2024-06-04T15:41:48.474 INFO:root:teuthology version: 0.0.1.dev303+g861a8dc 2024-06-04T15:41:48.474 DEBUG:teuthology.run:Teuthology command: teuthology --name cbodley-2024-06-04_15:11:52-rgw-main-distro-default-smithi --archive /home/teuthworker/archive/cbodley-2024-06-04_15:11:52-rgw-main-distro-default-smithi/7740770 --verbose --description rgw/verify/{0-install clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability inline-data$/{on} msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/ec s3tests-branch sharding$/{default} striping$/{stripe-equals-chunk} supported-random-distro$/{centos_latest} tasks/{bucket-check cls mp_reupload ragweed reshard s3tests-java s3tests versioning} validater/lockdep} --owner scheduled_cbodley@teuthology -- /home/teuthworker/archive/cbodley-2024-06-04_15:11:52-rgw-main-distro-default-smithi/7740770/orig.config.yaml 2024-06-04T15:41:48.517 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-06-04T15:41:48.609 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/cbodley-2024-06-04_15:11:52-rgw-main-distro-default-smithi/7740770 branch: main description: rgw/verify/{0-install clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability inline-data$/{on} msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/ec s3tests-branch sharding$/{default} striping$/{stripe-equals-chunk} supported-random-distro$/{centos_latest} tasks/{bucket-check cls mp_reupload ragweed reshard s3tests-java s3tests versioning} validater/lockdep} email: null first_in_suite: false job_id: '7740770' kernel: kdb: 1 sha1: distro last_in_suite: false machine_type: smithi name: cbodley-2024-06-04_15:11:52-rgw-main-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 10 os_type: centos os_version: 9.stream overrides: admin_socket: branch: main ceph: conf: client: debug rgw: 20 rgw bucket counters cache: true rgw crypt require ssl: false rgw crypt s3 kms backend: testing rgw crypt s3 kms encryption keys: testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= rgw torrent flag: true rgw user counters cache: true setgroup: ceph setuser: ceph global: mon client directed command retry: 5 ms inject socket failures: 5000 osd_max_pg_log_entries: 10 osd_min_pg_log_entries: 10 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 lockdep: true osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 lockdep: true mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd shutdown pgref assert: true flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(PG_AVAILABILITY\) - \(PG_DEGRADED\) - \(POOL_APP_NOT_ENABLED\) - not have an application enabled - \(OSD_SLOW_PING_TIME sha1: 65533a907fc9add1863609703fdbbea67993c8ef ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 65533a907fc9add1863609703fdbbea67993c8ef openssl_keys: rgw.client.0: ca: root client: client.0 embed-key: true root: client: client.0 cn: teuthology install: - client.0 key-type: rsa:4096 rgw: client.0: ssl certificate: rgw.client.0 compression type: random ec-data-pool: true frontend: beast storage classes: LUKEWARM, FROZEN s3tests: force-branch: ceph-master slow_backend: true storage classes: LUKEWARM, FROZEN thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: main sha1: 1fb5d10608dccee73edd6ef8a2c7b804a097c324 owner: scheduled_cbodley@teuthology priority: 75 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mon.c - mgr.y - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - node-exporter.a - - mon.b - mgr.x - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - prometheus.a - node-exporter.b seed: 4806 sha1: 65533a907fc9add1863609703fdbbea67993c8ef sleep_before_teardown: 0 subset: 1/3 suite: rgw suite_branch: main suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_1fb5d10608dccee73edd6ef8a2c7b804a097c324/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 1fb5d10608dccee73edd6ef8a2c7b804a097c324 targets: smithi144.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNQ9EUM6tfX7YL8vEtoaVQD6Zxg1awHwccMTbverH6oqS3y1Th0owLAQGyqQ7Fesz7cZy+us5LiB/w5Z44wjXCI= smithi177.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIKxsZ++k1S4y5fUAG0dNOpR87X3l2cA/RQLRi6aMDsmJrofMk8JwuHinkfOzL9VccwcxtM9H3PzyCguKtIPAdQ= tasks: - install: extra_system_packages: deb: - s3cmd - maven rpm: - s3cmd - maven - ceph: null - openssl_keys: null - rgw: client.0: null - tox: - client.0 - workunit: clients: client.0: - rgw/run-bucket-check.sh - workunit: clients: client.0: - cls/test_cls_lock.sh - cls/test_cls_log.sh - cls/test_cls_refcount.sh - cls/test_cls_rgw.sh - cls/test_cls_rgw_gc.sh - cls/test_cls_rgw_stats.sh - cls/test_cls_cmpomap.sh - cls/test_cls_2pc_queue.sh - rgw/test_rgw_gc_log.sh - rgw/test_rgw_obj.sh - rgw/test_librgw_file.sh - rgw/test_awssdkv4_sig.sh - workunit: clients: client.0: - rgw/test_rgw_s3_mp_reupload.sh - ragweed: client.0: default-branch: ceph-master rgw_server: client.0 stages: prepare,check - workunit: clients: client.0: - rgw/run-reshard.sh - s3tests-java: client.0: force-branch: ceph-master force-repo: https://github.com/ceph/java_s3tests.git - s3tests: client.0: rgw_server: client.0 - workunit: clients: client.0: - rgw/run-versioning.sh teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 861a8dcf7aa816a26e13f039336f7ed0a9aec0fa timestamp: 2024-06-04_15:11:52 tube: smithi user: cbodley verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2698841 2024-06-04T15:41:48.609 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_1fb5d10608dccee73edd6ef8a2c7b804a097c324/qa; will attempt to use it 2024-06-04T15:41:48.610 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_1fb5d10608dccee73edd6ef8a2c7b804a097c324/qa/tasks 2024-06-04T15:41:48.610 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-06-04T15:41:48.612 INFO:teuthology.task.internal:Checking packages... 2024-06-04T15:41:48.632 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '65533a907fc9add1863609703fdbbea67993c8ef' 2024-06-04T15:41:48.632 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-06-04T15:41:48.632 INFO:teuthology.packaging:ref: None 2024-06-04T15:41:48.632 INFO:teuthology.packaging:tag: None 2024-06-04T15:41:48.632 INFO:teuthology.packaging:branch: main 2024-06-04T15:41:48.632 INFO:teuthology.packaging:sha1: 65533a907fc9add1863609703fdbbea67993c8ef 2024-06-04T15:41:48.632 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=main 2024-06-04T15:41:49.043 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-4027.g65533a90 2024-06-04T15:41:49.045 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-06-04T15:41:49.052 INFO:teuthology.task.internal:no buildpackages task found 2024-06-04T15:41:49.052 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-06-04T15:41:49.074 INFO:teuthology.task.internal:Saving configuration 2024-06-04T15:41:49.091 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-06-04T15:41:49.097 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-06-04T15:41:49.120 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi144.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/cbodley-2024-06-04_15:11:52-rgw-main-distro-default-smithi/7740770', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-06-04 15:36:50.916352', 'locked_by': 'scheduled_cbodley@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNQ9EUM6tfX7YL8vEtoaVQD6Zxg1awHwccMTbverH6oqS3y1Th0owLAQGyqQ7Fesz7cZy+us5LiB/w5Z44wjXCI='} 2024-06-04T15:41:49.143 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi177.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/cbodley-2024-06-04_15:11:52-rgw-main-distro-default-smithi/7740770', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-06-04 15:36:50.915436', 'locked_by': 'scheduled_cbodley@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIKxsZ++k1S4y5fUAG0dNOpR87X3l2cA/RQLRi6aMDsmJrofMk8JwuHinkfOzL9VccwcxtM9H3PzyCguKtIPAdQ='} 2024-06-04T15:41:49.143 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-06-04T15:41:49.150 INFO:teuthology.task.internal:roles: ubuntu@smithi144.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2024-06-04T15:41:49.150 INFO:teuthology.task.internal:roles: ubuntu@smithi177.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2024-06-04T15:41:49.150 INFO:teuthology.run_tasks:Running task console_log... 2024-06-04T15:41:49.223 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f5e5b759120>, signals=[15]) 2024-06-04T15:41:49.223 INFO:teuthology.run_tasks:Running task internal.connect... 2024-06-04T15:41:49.230 INFO:teuthology.task.internal:Opening connections... 2024-06-04T15:41:49.230 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi144.front.sepia.ceph.com 2024-06-04T15:41:49.231 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi144.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-06-04T15:41:49.316 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi177.front.sepia.ceph.com 2024-06-04T15:41:49.317 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi177.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-06-04T15:41:49.390 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-06-04T15:41:49.397 DEBUG:teuthology.orchestra.run.smithi144:> uname -m 2024-06-04T15:41:49.415 INFO:teuthology.orchestra.run.smithi144.stdout:x86_64 2024-06-04T15:41:49.415 DEBUG:teuthology.orchestra.run.smithi144:> cat /etc/os-release 2024-06-04T15:41:49.471 INFO:teuthology.orchestra.run.smithi144.stdout:NAME="CentOS Stream" 2024-06-04T15:41:49.471 INFO:teuthology.orchestra.run.smithi144.stdout:VERSION="9" 2024-06-04T15:41:49.471 INFO:teuthology.orchestra.run.smithi144.stdout:ID="centos" 2024-06-04T15:41:49.471 INFO:teuthology.orchestra.run.smithi144.stdout:ID_LIKE="rhel fedora" 2024-06-04T15:41:49.472 INFO:teuthology.orchestra.run.smithi144.stdout:VERSION_ID="9" 2024-06-04T15:41:49.472 INFO:teuthology.orchestra.run.smithi144.stdout:PLATFORM_ID="platform:el9" 2024-06-04T15:41:49.472 INFO:teuthology.orchestra.run.smithi144.stdout:PRETTY_NAME="CentOS Stream 9" 2024-06-04T15:41:49.472 INFO:teuthology.orchestra.run.smithi144.stdout:ANSI_COLOR="0;31" 2024-06-04T15:41:49.472 INFO:teuthology.orchestra.run.smithi144.stdout:LOGO="fedora-logo-icon" 2024-06-04T15:41:49.472 INFO:teuthology.orchestra.run.smithi144.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-06-04T15:41:49.472 INFO:teuthology.orchestra.run.smithi144.stdout:HOME_URL="https://centos.org/" 2024-06-04T15:41:49.472 INFO:teuthology.orchestra.run.smithi144.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-06-04T15:41:49.472 INFO:teuthology.orchestra.run.smithi144.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-06-04T15:41:49.472 INFO:teuthology.orchestra.run.smithi144.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-06-04T15:41:49.473 INFO:teuthology.lock.ops:Updating smithi144.front.sepia.ceph.com on lock server 2024-06-04T15:41:49.507 DEBUG:teuthology.orchestra.run.smithi177:> uname -m 2024-06-04T15:41:49.525 INFO:teuthology.orchestra.run.smithi177.stdout:x86_64 2024-06-04T15:41:49.525 DEBUG:teuthology.orchestra.run.smithi177:> cat /etc/os-release 2024-06-04T15:41:49.582 INFO:teuthology.orchestra.run.smithi177.stdout:NAME="CentOS Stream" 2024-06-04T15:41:49.582 INFO:teuthology.orchestra.run.smithi177.stdout:VERSION="9" 2024-06-04T15:41:49.582 INFO:teuthology.orchestra.run.smithi177.stdout:ID="centos" 2024-06-04T15:41:49.582 INFO:teuthology.orchestra.run.smithi177.stdout:ID_LIKE="rhel fedora" 2024-06-04T15:41:49.582 INFO:teuthology.orchestra.run.smithi177.stdout:VERSION_ID="9" 2024-06-04T15:41:49.582 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM_ID="platform:el9" 2024-06-04T15:41:49.583 INFO:teuthology.orchestra.run.smithi177.stdout:PRETTY_NAME="CentOS Stream 9" 2024-06-04T15:41:49.583 INFO:teuthology.orchestra.run.smithi177.stdout:ANSI_COLOR="0;31" 2024-06-04T15:41:49.583 INFO:teuthology.orchestra.run.smithi177.stdout:LOGO="fedora-logo-icon" 2024-06-04T15:41:49.583 INFO:teuthology.orchestra.run.smithi177.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-06-04T15:41:49.583 INFO:teuthology.orchestra.run.smithi177.stdout:HOME_URL="https://centos.org/" 2024-06-04T15:41:49.583 INFO:teuthology.orchestra.run.smithi177.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-06-04T15:41:49.583 INFO:teuthology.orchestra.run.smithi177.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-06-04T15:41:49.583 INFO:teuthology.orchestra.run.smithi177.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-06-04T15:41:49.583 INFO:teuthology.lock.ops:Updating smithi177.front.sepia.ceph.com on lock server 2024-06-04T15:41:49.607 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-06-04T15:41:49.618 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-06-04T15:41:49.639 INFO:teuthology.task.internal:Checking for old test directory... 2024-06-04T15:41:49.639 DEBUG:teuthology.orchestra.run.smithi144:> test '!' -e /home/ubuntu/cephtest 2024-06-04T15:41:49.642 DEBUG:teuthology.orchestra.run.smithi177:> test '!' -e /home/ubuntu/cephtest 2024-06-04T15:41:49.658 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-06-04T15:41:49.664 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-06-04T15:41:49.664 DEBUG:teuthology.orchestra.run.smithi144:> test -z $(ls -A /var/lib/ceph) 2024-06-04T15:41:49.698 DEBUG:teuthology.orchestra.run.smithi177:> test -z $(ls -A /var/lib/ceph) 2024-06-04T15:41:49.804 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-06-04T15:41:49.860 INFO:teuthology.run_tasks:Running task kernel... 2024-06-04T15:41:49.875 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-06-04T15:41:49.875 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'mon.b': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-06-04T15:41:49.876 DEBUG:teuthology.orchestra.run.smithi144:> test -f /run/.containerenv -o -f /.dockerenv 2024-06-04T15:41:49.876 DEBUG:teuthology.orchestra.run.smithi177:> test -f /run/.containerenv -o -f /.dockerenv 2024-06-04T15:41:49.892 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-06-04T15:41:49.892 DEBUG:teuthology.orchestra.run.smithi177:> uname -r 2024-06-04T15:41:49.893 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-06-04T15:41:49.893 DEBUG:teuthology.orchestra.run.smithi144:> uname -r 2024-06-04T15:41:49.949 INFO:teuthology.orchestra.run.smithi177.stdout:5.14.0-437.el9.x86_64 2024-06-04T15:41:49.949 INFO:teuthology.task.kernel:Running kernel on smithi177: 5.14.0-437.el9.x86_64 2024-06-04T15:41:49.949 DEBUG:teuthology.orchestra.run.smithi177:> sudo yum install -y kernel 2024-06-04T15:41:49.951 INFO:teuthology.orchestra.run.smithi144.stdout:5.14.0-437.el9.x86_64 2024-06-04T15:41:49.951 INFO:teuthology.task.kernel:Running kernel on smithi144: 5.14.0-437.el9.x86_64 2024-06-04T15:41:49.951 DEBUG:teuthology.orchestra.run.smithi144:> sudo yum install -y kernel 2024-06-04T15:41:52.176 INFO:teuthology.orchestra.run.smithi177.stdout:CentOS Stream 9 - BaseOS 12 MB/s | 8.1 MB 00:00 2024-06-04T15:41:52.541 INFO:teuthology.orchestra.run.smithi144.stdout:CentOS Stream 9 - BaseOS 8.9 MB/s | 8.1 MB 00:00 2024-06-04T15:41:54.027 INFO:teuthology.orchestra.run.smithi177.stdout:CentOS Stream 9 - AppStream 25 MB/s | 19 MB 00:00 2024-06-04T15:41:54.401 INFO:teuthology.orchestra.run.smithi144.stdout:CentOS Stream 9 - AppStream 26 MB/s | 19 MB 00:00 2024-06-04T15:41:58.436 INFO:teuthology.orchestra.run.smithi177.stdout:CentOS Stream 9 - CRB 9.0 MB/s | 6.2 MB 00:00 2024-06-04T15:41:59.060 INFO:teuthology.orchestra.run.smithi144.stdout:CentOS Stream 9 - CRB 5.7 MB/s | 6.2 MB 00:01 2024-06-04T15:42:00.302 INFO:teuthology.orchestra.run.smithi177.stdout:CentOS Stream 9 - Extras packages 32 kB/s | 17 kB 00:00 2024-06-04T15:42:00.959 INFO:teuthology.orchestra.run.smithi144.stdout:CentOS Stream 9 - Extras packages 32 kB/s | 17 kB 00:00 2024-06-04T15:42:01.788 INFO:teuthology.orchestra.run.smithi177.stdout:Extra Packages for Enterprise Linux 16 MB/s | 21 MB 00:01 2024-06-04T15:42:02.104 INFO:teuthology.orchestra.run.smithi144.stdout:Extra Packages for Enterprise Linux 21 MB/s | 21 MB 00:01 2024-06-04T15:42:07.027 INFO:teuthology.orchestra.run.smithi177.stdout:lab-extras 17 kB/s | 1.7 kB 00:00 2024-06-04T15:42:07.359 INFO:teuthology.orchestra.run.smithi144.stdout:lab-extras 17 kB/s | 1.7 kB 00:00 2024-06-04T15:42:09.050 INFO:teuthology.orchestra.run.smithi177.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-06-04T15:42:09.050 INFO:teuthology.orchestra.run.smithi177.stdout:Package kernel-5.14.0-437.el9.x86_64 is already installed. 2024-06-04T15:42:09.137 INFO:teuthology.orchestra.run.smithi177.stdout:Dependencies resolved. 2024-06-04T15:42:09.145 INFO:teuthology.orchestra.run.smithi177.stdout:================================================================================ 2024-06-04T15:42:09.145 INFO:teuthology.orchestra.run.smithi177.stdout: Package Architecture Version Repository Size 2024-06-04T15:42:09.145 INFO:teuthology.orchestra.run.smithi177.stdout:================================================================================ 2024-06-04T15:42:09.145 INFO:teuthology.orchestra.run.smithi177.stdout:Installing: 2024-06-04T15:42:09.145 INFO:teuthology.orchestra.run.smithi177.stdout: kernel x86_64 5.14.0-452.el9 baseos 893 k 2024-06-04T15:42:09.145 INFO:teuthology.orchestra.run.smithi177.stdout:Installing dependencies: 2024-06-04T15:42:09.145 INFO:teuthology.orchestra.run.smithi177.stdout: kernel-core x86_64 5.14.0-452.el9 baseos 16 M 2024-06-04T15:42:09.145 INFO:teuthology.orchestra.run.smithi177.stdout: kernel-modules x86_64 5.14.0-452.el9 baseos 35 M 2024-06-04T15:42:09.146 INFO:teuthology.orchestra.run.smithi177.stdout: kernel-modules-core x86_64 5.14.0-452.el9 baseos 29 M 2024-06-04T15:42:09.146 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-06-04T15:42:09.146 INFO:teuthology.orchestra.run.smithi177.stdout:Transaction Summary 2024-06-04T15:42:09.146 INFO:teuthology.orchestra.run.smithi177.stdout:================================================================================ 2024-06-04T15:42:09.146 INFO:teuthology.orchestra.run.smithi177.stdout:Install 4 Packages 2024-06-04T15:42:09.146 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-06-04T15:42:09.146 INFO:teuthology.orchestra.run.smithi177.stdout:Total download size: 80 M 2024-06-04T15:42:09.147 INFO:teuthology.orchestra.run.smithi177.stdout:Installed size: 124 M 2024-06-04T15:42:09.147 INFO:teuthology.orchestra.run.smithi177.stdout:Downloading Packages: 2024-06-04T15:42:09.344 INFO:teuthology.orchestra.run.smithi177.stdout:[MIRROR] kernel-core-5.14.0-452.el9.x86_64.rpm: Status code: 404 for https://download-cc-rdu01.fedoraproject.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-core-5.14.0-452.el9.x86_64.rpm (IP: 8.43.85.72) 2024-06-04T15:42:09.344 INFO:teuthology.orchestra.run.smithi177.stdout:[MIRROR] kernel-modules-5.14.0-452.el9.x86_64.rpm: Status code: 404 for https://download-cc-rdu01.fedoraproject.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-modules-5.14.0-452.el9.x86_64.rpm (IP: 8.43.85.72) 2024-06-04T15:42:09.348 INFO:teuthology.orchestra.run.smithi177.stdout:[MIRROR] kernel-5.14.0-452.el9.x86_64.rpm: Status code: 404 for https://download-cc-rdu01.fedoraproject.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-5.14.0-452.el9.x86_64.rpm (IP: 8.43.85.72) 2024-06-04T15:42:09.391 INFO:teuthology.orchestra.run.smithi144.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-06-04T15:42:09.391 INFO:teuthology.orchestra.run.smithi144.stdout:Package kernel-5.14.0-437.el9.x86_64 is already installed. 2024-06-04T15:42:09.484 INFO:teuthology.orchestra.run.smithi144.stdout:Dependencies resolved. 2024-06-04T15:42:09.489 INFO:teuthology.orchestra.run.smithi177.stdout:(1/4): kernel-5.14.0-452.el9.x86_64.rpm 3.9 MB/s | 893 kB 00:00 2024-06-04T15:42:09.489 INFO:teuthology.orchestra.run.smithi144.stdout:================================================================================ 2024-06-04T15:42:09.489 INFO:teuthology.orchestra.run.smithi144.stdout: Package Architecture Version Repository Size 2024-06-04T15:42:09.489 INFO:teuthology.orchestra.run.smithi144.stdout:================================================================================ 2024-06-04T15:42:09.489 INFO:teuthology.orchestra.run.smithi144.stdout:Installing: 2024-06-04T15:42:09.489 INFO:teuthology.orchestra.run.smithi144.stdout: kernel x86_64 5.14.0-452.el9 baseos 893 k 2024-06-04T15:42:09.490 INFO:teuthology.orchestra.run.smithi144.stdout:Installing dependencies: 2024-06-04T15:42:09.490 INFO:teuthology.orchestra.run.smithi144.stdout: kernel-core x86_64 5.14.0-452.el9 baseos 16 M 2024-06-04T15:42:09.490 INFO:teuthology.orchestra.run.smithi144.stdout: kernel-modules x86_64 5.14.0-452.el9 baseos 35 M 2024-06-04T15:42:09.490 INFO:teuthology.orchestra.run.smithi144.stdout: kernel-modules-core x86_64 5.14.0-452.el9 baseos 29 M 2024-06-04T15:42:09.490 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T15:42:09.490 INFO:teuthology.orchestra.run.smithi144.stdout:Transaction Summary 2024-06-04T15:42:09.490 INFO:teuthology.orchestra.run.smithi144.stdout:================================================================================ 2024-06-04T15:42:09.490 INFO:teuthology.orchestra.run.smithi144.stdout:Install 4 Packages 2024-06-04T15:42:09.490 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T15:42:09.491 INFO:teuthology.orchestra.run.smithi144.stdout:Total download size: 80 M 2024-06-04T15:42:09.491 INFO:teuthology.orchestra.run.smithi144.stdout:Installed size: 124 M 2024-06-04T15:42:09.491 INFO:teuthology.orchestra.run.smithi144.stdout:Downloading Packages: 2024-06-04T15:42:09.642 INFO:teuthology.orchestra.run.smithi144.stdout:[MIRROR] kernel-5.14.0-452.el9.x86_64.rpm: Status code: 404 for https://download-cc-rdu01.fedoraproject.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-5.14.0-452.el9.x86_64.rpm (IP: 8.43.85.72) 2024-06-04T15:42:09.644 INFO:teuthology.orchestra.run.smithi144.stdout:[MIRROR] kernel-core-5.14.0-452.el9.x86_64.rpm: Status code: 404 for https://download-cc-rdu01.fedoraproject.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-core-5.14.0-452.el9.x86_64.rpm (IP: 8.43.85.72) 2024-06-04T15:42:09.647 INFO:teuthology.orchestra.run.smithi144.stdout:[MIRROR] kernel-modules-5.14.0-452.el9.x86_64.rpm: Status code: 404 for https://download-cc-rdu01.fedoraproject.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-modules-5.14.0-452.el9.x86_64.rpm (IP: 8.43.85.72) 2024-06-04T15:42:09.748 INFO:teuthology.orchestra.run.smithi177.stdout:(2/4): kernel-core-5.14.0-452.el9.x86_64.rpm 33 MB/s | 16 MB 00:00 2024-06-04T15:42:09.852 INFO:teuthology.orchestra.run.smithi144.stdout:(1/4): kernel-5.14.0-452.el9.x86_64.rpm 2.9 MB/s | 893 kB 00:00 2024-06-04T15:42:10.181 INFO:teuthology.orchestra.run.smithi177.stdout:(3/4): kernel-modules-5.14.0-452.el9.x86_64.rpm 38 MB/s | 35 MB 00:00 2024-06-04T15:42:10.456 INFO:teuthology.orchestra.run.smithi177.stdout:(4/4): kernel-modules-core-5.14.0-452.el9.x86_6 30 MB/s | 29 MB 00:00 2024-06-04T15:42:10.459 INFO:teuthology.orchestra.run.smithi177.stdout:-------------------------------------------------------------------------------- 2024-06-04T15:42:10.459 INFO:teuthology.orchestra.run.smithi177.stdout:Total 61 MB/s | 80 MB 00:01 2024-06-04T15:42:11.159 INFO:teuthology.orchestra.run.smithi177.stdout:Running transaction check 2024-06-04T15:42:11.501 INFO:teuthology.orchestra.run.smithi177.stdout:Transaction check succeeded. 2024-06-04T15:42:11.501 INFO:teuthology.orchestra.run.smithi177.stdout:Running transaction test 2024-06-04T15:42:12.253 INFO:teuthology.orchestra.run.smithi144.stdout:(2/4): kernel-core-5.14.0-452.el9.x86_64.rpm 5.9 MB/s | 16 MB 00:02 2024-06-04T15:42:12.444 INFO:teuthology.orchestra.run.smithi177.stdout:Transaction test succeeded. 2024-06-04T15:42:12.445 INFO:teuthology.orchestra.run.smithi177.stdout:Running transaction 2024-06-04T15:42:12.594 INFO:teuthology.orchestra.run.smithi144.stdout:(3/4): kernel-modules-5.14.0-452.el9.x86_64.rpm 11 MB/s | 35 MB 00:03 2024-06-04T15:42:13.236 INFO:teuthology.orchestra.run.smithi144.stdout:(4/4): kernel-modules-core-5.14.0-452.el9.x86_6 8.5 MB/s | 29 MB 00:03 2024-06-04T15:42:13.239 INFO:teuthology.orchestra.run.smithi144.stdout:-------------------------------------------------------------------------------- 2024-06-04T15:42:13.239 INFO:teuthology.orchestra.run.smithi144.stdout:Total 21 MB/s | 80 MB 00:03 2024-06-04T15:42:13.941 INFO:teuthology.orchestra.run.smithi144.stdout:Running transaction check 2024-06-04T15:42:14.282 INFO:teuthology.orchestra.run.smithi144.stdout:Transaction check succeeded. 2024-06-04T15:42:14.282 INFO:teuthology.orchestra.run.smithi144.stdout:Running transaction test 2024-06-04T15:42:14.838 INFO:teuthology.orchestra.run.smithi177.stdout: Preparing : 1/1 2024-06-04T15:42:15.220 INFO:teuthology.orchestra.run.smithi144.stdout:Transaction test succeeded. 2024-06-04T15:42:15.221 INFO:teuthology.orchestra.run.smithi144.stdout:Running transaction 2024-06-04T15:42:15.515 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : kernel-modules-core-5.14.0-452.el9.x86_64 1/4 2024-06-04T15:42:15.607 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : kernel-core-5.14.0-452.el9.x86_64 2/4 2024-06-04T15:42:17.655 INFO:teuthology.orchestra.run.smithi144.stdout: Preparing : 1/1 2024-06-04T15:42:18.253 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: kernel-core-5.14.0-452.el9.x86_64 2/4 2024-06-04T15:42:18.361 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : kernel-modules-core-5.14.0-452.el9.x86_64 1/4 2024-06-04T15:42:18.388 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : kernel-modules-5.14.0-452.el9.x86_64 3/4 2024-06-04T15:42:18.445 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : kernel-core-5.14.0-452.el9.x86_64 2/4 2024-06-04T15:42:21.104 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: kernel-core-5.14.0-452.el9.x86_64 2/4 2024-06-04T15:42:21.250 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : kernel-modules-5.14.0-452.el9.x86_64 3/4 2024-06-04T15:42:23.115 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: kernel-modules-5.14.0-452.el9.x86_64 3/4 2024-06-04T15:42:23.235 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : kernel-5.14.0-452.el9.x86_64 4/4 2024-06-04T15:42:25.975 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: kernel-modules-5.14.0-452.el9.x86_64 3/4 2024-06-04T15:42:26.022 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : kernel-5.14.0-452.el9.x86_64 4/4 2024-06-04T15:42:28.006 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: kernel-modules-core-5.14.0-452.el9.x86_64 4/4 2024-06-04T15:42:30.797 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: kernel-modules-core-5.14.0-452.el9.x86_64 4/4 2024-06-04T15:42:57.435 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: kernel-core-5.14.0-452.el9.x86_64 4/4 2024-06-04T15:42:57.475 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: kernel-modules-5.14.0-452.el9.x86_64 4/4 2024-06-04T15:42:57.857 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: kernel-5.14.0-452.el9.x86_64 4/4 2024-06-04T15:42:57.857 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : kernel-5.14.0-452.el9.x86_64 1/4 2024-06-04T15:42:57.857 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : kernel-core-5.14.0-452.el9.x86_64 2/4 2024-06-04T15:42:57.857 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : kernel-modules-5.14.0-452.el9.x86_64 3/4 2024-06-04T15:42:58.641 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : kernel-modules-core-5.14.0-452.el9.x86_64 4/4 2024-06-04T15:42:58.642 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-06-04T15:42:58.642 INFO:teuthology.orchestra.run.smithi177.stdout:Installed: 2024-06-04T15:42:58.642 INFO:teuthology.orchestra.run.smithi177.stdout: kernel-5.14.0-452.el9.x86_64 2024-06-04T15:42:58.642 INFO:teuthology.orchestra.run.smithi177.stdout: kernel-core-5.14.0-452.el9.x86_64 2024-06-04T15:42:58.642 INFO:teuthology.orchestra.run.smithi177.stdout: kernel-modules-5.14.0-452.el9.x86_64 2024-06-04T15:42:58.642 INFO:teuthology.orchestra.run.smithi177.stdout: kernel-modules-core-5.14.0-452.el9.x86_64 2024-06-04T15:42:58.642 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-06-04T15:42:58.642 INFO:teuthology.orchestra.run.smithi177.stdout:Complete! 2024-06-04T15:42:59.014 DEBUG:teuthology.orchestra.run.smithi177:> rpm -q kernel | sort -rV | head -n 1 2024-06-04T15:42:59.114 INFO:teuthology.orchestra.run.smithi177.stdout:kernel-5.14.0-452.el9.x86_64 2024-06-04T15:42:59.115 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-452.el9.x86_64 2024-06-04T15:42:59.115 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-437.el9.x86_64 Expected: 5.14.0-452.el9.x86_64 2024-06-04T15:42:59.115 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-06-04T15:42:59.115 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-06-04T15:42:59.115 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2024-06-04T15:42:59.115 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi177.front.sepia.ceph.com, path=None, version=distro) 2024-06-04T15:42:59.115 DEBUG:teuthology.orchestra.run.smithi177:> rpm -q kernel | sort -rV | head -n 1 2024-06-04T15:42:59.167 INFO:teuthology.orchestra.run.smithi177.stdout:kernel-5.14.0-452.el9.x86_64 2024-06-04T15:42:59.167 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-452.el9.x86_64 2024-06-04T15:42:59.167 DEBUG:teuthology.orchestra.run.smithi177:> sudo rpm -qi grub2-tools 2024-06-04T15:42:59.201 INFO:teuthology.orchestra.run.smithi177.stdout:Name : grub2-tools 2024-06-04T15:42:59.201 INFO:teuthology.orchestra.run.smithi177.stdout:Epoch : 1 2024-06-04T15:42:59.201 INFO:teuthology.orchestra.run.smithi177.stdout:Version : 2.06 2024-06-04T15:42:59.201 INFO:teuthology.orchestra.run.smithi177.stdout:Release : 68.el9 2024-06-04T15:42:59.201 INFO:teuthology.orchestra.run.smithi177.stdout:Architecture: x86_64 2024-06-04T15:42:59.201 INFO:teuthology.orchestra.run.smithi177.stdout:Install Date: Fri 19 Apr 2024 09:32:39 PM UTC 2024-06-04T15:42:59.201 INFO:teuthology.orchestra.run.smithi177.stdout:Group : Unspecified 2024-06-04T15:42:59.201 INFO:teuthology.orchestra.run.smithi177.stdout:Size : 8264254 2024-06-04T15:42:59.201 INFO:teuthology.orchestra.run.smithi177.stdout:License : GPLv3+ 2024-06-04T15:42:59.201 INFO:teuthology.orchestra.run.smithi177.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-06-04T15:42:59.201 INFO:teuthology.orchestra.run.smithi177.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-06-04T15:42:59.202 INFO:teuthology.orchestra.run.smithi177.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-06-04T15:42:59.202 INFO:teuthology.orchestra.run.smithi177.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-06-04T15:42:59.202 INFO:teuthology.orchestra.run.smithi177.stdout:Packager : builder@centos.org 2024-06-04T15:42:59.202 INFO:teuthology.orchestra.run.smithi177.stdout:Vendor : CentOS 2024-06-04T15:42:59.202 INFO:teuthology.orchestra.run.smithi177.stdout:URL : http://www.gnu.org/software/grub/ 2024-06-04T15:42:59.202 INFO:teuthology.orchestra.run.smithi177.stdout:Summary : Support tools for GRUB. 2024-06-04T15:42:59.202 INFO:teuthology.orchestra.run.smithi177.stdout:Description : 2024-06-04T15:42:59.202 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-06-04T15:42:59.202 INFO:teuthology.orchestra.run.smithi177.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-06-04T15:42:59.202 INFO:teuthology.orchestra.run.smithi177.stdout:customizable bootloader with modular architecture. It supports a rich 2024-06-04T15:42:59.203 INFO:teuthology.orchestra.run.smithi177.stdout:variety of kernel formats, file systems, computer architectures and 2024-06-04T15:42:59.203 INFO:teuthology.orchestra.run.smithi177.stdout:hardware devices. 2024-06-04T15:42:59.203 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-06-04T15:42:59.203 INFO:teuthology.orchestra.run.smithi177.stdout:This subpackage provides tools for support of all platforms. 2024-06-04T15:42:59.205 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-06-04T15:42:59.205 INFO:teuthology.task.kernel:Updating grub on smithi177 to boot 5.14.0-452.el9.x86_64 2024-06-04T15:42:59.205 DEBUG:teuthology.orchestra.run.smithi177:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-06-04T15:42:59.856 INFO:teuthology.orchestra.run.smithi177.stderr:Generating grub configuration file ... 2024-06-04T15:43:00.638 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: kernel-core-5.14.0-452.el9.x86_64 4/4 2024-06-04T15:43:00.679 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: kernel-modules-5.14.0-452.el9.x86_64 4/4 2024-06-04T15:43:01.035 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: kernel-5.14.0-452.el9.x86_64 4/4 2024-06-04T15:43:01.035 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : kernel-5.14.0-452.el9.x86_64 1/4 2024-06-04T15:43:01.035 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : kernel-core-5.14.0-452.el9.x86_64 2/4 2024-06-04T15:43:01.035 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : kernel-modules-5.14.0-452.el9.x86_64 3/4 2024-06-04T15:43:01.203 INFO:teuthology.orchestra.run.smithi177.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-06-04T15:43:01.218 INFO:teuthology.orchestra.run.smithi177.stderr:done 2024-06-04T15:43:01.221 DEBUG:teuthology.orchestra.run.smithi177:> mktemp 2024-06-04T15:43:01.238 INFO:teuthology.orchestra.run.smithi177.stdout:/tmp/tmp.54e6WgGkeY 2024-06-04T15:43:01.238 DEBUG:teuthology.orchestra.run.smithi177:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.54e6WgGkeY 2024-06-04T15:43:01.304 DEBUG:teuthology.orchestra.run.smithi177:> sudo chmod 0666 /tmp/tmp.54e6WgGkeY 2024-06-04T15:43:01.439 DEBUG:teuthology.orchestra.remote:smithi177:/tmp/tmp.54e6WgGkeY is 6KB 2024-06-04T15:43:01.487 DEBUG:teuthology.orchestra.run.smithi177:> rm -fr /tmp/tmp.54e6WgGkeY 2024-06-04T15:43:01.501 DEBUG:teuthology.orchestra.run.smithi177:> sudo /bin/ls /boot/loader/entries || true 2024-06-04T15:43:01.569 INFO:teuthology.orchestra.run.smithi177.stdout:7fc8828e06d0482694bcf4a447d13cb6-0-rescue.conf 2024-06-04T15:43:01.570 INFO:teuthology.orchestra.run.smithi177.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-239.el9.x86_64.conf 2024-06-04T15:43:01.570 INFO:teuthology.orchestra.run.smithi177.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-437.el9.x86_64.conf 2024-06-04T15:43:01.570 INFO:teuthology.orchestra.run.smithi177.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-452.el9.x86_64.conf 2024-06-04T15:43:01.571 DEBUG:teuthology.orchestra.run.smithi177:> sudo grub2-set-default 7fc8828e06d0482694bcf4a447d13cb6-5.14.0-452.el9.x86_64 2024-06-04T15:43:01.761 DEBUG:teuthology.orchestra.run.smithi177:> sudo shutdown -r now 2024-06-04T15:43:01.861 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : kernel-modules-core-5.14.0-452.el9.x86_64 4/4 2024-06-04T15:43:01.861 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T15:43:01.861 INFO:teuthology.orchestra.run.smithi144.stdout:Installed: 2024-06-04T15:43:01.861 INFO:teuthology.orchestra.run.smithi144.stdout: kernel-5.14.0-452.el9.x86_64 2024-06-04T15:43:01.861 INFO:teuthology.orchestra.run.smithi144.stdout: kernel-core-5.14.0-452.el9.x86_64 2024-06-04T15:43:01.861 INFO:teuthology.orchestra.run.smithi144.stdout: kernel-modules-5.14.0-452.el9.x86_64 2024-06-04T15:43:01.861 INFO:teuthology.orchestra.run.smithi144.stdout: kernel-modules-core-5.14.0-452.el9.x86_64 2024-06-04T15:43:01.861 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T15:43:01.862 INFO:teuthology.orchestra.run.smithi144.stdout:Complete! 2024-06-04T15:43:02.233 DEBUG:teuthology.orchestra.run.smithi144:> rpm -q kernel | sort -rV | head -n 1 2024-06-04T15:43:02.315 INFO:teuthology.orchestra.run.smithi144.stdout:kernel-5.14.0-452.el9.x86_64 2024-06-04T15:43:02.315 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-452.el9.x86_64 2024-06-04T15:43:02.315 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-437.el9.x86_64 Expected: 5.14.0-452.el9.x86_64 2024-06-04T15:43:02.315 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-06-04T15:43:02.315 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-06-04T15:43:02.315 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-06-04T15:43:02.316 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi144.front.sepia.ceph.com, path=None, version=distro) 2024-06-04T15:43:02.316 DEBUG:teuthology.orchestra.run.smithi144:> rpm -q kernel | sort -rV | head -n 1 2024-06-04T15:43:02.368 INFO:teuthology.orchestra.run.smithi144.stdout:kernel-5.14.0-452.el9.x86_64 2024-06-04T15:43:02.368 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-452.el9.x86_64 2024-06-04T15:43:02.368 DEBUG:teuthology.orchestra.run.smithi144:> sudo rpm -qi grub2-tools 2024-06-04T15:43:02.399 INFO:teuthology.orchestra.run.smithi144.stdout:Name : grub2-tools 2024-06-04T15:43:02.399 INFO:teuthology.orchestra.run.smithi144.stdout:Epoch : 1 2024-06-04T15:43:02.399 INFO:teuthology.orchestra.run.smithi144.stdout:Version : 2.06 2024-06-04T15:43:02.400 INFO:teuthology.orchestra.run.smithi144.stdout:Release : 68.el9 2024-06-04T15:43:02.400 INFO:teuthology.orchestra.run.smithi144.stdout:Architecture: x86_64 2024-06-04T15:43:02.400 INFO:teuthology.orchestra.run.smithi144.stdout:Install Date: Fri 19 Apr 2024 09:32:39 PM UTC 2024-06-04T15:43:02.400 INFO:teuthology.orchestra.run.smithi144.stdout:Group : Unspecified 2024-06-04T15:43:02.400 INFO:teuthology.orchestra.run.smithi144.stdout:Size : 8264254 2024-06-04T15:43:02.400 INFO:teuthology.orchestra.run.smithi144.stdout:License : GPLv3+ 2024-06-04T15:43:02.400 INFO:teuthology.orchestra.run.smithi144.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-06-04T15:43:02.400 INFO:teuthology.orchestra.run.smithi144.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-06-04T15:43:02.400 INFO:teuthology.orchestra.run.smithi144.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-06-04T15:43:02.400 INFO:teuthology.orchestra.run.smithi144.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-06-04T15:43:02.401 INFO:teuthology.orchestra.run.smithi144.stdout:Packager : builder@centos.org 2024-06-04T15:43:02.401 INFO:teuthology.orchestra.run.smithi144.stdout:Vendor : CentOS 2024-06-04T15:43:02.401 INFO:teuthology.orchestra.run.smithi144.stdout:URL : http://www.gnu.org/software/grub/ 2024-06-04T15:43:02.401 INFO:teuthology.orchestra.run.smithi144.stdout:Summary : Support tools for GRUB. 2024-06-04T15:43:02.401 INFO:teuthology.orchestra.run.smithi144.stdout:Description : 2024-06-04T15:43:02.401 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T15:43:02.401 INFO:teuthology.orchestra.run.smithi144.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-06-04T15:43:02.401 INFO:teuthology.orchestra.run.smithi144.stdout:customizable bootloader with modular architecture. It supports a rich 2024-06-04T15:43:02.401 INFO:teuthology.orchestra.run.smithi144.stdout:variety of kernel formats, file systems, computer architectures and 2024-06-04T15:43:02.401 INFO:teuthology.orchestra.run.smithi144.stdout:hardware devices. 2024-06-04T15:43:02.401 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T15:43:02.401 INFO:teuthology.orchestra.run.smithi144.stdout:This subpackage provides tools for support of all platforms. 2024-06-04T15:43:02.402 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-06-04T15:43:02.402 INFO:teuthology.task.kernel:Updating grub on smithi144 to boot 5.14.0-452.el9.x86_64 2024-06-04T15:43:02.402 DEBUG:teuthology.orchestra.run.smithi144:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-06-04T15:43:03.003 INFO:teuthology.orchestra.run.smithi144.stderr:Generating grub configuration file ... 2024-06-04T15:43:04.423 INFO:teuthology.orchestra.run.smithi144.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-06-04T15:43:04.454 INFO:teuthology.orchestra.run.smithi144.stderr:done 2024-06-04T15:43:04.457 DEBUG:teuthology.orchestra.run.smithi144:> mktemp 2024-06-04T15:43:04.472 INFO:teuthology.orchestra.run.smithi144.stdout:/tmp/tmp.xuHoRPEQWA 2024-06-04T15:43:04.472 DEBUG:teuthology.orchestra.run.smithi144:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.xuHoRPEQWA 2024-06-04T15:43:04.538 DEBUG:teuthology.orchestra.run.smithi144:> sudo chmod 0666 /tmp/tmp.xuHoRPEQWA 2024-06-04T15:43:04.679 DEBUG:teuthology.orchestra.remote:smithi144:/tmp/tmp.xuHoRPEQWA is 6KB 2024-06-04T15:43:04.727 DEBUG:teuthology.orchestra.run.smithi144:> rm -fr /tmp/tmp.xuHoRPEQWA 2024-06-04T15:43:04.741 DEBUG:teuthology.orchestra.run.smithi144:> sudo /bin/ls /boot/loader/entries || true 2024-06-04T15:43:04.803 INFO:teuthology.orchestra.run.smithi144.stdout:7fc8828e06d0482694bcf4a447d13cb6-0-rescue.conf 2024-06-04T15:43:04.803 INFO:teuthology.orchestra.run.smithi144.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-239.el9.x86_64.conf 2024-06-04T15:43:04.803 INFO:teuthology.orchestra.run.smithi144.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-437.el9.x86_64.conf 2024-06-04T15:43:04.804 INFO:teuthology.orchestra.run.smithi144.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-452.el9.x86_64.conf 2024-06-04T15:43:04.805 DEBUG:teuthology.orchestra.run.smithi144:> sudo grub2-set-default 7fc8828e06d0482694bcf4a447d13cb6-5.14.0-452.el9.x86_64 2024-06-04T15:43:04.957 DEBUG:teuthology.orchestra.run.smithi144:> sudo shutdown -r now 2024-06-04T15:43:31.783 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-06-04T15:43:31.784 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi177.front.sepia.ceph.com' 2024-06-04T15:43:31.785 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi177.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-06-04T15:43:34.963 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-06-04T15:43:34.964 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi144.front.sepia.ceph.com' 2024-06-04T15:43:34.964 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi144.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-06-04T15:43:50.302 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.177 2024-06-04T15:43:53.378 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.144 2024-06-04T15:43:59.305 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi177.front.sepia.ceph.com' 2024-06-04T15:43:59.306 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi177.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-06-04T15:44:02.366 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.177 2024-06-04T15:44:02.379 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi144.front.sepia.ceph.com' 2024-06-04T15:44:02.380 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi144.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-06-04T15:44:05.438 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.144 2024-06-04T15:44:14.370 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi177.front.sepia.ceph.com' 2024-06-04T15:44:14.371 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi177.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-06-04T15:44:17.442 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi144.front.sepia.ceph.com' 2024-06-04T15:44:17.443 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi144.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-06-04T15:44:32.798 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.177 2024-06-04T15:44:47.813 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi177.front.sepia.ceph.com' 2024-06-04T15:44:47.814 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi177.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-06-04T15:44:48.115 DEBUG:teuthology.orchestra.run.smithi177:> true 2024-06-04T15:44:48.516 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi177.front.sepia.ceph.com' 2024-06-04T15:44:48.516 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-452.el9.x86_64"... 2024-06-04T15:44:48.517 DEBUG:teuthology.orchestra.run.smithi177:> uname -r 2024-06-04T15:44:48.531 INFO:teuthology.orchestra.run.smithi177.stdout:5.14.0-452.el9.x86_64 2024-06-04T15:44:48.531 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-452.el9.x86_64 vs 5.14.0-452.el9.x86_64 2024-06-04T15:44:48.531 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-06-04T15:44:48.532 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-06-04T15:44:49.472 DEBUG:teuthology.orchestra.run.smithi144:> true 2024-06-04T15:44:49.532 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-06-04T15:44:49.533 DEBUG:teuthology.orchestra.run.smithi177:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-06-04T15:44:49.624 INFO:teuthology.orchestra.run.smithi177.stdout:ttyS1 2024-06-04T15:44:49.666 DEBUG:teuthology.parallel:result is None 2024-06-04T15:44:49.838 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi144.front.sepia.ceph.com' 2024-06-04T15:44:49.838 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-452.el9.x86_64"... 2024-06-04T15:44:49.839 DEBUG:teuthology.orchestra.run.smithi144:> uname -r 2024-06-04T15:44:49.853 INFO:teuthology.orchestra.run.smithi144.stdout:5.14.0-452.el9.x86_64 2024-06-04T15:44:49.853 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-452.el9.x86_64 vs 5.14.0-452.el9.x86_64 2024-06-04T15:44:49.854 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-06-04T15:44:49.854 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-06-04T15:44:50.854 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-06-04T15:44:50.855 DEBUG:teuthology.orchestra.run.smithi144:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-06-04T15:44:50.909 INFO:teuthology.orchestra.run.smithi144.stdout:ttyS1 2024-06-04T15:44:50.943 DEBUG:teuthology.parallel:result is None 2024-06-04T15:44:50.943 INFO:teuthology.run_tasks:Running task internal.base... 2024-06-04T15:44:50.951 INFO:teuthology.task.internal:Creating test directory... 2024-06-04T15:44:50.951 DEBUG:teuthology.orchestra.run.smithi144:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-06-04T15:44:50.953 DEBUG:teuthology.orchestra.run.smithi177:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-06-04T15:44:50.993 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-06-04T15:44:50.999 INFO:teuthology.run_tasks:Running task internal.archive... 2024-06-04T15:44:51.028 INFO:teuthology.task.internal:Creating archive directory... 2024-06-04T15:44:51.028 DEBUG:teuthology.orchestra.run.smithi144:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-06-04T15:44:51.031 DEBUG:teuthology.orchestra.run.smithi177:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-06-04T15:44:51.107 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-06-04T15:44:51.114 INFO:teuthology.task.internal:Enabling coredump saving... 2024-06-04T15:44:51.114 DEBUG:teuthology.orchestra.run.smithi144:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-06-04T15:44:51.117 DEBUG:teuthology.orchestra.run.smithi177:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-06-04T15:44:51.146 INFO:teuthology.orchestra.run.smithi144.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-06-04T15:44:51.157 INFO:teuthology.orchestra.run.smithi144.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-06-04T15:44:51.174 INFO:teuthology.orchestra.run.smithi177.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-06-04T15:44:51.192 INFO:teuthology.orchestra.run.smithi177.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-06-04T15:44:51.198 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-06-04T15:44:51.204 INFO:teuthology.task.internal:Configuring sudo... 2024-06-04T15:44:51.205 DEBUG:teuthology.orchestra.run.smithi144:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-06-04T15:44:51.207 DEBUG:teuthology.orchestra.run.smithi177:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-06-04T15:44:51.262 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-06-04T15:44:51.272 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-06-04T15:44:51.273 DEBUG:teuthology.orchestra.run.smithi144:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-06-04T15:44:51.275 DEBUG:teuthology.orchestra.run.smithi177:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-06-04T15:44:51.309 DEBUG:teuthology.orchestra.run.smithi144:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-06-04T15:44:51.369 DEBUG:teuthology.orchestra.run.smithi144:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-06-04T15:44:51.425 DEBUG:teuthology.orchestra.run.smithi144:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-06-04T15:44:51.506 DEBUG:teuthology.orchestra.run.smithi144:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-06-04T15:44:51.553 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-06-04T15:44:51.553 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-06-04T15:44:51.619 DEBUG:teuthology.orchestra.run.smithi177:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-06-04T15:44:51.657 DEBUG:teuthology.orchestra.run.smithi177:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-06-04T15:44:51.765 DEBUG:teuthology.orchestra.run.smithi177:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-06-04T15:44:51.800 DEBUG:teuthology.orchestra.run.smithi177:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-06-04T15:44:51.847 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-06-04T15:44:51.847 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-06-04T15:44:51.912 DEBUG:teuthology.orchestra.run.smithi144:> sudo service rsyslog restart 2024-06-04T15:44:51.915 DEBUG:teuthology.orchestra.run.smithi177:> sudo service rsyslog restart 2024-06-04T15:44:51.950 INFO:teuthology.orchestra.run.smithi144.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-06-04T15:44:52.075 INFO:teuthology.orchestra.run.smithi177.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-06-04T15:44:52.475 INFO:teuthology.run_tasks:Running task internal.timer... 2024-06-04T15:44:52.485 INFO:teuthology.task.internal:Starting timer... 2024-06-04T15:44:52.485 INFO:teuthology.run_tasks:Running task pcp... 2024-06-04T15:44:52.526 INFO:teuthology.run_tasks:Running task selinux... 2024-06-04T15:44:52.556 DEBUG:teuthology.orchestra.run.smithi144:> sudo service auditd rotate 2024-06-04T15:44:52.607 INFO:teuthology.orchestra.run.smithi144.stdout:Rotating logs: 2024-06-04T15:44:52.609 DEBUG:teuthology.orchestra.run.smithi177:> sudo service auditd rotate 2024-06-04T15:44:52.667 INFO:teuthology.orchestra.run.smithi177.stdout:Rotating logs: 2024-06-04T15:44:52.670 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-06-04T15:44:52.670 DEBUG:teuthology.orchestra.run.smithi144:> /usr/sbin/getenforce 2024-06-04T15:44:52.698 INFO:teuthology.orchestra.run.smithi144.stdout:Permissive 2024-06-04T15:44:52.698 DEBUG:teuthology.orchestra.run.smithi177:> /usr/sbin/getenforce 2024-06-04T15:44:52.724 INFO:teuthology.orchestra.run.smithi177.stdout:Permissive 2024-06-04T15:44:52.724 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi144.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi177.front.sepia.ceph.com': 'permissive'} 2024-06-04T15:44:52.724 DEBUG:teuthology.orchestra.run.smithi144:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-06-04T15:44:52.765 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-06-04T15:44:52.765 DEBUG:teuthology.orchestra.run.smithi177:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-06-04T15:44:52.789 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-06-04T15:44:52.790 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-06-04T15:44:52.790 DEBUG:teuthology.orchestra.run.smithi144:> sudo /usr/sbin/setenforce permissive 2024-06-04T15:44:52.831 DEBUG:teuthology.orchestra.run.smithi177:> sudo /usr/sbin/setenforce permissive 2024-06-04T15:44:52.856 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-06-04T15:44:52.866 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-06-04T15:44:52.869 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-06-04T15:44:52.999 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-06-04T15:44:53.014 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-06-04T15:44:53.015 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi144.front.sepia.ceph.com,smithi177.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-06-04T15:49:15.645 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi144.front.sepia.ceph.com'), Remote(name='ubuntu@smithi177.front.sepia.ceph.com')] 2024-06-04T15:49:15.647 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi144.front.sepia.ceph.com' 2024-06-04T15:49:15.648 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi144.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-06-04T15:49:15.725 DEBUG:teuthology.orchestra.run.smithi144:> true 2024-06-04T15:49:15.809 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi144.front.sepia.ceph.com' 2024-06-04T15:49:15.809 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi177.front.sepia.ceph.com' 2024-06-04T15:49:15.810 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi177.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-06-04T15:49:15.883 DEBUG:teuthology.orchestra.run.smithi177:> true 2024-06-04T15:49:15.962 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi177.front.sepia.ceph.com' 2024-06-04T15:49:15.962 INFO:teuthology.run_tasks:Running task clock... 2024-06-04T15:49:15.974 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-06-04T15:49:15.974 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-06-04T15:49:15.975 DEBUG:teuthology.orchestra.run.smithi144:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-06-04T15:49:15.977 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-06-04T15:49:15.977 DEBUG:teuthology.orchestra.run.smithi177:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-06-04T15:49:16.004 INFO:teuthology.orchestra.run.smithi144.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-06-04T15:49:16.017 INFO:teuthology.orchestra.run.smithi144.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-06-04T15:49:16.033 INFO:teuthology.orchestra.run.smithi177.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-06-04T15:49:16.041 INFO:teuthology.orchestra.run.smithi144.stderr:sudo: ntpd: command not found 2024-06-04T15:49:16.048 INFO:teuthology.orchestra.run.smithi177.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-06-04T15:49:16.054 INFO:teuthology.orchestra.run.smithi144.stdout:506 Cannot talk to daemon 2024-06-04T15:49:16.068 INFO:teuthology.orchestra.run.smithi144.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-06-04T15:49:16.072 INFO:teuthology.orchestra.run.smithi177.stderr:sudo: ntpd: command not found 2024-06-04T15:49:16.081 INFO:teuthology.orchestra.run.smithi144.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-06-04T15:49:16.083 INFO:teuthology.orchestra.run.smithi177.stdout:506 Cannot talk to daemon 2024-06-04T15:49:16.096 INFO:teuthology.orchestra.run.smithi177.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-06-04T15:49:16.110 INFO:teuthology.orchestra.run.smithi177.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-06-04T15:49:16.137 INFO:teuthology.orchestra.run.smithi144.stderr:bash: line 1: ntpq: command not found 2024-06-04T15:49:16.141 INFO:teuthology.orchestra.run.smithi144.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-06-04T15:49:16.141 INFO:teuthology.orchestra.run.smithi144.stdout:=============================================================================== 2024-06-04T15:49:16.141 INFO:teuthology.orchestra.run.smithi144.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-06-04T15:49:16.141 INFO:teuthology.orchestra.run.smithi144.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-06-04T15:49:16.141 INFO:teuthology.orchestra.run.smithi144.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-06-04T15:49:16.141 INFO:teuthology.orchestra.run.smithi144.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-06-04T15:49:16.171 INFO:teuthology.orchestra.run.smithi177.stderr:bash: line 1: ntpq: command not found 2024-06-04T15:49:16.174 INFO:teuthology.orchestra.run.smithi177.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-06-04T15:49:16.174 INFO:teuthology.orchestra.run.smithi177.stdout:=============================================================================== 2024-06-04T15:49:16.174 INFO:teuthology.orchestra.run.smithi177.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-06-04T15:49:16.174 INFO:teuthology.orchestra.run.smithi177.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-06-04T15:49:16.174 INFO:teuthology.orchestra.run.smithi177.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-06-04T15:49:16.174 INFO:teuthology.orchestra.run.smithi177.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-06-04T15:49:16.175 INFO:teuthology.run_tasks:Running task install... 2024-06-04T15:49:16.183 DEBUG:teuthology.task.install:project ceph 2024-06-04T15:49:16.183 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '65533a907fc9add1863609703fdbbea67993c8ef'}} 2024-06-04T15:49:16.183 DEBUG:teuthology.task.install:config {'extra_system_packages': {'deb': ['s3cmd', 'maven'], 'rpm': ['s3cmd', 'maven']}, 'flavor': 'default', 'sha1': '65533a907fc9add1863609703fdbbea67993c8ef'} 2024-06-04T15:49:16.183 INFO:teuthology.task.install:Using flavor: default 2024-06-04T15:49:16.189 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-06-04T15:49:16.189 INFO:teuthology.task.install:extra packages: [] 2024-06-04T15:49:16.189 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': {'deb': ['s3cmd', 'maven'], 'rpm': ['s3cmd', 'maven']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '65533a907fc9add1863609703fdbbea67993c8ef', 'tag': None, 'wait_for_package': False} 2024-06-04T15:49:16.190 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=65533a907fc9add1863609703fdbbea67993c8ef 2024-06-04T15:49:16.192 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': {'deb': ['s3cmd', 'maven'], 'rpm': ['s3cmd', 'maven']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '65533a907fc9add1863609703fdbbea67993c8ef', 'tag': None, 'wait_for_package': False} 2024-06-04T15:49:16.192 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=65533a907fc9add1863609703fdbbea67993c8ef 2024-06-04T15:49:16.333 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/main/65533a907fc9add1863609703fdbbea67993c8ef/centos/9/flavors/default/ 2024-06-04T15:49:16.333 INFO:teuthology.task.install.rpm:Package version is 19.0.0-4027.g65533a90 2024-06-04T15:49:16.339 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/main/65533a907fc9add1863609703fdbbea67993c8ef/centos/9/flavors/default/ 2024-06-04T15:49:16.339 INFO:teuthology.task.install.rpm:Package version is 19.0.0-4027.g65533a90 2024-06-04T15:49:16.446 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/main/65533a907fc9add1863609703fdbbea67993c8ef/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/main/65533a907fc9add1863609703fdbbea67993c8ef/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/main/65533a907fc9add1863609703fdbbea67993c8ef/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-06-04T15:49:16.446 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-06-04T15:49:16.446 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-06-04T15:49:16.456 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/main/65533a907fc9add1863609703fdbbea67993c8ef/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/main/65533a907fc9add1863609703fdbbea67993c8ef/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/main/65533a907fc9add1863609703fdbbea67993c8ef/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-06-04T15:49:16.456 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-06-04T15:49:16.456 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-06-04T15:49:16.472 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, s3cmd, maven, s3cmd, maven, s3cmd, maven on remote rpm x86_64 2024-06-04T15:49:16.472 DEBUG:teuthology.orchestra.run.smithi144:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/65533a907fc9add1863609703fdbbea67993c8ef/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-06-04T15:49:16.482 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, s3cmd, maven, s3cmd, maven, s3cmd, maven, s3cmd, maven on remote rpm x86_64 2024-06-04T15:49:16.482 DEBUG:teuthology.orchestra.run.smithi177:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/65533a907fc9add1863609703fdbbea67993c8ef/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-06-04T15:49:16.538 DEBUG:teuthology.orchestra.run.smithi144:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-06-04T15:49:16.548 DEBUG:teuthology.orchestra.run.smithi177:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-06-04T15:49:16.613 DEBUG:teuthology.orchestra.run.smithi144:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-06-04T15:49:16.623 DEBUG:teuthology.orchestra.run.smithi177:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-06-04T15:49:16.678 INFO:teuthology.orchestra.run.smithi144.stdout:check_obsoletes = 1 2024-06-04T15:49:16.679 DEBUG:teuthology.orchestra.run.smithi144:> sudo yum clean all 2024-06-04T15:49:16.687 INFO:teuthology.orchestra.run.smithi177.stdout:check_obsoletes = 1 2024-06-04T15:49:16.689 DEBUG:teuthology.orchestra.run.smithi177:> sudo yum clean all 2024-06-04T15:49:16.920 INFO:teuthology.orchestra.run.smithi144.stdout:45 files removed 2024-06-04T15:49:16.923 INFO:teuthology.orchestra.run.smithi177.stdout:45 files removed 2024-06-04T15:49:16.948 DEBUG:teuthology.orchestra.run.smithi144:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd s3cmd maven s3cmd maven s3cmd maven s3cmd maven 2024-06-04T15:49:16.949 DEBUG:teuthology.orchestra.run.smithi177:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd s3cmd maven s3cmd maven s3cmd maven s3cmd maven 2024-06-04T15:49:17.582 INFO:teuthology.orchestra.run.smithi144.stdout:ceph packages for x86_64 237 kB/s | 84 kB 00:00 2024-06-04T15:49:17.641 INFO:teuthology.orchestra.run.smithi177.stdout:ceph packages for x86_64 202 kB/s | 84 kB 00:00 2024-06-04T15:49:17.974 INFO:teuthology.orchestra.run.smithi144.stdout:ceph noarch packages 35 kB/s | 12 kB 00:00 2024-06-04T15:49:18.083 INFO:teuthology.orchestra.run.smithi177.stdout:ceph noarch packages 30 kB/s | 12 kB 00:00 2024-06-04T15:49:18.324 INFO:teuthology.orchestra.run.smithi144.stdout:ceph source packages 6.2 kB/s | 1.9 kB 00:00 2024-06-04T15:49:18.442 INFO:teuthology.orchestra.run.smithi177.stdout:ceph source packages 6.0 kB/s | 1.9 kB 00:00 2024-06-04T15:49:18.960 INFO:teuthology.orchestra.run.smithi144.stdout:CentOS Stream 9 - BaseOS 14 MB/s | 8.1 MB 00:00 2024-06-04T15:49:19.669 INFO:teuthology.orchestra.run.smithi177.stdout:CentOS Stream 9 - BaseOS 6.8 MB/s | 8.1 MB 00:01 2024-06-04T15:49:20.678 INFO:teuthology.orchestra.run.smithi144.stdout:CentOS Stream 9 - AppStream 30 MB/s | 19 MB 00:00 2024-06-04T15:49:21.820 INFO:teuthology.orchestra.run.smithi177.stdout:CentOS Stream 9 - AppStream 18 MB/s | 19 MB 00:01 2024-06-04T15:49:24.795 INFO:teuthology.orchestra.run.smithi144.stdout:CentOS Stream 9 - CRB 11 MB/s | 6.2 MB 00:00 2024-06-04T15:49:26.046 INFO:teuthology.orchestra.run.smithi177.stdout:CentOS Stream 9 - CRB 9.3 MB/s | 6.2 MB 00:00 2024-06-04T15:49:26.287 INFO:teuthology.orchestra.run.smithi144.stdout:CentOS Stream 9 - Extras packages 55 kB/s | 17 kB 00:00 2024-06-04T15:49:27.529 INFO:teuthology.orchestra.run.smithi177.stdout:CentOS Stream 9 - Extras packages 55 kB/s | 17 kB 00:00 2024-06-04T15:49:27.732 INFO:teuthology.orchestra.run.smithi144.stdout:Extra Packages for Enterprise Linux 16 MB/s | 21 MB 00:01 2024-06-04T15:49:28.865 INFO:teuthology.orchestra.run.smithi177.stdout:Extra Packages for Enterprise Linux 18 MB/s | 21 MB 00:01 2024-06-04T15:49:32.879 INFO:teuthology.orchestra.run.smithi144.stdout:lab-extras 17 kB/s | 1.7 kB 00:00 2024-06-04T15:49:34.071 INFO:teuthology.orchestra.run.smithi177.stdout:lab-extras 27 kB/s | 1.7 kB 00:00 2024-06-04T15:49:35.230 INFO:teuthology.orchestra.run.smithi144.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-06-04T15:49:35.230 INFO:teuthology.orchestra.run.smithi144.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-06-04T15:49:35.318 INFO:teuthology.orchestra.run.smithi144.stdout:Dependencies resolved. 2024-06-04T15:49:35.343 INFO:teuthology.orchestra.run.smithi144.stdout:====================================================================================================== 2024-06-04T15:49:35.343 INFO:teuthology.orchestra.run.smithi144.stdout: Package Arch Version Repository Size 2024-06-04T15:49:35.343 INFO:teuthology.orchestra.run.smithi144.stdout:====================================================================================================== 2024-06-04T15:49:35.343 INFO:teuthology.orchestra.run.smithi144.stdout:Installing: 2024-06-04T15:49:35.343 INFO:teuthology.orchestra.run.smithi144.stdout: ceph x86_64 2:19.0.0-4027.g65533a90.el9 ceph 6.6 k 2024-06-04T15:49:35.344 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-base x86_64 2:19.0.0-4027.g65533a90.el9 ceph 5.4 M 2024-06-04T15:49:35.344 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-fuse x86_64 2:19.0.0-4027.g65533a90.el9 ceph 893 k 2024-06-04T15:49:35.344 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-4027.g65533a90.el9 ceph 145 k 2024-06-04T15:49:35.344 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mgr x86_64 2:19.0.0-4027.g65533a90.el9 ceph 1.5 M 2024-06-04T15:49:35.344 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mgr-cephadm noarch 2:19.0.0-4027.g65533a90.el9 ceph-noarch 143 k 2024-06-04T15:49:35.344 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mgr-dashboard noarch 2:19.0.0-4027.g65533a90.el9 ceph-noarch 3.5 M 2024-06-04T15:49:35.344 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-4027.g65533a90.el9 ceph-noarch 7.4 M 2024-06-04T15:49:35.344 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mgr-rook noarch 2:19.0.0-4027.g65533a90.el9 ceph-noarch 49 k 2024-06-04T15:49:35.345 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-radosgw x86_64 2:19.0.0-4027.g65533a90.el9 ceph 11 M 2024-06-04T15:49:35.345 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-test x86_64 2:19.0.0-4027.g65533a90.el9 ceph 49 M 2024-06-04T15:49:35.345 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-volume noarch 2:19.0.0-4027.g65533a90.el9 ceph-noarch 273 k 2024-06-04T15:49:35.345 INFO:teuthology.orchestra.run.smithi144.stdout: cephadm noarch 2:19.0.0-4027.g65533a90.el9 ceph-noarch 764 k 2024-06-04T15:49:35.345 INFO:teuthology.orchestra.run.smithi144.stdout: libcephfs-devel x86_64 2:19.0.0-4027.g65533a90.el9 ceph 32 k 2024-06-04T15:49:35.345 INFO:teuthology.orchestra.run.smithi144.stdout: libcephfs2 x86_64 2:19.0.0-4027.g65533a90.el9 ceph 748 k 2024-06-04T15:49:35.345 INFO:teuthology.orchestra.run.smithi144.stdout: librados-devel x86_64 2:19.0.0-4027.g65533a90.el9 ceph 127 k 2024-06-04T15:49:35.345 INFO:teuthology.orchestra.run.smithi144.stdout: maven noarch 1:3.6.3-15.el9 appstream 18 k 2024-06-04T15:49:35.345 INFO:teuthology.orchestra.run.smithi144.stdout: python3-cephfs x86_64 2:19.0.0-4027.g65533a90.el9 ceph 161 k 2024-06-04T15:49:35.345 INFO:teuthology.orchestra.run.smithi144.stdout: python3-rados x86_64 2:19.0.0-4027.g65533a90.el9 ceph 320 k 2024-06-04T15:49:35.345 INFO:teuthology.orchestra.run.smithi144.stdout: python3-rbd x86_64 2:19.0.0-4027.g65533a90.el9 ceph 300 k 2024-06-04T15:49:35.345 INFO:teuthology.orchestra.run.smithi144.stdout: python3-rgw x86_64 2:19.0.0-4027.g65533a90.el9 ceph 99 k 2024-06-04T15:49:35.345 INFO:teuthology.orchestra.run.smithi144.stdout: rbd-fuse x86_64 2:19.0.0-4027.g65533a90.el9 ceph 85 k 2024-06-04T15:49:35.346 INFO:teuthology.orchestra.run.smithi144.stdout: rbd-mirror x86_64 2:19.0.0-4027.g65533a90.el9 ceph 3.1 M 2024-06-04T15:49:35.346 INFO:teuthology.orchestra.run.smithi144.stdout: rbd-nbd x86_64 2:19.0.0-4027.g65533a90.el9 ceph 171 k 2024-06-04T15:49:35.346 INFO:teuthology.orchestra.run.smithi144.stdout: s3cmd noarch 2.4.0-1.el9 epel 206 k 2024-06-04T15:49:35.346 INFO:teuthology.orchestra.run.smithi144.stdout:Upgrading: 2024-06-04T15:49:35.346 INFO:teuthology.orchestra.run.smithi144.stdout: librados2 x86_64 2:19.0.0-4027.g65533a90.el9 ceph 3.4 M 2024-06-04T15:49:35.346 INFO:teuthology.orchestra.run.smithi144.stdout: librbd1 x86_64 2:19.0.0-4027.g65533a90.el9 ceph 3.1 M 2024-06-04T15:49:35.346 INFO:teuthology.orchestra.run.smithi144.stdout:Installing dependencies: 2024-06-04T15:49:35.346 INFO:teuthology.orchestra.run.smithi144.stdout: ModemManager-glib x86_64 1.20.2-1.el9 baseos 335 k 2024-06-04T15:49:35.347 INFO:teuthology.orchestra.run.smithi144.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-06-04T15:49:35.347 INFO:teuthology.orchestra.run.smithi144.stdout: adwaita-cursor-theme noarch 40.1.1-3.el9 appstream 650 k 2024-06-04T15:49:35.347 INFO:teuthology.orchestra.run.smithi144.stdout: adwaita-icon-theme noarch 40.1.1-3.el9 appstream 12 M 2024-06-04T15:49:35.347 INFO:teuthology.orchestra.run.smithi144.stdout: alsa-lib x86_64 1.2.10-2.el9 appstream 523 k 2024-06-04T15:49:35.347 INFO:teuthology.orchestra.run.smithi144.stdout: apache-commons-cli noarch 1.4-17.el9 appstream 71 k 2024-06-04T15:49:35.347 INFO:teuthology.orchestra.run.smithi144.stdout: apache-commons-codec noarch 1.15-7.el9 appstream 302 k 2024-06-04T15:49:35.347 INFO:teuthology.orchestra.run.smithi144.stdout: apache-commons-io noarch 1:2.8.0-8.el9 appstream 283 k 2024-06-04T15:49:35.347 INFO:teuthology.orchestra.run.smithi144.stdout: apache-commons-lang3 noarch 3.12.0-6.el9 appstream 559 k 2024-06-04T15:49:35.348 INFO:teuthology.orchestra.run.smithi144.stdout: at-spi2-atk x86_64 2.38.0-4.el9 appstream 87 k 2024-06-04T15:49:35.348 INFO:teuthology.orchestra.run.smithi144.stdout: at-spi2-core x86_64 2.40.3-1.el9 appstream 195 k 2024-06-04T15:49:35.348 INFO:teuthology.orchestra.run.smithi144.stdout: atinject noarch 1.0.3-6.el9 appstream 23 k 2024-06-04T15:49:35.348 INFO:teuthology.orchestra.run.smithi144.stdout: atk x86_64 2.36.0-5.el9 appstream 292 k 2024-06-04T15:49:35.348 INFO:teuthology.orchestra.run.smithi144.stdout: avahi-glib x86_64 0.8-20.el9 appstream 15 k 2024-06-04T15:49:35.348 INFO:teuthology.orchestra.run.smithi144.stdout: bluez-libs x86_64 5.56-6.el9 baseos 85 k 2024-06-04T15:49:35.348 INFO:teuthology.orchestra.run.smithi144.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-06-04T15:49:35.348 INFO:teuthology.orchestra.run.smithi144.stdout: bubblewrap x86_64 0.4.1-7.el9 baseos 49 k 2024-06-04T15:49:35.348 INFO:teuthology.orchestra.run.smithi144.stdout: cdi-api noarch 2.0.2-6.el9 appstream 53 k 2024-06-04T15:49:35.348 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-common x86_64 2:19.0.0-4027.g65533a90.el9 ceph 21 M 2024-06-04T15:49:35.348 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-grafana-dashboards noarch 2:19.0.0-4027.g65533a90.el9 ceph-noarch 34 k 2024-06-04T15:49:35.349 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mds x86_64 2:19.0.0-4027.g65533a90.el9 ceph 2.4 M 2024-06-04T15:49:35.349 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mgr-modules-core noarch 2:19.0.0-4027.g65533a90.el9 ceph-noarch 274 k 2024-06-04T15:49:35.349 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mon x86_64 2:19.0.0-4027.g65533a90.el9 ceph 4.7 M 2024-06-04T15:49:35.349 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-osd x86_64 2:19.0.0-4027.g65533a90.el9 ceph 17 M 2024-06-04T15:49:35.349 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-prometheus-alerts noarch 2:19.0.0-4027.g65533a90.el9 ceph-noarch 16 k 2024-06-04T15:49:35.349 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-selinux x86_64 2:19.0.0-4027.g65533a90.el9 ceph 25 k 2024-06-04T15:49:35.349 INFO:teuthology.orchestra.run.smithi144.stdout: colord-libs x86_64 1.4.5-4.el9 appstream 229 k 2024-06-04T15:49:35.350 INFO:teuthology.orchestra.run.smithi144.stdout: composefs-libs x86_64 1.0.3-2.el9 appstream 60 k 2024-06-04T15:49:35.350 INFO:teuthology.orchestra.run.smithi144.stdout: copy-jdk-configs noarch 4.0-3.el9 appstream 28 k 2024-06-04T15:49:35.350 INFO:teuthology.orchestra.run.smithi144.stdout: cups-libs x86_64 1:2.3.3op2-26.el9 baseos 262 k 2024-06-04T15:49:35.350 INFO:teuthology.orchestra.run.smithi144.stdout: exempi x86_64 2.6.0-0.2.20211007gite23c213.el9 appstream 525 k 2024-06-04T15:49:35.350 INFO:teuthology.orchestra.run.smithi144.stdout: exiv2-libs x86_64 0.27.5-2.el9 appstream 781 k 2024-06-04T15:49:35.350 INFO:teuthology.orchestra.run.smithi144.stdout: fdk-aac-free x86_64 2.0.0-8.el9 appstream 325 k 2024-06-04T15:49:35.350 INFO:teuthology.orchestra.run.smithi144.stdout: flac-libs x86_64 1.3.3-12.el9 appstream 218 k 2024-06-04T15:49:35.350 INFO:teuthology.orchestra.run.smithi144.stdout: flatpak-selinux noarch 1.12.8-1.el9 appstream 21 k 2024-06-04T15:49:35.351 INFO:teuthology.orchestra.run.smithi144.stdout: flatpak-session-helper x86_64 1.12.8-1.el9 appstream 74 k 2024-06-04T15:49:35.351 INFO:teuthology.orchestra.run.smithi144.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-06-04T15:49:35.351 INFO:teuthology.orchestra.run.smithi144.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-06-04T15:49:35.351 INFO:teuthology.orchestra.run.smithi144.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-06-04T15:49:35.351 INFO:teuthology.orchestra.run.smithi144.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-06-04T15:49:35.351 INFO:teuthology.orchestra.run.smithi144.stdout: gdk-pixbuf2-modules x86_64 2.42.6-3.el9 appstream 88 k 2024-06-04T15:49:35.351 INFO:teuthology.orchestra.run.smithi144.stdout: geoclue2 x86_64 2.6.0-7.el9 appstream 124 k 2024-06-04T15:49:35.352 INFO:teuthology.orchestra.run.smithi144.stdout: giflib x86_64 5.2.1-9.el9 appstream 49 k 2024-06-04T15:49:35.352 INFO:teuthology.orchestra.run.smithi144.stdout: google-guice noarch 4.2.3-9.el9 appstream 473 k 2024-06-04T15:49:35.352 INFO:teuthology.orchestra.run.smithi144.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-06-04T15:49:35.352 INFO:teuthology.orchestra.run.smithi144.stdout: graphene x86_64 1.10.6-2.el9 appstream 64 k 2024-06-04T15:49:35.352 INFO:teuthology.orchestra.run.smithi144.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-06-04T15:49:35.352 INFO:teuthology.orchestra.run.smithi144.stdout: gsm x86_64 1.0.19-6.el9 appstream 34 k 2024-06-04T15:49:35.352 INFO:teuthology.orchestra.run.smithi144.stdout: gstreamer1 x86_64 1.22.1-2.el9 appstream 1.4 M 2024-06-04T15:49:35.352 INFO:teuthology.orchestra.run.smithi144.stdout: gstreamer1-plugins-base x86_64 1.22.1-2.el9 appstream 2.2 M 2024-06-04T15:49:35.352 INFO:teuthology.orchestra.run.smithi144.stdout: gtk-update-icon-cache x86_64 3.24.31-2.el9 appstream 35 k 2024-06-04T15:49:35.352 INFO:teuthology.orchestra.run.smithi144.stdout: guava noarch 30.1-6.el9 appstream 2.3 M 2024-06-04T15:49:35.352 INFO:teuthology.orchestra.run.smithi144.stdout: hicolor-icon-theme noarch 0.17-13.el9 appstream 219 k 2024-06-04T15:49:35.353 INFO:teuthology.orchestra.run.smithi144.stdout: httpcomponents-client noarch 4.5.13-3.el9 appstream 657 k 2024-06-04T15:49:35.353 INFO:teuthology.orchestra.run.smithi144.stdout: httpcomponents-core noarch 4.4.13-7.el9 appstream 632 k 2024-06-04T15:49:35.353 INFO:teuthology.orchestra.run.smithi144.stdout: iso-codes noarch 4.6.0-3.el9 appstream 3.5 M 2024-06-04T15:49:35.353 INFO:teuthology.orchestra.run.smithi144.stdout: jakarta-annotations noarch 1.3.5-13.el9 appstream 45 k 2024-06-04T15:49:35.353 INFO:teuthology.orchestra.run.smithi144.stdout: jansi x86_64 2.3.3-6.el9 appstream 110 k 2024-06-04T15:49:35.353 INFO:teuthology.orchestra.run.smithi144.stdout: java-11-openjdk x86_64 1:11.0.20.1.1-2.el9 appstream 413 k 2024-06-04T15:49:35.353 INFO:teuthology.orchestra.run.smithi144.stdout: java-11-openjdk-headless x86_64 1:11.0.20.1.1-2.el9 appstream 39 M 2024-06-04T15:49:35.353 INFO:teuthology.orchestra.run.smithi144.stdout: javapackages-filesystem noarch 6.0.0-4.el9 appstream 13 k 2024-06-04T15:49:35.353 INFO:teuthology.orchestra.run.smithi144.stdout: jbigkit-libs x86_64 2.1-23.el9 appstream 53 k 2024-06-04T15:49:35.353 INFO:teuthology.orchestra.run.smithi144.stdout: jcl-over-slf4j noarch 1.7.30-13.el9 appstream 24 k 2024-06-04T15:49:35.353 INFO:teuthology.orchestra.run.smithi144.stdout: jsoup noarch 1.13.1-10.el9 appstream 377 k 2024-06-04T15:49:35.353 INFO:teuthology.orchestra.run.smithi144.stdout: jsr-305 noarch 3.0.2-6.el9 appstream 35 k 2024-06-04T15:49:35.353 INFO:teuthology.orchestra.run.smithi144.stdout: lcms2 x86_64 2.12-3.el9 appstream 168 k 2024-06-04T15:49:35.354 INFO:teuthology.orchestra.run.smithi144.stdout: libX11-xcb x86_64 1.7.0-9.el9 appstream 11 k 2024-06-04T15:49:35.354 INFO:teuthology.orchestra.run.smithi144.stdout: libXcomposite x86_64 0.4.5-7.el9 appstream 24 k 2024-06-04T15:49:35.354 INFO:teuthology.orchestra.run.smithi144.stdout: libXcursor x86_64 1.2.0-7.el9 appstream 31 k 2024-06-04T15:49:35.354 INFO:teuthology.orchestra.run.smithi144.stdout: libXdamage x86_64 1.1.5-7.el9 appstream 23 k 2024-06-04T15:49:35.354 INFO:teuthology.orchestra.run.smithi144.stdout: libXfixes x86_64 5.0.3-16.el9 appstream 20 k 2024-06-04T15:49:35.354 INFO:teuthology.orchestra.run.smithi144.stdout: libXi x86_64 1.7.10-8.el9 appstream 40 k 2024-06-04T15:49:35.354 INFO:teuthology.orchestra.run.smithi144.stdout: libXinerama x86_64 1.1.4-10.el9 appstream 15 k 2024-06-04T15:49:35.354 INFO:teuthology.orchestra.run.smithi144.stdout: libXrandr x86_64 1.5.2-8.el9 appstream 28 k 2024-06-04T15:49:35.354 INFO:teuthology.orchestra.run.smithi144.stdout: libXtst x86_64 1.2.3-16.el9 appstream 21 k 2024-06-04T15:49:35.354 INFO:teuthology.orchestra.run.smithi144.stdout: libXv x86_64 1.0.11-16.el9 appstream 19 k 2024-06-04T15:49:35.354 INFO:teuthology.orchestra.run.smithi144.stdout: libXxf86vm x86_64 1.1.4-18.el9 appstream 19 k 2024-06-04T15:49:35.354 INFO:teuthology.orchestra.run.smithi144.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-06-04T15:49:35.355 INFO:teuthology.orchestra.run.smithi144.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-06-04T15:49:35.355 INFO:teuthology.orchestra.run.smithi144.stdout: libasyncns x86_64 0.8-22.el9 appstream 30 k 2024-06-04T15:49:35.355 INFO:teuthology.orchestra.run.smithi144.stdout: libcanberra x86_64 0.30-27.el9 appstream 86 k 2024-06-04T15:49:35.355 INFO:teuthology.orchestra.run.smithi144.stdout: libcephsqlite x86_64 2:19.0.0-4027.g65533a90.el9 ceph 163 k 2024-06-04T15:49:35.355 INFO:teuthology.orchestra.run.smithi144.stdout: libdrm x86_64 2.4.117-1.el9 appstream 161 k 2024-06-04T15:49:35.355 INFO:teuthology.orchestra.run.smithi144.stdout: libepoxy x86_64 1.5.5-4.el9 appstream 241 k 2024-06-04T15:49:35.355 INFO:teuthology.orchestra.run.smithi144.stdout: libexif x86_64 0.6.22-6.el9 appstream 435 k 2024-06-04T15:49:35.355 INFO:teuthology.orchestra.run.smithi144.stdout: libfontenc x86_64 1.1.3-17.el9 appstream 31 k 2024-06-04T15:49:35.355 INFO:teuthology.orchestra.run.smithi144.stdout: libgexiv2 x86_64 0.12.3-1.el9 appstream 83 k 2024-06-04T15:49:35.355 INFO:teuthology.orchestra.run.smithi144.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-06-04T15:49:35.355 INFO:teuthology.orchestra.run.smithi144.stdout: libglvnd x86_64 1:1.3.4-1.el9 appstream 135 k 2024-06-04T15:49:35.356 INFO:teuthology.orchestra.run.smithi144.stdout: libglvnd-egl x86_64 1:1.3.4-1.el9 appstream 37 k 2024-06-04T15:49:35.356 INFO:teuthology.orchestra.run.smithi144.stdout: libglvnd-glx x86_64 1:1.3.4-1.el9 appstream 142 k 2024-06-04T15:49:35.356 INFO:teuthology.orchestra.run.smithi144.stdout: libgsf x86_64 1.14.47-5.el9 appstream 256 k 2024-06-04T15:49:35.356 INFO:teuthology.orchestra.run.smithi144.stdout: libgxps x86_64 0.3.2-3.el9 appstream 79 k 2024-06-04T15:49:35.356 INFO:teuthology.orchestra.run.smithi144.stdout: libiptcdata x86_64 1.0.5-9.el9 appstream 62 k 2024-06-04T15:49:35.356 INFO:teuthology.orchestra.run.smithi144.stdout: libldac x86_64 2.0.2.3-10.el9 appstream 41 k 2024-06-04T15:49:35.356 INFO:teuthology.orchestra.run.smithi144.stdout: libnotify x86_64 0.7.9-8.el9 appstream 44 k 2024-06-04T15:49:35.356 INFO:teuthology.orchestra.run.smithi144.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-06-04T15:49:35.356 INFO:teuthology.orchestra.run.smithi144.stdout: libogg x86_64 2:1.3.4-6.el9 appstream 34 k 2024-06-04T15:49:35.357 INFO:teuthology.orchestra.run.smithi144.stdout: libosinfo x86_64 1.10.0-1.el9 appstream 319 k 2024-06-04T15:49:35.357 INFO:teuthology.orchestra.run.smithi144.stdout: libpciaccess x86_64 0.16-7.el9 baseos 27 k 2024-06-04T15:49:35.357 INFO:teuthology.orchestra.run.smithi144.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-06-04T15:49:35.357 INFO:teuthology.orchestra.run.smithi144.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-06-04T15:49:35.357 INFO:teuthology.orchestra.run.smithi144.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-06-04T15:49:35.357 INFO:teuthology.orchestra.run.smithi144.stdout: libradosstriper1 x86_64 2:19.0.0-4027.g65533a90.el9 ceph 504 k 2024-06-04T15:49:35.357 INFO:teuthology.orchestra.run.smithi144.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-06-04T15:49:35.357 INFO:teuthology.orchestra.run.smithi144.stdout: librgw2 x86_64 2:19.0.0-4027.g65533a90.el9 ceph 5.4 M 2024-06-04T15:49:35.357 INFO:teuthology.orchestra.run.smithi144.stdout: libsbc x86_64 1.4-9.el9 appstream 45 k 2024-06-04T15:49:35.357 INFO:teuthology.orchestra.run.smithi144.stdout: libsndfile x86_64 1.0.31-8.el9 appstream 206 k 2024-06-04T15:49:35.358 INFO:teuthology.orchestra.run.smithi144.stdout: libtheora x86_64 1:1.1.1-31.el9 appstream 164 k 2024-06-04T15:49:35.358 INFO:teuthology.orchestra.run.smithi144.stdout: libtiff x86_64 4.4.0-12.el9 appstream 198 k 2024-06-04T15:49:35.358 INFO:teuthology.orchestra.run.smithi144.stdout: libtool-ltdl x86_64 2.4.6-45.el9 appstream 37 k 2024-06-04T15:49:35.358 INFO:teuthology.orchestra.run.smithi144.stdout: libtracker-sparql x86_64 3.1.2-3.el9 appstream 324 k 2024-06-04T15:49:35.358 INFO:teuthology.orchestra.run.smithi144.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-06-04T15:49:35.358 INFO:teuthology.orchestra.run.smithi144.stdout: libvisual x86_64 1:0.4.0-34.el9 appstream 144 k 2024-06-04T15:49:35.358 INFO:teuthology.orchestra.run.smithi144.stdout: libvorbis x86_64 1:1.3.7-5.el9 appstream 193 k 2024-06-04T15:49:35.358 INFO:teuthology.orchestra.run.smithi144.stdout: libwayland-client x86_64 1.21.0-1.el9 appstream 33 k 2024-06-04T15:49:35.358 INFO:teuthology.orchestra.run.smithi144.stdout: libwayland-cursor x86_64 1.21.0-1.el9 appstream 19 k 2024-06-04T15:49:35.359 INFO:teuthology.orchestra.run.smithi144.stdout: libwayland-egl x86_64 1.21.0-1.el9 appstream 13 k 2024-06-04T15:49:35.359 INFO:teuthology.orchestra.run.smithi144.stdout: libwayland-server x86_64 1.21.0-1.el9 appstream 42 k 2024-06-04T15:49:35.359 INFO:teuthology.orchestra.run.smithi144.stdout: libwebp x86_64 1.2.0-8.el9 appstream 277 k 2024-06-04T15:49:35.359 INFO:teuthology.orchestra.run.smithi144.stdout: libxkbcommon x86_64 1.0.3-4.el9 appstream 133 k 2024-06-04T15:49:35.359 INFO:teuthology.orchestra.run.smithi144.stdout: libxshmfence x86_64 1.3-10.el9 appstream 13 k 2024-06-04T15:49:35.359 INFO:teuthology.orchestra.run.smithi144.stdout: lksctp-tools x86_64 1.0.19-2.el9 baseos 94 k 2024-06-04T15:49:35.359 INFO:teuthology.orchestra.run.smithi144.stdout: low-memory-monitor x86_64 2.1-4.el9 appstream 36 k 2024-06-04T15:49:35.359 INFO:teuthology.orchestra.run.smithi144.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-06-04T15:49:35.359 INFO:teuthology.orchestra.run.smithi144.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-06-04T15:49:35.359 INFO:teuthology.orchestra.run.smithi144.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-06-04T15:49:35.360 INFO:teuthology.orchestra.run.smithi144.stdout: lua-posix x86_64 35.0-8.el9 appstream 151 k 2024-06-04T15:49:35.360 INFO:teuthology.orchestra.run.smithi144.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-06-04T15:49:35.360 INFO:teuthology.orchestra.run.smithi144.stdout: maven-lib noarch 1:3.6.3-15.el9 appstream 1.5 M 2024-06-04T15:49:35.360 INFO:teuthology.orchestra.run.smithi144.stdout: maven-openjdk11 noarch 1:3.6.3-15.el9 appstream 9.0 k 2024-06-04T15:49:35.360 INFO:teuthology.orchestra.run.smithi144.stdout: maven-resolver noarch 1:1.6.1-10.el9 appstream 517 k 2024-06-04T15:49:35.360 INFO:teuthology.orchestra.run.smithi144.stdout: maven-shared-utils noarch 3.3.4-3.el9 appstream 151 k 2024-06-04T15:49:35.360 INFO:teuthology.orchestra.run.smithi144.stdout: maven-wagon noarch 3.4.2-7.el9 appstream 112 k 2024-06-04T15:49:35.360 INFO:teuthology.orchestra.run.smithi144.stdout: mesa-libEGL x86_64 23.3.3-1.el9 appstream 127 k 2024-06-04T15:49:35.360 INFO:teuthology.orchestra.run.smithi144.stdout: mesa-libGL x86_64 23.3.3-1.el9 appstream 168 k 2024-06-04T15:49:35.361 INFO:teuthology.orchestra.run.smithi144.stdout: mesa-libgbm x86_64 23.3.3-1.el9 appstream 38 k 2024-06-04T15:49:35.361 INFO:teuthology.orchestra.run.smithi144.stdout: mesa-libglapi x86_64 23.3.3-1.el9 appstream 44 k 2024-06-04T15:49:35.361 INFO:teuthology.orchestra.run.smithi144.stdout: mkfontscale x86_64 1.2.1-3.el9 appstream 32 k 2024-06-04T15:49:35.361 INFO:teuthology.orchestra.run.smithi144.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-06-04T15:49:35.361 INFO:teuthology.orchestra.run.smithi144.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-06-04T15:49:35.361 INFO:teuthology.orchestra.run.smithi144.stdout: openjpeg2 x86_64 2.4.0-7.el9 appstream 163 k 2024-06-04T15:49:35.361 INFO:teuthology.orchestra.run.smithi144.stdout: opus x86_64 1.3.1-10.el9 appstream 200 k 2024-06-04T15:49:35.361 INFO:teuthology.orchestra.run.smithi144.stdout: orc x86_64 0.4.31-6.el9 appstream 184 k 2024-06-04T15:49:35.361 INFO:teuthology.orchestra.run.smithi144.stdout: osinfo-db noarch 20231215-1.el9 appstream 521 k 2024-06-04T15:49:35.361 INFO:teuthology.orchestra.run.smithi144.stdout: osinfo-db-tools x86_64 1.10.0-1.el9 appstream 74 k 2024-06-04T15:49:35.362 INFO:teuthology.orchestra.run.smithi144.stdout: ostree-libs x86_64 2024.6-1.el9 appstream 466 k 2024-06-04T15:49:35.362 INFO:teuthology.orchestra.run.smithi144.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-06-04T15:49:35.362 INFO:teuthology.orchestra.run.smithi144.stdout: pipewire-jack-audio-connection-kit-libs x86_64 1.0.1-1.el9 appstream 135 k 2024-06-04T15:49:35.362 INFO:teuthology.orchestra.run.smithi144.stdout: pipewire-libs x86_64 1.0.1-1.el9 appstream 1.9 M 2024-06-04T15:49:35.362 INFO:teuthology.orchestra.run.smithi144.stdout: plexus-cipher noarch 1.7-27.el9 appstream 26 k 2024-06-04T15:49:35.362 INFO:teuthology.orchestra.run.smithi144.stdout: plexus-classworlds noarch 2.6.0-11.el9 appstream 60 k 2024-06-04T15:49:35.362 INFO:teuthology.orchestra.run.smithi144.stdout: plexus-containers-component-annotations noarch 2.1.0-10.el9 appstream 18 k 2024-06-04T15:49:35.362 INFO:teuthology.orchestra.run.smithi144.stdout: plexus-interpolation noarch 1.26-11.el9 appstream 80 k 2024-06-04T15:49:35.362 INFO:teuthology.orchestra.run.smithi144.stdout: plexus-sec-dispatcher noarch 1.4-37.el9 appstream 34 k 2024-06-04T15:49:35.363 INFO:teuthology.orchestra.run.smithi144.stdout: plexus-utils noarch 3.3.0-10.el9 appstream 254 k 2024-06-04T15:49:35.363 INFO:teuthology.orchestra.run.smithi144.stdout: poppler x86_64 21.01.0-20.el9 appstream 1.1 M 2024-06-04T15:49:35.363 INFO:teuthology.orchestra.run.smithi144.stdout: poppler-data noarch 0.4.9-9.el9 appstream 1.9 M 2024-06-04T15:49:35.363 INFO:teuthology.orchestra.run.smithi144.stdout: poppler-glib x86_64 21.01.0-20.el9 appstream 152 k 2024-06-04T15:49:35.363 INFO:teuthology.orchestra.run.smithi144.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-06-04T15:49:35.363 INFO:teuthology.orchestra.run.smithi144.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-06-04T15:49:35.363 INFO:teuthology.orchestra.run.smithi144.stdout: publicsuffix-list noarch 20210518-3.el9 appstream 83 k 2024-06-04T15:49:35.363 INFO:teuthology.orchestra.run.smithi144.stdout: pulseaudio-libs x86_64 15.0-2.el9 appstream 679 k 2024-06-04T15:49:35.363 INFO:teuthology.orchestra.run.smithi144.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-06-04T15:49:35.364 INFO:teuthology.orchestra.run.smithi144.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-06-04T15:49:35.364 INFO:teuthology.orchestra.run.smithi144.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-06-04T15:49:35.364 INFO:teuthology.orchestra.run.smithi144.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-06-04T15:49:35.364 INFO:teuthology.orchestra.run.smithi144.stdout: python3-ceph-argparse x86_64 2:19.0.0-4027.g65533a90.el9 ceph 45 k 2024-06-04T15:49:35.364 INFO:teuthology.orchestra.run.smithi144.stdout: python3-ceph-common x86_64 2:19.0.0-4027.g65533a90.el9 ceph 136 k 2024-06-04T15:49:35.364 INFO:teuthology.orchestra.run.smithi144.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-06-04T15:49:35.364 INFO:teuthology.orchestra.run.smithi144.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-06-04T15:49:35.364 INFO:teuthology.orchestra.run.smithi144.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-06-04T15:49:35.364 INFO:teuthology.orchestra.run.smithi144.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-06-04T15:49:35.364 INFO:teuthology.orchestra.run.smithi144.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-06-04T15:49:35.365 INFO:teuthology.orchestra.run.smithi144.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-06-04T15:49:35.365 INFO:teuthology.orchestra.run.smithi144.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-06-04T15:49:35.365 INFO:teuthology.orchestra.run.smithi144.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-06-04T15:49:35.365 INFO:teuthology.orchestra.run.smithi144.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-06-04T15:49:35.365 INFO:teuthology.orchestra.run.smithi144.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-06-04T15:49:35.365 INFO:teuthology.orchestra.run.smithi144.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-06-04T15:49:35.365 INFO:teuthology.orchestra.run.smithi144.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-06-04T15:49:35.365 INFO:teuthology.orchestra.run.smithi144.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-06-04T15:49:35.365 INFO:teuthology.orchestra.run.smithi144.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-06-04T15:49:35.365 INFO:teuthology.orchestra.run.smithi144.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-06-04T15:49:35.366 INFO:teuthology.orchestra.run.smithi144.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-06-04T15:49:35.366 INFO:teuthology.orchestra.run.smithi144.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-06-04T15:49:35.366 INFO:teuthology.orchestra.run.smithi144.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-06-04T15:49:35.366 INFO:teuthology.orchestra.run.smithi144.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-06-04T15:49:35.366 INFO:teuthology.orchestra.run.smithi144.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-06-04T15:49:35.366 INFO:teuthology.orchestra.run.smithi144.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-06-04T15:49:35.366 INFO:teuthology.orchestra.run.smithi144.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-06-04T15:49:35.366 INFO:teuthology.orchestra.run.smithi144.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-06-04T15:49:35.366 INFO:teuthology.orchestra.run.smithi144.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-06-04T15:49:35.367 INFO:teuthology.orchestra.run.smithi144.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-06-04T15:49:35.367 INFO:teuthology.orchestra.run.smithi144.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-06-04T15:49:35.367 INFO:teuthology.orchestra.run.smithi144.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-06-04T15:49:35.367 INFO:teuthology.orchestra.run.smithi144.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-06-04T15:49:35.367 INFO:teuthology.orchestra.run.smithi144.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-06-04T15:49:35.367 INFO:teuthology.orchestra.run.smithi144.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-06-04T15:49:35.367 INFO:teuthology.orchestra.run.smithi144.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-06-04T15:49:35.367 INFO:teuthology.orchestra.run.smithi144.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-06-04T15:49:35.367 INFO:teuthology.orchestra.run.smithi144.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-06-04T15:49:35.368 INFO:teuthology.orchestra.run.smithi144.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-06-04T15:49:35.368 INFO:teuthology.orchestra.run.smithi144.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-06-04T15:49:35.368 INFO:teuthology.orchestra.run.smithi144.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-06-04T15:49:35.368 INFO:teuthology.orchestra.run.smithi144.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-06-04T15:49:35.368 INFO:teuthology.orchestra.run.smithi144.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-06-04T15:49:35.368 INFO:teuthology.orchestra.run.smithi144.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-06-04T15:49:35.368 INFO:teuthology.orchestra.run.smithi144.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-06-04T15:49:35.368 INFO:teuthology.orchestra.run.smithi144.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-06-04T15:49:35.368 INFO:teuthology.orchestra.run.smithi144.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-06-04T15:49:35.368 INFO:teuthology.orchestra.run.smithi144.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-06-04T15:49:35.368 INFO:teuthology.orchestra.run.smithi144.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-06-04T15:49:35.369 INFO:teuthology.orchestra.run.smithi144.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-06-04T15:49:35.369 INFO:teuthology.orchestra.run.smithi144.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-06-04T15:49:35.369 INFO:teuthology.orchestra.run.smithi144.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-06-04T15:49:35.369 INFO:teuthology.orchestra.run.smithi144.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-06-04T15:49:35.369 INFO:teuthology.orchestra.run.smithi144.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-06-04T15:49:35.369 INFO:teuthology.orchestra.run.smithi144.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-06-04T15:49:35.369 INFO:teuthology.orchestra.run.smithi144.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-06-04T15:49:35.369 INFO:teuthology.orchestra.run.smithi144.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-06-04T15:49:35.369 INFO:teuthology.orchestra.run.smithi144.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-06-04T15:49:35.370 INFO:teuthology.orchestra.run.smithi144.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-06-04T15:49:35.370 INFO:teuthology.orchestra.run.smithi144.stdout: rtkit x86_64 0.11-28.el9 appstream 56 k 2024-06-04T15:49:35.370 INFO:teuthology.orchestra.run.smithi144.stdout: sisu noarch 1:0.3.4-10.el9 appstream 510 k 2024-06-04T15:49:35.370 INFO:teuthology.orchestra.run.smithi144.stdout: slf4j noarch 1.7.30-13.el9 appstream 69 k 2024-06-04T15:49:35.370 INFO:teuthology.orchestra.run.smithi144.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-06-04T15:49:35.370 INFO:teuthology.orchestra.run.smithi144.stdout: sound-theme-freedesktop noarch 0.8-17.el9 appstream 383 k 2024-06-04T15:49:35.371 INFO:teuthology.orchestra.run.smithi144.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-06-04T15:49:35.371 INFO:teuthology.orchestra.run.smithi144.stdout: totem-pl-parser x86_64 3.26.6-2.el9 appstream 152 k 2024-06-04T15:49:35.371 INFO:teuthology.orchestra.run.smithi144.stdout: tracker x86_64 3.1.2-3.el9 appstream 555 k 2024-06-04T15:49:35.372 INFO:teuthology.orchestra.run.smithi144.stdout: ttmkfdir x86_64 3.0.9-65.el9 appstream 53 k 2024-06-04T15:49:35.372 INFO:teuthology.orchestra.run.smithi144.stdout: tzdata-java noarch 2024a-2.el9 appstream 230 k 2024-06-04T15:49:35.372 INFO:teuthology.orchestra.run.smithi144.stdout: upower x86_64 0.99.11-11.el9 appstream 173 k 2024-06-04T15:49:35.372 INFO:teuthology.orchestra.run.smithi144.stdout: webrtc-audio-processing x86_64 0.3.1-8.el9 appstream 306 k 2024-06-04T15:49:35.372 INFO:teuthology.orchestra.run.smithi144.stdout: wireplumber x86_64 0.4.14-1.el9 appstream 96 k 2024-06-04T15:49:35.372 INFO:teuthology.orchestra.run.smithi144.stdout: wireplumber-libs x86_64 0.4.14-1.el9 appstream 358 k 2024-06-04T15:49:35.372 INFO:teuthology.orchestra.run.smithi144.stdout: xdg-dbus-proxy x86_64 0.1.3-1.el9 appstream 42 k 2024-06-04T15:49:35.372 INFO:teuthology.orchestra.run.smithi144.stdout: xdg-desktop-portal x86_64 1.12.6-1.el9 appstream 385 k 2024-06-04T15:49:35.372 INFO:teuthology.orchestra.run.smithi144.stdout: xkeyboard-config noarch 2.33-2.el9 appstream 859 k 2024-06-04T15:49:35.372 INFO:teuthology.orchestra.run.smithi144.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-06-04T15:49:35.373 INFO:teuthology.orchestra.run.smithi144.stdout: xorg-x11-fonts-Type1 noarch 7.5-33.el9 appstream 505 k 2024-06-04T15:49:35.373 INFO:teuthology.orchestra.run.smithi144.stdout:Installing weak dependencies: 2024-06-04T15:49:35.373 INFO:teuthology.orchestra.run.smithi144.stdout: dconf x86_64 0.40.0-6.el9 appstream 113 k 2024-06-04T15:49:35.374 INFO:teuthology.orchestra.run.smithi144.stdout: exiv2 x86_64 0.27.5-2.el9 appstream 980 k 2024-06-04T15:49:35.374 INFO:teuthology.orchestra.run.smithi144.stdout: flatpak x86_64 1.12.8-1.el9 appstream 1.7 M 2024-06-04T15:49:35.374 INFO:teuthology.orchestra.run.smithi144.stdout: gtk3 x86_64 3.24.31-2.el9 appstream 4.9 M 2024-06-04T15:49:35.374 INFO:teuthology.orchestra.run.smithi144.stdout: java-11-openjdk-devel x86_64 1:11.0.20.1.1-2.el9 appstream 3.3 M 2024-06-04T15:49:35.374 INFO:teuthology.orchestra.run.smithi144.stdout: libcanberra-gtk3 x86_64 0.30-27.el9 appstream 32 k 2024-06-04T15:49:35.374 INFO:teuthology.orchestra.run.smithi144.stdout: p11-kit-server x86_64 0.25.3-2.el9 appstream 246 k 2024-06-04T15:49:35.375 INFO:teuthology.orchestra.run.smithi144.stdout: pipewire x86_64 1.0.1-1.el9 appstream 107 k 2024-06-04T15:49:35.375 INFO:teuthology.orchestra.run.smithi144.stdout: pipewire-alsa x86_64 1.0.1-1.el9 appstream 57 k 2024-06-04T15:49:35.375 INFO:teuthology.orchestra.run.smithi144.stdout: pipewire-jack-audio-connection-kit x86_64 1.0.1-1.el9 appstream 9.1 k 2024-06-04T15:49:35.375 INFO:teuthology.orchestra.run.smithi144.stdout: pipewire-pulseaudio x86_64 1.0.1-1.el9 appstream 192 k 2024-06-04T15:49:35.375 INFO:teuthology.orchestra.run.smithi144.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-06-04T15:49:35.375 INFO:teuthology.orchestra.run.smithi144.stdout: tracker-miners x86_64 3.1.2-4.el9 appstream 944 k 2024-06-04T15:49:35.375 INFO:teuthology.orchestra.run.smithi144.stdout: xdg-desktop-portal-gtk x86_64 1.12.0-3.el9 appstream 134 k 2024-06-04T15:49:35.375 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T15:49:35.375 INFO:teuthology.orchestra.run.smithi144.stdout:Transaction Summary 2024-06-04T15:49:35.375 INFO:teuthology.orchestra.run.smithi144.stdout:====================================================================================================== 2024-06-04T15:49:35.375 INFO:teuthology.orchestra.run.smithi144.stdout:Install 281 Packages 2024-06-04T15:49:35.375 INFO:teuthology.orchestra.run.smithi144.stdout:Upgrade 2 Packages 2024-06-04T15:49:35.375 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T15:49:35.376 INFO:teuthology.orchestra.run.smithi144.stdout:Total download size: 304 M 2024-06-04T15:49:35.376 INFO:teuthology.orchestra.run.smithi144.stdout:Downloading Packages: 2024-06-04T15:49:36.147 INFO:teuthology.orchestra.run.smithi144.stdout:(1/283): ceph-19.0.0-4027.g65533a90.el9.x86_64. 34 kB/s | 6.6 kB 00:00 2024-06-04T15:49:36.322 INFO:teuthology.orchestra.run.smithi144.stdout:(2/283): ceph-fuse-19.0.0-4027.g65533a90.el9.x8 5.0 MB/s | 893 kB 00:00 2024-06-04T15:49:36.372 INFO:teuthology.orchestra.run.smithi144.stdout:(3/283): ceph-immutable-object-cache-19.0.0-402 2.8 MB/s | 145 kB 00:00 2024-06-04T15:49:36.423 INFO:teuthology.orchestra.run.smithi177.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-06-04T15:49:36.424 INFO:teuthology.orchestra.run.smithi177.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-06-04T15:49:36.514 INFO:teuthology.orchestra.run.smithi177.stdout:Dependencies resolved. 2024-06-04T15:49:36.523 INFO:teuthology.orchestra.run.smithi144.stdout:(4/283): ceph-mds-19.0.0-4027.g65533a90.el9.x86 16 MB/s | 2.4 MB 00:00 2024-06-04T15:49:36.546 INFO:teuthology.orchestra.run.smithi177.stdout:====================================================================================================== 2024-06-04T15:49:36.547 INFO:teuthology.orchestra.run.smithi177.stdout: Package Arch Version Repository Size 2024-06-04T15:49:36.547 INFO:teuthology.orchestra.run.smithi177.stdout:====================================================================================================== 2024-06-04T15:49:36.547 INFO:teuthology.orchestra.run.smithi177.stdout:Installing: 2024-06-04T15:49:36.547 INFO:teuthology.orchestra.run.smithi177.stdout: ceph x86_64 2:19.0.0-4027.g65533a90.el9 ceph 6.6 k 2024-06-04T15:49:36.547 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-base x86_64 2:19.0.0-4027.g65533a90.el9 ceph 5.4 M 2024-06-04T15:49:36.547 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-fuse x86_64 2:19.0.0-4027.g65533a90.el9 ceph 893 k 2024-06-04T15:49:36.547 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-4027.g65533a90.el9 ceph 145 k 2024-06-04T15:49:36.547 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-mgr x86_64 2:19.0.0-4027.g65533a90.el9 ceph 1.5 M 2024-06-04T15:49:36.548 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-mgr-cephadm noarch 2:19.0.0-4027.g65533a90.el9 ceph-noarch 143 k 2024-06-04T15:49:36.548 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-mgr-dashboard noarch 2:19.0.0-4027.g65533a90.el9 ceph-noarch 3.5 M 2024-06-04T15:49:36.548 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-4027.g65533a90.el9 ceph-noarch 7.4 M 2024-06-04T15:49:36.548 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-mgr-rook noarch 2:19.0.0-4027.g65533a90.el9 ceph-noarch 49 k 2024-06-04T15:49:36.548 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-radosgw x86_64 2:19.0.0-4027.g65533a90.el9 ceph 11 M 2024-06-04T15:49:36.548 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-test x86_64 2:19.0.0-4027.g65533a90.el9 ceph 49 M 2024-06-04T15:49:36.548 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-volume noarch 2:19.0.0-4027.g65533a90.el9 ceph-noarch 273 k 2024-06-04T15:49:36.548 INFO:teuthology.orchestra.run.smithi177.stdout: cephadm noarch 2:19.0.0-4027.g65533a90.el9 ceph-noarch 764 k 2024-06-04T15:49:36.548 INFO:teuthology.orchestra.run.smithi177.stdout: libcephfs-devel x86_64 2:19.0.0-4027.g65533a90.el9 ceph 32 k 2024-06-04T15:49:36.549 INFO:teuthology.orchestra.run.smithi177.stdout: libcephfs2 x86_64 2:19.0.0-4027.g65533a90.el9 ceph 748 k 2024-06-04T15:49:36.549 INFO:teuthology.orchestra.run.smithi177.stdout: librados-devel x86_64 2:19.0.0-4027.g65533a90.el9 ceph 127 k 2024-06-04T15:49:36.549 INFO:teuthology.orchestra.run.smithi177.stdout: maven noarch 1:3.6.3-15.el9 appstream 18 k 2024-06-04T15:49:36.549 INFO:teuthology.orchestra.run.smithi177.stdout: python3-cephfs x86_64 2:19.0.0-4027.g65533a90.el9 ceph 161 k 2024-06-04T15:49:36.549 INFO:teuthology.orchestra.run.smithi177.stdout: python3-rados x86_64 2:19.0.0-4027.g65533a90.el9 ceph 320 k 2024-06-04T15:49:36.549 INFO:teuthology.orchestra.run.smithi177.stdout: python3-rbd x86_64 2:19.0.0-4027.g65533a90.el9 ceph 300 k 2024-06-04T15:49:36.550 INFO:teuthology.orchestra.run.smithi177.stdout: python3-rgw x86_64 2:19.0.0-4027.g65533a90.el9 ceph 99 k 2024-06-04T15:49:36.550 INFO:teuthology.orchestra.run.smithi177.stdout: rbd-fuse x86_64 2:19.0.0-4027.g65533a90.el9 ceph 85 k 2024-06-04T15:49:36.550 INFO:teuthology.orchestra.run.smithi177.stdout: rbd-mirror x86_64 2:19.0.0-4027.g65533a90.el9 ceph 3.1 M 2024-06-04T15:49:36.550 INFO:teuthology.orchestra.run.smithi177.stdout: rbd-nbd x86_64 2:19.0.0-4027.g65533a90.el9 ceph 171 k 2024-06-04T15:49:36.550 INFO:teuthology.orchestra.run.smithi177.stdout: s3cmd noarch 2.4.0-1.el9 epel 206 k 2024-06-04T15:49:36.550 INFO:teuthology.orchestra.run.smithi177.stdout:Upgrading: 2024-06-04T15:49:36.550 INFO:teuthology.orchestra.run.smithi177.stdout: librados2 x86_64 2:19.0.0-4027.g65533a90.el9 ceph 3.4 M 2024-06-04T15:49:36.551 INFO:teuthology.orchestra.run.smithi177.stdout: librbd1 x86_64 2:19.0.0-4027.g65533a90.el9 ceph 3.1 M 2024-06-04T15:49:36.551 INFO:teuthology.orchestra.run.smithi177.stdout:Installing dependencies: 2024-06-04T15:49:36.551 INFO:teuthology.orchestra.run.smithi177.stdout: ModemManager-glib x86_64 1.20.2-1.el9 baseos 335 k 2024-06-04T15:49:36.551 INFO:teuthology.orchestra.run.smithi177.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-06-04T15:49:36.551 INFO:teuthology.orchestra.run.smithi177.stdout: adwaita-cursor-theme noarch 40.1.1-3.el9 appstream 650 k 2024-06-04T15:49:36.551 INFO:teuthology.orchestra.run.smithi177.stdout: adwaita-icon-theme noarch 40.1.1-3.el9 appstream 12 M 2024-06-04T15:49:36.551 INFO:teuthology.orchestra.run.smithi177.stdout: alsa-lib x86_64 1.2.10-2.el9 appstream 523 k 2024-06-04T15:49:36.551 INFO:teuthology.orchestra.run.smithi177.stdout: apache-commons-cli noarch 1.4-17.el9 appstream 71 k 2024-06-04T15:49:36.551 INFO:teuthology.orchestra.run.smithi177.stdout: apache-commons-codec noarch 1.15-7.el9 appstream 302 k 2024-06-04T15:49:36.551 INFO:teuthology.orchestra.run.smithi177.stdout: apache-commons-io noarch 1:2.8.0-8.el9 appstream 283 k 2024-06-04T15:49:36.552 INFO:teuthology.orchestra.run.smithi177.stdout: apache-commons-lang3 noarch 3.12.0-6.el9 appstream 559 k 2024-06-04T15:49:36.552 INFO:teuthology.orchestra.run.smithi177.stdout: at-spi2-atk x86_64 2.38.0-4.el9 appstream 87 k 2024-06-04T15:49:36.552 INFO:teuthology.orchestra.run.smithi177.stdout: at-spi2-core x86_64 2.40.3-1.el9 appstream 195 k 2024-06-04T15:49:36.552 INFO:teuthology.orchestra.run.smithi177.stdout: atinject noarch 1.0.3-6.el9 appstream 23 k 2024-06-04T15:49:36.552 INFO:teuthology.orchestra.run.smithi177.stdout: atk x86_64 2.36.0-5.el9 appstream 292 k 2024-06-04T15:49:36.552 INFO:teuthology.orchestra.run.smithi177.stdout: avahi-glib x86_64 0.8-20.el9 appstream 15 k 2024-06-04T15:49:36.552 INFO:teuthology.orchestra.run.smithi177.stdout: bluez-libs x86_64 5.56-6.el9 baseos 85 k 2024-06-04T15:49:36.552 INFO:teuthology.orchestra.run.smithi177.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-06-04T15:49:36.553 INFO:teuthology.orchestra.run.smithi177.stdout: bubblewrap x86_64 0.4.1-7.el9 baseos 49 k 2024-06-04T15:49:36.553 INFO:teuthology.orchestra.run.smithi177.stdout: cdi-api noarch 2.0.2-6.el9 appstream 53 k 2024-06-04T15:49:36.553 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-common x86_64 2:19.0.0-4027.g65533a90.el9 ceph 21 M 2024-06-04T15:49:36.553 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-grafana-dashboards noarch 2:19.0.0-4027.g65533a90.el9 ceph-noarch 34 k 2024-06-04T15:49:36.553 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-mds x86_64 2:19.0.0-4027.g65533a90.el9 ceph 2.4 M 2024-06-04T15:49:36.553 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-mgr-modules-core noarch 2:19.0.0-4027.g65533a90.el9 ceph-noarch 274 k 2024-06-04T15:49:36.553 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-mon x86_64 2:19.0.0-4027.g65533a90.el9 ceph 4.7 M 2024-06-04T15:49:36.553 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-osd x86_64 2:19.0.0-4027.g65533a90.el9 ceph 17 M 2024-06-04T15:49:36.553 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-prometheus-alerts noarch 2:19.0.0-4027.g65533a90.el9 ceph-noarch 16 k 2024-06-04T15:49:36.553 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-selinux x86_64 2:19.0.0-4027.g65533a90.el9 ceph 25 k 2024-06-04T15:49:36.553 INFO:teuthology.orchestra.run.smithi177.stdout: colord-libs x86_64 1.4.5-4.el9 appstream 229 k 2024-06-04T15:49:36.554 INFO:teuthology.orchestra.run.smithi177.stdout: composefs-libs x86_64 1.0.3-2.el9 appstream 60 k 2024-06-04T15:49:36.554 INFO:teuthology.orchestra.run.smithi177.stdout: copy-jdk-configs noarch 4.0-3.el9 appstream 28 k 2024-06-04T15:49:36.554 INFO:teuthology.orchestra.run.smithi177.stdout: cups-libs x86_64 1:2.3.3op2-26.el9 baseos 262 k 2024-06-04T15:49:36.554 INFO:teuthology.orchestra.run.smithi177.stdout: exempi x86_64 2.6.0-0.2.20211007gite23c213.el9 appstream 525 k 2024-06-04T15:49:36.554 INFO:teuthology.orchestra.run.smithi177.stdout: exiv2-libs x86_64 0.27.5-2.el9 appstream 781 k 2024-06-04T15:49:36.554 INFO:teuthology.orchestra.run.smithi177.stdout: fdk-aac-free x86_64 2.0.0-8.el9 appstream 325 k 2024-06-04T15:49:36.554 INFO:teuthology.orchestra.run.smithi177.stdout: flac-libs x86_64 1.3.3-12.el9 appstream 218 k 2024-06-04T15:49:36.554 INFO:teuthology.orchestra.run.smithi177.stdout: flatpak-selinux noarch 1.12.8-1.el9 appstream 21 k 2024-06-04T15:49:36.554 INFO:teuthology.orchestra.run.smithi177.stdout: flatpak-session-helper x86_64 1.12.8-1.el9 appstream 74 k 2024-06-04T15:49:36.554 INFO:teuthology.orchestra.run.smithi177.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-06-04T15:49:36.555 INFO:teuthology.orchestra.run.smithi177.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-06-04T15:49:36.555 INFO:teuthology.orchestra.run.smithi177.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-06-04T15:49:36.555 INFO:teuthology.orchestra.run.smithi177.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-06-04T15:49:36.555 INFO:teuthology.orchestra.run.smithi177.stdout: gdk-pixbuf2-modules x86_64 2.42.6-3.el9 appstream 88 k 2024-06-04T15:49:36.555 INFO:teuthology.orchestra.run.smithi177.stdout: geoclue2 x86_64 2.6.0-7.el9 appstream 124 k 2024-06-04T15:49:36.555 INFO:teuthology.orchestra.run.smithi177.stdout: giflib x86_64 5.2.1-9.el9 appstream 49 k 2024-06-04T15:49:36.555 INFO:teuthology.orchestra.run.smithi177.stdout: google-guice noarch 4.2.3-9.el9 appstream 473 k 2024-06-04T15:49:36.555 INFO:teuthology.orchestra.run.smithi177.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-06-04T15:49:36.556 INFO:teuthology.orchestra.run.smithi177.stdout: graphene x86_64 1.10.6-2.el9 appstream 64 k 2024-06-04T15:49:36.556 INFO:teuthology.orchestra.run.smithi177.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-06-04T15:49:36.556 INFO:teuthology.orchestra.run.smithi177.stdout: gsm x86_64 1.0.19-6.el9 appstream 34 k 2024-06-04T15:49:36.556 INFO:teuthology.orchestra.run.smithi177.stdout: gstreamer1 x86_64 1.22.1-2.el9 appstream 1.4 M 2024-06-04T15:49:36.556 INFO:teuthology.orchestra.run.smithi177.stdout: gstreamer1-plugins-base x86_64 1.22.1-2.el9 appstream 2.2 M 2024-06-04T15:49:36.556 INFO:teuthology.orchestra.run.smithi177.stdout: gtk-update-icon-cache x86_64 3.24.31-2.el9 appstream 35 k 2024-06-04T15:49:36.556 INFO:teuthology.orchestra.run.smithi177.stdout: guava noarch 30.1-6.el9 appstream 2.3 M 2024-06-04T15:49:36.556 INFO:teuthology.orchestra.run.smithi177.stdout: hicolor-icon-theme noarch 0.17-13.el9 appstream 219 k 2024-06-04T15:49:36.556 INFO:teuthology.orchestra.run.smithi177.stdout: httpcomponents-client noarch 4.5.13-3.el9 appstream 657 k 2024-06-04T15:49:36.556 INFO:teuthology.orchestra.run.smithi177.stdout: httpcomponents-core noarch 4.4.13-7.el9 appstream 632 k 2024-06-04T15:49:36.556 INFO:teuthology.orchestra.run.smithi177.stdout: iso-codes noarch 4.6.0-3.el9 appstream 3.5 M 2024-06-04T15:49:36.557 INFO:teuthology.orchestra.run.smithi177.stdout: jakarta-annotations noarch 1.3.5-13.el9 appstream 45 k 2024-06-04T15:49:36.557 INFO:teuthology.orchestra.run.smithi177.stdout: jansi x86_64 2.3.3-6.el9 appstream 110 k 2024-06-04T15:49:36.557 INFO:teuthology.orchestra.run.smithi177.stdout: java-11-openjdk x86_64 1:11.0.20.1.1-2.el9 appstream 413 k 2024-06-04T15:49:36.557 INFO:teuthology.orchestra.run.smithi177.stdout: java-11-openjdk-headless x86_64 1:11.0.20.1.1-2.el9 appstream 39 M 2024-06-04T15:49:36.557 INFO:teuthology.orchestra.run.smithi177.stdout: javapackages-filesystem noarch 6.0.0-4.el9 appstream 13 k 2024-06-04T15:49:36.557 INFO:teuthology.orchestra.run.smithi177.stdout: jbigkit-libs x86_64 2.1-23.el9 appstream 53 k 2024-06-04T15:49:36.557 INFO:teuthology.orchestra.run.smithi177.stdout: jcl-over-slf4j noarch 1.7.30-13.el9 appstream 24 k 2024-06-04T15:49:36.557 INFO:teuthology.orchestra.run.smithi177.stdout: jsoup noarch 1.13.1-10.el9 appstream 377 k 2024-06-04T15:49:36.557 INFO:teuthology.orchestra.run.smithi177.stdout: jsr-305 noarch 3.0.2-6.el9 appstream 35 k 2024-06-04T15:49:36.557 INFO:teuthology.orchestra.run.smithi177.stdout: lcms2 x86_64 2.12-3.el9 appstream 168 k 2024-06-04T15:49:36.558 INFO:teuthology.orchestra.run.smithi177.stdout: libX11-xcb x86_64 1.7.0-9.el9 appstream 11 k 2024-06-04T15:49:36.558 INFO:teuthology.orchestra.run.smithi177.stdout: libXcomposite x86_64 0.4.5-7.el9 appstream 24 k 2024-06-04T15:49:36.558 INFO:teuthology.orchestra.run.smithi177.stdout: libXcursor x86_64 1.2.0-7.el9 appstream 31 k 2024-06-04T15:49:36.558 INFO:teuthology.orchestra.run.smithi177.stdout: libXdamage x86_64 1.1.5-7.el9 appstream 23 k 2024-06-04T15:49:36.558 INFO:teuthology.orchestra.run.smithi177.stdout: libXfixes x86_64 5.0.3-16.el9 appstream 20 k 2024-06-04T15:49:36.558 INFO:teuthology.orchestra.run.smithi177.stdout: libXi x86_64 1.7.10-8.el9 appstream 40 k 2024-06-04T15:49:36.558 INFO:teuthology.orchestra.run.smithi177.stdout: libXinerama x86_64 1.1.4-10.el9 appstream 15 k 2024-06-04T15:49:36.558 INFO:teuthology.orchestra.run.smithi177.stdout: libXrandr x86_64 1.5.2-8.el9 appstream 28 k 2024-06-04T15:49:36.558 INFO:teuthology.orchestra.run.smithi177.stdout: libXtst x86_64 1.2.3-16.el9 appstream 21 k 2024-06-04T15:49:36.558 INFO:teuthology.orchestra.run.smithi177.stdout: libXv x86_64 1.0.11-16.el9 appstream 19 k 2024-06-04T15:49:36.558 INFO:teuthology.orchestra.run.smithi177.stdout: libXxf86vm x86_64 1.1.4-18.el9 appstream 19 k 2024-06-04T15:49:36.558 INFO:teuthology.orchestra.run.smithi177.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-06-04T15:49:36.559 INFO:teuthology.orchestra.run.smithi177.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-06-04T15:49:36.559 INFO:teuthology.orchestra.run.smithi177.stdout: libasyncns x86_64 0.8-22.el9 appstream 30 k 2024-06-04T15:49:36.559 INFO:teuthology.orchestra.run.smithi177.stdout: libcanberra x86_64 0.30-27.el9 appstream 86 k 2024-06-04T15:49:36.559 INFO:teuthology.orchestra.run.smithi177.stdout: libcephsqlite x86_64 2:19.0.0-4027.g65533a90.el9 ceph 163 k 2024-06-04T15:49:36.560 INFO:teuthology.orchestra.run.smithi177.stdout: libdrm x86_64 2.4.117-1.el9 appstream 161 k 2024-06-04T15:49:36.560 INFO:teuthology.orchestra.run.smithi177.stdout: libepoxy x86_64 1.5.5-4.el9 appstream 241 k 2024-06-04T15:49:36.560 INFO:teuthology.orchestra.run.smithi177.stdout: libexif x86_64 0.6.22-6.el9 appstream 435 k 2024-06-04T15:49:36.560 INFO:teuthology.orchestra.run.smithi177.stdout: libfontenc x86_64 1.1.3-17.el9 appstream 31 k 2024-06-04T15:49:36.560 INFO:teuthology.orchestra.run.smithi177.stdout: libgexiv2 x86_64 0.12.3-1.el9 appstream 83 k 2024-06-04T15:49:36.560 INFO:teuthology.orchestra.run.smithi177.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-06-04T15:49:36.560 INFO:teuthology.orchestra.run.smithi177.stdout: libglvnd x86_64 1:1.3.4-1.el9 appstream 135 k 2024-06-04T15:49:36.560 INFO:teuthology.orchestra.run.smithi177.stdout: libglvnd-egl x86_64 1:1.3.4-1.el9 appstream 37 k 2024-06-04T15:49:36.560 INFO:teuthology.orchestra.run.smithi177.stdout: libglvnd-glx x86_64 1:1.3.4-1.el9 appstream 142 k 2024-06-04T15:49:36.561 INFO:teuthology.orchestra.run.smithi177.stdout: libgsf x86_64 1.14.47-5.el9 appstream 256 k 2024-06-04T15:49:36.561 INFO:teuthology.orchestra.run.smithi177.stdout: libgxps x86_64 0.3.2-3.el9 appstream 79 k 2024-06-04T15:49:36.561 INFO:teuthology.orchestra.run.smithi177.stdout: libiptcdata x86_64 1.0.5-9.el9 appstream 62 k 2024-06-04T15:49:36.561 INFO:teuthology.orchestra.run.smithi177.stdout: libldac x86_64 2.0.2.3-10.el9 appstream 41 k 2024-06-04T15:49:36.561 INFO:teuthology.orchestra.run.smithi177.stdout: libnotify x86_64 0.7.9-8.el9 appstream 44 k 2024-06-04T15:49:36.561 INFO:teuthology.orchestra.run.smithi177.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-06-04T15:49:36.561 INFO:teuthology.orchestra.run.smithi177.stdout: libogg x86_64 2:1.3.4-6.el9 appstream 34 k 2024-06-04T15:49:36.561 INFO:teuthology.orchestra.run.smithi177.stdout: libosinfo x86_64 1.10.0-1.el9 appstream 319 k 2024-06-04T15:49:36.561 INFO:teuthology.orchestra.run.smithi177.stdout: libpciaccess x86_64 0.16-7.el9 baseos 27 k 2024-06-04T15:49:36.561 INFO:teuthology.orchestra.run.smithi177.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-06-04T15:49:36.561 INFO:teuthology.orchestra.run.smithi177.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-06-04T15:49:36.561 INFO:teuthology.orchestra.run.smithi177.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-06-04T15:49:36.562 INFO:teuthology.orchestra.run.smithi177.stdout: libradosstriper1 x86_64 2:19.0.0-4027.g65533a90.el9 ceph 504 k 2024-06-04T15:49:36.562 INFO:teuthology.orchestra.run.smithi177.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-06-04T15:49:36.562 INFO:teuthology.orchestra.run.smithi177.stdout: librgw2 x86_64 2:19.0.0-4027.g65533a90.el9 ceph 5.4 M 2024-06-04T15:49:36.562 INFO:teuthology.orchestra.run.smithi177.stdout: libsbc x86_64 1.4-9.el9 appstream 45 k 2024-06-04T15:49:36.562 INFO:teuthology.orchestra.run.smithi177.stdout: libsndfile x86_64 1.0.31-8.el9 appstream 206 k 2024-06-04T15:49:36.562 INFO:teuthology.orchestra.run.smithi177.stdout: libtheora x86_64 1:1.1.1-31.el9 appstream 164 k 2024-06-04T15:49:36.562 INFO:teuthology.orchestra.run.smithi177.stdout: libtiff x86_64 4.4.0-12.el9 appstream 198 k 2024-06-04T15:49:36.562 INFO:teuthology.orchestra.run.smithi177.stdout: libtool-ltdl x86_64 2.4.6-45.el9 appstream 37 k 2024-06-04T15:49:36.562 INFO:teuthology.orchestra.run.smithi177.stdout: libtracker-sparql x86_64 3.1.2-3.el9 appstream 324 k 2024-06-04T15:49:36.562 INFO:teuthology.orchestra.run.smithi177.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-06-04T15:49:36.563 INFO:teuthology.orchestra.run.smithi177.stdout: libvisual x86_64 1:0.4.0-34.el9 appstream 144 k 2024-06-04T15:49:36.563 INFO:teuthology.orchestra.run.smithi177.stdout: libvorbis x86_64 1:1.3.7-5.el9 appstream 193 k 2024-06-04T15:49:36.563 INFO:teuthology.orchestra.run.smithi177.stdout: libwayland-client x86_64 1.21.0-1.el9 appstream 33 k 2024-06-04T15:49:36.563 INFO:teuthology.orchestra.run.smithi177.stdout: libwayland-cursor x86_64 1.21.0-1.el9 appstream 19 k 2024-06-04T15:49:36.563 INFO:teuthology.orchestra.run.smithi177.stdout: libwayland-egl x86_64 1.21.0-1.el9 appstream 13 k 2024-06-04T15:49:36.563 INFO:teuthology.orchestra.run.smithi177.stdout: libwayland-server x86_64 1.21.0-1.el9 appstream 42 k 2024-06-04T15:49:36.563 INFO:teuthology.orchestra.run.smithi177.stdout: libwebp x86_64 1.2.0-8.el9 appstream 277 k 2024-06-04T15:49:36.563 INFO:teuthology.orchestra.run.smithi177.stdout: libxkbcommon x86_64 1.0.3-4.el9 appstream 133 k 2024-06-04T15:49:36.563 INFO:teuthology.orchestra.run.smithi177.stdout: libxshmfence x86_64 1.3-10.el9 appstream 13 k 2024-06-04T15:49:36.563 INFO:teuthology.orchestra.run.smithi177.stdout: lksctp-tools x86_64 1.0.19-2.el9 baseos 94 k 2024-06-04T15:49:36.563 INFO:teuthology.orchestra.run.smithi177.stdout: low-memory-monitor x86_64 2.1-4.el9 appstream 36 k 2024-06-04T15:49:36.564 INFO:teuthology.orchestra.run.smithi177.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-06-04T15:49:36.564 INFO:teuthology.orchestra.run.smithi177.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-06-04T15:49:36.564 INFO:teuthology.orchestra.run.smithi177.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-06-04T15:49:36.564 INFO:teuthology.orchestra.run.smithi177.stdout: lua-posix x86_64 35.0-8.el9 appstream 151 k 2024-06-04T15:49:36.564 INFO:teuthology.orchestra.run.smithi177.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-06-04T15:49:36.564 INFO:teuthology.orchestra.run.smithi177.stdout: maven-lib noarch 1:3.6.3-15.el9 appstream 1.5 M 2024-06-04T15:49:36.564 INFO:teuthology.orchestra.run.smithi177.stdout: maven-openjdk11 noarch 1:3.6.3-15.el9 appstream 9.0 k 2024-06-04T15:49:36.564 INFO:teuthology.orchestra.run.smithi177.stdout: maven-resolver noarch 1:1.6.1-10.el9 appstream 517 k 2024-06-04T15:49:36.564 INFO:teuthology.orchestra.run.smithi177.stdout: maven-shared-utils noarch 3.3.4-3.el9 appstream 151 k 2024-06-04T15:49:36.564 INFO:teuthology.orchestra.run.smithi177.stdout: maven-wagon noarch 3.4.2-7.el9 appstream 112 k 2024-06-04T15:49:36.564 INFO:teuthology.orchestra.run.smithi177.stdout: mesa-libEGL x86_64 23.3.3-1.el9 appstream 127 k 2024-06-04T15:49:36.565 INFO:teuthology.orchestra.run.smithi177.stdout: mesa-libGL x86_64 23.3.3-1.el9 appstream 168 k 2024-06-04T15:49:36.565 INFO:teuthology.orchestra.run.smithi177.stdout: mesa-libgbm x86_64 23.3.3-1.el9 appstream 38 k 2024-06-04T15:49:36.565 INFO:teuthology.orchestra.run.smithi177.stdout: mesa-libglapi x86_64 23.3.3-1.el9 appstream 44 k 2024-06-04T15:49:36.565 INFO:teuthology.orchestra.run.smithi177.stdout: mkfontscale x86_64 1.2.1-3.el9 appstream 32 k 2024-06-04T15:49:36.565 INFO:teuthology.orchestra.run.smithi177.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-06-04T15:49:36.565 INFO:teuthology.orchestra.run.smithi177.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-06-04T15:49:36.565 INFO:teuthology.orchestra.run.smithi177.stdout: openjpeg2 x86_64 2.4.0-7.el9 appstream 163 k 2024-06-04T15:49:36.565 INFO:teuthology.orchestra.run.smithi177.stdout: opus x86_64 1.3.1-10.el9 appstream 200 k 2024-06-04T15:49:36.565 INFO:teuthology.orchestra.run.smithi177.stdout: orc x86_64 0.4.31-6.el9 appstream 184 k 2024-06-04T15:49:36.565 INFO:teuthology.orchestra.run.smithi177.stdout: osinfo-db noarch 20231215-1.el9 appstream 521 k 2024-06-04T15:49:36.565 INFO:teuthology.orchestra.run.smithi177.stdout: osinfo-db-tools x86_64 1.10.0-1.el9 appstream 74 k 2024-06-04T15:49:36.566 INFO:teuthology.orchestra.run.smithi177.stdout: ostree-libs x86_64 2024.6-1.el9 appstream 466 k 2024-06-04T15:49:36.566 INFO:teuthology.orchestra.run.smithi177.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-06-04T15:49:36.566 INFO:teuthology.orchestra.run.smithi177.stdout: pipewire-jack-audio-connection-kit-libs x86_64 1.0.1-1.el9 appstream 135 k 2024-06-04T15:49:36.566 INFO:teuthology.orchestra.run.smithi177.stdout: pipewire-libs x86_64 1.0.1-1.el9 appstream 1.9 M 2024-06-04T15:49:36.566 INFO:teuthology.orchestra.run.smithi177.stdout: plexus-cipher noarch 1.7-27.el9 appstream 26 k 2024-06-04T15:49:36.566 INFO:teuthology.orchestra.run.smithi177.stdout: plexus-classworlds noarch 2.6.0-11.el9 appstream 60 k 2024-06-04T15:49:36.566 INFO:teuthology.orchestra.run.smithi177.stdout: plexus-containers-component-annotations noarch 2.1.0-10.el9 appstream 18 k 2024-06-04T15:49:36.566 INFO:teuthology.orchestra.run.smithi177.stdout: plexus-interpolation noarch 1.26-11.el9 appstream 80 k 2024-06-04T15:49:36.566 INFO:teuthology.orchestra.run.smithi177.stdout: plexus-sec-dispatcher noarch 1.4-37.el9 appstream 34 k 2024-06-04T15:49:36.566 INFO:teuthology.orchestra.run.smithi177.stdout: plexus-utils noarch 3.3.0-10.el9 appstream 254 k 2024-06-04T15:49:36.567 INFO:teuthology.orchestra.run.smithi177.stdout: poppler x86_64 21.01.0-20.el9 appstream 1.1 M 2024-06-04T15:49:36.567 INFO:teuthology.orchestra.run.smithi177.stdout: poppler-data noarch 0.4.9-9.el9 appstream 1.9 M 2024-06-04T15:49:36.567 INFO:teuthology.orchestra.run.smithi177.stdout: poppler-glib x86_64 21.01.0-20.el9 appstream 152 k 2024-06-04T15:49:36.567 INFO:teuthology.orchestra.run.smithi177.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-06-04T15:49:36.567 INFO:teuthology.orchestra.run.smithi177.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-06-04T15:49:36.567 INFO:teuthology.orchestra.run.smithi177.stdout: publicsuffix-list noarch 20210518-3.el9 appstream 83 k 2024-06-04T15:49:36.567 INFO:teuthology.orchestra.run.smithi177.stdout: pulseaudio-libs x86_64 15.0-2.el9 appstream 679 k 2024-06-04T15:49:36.567 INFO:teuthology.orchestra.run.smithi177.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-06-04T15:49:36.567 INFO:teuthology.orchestra.run.smithi177.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-06-04T15:49:36.567 INFO:teuthology.orchestra.run.smithi177.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-06-04T15:49:36.568 INFO:teuthology.orchestra.run.smithi177.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-06-04T15:49:36.568 INFO:teuthology.orchestra.run.smithi177.stdout: python3-ceph-argparse x86_64 2:19.0.0-4027.g65533a90.el9 ceph 45 k 2024-06-04T15:49:36.568 INFO:teuthology.orchestra.run.smithi177.stdout: python3-ceph-common x86_64 2:19.0.0-4027.g65533a90.el9 ceph 136 k 2024-06-04T15:49:36.568 INFO:teuthology.orchestra.run.smithi177.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-06-04T15:49:36.568 INFO:teuthology.orchestra.run.smithi177.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-06-04T15:49:36.568 INFO:teuthology.orchestra.run.smithi177.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-06-04T15:49:36.568 INFO:teuthology.orchestra.run.smithi177.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-06-04T15:49:36.568 INFO:teuthology.orchestra.run.smithi177.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-06-04T15:49:36.568 INFO:teuthology.orchestra.run.smithi177.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-06-04T15:49:36.568 INFO:teuthology.orchestra.run.smithi177.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-06-04T15:49:36.568 INFO:teuthology.orchestra.run.smithi177.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-06-04T15:49:36.569 INFO:teuthology.orchestra.run.smithi177.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-06-04T15:49:36.569 INFO:teuthology.orchestra.run.smithi177.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-06-04T15:49:36.569 INFO:teuthology.orchestra.run.smithi177.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-06-04T15:49:36.569 INFO:teuthology.orchestra.run.smithi177.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-06-04T15:49:36.569 INFO:teuthology.orchestra.run.smithi177.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-06-04T15:49:36.569 INFO:teuthology.orchestra.run.smithi177.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-06-04T15:49:36.569 INFO:teuthology.orchestra.run.smithi177.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-06-04T15:49:36.569 INFO:teuthology.orchestra.run.smithi177.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-06-04T15:49:36.569 INFO:teuthology.orchestra.run.smithi177.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-06-04T15:49:36.569 INFO:teuthology.orchestra.run.smithi177.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-06-04T15:49:36.569 INFO:teuthology.orchestra.run.smithi177.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-06-04T15:49:36.570 INFO:teuthology.orchestra.run.smithi177.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-06-04T15:49:36.570 INFO:teuthology.orchestra.run.smithi177.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-06-04T15:49:36.570 INFO:teuthology.orchestra.run.smithi177.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-06-04T15:49:36.570 INFO:teuthology.orchestra.run.smithi177.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-06-04T15:49:36.570 INFO:teuthology.orchestra.run.smithi177.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-06-04T15:49:36.570 INFO:teuthology.orchestra.run.smithi177.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-06-04T15:49:36.570 INFO:teuthology.orchestra.run.smithi177.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-06-04T15:49:36.570 INFO:teuthology.orchestra.run.smithi177.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-06-04T15:49:36.570 INFO:teuthology.orchestra.run.smithi177.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-06-04T15:49:36.570 INFO:teuthology.orchestra.run.smithi177.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-06-04T15:49:36.570 INFO:teuthology.orchestra.run.smithi177.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-06-04T15:49:36.571 INFO:teuthology.orchestra.run.smithi177.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-06-04T15:49:36.571 INFO:teuthology.orchestra.run.smithi177.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-06-04T15:49:36.571 INFO:teuthology.orchestra.run.smithi177.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-06-04T15:49:36.571 INFO:teuthology.orchestra.run.smithi177.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-06-04T15:49:36.571 INFO:teuthology.orchestra.run.smithi177.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-06-04T15:49:36.571 INFO:teuthology.orchestra.run.smithi177.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-06-04T15:49:36.571 INFO:teuthology.orchestra.run.smithi177.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-06-04T15:49:36.571 INFO:teuthology.orchestra.run.smithi177.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-06-04T15:49:36.571 INFO:teuthology.orchestra.run.smithi177.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-06-04T15:49:36.571 INFO:teuthology.orchestra.run.smithi177.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-06-04T15:49:36.571 INFO:teuthology.orchestra.run.smithi177.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-06-04T15:49:36.572 INFO:teuthology.orchestra.run.smithi177.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-06-04T15:49:36.572 INFO:teuthology.orchestra.run.smithi177.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-06-04T15:49:36.572 INFO:teuthology.orchestra.run.smithi177.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-06-04T15:49:36.572 INFO:teuthology.orchestra.run.smithi177.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-06-04T15:49:36.572 INFO:teuthology.orchestra.run.smithi177.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-06-04T15:49:36.572 INFO:teuthology.orchestra.run.smithi177.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-06-04T15:49:36.572 INFO:teuthology.orchestra.run.smithi177.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-06-04T15:49:36.572 INFO:teuthology.orchestra.run.smithi177.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-06-04T15:49:36.572 INFO:teuthology.orchestra.run.smithi177.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-06-04T15:49:36.573 INFO:teuthology.orchestra.run.smithi177.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-06-04T15:49:36.573 INFO:teuthology.orchestra.run.smithi177.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-06-04T15:49:36.573 INFO:teuthology.orchestra.run.smithi177.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-06-04T15:49:36.573 INFO:teuthology.orchestra.run.smithi177.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-06-04T15:49:36.573 INFO:teuthology.orchestra.run.smithi177.stdout: rtkit x86_64 0.11-28.el9 appstream 56 k 2024-06-04T15:49:36.573 INFO:teuthology.orchestra.run.smithi177.stdout: sisu noarch 1:0.3.4-10.el9 appstream 510 k 2024-06-04T15:49:36.573 INFO:teuthology.orchestra.run.smithi177.stdout: slf4j noarch 1.7.30-13.el9 appstream 69 k 2024-06-04T15:49:36.573 INFO:teuthology.orchestra.run.smithi177.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-06-04T15:49:36.573 INFO:teuthology.orchestra.run.smithi177.stdout: sound-theme-freedesktop noarch 0.8-17.el9 appstream 383 k 2024-06-04T15:49:36.573 INFO:teuthology.orchestra.run.smithi177.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-06-04T15:49:36.574 INFO:teuthology.orchestra.run.smithi177.stdout: totem-pl-parser x86_64 3.26.6-2.el9 appstream 152 k 2024-06-04T15:49:36.574 INFO:teuthology.orchestra.run.smithi177.stdout: tracker x86_64 3.1.2-3.el9 appstream 555 k 2024-06-04T15:49:36.574 INFO:teuthology.orchestra.run.smithi177.stdout: ttmkfdir x86_64 3.0.9-65.el9 appstream 53 k 2024-06-04T15:49:36.574 INFO:teuthology.orchestra.run.smithi177.stdout: tzdata-java noarch 2024a-2.el9 appstream 230 k 2024-06-04T15:49:36.574 INFO:teuthology.orchestra.run.smithi177.stdout: upower x86_64 0.99.11-11.el9 appstream 173 k 2024-06-04T15:49:36.574 INFO:teuthology.orchestra.run.smithi177.stdout: webrtc-audio-processing x86_64 0.3.1-8.el9 appstream 306 k 2024-06-04T15:49:36.574 INFO:teuthology.orchestra.run.smithi177.stdout: wireplumber x86_64 0.4.14-1.el9 appstream 96 k 2024-06-04T15:49:36.574 INFO:teuthology.orchestra.run.smithi177.stdout: wireplumber-libs x86_64 0.4.14-1.el9 appstream 358 k 2024-06-04T15:49:36.574 INFO:teuthology.orchestra.run.smithi177.stdout: xdg-dbus-proxy x86_64 0.1.3-1.el9 appstream 42 k 2024-06-04T15:49:36.574 INFO:teuthology.orchestra.run.smithi177.stdout: xdg-desktop-portal x86_64 1.12.6-1.el9 appstream 385 k 2024-06-04T15:49:36.575 INFO:teuthology.orchestra.run.smithi177.stdout: xkeyboard-config noarch 2.33-2.el9 appstream 859 k 2024-06-04T15:49:36.575 INFO:teuthology.orchestra.run.smithi177.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-06-04T15:49:36.575 INFO:teuthology.orchestra.run.smithi177.stdout: xorg-x11-fonts-Type1 noarch 7.5-33.el9 appstream 505 k 2024-06-04T15:49:36.575 INFO:teuthology.orchestra.run.smithi177.stdout:Installing weak dependencies: 2024-06-04T15:49:36.575 INFO:teuthology.orchestra.run.smithi177.stdout: dconf x86_64 0.40.0-6.el9 appstream 113 k 2024-06-04T15:49:36.575 INFO:teuthology.orchestra.run.smithi177.stdout: exiv2 x86_64 0.27.5-2.el9 appstream 980 k 2024-06-04T15:49:36.575 INFO:teuthology.orchestra.run.smithi177.stdout: flatpak x86_64 1.12.8-1.el9 appstream 1.7 M 2024-06-04T15:49:36.575 INFO:teuthology.orchestra.run.smithi177.stdout: gtk3 x86_64 3.24.31-2.el9 appstream 4.9 M 2024-06-04T15:49:36.575 INFO:teuthology.orchestra.run.smithi177.stdout: java-11-openjdk-devel x86_64 1:11.0.20.1.1-2.el9 appstream 3.3 M 2024-06-04T15:49:36.576 INFO:teuthology.orchestra.run.smithi177.stdout: libcanberra-gtk3 x86_64 0.30-27.el9 appstream 32 k 2024-06-04T15:49:36.576 INFO:teuthology.orchestra.run.smithi177.stdout: p11-kit-server x86_64 0.25.3-2.el9 appstream 246 k 2024-06-04T15:49:36.576 INFO:teuthology.orchestra.run.smithi177.stdout: pipewire x86_64 1.0.1-1.el9 appstream 107 k 2024-06-04T15:49:36.576 INFO:teuthology.orchestra.run.smithi177.stdout: pipewire-alsa x86_64 1.0.1-1.el9 appstream 57 k 2024-06-04T15:49:36.576 INFO:teuthology.orchestra.run.smithi177.stdout: pipewire-jack-audio-connection-kit x86_64 1.0.1-1.el9 appstream 9.1 k 2024-06-04T15:49:36.576 INFO:teuthology.orchestra.run.smithi177.stdout: pipewire-pulseaudio x86_64 1.0.1-1.el9 appstream 192 k 2024-06-04T15:49:36.576 INFO:teuthology.orchestra.run.smithi177.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-06-04T15:49:36.576 INFO:teuthology.orchestra.run.smithi177.stdout: tracker-miners x86_64 3.1.2-4.el9 appstream 944 k 2024-06-04T15:49:36.576 INFO:teuthology.orchestra.run.smithi177.stdout: xdg-desktop-portal-gtk x86_64 1.12.0-3.el9 appstream 134 k 2024-06-04T15:49:36.576 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-06-04T15:49:36.576 INFO:teuthology.orchestra.run.smithi177.stdout:Transaction Summary 2024-06-04T15:49:36.577 INFO:teuthology.orchestra.run.smithi177.stdout:====================================================================================================== 2024-06-04T15:49:36.577 INFO:teuthology.orchestra.run.smithi177.stdout:Install 281 Packages 2024-06-04T15:49:36.577 INFO:teuthology.orchestra.run.smithi177.stdout:Upgrade 2 Packages 2024-06-04T15:49:36.577 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-06-04T15:49:36.578 INFO:teuthology.orchestra.run.smithi177.stdout:Total download size: 304 M 2024-06-04T15:49:36.578 INFO:teuthology.orchestra.run.smithi177.stdout:Downloading Packages: 2024-06-04T15:49:36.656 INFO:teuthology.orchestra.run.smithi144.stdout:(5/283): ceph-mgr-19.0.0-4027.g65533a90.el9.x86 11 MB/s | 1.5 MB 00:00 2024-06-04T15:49:37.015 INFO:teuthology.orchestra.run.smithi144.stdout:(6/283): ceph-mon-19.0.0-4027.g65533a90.el9.x86 13 MB/s | 4.7 MB 00:00 2024-06-04T15:49:37.557 INFO:teuthology.orchestra.run.smithi144.stdout:(7/283): ceph-base-19.0.0-4027.g65533a90.el9.x8 3.4 MB/s | 5.4 MB 00:01 2024-06-04T15:49:37.973 INFO:teuthology.orchestra.run.smithi177.stdout:(1/283): ceph-19.0.0-4027.g65533a90.el9.x86_64. 13 kB/s | 6.6 kB 00:00 2024-06-04T15:49:38.274 INFO:teuthology.orchestra.run.smithi144.stdout:(8/283): ceph-osd-19.0.0-4027.g65533a90.el9.x86 13 MB/s | 17 MB 00:01 2024-06-04T15:49:38.341 INFO:teuthology.orchestra.run.smithi144.stdout:(9/283): ceph-selinux-19.0.0-4027.g65533a90.el9 378 kB/s | 25 kB 00:00 2024-06-04T15:49:39.416 INFO:teuthology.orchestra.run.smithi144.stdout:(10/283): ceph-radosgw-19.0.0-4027.g65533a90.el 5.7 MB/s | 11 MB 00:01 2024-06-04T15:49:39.550 INFO:teuthology.orchestra.run.smithi144.stdout:(11/283): libcephfs-devel-19.0.0-4027.g65533a90 238 kB/s | 32 kB 00:00 2024-06-04T15:49:39.750 INFO:teuthology.orchestra.run.smithi144.stdout:(12/283): ceph-common-19.0.0-4027.g65533a90.el9 5.6 MB/s | 21 MB 00:03 2024-06-04T15:49:39.784 INFO:teuthology.orchestra.run.smithi144.stdout:(13/283): libcephfs2-19.0.0-4027.g65533a90.el9. 3.1 MB/s | 748 kB 00:00 2024-06-04T15:49:39.851 INFO:teuthology.orchestra.run.smithi144.stdout:(14/283): libcephsqlite-19.0.0-4027.g65533a90.e 1.6 MB/s | 163 kB 00:00 2024-06-04T15:49:39.892 INFO:teuthology.orchestra.run.smithi144.stdout:(15/283): librados-devel-19.0.0-4027.g65533a90. 1.1 MB/s | 127 kB 00:00 2024-06-04T15:49:39.914 INFO:teuthology.orchestra.run.smithi177.stdout:(2/283): ceph-fuse-19.0.0-4027.g65533a90.el9.x8 460 kB/s | 893 kB 00:01 2024-06-04T15:49:40.068 INFO:teuthology.orchestra.run.smithi144.stdout:(16/283): libradosstriper1-19.0.0-4027.g65533a9 2.3 MB/s | 504 kB 00:00 2024-06-04T15:49:40.173 INFO:teuthology.orchestra.run.smithi177.stdout:(3/283): ceph-immutable-object-cache-19.0.0-402 562 kB/s | 145 kB 00:00 2024-06-04T15:49:40.176 INFO:teuthology.orchestra.run.smithi144.stdout:(17/283): python3-ceph-argparse-19.0.0-4027.g65 416 kB/s | 45 kB 00:00 2024-06-04T15:49:40.302 INFO:teuthology.orchestra.run.smithi144.stdout:(18/283): python3-ceph-common-19.0.0-4027.g6553 1.1 MB/s | 136 kB 00:00 2024-06-04T15:49:40.427 INFO:teuthology.orchestra.run.smithi144.stdout:(19/283): python3-cephfs-19.0.0-4027.g65533a90. 1.3 MB/s | 161 kB 00:00 2024-06-04T15:49:40.552 INFO:teuthology.orchestra.run.smithi144.stdout:(20/283): python3-rados-19.0.0-4027.g65533a90.e 2.5 MB/s | 320 kB 00:00 2024-06-04T15:49:40.640 INFO:teuthology.orchestra.run.smithi177.stdout:(4/283): ceph-common-19.0.0-4027.g65533a90.el9. 6.7 MB/s | 21 MB 00:03 2024-06-04T15:49:40.669 INFO:teuthology.orchestra.run.smithi144.stdout:(21/283): python3-rbd-19.0.0-4027.g65533a90.el9 2.5 MB/s | 300 kB 00:00 2024-06-04T15:49:40.753 INFO:teuthology.orchestra.run.smithi144.stdout:(22/283): librgw2-19.0.0-4027.g65533a90.el9.x86 6.3 MB/s | 5.4 MB 00:00 2024-06-04T15:49:40.778 INFO:teuthology.orchestra.run.smithi144.stdout:(23/283): python3-rgw-19.0.0-4027.g65533a90.el9 911 kB/s | 99 kB 00:00 2024-06-04T15:49:40.849 INFO:teuthology.orchestra.run.smithi177.stdout:(5/283): ceph-mgr-19.0.0-4027.g65533a90.el9.x86 7.3 MB/s | 1.5 MB 00:00 2024-06-04T15:49:40.862 INFO:teuthology.orchestra.run.smithi144.stdout:(24/283): rbd-fuse-19.0.0-4027.g65533a90.el9.x8 786 kB/s | 85 kB 00:00 2024-06-04T15:49:40.995 INFO:teuthology.orchestra.run.smithi144.stdout:(25/283): rbd-nbd-19.0.0-4027.g65533a90.el9.x86 1.3 MB/s | 171 kB 00:00 2024-06-04T15:49:41.121 INFO:teuthology.orchestra.run.smithi144.stdout:(26/283): ceph-grafana-dashboards-19.0.0-4027.g 273 kB/s | 34 kB 00:00 2024-06-04T15:49:41.195 INFO:teuthology.orchestra.run.smithi177.stdout:(6/283): ceph-base-19.0.0-4027.g65533a90.el9.x8 1.5 MB/s | 5.4 MB 00:03 2024-06-04T15:49:41.238 INFO:teuthology.orchestra.run.smithi144.stdout:(27/283): ceph-mgr-cephadm-19.0.0-4027.g65533a9 1.2 MB/s | 143 kB 00:00 2024-06-04T15:49:41.524 INFO:teuthology.orchestra.run.smithi177.stdout:(7/283): ceph-mon-19.0.0-4027.g65533a90.el9.x86 7.0 MB/s | 4.7 MB 00:00 2024-06-04T15:49:41.838 INFO:teuthology.orchestra.run.smithi144.stdout:(28/283): rbd-mirror-19.0.0-4027.g65533a90.el9. 2.9 MB/s | 3.1 MB 00:01 2024-06-04T15:49:42.013 INFO:teuthology.orchestra.run.smithi144.stdout:(29/283): ceph-mgr-dashboard-19.0.0-4027.g65533 4.6 MB/s | 3.5 MB 00:00 2024-06-04T15:49:42.138 INFO:teuthology.orchestra.run.smithi144.stdout:(30/283): ceph-mgr-modules-core-19.0.0-4027.g65 2.1 MB/s | 274 kB 00:00 2024-06-04T15:49:42.264 INFO:teuthology.orchestra.run.smithi144.stdout:(31/283): ceph-mgr-rook-19.0.0-4027.g65533a90.e 394 kB/s | 49 kB 00:00 2024-06-04T15:49:42.381 INFO:teuthology.orchestra.run.smithi144.stdout:(32/283): ceph-prometheus-alerts-19.0.0-4027.g6 141 kB/s | 16 kB 00:00 2024-06-04T15:49:42.506 INFO:teuthology.orchestra.run.smithi144.stdout:(33/283): ceph-volume-19.0.0-4027.g65533a90.el9 2.1 MB/s | 273 kB 00:00 2024-06-04T15:49:42.740 INFO:teuthology.orchestra.run.smithi144.stdout:(34/283): cephadm-19.0.0-4027.g65533a90.el9.noa 3.2 MB/s | 764 kB 00:00 2024-06-04T15:49:42.777 INFO:teuthology.orchestra.run.smithi144.stdout:[MIRROR] ModemManager-glib-1.20.2-1.el9.x86_64.rpm: Status code: 404 for https://download-cc-rdu01.fedoraproject.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/ModemManager-glib-1.20.2-1.el9.x86_64.rpm (IP: 8.43.85.72) 2024-06-04T15:49:42.924 INFO:teuthology.orchestra.run.smithi144.stdout:(35/283): ModemManager-glib-1.20.2-1.el9.x86_64 1.8 MB/s | 335 kB 00:00 2024-06-04T15:49:42.924 INFO:teuthology.orchestra.run.smithi144.stdout:[MIRROR] bluez-libs-5.56-6.el9.x86_64.rpm: Status code: 404 for https://download-cc-rdu01.fedoraproject.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/bluez-libs-5.56-6.el9.x86_64.rpm (IP: 8.43.85.72) 2024-06-04T15:49:42.966 INFO:teuthology.orchestra.run.smithi177.stdout:(8/283): ceph-radosgw-19.0.0-4027.g65533a90.el9 7.4 MB/s | 11 MB 00:01 2024-06-04T15:49:43.009 INFO:teuthology.orchestra.run.smithi144.stdout:(36/283): bluez-libs-5.56-6.el9.x86_64.rpm 1.0 MB/s | 85 kB 00:00 2024-06-04T15:49:43.010 INFO:teuthology.orchestra.run.smithi144.stdout:[MIRROR] bubblewrap-0.4.1-7.el9.x86_64.rpm: Status code: 404 for https://download-cc-rdu01.fedoraproject.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/bubblewrap-0.4.1-7.el9.x86_64.rpm (IP: 8.43.85.72) 2024-06-04T15:49:43.016 INFO:teuthology.orchestra.run.smithi177.stdout:(9/283): ceph-selinux-19.0.0-4027.g65533a90.el9 506 kB/s | 25 kB 00:00 2024-06-04T15:49:43.199 INFO:teuthology.orchestra.run.smithi177.stdout:(10/283): ceph-mds-19.0.0-4027.g65533a90.el9.x8 801 kB/s | 2.4 MB 00:03 2024-06-04T15:49:43.275 INFO:teuthology.orchestra.run.smithi177.stdout:(11/283): libcephfs-devel-19.0.0-4027.g65533a90 424 kB/s | 32 kB 00:00 2024-06-04T15:49:43.466 INFO:teuthology.orchestra.run.smithi144.stdout:(37/283): ceph-test-19.0.0-4027.g65533a90.el9.x 9.6 MB/s | 49 MB 00:05 2024-06-04T15:49:43.491 INFO:teuthology.orchestra.run.smithi144.stdout:(38/283): bubblewrap-0.4.1-7.el9.x86_64.rpm 102 kB/s | 49 kB 00:00 2024-06-04T15:49:43.533 INFO:teuthology.orchestra.run.smithi144.stdout:(39/283): fuse-2.9.9-15.el9.x86_64.rpm 1.9 MB/s | 80 kB 00:00 2024-06-04T15:49:43.617 INFO:teuthology.orchestra.run.smithi144.stdout:(40/283): cups-libs-2.3.3op2-26.el9.x86_64.rpm 1.7 MB/s | 262 kB 00:00 2024-06-04T15:49:43.725 INFO:teuthology.orchestra.run.smithi144.stdout:(41/283): ceph-mgr-diskprediction-local-19.0.0- 3.9 MB/s | 7.4 MB 00:01 2024-06-04T15:49:43.742 INFO:teuthology.orchestra.run.smithi144.stdout:(42/283): libpciaccess-0.16-7.el9.x86_64.rpm 215 kB/s | 27 kB 00:00 2024-06-04T15:49:43.750 INFO:teuthology.orchestra.run.smithi177.stdout:(12/283): libcephfs2-19.0.0-4027.g65533a90.el9. 1.5 MB/s | 748 kB 00:00 2024-06-04T15:49:43.776 INFO:teuthology.orchestra.run.smithi144.stdout:(43/283): libgfortran-11.4.1-3.el9.x86_64.rpm 3.2 MB/s | 803 kB 00:00 2024-06-04T15:49:43.801 INFO:teuthology.orchestra.run.smithi144.stdout:(44/283): lksctp-tools-1.0.19-2.el9.x86_64.rpm 1.6 MB/s | 94 kB 00:00 2024-06-04T15:49:43.826 INFO:teuthology.orchestra.run.smithi144.stdout:(45/283): python3-cffi-1.14.5-5.el9.x86_64.rpm 4.9 MB/s | 253 kB 00:00 2024-06-04T15:49:43.877 INFO:teuthology.orchestra.run.smithi144.stdout:(46/283): python3-ply-3.11-14.el9.noarch.rpm 2.1 MB/s | 106 kB 00:00 2024-06-04T15:49:43.902 INFO:teuthology.orchestra.run.smithi144.stdout:(47/283): libquadmath-11.4.1-3.el9.x86_64.rpm 1.1 MB/s | 195 kB 00:00 2024-06-04T15:49:43.917 INFO:teuthology.orchestra.run.smithi177.stdout:(13/283): ceph-osd-19.0.0-4027.g65533a90.el9.x8 6.2 MB/s | 17 MB 00:02 2024-06-04T15:49:43.942 INFO:teuthology.orchestra.run.smithi177.stdout:(14/283): libcephsqlite-19.0.0-4027.g65533a90.e 852 kB/s | 163 kB 00:00 2024-06-04T15:49:43.944 INFO:teuthology.orchestra.run.smithi144.stdout:(48/283): python3-pycparser-2.20-6.el9.noarch.r 2.0 MB/s | 135 kB 00:00 2024-06-04T15:49:43.969 INFO:teuthology.orchestra.run.smithi144.stdout:(49/283): python3-requests-2.25.1-8.el9.noarch. 1.8 MB/s | 125 kB 00:00 2024-06-04T15:49:43.970 INFO:teuthology.orchestra.run.smithi144.stdout:[MIRROR] adwaita-cursor-theme-40.1.1-3.el9.noarch.rpm: Status code: 404 for https://download-cc-rdu01.fedoraproject.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/adwaita-cursor-theme-40.1.1-3.el9.noarch.rpm (IP: 8.43.85.72) 2024-06-04T15:49:43.994 INFO:teuthology.orchestra.run.smithi144.stdout:(50/283): python3-urllib3-1.26.5-5.el9.noarch.r 4.2 MB/s | 215 kB 00:00 2024-06-04T15:49:44.001 INFO:teuthology.orchestra.run.smithi177.stdout:(15/283): librados-devel-19.0.0-4027.g65533a90. 1.5 MB/s | 127 kB 00:00 2024-06-04T15:49:44.037 INFO:teuthology.orchestra.run.smithi144.stdout:(51/283): python3-cryptography-36.0.1-4.el9.x86 5.2 MB/s | 1.2 MB 00:00 2024-06-04T15:49:44.037 INFO:teuthology.orchestra.run.smithi144.stdout:[MIRROR] adwaita-icon-theme-40.1.1-3.el9.noarch.rpm: Status code: 404 for https://download-cc-rdu01.fedoraproject.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/adwaita-icon-theme-40.1.1-3.el9.noarch.rpm (IP: 8.43.85.72) 2024-06-04T15:49:44.039 INFO:teuthology.orchestra.run.smithi144.stdout:[MIRROR] alsa-lib-1.2.10-2.el9.x86_64.rpm: Status code: 404 for https://download-cc-rdu01.fedoraproject.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/alsa-lib-1.2.10-2.el9.x86_64.rpm (IP: 8.43.85.72) 2024-06-04T15:49:44.209 INFO:teuthology.orchestra.run.smithi177.stdout:(16/283): libradosstriper1-19.0.0-4027.g65533a9 1.8 MB/s | 504 kB 00:00 2024-06-04T15:49:44.268 INFO:teuthology.orchestra.run.smithi177.stdout:(17/283): python3-ceph-argparse-19.0.0-4027.g65 778 kB/s | 45 kB 00:00 2024-06-04T15:49:44.270 INFO:teuthology.orchestra.run.smithi144.stdout:(52/283): adwaita-cursor-theme-40.1.1-3.el9.noa 2.1 MB/s | 650 kB 00:00 2024-06-04T15:49:44.312 INFO:teuthology.orchestra.run.smithi144.stdout:(53/283): alsa-lib-1.2.10-2.el9.x86_64.rpm 1.9 MB/s | 523 kB 00:00 2024-06-04T15:49:44.368 INFO:teuthology.orchestra.run.smithi177.stdout:(18/283): python3-ceph-common-19.0.0-4027.g6553 1.3 MB/s | 136 kB 00:00 2024-06-04T15:49:44.379 INFO:teuthology.orchestra.run.smithi144.stdout:(54/283): apache-commons-cli-1.4-17.el9.noarch. 651 kB/s | 71 kB 00:00 2024-06-04T15:49:44.404 INFO:teuthology.orchestra.run.smithi144.stdout:(55/283): apache-commons-codec-1.15-7.el9.noarc 3.2 MB/s | 302 kB 00:00 2024-06-04T15:49:44.463 INFO:teuthology.orchestra.run.smithi144.stdout:(56/283): apache-commons-io-2.8.0-8.el9.noarch. 3.3 MB/s | 283 kB 00:00 2024-06-04T15:49:44.477 INFO:teuthology.orchestra.run.smithi177.stdout:(19/283): python3-cephfs-19.0.0-4027.g65533a90. 1.5 MB/s | 161 kB 00:00 2024-06-04T15:49:44.497 INFO:teuthology.orchestra.run.smithi144.stdout:(57/283): apache-commons-lang3-3.12.0-6.el9.noa 5.9 MB/s | 559 kB 00:00 2024-06-04T15:49:44.522 INFO:teuthology.orchestra.run.smithi144.stdout:(58/283): at-spi2-atk-2.38.0-4.el9.x86_64.rpm 1.4 MB/s | 87 kB 00:00 2024-06-04T15:49:44.547 INFO:teuthology.orchestra.run.smithi144.stdout:(59/283): at-spi2-core-2.40.3-1.el9.x86_64.rpm 3.8 MB/s | 195 kB 00:00 2024-06-04T15:49:44.597 INFO:teuthology.orchestra.run.smithi144.stdout:(60/283): atinject-1.0.3-6.el9.noarch.rpm 309 kB/s | 23 kB 00:00 2024-06-04T15:49:44.619 INFO:teuthology.orchestra.run.smithi177.stdout:(20/283): librgw2-19.0.0-4027.g65533a90.el9.x86 8.7 MB/s | 5.4 MB 00:00 2024-06-04T15:49:44.623 INFO:teuthology.orchestra.run.smithi144.stdout:(61/283): atk-2.36.0-5.el9.x86_64.rpm 3.8 MB/s | 292 kB 00:00 2024-06-04T15:49:44.669 INFO:teuthology.orchestra.run.smithi177.stdout:(21/283): python3-rados-19.0.0-4027.g65533a90.e 1.6 MB/s | 320 kB 00:00 2024-06-04T15:49:44.703 INFO:teuthology.orchestra.run.smithi177.stdout:(22/283): python3-rbd-19.0.0-4027.g65533a90.el9 3.5 MB/s | 300 kB 00:00 2024-06-04T15:49:44.753 INFO:teuthology.orchestra.run.smithi177.stdout:(23/283): python3-rgw-19.0.0-4027.g65533a90.el9 1.2 MB/s | 99 kB 00:00 2024-06-04T15:49:44.757 INFO:teuthology.orchestra.run.smithi144.stdout:(62/283): adwaita-icon-theme-40.1.1-3.el9.noarc 16 MB/s | 12 MB 00:00 2024-06-04T15:49:44.778 INFO:teuthology.orchestra.run.smithi177.stdout:(24/283): rbd-fuse-19.0.0-4027.g65533a90.el9.x8 1.1 MB/s | 85 kB 00:00 2024-06-04T15:49:44.782 INFO:teuthology.orchestra.run.smithi144.stdout:(63/283): avahi-glib-0.8-20.el9.x86_64.rpm 81 kB/s | 15 kB 00:00 2024-06-04T15:49:44.807 INFO:teuthology.orchestra.run.smithi144.stdout:(64/283): boost-program-options-1.75.0-8.el9.x8 580 kB/s | 107 kB 00:00 2024-06-04T15:49:44.832 INFO:teuthology.orchestra.run.smithi144.stdout:(65/283): cdi-api-2.0.2-6.el9.noarch.rpm 708 kB/s | 53 kB 00:00 2024-06-04T15:49:44.858 INFO:teuthology.orchestra.run.smithi144.stdout:(66/283): colord-libs-1.4.5-4.el9.x86_64.rpm 3.0 MB/s | 229 kB 00:00 2024-06-04T15:49:44.871 INFO:teuthology.orchestra.run.smithi177.stdout:(25/283): rbd-nbd-19.0.0-4027.g65533a90.el9.x86 1.8 MB/s | 171 kB 00:00 2024-06-04T15:49:44.883 INFO:teuthology.orchestra.run.smithi144.stdout:(67/283): copy-jdk-configs-4.0-3.el9.noarch.rpm 560 kB/s | 28 kB 00:00 2024-06-04T15:49:44.909 INFO:teuthology.orchestra.run.smithi144.stdout:(68/283): composefs-libs-1.0.3-2.el9.x86_64.rpm 599 kB/s | 60 kB 00:00 2024-06-04T15:49:44.938 INFO:teuthology.orchestra.run.smithi177.stdout:(26/283): ceph-grafana-dashboards-19.0.0-4027.g 513 kB/s | 34 kB 00:00 2024-06-04T15:49:45.013 INFO:teuthology.orchestra.run.smithi177.stdout:(27/283): ceph-mgr-cephadm-19.0.0-4027.g65533a9 1.9 MB/s | 143 kB 00:00 2024-06-04T15:49:45.125 INFO:teuthology.orchestra.run.smithi144.stdout:(69/283): dconf-0.40.0-6.el9.x86_64.rpm 421 kB/s | 113 kB 00:00 2024-06-04T15:49:45.226 INFO:teuthology.orchestra.run.smithi144.stdout:(70/283): exempi-2.6.0-0.2.20211007gite23c213.e 1.5 MB/s | 525 kB 00:00 2024-06-04T15:49:45.260 INFO:teuthology.orchestra.run.smithi144.stdout:(71/283): exiv2-0.27.5-2.el9.x86_64.rpm 2.7 MB/s | 980 kB 00:00 2024-06-04T15:49:45.285 INFO:teuthology.orchestra.run.smithi144.stdout:(72/283): fdk-aac-free-2.0.0-8.el9.x86_64.rpm 5.4 MB/s | 325 kB 00:00 2024-06-04T15:49:45.310 INFO:teuthology.orchestra.run.smithi144.stdout:(73/283): flac-libs-1.3.3-12.el9.x86_64.rpm 4.3 MB/s | 218 kB 00:00 2024-06-04T15:49:45.335 INFO:teuthology.orchestra.run.smithi144.stdout:(74/283): exiv2-libs-0.27.5-2.el9.x86_64.rpm 3.6 MB/s | 781 kB 00:00 2024-06-04T15:49:45.372 INFO:teuthology.orchestra.run.smithi177.stdout:(28/283): ceph-mgr-dashboard-19.0.0-4027.g65533 9.9 MB/s | 3.5 MB 00:00 2024-06-04T15:49:45.386 INFO:teuthology.orchestra.run.smithi144.stdout:(75/283): flatpak-selinux-1.12.8-1.el9.noarch.r 283 kB/s | 21 kB 00:00 2024-06-04T15:49:45.578 INFO:teuthology.orchestra.run.smithi144.stdout:(76/283): flatpak-session-helper-1.12.8-1.el9.x 305 kB/s | 74 kB 00:00 2024-06-04T15:49:45.619 INFO:teuthology.orchestra.run.smithi144.stdout:(77/283): flatpak-1.12.8-1.el9.x86_64.rpm 5.1 MB/s | 1.7 MB 00:00 2024-06-04T15:49:45.645 INFO:teuthology.orchestra.run.smithi144.stdout:(78/283): flexiblas-3.0.4-8.el9.x86_64.rpm 126 kB/s | 33 kB 00:00 2024-06-04T15:49:45.737 INFO:teuthology.orchestra.run.smithi144.stdout:(79/283): flexiblas-openblas-openmp-3.0.4-8.el9 155 kB/s | 18 kB 00:00 2024-06-04T15:49:45.770 INFO:teuthology.orchestra.run.smithi144.stdout:(80/283): gdk-pixbuf2-modules-2.42.6-3.el9.x86_ 706 kB/s | 88 kB 00:00 2024-06-04T15:49:45.912 INFO:teuthology.orchestra.run.smithi144.stdout:(81/283): flexiblas-netlib-3.0.4-8.el9.x86_64.r 8.9 MB/s | 3.0 MB 00:00 2024-06-04T15:49:45.937 INFO:teuthology.orchestra.run.smithi144.stdout:(82/283): giflib-5.2.1-9.el9.x86_64.rpm 291 kB/s | 49 kB 00:00 2024-06-04T15:49:45.963 INFO:teuthology.orchestra.run.smithi144.stdout:(83/283): geoclue2-2.6.0-7.el9.x86_64.rpm 551 kB/s | 124 kB 00:00 2024-06-04T15:49:46.038 INFO:teuthology.orchestra.run.smithi177.stdout:(29/283): ceph-mgr-diskprediction-local-19.0.0- 11 MB/s | 7.4 MB 00:00 2024-06-04T15:49:46.055 INFO:teuthology.orchestra.run.smithi144.stdout:(84/283): google-guice-4.2.3-9.el9.noarch.rpm 3.3 MB/s | 473 kB 00:00 2024-06-04T15:49:46.080 INFO:teuthology.orchestra.run.smithi144.stdout:(85/283): gsm-1.0.19-6.el9.x86_64.rpm 291 kB/s | 34 kB 00:00 2024-06-04T15:49:46.089 INFO:teuthology.orchestra.run.smithi177.stdout:(30/283): rbd-mirror-19.0.0-4027.g65533a90.el9. 2.3 MB/s | 3.1 MB 00:01 2024-06-04T15:49:46.105 INFO:teuthology.orchestra.run.smithi144.stdout:(86/283): graphene-1.10.6-2.el9.x86_64.rpm 385 kB/s | 64 kB 00:00 2024-06-04T15:49:46.114 INFO:teuthology.orchestra.run.smithi177.stdout:(31/283): ceph-mgr-modules-core-19.0.0-4027.g65 3.6 MB/s | 274 kB 00:00 2024-06-04T15:49:46.131 INFO:teuthology.orchestra.run.smithi177.stdout:(32/283): ceph-mgr-rook-19.0.0-4027.g65533a90.e 1.2 MB/s | 49 kB 00:00 2024-06-04T15:49:46.147 INFO:teuthology.orchestra.run.smithi144.stdout:(87/283): gstreamer1-1.22.1-2.el9.x86_64.rpm 16 MB/s | 1.4 MB 00:00 2024-06-04T15:49:46.199 INFO:teuthology.orchestra.run.smithi177.stdout:(33/283): ceph-prometheus-alerts-19.0.0-4027.g6 280 kB/s | 16 kB 00:00 2024-06-04T15:49:46.199 INFO:teuthology.orchestra.run.smithi144.stdout:(88/283): gtk-update-icon-cache-3.24.31-2.el9.x 527 kB/s | 35 kB 00:00 2024-06-04T15:49:46.223 INFO:teuthology.orchestra.run.smithi144.stdout:(89/283): gstreamer1-plugins-base-1.22.1-2.el9. 16 MB/s | 2.2 MB 00:00 2024-06-04T15:49:46.223 INFO:teuthology.orchestra.run.smithi177.stdout:(34/283): ceph-volume-19.0.0-4027.g65533a90.el9 2.9 MB/s | 273 kB 00:00 2024-06-04T15:49:46.290 INFO:teuthology.orchestra.run.smithi177.stdout:(35/283): cephadm-19.0.0-4027.g65533a90.el9.noa 6.4 MB/s | 764 kB 00:00 2024-06-04T15:49:46.296 INFO:teuthology.orchestra.run.smithi177.stdout:[MIRROR] ModemManager-glib-1.20.2-1.el9.x86_64.rpm: Status code: 404 for https://download-cc-rdu01.fedoraproject.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/ModemManager-glib-1.20.2-1.el9.x86_64.rpm (IP: 8.43.85.72) 2024-06-04T15:49:46.334 INFO:teuthology.orchestra.run.smithi177.stdout:[MIRROR] bluez-libs-5.56-6.el9.x86_64.rpm: Status code: 404 for https://download-cc-rdu01.fedoraproject.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/bluez-libs-5.56-6.el9.x86_64.rpm (IP: 8.43.85.72) 2024-06-04T15:49:46.334 INFO:teuthology.orchestra.run.smithi144.stdout:(90/283): gtk3-3.24.31-2.el9.x86_64.rpm 27 MB/s | 4.9 MB 00:00 2024-06-04T15:49:46.424 INFO:teuthology.orchestra.run.smithi177.stdout:(36/283): ModemManager-glib-1.20.2-1.el9.x86_64 1.6 MB/s | 335 kB 00:00 2024-06-04T15:49:46.449 INFO:teuthology.orchestra.run.smithi177.stdout:(37/283): bluez-libs-5.56-6.el9.x86_64.rpm 542 kB/s | 85 kB 00:00 2024-06-04T15:49:46.449 INFO:teuthology.orchestra.run.smithi177.stdout:[MIRROR] bubblewrap-0.4.1-7.el9.x86_64.rpm: Status code: 404 for https://download-cc-rdu01.fedoraproject.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/bubblewrap-0.4.1-7.el9.x86_64.rpm (IP: 8.43.85.72) 2024-06-04T15:49:46.450 INFO:teuthology.orchestra.run.smithi177.stdout:[MIRROR] cups-libs-2.3.3op2-26.el9.x86_64.rpm: Status code: 404 for https://download-cc-rdu01.fedoraproject.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/cups-libs-2.3.3op2-26.el9.x86_64.rpm (IP: 8.43.85.72) 2024-06-04T15:49:46.457 INFO:teuthology.orchestra.run.smithi144.stdout:(91/283): guava-30.1-6.el9.noarch.rpm 8.1 MB/s | 2.3 MB 00:00 2024-06-04T15:49:46.482 INFO:teuthology.orchestra.run.smithi144.stdout:(92/283): hicolor-icon-theme-0.17-13.el9.noarch 845 kB/s | 219 kB 00:00 2024-06-04T15:49:46.491 INFO:teuthology.orchestra.run.smithi177.stdout:(38/283): bubblewrap-0.4.1-7.el9.x86_64.rpm 738 kB/s | 49 kB 00:00 2024-06-04T15:49:46.533 INFO:teuthology.orchestra.run.smithi177.stdout:(39/283): cups-libs-2.3.3op2-26.el9.x86_64.rpm 3.1 MB/s | 262 kB 00:00 2024-06-04T15:49:46.558 INFO:teuthology.orchestra.run.smithi177.stdout:(40/283): fuse-2.9.9-15.el9.x86_64.rpm 1.2 MB/s | 80 kB 00:00 2024-06-04T15:49:46.583 INFO:teuthology.orchestra.run.smithi144.stdout:(93/283): httpcomponents-client-4.5.13-3.el9.no 2.6 MB/s | 657 kB 00:00 2024-06-04T15:49:46.592 INFO:teuthology.orchestra.run.smithi177.stdout:(41/283): libpciaccess-0.16-7.el9.x86_64.rpm 806 kB/s | 27 kB 00:00 2024-06-04T15:49:46.617 INFO:teuthology.orchestra.run.smithi177.stdout:(42/283): libgfortran-11.4.1-3.el9.x86_64.rpm 9.4 MB/s | 803 kB 00:00 2024-06-04T15:49:46.642 INFO:teuthology.orchestra.run.smithi177.stdout:(43/283): libquadmath-11.4.1-3.el9.x86_64.rpm 3.8 MB/s | 195 kB 00:00 2024-06-04T15:49:46.668 INFO:teuthology.orchestra.run.smithi177.stdout:(44/283): lksctp-tools-1.0.19-2.el9.x86_64.rpm 1.8 MB/s | 94 kB 00:00 2024-06-04T15:49:46.691 INFO:teuthology.orchestra.run.smithi144.stdout:(94/283): httpcomponents-core-4.4.13-7.el9.noar 2.6 MB/s | 632 kB 00:00 2024-06-04T15:49:46.693 INFO:teuthology.orchestra.run.smithi177.stdout:(45/283): python3-cffi-1.14.5-5.el9.x86_64.rpm 4.9 MB/s | 253 kB 00:00 2024-06-04T15:49:46.716 INFO:teuthology.orchestra.run.smithi144.stdout:(95/283): jakarta-annotations-1.3.5-13.el9.noar 337 kB/s | 45 kB 00:00 2024-06-04T15:49:46.783 INFO:teuthology.orchestra.run.smithi144.stdout:(96/283): iso-codes-4.6.0-3.el9.noarch.rpm 12 MB/s | 3.5 MB 00:00 2024-06-04T15:49:46.809 INFO:teuthology.orchestra.run.smithi144.stdout:(97/283): jansi-2.3.3-6.el9.x86_64.rpm 935 kB/s | 110 kB 00:00 2024-06-04T15:49:46.834 INFO:teuthology.orchestra.run.smithi144.stdout:(98/283): java-11-openjdk-11.0.20.1.1-2.el9.x86 3.4 MB/s | 413 kB 00:00 2024-06-04T15:49:46.918 INFO:teuthology.orchestra.run.smithi144.stdout:(99/283): javapackages-filesystem-6.0.0-4.el9.n 156 kB/s | 13 kB 00:00 2024-06-04T15:49:46.968 INFO:teuthology.orchestra.run.smithi144.stdout:(100/283): jbigkit-libs-2.1-23.el9.x86_64.rpm 1.0 MB/s | 53 kB 00:00 2024-06-04T15:49:47.027 INFO:teuthology.orchestra.run.smithi144.stdout:(101/283): java-11-openjdk-devel-11.0.20.1.1-2. 14 MB/s | 3.3 MB 00:00 2024-06-04T15:49:47.052 INFO:teuthology.orchestra.run.smithi144.stdout:(102/283): jcl-over-slf4j-1.7.30-13.el9.noarch. 287 kB/s | 24 kB 00:00 2024-06-04T15:49:47.110 INFO:teuthology.orchestra.run.smithi177.stdout:(46/283): ceph-test-19.0.0-4027.g65533a90.el9.x 12 MB/s | 49 MB 00:04 2024-06-04T15:49:47.135 INFO:teuthology.orchestra.run.smithi144.stdout:(103/283): jsoup-1.13.1-10.el9.noarch.rpm 3.4 MB/s | 377 kB 00:00 2024-06-04T15:49:47.152 INFO:teuthology.orchestra.run.smithi177.stdout:(47/283): python3-ply-3.11-14.el9.noarch.rpm 232 kB/s | 106 kB 00:00 2024-06-04T15:49:47.186 INFO:teuthology.orchestra.run.smithi177.stdout:(48/283): python3-cryptography-36.0.1-4.el9.x86 2.4 MB/s | 1.2 MB 00:00 2024-06-04T15:49:47.211 INFO:teuthology.orchestra.run.smithi177.stdout:(49/283): python3-requests-2.25.1-8.el9.noarch. 2.1 MB/s | 125 kB 00:00 2024-06-04T15:49:47.236 INFO:teuthology.orchestra.run.smithi177.stdout:(50/283): python3-urllib3-1.26.5-5.el9.noarch.r 4.2 MB/s | 215 kB 00:00 2024-06-04T15:49:47.237 INFO:teuthology.orchestra.run.smithi177.stdout:[MIRROR] adwaita-cursor-theme-40.1.1-3.el9.noarch.rpm: Status code: 404 for https://download-cc-rdu01.fedoraproject.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/adwaita-cursor-theme-40.1.1-3.el9.noarch.rpm (IP: 8.43.85.72) 2024-06-04T15:49:47.244 INFO:teuthology.orchestra.run.smithi144.stdout:(104/283): jsr-305-3.0.2-6.el9.noarch.rpm 185 kB/s | 35 kB 00:00 2024-06-04T15:49:47.270 INFO:teuthology.orchestra.run.smithi177.stdout:(51/283): python3-pycparser-2.20-6.el9.noarch.r 850 kB/s | 135 kB 00:00 2024-06-04T15:49:47.271 INFO:teuthology.orchestra.run.smithi177.stdout:[MIRROR] adwaita-icon-theme-40.1.1-3.el9.noarch.rpm: Status code: 404 for https://download-cc-rdu01.fedoraproject.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/adwaita-icon-theme-40.1.1-3.el9.noarch.rpm (IP: 8.43.85.72) 2024-06-04T15:49:47.271 INFO:teuthology.orchestra.run.smithi177.stdout:[MIRROR] alsa-lib-1.2.10-2.el9.x86_64.rpm: Status code: 404 for https://download-cc-rdu01.fedoraproject.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/alsa-lib-1.2.10-2.el9.x86_64.rpm (IP: 8.43.85.72) 2024-06-04T15:49:47.303 INFO:teuthology.orchestra.run.smithi144.stdout:(105/283): lcms2-2.12-3.el9.x86_64.rpm 1.0 MB/s | 168 kB 00:00 2024-06-04T15:49:47.312 INFO:teuthology.orchestra.run.smithi177.stdout:(52/283): adwaita-cursor-theme-40.1.1-3.el9.noa 6.3 MB/s | 650 kB 00:00 2024-06-04T15:49:47.354 INFO:teuthology.orchestra.run.smithi177.stdout:(53/283): apache-commons-cli-1.4-17.el9.noarch. 1.7 MB/s | 71 kB 00:00 2024-06-04T15:49:47.380 INFO:teuthology.orchestra.run.smithi177.stdout:(54/283): alsa-lib-1.2.10-2.el9.x86_64.rpm 4.7 MB/s | 523 kB 00:00 2024-06-04T15:49:47.405 INFO:teuthology.orchestra.run.smithi177.stdout:(55/283): apache-commons-codec-1.15-7.el9.noarc 5.9 MB/s | 302 kB 00:00 2024-06-04T15:49:47.430 INFO:teuthology.orchestra.run.smithi177.stdout:(56/283): apache-commons-io-2.8.0-8.el9.noarch. 5.5 MB/s | 283 kB 00:00 2024-06-04T15:49:47.464 INFO:teuthology.orchestra.run.smithi177.stdout:(57/283): apache-commons-lang3-3.12.0-6.el9.noa 9.3 MB/s | 559 kB 00:00 2024-06-04T15:49:47.478 INFO:teuthology.orchestra.run.smithi144.stdout:(106/283): libX11-xcb-1.7.0-9.el9.x86_64.rpm 47 kB/s | 11 kB 00:00 2024-06-04T15:49:47.489 INFO:teuthology.orchestra.run.smithi177.stdout:(58/283): at-spi2-atk-2.38.0-4.el9.x86_64.rpm 1.4 MB/s | 87 kB 00:00 2024-06-04T15:49:47.514 INFO:teuthology.orchestra.run.smithi177.stdout:(59/283): at-spi2-core-2.40.3-1.el9.x86_64.rpm 3.8 MB/s | 195 kB 00:00 2024-06-04T15:49:47.531 INFO:teuthology.orchestra.run.smithi177.stdout:(60/283): atinject-1.0.3-6.el9.noarch.rpm 556 kB/s | 23 kB 00:00 2024-06-04T15:49:47.545 INFO:teuthology.orchestra.run.smithi144.stdout:(107/283): libXcomposite-0.4.5-7.el9.x86_64.rpm 100 kB/s | 24 kB 00:00 2024-06-04T15:49:47.565 INFO:teuthology.orchestra.run.smithi177.stdout:(61/283): atk-2.36.0-5.el9.x86_64.rpm 5.7 MB/s | 292 kB 00:00 2024-06-04T15:49:47.578 INFO:teuthology.orchestra.run.smithi144.stdout:(108/283): libXcursor-1.2.0-7.el9.x86_64.rpm 306 kB/s | 31 kB 00:00 2024-06-04T15:49:47.582 INFO:teuthology.orchestra.run.smithi177.stdout:(62/283): avahi-glib-0.8-20.el9.x86_64.rpm 297 kB/s | 15 kB 00:00 2024-06-04T15:49:47.607 INFO:teuthology.orchestra.run.smithi177.stdout:(63/283): boost-program-options-1.75.0-8.el9.x8 2.5 MB/s | 107 kB 00:00 2024-06-04T15:49:47.629 INFO:teuthology.orchestra.run.smithi144.stdout:(109/283): libXdamage-1.1.5-7.el9.x86_64.rpm 273 kB/s | 23 kB 00:00 2024-06-04T15:49:47.632 INFO:teuthology.orchestra.run.smithi177.stdout:(64/283): cdi-api-2.0.2-6.el9.noarch.rpm 1.0 MB/s | 53 kB 00:00 2024-06-04T15:49:47.646 INFO:teuthology.orchestra.run.smithi144.stdout:(110/283): libXfixes-5.0.3-16.el9.x86_64.rpm 295 kB/s | 20 kB 00:00 2024-06-04T15:49:47.671 INFO:teuthology.orchestra.run.smithi144.stdout:(111/283): libXi-1.7.10-8.el9.x86_64.rpm 945 kB/s | 40 kB 00:00 2024-06-04T15:49:47.696 INFO:teuthology.orchestra.run.smithi144.stdout:(112/283): libXinerama-1.1.4-10.el9.x86_64.rpm 300 kB/s | 15 kB 00:00 2024-06-04T15:49:47.713 INFO:teuthology.orchestra.run.smithi144.stdout:(113/283): libXrandr-1.5.2-8.el9.x86_64.rpm 678 kB/s | 28 kB 00:00 2024-06-04T15:49:47.733 INFO:teuthology.orchestra.run.smithi177.stdout:(65/283): colord-libs-1.4.5-4.el9.x86_64.rpm 1.8 MB/s | 229 kB 00:00 2024-06-04T15:49:47.747 INFO:teuthology.orchestra.run.smithi144.stdout:(114/283): libXtst-1.2.3-16.el9.x86_64.rpm 427 kB/s | 21 kB 00:00 2024-06-04T15:49:47.758 INFO:teuthology.orchestra.run.smithi177.stdout:(66/283): composefs-libs-1.0.3-2.el9.x86_64.rpm 482 kB/s | 60 kB 00:00 2024-06-04T15:49:47.772 INFO:teuthology.orchestra.run.smithi144.stdout:(115/283): libXv-1.0.11-16.el9.x86_64.rpm 326 kB/s | 19 kB 00:00 2024-06-04T15:49:47.783 INFO:teuthology.orchestra.run.smithi177.stdout:(67/283): copy-jdk-configs-4.0-3.el9.noarch.rpm 563 kB/s | 28 kB 00:00 2024-06-04T15:49:47.809 INFO:teuthology.orchestra.run.smithi177.stdout:(68/283): dconf-0.40.0-6.el9.x86_64.rpm 2.2 MB/s | 113 kB 00:00 2024-06-04T15:49:47.851 INFO:teuthology.orchestra.run.smithi177.stdout:(69/283): exempi-2.6.0-0.2.20211007gite23c213.e 7.6 MB/s | 525 kB 00:00 2024-06-04T15:49:47.884 INFO:teuthology.orchestra.run.smithi177.stdout:(70/283): exiv2-0.27.5-2.el9.x86_64.rpm 13 MB/s | 980 kB 00:00 2024-06-04T15:49:47.918 INFO:teuthology.orchestra.run.smithi177.stdout:(71/283): exiv2-libs-0.27.5-2.el9.x86_64.rpm 11 MB/s | 781 kB 00:00 2024-06-04T15:49:47.939 INFO:teuthology.orchestra.run.smithi144.stdout:(116/283): libXxf86vm-1.1.4-18.el9.x86_64.rpm 98 kB/s | 19 kB 00:00 2024-06-04T15:49:47.943 INFO:teuthology.orchestra.run.smithi177.stdout:(72/283): fdk-aac-free-2.0.0-8.el9.x86_64.rpm 5.5 MB/s | 325 kB 00:00 2024-06-04T15:49:47.968 INFO:teuthology.orchestra.run.smithi177.stdout:(73/283): flac-libs-1.3.3-12.el9.x86_64.rpm 4.2 MB/s | 218 kB 00:00 2024-06-04T15:49:47.973 INFO:teuthology.orchestra.run.smithi144.stdout:(117/283): libasyncns-0.8-22.el9.x86_64.rpm 152 kB/s | 30 kB 00:00 2024-06-04T15:49:47.998 INFO:teuthology.orchestra.run.smithi144.stdout:(118/283): libcanberra-0.30-27.el9.x86_64.rpm 1.4 MB/s | 86 kB 00:00 2024-06-04T15:49:48.024 INFO:teuthology.orchestra.run.smithi144.stdout:(119/283): libcanberra-gtk3-0.30-27.el9.x86_64. 632 kB/s | 32 kB 00:00 2024-06-04T15:49:48.027 INFO:teuthology.orchestra.run.smithi177.stdout:(74/283): flatpak-1.12.8-1.el9.x86_64.rpm 21 MB/s | 1.7 MB 00:00 2024-06-04T15:49:48.049 INFO:teuthology.orchestra.run.smithi144.stdout:(120/283): libdrm-2.4.117-1.el9.x86_64.rpm 3.1 MB/s | 161 kB 00:00 2024-06-04T15:49:48.052 INFO:teuthology.orchestra.run.smithi177.stdout:(75/283): flatpak-selinux-1.12.8-1.el9.noarch.r 256 kB/s | 21 kB 00:00 2024-06-04T15:49:48.074 INFO:teuthology.orchestra.run.smithi144.stdout:(121/283): libepoxy-1.5.5-4.el9.x86_64.rpm 4.7 MB/s | 241 kB 00:00 2024-06-04T15:49:48.100 INFO:teuthology.orchestra.run.smithi144.stdout:(122/283): libexif-0.6.22-6.el9.x86_64.rpm 8.5 MB/s | 435 kB 00:00 2024-06-04T15:49:48.186 INFO:teuthology.orchestra.run.smithi177.stdout:(76/283): adwaita-icon-theme-40.1.1-3.el9.noarc 13 MB/s | 12 MB 00:00 2024-06-04T15:49:48.211 INFO:teuthology.orchestra.run.smithi177.stdout:(77/283): flexiblas-3.0.4-8.el9.x86_64.rpm 206 kB/s | 33 kB 00:00 2024-06-04T15:49:48.225 INFO:teuthology.orchestra.run.smithi144.stdout:(123/283): libfontenc-1.1.3-17.el9.x86_64.rpm 206 kB/s | 31 kB 00:00 2024-06-04T15:49:48.237 INFO:teuthology.orchestra.run.smithi177.stdout:(78/283): flatpak-session-helper-1.12.8-1.el9.x 402 kB/s | 74 kB 00:00 2024-06-04T15:49:48.250 INFO:teuthology.orchestra.run.smithi144.stdout:(124/283): libgexiv2-0.12.3-1.el9.x86_64.rpm 550 kB/s | 83 kB 00:00 2024-06-04T15:49:48.262 INFO:teuthology.orchestra.run.smithi177.stdout:(79/283): flexiblas-openblas-openmp-3.0.4-8.el9 361 kB/s | 18 kB 00:00 2024-06-04T15:49:48.287 INFO:teuthology.orchestra.run.smithi177.stdout:(80/283): gdk-pixbuf2-modules-2.42.6-3.el9.x86_ 1.7 MB/s | 88 kB 00:00 2024-06-04T15:49:48.309 INFO:teuthology.orchestra.run.smithi144.stdout:(125/283): libglvnd-1.3.4-1.el9.x86_64.rpm 1.6 MB/s | 135 kB 00:00 2024-06-04T15:49:48.321 INFO:teuthology.orchestra.run.smithi177.stdout:(81/283): geoclue2-2.6.0-7.el9.x86_64.rpm 2.1 MB/s | 124 kB 00:00 2024-06-04T15:49:48.347 INFO:teuthology.orchestra.run.smithi177.stdout:(82/283): giflib-5.2.1-9.el9.x86_64.rpm 827 kB/s | 49 kB 00:00 2024-06-04T15:49:48.372 INFO:teuthology.orchestra.run.smithi177.stdout:(83/283): google-guice-4.2.3-9.el9.noarch.rpm 9.2 MB/s | 473 kB 00:00 2024-06-04T15:49:48.397 INFO:teuthology.orchestra.run.smithi177.stdout:(84/283): graphene-1.10.6-2.el9.x86_64.rpm 1.3 MB/s | 64 kB 00:00 2024-06-04T15:49:48.414 INFO:teuthology.orchestra.run.smithi177.stdout:(85/283): gsm-1.0.19-6.el9.x86_64.rpm 813 kB/s | 34 kB 00:00 2024-06-04T15:49:48.481 INFO:teuthology.orchestra.run.smithi177.stdout:(86/283): flexiblas-netlib-3.0.4-8.el9.x86_64.r 10 MB/s | 3.0 MB 00:00 2024-06-04T15:49:48.515 INFO:teuthology.orchestra.run.smithi177.stdout:(87/283): gstreamer1-1.22.1-2.el9.x86_64.rpm 12 MB/s | 1.4 MB 00:00 2024-06-04T15:49:48.531 INFO:teuthology.orchestra.run.smithi177.stdout:(88/283): gtk-update-icon-cache-3.24.31-2.el9.x 708 kB/s | 35 kB 00:00 2024-06-04T15:49:48.590 INFO:teuthology.orchestra.run.smithi177.stdout:(89/283): gstreamer1-plugins-base-1.22.1-2.el9. 13 MB/s | 2.2 MB 00:00 2024-06-04T15:49:48.659 INFO:teuthology.orchestra.run.smithi144.stdout:(126/283): java-11-openjdk-headless-11.0.20.1.1 21 MB/s | 39 MB 00:01 2024-06-04T15:49:48.674 INFO:teuthology.orchestra.run.smithi177.stdout:(90/283): gtk3-3.24.31-2.el9.x86_64.rpm 31 MB/s | 4.9 MB 00:00 2024-06-04T15:49:48.684 INFO:teuthology.orchestra.run.smithi144.stdout:(127/283): libglvnd-egl-1.3.4-1.el9.x86_64.rpm 85 kB/s | 37 kB 00:00 2024-06-04T15:49:48.699 INFO:teuthology.orchestra.run.smithi177.stdout:(91/283): hicolor-icon-theme-0.17-13.el9.noarch 2.0 MB/s | 219 kB 00:00 2024-06-04T15:49:48.709 INFO:teuthology.orchestra.run.smithi144.stdout:(128/283): libglvnd-glx-1.3.4-1.el9.x86_64.rpm 355 kB/s | 142 kB 00:00 2024-06-04T15:49:48.735 INFO:teuthology.orchestra.run.smithi144.stdout:(129/283): libgsf-1.14.47-5.el9.x86_64.rpm 3.3 MB/s | 256 kB 00:00 2024-06-04T15:49:48.758 INFO:teuthology.orchestra.run.smithi177.stdout:(92/283): guava-30.1-6.el9.noarch.rpm 10 MB/s | 2.3 MB 00:00 2024-06-04T15:49:48.760 INFO:teuthology.orchestra.run.smithi144.stdout:(130/283): libiptcdata-1.0.5-9.el9.x86_64.rpm 1.2 MB/s | 62 kB 00:00 2024-06-04T15:49:48.785 INFO:teuthology.orchestra.run.smithi144.stdout:(131/283): libgxps-0.3.2-3.el9.x86_64.rpm 782 kB/s | 79 kB 00:00 2024-06-04T15:49:48.794 INFO:teuthology.orchestra.run.smithi177.stdout:(93/283): httpcomponents-client-4.5.13-3.el9.no 5.5 MB/s | 657 kB 00:00 2024-06-04T15:49:48.811 INFO:teuthology.orchestra.run.smithi144.stdout:(132/283): libldac-2.0.2.3-10.el9.x86_64.rpm 548 kB/s | 41 kB 00:00 2024-06-04T15:49:48.817 INFO:teuthology.orchestra.run.smithi177.stdout:(94/283): httpcomponents-core-4.4.13-7.el9.noar 5.3 MB/s | 632 kB 00:00 2024-06-04T15:49:48.833 INFO:teuthology.orchestra.run.smithi177.stdout:(95/283): jakarta-annotations-1.3.5-13.el9.noar 1.1 MB/s | 45 kB 00:00 2024-06-04T15:49:48.836 INFO:teuthology.orchestra.run.smithi144.stdout:(133/283): libnotify-0.7.9-8.el9.x86_64.rpm 578 kB/s | 44 kB 00:00 2024-06-04T15:49:48.863 INFO:teuthology.orchestra.run.smithi144.stdout:(134/283): libogg-1.3.4-6.el9.x86_64.rpm 444 kB/s | 34 kB 00:00 2024-06-04T15:49:48.887 INFO:teuthology.orchestra.run.smithi144.stdout:(135/283): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.1 MB/s | 160 kB 00:00 2024-06-04T15:49:48.901 INFO:teuthology.orchestra.run.smithi177.stdout:(96/283): iso-codes-4.6.0-3.el9.noarch.rpm 25 MB/s | 3.5 MB 00:00 2024-06-04T15:49:48.912 INFO:teuthology.orchestra.run.smithi144.stdout:(136/283): librabbitmq-0.11.0-7.el9.x86_64.rpm 903 kB/s | 45 kB 00:00 2024-06-04T15:49:48.926 INFO:teuthology.orchestra.run.smithi177.stdout:(97/283): jansi-2.3.3-6.el9.x86_64.rpm 1.0 MB/s | 110 kB 00:00 2024-06-04T15:49:48.937 INFO:teuthology.orchestra.run.smithi144.stdout:(137/283): libosinfo-1.10.0-1.el9.x86_64.rpm 2.5 MB/s | 319 kB 00:00 2024-06-04T15:49:48.951 INFO:teuthology.orchestra.run.smithi177.stdout:(98/283): java-11-openjdk-11.0.20.1.1-2.el9.x86 3.4 MB/s | 413 kB 00:00 2024-06-04T15:49:48.985 INFO:teuthology.orchestra.run.smithi177.stdout:(99/283): javapackages-filesystem-6.0.0-4.el9.n 391 kB/s | 13 kB 00:00 2024-06-04T15:49:49.012 INFO:teuthology.orchestra.run.smithi144.stdout:(138/283): librdkafka-1.6.1-102.el9.x86_64.rpm 5.2 MB/s | 662 kB 00:00 2024-06-04T15:49:49.035 INFO:teuthology.orchestra.run.smithi177.stdout:(100/283): java-11-openjdk-devel-11.0.20.1.1-2. 25 MB/s | 3.3 MB 00:00 2024-06-04T15:49:49.038 INFO:teuthology.orchestra.run.smithi144.stdout:(139/283): libsbc-1.4-9.el9.x86_64.rpm 357 kB/s | 45 kB 00:00 2024-06-04T15:49:49.060 INFO:teuthology.orchestra.run.smithi177.stdout:(101/283): jbigkit-libs-2.1-23.el9.x86_64.rpm 706 kB/s | 53 kB 00:00 2024-06-04T15:49:49.063 INFO:teuthology.orchestra.run.smithi144.stdout:(140/283): libsndfile-1.0.31-8.el9.x86_64.rpm 1.6 MB/s | 206 kB 00:00 2024-06-04T15:49:49.086 INFO:teuthology.orchestra.run.smithi177.stdout:(102/283): jcl-over-slf4j-1.7.30-13.el9.noarch. 479 kB/s | 24 kB 00:00 2024-06-04T15:49:49.088 INFO:teuthology.orchestra.run.smithi144.stdout:(141/283): libtheora-1.1.1-31.el9.x86_64.rpm 2.1 MB/s | 164 kB 00:00 2024-06-04T15:49:49.111 INFO:teuthology.orchestra.run.smithi177.stdout:(103/283): jsoup-1.13.1-10.el9.noarch.rpm 7.3 MB/s | 377 kB 00:00 2024-06-04T15:49:49.114 INFO:teuthology.orchestra.run.smithi144.stdout:(142/283): libtool-ltdl-2.4.6-45.el9.x86_64.rpm 735 kB/s | 37 kB 00:00 2024-06-04T15:49:49.136 INFO:teuthology.orchestra.run.smithi177.stdout:(104/283): jsr-305-3.0.2-6.el9.noarch.rpm 705 kB/s | 35 kB 00:00 2024-06-04T15:49:49.139 INFO:teuthology.orchestra.run.smithi144.stdout:(143/283): libtiff-4.4.0-12.el9.x86_64.rpm 1.9 MB/s | 198 kB 00:00 2024-06-04T15:49:49.162 INFO:teuthology.orchestra.run.smithi177.stdout:(105/283): lcms2-2.12-3.el9.x86_64.rpm 3.3 MB/s | 168 kB 00:00 2024-06-04T15:49:49.164 INFO:teuthology.orchestra.run.smithi144.stdout:(144/283): libvisual-0.4.0-34.el9.x86_64.rpm 2.8 MB/s | 144 kB 00:00 2024-06-04T15:49:49.187 INFO:teuthology.orchestra.run.smithi177.stdout:(106/283): libX11-xcb-1.7.0-9.el9.x86_64.rpm 221 kB/s | 11 kB 00:00 2024-06-04T15:49:49.189 INFO:teuthology.orchestra.run.smithi144.stdout:(145/283): libtracker-sparql-3.1.2-3.el9.x86_64 3.1 MB/s | 324 kB 00:00 2024-06-04T15:49:49.215 INFO:teuthology.orchestra.run.smithi144.stdout:(146/283): libvorbis-1.3.7-5.el9.x86_64.rpm 2.5 MB/s | 193 kB 00:00 2024-06-04T15:49:49.220 INFO:teuthology.orchestra.run.smithi177.stdout:(107/283): libXcomposite-0.4.5-7.el9.x86_64.rpm 411 kB/s | 24 kB 00:00 2024-06-04T15:49:49.232 INFO:teuthology.orchestra.run.smithi144.stdout:(147/283): libwayland-client-1.21.0-1.el9.x86_6 496 kB/s | 33 kB 00:00 2024-06-04T15:49:49.246 INFO:teuthology.orchestra.run.smithi177.stdout:(108/283): libXcursor-1.2.0-7.el9.x86_64.rpm 524 kB/s | 31 kB 00:00 2024-06-04T15:49:49.249 INFO:teuthology.orchestra.run.smithi144.stdout:(148/283): libwayland-cursor-1.21.0-1.el9.x86_6 328 kB/s | 19 kB 00:00 2024-06-04T15:49:49.266 INFO:teuthology.orchestra.run.smithi144.stdout:(149/283): libwayland-egl-1.21.0-1.el9.x86_64.r 254 kB/s | 13 kB 00:00 2024-06-04T15:49:49.271 INFO:teuthology.orchestra.run.smithi177.stdout:(109/283): libXdamage-1.1.5-7.el9.x86_64.rpm 454 kB/s | 23 kB 00:00 2024-06-04T15:49:49.283 INFO:teuthology.orchestra.run.smithi144.stdout:(150/283): libwayland-server-1.21.0-1.el9.x86_6 823 kB/s | 42 kB 00:00 2024-06-04T15:49:49.296 INFO:teuthology.orchestra.run.smithi177.stdout:(110/283): libXfixes-5.0.3-16.el9.x86_64.rpm 393 kB/s | 20 kB 00:00 2024-06-04T15:49:49.316 INFO:teuthology.orchestra.run.smithi144.stdout:(151/283): libwebp-1.2.0-8.el9.x86_64.rpm 4.0 MB/s | 277 kB 00:00 2024-06-04T15:49:49.322 INFO:teuthology.orchestra.run.smithi177.stdout:(111/283): libXi-1.7.10-8.el9.x86_64.rpm 788 kB/s | 40 kB 00:00 2024-06-04T15:49:49.341 INFO:teuthology.orchestra.run.smithi144.stdout:(152/283): libxshmfence-1.3-10.el9.x86_64.rpm 216 kB/s | 13 kB 00:00 2024-06-04T15:49:49.347 INFO:teuthology.orchestra.run.smithi177.stdout:(112/283): libXinerama-1.1.4-10.el9.x86_64.rpm 299 kB/s | 15 kB 00:00 2024-06-04T15:49:49.367 INFO:teuthology.orchestra.run.smithi144.stdout:(153/283): low-memory-monitor-2.1-4.el9.x86_64. 714 kB/s | 36 kB 00:00 2024-06-04T15:49:49.372 INFO:teuthology.orchestra.run.smithi177.stdout:(113/283): libXrandr-1.5.2-8.el9.x86_64.rpm 568 kB/s | 28 kB 00:00 2024-06-04T15:49:49.393 INFO:teuthology.orchestra.run.smithi144.stdout:(154/283): libxkbcommon-1.0.3-4.el9.x86_64.rpm 1.0 MB/s | 133 kB 00:00 2024-06-04T15:49:49.398 INFO:teuthology.orchestra.run.smithi177.stdout:(114/283): libXtst-1.2.3-16.el9.x86_64.rpm 428 kB/s | 21 kB 00:00 2024-06-04T15:49:49.418 INFO:teuthology.orchestra.run.smithi144.stdout:(155/283): lua-5.4.4-4.el9.x86_64.rpm 3.7 MB/s | 188 kB 00:00 2024-06-04T15:49:49.423 INFO:teuthology.orchestra.run.smithi177.stdout:(115/283): libXv-1.0.11-16.el9.x86_64.rpm 381 kB/s | 19 kB 00:00 2024-06-04T15:49:49.443 INFO:teuthology.orchestra.run.smithi144.stdout:(156/283): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.8 MB/s | 292 kB 00:00 2024-06-04T15:49:49.448 INFO:teuthology.orchestra.run.smithi177.stdout:(116/283): libXxf86vm-1.1.4-18.el9.x86_64.rpm 374 kB/s | 19 kB 00:00 2024-06-04T15:49:49.474 INFO:teuthology.orchestra.run.smithi177.stdout:(117/283): libasyncns-0.8-22.el9.x86_64.rpm 605 kB/s | 30 kB 00:00 2024-06-04T15:49:49.476 INFO:teuthology.orchestra.run.smithi144.stdout:(157/283): lua-posix-35.0-8.el9.x86_64.rpm 1.8 MB/s | 151 kB 00:00 2024-06-04T15:49:49.499 INFO:teuthology.orchestra.run.smithi177.stdout:(118/283): libcanberra-0.30-27.el9.x86_64.rpm 1.7 MB/s | 86 kB 00:00 2024-06-04T15:49:49.524 INFO:teuthology.orchestra.run.smithi177.stdout:(119/283): libcanberra-gtk3-0.30-27.el9.x86_64. 634 kB/s | 32 kB 00:00 2024-06-04T15:49:49.527 INFO:teuthology.orchestra.run.smithi144.stdout:(158/283): maven-3.6.3-15.el9.noarch.rpm 162 kB/s | 18 kB 00:00 2024-06-04T15:49:49.550 INFO:teuthology.orchestra.run.smithi177.stdout:(120/283): libdrm-2.4.117-1.el9.x86_64.rpm 3.1 MB/s | 161 kB 00:00 2024-06-04T15:49:49.575 INFO:teuthology.orchestra.run.smithi177.stdout:(121/283): libepoxy-1.5.5-4.el9.x86_64.rpm 4.7 MB/s | 241 kB 00:00 2024-06-04T15:49:49.594 INFO:teuthology.orchestra.run.smithi144.stdout:(159/283): maven-openjdk11-3.6.3-15.el9.noarch. 77 kB/s | 9.0 kB 00:00 2024-06-04T15:49:49.600 INFO:teuthology.orchestra.run.smithi177.stdout:(122/283): libexif-0.6.22-6.el9.x86_64.rpm 8.5 MB/s | 435 kB 00:00 2024-06-04T15:49:49.617 INFO:teuthology.orchestra.run.smithi177.stdout:(123/283): libfontenc-1.1.3-17.el9.x86_64.rpm 743 kB/s | 31 kB 00:00 2024-06-04T15:49:49.642 INFO:teuthology.orchestra.run.smithi177.stdout:(124/283): libgexiv2-0.12.3-1.el9.x86_64.rpm 1.9 MB/s | 83 kB 00:00 2024-06-04T15:49:49.652 INFO:teuthology.orchestra.run.smithi144.stdout:(160/283): maven-resolver-1.6.1-10.el9.noarch.r 4.0 MB/s | 517 kB 00:00 2024-06-04T15:49:49.668 INFO:teuthology.orchestra.run.smithi177.stdout:(125/283): libglvnd-1.3.4-1.el9.x86_64.rpm 2.6 MB/s | 135 kB 00:00 2024-06-04T15:49:49.685 INFO:teuthology.orchestra.run.smithi177.stdout:(126/283): libglvnd-egl-1.3.4-1.el9.x86_64.rpm 876 kB/s | 37 kB 00:00 2024-06-04T15:49:49.686 INFO:teuthology.orchestra.run.smithi144.stdout:(161/283): maven-lib-3.6.3-15.el9.noarch.rpm 6.1 MB/s | 1.5 MB 00:00 2024-06-04T15:49:49.710 INFO:teuthology.orchestra.run.smithi177.stdout:(127/283): libglvnd-glx-1.3.4-1.el9.x86_64.rpm 3.3 MB/s | 142 kB 00:00 2024-06-04T15:49:49.711 INFO:teuthology.orchestra.run.smithi144.stdout:(162/283): maven-shared-utils-3.3.4-3.el9.noarc 1.3 MB/s | 151 kB 00:00 2024-06-04T15:49:49.735 INFO:teuthology.orchestra.run.smithi177.stdout:(128/283): libgsf-1.14.47-5.el9.x86_64.rpm 5.0 MB/s | 256 kB 00:00 2024-06-04T15:49:49.736 INFO:teuthology.orchestra.run.smithi144.stdout:(163/283): maven-wagon-3.4.2-7.el9.noarch.rpm 1.3 MB/s | 112 kB 00:00 2024-06-04T15:49:49.761 INFO:teuthology.orchestra.run.smithi177.stdout:(129/283): libgxps-0.3.2-3.el9.x86_64.rpm 1.5 MB/s | 79 kB 00:00 2024-06-04T15:49:49.762 INFO:teuthology.orchestra.run.smithi144.stdout:(164/283): mesa-libEGL-23.3.3-1.el9.x86_64.rpm 1.6 MB/s | 127 kB 00:00 2024-06-04T15:49:49.778 INFO:teuthology.orchestra.run.smithi177.stdout:(130/283): libiptcdata-1.0.5-9.el9.x86_64.rpm 1.4 MB/s | 62 kB 00:00 2024-06-04T15:49:49.787 INFO:teuthology.orchestra.run.smithi144.stdout:(165/283): mesa-libgbm-23.3.3-1.el9.x86_64.rpm 750 kB/s | 38 kB 00:00 2024-06-04T15:49:49.794 INFO:teuthology.orchestra.run.smithi177.stdout:(131/283): libldac-2.0.2.3-10.el9.x86_64.rpm 1.2 MB/s | 41 kB 00:00 2024-06-04T15:49:49.816 INFO:teuthology.orchestra.run.smithi177.stdout:(132/283): libnotify-0.7.9-8.el9.x86_64.rpm 1.3 MB/s | 44 kB 00:00 2024-06-04T15:49:49.816 INFO:teuthology.orchestra.run.smithi144.stdout:(166/283): mesa-libglapi-23.3.3-1.el9.x86_64.rp 881 kB/s | 44 kB 00:00 2024-06-04T15:49:49.828 INFO:teuthology.orchestra.run.smithi177.stdout:(133/283): libogg-1.3.4-6.el9.x86_64.rpm 1.0 MB/s | 34 kB 00:00 2024-06-04T15:49:49.837 INFO:teuthology.orchestra.run.smithi144.stdout:(167/283): mkfontscale-1.2.1-3.el9.x86_64.rpm 643 kB/s | 32 kB 00:00 2024-06-04T15:49:49.854 INFO:teuthology.orchestra.run.smithi177.stdout:(134/283): libosinfo-1.10.0-1.el9.x86_64.rpm 7.4 MB/s | 319 kB 00:00 2024-06-04T15:49:49.863 INFO:teuthology.orchestra.run.smithi144.stdout:(168/283): mesa-libGL-23.3.3-1.el9.x86_64.rpm 1.1 MB/s | 168 kB 00:00 2024-06-04T15:49:49.871 INFO:teuthology.orchestra.run.smithi177.stdout:(135/283): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.7 MB/s | 160 kB 00:00 2024-06-04T15:49:49.888 INFO:teuthology.orchestra.run.smithi144.stdout:(169/283): openblas-0.3.21-2.el9.x86_64.rpm 467 kB/s | 35 kB 00:00 2024-06-04T15:49:49.905 INFO:teuthology.orchestra.run.smithi177.stdout:(136/283): librabbitmq-0.11.0-7.el9.x86_64.rpm 903 kB/s | 45 kB 00:00 2024-06-04T15:49:49.930 INFO:teuthology.orchestra.run.smithi144.stdout:(170/283): openjpeg2-2.4.0-7.el9.x86_64.rpm 2.4 MB/s | 163 kB 00:00 2024-06-04T15:49:49.938 INFO:teuthology.orchestra.run.smithi177.stdout:(137/283): librdkafka-1.6.1-102.el9.x86_64.rpm 9.7 MB/s | 662 kB 00:00 2024-06-04T15:49:49.956 INFO:teuthology.orchestra.run.smithi144.stdout:(171/283): opus-1.3.1-10.el9.x86_64.rpm 2.9 MB/s | 200 kB 00:00 2024-06-04T15:49:49.964 INFO:teuthology.orchestra.run.smithi177.stdout:(138/283): libsbc-1.4-9.el9.x86_64.rpm 766 kB/s | 45 kB 00:00 2024-06-04T15:49:49.981 INFO:teuthology.orchestra.run.smithi144.stdout:(172/283): orc-0.4.31-6.el9.x86_64.rpm 3.6 MB/s | 184 kB 00:00 2024-06-04T15:49:49.989 INFO:teuthology.orchestra.run.smithi177.stdout:(139/283): libsndfile-1.0.31-8.el9.x86_64.rpm 4.0 MB/s | 206 kB 00:00 2024-06-04T15:49:50.014 INFO:teuthology.orchestra.run.smithi177.stdout:(140/283): libtheora-1.1.1-31.el9.x86_64.rpm 3.2 MB/s | 164 kB 00:00 2024-06-04T15:49:50.040 INFO:teuthology.orchestra.run.smithi177.stdout:(141/283): libtiff-4.4.0-12.el9.x86_64.rpm 3.9 MB/s | 198 kB 00:00 2024-06-04T15:49:50.056 INFO:teuthology.orchestra.run.smithi144.stdout:(173/283): openblas-openmp-0.3.21-2.el9.x86_64. 22 MB/s | 4.7 MB 00:00 2024-06-04T15:49:50.065 INFO:teuthology.orchestra.run.smithi177.stdout:(142/283): libtool-ltdl-2.4.6-45.el9.x86_64.rpm 740 kB/s | 37 kB 00:00 2024-06-04T15:49:50.082 INFO:teuthology.orchestra.run.smithi144.stdout:(174/283): osinfo-db-20231215-1.el9.noarch.rpm 4.0 MB/s | 521 kB 00:00 2024-06-04T15:49:50.090 INFO:teuthology.orchestra.run.smithi177.stdout:(143/283): libtracker-sparql-3.1.2-3.el9.x86_64 6.3 MB/s | 324 kB 00:00 2024-06-04T15:49:50.107 INFO:teuthology.orchestra.run.smithi144.stdout:(175/283): osinfo-db-tools-1.10.0-1.el9.x86_64. 588 kB/s | 74 kB 00:00 2024-06-04T15:49:50.116 INFO:teuthology.orchestra.run.smithi177.stdout:(144/283): libvisual-0.4.0-34.el9.x86_64.rpm 2.8 MB/s | 144 kB 00:00 2024-06-04T15:49:50.132 INFO:teuthology.orchestra.run.smithi144.stdout:(176/283): p11-kit-server-0.25.3-2.el9.x86_64.r 4.8 MB/s | 246 kB 00:00 2024-06-04T15:49:50.141 INFO:teuthology.orchestra.run.smithi177.stdout:(145/283): libvorbis-1.3.7-5.el9.x86_64.rpm 3.8 MB/s | 193 kB 00:00 2024-06-04T15:49:50.158 INFO:teuthology.orchestra.run.smithi144.stdout:(177/283): pipewire-1.0.1-1.el9.x86_64.rpm 2.1 MB/s | 107 kB 00:00 2024-06-04T15:49:50.166 INFO:teuthology.orchestra.run.smithi177.stdout:(146/283): libwayland-client-1.21.0-1.el9.x86_6 664 kB/s | 33 kB 00:00 2024-06-04T15:49:50.191 INFO:teuthology.orchestra.run.smithi144.stdout:(178/283): ostree-libs-2024.6-1.el9.x86_64.rpm 3.4 MB/s | 466 kB 00:00 2024-06-04T15:49:50.192 INFO:teuthology.orchestra.run.smithi177.stdout:(147/283): libwayland-cursor-1.21.0-1.el9.x86_6 387 kB/s | 19 kB 00:00 2024-06-04T15:49:50.217 INFO:teuthology.orchestra.run.smithi144.stdout:(179/283): pipewire-alsa-1.0.1-1.el9.x86_64.rpm 682 kB/s | 57 kB 00:00 2024-06-04T15:49:50.217 INFO:teuthology.orchestra.run.smithi177.stdout:(148/283): libwayland-egl-1.21.0-1.el9.x86_64.r 256 kB/s | 13 kB 00:00 2024-06-04T15:49:50.242 INFO:teuthology.orchestra.run.smithi144.stdout:(180/283): pipewire-jack-audio-connection-kit-1 109 kB/s | 9.1 kB 00:00 2024-06-04T15:49:50.243 INFO:teuthology.orchestra.run.smithi177.stdout:(149/283): libwayland-server-1.21.0-1.el9.x86_6 836 kB/s | 42 kB 00:00 2024-06-04T15:49:50.267 INFO:teuthology.orchestra.run.smithi144.stdout:(181/283): pipewire-jack-audio-connection-kit-l 1.7 MB/s | 135 kB 00:00 2024-06-04T15:49:50.267 INFO:teuthology.orchestra.run.smithi177.stdout:(150/283): libwebp-1.2.0-8.el9.x86_64.rpm 5.4 MB/s | 277 kB 00:00 2024-06-04T15:49:50.293 INFO:teuthology.orchestra.run.smithi177.stdout:(151/283): libxkbcommon-1.0.3-4.el9.x86_64.rpm 2.6 MB/s | 133 kB 00:00 2024-06-04T15:49:50.318 INFO:teuthology.orchestra.run.smithi177.stdout:(152/283): libxshmfence-1.3-10.el9.x86_64.rpm 252 kB/s | 13 kB 00:00 2024-06-04T15:49:50.343 INFO:teuthology.orchestra.run.smithi177.stdout:(153/283): low-memory-monitor-2.1-4.el9.x86_64. 715 kB/s | 36 kB 00:00 2024-06-04T15:49:50.368 INFO:teuthology.orchestra.run.smithi177.stdout:(154/283): lttng-ust-2.12.0-6.el9.x86_64.rpm 5.7 MB/s | 292 kB 00:00 2024-06-04T15:49:50.392 INFO:teuthology.orchestra.run.smithi144.stdout:(182/283): pipewire-pulseaudio-1.0.1-1.el9.x86_ 1.2 MB/s | 192 kB 00:00 2024-06-04T15:49:50.394 INFO:teuthology.orchestra.run.smithi177.stdout:(155/283): lua-5.4.4-4.el9.x86_64.rpm 3.7 MB/s | 188 kB 00:00 2024-06-04T15:49:50.419 INFO:teuthology.orchestra.run.smithi177.stdout:(156/283): lua-posix-35.0-8.el9.x86_64.rpm 2.9 MB/s | 151 kB 00:00 2024-06-04T15:49:50.445 INFO:teuthology.orchestra.run.smithi177.stdout:(157/283): maven-3.6.3-15.el9.noarch.rpm 352 kB/s | 18 kB 00:00 2024-06-04T15:49:50.459 INFO:teuthology.orchestra.run.smithi144.stdout:(183/283): plexus-cipher-1.7-27.el9.noarch.rpm 134 kB/s | 26 kB 00:00 2024-06-04T15:49:50.486 INFO:teuthology.orchestra.run.smithi177.stdout:(158/283): maven-lib-3.6.3-15.el9.noarch.rpm 22 MB/s | 1.5 MB 00:00 2024-06-04T15:49:50.501 INFO:teuthology.orchestra.run.smithi144.stdout:(184/283): pipewire-libs-1.0.1-1.el9.x86_64.rpm 7.4 MB/s | 1.9 MB 00:00 2024-06-04T15:49:50.512 INFO:teuthology.orchestra.run.smithi177.stdout:(159/283): maven-openjdk11-3.6.3-15.el9.noarch. 135 kB/s | 9.0 kB 00:00 2024-06-04T15:49:50.526 INFO:teuthology.orchestra.run.smithi144.stdout:(185/283): plexus-classworlds-2.6.0-11.el9.noar 449 kB/s | 60 kB 00:00 2024-06-04T15:49:50.537 INFO:teuthology.orchestra.run.smithi177.stdout:(160/283): maven-resolver-1.6.1-10.el9.noarch.r 10 MB/s | 517 kB 00:00 2024-06-04T15:49:50.552 INFO:teuthology.orchestra.run.smithi144.stdout:(186/283): plexus-containers-component-annotati 199 kB/s | 18 kB 00:00 2024-06-04T15:49:50.554 INFO:teuthology.orchestra.run.smithi177.stdout:(161/283): maven-shared-utils-3.3.4-3.el9.noarc 3.5 MB/s | 151 kB 00:00 2024-06-04T15:49:50.577 INFO:teuthology.orchestra.run.smithi144.stdout:(187/283): plexus-interpolation-1.26-11.el9.noa 1.0 MB/s | 80 kB 00:00 2024-06-04T15:49:50.580 INFO:teuthology.orchestra.run.smithi177.stdout:(162/283): maven-wagon-3.4.2-7.el9.noarch.rpm 2.6 MB/s | 112 kB 00:00 2024-06-04T15:49:50.602 INFO:teuthology.orchestra.run.smithi144.stdout:(188/283): plexus-sec-dispatcher-1.4-37.el9.noa 445 kB/s | 34 kB 00:00 2024-06-04T15:49:50.605 INFO:teuthology.orchestra.run.smithi177.stdout:(163/283): mesa-libEGL-23.3.3-1.el9.x86_64.rpm 2.5 MB/s | 127 kB 00:00 2024-06-04T15:49:50.627 INFO:teuthology.orchestra.run.smithi144.stdout:(189/283): plexus-utils-3.3.0-10.el9.noarch.rpm 3.3 MB/s | 254 kB 00:00 2024-06-04T15:49:50.630 INFO:teuthology.orchestra.run.smithi177.stdout:(164/283): mesa-libGL-23.3.3-1.el9.x86_64.rpm 3.3 MB/s | 168 kB 00:00 2024-06-04T15:49:50.656 INFO:teuthology.orchestra.run.smithi177.stdout:(165/283): mesa-libgbm-23.3.3-1.el9.x86_64.rpm 749 kB/s | 38 kB 00:00 2024-06-04T15:49:50.669 INFO:teuthology.orchestra.run.smithi144.stdout:(190/283): poppler-21.01.0-20.el9.x86_64.rpm 12 MB/s | 1.1 MB 00:00 2024-06-04T15:49:50.681 INFO:teuthology.orchestra.run.smithi177.stdout:(166/283): mesa-libglapi-23.3.3-1.el9.x86_64.rp 880 kB/s | 44 kB 00:00 2024-06-04T15:49:50.695 INFO:teuthology.orchestra.run.smithi144.stdout:(191/283): poppler-glib-21.01.0-20.el9.x86_64.r 2.2 MB/s | 152 kB 00:00 2024-06-04T15:49:50.698 INFO:teuthology.orchestra.run.smithi177.stdout:(167/283): mkfontscale-1.2.1-3.el9.x86_64.rpm 772 kB/s | 32 kB 00:00 2024-06-04T15:49:50.715 INFO:teuthology.orchestra.run.smithi177.stdout:(168/283): openblas-0.3.21-2.el9.x86_64.rpm 1.0 MB/s | 35 kB 00:00 2024-06-04T15:49:50.737 INFO:teuthology.orchestra.run.smithi144.stdout:(192/283): poppler-data-0.4.9-9.el9.noarch.rpm 14 MB/s | 1.9 MB 00:00 2024-06-04T15:49:50.757 INFO:teuthology.orchestra.run.smithi177.stdout:(169/283): openjpeg2-2.4.0-7.el9.x86_64.rpm 3.8 MB/s | 163 kB 00:00 2024-06-04T15:49:50.832 INFO:teuthology.orchestra.run.smithi177.stdout:(170/283): openblas-openmp-0.3.21-2.el9.x86_64. 35 MB/s | 4.7 MB 00:00 2024-06-04T15:49:50.857 INFO:teuthology.orchestra.run.smithi177.stdout:(171/283): opus-1.3.1-10.el9.x86_64.rpm 1.9 MB/s | 200 kB 00:00 2024-06-04T15:49:50.883 INFO:teuthology.orchestra.run.smithi177.stdout:(172/283): orc-0.4.31-6.el9.x86_64.rpm 3.6 MB/s | 184 kB 00:00 2024-06-04T15:49:50.903 INFO:teuthology.orchestra.run.smithi144.stdout:(193/283): protobuf-3.14.0-13.el9.x86_64.rpm 4.3 MB/s | 1.0 MB 00:00 2024-06-04T15:49:50.916 INFO:teuthology.orchestra.run.smithi177.stdout:(173/283): osinfo-db-20231215-1.el9.noarch.rpm 8.7 MB/s | 521 kB 00:00 2024-06-04T15:49:50.929 INFO:teuthology.orchestra.run.smithi144.stdout:(194/283): publicsuffix-list-20210518-3.el9.noa 354 kB/s | 83 kB 00:00 2024-06-04T15:49:50.941 INFO:teuthology.orchestra.run.smithi177.stdout:(174/283): osinfo-db-tools-1.10.0-1.el9.x86_64. 1.2 MB/s | 74 kB 00:00 2024-06-04T15:49:50.962 INFO:teuthology.orchestra.run.smithi144.stdout:(195/283): pulseaudio-libs-15.0-2.el9.x86_64.rp 2.9 MB/s | 679 kB 00:00 2024-06-04T15:49:50.967 INFO:teuthology.orchestra.run.smithi177.stdout:(175/283): ostree-libs-2024.6-1.el9.x86_64.rpm 9.1 MB/s | 466 kB 00:00 2024-06-04T15:49:50.992 INFO:teuthology.orchestra.run.smithi177.stdout:(176/283): p11-kit-server-0.25.3-2.el9.x86_64.r 4.8 MB/s | 246 kB 00:00 2024-06-04T15:49:50.996 INFO:teuthology.orchestra.run.smithi144.stdout:(196/283): python3-devel-3.9.18-3.el9.x86_64.rp 3.6 MB/s | 244 kB 00:00 2024-06-04T15:49:51.017 INFO:teuthology.orchestra.run.smithi177.stdout:(177/283): pipewire-1.0.1-1.el9.x86_64.rpm 2.1 MB/s | 107 kB 00:00 2024-06-04T15:49:51.021 INFO:teuthology.orchestra.run.smithi144.stdout:(197/283): python3-jinja2-2.11.3-6.el9.noarch.r 4.1 MB/s | 248 kB 00:00 2024-06-04T15:49:51.043 INFO:teuthology.orchestra.run.smithi177.stdout:(178/283): pipewire-alsa-1.0.1-1.el9.x86_64.rpm 1.1 MB/s | 57 kB 00:00 2024-06-04T15:49:51.047 INFO:teuthology.orchestra.run.smithi144.stdout:(198/283): python3-jsonpatch-1.21-16.el9.noarch 510 kB/s | 26 kB 00:00 2024-06-04T15:49:51.068 INFO:teuthology.orchestra.run.smithi177.stdout:(179/283): pipewire-jack-audio-connection-kit-1 182 kB/s | 9.1 kB 00:00 2024-06-04T15:49:51.074 INFO:teuthology.orchestra.run.smithi144.stdout:(199/283): python3-jsonpointer-2.0-4.el9.noarch 382 kB/s | 19 kB 00:00 2024-06-04T15:49:51.093 INFO:teuthology.orchestra.run.smithi177.stdout:(180/283): pipewire-jack-audio-connection-kit-l 2.6 MB/s | 135 kB 00:00 2024-06-04T15:49:51.122 INFO:teuthology.orchestra.run.smithi144.stdout:(200/283): python3-mako-1.1.4-6.el9.noarch.rpm 2.2 MB/s | 172 kB 00:00 2024-06-04T15:49:51.144 INFO:teuthology.orchestra.run.smithi177.stdout:(181/283): pipewire-libs-1.0.1-1.el9.x86_64.rpm 26 MB/s | 1.9 MB 00:00 2024-06-04T15:49:51.148 INFO:teuthology.orchestra.run.smithi144.stdout:(201/283): python3-markupsafe-1.1.1-12.el9.x86_ 461 kB/s | 35 kB 00:00 2024-06-04T15:49:51.169 INFO:teuthology.orchestra.run.smithi177.stdout:(182/283): pipewire-pulseaudio-1.0.1-1.el9.x86_ 2.5 MB/s | 192 kB 00:00 2024-06-04T15:49:51.194 INFO:teuthology.orchestra.run.smithi177.stdout:(183/283): plexus-cipher-1.7-27.el9.noarch.rpm 517 kB/s | 26 kB 00:00 2024-06-04T15:49:51.220 INFO:teuthology.orchestra.run.smithi177.stdout:(184/283): plexus-classworlds-2.6.0-11.el9.noar 1.2 MB/s | 60 kB 00:00 2024-06-04T15:49:51.223 INFO:teuthology.orchestra.run.smithi144.stdout:(202/283): python3-babel-2.9.1-2.el9.noarch.rpm 19 MB/s | 6.0 MB 00:00 2024-06-04T15:49:51.245 INFO:teuthology.orchestra.run.smithi177.stdout:(185/283): plexus-containers-component-annotati 366 kB/s | 18 kB 00:00 2024-06-04T15:49:51.248 INFO:teuthology.orchestra.run.smithi144.stdout:(203/283): python3-numpy-f2py-1.20.1-5.el9.x86_ 2.4 MB/s | 250 kB 00:00 2024-06-04T15:49:51.270 INFO:teuthology.orchestra.run.smithi177.stdout:(186/283): plexus-interpolation-1.26-11.el9.noa 1.5 MB/s | 80 kB 00:00 2024-06-04T15:49:51.273 INFO:teuthology.orchestra.run.smithi144.stdout:(204/283): python3-oauthlib-3.1.1-5.el9.noarch. 4.3 MB/s | 222 kB 00:00 2024-06-04T15:49:51.291 INFO:teuthology.orchestra.run.smithi144.stdout:(205/283): python3-packaging-20.9-5.el9.noarch. 1.8 MB/s | 77 kB 00:00 2024-06-04T15:49:51.295 INFO:teuthology.orchestra.run.smithi177.stdout:(187/283): plexus-sec-dispatcher-1.4-37.el9.noa 667 kB/s | 34 kB 00:00 2024-06-04T15:49:51.308 INFO:teuthology.orchestra.run.smithi144.stdout:(206/283): python3-prettytable-0.7.2-27.el9.noa 1.2 MB/s | 42 kB 00:00 2024-06-04T15:49:51.321 INFO:teuthology.orchestra.run.smithi177.stdout:(188/283): plexus-utils-3.3.0-10.el9.noarch.rpm 4.9 MB/s | 254 kB 00:00 2024-06-04T15:49:51.341 INFO:teuthology.orchestra.run.smithi144.stdout:(207/283): python3-protobuf-3.14.0-13.el9.noarc 5.2 MB/s | 269 kB 00:00 2024-06-04T15:49:51.363 INFO:teuthology.orchestra.run.smithi177.stdout:(189/283): poppler-21.01.0-20.el9.x86_64.rpm 16 MB/s | 1.1 MB 00:00 2024-06-04T15:49:51.366 INFO:teuthology.orchestra.run.smithi144.stdout:(208/283): python3-pyasn1-0.4.8-6.el9.noarch.rp 2.7 MB/s | 159 kB 00:00 2024-06-04T15:49:51.413 INFO:teuthology.orchestra.run.smithi177.stdout:(190/283): poppler-data-0.4.9-9.el9.noarch.rpm 20 MB/s | 1.9 MB 00:00 2024-06-04T15:49:51.417 INFO:teuthology.orchestra.run.smithi144.stdout:(209/283): python3-pyasn1-modules-0.4.8-6.el9.n 3.6 MB/s | 279 kB 00:00 2024-06-04T15:49:51.438 INFO:teuthology.orchestra.run.smithi177.stdout:(191/283): poppler-glib-21.01.0-20.el9.x86_64.r 2.0 MB/s | 152 kB 00:00 2024-06-04T15:49:51.442 INFO:teuthology.orchestra.run.smithi144.stdout:(210/283): python3-pytz-2021.1-5.el9.noarch.rpm 676 kB/s | 51 kB 00:00 2024-06-04T15:49:51.468 INFO:teuthology.orchestra.run.smithi144.stdout:(211/283): python3-requests-oauthlib-1.3.0-12.e 1.0 MB/s | 54 kB 00:00 2024-06-04T15:49:51.489 INFO:teuthology.orchestra.run.smithi177.stdout:(192/283): protobuf-3.14.0-13.el9.x86_64.rpm 13 MB/s | 1.0 MB 00:00 2024-06-04T15:49:51.514 INFO:teuthology.orchestra.run.smithi177.stdout:(193/283): publicsuffix-list-20210518-3.el9.noa 1.1 MB/s | 83 kB 00:00 2024-06-04T15:49:51.534 INFO:teuthology.orchestra.run.smithi144.stdout:(212/283): python3-numpy-1.20.1-5.el9.x86_64.rp 12 MB/s | 5.1 MB 00:00 2024-06-04T15:49:51.556 INFO:teuthology.orchestra.run.smithi177.stdout:(194/283): pulseaudio-libs-15.0-2.el9.x86_64.rp 10 MB/s | 679 kB 00:00 2024-06-04T15:49:51.598 INFO:teuthology.orchestra.run.smithi177.stdout:(195/283): python3-devel-3.9.18-3.el9.x86_64.rp 5.7 MB/s | 244 kB 00:00 2024-06-04T15:49:51.640 INFO:teuthology.orchestra.run.smithi177.stdout:(196/283): python3-jinja2-2.11.3-6.el9.noarch.r 5.9 MB/s | 248 kB 00:00 2024-06-04T15:49:51.716 INFO:teuthology.orchestra.run.smithi177.stdout:(197/283): python3-babel-2.9.1-2.el9.noarch.rpm 30 MB/s | 6.0 MB 00:00 2024-06-04T15:49:51.732 INFO:teuthology.orchestra.run.smithi177.stdout:(198/283): python3-jsonpatch-1.21-16.el9.noarch 279 kB/s | 26 kB 00:00 2024-06-04T15:49:51.749 INFO:teuthology.orchestra.run.smithi177.stdout:(199/283): python3-jsonpointer-2.0-4.el9.noarch 573 kB/s | 19 kB 00:00 2024-06-04T15:49:51.774 INFO:teuthology.orchestra.run.smithi177.stdout:(200/283): python3-mako-1.1.4-6.el9.noarch.rpm 4.0 MB/s | 172 kB 00:00 2024-06-04T15:49:51.791 INFO:teuthology.orchestra.run.smithi177.stdout:(201/283): python3-markupsafe-1.1.1-12.el9.x86_ 832 kB/s | 35 kB 00:00 2024-06-04T15:49:51.834 INFO:teuthology.orchestra.run.smithi177.stdout:(202/283): python3-numpy-f2py-1.20.1-5.el9.x86_ 5.9 MB/s | 250 kB 00:00 2024-06-04T15:49:51.901 INFO:teuthology.orchestra.run.smithi144.stdout:(213/283): python3-toml-0.10.2-6.el9.noarch.rpm 96 kB/s | 42 kB 00:00 2024-06-04T15:49:51.926 INFO:teuthology.orchestra.run.smithi144.stdout:(214/283): qatlib-24.02.0-1.el9.x86_64.rpm 563 kB/s | 221 kB 00:00 2024-06-04T15:49:52.027 INFO:teuthology.orchestra.run.smithi144.stdout:(215/283): qatlib-service-24.02.0-1.el9.x86_64. 287 kB/s | 36 kB 00:00 2024-06-04T15:49:52.052 INFO:teuthology.orchestra.run.smithi144.stdout:(216/283): qatzip-libs-1.2.0-1.el9.x86_64.rpm 378 kB/s | 47 kB 00:00 2024-06-04T15:49:52.192 INFO:teuthology.orchestra.run.smithi177.stdout:(203/283): java-11-openjdk-headless-11.0.20.1.1 12 MB/s | 39 MB 00:03 2024-06-04T15:49:52.194 INFO:teuthology.orchestra.run.smithi144.stdout:(217/283): rtkit-0.11-28.el9.x86_64.rpm 336 kB/s | 56 kB 00:00 2024-06-04T15:49:52.217 INFO:teuthology.orchestra.run.smithi177.stdout:(204/283): python3-oauthlib-3.1.1-5.el9.noarch. 579 kB/s | 222 kB 00:00 2024-06-04T15:49:52.243 INFO:teuthology.orchestra.run.smithi177.stdout:(205/283): python3-packaging-20.9-5.el9.noarch. 1.5 MB/s | 77 kB 00:00 2024-06-04T15:49:52.253 INFO:teuthology.orchestra.run.smithi144.stdout:(218/283): sisu-0.3.4-10.el9.noarch.rpm 2.5 MB/s | 510 kB 00:00 2024-06-04T15:49:52.271 INFO:teuthology.orchestra.run.smithi177.stdout:(206/283): python3-prettytable-0.7.2-27.el9.noa 856 kB/s | 42 kB 00:00 2024-06-04T15:49:52.293 INFO:teuthology.orchestra.run.smithi177.stdout:(207/283): python3-protobuf-3.14.0-13.el9.noarc 5.3 MB/s | 269 kB 00:00 2024-06-04T15:49:52.328 INFO:teuthology.orchestra.run.smithi144.stdout:(219/283): slf4j-1.7.30-13.el9.noarch.rpm 516 kB/s | 69 kB 00:00 2024-06-04T15:49:52.336 INFO:teuthology.orchestra.run.smithi177.stdout:(208/283): python3-pyasn1-0.4.8-6.el9.noarch.rp 2.3 MB/s | 159 kB 00:00 2024-06-04T15:49:52.353 INFO:teuthology.orchestra.run.smithi144.stdout:(220/283): socat-1.7.4.1-5.el9.x86_64.rpm 3.0 MB/s | 305 kB 00:00 2024-06-04T15:49:52.370 INFO:teuthology.orchestra.run.smithi177.stdout:(209/283): python3-pyasn1-modules-0.4.8-6.el9.n 3.6 MB/s | 279 kB 00:00 2024-06-04T15:49:52.394 INFO:teuthology.orchestra.run.smithi177.stdout:(210/283): python3-pytz-2021.1-5.el9.noarch.rpm 865 kB/s | 51 kB 00:00 2024-06-04T15:49:52.395 INFO:teuthology.orchestra.run.smithi144.stdout:(221/283): sound-theme-freedesktop-0.8-17.el9.n 5.6 MB/s | 383 kB 00:00 2024-06-04T15:49:52.420 INFO:teuthology.orchestra.run.smithi177.stdout:(211/283): python3-requests-oauthlib-1.3.0-12.e 1.0 MB/s | 54 kB 00:00 2024-06-04T15:49:52.580 INFO:teuthology.orchestra.run.smithi177.stdout:(212/283): python3-numpy-1.20.1-5.el9.x86_64.rp 6.3 MB/s | 5.1 MB 00:00 2024-06-04T15:49:52.596 INFO:teuthology.orchestra.run.smithi144.stdout:(222/283): totem-pl-parser-3.26.6-2.el9.x86_64. 630 kB/s | 152 kB 00:00 2024-06-04T15:49:52.604 INFO:teuthology.orchestra.run.smithi177.stdout:(213/283): python3-toml-0.10.2-6.el9.noarch.rpm 227 kB/s | 42 kB 00:00 2024-06-04T15:49:52.621 INFO:teuthology.orchestra.run.smithi144.stdout:(223/283): tracker-3.1.2-3.el9.x86_64.rpm 2.4 MB/s | 555 kB 00:00 2024-06-04T15:49:52.629 INFO:teuthology.orchestra.run.smithi177.stdout:(214/283): qatlib-24.02.0-1.el9.x86_64.rpm 4.5 MB/s | 221 kB 00:00 2024-06-04T15:49:52.663 INFO:teuthology.orchestra.run.smithi177.stdout:(215/283): qatlib-service-24.02.0-1.el9.x86_64. 612 kB/s | 36 kB 00:00 2024-06-04T15:49:52.688 INFO:teuthology.orchestra.run.smithi177.stdout:(216/283): qatzip-libs-1.2.0-1.el9.x86_64.rpm 805 kB/s | 47 kB 00:00 2024-06-04T15:49:52.713 INFO:teuthology.orchestra.run.smithi177.stdout:(217/283): rtkit-0.11-28.el9.x86_64.rpm 1.1 MB/s | 56 kB 00:00 2024-06-04T15:49:52.739 INFO:teuthology.orchestra.run.smithi177.stdout:(218/283): sisu-0.3.4-10.el9.noarch.rpm 9.9 MB/s | 510 kB 00:00 2024-06-04T15:49:52.764 INFO:teuthology.orchestra.run.smithi177.stdout:(219/283): slf4j-1.7.30-13.el9.noarch.rpm 1.3 MB/s | 69 kB 00:00 2024-06-04T15:49:52.789 INFO:teuthology.orchestra.run.smithi177.stdout:(220/283): socat-1.7.4.1-5.el9.x86_64.rpm 5.9 MB/s | 305 kB 00:00 2024-06-04T15:49:52.815 INFO:teuthology.orchestra.run.smithi177.stdout:(221/283): sound-theme-freedesktop-0.8-17.el9.n 7.5 MB/s | 383 kB 00:00 2024-06-04T15:49:52.840 INFO:teuthology.orchestra.run.smithi177.stdout:(222/283): totem-pl-parser-3.26.6-2.el9.x86_64. 3.0 MB/s | 152 kB 00:00 2024-06-04T15:49:52.846 INFO:teuthology.orchestra.run.smithi144.stdout:(224/283): ttmkfdir-3.0.9-65.el9.x86_64.rpm 236 kB/s | 53 kB 00:00 2024-06-04T15:49:52.874 INFO:teuthology.orchestra.run.smithi177.stdout:(223/283): tracker-3.1.2-3.el9.x86_64.rpm 9.3 MB/s | 555 kB 00:00 2024-06-04T15:49:52.897 INFO:teuthology.orchestra.run.smithi144.stdout:(225/283): tracker-miners-3.1.2-4.el9.x86_64.rp 3.1 MB/s | 944 kB 00:00 2024-06-04T15:49:52.907 INFO:teuthology.orchestra.run.smithi177.stdout:(224/283): tracker-miners-3.1.2-4.el9.x86_64.rp 14 MB/s | 944 kB 00:00 2024-06-04T15:49:52.933 INFO:teuthology.orchestra.run.smithi177.stdout:(225/283): ttmkfdir-3.0.9-65.el9.x86_64.rpm 909 kB/s | 53 kB 00:00 2024-06-04T15:49:52.958 INFO:teuthology.orchestra.run.smithi177.stdout:(226/283): tzdata-java-2024a-2.el9.noarch.rpm 4.5 MB/s | 230 kB 00:00 2024-06-04T15:49:52.983 INFO:teuthology.orchestra.run.smithi177.stdout:(227/283): upower-0.99.11-11.el9.x86_64.rpm 3.4 MB/s | 173 kB 00:00 2024-06-04T15:49:53.008 INFO:teuthology.orchestra.run.smithi177.stdout:(228/283): webrtc-audio-processing-0.3.1-8.el9. 6.0 MB/s | 306 kB 00:00 2024-06-04T15:49:53.034 INFO:teuthology.orchestra.run.smithi177.stdout:(229/283): wireplumber-0.4.14-1.el9.x86_64.rpm 1.9 MB/s | 96 kB 00:00 2024-06-04T15:49:53.059 INFO:teuthology.orchestra.run.smithi177.stdout:(230/283): wireplumber-libs-0.4.14-1.el9.x86_64 7.0 MB/s | 358 kB 00:00 2024-06-04T15:49:53.087 INFO:teuthology.orchestra.run.smithi177.stdout:(231/283): xdg-dbus-proxy-0.1.3-1.el9.x86_64.rp 845 kB/s | 42 kB 00:00 2024-06-04T15:49:53.088 INFO:teuthology.orchestra.run.smithi144.stdout:(226/283): tzdata-java-2024a-2.el9.noarch.rpm 950 kB/s | 230 kB 00:00 2024-06-04T15:49:53.110 INFO:teuthology.orchestra.run.smithi177.stdout:(232/283): xdg-desktop-portal-1.12.6-1.el9.x86_ 7.5 MB/s | 385 kB 00:00 2024-06-04T15:49:53.114 INFO:teuthology.orchestra.run.smithi144.stdout:(227/283): upower-0.99.11-11.el9.x86_64.rpm 796 kB/s | 173 kB 00:00 2024-06-04T15:49:53.135 INFO:teuthology.orchestra.run.smithi177.stdout:(233/283): xdg-desktop-portal-gtk-1.12.0-3.el9. 2.6 MB/s | 134 kB 00:00 2024-06-04T15:49:53.139 INFO:teuthology.orchestra.run.smithi144.stdout:(228/283): webrtc-audio-processing-0.3.1-8.el9. 5.9 MB/s | 306 kB 00:00 2024-06-04T15:49:53.177 INFO:teuthology.orchestra.run.smithi177.stdout:(234/283): xkeyboard-config-2.33-2.el9.noarch.r 13 MB/s | 859 kB 00:00 2024-06-04T15:49:53.194 INFO:teuthology.orchestra.run.smithi177.stdout:(235/283): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.1 MB/s | 64 kB 00:00 2024-06-04T15:49:53.253 INFO:teuthology.orchestra.run.smithi177.stdout:(236/283): xorg-x11-fonts-Type1-7.5-33.el9.noar 6.6 MB/s | 505 kB 00:00 2024-06-04T15:49:53.256 INFO:teuthology.orchestra.run.smithi177.stdout:[MIRROR] lua-devel-5.4.4-4.el9.x86_64.rpm: Status code: 404 for https://download-cc-rdu01.fedoraproject.org/pub/centos-stream/9-stream/CRB/x86_64/os/Packages/lua-devel-5.4.4-4.el9.x86_64.rpm (IP: 8.43.85.72) 2024-06-04T15:49:53.281 INFO:teuthology.orchestra.run.smithi144.stdout:(229/283): wireplumber-0.4.14-1.el9.x86_64.rpm 579 kB/s | 96 kB 00:00 2024-06-04T15:49:53.292 INFO:teuthology.orchestra.run.smithi177.stdout:[MIRROR] protobuf-compiler-3.14.0-13.el9.x86_64.rpm: Status code: 404 for https://download-cc-rdu01.fedoraproject.org/pub/centos-stream/9-stream/CRB/x86_64/os/Packages/protobuf-compiler-3.14.0-13.el9.x86_64.rpm (IP: 8.43.85.72) 2024-06-04T15:49:53.307 INFO:teuthology.orchestra.run.smithi144.stdout:(230/283): wireplumber-libs-0.4.14-1.el9.x86_64 2.1 MB/s | 358 kB 00:00 2024-06-04T15:49:53.340 INFO:teuthology.orchestra.run.smithi144.stdout:(231/283): xdg-dbus-proxy-0.1.3-1.el9.x86_64.rp 721 kB/s | 42 kB 00:00 2024-06-04T15:49:53.441 INFO:teuthology.orchestra.run.smithi144.stdout:(232/283): xdg-desktop-portal-1.12.6-1.el9.x86_ 2.8 MB/s | 385 kB 00:00 2024-06-04T15:49:53.466 INFO:teuthology.orchestra.run.smithi144.stdout:(233/283): xdg-desktop-portal-gtk-1.12.0-3.el9. 1.0 MB/s | 134 kB 00:00 2024-06-04T15:49:53.478 INFO:teuthology.orchestra.run.smithi177.stdout:(237/283): python3-scipy-1.6.2-8.el9.x86_64.rpm 15 MB/s | 16 MB 00:01 2024-06-04T15:49:53.495 INFO:teuthology.orchestra.run.smithi177.stdout:(238/283): lua-devel-5.4.4-4.el9.x86_64.rpm 74 kB/s | 22 kB 00:00 2024-06-04T15:49:53.528 INFO:teuthology.orchestra.run.smithi177.stdout:(239/283): gperftools-libs-2.9.1-2.el9.x86_64.r 9.1 MB/s | 309 kB 00:00 2024-06-04T15:49:53.554 INFO:teuthology.orchestra.run.smithi177.stdout:(240/283): grpc-data-1.46.7-10.el9.noarch.rpm 778 kB/s | 19 kB 00:00 2024-06-04T15:49:53.579 INFO:teuthology.orchestra.run.smithi177.stdout:(241/283): abseil-cpp-20211102.0-3.el9.x86_64.r 5.3 MB/s | 548 kB 00:00 2024-06-04T15:49:53.605 INFO:teuthology.orchestra.run.smithi177.stdout:(242/283): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.0 MB/s | 26 kB 00:00 2024-06-04T15:49:53.624 INFO:teuthology.orchestra.run.smithi144.stdout:(234/283): python3-scipy-1.6.2-8.el9.x86_64.rpm 7.4 MB/s | 16 MB 00:02 2024-06-04T15:49:53.638 INFO:teuthology.orchestra.run.smithi177.stdout:(243/283): protobuf-compiler-3.14.0-13.el9.x86_ 2.2 MB/s | 863 kB 00:00 2024-06-04T15:49:53.650 INFO:teuthology.orchestra.run.smithi144.stdout:(235/283): xmlstarlet-1.6.1-20.el9.x86_64.rpm 347 kB/s | 64 kB 00:00 2024-06-04T15:49:53.664 INFO:teuthology.orchestra.run.smithi177.stdout:(244/283): liboath-2.6.7-2.el9.x86_64.rpm 829 kB/s | 49 kB 00:00 2024-06-04T15:49:53.675 INFO:teuthology.orchestra.run.smithi144.stdout:(236/283): xorg-x11-fonts-Type1-7.5-33.el9.noar 9.9 MB/s | 505 kB 00:00 2024-06-04T15:49:53.722 INFO:teuthology.orchestra.run.smithi177.stdout:(245/283): luarocks-3.9.2-5.el9.noarch.rpm 4.6 MB/s | 151 kB 00:00 2024-06-04T15:49:53.742 INFO:teuthology.orchestra.run.smithi144.stdout:(237/283): xkeyboard-config-2.33-2.el9.noarch.r 2.8 MB/s | 859 kB 00:00 2024-06-04T15:49:53.747 INFO:teuthology.orchestra.run.smithi177.stdout:(246/283): libunwind-1.6.2-1.el9.x86_64.rpm 619 kB/s | 67 kB 00:00 2024-06-04T15:49:53.771 INFO:teuthology.orchestra.run.smithi144.stdout:[MIRROR] lua-devel-5.4.4-4.el9.x86_64.rpm: Status code: 404 for https://download-cc-rdu01.fedoraproject.org/pub/centos-stream/9-stream/CRB/x86_64/os/Packages/lua-devel-5.4.4-4.el9.x86_64.rpm (IP: 8.43.85.72) 2024-06-04T15:49:53.806 INFO:teuthology.orchestra.run.smithi144.stdout:[MIRROR] protobuf-compiler-3.14.0-13.el9.x86_64.rpm: Status code: 404 for https://download-cc-rdu01.fedoraproject.org/pub/centos-stream/9-stream/CRB/x86_64/os/Packages/protobuf-compiler-3.14.0-13.el9.x86_64.rpm (IP: 8.43.85.72) 2024-06-04T15:49:53.831 INFO:teuthology.orchestra.run.smithi177.stdout:(247/283): python3-asyncssh-2.13.2-5.el9.noarch 6.4 MB/s | 548 kB 00:00 2024-06-04T15:49:53.842 INFO:teuthology.orchestra.run.smithi144.stdout:(238/283): lua-devel-5.4.4-4.el9.x86_64.rpm 116 kB/s | 22 kB 00:00 2024-06-04T15:49:53.856 INFO:teuthology.orchestra.run.smithi177.stdout:(248/283): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-06-04T15:49:53.882 INFO:teuthology.orchestra.run.smithi177.stdout:(249/283): parquet-libs-9.0.0-11.el9.x86_64.rpm 5.1 MB/s | 839 kB 00:00 2024-06-04T15:49:53.901 INFO:teuthology.orchestra.run.smithi144.stdout:(239/283): gperftools-libs-2.9.1-2.el9.x86_64.r 5.2 MB/s | 309 kB 00:00 2024-06-04T15:49:53.907 INFO:teuthology.orchestra.run.smithi177.stdout:(250/283): python3-cachetools-4.2.4-1.el9.noarc 640 kB/s | 32 kB 00:00 2024-06-04T15:49:53.934 INFO:teuthology.orchestra.run.smithi177.stdout:(251/283): python3-certifi-2021.10.8-2.el9.noar 298 kB/s | 15 kB 00:00 2024-06-04T15:49:53.934 INFO:teuthology.orchestra.run.smithi144.stdout:(240/283): abseil-cpp-20211102.0-3.el9.x86_64.r 3.3 MB/s | 548 kB 00:00 2024-06-04T15:49:53.951 INFO:teuthology.orchestra.run.smithi144.stdout:(241/283): grpc-data-1.46.7-10.el9.noarch.rpm 386 kB/s | 19 kB 00:00 2024-06-04T15:49:53.966 INFO:teuthology.orchestra.run.smithi177.stdout:(252/283): python3-cheroot-8.6.0-4.el9.noarch.r 2.9 MB/s | 172 kB 00:00 2024-06-04T15:49:53.993 INFO:teuthology.orchestra.run.smithi144.stdout:(242/283): protobuf-compiler-3.14.0-13.el9.x86_ 2.9 MB/s | 863 kB 00:00 2024-06-04T15:49:54.008 INFO:teuthology.orchestra.run.smithi177.stdout:(253/283): python3-cherrypy-18.6.1-2.el9.noarch 4.7 MB/s | 358 kB 00:00 2024-06-04T15:49:54.019 INFO:teuthology.orchestra.run.smithi144.stdout:(243/283): libarrow-doc-9.0.0-11.el9.noarch.rpm 388 kB/s | 26 kB 00:00 2024-06-04T15:49:54.033 INFO:teuthology.orchestra.run.smithi177.stdout:(254/283): python3-google-auth-2.29.0-1.el9.noa 3.0 MB/s | 206 kB 00:00 2024-06-04T15:49:54.044 INFO:teuthology.orchestra.run.smithi144.stdout:(244/283): liboath-2.6.7-2.el9.x86_64.rpm 965 kB/s | 49 kB 00:00 2024-06-04T15:49:54.069 INFO:teuthology.orchestra.run.smithi144.stdout:(245/283): libunwind-1.6.2-1.el9.x86_64.rpm 1.3 MB/s | 67 kB 00:00 2024-06-04T15:49:54.075 INFO:teuthology.orchestra.run.smithi177.stdout:(255/283): python3-grpcio-tools-1.46.7-10.el9.x 3.4 MB/s | 144 kB 00:00 2024-06-04T15:49:54.101 INFO:teuthology.orchestra.run.smithi177.stdout:(256/283): python3-jaraco-8.2.1-3.el9.noarch.rp 432 kB/s | 11 kB 00:00 2024-06-04T15:49:54.103 INFO:teuthology.orchestra.run.smithi144.stdout:(246/283): luarocks-3.9.2-5.el9.noarch.rpm 2.5 MB/s | 151 kB 00:00 2024-06-04T15:49:54.159 INFO:teuthology.orchestra.run.smithi177.stdout:(257/283): libarrow-9.0.0-11.el9.x86_64.rpm 7.3 MB/s | 4.4 MB 00:00 2024-06-04T15:49:54.184 INFO:teuthology.orchestra.run.smithi177.stdout:(258/283): python3-jaraco-classes-3.2.1-5.el9.n 211 kB/s | 18 kB 00:00 2024-06-04T15:49:54.186 INFO:teuthology.orchestra.run.smithi144.stdout:(247/283): python3-asyncssh-2.13.2-5.el9.noarch 6.4 MB/s | 548 kB 00:00 2024-06-04T15:49:54.210 INFO:teuthology.orchestra.run.smithi177.stdout:(259/283): python3-jaraco-collections-3.0.0-8.e 462 kB/s | 23 kB 00:00 2024-06-04T15:49:54.220 INFO:teuthology.orchestra.run.smithi144.stdout:(248/283): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.3 MB/s | 43 kB 00:00 2024-06-04T15:49:54.235 INFO:teuthology.orchestra.run.smithi177.stdout:(260/283): python3-jaraco-functools-3.5.0-2.el9 386 kB/s | 19 kB 00:00 2024-06-04T15:49:54.254 INFO:teuthology.orchestra.run.smithi144.stdout:(249/283): parquet-libs-9.0.0-11.el9.x86_64.rpm 4.4 MB/s | 839 kB 00:00 2024-06-04T15:49:54.261 INFO:teuthology.orchestra.run.smithi177.stdout:(261/283): python3-jaraco-text-3.2.0-6.el9.noar 391 kB/s | 20 kB 00:00 2024-06-04T15:49:54.279 INFO:teuthology.orchestra.run.smithi144.stdout:(250/283): python3-cachetools-4.2.4-1.el9.noarc 550 kB/s | 32 kB 00:00 2024-06-04T15:49:54.294 INFO:teuthology.orchestra.run.smithi177.stdout:(262/283): python3-logutils-0.3.5-21.el9.noarch 1.4 MB/s | 46 kB 00:00 2024-06-04T15:49:54.304 INFO:teuthology.orchestra.run.smithi144.stdout:(251/283): python3-certifi-2021.10.8-2.el9.noar 298 kB/s | 15 kB 00:00 2024-06-04T15:49:54.319 INFO:teuthology.orchestra.run.smithi177.stdout:(263/283): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-06-04T15:49:54.338 INFO:teuthology.orchestra.run.smithi144.stdout:(252/283): python3-cheroot-8.6.0-4.el9.noarch.r 2.9 MB/s | 172 kB 00:00 2024-06-04T15:49:54.353 INFO:teuthology.orchestra.run.smithi177.stdout:(264/283): python3-natsort-7.1.1-5.el9.noarch.r 1.7 MB/s | 58 kB 00:00 2024-06-04T15:49:54.389 INFO:teuthology.orchestra.run.smithi144.stdout:(253/283): python3-google-auth-2.29.0-1.el9.noa 4.0 MB/s | 206 kB 00:00 2024-06-04T15:49:54.395 INFO:teuthology.orchestra.run.smithi177.stdout:(265/283): python3-grpcio-1.46.7-10.el9.x86_64. 5.3 MB/s | 2.0 MB 00:00 2024-06-04T15:49:54.413 INFO:teuthology.orchestra.run.smithi144.stdout:(254/283): python3-cherrypy-18.6.1-2.el9.noarch 3.2 MB/s | 358 kB 00:00 2024-06-04T15:49:54.420 INFO:teuthology.orchestra.run.smithi177.stdout:(266/283): python3-portend-3.1.0-2.el9.noarch.r 660 kB/s | 16 kB 00:00 2024-06-04T15:49:54.446 INFO:teuthology.orchestra.run.smithi177.stdout:(267/283): python3-pecan-1.4.2-3.el9.noarch.rpm 2.9 MB/s | 272 kB 00:00 2024-06-04T15:49:54.464 INFO:teuthology.orchestra.run.smithi144.stdout:(255/283): python3-grpcio-tools-1.46.7-10.el9.x 2.8 MB/s | 144 kB 00:00 2024-06-04T15:49:54.471 INFO:teuthology.orchestra.run.smithi177.stdout:(268/283): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.7 MB/s | 90 kB 00:00 2024-06-04T15:49:54.489 INFO:teuthology.orchestra.run.smithi144.stdout:(256/283): python3-jaraco-8.2.1-3.el9.noarch.rp 428 kB/s | 11 kB 00:00 2024-06-04T15:49:54.496 INFO:teuthology.orchestra.run.smithi177.stdout:(269/283): python3-repoze-lru-0.7-16.el9.noarch 611 kB/s | 31 kB 00:00 2024-06-04T15:49:54.530 INFO:teuthology.orchestra.run.smithi177.stdout:(270/283): python3-kubernetes-26.1.0-2.el9.noar 3.5 MB/s | 1.0 MB 00:00 2024-06-04T15:49:54.547 INFO:teuthology.orchestra.run.smithi177.stdout:(271/283): python3-rsa-4.9-2.el9.noarch.rpm 1.1 MB/s | 59 kB 00:00 2024-06-04T15:49:54.556 INFO:teuthology.orchestra.run.smithi144.stdout:(257/283): libarrow-9.0.0-11.el9.x86_64.rpm 7.1 MB/s | 4.4 MB 00:00 2024-06-04T15:49:54.564 INFO:teuthology.orchestra.run.smithi177.stdout:(272/283): python3-tempora-5.0.0-2.el9.noarch.r 1.0 MB/s | 36 kB 00:00 2024-06-04T15:49:54.589 INFO:teuthology.orchestra.run.smithi177.stdout:(273/283): python3-routes-2.5.1-5.el9.noarch.rp 1.6 MB/s | 188 kB 00:00 2024-06-04T15:49:54.590 INFO:teuthology.orchestra.run.smithi144.stdout:(258/283): python3-jaraco-classes-3.2.1-5.el9.n 176 kB/s | 18 kB 00:00 2024-06-04T15:49:54.615 INFO:teuthology.orchestra.run.smithi177.stdout:(274/283): python3-typing-extensions-4.4.0-2.el 759 kB/s | 51 kB 00:00 2024-06-04T15:49:54.615 INFO:teuthology.orchestra.run.smithi144.stdout:(259/283): python3-jaraco-collections-3.0.0-8.e 393 kB/s | 23 kB 00:00 2024-06-04T15:49:54.640 INFO:teuthology.orchestra.run.smithi177.stdout:(275/283): python3-websocket-client-1.2.3-2.el9 1.7 MB/s | 90 kB 00:00 2024-06-04T15:49:54.641 INFO:teuthology.orchestra.run.smithi144.stdout:(260/283): python3-jaraco-functools-3.5.0-2.el9 384 kB/s | 19 kB 00:00 2024-06-04T15:49:54.665 INFO:teuthology.orchestra.run.smithi177.stdout:(276/283): python3-webob-1.8.7-6.el9.noarch.rpm 2.2 MB/s | 230 kB 00:00 2024-06-04T15:49:54.666 INFO:teuthology.orchestra.run.smithi144.stdout:(261/283): python3-jaraco-text-3.2.0-6.el9.noar 392 kB/s | 20 kB 00:00 2024-06-04T15:49:54.690 INFO:teuthology.orchestra.run.smithi177.stdout:(277/283): python3-zc-lockfile-2.0-10.el9.noarc 398 kB/s | 20 kB 00:00 2024-06-04T15:49:54.700 INFO:teuthology.orchestra.run.smithi144.stdout:(262/283): python3-logutils-0.3.5-21.el9.noarch 1.4 MB/s | 46 kB 00:00 2024-06-04T15:49:54.716 INFO:teuthology.orchestra.run.smithi177.stdout:(278/283): python3-werkzeug-2.0.3-3.el9.1.noarc 4.1 MB/s | 427 kB 00:00 2024-06-04T15:49:54.733 INFO:teuthology.orchestra.run.smithi144.stdout:(263/283): python3-more-itertools-8.12.0-2.el9. 2.3 MB/s | 79 kB 00:00 2024-06-04T15:49:54.741 INFO:teuthology.orchestra.run.smithi177.stdout:(279/283): re2-20211101-3.el9.x86_64.rpm 2.5 MB/s | 192 kB 00:00 2024-06-04T15:49:54.766 INFO:teuthology.orchestra.run.smithi177.stdout:(280/283): s3cmd-2.4.0-1.el9.noarch.rpm 2.7 MB/s | 206 kB 00:00 2024-06-04T15:49:54.784 INFO:teuthology.orchestra.run.smithi144.stdout:(264/283): python3-grpcio-1.46.7-10.el9.x86_64. 5.2 MB/s | 2.0 MB 00:00 2024-06-04T15:49:54.809 INFO:teuthology.orchestra.run.smithi144.stdout:(265/283): python3-natsort-7.1.1-5.el9.noarch.r 765 kB/s | 58 kB 00:00 2024-06-04T15:49:54.834 INFO:teuthology.orchestra.run.smithi144.stdout:(266/283): python3-pecan-1.4.2-3.el9.noarch.rpm 5.3 MB/s | 272 kB 00:00 2024-06-04T15:49:54.860 INFO:teuthology.orchestra.run.smithi144.stdout:(267/283): python3-portend-3.1.0-2.el9.noarch.r 327 kB/s | 16 kB 00:00 2024-06-04T15:49:54.866 INFO:teuthology.orchestra.run.smithi177.stdout:(281/283): thrift-0.15.0-2.el9.x86_64.rpm 11 MB/s | 1.6 MB 00:00 2024-06-04T15:49:54.885 INFO:teuthology.orchestra.run.smithi144.stdout:(268/283): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.7 MB/s | 90 kB 00:00 2024-06-04T15:49:54.934 INFO:teuthology.orchestra.run.smithi144.stdout:(269/283): python3-kubernetes-26.1.0-2.el9.noar 3.5 MB/s | 1.0 MB 00:00 2024-06-04T15:49:54.960 INFO:teuthology.orchestra.run.smithi144.stdout:(270/283): python3-repoze-lru-0.7-16.el9.noarch 306 kB/s | 31 kB 00:00 2024-06-04T15:49:54.986 INFO:teuthology.orchestra.run.smithi144.stdout:(271/283): python3-rsa-4.9-2.el9.noarch.rpm 1.1 MB/s | 59 kB 00:00 2024-06-04T15:49:55.011 INFO:teuthology.orchestra.run.smithi144.stdout:(272/283): python3-tempora-5.0.0-2.el9.noarch.r 711 kB/s | 36 kB 00:00 2024-06-04T15:49:55.036 INFO:teuthology.orchestra.run.smithi144.stdout:(273/283): python3-typing-extensions-4.4.0-2.el 1.0 MB/s | 51 kB 00:00 2024-06-04T15:49:55.062 INFO:teuthology.orchestra.run.smithi144.stdout:(274/283): python3-routes-2.5.1-5.el9.noarch.rp 1.0 MB/s | 188 kB 00:00 2024-06-04T15:49:55.087 INFO:teuthology.orchestra.run.smithi144.stdout:(275/283): python3-websocket-client-1.2.3-2.el9 1.7 MB/s | 90 kB 00:00 2024-06-04T15:49:55.112 INFO:teuthology.orchestra.run.smithi144.stdout:(276/283): python3-webob-1.8.7-6.el9.noarch.rpm 2.2 MB/s | 230 kB 00:00 2024-06-04T15:49:55.129 INFO:teuthology.orchestra.run.smithi144.stdout:(277/283): python3-zc-lockfile-2.0-10.el9.noarc 478 kB/s | 20 kB 00:00 2024-06-04T15:49:55.155 INFO:teuthology.orchestra.run.smithi144.stdout:(278/283): re2-20211101-3.el9.x86_64.rpm 4.5 MB/s | 192 kB 00:00 2024-06-04T15:49:55.175 INFO:teuthology.orchestra.run.smithi177.stdout:(282/283): librbd1-19.0.0-4027.g65533a90.el9.x8 7.7 MB/s | 3.1 MB 00:00 2024-06-04T15:49:55.180 INFO:teuthology.orchestra.run.smithi144.stdout:(279/283): s3cmd-2.4.0-1.el9.noarch.rpm 4.0 MB/s | 206 kB 00:00 2024-06-04T15:49:55.213 INFO:teuthology.orchestra.run.smithi144.stdout:(280/283): python3-werkzeug-2.0.3-3.el9.1.noarc 2.8 MB/s | 427 kB 00:00 2024-06-04T15:49:55.264 INFO:teuthology.orchestra.run.smithi144.stdout:(281/283): thrift-0.15.0-2.el9.x86_64.rpm 15 MB/s | 1.6 MB 00:00 2024-06-04T15:49:55.505 INFO:teuthology.orchestra.run.smithi144.stdout:(282/283): librados2-19.0.0-4027.g65533a90.el9. 10 MB/s | 3.4 MB 00:00 2024-06-04T15:49:55.567 INFO:teuthology.orchestra.run.smithi177.stdout:(283/283): librados2-19.0.0-4027.g65533a90.el9. 4.1 MB/s | 3.4 MB 00:00 2024-06-04T15:49:55.573 INFO:teuthology.orchestra.run.smithi177.stdout:-------------------------------------------------------------------------------- 2024-06-04T15:49:55.573 INFO:teuthology.orchestra.run.smithi177.stdout:Total 16 MB/s | 304 MB 00:19 2024-06-04T15:49:55.689 INFO:teuthology.orchestra.run.smithi144.stdout:(283/283): librbd1-19.0.0-4027.g65533a90.el9.x8 6.6 MB/s | 3.1 MB 00:00 2024-06-04T15:49:55.696 INFO:teuthology.orchestra.run.smithi144.stdout:-------------------------------------------------------------------------------- 2024-06-04T15:49:55.696 INFO:teuthology.orchestra.run.smithi144.stdout:Total 15 MB/s | 304 MB 00:20 2024-06-04T15:49:58.622 INFO:teuthology.orchestra.run.smithi177.stdout:Running transaction check 2024-06-04T15:49:58.753 INFO:teuthology.orchestra.run.smithi144.stdout:Running transaction check 2024-06-04T15:49:58.804 INFO:teuthology.orchestra.run.smithi177.stdout:Transaction check succeeded. 2024-06-04T15:49:58.804 INFO:teuthology.orchestra.run.smithi177.stdout:Running transaction test 2024-06-04T15:49:58.933 INFO:teuthology.orchestra.run.smithi144.stdout:Transaction check succeeded. 2024-06-04T15:49:58.933 INFO:teuthology.orchestra.run.smithi144.stdout:Running transaction test 2024-06-04T15:50:01.665 INFO:teuthology.orchestra.run.smithi177.stdout:Transaction test succeeded. 2024-06-04T15:50:01.667 INFO:teuthology.orchestra.run.smithi177.stdout:Running transaction 2024-06-04T15:50:01.879 INFO:teuthology.orchestra.run.smithi144.stdout:Transaction test succeeded. 2024-06-04T15:50:01.880 INFO:teuthology.orchestra.run.smithi144.stdout:Running transaction 2024-06-04T15:50:11.490 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: copy-jdk-configs-4.0-3.el9.noarch 1/1 2024-06-04T15:50:11.646 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86_64 1/1 2024-06-04T15:50:11.799 INFO:teuthology.orchestra.run.smithi177.stdout: Preparing : 1/1 2024-06-04T15:50:11.850 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: copy-jdk-configs-4.0-3.el9.noarch 1/1 2024-06-04T15:50:11.881 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : javapackages-filesystem-6.0.0-4.el9.noarch 1/285 2024-06-04T15:50:11.908 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : libogg-2:1.3.4-6.el9.x86_64 2/285 2024-06-04T15:50:11.984 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : libXi-1.7.10-8.el9.x86_64 3/285 2024-06-04T15:50:11.995 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86_64 1/1 2024-06-04T15:50:12.024 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : alsa-lib-1.2.10-2.el9.x86_64 4/285 2024-06-04T15:50:12.086 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : libvorbis-1:1.3.7-5.el9.x86_64 5/285 2024-06-04T15:50:12.127 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/285 2024-06-04T15:50:12.150 INFO:teuthology.orchestra.run.smithi144.stdout: Preparing : 1/1 2024-06-04T15:50:12.152 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 7/285 2024-06-04T15:50:12.203 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 8/285 2024-06-04T15:50:12.224 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : javapackages-filesystem-6.0.0-4.el9.noarch 1/285 2024-06-04T15:50:12.261 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libogg-2:1.3.4-6.el9.x86_64 2/285 2024-06-04T15:50:12.337 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libXi-1.7.10-8.el9.x86_64 3/285 2024-06-04T15:50:12.376 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : alsa-lib-1.2.10-2.el9.x86_64 4/285 2024-06-04T15:50:12.435 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libvorbis-1:1.3.7-5.el9.x86_64 5/285 2024-06-04T15:50:12.471 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/285 2024-06-04T15:50:12.497 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 7/285 2024-06-04T15:50:12.531 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 9/285 2024-06-04T15:50:12.562 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 8/285 2024-06-04T15:50:12.645 INFO:teuthology.orchestra.run.smithi177.stdout: Upgrading : librados2-2:19.0.0-4027.g65533a90.el9.x86_64 10/285 2024-06-04T15:50:12.767 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: librados2-2:19.0.0-4027.g65533a90.el9.x86_64 10/285 2024-06-04T15:50:12.796 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : libcephfs2-2:19.0.0-4027.g65533a90.el9.x86_64 11/285 2024-06-04T15:50:12.887 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 9/285 2024-06-04T15:50:12.888 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: libcephfs2-2:19.0.0-4027.g65533a90.el9.x86_64 11/285 2024-06-04T15:50:12.916 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-rados-2:19.0.0-4027.g65533a90.el9.x86_64 12/285 2024-06-04T15:50:12.956 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : libwayland-client-1.21.0-1.el9.x86_64 13/285 2024-06-04T15:50:12.995 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 14/285 2024-06-04T15:50:13.007 INFO:teuthology.orchestra.run.smithi144.stdout: Upgrading : librados2-2:19.0.0-4027.g65533a90.el9.x86_64 10/285 2024-06-04T15:50:13.026 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 15/285 2024-06-04T15:50:13.052 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : libXfixes-5.0.3-16.el9.x86_64 16/285 2024-06-04T15:50:13.084 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : opus-1.3.1-10.el9.x86_64 17/285 2024-06-04T15:50:13.110 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : lua-5.4.4-4.el9.x86_64 18/285 2024-06-04T15:50:13.130 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: librados2-2:19.0.0-4027.g65533a90.el9.x86_64 10/285 2024-06-04T15:50:13.148 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : libX11-xcb-1.7.0-9.el9.x86_64 19/285 2024-06-04T15:50:13.159 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libcephfs2-2:19.0.0-4027.g65533a90.el9.x86_64 11/285 2024-06-04T15:50:13.253 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: libcephfs2-2:19.0.0-4027.g65533a90.el9.x86_64 11/285 2024-06-04T15:50:13.279 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-rados-2:19.0.0-4027.g65533a90.el9.x86_64 12/285 2024-06-04T15:50:13.281 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : lcms2-2.12-3.el9.x86_64 20/285 2024-06-04T15:50:13.318 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libwayland-client-1.21.0-1.el9.x86_64 13/285 2024-06-04T15:50:13.355 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 14/285 2024-06-04T15:50:13.381 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 15/285 2024-06-04T15:50:13.406 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libXfixes-5.0.3-16.el9.x86_64 16/285 2024-06-04T15:50:13.421 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : gstreamer1-1.22.1-2.el9.x86_64 21/285 2024-06-04T15:50:13.430 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : opus-1.3.1-10.el9.x86_64 17/285 2024-06-04T15:50:13.456 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : lua-5.4.4-4.el9.x86_64 18/285 2024-06-04T15:50:13.462 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : atk-2.36.0-5.el9.x86_64 22/285 2024-06-04T15:50:13.493 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libX11-xcb-1.7.0-9.el9.x86_64 19/285 2024-06-04T15:50:13.514 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : libwayland-cursor-1.21.0-1.el9.x86_64 23/285 2024-06-04T15:50:13.543 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : libcephsqlite-2:19.0.0-4027.g65533a90.el9.x86_64 24/285 2024-06-04T15:50:13.628 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : lcms2-2.12-3.el9.x86_64 20/285 2024-06-04T15:50:13.647 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: libcephsqlite-2:19.0.0-4027.g65533a90.el9.x86_64 24/285 2024-06-04T15:50:13.669 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : libradosstriper1-2:19.0.0-4027.g65533a90.el9.x86 25/285 2024-06-04T15:50:13.731 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: libradosstriper1-2:19.0.0-4027.g65533a90.el9.x86 25/285 2024-06-04T15:50:13.755 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : gstreamer1-1.22.1-2.el9.x86_64 21/285 2024-06-04T15:50:13.756 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : libXtst-1.2.3-16.el9.x86_64 26/285 2024-06-04T15:50:13.779 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 27/285 2024-06-04T15:50:13.790 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : atk-2.36.0-5.el9.x86_64 22/285 2024-06-04T15:50:13.799 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 27/285 2024-06-04T15:50:13.826 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libwayland-cursor-1.21.0-1.el9.x86_64 23/285 2024-06-04T15:50:13.855 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libcephsqlite-2:19.0.0-4027.g65533a90.el9.x86_64 24/285 2024-06-04T15:50:13.948 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 28/285 2024-06-04T15:50:13.960 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: libcephsqlite-2:19.0.0-4027.g65533a90.el9.x86_64 24/285 2024-06-04T15:50:13.978 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 28/285 2024-06-04T15:50:13.989 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libradosstriper1-2:19.0.0-4027.g65533a90.el9.x86 25/285 2024-06-04T15:50:14.052 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: libradosstriper1-2:19.0.0-4027.g65533a90.el9.x86 25/285 2024-06-04T15:50:14.077 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libXtst-1.2.3-16.el9.x86_64 26/285 2024-06-04T15:50:14.085 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : re2-1:20211101-3.el9.x86_64 29/285 2024-06-04T15:50:14.099 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 27/285 2024-06-04T15:50:14.125 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 27/285 2024-06-04T15:50:14.126 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 30/285 2024-06-04T15:50:14.161 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : liboath-2.6.7-2.el9.x86_64 31/285 2024-06-04T15:50:14.227 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 32/285 2024-06-04T15:50:14.271 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 33/285 2024-06-04T15:50:14.303 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-packaging-20.9-5.el9.noarch 34/285 2024-06-04T15:50:14.319 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 28/285 2024-06-04T15:50:14.346 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 35/285 2024-06-04T15:50:14.349 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 28/285 2024-06-04T15:50:14.381 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 36/285 2024-06-04T15:50:14.404 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : mesa-libglapi-23.3.3-1.el9.x86_64 37/285 2024-06-04T15:50:14.431 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : libxshmfence-1.3-10.el9.x86_64 38/285 2024-06-04T15:50:14.456 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : libwayland-server-1.21.0-1.el9.x86_64 39/285 2024-06-04T15:50:14.457 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : re2-1:20211101-3.el9.x86_64 29/285 2024-06-04T15:50:14.481 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : libwayland-egl-1.21.0-1.el9.x86_64 40/285 2024-06-04T15:50:14.511 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : libtool-ltdl-2.4.6-45.el9.x86_64 41/285 2024-06-04T15:50:14.522 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 30/285 2024-06-04T15:50:14.542 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : libglvnd-1:1.3.4-1.el9.x86_64 42/285 2024-06-04T15:50:14.567 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : libXcomposite-0.4.5-7.el9.x86_64 43/285 2024-06-04T15:50:14.630 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 44/285 2024-06-04T15:50:14.657 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : dconf-0.40.0-6.el9.x86_64 45/285 2024-06-04T15:50:14.660 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : liboath-2.6.7-2.el9.x86_64 31/285 2024-06-04T15:50:14.721 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: dconf-0.40.0-6.el9.x86_64 45/285 2024-06-04T15:50:14.783 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 46/285 2024-06-04T15:50:14.814 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 47/285 2024-06-04T15:50:14.825 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 32/285 2024-06-04T15:50:14.857 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 48/285 2024-06-04T15:50:14.893 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 49/285 2024-06-04T15:50:14.926 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : fuse-2.9.9-15.el9.x86_64 50/285 2024-06-04T15:50:14.933 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 33/285 2024-06-04T15:50:14.974 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-packaging-20.9-5.el9.noarch 34/285 2024-06-04T15:50:15.001 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : cups-libs-1:2.3.3op2-26.el9.x86_64 51/285 2024-06-04T15:50:15.017 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 35/285 2024-06-04T15:50:15.036 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-ceph-common-2:19.0.0-4027.g65533a90.el9. 52/285 2024-06-04T15:50:15.042 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 36/285 2024-06-04T15:50:15.067 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : mesa-libglapi-23.3.3-1.el9.x86_64 37/285 2024-06-04T15:50:15.079 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-ceph-argparse-2:19.0.0-4027.g65533a90.el 53/285 2024-06-04T15:50:15.093 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libxshmfence-1.3-10.el9.x86_64 38/285 2024-06-04T15:50:15.118 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libwayland-server-1.21.0-1.el9.x86_64 39/285 2024-06-04T15:50:15.121 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-cephfs-2:19.0.0-4027.g65533a90.el9.x86_6 54/285 2024-06-04T15:50:15.144 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libwayland-egl-1.21.0-1.el9.x86_64 40/285 2024-06-04T15:50:15.173 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libtool-ltdl-2.4.6-45.el9.x86_64 41/285 2024-06-04T15:50:15.196 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 55/285 2024-06-04T15:50:15.204 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libglvnd-1:1.3.4-1.el9.x86_64 42/285 2024-06-04T15:50:15.230 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libXcomposite-0.4.5-7.el9.x86_64 43/285 2024-06-04T15:50:15.275 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 44/285 2024-06-04T15:50:15.312 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : dconf-0.40.0-6.el9.x86_64 45/285 2024-06-04T15:50:15.341 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 56/285 2024-06-04T15:50:15.379 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: dconf-0.40.0-6.el9.x86_64 45/285 2024-06-04T15:50:15.399 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 57/285 2024-06-04T15:50:15.437 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 46/285 2024-06-04T15:50:15.468 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 47/285 2024-06-04T15:50:15.511 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 48/285 2024-06-04T15:50:15.547 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 49/285 2024-06-04T15:50:15.580 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : fuse-2.9.9-15.el9.x86_64 50/285 2024-06-04T15:50:15.657 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : cups-libs-1:2.3.3op2-26.el9.x86_64 51/285 2024-06-04T15:50:15.690 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-ceph-common-2:19.0.0-4027.g65533a90.el9. 52/285 2024-06-04T15:50:15.745 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-ceph-argparse-2:19.0.0-4027.g65533a90.el 53/285 2024-06-04T15:50:15.784 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-cephfs-2:19.0.0-4027.g65533a90.el9.x86_6 54/285 2024-06-04T15:50:15.860 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 55/285 2024-06-04T15:50:15.934 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-rsa-4.9-2.el9.noarch 58/285 2024-06-04T15:50:16.001 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 56/285 2024-06-04T15:50:16.013 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 59/285 2024-06-04T15:50:16.048 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 60/285 2024-06-04T15:50:16.073 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 57/285 2024-06-04T15:50:16.127 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 61/285 2024-06-04T15:50:16.171 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : at-spi2-core-2.40.3-1.el9.x86_64 62/285 2024-06-04T15:50:16.207 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : at-spi2-atk-2.38.0-4.el9.x86_64 63/285 2024-06-04T15:50:16.236 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : colord-libs-1.4.5-4.el9.x86_64 64/285 2024-06-04T15:50:16.323 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 65/285 2024-06-04T15:50:16.364 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : luarocks-3.9.2-5.el9.noarch 66/285 2024-06-04T15:50:16.396 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : libXcursor-1.2.0-7.el9.x86_64 67/285 2024-06-04T15:50:16.432 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : libXdamage-1.1.5-7.el9.x86_64 68/285 2024-06-04T15:50:16.472 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : librados-devel-2:19.0.0-4027.g65533a90.el9.x86_6 69/285 2024-06-04T15:50:16.504 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 70/285 2024-06-04T15:50:16.537 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : flac-libs-1.3.3-12.el9.x86_64 71/285 2024-06-04T15:50:16.579 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : libtheora-1:1.1.1-31.el9.x86_64 72/285 2024-06-04T15:50:16.607 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-rsa-4.9-2.el9.noarch 58/285 2024-06-04T15:50:16.645 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : exiv2-libs-0.27.5-2.el9.x86_64 73/285 2024-06-04T15:50:16.688 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : exiv2-0.27.5-2.el9.x86_64 74/285 2024-06-04T15:50:16.692 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 59/285 2024-06-04T15:50:16.725 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : libgexiv2-0.12.3-1.el9.x86_64 75/285 2024-06-04T15:50:16.727 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 60/285 2024-06-04T15:50:16.814 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 61/285 2024-06-04T15:50:16.818 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 76/285 2024-06-04T15:50:16.849 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : at-spi2-core-2.40.3-1.el9.x86_64 62/285 2024-06-04T15:50:16.875 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 77/285 2024-06-04T15:50:16.886 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : at-spi2-atk-2.38.0-4.el9.x86_64 63/285 2024-06-04T15:50:16.915 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : colord-libs-1.4.5-4.el9.x86_64 64/285 2024-06-04T15:50:16.947 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 78/285 2024-06-04T15:50:16.985 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 79/285 2024-06-04T15:50:16.985 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 65/285 2024-06-04T15:50:17.017 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : luarocks-3.9.2-5.el9.noarch 66/285 2024-06-04T15:50:17.021 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 80/285 2024-06-04T15:50:17.050 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libXcursor-1.2.0-7.el9.x86_64 67/285 2024-06-04T15:50:17.068 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 81/285 2024-06-04T15:50:17.086 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libXdamage-1.1.5-7.el9.x86_64 68/285 2024-06-04T15:50:17.121 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 82/285 2024-06-04T15:50:17.124 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : librados-devel-2:19.0.0-4027.g65533a90.el9.x86_6 69/285 2024-06-04T15:50:17.163 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 70/285 2024-06-04T15:50:17.164 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 83/285 2024-06-04T15:50:17.197 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : flac-libs-1.3.3-12.el9.x86_64 71/285 2024-06-04T15:50:17.239 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libtheora-1:1.1.1-31.el9.x86_64 72/285 2024-06-04T15:50:17.297 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : exiv2-libs-0.27.5-2.el9.x86_64 73/285 2024-06-04T15:50:17.302 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 84/285 2024-06-04T15:50:17.332 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : exiv2-0.27.5-2.el9.x86_64 74/285 2024-06-04T15:50:17.348 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 85/285 2024-06-04T15:50:17.368 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libgexiv2-0.12.3-1.el9.x86_64 75/285 2024-06-04T15:50:17.390 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 86/285 2024-06-04T15:50:17.461 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 76/285 2024-06-04T15:50:17.486 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 87/285 2024-06-04T15:50:17.524 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 88/285 2024-06-04T15:50:17.525 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 77/285 2024-06-04T15:50:17.564 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 89/285 2024-06-04T15:50:17.598 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 78/285 2024-06-04T15:50:17.605 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 90/285 2024-06-04T15:50:17.629 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 79/285 2024-06-04T15:50:17.629 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 91/285 2024-06-04T15:50:17.665 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 80/285 2024-06-04T15:50:17.712 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 81/285 2024-06-04T15:50:17.714 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 92/285 2024-06-04T15:50:17.758 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 82/285 2024-06-04T15:50:17.799 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 83/285 2024-06-04T15:50:17.850 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 93/285 2024-06-04T15:50:17.890 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 94/285 2024-06-04T15:50:17.937 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 84/285 2024-06-04T15:50:17.976 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 85/285 2024-06-04T15:50:18.017 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 86/285 2024-06-04T15:50:18.095 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 95/285 2024-06-04T15:50:18.113 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 87/285 2024-06-04T15:50:18.141 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : xkeyboard-config-2.33-2.el9.noarch 96/285 2024-06-04T15:50:18.160 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 88/285 2024-06-04T15:50:18.173 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : libxkbcommon-1.0.3-4.el9.x86_64 97/285 2024-06-04T15:50:18.201 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 89/285 2024-06-04T15:50:18.202 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : xdg-dbus-proxy-0.1.3-1.el9.x86_64 98/285 2024-06-04T15:50:18.234 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 90/285 2024-06-04T15:50:18.244 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : webrtc-audio-processing-0.3.1-8.el9.x86_64 99/285 2024-06-04T15:50:18.258 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 91/285 2024-06-04T15:50:18.272 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : upower-0.99.11-11.el9.x86_64 100/285 2024-06-04T15:50:18.286 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: upower-0.99.11-11.el9.x86_64 100/285 2024-06-04T15:50:18.287 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/system/graphical.target.wants/upower.service → /usr/lib/systemd/system/upower.service. 2024-06-04T15:50:18.287 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-06-04T15:50:18.339 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 92/285 2024-06-04T15:50:18.460 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 93/285 2024-06-04T15:50:18.468 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : tzdata-java-2024a-2.el9.noarch 101/285 2024-06-04T15:50:18.493 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 94/285 2024-06-04T15:50:18.540 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : ttmkfdir-3.0.9-65.el9.x86_64 102/285 2024-06-04T15:50:18.595 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : totem-pl-parser-3.26.6-2.el9.x86_64 103/285 2024-06-04T15:50:18.620 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : sound-theme-freedesktop-0.8-17.el9.noarch 104/285 2024-06-04T15:50:18.648 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: sound-theme-freedesktop-0.8-17.el9.noarch 104/285 2024-06-04T15:50:18.680 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 105/285 2024-06-04T15:50:18.717 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 95/285 2024-06-04T15:50:18.761 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : xkeyboard-config-2.33-2.el9.noarch 96/285 2024-06-04T15:50:18.793 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libxkbcommon-1.0.3-4.el9.x86_64 97/285 2024-06-04T15:50:18.823 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : xdg-dbus-proxy-0.1.3-1.el9.x86_64 98/285 2024-06-04T15:50:18.864 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : webrtc-audio-processing-0.3.1-8.el9.x86_64 99/285 2024-06-04T15:50:18.893 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : upower-0.99.11-11.el9.x86_64 100/285 2024-06-04T15:50:18.906 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: upower-0.99.11-11.el9.x86_64 100/285 2024-06-04T15:50:18.907 INFO:teuthology.orchestra.run.smithi144.stdout:Created symlink /etc/systemd/system/graphical.target.wants/upower.service → /usr/lib/systemd/system/upower.service. 2024-06-04T15:50:18.907 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T15:50:19.027 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: rtkit-0.11-28.el9.x86_64 106/285 2024-06-04T15:50:19.058 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : rtkit-0.11-28.el9.x86_64 106/285 2024-06-04T15:50:19.071 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: rtkit-0.11-28.el9.x86_64 106/285 2024-06-04T15:50:19.071 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/system/graphical.target.wants/rtkit-daemon.service → /usr/lib/systemd/system/rtkit-daemon.service. 2024-06-04T15:50:19.071 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-06-04T15:50:19.089 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : tzdata-java-2024a-2.el9.noarch 101/285 2024-06-04T15:50:19.114 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 107/285 2024-06-04T15:50:19.149 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 108/285 2024-06-04T15:50:19.175 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ttmkfdir-3.0.9-65.el9.x86_64 102/285 2024-06-04T15:50:19.182 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 109/285 2024-06-04T15:50:19.224 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 110/285 2024-06-04T15:50:19.224 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : totem-pl-parser-3.26.6-2.el9.x86_64 103/285 2024-06-04T15:50:19.258 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 111/285 2024-06-04T15:50:19.258 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : sound-theme-freedesktop-0.8-17.el9.noarch 104/285 2024-06-04T15:50:19.282 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: sound-theme-freedesktop-0.8-17.el9.noarch 104/285 2024-06-04T15:50:19.309 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 105/285 2024-06-04T15:50:19.347 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 112/285 2024-06-04T15:50:19.397 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 113/285 2024-06-04T15:50:19.428 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 114/285 2024-06-04T15:50:19.532 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 115/285 2024-06-04T15:50:19.588 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 116/285 2024-06-04T15:50:19.770 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: rtkit-0.11-28.el9.x86_64 106/285 2024-06-04T15:50:19.797 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : rtkit-0.11-28.el9.x86_64 106/285 2024-06-04T15:50:19.808 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: rtkit-0.11-28.el9.x86_64 106/285 2024-06-04T15:50:19.808 INFO:teuthology.orchestra.run.smithi144.stdout:Created symlink /etc/systemd/system/graphical.target.wants/rtkit-daemon.service → /usr/lib/systemd/system/rtkit-daemon.service. 2024-06-04T15:50:19.808 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T15:50:19.852 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 107/285 2024-06-04T15:50:19.887 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 108/285 2024-06-04T15:50:19.920 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 109/285 2024-06-04T15:50:19.961 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 110/285 2024-06-04T15:50:19.996 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 111/285 2024-06-04T15:50:20.083 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 112/285 2024-06-04T15:50:20.127 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 113/285 2024-06-04T15:50:20.158 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 114/285 2024-06-04T15:50:20.261 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 115/285 2024-06-04T15:50:20.326 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 117/285 2024-06-04T15:50:20.334 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 116/285 2024-06-04T15:50:20.376 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 118/285 2024-06-04T15:50:20.409 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 119/285 2024-06-04T15:50:20.519 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 120/285 2024-06-04T15:50:20.563 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 121/285 2024-06-04T15:50:20.752 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : publicsuffix-list-20210518-3.el9.noarch 122/285 2024-06-04T15:50:20.799 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : poppler-data-0.4.9-9.el9.noarch 123/285 2024-06-04T15:50:20.848 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : p11-kit-server-0.25.3-2.el9.x86_64 124/285 2024-06-04T15:50:21.077 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 117/285 2024-06-04T15:50:21.122 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 118/285 2024-06-04T15:50:21.156 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 119/285 2024-06-04T15:50:21.256 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 120/285 2024-06-04T15:50:21.292 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 121/285 2024-06-04T15:50:21.337 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : osinfo-db-tools-1.10.0-1.el9.x86_64 125/285 2024-06-04T15:50:21.409 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : osinfo-db-20231215-1.el9.noarch 126/285 2024-06-04T15:50:21.452 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : libosinfo-1.10.0-1.el9.x86_64 127/285 2024-06-04T15:50:21.485 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : publicsuffix-list-20210518-3.el9.noarch 122/285 2024-06-04T15:50:21.486 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : orc-0.4.31-6.el9.x86_64 128/285 2024-06-04T15:50:21.519 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : openjpeg2-2.4.0-7.el9.x86_64 129/285 2024-06-04T15:50:21.529 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : poppler-data-0.4.9-9.el9.noarch 123/285 2024-06-04T15:50:21.580 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : p11-kit-server-0.25.3-2.el9.x86_64 124/285 2024-06-04T15:50:21.705 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : openblas-0.3.21-2.el9.x86_64 130/285 2024-06-04T15:50:21.733 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 131/285 2024-06-04T15:50:21.822 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 132/285 2024-06-04T15:50:22.081 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : osinfo-db-tools-1.10.0-1.el9.x86_64 125/285 2024-06-04T15:50:22.143 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : osinfo-db-20231215-1.el9.noarch 126/285 2024-06-04T15:50:22.184 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libosinfo-1.10.0-1.el9.x86_64 127/285 2024-06-04T15:50:22.218 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : orc-0.4.31-6.el9.x86_64 128/285 2024-06-04T15:50:22.250 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : openjpeg2-2.4.0-7.el9.x86_64 129/285 2024-06-04T15:50:22.426 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : openblas-0.3.21-2.el9.x86_64 130/285 2024-06-04T15:50:22.464 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 131/285 2024-06-04T15:50:22.509 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 133/285 2024-06-04T15:50:22.546 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 132/285 2024-06-04T15:50:22.633 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 134/285 2024-06-04T15:50:23.224 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 133/285 2024-06-04T15:50:23.347 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 134/285 2024-06-04T15:50:23.907 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 135/285 2024-06-04T15:50:24.018 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 136/285 2024-06-04T15:50:24.053 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : lua-posix-35.0-8.el9.x86_64 137/285 2024-06-04T15:50:24.080 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : copy-jdk-configs-4.0-3.el9.noarch 138/285 2024-06-04T15:50:24.110 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : low-memory-monitor-2.1-4.el9.x86_64 139/285 2024-06-04T15:50:24.122 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: low-memory-monitor-2.1-4.el9.x86_64 139/285 2024-06-04T15:50:24.122 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/system/basic.target.wants/low-memory-monitor.service → /usr/lib/systemd/system/low-memory-monitor.service. 2024-06-04T15:50:24.122 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-06-04T15:50:24.168 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : libwebp-1.2.0-8.el9.x86_64 140/285 2024-06-04T15:50:24.197 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : libvisual-1:0.4.0-34.el9.x86_64 141/285 2024-06-04T15:50:24.225 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : libsbc-1.4-9.el9.x86_64 142/285 2024-06-04T15:50:24.539 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 143/285 2024-06-04T15:50:24.580 INFO:teuthology.orchestra.run.smithi177.stdout: Upgrading : librbd1-2:19.0.0-4027.g65533a90.el9.x86_64 144/285 2024-06-04T15:50:24.609 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 135/285 2024-06-04T15:50:24.687 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: librbd1-2:19.0.0-4027.g65533a90.el9.x86_64 144/285 2024-06-04T15:50:24.718 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 136/285 2024-06-04T15:50:24.719 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-rbd-2:19.0.0-4027.g65533a90.el9.x86_64 145/285 2024-06-04T15:50:24.752 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : libnotify-0.7.9-8.el9.x86_64 146/285 2024-06-04T15:50:24.769 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : lua-posix-35.0-8.el9.x86_64 137/285 2024-06-04T15:50:24.782 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : libldac-2.0.2.3-10.el9.x86_64 147/285 2024-06-04T15:50:24.796 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : copy-jdk-configs-4.0-3.el9.noarch 138/285 2024-06-04T15:50:24.817 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : low-memory-monitor-2.1-4.el9.x86_64 139/285 2024-06-04T15:50:24.829 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: low-memory-monitor-2.1-4.el9.x86_64 139/285 2024-06-04T15:50:24.829 INFO:teuthology.orchestra.run.smithi144.stdout:Created symlink /etc/systemd/system/basic.target.wants/low-memory-monitor.service → /usr/lib/systemd/system/low-memory-monitor.service. 2024-06-04T15:50:24.829 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T15:50:24.845 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : libiptcdata-1.0.5-9.el9.x86_64 148/285 2024-06-04T15:50:24.876 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libwebp-1.2.0-8.el9.x86_64 140/285 2024-06-04T15:50:24.880 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : libgsf-1.14.47-5.el9.x86_64 149/285 2024-06-04T15:50:24.905 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libvisual-1:0.4.0-34.el9.x86_64 141/285 2024-06-04T15:50:24.914 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : libfontenc-1.1.3-17.el9.x86_64 150/285 2024-06-04T15:50:24.933 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libsbc-1.4-9.el9.x86_64 142/285 2024-06-04T15:50:24.959 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : mkfontscale-1.2.1-3.el9.x86_64 151/285 2024-06-04T15:50:24.987 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : xorg-x11-fonts-Type1-7.5-33.el9.noarch 152/285 2024-06-04T15:50:25.229 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: xorg-x11-fonts-Type1-7.5-33.el9.noarch 152/285 2024-06-04T15:50:25.248 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 143/285 2024-06-04T15:50:25.278 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : libexif-0.6.22-6.el9.x86_64 153/285 2024-06-04T15:50:25.288 INFO:teuthology.orchestra.run.smithi144.stdout: Upgrading : librbd1-2:19.0.0-4027.g65533a90.el9.x86_64 144/285 2024-06-04T15:50:25.307 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : libepoxy-1.5.5-4.el9.x86_64 154/285 2024-06-04T15:50:25.337 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : libasyncns-0.8-22.el9.x86_64 155/285 2024-06-04T15:50:25.362 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : libXxf86vm-1.1.4-18.el9.x86_64 156/285 2024-06-04T15:50:25.378 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: librbd1-2:19.0.0-4027.g65533a90.el9.x86_64 144/285 2024-06-04T15:50:25.387 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : libXv-1.0.11-16.el9.x86_64 157/285 2024-06-04T15:50:25.411 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-rbd-2:19.0.0-4027.g65533a90.el9.x86_64 145/285 2024-06-04T15:50:25.412 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : libXrandr-1.5.2-8.el9.x86_64 158/285 2024-06-04T15:50:25.441 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : libXinerama-1.1.4-10.el9.x86_64 159/285 2024-06-04T15:50:25.443 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libnotify-0.7.9-8.el9.x86_64 146/285 2024-06-04T15:50:25.477 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : jbigkit-libs-2.1-23.el9.x86_64 160/285 2024-06-04T15:50:25.480 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libldac-2.0.2.3-10.el9.x86_64 147/285 2024-06-04T15:50:25.542 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : libtiff-4.4.0-12.el9.x86_64 161/285 2024-06-04T15:50:25.550 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libiptcdata-1.0.5-9.el9.x86_64 148/285 2024-06-04T15:50:25.577 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : gdk-pixbuf2-modules-2.42.6-3.el9.x86_64 162/285 2024-06-04T15:50:25.582 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libgsf-1.14.47-5.el9.x86_64 149/285 2024-06-04T15:50:25.608 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libfontenc-1.1.3-17.el9.x86_64 150/285 2024-06-04T15:50:25.625 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : libgxps-0.3.2-3.el9.x86_64 163/285 2024-06-04T15:50:25.649 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : mkfontscale-1.2.1-3.el9.x86_64 151/285 2024-06-04T15:50:25.652 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : poppler-21.01.0-20.el9.x86_64 164/285 2024-06-04T15:50:25.673 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : xorg-x11-fonts-Type1-7.5-33.el9.noarch 152/285 2024-06-04T15:50:25.919 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: xorg-x11-fonts-Type1-7.5-33.el9.noarch 152/285 2024-06-04T15:50:25.958 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libexif-0.6.22-6.el9.x86_64 153/285 2024-06-04T15:50:25.986 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libepoxy-1.5.5-4.el9.x86_64 154/285 2024-06-04T15:50:26.012 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libasyncns-0.8-22.el9.x86_64 155/285 2024-06-04T15:50:26.038 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libXxf86vm-1.1.4-18.el9.x86_64 156/285 2024-06-04T15:50:26.063 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libXv-1.0.11-16.el9.x86_64 157/285 2024-06-04T15:50:26.088 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libXrandr-1.5.2-8.el9.x86_64 158/285 2024-06-04T15:50:26.104 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : poppler-glib-21.01.0-20.el9.x86_64 165/285 2024-06-04T15:50:26.116 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libXinerama-1.1.4-10.el9.x86_64 159/285 2024-06-04T15:50:26.152 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : jbigkit-libs-2.1-23.el9.x86_64 160/285 2024-06-04T15:50:26.209 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libtiff-4.4.0-12.el9.x86_64 161/285 2024-06-04T15:50:26.238 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : iso-codes-4.6.0-3.el9.noarch 166/285 2024-06-04T15:50:26.244 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : gdk-pixbuf2-modules-2.42.6-3.el9.x86_64 162/285 2024-06-04T15:50:26.291 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : hicolor-icon-theme-0.17-13.el9.noarch 167/285 2024-06-04T15:50:26.292 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libgxps-0.3.2-3.el9.x86_64 163/285 2024-06-04T15:50:26.317 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : gtk-update-icon-cache-3.24.31-2.el9.x86_64 168/285 2024-06-04T15:50:26.319 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : poppler-21.01.0-20.el9.x86_64 164/285 2024-06-04T15:50:26.345 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : gsm-1.0.19-6.el9.x86_64 169/285 2024-06-04T15:50:26.412 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : libsndfile-1.0.31-8.el9.x86_64 170/285 2024-06-04T15:50:26.451 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : pulseaudio-libs-15.0-2.el9.x86_64 171/285 2024-06-04T15:50:26.476 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : libcanberra-0.30-27.el9.x86_64 172/285 2024-06-04T15:50:26.496 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: libcanberra-0.30-27.el9.x86_64 172/285 2024-06-04T15:50:26.521 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : graphene-1.10.6-2.el9.x86_64 173/285 2024-06-04T15:50:26.548 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : giflib-5.2.1-9.el9.x86_64 174/285 2024-06-04T15:50:26.580 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : flatpak-session-helper-1.12.8-1.el9.x86_64 175/285 2024-06-04T15:50:26.603 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : flatpak-selinux-1.12.8-1.el9.noarch 176/285 2024-06-04T15:50:26.763 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : poppler-glib-21.01.0-20.el9.x86_64 165/285 2024-06-04T15:50:26.894 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : iso-codes-4.6.0-3.el9.noarch 166/285 2024-06-04T15:50:26.942 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : hicolor-icon-theme-0.17-13.el9.noarch 167/285 2024-06-04T15:50:26.968 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : gtk-update-icon-cache-3.24.31-2.el9.x86_64 168/285 2024-06-04T15:50:26.996 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : gsm-1.0.19-6.el9.x86_64 169/285 2024-06-04T15:50:27.065 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libsndfile-1.0.31-8.el9.x86_64 170/285 2024-06-04T15:50:27.111 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : pulseaudio-libs-15.0-2.el9.x86_64 171/285 2024-06-04T15:50:27.136 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libcanberra-0.30-27.el9.x86_64 172/285 2024-06-04T15:50:27.156 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: libcanberra-0.30-27.el9.x86_64 172/285 2024-06-04T15:50:27.182 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : graphene-1.10.6-2.el9.x86_64 173/285 2024-06-04T15:50:27.208 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : giflib-5.2.1-9.el9.x86_64 174/285 2024-06-04T15:50:27.239 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : flatpak-session-helper-1.12.8-1.el9.x86_64 175/285 2024-06-04T15:50:27.255 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : flatpak-selinux-1.12.8-1.el9.noarch 176/285 2024-06-04T15:50:37.622 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: flatpak-selinux-1.12.8-1.el9.noarch 176/285 2024-06-04T15:50:37.662 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : fdk-aac-free-2.0.0-8.el9.x86_64 177/285 2024-06-04T15:50:37.690 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : exempi-2.6.0-0.2.20211007gite23c213.el9.x86_64 178/285 2024-06-04T15:50:37.727 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : composefs-libs-1.0.3-2.el9.x86_64 179/285 2024-06-04T15:50:37.756 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : ostree-libs-2024.6-1.el9.x86_64 180/285 2024-06-04T15:50:37.792 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 181/285 2024-06-04T15:50:38.306 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 182/285 2024-06-04T15:50:38.338 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : librgw2-2:19.0.0-4027.g65533a90.el9.x86_64 183/285 2024-06-04T15:50:38.419 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: librgw2-2:19.0.0-4027.g65533a90.el9.x86_64 183/285 2024-06-04T15:50:38.449 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-rgw-2:19.0.0-4027.g65533a90.el9.x86_64 184/285 2024-06-04T15:50:38.692 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: flatpak-selinux-1.12.8-1.el9.noarch 176/285 2024-06-04T15:50:38.741 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : fdk-aac-free-2.0.0-8.el9.x86_64 177/285 2024-06-04T15:50:38.786 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : exempi-2.6.0-0.2.20211007gite23c213.el9.x86_64 178/285 2024-06-04T15:50:38.823 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : composefs-libs-1.0.3-2.el9.x86_64 179/285 2024-06-04T15:50:38.852 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ostree-libs-2024.6-1.el9.x86_64 180/285 2024-06-04T15:50:38.888 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 181/285 2024-06-04T15:50:39.408 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 182/285 2024-06-04T15:50:39.443 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : librgw2-2:19.0.0-4027.g65533a90.el9.x86_64 183/285 2024-06-04T15:50:39.531 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: librgw2-2:19.0.0-4027.g65533a90.el9.x86_64 183/285 2024-06-04T15:50:39.562 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-rgw-2:19.0.0-4027.g65533a90.el9.x86_64 184/285 2024-06-04T15:50:40.746 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: ceph-common-2:19.0.0-4027.g65533a90.el9.x86_64 185/285 2024-06-04T15:50:40.788 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : ceph-common-2:19.0.0-4027.g65533a90.el9.x86_64 185/285 2024-06-04T15:50:41.346 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: ceph-common-2:19.0.0-4027.g65533a90.el9.x86_64 185/285 2024-06-04T15:50:41.397 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : ceph-base-2:19.0.0-4027.g65533a90.el9.x86_64 186/285 2024-06-04T15:50:41.494 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: ceph-base-2:19.0.0-4027.g65533a90.el9.x86_64 186/285 2024-06-04T15:50:41.494 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-06-04T15:50:41.494 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-06-04T15:50:41.495 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-06-04T15:50:41.522 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : ceph-selinux-2:19.0.0-4027.g65533a90.el9.x86_64 187/285 2024-06-04T15:50:41.840 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: ceph-common-2:19.0.0-4027.g65533a90.el9.x86_64 185/285 2024-06-04T15:50:41.873 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-common-2:19.0.0-4027.g65533a90.el9.x86_64 185/285 2024-06-04T15:50:42.435 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: ceph-common-2:19.0.0-4027.g65533a90.el9.x86_64 185/285 2024-06-04T15:50:42.479 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-base-2:19.0.0-4027.g65533a90.el9.x86_64 186/285 2024-06-04T15:50:42.570 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: ceph-base-2:19.0.0-4027.g65533a90.el9.x86_64 186/285 2024-06-04T15:50:42.570 INFO:teuthology.orchestra.run.smithi144.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-06-04T15:50:42.571 INFO:teuthology.orchestra.run.smithi144.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-06-04T15:50:42.571 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T15:50:42.596 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-selinux-2:19.0.0-4027.g65533a90.el9.x86_64 187/285 2024-06-04T15:50:50.474 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: ceph-selinux-2:19.0.0-4027.g65533a90.el9.x86_64 187/285 2024-06-04T15:50:50.474 INFO:teuthology.orchestra.run.smithi177.stdout:skipping the directory /sys 2024-06-04T15:50:50.474 INFO:teuthology.orchestra.run.smithi177.stdout:skipping the directory /proc 2024-06-04T15:50:50.474 INFO:teuthology.orchestra.run.smithi177.stdout:skipping the directory /mnt 2024-06-04T15:50:50.474 INFO:teuthology.orchestra.run.smithi177.stdout:skipping the directory /var/tmp 2024-06-04T15:50:50.474 INFO:teuthology.orchestra.run.smithi177.stdout:skipping the directory /home 2024-06-04T15:50:50.474 INFO:teuthology.orchestra.run.smithi177.stdout:skipping the directory /root 2024-06-04T15:50:50.474 INFO:teuthology.orchestra.run.smithi177.stdout:skipping the directory /tmp 2024-06-04T15:50:50.474 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-06-04T15:50:50.650 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : ceph-volume-2:19.0.0-4027.g65533a90.el9.noarch 188/285 2024-06-04T15:50:50.665 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: ceph-volume-2:19.0.0-4027.g65533a90.el9.noarch 188/285 2024-06-04T15:50:50.665 INFO:teuthology.orchestra.run.smithi177.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-04T15:50:50.666 INFO:teuthology.orchestra.run.smithi177.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-06-04T15:50:50.666 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-06-04T15:50:51.484 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: ceph-selinux-2:19.0.0-4027.g65533a90.el9.x86_64 187/285 2024-06-04T15:50:51.484 INFO:teuthology.orchestra.run.smithi144.stdout:skipping the directory /sys 2024-06-04T15:50:51.484 INFO:teuthology.orchestra.run.smithi144.stdout:skipping the directory /proc 2024-06-04T15:50:51.484 INFO:teuthology.orchestra.run.smithi144.stdout:skipping the directory /mnt 2024-06-04T15:50:51.484 INFO:teuthology.orchestra.run.smithi144.stdout:skipping the directory /var/tmp 2024-06-04T15:50:51.485 INFO:teuthology.orchestra.run.smithi144.stdout:skipping the directory /home 2024-06-04T15:50:51.485 INFO:teuthology.orchestra.run.smithi144.stdout:skipping the directory /root 2024-06-04T15:50:51.485 INFO:teuthology.orchestra.run.smithi144.stdout:skipping the directory /tmp 2024-06-04T15:50:51.485 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T15:50:51.645 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-volume-2:19.0.0-4027.g65533a90.el9.noarch 188/285 2024-06-04T15:50:51.661 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: ceph-volume-2:19.0.0-4027.g65533a90.el9.noarch 188/285 2024-06-04T15:50:51.661 INFO:teuthology.orchestra.run.smithi144.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-04T15:50:51.662 INFO:teuthology.orchestra.run.smithi144.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-06-04T15:50:51.662 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T15:50:52.109 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : ceph-osd-2:19.0.0-4027.g65533a90.el9.x86_64 189/285 2024-06-04T15:50:52.135 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: ceph-osd-2:19.0.0-4027.g65533a90.el9.x86_64 189/285 2024-06-04T15:50:52.136 INFO:teuthology.orchestra.run.smithi177.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-04T15:50:52.136 INFO:teuthology.orchestra.run.smithi177.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-06-04T15:50:52.136 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-06-04T15:50:52.136 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-06-04T15:50:52.136 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-06-04T15:50:52.359 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : ceph-mds-2:19.0.0-4027.g65533a90.el9.x86_64 190/285 2024-06-04T15:50:52.382 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: ceph-mds-2:19.0.0-4027.g65533a90.el9.x86_64 190/285 2024-06-04T15:50:52.383 INFO:teuthology.orchestra.run.smithi177.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-04T15:50:52.383 INFO:teuthology.orchestra.run.smithi177.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-06-04T15:50:52.383 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-06-04T15:50:52.383 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-06-04T15:50:52.383 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-06-04T15:50:52.818 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : ceph-mon-2:19.0.0-4027.g65533a90.el9.x86_64 191/285 2024-06-04T15:50:52.843 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: ceph-mon-2:19.0.0-4027.g65533a90.el9.x86_64 191/285 2024-06-04T15:50:52.843 INFO:teuthology.orchestra.run.smithi177.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-04T15:50:52.843 INFO:teuthology.orchestra.run.smithi177.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-06-04T15:50:52.843 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-06-04T15:50:52.843 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-06-04T15:50:52.843 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-06-04T15:50:52.945 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : avahi-glib-0.8-20.el9.x86_64 192/285 2024-06-04T15:50:53.096 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-osd-2:19.0.0-4027.g65533a90.el9.x86_64 189/285 2024-06-04T15:50:53.122 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: ceph-osd-2:19.0.0-4027.g65533a90.el9.x86_64 189/285 2024-06-04T15:50:53.122 INFO:teuthology.orchestra.run.smithi144.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-04T15:50:53.122 INFO:teuthology.orchestra.run.smithi144.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-06-04T15:50:53.123 INFO:teuthology.orchestra.run.smithi144.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-06-04T15:50:53.123 INFO:teuthology.orchestra.run.smithi144.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-06-04T15:50:53.123 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T15:50:53.346 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-mds-2:19.0.0-4027.g65533a90.el9.x86_64 190/285 2024-06-04T15:50:53.369 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: ceph-mds-2:19.0.0-4027.g65533a90.el9.x86_64 190/285 2024-06-04T15:50:53.370 INFO:teuthology.orchestra.run.smithi144.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-04T15:50:53.370 INFO:teuthology.orchestra.run.smithi144.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-06-04T15:50:53.370 INFO:teuthology.orchestra.run.smithi144.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-06-04T15:50:53.370 INFO:teuthology.orchestra.run.smithi144.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-06-04T15:50:53.370 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T15:50:53.805 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-mon-2:19.0.0-4027.g65533a90.el9.x86_64 191/285 2024-06-04T15:50:53.829 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: ceph-mon-2:19.0.0-4027.g65533a90.el9.x86_64 191/285 2024-06-04T15:50:53.829 INFO:teuthology.orchestra.run.smithi144.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-04T15:50:53.829 INFO:teuthology.orchestra.run.smithi144.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-06-04T15:50:53.829 INFO:teuthology.orchestra.run.smithi144.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-06-04T15:50:53.829 INFO:teuthology.orchestra.run.smithi144.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-06-04T15:50:53.829 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T15:50:53.923 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : avahi-glib-0.8-20.el9.x86_64 192/285 2024-06-04T15:50:55.761 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : adwaita-cursor-theme-40.1.1-3.el9.noarch 193/285 2024-06-04T15:50:55.882 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : adwaita-icon-theme-40.1.1-3.el9.noarch 194/285 2024-06-04T15:50:55.938 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-ply-3.11-14.el9.noarch 195/285 2024-06-04T15:50:56.002 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 196/285 2024-06-04T15:50:56.192 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 197/285 2024-06-04T15:50:56.245 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 198/285 2024-06-04T15:50:56.323 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 199/285 2024-06-04T15:50:56.412 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 200/285 2024-06-04T15:50:56.544 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 201/285 2024-06-04T15:50:56.579 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 202/285 2024-06-04T15:50:56.612 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 203/285 2024-06-04T15:50:56.734 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : adwaita-cursor-theme-40.1.1-3.el9.noarch 193/285 2024-06-04T15:50:56.862 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : adwaita-icon-theme-40.1.1-3.el9.noarch 194/285 2024-06-04T15:50:56.918 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-ply-3.11-14.el9.noarch 195/285 2024-06-04T15:50:56.973 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 196/285 2024-06-04T15:50:57.177 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 197/285 2024-06-04T15:50:57.224 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 198/285 2024-06-04T15:50:57.293 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 199/285 2024-06-04T15:50:57.381 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 200/285 2024-06-04T15:50:57.484 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : lksctp-tools-1.0.19-2.el9.x86_64 204/285 2024-06-04T15:50:57.511 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 201/285 2024-06-04T15:50:57.528 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86 205/285 2024-06-04T15:50:57.557 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 202/285 2024-06-04T15:50:57.590 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 203/285 2024-06-04T15:50:57.884 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86 205/285 2024-06-04T15:50:57.934 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : plexus-utils-3.3.0-10.el9.noarch 206/285 2024-06-04T15:50:57.965 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : slf4j-1.7.30-13.el9.noarch 207/285 2024-06-04T15:50:57.992 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : atinject-1.0.3-6.el9.noarch 208/285 2024-06-04T15:50:58.027 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : apache-commons-io-1:2.8.0-8.el9.noarch 209/285 2024-06-04T15:50:58.064 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : apache-commons-lang3-3.12.0-6.el9.noarch 210/285 2024-06-04T15:50:58.092 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : httpcomponents-core-4.4.13-7.el9.noarch 211/285 2024-06-04T15:50:58.117 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : plexus-cipher-1.7-27.el9.noarch 212/285 2024-06-04T15:50:58.143 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : plexus-classworlds-2.6.0-11.el9.noarch 213/285 2024-06-04T15:50:58.168 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : plexus-containers-component-annotations-2.1.0-10 214/285 2024-06-04T15:50:58.194 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : plexus-sec-dispatcher-1.4-37.el9.noarch 215/285 2024-06-04T15:50:58.220 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : maven-shared-utils-3.3.4-3.el9.noarch 216/285 2024-06-04T15:50:58.246 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : cdi-api-2.0.2-6.el9.noarch 217/285 2024-06-04T15:50:58.277 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : sisu-1:0.3.4-10.el9.noarch 218/285 2024-06-04T15:50:58.305 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : jcl-over-slf4j-1.7.30-13.el9.noarch 219/285 2024-06-04T15:50:58.340 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : apache-commons-cli-1.4-17.el9.noarch 220/285 2024-06-04T15:50:58.375 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : apache-commons-codec-1.15-7.el9.noarch 221/285 2024-06-04T15:50:58.406 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : httpcomponents-client-4.5.13-3.el9.noarch 222/285 2024-06-04T15:50:58.441 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : jakarta-annotations-1.3.5-13.el9.noarch 223/285 2024-06-04T15:50:58.461 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : lksctp-tools-1.0.19-2.el9.x86_64 204/285 2024-06-04T15:50:58.474 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : jansi-2.3.3-6.el9.x86_64 224/285 2024-06-04T15:50:58.511 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : jsoup-1.13.1-10.el9.noarch 225/285 2024-06-04T15:50:58.522 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86 205/285 2024-06-04T15:50:58.549 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : maven-wagon-3.4.2-7.el9.noarch 226/285 2024-06-04T15:50:58.591 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : maven-resolver-1:1.6.1-10.el9.noarch 227/285 2024-06-04T15:50:58.636 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : jsr-305-3.0.2-6.el9.noarch 228/285 2024-06-04T15:50:58.668 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : guava-30.1-6.el9.noarch 229/285 2024-06-04T15:50:58.691 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : google-guice-4.2.3-9.el9.noarch 230/285 2024-06-04T15:50:58.744 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : plexus-interpolation-1.26-11.el9.noarch 231/285 2024-06-04T15:50:58.777 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : maven-lib-1:3.6.3-15.el9.noarch 232/285 2024-06-04T15:50:58.808 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : libpciaccess-0.16-7.el9.x86_64 233/285 2024-06-04T15:50:58.843 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : libdrm-2.4.117-1.el9.x86_64 234/285 2024-06-04T15:50:58.870 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : mesa-libgbm-23.3.3-1.el9.x86_64 235/285 2024-06-04T15:50:58.871 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86 205/285 2024-06-04T15:50:58.898 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : libglvnd-egl-1:1.3.4-1.el9.x86_64 236/285 2024-06-04T15:50:58.912 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : plexus-utils-3.3.0-10.el9.noarch 206/285 2024-06-04T15:50:58.925 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : mesa-libEGL-23.3.3-1.el9.x86_64 237/285 2024-06-04T15:50:58.943 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : slf4j-1.7.30-13.el9.noarch 207/285 2024-06-04T15:50:58.958 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : libglvnd-glx-1:1.3.4-1.el9.x86_64 238/285 2024-06-04T15:50:58.970 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : atinject-1.0.3-6.el9.noarch 208/285 2024-06-04T15:50:59.006 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : apache-commons-io-1:2.8.0-8.el9.noarch 209/285 2024-06-04T15:50:59.043 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : apache-commons-lang3-3.12.0-6.el9.noarch 210/285 2024-06-04T15:50:59.070 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : httpcomponents-core-4.4.13-7.el9.noarch 211/285 2024-06-04T15:50:59.079 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : mesa-libGL-23.3.3-1.el9.x86_64 239/285 2024-06-04T15:50:59.096 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : plexus-cipher-1.7-27.el9.noarch 212/285 2024-06-04T15:50:59.122 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : plexus-classworlds-2.6.0-11.el9.noarch 213/285 2024-06-04T15:50:59.143 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : gstreamer1-plugins-base-1.22.1-2.el9.x86_64 240/285 2024-06-04T15:50:59.146 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : plexus-containers-component-annotations-2.1.0-10 214/285 2024-06-04T15:50:59.172 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : plexus-sec-dispatcher-1.4-37.el9.noarch 215/285 2024-06-04T15:50:59.206 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : maven-shared-utils-3.3.4-3.el9.noarch 216/285 2024-06-04T15:50:59.211 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : libtracker-sparql-3.1.2-3.el9.x86_64 241/285 2024-06-04T15:50:59.233 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : cdi-api-2.0.2-6.el9.noarch 217/285 2024-06-04T15:50:59.240 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : tracker-3.1.2-3.el9.x86_64 242/285 2024-06-04T15:50:59.263 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : sisu-1:0.3.4-10.el9.noarch 218/285 2024-06-04T15:50:59.291 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : jcl-over-slf4j-1.7.30-13.el9.noarch 219/285 2024-06-04T15:50:59.318 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : apache-commons-cli-1.4-17.el9.noarch 220/285 2024-06-04T15:50:59.345 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: tracker-3.1.2-3.el9.x86_64 242/285 2024-06-04T15:50:59.353 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : apache-commons-codec-1.15-7.el9.noarch 221/285 2024-06-04T15:50:59.386 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : httpcomponents-client-4.5.13-3.el9.noarch 222/285 2024-06-04T15:50:59.417 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : tracker-miners-3.1.2-4.el9.x86_64 243/285 2024-06-04T15:50:59.419 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : jakarta-annotations-1.3.5-13.el9.noarch 223/285 2024-06-04T15:50:59.432 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: tracker-miners-3.1.2-4.el9.x86_64 243/285 2024-06-04T15:50:59.455 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : jansi-2.3.3-6.el9.x86_64 224/285 2024-06-04T15:50:59.468 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : bubblewrap-0.4.1-7.el9.x86_64 244/285 2024-06-04T15:50:59.491 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : bluez-libs-5.56-6.el9.x86_64 245/285 2024-06-04T15:50:59.492 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : jsoup-1.13.1-10.el9.noarch 225/285 2024-06-04T15:50:59.530 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : maven-wagon-3.4.2-7.el9.noarch 226/285 2024-06-04T15:50:59.564 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : maven-resolver-1:1.6.1-10.el9.noarch 227/285 2024-06-04T15:50:59.608 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : jsr-305-3.0.2-6.el9.noarch 228/285 2024-06-04T15:50:59.641 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : guava-30.1-6.el9.noarch 229/285 2024-06-04T15:50:59.664 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : google-guice-4.2.3-9.el9.noarch 230/285 2024-06-04T15:50:59.715 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : plexus-interpolation-1.26-11.el9.noarch 231/285 2024-06-04T15:50:59.750 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : maven-lib-1:3.6.3-15.el9.noarch 232/285 2024-06-04T15:50:59.780 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libpciaccess-0.16-7.el9.x86_64 233/285 2024-06-04T15:50:59.808 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libdrm-2.4.117-1.el9.x86_64 234/285 2024-06-04T15:50:59.834 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : mesa-libgbm-23.3.3-1.el9.x86_64 235/285 2024-06-04T15:50:59.861 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libglvnd-egl-1:1.3.4-1.el9.x86_64 236/285 2024-06-04T15:50:59.875 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: pipewire-1.0.1-1.el9.x86_64 246/285 2024-06-04T15:50:59.888 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : mesa-libEGL-23.3.3-1.el9.x86_64 237/285 2024-06-04T15:50:59.912 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : pipewire-1.0.1-1.el9.x86_64 246/285 2024-06-04T15:50:59.921 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libglvnd-glx-1:1.3.4-1.el9.x86_64 238/285 2024-06-04T15:50:59.928 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: pipewire-1.0.1-1.el9.x86_64 246/285 2024-06-04T15:50:59.928 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/user/sockets.target.wants/pipewire.socket → /usr/lib/systemd/user/pipewire.socket. 2024-06-04T15:50:59.928 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-06-04T15:51:00.039 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : mesa-libGL-23.3.3-1.el9.x86_64 239/285 2024-06-04T15:51:00.105 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : gstreamer1-plugins-base-1.22.1-2.el9.x86_64 240/285 2024-06-04T15:51:00.171 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : pipewire-libs-1.0.1-1.el9.x86_64 247/285 2024-06-04T15:51:00.173 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libtracker-sparql-3.1.2-3.el9.x86_64 241/285 2024-06-04T15:51:00.203 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : tracker-3.1.2-3.el9.x86_64 242/285 2024-06-04T15:51:00.242 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : wireplumber-0.4.14-1.el9.x86_64 248/285 2024-06-04T15:51:00.278 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : wireplumber-libs-0.4.14-1.el9.x86_64 249/285 2024-06-04T15:51:00.315 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : pipewire-jack-audio-connection-kit-libs-1.0.1-1. 250/285 2024-06-04T15:51:00.315 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: tracker-3.1.2-3.el9.x86_64 242/285 2024-06-04T15:51:00.340 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : ModemManager-glib-1.20.2-1.el9.x86_64 251/285 2024-06-04T15:51:00.358 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : tracker-miners-3.1.2-4.el9.x86_64 243/285 2024-06-04T15:51:00.373 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: tracker-miners-3.1.2-4.el9.x86_64 243/285 2024-06-04T15:51:00.404 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : bubblewrap-0.4.1-7.el9.x86_64 244/285 2024-06-04T15:51:00.427 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : bluez-libs-5.56-6.el9.x86_64 245/285 2024-06-04T15:51:00.756 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: geoclue2-2.6.0-7.el9.x86_64 252/285 2024-06-04T15:51:00.786 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : geoclue2-2.6.0-7.el9.x86_64 252/285 2024-06-04T15:51:00.801 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: geoclue2-2.6.0-7.el9.x86_64 252/285 2024-06-04T15:51:00.895 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: pipewire-1.0.1-1.el9.x86_64 246/285 2024-06-04T15:51:00.922 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : pipewire-1.0.1-1.el9.x86_64 246/285 2024-06-04T15:51:00.938 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: pipewire-1.0.1-1.el9.x86_64 246/285 2024-06-04T15:51:00.939 INFO:teuthology.orchestra.run.smithi144.stdout:Created symlink /etc/systemd/user/sockets.target.wants/pipewire.socket → /usr/lib/systemd/user/pipewire.socket. 2024-06-04T15:51:00.939 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T15:51:01.165 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : pipewire-libs-1.0.1-1.el9.x86_64 247/285 2024-06-04T15:51:01.235 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : wireplumber-0.4.14-1.el9.x86_64 248/285 2024-06-04T15:51:01.273 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : wireplumber-libs-0.4.14-1.el9.x86_64 249/285 2024-06-04T15:51:01.304 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: flatpak-1.12.8-1.el9.x86_64 253/285 2024-06-04T15:51:01.309 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : pipewire-jack-audio-connection-kit-libs-1.0.1-1. 250/285 2024-06-04T15:51:01.334 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ModemManager-glib-1.20.2-1.el9.x86_64 251/285 2024-06-04T15:51:01.388 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : flatpak-1.12.8-1.el9.x86_64 253/285 2024-06-04T15:51:01.436 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : xdg-desktop-portal-1.12.6-1.el9.x86_64 254/285 2024-06-04T15:51:01.464 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: xdg-desktop-portal-1.12.6-1.el9.x86_64 254/285 2024-06-04T15:51:01.664 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : libcanberra-gtk3-0.30-27.el9.x86_64 255/285 2024-06-04T15:51:01.717 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : gtk3-3.24.31-2.el9.x86_64 256/285 2024-06-04T15:51:01.743 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : xdg-desktop-portal-gtk-1.12.0-3.el9.x86_64 257/285 2024-06-04T15:51:01.765 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: xdg-desktop-portal-gtk-1.12.0-3.el9.x86_64 257/285 2024-06-04T15:51:01.766 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: geoclue2-2.6.0-7.el9.x86_64 252/285 2024-06-04T15:51:01.794 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : java-11-openjdk-1:11.0.20.1.1-2.el9.x86_64 258/285 2024-06-04T15:51:01.797 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : geoclue2-2.6.0-7.el9.x86_64 252/285 2024-06-04T15:51:01.813 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: geoclue2-2.6.0-7.el9.x86_64 252/285 2024-06-04T15:51:01.858 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: java-11-openjdk-1:11.0.20.1.1-2.el9.x86_64 258/285 2024-06-04T15:51:01.889 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : java-11-openjdk-devel-1:11.0.20.1.1-2.el9.x86_64 259/285 2024-06-04T15:51:01.899 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: java-11-openjdk-devel-1:11.0.20.1.1-2.el9.x86_64 259/285 2024-06-04T15:51:01.922 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : maven-1:3.6.3-15.el9.noarch 260/285 2024-06-04T15:51:01.941 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: maven-1:3.6.3-15.el9.noarch 260/285 2024-06-04T15:51:01.965 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : maven-openjdk11-1:3.6.3-15.el9.noarch 261/285 2024-06-04T15:51:02.279 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: flatpak-1.12.8-1.el9.x86_64 253/285 2024-06-04T15:51:02.343 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: cephadm-2:19.0.0-4027.g65533a90.el9.noarch 262/285 2024-06-04T15:51:02.370 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : cephadm-2:19.0.0-4027.g65533a90.el9.noarch 262/285 2024-06-04T15:51:02.375 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : flatpak-1.12.8-1.el9.x86_64 253/285 2024-06-04T15:51:02.404 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-4027.g65533a90.e 263/285 2024-06-04T15:51:02.422 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : xdg-desktop-portal-1.12.6-1.el9.x86_64 254/285 2024-06-04T15:51:02.450 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: xdg-desktop-portal-1.12.6-1.el9.x86_64 254/285 2024-06-04T15:51:02.465 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-4027.g65533a90. 264/285 2024-06-04T15:51:02.495 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-4027.g65533a90.el9.noa 265/285 2024-06-04T15:51:02.647 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libcanberra-gtk3-0.30-27.el9.x86_64 255/285 2024-06-04T15:51:02.703 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : gtk3-3.24.31-2.el9.x86_64 256/285 2024-06-04T15:51:02.730 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : xdg-desktop-portal-gtk-1.12.0-3.el9.x86_64 257/285 2024-06-04T15:51:02.752 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: xdg-desktop-portal-gtk-1.12.0-3.el9.x86_64 257/285 2024-06-04T15:51:02.781 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : java-11-openjdk-1:11.0.20.1.1-2.el9.x86_64 258/285 2024-06-04T15:51:02.847 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: java-11-openjdk-1:11.0.20.1.1-2.el9.x86_64 258/285 2024-06-04T15:51:02.883 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : java-11-openjdk-devel-1:11.0.20.1.1-2.el9.x86_64 259/285 2024-06-04T15:51:02.894 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: java-11-openjdk-devel-1:11.0.20.1.1-2.el9.x86_64 259/285 2024-06-04T15:51:02.925 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : maven-1:3.6.3-15.el9.noarch 260/285 2024-06-04T15:51:02.944 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: maven-1:3.6.3-15.el9.noarch 260/285 2024-06-04T15:51:02.977 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : maven-openjdk11-1:3.6.3-15.el9.noarch 261/285 2024-06-04T15:51:03.388 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: cephadm-2:19.0.0-4027.g65533a90.el9.noarch 262/285 2024-06-04T15:51:03.424 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : cephadm-2:19.0.0-4027.g65533a90.el9.noarch 262/285 2024-06-04T15:51:03.457 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-4027.g65533a90.e 263/285 2024-06-04T15:51:03.527 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-4027.g65533a90. 264/285 2024-06-04T15:51:03.543 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-4027.g65533a90.el9.noa 265/285 2024-06-04T15:51:03.557 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-4027.g65533a90.el9.noa 265/285 2024-06-04T15:51:03.580 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-4027.g65533a90.el9.n 266/285 2024-06-04T15:51:04.546 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-4027.g65533a90.el9.n 266/285 2024-06-04T15:51:04.572 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-4027.g655 267/285 2024-06-04T15:51:04.605 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-4027.g65533a90.el9.noa 265/285 2024-06-04T15:51:04.642 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-4027.g65533a90.el9.n 266/285 2024-06-04T15:51:04.684 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-4027.g655 267/285 2024-06-04T15:51:04.842 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-4027.g65533a90.el 268/285 2024-06-04T15:51:04.866 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : ceph-mgr-2:19.0.0-4027.g65533a90.el9.x86_64 269/285 2024-06-04T15:51:04.889 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: ceph-mgr-2:19.0.0-4027.g65533a90.el9.x86_64 269/285 2024-06-04T15:51:04.889 INFO:teuthology.orchestra.run.smithi177.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-04T15:51:04.889 INFO:teuthology.orchestra.run.smithi177.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-06-04T15:51:04.889 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-06-04T15:51:04.889 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-06-04T15:51:04.889 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-06-04T15:51:04.933 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : ceph-mgr-rook-2:19.0.0-4027.g65533a90.el9.noarch 270/285 2024-06-04T15:51:04.944 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-4027.g65533a90.el9.noarch 270/285 2024-06-04T15:51:04.968 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : ceph-2:19.0.0-4027.g65533a90.el9.x86_64 271/285 2024-06-04T15:51:04.996 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : pipewire-jack-audio-connection-kit-1.0.1-1.el9.x 272/285 2024-06-04T15:51:05.046 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : pipewire-alsa-1.0.1-1.el9.x86_64 273/285 2024-06-04T15:51:05.069 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : pipewire-pulseaudio-1.0.1-1.el9.x86_64 274/285 2024-06-04T15:51:05.084 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: pipewire-pulseaudio-1.0.1-1.el9.x86_64 274/285 2024-06-04T15:51:05.086 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/user/sockets.target.wants/pipewire-pulse.socket → /usr/lib/systemd/user/pipewire-pulse.socket. 2024-06-04T15:51:05.087 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-06-04T15:51:05.612 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-4027.g65533a90.el9.n 266/285 2024-06-04T15:51:05.642 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-4027.g655 267/285 2024-06-04T15:51:05.754 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-4027.g655 267/285 2024-06-04T15:51:05.929 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-4027.g65533a90.el 268/285 2024-06-04T15:51:05.961 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-mgr-2:19.0.0-4027.g65533a90.el9.x86_64 269/285 2024-06-04T15:51:05.984 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: ceph-mgr-2:19.0.0-4027.g65533a90.el9.x86_64 269/285 2024-06-04T15:51:05.984 INFO:teuthology.orchestra.run.smithi144.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-04T15:51:05.985 INFO:teuthology.orchestra.run.smithi144.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-06-04T15:51:05.985 INFO:teuthology.orchestra.run.smithi144.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-06-04T15:51:05.985 INFO:teuthology.orchestra.run.smithi144.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-06-04T15:51:05.985 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T15:51:06.028 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : ceph-radosgw-2:19.0.0-4027.g65533a90.el9.x86_64 275/285 2024-06-04T15:51:06.036 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-mgr-rook-2:19.0.0-4027.g65533a90.el9.noarch 270/285 2024-06-04T15:51:06.048 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-4027.g65533a90.el9.noarch 270/285 2024-06-04T15:51:06.051 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-4027.g65533a90.el9.x86_64 275/285 2024-06-04T15:51:06.051 INFO:teuthology.orchestra.run.smithi177.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-04T15:51:06.052 INFO:teuthology.orchestra.run.smithi177.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-06-04T15:51:06.052 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-06-04T15:51:06.052 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-06-04T15:51:06.052 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-06-04T15:51:06.071 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-2:19.0.0-4027.g65533a90.el9.x86_64 271/285 2024-06-04T15:51:06.095 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-4027.g65533 276/285 2024-06-04T15:51:06.100 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : pipewire-jack-audio-connection-kit-1.0.1-1.el9.x 272/285 2024-06-04T15:51:06.118 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-4027.g65533 276/285 2024-06-04T15:51:06.118 INFO:teuthology.orchestra.run.smithi177.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-04T15:51:06.118 INFO:teuthology.orchestra.run.smithi177.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-06-04T15:51:06.118 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-06-04T15:51:06.150 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : pipewire-alsa-1.0.1-1.el9.x86_64 273/285 2024-06-04T15:51:06.172 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : pipewire-pulseaudio-1.0.1-1.el9.x86_64 274/285 2024-06-04T15:51:06.188 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: pipewire-pulseaudio-1.0.1-1.el9.x86_64 274/285 2024-06-04T15:51:06.188 INFO:teuthology.orchestra.run.smithi144.stdout:Created symlink /etc/systemd/user/sockets.target.wants/pipewire-pulse.socket → /usr/lib/systemd/user/pipewire-pulse.socket. 2024-06-04T15:51:06.188 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T15:51:06.429 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : rbd-mirror-2:19.0.0-4027.g65533a90.el9.x86_64 277/285 2024-06-04T15:51:06.452 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: rbd-mirror-2:19.0.0-4027.g65533a90.el9.x86_64 277/285 2024-06-04T15:51:06.453 INFO:teuthology.orchestra.run.smithi177.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-04T15:51:06.453 INFO:teuthology.orchestra.run.smithi177.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-06-04T15:51:06.453 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-06-04T15:51:06.453 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-06-04T15:51:06.453 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-06-04T15:51:07.131 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-radosgw-2:19.0.0-4027.g65533a90.el9.x86_64 275/285 2024-06-04T15:51:07.155 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-4027.g65533a90.el9.x86_64 275/285 2024-06-04T15:51:07.155 INFO:teuthology.orchestra.run.smithi144.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-04T15:51:07.155 INFO:teuthology.orchestra.run.smithi144.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-06-04T15:51:07.155 INFO:teuthology.orchestra.run.smithi144.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-06-04T15:51:07.156 INFO:teuthology.orchestra.run.smithi144.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-06-04T15:51:07.156 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T15:51:07.199 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-4027.g65533 276/285 2024-06-04T15:51:07.222 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-4027.g65533 276/285 2024-06-04T15:51:07.222 INFO:teuthology.orchestra.run.smithi144.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-04T15:51:07.222 INFO:teuthology.orchestra.run.smithi144.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-06-04T15:51:07.222 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T15:51:07.524 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : rbd-mirror-2:19.0.0-4027.g65533a90.el9.x86_64 277/285 2024-06-04T15:51:07.548 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: rbd-mirror-2:19.0.0-4027.g65533a90.el9.x86_64 277/285 2024-06-04T15:51:07.548 INFO:teuthology.orchestra.run.smithi144.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-04T15:51:07.548 INFO:teuthology.orchestra.run.smithi144.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-06-04T15:51:07.548 INFO:teuthology.orchestra.run.smithi144.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-06-04T15:51:07.548 INFO:teuthology.orchestra.run.smithi144.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-06-04T15:51:07.548 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T15:51:11.051 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : ceph-test-2:19.0.0-4027.g65533a90.el9.x86_64 278/285 2024-06-04T15:51:11.099 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : rbd-fuse-2:19.0.0-4027.g65533a90.el9.x86_64 279/285 2024-06-04T15:51:11.130 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : rbd-nbd-2:19.0.0-4027.g65533a90.el9.x86_64 280/285 2024-06-04T15:51:11.234 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : libcephfs-devel-2:19.0.0-4027.g65533a90.el9.x86_ 281/285 2024-06-04T15:51:11.291 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : ceph-fuse-2:19.0.0-4027.g65533a90.el9.x86_64 282/285 2024-06-04T15:51:11.322 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : s3cmd-2.4.0-1.el9.noarch 283/285 2024-06-04T15:51:11.322 INFO:teuthology.orchestra.run.smithi177.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 284/285 2024-06-04T15:51:11.414 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 284/285 2024-06-04T15:51:11.414 INFO:teuthology.orchestra.run.smithi177.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 285/285 2024-06-04T15:51:11.521 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 285/285 2024-06-04T15:51:11.547 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: dconf-0.40.0-6.el9.x86_64 285/285 2024-06-04T15:51:11.553 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: copy-jdk-configs-4.0-3.el9.noarch 285/285 2024-06-04T15:51:11.562 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86 285/285 2024-06-04T15:51:11.573 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: wireplumber-0.4.14-1.el9.x86_64 285/285 2024-06-04T15:51:11.573 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/user/pipewire-session-manager.service → /usr/lib/systemd/user/wireplumber.service. 2024-06-04T15:51:11.573 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/user/pipewire.service.wants/wireplumber.service → /usr/lib/systemd/user/wireplumber.service. 2024-06-04T15:51:11.573 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-06-04T15:51:11.632 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: java-11-openjdk-1:11.0.20.1.1-2.el9.x86_64 285/285 2024-06-04T15:51:11.701 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: java-11-openjdk-devel-1:11.0.20.1.1-2.el9.x86_64 285/285 2024-06-04T15:51:12.155 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-test-2:19.0.0-4027.g65533a90.el9.x86_64 278/285 2024-06-04T15:51:12.194 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : rbd-fuse-2:19.0.0-4027.g65533a90.el9.x86_64 279/285 2024-06-04T15:51:12.234 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : rbd-nbd-2:19.0.0-4027.g65533a90.el9.x86_64 280/285 2024-06-04T15:51:12.337 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libcephfs-devel-2:19.0.0-4027.g65533a90.el9.x86_ 281/285 2024-06-04T15:51:12.394 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-fuse-2:19.0.0-4027.g65533a90.el9.x86_64 282/285 2024-06-04T15:51:12.425 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : s3cmd-2.4.0-1.el9.noarch 283/285 2024-06-04T15:51:12.425 INFO:teuthology.orchestra.run.smithi144.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 284/285 2024-06-04T15:51:12.558 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 284/285 2024-06-04T15:51:12.558 INFO:teuthology.orchestra.run.smithi144.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 285/285 2024-06-04T15:51:12.659 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 285/285 2024-06-04T15:51:12.678 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: dconf-0.40.0-6.el9.x86_64 285/285 2024-06-04T15:51:12.685 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: copy-jdk-configs-4.0-3.el9.noarch 285/285 2024-06-04T15:51:12.694 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86 285/285 2024-06-04T15:51:12.705 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: wireplumber-0.4.14-1.el9.x86_64 285/285 2024-06-04T15:51:12.705 INFO:teuthology.orchestra.run.smithi144.stdout:Created symlink /etc/systemd/user/pipewire-session-manager.service → /usr/lib/systemd/user/wireplumber.service. 2024-06-04T15:51:12.705 INFO:teuthology.orchestra.run.smithi144.stdout:Created symlink /etc/systemd/user/pipewire.service.wants/wireplumber.service → /usr/lib/systemd/user/wireplumber.service. 2024-06-04T15:51:12.705 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T15:51:12.763 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: java-11-openjdk-1:11.0.20.1.1-2.el9.x86_64 285/285 2024-06-04T15:51:12.833 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: java-11-openjdk-devel-1:11.0.20.1.1-2.el9.x86_64 285/285 2024-06-04T15:51:20.431 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 285/285 2024-06-04T15:51:20.432 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : ceph-2:19.0.0-4027.g65533a90.el9.x86_64 1/285 2024-06-04T15:51:20.432 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : ceph-base-2:19.0.0-4027.g65533a90.el9.x86_64 2/285 2024-06-04T15:51:20.432 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : ceph-common-2:19.0.0-4027.g65533a90.el9.x86_64 3/285 2024-06-04T15:51:20.432 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : ceph-fuse-2:19.0.0-4027.g65533a90.el9.x86_64 4/285 2024-06-04T15:51:20.432 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-4027.g65533 5/285 2024-06-04T15:51:20.432 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : ceph-mds-2:19.0.0-4027.g65533a90.el9.x86_64 6/285 2024-06-04T15:51:20.432 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : ceph-mgr-2:19.0.0-4027.g65533a90.el9.x86_64 7/285 2024-06-04T15:51:20.432 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : ceph-mon-2:19.0.0-4027.g65533a90.el9.x86_64 8/285 2024-06-04T15:51:20.432 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : ceph-osd-2:19.0.0-4027.g65533a90.el9.x86_64 9/285 2024-06-04T15:51:20.433 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : ceph-radosgw-2:19.0.0-4027.g65533a90.el9.x86_64 10/285 2024-06-04T15:51:20.433 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : ceph-selinux-2:19.0.0-4027.g65533a90.el9.x86_64 11/285 2024-06-04T15:51:20.433 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : ceph-test-2:19.0.0-4027.g65533a90.el9.x86_64 12/285 2024-06-04T15:51:20.433 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : libcephfs-devel-2:19.0.0-4027.g65533a90.el9.x86_ 13/285 2024-06-04T15:51:20.433 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : libcephfs2-2:19.0.0-4027.g65533a90.el9.x86_64 14/285 2024-06-04T15:51:20.433 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : libcephsqlite-2:19.0.0-4027.g65533a90.el9.x86_64 15/285 2024-06-04T15:51:20.433 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : librados-devel-2:19.0.0-4027.g65533a90.el9.x86_6 16/285 2024-06-04T15:51:20.433 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : libradosstriper1-2:19.0.0-4027.g65533a90.el9.x86 17/285 2024-06-04T15:51:20.433 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : librgw2-2:19.0.0-4027.g65533a90.el9.x86_64 18/285 2024-06-04T15:51:20.433 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-ceph-argparse-2:19.0.0-4027.g65533a90.el 19/285 2024-06-04T15:51:20.433 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-ceph-common-2:19.0.0-4027.g65533a90.el9. 20/285 2024-06-04T15:51:20.434 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-cephfs-2:19.0.0-4027.g65533a90.el9.x86_6 21/285 2024-06-04T15:51:20.434 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-rados-2:19.0.0-4027.g65533a90.el9.x86_64 22/285 2024-06-04T15:51:20.434 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-rbd-2:19.0.0-4027.g65533a90.el9.x86_64 23/285 2024-06-04T15:51:20.434 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-rgw-2:19.0.0-4027.g65533a90.el9.x86_64 24/285 2024-06-04T15:51:20.434 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : rbd-fuse-2:19.0.0-4027.g65533a90.el9.x86_64 25/285 2024-06-04T15:51:20.434 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : rbd-mirror-2:19.0.0-4027.g65533a90.el9.x86_64 26/285 2024-06-04T15:51:20.434 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : rbd-nbd-2:19.0.0-4027.g65533a90.el9.x86_64 27/285 2024-06-04T15:51:20.434 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-4027.g65533a90. 28/285 2024-06-04T15:51:20.434 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-4027.g65533a90.el9.noa 29/285 2024-06-04T15:51:20.434 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-4027.g65533a90.el9.n 30/285 2024-06-04T15:51:20.459 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-4027.g655 31/285 2024-06-04T15:51:20.459 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-4027.g65533a90.el 32/285 2024-06-04T15:51:20.459 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : ceph-mgr-rook-2:19.0.0-4027.g65533a90.el9.noarch 33/285 2024-06-04T15:51:20.459 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-4027.g65533a90.e 34/285 2024-06-04T15:51:20.460 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : ceph-volume-2:19.0.0-4027.g65533a90.el9.noarch 35/285 2024-06-04T15:51:20.460 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : cephadm-2:19.0.0-4027.g65533a90.el9.noarch 36/285 2024-06-04T15:51:20.460 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : ModemManager-glib-1.20.2-1.el9.x86_64 37/285 2024-06-04T15:51:20.460 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : bluez-libs-5.56-6.el9.x86_64 38/285 2024-06-04T15:51:20.460 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : bubblewrap-0.4.1-7.el9.x86_64 39/285 2024-06-04T15:51:20.460 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : cups-libs-1:2.3.3op2-26.el9.x86_64 40/285 2024-06-04T15:51:20.460 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 41/285 2024-06-04T15:51:20.460 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 42/285 2024-06-04T15:51:20.460 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : libpciaccess-0.16-7.el9.x86_64 43/285 2024-06-04T15:51:20.460 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 44/285 2024-06-04T15:51:20.461 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : lksctp-tools-1.0.19-2.el9.x86_64 45/285 2024-06-04T15:51:20.461 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 46/285 2024-06-04T15:51:20.461 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 47/285 2024-06-04T15:51:20.461 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-ply-3.11-14.el9.noarch 48/285 2024-06-04T15:51:20.461 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 49/285 2024-06-04T15:51:20.461 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 50/285 2024-06-04T15:51:20.461 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 51/285 2024-06-04T15:51:20.461 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : adwaita-cursor-theme-40.1.1-3.el9.noarch 52/285 2024-06-04T15:51:20.461 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : adwaita-icon-theme-40.1.1-3.el9.noarch 53/285 2024-06-04T15:51:20.461 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : alsa-lib-1.2.10-2.el9.x86_64 54/285 2024-06-04T15:51:20.461 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : apache-commons-cli-1.4-17.el9.noarch 55/285 2024-06-04T15:51:20.462 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : apache-commons-codec-1.15-7.el9.noarch 56/285 2024-06-04T15:51:20.462 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : apache-commons-io-1:2.8.0-8.el9.noarch 57/285 2024-06-04T15:51:20.462 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : apache-commons-lang3-3.12.0-6.el9.noarch 58/285 2024-06-04T15:51:20.462 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : at-spi2-atk-2.38.0-4.el9.x86_64 59/285 2024-06-04T15:51:20.462 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : at-spi2-core-2.40.3-1.el9.x86_64 60/285 2024-06-04T15:51:20.462 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : atinject-1.0.3-6.el9.noarch 61/285 2024-06-04T15:51:20.462 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : atk-2.36.0-5.el9.x86_64 62/285 2024-06-04T15:51:20.462 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : avahi-glib-0.8-20.el9.x86_64 63/285 2024-06-04T15:51:20.462 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 64/285 2024-06-04T15:51:20.463 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : cdi-api-2.0.2-6.el9.noarch 65/285 2024-06-04T15:51:20.463 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : colord-libs-1.4.5-4.el9.x86_64 66/285 2024-06-04T15:51:20.463 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : composefs-libs-1.0.3-2.el9.x86_64 67/285 2024-06-04T15:51:20.463 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : copy-jdk-configs-4.0-3.el9.noarch 68/285 2024-06-04T15:51:20.463 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : dconf-0.40.0-6.el9.x86_64 69/285 2024-06-04T15:51:20.463 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : exempi-2.6.0-0.2.20211007gite23c213.el9.x86_64 70/285 2024-06-04T15:51:20.463 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : exiv2-0.27.5-2.el9.x86_64 71/285 2024-06-04T15:51:20.463 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : exiv2-libs-0.27.5-2.el9.x86_64 72/285 2024-06-04T15:51:20.463 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : fdk-aac-free-2.0.0-8.el9.x86_64 73/285 2024-06-04T15:51:20.463 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : flac-libs-1.3.3-12.el9.x86_64 74/285 2024-06-04T15:51:20.464 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : flatpak-1.12.8-1.el9.x86_64 75/285 2024-06-04T15:51:20.464 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : flatpak-selinux-1.12.8-1.el9.noarch 76/285 2024-06-04T15:51:20.464 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : flatpak-session-helper-1.12.8-1.el9.x86_64 77/285 2024-06-04T15:51:20.464 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 78/285 2024-06-04T15:51:20.464 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 79/285 2024-06-04T15:51:20.464 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 80/285 2024-06-04T15:51:20.464 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : gdk-pixbuf2-modules-2.42.6-3.el9.x86_64 81/285 2024-06-04T15:51:20.464 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : geoclue2-2.6.0-7.el9.x86_64 82/285 2024-06-04T15:51:20.464 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : giflib-5.2.1-9.el9.x86_64 83/285 2024-06-04T15:51:20.464 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : google-guice-4.2.3-9.el9.noarch 84/285 2024-06-04T15:51:20.464 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : graphene-1.10.6-2.el9.x86_64 85/285 2024-06-04T15:51:20.465 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : gsm-1.0.19-6.el9.x86_64 86/285 2024-06-04T15:51:20.465 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : gstreamer1-1.22.1-2.el9.x86_64 87/285 2024-06-04T15:51:20.465 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : gstreamer1-plugins-base-1.22.1-2.el9.x86_64 88/285 2024-06-04T15:51:20.465 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : gtk-update-icon-cache-3.24.31-2.el9.x86_64 89/285 2024-06-04T15:51:20.465 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : gtk3-3.24.31-2.el9.x86_64 90/285 2024-06-04T15:51:20.465 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : guava-30.1-6.el9.noarch 91/285 2024-06-04T15:51:20.465 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : hicolor-icon-theme-0.17-13.el9.noarch 92/285 2024-06-04T15:51:20.465 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : httpcomponents-client-4.5.13-3.el9.noarch 93/285 2024-06-04T15:51:20.465 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : httpcomponents-core-4.4.13-7.el9.noarch 94/285 2024-06-04T15:51:20.465 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : iso-codes-4.6.0-3.el9.noarch 95/285 2024-06-04T15:51:20.466 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : jakarta-annotations-1.3.5-13.el9.noarch 96/285 2024-06-04T15:51:20.466 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : jansi-2.3.3-6.el9.x86_64 97/285 2024-06-04T15:51:20.466 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : java-11-openjdk-1:11.0.20.1.1-2.el9.x86_64 98/285 2024-06-04T15:51:20.466 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : java-11-openjdk-devel-1:11.0.20.1.1-2.el9.x86_64 99/285 2024-06-04T15:51:20.466 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86 100/285 2024-06-04T15:51:20.466 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : javapackages-filesystem-6.0.0-4.el9.noarch 101/285 2024-06-04T15:51:20.466 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : jbigkit-libs-2.1-23.el9.x86_64 102/285 2024-06-04T15:51:20.466 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : jcl-over-slf4j-1.7.30-13.el9.noarch 103/285 2024-06-04T15:51:20.466 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : jsoup-1.13.1-10.el9.noarch 104/285 2024-06-04T15:51:20.466 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : jsr-305-3.0.2-6.el9.noarch 105/285 2024-06-04T15:51:20.466 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : lcms2-2.12-3.el9.x86_64 106/285 2024-06-04T15:51:20.467 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : libX11-xcb-1.7.0-9.el9.x86_64 107/285 2024-06-04T15:51:20.467 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : libXcomposite-0.4.5-7.el9.x86_64 108/285 2024-06-04T15:51:20.467 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : libXcursor-1.2.0-7.el9.x86_64 109/285 2024-06-04T15:51:20.467 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : libXdamage-1.1.5-7.el9.x86_64 110/285 2024-06-04T15:51:20.467 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : libXfixes-5.0.3-16.el9.x86_64 111/285 2024-06-04T15:51:20.467 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : libXi-1.7.10-8.el9.x86_64 112/285 2024-06-04T15:51:20.467 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : libXinerama-1.1.4-10.el9.x86_64 113/285 2024-06-04T15:51:20.467 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : libXrandr-1.5.2-8.el9.x86_64 114/285 2024-06-04T15:51:20.467 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : libXtst-1.2.3-16.el9.x86_64 115/285 2024-06-04T15:51:20.467 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : libXv-1.0.11-16.el9.x86_64 116/285 2024-06-04T15:51:20.467 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : libXxf86vm-1.1.4-18.el9.x86_64 117/285 2024-06-04T15:51:20.468 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : libasyncns-0.8-22.el9.x86_64 118/285 2024-06-04T15:51:20.468 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : libcanberra-0.30-27.el9.x86_64 119/285 2024-06-04T15:51:20.468 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : libcanberra-gtk3-0.30-27.el9.x86_64 120/285 2024-06-04T15:51:20.468 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : libdrm-2.4.117-1.el9.x86_64 121/285 2024-06-04T15:51:20.468 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : libepoxy-1.5.5-4.el9.x86_64 122/285 2024-06-04T15:51:20.468 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : libexif-0.6.22-6.el9.x86_64 123/285 2024-06-04T15:51:20.468 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : libfontenc-1.1.3-17.el9.x86_64 124/285 2024-06-04T15:51:20.468 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : libgexiv2-0.12.3-1.el9.x86_64 125/285 2024-06-04T15:51:20.468 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : libglvnd-1:1.3.4-1.el9.x86_64 126/285 2024-06-04T15:51:20.468 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : libglvnd-egl-1:1.3.4-1.el9.x86_64 127/285 2024-06-04T15:51:20.468 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : libglvnd-glx-1:1.3.4-1.el9.x86_64 128/285 2024-06-04T15:51:20.469 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : libgsf-1.14.47-5.el9.x86_64 129/285 2024-06-04T15:51:20.469 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : libgxps-0.3.2-3.el9.x86_64 130/285 2024-06-04T15:51:20.469 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : libiptcdata-1.0.5-9.el9.x86_64 131/285 2024-06-04T15:51:20.469 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : libldac-2.0.2.3-10.el9.x86_64 132/285 2024-06-04T15:51:20.469 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : libnotify-0.7.9-8.el9.x86_64 133/285 2024-06-04T15:51:20.469 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : libogg-2:1.3.4-6.el9.x86_64 134/285 2024-06-04T15:51:20.469 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : libosinfo-1.10.0-1.el9.x86_64 135/285 2024-06-04T15:51:20.469 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 136/285 2024-06-04T15:51:20.469 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 137/285 2024-06-04T15:51:20.469 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 138/285 2024-06-04T15:51:20.469 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : libsbc-1.4-9.el9.x86_64 139/285 2024-06-04T15:51:20.469 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : libsndfile-1.0.31-8.el9.x86_64 140/285 2024-06-04T15:51:20.470 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : libtheora-1:1.1.1-31.el9.x86_64 141/285 2024-06-04T15:51:20.470 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : libtiff-4.4.0-12.el9.x86_64 142/285 2024-06-04T15:51:20.470 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : libtool-ltdl-2.4.6-45.el9.x86_64 143/285 2024-06-04T15:51:20.470 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : libtracker-sparql-3.1.2-3.el9.x86_64 144/285 2024-06-04T15:51:20.470 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : libvisual-1:0.4.0-34.el9.x86_64 145/285 2024-06-04T15:51:20.470 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : libvorbis-1:1.3.7-5.el9.x86_64 146/285 2024-06-04T15:51:20.470 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : libwayland-client-1.21.0-1.el9.x86_64 147/285 2024-06-04T15:51:20.470 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : libwayland-cursor-1.21.0-1.el9.x86_64 148/285 2024-06-04T15:51:20.470 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : libwayland-egl-1.21.0-1.el9.x86_64 149/285 2024-06-04T15:51:20.470 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : libwayland-server-1.21.0-1.el9.x86_64 150/285 2024-06-04T15:51:20.470 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : libwebp-1.2.0-8.el9.x86_64 151/285 2024-06-04T15:51:20.471 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : libxkbcommon-1.0.3-4.el9.x86_64 152/285 2024-06-04T15:51:20.471 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : libxshmfence-1.3-10.el9.x86_64 153/285 2024-06-04T15:51:20.471 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : low-memory-monitor-2.1-4.el9.x86_64 154/285 2024-06-04T15:51:20.471 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 155/285 2024-06-04T15:51:20.471 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : lua-5.4.4-4.el9.x86_64 156/285 2024-06-04T15:51:20.471 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : lua-posix-35.0-8.el9.x86_64 157/285 2024-06-04T15:51:20.471 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : maven-1:3.6.3-15.el9.noarch 158/285 2024-06-04T15:51:20.471 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : maven-lib-1:3.6.3-15.el9.noarch 159/285 2024-06-04T15:51:20.471 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : maven-openjdk11-1:3.6.3-15.el9.noarch 160/285 2024-06-04T15:51:20.472 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : maven-resolver-1:1.6.1-10.el9.noarch 161/285 2024-06-04T15:51:20.472 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : maven-shared-utils-3.3.4-3.el9.noarch 162/285 2024-06-04T15:51:20.472 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : maven-wagon-3.4.2-7.el9.noarch 163/285 2024-06-04T15:51:20.472 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : mesa-libEGL-23.3.3-1.el9.x86_64 164/285 2024-06-04T15:51:20.472 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : mesa-libGL-23.3.3-1.el9.x86_64 165/285 2024-06-04T15:51:20.472 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : mesa-libgbm-23.3.3-1.el9.x86_64 166/285 2024-06-04T15:51:20.472 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : mesa-libglapi-23.3.3-1.el9.x86_64 167/285 2024-06-04T15:51:20.472 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : mkfontscale-1.2.1-3.el9.x86_64 168/285 2024-06-04T15:51:20.472 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 169/285 2024-06-04T15:51:20.472 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 170/285 2024-06-04T15:51:20.472 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : openjpeg2-2.4.0-7.el9.x86_64 171/285 2024-06-04T15:51:20.473 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : opus-1.3.1-10.el9.x86_64 172/285 2024-06-04T15:51:20.473 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : orc-0.4.31-6.el9.x86_64 173/285 2024-06-04T15:51:20.473 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : osinfo-db-20231215-1.el9.noarch 174/285 2024-06-04T15:51:20.473 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : osinfo-db-tools-1.10.0-1.el9.x86_64 175/285 2024-06-04T15:51:20.473 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : ostree-libs-2024.6-1.el9.x86_64 176/285 2024-06-04T15:51:20.473 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : p11-kit-server-0.25.3-2.el9.x86_64 177/285 2024-06-04T15:51:20.473 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : pipewire-1.0.1-1.el9.x86_64 178/285 2024-06-04T15:51:20.473 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : pipewire-alsa-1.0.1-1.el9.x86_64 179/285 2024-06-04T15:51:20.473 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : pipewire-jack-audio-connection-kit-1.0.1-1.el9.x 180/285 2024-06-04T15:51:20.473 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : pipewire-jack-audio-connection-kit-libs-1.0.1-1. 181/285 2024-06-04T15:51:20.473 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : pipewire-libs-1.0.1-1.el9.x86_64 182/285 2024-06-04T15:51:20.474 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : pipewire-pulseaudio-1.0.1-1.el9.x86_64 183/285 2024-06-04T15:51:20.474 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : plexus-cipher-1.7-27.el9.noarch 184/285 2024-06-04T15:51:20.474 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : plexus-classworlds-2.6.0-11.el9.noarch 185/285 2024-06-04T15:51:20.474 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : plexus-containers-component-annotations-2.1.0-10 186/285 2024-06-04T15:51:20.474 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : plexus-interpolation-1.26-11.el9.noarch 187/285 2024-06-04T15:51:20.474 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : plexus-sec-dispatcher-1.4-37.el9.noarch 188/285 2024-06-04T15:51:20.474 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : plexus-utils-3.3.0-10.el9.noarch 189/285 2024-06-04T15:51:20.474 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : poppler-21.01.0-20.el9.x86_64 190/285 2024-06-04T15:51:20.474 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : poppler-data-0.4.9-9.el9.noarch 191/285 2024-06-04T15:51:20.474 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : poppler-glib-21.01.0-20.el9.x86_64 192/285 2024-06-04T15:51:20.474 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 193/285 2024-06-04T15:51:20.475 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : publicsuffix-list-20210518-3.el9.noarch 194/285 2024-06-04T15:51:20.475 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : pulseaudio-libs-15.0-2.el9.x86_64 195/285 2024-06-04T15:51:20.475 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 196/285 2024-06-04T15:51:20.475 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 197/285 2024-06-04T15:51:20.475 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 198/285 2024-06-04T15:51:20.475 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 199/285 2024-06-04T15:51:20.475 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 200/285 2024-06-04T15:51:20.475 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 201/285 2024-06-04T15:51:20.475 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 202/285 2024-06-04T15:51:20.475 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 203/285 2024-06-04T15:51:20.475 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 204/285 2024-06-04T15:51:20.476 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 205/285 2024-06-04T15:51:20.476 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 206/285 2024-06-04T15:51:20.476 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 207/285 2024-06-04T15:51:20.476 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 208/285 2024-06-04T15:51:20.476 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 209/285 2024-06-04T15:51:20.476 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 210/285 2024-06-04T15:51:20.476 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 211/285 2024-06-04T15:51:20.476 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 212/285 2024-06-04T15:51:20.476 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 213/285 2024-06-04T15:51:20.476 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 214/285 2024-06-04T15:51:20.476 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 215/285 2024-06-04T15:51:20.477 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 216/285 2024-06-04T15:51:20.477 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 217/285 2024-06-04T15:51:20.477 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : rtkit-0.11-28.el9.x86_64 218/285 2024-06-04T15:51:20.477 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : sisu-1:0.3.4-10.el9.noarch 219/285 2024-06-04T15:51:20.477 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : slf4j-1.7.30-13.el9.noarch 220/285 2024-06-04T15:51:20.477 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 221/285 2024-06-04T15:51:20.477 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : sound-theme-freedesktop-0.8-17.el9.noarch 222/285 2024-06-04T15:51:20.477 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : totem-pl-parser-3.26.6-2.el9.x86_64 223/285 2024-06-04T15:51:20.477 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : tracker-3.1.2-3.el9.x86_64 224/285 2024-06-04T15:51:20.477 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : tracker-miners-3.1.2-4.el9.x86_64 225/285 2024-06-04T15:51:20.477 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : ttmkfdir-3.0.9-65.el9.x86_64 226/285 2024-06-04T15:51:20.478 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : tzdata-java-2024a-2.el9.noarch 227/285 2024-06-04T15:51:20.478 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : upower-0.99.11-11.el9.x86_64 228/285 2024-06-04T15:51:20.478 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : webrtc-audio-processing-0.3.1-8.el9.x86_64 229/285 2024-06-04T15:51:20.478 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : wireplumber-0.4.14-1.el9.x86_64 230/285 2024-06-04T15:51:20.478 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : wireplumber-libs-0.4.14-1.el9.x86_64 231/285 2024-06-04T15:51:20.478 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : xdg-dbus-proxy-0.1.3-1.el9.x86_64 232/285 2024-06-04T15:51:20.478 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : xdg-desktop-portal-1.12.6-1.el9.x86_64 233/285 2024-06-04T15:51:20.478 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : xdg-desktop-portal-gtk-1.12.0-3.el9.x86_64 234/285 2024-06-04T15:51:20.478 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : xkeyboard-config-2.33-2.el9.noarch 235/285 2024-06-04T15:51:20.478 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 236/285 2024-06-04T15:51:20.478 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : xorg-x11-fonts-Type1-7.5-33.el9.noarch 237/285 2024-06-04T15:51:20.479 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 238/285 2024-06-04T15:51:20.479 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 239/285 2024-06-04T15:51:20.479 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 240/285 2024-06-04T15:51:20.479 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 241/285 2024-06-04T15:51:20.479 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 242/285 2024-06-04T15:51:20.479 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 243/285 2024-06-04T15:51:20.479 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 244/285 2024-06-04T15:51:20.479 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 245/285 2024-06-04T15:51:20.479 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 246/285 2024-06-04T15:51:20.479 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 247/285 2024-06-04T15:51:20.479 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 248/285 2024-06-04T15:51:20.479 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 249/285 2024-06-04T15:51:20.480 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 250/285 2024-06-04T15:51:20.480 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 251/285 2024-06-04T15:51:20.480 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 252/285 2024-06-04T15:51:20.480 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 253/285 2024-06-04T15:51:20.480 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 254/285 2024-06-04T15:51:20.480 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 255/285 2024-06-04T15:51:20.480 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 256/285 2024-06-04T15:51:20.480 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 257/285 2024-06-04T15:51:20.480 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 258/285 2024-06-04T15:51:20.480 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 259/285 2024-06-04T15:51:20.480 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 260/285 2024-06-04T15:51:20.480 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 261/285 2024-06-04T15:51:20.481 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 262/285 2024-06-04T15:51:20.481 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 263/285 2024-06-04T15:51:20.481 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 264/285 2024-06-04T15:51:20.481 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 265/285 2024-06-04T15:51:20.481 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 266/285 2024-06-04T15:51:20.481 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 267/285 2024-06-04T15:51:20.481 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 268/285 2024-06-04T15:51:20.481 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 269/285 2024-06-04T15:51:20.481 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 270/285 2024-06-04T15:51:20.481 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 271/285 2024-06-04T15:51:20.481 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 272/285 2024-06-04T15:51:20.482 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 273/285 2024-06-04T15:51:20.482 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 274/285 2024-06-04T15:51:20.482 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 275/285 2024-06-04T15:51:20.482 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 276/285 2024-06-04T15:51:20.482 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 277/285 2024-06-04T15:51:20.482 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 278/285 2024-06-04T15:51:20.482 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : re2-1:20211101-3.el9.x86_64 279/285 2024-06-04T15:51:20.482 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : s3cmd-2.4.0-1.el9.noarch 280/285 2024-06-04T15:51:20.482 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 281/285 2024-06-04T15:51:20.482 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : librados2-2:19.0.0-4027.g65533a90.el9.x86_64 282/285 2024-06-04T15:51:20.482 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 283/285 2024-06-04T15:51:20.482 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : librbd1-2:19.0.0-4027.g65533a90.el9.x86_64 284/285 2024-06-04T15:51:21.741 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 285/285 2024-06-04T15:51:21.741 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-2:19.0.0-4027.g65533a90.el9.x86_64 1/285 2024-06-04T15:51:21.741 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-base-2:19.0.0-4027.g65533a90.el9.x86_64 2/285 2024-06-04T15:51:21.741 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-common-2:19.0.0-4027.g65533a90.el9.x86_64 3/285 2024-06-04T15:51:21.741 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-fuse-2:19.0.0-4027.g65533a90.el9.x86_64 4/285 2024-06-04T15:51:21.741 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-4027.g65533 5/285 2024-06-04T15:51:21.741 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-mds-2:19.0.0-4027.g65533a90.el9.x86_64 6/285 2024-06-04T15:51:21.741 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-mgr-2:19.0.0-4027.g65533a90.el9.x86_64 7/285 2024-06-04T15:51:21.742 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-mon-2:19.0.0-4027.g65533a90.el9.x86_64 8/285 2024-06-04T15:51:21.742 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-osd-2:19.0.0-4027.g65533a90.el9.x86_64 9/285 2024-06-04T15:51:21.742 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-radosgw-2:19.0.0-4027.g65533a90.el9.x86_64 10/285 2024-06-04T15:51:21.742 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-selinux-2:19.0.0-4027.g65533a90.el9.x86_64 11/285 2024-06-04T15:51:21.742 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-test-2:19.0.0-4027.g65533a90.el9.x86_64 12/285 2024-06-04T15:51:21.742 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libcephfs-devel-2:19.0.0-4027.g65533a90.el9.x86_ 13/285 2024-06-04T15:51:21.742 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libcephfs2-2:19.0.0-4027.g65533a90.el9.x86_64 14/285 2024-06-04T15:51:21.742 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libcephsqlite-2:19.0.0-4027.g65533a90.el9.x86_64 15/285 2024-06-04T15:51:21.742 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : librados-devel-2:19.0.0-4027.g65533a90.el9.x86_6 16/285 2024-06-04T15:51:21.743 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libradosstriper1-2:19.0.0-4027.g65533a90.el9.x86 17/285 2024-06-04T15:51:21.743 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : librgw2-2:19.0.0-4027.g65533a90.el9.x86_64 18/285 2024-06-04T15:51:21.743 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-ceph-argparse-2:19.0.0-4027.g65533a90.el 19/285 2024-06-04T15:51:21.743 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-ceph-common-2:19.0.0-4027.g65533a90.el9. 20/285 2024-06-04T15:51:21.743 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-cephfs-2:19.0.0-4027.g65533a90.el9.x86_6 21/285 2024-06-04T15:51:21.743 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-rados-2:19.0.0-4027.g65533a90.el9.x86_64 22/285 2024-06-04T15:51:21.743 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-rbd-2:19.0.0-4027.g65533a90.el9.x86_64 23/285 2024-06-04T15:51:21.743 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-rgw-2:19.0.0-4027.g65533a90.el9.x86_64 24/285 2024-06-04T15:51:21.743 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : rbd-fuse-2:19.0.0-4027.g65533a90.el9.x86_64 25/285 2024-06-04T15:51:21.743 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : rbd-mirror-2:19.0.0-4027.g65533a90.el9.x86_64 26/285 2024-06-04T15:51:21.743 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : rbd-nbd-2:19.0.0-4027.g65533a90.el9.x86_64 27/285 2024-06-04T15:51:21.743 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-4027.g65533a90. 28/285 2024-06-04T15:51:21.744 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-4027.g65533a90.el9.noa 29/285 2024-06-04T15:51:21.766 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-4027.g65533a90.el9.n 30/285 2024-06-04T15:51:21.766 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-4027.g655 31/285 2024-06-04T15:51:21.767 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-4027.g65533a90.el 32/285 2024-06-04T15:51:21.767 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-mgr-rook-2:19.0.0-4027.g65533a90.el9.noarch 33/285 2024-06-04T15:51:21.767 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-4027.g65533a90.e 34/285 2024-06-04T15:51:21.767 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-volume-2:19.0.0-4027.g65533a90.el9.noarch 35/285 2024-06-04T15:51:21.767 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : cephadm-2:19.0.0-4027.g65533a90.el9.noarch 36/285 2024-06-04T15:51:21.767 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ModemManager-glib-1.20.2-1.el9.x86_64 37/285 2024-06-04T15:51:21.767 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : bluez-libs-5.56-6.el9.x86_64 38/285 2024-06-04T15:51:21.767 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : bubblewrap-0.4.1-7.el9.x86_64 39/285 2024-06-04T15:51:21.767 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : cups-libs-1:2.3.3op2-26.el9.x86_64 40/285 2024-06-04T15:51:21.767 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 41/285 2024-06-04T15:51:21.767 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 42/285 2024-06-04T15:51:21.767 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libpciaccess-0.16-7.el9.x86_64 43/285 2024-06-04T15:51:21.767 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 44/285 2024-06-04T15:51:21.768 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : lksctp-tools-1.0.19-2.el9.x86_64 45/285 2024-06-04T15:51:21.768 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 46/285 2024-06-04T15:51:21.768 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 47/285 2024-06-04T15:51:21.768 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-ply-3.11-14.el9.noarch 48/285 2024-06-04T15:51:21.768 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 49/285 2024-06-04T15:51:21.768 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 50/285 2024-06-04T15:51:21.768 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 51/285 2024-06-04T15:51:21.768 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : adwaita-cursor-theme-40.1.1-3.el9.noarch 52/285 2024-06-04T15:51:21.768 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : adwaita-icon-theme-40.1.1-3.el9.noarch 53/285 2024-06-04T15:51:21.768 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : alsa-lib-1.2.10-2.el9.x86_64 54/285 2024-06-04T15:51:21.768 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : apache-commons-cli-1.4-17.el9.noarch 55/285 2024-06-04T15:51:21.768 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : apache-commons-codec-1.15-7.el9.noarch 56/285 2024-06-04T15:51:21.769 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : apache-commons-io-1:2.8.0-8.el9.noarch 57/285 2024-06-04T15:51:21.769 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : apache-commons-lang3-3.12.0-6.el9.noarch 58/285 2024-06-04T15:51:21.769 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : at-spi2-atk-2.38.0-4.el9.x86_64 59/285 2024-06-04T15:51:21.769 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : at-spi2-core-2.40.3-1.el9.x86_64 60/285 2024-06-04T15:51:21.769 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : atinject-1.0.3-6.el9.noarch 61/285 2024-06-04T15:51:21.769 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : atk-2.36.0-5.el9.x86_64 62/285 2024-06-04T15:51:21.769 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : avahi-glib-0.8-20.el9.x86_64 63/285 2024-06-04T15:51:21.769 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 64/285 2024-06-04T15:51:21.769 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : cdi-api-2.0.2-6.el9.noarch 65/285 2024-06-04T15:51:21.769 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : colord-libs-1.4.5-4.el9.x86_64 66/285 2024-06-04T15:51:21.769 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : composefs-libs-1.0.3-2.el9.x86_64 67/285 2024-06-04T15:51:21.770 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : copy-jdk-configs-4.0-3.el9.noarch 68/285 2024-06-04T15:51:21.770 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : dconf-0.40.0-6.el9.x86_64 69/285 2024-06-04T15:51:21.770 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : exempi-2.6.0-0.2.20211007gite23c213.el9.x86_64 70/285 2024-06-04T15:51:21.770 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : exiv2-0.27.5-2.el9.x86_64 71/285 2024-06-04T15:51:21.770 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : exiv2-libs-0.27.5-2.el9.x86_64 72/285 2024-06-04T15:51:21.770 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : fdk-aac-free-2.0.0-8.el9.x86_64 73/285 2024-06-04T15:51:21.770 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : flac-libs-1.3.3-12.el9.x86_64 74/285 2024-06-04T15:51:21.770 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : flatpak-1.12.8-1.el9.x86_64 75/285 2024-06-04T15:51:21.770 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : flatpak-selinux-1.12.8-1.el9.noarch 76/285 2024-06-04T15:51:21.770 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : flatpak-session-helper-1.12.8-1.el9.x86_64 77/285 2024-06-04T15:51:21.770 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 78/285 2024-06-04T15:51:21.771 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 79/285 2024-06-04T15:51:21.771 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 80/285 2024-06-04T15:51:21.771 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : gdk-pixbuf2-modules-2.42.6-3.el9.x86_64 81/285 2024-06-04T15:51:21.771 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : geoclue2-2.6.0-7.el9.x86_64 82/285 2024-06-04T15:51:21.771 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : giflib-5.2.1-9.el9.x86_64 83/285 2024-06-04T15:51:21.771 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : google-guice-4.2.3-9.el9.noarch 84/285 2024-06-04T15:51:21.771 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : graphene-1.10.6-2.el9.x86_64 85/285 2024-06-04T15:51:21.771 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : gsm-1.0.19-6.el9.x86_64 86/285 2024-06-04T15:51:21.771 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : gstreamer1-1.22.1-2.el9.x86_64 87/285 2024-06-04T15:51:21.771 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : gstreamer1-plugins-base-1.22.1-2.el9.x86_64 88/285 2024-06-04T15:51:21.771 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : gtk-update-icon-cache-3.24.31-2.el9.x86_64 89/285 2024-06-04T15:51:21.771 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : gtk3-3.24.31-2.el9.x86_64 90/285 2024-06-04T15:51:21.772 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : guava-30.1-6.el9.noarch 91/285 2024-06-04T15:51:21.772 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : hicolor-icon-theme-0.17-13.el9.noarch 92/285 2024-06-04T15:51:21.772 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : httpcomponents-client-4.5.13-3.el9.noarch 93/285 2024-06-04T15:51:21.772 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : httpcomponents-core-4.4.13-7.el9.noarch 94/285 2024-06-04T15:51:21.772 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : iso-codes-4.6.0-3.el9.noarch 95/285 2024-06-04T15:51:21.772 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : jakarta-annotations-1.3.5-13.el9.noarch 96/285 2024-06-04T15:51:21.772 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : jansi-2.3.3-6.el9.x86_64 97/285 2024-06-04T15:51:21.772 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : java-11-openjdk-1:11.0.20.1.1-2.el9.x86_64 98/285 2024-06-04T15:51:21.772 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : java-11-openjdk-devel-1:11.0.20.1.1-2.el9.x86_64 99/285 2024-06-04T15:51:21.772 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86 100/285 2024-06-04T15:51:21.773 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : javapackages-filesystem-6.0.0-4.el9.noarch 101/285 2024-06-04T15:51:21.773 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : jbigkit-libs-2.1-23.el9.x86_64 102/285 2024-06-04T15:51:21.773 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : jcl-over-slf4j-1.7.30-13.el9.noarch 103/285 2024-06-04T15:51:21.773 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : jsoup-1.13.1-10.el9.noarch 104/285 2024-06-04T15:51:21.773 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : jsr-305-3.0.2-6.el9.noarch 105/285 2024-06-04T15:51:21.773 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : lcms2-2.12-3.el9.x86_64 106/285 2024-06-04T15:51:21.773 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libX11-xcb-1.7.0-9.el9.x86_64 107/285 2024-06-04T15:51:21.773 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libXcomposite-0.4.5-7.el9.x86_64 108/285 2024-06-04T15:51:21.773 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libXcursor-1.2.0-7.el9.x86_64 109/285 2024-06-04T15:51:21.773 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libXdamage-1.1.5-7.el9.x86_64 110/285 2024-06-04T15:51:21.773 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libXfixes-5.0.3-16.el9.x86_64 111/285 2024-06-04T15:51:21.773 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libXi-1.7.10-8.el9.x86_64 112/285 2024-06-04T15:51:21.773 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libXinerama-1.1.4-10.el9.x86_64 113/285 2024-06-04T15:51:21.774 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libXrandr-1.5.2-8.el9.x86_64 114/285 2024-06-04T15:51:21.774 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libXtst-1.2.3-16.el9.x86_64 115/285 2024-06-04T15:51:21.774 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libXv-1.0.11-16.el9.x86_64 116/285 2024-06-04T15:51:21.774 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libXxf86vm-1.1.4-18.el9.x86_64 117/285 2024-06-04T15:51:21.774 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libasyncns-0.8-22.el9.x86_64 118/285 2024-06-04T15:51:21.774 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libcanberra-0.30-27.el9.x86_64 119/285 2024-06-04T15:51:21.774 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libcanberra-gtk3-0.30-27.el9.x86_64 120/285 2024-06-04T15:51:21.774 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libdrm-2.4.117-1.el9.x86_64 121/285 2024-06-04T15:51:21.774 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libepoxy-1.5.5-4.el9.x86_64 122/285 2024-06-04T15:51:21.774 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libexif-0.6.22-6.el9.x86_64 123/285 2024-06-04T15:51:21.774 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libfontenc-1.1.3-17.el9.x86_64 124/285 2024-06-04T15:51:21.775 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libgexiv2-0.12.3-1.el9.x86_64 125/285 2024-06-04T15:51:21.775 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libglvnd-1:1.3.4-1.el9.x86_64 126/285 2024-06-04T15:51:21.775 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libglvnd-egl-1:1.3.4-1.el9.x86_64 127/285 2024-06-04T15:51:21.775 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libglvnd-glx-1:1.3.4-1.el9.x86_64 128/285 2024-06-04T15:51:21.775 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libgsf-1.14.47-5.el9.x86_64 129/285 2024-06-04T15:51:21.775 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libgxps-0.3.2-3.el9.x86_64 130/285 2024-06-04T15:51:21.775 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libiptcdata-1.0.5-9.el9.x86_64 131/285 2024-06-04T15:51:21.775 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libldac-2.0.2.3-10.el9.x86_64 132/285 2024-06-04T15:51:21.775 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libnotify-0.7.9-8.el9.x86_64 133/285 2024-06-04T15:51:21.775 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libogg-2:1.3.4-6.el9.x86_64 134/285 2024-06-04T15:51:21.775 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libosinfo-1.10.0-1.el9.x86_64 135/285 2024-06-04T15:51:21.776 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 136/285 2024-06-04T15:51:21.776 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 137/285 2024-06-04T15:51:21.776 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 138/285 2024-06-04T15:51:21.776 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libsbc-1.4-9.el9.x86_64 139/285 2024-06-04T15:51:21.776 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libsndfile-1.0.31-8.el9.x86_64 140/285 2024-06-04T15:51:21.776 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libtheora-1:1.1.1-31.el9.x86_64 141/285 2024-06-04T15:51:21.776 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libtiff-4.4.0-12.el9.x86_64 142/285 2024-06-04T15:51:21.776 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libtool-ltdl-2.4.6-45.el9.x86_64 143/285 2024-06-04T15:51:21.776 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libtracker-sparql-3.1.2-3.el9.x86_64 144/285 2024-06-04T15:51:21.776 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libvisual-1:0.4.0-34.el9.x86_64 145/285 2024-06-04T15:51:21.776 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libvorbis-1:1.3.7-5.el9.x86_64 146/285 2024-06-04T15:51:21.776 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libwayland-client-1.21.0-1.el9.x86_64 147/285 2024-06-04T15:51:21.776 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libwayland-cursor-1.21.0-1.el9.x86_64 148/285 2024-06-04T15:51:21.776 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libwayland-egl-1.21.0-1.el9.x86_64 149/285 2024-06-04T15:51:21.777 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libwayland-server-1.21.0-1.el9.x86_64 150/285 2024-06-04T15:51:21.777 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libwebp-1.2.0-8.el9.x86_64 151/285 2024-06-04T15:51:21.777 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libxkbcommon-1.0.3-4.el9.x86_64 152/285 2024-06-04T15:51:21.777 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libxshmfence-1.3-10.el9.x86_64 153/285 2024-06-04T15:51:21.777 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : low-memory-monitor-2.1-4.el9.x86_64 154/285 2024-06-04T15:51:21.777 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 155/285 2024-06-04T15:51:21.777 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : lua-5.4.4-4.el9.x86_64 156/285 2024-06-04T15:51:21.777 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : lua-posix-35.0-8.el9.x86_64 157/285 2024-06-04T15:51:21.777 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : maven-1:3.6.3-15.el9.noarch 158/285 2024-06-04T15:51:21.777 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : maven-lib-1:3.6.3-15.el9.noarch 159/285 2024-06-04T15:51:21.777 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : maven-openjdk11-1:3.6.3-15.el9.noarch 160/285 2024-06-04T15:51:21.777 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : maven-resolver-1:1.6.1-10.el9.noarch 161/285 2024-06-04T15:51:21.778 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : maven-shared-utils-3.3.4-3.el9.noarch 162/285 2024-06-04T15:51:21.778 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : maven-wagon-3.4.2-7.el9.noarch 163/285 2024-06-04T15:51:21.778 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : mesa-libEGL-23.3.3-1.el9.x86_64 164/285 2024-06-04T15:51:21.778 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : mesa-libGL-23.3.3-1.el9.x86_64 165/285 2024-06-04T15:51:21.778 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : mesa-libgbm-23.3.3-1.el9.x86_64 166/285 2024-06-04T15:51:21.778 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : mesa-libglapi-23.3.3-1.el9.x86_64 167/285 2024-06-04T15:51:21.778 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : mkfontscale-1.2.1-3.el9.x86_64 168/285 2024-06-04T15:51:21.778 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 169/285 2024-06-04T15:51:21.778 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 170/285 2024-06-04T15:51:21.778 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : openjpeg2-2.4.0-7.el9.x86_64 171/285 2024-06-04T15:51:21.778 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : opus-1.3.1-10.el9.x86_64 172/285 2024-06-04T15:51:21.778 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : orc-0.4.31-6.el9.x86_64 173/285 2024-06-04T15:51:21.779 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : osinfo-db-20231215-1.el9.noarch 174/285 2024-06-04T15:51:21.779 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : osinfo-db-tools-1.10.0-1.el9.x86_64 175/285 2024-06-04T15:51:21.779 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ostree-libs-2024.6-1.el9.x86_64 176/285 2024-06-04T15:51:21.779 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : p11-kit-server-0.25.3-2.el9.x86_64 177/285 2024-06-04T15:51:21.779 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : pipewire-1.0.1-1.el9.x86_64 178/285 2024-06-04T15:51:21.779 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : pipewire-alsa-1.0.1-1.el9.x86_64 179/285 2024-06-04T15:51:21.779 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : pipewire-jack-audio-connection-kit-1.0.1-1.el9.x 180/285 2024-06-04T15:51:21.779 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : pipewire-jack-audio-connection-kit-libs-1.0.1-1. 181/285 2024-06-04T15:51:21.779 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : pipewire-libs-1.0.1-1.el9.x86_64 182/285 2024-06-04T15:51:21.779 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : pipewire-pulseaudio-1.0.1-1.el9.x86_64 183/285 2024-06-04T15:51:21.779 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : plexus-cipher-1.7-27.el9.noarch 184/285 2024-06-04T15:51:21.779 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : plexus-classworlds-2.6.0-11.el9.noarch 185/285 2024-06-04T15:51:21.779 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : plexus-containers-component-annotations-2.1.0-10 186/285 2024-06-04T15:51:21.780 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : plexus-interpolation-1.26-11.el9.noarch 187/285 2024-06-04T15:51:21.780 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : plexus-sec-dispatcher-1.4-37.el9.noarch 188/285 2024-06-04T15:51:21.780 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : plexus-utils-3.3.0-10.el9.noarch 189/285 2024-06-04T15:51:21.780 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : poppler-21.01.0-20.el9.x86_64 190/285 2024-06-04T15:51:21.780 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : poppler-data-0.4.9-9.el9.noarch 191/285 2024-06-04T15:51:21.780 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : poppler-glib-21.01.0-20.el9.x86_64 192/285 2024-06-04T15:51:21.780 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 193/285 2024-06-04T15:51:21.780 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : publicsuffix-list-20210518-3.el9.noarch 194/285 2024-06-04T15:51:21.780 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : pulseaudio-libs-15.0-2.el9.x86_64 195/285 2024-06-04T15:51:21.780 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 196/285 2024-06-04T15:51:21.780 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 197/285 2024-06-04T15:51:21.780 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 198/285 2024-06-04T15:51:21.780 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 199/285 2024-06-04T15:51:21.780 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 200/285 2024-06-04T15:51:21.781 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 201/285 2024-06-04T15:51:21.781 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 202/285 2024-06-04T15:51:21.781 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 203/285 2024-06-04T15:51:21.781 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 204/285 2024-06-04T15:51:21.781 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 205/285 2024-06-04T15:51:21.781 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 206/285 2024-06-04T15:51:21.781 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 207/285 2024-06-04T15:51:21.781 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 208/285 2024-06-04T15:51:21.781 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 209/285 2024-06-04T15:51:21.781 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 210/285 2024-06-04T15:51:21.781 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 211/285 2024-06-04T15:51:21.781 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 212/285 2024-06-04T15:51:21.781 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 213/285 2024-06-04T15:51:21.781 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 214/285 2024-06-04T15:51:21.782 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 215/285 2024-06-04T15:51:21.782 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 216/285 2024-06-04T15:51:21.782 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 217/285 2024-06-04T15:51:21.782 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : rtkit-0.11-28.el9.x86_64 218/285 2024-06-04T15:51:21.782 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : sisu-1:0.3.4-10.el9.noarch 219/285 2024-06-04T15:51:21.782 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : slf4j-1.7.30-13.el9.noarch 220/285 2024-06-04T15:51:21.782 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 221/285 2024-06-04T15:51:21.782 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : sound-theme-freedesktop-0.8-17.el9.noarch 222/285 2024-06-04T15:51:21.782 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : totem-pl-parser-3.26.6-2.el9.x86_64 223/285 2024-06-04T15:51:21.782 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : tracker-3.1.2-3.el9.x86_64 224/285 2024-06-04T15:51:21.782 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : tracker-miners-3.1.2-4.el9.x86_64 225/285 2024-06-04T15:51:21.782 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ttmkfdir-3.0.9-65.el9.x86_64 226/285 2024-06-04T15:51:21.782 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : tzdata-java-2024a-2.el9.noarch 227/285 2024-06-04T15:51:21.783 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : upower-0.99.11-11.el9.x86_64 228/285 2024-06-04T15:51:21.783 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : webrtc-audio-processing-0.3.1-8.el9.x86_64 229/285 2024-06-04T15:51:21.783 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : wireplumber-0.4.14-1.el9.x86_64 230/285 2024-06-04T15:51:21.783 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : wireplumber-libs-0.4.14-1.el9.x86_64 231/285 2024-06-04T15:51:21.783 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : xdg-dbus-proxy-0.1.3-1.el9.x86_64 232/285 2024-06-04T15:51:21.783 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : xdg-desktop-portal-1.12.6-1.el9.x86_64 233/285 2024-06-04T15:51:21.783 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : xdg-desktop-portal-gtk-1.12.0-3.el9.x86_64 234/285 2024-06-04T15:51:21.783 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : xkeyboard-config-2.33-2.el9.noarch 235/285 2024-06-04T15:51:21.783 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 236/285 2024-06-04T15:51:21.783 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : xorg-x11-fonts-Type1-7.5-33.el9.noarch 237/285 2024-06-04T15:51:21.783 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 238/285 2024-06-04T15:51:21.783 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 239/285 2024-06-04T15:51:21.783 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 240/285 2024-06-04T15:51:21.784 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 241/285 2024-06-04T15:51:21.784 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 242/285 2024-06-04T15:51:21.784 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 243/285 2024-06-04T15:51:21.784 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 244/285 2024-06-04T15:51:21.784 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 245/285 2024-06-04T15:51:21.784 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 246/285 2024-06-04T15:51:21.784 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 247/285 2024-06-04T15:51:21.784 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 248/285 2024-06-04T15:51:21.784 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 249/285 2024-06-04T15:51:21.784 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 250/285 2024-06-04T15:51:21.784 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 251/285 2024-06-04T15:51:21.784 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 252/285 2024-06-04T15:51:21.784 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 253/285 2024-06-04T15:51:21.784 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 254/285 2024-06-04T15:51:21.784 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 255/285 2024-06-04T15:51:21.785 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 256/285 2024-06-04T15:51:21.785 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 257/285 2024-06-04T15:51:21.785 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 258/285 2024-06-04T15:51:21.785 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 259/285 2024-06-04T15:51:21.785 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 260/285 2024-06-04T15:51:21.785 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 261/285 2024-06-04T15:51:21.785 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 262/285 2024-06-04T15:51:21.785 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 263/285 2024-06-04T15:51:21.785 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 264/285 2024-06-04T15:51:21.785 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 265/285 2024-06-04T15:51:21.785 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 266/285 2024-06-04T15:51:21.785 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 267/285 2024-06-04T15:51:21.785 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 268/285 2024-06-04T15:51:21.785 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 269/285 2024-06-04T15:51:21.786 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 270/285 2024-06-04T15:51:21.786 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 271/285 2024-06-04T15:51:21.786 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 272/285 2024-06-04T15:51:21.786 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 273/285 2024-06-04T15:51:21.786 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 274/285 2024-06-04T15:51:21.786 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 275/285 2024-06-04T15:51:21.786 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 276/285 2024-06-04T15:51:21.786 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 277/285 2024-06-04T15:51:21.786 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 278/285 2024-06-04T15:51:21.786 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : re2-1:20211101-3.el9.x86_64 279/285 2024-06-04T15:51:21.786 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : s3cmd-2.4.0-1.el9.noarch 280/285 2024-06-04T15:51:21.786 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 281/285 2024-06-04T15:51:21.787 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : librados2-2:19.0.0-4027.g65533a90.el9.x86_64 282/285 2024-06-04T15:51:21.787 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 283/285 2024-06-04T15:51:21.787 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : librbd1-2:19.0.0-4027.g65533a90.el9.x86_64 284/285 2024-06-04T15:51:24.060 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 285/285 2024-06-04T15:51:24.060 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-06-04T15:51:24.060 INFO:teuthology.orchestra.run.smithi177.stdout:Upgraded: 2024-06-04T15:51:24.060 INFO:teuthology.orchestra.run.smithi177.stdout: librados2-2:19.0.0-4027.g65533a90.el9.x86_64 2024-06-04T15:51:24.060 INFO:teuthology.orchestra.run.smithi177.stdout: librbd1-2:19.0.0-4027.g65533a90.el9.x86_64 2024-06-04T15:51:24.061 INFO:teuthology.orchestra.run.smithi177.stdout:Installed: 2024-06-04T15:51:24.061 INFO:teuthology.orchestra.run.smithi177.stdout: ModemManager-glib-1.20.2-1.el9.x86_64 2024-06-04T15:51:24.061 INFO:teuthology.orchestra.run.smithi177.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-06-04T15:51:24.061 INFO:teuthology.orchestra.run.smithi177.stdout: adwaita-cursor-theme-40.1.1-3.el9.noarch 2024-06-04T15:51:24.061 INFO:teuthology.orchestra.run.smithi177.stdout: adwaita-icon-theme-40.1.1-3.el9.noarch 2024-06-04T15:51:24.061 INFO:teuthology.orchestra.run.smithi177.stdout: alsa-lib-1.2.10-2.el9.x86_64 2024-06-04T15:51:24.061 INFO:teuthology.orchestra.run.smithi177.stdout: apache-commons-cli-1.4-17.el9.noarch 2024-06-04T15:51:24.061 INFO:teuthology.orchestra.run.smithi177.stdout: apache-commons-codec-1.15-7.el9.noarch 2024-06-04T15:51:24.061 INFO:teuthology.orchestra.run.smithi177.stdout: apache-commons-io-1:2.8.0-8.el9.noarch 2024-06-04T15:51:24.061 INFO:teuthology.orchestra.run.smithi177.stdout: apache-commons-lang3-3.12.0-6.el9.noarch 2024-06-04T15:51:24.061 INFO:teuthology.orchestra.run.smithi177.stdout: at-spi2-atk-2.38.0-4.el9.x86_64 2024-06-04T15:51:24.061 INFO:teuthology.orchestra.run.smithi177.stdout: at-spi2-core-2.40.3-1.el9.x86_64 2024-06-04T15:51:24.061 INFO:teuthology.orchestra.run.smithi177.stdout: atinject-1.0.3-6.el9.noarch 2024-06-04T15:51:24.062 INFO:teuthology.orchestra.run.smithi177.stdout: atk-2.36.0-5.el9.x86_64 2024-06-04T15:51:24.062 INFO:teuthology.orchestra.run.smithi177.stdout: avahi-glib-0.8-20.el9.x86_64 2024-06-04T15:51:24.062 INFO:teuthology.orchestra.run.smithi177.stdout: bluez-libs-5.56-6.el9.x86_64 2024-06-04T15:51:24.062 INFO:teuthology.orchestra.run.smithi177.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-06-04T15:51:24.062 INFO:teuthology.orchestra.run.smithi177.stdout: bubblewrap-0.4.1-7.el9.x86_64 2024-06-04T15:51:24.062 INFO:teuthology.orchestra.run.smithi177.stdout: cdi-api-2.0.2-6.el9.noarch 2024-06-04T15:51:24.062 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-2:19.0.0-4027.g65533a90.el9.x86_64 2024-06-04T15:51:24.062 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-base-2:19.0.0-4027.g65533a90.el9.x86_64 2024-06-04T15:51:24.062 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-common-2:19.0.0-4027.g65533a90.el9.x86_64 2024-06-04T15:51:24.062 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-fuse-2:19.0.0-4027.g65533a90.el9.x86_64 2024-06-04T15:51:24.062 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-grafana-dashboards-2:19.0.0-4027.g65533a90.el9.noarch 2024-06-04T15:51:24.062 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-immutable-object-cache-2:19.0.0-4027.g65533a90.el9.x86_64 2024-06-04T15:51:24.062 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-mds-2:19.0.0-4027.g65533a90.el9.x86_64 2024-06-04T15:51:24.063 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-mgr-2:19.0.0-4027.g65533a90.el9.x86_64 2024-06-04T15:51:24.063 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-mgr-cephadm-2:19.0.0-4027.g65533a90.el9.noarch 2024-06-04T15:51:24.063 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-mgr-dashboard-2:19.0.0-4027.g65533a90.el9.noarch 2024-06-04T15:51:24.063 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-mgr-diskprediction-local-2:19.0.0-4027.g65533a90.el9.noarch 2024-06-04T15:51:24.063 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-mgr-modules-core-2:19.0.0-4027.g65533a90.el9.noarch 2024-06-04T15:51:24.063 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-mgr-rook-2:19.0.0-4027.g65533a90.el9.noarch 2024-06-04T15:51:24.063 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-mon-2:19.0.0-4027.g65533a90.el9.x86_64 2024-06-04T15:51:24.063 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-osd-2:19.0.0-4027.g65533a90.el9.x86_64 2024-06-04T15:51:24.063 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-prometheus-alerts-2:19.0.0-4027.g65533a90.el9.noarch 2024-06-04T15:51:24.063 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-radosgw-2:19.0.0-4027.g65533a90.el9.x86_64 2024-06-04T15:51:24.063 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-selinux-2:19.0.0-4027.g65533a90.el9.x86_64 2024-06-04T15:51:24.063 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-test-2:19.0.0-4027.g65533a90.el9.x86_64 2024-06-04T15:51:24.063 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-volume-2:19.0.0-4027.g65533a90.el9.noarch 2024-06-04T15:51:24.064 INFO:teuthology.orchestra.run.smithi177.stdout: cephadm-2:19.0.0-4027.g65533a90.el9.noarch 2024-06-04T15:51:24.064 INFO:teuthology.orchestra.run.smithi177.stdout: colord-libs-1.4.5-4.el9.x86_64 2024-06-04T15:51:24.064 INFO:teuthology.orchestra.run.smithi177.stdout: composefs-libs-1.0.3-2.el9.x86_64 2024-06-04T15:51:24.064 INFO:teuthology.orchestra.run.smithi177.stdout: copy-jdk-configs-4.0-3.el9.noarch 2024-06-04T15:51:24.064 INFO:teuthology.orchestra.run.smithi177.stdout: cups-libs-1:2.3.3op2-26.el9.x86_64 2024-06-04T15:51:24.064 INFO:teuthology.orchestra.run.smithi177.stdout: dconf-0.40.0-6.el9.x86_64 2024-06-04T15:51:24.064 INFO:teuthology.orchestra.run.smithi177.stdout: exempi-2.6.0-0.2.20211007gite23c213.el9.x86_64 2024-06-04T15:51:24.064 INFO:teuthology.orchestra.run.smithi177.stdout: exiv2-0.27.5-2.el9.x86_64 2024-06-04T15:51:24.064 INFO:teuthology.orchestra.run.smithi177.stdout: exiv2-libs-0.27.5-2.el9.x86_64 2024-06-04T15:51:24.064 INFO:teuthology.orchestra.run.smithi177.stdout: fdk-aac-free-2.0.0-8.el9.x86_64 2024-06-04T15:51:24.064 INFO:teuthology.orchestra.run.smithi177.stdout: flac-libs-1.3.3-12.el9.x86_64 2024-06-04T15:51:24.064 INFO:teuthology.orchestra.run.smithi177.stdout: flatpak-1.12.8-1.el9.x86_64 2024-06-04T15:51:24.064 INFO:teuthology.orchestra.run.smithi177.stdout: flatpak-selinux-1.12.8-1.el9.noarch 2024-06-04T15:51:24.065 INFO:teuthology.orchestra.run.smithi177.stdout: flatpak-session-helper-1.12.8-1.el9.x86_64 2024-06-04T15:51:24.065 INFO:teuthology.orchestra.run.smithi177.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-06-04T15:51:24.065 INFO:teuthology.orchestra.run.smithi177.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-06-04T15:51:24.065 INFO:teuthology.orchestra.run.smithi177.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-06-04T15:51:24.065 INFO:teuthology.orchestra.run.smithi177.stdout: fuse-2.9.9-15.el9.x86_64 2024-06-04T15:51:24.065 INFO:teuthology.orchestra.run.smithi177.stdout: gdk-pixbuf2-modules-2.42.6-3.el9.x86_64 2024-06-04T15:51:24.065 INFO:teuthology.orchestra.run.smithi177.stdout: geoclue2-2.6.0-7.el9.x86_64 2024-06-04T15:51:24.065 INFO:teuthology.orchestra.run.smithi177.stdout: giflib-5.2.1-9.el9.x86_64 2024-06-04T15:51:24.065 INFO:teuthology.orchestra.run.smithi177.stdout: google-guice-4.2.3-9.el9.noarch 2024-06-04T15:51:24.065 INFO:teuthology.orchestra.run.smithi177.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-06-04T15:51:24.065 INFO:teuthology.orchestra.run.smithi177.stdout: graphene-1.10.6-2.el9.x86_64 2024-06-04T15:51:24.065 INFO:teuthology.orchestra.run.smithi177.stdout: grpc-data-1.46.7-10.el9.noarch 2024-06-04T15:51:24.065 INFO:teuthology.orchestra.run.smithi177.stdout: gsm-1.0.19-6.el9.x86_64 2024-06-04T15:51:24.066 INFO:teuthology.orchestra.run.smithi177.stdout: gstreamer1-1.22.1-2.el9.x86_64 2024-06-04T15:51:24.066 INFO:teuthology.orchestra.run.smithi177.stdout: gstreamer1-plugins-base-1.22.1-2.el9.x86_64 2024-06-04T15:51:24.066 INFO:teuthology.orchestra.run.smithi177.stdout: gtk-update-icon-cache-3.24.31-2.el9.x86_64 2024-06-04T15:51:24.066 INFO:teuthology.orchestra.run.smithi177.stdout: gtk3-3.24.31-2.el9.x86_64 2024-06-04T15:51:24.066 INFO:teuthology.orchestra.run.smithi177.stdout: guava-30.1-6.el9.noarch 2024-06-04T15:51:24.066 INFO:teuthology.orchestra.run.smithi177.stdout: hicolor-icon-theme-0.17-13.el9.noarch 2024-06-04T15:51:24.066 INFO:teuthology.orchestra.run.smithi177.stdout: httpcomponents-client-4.5.13-3.el9.noarch 2024-06-04T15:51:24.066 INFO:teuthology.orchestra.run.smithi177.stdout: httpcomponents-core-4.4.13-7.el9.noarch 2024-06-04T15:51:24.066 INFO:teuthology.orchestra.run.smithi177.stdout: iso-codes-4.6.0-3.el9.noarch 2024-06-04T15:51:24.066 INFO:teuthology.orchestra.run.smithi177.stdout: jakarta-annotations-1.3.5-13.el9.noarch 2024-06-04T15:51:24.066 INFO:teuthology.orchestra.run.smithi177.stdout: jansi-2.3.3-6.el9.x86_64 2024-06-04T15:51:24.066 INFO:teuthology.orchestra.run.smithi177.stdout: java-11-openjdk-1:11.0.20.1.1-2.el9.x86_64 2024-06-04T15:51:24.066 INFO:teuthology.orchestra.run.smithi177.stdout: java-11-openjdk-devel-1:11.0.20.1.1-2.el9.x86_64 2024-06-04T15:51:24.067 INFO:teuthology.orchestra.run.smithi177.stdout: java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86_64 2024-06-04T15:51:24.067 INFO:teuthology.orchestra.run.smithi177.stdout: javapackages-filesystem-6.0.0-4.el9.noarch 2024-06-04T15:51:24.067 INFO:teuthology.orchestra.run.smithi177.stdout: jbigkit-libs-2.1-23.el9.x86_64 2024-06-04T15:51:24.067 INFO:teuthology.orchestra.run.smithi177.stdout: jcl-over-slf4j-1.7.30-13.el9.noarch 2024-06-04T15:51:24.067 INFO:teuthology.orchestra.run.smithi177.stdout: jsoup-1.13.1-10.el9.noarch 2024-06-04T15:51:24.067 INFO:teuthology.orchestra.run.smithi177.stdout: jsr-305-3.0.2-6.el9.noarch 2024-06-04T15:51:24.067 INFO:teuthology.orchestra.run.smithi177.stdout: lcms2-2.12-3.el9.x86_64 2024-06-04T15:51:24.067 INFO:teuthology.orchestra.run.smithi177.stdout: libX11-xcb-1.7.0-9.el9.x86_64 2024-06-04T15:51:24.067 INFO:teuthology.orchestra.run.smithi177.stdout: libXcomposite-0.4.5-7.el9.x86_64 2024-06-04T15:51:24.067 INFO:teuthology.orchestra.run.smithi177.stdout: libXcursor-1.2.0-7.el9.x86_64 2024-06-04T15:51:24.067 INFO:teuthology.orchestra.run.smithi177.stdout: libXdamage-1.1.5-7.el9.x86_64 2024-06-04T15:51:24.067 INFO:teuthology.orchestra.run.smithi177.stdout: libXfixes-5.0.3-16.el9.x86_64 2024-06-04T15:51:24.067 INFO:teuthology.orchestra.run.smithi177.stdout: libXi-1.7.10-8.el9.x86_64 2024-06-04T15:51:24.068 INFO:teuthology.orchestra.run.smithi177.stdout: libXinerama-1.1.4-10.el9.x86_64 2024-06-04T15:51:24.068 INFO:teuthology.orchestra.run.smithi177.stdout: libXrandr-1.5.2-8.el9.x86_64 2024-06-04T15:51:24.068 INFO:teuthology.orchestra.run.smithi177.stdout: libXtst-1.2.3-16.el9.x86_64 2024-06-04T15:51:24.068 INFO:teuthology.orchestra.run.smithi177.stdout: libXv-1.0.11-16.el9.x86_64 2024-06-04T15:51:24.068 INFO:teuthology.orchestra.run.smithi177.stdout: libXxf86vm-1.1.4-18.el9.x86_64 2024-06-04T15:51:24.068 INFO:teuthology.orchestra.run.smithi177.stdout: libarrow-9.0.0-11.el9.x86_64 2024-06-04T15:51:24.068 INFO:teuthology.orchestra.run.smithi177.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-06-04T15:51:24.068 INFO:teuthology.orchestra.run.smithi177.stdout: libasyncns-0.8-22.el9.x86_64 2024-06-04T15:51:24.068 INFO:teuthology.orchestra.run.smithi177.stdout: libcanberra-0.30-27.el9.x86_64 2024-06-04T15:51:24.068 INFO:teuthology.orchestra.run.smithi177.stdout: libcanberra-gtk3-0.30-27.el9.x86_64 2024-06-04T15:51:24.068 INFO:teuthology.orchestra.run.smithi177.stdout: libcephfs-devel-2:19.0.0-4027.g65533a90.el9.x86_64 2024-06-04T15:51:24.068 INFO:teuthology.orchestra.run.smithi177.stdout: libcephfs2-2:19.0.0-4027.g65533a90.el9.x86_64 2024-06-04T15:51:24.068 INFO:teuthology.orchestra.run.smithi177.stdout: libcephsqlite-2:19.0.0-4027.g65533a90.el9.x86_64 2024-06-04T15:51:24.069 INFO:teuthology.orchestra.run.smithi177.stdout: libdrm-2.4.117-1.el9.x86_64 2024-06-04T15:51:24.069 INFO:teuthology.orchestra.run.smithi177.stdout: libepoxy-1.5.5-4.el9.x86_64 2024-06-04T15:51:24.069 INFO:teuthology.orchestra.run.smithi177.stdout: libexif-0.6.22-6.el9.x86_64 2024-06-04T15:51:24.069 INFO:teuthology.orchestra.run.smithi177.stdout: libfontenc-1.1.3-17.el9.x86_64 2024-06-04T15:51:24.069 INFO:teuthology.orchestra.run.smithi177.stdout: libgexiv2-0.12.3-1.el9.x86_64 2024-06-04T15:51:24.069 INFO:teuthology.orchestra.run.smithi177.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-06-04T15:51:24.069 INFO:teuthology.orchestra.run.smithi177.stdout: libglvnd-1:1.3.4-1.el9.x86_64 2024-06-04T15:51:24.069 INFO:teuthology.orchestra.run.smithi177.stdout: libglvnd-egl-1:1.3.4-1.el9.x86_64 2024-06-04T15:51:24.069 INFO:teuthology.orchestra.run.smithi177.stdout: libglvnd-glx-1:1.3.4-1.el9.x86_64 2024-06-04T15:51:24.069 INFO:teuthology.orchestra.run.smithi177.stdout: libgsf-1.14.47-5.el9.x86_64 2024-06-04T15:51:24.069 INFO:teuthology.orchestra.run.smithi177.stdout: libgxps-0.3.2-3.el9.x86_64 2024-06-04T15:51:24.069 INFO:teuthology.orchestra.run.smithi177.stdout: libiptcdata-1.0.5-9.el9.x86_64 2024-06-04T15:51:24.070 INFO:teuthology.orchestra.run.smithi177.stdout: libldac-2.0.2.3-10.el9.x86_64 2024-06-04T15:51:24.070 INFO:teuthology.orchestra.run.smithi177.stdout: libnotify-0.7.9-8.el9.x86_64 2024-06-04T15:51:24.070 INFO:teuthology.orchestra.run.smithi177.stdout: liboath-2.6.7-2.el9.x86_64 2024-06-04T15:51:24.070 INFO:teuthology.orchestra.run.smithi177.stdout: libogg-2:1.3.4-6.el9.x86_64 2024-06-04T15:51:24.071 INFO:teuthology.orchestra.run.smithi177.stdout: libosinfo-1.10.0-1.el9.x86_64 2024-06-04T15:51:24.071 INFO:teuthology.orchestra.run.smithi177.stdout: libpciaccess-0.16-7.el9.x86_64 2024-06-04T15:51:24.071 INFO:teuthology.orchestra.run.smithi177.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-06-04T15:51:24.071 INFO:teuthology.orchestra.run.smithi177.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-06-04T15:51:24.071 INFO:teuthology.orchestra.run.smithi177.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-06-04T15:51:24.071 INFO:teuthology.orchestra.run.smithi177.stdout: librados-devel-2:19.0.0-4027.g65533a90.el9.x86_64 2024-06-04T15:51:24.071 INFO:teuthology.orchestra.run.smithi177.stdout: libradosstriper1-2:19.0.0-4027.g65533a90.el9.x86_64 2024-06-04T15:51:24.071 INFO:teuthology.orchestra.run.smithi177.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-06-04T15:51:24.071 INFO:teuthology.orchestra.run.smithi177.stdout: librgw2-2:19.0.0-4027.g65533a90.el9.x86_64 2024-06-04T15:51:24.071 INFO:teuthology.orchestra.run.smithi177.stdout: libsbc-1.4-9.el9.x86_64 2024-06-04T15:51:24.071 INFO:teuthology.orchestra.run.smithi177.stdout: libsndfile-1.0.31-8.el9.x86_64 2024-06-04T15:51:24.071 INFO:teuthology.orchestra.run.smithi177.stdout: libtheora-1:1.1.1-31.el9.x86_64 2024-06-04T15:51:24.071 INFO:teuthology.orchestra.run.smithi177.stdout: libtiff-4.4.0-12.el9.x86_64 2024-06-04T15:51:24.071 INFO:teuthology.orchestra.run.smithi177.stdout: libtool-ltdl-2.4.6-45.el9.x86_64 2024-06-04T15:51:24.072 INFO:teuthology.orchestra.run.smithi177.stdout: libtracker-sparql-3.1.2-3.el9.x86_64 2024-06-04T15:51:24.072 INFO:teuthology.orchestra.run.smithi177.stdout: libunwind-1.6.2-1.el9.x86_64 2024-06-04T15:51:24.072 INFO:teuthology.orchestra.run.smithi177.stdout: libvisual-1:0.4.0-34.el9.x86_64 2024-06-04T15:51:24.072 INFO:teuthology.orchestra.run.smithi177.stdout: libvorbis-1:1.3.7-5.el9.x86_64 2024-06-04T15:51:24.072 INFO:teuthology.orchestra.run.smithi177.stdout: libwayland-client-1.21.0-1.el9.x86_64 2024-06-04T15:51:24.072 INFO:teuthology.orchestra.run.smithi177.stdout: libwayland-cursor-1.21.0-1.el9.x86_64 2024-06-04T15:51:24.072 INFO:teuthology.orchestra.run.smithi177.stdout: libwayland-egl-1.21.0-1.el9.x86_64 2024-06-04T15:51:24.072 INFO:teuthology.orchestra.run.smithi177.stdout: libwayland-server-1.21.0-1.el9.x86_64 2024-06-04T15:51:24.072 INFO:teuthology.orchestra.run.smithi177.stdout: libwebp-1.2.0-8.el9.x86_64 2024-06-04T15:51:24.073 INFO:teuthology.orchestra.run.smithi177.stdout: libxkbcommon-1.0.3-4.el9.x86_64 2024-06-04T15:51:24.073 INFO:teuthology.orchestra.run.smithi177.stdout: libxshmfence-1.3-10.el9.x86_64 2024-06-04T15:51:24.073 INFO:teuthology.orchestra.run.smithi177.stdout: lksctp-tools-1.0.19-2.el9.x86_64 2024-06-04T15:51:24.073 INFO:teuthology.orchestra.run.smithi177.stdout: low-memory-monitor-2.1-4.el9.x86_64 2024-06-04T15:51:24.073 INFO:teuthology.orchestra.run.smithi177.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-06-04T15:51:24.073 INFO:teuthology.orchestra.run.smithi177.stdout: lua-5.4.4-4.el9.x86_64 2024-06-04T15:51:24.073 INFO:teuthology.orchestra.run.smithi177.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-06-04T15:51:24.073 INFO:teuthology.orchestra.run.smithi177.stdout: lua-posix-35.0-8.el9.x86_64 2024-06-04T15:51:24.073 INFO:teuthology.orchestra.run.smithi177.stdout: luarocks-3.9.2-5.el9.noarch 2024-06-04T15:51:24.073 INFO:teuthology.orchestra.run.smithi177.stdout: maven-1:3.6.3-15.el9.noarch 2024-06-04T15:51:24.073 INFO:teuthology.orchestra.run.smithi177.stdout: maven-lib-1:3.6.3-15.el9.noarch 2024-06-04T15:51:24.073 INFO:teuthology.orchestra.run.smithi177.stdout: maven-openjdk11-1:3.6.3-15.el9.noarch 2024-06-04T15:51:24.073 INFO:teuthology.orchestra.run.smithi177.stdout: maven-resolver-1:1.6.1-10.el9.noarch 2024-06-04T15:51:24.074 INFO:teuthology.orchestra.run.smithi177.stdout: maven-shared-utils-3.3.4-3.el9.noarch 2024-06-04T15:51:24.074 INFO:teuthology.orchestra.run.smithi177.stdout: maven-wagon-3.4.2-7.el9.noarch 2024-06-04T15:51:24.074 INFO:teuthology.orchestra.run.smithi177.stdout: mesa-libEGL-23.3.3-1.el9.x86_64 2024-06-04T15:51:24.074 INFO:teuthology.orchestra.run.smithi177.stdout: mesa-libGL-23.3.3-1.el9.x86_64 2024-06-04T15:51:24.074 INFO:teuthology.orchestra.run.smithi177.stdout: mesa-libgbm-23.3.3-1.el9.x86_64 2024-06-04T15:51:24.074 INFO:teuthology.orchestra.run.smithi177.stdout: mesa-libglapi-23.3.3-1.el9.x86_64 2024-06-04T15:51:24.074 INFO:teuthology.orchestra.run.smithi177.stdout: mkfontscale-1.2.1-3.el9.x86_64 2024-06-04T15:51:24.074 INFO:teuthology.orchestra.run.smithi177.stdout: openblas-0.3.21-2.el9.x86_64 2024-06-04T15:51:24.074 INFO:teuthology.orchestra.run.smithi177.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-06-04T15:51:24.074 INFO:teuthology.orchestra.run.smithi177.stdout: openjpeg2-2.4.0-7.el9.x86_64 2024-06-04T15:51:24.074 INFO:teuthology.orchestra.run.smithi177.stdout: opus-1.3.1-10.el9.x86_64 2024-06-04T15:51:24.074 INFO:teuthology.orchestra.run.smithi177.stdout: orc-0.4.31-6.el9.x86_64 2024-06-04T15:51:24.074 INFO:teuthology.orchestra.run.smithi177.stdout: osinfo-db-20231215-1.el9.noarch 2024-06-04T15:51:24.075 INFO:teuthology.orchestra.run.smithi177.stdout: osinfo-db-tools-1.10.0-1.el9.x86_64 2024-06-04T15:51:24.075 INFO:teuthology.orchestra.run.smithi177.stdout: ostree-libs-2024.6-1.el9.x86_64 2024-06-04T15:51:24.075 INFO:teuthology.orchestra.run.smithi177.stdout: p11-kit-server-0.25.3-2.el9.x86_64 2024-06-04T15:51:24.075 INFO:teuthology.orchestra.run.smithi177.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-06-04T15:51:24.075 INFO:teuthology.orchestra.run.smithi177.stdout: pipewire-1.0.1-1.el9.x86_64 2024-06-04T15:51:24.075 INFO:teuthology.orchestra.run.smithi177.stdout: pipewire-alsa-1.0.1-1.el9.x86_64 2024-06-04T15:51:24.075 INFO:teuthology.orchestra.run.smithi177.stdout: pipewire-jack-audio-connection-kit-1.0.1-1.el9.x86_64 2024-06-04T15:51:24.075 INFO:teuthology.orchestra.run.smithi177.stdout: pipewire-jack-audio-connection-kit-libs-1.0.1-1.el9.x86_64 2024-06-04T15:51:24.075 INFO:teuthology.orchestra.run.smithi177.stdout: pipewire-libs-1.0.1-1.el9.x86_64 2024-06-04T15:51:24.075 INFO:teuthology.orchestra.run.smithi177.stdout: pipewire-pulseaudio-1.0.1-1.el9.x86_64 2024-06-04T15:51:24.075 INFO:teuthology.orchestra.run.smithi177.stdout: plexus-cipher-1.7-27.el9.noarch 2024-06-04T15:51:24.075 INFO:teuthology.orchestra.run.smithi177.stdout: plexus-classworlds-2.6.0-11.el9.noarch 2024-06-04T15:51:24.075 INFO:teuthology.orchestra.run.smithi177.stdout: plexus-containers-component-annotations-2.1.0-10.el9.noarch 2024-06-04T15:51:24.075 INFO:teuthology.orchestra.run.smithi177.stdout: plexus-interpolation-1.26-11.el9.noarch 2024-06-04T15:51:24.076 INFO:teuthology.orchestra.run.smithi177.stdout: plexus-sec-dispatcher-1.4-37.el9.noarch 2024-06-04T15:51:24.076 INFO:teuthology.orchestra.run.smithi177.stdout: plexus-utils-3.3.0-10.el9.noarch 2024-06-04T15:51:24.076 INFO:teuthology.orchestra.run.smithi177.stdout: poppler-21.01.0-20.el9.x86_64 2024-06-04T15:51:24.076 INFO:teuthology.orchestra.run.smithi177.stdout: poppler-data-0.4.9-9.el9.noarch 2024-06-04T15:51:24.076 INFO:teuthology.orchestra.run.smithi177.stdout: poppler-glib-21.01.0-20.el9.x86_64 2024-06-04T15:51:24.076 INFO:teuthology.orchestra.run.smithi177.stdout: protobuf-3.14.0-13.el9.x86_64 2024-06-04T15:51:24.076 INFO:teuthology.orchestra.run.smithi177.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-06-04T15:51:24.076 INFO:teuthology.orchestra.run.smithi177.stdout: publicsuffix-list-20210518-3.el9.noarch 2024-06-04T15:51:24.076 INFO:teuthology.orchestra.run.smithi177.stdout: pulseaudio-libs-15.0-2.el9.x86_64 2024-06-04T15:51:24.076 INFO:teuthology.orchestra.run.smithi177.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-06-04T15:51:24.077 INFO:teuthology.orchestra.run.smithi177.stdout: python3-babel-2.9.1-2.el9.noarch 2024-06-04T15:51:24.077 INFO:teuthology.orchestra.run.smithi177.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-06-04T15:51:24.077 INFO:teuthology.orchestra.run.smithi177.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-06-04T15:51:24.077 INFO:teuthology.orchestra.run.smithi177.stdout: python3-ceph-argparse-2:19.0.0-4027.g65533a90.el9.x86_64 2024-06-04T15:51:24.078 INFO:teuthology.orchestra.run.smithi177.stdout: python3-ceph-common-2:19.0.0-4027.g65533a90.el9.x86_64 2024-06-04T15:51:24.078 INFO:teuthology.orchestra.run.smithi177.stdout: python3-cephfs-2:19.0.0-4027.g65533a90.el9.x86_64 2024-06-04T15:51:24.078 INFO:teuthology.orchestra.run.smithi177.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-06-04T15:51:24.078 INFO:teuthology.orchestra.run.smithi177.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-06-04T15:51:24.078 INFO:teuthology.orchestra.run.smithi177.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-06-04T15:51:24.078 INFO:teuthology.orchestra.run.smithi177.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-06-04T15:51:24.078 INFO:teuthology.orchestra.run.smithi177.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-06-04T15:51:24.078 INFO:teuthology.orchestra.run.smithi177.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-06-04T15:51:24.078 INFO:teuthology.orchestra.run.smithi177.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-06-04T15:51:24.078 INFO:teuthology.orchestra.run.smithi177.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-06-04T15:51:24.078 INFO:teuthology.orchestra.run.smithi177.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-06-04T15:51:24.078 INFO:teuthology.orchestra.run.smithi177.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-06-04T15:51:24.079 INFO:teuthology.orchestra.run.smithi177.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-06-04T15:51:24.079 INFO:teuthology.orchestra.run.smithi177.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-06-04T15:51:24.079 INFO:teuthology.orchestra.run.smithi177.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-06-04T15:51:24.079 INFO:teuthology.orchestra.run.smithi177.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-06-04T15:51:24.079 INFO:teuthology.orchestra.run.smithi177.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-06-04T15:51:24.079 INFO:teuthology.orchestra.run.smithi177.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-06-04T15:51:24.079 INFO:teuthology.orchestra.run.smithi177.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-06-04T15:51:24.079 INFO:teuthology.orchestra.run.smithi177.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-06-04T15:51:24.079 INFO:teuthology.orchestra.run.smithi177.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-06-04T15:51:24.079 INFO:teuthology.orchestra.run.smithi177.stdout: python3-mako-1.1.4-6.el9.noarch 2024-06-04T15:51:24.079 INFO:teuthology.orchestra.run.smithi177.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-06-04T15:51:24.079 INFO:teuthology.orchestra.run.smithi177.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-06-04T15:51:24.079 INFO:teuthology.orchestra.run.smithi177.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-06-04T15:51:24.079 INFO:teuthology.orchestra.run.smithi177.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-06-04T15:51:24.080 INFO:teuthology.orchestra.run.smithi177.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-06-04T15:51:24.080 INFO:teuthology.orchestra.run.smithi177.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-06-04T15:51:24.080 INFO:teuthology.orchestra.run.smithi177.stdout: python3-packaging-20.9-5.el9.noarch 2024-06-04T15:51:24.080 INFO:teuthology.orchestra.run.smithi177.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-06-04T15:51:24.080 INFO:teuthology.orchestra.run.smithi177.stdout: python3-ply-3.11-14.el9.noarch 2024-06-04T15:51:24.080 INFO:teuthology.orchestra.run.smithi177.stdout: python3-portend-3.1.0-2.el9.noarch 2024-06-04T15:51:24.080 INFO:teuthology.orchestra.run.smithi177.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-06-04T15:51:24.080 INFO:teuthology.orchestra.run.smithi177.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-06-04T15:51:24.080 INFO:teuthology.orchestra.run.smithi177.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-06-04T15:51:24.080 INFO:teuthology.orchestra.run.smithi177.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-06-04T15:51:24.080 INFO:teuthology.orchestra.run.smithi177.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-06-04T15:51:24.080 INFO:teuthology.orchestra.run.smithi177.stdout: python3-pycparser-2.20-6.el9.noarch 2024-06-04T15:51:24.080 INFO:teuthology.orchestra.run.smithi177.stdout: python3-pytz-2021.1-5.el9.noarch 2024-06-04T15:51:24.080 INFO:teuthology.orchestra.run.smithi177.stdout: python3-rados-2:19.0.0-4027.g65533a90.el9.x86_64 2024-06-04T15:51:24.081 INFO:teuthology.orchestra.run.smithi177.stdout: python3-rbd-2:19.0.0-4027.g65533a90.el9.x86_64 2024-06-04T15:51:24.081 INFO:teuthology.orchestra.run.smithi177.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-06-04T15:51:24.081 INFO:teuthology.orchestra.run.smithi177.stdout: python3-requests-2.25.1-8.el9.noarch 2024-06-04T15:51:24.081 INFO:teuthology.orchestra.run.smithi177.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-06-04T15:51:24.081 INFO:teuthology.orchestra.run.smithi177.stdout: python3-rgw-2:19.0.0-4027.g65533a90.el9.x86_64 2024-06-04T15:51:24.081 INFO:teuthology.orchestra.run.smithi177.stdout: python3-routes-2.5.1-5.el9.noarch 2024-06-04T15:51:24.081 INFO:teuthology.orchestra.run.smithi177.stdout: python3-rsa-4.9-2.el9.noarch 2024-06-04T15:51:24.081 INFO:teuthology.orchestra.run.smithi177.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-06-04T15:51:24.081 INFO:teuthology.orchestra.run.smithi177.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-06-04T15:51:24.081 INFO:teuthology.orchestra.run.smithi177.stdout: python3-toml-0.10.2-6.el9.noarch 2024-06-04T15:51:24.081 INFO:teuthology.orchestra.run.smithi177.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-06-04T15:51:24.081 INFO:teuthology.orchestra.run.smithi177.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-06-04T15:51:24.081 INFO:teuthology.orchestra.run.smithi177.stdout: python3-webob-1.8.7-6.el9.noarch 2024-06-04T15:51:24.081 INFO:teuthology.orchestra.run.smithi177.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-06-04T15:51:24.082 INFO:teuthology.orchestra.run.smithi177.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-06-04T15:51:24.082 INFO:teuthology.orchestra.run.smithi177.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-06-04T15:51:24.082 INFO:teuthology.orchestra.run.smithi177.stdout: qatlib-24.02.0-1.el9.x86_64 2024-06-04T15:51:24.082 INFO:teuthology.orchestra.run.smithi177.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-06-04T15:51:24.082 INFO:teuthology.orchestra.run.smithi177.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-06-04T15:51:24.082 INFO:teuthology.orchestra.run.smithi177.stdout: rbd-fuse-2:19.0.0-4027.g65533a90.el9.x86_64 2024-06-04T15:51:24.082 INFO:teuthology.orchestra.run.smithi177.stdout: rbd-mirror-2:19.0.0-4027.g65533a90.el9.x86_64 2024-06-04T15:51:24.082 INFO:teuthology.orchestra.run.smithi177.stdout: rbd-nbd-2:19.0.0-4027.g65533a90.el9.x86_64 2024-06-04T15:51:24.082 INFO:teuthology.orchestra.run.smithi177.stdout: re2-1:20211101-3.el9.x86_64 2024-06-04T15:51:24.083 INFO:teuthology.orchestra.run.smithi177.stdout: rtkit-0.11-28.el9.x86_64 2024-06-04T15:51:24.083 INFO:teuthology.orchestra.run.smithi177.stdout: s3cmd-2.4.0-1.el9.noarch 2024-06-04T15:51:24.083 INFO:teuthology.orchestra.run.smithi177.stdout: sisu-1:0.3.4-10.el9.noarch 2024-06-04T15:51:24.083 INFO:teuthology.orchestra.run.smithi177.stdout: slf4j-1.7.30-13.el9.noarch 2024-06-04T15:51:24.083 INFO:teuthology.orchestra.run.smithi177.stdout: socat-1.7.4.1-5.el9.x86_64 2024-06-04T15:51:24.083 INFO:teuthology.orchestra.run.smithi177.stdout: sound-theme-freedesktop-0.8-17.el9.noarch 2024-06-04T15:51:24.083 INFO:teuthology.orchestra.run.smithi177.stdout: thrift-0.15.0-2.el9.x86_64 2024-06-04T15:51:24.083 INFO:teuthology.orchestra.run.smithi177.stdout: totem-pl-parser-3.26.6-2.el9.x86_64 2024-06-04T15:51:24.083 INFO:teuthology.orchestra.run.smithi177.stdout: tracker-3.1.2-3.el9.x86_64 2024-06-04T15:51:24.083 INFO:teuthology.orchestra.run.smithi177.stdout: tracker-miners-3.1.2-4.el9.x86_64 2024-06-04T15:51:24.083 INFO:teuthology.orchestra.run.smithi177.stdout: ttmkfdir-3.0.9-65.el9.x86_64 2024-06-04T15:51:24.083 INFO:teuthology.orchestra.run.smithi177.stdout: tzdata-java-2024a-2.el9.noarch 2024-06-04T15:51:24.083 INFO:teuthology.orchestra.run.smithi177.stdout: upower-0.99.11-11.el9.x86_64 2024-06-04T15:51:24.084 INFO:teuthology.orchestra.run.smithi177.stdout: webrtc-audio-processing-0.3.1-8.el9.x86_64 2024-06-04T15:51:24.084 INFO:teuthology.orchestra.run.smithi177.stdout: wireplumber-0.4.14-1.el9.x86_64 2024-06-04T15:51:24.084 INFO:teuthology.orchestra.run.smithi177.stdout: wireplumber-libs-0.4.14-1.el9.x86_64 2024-06-04T15:51:24.084 INFO:teuthology.orchestra.run.smithi177.stdout: xdg-dbus-proxy-0.1.3-1.el9.x86_64 2024-06-04T15:51:24.084 INFO:teuthology.orchestra.run.smithi177.stdout: xdg-desktop-portal-1.12.6-1.el9.x86_64 2024-06-04T15:51:24.084 INFO:teuthology.orchestra.run.smithi177.stdout: xdg-desktop-portal-gtk-1.12.0-3.el9.x86_64 2024-06-04T15:51:24.084 INFO:teuthology.orchestra.run.smithi177.stdout: xkeyboard-config-2.33-2.el9.noarch 2024-06-04T15:51:24.084 INFO:teuthology.orchestra.run.smithi177.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-06-04T15:51:24.085 INFO:teuthology.orchestra.run.smithi177.stdout: xorg-x11-fonts-Type1-7.5-33.el9.noarch 2024-06-04T15:51:24.085 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-06-04T15:51:24.085 INFO:teuthology.orchestra.run.smithi177.stdout:Complete! 2024-06-04T15:51:24.468 DEBUG:teuthology.parallel:result is None 2024-06-04T15:51:25.347 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 285/285 2024-06-04T15:51:25.347 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T15:51:25.347 INFO:teuthology.orchestra.run.smithi144.stdout:Upgraded: 2024-06-04T15:51:25.347 INFO:teuthology.orchestra.run.smithi144.stdout: librados2-2:19.0.0-4027.g65533a90.el9.x86_64 2024-06-04T15:51:25.347 INFO:teuthology.orchestra.run.smithi144.stdout: librbd1-2:19.0.0-4027.g65533a90.el9.x86_64 2024-06-04T15:51:25.347 INFO:teuthology.orchestra.run.smithi144.stdout:Installed: 2024-06-04T15:51:25.347 INFO:teuthology.orchestra.run.smithi144.stdout: ModemManager-glib-1.20.2-1.el9.x86_64 2024-06-04T15:51:25.348 INFO:teuthology.orchestra.run.smithi144.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-06-04T15:51:25.348 INFO:teuthology.orchestra.run.smithi144.stdout: adwaita-cursor-theme-40.1.1-3.el9.noarch 2024-06-04T15:51:25.348 INFO:teuthology.orchestra.run.smithi144.stdout: adwaita-icon-theme-40.1.1-3.el9.noarch 2024-06-04T15:51:25.348 INFO:teuthology.orchestra.run.smithi144.stdout: alsa-lib-1.2.10-2.el9.x86_64 2024-06-04T15:51:25.348 INFO:teuthology.orchestra.run.smithi144.stdout: apache-commons-cli-1.4-17.el9.noarch 2024-06-04T15:51:25.348 INFO:teuthology.orchestra.run.smithi144.stdout: apache-commons-codec-1.15-7.el9.noarch 2024-06-04T15:51:25.348 INFO:teuthology.orchestra.run.smithi144.stdout: apache-commons-io-1:2.8.0-8.el9.noarch 2024-06-04T15:51:25.348 INFO:teuthology.orchestra.run.smithi144.stdout: apache-commons-lang3-3.12.0-6.el9.noarch 2024-06-04T15:51:25.348 INFO:teuthology.orchestra.run.smithi144.stdout: at-spi2-atk-2.38.0-4.el9.x86_64 2024-06-04T15:51:25.348 INFO:teuthology.orchestra.run.smithi144.stdout: at-spi2-core-2.40.3-1.el9.x86_64 2024-06-04T15:51:25.348 INFO:teuthology.orchestra.run.smithi144.stdout: atinject-1.0.3-6.el9.noarch 2024-06-04T15:51:25.348 INFO:teuthology.orchestra.run.smithi144.stdout: atk-2.36.0-5.el9.x86_64 2024-06-04T15:51:25.348 INFO:teuthology.orchestra.run.smithi144.stdout: avahi-glib-0.8-20.el9.x86_64 2024-06-04T15:51:25.349 INFO:teuthology.orchestra.run.smithi144.stdout: bluez-libs-5.56-6.el9.x86_64 2024-06-04T15:51:25.349 INFO:teuthology.orchestra.run.smithi144.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-06-04T15:51:25.349 INFO:teuthology.orchestra.run.smithi144.stdout: bubblewrap-0.4.1-7.el9.x86_64 2024-06-04T15:51:25.349 INFO:teuthology.orchestra.run.smithi144.stdout: cdi-api-2.0.2-6.el9.noarch 2024-06-04T15:51:25.349 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-2:19.0.0-4027.g65533a90.el9.x86_64 2024-06-04T15:51:25.349 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-base-2:19.0.0-4027.g65533a90.el9.x86_64 2024-06-04T15:51:25.349 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-common-2:19.0.0-4027.g65533a90.el9.x86_64 2024-06-04T15:51:25.349 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-fuse-2:19.0.0-4027.g65533a90.el9.x86_64 2024-06-04T15:51:25.349 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-grafana-dashboards-2:19.0.0-4027.g65533a90.el9.noarch 2024-06-04T15:51:25.349 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-immutable-object-cache-2:19.0.0-4027.g65533a90.el9.x86_64 2024-06-04T15:51:25.349 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mds-2:19.0.0-4027.g65533a90.el9.x86_64 2024-06-04T15:51:25.349 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mgr-2:19.0.0-4027.g65533a90.el9.x86_64 2024-06-04T15:51:25.349 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mgr-cephadm-2:19.0.0-4027.g65533a90.el9.noarch 2024-06-04T15:51:25.350 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mgr-dashboard-2:19.0.0-4027.g65533a90.el9.noarch 2024-06-04T15:51:25.350 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mgr-diskprediction-local-2:19.0.0-4027.g65533a90.el9.noarch 2024-06-04T15:51:25.350 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mgr-modules-core-2:19.0.0-4027.g65533a90.el9.noarch 2024-06-04T15:51:25.350 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mgr-rook-2:19.0.0-4027.g65533a90.el9.noarch 2024-06-04T15:51:25.350 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mon-2:19.0.0-4027.g65533a90.el9.x86_64 2024-06-04T15:51:25.350 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-osd-2:19.0.0-4027.g65533a90.el9.x86_64 2024-06-04T15:51:25.350 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-prometheus-alerts-2:19.0.0-4027.g65533a90.el9.noarch 2024-06-04T15:51:25.350 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-radosgw-2:19.0.0-4027.g65533a90.el9.x86_64 2024-06-04T15:51:25.350 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-selinux-2:19.0.0-4027.g65533a90.el9.x86_64 2024-06-04T15:51:25.350 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-test-2:19.0.0-4027.g65533a90.el9.x86_64 2024-06-04T15:51:25.350 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-volume-2:19.0.0-4027.g65533a90.el9.noarch 2024-06-04T15:51:25.350 INFO:teuthology.orchestra.run.smithi144.stdout: cephadm-2:19.0.0-4027.g65533a90.el9.noarch 2024-06-04T15:51:25.350 INFO:teuthology.orchestra.run.smithi144.stdout: colord-libs-1.4.5-4.el9.x86_64 2024-06-04T15:51:25.351 INFO:teuthology.orchestra.run.smithi144.stdout: composefs-libs-1.0.3-2.el9.x86_64 2024-06-04T15:51:25.351 INFO:teuthology.orchestra.run.smithi144.stdout: copy-jdk-configs-4.0-3.el9.noarch 2024-06-04T15:51:25.351 INFO:teuthology.orchestra.run.smithi144.stdout: cups-libs-1:2.3.3op2-26.el9.x86_64 2024-06-04T15:51:25.351 INFO:teuthology.orchestra.run.smithi144.stdout: dconf-0.40.0-6.el9.x86_64 2024-06-04T15:51:25.351 INFO:teuthology.orchestra.run.smithi144.stdout: exempi-2.6.0-0.2.20211007gite23c213.el9.x86_64 2024-06-04T15:51:25.351 INFO:teuthology.orchestra.run.smithi144.stdout: exiv2-0.27.5-2.el9.x86_64 2024-06-04T15:51:25.351 INFO:teuthology.orchestra.run.smithi144.stdout: exiv2-libs-0.27.5-2.el9.x86_64 2024-06-04T15:51:25.351 INFO:teuthology.orchestra.run.smithi144.stdout: fdk-aac-free-2.0.0-8.el9.x86_64 2024-06-04T15:51:25.351 INFO:teuthology.orchestra.run.smithi144.stdout: flac-libs-1.3.3-12.el9.x86_64 2024-06-04T15:51:25.351 INFO:teuthology.orchestra.run.smithi144.stdout: flatpak-1.12.8-1.el9.x86_64 2024-06-04T15:51:25.351 INFO:teuthology.orchestra.run.smithi144.stdout: flatpak-selinux-1.12.8-1.el9.noarch 2024-06-04T15:51:25.351 INFO:teuthology.orchestra.run.smithi144.stdout: flatpak-session-helper-1.12.8-1.el9.x86_64 2024-06-04T15:51:25.351 INFO:teuthology.orchestra.run.smithi144.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-06-04T15:51:25.352 INFO:teuthology.orchestra.run.smithi144.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-06-04T15:51:25.352 INFO:teuthology.orchestra.run.smithi144.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-06-04T15:51:25.352 INFO:teuthology.orchestra.run.smithi144.stdout: fuse-2.9.9-15.el9.x86_64 2024-06-04T15:51:25.352 INFO:teuthology.orchestra.run.smithi144.stdout: gdk-pixbuf2-modules-2.42.6-3.el9.x86_64 2024-06-04T15:51:25.352 INFO:teuthology.orchestra.run.smithi144.stdout: geoclue2-2.6.0-7.el9.x86_64 2024-06-04T15:51:25.352 INFO:teuthology.orchestra.run.smithi144.stdout: giflib-5.2.1-9.el9.x86_64 2024-06-04T15:51:25.352 INFO:teuthology.orchestra.run.smithi144.stdout: google-guice-4.2.3-9.el9.noarch 2024-06-04T15:51:25.352 INFO:teuthology.orchestra.run.smithi144.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-06-04T15:51:25.352 INFO:teuthology.orchestra.run.smithi144.stdout: graphene-1.10.6-2.el9.x86_64 2024-06-04T15:51:25.352 INFO:teuthology.orchestra.run.smithi144.stdout: grpc-data-1.46.7-10.el9.noarch 2024-06-04T15:51:25.352 INFO:teuthology.orchestra.run.smithi144.stdout: gsm-1.0.19-6.el9.x86_64 2024-06-04T15:51:25.352 INFO:teuthology.orchestra.run.smithi144.stdout: gstreamer1-1.22.1-2.el9.x86_64 2024-06-04T15:51:25.352 INFO:teuthology.orchestra.run.smithi144.stdout: gstreamer1-plugins-base-1.22.1-2.el9.x86_64 2024-06-04T15:51:25.352 INFO:teuthology.orchestra.run.smithi144.stdout: gtk-update-icon-cache-3.24.31-2.el9.x86_64 2024-06-04T15:51:25.353 INFO:teuthology.orchestra.run.smithi144.stdout: gtk3-3.24.31-2.el9.x86_64 2024-06-04T15:51:25.353 INFO:teuthology.orchestra.run.smithi144.stdout: guava-30.1-6.el9.noarch 2024-06-04T15:51:25.353 INFO:teuthology.orchestra.run.smithi144.stdout: hicolor-icon-theme-0.17-13.el9.noarch 2024-06-04T15:51:25.353 INFO:teuthology.orchestra.run.smithi144.stdout: httpcomponents-client-4.5.13-3.el9.noarch 2024-06-04T15:51:25.353 INFO:teuthology.orchestra.run.smithi144.stdout: httpcomponents-core-4.4.13-7.el9.noarch 2024-06-04T15:51:25.353 INFO:teuthology.orchestra.run.smithi144.stdout: iso-codes-4.6.0-3.el9.noarch 2024-06-04T15:51:25.353 INFO:teuthology.orchestra.run.smithi144.stdout: jakarta-annotations-1.3.5-13.el9.noarch 2024-06-04T15:51:25.353 INFO:teuthology.orchestra.run.smithi144.stdout: jansi-2.3.3-6.el9.x86_64 2024-06-04T15:51:25.353 INFO:teuthology.orchestra.run.smithi144.stdout: java-11-openjdk-1:11.0.20.1.1-2.el9.x86_64 2024-06-04T15:51:25.353 INFO:teuthology.orchestra.run.smithi144.stdout: java-11-openjdk-devel-1:11.0.20.1.1-2.el9.x86_64 2024-06-04T15:51:25.353 INFO:teuthology.orchestra.run.smithi144.stdout: java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86_64 2024-06-04T15:51:25.353 INFO:teuthology.orchestra.run.smithi144.stdout: javapackages-filesystem-6.0.0-4.el9.noarch 2024-06-04T15:51:25.354 INFO:teuthology.orchestra.run.smithi144.stdout: jbigkit-libs-2.1-23.el9.x86_64 2024-06-04T15:51:25.354 INFO:teuthology.orchestra.run.smithi144.stdout: jcl-over-slf4j-1.7.30-13.el9.noarch 2024-06-04T15:51:25.354 INFO:teuthology.orchestra.run.smithi144.stdout: jsoup-1.13.1-10.el9.noarch 2024-06-04T15:51:25.354 INFO:teuthology.orchestra.run.smithi144.stdout: jsr-305-3.0.2-6.el9.noarch 2024-06-04T15:51:25.354 INFO:teuthology.orchestra.run.smithi144.stdout: lcms2-2.12-3.el9.x86_64 2024-06-04T15:51:25.354 INFO:teuthology.orchestra.run.smithi144.stdout: libX11-xcb-1.7.0-9.el9.x86_64 2024-06-04T15:51:25.354 INFO:teuthology.orchestra.run.smithi144.stdout: libXcomposite-0.4.5-7.el9.x86_64 2024-06-04T15:51:25.354 INFO:teuthology.orchestra.run.smithi144.stdout: libXcursor-1.2.0-7.el9.x86_64 2024-06-04T15:51:25.354 INFO:teuthology.orchestra.run.smithi144.stdout: libXdamage-1.1.5-7.el9.x86_64 2024-06-04T15:51:25.354 INFO:teuthology.orchestra.run.smithi144.stdout: libXfixes-5.0.3-16.el9.x86_64 2024-06-04T15:51:25.354 INFO:teuthology.orchestra.run.smithi144.stdout: libXi-1.7.10-8.el9.x86_64 2024-06-04T15:51:25.355 INFO:teuthology.orchestra.run.smithi144.stdout: libXinerama-1.1.4-10.el9.x86_64 2024-06-04T15:51:25.355 INFO:teuthology.orchestra.run.smithi144.stdout: libXrandr-1.5.2-8.el9.x86_64 2024-06-04T15:51:25.355 INFO:teuthology.orchestra.run.smithi144.stdout: libXtst-1.2.3-16.el9.x86_64 2024-06-04T15:51:25.355 INFO:teuthology.orchestra.run.smithi144.stdout: libXv-1.0.11-16.el9.x86_64 2024-06-04T15:51:25.355 INFO:teuthology.orchestra.run.smithi144.stdout: libXxf86vm-1.1.4-18.el9.x86_64 2024-06-04T15:51:25.355 INFO:teuthology.orchestra.run.smithi144.stdout: libarrow-9.0.0-11.el9.x86_64 2024-06-04T15:51:25.355 INFO:teuthology.orchestra.run.smithi144.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-06-04T15:51:25.355 INFO:teuthology.orchestra.run.smithi144.stdout: libasyncns-0.8-22.el9.x86_64 2024-06-04T15:51:25.355 INFO:teuthology.orchestra.run.smithi144.stdout: libcanberra-0.30-27.el9.x86_64 2024-06-04T15:51:25.355 INFO:teuthology.orchestra.run.smithi144.stdout: libcanberra-gtk3-0.30-27.el9.x86_64 2024-06-04T15:51:25.355 INFO:teuthology.orchestra.run.smithi144.stdout: libcephfs-devel-2:19.0.0-4027.g65533a90.el9.x86_64 2024-06-04T15:51:25.355 INFO:teuthology.orchestra.run.smithi144.stdout: libcephfs2-2:19.0.0-4027.g65533a90.el9.x86_64 2024-06-04T15:51:25.355 INFO:teuthology.orchestra.run.smithi144.stdout: libcephsqlite-2:19.0.0-4027.g65533a90.el9.x86_64 2024-06-04T15:51:25.356 INFO:teuthology.orchestra.run.smithi144.stdout: libdrm-2.4.117-1.el9.x86_64 2024-06-04T15:51:25.356 INFO:teuthology.orchestra.run.smithi144.stdout: libepoxy-1.5.5-4.el9.x86_64 2024-06-04T15:51:25.356 INFO:teuthology.orchestra.run.smithi144.stdout: libexif-0.6.22-6.el9.x86_64 2024-06-04T15:51:25.356 INFO:teuthology.orchestra.run.smithi144.stdout: libfontenc-1.1.3-17.el9.x86_64 2024-06-04T15:51:25.356 INFO:teuthology.orchestra.run.smithi144.stdout: libgexiv2-0.12.3-1.el9.x86_64 2024-06-04T15:51:25.356 INFO:teuthology.orchestra.run.smithi144.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-06-04T15:51:25.356 INFO:teuthology.orchestra.run.smithi144.stdout: libglvnd-1:1.3.4-1.el9.x86_64 2024-06-04T15:51:25.356 INFO:teuthology.orchestra.run.smithi144.stdout: libglvnd-egl-1:1.3.4-1.el9.x86_64 2024-06-04T15:51:25.356 INFO:teuthology.orchestra.run.smithi144.stdout: libglvnd-glx-1:1.3.4-1.el9.x86_64 2024-06-04T15:51:25.356 INFO:teuthology.orchestra.run.smithi144.stdout: libgsf-1.14.47-5.el9.x86_64 2024-06-04T15:51:25.356 INFO:teuthology.orchestra.run.smithi144.stdout: libgxps-0.3.2-3.el9.x86_64 2024-06-04T15:51:25.356 INFO:teuthology.orchestra.run.smithi144.stdout: libiptcdata-1.0.5-9.el9.x86_64 2024-06-04T15:51:25.356 INFO:teuthology.orchestra.run.smithi144.stdout: libldac-2.0.2.3-10.el9.x86_64 2024-06-04T15:51:25.356 INFO:teuthology.orchestra.run.smithi144.stdout: libnotify-0.7.9-8.el9.x86_64 2024-06-04T15:51:25.357 INFO:teuthology.orchestra.run.smithi144.stdout: liboath-2.6.7-2.el9.x86_64 2024-06-04T15:51:25.357 INFO:teuthology.orchestra.run.smithi144.stdout: libogg-2:1.3.4-6.el9.x86_64 2024-06-04T15:51:25.357 INFO:teuthology.orchestra.run.smithi144.stdout: libosinfo-1.10.0-1.el9.x86_64 2024-06-04T15:51:25.357 INFO:teuthology.orchestra.run.smithi144.stdout: libpciaccess-0.16-7.el9.x86_64 2024-06-04T15:51:25.357 INFO:teuthology.orchestra.run.smithi144.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-06-04T15:51:25.357 INFO:teuthology.orchestra.run.smithi144.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-06-04T15:51:25.357 INFO:teuthology.orchestra.run.smithi144.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-06-04T15:51:25.357 INFO:teuthology.orchestra.run.smithi144.stdout: librados-devel-2:19.0.0-4027.g65533a90.el9.x86_64 2024-06-04T15:51:25.357 INFO:teuthology.orchestra.run.smithi144.stdout: libradosstriper1-2:19.0.0-4027.g65533a90.el9.x86_64 2024-06-04T15:51:25.357 INFO:teuthology.orchestra.run.smithi144.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-06-04T15:51:25.357 INFO:teuthology.orchestra.run.smithi144.stdout: librgw2-2:19.0.0-4027.g65533a90.el9.x86_64 2024-06-04T15:51:25.357 INFO:teuthology.orchestra.run.smithi144.stdout: libsbc-1.4-9.el9.x86_64 2024-06-04T15:51:25.357 INFO:teuthology.orchestra.run.smithi144.stdout: libsndfile-1.0.31-8.el9.x86_64 2024-06-04T15:51:25.358 INFO:teuthology.orchestra.run.smithi144.stdout: libtheora-1:1.1.1-31.el9.x86_64 2024-06-04T15:51:25.358 INFO:teuthology.orchestra.run.smithi144.stdout: libtiff-4.4.0-12.el9.x86_64 2024-06-04T15:51:25.358 INFO:teuthology.orchestra.run.smithi144.stdout: libtool-ltdl-2.4.6-45.el9.x86_64 2024-06-04T15:51:25.358 INFO:teuthology.orchestra.run.smithi144.stdout: libtracker-sparql-3.1.2-3.el9.x86_64 2024-06-04T15:51:25.358 INFO:teuthology.orchestra.run.smithi144.stdout: libunwind-1.6.2-1.el9.x86_64 2024-06-04T15:51:25.358 INFO:teuthology.orchestra.run.smithi144.stdout: libvisual-1:0.4.0-34.el9.x86_64 2024-06-04T15:51:25.358 INFO:teuthology.orchestra.run.smithi144.stdout: libvorbis-1:1.3.7-5.el9.x86_64 2024-06-04T15:51:25.358 INFO:teuthology.orchestra.run.smithi144.stdout: libwayland-client-1.21.0-1.el9.x86_64 2024-06-04T15:51:25.358 INFO:teuthology.orchestra.run.smithi144.stdout: libwayland-cursor-1.21.0-1.el9.x86_64 2024-06-04T15:51:25.358 INFO:teuthology.orchestra.run.smithi144.stdout: libwayland-egl-1.21.0-1.el9.x86_64 2024-06-04T15:51:25.358 INFO:teuthology.orchestra.run.smithi144.stdout: libwayland-server-1.21.0-1.el9.x86_64 2024-06-04T15:51:25.358 INFO:teuthology.orchestra.run.smithi144.stdout: libwebp-1.2.0-8.el9.x86_64 2024-06-04T15:51:25.358 INFO:teuthology.orchestra.run.smithi144.stdout: libxkbcommon-1.0.3-4.el9.x86_64 2024-06-04T15:51:25.358 INFO:teuthology.orchestra.run.smithi144.stdout: libxshmfence-1.3-10.el9.x86_64 2024-06-04T15:51:25.359 INFO:teuthology.orchestra.run.smithi144.stdout: lksctp-tools-1.0.19-2.el9.x86_64 2024-06-04T15:51:25.359 INFO:teuthology.orchestra.run.smithi144.stdout: low-memory-monitor-2.1-4.el9.x86_64 2024-06-04T15:51:25.359 INFO:teuthology.orchestra.run.smithi144.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-06-04T15:51:25.359 INFO:teuthology.orchestra.run.smithi144.stdout: lua-5.4.4-4.el9.x86_64 2024-06-04T15:51:25.359 INFO:teuthology.orchestra.run.smithi144.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-06-04T15:51:25.359 INFO:teuthology.orchestra.run.smithi144.stdout: lua-posix-35.0-8.el9.x86_64 2024-06-04T15:51:25.359 INFO:teuthology.orchestra.run.smithi144.stdout: luarocks-3.9.2-5.el9.noarch 2024-06-04T15:51:25.359 INFO:teuthology.orchestra.run.smithi144.stdout: maven-1:3.6.3-15.el9.noarch 2024-06-04T15:51:25.359 INFO:teuthology.orchestra.run.smithi144.stdout: maven-lib-1:3.6.3-15.el9.noarch 2024-06-04T15:51:25.359 INFO:teuthology.orchestra.run.smithi144.stdout: maven-openjdk11-1:3.6.3-15.el9.noarch 2024-06-04T15:51:25.359 INFO:teuthology.orchestra.run.smithi144.stdout: maven-resolver-1:1.6.1-10.el9.noarch 2024-06-04T15:51:25.359 INFO:teuthology.orchestra.run.smithi144.stdout: maven-shared-utils-3.3.4-3.el9.noarch 2024-06-04T15:51:25.359 INFO:teuthology.orchestra.run.smithi144.stdout: maven-wagon-3.4.2-7.el9.noarch 2024-06-04T15:51:25.359 INFO:teuthology.orchestra.run.smithi144.stdout: mesa-libEGL-23.3.3-1.el9.x86_64 2024-06-04T15:51:25.360 INFO:teuthology.orchestra.run.smithi144.stdout: mesa-libGL-23.3.3-1.el9.x86_64 2024-06-04T15:51:25.360 INFO:teuthology.orchestra.run.smithi144.stdout: mesa-libgbm-23.3.3-1.el9.x86_64 2024-06-04T15:51:25.360 INFO:teuthology.orchestra.run.smithi144.stdout: mesa-libglapi-23.3.3-1.el9.x86_64 2024-06-04T15:51:25.360 INFO:teuthology.orchestra.run.smithi144.stdout: mkfontscale-1.2.1-3.el9.x86_64 2024-06-04T15:51:25.360 INFO:teuthology.orchestra.run.smithi144.stdout: openblas-0.3.21-2.el9.x86_64 2024-06-04T15:51:25.360 INFO:teuthology.orchestra.run.smithi144.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-06-04T15:51:25.360 INFO:teuthology.orchestra.run.smithi144.stdout: openjpeg2-2.4.0-7.el9.x86_64 2024-06-04T15:51:25.360 INFO:teuthology.orchestra.run.smithi144.stdout: opus-1.3.1-10.el9.x86_64 2024-06-04T15:51:25.360 INFO:teuthology.orchestra.run.smithi144.stdout: orc-0.4.31-6.el9.x86_64 2024-06-04T15:51:25.360 INFO:teuthology.orchestra.run.smithi144.stdout: osinfo-db-20231215-1.el9.noarch 2024-06-04T15:51:25.361 INFO:teuthology.orchestra.run.smithi144.stdout: osinfo-db-tools-1.10.0-1.el9.x86_64 2024-06-04T15:51:25.361 INFO:teuthology.orchestra.run.smithi144.stdout: ostree-libs-2024.6-1.el9.x86_64 2024-06-04T15:51:25.361 INFO:teuthology.orchestra.run.smithi144.stdout: p11-kit-server-0.25.3-2.el9.x86_64 2024-06-04T15:51:25.361 INFO:teuthology.orchestra.run.smithi144.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-06-04T15:51:25.361 INFO:teuthology.orchestra.run.smithi144.stdout: pipewire-1.0.1-1.el9.x86_64 2024-06-04T15:51:25.361 INFO:teuthology.orchestra.run.smithi144.stdout: pipewire-alsa-1.0.1-1.el9.x86_64 2024-06-04T15:51:25.361 INFO:teuthology.orchestra.run.smithi144.stdout: pipewire-jack-audio-connection-kit-1.0.1-1.el9.x86_64 2024-06-04T15:51:25.361 INFO:teuthology.orchestra.run.smithi144.stdout: pipewire-jack-audio-connection-kit-libs-1.0.1-1.el9.x86_64 2024-06-04T15:51:25.361 INFO:teuthology.orchestra.run.smithi144.stdout: pipewire-libs-1.0.1-1.el9.x86_64 2024-06-04T15:51:25.361 INFO:teuthology.orchestra.run.smithi144.stdout: pipewire-pulseaudio-1.0.1-1.el9.x86_64 2024-06-04T15:51:25.361 INFO:teuthology.orchestra.run.smithi144.stdout: plexus-cipher-1.7-27.el9.noarch 2024-06-04T15:51:25.361 INFO:teuthology.orchestra.run.smithi144.stdout: plexus-classworlds-2.6.0-11.el9.noarch 2024-06-04T15:51:25.362 INFO:teuthology.orchestra.run.smithi144.stdout: plexus-containers-component-annotations-2.1.0-10.el9.noarch 2024-06-04T15:51:25.362 INFO:teuthology.orchestra.run.smithi144.stdout: plexus-interpolation-1.26-11.el9.noarch 2024-06-04T15:51:25.362 INFO:teuthology.orchestra.run.smithi144.stdout: plexus-sec-dispatcher-1.4-37.el9.noarch 2024-06-04T15:51:25.362 INFO:teuthology.orchestra.run.smithi144.stdout: plexus-utils-3.3.0-10.el9.noarch 2024-06-04T15:51:25.362 INFO:teuthology.orchestra.run.smithi144.stdout: poppler-21.01.0-20.el9.x86_64 2024-06-04T15:51:25.362 INFO:teuthology.orchestra.run.smithi144.stdout: poppler-data-0.4.9-9.el9.noarch 2024-06-04T15:51:25.362 INFO:teuthology.orchestra.run.smithi144.stdout: poppler-glib-21.01.0-20.el9.x86_64 2024-06-04T15:51:25.362 INFO:teuthology.orchestra.run.smithi144.stdout: protobuf-3.14.0-13.el9.x86_64 2024-06-04T15:51:25.362 INFO:teuthology.orchestra.run.smithi144.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-06-04T15:51:25.362 INFO:teuthology.orchestra.run.smithi144.stdout: publicsuffix-list-20210518-3.el9.noarch 2024-06-04T15:51:25.362 INFO:teuthology.orchestra.run.smithi144.stdout: pulseaudio-libs-15.0-2.el9.x86_64 2024-06-04T15:51:25.362 INFO:teuthology.orchestra.run.smithi144.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-06-04T15:51:25.362 INFO:teuthology.orchestra.run.smithi144.stdout: python3-babel-2.9.1-2.el9.noarch 2024-06-04T15:51:25.363 INFO:teuthology.orchestra.run.smithi144.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-06-04T15:51:25.363 INFO:teuthology.orchestra.run.smithi144.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-06-04T15:51:25.363 INFO:teuthology.orchestra.run.smithi144.stdout: python3-ceph-argparse-2:19.0.0-4027.g65533a90.el9.x86_64 2024-06-04T15:51:25.363 INFO:teuthology.orchestra.run.smithi144.stdout: python3-ceph-common-2:19.0.0-4027.g65533a90.el9.x86_64 2024-06-04T15:51:25.363 INFO:teuthology.orchestra.run.smithi144.stdout: python3-cephfs-2:19.0.0-4027.g65533a90.el9.x86_64 2024-06-04T15:51:25.363 INFO:teuthology.orchestra.run.smithi144.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-06-04T15:51:25.363 INFO:teuthology.orchestra.run.smithi144.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-06-04T15:51:25.363 INFO:teuthology.orchestra.run.smithi144.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-06-04T15:51:25.363 INFO:teuthology.orchestra.run.smithi144.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-06-04T15:51:25.363 INFO:teuthology.orchestra.run.smithi144.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-06-04T15:51:25.363 INFO:teuthology.orchestra.run.smithi144.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-06-04T15:51:25.363 INFO:teuthology.orchestra.run.smithi144.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-06-04T15:51:25.363 INFO:teuthology.orchestra.run.smithi144.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-06-04T15:51:25.364 INFO:teuthology.orchestra.run.smithi144.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-06-04T15:51:25.364 INFO:teuthology.orchestra.run.smithi144.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-06-04T15:51:25.364 INFO:teuthology.orchestra.run.smithi144.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-06-04T15:51:25.364 INFO:teuthology.orchestra.run.smithi144.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-06-04T15:51:25.364 INFO:teuthology.orchestra.run.smithi144.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-06-04T15:51:25.364 INFO:teuthology.orchestra.run.smithi144.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-06-04T15:51:25.364 INFO:teuthology.orchestra.run.smithi144.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-06-04T15:51:25.364 INFO:teuthology.orchestra.run.smithi144.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-06-04T15:51:25.364 INFO:teuthology.orchestra.run.smithi144.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-06-04T15:51:25.364 INFO:teuthology.orchestra.run.smithi144.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-06-04T15:51:25.364 INFO:teuthology.orchestra.run.smithi144.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-06-04T15:51:25.364 INFO:teuthology.orchestra.run.smithi144.stdout: python3-mako-1.1.4-6.el9.noarch 2024-06-04T15:51:25.364 INFO:teuthology.orchestra.run.smithi144.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-06-04T15:51:25.364 INFO:teuthology.orchestra.run.smithi144.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-06-04T15:51:25.365 INFO:teuthology.orchestra.run.smithi144.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-06-04T15:51:25.365 INFO:teuthology.orchestra.run.smithi144.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-06-04T15:51:25.365 INFO:teuthology.orchestra.run.smithi144.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-06-04T15:51:25.365 INFO:teuthology.orchestra.run.smithi144.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-06-04T15:51:25.365 INFO:teuthology.orchestra.run.smithi144.stdout: python3-packaging-20.9-5.el9.noarch 2024-06-04T15:51:25.365 INFO:teuthology.orchestra.run.smithi144.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-06-04T15:51:25.365 INFO:teuthology.orchestra.run.smithi144.stdout: python3-ply-3.11-14.el9.noarch 2024-06-04T15:51:25.365 INFO:teuthology.orchestra.run.smithi144.stdout: python3-portend-3.1.0-2.el9.noarch 2024-06-04T15:51:25.365 INFO:teuthology.orchestra.run.smithi144.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-06-04T15:51:25.365 INFO:teuthology.orchestra.run.smithi144.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-06-04T15:51:25.365 INFO:teuthology.orchestra.run.smithi144.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-06-04T15:51:25.365 INFO:teuthology.orchestra.run.smithi144.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-06-04T15:51:25.365 INFO:teuthology.orchestra.run.smithi144.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-06-04T15:51:25.365 INFO:teuthology.orchestra.run.smithi144.stdout: python3-pycparser-2.20-6.el9.noarch 2024-06-04T15:51:25.366 INFO:teuthology.orchestra.run.smithi144.stdout: python3-pytz-2021.1-5.el9.noarch 2024-06-04T15:51:25.366 INFO:teuthology.orchestra.run.smithi144.stdout: python3-rados-2:19.0.0-4027.g65533a90.el9.x86_64 2024-06-04T15:51:25.366 INFO:teuthology.orchestra.run.smithi144.stdout: python3-rbd-2:19.0.0-4027.g65533a90.el9.x86_64 2024-06-04T15:51:25.366 INFO:teuthology.orchestra.run.smithi144.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-06-04T15:51:25.366 INFO:teuthology.orchestra.run.smithi144.stdout: python3-requests-2.25.1-8.el9.noarch 2024-06-04T15:51:25.366 INFO:teuthology.orchestra.run.smithi144.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-06-04T15:51:25.366 INFO:teuthology.orchestra.run.smithi144.stdout: python3-rgw-2:19.0.0-4027.g65533a90.el9.x86_64 2024-06-04T15:51:25.366 INFO:teuthology.orchestra.run.smithi144.stdout: python3-routes-2.5.1-5.el9.noarch 2024-06-04T15:51:25.366 INFO:teuthology.orchestra.run.smithi144.stdout: python3-rsa-4.9-2.el9.noarch 2024-06-04T15:51:25.366 INFO:teuthology.orchestra.run.smithi144.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-06-04T15:51:25.366 INFO:teuthology.orchestra.run.smithi144.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-06-04T15:51:25.366 INFO:teuthology.orchestra.run.smithi144.stdout: python3-toml-0.10.2-6.el9.noarch 2024-06-04T15:51:25.366 INFO:teuthology.orchestra.run.smithi144.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-06-04T15:51:25.367 INFO:teuthology.orchestra.run.smithi144.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-06-04T15:51:25.367 INFO:teuthology.orchestra.run.smithi144.stdout: python3-webob-1.8.7-6.el9.noarch 2024-06-04T15:51:25.367 INFO:teuthology.orchestra.run.smithi144.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-06-04T15:51:25.367 INFO:teuthology.orchestra.run.smithi144.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-06-04T15:51:25.367 INFO:teuthology.orchestra.run.smithi144.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-06-04T15:51:25.367 INFO:teuthology.orchestra.run.smithi144.stdout: qatlib-24.02.0-1.el9.x86_64 2024-06-04T15:51:25.367 INFO:teuthology.orchestra.run.smithi144.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-06-04T15:51:25.367 INFO:teuthology.orchestra.run.smithi144.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-06-04T15:51:25.367 INFO:teuthology.orchestra.run.smithi144.stdout: rbd-fuse-2:19.0.0-4027.g65533a90.el9.x86_64 2024-06-04T15:51:25.367 INFO:teuthology.orchestra.run.smithi144.stdout: rbd-mirror-2:19.0.0-4027.g65533a90.el9.x86_64 2024-06-04T15:51:25.367 INFO:teuthology.orchestra.run.smithi144.stdout: rbd-nbd-2:19.0.0-4027.g65533a90.el9.x86_64 2024-06-04T15:51:25.367 INFO:teuthology.orchestra.run.smithi144.stdout: re2-1:20211101-3.el9.x86_64 2024-06-04T15:51:25.367 INFO:teuthology.orchestra.run.smithi144.stdout: rtkit-0.11-28.el9.x86_64 2024-06-04T15:51:25.367 INFO:teuthology.orchestra.run.smithi144.stdout: s3cmd-2.4.0-1.el9.noarch 2024-06-04T15:51:25.368 INFO:teuthology.orchestra.run.smithi144.stdout: sisu-1:0.3.4-10.el9.noarch 2024-06-04T15:51:25.368 INFO:teuthology.orchestra.run.smithi144.stdout: slf4j-1.7.30-13.el9.noarch 2024-06-04T15:51:25.368 INFO:teuthology.orchestra.run.smithi144.stdout: socat-1.7.4.1-5.el9.x86_64 2024-06-04T15:51:25.368 INFO:teuthology.orchestra.run.smithi144.stdout: sound-theme-freedesktop-0.8-17.el9.noarch 2024-06-04T15:51:25.368 INFO:teuthology.orchestra.run.smithi144.stdout: thrift-0.15.0-2.el9.x86_64 2024-06-04T15:51:25.368 INFO:teuthology.orchestra.run.smithi144.stdout: totem-pl-parser-3.26.6-2.el9.x86_64 2024-06-04T15:51:25.368 INFO:teuthology.orchestra.run.smithi144.stdout: tracker-3.1.2-3.el9.x86_64 2024-06-04T15:51:25.368 INFO:teuthology.orchestra.run.smithi144.stdout: tracker-miners-3.1.2-4.el9.x86_64 2024-06-04T15:51:25.368 INFO:teuthology.orchestra.run.smithi144.stdout: ttmkfdir-3.0.9-65.el9.x86_64 2024-06-04T15:51:25.368 INFO:teuthology.orchestra.run.smithi144.stdout: tzdata-java-2024a-2.el9.noarch 2024-06-04T15:51:25.368 INFO:teuthology.orchestra.run.smithi144.stdout: upower-0.99.11-11.el9.x86_64 2024-06-04T15:51:25.368 INFO:teuthology.orchestra.run.smithi144.stdout: webrtc-audio-processing-0.3.1-8.el9.x86_64 2024-06-04T15:51:25.368 INFO:teuthology.orchestra.run.smithi144.stdout: wireplumber-0.4.14-1.el9.x86_64 2024-06-04T15:51:25.369 INFO:teuthology.orchestra.run.smithi144.stdout: wireplumber-libs-0.4.14-1.el9.x86_64 2024-06-04T15:51:25.369 INFO:teuthology.orchestra.run.smithi144.stdout: xdg-dbus-proxy-0.1.3-1.el9.x86_64 2024-06-04T15:51:25.369 INFO:teuthology.orchestra.run.smithi144.stdout: xdg-desktop-portal-1.12.6-1.el9.x86_64 2024-06-04T15:51:25.369 INFO:teuthology.orchestra.run.smithi144.stdout: xdg-desktop-portal-gtk-1.12.0-3.el9.x86_64 2024-06-04T15:51:25.369 INFO:teuthology.orchestra.run.smithi144.stdout: xkeyboard-config-2.33-2.el9.noarch 2024-06-04T15:51:25.369 INFO:teuthology.orchestra.run.smithi144.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-06-04T15:51:25.369 INFO:teuthology.orchestra.run.smithi144.stdout: xorg-x11-fonts-Type1-7.5-33.el9.noarch 2024-06-04T15:51:25.369 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T15:51:25.370 INFO:teuthology.orchestra.run.smithi144.stdout:Complete! 2024-06-04T15:51:25.763 DEBUG:teuthology.parallel:result is None 2024-06-04T15:51:25.763 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=65533a907fc9add1863609703fdbbea67993c8ef 2024-06-04T15:51:25.935 DEBUG:teuthology.orchestra.run.smithi144:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-06-04T15:51:26.000 INFO:teuthology.orchestra.run.smithi144.stdout:19.0.0-4027.g65533a90.el9 2024-06-04T15:51:26.000 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-4027.g65533a90.el9 2024-06-04T15:51:26.000 INFO:teuthology.task.install:The correct ceph version 19.0.0-4027.g65533a90 is installed. 2024-06-04T15:51:26.002 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=65533a907fc9add1863609703fdbbea67993c8ef 2024-06-04T15:51:26.241 DEBUG:teuthology.orchestra.run.smithi177:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-06-04T15:51:26.313 INFO:teuthology.orchestra.run.smithi177.stdout:19.0.0-4027.g65533a90.el9 2024-06-04T15:51:26.314 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-4027.g65533a90.el9 2024-06-04T15:51:26.314 INFO:teuthology.task.install:The correct ceph version 19.0.0-4027.g65533a90 is installed. 2024-06-04T15:51:26.315 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-06-04T15:51:26.316 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-06-04T15:51:26.316 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-06-04T15:51:26.361 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-06-04T15:51:26.361 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-06-04T15:51:26.411 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-06-04T15:51:26.411 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-06-04T15:51:26.411 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd of=/usr/bin/daemon-helper 2024-06-04T15:51:26.452 DEBUG:teuthology.orchestra.run.smithi144:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-06-04T15:51:26.537 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-06-04T15:51:26.537 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd of=/usr/bin/daemon-helper 2024-06-04T15:51:26.580 DEBUG:teuthology.orchestra.run.smithi177:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-06-04T15:51:26.664 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-06-04T15:51:26.665 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-06-04T15:51:26.665 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd of=/usr/bin/adjust-ulimits 2024-06-04T15:51:26.708 DEBUG:teuthology.orchestra.run.smithi144:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-06-04T15:51:26.791 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-06-04T15:51:26.791 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd of=/usr/bin/adjust-ulimits 2024-06-04T15:51:26.834 DEBUG:teuthology.orchestra.run.smithi177:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-06-04T15:51:26.918 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-06-04T15:51:26.918 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-06-04T15:51:26.918 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd of=/usr/bin/stdin-killer 2024-06-04T15:51:26.958 DEBUG:teuthology.orchestra.run.smithi144:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-06-04T15:51:27.038 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-06-04T15:51:27.038 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd of=/usr/bin/stdin-killer 2024-06-04T15:51:27.077 DEBUG:teuthology.orchestra.run.smithi177:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-06-04T15:51:27.159 INFO:teuthology.run_tasks:Running task ceph... 2024-06-04T15:51:27.253 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-06-04T15:51:27.253 DEBUG:teuthology.orchestra.run.smithi144:> sudo chmod 777 /var/log/ceph 2024-06-04T15:51:27.256 DEBUG:teuthology.orchestra.run.smithi177:> sudo chmod 777 /var/log/ceph 2024-06-04T15:51:27.295 INFO:tasks.ceph:Disabling ceph logrotate... 2024-06-04T15:51:27.295 DEBUG:teuthology.orchestra.run.smithi144:> sudo rm -f -- /etc/logrotate.d/ceph 2024-06-04T15:51:27.336 DEBUG:teuthology.orchestra.run.smithi177:> sudo rm -f -- /etc/logrotate.d/ceph 2024-06-04T15:51:27.375 INFO:tasks.ceph:Creating extra log directories... 2024-06-04T15:51:27.375 DEBUG:teuthology.orchestra.run.smithi144:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-06-04T15:51:27.414 DEBUG:teuthology.orchestra.run.smithi177:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-06-04T15:51:27.464 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-06-04T15:51:27.464 INFO:tasks.ceph:config {'conf': {'client': {'debug rgw': 20, 'rgw bucket counters cache': True, 'rgw crypt require ssl': False, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo=', 'rgw torrent flag': True, 'rgw user counters cache': True, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'global': {'mon client directed command retry': 5, 'ms inject socket failures': 5000, 'osd_max_pg_log_entries': 10, 'osd_min_pg_log_entries': 10}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'lockdep': True}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'lockdep': True, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled', '\\(OSD_SLOW_PING_TIME'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-06-04T15:51:27.464 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/cbodley-2024-06-04_15:11:52-rgw-main-distro-default-smithi/7740770', 'branch': 'main', 'description': 'rgw/verify/{0-install clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability inline-data$/{on} msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/ec s3tests-branch sharding$/{default} striping$/{stripe-equals-chunk} supported-random-distro$/{centos_latest} tasks/{bucket-check cls mp_reupload ragweed reshard s3tests-java s3tests versioning} validater/lockdep}', 'email': None, 'first_in_suite': False, 'job_id': '7740770', 'kernel': {'kdb': 1, 'sha1': 'distro'}, 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'cbodley-2024-06-04_15:11:52-rgw-main-distro-default-smithi', 'no_nested_subset': False, 'openstack': [{'volumes': {'count': 4, 'size': 10}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'main'}, 'ceph': {'conf': {'client': {'debug rgw': 20, 'rgw bucket counters cache': True, 'rgw crypt require ssl': False, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo=', 'rgw torrent flag': True, 'rgw user counters cache': True, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'global': {'mon client directed command retry': 5, 'ms inject socket failures': 5000, 'osd_max_pg_log_entries': 10, 'osd_min_pg_log_entries': 10}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'lockdep': True}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'lockdep': True, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled', '\\(OSD_SLOW_PING_TIME'], 'sha1': '65533a907fc9add1863609703fdbbea67993c8ef'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '65533a907fc9add1863609703fdbbea67993c8ef'}}, 'openssl_keys': {'rgw.client.0': {'ca': 'root', 'client': 'client.0', 'embed-key': True}, 'root': {'client': 'client.0', 'cn': 'teuthology', 'install': ['client.0'], 'key-type': 'rsa:4096'}}, 'rgw': {'client.0': {'ssl certificate': 'rgw.client.0'}, 'compression type': 'random', 'ec-data-pool': True, 'frontend': 'beast', 'storage classes': 'LUKEWARM, FROZEN'}, 's3tests': {'force-branch': 'ceph-master', 'slow_backend': True, 'storage classes': 'LUKEWARM, FROZEN'}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'main', 'sha1': '1fb5d10608dccee73edd6ef8a2c7b804a097c324'}}, 'owner': 'scheduled_cbodley@teuthology', 'priority': 75, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'], ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b']], 'seed': 4806, 'sha1': '65533a907fc9add1863609703fdbbea67993c8ef', 'sleep_before_teardown': 0, 'subset': '1/3', 'suite': 'rgw', 'suite_branch': 'main', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_1fb5d10608dccee73edd6ef8a2c7b804a097c324/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': '1fb5d10608dccee73edd6ef8a2c7b804a097c324', 'targets': {'smithi144.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNQ9EUM6tfX7YL8vEtoaVQD6Zxg1awHwccMTbverH6oqS3y1Th0owLAQGyqQ7Fesz7cZy+us5LiB/w5Z44wjXCI=', 'smithi177.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIKxsZ++k1S4y5fUAG0dNOpR87X3l2cA/RQLRi6aMDsmJrofMk8JwuHinkfOzL9VccwcxtM9H3PzyCguKtIPAdQ='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_system_packages': {'deb': ['s3cmd', 'maven'], 'rpm': ['s3cmd', 'maven']}, 'flavor': 'default', 'sha1': '65533a907fc9add1863609703fdbbea67993c8ef'}}, {'ceph': None}, {'openssl_keys': None}, {'rgw': {'client.0': None}}, {'tox': ['client.0']}, {'workunit': {'clients': {'client.0': ['rgw/run-bucket-check.sh']}}}, {'workunit': {'clients': {'client.0': ['cls/test_cls_lock.sh', 'cls/test_cls_log.sh', 'cls/test_cls_refcount.sh', 'cls/test_cls_rgw.sh', 'cls/test_cls_rgw_gc.sh', 'cls/test_cls_rgw_stats.sh', 'cls/test_cls_cmpomap.sh', 'cls/test_cls_2pc_queue.sh', 'rgw/test_rgw_gc_log.sh', 'rgw/test_rgw_obj.sh', 'rgw/test_librgw_file.sh', 'rgw/test_awssdkv4_sig.sh']}}}, {'workunit': {'clients': {'client.0': ['rgw/test_rgw_s3_mp_reupload.sh']}}}, {'ragweed': {'client.0': {'default-branch': 'ceph-master', 'rgw_server': 'client.0', 'stages': 'prepare,check'}}}, {'workunit': {'clients': {'client.0': ['rgw/run-reshard.sh']}}}, {'s3tests-java': {'client.0': {'force-branch': 'ceph-master', 'force-repo': 'https://github.com/ceph/java_s3tests.git'}}}, {'s3tests': {'client.0': {'rgw_server': 'client.0'}}}, {'workunit': {'clients': {'client.0': ['rgw/run-versioning.sh']}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '861a8dcf7aa816a26e13f039336f7ed0a9aec0fa', 'timestamp': '2024-06-04_15:11:52', 'tube': 'smithi', 'user': 'cbodley', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2698841'} 2024-06-04T15:51:27.465 DEBUG:teuthology.orchestra.run.smithi144:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-06-04T15:51:27.492 DEBUG:teuthology.orchestra.run.smithi177:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-06-04T15:51:27.524 DEBUG:teuthology.orchestra.run.smithi144:> sudo install -d -m0777 -- /var/run/ceph 2024-06-04T15:51:27.561 DEBUG:teuthology.orchestra.run.smithi177:> sudo install -d -m0777 -- /var/run/ceph 2024-06-04T15:51:27.601 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-06-04T15:51:27.601 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/scratch_devs of=/dev/stdout 2024-06-04T15:51:27.666 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-06-04T15:51:27.666 DEBUG:teuthology.orchestra.run.smithi144:> stat /dev/vg_nvme/lv_1 2024-06-04T15:51:27.735 INFO:teuthology.orchestra.run.smithi144.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-06-04T15:51:27.735 INFO:teuthology.orchestra.run.smithi144.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-06-04T15:51:27.735 INFO:teuthology.orchestra.run.smithi144.stdout:Device: 5h/5d Inode: 667 Links: 1 2024-06-04T15:51:27.735 INFO:teuthology.orchestra.run.smithi144.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-06-04T15:51:27.736 INFO:teuthology.orchestra.run.smithi144.stdout:Context: system_u:object_r:device_t:s0 2024-06-04T15:51:27.736 INFO:teuthology.orchestra.run.smithi144.stdout:Access: 2024-06-04 15:51:13.771432054 +0000 2024-06-04T15:51:27.736 INFO:teuthology.orchestra.run.smithi144.stdout:Modify: 2024-06-04 15:48:30.550493619 +0000 2024-06-04T15:51:27.736 INFO:teuthology.orchestra.run.smithi144.stdout:Change: 2024-06-04 15:48:30.550493619 +0000 2024-06-04T15:51:27.736 INFO:teuthology.orchestra.run.smithi144.stdout: Birth: 2024-06-04 15:48:30.550493619 +0000 2024-06-04T15:51:27.736 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-06-04T15:51:27.812 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-06-04T15:51:27.812 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-06-04T15:51:27.812 INFO:teuthology.orchestra.run.smithi144.stderr:512 bytes copied, 0.000205506 s, 2.5 MB/s 2024-06-04T15:51:27.813 DEBUG:teuthology.orchestra.run.smithi144:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-06-04T15:51:27.883 DEBUG:teuthology.orchestra.run.smithi144:> stat /dev/vg_nvme/lv_2 2024-06-04T15:51:27.953 INFO:teuthology.orchestra.run.smithi144.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-06-04T15:51:27.953 INFO:teuthology.orchestra.run.smithi144.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-06-04T15:51:27.953 INFO:teuthology.orchestra.run.smithi144.stdout:Device: 5h/5d Inode: 685 Links: 1 2024-06-04T15:51:27.954 INFO:teuthology.orchestra.run.smithi144.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-06-04T15:51:27.954 INFO:teuthology.orchestra.run.smithi144.stdout:Context: system_u:object_r:device_t:s0 2024-06-04T15:51:27.954 INFO:teuthology.orchestra.run.smithi144.stdout:Access: 2024-06-04 15:51:13.771432054 +0000 2024-06-04T15:51:27.954 INFO:teuthology.orchestra.run.smithi144.stdout:Modify: 2024-06-04 15:48:30.875488104 +0000 2024-06-04T15:51:27.954 INFO:teuthology.orchestra.run.smithi144.stdout:Change: 2024-06-04 15:48:30.875488104 +0000 2024-06-04T15:51:27.954 INFO:teuthology.orchestra.run.smithi144.stdout: Birth: 2024-06-04 15:48:30.875488104 +0000 2024-06-04T15:51:27.954 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-06-04T15:51:28.030 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-06-04T15:51:28.031 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-06-04T15:51:28.031 INFO:teuthology.orchestra.run.smithi144.stderr:512 bytes copied, 0.000225377 s, 2.3 MB/s 2024-06-04T15:51:28.032 DEBUG:teuthology.orchestra.run.smithi144:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-06-04T15:51:28.101 DEBUG:teuthology.orchestra.run.smithi144:> stat /dev/vg_nvme/lv_3 2024-06-04T15:51:28.170 INFO:teuthology.orchestra.run.smithi144.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-06-04T15:51:28.170 INFO:teuthology.orchestra.run.smithi144.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-06-04T15:51:28.171 INFO:teuthology.orchestra.run.smithi144.stdout:Device: 5h/5d Inode: 704 Links: 1 2024-06-04T15:51:28.171 INFO:teuthology.orchestra.run.smithi144.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-06-04T15:51:28.171 INFO:teuthology.orchestra.run.smithi144.stdout:Context: system_u:object_r:device_t:s0 2024-06-04T15:51:28.171 INFO:teuthology.orchestra.run.smithi144.stdout:Access: 2024-06-04 15:51:13.771432054 +0000 2024-06-04T15:51:28.171 INFO:teuthology.orchestra.run.smithi144.stdout:Modify: 2024-06-04 15:48:31.219482266 +0000 2024-06-04T15:51:28.171 INFO:teuthology.orchestra.run.smithi144.stdout:Change: 2024-06-04 15:48:31.219482266 +0000 2024-06-04T15:51:28.171 INFO:teuthology.orchestra.run.smithi144.stdout: Birth: 2024-06-04 15:48:31.219482266 +0000 2024-06-04T15:51:28.171 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-06-04T15:51:28.247 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-06-04T15:51:28.247 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-06-04T15:51:28.247 INFO:teuthology.orchestra.run.smithi144.stderr:512 bytes copied, 0.000187511 s, 2.7 MB/s 2024-06-04T15:51:28.248 DEBUG:teuthology.orchestra.run.smithi144:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-06-04T15:51:28.319 DEBUG:teuthology.orchestra.run.smithi144:> stat /dev/vg_nvme/lv_4 2024-06-04T15:51:28.388 INFO:teuthology.orchestra.run.smithi144.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-06-04T15:51:28.388 INFO:teuthology.orchestra.run.smithi144.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-06-04T15:51:28.388 INFO:teuthology.orchestra.run.smithi144.stdout:Device: 5h/5d Inode: 725 Links: 1 2024-06-04T15:51:28.388 INFO:teuthology.orchestra.run.smithi144.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-06-04T15:51:28.388 INFO:teuthology.orchestra.run.smithi144.stdout:Context: system_u:object_r:device_t:s0 2024-06-04T15:51:28.388 INFO:teuthology.orchestra.run.smithi144.stdout:Access: 2024-06-04 15:51:13.772432038 +0000 2024-06-04T15:51:28.388 INFO:teuthology.orchestra.run.smithi144.stdout:Modify: 2024-06-04 15:48:31.569476326 +0000 2024-06-04T15:51:28.388 INFO:teuthology.orchestra.run.smithi144.stdout:Change: 2024-06-04 15:48:31.569476326 +0000 2024-06-04T15:51:28.388 INFO:teuthology.orchestra.run.smithi144.stdout: Birth: 2024-06-04 15:48:31.569476326 +0000 2024-06-04T15:51:28.389 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-06-04T15:51:28.465 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-06-04T15:51:28.465 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-06-04T15:51:28.465 INFO:teuthology.orchestra.run.smithi144.stderr:512 bytes copied, 0.000198543 s, 2.6 MB/s 2024-06-04T15:51:28.466 DEBUG:teuthology.orchestra.run.smithi144:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-06-04T15:51:28.536 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-06-04T15:51:28.536 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-06-04T15:51:28.536 DEBUG:teuthology.orchestra.run.smithi177:> dd if=/scratch_devs of=/dev/stdout 2024-06-04T15:51:28.571 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-06-04T15:51:28.571 DEBUG:teuthology.orchestra.run.smithi177:> stat /dev/vg_nvme/lv_1 2024-06-04T15:51:28.643 INFO:teuthology.orchestra.run.smithi177.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-06-04T15:51:28.643 INFO:teuthology.orchestra.run.smithi177.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-06-04T15:51:28.644 INFO:teuthology.orchestra.run.smithi177.stdout:Device: 5h/5d Inode: 667 Links: 1 2024-06-04T15:51:28.644 INFO:teuthology.orchestra.run.smithi177.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-06-04T15:51:28.644 INFO:teuthology.orchestra.run.smithi177.stdout:Context: system_u:object_r:device_t:s0 2024-06-04T15:51:28.644 INFO:teuthology.orchestra.run.smithi177.stdout:Access: 2024-06-04 15:51:12.632274310 +0000 2024-06-04T15:51:28.644 INFO:teuthology.orchestra.run.smithi177.stdout:Modify: 2024-06-04 15:48:30.561888458 +0000 2024-06-04T15:51:28.644 INFO:teuthology.orchestra.run.smithi177.stdout:Change: 2024-06-04 15:48:30.561888458 +0000 2024-06-04T15:51:28.644 INFO:teuthology.orchestra.run.smithi177.stdout: Birth: 2024-06-04 15:48:30.561888458 +0000 2024-06-04T15:51:28.644 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-06-04T15:51:28.724 INFO:teuthology.orchestra.run.smithi177.stderr:1+0 records in 2024-06-04T15:51:28.724 INFO:teuthology.orchestra.run.smithi177.stderr:1+0 records out 2024-06-04T15:51:28.724 INFO:teuthology.orchestra.run.smithi177.stderr:512 bytes copied, 0.00021048 s, 2.4 MB/s 2024-06-04T15:51:28.725 DEBUG:teuthology.orchestra.run.smithi177:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-06-04T15:51:28.797 DEBUG:teuthology.orchestra.run.smithi177:> stat /dev/vg_nvme/lv_2 2024-06-04T15:51:28.866 INFO:teuthology.orchestra.run.smithi177.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-06-04T15:51:28.866 INFO:teuthology.orchestra.run.smithi177.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-06-04T15:51:28.866 INFO:teuthology.orchestra.run.smithi177.stdout:Device: 5h/5d Inode: 686 Links: 1 2024-06-04T15:51:28.866 INFO:teuthology.orchestra.run.smithi177.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-06-04T15:51:28.866 INFO:teuthology.orchestra.run.smithi177.stdout:Context: system_u:object_r:device_t:s0 2024-06-04T15:51:28.866 INFO:teuthology.orchestra.run.smithi177.stdout:Access: 2024-06-04 15:51:12.632274310 +0000 2024-06-04T15:51:28.866 INFO:teuthology.orchestra.run.smithi177.stdout:Modify: 2024-06-04 15:48:30.893878986 +0000 2024-06-04T15:51:28.866 INFO:teuthology.orchestra.run.smithi177.stdout:Change: 2024-06-04 15:48:30.893878986 +0000 2024-06-04T15:51:28.866 INFO:teuthology.orchestra.run.smithi177.stdout: Birth: 2024-06-04 15:48:30.893878986 +0000 2024-06-04T15:51:28.867 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-06-04T15:51:28.942 INFO:teuthology.orchestra.run.smithi177.stderr:1+0 records in 2024-06-04T15:51:28.942 INFO:teuthology.orchestra.run.smithi177.stderr:1+0 records out 2024-06-04T15:51:28.943 INFO:teuthology.orchestra.run.smithi177.stderr:512 bytes copied, 0.000193242 s, 2.6 MB/s 2024-06-04T15:51:28.944 DEBUG:teuthology.orchestra.run.smithi177:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-06-04T15:51:29.013 DEBUG:teuthology.orchestra.run.smithi177:> stat /dev/vg_nvme/lv_3 2024-06-04T15:51:29.081 INFO:teuthology.orchestra.run.smithi177.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-06-04T15:51:29.081 INFO:teuthology.orchestra.run.smithi177.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-06-04T15:51:29.081 INFO:teuthology.orchestra.run.smithi177.stdout:Device: 5h/5d Inode: 703 Links: 1 2024-06-04T15:51:29.081 INFO:teuthology.orchestra.run.smithi177.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-06-04T15:51:29.081 INFO:teuthology.orchestra.run.smithi177.stdout:Context: system_u:object_r:device_t:s0 2024-06-04T15:51:29.082 INFO:teuthology.orchestra.run.smithi177.stdout:Access: 2024-06-04 15:51:12.633274282 +0000 2024-06-04T15:51:29.082 INFO:teuthology.orchestra.run.smithi177.stdout:Modify: 2024-06-04 15:48:31.234869257 +0000 2024-06-04T15:51:29.082 INFO:teuthology.orchestra.run.smithi177.stdout:Change: 2024-06-04 15:48:31.234869257 +0000 2024-06-04T15:51:29.082 INFO:teuthology.orchestra.run.smithi177.stdout: Birth: 2024-06-04 15:48:31.234869257 +0000 2024-06-04T15:51:29.082 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-06-04T15:51:29.158 INFO:teuthology.orchestra.run.smithi177.stderr:1+0 records in 2024-06-04T15:51:29.158 INFO:teuthology.orchestra.run.smithi177.stderr:1+0 records out 2024-06-04T15:51:29.158 INFO:teuthology.orchestra.run.smithi177.stderr:512 bytes copied, 0.000194851 s, 2.6 MB/s 2024-06-04T15:51:29.159 DEBUG:teuthology.orchestra.run.smithi177:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-06-04T15:51:29.229 DEBUG:teuthology.orchestra.run.smithi177:> stat /dev/vg_nvme/lv_4 2024-06-04T15:51:29.297 INFO:teuthology.orchestra.run.smithi177.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-06-04T15:51:29.298 INFO:teuthology.orchestra.run.smithi177.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-06-04T15:51:29.298 INFO:teuthology.orchestra.run.smithi177.stdout:Device: 5h/5d Inode: 723 Links: 1 2024-06-04T15:51:29.298 INFO:teuthology.orchestra.run.smithi177.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-06-04T15:51:29.298 INFO:teuthology.orchestra.run.smithi177.stdout:Context: system_u:object_r:device_t:s0 2024-06-04T15:51:29.298 INFO:teuthology.orchestra.run.smithi177.stdout:Access: 2024-06-04 15:51:12.633274282 +0000 2024-06-04T15:51:29.298 INFO:teuthology.orchestra.run.smithi177.stdout:Modify: 2024-06-04 15:48:31.561859927 +0000 2024-06-04T15:51:29.298 INFO:teuthology.orchestra.run.smithi177.stdout:Change: 2024-06-04 15:48:31.561859927 +0000 2024-06-04T15:51:29.298 INFO:teuthology.orchestra.run.smithi177.stdout: Birth: 2024-06-04 15:48:31.561859927 +0000 2024-06-04T15:51:29.298 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-06-04T15:51:29.374 INFO:teuthology.orchestra.run.smithi177.stderr:1+0 records in 2024-06-04T15:51:29.374 INFO:teuthology.orchestra.run.smithi177.stderr:1+0 records out 2024-06-04T15:51:29.374 INFO:teuthology.orchestra.run.smithi177.stderr:512 bytes copied, 0.000195422 s, 2.6 MB/s 2024-06-04T15:51:29.375 DEBUG:teuthology.orchestra.run.smithi177:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-06-04T15:51:29.445 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-06-04T15:51:29.445 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi144.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi177.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-06-04T15:51:29.445 INFO:tasks.ceph:Generating config... 2024-06-04T15:51:29.447 INFO:tasks.ceph:[client] debug rgw = 20 2024-06-04T15:51:29.447 INFO:tasks.ceph:[client] rgw bucket counters cache = True 2024-06-04T15:51:29.447 INFO:tasks.ceph:[client] rgw crypt require ssl = False 2024-06-04T15:51:29.447 INFO:tasks.ceph:[client] rgw crypt s3 kms backend = testing 2024-06-04T15:51:29.447 INFO:tasks.ceph:[client] rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= 2024-06-04T15:51:29.447 INFO:tasks.ceph:[client] rgw torrent flag = True 2024-06-04T15:51:29.447 INFO:tasks.ceph:[client] rgw user counters cache = True 2024-06-04T15:51:29.447 INFO:tasks.ceph:[client] setgroup = ceph 2024-06-04T15:51:29.447 INFO:tasks.ceph:[client] setuser = ceph 2024-06-04T15:51:29.447 INFO:tasks.ceph:[global] mon client directed command retry = 5 2024-06-04T15:51:29.447 INFO:tasks.ceph:[global] ms inject socket failures = 5000 2024-06-04T15:51:29.447 INFO:tasks.ceph:[global] osd_max_pg_log_entries = 10 2024-06-04T15:51:29.447 INFO:tasks.ceph:[global] osd_min_pg_log_entries = 10 2024-06-04T15:51:29.448 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-06-04T15:51:29.448 INFO:tasks.ceph:[mgr] debug ms = 1 2024-06-04T15:51:29.448 INFO:tasks.ceph:[mon] debug mon = 20 2024-06-04T15:51:29.448 INFO:tasks.ceph:[mon] debug ms = 1 2024-06-04T15:51:29.448 INFO:tasks.ceph:[mon] debug paxos = 20 2024-06-04T15:51:29.448 INFO:tasks.ceph:[mon] lockdep = True 2024-06-04T15:51:29.448 INFO:tasks.ceph:[osd] bdev async discard = True 2024-06-04T15:51:29.448 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-06-04T15:51:29.448 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-06-04T15:51:29.448 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-06-04T15:51:29.448 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-06-04T15:51:29.448 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-06-04T15:51:29.448 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-06-04T15:51:29.448 INFO:tasks.ceph:[osd] debug ms = 1 2024-06-04T15:51:29.448 INFO:tasks.ceph:[osd] debug osd = 20 2024-06-04T15:51:29.449 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-06-04T15:51:29.449 INFO:tasks.ceph:[osd] lockdep = True 2024-06-04T15:51:29.449 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-06-04T15:51:29.449 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-06-04T15:51:29.449 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-06-04T15:51:29.449 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-06-04T15:51:29.449 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-06-04T15:51:29.449 INFO:tasks.ceph:[osd] osd shutdown pgref assert = True 2024-06-04T15:51:29.449 INFO:tasks.ceph:Setting up mon.a... 2024-06-04T15:51:29.449 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-06-04T15:51:29.524 INFO:teuthology.orchestra.run.smithi144.stdout:creating /etc/ceph/ceph.keyring 2024-06-04T15:51:29.524 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-06-04T15:51:29.582 DEBUG:teuthology.orchestra.run.smithi144:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-06-04T15:51:29.620 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.144'), ('mon.c', '[v2:172.21.15.144:3301,v1:172.21.15.144:6790]'), ('mon.b', '172.21.15.177')] 2024-06-04T15:51:29.620 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.144,[v2:172.21.15.144:3301,v1:172.21.15.144:6790],172.21.15.177', 'mon client directed command retry': 5, 'ms inject socket failures': 5000, 'osd_max_pg_log_entries': 10, 'osd_min_pg_log_entries': 10}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'lockdep': True, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'lockdep': True}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'debug rgw': 20, 'rgw bucket counters cache': True, 'rgw crypt require ssl': False, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo=', 'rgw torrent flag': True, 'rgw user counters cache': True, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'mon.a': {}, 'mon.c': {}, 'mon.b': {}} 2024-06-04T15:51:29.621 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-06-04T15:51:29.621 DEBUG:teuthology.orchestra.run.smithi144:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-06-04T15:51:29.688 DEBUG:teuthology.orchestra.run.smithi144:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.144 --addv c '[v2:172.21.15.144:3301,v1:172.21.15.144:6790]' --add b 172.21.15.177 --print /home/ubuntu/cephtest/ceph.monmap 2024-06-04T15:51:29.788 INFO:teuthology.orchestra.run.smithi144.stderr:ignoring --setuser ceph since I am not root 2024-06-04T15:51:29.788 INFO:teuthology.orchestra.run.smithi144.stderr:ignoring --setgroup ceph since I am not root 2024-06-04T15:51:29.788 INFO:teuthology.orchestra.run.smithi144.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-06-04T15:51:29.789 INFO:teuthology.orchestra.run.smithi144.stdout:monmaptool: generated fsid 15e56bb1-4856-42f3-b6db-a2c8f23c5557 2024-06-04T15:51:29.789 INFO:teuthology.orchestra.run.smithi144.stdout:setting min_mon_release = quincy 2024-06-04T15:51:29.789 INFO:teuthology.orchestra.run.smithi144.stdout:epoch 0 2024-06-04T15:51:29.789 INFO:teuthology.orchestra.run.smithi144.stdout:fsid 15e56bb1-4856-42f3-b6db-a2c8f23c5557 2024-06-04T15:51:29.789 INFO:teuthology.orchestra.run.smithi144.stdout:last_changed 2024-06-04T15:51:29.789359+0000 2024-06-04T15:51:29.789 INFO:teuthology.orchestra.run.smithi144.stdout:created 2024-06-04T15:51:29.789359+0000 2024-06-04T15:51:29.789 INFO:teuthology.orchestra.run.smithi144.stdout:min_mon_release 17 (quincy) 2024-06-04T15:51:29.789 INFO:teuthology.orchestra.run.smithi144.stdout:election_strategy: 1 2024-06-04T15:51:29.789 INFO:teuthology.orchestra.run.smithi144.stdout:0: [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] mon.a 2024-06-04T15:51:29.789 INFO:teuthology.orchestra.run.smithi144.stdout:1: [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] mon.b 2024-06-04T15:51:29.789 INFO:teuthology.orchestra.run.smithi144.stdout:2: [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] mon.c 2024-06-04T15:51:29.789 INFO:teuthology.orchestra.run.smithi144.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-06-04T15:51:29.791 DEBUG:teuthology.orchestra.run.smithi144:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-06-04T15:51:29.819 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 15e56bb1-4856-42f3-b6db-a2c8f23c5557... 2024-06-04T15:51:29.819 DEBUG:teuthology.orchestra.run.smithi144:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-06-04T15:51:29.862 DEBUG:teuthology.orchestra.run.smithi177:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-06-04T15:51:29.916 INFO:teuthology.orchestra.run.smithi144.stdout:[global] 2024-06-04T15:51:29.916 INFO:teuthology.orchestra.run.smithi144.stdout: chdir = "" 2024-06-04T15:51:29.916 INFO:teuthology.orchestra.run.smithi144.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-06-04T15:51:29.916 INFO:teuthology.orchestra.run.smithi144.stdout: auth supported = cephx 2024-06-04T15:51:29.916 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T15:51:29.917 INFO:teuthology.orchestra.run.smithi144.stdout: filestore xattr use omap = true 2024-06-04T15:51:29.917 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T15:51:29.917 INFO:teuthology.orchestra.run.smithi144.stdout: mon clock drift allowed = 1.000 2024-06-04T15:51:29.917 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T15:51:29.917 INFO:teuthology.orchestra.run.smithi144.stdout: osd crush chooseleaf type = 0 2024-06-04T15:51:29.917 INFO:teuthology.orchestra.run.smithi144.stdout: auth debug = true 2024-06-04T15:51:29.917 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T15:51:29.917 INFO:teuthology.orchestra.run.smithi144.stdout: ms die on old message = true 2024-06-04T15:51:29.917 INFO:teuthology.orchestra.run.smithi144.stdout: ms die on bug = true 2024-06-04T15:51:29.918 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T15:51:29.918 INFO:teuthology.orchestra.run.smithi144.stdout: mon max pg per osd = 10000 # >= luminous 2024-06-04T15:51:29.918 INFO:teuthology.orchestra.run.smithi144.stdout: mon pg warn max object skew = 0 2024-06-04T15:51:29.918 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T15:51:29.918 INFO:teuthology.orchestra.run.smithi144.stdout: # disable pg_autoscaler by default for new pools 2024-06-04T15:51:29.918 INFO:teuthology.orchestra.run.smithi144.stdout: osd_pool_default_pg_autoscale_mode = off 2024-06-04T15:51:29.918 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T15:51:29.918 INFO:teuthology.orchestra.run.smithi144.stdout: osd pool default size = 2 2024-06-04T15:51:29.918 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T15:51:29.918 INFO:teuthology.orchestra.run.smithi144.stdout: mon osd allow primary affinity = true 2024-06-04T15:51:29.918 INFO:teuthology.orchestra.run.smithi144.stdout: mon osd allow pg remap = true 2024-06-04T15:51:29.918 INFO:teuthology.orchestra.run.smithi144.stdout: mon warn on legacy crush tunables = false 2024-06-04T15:51:29.919 INFO:teuthology.orchestra.run.smithi144.stdout: mon warn on crush straw calc version zero = false 2024-06-04T15:51:29.919 INFO:teuthology.orchestra.run.smithi144.stdout: mon warn on no sortbitwise = false 2024-06-04T15:51:29.919 INFO:teuthology.orchestra.run.smithi144.stdout: mon warn on osd down out interval zero = false 2024-06-04T15:51:29.919 INFO:teuthology.orchestra.run.smithi144.stdout: mon warn on too few osds = false 2024-06-04T15:51:29.919 INFO:teuthology.orchestra.run.smithi144.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-06-04T15:51:29.919 INFO:teuthology.orchestra.run.smithi144.stdout: mon_warn_on_pool_no_redundancy = false 2024-06-04T15:51:29.919 INFO:teuthology.orchestra.run.smithi144.stdout: mon_allow_pool_size_one = true 2024-06-04T15:51:29.919 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T15:51:29.919 INFO:teuthology.orchestra.run.smithi144.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-06-04T15:51:29.919 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T15:51:29.919 INFO:teuthology.orchestra.run.smithi144.stdout: osd default data pool replay window = 5 2024-06-04T15:51:29.919 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T15:51:29.919 INFO:teuthology.orchestra.run.smithi144.stdout: mon allow pool delete = true 2024-06-04T15:51:29.920 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T15:51:29.920 INFO:teuthology.orchestra.run.smithi144.stdout: mon cluster log file level = debug 2024-06-04T15:51:29.920 INFO:teuthology.orchestra.run.smithi144.stdout: debug asserts on shutdown = true 2024-06-04T15:51:29.920 INFO:teuthology.orchestra.run.smithi144.stdout: mon health detail to clog = false 2024-06-04T15:51:29.920 INFO:teuthology.orchestra.run.smithi144.stdout: mon host = "172.21.15.144,[v2:172.21.15.144:3301,v1:172.21.15.144:6790],172.21.15.177" 2024-06-04T15:51:29.920 INFO:teuthology.orchestra.run.smithi144.stdout: mon client directed command retry = 5 2024-06-04T15:51:29.920 INFO:teuthology.orchestra.run.smithi144.stdout: ms inject socket failures = 5000 2024-06-04T15:51:29.920 INFO:teuthology.orchestra.run.smithi144.stdout: osd_max_pg_log_entries = 10 2024-06-04T15:51:29.920 INFO:teuthology.orchestra.run.smithi144.stdout: osd_min_pg_log_entries = 10 2024-06-04T15:51:29.920 INFO:teuthology.orchestra.run.smithi144.stdout: fsid = 15e56bb1-4856-42f3-b6db-a2c8f23c5557 2024-06-04T15:51:29.920 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T15:51:29.920 INFO:teuthology.orchestra.run.smithi144.stdout:[osd] 2024-06-04T15:51:29.920 INFO:teuthology.orchestra.run.smithi144.stdout: osd journal size = 100 2024-06-04T15:51:29.920 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T15:51:29.921 INFO:teuthology.orchestra.run.smithi144.stdout: osd scrub load threshold = 5.0 2024-06-04T15:51:29.921 INFO:teuthology.orchestra.run.smithi144.stdout: osd scrub max interval = 600 2024-06-04T15:51:29.921 INFO:teuthology.orchestra.run.smithi144.stdout: osd mclock profile = high_recovery_ops 2024-06-04T15:51:29.921 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T15:51:29.921 INFO:teuthology.orchestra.run.smithi144.stdout: osd recover clone overlap = true 2024-06-04T15:51:29.921 INFO:teuthology.orchestra.run.smithi144.stdout: osd recovery max chunk = 1048576 2024-06-04T15:51:29.921 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T15:51:29.921 INFO:teuthology.orchestra.run.smithi144.stdout: osd debug shutdown = true 2024-06-04T15:51:29.921 INFO:teuthology.orchestra.run.smithi144.stdout: osd debug op order = true 2024-06-04T15:51:29.921 INFO:teuthology.orchestra.run.smithi144.stdout: osd debug verify stray on activate = true 2024-06-04T15:51:29.921 INFO:teuthology.orchestra.run.smithi144.stdout: osd debug trim objects = true 2024-06-04T15:51:29.921 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T15:51:29.921 INFO:teuthology.orchestra.run.smithi144.stdout: osd open classes on start = true 2024-06-04T15:51:29.921 INFO:teuthology.orchestra.run.smithi144.stdout: osd debug pg log writeout = true 2024-06-04T15:51:29.922 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T15:51:29.922 INFO:teuthology.orchestra.run.smithi144.stdout: osd deep scrub update digest min age = 30 2024-06-04T15:51:29.922 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T15:51:29.922 INFO:teuthology.orchestra.run.smithi144.stdout: osd map max advance = 10 2024-06-04T15:51:29.922 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T15:51:29.922 INFO:teuthology.orchestra.run.smithi144.stdout: journal zero on create = true 2024-06-04T15:51:29.922 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T15:51:29.922 INFO:teuthology.orchestra.run.smithi144.stdout: filestore ondisk finisher threads = 3 2024-06-04T15:51:29.922 INFO:teuthology.orchestra.run.smithi144.stdout: filestore apply finisher threads = 3 2024-06-04T15:51:29.922 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T15:51:29.922 INFO:teuthology.orchestra.run.smithi144.stdout: bdev debug aio = true 2024-06-04T15:51:29.922 INFO:teuthology.orchestra.run.smithi144.stdout: osd debug misdirected ops = true 2024-06-04T15:51:29.923 INFO:teuthology.orchestra.run.smithi144.stdout: bdev async discard = True 2024-06-04T15:51:29.923 INFO:teuthology.orchestra.run.smithi144.stdout: bdev enable discard = True 2024-06-04T15:51:29.923 INFO:teuthology.orchestra.run.smithi144.stdout: bluestore allocator = bitmap 2024-06-04T15:51:29.923 INFO:teuthology.orchestra.run.smithi144.stdout: bluestore block size = 96636764160 2024-06-04T15:51:29.923 INFO:teuthology.orchestra.run.smithi144.stdout: bluestore fsck on mount = True 2024-06-04T15:51:29.923 INFO:teuthology.orchestra.run.smithi144.stdout: debug bluefs = 1/20 2024-06-04T15:51:29.923 INFO:teuthology.orchestra.run.smithi144.stdout: debug bluestore = 1/20 2024-06-04T15:51:29.923 INFO:teuthology.orchestra.run.smithi144.stdout: debug ms = 1 2024-06-04T15:51:29.923 INFO:teuthology.orchestra.run.smithi144.stdout: debug osd = 20 2024-06-04T15:51:29.923 INFO:teuthology.orchestra.run.smithi144.stdout: debug rocksdb = 4/10 2024-06-04T15:51:29.923 INFO:teuthology.orchestra.run.smithi144.stdout: lockdep = True 2024-06-04T15:51:29.923 INFO:teuthology.orchestra.run.smithi144.stdout: mon osd backfillfull_ratio = 0.85 2024-06-04T15:51:29.923 INFO:teuthology.orchestra.run.smithi144.stdout: mon osd full ratio = 0.9 2024-06-04T15:51:29.923 INFO:teuthology.orchestra.run.smithi144.stdout: mon osd nearfull ratio = 0.8 2024-06-04T15:51:29.924 INFO:teuthology.orchestra.run.smithi144.stdout: osd failsafe full ratio = 0.95 2024-06-04T15:51:29.924 INFO:teuthology.orchestra.run.smithi144.stdout: osd objectstore = bluestore 2024-06-04T15:51:29.924 INFO:teuthology.orchestra.run.smithi144.stdout: osd shutdown pgref assert = True 2024-06-04T15:51:29.924 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T15:51:29.924 INFO:teuthology.orchestra.run.smithi144.stdout:[mgr] 2024-06-04T15:51:29.924 INFO:teuthology.orchestra.run.smithi144.stdout: debug ms = 1 2024-06-04T15:51:29.924 INFO:teuthology.orchestra.run.smithi144.stdout: debug mgr = 20 2024-06-04T15:51:29.924 INFO:teuthology.orchestra.run.smithi144.stdout: debug mon = 20 2024-06-04T15:51:29.924 INFO:teuthology.orchestra.run.smithi144.stdout: debug auth = 20 2024-06-04T15:51:29.924 INFO:teuthology.orchestra.run.smithi144.stdout: mon reweight min pgs per osd = 4 2024-06-04T15:51:29.924 INFO:teuthology.orchestra.run.smithi144.stdout: mon reweight min bytes per osd = 10 2024-06-04T15:51:29.924 INFO:teuthology.orchestra.run.smithi144.stdout: mgr/telemetry/nag = false 2024-06-04T15:51:29.924 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T15:51:29.924 INFO:teuthology.orchestra.run.smithi144.stdout:[mon] 2024-06-04T15:51:29.925 INFO:teuthology.orchestra.run.smithi144.stdout: debug ms = 1 2024-06-04T15:51:29.925 INFO:teuthology.orchestra.run.smithi144.stdout: debug mon = 20 2024-06-04T15:51:29.925 INFO:teuthology.orchestra.run.smithi144.stdout: debug paxos = 20 2024-06-04T15:51:29.925 INFO:teuthology.orchestra.run.smithi144.stdout: debug auth = 20 2024-06-04T15:51:29.925 INFO:teuthology.orchestra.run.smithi144.stdout: mon data avail warn = 5 2024-06-04T15:51:29.925 INFO:teuthology.orchestra.run.smithi144.stdout: mon mgr mkfs grace = 240 2024-06-04T15:51:29.925 INFO:teuthology.orchestra.run.smithi144.stdout: mon reweight min pgs per osd = 4 2024-06-04T15:51:29.925 INFO:teuthology.orchestra.run.smithi144.stdout: mon osd reporter subtree level = osd 2024-06-04T15:51:29.925 INFO:teuthology.orchestra.run.smithi144.stdout: mon osd prime pg temp = true 2024-06-04T15:51:29.925 INFO:teuthology.orchestra.run.smithi144.stdout: mon reweight min bytes per osd = 10 2024-06-04T15:51:29.925 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T15:51:29.925 INFO:teuthology.orchestra.run.smithi144.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-06-04T15:51:29.925 INFO:teuthology.orchestra.run.smithi144.stdout: auth mon ticket ttl = 660 # 11m 2024-06-04T15:51:29.926 INFO:teuthology.orchestra.run.smithi144.stdout: auth service ticket ttl = 240 # 4m 2024-06-04T15:51:29.926 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T15:51:29.926 INFO:teuthology.orchestra.run.smithi144.stdout: # don't complain about insecure global_id in the test suite 2024-06-04T15:51:29.926 INFO:teuthology.orchestra.run.smithi144.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-06-04T15:51:29.926 INFO:teuthology.orchestra.run.smithi144.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-06-04T15:51:29.926 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T15:51:29.926 INFO:teuthology.orchestra.run.smithi144.stdout: # 1m isn't quite enough 2024-06-04T15:51:29.926 INFO:teuthology.orchestra.run.smithi144.stdout: mon_down_mkfs_grace = 2m 2024-06-04T15:51:29.926 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T15:51:29.926 INFO:teuthology.orchestra.run.smithi144.stdout: mon_warn_on_filestore_osds = false 2024-06-04T15:51:29.926 INFO:teuthology.orchestra.run.smithi144.stdout: lockdep = True 2024-06-04T15:51:29.926 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T15:51:29.926 INFO:teuthology.orchestra.run.smithi144.stdout:[client] 2024-06-04T15:51:29.927 INFO:teuthology.orchestra.run.smithi144.stdout: rgw cache enabled = true 2024-06-04T15:51:29.927 INFO:teuthology.orchestra.run.smithi144.stdout: rgw enable ops log = true 2024-06-04T15:51:29.927 INFO:teuthology.orchestra.run.smithi144.stdout: rgw enable usage log = true 2024-06-04T15:51:29.927 INFO:teuthology.orchestra.run.smithi144.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-06-04T15:51:29.927 INFO:teuthology.orchestra.run.smithi144.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-06-04T15:51:29.927 INFO:teuthology.orchestra.run.smithi144.stdout: debug rgw = 20 2024-06-04T15:51:29.927 INFO:teuthology.orchestra.run.smithi144.stdout: rgw bucket counters cache = True 2024-06-04T15:51:29.927 INFO:teuthology.orchestra.run.smithi144.stdout: rgw crypt require ssl = False 2024-06-04T15:51:29.927 INFO:teuthology.orchestra.run.smithi144.stdout: rgw crypt s3 kms backend = testing 2024-06-04T15:51:29.927 INFO:teuthology.orchestra.run.smithi144.stdout: rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= 2024-06-04T15:51:29.927 INFO:teuthology.orchestra.run.smithi144.stdout: rgw torrent flag = True 2024-06-04T15:51:29.927 INFO:teuthology.orchestra.run.smithi144.stdout: rgw user counters cache = True 2024-06-04T15:51:29.927 INFO:teuthology.orchestra.run.smithi144.stdout: setgroup = ceph 2024-06-04T15:51:29.927 INFO:teuthology.orchestra.run.smithi144.stdout: setuser = ceph 2024-06-04T15:51:29.928 INFO:teuthology.orchestra.run.smithi144.stdout:[mon.a] 2024-06-04T15:51:29.928 INFO:teuthology.orchestra.run.smithi144.stdout:[mon.c] 2024-06-04T15:51:29.928 INFO:teuthology.orchestra.run.smithi144.stdout:[mon.b] 2024-06-04T15:51:29.928 INFO:teuthology.orchestra.run.smithi177.stdout:[global] 2024-06-04T15:51:29.928 INFO:teuthology.orchestra.run.smithi177.stdout: chdir = "" 2024-06-04T15:51:29.928 INFO:teuthology.orchestra.run.smithi177.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-06-04T15:51:29.929 INFO:teuthology.orchestra.run.smithi177.stdout: auth supported = cephx 2024-06-04T15:51:29.929 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-06-04T15:51:29.929 INFO:teuthology.orchestra.run.smithi177.stdout: filestore xattr use omap = true 2024-06-04T15:51:29.929 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-06-04T15:51:29.929 INFO:teuthology.orchestra.run.smithi177.stdout: mon clock drift allowed = 1.000 2024-06-04T15:51:29.929 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-06-04T15:51:29.929 INFO:teuthology.orchestra.run.smithi177.stdout: osd crush chooseleaf type = 0 2024-06-04T15:51:29.929 INFO:teuthology.orchestra.run.smithi177.stdout: auth debug = true 2024-06-04T15:51:29.929 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-06-04T15:51:29.929 INFO:teuthology.orchestra.run.smithi177.stdout: ms die on old message = true 2024-06-04T15:51:29.929 INFO:teuthology.orchestra.run.smithi177.stdout: ms die on bug = true 2024-06-04T15:51:29.929 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-06-04T15:51:29.929 INFO:teuthology.orchestra.run.smithi177.stdout: mon max pg per osd = 10000 # >= luminous 2024-06-04T15:51:29.929 INFO:teuthology.orchestra.run.smithi177.stdout: mon pg warn max object skew = 0 2024-06-04T15:51:29.930 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-06-04T15:51:29.930 INFO:teuthology.orchestra.run.smithi177.stdout: # disable pg_autoscaler by default for new pools 2024-06-04T15:51:29.930 INFO:teuthology.orchestra.run.smithi177.stdout: osd_pool_default_pg_autoscale_mode = off 2024-06-04T15:51:29.930 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-06-04T15:51:29.930 INFO:teuthology.orchestra.run.smithi177.stdout: osd pool default size = 2 2024-06-04T15:51:29.930 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-06-04T15:51:29.930 INFO:teuthology.orchestra.run.smithi177.stdout: mon osd allow primary affinity = true 2024-06-04T15:51:29.930 INFO:teuthology.orchestra.run.smithi177.stdout: mon osd allow pg remap = true 2024-06-04T15:51:29.930 INFO:teuthology.orchestra.run.smithi177.stdout: mon warn on legacy crush tunables = false 2024-06-04T15:51:29.930 INFO:teuthology.orchestra.run.smithi177.stdout: mon warn on crush straw calc version zero = false 2024-06-04T15:51:29.930 INFO:teuthology.orchestra.run.smithi177.stdout: mon warn on no sortbitwise = false 2024-06-04T15:51:29.930 INFO:teuthology.orchestra.run.smithi177.stdout: mon warn on osd down out interval zero = false 2024-06-04T15:51:29.930 INFO:teuthology.orchestra.run.smithi177.stdout: mon warn on too few osds = false 2024-06-04T15:51:29.931 INFO:teuthology.orchestra.run.smithi177.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-06-04T15:51:29.931 INFO:teuthology.orchestra.run.smithi177.stdout: mon_warn_on_pool_no_redundancy = false 2024-06-04T15:51:29.931 INFO:teuthology.orchestra.run.smithi177.stdout: mon_allow_pool_size_one = true 2024-06-04T15:51:29.931 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-06-04T15:51:29.931 INFO:teuthology.orchestra.run.smithi177.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-06-04T15:51:29.931 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-06-04T15:51:29.931 INFO:teuthology.orchestra.run.smithi177.stdout: osd default data pool replay window = 5 2024-06-04T15:51:29.931 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-06-04T15:51:29.931 INFO:teuthology.orchestra.run.smithi177.stdout: mon allow pool delete = true 2024-06-04T15:51:29.931 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-06-04T15:51:29.931 INFO:teuthology.orchestra.run.smithi177.stdout: mon cluster log file level = debug 2024-06-04T15:51:29.931 INFO:teuthology.orchestra.run.smithi177.stdout: debug asserts on shutdown = true 2024-06-04T15:51:29.931 INFO:teuthology.orchestra.run.smithi177.stdout: mon health detail to clog = false 2024-06-04T15:51:29.932 INFO:teuthology.orchestra.run.smithi177.stdout: mon host = "172.21.15.144,[v2:172.21.15.144:3301,v1:172.21.15.144:6790],172.21.15.177" 2024-06-04T15:51:29.932 INFO:teuthology.orchestra.run.smithi177.stdout: mon client directed command retry = 5 2024-06-04T15:51:29.932 INFO:teuthology.orchestra.run.smithi177.stdout: ms inject socket failures = 5000 2024-06-04T15:51:29.932 INFO:teuthology.orchestra.run.smithi177.stdout: osd_max_pg_log_entries = 10 2024-06-04T15:51:29.932 INFO:teuthology.orchestra.run.smithi177.stdout: osd_min_pg_log_entries = 10 2024-06-04T15:51:29.932 INFO:teuthology.orchestra.run.smithi177.stdout: fsid = 15e56bb1-4856-42f3-b6db-a2c8f23c5557 2024-06-04T15:51:29.932 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-06-04T15:51:29.932 INFO:teuthology.orchestra.run.smithi177.stdout:[osd] 2024-06-04T15:51:29.932 INFO:teuthology.orchestra.run.smithi177.stdout: osd journal size = 100 2024-06-04T15:51:29.932 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-06-04T15:51:29.933 INFO:teuthology.orchestra.run.smithi177.stdout: osd scrub load threshold = 5.0 2024-06-04T15:51:29.933 INFO:teuthology.orchestra.run.smithi177.stdout: osd scrub max interval = 600 2024-06-04T15:51:29.933 INFO:teuthology.orchestra.run.smithi177.stdout: osd mclock profile = high_recovery_ops 2024-06-04T15:51:29.933 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-06-04T15:51:29.933 INFO:teuthology.orchestra.run.smithi177.stdout: osd recover clone overlap = true 2024-06-04T15:51:29.933 INFO:teuthology.orchestra.run.smithi177.stdout: osd recovery max chunk = 1048576 2024-06-04T15:51:29.933 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-06-04T15:51:29.933 INFO:teuthology.orchestra.run.smithi177.stdout: osd debug shutdown = true 2024-06-04T15:51:29.933 INFO:teuthology.orchestra.run.smithi177.stdout: osd debug op order = true 2024-06-04T15:51:29.933 INFO:teuthology.orchestra.run.smithi177.stdout: osd debug verify stray on activate = true 2024-06-04T15:51:29.933 INFO:teuthology.orchestra.run.smithi177.stdout: osd debug trim objects = true 2024-06-04T15:51:29.933 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-06-04T15:51:29.933 INFO:teuthology.orchestra.run.smithi177.stdout: osd open classes on start = true 2024-06-04T15:51:29.934 INFO:teuthology.orchestra.run.smithi177.stdout: osd debug pg log writeout = true 2024-06-04T15:51:29.934 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-06-04T15:51:29.934 INFO:teuthology.orchestra.run.smithi177.stdout: osd deep scrub update digest min age = 30 2024-06-04T15:51:29.934 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-06-04T15:51:29.934 INFO:teuthology.orchestra.run.smithi177.stdout: osd map max advance = 10 2024-06-04T15:51:29.934 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-06-04T15:51:29.934 INFO:teuthology.orchestra.run.smithi177.stdout: journal zero on create = true 2024-06-04T15:51:29.934 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-06-04T15:51:29.934 INFO:teuthology.orchestra.run.smithi177.stdout: filestore ondisk finisher threads = 3 2024-06-04T15:51:29.934 INFO:teuthology.orchestra.run.smithi177.stdout: filestore apply finisher threads = 3 2024-06-04T15:51:29.934 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-06-04T15:51:29.935 INFO:teuthology.orchestra.run.smithi177.stdout: bdev debug aio = true 2024-06-04T15:51:29.935 INFO:teuthology.orchestra.run.smithi177.stdout: osd debug misdirected ops = true 2024-06-04T15:51:29.935 INFO:teuthology.orchestra.run.smithi177.stdout: bdev async discard = True 2024-06-04T15:51:29.935 INFO:teuthology.orchestra.run.smithi177.stdout: bdev enable discard = True 2024-06-04T15:51:29.935 INFO:teuthology.orchestra.run.smithi177.stdout: bluestore allocator = bitmap 2024-06-04T15:51:29.935 INFO:teuthology.orchestra.run.smithi177.stdout: bluestore block size = 96636764160 2024-06-04T15:51:29.935 INFO:teuthology.orchestra.run.smithi177.stdout: bluestore fsck on mount = True 2024-06-04T15:51:29.935 INFO:teuthology.orchestra.run.smithi177.stdout: debug bluefs = 1/20 2024-06-04T15:51:29.935 INFO:teuthology.orchestra.run.smithi177.stdout: debug bluestore = 1/20 2024-06-04T15:51:29.935 INFO:teuthology.orchestra.run.smithi177.stdout: debug ms = 1 2024-06-04T15:51:29.935 INFO:teuthology.orchestra.run.smithi177.stdout: debug osd = 20 2024-06-04T15:51:29.935 INFO:teuthology.orchestra.run.smithi177.stdout: debug rocksdb = 4/10 2024-06-04T15:51:29.936 INFO:teuthology.orchestra.run.smithi177.stdout: lockdep = True 2024-06-04T15:51:29.936 INFO:teuthology.orchestra.run.smithi177.stdout: mon osd backfillfull_ratio = 0.85 2024-06-04T15:51:29.936 INFO:teuthology.orchestra.run.smithi177.stdout: mon osd full ratio = 0.9 2024-06-04T15:51:29.936 INFO:teuthology.orchestra.run.smithi177.stdout: mon osd nearfull ratio = 0.8 2024-06-04T15:51:29.936 INFO:teuthology.orchestra.run.smithi177.stdout: osd failsafe full ratio = 0.95 2024-06-04T15:51:29.936 INFO:teuthology.orchestra.run.smithi177.stdout: osd objectstore = bluestore 2024-06-04T15:51:29.936 INFO:teuthology.orchestra.run.smithi177.stdout: osd shutdown pgref assert = True 2024-06-04T15:51:29.936 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-06-04T15:51:29.936 INFO:teuthology.orchestra.run.smithi177.stdout:[mgr] 2024-06-04T15:51:29.936 INFO:teuthology.orchestra.run.smithi177.stdout: debug ms = 1 2024-06-04T15:51:29.936 INFO:teuthology.orchestra.run.smithi177.stdout: debug mgr = 20 2024-06-04T15:51:29.936 INFO:teuthology.orchestra.run.smithi177.stdout: debug mon = 20 2024-06-04T15:51:29.937 INFO:teuthology.orchestra.run.smithi177.stdout: debug auth = 20 2024-06-04T15:51:29.937 INFO:teuthology.orchestra.run.smithi177.stdout: mon reweight min pgs per osd = 4 2024-06-04T15:51:29.937 INFO:teuthology.orchestra.run.smithi177.stdout: mon reweight min bytes per osd = 10 2024-06-04T15:51:29.937 INFO:teuthology.orchestra.run.smithi177.stdout: mgr/telemetry/nag = false 2024-06-04T15:51:29.937 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-06-04T15:51:29.937 INFO:teuthology.orchestra.run.smithi177.stdout:[mon] 2024-06-04T15:51:29.937 INFO:teuthology.orchestra.run.smithi177.stdout: debug ms = 1 2024-06-04T15:51:29.937 INFO:teuthology.orchestra.run.smithi177.stdout: debug mon = 20 2024-06-04T15:51:29.937 INFO:teuthology.orchestra.run.smithi177.stdout: debug paxos = 20 2024-06-04T15:51:29.937 INFO:teuthology.orchestra.run.smithi177.stdout: debug auth = 20 2024-06-04T15:51:29.937 INFO:teuthology.orchestra.run.smithi177.stdout: mon data avail warn = 5 2024-06-04T15:51:29.938 INFO:teuthology.orchestra.run.smithi177.stdout: mon mgr mkfs grace = 240 2024-06-04T15:51:29.938 INFO:teuthology.orchestra.run.smithi177.stdout: mon reweight min pgs per osd = 4 2024-06-04T15:51:29.938 INFO:teuthology.orchestra.run.smithi177.stdout: mon osd reporter subtree level = osd 2024-06-04T15:51:29.938 INFO:teuthology.orchestra.run.smithi177.stdout: mon osd prime pg temp = true 2024-06-04T15:51:29.938 INFO:teuthology.orchestra.run.smithi177.stdout: mon reweight min bytes per osd = 10 2024-06-04T15:51:29.938 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-06-04T15:51:29.938 INFO:teuthology.orchestra.run.smithi177.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-06-04T15:51:29.938 INFO:teuthology.orchestra.run.smithi177.stdout: auth mon ticket ttl = 660 # 11m 2024-06-04T15:51:29.938 INFO:teuthology.orchestra.run.smithi177.stdout: auth service ticket ttl = 240 # 4m 2024-06-04T15:51:29.938 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-06-04T15:51:29.938 INFO:teuthology.orchestra.run.smithi177.stdout: # don't complain about insecure global_id in the test suite 2024-06-04T15:51:29.938 INFO:teuthology.orchestra.run.smithi177.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-06-04T15:51:29.938 INFO:teuthology.orchestra.run.smithi177.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-06-04T15:51:29.939 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-06-04T15:51:29.939 INFO:teuthology.orchestra.run.smithi177.stdout: # 1m isn't quite enough 2024-06-04T15:51:29.939 INFO:teuthology.orchestra.run.smithi177.stdout: mon_down_mkfs_grace = 2m 2024-06-04T15:51:29.939 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-06-04T15:51:29.939 INFO:teuthology.orchestra.run.smithi177.stdout: mon_warn_on_filestore_osds = false 2024-06-04T15:51:29.939 INFO:teuthology.orchestra.run.smithi177.stdout: lockdep = True 2024-06-04T15:51:29.939 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-06-04T15:51:29.939 INFO:teuthology.orchestra.run.smithi177.stdout:[client] 2024-06-04T15:51:29.939 INFO:teuthology.orchestra.run.smithi177.stdout: rgw cache enabled = true 2024-06-04T15:51:29.939 INFO:teuthology.orchestra.run.smithi177.stdout: rgw enable ops log = true 2024-06-04T15:51:29.939 INFO:teuthology.orchestra.run.smithi177.stdout: rgw enable usage log = true 2024-06-04T15:51:29.939 INFO:teuthology.orchestra.run.smithi177.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-06-04T15:51:29.939 INFO:teuthology.orchestra.run.smithi177.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-06-04T15:51:29.939 INFO:teuthology.orchestra.run.smithi177.stdout: debug rgw = 20 2024-06-04T15:51:29.940 INFO:teuthology.orchestra.run.smithi177.stdout: rgw bucket counters cache = True 2024-06-04T15:51:29.940 INFO:teuthology.orchestra.run.smithi177.stdout: rgw crypt require ssl = False 2024-06-04T15:51:29.940 INFO:teuthology.orchestra.run.smithi177.stdout: rgw crypt s3 kms backend = testing 2024-06-04T15:51:29.940 INFO:teuthology.orchestra.run.smithi177.stdout: rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= 2024-06-04T15:51:29.940 INFO:teuthology.orchestra.run.smithi177.stdout: rgw torrent flag = True 2024-06-04T15:51:29.940 INFO:teuthology.orchestra.run.smithi177.stdout: rgw user counters cache = True 2024-06-04T15:51:29.940 INFO:teuthology.orchestra.run.smithi177.stdout: setgroup = ceph 2024-06-04T15:51:29.940 INFO:teuthology.orchestra.run.smithi177.stdout: setuser = ceph 2024-06-04T15:51:29.940 INFO:teuthology.orchestra.run.smithi177.stdout:[mon.a] 2024-06-04T15:51:29.940 INFO:teuthology.orchestra.run.smithi177.stdout:[mon.c] 2024-06-04T15:51:29.940 INFO:teuthology.orchestra.run.smithi177.stdout:[mon.b] 2024-06-04T15:51:29.942 INFO:tasks.ceph:Creating admin key on mon.a... 2024-06-04T15:51:29.942 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-06-04T15:51:30.010 INFO:tasks.ceph:Copying monmap to all nodes... 2024-06-04T15:51:30.011 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-06-04T15:51:30.011 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-06-04T15:51:30.039 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-06-04T15:51:30.039 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-06-04T15:51:30.109 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi144.front.sepia.ceph.com 2024-06-04T15:51:30.109 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-06-04T15:51:30.109 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd of=/etc/ceph/ceph.keyring 2024-06-04T15:51:30.109 DEBUG:teuthology.orchestra.run.smithi144:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-06-04T15:51:30.198 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-06-04T15:51:30.198 DEBUG:teuthology.orchestra.run.smithi144:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-06-04T15:51:30.266 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi177.front.sepia.ceph.com 2024-06-04T15:51:30.267 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-06-04T15:51:30.267 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd of=/etc/ceph/ceph.keyring 2024-06-04T15:51:30.267 DEBUG:teuthology.orchestra.run.smithi177:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-06-04T15:51:30.318 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-06-04T15:51:30.318 DEBUG:teuthology.orchestra.run.smithi177:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-06-04T15:51:30.388 INFO:tasks.ceph:Setting up mon nodes... 2024-06-04T15:51:30.388 INFO:tasks.ceph:Setting up mgr nodes... 2024-06-04T15:51:30.389 DEBUG:teuthology.orchestra.run.smithi144:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-06-04T15:51:30.453 INFO:teuthology.orchestra.run.smithi144.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-06-04T15:51:30.456 DEBUG:teuthology.orchestra.run.smithi177:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-06-04T15:51:30.530 INFO:teuthology.orchestra.run.smithi177.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-06-04T15:51:30.533 INFO:tasks.ceph:Setting up mds nodes... 2024-06-04T15:51:30.533 INFO:tasks.ceph_client:Setting up client nodes... 2024-06-04T15:51:30.534 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-06-04T15:51:30.588 INFO:teuthology.orchestra.run.smithi144.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-06-04T15:51:30.601 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-06-04T15:51:30.657 INFO:teuthology.orchestra.run.smithi177.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-06-04T15:51:30.670 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-06-04T15:51:30.671 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi144.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi177.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-06-04T15:51:30.671 DEBUG:teuthology.orchestra.run.smithi144:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-06-04T15:51:30.710 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-06-04T15:51:30.710 INFO:tasks.ceph:role: osd.0 2024-06-04T15:51:30.710 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi144.front.sepia.ceph.com 2024-06-04T15:51:30.710 DEBUG:teuthology.orchestra.run.smithi144:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-06-04T15:51:30.795 INFO:teuthology.orchestra.run.smithi144.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-06-04T15:51:30.795 INFO:teuthology.orchestra.run.smithi144.stdout: = sectsz=512 attr=2, projid32bit=1 2024-06-04T15:51:30.795 INFO:teuthology.orchestra.run.smithi144.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-06-04T15:51:30.795 INFO:teuthology.orchestra.run.smithi144.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-06-04T15:51:30.795 INFO:teuthology.orchestra.run.smithi144.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-06-04T15:51:30.795 INFO:teuthology.orchestra.run.smithi144.stdout: = sunit=0 swidth=0 blks 2024-06-04T15:51:30.795 INFO:teuthology.orchestra.run.smithi144.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-06-04T15:51:30.795 INFO:teuthology.orchestra.run.smithi144.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-06-04T15:51:30.795 INFO:teuthology.orchestra.run.smithi144.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-06-04T15:51:30.796 INFO:teuthology.orchestra.run.smithi144.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-06-04T15:51:31.286 INFO:teuthology.orchestra.run.smithi144.stdout:Discarding blocks...Done. 2024-06-04T15:51:31.288 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi144.front.sepia.ceph.com -o noatime 2024-06-04T15:51:31.288 DEBUG:teuthology.orchestra.run.smithi144:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-06-04T15:51:31.385 DEBUG:teuthology.orchestra.run.smithi144:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-06-04T15:51:31.430 DEBUG:teuthology.orchestra.run.smithi144:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-06-04T15:51:31.469 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-06-04T15:51:31.469 INFO:tasks.ceph:role: osd.1 2024-06-04T15:51:31.469 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi144.front.sepia.ceph.com 2024-06-04T15:51:31.469 DEBUG:teuthology.orchestra.run.smithi144:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-06-04T15:51:31.555 INFO:teuthology.orchestra.run.smithi144.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-06-04T15:51:31.555 INFO:teuthology.orchestra.run.smithi144.stdout: = sectsz=512 attr=2, projid32bit=1 2024-06-04T15:51:31.555 INFO:teuthology.orchestra.run.smithi144.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-06-04T15:51:31.555 INFO:teuthology.orchestra.run.smithi144.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-06-04T15:51:31.556 INFO:teuthology.orchestra.run.smithi144.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-06-04T15:51:31.556 INFO:teuthology.orchestra.run.smithi144.stdout: = sunit=0 swidth=0 blks 2024-06-04T15:51:31.556 INFO:teuthology.orchestra.run.smithi144.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-06-04T15:51:31.556 INFO:teuthology.orchestra.run.smithi144.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-06-04T15:51:31.556 INFO:teuthology.orchestra.run.smithi144.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-06-04T15:51:31.556 INFO:teuthology.orchestra.run.smithi144.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-06-04T15:51:32.010 INFO:teuthology.orchestra.run.smithi144.stdout:Discarding blocks...Done. 2024-06-04T15:51:32.013 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi144.front.sepia.ceph.com -o noatime 2024-06-04T15:51:32.013 DEBUG:teuthology.orchestra.run.smithi144:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-06-04T15:51:32.059 DEBUG:teuthology.orchestra.run.smithi144:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-06-04T15:51:32.101 DEBUG:teuthology.orchestra.run.smithi144:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-06-04T15:51:32.183 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-06-04T15:51:32.183 INFO:tasks.ceph:role: osd.2 2024-06-04T15:51:32.183 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi144.front.sepia.ceph.com 2024-06-04T15:51:32.184 DEBUG:teuthology.orchestra.run.smithi144:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-06-04T15:51:32.268 INFO:teuthology.orchestra.run.smithi144.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-06-04T15:51:32.268 INFO:teuthology.orchestra.run.smithi144.stdout: = sectsz=512 attr=2, projid32bit=1 2024-06-04T15:51:32.268 INFO:teuthology.orchestra.run.smithi144.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-06-04T15:51:32.269 INFO:teuthology.orchestra.run.smithi144.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-06-04T15:51:32.269 INFO:teuthology.orchestra.run.smithi144.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-06-04T15:51:32.269 INFO:teuthology.orchestra.run.smithi144.stdout: = sunit=0 swidth=0 blks 2024-06-04T15:51:32.269 INFO:teuthology.orchestra.run.smithi144.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-06-04T15:51:32.269 INFO:teuthology.orchestra.run.smithi144.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-06-04T15:51:32.269 INFO:teuthology.orchestra.run.smithi144.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-06-04T15:51:32.269 INFO:teuthology.orchestra.run.smithi144.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-06-04T15:51:32.748 INFO:teuthology.orchestra.run.smithi144.stdout:Discarding blocks...Done. 2024-06-04T15:51:32.750 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi144.front.sepia.ceph.com -o noatime 2024-06-04T15:51:32.750 DEBUG:teuthology.orchestra.run.smithi144:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-06-04T15:51:32.824 DEBUG:teuthology.orchestra.run.smithi144:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-06-04T15:51:32.867 DEBUG:teuthology.orchestra.run.smithi144:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-06-04T15:51:32.947 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-06-04T15:51:32.947 INFO:tasks.ceph:role: osd.3 2024-06-04T15:51:32.947 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi144.front.sepia.ceph.com 2024-06-04T15:51:32.947 DEBUG:teuthology.orchestra.run.smithi144:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-06-04T15:51:33.035 INFO:teuthology.orchestra.run.smithi144.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-06-04T15:51:33.035 INFO:teuthology.orchestra.run.smithi144.stdout: = sectsz=512 attr=2, projid32bit=1 2024-06-04T15:51:33.035 INFO:teuthology.orchestra.run.smithi144.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-06-04T15:51:33.035 INFO:teuthology.orchestra.run.smithi144.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-06-04T15:51:33.035 INFO:teuthology.orchestra.run.smithi144.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-06-04T15:51:33.036 INFO:teuthology.orchestra.run.smithi144.stdout: = sunit=0 swidth=0 blks 2024-06-04T15:51:33.036 INFO:teuthology.orchestra.run.smithi144.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-06-04T15:51:33.036 INFO:teuthology.orchestra.run.smithi144.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-06-04T15:51:33.036 INFO:teuthology.orchestra.run.smithi144.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-06-04T15:51:33.036 INFO:teuthology.orchestra.run.smithi144.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-06-04T15:51:33.525 INFO:teuthology.orchestra.run.smithi144.stdout:Discarding blocks...Done. 2024-06-04T15:51:33.527 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi144.front.sepia.ceph.com -o noatime 2024-06-04T15:51:33.527 DEBUG:teuthology.orchestra.run.smithi144:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-06-04T15:51:33.626 DEBUG:teuthology.orchestra.run.smithi144:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-06-04T15:51:33.670 DEBUG:teuthology.orchestra.run.smithi144:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-06-04T15:51:33.786 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:51:33.786+0000 7f2e79a0e640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-06-04T15:51:33.787 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:51:33.787+0000 7f2e79a0e640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-06-04T15:51:33.787 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:51:33.787+0000 7f2e79a0e640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-06-04T15:51:33.787 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:51:33.787+0000 7f2e79a0e640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-06-04T15:51:33.787 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:51:33.787+0000 7f2e79a0e640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-06-04T15:51:33.794 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:51:33.794+0000 7f2e79a0e640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-06-04T15:51:36.642 DEBUG:teuthology.orchestra.run.smithi144:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-06-04T15:51:36.687 DEBUG:teuthology.orchestra.run.smithi144:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-06-04T15:51:36.790 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:51:36.789+0000 7f721240d640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-06-04T15:51:36.790 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:51:36.789+0000 7f721240d640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-06-04T15:51:36.790 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:51:36.789+0000 7f721240d640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-06-04T15:51:36.790 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:51:36.789+0000 7f721240d640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-06-04T15:51:36.790 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:51:36.789+0000 7f721240d640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-06-04T15:51:36.790 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:51:36.790+0000 7f721240d640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-06-04T15:51:39.653 DEBUG:teuthology.orchestra.run.smithi144:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-06-04T15:51:39.697 DEBUG:teuthology.orchestra.run.smithi144:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-06-04T15:51:39.800 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:51:39.800+0000 7f59a0b68640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-06-04T15:51:39.800 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:51:39.800+0000 7f59a0b68640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-06-04T15:51:39.801 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:51:39.800+0000 7f59a0b68640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-06-04T15:51:39.801 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:51:39.800+0000 7f59a0b68640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-06-04T15:51:39.801 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:51:39.800+0000 7f59a0b68640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-06-04T15:51:39.801 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:51:39.800+0000 7f59a0b68640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-06-04T15:51:42.660 DEBUG:teuthology.orchestra.run.smithi144:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-06-04T15:51:42.705 DEBUG:teuthology.orchestra.run.smithi144:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-06-04T15:51:42.814 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:51:42.811+0000 7fd3f370f640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-06-04T15:51:42.814 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:51:42.812+0000 7fd3f370f640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-06-04T15:51:42.814 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:51:42.812+0000 7fd3f370f640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-06-04T15:51:42.814 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:51:42.812+0000 7fd3f370f640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-06-04T15:51:42.814 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:51:42.812+0000 7fd3f370f640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-06-04T15:51:42.815 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:51:42.812+0000 7fd3f370f640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-06-04T15:51:45.664 DEBUG:teuthology.orchestra.run.smithi144:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-06-04T15:51:45.706 DEBUG:teuthology.orchestra.run.smithi177:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-06-04T15:51:45.751 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-06-04T15:51:45.752 INFO:tasks.ceph:role: osd.4 2024-06-04T15:51:45.752 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi177.front.sepia.ceph.com 2024-06-04T15:51:45.752 DEBUG:teuthology.orchestra.run.smithi177:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-06-04T15:51:45.800 INFO:teuthology.orchestra.run.smithi177.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-06-04T15:51:45.800 INFO:teuthology.orchestra.run.smithi177.stdout: = sectsz=512 attr=2, projid32bit=1 2024-06-04T15:51:45.800 INFO:teuthology.orchestra.run.smithi177.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-06-04T15:51:45.801 INFO:teuthology.orchestra.run.smithi177.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-06-04T15:51:45.801 INFO:teuthology.orchestra.run.smithi177.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-06-04T15:51:45.801 INFO:teuthology.orchestra.run.smithi177.stdout: = sunit=0 swidth=0 blks 2024-06-04T15:51:45.801 INFO:teuthology.orchestra.run.smithi177.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-06-04T15:51:45.801 INFO:teuthology.orchestra.run.smithi177.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-06-04T15:51:45.801 INFO:teuthology.orchestra.run.smithi177.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-06-04T15:51:45.801 INFO:teuthology.orchestra.run.smithi177.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-06-04T15:51:46.308 INFO:teuthology.orchestra.run.smithi177.stdout:Discarding blocks...Done. 2024-06-04T15:51:46.310 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi177.front.sepia.ceph.com -o noatime 2024-06-04T15:51:46.311 DEBUG:teuthology.orchestra.run.smithi177:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-06-04T15:51:46.397 DEBUG:teuthology.orchestra.run.smithi177:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-06-04T15:51:46.450 DEBUG:teuthology.orchestra.run.smithi177:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-06-04T15:51:46.489 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-06-04T15:51:46.489 INFO:tasks.ceph:role: osd.5 2024-06-04T15:51:46.489 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi177.front.sepia.ceph.com 2024-06-04T15:51:46.489 DEBUG:teuthology.orchestra.run.smithi177:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-06-04T15:51:46.581 INFO:teuthology.orchestra.run.smithi177.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-06-04T15:51:46.581 INFO:teuthology.orchestra.run.smithi177.stdout: = sectsz=512 attr=2, projid32bit=1 2024-06-04T15:51:46.583 INFO:teuthology.orchestra.run.smithi177.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-06-04T15:51:46.583 INFO:teuthology.orchestra.run.smithi177.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-06-04T15:51:46.583 INFO:teuthology.orchestra.run.smithi177.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-06-04T15:51:46.583 INFO:teuthology.orchestra.run.smithi177.stdout: = sunit=0 swidth=0 blks 2024-06-04T15:51:46.583 INFO:teuthology.orchestra.run.smithi177.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-06-04T15:51:46.583 INFO:teuthology.orchestra.run.smithi177.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-06-04T15:51:46.583 INFO:teuthology.orchestra.run.smithi177.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-06-04T15:51:46.583 INFO:teuthology.orchestra.run.smithi177.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-06-04T15:51:47.033 INFO:teuthology.orchestra.run.smithi177.stdout:Discarding blocks...Done. 2024-06-04T15:51:47.035 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi177.front.sepia.ceph.com -o noatime 2024-06-04T15:51:47.035 DEBUG:teuthology.orchestra.run.smithi177:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-06-04T15:51:47.123 DEBUG:teuthology.orchestra.run.smithi177:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-06-04T15:51:47.168 DEBUG:teuthology.orchestra.run.smithi177:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-06-04T15:51:47.247 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-06-04T15:51:47.247 INFO:tasks.ceph:role: osd.6 2024-06-04T15:51:47.247 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi177.front.sepia.ceph.com 2024-06-04T15:51:47.247 DEBUG:teuthology.orchestra.run.smithi177:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-06-04T15:51:47.334 INFO:teuthology.orchestra.run.smithi177.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-06-04T15:51:47.334 INFO:teuthology.orchestra.run.smithi177.stdout: = sectsz=512 attr=2, projid32bit=1 2024-06-04T15:51:47.334 INFO:teuthology.orchestra.run.smithi177.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-06-04T15:51:47.334 INFO:teuthology.orchestra.run.smithi177.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-06-04T15:51:47.334 INFO:teuthology.orchestra.run.smithi177.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-06-04T15:51:47.335 INFO:teuthology.orchestra.run.smithi177.stdout: = sunit=0 swidth=0 blks 2024-06-04T15:51:47.335 INFO:teuthology.orchestra.run.smithi177.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-06-04T15:51:47.335 INFO:teuthology.orchestra.run.smithi177.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-06-04T15:51:47.335 INFO:teuthology.orchestra.run.smithi177.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-06-04T15:51:47.335 INFO:teuthology.orchestra.run.smithi177.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-06-04T15:51:47.823 INFO:teuthology.orchestra.run.smithi177.stdout:Discarding blocks...Done. 2024-06-04T15:51:47.825 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi177.front.sepia.ceph.com -o noatime 2024-06-04T15:51:47.825 DEBUG:teuthology.orchestra.run.smithi177:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-06-04T15:51:47.900 DEBUG:teuthology.orchestra.run.smithi177:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-06-04T15:51:47.946 DEBUG:teuthology.orchestra.run.smithi177:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-06-04T15:51:48.025 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-06-04T15:51:48.025 INFO:tasks.ceph:role: osd.7 2024-06-04T15:51:48.025 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi177.front.sepia.ceph.com 2024-06-04T15:51:48.025 DEBUG:teuthology.orchestra.run.smithi177:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-06-04T15:51:48.111 INFO:teuthology.orchestra.run.smithi177.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-06-04T15:51:48.111 INFO:teuthology.orchestra.run.smithi177.stdout: = sectsz=512 attr=2, projid32bit=1 2024-06-04T15:51:48.111 INFO:teuthology.orchestra.run.smithi177.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-06-04T15:51:48.111 INFO:teuthology.orchestra.run.smithi177.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-06-04T15:51:48.111 INFO:teuthology.orchestra.run.smithi177.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-06-04T15:51:48.111 INFO:teuthology.orchestra.run.smithi177.stdout: = sunit=0 swidth=0 blks 2024-06-04T15:51:48.111 INFO:teuthology.orchestra.run.smithi177.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-06-04T15:51:48.112 INFO:teuthology.orchestra.run.smithi177.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-06-04T15:51:48.112 INFO:teuthology.orchestra.run.smithi177.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-06-04T15:51:48.112 INFO:teuthology.orchestra.run.smithi177.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-06-04T15:51:48.621 INFO:teuthology.orchestra.run.smithi177.stdout:Discarding blocks...Done. 2024-06-04T15:51:48.623 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi177.front.sepia.ceph.com -o noatime 2024-06-04T15:51:48.623 DEBUG:teuthology.orchestra.run.smithi177:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-06-04T15:51:48.718 DEBUG:teuthology.orchestra.run.smithi177:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-06-04T15:51:48.762 DEBUG:teuthology.orchestra.run.smithi177:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-06-04T15:51:48.872 INFO:teuthology.orchestra.run.smithi177.stderr:2024-06-04T15:51:48.872+0000 7f71e9c14640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-06-04T15:51:48.875 INFO:teuthology.orchestra.run.smithi177.stderr:2024-06-04T15:51:48.875+0000 7f71e9c14640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-06-04T15:51:48.875 INFO:teuthology.orchestra.run.smithi177.stderr:2024-06-04T15:51:48.875+0000 7f71e9c14640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-06-04T15:51:48.875 INFO:teuthology.orchestra.run.smithi177.stderr:2024-06-04T15:51:48.875+0000 7f71e9c14640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-06-04T15:51:48.875 INFO:teuthology.orchestra.run.smithi177.stderr:2024-06-04T15:51:48.875+0000 7f71e9c14640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-06-04T15:51:48.883 INFO:teuthology.orchestra.run.smithi177.stderr:2024-06-04T15:51:48.883+0000 7f71e9c14640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-06-04T15:51:51.735 DEBUG:teuthology.orchestra.run.smithi177:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-06-04T15:51:51.777 DEBUG:teuthology.orchestra.run.smithi177:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-06-04T15:51:51.881 INFO:teuthology.orchestra.run.smithi177.stderr:2024-06-04T15:51:51.880+0000 7f6735e0c640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-06-04T15:51:51.881 INFO:teuthology.orchestra.run.smithi177.stderr:2024-06-04T15:51:51.880+0000 7f6735e0c640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-06-04T15:51:51.881 INFO:teuthology.orchestra.run.smithi177.stderr:2024-06-04T15:51:51.880+0000 7f6735e0c640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-06-04T15:51:51.881 INFO:teuthology.orchestra.run.smithi177.stderr:2024-06-04T15:51:51.880+0000 7f6735e0c640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-06-04T15:51:51.881 INFO:teuthology.orchestra.run.smithi177.stderr:2024-06-04T15:51:51.880+0000 7f6735e0c640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-06-04T15:51:51.881 INFO:teuthology.orchestra.run.smithi177.stderr:2024-06-04T15:51:51.881+0000 7f6735e0c640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-06-04T15:51:54.725 DEBUG:teuthology.orchestra.run.smithi177:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-06-04T15:51:54.767 DEBUG:teuthology.orchestra.run.smithi177:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-06-04T15:51:54.868 INFO:teuthology.orchestra.run.smithi177.stderr:2024-06-04T15:51:54.867+0000 7f2f0ca2c640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-06-04T15:51:54.868 INFO:teuthology.orchestra.run.smithi177.stderr:2024-06-04T15:51:54.867+0000 7f2f0ca2c640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-06-04T15:51:54.868 INFO:teuthology.orchestra.run.smithi177.stderr:2024-06-04T15:51:54.867+0000 7f2f0ca2c640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-06-04T15:51:54.868 INFO:teuthology.orchestra.run.smithi177.stderr:2024-06-04T15:51:54.867+0000 7f2f0ca2c640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-06-04T15:51:54.868 INFO:teuthology.orchestra.run.smithi177.stderr:2024-06-04T15:51:54.867+0000 7f2f0ca2c640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-06-04T15:51:54.868 INFO:teuthology.orchestra.run.smithi177.stderr:2024-06-04T15:51:54.868+0000 7f2f0ca2c640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-06-04T15:51:57.714 DEBUG:teuthology.orchestra.run.smithi177:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-06-04T15:51:57.752 DEBUG:teuthology.orchestra.run.smithi177:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-06-04T15:51:57.852 INFO:teuthology.orchestra.run.smithi177.stderr:2024-06-04T15:51:57.852+0000 7f1240423640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-06-04T15:51:57.853 INFO:teuthology.orchestra.run.smithi177.stderr:2024-06-04T15:51:57.852+0000 7f1240423640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-06-04T15:51:57.853 INFO:teuthology.orchestra.run.smithi177.stderr:2024-06-04T15:51:57.852+0000 7f1240423640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-06-04T15:51:57.853 INFO:teuthology.orchestra.run.smithi177.stderr:2024-06-04T15:51:57.852+0000 7f1240423640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-06-04T15:51:57.853 INFO:teuthology.orchestra.run.smithi177.stderr:2024-06-04T15:51:57.852+0000 7f1240423640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-06-04T15:51:57.853 INFO:teuthology.orchestra.run.smithi177.stderr:2024-06-04T15:51:57.852+0000 7f1240423640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-06-04T15:52:00.707 DEBUG:teuthology.orchestra.run.smithi177:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-06-04T15:52:00.748 INFO:tasks.ceph:Reading keys from all nodes... 2024-06-04T15:52:00.748 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-06-04T15:52:00.748 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-06-04T15:52:00.796 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-06-04T15:52:00.797 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-06-04T15:52:00.880 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-06-04T15:52:00.881 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-06-04T15:52:00.962 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-06-04T15:52:00.962 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-06-04T15:52:01.040 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-06-04T15:52:01.041 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-06-04T15:52:01.119 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-06-04T15:52:01.119 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-06-04T15:52:01.164 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-06-04T15:52:01.164 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-06-04T15:52:01.244 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-06-04T15:52:01.245 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-06-04T15:52:01.324 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-06-04T15:52:01.325 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-06-04T15:52:01.403 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-06-04T15:52:01.403 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-06-04T15:52:01.482 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-06-04T15:52:01.482 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-06-04T15:52:01.513 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-06-04T15:52:01.514 DEBUG:teuthology.orchestra.run.smithi177:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-06-04T15:52:01.552 INFO:tasks.ceph:Adding keys to all mons... 2024-06-04T15:52:01.552 DEBUG:teuthology.orchestra.run.smithi144:> sudo tee -a /etc/ceph/ceph.keyring 2024-06-04T15:52:01.555 DEBUG:teuthology.orchestra.run.smithi177:> sudo tee -a /etc/ceph/ceph.keyring 2024-06-04T15:52:01.595 INFO:teuthology.orchestra.run.smithi144.stdout:[mgr.y] 2024-06-04T15:52:01.595 INFO:teuthology.orchestra.run.smithi144.stdout: key = AQACOF9mRvAVGxAAZ0OE/M/ueqtqnPu0aYn/7w== 2024-06-04T15:52:01.596 INFO:teuthology.orchestra.run.smithi144.stdout:[osd.0] 2024-06-04T15:52:01.596 INFO:teuthology.orchestra.run.smithi144.stdout: key = AQAFOF9mPE3oLhAAOoDYh62XDPqOEgzDnIpm7g== 2024-06-04T15:52:01.596 INFO:teuthology.orchestra.run.smithi144.stdout:[osd.1] 2024-06-04T15:52:01.596 INFO:teuthology.orchestra.run.smithi144.stdout: key = AQAIOF9mi0IbLxAAOFV1cqpKu/U6C4WXC2RRmg== 2024-06-04T15:52:01.596 INFO:teuthology.orchestra.run.smithi144.stdout:[osd.2] 2024-06-04T15:52:01.596 INFO:teuthology.orchestra.run.smithi144.stdout: key = AQALOF9mHEa9LxAAImwpcxH6mjoTe3IipviPcQ== 2024-06-04T15:52:01.596 INFO:teuthology.orchestra.run.smithi144.stdout:[osd.3] 2024-06-04T15:52:01.596 INFO:teuthology.orchestra.run.smithi144.stdout: key = AQAOOF9mgbx+MBAA2eXcXHU8Fcqg7IipaIIMEg== 2024-06-04T15:52:01.596 INFO:teuthology.orchestra.run.smithi144.stdout:[mgr.x] 2024-06-04T15:52:01.596 INFO:teuthology.orchestra.run.smithi144.stdout: key = AQACOF9mEKaxHxAAfYufXMiOzTd9jDAGOtxMsg== 2024-06-04T15:52:01.596 INFO:teuthology.orchestra.run.smithi144.stdout:[osd.4] 2024-06-04T15:52:01.597 INFO:teuthology.orchestra.run.smithi144.stdout: key = AQAUOF9mxUMINBAANnduSeNPugjY+kIECaTMaA== 2024-06-04T15:52:01.597 INFO:teuthology.orchestra.run.smithi144.stdout:[osd.5] 2024-06-04T15:52:01.597 INFO:teuthology.orchestra.run.smithi144.stdout: key = AQAXOF9meliFNBAAFGZVa7d9j1P1cGWXczJgaQ== 2024-06-04T15:52:01.597 INFO:teuthology.orchestra.run.smithi144.stdout:[osd.6] 2024-06-04T15:52:01.597 INFO:teuthology.orchestra.run.smithi144.stdout: key = AQAaOF9mhGfCMxAAqMFFElYq29kfiLA7htgYlQ== 2024-06-04T15:52:01.597 INFO:teuthology.orchestra.run.smithi144.stdout:[osd.7] 2024-06-04T15:52:01.597 INFO:teuthology.orchestra.run.smithi144.stdout: key = AQAdOF9mxnbWMhAAKyhs2h6JxObIlffloQJ62A== 2024-06-04T15:52:01.597 INFO:teuthology.orchestra.run.smithi144.stdout:[client.0] 2024-06-04T15:52:01.597 INFO:teuthology.orchestra.run.smithi144.stdout: key = AQACOF9mfPQkIxAAjERs9l9axVvJaOtmPxKKZw== 2024-06-04T15:52:01.597 INFO:teuthology.orchestra.run.smithi144.stdout:[client.1] 2024-06-04T15:52:01.597 INFO:teuthology.orchestra.run.smithi144.stdout: key = AQACOF9m4XVCJxAAIzXOWrhCz+87gucCS2WO0w== 2024-06-04T15:52:01.629 INFO:teuthology.orchestra.run.smithi177.stdout:[mgr.y] 2024-06-04T15:52:01.630 INFO:teuthology.orchestra.run.smithi177.stdout: key = AQACOF9mRvAVGxAAZ0OE/M/ueqtqnPu0aYn/7w== 2024-06-04T15:52:01.630 INFO:teuthology.orchestra.run.smithi177.stdout:[osd.0] 2024-06-04T15:52:01.630 INFO:teuthology.orchestra.run.smithi177.stdout: key = AQAFOF9mPE3oLhAAOoDYh62XDPqOEgzDnIpm7g== 2024-06-04T15:52:01.630 INFO:teuthology.orchestra.run.smithi177.stdout:[osd.1] 2024-06-04T15:52:01.630 INFO:teuthology.orchestra.run.smithi177.stdout: key = AQAIOF9mi0IbLxAAOFV1cqpKu/U6C4WXC2RRmg== 2024-06-04T15:52:01.630 INFO:teuthology.orchestra.run.smithi177.stdout:[osd.2] 2024-06-04T15:52:01.630 INFO:teuthology.orchestra.run.smithi177.stdout: key = AQALOF9mHEa9LxAAImwpcxH6mjoTe3IipviPcQ== 2024-06-04T15:52:01.630 INFO:teuthology.orchestra.run.smithi177.stdout:[osd.3] 2024-06-04T15:52:01.630 INFO:teuthology.orchestra.run.smithi177.stdout: key = AQAOOF9mgbx+MBAA2eXcXHU8Fcqg7IipaIIMEg== 2024-06-04T15:52:01.630 INFO:teuthology.orchestra.run.smithi177.stdout:[mgr.x] 2024-06-04T15:52:01.631 INFO:teuthology.orchestra.run.smithi177.stdout: key = AQACOF9mEKaxHxAAfYufXMiOzTd9jDAGOtxMsg== 2024-06-04T15:52:01.631 INFO:teuthology.orchestra.run.smithi177.stdout:[osd.4] 2024-06-04T15:52:01.631 INFO:teuthology.orchestra.run.smithi177.stdout: key = AQAUOF9mxUMINBAANnduSeNPugjY+kIECaTMaA== 2024-06-04T15:52:01.631 INFO:teuthology.orchestra.run.smithi177.stdout:[osd.5] 2024-06-04T15:52:01.631 INFO:teuthology.orchestra.run.smithi177.stdout: key = AQAXOF9meliFNBAAFGZVa7d9j1P1cGWXczJgaQ== 2024-06-04T15:52:01.631 INFO:teuthology.orchestra.run.smithi177.stdout:[osd.6] 2024-06-04T15:52:01.631 INFO:teuthology.orchestra.run.smithi177.stdout: key = AQAaOF9mhGfCMxAAqMFFElYq29kfiLA7htgYlQ== 2024-06-04T15:52:01.631 INFO:teuthology.orchestra.run.smithi177.stdout:[osd.7] 2024-06-04T15:52:01.631 INFO:teuthology.orchestra.run.smithi177.stdout: key = AQAdOF9mxnbWMhAAKyhs2h6JxObIlffloQJ62A== 2024-06-04T15:52:01.631 INFO:teuthology.orchestra.run.smithi177.stdout:[client.0] 2024-06-04T15:52:01.631 INFO:teuthology.orchestra.run.smithi177.stdout: key = AQACOF9mfPQkIxAAjERs9l9axVvJaOtmPxKKZw== 2024-06-04T15:52:01.631 INFO:teuthology.orchestra.run.smithi177.stdout:[client.1] 2024-06-04T15:52:01.632 INFO:teuthology.orchestra.run.smithi177.stdout: key = AQACOF9m4XVCJxAAIzXOWrhCz+87gucCS2WO0w== 2024-06-04T15:52:01.633 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-06-04T15:52:01.641 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-06-04T15:52:01.738 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-06-04T15:52:01.740 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-06-04T15:52:01.804 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-06-04T15:52:01.806 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-06-04T15:52:01.871 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-06-04T15:52:01.874 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-06-04T15:52:01.937 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-06-04T15:52:01.940 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-06-04T15:52:02.004 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-06-04T15:52:02.006 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-06-04T15:52:02.070 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-06-04T15:52:02.072 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-06-04T15:52:02.135 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-06-04T15:52:02.143 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-06-04T15:52:02.211 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-06-04T15:52:02.216 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-06-04T15:52:02.289 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-06-04T15:52:02.297 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-06-04T15:52:02.363 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-06-04T15:52:02.366 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-06-04T15:52:02.432 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-06-04T15:52:02.435 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-06-04T15:52:02.502 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-06-04T15:52:02.502 DEBUG:teuthology.orchestra.run.smithi144:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-06-04T15:52:02.540 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-06-04T15:52:02.650 DEBUG:teuthology.orchestra.run.smithi144:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-06-04T15:52:02.688 DEBUG:teuthology.orchestra.run.smithi144:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-06-04T15:52:02.767 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-06-04T15:52:02.877 DEBUG:teuthology.orchestra.run.smithi144:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-06-04T15:52:02.915 DEBUG:teuthology.orchestra.run.smithi177:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-06-04T15:52:02.955 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-06-04T15:52:03.067 DEBUG:teuthology.orchestra.run.smithi177:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-06-04T15:52:03.107 DEBUG:teuthology.orchestra.run.smithi144:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-06-04T15:52:03.109 DEBUG:teuthology.orchestra.run.smithi177:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-06-04T15:52:03.176 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-06-04T15:52:03.177 INFO:tasks.ceph.mon.a:Restarting daemon 2024-06-04T15:52:03.177 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-06-04T15:52:03.179 INFO:tasks.ceph.mon.a:Started 2024-06-04T15:52:03.179 INFO:tasks.ceph.mon.c:Restarting daemon 2024-06-04T15:52:03.179 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-06-04T15:52:03.181 INFO:tasks.ceph.mon.c:Started 2024-06-04T15:52:03.181 INFO:tasks.ceph.mon.b:Restarting daemon 2024-06-04T15:52:03.181 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-06-04T15:52:03.218 INFO:tasks.ceph.mon.b:Started 2024-06-04T15:52:03.219 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-06-04T15:52:03.219 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-06-04T15:52:03.219 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-06-04T15:52:03.221 INFO:tasks.ceph.mgr.y:Started 2024-06-04T15:52:03.221 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-06-04T15:52:03.221 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-06-04T15:52:03.223 INFO:tasks.ceph.mgr.x:Started 2024-06-04T15:52:03.223 INFO:tasks.ceph:Setting crush tunables to default 2024-06-04T15:52:03.224 DEBUG:teuthology.orchestra.run.smithi144:> sudo ceph --cluster ceph osd crush tunables default 2024-06-04T15:52:08.636 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-06-04T15:52:08.635+0000 7fd62bb53040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-06-04T15:52:08.636 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-06-04T15:52:08.636+0000 7f40a2a14040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-06-04T15:52:08.795 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-06-04T15:52:08.795+0000 7fd62bb53040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-06-04T15:52:08.799 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-06-04T15:52:08.799+0000 7f40a2a14040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-06-04T15:52:08.848 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-06-04T15:52:08.847+0000 7fd62bb53040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-06-04T15:52:08.851 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-06-04T15:52:08.851+0000 7f40a2a14040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-06-04T15:52:09.102 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-06-04T15:52:09.102+0000 7fd62bb53040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-06-04T15:52:09.126 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-06-04T15:52:09.126+0000 7f40a2a14040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-06-04T15:52:09.147 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-06-04T15:52:09.147+0000 7fd62bb53040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-06-04T15:52:09.172 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-06-04T15:52:09.171+0000 7f40a2a14040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-06-04T15:52:09.416 INFO:teuthology.orchestra.run.smithi144.stderr:adjusted tunables profile to default 2024-06-04T15:52:09.429 INFO:tasks.ceph:check_enable_crimson: False 2024-06-04T15:52:09.429 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-06-04T15:52:09.429 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-06-04T15:52:09.430 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-06-04T15:52:09.468 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-06-04T15:52:09.468 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-06-04T15:52:09.547 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-06-04T15:52:09.547 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-06-04T15:52:09.625 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-06-04T15:52:09.625 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-06-04T15:52:09.704 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-06-04T15:52:09.704 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-06-04T15:52:09.744 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-06-04T15:52:09.744 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-06-04T15:52:09.825 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-06-04T15:52:09.825 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-06-04T15:52:09.895 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-06-04T15:52:09.895+0000 7fd62bb53040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-06-04T15:52:09.904 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-06-04T15:52:09.904 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-06-04T15:52:09.926 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-06-04T15:52:09.926+0000 7f40a2a14040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-06-04T15:52:09.984 DEBUG:teuthology.orchestra.run.smithi177:> sudo ceph --cluster ceph osd new 865b3e53-9572-4d2e-a552-93aeba5a878e 0 2024-06-04T15:52:09.987 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-06-04T15:52:09.987+0000 7fd62bb53040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-06-04T15:52:10.013 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-06-04T15:52:10.013+0000 7f40a2a14040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-06-04T15:52:10.033 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-06-04T15:52:10.033+0000 7fd62bb53040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-06-04T15:52:10.056 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-06-04T15:52:10.056+0000 7f40a2a14040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-06-04T15:52:10.201 INFO:teuthology.orchestra.run.smithi177.stdout:0 2024-06-04T15:52:10.211 DEBUG:teuthology.orchestra.run.smithi177:> sudo ceph --cluster ceph osd new 530d160d-4c96-482b-b9ca-017c52d6971b 1 2024-06-04T15:52:10.222 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-06-04T15:52:10.222+0000 7fd62bb53040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-06-04T15:52:10.239 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-06-04T15:52:10.239+0000 7f40a2a14040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-06-04T15:52:10.276 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-06-04T15:52:10.276+0000 7fd62bb53040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-06-04T15:52:10.291 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-06-04T15:52:10.291+0000 7f40a2a14040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-06-04T15:52:10.333 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-06-04T15:52:10.333+0000 7fd62bb53040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-06-04T15:52:10.344 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-06-04T15:52:10.344+0000 7f40a2a14040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-06-04T15:52:10.409 INFO:teuthology.orchestra.run.smithi177.stdout:1 2024-06-04T15:52:10.421 DEBUG:teuthology.orchestra.run.smithi177:> sudo ceph --cluster ceph osd new ef99cc9a-405c-41d4-b504-396b1cc3ab62 2 2024-06-04T15:52:10.449 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-06-04T15:52:10.449+0000 7fd62bb53040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-06-04T15:52:10.457 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-06-04T15:52:10.457+0000 7f40a2a14040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-06-04T15:52:10.651 INFO:teuthology.orchestra.run.smithi177.stdout:2 2024-06-04T15:52:10.662 DEBUG:teuthology.orchestra.run.smithi177:> sudo ceph --cluster ceph osd new bbc2f08d-579a-4c02-bf75-8be9e630d34c 3 2024-06-04T15:52:10.836 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-06-04T15:52:10.836+0000 7f40a2a14040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-06-04T15:52:10.851 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-06-04T15:52:10.851+0000 7fd62bb53040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-06-04T15:52:10.864 INFO:teuthology.orchestra.run.smithi177.stdout:3 2024-06-04T15:52:10.876 DEBUG:teuthology.orchestra.run.smithi177:> sudo ceph --cluster ceph osd new 64a1a82a-e45e-4750-9101-499c6fe49b5f 4 2024-06-04T15:52:10.974 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-06-04T15:52:10.974+0000 7f40a2a14040 -1 mgr[py] Module smb has missing NOTIFY_TYPES member 2024-06-04T15:52:11.001 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-06-04T15:52:11.000+0000 7fd62bb53040 -1 mgr[py] Module smb has missing NOTIFY_TYPES member 2024-06-04T15:52:11.077 INFO:teuthology.orchestra.run.smithi177.stdout:4 2024-06-04T15:52:11.088 DEBUG:teuthology.orchestra.run.smithi177:> sudo ceph --cluster ceph osd new 4391ac8e-1bdf-4e68-aa72-c78e1bdca71e 5 2024-06-04T15:52:11.233 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-06-04T15:52:11.233+0000 7f40a2a14040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-06-04T15:52:11.271 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-06-04T15:52:11.270+0000 7fd62bb53040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-06-04T15:52:11.284 INFO:teuthology.orchestra.run.smithi177.stdout:5 2024-06-04T15:52:11.286 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-06-04T15:52:11.286+0000 7f40a2a14040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-06-04T15:52:11.295 DEBUG:teuthology.orchestra.run.smithi177:> sudo ceph --cluster ceph osd new 89c685a4-0158-49d1-a3a4-7a794cd8cdc4 6 2024-06-04T15:52:11.326 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-06-04T15:52:11.326+0000 7fd62bb53040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-06-04T15:52:11.401 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-06-04T15:52:11.401+0000 7f40a2a14040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-06-04T15:52:11.447 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-06-04T15:52:11.447+0000 7fd62bb53040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-06-04T15:52:11.492 INFO:teuthology.orchestra.run.smithi177.stdout:6 2024-06-04T15:52:11.504 DEBUG:teuthology.orchestra.run.smithi177:> sudo ceph --cluster ceph osd new 08fae03a-7ac7-40f4-a0fe-f754dcfd8c8f 7 2024-06-04T15:52:11.733 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-06-04T15:52:11.733+0000 7f40a2a14040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-06-04T15:52:11.753 INFO:teuthology.orchestra.run.smithi177.stdout:7 2024-06-04T15:52:11.764 INFO:tasks.ceph.osd.0:Restarting daemon 2024-06-04T15:52:11.764 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-06-04T15:52:11.765 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-06-04T15:52:11.764+0000 7fd62bb53040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-06-04T15:52:11.766 INFO:tasks.ceph.osd.0:Started 2024-06-04T15:52:11.767 INFO:tasks.ceph.osd.1:Restarting daemon 2024-06-04T15:52:11.767 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-06-04T15:52:11.769 INFO:tasks.ceph.osd.1:Started 2024-06-04T15:52:11.769 INFO:tasks.ceph.osd.2:Restarting daemon 2024-06-04T15:52:11.769 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-06-04T15:52:11.771 INFO:tasks.ceph.osd.2:Started 2024-06-04T15:52:11.771 INFO:tasks.ceph.osd.3:Restarting daemon 2024-06-04T15:52:11.771 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-06-04T15:52:11.773 INFO:tasks.ceph.osd.3:Started 2024-06-04T15:52:11.773 INFO:tasks.ceph.osd.4:Restarting daemon 2024-06-04T15:52:11.773 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-06-04T15:52:11.775 INFO:tasks.ceph.osd.4:Started 2024-06-04T15:52:11.775 INFO:tasks.ceph.osd.5:Restarting daemon 2024-06-04T15:52:11.776 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-06-04T15:52:11.777 INFO:tasks.ceph.osd.5:Started 2024-06-04T15:52:11.778 INFO:tasks.ceph.osd.6:Restarting daemon 2024-06-04T15:52:11.778 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-06-04T15:52:11.780 INFO:tasks.ceph.osd.6:Started 2024-06-04T15:52:11.780 INFO:tasks.ceph.osd.7:Restarting daemon 2024-06-04T15:52:11.780 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-06-04T15:52:11.782 INFO:tasks.ceph.osd.7:Started 2024-06-04T15:52:11.783 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-06-04T15:52:11.787 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-06-04T15:52:11.787+0000 7f40a2a14040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-06-04T15:52:11.824 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-06-04T15:52:11.823+0000 7fd62bb53040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-06-04T15:52:11.987 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-06-04T15:52:11.987+0000 7f40a2a14040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-06-04T15:52:11.989 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-06-04T15:52:11.989+0000 7fd62bb53040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-06-04T15:52:12.004 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T15:52:12.004 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":10,"fsid":"15e56bb1-4856-42f3-b6db-a2c8f23c5557","created":"2024-06-04T15:52:08.498471+0000","modified":"2024-06-04T15:52:11.751110+0000","last_up_change":"0.000000","last_in_change":"2024-06-04T15:52:11.751110+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"865b3e53-9572-4d2e-a552-93aeba5a878e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"530d160d-4c96-482b-b9ca-017c52d6971b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"ef99cc9a-405c-41d4-b504-396b1cc3ab62","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"bbc2f08d-579a-4c02-bf75-8be9e630d34c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"64a1a82a-e45e-4750-9101-499c6fe49b5f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"4391ac8e-1bdf-4e68-aa72-c78e1bdca71e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"89c685a4-0158-49d1-a3a4-7a794cd8cdc4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"08fae03a-7ac7-40f4-a0fe-f754dcfd8c8f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-04T15:52:12.016 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-06-04T15:52:12.016 INFO:tasks.ceph:Waiting for OSDs to come up 2024-06-04T15:52:12.124 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-06-04T15:52:12.124+0000 7fd62bb53040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-06-04T15:52:12.125 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-06-04T15:52:12.125+0000 7f40a2a14040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-06-04T15:52:12.175 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-06-04T15:52:12.175+0000 7fd62bb53040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-06-04T15:52:12.176 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-06-04T15:52:12.176+0000 7f40a2a14040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-06-04T15:52:12.244 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-06-04T15:52:12.244+0000 7fd62bb53040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-06-04T15:52:12.245 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-06-04T15:52:12.245+0000 7f40a2a14040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-06-04T15:52:12.289 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-06-04T15:52:12.289+0000 7f40a2a14040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-06-04T15:52:12.290 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-06-04T15:52:12.289+0000 7fd62bb53040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-06-04T15:52:12.389 INFO:tasks.ceph.osd.5.smithi177.stderr:2024-06-04T15:52:12.389+0000 7fcb2f101640 -1 Falling back to public interface 2024-06-04T15:52:12.390 INFO:tasks.ceph.osd.0.smithi144.stderr:2024-06-04T15:52:12.390+0000 7f2c9a807640 -1 Falling back to public interface 2024-06-04T15:52:12.395 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-06-04T15:52:12.395+0000 7f3a15c1a640 -1 Falling back to public interface 2024-06-04T15:52:12.402 INFO:tasks.ceph.osd.7.smithi177.stderr:2024-06-04T15:52:12.402+0000 7efe0e0b3640 -1 Falling back to public interface 2024-06-04T15:52:12.404 INFO:tasks.ceph.osd.1.smithi144.stderr:2024-06-04T15:52:12.404+0000 7ff524f99640 -1 Falling back to public interface 2024-06-04T15:52:12.409 INFO:tasks.ceph.osd.4.smithi177.stderr:2024-06-04T15:52:12.409+0000 7fe09ee13640 -1 Falling back to public interface 2024-06-04T15:52:12.413 INFO:tasks.ceph.osd.3.smithi144.stderr:2024-06-04T15:52:12.414+0000 7f411ee13640 -1 Falling back to public interface 2024-06-04T15:52:12.414 INFO:tasks.ceph.osd.6.smithi177.stderr:2024-06-04T15:52:12.414+0000 7f3999e32640 -1 Falling back to public interface 2024-06-04T15:52:12.775 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-06-04T15:52:12.774+0000 7f40a2a14040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-06-04T15:52:12.775 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-06-04T15:52:12.775+0000 7fd62bb53040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-06-04T15:52:12.822 DEBUG:teuthology.orchestra.run.smithi144:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-06-04T15:52:12.890 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-06-04T15:52:12.890+0000 7fd62bb53040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-06-04T15:52:12.893 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-06-04T15:52:12.893+0000 7f40a2a14040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-06-04T15:52:13.000 INFO:teuthology.misc.health.smithi144.stdout: 2024-06-04T15:52:13.000 INFO:teuthology.misc.health.smithi144.stdout:{"epoch":10,"fsid":"15e56bb1-4856-42f3-b6db-a2c8f23c5557","created":"2024-06-04T15:52:08.498471+0000","modified":"2024-06-04T15:52:11.751110+0000","last_up_change":"0.000000","last_in_change":"2024-06-04T15:52:11.751110+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"865b3e53-9572-4d2e-a552-93aeba5a878e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"530d160d-4c96-482b-b9ca-017c52d6971b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"ef99cc9a-405c-41d4-b504-396b1cc3ab62","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"bbc2f08d-579a-4c02-bf75-8be9e630d34c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"64a1a82a-e45e-4750-9101-499c6fe49b5f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"4391ac8e-1bdf-4e68-aa72-c78e1bdca71e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"89c685a4-0158-49d1-a3a4-7a794cd8cdc4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"08fae03a-7ac7-40f4-a0fe-f754dcfd8c8f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-04T15:52:13.010 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-06-04T15:52:13.905 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-06-04T15:52:13.905+0000 7fd5cbefb640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-06-04T15:52:13.905 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-06-04T15:52:13.905+0000 7fd5cbefb640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-06-04T15:52:15.828 INFO:tasks.ceph.osd.5.smithi177.stderr:2024-06-04T15:52:15.828+0000 7fcb2f101640 -1 osd.5 0 log_to_monitors true 2024-06-04T15:52:15.834 INFO:tasks.ceph.osd.0.smithi144.stderr:2024-06-04T15:52:15.834+0000 7f2c9a807640 -1 osd.0 0 log_to_monitors true 2024-06-04T15:52:15.870 INFO:tasks.ceph.osd.7.smithi177.stderr:2024-06-04T15:52:15.870+0000 7efe0e0b3640 -1 osd.7 0 log_to_monitors true 2024-06-04T15:52:15.891 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-06-04T15:52:15.891+0000 7f3a15c1a640 -1 osd.2 0 log_to_monitors true 2024-06-04T15:52:15.912 INFO:tasks.ceph.osd.1.smithi144.stderr:2024-06-04T15:52:15.912+0000 7ff524f99640 -1 osd.1 0 log_to_monitors true 2024-06-04T15:52:15.916 INFO:tasks.ceph.osd.4.smithi177.stderr:2024-06-04T15:52:15.916+0000 7fe09ee13640 -1 osd.4 0 log_to_monitors true 2024-06-04T15:52:15.923 INFO:tasks.ceph.osd.6.smithi177.stderr:2024-06-04T15:52:15.923+0000 7f3999e32640 -1 osd.6 0 log_to_monitors true 2024-06-04T15:52:15.930 INFO:tasks.ceph.osd.3.smithi144.stderr:2024-06-04T15:52:15.930+0000 7f411ee13640 -1 osd.3 0 log_to_monitors true 2024-06-04T15:52:18.295 INFO:tasks.ceph.osd.7.smithi177.stderr:2024-06-04T15:52:18.295+0000 7efe0a047640 -1 osd.7 0 waiting for initial osdmap 2024-06-04T15:52:18.351 INFO:tasks.ceph.osd.5.smithi177.stderr:2024-06-04T15:52:18.350+0000 7fcb2b095640 -1 osd.5 0 waiting for initial osdmap 2024-06-04T15:52:18.366 INFO:tasks.ceph.osd.7.smithi177.stderr:2024-06-04T15:52:18.366+0000 7efe01e67640 -1 osd.7 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-06-04T15:52:18.387 INFO:tasks.ceph.osd.5.smithi177.stderr:2024-06-04T15:52:18.387+0000 7fcb22eb5640 -1 osd.5 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-06-04T15:52:18.492 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-06-04T15:52:18.492+0000 7f3a1167d640 -1 osd.2 0 waiting for initial osdmap 2024-06-04T15:52:18.545 INFO:tasks.ceph.osd.0.smithi144.stderr:2024-06-04T15:52:18.545+0000 7f2c9679b640 -1 osd.0 0 waiting for initial osdmap 2024-06-04T15:52:18.574 INFO:tasks.ceph.osd.0.smithi144.stderr:2024-06-04T15:52:18.574+0000 7f2c8e5bb640 -1 osd.0 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-06-04T15:52:18.574 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-06-04T15:52:18.574+0000 7f3a0949d640 -1 osd.2 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-06-04T15:52:19.166 INFO:tasks.ceph.osd.6.smithi177.stderr:2024-06-04T15:52:19.166+0000 7f39953b2640 -1 osd.6 0 waiting for initial osdmap 2024-06-04T15:52:19.169 INFO:tasks.ceph.osd.4.smithi177.stderr:2024-06-04T15:52:19.169+0000 7fe09a7cc640 -1 osd.4 0 waiting for initial osdmap 2024-06-04T15:52:19.175 INFO:tasks.ceph.osd.6.smithi177.stderr:2024-06-04T15:52:19.175+0000 7f398d1d2640 -1 osd.6 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-06-04T15:52:19.183 INFO:tasks.ceph.osd.4.smithi177.stderr:2024-06-04T15:52:19.183+0000 7fe0925ec640 -1 osd.4 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-06-04T15:52:19.194 INFO:tasks.ceph.osd.3.smithi144.stderr:2024-06-04T15:52:19.194+0000 7f411a7a8640 -1 osd.3 0 waiting for initial osdmap 2024-06-04T15:52:19.207 INFO:tasks.ceph.osd.1.smithi144.stderr:2024-06-04T15:52:19.207+0000 7ff520f2d640 -1 osd.1 0 waiting for initial osdmap 2024-06-04T15:52:19.213 INFO:tasks.ceph.osd.3.smithi144.stderr:2024-06-04T15:52:19.213+0000 7f41125c8640 -1 osd.3 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-06-04T15:52:19.221 INFO:tasks.ceph.osd.1.smithi144.stderr:2024-06-04T15:52:19.221+0000 7ff518d4d640 -1 osd.1 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-06-04T15:52:19.817 DEBUG:teuthology.orchestra.run.smithi144:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-06-04T15:52:20.123 INFO:teuthology.misc.health.smithi144.stdout: 2024-06-04T15:52:20.123 INFO:teuthology.misc.health.smithi144.stdout:{"epoch":14,"fsid":"15e56bb1-4856-42f3-b6db-a2c8f23c5557","created":"2024-06-04T15:52:08.498471+0000","modified":"2024-06-04T15:52:19.398091+0000","last_up_change":"2024-06-04T15:52:19.398091+0000","last_in_change":"2024-06-04T15:52:11.751110+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"865b3e53-9572-4d2e-a552-93aeba5a878e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":1453747520},{"type":"v1","addr":"172.21.15.144:6801","nonce":1453747520}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":1453747520},{"type":"v1","addr":"172.21.15.144:6803","nonce":1453747520}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":1453747520},{"type":"v1","addr":"172.21.15.144:6807","nonce":1453747520}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":1453747520},{"type":"v1","addr":"172.21.15.144:6805","nonce":1453747520}]},"public_addr":"172.21.15.144:6801/1453747520","cluster_addr":"172.21.15.144:6803/1453747520","heartbeat_back_addr":"172.21.15.144:6807/1453747520","heartbeat_front_addr":"172.21.15.144:6805/1453747520","state":["exists","up"]},{"osd":1,"uuid":"530d160d-4c96-482b-b9ca-017c52d6971b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":2358575268},{"type":"v1","addr":"172.21.15.144:6817","nonce":2358575268}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":2358575268},{"type":"v1","addr":"172.21.15.144:6819","nonce":2358575268}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":2358575268},{"type":"v1","addr":"172.21.15.144:6823","nonce":2358575268}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":2358575268},{"type":"v1","addr":"172.21.15.144:6821","nonce":2358575268}]},"public_addr":"172.21.15.144:6817/2358575268","cluster_addr":"172.21.15.144:6819/2358575268","heartbeat_back_addr":"172.21.15.144:6823/2358575268","heartbeat_front_addr":"172.21.15.144:6821/2358575268","state":["exists","up"]},{"osd":2,"uuid":"ef99cc9a-405c-41d4-b504-396b1cc3ab62","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":86532035},{"type":"v1","addr":"172.21.15.144:6809","nonce":86532035}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":86532035},{"type":"v1","addr":"172.21.15.144:6811","nonce":86532035}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":86532035},{"type":"v1","addr":"172.21.15.144:6815","nonce":86532035}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":86532035},{"type":"v1","addr":"172.21.15.144:6813","nonce":86532035}]},"public_addr":"172.21.15.144:6809/86532035","cluster_addr":"172.21.15.144:6811/86532035","heartbeat_back_addr":"172.21.15.144:6815/86532035","heartbeat_front_addr":"172.21.15.144:6813/86532035","state":["exists","up"]},{"osd":3,"uuid":"bbc2f08d-579a-4c02-bf75-8be9e630d34c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":166159729},{"type":"v1","addr":"172.21.15.144:6825","nonce":166159729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":166159729},{"type":"v1","addr":"172.21.15.144:6827","nonce":166159729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":166159729},{"type":"v1","addr":"172.21.15.144:6831","nonce":166159729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":166159729},{"type":"v1","addr":"172.21.15.144:6829","nonce":166159729}]},"public_addr":"172.21.15.144:6825/166159729","cluster_addr":"172.21.15.144:6827/166159729","heartbeat_back_addr":"172.21.15.144:6831/166159729","heartbeat_front_addr":"172.21.15.144:6829/166159729","state":["exists","up"]},{"osd":4,"uuid":"64a1a82a-e45e-4750-9101-499c6fe49b5f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":2039473917},{"type":"v1","addr":"172.21.15.177:6817","nonce":2039473917}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":2039473917},{"type":"v1","addr":"172.21.15.177:6819","nonce":2039473917}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":2039473917},{"type":"v1","addr":"172.21.15.177:6823","nonce":2039473917}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":2039473917},{"type":"v1","addr":"172.21.15.177:6821","nonce":2039473917}]},"public_addr":"172.21.15.177:6817/2039473917","cluster_addr":"172.21.15.177:6819/2039473917","heartbeat_back_addr":"172.21.15.177:6823/2039473917","heartbeat_front_addr":"172.21.15.177:6821/2039473917","state":["exists","up"]},{"osd":5,"uuid":"4391ac8e-1bdf-4e68-aa72-c78e1bdca71e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3891611393},{"type":"v1","addr":"172.21.15.177:6801","nonce":3891611393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3891611393},{"type":"v1","addr":"172.21.15.177:6803","nonce":3891611393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3891611393},{"type":"v1","addr":"172.21.15.177:6807","nonce":3891611393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3891611393},{"type":"v1","addr":"172.21.15.177:6805","nonce":3891611393}]},"public_addr":"172.21.15.177:6801/3891611393","cluster_addr":"172.21.15.177:6803/3891611393","heartbeat_back_addr":"172.21.15.177:6807/3891611393","heartbeat_front_addr":"172.21.15.177:6805/3891611393","state":["exists","up"]},{"osd":6,"uuid":"89c685a4-0158-49d1-a3a4-7a794cd8cdc4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":800067290},{"type":"v1","addr":"172.21.15.177:6825","nonce":800067290}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":800067290},{"type":"v1","addr":"172.21.15.177:6827","nonce":800067290}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":800067290},{"type":"v1","addr":"172.21.15.177:6831","nonce":800067290}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":800067290},{"type":"v1","addr":"172.21.15.177:6829","nonce":800067290}]},"public_addr":"172.21.15.177:6825/800067290","cluster_addr":"172.21.15.177:6827/800067290","heartbeat_back_addr":"172.21.15.177:6831/800067290","heartbeat_front_addr":"172.21.15.177:6829/800067290","state":["exists","up"]},{"osd":7,"uuid":"08fae03a-7ac7-40f4-a0fe-f754dcfd8c8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":2618477608},{"type":"v1","addr":"172.21.15.177:6809","nonce":2618477608}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":2618477608},{"type":"v1","addr":"172.21.15.177:6811","nonce":2618477608}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":2618477608},{"type":"v1","addr":"172.21.15.177:6815","nonce":2618477608}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":2618477608},{"type":"v1","addr":"172.21.15.177:6813","nonce":2618477608}]},"public_addr":"172.21.15.177:6809/2618477608","cluster_addr":"172.21.15.177:6811/2618477608","heartbeat_back_addr":"172.21.15.177:6815/2618477608","heartbeat_front_addr":"172.21.15.177:6813/2618477608","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-04T15:52:20.137 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-06-04T15:52:20.137 INFO:tasks.ceph:Creating RBD pool 2024-06-04T15:52:20.137 DEBUG:teuthology.orchestra.run.smithi144:> sudo ceph --cluster ceph osd pool create rbd 8 2024-06-04T15:52:21.414 INFO:teuthology.orchestra.run.smithi144.stderr:pool 'rbd' created 2024-06-04T15:52:21.431 DEBUG:teuthology.orchestra.run.smithi144:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2024-06-04T15:52:22.408 INFO:teuthology.orchestra.run.smithi144.stderr:enabled application 'rbd' on pool 'rbd' 2024-06-04T15:52:22.425 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-06-04T15:52:22.426 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-06-04T15:52:22.426 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-06-04T15:52:22.426 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-06-04T15:52:22.426 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-06-04T15:52:22.808 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T15:52:22.819 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":4,"flags":0,"active_gid":4101,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":2645786330},{"type":"v1","addr":"172.21.15.177:6833","nonce":2645786330}]},"active_addr":"172.21.15.177:6833/2645786330","active_change":"2024-06-04T15:52:12.892192+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":4100,"name":"y","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.177:0","nonce":3449359734}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.177:0","nonce":2323594327}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.177:0","nonce":3776496716}]}]} 2024-06-04T15:52:22.824 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-06-04T15:52:22.824 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-06-04T15:52:22.825 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-06-04T15:52:23.138 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T15:52:23.138 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":17,"fsid":"15e56bb1-4856-42f3-b6db-a2c8f23c5557","created":"2024-06-04T15:52:08.498471+0000","modified":"2024-06-04T15:52:22.407297+0000","last_up_change":"2024-06-04T15:52:19.398091+0000","last_in_change":"2024-06-04T15:52:11.751110+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2024-06-04T15:52:20.443906+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2024-06-04T15:52:20.915083+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"865b3e53-9572-4d2e-a552-93aeba5a878e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":1453747520},{"type":"v1","addr":"172.21.15.144:6801","nonce":1453747520}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":1453747520},{"type":"v1","addr":"172.21.15.144:6803","nonce":1453747520}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":1453747520},{"type":"v1","addr":"172.21.15.144:6807","nonce":1453747520}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":1453747520},{"type":"v1","addr":"172.21.15.144:6805","nonce":1453747520}]},"public_addr":"172.21.15.144:6801/1453747520","cluster_addr":"172.21.15.144:6803/1453747520","heartbeat_back_addr":"172.21.15.144:6807/1453747520","heartbeat_front_addr":"172.21.15.144:6805/1453747520","state":["exists","up"]},{"osd":1,"uuid":"530d160d-4c96-482b-b9ca-017c52d6971b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":2358575268},{"type":"v1","addr":"172.21.15.144:6817","nonce":2358575268}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":2358575268},{"type":"v1","addr":"172.21.15.144:6819","nonce":2358575268}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":2358575268},{"type":"v1","addr":"172.21.15.144:6823","nonce":2358575268}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":2358575268},{"type":"v1","addr":"172.21.15.144:6821","nonce":2358575268}]},"public_addr":"172.21.15.144:6817/2358575268","cluster_addr":"172.21.15.144:6819/2358575268","heartbeat_back_addr":"172.21.15.144:6823/2358575268","heartbeat_front_addr":"172.21.15.144:6821/2358575268","state":["exists","up"]},{"osd":2,"uuid":"ef99cc9a-405c-41d4-b504-396b1cc3ab62","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":86532035},{"type":"v1","addr":"172.21.15.144:6809","nonce":86532035}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":86532035},{"type":"v1","addr":"172.21.15.144:6811","nonce":86532035}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":86532035},{"type":"v1","addr":"172.21.15.144:6815","nonce":86532035}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":86532035},{"type":"v1","addr":"172.21.15.144:6813","nonce":86532035}]},"public_addr":"172.21.15.144:6809/86532035","cluster_addr":"172.21.15.144:6811/86532035","heartbeat_back_addr":"172.21.15.144:6815/86532035","heartbeat_front_addr":"172.21.15.144:6813/86532035","state":["exists","up"]},{"osd":3,"uuid":"bbc2f08d-579a-4c02-bf75-8be9e630d34c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":166159729},{"type":"v1","addr":"172.21.15.144:6825","nonce":166159729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":166159729},{"type":"v1","addr":"172.21.15.144:6827","nonce":166159729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":166159729},{"type":"v1","addr":"172.21.15.144:6831","nonce":166159729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":166159729},{"type":"v1","addr":"172.21.15.144:6829","nonce":166159729}]},"public_addr":"172.21.15.144:6825/166159729","cluster_addr":"172.21.15.144:6827/166159729","heartbeat_back_addr":"172.21.15.144:6831/166159729","heartbeat_front_addr":"172.21.15.144:6829/166159729","state":["exists","up"]},{"osd":4,"uuid":"64a1a82a-e45e-4750-9101-499c6fe49b5f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":2039473917},{"type":"v1","addr":"172.21.15.177:6817","nonce":2039473917}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":2039473917},{"type":"v1","addr":"172.21.15.177:6819","nonce":2039473917}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":2039473917},{"type":"v1","addr":"172.21.15.177:6823","nonce":2039473917}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":2039473917},{"type":"v1","addr":"172.21.15.177:6821","nonce":2039473917}]},"public_addr":"172.21.15.177:6817/2039473917","cluster_addr":"172.21.15.177:6819/2039473917","heartbeat_back_addr":"172.21.15.177:6823/2039473917","heartbeat_front_addr":"172.21.15.177:6821/2039473917","state":["exists","up"]},{"osd":5,"uuid":"4391ac8e-1bdf-4e68-aa72-c78e1bdca71e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3891611393},{"type":"v1","addr":"172.21.15.177:6801","nonce":3891611393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3891611393},{"type":"v1","addr":"172.21.15.177:6803","nonce":3891611393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3891611393},{"type":"v1","addr":"172.21.15.177:6807","nonce":3891611393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3891611393},{"type":"v1","addr":"172.21.15.177:6805","nonce":3891611393}]},"public_addr":"172.21.15.177:6801/3891611393","cluster_addr":"172.21.15.177:6803/3891611393","heartbeat_back_addr":"172.21.15.177:6807/3891611393","heartbeat_front_addr":"172.21.15.177:6805/3891611393","state":["exists","up"]},{"osd":6,"uuid":"89c685a4-0158-49d1-a3a4-7a794cd8cdc4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":800067290},{"type":"v1","addr":"172.21.15.177:6825","nonce":800067290}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":800067290},{"type":"v1","addr":"172.21.15.177:6827","nonce":800067290}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":800067290},{"type":"v1","addr":"172.21.15.177:6831","nonce":800067290}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":800067290},{"type":"v1","addr":"172.21.15.177:6829","nonce":800067290}]},"public_addr":"172.21.15.177:6825/800067290","cluster_addr":"172.21.15.177:6827/800067290","heartbeat_back_addr":"172.21.15.177:6831/800067290","heartbeat_front_addr":"172.21.15.177:6829/800067290","state":["exists","up"]},{"osd":7,"uuid":"08fae03a-7ac7-40f4-a0fe-f754dcfd8c8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":2618477608},{"type":"v1","addr":"172.21.15.177:6809","nonce":2618477608}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":2618477608},{"type":"v1","addr":"172.21.15.177:6811","nonce":2618477608}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":2618477608},{"type":"v1","addr":"172.21.15.177:6815","nonce":2618477608}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":2618477608},{"type":"v1","addr":"172.21.15.177:6813","nonce":2618477608}]},"public_addr":"172.21.15.177:6809/2618477608","cluster_addr":"172.21.15.177:6811/2618477608","heartbeat_back_addr":"172.21.15.177:6815/2618477608","heartbeat_front_addr":"172.21.15.177:6813/2618477608","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-04T15:52:16.796198+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-04T15:52:16.944288+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-04T15:52:16.890626+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-04T15:52:16.976961+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-04T15:52:16.916053+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-04T15:52:16.816952+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-04T15:52:16.913393+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-04T15:52:16.833768+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-04T15:52:23.152 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-06-04T15:52:23.152 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-06-04T15:52:23.464 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T15:52:23.464 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":18,"fsid":"15e56bb1-4856-42f3-b6db-a2c8f23c5557","created":"2024-06-04T15:52:08.498471+0000","modified":"2024-06-04T15:52:23.408840+0000","last_up_change":"2024-06-04T15:52:19.398091+0000","last_in_change":"2024-06-04T15:52:11.751110+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2024-06-04T15:52:20.443906+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2024-06-04T15:52:20.915083+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"865b3e53-9572-4d2e-a552-93aeba5a878e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":1453747520},{"type":"v1","addr":"172.21.15.144:6801","nonce":1453747520}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":1453747520},{"type":"v1","addr":"172.21.15.144:6803","nonce":1453747520}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":1453747520},{"type":"v1","addr":"172.21.15.144:6807","nonce":1453747520}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":1453747520},{"type":"v1","addr":"172.21.15.144:6805","nonce":1453747520}]},"public_addr":"172.21.15.144:6801/1453747520","cluster_addr":"172.21.15.144:6803/1453747520","heartbeat_back_addr":"172.21.15.144:6807/1453747520","heartbeat_front_addr":"172.21.15.144:6805/1453747520","state":["exists","up"]},{"osd":1,"uuid":"530d160d-4c96-482b-b9ca-017c52d6971b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":2358575268},{"type":"v1","addr":"172.21.15.144:6817","nonce":2358575268}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":2358575268},{"type":"v1","addr":"172.21.15.144:6819","nonce":2358575268}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":2358575268},{"type":"v1","addr":"172.21.15.144:6823","nonce":2358575268}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":2358575268},{"type":"v1","addr":"172.21.15.144:6821","nonce":2358575268}]},"public_addr":"172.21.15.144:6817/2358575268","cluster_addr":"172.21.15.144:6819/2358575268","heartbeat_back_addr":"172.21.15.144:6823/2358575268","heartbeat_front_addr":"172.21.15.144:6821/2358575268","state":["exists","up"]},{"osd":2,"uuid":"ef99cc9a-405c-41d4-b504-396b1cc3ab62","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":86532035},{"type":"v1","addr":"172.21.15.144:6809","nonce":86532035}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":86532035},{"type":"v1","addr":"172.21.15.144:6811","nonce":86532035}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":86532035},{"type":"v1","addr":"172.21.15.144:6815","nonce":86532035}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":86532035},{"type":"v1","addr":"172.21.15.144:6813","nonce":86532035}]},"public_addr":"172.21.15.144:6809/86532035","cluster_addr":"172.21.15.144:6811/86532035","heartbeat_back_addr":"172.21.15.144:6815/86532035","heartbeat_front_addr":"172.21.15.144:6813/86532035","state":["exists","up"]},{"osd":3,"uuid":"bbc2f08d-579a-4c02-bf75-8be9e630d34c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":166159729},{"type":"v1","addr":"172.21.15.144:6825","nonce":166159729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":166159729},{"type":"v1","addr":"172.21.15.144:6827","nonce":166159729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":166159729},{"type":"v1","addr":"172.21.15.144:6831","nonce":166159729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":166159729},{"type":"v1","addr":"172.21.15.144:6829","nonce":166159729}]},"public_addr":"172.21.15.144:6825/166159729","cluster_addr":"172.21.15.144:6827/166159729","heartbeat_back_addr":"172.21.15.144:6831/166159729","heartbeat_front_addr":"172.21.15.144:6829/166159729","state":["exists","up"]},{"osd":4,"uuid":"64a1a82a-e45e-4750-9101-499c6fe49b5f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":2039473917},{"type":"v1","addr":"172.21.15.177:6817","nonce":2039473917}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":2039473917},{"type":"v1","addr":"172.21.15.177:6819","nonce":2039473917}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":2039473917},{"type":"v1","addr":"172.21.15.177:6823","nonce":2039473917}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":2039473917},{"type":"v1","addr":"172.21.15.177:6821","nonce":2039473917}]},"public_addr":"172.21.15.177:6817/2039473917","cluster_addr":"172.21.15.177:6819/2039473917","heartbeat_back_addr":"172.21.15.177:6823/2039473917","heartbeat_front_addr":"172.21.15.177:6821/2039473917","state":["exists","up"]},{"osd":5,"uuid":"4391ac8e-1bdf-4e68-aa72-c78e1bdca71e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3891611393},{"type":"v1","addr":"172.21.15.177:6801","nonce":3891611393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3891611393},{"type":"v1","addr":"172.21.15.177:6803","nonce":3891611393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3891611393},{"type":"v1","addr":"172.21.15.177:6807","nonce":3891611393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3891611393},{"type":"v1","addr":"172.21.15.177:6805","nonce":3891611393}]},"public_addr":"172.21.15.177:6801/3891611393","cluster_addr":"172.21.15.177:6803/3891611393","heartbeat_back_addr":"172.21.15.177:6807/3891611393","heartbeat_front_addr":"172.21.15.177:6805/3891611393","state":["exists","up"]},{"osd":6,"uuid":"89c685a4-0158-49d1-a3a4-7a794cd8cdc4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":800067290},{"type":"v1","addr":"172.21.15.177:6825","nonce":800067290}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":800067290},{"type":"v1","addr":"172.21.15.177:6827","nonce":800067290}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":800067290},{"type":"v1","addr":"172.21.15.177:6831","nonce":800067290}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":800067290},{"type":"v1","addr":"172.21.15.177:6829","nonce":800067290}]},"public_addr":"172.21.15.177:6825/800067290","cluster_addr":"172.21.15.177:6827/800067290","heartbeat_back_addr":"172.21.15.177:6831/800067290","heartbeat_front_addr":"172.21.15.177:6829/800067290","state":["exists","up"]},{"osd":7,"uuid":"08fae03a-7ac7-40f4-a0fe-f754dcfd8c8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":2618477608},{"type":"v1","addr":"172.21.15.177:6809","nonce":2618477608}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":2618477608},{"type":"v1","addr":"172.21.15.177:6811","nonce":2618477608}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":2618477608},{"type":"v1","addr":"172.21.15.177:6815","nonce":2618477608}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":2618477608},{"type":"v1","addr":"172.21.15.177:6813","nonce":2618477608}]},"public_addr":"172.21.15.177:6809/2618477608","cluster_addr":"172.21.15.177:6811/2618477608","heartbeat_back_addr":"172.21.15.177:6815/2618477608","heartbeat_front_addr":"172.21.15.177:6813/2618477608","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-04T15:52:16.796198+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-04T15:52:16.944288+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-04T15:52:16.890626+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-04T15:52:16.976961+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-04T15:52:16.916053+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-04T15:52:16.816952+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-04T15:52:16.913393+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-04T15:52:16.833768+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-04T15:52:23.477 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-06-04T15:52:23.478 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-06-04T15:52:23.478 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-06-04T15:52:23.478 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-06-04T15:52:23.479 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-06-04T15:52:23.479 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-06-04T15:52:23.479 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-06-04T15:52:23.480 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-06-04T15:52:23.738 INFO:teuthology.orchestra.run.smithi144.stdout:60129542146 2024-06-04T15:52:23.739 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-06-04T15:52:23.745 INFO:teuthology.orchestra.run.smithi144.stdout:60129542148 2024-06-04T15:52:23.745 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-06-04T15:52:23.753 INFO:teuthology.orchestra.run.smithi144.stdout:60129542148 2024-06-04T15:52:23.753 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-06-04T15:52:23.754 INFO:teuthology.orchestra.run.smithi144.stdout:60129542147 2024-06-04T15:52:23.754 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-06-04T15:52:23.755 INFO:teuthology.orchestra.run.smithi144.stdout:60129542147 2024-06-04T15:52:23.755 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-06-04T15:52:23.756 INFO:teuthology.orchestra.run.smithi144.stdout:60129542149 2024-06-04T15:52:23.756 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-06-04T15:52:23.757 INFO:teuthology.orchestra.run.smithi144.stdout:60129542149 2024-06-04T15:52:23.757 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-06-04T15:52:23.759 INFO:teuthology.orchestra.run.smithi144.stdout:60129542148 2024-06-04T15:52:23.760 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-06-04T15:52:24.394 INFO:teuthology.orchestra.run.smithi144.stdout:60129542145 2024-06-04T15:52:24.408 INFO:teuthology.orchestra.run.smithi144.stdout:60129542147 2024-06-04T15:52:24.408 INFO:teuthology.orchestra.run.smithi144.stdout:60129542147 2024-06-04T15:52:24.412 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542146 got 60129542145 for osd.4 2024-06-04T15:52:24.412 INFO:teuthology.orchestra.run.smithi144.stdout:60129542148 2024-06-04T15:52:24.412 INFO:teuthology.orchestra.run.smithi144.stdout:60129542146 2024-06-04T15:52:24.414 INFO:teuthology.orchestra.run.smithi144.stdout:60129542148 2024-06-04T15:52:24.425 INFO:teuthology.orchestra.run.smithi144.stdout:60129542146 2024-06-04T15:52:24.426 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542148 got 60129542147 for osd.7 2024-06-04T15:52:24.430 INFO:teuthology.orchestra.run.smithi144.stdout:60129542147 2024-06-04T15:52:24.433 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542148 got 60129542147 for osd.6 2024-06-04T15:52:24.439 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542147 got 60129542146 for osd.5 2024-06-04T15:52:24.439 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542148 for osd.2 2024-06-04T15:52:24.441 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542148 for osd.0 2024-06-04T15:52:24.447 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542147 got 60129542146 for osd.3 2024-06-04T15:52:24.447 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542148 got 60129542147 for osd.1 2024-06-04T15:52:25.413 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-06-04T15:52:25.427 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-06-04T15:52:25.434 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-06-04T15:52:25.439 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-06-04T15:52:25.439 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-06-04T15:52:25.442 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-06-04T15:52:25.448 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-06-04T15:52:25.448 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-06-04T15:52:26.043 INFO:teuthology.orchestra.run.smithi144.stdout:60129542146 2024-06-04T15:52:26.064 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542146 got 60129542146 for osd.4 2024-06-04T15:52:26.064 DEBUG:teuthology.parallel:result is None 2024-06-04T15:52:26.087 INFO:teuthology.orchestra.run.smithi144.stdout:60129542148 2024-06-04T15:52:26.100 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542148 got 60129542148 for osd.7 2024-06-04T15:52:26.101 DEBUG:teuthology.parallel:result is None 2024-06-04T15:52:26.108 INFO:teuthology.orchestra.run.smithi144.stdout:60129542149 2024-06-04T15:52:26.113 INFO:teuthology.orchestra.run.smithi144.stdout:60129542147 2024-06-04T15:52:26.119 INFO:teuthology.orchestra.run.smithi144.stdout:60129542148 2024-06-04T15:52:26.119 INFO:teuthology.orchestra.run.smithi144.stdout:60129542149 2024-06-04T15:52:26.125 INFO:teuthology.orchestra.run.smithi144.stdout:60129542147 2024-06-04T15:52:26.127 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542149 for osd.2 2024-06-04T15:52:26.127 DEBUG:teuthology.parallel:result is None 2024-06-04T15:52:26.129 INFO:teuthology.orchestra.run.smithi144.stdout:60129542148 2024-06-04T15:52:26.133 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542147 got 60129542147 for osd.5 2024-06-04T15:52:26.133 DEBUG:teuthology.parallel:result is None 2024-06-04T15:52:26.138 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542149 for osd.0 2024-06-04T15:52:26.139 DEBUG:teuthology.parallel:result is None 2024-06-04T15:52:26.139 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542148 got 60129542148 for osd.6 2024-06-04T15:52:26.139 DEBUG:teuthology.parallel:result is None 2024-06-04T15:52:26.147 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542147 got 60129542147 for osd.3 2024-06-04T15:52:26.147 DEBUG:teuthology.parallel:result is None 2024-06-04T15:52:26.148 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542148 got 60129542148 for osd.1 2024-06-04T15:52:26.148 DEBUG:teuthology.parallel:result is None 2024-06-04T15:52:26.148 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-06-04T15:52:26.149 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-06-04T15:52:26.492 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T15:52:26.493 INFO:teuthology.orchestra.run.smithi144.stderr:dumped all 2024-06-04T15:52:26.505 INFO:teuthology.orchestra.run.smithi144.stdout:{"pg_ready":true,"pg_map":{"version":14,"stamp":"2024-06-04T15:52:24.898958+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":10,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218612,"kb_used_data":2440,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754756108,"statfs":{"total":773094113280,"available":772870254592,"internally_reserved":0,"allocated":2498560,"data_stored":1576952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-06-04T15:52:23.413260+0000","last_change":"2024-06-04T15:52:22.777053+0000","last_active":"2024-06-04T15:52:23.413260+0000","last_peered":"2024-06-04T15:52:23.413260+0000","last_clean":"2024-06-04T15:52:23.413260+0000","last_became_active":"2024-06-04T15:52:22.776723+0000","last_became_peered":"2024-06-04T15:52:22.776723+0000","last_unstale":"2024-06-04T15:52:23.413260+0000","last_undegraded":"2024-06-04T15:52:23.413260+0000","last_fullsized":"2024-06-04T15:52:23.413260+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:21.400880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:21.400880+0000","last_clean_scrub_stamp":"2024-06-04T15:52:21.400880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T02:40:05.098206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-06-04T15:52:22.778086+0000","last_change":"2024-06-04T15:52:22.777126+0000","last_active":"2024-06-04T15:52:22.778086+0000","last_peered":"2024-06-04T15:52:22.778086+0000","last_clean":"2024-06-04T15:52:22.778086+0000","last_became_active":"2024-06-04T15:52:22.776729+0000","last_became_peered":"2024-06-04T15:52:22.776729+0000","last_unstale":"2024-06-04T15:52:22.778086+0000","last_undegraded":"2024-06-04T15:52:22.778086+0000","last_fullsized":"2024-06-04T15:52:22.778086+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:21.400880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:21.400880+0000","last_clean_scrub_stamp":"2024-06-04T15:52:21.400880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T19:33:45.088803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-06-04T15:52:22.777796+0000","last_change":"2024-06-04T15:52:22.777104+0000","last_active":"2024-06-04T15:52:22.777796+0000","last_peered":"2024-06-04T15:52:22.777796+0000","last_clean":"2024-06-04T15:52:22.777796+0000","last_became_active":"2024-06-04T15:52:22.776744+0000","last_became_peered":"2024-06-04T15:52:22.776744+0000","last_unstale":"2024-06-04T15:52:22.777796+0000","last_undegraded":"2024-06-04T15:52:22.777796+0000","last_fullsized":"2024-06-04T15:52:22.777796+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:21.400880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:21.400880+0000","last_clean_scrub_stamp":"2024-06-04T15:52:21.400880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T18:39:48.385939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-06-04T15:52:22.429845+0000","last_change":"2024-06-04T15:52:22.429208+0000","last_active":"2024-06-04T15:52:22.429845+0000","last_peered":"2024-06-04T15:52:22.429845+0000","last_clean":"2024-06-04T15:52:22.429845+0000","last_became_active":"2024-06-04T15:52:22.428894+0000","last_became_peered":"2024-06-04T15:52:22.428894+0000","last_unstale":"2024-06-04T15:52:22.429845+0000","last_undegraded":"2024-06-04T15:52:22.429845+0000","last_fullsized":"2024-06-04T15:52:22.429845+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:21.400880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:21.400880+0000","last_clean_scrub_stamp":"2024-06-04T15:52:21.400880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T19:03:15.009651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"17'72","reported_seq":99,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-06-04T15:52:23.203023+0000","last_change":"2024-06-04T15:52:22.429522+0000","last_active":"2024-06-04T15:52:23.203023+0000","last_peered":"2024-06-04T15:52:23.203023+0000","last_clean":"2024-06-04T15:52:23.203023+0000","last_became_active":"2024-06-04T15:52:22.428356+0000","last_became_peered":"2024-06-04T15:52:22.428356+0000","last_unstale":"2024-06-04T15:52:23.203023+0000","last_undegraded":"2024-06-04T15:52:23.203023+0000","last_fullsized":"2024-06-04T15:52:23.203023+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:21.400880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:21.400880+0000","last_clean_scrub_stamp":"2024-06-04T15:52:21.400880+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T17:53:49.151658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-06-04T15:52:22.424574+0000","last_change":"2024-06-04T15:52:22.423963+0000","last_active":"2024-06-04T15:52:22.424574+0000","last_peered":"2024-06-04T15:52:22.424574+0000","last_clean":"2024-06-04T15:52:22.424574+0000","last_became_active":"2024-06-04T15:52:22.423712+0000","last_became_peered":"2024-06-04T15:52:22.423712+0000","last_unstale":"2024-06-04T15:52:22.424574+0000","last_undegraded":"2024-06-04T15:52:22.424574+0000","last_fullsized":"2024-06-04T15:52:22.424574+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:21.400880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:21.400880+0000","last_clean_scrub_stamp":"2024-06-04T15:52:21.400880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T17:06:56.705415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-06-04T15:52:23.413429+0000","last_change":"2024-06-04T15:52:22.423235+0000","last_active":"2024-06-04T15:52:23.413429+0000","last_peered":"2024-06-04T15:52:23.413429+0000","last_clean":"2024-06-04T15:52:23.413429+0000","last_became_active":"2024-06-04T15:52:22.422971+0000","last_became_peered":"2024-06-04T15:52:22.422971+0000","last_unstale":"2024-06-04T15:52:23.413429+0000","last_undegraded":"2024-06-04T15:52:23.413429+0000","last_fullsized":"2024-06-04T15:52:23.413429+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:21.400880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:21.400880+0000","last_clean_scrub_stamp":"2024-06-04T15:52:21.400880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T16:30:17.573588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-06-04T15:52:22.778090+0000","last_change":"2024-06-04T15:52:22.777198+0000","last_active":"2024-06-04T15:52:22.778090+0000","last_peered":"2024-06-04T15:52:22.778090+0000","last_clean":"2024-06-04T15:52:22.778090+0000","last_became_active":"2024-06-04T15:52:22.776779+0000","last_became_peered":"2024-06-04T15:52:22.776779+0000","last_unstale":"2024-06-04T15:52:22.778090+0000","last_undegraded":"2024-06-04T15:52:22.778090+0000","last_fullsized":"2024-06-04T15:52:22.778090+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:21.400880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:21.400880+0000","last_clean_scrub_stamp":"2024-06-04T15:52:21.400880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T21:20:21.432486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-06-04T15:52:23.413252+0000","last_change":"2024-06-04T15:52:22.417765+0000","last_active":"2024-06-04T15:52:23.413252+0000","last_peered":"2024-06-04T15:52:23.413252+0000","last_clean":"2024-06-04T15:52:23.413252+0000","last_became_active":"2024-06-04T15:52:22.417462+0000","last_became_peered":"2024-06-04T15:52:22.417462+0000","last_unstale":"2024-06-04T15:52:23.413252+0000","last_undegraded":"2024-06-04T15:52:23.413252+0000","last_fullsized":"2024-06-04T15:52:23.413252+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:21.400880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:21.400880+0000","last_clean_scrub_stamp":"2024-06-04T15:52:21.400880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T01:56:18.510923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542148,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27188,"kb_used_data":160,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344652,"statfs":{"total":96636764160,"available":96608923648,"internally_reserved":0,"allocated":163840,"data_stored":49527,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542148,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27180,"kb_used_data":160,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344660,"statfs":{"total":96636764160,"available":96608931840,"internally_reserved":0,"allocated":163840,"data_stored":49527,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542147,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27756,"kb_used_data":740,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344084,"statfs":{"total":96636764160,"available":96608342016,"internally_reserved":0,"allocated":757760,"data_stored":639895,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542146,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27180,"kb_used_data":160,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344660,"statfs":{"total":96636764160,"available":96608931840,"internally_reserved":0,"allocated":163840,"data_stored":49527,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542147,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27756,"kb_used_data":740,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344084,"statfs":{"total":96636764160,"available":96608342016,"internally_reserved":0,"allocated":757760,"data_stored":639895,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542149,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27184,"kb_used_data":160,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344656,"statfs":{"total":96636764160,"available":96608927744,"internally_reserved":0,"allocated":163840,"data_stored":49527,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542148,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27180,"kb_used_data":160,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344660,"statfs":{"total":96636764160,"available":96608931840,"internally_reserved":0,"allocated":163840,"data_stored":49527,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542149,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27188,"kb_used_data":160,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344652,"statfs":{"total":96636764160,"available":96608923648,"internally_reserved":0,"allocated":163840,"data_stored":49527,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-06-04T15:52:26.506 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-06-04T15:52:26.807 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T15:52:26.807 INFO:teuthology.orchestra.run.smithi144.stderr:dumped all 2024-06-04T15:52:26.819 INFO:teuthology.orchestra.run.smithi144.stdout:{"pg_ready":true,"pg_map":{"version":14,"stamp":"2024-06-04T15:52:24.898958+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":10,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218612,"kb_used_data":2440,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754756108,"statfs":{"total":773094113280,"available":772870254592,"internally_reserved":0,"allocated":2498560,"data_stored":1576952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-06-04T15:52:23.413260+0000","last_change":"2024-06-04T15:52:22.777053+0000","last_active":"2024-06-04T15:52:23.413260+0000","last_peered":"2024-06-04T15:52:23.413260+0000","last_clean":"2024-06-04T15:52:23.413260+0000","last_became_active":"2024-06-04T15:52:22.776723+0000","last_became_peered":"2024-06-04T15:52:22.776723+0000","last_unstale":"2024-06-04T15:52:23.413260+0000","last_undegraded":"2024-06-04T15:52:23.413260+0000","last_fullsized":"2024-06-04T15:52:23.413260+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:21.400880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:21.400880+0000","last_clean_scrub_stamp":"2024-06-04T15:52:21.400880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T02:40:05.098206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-06-04T15:52:22.778086+0000","last_change":"2024-06-04T15:52:22.777126+0000","last_active":"2024-06-04T15:52:22.778086+0000","last_peered":"2024-06-04T15:52:22.778086+0000","last_clean":"2024-06-04T15:52:22.778086+0000","last_became_active":"2024-06-04T15:52:22.776729+0000","last_became_peered":"2024-06-04T15:52:22.776729+0000","last_unstale":"2024-06-04T15:52:22.778086+0000","last_undegraded":"2024-06-04T15:52:22.778086+0000","last_fullsized":"2024-06-04T15:52:22.778086+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:21.400880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:21.400880+0000","last_clean_scrub_stamp":"2024-06-04T15:52:21.400880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T19:33:45.088803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-06-04T15:52:22.777796+0000","last_change":"2024-06-04T15:52:22.777104+0000","last_active":"2024-06-04T15:52:22.777796+0000","last_peered":"2024-06-04T15:52:22.777796+0000","last_clean":"2024-06-04T15:52:22.777796+0000","last_became_active":"2024-06-04T15:52:22.776744+0000","last_became_peered":"2024-06-04T15:52:22.776744+0000","last_unstale":"2024-06-04T15:52:22.777796+0000","last_undegraded":"2024-06-04T15:52:22.777796+0000","last_fullsized":"2024-06-04T15:52:22.777796+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:21.400880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:21.400880+0000","last_clean_scrub_stamp":"2024-06-04T15:52:21.400880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T18:39:48.385939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-06-04T15:52:22.429845+0000","last_change":"2024-06-04T15:52:22.429208+0000","last_active":"2024-06-04T15:52:22.429845+0000","last_peered":"2024-06-04T15:52:22.429845+0000","last_clean":"2024-06-04T15:52:22.429845+0000","last_became_active":"2024-06-04T15:52:22.428894+0000","last_became_peered":"2024-06-04T15:52:22.428894+0000","last_unstale":"2024-06-04T15:52:22.429845+0000","last_undegraded":"2024-06-04T15:52:22.429845+0000","last_fullsized":"2024-06-04T15:52:22.429845+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:21.400880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:21.400880+0000","last_clean_scrub_stamp":"2024-06-04T15:52:21.400880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T19:03:15.009651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"17'72","reported_seq":99,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-06-04T15:52:23.203023+0000","last_change":"2024-06-04T15:52:22.429522+0000","last_active":"2024-06-04T15:52:23.203023+0000","last_peered":"2024-06-04T15:52:23.203023+0000","last_clean":"2024-06-04T15:52:23.203023+0000","last_became_active":"2024-06-04T15:52:22.428356+0000","last_became_peered":"2024-06-04T15:52:22.428356+0000","last_unstale":"2024-06-04T15:52:23.203023+0000","last_undegraded":"2024-06-04T15:52:23.203023+0000","last_fullsized":"2024-06-04T15:52:23.203023+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:21.400880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:21.400880+0000","last_clean_scrub_stamp":"2024-06-04T15:52:21.400880+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T17:53:49.151658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-06-04T15:52:22.424574+0000","last_change":"2024-06-04T15:52:22.423963+0000","last_active":"2024-06-04T15:52:22.424574+0000","last_peered":"2024-06-04T15:52:22.424574+0000","last_clean":"2024-06-04T15:52:22.424574+0000","last_became_active":"2024-06-04T15:52:22.423712+0000","last_became_peered":"2024-06-04T15:52:22.423712+0000","last_unstale":"2024-06-04T15:52:22.424574+0000","last_undegraded":"2024-06-04T15:52:22.424574+0000","last_fullsized":"2024-06-04T15:52:22.424574+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:21.400880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:21.400880+0000","last_clean_scrub_stamp":"2024-06-04T15:52:21.400880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T17:06:56.705415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-06-04T15:52:23.413429+0000","last_change":"2024-06-04T15:52:22.423235+0000","last_active":"2024-06-04T15:52:23.413429+0000","last_peered":"2024-06-04T15:52:23.413429+0000","last_clean":"2024-06-04T15:52:23.413429+0000","last_became_active":"2024-06-04T15:52:22.422971+0000","last_became_peered":"2024-06-04T15:52:22.422971+0000","last_unstale":"2024-06-04T15:52:23.413429+0000","last_undegraded":"2024-06-04T15:52:23.413429+0000","last_fullsized":"2024-06-04T15:52:23.413429+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:21.400880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:21.400880+0000","last_clean_scrub_stamp":"2024-06-04T15:52:21.400880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T16:30:17.573588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-06-04T15:52:22.778090+0000","last_change":"2024-06-04T15:52:22.777198+0000","last_active":"2024-06-04T15:52:22.778090+0000","last_peered":"2024-06-04T15:52:22.778090+0000","last_clean":"2024-06-04T15:52:22.778090+0000","last_became_active":"2024-06-04T15:52:22.776779+0000","last_became_peered":"2024-06-04T15:52:22.776779+0000","last_unstale":"2024-06-04T15:52:22.778090+0000","last_undegraded":"2024-06-04T15:52:22.778090+0000","last_fullsized":"2024-06-04T15:52:22.778090+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:21.400880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:21.400880+0000","last_clean_scrub_stamp":"2024-06-04T15:52:21.400880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T21:20:21.432486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-06-04T15:52:23.413252+0000","last_change":"2024-06-04T15:52:22.417765+0000","last_active":"2024-06-04T15:52:23.413252+0000","last_peered":"2024-06-04T15:52:23.413252+0000","last_clean":"2024-06-04T15:52:23.413252+0000","last_became_active":"2024-06-04T15:52:22.417462+0000","last_became_peered":"2024-06-04T15:52:22.417462+0000","last_unstale":"2024-06-04T15:52:23.413252+0000","last_undegraded":"2024-06-04T15:52:23.413252+0000","last_fullsized":"2024-06-04T15:52:23.413252+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:21.400880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:21.400880+0000","last_clean_scrub_stamp":"2024-06-04T15:52:21.400880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T01:56:18.510923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542148,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27188,"kb_used_data":160,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344652,"statfs":{"total":96636764160,"available":96608923648,"internally_reserved":0,"allocated":163840,"data_stored":49527,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542148,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27180,"kb_used_data":160,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344660,"statfs":{"total":96636764160,"available":96608931840,"internally_reserved":0,"allocated":163840,"data_stored":49527,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542147,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27756,"kb_used_data":740,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344084,"statfs":{"total":96636764160,"available":96608342016,"internally_reserved":0,"allocated":757760,"data_stored":639895,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542146,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27180,"kb_used_data":160,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344660,"statfs":{"total":96636764160,"available":96608931840,"internally_reserved":0,"allocated":163840,"data_stored":49527,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542147,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27756,"kb_used_data":740,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344084,"statfs":{"total":96636764160,"available":96608342016,"internally_reserved":0,"allocated":757760,"data_stored":639895,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542149,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27184,"kb_used_data":160,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344656,"statfs":{"total":96636764160,"available":96608927744,"internally_reserved":0,"allocated":163840,"data_stored":49527,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542148,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27180,"kb_used_data":160,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344660,"statfs":{"total":96636764160,"available":96608931840,"internally_reserved":0,"allocated":163840,"data_stored":49527,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542149,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27188,"kb_used_data":160,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344652,"statfs":{"total":96636764160,"available":96608923648,"internally_reserved":0,"allocated":163840,"data_stored":49527,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-06-04T15:52:26.820 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-06-04T15:52:26.820 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-06-04T15:52:26.820 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-06-04T15:52:26.820 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-06-04T15:52:27.161 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T15:52:27.161 INFO:teuthology.orchestra.run.smithi144.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-06-04T15:52:27.175 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-06-04T15:52:27.175 INFO:teuthology.run_tasks:Running task openssl_keys... 2024-06-04T15:52:27.188 DEBUG:teuthology.task:Applying overrides for task openssl_keys: {'rgw.client.0': {'ca': 'root', 'client': 'client.0', 'embed-key': True}, 'root': {'client': 'client.0', 'cn': 'teuthology', 'install': ['client.0'], 'key-type': 'rsa:4096'}} 2024-06-04T15:52:27.189 DEBUG:teuthology.orchestra.run.smithi144:> mkdir -p /home/ubuntu/cephtest/ca 2024-06-04T15:52:27.217 DEBUG:teuthology.orchestra.run.smithi144:> openssl req -x509 -nodes -newkey rsa:4096 -keyout /home/ubuntu/cephtest/ca/root.key -days 365 -out /home/ubuntu/cephtest/ca/root.crt -subj /CN=teuthology 2024-06-04T15:52:28.349 INFO:teuthology.orchestra.run.smithi144.stderr:................+...+.+..+...+.+...+..+.+.....+.......+...+...+...........+...+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*........+...+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*.......+...+..+.........+.+..+.+...........+.........+.........+.+............+.........+......+........+.........+......+.+.........+.....+....+...+.........+...+...............+..........................+.+...........+.......+..+.+..+......+....+...........+......+.+............+..+..........+...........+...+...........................+..........+..+..........+......+..+.............+..+....+........+.+..+.......+...+..................+.....................+......+..+..................+.......+...+..+..................+............+...+....+...+......+......+.....+...............+......+..........+...+...........+.+..+.+...........+....+.........+.....+............+....+.....+......+.+....................+....+...+...............+...+.....+.............+.....+....+......+..+...+......+.+...+.....+.......+.........+....................+.+............+......+.........+...........+.+...+........+.......+...+..+.+............+..+..........+..+.+..............+.+........+......+...+............................+..+...............+.......+.....+....+...........+......+....+......+.....+.......+......+..+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ 2024-06-04T15:52:30.405 INFO:teuthology.orchestra.run.smithi144.stderr:.......+..............+.+..+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*....+.+.....+.+.....+....+.....+.+......+.....+...+....+...............+.....+.......+...+.....+...+...+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*......+........+...............+....+...............+........+.......+..+...+......+.......+...+......+........+...............+.+..+....+...............+...........+.........+.+.....+...............+..........+...+.....+.......+........+................+......+........+.......+...............+.........+........+.+............+........+.+...+......+.....................+.....+...+.......+...+...+............+..+......+...............+....+...+...+.....+...+....+.....+.............+.........+....................+......+.............+......+.......................+...+.......+............+.....+.+..............+.+........+......+...............+.....................+..........+..+..........+......+.....+.+...........+...+...............+...............+.......+..+.......+.....+...+.......+.........+..+...+.+........+................+.....+....+..+..........+.......................+...............+.+.........+...........+....+..+...+.........................+.......................+..........+..............+.............+...+.....+...+.+......+...+...........+.........+.+...+.....+...+.............+.........+.....................+.....+.......+.........+.........+......+......+........+.......+..+.............+...+...............+..............+.+..+.......+........+...+.+.........+......+........+...+............+..........+..................+............+.....+...+...+.........+......+.+...+...+.................+...+....+.....+.+.....+.........+.........+......+.+...+......+.......................+...+.........+...+............+........................+.......+........+........................+...+.......+.....+.+..+....+...............+......+..+............+.+.........+...........+.............+..+....+.....................+...+...........+.+...+.....+......+.........+................+.....+.+........+.........+...+...............+....+...........+..........+...+...........+...+.+......+...+...+.....+.............+.........+............+.....+......+.............+...........+...+.+......+.....+..................+......+.+......+.....+.......+...+..+................+..+....+.........+.........+..+...................+......+........................+..+.......+..+.+...+.........+........+...................+........+.......+........+......+.........+...+...+.+...+..................+..+...+............+.+......+........+.......+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ 2024-06-04T15:52:30.421 INFO:teuthology.orchestra.run.smithi144.stderr:----- 2024-06-04T15:52:30.450 DEBUG:teuthology.orchestra.run.smithi144:> sudo cp /home/ubuntu/cephtest/ca/root.crt /usr/share/pki/ca-trust-source/anchors/root.crt 2024-06-04T15:52:30.488 DEBUG:teuthology.orchestra.run.smithi144:> sudo update-ca-trust 2024-06-04T15:52:31.374 DEBUG:teuthology.orchestra.run.smithi144:> mkdir -p /home/ubuntu/cephtest/ca 2024-06-04T15:52:31.402 DEBUG:teuthology.orchestra.run.smithi144:> openssl req -nodes -newkey rsa:2048 -keyout /home/ubuntu/cephtest/ca/rgw.client.0.key -out /home/ubuntu/cephtest/ca/rgw.client.0.csr -subj /CN=smithi144.front.sepia.ceph.com 2024-06-04T15:52:31.748 INFO:teuthology.orchestra.run.smithi144.stderr:..+...+.+...+..+......+...+......+...+.+......+.....+...+...+.......+...+...+......+......+..+.+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*..+...+......+......+....+..+.......+..+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*.............+....................+..........+...+...+......+......+.....+.........+..........+...+...............+..+...+..........+..+.........+.+...+............+.........+.....+......+.+...+..+....+......+.....+....+...+...+...+..+...+.......+...+......+........+.......+......+..+...+....+........+.+...........+.........+.+.....+...+......+.......+.................+.+.........+.....+.+.....+.+...........+.........+...+............+....+.....+.+...+...+........+......+.+.....+............+.+..+....+...+...............+......+..+.......+..+.+........+.+......+...+......+...+...+..+...+...+.......+........+....+.................+................+...+......+.....+.........................+...+..+..........+...........+...+......+......+....+...........+.......+...+........+.+.....+....+...........+...............+.+........+.......+...+..+...+.........+.+..+....+...+.....+.+.........+......+.....+.+...+.....+.......+.....+........................+.+...........+.........+.+............+......+..+.......+...+.........+.....................+...+..+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ 2024-06-04T15:52:31.917 INFO:teuthology.orchestra.run.smithi144.stderr:...+......+...+.......+.....+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*....+...+..+......................+...+...+.....+......+...+.......+.........+.....+....+...+.....+...+...............+....+........+....+.....+...+.......+......+..+.+..+.........+....+.....+.........+..........+.....+...+...+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*........+....+......+.....+.......+..+.+.....+......+.........+..........+............+..+............+....+......+...+......+......+...+..............................+........+.......+......+...........+....+..+....+...+.....+......+..........+......+...+...+..+............+.+.....+....+.....+.+........+.+.........+...........+.+...+.........+..+...+...+.......+...+..+............+..........+.....+.+.........+...+.....+...+...+..........+.....+....+......+...........+...+...+....+......+..+.+.........+.....+.............+..+...+...+.+.....................+........+......+.+...+..+.......+..+.........+..........+............+........+......+....+...........+......+.......+......+.....+......+...+............+.........+.+...+...+........+.+...+......+............+...+......+......+............+..+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ 2024-06-04T15:52:31.920 INFO:teuthology.orchestra.run.smithi144.stderr:----- 2024-06-04T15:52:31.923 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-06-04T15:52:31.923 DEBUG:teuthology.orchestra.run.smithi144:> dd of=/home/ubuntu/cephtest/ca/rgw.client.0.ext 2024-06-04T15:52:31.992 DEBUG:teuthology.orchestra.run.smithi144:> openssl x509 -req -in /home/ubuntu/cephtest/ca/rgw.client.0.csr -CA /home/ubuntu/cephtest/ca/root.crt -CAkey /home/ubuntu/cephtest/ca/root.key -CAcreateserial -out /home/ubuntu/cephtest/ca/rgw.client.0.crt -days 365 -sha256 -extfile /home/ubuntu/cephtest/ca/rgw.client.0.ext 2024-06-04T15:52:32.085 INFO:teuthology.orchestra.run.smithi144.stderr:Certificate request self-signature ok 2024-06-04T15:52:32.086 INFO:teuthology.orchestra.run.smithi144.stderr:subject=CN = smithi144.front.sepia.ceph.com 2024-06-04T15:52:32.093 DEBUG:teuthology.orchestra.run.smithi144:> rm -f /home/ubuntu/cephtest/ca/rgw.client.0.csr /home/ubuntu/cephtest/ca/root.srl /home/ubuntu/cephtest/ca/rgw.client.0.ext 2024-06-04T15:52:32.121 DEBUG:teuthology.orchestra.run.smithi144:> openssl verify -CAfile /home/ubuntu/cephtest/ca/root.crt /home/ubuntu/cephtest/ca/rgw.client.0.crt 2024-06-04T15:52:32.194 INFO:teuthology.orchestra.run.smithi144.stdout:/home/ubuntu/cephtest/ca/rgw.client.0.crt: OK 2024-06-04T15:52:32.194 DEBUG:teuthology.orchestra.run.smithi144:> cat /home/ubuntu/cephtest/ca/rgw.client.0.key >> /home/ubuntu/cephtest/ca/rgw.client.0.crt 2024-06-04T15:52:32.264 INFO:teuthology.run_tasks:Running task rgw... 2024-06-04T15:52:32.277 DEBUG:tasks.rgw:config is {'client.0': {'ssl certificate': 'rgw.client.0'}} 2024-06-04T15:52:32.277 DEBUG:tasks.rgw:client list is dict_keys(['client.0']) 2024-06-04T15:52:32.278 INFO:tasks.rgw:Creating data pools 2024-06-04T15:52:32.278 DEBUG:tasks.rgw:Obtaining remote for client client.0 2024-06-04T15:52:32.278 DEBUG:teuthology.orchestra.run.smithi144:> sudo ceph osd erasure-code-profile set client.0 k=2 m=1 crush-failure-domain=osd --cluster ceph 2024-06-04T15:52:33.472 DEBUG:teuthology.orchestra.run.smithi144:> sudo ceph osd pool create default.rgw.buckets.data 64 64 erasure client.0 --cluster ceph 2024-06-04T15:52:35.457 INFO:teuthology.orchestra.run.smithi144.stderr:pool 'default.rgw.buckets.data' created 2024-06-04T15:52:35.485 DEBUG:teuthology.orchestra.run.smithi144:> sudo ceph osd pool application enable default.rgw.buckets.data rgw --cluster ceph 2024-06-04T15:52:36.458 INFO:teuthology.orchestra.run.smithi144.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.data' 2024-06-04T15:52:36.493 DEBUG:teuthology.orchestra.run.smithi144:> sudo ceph osd pool create default.rgw.buckets.index 64 64 --cluster ceph 2024-06-04T15:52:37.461 INFO:teuthology.orchestra.run.smithi144.stderr:pool 'default.rgw.buckets.index' created 2024-06-04T15:52:37.481 DEBUG:teuthology.orchestra.run.smithi144:> sudo ceph osd pool application enable default.rgw.buckets.index rgw --cluster ceph 2024-06-04T15:52:38.470 INFO:teuthology.orchestra.run.smithi144.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.index' 2024-06-04T15:52:38.499 DEBUG:tasks.rgw:Pools created 2024-06-04T15:52:38.499 INFO:tasks.rgw:Configuring compression type = random 2024-06-04T15:52:38.499 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'list'] 2024-06-04T15:52:38.499 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'list'] 2024-06-04T15:52:38.500 DEBUG:teuthology.orchestra.run.smithi144:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user list 2024-06-04T15:52:38.610 INFO:teuthology.orchestra.run.smithi144.stderr:ignoring --setuser ceph since I am not root 2024-06-04T15:52:38.610 INFO:teuthology.orchestra.run.smithi144.stderr:ignoring --setgroup ceph since I am not root 2024-06-04T15:52:40.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:40.717+0000 7fcda35ff640 0 -- 172.21.15.144:0/1852797474 >> [v2:172.21.15.177:6832/2645786330,v1:172.21.15.177:6833/2645786330] conn(0x7fcc78074bc0 msgr2=0x7fcc78077080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-06-04T15:52:40.722 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:40.722+0000 7fcda5b0a800 20 rados->read ofs=0 len=0 2024-06-04T15:52:40.723 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:40.723+0000 7fcda3e00640 0 -- 172.21.15.144:0/3892742276 >> [v2:172.21.15.177:6832/2645786330,v1:172.21.15.177:6833/2645786330] conn(0x7fcc68074cb0 msgr2=0x7fcc68077170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-06-04T15:52:40.724 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:40.724+0000 7fcda5b0a800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T15:52:40.725 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:40.724+0000 7fcda5b0a800 20 realm 2024-06-04T15:52:40.725 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:40.724+0000 7fcda5b0a800 20 rados->read ofs=0 len=0 2024-06-04T15:52:40.725 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:40.724+0000 7fcda5b0a800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T15:52:40.725 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:40.724+0000 7fcda5b0a800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-06-04T15:52:40.725 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:40.724+0000 7fcda5b0a800 20 rados->read ofs=0 len=0 2024-06-04T15:52:40.725 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:40.724+0000 7fcda5b0a800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T15:52:40.725 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:40.724+0000 7fcda5b0a800 20 rados->read ofs=0 len=0 2024-06-04T15:52:40.725 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:40.725+0000 7fcda5b0a800 20 rados_obj.operate() r=0 bl.length=46 2024-06-04T15:52:40.725 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:40.725+0000 7fcda5b0a800 20 rados->read ofs=0 len=0 2024-06-04T15:52:40.726 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:40.726+0000 7fcda5b0a800 20 rados_obj.operate() r=0 bl.length=993 2024-06-04T15:52:40.726 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:40.726+0000 7fcda5b0a800 20 searching for the correct realm 2024-06-04T15:52:40.739 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:40.738+0000 7fcda5b0a800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-06-04T15:52:40.739 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:40.738+0000 7fcda5b0a800 20 RGWRados::pool_iterate: got zone_info.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767 2024-06-04T15:52:40.739 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:40.738+0000 7fcda5b0a800 20 RGWRados::pool_iterate: got default.zone. 2024-06-04T15:52:40.739 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:40.738+0000 7fcda5b0a800 20 RGWRados::pool_iterate: got zonegroup_info.abb22408-c332-4e28-8f7a-ff254ea2fed2 2024-06-04T15:52:40.739 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:40.738+0000 7fcda5b0a800 20 RGWRados::pool_iterate: got zone_names.default 2024-06-04T15:52:40.739 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:40.738+0000 7fcda5b0a800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-06-04T15:52:40.739 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:40.738+0000 7fcda5b0a800 20 rados->read ofs=0 len=0 2024-06-04T15:52:40.739 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:40.738+0000 7fcda5b0a800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T15:52:40.739 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:40.738+0000 7fcda5b0a800 20 rados->read ofs=0 len=0 2024-06-04T15:52:40.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:40.739+0000 7fcda5b0a800 20 rados_obj.operate() r=0 bl.length=46 2024-06-04T15:52:40.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:40.739+0000 7fcda5b0a800 20 rados->read ofs=0 len=0 2024-06-04T15:52:40.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:40.740+0000 7fcda5b0a800 20 rados_obj.operate() r=0 bl.length=436 2024-06-04T15:52:40.741 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:40.740+0000 7fcda5b0a800 20 zone default found 2024-06-04T15:52:40.741 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:40.740+0000 7fcda5b0a800 4 Realm: () 2024-06-04T15:52:40.741 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:40.740+0000 7fcda5b0a800 4 ZoneGroup: default (abb22408-c332-4e28-8f7a-ff254ea2fed2) 2024-06-04T15:52:40.741 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:40.740+0000 7fcda5b0a800 4 Zone: default (be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767) 2024-06-04T15:52:40.741 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:40.740+0000 7fcda5b0a800 10 cannot find current period zonegroup using local zonegroup configuration 2024-06-04T15:52:40.741 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:40.740+0000 7fcda5b0a800 20 zonegroup default 2024-06-04T15:52:40.741 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:40.740+0000 7fcda5b0a800 20 rados->read ofs=0 len=0 2024-06-04T15:52:40.741 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:40.741+0000 7fcda5b0a800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T15:52:40.741 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:40.741+0000 7fcda5b0a800 20 rados->read ofs=0 len=0 2024-06-04T15:52:42.501 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:42.499+0000 7fcda5b0a800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T15:52:42.501 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:42.500+0000 7fcda5b0a800 20 rados->read ofs=0 len=0 2024-06-04T15:52:42.505 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:42.503+0000 7fcda5b0a800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T15:52:42.505 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:42.503+0000 7fcda5b0a800 20 started sync module instance, tier type = 2024-06-04T15:52:42.505 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:42.503+0000 7fcda5b0a800 20 started zone id=be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767 (name=default) with tier type = 2024-06-04T15:52:44.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.538+0000 7fcda5b0a800 20 add_watcher() i=0 2024-06-04T15:52:44.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.538+0000 7fcda5b0a800 20 add_watcher() i=1 2024-06-04T15:52:44.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.538+0000 7fcda5b0a800 20 add_watcher() i=2 2024-06-04T15:52:44.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.538+0000 7fcda5b0a800 20 add_watcher() i=3 2024-06-04T15:52:44.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.538+0000 7fcda5b0a800 20 add_watcher() i=4 2024-06-04T15:52:44.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.538+0000 7fcda5b0a800 20 add_watcher() i=5 2024-06-04T15:52:44.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.541+0000 7fcda5b0a800 20 add_watcher() i=6 2024-06-04T15:52:44.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.544+0000 7fcda5b0a800 20 add_watcher() i=7 2024-06-04T15:52:44.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.544+0000 7fcda5b0a800 2 all 8 watchers are set, enabling cache 2024-06-04T15:52:44.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.544+0000 7fcda5b0a800 5 tl::expected, obj_version>, boost::system::error_code> logback_generations::read(const DoutPrefixProvider*, optional_yield):410: oid=data_loggenerations_metadata not found 2024-06-04T15:52:44.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.544+0000 7fcda5b0a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.0 2024-06-04T15:52:44.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.544+0000 7fcda5b0a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-06-04T15:52:44.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.544+0000 7fcda5b0a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.0 does not exist 2024-06-04T15:52:44.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.544+0000 7fcda5b0a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.1 2024-06-04T15:52:44.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.544+0000 7fcda5b0a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-06-04T15:52:44.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.545+0000 7fcda5b0a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.1 does not exist 2024-06-04T15:52:44.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.545+0000 7fcda5b0a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.2 2024-06-04T15:52:44.547 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.545+0000 7fcda5b0a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-06-04T15:52:44.548 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.545+0000 7fcda5b0a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.2 does not exist 2024-06-04T15:52:44.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.545+0000 7fcda5b0a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.3 2024-06-04T15:52:44.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.545+0000 7fcda5b0a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-06-04T15:52:44.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.545+0000 7fcda5b0a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.3 does not exist 2024-06-04T15:52:44.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.545+0000 7fcda5b0a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.4 2024-06-04T15:52:44.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.545+0000 7fcda5b0a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-06-04T15:52:44.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.545+0000 7fcda5b0a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.4 does not exist 2024-06-04T15:52:44.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.545+0000 7fcda5b0a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.5 2024-06-04T15:52:44.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.545+0000 7fcda5b0a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-06-04T15:52:44.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.546+0000 7fcda5b0a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.5 does not exist 2024-06-04T15:52:44.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.546+0000 7fcda5b0a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.6 2024-06-04T15:52:44.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.546+0000 7fcda5b0a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-06-04T15:52:44.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.546+0000 7fcda5b0a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.6 does not exist 2024-06-04T15:52:44.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.546+0000 7fcda5b0a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.7 2024-06-04T15:52:44.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.546+0000 7fcda5b0a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-06-04T15:52:44.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.546+0000 7fcda5b0a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.7 does not exist 2024-06-04T15:52:44.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.546+0000 7fcda5b0a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.8 2024-06-04T15:52:44.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.546+0000 7fcda5b0a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-06-04T15:52:44.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.546+0000 7fcda5b0a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.8 does not exist 2024-06-04T15:52:44.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.546+0000 7fcda5b0a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.9 2024-06-04T15:52:44.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.546+0000 7fcda5b0a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-06-04T15:52:44.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.547+0000 7fcda5b0a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.9 does not exist 2024-06-04T15:52:44.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.547+0000 7fcda5b0a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.10 2024-06-04T15:52:44.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.547+0000 7fcda5b0a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-06-04T15:52:44.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.547+0000 7fcda5b0a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.10 does not exist 2024-06-04T15:52:44.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.547+0000 7fcda5b0a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.11 2024-06-04T15:52:44.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.547+0000 7fcda5b0a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-06-04T15:52:44.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.547+0000 7fcda5b0a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.11 does not exist 2024-06-04T15:52:44.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.547+0000 7fcda5b0a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.12 2024-06-04T15:52:44.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.547+0000 7fcda5b0a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-06-04T15:52:44.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.547+0000 7fcda5b0a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.12 does not exist 2024-06-04T15:52:44.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.547+0000 7fcda5b0a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.13 2024-06-04T15:52:44.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.547+0000 7fcda5b0a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-06-04T15:52:44.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.548+0000 7fcda5b0a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.13 does not exist 2024-06-04T15:52:44.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.548+0000 7fcda5b0a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.14 2024-06-04T15:52:44.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.548+0000 7fcda5b0a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-06-04T15:52:44.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.548+0000 7fcda5b0a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.14 does not exist 2024-06-04T15:52:44.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.548+0000 7fcda5b0a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.15 2024-06-04T15:52:44.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.548+0000 7fcda5b0a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-06-04T15:52:44.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.548+0000 7fcda5b0a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.15 does not exist 2024-06-04T15:52:44.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.548+0000 7fcda5b0a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.16 2024-06-04T15:52:44.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.548+0000 7fcda5b0a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-06-04T15:52:44.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.548+0000 7fcda5b0a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.16 does not exist 2024-06-04T15:52:44.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.548+0000 7fcda5b0a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.17 2024-06-04T15:52:44.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.548+0000 7fcda5b0a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-06-04T15:52:44.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.549+0000 7fcda5b0a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.17 does not exist 2024-06-04T15:52:44.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.549+0000 7fcda5b0a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.18 2024-06-04T15:52:44.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.549+0000 7fcda5b0a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-06-04T15:52:44.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.549+0000 7fcda5b0a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.18 does not exist 2024-06-04T15:52:44.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.549+0000 7fcda5b0a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.19 2024-06-04T15:52:44.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.549+0000 7fcda5b0a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-06-04T15:52:44.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.549+0000 7fcda5b0a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.19 does not exist 2024-06-04T15:52:44.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.549+0000 7fcda5b0a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.20 2024-06-04T15:52:44.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.549+0000 7fcda5b0a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-06-04T15:52:44.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.549+0000 7fcda5b0a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.20 does not exist 2024-06-04T15:52:44.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.549+0000 7fcda5b0a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.21 2024-06-04T15:52:44.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.549+0000 7fcda5b0a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-06-04T15:52:44.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.550+0000 7fcda5b0a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.21 does not exist 2024-06-04T15:52:44.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.550+0000 7fcda5b0a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.22 2024-06-04T15:52:44.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.550+0000 7fcda5b0a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-06-04T15:52:44.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.550+0000 7fcda5b0a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.22 does not exist 2024-06-04T15:52:44.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.550+0000 7fcda5b0a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.23 2024-06-04T15:52:44.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.550+0000 7fcda5b0a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-06-04T15:52:44.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.550+0000 7fcda5b0a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.23 does not exist 2024-06-04T15:52:44.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.550+0000 7fcda5b0a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.24 2024-06-04T15:52:44.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.550+0000 7fcda5b0a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-06-04T15:52:44.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.550+0000 7fcda5b0a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.24 does not exist 2024-06-04T15:52:44.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.550+0000 7fcda5b0a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.25 2024-06-04T15:52:44.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.550+0000 7fcda5b0a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-06-04T15:52:44.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.551+0000 7fcda5b0a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.25 does not exist 2024-06-04T15:52:44.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.551+0000 7fcda5b0a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.26 2024-06-04T15:52:44.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.551+0000 7fcda5b0a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-06-04T15:52:44.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.551+0000 7fcda5b0a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.26 does not exist 2024-06-04T15:52:44.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.551+0000 7fcda5b0a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.27 2024-06-04T15:52:44.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.551+0000 7fcda5b0a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-06-04T15:52:44.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.551+0000 7fcda5b0a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.27 does not exist 2024-06-04T15:52:44.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.551+0000 7fcda5b0a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.28 2024-06-04T15:52:44.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.551+0000 7fcda5b0a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-06-04T15:52:44.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.552+0000 7fcda5b0a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.28 does not exist 2024-06-04T15:52:44.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.552+0000 7fcda5b0a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.29 2024-06-04T15:52:44.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.552+0000 7fcda5b0a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-06-04T15:52:44.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.552+0000 7fcda5b0a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.29 does not exist 2024-06-04T15:52:44.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.552+0000 7fcda5b0a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.30 2024-06-04T15:52:44.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.552+0000 7fcda5b0a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-06-04T15:52:44.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.552+0000 7fcda5b0a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.30 does not exist 2024-06-04T15:52:44.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.552+0000 7fcda5b0a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.31 2024-06-04T15:52:44.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.552+0000 7fcda5b0a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-06-04T15:52:44.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.552+0000 7fcda5b0a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.31 does not exist 2024-06-04T15:52:44.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.552+0000 7fcda5b0a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.32 2024-06-04T15:52:44.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.552+0000 7fcda5b0a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-06-04T15:52:44.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.553+0000 7fcda5b0a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.32 does not exist 2024-06-04T15:52:44.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.553+0000 7fcda5b0a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.33 2024-06-04T15:52:44.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.553+0000 7fcda5b0a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-06-04T15:52:44.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.553+0000 7fcda5b0a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.33 does not exist 2024-06-04T15:52:44.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.553+0000 7fcda5b0a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.34 2024-06-04T15:52:44.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.553+0000 7fcda5b0a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-06-04T15:52:44.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.553+0000 7fcda5b0a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.34 does not exist 2024-06-04T15:52:44.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.553+0000 7fcda5b0a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.35 2024-06-04T15:52:44.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.553+0000 7fcda5b0a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-06-04T15:52:44.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.553+0000 7fcda5b0a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.35 does not exist 2024-06-04T15:52:44.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.553+0000 7fcda5b0a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.36 2024-06-04T15:52:44.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.553+0000 7fcda5b0a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-06-04T15:52:44.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.554+0000 7fcda5b0a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.36 does not exist 2024-06-04T15:52:44.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.554+0000 7fcda5b0a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.37 2024-06-04T15:52:44.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.554+0000 7fcda5b0a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-06-04T15:52:44.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.554+0000 7fcda5b0a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.37 does not exist 2024-06-04T15:52:44.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.554+0000 7fcda5b0a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.38 2024-06-04T15:52:44.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.554+0000 7fcda5b0a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-06-04T15:52:44.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.554+0000 7fcda5b0a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.38 does not exist 2024-06-04T15:52:44.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.554+0000 7fcda5b0a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.39 2024-06-04T15:52:44.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.554+0000 7fcda5b0a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-06-04T15:52:44.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.554+0000 7fcda5b0a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.39 does not exist 2024-06-04T15:52:44.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.554+0000 7fcda5b0a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.40 2024-06-04T15:52:44.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.554+0000 7fcda5b0a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-06-04T15:52:44.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.554+0000 7fcda5b0a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.40 does not exist 2024-06-04T15:52:44.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.554+0000 7fcda5b0a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.41 2024-06-04T15:52:44.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.554+0000 7fcda5b0a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-06-04T15:52:44.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.555+0000 7fcda5b0a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.41 does not exist 2024-06-04T15:52:44.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.555+0000 7fcda5b0a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.42 2024-06-04T15:52:44.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.555+0000 7fcda5b0a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-06-04T15:52:44.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.555+0000 7fcda5b0a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.42 does not exist 2024-06-04T15:52:44.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.555+0000 7fcda5b0a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.43 2024-06-04T15:52:44.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.555+0000 7fcda5b0a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-06-04T15:52:44.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.555+0000 7fcda5b0a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.43 does not exist 2024-06-04T15:52:44.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.555+0000 7fcda5b0a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.44 2024-06-04T15:52:44.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.555+0000 7fcda5b0a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-06-04T15:52:44.577 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.555+0000 7fcda5b0a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.44 does not exist 2024-06-04T15:52:44.577 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.555+0000 7fcda5b0a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.45 2024-06-04T15:52:44.577 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.555+0000 7fcda5b0a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-06-04T15:52:44.577 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.556+0000 7fcda5b0a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.45 does not exist 2024-06-04T15:52:44.577 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.556+0000 7fcda5b0a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.46 2024-06-04T15:52:44.578 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.556+0000 7fcda5b0a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-06-04T15:52:44.578 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.556+0000 7fcda5b0a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.46 does not exist 2024-06-04T15:52:44.578 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.556+0000 7fcda5b0a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.47 2024-06-04T15:52:44.578 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.556+0000 7fcda5b0a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-06-04T15:52:44.578 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.556+0000 7fcda5b0a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.47 does not exist 2024-06-04T15:52:44.578 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.556+0000 7fcda5b0a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.48 2024-06-04T15:52:44.578 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.556+0000 7fcda5b0a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-06-04T15:52:44.578 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.556+0000 7fcda5b0a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.48 does not exist 2024-06-04T15:52:44.578 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.556+0000 7fcda5b0a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.49 2024-06-04T15:52:44.578 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.556+0000 7fcda5b0a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-06-04T15:52:44.578 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.557+0000 7fcda5b0a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.49 does not exist 2024-06-04T15:52:44.578 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.557+0000 7fcda5b0a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.50 2024-06-04T15:52:44.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.557+0000 7fcda5b0a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-06-04T15:52:44.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.557+0000 7fcda5b0a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.50 does not exist 2024-06-04T15:52:44.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.557+0000 7fcda5b0a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.51 2024-06-04T15:52:44.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.557+0000 7fcda5b0a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-06-04T15:52:44.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.557+0000 7fcda5b0a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.51 does not exist 2024-06-04T15:52:44.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.557+0000 7fcda5b0a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.52 2024-06-04T15:52:44.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.557+0000 7fcda5b0a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-06-04T15:52:44.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.557+0000 7fcda5b0a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.52 does not exist 2024-06-04T15:52:44.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.557+0000 7fcda5b0a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.53 2024-06-04T15:52:44.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.557+0000 7fcda5b0a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-06-04T15:52:44.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.558+0000 7fcda5b0a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.53 does not exist 2024-06-04T15:52:44.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.558+0000 7fcda5b0a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.54 2024-06-04T15:52:44.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.558+0000 7fcda5b0a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-06-04T15:52:44.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.558+0000 7fcda5b0a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.54 does not exist 2024-06-04T15:52:44.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.558+0000 7fcda5b0a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.55 2024-06-04T15:52:44.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.558+0000 7fcda5b0a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-06-04T15:52:44.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.558+0000 7fcda5b0a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.55 does not exist 2024-06-04T15:52:44.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.558+0000 7fcda5b0a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.56 2024-06-04T15:52:44.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.558+0000 7fcda5b0a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-06-04T15:52:44.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.558+0000 7fcda5b0a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.56 does not exist 2024-06-04T15:52:44.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.558+0000 7fcda5b0a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.57 2024-06-04T15:52:44.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.558+0000 7fcda5b0a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-06-04T15:52:44.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.559+0000 7fcda5b0a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.57 does not exist 2024-06-04T15:52:44.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.559+0000 7fcda5b0a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.58 2024-06-04T15:52:44.581 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.559+0000 7fcda5b0a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-06-04T15:52:44.581 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.559+0000 7fcda5b0a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.58 does not exist 2024-06-04T15:52:44.581 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.559+0000 7fcda5b0a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.59 2024-06-04T15:52:44.581 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.559+0000 7fcda5b0a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-06-04T15:52:44.581 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.559+0000 7fcda5b0a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.59 does not exist 2024-06-04T15:52:44.581 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.559+0000 7fcda5b0a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.60 2024-06-04T15:52:44.581 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.559+0000 7fcda5b0a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-06-04T15:52:44.581 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.559+0000 7fcda5b0a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.60 does not exist 2024-06-04T15:52:44.581 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.559+0000 7fcda5b0a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.61 2024-06-04T15:52:44.581 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.559+0000 7fcda5b0a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-06-04T15:52:44.582 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.559+0000 7fcda5b0a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.61 does not exist 2024-06-04T15:52:44.582 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.559+0000 7fcda5b0a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.62 2024-06-04T15:52:44.582 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.559+0000 7fcda5b0a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-06-04T15:52:44.582 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.560+0000 7fcda5b0a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.62 does not exist 2024-06-04T15:52:44.582 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.560+0000 7fcda5b0a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.63 2024-06-04T15:52:44.582 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.560+0000 7fcda5b0a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-06-04T15:52:44.582 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.560+0000 7fcda5b0a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.63 does not exist 2024-06-04T15:52:44.582 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.560+0000 7fcda5b0a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.64 2024-06-04T15:52:44.582 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.560+0000 7fcda5b0a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-06-04T15:52:44.582 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.560+0000 7fcda5b0a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.64 does not exist 2024-06-04T15:52:44.582 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.560+0000 7fcda5b0a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.65 2024-06-04T15:52:44.582 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.560+0000 7fcda5b0a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-06-04T15:52:44.583 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.560+0000 7fcda5b0a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.65 does not exist 2024-06-04T15:52:44.583 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.560+0000 7fcda5b0a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.66 2024-06-04T15:52:44.583 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.560+0000 7fcda5b0a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-06-04T15:52:44.583 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.561+0000 7fcda5b0a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.66 does not exist 2024-06-04T15:52:44.583 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.561+0000 7fcda5b0a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.67 2024-06-04T15:52:44.583 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.561+0000 7fcda5b0a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-06-04T15:52:44.583 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.561+0000 7fcda5b0a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.67 does not exist 2024-06-04T15:52:44.583 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.561+0000 7fcda5b0a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.68 2024-06-04T15:52:44.583 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.561+0000 7fcda5b0a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-06-04T15:52:44.583 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.561+0000 7fcda5b0a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.68 does not exist 2024-06-04T15:52:44.583 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.561+0000 7fcda5b0a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.69 2024-06-04T15:52:44.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.561+0000 7fcda5b0a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-06-04T15:52:44.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.561+0000 7fcda5b0a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.69 does not exist 2024-06-04T15:52:44.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.561+0000 7fcda5b0a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.70 2024-06-04T15:52:44.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.561+0000 7fcda5b0a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-06-04T15:52:44.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.561+0000 7fcda5b0a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.70 does not exist 2024-06-04T15:52:44.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.561+0000 7fcda5b0a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.71 2024-06-04T15:52:44.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.561+0000 7fcda5b0a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-06-04T15:52:44.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.562+0000 7fcda5b0a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.71 does not exist 2024-06-04T15:52:44.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.562+0000 7fcda5b0a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.72 2024-06-04T15:52:44.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.562+0000 7fcda5b0a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-06-04T15:52:44.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.562+0000 7fcda5b0a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.72 does not exist 2024-06-04T15:52:44.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.562+0000 7fcda5b0a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.73 2024-06-04T15:52:44.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.562+0000 7fcda5b0a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-06-04T15:52:44.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.562+0000 7fcda5b0a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.73 does not exist 2024-06-04T15:52:44.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.562+0000 7fcda5b0a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.74 2024-06-04T15:52:44.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.562+0000 7fcda5b0a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-06-04T15:52:44.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.562+0000 7fcda5b0a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.74 does not exist 2024-06-04T15:52:44.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.562+0000 7fcda5b0a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.75 2024-06-04T15:52:44.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.562+0000 7fcda5b0a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-06-04T15:52:44.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.563+0000 7fcda5b0a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.75 does not exist 2024-06-04T15:52:44.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.563+0000 7fcda5b0a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.76 2024-06-04T15:52:44.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.563+0000 7fcda5b0a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-06-04T15:52:44.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.563+0000 7fcda5b0a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.76 does not exist 2024-06-04T15:52:44.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.563+0000 7fcda5b0a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.77 2024-06-04T15:52:44.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.563+0000 7fcda5b0a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-06-04T15:52:44.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.563+0000 7fcda5b0a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.77 does not exist 2024-06-04T15:52:44.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.563+0000 7fcda5b0a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.78 2024-06-04T15:52:44.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.563+0000 7fcda5b0a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-06-04T15:52:44.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.563+0000 7fcda5b0a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.78 does not exist 2024-06-04T15:52:44.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.563+0000 7fcda5b0a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.79 2024-06-04T15:52:44.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.563+0000 7fcda5b0a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-06-04T15:52:44.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.564+0000 7fcda5b0a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.79 does not exist 2024-06-04T15:52:44.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.564+0000 7fcda5b0a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.80 2024-06-04T15:52:44.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.564+0000 7fcda5b0a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-06-04T15:52:44.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.564+0000 7fcda5b0a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.80 does not exist 2024-06-04T15:52:44.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.564+0000 7fcda5b0a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.81 2024-06-04T15:52:44.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.564+0000 7fcda5b0a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-06-04T15:52:44.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.564+0000 7fcda5b0a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.81 does not exist 2024-06-04T15:52:44.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.564+0000 7fcda5b0a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.82 2024-06-04T15:52:44.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.564+0000 7fcda5b0a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-06-04T15:52:44.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.564+0000 7fcda5b0a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.82 does not exist 2024-06-04T15:52:44.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.564+0000 7fcda5b0a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.83 2024-06-04T15:52:44.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.564+0000 7fcda5b0a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-06-04T15:52:44.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.564+0000 7fcda5b0a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.83 does not exist 2024-06-04T15:52:44.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.564+0000 7fcda5b0a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.84 2024-06-04T15:52:44.588 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.564+0000 7fcda5b0a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-06-04T15:52:44.588 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.565+0000 7fcda5b0a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.84 does not exist 2024-06-04T15:52:44.588 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.565+0000 7fcda5b0a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.85 2024-06-04T15:52:44.588 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.565+0000 7fcda5b0a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-06-04T15:52:44.588 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.565+0000 7fcda5b0a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.85 does not exist 2024-06-04T15:52:44.588 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.565+0000 7fcda5b0a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.86 2024-06-04T15:52:44.588 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.565+0000 7fcda5b0a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-06-04T15:52:44.588 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.565+0000 7fcda5b0a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.86 does not exist 2024-06-04T15:52:44.588 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.565+0000 7fcda5b0a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.87 2024-06-04T15:52:44.588 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.565+0000 7fcda5b0a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-06-04T15:52:44.588 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.566+0000 7fcda5b0a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.87 does not exist 2024-06-04T15:52:44.588 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.566+0000 7fcda5b0a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.88 2024-06-04T15:52:44.588 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.566+0000 7fcda5b0a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-06-04T15:52:44.589 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.566+0000 7fcda5b0a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.88 does not exist 2024-06-04T15:52:44.589 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.566+0000 7fcda5b0a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.89 2024-06-04T15:52:44.589 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.566+0000 7fcda5b0a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-06-04T15:52:44.589 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.566+0000 7fcda5b0a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.89 does not exist 2024-06-04T15:52:44.589 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.566+0000 7fcda5b0a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.90 2024-06-04T15:52:44.589 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.566+0000 7fcda5b0a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-06-04T15:52:44.589 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.566+0000 7fcda5b0a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.90 does not exist 2024-06-04T15:52:44.589 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.566+0000 7fcda5b0a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.91 2024-06-04T15:52:44.589 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.566+0000 7fcda5b0a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-06-04T15:52:44.589 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.567+0000 7fcda5b0a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.91 does not exist 2024-06-04T15:52:44.589 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.567+0000 7fcda5b0a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.92 2024-06-04T15:52:44.589 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.567+0000 7fcda5b0a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-06-04T15:52:44.590 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.567+0000 7fcda5b0a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.92 does not exist 2024-06-04T15:52:44.590 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.567+0000 7fcda5b0a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.93 2024-06-04T15:52:44.590 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.567+0000 7fcda5b0a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-06-04T15:52:44.590 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.567+0000 7fcda5b0a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.93 does not exist 2024-06-04T15:52:44.590 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.567+0000 7fcda5b0a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.94 2024-06-04T15:52:44.590 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.567+0000 7fcda5b0a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-06-04T15:52:44.590 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.567+0000 7fcda5b0a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.94 does not exist 2024-06-04T15:52:44.590 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.567+0000 7fcda5b0a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.95 2024-06-04T15:52:44.590 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.567+0000 7fcda5b0a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-06-04T15:52:44.590 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.567+0000 7fcda5b0a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.95 does not exist 2024-06-04T15:52:44.590 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.567+0000 7fcda5b0a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.96 2024-06-04T15:52:44.590 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.567+0000 7fcda5b0a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-06-04T15:52:44.591 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.568+0000 7fcda5b0a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.96 does not exist 2024-06-04T15:52:44.591 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.568+0000 7fcda5b0a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.97 2024-06-04T15:52:44.591 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.568+0000 7fcda5b0a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-06-04T15:52:44.591 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.568+0000 7fcda5b0a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.97 does not exist 2024-06-04T15:52:44.591 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.568+0000 7fcda5b0a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.98 2024-06-04T15:52:44.591 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.568+0000 7fcda5b0a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-06-04T15:52:44.591 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.568+0000 7fcda5b0a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.98 does not exist 2024-06-04T15:52:44.591 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.568+0000 7fcda5b0a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.99 2024-06-04T15:52:44.591 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.568+0000 7fcda5b0a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-06-04T15:52:44.591 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.569+0000 7fcda5b0a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.99 does not exist 2024-06-04T15:52:44.591 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.569+0000 7fcda5b0a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.100 2024-06-04T15:52:44.591 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.569+0000 7fcda5b0a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-06-04T15:52:44.591 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.569+0000 7fcda5b0a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.100 does not exist 2024-06-04T15:52:44.591 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.569+0000 7fcda5b0a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.101 2024-06-04T15:52:44.591 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.569+0000 7fcda5b0a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-06-04T15:52:44.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.569+0000 7fcda5b0a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.101 does not exist 2024-06-04T15:52:44.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.569+0000 7fcda5b0a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.102 2024-06-04T15:52:44.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.569+0000 7fcda5b0a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-06-04T15:52:44.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.569+0000 7fcda5b0a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.102 does not exist 2024-06-04T15:52:44.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.569+0000 7fcda5b0a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.103 2024-06-04T15:52:44.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.569+0000 7fcda5b0a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-06-04T15:52:44.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.569+0000 7fcda5b0a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.103 does not exist 2024-06-04T15:52:44.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.569+0000 7fcda5b0a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.104 2024-06-04T15:52:44.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.569+0000 7fcda5b0a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-06-04T15:52:44.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.570+0000 7fcda5b0a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.104 does not exist 2024-06-04T15:52:44.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.570+0000 7fcda5b0a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.105 2024-06-04T15:52:44.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.570+0000 7fcda5b0a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-06-04T15:52:44.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.570+0000 7fcda5b0a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.105 does not exist 2024-06-04T15:52:44.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.570+0000 7fcda5b0a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.106 2024-06-04T15:52:44.593 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.570+0000 7fcda5b0a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-06-04T15:52:44.593 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.570+0000 7fcda5b0a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.106 does not exist 2024-06-04T15:52:44.593 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.570+0000 7fcda5b0a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.107 2024-06-04T15:52:44.593 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.570+0000 7fcda5b0a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-06-04T15:52:44.593 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.570+0000 7fcda5b0a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.107 does not exist 2024-06-04T15:52:44.593 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.570+0000 7fcda5b0a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.108 2024-06-04T15:52:44.593 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.570+0000 7fcda5b0a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-06-04T15:52:44.593 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.571+0000 7fcda5b0a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.108 does not exist 2024-06-04T15:52:44.593 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.571+0000 7fcda5b0a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.109 2024-06-04T15:52:44.593 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.571+0000 7fcda5b0a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-06-04T15:52:44.593 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.571+0000 7fcda5b0a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.109 does not exist 2024-06-04T15:52:44.593 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.571+0000 7fcda5b0a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.110 2024-06-04T15:52:44.593 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.571+0000 7fcda5b0a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-06-04T15:52:44.593 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.571+0000 7fcda5b0a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.110 does not exist 2024-06-04T15:52:44.594 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.571+0000 7fcda5b0a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.111 2024-06-04T15:52:44.594 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.571+0000 7fcda5b0a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-06-04T15:52:44.594 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.571+0000 7fcda5b0a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.111 does not exist 2024-06-04T15:52:44.594 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.571+0000 7fcda5b0a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.112 2024-06-04T15:52:44.594 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.571+0000 7fcda5b0a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-06-04T15:52:44.594 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.572+0000 7fcda5b0a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.112 does not exist 2024-06-04T15:52:44.594 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.572+0000 7fcda5b0a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.113 2024-06-04T15:52:44.594 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.572+0000 7fcda5b0a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-06-04T15:52:44.594 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.572+0000 7fcda5b0a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.113 does not exist 2024-06-04T15:52:44.594 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.572+0000 7fcda5b0a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.114 2024-06-04T15:52:44.594 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.572+0000 7fcda5b0a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-06-04T15:52:44.594 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.572+0000 7fcda5b0a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.114 does not exist 2024-06-04T15:52:44.594 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.572+0000 7fcda5b0a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.115 2024-06-04T15:52:44.595 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.572+0000 7fcda5b0a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-06-04T15:52:44.595 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.572+0000 7fcda5b0a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.115 does not exist 2024-06-04T15:52:44.595 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.572+0000 7fcda5b0a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.116 2024-06-04T15:52:44.595 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.572+0000 7fcda5b0a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-06-04T15:52:44.595 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.573+0000 7fcda5b0a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.116 does not exist 2024-06-04T15:52:44.595 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.573+0000 7fcda5b0a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.117 2024-06-04T15:52:44.595 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.573+0000 7fcda5b0a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-06-04T15:52:44.595 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.573+0000 7fcda5b0a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.117 does not exist 2024-06-04T15:52:44.595 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.573+0000 7fcda5b0a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.118 2024-06-04T15:52:44.595 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.573+0000 7fcda5b0a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-06-04T15:52:44.595 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.573+0000 7fcda5b0a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.118 does not exist 2024-06-04T15:52:44.595 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.573+0000 7fcda5b0a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.119 2024-06-04T15:52:44.596 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.573+0000 7fcda5b0a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-06-04T15:52:44.596 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.573+0000 7fcda5b0a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.119 does not exist 2024-06-04T15:52:44.596 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.573+0000 7fcda5b0a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.120 2024-06-04T15:52:44.596 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.573+0000 7fcda5b0a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-06-04T15:52:44.596 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.573+0000 7fcda5b0a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.120 does not exist 2024-06-04T15:52:44.596 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.574+0000 7fcda5b0a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.121 2024-06-04T15:52:44.596 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.574+0000 7fcda5b0a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-06-04T15:52:44.596 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.574+0000 7fcda5b0a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.121 does not exist 2024-06-04T15:52:44.596 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.574+0000 7fcda5b0a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.122 2024-06-04T15:52:44.596 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.574+0000 7fcda5b0a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-06-04T15:52:44.596 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.574+0000 7fcda5b0a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.122 does not exist 2024-06-04T15:52:44.596 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.574+0000 7fcda5b0a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.123 2024-06-04T15:52:44.596 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.574+0000 7fcda5b0a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-06-04T15:52:44.597 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.574+0000 7fcda5b0a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.123 does not exist 2024-06-04T15:52:44.597 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.574+0000 7fcda5b0a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.124 2024-06-04T15:52:44.597 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.574+0000 7fcda5b0a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-06-04T15:52:44.597 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.574+0000 7fcda5b0a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.124 does not exist 2024-06-04T15:52:44.597 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.574+0000 7fcda5b0a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.125 2024-06-04T15:52:44.597 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.574+0000 7fcda5b0a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-06-04T15:52:44.597 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.575+0000 7fcda5b0a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.125 does not exist 2024-06-04T15:52:44.597 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.575+0000 7fcda5b0a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.126 2024-06-04T15:52:44.597 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.575+0000 7fcda5b0a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-06-04T15:52:44.597 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.575+0000 7fcda5b0a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.126 does not exist 2024-06-04T15:52:44.597 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.575+0000 7fcda5b0a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.127 2024-06-04T15:52:44.597 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.575+0000 7fcda5b0a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-06-04T15:52:44.597 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.575+0000 7fcda5b0a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.127 does not exist 2024-06-04T15:52:44.598 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.575+0000 7fcda5b0a800 20 static int rgw::cls::fifo::FIFO::create(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, std::optional >, bool, uint64_t, uint64_t):1211 entering 2024-06-04T15:52:44.598 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.577+0000 7fcda5b0a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-06-04T15:52:44.598 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.580+0000 7fcc55fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-06-04T15:52:44.598 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.581+0000 7fcda5b0a800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-06-04T15:52:44.598 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:44.581+0000 7fcda5b0a800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-06-04T15:52:47.530 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:47.528+0000 7fcda5b0a800 10 rgw_init_ioctx warning: failed to set recovery_priority on default.rgw.meta 2024-06-04T15:52:47.530 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:47.528+0000 7fcda5b0a800 5 note: GC not initialized 2024-06-04T15:52:47.531 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:47.529+0000 7fcc54fe1640 20 reqs_thread_entry: start 2024-06-04T15:52:47.531 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:47.529+0000 7fcda5b0a800 20 init_complete bucket index max shards: 11 2024-06-04T15:52:47.531 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:47.529+0000 7fcda5b0a800 20 Filter name: none 2024-06-04T15:52:47.531 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:47.529+0000 7fcbbe7fc640 20 reqs_thread_entry: start 2024-06-04T15:52:47.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:47.562+0000 7fcc55fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-06-04T15:52:47.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:47.566+0000 7fcda5b0a800 20 remove_watcher() i=0 2024-06-04T15:52:47.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:47.566+0000 7fcda5b0a800 2 removed watcher, disabling cache 2024-06-04T15:52:47.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:47.567+0000 7fcda5b0a800 20 remove_watcher() i=1 2024-06-04T15:52:47.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:47.568+0000 7fcda5b0a800 20 remove_watcher() i=2 2024-06-04T15:52:47.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:47.570+0000 7fcda5b0a800 20 remove_watcher() i=3 2024-06-04T15:52:47.573 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:47.572+0000 7fcda5b0a800 20 remove_watcher() i=4 2024-06-04T15:52:47.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:47.574+0000 7fcda5b0a800 20 remove_watcher() i=5 2024-06-04T15:52:47.576 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:47.575+0000 7fcda5b0a800 20 remove_watcher() i=6 2024-06-04T15:52:47.577 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:47.576+0000 7fcda5b0a800 20 remove_watcher() i=7 2024-06-04T15:52:47.631 INFO:teuthology.orchestra.run.smithi144.stdout:[] 2024-06-04T15:52:47.631 DEBUG:tasks.util.rgw: json result: [] 2024-06-04T15:52:47.631 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--compression', 'random'] 2024-06-04T15:52:47.631 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--compression', 'random'] 2024-06-04T15:52:47.632 DEBUG:teuthology.orchestra.run.smithi144:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement modify --rgw-zone default --placement-id default-placement --compression random 2024-06-04T15:52:47.697 INFO:teuthology.orchestra.run.smithi144.stderr:ignoring --setuser ceph since I am not root 2024-06-04T15:52:47.698 INFO:teuthology.orchestra.run.smithi144.stderr:ignoring --setgroup ceph since I am not root 2024-06-04T15:52:47.724 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:47.723+0000 7f2d52a62800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-06-04T15:52:47.724 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:47.723+0000 7f2d52a62800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-06-04T15:52:47.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:47.726+0000 7f2bc67fc640 20 reqs_thread_entry: start 2024-06-04T15:52:47.743 INFO:teuthology.orchestra.run.smithi144.stdout:{"id":"be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":""} 2024-06-04T15:52:47.743 DEBUG:tasks.util.rgw: json result: {'id': 'be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data', 'compression_type': 'random'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': ''} 2024-06-04T15:52:47.744 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'list'] 2024-06-04T15:52:47.744 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'list'] 2024-06-04T15:52:47.744 DEBUG:teuthology.orchestra.run.smithi144:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user list 2024-06-04T15:52:47.799 INFO:teuthology.orchestra.run.smithi144.stderr:ignoring --setuser ceph since I am not root 2024-06-04T15:52:47.799 INFO:teuthology.orchestra.run.smithi144.stderr:ignoring --setgroup ceph since I am not root 2024-06-04T15:52:47.832 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:47.831+0000 7fc9fa527800 20 rados->read ofs=0 len=0 2024-06-04T15:52:47.836 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:47.833+0000 7fc9fa527800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T15:52:47.836 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:47.833+0000 7fc9fa527800 20 realm 2024-06-04T15:52:47.836 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:47.833+0000 7fc9fa527800 20 rados->read ofs=0 len=0 2024-06-04T15:52:47.836 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:47.833+0000 7fc9fa527800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T15:52:47.836 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:47.833+0000 7fc9fa527800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-06-04T15:52:47.836 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:47.833+0000 7fc9fa527800 20 rados->read ofs=0 len=0 2024-06-04T15:52:47.837 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:47.833+0000 7fc9fa527800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T15:52:47.837 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:47.833+0000 7fc9fa527800 20 rados->read ofs=0 len=0 2024-06-04T15:52:47.837 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:47.834+0000 7fc9fa527800 20 rados_obj.operate() r=0 bl.length=46 2024-06-04T15:52:47.837 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:47.834+0000 7fc9fa527800 20 rados->read ofs=0 len=0 2024-06-04T15:52:47.837 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:47.834+0000 7fc9fa527800 20 rados_obj.operate() r=0 bl.length=1009 2024-06-04T15:52:47.837 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:47.834+0000 7fc9fa527800 20 searching for the correct realm 2024-06-04T15:52:47.838 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:47.837+0000 7fc9f6ae2640 0 -- 172.21.15.144:0/883566663 >> [v2:172.21.15.144:6800/1453747520,v1:172.21.15.144:6801/1453747520] conn(0x7fc9ec056070 msgr2=0x7fc9ec08b940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-06-04T15:52:48.043 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:48.042+0000 7fc9f6ae2640 0 -- 172.21.15.144:0/883566663 >> [v2:172.21.15.144:6824/166159729,v1:172.21.15.144:6825/166159729] conn(0x560fdbf620d0 msgr2=0x560fdbf644c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-06-04T15:52:48.051 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:48.047+0000 7fc9fa527800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-06-04T15:52:48.051 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:48.047+0000 7fc9fa527800 20 RGWRados::pool_iterate: got zone_info.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767 2024-06-04T15:52:48.051 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:48.047+0000 7fc9fa527800 20 RGWRados::pool_iterate: got default.zone. 2024-06-04T15:52:48.051 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:48.047+0000 7fc9fa527800 20 RGWRados::pool_iterate: got zonegroup_info.abb22408-c332-4e28-8f7a-ff254ea2fed2 2024-06-04T15:52:48.052 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:48.047+0000 7fc9fa527800 20 RGWRados::pool_iterate: got zone_names.default 2024-06-04T15:52:48.052 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:48.047+0000 7fc9fa527800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-06-04T15:52:48.052 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:48.047+0000 7fc9fa527800 20 rados->read ofs=0 len=0 2024-06-04T15:52:48.052 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:48.047+0000 7fc9fa527800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T15:52:48.052 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:48.047+0000 7fc9fa527800 20 rados->read ofs=0 len=0 2024-06-04T15:52:48.052 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:48.048+0000 7fc9fa527800 20 rados_obj.operate() r=0 bl.length=46 2024-06-04T15:52:48.053 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:48.048+0000 7fc9fa527800 20 rados->read ofs=0 len=0 2024-06-04T15:52:48.053 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:48.048+0000 7fc9fa527800 20 rados_obj.operate() r=0 bl.length=436 2024-06-04T15:52:48.053 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:48.048+0000 7fc9fa527800 20 zone default found 2024-06-04T15:52:48.053 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:48.048+0000 7fc9fa527800 4 Realm: () 2024-06-04T15:52:48.053 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:48.048+0000 7fc9fa527800 4 ZoneGroup: default (abb22408-c332-4e28-8f7a-ff254ea2fed2) 2024-06-04T15:52:48.053 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:48.048+0000 7fc9fa527800 4 Zone: default (be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767) 2024-06-04T15:52:48.054 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:48.048+0000 7fc9fa527800 10 cannot find current period zonegroup using local zonegroup configuration 2024-06-04T15:52:48.054 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:48.048+0000 7fc9fa527800 20 zonegroup default 2024-06-04T15:52:48.054 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:48.048+0000 7fc9fa527800 20 rados->read ofs=0 len=0 2024-06-04T15:52:48.054 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:48.048+0000 7fc9fa527800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T15:52:48.054 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:48.049+0000 7fc9fa527800 20 rados->read ofs=0 len=0 2024-06-04T15:52:48.054 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:48.049+0000 7fc9fa527800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T15:52:48.055 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:48.049+0000 7fc9fa527800 20 rados->read ofs=0 len=0 2024-06-04T15:52:48.055 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:48.049+0000 7fc9fa527800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T15:52:48.055 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:48.049+0000 7fc9fa527800 20 started sync module instance, tier type = 2024-06-04T15:52:48.055 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:48.049+0000 7fc9fa527800 20 started zone id=be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767 (name=default) with tier type = 2024-06-04T15:52:48.070 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:48.070+0000 7fc9fa527800 20 add_watcher() i=0 2024-06-04T15:52:48.070 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:48.070+0000 7fc9fa527800 20 add_watcher() i=1 2024-06-04T15:52:48.070 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:48.070+0000 7fc9fa527800 20 add_watcher() i=2 2024-06-04T15:52:48.070 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:48.070+0000 7fc9fa527800 20 add_watcher() i=3 2024-06-04T15:52:48.070 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:48.070+0000 7fc9fa527800 20 add_watcher() i=4 2024-06-04T15:52:48.070 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:48.070+0000 7fc9fa527800 20 add_watcher() i=5 2024-06-04T15:52:48.071 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:48.070+0000 7fc9fa527800 20 add_watcher() i=6 2024-06-04T15:52:48.073 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:48.072+0000 7fc9fa527800 20 add_watcher() i=7 2024-06-04T15:52:48.073 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:48.072+0000 7fc9fa527800 2 all 8 watchers are set, enabling cache 2024-06-04T15:52:48.076 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:48.074+0000 7fc8acfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-06-04T15:52:48.076 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:48.074+0000 7fc9fa527800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-06-04T15:52:48.076 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:48.074+0000 7fc9fa527800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-06-04T15:52:48.076 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:48.074+0000 7fc9fa527800 5 note: GC not initialized 2024-06-04T15:52:48.076 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:48.074+0000 7fc8277fe640 20 reqs_thread_entry: start 2024-06-04T15:52:48.076 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:48.074+0000 7fc9fa527800 20 init_complete bucket index max shards: 11 2024-06-04T15:52:48.076 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:48.074+0000 7fc9fa527800 20 Filter name: none 2024-06-04T15:52:48.076 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:48.074+0000 7fc8257fa640 20 reqs_thread_entry: start 2024-06-04T15:52:48.085 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:48.084+0000 7fc8acfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-06-04T15:52:48.091 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:48.090+0000 7fc9fa527800 20 remove_watcher() i=0 2024-06-04T15:52:48.091 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:48.090+0000 7fc9fa527800 2 removed watcher, disabling cache 2024-06-04T15:52:48.092 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:48.091+0000 7fc9fa527800 20 remove_watcher() i=1 2024-06-04T15:52:48.095 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:48.094+0000 7fc9fa527800 20 remove_watcher() i=2 2024-06-04T15:52:48.096 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:48.095+0000 7fc9fa527800 20 remove_watcher() i=3 2024-06-04T15:52:48.099 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:48.098+0000 7fc9fa527800 20 remove_watcher() i=4 2024-06-04T15:52:48.100 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:48.099+0000 7fc9fa527800 20 remove_watcher() i=5 2024-06-04T15:52:48.103 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:48.102+0000 7fc9fa527800 20 remove_watcher() i=6 2024-06-04T15:52:48.106 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:48.105+0000 7fc9fa527800 20 remove_watcher() i=7 2024-06-04T15:52:48.116 INFO:teuthology.orchestra.run.smithi144.stdout:[] 2024-06-04T15:52:48.116 DEBUG:tasks.util.rgw: json result: [] 2024-06-04T15:52:48.117 INFO:tasks.rgw:Configuring storage class type = LUKEWARM 2024-06-04T15:52:48.117 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM'] 2024-06-04T15:52:48.117 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM'] 2024-06-04T15:52:48.117 DEBUG:teuthology.orchestra.run.smithi144:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zonegroup placement add --rgw-zone default --placement-id default-placement --storage-class LUKEWARM 2024-06-04T15:52:48.179 INFO:teuthology.orchestra.run.smithi144.stderr:ignoring --setuser ceph since I am not root 2024-06-04T15:52:48.179 INFO:teuthology.orchestra.run.smithi144.stderr:ignoring --setgroup ceph since I am not root 2024-06-04T15:52:48.204 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:48.203+0000 7fa35c12e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-06-04T15:52:48.205 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:48.203+0000 7fa35c12e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-06-04T15:52:48.208 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:48.207+0000 7fa2167fc640 20 reqs_thread_entry: start 2024-06-04T15:52:48.223 INFO:teuthology.orchestra.run.smithi144.stdout:[{"key":"default-placement","val":{"name":"default-placement","tags":[],"storage_classes":["LUKEWARM","STANDARD"]}}] 2024-06-04T15:52:48.223 DEBUG:tasks.util.rgw: json result: [{'key': 'default-placement', 'val': {'name': 'default-placement', 'tags': [], 'storage_classes': ['LUKEWARM', 'STANDARD']}}] 2024-06-04T15:52:48.224 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM', '--data-pool', 'default.rgw.buckets.data.lukewarm'] 2024-06-04T15:52:48.224 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM', '--data-pool', 'default.rgw.buckets.data.lukewarm'] 2024-06-04T15:52:48.224 DEBUG:teuthology.orchestra.run.smithi144:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement add --rgw-zone default --placement-id default-placement --storage-class LUKEWARM --data-pool default.rgw.buckets.data.lukewarm 2024-06-04T15:52:48.288 INFO:teuthology.orchestra.run.smithi144.stderr:ignoring --setuser ceph since I am not root 2024-06-04T15:52:48.288 INFO:teuthology.orchestra.run.smithi144.stderr:ignoring --setgroup ceph since I am not root 2024-06-04T15:52:48.314 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:48.312+0000 7fc9c4308800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-06-04T15:52:48.314 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:48.312+0000 7fc9c4308800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-06-04T15:52:48.317 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:48.316+0000 7fc7f7fff640 20 reqs_thread_entry: start 2024-06-04T15:52:48.333 INFO:teuthology.orchestra.run.smithi144.stdout:{"id":"be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"LUKEWARM":{"data_pool":"default.rgw.buckets.data.lukewarm"},"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":""} 2024-06-04T15:52:48.333 DEBUG:tasks.util.rgw: json result: {'id': 'be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'LUKEWARM': {'data_pool': 'default.rgw.buckets.data.lukewarm'}, 'STANDARD': {'data_pool': 'default.rgw.buckets.data', 'compression_type': 'random'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': ''} 2024-06-04T15:52:48.333 INFO:tasks.rgw:Configuring storage class type = FROZEN 2024-06-04T15:52:48.333 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN'] 2024-06-04T15:52:48.333 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN'] 2024-06-04T15:52:48.333 DEBUG:teuthology.orchestra.run.smithi144:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zonegroup placement add --rgw-zone default --placement-id default-placement --storage-class FROZEN 2024-06-04T15:52:48.396 INFO:teuthology.orchestra.run.smithi144.stderr:ignoring --setuser ceph since I am not root 2024-06-04T15:52:48.397 INFO:teuthology.orchestra.run.smithi144.stderr:ignoring --setgroup ceph since I am not root 2024-06-04T15:52:48.421 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:48.420+0000 7f77ff211800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-06-04T15:52:48.422 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:48.420+0000 7f77ff211800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-06-04T15:52:48.425 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:48.424+0000 7f76bd7e2640 20 reqs_thread_entry: start 2024-06-04T15:52:48.439 INFO:teuthology.orchestra.run.smithi144.stdout:[{"key":"default-placement","val":{"name":"default-placement","tags":[],"storage_classes":["FROZEN","LUKEWARM","STANDARD"]}}] 2024-06-04T15:52:48.440 DEBUG:tasks.util.rgw: json result: [{'key': 'default-placement', 'val': {'name': 'default-placement', 'tags': [], 'storage_classes': ['FROZEN', 'LUKEWARM', 'STANDARD']}}] 2024-06-04T15:52:48.440 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN', '--data-pool', 'default.rgw.buckets.data.frozen'] 2024-06-04T15:52:48.440 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN', '--data-pool', 'default.rgw.buckets.data.frozen'] 2024-06-04T15:52:48.440 DEBUG:teuthology.orchestra.run.smithi144:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement add --rgw-zone default --placement-id default-placement --storage-class FROZEN --data-pool default.rgw.buckets.data.frozen 2024-06-04T15:52:48.503 INFO:teuthology.orchestra.run.smithi144.stderr:ignoring --setuser ceph since I am not root 2024-06-04T15:52:48.503 INFO:teuthology.orchestra.run.smithi144.stderr:ignoring --setgroup ceph since I am not root 2024-06-04T15:52:48.528 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:48.527+0000 7fc1bed1f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-06-04T15:52:48.528 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:48.527+0000 7fc1bed1f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-06-04T15:52:48.531 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T15:52:48.530+0000 7fc07d7e2640 20 reqs_thread_entry: start 2024-06-04T15:52:48.549 INFO:teuthology.orchestra.run.smithi144.stdout:{"id":"be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"FROZEN":{"data_pool":"default.rgw.buckets.data.frozen"},"LUKEWARM":{"data_pool":"default.rgw.buckets.data.lukewarm"},"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":""} 2024-06-04T15:52:48.549 DEBUG:tasks.util.rgw: json result: {'id': 'be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'FROZEN': {'data_pool': 'default.rgw.buckets.data.frozen'}, 'LUKEWARM': {'data_pool': 'default.rgw.buckets.data.lukewarm'}, 'STANDARD': {'data_pool': 'default.rgw.buckets.data', 'compression_type': 'random'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': ''} 2024-06-04T15:52:48.549 INFO:tasks.rgw:Starting rgw... 2024-06-04T15:52:48.550 INFO:tasks.rgw:rgw client.0 config is {'ssl certificate': 'rgw.client.0'} 2024-06-04T15:52:48.550 INFO:tasks.rgw:Using beast as radosgw frontend 2024-06-04T15:52:48.550 DEBUG:teuthology.orchestra.run.smithi144:> sudo echo -n https://smithi144.front.sepia.ceph.com:443 | sudo tee /home/ubuntu/cephtest/url_file 2024-06-04T15:52:48.590 INFO:teuthology.orchestra.run.smithi144.stdout:https://smithi144.front.sepia.ceph.com:443 2024-06-04T15:52:48.590 DEBUG:teuthology.orchestra.run.smithi144:> sudo chown ceph /home/ubuntu/cephtest/url_file 2024-06-04T15:52:48.669 DEBUG:teuthology.orchestra.run.smithi144:> sudo keytool -import -alias smithi144.front.sepia.ceph.com -keystore $(readlink -e $(dirname $(readlink -e $(which keytool)))/../lib/security/cacerts) -file /home/ubuntu/cephtest/ca/rgw.client.0.crt -storepass changeit 2024-06-04T15:52:48.878 INFO:teuthology.orchestra.run.smithi144.stderr:Warning: use -cacerts option to access cacerts keystore 2024-06-04T15:52:49.011 INFO:teuthology.orchestra.run.smithi144.stderr:Certificate was added to keystore 2024-06-04T15:52:49.128 INFO:tasks.rgw.client.0:Restarting daemon 2024-06-04T15:52:49.128 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term radosgw --rgw-frontends 'beast ssl_certificate=/home/ubuntu/cephtest/ca/rgw.client.0.crt ssl_port=443' -n client.0 --cluster ceph -k /etc/ceph/ceph.client.0.keyring --log-file /var/log/ceph/rgw.ceph.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock --foreground | sudo tee /var/log/ceph/rgw.ceph.client.0.stdout 2>&1 2024-06-04T15:52:49.134 INFO:tasks.rgw.client.0:Started 2024-06-04T15:52:49.134 INFO:tasks.rgw:Polling client.0 until it starts accepting connections on https://smithi144.front.sepia.ceph.com:443/ 2024-06-04T15:52:49.134 DEBUG:teuthology.orchestra.run.smithi144:> curl https://smithi144.front.sepia.ceph.com:443/ 2024-06-04T15:52:49.176 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-06-04T15:52:49.176 INFO:teuthology.orchestra.run.smithi144.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-06-04T15:52:49.177 INFO:teuthology.orchestra.run.smithi144.stderr: Dload Upload Total Spent Left Speed 2024-06-04T15:52:49.177 INFO:teuthology.orchestra.run.smithi144.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-06-04T15:52:49.177 INFO:teuthology.orchestra.run.smithi144.stderr:curl: (7) Failed to connect to smithi144.front.sepia.ceph.com port 443: Connection refused 2024-06-04T15:52:49.596 INFO:tasks.rgw.client.0.smithi144.stdout:2024-06-04T15:52:49.594+0000 7fce8f432880 -1 ssl_private_key was not found: rgw/cert//default.key 2024-06-04T15:52:50.177 DEBUG:teuthology.orchestra.run.smithi144:> curl https://smithi144.front.sepia.ceph.com:443/ 2024-06-04T15:52:50.209 INFO:teuthology.orchestra.run.smithi144.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-06-04T15:52:50.210 INFO:teuthology.orchestra.run.smithi144.stderr: Dload Upload Total Spent Left Speed 2024-06-04T15:52:50.279 INFO:teuthology.orchestra.run.smithi144.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 187 0 187 0 0 2710 0 --:--:-- --:--:-- --:--:-- 2710 2024-06-04T15:52:50.280 INFO:teuthology.orchestra.run.smithi144.stdout:anonymous 2024-06-04T15:52:50.281 INFO:teuthology.run_tasks:Running task tox... 2024-06-04T15:52:50.292 INFO:tasks.tox:Deploying tox from pip... 2024-06-04T15:52:50.292 DEBUG:teuthology.orchestra.run.smithi144:> python3 -m venv /home/ubuntu/cephtest/tox-venv 2024-06-04T15:52:52.740 DEBUG:teuthology.orchestra.run.smithi144:> source /home/ubuntu/cephtest/tox-venv/bin/activate && pip install tox==3.15.0 2024-06-04T15:52:53.298 INFO:teuthology.orchestra.run.smithi144.stdout:Collecting tox==3.15.0 2024-06-04T15:52:53.375 INFO:teuthology.orchestra.run.smithi144.stdout: Downloading tox-3.15.0-py2.py3-none-any.whl (82 kB) 2024-06-04T15:52:53.533 INFO:teuthology.orchestra.run.smithi144.stdout:Collecting packaging>=14 2024-06-04T15:52:53.551 INFO:teuthology.orchestra.run.smithi144.stdout: Downloading packaging-24.0-py3-none-any.whl (53 kB) 2024-06-04T15:52:53.633 INFO:teuthology.orchestra.run.smithi144.stdout:Collecting toml>=0.9.4 2024-06-04T15:52:53.650 INFO:teuthology.orchestra.run.smithi144.stdout: Downloading toml-0.10.2-py2.py3-none-any.whl (16 kB) 2024-06-04T15:52:53.737 INFO:teuthology.orchestra.run.smithi144.stdout:Collecting pluggy<1,>=0.12.0 2024-06-04T15:52:53.754 INFO:teuthology.orchestra.run.smithi144.stdout: Downloading pluggy-0.13.1-py2.py3-none-any.whl (18 kB) 2024-06-04T15:52:54.043 INFO:teuthology.orchestra.run.smithi144.stdout:Collecting virtualenv!=20.0.0,!=20.0.1,!=20.0.2,!=20.0.3,!=20.0.4,!=20.0.5,!=20.0.6,!=20.0.7,>=16.0.0 2024-06-04T15:52:54.062 INFO:teuthology.orchestra.run.smithi144.stdout: Downloading virtualenv-20.26.2-py3-none-any.whl (3.9 MB) 2024-06-04T15:52:54.312 INFO:teuthology.orchestra.run.smithi144.stdout:Collecting py<2,>=1.4.17 2024-06-04T15:52:54.332 INFO:teuthology.orchestra.run.smithi144.stdout: Downloading py-1.11.0-py2.py3-none-any.whl (98 kB) 2024-06-04T15:52:54.467 INFO:teuthology.orchestra.run.smithi144.stdout:Collecting filelock<4,>=3.0.0 2024-06-04T15:52:54.484 INFO:teuthology.orchestra.run.smithi144.stdout: Downloading filelock-3.14.0-py3-none-any.whl (12 kB) 2024-06-04T15:52:54.561 INFO:teuthology.orchestra.run.smithi144.stdout:Collecting six<2,>=1.14.0 2024-06-04T15:52:54.578 INFO:teuthology.orchestra.run.smithi144.stdout: Downloading six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-06-04T15:52:54.702 INFO:teuthology.orchestra.run.smithi144.stdout:Collecting platformdirs<5,>=3.9.1 2024-06-04T15:52:54.719 INFO:teuthology.orchestra.run.smithi144.stdout: Downloading platformdirs-4.2.2-py3-none-any.whl (18 kB) 2024-06-04T15:52:54.799 INFO:teuthology.orchestra.run.smithi144.stdout:Collecting distlib<1,>=0.3.7 2024-06-04T15:52:54.815 INFO:teuthology.orchestra.run.smithi144.stdout: Downloading distlib-0.3.8-py2.py3-none-any.whl (468 kB) 2024-06-04T15:52:54.943 INFO:teuthology.orchestra.run.smithi144.stdout:Installing collected packages: platformdirs, filelock, distlib, virtualenv, toml, six, py, pluggy, packaging, tox 2024-06-04T15:52:55.772 INFO:teuthology.orchestra.run.smithi144.stdout:Successfully installed distlib-0.3.8 filelock-3.14.0 packaging-24.0 platformdirs-4.2.2 pluggy-0.13.1 py-1.11.0 six-1.16.0 toml-0.10.2 tox-3.15.0 virtualenv-20.26.2 2024-06-04T15:52:55.995 INFO:teuthology.orchestra.run.smithi144.stderr:WARNING: You are using pip version 21.3.1; however, version 24.0 is available. 2024-06-04T15:52:55.995 INFO:teuthology.orchestra.run.smithi144.stderr:You should consider upgrading via the '/home/ubuntu/cephtest/tox-venv/bin/python3 -m pip install --upgrade pip' command. 2024-06-04T15:52:56.056 INFO:teuthology.run_tasks:Running task workunit... 2024-06-04T15:52:56.069 INFO:tasks.workunit:Pulling workunits from ref 1fb5d10608dccee73edd6ef8a2c7b804a097c324 2024-06-04T15:52:56.070 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-06-04T15:52:56.070 DEBUG:teuthology.orchestra.run.smithi144:> stat -- /home/ubuntu/cephtest/mnt.0 2024-06-04T15:52:56.098 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-06-04T15:52:56.099 INFO:teuthology.orchestra.run.smithi144.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-06-04T15:52:56.099 DEBUG:teuthology.orchestra.run.smithi144:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-06-04T15:52:56.167 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-06-04T15:52:56.168 DEBUG:teuthology.orchestra.run.smithi144:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-06-04T15:52:56.236 INFO:tasks.workunit:timeout=3h 2024-06-04T15:52:56.236 INFO:tasks.workunit:cleanup=True 2024-06-04T15:52:56.237 DEBUG:teuthology.orchestra.run.smithi144:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 1fb5d10608dccee73edd6ef8a2c7b804a097c324 2024-06-04T15:52:56.304 INFO:tasks.workunit.client.0.smithi144.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-06-04T15:54:25.255 INFO:tasks.workunit.client.0.smithi144.stderr:Note: switching to '1fb5d10608dccee73edd6ef8a2c7b804a097c324'. 2024-06-04T15:54:25.256 INFO:tasks.workunit.client.0.smithi144.stderr: 2024-06-04T15:54:25.256 INFO:tasks.workunit.client.0.smithi144.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-06-04T15:54:25.256 INFO:tasks.workunit.client.0.smithi144.stderr:changes and commit them, and you can discard any commits you make in this 2024-06-04T15:54:25.256 INFO:tasks.workunit.client.0.smithi144.stderr:state without impacting any branches by switching back to a branch. 2024-06-04T15:54:25.256 INFO:tasks.workunit.client.0.smithi144.stderr: 2024-06-04T15:54:25.256 INFO:tasks.workunit.client.0.smithi144.stderr:If you want to create a new branch to retain commits you create, you may 2024-06-04T15:54:25.256 INFO:tasks.workunit.client.0.smithi144.stderr:do so (now or later) by using -c with the switch command. Example: 2024-06-04T15:54:25.256 INFO:tasks.workunit.client.0.smithi144.stderr: 2024-06-04T15:54:25.257 INFO:tasks.workunit.client.0.smithi144.stderr: git switch -c 2024-06-04T15:54:25.257 INFO:tasks.workunit.client.0.smithi144.stderr: 2024-06-04T15:54:25.257 INFO:tasks.workunit.client.0.smithi144.stderr:Or undo this operation with: 2024-06-04T15:54:25.257 INFO:tasks.workunit.client.0.smithi144.stderr: 2024-06-04T15:54:25.257 INFO:tasks.workunit.client.0.smithi144.stderr: git switch - 2024-06-04T15:54:25.257 INFO:tasks.workunit.client.0.smithi144.stderr: 2024-06-04T15:54:25.257 INFO:tasks.workunit.client.0.smithi144.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-06-04T15:54:25.257 INFO:tasks.workunit.client.0.smithi144.stderr: 2024-06-04T15:54:25.257 INFO:tasks.workunit.client.0.smithi144.stderr:HEAD is now at 1fb5d10608d Merge pull request #55565 from BBoozmen/oozmen_avoid_path_normalization 2024-06-04T15:54:25.258 DEBUG:teuthology.orchestra.run.smithi144:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-06-04T15:54:25.331 INFO:tasks.workunit.client.0.smithi144.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-06-04T15:54:25.333 INFO:tasks.workunit.client.0.smithi144.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-06-04T15:54:25.333 INFO:tasks.workunit.client.0.smithi144.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-06-04T15:54:25.943 INFO:tasks.workunit.client.0.smithi144.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-06-04T15:54:25.997 INFO:tasks.workunit.client.0.smithi144.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-06-04T15:54:26.036 INFO:tasks.workunit.client.0.smithi144.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-06-04T15:54:26.038 INFO:tasks.workunit.client.0.smithi144.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-06-04T15:54:26.038 INFO:tasks.workunit.client.0.smithi144.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-06-04T15:54:26.077 INFO:tasks.workunit.client.0.smithi144.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-06-04T15:54:26.080 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-06-04T15:54:26.080 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-06-04T15:54:26.150 INFO:tasks.workunit:Running workunits matching rgw/run-bucket-check.sh on client.0... 2024-06-04T15:54:26.151 INFO:tasks.workunit:Running workunit rgw/run-bucket-check.sh... 2024-06-04T15:54:26.151 DEBUG:teuthology.orchestra.run.smithi144:workunit test rgw/run-bucket-check.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1fb5d10608dccee73edd6ef8a2c7b804a097c324 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-bucket-check.sh 2024-06-04T15:54:26.223 INFO:tasks.workunit.client.0.smithi144.stderr:++ dirname /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-bucket-check.sh 2024-06-04T15:54:26.224 INFO:tasks.workunit.client.0.smithi144.stderr:+ mydir=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-06-04T15:54:26.224 INFO:tasks.workunit.client.0.smithi144.stderr:+ python3 -m venv /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-06-04T15:54:28.575 INFO:tasks.workunit.client.0.smithi144.stderr:+ source /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/activate 2024-06-04T15:54:28.576 INFO:tasks.workunit.client.0.smithi144.stderr:++ deactivate nondestructive 2024-06-04T15:54:28.576 INFO:tasks.workunit.client.0.smithi144.stderr:++ '[' -n '' ']' 2024-06-04T15:54:28.576 INFO:tasks.workunit.client.0.smithi144.stderr:++ '[' -n '' ']' 2024-06-04T15:54:28.576 INFO:tasks.workunit.client.0.smithi144.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-06-04T15:54:28.576 INFO:tasks.workunit.client.0.smithi144.stderr:++ hash -r 2024-06-04T15:54:28.576 INFO:tasks.workunit.client.0.smithi144.stderr:++ '[' -n '' ']' 2024-06-04T15:54:28.576 INFO:tasks.workunit.client.0.smithi144.stderr:++ unset VIRTUAL_ENV 2024-06-04T15:54:28.576 INFO:tasks.workunit.client.0.smithi144.stderr:++ '[' '!' nondestructive = nondestructive ']' 2024-06-04T15:54:28.576 INFO:tasks.workunit.client.0.smithi144.stderr:++ VIRTUAL_ENV=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-06-04T15:54:28.576 INFO:tasks.workunit.client.0.smithi144.stderr:++ export VIRTUAL_ENV 2024-06-04T15:54:28.577 INFO:tasks.workunit.client.0.smithi144.stderr:++ _OLD_VIRTUAL_PATH=/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-06-04T15:54:28.578 INFO:tasks.workunit.client.0.smithi144.stderr:++ PATH=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-06-04T15:54:28.578 INFO:tasks.workunit.client.0.smithi144.stderr:++ export PATH 2024-06-04T15:54:28.578 INFO:tasks.workunit.client.0.smithi144.stderr:++ '[' -n '' ']' 2024-06-04T15:54:28.578 INFO:tasks.workunit.client.0.smithi144.stderr:++ '[' -z '' ']' 2024-06-04T15:54:28.578 INFO:tasks.workunit.client.0.smithi144.stderr:++ _OLD_VIRTUAL_PS1= 2024-06-04T15:54:28.578 INFO:tasks.workunit.client.0.smithi144.stderr:++ PS1='(rgw) ' 2024-06-04T15:54:28.578 INFO:tasks.workunit.client.0.smithi144.stderr:++ export PS1 2024-06-04T15:54:28.578 INFO:tasks.workunit.client.0.smithi144.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-06-04T15:54:28.578 INFO:tasks.workunit.client.0.smithi144.stderr:++ hash -r 2024-06-04T15:54:28.578 INFO:tasks.workunit.client.0.smithi144.stderr:+ pip install pip --upgrade 2024-06-04T15:54:28.806 INFO:tasks.workunit.client.0.smithi144.stdout:Requirement already satisfied: pip in /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.9/site-packages (21.3.1) 2024-06-04T15:54:29.019 INFO:tasks.workunit.client.0.smithi144.stdout:Collecting pip 2024-06-04T15:54:29.102 INFO:tasks.workunit.client.0.smithi144.stdout: Downloading pip-24.0-py3-none-any.whl (2.1 MB) 2024-06-04T15:54:29.309 INFO:tasks.workunit.client.0.smithi144.stdout:Installing collected packages: pip 2024-06-04T15:54:29.310 INFO:tasks.workunit.client.0.smithi144.stdout: Attempting uninstall: pip 2024-06-04T15:54:29.310 INFO:tasks.workunit.client.0.smithi144.stdout: Found existing installation: pip 21.3.1 2024-06-04T15:54:29.466 INFO:tasks.workunit.client.0.smithi144.stdout: Uninstalling pip-21.3.1: 2024-06-04T15:54:29.496 INFO:tasks.workunit.client.0.smithi144.stdout: Successfully uninstalled pip-21.3.1 2024-06-04T15:54:30.459 INFO:tasks.workunit.client.0.smithi144.stdout:Successfully installed pip-24.0 2024-06-04T15:54:30.740 INFO:tasks.workunit.client.0.smithi144.stderr:+ pip install boto3 2024-06-04T15:54:31.677 INFO:tasks.workunit.client.0.smithi144.stdout:Collecting boto3 2024-06-04T15:54:31.753 INFO:tasks.workunit.client.0.smithi144.stdout: Downloading boto3-1.34.118-py3-none-any.whl.metadata (6.6 kB) 2024-06-04T15:54:32.391 INFO:tasks.workunit.client.0.smithi144.stdout:Collecting botocore<1.35.0,>=1.34.118 (from boto3) 2024-06-04T15:54:32.408 INFO:tasks.workunit.client.0.smithi144.stdout: Downloading botocore-1.34.118-py3-none-any.whl.metadata (5.7 kB) 2024-06-04T15:54:32.553 INFO:tasks.workunit.client.0.smithi144.stdout:Collecting jmespath<2.0.0,>=0.7.1 (from boto3) 2024-06-04T15:54:32.570 INFO:tasks.workunit.client.0.smithi144.stdout: Downloading jmespath-1.0.1-py3-none-any.whl.metadata (7.6 kB) 2024-06-04T15:54:32.702 INFO:tasks.workunit.client.0.smithi144.stdout:Collecting s3transfer<0.11.0,>=0.10.0 (from boto3) 2024-06-04T15:54:32.718 INFO:tasks.workunit.client.0.smithi144.stdout: Downloading s3transfer-0.10.1-py3-none-any.whl.metadata (1.7 kB) 2024-06-04T15:54:32.861 INFO:tasks.workunit.client.0.smithi144.stdout:Collecting python-dateutil<3.0.0,>=2.1 (from botocore<1.35.0,>=1.34.118->boto3) 2024-06-04T15:54:32.878 INFO:tasks.workunit.client.0.smithi144.stdout: Downloading python_dateutil-2.9.0.post0-py2.py3-none-any.whl.metadata (8.4 kB) 2024-06-04T15:54:33.037 INFO:tasks.workunit.client.0.smithi144.stdout:Collecting urllib3<1.27,>=1.25.4 (from botocore<1.35.0,>=1.34.118->boto3) 2024-06-04T15:54:33.055 INFO:tasks.workunit.client.0.smithi144.stdout: Downloading urllib3-1.26.18-py2.py3-none-any.whl.metadata (48 kB) 2024-06-04T15:54:33.124 INFO:tasks.workunit.client.0.smithi144.stdout: ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 48.9/48.9 kB 593.4 kB/s eta 0:00:00 2024-06-04T15:54:33.318 INFO:tasks.workunit.client.0.smithi144.stdout:Collecting six>=1.5 (from python-dateutil<3.0.0,>=2.1->botocore<1.35.0,>=1.34.118->boto3) 2024-06-04T15:54:33.335 INFO:tasks.workunit.client.0.smithi144.stdout: Downloading six-1.16.0-py2.py3-none-any.whl.metadata (1.8 kB) 2024-06-04T15:54:33.420 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading boto3-1.34.118-py3-none-any.whl (139 kB) 2024-06-04T15:54:33.492 INFO:tasks.workunit.client.0.smithi144.stdout: ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 139.3/139.3 kB 1.8 MB/s eta 0:00:00 2024-06-04T15:54:33.512 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading botocore-1.34.118-py3-none-any.whl (12.3 MB) 2024-06-04T15:54:33.769 INFO:tasks.workunit.client.0.smithi144.stdout: ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 12.3/12.3 MB 49.8 MB/s eta 0:00:00 2024-06-04T15:54:33.795 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading jmespath-1.0.1-py3-none-any.whl (20 kB) 2024-06-04T15:54:33.855 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading s3transfer-0.10.1-py3-none-any.whl (82 kB) 2024-06-04T15:54:33.911 INFO:tasks.workunit.client.0.smithi144.stdout: ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 82.2/82.2 kB 1.3 MB/s eta 0:00:00 2024-06-04T15:54:33.927 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading python_dateutil-2.9.0.post0-py2.py3-none-any.whl (229 kB) 2024-06-04T15:54:33.986 INFO:tasks.workunit.client.0.smithi144.stdout: ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 229.9/229.9 kB 3.9 MB/s eta 0:00:00 2024-06-04T15:54:34.008 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading urllib3-1.26.18-py2.py3-none-any.whl (143 kB) 2024-06-04T15:54:34.062 INFO:tasks.workunit.client.0.smithi144.stdout: ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 143.8/143.8 kB 2.6 MB/s eta 0:00:00 2024-06-04T15:54:34.092 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-06-04T15:54:34.249 INFO:tasks.workunit.client.0.smithi144.stdout:Installing collected packages: urllib3, six, jmespath, python-dateutil, botocore, s3transfer, boto3 2024-06-04T15:54:35.331 INFO:tasks.workunit.client.0.smithi144.stdout:Successfully installed boto3-1.34.118 botocore-1.34.118 jmespath-1.0.1 python-dateutil-2.9.0.post0 s3transfer-0.10.1 six-1.16.0 urllib3-1.26.18 2024-06-04T15:54:35.481 INFO:tasks.workunit.client.0.smithi144.stderr:+ /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/python3 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_bucket_check.py 2024-06-04T15:54:35.616 INFO:tasks.workunit.client.0.smithi144.stderr:radosgw-admin user create --uid check-tester --display-name "Check Testing" --access-key OJODXSLNX4LUNHQG99PA --secret 3l6ffld34qaymfomuh832j94738aie2x4p2o8h6n 2024-06-04T15:54:35.649 INFO:tasks.workunit.client.0.smithi144.stderr:ignoring --setuser ceph since I am not root 2024-06-04T15:54:35.649 INFO:tasks.workunit.client.0.smithi144.stderr:ignoring --setgroup ceph since I am not root 2024-06-04T15:54:35.687 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:35.687+0000 7f5f75331800 20 rados->read ofs=0 len=0 2024-06-04T15:54:35.689 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:35.689+0000 7f5f75331800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T15:54:35.689 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:35.689+0000 7f5f75331800 20 realm 2024-06-04T15:54:35.689 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:35.689+0000 7f5f75331800 20 rados->read ofs=0 len=0 2024-06-04T15:54:35.689 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:35.689+0000 7f5f75331800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T15:54:35.689 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:35.689+0000 7f5f75331800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-06-04T15:54:35.689 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:35.689+0000 7f5f75331800 20 rados->read ofs=0 len=0 2024-06-04T15:54:35.690 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:35.689+0000 7f5f75331800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T15:54:35.690 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:35.689+0000 7f5f75331800 20 rados->read ofs=0 len=0 2024-06-04T15:54:35.690 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:35.690+0000 7f5f75331800 20 rados_obj.operate() r=0 bl.length=46 2024-06-04T15:54:35.690 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:35.690+0000 7f5f75331800 20 rados->read ofs=0 len=0 2024-06-04T15:54:35.691 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:35.690+0000 7f5f75331800 20 rados_obj.operate() r=0 bl.length=1139 2024-06-04T15:54:35.691 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:35.690+0000 7f5f75331800 20 searching for the correct realm 2024-06-04T15:54:35.692 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:35.692+0000 7f5f717ec640 0 -- 172.21.15.144:0/4263151794 >> [v2:172.21.15.144:6800/1453747520,v1:172.21.15.144:6801/1453747520] conn(0x7f5f640cb070 msgr2=0x7f5f640a04f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-06-04T15:54:35.897 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:35.897+0000 7f5f717ec640 0 -- 172.21.15.144:0/4263151794 >> [v2:172.21.15.144:6824/166159729,v1:172.21.15.144:6825/166159729] conn(0x55df08599d10 msgr2=0x55df0859c100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-06-04T15:54:35.903 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:35.902+0000 7f5f75331800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-06-04T15:54:35.903 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:35.902+0000 7f5f75331800 20 RGWRados::pool_iterate: got zone_info.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767 2024-06-04T15:54:35.903 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:35.902+0000 7f5f75331800 20 RGWRados::pool_iterate: got default.zone. 2024-06-04T15:54:35.903 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:35.902+0000 7f5f75331800 20 RGWRados::pool_iterate: got zonegroup_info.abb22408-c332-4e28-8f7a-ff254ea2fed2 2024-06-04T15:54:35.903 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:35.902+0000 7f5f75331800 20 RGWRados::pool_iterate: got zone_names.default 2024-06-04T15:54:35.903 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:35.902+0000 7f5f75331800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-06-04T15:54:35.903 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:35.902+0000 7f5f75331800 20 rados->read ofs=0 len=0 2024-06-04T15:54:35.903 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:35.903+0000 7f5f75331800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T15:54:35.903 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:35.903+0000 7f5f75331800 20 rados->read ofs=0 len=0 2024-06-04T15:54:35.904 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:35.903+0000 7f5f75331800 20 rados_obj.operate() r=0 bl.length=46 2024-06-04T15:54:35.904 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:35.903+0000 7f5f75331800 20 rados->read ofs=0 len=0 2024-06-04T15:54:35.905 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:35.903+0000 7f5f75331800 20 rados_obj.operate() r=0 bl.length=470 2024-06-04T15:54:35.905 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:35.903+0000 7f5f75331800 20 zone default found 2024-06-04T15:54:35.905 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:35.903+0000 7f5f75331800 4 Realm: () 2024-06-04T15:54:35.905 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:35.903+0000 7f5f75331800 4 ZoneGroup: default (abb22408-c332-4e28-8f7a-ff254ea2fed2) 2024-06-04T15:54:35.905 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:35.903+0000 7f5f75331800 4 Zone: default (be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767) 2024-06-04T15:54:35.905 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:35.903+0000 7f5f75331800 10 cannot find current period zonegroup using local zonegroup configuration 2024-06-04T15:54:35.905 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:35.903+0000 7f5f75331800 20 zonegroup default 2024-06-04T15:54:35.905 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:35.903+0000 7f5f75331800 20 rados->read ofs=0 len=0 2024-06-04T15:54:35.905 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:35.904+0000 7f5f75331800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T15:54:35.905 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:35.904+0000 7f5f75331800 20 rados->read ofs=0 len=0 2024-06-04T15:54:35.905 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:35.904+0000 7f5f75331800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T15:54:35.905 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:35.904+0000 7f5f75331800 20 rados->read ofs=0 len=0 2024-06-04T15:54:35.905 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:35.904+0000 7f5f75331800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T15:54:35.906 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:35.904+0000 7f5f75331800 20 started sync module instance, tier type = 2024-06-04T15:54:35.906 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:35.904+0000 7f5f75331800 20 started zone id=be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767 (name=default) with tier type = 2024-06-04T15:54:35.919 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:35.919+0000 7f5f75331800 20 add_watcher() i=0 2024-06-04T15:54:35.919 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:35.919+0000 7f5f75331800 20 add_watcher() i=1 2024-06-04T15:54:35.919 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:35.919+0000 7f5f75331800 20 add_watcher() i=2 2024-06-04T15:54:35.919 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:35.919+0000 7f5f75331800 20 add_watcher() i=3 2024-06-04T15:54:35.920 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:35.919+0000 7f5f75331800 20 add_watcher() i=4 2024-06-04T15:54:35.920 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:35.919+0000 7f5f75331800 20 add_watcher() i=5 2024-06-04T15:54:35.920 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:35.919+0000 7f5f75331800 20 add_watcher() i=6 2024-06-04T15:54:35.920 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:35.920+0000 7f5f75331800 20 add_watcher() i=7 2024-06-04T15:54:35.920 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:35.920+0000 7f5f75331800 2 all 8 watchers are set, enabling cache 2024-06-04T15:54:35.923 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:35.922+0000 7f5e26fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-06-04T15:54:35.923 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:35.922+0000 7f5f75331800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-06-04T15:54:35.923 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:35.922+0000 7f5f75331800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-06-04T15:54:35.923 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:35.922+0000 7f5f75331800 5 note: GC not initialized 2024-06-04T15:54:35.923 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:35.923+0000 7f5e25fe3640 20 reqs_thread_entry: start 2024-06-04T15:54:35.924 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:35.923+0000 7f5f75331800 20 init_complete bucket index max shards: 11 2024-06-04T15:54:35.924 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:35.923+0000 7f5f75331800 20 Filter name: none 2024-06-04T15:54:35.924 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:35.923+0000 7f5d977fe640 20 reqs_thread_entry: start 2024-06-04T15:54:35.924 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:35.923+0000 7f5f75331800 10 cache get: name=default.rgw.meta+users.uid+check-tester : miss 2024-06-04T15:54:35.924 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:35.923+0000 7f5f75331800 20 rados->read ofs=0 len=0 2024-06-04T15:54:35.924 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:35.923+0000 7f5f75331800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T15:54:35.924 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:35.923+0000 7f5f75331800 10 cache put: name=default.rgw.meta+users.uid+check-tester info.flags=0x0 2024-06-04T15:54:35.924 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:35.923+0000 7f5f75331800 10 adding default.rgw.meta+users.uid+check-tester to cache LRU end 2024-06-04T15:54:35.924 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:35.923+0000 7f5f75331800 10 cache get: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA : miss 2024-06-04T15:54:35.924 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:35.923+0000 7f5f75331800 20 rados->read ofs=0 len=0 2024-06-04T15:54:35.925 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:35.923+0000 7f5f75331800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T15:54:35.925 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:35.923+0000 7f5f75331800 10 cache put: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA info.flags=0x0 2024-06-04T15:54:35.925 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:35.923+0000 7f5f75331800 10 adding default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA to cache LRU end 2024-06-04T15:54:35.926 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:35.923+0000 7f5f75331800 10 cache get: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA : hit (negative entry) 2024-06-04T15:54:35.926 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:35.923+0000 7f5f75331800 10 cache get: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA : hit (negative entry) 2024-06-04T15:54:35.926 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:35.924+0000 7f5f75331800 10 cache put: name=default.rgw.meta+users.uid+check-tester info.flags=0x17 2024-06-04T15:54:35.926 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:35.924+0000 7f5f75331800 10 moving default.rgw.meta+users.uid+check-tester to cache LRU end 2024-06-04T15:54:35.926 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:35.924+0000 7f5f75331800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.uid:check-tester, ofs0, ns] 2024-06-04T15:54:35.926 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:35.925+0000 7f5e47fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855360 cookie 94416406194048 notifier 4514 bl.length()=593 2024-06-04T15:54:35.926 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:35.925+0000 7f5e47fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+check-tester info.flags=0x17 2024-06-04T15:54:35.926 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:35.925+0000 7f5e47fff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+check-tester to cache LRU end 2024-06-04T15:54:35.927 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:35.927+0000 7f5f75331800 10 cache put: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA info.flags=0x7 2024-06-04T15:54:35.927 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:35.927+0000 7f5f75331800 10 moving default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA to cache LRU end 2024-06-04T15:54:35.927 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:35.927+0000 7f5f75331800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.keys:OJODXSLNX4LUNHQG99PA, ofs0, ns] 2024-06-04T15:54:35.927 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:35.927+0000 7f5e47fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855360 cookie 94416406166464 notifier 4514 bl.length()=186 2024-06-04T15:54:35.927 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:35.927+0000 7f5e47fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA info.flags=0x7 2024-06-04T15:54:35.927 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:35.927+0000 7f5e47fff640 10 rgw watcher librados: moving default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA to cache LRU end 2024-06-04T15:54:35.928 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:35.928+0000 7f5e26fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-06-04T15:54:35.930 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:35.930+0000 7f5f75331800 20 remove_watcher() i=0 2024-06-04T15:54:35.930 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:35.930+0000 7f5f75331800 2 removed watcher, disabling cache 2024-06-04T15:54:35.931 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:35.931+0000 7f5f75331800 20 remove_watcher() i=1 2024-06-04T15:54:35.933 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:35.933+0000 7f5f75331800 20 remove_watcher() i=2 2024-06-04T15:54:35.934 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:35.934+0000 7f5f75331800 20 remove_watcher() i=3 2024-06-04T15:54:35.935 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:35.935+0000 7f5f75331800 20 remove_watcher() i=4 2024-06-04T15:54:35.936 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:35.936+0000 7f5f75331800 20 remove_watcher() i=5 2024-06-04T15:54:35.937 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:35.937+0000 7f5f75331800 20 remove_watcher() i=6 2024-06-04T15:54:35.938 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:35.938+0000 7f5f75331800 20 remove_watcher() i=7 2024-06-04T15:54:36.097 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T15:54:36.097 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T15:54:36.143 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T15:54:36.143 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T15:54:36.190 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T15:54:36.190 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T15:54:36.210 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T15:54:36.211 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T15:54:36.220 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T15:54:36.220 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T15:54:36.223 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T15:54:36.223 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T15:54:36.232 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T15:54:36.233 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T15:54:36.236 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T15:54:36.236 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T15:54:36.240 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T15:54:36.240 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T15:54:36.254 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T15:54:36.255 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T15:54:36.258 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T15:54:36.258 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T15:54:36.275 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T15:54:36.275 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T15:54:36.278 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T15:54:36.278 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T15:54:36.292 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T15:54:36.292 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T15:54:36.295 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T15:54:36.296 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T15:54:36.321 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T15:54:36.321 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T15:54:36.326 INFO:tasks.workunit.client.0.smithi144.stderr:TEST: recalculated bucket check stats are correct 2024-06-04T15:54:36.326 INFO:tasks.workunit.client.0.smithi144.stderr: 2024-06-04T15:54:36.326 INFO:tasks.workunit.client.0.smithi144.stderr:radosgw-admin bucket check --fix --bucket check-bucket 2024-06-04T15:54:36.353 INFO:tasks.workunit.client.0.smithi144.stderr:ignoring --setuser ceph since I am not root 2024-06-04T15:54:36.353 INFO:tasks.workunit.client.0.smithi144.stderr:ignoring --setgroup ceph since I am not root 2024-06-04T15:54:36.390 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:36.390+0000 7ff86392f800 20 rados->read ofs=0 len=0 2024-06-04T15:54:36.392 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:36.391+0000 7ff86392f800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T15:54:36.392 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:36.391+0000 7ff86392f800 20 realm 2024-06-04T15:54:36.392 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:36.391+0000 7ff86392f800 20 rados->read ofs=0 len=0 2024-06-04T15:54:36.392 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:36.391+0000 7ff86392f800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T15:54:36.392 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:36.391+0000 7ff86392f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-06-04T15:54:36.392 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:36.391+0000 7ff86392f800 20 rados->read ofs=0 len=0 2024-06-04T15:54:36.392 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:36.392+0000 7ff86392f800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T15:54:36.392 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:36.392+0000 7ff86392f800 20 rados->read ofs=0 len=0 2024-06-04T15:54:36.393 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:36.392+0000 7ff86392f800 20 rados_obj.operate() r=0 bl.length=46 2024-06-04T15:54:36.393 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:36.392+0000 7ff86392f800 20 rados->read ofs=0 len=0 2024-06-04T15:54:36.393 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:36.393+0000 7ff86392f800 20 rados_obj.operate() r=0 bl.length=1139 2024-06-04T15:54:36.393 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:36.393+0000 7ff86392f800 20 searching for the correct realm 2024-06-04T15:54:36.395 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:36.395+0000 7ff85febc640 0 -- 172.21.15.144:0/1688600117 >> [v2:172.21.15.144:6800/1453747520,v1:172.21.15.144:6801/1453747520] conn(0x7ff854040b90 msgr2=0x7ff854019920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-06-04T15:54:36.599 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:36.599+0000 7ff85febc640 0 -- 172.21.15.144:0/1688600117 >> [v2:172.21.15.144:6824/166159729,v1:172.21.15.144:6825/166159729] conn(0x55580c564b70 msgr2=0x55580c566f60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-06-04T15:54:36.605 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:36.604+0000 7ff86392f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-06-04T15:54:36.605 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:36.604+0000 7ff86392f800 20 RGWRados::pool_iterate: got zone_info.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767 2024-06-04T15:54:36.605 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:36.604+0000 7ff86392f800 20 RGWRados::pool_iterate: got default.zone. 2024-06-04T15:54:36.605 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:36.604+0000 7ff86392f800 20 RGWRados::pool_iterate: got zonegroup_info.abb22408-c332-4e28-8f7a-ff254ea2fed2 2024-06-04T15:54:36.605 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:36.604+0000 7ff86392f800 20 RGWRados::pool_iterate: got zone_names.default 2024-06-04T15:54:36.605 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:36.604+0000 7ff86392f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-06-04T15:54:36.605 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:36.604+0000 7ff86392f800 20 rados->read ofs=0 len=0 2024-06-04T15:54:36.605 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:36.604+0000 7ff86392f800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T15:54:36.605 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:36.604+0000 7ff86392f800 20 rados->read ofs=0 len=0 2024-06-04T15:54:36.605 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:36.605+0000 7ff86392f800 20 rados_obj.operate() r=0 bl.length=46 2024-06-04T15:54:36.605 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:36.605+0000 7ff86392f800 20 rados->read ofs=0 len=0 2024-06-04T15:54:36.606 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:36.605+0000 7ff86392f800 20 rados_obj.operate() r=0 bl.length=470 2024-06-04T15:54:36.607 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:36.605+0000 7ff86392f800 20 zone default found 2024-06-04T15:54:36.607 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:36.605+0000 7ff86392f800 4 Realm: () 2024-06-04T15:54:36.607 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:36.605+0000 7ff86392f800 4 ZoneGroup: default (abb22408-c332-4e28-8f7a-ff254ea2fed2) 2024-06-04T15:54:36.607 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:36.605+0000 7ff86392f800 4 Zone: default (be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767) 2024-06-04T15:54:36.607 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:36.605+0000 7ff86392f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-06-04T15:54:36.607 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:36.605+0000 7ff86392f800 20 zonegroup default 2024-06-04T15:54:36.607 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:36.605+0000 7ff86392f800 20 rados->read ofs=0 len=0 2024-06-04T15:54:36.607 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:36.605+0000 7ff86392f800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T15:54:36.607 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:36.605+0000 7ff86392f800 20 rados->read ofs=0 len=0 2024-06-04T15:54:36.607 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:36.605+0000 7ff86392f800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T15:54:36.607 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:36.605+0000 7ff86392f800 20 rados->read ofs=0 len=0 2024-06-04T15:54:36.607 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:36.606+0000 7ff86392f800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T15:54:36.607 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:36.606+0000 7ff86392f800 20 started sync module instance, tier type = 2024-06-04T15:54:36.608 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:36.606+0000 7ff86392f800 20 started zone id=be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767 (name=default) with tier type = 2024-06-04T15:54:36.629 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:36.629+0000 7ff86392f800 20 add_watcher() i=0 2024-06-04T15:54:36.629 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:36.629+0000 7ff86392f800 20 add_watcher() i=1 2024-06-04T15:54:36.629 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:36.629+0000 7ff86392f800 20 add_watcher() i=2 2024-06-04T15:54:36.630 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:36.629+0000 7ff86392f800 20 add_watcher() i=3 2024-06-04T15:54:36.630 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:36.629+0000 7ff86392f800 20 add_watcher() i=4 2024-06-04T15:54:36.630 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:36.629+0000 7ff86392f800 20 add_watcher() i=5 2024-06-04T15:54:36.630 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:36.629+0000 7ff86392f800 20 add_watcher() i=6 2024-06-04T15:54:36.632 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:36.632+0000 7ff86392f800 20 add_watcher() i=7 2024-06-04T15:54:36.632 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:36.632+0000 7ff86392f800 2 all 8 watchers are set, enabling cache 2024-06-04T15:54:36.634 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:36.634+0000 7ff715fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-06-04T15:54:36.635 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:36.634+0000 7ff86392f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-06-04T15:54:36.635 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:36.634+0000 7ff86392f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-06-04T15:54:36.635 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:36.634+0000 7ff86392f800 5 note: GC not initialized 2024-06-04T15:54:36.635 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:36.634+0000 7ff714fe1640 20 reqs_thread_entry: start 2024-06-04T15:54:36.635 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:36.634+0000 7ff86392f800 20 init_complete bucket index max shards: 11 2024-06-04T15:54:36.635 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:36.634+0000 7ff86392f800 20 Filter name: none 2024-06-04T15:54:36.635 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:36.635+0000 7ff68e7fc640 20 reqs_thread_entry: start 2024-06-04T15:54:36.635 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:36.635+0000 7ff86392f800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-06-04T15:54:36.635 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:36.635+0000 7ff86392f800 20 rados->read ofs=0 len=0 2024-06-04T15:54:36.636 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:36.635+0000 7ff86392f800 20 rados_obj.operate() r=0 bl.length=190 2024-06-04T15:54:36.636 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:36.635+0000 7ff86392f800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-06-04T15:54:36.636 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:36.635+0000 7ff86392f800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-06-04T15:54:36.636 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:36.635+0000 7ff86392f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1 : miss 2024-06-04T15:54:36.636 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:36.635+0000 7ff86392f800 20 rados->read ofs=0 len=0 2024-06-04T15:54:36.637 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:36.636+0000 7ff86392f800 20 rados_obj.operate() r=0 bl.length=404 2024-06-04T15:54:36.637 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:36.636+0000 7ff86392f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1 info.flags=0x17 2024-06-04T15:54:36.637 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:36.636+0000 7ff86392f800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1 to cache LRU end 2024-06-04T15:54:36.637 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:36.636+0000 7ff86392f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-06-04T15:54:36.637 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:36.636+0000 7ff86392f800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-06-04T15:54:36.637 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:36.636+0000 7ff86392f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1 2024-06-04T15:54:36.637 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:36.636+0000 7ff86392f800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.0 2024-06-04T15:54:36.638 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:36.636+0000 7ff86392f800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.1 2024-06-04T15:54:36.638 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:36.637+0000 7ff86392f800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.2 2024-06-04T15:54:36.638 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:36.638+0000 7ff86392f800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.3 2024-06-04T15:54:36.638 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:36.638+0000 7ff86392f800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.4 2024-06-04T15:54:36.639 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:36.638+0000 7ff86392f800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.5 2024-06-04T15:54:36.639 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:36.639+0000 7ff86392f800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.6 2024-06-04T15:54:36.640 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:36.640+0000 7ff86392f800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.7 2024-06-04T15:54:36.640 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:36.640+0000 7ff86392f800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.8 2024-06-04T15:54:36.641 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:36.641+0000 7ff86392f800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.9 2024-06-04T15:54:36.641 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:36.641+0000 7ff86392f800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.10 2024-06-04T15:54:36.651 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:36.651+0000 7ff715fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-06-04T15:54:36.653 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:36.653+0000 7ff86392f800 20 remove_watcher() i=0 2024-06-04T15:54:36.653 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:36.653+0000 7ff86392f800 2 removed watcher, disabling cache 2024-06-04T15:54:36.654 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:36.654+0000 7ff86392f800 20 remove_watcher() i=1 2024-06-04T15:54:36.655 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:36.655+0000 7ff86392f800 20 remove_watcher() i=2 2024-06-04T15:54:36.656 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:36.656+0000 7ff86392f800 20 remove_watcher() i=3 2024-06-04T15:54:36.657 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:36.657+0000 7ff86392f800 20 remove_watcher() i=4 2024-06-04T15:54:36.658 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:36.658+0000 7ff86392f800 20 remove_watcher() i=5 2024-06-04T15:54:36.661 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:36.661+0000 7ff86392f800 20 remove_watcher() i=6 2024-06-04T15:54:36.664 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:36.664+0000 7ff86392f800 20 remove_watcher() i=7 2024-06-04T15:54:36.676 INFO:tasks.workunit.client.0.smithi144.stderr:radosgw-admin bucket stats --bucket check-bucket 2024-06-04T15:54:36.704 INFO:tasks.workunit.client.0.smithi144.stderr:ignoring --setuser ceph since I am not root 2024-06-04T15:54:36.704 INFO:tasks.workunit.client.0.smithi144.stderr:ignoring --setgroup ceph since I am not root 2024-06-04T15:54:36.740 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:36.740+0000 7f5b19a13800 20 rados->read ofs=0 len=0 2024-06-04T15:54:36.742 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:36.741+0000 7f5b19a13800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T15:54:36.742 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:36.741+0000 7f5b19a13800 20 realm 2024-06-04T15:54:36.742 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:36.741+0000 7f5b19a13800 20 rados->read ofs=0 len=0 2024-06-04T15:54:36.742 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:36.742+0000 7f5b19a13800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T15:54:36.743 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:36.742+0000 7f5b19a13800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-06-04T15:54:36.743 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:36.742+0000 7f5b19a13800 20 rados->read ofs=0 len=0 2024-06-04T15:54:36.743 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:36.742+0000 7f5b19a13800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T15:54:36.743 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:36.742+0000 7f5b19a13800 20 rados->read ofs=0 len=0 2024-06-04T15:54:36.744 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:36.742+0000 7f5b19a13800 20 rados_obj.operate() r=0 bl.length=46 2024-06-04T15:54:36.744 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:36.743+0000 7f5b19a13800 20 rados->read ofs=0 len=0 2024-06-04T15:54:36.744 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:36.743+0000 7f5b19a13800 20 rados_obj.operate() r=0 bl.length=1139 2024-06-04T15:54:36.744 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:36.743+0000 7f5b19a13800 20 searching for the correct realm 2024-06-04T15:54:36.746 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:36.745+0000 7f5b15953640 0 -- 172.21.15.144:0/4226236496 >> [v2:172.21.15.144:6800/1453747520,v1:172.21.15.144:6801/1453747520] conn(0x7f5b00097070 msgr2=0x7f5b000871e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-06-04T15:54:36.749 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:36.749+0000 7f5b15953640 0 -- 172.21.15.144:0/4226236496 >> [v2:172.21.15.144:6824/166159729,v1:172.21.15.144:6825/166159729] conn(0x561e7c5b6600 msgr2=0x561e7c5b89f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-06-04T15:54:36.755 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:36.753+0000 7f5b19a13800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-06-04T15:54:36.755 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:36.753+0000 7f5b19a13800 20 RGWRados::pool_iterate: got zone_info.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767 2024-06-04T15:54:36.755 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:36.753+0000 7f5b19a13800 20 RGWRados::pool_iterate: got default.zone. 2024-06-04T15:54:36.756 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:36.753+0000 7f5b19a13800 20 RGWRados::pool_iterate: got zonegroup_info.abb22408-c332-4e28-8f7a-ff254ea2fed2 2024-06-04T15:54:36.756 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:36.753+0000 7f5b19a13800 20 RGWRados::pool_iterate: got zone_names.default 2024-06-04T15:54:36.756 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:36.753+0000 7f5b19a13800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-06-04T15:54:36.756 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:36.753+0000 7f5b19a13800 20 rados->read ofs=0 len=0 2024-06-04T15:54:36.756 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:36.754+0000 7f5b19a13800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T15:54:36.756 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:36.754+0000 7f5b19a13800 20 rados->read ofs=0 len=0 2024-06-04T15:54:36.757 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:36.754+0000 7f5b19a13800 20 rados_obj.operate() r=0 bl.length=46 2024-06-04T15:54:36.757 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:36.754+0000 7f5b19a13800 20 rados->read ofs=0 len=0 2024-06-04T15:54:36.757 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:36.754+0000 7f5b19a13800 20 rados_obj.operate() r=0 bl.length=470 2024-06-04T15:54:36.757 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:36.754+0000 7f5b19a13800 20 zone default found 2024-06-04T15:54:36.757 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:36.754+0000 7f5b19a13800 4 Realm: () 2024-06-04T15:54:36.758 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:36.754+0000 7f5b19a13800 4 ZoneGroup: default (abb22408-c332-4e28-8f7a-ff254ea2fed2) 2024-06-04T15:54:36.758 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:36.754+0000 7f5b19a13800 4 Zone: default (be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767) 2024-06-04T15:54:36.758 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:36.754+0000 7f5b19a13800 10 cannot find current period zonegroup using local zonegroup configuration 2024-06-04T15:54:36.758 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:36.754+0000 7f5b19a13800 20 zonegroup default 2024-06-04T15:54:36.758 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:36.754+0000 7f5b19a13800 20 rados->read ofs=0 len=0 2024-06-04T15:54:36.759 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:36.754+0000 7f5b19a13800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T15:54:36.759 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:36.754+0000 7f5b19a13800 20 rados->read ofs=0 len=0 2024-06-04T15:54:36.759 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:36.755+0000 7f5b19a13800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T15:54:36.759 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:36.755+0000 7f5b19a13800 20 rados->read ofs=0 len=0 2024-06-04T15:54:36.759 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:36.755+0000 7f5b19a13800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T15:54:36.759 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:36.755+0000 7f5b19a13800 20 started sync module instance, tier type = 2024-06-04T15:54:36.759 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:36.755+0000 7f5b19a13800 20 started zone id=be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767 (name=default) with tier type = 2024-06-04T15:54:36.776 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:36.776+0000 7f5b19a13800 20 add_watcher() i=0 2024-06-04T15:54:36.776 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:36.776+0000 7f5b19a13800 20 add_watcher() i=1 2024-06-04T15:54:36.776 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:36.776+0000 7f5b19a13800 20 add_watcher() i=2 2024-06-04T15:54:36.777 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:36.776+0000 7f5b19a13800 20 add_watcher() i=3 2024-06-04T15:54:36.777 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:36.776+0000 7f5b19a13800 20 add_watcher() i=4 2024-06-04T15:54:36.777 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:36.776+0000 7f5b19a13800 20 add_watcher() i=5 2024-06-04T15:54:36.777 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:36.776+0000 7f5b19a13800 20 add_watcher() i=6 2024-06-04T15:54:36.778 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:36.778+0000 7f5b19a13800 20 add_watcher() i=7 2024-06-04T15:54:36.779 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:36.778+0000 7f5b19a13800 2 all 8 watchers are set, enabling cache 2024-06-04T15:54:36.780 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:36.780+0000 7f59cb7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-06-04T15:54:36.782 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:36.781+0000 7f5b19a13800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-06-04T15:54:36.782 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:36.781+0000 7f5b19a13800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-06-04T15:54:36.782 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:36.781+0000 7f5b19a13800 5 note: GC not initialized 2024-06-04T15:54:36.782 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:36.781+0000 7f59ca7e4640 20 reqs_thread_entry: start 2024-06-04T15:54:36.782 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:36.781+0000 7f5b19a13800 20 init_complete bucket index max shards: 11 2024-06-04T15:54:36.782 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:36.781+0000 7f5b19a13800 20 Filter name: none 2024-06-04T15:54:36.782 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:36.781+0000 7f593bfff640 20 reqs_thread_entry: start 2024-06-04T15:54:36.782 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:36.781+0000 7f5b19a13800 20 rados->read ofs=0 len=0 2024-06-04T15:54:36.782 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:36.782+0000 7f5b19a13800 20 rados_obj.operate() r=0 bl.length=190 2024-06-04T15:54:36.783 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:36.782+0000 7f5b19a13800 20 rados->read ofs=0 len=0 2024-06-04T15:54:36.784 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:36.782+0000 7f5b19a13800 20 rados_obj.operate() r=0 bl.length=404 2024-06-04T15:54:36.784 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:36.782+0000 7f5b19a13800 20 couldn't put binfo cache entry, might have raced with data changes 2024-06-04T15:54:36.784 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:36.782+0000 7f5b19a13800 20 rados->read ofs=0 len=0 2024-06-04T15:54:36.784 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:36.782+0000 7f5b19a13800 20 rados_obj.operate() r=0 bl.length=190 2024-06-04T15:54:36.784 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:36.782+0000 7f5b19a13800 20 rados->read ofs=0 len=0 2024-06-04T15:54:36.785 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:36.783+0000 7f5b19a13800 20 rados_obj.operate() r=0 bl.length=404 2024-06-04T15:54:36.785 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:36.783+0000 7f5b19a13800 20 couldn't put binfo cache entry, might have raced with data changes 2024-06-04T15:54:36.785 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:36.784+0000 7f59cb7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-06-04T15:54:36.786 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:36.786+0000 7f5b19a13800 20 remove_watcher() i=0 2024-06-04T15:54:36.786 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:36.786+0000 7f5b19a13800 2 removed watcher, disabling cache 2024-06-04T15:54:36.788 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:36.787+0000 7f5b19a13800 20 remove_watcher() i=1 2024-06-04T15:54:36.790 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:36.790+0000 7f5b19a13800 20 remove_watcher() i=2 2024-06-04T15:54:36.791 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:36.791+0000 7f5b19a13800 20 remove_watcher() i=3 2024-06-04T15:54:36.792 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:36.792+0000 7f5b19a13800 20 remove_watcher() i=4 2024-06-04T15:54:36.793 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:36.793+0000 7f5b19a13800 20 remove_watcher() i=5 2024-06-04T15:54:36.795 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:36.795+0000 7f5b19a13800 20 remove_watcher() i=6 2024-06-04T15:54:36.796 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:36.796+0000 7f5b19a13800 20 remove_watcher() i=7 2024-06-04T15:54:36.807 INFO:tasks.workunit.client.0.smithi144.stderr:{'rgw.main': {'size': 54, 'size_actual': 24576, 'size_utilized': 88, 'size_kb': 1, 'size_kb_actual': 24, 'size_kb_utilized': 1, 'num_objects': 6}} 2024-06-04T15:54:36.807 INFO:tasks.workunit.client.0.smithi144.stderr:TEST: bucket check unlinked does not report normal entries 2024-06-04T15:54:36.807 INFO:tasks.workunit.client.0.smithi144.stderr: 2024-06-04T15:54:36.808 INFO:tasks.workunit.client.0.smithi144.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --min-age-hours 0 --dump-keys 2024-06-04T15:54:36.840 INFO:tasks.workunit.client.0.smithi144.stderr:ignoring --setuser ceph since I am not root 2024-06-04T15:54:36.840 INFO:tasks.workunit.client.0.smithi144.stderr:ignoring --setgroup ceph since I am not root 2024-06-04T15:54:36.878 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:36.877+0000 7fd26dc87800 20 rados->read ofs=0 len=0 2024-06-04T15:54:36.879 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:36.879+0000 7fd26dc87800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T15:54:36.879 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:36.879+0000 7fd26dc87800 20 realm 2024-06-04T15:54:36.879 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:36.879+0000 7fd26dc87800 20 rados->read ofs=0 len=0 2024-06-04T15:54:36.879 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:36.879+0000 7fd26dc87800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T15:54:36.879 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:36.879+0000 7fd26dc87800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-06-04T15:54:36.880 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:36.879+0000 7fd26dc87800 20 rados->read ofs=0 len=0 2024-06-04T15:54:36.880 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:36.879+0000 7fd26dc87800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T15:54:36.880 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:36.879+0000 7fd26dc87800 20 rados->read ofs=0 len=0 2024-06-04T15:54:36.880 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:36.880+0000 7fd26dc87800 20 rados_obj.operate() r=0 bl.length=46 2024-06-04T15:54:36.881 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:36.880+0000 7fd26dc87800 20 rados->read ofs=0 len=0 2024-06-04T15:54:36.881 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:36.880+0000 7fd26dc87800 20 rados_obj.operate() r=0 bl.length=1139 2024-06-04T15:54:36.881 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:36.880+0000 7fd26dc87800 20 searching for the correct realm 2024-06-04T15:54:36.881 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:36.881+0000 7fd26b77c640 0 -- 172.21.15.144:0/2009158448 >> [v2:172.21.15.177:6816/2039473917,v1:172.21.15.177:6817/2039473917] conn(0x559b77abd280 msgr2=0x559b77abf740 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-06-04T15:54:36.884 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:36.884+0000 7fd26b77c640 0 -- 172.21.15.144:0/2009158448 >> [v2:172.21.15.177:6800/3891611393,v1:172.21.15.177:6801/3891611393] conn(0x7fd25c0ac040 msgr2=0x7fd25c0a88e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-06-04T15:54:36.892 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:36.890+0000 7fd26dc87800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-06-04T15:54:36.892 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:36.890+0000 7fd26dc87800 20 RGWRados::pool_iterate: got zone_info.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767 2024-06-04T15:54:36.892 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:36.890+0000 7fd26dc87800 20 RGWRados::pool_iterate: got default.zone. 2024-06-04T15:54:36.892 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:36.890+0000 7fd26dc87800 20 RGWRados::pool_iterate: got zonegroup_info.abb22408-c332-4e28-8f7a-ff254ea2fed2 2024-06-04T15:54:36.893 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:36.890+0000 7fd26dc87800 20 RGWRados::pool_iterate: got zone_names.default 2024-06-04T15:54:36.893 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:36.890+0000 7fd26dc87800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-06-04T15:54:36.893 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:36.890+0000 7fd26dc87800 20 rados->read ofs=0 len=0 2024-06-04T15:54:36.893 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:36.890+0000 7fd26dc87800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T15:54:36.893 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:36.890+0000 7fd26dc87800 20 rados->read ofs=0 len=0 2024-06-04T15:54:36.893 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:36.890+0000 7fd26dc87800 20 rados_obj.operate() r=0 bl.length=46 2024-06-04T15:54:36.893 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:36.890+0000 7fd26dc87800 20 rados->read ofs=0 len=0 2024-06-04T15:54:36.893 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:36.891+0000 7fd26dc87800 20 rados_obj.operate() r=0 bl.length=470 2024-06-04T15:54:36.893 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:36.891+0000 7fd26dc87800 20 zone default found 2024-06-04T15:54:36.894 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:36.891+0000 7fd26dc87800 4 Realm: () 2024-06-04T15:54:36.894 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:36.891+0000 7fd26dc87800 4 ZoneGroup: default (abb22408-c332-4e28-8f7a-ff254ea2fed2) 2024-06-04T15:54:36.894 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:36.891+0000 7fd26dc87800 4 Zone: default (be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767) 2024-06-04T15:54:36.894 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:36.891+0000 7fd26dc87800 10 cannot find current period zonegroup using local zonegroup configuration 2024-06-04T15:54:36.894 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:36.891+0000 7fd26dc87800 20 zonegroup default 2024-06-04T15:54:36.894 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:36.891+0000 7fd26dc87800 20 rados->read ofs=0 len=0 2024-06-04T15:54:36.894 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:36.891+0000 7fd26dc87800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T15:54:36.894 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:36.891+0000 7fd26dc87800 20 rados->read ofs=0 len=0 2024-06-04T15:54:36.894 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:36.891+0000 7fd26dc87800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T15:54:36.894 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:36.891+0000 7fd26dc87800 20 rados->read ofs=0 len=0 2024-06-04T15:54:36.894 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:36.892+0000 7fd26dc87800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T15:54:36.894 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:36.892+0000 7fd26dc87800 20 started sync module instance, tier type = 2024-06-04T15:54:36.894 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:36.892+0000 7fd26dc87800 20 started zone id=be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767 (name=default) with tier type = 2024-06-04T15:54:36.904 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:36.903+0000 7fd26dc87800 20 add_watcher() i=0 2024-06-04T15:54:36.904 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:36.903+0000 7fd26dc87800 20 add_watcher() i=1 2024-06-04T15:54:36.904 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:36.903+0000 7fd26dc87800 20 add_watcher() i=2 2024-06-04T15:54:36.904 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:36.903+0000 7fd26dc87800 20 add_watcher() i=3 2024-06-04T15:54:36.904 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:36.903+0000 7fd26dc87800 20 add_watcher() i=4 2024-06-04T15:54:36.904 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:36.903+0000 7fd26dc87800 20 add_watcher() i=5 2024-06-04T15:54:36.904 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:36.903+0000 7fd26dc87800 20 add_watcher() i=6 2024-06-04T15:54:36.905 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:36.904+0000 7fd26dc87800 20 add_watcher() i=7 2024-06-04T15:54:36.905 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:36.904+0000 7fd26dc87800 2 all 8 watchers are set, enabling cache 2024-06-04T15:54:36.906 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:36.906+0000 7fd121fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-06-04T15:54:36.910 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:36.906+0000 7fd26dc87800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-06-04T15:54:36.911 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:36.906+0000 7fd26dc87800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-06-04T15:54:36.911 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:36.906+0000 7fd26dc87800 5 note: GC not initialized 2024-06-04T15:54:36.911 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:36.906+0000 7fd120fe1640 20 reqs_thread_entry: start 2024-06-04T15:54:36.911 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:36.906+0000 7fd26dc87800 20 init_complete bucket index max shards: 11 2024-06-04T15:54:36.911 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:36.907+0000 7fd26dc87800 20 Filter name: none 2024-06-04T15:54:36.911 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:36.907+0000 7fd09a7fc640 20 reqs_thread_entry: start 2024-06-04T15:54:36.911 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:36.907+0000 7fd26dc87800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-06-04T15:54:36.912 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:36.907+0000 7fd26dc87800 20 rados->read ofs=0 len=0 2024-06-04T15:54:36.912 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:36.907+0000 7fd26dc87800 20 rados_obj.operate() r=0 bl.length=190 2024-06-04T15:54:36.912 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:36.907+0000 7fd26dc87800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-06-04T15:54:36.912 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:36.907+0000 7fd26dc87800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-06-04T15:54:36.912 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:36.907+0000 7fd26dc87800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1 : miss 2024-06-04T15:54:36.912 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:36.907+0000 7fd26dc87800 20 rados->read ofs=0 len=0 2024-06-04T15:54:36.912 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:36.907+0000 7fd26dc87800 20 rados_obj.operate() r=0 bl.length=404 2024-06-04T15:54:36.913 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:36.907+0000 7fd26dc87800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1 info.flags=0x17 2024-06-04T15:54:36.913 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:36.907+0000 7fd26dc87800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1 to cache LRU end 2024-06-04T15:54:36.913 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:36.907+0000 7fd26dc87800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-06-04T15:54:36.913 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:36.907+0000 7fd26dc87800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-06-04T15:54:36.913 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:36.907+0000 7fd26dc87800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1 2024-06-04T15:54:36.913 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:36.908+0000 7fd26dc87800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.0 2024-06-04T15:54:36.914 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:36.908+0000 7fd26dc87800 1 NOTICE: finished shard 0 (0 entries found) 2024-06-04T15:54:36.914 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:36.908+0000 7fd26dc87800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.1 2024-06-04T15:54:36.914 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:36.908+0000 7fd26dc87800 1 NOTICE: finished shard 1 (0 entries found) 2024-06-04T15:54:36.914 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:36.908+0000 7fd26dc87800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.2 2024-06-04T15:54:36.914 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:36.909+0000 7fd26dc87800 1 NOTICE: finished shard 2 (0 entries found) 2024-06-04T15:54:36.914 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:36.909+0000 7fd26dc87800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.3 2024-06-04T15:54:36.914 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:36.909+0000 7fd26dc87800 1 NOTICE: finished shard 3 (0 entries found) 2024-06-04T15:54:36.915 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:36.909+0000 7fd26dc87800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.4 2024-06-04T15:54:36.915 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:36.910+0000 7fd26dc87800 1 NOTICE: finished shard 4 (0 entries found) 2024-06-04T15:54:36.915 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:36.910+0000 7fd26dc87800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.5 2024-06-04T15:54:36.915 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:36.910+0000 7fd26dc87800 1 NOTICE: finished shard 5 (0 entries found) 2024-06-04T15:54:36.915 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:36.910+0000 7fd26dc87800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.6 2024-06-04T15:54:36.918 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:36.910+0000 7fd26dc87800 1 NOTICE: finished shard 6 (0 entries found) 2024-06-04T15:54:36.918 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:36.910+0000 7fd26dc87800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.7 2024-06-04T15:54:36.918 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:36.911+0000 7fd26dc87800 1 NOTICE: finished shard 7 (0 entries found) 2024-06-04T15:54:36.918 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:36.911+0000 7fd26dc87800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.8 2024-06-04T15:54:36.919 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:36.911+0000 7fd26dc87800 1 NOTICE: finished shard 8 (0 entries found) 2024-06-04T15:54:36.919 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:36.911+0000 7fd26dc87800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.9 2024-06-04T15:54:36.919 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:36.912+0000 7fd26dc87800 1 NOTICE: finished shard 9 (0 entries found) 2024-06-04T15:54:36.919 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:36.912+0000 7fd26dc87800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.10 2024-06-04T15:54:36.919 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:36.912+0000 7fd26dc87800 1 NOTICE: finished shard 10 (0 entries found) 2024-06-04T15:54:36.919 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:36.912+0000 7fd26dc87800 1 NOTICE: finished all shards (0 entries found) 2024-06-04T15:54:36.919 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:36.913+0000 7fd121fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-06-04T15:54:36.920 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:36.915+0000 7fd26dc87800 20 remove_watcher() i=0 2024-06-04T15:54:36.920 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:36.915+0000 7fd26dc87800 2 removed watcher, disabling cache 2024-06-04T15:54:36.920 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:36.917+0000 7fd26dc87800 20 remove_watcher() i=1 2024-06-04T15:54:36.920 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:36.918+0000 7fd26dc87800 20 remove_watcher() i=2 2024-06-04T15:54:36.921 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:36.920+0000 7fd26dc87800 20 remove_watcher() i=3 2024-06-04T15:54:36.923 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:36.923+0000 7fd26dc87800 20 remove_watcher() i=4 2024-06-04T15:54:36.924 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:36.924+0000 7fd26dc87800 20 remove_watcher() i=5 2024-06-04T15:54:36.925 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:36.925+0000 7fd26dc87800 20 remove_watcher() i=6 2024-06-04T15:54:36.926 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:36.926+0000 7fd26dc87800 20 remove_watcher() i=7 2024-06-04T15:54:36.938 INFO:tasks.workunit.client.0.smithi144.stderr:ceph config set client rgw_debug_inject_set_olh_err 2 2024-06-04T15:54:37.338 INFO:tasks.workunit.client.0.smithi144.stderr:ceph config set client rgw_debug_inject_olh_cancel_modification_err true 2024-06-04T15:54:38.737 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T15:54:38.737 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T15:54:38.789 INFO:tasks.workunit.client.0.smithi144.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-06-04T15:54:38.791 INFO:tasks.workunit.client.0.smithi144.stderr:radosgw-admin bi list --bucket check-bucket --object c 2024-06-04T15:54:38.825 INFO:tasks.workunit.client.0.smithi144.stderr:ignoring --setuser ceph since I am not root 2024-06-04T15:54:38.825 INFO:tasks.workunit.client.0.smithi144.stderr:ignoring --setgroup ceph since I am not root 2024-06-04T15:54:38.868 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:38.867+0000 7fa704e31800 20 rados->read ofs=0 len=0 2024-06-04T15:54:38.870 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:38.869+0000 7fa704e31800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T15:54:38.870 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:38.869+0000 7fa704e31800 20 realm 2024-06-04T15:54:38.870 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:38.869+0000 7fa704e31800 20 rados->read ofs=0 len=0 2024-06-04T15:54:38.870 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:38.869+0000 7fa704e31800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T15:54:38.870 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:38.869+0000 7fa704e31800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-06-04T15:54:38.870 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:38.869+0000 7fa704e31800 20 rados->read ofs=0 len=0 2024-06-04T15:54:38.870 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:38.869+0000 7fa704e31800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T15:54:38.870 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:38.869+0000 7fa704e31800 20 rados->read ofs=0 len=0 2024-06-04T15:54:38.871 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:38.870+0000 7fa704e31800 20 rados_obj.operate() r=0 bl.length=46 2024-06-04T15:54:38.871 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:38.870+0000 7fa704e31800 20 rados->read ofs=0 len=0 2024-06-04T15:54:38.871 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:38.871+0000 7fa704e31800 20 rados_obj.operate() r=0 bl.length=1139 2024-06-04T15:54:38.871 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:38.871+0000 7fa704e31800 20 searching for the correct realm 2024-06-04T15:54:38.874 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:38.874+0000 7fa7007b5640 0 -- 172.21.15.144:0/196810306 >> [v2:172.21.15.144:6800/1453747520,v1:172.21.15.144:6801/1453747520] conn(0x7fa6f4029410 msgr2=0x7fa6f4029890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-06-04T15:54:39.080 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.079+0000 7fa7007b5640 0 -- 172.21.15.144:0/196810306 >> [v2:172.21.15.144:6824/166159729,v1:172.21.15.144:6825/166159729] conn(0x5577a3417c90 msgr2=0x5577a341a080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-06-04T15:54:39.085 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.085+0000 7fa704e31800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-06-04T15:54:39.085 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.085+0000 7fa704e31800 20 RGWRados::pool_iterate: got zone_info.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767 2024-06-04T15:54:39.085 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.085+0000 7fa704e31800 20 RGWRados::pool_iterate: got default.zone. 2024-06-04T15:54:39.085 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.085+0000 7fa704e31800 20 RGWRados::pool_iterate: got zonegroup_info.abb22408-c332-4e28-8f7a-ff254ea2fed2 2024-06-04T15:54:39.085 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.085+0000 7fa704e31800 20 RGWRados::pool_iterate: got zone_names.default 2024-06-04T15:54:39.086 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.085+0000 7fa704e31800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-06-04T15:54:39.086 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.085+0000 7fa704e31800 20 rados->read ofs=0 len=0 2024-06-04T15:54:39.086 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.085+0000 7fa704e31800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T15:54:39.086 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.085+0000 7fa704e31800 20 rados->read ofs=0 len=0 2024-06-04T15:54:39.086 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.086+0000 7fa704e31800 20 rados_obj.operate() r=0 bl.length=46 2024-06-04T15:54:39.087 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.086+0000 7fa704e31800 20 rados->read ofs=0 len=0 2024-06-04T15:54:39.087 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.086+0000 7fa704e31800 20 rados_obj.operate() r=0 bl.length=470 2024-06-04T15:54:39.087 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.086+0000 7fa704e31800 20 zone default found 2024-06-04T15:54:39.087 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.086+0000 7fa704e31800 4 Realm: () 2024-06-04T15:54:39.087 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.086+0000 7fa704e31800 4 ZoneGroup: default (abb22408-c332-4e28-8f7a-ff254ea2fed2) 2024-06-04T15:54:39.087 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.086+0000 7fa704e31800 4 Zone: default (be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767) 2024-06-04T15:54:39.087 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.086+0000 7fa704e31800 10 cannot find current period zonegroup using local zonegroup configuration 2024-06-04T15:54:39.087 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.086+0000 7fa704e31800 20 zonegroup default 2024-06-04T15:54:39.087 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.086+0000 7fa704e31800 20 rados->read ofs=0 len=0 2024-06-04T15:54:39.088 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.086+0000 7fa704e31800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T15:54:39.088 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.086+0000 7fa704e31800 20 rados->read ofs=0 len=0 2024-06-04T15:54:39.088 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.087+0000 7fa704e31800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T15:54:39.088 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.087+0000 7fa704e31800 20 rados->read ofs=0 len=0 2024-06-04T15:54:39.088 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.087+0000 7fa704e31800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T15:54:39.088 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.087+0000 7fa704e31800 20 started sync module instance, tier type = 2024-06-04T15:54:39.088 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.087+0000 7fa704e31800 20 started zone id=be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767 (name=default) with tier type = 2024-06-04T15:54:39.106 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.106+0000 7fa704e31800 20 add_watcher() i=0 2024-06-04T15:54:39.106 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.106+0000 7fa704e31800 20 add_watcher() i=1 2024-06-04T15:54:39.106 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.106+0000 7fa704e31800 20 add_watcher() i=2 2024-06-04T15:54:39.106 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.106+0000 7fa704e31800 20 add_watcher() i=3 2024-06-04T15:54:39.107 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.106+0000 7fa704e31800 20 add_watcher() i=4 2024-06-04T15:54:39.107 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.106+0000 7fa704e31800 20 add_watcher() i=5 2024-06-04T15:54:39.107 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.106+0000 7fa704e31800 20 add_watcher() i=6 2024-06-04T15:54:39.107 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.107+0000 7fa704e31800 20 add_watcher() i=7 2024-06-04T15:54:39.107 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.107+0000 7fa704e31800 2 all 8 watchers are set, enabling cache 2024-06-04T15:54:39.109 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.109+0000 7fa5b5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-06-04T15:54:39.110 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.110+0000 7fa704e31800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-06-04T15:54:39.110 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.110+0000 7fa704e31800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-06-04T15:54:39.111 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.110+0000 7fa704e31800 5 note: GC not initialized 2024-06-04T15:54:39.111 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.110+0000 7fa5b4fe1640 20 reqs_thread_entry: start 2024-06-04T15:54:39.111 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.110+0000 7fa704e31800 20 init_complete bucket index max shards: 11 2024-06-04T15:54:39.111 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.110+0000 7fa704e31800 20 Filter name: none 2024-06-04T15:54:39.111 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.110+0000 7fa52e7fc640 20 reqs_thread_entry: start 2024-06-04T15:54:39.111 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.110+0000 7fa704e31800 20 rados->read ofs=0 len=0 2024-06-04T15:54:39.113 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.111+0000 7fa704e31800 20 rados_obj.operate() r=0 bl.length=190 2024-06-04T15:54:39.113 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.111+0000 7fa704e31800 20 rados->read ofs=0 len=0 2024-06-04T15:54:39.113 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.111+0000 7fa704e31800 20 rados_obj.operate() r=0 bl.length=404 2024-06-04T15:54:39.113 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.111+0000 7fa704e31800 20 couldn't put binfo cache entry, might have raced with data changes 2024-06-04T15:54:39.113 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.111+0000 7fa704e31800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-06-04T15:54:39.114 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.111+0000 7fa704e31800 20 INFO: main: starting shard=0 2024-06-04T15:54:39.114 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.111+0000 7fa704e31800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.0 2024-06-04T15:54:39.114 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.112+0000 7fa704e31800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-06-04T15:54:39.114 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.112+0000 7fa704e31800 20 INFO: main: starting shard=1 2024-06-04T15:54:39.114 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.112+0000 7fa704e31800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.1 2024-06-04T15:54:39.114 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.112+0000 7fa704e31800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-06-04T15:54:39.114 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.112+0000 7fa704e31800 20 INFO: main: starting shard=2 2024-06-04T15:54:39.114 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.112+0000 7fa704e31800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.2 2024-06-04T15:54:39.114 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.113+0000 7fa704e31800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-06-04T15:54:39.114 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.113+0000 7fa704e31800 20 INFO: main: starting shard=3 2024-06-04T15:54:39.114 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.113+0000 7fa704e31800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.3 2024-06-04T15:54:39.114 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.113+0000 7fa704e31800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-06-04T15:54:39.114 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.113+0000 7fa704e31800 20 INFO: main: starting shard=4 2024-06-04T15:54:39.115 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.113+0000 7fa704e31800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.4 2024-06-04T15:54:39.115 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.114+0000 7fa704e31800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-06-04T15:54:39.115 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.114+0000 7fa704e31800 20 INFO: main: starting shard=5 2024-06-04T15:54:39.116 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.114+0000 7fa704e31800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.5 2024-06-04T15:54:39.116 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.114+0000 7fa704e31800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-06-04T15:54:39.116 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.114+0000 7fa704e31800 20 INFO: main: starting shard=6 2024-06-04T15:54:39.116 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.114+0000 7fa704e31800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.6 2024-06-04T15:54:39.116 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.115+0000 7fa704e31800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-06-04T15:54:39.116 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.115+0000 7fa704e31800 20 INFO: main: starting shard=7 2024-06-04T15:54:39.116 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.115+0000 7fa704e31800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.7 2024-06-04T15:54:39.117 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.116+0000 7fa704e31800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-06-04T15:54:39.117 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.116+0000 7fa704e31800 20 INFO: main: starting shard=8 2024-06-04T15:54:39.117 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.116+0000 7fa704e31800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.8 2024-06-04T15:54:39.117 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.117+0000 7fa704e31800 20 INFO: main: bi_list() returned without error; entries.size()=5, is_truncated=0, marker= 2024-06-04T15:54:39.118 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.117+0000 7fa704e31800 20 INFO: main: starting shard=9 2024-06-04T15:54:39.118 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.117+0000 7fa704e31800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.9 2024-06-04T15:54:39.118 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.117+0000 7fa704e31800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-06-04T15:54:39.118 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.117+0000 7fa704e31800 20 INFO: main: starting shard=10 2024-06-04T15:54:39.118 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.117+0000 7fa704e31800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.10 2024-06-04T15:54:39.118 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.118+0000 7fa704e31800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-06-04T15:54:39.118 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.118+0000 7fa704e31800 20 INFO: main: done 2024-06-04T15:54:39.119 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.118+0000 7fa5b5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-06-04T15:54:39.121 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.121+0000 7fa704e31800 20 remove_watcher() i=0 2024-06-04T15:54:39.121 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.121+0000 7fa704e31800 2 removed watcher, disabling cache 2024-06-04T15:54:39.122 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.122+0000 7fa704e31800 20 remove_watcher() i=1 2024-06-04T15:54:39.123 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.123+0000 7fa704e31800 20 remove_watcher() i=2 2024-06-04T15:54:39.124 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.124+0000 7fa704e31800 20 remove_watcher() i=3 2024-06-04T15:54:39.125 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.125+0000 7fa704e31800 20 remove_watcher() i=4 2024-06-04T15:54:39.126 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.126+0000 7fa704e31800 20 remove_watcher() i=5 2024-06-04T15:54:39.130 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.130+0000 7fa704e31800 20 remove_watcher() i=6 2024-06-04T15:54:39.131 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.131+0000 7fa704e31800 20 remove_watcher() i=7 2024-06-04T15:54:39.145 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T15:54:39.145 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T15:54:39.149 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T15:54:39.149 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T15:54:39.151 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T15:54:39.151 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T15:54:39.203 INFO:tasks.workunit.client.0.smithi144.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-06-04T15:54:39.205 INFO:tasks.workunit.client.0.smithi144.stderr:radosgw-admin bi list --bucket check-bucket --object d 2024-06-04T15:54:39.236 INFO:tasks.workunit.client.0.smithi144.stderr:ignoring --setuser ceph since I am not root 2024-06-04T15:54:39.236 INFO:tasks.workunit.client.0.smithi144.stderr:ignoring --setgroup ceph since I am not root 2024-06-04T15:54:39.273 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.272+0000 7f3a2891f800 20 rados->read ofs=0 len=0 2024-06-04T15:54:39.275 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.274+0000 7f3a2891f800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T15:54:39.275 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.274+0000 7f3a2891f800 20 realm 2024-06-04T15:54:39.275 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.274+0000 7f3a2891f800 20 rados->read ofs=0 len=0 2024-06-04T15:54:39.275 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.275+0000 7f3a2891f800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T15:54:39.275 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.275+0000 7f3a2891f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-06-04T15:54:39.275 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.275+0000 7f3a2891f800 20 rados->read ofs=0 len=0 2024-06-04T15:54:39.276 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.275+0000 7f3a2891f800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T15:54:39.276 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.275+0000 7f3a2891f800 20 rados->read ofs=0 len=0 2024-06-04T15:54:39.276 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.275+0000 7f3a2891f800 20 rados_obj.operate() r=0 bl.length=46 2024-06-04T15:54:39.276 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.275+0000 7f3a2891f800 20 rados->read ofs=0 len=0 2024-06-04T15:54:39.277 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.276+0000 7f3a2891f800 20 rados_obj.operate() r=0 bl.length=1139 2024-06-04T15:54:39.277 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.276+0000 7f3a2891f800 20 searching for the correct realm 2024-06-04T15:54:39.277 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.277+0000 7f3a2464f640 0 -- 172.21.15.144:0/3723670028 >> [v2:172.21.15.177:6816/2039473917,v1:172.21.15.177:6817/2039473917] conn(0x558f9691e480 msgr2=0x558f969208d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-06-04T15:54:39.280 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.280+0000 7f3a2464f640 0 -- 172.21.15.144:0/3723670028 >> [v2:172.21.15.177:6800/3891611393,v1:172.21.15.177:6801/3891611393] conn(0x7f3a1409dbe0 msgr2=0x7f3a14067300 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-06-04T15:54:39.288 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.287+0000 7f3a2891f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-06-04T15:54:39.288 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.287+0000 7f3a2891f800 20 RGWRados::pool_iterate: got zone_info.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767 2024-06-04T15:54:39.288 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.287+0000 7f3a2891f800 20 RGWRados::pool_iterate: got default.zone. 2024-06-04T15:54:39.288 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.287+0000 7f3a2891f800 20 RGWRados::pool_iterate: got zonegroup_info.abb22408-c332-4e28-8f7a-ff254ea2fed2 2024-06-04T15:54:39.289 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.287+0000 7f3a2891f800 20 RGWRados::pool_iterate: got zone_names.default 2024-06-04T15:54:39.289 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.287+0000 7f3a2891f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-06-04T15:54:39.289 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.287+0000 7f3a2891f800 20 rados->read ofs=0 len=0 2024-06-04T15:54:39.289 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.287+0000 7f3a2891f800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T15:54:39.289 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.287+0000 7f3a2891f800 20 rados->read ofs=0 len=0 2024-06-04T15:54:39.289 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.287+0000 7f3a2891f800 20 rados_obj.operate() r=0 bl.length=46 2024-06-04T15:54:39.289 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.287+0000 7f3a2891f800 20 rados->read ofs=0 len=0 2024-06-04T15:54:39.289 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.288+0000 7f3a2891f800 20 rados_obj.operate() r=0 bl.length=470 2024-06-04T15:54:39.289 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.288+0000 7f3a2891f800 20 zone default found 2024-06-04T15:54:39.289 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.288+0000 7f3a2891f800 4 Realm: () 2024-06-04T15:54:39.289 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.288+0000 7f3a2891f800 4 ZoneGroup: default (abb22408-c332-4e28-8f7a-ff254ea2fed2) 2024-06-04T15:54:39.289 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.288+0000 7f3a2891f800 4 Zone: default (be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767) 2024-06-04T15:54:39.290 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.288+0000 7f3a2891f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-06-04T15:54:39.290 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.288+0000 7f3a2891f800 20 zonegroup default 2024-06-04T15:54:39.290 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.288+0000 7f3a2891f800 20 rados->read ofs=0 len=0 2024-06-04T15:54:39.290 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.288+0000 7f3a2891f800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T15:54:39.290 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.288+0000 7f3a2891f800 20 rados->read ofs=0 len=0 2024-06-04T15:54:39.291 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.289+0000 7f3a2891f800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T15:54:39.291 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.289+0000 7f3a2891f800 20 rados->read ofs=0 len=0 2024-06-04T15:54:39.291 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.289+0000 7f3a2891f800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T15:54:39.291 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.289+0000 7f3a2891f800 20 started sync module instance, tier type = 2024-06-04T15:54:39.291 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.289+0000 7f3a2891f800 20 started zone id=be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767 (name=default) with tier type = 2024-06-04T15:54:39.304 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.304+0000 7f3a2891f800 20 add_watcher() i=0 2024-06-04T15:54:39.304 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.304+0000 7f3a2891f800 20 add_watcher() i=1 2024-06-04T15:54:39.304 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.304+0000 7f3a2891f800 20 add_watcher() i=2 2024-06-04T15:54:39.304 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.304+0000 7f3a2891f800 20 add_watcher() i=3 2024-06-04T15:54:39.304 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.304+0000 7f3a2891f800 20 add_watcher() i=4 2024-06-04T15:54:39.304 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.304+0000 7f3a2891f800 20 add_watcher() i=5 2024-06-04T15:54:39.304 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.304+0000 7f3a2891f800 20 add_watcher() i=6 2024-06-04T15:54:39.306 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.306+0000 7f3a2891f800 20 add_watcher() i=7 2024-06-04T15:54:39.307 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.306+0000 7f3a2891f800 2 all 8 watchers are set, enabling cache 2024-06-04T15:54:39.308 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.308+0000 7f38da7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-06-04T15:54:39.310 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.309+0000 7f3a2891f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-06-04T15:54:39.311 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.309+0000 7f3a2891f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-06-04T15:54:39.311 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.309+0000 7f3a2891f800 5 note: GC not initialized 2024-06-04T15:54:39.311 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.309+0000 7f38d97e2640 20 reqs_thread_entry: start 2024-06-04T15:54:39.311 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.309+0000 7f3a2891f800 20 init_complete bucket index max shards: 11 2024-06-04T15:54:39.311 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.309+0000 7f3a2891f800 20 Filter name: none 2024-06-04T15:54:39.311 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.309+0000 7f384affd640 20 reqs_thread_entry: start 2024-06-04T15:54:39.311 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.309+0000 7f3a2891f800 20 rados->read ofs=0 len=0 2024-06-04T15:54:39.311 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.310+0000 7f3a2891f800 20 rados_obj.operate() r=0 bl.length=190 2024-06-04T15:54:39.311 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.310+0000 7f3a2891f800 20 rados->read ofs=0 len=0 2024-06-04T15:54:39.311 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.310+0000 7f3a2891f800 20 rados_obj.operate() r=0 bl.length=404 2024-06-04T15:54:39.312 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.310+0000 7f3a2891f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-06-04T15:54:39.312 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.310+0000 7f3a2891f800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-06-04T15:54:39.312 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.310+0000 7f3a2891f800 20 INFO: main: starting shard=0 2024-06-04T15:54:39.312 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.310+0000 7f3a2891f800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.0 2024-06-04T15:54:39.312 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.310+0000 7f3a2891f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-06-04T15:54:39.312 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.310+0000 7f3a2891f800 20 INFO: main: starting shard=1 2024-06-04T15:54:39.312 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.310+0000 7f3a2891f800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.1 2024-06-04T15:54:39.313 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.311+0000 7f3a2891f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-06-04T15:54:39.314 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.311+0000 7f3a2891f800 20 INFO: main: starting shard=2 2024-06-04T15:54:39.314 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.311+0000 7f3a2891f800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.2 2024-06-04T15:54:39.314 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.311+0000 7f3a2891f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-06-04T15:54:39.314 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.311+0000 7f3a2891f800 20 INFO: main: starting shard=3 2024-06-04T15:54:39.314 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.311+0000 7f3a2891f800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.3 2024-06-04T15:54:39.314 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.312+0000 7f3a2891f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-06-04T15:54:39.314 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.312+0000 7f3a2891f800 20 INFO: main: starting shard=4 2024-06-04T15:54:39.314 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.312+0000 7f3a2891f800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.4 2024-06-04T15:54:39.314 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.312+0000 7f3a2891f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-06-04T15:54:39.314 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.312+0000 7f3a2891f800 20 INFO: main: starting shard=5 2024-06-04T15:54:39.314 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.312+0000 7f3a2891f800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.5 2024-06-04T15:54:39.315 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.313+0000 7f3a2891f800 20 INFO: main: bi_list() returned without error; entries.size()=5, is_truncated=0, marker= 2024-06-04T15:54:39.315 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.313+0000 7f3a2891f800 20 INFO: main: starting shard=6 2024-06-04T15:54:39.315 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.313+0000 7f3a2891f800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.6 2024-06-04T15:54:39.316 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.314+0000 7f3a2891f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-06-04T15:54:39.316 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.314+0000 7f3a2891f800 20 INFO: main: starting shard=7 2024-06-04T15:54:39.316 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.314+0000 7f3a2891f800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.7 2024-06-04T15:54:39.316 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.314+0000 7f3a2891f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-06-04T15:54:39.316 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.314+0000 7f3a2891f800 20 INFO: main: starting shard=8 2024-06-04T15:54:39.317 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.314+0000 7f3a2891f800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.8 2024-06-04T15:54:39.317 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.315+0000 7f3a2891f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-06-04T15:54:39.317 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.315+0000 7f3a2891f800 20 INFO: main: starting shard=9 2024-06-04T15:54:39.317 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.315+0000 7f3a2891f800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.9 2024-06-04T15:54:39.317 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.315+0000 7f3a2891f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-06-04T15:54:39.317 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.315+0000 7f3a2891f800 20 INFO: main: starting shard=10 2024-06-04T15:54:39.317 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.315+0000 7f3a2891f800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.10 2024-06-04T15:54:39.317 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.316+0000 7f3a2891f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-06-04T15:54:39.317 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.316+0000 7f3a2891f800 20 INFO: main: done 2024-06-04T15:54:39.318 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.317+0000 7f38da7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-06-04T15:54:39.319 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.319+0000 7f3a2891f800 20 remove_watcher() i=0 2024-06-04T15:54:39.319 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.319+0000 7f3a2891f800 2 removed watcher, disabling cache 2024-06-04T15:54:39.321 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.321+0000 7f3a2891f800 20 remove_watcher() i=1 2024-06-04T15:54:39.322 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.322+0000 7f3a2891f800 20 remove_watcher() i=2 2024-06-04T15:54:39.324 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.324+0000 7f3a2891f800 20 remove_watcher() i=3 2024-06-04T15:54:39.327 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.327+0000 7f3a2891f800 20 remove_watcher() i=4 2024-06-04T15:54:39.328 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.328+0000 7f3a2891f800 20 remove_watcher() i=5 2024-06-04T15:54:39.330 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.330+0000 7f3a2891f800 20 remove_watcher() i=6 2024-06-04T15:54:39.332 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.332+0000 7f3a2891f800 20 remove_watcher() i=7 2024-06-04T15:54:39.345 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T15:54:39.345 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T15:54:39.348 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T15:54:39.348 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T15:54:39.351 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T15:54:39.351 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T15:54:39.398 INFO:tasks.workunit.client.0.smithi144.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-06-04T15:54:39.400 INFO:tasks.workunit.client.0.smithi144.stderr:radosgw-admin bi list --bucket check-bucket --object e 2024-06-04T15:54:39.430 INFO:tasks.workunit.client.0.smithi144.stderr:ignoring --setuser ceph since I am not root 2024-06-04T15:54:39.431 INFO:tasks.workunit.client.0.smithi144.stderr:ignoring --setgroup ceph since I am not root 2024-06-04T15:54:39.469 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.468+0000 7f0d42733800 20 rados->read ofs=0 len=0 2024-06-04T15:54:39.469 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.469+0000 7f0d42733800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T15:54:39.470 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.469+0000 7f0d42733800 20 realm 2024-06-04T15:54:39.470 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.469+0000 7f0d42733800 20 rados->read ofs=0 len=0 2024-06-04T15:54:39.470 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.469+0000 7f0d42733800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T15:54:39.470 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.469+0000 7f0d42733800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-06-04T15:54:39.470 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.469+0000 7f0d42733800 20 rados->read ofs=0 len=0 2024-06-04T15:54:39.470 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.469+0000 7f0d42733800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T15:54:39.470 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.469+0000 7f0d42733800 20 rados->read ofs=0 len=0 2024-06-04T15:54:39.471 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.470+0000 7f0d42733800 20 rados_obj.operate() r=0 bl.length=46 2024-06-04T15:54:39.471 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.470+0000 7f0d42733800 20 rados->read ofs=0 len=0 2024-06-04T15:54:39.471 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.471+0000 7f0d42733800 20 rados_obj.operate() r=0 bl.length=1139 2024-06-04T15:54:39.471 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.471+0000 7f0d42733800 20 searching for the correct realm 2024-06-04T15:54:39.473 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.473+0000 7f0d3ebec640 0 -- 172.21.15.144:0/3477460296 >> [v2:172.21.15.144:6800/1453747520,v1:172.21.15.144:6801/1453747520] conn(0x7f0d34088060 msgr2=0x7f0d34002940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-06-04T15:54:39.678 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.678+0000 7f0d3ebec640 0 -- 172.21.15.144:0/3477460296 >> [v2:172.21.15.144:6824/166159729,v1:172.21.15.144:6825/166159729] conn(0x55f2997ee540 msgr2=0x55f2997f0930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-06-04T15:54:39.683 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.682+0000 7f0d42733800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-06-04T15:54:39.683 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.682+0000 7f0d42733800 20 RGWRados::pool_iterate: got zone_info.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767 2024-06-04T15:54:39.683 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.682+0000 7f0d42733800 20 RGWRados::pool_iterate: got default.zone. 2024-06-04T15:54:39.683 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.682+0000 7f0d42733800 20 RGWRados::pool_iterate: got zonegroup_info.abb22408-c332-4e28-8f7a-ff254ea2fed2 2024-06-04T15:54:39.683 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.682+0000 7f0d42733800 20 RGWRados::pool_iterate: got zone_names.default 2024-06-04T15:54:39.683 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.682+0000 7f0d42733800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-06-04T15:54:39.683 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.682+0000 7f0d42733800 20 rados->read ofs=0 len=0 2024-06-04T15:54:39.683 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.683+0000 7f0d42733800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T15:54:39.683 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.683+0000 7f0d42733800 20 rados->read ofs=0 len=0 2024-06-04T15:54:39.684 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.683+0000 7f0d42733800 20 rados_obj.operate() r=0 bl.length=46 2024-06-04T15:54:39.685 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.683+0000 7f0d42733800 20 rados->read ofs=0 len=0 2024-06-04T15:54:39.685 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.683+0000 7f0d42733800 20 rados_obj.operate() r=0 bl.length=470 2024-06-04T15:54:39.685 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.683+0000 7f0d42733800 20 zone default found 2024-06-04T15:54:39.685 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.683+0000 7f0d42733800 4 Realm: () 2024-06-04T15:54:39.685 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.683+0000 7f0d42733800 4 ZoneGroup: default (abb22408-c332-4e28-8f7a-ff254ea2fed2) 2024-06-04T15:54:39.685 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.683+0000 7f0d42733800 4 Zone: default (be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767) 2024-06-04T15:54:39.685 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.683+0000 7f0d42733800 10 cannot find current period zonegroup using local zonegroup configuration 2024-06-04T15:54:39.685 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.683+0000 7f0d42733800 20 zonegroup default 2024-06-04T15:54:39.685 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.683+0000 7f0d42733800 20 rados->read ofs=0 len=0 2024-06-04T15:54:39.685 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.684+0000 7f0d42733800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T15:54:39.685 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.684+0000 7f0d42733800 20 rados->read ofs=0 len=0 2024-06-04T15:54:39.685 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.684+0000 7f0d42733800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T15:54:39.685 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.684+0000 7f0d42733800 20 rados->read ofs=0 len=0 2024-06-04T15:54:39.686 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.684+0000 7f0d42733800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T15:54:39.686 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.684+0000 7f0d42733800 20 started sync module instance, tier type = 2024-06-04T15:54:39.686 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.684+0000 7f0d42733800 20 started zone id=be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767 (name=default) with tier type = 2024-06-04T15:54:39.698 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.698+0000 7f0d42733800 20 add_watcher() i=0 2024-06-04T15:54:39.698 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.698+0000 7f0d42733800 20 add_watcher() i=1 2024-06-04T15:54:39.699 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.698+0000 7f0d42733800 20 add_watcher() i=2 2024-06-04T15:54:39.699 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.698+0000 7f0d42733800 20 add_watcher() i=3 2024-06-04T15:54:39.699 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.698+0000 7f0d42733800 20 add_watcher() i=4 2024-06-04T15:54:39.699 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.698+0000 7f0d42733800 20 add_watcher() i=5 2024-06-04T15:54:39.699 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.698+0000 7f0d42733800 20 add_watcher() i=6 2024-06-04T15:54:39.701 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.701+0000 7f0d42733800 20 add_watcher() i=7 2024-06-04T15:54:39.701 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.701+0000 7f0d42733800 2 all 8 watchers are set, enabling cache 2024-06-04T15:54:39.702 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.702+0000 7f0bf4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-06-04T15:54:39.703 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.703+0000 7f0d42733800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-06-04T15:54:39.703 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.703+0000 7f0d42733800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-06-04T15:54:39.703 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.703+0000 7f0d42733800 5 note: GC not initialized 2024-06-04T15:54:39.703 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.703+0000 7f0b6f7fe640 20 reqs_thread_entry: start 2024-06-04T15:54:39.704 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.703+0000 7f0d42733800 20 init_complete bucket index max shards: 11 2024-06-04T15:54:39.704 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.703+0000 7f0d42733800 20 Filter name: none 2024-06-04T15:54:39.704 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.703+0000 7f0b6d7fa640 20 reqs_thread_entry: start 2024-06-04T15:54:39.704 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.703+0000 7f0d42733800 20 rados->read ofs=0 len=0 2024-06-04T15:54:39.704 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.704+0000 7f0d42733800 20 rados_obj.operate() r=0 bl.length=190 2024-06-04T15:54:39.704 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.704+0000 7f0d42733800 20 rados->read ofs=0 len=0 2024-06-04T15:54:39.705 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.704+0000 7f0d42733800 20 rados_obj.operate() r=0 bl.length=404 2024-06-04T15:54:39.705 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.704+0000 7f0d42733800 20 couldn't put binfo cache entry, might have raced with data changes 2024-06-04T15:54:39.705 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.704+0000 7f0d42733800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-06-04T15:54:39.705 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.704+0000 7f0d42733800 20 INFO: main: starting shard=0 2024-06-04T15:54:39.705 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.704+0000 7f0d42733800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.0 2024-06-04T15:54:39.706 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.705+0000 7f0d42733800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-06-04T15:54:39.706 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.705+0000 7f0d42733800 20 INFO: main: starting shard=1 2024-06-04T15:54:39.706 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.705+0000 7f0d42733800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.1 2024-06-04T15:54:39.706 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.705+0000 7f0d42733800 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-06-04T15:54:39.706 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.705+0000 7f0d42733800 20 INFO: main: starting shard=2 2024-06-04T15:54:39.706 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.705+0000 7f0d42733800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.2 2024-06-04T15:54:39.706 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.706+0000 7f0d42733800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-06-04T15:54:39.706 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.706+0000 7f0d42733800 20 INFO: main: starting shard=3 2024-06-04T15:54:39.706 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.706+0000 7f0d42733800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.3 2024-06-04T15:54:39.707 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.706+0000 7f0d42733800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-06-04T15:54:39.707 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.706+0000 7f0d42733800 20 INFO: main: starting shard=4 2024-06-04T15:54:39.707 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.706+0000 7f0d42733800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.4 2024-06-04T15:54:39.707 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.706+0000 7f0d42733800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-06-04T15:54:39.707 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.706+0000 7f0d42733800 20 INFO: main: starting shard=5 2024-06-04T15:54:39.708 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.706+0000 7f0d42733800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.5 2024-06-04T15:54:39.708 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.707+0000 7f0d42733800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-06-04T15:54:39.708 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.707+0000 7f0d42733800 20 INFO: main: starting shard=6 2024-06-04T15:54:39.708 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.707+0000 7f0d42733800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.6 2024-06-04T15:54:39.708 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.707+0000 7f0d42733800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-06-04T15:54:39.709 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.707+0000 7f0d42733800 20 INFO: main: starting shard=7 2024-06-04T15:54:39.709 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.707+0000 7f0d42733800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.7 2024-06-04T15:54:39.709 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.708+0000 7f0d42733800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-06-04T15:54:39.709 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.708+0000 7f0d42733800 20 INFO: main: starting shard=8 2024-06-04T15:54:39.709 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.708+0000 7f0d42733800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.8 2024-06-04T15:54:39.709 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.708+0000 7f0d42733800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-06-04T15:54:39.709 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.708+0000 7f0d42733800 20 INFO: main: starting shard=9 2024-06-04T15:54:39.709 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.708+0000 7f0d42733800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.9 2024-06-04T15:54:39.710 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.709+0000 7f0d42733800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-06-04T15:54:39.710 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.709+0000 7f0d42733800 20 INFO: main: starting shard=10 2024-06-04T15:54:39.710 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.709+0000 7f0d42733800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.10 2024-06-04T15:54:39.710 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.709+0000 7f0d42733800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-06-04T15:54:39.710 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.709+0000 7f0d42733800 20 INFO: main: done 2024-06-04T15:54:39.710 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.710+0000 7f0bf4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-06-04T15:54:39.712 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.712+0000 7f0d42733800 20 remove_watcher() i=0 2024-06-04T15:54:39.712 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.712+0000 7f0d42733800 2 removed watcher, disabling cache 2024-06-04T15:54:39.713 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.713+0000 7f0d42733800 20 remove_watcher() i=1 2024-06-04T15:54:39.714 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.714+0000 7f0d42733800 20 remove_watcher() i=2 2024-06-04T15:54:39.715 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.715+0000 7f0d42733800 20 remove_watcher() i=3 2024-06-04T15:54:39.716 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.716+0000 7f0d42733800 20 remove_watcher() i=4 2024-06-04T15:54:39.717 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.717+0000 7f0d42733800 20 remove_watcher() i=5 2024-06-04T15:54:39.718 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.718+0000 7f0d42733800 20 remove_watcher() i=6 2024-06-04T15:54:39.720 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.719+0000 7f0d42733800 20 remove_watcher() i=7 2024-06-04T15:54:39.733 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T15:54:39.734 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T15:54:39.737 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T15:54:39.737 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T15:54:39.785 INFO:tasks.workunit.client.0.smithi144.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-06-04T15:54:39.787 INFO:tasks.workunit.client.0.smithi144.stderr:radosgw-admin bi list --bucket check-bucket --object f 2024-06-04T15:54:39.817 INFO:tasks.workunit.client.0.smithi144.stderr:ignoring --setuser ceph since I am not root 2024-06-04T15:54:39.818 INFO:tasks.workunit.client.0.smithi144.stderr:ignoring --setgroup ceph since I am not root 2024-06-04T15:54:39.853 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.853+0000 7f6053298800 20 rados->read ofs=0 len=0 2024-06-04T15:54:39.856 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.855+0000 7f6053298800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T15:54:39.856 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.855+0000 7f6053298800 20 realm 2024-06-04T15:54:39.856 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.855+0000 7f6053298800 20 rados->read ofs=0 len=0 2024-06-04T15:54:39.856 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.856+0000 7f6053298800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T15:54:39.856 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.856+0000 7f6053298800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-06-04T15:54:39.856 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.856+0000 7f6053298800 20 rados->read ofs=0 len=0 2024-06-04T15:54:39.856 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.856+0000 7f6053298800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T15:54:39.856 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.856+0000 7f6053298800 20 rados->read ofs=0 len=0 2024-06-04T15:54:39.857 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.856+0000 7f6053298800 20 rados_obj.operate() r=0 bl.length=46 2024-06-04T15:54:39.857 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.856+0000 7f6053298800 20 rados->read ofs=0 len=0 2024-06-04T15:54:39.857 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.857+0000 7f6053298800 20 rados_obj.operate() r=0 bl.length=1139 2024-06-04T15:54:39.857 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.857+0000 7f6053298800 20 searching for the correct realm 2024-06-04T15:54:39.859 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:39.859+0000 7f6051595640 0 -- 172.21.15.144:0/1577299430 >> [v2:172.21.15.144:6800/1453747520,v1:172.21.15.144:6801/1453747520] conn(0x7f60380b2760 msgr2=0x7f60380a8ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-06-04T15:54:40.064 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:40.063+0000 7f6051595640 0 -- 172.21.15.144:0/1577299430 >> [v2:172.21.15.144:6824/166159729,v1:172.21.15.144:6825/166159729] conn(0x5562520a2880 msgr2=0x5562520a4c70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-06-04T15:54:40.069 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:40.068+0000 7f6053298800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-06-04T15:54:40.070 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:40.068+0000 7f6053298800 20 RGWRados::pool_iterate: got zone_info.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767 2024-06-04T15:54:40.070 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:40.068+0000 7f6053298800 20 RGWRados::pool_iterate: got default.zone. 2024-06-04T15:54:40.070 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:40.068+0000 7f6053298800 20 RGWRados::pool_iterate: got zonegroup_info.abb22408-c332-4e28-8f7a-ff254ea2fed2 2024-06-04T15:54:40.070 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:40.068+0000 7f6053298800 20 RGWRados::pool_iterate: got zone_names.default 2024-06-04T15:54:40.070 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:40.068+0000 7f6053298800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-06-04T15:54:40.070 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:40.068+0000 7f6053298800 20 rados->read ofs=0 len=0 2024-06-04T15:54:40.071 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:40.069+0000 7f6053298800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T15:54:40.071 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:40.069+0000 7f6053298800 20 rados->read ofs=0 len=0 2024-06-04T15:54:40.071 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:40.069+0000 7f6053298800 20 rados_obj.operate() r=0 bl.length=46 2024-06-04T15:54:40.071 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:40.069+0000 7f6053298800 20 rados->read ofs=0 len=0 2024-06-04T15:54:40.072 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:40.069+0000 7f6053298800 20 rados_obj.operate() r=0 bl.length=470 2024-06-04T15:54:40.072 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:40.069+0000 7f6053298800 20 zone default found 2024-06-04T15:54:40.072 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:40.069+0000 7f6053298800 4 Realm: () 2024-06-04T15:54:40.072 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:40.069+0000 7f6053298800 4 ZoneGroup: default (abb22408-c332-4e28-8f7a-ff254ea2fed2) 2024-06-04T15:54:40.072 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:40.069+0000 7f6053298800 4 Zone: default (be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767) 2024-06-04T15:54:40.072 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:40.069+0000 7f6053298800 10 cannot find current period zonegroup using local zonegroup configuration 2024-06-04T15:54:40.072 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:40.069+0000 7f6053298800 20 zonegroup default 2024-06-04T15:54:40.072 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:40.069+0000 7f6053298800 20 rados->read ofs=0 len=0 2024-06-04T15:54:40.073 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:40.069+0000 7f6053298800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T15:54:40.073 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:40.070+0000 7f6053298800 20 rados->read ofs=0 len=0 2024-06-04T15:54:40.073 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:40.070+0000 7f6053298800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T15:54:40.073 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:40.070+0000 7f6053298800 20 rados->read ofs=0 len=0 2024-06-04T15:54:40.073 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:40.070+0000 7f6053298800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T15:54:40.073 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:40.070+0000 7f6053298800 20 started sync module instance, tier type = 2024-06-04T15:54:40.073 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:40.070+0000 7f6053298800 20 started zone id=be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767 (name=default) with tier type = 2024-06-04T15:54:40.079 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:40.079+0000 7f6053298800 20 add_watcher() i=0 2024-06-04T15:54:40.079 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:40.079+0000 7f6053298800 20 add_watcher() i=1 2024-06-04T15:54:40.079 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:40.079+0000 7f6053298800 20 add_watcher() i=2 2024-06-04T15:54:40.079 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:40.079+0000 7f6053298800 20 add_watcher() i=3 2024-06-04T15:54:40.079 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:40.079+0000 7f6053298800 20 add_watcher() i=4 2024-06-04T15:54:40.079 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:40.079+0000 7f6053298800 20 add_watcher() i=5 2024-06-04T15:54:40.080 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:40.080+0000 7f6053298800 20 add_watcher() i=6 2024-06-04T15:54:40.080 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:40.080+0000 7f6053298800 20 add_watcher() i=7 2024-06-04T15:54:40.080 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:40.080+0000 7f6053298800 2 all 8 watchers are set, enabling cache 2024-06-04T15:54:40.082 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:40.082+0000 7f5f06fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-06-04T15:54:40.083 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:40.083+0000 7f6053298800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-06-04T15:54:40.083 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:40.083+0000 7f6053298800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-06-04T15:54:40.084 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:40.083+0000 7f6053298800 5 note: GC not initialized 2024-06-04T15:54:40.084 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:40.083+0000 7f5f05fe3640 20 reqs_thread_entry: start 2024-06-04T15:54:40.084 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:40.083+0000 7f6053298800 20 init_complete bucket index max shards: 11 2024-06-04T15:54:40.084 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:40.083+0000 7f6053298800 20 Filter name: none 2024-06-04T15:54:40.084 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:40.083+0000 7f5e777fe640 20 reqs_thread_entry: start 2024-06-04T15:54:40.084 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:40.083+0000 7f6053298800 20 rados->read ofs=0 len=0 2024-06-04T15:54:40.085 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:40.084+0000 7f6053298800 20 rados_obj.operate() r=0 bl.length=190 2024-06-04T15:54:40.085 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:40.084+0000 7f6053298800 20 rados->read ofs=0 len=0 2024-06-04T15:54:40.085 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:40.084+0000 7f6053298800 20 rados_obj.operate() r=0 bl.length=404 2024-06-04T15:54:40.085 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:40.084+0000 7f6053298800 20 couldn't put binfo cache entry, might have raced with data changes 2024-06-04T15:54:40.085 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:40.084+0000 7f6053298800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-06-04T15:54:40.085 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:40.084+0000 7f6053298800 20 INFO: main: starting shard=0 2024-06-04T15:54:40.085 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:40.084+0000 7f6053298800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.0 2024-06-04T15:54:40.085 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:40.085+0000 7f6053298800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-06-04T15:54:40.085 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:40.085+0000 7f6053298800 20 INFO: main: starting shard=1 2024-06-04T15:54:40.085 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:40.085+0000 7f6053298800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.1 2024-06-04T15:54:40.086 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:40.085+0000 7f6053298800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-06-04T15:54:40.087 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:40.085+0000 7f6053298800 20 INFO: main: starting shard=2 2024-06-04T15:54:40.087 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:40.085+0000 7f6053298800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.2 2024-06-04T15:54:40.087 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:40.086+0000 7f6053298800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-06-04T15:54:40.087 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:40.086+0000 7f6053298800 20 INFO: main: starting shard=3 2024-06-04T15:54:40.087 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:40.086+0000 7f6053298800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.3 2024-06-04T15:54:40.087 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:40.086+0000 7f6053298800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-06-04T15:54:40.087 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:40.086+0000 7f6053298800 20 INFO: main: starting shard=4 2024-06-04T15:54:40.087 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:40.086+0000 7f6053298800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.4 2024-06-04T15:54:40.087 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:40.086+0000 7f6053298800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-06-04T15:54:40.087 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:40.086+0000 7f6053298800 20 INFO: main: starting shard=5 2024-06-04T15:54:40.087 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:40.086+0000 7f6053298800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.5 2024-06-04T15:54:40.088 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:40.087+0000 7f6053298800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-06-04T15:54:40.088 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:40.087+0000 7f6053298800 20 INFO: main: starting shard=6 2024-06-04T15:54:40.088 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:40.087+0000 7f6053298800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.6 2024-06-04T15:54:40.088 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:40.087+0000 7f6053298800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-06-04T15:54:40.088 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:40.087+0000 7f6053298800 20 INFO: main: starting shard=7 2024-06-04T15:54:40.088 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:40.087+0000 7f6053298800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.7 2024-06-04T15:54:40.089 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:40.088+0000 7f6053298800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-06-04T15:54:40.089 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:40.088+0000 7f6053298800 20 INFO: main: starting shard=8 2024-06-04T15:54:40.089 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:40.088+0000 7f6053298800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.8 2024-06-04T15:54:40.090 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:40.088+0000 7f6053298800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-06-04T15:54:40.090 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:40.088+0000 7f6053298800 20 INFO: main: starting shard=9 2024-06-04T15:54:40.090 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:40.088+0000 7f6053298800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.9 2024-06-04T15:54:40.090 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:40.089+0000 7f6053298800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-06-04T15:54:40.090 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:40.089+0000 7f6053298800 20 INFO: main: starting shard=10 2024-06-04T15:54:40.090 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:40.089+0000 7f6053298800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.10 2024-06-04T15:54:40.090 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:40.089+0000 7f6053298800 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-06-04T15:54:40.090 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:40.089+0000 7f6053298800 20 INFO: main: done 2024-06-04T15:54:40.091 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:40.090+0000 7f5f06fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-06-04T15:54:40.092 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:40.092+0000 7f6053298800 20 remove_watcher() i=0 2024-06-04T15:54:40.093 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:40.092+0000 7f6053298800 2 removed watcher, disabling cache 2024-06-04T15:54:40.093 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:40.093+0000 7f6053298800 20 remove_watcher() i=1 2024-06-04T15:54:40.095 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:40.095+0000 7f6053298800 20 remove_watcher() i=2 2024-06-04T15:54:40.095 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:40.096+0000 7f6053298800 20 remove_watcher() i=3 2024-06-04T15:54:40.097 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:40.097+0000 7f6053298800 20 remove_watcher() i=4 2024-06-04T15:54:40.098 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:40.098+0000 7f6053298800 20 remove_watcher() i=5 2024-06-04T15:54:40.099 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:40.099+0000 7f6053298800 20 remove_watcher() i=6 2024-06-04T15:54:40.100 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:40.100+0000 7f6053298800 20 remove_watcher() i=7 2024-06-04T15:54:40.113 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T15:54:40.113 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T15:54:40.116 INFO:tasks.workunit.client.0.smithi144.stderr:ceph config rm client rgw_debug_inject_set_olh_err 2024-06-04T15:54:40.521 INFO:tasks.workunit.client.0.smithi144.stderr:ceph config rm client rgw_debug_inject_olh_cancel_modification_err 2024-06-04T15:54:40.920 INFO:tasks.workunit.client.0.smithi144.stderr:TEST: bucket check unlinked finds unlistable entries 2024-06-04T15:54:40.920 INFO:tasks.workunit.client.0.smithi144.stderr: 2024-06-04T15:54:40.921 INFO:tasks.workunit.client.0.smithi144.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --min-age-hours 0 --dump-keys 2024-06-04T15:54:40.954 INFO:tasks.workunit.client.0.smithi144.stderr:ignoring --setuser ceph since I am not root 2024-06-04T15:54:40.954 INFO:tasks.workunit.client.0.smithi144.stderr:ignoring --setgroup ceph since I am not root 2024-06-04T15:54:40.991 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:40.990+0000 7fb51901d800 20 rados->read ofs=0 len=0 2024-06-04T15:54:40.992 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:40.992+0000 7fb51901d800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T15:54:40.992 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:40.992+0000 7fb51901d800 20 realm 2024-06-04T15:54:40.993 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:40.992+0000 7fb51901d800 20 rados->read ofs=0 len=0 2024-06-04T15:54:40.993 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:40.992+0000 7fb51901d800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T15:54:40.993 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:40.992+0000 7fb51901d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-06-04T15:54:40.993 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:40.992+0000 7fb51901d800 20 rados->read ofs=0 len=0 2024-06-04T15:54:40.993 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:40.992+0000 7fb51901d800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T15:54:40.993 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:40.992+0000 7fb51901d800 20 rados->read ofs=0 len=0 2024-06-04T15:54:40.994 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:40.993+0000 7fb51901d800 20 rados_obj.operate() r=0 bl.length=46 2024-06-04T15:54:40.994 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:40.993+0000 7fb51901d800 20 rados->read ofs=0 len=0 2024-06-04T15:54:40.994 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:40.994+0000 7fb51901d800 20 rados_obj.operate() r=0 bl.length=1139 2024-06-04T15:54:40.994 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:40.994+0000 7fb51901d800 20 searching for the correct realm 2024-06-04T15:54:40.996 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:40.996+0000 7fb516311640 0 -- 172.21.15.144:0/1836290147 >> [v2:172.21.15.144:6816/2358575268,v1:172.21.15.144:6817/2358575268] conn(0x56388d0c3230 msgr2=0x56388d0c5620 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-06-04T15:54:40.999 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:40.999+0000 7fb516311640 0 -- 172.21.15.144:0/1836290147 >> [v2:172.21.15.177:6808/2618477608,v1:172.21.15.177:6809/2618477608] conn(0x7fb50c038440 msgr2=0x7fb50c0388c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-06-04T15:54:41.207 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.206+0000 7fb51901d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-06-04T15:54:41.207 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.206+0000 7fb51901d800 20 RGWRados::pool_iterate: got zone_info.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767 2024-06-04T15:54:41.207 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.206+0000 7fb51901d800 20 RGWRados::pool_iterate: got default.zone. 2024-06-04T15:54:41.207 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.206+0000 7fb51901d800 20 RGWRados::pool_iterate: got zonegroup_info.abb22408-c332-4e28-8f7a-ff254ea2fed2 2024-06-04T15:54:41.207 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.206+0000 7fb51901d800 20 RGWRados::pool_iterate: got zone_names.default 2024-06-04T15:54:41.208 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.206+0000 7fb51901d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-06-04T15:54:41.208 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.206+0000 7fb51901d800 20 rados->read ofs=0 len=0 2024-06-04T15:54:41.208 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.207+0000 7fb51901d800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T15:54:41.208 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.207+0000 7fb51901d800 20 rados->read ofs=0 len=0 2024-06-04T15:54:41.208 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.207+0000 7fb51901d800 20 rados_obj.operate() r=0 bl.length=46 2024-06-04T15:54:41.208 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.207+0000 7fb51901d800 20 rados->read ofs=0 len=0 2024-06-04T15:54:41.209 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.207+0000 7fb51901d800 20 rados_obj.operate() r=0 bl.length=470 2024-06-04T15:54:41.209 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.207+0000 7fb51901d800 20 zone default found 2024-06-04T15:54:41.209 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.207+0000 7fb51901d800 4 Realm: () 2024-06-04T15:54:41.209 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.207+0000 7fb51901d800 4 ZoneGroup: default (abb22408-c332-4e28-8f7a-ff254ea2fed2) 2024-06-04T15:54:41.209 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.207+0000 7fb51901d800 4 Zone: default (be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767) 2024-06-04T15:54:41.209 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.207+0000 7fb51901d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-06-04T15:54:41.209 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.207+0000 7fb51901d800 20 zonegroup default 2024-06-04T15:54:41.209 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.207+0000 7fb51901d800 20 rados->read ofs=0 len=0 2024-06-04T15:54:41.210 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.208+0000 7fb51901d800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T15:54:41.210 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.208+0000 7fb51901d800 20 rados->read ofs=0 len=0 2024-06-04T15:54:41.210 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.208+0000 7fb51901d800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T15:54:41.210 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.208+0000 7fb51901d800 20 rados->read ofs=0 len=0 2024-06-04T15:54:41.210 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.208+0000 7fb51901d800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T15:54:41.210 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.208+0000 7fb51901d800 20 started sync module instance, tier type = 2024-06-04T15:54:41.210 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.208+0000 7fb51901d800 20 started zone id=be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767 (name=default) with tier type = 2024-06-04T15:54:41.224 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.224+0000 7fb51901d800 20 add_watcher() i=0 2024-06-04T15:54:41.224 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.224+0000 7fb51901d800 20 add_watcher() i=1 2024-06-04T15:54:41.224 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.224+0000 7fb51901d800 20 add_watcher() i=2 2024-06-04T15:54:41.224 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.224+0000 7fb51901d800 20 add_watcher() i=3 2024-06-04T15:54:41.224 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.224+0000 7fb51901d800 20 add_watcher() i=4 2024-06-04T15:54:41.224 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.224+0000 7fb51901d800 20 add_watcher() i=5 2024-06-04T15:54:41.224 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.224+0000 7fb51901d800 20 add_watcher() i=6 2024-06-04T15:54:41.227 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.227+0000 7fb51901d800 20 add_watcher() i=7 2024-06-04T15:54:41.227 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.227+0000 7fb51901d800 2 all 8 watchers are set, enabling cache 2024-06-04T15:54:41.229 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.229+0000 7fb3cd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-06-04T15:54:41.230 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.229+0000 7fb51901d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-06-04T15:54:41.230 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.229+0000 7fb51901d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-06-04T15:54:41.230 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.229+0000 7fb51901d800 5 note: GC not initialized 2024-06-04T15:54:41.230 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.230+0000 7fb347fff640 20 reqs_thread_entry: start 2024-06-04T15:54:41.230 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.230+0000 7fb51901d800 20 init_complete bucket index max shards: 11 2024-06-04T15:54:41.231 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.230+0000 7fb51901d800 20 Filter name: none 2024-06-04T15:54:41.231 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.230+0000 7fb345ffb640 20 reqs_thread_entry: start 2024-06-04T15:54:41.231 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.230+0000 7fb51901d800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-06-04T15:54:41.231 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.230+0000 7fb51901d800 20 rados->read ofs=0 len=0 2024-06-04T15:54:41.232 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.230+0000 7fb51901d800 20 rados_obj.operate() r=0 bl.length=190 2024-06-04T15:54:41.232 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.230+0000 7fb51901d800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-06-04T15:54:41.232 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.230+0000 7fb51901d800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-06-04T15:54:41.232 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.230+0000 7fb51901d800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1 : miss 2024-06-04T15:54:41.232 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.230+0000 7fb51901d800 20 rados->read ofs=0 len=0 2024-06-04T15:54:41.232 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.231+0000 7fb51901d800 20 rados_obj.operate() r=0 bl.length=404 2024-06-04T15:54:41.232 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.231+0000 7fb51901d800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1 info.flags=0x17 2024-06-04T15:54:41.233 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.231+0000 7fb51901d800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1 to cache LRU end 2024-06-04T15:54:41.233 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.231+0000 7fb51901d800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-06-04T15:54:41.233 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.231+0000 7fb51901d800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-06-04T15:54:41.233 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.231+0000 7fb51901d800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1 2024-06-04T15:54:41.233 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.231+0000 7fb51901d800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.0 2024-06-04T15:54:41.233 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.231+0000 7fb51901d800 1 NOTICE: finished shard 0 (0 entries found) 2024-06-04T15:54:41.233 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.231+0000 7fb51901d800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.1 2024-06-04T15:54:41.233 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.232+0000 7fb51901d800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.2 2024-06-04T15:54:41.234 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.233+0000 7fb51901d800 1 NOTICE: finished shard 2 (0 entries found) 2024-06-04T15:54:41.234 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.233+0000 7fb51901d800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.3 2024-06-04T15:54:41.234 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.233+0000 7fb51901d800 1 NOTICE: finished shard 3 (0 entries found) 2024-06-04T15:54:41.234 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.233+0000 7fb51901d800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.4 2024-06-04T15:54:41.234 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.234+0000 7fb51901d800 1 NOTICE: finished shard 4 (0 entries found) 2024-06-04T15:54:41.237 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.234+0000 7fb51901d800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.5 2024-06-04T15:54:41.238 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.234+0000 7fb51901d800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.6 2024-06-04T15:54:41.239 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.235+0000 7fb51901d800 1 NOTICE: finished shard 6 (0 entries found) 2024-06-04T15:54:41.239 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.235+0000 7fb51901d800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.7 2024-06-04T15:54:41.239 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.235+0000 7fb51901d800 1 NOTICE: finished shard 7 (0 entries found) 2024-06-04T15:54:41.239 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.235+0000 7fb51901d800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.8 2024-06-04T15:54:41.239 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.236+0000 7fb51901d800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.9 2024-06-04T15:54:41.239 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.236+0000 7fb51901d800 1 NOTICE: finished shard 9 (0 entries found) 2024-06-04T15:54:41.239 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.236+0000 7fb51901d800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.10 2024-06-04T15:54:41.239 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.237+0000 7fb51901d800 1 NOTICE: finished shard 1 (1 entries found) 2024-06-04T15:54:41.239 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.237+0000 7fb51901d800 1 NOTICE: finished shard 5 (1 entries found) 2024-06-04T15:54:41.239 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.237+0000 7fb51901d800 1 NOTICE: finished shard 8 (1 entries found) 2024-06-04T15:54:41.240 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.237+0000 7fb51901d800 1 NOTICE: finished shard 10 (1 entries found) 2024-06-04T15:54:41.240 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.237+0000 7fb51901d800 1 NOTICE: finished all shards (4 entries found) 2024-06-04T15:54:41.240 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.238+0000 7fb3cd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-06-04T15:54:41.241 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.241+0000 7fb51901d800 20 remove_watcher() i=0 2024-06-04T15:54:41.241 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.241+0000 7fb51901d800 2 removed watcher, disabling cache 2024-06-04T15:54:41.242 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.242+0000 7fb51901d800 20 remove_watcher() i=1 2024-06-04T15:54:41.245 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.245+0000 7fb51901d800 20 remove_watcher() i=2 2024-06-04T15:54:41.246 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.246+0000 7fb51901d800 20 remove_watcher() i=3 2024-06-04T15:54:41.247 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.247+0000 7fb51901d800 20 remove_watcher() i=4 2024-06-04T15:54:41.248 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.248+0000 7fb51901d800 20 remove_watcher() i=5 2024-06-04T15:54:41.251 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.250+0000 7fb51901d800 20 remove_watcher() i=6 2024-06-04T15:54:41.252 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.252+0000 7fb51901d800 20 remove_watcher() i=7 2024-06-04T15:54:41.262 INFO:tasks.workunit.client.0.smithi144.stderr:TEST: unlinked entries are not listable 2024-06-04T15:54:41.262 INFO:tasks.workunit.client.0.smithi144.stderr: 2024-06-04T15:54:41.265 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T15:54:41.265 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T15:54:41.270 INFO:tasks.workunit.client.0.smithi144.stderr:TEST: GET returns 404 for unlinked entry keys that have no other versions 2024-06-04T15:54:41.270 INFO:tasks.workunit.client.0.smithi144.stderr: 2024-06-04T15:54:41.272 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T15:54:41.272 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T15:54:41.317 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T15:54:41.317 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T15:54:41.359 INFO:tasks.workunit.client.0.smithi144.stderr:TEST: bucket check unlinked fixes unlistable entries 2024-06-04T15:54:41.359 INFO:tasks.workunit.client.0.smithi144.stderr: 2024-06-04T15:54:41.360 INFO:tasks.workunit.client.0.smithi144.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --fix --min-age-hours 0 --rgw-olh-pending-timeout-sec 0 --dump-keys 2024-06-04T15:54:41.394 INFO:tasks.workunit.client.0.smithi144.stderr:ignoring --setuser ceph since I am not root 2024-06-04T15:54:41.394 INFO:tasks.workunit.client.0.smithi144.stderr:ignoring --setgroup ceph since I am not root 2024-06-04T15:54:41.431 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.430+0000 7ff968632800 20 rados->read ofs=0 len=0 2024-06-04T15:54:41.433 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.432+0000 7ff968632800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T15:54:41.433 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.432+0000 7ff968632800 20 realm 2024-06-04T15:54:41.433 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.432+0000 7ff968632800 20 rados->read ofs=0 len=0 2024-06-04T15:54:41.433 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.432+0000 7ff968632800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T15:54:41.433 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.432+0000 7ff968632800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-06-04T15:54:41.433 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.432+0000 7ff968632800 20 rados->read ofs=0 len=0 2024-06-04T15:54:41.433 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.432+0000 7ff968632800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T15:54:41.433 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.432+0000 7ff968632800 20 rados->read ofs=0 len=0 2024-06-04T15:54:41.434 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.433+0000 7ff968632800 20 rados_obj.operate() r=0 bl.length=46 2024-06-04T15:54:41.434 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.433+0000 7ff968632800 20 rados->read ofs=0 len=0 2024-06-04T15:54:41.434 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.434+0000 7ff968632800 20 rados_obj.operate() r=0 bl.length=1139 2024-06-04T15:54:41.434 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.434+0000 7ff968632800 20 searching for the correct realm 2024-06-04T15:54:41.436 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.436+0000 7ff964070640 0 -- 172.21.15.144:0/1621775158 >> [v2:172.21.15.144:6800/1453747520,v1:172.21.15.144:6801/1453747520] conn(0x7ff94c009040 msgr2=0x7ff94c0743c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-06-04T15:54:41.440 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.440+0000 7ff964070640 0 -- 172.21.15.144:0/1621775158 >> [v2:172.21.15.144:6824/166159729,v1:172.21.15.144:6825/166159729] conn(0x562b93008620 msgr2=0x562b9300aa30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-06-04T15:54:41.446 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.445+0000 7ff968632800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-06-04T15:54:41.446 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.445+0000 7ff968632800 20 RGWRados::pool_iterate: got zone_info.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767 2024-06-04T15:54:41.446 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.445+0000 7ff968632800 20 RGWRados::pool_iterate: got default.zone. 2024-06-04T15:54:41.446 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.445+0000 7ff968632800 20 RGWRados::pool_iterate: got zonegroup_info.abb22408-c332-4e28-8f7a-ff254ea2fed2 2024-06-04T15:54:41.446 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.445+0000 7ff968632800 20 RGWRados::pool_iterate: got zone_names.default 2024-06-04T15:54:41.446 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.445+0000 7ff968632800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-06-04T15:54:41.446 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.445+0000 7ff968632800 20 rados->read ofs=0 len=0 2024-06-04T15:54:41.446 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.445+0000 7ff968632800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T15:54:41.446 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.445+0000 7ff968632800 20 rados->read ofs=0 len=0 2024-06-04T15:54:41.447 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.445+0000 7ff968632800 20 rados_obj.operate() r=0 bl.length=46 2024-06-04T15:54:41.447 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.445+0000 7ff968632800 20 rados->read ofs=0 len=0 2024-06-04T15:54:41.447 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.446+0000 7ff968632800 20 rados_obj.operate() r=0 bl.length=470 2024-06-04T15:54:41.447 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.446+0000 7ff968632800 20 zone default found 2024-06-04T15:54:41.447 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.446+0000 7ff968632800 4 Realm: () 2024-06-04T15:54:41.447 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.446+0000 7ff968632800 4 ZoneGroup: default (abb22408-c332-4e28-8f7a-ff254ea2fed2) 2024-06-04T15:54:41.447 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.446+0000 7ff968632800 4 Zone: default (be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767) 2024-06-04T15:54:41.447 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.446+0000 7ff968632800 10 cannot find current period zonegroup using local zonegroup configuration 2024-06-04T15:54:41.447 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.446+0000 7ff968632800 20 zonegroup default 2024-06-04T15:54:41.447 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.446+0000 7ff968632800 20 rados->read ofs=0 len=0 2024-06-04T15:54:41.448 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.446+0000 7ff968632800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T15:54:41.448 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.446+0000 7ff968632800 20 rados->read ofs=0 len=0 2024-06-04T15:54:41.448 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.446+0000 7ff968632800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T15:54:41.448 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.446+0000 7ff968632800 20 rados->read ofs=0 len=0 2024-06-04T15:54:41.448 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.446+0000 7ff968632800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T15:54:41.448 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.447+0000 7ff968632800 20 started sync module instance, tier type = 2024-06-04T15:54:41.448 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.447+0000 7ff968632800 20 started zone id=be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767 (name=default) with tier type = 2024-06-04T15:54:41.458 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.458+0000 7ff968632800 20 add_watcher() i=0 2024-06-04T15:54:41.458 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.458+0000 7ff968632800 20 add_watcher() i=1 2024-06-04T15:54:41.458 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.458+0000 7ff968632800 20 add_watcher() i=2 2024-06-04T15:54:41.458 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.458+0000 7ff968632800 20 add_watcher() i=3 2024-06-04T15:54:41.459 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.458+0000 7ff968632800 20 add_watcher() i=4 2024-06-04T15:54:41.459 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.458+0000 7ff968632800 20 add_watcher() i=5 2024-06-04T15:54:41.459 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.458+0000 7ff968632800 20 add_watcher() i=6 2024-06-04T15:54:41.459 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.459+0000 7ff968632800 20 add_watcher() i=7 2024-06-04T15:54:41.459 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.459+0000 7ff968632800 2 all 8 watchers are set, enabling cache 2024-06-04T15:54:41.461 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.461+0000 7ff819fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-06-04T15:54:41.463 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.461+0000 7ff968632800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-06-04T15:54:41.463 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.461+0000 7ff968632800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-06-04T15:54:41.463 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.461+0000 7ff968632800 5 note: GC not initialized 2024-06-04T15:54:41.463 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.461+0000 7ff818fe1640 20 reqs_thread_entry: start 2024-06-04T15:54:41.463 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.461+0000 7ff968632800 20 init_complete bucket index max shards: 11 2024-06-04T15:54:41.463 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.462+0000 7ff968632800 20 Filter name: none 2024-06-04T15:54:41.464 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.462+0000 7ff7927fc640 20 reqs_thread_entry: start 2024-06-04T15:54:41.464 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.462+0000 7ff968632800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-06-04T15:54:41.464 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.462+0000 7ff968632800 20 rados->read ofs=0 len=0 2024-06-04T15:54:41.464 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.462+0000 7ff968632800 20 rados_obj.operate() r=0 bl.length=190 2024-06-04T15:54:41.464 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.462+0000 7ff968632800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-06-04T15:54:41.464 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.462+0000 7ff968632800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-06-04T15:54:41.464 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.462+0000 7ff968632800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1 : miss 2024-06-04T15:54:41.464 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.462+0000 7ff968632800 20 rados->read ofs=0 len=0 2024-06-04T15:54:41.464 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.462+0000 7ff968632800 20 rados_obj.operate() r=0 bl.length=404 2024-06-04T15:54:41.464 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.462+0000 7ff968632800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1 info.flags=0x17 2024-06-04T15:54:41.464 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.462+0000 7ff968632800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1 to cache LRU end 2024-06-04T15:54:41.465 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.462+0000 7ff968632800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-06-04T15:54:41.465 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.462+0000 7ff968632800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-06-04T15:54:41.465 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.462+0000 7ff968632800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1 2024-06-04T15:54:41.465 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.463+0000 7ff968632800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.0 2024-06-04T15:54:41.465 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.463+0000 7ff968632800 1 NOTICE: finished shard 0 (0 entries removed) 2024-06-04T15:54:41.465 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.463+0000 7ff968632800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.1 2024-06-04T15:54:41.466 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.463+0000 7ff968632800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.2 2024-06-04T15:54:41.466 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.464+0000 7ff968632800 1 NOTICE: finished shard 2 (0 entries removed) 2024-06-04T15:54:41.466 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.464+0000 7ff968632800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.3 2024-06-04T15:54:41.466 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.464+0000 7ff968632800 1 NOTICE: finished shard 3 (0 entries removed) 2024-06-04T15:54:41.466 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.464+0000 7ff968632800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.4 2024-06-04T15:54:41.467 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.465+0000 7ff968632800 1 NOTICE: finished shard 4 (0 entries removed) 2024-06-04T15:54:41.467 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.465+0000 7ff968632800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.5 2024-06-04T15:54:41.467 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.465+0000 7ff968632800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.6 2024-06-04T15:54:41.467 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.466+0000 7ff968632800 1 NOTICE: finished shard 6 (0 entries removed) 2024-06-04T15:54:41.467 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.466+0000 7ff968632800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.7 2024-06-04T15:54:41.467 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.466+0000 7ff968632800 1 NOTICE: finished shard 7 (0 entries removed) 2024-06-04T15:54:41.467 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.466+0000 7ff968632800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.8 2024-06-04T15:54:41.468 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.467+0000 7ff968632800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.9 2024-06-04T15:54:41.468 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.467+0000 7ff968632800 1 NOTICE: finished shard 9 (0 entries removed) 2024-06-04T15:54:41.468 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.467+0000 7ff968632800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.10 2024-06-04T15:54:41.468 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.468+0000 7ff968632800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.1 2024-06-04T15:54:41.469 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.468+0000 7ff968632800 20 get_obj_state: octx=0x562b92d717c0 obj=check-bucket:e state=0x562b9303d748 s->prefetch_data=0 2024-06-04T15:54:41.470 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.468+0000 7ff968632800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.5 2024-06-04T15:54:41.470 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.468+0000 7ff968632800 20 get_obj_state: octx=0x562b92d990b0 obj=check-bucket:d state=0x562b9303f638 s->prefetch_data=0 2024-06-04T15:54:41.470 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.468+0000 7ff968632800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.8 2024-06-04T15:54:41.470 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.469+0000 7ff968632800 20 get_obj_state: octx=0x562b93040130 obj=check-bucket:c state=0x562b9303aa48 s->prefetch_data=0 2024-06-04T15:54:41.470 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.469+0000 7ff968632800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.10 2024-06-04T15:54:41.470 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.469+0000 7ff968632800 20 get_obj_state: octx=0x562b9303e3c0 obj=check-bucket:f state=0x562b9303b928 s->prefetch_data=0 2024-06-04T15:54:41.470 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.469+0000 7ff968632800 20 get_obj_state: setting s->obj_tag to zc8ux2dubkdb2yl14pg1fwq908s3o181 2024-06-04T15:54:41.470 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.469+0000 7ff968632800 20 get_obj_state_impl: setting s->olh_tag to mrm5mu3j5897kia11aaxfhw1riohuca0 2024-06-04T15:54:41.470 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.469+0000 7ff968632800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=mrm5mu3j5897kia11aaxfhw1riohuca0 2024-06-04T15:54:41.470 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.469+0000 7ff968632800 20 get_obj_state: setting s->obj_tag to 27oq1d1fwq6zdthadwtyr7yoaw4wfkdv 2024-06-04T15:54:41.471 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.469+0000 7ff968632800 20 get_obj_state_impl: setting s->olh_tag to fw9v819aff782h8yrsz6ahlqcwfkw84o 2024-06-04T15:54:41.471 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.469+0000 7ff968632800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=fw9v819aff782h8yrsz6ahlqcwfkw84o 2024-06-04T15:54:41.471 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.469+0000 7ff968632800 20 get_obj_state: setting s->obj_tag to rs8tftipyi64km0ffov0ebkda8d9css5 2024-06-04T15:54:41.471 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.469+0000 7ff968632800 20 get_obj_state_impl: setting s->olh_tag to epyt9ehkdcnxwykgxq1581ncp91susd9 2024-06-04T15:54:41.471 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.469+0000 7ff968632800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=epyt9ehkdcnxwykgxq1581ncp91susd9 2024-06-04T15:54:41.471 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.469+0000 7ff968632800 20 get_obj_state: setting s->obj_tag to w57bgx9s5wb78ir9mapuyw4z5yakpiqt 2024-06-04T15:54:41.471 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.469+0000 7ff968632800 20 get_obj_state_impl: setting s->olh_tag to a55d5la81a5w74o9osh2g8nx1ppxmqbp 2024-06-04T15:54:41.471 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.469+0000 7ff968632800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=a55d5la81a5w74o9osh2g8nx1ppxmqbp 2024-06-04T15:54:41.472 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.471+0000 7ff968632800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.5 2024-06-04T15:54:41.472 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.471+0000 7ff968632800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.8 2024-06-04T15:54:41.472 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.471+0000 7ff968632800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.1 2024-06-04T15:54:41.472 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.472+0000 7ff968632800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.10 2024-06-04T15:54:41.472 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.472+0000 7ff968632800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.5 2024-06-04T15:54:41.473 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.473+0000 7ff968632800 20 olh_log_entry: epoch=3 op=3 key=d[ktY0P2uoO5nkyBvpW943ufls2x5q3rf] 2024-06-04T15:54:41.473 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.473+0000 7ff968632800 20 get_obj_state: octx=0x562b92d990b0 obj=check-bucket:_:ktY0P2uoO5nkyBvpW943ufls2x5q3rf_d state=0x562b930f5768 s->prefetch_data=0 2024-06-04T15:54:41.474 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.473+0000 7ff968632800 10 manifest: total_size = 11 2024-06-04T15:54:41.474 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.473+0000 7ff968632800 20 get_obj_state: setting s->obj_tag to be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.15768392426456463391 2024-06-04T15:54:41.474 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.473+0000 7ff968632800 20 get_obj_state: octx=0x562b92d990b0 obj=check-bucket:_:ktY0P2uoO5nkyBvpW943ufls2x5q3rf_d state=0x562b930f5768 s->prefetch_data=0 2024-06-04T15:54:41.474 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.473+0000 7ff968632800 20 prepare_atomic_modification: state is not atomic. state=0x562b930f5768 2024-06-04T15:54:41.474 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.473+0000 7ff968632800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.5 2024-06-04T15:54:41.476 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.475+0000 7ff968632800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.1 2024-06-04T15:54:41.476 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.475+0000 7ff968632800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.10 2024-06-04T15:54:41.476 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.475+0000 7ff968632800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.8 2024-06-04T15:54:41.476 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.475+0000 7ff968632800 20 olh_log_entry: epoch=2 op=2 key=e[] 2024-06-04T15:54:41.476 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.475+0000 7ff968632800 20 olh_log_entry: epoch=2 op=3 key=e[rBGcdigKI7nr9-JGKQ3g7ICv-y0bLRU] 2024-06-04T15:54:41.477 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.475+0000 7ff968632800 20 get_obj_state: octx=0x562b92d717c0 obj=check-bucket:_:rBGcdigKI7nr9-JGKQ3g7ICv-y0bLRU_e state=0x562b930f0ac8 s->prefetch_data=0 2024-06-04T15:54:41.477 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.475+0000 7ff968632800 20 olh_log_entry: epoch=2 op=2 key=f[] 2024-06-04T15:54:41.477 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.475+0000 7ff968632800 20 olh_log_entry: epoch=2 op=3 key=f[J4sg3v0cwRP48P.cWPTA55udn7p3eDB] 2024-06-04T15:54:41.477 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.475+0000 7ff968632800 20 get_obj_state: octx=0x562b9303e3c0 obj=check-bucket:_:J4sg3v0cwRP48P.cWPTA55udn7p3eDB_f state=0x562b93100308 s->prefetch_data=0 2024-06-04T15:54:41.477 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.475+0000 7ff968632800 20 olh_log_entry: epoch=3 op=3 key=c[REPnWS7OB1srOS6ZJQJvfkEzfFxgmiz] 2024-06-04T15:54:41.477 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.475+0000 7ff968632800 20 get_obj_state: octx=0x562b93040130 obj=check-bucket:_:REPnWS7OB1srOS6ZJQJvfkEzfFxgmiz_c state=0x562b93105358 s->prefetch_data=0 2024-06-04T15:54:41.477 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.475+0000 7ff968632800 10 manifest: total_size = 11 2024-06-04T15:54:41.477 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.475+0000 7ff968632800 20 get_obj_state: setting s->obj_tag to be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.4855512539118372061 2024-06-04T15:54:41.477 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.476+0000 7ff968632800 20 get_obj_state: octx=0x562b92d717c0 obj=check-bucket:_:rBGcdigKI7nr9-JGKQ3g7ICv-y0bLRU_e state=0x562b930f0ac8 s->prefetch_data=0 2024-06-04T15:54:41.477 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.476+0000 7ff968632800 20 prepare_atomic_modification: state is not atomic. state=0x562b930f0ac8 2024-06-04T15:54:41.477 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.476+0000 7ff968632800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.1 2024-06-04T15:54:41.477 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.476+0000 7ff968632800 10 manifest: total_size = 11 2024-06-04T15:54:41.477 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.476+0000 7ff968632800 20 get_obj_state: setting s->obj_tag to be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.8487477574630615470 2024-06-04T15:54:41.477 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.476+0000 7ff968632800 20 get_obj_state: octx=0x562b9303e3c0 obj=check-bucket:_:J4sg3v0cwRP48P.cWPTA55udn7p3eDB_f state=0x562b93100308 s->prefetch_data=0 2024-06-04T15:54:41.478 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.476+0000 7ff968632800 20 prepare_atomic_modification: state is not atomic. state=0x562b93100308 2024-06-04T15:54:41.478 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.476+0000 7ff968632800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.10 2024-06-04T15:54:41.478 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.476+0000 7ff968632800 10 manifest: total_size = 22 2024-06-04T15:54:41.478 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.476+0000 7ff968632800 20 get_obj_state: setting s->obj_tag to be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.5642393481091029294 2024-06-04T15:54:41.478 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.476+0000 7ff968632800 20 get_obj_state: octx=0x562b93040130 obj=check-bucket:_:REPnWS7OB1srOS6ZJQJvfkEzfFxgmiz_c state=0x562b93105358 s->prefetch_data=0 2024-06-04T15:54:41.478 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.476+0000 7ff968632800 20 prepare_atomic_modification: state is not atomic. state=0x562b93105358 2024-06-04T15:54:41.478 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.476+0000 7ff968632800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.8 2024-06-04T15:54:41.479 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.479+0000 7ff842ffd640 20 handle_completion(): completion ok for obj=d[ktY0P2uoO5nkyBvpW943ufls2x5q3rf] 2024-06-04T15:54:41.480 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.480+0000 7ff968632800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.5 2024-06-04T15:54:41.480 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.480+0000 7ff968632800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.5 2024-06-04T15:54:41.482 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.482+0000 7ff968632800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.5 2024-06-04T15:54:41.482 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.482+0000 7ff968632800 1 NOTICE: finished shard 5 (1 entries removed) 2024-06-04T15:54:41.488 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.488+0000 7ff968632800 20 get_obj_state: octx=0x562b92d717c0 obj=check-bucket:e state=0x562b9303d748 s->prefetch_data=0 2024-06-04T15:54:41.489 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.488+0000 7ff8427fc640 20 handle_completion(): completion ok for obj=e[rBGcdigKI7nr9-JGKQ3g7ICv-y0bLRU] 2024-06-04T15:54:41.489 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.488+0000 7ff968632800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=mrm5mu3j5897kia11aaxfhw1riohuca0 2024-06-04T15:54:41.491 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.491+0000 7ff842ffd640 20 handle_completion(): completion ok for obj=f[J4sg3v0cwRP48P.cWPTA55udn7p3eDB] 2024-06-04T15:54:41.491 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.491+0000 7ff968632800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.8 2024-06-04T15:54:41.491 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.491+0000 7ff968632800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.8 2024-06-04T15:54:41.492 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.491+0000 7ff842ffd640 20 handle_completion(): completion ok for obj=c[REPnWS7OB1srOS6ZJQJvfkEzfFxgmiz] 2024-06-04T15:54:41.492 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.491+0000 7ff968632800 20 get_obj_state: octx=0x562b9303e3c0 obj=check-bucket:f state=0x562b9303b928 s->prefetch_data=0 2024-06-04T15:54:41.492 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.491+0000 7ff968632800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=a55d5la81a5w74o9osh2g8nx1ppxmqbp 2024-06-04T15:54:41.494 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.494+0000 7ff968632800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.8 2024-06-04T15:54:41.495 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.494+0000 7ff968632800 1 NOTICE: finished shard 8 (1 entries removed) 2024-06-04T15:54:41.497 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.497+0000 7ff968632800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.1 2024-06-04T15:54:41.498 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.498+0000 7ff968632800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.1 2024-06-04T15:54:41.499 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.498+0000 7ff968632800 1 NOTICE: finished shard 1 (1 entries removed) 2024-06-04T15:54:41.503 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.503+0000 7ff968632800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.10 2024-06-04T15:54:41.508 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.508+0000 7ff968632800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.10 2024-06-04T15:54:41.508 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.508+0000 7ff968632800 1 NOTICE: finished shard 10 (1 entries removed) 2024-06-04T15:54:41.508 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.508+0000 7ff968632800 1 NOTICE: finished all shards (4 entries removed) 2024-06-04T15:54:41.509 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.509+0000 7ff819fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-06-04T15:54:41.511 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.511+0000 7ff968632800 20 remove_watcher() i=0 2024-06-04T15:54:41.511 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.511+0000 7ff968632800 2 removed watcher, disabling cache 2024-06-04T15:54:41.512 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.512+0000 7ff968632800 20 remove_watcher() i=1 2024-06-04T15:54:41.513 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.513+0000 7ff968632800 20 remove_watcher() i=2 2024-06-04T15:54:41.514 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.514+0000 7ff968632800 20 remove_watcher() i=3 2024-06-04T15:54:41.516 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.516+0000 7ff968632800 20 remove_watcher() i=4 2024-06-04T15:54:41.517 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.517+0000 7ff968632800 20 remove_watcher() i=5 2024-06-04T15:54:41.518 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.518+0000 7ff968632800 20 remove_watcher() i=6 2024-06-04T15:54:41.521 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.521+0000 7ff968632800 20 remove_watcher() i=7 2024-06-04T15:54:41.533 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T15:54:41.534 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T15:54:41.536 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T15:54:41.536 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T15:54:41.538 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T15:54:41.538 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T15:54:41.541 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T15:54:41.541 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T15:54:41.542 INFO:tasks.workunit.client.0.smithi144.stderr:TEST: bucket check unlinked does not affect normal entries 2024-06-04T15:54:41.542 INFO:tasks.workunit.client.0.smithi144.stderr: 2024-06-04T15:54:41.543 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T15:54:41.543 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T15:54:41.588 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T15:54:41.588 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T15:54:41.591 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T15:54:41.591 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T15:54:41.593 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T15:54:41.594 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T15:54:41.596 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T15:54:41.596 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T15:54:41.598 INFO:tasks.workunit.client.0.smithi144.stderr:TEST: bucket check unlinked does not find new unlistable entries after fix 2024-06-04T15:54:41.598 INFO:tasks.workunit.client.0.smithi144.stderr: 2024-06-04T15:54:41.599 INFO:tasks.workunit.client.0.smithi144.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --min-age-hours 0 --dump-keys 2024-06-04T15:54:41.630 INFO:tasks.workunit.client.0.smithi144.stderr:ignoring --setuser ceph since I am not root 2024-06-04T15:54:41.631 INFO:tasks.workunit.client.0.smithi144.stderr:ignoring --setgroup ceph since I am not root 2024-06-04T15:54:41.667 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.667+0000 7f0925933800 20 rados->read ofs=0 len=0 2024-06-04T15:54:41.669 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.668+0000 7f0925933800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T15:54:41.669 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.668+0000 7f0925933800 20 realm 2024-06-04T15:54:41.669 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.668+0000 7f0925933800 20 rados->read ofs=0 len=0 2024-06-04T15:54:41.669 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.668+0000 7f0925933800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T15:54:41.669 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.668+0000 7f0925933800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-06-04T15:54:41.669 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.668+0000 7f0925933800 20 rados->read ofs=0 len=0 2024-06-04T15:54:41.669 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.669+0000 7f0925933800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T15:54:41.669 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.669+0000 7f0925933800 20 rados->read ofs=0 len=0 2024-06-04T15:54:41.670 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.669+0000 7f0925933800 20 rados_obj.operate() r=0 bl.length=46 2024-06-04T15:54:41.670 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.669+0000 7f0925933800 20 rados->read ofs=0 len=0 2024-06-04T15:54:41.670 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.670+0000 7f0925933800 20 rados_obj.operate() r=0 bl.length=1139 2024-06-04T15:54:41.670 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.670+0000 7f0925933800 20 searching for the correct realm 2024-06-04T15:54:41.672 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.672+0000 7f0921dec640 0 -- 172.21.15.144:0/2237963061 >> [v2:172.21.15.144:6800/1453747520,v1:172.21.15.144:6801/1453747520] conn(0x7f09180750b0 msgr2=0x7f091803df20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-06-04T15:54:41.877 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.877+0000 7f0921dec640 0 -- 172.21.15.144:0/2237963061 >> [v2:172.21.15.144:6824/166159729,v1:172.21.15.144:6825/166159729] conn(0x56275ec32460 msgr2=0x56275ec34850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-06-04T15:54:41.883 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.882+0000 7f0925933800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-06-04T15:54:41.883 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.882+0000 7f0925933800 20 RGWRados::pool_iterate: got zone_info.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767 2024-06-04T15:54:41.883 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.882+0000 7f0925933800 20 RGWRados::pool_iterate: got default.zone. 2024-06-04T15:54:41.883 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.882+0000 7f0925933800 20 RGWRados::pool_iterate: got zonegroup_info.abb22408-c332-4e28-8f7a-ff254ea2fed2 2024-06-04T15:54:41.883 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.882+0000 7f0925933800 20 RGWRados::pool_iterate: got zone_names.default 2024-06-04T15:54:41.883 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.882+0000 7f0925933800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-06-04T15:54:41.883 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.882+0000 7f0925933800 20 rados->read ofs=0 len=0 2024-06-04T15:54:41.883 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.882+0000 7f0925933800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T15:54:41.883 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.882+0000 7f0925933800 20 rados->read ofs=0 len=0 2024-06-04T15:54:41.883 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.883+0000 7f0925933800 20 rados_obj.operate() r=0 bl.length=46 2024-06-04T15:54:41.883 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.883+0000 7f0925933800 20 rados->read ofs=0 len=0 2024-06-04T15:54:41.884 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.883+0000 7f0925933800 20 rados_obj.operate() r=0 bl.length=470 2024-06-04T15:54:41.885 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.883+0000 7f0925933800 20 zone default found 2024-06-04T15:54:41.885 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.883+0000 7f0925933800 4 Realm: () 2024-06-04T15:54:41.885 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.883+0000 7f0925933800 4 ZoneGroup: default (abb22408-c332-4e28-8f7a-ff254ea2fed2) 2024-06-04T15:54:41.885 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.883+0000 7f0925933800 4 Zone: default (be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767) 2024-06-04T15:54:41.885 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.883+0000 7f0925933800 10 cannot find current period zonegroup using local zonegroup configuration 2024-06-04T15:54:41.885 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.883+0000 7f0925933800 20 zonegroup default 2024-06-04T15:54:41.885 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.883+0000 7f0925933800 20 rados->read ofs=0 len=0 2024-06-04T15:54:41.885 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.883+0000 7f0925933800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T15:54:41.885 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.883+0000 7f0925933800 20 rados->read ofs=0 len=0 2024-06-04T15:54:41.885 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.884+0000 7f0925933800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T15:54:41.885 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.884+0000 7f0925933800 20 rados->read ofs=0 len=0 2024-06-04T15:54:41.885 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.884+0000 7f0925933800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T15:54:41.885 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.884+0000 7f0925933800 20 started sync module instance, tier type = 2024-06-04T15:54:41.885 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.884+0000 7f0925933800 20 started zone id=be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767 (name=default) with tier type = 2024-06-04T15:54:41.894 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.893+0000 7f0925933800 20 add_watcher() i=0 2024-06-04T15:54:41.894 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.893+0000 7f0925933800 20 add_watcher() i=1 2024-06-04T15:54:41.894 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.893+0000 7f0925933800 20 add_watcher() i=2 2024-06-04T15:54:41.894 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.893+0000 7f0925933800 20 add_watcher() i=3 2024-06-04T15:54:41.894 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.893+0000 7f0925933800 20 add_watcher() i=4 2024-06-04T15:54:41.894 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.893+0000 7f0925933800 20 add_watcher() i=5 2024-06-04T15:54:41.894 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.893+0000 7f0925933800 20 add_watcher() i=6 2024-06-04T15:54:41.895 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.895+0000 7f0925933800 20 add_watcher() i=7 2024-06-04T15:54:41.895 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.895+0000 7f0925933800 2 all 8 watchers are set, enabling cache 2024-06-04T15:54:41.897 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.897+0000 7f07d77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-06-04T15:54:41.897 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.897+0000 7f0925933800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-06-04T15:54:41.897 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.897+0000 7f0925933800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-06-04T15:54:41.897 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.897+0000 7f0925933800 5 note: GC not initialized 2024-06-04T15:54:41.899 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.897+0000 7f07d67e4640 20 reqs_thread_entry: start 2024-06-04T15:54:41.899 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.897+0000 7f0925933800 20 init_complete bucket index max shards: 11 2024-06-04T15:54:41.899 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.897+0000 7f0925933800 20 Filter name: none 2024-06-04T15:54:41.899 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.898+0000 7f0747fff640 20 reqs_thread_entry: start 2024-06-04T15:54:41.899 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.898+0000 7f0925933800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-06-04T15:54:41.899 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.898+0000 7f0925933800 20 rados->read ofs=0 len=0 2024-06-04T15:54:41.899 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.898+0000 7f0925933800 20 rados_obj.operate() r=0 bl.length=190 2024-06-04T15:54:41.899 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.898+0000 7f0925933800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-06-04T15:54:41.899 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.898+0000 7f0925933800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-06-04T15:54:41.899 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.898+0000 7f0925933800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1 : miss 2024-06-04T15:54:41.899 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.898+0000 7f0925933800 20 rados->read ofs=0 len=0 2024-06-04T15:54:41.900 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.898+0000 7f0925933800 20 rados_obj.operate() r=0 bl.length=404 2024-06-04T15:54:41.900 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.898+0000 7f0925933800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1 info.flags=0x17 2024-06-04T15:54:41.900 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.898+0000 7f0925933800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1 to cache LRU end 2024-06-04T15:54:41.900 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.898+0000 7f0925933800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-06-04T15:54:41.900 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.898+0000 7f0925933800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-06-04T15:54:41.900 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.899+0000 7f0925933800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1 2024-06-04T15:54:41.900 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.899+0000 7f0925933800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.0 2024-06-04T15:54:41.901 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.899+0000 7f0925933800 1 NOTICE: finished shard 0 (0 entries found) 2024-06-04T15:54:41.901 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.899+0000 7f0925933800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.1 2024-06-04T15:54:41.901 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.899+0000 7f0925933800 1 NOTICE: finished shard 1 (0 entries found) 2024-06-04T15:54:41.901 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.899+0000 7f0925933800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.2 2024-06-04T15:54:41.901 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.900+0000 7f0925933800 1 NOTICE: finished shard 2 (0 entries found) 2024-06-04T15:54:41.901 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.900+0000 7f0925933800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.3 2024-06-04T15:54:41.901 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.900+0000 7f0925933800 1 NOTICE: finished shard 3 (0 entries found) 2024-06-04T15:54:41.902 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.900+0000 7f0925933800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.4 2024-06-04T15:54:41.902 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.901+0000 7f0925933800 1 NOTICE: finished shard 4 (0 entries found) 2024-06-04T15:54:41.902 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.901+0000 7f0925933800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.5 2024-06-04T15:54:41.902 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.901+0000 7f0925933800 1 NOTICE: finished shard 5 (0 entries found) 2024-06-04T15:54:41.902 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.901+0000 7f0925933800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.6 2024-06-04T15:54:41.902 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.902+0000 7f0925933800 1 NOTICE: finished shard 6 (0 entries found) 2024-06-04T15:54:41.903 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.902+0000 7f0925933800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.7 2024-06-04T15:54:41.903 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.902+0000 7f0925933800 1 NOTICE: finished shard 7 (0 entries found) 2024-06-04T15:54:41.903 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.902+0000 7f0925933800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.8 2024-06-04T15:54:41.903 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.903+0000 7f0925933800 1 NOTICE: finished shard 8 (0 entries found) 2024-06-04T15:54:41.903 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.903+0000 7f0925933800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.9 2024-06-04T15:54:41.903 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.903+0000 7f0925933800 1 NOTICE: finished shard 9 (0 entries found) 2024-06-04T15:54:41.904 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.903+0000 7f0925933800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.10 2024-06-04T15:54:41.904 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.904+0000 7f0925933800 1 NOTICE: finished shard 10 (0 entries found) 2024-06-04T15:54:41.904 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.904+0000 7f0925933800 1 NOTICE: finished all shards (0 entries found) 2024-06-04T15:54:41.905 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.905+0000 7f07d77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-06-04T15:54:41.907 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.907+0000 7f0925933800 20 remove_watcher() i=0 2024-06-04T15:54:41.907 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.907+0000 7f0925933800 2 removed watcher, disabling cache 2024-06-04T15:54:41.908 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.908+0000 7f0925933800 20 remove_watcher() i=1 2024-06-04T15:54:41.909 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.909+0000 7f0925933800 20 remove_watcher() i=2 2024-06-04T15:54:41.910 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.910+0000 7f0925933800 20 remove_watcher() i=3 2024-06-04T15:54:41.912 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.911+0000 7f0925933800 20 remove_watcher() i=4 2024-06-04T15:54:41.912 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.912+0000 7f0925933800 20 remove_watcher() i=5 2024-06-04T15:54:41.914 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.913+0000 7f0925933800 20 remove_watcher() i=6 2024-06-04T15:54:41.915 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:41.915+0000 7f0925933800 20 remove_watcher() i=7 2024-06-04T15:54:41.928 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T15:54:41.928 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T15:54:41.949 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T15:54:41.949 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T15:54:41.962 INFO:tasks.workunit.client.0.smithi144.stderr:radosgw-admin bi list --bucket check-bucket --object d 2024-06-04T15:54:41.991 INFO:tasks.workunit.client.0.smithi144.stderr:ignoring --setuser ceph since I am not root 2024-06-04T15:54:41.991 INFO:tasks.workunit.client.0.smithi144.stderr:ignoring --setgroup ceph since I am not root 2024-06-04T15:54:42.028 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.028+0000 7efeb6723800 20 rados->read ofs=0 len=0 2024-06-04T15:54:42.030 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.029+0000 7efeb6723800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T15:54:42.030 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.029+0000 7efeb6723800 20 realm 2024-06-04T15:54:42.030 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.029+0000 7efeb6723800 20 rados->read ofs=0 len=0 2024-06-04T15:54:42.030 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.030+0000 7efeb6723800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T15:54:42.030 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.030+0000 7efeb6723800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-06-04T15:54:42.030 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.030+0000 7efeb6723800 20 rados->read ofs=0 len=0 2024-06-04T15:54:42.030 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.030+0000 7efeb6723800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T15:54:42.030 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.030+0000 7efeb6723800 20 rados->read ofs=0 len=0 2024-06-04T15:54:42.031 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.030+0000 7efeb6723800 20 rados_obj.operate() r=0 bl.length=46 2024-06-04T15:54:42.031 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.030+0000 7efeb6723800 20 rados->read ofs=0 len=0 2024-06-04T15:54:42.031 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.031+0000 7efeb6723800 20 rados_obj.operate() r=0 bl.length=1139 2024-06-04T15:54:42.031 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.031+0000 7efeb6723800 20 searching for the correct realm 2024-06-04T15:54:42.032 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.032+0000 7efeabfff640 0 -- 172.21.15.144:0/3120072413 >> [v2:172.21.15.144:6808/86532035,v1:172.21.15.144:6809/86532035] conn(0x7efea4070070 msgr2=0x7efea40b8950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-06-04T15:54:42.237 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.236+0000 7efeb2cae640 0 -- 172.21.15.144:0/3120072413 >> [v2:172.21.15.177:6824/800067290,v1:172.21.15.177:6825/800067290] conn(0x55995be603a0 msgr2=0x55995be62820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-06-04T15:54:42.244 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.242+0000 7efeb6723800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-06-04T15:54:42.244 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.242+0000 7efeb6723800 20 RGWRados::pool_iterate: got zone_info.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767 2024-06-04T15:54:42.244 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.242+0000 7efeb6723800 20 RGWRados::pool_iterate: got default.zone. 2024-06-04T15:54:42.244 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.242+0000 7efeb6723800 20 RGWRados::pool_iterate: got zonegroup_info.abb22408-c332-4e28-8f7a-ff254ea2fed2 2024-06-04T15:54:42.244 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.242+0000 7efeb6723800 20 RGWRados::pool_iterate: got zone_names.default 2024-06-04T15:54:42.244 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.242+0000 7efeb6723800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-06-04T15:54:42.244 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.242+0000 7efeb6723800 20 rados->read ofs=0 len=0 2024-06-04T15:54:42.244 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.242+0000 7efeb6723800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T15:54:42.244 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.242+0000 7efeb6723800 20 rados->read ofs=0 len=0 2024-06-04T15:54:42.244 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.243+0000 7efeb6723800 20 rados_obj.operate() r=0 bl.length=46 2024-06-04T15:54:42.244 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.243+0000 7efeb6723800 20 rados->read ofs=0 len=0 2024-06-04T15:54:42.245 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.243+0000 7efeb6723800 20 rados_obj.operate() r=0 bl.length=470 2024-06-04T15:54:42.245 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.243+0000 7efeb6723800 20 zone default found 2024-06-04T15:54:42.245 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.243+0000 7efeb6723800 4 Realm: () 2024-06-04T15:54:42.245 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.243+0000 7efeb6723800 4 ZoneGroup: default (abb22408-c332-4e28-8f7a-ff254ea2fed2) 2024-06-04T15:54:42.245 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.243+0000 7efeb6723800 4 Zone: default (be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767) 2024-06-04T15:54:42.245 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.243+0000 7efeb6723800 10 cannot find current period zonegroup using local zonegroup configuration 2024-06-04T15:54:42.245 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.243+0000 7efeb6723800 20 zonegroup default 2024-06-04T15:54:42.245 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.243+0000 7efeb6723800 20 rados->read ofs=0 len=0 2024-06-04T15:54:42.245 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.243+0000 7efeb6723800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T15:54:42.245 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.243+0000 7efeb6723800 20 rados->read ofs=0 len=0 2024-06-04T15:54:42.245 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.243+0000 7efeb6723800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T15:54:42.245 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.243+0000 7efeb6723800 20 rados->read ofs=0 len=0 2024-06-04T15:54:42.245 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.244+0000 7efeb6723800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T15:54:42.245 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.244+0000 7efeb6723800 20 started sync module instance, tier type = 2024-06-04T15:54:42.246 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.244+0000 7efeb6723800 20 started zone id=be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767 (name=default) with tier type = 2024-06-04T15:54:42.260 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.261+0000 7efeb6723800 20 add_watcher() i=0 2024-06-04T15:54:42.260 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.261+0000 7efeb6723800 20 add_watcher() i=1 2024-06-04T15:54:42.261 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.261+0000 7efeb6723800 20 add_watcher() i=2 2024-06-04T15:54:42.261 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.261+0000 7efeb6723800 20 add_watcher() i=3 2024-06-04T15:54:42.261 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.261+0000 7efeb6723800 20 add_watcher() i=4 2024-06-04T15:54:42.261 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.261+0000 7efeb6723800 20 add_watcher() i=5 2024-06-04T15:54:42.261 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.261+0000 7efeb6723800 20 add_watcher() i=6 2024-06-04T15:54:42.263 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.263+0000 7efeb6723800 20 add_watcher() i=7 2024-06-04T15:54:42.263 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.263+0000 7efeb6723800 2 all 8 watchers are set, enabling cache 2024-06-04T15:54:42.265 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.265+0000 7efd68fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-06-04T15:54:42.266 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.265+0000 7efeb6723800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-06-04T15:54:42.266 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.265+0000 7efeb6723800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-06-04T15:54:42.266 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.265+0000 7efeb6723800 5 note: GC not initialized 2024-06-04T15:54:42.266 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.265+0000 7efce37fe640 20 reqs_thread_entry: start 2024-06-04T15:54:42.266 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.265+0000 7efeb6723800 20 init_complete bucket index max shards: 11 2024-06-04T15:54:42.266 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.265+0000 7efeb6723800 20 Filter name: none 2024-06-04T15:54:42.266 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.266+0000 7efce17fa640 20 reqs_thread_entry: start 2024-06-04T15:54:42.266 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.266+0000 7efeb6723800 20 rados->read ofs=0 len=0 2024-06-04T15:54:42.267 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.266+0000 7efeb6723800 20 rados_obj.operate() r=0 bl.length=190 2024-06-04T15:54:42.267 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.266+0000 7efeb6723800 20 rados->read ofs=0 len=0 2024-06-04T15:54:42.267 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.267+0000 7efeb6723800 20 rados_obj.operate() r=0 bl.length=404 2024-06-04T15:54:42.267 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.267+0000 7efeb6723800 20 couldn't put binfo cache entry, might have raced with data changes 2024-06-04T15:54:42.267 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.267+0000 7efeb6723800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-06-04T15:54:42.268 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.267+0000 7efeb6723800 20 INFO: main: starting shard=0 2024-06-04T15:54:42.268 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.267+0000 7efeb6723800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.0 2024-06-04T15:54:42.268 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.267+0000 7efeb6723800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-06-04T15:54:42.268 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.267+0000 7efeb6723800 20 INFO: main: starting shard=1 2024-06-04T15:54:42.268 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.267+0000 7efeb6723800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.1 2024-06-04T15:54:42.269 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.267+0000 7efeb6723800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-06-04T15:54:42.269 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.267+0000 7efeb6723800 20 INFO: main: starting shard=2 2024-06-04T15:54:42.269 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.267+0000 7efeb6723800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.2 2024-06-04T15:54:42.269 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.268+0000 7efeb6723800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-06-04T15:54:42.269 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.268+0000 7efeb6723800 20 INFO: main: starting shard=3 2024-06-04T15:54:42.269 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.268+0000 7efeb6723800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.3 2024-06-04T15:54:42.269 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.268+0000 7efeb6723800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-06-04T15:54:42.269 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.268+0000 7efeb6723800 20 INFO: main: starting shard=4 2024-06-04T15:54:42.269 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.268+0000 7efeb6723800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.4 2024-06-04T15:54:42.271 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.269+0000 7efeb6723800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-06-04T15:54:42.271 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.269+0000 7efeb6723800 20 INFO: main: starting shard=5 2024-06-04T15:54:42.271 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.269+0000 7efeb6723800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.5 2024-06-04T15:54:42.271 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.269+0000 7efeb6723800 20 INFO: main: bi_list() returned without error; entries.size()=2, is_truncated=0, marker= 2024-06-04T15:54:42.271 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.269+0000 7efeb6723800 20 INFO: main: starting shard=6 2024-06-04T15:54:42.271 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.270+0000 7efeb6723800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.6 2024-06-04T15:54:42.271 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.270+0000 7efeb6723800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-06-04T15:54:42.271 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.270+0000 7efeb6723800 20 INFO: main: starting shard=7 2024-06-04T15:54:42.271 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.270+0000 7efeb6723800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.7 2024-06-04T15:54:42.271 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.270+0000 7efeb6723800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-06-04T15:54:42.271 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.270+0000 7efeb6723800 20 INFO: main: starting shard=8 2024-06-04T15:54:42.271 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.270+0000 7efeb6723800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.8 2024-06-04T15:54:42.272 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.271+0000 7efeb6723800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-06-04T15:54:42.272 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.271+0000 7efeb6723800 20 INFO: main: starting shard=9 2024-06-04T15:54:42.272 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.271+0000 7efeb6723800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.9 2024-06-04T15:54:42.272 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.271+0000 7efeb6723800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-06-04T15:54:42.272 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.271+0000 7efeb6723800 20 INFO: main: starting shard=10 2024-06-04T15:54:42.273 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.271+0000 7efeb6723800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.10 2024-06-04T15:54:42.273 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.272+0000 7efeb6723800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-06-04T15:54:42.273 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.272+0000 7efeb6723800 20 INFO: main: done 2024-06-04T15:54:42.273 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.273+0000 7efd68fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-06-04T15:54:42.275 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.275+0000 7efeb6723800 20 remove_watcher() i=0 2024-06-04T15:54:42.276 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.275+0000 7efeb6723800 2 removed watcher, disabling cache 2024-06-04T15:54:42.276 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.276+0000 7efeb6723800 20 remove_watcher() i=1 2024-06-04T15:54:42.277 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.277+0000 7efeb6723800 20 remove_watcher() i=2 2024-06-04T15:54:42.278 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.278+0000 7efeb6723800 20 remove_watcher() i=3 2024-06-04T15:54:42.280 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.280+0000 7efeb6723800 20 remove_watcher() i=4 2024-06-04T15:54:42.281 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.281+0000 7efeb6723800 20 remove_watcher() i=5 2024-06-04T15:54:42.284 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.284+0000 7efeb6723800 20 remove_watcher() i=6 2024-06-04T15:54:42.286 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.286+0000 7efeb6723800 20 remove_watcher() i=7 2024-06-04T15:54:42.298 INFO:tasks.workunit.client.0.smithi144.stderr:radosgw-admin bi list --bucket check-bucket --object c 2024-06-04T15:54:42.328 INFO:tasks.workunit.client.0.smithi144.stderr:ignoring --setuser ceph since I am not root 2024-06-04T15:54:42.328 INFO:tasks.workunit.client.0.smithi144.stderr:ignoring --setgroup ceph since I am not root 2024-06-04T15:54:42.364 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.364+0000 7f192f33f800 20 rados->read ofs=0 len=0 2024-06-04T15:54:42.366 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.366+0000 7f192f33f800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T15:54:42.366 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.366+0000 7f192f33f800 20 realm 2024-06-04T15:54:42.366 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.366+0000 7f192f33f800 20 rados->read ofs=0 len=0 2024-06-04T15:54:42.367 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.366+0000 7f192f33f800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T15:54:42.367 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.366+0000 7f192f33f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-06-04T15:54:42.367 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.366+0000 7f192f33f800 20 rados->read ofs=0 len=0 2024-06-04T15:54:42.367 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.366+0000 7f192f33f800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T15:54:42.367 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.366+0000 7f192f33f800 20 rados->read ofs=0 len=0 2024-06-04T15:54:42.368 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.367+0000 7f192f33f800 20 rados_obj.operate() r=0 bl.length=46 2024-06-04T15:54:42.368 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.367+0000 7f192f33f800 20 rados->read ofs=0 len=0 2024-06-04T15:54:42.368 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.367+0000 7f192f33f800 20 rados_obj.operate() r=0 bl.length=1139 2024-06-04T15:54:42.368 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.367+0000 7f192f33f800 20 searching for the correct realm 2024-06-04T15:54:42.369 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.369+0000 7f192a890640 0 -- 172.21.15.144:0/2641128245 >> [v2:172.21.15.144:6816/2358575268,v1:172.21.15.144:6817/2358575268] conn(0x55bd82e53440 msgr2=0x55bd82e55830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-06-04T15:54:42.372 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.372+0000 7f192a890640 0 -- 172.21.15.144:0/2641128245 >> [v2:172.21.15.177:6808/2618477608,v1:172.21.15.177:6809/2618477608] conn(0x7f1914050be0 msgr2=0x7f191405e910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-06-04T15:54:42.579 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.578+0000 7f192f33f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-06-04T15:54:42.579 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.578+0000 7f192f33f800 20 RGWRados::pool_iterate: got zone_info.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767 2024-06-04T15:54:42.579 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.578+0000 7f192f33f800 20 RGWRados::pool_iterate: got default.zone. 2024-06-04T15:54:42.579 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.578+0000 7f192f33f800 20 RGWRados::pool_iterate: got zonegroup_info.abb22408-c332-4e28-8f7a-ff254ea2fed2 2024-06-04T15:54:42.579 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.578+0000 7f192f33f800 20 RGWRados::pool_iterate: got zone_names.default 2024-06-04T15:54:42.579 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.578+0000 7f192f33f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-06-04T15:54:42.579 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.578+0000 7f192f33f800 20 rados->read ofs=0 len=0 2024-06-04T15:54:42.580 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.579+0000 7f192f33f800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T15:54:42.580 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.579+0000 7f192f33f800 20 rados->read ofs=0 len=0 2024-06-04T15:54:42.580 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.579+0000 7f192f33f800 20 rados_obj.operate() r=0 bl.length=46 2024-06-04T15:54:42.580 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.579+0000 7f192f33f800 20 rados->read ofs=0 len=0 2024-06-04T15:54:42.581 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.579+0000 7f192f33f800 20 rados_obj.operate() r=0 bl.length=470 2024-06-04T15:54:42.581 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.579+0000 7f192f33f800 20 zone default found 2024-06-04T15:54:42.581 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.579+0000 7f192f33f800 4 Realm: () 2024-06-04T15:54:42.581 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.579+0000 7f192f33f800 4 ZoneGroup: default (abb22408-c332-4e28-8f7a-ff254ea2fed2) 2024-06-04T15:54:42.581 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.579+0000 7f192f33f800 4 Zone: default (be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767) 2024-06-04T15:54:42.581 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.579+0000 7f192f33f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-06-04T15:54:42.581 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.579+0000 7f192f33f800 20 zonegroup default 2024-06-04T15:54:42.581 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.579+0000 7f192f33f800 20 rados->read ofs=0 len=0 2024-06-04T15:54:42.581 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.579+0000 7f192f33f800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T15:54:42.581 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.579+0000 7f192f33f800 20 rados->read ofs=0 len=0 2024-06-04T15:54:42.581 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.580+0000 7f192f33f800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T15:54:42.581 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.580+0000 7f192f33f800 20 rados->read ofs=0 len=0 2024-06-04T15:54:42.581 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.580+0000 7f192f33f800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T15:54:42.582 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.580+0000 7f192f33f800 20 started sync module instance, tier type = 2024-06-04T15:54:42.582 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.580+0000 7f192f33f800 20 started zone id=be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767 (name=default) with tier type = 2024-06-04T15:54:42.597 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.597+0000 7f192f33f800 20 add_watcher() i=0 2024-06-04T15:54:42.597 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.597+0000 7f192f33f800 20 add_watcher() i=1 2024-06-04T15:54:42.597 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.597+0000 7f192f33f800 20 add_watcher() i=2 2024-06-04T15:54:42.598 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.597+0000 7f192f33f800 20 add_watcher() i=3 2024-06-04T15:54:42.598 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.597+0000 7f192f33f800 20 add_watcher() i=4 2024-06-04T15:54:42.598 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.597+0000 7f192f33f800 20 add_watcher() i=5 2024-06-04T15:54:42.600 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.600+0000 7f192f33f800 20 add_watcher() i=6 2024-06-04T15:54:42.603 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.603+0000 7f192f33f800 20 add_watcher() i=7 2024-06-04T15:54:42.603 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.603+0000 7f192f33f800 2 all 8 watchers are set, enabling cache 2024-06-04T15:54:42.604 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.604+0000 7f17e1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-06-04T15:54:42.605 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.605+0000 7f192f33f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-06-04T15:54:42.605 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.605+0000 7f192f33f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-06-04T15:54:42.605 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.605+0000 7f192f33f800 5 note: GC not initialized 2024-06-04T15:54:42.606 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.605+0000 7f17e0fe1640 20 reqs_thread_entry: start 2024-06-04T15:54:42.606 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.605+0000 7f192f33f800 20 init_complete bucket index max shards: 11 2024-06-04T15:54:42.606 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.605+0000 7f192f33f800 20 Filter name: none 2024-06-04T15:54:42.606 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.605+0000 7f175a7fc640 20 reqs_thread_entry: start 2024-06-04T15:54:42.606 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.605+0000 7f192f33f800 20 rados->read ofs=0 len=0 2024-06-04T15:54:42.607 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.606+0000 7f192f33f800 20 rados_obj.operate() r=0 bl.length=190 2024-06-04T15:54:42.607 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.606+0000 7f192f33f800 20 rados->read ofs=0 len=0 2024-06-04T15:54:42.607 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.606+0000 7f192f33f800 20 rados_obj.operate() r=0 bl.length=404 2024-06-04T15:54:42.607 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.606+0000 7f192f33f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-06-04T15:54:42.607 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.606+0000 7f192f33f800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-06-04T15:54:42.607 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.606+0000 7f192f33f800 20 INFO: main: starting shard=0 2024-06-04T15:54:42.607 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.606+0000 7f192f33f800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.0 2024-06-04T15:54:42.607 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.606+0000 7f192f33f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-06-04T15:54:42.607 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.607+0000 7f192f33f800 20 INFO: main: starting shard=1 2024-06-04T15:54:42.607 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.607+0000 7f192f33f800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.1 2024-06-04T15:54:42.608 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.607+0000 7f192f33f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-06-04T15:54:42.609 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.607+0000 7f192f33f800 20 INFO: main: starting shard=2 2024-06-04T15:54:42.609 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.607+0000 7f192f33f800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.2 2024-06-04T15:54:42.609 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.607+0000 7f192f33f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-06-04T15:54:42.609 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.607+0000 7f192f33f800 20 INFO: main: starting shard=3 2024-06-04T15:54:42.609 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.607+0000 7f192f33f800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.3 2024-06-04T15:54:42.609 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.608+0000 7f192f33f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-06-04T15:54:42.609 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.608+0000 7f192f33f800 20 INFO: main: starting shard=4 2024-06-04T15:54:42.609 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.608+0000 7f192f33f800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.4 2024-06-04T15:54:42.609 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.608+0000 7f192f33f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-06-04T15:54:42.610 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.608+0000 7f192f33f800 20 INFO: main: starting shard=5 2024-06-04T15:54:42.610 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.608+0000 7f192f33f800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.5 2024-06-04T15:54:42.610 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.609+0000 7f192f33f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-06-04T15:54:42.611 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.609+0000 7f192f33f800 20 INFO: main: starting shard=6 2024-06-04T15:54:42.611 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.609+0000 7f192f33f800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.6 2024-06-04T15:54:42.611 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.609+0000 7f192f33f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-06-04T15:54:42.611 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.609+0000 7f192f33f800 20 INFO: main: starting shard=7 2024-06-04T15:54:42.611 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.609+0000 7f192f33f800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.7 2024-06-04T15:54:42.611 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.610+0000 7f192f33f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-06-04T15:54:42.611 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.610+0000 7f192f33f800 20 INFO: main: starting shard=8 2024-06-04T15:54:42.611 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.610+0000 7f192f33f800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.8 2024-06-04T15:54:42.611 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.610+0000 7f192f33f800 20 INFO: main: bi_list() returned without error; entries.size()=2, is_truncated=0, marker= 2024-06-04T15:54:42.611 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.610+0000 7f192f33f800 20 INFO: main: starting shard=9 2024-06-04T15:54:42.611 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.610+0000 7f192f33f800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.9 2024-06-04T15:54:42.612 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.611+0000 7f192f33f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-06-04T15:54:42.612 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.611+0000 7f192f33f800 20 INFO: main: starting shard=10 2024-06-04T15:54:42.612 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.611+0000 7f192f33f800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.10 2024-06-04T15:54:42.612 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.611+0000 7f192f33f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-06-04T15:54:42.612 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.611+0000 7f192f33f800 20 INFO: main: done 2024-06-04T15:54:42.612 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.612+0000 7f17e1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-06-04T15:54:42.614 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.614+0000 7f192f33f800 20 remove_watcher() i=0 2024-06-04T15:54:42.614 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.614+0000 7f192f33f800 2 removed watcher, disabling cache 2024-06-04T15:54:42.615 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.615+0000 7f192f33f800 20 remove_watcher() i=1 2024-06-04T15:54:42.616 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.616+0000 7f192f33f800 20 remove_watcher() i=2 2024-06-04T15:54:42.617 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.617+0000 7f192f33f800 20 remove_watcher() i=3 2024-06-04T15:54:42.618 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.618+0000 7f192f33f800 20 remove_watcher() i=4 2024-06-04T15:54:42.620 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.620+0000 7f192f33f800 20 remove_watcher() i=5 2024-06-04T15:54:42.621 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.621+0000 7f192f33f800 20 remove_watcher() i=6 2024-06-04T15:54:42.622 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.622+0000 7f192f33f800 20 remove_watcher() i=7 2024-06-04T15:54:42.632 INFO:tasks.workunit.client.0.smithi144.stderr:TEST: bucket check olh finds leftover OLH entries 2024-06-04T15:54:42.633 INFO:tasks.workunit.client.0.smithi144.stderr: 2024-06-04T15:54:42.634 INFO:tasks.workunit.client.0.smithi144.stderr:radosgw-admin bucket check olh --bucket check-bucket --dump-keys 2024-06-04T15:54:42.664 INFO:tasks.workunit.client.0.smithi144.stderr:ignoring --setuser ceph since I am not root 2024-06-04T15:54:42.664 INFO:tasks.workunit.client.0.smithi144.stderr:ignoring --setgroup ceph since I am not root 2024-06-04T15:54:42.700 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.700+0000 7fc42b418800 20 rados->read ofs=0 len=0 2024-06-04T15:54:42.702 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.702+0000 7fc42b418800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T15:54:42.702 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.702+0000 7fc42b418800 20 realm 2024-06-04T15:54:42.702 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.702+0000 7fc42b418800 20 rados->read ofs=0 len=0 2024-06-04T15:54:42.702 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.702+0000 7fc42b418800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T15:54:42.702 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.702+0000 7fc42b418800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-06-04T15:54:42.703 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.702+0000 7fc42b418800 20 rados->read ofs=0 len=0 2024-06-04T15:54:42.703 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.702+0000 7fc42b418800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T15:54:42.703 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.702+0000 7fc42b418800 20 rados->read ofs=0 len=0 2024-06-04T15:54:42.703 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.703+0000 7fc42b418800 20 rados_obj.operate() r=0 bl.length=46 2024-06-04T15:54:42.703 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.703+0000 7fc42b418800 20 rados->read ofs=0 len=0 2024-06-04T15:54:42.704 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.703+0000 7fc42b418800 20 rados_obj.operate() r=0 bl.length=1139 2024-06-04T15:54:42.704 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.703+0000 7fc42b418800 20 searching for the correct realm 2024-06-04T15:54:42.705 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.705+0000 7fc427212640 0 -- 172.21.15.144:0/3680728096 >> [v2:172.21.15.144:6800/1453747520,v1:172.21.15.144:6801/1453747520] conn(0x7fc4100aec20 msgr2=0x7fc4100dd3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-06-04T15:54:42.910 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.909+0000 7fc427212640 0 -- 172.21.15.144:0/3680728096 >> [v2:172.21.15.144:6824/166159729,v1:172.21.15.144:6825/166159729] conn(0x55e90970d2c0 msgr2=0x55e90970f6d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-06-04T15:54:42.915 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.915+0000 7fc42b418800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-06-04T15:54:42.915 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.915+0000 7fc42b418800 20 RGWRados::pool_iterate: got zone_info.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767 2024-06-04T15:54:42.915 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.915+0000 7fc42b418800 20 RGWRados::pool_iterate: got default.zone. 2024-06-04T15:54:42.915 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.915+0000 7fc42b418800 20 RGWRados::pool_iterate: got zonegroup_info.abb22408-c332-4e28-8f7a-ff254ea2fed2 2024-06-04T15:54:42.915 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.915+0000 7fc42b418800 20 RGWRados::pool_iterate: got zone_names.default 2024-06-04T15:54:42.915 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.915+0000 7fc42b418800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-06-04T15:54:42.915 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.915+0000 7fc42b418800 20 rados->read ofs=0 len=0 2024-06-04T15:54:42.916 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.915+0000 7fc42b418800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T15:54:42.916 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.915+0000 7fc42b418800 20 rados->read ofs=0 len=0 2024-06-04T15:54:42.917 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.915+0000 7fc42b418800 20 rados_obj.operate() r=0 bl.length=46 2024-06-04T15:54:42.917 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.915+0000 7fc42b418800 20 rados->read ofs=0 len=0 2024-06-04T15:54:42.917 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.915+0000 7fc42b418800 20 rados_obj.operate() r=0 bl.length=470 2024-06-04T15:54:42.917 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.915+0000 7fc42b418800 20 zone default found 2024-06-04T15:54:42.917 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.915+0000 7fc42b418800 4 Realm: () 2024-06-04T15:54:42.917 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.915+0000 7fc42b418800 4 ZoneGroup: default (abb22408-c332-4e28-8f7a-ff254ea2fed2) 2024-06-04T15:54:42.917 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.915+0000 7fc42b418800 4 Zone: default (be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767) 2024-06-04T15:54:42.918 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.915+0000 7fc42b418800 10 cannot find current period zonegroup using local zonegroup configuration 2024-06-04T15:54:42.918 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.915+0000 7fc42b418800 20 zonegroup default 2024-06-04T15:54:42.918 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.915+0000 7fc42b418800 20 rados->read ofs=0 len=0 2024-06-04T15:54:42.918 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.916+0000 7fc42b418800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T15:54:42.918 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.916+0000 7fc42b418800 20 rados->read ofs=0 len=0 2024-06-04T15:54:42.918 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.916+0000 7fc42b418800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T15:54:42.918 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.916+0000 7fc42b418800 20 rados->read ofs=0 len=0 2024-06-04T15:54:42.918 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.916+0000 7fc42b418800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T15:54:42.918 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.916+0000 7fc42b418800 20 started sync module instance, tier type = 2024-06-04T15:54:42.918 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.916+0000 7fc42b418800 20 started zone id=be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767 (name=default) with tier type = 2024-06-04T15:54:42.936 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.936+0000 7fc42b418800 20 add_watcher() i=0 2024-06-04T15:54:42.937 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.936+0000 7fc42b418800 20 add_watcher() i=1 2024-06-04T15:54:42.937 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.936+0000 7fc42b418800 20 add_watcher() i=2 2024-06-04T15:54:42.937 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.936+0000 7fc42b418800 20 add_watcher() i=3 2024-06-04T15:54:42.937 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.936+0000 7fc42b418800 20 add_watcher() i=4 2024-06-04T15:54:42.937 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.936+0000 7fc42b418800 20 add_watcher() i=5 2024-06-04T15:54:42.937 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.936+0000 7fc42b418800 20 add_watcher() i=6 2024-06-04T15:54:42.939 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.939+0000 7fc42b418800 20 add_watcher() i=7 2024-06-04T15:54:42.939 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.939+0000 7fc42b418800 2 all 8 watchers are set, enabling cache 2024-06-04T15:54:42.940 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.940+0000 7fc2dd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-06-04T15:54:42.941 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.941+0000 7fc42b418800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-06-04T15:54:42.941 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.941+0000 7fc42b418800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-06-04T15:54:42.942 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.941+0000 7fc42b418800 5 note: GC not initialized 2024-06-04T15:54:42.942 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.941+0000 7fc257fff640 20 reqs_thread_entry: start 2024-06-04T15:54:42.942 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.941+0000 7fc42b418800 20 init_complete bucket index max shards: 11 2024-06-04T15:54:42.942 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.941+0000 7fc42b418800 20 Filter name: none 2024-06-04T15:54:42.942 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.941+0000 7fc255ffb640 20 reqs_thread_entry: start 2024-06-04T15:54:42.942 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.941+0000 7fc42b418800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-06-04T15:54:42.942 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.941+0000 7fc42b418800 20 rados->read ofs=0 len=0 2024-06-04T15:54:42.943 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.942+0000 7fc42b418800 20 rados_obj.operate() r=0 bl.length=190 2024-06-04T15:54:42.943 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.942+0000 7fc42b418800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-06-04T15:54:42.943 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.942+0000 7fc42b418800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-06-04T15:54:42.943 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.942+0000 7fc42b418800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1 : miss 2024-06-04T15:54:42.943 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.942+0000 7fc42b418800 20 rados->read ofs=0 len=0 2024-06-04T15:54:42.944 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.942+0000 7fc42b418800 20 rados_obj.operate() r=0 bl.length=404 2024-06-04T15:54:42.944 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.942+0000 7fc42b418800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1 info.flags=0x17 2024-06-04T15:54:42.944 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.942+0000 7fc42b418800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1 to cache LRU end 2024-06-04T15:54:42.944 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.942+0000 7fc42b418800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-06-04T15:54:42.944 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.942+0000 7fc42b418800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-06-04T15:54:42.944 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.942+0000 7fc42b418800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1 2024-06-04T15:54:42.944 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.942+0000 7fc42b418800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.0 2024-06-04T15:54:42.944 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.943+0000 7fc42b418800 1 NOTICE: finished shard 0 (0 entries found) 2024-06-04T15:54:42.944 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.943+0000 7fc42b418800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.1 2024-06-04T15:54:42.944 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.943+0000 7fc42b418800 1 NOTICE: finished shard 1 (0 entries found) 2024-06-04T15:54:42.944 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.943+0000 7fc42b418800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.2 2024-06-04T15:54:42.945 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.944+0000 7fc42b418800 1 NOTICE: finished shard 2 (0 entries found) 2024-06-04T15:54:42.945 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.944+0000 7fc42b418800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.3 2024-06-04T15:54:42.945 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.944+0000 7fc42b418800 1 NOTICE: finished shard 3 (0 entries found) 2024-06-04T15:54:42.945 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.944+0000 7fc42b418800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.4 2024-06-04T15:54:42.945 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.945+0000 7fc42b418800 1 NOTICE: finished shard 4 (0 entries found) 2024-06-04T15:54:42.945 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.945+0000 7fc42b418800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.5 2024-06-04T15:54:42.946 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.945+0000 7fc42b418800 1 NOTICE: finished shard 5 (1 entries found) 2024-06-04T15:54:42.946 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.945+0000 7fc42b418800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.6 2024-06-04T15:54:42.946 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.946+0000 7fc42b418800 1 NOTICE: finished shard 6 (0 entries found) 2024-06-04T15:54:42.946 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.946+0000 7fc42b418800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.7 2024-06-04T15:54:42.947 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.946+0000 7fc42b418800 1 NOTICE: finished shard 7 (0 entries found) 2024-06-04T15:54:42.947 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.946+0000 7fc42b418800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.8 2024-06-04T15:54:42.947 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.946+0000 7fc42b418800 1 NOTICE: finished shard 8 (1 entries found) 2024-06-04T15:54:42.947 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.946+0000 7fc42b418800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.9 2024-06-04T15:54:42.947 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.947+0000 7fc42b418800 1 NOTICE: finished shard 9 (0 entries found) 2024-06-04T15:54:42.947 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.947+0000 7fc42b418800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.10 2024-06-04T15:54:42.948 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.947+0000 7fc42b418800 1 NOTICE: finished shard 10 (0 entries found) 2024-06-04T15:54:42.948 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.947+0000 7fc42b418800 1 NOTICE: finished all shards (2 entries found) 2024-06-04T15:54:42.948 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.948+0000 7fc2dd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-06-04T15:54:42.951 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.951+0000 7fc42b418800 20 remove_watcher() i=0 2024-06-04T15:54:42.951 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.951+0000 7fc42b418800 2 removed watcher, disabling cache 2024-06-04T15:54:42.952 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.952+0000 7fc42b418800 20 remove_watcher() i=1 2024-06-04T15:54:42.953 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.953+0000 7fc42b418800 20 remove_watcher() i=2 2024-06-04T15:54:42.954 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.954+0000 7fc42b418800 20 remove_watcher() i=3 2024-06-04T15:54:42.955 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.955+0000 7fc42b418800 20 remove_watcher() i=4 2024-06-04T15:54:42.956 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.956+0000 7fc42b418800 20 remove_watcher() i=5 2024-06-04T15:54:42.959 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.958+0000 7fc42b418800 20 remove_watcher() i=6 2024-06-04T15:54:42.961 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:42.961+0000 7fc42b418800 20 remove_watcher() i=7 2024-06-04T15:54:42.972 INFO:tasks.workunit.client.0.smithi144.stderr:TEST: bucket check olh fixes leftover OLH entries 2024-06-04T15:54:42.972 INFO:tasks.workunit.client.0.smithi144.stderr: 2024-06-04T15:54:42.973 INFO:tasks.workunit.client.0.smithi144.stderr:radosgw-admin bucket check olh --bucket check-bucket --fix --rgw-olh-pending-timeout-sec 0 --dump-keys 2024-06-04T15:54:43.005 INFO:tasks.workunit.client.0.smithi144.stderr:ignoring --setuser ceph since I am not root 2024-06-04T15:54:43.005 INFO:tasks.workunit.client.0.smithi144.stderr:ignoring --setgroup ceph since I am not root 2024-06-04T15:54:43.041 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.041+0000 7f0307c0e800 20 rados->read ofs=0 len=0 2024-06-04T15:54:43.043 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.042+0000 7f0307c0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T15:54:43.043 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.043+0000 7f0307c0e800 20 realm 2024-06-04T15:54:43.043 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.043+0000 7f0307c0e800 20 rados->read ofs=0 len=0 2024-06-04T15:54:43.043 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.043+0000 7f0307c0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T15:54:43.043 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.043+0000 7f0307c0e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-06-04T15:54:43.043 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.043+0000 7f0307c0e800 20 rados->read ofs=0 len=0 2024-06-04T15:54:43.044 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.043+0000 7f0307c0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T15:54:43.044 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.043+0000 7f0307c0e800 20 rados->read ofs=0 len=0 2024-06-04T15:54:43.044 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.044+0000 7f0307c0e800 20 rados_obj.operate() r=0 bl.length=46 2024-06-04T15:54:43.044 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.044+0000 7f0307c0e800 20 rados->read ofs=0 len=0 2024-06-04T15:54:43.044 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.044+0000 7f0307c0e800 20 rados_obj.operate() r=0 bl.length=1139 2024-06-04T15:54:43.044 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.044+0000 7f0307c0e800 20 searching for the correct realm 2024-06-04T15:54:43.046 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.046+0000 7f0305f04640 0 -- 172.21.15.144:0/754711313 >> [v2:172.21.15.144:6800/1453747520,v1:172.21.15.144:6801/1453747520] conn(0x7f02fc07d030 msgr2=0x7f02fc09c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-06-04T15:54:43.251 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.251+0000 7f0305f04640 0 -- 172.21.15.144:0/754711313 >> [v2:172.21.15.144:6824/166159729,v1:172.21.15.144:6825/166159729] conn(0x564373a7c000 msgr2=0x564373a7e410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-06-04T15:54:43.256 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.255+0000 7f0307c0e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-06-04T15:54:43.256 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.255+0000 7f0307c0e800 20 RGWRados::pool_iterate: got zone_info.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767 2024-06-04T15:54:43.256 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.255+0000 7f0307c0e800 20 RGWRados::pool_iterate: got default.zone. 2024-06-04T15:54:43.256 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.255+0000 7f0307c0e800 20 RGWRados::pool_iterate: got zonegroup_info.abb22408-c332-4e28-8f7a-ff254ea2fed2 2024-06-04T15:54:43.256 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.255+0000 7f0307c0e800 20 RGWRados::pool_iterate: got zone_names.default 2024-06-04T15:54:43.256 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.256+0000 7f0307c0e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-06-04T15:54:43.256 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.256+0000 7f0307c0e800 20 rados->read ofs=0 len=0 2024-06-04T15:54:43.257 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.256+0000 7f0307c0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T15:54:43.257 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.256+0000 7f0307c0e800 20 rados->read ofs=0 len=0 2024-06-04T15:54:43.258 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.256+0000 7f0307c0e800 20 rados_obj.operate() r=0 bl.length=46 2024-06-04T15:54:43.258 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.256+0000 7f0307c0e800 20 rados->read ofs=0 len=0 2024-06-04T15:54:43.258 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.256+0000 7f0307c0e800 20 rados_obj.operate() r=0 bl.length=470 2024-06-04T15:54:43.258 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.256+0000 7f0307c0e800 20 zone default found 2024-06-04T15:54:43.258 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.256+0000 7f0307c0e800 4 Realm: () 2024-06-04T15:54:43.258 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.256+0000 7f0307c0e800 4 ZoneGroup: default (abb22408-c332-4e28-8f7a-ff254ea2fed2) 2024-06-04T15:54:43.258 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.256+0000 7f0307c0e800 4 Zone: default (be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767) 2024-06-04T15:54:43.258 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.256+0000 7f0307c0e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-06-04T15:54:43.259 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.256+0000 7f0307c0e800 20 zonegroup default 2024-06-04T15:54:43.259 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.256+0000 7f0307c0e800 20 rados->read ofs=0 len=0 2024-06-04T15:54:43.259 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.257+0000 7f0307c0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T15:54:43.259 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.257+0000 7f0307c0e800 20 rados->read ofs=0 len=0 2024-06-04T15:54:43.259 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.257+0000 7f0307c0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T15:54:43.259 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.257+0000 7f0307c0e800 20 rados->read ofs=0 len=0 2024-06-04T15:54:43.259 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.257+0000 7f0307c0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T15:54:43.259 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.257+0000 7f0307c0e800 20 started sync module instance, tier type = 2024-06-04T15:54:43.259 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.257+0000 7f0307c0e800 20 started zone id=be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767 (name=default) with tier type = 2024-06-04T15:54:43.268 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.268+0000 7f0307c0e800 20 add_watcher() i=0 2024-06-04T15:54:43.269 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.268+0000 7f0307c0e800 20 add_watcher() i=1 2024-06-04T15:54:43.269 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.268+0000 7f0307c0e800 20 add_watcher() i=2 2024-06-04T15:54:43.269 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.268+0000 7f0307c0e800 20 add_watcher() i=3 2024-06-04T15:54:43.269 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.268+0000 7f0307c0e800 20 add_watcher() i=4 2024-06-04T15:54:43.269 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.268+0000 7f0307c0e800 20 add_watcher() i=5 2024-06-04T15:54:43.269 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.268+0000 7f0307c0e800 20 add_watcher() i=6 2024-06-04T15:54:43.270 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.269+0000 7f0307c0e800 20 add_watcher() i=7 2024-06-04T15:54:43.270 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.269+0000 7f0307c0e800 2 all 8 watchers are set, enabling cache 2024-06-04T15:54:43.272 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.271+0000 7f01bb7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-06-04T15:54:43.272 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.272+0000 7f0307c0e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-06-04T15:54:43.272 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.272+0000 7f0307c0e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-06-04T15:54:43.272 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.272+0000 7f0307c0e800 5 note: GC not initialized 2024-06-04T15:54:43.273 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.272+0000 7f01ba7e4640 20 reqs_thread_entry: start 2024-06-04T15:54:43.274 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.272+0000 7f0307c0e800 20 init_complete bucket index max shards: 11 2024-06-04T15:54:43.274 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.272+0000 7f0307c0e800 20 Filter name: none 2024-06-04T15:54:43.274 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.272+0000 7f012bfff640 20 reqs_thread_entry: start 2024-06-04T15:54:43.274 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.272+0000 7f0307c0e800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-06-04T15:54:43.274 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.272+0000 7f0307c0e800 20 rados->read ofs=0 len=0 2024-06-04T15:54:43.274 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.273+0000 7f0307c0e800 20 rados_obj.operate() r=0 bl.length=190 2024-06-04T15:54:43.274 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.273+0000 7f0307c0e800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-06-04T15:54:43.274 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.273+0000 7f0307c0e800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-06-04T15:54:43.274 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.273+0000 7f0307c0e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1 : miss 2024-06-04T15:54:43.274 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.273+0000 7f0307c0e800 20 rados->read ofs=0 len=0 2024-06-04T15:54:43.274 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.273+0000 7f0307c0e800 20 rados_obj.operate() r=0 bl.length=404 2024-06-04T15:54:43.275 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.273+0000 7f0307c0e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1 info.flags=0x17 2024-06-04T15:54:43.275 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.273+0000 7f0307c0e800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1 to cache LRU end 2024-06-04T15:54:43.275 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.273+0000 7f0307c0e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-06-04T15:54:43.275 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.273+0000 7f0307c0e800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-06-04T15:54:43.275 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.273+0000 7f0307c0e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1 2024-06-04T15:54:43.275 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.273+0000 7f0307c0e800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.0 2024-06-04T15:54:43.275 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.274+0000 7f0307c0e800 1 NOTICE: finished shard 0 (0 entries removed) 2024-06-04T15:54:43.275 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.274+0000 7f0307c0e800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.1 2024-06-04T15:54:43.276 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.274+0000 7f0307c0e800 1 NOTICE: finished shard 1 (0 entries removed) 2024-06-04T15:54:43.276 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.274+0000 7f0307c0e800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.2 2024-06-04T15:54:43.276 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.275+0000 7f0307c0e800 1 NOTICE: finished shard 2 (0 entries removed) 2024-06-04T15:54:43.276 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.275+0000 7f0307c0e800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.3 2024-06-04T15:54:43.276 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.275+0000 7f0307c0e800 1 NOTICE: finished shard 3 (0 entries removed) 2024-06-04T15:54:43.276 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.275+0000 7f0307c0e800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.4 2024-06-04T15:54:43.276 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.275+0000 7f0307c0e800 1 NOTICE: finished shard 4 (0 entries removed) 2024-06-04T15:54:43.276 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.276+0000 7f0307c0e800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.5 2024-06-04T15:54:43.277 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.276+0000 7f0307c0e800 20 get_obj_state: octx=0x5643737e67c0 obj=check-bucket:d state=0x564373ab53e8 s->prefetch_data=0 2024-06-04T15:54:43.277 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.276+0000 7f0307c0e800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.6 2024-06-04T15:54:43.277 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.276+0000 7f0307c0e800 1 NOTICE: finished shard 6 (0 entries removed) 2024-06-04T15:54:43.278 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.276+0000 7f0307c0e800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.7 2024-06-04T15:54:43.278 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.277+0000 7f0307c0e800 1 NOTICE: finished shard 7 (0 entries removed) 2024-06-04T15:54:43.278 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.277+0000 7f0307c0e800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.8 2024-06-04T15:54:43.278 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.277+0000 7f0307c0e800 20 get_obj_state: octx=0x56437380e0b0 obj=check-bucket:c state=0x564373aae2f8 s->prefetch_data=0 2024-06-04T15:54:43.278 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.277+0000 7f0307c0e800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.9 2024-06-04T15:54:43.279 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.278+0000 7f0307c0e800 1 NOTICE: finished shard 9 (0 entries removed) 2024-06-04T15:54:43.279 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.278+0000 7f0307c0e800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.10 2024-06-04T15:54:43.279 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.278+0000 7f0307c0e800 1 NOTICE: finished shard 10 (0 entries removed) 2024-06-04T15:54:43.279 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.278+0000 7f0307c0e800 20 get_obj_state: setting s->obj_tag to 27oq1d1fwq6zdthadwtyr7yoaw4wfkdv 2024-06-04T15:54:43.279 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.278+0000 7f0307c0e800 20 get_obj_state_impl: setting s->olh_tag to fw9v819aff782h8yrsz6ahlqcwfkw84o 2024-06-04T15:54:43.279 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.278+0000 7f0307c0e800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.5 2024-06-04T15:54:43.280 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.278+0000 7f0307c0e800 20 get_obj_state: setting s->obj_tag to rs8tftipyi64km0ffov0ebkda8d9css5 2024-06-04T15:54:43.280 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.278+0000 7f0307c0e800 20 get_obj_state_impl: setting s->olh_tag to epyt9ehkdcnxwykgxq1581ncp91susd9 2024-06-04T15:54:43.280 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.278+0000 7f0307c0e800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.8 2024-06-04T15:54:43.280 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.279+0000 7f0307c0e800 20 olh_log_entry: epoch=4 op=2 key=d[] 2024-06-04T15:54:43.280 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.279+0000 7f0307c0e800 20 olh_log_entry: epoch=4 op=3 key=d[L4jPdoVbeqPrpxCBnUoF2tL...1j5Zc] 2024-06-04T15:54:43.280 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.279+0000 7f0307c0e800 20 get_obj_state: octx=0x564373aecfb0 obj=check-bucket:_:L4jPdoVbeqPrpxCBnUoF2tL...1j5Zc_d state=0x564373b13a58 s->prefetch_data=0 2024-06-04T15:54:43.280 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.279+0000 7f0307c0e800 20 olh_log_entry: epoch=4 op=2 key=c[] 2024-06-04T15:54:43.280 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.279+0000 7f0307c0e800 20 olh_log_entry: epoch=4 op=3 key=c[QKuXN1t5cwjjdjFQ.0XRWFGyzPqYTdd] 2024-06-04T15:54:43.280 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.279+0000 7f0307c0e800 20 get_obj_state: octx=0x564373b0cfb0 obj=check-bucket:_:QKuXN1t5cwjjdjFQ.0XRWFGyzPqYTdd_c state=0x564373b197b8 s->prefetch_data=0 2024-06-04T15:54:43.281 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.280+0000 7f0307c0e800 20 get_obj_state: octx=0x564373aecfb0 obj=check-bucket:d state=0x564373b19788 s->prefetch_data=0 2024-06-04T15:54:43.281 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.281+0000 7f0307c0e800 20 get_obj_state: octx=0x564373b0cfb0 obj=check-bucket:c state=0x564373ab1298 s->prefetch_data=0 2024-06-04T15:54:43.281 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.281+0000 7f0307c0e800 20 get_obj_state: setting s->obj_tag to 27oq1d1fwq6zdthadwtyr7yoaw4wfkdv 2024-06-04T15:54:43.281 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.281+0000 7f0307c0e800 20 get_obj_state_impl: setting s->olh_tag to fw9v819aff782h8yrsz6ahlqcwfkw84o 2024-06-04T15:54:43.281 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.281+0000 7f0307c0e800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=fw9v819aff782h8yrsz6ahlqcwfkw84o 2024-06-04T15:54:43.282 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.281+0000 7f0307c0e800 20 get_obj_state: setting s->obj_tag to rs8tftipyi64km0ffov0ebkda8d9css5 2024-06-04T15:54:43.282 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.281+0000 7f0307c0e800 20 get_obj_state_impl: setting s->olh_tag to epyt9ehkdcnxwykgxq1581ncp91susd9 2024-06-04T15:54:43.282 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.281+0000 7f0307c0e800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=epyt9ehkdcnxwykgxq1581ncp91susd9 2024-06-04T15:54:43.292 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.292+0000 7f0307c0e800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.8 2024-06-04T15:54:43.292 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.292+0000 7f0307c0e800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.5 2024-06-04T15:54:43.294 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.294+0000 7f0307c0e800 1 NOTICE: finished shard 5 (1 entries removed) 2024-06-04T15:54:43.295 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.295+0000 7f0307c0e800 1 NOTICE: finished shard 8 (1 entries removed) 2024-06-04T15:54:43.295 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.295+0000 7f0307c0e800 1 NOTICE: finished all shards (2 entries removed) 2024-06-04T15:54:43.295 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.295+0000 7f01bb7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-06-04T15:54:43.298 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.297+0000 7f0307c0e800 20 remove_watcher() i=0 2024-06-04T15:54:43.298 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.297+0000 7f0307c0e800 2 removed watcher, disabling cache 2024-06-04T15:54:43.299 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.299+0000 7f0307c0e800 20 remove_watcher() i=1 2024-06-04T15:54:43.300 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.300+0000 7f0307c0e800 20 remove_watcher() i=2 2024-06-04T15:54:43.304 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.304+0000 7f0307c0e800 20 remove_watcher() i=3 2024-06-04T15:54:43.305 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.305+0000 7f0307c0e800 20 remove_watcher() i=4 2024-06-04T15:54:43.306 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.306+0000 7f0307c0e800 20 remove_watcher() i=5 2024-06-04T15:54:43.307 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.307+0000 7f0307c0e800 20 remove_watcher() i=6 2024-06-04T15:54:43.309 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.308+0000 7f0307c0e800 20 remove_watcher() i=7 2024-06-04T15:54:43.320 INFO:tasks.workunit.client.0.smithi144.stderr:radosgw-admin bi list --bucket check-bucket --object d 2024-06-04T15:54:43.350 INFO:tasks.workunit.client.0.smithi144.stderr:ignoring --setuser ceph since I am not root 2024-06-04T15:54:43.350 INFO:tasks.workunit.client.0.smithi144.stderr:ignoring --setgroup ceph since I am not root 2024-06-04T15:54:43.386 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.386+0000 7f2f5a11f800 20 rados->read ofs=0 len=0 2024-06-04T15:54:43.388 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.388+0000 7f2f5a11f800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T15:54:43.388 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.388+0000 7f2f5a11f800 20 realm 2024-06-04T15:54:43.389 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.388+0000 7f2f5a11f800 20 rados->read ofs=0 len=0 2024-06-04T15:54:43.389 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.388+0000 7f2f5a11f800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T15:54:43.389 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.388+0000 7f2f5a11f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-06-04T15:54:43.389 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.388+0000 7f2f5a11f800 20 rados->read ofs=0 len=0 2024-06-04T15:54:43.389 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.388+0000 7f2f5a11f800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T15:54:43.389 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.388+0000 7f2f5a11f800 20 rados->read ofs=0 len=0 2024-06-04T15:54:43.389 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.389+0000 7f2f5a11f800 20 rados_obj.operate() r=0 bl.length=46 2024-06-04T15:54:43.389 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.389+0000 7f2f5a11f800 20 rados->read ofs=0 len=0 2024-06-04T15:54:43.390 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.390+0000 7f2f5a11f800 20 rados_obj.operate() r=0 bl.length=1139 2024-06-04T15:54:43.390 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.390+0000 7f2f5a11f800 20 searching for the correct realm 2024-06-04T15:54:43.392 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.392+0000 7f2f56650640 0 -- 172.21.15.144:0/2344026142 >> [v2:172.21.15.144:6800/1453747520,v1:172.21.15.144:6801/1453747520] conn(0x7f2f4c027030 msgr2=0x7f2f4c0914b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-06-04T15:54:43.597 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.597+0000 7f2f56650640 0 -- 172.21.15.144:0/2344026142 >> [v2:172.21.15.144:6824/166159729,v1:172.21.15.144:6825/166159729] conn(0x557955bf7510 msgr2=0x557955bf9900 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-06-04T15:54:43.602 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.602+0000 7f2f5a11f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-06-04T15:54:43.602 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.602+0000 7f2f5a11f800 20 RGWRados::pool_iterate: got zone_info.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767 2024-06-04T15:54:43.603 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.602+0000 7f2f5a11f800 20 RGWRados::pool_iterate: got default.zone. 2024-06-04T15:54:43.603 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.602+0000 7f2f5a11f800 20 RGWRados::pool_iterate: got zonegroup_info.abb22408-c332-4e28-8f7a-ff254ea2fed2 2024-06-04T15:54:43.603 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.602+0000 7f2f5a11f800 20 RGWRados::pool_iterate: got zone_names.default 2024-06-04T15:54:43.603 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.602+0000 7f2f5a11f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-06-04T15:54:43.603 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.602+0000 7f2f5a11f800 20 rados->read ofs=0 len=0 2024-06-04T15:54:43.603 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.602+0000 7f2f5a11f800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T15:54:43.603 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.602+0000 7f2f5a11f800 20 rados->read ofs=0 len=0 2024-06-04T15:54:43.603 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.602+0000 7f2f5a11f800 20 rados_obj.operate() r=0 bl.length=46 2024-06-04T15:54:43.603 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.602+0000 7f2f5a11f800 20 rados->read ofs=0 len=0 2024-06-04T15:54:43.604 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.603+0000 7f2f5a11f800 20 rados_obj.operate() r=0 bl.length=470 2024-06-04T15:54:43.604 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.603+0000 7f2f5a11f800 20 zone default found 2024-06-04T15:54:43.604 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.603+0000 7f2f5a11f800 4 Realm: () 2024-06-04T15:54:43.604 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.603+0000 7f2f5a11f800 4 ZoneGroup: default (abb22408-c332-4e28-8f7a-ff254ea2fed2) 2024-06-04T15:54:43.604 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.603+0000 7f2f5a11f800 4 Zone: default (be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767) 2024-06-04T15:54:43.604 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.603+0000 7f2f5a11f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-06-04T15:54:43.605 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.603+0000 7f2f5a11f800 20 zonegroup default 2024-06-04T15:54:43.605 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.603+0000 7f2f5a11f800 20 rados->read ofs=0 len=0 2024-06-04T15:54:43.605 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.603+0000 7f2f5a11f800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T15:54:43.605 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.603+0000 7f2f5a11f800 20 rados->read ofs=0 len=0 2024-06-04T15:54:43.605 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.603+0000 7f2f5a11f800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T15:54:43.605 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.603+0000 7f2f5a11f800 20 rados->read ofs=0 len=0 2024-06-04T15:54:43.605 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.604+0000 7f2f5a11f800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T15:54:43.605 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.604+0000 7f2f5a11f800 20 started sync module instance, tier type = 2024-06-04T15:54:43.605 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.604+0000 7f2f5a11f800 20 started zone id=be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767 (name=default) with tier type = 2024-06-04T15:54:43.625 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.625+0000 7f2f5a11f800 20 add_watcher() i=0 2024-06-04T15:54:43.625 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.625+0000 7f2f5a11f800 20 add_watcher() i=1 2024-06-04T15:54:43.625 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.625+0000 7f2f5a11f800 20 add_watcher() i=2 2024-06-04T15:54:43.625 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.625+0000 7f2f5a11f800 20 add_watcher() i=3 2024-06-04T15:54:43.625 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.625+0000 7f2f5a11f800 20 add_watcher() i=4 2024-06-04T15:54:43.625 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.625+0000 7f2f5a11f800 20 add_watcher() i=5 2024-06-04T15:54:43.625 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.625+0000 7f2f5a11f800 20 add_watcher() i=6 2024-06-04T15:54:43.627 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.628+0000 7f2f5a11f800 20 add_watcher() i=7 2024-06-04T15:54:43.627 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.628+0000 7f2f5a11f800 2 all 8 watchers are set, enabling cache 2024-06-04T15:54:43.629 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.629+0000 7f2e077fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-06-04T15:54:43.629 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.629+0000 7f2f5a11f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-06-04T15:54:43.630 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.629+0000 7f2f5a11f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-06-04T15:54:43.630 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.629+0000 7f2f5a11f800 5 note: GC not initialized 2024-06-04T15:54:43.631 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.630+0000 7f2e067fc640 20 reqs_thread_entry: start 2024-06-04T15:54:43.631 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.630+0000 7f2f5a11f800 20 init_complete bucket index max shards: 11 2024-06-04T15:54:43.631 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.630+0000 7f2f5a11f800 20 Filter name: none 2024-06-04T15:54:43.631 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.630+0000 7f2d77fff640 20 reqs_thread_entry: start 2024-06-04T15:54:43.631 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.630+0000 7f2f5a11f800 20 rados->read ofs=0 len=0 2024-06-04T15:54:43.631 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.630+0000 7f2f5a11f800 20 rados_obj.operate() r=0 bl.length=190 2024-06-04T15:54:43.632 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.630+0000 7f2f5a11f800 20 rados->read ofs=0 len=0 2024-06-04T15:54:43.632 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.631+0000 7f2f5a11f800 20 rados_obj.operate() r=0 bl.length=404 2024-06-04T15:54:43.632 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.631+0000 7f2f5a11f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-06-04T15:54:43.632 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.631+0000 7f2f5a11f800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-06-04T15:54:43.632 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.631+0000 7f2f5a11f800 20 INFO: main: starting shard=0 2024-06-04T15:54:43.632 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.631+0000 7f2f5a11f800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.0 2024-06-04T15:54:43.633 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.631+0000 7f2f5a11f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-06-04T15:54:43.633 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.631+0000 7f2f5a11f800 20 INFO: main: starting shard=1 2024-06-04T15:54:43.633 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.631+0000 7f2f5a11f800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.1 2024-06-04T15:54:43.633 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.632+0000 7f2f5a11f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-06-04T15:54:43.633 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.632+0000 7f2f5a11f800 20 INFO: main: starting shard=2 2024-06-04T15:54:43.633 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.632+0000 7f2f5a11f800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.2 2024-06-04T15:54:43.633 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.632+0000 7f2f5a11f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-06-04T15:54:43.633 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.632+0000 7f2f5a11f800 20 INFO: main: starting shard=3 2024-06-04T15:54:43.633 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.632+0000 7f2f5a11f800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.3 2024-06-04T15:54:43.633 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.633+0000 7f2f5a11f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-06-04T15:54:43.634 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.633+0000 7f2f5a11f800 20 INFO: main: starting shard=4 2024-06-04T15:54:43.634 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.633+0000 7f2f5a11f800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.4 2024-06-04T15:54:43.635 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.633+0000 7f2f5a11f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-06-04T15:54:43.635 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.633+0000 7f2f5a11f800 20 INFO: main: starting shard=5 2024-06-04T15:54:43.635 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.633+0000 7f2f5a11f800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.5 2024-06-04T15:54:43.635 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.634+0000 7f2f5a11f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-06-04T15:54:43.635 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.634+0000 7f2f5a11f800 20 INFO: main: starting shard=6 2024-06-04T15:54:43.635 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.634+0000 7f2f5a11f800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.6 2024-06-04T15:54:43.635 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.634+0000 7f2f5a11f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-06-04T15:54:43.635 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.634+0000 7f2f5a11f800 20 INFO: main: starting shard=7 2024-06-04T15:54:43.635 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.634+0000 7f2f5a11f800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.7 2024-06-04T15:54:43.635 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.634+0000 7f2f5a11f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-06-04T15:54:43.635 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.634+0000 7f2f5a11f800 20 INFO: main: starting shard=8 2024-06-04T15:54:43.636 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.634+0000 7f2f5a11f800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.8 2024-06-04T15:54:43.636 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.635+0000 7f2f5a11f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-06-04T15:54:43.636 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.635+0000 7f2f5a11f800 20 INFO: main: starting shard=9 2024-06-04T15:54:43.637 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.635+0000 7f2f5a11f800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.9 2024-06-04T15:54:43.637 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.635+0000 7f2f5a11f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-06-04T15:54:43.637 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.635+0000 7f2f5a11f800 20 INFO: main: starting shard=10 2024-06-04T15:54:43.637 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.635+0000 7f2f5a11f800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.10 2024-06-04T15:54:43.637 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.636+0000 7f2f5a11f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-06-04T15:54:43.637 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.636+0000 7f2f5a11f800 20 INFO: main: done 2024-06-04T15:54:43.637 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.637+0000 7f2e077fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-06-04T15:54:43.639 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.639+0000 7f2f5a11f800 20 remove_watcher() i=0 2024-06-04T15:54:43.639 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.639+0000 7f2f5a11f800 2 removed watcher, disabling cache 2024-06-04T15:54:43.640 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.640+0000 7f2f5a11f800 20 remove_watcher() i=1 2024-06-04T15:54:43.641 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.641+0000 7f2f5a11f800 20 remove_watcher() i=2 2024-06-04T15:54:43.642 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.642+0000 7f2f5a11f800 20 remove_watcher() i=3 2024-06-04T15:54:43.644 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.643+0000 7f2f5a11f800 20 remove_watcher() i=4 2024-06-04T15:54:43.644 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.644+0000 7f2f5a11f800 20 remove_watcher() i=5 2024-06-04T15:54:43.645 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.645+0000 7f2f5a11f800 20 remove_watcher() i=6 2024-06-04T15:54:43.647 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.647+0000 7f2f5a11f800 20 remove_watcher() i=7 2024-06-04T15:54:43.659 INFO:tasks.workunit.client.0.smithi144.stderr:radosgw-admin bi list --bucket check-bucket --object c 2024-06-04T15:54:43.689 INFO:tasks.workunit.client.0.smithi144.stderr:ignoring --setuser ceph since I am not root 2024-06-04T15:54:43.690 INFO:tasks.workunit.client.0.smithi144.stderr:ignoring --setgroup ceph since I am not root 2024-06-04T15:54:43.726 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.726+0000 7f43b3733800 20 rados->read ofs=0 len=0 2024-06-04T15:54:43.728 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.727+0000 7f43b3733800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T15:54:43.728 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.727+0000 7f43b3733800 20 realm 2024-06-04T15:54:43.728 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.727+0000 7f43b3733800 20 rados->read ofs=0 len=0 2024-06-04T15:54:43.728 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.728+0000 7f43b3733800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T15:54:43.728 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.728+0000 7f43b3733800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-06-04T15:54:43.728 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.728+0000 7f43b3733800 20 rados->read ofs=0 len=0 2024-06-04T15:54:43.728 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.728+0000 7f43b3733800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T15:54:43.728 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.728+0000 7f43b3733800 20 rados->read ofs=0 len=0 2024-06-04T15:54:43.729 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.728+0000 7f43b3733800 20 rados_obj.operate() r=0 bl.length=46 2024-06-04T15:54:43.729 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.728+0000 7f43b3733800 20 rados->read ofs=0 len=0 2024-06-04T15:54:43.729 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.729+0000 7f43b3733800 20 rados_obj.operate() r=0 bl.length=1139 2024-06-04T15:54:43.730 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.729+0000 7f43b3733800 20 searching for the correct realm 2024-06-04T15:54:43.731 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.731+0000 7f43af4e8640 0 -- 172.21.15.144:0/2928487228 >> [v2:172.21.15.177:6824/800067290,v1:172.21.15.177:6825/800067290] conn(0x56289e742a10 msgr2=0x56289e744e60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-06-04T15:54:43.734 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.734+0000 7f43a6ce7640 0 -- 172.21.15.144:0/2928487228 >> [v2:172.21.15.177:6808/2618477608,v1:172.21.15.177:6809/2618477608] conn(0x7f439803e070 msgr2=0x7f4398072590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-06-04T15:54:43.941 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.940+0000 7f43b3733800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-06-04T15:54:43.941 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.940+0000 7f43b3733800 20 RGWRados::pool_iterate: got zone_info.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767 2024-06-04T15:54:43.941 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.940+0000 7f43b3733800 20 RGWRados::pool_iterate: got default.zone. 2024-06-04T15:54:43.941 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.940+0000 7f43b3733800 20 RGWRados::pool_iterate: got zonegroup_info.abb22408-c332-4e28-8f7a-ff254ea2fed2 2024-06-04T15:54:43.941 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.940+0000 7f43b3733800 20 RGWRados::pool_iterate: got zone_names.default 2024-06-04T15:54:43.942 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.940+0000 7f43b3733800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-06-04T15:54:43.942 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.940+0000 7f43b3733800 20 rados->read ofs=0 len=0 2024-06-04T15:54:43.942 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.941+0000 7f43b3733800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T15:54:43.942 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.941+0000 7f43b3733800 20 rados->read ofs=0 len=0 2024-06-04T15:54:43.942 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.941+0000 7f43b3733800 20 rados_obj.operate() r=0 bl.length=46 2024-06-04T15:54:43.942 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.941+0000 7f43b3733800 20 rados->read ofs=0 len=0 2024-06-04T15:54:43.943 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.941+0000 7f43b3733800 20 rados_obj.operate() r=0 bl.length=470 2024-06-04T15:54:43.943 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.941+0000 7f43b3733800 20 zone default found 2024-06-04T15:54:43.943 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.941+0000 7f43b3733800 4 Realm: () 2024-06-04T15:54:43.943 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.941+0000 7f43b3733800 4 ZoneGroup: default (abb22408-c332-4e28-8f7a-ff254ea2fed2) 2024-06-04T15:54:43.943 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.941+0000 7f43b3733800 4 Zone: default (be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767) 2024-06-04T15:54:43.943 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.941+0000 7f43b3733800 10 cannot find current period zonegroup using local zonegroup configuration 2024-06-04T15:54:43.943 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.941+0000 7f43b3733800 20 zonegroup default 2024-06-04T15:54:43.943 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.941+0000 7f43b3733800 20 rados->read ofs=0 len=0 2024-06-04T15:54:43.944 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.942+0000 7f43b3733800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T15:54:43.944 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.942+0000 7f43b3733800 20 rados->read ofs=0 len=0 2024-06-04T15:54:43.944 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.942+0000 7f43b3733800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T15:54:43.944 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.942+0000 7f43b3733800 20 rados->read ofs=0 len=0 2024-06-04T15:54:43.944 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.942+0000 7f43b3733800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T15:54:43.944 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.942+0000 7f43b3733800 20 started sync module instance, tier type = 2024-06-04T15:54:43.944 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.942+0000 7f43b3733800 20 started zone id=be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767 (name=default) with tier type = 2024-06-04T15:54:43.952 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.951+0000 7f43b3733800 20 add_watcher() i=0 2024-06-04T15:54:43.952 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.951+0000 7f43b3733800 20 add_watcher() i=1 2024-06-04T15:54:43.952 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.951+0000 7f43b3733800 20 add_watcher() i=2 2024-06-04T15:54:43.952 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.951+0000 7f43b3733800 20 add_watcher() i=3 2024-06-04T15:54:43.952 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.951+0000 7f43b3733800 20 add_watcher() i=4 2024-06-04T15:54:43.952 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.951+0000 7f43b3733800 20 add_watcher() i=5 2024-06-04T15:54:43.952 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.952+0000 7f43b3733800 20 add_watcher() i=6 2024-06-04T15:54:43.953 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.953+0000 7f43b3733800 20 add_watcher() i=7 2024-06-04T15:54:43.953 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.953+0000 7f43b3733800 2 all 8 watchers are set, enabling cache 2024-06-04T15:54:43.954 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.954+0000 7f4265fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-06-04T15:54:43.956 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.955+0000 7f43b3733800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-06-04T15:54:43.956 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.955+0000 7f43b3733800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-06-04T15:54:43.956 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.955+0000 7f43b3733800 5 note: GC not initialized 2024-06-04T15:54:43.956 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.955+0000 7f4264fe1640 20 reqs_thread_entry: start 2024-06-04T15:54:43.956 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.955+0000 7f43b3733800 20 init_complete bucket index max shards: 11 2024-06-04T15:54:43.957 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.955+0000 7f43b3733800 20 Filter name: none 2024-06-04T15:54:43.957 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.955+0000 7f41de7fc640 20 reqs_thread_entry: start 2024-06-04T15:54:43.957 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.955+0000 7f43b3733800 20 rados->read ofs=0 len=0 2024-06-04T15:54:43.957 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.956+0000 7f43b3733800 20 rados_obj.operate() r=0 bl.length=190 2024-06-04T15:54:43.957 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.956+0000 7f43b3733800 20 rados->read ofs=0 len=0 2024-06-04T15:54:43.957 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.956+0000 7f43b3733800 20 rados_obj.operate() r=0 bl.length=404 2024-06-04T15:54:43.957 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.956+0000 7f43b3733800 20 couldn't put binfo cache entry, might have raced with data changes 2024-06-04T15:54:43.957 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.956+0000 7f43b3733800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-06-04T15:54:43.957 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.956+0000 7f43b3733800 20 INFO: main: starting shard=0 2024-06-04T15:54:43.957 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.956+0000 7f43b3733800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.0 2024-06-04T15:54:43.958 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.956+0000 7f43b3733800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-06-04T15:54:43.958 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.956+0000 7f43b3733800 20 INFO: main: starting shard=1 2024-06-04T15:54:43.958 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.956+0000 7f43b3733800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.1 2024-06-04T15:54:43.958 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.957+0000 7f43b3733800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-06-04T15:54:43.958 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.957+0000 7f43b3733800 20 INFO: main: starting shard=2 2024-06-04T15:54:43.958 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.957+0000 7f43b3733800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.2 2024-06-04T15:54:43.959 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.958+0000 7f43b3733800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-06-04T15:54:43.959 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.958+0000 7f43b3733800 20 INFO: main: starting shard=3 2024-06-04T15:54:43.959 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.958+0000 7f43b3733800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.3 2024-06-04T15:54:43.959 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.958+0000 7f43b3733800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-06-04T15:54:43.959 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.958+0000 7f43b3733800 20 INFO: main: starting shard=4 2024-06-04T15:54:43.959 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.958+0000 7f43b3733800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.4 2024-06-04T15:54:43.959 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.958+0000 7f43b3733800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-06-04T15:54:43.959 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.958+0000 7f43b3733800 20 INFO: main: starting shard=5 2024-06-04T15:54:43.960 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.958+0000 7f43b3733800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.5 2024-06-04T15:54:43.960 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.959+0000 7f43b3733800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-06-04T15:54:43.960 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.959+0000 7f43b3733800 20 INFO: main: starting shard=6 2024-06-04T15:54:43.960 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.959+0000 7f43b3733800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.6 2024-06-04T15:54:43.960 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.960+0000 7f43b3733800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-06-04T15:54:43.961 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.960+0000 7f43b3733800 20 INFO: main: starting shard=7 2024-06-04T15:54:43.961 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.960+0000 7f43b3733800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.7 2024-06-04T15:54:43.961 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.960+0000 7f43b3733800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-06-04T15:54:43.961 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.960+0000 7f43b3733800 20 INFO: main: starting shard=8 2024-06-04T15:54:43.961 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.960+0000 7f43b3733800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.8 2024-06-04T15:54:43.962 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.961+0000 7f43b3733800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-06-04T15:54:43.962 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.961+0000 7f43b3733800 20 INFO: main: starting shard=9 2024-06-04T15:54:43.962 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.961+0000 7f43b3733800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.9 2024-06-04T15:54:43.962 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.961+0000 7f43b3733800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-06-04T15:54:43.962 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.961+0000 7f43b3733800 20 INFO: main: starting shard=10 2024-06-04T15:54:43.962 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.961+0000 7f43b3733800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.10 2024-06-04T15:54:43.962 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.962+0000 7f43b3733800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-06-04T15:54:43.962 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.962+0000 7f43b3733800 20 INFO: main: done 2024-06-04T15:54:43.963 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.962+0000 7f4265fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-06-04T15:54:43.965 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.965+0000 7f43b3733800 20 remove_watcher() i=0 2024-06-04T15:54:43.965 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.965+0000 7f43b3733800 2 removed watcher, disabling cache 2024-06-04T15:54:43.966 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.966+0000 7f43b3733800 20 remove_watcher() i=1 2024-06-04T15:54:43.967 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.967+0000 7f43b3733800 20 remove_watcher() i=2 2024-06-04T15:54:43.968 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.968+0000 7f43b3733800 20 remove_watcher() i=3 2024-06-04T15:54:43.969 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.969+0000 7f43b3733800 20 remove_watcher() i=4 2024-06-04T15:54:43.970 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.970+0000 7f43b3733800 20 remove_watcher() i=5 2024-06-04T15:54:43.971 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.971+0000 7f43b3733800 20 remove_watcher() i=6 2024-06-04T15:54:43.972 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:43.972+0000 7f43b3733800 20 remove_watcher() i=7 2024-06-04T15:54:43.982 INFO:tasks.workunit.client.0.smithi144.stderr:TEST: bucket check olh does not find new leftover OLH entries after fix 2024-06-04T15:54:43.982 INFO:tasks.workunit.client.0.smithi144.stderr: 2024-06-04T15:54:43.984 INFO:tasks.workunit.client.0.smithi144.stderr:radosgw-admin bucket check olh --bucket check-bucket --dump-keys 2024-06-04T15:54:44.013 INFO:tasks.workunit.client.0.smithi144.stderr:ignoring --setuser ceph since I am not root 2024-06-04T15:54:44.013 INFO:tasks.workunit.client.0.smithi144.stderr:ignoring --setgroup ceph since I am not root 2024-06-04T15:54:44.049 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:44.049+0000 7f1814735800 20 rados->read ofs=0 len=0 2024-06-04T15:54:44.051 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:44.051+0000 7f1814735800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T15:54:44.052 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:44.051+0000 7f1814735800 20 realm 2024-06-04T15:54:44.052 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:44.051+0000 7f1814735800 20 rados->read ofs=0 len=0 2024-06-04T15:54:44.052 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:44.051+0000 7f1814735800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T15:54:44.052 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:44.051+0000 7f1814735800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-06-04T15:54:44.052 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:44.051+0000 7f1814735800 20 rados->read ofs=0 len=0 2024-06-04T15:54:44.052 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:44.051+0000 7f1814735800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T15:54:44.052 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:44.051+0000 7f1814735800 20 rados->read ofs=0 len=0 2024-06-04T15:54:44.053 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:44.052+0000 7f1814735800 20 rados_obj.operate() r=0 bl.length=46 2024-06-04T15:54:44.053 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:44.052+0000 7f1814735800 20 rados->read ofs=0 len=0 2024-06-04T15:54:44.053 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:44.052+0000 7f1814735800 20 rados_obj.operate() r=0 bl.length=1139 2024-06-04T15:54:44.053 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:44.053+0000 7f1814735800 20 searching for the correct realm 2024-06-04T15:54:44.055 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:44.055+0000 7f1810bac640 0 -- 172.21.15.144:0/4020260205 >> [v2:172.21.15.144:6800/1453747520,v1:172.21.15.144:6801/1453747520] conn(0x7f17f8025020 msgr2=0x7f17f805f9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-06-04T15:54:44.260 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:44.259+0000 7f1810bac640 0 -- 172.21.15.144:0/4020260205 >> [v2:172.21.15.144:6824/166159729,v1:172.21.15.144:6825/166159729] conn(0x56284917b930 msgr2=0x56284917dd20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-06-04T15:54:44.265 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:44.264+0000 7f1814735800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-06-04T15:54:44.265 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:44.264+0000 7f1814735800 20 RGWRados::pool_iterate: got zone_info.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767 2024-06-04T15:54:44.265 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:44.264+0000 7f1814735800 20 RGWRados::pool_iterate: got default.zone. 2024-06-04T15:54:44.265 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:44.264+0000 7f1814735800 20 RGWRados::pool_iterate: got zonegroup_info.abb22408-c332-4e28-8f7a-ff254ea2fed2 2024-06-04T15:54:44.265 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:44.264+0000 7f1814735800 20 RGWRados::pool_iterate: got zone_names.default 2024-06-04T15:54:44.265 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:44.264+0000 7f1814735800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-06-04T15:54:44.265 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:44.264+0000 7f1814735800 20 rados->read ofs=0 len=0 2024-06-04T15:54:44.265 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:44.264+0000 7f1814735800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T15:54:44.265 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:44.264+0000 7f1814735800 20 rados->read ofs=0 len=0 2024-06-04T15:54:44.266 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:44.265+0000 7f1814735800 20 rados_obj.operate() r=0 bl.length=46 2024-06-04T15:54:44.266 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:44.265+0000 7f1814735800 20 rados->read ofs=0 len=0 2024-06-04T15:54:44.266 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:44.265+0000 7f1814735800 20 rados_obj.operate() r=0 bl.length=470 2024-06-04T15:54:44.267 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:44.265+0000 7f1814735800 20 zone default found 2024-06-04T15:54:44.267 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:44.265+0000 7f1814735800 4 Realm: () 2024-06-04T15:54:44.267 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:44.265+0000 7f1814735800 4 ZoneGroup: default (abb22408-c332-4e28-8f7a-ff254ea2fed2) 2024-06-04T15:54:44.267 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:44.265+0000 7f1814735800 4 Zone: default (be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767) 2024-06-04T15:54:44.267 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:44.265+0000 7f1814735800 10 cannot find current period zonegroup using local zonegroup configuration 2024-06-04T15:54:44.267 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:44.265+0000 7f1814735800 20 zonegroup default 2024-06-04T15:54:44.267 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:44.265+0000 7f1814735800 20 rados->read ofs=0 len=0 2024-06-04T15:54:44.267 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:44.265+0000 7f1814735800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T15:54:44.267 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:44.265+0000 7f1814735800 20 rados->read ofs=0 len=0 2024-06-04T15:54:44.267 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:44.266+0000 7f1814735800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T15:54:44.267 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:44.266+0000 7f1814735800 20 rados->read ofs=0 len=0 2024-06-04T15:54:44.267 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:44.266+0000 7f1814735800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T15:54:44.267 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:44.266+0000 7f1814735800 20 started sync module instance, tier type = 2024-06-04T15:54:44.267 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:44.266+0000 7f1814735800 20 started zone id=be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767 (name=default) with tier type = 2024-06-04T15:54:44.281 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:44.280+0000 7f1814735800 20 add_watcher() i=0 2024-06-04T15:54:44.281 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:44.280+0000 7f1814735800 20 add_watcher() i=1 2024-06-04T15:54:44.281 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:44.280+0000 7f1814735800 20 add_watcher() i=2 2024-06-04T15:54:44.281 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:44.280+0000 7f1814735800 20 add_watcher() i=3 2024-06-04T15:54:44.281 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:44.280+0000 7f1814735800 20 add_watcher() i=4 2024-06-04T15:54:44.281 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:44.280+0000 7f1814735800 20 add_watcher() i=5 2024-06-04T15:54:44.281 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:44.280+0000 7f1814735800 20 add_watcher() i=6 2024-06-04T15:54:44.282 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:44.282+0000 7f1814735800 20 add_watcher() i=7 2024-06-04T15:54:44.282 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:44.282+0000 7f1814735800 2 all 8 watchers are set, enabling cache 2024-06-04T15:54:44.284 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:44.284+0000 7f16c6fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-06-04T15:54:44.285 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:44.284+0000 7f1814735800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-06-04T15:54:44.285 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:44.284+0000 7f1814735800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-06-04T15:54:44.285 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:44.284+0000 7f1814735800 5 note: GC not initialized 2024-06-04T15:54:44.285 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:44.284+0000 7f16c5fdb640 20 reqs_thread_entry: start 2024-06-04T15:54:44.285 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:44.284+0000 7f1814735800 20 init_complete bucket index max shards: 11 2024-06-04T15:54:44.285 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:44.284+0000 7f1814735800 20 Filter name: none 2024-06-04T15:54:44.285 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:44.285+0000 7f16377fe640 20 reqs_thread_entry: start 2024-06-04T15:54:44.285 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:44.285+0000 7f1814735800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-06-04T15:54:44.285 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:44.285+0000 7f1814735800 20 rados->read ofs=0 len=0 2024-06-04T15:54:44.287 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:44.285+0000 7f1814735800 20 rados_obj.operate() r=0 bl.length=190 2024-06-04T15:54:44.287 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:44.285+0000 7f1814735800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-06-04T15:54:44.287 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:44.285+0000 7f1814735800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-06-04T15:54:44.287 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:44.285+0000 7f1814735800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1 : miss 2024-06-04T15:54:44.287 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:44.285+0000 7f1814735800 20 rados->read ofs=0 len=0 2024-06-04T15:54:44.287 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:44.285+0000 7f1814735800 20 rados_obj.operate() r=0 bl.length=404 2024-06-04T15:54:44.287 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:44.285+0000 7f1814735800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1 info.flags=0x17 2024-06-04T15:54:44.287 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:44.285+0000 7f1814735800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1 to cache LRU end 2024-06-04T15:54:44.287 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:44.285+0000 7f1814735800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-06-04T15:54:44.287 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:44.285+0000 7f1814735800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-06-04T15:54:44.287 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:44.285+0000 7f1814735800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1 2024-06-04T15:54:44.287 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:44.286+0000 7f1814735800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.0 2024-06-04T15:54:44.288 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:44.286+0000 7f1814735800 1 NOTICE: finished shard 0 (0 entries found) 2024-06-04T15:54:44.288 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:44.286+0000 7f1814735800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.1 2024-06-04T15:54:44.288 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:44.286+0000 7f1814735800 1 NOTICE: finished shard 1 (0 entries found) 2024-06-04T15:54:44.288 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:44.286+0000 7f1814735800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.2 2024-06-04T15:54:44.289 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:44.287+0000 7f1814735800 1 NOTICE: finished shard 2 (0 entries found) 2024-06-04T15:54:44.289 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:44.287+0000 7f1814735800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.3 2024-06-04T15:54:44.289 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:44.287+0000 7f1814735800 1 NOTICE: finished shard 3 (0 entries found) 2024-06-04T15:54:44.289 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:44.287+0000 7f1814735800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.4 2024-06-04T15:54:44.289 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:44.288+0000 7f1814735800 1 NOTICE: finished shard 4 (0 entries found) 2024-06-04T15:54:44.289 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:44.288+0000 7f1814735800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.5 2024-06-04T15:54:44.289 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:44.288+0000 7f1814735800 1 NOTICE: finished shard 5 (0 entries found) 2024-06-04T15:54:44.289 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:44.288+0000 7f1814735800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.6 2024-06-04T15:54:44.289 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:44.289+0000 7f1814735800 1 NOTICE: finished shard 6 (0 entries found) 2024-06-04T15:54:44.289 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:44.289+0000 7f1814735800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.7 2024-06-04T15:54:44.290 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:44.289+0000 7f1814735800 1 NOTICE: finished shard 7 (0 entries found) 2024-06-04T15:54:44.290 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:44.289+0000 7f1814735800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.8 2024-06-04T15:54:44.290 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:44.289+0000 7f1814735800 1 NOTICE: finished shard 8 (0 entries found) 2024-06-04T15:54:44.290 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:44.289+0000 7f1814735800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.9 2024-06-04T15:54:44.290 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:44.290+0000 7f1814735800 1 NOTICE: finished shard 9 (0 entries found) 2024-06-04T15:54:44.291 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:44.290+0000 7f1814735800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.10 2024-06-04T15:54:44.291 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:44.290+0000 7f1814735800 1 NOTICE: finished shard 10 (0 entries found) 2024-06-04T15:54:44.291 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:44.290+0000 7f1814735800 1 NOTICE: finished all shards (0 entries found) 2024-06-04T15:54:44.291 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:44.291+0000 7f16c6fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-06-04T15:54:44.293 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:44.293+0000 7f1814735800 20 remove_watcher() i=0 2024-06-04T15:54:44.293 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:44.293+0000 7f1814735800 2 removed watcher, disabling cache 2024-06-04T15:54:44.294 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:44.294+0000 7f1814735800 20 remove_watcher() i=1 2024-06-04T15:54:44.295 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:44.295+0000 7f1814735800 20 remove_watcher() i=2 2024-06-04T15:54:44.296 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:44.296+0000 7f1814735800 20 remove_watcher() i=3 2024-06-04T15:54:44.297 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:44.297+0000 7f1814735800 20 remove_watcher() i=4 2024-06-04T15:54:44.298 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:44.298+0000 7f1814735800 20 remove_watcher() i=5 2024-06-04T15:54:44.299 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:44.299+0000 7f1814735800 20 remove_watcher() i=6 2024-06-04T15:54:44.300 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:44.300+0000 7f1814735800 20 remove_watcher() i=7 2024-06-04T15:54:44.313 INFO:tasks.workunit.client.0.smithi144.stderr:TEST: verify that bucket check fixes do not affect null version objects 2024-06-04T15:54:44.314 INFO:tasks.workunit.client.0.smithi144.stderr: 2024-06-04T15:54:44.314 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T15:54:44.314 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T15:54:44.317 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T15:54:44.317 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T15:54:44.319 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T15:54:44.319 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T15:54:44.363 INFO:tasks.workunit.client.0.smithi144.stderr:TEST: bucket check stats are correct in the presence of unlinked entries 2024-06-04T15:54:44.363 INFO:tasks.workunit.client.0.smithi144.stderr: 2024-06-04T15:54:44.364 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T15:54:44.365 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T15:54:44.409 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T15:54:44.409 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T15:54:44.463 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T15:54:44.463 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T15:54:44.483 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T15:54:44.483 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T15:54:44.486 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T15:54:44.486 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T15:54:44.503 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T15:54:44.503 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T15:54:44.506 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T15:54:44.506 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T15:54:44.519 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T15:54:44.519 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T15:54:44.522 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T15:54:44.522 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T15:54:44.537 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T15:54:44.537 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T15:54:44.540 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T15:54:44.540 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T15:54:44.557 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T15:54:44.557 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T15:54:44.560 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T15:54:44.560 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T15:54:44.584 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T15:54:44.584 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T15:54:44.588 INFO:tasks.workunit.client.0.smithi144.stderr:ceph config set client rgw_debug_inject_set_olh_err 2 2024-06-04T15:54:44.987 INFO:tasks.workunit.client.0.smithi144.stderr:ceph config set client rgw_debug_inject_olh_cancel_modification_err true 2024-06-04T15:54:46.386 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T15:54:46.387 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T15:54:46.438 INFO:tasks.workunit.client.0.smithi144.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-06-04T15:54:46.440 INFO:tasks.workunit.client.0.smithi144.stderr:radosgw-admin bi list --bucket check-bucket --object c 2024-06-04T15:54:46.472 INFO:tasks.workunit.client.0.smithi144.stderr:ignoring --setuser ceph since I am not root 2024-06-04T15:54:46.472 INFO:tasks.workunit.client.0.smithi144.stderr:ignoring --setgroup ceph since I am not root 2024-06-04T15:54:46.516 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:46.514+0000 7ff6ea53f800 20 rados->read ofs=0 len=0 2024-06-04T15:54:46.518 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:46.517+0000 7ff6ea53f800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T15:54:46.519 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:46.517+0000 7ff6ea53f800 20 realm 2024-06-04T15:54:46.519 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:46.517+0000 7ff6ea53f800 20 rados->read ofs=0 len=0 2024-06-04T15:54:46.519 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:46.517+0000 7ff6ea53f800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T15:54:46.519 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:46.517+0000 7ff6ea53f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-06-04T15:54:46.519 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:46.517+0000 7ff6ea53f800 20 rados->read ofs=0 len=0 2024-06-04T15:54:46.519 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:46.517+0000 7ff6ea53f800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T15:54:46.519 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:46.517+0000 7ff6ea53f800 20 rados->read ofs=0 len=0 2024-06-04T15:54:46.520 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:46.518+0000 7ff6ea53f800 20 rados_obj.operate() r=0 bl.length=46 2024-06-04T15:54:46.520 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:46.518+0000 7ff6ea53f800 20 rados->read ofs=0 len=0 2024-06-04T15:54:46.520 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:46.518+0000 7ff6ea53f800 20 rados_obj.operate() r=0 bl.length=1139 2024-06-04T15:54:46.520 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:46.518+0000 7ff6ea53f800 20 searching for the correct realm 2024-06-04T15:54:46.522 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:46.521+0000 7ff6e6a92640 0 -- 172.21.15.144:0/427477202 >> [v2:172.21.15.144:6800/1453747520,v1:172.21.15.144:6801/1453747520] conn(0x7ff6dc04ac50 msgr2=0x7ff6dc049450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-06-04T15:54:46.728 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:46.726+0000 7ff6e6a92640 0 -- 172.21.15.144:0/427477202 >> [v2:172.21.15.144:6824/166159729,v1:172.21.15.144:6825/166159729] conn(0x55774a03a2f0 msgr2=0x55774a03c6e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-06-04T15:54:46.733 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:46.731+0000 7ff6ea53f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-06-04T15:54:46.733 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:46.731+0000 7ff6ea53f800 20 RGWRados::pool_iterate: got zone_info.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767 2024-06-04T15:54:46.733 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:46.731+0000 7ff6ea53f800 20 RGWRados::pool_iterate: got default.zone. 2024-06-04T15:54:46.733 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:46.731+0000 7ff6ea53f800 20 RGWRados::pool_iterate: got zonegroup_info.abb22408-c332-4e28-8f7a-ff254ea2fed2 2024-06-04T15:54:46.733 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:46.731+0000 7ff6ea53f800 20 RGWRados::pool_iterate: got zone_names.default 2024-06-04T15:54:46.733 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:46.731+0000 7ff6ea53f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-06-04T15:54:46.733 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:46.731+0000 7ff6ea53f800 20 rados->read ofs=0 len=0 2024-06-04T15:54:46.733 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:46.732+0000 7ff6ea53f800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T15:54:46.733 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:46.732+0000 7ff6ea53f800 20 rados->read ofs=0 len=0 2024-06-04T15:54:46.735 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:46.732+0000 7ff6ea53f800 20 rados_obj.operate() r=0 bl.length=46 2024-06-04T15:54:46.735 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:46.732+0000 7ff6ea53f800 20 rados->read ofs=0 len=0 2024-06-04T15:54:46.735 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:46.732+0000 7ff6ea53f800 20 rados_obj.operate() r=0 bl.length=470 2024-06-04T15:54:46.735 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:46.732+0000 7ff6ea53f800 20 zone default found 2024-06-04T15:54:46.735 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:46.732+0000 7ff6ea53f800 4 Realm: () 2024-06-04T15:54:46.735 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:46.732+0000 7ff6ea53f800 4 ZoneGroup: default (abb22408-c332-4e28-8f7a-ff254ea2fed2) 2024-06-04T15:54:46.735 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:46.732+0000 7ff6ea53f800 4 Zone: default (be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767) 2024-06-04T15:54:46.735 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:46.732+0000 7ff6ea53f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-06-04T15:54:46.735 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:46.732+0000 7ff6ea53f800 20 zonegroup default 2024-06-04T15:54:46.735 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:46.732+0000 7ff6ea53f800 20 rados->read ofs=0 len=0 2024-06-04T15:54:46.735 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:46.733+0000 7ff6ea53f800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T15:54:46.735 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:46.733+0000 7ff6ea53f800 20 rados->read ofs=0 len=0 2024-06-04T15:54:46.735 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:46.733+0000 7ff6ea53f800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T15:54:46.736 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:46.733+0000 7ff6ea53f800 20 rados->read ofs=0 len=0 2024-06-04T15:54:46.736 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:46.733+0000 7ff6ea53f800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T15:54:46.736 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:46.733+0000 7ff6ea53f800 20 started sync module instance, tier type = 2024-06-04T15:54:46.736 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:46.733+0000 7ff6ea53f800 20 started zone id=be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767 (name=default) with tier type = 2024-06-04T15:54:46.751 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:46.750+0000 7ff6ea53f800 20 add_watcher() i=0 2024-06-04T15:54:46.751 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:46.750+0000 7ff6ea53f800 20 add_watcher() i=1 2024-06-04T15:54:46.752 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:46.750+0000 7ff6ea53f800 20 add_watcher() i=2 2024-06-04T15:54:46.752 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:46.750+0000 7ff6ea53f800 20 add_watcher() i=3 2024-06-04T15:54:46.752 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:46.750+0000 7ff6ea53f800 20 add_watcher() i=4 2024-06-04T15:54:46.752 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:46.750+0000 7ff6ea53f800 20 add_watcher() i=5 2024-06-04T15:54:46.752 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:46.750+0000 7ff6ea53f800 20 add_watcher() i=6 2024-06-04T15:54:46.752 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:46.751+0000 7ff6ea53f800 20 add_watcher() i=7 2024-06-04T15:54:46.753 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:46.751+0000 7ff6ea53f800 2 all 8 watchers are set, enabling cache 2024-06-04T15:54:46.754 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:46.753+0000 7ff59cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-06-04T15:54:46.755 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:46.753+0000 7ff6ea53f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-06-04T15:54:46.755 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:46.753+0000 7ff6ea53f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-06-04T15:54:46.755 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:46.753+0000 7ff6ea53f800 5 note: GC not initialized 2024-06-04T15:54:46.755 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:46.753+0000 7ff5177fe640 20 reqs_thread_entry: start 2024-06-04T15:54:46.755 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:46.754+0000 7ff6ea53f800 20 init_complete bucket index max shards: 11 2024-06-04T15:54:46.755 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:46.754+0000 7ff6ea53f800 20 Filter name: none 2024-06-04T15:54:46.755 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:46.754+0000 7ff5157fa640 20 reqs_thread_entry: start 2024-06-04T15:54:46.755 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:46.754+0000 7ff6ea53f800 20 rados->read ofs=0 len=0 2024-06-04T15:54:46.757 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:46.754+0000 7ff6ea53f800 20 rados_obj.operate() r=0 bl.length=190 2024-06-04T15:54:46.757 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:46.754+0000 7ff6ea53f800 20 rados->read ofs=0 len=0 2024-06-04T15:54:46.757 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:46.755+0000 7ff6ea53f800 20 rados_obj.operate() r=0 bl.length=404 2024-06-04T15:54:46.757 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:46.755+0000 7ff6ea53f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-06-04T15:54:46.757 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:46.755+0000 7ff6ea53f800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-06-04T15:54:46.757 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:46.755+0000 7ff6ea53f800 20 INFO: main: starting shard=0 2024-06-04T15:54:46.757 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:46.755+0000 7ff6ea53f800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.0 2024-06-04T15:54:46.757 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:46.755+0000 7ff6ea53f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-06-04T15:54:46.757 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:46.755+0000 7ff6ea53f800 20 INFO: main: starting shard=1 2024-06-04T15:54:46.757 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:46.755+0000 7ff6ea53f800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.1 2024-06-04T15:54:46.757 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:46.755+0000 7ff6ea53f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-06-04T15:54:46.757 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:46.755+0000 7ff6ea53f800 20 INFO: main: starting shard=2 2024-06-04T15:54:46.758 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:46.755+0000 7ff6ea53f800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.2 2024-06-04T15:54:46.758 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:46.756+0000 7ff6ea53f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-06-04T15:54:46.758 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:46.756+0000 7ff6ea53f800 20 INFO: main: starting shard=3 2024-06-04T15:54:46.758 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:46.756+0000 7ff6ea53f800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.3 2024-06-04T15:54:46.759 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:46.757+0000 7ff6ea53f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-06-04T15:54:46.759 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:46.757+0000 7ff6ea53f800 20 INFO: main: starting shard=4 2024-06-04T15:54:46.759 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:46.757+0000 7ff6ea53f800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.4 2024-06-04T15:54:46.759 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:46.757+0000 7ff6ea53f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-06-04T15:54:46.759 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:46.757+0000 7ff6ea53f800 20 INFO: main: starting shard=5 2024-06-04T15:54:46.759 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:46.757+0000 7ff6ea53f800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.5 2024-06-04T15:54:46.760 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:46.758+0000 7ff6ea53f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-06-04T15:54:46.760 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:46.758+0000 7ff6ea53f800 20 INFO: main: starting shard=6 2024-06-04T15:54:46.760 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:46.758+0000 7ff6ea53f800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.6 2024-06-04T15:54:46.760 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:46.758+0000 7ff6ea53f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-06-04T15:54:46.760 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:46.758+0000 7ff6ea53f800 20 INFO: main: starting shard=7 2024-06-04T15:54:46.760 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:46.758+0000 7ff6ea53f800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.7 2024-06-04T15:54:46.760 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:46.758+0000 7ff6ea53f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-06-04T15:54:46.760 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:46.758+0000 7ff6ea53f800 20 INFO: main: starting shard=8 2024-06-04T15:54:46.760 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:46.758+0000 7ff6ea53f800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.8 2024-06-04T15:54:46.761 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:46.759+0000 7ff6ea53f800 20 INFO: main: bi_list() returned without error; entries.size()=5, is_truncated=0, marker= 2024-06-04T15:54:46.761 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:46.759+0000 7ff6ea53f800 20 INFO: main: starting shard=9 2024-06-04T15:54:46.761 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:46.759+0000 7ff6ea53f800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.9 2024-06-04T15:54:46.761 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:46.760+0000 7ff6ea53f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-06-04T15:54:46.761 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:46.760+0000 7ff6ea53f800 20 INFO: main: starting shard=10 2024-06-04T15:54:46.761 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:46.760+0000 7ff6ea53f800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.10 2024-06-04T15:54:46.762 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:46.760+0000 7ff6ea53f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-06-04T15:54:46.762 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:46.760+0000 7ff6ea53f800 20 INFO: main: done 2024-06-04T15:54:46.762 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:46.761+0000 7ff59cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-06-04T15:54:46.764 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:46.763+0000 7ff6ea53f800 20 remove_watcher() i=0 2024-06-04T15:54:46.764 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:46.763+0000 7ff6ea53f800 2 removed watcher, disabling cache 2024-06-04T15:54:46.765 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:46.764+0000 7ff6ea53f800 20 remove_watcher() i=1 2024-06-04T15:54:46.767 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:46.766+0000 7ff6ea53f800 20 remove_watcher() i=2 2024-06-04T15:54:46.768 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:46.767+0000 7ff6ea53f800 20 remove_watcher() i=3 2024-06-04T15:54:46.769 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:46.768+0000 7ff6ea53f800 20 remove_watcher() i=4 2024-06-04T15:54:46.770 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:46.769+0000 7ff6ea53f800 20 remove_watcher() i=5 2024-06-04T15:54:46.773 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:46.772+0000 7ff6ea53f800 20 remove_watcher() i=6 2024-06-04T15:54:46.774 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:46.773+0000 7ff6ea53f800 20 remove_watcher() i=7 2024-06-04T15:54:46.787 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T15:54:46.787 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T15:54:46.790 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T15:54:46.790 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T15:54:46.838 INFO:tasks.workunit.client.0.smithi144.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-06-04T15:54:46.840 INFO:tasks.workunit.client.0.smithi144.stderr:radosgw-admin bi list --bucket check-bucket --object d 2024-06-04T15:54:46.870 INFO:tasks.workunit.client.0.smithi144.stderr:ignoring --setuser ceph since I am not root 2024-06-04T15:54:46.870 INFO:tasks.workunit.client.0.smithi144.stderr:ignoring --setgroup ceph since I am not root 2024-06-04T15:54:46.907 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:46.906+0000 7fefee40c800 20 rados->read ofs=0 len=0 2024-06-04T15:54:46.909 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:46.908+0000 7fefee40c800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T15:54:46.909 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:46.908+0000 7fefee40c800 20 realm 2024-06-04T15:54:46.909 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:46.908+0000 7fefee40c800 20 rados->read ofs=0 len=0 2024-06-04T15:54:46.909 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:46.908+0000 7fefee40c800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T15:54:46.910 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:46.908+0000 7fefee40c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-06-04T15:54:46.910 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:46.908+0000 7fefee40c800 20 rados->read ofs=0 len=0 2024-06-04T15:54:46.910 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:46.908+0000 7fefee40c800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T15:54:46.910 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:46.908+0000 7fefee40c800 20 rados->read ofs=0 len=0 2024-06-04T15:54:46.910 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:46.909+0000 7fefee40c800 20 rados_obj.operate() r=0 bl.length=46 2024-06-04T15:54:46.910 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:46.909+0000 7fefee40c800 20 rados->read ofs=0 len=0 2024-06-04T15:54:46.911 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:46.910+0000 7fefee40c800 20 rados_obj.operate() r=0 bl.length=1139 2024-06-04T15:54:46.911 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:46.910+0000 7fefee40c800 20 searching for the correct realm 2024-06-04T15:54:46.911 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:46.910+0000 7fefebf01640 0 -- 172.21.15.144:0/724765519 >> [v2:172.21.15.177:6816/2039473917,v1:172.21.15.177:6817/2039473917] conn(0x56520a21cfb0 msgr2=0x56520a21f470 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-06-04T15:54:47.116 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.115+0000 7fefebf01640 0 -- 172.21.15.144:0/724765519 >> [v2:172.21.15.177:6800/3891611393,v1:172.21.15.177:6801/3891611393] conn(0x7fefd8003b20 msgr2=0x7fefdc04e410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-06-04T15:54:47.124 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.123+0000 7fefee40c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-06-04T15:54:47.124 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.123+0000 7fefee40c800 20 RGWRados::pool_iterate: got zone_info.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767 2024-06-04T15:54:47.124 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.123+0000 7fefee40c800 20 RGWRados::pool_iterate: got default.zone. 2024-06-04T15:54:47.124 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.123+0000 7fefee40c800 20 RGWRados::pool_iterate: got zonegroup_info.abb22408-c332-4e28-8f7a-ff254ea2fed2 2024-06-04T15:54:47.125 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.123+0000 7fefee40c800 20 RGWRados::pool_iterate: got zone_names.default 2024-06-04T15:54:47.125 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.123+0000 7fefee40c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-06-04T15:54:47.125 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.123+0000 7fefee40c800 20 rados->read ofs=0 len=0 2024-06-04T15:54:47.125 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.123+0000 7fefee40c800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T15:54:47.125 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.123+0000 7fefee40c800 20 rados->read ofs=0 len=0 2024-06-04T15:54:47.126 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.123+0000 7fefee40c800 20 rados_obj.operate() r=0 bl.length=46 2024-06-04T15:54:47.126 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.123+0000 7fefee40c800 20 rados->read ofs=0 len=0 2024-06-04T15:54:47.126 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.124+0000 7fefee40c800 20 rados_obj.operate() r=0 bl.length=470 2024-06-04T15:54:47.126 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.124+0000 7fefee40c800 20 zone default found 2024-06-04T15:54:47.126 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.124+0000 7fefee40c800 4 Realm: () 2024-06-04T15:54:47.126 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.124+0000 7fefee40c800 4 ZoneGroup: default (abb22408-c332-4e28-8f7a-ff254ea2fed2) 2024-06-04T15:54:47.127 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.124+0000 7fefee40c800 4 Zone: default (be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767) 2024-06-04T15:54:47.127 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.124+0000 7fefee40c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-06-04T15:54:47.127 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.124+0000 7fefee40c800 20 zonegroup default 2024-06-04T15:54:47.127 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.124+0000 7fefee40c800 20 rados->read ofs=0 len=0 2024-06-04T15:54:47.127 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.124+0000 7fefee40c800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T15:54:47.127 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.124+0000 7fefee40c800 20 rados->read ofs=0 len=0 2024-06-04T15:54:47.127 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.124+0000 7fefee40c800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T15:54:47.127 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.124+0000 7fefee40c800 20 rados->read ofs=0 len=0 2024-06-04T15:54:47.127 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.125+0000 7fefee40c800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T15:54:47.127 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.125+0000 7fefee40c800 20 started sync module instance, tier type = 2024-06-04T15:54:47.127 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.125+0000 7fefee40c800 20 started zone id=be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767 (name=default) with tier type = 2024-06-04T15:54:47.141 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.140+0000 7fefee40c800 20 add_watcher() i=0 2024-06-04T15:54:47.141 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.140+0000 7fefee40c800 20 add_watcher() i=1 2024-06-04T15:54:47.142 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.140+0000 7fefee40c800 20 add_watcher() i=2 2024-06-04T15:54:47.142 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.140+0000 7fefee40c800 20 add_watcher() i=3 2024-06-04T15:54:47.142 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.140+0000 7fefee40c800 20 add_watcher() i=4 2024-06-04T15:54:47.142 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.140+0000 7fefee40c800 20 add_watcher() i=5 2024-06-04T15:54:47.142 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.140+0000 7fefee40c800 20 add_watcher() i=6 2024-06-04T15:54:47.142 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.141+0000 7fefee40c800 20 add_watcher() i=7 2024-06-04T15:54:47.142 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.141+0000 7fefee40c800 2 all 8 watchers are set, enabling cache 2024-06-04T15:54:47.144 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.143+0000 7feea1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-06-04T15:54:47.146 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.144+0000 7fefee40c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-06-04T15:54:47.146 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.144+0000 7fefee40c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-06-04T15:54:47.146 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.144+0000 7fefee40c800 5 note: GC not initialized 2024-06-04T15:54:47.146 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.144+0000 7feea0fe1640 20 reqs_thread_entry: start 2024-06-04T15:54:47.146 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.144+0000 7fefee40c800 20 init_complete bucket index max shards: 11 2024-06-04T15:54:47.146 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.144+0000 7fefee40c800 20 Filter name: none 2024-06-04T15:54:47.146 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.144+0000 7fee1a7fc640 20 reqs_thread_entry: start 2024-06-04T15:54:47.146 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.144+0000 7fefee40c800 20 rados->read ofs=0 len=0 2024-06-04T15:54:47.146 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.145+0000 7fefee40c800 20 rados_obj.operate() r=0 bl.length=190 2024-06-04T15:54:47.147 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.145+0000 7fefee40c800 20 rados->read ofs=0 len=0 2024-06-04T15:54:47.148 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.145+0000 7fefee40c800 20 rados_obj.operate() r=0 bl.length=404 2024-06-04T15:54:47.148 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.145+0000 7fefee40c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-06-04T15:54:47.148 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.145+0000 7fefee40c800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-06-04T15:54:47.148 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.145+0000 7fefee40c800 20 INFO: main: starting shard=0 2024-06-04T15:54:47.148 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.145+0000 7fefee40c800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.0 2024-06-04T15:54:47.148 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.146+0000 7fefee40c800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-06-04T15:54:47.148 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.146+0000 7fefee40c800 20 INFO: main: starting shard=1 2024-06-04T15:54:47.148 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.146+0000 7fefee40c800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.1 2024-06-04T15:54:47.148 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.146+0000 7fefee40c800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-06-04T15:54:47.148 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.146+0000 7fefee40c800 20 INFO: main: starting shard=2 2024-06-04T15:54:47.148 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.146+0000 7fefee40c800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.2 2024-06-04T15:54:47.148 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.147+0000 7fefee40c800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-06-04T15:54:47.149 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.147+0000 7fefee40c800 20 INFO: main: starting shard=3 2024-06-04T15:54:47.149 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.147+0000 7fefee40c800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.3 2024-06-04T15:54:47.150 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.147+0000 7fefee40c800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-06-04T15:54:47.150 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.147+0000 7fefee40c800 20 INFO: main: starting shard=4 2024-06-04T15:54:47.150 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.147+0000 7fefee40c800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.4 2024-06-04T15:54:47.150 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.147+0000 7fefee40c800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-06-04T15:54:47.150 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.147+0000 7fefee40c800 20 INFO: main: starting shard=5 2024-06-04T15:54:47.150 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.147+0000 7fefee40c800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.5 2024-06-04T15:54:47.151 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.148+0000 7fefee40c800 20 INFO: main: bi_list() returned without error; entries.size()=5, is_truncated=0, marker= 2024-06-04T15:54:47.151 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.148+0000 7fefee40c800 20 INFO: main: starting shard=6 2024-06-04T15:54:47.151 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.148+0000 7fefee40c800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.6 2024-06-04T15:54:47.151 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.149+0000 7fefee40c800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-06-04T15:54:47.151 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.149+0000 7fefee40c800 20 INFO: main: starting shard=7 2024-06-04T15:54:47.151 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.149+0000 7fefee40c800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.7 2024-06-04T15:54:47.151 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.149+0000 7fefee40c800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-06-04T15:54:47.151 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.149+0000 7fefee40c800 20 INFO: main: starting shard=8 2024-06-04T15:54:47.152 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.149+0000 7fefee40c800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.8 2024-06-04T15:54:47.152 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.150+0000 7fefee40c800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-06-04T15:54:47.153 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.150+0000 7fefee40c800 20 INFO: main: starting shard=9 2024-06-04T15:54:47.153 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.150+0000 7fefee40c800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.9 2024-06-04T15:54:47.153 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.150+0000 7fefee40c800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-06-04T15:54:47.153 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.150+0000 7fefee40c800 20 INFO: main: starting shard=10 2024-06-04T15:54:47.153 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.150+0000 7fefee40c800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.10 2024-06-04T15:54:47.153 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.151+0000 7fefee40c800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-06-04T15:54:47.153 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.151+0000 7fefee40c800 20 INFO: main: done 2024-06-04T15:54:47.153 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.152+0000 7feea1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-06-04T15:54:47.155 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.154+0000 7fefee40c800 20 remove_watcher() i=0 2024-06-04T15:54:47.155 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.154+0000 7fefee40c800 2 removed watcher, disabling cache 2024-06-04T15:54:47.156 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.155+0000 7fefee40c800 20 remove_watcher() i=1 2024-06-04T15:54:47.157 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.156+0000 7fefee40c800 20 remove_watcher() i=2 2024-06-04T15:54:47.159 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.158+0000 7fefee40c800 20 remove_watcher() i=3 2024-06-04T15:54:47.160 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.159+0000 7fefee40c800 20 remove_watcher() i=4 2024-06-04T15:54:47.161 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.160+0000 7fefee40c800 20 remove_watcher() i=5 2024-06-04T15:54:47.162 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.161+0000 7fefee40c800 20 remove_watcher() i=6 2024-06-04T15:54:47.163 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.162+0000 7fefee40c800 20 remove_watcher() i=7 2024-06-04T15:54:47.176 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T15:54:47.176 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T15:54:47.179 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T15:54:47.179 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T15:54:47.182 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T15:54:47.182 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T15:54:47.230 INFO:tasks.workunit.client.0.smithi144.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-06-04T15:54:47.232 INFO:tasks.workunit.client.0.smithi144.stderr:radosgw-admin bi list --bucket check-bucket --object e 2024-06-04T15:54:47.264 INFO:tasks.workunit.client.0.smithi144.stderr:ignoring --setuser ceph since I am not root 2024-06-04T15:54:47.264 INFO:tasks.workunit.client.0.smithi144.stderr:ignoring --setgroup ceph since I am not root 2024-06-04T15:54:47.300 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.299+0000 7f3675d2a800 20 rados->read ofs=0 len=0 2024-06-04T15:54:47.302 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.301+0000 7f3675d2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T15:54:47.302 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.301+0000 7f3675d2a800 20 realm 2024-06-04T15:54:47.303 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.301+0000 7f3675d2a800 20 rados->read ofs=0 len=0 2024-06-04T15:54:47.303 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.301+0000 7f3675d2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T15:54:47.303 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.301+0000 7f3675d2a800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-06-04T15:54:47.303 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.301+0000 7f3675d2a800 20 rados->read ofs=0 len=0 2024-06-04T15:54:47.303 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.301+0000 7f3675d2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T15:54:47.303 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.301+0000 7f3675d2a800 20 rados->read ofs=0 len=0 2024-06-04T15:54:47.304 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.302+0000 7f3675d2a800 20 rados_obj.operate() r=0 bl.length=46 2024-06-04T15:54:47.304 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.302+0000 7f3675d2a800 20 rados->read ofs=0 len=0 2024-06-04T15:54:47.304 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.302+0000 7f3675d2a800 20 rados_obj.operate() r=0 bl.length=1139 2024-06-04T15:54:47.304 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.302+0000 7f3675d2a800 20 searching for the correct realm 2024-06-04T15:54:47.306 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.304+0000 7f3671259640 0 -- 172.21.15.144:0/2518732836 >> [v2:172.21.15.144:6816/2358575268,v1:172.21.15.144:6817/2358575268] conn(0x5558d52b5090 msgr2=0x5558d52b7480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-06-04T15:54:47.309 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.308+0000 7f3671259640 0 -- 172.21.15.144:0/2518732836 >> [v2:172.21.15.177:6808/2618477608,v1:172.21.15.177:6809/2618477608] conn(0x7f365c081bf0 msgr2=0x7f365c0ce6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-06-04T15:54:47.516 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.515+0000 7f3675d2a800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-06-04T15:54:47.516 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.515+0000 7f3675d2a800 20 RGWRados::pool_iterate: got zone_info.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767 2024-06-04T15:54:47.517 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.515+0000 7f3675d2a800 20 RGWRados::pool_iterate: got default.zone. 2024-06-04T15:54:47.517 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.515+0000 7f3675d2a800 20 RGWRados::pool_iterate: got zonegroup_info.abb22408-c332-4e28-8f7a-ff254ea2fed2 2024-06-04T15:54:47.517 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.515+0000 7f3675d2a800 20 RGWRados::pool_iterate: got zone_names.default 2024-06-04T15:54:47.517 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.515+0000 7f3675d2a800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-06-04T15:54:47.517 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.515+0000 7f3675d2a800 20 rados->read ofs=0 len=0 2024-06-04T15:54:47.517 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.515+0000 7f3675d2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T15:54:47.517 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.515+0000 7f3675d2a800 20 rados->read ofs=0 len=0 2024-06-04T15:54:47.517 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.515+0000 7f3675d2a800 20 rados_obj.operate() r=0 bl.length=46 2024-06-04T15:54:47.517 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.515+0000 7f3675d2a800 20 rados->read ofs=0 len=0 2024-06-04T15:54:47.518 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.516+0000 7f3675d2a800 20 rados_obj.operate() r=0 bl.length=470 2024-06-04T15:54:47.518 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.516+0000 7f3675d2a800 20 zone default found 2024-06-04T15:54:47.518 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.516+0000 7f3675d2a800 4 Realm: () 2024-06-04T15:54:47.519 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.516+0000 7f3675d2a800 4 ZoneGroup: default (abb22408-c332-4e28-8f7a-ff254ea2fed2) 2024-06-04T15:54:47.519 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.516+0000 7f3675d2a800 4 Zone: default (be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767) 2024-06-04T15:54:47.519 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.516+0000 7f3675d2a800 10 cannot find current period zonegroup using local zonegroup configuration 2024-06-04T15:54:47.519 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.516+0000 7f3675d2a800 20 zonegroup default 2024-06-04T15:54:47.519 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.516+0000 7f3675d2a800 20 rados->read ofs=0 len=0 2024-06-04T15:54:47.519 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.516+0000 7f3675d2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T15:54:47.519 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.516+0000 7f3675d2a800 20 rados->read ofs=0 len=0 2024-06-04T15:54:47.519 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.517+0000 7f3675d2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T15:54:47.519 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.517+0000 7f3675d2a800 20 rados->read ofs=0 len=0 2024-06-04T15:54:47.519 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.517+0000 7f3675d2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T15:54:47.519 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.517+0000 7f3675d2a800 20 started sync module instance, tier type = 2024-06-04T15:54:47.519 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.517+0000 7f3675d2a800 20 started zone id=be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767 (name=default) with tier type = 2024-06-04T15:54:47.533 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.531+0000 7f3675d2a800 20 add_watcher() i=0 2024-06-04T15:54:47.533 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.531+0000 7f3675d2a800 20 add_watcher() i=1 2024-06-04T15:54:47.533 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.531+0000 7f3675d2a800 20 add_watcher() i=2 2024-06-04T15:54:47.533 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.531+0000 7f3675d2a800 20 add_watcher() i=3 2024-06-04T15:54:47.533 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.531+0000 7f3675d2a800 20 add_watcher() i=4 2024-06-04T15:54:47.533 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.531+0000 7f3675d2a800 20 add_watcher() i=5 2024-06-04T15:54:47.533 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.531+0000 7f3675d2a800 20 add_watcher() i=6 2024-06-04T15:54:47.533 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.532+0000 7f3675d2a800 20 add_watcher() i=7 2024-06-04T15:54:47.534 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.532+0000 7f3675d2a800 2 all 8 watchers are set, enabling cache 2024-06-04T15:54:47.535 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.534+0000 7f35237fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-06-04T15:54:47.536 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.535+0000 7f3675d2a800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-06-04T15:54:47.536 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.535+0000 7f3675d2a800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-06-04T15:54:47.536 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.535+0000 7f3675d2a800 5 note: GC not initialized 2024-06-04T15:54:47.537 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.535+0000 7f35227fc640 20 reqs_thread_entry: start 2024-06-04T15:54:47.537 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.535+0000 7f3675d2a800 20 init_complete bucket index max shards: 11 2024-06-04T15:54:47.537 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.535+0000 7f3675d2a800 20 Filter name: none 2024-06-04T15:54:47.537 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.535+0000 7f3493fff640 20 reqs_thread_entry: start 2024-06-04T15:54:47.537 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.535+0000 7f3675d2a800 20 rados->read ofs=0 len=0 2024-06-04T15:54:47.538 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.536+0000 7f3675d2a800 20 rados_obj.operate() r=0 bl.length=190 2024-06-04T15:54:47.538 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.536+0000 7f3675d2a800 20 rados->read ofs=0 len=0 2024-06-04T15:54:47.538 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.536+0000 7f3675d2a800 20 rados_obj.operate() r=0 bl.length=404 2024-06-04T15:54:47.538 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.536+0000 7f3675d2a800 20 couldn't put binfo cache entry, might have raced with data changes 2024-06-04T15:54:47.538 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.536+0000 7f3675d2a800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-06-04T15:54:47.538 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.536+0000 7f3675d2a800 20 INFO: main: starting shard=0 2024-06-04T15:54:47.538 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.536+0000 7f3675d2a800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.0 2024-06-04T15:54:47.538 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.536+0000 7f3675d2a800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-06-04T15:54:47.539 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.536+0000 7f3675d2a800 20 INFO: main: starting shard=1 2024-06-04T15:54:47.539 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.536+0000 7f3675d2a800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.1 2024-06-04T15:54:47.539 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.537+0000 7f3675d2a800 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-06-04T15:54:47.539 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.537+0000 7f3675d2a800 20 INFO: main: starting shard=2 2024-06-04T15:54:47.539 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.537+0000 7f3675d2a800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.2 2024-06-04T15:54:47.539 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.537+0000 7f3675d2a800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-06-04T15:54:47.539 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.537+0000 7f3675d2a800 20 INFO: main: starting shard=3 2024-06-04T15:54:47.540 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.537+0000 7f3675d2a800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.3 2024-06-04T15:54:47.540 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.538+0000 7f3675d2a800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-06-04T15:54:47.540 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.538+0000 7f3675d2a800 20 INFO: main: starting shard=4 2024-06-04T15:54:47.540 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.538+0000 7f3675d2a800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.4 2024-06-04T15:54:47.540 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.538+0000 7f3675d2a800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-06-04T15:54:47.540 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.538+0000 7f3675d2a800 20 INFO: main: starting shard=5 2024-06-04T15:54:47.540 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.538+0000 7f3675d2a800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.5 2024-06-04T15:54:47.540 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.539+0000 7f3675d2a800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-06-04T15:54:47.541 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.539+0000 7f3675d2a800 20 INFO: main: starting shard=6 2024-06-04T15:54:47.541 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.539+0000 7f3675d2a800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.6 2024-06-04T15:54:47.541 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.539+0000 7f3675d2a800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-06-04T15:54:47.541 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.539+0000 7f3675d2a800 20 INFO: main: starting shard=7 2024-06-04T15:54:47.541 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.539+0000 7f3675d2a800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.7 2024-06-04T15:54:47.542 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.540+0000 7f3675d2a800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-06-04T15:54:47.542 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.540+0000 7f3675d2a800 20 INFO: main: starting shard=8 2024-06-04T15:54:47.542 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.540+0000 7f3675d2a800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.8 2024-06-04T15:54:47.542 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.541+0000 7f3675d2a800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-06-04T15:54:47.542 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.541+0000 7f3675d2a800 20 INFO: main: starting shard=9 2024-06-04T15:54:47.542 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.541+0000 7f3675d2a800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.9 2024-06-04T15:54:47.542 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.541+0000 7f3675d2a800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-06-04T15:54:47.543 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.541+0000 7f3675d2a800 20 INFO: main: starting shard=10 2024-06-04T15:54:47.543 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.541+0000 7f3675d2a800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.10 2024-06-04T15:54:47.543 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.542+0000 7f3675d2a800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-06-04T15:54:47.543 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.542+0000 7f3675d2a800 20 INFO: main: done 2024-06-04T15:54:47.544 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.543+0000 7f35237fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-06-04T15:54:47.546 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.545+0000 7f3675d2a800 20 remove_watcher() i=0 2024-06-04T15:54:47.546 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.545+0000 7f3675d2a800 2 removed watcher, disabling cache 2024-06-04T15:54:47.547 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.546+0000 7f3675d2a800 20 remove_watcher() i=1 2024-06-04T15:54:47.548 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.547+0000 7f3675d2a800 20 remove_watcher() i=2 2024-06-04T15:54:47.549 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.548+0000 7f3675d2a800 20 remove_watcher() i=3 2024-06-04T15:54:47.551 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.549+0000 7f3675d2a800 20 remove_watcher() i=4 2024-06-04T15:54:47.552 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.550+0000 7f3675d2a800 20 remove_watcher() i=5 2024-06-04T15:54:47.552 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.551+0000 7f3675d2a800 20 remove_watcher() i=6 2024-06-04T15:54:47.554 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.552+0000 7f3675d2a800 20 remove_watcher() i=7 2024-06-04T15:54:47.566 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T15:54:47.567 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T15:54:47.569 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T15:54:47.570 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T15:54:47.617 INFO:tasks.workunit.client.0.smithi144.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-06-04T15:54:47.619 INFO:tasks.workunit.client.0.smithi144.stderr:radosgw-admin bi list --bucket check-bucket --object f 2024-06-04T15:54:47.650 INFO:tasks.workunit.client.0.smithi144.stderr:ignoring --setuser ceph since I am not root 2024-06-04T15:54:47.650 INFO:tasks.workunit.client.0.smithi144.stderr:ignoring --setgroup ceph since I am not root 2024-06-04T15:54:47.686 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.685+0000 7f4770698800 20 rados->read ofs=0 len=0 2024-06-04T15:54:47.689 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.687+0000 7f4770698800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T15:54:47.690 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.687+0000 7f4770698800 20 realm 2024-06-04T15:54:47.690 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.687+0000 7f4770698800 20 rados->read ofs=0 len=0 2024-06-04T15:54:47.690 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.687+0000 7f4770698800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T15:54:47.690 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.687+0000 7f4770698800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-06-04T15:54:47.690 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.687+0000 7f4770698800 20 rados->read ofs=0 len=0 2024-06-04T15:54:47.690 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.687+0000 7f4770698800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T15:54:47.691 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.687+0000 7f4770698800 20 rados->read ofs=0 len=0 2024-06-04T15:54:47.691 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.688+0000 7f4770698800 20 rados_obj.operate() r=0 bl.length=46 2024-06-04T15:54:47.691 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.688+0000 7f4770698800 20 rados->read ofs=0 len=0 2024-06-04T15:54:47.692 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.689+0000 7f4770698800 20 rados_obj.operate() r=0 bl.length=1139 2024-06-04T15:54:47.692 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.689+0000 7f4770698800 20 searching for the correct realm 2024-06-04T15:54:47.692 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.691+0000 7f476e995640 0 -- 172.21.15.144:0/438427152 >> [v2:172.21.15.144:6800/1453747520,v1:172.21.15.144:6801/1453747520] conn(0x7f475801a040 msgr2=0x7f475809c710 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-06-04T15:54:47.897 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.896+0000 7f476e995640 0 -- 172.21.15.144:0/438427152 >> [v2:172.21.15.144:6824/166159729,v1:172.21.15.144:6825/166159729] conn(0x556251bb3540 msgr2=0x556251bb5930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-06-04T15:54:47.905 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.902+0000 7f4770698800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-06-04T15:54:47.905 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.902+0000 7f4770698800 20 RGWRados::pool_iterate: got zone_info.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767 2024-06-04T15:54:47.905 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.902+0000 7f4770698800 20 RGWRados::pool_iterate: got default.zone. 2024-06-04T15:54:47.905 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.902+0000 7f4770698800 20 RGWRados::pool_iterate: got zonegroup_info.abb22408-c332-4e28-8f7a-ff254ea2fed2 2024-06-04T15:54:47.905 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.902+0000 7f4770698800 20 RGWRados::pool_iterate: got zone_names.default 2024-06-04T15:54:47.905 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.902+0000 7f4770698800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-06-04T15:54:47.905 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.902+0000 7f4770698800 20 rados->read ofs=0 len=0 2024-06-04T15:54:47.905 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.902+0000 7f4770698800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T15:54:47.905 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.902+0000 7f4770698800 20 rados->read ofs=0 len=0 2024-06-04T15:54:47.905 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.902+0000 7f4770698800 20 rados_obj.operate() r=0 bl.length=46 2024-06-04T15:54:47.906 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.902+0000 7f4770698800 20 rados->read ofs=0 len=0 2024-06-04T15:54:47.906 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.903+0000 7f4770698800 20 rados_obj.operate() r=0 bl.length=470 2024-06-04T15:54:47.906 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.903+0000 7f4770698800 20 zone default found 2024-06-04T15:54:47.906 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.903+0000 7f4770698800 4 Realm: () 2024-06-04T15:54:47.906 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.903+0000 7f4770698800 4 ZoneGroup: default (abb22408-c332-4e28-8f7a-ff254ea2fed2) 2024-06-04T15:54:47.906 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.903+0000 7f4770698800 4 Zone: default (be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767) 2024-06-04T15:54:47.906 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.903+0000 7f4770698800 10 cannot find current period zonegroup using local zonegroup configuration 2024-06-04T15:54:47.906 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.903+0000 7f4770698800 20 zonegroup default 2024-06-04T15:54:47.906 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.903+0000 7f4770698800 20 rados->read ofs=0 len=0 2024-06-04T15:54:47.906 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.903+0000 7f4770698800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T15:54:47.906 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.903+0000 7f4770698800 20 rados->read ofs=0 len=0 2024-06-04T15:54:47.906 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.903+0000 7f4770698800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T15:54:47.906 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.903+0000 7f4770698800 20 rados->read ofs=0 len=0 2024-06-04T15:54:47.907 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.904+0000 7f4770698800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T15:54:47.907 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.904+0000 7f4770698800 20 started sync module instance, tier type = 2024-06-04T15:54:47.907 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.904+0000 7f4770698800 20 started zone id=be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767 (name=default) with tier type = 2024-06-04T15:54:47.920 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.919+0000 7f4770698800 20 add_watcher() i=0 2024-06-04T15:54:47.921 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.919+0000 7f4770698800 20 add_watcher() i=1 2024-06-04T15:54:47.921 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.919+0000 7f4770698800 20 add_watcher() i=2 2024-06-04T15:54:47.921 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.919+0000 7f4770698800 20 add_watcher() i=3 2024-06-04T15:54:47.921 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.919+0000 7f4770698800 20 add_watcher() i=4 2024-06-04T15:54:47.921 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.919+0000 7f4770698800 20 add_watcher() i=5 2024-06-04T15:54:47.921 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.919+0000 7f4770698800 20 add_watcher() i=6 2024-06-04T15:54:47.922 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.921+0000 7f4770698800 20 add_watcher() i=7 2024-06-04T15:54:47.922 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.921+0000 7f4770698800 2 all 8 watchers are set, enabling cache 2024-06-04T15:54:47.924 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.923+0000 7f4624fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-06-04T15:54:47.925 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.923+0000 7f4770698800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-06-04T15:54:47.925 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.923+0000 7f4770698800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-06-04T15:54:47.926 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.923+0000 7f4770698800 5 note: GC not initialized 2024-06-04T15:54:47.926 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.923+0000 7f459f7fe640 20 reqs_thread_entry: start 2024-06-04T15:54:47.926 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.924+0000 7f4770698800 20 init_complete bucket index max shards: 11 2024-06-04T15:54:47.926 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.924+0000 7f4770698800 20 Filter name: none 2024-06-04T15:54:47.926 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.924+0000 7f459d7fa640 20 reqs_thread_entry: start 2024-06-04T15:54:47.926 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.924+0000 7f4770698800 20 rados->read ofs=0 len=0 2024-06-04T15:54:47.926 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.924+0000 7f4770698800 20 rados_obj.operate() r=0 bl.length=190 2024-06-04T15:54:47.926 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.924+0000 7f4770698800 20 rados->read ofs=0 len=0 2024-06-04T15:54:47.928 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.925+0000 7f4770698800 20 rados_obj.operate() r=0 bl.length=404 2024-06-04T15:54:47.928 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.925+0000 7f4770698800 20 couldn't put binfo cache entry, might have raced with data changes 2024-06-04T15:54:47.928 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.925+0000 7f4770698800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-06-04T15:54:47.928 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.925+0000 7f4770698800 20 INFO: main: starting shard=0 2024-06-04T15:54:47.928 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.925+0000 7f4770698800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.0 2024-06-04T15:54:47.928 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.925+0000 7f4770698800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-06-04T15:54:47.929 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.925+0000 7f4770698800 20 INFO: main: starting shard=1 2024-06-04T15:54:47.929 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.925+0000 7f4770698800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.1 2024-06-04T15:54:47.929 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.926+0000 7f4770698800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-06-04T15:54:47.929 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.926+0000 7f4770698800 20 INFO: main: starting shard=2 2024-06-04T15:54:47.929 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.926+0000 7f4770698800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.2 2024-06-04T15:54:47.929 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.926+0000 7f4770698800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-06-04T15:54:47.929 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.926+0000 7f4770698800 20 INFO: main: starting shard=3 2024-06-04T15:54:47.929 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.926+0000 7f4770698800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.3 2024-06-04T15:54:47.929 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.927+0000 7f4770698800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-06-04T15:54:47.929 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.927+0000 7f4770698800 20 INFO: main: starting shard=4 2024-06-04T15:54:47.929 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.927+0000 7f4770698800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.4 2024-06-04T15:54:47.931 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.927+0000 7f4770698800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-06-04T15:54:47.931 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.927+0000 7f4770698800 20 INFO: main: starting shard=5 2024-06-04T15:54:47.931 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.927+0000 7f4770698800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.5 2024-06-04T15:54:47.931 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.928+0000 7f4770698800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-06-04T15:54:47.931 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.928+0000 7f4770698800 20 INFO: main: starting shard=6 2024-06-04T15:54:47.932 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.928+0000 7f4770698800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.6 2024-06-04T15:54:47.932 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.928+0000 7f4770698800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-06-04T15:54:47.932 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.928+0000 7f4770698800 20 INFO: main: starting shard=7 2024-06-04T15:54:47.932 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.928+0000 7f4770698800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.7 2024-06-04T15:54:47.932 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.929+0000 7f4770698800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-06-04T15:54:47.932 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.929+0000 7f4770698800 20 INFO: main: starting shard=8 2024-06-04T15:54:47.932 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.929+0000 7f4770698800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.8 2024-06-04T15:54:47.932 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.929+0000 7f4770698800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-06-04T15:54:47.932 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.929+0000 7f4770698800 20 INFO: main: starting shard=9 2024-06-04T15:54:47.932 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.929+0000 7f4770698800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.9 2024-06-04T15:54:47.933 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.930+0000 7f4770698800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-06-04T15:54:47.933 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.930+0000 7f4770698800 20 INFO: main: starting shard=10 2024-06-04T15:54:47.933 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.930+0000 7f4770698800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.10 2024-06-04T15:54:47.933 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.930+0000 7f4770698800 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-06-04T15:54:47.933 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.931+0000 7f4770698800 20 INFO: main: done 2024-06-04T15:54:47.933 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.931+0000 7f4624fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-06-04T15:54:47.935 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.934+0000 7f4770698800 20 remove_watcher() i=0 2024-06-04T15:54:47.935 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.934+0000 7f4770698800 2 removed watcher, disabling cache 2024-06-04T15:54:47.936 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.935+0000 7f4770698800 20 remove_watcher() i=1 2024-06-04T15:54:47.937 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.936+0000 7f4770698800 20 remove_watcher() i=2 2024-06-04T15:54:47.938 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.937+0000 7f4770698800 20 remove_watcher() i=3 2024-06-04T15:54:47.939 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.938+0000 7f4770698800 20 remove_watcher() i=4 2024-06-04T15:54:47.940 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.939+0000 7f4770698800 20 remove_watcher() i=5 2024-06-04T15:54:47.941 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.940+0000 7f4770698800 20 remove_watcher() i=6 2024-06-04T15:54:47.944 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:47.943+0000 7f4770698800 20 remove_watcher() i=7 2024-06-04T15:54:47.957 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T15:54:47.957 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T15:54:47.960 INFO:tasks.workunit.client.0.smithi144.stderr:ceph config rm client rgw_debug_inject_set_olh_err 2024-06-04T15:54:48.361 INFO:tasks.workunit.client.0.smithi144.stderr:ceph config rm client rgw_debug_inject_olh_cancel_modification_err 2024-06-04T15:54:48.756 INFO:tasks.workunit.client.0.smithi144.stderr:radosgw-admin bucket check --fix --bucket check-bucket 2024-06-04T15:54:48.785 INFO:tasks.workunit.client.0.smithi144.stderr:ignoring --setuser ceph since I am not root 2024-06-04T15:54:48.785 INFO:tasks.workunit.client.0.smithi144.stderr:ignoring --setgroup ceph since I am not root 2024-06-04T15:54:48.822 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:48.821+0000 7fa8e552e800 20 rados->read ofs=0 len=0 2024-06-04T15:54:48.826 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:48.823+0000 7fa8e552e800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T15:54:48.826 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:48.823+0000 7fa8e552e800 20 realm 2024-06-04T15:54:48.826 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:48.823+0000 7fa8e552e800 20 rados->read ofs=0 len=0 2024-06-04T15:54:48.827 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:48.823+0000 7fa8e552e800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T15:54:48.827 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:48.823+0000 7fa8e552e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-06-04T15:54:48.827 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:48.823+0000 7fa8e552e800 20 rados->read ofs=0 len=0 2024-06-04T15:54:48.827 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:48.823+0000 7fa8e552e800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T15:54:48.827 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:48.823+0000 7fa8e552e800 20 rados->read ofs=0 len=0 2024-06-04T15:54:48.827 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:48.824+0000 7fa8e552e800 20 rados_obj.operate() r=0 bl.length=46 2024-06-04T15:54:48.827 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:48.824+0000 7fa8e552e800 20 rados->read ofs=0 len=0 2024-06-04T15:54:48.827 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:48.824+0000 7fa8e552e800 20 rados_obj.operate() r=0 bl.length=1139 2024-06-04T15:54:48.827 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:48.825+0000 7fa8e552e800 20 searching for the correct realm 2024-06-04T15:54:48.828 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:48.826+0000 7fa8e0a63640 0 -- 172.21.15.144:0/421263469 >> [v2:172.21.15.144:6816/2358575268,v1:172.21.15.144:6817/2358575268] conn(0x55aa01a66190 msgr2=0x55aa01a685e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-06-04T15:54:48.831 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:48.830+0000 7fa8e0a63640 0 -- 172.21.15.144:0/421263469 >> [v2:172.21.15.177:6808/2618477608,v1:172.21.15.177:6809/2618477608] conn(0x7fa8d8077980 msgr2=0x7fa8d8064b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-06-04T15:54:49.041 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.037+0000 7fa8e552e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-06-04T15:54:49.041 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.037+0000 7fa8e552e800 20 RGWRados::pool_iterate: got zone_info.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767 2024-06-04T15:54:49.041 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.037+0000 7fa8e552e800 20 RGWRados::pool_iterate: got default.zone. 2024-06-04T15:54:49.041 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.037+0000 7fa8e552e800 20 RGWRados::pool_iterate: got zonegroup_info.abb22408-c332-4e28-8f7a-ff254ea2fed2 2024-06-04T15:54:49.041 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.037+0000 7fa8e552e800 20 RGWRados::pool_iterate: got zone_names.default 2024-06-04T15:54:49.041 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.037+0000 7fa8e552e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-06-04T15:54:49.042 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.037+0000 7fa8e552e800 20 rados->read ofs=0 len=0 2024-06-04T15:54:49.042 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.037+0000 7fa8e552e800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T15:54:49.042 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.037+0000 7fa8e552e800 20 rados->read ofs=0 len=0 2024-06-04T15:54:49.042 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.038+0000 7fa8e552e800 20 rados_obj.operate() r=0 bl.length=46 2024-06-04T15:54:49.042 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.038+0000 7fa8e552e800 20 rados->read ofs=0 len=0 2024-06-04T15:54:49.043 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.038+0000 7fa8e552e800 20 rados_obj.operate() r=0 bl.length=470 2024-06-04T15:54:49.043 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.038+0000 7fa8e552e800 20 zone default found 2024-06-04T15:54:49.043 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.038+0000 7fa8e552e800 4 Realm: () 2024-06-04T15:54:49.043 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.038+0000 7fa8e552e800 4 ZoneGroup: default (abb22408-c332-4e28-8f7a-ff254ea2fed2) 2024-06-04T15:54:49.043 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.038+0000 7fa8e552e800 4 Zone: default (be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767) 2024-06-04T15:54:49.043 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.038+0000 7fa8e552e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-06-04T15:54:49.044 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.038+0000 7fa8e552e800 20 zonegroup default 2024-06-04T15:54:49.044 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.038+0000 7fa8e552e800 20 rados->read ofs=0 len=0 2024-06-04T15:54:49.044 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.038+0000 7fa8e552e800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T15:54:49.044 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.039+0000 7fa8e552e800 20 rados->read ofs=0 len=0 2024-06-04T15:54:49.044 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.039+0000 7fa8e552e800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T15:54:49.044 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.039+0000 7fa8e552e800 20 rados->read ofs=0 len=0 2024-06-04T15:54:49.045 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.039+0000 7fa8e552e800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T15:54:49.045 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.039+0000 7fa8e552e800 20 started sync module instance, tier type = 2024-06-04T15:54:49.045 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.039+0000 7fa8e552e800 20 started zone id=be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767 (name=default) with tier type = 2024-06-04T15:54:49.053 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.052+0000 7fa8e552e800 20 add_watcher() i=0 2024-06-04T15:54:49.053 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.052+0000 7fa8e552e800 20 add_watcher() i=1 2024-06-04T15:54:49.053 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.052+0000 7fa8e552e800 20 add_watcher() i=2 2024-06-04T15:54:49.053 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.052+0000 7fa8e552e800 20 add_watcher() i=3 2024-06-04T15:54:49.053 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.052+0000 7fa8e552e800 20 add_watcher() i=4 2024-06-04T15:54:49.053 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.052+0000 7fa8e552e800 20 add_watcher() i=5 2024-06-04T15:54:49.054 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.052+0000 7fa8e552e800 20 add_watcher() i=6 2024-06-04T15:54:49.054 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.053+0000 7fa8e552e800 20 add_watcher() i=7 2024-06-04T15:54:49.054 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.053+0000 7fa8e552e800 2 all 8 watchers are set, enabling cache 2024-06-04T15:54:49.057 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.055+0000 7fa7977e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-06-04T15:54:49.058 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.056+0000 7fa8e552e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-06-04T15:54:49.058 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.056+0000 7fa8e552e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-06-04T15:54:49.058 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.056+0000 7fa8e552e800 5 note: GC not initialized 2024-06-04T15:54:49.058 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.056+0000 7fa7967e4640 20 reqs_thread_entry: start 2024-06-04T15:54:49.058 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.056+0000 7fa8e552e800 20 init_complete bucket index max shards: 11 2024-06-04T15:54:49.058 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.056+0000 7fa8e552e800 20 Filter name: none 2024-06-04T15:54:49.058 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.056+0000 7fa707fff640 20 reqs_thread_entry: start 2024-06-04T15:54:49.058 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.056+0000 7fa8e552e800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-06-04T15:54:49.058 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.056+0000 7fa8e552e800 20 rados->read ofs=0 len=0 2024-06-04T15:54:49.059 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.057+0000 7fa8e552e800 20 rados_obj.operate() r=0 bl.length=190 2024-06-04T15:54:49.059 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.057+0000 7fa8e552e800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-06-04T15:54:49.059 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.057+0000 7fa8e552e800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-06-04T15:54:49.059 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.057+0000 7fa8e552e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1 : miss 2024-06-04T15:54:49.059 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.057+0000 7fa8e552e800 20 rados->read ofs=0 len=0 2024-06-04T15:54:49.059 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.057+0000 7fa8e552e800 20 rados_obj.operate() r=0 bl.length=404 2024-06-04T15:54:49.060 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.057+0000 7fa8e552e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1 info.flags=0x17 2024-06-04T15:54:49.060 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.057+0000 7fa8e552e800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1 to cache LRU end 2024-06-04T15:54:49.060 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.057+0000 7fa8e552e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-06-04T15:54:49.060 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.057+0000 7fa8e552e800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-06-04T15:54:49.060 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.057+0000 7fa8e552e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1 2024-06-04T15:54:49.060 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.057+0000 7fa8e552e800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.0 2024-06-04T15:54:49.060 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.058+0000 7fa8e552e800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.1 2024-06-04T15:54:49.061 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.058+0000 7fa8e552e800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.2 2024-06-04T15:54:49.061 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.059+0000 7fa8e552e800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.3 2024-06-04T15:54:49.061 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.060+0000 7fa8e552e800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.4 2024-06-04T15:54:49.061 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.060+0000 7fa8e552e800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.5 2024-06-04T15:54:49.062 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.061+0000 7fa8e552e800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.6 2024-06-04T15:54:49.062 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.061+0000 7fa8e552e800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.7 2024-06-04T15:54:49.062 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.061+0000 7fa8e552e800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.8 2024-06-04T15:54:49.063 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.062+0000 7fa8e552e800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.9 2024-06-04T15:54:49.064 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.063+0000 7fa8e552e800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.10 2024-06-04T15:54:49.073 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.072+0000 7fa7977e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-06-04T15:54:49.075 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.074+0000 7fa8e552e800 20 remove_watcher() i=0 2024-06-04T15:54:49.076 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.074+0000 7fa8e552e800 2 removed watcher, disabling cache 2024-06-04T15:54:49.076 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.075+0000 7fa8e552e800 20 remove_watcher() i=1 2024-06-04T15:54:49.077 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.076+0000 7fa8e552e800 20 remove_watcher() i=2 2024-06-04T15:54:49.078 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.077+0000 7fa8e552e800 20 remove_watcher() i=3 2024-06-04T15:54:49.079 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.078+0000 7fa8e552e800 20 remove_watcher() i=4 2024-06-04T15:54:49.080 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.079+0000 7fa8e552e800 20 remove_watcher() i=5 2024-06-04T15:54:49.082 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.081+0000 7fa8e552e800 20 remove_watcher() i=6 2024-06-04T15:54:49.083 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.082+0000 7fa8e552e800 20 remove_watcher() i=7 2024-06-04T15:54:49.095 INFO:tasks.workunit.client.0.smithi144.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --fix --min-age-hours 0 --rgw-olh-pending-timeout-sec 0 --dump-keys 2024-06-04T15:54:49.129 INFO:tasks.workunit.client.0.smithi144.stderr:ignoring --setuser ceph since I am not root 2024-06-04T15:54:49.129 INFO:tasks.workunit.client.0.smithi144.stderr:ignoring --setgroup ceph since I am not root 2024-06-04T15:54:49.165 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.164+0000 7f0d59c0f800 20 rados->read ofs=0 len=0 2024-06-04T15:54:49.167 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.166+0000 7f0d59c0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T15:54:49.167 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.166+0000 7f0d59c0f800 20 realm 2024-06-04T15:54:49.167 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.166+0000 7f0d59c0f800 20 rados->read ofs=0 len=0 2024-06-04T15:54:49.167 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.166+0000 7f0d59c0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T15:54:49.167 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.166+0000 7f0d59c0f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-06-04T15:54:49.167 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.166+0000 7f0d59c0f800 20 rados->read ofs=0 len=0 2024-06-04T15:54:49.167 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.166+0000 7f0d59c0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T15:54:49.168 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.166+0000 7f0d59c0f800 20 rados->read ofs=0 len=0 2024-06-04T15:54:49.168 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.167+0000 7f0d59c0f800 20 rados_obj.operate() r=0 bl.length=46 2024-06-04T15:54:49.168 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.167+0000 7f0d59c0f800 20 rados->read ofs=0 len=0 2024-06-04T15:54:49.169 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.167+0000 7f0d59c0f800 20 rados_obj.operate() r=0 bl.length=1139 2024-06-04T15:54:49.169 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.167+0000 7f0d59c0f800 20 searching for the correct realm 2024-06-04T15:54:49.170 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.169+0000 7f0d559a2640 0 -- 172.21.15.144:0/2054577746 >> [v2:172.21.15.144:6800/1453747520,v1:172.21.15.144:6801/1453747520] conn(0x7f0d40042040 msgr2=0x7f0d40042930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-06-04T15:54:49.376 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.375+0000 7f0d559a2640 0 -- 172.21.15.144:0/2054577746 >> [v2:172.21.15.144:6824/166159729,v1:172.21.15.144:6825/166159729] conn(0x55982ef924b0 msgr2=0x55982ef948c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-06-04T15:54:49.381 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.380+0000 7f0d59c0f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-06-04T15:54:49.381 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.380+0000 7f0d59c0f800 20 RGWRados::pool_iterate: got zone_info.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767 2024-06-04T15:54:49.381 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.380+0000 7f0d59c0f800 20 RGWRados::pool_iterate: got default.zone. 2024-06-04T15:54:49.381 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.380+0000 7f0d59c0f800 20 RGWRados::pool_iterate: got zonegroup_info.abb22408-c332-4e28-8f7a-ff254ea2fed2 2024-06-04T15:54:49.382 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.380+0000 7f0d59c0f800 20 RGWRados::pool_iterate: got zone_names.default 2024-06-04T15:54:49.382 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.380+0000 7f0d59c0f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-06-04T15:54:49.382 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.380+0000 7f0d59c0f800 20 rados->read ofs=0 len=0 2024-06-04T15:54:49.382 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.380+0000 7f0d59c0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T15:54:49.382 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.380+0000 7f0d59c0f800 20 rados->read ofs=0 len=0 2024-06-04T15:54:49.383 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.381+0000 7f0d59c0f800 20 rados_obj.operate() r=0 bl.length=46 2024-06-04T15:54:49.383 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.381+0000 7f0d59c0f800 20 rados->read ofs=0 len=0 2024-06-04T15:54:49.383 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.381+0000 7f0d59c0f800 20 rados_obj.operate() r=0 bl.length=470 2024-06-04T15:54:49.383 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.381+0000 7f0d59c0f800 20 zone default found 2024-06-04T15:54:49.383 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.381+0000 7f0d59c0f800 4 Realm: () 2024-06-04T15:54:49.383 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.381+0000 7f0d59c0f800 4 ZoneGroup: default (abb22408-c332-4e28-8f7a-ff254ea2fed2) 2024-06-04T15:54:49.383 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.381+0000 7f0d59c0f800 4 Zone: default (be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767) 2024-06-04T15:54:49.383 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.381+0000 7f0d59c0f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-06-04T15:54:49.384 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.381+0000 7f0d59c0f800 20 zonegroup default 2024-06-04T15:54:49.384 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.381+0000 7f0d59c0f800 20 rados->read ofs=0 len=0 2024-06-04T15:54:49.384 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.381+0000 7f0d59c0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T15:54:49.384 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.381+0000 7f0d59c0f800 20 rados->read ofs=0 len=0 2024-06-04T15:54:49.384 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.382+0000 7f0d59c0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T15:54:49.384 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.382+0000 7f0d59c0f800 20 rados->read ofs=0 len=0 2024-06-04T15:54:49.384 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.382+0000 7f0d59c0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T15:54:49.384 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.382+0000 7f0d59c0f800 20 started sync module instance, tier type = 2024-06-04T15:54:49.384 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.382+0000 7f0d59c0f800 20 started zone id=be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767 (name=default) with tier type = 2024-06-04T15:54:49.394 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.393+0000 7f0d59c0f800 20 add_watcher() i=0 2024-06-04T15:54:49.394 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.393+0000 7f0d59c0f800 20 add_watcher() i=1 2024-06-04T15:54:49.394 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.393+0000 7f0d59c0f800 20 add_watcher() i=2 2024-06-04T15:54:49.394 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.393+0000 7f0d59c0f800 20 add_watcher() i=3 2024-06-04T15:54:49.394 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.393+0000 7f0d59c0f800 20 add_watcher() i=4 2024-06-04T15:54:49.394 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.393+0000 7f0d59c0f800 20 add_watcher() i=5 2024-06-04T15:54:49.394 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.393+0000 7f0d59c0f800 20 add_watcher() i=6 2024-06-04T15:54:49.395 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.394+0000 7f0d59c0f800 20 add_watcher() i=7 2024-06-04T15:54:49.395 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.394+0000 7f0d59c0f800 2 all 8 watchers are set, enabling cache 2024-06-04T15:54:49.397 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.396+0000 7f0c0bfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-06-04T15:54:49.397 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.396+0000 7f0d59c0f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-06-04T15:54:49.397 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.396+0000 7f0d59c0f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-06-04T15:54:49.397 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.396+0000 7f0d59c0f800 5 note: GC not initialized 2024-06-04T15:54:49.398 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.396+0000 7f0c0afe5640 20 reqs_thread_entry: start 2024-06-04T15:54:49.399 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.397+0000 7f0d59c0f800 20 init_complete bucket index max shards: 11 2024-06-04T15:54:49.399 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.397+0000 7f0d59c0f800 20 Filter name: none 2024-06-04T15:54:49.399 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.397+0000 7f0c08fe1640 20 reqs_thread_entry: start 2024-06-04T15:54:49.399 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.397+0000 7f0d59c0f800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-06-04T15:54:49.399 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.397+0000 7f0d59c0f800 20 rados->read ofs=0 len=0 2024-06-04T15:54:49.399 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.397+0000 7f0d59c0f800 20 rados_obj.operate() r=0 bl.length=190 2024-06-04T15:54:49.399 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.397+0000 7f0d59c0f800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-06-04T15:54:49.399 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.397+0000 7f0d59c0f800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-06-04T15:54:49.399 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.397+0000 7f0d59c0f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1 : miss 2024-06-04T15:54:49.399 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.397+0000 7f0d59c0f800 20 rados->read ofs=0 len=0 2024-06-04T15:54:49.400 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.398+0000 7f0d59c0f800 20 rados_obj.operate() r=0 bl.length=404 2024-06-04T15:54:49.400 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.398+0000 7f0d59c0f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1 info.flags=0x17 2024-06-04T15:54:49.400 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.398+0000 7f0d59c0f800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1 to cache LRU end 2024-06-04T15:54:49.400 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.398+0000 7f0d59c0f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-06-04T15:54:49.400 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.398+0000 7f0d59c0f800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-06-04T15:54:49.401 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.398+0000 7f0d59c0f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1 2024-06-04T15:54:49.401 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.398+0000 7f0d59c0f800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.0 2024-06-04T15:54:49.401 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.398+0000 7f0d59c0f800 1 NOTICE: finished shard 0 (0 entries removed) 2024-06-04T15:54:49.401 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.398+0000 7f0d59c0f800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.1 2024-06-04T15:54:49.401 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.399+0000 7f0d59c0f800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.2 2024-06-04T15:54:49.402 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.399+0000 7f0d59c0f800 1 NOTICE: finished shard 2 (0 entries removed) 2024-06-04T15:54:49.402 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.399+0000 7f0d59c0f800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.3 2024-06-04T15:54:49.402 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.400+0000 7f0d59c0f800 1 NOTICE: finished shard 3 (0 entries removed) 2024-06-04T15:54:49.402 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.400+0000 7f0d59c0f800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.4 2024-06-04T15:54:49.402 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.400+0000 7f0d59c0f800 1 NOTICE: finished shard 4 (0 entries removed) 2024-06-04T15:54:49.402 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.400+0000 7f0d59c0f800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.5 2024-06-04T15:54:49.402 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.401+0000 7f0d59c0f800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.6 2024-06-04T15:54:49.403 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.401+0000 7f0d59c0f800 1 NOTICE: finished shard 6 (0 entries removed) 2024-06-04T15:54:49.403 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.401+0000 7f0d59c0f800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.7 2024-06-04T15:54:49.403 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.402+0000 7f0d59c0f800 1 NOTICE: finished shard 7 (0 entries removed) 2024-06-04T15:54:49.403 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.402+0000 7f0d59c0f800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.8 2024-06-04T15:54:49.404 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.403+0000 7f0d59c0f800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.9 2024-06-04T15:54:49.404 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.403+0000 7f0d59c0f800 1 NOTICE: finished shard 9 (0 entries removed) 2024-06-04T15:54:49.404 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.403+0000 7f0d59c0f800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.10 2024-06-04T15:54:49.405 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.404+0000 7f0d59c0f800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.1 2024-06-04T15:54:49.405 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.404+0000 7f0d59c0f800 20 get_obj_state: octx=0x55982ecfc7c0 obj=check-bucket:e state=0x55982efca3a8 s->prefetch_data=0 2024-06-04T15:54:49.405 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.404+0000 7f0d59c0f800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.5 2024-06-04T15:54:49.406 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.404+0000 7f0d59c0f800 20 get_obj_state: octx=0x55982ed240b0 obj=check-bucket:d state=0x55982efc9398 s->prefetch_data=0 2024-06-04T15:54:49.406 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.404+0000 7f0d59c0f800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.8 2024-06-04T15:54:49.406 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.405+0000 7f0d59c0f800 20 get_obj_state: octx=0x55982efc65c0 obj=check-bucket:c state=0x55982efc7568 s->prefetch_data=0 2024-06-04T15:54:49.406 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.405+0000 7f0d59c0f800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.10 2024-06-04T15:54:49.407 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.405+0000 7f0d59c0f800 20 get_obj_state: octx=0x55982efcf440 obj=check-bucket:f state=0x55982efc8368 s->prefetch_data=0 2024-06-04T15:54:49.407 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.405+0000 7f0d59c0f800 20 get_obj_state: setting s->obj_tag to w3uilfvvqhyqbzwb2meq0lrdhy2430d0 2024-06-04T15:54:49.407 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.405+0000 7f0d59c0f800 20 get_obj_state_impl: setting s->olh_tag to rfe8ueujiz338klho083l7i9346t42c2 2024-06-04T15:54:49.407 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.405+0000 7f0d59c0f800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=rfe8ueujiz338klho083l7i9346t42c2 2024-06-04T15:54:49.407 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.405+0000 7f0d59c0f800 20 get_obj_state: setting s->obj_tag to hetl1ayj3wvo35bu66kshdaj43wj6ijs 2024-06-04T15:54:49.407 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.405+0000 7f0d59c0f800 20 get_obj_state_impl: setting s->olh_tag to gmbedoi358o7h13we1larfi9m55svebe 2024-06-04T15:54:49.407 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.405+0000 7f0d59c0f800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=gmbedoi358o7h13we1larfi9m55svebe 2024-06-04T15:54:49.407 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.405+0000 7f0d59c0f800 20 get_obj_state: setting s->obj_tag to p36opfjr5c89wz6ggj7gkruvduclz28f 2024-06-04T15:54:49.408 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.405+0000 7f0d59c0f800 20 get_obj_state_impl: setting s->olh_tag to smtmspbdn4copftrr7nf7dkd1ydeesnh 2024-06-04T15:54:49.408 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.405+0000 7f0d59c0f800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=smtmspbdn4copftrr7nf7dkd1ydeesnh 2024-06-04T15:54:49.408 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.406+0000 7f0d59c0f800 20 get_obj_state: setting s->obj_tag to e60t9miwvzvsol02s26s3uiqwtz4qs9x 2024-06-04T15:54:49.408 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.406+0000 7f0d59c0f800 20 get_obj_state_impl: setting s->olh_tag to yg9mcbm0f0kdnfwugqtcnh2srhlldqbl 2024-06-04T15:54:49.408 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.406+0000 7f0d59c0f800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=yg9mcbm0f0kdnfwugqtcnh2srhlldqbl 2024-06-04T15:54:49.408 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.407+0000 7f0d59c0f800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.8 2024-06-04T15:54:49.409 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.407+0000 7f0d59c0f800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.5 2024-06-04T15:54:49.409 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.407+0000 7f0d59c0f800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.1 2024-06-04T15:54:49.409 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.407+0000 7f0d59c0f800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.10 2024-06-04T15:54:49.410 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.409+0000 7f0d59c0f800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.1 2024-06-04T15:54:49.410 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.409+0000 7f0d59c0f800 20 olh_log_entry: epoch=2 op=2 key=e[] 2024-06-04T15:54:49.410 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.409+0000 7f0d59c0f800 20 olh_log_entry: epoch=2 op=3 key=e[BBaGXwnbHJDhH9KWwlcByNUW2DrWYs9] 2024-06-04T15:54:49.411 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.409+0000 7f0d59c0f800 20 get_obj_state: octx=0x55982ecfc7c0 obj=check-bucket:_:BBaGXwnbHJDhH9KWwlcByNUW2DrWYs9_e state=0x55982f080668 s->prefetch_data=0 2024-06-04T15:54:49.411 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.410+0000 7f0d59c0f800 10 manifest: total_size = 22 2024-06-04T15:54:49.411 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.410+0000 7f0d59c0f800 20 get_obj_state: setting s->obj_tag to be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.12299948965420453520 2024-06-04T15:54:49.411 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.410+0000 7f0d59c0f800 20 get_obj_state: octx=0x55982ecfc7c0 obj=check-bucket:_:BBaGXwnbHJDhH9KWwlcByNUW2DrWYs9_e state=0x55982f080668 s->prefetch_data=0 2024-06-04T15:54:49.411 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.410+0000 7f0d59c0f800 20 prepare_atomic_modification: state is not atomic. state=0x55982f080668 2024-06-04T15:54:49.411 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.410+0000 7f0d59c0f800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.1 2024-06-04T15:54:49.413 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.412+0000 7f0d59c0f800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.8 2024-06-04T15:54:49.414 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.412+0000 7f0d59c0f800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.10 2024-06-04T15:54:49.415 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.413+0000 7f0d59c0f800 20 olh_log_entry: epoch=2 op=2 key=f[] 2024-06-04T15:54:49.415 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.413+0000 7f0d59c0f800 20 olh_log_entry: epoch=2 op=3 key=f[StZWnuGEyMhhAaJLBwjYLf0zoAOpnkw] 2024-06-04T15:54:49.415 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.413+0000 7f0d59c0f800 20 get_obj_state: octx=0x55982efcf440 obj=check-bucket:_:StZWnuGEyMhhAaJLBwjYLf0zoAOpnkw_f state=0x55982f087528 s->prefetch_data=0 2024-06-04T15:54:49.415 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.413+0000 7f0d59c0f800 20 olh_log_entry: epoch=3 op=3 key=c[0UXXEYQY0QLcMp7DEZgM-uoM-BxmzyC] 2024-06-04T15:54:49.415 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.413+0000 7f0d59c0f800 20 get_obj_state: octx=0x55982efc65c0 obj=check-bucket:_:0UXXEYQY0QLcMp7DEZgM-uoM-BxmzyC_c state=0x55982f08e0e8 s->prefetch_data=0 2024-06-04T15:54:49.415 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.413+0000 7f0d59c0f800 10 manifest: total_size = 9 2024-06-04T15:54:49.415 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.413+0000 7f0d59c0f800 20 get_obj_state: setting s->obj_tag to be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.4577426720358598265 2024-06-04T15:54:49.415 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.413+0000 7f0d59c0f800 20 get_obj_state: octx=0x55982efcf440 obj=check-bucket:_:StZWnuGEyMhhAaJLBwjYLf0zoAOpnkw_f state=0x55982f087528 s->prefetch_data=0 2024-06-04T15:54:49.415 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.413+0000 7f0d59c0f800 20 prepare_atomic_modification: state is not atomic. state=0x55982f087528 2024-06-04T15:54:49.415 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.413+0000 7f0d59c0f800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.10 2024-06-04T15:54:49.415 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.413+0000 7f0d59c0f800 10 manifest: total_size = 22 2024-06-04T15:54:49.415 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.413+0000 7f0d59c0f800 20 get_obj_state: setting s->obj_tag to be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.11447521561494718070 2024-06-04T15:54:49.416 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.413+0000 7f0d59c0f800 20 get_obj_state: octx=0x55982efc65c0 obj=check-bucket:_:0UXXEYQY0QLcMp7DEZgM-uoM-BxmzyC_c state=0x55982f08e0e8 s->prefetch_data=0 2024-06-04T15:54:49.416 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.413+0000 7f0d59c0f800 20 prepare_atomic_modification: state is not atomic. state=0x55982f08e0e8 2024-06-04T15:54:49.416 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.413+0000 7f0d59c0f800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.8 2024-06-04T15:54:49.416 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.415+0000 7f0d59c0f800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.5 2024-06-04T15:54:49.416 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.415+0000 7f0d59c0f800 20 olh_log_entry: epoch=3 op=3 key=d[PvNuKuI5Qtr9OO-qrALah1IlSllsdhf] 2024-06-04T15:54:49.416 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.415+0000 7f0d59c0f800 20 get_obj_state: octx=0x55982ed240b0 obj=check-bucket:_:PvNuKuI5Qtr9OO-qrALah1IlSllsdhf_d state=0x55982f09b038 s->prefetch_data=0 2024-06-04T15:54:49.417 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.416+0000 7f0d59c0f800 10 manifest: total_size = 11 2024-06-04T15:54:49.417 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.416+0000 7f0d59c0f800 20 get_obj_state: setting s->obj_tag to be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.16721073655636166911 2024-06-04T15:54:49.417 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.416+0000 7f0d59c0f800 20 get_obj_state: octx=0x55982ed240b0 obj=check-bucket:_:PvNuKuI5Qtr9OO-qrALah1IlSllsdhf_d state=0x55982f09b038 s->prefetch_data=0 2024-06-04T15:54:49.417 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.416+0000 7f0d59c0f800 20 prepare_atomic_modification: state is not atomic. state=0x55982f09b038 2024-06-04T15:54:49.417 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.416+0000 7f0d59c0f800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.5 2024-06-04T15:54:49.424 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.422+0000 7f0c38ff9640 20 handle_completion(): completion ok for obj=c[0UXXEYQY0QLcMp7DEZgM-uoM-BxmzyC] 2024-06-04T15:54:49.424 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.422+0000 7f0c38ff9640 20 handle_completion(): completion ok for obj=e[BBaGXwnbHJDhH9KWwlcByNUW2DrWYs9] 2024-06-04T15:54:49.424 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.422+0000 7f0d59c0f800 20 get_obj_state: octx=0x55982ecfc7c0 obj=check-bucket:e state=0x55982efca3a8 s->prefetch_data=0 2024-06-04T15:54:49.424 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.422+0000 7f0d59c0f800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=rfe8ueujiz338klho083l7i9346t42c2 2024-06-04T15:54:49.424 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.422+0000 7f0d59c0f800 20 get_obj_state: octx=0x55982efcf440 obj=check-bucket:f state=0x55982efc8368 s->prefetch_data=0 2024-06-04T15:54:49.424 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.422+0000 7f0d59c0f800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=yg9mcbm0f0kdnfwugqtcnh2srhlldqbl 2024-06-04T15:54:49.424 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.423+0000 7f0d59c0f800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.8 2024-06-04T15:54:49.424 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.423+0000 7f0d59c0f800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.8 2024-06-04T15:54:49.426 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.425+0000 7f0c27fff640 20 handle_completion(): completion ok for obj=f[StZWnuGEyMhhAaJLBwjYLf0zoAOpnkw] 2024-06-04T15:54:49.426 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.425+0000 7f0c27fff640 20 handle_completion(): completion ok for obj=d[PvNuKuI5Qtr9OO-qrALah1IlSllsdhf] 2024-06-04T15:54:49.429 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.428+0000 7f0d59c0f800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.5 2024-06-04T15:54:49.429 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.428+0000 7f0d59c0f800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.5 2024-06-04T15:54:49.429 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.428+0000 7f0d59c0f800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.8 2024-06-04T15:54:49.429 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.428+0000 7f0d59c0f800 1 NOTICE: finished shard 8 (1 entries removed) 2024-06-04T15:54:49.431 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.430+0000 7f0d59c0f800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.5 2024-06-04T15:54:49.431 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.430+0000 7f0d59c0f800 1 NOTICE: finished shard 5 (1 entries removed) 2024-06-04T15:54:49.434 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.433+0000 7f0d59c0f800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.1 2024-06-04T15:54:49.434 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.433+0000 7f0d59c0f800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.10 2024-06-04T15:54:49.437 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.435+0000 7f0d59c0f800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.10 2024-06-04T15:54:49.437 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.436+0000 7f0d59c0f800 1 NOTICE: finished shard 10 (1 entries removed) 2024-06-04T15:54:49.439 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.438+0000 7f0d59c0f800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1.1 2024-06-04T15:54:49.441 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.438+0000 7f0d59c0f800 1 NOTICE: finished shard 1 (1 entries removed) 2024-06-04T15:54:49.441 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.438+0000 7f0d59c0f800 1 NOTICE: finished all shards (4 entries removed) 2024-06-04T15:54:49.442 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.439+0000 7f0c0bfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-06-04T15:54:49.442 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.441+0000 7f0d59c0f800 20 remove_watcher() i=0 2024-06-04T15:54:49.443 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.441+0000 7f0d59c0f800 2 removed watcher, disabling cache 2024-06-04T15:54:49.444 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.443+0000 7f0d59c0f800 20 remove_watcher() i=1 2024-06-04T15:54:49.445 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.444+0000 7f0d59c0f800 20 remove_watcher() i=2 2024-06-04T15:54:49.445 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.445+0000 7f0d59c0f800 20 remove_watcher() i=3 2024-06-04T15:54:49.446 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.445+0000 7f0d59c0f800 20 remove_watcher() i=4 2024-06-04T15:54:49.448 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.447+0000 7f0d59c0f800 20 remove_watcher() i=5 2024-06-04T15:54:49.449 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.448+0000 7f0d59c0f800 20 remove_watcher() i=6 2024-06-04T15:54:49.450 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.449+0000 7f0d59c0f800 20 remove_watcher() i=7 2024-06-04T15:54:49.463 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T15:54:49.463 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T15:54:49.468 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T15:54:49.468 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T15:54:49.512 INFO:tasks.workunit.client.0.smithi144.stderr:radosgw-admin bucket stats --bucket check-bucket 2024-06-04T15:54:49.540 INFO:tasks.workunit.client.0.smithi144.stderr:ignoring --setuser ceph since I am not root 2024-06-04T15:54:49.540 INFO:tasks.workunit.client.0.smithi144.stderr:ignoring --setgroup ceph since I am not root 2024-06-04T15:54:49.577 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.575+0000 7fa5bba13800 20 rados->read ofs=0 len=0 2024-06-04T15:54:49.579 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.577+0000 7fa5bba13800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T15:54:49.579 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.577+0000 7fa5bba13800 20 realm 2024-06-04T15:54:49.579 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.577+0000 7fa5bba13800 20 rados->read ofs=0 len=0 2024-06-04T15:54:49.579 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.577+0000 7fa5bba13800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T15:54:49.579 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.577+0000 7fa5bba13800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-06-04T15:54:49.579 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.577+0000 7fa5bba13800 20 rados->read ofs=0 len=0 2024-06-04T15:54:49.579 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.577+0000 7fa5bba13800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T15:54:49.579 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.577+0000 7fa5bba13800 20 rados->read ofs=0 len=0 2024-06-04T15:54:49.580 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.578+0000 7fa5bba13800 20 rados_obj.operate() r=0 bl.length=46 2024-06-04T15:54:49.580 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.578+0000 7fa5bba13800 20 rados->read ofs=0 len=0 2024-06-04T15:54:49.580 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.579+0000 7fa5bba13800 20 rados_obj.operate() r=0 bl.length=1139 2024-06-04T15:54:49.580 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.579+0000 7fa5bba13800 20 searching for the correct realm 2024-06-04T15:54:49.582 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.581+0000 7fa5b7818640 0 -- 172.21.15.144:0/2939436333 >> [v2:172.21.15.144:6800/1453747520,v1:172.21.15.144:6801/1453747520] conn(0x7fa5a003f060 msgr2=0x7fa5a0068f20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-06-04T15:54:49.585 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.584+0000 7fa5b7818640 0 -- 172.21.15.144:0/2939436333 >> [v2:172.21.15.144:6824/166159729,v1:172.21.15.144:6825/166159729] conn(0x55ecc3831550 msgr2=0x55ecc3833940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-06-04T15:54:49.590 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.589+0000 7fa5bba13800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-06-04T15:54:49.590 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.589+0000 7fa5bba13800 20 RGWRados::pool_iterate: got zone_info.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767 2024-06-04T15:54:49.591 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.589+0000 7fa5bba13800 20 RGWRados::pool_iterate: got default.zone. 2024-06-04T15:54:49.591 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.589+0000 7fa5bba13800 20 RGWRados::pool_iterate: got zonegroup_info.abb22408-c332-4e28-8f7a-ff254ea2fed2 2024-06-04T15:54:49.591 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.589+0000 7fa5bba13800 20 RGWRados::pool_iterate: got zone_names.default 2024-06-04T15:54:49.591 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.589+0000 7fa5bba13800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-06-04T15:54:49.591 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.589+0000 7fa5bba13800 20 rados->read ofs=0 len=0 2024-06-04T15:54:49.591 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.589+0000 7fa5bba13800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T15:54:49.591 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.589+0000 7fa5bba13800 20 rados->read ofs=0 len=0 2024-06-04T15:54:49.591 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.589+0000 7fa5bba13800 20 rados_obj.operate() r=0 bl.length=46 2024-06-04T15:54:49.591 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.589+0000 7fa5bba13800 20 rados->read ofs=0 len=0 2024-06-04T15:54:49.593 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.590+0000 7fa5bba13800 20 rados_obj.operate() r=0 bl.length=470 2024-06-04T15:54:49.593 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.590+0000 7fa5bba13800 20 zone default found 2024-06-04T15:54:49.593 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.590+0000 7fa5bba13800 4 Realm: () 2024-06-04T15:54:49.593 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.590+0000 7fa5bba13800 4 ZoneGroup: default (abb22408-c332-4e28-8f7a-ff254ea2fed2) 2024-06-04T15:54:49.593 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.590+0000 7fa5bba13800 4 Zone: default (be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767) 2024-06-04T15:54:49.593 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.590+0000 7fa5bba13800 10 cannot find current period zonegroup using local zonegroup configuration 2024-06-04T15:54:49.593 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.590+0000 7fa5bba13800 20 zonegroup default 2024-06-04T15:54:49.593 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.590+0000 7fa5bba13800 20 rados->read ofs=0 len=0 2024-06-04T15:54:49.593 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.590+0000 7fa5bba13800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T15:54:49.593 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.590+0000 7fa5bba13800 20 rados->read ofs=0 len=0 2024-06-04T15:54:49.593 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.590+0000 7fa5bba13800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T15:54:49.594 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.590+0000 7fa5bba13800 20 rados->read ofs=0 len=0 2024-06-04T15:54:49.594 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.590+0000 7fa5bba13800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T15:54:49.594 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.590+0000 7fa5bba13800 20 started sync module instance, tier type = 2024-06-04T15:54:49.594 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.590+0000 7fa5bba13800 20 started zone id=be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767 (name=default) with tier type = 2024-06-04T15:54:49.603 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.601+0000 7fa5bba13800 20 add_watcher() i=0 2024-06-04T15:54:49.603 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.602+0000 7fa5bba13800 20 add_watcher() i=1 2024-06-04T15:54:49.603 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.602+0000 7fa5bba13800 20 add_watcher() i=2 2024-06-04T15:54:49.603 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.602+0000 7fa5bba13800 20 add_watcher() i=3 2024-06-04T15:54:49.603 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.602+0000 7fa5bba13800 20 add_watcher() i=4 2024-06-04T15:54:49.603 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.602+0000 7fa5bba13800 20 add_watcher() i=5 2024-06-04T15:54:49.603 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.602+0000 7fa5bba13800 20 add_watcher() i=6 2024-06-04T15:54:49.604 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.602+0000 7fa5bba13800 20 add_watcher() i=7 2024-06-04T15:54:49.604 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.603+0000 7fa5bba13800 2 all 8 watchers are set, enabling cache 2024-06-04T15:54:49.606 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.604+0000 7fa46dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-06-04T15:54:49.607 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.605+0000 7fa5bba13800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-06-04T15:54:49.607 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.605+0000 7fa5bba13800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-06-04T15:54:49.607 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.605+0000 7fa5bba13800 5 note: GC not initialized 2024-06-04T15:54:49.607 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.605+0000 7fa46cfe1640 20 reqs_thread_entry: start 2024-06-04T15:54:49.607 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.605+0000 7fa5bba13800 20 init_complete bucket index max shards: 11 2024-06-04T15:54:49.607 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.605+0000 7fa5bba13800 20 Filter name: none 2024-06-04T15:54:49.607 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.605+0000 7fa3e67fc640 20 reqs_thread_entry: start 2024-06-04T15:54:49.607 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.605+0000 7fa5bba13800 20 rados->read ofs=0 len=0 2024-06-04T15:54:49.608 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.606+0000 7fa5bba13800 20 rados_obj.operate() r=0 bl.length=190 2024-06-04T15:54:49.608 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.606+0000 7fa5bba13800 20 rados->read ofs=0 len=0 2024-06-04T15:54:49.609 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.606+0000 7fa5bba13800 20 rados_obj.operate() r=0 bl.length=404 2024-06-04T15:54:49.609 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.606+0000 7fa5bba13800 20 couldn't put binfo cache entry, might have raced with data changes 2024-06-04T15:54:49.609 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.606+0000 7fa5bba13800 20 rados->read ofs=0 len=0 2024-06-04T15:54:49.609 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.606+0000 7fa5bba13800 20 rados_obj.operate() r=0 bl.length=190 2024-06-04T15:54:49.609 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.606+0000 7fa5bba13800 20 rados->read ofs=0 len=0 2024-06-04T15:54:49.609 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.607+0000 7fa5bba13800 20 rados_obj.operate() r=0 bl.length=404 2024-06-04T15:54:49.609 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.607+0000 7fa5bba13800 20 couldn't put binfo cache entry, might have raced with data changes 2024-06-04T15:54:49.610 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.608+0000 7fa46dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-06-04T15:54:49.611 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.610+0000 7fa5bba13800 20 remove_watcher() i=0 2024-06-04T15:54:49.612 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.610+0000 7fa5bba13800 2 removed watcher, disabling cache 2024-06-04T15:54:49.613 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.611+0000 7fa5bba13800 20 remove_watcher() i=1 2024-06-04T15:54:49.614 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.612+0000 7fa5bba13800 20 remove_watcher() i=2 2024-06-04T15:54:49.615 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.613+0000 7fa5bba13800 20 remove_watcher() i=3 2024-06-04T15:54:49.615 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.614+0000 7fa5bba13800 20 remove_watcher() i=4 2024-06-04T15:54:49.616 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.615+0000 7fa5bba13800 20 remove_watcher() i=5 2024-06-04T15:54:49.618 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.616+0000 7fa5bba13800 20 remove_watcher() i=6 2024-06-04T15:54:49.619 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:54:49.618+0000 7fa5bba13800 20 remove_watcher() i=7 2024-06-04T15:54:49.629 INFO:tasks.workunit.client.0.smithi144.stderr:{'rgw.main': {'size': 0, 'size_actual': 0, 'size_utilized': 0, 'size_kb': 0, 'size_kb_actual': 0, 'size_kb_utilized': 0, 'num_objects': 0}} 2024-06-04T15:54:49.630 INFO:tasks.workunit.client.0.smithi144.stderr:Deleting bucket check-bucket 2024-06-04T15:54:49.631 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T15:54:49.631 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T15:54:49.638 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T15:54:49.638 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T15:54:49.666 INFO:tasks.workunit.client.0.smithi144.stderr:Completed bucket check tests 2024-06-04T15:54:49.667 INFO:tasks.workunit.client.0.smithi144.stdout:Could not connect to the endpoint URL: "http://localhost:80/" 2024-06-04T15:54:49.667 INFO:tasks.workunit.client.0.smithi144.stdout:Could not connect to the endpoint URL: "http://localhost:8000/" 2024-06-04T15:54:49.667 INFO:tasks.workunit.client.0.smithi144.stdout:connected to https://localhost:443 2024-06-04T15:54:49.728 INFO:tasks.workunit.client.0.smithi144.stderr:+ deactivate 2024-06-04T15:54:49.728 INFO:tasks.workunit.client.0.smithi144.stderr:+ '[' -n /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin ']' 2024-06-04T15:54:49.728 INFO:tasks.workunit.client.0.smithi144.stderr:+ PATH=/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-06-04T15:54:49.728 INFO:tasks.workunit.client.0.smithi144.stderr:+ export PATH 2024-06-04T15:54:49.728 INFO:tasks.workunit.client.0.smithi144.stderr:+ unset _OLD_VIRTUAL_PATH 2024-06-04T15:54:49.728 INFO:tasks.workunit.client.0.smithi144.stderr:+ '[' -n '' ']' 2024-06-04T15:54:49.728 INFO:tasks.workunit.client.0.smithi144.stderr:+ '[' -n /usr/bin/bash -o -n '' ']' 2024-06-04T15:54:49.728 INFO:tasks.workunit.client.0.smithi144.stderr:+ hash -r 2024-06-04T15:54:49.728 INFO:tasks.workunit.client.0.smithi144.stderr:+ '[' -n '' ']' 2024-06-04T15:54:49.728 INFO:tasks.workunit.client.0.smithi144.stderr:+ unset VIRTUAL_ENV 2024-06-04T15:54:49.729 INFO:tasks.workunit.client.0.smithi144.stderr:+ '[' '!' '' = nondestructive ']' 2024-06-04T15:54:49.729 INFO:tasks.workunit.client.0.smithi144.stderr:+ unset -f deactivate 2024-06-04T15:54:49.729 INFO:tasks.workunit.client.0.smithi144.stderr:+ echo OK. 2024-06-04T15:54:49.730 INFO:tasks.workunit.client.0.smithi144.stdout:OK. 2024-06-04T15:54:49.730 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-06-04T15:54:49.730 DEBUG:teuthology.orchestra.run.smithi144:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-06-04T15:54:49.808 INFO:tasks.workunit:Stopping ['rgw/run-bucket-check.sh'] on client.0... 2024-06-04T15:54:49.808 DEBUG:teuthology.orchestra.run.smithi144:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-06-04T15:54:50.148 DEBUG:teuthology.parallel:result is None 2024-06-04T15:54:50.148 DEBUG:teuthology.orchestra.run.smithi144:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-06-04T15:54:50.186 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-06-04T15:54:50.186 DEBUG:teuthology.orchestra.run.smithi144:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-06-04T15:54:50.375 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-06-04T15:54:50.375 INFO:teuthology.run_tasks:Running task workunit... 2024-06-04T15:54:50.385 INFO:tasks.workunit:Pulling workunits from ref 1fb5d10608dccee73edd6ef8a2c7b804a097c324 2024-06-04T15:54:50.385 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-06-04T15:54:50.385 DEBUG:teuthology.orchestra.run.smithi144:> stat -- /home/ubuntu/cephtest/mnt.0 2024-06-04T15:54:50.414 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-06-04T15:54:50.414 INFO:teuthology.orchestra.run.smithi144.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-06-04T15:54:50.415 DEBUG:teuthology.orchestra.run.smithi144:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-06-04T15:54:50.486 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-06-04T15:54:50.486 DEBUG:teuthology.orchestra.run.smithi144:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-06-04T15:54:50.555 INFO:tasks.workunit:timeout=3h 2024-06-04T15:54:50.555 INFO:tasks.workunit:cleanup=True 2024-06-04T15:54:50.555 DEBUG:teuthology.orchestra.run.smithi144:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 1fb5d10608dccee73edd6ef8a2c7b804a097c324 2024-06-04T15:54:50.624 INFO:tasks.workunit.client.0.smithi144.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-06-04T15:56:19.139 INFO:tasks.workunit.client.0.smithi144.stderr:Note: switching to '1fb5d10608dccee73edd6ef8a2c7b804a097c324'. 2024-06-04T15:56:19.139 INFO:tasks.workunit.client.0.smithi144.stderr: 2024-06-04T15:56:19.140 INFO:tasks.workunit.client.0.smithi144.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-06-04T15:56:19.140 INFO:tasks.workunit.client.0.smithi144.stderr:changes and commit them, and you can discard any commits you make in this 2024-06-04T15:56:19.140 INFO:tasks.workunit.client.0.smithi144.stderr:state without impacting any branches by switching back to a branch. 2024-06-04T15:56:19.140 INFO:tasks.workunit.client.0.smithi144.stderr: 2024-06-04T15:56:19.140 INFO:tasks.workunit.client.0.smithi144.stderr:If you want to create a new branch to retain commits you create, you may 2024-06-04T15:56:19.140 INFO:tasks.workunit.client.0.smithi144.stderr:do so (now or later) by using -c with the switch command. Example: 2024-06-04T15:56:19.140 INFO:tasks.workunit.client.0.smithi144.stderr: 2024-06-04T15:56:19.140 INFO:tasks.workunit.client.0.smithi144.stderr: git switch -c 2024-06-04T15:56:19.140 INFO:tasks.workunit.client.0.smithi144.stderr: 2024-06-04T15:56:19.140 INFO:tasks.workunit.client.0.smithi144.stderr:Or undo this operation with: 2024-06-04T15:56:19.140 INFO:tasks.workunit.client.0.smithi144.stderr: 2024-06-04T15:56:19.140 INFO:tasks.workunit.client.0.smithi144.stderr: git switch - 2024-06-04T15:56:19.141 INFO:tasks.workunit.client.0.smithi144.stderr: 2024-06-04T15:56:19.141 INFO:tasks.workunit.client.0.smithi144.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-06-04T15:56:19.141 INFO:tasks.workunit.client.0.smithi144.stderr: 2024-06-04T15:56:19.141 INFO:tasks.workunit.client.0.smithi144.stderr:HEAD is now at 1fb5d10608d Merge pull request #55565 from BBoozmen/oozmen_avoid_path_normalization 2024-06-04T15:56:19.141 DEBUG:teuthology.orchestra.run.smithi144:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-06-04T15:56:19.208 INFO:tasks.workunit.client.0.smithi144.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-06-04T15:56:19.210 INFO:tasks.workunit.client.0.smithi144.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-06-04T15:56:19.210 INFO:tasks.workunit.client.0.smithi144.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-06-04T15:56:19.259 INFO:tasks.workunit.client.0.smithi144.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-06-04T15:56:19.308 INFO:tasks.workunit.client.0.smithi144.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-06-04T15:56:19.347 INFO:tasks.workunit.client.0.smithi144.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-06-04T15:56:19.348 INFO:tasks.workunit.client.0.smithi144.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-06-04T15:56:19.348 INFO:tasks.workunit.client.0.smithi144.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-06-04T15:56:19.388 INFO:tasks.workunit.client.0.smithi144.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-06-04T15:56:19.391 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-06-04T15:56:19.391 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-06-04T15:56:19.462 INFO:tasks.workunit:Running workunits matching cls/test_cls_lock.sh on client.0... 2024-06-04T15:56:19.464 INFO:tasks.workunit:Running workunit cls/test_cls_lock.sh... 2024-06-04T15:56:19.464 DEBUG:teuthology.orchestra.run.smithi144:workunit test cls/test_cls_lock.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1fb5d10608dccee73edd6ef8a2c7b804a097c324 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_lock.sh 2024-06-04T15:56:19.557 INFO:tasks.workunit.client.0.smithi144.stdout:Running main() from gmock_main.cc 2024-06-04T15:56:19.557 INFO:tasks.workunit.client.0.smithi144.stdout:[==========] Running 11 tests from 1 test suite. 2024-06-04T15:56:19.558 INFO:tasks.workunit.client.0.smithi144.stdout:[----------] Global test environment set-up. 2024-06-04T15:56:19.558 INFO:tasks.workunit.client.0.smithi144.stdout:[----------] 11 tests from ClsLock 2024-06-04T15:56:19.558 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] ClsLock.TestMultiLocking 2024-06-04T15:56:21.174 INFO:tasks.workunit.client.0.smithi144.stdout:lock: mylock 2024-06-04T15:56:21.174 INFO:tasks.workunit.client.0.smithi144.stdout: lock_type: exclusive 2024-06-04T15:56:21.174 INFO:tasks.workunit.client.0.smithi144.stdout: tag: 2024-06-04T15:56:21.175 INFO:tasks.workunit.client.0.smithi144.stdout: lockers: 2024-06-04T15:56:21.175 INFO:tasks.workunit.client.0.smithi144.stdout: client.4958 expiration=2024-06-04T15:58:21.171337+0000 addr=v1:172.21.15.144:0/3833613529 cookie= 2024-06-04T15:56:21.179 INFO:tasks.workunit.client.0.smithi144.stdout:lock: mylock 2024-06-04T15:56:21.179 INFO:tasks.workunit.client.0.smithi144.stdout: lock_type: shared 2024-06-04T15:56:21.179 INFO:tasks.workunit.client.0.smithi144.stdout: tag: 2024-06-04T15:56:21.179 INFO:tasks.workunit.client.0.smithi144.stdout: lockers: 2024-06-04T15:56:21.180 INFO:tasks.workunit.client.0.smithi144.stdout: client.4958 expiration=2024-06-04T15:58:21.177786+0000 addr=v1:172.21.15.144:0/3833613529 cookie= 2024-06-04T15:56:21.180 INFO:tasks.workunit.client.0.smithi144.stdout: client.5124 expiration=0.000000 addr=v1:172.21.15.144:0/1016800635 cookie= 2024-06-04T15:56:21.181 INFO:tasks.workunit.client.0.smithi144.stdout:lock: mylock 2024-06-04T15:56:21.181 INFO:tasks.workunit.client.0.smithi144.stdout: lock_type: shared 2024-06-04T15:56:21.181 INFO:tasks.workunit.client.0.smithi144.stdout: tag: 2024-06-04T15:56:21.181 INFO:tasks.workunit.client.0.smithi144.stdout: lockers: 2024-06-04T15:56:21.181 INFO:tasks.workunit.client.0.smithi144.stdout: client.5124 expiration=0.000000 addr=v1:172.21.15.144:0/1016800635 cookie= 2024-06-04T15:56:22.155 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] ClsLock.TestMultiLocking (2598 ms) 2024-06-04T15:56:22.155 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] ClsLock.TestMeta 2024-06-04T15:56:24.200 INFO:tasks.workunit.client.0.smithi144.stdout:lock: mylock 2024-06-04T15:56:24.200 INFO:tasks.workunit.client.0.smithi144.stdout: lock_type: shared 2024-06-04T15:56:24.200 INFO:tasks.workunit.client.0.smithi144.stdout: tag: 2024-06-04T15:56:24.200 INFO:tasks.workunit.client.0.smithi144.stdout: lockers: 2024-06-04T15:56:24.200 INFO:tasks.workunit.client.0.smithi144.stdout: client.5136 expiration=0.000000 addr=v1:172.21.15.144:0/3766533303 cookie= 2024-06-04T15:56:24.202 INFO:tasks.workunit.client.0.smithi144.stdout:lock: mylock 2024-06-04T15:56:24.202 INFO:tasks.workunit.client.0.smithi144.stdout: lock_type: exclusive 2024-06-04T15:56:24.202 INFO:tasks.workunit.client.0.smithi144.stdout: tag: new_tag 2024-06-04T15:56:24.202 INFO:tasks.workunit.client.0.smithi144.stdout: lockers: 2024-06-04T15:56:24.202 INFO:tasks.workunit.client.0.smithi144.stdout: client.4967 expiration=0.000000 addr=v1:172.21.15.144:0/3238177123 cookie= 2024-06-04T15:56:25.178 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] ClsLock.TestMeta (3024 ms) 2024-06-04T15:56:25.179 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] ClsLock.TestCookie 2024-06-04T15:56:27.219 INFO:tasks.workunit.client.0.smithi144.stdout:lock: mylock 2024-06-04T15:56:27.219 INFO:tasks.workunit.client.0.smithi144.stdout: lock_type: exclusive 2024-06-04T15:56:27.219 INFO:tasks.workunit.client.0.smithi144.stdout: tag: 2024-06-04T15:56:27.219 INFO:tasks.workunit.client.0.smithi144.stdout: lockers: 2024-06-04T15:56:27.224 INFO:tasks.workunit.client.0.smithi144.stdout:lock: mylock 2024-06-04T15:56:27.224 INFO:tasks.workunit.client.0.smithi144.stdout: lock_type: shared 2024-06-04T15:56:27.224 INFO:tasks.workunit.client.0.smithi144.stdout: tag: 2024-06-04T15:56:27.224 INFO:tasks.workunit.client.0.smithi144.stdout: lockers: 2024-06-04T15:56:27.224 INFO:tasks.workunit.client.0.smithi144.stdout: client.5142 expiration=0.000000 addr=v1:172.21.15.144:0/1182965191 cookie= 2024-06-04T15:56:27.224 INFO:tasks.workunit.client.0.smithi144.stdout: client.5142 expiration=0.000000 addr=v1:172.21.15.144:0/1182965191 cookie=new cookie 2024-06-04T15:56:28.209 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] ClsLock.TestCookie (3030 ms) 2024-06-04T15:56:28.209 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] ClsLock.TestMultipleLocks 2024-06-04T15:56:31.243 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] ClsLock.TestMultipleLocks (3035 ms) 2024-06-04T15:56:31.244 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] ClsLock.TestLockDuration 2024-06-04T15:56:39.282 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] ClsLock.TestLockDuration (8038 ms) 2024-06-04T15:56:39.282 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] ClsLock.TestAssertLocked 2024-06-04T15:56:42.301 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] ClsLock.TestAssertLocked (3019 ms) 2024-06-04T15:56:42.301 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] ClsLock.TestSetCookie 2024-06-04T15:56:45.323 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] ClsLock.TestSetCookie (3022 ms) 2024-06-04T15:56:45.323 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] ClsLock.TestRenew 2024-06-04T15:57:06.368 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] ClsLock.TestRenew (21045 ms) 2024-06-04T15:57:06.368 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] ClsLock.TestExclusiveEphemeralBasic 2024-06-04T15:57:13.407 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] ClsLock.TestExclusiveEphemeralBasic (7039 ms) 2024-06-04T15:57:13.407 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] ClsLock.TestExclusiveEphemeralStealEphemeral 2024-06-04T15:57:21.447 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] ClsLock.TestExclusiveEphemeralStealEphemeral (8040 ms) 2024-06-04T15:57:21.447 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] ClsLock.TestExclusiveEphemeralStealExclusive 2024-06-04T15:57:29.483 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] ClsLock.TestExclusiveEphemeralStealExclusive (8037 ms) 2024-06-04T15:57:29.484 INFO:tasks.workunit.client.0.smithi144.stdout:[----------] 11 tests from ClsLock (69927 ms total) 2024-06-04T15:57:29.484 INFO:tasks.workunit.client.0.smithi144.stdout: 2024-06-04T15:57:29.484 INFO:tasks.workunit.client.0.smithi144.stdout:[----------] Global test environment tear-down 2024-06-04T15:57:29.484 INFO:tasks.workunit.client.0.smithi144.stdout:[==========] 11 tests from 1 test suite ran. (69927 ms total) 2024-06-04T15:57:29.484 INFO:tasks.workunit.client.0.smithi144.stdout:[ PASSED ] 11 tests. 2024-06-04T15:57:29.487 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-06-04T15:57:29.487 DEBUG:teuthology.orchestra.run.smithi144:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-06-04T15:57:29.570 INFO:tasks.workunit:Running workunits matching cls/test_cls_log.sh on client.0... 2024-06-04T15:57:29.571 INFO:tasks.workunit:Running workunit cls/test_cls_log.sh... 2024-06-04T15:57:29.571 DEBUG:teuthology.orchestra.run.smithi144:workunit test cls/test_cls_log.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1fb5d10608dccee73edd6ef8a2c7b804a097c324 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_log.sh 2024-06-04T15:57:29.660 INFO:tasks.workunit.client.0.smithi144.stdout:Running main() from gmock_main.cc 2024-06-04T15:57:29.660 INFO:tasks.workunit.client.0.smithi144.stdout:[==========] Running 4 tests from 1 test suite. 2024-06-04T15:57:29.660 INFO:tasks.workunit.client.0.smithi144.stdout:[----------] Global test environment set-up. 2024-06-04T15:57:29.660 INFO:tasks.workunit.client.0.smithi144.stdout:[----------] 4 tests from cls_log 2024-06-04T15:57:29.660 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] cls_log.test_log_add_same_time 2024-06-04T15:57:32.499 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] cls_log.test_log_add_same_time (2836 ms) 2024-06-04T15:57:32.499 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] cls_log.test_log_add_different_time 2024-06-04T15:57:35.524 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] cls_log.test_log_add_different_time (3029 ms) 2024-06-04T15:57:35.525 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] cls_log.trim_by_time 2024-06-04T15:57:38.539 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] cls_log.trim_by_time (3014 ms) 2024-06-04T15:57:38.539 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] cls_log.trim_by_marker 2024-06-04T15:57:41.558 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] cls_log.trim_by_marker (3019 ms) 2024-06-04T15:57:41.558 INFO:tasks.workunit.client.0.smithi144.stdout:[----------] 4 tests from cls_log (11898 ms total) 2024-06-04T15:57:41.558 INFO:tasks.workunit.client.0.smithi144.stdout: 2024-06-04T15:57:41.559 INFO:tasks.workunit.client.0.smithi144.stdout:[----------] Global test environment tear-down 2024-06-04T15:57:41.559 INFO:tasks.workunit.client.0.smithi144.stdout:[==========] 4 tests from 1 test suite ran. (11898 ms total) 2024-06-04T15:57:41.559 INFO:tasks.workunit.client.0.smithi144.stdout:[ PASSED ] 4 tests. 2024-06-04T15:57:41.561 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-06-04T15:57:41.561 DEBUG:teuthology.orchestra.run.smithi144:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-06-04T15:57:41.604 INFO:tasks.workunit:Running workunits matching cls/test_cls_refcount.sh on client.0... 2024-06-04T15:57:41.606 INFO:tasks.workunit:Running workunit cls/test_cls_refcount.sh... 2024-06-04T15:57:41.606 DEBUG:teuthology.orchestra.run.smithi144:workunit test cls/test_cls_refcount.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1fb5d10608dccee73edd6ef8a2c7b804a097c324 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_refcount.sh 2024-06-04T15:57:41.692 INFO:tasks.workunit.client.0.smithi144.stdout:Running main() from gmock_main.cc 2024-06-04T15:57:41.692 INFO:tasks.workunit.client.0.smithi144.stdout:[==========] Running 10 tests from 1 test suite. 2024-06-04T15:57:41.692 INFO:tasks.workunit.client.0.smithi144.stdout:[----------] Global test environment set-up. 2024-06-04T15:57:41.692 INFO:tasks.workunit.client.0.smithi144.stdout:[----------] 10 tests from cls_refcount 2024-06-04T15:57:41.692 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] cls_refcount.test_implicit 2024-06-04T15:57:44.584 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] cls_refcount.test_implicit (2893 ms) 2024-06-04T15:57:44.585 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] cls_refcount.test_implicit_idempotent 2024-06-04T15:57:47.623 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] cls_refcount.test_implicit_idempotent (3038 ms) 2024-06-04T15:57:47.623 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] cls_refcount.test_put_snap 2024-06-04T15:57:56.657 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] cls_refcount.test_put_snap (9035 ms) 2024-06-04T15:57:56.658 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] cls_refcount.test_explicit 2024-06-04T15:57:59.689 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] cls_refcount.test_explicit (3031 ms) 2024-06-04T15:57:59.689 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] cls_refcount.set 2024-06-04T15:58:02.710 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] cls_refcount.set (3021 ms) 2024-06-04T15:58:02.710 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] cls_refcount.test_implicit_ec 2024-06-04T15:58:09.739 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] cls_refcount.test_implicit_ec (7029 ms) 2024-06-04T15:58:09.739 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] cls_refcount.test_implicit_idempotent_ec 2024-06-04T15:58:16.751 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] cls_refcount.test_implicit_idempotent_ec (7012 ms) 2024-06-04T15:58:16.751 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] cls_refcount.test_put_snap_ec 2024-06-04T15:58:29.814 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] cls_refcount.test_put_snap_ec (13062 ms) 2024-06-04T15:58:29.814 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] cls_refcount.test_explicit_ec 2024-06-04T15:58:36.827 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] cls_refcount.test_explicit_ec (7014 ms) 2024-06-04T15:58:36.827 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] cls_refcount.set_ec 2024-06-04T15:58:43.881 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] cls_refcount.set_ec (7054 ms) 2024-06-04T15:58:43.881 INFO:tasks.workunit.client.0.smithi144.stdout:[----------] 10 tests from cls_refcount (62189 ms total) 2024-06-04T15:58:43.881 INFO:tasks.workunit.client.0.smithi144.stdout: 2024-06-04T15:58:43.881 INFO:tasks.workunit.client.0.smithi144.stdout:[----------] Global test environment tear-down 2024-06-04T15:58:43.881 INFO:tasks.workunit.client.0.smithi144.stdout:[==========] 10 tests from 1 test suite ran. (62189 ms total) 2024-06-04T15:58:43.881 INFO:tasks.workunit.client.0.smithi144.stdout:[ PASSED ] 10 tests. 2024-06-04T15:58:43.884 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-06-04T15:58:43.884 DEBUG:teuthology.orchestra.run.smithi144:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-06-04T15:58:43.926 INFO:tasks.workunit:Running workunits matching cls/test_cls_rgw.sh on client.0... 2024-06-04T15:58:43.927 INFO:tasks.workunit:Running workunit cls/test_cls_rgw.sh... 2024-06-04T15:58:43.928 DEBUG:teuthology.orchestra.run.smithi144:workunit test cls/test_cls_rgw.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1fb5d10608dccee73edd6ef8a2c7b804a097c324 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_rgw.sh 2024-06-04T15:58:44.014 INFO:tasks.workunit.client.0.smithi144.stdout:Running main() from gmock_main.cc 2024-06-04T15:58:44.014 INFO:tasks.workunit.client.0.smithi144.stdout:[==========] Running 16 tests from 1 test suite. 2024-06-04T15:58:44.014 INFO:tasks.workunit.client.0.smithi144.stdout:[----------] Global test environment set-up. 2024-06-04T15:58:44.014 INFO:tasks.workunit.client.0.smithi144.stdout:[----------] 16 tests from cls_rgw 2024-06-04T15:58:45.902 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] cls_rgw.index_basic 2024-06-04T15:58:45.946 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] cls_rgw.index_basic (45 ms) 2024-06-04T15:58:45.946 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] cls_rgw.index_multiple_obj_writers 2024-06-04T15:58:45.978 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] cls_rgw.index_multiple_obj_writers (31 ms) 2024-06-04T15:58:45.978 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] cls_rgw.index_remove_object 2024-06-04T15:58:46.014 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] cls_rgw.index_remove_object (36 ms) 2024-06-04T15:58:46.014 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] cls_rgw.index_suggest 2024-06-04T15:58:47.453 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] cls_rgw.index_suggest (1439 ms) 2024-06-04T15:58:47.453 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] cls_rgw.index_suggest_complete 2024-06-04T15:58:47.459 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] cls_rgw.index_suggest_complete (6 ms) 2024-06-04T15:58:47.459 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] cls_rgw.index_list 2024-06-04T15:58:47.482 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] cls_rgw.index_list (23 ms) 2024-06-04T15:58:47.482 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] cls_rgw.index_list_delimited 2024-06-04T15:59:10.717 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] cls_rgw.index_list_delimited (23235 ms) 2024-06-04T15:59:10.717 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] cls_rgw.bi_list 2024-06-04T15:59:10.816 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] cls_rgw.bi_list (99 ms) 2024-06-04T15:59:10.816 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] cls_rgw.gc_set 2024-06-04T15:59:10.828 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] cls_rgw.gc_set (13 ms) 2024-06-04T15:59:10.828 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] cls_rgw.gc_list 2024-06-04T15:59:10.840 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] cls_rgw.gc_list (12 ms) 2024-06-04T15:59:10.840 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] cls_rgw.gc_defer 2024-06-04T15:59:18.138 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] cls_rgw.gc_defer (7297 ms) 2024-06-04T15:59:18.138 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] cls_rgw.usage_basic 2024-06-04T15:59:18.248 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] cls_rgw.usage_basic (111 ms) 2024-06-04T15:59:18.249 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] cls_rgw.usage_clear_no_obj 2024-06-04T15:59:18.250 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] cls_rgw.usage_clear_no_obj (1 ms) 2024-06-04T15:59:18.250 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] cls_rgw.usage_clear 2024-06-04T15:59:18.341 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] cls_rgw.usage_clear (91 ms) 2024-06-04T15:59:18.341 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] cls_rgw.bi_log_trim 2024-06-04T15:59:18.395 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] cls_rgw.bi_log_trim (55 ms) 2024-06-04T15:59:18.396 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] cls_rgw.index_racing_removes 2024-06-04T15:59:18.419 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] cls_rgw.index_racing_removes (23 ms) 2024-06-04T15:59:19.144 INFO:tasks.workunit.client.0.smithi144.stdout:[----------] 16 tests from cls_rgw (32517 ms total) 2024-06-04T15:59:19.144 INFO:tasks.workunit.client.0.smithi144.stdout: 2024-06-04T15:59:19.145 INFO:tasks.workunit.client.0.smithi144.stdout:[----------] Global test environment tear-down 2024-06-04T15:59:19.145 INFO:tasks.workunit.client.0.smithi144.stdout:[==========] 16 tests from 1 test suite ran. (35131 ms total) 2024-06-04T15:59:19.145 INFO:tasks.workunit.client.0.smithi144.stdout:[ PASSED ] 16 tests. 2024-06-04T15:59:19.148 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-06-04T15:59:19.148 DEBUG:teuthology.orchestra.run.smithi144:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-06-04T15:59:19.190 INFO:tasks.workunit:Running workunits matching cls/test_cls_rgw_gc.sh on client.0... 2024-06-04T15:59:19.191 INFO:tasks.workunit:Running workunit cls/test_cls_rgw_gc.sh... 2024-06-04T15:59:19.191 DEBUG:teuthology.orchestra.run.smithi144:workunit test cls/test_cls_rgw_gc.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1fb5d10608dccee73edd6ef8a2c7b804a097c324 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_rgw_gc.sh 2024-06-04T15:59:19.276 INFO:tasks.workunit.client.0.smithi144.stdout:Running main() from gmock_main.cc 2024-06-04T15:59:19.276 INFO:tasks.workunit.client.0.smithi144.stdout:[==========] Running 9 tests from 1 test suite. 2024-06-04T15:59:19.276 INFO:tasks.workunit.client.0.smithi144.stdout:[----------] Global test environment set-up. 2024-06-04T15:59:19.276 INFO:tasks.workunit.client.0.smithi144.stdout:[----------] 9 tests from cls_rgw_gc 2024-06-04T15:59:19.276 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] cls_rgw_gc.init 2024-06-04T15:59:21.152 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] cls_rgw_gc.init (1877 ms) 2024-06-04T15:59:21.152 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops1 2024-06-04T15:59:21.176 INFO:tasks.workunit.client.0.smithi144.stderr:[ ] list info tag = chain-0 2024-06-04T15:59:21.177 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] cls_rgw_gc.gc_queue_ops1 (24 ms) 2024-06-04T15:59:21.177 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops2 2024-06-04T15:59:21.185 INFO:tasks.workunit.client.0.smithi144.stderr:[ ] next_marker is: = 0/4263 2024-06-04T15:59:21.186 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] cls_rgw_gc.gc_queue_ops2 (9 ms) 2024-06-04T15:59:21.186 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops5 2024-06-04T15:59:21.194 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] cls_rgw_gc.gc_queue_ops5 (9 ms) 2024-06-04T15:59:21.195 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops6 2024-06-04T15:59:21.203 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] cls_rgw_gc.gc_queue_ops6 (8 ms) 2024-06-04T15:59:21.203 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops7 2024-06-04T15:59:21.215 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] cls_rgw_gc.gc_queue_ops7 (12 ms) 2024-06-04T15:59:21.215 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops8 2024-06-04T15:59:21.222 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] cls_rgw_gc.gc_queue_ops8 (8 ms) 2024-06-04T15:59:21.222 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops9 2024-06-04T15:59:21.229 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] cls_rgw_gc.gc_queue_ops9 (7 ms) 2024-06-04T15:59:21.229 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] cls_rgw_gc.finalize 2024-06-04T15:59:22.154 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] cls_rgw_gc.finalize (922 ms) 2024-06-04T15:59:22.154 INFO:tasks.workunit.client.0.smithi144.stdout:[----------] 9 tests from cls_rgw_gc (2876 ms total) 2024-06-04T15:59:22.155 INFO:tasks.workunit.client.0.smithi144.stdout: 2024-06-04T15:59:22.155 INFO:tasks.workunit.client.0.smithi144.stdout:[----------] Global test environment tear-down 2024-06-04T15:59:22.155 INFO:tasks.workunit.client.0.smithi144.stdout:[==========] 9 tests from 1 test suite ran. (2876 ms total) 2024-06-04T15:59:22.155 INFO:tasks.workunit.client.0.smithi144.stdout:[ PASSED ] 9 tests. 2024-06-04T15:59:22.156 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-06-04T15:59:22.156 DEBUG:teuthology.orchestra.run.smithi144:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-06-04T15:59:22.199 INFO:tasks.workunit:Running workunits matching cls/test_cls_rgw_stats.sh on client.0... 2024-06-04T15:59:22.200 INFO:tasks.workunit:Running workunit cls/test_cls_rgw_stats.sh... 2024-06-04T15:59:22.200 DEBUG:teuthology.orchestra.run.smithi144:workunit test cls/test_cls_rgw_stats.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1fb5d10608dccee73edd6ef8a2c7b804a097c324 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_rgw_stats.sh 2024-06-04T15:59:22.295 INFO:tasks.workunit.client.0.smithi144.stderr:ignoring --setuser ceph since I am not root 2024-06-04T15:59:22.295 INFO:tasks.workunit.client.0.smithi144.stderr:ignoring --setgroup ceph since I am not root 2024-06-04T15:59:22.296 INFO:tasks.workunit.client.0.smithi144.stdout:[==========] Running 1 test from 1 test suite. 2024-06-04T15:59:22.296 INFO:tasks.workunit.client.0.smithi144.stdout:[----------] Global test environment set-up. 2024-06-04T15:59:24.176 INFO:tasks.workunit.client.0.smithi144.stdout:[----------] 1 test from cls_rgw_stats 2024-06-04T15:59:24.176 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] cls_rgw_stats.simulate 2024-06-04T15:59:24.190 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.190+0000 7f5e9aacc780 1 > prepared part key=_multipart_GCPC9OJH7KWU.2~9IY5E2V89IS6.0 size=1048576 2024-06-04T15:59:24.191 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.191+0000 7f5e9aacc780 1 > prepared part key=_multipart_GCPC9OJH7KWU.2~9IY5E2V89IS6.1 size=624248 2024-06-04T15:59:24.192 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.191+0000 7f5e9aacc780 1 > prepared multipart upload key=GCPC9OJH7KWU upload=9IY5E2V89IS6 tag=L26OFV3T8G3U type=write size=2721400 2024-06-04T15:59:24.193 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.193+0000 7f5e9aacc780 1 > prepared operation key=GTRMEQJK675Z tag=13XKKWNFEOVJ type=del size=1176753 2024-06-04T15:59:24.196 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.195+0000 7f5e9aacc780 1 > prepared part key=_multipart_9MPRI6LW3956.2~M6WEVR0P3FYM.0 size=1048576 2024-06-04T15:59:24.197 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.197+0000 7f5e9aacc780 1 > prepared part key=_multipart_9MPRI6LW3956.2~M6WEVR0P3FYM.1 size=161128 2024-06-04T15:59:24.197 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.197+0000 7f5e9aacc780 1 > prepared multipart upload key=9MPRI6LW3956 upload=M6WEVR0P3FYM tag=HD0Y9IFD1LI2 type=write size=2258280 2024-06-04T15:59:24.200 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.200+0000 7f5e9aacc780 1 > prepared part key=_multipart_A8O0S3S45RGM.2~1NN2RNQ6GWG3.0 size=1048576 2024-06-04T15:59:24.201 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.201+0000 7f5e9aacc780 1 > prepared part key=_multipart_A8O0S3S45RGM.2~1NN2RNQ6GWG3.1 size=1048576 2024-06-04T15:59:24.206 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.203+0000 7f5e9aacc780 1 > prepared part key=_multipart_A8O0S3S45RGM.2~1NN2RNQ6GWG3.2 size=643446 2024-06-04T15:59:24.206 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.203+0000 7f5e9aacc780 1 > prepared multipart upload key=A8O0S3S45RGM upload=1NN2RNQ6GWG3 tag=EM3MHXKXI97Q type=write size=3789174 2024-06-04T15:59:24.206 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.205+0000 7f5e9aacc780 1 > prepared part key=_multipart_W1T4O3EAE7JN.2~NENM42B0972X.0 size=941417 2024-06-04T15:59:24.206 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.205+0000 7f5e9aacc780 1 > prepared multipart upload key=W1T4O3EAE7JN upload=NENM42B0972X tag=IWEGEMX51QUC type=write size=1989993 2024-06-04T15:59:24.207 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.207+0000 7f5e9aacc780 1 > prepared operation key=QUIVPH3OB6KN tag=ZYV1LCSTFSYU type=write size=375636 2024-06-04T15:59:24.210 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.210+0000 7f5e9aacc780 1 > prepared part key=_multipart_XH0N984YVGKP.2~50NV9JIDRV4L.0 size=1048576 2024-06-04T15:59:24.211 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.211+0000 7f5e9aacc780 1 > prepared part key=_multipart_XH0N984YVGKP.2~50NV9JIDRV4L.1 size=1048576 2024-06-04T15:59:24.212 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.212+0000 7f5e9aacc780 1 > prepared part key=_multipart_XH0N984YVGKP.2~50NV9JIDRV4L.2 size=788501 2024-06-04T15:59:24.212 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.212+0000 7f5e9aacc780 1 > prepared multipart upload key=XH0N984YVGKP upload=50NV9JIDRV4L tag=WYUZ6CMQVK89 type=write size=3934229 2024-06-04T15:59:24.214 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.213+0000 7f5e9aacc780 1 > prepared operation key=Q4OFQI0F5YLG tag=TMSRIWE8TSXF type=del size=15793 2024-06-04T15:59:24.215 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.215+0000 7f5e9aacc780 1 > prepared operation key=K01DAK0M4I4M tag=RWP9PWN5Q02S type=write size=120199 2024-06-04T15:59:24.218 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.218+0000 7f5e9aacc780 1 > prepared part key=_multipart_UW5LVIBG09SV.2~2DCMTPWNJ7U8.0 size=1048576 2024-06-04T15:59:24.219 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.219+0000 7f5e9aacc780 1 > prepared part key=_multipart_UW5LVIBG09SV.2~2DCMTPWNJ7U8.1 size=1048576 2024-06-04T15:59:24.220 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.220+0000 7f5e9aacc780 1 > prepared part key=_multipart_UW5LVIBG09SV.2~2DCMTPWNJ7U8.2 size=515492 2024-06-04T15:59:24.221 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.220+0000 7f5e9aacc780 1 > prepared multipart upload key=UW5LVIBG09SV upload=2DCMTPWNJ7U8 tag=FL4U00S0JHVN type=write size=3661220 2024-06-04T15:59:24.222 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.222+0000 7f5e9aacc780 1 > prepared operation key=4W5HB9WQQHR6 tag=IDEVCJIBP54N type=write size=93097 2024-06-04T15:59:24.224 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.223+0000 7f5e9aacc780 1 > prepared operation key=2BT2AXKB1RTA tag=5XEPTV482WOZ type=del size=2372599 2024-06-04T15:59:24.225 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.225+0000 7f5e9aacc780 1 > prepared operation key=JL69PUHT6NNT tag=85Y9W072IS9Z type=del size=930132 2024-06-04T15:59:24.227 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.227+0000 7f5e9aacc780 1 > prepared part key=_multipart_RP8K6QJUZAH1.2~TMOHCPGVZSY1.0 size=1048576 2024-06-04T15:59:24.229 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.228+0000 7f5e9aacc780 1 > prepared part key=_multipart_RP8K6QJUZAH1.2~TMOHCPGVZSY1.1 size=1048576 2024-06-04T15:59:24.230 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.230+0000 7f5e9aacc780 1 > prepared part key=_multipart_RP8K6QJUZAH1.2~TMOHCPGVZSY1.2 size=22139 2024-06-04T15:59:24.230 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.230+0000 7f5e9aacc780 1 > prepared multipart upload key=RP8K6QJUZAH1 upload=TMOHCPGVZSY1 tag=D5GMJL5931G7 type=write size=3167867 2024-06-04T15:59:24.231 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.231+0000 7f5e9aacc780 1 > prepared operation key=K01DAK0M4I4M tag=89TIRSBQKONR type=del size=2350490 2024-06-04T15:59:24.233 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.233+0000 7f5e9aacc780 1 > prepared operation key=XH0N984YVGKP tag=PGXSB1LZ6PLV type=write size=215279 2024-06-04T15:59:24.235 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.234+0000 7f5e9aacc780 1 < completed part key=_multipart_GCPC9OJH7KWU.2~9IY5E2V89IS6.0 size=1048576 2024-06-04T15:59:24.236 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.236+0000 7f5e9aacc780 1 < completed part key=_multipart_GCPC9OJH7KWU.2~9IY5E2V89IS6.1 size=624248 2024-06-04T15:59:24.238 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.238+0000 7f5e9aacc780 1 < completed multipart upload key=GCPC9OJH7KWU upload=9IY5E2V89IS6 tag=L26OFV3T8G3U type=write size=2721400 2024-06-04T15:59:24.241 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.241+0000 7f5e9aacc780 1 > prepared part key=_multipart_AOCB36Y5Q7B0.2~Y0L2EFN7S8S4.0 size=1048576 2024-06-04T15:59:24.242 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.242+0000 7f5e9aacc780 1 > prepared part key=_multipart_AOCB36Y5Q7B0.2~Y0L2EFN7S8S4.1 size=1048576 2024-06-04T15:59:24.244 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.243+0000 7f5e9aacc780 1 > prepared part key=_multipart_AOCB36Y5Q7B0.2~Y0L2EFN7S8S4.2 size=493319 2024-06-04T15:59:24.244 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.243+0000 7f5e9aacc780 1 > prepared multipart upload key=AOCB36Y5Q7B0 upload=Y0L2EFN7S8S4 tag=1H69S0JZ6VI9 type=write size=3639047 2024-06-04T15:59:24.245 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.245+0000 7f5e9aacc780 1 < completed delete operation key=GTRMEQJK675Z tag=13XKKWNFEOVJ type=del 2024-06-04T15:59:24.247 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.247+0000 7f5e9aacc780 1 > prepared operation key=RP8K6QJUZAH1 tag=BUIDQD1LYV2X type=del size=3388041 2024-06-04T15:59:24.248 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.248+0000 7f5e9aacc780 1 < completed part key=_multipart_9MPRI6LW3956.2~M6WEVR0P3FYM.0 size=1048576 2024-06-04T15:59:24.250 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.250+0000 7f5e9aacc780 1 < completed part key=_multipart_9MPRI6LW3956.2~M6WEVR0P3FYM.1 size=161128 2024-06-04T15:59:24.252 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.252+0000 7f5e9aacc780 1 < completed multipart upload key=9MPRI6LW3956 upload=M6WEVR0P3FYM tag=HD0Y9IFD1LI2 type=write size=2258280 2024-06-04T15:59:24.255 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.255+0000 7f5e9aacc780 1 > prepared part key=_multipart_GTRMEQJK675Z.2~JLYXKQAWH53P.0 size=1048576 2024-06-04T15:59:24.256 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.256+0000 7f5e9aacc780 1 > prepared part key=_multipart_GTRMEQJK675Z.2~JLYXKQAWH53P.1 size=137897 2024-06-04T15:59:24.256 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.256+0000 7f5e9aacc780 1 > prepared multipart upload key=GTRMEQJK675Z upload=JLYXKQAWH53P tag=VVER53GJI9FI type=write size=2235049 2024-06-04T15:59:24.257 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.258+0000 7f5e9aacc780 1 < completed part key=_multipart_A8O0S3S45RGM.2~1NN2RNQ6GWG3.0 size=1048576 2024-06-04T15:59:24.259 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.259+0000 7f5e9aacc780 1 < completed part key=_multipart_A8O0S3S45RGM.2~1NN2RNQ6GWG3.1 size=1048576 2024-06-04T15:59:24.260 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.260+0000 7f5e9aacc780 1 < completed part key=_multipart_A8O0S3S45RGM.2~1NN2RNQ6GWG3.2 size=643446 2024-06-04T15:59:24.262 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.262+0000 7f5e9aacc780 1 < completed multipart upload key=A8O0S3S45RGM upload=1NN2RNQ6GWG3 tag=EM3MHXKXI97Q type=write size=3789174 2024-06-04T15:59:24.264 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.264+0000 7f5e9aacc780 1 > prepared operation key=AOCB36Y5Q7B0 tag=8DQNUTV79708 type=write size=575538 2024-06-04T15:59:24.265 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.265+0000 7f5e9aacc780 1 < completed part key=_multipart_W1T4O3EAE7JN.2~NENM42B0972X.0 size=941417 2024-06-04T15:59:24.267 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.268+0000 7f5e9aacc780 1 < completed multipart upload key=W1T4O3EAE7JN upload=NENM42B0972X tag=IWEGEMX51QUC type=write size=1989993 2024-06-04T15:59:24.270 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.270+0000 7f5e9aacc780 1 > prepared part key=_multipart_DY9JWHWNAUO1.2~8IPTTS8RV8P4.0 size=1048576 2024-06-04T15:59:24.271 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.271+0000 7f5e9aacc780 1 > prepared part key=_multipart_DY9JWHWNAUO1.2~8IPTTS8RV8P4.1 size=524433 2024-06-04T15:59:24.271 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.271+0000 7f5e9aacc780 1 > prepared multipart upload key=DY9JWHWNAUO1 upload=8IPTTS8RV8P4 tag=4NVP28S1A4MR type=write size=2621585 2024-06-04T15:59:24.273 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.273+0000 7f5e9aacc780 1 < completed write operation key=QUIVPH3OB6KN tag=ZYV1LCSTFSYU type=write size=375636 2024-06-04T15:59:24.274 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.274+0000 7f5e9aacc780 1 > prepared operation key=PNDPO2WUW7UX tag=N3RWRSF57XON type=del size=2091376 2024-06-04T15:59:24.276 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.276+0000 7f5e9aacc780 1 < completed part key=_multipart_XH0N984YVGKP.2~50NV9JIDRV4L.0 size=1048576 2024-06-04T15:59:24.277 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.277+0000 7f5e9aacc780 1 < completed part key=_multipart_XH0N984YVGKP.2~50NV9JIDRV4L.1 size=1048576 2024-06-04T15:59:24.279 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.278+0000 7f5e9aacc780 1 < completed part key=_multipart_XH0N984YVGKP.2~50NV9JIDRV4L.2 size=788501 2024-06-04T15:59:24.281 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.281+0000 7f5e9aacc780 1 < completed multipart upload key=XH0N984YVGKP upload=50NV9JIDRV4L tag=WYUZ6CMQVK89 type=write size=3934229 2024-06-04T15:59:24.282 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.282+0000 7f5e9aacc780 1 > prepared operation key=FBV2MAG130M6 tag=JU2X60T5O4HO type=del size=2615314 2024-06-04T15:59:24.284 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.283+0000 7f5e9aacc780 1 < completed delete operation key=Q4OFQI0F5YLG tag=TMSRIWE8TSXF type=del 2024-06-04T15:59:24.286 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.286+0000 7f5e9aacc780 1 > prepared part key=_multipart_AOCB36Y5Q7B0.2~0JO3D01Y9N3X.0 size=276475 2024-06-04T15:59:24.286 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.286+0000 7f5e9aacc780 1 > prepared multipart upload key=AOCB36Y5Q7B0 upload=0JO3D01Y9N3X tag=IBPA44A62N3M type=write size=1325051 2024-06-04T15:59:24.289 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.289+0000 7f5e9aacc780 1 < suggested remove operation key=K01DAK0M4I4M tag=RWP9PWN5Q02S type=write 2024-06-04T15:59:24.291 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.290+0000 7f5e9aacc780 1 > prepared operation key=K01DAK0M4I4M tag=DZ83N4B49RDH type=del size=2549600 2024-06-04T15:59:24.292 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.293+0000 7f5e9aacc780 1 < completed part key=_multipart_UW5LVIBG09SV.2~2DCMTPWNJ7U8.0 size=1048576 2024-06-04T15:59:24.294 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.294+0000 7f5e9aacc780 1 < completed part key=_multipart_UW5LVIBG09SV.2~2DCMTPWNJ7U8.1 size=1048576 2024-06-04T15:59:24.295 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.295+0000 7f5e9aacc780 1 < completed part key=_multipart_UW5LVIBG09SV.2~2DCMTPWNJ7U8.2 size=515492 2024-06-04T15:59:24.298 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.298+0000 7f5e9aacc780 1 < completed multipart upload key=UW5LVIBG09SV upload=2DCMTPWNJ7U8 tag=FL4U00S0JHVN type=write size=3661220 2024-06-04T15:59:24.300 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.299+0000 7f5e9aacc780 1 > prepared operation key=GTRMEQJK675Z tag=GMNJHNVH1UK7 type=del size=3567202 2024-06-04T15:59:24.303 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.302+0000 7f5e9aacc780 1 < suggested remove operation key=4W5HB9WQQHR6 tag=IDEVCJIBP54N type=write 2024-06-04T15:59:24.304 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.304+0000 7f5e9aacc780 1 > prepared operation key=SUBHZJ7HUV3H tag=SS7H3LEIPQRF type=del size=3102204 2024-06-04T15:59:24.306 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.306+0000 7f5e9aacc780 1 < completed delete operation key=2BT2AXKB1RTA tag=5XEPTV482WOZ type=del 2024-06-04T15:59:24.308 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.308+0000 7f5e9aacc780 1 > prepared operation key=XH0N984YVGKP tag=IHROYIVUTGAG type=del size=3023949 2024-06-04T15:59:24.309 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.309+0000 7f5e9aacc780 1 < completed delete operation key=JL69PUHT6NNT tag=85Y9W072IS9Z type=del 2024-06-04T15:59:24.312 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.312+0000 7f5e9aacc780 1 > prepared part key=_multipart_PASGIP872OVX.2~6BBF0G2YGXHI.0 size=604947 2024-06-04T15:59:24.312 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.312+0000 7f5e9aacc780 1 > prepared multipart upload key=PASGIP872OVX upload=6BBF0G2YGXHI tag=YEG3DB47NIGP type=write size=1653523 2024-06-04T15:59:24.314 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.313+0000 7f5e9aacc780 1 < completed part key=_multipart_RP8K6QJUZAH1.2~TMOHCPGVZSY1.0 size=1048576 2024-06-04T15:59:24.315 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.315+0000 7f5e9aacc780 1 < completed part key=_multipart_RP8K6QJUZAH1.2~TMOHCPGVZSY1.1 size=1048576 2024-06-04T15:59:24.316 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.316+0000 7f5e9aacc780 1 < completed part key=_multipart_RP8K6QJUZAH1.2~TMOHCPGVZSY1.2 size=22139 2024-06-04T15:59:24.319 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.319+0000 7f5e9aacc780 1 < completed multipart upload key=RP8K6QJUZAH1 upload=TMOHCPGVZSY1 tag=D5GMJL5931G7 type=write size=3167867 2024-06-04T15:59:24.320 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.320+0000 7f5e9aacc780 1 > prepared operation key=TUGKW7F4V9NO tag=0QADDR29LLB3 type=write size=221023 2024-06-04T15:59:24.322 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.322+0000 7f5e9aacc780 -1 < failed to complete operation key=K01DAK0M4I4M tag=89TIRSBQKONR type=del size=2350490: (22) Invalid argument 2024-06-04T15:59:24.323 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.323+0000 7f5e9aacc780 1 > prepared operation key=9MPRI6LW3956 tag=OK04MOBI6GKN type=del size=2113401 2024-06-04T15:59:24.325 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.325+0000 7f5e9aacc780 1 < canceled operation key=XH0N984YVGKP tag=PGXSB1LZ6PLV type=write size=215279 2024-06-04T15:59:24.327 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.327+0000 7f5e9aacc780 1 > prepared operation key=PASGIP872OVX tag=8AIZ2LO1OH29 type=del size=4138026 2024-06-04T15:59:24.327 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.327+0000 7f5e9aacc780 1 < canceled part key=_multipart_AOCB36Y5Q7B0.2~Y0L2EFN7S8S4.0 size=1048576 2024-06-04T15:59:24.328 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.328+0000 7f5e9aacc780 1 < completed part key=_multipart_AOCB36Y5Q7B0.2~Y0L2EFN7S8S4.1 size=1048576 2024-06-04T15:59:24.330 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.329+0000 7f5e9aacc780 1 < completed part key=_multipart_AOCB36Y5Q7B0.2~Y0L2EFN7S8S4.2 size=493319 2024-06-04T15:59:24.332 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.332+0000 7f5e9aacc780 1 < canceled multipart upload key=AOCB36Y5Q7B0 upload=Y0L2EFN7S8S4 tag=1H69S0JZ6VI9 type=write size=3639047 2024-06-04T15:59:24.334 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.333+0000 7f5e9aacc780 1 > prepared operation key=PCLJXQHJ4HTY tag=Q75UFEUVS2SY type=del size=1261751 2024-06-04T15:59:24.335 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.335+0000 7f5e9aacc780 1 < canceled operation key=RP8K6QJUZAH1 tag=BUIDQD1LYV2X type=del size=3388041 2024-06-04T15:59:24.337 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.336+0000 7f5e9aacc780 1 > prepared operation key=RP8K6QJUZAH1 tag=K2MJX44J09MX type=del size=3738558 2024-06-04T15:59:24.338 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.338+0000 7f5e9aacc780 1 < completed part key=_multipart_GTRMEQJK675Z.2~JLYXKQAWH53P.0 size=1048576 2024-06-04T15:59:24.339 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.339+0000 7f5e9aacc780 1 < completed part key=_multipart_GTRMEQJK675Z.2~JLYXKQAWH53P.1 size=137897 2024-06-04T15:59:24.342 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.342+0000 7f5e9aacc780 1 < completed multipart upload key=GTRMEQJK675Z upload=JLYXKQAWH53P tag=VVER53GJI9FI type=write size=2235049 2024-06-04T15:59:24.345 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.345+0000 7f5e9aacc780 1 > prepared part key=_multipart_JL69PUHT6NNT.2~01W5IVS8QAUO.0 size=1048576 2024-06-04T15:59:24.346 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.346+0000 7f5e9aacc780 1 > prepared part key=_multipart_JL69PUHT6NNT.2~01W5IVS8QAUO.1 size=1043496 2024-06-04T15:59:24.346 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.346+0000 7f5e9aacc780 1 > prepared multipart upload key=JL69PUHT6NNT upload=01W5IVS8QAUO tag=XSCSMMF934QN type=write size=3140648 2024-06-04T15:59:24.347 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.347+0000 7f5e9aacc780 1 < completed write operation key=AOCB36Y5Q7B0 tag=8DQNUTV79708 type=write size=575538 2024-06-04T15:59:24.349 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.348+0000 7f5e9aacc780 1 > prepared operation key=TUGKW7F4V9NO tag=EHYAM9GXMUTB type=del size=2166708 2024-06-04T15:59:24.350 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.350+0000 7f5e9aacc780 1 < completed part key=_multipart_DY9JWHWNAUO1.2~8IPTTS8RV8P4.0 size=1048576 2024-06-04T15:59:24.350 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.350+0000 7f5e9aacc780 1 < canceled part key=_multipart_DY9JWHWNAUO1.2~8IPTTS8RV8P4.1 size=524433 2024-06-04T15:59:24.352 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.352+0000 7f5e9aacc780 1 < canceled multipart upload key=DY9JWHWNAUO1 upload=8IPTTS8RV8P4 tag=4NVP28S1A4MR type=write size=2621585 2024-06-04T15:59:24.354 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.353+0000 7f5e9aacc780 1 > prepared operation key=QJA2JPATITNH tag=SJ9QWOA9NH6A type=del size=4049523 2024-06-04T15:59:24.357 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.356+0000 7f5e9aacc780 1 < suggested update operation key=PNDPO2WUW7UX tag=N3RWRSF57XON type=del size=2091376 2024-06-04T15:59:24.359 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.359+0000 7f5e9aacc780 1 > prepared part key=_multipart_Q4OFQI0F5YLG.2~1QZS7FKMSW9M.0 size=1048576 2024-06-04T15:59:24.360 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.360+0000 7f5e9aacc780 1 > prepared part key=_multipart_Q4OFQI0F5YLG.2~1QZS7FKMSW9M.1 size=1048576 2024-06-04T15:59:24.361 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.361+0000 7f5e9aacc780 1 > prepared part key=_multipart_Q4OFQI0F5YLG.2~1QZS7FKMSW9M.2 size=57150 2024-06-04T15:59:24.361 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.361+0000 7f5e9aacc780 1 > prepared multipart upload key=Q4OFQI0F5YLG upload=1QZS7FKMSW9M tag=IKLMHALRU9ZG type=write size=3202878 2024-06-04T15:59:24.364 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.364+0000 7f5e9aacc780 1 < suggested update operation key=FBV2MAG130M6 tag=JU2X60T5O4HO type=del size=2615314 2024-06-04T15:59:24.366 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.366+0000 7f5e9aacc780 1 > prepared part key=_multipart_Q4OFQI0F5YLG.2~BU4OZ8GW411Z.0 size=1048576 2024-06-04T15:59:24.367 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.367+0000 7f5e9aacc780 1 > prepared part key=_multipart_Q4OFQI0F5YLG.2~BU4OZ8GW411Z.1 size=819943 2024-06-04T15:59:24.367 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.367+0000 7f5e9aacc780 1 > prepared multipart upload key=Q4OFQI0F5YLG upload=BU4OZ8GW411Z tag=924UYY94VUR1 type=write size=2917095 2024-06-04T15:59:24.369 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.368+0000 7f5e9aacc780 1 < completed part key=_multipart_AOCB36Y5Q7B0.2~0JO3D01Y9N3X.0 size=276475 2024-06-04T15:59:24.371 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.371+0000 7f5e9aacc780 1 < completed multipart upload key=AOCB36Y5Q7B0 upload=0JO3D01Y9N3X tag=IBPA44A62N3M type=write size=1325051 2024-06-04T15:59:24.373 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.372+0000 7f5e9aacc780 1 > prepared operation key=2BT2AXKB1RTA tag=KG9066O9VH6T type=del size=2284921 2024-06-04T15:59:24.374 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.374+0000 7f5e9aacc780 1 < canceled operation key=K01DAK0M4I4M tag=DZ83N4B49RDH type=del size=2549600 2024-06-04T15:59:24.376 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.375+0000 7f5e9aacc780 1 > prepared operation key=7S9S3MIG7WIT tag=216MZZW393KF type=del size=2110965 2024-06-04T15:59:24.377 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.377+0000 7f5e9aacc780 1 < completed delete operation key=GTRMEQJK675Z tag=GMNJHNVH1UK7 type=del 2024-06-04T15:59:24.380 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.380+0000 7f5e9aacc780 1 > prepared part key=_multipart_RP8K6QJUZAH1.2~XHC1P5ZAXGWR.0 size=1048576 2024-06-04T15:59:24.381 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.381+0000 7f5e9aacc780 1 > prepared part key=_multipart_RP8K6QJUZAH1.2~XHC1P5ZAXGWR.1 size=210043 2024-06-04T15:59:24.381 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.381+0000 7f5e9aacc780 1 > prepared multipart upload key=RP8K6QJUZAH1 upload=XHC1P5ZAXGWR tag=2SDFRERP60N3 type=write size=2307195 2024-06-04T15:59:24.384 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.384+0000 7f5e9aacc780 1 < suggested update operation key=SUBHZJ7HUV3H tag=SS7H3LEIPQRF type=del size=3102204 2024-06-04T15:59:24.386 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.385+0000 7f5e9aacc780 1 > prepared operation key=9MPRI6LW3956 tag=F0R8E1OGW6BQ type=del size=3300328 2024-06-04T15:59:24.388 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.387+0000 7f5e9aacc780 1 < completed delete operation key=XH0N984YVGKP tag=IHROYIVUTGAG type=del 2024-06-04T15:59:24.390 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.390+0000 7f5e9aacc780 1 > prepared part key=_multipart_FBV2MAG130M6.2~IR1X09JEKT2Z.0 size=269009 2024-06-04T15:59:24.390 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.390+0000 7f5e9aacc780 1 > prepared multipart upload key=FBV2MAG130M6 upload=IR1X09JEKT2Z tag=ODLFTN7UMI04 type=write size=1317585 2024-06-04T15:59:24.391 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.391+0000 7f5e9aacc780 1 < completed part key=_multipart_PASGIP872OVX.2~6BBF0G2YGXHI.0 size=604947 2024-06-04T15:59:24.394 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.393+0000 7f5e9aacc780 1 < completed multipart upload key=PASGIP872OVX upload=6BBF0G2YGXHI tag=YEG3DB47NIGP type=write size=1653523 2024-06-04T15:59:24.396 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.396+0000 7f5e9aacc780 1 > prepared part key=_multipart_NHPH4LYPP0LL.2~KKVT7LCA1D7K.0 size=1048576 2024-06-04T15:59:24.397 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.397+0000 7f5e9aacc780 1 > prepared part key=_multipart_NHPH4LYPP0LL.2~KKVT7LCA1D7K.1 size=1048576 2024-06-04T15:59:24.398 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.398+0000 7f5e9aacc780 1 > prepared part key=_multipart_NHPH4LYPP0LL.2~KKVT7LCA1D7K.2 size=424706 2024-06-04T15:59:24.398 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.398+0000 7f5e9aacc780 1 > prepared multipart upload key=NHPH4LYPP0LL upload=KKVT7LCA1D7K tag=4OJA6LSC3W8K type=write size=3570434 2024-06-04T15:59:24.401 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.401+0000 7f5e9aacc780 1 < suggested update operation key=TUGKW7F4V9NO tag=0QADDR29LLB3 type=write size=221023 2024-06-04T15:59:24.403 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.403+0000 7f5e9aacc780 1 > prepared operation key=UTZHANL9ER2Q tag=2F3B3GQ1GEY1 type=del size=2446611 2024-06-04T15:59:24.404 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.404+0000 7f5e9aacc780 1 < completed delete operation key=9MPRI6LW3956 tag=OK04MOBI6GKN type=del 2024-06-04T15:59:24.406 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.406+0000 7f5e9aacc780 1 > prepared operation key=4W5HB9WQQHR6 tag=1U5VLEYYGNSC type=write size=321555 2024-06-04T15:59:24.409 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.407+0000 7f5e9aacc780 1 < completed delete operation key=PASGIP872OVX tag=8AIZ2LO1OH29 type=del 2024-06-04T15:59:24.409 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.409+0000 7f5e9aacc780 1 > prepared operation key=QJA2JPATITNH tag=6FUBPFPXCSAB type=del size=2887270 2024-06-04T15:59:24.411 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.411+0000 7f5e9aacc780 1 < completed delete operation key=PCLJXQHJ4HTY tag=Q75UFEUVS2SY type=del 2024-06-04T15:59:24.414 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.413+0000 7f5e9aacc780 1 > prepared part key=_multipart_Q4OFQI0F5YLG.2~5TDSL4XS2GB4.0 size=806769 2024-06-04T15:59:24.414 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.413+0000 7f5e9aacc780 1 > prepared multipart upload key=Q4OFQI0F5YLG upload=5TDSL4XS2GB4 tag=43X4RB68WN2C type=write size=1855345 2024-06-04T15:59:24.415 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.415+0000 7f5e9aacc780 1 < canceled operation key=RP8K6QJUZAH1 tag=K2MJX44J09MX type=del size=3738558 2024-06-04T15:59:24.417 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.417+0000 7f5e9aacc780 1 > prepared operation key=XH0N984YVGKP tag=M824EV6ZN6OP type=del size=1744846 2024-06-04T15:59:24.418 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.418+0000 7f5e9aacc780 1 < completed part key=_multipart_JL69PUHT6NNT.2~01W5IVS8QAUO.0 size=1048576 2024-06-04T15:59:24.420 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.419+0000 7f5e9aacc780 1 < completed part key=_multipart_JL69PUHT6NNT.2~01W5IVS8QAUO.1 size=1043496 2024-06-04T15:59:24.422 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.422+0000 7f5e9aacc780 1 < completed multipart upload key=JL69PUHT6NNT upload=01W5IVS8QAUO tag=XSCSMMF934QN type=write size=3140648 2024-06-04T15:59:24.425 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.424+0000 7f5e9aacc780 1 > prepared part key=_multipart_Q4OFQI0F5YLG.2~3NUCO0JH83ZK.0 size=602380 2024-06-04T15:59:24.425 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.424+0000 7f5e9aacc780 1 > prepared multipart upload key=Q4OFQI0F5YLG upload=3NUCO0JH83ZK tag=MXMWGJS192Z0 type=write size=1650956 2024-06-04T15:59:24.426 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.426+0000 7f5e9aacc780 -1 < failed to complete operation key=TUGKW7F4V9NO tag=EHYAM9GXMUTB type=del size=2166708: (22) Invalid argument 2024-06-04T15:59:24.427 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.427+0000 7f5e9aacc780 1 > prepared operation key=B0HK5FJ2RGJE tag=PFG27WV2JICC type=del size=3143493 2024-06-04T15:59:24.429 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.428+0000 7f5e9aacc780 1 < completed delete operation key=QJA2JPATITNH tag=SJ9QWOA9NH6A type=del 2024-06-04T15:59:24.431 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.431+0000 7f5e9aacc780 1 > prepared part key=_multipart_A8O0S3S45RGM.2~7F3GGMW2QQ2L.0 size=512870 2024-06-04T15:59:24.431 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.431+0000 7f5e9aacc780 1 > prepared multipart upload key=A8O0S3S45RGM upload=7F3GGMW2QQ2L tag=3D4ZJJ80U2GJ type=write size=1561446 2024-06-04T15:59:24.432 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.432+0000 7f5e9aacc780 1 < completed part key=_multipart_Q4OFQI0F5YLG.2~1QZS7FKMSW9M.0 size=1048576 2024-06-04T15:59:24.434 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.433+0000 7f5e9aacc780 1 < completed part key=_multipart_Q4OFQI0F5YLG.2~1QZS7FKMSW9M.1 size=1048576 2024-06-04T15:59:24.435 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.434+0000 7f5e9aacc780 1 < completed part key=_multipart_Q4OFQI0F5YLG.2~1QZS7FKMSW9M.2 size=57150 2024-06-04T15:59:24.437 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.437+0000 7f5e9aacc780 1 < completed multipart upload key=Q4OFQI0F5YLG upload=1QZS7FKMSW9M tag=IKLMHALRU9ZG type=write size=3202878 2024-06-04T15:59:24.440 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.440+0000 7f5e9aacc780 1 > prepared part key=_multipart_A8O0S3S45RGM.2~05GY71609EIU.0 size=1048576 2024-06-04T15:59:24.441 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.441+0000 7f5e9aacc780 1 > prepared part key=_multipart_A8O0S3S45RGM.2~05GY71609EIU.1 size=1048576 2024-06-04T15:59:24.442 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.442+0000 7f5e9aacc780 1 > prepared part key=_multipart_A8O0S3S45RGM.2~05GY71609EIU.2 size=1000849 2024-06-04T15:59:24.442 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.442+0000 7f5e9aacc780 1 > prepared multipart upload key=A8O0S3S45RGM upload=05GY71609EIU tag=5LAWV6YTNZ4O type=write size=4146577 2024-06-04T15:59:24.444 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.443+0000 7f5e9aacc780 1 < completed part key=_multipart_Q4OFQI0F5YLG.2~BU4OZ8GW411Z.0 size=1048576 2024-06-04T15:59:24.445 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.445+0000 7f5e9aacc780 1 < completed part key=_multipart_Q4OFQI0F5YLG.2~BU4OZ8GW411Z.1 size=819943 2024-06-04T15:59:24.447 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.447+0000 7f5e9aacc780 1 < completed multipart upload key=Q4OFQI0F5YLG upload=BU4OZ8GW411Z tag=924UYY94VUR1 type=write size=2917095 2024-06-04T15:59:24.449 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.449+0000 7f5e9aacc780 1 > prepared operation key=PCLJXQHJ4HTY tag=7J0Z1OE23IXW type=write size=278768 2024-06-04T15:59:24.450 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.450+0000 7f5e9aacc780 1 < completed delete operation key=2BT2AXKB1RTA tag=KG9066O9VH6T type=del 2024-06-04T15:59:24.452 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.452+0000 7f5e9aacc780 1 > prepared operation key=NJ5U8JTT32QK tag=TGQ6K8U26W99 type=del size=3757899 2024-06-04T15:59:24.453 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.453+0000 7f5e9aacc780 1 < completed delete operation key=7S9S3MIG7WIT tag=216MZZW393KF type=del 2024-06-04T15:59:24.456 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.456+0000 7f5e9aacc780 1 > prepared part key=_multipart_B0HK5FJ2RGJE.2~B5TMO2A8F3II.0 size=178750 2024-06-04T15:59:24.456 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.456+0000 7f5e9aacc780 1 > prepared multipart upload key=B0HK5FJ2RGJE upload=B5TMO2A8F3II tag=QC98JD61IH18 type=write size=1227326 2024-06-04T15:59:24.457 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.457+0000 7f5e9aacc780 1 < completed part key=_multipart_RP8K6QJUZAH1.2~XHC1P5ZAXGWR.0 size=1048576 2024-06-04T15:59:24.458 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.458+0000 7f5e9aacc780 1 < completed part key=_multipart_RP8K6QJUZAH1.2~XHC1P5ZAXGWR.1 size=210043 2024-06-04T15:59:24.461 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.461+0000 7f5e9aacc780 1 < completed multipart upload key=RP8K6QJUZAH1 upload=XHC1P5ZAXGWR tag=2SDFRERP60N3 type=write size=2307195 2024-06-04T15:59:24.463 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.463+0000 7f5e9aacc780 1 > prepared part key=_multipart_K01DAK0M4I4M.2~74LU2BQPL60H.0 size=1048576 2024-06-04T15:59:24.465 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.465+0000 7f5e9aacc780 1 > prepared part key=_multipart_K01DAK0M4I4M.2~74LU2BQPL60H.1 size=1048576 2024-06-04T15:59:24.466 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.465+0000 7f5e9aacc780 1 > prepared part key=_multipart_K01DAK0M4I4M.2~74LU2BQPL60H.2 size=4881 2024-06-04T15:59:24.466 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.465+0000 7f5e9aacc780 1 > prepared multipart upload key=K01DAK0M4I4M upload=74LU2BQPL60H tag=F0KQ2U4UFXDM type=write size=3150609 2024-06-04T15:59:24.469 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.469+0000 7f5e9aacc780 1 < suggested update operation key=9MPRI6LW3956 tag=F0R8E1OGW6BQ type=del size=3300328 2024-06-04T15:59:24.472 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.471+0000 7f5e9aacc780 1 > prepared part key=_multipart_1IKNQXU3Y2JJ.2~T5N8BS82QAOZ.0 size=1048576 2024-06-04T15:59:24.473 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.472+0000 7f5e9aacc780 1 > prepared part key=_multipart_1IKNQXU3Y2JJ.2~T5N8BS82QAOZ.1 size=796141 2024-06-04T15:59:24.473 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.472+0000 7f5e9aacc780 1 > prepared multipart upload key=1IKNQXU3Y2JJ upload=T5N8BS82QAOZ tag=6TB35OJEOZLL type=write size=2893293 2024-06-04T15:59:24.473 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.473+0000 7f5e9aacc780 1 < canceled part key=_multipart_FBV2MAG130M6.2~IR1X09JEKT2Z.0 size=269009 2024-06-04T15:59:24.476 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.476+0000 7f5e9aacc780 1 < canceled multipart upload key=FBV2MAG130M6 upload=IR1X09JEKT2Z tag=ODLFTN7UMI04 type=write size=1317585 2024-06-04T15:59:24.478 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.477+0000 7f5e9aacc780 1 > prepared operation key=UW5LVIBG09SV tag=FCOVYCISCY8W type=del size=1158638 2024-06-04T15:59:24.479 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.479+0000 7f5e9aacc780 1 < completed part key=_multipart_NHPH4LYPP0LL.2~KKVT7LCA1D7K.0 size=1048576 2024-06-04T15:59:24.480 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.480+0000 7f5e9aacc780 1 < completed part key=_multipart_NHPH4LYPP0LL.2~KKVT7LCA1D7K.1 size=1048576 2024-06-04T15:59:24.481 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.481+0000 7f5e9aacc780 1 < completed part key=_multipart_NHPH4LYPP0LL.2~KKVT7LCA1D7K.2 size=424706 2024-06-04T15:59:24.484 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.484+0000 7f5e9aacc780 1 < completed multipart upload key=NHPH4LYPP0LL upload=KKVT7LCA1D7K tag=4OJA6LSC3W8K type=write size=3570434 2024-06-04T15:59:24.485 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.485+0000 7f5e9aacc780 1 > prepared operation key=03ZNYG3WLMP4 tag=VCN7A8V0G4LF type=del size=94044 2024-06-04T15:59:24.488 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.488+0000 7f5e9aacc780 1 < suggested update operation key=UTZHANL9ER2Q tag=2F3B3GQ1GEY1 type=del size=2446611 2024-06-04T15:59:24.491 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.490+0000 7f5e9aacc780 1 > prepared operation key=QUIVPH3OB6KN tag=3A17O3CJQGKB type=del size=428068 2024-06-04T15:59:24.492 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.492+0000 7f5e9aacc780 1 < completed write operation key=4W5HB9WQQHR6 tag=1U5VLEYYGNSC type=write size=321555 2024-06-04T15:59:24.494 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.493+0000 7f5e9aacc780 1 > prepared operation key=K01DAK0M4I4M tag=2OG8EJJU7OEC type=del size=638504 2024-06-04T15:59:24.495 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.495+0000 7f5e9aacc780 1 < completed delete operation key=QJA2JPATITNH tag=6FUBPFPXCSAB type=del 2024-06-04T15:59:24.496 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.496+0000 7f5e9aacc780 1 > prepared operation key=UW5LVIBG09SV tag=5H7KMCA9I92F type=del size=207997 2024-06-04T15:59:24.498 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.498+0000 7f5e9aacc780 1 < completed part key=_multipart_Q4OFQI0F5YLG.2~5TDSL4XS2GB4.0 size=806769 2024-06-04T15:59:24.500 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.500+0000 7f5e9aacc780 1 < completed multipart upload key=Q4OFQI0F5YLG upload=5TDSL4XS2GB4 tag=43X4RB68WN2C type=write size=1855345 2024-06-04T15:59:24.501 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.501+0000 7f5e9aacc780 1 > prepared operation key=UTZHANL9ER2Q tag=OMN2TGW4BUM6 type=write size=20101 2024-06-04T15:59:24.503 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.503+0000 7f5e9aacc780 1 < completed delete operation key=XH0N984YVGKP tag=M824EV6ZN6OP type=del 2024-06-04T15:59:24.504 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.504+0000 7f5e9aacc780 1 > prepared operation key=SUBHZJ7HUV3H tag=8XTMVAFGU412 type=write size=959619 2024-06-04T15:59:24.506 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.505+0000 7f5e9aacc780 1 < completed part key=_multipart_Q4OFQI0F5YLG.2~3NUCO0JH83ZK.0 size=602380 2024-06-04T15:59:24.508 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.508+0000 7f5e9aacc780 1 < completed multipart upload key=Q4OFQI0F5YLG upload=3NUCO0JH83ZK tag=MXMWGJS192Z0 type=write size=1650956 2024-06-04T15:59:24.510 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.510+0000 7f5e9aacc780 1 > prepared part key=_multipart_UTZHANL9ER2Q.2~K6PCSM4DAXOM.0 size=1048576 2024-06-04T15:59:24.512 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.512+0000 7f5e9aacc780 1 > prepared part key=_multipart_UTZHANL9ER2Q.2~K6PCSM4DAXOM.1 size=277938 2024-06-04T15:59:24.512 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.512+0000 7f5e9aacc780 1 > prepared multipart upload key=UTZHANL9ER2Q upload=K6PCSM4DAXOM tag=NEAWX3IDOYZ1 type=write size=2375090 2024-06-04T15:59:24.513 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.513+0000 7f5e9aacc780 1 < completed delete operation key=B0HK5FJ2RGJE tag=PFG27WV2JICC type=del 2024-06-04T15:59:24.515 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.515+0000 7f5e9aacc780 1 > prepared operation key=RP8K6QJUZAH1 tag=FBV8GAKNSZY0 type=write size=586446 2024-06-04T15:59:24.516 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.516+0000 7f5e9aacc780 1 < completed part key=_multipart_A8O0S3S45RGM.2~7F3GGMW2QQ2L.0 size=512870 2024-06-04T15:59:24.519 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.518+0000 7f5e9aacc780 1 < completed multipart upload key=A8O0S3S45RGM upload=7F3GGMW2QQ2L tag=3D4ZJJ80U2GJ type=write size=1561446 2024-06-04T15:59:24.522 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.521+0000 7f5e9aacc780 1 > prepared part key=_multipart_7S9S3MIG7WIT.2~MKQ8SLKTQMVE.0 size=1048576 2024-06-04T15:59:24.523 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.522+0000 7f5e9aacc780 1 > prepared part key=_multipart_7S9S3MIG7WIT.2~MKQ8SLKTQMVE.1 size=1048576 2024-06-04T15:59:24.524 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.523+0000 7f5e9aacc780 1 > prepared part key=_multipart_7S9S3MIG7WIT.2~MKQ8SLKTQMVE.2 size=271885 2024-06-04T15:59:24.524 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.523+0000 7f5e9aacc780 1 > prepared multipart upload key=7S9S3MIG7WIT upload=MKQ8SLKTQMVE tag=7XK332ND8JSD type=write size=3417613 2024-06-04T15:59:24.525 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.525+0000 7f5e9aacc780 1 < completed part key=_multipart_A8O0S3S45RGM.2~05GY71609EIU.0 size=1048576 2024-06-04T15:59:24.526 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.526+0000 7f5e9aacc780 1 < completed part key=_multipart_A8O0S3S45RGM.2~05GY71609EIU.1 size=1048576 2024-06-04T15:59:24.527 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.527+0000 7f5e9aacc780 1 < completed part key=_multipart_A8O0S3S45RGM.2~05GY71609EIU.2 size=1000849 2024-06-04T15:59:24.529 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.529+0000 7f5e9aacc780 1 < completed multipart upload key=A8O0S3S45RGM upload=05GY71609EIU tag=5LAWV6YTNZ4O type=write size=4146577 2024-06-04T15:59:24.531 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.530+0000 7f5e9aacc780 1 > prepared operation key=K01DAK0M4I4M tag=1R3WARZTVAO2 type=del size=345420 2024-06-04T15:59:24.532 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.532+0000 7f5e9aacc780 1 < completed write operation key=PCLJXQHJ4HTY tag=7J0Z1OE23IXW type=write size=278768 2024-06-04T15:59:24.534 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.534+0000 7f5e9aacc780 1 > prepared part key=_multipart_A8O0S3S45RGM.2~68M98TKLMBBH.0 size=536222 2024-06-04T15:59:24.534 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.534+0000 7f5e9aacc780 1 > prepared multipart upload key=A8O0S3S45RGM upload=68M98TKLMBBH tag=6DLNJZTITDF0 type=write size=1584798 2024-06-04T15:59:24.535 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.535+0000 7f5e9aacc780 1 < canceled operation key=NJ5U8JTT32QK tag=TGQ6K8U26W99 type=del size=3757899 2024-06-04T15:59:24.538 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.538+0000 7f5e9aacc780 1 > prepared part key=_multipart_UW5LVIBG09SV.2~JUEKC2Y01YUZ.0 size=1048576 2024-06-04T15:59:24.539 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.539+0000 7f5e9aacc780 1 > prepared part key=_multipart_UW5LVIBG09SV.2~JUEKC2Y01YUZ.1 size=95649 2024-06-04T15:59:24.539 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.539+0000 7f5e9aacc780 1 > prepared multipart upload key=UW5LVIBG09SV upload=JUEKC2Y01YUZ tag=LTLCL7C1OGFR type=write size=2192801 2024-06-04T15:59:24.540 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.540+0000 7f5e9aacc780 1 < completed part key=_multipart_B0HK5FJ2RGJE.2~B5TMO2A8F3II.0 size=178750 2024-06-04T15:59:24.542 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.542+0000 7f5e9aacc780 1 < completed multipart upload key=B0HK5FJ2RGJE upload=B5TMO2A8F3II tag=QC98JD61IH18 type=write size=1227326 2024-06-04T15:59:24.543 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.543+0000 7f5e9aacc780 1 > prepared operation key=W1T4O3EAE7JN tag=OSC45OV1Q961 type=del size=1616998 2024-06-04T15:59:24.545 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.545+0000 7f5e9aacc780 1 < completed part key=_multipart_K01DAK0M4I4M.2~74LU2BQPL60H.0 size=1048576 2024-06-04T15:59:24.546 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.546+0000 7f5e9aacc780 1 < completed part key=_multipart_K01DAK0M4I4M.2~74LU2BQPL60H.1 size=1048576 2024-06-04T15:59:24.547 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.547+0000 7f5e9aacc780 1 < completed part key=_multipart_K01DAK0M4I4M.2~74LU2BQPL60H.2 size=4881 2024-06-04T15:59:24.549 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.549+0000 7f5e9aacc780 1 < completed multipart upload key=K01DAK0M4I4M upload=74LU2BQPL60H tag=F0KQ2U4UFXDM type=write size=3150609 2024-06-04T15:59:24.550 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.550+0000 7f5e9aacc780 1 > prepared operation key=1IKNQXU3Y2JJ tag=KGUHRVMMF1LW type=del size=2459266 2024-06-04T15:59:24.551 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.551+0000 7f5e9aacc780 1 < completed part key=_multipart_1IKNQXU3Y2JJ.2~T5N8BS82QAOZ.0 size=1048576 2024-06-04T15:59:24.553 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.553+0000 7f5e9aacc780 1 < completed part key=_multipart_1IKNQXU3Y2JJ.2~T5N8BS82QAOZ.1 size=796141 2024-06-04T15:59:24.555 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.555+0000 7f5e9aacc780 1 < completed multipart upload key=1IKNQXU3Y2JJ upload=T5N8BS82QAOZ tag=6TB35OJEOZLL type=write size=2893293 2024-06-04T15:59:24.558 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.557+0000 7f5e9aacc780 1 > prepared part key=_multipart_SUBHZJ7HUV3H.2~WOFUO6GJPVEP.0 size=1048576 2024-06-04T15:59:24.558 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.558+0000 7f5e9aacc780 1 > prepared part key=_multipart_SUBHZJ7HUV3H.2~WOFUO6GJPVEP.1 size=1048576 2024-06-04T15:59:24.560 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.559+0000 7f5e9aacc780 1 > prepared part key=_multipart_SUBHZJ7HUV3H.2~WOFUO6GJPVEP.2 size=346249 2024-06-04T15:59:24.560 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.559+0000 7f5e9aacc780 1 > prepared multipart upload key=SUBHZJ7HUV3H upload=WOFUO6GJPVEP tag=2ZLSA6HXKYIR type=write size=3491977 2024-06-04T15:59:24.561 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.561+0000 7f5e9aacc780 1 < completed delete operation key=UW5LVIBG09SV tag=FCOVYCISCY8W type=del 2024-06-04T15:59:24.562 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.562+0000 7f5e9aacc780 1 > prepared operation key=W1T4O3EAE7JN tag=2L7PU8Y82P7S type=del size=1854500 2024-06-04T15:59:24.564 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.563+0000 7f5e9aacc780 1 < completed delete operation key=03ZNYG3WLMP4 tag=VCN7A8V0G4LF type=del 2024-06-04T15:59:24.566 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.566+0000 7f5e9aacc780 1 > prepared part key=_multipart_HD6SNICRCDLL.2~9NP2Z38GV2R4.0 size=1048576 2024-06-04T15:59:24.567 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.567+0000 7f5e9aacc780 1 > prepared part key=_multipart_HD6SNICRCDLL.2~9NP2Z38GV2R4.1 size=699955 2024-06-04T15:59:24.567 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.567+0000 7f5e9aacc780 1 > prepared multipart upload key=HD6SNICRCDLL upload=9NP2Z38GV2R4 tag=EFVBA8A9NYFM type=write size=2797107 2024-06-04T15:59:24.569 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.568+0000 7f5e9aacc780 1 < completed delete operation key=QUIVPH3OB6KN tag=3A17O3CJQGKB type=del 2024-06-04T15:59:24.571 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.571+0000 7f5e9aacc780 1 > prepared part key=_multipart_Q4OFQI0F5YLG.2~1KHYYYG51AYM.0 size=982363 2024-06-04T15:59:24.571 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.571+0000 7f5e9aacc780 1 > prepared multipart upload key=Q4OFQI0F5YLG upload=1KHYYYG51AYM tag=1LQO7AM7YUYQ type=write size=2030939 2024-06-04T15:59:24.574 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.573+0000 7f5e9aacc780 1 < suggested remove operation key=K01DAK0M4I4M tag=2OG8EJJU7OEC type=del 2024-06-04T15:59:24.575 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.575+0000 7f5e9aacc780 1 > prepared operation key=GCPC9OJH7KWU tag=JTKBUBW3KMIO type=del size=2735987 2024-06-04T15:59:24.576 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.576+0000 7f5e9aacc780 1 < completed delete operation key=UW5LVIBG09SV tag=5H7KMCA9I92F type=del 2024-06-04T15:59:24.579 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.579+0000 7f5e9aacc780 1 > prepared part key=_multipart_PCLJXQHJ4HTY.2~Z7I32HDGVW0W.0 size=1048576 2024-06-04T15:59:24.581 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.580+0000 7f5e9aacc780 1 > prepared part key=_multipart_PCLJXQHJ4HTY.2~Z7I32HDGVW0W.1 size=1048576 2024-06-04T15:59:24.582 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.581+0000 7f5e9aacc780 1 > prepared part key=_multipart_PCLJXQHJ4HTY.2~Z7I32HDGVW0W.2 size=506902 2024-06-04T15:59:24.582 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.581+0000 7f5e9aacc780 1 > prepared multipart upload key=PCLJXQHJ4HTY upload=Z7I32HDGVW0W tag=7BOXG163JIMI type=write size=3652630 2024-06-04T15:59:24.583 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.583+0000 7f5e9aacc780 1 < completed write operation key=UTZHANL9ER2Q tag=OMN2TGW4BUM6 type=write size=20101 2024-06-04T15:59:24.584 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.584+0000 7f5e9aacc780 1 > prepared operation key=JL69PUHT6NNT tag=B23IKH31Q2CC type=del size=1464987 2024-06-04T15:59:24.586 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.586+0000 7f5e9aacc780 1 < completed write operation key=SUBHZJ7HUV3H tag=8XTMVAFGU412 type=write size=959619 2024-06-04T15:59:24.587 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.587+0000 7f5e9aacc780 1 > prepared operation key=B0HK5FJ2RGJE tag=GK4KC5WHJKE6 type=del size=3588558 2024-06-04T15:59:24.589 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.588+0000 7f5e9aacc780 1 < completed part key=_multipart_UTZHANL9ER2Q.2~K6PCSM4DAXOM.0 size=1048576 2024-06-04T15:59:24.590 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.590+0000 7f5e9aacc780 1 < completed part key=_multipart_UTZHANL9ER2Q.2~K6PCSM4DAXOM.1 size=277938 2024-06-04T15:59:24.592 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.592+0000 7f5e9aacc780 1 < completed multipart upload key=UTZHANL9ER2Q upload=K6PCSM4DAXOM tag=NEAWX3IDOYZ1 type=write size=2375090 2024-06-04T15:59:24.594 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.593+0000 7f5e9aacc780 1 > prepared operation key=1IKNQXU3Y2JJ tag=W3848JLLBPYW type=del size=2421522 2024-06-04T15:59:24.595 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.595+0000 7f5e9aacc780 1 < completed write operation key=RP8K6QJUZAH1 tag=FBV8GAKNSZY0 type=write size=586446 2024-06-04T15:59:24.597 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.597+0000 7f5e9aacc780 1 > prepared operation key=PASGIP872OVX tag=FYAFHJZ1LO1A type=write size=728307 2024-06-04T15:59:24.599 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.598+0000 7f5e9aacc780 1 < completed part key=_multipart_7S9S3MIG7WIT.2~MKQ8SLKTQMVE.0 size=1048576 2024-06-04T15:59:24.599 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.599+0000 7f5e9aacc780 1 < canceled part key=_multipart_7S9S3MIG7WIT.2~MKQ8SLKTQMVE.1 size=1048576 2024-06-04T15:59:24.600 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.600+0000 7f5e9aacc780 1 < completed part key=_multipart_7S9S3MIG7WIT.2~MKQ8SLKTQMVE.2 size=271885 2024-06-04T15:59:24.602 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.602+0000 7f5e9aacc780 1 < canceled multipart upload key=7S9S3MIG7WIT upload=MKQ8SLKTQMVE tag=7XK332ND8JSD type=write size=3417613 2024-06-04T15:59:24.606 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.606+0000 7f5e9aacc780 1 > prepared part key=_multipart_PASGIP872OVX.2~U5DJHUT7UC8J.0 size=1048576 2024-06-04T15:59:24.607 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.607+0000 7f5e9aacc780 1 > prepared part key=_multipart_PASGIP872OVX.2~U5DJHUT7UC8J.1 size=573572 2024-06-04T15:59:24.607 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.607+0000 7f5e9aacc780 1 > prepared multipart upload key=PASGIP872OVX upload=U5DJHUT7UC8J tag=35DEEJKYKNH3 type=write size=2670724 2024-06-04T15:59:24.608 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.608+0000 7f5e9aacc780 -1 < failed to complete operation key=K01DAK0M4I4M tag=1R3WARZTVAO2 type=del size=345420: (22) Invalid argument 2024-06-04T15:59:24.610 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.610+0000 7f5e9aacc780 1 > prepared operation key=JL69PUHT6NNT tag=LWNMFKEC1BSC type=del size=3199346 2024-06-04T15:59:24.610 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.610+0000 7f5e9aacc780 1 < canceled part key=_multipart_A8O0S3S45RGM.2~68M98TKLMBBH.0 size=536222 2024-06-04T15:59:24.613 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.612+0000 7f5e9aacc780 1 < canceled multipart upload key=A8O0S3S45RGM upload=68M98TKLMBBH tag=6DLNJZTITDF0 type=write size=1584798 2024-06-04T15:59:24.614 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.614+0000 7f5e9aacc780 1 > prepared operation key=DY9JWHWNAUO1 tag=4UMKTWEVXXN6 type=del size=3084741 2024-06-04T15:59:24.616 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.615+0000 7f5e9aacc780 1 < completed part key=_multipart_UW5LVIBG09SV.2~JUEKC2Y01YUZ.0 size=1048576 2024-06-04T15:59:24.617 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.616+0000 7f5e9aacc780 1 < completed part key=_multipart_UW5LVIBG09SV.2~JUEKC2Y01YUZ.1 size=95649 2024-06-04T15:59:24.619 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.619+0000 7f5e9aacc780 1 < completed multipart upload key=UW5LVIBG09SV upload=JUEKC2Y01YUZ tag=LTLCL7C1OGFR type=write size=2192801 2024-06-04T15:59:24.621 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.621+0000 7f5e9aacc780 1 > prepared operation key=UW5LVIBG09SV tag=ULOFCITES0T3 type=del size=467889 2024-06-04T15:59:24.624 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.624+0000 7f5e9aacc780 1 < suggested remove operation key=W1T4O3EAE7JN tag=OSC45OV1Q961 type=del 2024-06-04T15:59:24.626 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.625+0000 7f5e9aacc780 1 > prepared operation key=JL69PUHT6NNT tag=FH9BJC21DQEY type=del size=981400 2024-06-04T15:59:24.627 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.627+0000 7f5e9aacc780 1 < completed delete operation key=1IKNQXU3Y2JJ tag=KGUHRVMMF1LW type=del 2024-06-04T15:59:24.628 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.628+0000 7f5e9aacc780 1 > prepared operation key=QJA2JPATITNH tag=09GTWEWJJP9A type=del size=2651390 2024-06-04T15:59:24.630 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.630+0000 7f5e9aacc780 1 < completed part key=_multipart_SUBHZJ7HUV3H.2~WOFUO6GJPVEP.0 size=1048576 2024-06-04T15:59:24.631 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.631+0000 7f5e9aacc780 1 < completed part key=_multipart_SUBHZJ7HUV3H.2~WOFUO6GJPVEP.1 size=1048576 2024-06-04T15:59:24.632 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.632+0000 7f5e9aacc780 1 < completed part key=_multipart_SUBHZJ7HUV3H.2~WOFUO6GJPVEP.2 size=346249 2024-06-04T15:59:24.634 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.634+0000 7f5e9aacc780 1 < completed multipart upload key=SUBHZJ7HUV3H upload=WOFUO6GJPVEP tag=2ZLSA6HXKYIR type=write size=3491977 2024-06-04T15:59:24.636 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.635+0000 7f5e9aacc780 1 > prepared operation key=PASGIP872OVX tag=AD5GJMJXLZTV type=write size=174993 2024-06-04T15:59:24.637 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.637+0000 7f5e9aacc780 -1 < failed to complete operation key=W1T4O3EAE7JN tag=2L7PU8Y82P7S type=del size=1854500: (22) Invalid argument 2024-06-04T15:59:24.638 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.638+0000 7f5e9aacc780 1 > prepared operation key=RP8K6QJUZAH1 tag=OWD03FZQQ552 type=del size=233534 2024-06-04T15:59:24.640 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.639+0000 7f5e9aacc780 1 < completed part key=_multipart_HD6SNICRCDLL.2~9NP2Z38GV2R4.0 size=1048576 2024-06-04T15:59:24.641 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.640+0000 7f5e9aacc780 1 < completed part key=_multipart_HD6SNICRCDLL.2~9NP2Z38GV2R4.1 size=699955 2024-06-04T15:59:24.643 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.643+0000 7f5e9aacc780 1 < completed multipart upload key=HD6SNICRCDLL upload=9NP2Z38GV2R4 tag=EFVBA8A9NYFM type=write size=2797107 2024-06-04T15:59:24.646 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.645+0000 7f5e9aacc780 1 > prepared part key=_multipart_4W5HB9WQQHR6.2~PJP7WTR1K36H.0 size=53319 2024-06-04T15:59:24.646 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.645+0000 7f5e9aacc780 1 > prepared multipart upload key=4W5HB9WQQHR6 upload=PJP7WTR1K36H tag=G8IRULIG9L00 type=write size=1101895 2024-06-04T15:59:24.647 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.647+0000 7f5e9aacc780 1 < completed part key=_multipart_Q4OFQI0F5YLG.2~1KHYYYG51AYM.0 size=982363 2024-06-04T15:59:24.650 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.649+0000 7f5e9aacc780 1 < completed multipart upload key=Q4OFQI0F5YLG upload=1KHYYYG51AYM tag=1LQO7AM7YUYQ type=write size=2030939 2024-06-04T15:59:24.651 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.651+0000 7f5e9aacc780 1 > prepared operation key=UW5LVIBG09SV tag=GZSDJF12F0IJ type=del size=3511120 2024-06-04T15:59:24.653 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.652+0000 7f5e9aacc780 1 < completed delete operation key=GCPC9OJH7KWU tag=JTKBUBW3KMIO type=del 2024-06-04T15:59:24.655 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.654+0000 7f5e9aacc780 1 > prepared operation key=9MPRI6LW3956 tag=EAB8QWSZIJ7R type=del size=3550924 2024-06-04T15:59:24.656 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.656+0000 7f5e9aacc780 1 < completed part key=_multipart_PCLJXQHJ4HTY.2~Z7I32HDGVW0W.0 size=1048576 2024-06-04T15:59:24.657 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.657+0000 7f5e9aacc780 1 < completed part key=_multipart_PCLJXQHJ4HTY.2~Z7I32HDGVW0W.1 size=1048576 2024-06-04T15:59:24.658 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.658+0000 7f5e9aacc780 1 < completed part key=_multipart_PCLJXQHJ4HTY.2~Z7I32HDGVW0W.2 size=506902 2024-06-04T15:59:24.661 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.661+0000 7f5e9aacc780 1 < completed multipart upload key=PCLJXQHJ4HTY upload=Z7I32HDGVW0W tag=7BOXG163JIMI type=write size=3652630 2024-06-04T15:59:24.662 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.662+0000 7f5e9aacc780 1 > prepared operation key=1IKNQXU3Y2JJ tag=49L29EGGZKQ6 type=del size=1441848 2024-06-04T15:59:24.664 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.664+0000 7f5e9aacc780 1 < completed delete operation key=JL69PUHT6NNT tag=B23IKH31Q2CC type=del 2024-06-04T15:59:24.667 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.666+0000 7f5e9aacc780 1 > prepared part key=_multipart_PCLJXQHJ4HTY.2~B3V6WV1NP998.0 size=1048576 2024-06-04T15:59:24.668 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.667+0000 7f5e9aacc780 1 > prepared part key=_multipart_PCLJXQHJ4HTY.2~B3V6WV1NP998.1 size=1048576 2024-06-04T15:59:24.669 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.669+0000 7f5e9aacc780 1 > prepared part key=_multipart_PCLJXQHJ4HTY.2~B3V6WV1NP998.2 size=242431 2024-06-04T15:59:24.669 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.669+0000 7f5e9aacc780 1 > prepared multipart upload key=PCLJXQHJ4HTY upload=B3V6WV1NP998 tag=1A2MD2F86KRD type=write size=3388159 2024-06-04T15:59:24.672 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.672+0000 7f5e9aacc780 1 < suggested update operation key=B0HK5FJ2RGJE tag=GK4KC5WHJKE6 type=del size=3588558 2024-06-04T15:59:24.675 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.675+0000 7f5e9aacc780 1 > prepared part key=_multipart_XH0N984YVGKP.2~3XNZNX4AEF7P.0 size=1048576 2024-06-04T15:59:24.676 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.676+0000 7f5e9aacc780 1 > prepared part key=_multipart_XH0N984YVGKP.2~3XNZNX4AEF7P.1 size=243031 2024-06-04T15:59:24.676 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.676+0000 7f5e9aacc780 1 > prepared multipart upload key=XH0N984YVGKP upload=3XNZNX4AEF7P tag=PCNCXT2VTM20 type=write size=2340183 2024-06-04T15:59:24.678 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.678+0000 7f5e9aacc780 1 < canceled operation key=1IKNQXU3Y2JJ tag=W3848JLLBPYW type=del size=2421522 2024-06-04T15:59:24.680 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.679+0000 7f5e9aacc780 1 > prepared operation key=SUBHZJ7HUV3H tag=7IN5X2OEE3VA type=del size=2779253 2024-06-04T15:59:24.681 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.681+0000 7f5e9aacc780 1 < completed write operation key=PASGIP872OVX tag=FYAFHJZ1LO1A type=write size=728307 2024-06-04T15:59:24.684 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.684+0000 7f5e9aacc780 1 > prepared part key=_multipart_HD6SNICRCDLL.2~PFYNPQUDF4ZG.0 size=1048576 2024-06-04T15:59:24.685 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.685+0000 7f5e9aacc780 1 > prepared part key=_multipart_HD6SNICRCDLL.2~PFYNPQUDF4ZG.1 size=41647 2024-06-04T15:59:24.685 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.685+0000 7f5e9aacc780 1 > prepared multipart upload key=HD6SNICRCDLL upload=PFYNPQUDF4ZG tag=HGNN7Q2HPWEP type=write size=2138799 2024-06-04T15:59:24.686 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.686+0000 7f5e9aacc780 1 < completed part key=_multipart_PASGIP872OVX.2~U5DJHUT7UC8J.0 size=1048576 2024-06-04T15:59:24.687 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.687+0000 7f5e9aacc780 1 < completed part key=_multipart_PASGIP872OVX.2~U5DJHUT7UC8J.1 size=573572 2024-06-04T15:59:24.690 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.690+0000 7f5e9aacc780 1 < completed multipart upload key=PASGIP872OVX upload=U5DJHUT7UC8J tag=35DEEJKYKNH3 type=write size=2670724 2024-06-04T15:59:24.691 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.691+0000 7f5e9aacc780 1 > prepared operation key=Q4OFQI0F5YLG tag=CRG01RMSPGTU type=del size=2937345 2024-06-04T15:59:24.694 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.693+0000 7f5e9aacc780 1 < suggested remove operation key=JL69PUHT6NNT tag=LWNMFKEC1BSC type=del 2024-06-04T15:59:24.695 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.695+0000 7f5e9aacc780 1 > prepared operation key=03ZNYG3WLMP4 tag=JD1GF3HY25L7 type=del size=102026 2024-06-04T15:59:24.696 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.697+0000 7f5e9aacc780 1 < canceled operation key=DY9JWHWNAUO1 tag=4UMKTWEVXXN6 type=del size=3084741 2024-06-04T15:59:24.699 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.699+0000 7f5e9aacc780 1 > prepared part key=_multipart_Q4OFQI0F5YLG.2~SVERF3V7P8L2.0 size=1048576 2024-06-04T15:59:24.700 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.700+0000 7f5e9aacc780 1 > prepared part key=_multipart_Q4OFQI0F5YLG.2~SVERF3V7P8L2.1 size=1048576 2024-06-04T15:59:24.701 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.701+0000 7f5e9aacc780 1 > prepared part key=_multipart_Q4OFQI0F5YLG.2~SVERF3V7P8L2.2 size=191755 2024-06-04T15:59:24.701 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.701+0000 7f5e9aacc780 1 > prepared multipart upload key=Q4OFQI0F5YLG upload=SVERF3V7P8L2 tag=4ML717XO0ZXK type=write size=3337483 2024-06-04T15:59:24.703 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.702+0000 7f5e9aacc780 1 < completed delete operation key=UW5LVIBG09SV tag=ULOFCITES0T3 type=del 2024-06-04T15:59:24.705 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.705+0000 7f5e9aacc780 1 > prepared part key=_multipart_NJ5U8JTT32QK.2~1Z6KB5ZI352W.0 size=1048576 2024-06-04T15:59:24.706 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.706+0000 7f5e9aacc780 1 > prepared part key=_multipart_NJ5U8JTT32QK.2~1Z6KB5ZI352W.1 size=1048576 2024-06-04T15:59:24.707 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.707+0000 7f5e9aacc780 1 > prepared part key=_multipart_NJ5U8JTT32QK.2~1Z6KB5ZI352W.2 size=537714 2024-06-04T15:59:24.707 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.707+0000 7f5e9aacc780 1 > prepared multipart upload key=NJ5U8JTT32QK upload=1Z6KB5ZI352W tag=GYLZGU4ZEPAE type=write size=3683442 2024-06-04T15:59:24.709 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.708+0000 7f5e9aacc780 -1 < failed to complete operation key=JL69PUHT6NNT tag=FH9BJC21DQEY type=del size=981400: (22) Invalid argument 2024-06-04T15:59:24.711 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.711+0000 7f5e9aacc780 1 > prepared part key=_multipart_1IKNQXU3Y2JJ.2~C93FW0E2D0WP.0 size=1048576 2024-06-04T15:59:24.712 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.712+0000 7f5e9aacc780 1 > prepared part key=_multipart_1IKNQXU3Y2JJ.2~C93FW0E2D0WP.1 size=612848 2024-06-04T15:59:24.712 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.712+0000 7f5e9aacc780 1 > prepared multipart upload key=1IKNQXU3Y2JJ upload=C93FW0E2D0WP tag=NP6AVLHU2ZU6 type=write size=2710000 2024-06-04T15:59:24.713 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.713+0000 7f5e9aacc780 1 < canceled operation key=QJA2JPATITNH tag=09GTWEWJJP9A type=del size=2651390 2024-06-04T15:59:24.716 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.716+0000 7f5e9aacc780 1 > prepared part key=_multipart_Q4OFQI0F5YLG.2~YQ1NYPI0560I.0 size=468445 2024-06-04T15:59:24.716 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.716+0000 7f5e9aacc780 1 > prepared multipart upload key=Q4OFQI0F5YLG upload=YQ1NYPI0560I tag=090M1CEZHM9Z type=write size=1517021 2024-06-04T15:59:24.717 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.717+0000 7f5e9aacc780 1 < completed write operation key=PASGIP872OVX tag=AD5GJMJXLZTV type=write size=174993 2024-06-04T15:59:24.720 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.720+0000 7f5e9aacc780 1 > prepared part key=_multipart_W1T4O3EAE7JN.2~GL072G2SRO8D.0 size=1048576 2024-06-04T15:59:24.721 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.721+0000 7f5e9aacc780 1 > prepared part key=_multipart_W1T4O3EAE7JN.2~GL072G2SRO8D.1 size=280194 2024-06-04T15:59:24.721 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.721+0000 7f5e9aacc780 1 > prepared multipart upload key=W1T4O3EAE7JN upload=GL072G2SRO8D tag=MEFXJISM791O type=write size=2377346 2024-06-04T15:59:24.723 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.722+0000 7f5e9aacc780 1 < completed delete operation key=RP8K6QJUZAH1 tag=OWD03FZQQ552 type=del 2024-06-04T15:59:24.724 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.724+0000 7f5e9aacc780 1 > prepared operation key=FBV2MAG130M6 tag=PTCAPTAHH5WG type=del size=1794459 2024-06-04T15:59:24.726 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.725+0000 7f5e9aacc780 1 < completed part key=_multipart_4W5HB9WQQHR6.2~PJP7WTR1K36H.0 size=53319 2024-06-04T15:59:24.727 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.727+0000 7f5e9aacc780 1 < completed multipart upload key=4W5HB9WQQHR6 upload=PJP7WTR1K36H tag=G8IRULIG9L00 type=write size=1101895 2024-06-04T15:59:24.729 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.729+0000 7f5e9aacc780 1 > prepared operation key=RP8K6QJUZAH1 tag=ID3GCJOX10TD type=del size=1791191 2024-06-04T15:59:24.730 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.730+0000 7f5e9aacc780 1 < completed delete operation key=UW5LVIBG09SV tag=GZSDJF12F0IJ type=del 2024-06-04T15:59:24.733 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.733+0000 7f5e9aacc780 1 > prepared part key=_multipart_PCLJXQHJ4HTY.2~3MJP7SLSEJK4.0 size=1031198 2024-06-04T15:59:24.733 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.733+0000 7f5e9aacc780 1 > prepared multipart upload key=PCLJXQHJ4HTY upload=3MJP7SLSEJK4 tag=XELPEG35WL5T type=write size=2079774 2024-06-04T15:59:24.734 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.734+0000 7f5e9aacc780 1 < completed delete operation key=9MPRI6LW3956 tag=EAB8QWSZIJ7R type=del 2024-06-04T15:59:24.736 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.736+0000 7f5e9aacc780 1 > prepared operation key=RP8K6QJUZAH1 tag=VWXGNF1PSADO type=del size=1582910 2024-06-04T15:59:24.738 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.737+0000 7f5e9aacc780 1 < completed delete operation key=1IKNQXU3Y2JJ tag=49L29EGGZKQ6 type=del 2024-06-04T15:59:24.739 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.739+0000 7f5e9aacc780 1 > prepared operation key=RP8K6QJUZAH1 tag=6X0IDC9S4BSG type=del size=1332248 2024-06-04T15:59:24.740 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.739+0000 7f5e9aacc780 1 < canceled part key=_multipart_PCLJXQHJ4HTY.2~B3V6WV1NP998.0 size=1048576 2024-06-04T15:59:24.741 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.740+0000 7f5e9aacc780 1 < completed part key=_multipart_PCLJXQHJ4HTY.2~B3V6WV1NP998.1 size=1048576 2024-06-04T15:59:24.742 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.742+0000 7f5e9aacc780 1 < completed part key=_multipart_PCLJXQHJ4HTY.2~B3V6WV1NP998.2 size=242431 2024-06-04T15:59:24.744 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.744+0000 7f5e9aacc780 1 < canceled multipart upload key=PCLJXQHJ4HTY upload=B3V6WV1NP998 tag=1A2MD2F86KRD type=write size=3388159 2024-06-04T15:59:24.746 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.746+0000 7f5e9aacc780 1 > prepared operation key=PNDPO2WUW7UX tag=4TSJ7ZDPEZCS type=del size=2316550 2024-06-04T15:59:24.748 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.747+0000 7f5e9aacc780 1 < completed part key=_multipart_XH0N984YVGKP.2~3XNZNX4AEF7P.0 size=1048576 2024-06-04T15:59:24.749 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.749+0000 7f5e9aacc780 1 < completed part key=_multipart_XH0N984YVGKP.2~3XNZNX4AEF7P.1 size=243031 2024-06-04T15:59:24.753 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.752+0000 7f5e9aacc780 1 < completed multipart upload key=XH0N984YVGKP upload=3XNZNX4AEF7P tag=PCNCXT2VTM20 type=write size=2340183 2024-06-04T15:59:24.754 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.754+0000 7f5e9aacc780 1 > prepared operation key=UTZHANL9ER2Q tag=EZEF66UW26FF type=del size=278235 2024-06-04T15:59:24.755 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.755+0000 7f5e9aacc780 1 < completed delete operation key=SUBHZJ7HUV3H tag=7IN5X2OEE3VA type=del 2024-06-04T15:59:24.758 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.757+0000 7f5e9aacc780 1 > prepared part key=_multipart_PASGIP872OVX.2~AS39ZJK1W40Z.0 size=1048576 2024-06-04T15:59:24.759 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.759+0000 7f5e9aacc780 1 > prepared part key=_multipart_PASGIP872OVX.2~AS39ZJK1W40Z.1 size=1048576 2024-06-04T15:59:24.760 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.760+0000 7f5e9aacc780 1 > prepared part key=_multipart_PASGIP872OVX.2~AS39ZJK1W40Z.2 size=315280 2024-06-04T15:59:24.760 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.760+0000 7f5e9aacc780 1 > prepared multipart upload key=PASGIP872OVX upload=AS39ZJK1W40Z tag=M33K0CT7SEI0 type=write size=3461008 2024-06-04T15:59:24.761 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.761+0000 7f5e9aacc780 1 < completed part key=_multipart_HD6SNICRCDLL.2~PFYNPQUDF4ZG.0 size=1048576 2024-06-04T15:59:24.763 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.762+0000 7f5e9aacc780 1 < completed part key=_multipart_HD6SNICRCDLL.2~PFYNPQUDF4ZG.1 size=41647 2024-06-04T15:59:24.765 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.765+0000 7f5e9aacc780 1 < completed multipart upload key=HD6SNICRCDLL upload=PFYNPQUDF4ZG tag=HGNN7Q2HPWEP type=write size=2138799 2024-06-04T15:59:24.767 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.766+0000 7f5e9aacc780 1 > prepared operation key=JL69PUHT6NNT tag=5QO6JW1NF8II type=del size=355312 2024-06-04T15:59:24.768 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.768+0000 7f5e9aacc780 1 < completed delete operation key=Q4OFQI0F5YLG tag=CRG01RMSPGTU type=del 2024-06-04T15:59:24.769 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.769+0000 7f5e9aacc780 1 > prepared operation key=FBV2MAG130M6 tag=Y5UWWN188TMI type=del size=4093745 2024-06-04T15:59:24.771 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.770+0000 7f5e9aacc780 1 < canceled operation key=03ZNYG3WLMP4 tag=JD1GF3HY25L7 type=del size=102026 2024-06-04T15:59:24.772 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.772+0000 7f5e9aacc780 1 > prepared operation key=DY9JWHWNAUO1 tag=H6GLJVMWV0NS type=del size=1036310 2024-06-04T15:59:24.773 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.773+0000 7f5e9aacc780 1 < completed part key=_multipart_Q4OFQI0F5YLG.2~SVERF3V7P8L2.0 size=1048576 2024-06-04T15:59:24.775 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.774+0000 7f5e9aacc780 1 < completed part key=_multipart_Q4OFQI0F5YLG.2~SVERF3V7P8L2.1 size=1048576 2024-06-04T15:59:24.776 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.776+0000 7f5e9aacc780 1 < completed part key=_multipart_Q4OFQI0F5YLG.2~SVERF3V7P8L2.2 size=191755 2024-06-04T15:59:24.779 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.778+0000 7f5e9aacc780 1 < completed multipart upload key=Q4OFQI0F5YLG upload=SVERF3V7P8L2 tag=4ML717XO0ZXK type=write size=3337483 2024-06-04T15:59:24.781 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.781+0000 7f5e9aacc780 1 > prepared part key=_multipart_NJ5U8JTT32QK.2~WYULYRYJKNWS.0 size=1048576 2024-06-04T15:59:24.783 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.782+0000 7f5e9aacc780 1 > prepared part key=_multipart_NJ5U8JTT32QK.2~WYULYRYJKNWS.1 size=1048576 2024-06-04T15:59:24.784 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.783+0000 7f5e9aacc780 1 > prepared part key=_multipart_NJ5U8JTT32QK.2~WYULYRYJKNWS.2 size=39391 2024-06-04T15:59:24.784 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.783+0000 7f5e9aacc780 1 > prepared multipart upload key=NJ5U8JTT32QK upload=WYULYRYJKNWS tag=XSMTNG9QUBUH type=write size=3185119 2024-06-04T15:59:24.786 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.785+0000 7f5e9aacc780 1 < completed part key=_multipart_NJ5U8JTT32QK.2~1Z6KB5ZI352W.0 size=1048576 2024-06-04T15:59:24.787 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.786+0000 7f5e9aacc780 1 < completed part key=_multipart_NJ5U8JTT32QK.2~1Z6KB5ZI352W.1 size=1048576 2024-06-04T15:59:24.788 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.788+0000 7f5e9aacc780 1 < completed part key=_multipart_NJ5U8JTT32QK.2~1Z6KB5ZI352W.2 size=537714 2024-06-04T15:59:24.790 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.790+0000 7f5e9aacc780 1 < completed multipart upload key=NJ5U8JTT32QK upload=1Z6KB5ZI352W tag=GYLZGU4ZEPAE type=write size=3683442 2024-06-04T15:59:24.792 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.791+0000 7f5e9aacc780 1 > prepared operation key=GTRMEQJK675Z tag=WXUQ5RANWN4P type=del size=3524349 2024-06-04T15:59:24.793 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.793+0000 7f5e9aacc780 1 < completed part key=_multipart_1IKNQXU3Y2JJ.2~C93FW0E2D0WP.0 size=1048576 2024-06-04T15:59:24.795 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.794+0000 7f5e9aacc780 1 < completed part key=_multipart_1IKNQXU3Y2JJ.2~C93FW0E2D0WP.1 size=612848 2024-06-04T15:59:24.797 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.797+0000 7f5e9aacc780 1 < completed multipart upload key=1IKNQXU3Y2JJ upload=C93FW0E2D0WP tag=NP6AVLHU2ZU6 type=write size=2710000 2024-06-04T15:59:24.799 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.798+0000 7f5e9aacc780 1 > prepared operation key=SUBHZJ7HUV3H tag=3LC4DPR4RATU type=del size=2920038 2024-06-04T15:59:24.799 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.798+0000 7f5e9aacc780 1 < canceled part key=_multipart_Q4OFQI0F5YLG.2~YQ1NYPI0560I.0 size=468445 2024-06-04T15:59:24.801 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.801+0000 7f5e9aacc780 1 < canceled multipart upload key=Q4OFQI0F5YLG upload=YQ1NYPI0560I tag=090M1CEZHM9Z type=write size=1517021 2024-06-04T15:59:24.802 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.802+0000 7f5e9aacc780 1 > prepared operation key=W1T4O3EAE7JN tag=4JVOHZB325CR type=del size=1593581 2024-06-04T15:59:24.804 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.804+0000 7f5e9aacc780 1 < completed part key=_multipart_W1T4O3EAE7JN.2~GL072G2SRO8D.0 size=1048576 2024-06-04T15:59:24.804 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.804+0000 7f5e9aacc780 1 < canceled part key=_multipart_W1T4O3EAE7JN.2~GL072G2SRO8D.1 size=280194 2024-06-04T15:59:24.806 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.806+0000 7f5e9aacc780 1 < canceled multipart upload key=W1T4O3EAE7JN upload=GL072G2SRO8D tag=MEFXJISM791O type=write size=2377346 2024-06-04T15:59:24.808 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.808+0000 7f5e9aacc780 1 > prepared operation key=NHPH4LYPP0LL tag=6DKDO4PHHF7A type=del size=3967594 2024-06-04T15:59:24.809 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.809+0000 7f5e9aacc780 1 < completed delete operation key=FBV2MAG130M6 tag=PTCAPTAHH5WG type=del 2024-06-04T15:59:24.811 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.811+0000 7f5e9aacc780 1 > prepared operation key=FBV2MAG130M6 tag=ORV9KJXMO73G type=del size=2788894 2024-06-04T15:59:24.813 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.813+0000 7f5e9aacc780 1 < completed delete operation key=RP8K6QJUZAH1 tag=ID3GCJOX10TD type=del 2024-06-04T15:59:24.815 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.814+0000 7f5e9aacc780 1 > prepared operation key=HD6SNICRCDLL tag=LARQLWUM3AVC type=del size=2526018 2024-06-04T15:59:24.816 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.816+0000 7f5e9aacc780 1 < completed part key=_multipart_PCLJXQHJ4HTY.2~3MJP7SLSEJK4.0 size=1031198 2024-06-04T15:59:24.819 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.818+0000 7f5e9aacc780 1 < completed multipart upload key=PCLJXQHJ4HTY upload=3MJP7SLSEJK4 tag=XELPEG35WL5T type=write size=2079774 2024-06-04T15:59:24.821 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.821+0000 7f5e9aacc780 1 > prepared part key=_multipart_UTZHANL9ER2Q.2~492VDUA102FX.0 size=365633 2024-06-04T15:59:24.821 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.821+0000 7f5e9aacc780 1 > prepared multipart upload key=UTZHANL9ER2Q upload=492VDUA102FX tag=F1HNDEMU8ZC1 type=write size=1414209 2024-06-04T15:59:24.823 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.823+0000 7f5e9aacc780 1 < completed delete operation key=RP8K6QJUZAH1 tag=VWXGNF1PSADO type=del 2024-06-04T15:59:24.826 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.826+0000 7f5e9aacc780 1 > prepared part key=_multipart_9MPRI6LW3956.2~9RDFFN21CYYQ.0 size=1048576 2024-06-04T15:59:24.827 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.827+0000 7f5e9aacc780 1 > prepared part key=_multipart_9MPRI6LW3956.2~9RDFFN21CYYQ.1 size=458443 2024-06-04T15:59:24.827 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.827+0000 7f5e9aacc780 1 > prepared multipart upload key=9MPRI6LW3956 upload=9RDFFN21CYYQ tag=3ZKK2DYQBIPJ type=write size=2555595 2024-06-04T15:59:24.828 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.828+0000 7f5e9aacc780 1 < completed delete operation key=RP8K6QJUZAH1 tag=6X0IDC9S4BSG type=del 2024-06-04T15:59:24.831 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.831+0000 7f5e9aacc780 1 > prepared part key=_multipart_7S9S3MIG7WIT.2~T8K22M8D7T8J.0 size=1048576 2024-06-04T15:59:24.832 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.832+0000 7f5e9aacc780 1 > prepared part key=_multipart_7S9S3MIG7WIT.2~T8K22M8D7T8J.1 size=1048576 2024-06-04T15:59:24.834 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.833+0000 7f5e9aacc780 1 > prepared part key=_multipart_7S9S3MIG7WIT.2~T8K22M8D7T8J.2 size=906136 2024-06-04T15:59:24.834 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.833+0000 7f5e9aacc780 1 > prepared multipart upload key=7S9S3MIG7WIT upload=T8K22M8D7T8J tag=JBQ8JFFI8PIB type=write size=4051864 2024-06-04T15:59:24.835 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.834+0000 7f5e9aacc780 1 < completed delete operation key=PNDPO2WUW7UX tag=4TSJ7ZDPEZCS type=del 2024-06-04T15:59:24.836 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.836+0000 7f5e9aacc780 1 > prepared operation key=PNDPO2WUW7UX tag=6G010JEW34TA type=del size=4064843 2024-06-04T15:59:24.837 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.837+0000 7f5e9aacc780 1 < completed delete operation key=UTZHANL9ER2Q tag=EZEF66UW26FF type=del 2024-06-04T15:59:24.839 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.838+0000 7f5e9aacc780 1 > prepared operation key=A8O0S3S45RGM tag=KT5UIMP1GNXP type=write size=110016 2024-06-04T15:59:24.840 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.840+0000 7f5e9aacc780 1 < completed part key=_multipart_PASGIP872OVX.2~AS39ZJK1W40Z.0 size=1048576 2024-06-04T15:59:24.841 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.841+0000 7f5e9aacc780 1 < completed part key=_multipart_PASGIP872OVX.2~AS39ZJK1W40Z.1 size=1048576 2024-06-04T15:59:24.842 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.842+0000 7f5e9aacc780 1 < completed part key=_multipart_PASGIP872OVX.2~AS39ZJK1W40Z.2 size=315280 2024-06-04T15:59:24.845 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.845+0000 7f5e9aacc780 1 < completed multipart upload key=PASGIP872OVX upload=AS39ZJK1W40Z tag=M33K0CT7SEI0 type=write size=3461008 2024-06-04T15:59:24.847 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.847+0000 7f5e9aacc780 1 > prepared part key=_multipart_AOCB36Y5Q7B0.2~5IS2YQIK4Q0Z.0 size=1048576 2024-06-04T15:59:24.848 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.848+0000 7f5e9aacc780 1 > prepared part key=_multipart_AOCB36Y5Q7B0.2~5IS2YQIK4Q0Z.1 size=692255 2024-06-04T15:59:24.848 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.848+0000 7f5e9aacc780 1 > prepared multipart upload key=AOCB36Y5Q7B0 upload=5IS2YQIK4Q0Z tag=D40U768IKYVI type=write size=2789407 2024-06-04T15:59:24.850 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.849+0000 7f5e9aacc780 1 < completed delete operation key=JL69PUHT6NNT tag=5QO6JW1NF8II type=del 2024-06-04T15:59:24.852 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.851+0000 7f5e9aacc780 1 > prepared operation key=NHPH4LYPP0LL tag=RZCA71I3DG25 type=del size=1816760 2024-06-04T15:59:24.853 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.853+0000 7f5e9aacc780 1 < completed delete operation key=FBV2MAG130M6 tag=Y5UWWN188TMI type=del 2024-06-04T15:59:24.854 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.854+0000 7f5e9aacc780 1 > prepared operation key=PCLJXQHJ4HTY tag=792T6KC7VDR3 type=del size=146942 2024-06-04T15:59:24.856 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.856+0000 7f5e9aacc780 1 < completed delete operation key=DY9JWHWNAUO1 tag=H6GLJVMWV0NS type=del 2024-06-04T15:59:24.859 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.859+0000 7f5e9aacc780 1 > prepared part key=_multipart_SUBHZJ7HUV3H.2~55WU9ZREMK0L.0 size=1048576 2024-06-04T15:59:24.860 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.860+0000 7f5e9aacc780 1 > prepared part key=_multipart_SUBHZJ7HUV3H.2~55WU9ZREMK0L.1 size=201513 2024-06-04T15:59:24.860 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.860+0000 7f5e9aacc780 1 > prepared multipart upload key=SUBHZJ7HUV3H upload=55WU9ZREMK0L tag=TM0WHNPIIIV7 type=write size=2298665 2024-06-04T15:59:24.862 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.861+0000 7f5e9aacc780 1 < completed part key=_multipart_NJ5U8JTT32QK.2~WYULYRYJKNWS.0 size=1048576 2024-06-04T15:59:24.863 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.863+0000 7f5e9aacc780 1 < completed part key=_multipart_NJ5U8JTT32QK.2~WYULYRYJKNWS.1 size=1048576 2024-06-04T15:59:24.864 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.864+0000 7f5e9aacc780 1 < completed part key=_multipart_NJ5U8JTT32QK.2~WYULYRYJKNWS.2 size=39391 2024-06-04T15:59:24.866 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.866+0000 7f5e9aacc780 1 < completed multipart upload key=NJ5U8JTT32QK upload=WYULYRYJKNWS tag=XSMTNG9QUBUH type=write size=3185119 2024-06-04T15:59:24.868 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.867+0000 7f5e9aacc780 1 > prepared operation key=QUIVPH3OB6KN tag=XHDRSJEOFXK0 type=del size=2811746 2024-06-04T15:59:24.870 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.870+0000 7f5e9aacc780 1 < completed delete operation key=GTRMEQJK675Z tag=WXUQ5RANWN4P type=del 2024-06-04T15:59:24.872 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.871+0000 7f5e9aacc780 1 > prepared operation key=QJA2JPATITNH tag=QY88800WFZ1D type=write size=83813 2024-06-04T15:59:24.875 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.875+0000 7f5e9aacc780 1 < suggested update operation key=SUBHZJ7HUV3H tag=3LC4DPR4RATU type=del size=2920038 2024-06-04T15:59:24.878 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.878+0000 7f5e9aacc780 1 > prepared part key=_multipart_GCPC9OJH7KWU.2~QKQJQ2W05JSD.0 size=1048576 2024-06-04T15:59:24.879 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.879+0000 7f5e9aacc780 1 > prepared part key=_multipart_GCPC9OJH7KWU.2~QKQJQ2W05JSD.1 size=1048576 2024-06-04T15:59:24.880 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.880+0000 7f5e9aacc780 1 > prepared part key=_multipart_GCPC9OJH7KWU.2~QKQJQ2W05JSD.2 size=742075 2024-06-04T15:59:24.880 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.880+0000 7f5e9aacc780 1 > prepared multipart upload key=GCPC9OJH7KWU upload=QKQJQ2W05JSD tag=9ZSKC56VGNN3 type=write size=3887803 2024-06-04T15:59:24.881 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.881+0000 7f5e9aacc780 1 < completed delete operation key=W1T4O3EAE7JN tag=4JVOHZB325CR type=del 2024-06-04T15:59:24.883 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.883+0000 7f5e9aacc780 1 > prepared operation key=2BT2AXKB1RTA tag=KOLUTV3Q059N type=del size=1864040 2024-06-04T15:59:24.884 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.884+0000 7f5e9aacc780 1 < completed delete operation key=NHPH4LYPP0LL tag=6DKDO4PHHF7A type=del 2024-06-04T15:59:24.887 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.887+0000 7f5e9aacc780 1 > prepared part key=_multipart_Q4OFQI0F5YLG.2~30R8EICECV4V.0 size=1048576 2024-06-04T15:59:24.888 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.888+0000 7f5e9aacc780 1 > prepared part key=_multipart_Q4OFQI0F5YLG.2~30R8EICECV4V.1 size=1048576 2024-06-04T15:59:24.889 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.889+0000 7f5e9aacc780 1 > prepared part key=_multipart_Q4OFQI0F5YLG.2~30R8EICECV4V.2 size=544501 2024-06-04T15:59:24.889 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.889+0000 7f5e9aacc780 1 > prepared multipart upload key=Q4OFQI0F5YLG upload=30R8EICECV4V tag=VDV2RPHHDI23 type=write size=3690229 2024-06-04T15:59:24.892 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.892+0000 7f5e9aacc780 1 < suggested remove operation key=FBV2MAG130M6 tag=ORV9KJXMO73G type=del 2024-06-04T15:59:24.893 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.893+0000 7f5e9aacc780 1 > prepared operation key=AOCB36Y5Q7B0 tag=SBLBHQOJ6TQB type=del size=453676 2024-06-04T15:59:24.895 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.894+0000 7f5e9aacc780 1 < completed delete operation key=HD6SNICRCDLL tag=LARQLWUM3AVC type=del 2024-06-04T15:59:24.896 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.896+0000 7f5e9aacc780 1 > prepared operation key=QJA2JPATITNH tag=AMUW1E1PUFJB type=del size=2565831 2024-06-04T15:59:24.897 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.897+0000 7f5e9aacc780 1 < completed part key=_multipart_UTZHANL9ER2Q.2~492VDUA102FX.0 size=365633 2024-06-04T15:59:24.899 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.899+0000 7f5e9aacc780 1 < completed multipart upload key=UTZHANL9ER2Q upload=492VDUA102FX tag=F1HNDEMU8ZC1 type=write size=1414209 2024-06-04T15:59:24.901 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.901+0000 7f5e9aacc780 1 > prepared operation key=RP8K6QJUZAH1 tag=ED8IL3VVUT9W type=write size=20401 2024-06-04T15:59:24.903 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.902+0000 7f5e9aacc780 1 < completed part key=_multipart_9MPRI6LW3956.2~9RDFFN21CYYQ.0 size=1048576 2024-06-04T15:59:24.904 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.903+0000 7f5e9aacc780 1 < completed part key=_multipart_9MPRI6LW3956.2~9RDFFN21CYYQ.1 size=458443 2024-06-04T15:59:24.906 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.905+0000 7f5e9aacc780 1 < completed multipart upload key=9MPRI6LW3956 upload=9RDFFN21CYYQ tag=3ZKK2DYQBIPJ type=write size=2555595 2024-06-04T15:59:24.908 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.908+0000 7f5e9aacc780 1 > prepared part key=_multipart_W1T4O3EAE7JN.2~E3LSDY6AE3HL.0 size=1048576 2024-06-04T15:59:24.909 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.909+0000 7f5e9aacc780 1 > prepared part key=_multipart_W1T4O3EAE7JN.2~E3LSDY6AE3HL.1 size=589223 2024-06-04T15:59:24.909 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.909+0000 7f5e9aacc780 1 > prepared multipart upload key=W1T4O3EAE7JN upload=E3LSDY6AE3HL tag=LVUSHXADAEIU type=write size=2686375 2024-06-04T15:59:24.911 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.911+0000 7f5e9aacc780 1 < completed part key=_multipart_7S9S3MIG7WIT.2~T8K22M8D7T8J.0 size=1048576 2024-06-04T15:59:24.912 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.912+0000 7f5e9aacc780 1 < completed part key=_multipart_7S9S3MIG7WIT.2~T8K22M8D7T8J.1 size=1048576 2024-06-04T15:59:24.913 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.913+0000 7f5e9aacc780 1 < completed part key=_multipart_7S9S3MIG7WIT.2~T8K22M8D7T8J.2 size=906136 2024-06-04T15:59:24.915 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.915+0000 7f5e9aacc780 1 < completed multipart upload key=7S9S3MIG7WIT upload=T8K22M8D7T8J tag=JBQ8JFFI8PIB type=write size=4051864 2024-06-04T15:59:24.917 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.917+0000 7f5e9aacc780 1 > prepared operation key=GCPC9OJH7KWU tag=6YGRLVRBA8KW type=del size=3424597 2024-06-04T15:59:24.918 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.918+0000 7f5e9aacc780 1 < completed delete operation key=PNDPO2WUW7UX tag=6G010JEW34TA type=del 2024-06-04T15:59:24.920 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.919+0000 7f5e9aacc780 1 > prepared operation key=9MPRI6LW3956 tag=2D9O94P5TDXR type=del size=1599813 2024-06-04T15:59:24.921 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.921+0000 7f5e9aacc780 1 < canceled operation key=A8O0S3S45RGM tag=KT5UIMP1GNXP type=write size=110016 2024-06-04T15:59:24.923 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.923+0000 7f5e9aacc780 1 > prepared part key=_multipart_GCPC9OJH7KWU.2~4T2R6LR5SEE8.0 size=1048576 2024-06-04T15:59:24.925 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.924+0000 7f5e9aacc780 1 > prepared part key=_multipart_GCPC9OJH7KWU.2~4T2R6LR5SEE8.1 size=1048576 2024-06-04T15:59:24.926 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.926+0000 7f5e9aacc780 1 > prepared part key=_multipart_GCPC9OJH7KWU.2~4T2R6LR5SEE8.2 size=448453 2024-06-04T15:59:24.926 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.926+0000 7f5e9aacc780 1 > prepared multipart upload key=GCPC9OJH7KWU upload=4T2R6LR5SEE8 tag=Z82SXR1WF0V8 type=write size=3594181 2024-06-04T15:59:24.927 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.927+0000 7f5e9aacc780 1 < completed part key=_multipart_AOCB36Y5Q7B0.2~5IS2YQIK4Q0Z.0 size=1048576 2024-06-04T15:59:24.928 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.928+0000 7f5e9aacc780 1 < completed part key=_multipart_AOCB36Y5Q7B0.2~5IS2YQIK4Q0Z.1 size=692255 2024-06-04T15:59:24.931 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.931+0000 7f5e9aacc780 1 < completed multipart upload key=AOCB36Y5Q7B0 upload=5IS2YQIK4Q0Z tag=D40U768IKYVI type=write size=2789407 2024-06-04T15:59:24.933 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.933+0000 7f5e9aacc780 1 > prepared part key=_multipart_HD6SNICRCDLL.2~N8MU1IYE21XZ.0 size=1048576 2024-06-04T15:59:24.934 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.934+0000 7f5e9aacc780 1 > prepared part key=_multipart_HD6SNICRCDLL.2~N8MU1IYE21XZ.1 size=1048576 2024-06-04T15:59:24.935 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.935+0000 7f5e9aacc780 1 > prepared part key=_multipart_HD6SNICRCDLL.2~N8MU1IYE21XZ.2 size=637550 2024-06-04T15:59:24.935 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.935+0000 7f5e9aacc780 1 > prepared multipart upload key=HD6SNICRCDLL upload=N8MU1IYE21XZ tag=3DBGLW4OO7KX type=write size=3783278 2024-06-04T15:59:24.937 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.936+0000 7f5e9aacc780 1 < completed delete operation key=NHPH4LYPP0LL tag=RZCA71I3DG25 type=del 2024-06-04T15:59:24.939 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.939+0000 7f5e9aacc780 1 > prepared part key=_multipart_2BT2AXKB1RTA.2~IRYGADSF1ESU.0 size=1048576 2024-06-04T15:59:24.940 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.940+0000 7f5e9aacc780 1 > prepared part key=_multipart_2BT2AXKB1RTA.2~IRYGADSF1ESU.1 size=468880 2024-06-04T15:59:24.940 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.940+0000 7f5e9aacc780 1 > prepared multipart upload key=2BT2AXKB1RTA upload=IRYGADSF1ESU tag=IKMHSCZD8W15 type=write size=2566032 2024-06-04T15:59:24.943 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.943+0000 7f5e9aacc780 1 < suggested remove operation key=PCLJXQHJ4HTY tag=792T6KC7VDR3 type=del 2024-06-04T15:59:24.944 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.944+0000 7f5e9aacc780 1 > prepared operation key=1IKNQXU3Y2JJ tag=TQI68B1X4VV1 type=write size=210996 2024-06-04T15:59:24.946 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.946+0000 7f5e9aacc780 1 < completed part key=_multipart_SUBHZJ7HUV3H.2~55WU9ZREMK0L.0 size=1048576 2024-06-04T15:59:24.947 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.947+0000 7f5e9aacc780 1 < completed part key=_multipart_SUBHZJ7HUV3H.2~55WU9ZREMK0L.1 size=201513 2024-06-04T15:59:24.949 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.950+0000 7f5e9aacc780 1 < completed multipart upload key=SUBHZJ7HUV3H upload=55WU9ZREMK0L tag=TM0WHNPIIIV7 type=write size=2298665 2024-06-04T15:59:24.951 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.951+0000 7f5e9aacc780 1 > prepared operation key=W1T4O3EAE7JN tag=IGTOQPAWZ0XV type=write size=494195 2024-06-04T15:59:24.952 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.952+0000 7f5e9aacc780 1 < completed delete operation key=QUIVPH3OB6KN tag=XHDRSJEOFXK0 type=del 2024-06-04T15:59:24.954 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.953+0000 7f5e9aacc780 1 > prepared operation key=B0HK5FJ2RGJE tag=O4JUCAI5I33O type=del size=3029205 2024-06-04T15:59:24.955 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.955+0000 7f5e9aacc780 1 < completed write operation key=QJA2JPATITNH tag=QY88800WFZ1D type=write size=83813 2024-06-04T15:59:24.957 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.957+0000 7f5e9aacc780 1 > prepared part key=_multipart_Q4OFQI0F5YLG.2~VTFS6T1J7RX5.0 size=1048576 2024-06-04T15:59:24.959 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.958+0000 7f5e9aacc780 1 > prepared part key=_multipart_Q4OFQI0F5YLG.2~VTFS6T1J7RX5.1 size=657217 2024-06-04T15:59:24.959 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.958+0000 7f5e9aacc780 1 > prepared multipart upload key=Q4OFQI0F5YLG upload=VTFS6T1J7RX5 tag=81VYNJR32XLH type=write size=2754369 2024-06-04T15:59:24.960 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.960+0000 7f5e9aacc780 1 < completed part key=_multipart_GCPC9OJH7KWU.2~QKQJQ2W05JSD.0 size=1048576 2024-06-04T15:59:24.961 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.961+0000 7f5e9aacc780 1 < completed part key=_multipart_GCPC9OJH7KWU.2~QKQJQ2W05JSD.1 size=1048576 2024-06-04T15:59:24.962 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.962+0000 7f5e9aacc780 1 < completed part key=_multipart_GCPC9OJH7KWU.2~QKQJQ2W05JSD.2 size=742075 2024-06-04T15:59:24.965 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.964+0000 7f5e9aacc780 1 < completed multipart upload key=GCPC9OJH7KWU upload=QKQJQ2W05JSD tag=9ZSKC56VGNN3 type=write size=3887803 2024-06-04T15:59:24.966 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.966+0000 7f5e9aacc780 1 > prepared operation key=9MPRI6LW3956 tag=YTGJS5XJSZX4 type=del size=2537139 2024-06-04T15:59:24.968 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.967+0000 7f5e9aacc780 1 < completed delete operation key=2BT2AXKB1RTA tag=KOLUTV3Q059N type=del 2024-06-04T15:59:24.969 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.969+0000 7f5e9aacc780 1 > prepared operation key=GCPC9OJH7KWU tag=NLBKPL1T5639 type=del size=90343 2024-06-04T15:59:24.971 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.970+0000 7f5e9aacc780 1 < completed part key=_multipart_Q4OFQI0F5YLG.2~30R8EICECV4V.0 size=1048576 2024-06-04T15:59:24.972 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.971+0000 7f5e9aacc780 1 < completed part key=_multipart_Q4OFQI0F5YLG.2~30R8EICECV4V.1 size=1048576 2024-06-04T15:59:24.972 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.971+0000 7f5e9aacc780 1 < canceled part key=_multipart_Q4OFQI0F5YLG.2~30R8EICECV4V.2 size=544501 2024-06-04T15:59:24.974 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.974+0000 7f5e9aacc780 1 < canceled multipart upload key=Q4OFQI0F5YLG upload=30R8EICECV4V tag=VDV2RPHHDI23 type=write size=3690229 2024-06-04T15:59:24.976 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.975+0000 7f5e9aacc780 1 > prepared operation key=A8O0S3S45RGM tag=VEJK9WT3F0M2 type=del size=2455979 2024-06-04T15:59:24.978 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.978+0000 7f5e9aacc780 1 < suggested update operation key=AOCB36Y5Q7B0 tag=SBLBHQOJ6TQB type=del size=453676 2024-06-04T15:59:24.979 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.979+0000 7f5e9aacc780 1 > prepared operation key=PCLJXQHJ4HTY tag=NJU9RARU10GR type=write size=233459 2024-06-04T15:59:24.981 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.981+0000 7f5e9aacc780 1 < completed delete operation key=QJA2JPATITNH tag=AMUW1E1PUFJB type=del 2024-06-04T15:59:24.984 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.984+0000 7f5e9aacc780 1 > prepared part key=_multipart_TUGKW7F4V9NO.2~DK0LNMO9I5DP.0 size=1048576 2024-06-04T15:59:24.985 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.985+0000 7f5e9aacc780 1 > prepared part key=_multipart_TUGKW7F4V9NO.2~DK0LNMO9I5DP.1 size=1048576 2024-06-04T15:59:24.986 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.986+0000 7f5e9aacc780 1 > prepared part key=_multipart_TUGKW7F4V9NO.2~DK0LNMO9I5DP.2 size=705414 2024-06-04T15:59:24.986 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.986+0000 7f5e9aacc780 1 > prepared multipart upload key=TUGKW7F4V9NO upload=DK0LNMO9I5DP tag=ALAYPU1CULEM type=write size=3851142 2024-06-04T15:59:24.988 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.987+0000 7f5e9aacc780 1 < completed write operation key=RP8K6QJUZAH1 tag=ED8IL3VVUT9W type=write size=20401 2024-06-04T15:59:24.990 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.990+0000 7f5e9aacc780 1 > prepared part key=_multipart_9MPRI6LW3956.2~1ATSBJTO0OTA.0 size=1048576 2024-06-04T15:59:24.991 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.991+0000 7f5e9aacc780 1 > prepared part key=_multipart_9MPRI6LW3956.2~1ATSBJTO0OTA.1 size=117697 2024-06-04T15:59:24.991 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.991+0000 7f5e9aacc780 1 > prepared multipart upload key=9MPRI6LW3956 upload=1ATSBJTO0OTA tag=9K8MT7242T1O type=write size=2214849 2024-06-04T15:59:24.993 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.992+0000 7f5e9aacc780 1 < completed part key=_multipart_W1T4O3EAE7JN.2~E3LSDY6AE3HL.0 size=1048576 2024-06-04T15:59:24.994 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.993+0000 7f5e9aacc780 1 < completed part key=_multipart_W1T4O3EAE7JN.2~E3LSDY6AE3HL.1 size=589223 2024-06-04T15:59:24.996 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.996+0000 7f5e9aacc780 1 < completed multipart upload key=W1T4O3EAE7JN upload=E3LSDY6AE3HL tag=LVUSHXADAEIU type=write size=2686375 2024-06-04T15:59:24.998 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.997+0000 7f5e9aacc780 1 > prepared operation key=B0HK5FJ2RGJE tag=PEHBHLJSRORQ type=del size=3749675 2024-06-04T15:59:24.999 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:24.999+0000 7f5e9aacc780 1 < completed delete operation key=GCPC9OJH7KWU tag=6YGRLVRBA8KW type=del 2024-06-04T15:59:25.002 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.001+0000 7f5e9aacc780 1 > prepared part key=_multipart_XH0N984YVGKP.2~HZOANG0XGZX2.0 size=529364 2024-06-04T15:59:25.002 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.001+0000 7f5e9aacc780 1 > prepared multipart upload key=XH0N984YVGKP upload=HZOANG0XGZX2 tag=U30LL3ZLB8Z8 type=write size=1577940 2024-06-04T15:59:25.004 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.004+0000 7f5e9aacc780 1 < completed delete operation key=9MPRI6LW3956 tag=2D9O94P5TDXR type=del 2024-06-04T15:59:25.005 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.005+0000 7f5e9aacc780 1 > prepared operation key=2BT2AXKB1RTA tag=0Q806D75FY00 type=del size=2428638 2024-06-04T15:59:25.007 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.007+0000 7f5e9aacc780 1 < completed part key=_multipart_GCPC9OJH7KWU.2~4T2R6LR5SEE8.0 size=1048576 2024-06-04T15:59:25.008 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.008+0000 7f5e9aacc780 1 < completed part key=_multipart_GCPC9OJH7KWU.2~4T2R6LR5SEE8.1 size=1048576 2024-06-04T15:59:25.009 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.009+0000 7f5e9aacc780 1 < completed part key=_multipart_GCPC9OJH7KWU.2~4T2R6LR5SEE8.2 size=448453 2024-06-04T15:59:25.012 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.012+0000 7f5e9aacc780 1 < completed multipart upload key=GCPC9OJH7KWU upload=4T2R6LR5SEE8 tag=Z82SXR1WF0V8 type=write size=3594181 2024-06-04T15:59:25.015 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.015+0000 7f5e9aacc780 1 > prepared part key=_multipart_UW5LVIBG09SV.2~QULA0VLQ3AMK.0 size=1048576 2024-06-04T15:59:25.018 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.018+0000 7f5e9aacc780 1 > prepared part key=_multipart_UW5LVIBG09SV.2~QULA0VLQ3AMK.1 size=557655 2024-06-04T15:59:25.018 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.018+0000 7f5e9aacc780 1 > prepared multipart upload key=UW5LVIBG09SV upload=QULA0VLQ3AMK tag=FYRLNXCJ9KTO type=write size=2654807 2024-06-04T15:59:25.019 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.019+0000 7f5e9aacc780 1 < completed part key=_multipart_HD6SNICRCDLL.2~N8MU1IYE21XZ.0 size=1048576 2024-06-04T15:59:25.021 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.021+0000 7f5e9aacc780 1 < completed part key=_multipart_HD6SNICRCDLL.2~N8MU1IYE21XZ.1 size=1048576 2024-06-04T15:59:25.022 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.022+0000 7f5e9aacc780 1 < completed part key=_multipart_HD6SNICRCDLL.2~N8MU1IYE21XZ.2 size=637550 2024-06-04T15:59:25.025 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.024+0000 7f5e9aacc780 1 < completed multipart upload key=HD6SNICRCDLL upload=N8MU1IYE21XZ tag=3DBGLW4OO7KX type=write size=3783278 2024-06-04T15:59:25.026 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.026+0000 7f5e9aacc780 1 > prepared operation key=PASGIP872OVX tag=EORYFH7UR0YO type=del size=224749 2024-06-04T15:59:25.027 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.027+0000 7f5e9aacc780 1 < completed part key=_multipart_2BT2AXKB1RTA.2~IRYGADSF1ESU.0 size=1048576 2024-06-04T15:59:25.029 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.028+0000 7f5e9aacc780 1 < completed part key=_multipart_2BT2AXKB1RTA.2~IRYGADSF1ESU.1 size=468880 2024-06-04T15:59:25.031 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.031+0000 7f5e9aacc780 1 < completed multipart upload key=2BT2AXKB1RTA upload=IRYGADSF1ESU tag=IKMHSCZD8W15 type=write size=2566032 2024-06-04T15:59:25.032 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.032+0000 7f5e9aacc780 1 > prepared operation key=Q2V1ICTBSCV1 tag=J3C8SJEU33XA type=write size=642294 2024-06-04T15:59:25.034 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.034+0000 7f5e9aacc780 1 < completed write operation key=1IKNQXU3Y2JJ tag=TQI68B1X4VV1 type=write size=210996 2024-06-04T15:59:25.035 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.035+0000 7f5e9aacc780 1 > prepared operation key=XH0N984YVGKP tag=G2LN0FJUAT9B type=write size=69875 2024-06-04T15:59:25.037 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.036+0000 7f5e9aacc780 1 < completed write operation key=W1T4O3EAE7JN tag=IGTOQPAWZ0XV type=write size=494195 2024-06-04T15:59:25.038 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.038+0000 7f5e9aacc780 1 > prepared operation key=1IKNQXU3Y2JJ tag=AN83CI6TH3L7 type=del size=418241 2024-06-04T15:59:25.040 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.039+0000 7f5e9aacc780 1 < completed delete operation key=B0HK5FJ2RGJE tag=O4JUCAI5I33O type=del 2024-06-04T15:59:25.041 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.041+0000 7f5e9aacc780 1 > prepared operation key=W1T4O3EAE7JN tag=GYGK7XYYU08J type=del size=1808668 2024-06-04T15:59:25.042 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.042+0000 7f5e9aacc780 1 < completed part key=_multipart_Q4OFQI0F5YLG.2~VTFS6T1J7RX5.0 size=1048576 2024-06-04T15:59:25.044 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.043+0000 7f5e9aacc780 1 < completed part key=_multipart_Q4OFQI0F5YLG.2~VTFS6T1J7RX5.1 size=657217 2024-06-04T15:59:25.046 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.046+0000 7f5e9aacc780 1 < completed multipart upload key=Q4OFQI0F5YLG upload=VTFS6T1J7RX5 tag=81VYNJR32XLH type=write size=2754369 2024-06-04T15:59:25.049 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.048+0000 7f5e9aacc780 1 > prepared part key=_multipart_PASGIP872OVX.2~ZTBPF0RBF4I7.0 size=10149 2024-06-04T15:59:25.049 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.048+0000 7f5e9aacc780 1 > prepared multipart upload key=PASGIP872OVX upload=ZTBPF0RBF4I7 tag=QFZYF38N9XF5 type=write size=1058725 2024-06-04T15:59:25.052 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.051+0000 7f5e9aacc780 1 < suggested update operation key=9MPRI6LW3956 tag=YTGJS5XJSZX4 type=del size=2537139 2024-06-04T15:59:25.053 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.053+0000 7f5e9aacc780 1 > prepared operation key=2BT2AXKB1RTA tag=3O0S0B8DN5UA type=write size=39304 2024-06-04T15:59:25.057 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.057+0000 7f5e9aacc780 1 < suggested update operation key=GCPC9OJH7KWU tag=NLBKPL1T5639 type=del size=90343 2024-06-04T15:59:25.059 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.059+0000 7f5e9aacc780 1 > prepared part key=_multipart_7S9S3MIG7WIT.2~8KTS14VDNTPI.0 size=1048576 2024-06-04T15:59:25.060 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.060+0000 7f5e9aacc780 1 > prepared part key=_multipart_7S9S3MIG7WIT.2~8KTS14VDNTPI.1 size=845153 2024-06-04T15:59:25.060 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.060+0000 7f5e9aacc780 1 > prepared multipart upload key=7S9S3MIG7WIT upload=8KTS14VDNTPI tag=Y7Z5VU4VU2KH type=write size=2942305 2024-06-04T15:59:25.062 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.061+0000 7f5e9aacc780 1 < canceled operation key=A8O0S3S45RGM tag=VEJK9WT3F0M2 type=del size=2455979 2024-06-04T15:59:25.063 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.063+0000 7f5e9aacc780 1 > prepared operation key=9MPRI6LW3956 tag=0XZRJBIGVWH1 type=del size=297066 2024-06-04T15:59:25.065 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.064+0000 7f5e9aacc780 1 < canceled operation key=PCLJXQHJ4HTY tag=NJU9RARU10GR type=write size=233459 2024-06-04T15:59:25.066 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.066+0000 7f5e9aacc780 1 > prepared operation key=FBV2MAG130M6 tag=JP1OACG57E4R type=del size=1629141 2024-06-04T15:59:25.068 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.068+0000 7f5e9aacc780 1 < completed part key=_multipart_TUGKW7F4V9NO.2~DK0LNMO9I5DP.0 size=1048576 2024-06-04T15:59:25.069 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.069+0000 7f5e9aacc780 1 < completed part key=_multipart_TUGKW7F4V9NO.2~DK0LNMO9I5DP.1 size=1048576 2024-06-04T15:59:25.070 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.070+0000 7f5e9aacc780 1 < completed part key=_multipart_TUGKW7F4V9NO.2~DK0LNMO9I5DP.2 size=705414 2024-06-04T15:59:25.073 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.072+0000 7f5e9aacc780 1 < completed multipart upload key=TUGKW7F4V9NO upload=DK0LNMO9I5DP tag=ALAYPU1CULEM type=write size=3851142 2024-06-04T15:59:25.075 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.074+0000 7f5e9aacc780 1 > prepared operation key=Q4OFQI0F5YLG tag=77DGAQNOZTQG type=del size=718410 2024-06-04T15:59:25.076 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.076+0000 7f5e9aacc780 1 < completed part key=_multipart_9MPRI6LW3956.2~1ATSBJTO0OTA.0 size=1048576 2024-06-04T15:59:25.076 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.076+0000 7f5e9aacc780 1 < canceled part key=_multipart_9MPRI6LW3956.2~1ATSBJTO0OTA.1 size=117697 2024-06-04T15:59:25.078 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.078+0000 7f5e9aacc780 1 < canceled multipart upload key=9MPRI6LW3956 upload=1ATSBJTO0OTA tag=9K8MT7242T1O type=write size=2214849 2024-06-04T15:59:25.080 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.079+0000 7f5e9aacc780 1 > prepared operation key=K01DAK0M4I4M tag=0GXB96538HCZ type=write size=62115 2024-06-04T15:59:25.081 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.081+0000 7f5e9aacc780 1 < completed delete operation key=B0HK5FJ2RGJE tag=PEHBHLJSRORQ type=del 2024-06-04T15:59:25.083 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.083+0000 7f5e9aacc780 1 > prepared part key=_multipart_PNDPO2WUW7UX.2~IC1HSS9NL7IN.0 size=1048576 2024-06-04T15:59:25.084 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.084+0000 7f5e9aacc780 1 > prepared part key=_multipart_PNDPO2WUW7UX.2~IC1HSS9NL7IN.1 size=85851 2024-06-04T15:59:25.085 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.084+0000 7f5e9aacc780 1 > prepared multipart upload key=PNDPO2WUW7UX upload=IC1HSS9NL7IN tag=3IW39NIQPVB2 type=write size=2183003 2024-06-04T15:59:25.086 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.086+0000 7f5e9aacc780 1 < completed part key=_multipart_XH0N984YVGKP.2~HZOANG0XGZX2.0 size=529364 2024-06-04T15:59:25.088 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.088+0000 7f5e9aacc780 1 < completed multipart upload key=XH0N984YVGKP upload=HZOANG0XGZX2 tag=U30LL3ZLB8Z8 type=write size=1577940 2024-06-04T15:59:25.089 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.089+0000 7f5e9aacc780 1 > prepared operation key=K01DAK0M4I4M tag=V3ZD4GM3V18N type=del size=2309301 2024-06-04T15:59:25.091 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.091+0000 7f5e9aacc780 1 < completed delete operation key=2BT2AXKB1RTA tag=0Q806D75FY00 type=del 2024-06-04T15:59:25.092 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.092+0000 7f5e9aacc780 1 > prepared operation key=GCPC9OJH7KWU tag=L7XDFJNOEE6N type=del size=3115064 2024-06-04T15:59:25.094 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.093+0000 7f5e9aacc780 1 < completed part key=_multipart_UW5LVIBG09SV.2~QULA0VLQ3AMK.0 size=1048576 2024-06-04T15:59:25.095 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.094+0000 7f5e9aacc780 1 < completed part key=_multipart_UW5LVIBG09SV.2~QULA0VLQ3AMK.1 size=557655 2024-06-04T15:59:25.097 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.097+0000 7f5e9aacc780 1 < completed multipart upload key=UW5LVIBG09SV upload=QULA0VLQ3AMK tag=FYRLNXCJ9KTO type=write size=2654807 2024-06-04T15:59:25.099 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.099+0000 7f5e9aacc780 1 > prepared part key=_multipart_TUGKW7F4V9NO.2~8C05FLC8CI5S.0 size=1048576 2024-06-04T15:59:25.100 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.100+0000 7f5e9aacc780 1 > prepared part key=_multipart_TUGKW7F4V9NO.2~8C05FLC8CI5S.1 size=1048576 2024-06-04T15:59:25.102 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.101+0000 7f5e9aacc780 1 > prepared part key=_multipart_TUGKW7F4V9NO.2~8C05FLC8CI5S.2 size=510546 2024-06-04T15:59:25.102 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.101+0000 7f5e9aacc780 1 > prepared multipart upload key=TUGKW7F4V9NO upload=8C05FLC8CI5S tag=QD6EHN97NY6U type=write size=3656274 2024-06-04T15:59:25.103 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.103+0000 7f5e9aacc780 1 < completed delete operation key=PASGIP872OVX tag=EORYFH7UR0YO type=del 2024-06-04T15:59:25.104 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.104+0000 7f5e9aacc780 1 > prepared operation key=JL69PUHT6NNT tag=KVQ43V2PIHVG type=del size=278656 2024-06-04T15:59:25.105 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.105+0000 7f5e9aacc780 1 < completed write operation key=Q2V1ICTBSCV1 tag=J3C8SJEU33XA type=write size=642294 2024-06-04T15:59:25.108 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.108+0000 7f5e9aacc780 1 > prepared part key=_multipart_NHPH4LYPP0LL.2~K4G56ZFJ6E6J.0 size=1048576 2024-06-04T15:59:25.109 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.109+0000 7f5e9aacc780 1 > prepared part key=_multipart_NHPH4LYPP0LL.2~K4G56ZFJ6E6J.1 size=1048576 2024-06-04T15:59:25.110 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.110+0000 7f5e9aacc780 1 > prepared part key=_multipart_NHPH4LYPP0LL.2~K4G56ZFJ6E6J.2 size=871858 2024-06-04T15:59:25.110 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.110+0000 7f5e9aacc780 1 > prepared multipart upload key=NHPH4LYPP0LL upload=K4G56ZFJ6E6J tag=49EL96IIM8AH type=write size=4017586 2024-06-04T15:59:25.112 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.111+0000 7f5e9aacc780 1 < completed write operation key=XH0N984YVGKP tag=G2LN0FJUAT9B type=write size=69875 2024-06-04T15:59:25.113 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.113+0000 7f5e9aacc780 1 > prepared operation key=UTZHANL9ER2Q tag=FZ33ZRAEDF0T type=del size=1017843 2024-06-04T15:59:25.114 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.114+0000 7f5e9aacc780 1 < completed delete operation key=1IKNQXU3Y2JJ tag=AN83CI6TH3L7 type=del 2024-06-04T15:59:25.116 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.115+0000 7f5e9aacc780 1 > prepared operation key=HD6SNICRCDLL tag=LE195TT7HWM3 type=del size=2681293 2024-06-04T15:59:25.119 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.118+0000 7f5e9aacc780 1 < suggested remove operation key=W1T4O3EAE7JN tag=GYGK7XYYU08J type=del 2024-06-04T15:59:25.120 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.120+0000 7f5e9aacc780 1 > prepared operation key=PNDPO2WUW7UX tag=LU55P8YES83Y type=del size=2128282 2024-06-04T15:59:25.121 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.121+0000 7f5e9aacc780 1 < completed part key=_multipart_PASGIP872OVX.2~ZTBPF0RBF4I7.0 size=10149 2024-06-04T15:59:25.124 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.123+0000 7f5e9aacc780 1 < completed multipart upload key=PASGIP872OVX upload=ZTBPF0RBF4I7 tag=QFZYF38N9XF5 type=write size=1058725 2024-06-04T15:59:25.126 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.126+0000 7f5e9aacc780 1 > prepared part key=_multipart_HD6SNICRCDLL.2~JZN9S4DESWJR.0 size=1048576 2024-06-04T15:59:25.127 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.127+0000 7f5e9aacc780 1 > prepared part key=_multipart_HD6SNICRCDLL.2~JZN9S4DESWJR.1 size=1048576 2024-06-04T15:59:25.128 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.128+0000 7f5e9aacc780 1 > prepared part key=_multipart_HD6SNICRCDLL.2~JZN9S4DESWJR.2 size=305214 2024-06-04T15:59:25.128 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.128+0000 7f5e9aacc780 1 > prepared multipart upload key=HD6SNICRCDLL upload=JZN9S4DESWJR tag=Z74IBAG9U819 type=write size=3450942 2024-06-04T15:59:25.131 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.131+0000 7f5e9aacc780 1 < suggested remove operation key=2BT2AXKB1RTA tag=3O0S0B8DN5UA type=write 2024-06-04T15:59:25.132 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.132+0000 7f5e9aacc780 1 > prepared operation key=JL69PUHT6NNT tag=F6AK5KEV55OD type=del size=1287820 2024-06-04T15:59:25.134 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.133+0000 7f5e9aacc780 1 < completed part key=_multipart_7S9S3MIG7WIT.2~8KTS14VDNTPI.0 size=1048576 2024-06-04T15:59:25.135 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.135+0000 7f5e9aacc780 1 < completed part key=_multipart_7S9S3MIG7WIT.2~8KTS14VDNTPI.1 size=845153 2024-06-04T15:59:25.138 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.137+0000 7f5e9aacc780 1 < completed multipart upload key=7S9S3MIG7WIT upload=8KTS14VDNTPI tag=Y7Z5VU4VU2KH type=write size=2942305 2024-06-04T15:59:25.139 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.139+0000 7f5e9aacc780 1 > prepared operation key=K01DAK0M4I4M tag=CE47HSM3NM60 type=del size=2740985 2024-06-04T15:59:25.140 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.140+0000 7f5e9aacc780 1 < completed delete operation key=9MPRI6LW3956 tag=0XZRJBIGVWH1 type=del 2024-06-04T15:59:25.143 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.143+0000 7f5e9aacc780 1 > prepared part key=_multipart_1IKNQXU3Y2JJ.2~LAR9WDHC0MIK.0 size=1048576 2024-06-04T15:59:25.144 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.144+0000 7f5e9aacc780 1 > prepared part key=_multipart_1IKNQXU3Y2JJ.2~LAR9WDHC0MIK.1 size=423535 2024-06-04T15:59:25.144 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.144+0000 7f5e9aacc780 1 > prepared multipart upload key=1IKNQXU3Y2JJ upload=LAR9WDHC0MIK tag=M3CMF9PMXTNS type=write size=2520687 2024-06-04T15:59:25.145 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.145+0000 7f5e9aacc780 1 < completed delete operation key=FBV2MAG130M6 tag=JP1OACG57E4R type=del 2024-06-04T15:59:25.147 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.146+0000 7f5e9aacc780 1 > prepared operation key=03ZNYG3WLMP4 tag=N866HUYYQSDA type=del size=2180307 2024-06-04T15:59:25.148 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.148+0000 7f5e9aacc780 1 < completed delete operation key=Q4OFQI0F5YLG tag=77DGAQNOZTQG type=del 2024-06-04T15:59:25.150 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.149+0000 7f5e9aacc780 1 > prepared operation key=7S9S3MIG7WIT tag=DTXL0DLRSLXM type=del size=3982422 2024-06-04T15:59:25.151 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.151+0000 7f5e9aacc780 1 < completed write operation key=K01DAK0M4I4M tag=0GXB96538HCZ type=write size=62115 2024-06-04T15:59:25.152 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.152+0000 7f5e9aacc780 1 > prepared operation key=FBV2MAG130M6 tag=B897H3TYL25C type=write size=530527 2024-06-04T15:59:25.154 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.154+0000 7f5e9aacc780 1 < completed part key=_multipart_PNDPO2WUW7UX.2~IC1HSS9NL7IN.0 size=1048576 2024-06-04T15:59:25.155 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.155+0000 7f5e9aacc780 1 < completed part key=_multipart_PNDPO2WUW7UX.2~IC1HSS9NL7IN.1 size=85851 2024-06-04T15:59:25.157 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.157+0000 7f5e9aacc780 1 < completed multipart upload key=PNDPO2WUW7UX upload=IC1HSS9NL7IN tag=3IW39NIQPVB2 type=write size=2183003 2024-06-04T15:59:25.160 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.160+0000 7f5e9aacc780 1 > prepared part key=_multipart_RP8K6QJUZAH1.2~I38ZAXAA36YY.0 size=1048576 2024-06-04T15:59:25.161 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.161+0000 7f5e9aacc780 1 > prepared part key=_multipart_RP8K6QJUZAH1.2~I38ZAXAA36YY.1 size=1048576 2024-06-04T15:59:25.162 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.162+0000 7f5e9aacc780 1 > prepared part key=_multipart_RP8K6QJUZAH1.2~I38ZAXAA36YY.2 size=910252 2024-06-04T15:59:25.162 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.162+0000 7f5e9aacc780 1 > prepared multipart upload key=RP8K6QJUZAH1 upload=I38ZAXAA36YY tag=EWLMKR291SGJ type=write size=4055980 2024-06-04T15:59:25.164 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.163+0000 7f5e9aacc780 1 < completed delete operation key=K01DAK0M4I4M tag=V3ZD4GM3V18N type=del 2024-06-04T15:59:25.165 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.165+0000 7f5e9aacc780 1 > prepared operation key=JL69PUHT6NNT tag=N7MV5IDWT3EF type=del size=1710831 2024-06-04T15:59:25.166 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.166+0000 7f5e9aacc780 1 < canceled operation key=GCPC9OJH7KWU tag=L7XDFJNOEE6N type=del size=3115064 2024-06-04T15:59:25.169 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.169+0000 7f5e9aacc780 1 > prepared part key=_multipart_JL69PUHT6NNT.2~I0G1D7YV9AIW.0 size=774621 2024-06-04T15:59:25.169 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.169+0000 7f5e9aacc780 1 > prepared multipart upload key=JL69PUHT6NNT upload=I0G1D7YV9AIW tag=C0CTJ4RSAF8I type=write size=1823197 2024-06-04T15:59:25.170 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.170+0000 7f5e9aacc780 1 < completed part key=_multipart_TUGKW7F4V9NO.2~8C05FLC8CI5S.0 size=1048576 2024-06-04T15:59:25.171 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.171+0000 7f5e9aacc780 1 < completed part key=_multipart_TUGKW7F4V9NO.2~8C05FLC8CI5S.1 size=1048576 2024-06-04T15:59:25.172 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.171+0000 7f5e9aacc780 1 < canceled part key=_multipart_TUGKW7F4V9NO.2~8C05FLC8CI5S.2 size=510546 2024-06-04T15:59:25.175 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.174+0000 7f5e9aacc780 1 < canceled multipart upload key=TUGKW7F4V9NO upload=8C05FLC8CI5S tag=QD6EHN97NY6U type=write size=3656274 2024-06-04T15:59:25.183 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.182+0000 7f5e9aacc780 1 > prepared part key=_multipart_Q4OFQI0F5YLG.2~6GXQHJYVLV2K.0 size=828074 2024-06-04T15:59:25.183 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.182+0000 7f5e9aacc780 1 > prepared multipart upload key=Q4OFQI0F5YLG upload=6GXQHJYVLV2K tag=BB2S3YF6482T type=write size=1876650 2024-06-04T15:59:25.186 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.185+0000 7f5e9aacc780 1 < suggested remove operation key=JL69PUHT6NNT tag=KVQ43V2PIHVG type=del 2024-06-04T15:59:25.188 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.188+0000 7f5e9aacc780 1 > prepared part key=_multipart_W1T4O3EAE7JN.2~RTX8KX5PU16X.0 size=1048576 2024-06-04T15:59:25.189 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.189+0000 7f5e9aacc780 1 > prepared part key=_multipart_W1T4O3EAE7JN.2~RTX8KX5PU16X.1 size=1048576 2024-06-04T15:59:25.191 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.190+0000 7f5e9aacc780 1 > prepared part key=_multipart_W1T4O3EAE7JN.2~RTX8KX5PU16X.2 size=498807 2024-06-04T15:59:25.191 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.190+0000 7f5e9aacc780 1 > prepared multipart upload key=W1T4O3EAE7JN upload=RTX8KX5PU16X tag=E79CKF7JF3QK type=write size=3644535 2024-06-04T15:59:25.192 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.192+0000 7f5e9aacc780 1 < completed part key=_multipart_NHPH4LYPP0LL.2~K4G56ZFJ6E6J.0 size=1048576 2024-06-04T15:59:25.193 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.194+0000 7f5e9aacc780 1 < completed part key=_multipart_NHPH4LYPP0LL.2~K4G56ZFJ6E6J.1 size=1048576 2024-06-04T15:59:25.195 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.194+0000 7f5e9aacc780 1 < completed part key=_multipart_NHPH4LYPP0LL.2~K4G56ZFJ6E6J.2 size=871858 2024-06-04T15:59:25.197 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.197+0000 7f5e9aacc780 1 < completed multipart upload key=NHPH4LYPP0LL upload=K4G56ZFJ6E6J tag=49EL96IIM8AH type=write size=4017586 2024-06-04T15:59:25.199 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.198+0000 7f5e9aacc780 1 > prepared operation key=4W5HB9WQQHR6 tag=4V3BPJ325BEJ type=del size=987054 2024-06-04T15:59:25.200 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.200+0000 7f5e9aacc780 1 < completed delete operation key=UTZHANL9ER2Q tag=FZ33ZRAEDF0T type=del 2024-06-04T15:59:25.202 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.201+0000 7f5e9aacc780 1 > prepared operation key=SUBHZJ7HUV3H tag=LC3VIU9F0A9M type=del size=2202529 2024-06-04T15:59:25.203 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.203+0000 7f5e9aacc780 1 < completed delete operation key=HD6SNICRCDLL tag=LE195TT7HWM3 type=del 2024-06-04T15:59:25.205 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.205+0000 7f5e9aacc780 1 > prepared part key=_multipart_XH0N984YVGKP.2~U4K3YOBIC0O8.0 size=1048576 2024-06-04T15:59:25.207 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.207+0000 7f5e9aacc780 1 > prepared part key=_multipart_XH0N984YVGKP.2~U4K3YOBIC0O8.1 size=1048576 2024-06-04T15:59:25.208 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.208+0000 7f5e9aacc780 1 > prepared part key=_multipart_XH0N984YVGKP.2~U4K3YOBIC0O8.2 size=936025 2024-06-04T15:59:25.208 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.208+0000 7f5e9aacc780 1 > prepared multipart upload key=XH0N984YVGKP upload=U4K3YOBIC0O8 tag=PH3T6XUZVIJE type=write size=4081753 2024-06-04T15:59:25.210 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.209+0000 7f5e9aacc780 1 < canceled operation key=PNDPO2WUW7UX tag=LU55P8YES83Y type=del size=2128282 2024-06-04T15:59:25.212 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.212+0000 7f5e9aacc780 1 > prepared part key=_multipart_K01DAK0M4I4M.2~YI23EYQR4EA6.0 size=1048576 2024-06-04T15:59:25.213 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.213+0000 7f5e9aacc780 1 > prepared part key=_multipart_K01DAK0M4I4M.2~YI23EYQR4EA6.1 size=70264 2024-06-04T15:59:25.213 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.213+0000 7f5e9aacc780 1 > prepared multipart upload key=K01DAK0M4I4M upload=YI23EYQR4EA6 tag=3M3P9BYH7HTD type=write size=2167416 2024-06-04T15:59:25.214 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.213+0000 7f5e9aacc780 1 < canceled part key=_multipart_HD6SNICRCDLL.2~JZN9S4DESWJR.0 size=1048576 2024-06-04T15:59:25.215 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.214+0000 7f5e9aacc780 1 < completed part key=_multipart_HD6SNICRCDLL.2~JZN9S4DESWJR.1 size=1048576 2024-06-04T15:59:25.216 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.216+0000 7f5e9aacc780 1 < completed part key=_multipart_HD6SNICRCDLL.2~JZN9S4DESWJR.2 size=305214 2024-06-04T15:59:25.218 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.218+0000 7f5e9aacc780 1 < canceled multipart upload key=HD6SNICRCDLL upload=JZN9S4DESWJR tag=Z74IBAG9U819 type=write size=3450942 2024-06-04T15:59:25.220 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.219+0000 7f5e9aacc780 1 > prepared operation key=Q2V1ICTBSCV1 tag=1RM13L5V51KS type=write size=780126 2024-06-04T15:59:25.221 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.221+0000 7f5e9aacc780 -1 < failed to complete operation key=JL69PUHT6NNT tag=F6AK5KEV55OD type=del size=1287820: (22) Invalid argument 2024-06-04T15:59:25.223 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.223+0000 7f5e9aacc780 1 > prepared operation key=PNDPO2WUW7UX tag=Y75VQ2GQ0Y9X type=del size=2668051 2024-06-04T15:59:25.226 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.226+0000 7f5e9aacc780 1 < suggested remove operation key=K01DAK0M4I4M tag=CE47HSM3NM60 type=del 2024-06-04T15:59:25.229 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.228+0000 7f5e9aacc780 1 > prepared part key=_multipart_PNDPO2WUW7UX.2~GTZWDD7KZPP8.0 size=1048576 2024-06-04T15:59:25.230 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.229+0000 7f5e9aacc780 1 > prepared part key=_multipart_PNDPO2WUW7UX.2~GTZWDD7KZPP8.1 size=1048576 2024-06-04T15:59:25.231 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.231+0000 7f5e9aacc780 1 > prepared part key=_multipart_PNDPO2WUW7UX.2~GTZWDD7KZPP8.2 size=479473 2024-06-04T15:59:25.231 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.231+0000 7f5e9aacc780 1 > prepared multipart upload key=PNDPO2WUW7UX upload=GTZWDD7KZPP8 tag=7X85OBLV3VQL type=write size=3625201 2024-06-04T15:59:25.232 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.232+0000 7f5e9aacc780 1 < completed part key=_multipart_1IKNQXU3Y2JJ.2~LAR9WDHC0MIK.0 size=1048576 2024-06-04T15:59:25.234 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.233+0000 7f5e9aacc780 1 < completed part key=_multipart_1IKNQXU3Y2JJ.2~LAR9WDHC0MIK.1 size=423535 2024-06-04T15:59:25.236 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.236+0000 7f5e9aacc780 1 < completed multipart upload key=1IKNQXU3Y2JJ upload=LAR9WDHC0MIK tag=M3CMF9PMXTNS type=write size=2520687 2024-06-04T15:59:25.238 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.237+0000 7f5e9aacc780 1 > prepared operation key=K01DAK0M4I4M tag=BVLUN8IGPTOL type=del size=1752568 2024-06-04T15:59:25.239 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.239+0000 7f5e9aacc780 1 < canceled operation key=03ZNYG3WLMP4 tag=N866HUYYQSDA type=del size=2180307 2024-06-04T15:59:25.241 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.241+0000 7f5e9aacc780 1 > prepared operation key=QJA2JPATITNH tag=658GRD0BF4IW type=del size=200894 2024-06-04T15:59:25.242 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.242+0000 7f5e9aacc780 1 < completed delete operation key=7S9S3MIG7WIT tag=DTXL0DLRSLXM type=del 2024-06-04T15:59:25.244 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.244+0000 7f5e9aacc780 1 > prepared operation key=03ZNYG3WLMP4 tag=BD8EB7PLAFMJ type=del size=971564 2024-06-04T15:59:25.246 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.245+0000 7f5e9aacc780 1 < completed write operation key=FBV2MAG130M6 tag=B897H3TYL25C type=write size=530527 2024-06-04T15:59:25.247 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.247+0000 7f5e9aacc780 1 > prepared operation key=B0HK5FJ2RGJE tag=6L9X629SZI3D type=del size=884413 2024-06-04T15:59:25.247 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.247+0000 7f5e9aacc780 1 < canceled part key=_multipart_RP8K6QJUZAH1.2~I38ZAXAA36YY.0 size=1048576 2024-06-04T15:59:25.248 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.247+0000 7f5e9aacc780 1 < canceled part key=_multipart_RP8K6QJUZAH1.2~I38ZAXAA36YY.1 size=1048576 2024-06-04T15:59:25.248 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.247+0000 7f5e9aacc780 1 < canceled part key=_multipart_RP8K6QJUZAH1.2~I38ZAXAA36YY.2 size=910252 2024-06-04T15:59:25.250 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.250+0000 7f5e9aacc780 1 < canceled multipart upload key=RP8K6QJUZAH1 upload=I38ZAXAA36YY tag=EWLMKR291SGJ type=write size=4055980 2024-06-04T15:59:25.251 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.251+0000 7f5e9aacc780 1 > prepared operation key=UW5LVIBG09SV tag=FZ5FUVKG7TUU type=del size=2143203 2024-06-04T15:59:25.252 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.252+0000 7f5e9aacc780 -1 < no bi entry to suggest for operation key=JL69PUHT6NNT tag=N7MV5IDWT3EF type=del size=1710831: (2) No such file or directory 2024-06-04T15:59:25.253 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.253+0000 7f5e9aacc780 1 > prepared operation key=JL69PUHT6NNT tag=W3LIYSBS3C5A type=del size=2432 2024-06-04T15:59:25.255 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.254+0000 7f5e9aacc780 1 < completed part key=_multipart_JL69PUHT6NNT.2~I0G1D7YV9AIW.0 size=774621 2024-06-04T15:59:25.257 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.257+0000 7f5e9aacc780 1 < completed multipart upload key=JL69PUHT6NNT upload=I0G1D7YV9AIW tag=C0CTJ4RSAF8I type=write size=1823197 2024-06-04T15:59:25.260 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.259+0000 7f5e9aacc780 1 > prepared part key=_multipart_B0HK5FJ2RGJE.2~AL2A0DYST8ES.0 size=1048576 2024-06-04T15:59:25.261 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.260+0000 7f5e9aacc780 1 > prepared part key=_multipart_B0HK5FJ2RGJE.2~AL2A0DYST8ES.1 size=239538 2024-06-04T15:59:25.261 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.260+0000 7f5e9aacc780 1 > prepared multipart upload key=B0HK5FJ2RGJE upload=AL2A0DYST8ES tag=5AC3RGLXYGVQ type=write size=2336690 2024-06-04T15:59:25.261 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.261+0000 7f5e9aacc780 1 < canceled part key=_multipart_Q4OFQI0F5YLG.2~6GXQHJYVLV2K.0 size=828074 2024-06-04T15:59:25.263 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.263+0000 7f5e9aacc780 1 < canceled multipart upload key=Q4OFQI0F5YLG upload=6GXQHJYVLV2K tag=BB2S3YF6482T type=write size=1876650 2024-06-04T15:59:25.264 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.264+0000 7f5e9aacc780 1 > prepared operation key=GTRMEQJK675Z tag=W1F41AL3Y8QP type=write size=291670 2024-06-04T15:59:25.266 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.266+0000 7f5e9aacc780 1 < completed part key=_multipart_W1T4O3EAE7JN.2~RTX8KX5PU16X.0 size=1048576 2024-06-04T15:59:25.267 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.267+0000 7f5e9aacc780 1 < completed part key=_multipart_W1T4O3EAE7JN.2~RTX8KX5PU16X.1 size=1048576 2024-06-04T15:59:25.267 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.267+0000 7f5e9aacc780 1 < canceled part key=_multipart_W1T4O3EAE7JN.2~RTX8KX5PU16X.2 size=498807 2024-06-04T15:59:25.269 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.269+0000 7f5e9aacc780 1 < canceled multipart upload key=W1T4O3EAE7JN upload=RTX8KX5PU16X tag=E79CKF7JF3QK type=write size=3644535 2024-06-04T15:59:25.272 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.272+0000 7f5e9aacc780 1 > prepared part key=_multipart_DY9JWHWNAUO1.2~9YOF9WB0A7B1.0 size=1048576 2024-06-04T15:59:25.273 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.273+0000 7f5e9aacc780 1 > prepared part key=_multipart_DY9JWHWNAUO1.2~9YOF9WB0A7B1.1 size=904385 2024-06-04T15:59:25.273 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.273+0000 7f5e9aacc780 1 > prepared multipart upload key=DY9JWHWNAUO1 upload=9YOF9WB0A7B1 tag=J9WSJA1SAMZW type=write size=3001537 2024-06-04T15:59:25.274 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.274+0000 7f5e9aacc780 1 < completed delete operation key=4W5HB9WQQHR6 tag=4V3BPJ325BEJ type=del 2024-06-04T15:59:25.278 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.278+0000 7f5e9aacc780 1 > prepared part key=_multipart_HD6SNICRCDLL.2~KQNOYTTV8LSH.0 size=683151 2024-06-04T15:59:25.278 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.278+0000 7f5e9aacc780 1 > prepared multipart upload key=HD6SNICRCDLL upload=KQNOYTTV8LSH tag=UG3EHO4TDC2E type=write size=1731727 2024-06-04T15:59:25.280 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.280+0000 7f5e9aacc780 1 < completed delete operation key=SUBHZJ7HUV3H tag=LC3VIU9F0A9M type=del 2024-06-04T15:59:25.282 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.282+0000 7f5e9aacc780 1 > prepared operation key=Q2V1ICTBSCV1 tag=V5TOBYJEVORL type=del size=759959 2024-06-04T15:59:25.284 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.283+0000 7f5e9aacc780 1 < completed part key=_multipart_XH0N984YVGKP.2~U4K3YOBIC0O8.0 size=1048576 2024-06-04T15:59:25.285 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.284+0000 7f5e9aacc780 1 < completed part key=_multipart_XH0N984YVGKP.2~U4K3YOBIC0O8.1 size=1048576 2024-06-04T15:59:25.285 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.284+0000 7f5e9aacc780 1 < canceled part key=_multipart_XH0N984YVGKP.2~U4K3YOBIC0O8.2 size=936025 2024-06-04T15:59:25.288 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.288+0000 7f5e9aacc780 1 < canceled multipart upload key=XH0N984YVGKP upload=U4K3YOBIC0O8 tag=PH3T6XUZVIJE type=write size=4081753 2024-06-04T15:59:25.290 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.290+0000 7f5e9aacc780 1 > prepared part key=_multipart_AOCB36Y5Q7B0.2~9KCOSDGSEL5L.0 size=1048576 2024-06-04T15:59:25.291 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.291+0000 7f5e9aacc780 1 > prepared part key=_multipart_AOCB36Y5Q7B0.2~9KCOSDGSEL5L.1 size=517989 2024-06-04T15:59:25.291 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.291+0000 7f5e9aacc780 1 > prepared multipart upload key=AOCB36Y5Q7B0 upload=9KCOSDGSEL5L tag=FTMKJDWVRU7W type=write size=2615141 2024-06-04T15:59:25.293 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.293+0000 7f5e9aacc780 1 < completed part key=_multipart_K01DAK0M4I4M.2~YI23EYQR4EA6.0 size=1048576 2024-06-04T15:59:25.294 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.294+0000 7f5e9aacc780 1 < completed part key=_multipart_K01DAK0M4I4M.2~YI23EYQR4EA6.1 size=70264 2024-06-04T15:59:25.297 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.296+0000 7f5e9aacc780 1 < completed multipart upload key=K01DAK0M4I4M upload=YI23EYQR4EA6 tag=3M3P9BYH7HTD type=write size=2167416 2024-06-04T15:59:25.298 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.298+0000 7f5e9aacc780 1 > prepared operation key=B0HK5FJ2RGJE tag=F6XCQZCLD7OI type=write size=71819 2024-06-04T15:59:25.301 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.302+0000 7f5e9aacc780 1 < suggested remove operation key=Q2V1ICTBSCV1 tag=1RM13L5V51KS type=write 2024-06-04T15:59:25.303 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.303+0000 7f5e9aacc780 1 > prepared operation key=A8O0S3S45RGM tag=H9P2BWZ0OYZ6 type=del size=2450414 2024-06-04T15:59:25.304 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.304+0000 7f5e9aacc780 1 < completed delete operation key=PNDPO2WUW7UX tag=Y75VQ2GQ0Y9X type=del 2024-06-04T15:59:25.306 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.306+0000 7f5e9aacc780 1 > prepared operation key=AOCB36Y5Q7B0 tag=XOV9A52FJJNS type=write size=653316 2024-06-04T15:59:25.307 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.307+0000 7f5e9aacc780 1 < completed part key=_multipart_PNDPO2WUW7UX.2~GTZWDD7KZPP8.0 size=1048576 2024-06-04T15:59:25.309 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.308+0000 7f5e9aacc780 1 < completed part key=_multipart_PNDPO2WUW7UX.2~GTZWDD7KZPP8.1 size=1048576 2024-06-04T15:59:25.310 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.310+0000 7f5e9aacc780 1 < completed part key=_multipart_PNDPO2WUW7UX.2~GTZWDD7KZPP8.2 size=479473 2024-06-04T15:59:25.313 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.312+0000 7f5e9aacc780 1 < completed multipart upload key=PNDPO2WUW7UX upload=GTZWDD7KZPP8 tag=7X85OBLV3VQL type=write size=3625201 2024-06-04T15:59:25.314 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.314+0000 7f5e9aacc780 1 > prepared operation key=1IKNQXU3Y2JJ tag=B96N5TFH4XJX type=write size=1031783 2024-06-04T15:59:25.315 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.315+0000 7f5e9aacc780 1 < completed delete operation key=K01DAK0M4I4M tag=BVLUN8IGPTOL type=del 2024-06-04T15:59:25.317 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.316+0000 7f5e9aacc780 1 > prepared operation key=RP8K6QJUZAH1 tag=IH7ETL2ZS09M type=del size=639745 2024-06-04T15:59:25.318 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.318+0000 7f5e9aacc780 1 < completed delete operation key=QJA2JPATITNH tag=658GRD0BF4IW type=del 2024-06-04T15:59:25.319 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.319+0000 7f5e9aacc780 1 > prepared operation key=UTZHANL9ER2Q tag=JKXFOL79F2WZ type=del size=576152 2024-06-04T15:59:25.322 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.322+0000 7f5e9aacc780 1 < suggested update operation key=03ZNYG3WLMP4 tag=BD8EB7PLAFMJ type=del size=971564 2024-06-04T15:59:25.323 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.323+0000 7f5e9aacc780 1 > prepared operation key=HD6SNICRCDLL tag=XDWERK3U0J6Z type=write size=687237 2024-06-04T15:59:25.325 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.325+0000 7f5e9aacc780 1 < completed delete operation key=B0HK5FJ2RGJE tag=6L9X629SZI3D type=del 2024-06-04T15:59:25.326 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.326+0000 7f5e9aacc780 1 > prepared operation key=2BT2AXKB1RTA tag=NZXRBPSSBUPM type=del size=2708906 2024-06-04T15:59:25.328 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.327+0000 7f5e9aacc780 1 < completed delete operation key=UW5LVIBG09SV tag=FZ5FUVKG7TUU type=del 2024-06-04T15:59:25.329 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.329+0000 7f5e9aacc780 1 > prepared operation key=HD6SNICRCDLL tag=PADCX4L3JN9G type=del size=3874833 2024-06-04T15:59:25.330 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.330+0000 7f5e9aacc780 1 < completed delete operation key=JL69PUHT6NNT tag=W3LIYSBS3C5A type=del 2024-06-04T15:59:25.333 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.333+0000 7f5e9aacc780 1 > prepared part key=_multipart_XH0N984YVGKP.2~KGX8CIDFY8IX.0 size=1048576 2024-06-04T15:59:25.334 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.334+0000 7f5e9aacc780 1 > prepared part key=_multipart_XH0N984YVGKP.2~KGX8CIDFY8IX.1 size=438899 2024-06-04T15:59:25.334 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.334+0000 7f5e9aacc780 1 > prepared multipart upload key=XH0N984YVGKP upload=KGX8CIDFY8IX tag=5Y70PFKHI8M0 type=write size=2536051 2024-06-04T15:59:25.335 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.335+0000 7f5e9aacc780 1 < completed part key=_multipart_B0HK5FJ2RGJE.2~AL2A0DYST8ES.0 size=1048576 2024-06-04T15:59:25.336 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.335+0000 7f5e9aacc780 1 < canceled part key=_multipart_B0HK5FJ2RGJE.2~AL2A0DYST8ES.1 size=239538 2024-06-04T15:59:25.338 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.337+0000 7f5e9aacc780 1 < canceled multipart upload key=B0HK5FJ2RGJE upload=AL2A0DYST8ES tag=5AC3RGLXYGVQ type=write size=2336690 2024-06-04T15:59:25.339 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.339+0000 7f5e9aacc780 1 > prepared operation key=QUIVPH3OB6KN tag=OLJZ83ZA5E77 type=del size=73865 2024-06-04T15:59:25.340 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.340+0000 7f5e9aacc780 1 < completed write operation key=GTRMEQJK675Z tag=W1F41AL3Y8QP type=write size=291670 2024-06-04T15:59:25.342 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.342+0000 7f5e9aacc780 1 > prepared operation key=Q4OFQI0F5YLG tag=UZ1ZYD9WI7JZ type=del size=3111489 2024-06-04T15:59:25.343 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.343+0000 7f5e9aacc780 1 < completed part key=_multipart_DY9JWHWNAUO1.2~9YOF9WB0A7B1.0 size=1048576 2024-06-04T15:59:25.344 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.344+0000 7f5e9aacc780 1 < completed part key=_multipart_DY9JWHWNAUO1.2~9YOF9WB0A7B1.1 size=904385 2024-06-04T15:59:25.347 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.346+0000 7f5e9aacc780 1 < completed multipart upload key=DY9JWHWNAUO1 upload=9YOF9WB0A7B1 tag=J9WSJA1SAMZW type=write size=3001537 2024-06-04T15:59:25.348 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.348+0000 7f5e9aacc780 1 > prepared operation key=A8O0S3S45RGM tag=29HYB0D6P22W type=del size=3977895 2024-06-04T15:59:25.350 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.349+0000 7f5e9aacc780 1 < completed part key=_multipart_HD6SNICRCDLL.2~KQNOYTTV8LSH.0 size=683151 2024-06-04T15:59:25.352 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.352+0000 7f5e9aacc780 1 < completed multipart upload key=HD6SNICRCDLL upload=KQNOYTTV8LSH tag=UG3EHO4TDC2E type=write size=1731727 2024-06-04T15:59:25.354 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.353+0000 7f5e9aacc780 1 > prepared operation key=UW5LVIBG09SV tag=2EQKZUFY7YGQ type=del size=1619534 2024-06-04T15:59:25.355 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.355+0000 7f5e9aacc780 -1 < failed to complete operation key=Q2V1ICTBSCV1 tag=V5TOBYJEVORL type=del size=759959: (22) Invalid argument 2024-06-04T15:59:25.358 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.358+0000 7f5e9aacc780 1 > prepared part key=_multipart_4W5HB9WQQHR6.2~MWK7W32NBAQD.0 size=634553 2024-06-04T15:59:25.358 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.358+0000 7f5e9aacc780 1 > prepared multipart upload key=4W5HB9WQQHR6 upload=MWK7W32NBAQD tag=RX8CX3M28HHT type=write size=1683129 2024-06-04T15:59:25.359 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.359+0000 7f5e9aacc780 1 < completed part key=_multipart_AOCB36Y5Q7B0.2~9KCOSDGSEL5L.0 size=1048576 2024-06-04T15:59:25.360 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.360+0000 7f5e9aacc780 1 < completed part key=_multipart_AOCB36Y5Q7B0.2~9KCOSDGSEL5L.1 size=517989 2024-06-04T15:59:25.363 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.362+0000 7f5e9aacc780 1 < completed multipart upload key=AOCB36Y5Q7B0 upload=9KCOSDGSEL5L tag=FTMKJDWVRU7W type=write size=2615141 2024-06-04T15:59:25.364 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.364+0000 7f5e9aacc780 1 > prepared operation key=SUBHZJ7HUV3H tag=91BWRYABG0QP type=del size=1727627 2024-06-04T15:59:25.367 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.366+0000 7f5e9aacc780 1 < suggested remove operation key=B0HK5FJ2RGJE tag=F6XCQZCLD7OI type=write 2024-06-04T15:59:25.369 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.369+0000 7f5e9aacc780 1 > prepared part key=_multipart_4W5HB9WQQHR6.2~I6819A3M1OSQ.0 size=1048576 2024-06-04T15:59:25.370 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.370+0000 7f5e9aacc780 1 > prepared part key=_multipart_4W5HB9WQQHR6.2~I6819A3M1OSQ.1 size=415524 2024-06-04T15:59:25.370 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.370+0000 7f5e9aacc780 1 > prepared multipart upload key=4W5HB9WQQHR6 upload=I6819A3M1OSQ tag=YC6D1GVR0BQ1 type=write size=2512676 2024-06-04T15:59:25.372 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.372+0000 7f5e9aacc780 1 < completed delete operation key=A8O0S3S45RGM tag=H9P2BWZ0OYZ6 type=del 2024-06-04T15:59:25.375 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.374+0000 7f5e9aacc780 1 > prepared part key=_multipart_B0HK5FJ2RGJE.2~O7UL2B8RK0G0.0 size=1048576 2024-06-04T15:59:25.376 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.375+0000 7f5e9aacc780 1 > prepared part key=_multipart_B0HK5FJ2RGJE.2~O7UL2B8RK0G0.1 size=1048576 2024-06-04T15:59:25.377 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.376+0000 7f5e9aacc780 1 > prepared part key=_multipart_B0HK5FJ2RGJE.2~O7UL2B8RK0G0.2 size=938374 2024-06-04T15:59:25.377 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.377+0000 7f5e9aacc780 1 > prepared multipart upload key=B0HK5FJ2RGJE upload=O7UL2B8RK0G0 tag=HYNYIDR0N85I type=write size=4084102 2024-06-04T15:59:25.378 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.378+0000 7f5e9aacc780 1 < completed write operation key=AOCB36Y5Q7B0 tag=XOV9A52FJJNS type=write size=653316 2024-06-04T15:59:25.380 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.379+0000 7f5e9aacc780 1 > prepared operation key=Q2V1ICTBSCV1 tag=B2I420LME2N4 type=del size=1957689 2024-06-04T15:59:25.381 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.381+0000 7f5e9aacc780 1 < completed write operation key=1IKNQXU3Y2JJ tag=B96N5TFH4XJX type=write size=1031783 2024-06-04T15:59:25.383 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.383+0000 7f5e9aacc780 1 > prepared part key=_multipart_1IKNQXU3Y2JJ.2~VZZJGSUCE5IR.0 size=718241 2024-06-04T15:59:25.383 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.383+0000 7f5e9aacc780 1 > prepared multipart upload key=1IKNQXU3Y2JJ upload=VZZJGSUCE5IR tag=ED6POBC3MA59 type=write size=1766817 2024-06-04T15:59:25.385 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.384+0000 7f5e9aacc780 1 < completed delete operation key=RP8K6QJUZAH1 tag=IH7ETL2ZS09M type=del 2024-06-04T15:59:25.386 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.386+0000 7f5e9aacc780 1 > prepared operation key=UW5LVIBG09SV tag=ECK02DLA194J type=del size=1032870 2024-06-04T15:59:25.387 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.387+0000 7f5e9aacc780 1 < completed delete operation key=UTZHANL9ER2Q tag=JKXFOL79F2WZ type=del 2024-06-04T15:59:25.390 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.389+0000 7f5e9aacc780 1 > prepared part key=_multipart_NHPH4LYPP0LL.2~W80IIM1C06EM.0 size=1048576 2024-06-04T15:59:25.391 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.390+0000 7f5e9aacc780 1 > prepared part key=_multipart_NHPH4LYPP0LL.2~W80IIM1C06EM.1 size=430098 2024-06-04T15:59:25.391 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.390+0000 7f5e9aacc780 1 > prepared multipart upload key=NHPH4LYPP0LL upload=W80IIM1C06EM tag=15GZMVIHCUDR type=write size=2527250 2024-06-04T15:59:25.394 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.394+0000 7f5e9aacc780 1 < suggested update operation key=HD6SNICRCDLL tag=XDWERK3U0J6Z type=write size=687237 2024-06-04T15:59:25.395 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.395+0000 7f5e9aacc780 1 > prepared operation key=SUBHZJ7HUV3H tag=BZPGXEH8J1TG type=write size=732894 2024-06-04T15:59:25.397 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.396+0000 7f5e9aacc780 1 < canceled operation key=2BT2AXKB1RTA tag=NZXRBPSSBUPM type=del size=2708906 2024-06-04T15:59:25.398 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.398+0000 7f5e9aacc780 1 > prepared operation key=9MPRI6LW3956 tag=Q5EQ8QE54ZM5 type=del size=89466 2024-06-04T15:59:25.399 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.399+0000 7f5e9aacc780 -1 < failed to complete operation key=HD6SNICRCDLL tag=PADCX4L3JN9G type=del size=3874833: (22) Invalid argument 2024-06-04T15:59:25.402 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.402+0000 7f5e9aacc780 1 > prepared part key=_multipart_9MPRI6LW3956.2~OHMZCMLC2YLP.0 size=898428 2024-06-04T15:59:25.402 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.402+0000 7f5e9aacc780 1 > prepared multipart upload key=9MPRI6LW3956 upload=OHMZCMLC2YLP tag=987NJ50YUQIX type=write size=1947004 2024-06-04T15:59:25.403 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.403+0000 7f5e9aacc780 1 < completed part key=_multipart_XH0N984YVGKP.2~KGX8CIDFY8IX.0 size=1048576 2024-06-04T15:59:25.405 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.404+0000 7f5e9aacc780 1 < completed part key=_multipart_XH0N984YVGKP.2~KGX8CIDFY8IX.1 size=438899 2024-06-04T15:59:25.407 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.407+0000 7f5e9aacc780 1 < completed multipart upload key=XH0N984YVGKP upload=KGX8CIDFY8IX tag=5Y70PFKHI8M0 type=write size=2536051 2024-06-04T15:59:25.408 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.408+0000 7f5e9aacc780 1 > prepared operation key=4W5HB9WQQHR6 tag=1HVABN9KW2H4 type=del size=367172 2024-06-04T15:59:25.410 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.409+0000 7f5e9aacc780 1 < completed delete operation key=QUIVPH3OB6KN tag=OLJZ83ZA5E77 type=del 2024-06-04T15:59:25.413 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.413+0000 7f5e9aacc780 1 > prepared part key=_multipart_PNDPO2WUW7UX.2~LI5NGJEQFHGI.0 size=1048576 2024-06-04T15:59:25.414 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.414+0000 7f5e9aacc780 1 > prepared part key=_multipart_PNDPO2WUW7UX.2~LI5NGJEQFHGI.1 size=462642 2024-06-04T15:59:25.415 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.414+0000 7f5e9aacc780 1 > prepared multipart upload key=PNDPO2WUW7UX upload=LI5NGJEQFHGI tag=JSO8PBEOBJKB type=write size=2559794 2024-06-04T15:59:25.417 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.417+0000 7f5e9aacc780 1 < completed delete operation key=Q4OFQI0F5YLG tag=UZ1ZYD9WI7JZ type=del 2024-06-04T15:59:25.418 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.418+0000 7f5e9aacc780 1 > prepared operation key=JL69PUHT6NNT tag=4P66O2MCFUY5 type=del size=3043831 2024-06-04T15:59:25.421 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.421+0000 7f5e9aacc780 1 < suggested update operation key=A8O0S3S45RGM tag=29HYB0D6P22W type=del size=3977895 2024-06-04T15:59:25.422 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.422+0000 7f5e9aacc780 1 > prepared operation key=JL69PUHT6NNT tag=F3YRHITBAN2H type=del size=4158407 2024-06-04T15:59:25.423 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.423+0000 7f5e9aacc780 1 < completed delete operation key=UW5LVIBG09SV tag=2EQKZUFY7YGQ type=del 2024-06-04T15:59:25.426 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.425+0000 7f5e9aacc780 1 > prepared part key=_multipart_Q2V1ICTBSCV1.2~9CUL2PUGXGBI.0 size=1048576 2024-06-04T15:59:25.427 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.427+0000 7f5e9aacc780 1 > prepared part key=_multipart_Q2V1ICTBSCV1.2~9CUL2PUGXGBI.1 size=1048576 2024-06-04T15:59:25.428 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.428+0000 7f5e9aacc780 1 > prepared part key=_multipart_Q2V1ICTBSCV1.2~9CUL2PUGXGBI.2 size=885730 2024-06-04T15:59:25.428 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.428+0000 7f5e9aacc780 1 > prepared multipart upload key=Q2V1ICTBSCV1 upload=9CUL2PUGXGBI tag=FTEMNB9H3LLG type=write size=4031458 2024-06-04T15:59:25.429 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.429+0000 7f5e9aacc780 1 < completed part key=_multipart_4W5HB9WQQHR6.2~MWK7W32NBAQD.0 size=634553 2024-06-04T15:59:25.433 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.431+0000 7f5e9aacc780 1 < completed multipart upload key=4W5HB9WQQHR6 upload=MWK7W32NBAQD tag=RX8CX3M28HHT type=write size=1683129 2024-06-04T15:59:25.433 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.433+0000 7f5e9aacc780 1 > prepared operation key=UW5LVIBG09SV tag=LV0BT5LIVVHN type=del size=3552786 2024-06-04T15:59:25.434 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.434+0000 7f5e9aacc780 1 < completed delete operation key=SUBHZJ7HUV3H tag=91BWRYABG0QP type=del 2024-06-04T15:59:25.437 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.437+0000 7f5e9aacc780 1 > prepared part key=_multipart_SUBHZJ7HUV3H.2~HELK81FJGN14.0 size=1048576 2024-06-04T15:59:25.438 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.438+0000 7f5e9aacc780 1 > prepared part key=_multipart_SUBHZJ7HUV3H.2~HELK81FJGN14.1 size=1048576 2024-06-04T15:59:25.439 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.439+0000 7f5e9aacc780 1 > prepared part key=_multipart_SUBHZJ7HUV3H.2~HELK81FJGN14.2 size=547571 2024-06-04T15:59:25.439 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.439+0000 7f5e9aacc780 1 > prepared multipart upload key=SUBHZJ7HUV3H upload=HELK81FJGN14 tag=X1JRUA2QT6J7 type=write size=3693299 2024-06-04T15:59:25.441 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.440+0000 7f5e9aacc780 1 < completed part key=_multipart_4W5HB9WQQHR6.2~I6819A3M1OSQ.0 size=1048576 2024-06-04T15:59:25.442 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.442+0000 7f5e9aacc780 1 < completed part key=_multipart_4W5HB9WQQHR6.2~I6819A3M1OSQ.1 size=415524 2024-06-04T15:59:25.444 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.444+0000 7f5e9aacc780 1 < completed multipart upload key=4W5HB9WQQHR6 upload=I6819A3M1OSQ tag=YC6D1GVR0BQ1 type=write size=2512676 2024-06-04T15:59:25.447 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.446+0000 7f5e9aacc780 1 > prepared part key=_multipart_1IKNQXU3Y2JJ.2~5T2JA6N9DO8T.0 size=1048576 2024-06-04T15:59:25.448 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.447+0000 7f5e9aacc780 1 > prepared part key=_multipart_1IKNQXU3Y2JJ.2~5T2JA6N9DO8T.1 size=1048576 2024-06-04T15:59:25.449 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.448+0000 7f5e9aacc780 1 > prepared part key=_multipart_1IKNQXU3Y2JJ.2~5T2JA6N9DO8T.2 size=222755 2024-06-04T15:59:25.449 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.448+0000 7f5e9aacc780 1 > prepared multipart upload key=1IKNQXU3Y2JJ upload=5T2JA6N9DO8T tag=4IQ626PF9A1I type=write size=3368483 2024-06-04T15:59:25.450 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.450+0000 7f5e9aacc780 1 < completed part key=_multipart_B0HK5FJ2RGJE.2~O7UL2B8RK0G0.0 size=1048576 2024-06-04T15:59:25.451 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.451+0000 7f5e9aacc780 1 < completed part key=_multipart_B0HK5FJ2RGJE.2~O7UL2B8RK0G0.1 size=1048576 2024-06-04T15:59:25.452 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.452+0000 7f5e9aacc780 1 < completed part key=_multipart_B0HK5FJ2RGJE.2~O7UL2B8RK0G0.2 size=938374 2024-06-04T15:59:25.454 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.454+0000 7f5e9aacc780 1 < completed multipart upload key=B0HK5FJ2RGJE upload=O7UL2B8RK0G0 tag=HYNYIDR0N85I type=write size=4084102 2024-06-04T15:59:25.456 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.456+0000 7f5e9aacc780 1 > prepared operation key=NHPH4LYPP0LL tag=L9YMWKRJP7A4 type=del size=1931430 2024-06-04T15:59:25.457 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.457+0000 7f5e9aacc780 1 < completed delete operation key=Q2V1ICTBSCV1 tag=B2I420LME2N4 type=del 2024-06-04T15:59:25.460 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.459+0000 7f5e9aacc780 1 > prepared part key=_multipart_A8O0S3S45RGM.2~IHO9TAYTCE59.0 size=1048576 2024-06-04T15:59:25.461 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.461+0000 7f5e9aacc780 1 > prepared part key=_multipart_A8O0S3S45RGM.2~IHO9TAYTCE59.1 size=785897 2024-06-04T15:59:25.461 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.461+0000 7f5e9aacc780 1 > prepared multipart upload key=A8O0S3S45RGM upload=IHO9TAYTCE59 tag=X982QPH5492X type=write size=2883049 2024-06-04T15:59:25.462 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.462+0000 7f5e9aacc780 1 < completed part key=_multipart_1IKNQXU3Y2JJ.2~VZZJGSUCE5IR.0 size=718241 2024-06-04T15:59:25.464 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.464+0000 7f5e9aacc780 1 < completed multipart upload key=1IKNQXU3Y2JJ upload=VZZJGSUCE5IR tag=ED6POBC3MA59 type=write size=1766817 2024-06-04T15:59:25.466 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.466+0000 7f5e9aacc780 1 > prepared operation key=DY9JWHWNAUO1 tag=1YXMBATAYHHM type=del size=1615877 2024-06-04T15:59:25.468 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.467+0000 7f5e9aacc780 1 < completed delete operation key=UW5LVIBG09SV tag=ECK02DLA194J type=del 2024-06-04T15:59:25.470 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.470+0000 7f5e9aacc780 1 > prepared part key=_multipart_SUBHZJ7HUV3H.2~BU3BHD7AG1D5.0 size=1048576 2024-06-04T15:59:25.471 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.471+0000 7f5e9aacc780 1 > prepared part key=_multipart_SUBHZJ7HUV3H.2~BU3BHD7AG1D5.1 size=1015717 2024-06-04T15:59:25.471 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.471+0000 7f5e9aacc780 1 > prepared multipart upload key=SUBHZJ7HUV3H upload=BU3BHD7AG1D5 tag=LW13NF1ZAY1T type=write size=3112869 2024-06-04T15:59:25.472 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.472+0000 7f5e9aacc780 1 < completed part key=_multipart_NHPH4LYPP0LL.2~W80IIM1C06EM.0 size=1048576 2024-06-04T15:59:25.474 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.473+0000 7f5e9aacc780 1 < completed part key=_multipart_NHPH4LYPP0LL.2~W80IIM1C06EM.1 size=430098 2024-06-04T15:59:25.476 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.476+0000 7f5e9aacc780 1 < completed multipart upload key=NHPH4LYPP0LL upload=W80IIM1C06EM tag=15GZMVIHCUDR type=write size=2527250 2024-06-04T15:59:25.477 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.477+0000 7f5e9aacc780 1 > prepared operation key=NJ5U8JTT32QK tag=31YDQ477ST2U type=del size=3746054 2024-06-04T15:59:25.479 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.478+0000 7f5e9aacc780 1 < completed write operation key=SUBHZJ7HUV3H tag=BZPGXEH8J1TG type=write size=732894 2024-06-04T15:59:25.481 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.481+0000 7f5e9aacc780 1 > prepared part key=_multipart_03ZNYG3WLMP4.2~L4PTMSMX7W6P.0 size=650320 2024-06-04T15:59:25.481 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.481+0000 7f5e9aacc780 1 > prepared multipart upload key=03ZNYG3WLMP4 upload=L4PTMSMX7W6P tag=1UX2LJNBAV03 type=write size=1698896 2024-06-04T15:59:25.483 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.482+0000 7f5e9aacc780 1 < completed delete operation key=9MPRI6LW3956 tag=Q5EQ8QE54ZM5 type=del 2024-06-04T15:59:25.485 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.485+0000 7f5e9aacc780 1 > prepared part key=_multipart_7S9S3MIG7WIT.2~X4Z0CKJZCQES.0 size=1048576 2024-06-04T15:59:25.486 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.486+0000 7f5e9aacc780 1 > prepared part key=_multipart_7S9S3MIG7WIT.2~X4Z0CKJZCQES.1 size=622351 2024-06-04T15:59:25.486 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.486+0000 7f5e9aacc780 1 > prepared multipart upload key=7S9S3MIG7WIT upload=X4Z0CKJZCQES tag=T69QT6NFC3MO type=write size=2719503 2024-06-04T15:59:25.487 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.486+0000 7f5e9aacc780 1 < canceled part key=_multipart_9MPRI6LW3956.2~OHMZCMLC2YLP.0 size=898428 2024-06-04T15:59:25.489 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.489+0000 7f5e9aacc780 1 < canceled multipart upload key=9MPRI6LW3956 upload=OHMZCMLC2YLP tag=987NJ50YUQIX type=write size=1947004 2024-06-04T15:59:25.490 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.491+0000 7f5e9aacc780 1 > prepared operation key=GCPC9OJH7KWU tag=H26FGQURKDNJ type=del size=2476713 2024-06-04T15:59:25.492 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.492+0000 7f5e9aacc780 1 < canceled operation key=4W5HB9WQQHR6 tag=1HVABN9KW2H4 type=del size=367172 2024-06-04T15:59:25.494 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.494+0000 7f5e9aacc780 1 > prepared part key=_multipart_NJ5U8JTT32QK.2~C9BGR602UNG9.0 size=1048576 2024-06-04T15:59:25.496 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.496+0000 7f5e9aacc780 1 > prepared part key=_multipart_NJ5U8JTT32QK.2~C9BGR602UNG9.1 size=23446 2024-06-04T15:59:25.496 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.496+0000 7f5e9aacc780 1 > prepared multipart upload key=NJ5U8JTT32QK upload=C9BGR602UNG9 tag=3O2NHQE5K8L2 type=write size=2120598 2024-06-04T15:59:25.497 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.497+0000 7f5e9aacc780 1 < completed part key=_multipart_PNDPO2WUW7UX.2~LI5NGJEQFHGI.0 size=1048576 2024-06-04T15:59:25.498 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.498+0000 7f5e9aacc780 1 < completed part key=_multipart_PNDPO2WUW7UX.2~LI5NGJEQFHGI.1 size=462642 2024-06-04T15:59:25.500 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.500+0000 7f5e9aacc780 1 < completed multipart upload key=PNDPO2WUW7UX upload=LI5NGJEQFHGI tag=JSO8PBEOBJKB type=write size=2559794 2024-06-04T15:59:25.502 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.502+0000 7f5e9aacc780 1 > prepared operation key=QJA2JPATITNH tag=VATDP84CBY0P type=del size=1010133 2024-06-04T15:59:25.503 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.503+0000 7f5e9aacc780 1 < completed delete operation key=JL69PUHT6NNT tag=4P66O2MCFUY5 type=del 2024-06-04T15:59:25.504 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.504+0000 7f5e9aacc780 1 > prepared operation key=DY9JWHWNAUO1 tag=03XQ3T3C839Z type=write size=1032249 2024-06-04T15:59:25.507 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.507+0000 7f5e9aacc780 1 < suggested remove operation key=JL69PUHT6NNT tag=F3YRHITBAN2H type=del 2024-06-04T15:59:25.510 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.510+0000 7f5e9aacc780 1 > prepared part key=_multipart_A8O0S3S45RGM.2~4EH6AYXHO7ZM.0 size=391813 2024-06-04T15:59:25.510 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.510+0000 7f5e9aacc780 1 > prepared multipart upload key=A8O0S3S45RGM upload=4EH6AYXHO7ZM tag=SZCVTYCKZ6VY type=write size=1440389 2024-06-04T15:59:25.511 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.511+0000 7f5e9aacc780 1 < completed part key=_multipart_Q2V1ICTBSCV1.2~9CUL2PUGXGBI.0 size=1048576 2024-06-04T15:59:25.512 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.512+0000 7f5e9aacc780 1 < completed part key=_multipart_Q2V1ICTBSCV1.2~9CUL2PUGXGBI.1 size=1048576 2024-06-04T15:59:25.513 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.513+0000 7f5e9aacc780 1 < completed part key=_multipart_Q2V1ICTBSCV1.2~9CUL2PUGXGBI.2 size=885730 2024-06-04T15:59:25.516 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.515+0000 7f5e9aacc780 1 < completed multipart upload key=Q2V1ICTBSCV1 upload=9CUL2PUGXGBI tag=FTEMNB9H3LLG type=write size=4031458 2024-06-04T15:59:25.517 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.517+0000 7f5e9aacc780 1 > prepared operation key=NHPH4LYPP0LL tag=B99P8WIE8KIJ type=del size=1170036 2024-06-04T15:59:25.520 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.519+0000 7f5e9aacc780 1 < suggested remove operation key=UW5LVIBG09SV tag=LV0BT5LIVVHN type=del 2024-06-04T15:59:25.521 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.521+0000 7f5e9aacc780 1 > prepared operation key=RP8K6QJUZAH1 tag=8O0XFKWBM36I type=del size=476830 2024-06-04T15:59:25.523 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.522+0000 7f5e9aacc780 1 < completed part key=_multipart_SUBHZJ7HUV3H.2~HELK81FJGN14.0 size=1048576 2024-06-04T15:59:25.524 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.524+0000 7f5e9aacc780 1 < completed part key=_multipart_SUBHZJ7HUV3H.2~HELK81FJGN14.1 size=1048576 2024-06-04T15:59:25.525 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.525+0000 7f5e9aacc780 1 < completed part key=_multipart_SUBHZJ7HUV3H.2~HELK81FJGN14.2 size=547571 2024-06-04T15:59:25.527 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.527+0000 7f5e9aacc780 1 < completed multipart upload key=SUBHZJ7HUV3H upload=HELK81FJGN14 tag=X1JRUA2QT6J7 type=write size=3693299 2024-06-04T15:59:25.530 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.530+0000 7f5e9aacc780 1 > prepared part key=_multipart_FBV2MAG130M6.2~NPRJ3FG89DP1.0 size=344209 2024-06-04T15:59:25.530 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.530+0000 7f5e9aacc780 1 > prepared multipart upload key=FBV2MAG130M6 upload=NPRJ3FG89DP1 tag=3NYKJ2SAAV2P type=write size=1392785 2024-06-04T15:59:25.531 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.531+0000 7f5e9aacc780 1 < completed part key=_multipart_1IKNQXU3Y2JJ.2~5T2JA6N9DO8T.0 size=1048576 2024-06-04T15:59:25.532 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.532+0000 7f5e9aacc780 1 < completed part key=_multipart_1IKNQXU3Y2JJ.2~5T2JA6N9DO8T.1 size=1048576 2024-06-04T15:59:25.534 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.533+0000 7f5e9aacc780 1 < completed part key=_multipart_1IKNQXU3Y2JJ.2~5T2JA6N9DO8T.2 size=222755 2024-06-04T15:59:25.536 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.536+0000 7f5e9aacc780 1 < completed multipart upload key=1IKNQXU3Y2JJ upload=5T2JA6N9DO8T tag=4IQ626PF9A1I type=write size=3368483 2024-06-04T15:59:25.539 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.538+0000 7f5e9aacc780 1 > prepared part key=_multipart_K01DAK0M4I4M.2~VL26CMOGAFY3.0 size=1048576 2024-06-04T15:59:25.541 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.541+0000 7f5e9aacc780 1 > prepared part key=_multipart_K01DAK0M4I4M.2~VL26CMOGAFY3.1 size=1048576 2024-06-04T15:59:25.542 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.541+0000 7f5e9aacc780 1 > prepared part key=_multipart_K01DAK0M4I4M.2~VL26CMOGAFY3.2 size=34720 2024-06-04T15:59:25.542 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.541+0000 7f5e9aacc780 1 > prepared multipart upload key=K01DAK0M4I4M upload=VL26CMOGAFY3 tag=F7DTU65KGIVA type=write size=3180448 2024-06-04T15:59:25.543 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.543+0000 7f5e9aacc780 1 < completed delete operation key=NHPH4LYPP0LL tag=L9YMWKRJP7A4 type=del 2024-06-04T15:59:25.545 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.544+0000 7f5e9aacc780 1 > prepared operation key=Q2V1ICTBSCV1 tag=EMFDDSN7Z6DQ type=del size=3053403 2024-06-04T15:59:25.546 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.546+0000 7f5e9aacc780 1 < completed part key=_multipart_A8O0S3S45RGM.2~IHO9TAYTCE59.0 size=1048576 2024-06-04T15:59:25.547 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.547+0000 7f5e9aacc780 1 < completed part key=_multipart_A8O0S3S45RGM.2~IHO9TAYTCE59.1 size=785897 2024-06-04T15:59:25.549 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.549+0000 7f5e9aacc780 1 < completed multipart upload key=A8O0S3S45RGM upload=IHO9TAYTCE59 tag=X982QPH5492X type=write size=2883049 2024-06-04T15:59:25.551 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.551+0000 7f5e9aacc780 1 > prepared operation key=QJA2JPATITNH tag=X2XMLRV0O1PE type=del size=1565086 2024-06-04T15:59:25.554 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.553+0000 7f5e9aacc780 1 < suggested remove operation key=DY9JWHWNAUO1 tag=1YXMBATAYHHM type=del 2024-06-04T15:59:25.557 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.556+0000 7f5e9aacc780 1 > prepared part key=_multipart_03ZNYG3WLMP4.2~NM0QOB5KY7SQ.0 size=585539 2024-06-04T15:59:25.557 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.556+0000 7f5e9aacc780 1 > prepared multipart upload key=03ZNYG3WLMP4 upload=NM0QOB5KY7SQ tag=J7C8YXFZ81MI type=write size=1634115 2024-06-04T15:59:25.558 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.558+0000 7f5e9aacc780 1 < completed part key=_multipart_SUBHZJ7HUV3H.2~BU3BHD7AG1D5.0 size=1048576 2024-06-04T15:59:25.559 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.559+0000 7f5e9aacc780 1 < completed part key=_multipart_SUBHZJ7HUV3H.2~BU3BHD7AG1D5.1 size=1015717 2024-06-04T15:59:25.561 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.561+0000 7f5e9aacc780 1 < completed multipart upload key=SUBHZJ7HUV3H upload=BU3BHD7AG1D5 tag=LW13NF1ZAY1T type=write size=3112869 2024-06-04T15:59:25.563 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.562+0000 7f5e9aacc780 1 > prepared operation key=1IKNQXU3Y2JJ tag=F6W3E1XREEPD type=del size=3645197 2024-06-04T15:59:25.565 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.565+0000 7f5e9aacc780 1 < suggested update operation key=NJ5U8JTT32QK tag=31YDQ477ST2U type=del size=3746054 2024-06-04T15:59:25.566 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.566+0000 7f5e9aacc780 1 > prepared operation key=PASGIP872OVX tag=N5EBWFV1CGDA type=del size=1654872 2024-06-04T15:59:25.568 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.567+0000 7f5e9aacc780 1 < completed part key=_multipart_03ZNYG3WLMP4.2~L4PTMSMX7W6P.0 size=650320 2024-06-04T15:59:25.570 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.570+0000 7f5e9aacc780 1 < completed multipart upload key=03ZNYG3WLMP4 upload=L4PTMSMX7W6P tag=1UX2LJNBAV03 type=write size=1698896 2024-06-04T15:59:25.571 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.571+0000 7f5e9aacc780 1 > prepared operation key=1IKNQXU3Y2JJ tag=02YER5EBLRUR type=del size=1807183 2024-06-04T15:59:25.573 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.573+0000 7f5e9aacc780 1 < completed part key=_multipart_7S9S3MIG7WIT.2~X4Z0CKJZCQES.0 size=1048576 2024-06-04T15:59:25.574 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.574+0000 7f5e9aacc780 1 < completed part key=_multipart_7S9S3MIG7WIT.2~X4Z0CKJZCQES.1 size=622351 2024-06-04T15:59:25.577 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.576+0000 7f5e9aacc780 1 < completed multipart upload key=7S9S3MIG7WIT upload=X4Z0CKJZCQES tag=T69QT6NFC3MO type=write size=2719503 2024-06-04T15:59:25.578 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.577+0000 7f5e9aacc780 1 > prepared operation key=B0HK5FJ2RGJE tag=CR7DPOTDHD3M type=del size=556065 2024-06-04T15:59:25.579 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.579+0000 7f5e9aacc780 1 < completed delete operation key=GCPC9OJH7KWU tag=H26FGQURKDNJ type=del 2024-06-04T15:59:25.580 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.580+0000 7f5e9aacc780 1 > prepared operation key=2BT2AXKB1RTA tag=S8C10JDQ1VRJ type=del size=3085521 2024-06-04T15:59:25.582 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.582+0000 7f5e9aacc780 1 < completed part key=_multipart_NJ5U8JTT32QK.2~C9BGR602UNG9.0 size=1048576 2024-06-04T15:59:25.583 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.583+0000 7f5e9aacc780 1 < completed part key=_multipart_NJ5U8JTT32QK.2~C9BGR602UNG9.1 size=23446 2024-06-04T15:59:25.585 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.585+0000 7f5e9aacc780 1 < completed multipart upload key=NJ5U8JTT32QK upload=C9BGR602UNG9 tag=3O2NHQE5K8L2 type=write size=2120598 2024-06-04T15:59:25.587 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.586+0000 7f5e9aacc780 1 > prepared operation key=NHPH4LYPP0LL tag=7ZVMY7D9J3OJ type=write size=96137 2024-06-04T15:59:25.588 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.588+0000 7f5e9aacc780 1 < completed delete operation key=QJA2JPATITNH tag=VATDP84CBY0P type=del 2024-06-04T15:59:25.590 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.589+0000 7f5e9aacc780 1 > prepared operation key=UTZHANL9ER2Q tag=N18JUG7ON1T6 type=del size=3935621 2024-06-04T15:59:25.591 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.591+0000 7f5e9aacc780 -1 < failed to complete operation key=DY9JWHWNAUO1 tag=03XQ3T3C839Z type=write size=1032249: (22) Invalid argument 2024-06-04T15:59:25.592 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.592+0000 7f5e9aacc780 1 > prepared operation key=Q4OFQI0F5YLG tag=EW6IBMO93BNW type=del size=1720929 2024-06-04T15:59:25.594 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.593+0000 7f5e9aacc780 1 < completed part key=_multipart_A8O0S3S45RGM.2~4EH6AYXHO7ZM.0 size=391813 2024-06-04T15:59:25.596 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.596+0000 7f5e9aacc780 1 < completed multipart upload key=A8O0S3S45RGM upload=4EH6AYXHO7ZM tag=SZCVTYCKZ6VY type=write size=1440389 2024-06-04T15:59:25.599 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.599+0000 7f5e9aacc780 1 > prepared part key=_multipart_QUIVPH3OB6KN.2~T1WBJHFBQEJO.0 size=1048576 2024-06-04T15:59:25.600 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.600+0000 7f5e9aacc780 1 > prepared part key=_multipart_QUIVPH3OB6KN.2~T1WBJHFBQEJO.1 size=1048576 2024-06-04T15:59:25.601 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.601+0000 7f5e9aacc780 1 > prepared part key=_multipart_QUIVPH3OB6KN.2~T1WBJHFBQEJO.2 size=813143 2024-06-04T15:59:25.601 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.601+0000 7f5e9aacc780 1 > prepared multipart upload key=QUIVPH3OB6KN upload=T1WBJHFBQEJO tag=VUFI2IEGQQI1 type=write size=3958871 2024-06-04T15:59:25.602 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.602+0000 7f5e9aacc780 1 < completed delete operation key=NHPH4LYPP0LL tag=B99P8WIE8KIJ type=del 2024-06-04T15:59:25.604 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.604+0000 7f5e9aacc780 1 > prepared operation key=NHPH4LYPP0LL tag=VAHNWTFE0BHY type=del size=2914194 2024-06-04T15:59:25.605 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.605+0000 7f5e9aacc780 1 < completed delete operation key=RP8K6QJUZAH1 tag=8O0XFKWBM36I type=del 2024-06-04T15:59:25.607 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.606+0000 7f5e9aacc780 1 > prepared operation key=7S9S3MIG7WIT tag=EMUZ88V0S1TT type=write size=512231 2024-06-04T15:59:25.608 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.608+0000 7f5e9aacc780 1 < completed part key=_multipart_FBV2MAG130M6.2~NPRJ3FG89DP1.0 size=344209 2024-06-04T15:59:25.610 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.610+0000 7f5e9aacc780 1 < completed multipart upload key=FBV2MAG130M6 upload=NPRJ3FG89DP1 tag=3NYKJ2SAAV2P type=write size=1392785 2024-06-04T15:59:25.612 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.611+0000 7f5e9aacc780 1 > prepared operation key=RP8K6QJUZAH1 tag=NTCUPU2125LU type=del size=1993700 2024-06-04T15:59:25.613 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.613+0000 7f5e9aacc780 1 < completed part key=_multipart_K01DAK0M4I4M.2~VL26CMOGAFY3.0 size=1048576 2024-06-04T15:59:25.614 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.614+0000 7f5e9aacc780 1 < completed part key=_multipart_K01DAK0M4I4M.2~VL26CMOGAFY3.1 size=1048576 2024-06-04T15:59:25.614 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.614+0000 7f5e9aacc780 1 < canceled part key=_multipart_K01DAK0M4I4M.2~VL26CMOGAFY3.2 size=34720 2024-06-04T15:59:25.617 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.617+0000 7f5e9aacc780 1 < canceled multipart upload key=K01DAK0M4I4M upload=VL26CMOGAFY3 tag=F7DTU65KGIVA type=write size=3180448 2024-06-04T15:59:25.620 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.619+0000 7f5e9aacc780 1 > prepared part key=_multipart_QJA2JPATITNH.2~36TBHS4LAW1I.0 size=1048576 2024-06-04T15:59:25.621 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.621+0000 7f5e9aacc780 1 > prepared part key=_multipart_QJA2JPATITNH.2~36TBHS4LAW1I.1 size=348482 2024-06-04T15:59:25.621 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.621+0000 7f5e9aacc780 1 > prepared multipart upload key=QJA2JPATITNH upload=36TBHS4LAW1I tag=761UJU4PZR8Q type=write size=2445634 2024-06-04T15:59:25.622 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.622+0000 7f5e9aacc780 1 < completed delete operation key=Q2V1ICTBSCV1 tag=EMFDDSN7Z6DQ type=del 2024-06-04T15:59:25.625 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.625+0000 7f5e9aacc780 1 > prepared part key=_multipart_GCPC9OJH7KWU.2~NOWPSK41V8UG.0 size=236022 2024-06-04T15:59:25.625 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.625+0000 7f5e9aacc780 1 > prepared multipart upload key=GCPC9OJH7KWU upload=NOWPSK41V8UG tag=MXN4L2614HPL type=write size=1284598 2024-06-04T15:59:25.627 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.627+0000 7f5e9aacc780 1 < completed delete operation key=QJA2JPATITNH tag=X2XMLRV0O1PE type=del 2024-06-04T15:59:25.628 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.628+0000 7f5e9aacc780 1 > prepared operation key=UW5LVIBG09SV tag=01CQ8N9C9EI5 type=del size=3693811 2024-06-04T15:59:25.630 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.630+0000 7f5e9aacc780 1 < completed part key=_multipart_03ZNYG3WLMP4.2~NM0QOB5KY7SQ.0 size=585539 2024-06-04T15:59:25.633 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.632+0000 7f5e9aacc780 1 < completed multipart upload key=03ZNYG3WLMP4 upload=NM0QOB5KY7SQ tag=J7C8YXFZ81MI type=write size=1634115 2024-06-04T15:59:25.634 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.634+0000 7f5e9aacc780 1 > prepared operation key=QUIVPH3OB6KN tag=ICF0ZMD8W1A8 type=write size=765036 2024-06-04T15:59:25.636 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.635+0000 7f5e9aacc780 1 < completed delete operation key=1IKNQXU3Y2JJ tag=F6W3E1XREEPD type=del 2024-06-04T15:59:25.637 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.637+0000 7f5e9aacc780 1 > prepared operation key=SUBHZJ7HUV3H tag=3TPD3FOJMUSD type=del size=3225544 2024-06-04T15:59:25.639 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.638+0000 7f5e9aacc780 1 < completed delete operation key=PASGIP872OVX tag=N5EBWFV1CGDA type=del 2024-06-04T15:59:25.640 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.640+0000 7f5e9aacc780 1 > prepared operation key=03ZNYG3WLMP4 tag=9PNLECI6N4VF type=write size=588006 2024-06-04T15:59:25.641 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.641+0000 7f5e9aacc780 1 < completed delete operation key=1IKNQXU3Y2JJ tag=02YER5EBLRUR type=del 2024-06-04T15:59:25.642 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.642+0000 7f5e9aacc780 1 > prepared operation key=Q2V1ICTBSCV1 tag=NEPIADT9Z81L type=del size=975601 2024-06-04T15:59:25.644 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.644+0000 7f5e9aacc780 1 < completed delete operation key=B0HK5FJ2RGJE tag=CR7DPOTDHD3M type=del 2024-06-04T15:59:25.645 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.645+0000 7f5e9aacc780 1 > prepared operation key=XH0N984YVGKP tag=5O9DW9GSCQW7 type=write size=615633 2024-06-04T15:59:25.647 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.646+0000 7f5e9aacc780 1 < canceled operation key=2BT2AXKB1RTA tag=S8C10JDQ1VRJ type=del size=3085521 2024-06-04T15:59:25.648 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.648+0000 7f5e9aacc780 1 > prepared operation key=DY9JWHWNAUO1 tag=8N0DF0E2QROT type=del size=994665 2024-06-04T15:59:25.649 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.649+0000 7f5e9aacc780 1 < completed write operation key=NHPH4LYPP0LL tag=7ZVMY7D9J3OJ type=write size=96137 2024-06-04T15:59:25.652 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.651+0000 7f5e9aacc780 1 > prepared part key=_multipart_PASGIP872OVX.2~EYNSXMZCB45C.0 size=823958 2024-06-04T15:59:25.652 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.651+0000 7f5e9aacc780 1 > prepared multipart upload key=PASGIP872OVX upload=EYNSXMZCB45C tag=Q3W0A251YT6T type=write size=1872534 2024-06-04T15:59:25.653 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.653+0000 7f5e9aacc780 1 < completed delete operation key=UTZHANL9ER2Q tag=N18JUG7ON1T6 type=del 2024-06-04T15:59:25.655 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.654+0000 7f5e9aacc780 1 > prepared operation key=2BT2AXKB1RTA tag=C7RBLRSZIZTU type=del size=3857221 2024-06-04T15:59:25.656 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.655+0000 7f5e9aacc780 1 < canceled operation key=Q4OFQI0F5YLG tag=EW6IBMO93BNW type=del size=1720929 2024-06-04T15:59:25.657 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.657+0000 7f5e9aacc780 1 > prepared operation key=Q4OFQI0F5YLG tag=2KEI350NSN5K type=del size=2222265 2024-06-04T15:59:25.658 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.658+0000 7f5e9aacc780 1 < completed part key=_multipart_QUIVPH3OB6KN.2~T1WBJHFBQEJO.0 size=1048576 2024-06-04T15:59:25.660 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.659+0000 7f5e9aacc780 1 < completed part key=_multipart_QUIVPH3OB6KN.2~T1WBJHFBQEJO.1 size=1048576 2024-06-04T15:59:25.661 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.660+0000 7f5e9aacc780 1 < completed part key=_multipart_QUIVPH3OB6KN.2~T1WBJHFBQEJO.2 size=813143 2024-06-04T15:59:25.663 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.663+0000 7f5e9aacc780 1 < completed multipart upload key=QUIVPH3OB6KN upload=T1WBJHFBQEJO tag=VUFI2IEGQQI1 type=write size=3958871 2024-06-04T15:59:25.664 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.664+0000 7f5e9aacc780 1 > prepared operation key=PNDPO2WUW7UX tag=3GV971O2KXO7 type=del size=3736278 2024-06-04T15:59:25.666 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.666+0000 7f5e9aacc780 1 < completed delete operation key=NHPH4LYPP0LL tag=VAHNWTFE0BHY type=del 2024-06-04T15:59:25.669 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.668+0000 7f5e9aacc780 1 > prepared part key=_multipart_GCPC9OJH7KWU.2~1UIS49T5O4VY.0 size=441807 2024-06-04T15:59:25.669 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.668+0000 7f5e9aacc780 1 > prepared multipart upload key=GCPC9OJH7KWU upload=1UIS49T5O4VY tag=DIEUWP7ZYM6C type=write size=1490383 2024-06-04T15:59:25.670 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.670+0000 7f5e9aacc780 1 < completed write operation key=7S9S3MIG7WIT tag=EMUZ88V0S1TT type=write size=512231 2024-06-04T15:59:25.673 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.673+0000 7f5e9aacc780 1 > prepared part key=_multipart_Q2V1ICTBSCV1.2~FN2FA9QTYF43.0 size=1048576 2024-06-04T15:59:25.674 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.674+0000 7f5e9aacc780 1 > prepared part key=_multipart_Q2V1ICTBSCV1.2~FN2FA9QTYF43.1 size=1048576 2024-06-04T15:59:25.675 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.675+0000 7f5e9aacc780 1 > prepared part key=_multipart_Q2V1ICTBSCV1.2~FN2FA9QTYF43.2 size=932483 2024-06-04T15:59:25.676 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.675+0000 7f5e9aacc780 1 > prepared multipart upload key=Q2V1ICTBSCV1 upload=FN2FA9QTYF43 tag=V8L7Y5TL3USF type=write size=4078211 2024-06-04T15:59:25.677 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.677+0000 7f5e9aacc780 1 < completed delete operation key=RP8K6QJUZAH1 tag=NTCUPU2125LU type=del 2024-06-04T15:59:25.679 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.678+0000 7f5e9aacc780 1 > prepared operation key=GCPC9OJH7KWU tag=7FPGZTMU91YH type=del size=798446 2024-06-04T15:59:25.680 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.680+0000 7f5e9aacc780 1 < completed part key=_multipart_QJA2JPATITNH.2~36TBHS4LAW1I.0 size=1048576 2024-06-04T15:59:25.682 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.681+0000 7f5e9aacc780 1 < completed part key=_multipart_QJA2JPATITNH.2~36TBHS4LAW1I.1 size=348482 2024-06-04T15:59:25.684 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.684+0000 7f5e9aacc780 1 < completed multipart upload key=QJA2JPATITNH upload=36TBHS4LAW1I tag=761UJU4PZR8Q type=write size=2445634 2024-06-04T15:59:25.686 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.685+0000 7f5e9aacc780 1 > prepared operation key=PASGIP872OVX tag=IC0QRFQP710X type=del size=2892871 2024-06-04T15:59:25.687 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.687+0000 7f5e9aacc780 1 < completed part key=_multipart_GCPC9OJH7KWU.2~NOWPSK41V8UG.0 size=236022 2024-06-04T15:59:25.689 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.689+0000 7f5e9aacc780 1 < completed multipart upload key=GCPC9OJH7KWU upload=NOWPSK41V8UG tag=MXN4L2614HPL type=write size=1284598 2024-06-04T15:59:25.691 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.690+0000 7f5e9aacc780 1 > prepared operation key=2BT2AXKB1RTA tag=1SOFRMT7DV7S type=del size=1824624 2024-06-04T15:59:25.694 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.693+0000 7f5e9aacc780 1 < suggested update operation key=UW5LVIBG09SV tag=01CQ8N9C9EI5 type=del size=3693811 2024-06-04T15:59:25.695 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.695+0000 7f5e9aacc780 1 > prepared operation key=Q2V1ICTBSCV1 tag=WI2LU2VI3YH1 type=del size=3905970 2024-06-04T15:59:25.697 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.696+0000 7f5e9aacc780 1 < canceled operation key=QUIVPH3OB6KN tag=ICF0ZMD8W1A8 type=write size=765036 2024-06-04T15:59:25.699 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.699+0000 7f5e9aacc780 1 > prepared part key=_multipart_1IKNQXU3Y2JJ.2~6N6NEIZP51FP.0 size=1048576 2024-06-04T15:59:25.700 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.700+0000 7f5e9aacc780 1 > prepared part key=_multipart_1IKNQXU3Y2JJ.2~6N6NEIZP51FP.1 size=1048576 2024-06-04T15:59:25.701 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.701+0000 7f5e9aacc780 1 > prepared part key=_multipart_1IKNQXU3Y2JJ.2~6N6NEIZP51FP.2 size=432962 2024-06-04T15:59:25.702 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.701+0000 7f5e9aacc780 1 > prepared multipart upload key=1IKNQXU3Y2JJ upload=6N6NEIZP51FP tag=WG4NVA41EODO type=write size=3578690 2024-06-04T15:59:25.704 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.704+0000 7f5e9aacc780 1 < suggested update operation key=SUBHZJ7HUV3H tag=3TPD3FOJMUSD type=del size=3225544 2024-06-04T15:59:25.706 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.705+0000 7f5e9aacc780 1 > prepared operation key=A8O0S3S45RGM tag=PZZ6WEJBVSSN type=del size=2837124 2024-06-04T15:59:25.707 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.707+0000 7f5e9aacc780 1 < completed write operation key=03ZNYG3WLMP4 tag=9PNLECI6N4VF type=write size=588006 2024-06-04T15:59:25.708 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.708+0000 7f5e9aacc780 1 > prepared operation key=AOCB36Y5Q7B0 tag=SYY0N13FDRY8 type=del size=1360579 2024-06-04T15:59:25.710 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.710+0000 7f5e9aacc780 1 < completed delete operation key=Q2V1ICTBSCV1 tag=NEPIADT9Z81L type=del 2024-06-04T15:59:25.713 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.712+0000 7f5e9aacc780 1 > prepared part key=_multipart_PCLJXQHJ4HTY.2~PQMQ4LY1CE7M.0 size=428996 2024-06-04T15:59:25.713 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.712+0000 7f5e9aacc780 1 > prepared multipart upload key=PCLJXQHJ4HTY upload=PQMQ4LY1CE7M tag=BJ5ZKJCOPZNY type=write size=1477572 2024-06-04T15:59:25.716 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.715+0000 7f5e9aacc780 1 < suggested remove operation key=XH0N984YVGKP tag=5O9DW9GSCQW7 type=write 2024-06-04T15:59:25.718 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.718+0000 7f5e9aacc780 1 > prepared part key=_multipart_QJA2JPATITNH.2~KMB3J54DJRBU.0 size=1048576 2024-06-04T15:59:25.719 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.719+0000 7f5e9aacc780 1 > prepared part key=_multipart_QJA2JPATITNH.2~KMB3J54DJRBU.1 size=1048576 2024-06-04T15:59:25.721 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.720+0000 7f5e9aacc780 1 > prepared part key=_multipart_QJA2JPATITNH.2~KMB3J54DJRBU.2 size=116581 2024-06-04T15:59:25.721 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.720+0000 7f5e9aacc780 1 > prepared multipart upload key=QJA2JPATITNH upload=KMB3J54DJRBU tag=VY0GR1916W4K type=write size=3262309 2024-06-04T15:59:25.722 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.722+0000 7f5e9aacc780 1 < completed delete operation key=DY9JWHWNAUO1 tag=8N0DF0E2QROT type=del 2024-06-04T15:59:25.724 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.723+0000 7f5e9aacc780 1 > prepared operation key=2BT2AXKB1RTA tag=9OHDZHWJ34T0 type=del size=3364043 2024-06-04T15:59:25.725 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.725+0000 7f5e9aacc780 1 < completed part key=_multipart_PASGIP872OVX.2~EYNSXMZCB45C.0 size=823958 2024-06-04T15:59:25.728 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.727+0000 7f5e9aacc780 1 < completed multipart upload key=PASGIP872OVX upload=EYNSXMZCB45C tag=Q3W0A251YT6T type=write size=1872534 2024-06-04T15:59:25.729 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.729+0000 7f5e9aacc780 1 > prepared operation key=1IKNQXU3Y2JJ tag=WENPISJ8UV3W type=write size=895634 2024-06-04T15:59:25.730 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.730+0000 7f5e9aacc780 1 < completed delete operation key=2BT2AXKB1RTA tag=C7RBLRSZIZTU type=del 2024-06-04T15:59:25.732 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.731+0000 7f5e9aacc780 1 > prepared operation key=03ZNYG3WLMP4 tag=FOU4AR0P0BWY type=del size=2179648 2024-06-04T15:59:25.733 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.733+0000 7f5e9aacc780 1 < canceled operation key=Q4OFQI0F5YLG tag=2KEI350NSN5K type=del size=2222265 2024-06-04T15:59:25.735 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.735+0000 7f5e9aacc780 1 > prepared operation key=AOCB36Y5Q7B0 tag=IA8TI079HBUE type=del size=1440205 2024-06-04T15:59:25.737 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.736+0000 7f5e9aacc780 1 < completed delete operation key=PNDPO2WUW7UX tag=3GV971O2KXO7 type=del 2024-06-04T15:59:25.740 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.740+0000 7f5e9aacc780 1 > prepared part key=_multipart_7S9S3MIG7WIT.2~B5A9T9IJWK1P.0 size=1048576 2024-06-04T15:59:25.741 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.741+0000 7f5e9aacc780 1 > prepared part key=_multipart_7S9S3MIG7WIT.2~B5A9T9IJWK1P.1 size=1048576 2024-06-04T15:59:25.742 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.742+0000 7f5e9aacc780 1 > prepared part key=_multipart_7S9S3MIG7WIT.2~B5A9T9IJWK1P.2 size=449692 2024-06-04T15:59:25.742 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.742+0000 7f5e9aacc780 1 > prepared multipart upload key=7S9S3MIG7WIT upload=B5A9T9IJWK1P tag=2YT58BTH3H5Z type=write size=3595420 2024-06-04T15:59:25.743 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.742+0000 7f5e9aacc780 1 < canceled part key=_multipart_GCPC9OJH7KWU.2~1UIS49T5O4VY.0 size=441807 2024-06-04T15:59:25.745 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.745+0000 7f5e9aacc780 1 < canceled multipart upload key=GCPC9OJH7KWU upload=1UIS49T5O4VY tag=DIEUWP7ZYM6C type=write size=1490383 2024-06-04T15:59:25.747 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.747+0000 7f5e9aacc780 1 > prepared operation key=Q4OFQI0F5YLG tag=6XYE31AFRSQE type=del size=2653923 2024-06-04T15:59:25.749 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.749+0000 7f5e9aacc780 1 < completed part key=_multipart_Q2V1ICTBSCV1.2~FN2FA9QTYF43.0 size=1048576 2024-06-04T15:59:25.750 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.750+0000 7f5e9aacc780 1 < completed part key=_multipart_Q2V1ICTBSCV1.2~FN2FA9QTYF43.1 size=1048576 2024-06-04T15:59:25.751 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.751+0000 7f5e9aacc780 1 < completed part key=_multipart_Q2V1ICTBSCV1.2~FN2FA9QTYF43.2 size=932483 2024-06-04T15:59:25.754 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.754+0000 7f5e9aacc780 1 < completed multipart upload key=Q2V1ICTBSCV1 upload=FN2FA9QTYF43 tag=V8L7Y5TL3USF type=write size=4078211 2024-06-04T15:59:25.757 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.757+0000 7f5e9aacc780 1 > prepared part key=_multipart_SUBHZJ7HUV3H.2~RC79O8QYY4S7.0 size=1048576 2024-06-04T15:59:25.758 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.758+0000 7f5e9aacc780 1 > prepared part key=_multipart_SUBHZJ7HUV3H.2~RC79O8QYY4S7.1 size=273471 2024-06-04T15:59:25.758 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.758+0000 7f5e9aacc780 1 > prepared multipart upload key=SUBHZJ7HUV3H upload=RC79O8QYY4S7 tag=Y9PB09Q3Q486 type=write size=2370623 2024-06-04T15:59:25.760 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.760+0000 7f5e9aacc780 1 < completed delete operation key=GCPC9OJH7KWU tag=7FPGZTMU91YH type=del 2024-06-04T15:59:25.762 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.762+0000 7f5e9aacc780 1 > prepared operation key=SUBHZJ7HUV3H tag=FM20PFY5VYDM type=del size=74045 2024-06-04T15:59:25.765 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.766+0000 7f5e9aacc780 1 < suggested update operation key=PASGIP872OVX tag=IC0QRFQP710X type=del size=2892871 2024-06-04T15:59:25.769 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.769+0000 7f5e9aacc780 1 > prepared part key=_multipart_W1T4O3EAE7JN.2~JR8SA6DBER89.0 size=1048576 2024-06-04T15:59:25.770 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.770+0000 7f5e9aacc780 1 > prepared part key=_multipart_W1T4O3EAE7JN.2~JR8SA6DBER89.1 size=598445 2024-06-04T15:59:25.770 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.770+0000 7f5e9aacc780 1 > prepared multipart upload key=W1T4O3EAE7JN upload=JR8SA6DBER89 tag=026X4GM74AJR type=write size=2695597 2024-06-04T15:59:25.772 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.772+0000 7f5e9aacc780 1 < completed delete operation key=2BT2AXKB1RTA tag=1SOFRMT7DV7S type=del 2024-06-04T15:59:25.774 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.773+0000 7f5e9aacc780 1 > prepared operation key=W1T4O3EAE7JN tag=P2ZBHIILZIUB type=del size=2144420 2024-06-04T15:59:25.777 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.777+0000 7f5e9aacc780 1 < suggested update operation key=Q2V1ICTBSCV1 tag=WI2LU2VI3YH1 type=del size=3905970 2024-06-04T15:59:25.779 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.779+0000 7f5e9aacc780 1 > prepared operation key=Q4OFQI0F5YLG tag=AYWZH20JSCQ5 type=write size=279782 2024-06-04T15:59:25.782 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.781+0000 7f5e9aacc780 1 < completed part key=_multipart_1IKNQXU3Y2JJ.2~6N6NEIZP51FP.0 size=1048576 2024-06-04T15:59:25.783 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.783+0000 7f5e9aacc780 1 < completed part key=_multipart_1IKNQXU3Y2JJ.2~6N6NEIZP51FP.1 size=1048576 2024-06-04T15:59:25.784 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.784+0000 7f5e9aacc780 1 < completed part key=_multipart_1IKNQXU3Y2JJ.2~6N6NEIZP51FP.2 size=432962 2024-06-04T15:59:25.786 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.786+0000 7f5e9aacc780 1 < completed multipart upload key=1IKNQXU3Y2JJ upload=6N6NEIZP51FP tag=WG4NVA41EODO type=write size=3578690 2024-06-04T15:59:25.789 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.788+0000 7f5e9aacc780 1 > prepared part key=_multipart_9MPRI6LW3956.2~ED9CW10R3PPD.0 size=1048576 2024-06-04T15:59:25.790 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.790+0000 7f5e9aacc780 1 > prepared part key=_multipart_9MPRI6LW3956.2~ED9CW10R3PPD.1 size=519883 2024-06-04T15:59:25.790 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.790+0000 7f5e9aacc780 1 > prepared multipart upload key=9MPRI6LW3956 upload=ED9CW10R3PPD tag=2YNVXSVG983E type=write size=2617035 2024-06-04T15:59:25.793 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.793+0000 7f5e9aacc780 1 < suggested remove operation key=A8O0S3S45RGM tag=PZZ6WEJBVSSN type=del 2024-06-04T15:59:25.794 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.794+0000 7f5e9aacc780 1 > prepared operation key=Q4OFQI0F5YLG tag=334MG3QH5CLQ type=del size=2468213 2024-06-04T15:59:25.796 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.796+0000 7f5e9aacc780 1 < canceled operation key=AOCB36Y5Q7B0 tag=SYY0N13FDRY8 type=del size=1360579 2024-06-04T15:59:25.797 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.797+0000 7f5e9aacc780 1 > prepared operation key=GTRMEQJK675Z tag=IMEMA8A6X67X type=del size=1652795 2024-06-04T15:59:25.799 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.798+0000 7f5e9aacc780 1 < completed part key=_multipart_PCLJXQHJ4HTY.2~PQMQ4LY1CE7M.0 size=428996 2024-06-04T15:59:25.801 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.801+0000 7f5e9aacc780 1 < completed multipart upload key=PCLJXQHJ4HTY upload=PQMQ4LY1CE7M tag=BJ5ZKJCOPZNY type=write size=1477572 2024-06-04T15:59:25.803 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.803+0000 7f5e9aacc780 1 > prepared operation key=PNDPO2WUW7UX tag=CS1T3VE4RXG9 type=write size=662563 2024-06-04T15:59:25.805 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.805+0000 7f5e9aacc780 1 < completed part key=_multipart_QJA2JPATITNH.2~KMB3J54DJRBU.0 size=1048576 2024-06-04T15:59:25.806 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.806+0000 7f5e9aacc780 1 < completed part key=_multipart_QJA2JPATITNH.2~KMB3J54DJRBU.1 size=1048576 2024-06-04T15:59:25.807 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.807+0000 7f5e9aacc780 1 < completed part key=_multipart_QJA2JPATITNH.2~KMB3J54DJRBU.2 size=116581 2024-06-04T15:59:25.809 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.809+0000 7f5e9aacc780 1 < completed multipart upload key=QJA2JPATITNH upload=KMB3J54DJRBU tag=VY0GR1916W4K type=write size=3262309 2024-06-04T15:59:25.812 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.812+0000 7f5e9aacc780 1 > prepared part key=_multipart_FBV2MAG130M6.2~NZDO26W3HGE7.0 size=1048576 2024-06-04T15:59:25.813 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.813+0000 7f5e9aacc780 1 > prepared part key=_multipart_FBV2MAG130M6.2~NZDO26W3HGE7.1 size=1048576 2024-06-04T15:59:25.814 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.814+0000 7f5e9aacc780 1 > prepared part key=_multipart_FBV2MAG130M6.2~NZDO26W3HGE7.2 size=346811 2024-06-04T15:59:25.814 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.814+0000 7f5e9aacc780 1 > prepared multipart upload key=FBV2MAG130M6 upload=NZDO26W3HGE7 tag=OOG29CCRASLT type=write size=3492539 2024-06-04T15:59:25.817 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.816+0000 7f5e9aacc780 1 < completed delete operation key=2BT2AXKB1RTA tag=9OHDZHWJ34T0 type=del 2024-06-04T15:59:25.818 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.818+0000 7f5e9aacc780 1 > prepared operation key=1IKNQXU3Y2JJ tag=TEU2PCJYGGMM type=del size=477892 2024-06-04T15:59:25.821 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.821+0000 7f5e9aacc780 1 < suggested remove operation key=1IKNQXU3Y2JJ tag=WENPISJ8UV3W type=write 2024-06-04T15:59:25.823 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.824+0000 7f5e9aacc780 1 > prepared part key=_multipart_AOCB36Y5Q7B0.2~ZS75KPR3LQ9B.0 size=1048576 2024-06-04T15:59:25.825 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.824+0000 7f5e9aacc780 1 > prepared part key=_multipart_AOCB36Y5Q7B0.2~ZS75KPR3LQ9B.1 size=582458 2024-06-04T15:59:25.825 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.824+0000 7f5e9aacc780 1 > prepared multipart upload key=AOCB36Y5Q7B0 upload=ZS75KPR3LQ9B tag=KJSXHRIEB4EA type=write size=2679610 2024-06-04T15:59:25.826 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.826+0000 7f5e9aacc780 1 < completed delete operation key=03ZNYG3WLMP4 tag=FOU4AR0P0BWY type=del 2024-06-04T15:59:25.829 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.828+0000 7f5e9aacc780 1 > prepared part key=_multipart_FBV2MAG130M6.2~IJ6M3NQ46AJ8.0 size=97569 2024-06-04T15:59:25.829 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.828+0000 7f5e9aacc780 1 > prepared multipart upload key=FBV2MAG130M6 upload=IJ6M3NQ46AJ8 tag=AZ2TFL1OPUFO type=write size=1146145 2024-06-04T15:59:25.830 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.830+0000 7f5e9aacc780 1 < completed delete operation key=AOCB36Y5Q7B0 tag=IA8TI079HBUE type=del 2024-06-04T15:59:25.832 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.831+0000 7f5e9aacc780 1 > prepared operation key=A8O0S3S45RGM tag=YJFZ1968M2S7 type=del size=1460901 2024-06-04T15:59:25.834 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.833+0000 7f5e9aacc780 1 < completed part key=_multipart_7S9S3MIG7WIT.2~B5A9T9IJWK1P.0 size=1048576 2024-06-04T15:59:25.834 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.834+0000 7f5e9aacc780 1 < completed part key=_multipart_7S9S3MIG7WIT.2~B5A9T9IJWK1P.1 size=1048576 2024-06-04T15:59:25.836 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.835+0000 7f5e9aacc780 1 < completed part key=_multipart_7S9S3MIG7WIT.2~B5A9T9IJWK1P.2 size=449692 2024-06-04T15:59:25.838 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.838+0000 7f5e9aacc780 1 < completed multipart upload key=7S9S3MIG7WIT upload=B5A9T9IJWK1P tag=2YT58BTH3H5Z type=write size=3595420 2024-06-04T15:59:25.840 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.839+0000 7f5e9aacc780 1 > prepared operation key=1IKNQXU3Y2JJ tag=1RUE2U7R026U type=del size=1787069 2024-06-04T15:59:25.841 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.841+0000 7f5e9aacc780 1 < completed delete operation key=Q4OFQI0F5YLG tag=6XYE31AFRSQE type=del 2024-06-04T15:59:25.845 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.844+0000 7f5e9aacc780 1 > prepared part key=_multipart_SUBHZJ7HUV3H.2~JYTWHEN4CZ87.0 size=1048576 2024-06-04T15:59:25.845 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.844+0000 7f5e9aacc780 1 > prepared part key=_multipart_SUBHZJ7HUV3H.2~JYTWHEN4CZ87.1 size=527651 2024-06-04T15:59:25.845 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.845+0000 7f5e9aacc780 1 > prepared multipart upload key=SUBHZJ7HUV3H upload=JYTWHEN4CZ87 tag=LCZ7KJ4JMZDU type=write size=2624803 2024-06-04T15:59:25.846 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.846+0000 7f5e9aacc780 1 < completed part key=_multipart_SUBHZJ7HUV3H.2~RC79O8QYY4S7.0 size=1048576 2024-06-04T15:59:25.848 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.847+0000 7f5e9aacc780 1 < completed part key=_multipart_SUBHZJ7HUV3H.2~RC79O8QYY4S7.1 size=273471 2024-06-04T15:59:25.850 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.850+0000 7f5e9aacc780 1 < completed multipart upload key=SUBHZJ7HUV3H upload=RC79O8QYY4S7 tag=Y9PB09Q3Q486 type=write size=2370623 2024-06-04T15:59:25.851 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.851+0000 7f5e9aacc780 1 > prepared operation key=NHPH4LYPP0LL tag=06E63QOW2QZI type=del size=2384067 2024-06-04T15:59:25.853 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.853+0000 7f5e9aacc780 1 < completed delete operation key=SUBHZJ7HUV3H tag=FM20PFY5VYDM type=del 2024-06-04T15:59:25.854 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.854+0000 7f5e9aacc780 1 > prepared operation key=JL69PUHT6NNT tag=IFO4QLF47ROV type=del size=43851 2024-06-04T15:59:25.856 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.855+0000 7f5e9aacc780 1 < completed part key=_multipart_W1T4O3EAE7JN.2~JR8SA6DBER89.0 size=1048576 2024-06-04T15:59:25.857 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.857+0000 7f5e9aacc780 1 < completed part key=_multipart_W1T4O3EAE7JN.2~JR8SA6DBER89.1 size=598445 2024-06-04T15:59:25.859 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.859+0000 7f5e9aacc780 1 < completed multipart upload key=W1T4O3EAE7JN upload=JR8SA6DBER89 tag=026X4GM74AJR type=write size=2695597 2024-06-04T15:59:25.862 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.862+0000 7f5e9aacc780 1 > prepared part key=_multipart_PASGIP872OVX.2~IBRBZSV4T18M.0 size=1048576 2024-06-04T15:59:25.863 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.863+0000 7f5e9aacc780 1 > prepared part key=_multipart_PASGIP872OVX.2~IBRBZSV4T18M.1 size=135876 2024-06-04T15:59:25.863 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.863+0000 7f5e9aacc780 1 > prepared multipart upload key=PASGIP872OVX upload=IBRBZSV4T18M tag=VYQ7EUZJ8W9O type=write size=2233028 2024-06-04T15:59:25.865 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.865+0000 7f5e9aacc780 1 < completed delete operation key=W1T4O3EAE7JN tag=P2ZBHIILZIUB type=del 2024-06-04T15:59:25.867 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.867+0000 7f5e9aacc780 1 > prepared part key=_multipart_W1T4O3EAE7JN.2~4ZOIOI2TGICW.0 size=458399 2024-06-04T15:59:25.867 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.867+0000 7f5e9aacc780 1 > prepared multipart upload key=W1T4O3EAE7JN upload=4ZOIOI2TGICW tag=XW3P8ZW12O9V type=write size=1506975 2024-06-04T15:59:25.869 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.869+0000 7f5e9aacc780 1 < completed write operation key=Q4OFQI0F5YLG tag=AYWZH20JSCQ5 type=write size=279782 2024-06-04T15:59:25.871 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.870+0000 7f5e9aacc780 1 > prepared operation key=FBV2MAG130M6 tag=WD84ZTOT9BF6 type=del size=3796483 2024-06-04T15:59:25.872 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.873+0000 7f5e9aacc780 1 < completed part key=_multipart_9MPRI6LW3956.2~ED9CW10R3PPD.0 size=1048576 2024-06-04T15:59:25.874 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.873+0000 7f5e9aacc780 1 < completed part key=_multipart_9MPRI6LW3956.2~ED9CW10R3PPD.1 size=519883 2024-06-04T15:59:25.877 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.877+0000 7f5e9aacc780 1 < completed multipart upload key=9MPRI6LW3956 upload=ED9CW10R3PPD tag=2YNVXSVG983E type=write size=2617035 2024-06-04T15:59:25.878 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.878+0000 7f5e9aacc780 1 > prepared operation key=GCPC9OJH7KWU tag=XT3E6MODA248 type=del size=102435 2024-06-04T15:59:25.880 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.880+0000 7f5e9aacc780 1 < completed delete operation key=Q4OFQI0F5YLG tag=334MG3QH5CLQ type=del 2024-06-04T15:59:25.882 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.881+0000 7f5e9aacc780 1 > prepared operation key=Q2V1ICTBSCV1 tag=XJXUQ6M6T0XA type=del size=2347621 2024-06-04T15:59:25.883 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.883+0000 7f5e9aacc780 1 < completed delete operation key=GTRMEQJK675Z tag=IMEMA8A6X67X type=del 2024-06-04T15:59:25.886 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.886+0000 7f5e9aacc780 1 > prepared part key=_multipart_7S9S3MIG7WIT.2~COP9UTZOBRMQ.0 size=1048576 2024-06-04T15:59:25.887 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.887+0000 7f5e9aacc780 1 > prepared part key=_multipart_7S9S3MIG7WIT.2~COP9UTZOBRMQ.1 size=1048576 2024-06-04T15:59:25.888 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.888+0000 7f5e9aacc780 1 > prepared part key=_multipart_7S9S3MIG7WIT.2~COP9UTZOBRMQ.2 size=170171 2024-06-04T15:59:25.888 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.888+0000 7f5e9aacc780 1 > prepared multipart upload key=7S9S3MIG7WIT upload=COP9UTZOBRMQ tag=MH0B9QMM4VVD type=write size=3315899 2024-06-04T15:59:25.891 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.891+0000 7f5e9aacc780 1 < suggested update operation key=PNDPO2WUW7UX tag=CS1T3VE4RXG9 type=write size=662563 2024-06-04T15:59:25.894 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.893+0000 7f5e9aacc780 1 > prepared part key=_multipart_GCPC9OJH7KWU.2~CZ1R8JDEIESL.0 size=1048576 2024-06-04T15:59:25.895 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.894+0000 7f5e9aacc780 1 > prepared part key=_multipart_GCPC9OJH7KWU.2~CZ1R8JDEIESL.1 size=1048576 2024-06-04T15:59:25.896 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.896+0000 7f5e9aacc780 1 > prepared part key=_multipart_GCPC9OJH7KWU.2~CZ1R8JDEIESL.2 size=390583 2024-06-04T15:59:25.896 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.896+0000 7f5e9aacc780 1 > prepared multipart upload key=GCPC9OJH7KWU upload=CZ1R8JDEIESL tag=XGGNIXQ8W3HJ type=write size=3536311 2024-06-04T15:59:25.897 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.897+0000 7f5e9aacc780 1 < completed part key=_multipart_FBV2MAG130M6.2~NZDO26W3HGE7.0 size=1048576 2024-06-04T15:59:25.899 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.898+0000 7f5e9aacc780 1 < completed part key=_multipart_FBV2MAG130M6.2~NZDO26W3HGE7.1 size=1048576 2024-06-04T15:59:25.900 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.900+0000 7f5e9aacc780 1 < completed part key=_multipart_FBV2MAG130M6.2~NZDO26W3HGE7.2 size=346811 2024-06-04T15:59:25.903 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.903+0000 7f5e9aacc780 1 < completed multipart upload key=FBV2MAG130M6 upload=NZDO26W3HGE7 tag=OOG29CCRASLT type=write size=3492539 2024-06-04T15:59:25.904 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.904+0000 7f5e9aacc780 1 > prepared operation key=NHPH4LYPP0LL tag=EWYYIEOL8RRQ type=write size=640176 2024-06-04T15:59:25.906 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.906+0000 7f5e9aacc780 1 < suggested remove operation key=1IKNQXU3Y2JJ tag=TEU2PCJYGGMM type=del 2024-06-04T15:59:25.908 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.907+0000 7f5e9aacc780 1 > prepared operation key=FBV2MAG130M6 tag=ZU1OHN8Z4PB2 type=del size=981764 2024-06-04T15:59:25.909 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.909+0000 7f5e9aacc780 1 < completed part key=_multipart_AOCB36Y5Q7B0.2~ZS75KPR3LQ9B.0 size=1048576 2024-06-04T15:59:25.910 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.910+0000 7f5e9aacc780 1 < completed part key=_multipart_AOCB36Y5Q7B0.2~ZS75KPR3LQ9B.1 size=582458 2024-06-04T15:59:25.912 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.912+0000 7f5e9aacc780 1 < completed multipart upload key=AOCB36Y5Q7B0 upload=ZS75KPR3LQ9B tag=KJSXHRIEB4EA type=write size=2679610 2024-06-04T15:59:25.915 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.915+0000 7f5e9aacc780 1 > prepared part key=_multipart_RP8K6QJUZAH1.2~I743YE1NUP9Z.0 size=1048576 2024-06-04T15:59:25.917 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.917+0000 7f5e9aacc780 1 > prepared part key=_multipart_RP8K6QJUZAH1.2~I743YE1NUP9Z.1 size=810631 2024-06-04T15:59:25.917 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.917+0000 7f5e9aacc780 1 > prepared multipart upload key=RP8K6QJUZAH1 upload=I743YE1NUP9Z tag=S68ONPT4KE41 type=write size=2907783 2024-06-04T15:59:25.917 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.917+0000 7f5e9aacc780 1 < canceled part key=_multipart_FBV2MAG130M6.2~IJ6M3NQ46AJ8.0 size=97569 2024-06-04T15:59:25.919 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.919+0000 7f5e9aacc780 1 < canceled multipart upload key=FBV2MAG130M6 upload=IJ6M3NQ46AJ8 tag=AZ2TFL1OPUFO type=write size=1146145 2024-06-04T15:59:25.922 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.922+0000 7f5e9aacc780 1 > prepared part key=_multipart_4W5HB9WQQHR6.2~O1Q0G1DQG4X5.0 size=989854 2024-06-04T15:59:25.922 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.922+0000 7f5e9aacc780 1 > prepared multipart upload key=4W5HB9WQQHR6 upload=O1Q0G1DQG4X5 tag=S6G95OELJIIR type=write size=2038430 2024-06-04T15:59:25.925 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.924+0000 7f5e9aacc780 1 < suggested remove operation key=A8O0S3S45RGM tag=YJFZ1968M2S7 type=del 2024-06-04T15:59:25.927 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.927+0000 7f5e9aacc780 1 > prepared part key=_multipart_UTZHANL9ER2Q.2~S3BZCT0E0APA.0 size=1048576 2024-06-04T15:59:25.928 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.928+0000 7f5e9aacc780 1 > prepared part key=_multipart_UTZHANL9ER2Q.2~S3BZCT0E0APA.1 size=1048576 2024-06-04T15:59:25.929 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.928+0000 7f5e9aacc780 1 > prepared part key=_multipart_UTZHANL9ER2Q.2~S3BZCT0E0APA.2 size=336023 2024-06-04T15:59:25.929 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.928+0000 7f5e9aacc780 1 > prepared multipart upload key=UTZHANL9ER2Q upload=S3BZCT0E0APA tag=C0P2ZOZ59NYN type=write size=3481751 2024-06-04T15:59:25.930 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.930+0000 7f5e9aacc780 -1 < failed to complete operation key=1IKNQXU3Y2JJ tag=1RUE2U7R026U type=del size=1787069: (22) Invalid argument 2024-06-04T15:59:25.931 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.931+0000 7f5e9aacc780 1 > prepared operation key=A8O0S3S45RGM tag=8JPXE7J0WBQM type=del size=1692247 2024-06-04T15:59:25.933 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.933+0000 7f5e9aacc780 1 < completed part key=_multipart_SUBHZJ7HUV3H.2~JYTWHEN4CZ87.0 size=1048576 2024-06-04T15:59:25.934 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.934+0000 7f5e9aacc780 1 < completed part key=_multipart_SUBHZJ7HUV3H.2~JYTWHEN4CZ87.1 size=527651 2024-06-04T15:59:25.936 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.936+0000 7f5e9aacc780 1 < completed multipart upload key=SUBHZJ7HUV3H upload=JYTWHEN4CZ87 tag=LCZ7KJ4JMZDU type=write size=2624803 2024-06-04T15:59:25.939 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.939+0000 7f5e9aacc780 1 > prepared part key=_multipart_XH0N984YVGKP.2~RFYL97GZQSP5.0 size=591155 2024-06-04T15:59:25.939 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.939+0000 7f5e9aacc780 1 > prepared multipart upload key=XH0N984YVGKP upload=RFYL97GZQSP5 tag=BGG3BHOFU1GE type=write size=1639731 2024-06-04T15:59:25.941 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.941+0000 7f5e9aacc780 1 < completed delete operation key=NHPH4LYPP0LL tag=06E63QOW2QZI type=del 2024-06-04T15:59:25.943 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.942+0000 7f5e9aacc780 1 > prepared operation key=Q2V1ICTBSCV1 tag=5UF5Q4HERK61 type=del size=2391013 2024-06-04T15:59:25.944 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.944+0000 7f5e9aacc780 1 < completed delete operation key=JL69PUHT6NNT tag=IFO4QLF47ROV type=del 2024-06-04T15:59:25.947 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.947+0000 7f5e9aacc780 1 > prepared part key=_multipart_NHPH4LYPP0LL.2~LA9QXLQI2TQV.0 size=1048576 2024-06-04T15:59:25.949 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.949+0000 7f5e9aacc780 1 > prepared part key=_multipart_NHPH4LYPP0LL.2~LA9QXLQI2TQV.1 size=1048576 2024-06-04T15:59:25.950 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.950+0000 7f5e9aacc780 1 > prepared part key=_multipart_NHPH4LYPP0LL.2~LA9QXLQI2TQV.2 size=74832 2024-06-04T15:59:25.950 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.950+0000 7f5e9aacc780 1 > prepared multipart upload key=NHPH4LYPP0LL upload=LA9QXLQI2TQV tag=CIZHC3XSGCLA type=write size=3220560 2024-06-04T15:59:25.953 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.953+0000 7f5e9aacc780 1 < completed part key=_multipart_PASGIP872OVX.2~IBRBZSV4T18M.0 size=1048576 2024-06-04T15:59:25.954 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.954+0000 7f5e9aacc780 1 < completed part key=_multipart_PASGIP872OVX.2~IBRBZSV4T18M.1 size=135876 2024-06-04T15:59:25.956 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.956+0000 7f5e9aacc780 1 < completed multipart upload key=PASGIP872OVX upload=IBRBZSV4T18M tag=VYQ7EUZJ8W9O type=write size=2233028 2024-06-04T15:59:25.957 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.958+0000 7f5e9aacc780 1 > prepared operation key=7S9S3MIG7WIT tag=QA7IA88LVBT3 type=del size=2653099 2024-06-04T15:59:25.959 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.959+0000 7f5e9aacc780 1 < completed part key=_multipart_W1T4O3EAE7JN.2~4ZOIOI2TGICW.0 size=458399 2024-06-04T15:59:25.962 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.961+0000 7f5e9aacc780 1 < completed multipart upload key=W1T4O3EAE7JN upload=4ZOIOI2TGICW tag=XW3P8ZW12O9V type=write size=1506975 2024-06-04T15:59:25.964 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.964+0000 7f5e9aacc780 1 > prepared part key=_multipart_GTRMEQJK675Z.2~OZ4DCAOV7FYM.0 size=829806 2024-06-04T15:59:25.964 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.964+0000 7f5e9aacc780 1 > prepared multipart upload key=GTRMEQJK675Z upload=OZ4DCAOV7FYM tag=19B6TMDKN4WH type=write size=1878382 2024-06-04T15:59:25.967 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.967+0000 7f5e9aacc780 1 < suggested update operation key=FBV2MAG130M6 tag=WD84ZTOT9BF6 type=del size=3796483 2024-06-04T15:59:25.969 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.969+0000 7f5e9aacc780 1 > prepared operation key=FBV2MAG130M6 tag=12OEPL2OV0H6 type=del size=1964003 2024-06-04T15:59:25.971 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.970+0000 7f5e9aacc780 1 < completed delete operation key=GCPC9OJH7KWU tag=XT3E6MODA248 type=del 2024-06-04T15:59:25.972 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.972+0000 7f5e9aacc780 1 > prepared operation key=B0HK5FJ2RGJE tag=WTX0WDCMA90S type=del size=522341 2024-06-04T15:59:25.973 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.973+0000 7f5e9aacc780 1 < completed delete operation key=Q2V1ICTBSCV1 tag=XJXUQ6M6T0XA type=del 2024-06-04T15:59:25.976 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.976+0000 7f5e9aacc780 1 > prepared part key=_multipart_FBV2MAG130M6.2~CYCA4R2AEIQJ.0 size=229082 2024-06-04T15:59:25.976 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.976+0000 7f5e9aacc780 1 > prepared multipart upload key=FBV2MAG130M6 upload=CYCA4R2AEIQJ tag=KJC9DIIVNGYQ type=write size=1277658 2024-06-04T15:59:25.977 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.977+0000 7f5e9aacc780 1 < completed part key=_multipart_7S9S3MIG7WIT.2~COP9UTZOBRMQ.0 size=1048576 2024-06-04T15:59:25.979 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.979+0000 7f5e9aacc780 1 < completed part key=_multipart_7S9S3MIG7WIT.2~COP9UTZOBRMQ.1 size=1048576 2024-06-04T15:59:25.980 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.980+0000 7f5e9aacc780 1 < completed part key=_multipart_7S9S3MIG7WIT.2~COP9UTZOBRMQ.2 size=170171 2024-06-04T15:59:25.982 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.982+0000 7f5e9aacc780 1 < completed multipart upload key=7S9S3MIG7WIT upload=COP9UTZOBRMQ tag=MH0B9QMM4VVD type=write size=3315899 2024-06-04T15:59:25.985 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.984+0000 7f5e9aacc780 1 > prepared part key=_multipart_B0HK5FJ2RGJE.2~AU167RA60JQM.0 size=944333 2024-06-04T15:59:25.985 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.984+0000 7f5e9aacc780 1 > prepared multipart upload key=B0HK5FJ2RGJE upload=AU167RA60JQM tag=V1IH4IJ7X2EO type=write size=1992909 2024-06-04T15:59:25.986 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.986+0000 7f5e9aacc780 1 < completed part key=_multipart_GCPC9OJH7KWU.2~CZ1R8JDEIESL.0 size=1048576 2024-06-04T15:59:25.987 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.987+0000 7f5e9aacc780 1 < completed part key=_multipart_GCPC9OJH7KWU.2~CZ1R8JDEIESL.1 size=1048576 2024-06-04T15:59:25.988 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.988+0000 7f5e9aacc780 1 < completed part key=_multipart_GCPC9OJH7KWU.2~CZ1R8JDEIESL.2 size=390583 2024-06-04T15:59:25.990 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.990+0000 7f5e9aacc780 1 < completed multipart upload key=GCPC9OJH7KWU upload=CZ1R8JDEIESL tag=XGGNIXQ8W3HJ type=write size=3536311 2024-06-04T15:59:25.992 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.992+0000 7f5e9aacc780 1 > prepared operation key=GTRMEQJK675Z tag=A2V3BPR4USHI type=del size=3068414 2024-06-04T15:59:25.994 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.993+0000 7f5e9aacc780 1 < completed write operation key=NHPH4LYPP0LL tag=EWYYIEOL8RRQ type=write size=640176 2024-06-04T15:59:25.995 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.995+0000 7f5e9aacc780 1 > prepared operation key=JL69PUHT6NNT tag=OVZVCKQ9KN7B type=del size=533155 2024-06-04T15:59:25.998 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.997+0000 7f5e9aacc780 1 < suggested remove operation key=FBV2MAG130M6 tag=ZU1OHN8Z4PB2 type=del 2024-06-04T15:59:25.999 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:25.999+0000 7f5e9aacc780 1 > prepared operation key=DY9JWHWNAUO1 tag=1UYK315SC06L type=write size=477562 2024-06-04T15:59:26.000 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.000+0000 7f5e9aacc780 1 < completed part key=_multipart_RP8K6QJUZAH1.2~I743YE1NUP9Z.0 size=1048576 2024-06-04T15:59:26.001 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.001+0000 7f5e9aacc780 1 < completed part key=_multipart_RP8K6QJUZAH1.2~I743YE1NUP9Z.1 size=810631 2024-06-04T15:59:26.004 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.004+0000 7f5e9aacc780 1 < completed multipart upload key=RP8K6QJUZAH1 upload=I743YE1NUP9Z tag=S68ONPT4KE41 type=write size=2907783 2024-06-04T15:59:26.007 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.006+0000 7f5e9aacc780 1 > prepared part key=_multipart_NHPH4LYPP0LL.2~ND7OIRM2UN0N.0 size=150278 2024-06-04T15:59:26.007 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.006+0000 7f5e9aacc780 1 > prepared multipart upload key=NHPH4LYPP0LL upload=ND7OIRM2UN0N tag=5CNO6C9YU5NL type=write size=1198854 2024-06-04T15:59:26.008 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.008+0000 7f5e9aacc780 1 < completed part key=_multipart_4W5HB9WQQHR6.2~O1Q0G1DQG4X5.0 size=989854 2024-06-04T15:59:26.010 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.010+0000 7f5e9aacc780 1 < completed multipart upload key=4W5HB9WQQHR6 upload=O1Q0G1DQG4X5 tag=S6G95OELJIIR type=write size=2038430 2024-06-04T15:59:26.012 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.012+0000 7f5e9aacc780 1 > prepared operation key=NJ5U8JTT32QK tag=FHYK9976AFN4 type=del size=1457671 2024-06-04T15:59:26.013 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.013+0000 7f5e9aacc780 1 < completed part key=_multipart_UTZHANL9ER2Q.2~S3BZCT0E0APA.0 size=1048576 2024-06-04T15:59:26.014 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.014+0000 7f5e9aacc780 1 < completed part key=_multipart_UTZHANL9ER2Q.2~S3BZCT0E0APA.1 size=1048576 2024-06-04T15:59:26.016 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.015+0000 7f5e9aacc780 1 < completed part key=_multipart_UTZHANL9ER2Q.2~S3BZCT0E0APA.2 size=336023 2024-06-04T15:59:26.018 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.017+0000 7f5e9aacc780 1 < completed multipart upload key=UTZHANL9ER2Q upload=S3BZCT0E0APA tag=C0P2ZOZ59NYN type=write size=3481751 2024-06-04T15:59:26.020 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.020+0000 7f5e9aacc780 1 > prepared part key=_multipart_AOCB36Y5Q7B0.2~PIZUF31L3T7X.0 size=95450 2024-06-04T15:59:26.020 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.020+0000 7f5e9aacc780 1 > prepared multipart upload key=AOCB36Y5Q7B0 upload=PIZUF31L3T7X tag=7BV1IGIPCL1X type=write size=1144026 2024-06-04T15:59:26.023 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.023+0000 7f5e9aacc780 1 < suggested remove operation key=A8O0S3S45RGM tag=8JPXE7J0WBQM type=del 2024-06-04T15:59:26.024 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.024+0000 7f5e9aacc780 1 > prepared operation key=HD6SNICRCDLL tag=4NH34BCG99KD type=write size=976708 2024-06-04T15:59:26.026 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.025+0000 7f5e9aacc780 1 < completed part key=_multipart_XH0N984YVGKP.2~RFYL97GZQSP5.0 size=591155 2024-06-04T15:59:26.028 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.028+0000 7f5e9aacc780 1 < completed multipart upload key=XH0N984YVGKP upload=RFYL97GZQSP5 tag=BGG3BHOFU1GE type=write size=1639731 2024-06-04T15:59:26.030 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.030+0000 7f5e9aacc780 1 > prepared part key=_multipart_PCLJXQHJ4HTY.2~0DJ2ZDN5P3I9.0 size=1048576 2024-06-04T15:59:26.032 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.031+0000 7f5e9aacc780 1 > prepared part key=_multipart_PCLJXQHJ4HTY.2~0DJ2ZDN5P3I9.1 size=1048576 2024-06-04T15:59:26.032 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.032+0000 7f5e9aacc780 1 > prepared part key=_multipart_PCLJXQHJ4HTY.2~0DJ2ZDN5P3I9.2 size=804999 2024-06-04T15:59:26.033 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.032+0000 7f5e9aacc780 1 > prepared multipart upload key=PCLJXQHJ4HTY upload=0DJ2ZDN5P3I9 tag=TGULUB9GF9JM type=write size=3950727 2024-06-04T15:59:26.034 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.034+0000 7f5e9aacc780 1 < canceled operation key=Q2V1ICTBSCV1 tag=5UF5Q4HERK61 type=del size=2391013 2024-06-04T15:59:26.035 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.035+0000 7f5e9aacc780 1 > prepared operation key=Q4OFQI0F5YLG tag=U0SL24POU0VG type=del size=2132254 2024-06-04T15:59:26.037 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.036+0000 7f5e9aacc780 1 < completed part key=_multipart_NHPH4LYPP0LL.2~LA9QXLQI2TQV.0 size=1048576 2024-06-04T15:59:26.038 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.038+0000 7f5e9aacc780 1 < completed part key=_multipart_NHPH4LYPP0LL.2~LA9QXLQI2TQV.1 size=1048576 2024-06-04T15:59:26.039 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.039+0000 7f5e9aacc780 1 < completed part key=_multipart_NHPH4LYPP0LL.2~LA9QXLQI2TQV.2 size=74832 2024-06-04T15:59:26.041 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.041+0000 7f5e9aacc780 1 < completed multipart upload key=NHPH4LYPP0LL upload=LA9QXLQI2TQV tag=CIZHC3XSGCLA type=write size=3220560 2024-06-04T15:59:26.043 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.042+0000 7f5e9aacc780 1 > prepared operation key=K01DAK0M4I4M tag=IK350ZE7BDE0 type=write size=78466 2024-06-04T15:59:26.044 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.044+0000 7f5e9aacc780 1 < completed delete operation key=7S9S3MIG7WIT tag=QA7IA88LVBT3 type=del 2024-06-04T15:59:26.046 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.046+0000 7f5e9aacc780 1 > prepared operation key=A8O0S3S45RGM tag=ZVQJDGNIJO8J type=del size=3561205 2024-06-04T15:59:26.047 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.047+0000 7f5e9aacc780 1 < completed part key=_multipart_GTRMEQJK675Z.2~OZ4DCAOV7FYM.0 size=829806 2024-06-04T15:59:26.050 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.050+0000 7f5e9aacc780 1 < completed multipart upload key=GTRMEQJK675Z upload=OZ4DCAOV7FYM tag=19B6TMDKN4WH type=write size=1878382 2024-06-04T15:59:26.051 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.052+0000 7f5e9aacc780 1 > prepared operation key=PASGIP872OVX tag=C9SQ6D9OJ425 type=del size=2854935 2024-06-04T15:59:26.053 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.053+0000 7f5e9aacc780 -1 < failed to complete operation key=FBV2MAG130M6 tag=12OEPL2OV0H6 type=del size=1964003: (22) Invalid argument 2024-06-04T15:59:26.054 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.054+0000 7f5e9aacc780 1 > prepared operation key=K01DAK0M4I4M tag=HCEOSU1CO1WO type=del size=1306050 2024-06-04T15:59:26.057 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.057+0000 7f5e9aacc780 1 < suggested remove operation key=B0HK5FJ2RGJE tag=WTX0WDCMA90S type=del 2024-06-04T15:59:26.059 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.059+0000 7f5e9aacc780 1 > prepared operation key=PASGIP872OVX tag=8KECI64IEBVZ type=write size=505820 2024-06-04T15:59:26.061 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.060+0000 7f5e9aacc780 1 < completed part key=_multipart_FBV2MAG130M6.2~CYCA4R2AEIQJ.0 size=229082 2024-06-04T15:59:26.063 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.063+0000 7f5e9aacc780 1 < completed multipart upload key=FBV2MAG130M6 upload=CYCA4R2AEIQJ tag=KJC9DIIVNGYQ type=write size=1277658 2024-06-04T15:59:26.066 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.066+0000 7f5e9aacc780 1 > prepared part key=_multipart_XH0N984YVGKP.2~4WI0X81GRV91.0 size=985279 2024-06-04T15:59:26.066 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.066+0000 7f5e9aacc780 1 > prepared multipart upload key=XH0N984YVGKP upload=4WI0X81GRV91 tag=PW6FMEX5QXHC type=write size=2033855 2024-06-04T15:59:26.067 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.067+0000 7f5e9aacc780 1 < completed part key=_multipart_B0HK5FJ2RGJE.2~AU167RA60JQM.0 size=944333 2024-06-04T15:59:26.070 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.070+0000 7f5e9aacc780 1 < completed multipart upload key=B0HK5FJ2RGJE upload=AU167RA60JQM tag=V1IH4IJ7X2EO type=write size=1992909 2024-06-04T15:59:26.072 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.071+0000 7f5e9aacc780 1 > prepared operation key=AOCB36Y5Q7B0 tag=0SRQJH6NCR2Y type=del size=2691226 2024-06-04T15:59:26.073 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.073+0000 7f5e9aacc780 1 < completed delete operation key=GTRMEQJK675Z tag=A2V3BPR4USHI type=del 2024-06-04T15:59:26.075 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.074+0000 7f5e9aacc780 1 > prepared operation key=QUIVPH3OB6KN tag=BIX3PL8RY73C type=del size=1691948 2024-06-04T15:59:26.076 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.076+0000 7f5e9aacc780 1 < completed delete operation key=JL69PUHT6NNT tag=OVZVCKQ9KN7B type=del 2024-06-04T15:59:26.078 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.077+0000 7f5e9aacc780 1 > prepared operation key=AOCB36Y5Q7B0 tag=I114PWGN9HFK type=del size=1082918 2024-06-04T15:59:26.079 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.079+0000 7f5e9aacc780 1 < completed write operation key=DY9JWHWNAUO1 tag=1UYK315SC06L type=write size=477562 2024-06-04T15:59:26.081 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.081+0000 7f5e9aacc780 1 > prepared operation key=PNDPO2WUW7UX tag=O068T82M6O33 type=del size=1430336 2024-06-04T15:59:26.083 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.083+0000 7f5e9aacc780 1 < completed part key=_multipart_NHPH4LYPP0LL.2~ND7OIRM2UN0N.0 size=150278 2024-06-04T15:59:26.085 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.085+0000 7f5e9aacc780 1 < completed multipart upload key=NHPH4LYPP0LL upload=ND7OIRM2UN0N tag=5CNO6C9YU5NL type=write size=1198854 2024-06-04T15:59:26.088 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.088+0000 7f5e9aacc780 1 > prepared operation key=JL69PUHT6NNT tag=H8LPJ1GOL0FV type=write size=470396 2024-06-04T15:59:26.091 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.091+0000 7f5e9aacc780 1 < suggested remove operation key=NJ5U8JTT32QK tag=FHYK9976AFN4 type=del 2024-06-04T15:59:26.094 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.094+0000 7f5e9aacc780 1 > prepared part key=_multipart_SUBHZJ7HUV3H.2~ODPIPDHXWEMI.0 size=907912 2024-06-04T15:59:26.094 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.094+0000 7f5e9aacc780 1 > prepared multipart upload key=SUBHZJ7HUV3H upload=ODPIPDHXWEMI tag=T2EJXRPA7GJU type=write size=1956488 2024-06-04T15:59:26.095 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.095+0000 7f5e9aacc780 1 < completed part key=_multipart_AOCB36Y5Q7B0.2~PIZUF31L3T7X.0 size=95450 2024-06-04T15:59:26.098 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.097+0000 7f5e9aacc780 1 < completed multipart upload key=AOCB36Y5Q7B0 upload=PIZUF31L3T7X tag=7BV1IGIPCL1X type=write size=1144026 2024-06-04T15:59:26.099 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.099+0000 7f5e9aacc780 1 > prepared operation key=9MPRI6LW3956 tag=B6XS162S1SD5 type=del size=1073993 2024-06-04T15:59:26.102 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.101+0000 7f5e9aacc780 1 < suggested update operation key=HD6SNICRCDLL tag=4NH34BCG99KD type=write size=976708 2024-06-04T15:59:26.104 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.104+0000 7f5e9aacc780 1 > prepared part key=_multipart_QUIVPH3OB6KN.2~YI1XBTM34BS4.0 size=939794 2024-06-04T15:59:26.104 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.104+0000 7f5e9aacc780 1 > prepared multipart upload key=QUIVPH3OB6KN upload=YI1XBTM34BS4 tag=UHYZP9V6WBMN type=write size=1988370 2024-06-04T15:59:26.105 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.104+0000 7f5e9aacc780 1 < canceled part key=_multipart_PCLJXQHJ4HTY.2~0DJ2ZDN5P3I9.0 size=1048576 2024-06-04T15:59:26.106 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.105+0000 7f5e9aacc780 1 < completed part key=_multipart_PCLJXQHJ4HTY.2~0DJ2ZDN5P3I9.1 size=1048576 2024-06-04T15:59:26.106 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.106+0000 7f5e9aacc780 1 < completed part key=_multipart_PCLJXQHJ4HTY.2~0DJ2ZDN5P3I9.2 size=804999 2024-06-04T15:59:26.109 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.108+0000 7f5e9aacc780 1 < canceled multipart upload key=PCLJXQHJ4HTY upload=0DJ2ZDN5P3I9 tag=TGULUB9GF9JM type=write size=3950727 2024-06-04T15:59:26.111 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.111+0000 7f5e9aacc780 1 > prepared part key=_multipart_Q4OFQI0F5YLG.2~3J7V7T38HKK2.0 size=343573 2024-06-04T15:59:26.111 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.111+0000 7f5e9aacc780 1 > prepared multipart upload key=Q4OFQI0F5YLG upload=3J7V7T38HKK2 tag=RAKRI4FUCO0V type=write size=1392149 2024-06-04T15:59:26.112 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.112+0000 7f5e9aacc780 1 < completed delete operation key=Q4OFQI0F5YLG tag=U0SL24POU0VG type=del 2024-06-04T15:59:26.115 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.115+0000 7f5e9aacc780 1 > prepared part key=_multipart_UTZHANL9ER2Q.2~A6V5CBCD9Q6M.0 size=1048576 2024-06-04T15:59:26.116 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.116+0000 7f5e9aacc780 1 > prepared part key=_multipart_UTZHANL9ER2Q.2~A6V5CBCD9Q6M.1 size=1048576 2024-06-04T15:59:26.117 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.117+0000 7f5e9aacc780 1 > prepared part key=_multipart_UTZHANL9ER2Q.2~A6V5CBCD9Q6M.2 size=472708 2024-06-04T15:59:26.117 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.117+0000 7f5e9aacc780 1 > prepared multipart upload key=UTZHANL9ER2Q upload=A6V5CBCD9Q6M tag=LL5R9DLS4PSG type=write size=3618436 2024-06-04T15:59:26.120 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.119+0000 7f5e9aacc780 1 < suggested update operation key=K01DAK0M4I4M tag=IK350ZE7BDE0 type=write size=78466 2024-06-04T15:59:26.122 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.122+0000 7f5e9aacc780 1 > prepared part key=_multipart_DY9JWHWNAUO1.2~NGE43R7PLFG2.0 size=337103 2024-06-04T15:59:26.123 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.122+0000 7f5e9aacc780 1 > prepared multipart upload key=DY9JWHWNAUO1 upload=NGE43R7PLFG2 tag=94M2M3LUSWOT type=write size=1385679 2024-06-04T15:59:26.124 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.124+0000 7f5e9aacc780 1 < completed delete operation key=A8O0S3S45RGM tag=ZVQJDGNIJO8J type=del 2024-06-04T15:59:26.125 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.125+0000 7f5e9aacc780 1 > prepared operation key=GTRMEQJK675Z tag=Q6MRTQKLBREU type=del size=3592065 2024-06-04T15:59:26.126 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.126+0000 7f5e9aacc780 1 < completed delete operation key=PASGIP872OVX tag=C9SQ6D9OJ425 type=del 2024-06-04T15:59:26.129 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.128+0000 7f5e9aacc780 1 > prepared part key=_multipart_B0HK5FJ2RGJE.2~VDPA88BYVIH1.0 size=1048576 2024-06-04T15:59:26.130 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.130+0000 7f5e9aacc780 1 > prepared part key=_multipart_B0HK5FJ2RGJE.2~VDPA88BYVIH1.1 size=284947 2024-06-04T15:59:26.130 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.130+0000 7f5e9aacc780 1 > prepared multipart upload key=B0HK5FJ2RGJE upload=VDPA88BYVIH1 tag=3ZAV0DHO6Z5E type=write size=2382099 2024-06-04T15:59:26.131 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.131+0000 7f5e9aacc780 -1 < failed to complete operation key=K01DAK0M4I4M tag=HCEOSU1CO1WO type=del size=1306050: (22) Invalid argument 2024-06-04T15:59:26.132 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.132+0000 7f5e9aacc780 1 > prepared operation key=B0HK5FJ2RGJE tag=E0EAX1R0N46Y type=del size=36141 2024-06-04T15:59:26.134 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.134+0000 7f5e9aacc780 1 < completed write operation key=PASGIP872OVX tag=8KECI64IEBVZ type=write size=505820 2024-06-04T15:59:26.136 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.136+0000 7f5e9aacc780 1 > prepared part key=_multipart_W1T4O3EAE7JN.2~M3U9KHZYG6UR.0 size=1048576 2024-06-04T15:59:26.137 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.137+0000 7f5e9aacc780 1 > prepared part key=_multipart_W1T4O3EAE7JN.2~M3U9KHZYG6UR.1 size=381524 2024-06-04T15:59:26.137 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.137+0000 7f5e9aacc780 1 > prepared multipart upload key=W1T4O3EAE7JN upload=M3U9KHZYG6UR tag=BXKQ9Q3P7XHJ type=write size=2478676 2024-06-04T15:59:26.139 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.138+0000 7f5e9aacc780 1 < completed part key=_multipart_XH0N984YVGKP.2~4WI0X81GRV91.0 size=985279 2024-06-04T15:59:26.141 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.141+0000 7f5e9aacc780 1 < completed multipart upload key=XH0N984YVGKP upload=4WI0X81GRV91 tag=PW6FMEX5QXHC type=write size=2033855 2024-06-04T15:59:26.142 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.142+0000 7f5e9aacc780 1 > prepared operation key=A8O0S3S45RGM tag=AFTAI0S9D1PF type=del size=1078324 2024-06-04T15:59:26.144 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.143+0000 7f5e9aacc780 1 < completed delete operation key=AOCB36Y5Q7B0 tag=0SRQJH6NCR2Y type=del 2024-06-04T15:59:26.146 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.146+0000 7f5e9aacc780 1 > prepared part key=_multipart_K01DAK0M4I4M.2~M42V0HKZCX4P.0 size=1048576 2024-06-04T15:59:26.147 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.147+0000 7f5e9aacc780 1 > prepared part key=_multipart_K01DAK0M4I4M.2~M42V0HKZCX4P.1 size=418634 2024-06-04T15:59:26.147 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.147+0000 7f5e9aacc780 1 > prepared multipart upload key=K01DAK0M4I4M upload=M42V0HKZCX4P tag=E7XQ9A3SR688 type=write size=2515786 2024-06-04T15:59:26.149 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.148+0000 7f5e9aacc780 1 < completed delete operation key=QUIVPH3OB6KN tag=BIX3PL8RY73C type=del 2024-06-04T15:59:26.150 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.150+0000 7f5e9aacc780 1 > prepared operation key=UTZHANL9ER2Q tag=H8WGTY9G55ZT type=del size=4174921 2024-06-04T15:59:26.151 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.151+0000 7f5e9aacc780 1 < completed delete operation key=AOCB36Y5Q7B0 tag=I114PWGN9HFK type=del 2024-06-04T15:59:26.153 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.152+0000 7f5e9aacc780 1 > prepared operation key=W1T4O3EAE7JN tag=QZ7C5AF8FZOI type=write size=156231 2024-06-04T15:59:26.154 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.154+0000 7f5e9aacc780 1 < completed delete operation key=PNDPO2WUW7UX tag=O068T82M6O33 type=del 2024-06-04T15:59:26.156 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.156+0000 7f5e9aacc780 1 > prepared part key=_multipart_DY9JWHWNAUO1.2~CX5VUVM4LZXL.0 size=1048576 2024-06-04T15:59:26.157 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.157+0000 7f5e9aacc780 1 > prepared part key=_multipart_DY9JWHWNAUO1.2~CX5VUVM4LZXL.1 size=868438 2024-06-04T15:59:26.157 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.157+0000 7f5e9aacc780 1 > prepared multipart upload key=DY9JWHWNAUO1 upload=CX5VUVM4LZXL tag=8IEVRC914V6R type=write size=2965590 2024-06-04T15:59:26.160 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.159+0000 7f5e9aacc780 1 < suggested remove operation key=JL69PUHT6NNT tag=H8LPJ1GOL0FV type=write 2024-06-04T15:59:26.161 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.161+0000 7f5e9aacc780 1 > prepared operation key=GTRMEQJK675Z tag=FDMAXBZPBCHQ type=del size=1214361 2024-06-04T15:59:26.162 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.162+0000 7f5e9aacc780 1 < completed part key=_multipart_SUBHZJ7HUV3H.2~ODPIPDHXWEMI.0 size=907912 2024-06-04T15:59:26.165 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.164+0000 7f5e9aacc780 1 < completed multipart upload key=SUBHZJ7HUV3H upload=ODPIPDHXWEMI tag=T2EJXRPA7GJU type=write size=1956488 2024-06-04T15:59:26.166 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.166+0000 7f5e9aacc780 1 > prepared operation key=7S9S3MIG7WIT tag=C8CNXPPKQFHI type=del size=3764253 2024-06-04T15:59:26.169 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.168+0000 7f5e9aacc780 1 < suggested remove operation key=9MPRI6LW3956 tag=B6XS162S1SD5 type=del 2024-06-04T15:59:26.170 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.170+0000 7f5e9aacc780 1 > prepared operation key=K01DAK0M4I4M tag=45JM4J85B6IV type=write size=471258 2024-06-04T15:59:26.171 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.171+0000 7f5e9aacc780 1 < completed part key=_multipart_QUIVPH3OB6KN.2~YI1XBTM34BS4.0 size=939794 2024-06-04T15:59:26.174 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.174+0000 7f5e9aacc780 1 < completed multipart upload key=QUIVPH3OB6KN upload=YI1XBTM34BS4 tag=UHYZP9V6WBMN type=write size=1988370 2024-06-04T15:59:26.176 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.176+0000 7f5e9aacc780 1 > prepared part key=_multipart_QJA2JPATITNH.2~FBXRWD04XPG4.0 size=1048576 2024-06-04T15:59:26.178 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.177+0000 7f5e9aacc780 1 > prepared part key=_multipart_QJA2JPATITNH.2~FBXRWD04XPG4.1 size=1048576 2024-06-04T15:59:26.179 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.179+0000 7f5e9aacc780 1 > prepared part key=_multipart_QJA2JPATITNH.2~FBXRWD04XPG4.2 size=141082 2024-06-04T15:59:26.179 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.179+0000 7f5e9aacc780 1 > prepared multipart upload key=QJA2JPATITNH upload=FBXRWD04XPG4 tag=Z42OOKQ1U1R7 type=write size=3286810 2024-06-04T15:59:26.181 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.180+0000 7f5e9aacc780 1 < completed part key=_multipart_Q4OFQI0F5YLG.2~3J7V7T38HKK2.0 size=343573 2024-06-04T15:59:26.183 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.182+0000 7f5e9aacc780 1 < completed multipart upload key=Q4OFQI0F5YLG upload=3J7V7T38HKK2 tag=RAKRI4FUCO0V type=write size=1392149 2024-06-04T15:59:26.184 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.184+0000 7f5e9aacc780 1 > prepared operation key=PNDPO2WUW7UX tag=5FEAMI9PLEH1 type=del size=2877001 2024-06-04T15:59:26.186 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.186+0000 7f5e9aacc780 1 < completed part key=_multipart_UTZHANL9ER2Q.2~A6V5CBCD9Q6M.0 size=1048576 2024-06-04T15:59:26.186 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.186+0000 7f5e9aacc780 1 < canceled part key=_multipart_UTZHANL9ER2Q.2~A6V5CBCD9Q6M.1 size=1048576 2024-06-04T15:59:26.186 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.186+0000 7f5e9aacc780 1 < canceled part key=_multipart_UTZHANL9ER2Q.2~A6V5CBCD9Q6M.2 size=472708 2024-06-04T15:59:26.188 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.188+0000 7f5e9aacc780 1 < canceled multipart upload key=UTZHANL9ER2Q upload=A6V5CBCD9Q6M tag=LL5R9DLS4PSG type=write size=3618436 2024-06-04T15:59:26.190 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.189+0000 7f5e9aacc780 1 > prepared operation key=QUIVPH3OB6KN tag=RCRE3W1AKCUV type=del size=3828018 2024-06-04T15:59:26.191 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.191+0000 7f5e9aacc780 1 < completed part key=_multipart_DY9JWHWNAUO1.2~NGE43R7PLFG2.0 size=337103 2024-06-04T15:59:26.193 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.193+0000 7f5e9aacc780 1 < completed multipart upload key=DY9JWHWNAUO1 upload=NGE43R7PLFG2 tag=94M2M3LUSWOT type=write size=1385679 2024-06-04T15:59:26.195 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.194+0000 7f5e9aacc780 1 > prepared operation key=PCLJXQHJ4HTY tag=ACWGD1W9RDGT type=del size=3424706 2024-06-04T15:59:26.196 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.196+0000 7f5e9aacc780 1 < completed delete operation key=GTRMEQJK675Z tag=Q6MRTQKLBREU type=del 2024-06-04T15:59:26.198 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.197+0000 7f5e9aacc780 1 > prepared operation key=UW5LVIBG09SV tag=ZYL8K23YYVM8 type=del size=1096811 2024-06-04T15:59:26.199 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.199+0000 7f5e9aacc780 1 < completed part key=_multipart_B0HK5FJ2RGJE.2~VDPA88BYVIH1.0 size=1048576 2024-06-04T15:59:26.200 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.200+0000 7f5e9aacc780 1 < completed part key=_multipart_B0HK5FJ2RGJE.2~VDPA88BYVIH1.1 size=284947 2024-06-04T15:59:26.202 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.202+0000 7f5e9aacc780 1 < completed multipart upload key=B0HK5FJ2RGJE upload=VDPA88BYVIH1 tag=3ZAV0DHO6Z5E type=write size=2382099 2024-06-04T15:59:26.204 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.204+0000 7f5e9aacc780 1 > prepared operation key=PASGIP872OVX tag=TKTIBT6TZ85F type=del size=1281121 2024-06-04T15:59:26.205 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.205+0000 7f5e9aacc780 1 < completed delete operation key=B0HK5FJ2RGJE tag=E0EAX1R0N46Y type=del 2024-06-04T15:59:26.206 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.206+0000 7f5e9aacc780 1 > prepared operation key=1IKNQXU3Y2JJ tag=FA1WQRPL3WM1 type=del size=2690214 2024-06-04T15:59:26.208 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.208+0000 7f5e9aacc780 1 < completed part key=_multipart_W1T4O3EAE7JN.2~M3U9KHZYG6UR.0 size=1048576 2024-06-04T15:59:26.209 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.209+0000 7f5e9aacc780 1 < completed part key=_multipart_W1T4O3EAE7JN.2~M3U9KHZYG6UR.1 size=381524 2024-06-04T15:59:26.211 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.211+0000 7f5e9aacc780 1 < completed multipart upload key=W1T4O3EAE7JN upload=M3U9KHZYG6UR tag=BXKQ9Q3P7XHJ type=write size=2478676 2024-06-04T15:59:26.214 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.213+0000 7f5e9aacc780 1 > prepared part key=_multipart_JL69PUHT6NNT.2~AID9984DL997.0 size=1048576 2024-06-04T15:59:26.216 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.216+0000 7f5e9aacc780 1 > prepared part key=_multipart_JL69PUHT6NNT.2~AID9984DL997.1 size=808396 2024-06-04T15:59:26.216 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.216+0000 7f5e9aacc780 1 > prepared multipart upload key=JL69PUHT6NNT upload=AID9984DL997 tag=1K8FYWKQSGDI type=write size=2905548 2024-06-04T15:59:26.218 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.217+0000 7f5e9aacc780 1 < canceled operation key=A8O0S3S45RGM tag=AFTAI0S9D1PF type=del size=1078324 2024-06-04T15:59:26.220 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.220+0000 7f5e9aacc780 1 > prepared operation key=RP8K6QJUZAH1 tag=9GQ57OJ7KYGM type=del size=304302 2024-06-04T15:59:26.222 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.222+0000 7f5e9aacc780 1 < completed part key=_multipart_K01DAK0M4I4M.2~M42V0HKZCX4P.0 size=1048576 2024-06-04T15:59:26.223 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.222+0000 7f5e9aacc780 1 < completed part key=_multipart_K01DAK0M4I4M.2~M42V0HKZCX4P.1 size=418634 2024-06-04T15:59:26.225 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.225+0000 7f5e9aacc780 1 < completed multipart upload key=K01DAK0M4I4M upload=M42V0HKZCX4P tag=E7XQ9A3SR688 type=write size=2515786 2024-06-04T15:59:26.226 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.226+0000 7f5e9aacc780 1 > prepared operation key=K01DAK0M4I4M tag=GN14KUZCTTHB type=del size=2084468 2024-06-04T15:59:26.228 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.228+0000 7f5e9aacc780 1 < completed delete operation key=UTZHANL9ER2Q tag=H8WGTY9G55ZT type=del 2024-06-04T15:59:26.229 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.229+0000 7f5e9aacc780 1 > prepared operation key=TUGKW7F4V9NO tag=JHRHJO9J2EG4 type=write size=201469 2024-06-04T15:59:26.231 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.230+0000 7f5e9aacc780 1 < completed write operation key=W1T4O3EAE7JN tag=QZ7C5AF8FZOI type=write size=156231 2024-06-04T15:59:26.233 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.233+0000 7f5e9aacc780 1 > prepared part key=_multipart_A8O0S3S45RGM.2~UDLPH13Q0O5J.0 size=344509 2024-06-04T15:59:26.233 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.233+0000 7f5e9aacc780 1 > prepared multipart upload key=A8O0S3S45RGM upload=UDLPH13Q0O5J tag=5VXAN97VWWRU type=write size=1393085 2024-06-04T15:59:26.234 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.235+0000 7f5e9aacc780 1 < completed part key=_multipart_DY9JWHWNAUO1.2~CX5VUVM4LZXL.0 size=1048576 2024-06-04T15:59:26.236 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.236+0000 7f5e9aacc780 1 < completed part key=_multipart_DY9JWHWNAUO1.2~CX5VUVM4LZXL.1 size=868438 2024-06-04T15:59:26.238 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.238+0000 7f5e9aacc780 1 < completed multipart upload key=DY9JWHWNAUO1 upload=CX5VUVM4LZXL tag=8IEVRC914V6R type=write size=2965590 2024-06-04T15:59:26.239 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.239+0000 7f5e9aacc780 1 > prepared operation key=GCPC9OJH7KWU tag=R8S3BAH8H7SY type=del size=1222043 2024-06-04T15:59:26.242 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.242+0000 7f5e9aacc780 1 < suggested remove operation key=GTRMEQJK675Z tag=FDMAXBZPBCHQ type=del 2024-06-04T15:59:26.243 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.243+0000 7f5e9aacc780 1 > prepared operation key=GTRMEQJK675Z tag=ALYTV029KJCO type=del size=1975350 2024-06-04T15:59:26.245 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.245+0000 7f5e9aacc780 1 < completed delete operation key=7S9S3MIG7WIT tag=C8CNXPPKQFHI type=del 2024-06-04T15:59:26.246 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.246+0000 7f5e9aacc780 1 > prepared operation key=AOCB36Y5Q7B0 tag=6D66F7485YVQ type=del size=484668 2024-06-04T15:59:26.248 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.248+0000 7f5e9aacc780 1 < completed write operation key=K01DAK0M4I4M tag=45JM4J85B6IV type=write size=471258 2024-06-04T15:59:26.249 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.248+0000 7f5e9aacc780 1 > prepared operation key=NHPH4LYPP0LL tag=LJHF87Q8CF3J type=del size=2807505 2024-06-04T15:59:26.250 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.250+0000 7f5e9aacc780 1 < completed part key=_multipart_QJA2JPATITNH.2~FBXRWD04XPG4.0 size=1048576 2024-06-04T15:59:26.253 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.252+0000 7f5e9aacc780 1 < completed part key=_multipart_QJA2JPATITNH.2~FBXRWD04XPG4.1 size=1048576 2024-06-04T15:59:26.253 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.253+0000 7f5e9aacc780 1 < completed part key=_multipart_QJA2JPATITNH.2~FBXRWD04XPG4.2 size=141082 2024-06-04T15:59:26.255 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.255+0000 7f5e9aacc780 1 < completed multipart upload key=QJA2JPATITNH upload=FBXRWD04XPG4 tag=Z42OOKQ1U1R7 type=write size=3286810 2024-06-04T15:59:26.256 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.256+0000 7f5e9aacc780 1 > prepared operation key=AOCB36Y5Q7B0 tag=YFJWMAL5K8UN type=del size=3685701 2024-06-04T15:59:26.259 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.258+0000 7f5e9aacc780 1 < suggested update operation key=PNDPO2WUW7UX tag=5FEAMI9PLEH1 type=del size=2877001 2024-06-04T15:59:26.260 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.260+0000 7f5e9aacc780 1 > prepared operation key=GTRMEQJK675Z tag=SO1Y3I0NEKWY type=del size=1377026 2024-06-04T15:59:26.264 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.263+0000 7f5e9aacc780 1 < suggested update operation key=QUIVPH3OB6KN tag=RCRE3W1AKCUV type=del size=3828018 2024-06-04T15:59:26.265 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.265+0000 7f5e9aacc780 1 > prepared operation key=QJA2JPATITNH tag=YK09LNKTNORB type=del size=828459 2024-06-04T15:59:26.268 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.268+0000 7f5e9aacc780 1 < suggested remove operation key=PCLJXQHJ4HTY tag=ACWGD1W9RDGT type=del 2024-06-04T15:59:26.270 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.270+0000 7f5e9aacc780 1 > prepared operation key=2BT2AXKB1RTA tag=B1JGZ21J82ST type=write size=531177 2024-06-04T15:59:26.272 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.271+0000 7f5e9aacc780 1 < completed delete operation key=UW5LVIBG09SV tag=ZYL8K23YYVM8 type=del 2024-06-04T15:59:26.273 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.273+0000 7f5e9aacc780 1 > prepared operation key=TUGKW7F4V9NO tag=WGEHB3X2X2TH type=del size=1593659 2024-06-04T15:59:26.275 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.274+0000 7f5e9aacc780 1 < completed delete operation key=PASGIP872OVX tag=TKTIBT6TZ85F type=del 2024-06-04T15:59:26.276 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.276+0000 7f5e9aacc780 1 > prepared operation key=GCPC9OJH7KWU tag=E5860P2YEQBV type=del size=1968418 2024-06-04T15:59:26.278 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.278+0000 7f5e9aacc780 1 < suggested remove operation key=1IKNQXU3Y2JJ tag=FA1WQRPL3WM1 type=del 2024-06-04T15:59:26.280 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.280+0000 7f5e9aacc780 1 > prepared operation key=QUIVPH3OB6KN tag=BVXM9GEB1AZ6 type=del size=2347550 2024-06-04T15:59:26.281 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.281+0000 7f5e9aacc780 1 < completed part key=_multipart_JL69PUHT6NNT.2~AID9984DL997.0 size=1048576 2024-06-04T15:59:26.281 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.281+0000 7f5e9aacc780 1 < canceled part key=_multipart_JL69PUHT6NNT.2~AID9984DL997.1 size=808396 2024-06-04T15:59:26.284 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.283+0000 7f5e9aacc780 1 < canceled multipart upload key=JL69PUHT6NNT upload=AID9984DL997 tag=1K8FYWKQSGDI type=write size=2905548 2024-06-04T15:59:26.285 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.285+0000 7f5e9aacc780 1 > prepared operation key=B0HK5FJ2RGJE tag=PEK5MWFD5AH8 type=del size=3637532 2024-06-04T15:59:26.287 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.286+0000 7f5e9aacc780 1 < completed delete operation key=RP8K6QJUZAH1 tag=9GQ57OJ7KYGM type=del 2024-06-04T15:59:26.289 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.289+0000 7f5e9aacc780 1 > prepared part key=_multipart_RP8K6QJUZAH1.2~35049TVQX82V.0 size=539388 2024-06-04T15:59:26.289 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.289+0000 7f5e9aacc780 1 > prepared multipart upload key=RP8K6QJUZAH1 upload=35049TVQX82V tag=52PBWH2O6KLD type=write size=1587964 2024-06-04T15:59:26.291 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.291+0000 7f5e9aacc780 1 < completed delete operation key=K01DAK0M4I4M tag=GN14KUZCTTHB type=del 2024-06-04T15:59:26.292 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.292+0000 7f5e9aacc780 1 > prepared operation key=PASGIP872OVX tag=X9CB33F6B2VJ type=write size=436931 2024-06-04T15:59:26.294 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.294+0000 7f5e9aacc780 1 < completed write operation key=TUGKW7F4V9NO tag=JHRHJO9J2EG4 type=write size=201469 2024-06-04T15:59:26.297 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.296+0000 7f5e9aacc780 1 > prepared part key=_multipart_NJ5U8JTT32QK.2~8QWX8LYE70PA.0 size=16382 2024-06-04T15:59:26.297 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.296+0000 7f5e9aacc780 1 > prepared multipart upload key=NJ5U8JTT32QK upload=8QWX8LYE70PA tag=UELHGAHSLVQQ type=write size=1064958 2024-06-04T15:59:26.297 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.297+0000 7f5e9aacc780 1 < canceled part key=_multipart_A8O0S3S45RGM.2~UDLPH13Q0O5J.0 size=344509 2024-06-04T15:59:26.299 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.299+0000 7f5e9aacc780 1 < canceled multipart upload key=A8O0S3S45RGM upload=UDLPH13Q0O5J tag=5VXAN97VWWRU type=write size=1393085 2024-06-04T15:59:26.301 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.300+0000 7f5e9aacc780 1 > prepared operation key=Q2V1ICTBSCV1 tag=BEVODBFJJSE6 type=del size=830422 2024-06-04T15:59:26.302 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.302+0000 7f5e9aacc780 1 < canceled operation key=GCPC9OJH7KWU tag=R8S3BAH8H7SY type=del size=1222043 2024-06-04T15:59:26.303 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.303+0000 7f5e9aacc780 1 > prepared operation key=2BT2AXKB1RTA tag=QM3AKBHFRARZ type=del size=4106796 2024-06-04T15:59:26.306 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.306+0000 7f5e9aacc780 1 < suggested remove operation key=GTRMEQJK675Z tag=ALYTV029KJCO type=del 2024-06-04T15:59:26.307 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.307+0000 7f5e9aacc780 1 > prepared operation key=AOCB36Y5Q7B0 tag=8FB5OZ38TTF4 type=del size=907538 2024-06-04T15:59:26.309 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.309+0000 7f5e9aacc780 1 < completed delete operation key=AOCB36Y5Q7B0 tag=6D66F7485YVQ type=del 2024-06-04T15:59:26.312 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.311+0000 7f5e9aacc780 1 > prepared part key=_multipart_PCLJXQHJ4HTY.2~C2G9JHDYWC4O.0 size=570196 2024-06-04T15:59:26.312 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.311+0000 7f5e9aacc780 1 > prepared multipart upload key=PCLJXQHJ4HTY upload=C2G9JHDYWC4O tag=CWSIXUI0EH93 type=write size=1618772 2024-06-04T15:59:26.313 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.313+0000 7f5e9aacc780 1 < completed delete operation key=NHPH4LYPP0LL tag=LJHF87Q8CF3J type=del 2024-06-04T15:59:26.315 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.315+0000 7f5e9aacc780 1 > prepared part key=_multipart_1IKNQXU3Y2JJ.2~JAC9WVF54C3B.0 size=1048576 2024-06-04T15:59:26.316 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.316+0000 7f5e9aacc780 1 > prepared part key=_multipart_1IKNQXU3Y2JJ.2~JAC9WVF54C3B.1 size=1048576 2024-06-04T15:59:26.318 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.317+0000 7f5e9aacc780 1 > prepared part key=_multipart_1IKNQXU3Y2JJ.2~JAC9WVF54C3B.2 size=244476 2024-06-04T15:59:26.318 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.317+0000 7f5e9aacc780 1 > prepared multipart upload key=1IKNQXU3Y2JJ upload=JAC9WVF54C3B tag=MM8NCATUD9RI type=write size=3390204 2024-06-04T15:59:26.319 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.319+0000 7f5e9aacc780 1 < completed delete operation key=AOCB36Y5Q7B0 tag=YFJWMAL5K8UN type=del 2024-06-04T15:59:26.321 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.321+0000 7f5e9aacc780 1 > prepared part key=_multipart_B0HK5FJ2RGJE.2~HZTZEU06TLEY.0 size=1048576 2024-06-04T15:59:26.322 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.322+0000 7f5e9aacc780 1 > prepared part key=_multipart_B0HK5FJ2RGJE.2~HZTZEU06TLEY.1 size=578688 2024-06-04T15:59:26.323 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.322+0000 7f5e9aacc780 1 > prepared multipart upload key=B0HK5FJ2RGJE upload=HZTZEU06TLEY tag=LGD7ZZFR09MT type=write size=2675840 2024-06-04T15:59:26.324 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.324+0000 7f5e9aacc780 -1 < failed to complete operation key=GTRMEQJK675Z tag=SO1Y3I0NEKWY type=del size=1377026: (22) Invalid argument 2024-06-04T15:59:26.326 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.326+0000 7f5e9aacc780 1 > prepared part key=_multipart_03ZNYG3WLMP4.2~NFR8CVRIRS3T.0 size=1048576 2024-06-04T15:59:26.328 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.327+0000 7f5e9aacc780 1 > prepared part key=_multipart_03ZNYG3WLMP4.2~NFR8CVRIRS3T.1 size=422826 2024-06-04T15:59:26.328 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.327+0000 7f5e9aacc780 1 > prepared multipart upload key=03ZNYG3WLMP4 upload=NFR8CVRIRS3T tag=EL5U5Q888BXH type=write size=2519978 2024-06-04T15:59:26.329 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.329+0000 7f5e9aacc780 1 < canceled operation key=QJA2JPATITNH tag=YK09LNKTNORB type=del size=828459 2024-06-04T15:59:26.330 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.330+0000 7f5e9aacc780 1 > prepared operation key=W1T4O3EAE7JN tag=UV0XD22XZPG8 type=del size=718857 2024-06-04T15:59:26.332 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.332+0000 7f5e9aacc780 1 < completed write operation key=2BT2AXKB1RTA tag=B1JGZ21J82ST type=write size=531177 2024-06-04T15:59:26.333 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.333+0000 7f5e9aacc780 1 > prepared operation key=TUGKW7F4V9NO tag=AX0EL125KQUZ type=del size=3866826 2024-06-04T15:59:26.335 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.334+0000 7f5e9aacc780 1 < completed delete operation key=TUGKW7F4V9NO tag=WGEHB3X2X2TH type=del 2024-06-04T15:59:26.336 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.336+0000 7f5e9aacc780 1 > prepared operation key=AOCB36Y5Q7B0 tag=JX9JKAHCUBY6 type=del size=1679122 2024-06-04T15:59:26.339 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.339+0000 7f5e9aacc780 1 < suggested remove operation key=GCPC9OJH7KWU tag=E5860P2YEQBV type=del 2024-06-04T15:59:26.341 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.340+0000 7f5e9aacc780 1 > prepared operation key=AOCB36Y5Q7B0 tag=EDHC24LNH8IG type=del size=55233 2024-06-04T15:59:26.342 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.342+0000 7f5e9aacc780 1 < completed delete operation key=QUIVPH3OB6KN tag=BVXM9GEB1AZ6 type=del 2024-06-04T15:59:26.344 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.343+0000 7f5e9aacc780 1 > prepared operation key=4W5HB9WQQHR6 tag=ZSIESXBT4QS3 type=write size=88888 2024-06-04T15:59:26.345 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.345+0000 7f5e9aacc780 1 < completed delete operation key=B0HK5FJ2RGJE tag=PEK5MWFD5AH8 type=del 2024-06-04T15:59:26.347 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.346+0000 7f5e9aacc780 1 > prepared operation key=PCLJXQHJ4HTY tag=B93DCN4OZYMX type=write size=902669 2024-06-04T15:59:26.347 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.347+0000 7f5e9aacc780 1 < canceled part key=_multipart_RP8K6QJUZAH1.2~35049TVQX82V.0 size=539388 2024-06-04T15:59:26.350 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.349+0000 7f5e9aacc780 1 < canceled multipart upload key=RP8K6QJUZAH1 upload=35049TVQX82V tag=52PBWH2O6KLD type=write size=1587964 2024-06-04T15:59:26.353 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.352+0000 7f5e9aacc780 1 > prepared part key=_multipart_4W5HB9WQQHR6.2~700YPWBM9F2N.0 size=527529 2024-06-04T15:59:26.353 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.352+0000 7f5e9aacc780 1 > prepared multipart upload key=4W5HB9WQQHR6 upload=700YPWBM9F2N tag=EXLKL7RGLKNM type=write size=1576105 2024-06-04T15:59:26.356 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.356+0000 7f5e9aacc780 1 < suggested remove operation key=PASGIP872OVX tag=X9CB33F6B2VJ type=write 2024-06-04T15:59:26.360 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.360+0000 7f5e9aacc780 1 > prepared part key=_multipart_AOCB36Y5Q7B0.2~908CHZMTK2B0.0 size=1048576 2024-06-04T15:59:26.361 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.361+0000 7f5e9aacc780 1 > prepared part key=_multipart_AOCB36Y5Q7B0.2~908CHZMTK2B0.1 size=193255 2024-06-04T15:59:26.361 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.361+0000 7f5e9aacc780 1 > prepared multipart upload key=AOCB36Y5Q7B0 upload=908CHZMTK2B0 tag=SR8A6K3GG3DY type=write size=2290407 2024-06-04T15:59:26.362 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.362+0000 7f5e9aacc780 1 < completed part key=_multipart_NJ5U8JTT32QK.2~8QWX8LYE70PA.0 size=16382 2024-06-04T15:59:26.365 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.365+0000 7f5e9aacc780 1 < completed multipart upload key=NJ5U8JTT32QK upload=8QWX8LYE70PA tag=UELHGAHSLVQQ type=write size=1064958 2024-06-04T15:59:26.367 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.367+0000 7f5e9aacc780 1 > prepared part key=_multipart_2BT2AXKB1RTA.2~H9QIBJ30NG43.0 size=1048576 2024-06-04T15:59:26.368 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.368+0000 7f5e9aacc780 1 > prepared part key=_multipart_2BT2AXKB1RTA.2~H9QIBJ30NG43.1 size=858249 2024-06-04T15:59:26.368 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.368+0000 7f5e9aacc780 1 > prepared multipart upload key=2BT2AXKB1RTA upload=H9QIBJ30NG43 tag=JUM7JGITMKU9 type=write size=2955401 2024-06-04T15:59:26.370 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.369+0000 7f5e9aacc780 1 < completed delete operation key=Q2V1ICTBSCV1 tag=BEVODBFJJSE6 type=del 2024-06-04T15:59:26.371 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.371+0000 7f5e9aacc780 1 > prepared operation key=HD6SNICRCDLL tag=8O2360KKVB8G type=del size=1682595 2024-06-04T15:59:26.374 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.373+0000 7f5e9aacc780 1 < suggested update operation key=2BT2AXKB1RTA tag=QM3AKBHFRARZ type=del size=4106796 2024-06-04T15:59:26.375 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.375+0000 7f5e9aacc780 1 > prepared operation key=FBV2MAG130M6 tag=YN0T8TNRZN8A type=del size=3843647 2024-06-04T15:59:26.377 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.376+0000 7f5e9aacc780 1 < completed delete operation key=AOCB36Y5Q7B0 tag=8FB5OZ38TTF4 type=del 2024-06-04T15:59:26.378 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.378+0000 7f5e9aacc780 1 > prepared operation key=4W5HB9WQQHR6 tag=KCHXEJYPZ1KV type=del size=1056183 2024-06-04T15:59:26.380 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.379+0000 7f5e9aacc780 1 < completed part key=_multipart_PCLJXQHJ4HTY.2~C2G9JHDYWC4O.0 size=570196 2024-06-04T15:59:26.382 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.382+0000 7f5e9aacc780 1 < completed multipart upload key=PCLJXQHJ4HTY upload=C2G9JHDYWC4O tag=CWSIXUI0EH93 type=write size=1618772 2024-06-04T15:59:26.384 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.384+0000 7f5e9aacc780 1 > prepared part key=_multipart_HD6SNICRCDLL.2~EFAQ2JLCUX8Z.0 size=271206 2024-06-04T15:59:26.385 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.384+0000 7f5e9aacc780 1 > prepared multipart upload key=HD6SNICRCDLL upload=EFAQ2JLCUX8Z tag=JIUV6GAVXWZ7 type=write size=1319782 2024-06-04T15:59:26.386 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.386+0000 7f5e9aacc780 1 < completed part key=_multipart_1IKNQXU3Y2JJ.2~JAC9WVF54C3B.0 size=1048576 2024-06-04T15:59:26.387 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.387+0000 7f5e9aacc780 1 < completed part key=_multipart_1IKNQXU3Y2JJ.2~JAC9WVF54C3B.1 size=1048576 2024-06-04T15:59:26.387 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.387+0000 7f5e9aacc780 1 < canceled part key=_multipart_1IKNQXU3Y2JJ.2~JAC9WVF54C3B.2 size=244476 2024-06-04T15:59:26.389 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.389+0000 7f5e9aacc780 1 < canceled multipart upload key=1IKNQXU3Y2JJ upload=JAC9WVF54C3B tag=MM8NCATUD9RI type=write size=3390204 2024-06-04T15:59:26.391 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.391+0000 7f5e9aacc780 1 > prepared operation key=XH0N984YVGKP tag=JBDJGXX6HMG6 type=del size=3137533 2024-06-04T15:59:26.393 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.392+0000 7f5e9aacc780 1 < completed part key=_multipart_B0HK5FJ2RGJE.2~HZTZEU06TLEY.0 size=1048576 2024-06-04T15:59:26.394 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.393+0000 7f5e9aacc780 1 < completed part key=_multipart_B0HK5FJ2RGJE.2~HZTZEU06TLEY.1 size=578688 2024-06-04T15:59:26.396 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.396+0000 7f5e9aacc780 1 < completed multipart upload key=B0HK5FJ2RGJE upload=HZTZEU06TLEY tag=LGD7ZZFR09MT type=write size=2675840 2024-06-04T15:59:26.399 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.398+0000 7f5e9aacc780 1 > prepared part key=_multipart_PASGIP872OVX.2~E87G421TLDYT.0 size=1048576 2024-06-04T15:59:26.400 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.399+0000 7f5e9aacc780 1 > prepared part key=_multipart_PASGIP872OVX.2~E87G421TLDYT.1 size=1048576 2024-06-04T15:59:26.401 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.401+0000 7f5e9aacc780 1 > prepared part key=_multipart_PASGIP872OVX.2~E87G421TLDYT.2 size=821577 2024-06-04T15:59:26.401 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.401+0000 7f5e9aacc780 1 > prepared multipart upload key=PASGIP872OVX upload=E87G421TLDYT tag=IXEWV8PBUAZJ type=write size=3967305 2024-06-04T15:59:26.403 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.403+0000 7f5e9aacc780 1 < completed part key=_multipart_03ZNYG3WLMP4.2~NFR8CVRIRS3T.0 size=1048576 2024-06-04T15:59:26.404 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.404+0000 7f5e9aacc780 1 < completed part key=_multipart_03ZNYG3WLMP4.2~NFR8CVRIRS3T.1 size=422826 2024-06-04T15:59:26.406 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.406+0000 7f5e9aacc780 1 < completed multipart upload key=03ZNYG3WLMP4 upload=NFR8CVRIRS3T tag=EL5U5Q888BXH type=write size=2519978 2024-06-04T15:59:26.408 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.408+0000 7f5e9aacc780 1 > prepared operation key=QJA2JPATITNH tag=S7I60Q5F26HM type=del size=3640623 2024-06-04T15:59:26.410 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.410+0000 7f5e9aacc780 1 < completed delete operation key=W1T4O3EAE7JN tag=UV0XD22XZPG8 type=del 2024-06-04T15:59:26.412 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.412+0000 7f5e9aacc780 1 > prepared part key=_multipart_1IKNQXU3Y2JJ.2~7CF93POO86V4.0 size=1048576 2024-06-04T15:59:26.413 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.413+0000 7f5e9aacc780 1 > prepared part key=_multipart_1IKNQXU3Y2JJ.2~7CF93POO86V4.1 size=1048576 2024-06-04T15:59:26.414 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.414+0000 7f5e9aacc780 1 > prepared part key=_multipart_1IKNQXU3Y2JJ.2~7CF93POO86V4.2 size=886351 2024-06-04T15:59:26.414 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.414+0000 7f5e9aacc780 1 > prepared multipart upload key=1IKNQXU3Y2JJ upload=7CF93POO86V4 tag=Y2E0H25ILFX9 type=write size=4032079 2024-06-04T15:59:26.416 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.416+0000 7f5e9aacc780 1 < completed delete operation key=TUGKW7F4V9NO tag=AX0EL125KQUZ type=del 2024-06-04T15:59:26.419 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.418+0000 7f5e9aacc780 1 > prepared part key=_multipart_PNDPO2WUW7UX.2~JXXHNQ31T8UH.0 size=1048576 2024-06-04T15:59:26.420 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.420+0000 7f5e9aacc780 1 > prepared part key=_multipart_PNDPO2WUW7UX.2~JXXHNQ31T8UH.1 size=673022 2024-06-04T15:59:26.420 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.420+0000 7f5e9aacc780 1 > prepared multipart upload key=PNDPO2WUW7UX upload=JXXHNQ31T8UH tag=BPNUEA3VK3V8 type=write size=2770174 2024-06-04T15:59:26.421 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.421+0000 7f5e9aacc780 1 < completed delete operation key=AOCB36Y5Q7B0 tag=JX9JKAHCUBY6 type=del 2024-06-04T15:59:26.423 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.423+0000 7f5e9aacc780 1 > prepared operation key=4W5HB9WQQHR6 tag=JA07A7PC4OV3 type=write size=778563 2024-06-04T15:59:26.424 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.424+0000 7f5e9aacc780 1 < completed delete operation key=AOCB36Y5Q7B0 tag=EDHC24LNH8IG type=del 2024-06-04T15:59:26.426 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.426+0000 7f5e9aacc780 1 > prepared operation key=NJ5U8JTT32QK tag=R11IUPBD45BB type=del size=1644936 2024-06-04T15:59:26.428 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.427+0000 7f5e9aacc780 1 < completed write operation key=4W5HB9WQQHR6 tag=ZSIESXBT4QS3 type=write size=88888 2024-06-04T15:59:26.429 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.430+0000 7f5e9aacc780 1 > prepared operation key=2BT2AXKB1RTA tag=UI1XNJ2157HN type=del size=2407722 2024-06-04T15:59:26.433 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.432+0000 7f5e9aacc780 1 < suggested update operation key=PCLJXQHJ4HTY tag=B93DCN4OZYMX type=write size=902669 2024-06-04T15:59:26.434 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.434+0000 7f5e9aacc780 1 > prepared operation key=PCLJXQHJ4HTY tag=L6J8RF5RO0QC type=del size=759007 2024-06-04T15:59:26.436 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.436+0000 7f5e9aacc780 1 < completed part key=_multipart_4W5HB9WQQHR6.2~700YPWBM9F2N.0 size=527529 2024-06-04T15:59:26.438 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.438+0000 7f5e9aacc780 1 < completed multipart upload key=4W5HB9WQQHR6 upload=700YPWBM9F2N tag=EXLKL7RGLKNM type=write size=1576105 2024-06-04T15:59:26.440 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.439+0000 7f5e9aacc780 1 > prepared operation key=NHPH4LYPP0LL tag=91KDY5YOSUXL type=del size=2017410 2024-06-04T15:59:26.441 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.441+0000 7f5e9aacc780 1 < completed part key=_multipart_AOCB36Y5Q7B0.2~908CHZMTK2B0.0 size=1048576 2024-06-04T15:59:26.442 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.442+0000 7f5e9aacc780 1 < completed part key=_multipart_AOCB36Y5Q7B0.2~908CHZMTK2B0.1 size=193255 2024-06-04T15:59:26.445 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.445+0000 7f5e9aacc780 1 < completed multipart upload key=AOCB36Y5Q7B0 upload=908CHZMTK2B0 tag=SR8A6K3GG3DY type=write size=2290407 2024-06-04T15:59:26.446 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.446+0000 7f5e9aacc780 1 > prepared operation key=TUGKW7F4V9NO tag=BMPMFSUEX6R1 type=del size=1836079 2024-06-04T15:59:26.448 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.448+0000 7f5e9aacc780 1 < completed part key=_multipart_2BT2AXKB1RTA.2~H9QIBJ30NG43.0 size=1048576 2024-06-04T15:59:26.449 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.449+0000 7f5e9aacc780 1 < completed part key=_multipart_2BT2AXKB1RTA.2~H9QIBJ30NG43.1 size=858249 2024-06-04T15:59:26.451 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.451+0000 7f5e9aacc780 1 < completed multipart upload key=2BT2AXKB1RTA upload=H9QIBJ30NG43 tag=JUM7JGITMKU9 type=write size=2955401 2024-06-04T15:59:26.454 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.453+0000 7f5e9aacc780 1 > prepared part key=_multipart_SUBHZJ7HUV3H.2~75VNLN3Q09K0.0 size=1048576 2024-06-04T15:59:26.455 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.455+0000 7f5e9aacc780 1 > prepared part key=_multipart_SUBHZJ7HUV3H.2~75VNLN3Q09K0.1 size=1048576 2024-06-04T15:59:26.456 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.456+0000 7f5e9aacc780 1 > prepared part key=_multipart_SUBHZJ7HUV3H.2~75VNLN3Q09K0.2 size=423280 2024-06-04T15:59:26.456 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.456+0000 7f5e9aacc780 1 > prepared multipart upload key=SUBHZJ7HUV3H upload=75VNLN3Q09K0 tag=N1QL9T3H0H5J type=write size=3569008 2024-06-04T15:59:26.457 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.457+0000 7f5e9aacc780 1 < completed delete operation key=HD6SNICRCDLL tag=8O2360KKVB8G type=del 2024-06-04T15:59:26.460 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.460+0000 7f5e9aacc780 1 > prepared part key=_multipart_XH0N984YVGKP.2~R0F2QNQNXYN0.0 size=174085 2024-06-04T15:59:26.460 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.460+0000 7f5e9aacc780 1 > prepared multipart upload key=XH0N984YVGKP upload=R0F2QNQNXYN0 tag=XFNEUT3NH9Y8 type=write size=1222661 2024-06-04T15:59:26.462 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.461+0000 7f5e9aacc780 1 < completed delete operation key=FBV2MAG130M6 tag=YN0T8TNRZN8A type=del 2024-06-04T15:59:26.464 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.463+0000 7f5e9aacc780 1 > prepared operation key=A8O0S3S45RGM tag=Y6I23L221RL1 type=write size=509949 2024-06-04T15:59:26.465 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.465+0000 7f5e9aacc780 1 < completed delete operation key=4W5HB9WQQHR6 tag=KCHXEJYPZ1KV type=del 2024-06-04T15:59:26.468 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.468+0000 7f5e9aacc780 1 > prepared part key=_multipart_PNDPO2WUW7UX.2~0KRGRF24VHDE.0 size=1048576 2024-06-04T15:59:26.469 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.470+0000 7f5e9aacc780 1 > prepared part key=_multipart_PNDPO2WUW7UX.2~0KRGRF24VHDE.1 size=171771 2024-06-04T15:59:26.470 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.470+0000 7f5e9aacc780 1 > prepared multipart upload key=PNDPO2WUW7UX upload=0KRGRF24VHDE tag=B7GR3IWFDZO3 type=write size=2268923 2024-06-04T15:59:26.470 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.470+0000 7f5e9aacc780 1 < canceled part key=_multipart_HD6SNICRCDLL.2~EFAQ2JLCUX8Z.0 size=271206 2024-06-04T15:59:26.473 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.472+0000 7f5e9aacc780 1 < canceled multipart upload key=HD6SNICRCDLL upload=EFAQ2JLCUX8Z tag=JIUV6GAVXWZ7 type=write size=1319782 2024-06-04T15:59:26.474 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.474+0000 7f5e9aacc780 1 > prepared operation key=B0HK5FJ2RGJE tag=U4JSZ3FFDVPM type=del size=2995496 2024-06-04T15:59:26.476 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.476+0000 7f5e9aacc780 1 < completed delete operation key=XH0N984YVGKP tag=JBDJGXX6HMG6 type=del 2024-06-04T15:59:26.477 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.477+0000 7f5e9aacc780 1 > prepared operation key=1IKNQXU3Y2JJ tag=07NIURMUSJ0M type=del size=2228953 2024-06-04T15:59:26.479 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.478+0000 7f5e9aacc780 1 < completed part key=_multipart_PASGIP872OVX.2~E87G421TLDYT.0 size=1048576 2024-06-04T15:59:26.480 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.480+0000 7f5e9aacc780 1 < completed part key=_multipart_PASGIP872OVX.2~E87G421TLDYT.1 size=1048576 2024-06-04T15:59:26.481 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.481+0000 7f5e9aacc780 1 < completed part key=_multipart_PASGIP872OVX.2~E87G421TLDYT.2 size=821577 2024-06-04T15:59:26.484 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.483+0000 7f5e9aacc780 1 < completed multipart upload key=PASGIP872OVX upload=E87G421TLDYT tag=IXEWV8PBUAZJ type=write size=3967305 2024-06-04T15:59:26.485 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.485+0000 7f5e9aacc780 1 > prepared operation key=AOCB36Y5Q7B0 tag=4KGEFV4YOB8S type=del size=2650275 2024-06-04T15:59:26.488 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.488+0000 7f5e9aacc780 1 < suggested update operation key=QJA2JPATITNH tag=S7I60Q5F26HM type=del size=3640623 2024-06-04T15:59:26.490 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.490+0000 7f5e9aacc780 1 > prepared operation key=UW5LVIBG09SV tag=J85FZMBN2PQB type=write size=908995 2024-06-04T15:59:26.491 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.491+0000 7f5e9aacc780 1 < completed part key=_multipart_1IKNQXU3Y2JJ.2~7CF93POO86V4.0 size=1048576 2024-06-04T15:59:26.494 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.493+0000 7f5e9aacc780 1 < completed part key=_multipart_1IKNQXU3Y2JJ.2~7CF93POO86V4.1 size=1048576 2024-06-04T15:59:26.495 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.494+0000 7f5e9aacc780 1 < completed part key=_multipart_1IKNQXU3Y2JJ.2~7CF93POO86V4.2 size=886351 2024-06-04T15:59:26.497 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.496+0000 7f5e9aacc780 1 < completed multipart upload key=1IKNQXU3Y2JJ upload=7CF93POO86V4 tag=Y2E0H25ILFX9 type=write size=4032079 2024-06-04T15:59:26.498 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.498+0000 7f5e9aacc780 1 > prepared operation key=QJA2JPATITNH tag=SQRLBBFZ09XN type=del size=1623284 2024-06-04T15:59:26.499 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.499+0000 7f5e9aacc780 1 < completed part key=_multipart_PNDPO2WUW7UX.2~JXXHNQ31T8UH.0 size=1048576 2024-06-04T15:59:26.500 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.500+0000 7f5e9aacc780 1 < completed part key=_multipart_PNDPO2WUW7UX.2~JXXHNQ31T8UH.1 size=673022 2024-06-04T15:59:26.503 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.503+0000 7f5e9aacc780 1 < completed multipart upload key=PNDPO2WUW7UX upload=JXXHNQ31T8UH tag=BPNUEA3VK3V8 type=write size=2770174 2024-06-04T15:59:26.504 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.504+0000 7f5e9aacc780 1 > prepared operation key=UW5LVIBG09SV tag=Q074XWRKXCD8 type=del size=3430941 2024-06-04T15:59:26.507 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.507+0000 7f5e9aacc780 1 < suggested remove operation key=4W5HB9WQQHR6 tag=JA07A7PC4OV3 type=write 2024-06-04T15:59:26.508 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.508+0000 7f5e9aacc780 1 > prepared operation key=PASGIP872OVX tag=3SHPZ8KAVORE type=del size=289795 2024-06-04T15:59:26.510 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.509+0000 7f5e9aacc780 1 < completed delete operation key=NJ5U8JTT32QK tag=R11IUPBD45BB type=del 2024-06-04T15:59:26.512 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.512+0000 7f5e9aacc780 1 > prepared part key=_multipart_1IKNQXU3Y2JJ.2~6KD1X3BV1H7S.0 size=1048576 2024-06-04T15:59:26.513 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.513+0000 7f5e9aacc780 1 > prepared part key=_multipart_1IKNQXU3Y2JJ.2~6KD1X3BV1H7S.1 size=1048576 2024-06-04T15:59:26.514 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.514+0000 7f5e9aacc780 1 > prepared part key=_multipart_1IKNQXU3Y2JJ.2~6KD1X3BV1H7S.2 size=790113 2024-06-04T15:59:26.514 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.514+0000 7f5e9aacc780 1 > prepared multipart upload key=1IKNQXU3Y2JJ upload=6KD1X3BV1H7S tag=BUHSIVVDFK81 type=write size=3935841 2024-06-04T15:59:26.516 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.515+0000 7f5e9aacc780 1 < completed delete operation key=2BT2AXKB1RTA tag=UI1XNJ2157HN type=del 2024-06-04T15:59:26.517 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.517+0000 7f5e9aacc780 1 > prepared operation key=PNDPO2WUW7UX tag=XC5JHXEKQ75I type=del size=2460517 2024-06-04T15:59:26.520 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.520+0000 7f5e9aacc780 1 < suggested remove operation key=PCLJXQHJ4HTY tag=L6J8RF5RO0QC type=del 2024-06-04T15:59:26.522 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.522+0000 7f5e9aacc780 1 > prepared part key=_multipart_TUGKW7F4V9NO.2~5L4EK2PWB9RS.0 size=1048576 2024-06-04T15:59:26.524 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.524+0000 7f5e9aacc780 1 > prepared part key=_multipart_TUGKW7F4V9NO.2~5L4EK2PWB9RS.1 size=131899 2024-06-04T15:59:26.524 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.524+0000 7f5e9aacc780 1 > prepared multipart upload key=TUGKW7F4V9NO upload=5L4EK2PWB9RS tag=4IJOYNC95ECD type=write size=2229051 2024-06-04T15:59:26.525 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.525+0000 7f5e9aacc780 1 < completed delete operation key=NHPH4LYPP0LL tag=91KDY5YOSUXL type=del 2024-06-04T15:59:26.526 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.526+0000 7f5e9aacc780 1 > prepared operation key=B0HK5FJ2RGJE tag=06G8YT3HINKV type=del size=150254 2024-06-04T15:59:26.527 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.527+0000 7f5e9aacc780 1 < completed delete operation key=TUGKW7F4V9NO tag=BMPMFSUEX6R1 type=del 2024-06-04T15:59:26.529 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.528+0000 7f5e9aacc780 1 > prepared operation key=QUIVPH3OB6KN tag=M0OQXQ6SXKFS type=del size=660456 2024-06-04T15:59:26.530 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.530+0000 7f5e9aacc780 1 < completed part key=_multipart_SUBHZJ7HUV3H.2~75VNLN3Q09K0.0 size=1048576 2024-06-04T15:59:26.531 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.531+0000 7f5e9aacc780 1 < completed part key=_multipart_SUBHZJ7HUV3H.2~75VNLN3Q09K0.1 size=1048576 2024-06-04T15:59:26.532 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.532+0000 7f5e9aacc780 1 < completed part key=_multipart_SUBHZJ7HUV3H.2~75VNLN3Q09K0.2 size=423280 2024-06-04T15:59:26.534 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.534+0000 7f5e9aacc780 1 < completed multipart upload key=SUBHZJ7HUV3H upload=75VNLN3Q09K0 tag=N1QL9T3H0H5J type=write size=3569008 2024-06-04T15:59:26.535 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.535+0000 7f5e9aacc780 1 > prepared operation key=JL69PUHT6NNT tag=NTL1EK6EZC1T type=del size=2984116 2024-06-04T15:59:26.537 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.536+0000 7f5e9aacc780 1 < completed part key=_multipart_XH0N984YVGKP.2~R0F2QNQNXYN0.0 size=174085 2024-06-04T15:59:26.539 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.539+0000 7f5e9aacc780 1 < completed multipart upload key=XH0N984YVGKP upload=R0F2QNQNXYN0 tag=XFNEUT3NH9Y8 type=write size=1222661 2024-06-04T15:59:26.541 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.541+0000 7f5e9aacc780 1 > prepared part key=_multipart_A8O0S3S45RGM.2~D4HRDJ0B3OTK.0 size=1048576 2024-06-04T15:59:26.542 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.542+0000 7f5e9aacc780 1 > prepared part key=_multipart_A8O0S3S45RGM.2~D4HRDJ0B3OTK.1 size=1048576 2024-06-04T15:59:26.544 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.543+0000 7f5e9aacc780 1 > prepared part key=_multipart_A8O0S3S45RGM.2~D4HRDJ0B3OTK.2 size=950745 2024-06-04T15:59:26.544 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.543+0000 7f5e9aacc780 1 > prepared multipart upload key=A8O0S3S45RGM upload=D4HRDJ0B3OTK tag=SWNJVXR8HQVT type=write size=4096473 2024-06-04T15:59:26.545 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.545+0000 7f5e9aacc780 1 < completed write operation key=A8O0S3S45RGM tag=Y6I23L221RL1 type=write size=509949 2024-06-04T15:59:26.546 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.546+0000 7f5e9aacc780 1 > prepared operation key=AOCB36Y5Q7B0 tag=IMZ6J16FLNED type=del size=1500398 2024-06-04T15:59:26.548 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.548+0000 7f5e9aacc780 1 < completed part key=_multipart_PNDPO2WUW7UX.2~0KRGRF24VHDE.0 size=1048576 2024-06-04T15:59:26.549 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.549+0000 7f5e9aacc780 1 < completed part key=_multipart_PNDPO2WUW7UX.2~0KRGRF24VHDE.1 size=171771 2024-06-04T15:59:26.551 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.551+0000 7f5e9aacc780 1 < completed multipart upload key=PNDPO2WUW7UX upload=0KRGRF24VHDE tag=B7GR3IWFDZO3 type=write size=2268923 2024-06-04T15:59:26.553 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.553+0000 7f5e9aacc780 1 > prepared part key=_multipart_UTZHANL9ER2Q.2~CHSOLQK6GINH.0 size=1048576 2024-06-04T15:59:26.554 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.554+0000 7f5e9aacc780 1 > prepared part key=_multipart_UTZHANL9ER2Q.2~CHSOLQK6GINH.1 size=49649 2024-06-04T15:59:26.554 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.554+0000 7f5e9aacc780 1 > prepared multipart upload key=UTZHANL9ER2Q upload=CHSOLQK6GINH tag=DEU5DZ70SIK9 type=write size=2146801 2024-06-04T15:59:26.555 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.555+0000 7f5e9aacc780 1 < completed delete operation key=B0HK5FJ2RGJE tag=U4JSZ3FFDVPM type=del 2024-06-04T15:59:26.557 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.556+0000 7f5e9aacc780 1 > prepared operation key=PASGIP872OVX tag=UM7S3A2AM9FQ type=del size=4136712 2024-06-04T15:59:26.558 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.558+0000 7f5e9aacc780 1 < completed delete operation key=1IKNQXU3Y2JJ tag=07NIURMUSJ0M type=del 2024-06-04T15:59:26.559 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.559+0000 7f5e9aacc780 1 > prepared operation key=NHPH4LYPP0LL tag=OOHFHLZ8F4XH type=del size=1649249 2024-06-04T15:59:26.560 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.560+0000 7f5e9aacc780 1 < completed delete operation key=AOCB36Y5Q7B0 tag=4KGEFV4YOB8S type=del 2024-06-04T15:59:26.563 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.563+0000 7f5e9aacc780 1 > prepared part key=_multipart_QUIVPH3OB6KN.2~1SC2LLSDB1FJ.0 size=77158 2024-06-04T15:59:26.563 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.563+0000 7f5e9aacc780 1 > prepared multipart upload key=QUIVPH3OB6KN upload=1SC2LLSDB1FJ tag=1VFS9SLSG8KT type=write size=1125734 2024-06-04T15:59:26.567 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.566+0000 7f5e9aacc780 1 < suggested update operation key=UW5LVIBG09SV tag=J85FZMBN2PQB type=write size=908995 2024-06-04T15:59:26.568 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.568+0000 7f5e9aacc780 1 > prepared operation key=XH0N984YVGKP tag=S583JFOEO11I type=del size=2357743 2024-06-04T15:59:26.571 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.571+0000 7f5e9aacc780 1 < suggested remove operation key=QJA2JPATITNH tag=SQRLBBFZ09XN type=del 2024-06-04T15:59:26.572 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.572+0000 7f5e9aacc780 1 > prepared operation key=Q2V1ICTBSCV1 tag=JZ8R8G0JH0I9 type=del size=1587626 2024-06-04T15:59:26.574 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.574+0000 7f5e9aacc780 -1 < failed to complete operation key=UW5LVIBG09SV tag=Q074XWRKXCD8 type=del size=3430941: (22) Invalid argument 2024-06-04T15:59:26.575 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.575+0000 7f5e9aacc780 1 > prepared operation key=AOCB36Y5Q7B0 tag=1EH6OZKAU7TW type=del size=1074429 2024-06-04T15:59:26.577 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.577+0000 7f5e9aacc780 1 < completed delete operation key=PASGIP872OVX tag=3SHPZ8KAVORE type=del 2024-06-04T15:59:26.579 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.580+0000 7f5e9aacc780 1 > prepared part key=_multipart_Q2V1ICTBSCV1.2~9C23KTKW81RA.0 size=1048576 2024-06-04T15:59:26.580 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.580+0000 7f5e9aacc780 1 > prepared part key=_multipart_Q2V1ICTBSCV1.2~9C23KTKW81RA.1 size=1048576 2024-06-04T15:59:26.582 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.581+0000 7f5e9aacc780 1 > prepared part key=_multipart_Q2V1ICTBSCV1.2~9C23KTKW81RA.2 size=677738 2024-06-04T15:59:26.582 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.581+0000 7f5e9aacc780 1 > prepared multipart upload key=Q2V1ICTBSCV1 upload=9C23KTKW81RA tag=VF6DOVWP0WYN type=write size=3823466 2024-06-04T15:59:26.582 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.582+0000 7f5e9aacc780 1 < canceled part key=_multipart_1IKNQXU3Y2JJ.2~6KD1X3BV1H7S.0 size=1048576 2024-06-04T15:59:26.583 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.583+0000 7f5e9aacc780 1 < completed part key=_multipart_1IKNQXU3Y2JJ.2~6KD1X3BV1H7S.1 size=1048576 2024-06-04T15:59:26.584 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.584+0000 7f5e9aacc780 1 < completed part key=_multipart_1IKNQXU3Y2JJ.2~6KD1X3BV1H7S.2 size=790113 2024-06-04T15:59:26.586 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.586+0000 7f5e9aacc780 1 < canceled multipart upload key=1IKNQXU3Y2JJ upload=6KD1X3BV1H7S tag=BUHSIVVDFK81 type=write size=3935841 2024-06-04T15:59:26.589 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.589+0000 7f5e9aacc780 1 > prepared part key=_multipart_UW5LVIBG09SV.2~5XMMO6MR4E1I.0 size=1048576 2024-06-04T15:59:26.590 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.590+0000 7f5e9aacc780 1 > prepared part key=_multipart_UW5LVIBG09SV.2~5XMMO6MR4E1I.1 size=1048576 2024-06-04T15:59:26.591 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.591+0000 7f5e9aacc780 1 > prepared part key=_multipart_UW5LVIBG09SV.2~5XMMO6MR4E1I.2 size=381391 2024-06-04T15:59:26.591 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.591+0000 7f5e9aacc780 1 > prepared multipart upload key=UW5LVIBG09SV upload=5XMMO6MR4E1I tag=6TPG6GTJNT0O type=write size=3527119 2024-06-04T15:59:26.593 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.592+0000 7f5e9aacc780 1 < completed delete operation key=PNDPO2WUW7UX tag=XC5JHXEKQ75I type=del 2024-06-04T15:59:26.594 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.593+0000 7f5e9aacc780 1 > prepared operation key=UW5LVIBG09SV tag=TJQLNVF55EO0 type=del size=2865966 2024-06-04T15:59:26.595 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.595+0000 7f5e9aacc780 1 < completed part key=_multipart_TUGKW7F4V9NO.2~5L4EK2PWB9RS.0 size=1048576 2024-06-04T15:59:26.597 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.596+0000 7f5e9aacc780 1 < completed part key=_multipart_TUGKW7F4V9NO.2~5L4EK2PWB9RS.1 size=131899 2024-06-04T15:59:26.599 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.598+0000 7f5e9aacc780 1 < completed multipart upload key=TUGKW7F4V9NO upload=5L4EK2PWB9RS tag=4IJOYNC95ECD type=write size=2229051 2024-06-04T15:59:26.600 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.600+0000 7f5e9aacc780 1 > prepared operation key=UW5LVIBG09SV tag=L6198AG38JK4 type=del size=3363067 2024-06-04T15:59:26.602 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.601+0000 7f5e9aacc780 1 < completed delete operation key=B0HK5FJ2RGJE tag=06G8YT3HINKV type=del 2024-06-04T15:59:26.603 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.603+0000 7f5e9aacc780 1 > prepared operation key=Q4OFQI0F5YLG tag=M1AWOTDGITYI type=del size=132733 2024-06-04T15:59:26.604 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.604+0000 7f5e9aacc780 1 < completed delete operation key=QUIVPH3OB6KN tag=M0OQXQ6SXKFS type=del 2024-06-04T15:59:26.606 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.606+0000 7f5e9aacc780 1 > prepared operation key=NJ5U8JTT32QK tag=Q2B4UXPX8GLL type=del size=980294 2024-06-04T15:59:26.607 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.607+0000 7f5e9aacc780 1 < completed delete operation key=JL69PUHT6NNT tag=NTL1EK6EZC1T type=del 2024-06-04T15:59:26.610 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.610+0000 7f5e9aacc780 1 > prepared part key=_multipart_K01DAK0M4I4M.2~4FO1X0KJO4ZL.0 size=1048576 2024-06-04T15:59:26.611 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.611+0000 7f5e9aacc780 1 > prepared part key=_multipart_K01DAK0M4I4M.2~4FO1X0KJO4ZL.1 size=1048576 2024-06-04T15:59:26.613 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.613+0000 7f5e9aacc780 1 > prepared part key=_multipart_K01DAK0M4I4M.2~4FO1X0KJO4ZL.2 size=97298 2024-06-04T15:59:26.613 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.613+0000 7f5e9aacc780 1 > prepared multipart upload key=K01DAK0M4I4M upload=4FO1X0KJO4ZL tag=SQIW0TM8O7DR type=write size=3243026 2024-06-04T15:59:26.614 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.614+0000 7f5e9aacc780 1 < completed part key=_multipart_A8O0S3S45RGM.2~D4HRDJ0B3OTK.0 size=1048576 2024-06-04T15:59:26.615 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.615+0000 7f5e9aacc780 1 < completed part key=_multipart_A8O0S3S45RGM.2~D4HRDJ0B3OTK.1 size=1048576 2024-06-04T15:59:26.616 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.616+0000 7f5e9aacc780 1 < completed part key=_multipart_A8O0S3S45RGM.2~D4HRDJ0B3OTK.2 size=950745 2024-06-04T15:59:26.619 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.619+0000 7f5e9aacc780 1 < completed multipart upload key=A8O0S3S45RGM upload=D4HRDJ0B3OTK tag=SWNJVXR8HQVT type=write size=4096473 2024-06-04T15:59:26.622 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.622+0000 7f5e9aacc780 1 > prepared part key=_multipart_TUGKW7F4V9NO.2~RWMKBLWPDJ2X.0 size=188835 2024-06-04T15:59:26.622 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.622+0000 7f5e9aacc780 1 > prepared multipart upload key=TUGKW7F4V9NO upload=RWMKBLWPDJ2X tag=XDI4XLJR274B type=write size=1237411 2024-06-04T15:59:26.624 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.623+0000 7f5e9aacc780 1 < completed delete operation key=AOCB36Y5Q7B0 tag=IMZ6J16FLNED type=del 2024-06-04T15:59:26.626 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.626+0000 7f5e9aacc780 1 > prepared part key=_multipart_7S9S3MIG7WIT.2~FCQTZNXI3CKO.0 size=973856 2024-06-04T15:59:26.626 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.626+0000 7f5e9aacc780 1 > prepared multipart upload key=7S9S3MIG7WIT upload=FCQTZNXI3CKO tag=1AN0R9PFQUTJ type=write size=2022432 2024-06-04T15:59:26.627 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.627+0000 7f5e9aacc780 1 < completed part key=_multipart_UTZHANL9ER2Q.2~CHSOLQK6GINH.0 size=1048576 2024-06-04T15:59:26.628 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.628+0000 7f5e9aacc780 1 < completed part key=_multipart_UTZHANL9ER2Q.2~CHSOLQK6GINH.1 size=49649 2024-06-04T15:59:26.630 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.630+0000 7f5e9aacc780 1 < completed multipart upload key=UTZHANL9ER2Q upload=CHSOLQK6GINH tag=DEU5DZ70SIK9 type=write size=2146801 2024-06-04T15:59:26.632 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.632+0000 7f5e9aacc780 1 > prepared operation key=Q2V1ICTBSCV1 tag=DPUK3QW5OAWQ type=del size=68714 2024-06-04T15:59:26.634 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.633+0000 7f5e9aacc780 1 < completed delete operation key=PASGIP872OVX tag=UM7S3A2AM9FQ type=del 2024-06-04T15:59:26.635 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.635+0000 7f5e9aacc780 1 > prepared operation key=QUIVPH3OB6KN tag=3J35V1CANPAV type=del size=373588 2024-06-04T15:59:26.636 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.636+0000 7f5e9aacc780 1 < canceled operation key=NHPH4LYPP0LL tag=OOHFHLZ8F4XH type=del size=1649249 2024-06-04T15:59:26.639 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.639+0000 7f5e9aacc780 1 > prepared part key=_multipart_NHPH4LYPP0LL.2~549MPV3E3DTW.0 size=1048576 2024-06-04T15:59:26.640 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.640+0000 7f5e9aacc780 1 > prepared part key=_multipart_NHPH4LYPP0LL.2~549MPV3E3DTW.1 size=80320 2024-06-04T15:59:26.640 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.640+0000 7f5e9aacc780 1 > prepared multipart upload key=NHPH4LYPP0LL upload=549MPV3E3DTW tag=QRHPFUYJ67R5 type=write size=2177472 2024-06-04T15:59:26.642 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.642+0000 7f5e9aacc780 1 < completed part key=_multipart_QUIVPH3OB6KN.2~1SC2LLSDB1FJ.0 size=77158 2024-06-04T15:59:26.644 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.644+0000 7f5e9aacc780 1 < completed multipart upload key=QUIVPH3OB6KN upload=1SC2LLSDB1FJ tag=1VFS9SLSG8KT type=write size=1125734 2024-06-04T15:59:26.646 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.645+0000 7f5e9aacc780 1 > prepared operation key=AOCB36Y5Q7B0 tag=PYU0XI98CW0Y type=del size=1570311 2024-06-04T15:59:26.648 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.648+0000 7f5e9aacc780 1 < suggested update operation key=XH0N984YVGKP tag=S583JFOEO11I type=del size=2357743 2024-06-04T15:59:26.651 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.650+0000 7f5e9aacc780 1 > prepared part key=_multipart_9MPRI6LW3956.2~CG6U99KQPU53.0 size=1048576 2024-06-04T15:59:26.652 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.651+0000 7f5e9aacc780 1 > prepared part key=_multipart_9MPRI6LW3956.2~CG6U99KQPU53.1 size=849359 2024-06-04T15:59:26.652 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.651+0000 7f5e9aacc780 1 > prepared multipart upload key=9MPRI6LW3956 upload=CG6U99KQPU53 tag=ORBGGDJUNN6A type=write size=2946511 2024-06-04T15:59:26.653 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.653+0000 7f5e9aacc780 1 < completed delete operation key=Q2V1ICTBSCV1 tag=JZ8R8G0JH0I9 type=del 2024-06-04T15:59:26.654 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.654+0000 7f5e9aacc780 1 > prepared operation key=NJ5U8JTT32QK tag=APW5FO1DI7RH type=del size=1303484 2024-06-04T15:59:26.656 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.655+0000 7f5e9aacc780 1 < completed delete operation key=AOCB36Y5Q7B0 tag=1EH6OZKAU7TW type=del 2024-06-04T15:59:26.658 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.658+0000 7f5e9aacc780 1 > prepared part key=_multipart_Q4OFQI0F5YLG.2~THBMRHAKOVMI.0 size=942349 2024-06-04T15:59:26.658 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.658+0000 7f5e9aacc780 1 > prepared multipart upload key=Q4OFQI0F5YLG upload=THBMRHAKOVMI tag=RZ5DZGCO6ZZR type=write size=1990925 2024-06-04T15:59:26.661 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.660+0000 7f5e9aacc780 1 < completed part key=_multipart_Q2V1ICTBSCV1.2~9C23KTKW81RA.0 size=1048576 2024-06-04T15:59:26.661 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.661+0000 7f5e9aacc780 1 < completed part key=_multipart_Q2V1ICTBSCV1.2~9C23KTKW81RA.1 size=1048576 2024-06-04T15:59:26.662 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.661+0000 7f5e9aacc780 1 < completed part key=_multipart_Q2V1ICTBSCV1.2~9C23KTKW81RA.2 size=677738 2024-06-04T15:59:26.664 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.664+0000 7f5e9aacc780 1 < completed multipart upload key=Q2V1ICTBSCV1 upload=9C23KTKW81RA tag=VF6DOVWP0WYN type=write size=3823466 2024-06-04T15:59:26.666 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.665+0000 7f5e9aacc780 1 > prepared operation key=XH0N984YVGKP tag=VRTJC667ZPZH type=del size=2751005 2024-06-04T15:59:26.666 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.666+0000 7f5e9aacc780 1 < canceled part key=_multipart_UW5LVIBG09SV.2~5XMMO6MR4E1I.0 size=1048576 2024-06-04T15:59:26.667 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.667+0000 7f5e9aacc780 1 < completed part key=_multipart_UW5LVIBG09SV.2~5XMMO6MR4E1I.1 size=1048576 2024-06-04T15:59:26.668 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.668+0000 7f5e9aacc780 1 < completed part key=_multipart_UW5LVIBG09SV.2~5XMMO6MR4E1I.2 size=381391 2024-06-04T15:59:26.670 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.670+0000 7f5e9aacc780 1 < canceled multipart upload key=UW5LVIBG09SV upload=5XMMO6MR4E1I tag=6TPG6GTJNT0O type=write size=3527119 2024-06-04T15:59:26.673 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.673+0000 7f5e9aacc780 1 > prepared part key=_multipart_GCPC9OJH7KWU.2~RG24DD7SIJH0.0 size=1048576 2024-06-04T15:59:26.674 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.674+0000 7f5e9aacc780 1 > prepared part key=_multipart_GCPC9OJH7KWU.2~RG24DD7SIJH0.1 size=1048576 2024-06-04T15:59:26.675 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.675+0000 7f5e9aacc780 1 > prepared part key=_multipart_GCPC9OJH7KWU.2~RG24DD7SIJH0.2 size=844230 2024-06-04T15:59:26.675 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.675+0000 7f5e9aacc780 1 > prepared multipart upload key=GCPC9OJH7KWU upload=RG24DD7SIJH0 tag=625MVBOY1ELA type=write size=3989958 2024-06-04T15:59:26.676 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.676+0000 7f5e9aacc780 1 < completed delete operation key=UW5LVIBG09SV tag=TJQLNVF55EO0 type=del 2024-06-04T15:59:26.678 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.677+0000 7f5e9aacc780 1 > prepared operation key=2BT2AXKB1RTA tag=IF0MV3LR11I5 type=del size=1400406 2024-06-04T15:59:26.679 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.679+0000 7f5e9aacc780 1 < completed delete operation key=UW5LVIBG09SV tag=L6198AG38JK4 type=del 2024-06-04T15:59:26.680 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.680+0000 7f5e9aacc780 1 > prepared operation key=7S9S3MIG7WIT tag=9NUZJ62X6E3W type=del size=511355 2024-06-04T15:59:26.682 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.681+0000 7f5e9aacc780 1 < canceled operation key=Q4OFQI0F5YLG tag=M1AWOTDGITYI type=del size=132733 2024-06-04T15:59:26.684 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.684+0000 7f5e9aacc780 1 > prepared part key=_multipart_PNDPO2WUW7UX.2~BT9HKVHSX3FX.0 size=239675 2024-06-04T15:59:26.684 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.684+0000 7f5e9aacc780 1 > prepared multipart upload key=PNDPO2WUW7UX upload=BT9HKVHSX3FX tag=PB7OX4JJ9PTI type=write size=1288251 2024-06-04T15:59:26.686 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.686+0000 7f5e9aacc780 1 < canceled operation key=NJ5U8JTT32QK tag=Q2B4UXPX8GLL type=del size=980294 2024-06-04T15:59:26.688 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.687+0000 7f5e9aacc780 1 > prepared operation key=Q2V1ICTBSCV1 tag=X7T6R3NY0D5M type=del size=3586938 2024-06-04T15:59:26.689 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.689+0000 7f5e9aacc780 1 < completed part key=_multipart_K01DAK0M4I4M.2~4FO1X0KJO4ZL.0 size=1048576 2024-06-04T15:59:26.690 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.690+0000 7f5e9aacc780 1 < completed part key=_multipart_K01DAK0M4I4M.2~4FO1X0KJO4ZL.1 size=1048576 2024-06-04T15:59:26.691 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.691+0000 7f5e9aacc780 1 < completed part key=_multipart_K01DAK0M4I4M.2~4FO1X0KJO4ZL.2 size=97298 2024-06-04T15:59:26.693 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.693+0000 7f5e9aacc780 1 < completed multipart upload key=K01DAK0M4I4M upload=4FO1X0KJO4ZL tag=SQIW0TM8O7DR type=write size=3243026 2024-06-04T15:59:26.696 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.695+0000 7f5e9aacc780 1 > prepared part key=_multipart_Q4OFQI0F5YLG.2~KG24V6MVAOCZ.0 size=1048576 2024-06-04T15:59:26.697 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.697+0000 7f5e9aacc780 1 > prepared part key=_multipart_Q4OFQI0F5YLG.2~KG24V6MVAOCZ.1 size=1048576 2024-06-04T15:59:26.698 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.698+0000 7f5e9aacc780 1 > prepared part key=_multipart_Q4OFQI0F5YLG.2~KG24V6MVAOCZ.2 size=875763 2024-06-04T15:59:26.698 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.698+0000 7f5e9aacc780 1 > prepared multipart upload key=Q4OFQI0F5YLG upload=KG24V6MVAOCZ tag=DUMW9ORSXA6V type=write size=4021491 2024-06-04T15:59:26.698 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.698+0000 7f5e9aacc780 1 < canceled part key=_multipart_TUGKW7F4V9NO.2~RWMKBLWPDJ2X.0 size=188835 2024-06-04T15:59:26.701 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.700+0000 7f5e9aacc780 1 < canceled multipart upload key=TUGKW7F4V9NO upload=RWMKBLWPDJ2X tag=XDI4XLJR274B type=write size=1237411 2024-06-04T15:59:26.703 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.703+0000 7f5e9aacc780 1 > prepared part key=_multipart_UTZHANL9ER2Q.2~0VUV953L2TRP.0 size=248354 2024-06-04T15:59:26.703 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.703+0000 7f5e9aacc780 1 > prepared multipart upload key=UTZHANL9ER2Q upload=0VUV953L2TRP tag=UYVIGBS23BB2 type=write size=1296930 2024-06-04T15:59:26.704 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.704+0000 7f5e9aacc780 1 < completed part key=_multipart_7S9S3MIG7WIT.2~FCQTZNXI3CKO.0 size=973856 2024-06-04T15:59:26.707 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.707+0000 7f5e9aacc780 1 < completed multipart upload key=7S9S3MIG7WIT upload=FCQTZNXI3CKO tag=1AN0R9PFQUTJ type=write size=2022432 2024-06-04T15:59:26.708 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.709+0000 7f5e9aacc780 1 > prepared operation key=AOCB36Y5Q7B0 tag=3ISDTI19HN9A type=del size=3351277 2024-06-04T15:59:26.710 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.710+0000 7f5e9aacc780 1 < completed delete operation key=Q2V1ICTBSCV1 tag=DPUK3QW5OAWQ type=del 2024-06-04T15:59:26.711 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.711+0000 7f5e9aacc780 1 > prepared operation key=K01DAK0M4I4M tag=6DKLL7XYFWG6 type=del size=1809841 2024-06-04T15:59:26.713 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.713+0000 7f5e9aacc780 1 < canceled operation key=QUIVPH3OB6KN tag=3J35V1CANPAV type=del size=373588 2024-06-04T15:59:26.716 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.715+0000 7f5e9aacc780 1 > prepared part key=_multipart_XH0N984YVGKP.2~DDO45NJTH2AB.0 size=1048576 2024-06-04T15:59:26.717 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.716+0000 7f5e9aacc780 1 > prepared part key=_multipart_XH0N984YVGKP.2~DDO45NJTH2AB.1 size=829888 2024-06-04T15:59:26.717 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.716+0000 7f5e9aacc780 1 > prepared multipart upload key=XH0N984YVGKP upload=DDO45NJTH2AB tag=HRC3540EGW0X type=write size=2927040 2024-06-04T15:59:26.717 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.717+0000 7f5e9aacc780 1 < canceled part key=_multipart_NHPH4LYPP0LL.2~549MPV3E3DTW.0 size=1048576 2024-06-04T15:59:26.718 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.718+0000 7f5e9aacc780 1 < completed part key=_multipart_NHPH4LYPP0LL.2~549MPV3E3DTW.1 size=80320 2024-06-04T15:59:26.720 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.720+0000 7f5e9aacc780 1 < canceled multipart upload key=NHPH4LYPP0LL upload=549MPV3E3DTW tag=QRHPFUYJ67R5 type=write size=2177472 2024-06-04T15:59:26.722 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.722+0000 7f5e9aacc780 1 > prepared operation key=PASGIP872OVX tag=DTSUN64UMTVH type=del size=6967 2024-06-04T15:59:26.723 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.723+0000 7f5e9aacc780 1 < completed delete operation key=AOCB36Y5Q7B0 tag=PYU0XI98CW0Y type=del 2024-06-04T15:59:26.726 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.725+0000 7f5e9aacc780 1 > prepared part key=_multipart_NJ5U8JTT32QK.2~H2TF3Q0WKRJR.0 size=1048576 2024-06-04T15:59:26.727 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.727+0000 7f5e9aacc780 1 > prepared part key=_multipart_NJ5U8JTT32QK.2~H2TF3Q0WKRJR.1 size=1048576 2024-06-04T15:59:26.728 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.728+0000 7f5e9aacc780 1 > prepared part key=_multipart_NJ5U8JTT32QK.2~H2TF3Q0WKRJR.2 size=26444 2024-06-04T15:59:26.728 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.728+0000 7f5e9aacc780 1 > prepared multipart upload key=NJ5U8JTT32QK upload=H2TF3Q0WKRJR tag=762ULVHGFTLX type=write size=3172172 2024-06-04T15:59:26.729 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.729+0000 7f5e9aacc780 1 < completed part key=_multipart_9MPRI6LW3956.2~CG6U99KQPU53.0 size=1048576 2024-06-04T15:59:26.730 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.730+0000 7f5e9aacc780 1 < completed part key=_multipart_9MPRI6LW3956.2~CG6U99KQPU53.1 size=849359 2024-06-04T15:59:26.732 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.732+0000 7f5e9aacc780 1 < completed multipart upload key=9MPRI6LW3956 upload=CG6U99KQPU53 tag=ORBGGDJUNN6A type=write size=2946511 2024-06-04T15:59:26.735 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.735+0000 7f5e9aacc780 1 > prepared part key=_multipart_JL69PUHT6NNT.2~B24T9N6IYXOU.0 size=1048576 2024-06-04T15:59:26.736 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.736+0000 7f5e9aacc780 1 > prepared part key=_multipart_JL69PUHT6NNT.2~B24T9N6IYXOU.1 size=1048576 2024-06-04T15:59:26.737 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.737+0000 7f5e9aacc780 1 > prepared part key=_multipart_JL69PUHT6NNT.2~B24T9N6IYXOU.2 size=853907 2024-06-04T15:59:26.737 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.737+0000 7f5e9aacc780 1 > prepared multipart upload key=JL69PUHT6NNT upload=B24T9N6IYXOU tag=0PW44G5SN2XI type=write size=3999635 2024-06-04T15:59:26.739 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.738+0000 7f5e9aacc780 1 < completed delete operation key=NJ5U8JTT32QK tag=APW5FO1DI7RH type=del 2024-06-04T15:59:26.741 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.741+0000 7f5e9aacc780 1 > prepared part key=_multipart_HD6SNICRCDLL.2~EP3THXRZM02O.0 size=319037 2024-06-04T15:59:26.741 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.741+0000 7f5e9aacc780 1 > prepared multipart upload key=HD6SNICRCDLL upload=EP3THXRZM02O tag=HDR2Q5WHANUP type=write size=1367613 2024-06-04T15:59:26.743 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.742+0000 7f5e9aacc780 1 < completed part key=_multipart_Q4OFQI0F5YLG.2~THBMRHAKOVMI.0 size=942349 2024-06-04T15:59:26.745 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.745+0000 7f5e9aacc780 1 < completed multipart upload key=Q4OFQI0F5YLG upload=THBMRHAKOVMI tag=RZ5DZGCO6ZZR type=write size=1990925 2024-06-04T15:59:26.748 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.748+0000 7f5e9aacc780 1 > prepared part key=_multipart_FBV2MAG130M6.2~V8SZB8FLCAFG.0 size=1048576 2024-06-04T15:59:26.751 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.751+0000 7f5e9aacc780 1 > prepared part key=_multipart_FBV2MAG130M6.2~V8SZB8FLCAFG.1 size=1048576 2024-06-04T15:59:26.752 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.752+0000 7f5e9aacc780 1 > prepared part key=_multipart_FBV2MAG130M6.2~V8SZB8FLCAFG.2 size=185220 2024-06-04T15:59:26.752 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.752+0000 7f5e9aacc780 1 > prepared multipart upload key=FBV2MAG130M6 upload=V8SZB8FLCAFG tag=9RJ5LPYHXI01 type=write size=3330948 2024-06-04T15:59:26.754 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.753+0000 7f5e9aacc780 1 < completed delete operation key=XH0N984YVGKP tag=VRTJC667ZPZH type=del 2024-06-04T15:59:26.756 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.756+0000 7f5e9aacc780 1 > prepared part key=_multipart_AOCB36Y5Q7B0.2~3GMMZFEMV52R.0 size=1048576 2024-06-04T15:59:26.757 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.757+0000 7f5e9aacc780 1 > prepared part key=_multipart_AOCB36Y5Q7B0.2~3GMMZFEMV52R.1 size=471431 2024-06-04T15:59:26.757 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.757+0000 7f5e9aacc780 1 > prepared multipart upload key=AOCB36Y5Q7B0 upload=3GMMZFEMV52R tag=1GPEVF11JP7J type=write size=2568583 2024-06-04T15:59:26.758 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.758+0000 7f5e9aacc780 1 < completed part key=_multipart_GCPC9OJH7KWU.2~RG24DD7SIJH0.0 size=1048576 2024-06-04T15:59:26.759 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.759+0000 7f5e9aacc780 1 < completed part key=_multipart_GCPC9OJH7KWU.2~RG24DD7SIJH0.1 size=1048576 2024-06-04T15:59:26.760 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.760+0000 7f5e9aacc780 1 < completed part key=_multipart_GCPC9OJH7KWU.2~RG24DD7SIJH0.2 size=844230 2024-06-04T15:59:26.763 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.763+0000 7f5e9aacc780 1 < completed multipart upload key=GCPC9OJH7KWU upload=RG24DD7SIJH0 tag=625MVBOY1ELA type=write size=3989958 2024-06-04T15:59:26.765 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.764+0000 7f5e9aacc780 1 > prepared operation key=QUIVPH3OB6KN tag=L6TK5RS6432S type=write size=136303 2024-06-04T15:59:26.768 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.767+0000 7f5e9aacc780 1 < suggested update operation key=2BT2AXKB1RTA tag=IF0MV3LR11I5 type=del size=1400406 2024-06-04T15:59:26.769 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.769+0000 7f5e9aacc780 1 > prepared operation key=A8O0S3S45RGM tag=CVIZ9JL6YW59 type=del size=3310643 2024-06-04T15:59:26.772 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.772+0000 7f5e9aacc780 1 < suggested update operation key=7S9S3MIG7WIT tag=9NUZJ62X6E3W type=del size=511355 2024-06-04T15:59:26.774 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.774+0000 7f5e9aacc780 1 > prepared part key=_multipart_SUBHZJ7HUV3H.2~2PDLU0M0J491.0 size=1048576 2024-06-04T15:59:26.775 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.775+0000 7f5e9aacc780 1 > prepared part key=_multipart_SUBHZJ7HUV3H.2~2PDLU0M0J491.1 size=528063 2024-06-04T15:59:26.776 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.775+0000 7f5e9aacc780 1 > prepared multipart upload key=SUBHZJ7HUV3H upload=2PDLU0M0J491 tag=OL5VSQ97R288 type=write size=2625215 2024-06-04T15:59:26.777 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.777+0000 7f5e9aacc780 1 < completed part key=_multipart_PNDPO2WUW7UX.2~BT9HKVHSX3FX.0 size=239675 2024-06-04T15:59:26.779 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.779+0000 7f5e9aacc780 1 < completed multipart upload key=PNDPO2WUW7UX upload=BT9HKVHSX3FX tag=PB7OX4JJ9PTI type=write size=1288251 2024-06-04T15:59:26.781 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.781+0000 7f5e9aacc780 1 > prepared part key=_multipart_9MPRI6LW3956.2~B0NRCKHGN3GG.0 size=862805 2024-06-04T15:59:26.781 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.781+0000 7f5e9aacc780 1 > prepared multipart upload key=9MPRI6LW3956 upload=B0NRCKHGN3GG tag=TZ3A44IJ23GT type=write size=1911381 2024-06-04T15:59:26.784 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.784+0000 7f5e9aacc780 1 < suggested update operation key=Q2V1ICTBSCV1 tag=X7T6R3NY0D5M type=del size=3586938 2024-06-04T15:59:26.785 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.785+0000 7f5e9aacc780 1 > prepared operation key=DY9JWHWNAUO1 tag=KOFK21B7M1MS type=del size=766455 2024-06-04T15:59:26.787 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.786+0000 7f5e9aacc780 1 < completed part key=_multipart_Q4OFQI0F5YLG.2~KG24V6MVAOCZ.0 size=1048576 2024-06-04T15:59:26.787 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.786+0000 7f5e9aacc780 1 < canceled part key=_multipart_Q4OFQI0F5YLG.2~KG24V6MVAOCZ.1 size=1048576 2024-06-04T15:59:26.788 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.787+0000 7f5e9aacc780 1 < completed part key=_multipart_Q4OFQI0F5YLG.2~KG24V6MVAOCZ.2 size=875763 2024-06-04T15:59:26.790 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.790+0000 7f5e9aacc780 1 < canceled multipart upload key=Q4OFQI0F5YLG upload=KG24V6MVAOCZ tag=DUMW9ORSXA6V type=write size=4021491 2024-06-04T15:59:26.791 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.791+0000 7f5e9aacc780 1 > prepared operation key=UTZHANL9ER2Q tag=P512HOEU88ZU type=del size=125091 2024-06-04T15:59:26.793 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.792+0000 7f5e9aacc780 1 < completed part key=_multipart_UTZHANL9ER2Q.2~0VUV953L2TRP.0 size=248354 2024-06-04T15:59:26.795 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.795+0000 7f5e9aacc780 1 < completed multipart upload key=UTZHANL9ER2Q upload=0VUV953L2TRP tag=UYVIGBS23BB2 type=write size=1296930 2024-06-04T15:59:26.798 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.797+0000 7f5e9aacc780 1 > prepared part key=_multipart_DY9JWHWNAUO1.2~2WDQSLYLEQ7V.0 size=1048576 2024-06-04T15:59:26.799 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.798+0000 7f5e9aacc780 1 > prepared part key=_multipart_DY9JWHWNAUO1.2~2WDQSLYLEQ7V.1 size=1048576 2024-06-04T15:59:26.800 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.799+0000 7f5e9aacc780 1 > prepared part key=_multipart_DY9JWHWNAUO1.2~2WDQSLYLEQ7V.2 size=393556 2024-06-04T15:59:26.800 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.799+0000 7f5e9aacc780 1 > prepared multipart upload key=DY9JWHWNAUO1 upload=2WDQSLYLEQ7V tag=RNKX4H43TBRG type=write size=3539284 2024-06-04T15:59:26.801 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.801+0000 7f5e9aacc780 1 < completed delete operation key=AOCB36Y5Q7B0 tag=3ISDTI19HN9A type=del 2024-06-04T15:59:26.804 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.804+0000 7f5e9aacc780 1 > prepared part key=_multipart_UW5LVIBG09SV.2~2SERUUR8UW9W.0 size=1048576 2024-06-04T15:59:26.805 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.804+0000 7f5e9aacc780 1 > prepared part key=_multipart_UW5LVIBG09SV.2~2SERUUR8UW9W.1 size=1048576 2024-06-04T15:59:26.806 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.805+0000 7f5e9aacc780 1 > prepared part key=_multipart_UW5LVIBG09SV.2~2SERUUR8UW9W.2 size=774717 2024-06-04T15:59:26.806 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.805+0000 7f5e9aacc780 1 > prepared multipart upload key=UW5LVIBG09SV upload=2SERUUR8UW9W tag=UIXLL1OKDF5C type=write size=3920445 2024-06-04T15:59:26.807 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.807+0000 7f5e9aacc780 1 < completed delete operation key=K01DAK0M4I4M tag=6DKLL7XYFWG6 type=del 2024-06-04T15:59:26.808 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.808+0000 7f5e9aacc780 1 > prepared operation key=03ZNYG3WLMP4 tag=M8XDTOREYIZE type=del size=2107337 2024-06-04T15:59:26.810 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.809+0000 7f5e9aacc780 1 < completed part key=_multipart_XH0N984YVGKP.2~DDO45NJTH2AB.0 size=1048576 2024-06-04T15:59:26.811 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.811+0000 7f5e9aacc780 1 < completed part key=_multipart_XH0N984YVGKP.2~DDO45NJTH2AB.1 size=829888 2024-06-04T15:59:26.813 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.813+0000 7f5e9aacc780 1 < completed multipart upload key=XH0N984YVGKP upload=DDO45NJTH2AB tag=HRC3540EGW0X type=write size=2927040 2024-06-04T15:59:26.815 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.814+0000 7f5e9aacc780 1 > prepared operation key=SUBHZJ7HUV3H tag=K86BB9CIB4X9 type=del size=3841445 2024-06-04T15:59:26.816 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.816+0000 7f5e9aacc780 1 < completed delete operation key=PASGIP872OVX tag=DTSUN64UMTVH type=del 2024-06-04T15:59:26.818 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.817+0000 7f5e9aacc780 1 > prepared operation key=2BT2AXKB1RTA tag=1815BQUWM04J type=del size=2092417 2024-06-04T15:59:26.819 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.819+0000 7f5e9aacc780 1 < completed part key=_multipart_NJ5U8JTT32QK.2~H2TF3Q0WKRJR.0 size=1048576 2024-06-04T15:59:26.820 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.819+0000 7f5e9aacc780 1 < completed part key=_multipart_NJ5U8JTT32QK.2~H2TF3Q0WKRJR.1 size=1048576 2024-06-04T15:59:26.820 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.819+0000 7f5e9aacc780 1 < canceled part key=_multipart_NJ5U8JTT32QK.2~H2TF3Q0WKRJR.2 size=26444 2024-06-04T15:59:26.822 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.822+0000 7f5e9aacc780 1 < canceled multipart upload key=NJ5U8JTT32QK upload=H2TF3Q0WKRJR tag=762ULVHGFTLX type=write size=3172172 2024-06-04T15:59:26.825 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.824+0000 7f5e9aacc780 1 > prepared part key=_multipart_TUGKW7F4V9NO.2~740XC92R0CK7.0 size=1048576 2024-06-04T15:59:26.826 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.826+0000 7f5e9aacc780 1 > prepared part key=_multipart_TUGKW7F4V9NO.2~740XC92R0CK7.1 size=176662 2024-06-04T15:59:26.826 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.826+0000 7f5e9aacc780 1 > prepared multipart upload key=TUGKW7F4V9NO upload=740XC92R0CK7 tag=YTR5IWC5PFV7 type=write size=2273814 2024-06-04T15:59:26.827 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.827+0000 7f5e9aacc780 1 < completed part key=_multipart_JL69PUHT6NNT.2~B24T9N6IYXOU.0 size=1048576 2024-06-04T15:59:26.828 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.828+0000 7f5e9aacc780 1 < completed part key=_multipart_JL69PUHT6NNT.2~B24T9N6IYXOU.1 size=1048576 2024-06-04T15:59:26.828 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.828+0000 7f5e9aacc780 1 < canceled part key=_multipart_JL69PUHT6NNT.2~B24T9N6IYXOU.2 size=853907 2024-06-04T15:59:26.830 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.830+0000 7f5e9aacc780 1 < canceled multipart upload key=JL69PUHT6NNT upload=B24T9N6IYXOU tag=0PW44G5SN2XI type=write size=3999635 2024-06-04T15:59:26.832 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.831+0000 7f5e9aacc780 1 > prepared operation key=HD6SNICRCDLL tag=DOEZAORJOO1R type=del size=2864421 2024-06-04T15:59:26.833 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.833+0000 7f5e9aacc780 1 < completed part key=_multipart_HD6SNICRCDLL.2~EP3THXRZM02O.0 size=319037 2024-06-04T15:59:26.835 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.835+0000 7f5e9aacc780 1 < completed multipart upload key=HD6SNICRCDLL upload=EP3THXRZM02O tag=HDR2Q5WHANUP type=write size=1367613 2024-06-04T15:59:26.836 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.836+0000 7f5e9aacc780 1 > prepared operation key=4W5HB9WQQHR6 tag=VIPEHATPXY59 type=del size=3686010 2024-06-04T15:59:26.838 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.837+0000 7f5e9aacc780 1 < completed part key=_multipart_FBV2MAG130M6.2~V8SZB8FLCAFG.0 size=1048576 2024-06-04T15:59:26.839 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.838+0000 7f5e9aacc780 1 < completed part key=_multipart_FBV2MAG130M6.2~V8SZB8FLCAFG.1 size=1048576 2024-06-04T15:59:26.840 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.840+0000 7f5e9aacc780 1 < completed part key=_multipart_FBV2MAG130M6.2~V8SZB8FLCAFG.2 size=185220 2024-06-04T15:59:26.842 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.842+0000 7f5e9aacc780 1 < completed multipart upload key=FBV2MAG130M6 upload=V8SZB8FLCAFG tag=9RJ5LPYHXI01 type=write size=3330948 2024-06-04T15:59:26.844 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.843+0000 7f5e9aacc780 1 > prepared operation key=1IKNQXU3Y2JJ tag=WZZ3O3THN59F type=write size=663103 2024-06-04T15:59:26.845 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.845+0000 7f5e9aacc780 1 < completed part key=_multipart_AOCB36Y5Q7B0.2~3GMMZFEMV52R.0 size=1048576 2024-06-04T15:59:26.846 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.846+0000 7f5e9aacc780 1 < completed part key=_multipart_AOCB36Y5Q7B0.2~3GMMZFEMV52R.1 size=471431 2024-06-04T15:59:26.849 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.849+0000 7f5e9aacc780 1 < completed multipart upload key=AOCB36Y5Q7B0 upload=3GMMZFEMV52R tag=1GPEVF11JP7J type=write size=2568583 2024-06-04T15:59:26.850 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.850+0000 7f5e9aacc780 1 > prepared operation key=QUIVPH3OB6KN tag=32PECTXSICGI type=del size=3811183 2024-06-04T15:59:26.852 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.851+0000 7f5e9aacc780 1 < completed write operation key=QUIVPH3OB6KN tag=L6TK5RS6432S type=write size=136303 2024-06-04T15:59:26.853 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.853+0000 7f5e9aacc780 1 > prepared operation key=NJ5U8JTT32QK tag=4OZP9DC2WLMD type=del size=2029046 2024-06-04T15:59:26.854 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.854+0000 7f5e9aacc780 1 < completed delete operation key=A8O0S3S45RGM tag=CVIZ9JL6YW59 type=del 2024-06-04T15:59:26.856 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.855+0000 7f5e9aacc780 1 > prepared operation key=PASGIP872OVX tag=61GSRS5JMWO7 type=del size=3164383 2024-06-04T15:59:26.857 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.857+0000 7f5e9aacc780 1 < completed part key=_multipart_SUBHZJ7HUV3H.2~2PDLU0M0J491.0 size=1048576 2024-06-04T15:59:26.858 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.858+0000 7f5e9aacc780 1 < completed part key=_multipart_SUBHZJ7HUV3H.2~2PDLU0M0J491.1 size=528063 2024-06-04T15:59:26.861 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.860+0000 7f5e9aacc780 1 < completed multipart upload key=SUBHZJ7HUV3H upload=2PDLU0M0J491 tag=OL5VSQ97R288 type=write size=2625215 2024-06-04T15:59:26.863 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.863+0000 7f5e9aacc780 1 > prepared part key=_multipart_2BT2AXKB1RTA.2~6WRD41ELQ5VX.0 size=862794 2024-06-04T15:59:26.863 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.863+0000 7f5e9aacc780 1 > prepared multipart upload key=2BT2AXKB1RTA upload=6WRD41ELQ5VX tag=J05LOIVUPS3B type=write size=1911370 2024-06-04T15:59:26.865 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.863+0000 7f5e9aacc780 1 < canceled part key=_multipart_9MPRI6LW3956.2~B0NRCKHGN3GG.0 size=862805 2024-06-04T15:59:26.866 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.865+0000 7f5e9aacc780 1 < canceled multipart upload key=9MPRI6LW3956 upload=B0NRCKHGN3GG tag=TZ3A44IJ23GT type=write size=1911381 2024-06-04T15:59:26.867 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.867+0000 7f5e9aacc780 1 > prepared operation key=HD6SNICRCDLL tag=5GHHLXRJ3MDV type=write size=174657 2024-06-04T15:59:26.869 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.869+0000 7f5e9aacc780 1 < completed delete operation key=DY9JWHWNAUO1 tag=KOFK21B7M1MS type=del 2024-06-04T15:59:26.870 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.870+0000 7f5e9aacc780 1 > prepared operation key=1IKNQXU3Y2JJ tag=13VZG5SQI6V8 type=write size=229504 2024-06-04T15:59:26.872 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.871+0000 7f5e9aacc780 1 < completed delete operation key=UTZHANL9ER2Q tag=P512HOEU88ZU type=del 2024-06-04T15:59:26.873 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.873+0000 7f5e9aacc780 1 > prepared operation key=4W5HB9WQQHR6 tag=U3MRLQ0L86OH type=del size=288584 2024-06-04T15:59:26.875 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.874+0000 7f5e9aacc780 1 < completed part key=_multipart_DY9JWHWNAUO1.2~2WDQSLYLEQ7V.0 size=1048576 2024-06-04T15:59:26.875 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.874+0000 7f5e9aacc780 1 < canceled part key=_multipart_DY9JWHWNAUO1.2~2WDQSLYLEQ7V.1 size=1048576 2024-06-04T15:59:26.877 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.877+0000 7f5e9aacc780 1 < completed part key=_multipart_DY9JWHWNAUO1.2~2WDQSLYLEQ7V.2 size=393556 2024-06-04T15:59:26.881 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.881+0000 7f5e9aacc780 1 < canceled multipart upload key=DY9JWHWNAUO1 upload=2WDQSLYLEQ7V tag=RNKX4H43TBRG type=write size=3539284 2024-06-04T15:59:26.883 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.883+0000 7f5e9aacc780 1 > prepared operation key=RP8K6QJUZAH1 tag=GUP0D9DN6A29 type=del size=3947087 2024-06-04T15:59:26.884 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.884+0000 7f5e9aacc780 1 < completed part key=_multipart_UW5LVIBG09SV.2~2SERUUR8UW9W.0 size=1048576 2024-06-04T15:59:26.886 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.885+0000 7f5e9aacc780 1 < completed part key=_multipart_UW5LVIBG09SV.2~2SERUUR8UW9W.1 size=1048576 2024-06-04T15:59:26.886 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.886+0000 7f5e9aacc780 1 < completed part key=_multipart_UW5LVIBG09SV.2~2SERUUR8UW9W.2 size=774717 2024-06-04T15:59:26.889 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.889+0000 7f5e9aacc780 1 < completed multipart upload key=UW5LVIBG09SV upload=2SERUUR8UW9W tag=UIXLL1OKDF5C type=write size=3920445 2024-06-04T15:59:26.890 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.890+0000 7f5e9aacc780 1 > prepared operation key=W1T4O3EAE7JN tag=JH4CG1BPA13Z type=del size=2947601 2024-06-04T15:59:26.893 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.893+0000 7f5e9aacc780 1 < suggested remove operation key=03ZNYG3WLMP4 tag=M8XDTOREYIZE type=del 2024-06-04T15:59:26.894 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.894+0000 7f5e9aacc780 1 > prepared operation key=HD6SNICRCDLL tag=IGYWTSWA7GYB type=write size=530052 2024-06-04T15:59:26.896 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.896+0000 7f5e9aacc780 1 < completed delete operation key=SUBHZJ7HUV3H tag=K86BB9CIB4X9 type=del 2024-06-04T15:59:26.899 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.898+0000 7f5e9aacc780 1 > prepared part key=_multipart_W1T4O3EAE7JN.2~XA1BDR8W8VFC.0 size=1048576 2024-06-04T15:59:26.900 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.899+0000 7f5e9aacc780 1 > prepared part key=_multipart_W1T4O3EAE7JN.2~XA1BDR8W8VFC.1 size=925407 2024-06-04T15:59:26.900 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.899+0000 7f5e9aacc780 1 > prepared multipart upload key=W1T4O3EAE7JN upload=XA1BDR8W8VFC tag=RQ8IC0667YL0 type=write size=3022559 2024-06-04T15:59:26.901 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.901+0000 7f5e9aacc780 1 < canceled operation key=2BT2AXKB1RTA tag=1815BQUWM04J type=del size=2092417 2024-06-04T15:59:26.904 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.904+0000 7f5e9aacc780 1 > prepared part key=_multipart_JL69PUHT6NNT.2~UJ6CMLBB14HN.0 size=1048576 2024-06-04T15:59:26.905 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.905+0000 7f5e9aacc780 1 > prepared part key=_multipart_JL69PUHT6NNT.2~UJ6CMLBB14HN.1 size=1048576 2024-06-04T15:59:26.906 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.906+0000 7f5e9aacc780 1 > prepared part key=_multipart_JL69PUHT6NNT.2~UJ6CMLBB14HN.2 size=341264 2024-06-04T15:59:26.906 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.906+0000 7f5e9aacc780 1 > prepared multipart upload key=JL69PUHT6NNT upload=UJ6CMLBB14HN tag=9ZZUWCFN52JJ type=write size=3486992 2024-06-04T15:59:26.908 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.907+0000 7f5e9aacc780 1 < completed part key=_multipart_TUGKW7F4V9NO.2~740XC92R0CK7.0 size=1048576 2024-06-04T15:59:26.909 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.909+0000 7f5e9aacc780 1 < completed part key=_multipart_TUGKW7F4V9NO.2~740XC92R0CK7.1 size=176662 2024-06-04T15:59:26.911 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.911+0000 7f5e9aacc780 1 < completed multipart upload key=TUGKW7F4V9NO upload=740XC92R0CK7 tag=YTR5IWC5PFV7 type=write size=2273814 2024-06-04T15:59:26.914 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.914+0000 7f5e9aacc780 1 > prepared part key=_multipart_NJ5U8JTT32QK.2~1JBKS29FN7TT.0 size=1048576 2024-06-04T15:59:26.915 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.915+0000 7f5e9aacc780 1 > prepared part key=_multipart_NJ5U8JTT32QK.2~1JBKS29FN7TT.1 size=485945 2024-06-04T15:59:26.915 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.915+0000 7f5e9aacc780 1 > prepared multipart upload key=NJ5U8JTT32QK upload=1JBKS29FN7TT tag=8AEN3P9RUH32 type=write size=2583097 2024-06-04T15:59:26.917 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.917+0000 7f5e9aacc780 1 < completed delete operation key=HD6SNICRCDLL tag=DOEZAORJOO1R type=del 2024-06-04T15:59:26.920 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.920+0000 7f5e9aacc780 1 > prepared part key=_multipart_XH0N984YVGKP.2~UWNTV2QIUJME.0 size=1048576 2024-06-04T15:59:26.921 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.921+0000 7f5e9aacc780 1 > prepared part key=_multipart_XH0N984YVGKP.2~UWNTV2QIUJME.1 size=205772 2024-06-04T15:59:26.921 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.921+0000 7f5e9aacc780 1 > prepared multipart upload key=XH0N984YVGKP upload=UWNTV2QIUJME tag=7HYQAJG5NS7J type=write size=2302924 2024-06-04T15:59:26.923 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.922+0000 7f5e9aacc780 1 < canceled operation key=4W5HB9WQQHR6 tag=VIPEHATPXY59 type=del size=3686010 2024-06-04T15:59:26.924 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.924+0000 7f5e9aacc780 1 > prepared operation key=2BT2AXKB1RTA tag=OXXO0TAOWEXM type=del size=3354606 2024-06-04T15:59:26.926 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.925+0000 7f5e9aacc780 1 < completed write operation key=1IKNQXU3Y2JJ tag=WZZ3O3THN59F type=write size=663103 2024-06-04T15:59:26.928 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.928+0000 7f5e9aacc780 1 > prepared part key=_multipart_B0HK5FJ2RGJE.2~FRS6EDWZ7UZP.0 size=201484 2024-06-04T15:59:26.928 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.928+0000 7f5e9aacc780 1 > prepared multipart upload key=B0HK5FJ2RGJE upload=FRS6EDWZ7UZP tag=6WCTAEC7HPY2 type=write size=1250060 2024-06-04T15:59:26.930 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.929+0000 7f5e9aacc780 1 < completed delete operation key=QUIVPH3OB6KN tag=32PECTXSICGI type=del 2024-06-04T15:59:26.931 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.931+0000 7f5e9aacc780 1 > prepared operation key=GTRMEQJK675Z tag=G8I2XDQA34E2 type=del size=1206699 2024-06-04T15:59:26.933 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.932+0000 7f5e9aacc780 1 < completed delete operation key=NJ5U8JTT32QK tag=4OZP9DC2WLMD type=del 2024-06-04T15:59:26.935 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.935+0000 7f5e9aacc780 1 > prepared part key=_multipart_Q4OFQI0F5YLG.2~9PQ6YCPS214U.0 size=1048576 2024-06-04T15:59:26.936 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.936+0000 7f5e9aacc780 1 > prepared part key=_multipart_Q4OFQI0F5YLG.2~9PQ6YCPS214U.1 size=351571 2024-06-04T15:59:26.936 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.936+0000 7f5e9aacc780 1 > prepared multipart upload key=Q4OFQI0F5YLG upload=9PQ6YCPS214U tag=PS0ZJ4J0DYT5 type=write size=2448723 2024-06-04T15:59:26.939 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.939+0000 7f5e9aacc780 1 < suggested update operation key=PASGIP872OVX tag=61GSRS5JMWO7 type=del size=3164383 2024-06-04T15:59:26.942 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.942+0000 7f5e9aacc780 1 > prepared part key=_multipart_TUGKW7F4V9NO.2~VUX87UOXPVQN.0 size=678925 2024-06-04T15:59:26.942 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.942+0000 7f5e9aacc780 1 > prepared multipart upload key=TUGKW7F4V9NO upload=VUX87UOXPVQN tag=99GTKGKFDFF8 type=write size=1727501 2024-06-04T15:59:26.943 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.943+0000 7f5e9aacc780 1 < completed part key=_multipart_2BT2AXKB1RTA.2~6WRD41ELQ5VX.0 size=862794 2024-06-04T15:59:26.946 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.945+0000 7f5e9aacc780 1 < completed multipart upload key=2BT2AXKB1RTA upload=6WRD41ELQ5VX tag=J05LOIVUPS3B type=write size=1911370 2024-06-04T15:59:26.948 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.948+0000 7f5e9aacc780 1 > prepared part key=_multipart_PNDPO2WUW7UX.2~JHKBM4HJS0K3.0 size=1048576 2024-06-04T15:59:26.949 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.949+0000 7f5e9aacc780 1 > prepared part key=_multipart_PNDPO2WUW7UX.2~JHKBM4HJS0K3.1 size=948608 2024-06-04T15:59:26.949 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.949+0000 7f5e9aacc780 1 > prepared multipart upload key=PNDPO2WUW7UX upload=JHKBM4HJS0K3 tag=7JUC1U1VHD0L type=write size=3045760 2024-06-04T15:59:26.951 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.951+0000 7f5e9aacc780 1 < completed write operation key=HD6SNICRCDLL tag=5GHHLXRJ3MDV type=write size=174657 2024-06-04T15:59:26.952 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.952+0000 7f5e9aacc780 1 > prepared operation key=RP8K6QJUZAH1 tag=E6GPDBG34XOW type=del size=1053168 2024-06-04T15:59:26.954 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.953+0000 7f5e9aacc780 1 < completed write operation key=1IKNQXU3Y2JJ tag=13VZG5SQI6V8 type=write size=229504 2024-06-04T15:59:26.955 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.955+0000 7f5e9aacc780 1 > prepared operation key=QUIVPH3OB6KN tag=0L0X00RY6WRF type=del size=3174600 2024-06-04T15:59:26.957 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.956+0000 7f5e9aacc780 1 < canceled operation key=4W5HB9WQQHR6 tag=U3MRLQ0L86OH type=del size=288584 2024-06-04T15:59:26.958 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.958+0000 7f5e9aacc780 1 > prepared operation key=K01DAK0M4I4M tag=OUPCD1X298KW type=write size=43121 2024-06-04T15:59:26.959 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.959+0000 7f5e9aacc780 1 < completed delete operation key=RP8K6QJUZAH1 tag=GUP0D9DN6A29 type=del 2024-06-04T15:59:26.962 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.962+0000 7f5e9aacc780 1 > prepared part key=_multipart_GTRMEQJK675Z.2~5EQ9S25SDWYU.0 size=1048576 2024-06-04T15:59:26.963 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.963+0000 7f5e9aacc780 1 > prepared part key=_multipart_GTRMEQJK675Z.2~5EQ9S25SDWYU.1 size=1048576 2024-06-04T15:59:26.964 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.964+0000 7f5e9aacc780 1 > prepared part key=_multipart_GTRMEQJK675Z.2~5EQ9S25SDWYU.2 size=490061 2024-06-04T15:59:26.964 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.964+0000 7f5e9aacc780 1 > prepared multipart upload key=GTRMEQJK675Z upload=5EQ9S25SDWYU tag=FBFUV5Y0N0EV type=write size=3635789 2024-06-04T15:59:26.966 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.965+0000 7f5e9aacc780 1 < completed delete operation key=W1T4O3EAE7JN tag=JH4CG1BPA13Z type=del 2024-06-04T15:59:26.968 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.968+0000 7f5e9aacc780 1 > prepared part key=_multipart_GTRMEQJK675Z.2~WDSK7CN0TGFD.0 size=393767 2024-06-04T15:59:26.968 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.968+0000 7f5e9aacc780 1 > prepared multipart upload key=GTRMEQJK675Z upload=WDSK7CN0TGFD tag=6JJGWG3CI4XS type=write size=1442343 2024-06-04T15:59:26.970 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.969+0000 7f5e9aacc780 1 < completed write operation key=HD6SNICRCDLL tag=IGYWTSWA7GYB type=write size=530052 2024-06-04T15:59:26.971 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.971+0000 7f5e9aacc780 1 > prepared operation key=NHPH4LYPP0LL tag=71VHJO78MCXM type=del size=4129156 2024-06-04T15:59:26.973 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.972+0000 7f5e9aacc780 1 < completed part key=_multipart_W1T4O3EAE7JN.2~XA1BDR8W8VFC.0 size=1048576 2024-06-04T15:59:26.974 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.974+0000 7f5e9aacc780 1 < completed part key=_multipart_W1T4O3EAE7JN.2~XA1BDR8W8VFC.1 size=925407 2024-06-04T15:59:26.976 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.976+0000 7f5e9aacc780 1 < completed multipart upload key=W1T4O3EAE7JN upload=XA1BDR8W8VFC tag=RQ8IC0667YL0 type=write size=3022559 2024-06-04T15:59:26.978 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.977+0000 7f5e9aacc780 1 > prepared operation key=W1T4O3EAE7JN tag=A0JR3QL1TM2E type=write size=259915 2024-06-04T15:59:26.980 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.979+0000 7f5e9aacc780 1 < completed part key=_multipart_JL69PUHT6NNT.2~UJ6CMLBB14HN.0 size=1048576 2024-06-04T15:59:26.981 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.981+0000 7f5e9aacc780 1 < completed part key=_multipart_JL69PUHT6NNT.2~UJ6CMLBB14HN.1 size=1048576 2024-06-04T15:59:26.982 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.982+0000 7f5e9aacc780 1 < completed part key=_multipart_JL69PUHT6NNT.2~UJ6CMLBB14HN.2 size=341264 2024-06-04T15:59:26.984 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.984+0000 7f5e9aacc780 1 < completed multipart upload key=JL69PUHT6NNT upload=UJ6CMLBB14HN tag=9ZZUWCFN52JJ type=write size=3486992 2024-06-04T15:59:26.986 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.985+0000 7f5e9aacc780 1 > prepared operation key=QJA2JPATITNH tag=N2NRC3P6JX0M type=del size=3272577 2024-06-04T15:59:26.987 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.987+0000 7f5e9aacc780 1 < completed part key=_multipart_NJ5U8JTT32QK.2~1JBKS29FN7TT.0 size=1048576 2024-06-04T15:59:26.989 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.988+0000 7f5e9aacc780 1 < completed part key=_multipart_NJ5U8JTT32QK.2~1JBKS29FN7TT.1 size=485945 2024-06-04T15:59:26.991 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.991+0000 7f5e9aacc780 1 < completed multipart upload key=NJ5U8JTT32QK upload=1JBKS29FN7TT tag=8AEN3P9RUH32 type=write size=2583097 2024-06-04T15:59:26.992 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.992+0000 7f5e9aacc780 1 > prepared operation key=DY9JWHWNAUO1 tag=3M0JNTFDA3XM type=del size=233568 2024-06-04T15:59:26.994 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.994+0000 7f5e9aacc780 1 < completed part key=_multipart_XH0N984YVGKP.2~UWNTV2QIUJME.0 size=1048576 2024-06-04T15:59:26.995 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.995+0000 7f5e9aacc780 1 < completed part key=_multipart_XH0N984YVGKP.2~UWNTV2QIUJME.1 size=205772 2024-06-04T15:59:26.997 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.997+0000 7f5e9aacc780 1 < completed multipart upload key=XH0N984YVGKP upload=UWNTV2QIUJME tag=7HYQAJG5NS7J type=write size=2302924 2024-06-04T15:59:26.999 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:26.998+0000 7f5e9aacc780 1 > prepared operation key=QUIVPH3OB6KN tag=YMEBI8A80KZ3 type=write size=89599 2024-06-04T15:59:27.000 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.000+0000 7f5e9aacc780 1 < completed delete operation key=2BT2AXKB1RTA tag=OXXO0TAOWEXM type=del 2024-06-04T15:59:27.003 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.003+0000 7f5e9aacc780 1 > prepared part key=_multipart_GCPC9OJH7KWU.2~S7Q0QXQ07VP0.0 size=1048576 2024-06-04T15:59:27.004 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.004+0000 7f5e9aacc780 1 > prepared part key=_multipart_GCPC9OJH7KWU.2~S7Q0QXQ07VP0.1 size=286616 2024-06-04T15:59:27.004 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.004+0000 7f5e9aacc780 1 > prepared multipart upload key=GCPC9OJH7KWU upload=S7Q0QXQ07VP0 tag=E1HIUASFPM2J type=write size=2383768 2024-06-04T15:59:27.006 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.005+0000 7f5e9aacc780 1 < completed part key=_multipart_B0HK5FJ2RGJE.2~FRS6EDWZ7UZP.0 size=201484 2024-06-04T15:59:27.008 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.008+0000 7f5e9aacc780 1 < completed multipart upload key=B0HK5FJ2RGJE upload=FRS6EDWZ7UZP tag=6WCTAEC7HPY2 type=write size=1250060 2024-06-04T15:59:27.011 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.010+0000 7f5e9aacc780 1 > prepared part key=_multipart_UW5LVIBG09SV.2~CSLJPB60I7PW.0 size=181157 2024-06-04T15:59:27.011 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.010+0000 7f5e9aacc780 1 > prepared multipart upload key=UW5LVIBG09SV upload=CSLJPB60I7PW tag=IC8ABMWZEOQJ type=write size=1229733 2024-06-04T15:59:27.013 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.013+0000 7f5e9aacc780 1 < canceled operation key=GTRMEQJK675Z tag=G8I2XDQA34E2 type=del size=1206699 2024-06-04T15:59:27.014 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.014+0000 7f5e9aacc780 1 > prepared operation key=7S9S3MIG7WIT tag=S00ZQPKH1HDA type=write size=401224 2024-06-04T15:59:27.016 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.015+0000 7f5e9aacc780 1 < completed part key=_multipart_Q4OFQI0F5YLG.2~9PQ6YCPS214U.0 size=1048576 2024-06-04T15:59:27.017 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.017+0000 7f5e9aacc780 1 < completed part key=_multipart_Q4OFQI0F5YLG.2~9PQ6YCPS214U.1 size=351571 2024-06-04T15:59:27.019 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.019+0000 7f5e9aacc780 1 < completed multipart upload key=Q4OFQI0F5YLG upload=9PQ6YCPS214U tag=PS0ZJ4J0DYT5 type=write size=2448723 2024-06-04T15:59:27.021 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.021+0000 7f5e9aacc780 1 > prepared operation key=AOCB36Y5Q7B0 tag=LPOS9ADTHYJ0 type=del size=692645 2024-06-04T15:59:27.021 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.021+0000 7f5e9aacc780 1 < canceled part key=_multipart_TUGKW7F4V9NO.2~VUX87UOXPVQN.0 size=678925 2024-06-04T15:59:27.023 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.023+0000 7f5e9aacc780 1 < canceled multipart upload key=TUGKW7F4V9NO upload=VUX87UOXPVQN tag=99GTKGKFDFF8 type=write size=1727501 2024-06-04T15:59:27.026 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.026+0000 7f5e9aacc780 1 > prepared part key=_multipart_HD6SNICRCDLL.2~UH5T6AIIAPSO.0 size=369287 2024-06-04T15:59:27.026 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.026+0000 7f5e9aacc780 1 > prepared multipart upload key=HD6SNICRCDLL upload=UH5T6AIIAPSO tag=SH9JMWNSIOVP type=write size=1417863 2024-06-04T15:59:27.028 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.028+0000 7f5e9aacc780 1 < completed part key=_multipart_PNDPO2WUW7UX.2~JHKBM4HJS0K3.0 size=1048576 2024-06-04T15:59:27.029 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.029+0000 7f5e9aacc780 1 < completed part key=_multipart_PNDPO2WUW7UX.2~JHKBM4HJS0K3.1 size=948608 2024-06-04T15:59:27.031 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.031+0000 7f5e9aacc780 1 < completed multipart upload key=PNDPO2WUW7UX upload=JHKBM4HJS0K3 tag=7JUC1U1VHD0L type=write size=3045760 2024-06-04T15:59:27.032 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.032+0000 7f5e9aacc780 1 > prepared operation key=PASGIP872OVX tag=W35SXHRDR8XJ type=del size=1095976 2024-06-04T15:59:27.035 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.034+0000 7f5e9aacc780 1 < suggested update operation key=RP8K6QJUZAH1 tag=E6GPDBG34XOW type=del size=1053168 2024-06-04T15:59:27.037 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.037+0000 7f5e9aacc780 1 > prepared part key=_multipart_03ZNYG3WLMP4.2~S2Z0STF23PF2.0 size=1048576 2024-06-04T15:59:27.038 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.038+0000 7f5e9aacc780 1 > prepared part key=_multipart_03ZNYG3WLMP4.2~S2Z0STF23PF2.1 size=839365 2024-06-04T15:59:27.038 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.038+0000 7f5e9aacc780 1 > prepared multipart upload key=03ZNYG3WLMP4 upload=S2Z0STF23PF2 tag=0GXA677C1TUB type=write size=2936517 2024-06-04T15:59:27.039 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.039+0000 7f5e9aacc780 1 < completed delete operation key=QUIVPH3OB6KN tag=0L0X00RY6WRF type=del 2024-06-04T15:59:27.041 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.040+0000 7f5e9aacc780 1 > prepared operation key=QJA2JPATITNH tag=5VYE5CMW7YLN type=write size=393231 2024-06-04T15:59:27.042 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.042+0000 7f5e9aacc780 1 < completed write operation key=K01DAK0M4I4M tag=OUPCD1X298KW type=write size=43121 2024-06-04T15:59:27.045 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.044+0000 7f5e9aacc780 1 > prepared part key=_multipart_GTRMEQJK675Z.2~X62GEXWWQNGA.0 size=499822 2024-06-04T15:59:27.045 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.044+0000 7f5e9aacc780 1 > prepared multipart upload key=GTRMEQJK675Z upload=X62GEXWWQNGA tag=1SKIGL1G5NOC type=write size=1548398 2024-06-04T15:59:27.046 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.046+0000 7f5e9aacc780 1 < completed part key=_multipart_GTRMEQJK675Z.2~5EQ9S25SDWYU.0 size=1048576 2024-06-04T15:59:27.047 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.047+0000 7f5e9aacc780 1 < completed part key=_multipart_GTRMEQJK675Z.2~5EQ9S25SDWYU.1 size=1048576 2024-06-04T15:59:27.047 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.047+0000 7f5e9aacc780 1 < canceled part key=_multipart_GTRMEQJK675Z.2~5EQ9S25SDWYU.2 size=490061 2024-06-04T15:59:27.050 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.050+0000 7f5e9aacc780 1 < canceled multipart upload key=GTRMEQJK675Z upload=5EQ9S25SDWYU tag=FBFUV5Y0N0EV type=write size=3635789 2024-06-04T15:59:27.051 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.051+0000 7f5e9aacc780 1 > prepared operation key=4W5HB9WQQHR6 tag=VJ7RFO5FYOEU type=write size=494997 2024-06-04T15:59:27.053 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.052+0000 7f5e9aacc780 1 < completed part key=_multipart_GTRMEQJK675Z.2~WDSK7CN0TGFD.0 size=393767 2024-06-04T15:59:27.055 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.055+0000 7f5e9aacc780 1 < completed multipart upload key=GTRMEQJK675Z upload=WDSK7CN0TGFD tag=6JJGWG3CI4XS type=write size=1442343 2024-06-04T15:59:27.057 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.057+0000 7f5e9aacc780 1 > prepared part key=_multipart_UW5LVIBG09SV.2~9CGG3H1A0QLJ.0 size=1048576 2024-06-04T15:59:27.059 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.058+0000 7f5e9aacc780 1 > prepared part key=_multipart_UW5LVIBG09SV.2~9CGG3H1A0QLJ.1 size=34875 2024-06-04T15:59:27.059 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.058+0000 7f5e9aacc780 1 > prepared multipart upload key=UW5LVIBG09SV upload=9CGG3H1A0QLJ tag=FLXKRLK0TCBD type=write size=2132027 2024-06-04T15:59:27.060 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.060+0000 7f5e9aacc780 1 < completed delete operation key=NHPH4LYPP0LL tag=71VHJO78MCXM type=del 2024-06-04T15:59:27.061 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.061+0000 7f5e9aacc780 1 > prepared operation key=PCLJXQHJ4HTY tag=RD12Y7DCWCOS type=del size=1015428 2024-06-04T15:59:27.063 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.062+0000 7f5e9aacc780 1 < completed write operation key=W1T4O3EAE7JN tag=A0JR3QL1TM2E type=write size=259915 2024-06-04T15:59:27.065 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.065+0000 7f5e9aacc780 1 > prepared part key=_multipart_QJA2JPATITNH.2~QQQ13BOFA9WY.0 size=1048576 2024-06-04T15:59:27.066 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.066+0000 7f5e9aacc780 1 > prepared part key=_multipart_QJA2JPATITNH.2~QQQ13BOFA9WY.1 size=929909 2024-06-04T15:59:27.066 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.066+0000 7f5e9aacc780 1 > prepared multipart upload key=QJA2JPATITNH upload=QQQ13BOFA9WY tag=FQ0RP1MK5RG0 type=write size=3027061 2024-06-04T15:59:27.068 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.068+0000 7f5e9aacc780 1 < canceled operation key=QJA2JPATITNH tag=N2NRC3P6JX0M type=del size=3272577 2024-06-04T15:59:27.069 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.069+0000 7f5e9aacc780 1 > prepared operation key=UW5LVIBG09SV tag=1JJ48VWGW1F5 type=del size=94091 2024-06-04T15:59:27.072 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.072+0000 7f5e9aacc780 1 < suggested remove operation key=DY9JWHWNAUO1 tag=3M0JNTFDA3XM type=del 2024-06-04T15:59:27.074 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.074+0000 7f5e9aacc780 1 > prepared part key=_multipart_PNDPO2WUW7UX.2~JTT4TDELNPRH.0 size=1048576 2024-06-04T15:59:27.075 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.075+0000 7f5e9aacc780 1 > prepared part key=_multipart_PNDPO2WUW7UX.2~JTT4TDELNPRH.1 size=550135 2024-06-04T15:59:27.075 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.075+0000 7f5e9aacc780 1 > prepared multipart upload key=PNDPO2WUW7UX upload=JTT4TDELNPRH tag=9F51LNAKSVQZ type=write size=2647287 2024-06-04T15:59:27.078 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.078+0000 7f5e9aacc780 1 < suggested remove operation key=QUIVPH3OB6KN tag=YMEBI8A80KZ3 type=write 2024-06-04T15:59:27.081 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.080+0000 7f5e9aacc780 1 > prepared part key=_multipart_DY9JWHWNAUO1.2~DTTGB5Q2PGEX.0 size=1048576 2024-06-04T15:59:27.082 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.081+0000 7f5e9aacc780 1 > prepared part key=_multipart_DY9JWHWNAUO1.2~DTTGB5Q2PGEX.1 size=237853 2024-06-04T15:59:27.082 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.081+0000 7f5e9aacc780 1 > prepared multipart upload key=DY9JWHWNAUO1 upload=DTTGB5Q2PGEX tag=UOEBNNSI5EH3 type=write size=2335005 2024-06-04T15:59:27.083 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.083+0000 7f5e9aacc780 1 < completed part key=_multipart_GCPC9OJH7KWU.2~S7Q0QXQ07VP0.0 size=1048576 2024-06-04T15:59:27.085 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.084+0000 7f5e9aacc780 1 < completed part key=_multipart_GCPC9OJH7KWU.2~S7Q0QXQ07VP0.1 size=286616 2024-06-04T15:59:27.087 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.087+0000 7f5e9aacc780 1 < completed multipart upload key=GCPC9OJH7KWU upload=S7Q0QXQ07VP0 tag=E1HIUASFPM2J type=write size=2383768 2024-06-04T15:59:27.088 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.088+0000 7f5e9aacc780 1 > prepared operation key=GTRMEQJK675Z tag=J2XOWJ08G5Q9 type=del size=2554767 2024-06-04T15:59:27.089 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.089+0000 7f5e9aacc780 1 < completed part key=_multipart_UW5LVIBG09SV.2~CSLJPB60I7PW.0 size=181157 2024-06-04T15:59:27.092 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.092+0000 7f5e9aacc780 1 < completed multipart upload key=UW5LVIBG09SV upload=CSLJPB60I7PW tag=IC8ABMWZEOQJ type=write size=1229733 2024-06-04T15:59:27.093 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.093+0000 7f5e9aacc780 1 > prepared operation key=QJA2JPATITNH tag=79BQCEK9YLPU type=del size=1778503 2024-06-04T15:59:27.095 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.095+0000 7f5e9aacc780 1 < completed write operation key=7S9S3MIG7WIT tag=S00ZQPKH1HDA type=write size=401224 2024-06-04T15:59:27.098 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.097+0000 7f5e9aacc780 1 > prepared part key=_multipart_K01DAK0M4I4M.2~YNCGQLUAI9DM.0 size=197896 2024-06-04T15:59:27.098 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.097+0000 7f5e9aacc780 1 > prepared multipart upload key=K01DAK0M4I4M upload=YNCGQLUAI9DM tag=2IY1J42TRAW9 type=write size=1246472 2024-06-04T15:59:27.099 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.099+0000 7f5e9aacc780 1 < completed delete operation key=AOCB36Y5Q7B0 tag=LPOS9ADTHYJ0 type=del 2024-06-04T15:59:27.102 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.102+0000 7f5e9aacc780 1 > prepared part key=_multipart_B0HK5FJ2RGJE.2~H2FUREJP7KMZ.0 size=1048576 2024-06-04T15:59:27.103 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.103+0000 7f5e9aacc780 1 > prepared part key=_multipart_B0HK5FJ2RGJE.2~H2FUREJP7KMZ.1 size=588550 2024-06-04T15:59:27.103 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.103+0000 7f5e9aacc780 1 > prepared multipart upload key=B0HK5FJ2RGJE upload=H2FUREJP7KMZ tag=B30U22FOAGYS type=write size=2685702 2024-06-04T15:59:27.105 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.104+0000 7f5e9aacc780 1 < completed part key=_multipart_HD6SNICRCDLL.2~UH5T6AIIAPSO.0 size=369287 2024-06-04T15:59:27.107 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.107+0000 7f5e9aacc780 1 < completed multipart upload key=HD6SNICRCDLL upload=UH5T6AIIAPSO tag=SH9JMWNSIOVP type=write size=1417863 2024-06-04T15:59:27.109 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.108+0000 7f5e9aacc780 1 > prepared operation key=DY9JWHWNAUO1 tag=4LJJBDG213OO type=write size=660429 2024-06-04T15:59:27.112 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.112+0000 7f5e9aacc780 1 < suggested remove operation key=PASGIP872OVX tag=W35SXHRDR8XJ type=del 2024-06-04T15:59:27.115 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.115+0000 7f5e9aacc780 1 > prepared part key=_multipart_AOCB36Y5Q7B0.2~938YS9MJBOKA.0 size=1048576 2024-06-04T15:59:27.117 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.116+0000 7f5e9aacc780 1 > prepared part key=_multipart_AOCB36Y5Q7B0.2~938YS9MJBOKA.1 size=708071 2024-06-04T15:59:27.117 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.116+0000 7f5e9aacc780 1 > prepared multipart upload key=AOCB36Y5Q7B0 upload=938YS9MJBOKA tag=OBS7UJQ59SB9 type=write size=2805223 2024-06-04T15:59:27.118 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.118+0000 7f5e9aacc780 1 < completed part key=_multipart_03ZNYG3WLMP4.2~S2Z0STF23PF2.0 size=1048576 2024-06-04T15:59:27.119 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.119+0000 7f5e9aacc780 1 < completed part key=_multipart_03ZNYG3WLMP4.2~S2Z0STF23PF2.1 size=839365 2024-06-04T15:59:27.122 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.122+0000 7f5e9aacc780 1 < completed multipart upload key=03ZNYG3WLMP4 upload=S2Z0STF23PF2 tag=0GXA677C1TUB type=write size=2936517 2024-06-04T15:59:27.124 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.124+0000 7f5e9aacc780 1 > prepared operation key=2BT2AXKB1RTA tag=3VJXZDIQ84PN type=del size=2523731 2024-06-04T15:59:27.126 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.125+0000 7f5e9aacc780 1 < canceled operation key=QJA2JPATITNH tag=5VYE5CMW7YLN type=write size=393231 2024-06-04T15:59:27.127 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.127+0000 7f5e9aacc780 1 > prepared operation key=HD6SNICRCDLL tag=YZH8QJZ7A6HN type=write size=547520 2024-06-04T15:59:27.129 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.128+0000 7f5e9aacc780 1 < completed part key=_multipart_GTRMEQJK675Z.2~X62GEXWWQNGA.0 size=499822 2024-06-04T15:59:27.131 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.131+0000 7f5e9aacc780 1 < completed multipart upload key=GTRMEQJK675Z upload=X62GEXWWQNGA tag=1SKIGL1G5NOC type=write size=1548398 2024-06-04T15:59:27.133 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.133+0000 7f5e9aacc780 1 > prepared operation key=PNDPO2WUW7UX tag=6HUOIWDYHXOC type=del size=3667982 2024-06-04T15:59:27.136 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.136+0000 7f5e9aacc780 1 < suggested remove operation key=4W5HB9WQQHR6 tag=VJ7RFO5FYOEU type=write 2024-06-04T15:59:27.137 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.137+0000 7f5e9aacc780 1 > prepared operation key=NHPH4LYPP0LL tag=76CQNTEAX2AG type=del size=924715 2024-06-04T15:59:27.139 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.138+0000 7f5e9aacc780 1 < completed part key=_multipart_UW5LVIBG09SV.2~9CGG3H1A0QLJ.0 size=1048576 2024-06-04T15:59:27.140 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.140+0000 7f5e9aacc780 1 < completed part key=_multipart_UW5LVIBG09SV.2~9CGG3H1A0QLJ.1 size=34875 2024-06-04T15:59:27.142 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.142+0000 7f5e9aacc780 1 < completed multipart upload key=UW5LVIBG09SV upload=9CGG3H1A0QLJ tag=FLXKRLK0TCBD type=write size=2132027 2024-06-04T15:59:27.145 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.145+0000 7f5e9aacc780 1 > prepared part key=_multipart_9MPRI6LW3956.2~IUJJB8C383A2.0 size=1048576 2024-06-04T15:59:27.147 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.147+0000 7f5e9aacc780 1 > prepared part key=_multipart_9MPRI6LW3956.2~IUJJB8C383A2.1 size=952769 2024-06-04T15:59:27.147 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.147+0000 7f5e9aacc780 1 > prepared multipart upload key=9MPRI6LW3956 upload=IUJJB8C383A2 tag=7QXGSIU85YKY type=write size=3049921 2024-06-04T15:59:27.148 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.148+0000 7f5e9aacc780 1 < completed delete operation key=PCLJXQHJ4HTY tag=RD12Y7DCWCOS type=del 2024-06-04T15:59:27.150 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.149+0000 7f5e9aacc780 1 > prepared operation key=03ZNYG3WLMP4 tag=9P63VF9JGRQZ type=write size=109741 2024-06-04T15:59:27.151 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.151+0000 7f5e9aacc780 1 < completed part key=_multipart_QJA2JPATITNH.2~QQQ13BOFA9WY.0 size=1048576 2024-06-04T15:59:27.153 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.153+0000 7f5e9aacc780 1 < completed part key=_multipart_QJA2JPATITNH.2~QQQ13BOFA9WY.1 size=929909 2024-06-04T15:59:27.155 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.155+0000 7f5e9aacc780 1 < completed multipart upload key=QJA2JPATITNH upload=QQQ13BOFA9WY tag=FQ0RP1MK5RG0 type=write size=3027061 2024-06-04T15:59:27.157 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.156+0000 7f5e9aacc780 1 > prepared operation key=A8O0S3S45RGM tag=FV5RXNQIWB21 type=del size=183201 2024-06-04T15:59:27.158 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.158+0000 7f5e9aacc780 1 < completed delete operation key=UW5LVIBG09SV tag=1JJ48VWGW1F5 type=del 2024-06-04T15:59:27.159 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.159+0000 7f5e9aacc780 1 > prepared operation key=QJA2JPATITNH tag=QM0UVN6LYBHO type=write size=270372 2024-06-04T15:59:27.161 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.161+0000 7f5e9aacc780 1 < completed part key=_multipart_PNDPO2WUW7UX.2~JTT4TDELNPRH.0 size=1048576 2024-06-04T15:59:27.162 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.162+0000 7f5e9aacc780 1 < completed part key=_multipart_PNDPO2WUW7UX.2~JTT4TDELNPRH.1 size=550135 2024-06-04T15:59:27.164 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.164+0000 7f5e9aacc780 1 < completed multipart upload key=PNDPO2WUW7UX upload=JTT4TDELNPRH tag=9F51LNAKSVQZ type=write size=2647287 2024-06-04T15:59:27.166 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.166+0000 7f5e9aacc780 1 > prepared operation key=PASGIP872OVX tag=SY46BUTXTE5T type=write size=1046155 2024-06-04T15:59:27.167 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.167+0000 7f5e9aacc780 1 < completed part key=_multipart_DY9JWHWNAUO1.2~DTTGB5Q2PGEX.0 size=1048576 2024-06-04T15:59:27.169 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.169+0000 7f5e9aacc780 1 < completed part key=_multipart_DY9JWHWNAUO1.2~DTTGB5Q2PGEX.1 size=237853 2024-06-04T15:59:27.171 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.171+0000 7f5e9aacc780 1 < completed multipart upload key=DY9JWHWNAUO1 upload=DTTGB5Q2PGEX tag=UOEBNNSI5EH3 type=write size=2335005 2024-06-04T15:59:27.172 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.172+0000 7f5e9aacc780 1 > prepared operation key=SUBHZJ7HUV3H tag=UHO1KNTD03M8 type=del size=4071514 2024-06-04T15:59:27.175 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.175+0000 7f5e9aacc780 1 < suggested update operation key=GTRMEQJK675Z tag=J2XOWJ08G5Q9 type=del size=2554767 2024-06-04T15:59:27.178 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.177+0000 7f5e9aacc780 1 > prepared part key=_multipart_FBV2MAG130M6.2~S64Y81WXQKIM.0 size=1048576 2024-06-04T15:59:27.178 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.178+0000 7f5e9aacc780 1 > prepared part key=_multipart_FBV2MAG130M6.2~S64Y81WXQKIM.1 size=1048576 2024-06-04T15:59:27.180 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.179+0000 7f5e9aacc780 1 > prepared part key=_multipart_FBV2MAG130M6.2~S64Y81WXQKIM.2 size=626733 2024-06-04T15:59:27.180 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.179+0000 7f5e9aacc780 1 > prepared multipart upload key=FBV2MAG130M6 upload=S64Y81WXQKIM tag=G40ER85DTNED type=write size=3772461 2024-06-04T15:59:27.183 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.182+0000 7f5e9aacc780 1 < suggested update operation key=QJA2JPATITNH tag=79BQCEK9YLPU type=del size=1778503 2024-06-04T15:59:27.186 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.186+0000 7f5e9aacc780 1 > prepared part key=_multipart_A8O0S3S45RGM.2~BG74DV1OBG3Y.0 size=1048576 2024-06-04T15:59:27.187 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.187+0000 7f5e9aacc780 1 > prepared part key=_multipart_A8O0S3S45RGM.2~BG74DV1OBG3Y.1 size=1048576 2024-06-04T15:59:27.188 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.188+0000 7f5e9aacc780 1 > prepared part key=_multipart_A8O0S3S45RGM.2~BG74DV1OBG3Y.2 size=42954 2024-06-04T15:59:27.188 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.188+0000 7f5e9aacc780 1 > prepared multipart upload key=A8O0S3S45RGM upload=BG74DV1OBG3Y tag=QX7M2IEBWBCD type=write size=3188682 2024-06-04T15:59:27.189 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.189+0000 7f5e9aacc780 1 < completed part key=_multipart_K01DAK0M4I4M.2~YNCGQLUAI9DM.0 size=197896 2024-06-04T15:59:27.191 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.191+0000 7f5e9aacc780 1 < completed multipart upload key=K01DAK0M4I4M upload=YNCGQLUAI9DM tag=2IY1J42TRAW9 type=write size=1246472 2024-06-04T15:59:27.193 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.193+0000 7f5e9aacc780 1 > prepared operation key=NJ5U8JTT32QK tag=QVHUXCWUVROE type=del size=2899369 2024-06-04T15:59:27.194 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.194+0000 7f5e9aacc780 1 < completed part key=_multipart_B0HK5FJ2RGJE.2~H2FUREJP7KMZ.0 size=1048576 2024-06-04T15:59:27.194 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.194+0000 7f5e9aacc780 1 < canceled part key=_multipart_B0HK5FJ2RGJE.2~H2FUREJP7KMZ.1 size=588550 2024-06-04T15:59:27.196 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.196+0000 7f5e9aacc780 1 < canceled multipart upload key=B0HK5FJ2RGJE upload=H2FUREJP7KMZ tag=B30U22FOAGYS type=write size=2685702 2024-06-04T15:59:27.198 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.197+0000 7f5e9aacc780 1 > prepared operation key=QUIVPH3OB6KN tag=AO0TV4PRIK7L type=del size=2820483 2024-06-04T15:59:27.199 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.199+0000 7f5e9aacc780 1 < completed write operation key=DY9JWHWNAUO1 tag=4LJJBDG213OO type=write size=660429 2024-06-04T15:59:27.201 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.201+0000 7f5e9aacc780 1 > prepared part key=_multipart_Q4OFQI0F5YLG.2~MWMEZWNNYESS.0 size=1048576 2024-06-04T15:59:27.202 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.202+0000 7f5e9aacc780 1 > prepared part key=_multipart_Q4OFQI0F5YLG.2~MWMEZWNNYESS.1 size=1048576 2024-06-04T15:59:27.203 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.203+0000 7f5e9aacc780 1 > prepared part key=_multipart_Q4OFQI0F5YLG.2~MWMEZWNNYESS.2 size=174616 2024-06-04T15:59:27.203 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.203+0000 7f5e9aacc780 1 > prepared multipart upload key=Q4OFQI0F5YLG upload=MWMEZWNNYESS tag=N4HPORZ8EL21 type=write size=3320344 2024-06-04T15:59:27.205 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.204+0000 7f5e9aacc780 1 < completed part key=_multipart_AOCB36Y5Q7B0.2~938YS9MJBOKA.0 size=1048576 2024-06-04T15:59:27.206 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.205+0000 7f5e9aacc780 1 < completed part key=_multipart_AOCB36Y5Q7B0.2~938YS9MJBOKA.1 size=708071 2024-06-04T15:59:27.208 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.208+0000 7f5e9aacc780 1 < completed multipart upload key=AOCB36Y5Q7B0 upload=938YS9MJBOKA tag=OBS7UJQ59SB9 type=write size=2805223 2024-06-04T15:59:27.209 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.209+0000 7f5e9aacc780 1 > prepared operation key=DY9JWHWNAUO1 tag=975F5L5PFQ4S type=del size=3234065 2024-06-04T15:59:27.210 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.210+0000 7f5e9aacc780 1 < completed delete operation key=2BT2AXKB1RTA tag=3VJXZDIQ84PN type=del 2024-06-04T15:59:27.212 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.212+0000 7f5e9aacc780 1 > prepared operation key=NJ5U8JTT32QK tag=2LO66EUP1KWQ type=write size=298168 2024-06-04T15:59:27.214 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.213+0000 7f5e9aacc780 1 < completed write operation key=HD6SNICRCDLL tag=YZH8QJZ7A6HN type=write size=547520 2024-06-04T15:59:27.215 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.215+0000 7f5e9aacc780 1 > prepared operation key=NJ5U8JTT32QK tag=9HZPL27J1O34 type=write size=29297 2024-06-04T15:59:27.218 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.217+0000 7f5e9aacc780 1 < suggested update operation key=PNDPO2WUW7UX tag=6HUOIWDYHXOC type=del size=3667982 2024-06-04T15:59:27.220 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.220+0000 7f5e9aacc780 1 > prepared part key=_multipart_UTZHANL9ER2Q.2~2UW80ES2PQ32.0 size=1048576 2024-06-04T15:59:27.221 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.221+0000 7f5e9aacc780 1 > prepared part key=_multipart_UTZHANL9ER2Q.2~2UW80ES2PQ32.1 size=192063 2024-06-04T15:59:27.221 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.221+0000 7f5e9aacc780 1 > prepared multipart upload key=UTZHANL9ER2Q upload=2UW80ES2PQ32 tag=9YZDR6H1F2MO type=write size=2289215 2024-06-04T15:59:27.224 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.224+0000 7f5e9aacc780 1 < suggested update operation key=NHPH4LYPP0LL tag=76CQNTEAX2AG type=del size=924715 2024-06-04T15:59:27.225 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.225+0000 7f5e9aacc780 1 > prepared operation key=JL69PUHT6NNT tag=3I3I0CC5IS7S type=del size=1316730 2024-06-04T15:59:27.227 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.227+0000 7f5e9aacc780 1 < completed part key=_multipart_9MPRI6LW3956.2~IUJJB8C383A2.0 size=1048576 2024-06-04T15:59:27.228 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.228+0000 7f5e9aacc780 1 < completed part key=_multipart_9MPRI6LW3956.2~IUJJB8C383A2.1 size=952769 2024-06-04T15:59:27.231 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.231+0000 7f5e9aacc780 1 < completed multipart upload key=9MPRI6LW3956 upload=IUJJB8C383A2 tag=7QXGSIU85YKY type=write size=3049921 2024-06-04T15:59:27.233 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.232+0000 7f5e9aacc780 1 > prepared operation key=W1T4O3EAE7JN tag=8R5R32NNYX5P type=del size=1155649 2024-06-04T15:59:27.234 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.234+0000 7f5e9aacc780 1 < completed write operation key=03ZNYG3WLMP4 tag=9P63VF9JGRQZ type=write size=109741 2024-06-04T15:59:27.236 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.235+0000 7f5e9aacc780 1 > prepared operation key=NJ5U8JTT32QK tag=9BAVLI90BMWM type=del size=153424 2024-06-04T15:59:27.238 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.238+0000 7f5e9aacc780 1 < completed delete operation key=A8O0S3S45RGM tag=FV5RXNQIWB21 type=del 2024-06-04T15:59:27.241 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.240+0000 7f5e9aacc780 1 > prepared part key=_multipart_Q2V1ICTBSCV1.2~YDPSOHTMQWZ9.0 size=1048576 2024-06-04T15:59:27.242 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.242+0000 7f5e9aacc780 1 > prepared part key=_multipart_Q2V1ICTBSCV1.2~YDPSOHTMQWZ9.1 size=1048576 2024-06-04T15:59:27.243 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.243+0000 7f5e9aacc780 1 > prepared part key=_multipart_Q2V1ICTBSCV1.2~YDPSOHTMQWZ9.2 size=180593 2024-06-04T15:59:27.243 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.243+0000 7f5e9aacc780 1 > prepared multipart upload key=Q2V1ICTBSCV1 upload=YDPSOHTMQWZ9 tag=T1MB38F77UQ4 type=write size=3326321 2024-06-04T15:59:27.245 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.244+0000 7f5e9aacc780 -1 < failed to complete operation key=QJA2JPATITNH tag=QM0UVN6LYBHO type=write size=270372: (22) Invalid argument 2024-06-04T15:59:27.246 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.246+0000 7f5e9aacc780 1 > prepared operation key=UTZHANL9ER2Q tag=3QAX40J2R8V0 type=del size=3124783 2024-06-04T15:59:27.248 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.247+0000 7f5e9aacc780 1 < completed write operation key=PASGIP872OVX tag=SY46BUTXTE5T type=write size=1046155 2024-06-04T15:59:27.249 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.249+0000 7f5e9aacc780 1 > prepared operation key=GCPC9OJH7KWU tag=PSKGL9ADX9GV type=write size=889520 2024-06-04T15:59:27.250 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.250+0000 7f5e9aacc780 1 < completed delete operation key=SUBHZJ7HUV3H tag=UHO1KNTD03M8 type=del 2024-06-04T15:59:27.253 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.253+0000 7f5e9aacc780 1 > prepared part key=_multipart_JL69PUHT6NNT.2~R1CYZ10X1RLK.0 size=1048576 2024-06-04T15:59:27.255 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.255+0000 7f5e9aacc780 1 > prepared part key=_multipart_JL69PUHT6NNT.2~R1CYZ10X1RLK.1 size=944390 2024-06-04T15:59:27.255 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.255+0000 7f5e9aacc780 1 > prepared multipart upload key=JL69PUHT6NNT upload=R1CYZ10X1RLK tag=UNTBYH4EQOHF type=write size=3041542 2024-06-04T15:59:27.256 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.256+0000 7f5e9aacc780 1 < completed part key=_multipart_FBV2MAG130M6.2~S64Y81WXQKIM.0 size=1048576 2024-06-04T15:59:27.257 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.257+0000 7f5e9aacc780 1 < completed part key=_multipart_FBV2MAG130M6.2~S64Y81WXQKIM.1 size=1048576 2024-06-04T15:59:27.259 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.258+0000 7f5e9aacc780 1 < completed part key=_multipart_FBV2MAG130M6.2~S64Y81WXQKIM.2 size=626733 2024-06-04T15:59:27.261 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.261+0000 7f5e9aacc780 1 < completed multipart upload key=FBV2MAG130M6 upload=S64Y81WXQKIM tag=G40ER85DTNED type=write size=3772461 2024-06-04T15:59:27.266 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.262+0000 7f5e9aacc780 1 > prepared operation key=7S9S3MIG7WIT tag=42EGHSML6MVW type=write size=628010 2024-06-04T15:59:27.267 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.263+0000 7f5e9aacc780 1 < completed part key=_multipart_A8O0S3S45RGM.2~BG74DV1OBG3Y.0 size=1048576 2024-06-04T15:59:27.267 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.263+0000 7f5e9aacc780 1 < canceled part key=_multipart_A8O0S3S45RGM.2~BG74DV1OBG3Y.1 size=1048576 2024-06-04T15:59:27.267 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.263+0000 7f5e9aacc780 1 < canceled part key=_multipart_A8O0S3S45RGM.2~BG74DV1OBG3Y.2 size=42954 2024-06-04T15:59:27.267 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.266+0000 7f5e9aacc780 1 < canceled multipart upload key=A8O0S3S45RGM upload=BG74DV1OBG3Y tag=QX7M2IEBWBCD type=write size=3188682 2024-06-04T15:59:27.269 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.269+0000 7f5e9aacc780 1 > prepared part key=_multipart_03ZNYG3WLMP4.2~2CRMHV0BCF66.0 size=1048576 2024-06-04T15:59:27.270 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.270+0000 7f5e9aacc780 1 > prepared part key=_multipart_03ZNYG3WLMP4.2~2CRMHV0BCF66.1 size=1046261 2024-06-04T15:59:27.270 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.270+0000 7f5e9aacc780 1 > prepared multipart upload key=03ZNYG3WLMP4 upload=2CRMHV0BCF66 tag=IDNECOJ65PI9 type=write size=3143413 2024-06-04T15:59:27.271 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.271+0000 7f5e9aacc780 1 < completed delete operation key=NJ5U8JTT32QK tag=QVHUXCWUVROE type=del 2024-06-04T15:59:27.273 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.272+0000 7f5e9aacc780 1 > prepared operation key=K01DAK0M4I4M tag=VZ63SV3ZO6U4 type=del size=3862485 2024-06-04T15:59:27.275 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.275+0000 7f5e9aacc780 1 < suggested update operation key=QUIVPH3OB6KN tag=AO0TV4PRIK7L type=del size=2820483 2024-06-04T15:59:27.278 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.278+0000 7f5e9aacc780 1 > prepared part key=_multipart_4W5HB9WQQHR6.2~7E9GUN7NS0QZ.0 size=1048576 2024-06-04T15:59:27.280 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.280+0000 7f5e9aacc780 1 > prepared part key=_multipart_4W5HB9WQQHR6.2~7E9GUN7NS0QZ.1 size=18599 2024-06-04T15:59:27.280 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.280+0000 7f5e9aacc780 1 > prepared multipart upload key=4W5HB9WQQHR6 upload=7E9GUN7NS0QZ tag=1X3D1OC73NNW type=write size=2115751 2024-06-04T15:59:27.282 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.281+0000 7f5e9aacc780 1 < completed part key=_multipart_Q4OFQI0F5YLG.2~MWMEZWNNYESS.0 size=1048576 2024-06-04T15:59:27.284 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.284+0000 7f5e9aacc780 1 < completed part key=_multipart_Q4OFQI0F5YLG.2~MWMEZWNNYESS.1 size=1048576 2024-06-04T15:59:27.286 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.285+0000 7f5e9aacc780 1 < completed part key=_multipart_Q4OFQI0F5YLG.2~MWMEZWNNYESS.2 size=174616 2024-06-04T15:59:27.288 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.288+0000 7f5e9aacc780 1 < completed multipart upload key=Q4OFQI0F5YLG upload=MWMEZWNNYESS tag=N4HPORZ8EL21 type=write size=3320344 2024-06-04T15:59:27.289 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.289+0000 7f5e9aacc780 1 > prepared operation key=7S9S3MIG7WIT tag=F3QQ0VFAV1XK type=del size=1868397 2024-06-04T15:59:27.293 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.292+0000 7f5e9aacc780 1 < suggested remove operation key=DY9JWHWNAUO1 tag=975F5L5PFQ4S type=del 2024-06-04T15:59:27.294 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.294+0000 7f5e9aacc780 1 > prepared operation key=9MPRI6LW3956 tag=QH4LN2LAGV9Z type=write size=904748 2024-06-04T15:59:27.295 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.295+0000 7f5e9aacc780 1 < completed write operation key=NJ5U8JTT32QK tag=2LO66EUP1KWQ type=write size=298168 2024-06-04T15:59:27.297 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.296+0000 7f5e9aacc780 1 > prepared operation key=TUGKW7F4V9NO tag=GXVYFH4IE9J1 type=del size=4000785 2024-06-04T15:59:27.299 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.299+0000 7f5e9aacc780 1 < suggested remove operation key=NJ5U8JTT32QK tag=9HZPL27J1O34 type=write 2024-06-04T15:59:27.301 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.301+0000 7f5e9aacc780 1 > prepared operation key=UW5LVIBG09SV tag=8TGPB8HUZ2YB type=write size=604661 2024-06-04T15:59:27.302 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.302+0000 7f5e9aacc780 1 < completed part key=_multipart_UTZHANL9ER2Q.2~2UW80ES2PQ32.0 size=1048576 2024-06-04T15:59:27.303 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.303+0000 7f5e9aacc780 1 < completed part key=_multipart_UTZHANL9ER2Q.2~2UW80ES2PQ32.1 size=192063 2024-06-04T15:59:27.306 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.306+0000 7f5e9aacc780 1 < completed multipart upload key=UTZHANL9ER2Q upload=2UW80ES2PQ32 tag=9YZDR6H1F2MO type=write size=2289215 2024-06-04T15:59:27.308 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.308+0000 7f5e9aacc780 1 > prepared part key=_multipart_HD6SNICRCDLL.2~G1FN94A5942B.0 size=1048576 2024-06-04T15:59:27.309 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.309+0000 7f5e9aacc780 1 > prepared part key=_multipart_HD6SNICRCDLL.2~G1FN94A5942B.1 size=565984 2024-06-04T15:59:27.310 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.309+0000 7f5e9aacc780 1 > prepared multipart upload key=HD6SNICRCDLL upload=G1FN94A5942B tag=E5CQP6U9SCQD type=write size=2663136 2024-06-04T15:59:27.311 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.311+0000 7f5e9aacc780 1 < completed delete operation key=JL69PUHT6NNT tag=3I3I0CC5IS7S type=del 2024-06-04T15:59:27.312 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.312+0000 7f5e9aacc780 1 > prepared operation key=Q4OFQI0F5YLG tag=EOZJJ9S57AQQ type=del size=3112838 2024-06-04T15:59:27.314 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.313+0000 7f5e9aacc780 1 < canceled operation key=W1T4O3EAE7JN tag=8R5R32NNYX5P type=del size=1155649 2024-06-04T15:59:27.316 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.316+0000 7f5e9aacc780 1 > prepared part key=_multipart_SUBHZJ7HUV3H.2~XJZHV5F084ZQ.0 size=39255 2024-06-04T15:59:27.316 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.316+0000 7f5e9aacc780 1 > prepared multipart upload key=SUBHZJ7HUV3H upload=XJZHV5F084ZQ tag=ZS8AD5JFPIWN type=write size=1087831 2024-06-04T15:59:27.317 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.317+0000 7f5e9aacc780 -1 < failed to complete operation key=NJ5U8JTT32QK tag=9BAVLI90BMWM type=del size=153424: (22) Invalid argument 2024-06-04T15:59:27.319 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.318+0000 7f5e9aacc780 1 > prepared operation key=9MPRI6LW3956 tag=AXFDXJAGOI9F type=del size=3131347 2024-06-04T15:59:27.320 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.320+0000 7f5e9aacc780 1 < completed part key=_multipart_Q2V1ICTBSCV1.2~YDPSOHTMQWZ9.0 size=1048576 2024-06-04T15:59:27.321 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.321+0000 7f5e9aacc780 1 < completed part key=_multipart_Q2V1ICTBSCV1.2~YDPSOHTMQWZ9.1 size=1048576 2024-06-04T15:59:27.323 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.322+0000 7f5e9aacc780 1 < completed part key=_multipart_Q2V1ICTBSCV1.2~YDPSOHTMQWZ9.2 size=180593 2024-06-04T15:59:27.325 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.325+0000 7f5e9aacc780 1 < completed multipart upload key=Q2V1ICTBSCV1 upload=YDPSOHTMQWZ9 tag=T1MB38F77UQ4 type=write size=3326321 2024-06-04T15:59:27.327 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.327+0000 7f5e9aacc780 1 > prepared part key=_multipart_TUGKW7F4V9NO.2~X7UCVWSGHM1O.0 size=1048576 2024-06-04T15:59:27.328 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.328+0000 7f5e9aacc780 1 > prepared part key=_multipart_TUGKW7F4V9NO.2~X7UCVWSGHM1O.1 size=1048576 2024-06-04T15:59:27.329 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.329+0000 7f5e9aacc780 1 > prepared part key=_multipart_TUGKW7F4V9NO.2~X7UCVWSGHM1O.2 size=997490 2024-06-04T15:59:27.329 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.329+0000 7f5e9aacc780 1 > prepared multipart upload key=TUGKW7F4V9NO upload=X7UCVWSGHM1O tag=NHXX0UIBXU03 type=write size=4143218 2024-06-04T15:59:27.330 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.330+0000 7f5e9aacc780 1 < completed delete operation key=UTZHANL9ER2Q tag=3QAX40J2R8V0 type=del 2024-06-04T15:59:27.332 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.332+0000 7f5e9aacc780 1 > prepared operation key=4W5HB9WQQHR6 tag=I5Z917T609NJ type=del size=3368910 2024-06-04T15:59:27.335 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.334+0000 7f5e9aacc780 1 < suggested update operation key=GCPC9OJH7KWU tag=PSKGL9ADX9GV type=write size=889520 2024-06-04T15:59:27.336 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.336+0000 7f5e9aacc780 1 > prepared operation key=RP8K6QJUZAH1 tag=CD2WXABGZK8B type=del size=3259551 2024-06-04T15:59:27.337 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.337+0000 7f5e9aacc780 1 < completed part key=_multipart_JL69PUHT6NNT.2~R1CYZ10X1RLK.0 size=1048576 2024-06-04T15:59:27.338 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.339+0000 7f5e9aacc780 1 < completed part key=_multipart_JL69PUHT6NNT.2~R1CYZ10X1RLK.1 size=944390 2024-06-04T15:59:27.341 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.341+0000 7f5e9aacc780 1 < completed multipart upload key=JL69PUHT6NNT upload=R1CYZ10X1RLK tag=UNTBYH4EQOHF type=write size=3041542 2024-06-04T15:59:27.342 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.342+0000 7f5e9aacc780 1 > prepared operation key=GTRMEQJK675Z tag=WYUD6JNNB5P0 type=write size=894170 2024-06-04T15:59:27.344 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.344+0000 7f5e9aacc780 1 < canceled operation key=7S9S3MIG7WIT tag=42EGHSML6MVW type=write size=628010 2024-06-04T15:59:27.345 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.345+0000 7f5e9aacc780 1 > prepared operation key=B0HK5FJ2RGJE tag=H9PTQ6UKDV7P type=del size=518891 2024-06-04T15:59:27.347 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.346+0000 7f5e9aacc780 1 < completed part key=_multipart_03ZNYG3WLMP4.2~2CRMHV0BCF66.0 size=1048576 2024-06-04T15:59:27.348 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.348+0000 7f5e9aacc780 1 < completed part key=_multipart_03ZNYG3WLMP4.2~2CRMHV0BCF66.1 size=1046261 2024-06-04T15:59:27.350 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.350+0000 7f5e9aacc780 1 < completed multipart upload key=03ZNYG3WLMP4 upload=2CRMHV0BCF66 tag=IDNECOJ65PI9 type=write size=3143413 2024-06-04T15:59:27.353 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.352+0000 7f5e9aacc780 1 > prepared part key=_multipart_DY9JWHWNAUO1.2~QQJHX0EHMGUE.0 size=1048576 2024-06-04T15:59:27.354 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.354+0000 7f5e9aacc780 1 > prepared part key=_multipart_DY9JWHWNAUO1.2~QQJHX0EHMGUE.1 size=1048576 2024-06-04T15:59:27.355 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.355+0000 7f5e9aacc780 1 > prepared part key=_multipart_DY9JWHWNAUO1.2~QQJHX0EHMGUE.2 size=441940 2024-06-04T15:59:27.355 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.355+0000 7f5e9aacc780 1 > prepared multipart upload key=DY9JWHWNAUO1 upload=QQJHX0EHMGUE tag=MQKE7P0H2ZPH type=write size=3587668 2024-06-04T15:59:27.357 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.357+0000 7f5e9aacc780 1 < canceled operation key=K01DAK0M4I4M tag=VZ63SV3ZO6U4 type=del size=3862485 2024-06-04T15:59:27.358 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.358+0000 7f5e9aacc780 1 > prepared operation key=1IKNQXU3Y2JJ tag=2H2D5C2HBM7R type=del size=1357571 2024-06-04T15:59:27.359 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.359+0000 7f5e9aacc780 1 < completed part key=_multipart_4W5HB9WQQHR6.2~7E9GUN7NS0QZ.0 size=1048576 2024-06-04T15:59:27.361 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.361+0000 7f5e9aacc780 1 < completed part key=_multipart_4W5HB9WQQHR6.2~7E9GUN7NS0QZ.1 size=18599 2024-06-04T15:59:27.363 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.363+0000 7f5e9aacc780 1 < completed multipart upload key=4W5HB9WQQHR6 upload=7E9GUN7NS0QZ tag=1X3D1OC73NNW type=write size=2115751 2024-06-04T15:59:27.365 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.365+0000 7f5e9aacc780 1 > prepared operation key=RP8K6QJUZAH1 tag=V0WVGZFW392X type=del size=2531171 2024-06-04T15:59:27.367 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.366+0000 7f5e9aacc780 1 < completed delete operation key=7S9S3MIG7WIT tag=F3QQ0VFAV1XK type=del 2024-06-04T15:59:27.368 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.368+0000 7f5e9aacc780 1 > prepared operation key=PASGIP872OVX tag=ZSANRDRMORSI type=write size=25292 2024-06-04T15:59:27.371 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.371+0000 7f5e9aacc780 1 < suggested update operation key=9MPRI6LW3956 tag=QH4LN2LAGV9Z type=write size=904748 2024-06-04T15:59:27.372 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.372+0000 7f5e9aacc780 1 > prepared operation key=UW5LVIBG09SV tag=8721R6C2BX3F type=del size=1251689 2024-06-04T15:59:27.373 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.373+0000 7f5e9aacc780 1 < completed delete operation key=TUGKW7F4V9NO tag=GXVYFH4IE9J1 type=del 2024-06-04T15:59:27.376 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.375+0000 7f5e9aacc780 1 > prepared operation key=PASGIP872OVX tag=14NQ3RAS3QSU type=del size=2509154 2024-06-04T15:59:27.377 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.377+0000 7f5e9aacc780 1 < completed write operation key=UW5LVIBG09SV tag=8TGPB8HUZ2YB type=write size=604661 2024-06-04T15:59:27.378 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.378+0000 7f5e9aacc780 1 > prepared operation key=RP8K6QJUZAH1 tag=HB9L8BLGF9IX type=del size=3399794 2024-06-04T15:59:27.380 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.379+0000 7f5e9aacc780 1 < completed part key=_multipart_HD6SNICRCDLL.2~G1FN94A5942B.0 size=1048576 2024-06-04T15:59:27.381 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.380+0000 7f5e9aacc780 1 < completed part key=_multipart_HD6SNICRCDLL.2~G1FN94A5942B.1 size=565984 2024-06-04T15:59:27.383 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.383+0000 7f5e9aacc780 1 < completed multipart upload key=HD6SNICRCDLL upload=G1FN94A5942B tag=E5CQP6U9SCQD type=write size=2663136 2024-06-04T15:59:27.386 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.386+0000 7f5e9aacc780 1 > prepared part key=_multipart_GCPC9OJH7KWU.2~19XY0B3IS5XS.0 size=1048576 2024-06-04T15:59:27.387 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.387+0000 7f5e9aacc780 1 > prepared part key=_multipart_GCPC9OJH7KWU.2~19XY0B3IS5XS.1 size=1048576 2024-06-04T15:59:27.388 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.388+0000 7f5e9aacc780 1 > prepared part key=_multipart_GCPC9OJH7KWU.2~19XY0B3IS5XS.2 size=195678 2024-06-04T15:59:27.388 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.388+0000 7f5e9aacc780 1 > prepared multipart upload key=GCPC9OJH7KWU upload=19XY0B3IS5XS tag=BCG2YLF0NFCF type=write size=3341406 2024-06-04T15:59:27.391 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.391+0000 7f5e9aacc780 1 < suggested update operation key=Q4OFQI0F5YLG tag=EOZJJ9S57AQQ type=del size=3112838 2024-06-04T15:59:27.392 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.392+0000 7f5e9aacc780 1 > prepared operation key=JL69PUHT6NNT tag=X603ZW1WQ88E type=write size=1008031 2024-06-04T15:59:27.394 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.394+0000 7f5e9aacc780 1 < completed part key=_multipart_SUBHZJ7HUV3H.2~XJZHV5F084ZQ.0 size=39255 2024-06-04T15:59:27.396 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.396+0000 7f5e9aacc780 1 < completed multipart upload key=SUBHZJ7HUV3H upload=XJZHV5F084ZQ tag=ZS8AD5JFPIWN type=write size=1087831 2024-06-04T15:59:27.398 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.398+0000 7f5e9aacc780 1 > prepared operation key=2BT2AXKB1RTA tag=S0V9GBWJEHDU type=del size=525835 2024-06-04T15:59:27.399 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.399+0000 7f5e9aacc780 -1 < failed to complete operation key=9MPRI6LW3956 tag=AXFDXJAGOI9F type=del size=3131347: (22) Invalid argument 2024-06-04T15:59:27.401 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.400+0000 7f5e9aacc780 1 > prepared operation key=XH0N984YVGKP tag=8XPZEZ9VNAAK type=del size=133943 2024-06-04T15:59:27.402 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.402+0000 7f5e9aacc780 1 < completed part key=_multipart_TUGKW7F4V9NO.2~X7UCVWSGHM1O.0 size=1048576 2024-06-04T15:59:27.403 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.403+0000 7f5e9aacc780 1 < completed part key=_multipart_TUGKW7F4V9NO.2~X7UCVWSGHM1O.1 size=1048576 2024-06-04T15:59:27.404 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.404+0000 7f5e9aacc780 1 < completed part key=_multipart_TUGKW7F4V9NO.2~X7UCVWSGHM1O.2 size=997490 2024-06-04T15:59:27.407 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.407+0000 7f5e9aacc780 1 < completed multipart upload key=TUGKW7F4V9NO upload=X7UCVWSGHM1O tag=NHXX0UIBXU03 type=write size=4143218 2024-06-04T15:59:27.409 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.408+0000 7f5e9aacc780 1 > prepared operation key=HD6SNICRCDLL tag=2QWL07BRM43R type=del size=2140368 2024-06-04T15:59:27.410 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.409+0000 7f5e9aacc780 1 < completed delete operation key=4W5HB9WQQHR6 tag=I5Z917T609NJ type=del 2024-06-04T15:59:27.411 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.411+0000 7f5e9aacc780 1 > prepared operation key=B0HK5FJ2RGJE tag=A70YMXEVEMXB type=del size=814099 2024-06-04T15:59:27.413 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.412+0000 7f5e9aacc780 1 < completed delete operation key=RP8K6QJUZAH1 tag=CD2WXABGZK8B type=del 2024-06-04T15:59:27.415 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.415+0000 7f5e9aacc780 1 > prepared operation key=A8O0S3S45RGM tag=RLA5AZ85H8LK type=del size=3318334 2024-06-04T15:59:27.418 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.417+0000 7f5e9aacc780 1 < completed write operation key=GTRMEQJK675Z tag=WYUD6JNNB5P0 type=write size=894170 2024-06-04T15:59:27.420 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.420+0000 7f5e9aacc780 1 > prepared part key=_multipart_Q2V1ICTBSCV1.2~OURWK81F6IWQ.0 size=1048576 2024-06-04T15:59:27.421 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.421+0000 7f5e9aacc780 1 > prepared part key=_multipart_Q2V1ICTBSCV1.2~OURWK81F6IWQ.1 size=1048576 2024-06-04T15:59:27.422 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.422+0000 7f5e9aacc780 1 > prepared part key=_multipart_Q2V1ICTBSCV1.2~OURWK81F6IWQ.2 size=825333 2024-06-04T15:59:27.423 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.422+0000 7f5e9aacc780 1 > prepared multipart upload key=Q2V1ICTBSCV1 upload=OURWK81F6IWQ tag=42D7QEA2XN39 type=write size=3971061 2024-06-04T15:59:27.424 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.423+0000 7f5e9aacc780 1 < completed delete operation key=B0HK5FJ2RGJE tag=H9PTQ6UKDV7P type=del 2024-06-04T15:59:27.425 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.425+0000 7f5e9aacc780 1 > prepared operation key=2BT2AXKB1RTA tag=3YLOZLIOD8SX type=del size=240395 2024-06-04T15:59:27.427 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.427+0000 7f5e9aacc780 1 < completed part key=_multipart_DY9JWHWNAUO1.2~QQJHX0EHMGUE.0 size=1048576 2024-06-04T15:59:27.428 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.428+0000 7f5e9aacc780 1 < completed part key=_multipart_DY9JWHWNAUO1.2~QQJHX0EHMGUE.1 size=1048576 2024-06-04T15:59:27.429 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.429+0000 7f5e9aacc780 1 < completed part key=_multipart_DY9JWHWNAUO1.2~QQJHX0EHMGUE.2 size=441940 2024-06-04T15:59:27.431 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.431+0000 7f5e9aacc780 1 < completed multipart upload key=DY9JWHWNAUO1 upload=QQJHX0EHMGUE tag=MQKE7P0H2ZPH type=write size=3587668 2024-06-04T15:59:27.433 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.433+0000 7f5e9aacc780 1 > prepared part key=_multipart_SUBHZJ7HUV3H.2~CCB17H0CFP5O.0 size=1048576 2024-06-04T15:59:27.435 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.434+0000 7f5e9aacc780 1 > prepared part key=_multipart_SUBHZJ7HUV3H.2~CCB17H0CFP5O.1 size=796046 2024-06-04T15:59:27.435 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.434+0000 7f5e9aacc780 1 > prepared multipart upload key=SUBHZJ7HUV3H upload=CCB17H0CFP5O tag=YYPGL5K8YSOT type=write size=2893198 2024-06-04T15:59:27.436 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.436+0000 7f5e9aacc780 1 < completed delete operation key=1IKNQXU3Y2JJ tag=2H2D5C2HBM7R type=del 2024-06-04T15:59:27.437 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.437+0000 7f5e9aacc780 1 > prepared operation key=GTRMEQJK675Z tag=JFUGZG6V9JA5 type=del size=725103 2024-06-04T15:59:27.439 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.438+0000 7f5e9aacc780 1 < completed delete operation key=RP8K6QJUZAH1 tag=V0WVGZFW392X type=del 2024-06-04T15:59:27.440 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.440+0000 7f5e9aacc780 1 > prepared operation key=GTRMEQJK675Z tag=YSCV20YD0V3R type=del size=839283 2024-06-04T15:59:27.441 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.441+0000 7f5e9aacc780 1 < completed write operation key=PASGIP872OVX tag=ZSANRDRMORSI type=write size=25292 2024-06-04T15:59:27.443 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.443+0000 7f5e9aacc780 1 > prepared operation key=GTRMEQJK675Z tag=61VX31UMNO30 type=del size=1986882 2024-06-04T15:59:27.444 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.444+0000 7f5e9aacc780 1 < canceled operation key=UW5LVIBG09SV tag=8721R6C2BX3F type=del size=1251689 2024-06-04T15:59:27.446 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.445+0000 7f5e9aacc780 1 > prepared operation key=Q2V1ICTBSCV1 tag=PLZVOZXTE6X2 type=del size=1634103 2024-06-04T15:59:27.448 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.448+0000 7f5e9aacc780 1 < suggested remove operation key=PASGIP872OVX tag=14NQ3RAS3QSU type=del 2024-06-04T15:59:27.451 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.451+0000 7f5e9aacc780 1 > prepared part key=_multipart_Q4OFQI0F5YLG.2~48S2ASW0WV1O.0 size=1011014 2024-06-04T15:59:27.451 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.451+0000 7f5e9aacc780 1 > prepared multipart upload key=Q4OFQI0F5YLG upload=48S2ASW0WV1O tag=B6KFE5GMZ07M type=write size=2059590 2024-06-04T15:59:27.452 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.452+0000 7f5e9aacc780 1 < completed delete operation key=RP8K6QJUZAH1 tag=HB9L8BLGF9IX type=del 2024-06-04T15:59:27.454 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.453+0000 7f5e9aacc780 1 > prepared operation key=2BT2AXKB1RTA tag=UMPIMBAGDLFG type=del size=86461 2024-06-04T15:59:27.455 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.455+0000 7f5e9aacc780 1 < completed part key=_multipart_GCPC9OJH7KWU.2~19XY0B3IS5XS.0 size=1048576 2024-06-04T15:59:27.456 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.456+0000 7f5e9aacc780 1 < completed part key=_multipart_GCPC9OJH7KWU.2~19XY0B3IS5XS.1 size=1048576 2024-06-04T15:59:27.457 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.457+0000 7f5e9aacc780 1 < completed part key=_multipart_GCPC9OJH7KWU.2~19XY0B3IS5XS.2 size=195678 2024-06-04T15:59:27.459 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.459+0000 7f5e9aacc780 1 < completed multipart upload key=GCPC9OJH7KWU upload=19XY0B3IS5XS tag=BCG2YLF0NFCF type=write size=3341406 2024-06-04T15:59:27.461 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.460+0000 7f5e9aacc780 1 > prepared operation key=UTZHANL9ER2Q tag=65R1GDIM9SHQ type=del size=3662099 2024-06-04T15:59:27.462 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.462+0000 7f5e9aacc780 1 < completed write operation key=JL69PUHT6NNT tag=X603ZW1WQ88E type=write size=1008031 2024-06-04T15:59:27.464 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.463+0000 7f5e9aacc780 1 > prepared operation key=UTZHANL9ER2Q tag=V5UYJ0VK9GYU type=write size=113955 2024-06-04T15:59:27.465 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.465+0000 7f5e9aacc780 1 < completed delete operation key=2BT2AXKB1RTA tag=S0V9GBWJEHDU type=del 2024-06-04T15:59:27.468 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.467+0000 7f5e9aacc780 1 > prepared part key=_multipart_2BT2AXKB1RTA.2~UG5KBH27Q4A4.0 size=514682 2024-06-04T15:59:27.468 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.467+0000 7f5e9aacc780 1 > prepared multipart upload key=2BT2AXKB1RTA upload=UG5KBH27Q4A4 tag=JR9EQFQ74ALZ type=write size=1563258 2024-06-04T15:59:27.469 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.469+0000 7f5e9aacc780 1 < completed delete operation key=XH0N984YVGKP tag=8XPZEZ9VNAAK type=del 2024-06-04T15:59:27.471 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.471+0000 7f5e9aacc780 1 > prepared part key=_multipart_B0HK5FJ2RGJE.2~52WBXN0WG40L.0 size=1048576 2024-06-04T15:59:27.472 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.472+0000 7f5e9aacc780 1 > prepared part key=_multipart_B0HK5FJ2RGJE.2~52WBXN0WG40L.1 size=1048576 2024-06-04T15:59:27.473 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.473+0000 7f5e9aacc780 1 > prepared part key=_multipart_B0HK5FJ2RGJE.2~52WBXN0WG40L.2 size=140941 2024-06-04T15:59:27.474 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.473+0000 7f5e9aacc780 1 > prepared multipart upload key=B0HK5FJ2RGJE upload=52WBXN0WG40L tag=P2JLRMZ0JWWJ type=write size=3286669 2024-06-04T15:59:27.476 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.476+0000 7f5e9aacc780 1 < suggested remove operation key=HD6SNICRCDLL tag=2QWL07BRM43R type=del 2024-06-04T15:59:27.479 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.478+0000 7f5e9aacc780 1 > prepared part key=_multipart_9MPRI6LW3956.2~DMOVH6P023N3.0 size=1048576 2024-06-04T15:59:27.480 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.479+0000 7f5e9aacc780 1 > prepared part key=_multipart_9MPRI6LW3956.2~DMOVH6P023N3.1 size=1048576 2024-06-04T15:59:27.481 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.480+0000 7f5e9aacc780 1 > prepared part key=_multipart_9MPRI6LW3956.2~DMOVH6P023N3.2 size=1037202 2024-06-04T15:59:27.481 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.480+0000 7f5e9aacc780 1 > prepared multipart upload key=9MPRI6LW3956 upload=DMOVH6P023N3 tag=83IOZV9M0QZL type=write size=4182930 2024-06-04T15:59:27.488 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.488+0000 7f5e9aacc780 1 < completed delete operation key=B0HK5FJ2RGJE tag=A70YMXEVEMXB type=del 2024-06-04T15:59:27.490 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.489+0000 7f5e9aacc780 1 > prepared operation key=QJA2JPATITNH tag=80L9G6DUVFGL type=write size=327891 2024-06-04T15:59:27.491 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.491+0000 7f5e9aacc780 1 < completed delete operation key=A8O0S3S45RGM tag=RLA5AZ85H8LK type=del 2024-06-04T15:59:27.494 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.493+0000 7f5e9aacc780 1 > prepared part key=_multipart_1IKNQXU3Y2JJ.2~46WB4K9RI7NA.0 size=1048576 2024-06-04T15:59:27.495 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.494+0000 7f5e9aacc780 1 > prepared part key=_multipart_1IKNQXU3Y2JJ.2~46WB4K9RI7NA.1 size=407749 2024-06-04T15:59:27.495 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.494+0000 7f5e9aacc780 1 > prepared multipart upload key=1IKNQXU3Y2JJ upload=46WB4K9RI7NA tag=M03PGFUUKRFC type=write size=2504901 2024-06-04T15:59:27.496 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.496+0000 7f5e9aacc780 1 < completed part key=_multipart_Q2V1ICTBSCV1.2~OURWK81F6IWQ.0 size=1048576 2024-06-04T15:59:27.497 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.497+0000 7f5e9aacc780 1 < completed part key=_multipart_Q2V1ICTBSCV1.2~OURWK81F6IWQ.1 size=1048576 2024-06-04T15:59:27.498 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.498+0000 7f5e9aacc780 1 < completed part key=_multipart_Q2V1ICTBSCV1.2~OURWK81F6IWQ.2 size=825333 2024-06-04T15:59:27.502 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.502+0000 7f5e9aacc780 1 < completed multipart upload key=Q2V1ICTBSCV1 upload=OURWK81F6IWQ tag=42D7QEA2XN39 type=write size=3971061 2024-06-04T15:59:27.503 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.503+0000 7f5e9aacc780 1 > prepared operation key=PCLJXQHJ4HTY tag=UWHKGYZYSWFJ type=del size=3681860 2024-06-04T15:59:27.505 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.504+0000 7f5e9aacc780 1 < completed delete operation key=2BT2AXKB1RTA tag=3YLOZLIOD8SX type=del 2024-06-04T15:59:27.506 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.506+0000 7f5e9aacc780 1 > prepared operation key=QUIVPH3OB6KN tag=APOBWY4Z3360 type=write size=121310 2024-06-04T15:59:27.507 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.507+0000 7f5e9aacc780 1 < completed part key=_multipart_SUBHZJ7HUV3H.2~CCB17H0CFP5O.0 size=1048576 2024-06-04T15:59:27.508 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.508+0000 7f5e9aacc780 1 < completed part key=_multipart_SUBHZJ7HUV3H.2~CCB17H0CFP5O.1 size=796046 2024-06-04T15:59:27.511 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.511+0000 7f5e9aacc780 1 < completed multipart upload key=SUBHZJ7HUV3H upload=CCB17H0CFP5O tag=YYPGL5K8YSOT type=write size=2893198 2024-06-04T15:59:27.514 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.513+0000 7f5e9aacc780 1 > prepared part key=_multipart_FBV2MAG130M6.2~MSBUM1UVM4DL.0 size=1048576 2024-06-04T15:59:27.515 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.515+0000 7f5e9aacc780 1 > prepared part key=_multipart_FBV2MAG130M6.2~MSBUM1UVM4DL.1 size=1048576 2024-06-04T15:59:27.516 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.516+0000 7f5e9aacc780 1 > prepared part key=_multipart_FBV2MAG130M6.2~MSBUM1UVM4DL.2 size=168105 2024-06-04T15:59:27.516 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.516+0000 7f5e9aacc780 1 > prepared multipart upload key=FBV2MAG130M6 upload=MSBUM1UVM4DL tag=2IPLADR5ITLM type=write size=3313833 2024-06-04T15:59:27.517 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.517+0000 7f5e9aacc780 1 < completed delete operation key=GTRMEQJK675Z tag=JFUGZG6V9JA5 type=del 2024-06-04T15:59:27.520 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.519+0000 7f5e9aacc780 1 > prepared part key=_multipart_PASGIP872OVX.2~Y615W8EGAZC3.0 size=1048576 2024-06-04T15:59:27.521 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.521+0000 7f5e9aacc780 1 > prepared part key=_multipart_PASGIP872OVX.2~Y615W8EGAZC3.1 size=349042 2024-06-04T15:59:27.521 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.521+0000 7f5e9aacc780 1 > prepared multipart upload key=PASGIP872OVX upload=Y615W8EGAZC3 tag=M738MD3OH5KB type=write size=2446194 2024-06-04T15:59:27.523 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.522+0000 7f5e9aacc780 1 < completed delete operation key=GTRMEQJK675Z tag=YSCV20YD0V3R type=del 2024-06-04T15:59:27.524 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.524+0000 7f5e9aacc780 1 > prepared operation key=NJ5U8JTT32QK tag=3LSRETC9UR1L type=del size=3082131 2024-06-04T15:59:27.528 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.527+0000 7f5e9aacc780 1 < suggested remove operation key=GTRMEQJK675Z tag=61VX31UMNO30 type=del 2024-06-04T15:59:27.529 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.529+0000 7f5e9aacc780 1 > prepared operation key=QUIVPH3OB6KN tag=CL6KS4ID4XUK type=del size=2588200 2024-06-04T15:59:27.531 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.530+0000 7f5e9aacc780 1 < completed delete operation key=Q2V1ICTBSCV1 tag=PLZVOZXTE6X2 type=del 2024-06-04T15:59:27.532 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.532+0000 7f5e9aacc780 1 > prepared operation key=GCPC9OJH7KWU tag=A3YRL1NO2ONU type=del size=3414949 2024-06-04T15:59:27.534 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.533+0000 7f5e9aacc780 1 < completed part key=_multipart_Q4OFQI0F5YLG.2~48S2ASW0WV1O.0 size=1011014 2024-06-04T15:59:27.536 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.536+0000 7f5e9aacc780 1 < completed multipart upload key=Q4OFQI0F5YLG upload=48S2ASW0WV1O tag=B6KFE5GMZ07M type=write size=2059590 2024-06-04T15:59:27.539 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.539+0000 7f5e9aacc780 1 > prepared part key=_multipart_W1T4O3EAE7JN.2~ST0GS2ISEOW3.0 size=228952 2024-06-04T15:59:27.539 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.539+0000 7f5e9aacc780 1 > prepared multipart upload key=W1T4O3EAE7JN upload=ST0GS2ISEOW3 tag=QA0J3J4C3932 type=write size=1277528 2024-06-04T15:59:27.542 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.542+0000 7f5e9aacc780 1 < suggested update operation key=2BT2AXKB1RTA tag=UMPIMBAGDLFG type=del size=86461 2024-06-04T15:59:27.545 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.545+0000 7f5e9aacc780 1 > prepared part key=_multipart_HD6SNICRCDLL.2~S76C35KH0HJF.0 size=143174 2024-06-04T15:59:27.545 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.545+0000 7f5e9aacc780 1 > prepared multipart upload key=HD6SNICRCDLL upload=S76C35KH0HJF tag=V1O1WG9KIU04 type=write size=1191750 2024-06-04T15:59:27.548 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.548+0000 7f5e9aacc780 1 < suggested update operation key=UTZHANL9ER2Q tag=65R1GDIM9SHQ type=del size=3662099 2024-06-04T15:59:27.550 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.549+0000 7f5e9aacc780 1 > prepared operation key=PCLJXQHJ4HTY tag=W86Q2POPJF88 type=del size=3438020 2024-06-04T15:59:27.551 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.551+0000 7f5e9aacc780 -1 < failed to complete operation key=UTZHANL9ER2Q tag=V5UYJ0VK9GYU type=write size=113955: (22) Invalid argument 2024-06-04T15:59:27.552 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.552+0000 7f5e9aacc780 1 > prepared operation key=K01DAK0M4I4M tag=J82HKZNRUR37 type=del size=1438488 2024-06-04T15:59:27.554 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.553+0000 7f5e9aacc780 1 < completed part key=_multipart_2BT2AXKB1RTA.2~UG5KBH27Q4A4.0 size=514682 2024-06-04T15:59:27.557 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.556+0000 7f5e9aacc780 1 < completed multipart upload key=2BT2AXKB1RTA upload=UG5KBH27Q4A4 tag=JR9EQFQ74ALZ type=write size=1563258 2024-06-04T15:59:27.558 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.558+0000 7f5e9aacc780 1 > prepared operation key=NHPH4LYPP0LL tag=3XY1YZR3UO7J type=del size=2327864 2024-06-04T15:59:27.559 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.559+0000 7f5e9aacc780 1 < completed part key=_multipart_B0HK5FJ2RGJE.2~52WBXN0WG40L.0 size=1048576 2024-06-04T15:59:27.561 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.560+0000 7f5e9aacc780 1 < completed part key=_multipart_B0HK5FJ2RGJE.2~52WBXN0WG40L.1 size=1048576 2024-06-04T15:59:27.561 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.561+0000 7f5e9aacc780 1 < completed part key=_multipart_B0HK5FJ2RGJE.2~52WBXN0WG40L.2 size=140941 2024-06-04T15:59:27.564 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.563+0000 7f5e9aacc780 1 < completed multipart upload key=B0HK5FJ2RGJE upload=52WBXN0WG40L tag=P2JLRMZ0JWWJ type=write size=3286669 2024-06-04T15:59:27.566 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.566+0000 7f5e9aacc780 1 > prepared part key=_multipart_UTZHANL9ER2Q.2~8CEFO8GVP6NV.0 size=209508 2024-06-04T15:59:27.567 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.566+0000 7f5e9aacc780 1 > prepared multipart upload key=UTZHANL9ER2Q upload=8CEFO8GVP6NV tag=PR2A91UZY9YY type=write size=1258084 2024-06-04T15:59:27.568 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.568+0000 7f5e9aacc780 1 < completed part key=_multipart_9MPRI6LW3956.2~DMOVH6P023N3.0 size=1048576 2024-06-04T15:59:27.569 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.569+0000 7f5e9aacc780 1 < completed part key=_multipart_9MPRI6LW3956.2~DMOVH6P023N3.1 size=1048576 2024-06-04T15:59:27.570 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.570+0000 7f5e9aacc780 1 < completed part key=_multipart_9MPRI6LW3956.2~DMOVH6P023N3.2 size=1037202 2024-06-04T15:59:27.573 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.572+0000 7f5e9aacc780 1 < completed multipart upload key=9MPRI6LW3956 upload=DMOVH6P023N3 tag=83IOZV9M0QZL type=write size=4182930 2024-06-04T15:59:27.576 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.576+0000 7f5e9aacc780 1 > prepared part key=_multipart_Q2V1ICTBSCV1.2~DH9ZJB54UQAE.0 size=1048576 2024-06-04T15:59:27.577 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.577+0000 7f5e9aacc780 1 > prepared part key=_multipart_Q2V1ICTBSCV1.2~DH9ZJB54UQAE.1 size=1048576 2024-06-04T15:59:27.578 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.578+0000 7f5e9aacc780 1 > prepared part key=_multipart_Q2V1ICTBSCV1.2~DH9ZJB54UQAE.2 size=72421 2024-06-04T15:59:27.578 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.578+0000 7f5e9aacc780 1 > prepared multipart upload key=Q2V1ICTBSCV1 upload=DH9ZJB54UQAE tag=2A2BLG3696S5 type=write size=3218149 2024-06-04T15:59:27.581 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.581+0000 7f5e9aacc780 1 < suggested remove operation key=QJA2JPATITNH tag=80L9G6DUVFGL type=write 2024-06-04T15:59:27.583 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.582+0000 7f5e9aacc780 1 > prepared operation key=7S9S3MIG7WIT tag=L4DYMQZ4MJ0R type=del size=852884 2024-06-04T15:59:27.584 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.584+0000 7f5e9aacc780 1 < completed part key=_multipart_1IKNQXU3Y2JJ.2~46WB4K9RI7NA.0 size=1048576 2024-06-04T15:59:27.585 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.585+0000 7f5e9aacc780 1 < completed part key=_multipart_1IKNQXU3Y2JJ.2~46WB4K9RI7NA.1 size=407749 2024-06-04T15:59:27.587 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.587+0000 7f5e9aacc780 1 < completed multipart upload key=1IKNQXU3Y2JJ upload=46WB4K9RI7NA tag=M03PGFUUKRFC type=write size=2504901 2024-06-04T15:59:27.589 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.588+0000 7f5e9aacc780 1 > prepared operation key=9MPRI6LW3956 tag=BVQD78ZJCSB3 type=del size=75140 2024-06-04T15:59:27.590 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.590+0000 7f5e9aacc780 1 < completed delete operation key=PCLJXQHJ4HTY tag=UWHKGYZYSWFJ type=del 2024-06-04T15:59:27.591 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.591+0000 7f5e9aacc780 1 > prepared operation key=03ZNYG3WLMP4 tag=W2ZS79GN2DDL type=del size=3505516 2024-06-04T15:59:27.593 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.592+0000 7f5e9aacc780 1 < completed write operation key=QUIVPH3OB6KN tag=APOBWY4Z3360 type=write size=121310 2024-06-04T15:59:27.595 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.595+0000 7f5e9aacc780 1 > prepared part key=_multipart_AOCB36Y5Q7B0.2~YMB9ODVC1TA9.0 size=1048576 2024-06-04T15:59:27.596 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.596+0000 7f5e9aacc780 1 > prepared part key=_multipart_AOCB36Y5Q7B0.2~YMB9ODVC1TA9.1 size=851853 2024-06-04T15:59:27.596 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.596+0000 7f5e9aacc780 1 > prepared multipart upload key=AOCB36Y5Q7B0 upload=YMB9ODVC1TA9 tag=NI19C34Q1ZIB type=write size=2949005 2024-06-04T15:59:27.598 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.597+0000 7f5e9aacc780 1 < completed part key=_multipart_FBV2MAG130M6.2~MSBUM1UVM4DL.0 size=1048576 2024-06-04T15:59:27.599 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.598+0000 7f5e9aacc780 1 < completed part key=_multipart_FBV2MAG130M6.2~MSBUM1UVM4DL.1 size=1048576 2024-06-04T15:59:27.600 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.599+0000 7f5e9aacc780 1 < completed part key=_multipart_FBV2MAG130M6.2~MSBUM1UVM4DL.2 size=168105 2024-06-04T15:59:27.602 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.602+0000 7f5e9aacc780 1 < completed multipart upload key=FBV2MAG130M6 upload=MSBUM1UVM4DL tag=2IPLADR5ITLM type=write size=3313833 2024-06-04T15:59:27.605 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.605+0000 7f5e9aacc780 1 > prepared part key=_multipart_TUGKW7F4V9NO.2~UKRVPDLCXOGL.0 size=1048576 2024-06-04T15:59:27.606 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.606+0000 7f5e9aacc780 1 > prepared part key=_multipart_TUGKW7F4V9NO.2~UKRVPDLCXOGL.1 size=541559 2024-06-04T15:59:27.606 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.606+0000 7f5e9aacc780 1 > prepared multipart upload key=TUGKW7F4V9NO upload=UKRVPDLCXOGL tag=AV0ZUREZFE71 type=write size=2638711 2024-06-04T15:59:27.607 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.607+0000 7f5e9aacc780 1 < completed part key=_multipart_PASGIP872OVX.2~Y615W8EGAZC3.0 size=1048576 2024-06-04T15:59:27.608 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.608+0000 7f5e9aacc780 1 < completed part key=_multipart_PASGIP872OVX.2~Y615W8EGAZC3.1 size=349042 2024-06-04T15:59:27.611 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.611+0000 7f5e9aacc780 1 < completed multipart upload key=PASGIP872OVX upload=Y615W8EGAZC3 tag=M738MD3OH5KB type=write size=2446194 2024-06-04T15:59:27.614 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.613+0000 7f5e9aacc780 1 > prepared part key=_multipart_NHPH4LYPP0LL.2~L3948I0QXUO2.0 size=81639 2024-06-04T15:59:27.614 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.613+0000 7f5e9aacc780 1 > prepared multipart upload key=NHPH4LYPP0LL upload=L3948I0QXUO2 tag=INGPW03NYUEG type=write size=1130215 2024-06-04T15:59:27.615 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.615+0000 7f5e9aacc780 1 < canceled operation key=NJ5U8JTT32QK tag=3LSRETC9UR1L type=del size=3082131 2024-06-04T15:59:27.616 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.616+0000 7f5e9aacc780 1 > prepared operation key=4W5HB9WQQHR6 tag=0UO5YRI5RZHN type=del size=607326 2024-06-04T15:59:27.618 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.618+0000 7f5e9aacc780 1 < completed delete operation key=QUIVPH3OB6KN tag=CL6KS4ID4XUK type=del 2024-06-04T15:59:27.619 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.619+0000 7f5e9aacc780 1 > prepared operation key=UW5LVIBG09SV tag=XDX0DRY2NAP2 type=write size=1032116 2024-06-04T15:59:27.620 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.620+0000 7f5e9aacc780 1 < completed delete operation key=GCPC9OJH7KWU tag=A3YRL1NO2ONU type=del 2024-06-04T15:59:27.622 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.622+0000 7f5e9aacc780 1 > prepared operation key=DY9JWHWNAUO1 tag=EP3HHJ1JAX57 type=del size=2367754 2024-06-04T15:59:27.623 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.623+0000 7f5e9aacc780 1 < completed part key=_multipart_W1T4O3EAE7JN.2~ST0GS2ISEOW3.0 size=228952 2024-06-04T15:59:27.625 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.625+0000 7f5e9aacc780 1 < completed multipart upload key=W1T4O3EAE7JN upload=ST0GS2ISEOW3 tag=QA0J3J4C3932 type=write size=1277528 2024-06-04T15:59:27.627 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.626+0000 7f5e9aacc780 1 > prepared operation key=NJ5U8JTT32QK tag=FLC8NC7JXMUN type=del size=2024395 2024-06-04T15:59:27.628 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.628+0000 7f5e9aacc780 1 < completed part key=_multipart_HD6SNICRCDLL.2~S76C35KH0HJF.0 size=143174 2024-06-04T15:59:27.630 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.630+0000 7f5e9aacc780 1 < completed multipart upload key=HD6SNICRCDLL upload=S76C35KH0HJF tag=V1O1WG9KIU04 type=write size=1191750 2024-06-04T15:59:27.632 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.631+0000 7f5e9aacc780 1 > prepared operation key=FBV2MAG130M6 tag=QIJHQRH4DAQ4 type=del size=1895974 2024-06-04T15:59:27.633 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.633+0000 7f5e9aacc780 1 < completed delete operation key=PCLJXQHJ4HTY tag=W86Q2POPJF88 type=del 2024-06-04T15:59:27.634 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.634+0000 7f5e9aacc780 1 > prepared operation key=QJA2JPATITNH tag=F7C9ILURTI1Z type=del size=2883527 2024-06-04T15:59:27.635 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.635+0000 7f5e9aacc780 1 < canceled operation key=K01DAK0M4I4M tag=J82HKZNRUR37 type=del size=1438488 2024-06-04T15:59:27.638 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.638+0000 7f5e9aacc780 1 > prepared part key=_multipart_K01DAK0M4I4M.2~D0XN4N3VGFV2.0 size=545463 2024-06-04T15:59:27.638 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.638+0000 7f5e9aacc780 1 > prepared multipart upload key=K01DAK0M4I4M upload=D0XN4N3VGFV2 tag=05D7ALMFIEAZ type=write size=1594039 2024-06-04T15:59:27.639 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.639+0000 7f5e9aacc780 1 < completed delete operation key=NHPH4LYPP0LL tag=3XY1YZR3UO7J type=del 2024-06-04T15:59:27.642 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.641+0000 7f5e9aacc780 1 > prepared part key=_multipart_7S9S3MIG7WIT.2~43ASQ6I0J1KI.0 size=375021 2024-06-04T15:59:27.642 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.641+0000 7f5e9aacc780 1 > prepared multipart upload key=7S9S3MIG7WIT upload=43ASQ6I0J1KI tag=2TJZ752IGCMM type=write size=1423597 2024-06-04T15:59:27.643 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.643+0000 7f5e9aacc780 1 < completed part key=_multipart_UTZHANL9ER2Q.2~8CEFO8GVP6NV.0 size=209508 2024-06-04T15:59:27.645 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.646+0000 7f5e9aacc780 1 < completed multipart upload key=UTZHANL9ER2Q upload=8CEFO8GVP6NV tag=PR2A91UZY9YY type=write size=1258084 2024-06-04T15:59:27.647 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.647+0000 7f5e9aacc780 1 > prepared operation key=B0HK5FJ2RGJE tag=QZ0KTQ3F01VK type=del size=1610071 2024-06-04T15:59:27.649 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.648+0000 7f5e9aacc780 1 < completed part key=_multipart_Q2V1ICTBSCV1.2~DH9ZJB54UQAE.0 size=1048576 2024-06-04T15:59:27.650 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.650+0000 7f5e9aacc780 1 < completed part key=_multipart_Q2V1ICTBSCV1.2~DH9ZJB54UQAE.1 size=1048576 2024-06-04T15:59:27.651 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.651+0000 7f5e9aacc780 1 < completed part key=_multipart_Q2V1ICTBSCV1.2~DH9ZJB54UQAE.2 size=72421 2024-06-04T15:59:27.654 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.653+0000 7f5e9aacc780 1 < completed multipart upload key=Q2V1ICTBSCV1 upload=DH9ZJB54UQAE tag=2A2BLG3696S5 type=write size=3218149 2024-06-04T15:59:27.655 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.655+0000 7f5e9aacc780 1 > prepared operation key=HD6SNICRCDLL tag=LQFWQXTAU60A type=del size=1909990 2024-06-04T15:59:27.657 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.657+0000 7f5e9aacc780 1 < completed delete operation key=7S9S3MIG7WIT tag=L4DYMQZ4MJ0R type=del 2024-06-04T15:59:27.658 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.658+0000 7f5e9aacc780 1 > prepared operation key=Q4OFQI0F5YLG tag=1UCLR3BHMION type=del size=155309 2024-06-04T15:59:27.661 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.661+0000 7f5e9aacc780 1 < suggested update operation key=9MPRI6LW3956 tag=BVQD78ZJCSB3 type=del size=75140 2024-06-04T15:59:27.664 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.664+0000 7f5e9aacc780 1 > prepared part key=_multipart_FBV2MAG130M6.2~KRDOV9PGXND3.0 size=174584 2024-06-04T15:59:27.664 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.664+0000 7f5e9aacc780 1 > prepared multipart upload key=FBV2MAG130M6 upload=KRDOV9PGXND3 tag=WLZI6SD0K6XA type=write size=1223160 2024-06-04T15:59:27.665 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.665+0000 7f5e9aacc780 1 < completed delete operation key=03ZNYG3WLMP4 tag=W2ZS79GN2DDL type=del 2024-06-04T15:59:27.667 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.666+0000 7f5e9aacc780 1 > prepared operation key=UW5LVIBG09SV tag=3V2TXFUTEG32 type=del size=3517601 2024-06-04T15:59:27.669 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.669+0000 7f5e9aacc780 1 < completed part key=_multipart_AOCB36Y5Q7B0.2~YMB9ODVC1TA9.0 size=1048576 2024-06-04T15:59:27.671 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.671+0000 7f5e9aacc780 1 < completed part key=_multipart_AOCB36Y5Q7B0.2~YMB9ODVC1TA9.1 size=851853 2024-06-04T15:59:27.673 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.673+0000 7f5e9aacc780 1 < completed multipart upload key=AOCB36Y5Q7B0 upload=YMB9ODVC1TA9 tag=NI19C34Q1ZIB type=write size=2949005 2024-06-04T15:59:27.675 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.675+0000 7f5e9aacc780 1 > prepared operation key=NHPH4LYPP0LL tag=I3C07PT01F5O type=del size=1042415 2024-06-04T15:59:27.677 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.677+0000 7f5e9aacc780 1 < completed part key=_multipart_TUGKW7F4V9NO.2~UKRVPDLCXOGL.0 size=1048576 2024-06-04T15:59:27.677 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.677+0000 7f5e9aacc780 1 < canceled part key=_multipart_TUGKW7F4V9NO.2~UKRVPDLCXOGL.1 size=541559 2024-06-04T15:59:27.679 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.679+0000 7f5e9aacc780 1 < canceled multipart upload key=TUGKW7F4V9NO upload=UKRVPDLCXOGL tag=AV0ZUREZFE71 type=write size=2638711 2024-06-04T15:59:27.681 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.680+0000 7f5e9aacc780 1 > prepared operation key=SUBHZJ7HUV3H tag=2JZWMQHP107Y type=write size=148240 2024-06-04T15:59:27.682 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.682+0000 7f5e9aacc780 1 < completed part key=_multipart_NHPH4LYPP0LL.2~L3948I0QXUO2.0 size=81639 2024-06-04T15:59:27.684 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.684+0000 7f5e9aacc780 1 < completed multipart upload key=NHPH4LYPP0LL upload=L3948I0QXUO2 tag=INGPW03NYUEG type=write size=1130215 2024-06-04T15:59:27.685 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.685+0000 7f5e9aacc780 1 > prepared operation key=HD6SNICRCDLL tag=O644R9PRVCAW type=del size=3818277 2024-06-04T15:59:27.687 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.687+0000 7f5e9aacc780 1 < completed delete operation key=4W5HB9WQQHR6 tag=0UO5YRI5RZHN type=del 2024-06-04T15:59:27.691 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.691+0000 7f5e9aacc780 1 > prepared part key=_multipart_JL69PUHT6NNT.2~2I1P74ZG1DKK.0 size=1048576 2024-06-04T15:59:27.692 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.692+0000 7f5e9aacc780 1 > prepared part key=_multipart_JL69PUHT6NNT.2~2I1P74ZG1DKK.1 size=719193 2024-06-04T15:59:27.692 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.692+0000 7f5e9aacc780 1 > prepared multipart upload key=JL69PUHT6NNT upload=2I1P74ZG1DKK tag=XT39QWZRTV28 type=write size=2816345 2024-06-04T15:59:27.693 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.693+0000 7f5e9aacc780 1 < completed write operation key=UW5LVIBG09SV tag=XDX0DRY2NAP2 type=write size=1032116 2024-06-04T15:59:27.695 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.695+0000 7f5e9aacc780 1 > prepared operation key=SUBHZJ7HUV3H tag=G7KP26JPNIFU type=del size=1342677 2024-06-04T15:59:27.696 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.696+0000 7f5e9aacc780 1 < completed delete operation key=DY9JWHWNAUO1 tag=EP3HHJ1JAX57 type=del 2024-06-04T15:59:27.697 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.697+0000 7f5e9aacc780 1 > prepared operation key=7S9S3MIG7WIT tag=SKI2U61JM1RZ type=del size=624660 2024-06-04T15:59:27.700 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.700+0000 7f5e9aacc780 1 < suggested update operation key=NJ5U8JTT32QK tag=FLC8NC7JXMUN type=del size=2024395 2024-06-04T15:59:27.702 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.701+0000 7f5e9aacc780 1 > prepared operation key=GTRMEQJK675Z tag=35IM6D00FIHQ type=del size=1612416 2024-06-04T15:59:27.703 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.703+0000 7f5e9aacc780 1 < completed delete operation key=FBV2MAG130M6 tag=QIJHQRH4DAQ4 type=del 2024-06-04T15:59:27.704 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.704+0000 7f5e9aacc780 1 > prepared operation key=AOCB36Y5Q7B0 tag=JINGMNM4HXIG type=write size=687039 2024-06-04T15:59:27.706 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.705+0000 7f5e9aacc780 1 < completed delete operation key=QJA2JPATITNH tag=F7C9ILURTI1Z type=del 2024-06-04T15:59:27.708 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.708+0000 7f5e9aacc780 1 > prepared part key=_multipart_W1T4O3EAE7JN.2~FNRS3PM891K5.0 size=1048576 2024-06-04T15:59:27.709 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.709+0000 7f5e9aacc780 1 > prepared part key=_multipart_W1T4O3EAE7JN.2~FNRS3PM891K5.1 size=1012021 2024-06-04T15:59:27.710 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.709+0000 7f5e9aacc780 1 > prepared multipart upload key=W1T4O3EAE7JN upload=FNRS3PM891K5 tag=6LQ1M5SICRX9 type=write size=3109173 2024-06-04T15:59:27.711 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.711+0000 7f5e9aacc780 1 < completed part key=_multipart_K01DAK0M4I4M.2~D0XN4N3VGFV2.0 size=545463 2024-06-04T15:59:27.713 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.713+0000 7f5e9aacc780 1 < completed multipart upload key=K01DAK0M4I4M upload=D0XN4N3VGFV2 tag=05D7ALMFIEAZ type=write size=1594039 2024-06-04T15:59:27.716 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.716+0000 7f5e9aacc780 1 > prepared part key=_multipart_NJ5U8JTT32QK.2~ZAL82H2NABMC.0 size=521277 2024-06-04T15:59:27.716 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.716+0000 7f5e9aacc780 1 > prepared multipart upload key=NJ5U8JTT32QK upload=ZAL82H2NABMC tag=K1B4W2ZGSW16 type=write size=1569853 2024-06-04T15:59:27.717 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.717+0000 7f5e9aacc780 1 < completed part key=_multipart_7S9S3MIG7WIT.2~43ASQ6I0J1KI.0 size=375021 2024-06-04T15:59:27.719 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.719+0000 7f5e9aacc780 1 < completed multipart upload key=7S9S3MIG7WIT upload=43ASQ6I0J1KI tag=2TJZ752IGCMM type=write size=1423597 2024-06-04T15:59:27.721 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.721+0000 7f5e9aacc780 1 > prepared operation key=UW5LVIBG09SV tag=K2OQ9MX4CQNA type=del size=4066427 2024-06-04T15:59:27.722 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.722+0000 7f5e9aacc780 1 < completed delete operation key=B0HK5FJ2RGJE tag=QZ0KTQ3F01VK type=del 2024-06-04T15:59:27.724 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.723+0000 7f5e9aacc780 1 > prepared operation key=K01DAK0M4I4M tag=SOUX203G20IA type=write size=59896 2024-06-04T15:59:27.725 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.725+0000 7f5e9aacc780 1 < completed delete operation key=HD6SNICRCDLL tag=LQFWQXTAU60A type=del 2024-06-04T15:59:27.726 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.726+0000 7f5e9aacc780 1 > prepared operation key=Q2V1ICTBSCV1 tag=SFLZJOO7ND7M type=del size=3159356 2024-06-04T15:59:27.729 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.729+0000 7f5e9aacc780 1 < suggested update operation key=Q4OFQI0F5YLG tag=1UCLR3BHMION type=del size=155309 2024-06-04T15:59:27.731 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.730+0000 7f5e9aacc780 1 > prepared operation key=UTZHANL9ER2Q tag=8YJZZJ5VV6B0 type=del size=3390199 2024-06-04T15:59:27.732 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.732+0000 7f5e9aacc780 1 < completed part key=_multipart_FBV2MAG130M6.2~KRDOV9PGXND3.0 size=174584 2024-06-04T15:59:27.734 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.734+0000 7f5e9aacc780 1 < completed multipart upload key=FBV2MAG130M6 upload=KRDOV9PGXND3 tag=WLZI6SD0K6XA type=write size=1223160 2024-06-04T15:59:27.736 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.736+0000 7f5e9aacc780 1 > prepared operation key=B0HK5FJ2RGJE tag=QXYNIYWZ4E7O type=del size=2416806 2024-06-04T15:59:27.739 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.739+0000 7f5e9aacc780 1 < completed delete operation key=UW5LVIBG09SV tag=3V2TXFUTEG32 type=del 2024-06-04T15:59:27.741 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.740+0000 7f5e9aacc780 1 > prepared operation key=03ZNYG3WLMP4 tag=1IY9F7X6SXHW type=del size=1463447 2024-06-04T15:59:27.742 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.742+0000 7f5e9aacc780 1 < completed delete operation key=NHPH4LYPP0LL tag=I3C07PT01F5O type=del 2024-06-04T15:59:27.745 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.745+0000 7f5e9aacc780 1 > prepared part key=_multipart_FBV2MAG130M6.2~KBKODLVNRH0N.0 size=742993 2024-06-04T15:59:27.745 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.745+0000 7f5e9aacc780 1 > prepared multipart upload key=FBV2MAG130M6 upload=KBKODLVNRH0N tag=T6HY2C27B3ZQ type=write size=1791569 2024-06-04T15:59:27.746 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.746+0000 7f5e9aacc780 1 < completed write operation key=SUBHZJ7HUV3H tag=2JZWMQHP107Y type=write size=148240 2024-06-04T15:59:27.748 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.748+0000 7f5e9aacc780 1 > prepared operation key=03ZNYG3WLMP4 tag=V758DW1Q4DD0 type=del size=3480635 2024-06-04T15:59:27.749 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.749+0000 7f5e9aacc780 1 < canceled operation key=HD6SNICRCDLL tag=O644R9PRVCAW type=del size=3818277 2024-06-04T15:59:27.751 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.751+0000 7f5e9aacc780 1 > prepared operation key=QJA2JPATITNH tag=MT5YULPRWB56 type=write size=629281 2024-06-04T15:59:27.753 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.753+0000 7f5e9aacc780 1 < completed part key=_multipart_JL69PUHT6NNT.2~2I1P74ZG1DKK.0 size=1048576 2024-06-04T15:59:27.754 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.754+0000 7f5e9aacc780 1 < completed part key=_multipart_JL69PUHT6NNT.2~2I1P74ZG1DKK.1 size=719193 2024-06-04T15:59:27.757 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.756+0000 7f5e9aacc780 1 < completed multipart upload key=JL69PUHT6NNT upload=2I1P74ZG1DKK tag=XT39QWZRTV28 type=write size=2816345 2024-06-04T15:59:27.758 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.758+0000 7f5e9aacc780 1 > prepared operation key=B0HK5FJ2RGJE tag=WKVJI36WOTAL type=write size=35818 2024-06-04T15:59:27.760 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.760+0000 7f5e9aacc780 1 < suggested remove operation key=SUBHZJ7HUV3H tag=G7KP26JPNIFU type=del 2024-06-04T15:59:27.762 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.762+0000 7f5e9aacc780 1 > prepared operation key=GTRMEQJK675Z tag=IBBRXRO4RC72 type=del size=2916507 2024-06-04T15:59:27.764 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.763+0000 7f5e9aacc780 1 < completed delete operation key=7S9S3MIG7WIT tag=SKI2U61JM1RZ type=del 2024-06-04T15:59:27.766 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.766+0000 7f5e9aacc780 1 > prepared part key=_multipart_RP8K6QJUZAH1.2~YLPERF7QZDKO.0 size=1048576 2024-06-04T15:59:27.767 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.767+0000 7f5e9aacc780 1 > prepared part key=_multipart_RP8K6QJUZAH1.2~YLPERF7QZDKO.1 size=486978 2024-06-04T15:59:27.768 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.767+0000 7f5e9aacc780 1 > prepared multipart upload key=RP8K6QJUZAH1 upload=YLPERF7QZDKO tag=L6P2MOO79LPT type=write size=2584130 2024-06-04T15:59:27.769 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.769+0000 7f5e9aacc780 1 < completed delete operation key=GTRMEQJK675Z tag=35IM6D00FIHQ type=del 2024-06-04T15:59:27.772 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.771+0000 7f5e9aacc780 1 > prepared part key=_multipart_03ZNYG3WLMP4.2~WPSIIVBKZ17W.0 size=865653 2024-06-04T15:59:27.772 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.771+0000 7f5e9aacc780 1 > prepared multipart upload key=03ZNYG3WLMP4 upload=WPSIIVBKZ17W tag=6JDDB3HGDTK8 type=write size=1914229 2024-06-04T15:59:27.773 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.773+0000 7f5e9aacc780 1 < completed write operation key=AOCB36Y5Q7B0 tag=JINGMNM4HXIG type=write size=687039 2024-06-04T15:59:27.775 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.774+0000 7f5e9aacc780 1 > prepared operation key=XH0N984YVGKP tag=FFGE0FOUWZBU type=del size=212794 2024-06-04T15:59:27.775 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.775+0000 7f5e9aacc780 1 < canceled part key=_multipart_W1T4O3EAE7JN.2~FNRS3PM891K5.0 size=1048576 2024-06-04T15:59:27.776 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.776+0000 7f5e9aacc780 1 < completed part key=_multipart_W1T4O3EAE7JN.2~FNRS3PM891K5.1 size=1012021 2024-06-04T15:59:27.779 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.778+0000 7f5e9aacc780 1 < canceled multipart upload key=W1T4O3EAE7JN upload=FNRS3PM891K5 tag=6LQ1M5SICRX9 type=write size=3109173 2024-06-04T15:59:27.782 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.782+0000 7f5e9aacc780 1 > prepared part key=_multipart_GTRMEQJK675Z.2~OL19G2YKX9R0.0 size=1048576 2024-06-04T15:59:27.783 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.783+0000 7f5e9aacc780 1 > prepared part key=_multipart_GTRMEQJK675Z.2~OL19G2YKX9R0.1 size=1048576 2024-06-04T15:59:27.784 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.784+0000 7f5e9aacc780 1 > prepared part key=_multipart_GTRMEQJK675Z.2~OL19G2YKX9R0.2 size=526048 2024-06-04T15:59:27.784 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.784+0000 7f5e9aacc780 1 > prepared multipart upload key=GTRMEQJK675Z upload=OL19G2YKX9R0 tag=MXMJI7SXVQ7V type=write size=3671776 2024-06-04T15:59:27.786 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.786+0000 7f5e9aacc780 1 < completed part key=_multipart_NJ5U8JTT32QK.2~ZAL82H2NABMC.0 size=521277 2024-06-04T15:59:27.788 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.788+0000 7f5e9aacc780 1 < completed multipart upload key=NJ5U8JTT32QK upload=ZAL82H2NABMC tag=K1B4W2ZGSW16 type=write size=1569853 2024-06-04T15:59:27.790 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.790+0000 7f5e9aacc780 1 > prepared operation key=SUBHZJ7HUV3H tag=UKRYYX54SFKV type=write size=870147 2024-06-04T15:59:27.791 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.791+0000 7f5e9aacc780 1 < completed delete operation key=UW5LVIBG09SV tag=K2OQ9MX4CQNA type=del 2024-06-04T15:59:27.793 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.793+0000 7f5e9aacc780 1 > prepared operation key=W1T4O3EAE7JN tag=TCB6KXIDQRAR type=del size=3852465 2024-06-04T15:59:27.794 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.794+0000 7f5e9aacc780 1 < canceled operation key=K01DAK0M4I4M tag=SOUX203G20IA type=write size=59896 2024-06-04T15:59:27.796 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.796+0000 7f5e9aacc780 1 > prepared operation key=JL69PUHT6NNT tag=8F6BXXEYOLRE type=del size=1364417 2024-06-04T15:59:27.797 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.797+0000 7f5e9aacc780 1 < completed delete operation key=Q2V1ICTBSCV1 tag=SFLZJOO7ND7M type=del 2024-06-04T15:59:27.799 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.798+0000 7f5e9aacc780 1 > prepared operation key=9MPRI6LW3956 tag=TDR17BI0LTUC type=write size=941988 2024-06-04T15:59:27.802 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.801+0000 7f5e9aacc780 1 < suggested remove operation key=UTZHANL9ER2Q tag=8YJZZJ5VV6B0 type=del 2024-06-04T15:59:27.803 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.803+0000 7f5e9aacc780 1 > prepared operation key=NHPH4LYPP0LL tag=1U5X6BTQ9U74 type=del size=749384 2024-06-04T15:59:27.805 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.805+0000 7f5e9aacc780 1 < completed delete operation key=B0HK5FJ2RGJE tag=QXYNIYWZ4E7O type=del 2024-06-04T15:59:27.808 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.808+0000 7f5e9aacc780 1 > prepared part key=_multipart_TUGKW7F4V9NO.2~O6QQZLJ2YXE6.0 size=235941 2024-06-04T15:59:27.808 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.808+0000 7f5e9aacc780 1 > prepared multipart upload key=TUGKW7F4V9NO upload=O6QQZLJ2YXE6 tag=1L8MCXZ2JNRE type=write size=1284517 2024-06-04T15:59:27.811 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.810+0000 7f5e9aacc780 1 < suggested update operation key=03ZNYG3WLMP4 tag=1IY9F7X6SXHW type=del size=1463447 2024-06-04T15:59:27.813 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.813+0000 7f5e9aacc780 1 > prepared part key=_multipart_K01DAK0M4I4M.2~9U1E2YFMGRW8.0 size=1048576 2024-06-04T15:59:27.814 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.814+0000 7f5e9aacc780 1 > prepared part key=_multipart_K01DAK0M4I4M.2~9U1E2YFMGRW8.1 size=124836 2024-06-04T15:59:27.814 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.814+0000 7f5e9aacc780 1 > prepared multipart upload key=K01DAK0M4I4M upload=9U1E2YFMGRW8 tag=LG9AXU0CBQHR type=write size=2221988 2024-06-04T15:59:27.816 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.816+0000 7f5e9aacc780 1 < completed part key=_multipart_FBV2MAG130M6.2~KBKODLVNRH0N.0 size=742993 2024-06-04T15:59:27.818 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.818+0000 7f5e9aacc780 1 < completed multipart upload key=FBV2MAG130M6 upload=KBKODLVNRH0N tag=T6HY2C27B3ZQ type=write size=1791569 2024-06-04T15:59:27.821 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.821+0000 7f5e9aacc780 1 > prepared part key=_multipart_W1T4O3EAE7JN.2~1XD5JMMGH9YX.0 size=1048576 2024-06-04T15:59:27.822 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.822+0000 7f5e9aacc780 1 > prepared part key=_multipart_W1T4O3EAE7JN.2~1XD5JMMGH9YX.1 size=783374 2024-06-04T15:59:27.823 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.822+0000 7f5e9aacc780 1 > prepared multipart upload key=W1T4O3EAE7JN upload=1XD5JMMGH9YX tag=WDI0FW16T3Y2 type=write size=2880526 2024-06-04T15:59:27.824 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.824+0000 7f5e9aacc780 -1 < failed to complete operation key=03ZNYG3WLMP4 tag=V758DW1Q4DD0 type=del size=3480635: (22) Invalid argument 2024-06-04T15:59:27.826 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.825+0000 7f5e9aacc780 1 > prepared operation key=UW5LVIBG09SV tag=28MQCQG26DH1 type=del size=2726161 2024-06-04T15:59:27.827 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.827+0000 7f5e9aacc780 1 < completed write operation key=QJA2JPATITNH tag=MT5YULPRWB56 type=write size=629281 2024-06-04T15:59:27.833 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.833+0000 7f5e9aacc780 1 > prepared part key=_multipart_PNDPO2WUW7UX.2~L36ZZ086NM1A.0 size=444246 2024-06-04T15:59:27.833 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.833+0000 7f5e9aacc780 1 > prepared multipart upload key=PNDPO2WUW7UX upload=L36ZZ086NM1A tag=IO5CMNE84IGQ type=write size=1492822 2024-06-04T15:59:27.836 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.836+0000 7f5e9aacc780 1 < suggested remove operation key=B0HK5FJ2RGJE tag=WKVJI36WOTAL type=write 2024-06-04T15:59:27.838 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.838+0000 7f5e9aacc780 1 > prepared operation key=JL69PUHT6NNT tag=X63SHLE5Z5DO type=write size=54315 2024-06-04T15:59:27.841 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.841+0000 7f5e9aacc780 1 < suggested remove operation key=GTRMEQJK675Z tag=IBBRXRO4RC72 type=del 2024-06-04T15:59:27.845 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.844+0000 7f5e9aacc780 1 > prepared part key=_multipart_GTRMEQJK675Z.2~Y09RDERS62S1.0 size=325501 2024-06-04T15:59:27.845 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.844+0000 7f5e9aacc780 1 > prepared multipart upload key=GTRMEQJK675Z upload=Y09RDERS62S1 tag=AE4GXMXGCORX type=write size=1374077 2024-06-04T15:59:27.846 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.846+0000 7f5e9aacc780 1 < completed part key=_multipart_RP8K6QJUZAH1.2~YLPERF7QZDKO.0 size=1048576 2024-06-04T15:59:27.847 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.847+0000 7f5e9aacc780 1 < completed part key=_multipart_RP8K6QJUZAH1.2~YLPERF7QZDKO.1 size=486978 2024-06-04T15:59:27.850 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.850+0000 7f5e9aacc780 1 < completed multipart upload key=RP8K6QJUZAH1 upload=YLPERF7QZDKO tag=L6P2MOO79LPT type=write size=2584130 2024-06-04T15:59:27.853 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.852+0000 7f5e9aacc780 1 > prepared part key=_multipart_PASGIP872OVX.2~SLNNIB7GKPRW.0 size=1048576 2024-06-04T15:59:27.854 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.854+0000 7f5e9aacc780 1 > prepared part key=_multipart_PASGIP872OVX.2~SLNNIB7GKPRW.1 size=915630 2024-06-04T15:59:27.854 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.854+0000 7f5e9aacc780 1 > prepared multipart upload key=PASGIP872OVX upload=SLNNIB7GKPRW tag=YBFI1398EATQ type=write size=3012782 2024-06-04T15:59:27.856 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.855+0000 7f5e9aacc780 1 < completed part key=_multipart_03ZNYG3WLMP4.2~WPSIIVBKZ17W.0 size=865653 2024-06-04T15:59:27.858 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.858+0000 7f5e9aacc780 1 < completed multipart upload key=03ZNYG3WLMP4 upload=WPSIIVBKZ17W tag=6JDDB3HGDTK8 type=write size=1914229 2024-06-04T15:59:27.861 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.861+0000 7f5e9aacc780 1 > prepared part key=_multipart_DY9JWHWNAUO1.2~CAB7YNZSLH38.0 size=1048576 2024-06-04T15:59:27.862 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.862+0000 7f5e9aacc780 1 > prepared part key=_multipart_DY9JWHWNAUO1.2~CAB7YNZSLH38.1 size=1048576 2024-06-04T15:59:27.863 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.863+0000 7f5e9aacc780 1 > prepared part key=_multipart_DY9JWHWNAUO1.2~CAB7YNZSLH38.2 size=89010 2024-06-04T15:59:27.863 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.863+0000 7f5e9aacc780 1 > prepared multipart upload key=DY9JWHWNAUO1 upload=CAB7YNZSLH38 tag=A1QUBU0TPE74 type=write size=3234738 2024-06-04T15:59:27.865 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.864+0000 7f5e9aacc780 1 < completed delete operation key=XH0N984YVGKP tag=FFGE0FOUWZBU type=del 2024-06-04T15:59:27.867 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.867+0000 7f5e9aacc780 1 > prepared part key=_multipart_PCLJXQHJ4HTY.2~OPGRTQ5C0STF.0 size=825284 2024-06-04T15:59:27.867 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.867+0000 7f5e9aacc780 1 > prepared multipart upload key=PCLJXQHJ4HTY upload=OPGRTQ5C0STF tag=VH7YQ8V3PIYQ type=write size=1873860 2024-06-04T15:59:27.868 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.867+0000 7f5e9aacc780 1 < canceled part key=_multipart_GTRMEQJK675Z.2~OL19G2YKX9R0.0 size=1048576 2024-06-04T15:59:27.869 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.869+0000 7f5e9aacc780 1 < completed part key=_multipart_GTRMEQJK675Z.2~OL19G2YKX9R0.1 size=1048576 2024-06-04T15:59:27.870 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.870+0000 7f5e9aacc780 1 < completed part key=_multipart_GTRMEQJK675Z.2~OL19G2YKX9R0.2 size=526048 2024-06-04T15:59:27.872 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.872+0000 7f5e9aacc780 1 < canceled multipart upload key=GTRMEQJK675Z upload=OL19G2YKX9R0 tag=MXMJI7SXVQ7V type=write size=3671776 2024-06-04T15:59:27.874 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.873+0000 7f5e9aacc780 1 > prepared operation key=W1T4O3EAE7JN tag=6ODLK3TWO2YI type=del size=2373876 2024-06-04T15:59:27.875 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.875+0000 7f5e9aacc780 1 < completed write operation key=SUBHZJ7HUV3H tag=UKRYYX54SFKV type=write size=870147 2024-06-04T15:59:27.876 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.876+0000 7f5e9aacc780 1 > prepared operation key=UTZHANL9ER2Q tag=VQEI71RS1RQC type=del size=3368667 2024-06-04T15:59:27.879 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.879+0000 7f5e9aacc780 1 < suggested remove operation key=W1T4O3EAE7JN tag=TCB6KXIDQRAR type=del 2024-06-04T15:59:27.880 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.880+0000 7f5e9aacc780 1 > prepared operation key=JL69PUHT6NNT tag=NE66MPNMU7NJ type=write size=757294 2024-06-04T15:59:27.882 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.881+0000 7f5e9aacc780 1 < completed delete operation key=JL69PUHT6NNT tag=8F6BXXEYOLRE type=del 2024-06-04T15:59:27.884 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.884+0000 7f5e9aacc780 1 > prepared part key=_multipart_QJA2JPATITNH.2~TOTC2YIQCAFN.0 size=1048576 2024-06-04T15:59:27.885 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.885+0000 7f5e9aacc780 1 > prepared part key=_multipart_QJA2JPATITNH.2~TOTC2YIQCAFN.1 size=354038 2024-06-04T15:59:27.885 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.885+0000 7f5e9aacc780 1 > prepared multipart upload key=QJA2JPATITNH upload=TOTC2YIQCAFN tag=6WMO6IW6POK8 type=write size=2451190 2024-06-04T15:59:27.887 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.886+0000 7f5e9aacc780 1 < completed write operation key=9MPRI6LW3956 tag=TDR17BI0LTUC type=write size=941988 2024-06-04T15:59:27.889 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.889+0000 7f5e9aacc780 1 > prepared part key=_multipart_9MPRI6LW3956.2~HHVI5SOFYS3Z.0 size=572263 2024-06-04T15:59:27.889 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.889+0000 7f5e9aacc780 1 > prepared multipart upload key=9MPRI6LW3956 upload=HHVI5SOFYS3Z tag=1FWFKFOOSC6P type=write size=1620839 2024-06-04T15:59:27.892 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.892+0000 7f5e9aacc780 1 < suggested update operation key=NHPH4LYPP0LL tag=1U5X6BTQ9U74 type=del size=749384 2024-06-04T15:59:27.895 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.894+0000 7f5e9aacc780 1 > prepared part key=_multipart_2BT2AXKB1RTA.2~1QQ5Z7GC6NO1.0 size=689220 2024-06-04T15:59:27.895 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.894+0000 7f5e9aacc780 1 > prepared multipart upload key=2BT2AXKB1RTA upload=1QQ5Z7GC6NO1 tag=N3QUUOOWOMRT type=write size=1737796 2024-06-04T15:59:27.896 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.896+0000 7f5e9aacc780 1 < completed part key=_multipart_TUGKW7F4V9NO.2~O6QQZLJ2YXE6.0 size=235941 2024-06-04T15:59:27.899 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.899+0000 7f5e9aacc780 1 < completed multipart upload key=TUGKW7F4V9NO upload=O6QQZLJ2YXE6 tag=1L8MCXZ2JNRE type=write size=1284517 2024-06-04T15:59:27.901 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.901+0000 7f5e9aacc780 1 > prepared part key=_multipart_QJA2JPATITNH.2~0SB5WYZ2APGY.0 size=1048576 2024-06-04T15:59:27.903 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.902+0000 7f5e9aacc780 1 > prepared part key=_multipart_QJA2JPATITNH.2~0SB5WYZ2APGY.1 size=1048576 2024-06-04T15:59:27.904 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.903+0000 7f5e9aacc780 1 > prepared part key=_multipart_QJA2JPATITNH.2~0SB5WYZ2APGY.2 size=361273 2024-06-04T15:59:27.904 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.903+0000 7f5e9aacc780 1 > prepared multipart upload key=QJA2JPATITNH upload=0SB5WYZ2APGY tag=2DFX64565M35 type=write size=3507001 2024-06-04T15:59:27.905 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.905+0000 7f5e9aacc780 1 < completed part key=_multipart_K01DAK0M4I4M.2~9U1E2YFMGRW8.0 size=1048576 2024-06-04T15:59:27.908 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.908+0000 7f5e9aacc780 1 < completed part key=_multipart_K01DAK0M4I4M.2~9U1E2YFMGRW8.1 size=124836 2024-06-04T15:59:27.910 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.910+0000 7f5e9aacc780 1 < completed multipart upload key=K01DAK0M4I4M upload=9U1E2YFMGRW8 tag=LG9AXU0CBQHR type=write size=2221988 2024-06-04T15:59:27.913 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.913+0000 7f5e9aacc780 1 > prepared part key=_multipart_XH0N984YVGKP.2~APBR49K3I3L1.0 size=1048576 2024-06-04T15:59:27.914 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.914+0000 7f5e9aacc780 1 > prepared part key=_multipart_XH0N984YVGKP.2~APBR49K3I3L1.1 size=1048576 2024-06-04T15:59:27.915 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.915+0000 7f5e9aacc780 1 > prepared part key=_multipart_XH0N984YVGKP.2~APBR49K3I3L1.2 size=804085 2024-06-04T15:59:27.916 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.915+0000 7f5e9aacc780 1 > prepared multipart upload key=XH0N984YVGKP upload=APBR49K3I3L1 tag=B0Z7S97DZWJL type=write size=3949813 2024-06-04T15:59:27.917 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.917+0000 7f5e9aacc780 1 < completed part key=_multipart_W1T4O3EAE7JN.2~1XD5JMMGH9YX.0 size=1048576 2024-06-04T15:59:27.918 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.918+0000 7f5e9aacc780 1 < completed part key=_multipart_W1T4O3EAE7JN.2~1XD5JMMGH9YX.1 size=783374 2024-06-04T15:59:27.921 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.921+0000 7f5e9aacc780 1 < completed multipart upload key=W1T4O3EAE7JN upload=1XD5JMMGH9YX tag=WDI0FW16T3Y2 type=write size=2880526 2024-06-04T15:59:27.923 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.922+0000 7f5e9aacc780 1 > prepared operation key=Q2V1ICTBSCV1 tag=JFOYSZV5B0YX type=write size=467704 2024-06-04T15:59:27.924 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.924+0000 7f5e9aacc780 1 < completed delete operation key=UW5LVIBG09SV tag=28MQCQG26DH1 type=del 2024-06-04T15:59:27.926 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.926+0000 7f5e9aacc780 1 > prepared operation key=GCPC9OJH7KWU tag=Q3JS52WF0TPG type=del size=469222 2024-06-04T15:59:27.927 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.927+0000 7f5e9aacc780 1 < completed part key=_multipart_PNDPO2WUW7UX.2~L36ZZ086NM1A.0 size=444246 2024-06-04T15:59:27.930 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.930+0000 7f5e9aacc780 1 < completed multipart upload key=PNDPO2WUW7UX upload=L36ZZ086NM1A tag=IO5CMNE84IGQ type=write size=1492822 2024-06-04T15:59:27.933 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.933+0000 7f5e9aacc780 1 > prepared part key=_multipart_PNDPO2WUW7UX.2~34V4KKXAEVA5.0 size=1048576 2024-06-04T15:59:27.934 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.933+0000 7f5e9aacc780 1 > prepared part key=_multipart_PNDPO2WUW7UX.2~34V4KKXAEVA5.1 size=1048576 2024-06-04T15:59:27.935 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.935+0000 7f5e9aacc780 1 > prepared part key=_multipart_PNDPO2WUW7UX.2~34V4KKXAEVA5.2 size=631228 2024-06-04T15:59:27.935 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.935+0000 7f5e9aacc780 1 > prepared multipart upload key=PNDPO2WUW7UX upload=34V4KKXAEVA5 tag=IBR138A6OHAZ type=write size=3776956 2024-06-04T15:59:27.937 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.937+0000 7f5e9aacc780 1 < canceled operation key=JL69PUHT6NNT tag=X63SHLE5Z5DO type=write size=54315 2024-06-04T15:59:27.940 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.939+0000 7f5e9aacc780 1 > prepared part key=_multipart_QJA2JPATITNH.2~92AVSR72VYSP.0 size=811386 2024-06-04T15:59:27.940 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.939+0000 7f5e9aacc780 1 > prepared multipart upload key=QJA2JPATITNH upload=92AVSR72VYSP tag=GS5RRCHAA4X3 type=write size=1859962 2024-06-04T15:59:27.941 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.941+0000 7f5e9aacc780 1 < completed part key=_multipart_GTRMEQJK675Z.2~Y09RDERS62S1.0 size=325501 2024-06-04T15:59:27.944 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.944+0000 7f5e9aacc780 1 < completed multipart upload key=GTRMEQJK675Z upload=Y09RDERS62S1 tag=AE4GXMXGCORX type=write size=1374077 2024-06-04T15:59:27.945 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.945+0000 7f5e9aacc780 1 > prepared operation key=Q4OFQI0F5YLG tag=FWWGH4QA5EUJ type=del size=2158587 2024-06-04T15:59:27.947 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.947+0000 7f5e9aacc780 1 < completed part key=_multipart_PASGIP872OVX.2~SLNNIB7GKPRW.0 size=1048576 2024-06-04T15:59:27.948 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.948+0000 7f5e9aacc780 1 < completed part key=_multipart_PASGIP872OVX.2~SLNNIB7GKPRW.1 size=915630 2024-06-04T15:59:27.951 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.950+0000 7f5e9aacc780 1 < completed multipart upload key=PASGIP872OVX upload=SLNNIB7GKPRW tag=YBFI1398EATQ type=write size=3012782 2024-06-04T15:59:27.952 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.952+0000 7f5e9aacc780 1 > prepared operation key=UW5LVIBG09SV tag=RKYFJ35RC1DX type=del size=1779509 2024-06-04T15:59:27.954 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.954+0000 7f5e9aacc780 1 < completed part key=_multipart_DY9JWHWNAUO1.2~CAB7YNZSLH38.0 size=1048576 2024-06-04T15:59:27.955 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.955+0000 7f5e9aacc780 1 < completed part key=_multipart_DY9JWHWNAUO1.2~CAB7YNZSLH38.1 size=1048576 2024-06-04T15:59:27.956 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.956+0000 7f5e9aacc780 1 < completed part key=_multipart_DY9JWHWNAUO1.2~CAB7YNZSLH38.2 size=89010 2024-06-04T15:59:27.959 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.959+0000 7f5e9aacc780 1 < completed multipart upload key=DY9JWHWNAUO1 upload=CAB7YNZSLH38 tag=A1QUBU0TPE74 type=write size=3234738 2024-06-04T15:59:27.960 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.960+0000 7f5e9aacc780 1 > prepared operation key=NJ5U8JTT32QK tag=GLPJPJW08YI0 type=del size=13746 2024-06-04T15:59:27.962 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.962+0000 7f5e9aacc780 1 < completed part key=_multipart_PCLJXQHJ4HTY.2~OPGRTQ5C0STF.0 size=825284 2024-06-04T15:59:27.966 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.965+0000 7f5e9aacc780 1 < completed multipart upload key=PCLJXQHJ4HTY upload=OPGRTQ5C0STF tag=VH7YQ8V3PIYQ type=write size=1873860 2024-06-04T15:59:27.968 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.968+0000 7f5e9aacc780 1 > prepared part key=_multipart_DY9JWHWNAUO1.2~VK698NNMLTFB.0 size=1048576 2024-06-04T15:59:27.970 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.969+0000 7f5e9aacc780 1 > prepared part key=_multipart_DY9JWHWNAUO1.2~VK698NNMLTFB.1 size=207946 2024-06-04T15:59:27.970 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.969+0000 7f5e9aacc780 1 > prepared multipart upload key=DY9JWHWNAUO1 upload=VK698NNMLTFB tag=XU18YAVWCR2J type=write size=2305098 2024-06-04T15:59:27.973 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.973+0000 7f5e9aacc780 -1 < failed to complete operation key=W1T4O3EAE7JN tag=6ODLK3TWO2YI type=del size=2373876: (22) Invalid argument 2024-06-04T15:59:27.974 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.974+0000 7f5e9aacc780 1 > prepared operation key=RP8K6QJUZAH1 tag=C88U7C9QIIO9 type=write size=300598 2024-06-04T15:59:27.978 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.978+0000 7f5e9aacc780 1 < suggested update operation key=UTZHANL9ER2Q tag=VQEI71RS1RQC type=del size=3368667 2024-06-04T15:59:27.981 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.981+0000 7f5e9aacc780 1 > prepared part key=_multipart_UTZHANL9ER2Q.2~TI8ISN0UQ37G.0 size=1048576 2024-06-04T15:59:27.982 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.982+0000 7f5e9aacc780 1 > prepared part key=_multipart_UTZHANL9ER2Q.2~TI8ISN0UQ37G.1 size=1048576 2024-06-04T15:59:27.983 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.983+0000 7f5e9aacc780 1 > prepared part key=_multipart_UTZHANL9ER2Q.2~TI8ISN0UQ37G.2 size=345001 2024-06-04T15:59:27.983 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.983+0000 7f5e9aacc780 1 > prepared multipart upload key=UTZHANL9ER2Q upload=TI8ISN0UQ37G tag=J7ZXCIYB3IWN type=write size=3490729 2024-06-04T15:59:27.985 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.985+0000 7f5e9aacc780 1 < completed write operation key=JL69PUHT6NNT tag=NE66MPNMU7NJ type=write size=757294 2024-06-04T15:59:27.988 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.987+0000 7f5e9aacc780 1 > prepared part key=_multipart_B0HK5FJ2RGJE.2~ZSBGC4Q6LJA8.0 size=616244 2024-06-04T15:59:27.988 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.987+0000 7f5e9aacc780 1 > prepared multipart upload key=B0HK5FJ2RGJE upload=ZSBGC4Q6LJA8 tag=H0LZ6NBCOUTS type=write size=1664820 2024-06-04T15:59:27.988 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.988+0000 7f5e9aacc780 1 < canceled part key=_multipart_QJA2JPATITNH.2~TOTC2YIQCAFN.0 size=1048576 2024-06-04T15:59:27.989 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.989+0000 7f5e9aacc780 1 < completed part key=_multipart_QJA2JPATITNH.2~TOTC2YIQCAFN.1 size=354038 2024-06-04T15:59:27.992 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.992+0000 7f5e9aacc780 1 < canceled multipart upload key=QJA2JPATITNH upload=TOTC2YIQCAFN tag=6WMO6IW6POK8 type=write size=2451190 2024-06-04T15:59:27.994 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.993+0000 7f5e9aacc780 1 > prepared operation key=9MPRI6LW3956 tag=DJN8N03MYL36 type=del size=2068950 2024-06-04T15:59:27.995 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.995+0000 7f5e9aacc780 1 < completed part key=_multipart_9MPRI6LW3956.2~HHVI5SOFYS3Z.0 size=572263 2024-06-04T15:59:27.998 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:27.998+0000 7f5e9aacc780 1 < completed multipart upload key=9MPRI6LW3956 upload=HHVI5SOFYS3Z tag=1FWFKFOOSC6P type=write size=1620839 2024-06-04T15:59:28.000 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.000+0000 7f5e9aacc780 1 > prepared operation key=JL69PUHT6NNT tag=3SHZ591B5L41 type=write size=346941 2024-06-04T15:59:28.002 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.002+0000 7f5e9aacc780 1 < completed part key=_multipart_2BT2AXKB1RTA.2~1QQ5Z7GC6NO1.0 size=689220 2024-06-04T15:59:28.004 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.004+0000 7f5e9aacc780 1 < completed multipart upload key=2BT2AXKB1RTA upload=1QQ5Z7GC6NO1 tag=N3QUUOOWOMRT type=write size=1737796 2024-06-04T15:59:28.005 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.005+0000 7f5e9aacc780 1 > prepared operation key=NJ5U8JTT32QK tag=JM2UTYS6Q9VV type=del size=3272270 2024-06-04T15:59:28.007 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.007+0000 7f5e9aacc780 1 < completed part key=_multipart_QJA2JPATITNH.2~0SB5WYZ2APGY.0 size=1048576 2024-06-04T15:59:28.008 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.008+0000 7f5e9aacc780 1 < completed part key=_multipart_QJA2JPATITNH.2~0SB5WYZ2APGY.1 size=1048576 2024-06-04T15:59:28.009 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.009+0000 7f5e9aacc780 1 < completed part key=_multipart_QJA2JPATITNH.2~0SB5WYZ2APGY.2 size=361273 2024-06-04T15:59:28.012 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.011+0000 7f5e9aacc780 1 < completed multipart upload key=QJA2JPATITNH upload=0SB5WYZ2APGY tag=2DFX64565M35 type=write size=3507001 2024-06-04T15:59:28.013 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.013+0000 7f5e9aacc780 1 > prepared operation key=NHPH4LYPP0LL tag=EN299WRVJIIZ type=del size=1502155 2024-06-04T15:59:28.014 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.014+0000 7f5e9aacc780 1 < completed part key=_multipart_XH0N984YVGKP.2~APBR49K3I3L1.0 size=1048576 2024-06-04T15:59:28.016 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.015+0000 7f5e9aacc780 1 < completed part key=_multipart_XH0N984YVGKP.2~APBR49K3I3L1.1 size=1048576 2024-06-04T15:59:28.016 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.016+0000 7f5e9aacc780 1 < completed part key=_multipart_XH0N984YVGKP.2~APBR49K3I3L1.2 size=804085 2024-06-04T15:59:28.019 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.019+0000 7f5e9aacc780 1 < completed multipart upload key=XH0N984YVGKP upload=APBR49K3I3L1 tag=B0Z7S97DZWJL type=write size=3949813 2024-06-04T15:59:28.020 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.020+0000 7f5e9aacc780 1 > prepared operation key=2BT2AXKB1RTA tag=N6XNIZP1SJUM type=del size=869557 2024-06-04T15:59:28.022 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.021+0000 7f5e9aacc780 1 < completed write operation key=Q2V1ICTBSCV1 tag=JFOYSZV5B0YX type=write size=467704 2024-06-04T15:59:28.023 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.023+0000 7f5e9aacc780 1 > prepared operation key=AOCB36Y5Q7B0 tag=UOJ7ADJ2J6Q4 type=write size=312942 2024-06-04T15:59:28.025 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.025+0000 7f5e9aacc780 1 < completed delete operation key=GCPC9OJH7KWU tag=Q3JS52WF0TPG type=del 2024-06-04T15:59:28.027 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.027+0000 7f5e9aacc780 1 > prepared part key=_multipart_QJA2JPATITNH.2~H55ANQOOJCMB.0 size=1048576 2024-06-04T15:59:28.028 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.028+0000 7f5e9aacc780 1 > prepared part key=_multipart_QJA2JPATITNH.2~H55ANQOOJCMB.1 size=1048576 2024-06-04T15:59:28.030 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.029+0000 7f5e9aacc780 1 > prepared part key=_multipart_QJA2JPATITNH.2~H55ANQOOJCMB.2 size=639971 2024-06-04T15:59:28.030 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.029+0000 7f5e9aacc780 1 > prepared multipart upload key=QJA2JPATITNH upload=H55ANQOOJCMB tag=1K3GXFKTDH4U type=write size=3785699 2024-06-04T15:59:28.030 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.029+0000 7f5e9aacc780 1 < canceled part key=_multipart_PNDPO2WUW7UX.2~34V4KKXAEVA5.0 size=1048576 2024-06-04T15:59:28.031 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.031+0000 7f5e9aacc780 1 < completed part key=_multipart_PNDPO2WUW7UX.2~34V4KKXAEVA5.1 size=1048576 2024-06-04T15:59:28.032 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.032+0000 7f5e9aacc780 1 < completed part key=_multipart_PNDPO2WUW7UX.2~34V4KKXAEVA5.2 size=631228 2024-06-04T15:59:28.034 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.035+0000 7f5e9aacc780 1 < canceled multipart upload key=PNDPO2WUW7UX upload=34V4KKXAEVA5 tag=IBR138A6OHAZ type=write size=3776956 2024-06-04T15:59:28.037 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.037+0000 7f5e9aacc780 1 > prepared part key=_multipart_A8O0S3S45RGM.2~SIMZM0EONMYW.0 size=1048576 2024-06-04T15:59:28.039 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.038+0000 7f5e9aacc780 1 > prepared part key=_multipart_A8O0S3S45RGM.2~SIMZM0EONMYW.1 size=76561 2024-06-04T15:59:28.039 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.038+0000 7f5e9aacc780 1 > prepared multipart upload key=A8O0S3S45RGM upload=SIMZM0EONMYW tag=U51BFW7878O9 type=write size=2173713 2024-06-04T15:59:28.040 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.040+0000 7f5e9aacc780 1 < completed part key=_multipart_QJA2JPATITNH.2~92AVSR72VYSP.0 size=811386 2024-06-04T15:59:28.043 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.043+0000 7f5e9aacc780 1 < completed multipart upload key=QJA2JPATITNH upload=92AVSR72VYSP tag=GS5RRCHAA4X3 type=write size=1859962 2024-06-04T15:59:28.045 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.044+0000 7f5e9aacc780 1 > prepared operation key=UW5LVIBG09SV tag=0TET6HZH4LBB type=del size=1343016 2024-06-04T15:59:28.046 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.046+0000 7f5e9aacc780 1 < canceled operation key=Q4OFQI0F5YLG tag=FWWGH4QA5EUJ type=del size=2158587 2024-06-04T15:59:28.048 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.048+0000 7f5e9aacc780 1 > prepared operation key=PNDPO2WUW7UX tag=LE2NVEE3DAR6 type=del size=2487823 2024-06-04T15:59:28.049 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.049+0000 7f5e9aacc780 1 < completed delete operation key=UW5LVIBG09SV tag=RKYFJ35RC1DX type=del 2024-06-04T15:59:28.052 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.052+0000 7f5e9aacc780 1 > prepared part key=_multipart_B0HK5FJ2RGJE.2~71F9OHAN8R3Z.0 size=576532 2024-06-04T15:59:28.052 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.052+0000 7f5e9aacc780 1 > prepared multipart upload key=B0HK5FJ2RGJE upload=71F9OHAN8R3Z tag=UWH4XPPXOY8H type=write size=1625108 2024-06-04T15:59:28.055 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.055+0000 7f5e9aacc780 1 < suggested remove operation key=NJ5U8JTT32QK tag=GLPJPJW08YI0 type=del 2024-06-04T15:59:28.058 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.057+0000 7f5e9aacc780 1 > prepared part key=_multipart_4W5HB9WQQHR6.2~57GINV4072JM.0 size=1038534 2024-06-04T15:59:28.058 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.057+0000 7f5e9aacc780 1 > prepared multipart upload key=4W5HB9WQQHR6 upload=57GINV4072JM tag=MXFT7F3RPARY type=write size=2087110 2024-06-04T15:59:28.059 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.059+0000 7f5e9aacc780 1 < completed part key=_multipart_DY9JWHWNAUO1.2~VK698NNMLTFB.0 size=1048576 2024-06-04T15:59:28.060 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.060+0000 7f5e9aacc780 1 < completed part key=_multipart_DY9JWHWNAUO1.2~VK698NNMLTFB.1 size=207946 2024-06-04T15:59:28.063 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.062+0000 7f5e9aacc780 1 < completed multipart upload key=DY9JWHWNAUO1 upload=VK698NNMLTFB tag=XU18YAVWCR2J type=write size=2305098 2024-06-04T15:59:28.064 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.064+0000 7f5e9aacc780 1 > prepared operation key=7S9S3MIG7WIT tag=RGX9VRDYCYVN type=del size=1563195 2024-06-04T15:59:28.066 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.065+0000 7f5e9aacc780 1 < completed write operation key=RP8K6QJUZAH1 tag=C88U7C9QIIO9 type=write size=300598 2024-06-04T15:59:28.068 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.068+0000 7f5e9aacc780 1 > prepared part key=_multipart_K01DAK0M4I4M.2~1HWIQPFRGRFR.0 size=282446 2024-06-04T15:59:28.068 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.068+0000 7f5e9aacc780 1 > prepared multipart upload key=K01DAK0M4I4M upload=1HWIQPFRGRFR tag=VC6Z1RCX10EY type=write size=1331022 2024-06-04T15:59:28.069 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.069+0000 7f5e9aacc780 1 < completed part key=_multipart_UTZHANL9ER2Q.2~TI8ISN0UQ37G.0 size=1048576 2024-06-04T15:59:28.070 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.069+0000 7f5e9aacc780 1 < canceled part key=_multipart_UTZHANL9ER2Q.2~TI8ISN0UQ37G.1 size=1048576 2024-06-04T15:59:28.071 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.070+0000 7f5e9aacc780 1 < completed part key=_multipart_UTZHANL9ER2Q.2~TI8ISN0UQ37G.2 size=345001 2024-06-04T15:59:28.073 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.073+0000 7f5e9aacc780 1 < canceled multipart upload key=UTZHANL9ER2Q upload=TI8ISN0UQ37G tag=J7ZXCIYB3IWN type=write size=3490729 2024-06-04T15:59:28.076 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.076+0000 7f5e9aacc780 1 > prepared part key=_multipart_A8O0S3S45RGM.2~ZMX16BC285PO.0 size=1048576 2024-06-04T15:59:28.077 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.077+0000 7f5e9aacc780 1 > prepared part key=_multipart_A8O0S3S45RGM.2~ZMX16BC285PO.1 size=1048576 2024-06-04T15:59:28.078 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.078+0000 7f5e9aacc780 1 > prepared part key=_multipart_A8O0S3S45RGM.2~ZMX16BC285PO.2 size=366950 2024-06-04T15:59:28.078 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.078+0000 7f5e9aacc780 1 > prepared multipart upload key=A8O0S3S45RGM upload=ZMX16BC285PO tag=U3K3UCLDY3H5 type=write size=3512678 2024-06-04T15:59:28.079 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.079+0000 7f5e9aacc780 1 < completed part key=_multipart_B0HK5FJ2RGJE.2~ZSBGC4Q6LJA8.0 size=616244 2024-06-04T15:59:28.082 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.082+0000 7f5e9aacc780 1 < completed multipart upload key=B0HK5FJ2RGJE upload=ZSBGC4Q6LJA8 tag=H0LZ6NBCOUTS type=write size=1664820 2024-06-04T15:59:28.084 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.084+0000 7f5e9aacc780 1 > prepared part key=_multipart_9MPRI6LW3956.2~BGFZUT9RS1SI.0 size=1048576 2024-06-04T15:59:28.085 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.085+0000 7f5e9aacc780 1 > prepared part key=_multipart_9MPRI6LW3956.2~BGFZUT9RS1SI.1 size=1048576 2024-06-04T15:59:28.086 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.086+0000 7f5e9aacc780 1 > prepared part key=_multipart_9MPRI6LW3956.2~BGFZUT9RS1SI.2 size=408314 2024-06-04T15:59:28.087 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.086+0000 7f5e9aacc780 1 > prepared multipart upload key=9MPRI6LW3956 upload=BGFZUT9RS1SI tag=DSPZAMHE8YML type=write size=3554042 2024-06-04T15:59:28.089 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.088+0000 7f5e9aacc780 1 < completed delete operation key=9MPRI6LW3956 tag=DJN8N03MYL36 type=del 2024-06-04T15:59:28.090 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.090+0000 7f5e9aacc780 1 > prepared part key=_multipart_HD6SNICRCDLL.2~PZDSVKGGNPEG.0 size=1048576 2024-06-04T15:59:28.091 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.092+0000 7f5e9aacc780 1 > prepared part key=_multipart_HD6SNICRCDLL.2~PZDSVKGGNPEG.1 size=1048576 2024-06-04T15:59:28.093 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.092+0000 7f5e9aacc780 1 > prepared part key=_multipart_HD6SNICRCDLL.2~PZDSVKGGNPEG.2 size=676247 2024-06-04T15:59:28.093 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.092+0000 7f5e9aacc780 1 > prepared multipart upload key=HD6SNICRCDLL upload=PZDSVKGGNPEG tag=ZR45OV91BGM6 type=write size=3821975 2024-06-04T15:59:28.096 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.096+0000 7f5e9aacc780 1 < suggested update operation key=JL69PUHT6NNT tag=3SHZ591B5L41 type=write size=346941 2024-06-04T15:59:28.099 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.099+0000 7f5e9aacc780 1 > prepared part key=_multipart_PCLJXQHJ4HTY.2~LIUVTPWN4FZN.0 size=962107 2024-06-04T15:59:28.099 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.099+0000 7f5e9aacc780 1 > prepared multipart upload key=PCLJXQHJ4HTY upload=LIUVTPWN4FZN tag=X0VNUTBHPWCI type=write size=2010683 2024-06-04T15:59:28.100 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.100+0000 7f5e9aacc780 -1 < no bi entry to suggest for operation key=NJ5U8JTT32QK tag=JM2UTYS6Q9VV type=del size=3272270: (2) No such file or directory 2024-06-04T15:59:28.102 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.101+0000 7f5e9aacc780 1 > prepared operation key=TUGKW7F4V9NO tag=GPFFTNJKRUM1 type=del size=3447620 2024-06-04T15:59:28.104 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.104+0000 7f5e9aacc780 1 < completed delete operation key=NHPH4LYPP0LL tag=EN299WRVJIIZ type=del 2024-06-04T15:59:28.106 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.106+0000 7f5e9aacc780 1 > prepared part key=_multipart_TUGKW7F4V9NO.2~YA7TMZO9QCO2.0 size=1011838 2024-06-04T15:59:28.106 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.106+0000 7f5e9aacc780 1 > prepared multipart upload key=TUGKW7F4V9NO upload=YA7TMZO9QCO2 tag=1YI542O21A1M type=write size=2060414 2024-06-04T15:59:28.109 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.108+0000 7f5e9aacc780 1 < suggested update operation key=2BT2AXKB1RTA tag=N6XNIZP1SJUM type=del size=869557 2024-06-04T15:59:28.112 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.112+0000 7f5e9aacc780 1 > prepared part key=_multipart_K01DAK0M4I4M.2~TQHW5G285I20.0 size=1048576 2024-06-04T15:59:28.114 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.113+0000 7f5e9aacc780 1 > prepared part key=_multipart_K01DAK0M4I4M.2~TQHW5G285I20.1 size=638754 2024-06-04T15:59:28.114 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.113+0000 7f5e9aacc780 1 > prepared multipart upload key=K01DAK0M4I4M upload=TQHW5G285I20 tag=XN3TORABPYER type=write size=2735906 2024-06-04T15:59:28.115 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.115+0000 7f5e9aacc780 1 < completed write operation key=AOCB36Y5Q7B0 tag=UOJ7ADJ2J6Q4 type=write size=312942 2024-06-04T15:59:28.118 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.117+0000 7f5e9aacc780 1 > prepared part key=_multipart_7S9S3MIG7WIT.2~17AE1S7IKMNB.0 size=69428 2024-06-04T15:59:28.118 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.118+0000 7f5e9aacc780 1 > prepared multipart upload key=7S9S3MIG7WIT upload=17AE1S7IKMNB tag=RNU5DDCYR6CP type=write size=1118004 2024-06-04T15:59:28.119 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.119+0000 7f5e9aacc780 1 < completed part key=_multipart_QJA2JPATITNH.2~H55ANQOOJCMB.0 size=1048576 2024-06-04T15:59:28.121 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.120+0000 7f5e9aacc780 1 < completed part key=_multipart_QJA2JPATITNH.2~H55ANQOOJCMB.1 size=1048576 2024-06-04T15:59:28.121 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.120+0000 7f5e9aacc780 1 < canceled part key=_multipart_QJA2JPATITNH.2~H55ANQOOJCMB.2 size=639971 2024-06-04T15:59:28.123 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.123+0000 7f5e9aacc780 1 < canceled multipart upload key=QJA2JPATITNH upload=H55ANQOOJCMB tag=1K3GXFKTDH4U type=write size=3785699 2024-06-04T15:59:28.126 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.126+0000 7f5e9aacc780 1 > prepared part key=_multipart_PCLJXQHJ4HTY.2~GWNBC1CQN8PU.0 size=1048576 2024-06-04T15:59:28.127 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.127+0000 7f5e9aacc780 1 > prepared part key=_multipart_PCLJXQHJ4HTY.2~GWNBC1CQN8PU.1 size=1048576 2024-06-04T15:59:28.128 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.128+0000 7f5e9aacc780 1 > prepared part key=_multipart_PCLJXQHJ4HTY.2~GWNBC1CQN8PU.2 size=151238 2024-06-04T15:59:28.128 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.128+0000 7f5e9aacc780 1 > prepared multipart upload key=PCLJXQHJ4HTY upload=GWNBC1CQN8PU tag=SKR6YXIVE30I type=write size=3296966 2024-06-04T15:59:28.130 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.129+0000 7f5e9aacc780 1 < completed part key=_multipart_A8O0S3S45RGM.2~SIMZM0EONMYW.0 size=1048576 2024-06-04T15:59:28.131 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.130+0000 7f5e9aacc780 1 < completed part key=_multipart_A8O0S3S45RGM.2~SIMZM0EONMYW.1 size=76561 2024-06-04T15:59:28.133 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.133+0000 7f5e9aacc780 1 < completed multipart upload key=A8O0S3S45RGM upload=SIMZM0EONMYW tag=U51BFW7878O9 type=write size=2173713 2024-06-04T15:59:28.135 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.134+0000 7f5e9aacc780 1 > prepared operation key=GTRMEQJK675Z tag=XJ22FLS0XKE5 type=del size=3583179 2024-06-04T15:59:28.138 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.138+0000 7f5e9aacc780 1 < suggested update operation key=UW5LVIBG09SV tag=0TET6HZH4LBB type=del size=1343016 2024-06-04T15:59:28.139 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.139+0000 7f5e9aacc780 1 > prepared operation key=JL69PUHT6NNT tag=FBVP5K1ZX440 type=del size=3234863 2024-06-04T15:59:28.142 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.142+0000 7f5e9aacc780 1 < suggested update operation key=PNDPO2WUW7UX tag=LE2NVEE3DAR6 type=del size=2487823 2024-06-04T15:59:28.143 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.143+0000 7f5e9aacc780 1 > prepared operation key=2BT2AXKB1RTA tag=RJIU6U56LFOD type=del size=1233130 2024-06-04T15:59:28.145 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.144+0000 7f5e9aacc780 1 < completed part key=_multipart_B0HK5FJ2RGJE.2~71F9OHAN8R3Z.0 size=576532 2024-06-04T15:59:28.147 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.147+0000 7f5e9aacc780 1 < completed multipart upload key=B0HK5FJ2RGJE upload=71F9OHAN8R3Z tag=UWH4XPPXOY8H type=write size=1625108 2024-06-04T15:59:28.148 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.148+0000 7f5e9aacc780 1 > prepared operation key=03ZNYG3WLMP4 tag=RVQ2T9MVF7G9 type=del size=262347 2024-06-04T15:59:28.150 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.149+0000 7f5e9aacc780 1 < completed part key=_multipart_4W5HB9WQQHR6.2~57GINV4072JM.0 size=1038534 2024-06-04T15:59:28.152 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.152+0000 7f5e9aacc780 1 < completed multipart upload key=4W5HB9WQQHR6 upload=57GINV4072JM tag=MXFT7F3RPARY type=write size=2087110 2024-06-04T15:59:28.154 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.155+0000 7f5e9aacc780 1 > prepared part key=_multipart_NHPH4LYPP0LL.2~FMCB3744GXE7.0 size=614788 2024-06-04T15:59:28.154 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.155+0000 7f5e9aacc780 1 > prepared multipart upload key=NHPH4LYPP0LL upload=FMCB3744GXE7 tag=XZ397O2QJPNS type=write size=1663364 2024-06-04T15:59:28.157 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.157+0000 7f5e9aacc780 1 < suggested remove operation key=7S9S3MIG7WIT tag=RGX9VRDYCYVN type=del 2024-06-04T15:59:28.159 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.158+0000 7f5e9aacc780 1 > prepared operation key=UTZHANL9ER2Q tag=IQZTYSAM6X18 type=del size=1011673 2024-06-04T15:59:28.160 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.160+0000 7f5e9aacc780 1 < completed part key=_multipart_K01DAK0M4I4M.2~1HWIQPFRGRFR.0 size=282446 2024-06-04T15:59:28.162 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.162+0000 7f5e9aacc780 1 < completed multipart upload key=K01DAK0M4I4M upload=1HWIQPFRGRFR tag=VC6Z1RCX10EY type=write size=1331022 2024-06-04T15:59:28.164 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.163+0000 7f5e9aacc780 1 > prepared operation key=NJ5U8JTT32QK tag=FFHIPGN394MK type=del size=4063593 2024-06-04T15:59:28.165 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.165+0000 7f5e9aacc780 1 < completed part key=_multipart_A8O0S3S45RGM.2~ZMX16BC285PO.0 size=1048576 2024-06-04T15:59:28.166 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.166+0000 7f5e9aacc780 1 < completed part key=_multipart_A8O0S3S45RGM.2~ZMX16BC285PO.1 size=1048576 2024-06-04T15:59:28.167 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.167+0000 7f5e9aacc780 1 < completed part key=_multipart_A8O0S3S45RGM.2~ZMX16BC285PO.2 size=366950 2024-06-04T15:59:28.170 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.169+0000 7f5e9aacc780 1 < completed multipart upload key=A8O0S3S45RGM upload=ZMX16BC285PO tag=U3K3UCLDY3H5 type=write size=3512678 2024-06-04T15:59:28.171 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.171+0000 7f5e9aacc780 1 > prepared operation key=NHPH4LYPP0LL tag=1BF0MSORNBJW type=del size=3256960 2024-06-04T15:59:28.173 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.173+0000 7f5e9aacc780 1 < completed part key=_multipart_9MPRI6LW3956.2~BGFZUT9RS1SI.0 size=1048576 2024-06-04T15:59:28.174 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.174+0000 7f5e9aacc780 1 < completed part key=_multipart_9MPRI6LW3956.2~BGFZUT9RS1SI.1 size=1048576 2024-06-04T15:59:28.175 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.175+0000 7f5e9aacc780 1 < completed part key=_multipart_9MPRI6LW3956.2~BGFZUT9RS1SI.2 size=408314 2024-06-04T15:59:28.178 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.177+0000 7f5e9aacc780 1 < completed multipart upload key=9MPRI6LW3956 upload=BGFZUT9RS1SI tag=DSPZAMHE8YML type=write size=3554042 2024-06-04T15:59:28.179 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.178+0000 7f5e9aacc780 1 > prepared operation key=B0HK5FJ2RGJE tag=8SBVWH6WLO1T type=del size=1802967 2024-06-04T15:59:28.180 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.180+0000 7f5e9aacc780 1 < completed part key=_multipart_HD6SNICRCDLL.2~PZDSVKGGNPEG.0 size=1048576 2024-06-04T15:59:28.181 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.181+0000 7f5e9aacc780 1 < completed part key=_multipart_HD6SNICRCDLL.2~PZDSVKGGNPEG.1 size=1048576 2024-06-04T15:59:28.182 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.182+0000 7f5e9aacc780 1 < completed part key=_multipart_HD6SNICRCDLL.2~PZDSVKGGNPEG.2 size=676247 2024-06-04T15:59:28.185 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.184+0000 7f5e9aacc780 1 < completed multipart upload key=HD6SNICRCDLL upload=PZDSVKGGNPEG tag=ZR45OV91BGM6 type=write size=3821975 2024-06-04T15:59:28.186 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.186+0000 7f5e9aacc780 1 > prepared operation key=SUBHZJ7HUV3H tag=LVE89TIZHP2G type=del size=372862 2024-06-04T15:59:28.188 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.187+0000 7f5e9aacc780 1 < completed part key=_multipart_PCLJXQHJ4HTY.2~LIUVTPWN4FZN.0 size=962107 2024-06-04T15:59:28.190 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.190+0000 7f5e9aacc780 1 < completed multipart upload key=PCLJXQHJ4HTY upload=LIUVTPWN4FZN tag=X0VNUTBHPWCI type=write size=2010683 2024-06-04T15:59:28.192 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.192+0000 7f5e9aacc780 1 > prepared part key=_multipart_2BT2AXKB1RTA.2~14AHIYU8DV9L.0 size=1048576 2024-06-04T15:59:28.193 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.193+0000 7f5e9aacc780 1 > prepared part key=_multipart_2BT2AXKB1RTA.2~14AHIYU8DV9L.1 size=1048576 2024-06-04T15:59:28.194 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.194+0000 7f5e9aacc780 1 > prepared part key=_multipart_2BT2AXKB1RTA.2~14AHIYU8DV9L.2 size=192964 2024-06-04T15:59:28.195 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.194+0000 7f5e9aacc780 1 > prepared multipart upload key=2BT2AXKB1RTA upload=14AHIYU8DV9L tag=LPHVY1TV7FA1 type=write size=3338692 2024-06-04T15:59:28.196 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.196+0000 7f5e9aacc780 1 < completed delete operation key=TUGKW7F4V9NO tag=GPFFTNJKRUM1 type=del 2024-06-04T15:59:28.198 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.199+0000 7f5e9aacc780 1 > prepared part key=_multipart_UW5LVIBG09SV.2~J4XD51HSN4KJ.0 size=1048576 2024-06-04T15:59:28.200 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.200+0000 7f5e9aacc780 1 > prepared part key=_multipart_UW5LVIBG09SV.2~J4XD51HSN4KJ.1 size=823994 2024-06-04T15:59:28.200 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.200+0000 7f5e9aacc780 1 > prepared multipart upload key=UW5LVIBG09SV upload=J4XD51HSN4KJ tag=V9XQYVRIL45Y type=write size=2921146 2024-06-04T15:59:28.201 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.201+0000 7f5e9aacc780 1 < completed part key=_multipart_TUGKW7F4V9NO.2~YA7TMZO9QCO2.0 size=1011838 2024-06-04T15:59:28.204 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.204+0000 7f5e9aacc780 1 < completed multipart upload key=TUGKW7F4V9NO upload=YA7TMZO9QCO2 tag=1YI542O21A1M type=write size=2060414 2024-06-04T15:59:28.205 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.205+0000 7f5e9aacc780 1 > prepared operation key=PNDPO2WUW7UX tag=TLKCIZMEOO8H type=del size=3889964 2024-06-04T15:59:28.205 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.205+0000 7f5e9aacc780 1 < canceled part key=_multipart_K01DAK0M4I4M.2~TQHW5G285I20.0 size=1048576 2024-06-04T15:59:28.207 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.207+0000 7f5e9aacc780 1 < completed part key=_multipart_K01DAK0M4I4M.2~TQHW5G285I20.1 size=638754 2024-06-04T15:59:28.209 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.209+0000 7f5e9aacc780 1 < canceled multipart upload key=K01DAK0M4I4M upload=TQHW5G285I20 tag=XN3TORABPYER type=write size=2735906 2024-06-04T15:59:28.211 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.210+0000 7f5e9aacc780 1 > prepared operation key=03ZNYG3WLMP4 tag=L9PF4CYZIUI0 type=del size=1021054 2024-06-04T15:59:28.212 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.212+0000 7f5e9aacc780 1 < completed part key=_multipart_7S9S3MIG7WIT.2~17AE1S7IKMNB.0 size=69428 2024-06-04T15:59:28.215 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.215+0000 7f5e9aacc780 1 < completed multipart upload key=7S9S3MIG7WIT upload=17AE1S7IKMNB tag=RNU5DDCYR6CP type=write size=1118004 2024-06-04T15:59:28.217 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.216+0000 7f5e9aacc780 1 > prepared operation key=DY9JWHWNAUO1 tag=C6YQFS9ZBECF type=del size=4165668 2024-06-04T15:59:28.218 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.218+0000 7f5e9aacc780 1 < completed part key=_multipart_PCLJXQHJ4HTY.2~GWNBC1CQN8PU.0 size=1048576 2024-06-04T15:59:28.219 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.219+0000 7f5e9aacc780 1 < completed part key=_multipart_PCLJXQHJ4HTY.2~GWNBC1CQN8PU.1 size=1048576 2024-06-04T15:59:28.220 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.220+0000 7f5e9aacc780 1 < completed part key=_multipart_PCLJXQHJ4HTY.2~GWNBC1CQN8PU.2 size=151238 2024-06-04T15:59:28.222 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.222+0000 7f5e9aacc780 1 < completed multipart upload key=PCLJXQHJ4HTY upload=GWNBC1CQN8PU tag=SKR6YXIVE30I type=write size=3296966 2024-06-04T15:59:28.225 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.224+0000 7f5e9aacc780 1 > prepared operation key=NHPH4LYPP0LL tag=AF23HP26EBGM type=write size=1047024 2024-06-04T15:59:28.226 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.226+0000 7f5e9aacc780 1 < completed delete operation key=GTRMEQJK675Z tag=XJ22FLS0XKE5 type=del 2024-06-04T15:59:28.229 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.228+0000 7f5e9aacc780 1 > prepared part key=_multipart_Q4OFQI0F5YLG.2~C1N0CRHBDJJ8.0 size=1048576 2024-06-04T15:59:28.230 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.230+0000 7f5e9aacc780 1 > prepared part key=_multipart_Q4OFQI0F5YLG.2~C1N0CRHBDJJ8.1 size=1048576 2024-06-04T15:59:28.231 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.231+0000 7f5e9aacc780 1 > prepared part key=_multipart_Q4OFQI0F5YLG.2~C1N0CRHBDJJ8.2 size=540926 2024-06-04T15:59:28.231 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.231+0000 7f5e9aacc780 1 > prepared multipart upload key=Q4OFQI0F5YLG upload=C1N0CRHBDJJ8 tag=AUFQAJUWJV8Z type=write size=3686654 2024-06-04T15:59:28.233 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.233+0000 7f5e9aacc780 1 < completed delete operation key=JL69PUHT6NNT tag=FBVP5K1ZX440 type=del 2024-06-04T15:59:28.236 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.235+0000 7f5e9aacc780 1 > prepared part key=_multipart_AOCB36Y5Q7B0.2~CG54LN836TXN.0 size=97503 2024-06-04T15:59:28.236 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.235+0000 7f5e9aacc780 1 > prepared multipart upload key=AOCB36Y5Q7B0 upload=CG54LN836TXN tag=MKTSZGXULOEV type=write size=1146079 2024-06-04T15:59:28.237 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.238+0000 7f5e9aacc780 1 < completed delete operation key=2BT2AXKB1RTA tag=RJIU6U56LFOD type=del 2024-06-04T15:59:28.240 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.240+0000 7f5e9aacc780 1 > prepared part key=_multipart_HD6SNICRCDLL.2~J30Z16MPA69V.0 size=1048576 2024-06-04T15:59:28.241 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.241+0000 7f5e9aacc780 1 > prepared part key=_multipart_HD6SNICRCDLL.2~J30Z16MPA69V.1 size=1048576 2024-06-04T15:59:28.243 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.243+0000 7f5e9aacc780 1 > prepared part key=_multipart_HD6SNICRCDLL.2~J30Z16MPA69V.2 size=566482 2024-06-04T15:59:28.243 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.243+0000 7f5e9aacc780 1 > prepared multipart upload key=HD6SNICRCDLL upload=J30Z16MPA69V tag=Z39HAK2LR66H type=write size=3712210 2024-06-04T15:59:28.246 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.246+0000 7f5e9aacc780 1 < suggested update operation key=03ZNYG3WLMP4 tag=RVQ2T9MVF7G9 type=del size=262347 2024-06-04T15:59:28.248 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.248+0000 7f5e9aacc780 1 > prepared operation key=FBV2MAG130M6 tag=IJY1ZEOIHBUZ type=del size=3127766 2024-06-04T15:59:28.250 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.249+0000 7f5e9aacc780 1 < completed part key=_multipart_NHPH4LYPP0LL.2~FMCB3744GXE7.0 size=614788 2024-06-04T15:59:28.252 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.252+0000 7f5e9aacc780 1 < completed multipart upload key=NHPH4LYPP0LL upload=FMCB3744GXE7 tag=XZ397O2QJPNS type=write size=1663364 2024-06-04T15:59:28.254 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.253+0000 7f5e9aacc780 1 > prepared operation key=NJ5U8JTT32QK tag=MHQEO31M4MB6 type=write size=570568 2024-06-04T15:59:28.255 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.255+0000 7f5e9aacc780 1 < completed delete operation key=UTZHANL9ER2Q tag=IQZTYSAM6X18 type=del 2024-06-04T15:59:28.257 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.256+0000 7f5e9aacc780 1 > prepared operation key=NHPH4LYPP0LL tag=28YJ3SPKXROE type=write size=434222 2024-06-04T15:59:28.258 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.258+0000 7f5e9aacc780 1 < completed delete operation key=NJ5U8JTT32QK tag=FFHIPGN394MK type=del 2024-06-04T15:59:28.259 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.259+0000 7f5e9aacc780 1 > prepared operation key=2BT2AXKB1RTA tag=IZUP2LZYUE35 type=del size=2891525 2024-06-04T15:59:28.261 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.261+0000 7f5e9aacc780 1 < canceled operation key=NHPH4LYPP0LL tag=1BF0MSORNBJW type=del size=3256960 2024-06-04T15:59:28.262 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.262+0000 7f5e9aacc780 1 > prepared operation key=HD6SNICRCDLL tag=0FYV1F4NCMXR type=del size=3766490 2024-06-04T15:59:28.265 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.265+0000 7f5e9aacc780 1 < suggested remove operation key=B0HK5FJ2RGJE tag=8SBVWH6WLO1T type=del 2024-06-04T15:59:28.267 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.267+0000 7f5e9aacc780 1 > prepared operation key=UW5LVIBG09SV tag=2WPIUMK3IV5M type=del size=2754471 2024-06-04T15:59:28.268 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.268+0000 7f5e9aacc780 1 < completed delete operation key=SUBHZJ7HUV3H tag=LVE89TIZHP2G type=del 2024-06-04T15:59:28.271 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.270+0000 7f5e9aacc780 1 > prepared part key=_multipart_NJ5U8JTT32QK.2~84335PEJB30Y.0 size=1048576 2024-06-04T15:59:28.272 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.272+0000 7f5e9aacc780 1 > prepared part key=_multipart_NJ5U8JTT32QK.2~84335PEJB30Y.1 size=713615 2024-06-04T15:59:28.272 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.272+0000 7f5e9aacc780 1 > prepared multipart upload key=NJ5U8JTT32QK upload=84335PEJB30Y tag=DEX4C3T2LG1J type=write size=2810767 2024-06-04T15:59:28.272 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.272+0000 7f5e9aacc780 1 < canceled part key=_multipart_2BT2AXKB1RTA.2~14AHIYU8DV9L.0 size=1048576 2024-06-04T15:59:28.274 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.273+0000 7f5e9aacc780 1 < completed part key=_multipart_2BT2AXKB1RTA.2~14AHIYU8DV9L.1 size=1048576 2024-06-04T15:59:28.275 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.275+0000 7f5e9aacc780 1 < completed part key=_multipart_2BT2AXKB1RTA.2~14AHIYU8DV9L.2 size=192964 2024-06-04T15:59:28.277 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.277+0000 7f5e9aacc780 1 < canceled multipart upload key=2BT2AXKB1RTA upload=14AHIYU8DV9L tag=LPHVY1TV7FA1 type=write size=3338692 2024-06-04T15:59:28.279 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.279+0000 7f5e9aacc780 1 > prepared operation key=1IKNQXU3Y2JJ tag=4J7FQTMT943T type=write size=783122 2024-06-04T15:59:28.281 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.281+0000 7f5e9aacc780 1 < completed part key=_multipart_UW5LVIBG09SV.2~J4XD51HSN4KJ.0 size=1048576 2024-06-04T15:59:28.281 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.281+0000 7f5e9aacc780 1 < canceled part key=_multipart_UW5LVIBG09SV.2~J4XD51HSN4KJ.1 size=823994 2024-06-04T15:59:28.283 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.283+0000 7f5e9aacc780 1 < canceled multipart upload key=UW5LVIBG09SV upload=J4XD51HSN4KJ tag=V9XQYVRIL45Y type=write size=2921146 2024-06-04T15:59:28.285 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.284+0000 7f5e9aacc780 1 > prepared operation key=NJ5U8JTT32QK tag=L39LIQ8OKFKY type=del size=1574566 2024-06-04T15:59:28.288 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.287+0000 7f5e9aacc780 1 < suggested update operation key=PNDPO2WUW7UX tag=TLKCIZMEOO8H type=del size=3889964 2024-06-04T15:59:28.290 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.290+0000 7f5e9aacc780 1 > prepared part key=_multipart_NJ5U8JTT32QK.2~4AI2NMJWX0FO.0 size=179746 2024-06-04T15:59:28.290 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.290+0000 7f5e9aacc780 1 > prepared multipart upload key=NJ5U8JTT32QK upload=4AI2NMJWX0FO tag=2HXHFQ8VVJQA type=write size=1228322 2024-06-04T15:59:28.291 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.291+0000 7f5e9aacc780 -1 < failed to complete operation key=03ZNYG3WLMP4 tag=L9PF4CYZIUI0 type=del size=1021054: (22) Invalid argument 2024-06-04T15:59:28.293 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.293+0000 7f5e9aacc780 1 > prepared operation key=AOCB36Y5Q7B0 tag=KSDBYN3AO0TX type=del size=2231372 2024-06-04T15:59:28.294 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.294+0000 7f5e9aacc780 1 < completed delete operation key=DY9JWHWNAUO1 tag=C6YQFS9ZBECF type=del 2024-06-04T15:59:28.296 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.296+0000 7f5e9aacc780 1 > prepared operation key=AOCB36Y5Q7B0 tag=T6XHZM0SJIU7 type=write size=351651 2024-06-04T15:59:28.297 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.297+0000 7f5e9aacc780 1 < completed write operation key=NHPH4LYPP0LL tag=AF23HP26EBGM type=write size=1047024 2024-06-04T15:59:28.299 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.299+0000 7f5e9aacc780 1 > prepared operation key=03ZNYG3WLMP4 tag=LHZAAQ200VKA type=del size=3532612 2024-06-04T15:59:28.300 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.300+0000 7f5e9aacc780 1 < completed part key=_multipart_Q4OFQI0F5YLG.2~C1N0CRHBDJJ8.0 size=1048576 2024-06-04T15:59:28.302 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.302+0000 7f5e9aacc780 1 < completed part key=_multipart_Q4OFQI0F5YLG.2~C1N0CRHBDJJ8.1 size=1048576 2024-06-04T15:59:28.303 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.302+0000 7f5e9aacc780 1 < completed part key=_multipart_Q4OFQI0F5YLG.2~C1N0CRHBDJJ8.2 size=540926 2024-06-04T15:59:28.305 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.305+0000 7f5e9aacc780 1 < completed multipart upload key=Q4OFQI0F5YLG upload=C1N0CRHBDJJ8 tag=AUFQAJUWJV8Z type=write size=3686654 2024-06-04T15:59:28.307 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.306+0000 7f5e9aacc780 1 > prepared operation key=RP8K6QJUZAH1 tag=L2N7SQQ9LR9I type=write size=870982 2024-06-04T15:59:28.308 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.308+0000 7f5e9aacc780 1 < completed part key=_multipart_AOCB36Y5Q7B0.2~CG54LN836TXN.0 size=97503 2024-06-04T15:59:28.311 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.310+0000 7f5e9aacc780 1 < completed multipart upload key=AOCB36Y5Q7B0 upload=CG54LN836TXN tag=MKTSZGXULOEV type=write size=1146079 2024-06-04T15:59:28.312 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.312+0000 7f5e9aacc780 1 > prepared operation key=2BT2AXKB1RTA tag=RPWBVJ7X89OD type=del size=3324776 2024-06-04T15:59:28.313 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.313+0000 7f5e9aacc780 1 < completed part key=_multipart_HD6SNICRCDLL.2~J30Z16MPA69V.0 size=1048576 2024-06-04T15:59:28.314 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.314+0000 7f5e9aacc780 1 < completed part key=_multipart_HD6SNICRCDLL.2~J30Z16MPA69V.1 size=1048576 2024-06-04T15:59:28.316 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.315+0000 7f5e9aacc780 1 < completed part key=_multipart_HD6SNICRCDLL.2~J30Z16MPA69V.2 size=566482 2024-06-04T15:59:28.318 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.318+0000 7f5e9aacc780 1 < completed multipart upload key=HD6SNICRCDLL upload=J30Z16MPA69V tag=Z39HAK2LR66H type=write size=3712210 2024-06-04T15:59:28.320 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.319+0000 7f5e9aacc780 1 > prepared operation key=03ZNYG3WLMP4 tag=RXI0KKVOZNL8 type=del size=3444403 2024-06-04T15:59:28.322 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.322+0000 7f5e9aacc780 1 < suggested update operation key=FBV2MAG130M6 tag=IJY1ZEOIHBUZ type=del size=3127766 2024-06-04T15:59:28.325 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.325+0000 7f5e9aacc780 1 > prepared part key=_multipart_B0HK5FJ2RGJE.2~KADQL65LWTTR.0 size=1048576 2024-06-04T15:59:28.326 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.326+0000 7f5e9aacc780 1 > prepared part key=_multipart_B0HK5FJ2RGJE.2~KADQL65LWTTR.1 size=1048576 2024-06-04T15:59:28.327 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.327+0000 7f5e9aacc780 1 > prepared part key=_multipart_B0HK5FJ2RGJE.2~KADQL65LWTTR.2 size=634953 2024-06-04T15:59:28.327 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.327+0000 7f5e9aacc780 1 > prepared multipart upload key=B0HK5FJ2RGJE upload=KADQL65LWTTR tag=OUN4I12C4DT8 type=write size=3780681 2024-06-04T15:59:28.328 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.328+0000 7f5e9aacc780 1 < completed write operation key=NJ5U8JTT32QK tag=MHQEO31M4MB6 type=write size=570568 2024-06-04T15:59:28.331 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.331+0000 7f5e9aacc780 1 > prepared part key=_multipart_7S9S3MIG7WIT.2~998A5GZCKHZ9.0 size=1048576 2024-06-04T15:59:28.332 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.332+0000 7f5e9aacc780 1 > prepared part key=_multipart_7S9S3MIG7WIT.2~998A5GZCKHZ9.1 size=773383 2024-06-04T15:59:28.332 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.332+0000 7f5e9aacc780 1 > prepared multipart upload key=7S9S3MIG7WIT upload=998A5GZCKHZ9 tag=N5JC0QKLWX4I type=write size=2870535 2024-06-04T15:59:28.334 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.333+0000 7f5e9aacc780 1 < canceled operation key=NHPH4LYPP0LL tag=28YJ3SPKXROE type=write size=434222 2024-06-04T15:59:28.336 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.336+0000 7f5e9aacc780 1 > prepared part key=_multipart_1IKNQXU3Y2JJ.2~VDJUX55DCK5K.0 size=635078 2024-06-04T15:59:28.337 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.336+0000 7f5e9aacc780 1 > prepared multipart upload key=1IKNQXU3Y2JJ upload=VDJUX55DCK5K tag=0HOLHEO31W4Z type=write size=1683654 2024-06-04T15:59:28.338 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.338+0000 7f5e9aacc780 1 < completed delete operation key=2BT2AXKB1RTA tag=IZUP2LZYUE35 type=del 2024-06-04T15:59:28.341 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.340+0000 7f5e9aacc780 1 > prepared part key=_multipart_PNDPO2WUW7UX.2~8ERNNUXCFXQR.0 size=1048576 2024-06-04T15:59:28.342 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.341+0000 7f5e9aacc780 1 > prepared part key=_multipart_PNDPO2WUW7UX.2~8ERNNUXCFXQR.1 size=1048576 2024-06-04T15:59:28.343 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.342+0000 7f5e9aacc780 1 > prepared part key=_multipart_PNDPO2WUW7UX.2~8ERNNUXCFXQR.2 size=351844 2024-06-04T15:59:28.343 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.342+0000 7f5e9aacc780 1 > prepared multipart upload key=PNDPO2WUW7UX upload=8ERNNUXCFXQR tag=LYTV8HN25CFT type=write size=3497572 2024-06-04T15:59:28.344 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.344+0000 7f5e9aacc780 1 < completed delete operation key=HD6SNICRCDLL tag=0FYV1F4NCMXR type=del 2024-06-04T15:59:28.346 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.347+0000 7f5e9aacc780 1 > prepared part key=_multipart_7S9S3MIG7WIT.2~FGR4JJMYXL2W.0 size=1048576 2024-06-04T15:59:28.348 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.348+0000 7f5e9aacc780 1 > prepared part key=_multipart_7S9S3MIG7WIT.2~FGR4JJMYXL2W.1 size=1048576 2024-06-04T15:59:28.349 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.348+0000 7f5e9aacc780 1 > prepared part key=_multipart_7S9S3MIG7WIT.2~FGR4JJMYXL2W.2 size=248678 2024-06-04T15:59:28.349 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.348+0000 7f5e9aacc780 1 > prepared multipart upload key=7S9S3MIG7WIT upload=FGR4JJMYXL2W tag=ABSN6O2QGP7U type=write size=3394406 2024-06-04T15:59:28.352 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.352+0000 7f5e9aacc780 1 < suggested update operation key=UW5LVIBG09SV tag=2WPIUMK3IV5M type=del size=2754471 2024-06-04T15:59:28.353 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.353+0000 7f5e9aacc780 1 > prepared operation key=FBV2MAG130M6 tag=0K741C80RMPM type=del size=1849183 2024-06-04T15:59:28.354 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.354+0000 7f5e9aacc780 1 < completed part key=_multipart_NJ5U8JTT32QK.2~84335PEJB30Y.0 size=1048576 2024-06-04T15:59:28.356 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.355+0000 7f5e9aacc780 1 < completed part key=_multipart_NJ5U8JTT32QK.2~84335PEJB30Y.1 size=713615 2024-06-04T15:59:28.358 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.358+0000 7f5e9aacc780 1 < completed multipart upload key=NJ5U8JTT32QK upload=84335PEJB30Y tag=DEX4C3T2LG1J type=write size=2810767 2024-06-04T15:59:28.361 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.360+0000 7f5e9aacc780 1 > prepared part key=_multipart_SUBHZJ7HUV3H.2~2OG511EVND0J.0 size=1048576 2024-06-04T15:59:28.361 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.361+0000 7f5e9aacc780 1 > prepared part key=_multipart_SUBHZJ7HUV3H.2~2OG511EVND0J.1 size=424105 2024-06-04T15:59:28.362 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.361+0000 7f5e9aacc780 1 > prepared multipart upload key=SUBHZJ7HUV3H upload=2OG511EVND0J tag=0CBTK4MTXMTQ type=write size=2521257 2024-06-04T15:59:28.364 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.364+0000 7f5e9aacc780 1 < suggested update operation key=1IKNQXU3Y2JJ tag=4J7FQTMT943T type=write size=783122 2024-06-04T15:59:28.367 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.367+0000 7f5e9aacc780 1 > prepared part key=_multipart_GCPC9OJH7KWU.2~NX0RZ0IBI9T3.0 size=3818 2024-06-04T15:59:28.367 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.367+0000 7f5e9aacc780 1 > prepared multipart upload key=GCPC9OJH7KWU upload=NX0RZ0IBI9T3 tag=X32W5QJVPXU3 type=write size=1052394 2024-06-04T15:59:28.368 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.368+0000 7f5e9aacc780 1 < completed delete operation key=NJ5U8JTT32QK tag=L39LIQ8OKFKY type=del 2024-06-04T15:59:28.370 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.370+0000 7f5e9aacc780 1 > prepared operation key=PNDPO2WUW7UX tag=YSH0CBOJZBN4 type=del size=241233 2024-06-04T15:59:28.371 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.371+0000 7f5e9aacc780 1 < completed part key=_multipart_NJ5U8JTT32QK.2~4AI2NMJWX0FO.0 size=179746 2024-06-04T15:59:28.374 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.374+0000 7f5e9aacc780 1 < completed multipart upload key=NJ5U8JTT32QK upload=4AI2NMJWX0FO tag=2HXHFQ8VVJQA type=write size=1228322 2024-06-04T15:59:28.375 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.375+0000 7f5e9aacc780 1 > prepared operation key=4W5HB9WQQHR6 tag=T4SPVTYU2RDC type=write size=422797 2024-06-04T15:59:28.377 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.377+0000 7f5e9aacc780 1 < completed delete operation key=AOCB36Y5Q7B0 tag=KSDBYN3AO0TX type=del 2024-06-04T15:59:28.379 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.379+0000 7f5e9aacc780 1 > prepared operation key=PASGIP872OVX tag=05BWN22FUGEH type=del size=2144093 2024-06-04T15:59:28.381 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.380+0000 7f5e9aacc780 1 < completed write operation key=AOCB36Y5Q7B0 tag=T6XHZM0SJIU7 type=write size=351651 2024-06-04T15:59:28.383 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.383+0000 7f5e9aacc780 1 > prepared part key=_multipart_4W5HB9WQQHR6.2~RUF28L4HCMQL.0 size=1033680 2024-06-04T15:59:28.383 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.383+0000 7f5e9aacc780 1 > prepared multipart upload key=4W5HB9WQQHR6 upload=RUF28L4HCMQL tag=PGP5IW570VQH type=write size=2082256 2024-06-04T15:59:28.385 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.385+0000 7f5e9aacc780 1 < completed delete operation key=03ZNYG3WLMP4 tag=LHZAAQ200VKA type=del 2024-06-04T15:59:28.386 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.386+0000 7f5e9aacc780 1 > prepared operation key=GTRMEQJK675Z tag=QOO6NR1HCDCY type=del size=1292813 2024-06-04T15:59:28.388 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.388+0000 7f5e9aacc780 1 < completed write operation key=RP8K6QJUZAH1 tag=L2N7SQQ9LR9I type=write size=870982 2024-06-04T15:59:28.391 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.390+0000 7f5e9aacc780 1 > prepared part key=_multipart_NJ5U8JTT32QK.2~5LOUT2AT5LMG.0 size=1048576 2024-06-04T15:59:28.392 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.391+0000 7f5e9aacc780 1 > prepared part key=_multipart_NJ5U8JTT32QK.2~5LOUT2AT5LMG.1 size=795811 2024-06-04T15:59:28.392 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.391+0000 7f5e9aacc780 1 > prepared multipart upload key=NJ5U8JTT32QK upload=5LOUT2AT5LMG tag=BEVTFVIUH11Z type=write size=2892963 2024-06-04T15:59:28.393 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.393+0000 7f5e9aacc780 1 < completed delete operation key=2BT2AXKB1RTA tag=RPWBVJ7X89OD type=del 2024-06-04T15:59:28.395 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.395+0000 7f5e9aacc780 1 > prepared part key=_multipart_4W5HB9WQQHR6.2~J7D1G0ZXPUBG.0 size=1048576 2024-06-04T15:59:28.396 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.396+0000 7f5e9aacc780 1 > prepared part key=_multipart_4W5HB9WQQHR6.2~J7D1G0ZXPUBG.1 size=391083 2024-06-04T15:59:28.397 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.396+0000 7f5e9aacc780 1 > prepared multipart upload key=4W5HB9WQQHR6 upload=J7D1G0ZXPUBG tag=XKF5BQCRJI9K type=write size=2488235 2024-06-04T15:59:28.399 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.399+0000 7f5e9aacc780 1 < suggested update operation key=03ZNYG3WLMP4 tag=RXI0KKVOZNL8 type=del size=3444403 2024-06-04T15:59:28.401 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.401+0000 7f5e9aacc780 1 > prepared operation key=RP8K6QJUZAH1 tag=P56QMNH0XHML type=del size=3972565 2024-06-04T15:59:28.403 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.402+0000 7f5e9aacc780 1 < completed part key=_multipart_B0HK5FJ2RGJE.2~KADQL65LWTTR.0 size=1048576 2024-06-04T15:59:28.404 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.403+0000 7f5e9aacc780 1 < completed part key=_multipart_B0HK5FJ2RGJE.2~KADQL65LWTTR.1 size=1048576 2024-06-04T15:59:28.405 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.404+0000 7f5e9aacc780 1 < completed part key=_multipart_B0HK5FJ2RGJE.2~KADQL65LWTTR.2 size=634953 2024-06-04T15:59:28.407 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.407+0000 7f5e9aacc780 1 < completed multipart upload key=B0HK5FJ2RGJE upload=KADQL65LWTTR tag=OUN4I12C4DT8 type=write size=3780681 2024-06-04T15:59:28.409 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.408+0000 7f5e9aacc780 1 > prepared operation key=NJ5U8JTT32QK tag=FCMD2XRX3ORB type=del size=1530451 2024-06-04T15:59:28.410 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.410+0000 7f5e9aacc780 1 < completed part key=_multipart_7S9S3MIG7WIT.2~998A5GZCKHZ9.0 size=1048576 2024-06-04T15:59:28.411 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.411+0000 7f5e9aacc780 1 < completed part key=_multipart_7S9S3MIG7WIT.2~998A5GZCKHZ9.1 size=773383 2024-06-04T15:59:28.413 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.413+0000 7f5e9aacc780 1 < completed multipart upload key=7S9S3MIG7WIT upload=998A5GZCKHZ9 tag=N5JC0QKLWX4I type=write size=2870535 2024-06-04T15:59:28.415 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.414+0000 7f5e9aacc780 1 > prepared operation key=PASGIP872OVX tag=NC3QKPUMGUJI type=del size=1560730 2024-06-04T15:59:28.416 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.416+0000 7f5e9aacc780 1 < completed part key=_multipart_1IKNQXU3Y2JJ.2~VDJUX55DCK5K.0 size=635078 2024-06-04T15:59:28.419 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.418+0000 7f5e9aacc780 1 < completed multipart upload key=1IKNQXU3Y2JJ upload=VDJUX55DCK5K tag=0HOLHEO31W4Z type=write size=1683654 2024-06-04T15:59:28.420 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.420+0000 7f5e9aacc780 1 > prepared operation key=PASGIP872OVX tag=11ZRYXW36FCK type=del size=698335 2024-06-04T15:59:28.421 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.421+0000 7f5e9aacc780 1 < completed part key=_multipart_PNDPO2WUW7UX.2~8ERNNUXCFXQR.0 size=1048576 2024-06-04T15:59:28.423 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.422+0000 7f5e9aacc780 1 < completed part key=_multipart_PNDPO2WUW7UX.2~8ERNNUXCFXQR.1 size=1048576 2024-06-04T15:59:28.424 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.423+0000 7f5e9aacc780 1 < completed part key=_multipart_PNDPO2WUW7UX.2~8ERNNUXCFXQR.2 size=351844 2024-06-04T15:59:28.426 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.426+0000 7f5e9aacc780 1 < completed multipart upload key=PNDPO2WUW7UX upload=8ERNNUXCFXQR tag=LYTV8HN25CFT type=write size=3497572 2024-06-04T15:59:28.427 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.427+0000 7f5e9aacc780 1 > prepared operation key=B0HK5FJ2RGJE tag=ANWVQG58Y742 type=del size=4061226 2024-06-04T15:59:28.429 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.429+0000 7f5e9aacc780 1 < completed part key=_multipart_7S9S3MIG7WIT.2~FGR4JJMYXL2W.0 size=1048576 2024-06-04T15:59:28.430 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.430+0000 7f5e9aacc780 1 < completed part key=_multipart_7S9S3MIG7WIT.2~FGR4JJMYXL2W.1 size=1048576 2024-06-04T15:59:28.431 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.431+0000 7f5e9aacc780 1 < completed part key=_multipart_7S9S3MIG7WIT.2~FGR4JJMYXL2W.2 size=248678 2024-06-04T15:59:28.434 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.434+0000 7f5e9aacc780 1 < completed multipart upload key=7S9S3MIG7WIT upload=FGR4JJMYXL2W tag=ABSN6O2QGP7U type=write size=3394406 2024-06-04T15:59:28.435 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.435+0000 7f5e9aacc780 1 > prepared operation key=4W5HB9WQQHR6 tag=BIJHFLAUXIK5 type=del size=3140635 2024-06-04T15:59:28.438 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.437+0000 7f5e9aacc780 1 < suggested remove operation key=FBV2MAG130M6 tag=0K741C80RMPM type=del 2024-06-04T15:59:28.439 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.439+0000 7f5e9aacc780 1 > prepared operation key=UTZHANL9ER2Q tag=0WXBK179711G type=del size=995838 2024-06-04T15:59:28.441 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.440+0000 7f5e9aacc780 1 < completed part key=_multipart_SUBHZJ7HUV3H.2~2OG511EVND0J.0 size=1048576 2024-06-04T15:59:28.442 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.441+0000 7f5e9aacc780 1 < completed part key=_multipart_SUBHZJ7HUV3H.2~2OG511EVND0J.1 size=424105 2024-06-04T15:59:28.444 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.444+0000 7f5e9aacc780 1 < completed multipart upload key=SUBHZJ7HUV3H upload=2OG511EVND0J tag=0CBTK4MTXMTQ type=write size=2521257 2024-06-04T15:59:28.446 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.445+0000 7f5e9aacc780 1 > prepared operation key=FBV2MAG130M6 tag=79COAB9T35JW type=del size=3200565 2024-06-04T15:59:28.447 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.447+0000 7f5e9aacc780 1 < completed part key=_multipart_GCPC9OJH7KWU.2~NX0RZ0IBI9T3.0 size=3818 2024-06-04T15:59:28.449 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.449+0000 7f5e9aacc780 1 < completed multipart upload key=GCPC9OJH7KWU upload=NX0RZ0IBI9T3 tag=X32W5QJVPXU3 type=write size=1052394 2024-06-04T15:59:28.451 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.450+0000 7f5e9aacc780 1 > prepared operation key=RP8K6QJUZAH1 tag=ZOQ1GM5XWS2L type=del size=1696122 2024-06-04T15:59:28.453 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.453+0000 7f5e9aacc780 1 < suggested remove operation key=PNDPO2WUW7UX tag=YSH0CBOJZBN4 type=del 2024-06-04T15:59:28.455 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.454+0000 7f5e9aacc780 1 > prepared operation key=JL69PUHT6NNT tag=ZUYOIDSFENRN type=del size=3080048 2024-06-04T15:59:28.456 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.456+0000 7f5e9aacc780 1 < completed write operation key=4W5HB9WQQHR6 tag=T4SPVTYU2RDC type=write size=422797 2024-06-04T15:59:28.457 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.457+0000 7f5e9aacc780 1 > prepared operation key=UW5LVIBG09SV tag=GSPMD9T91YST type=del size=1146699 2024-06-04T15:59:28.459 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.459+0000 7f5e9aacc780 1 < completed delete operation key=PASGIP872OVX tag=05BWN22FUGEH type=del 2024-06-04T15:59:28.461 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.461+0000 7f5e9aacc780 1 > prepared part key=_multipart_A8O0S3S45RGM.2~QL7R2BUWBBG8.0 size=1048576 2024-06-04T15:59:28.462 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.462+0000 7f5e9aacc780 1 > prepared part key=_multipart_A8O0S3S45RGM.2~QL7R2BUWBBG8.1 size=1048576 2024-06-04T15:59:28.464 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.463+0000 7f5e9aacc780 1 > prepared part key=_multipart_A8O0S3S45RGM.2~QL7R2BUWBBG8.2 size=223345 2024-06-04T15:59:28.464 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.463+0000 7f5e9aacc780 1 > prepared multipart upload key=A8O0S3S45RGM upload=QL7R2BUWBBG8 tag=99SMN2YEQHPN type=write size=3369073 2024-06-04T15:59:28.465 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.465+0000 7f5e9aacc780 1 < completed part key=_multipart_4W5HB9WQQHR6.2~RUF28L4HCMQL.0 size=1033680 2024-06-04T15:59:28.467 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.467+0000 7f5e9aacc780 1 < completed multipart upload key=4W5HB9WQQHR6 upload=RUF28L4HCMQL tag=PGP5IW570VQH type=write size=2082256 2024-06-04T15:59:28.469 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.468+0000 7f5e9aacc780 1 > prepared operation key=RP8K6QJUZAH1 tag=UIZXDBL6IUOP type=del size=4173963 2024-06-04T15:59:28.470 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.470+0000 7f5e9aacc780 1 < completed delete operation key=GTRMEQJK675Z tag=QOO6NR1HCDCY type=del 2024-06-04T15:59:28.471 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.471+0000 7f5e9aacc780 1 > prepared operation key=TUGKW7F4V9NO tag=Z9QUEK6TZMUU type=del size=2752683 2024-06-04T15:59:28.473 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.473+0000 7f5e9aacc780 1 < completed part key=_multipart_NJ5U8JTT32QK.2~5LOUT2AT5LMG.0 size=1048576 2024-06-04T15:59:28.474 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.474+0000 7f5e9aacc780 1 < completed part key=_multipart_NJ5U8JTT32QK.2~5LOUT2AT5LMG.1 size=795811 2024-06-04T15:59:28.476 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.476+0000 7f5e9aacc780 1 < completed multipart upload key=NJ5U8JTT32QK upload=5LOUT2AT5LMG tag=BEVTFVIUH11Z type=write size=2892963 2024-06-04T15:59:28.477 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.477+0000 7f5e9aacc780 1 > prepared operation key=PASGIP872OVX tag=3S5485J7HAQP type=write size=1014306 2024-06-04T15:59:28.479 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.478+0000 7f5e9aacc780 1 < completed part key=_multipart_4W5HB9WQQHR6.2~J7D1G0ZXPUBG.0 size=1048576 2024-06-04T15:59:28.480 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.480+0000 7f5e9aacc780 1 < completed part key=_multipart_4W5HB9WQQHR6.2~J7D1G0ZXPUBG.1 size=391083 2024-06-04T15:59:28.482 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.482+0000 7f5e9aacc780 1 < completed multipart upload key=4W5HB9WQQHR6 upload=J7D1G0ZXPUBG tag=XKF5BQCRJI9K type=write size=2488235 2024-06-04T15:59:28.485 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.485+0000 7f5e9aacc780 1 > prepared part key=_multipart_AOCB36Y5Q7B0.2~W311AYZ9Q3QU.0 size=1048576 2024-06-04T15:59:28.486 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.486+0000 7f5e9aacc780 1 > prepared part key=_multipart_AOCB36Y5Q7B0.2~W311AYZ9Q3QU.1 size=1048576 2024-06-04T15:59:28.488 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.487+0000 7f5e9aacc780 1 > prepared part key=_multipart_AOCB36Y5Q7B0.2~W311AYZ9Q3QU.2 size=1012391 2024-06-04T15:59:28.488 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.487+0000 7f5e9aacc780 1 > prepared multipart upload key=AOCB36Y5Q7B0 upload=W311AYZ9Q3QU tag=OBXPJ0DGG0H4 type=write size=4158119 2024-06-04T15:59:28.489 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.489+0000 7f5e9aacc780 1 < completed delete operation key=RP8K6QJUZAH1 tag=P56QMNH0XHML type=del 2024-06-04T15:59:28.491 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.491+0000 7f5e9aacc780 1 > prepared operation key=NHPH4LYPP0LL tag=WQPFGRS9G0S8 type=del size=2108040 2024-06-04T15:59:28.492 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.492+0000 7f5e9aacc780 1 < completed delete operation key=NJ5U8JTT32QK tag=FCMD2XRX3ORB type=del 2024-06-04T15:59:28.495 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.495+0000 7f5e9aacc780 1 > prepared part key=_multipart_NHPH4LYPP0LL.2~RNJKKFW3X1HG.0 size=1048576 2024-06-04T15:59:28.496 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.496+0000 7f5e9aacc780 1 > prepared part key=_multipart_NHPH4LYPP0LL.2~RNJKKFW3X1HG.1 size=753317 2024-06-04T15:59:28.496 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.496+0000 7f5e9aacc780 1 > prepared multipart upload key=NHPH4LYPP0LL upload=RNJKKFW3X1HG tag=BX3BXCUJ4IEJ type=write size=2850469 2024-06-04T15:59:28.498 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.497+0000 7f5e9aacc780 1 < completed delete operation key=PASGIP872OVX tag=NC3QKPUMGUJI type=del 2024-06-04T15:59:28.500 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.500+0000 7f5e9aacc780 1 > prepared part key=_multipart_PNDPO2WUW7UX.2~2CPHNFEZDJD8.0 size=2657 2024-06-04T15:59:28.500 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.500+0000 7f5e9aacc780 1 > prepared multipart upload key=PNDPO2WUW7UX upload=2CPHNFEZDJD8 tag=AUHGAE6R3ZHU type=write size=1051233 2024-06-04T15:59:28.503 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.503+0000 7f5e9aacc780 1 < suggested update operation key=PASGIP872OVX tag=11ZRYXW36FCK type=del size=698335 2024-06-04T15:59:28.504 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.504+0000 7f5e9aacc780 1 > prepared operation key=Q4OFQI0F5YLG tag=ATIZHGU1HWSD type=del size=2435728 2024-06-04T15:59:28.507 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.507+0000 7f5e9aacc780 1 < suggested update operation key=B0HK5FJ2RGJE tag=ANWVQG58Y742 type=del size=4061226 2024-06-04T15:59:28.511 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.511+0000 7f5e9aacc780 1 > prepared part key=_multipart_QUIVPH3OB6KN.2~S7BVA81TRCAH.0 size=1048576 2024-06-04T15:59:28.512 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.512+0000 7f5e9aacc780 1 > prepared part key=_multipart_QUIVPH3OB6KN.2~S7BVA81TRCAH.1 size=587124 2024-06-04T15:59:28.512 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.512+0000 7f5e9aacc780 1 > prepared multipart upload key=QUIVPH3OB6KN upload=S7BVA81TRCAH tag=V8E8LHCF6A7E type=write size=2684276 2024-06-04T15:59:28.515 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.515+0000 7f5e9aacc780 1 < suggested update operation key=4W5HB9WQQHR6 tag=BIJHFLAUXIK5 type=del size=3140635 2024-06-04T15:59:28.518 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.518+0000 7f5e9aacc780 1 > prepared part key=_multipart_JL69PUHT6NNT.2~TZKT31QP6XSJ.0 size=503170 2024-06-04T15:59:28.519 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.518+0000 7f5e9aacc780 1 > prepared multipart upload key=JL69PUHT6NNT upload=TZKT31QP6XSJ tag=8L8EW36DTKBI type=write size=1551746 2024-06-04T15:59:28.520 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.520+0000 7f5e9aacc780 1 < completed delete operation key=UTZHANL9ER2Q tag=0WXBK179711G type=del 2024-06-04T15:59:28.521 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.522+0000 7f5e9aacc780 1 > prepared operation key=TUGKW7F4V9NO tag=07UVEP5O9JZK type=del size=2394210 2024-06-04T15:59:28.525 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.525+0000 7f5e9aacc780 1 < suggested update operation key=FBV2MAG130M6 tag=79COAB9T35JW type=del size=3200565 2024-06-04T15:59:28.527 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.526+0000 7f5e9aacc780 1 > prepared operation key=QJA2JPATITNH tag=GI5P5PMLHYTY type=del size=3152601 2024-06-04T15:59:28.530 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.529+0000 7f5e9aacc780 1 < suggested update operation key=RP8K6QJUZAH1 tag=ZOQ1GM5XWS2L type=del size=1696122 2024-06-04T15:59:28.532 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.532+0000 7f5e9aacc780 1 > prepared part key=_multipart_03ZNYG3WLMP4.2~XFVMTRY4LLEK.0 size=1048576 2024-06-04T15:59:28.533 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.533+0000 7f5e9aacc780 1 > prepared part key=_multipart_03ZNYG3WLMP4.2~XFVMTRY4LLEK.1 size=727036 2024-06-04T15:59:28.533 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.533+0000 7f5e9aacc780 1 > prepared multipart upload key=03ZNYG3WLMP4 upload=XFVMTRY4LLEK tag=HYMCVFOZPEQQ type=write size=2824188 2024-06-04T15:59:28.535 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.534+0000 7f5e9aacc780 1 < completed delete operation key=JL69PUHT6NNT tag=ZUYOIDSFENRN type=del 2024-06-04T15:59:28.538 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.537+0000 7f5e9aacc780 1 > prepared part key=_multipart_QUIVPH3OB6KN.2~DM4D0OL5PAJH.0 size=1048576 2024-06-04T15:59:28.539 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.538+0000 7f5e9aacc780 1 > prepared part key=_multipart_QUIVPH3OB6KN.2~DM4D0OL5PAJH.1 size=754224 2024-06-04T15:59:28.539 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.538+0000 7f5e9aacc780 1 > prepared multipart upload key=QUIVPH3OB6KN upload=DM4D0OL5PAJH tag=G56JWI5DOQB4 type=write size=2851376 2024-06-04T15:59:28.540 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.540+0000 7f5e9aacc780 1 < completed delete operation key=UW5LVIBG09SV tag=GSPMD9T91YST type=del 2024-06-04T15:59:28.542 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.541+0000 7f5e9aacc780 1 > prepared operation key=Q2V1ICTBSCV1 tag=9YPSFLQ1JN6M type=del size=1357348 2024-06-04T15:59:28.543 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.543+0000 7f5e9aacc780 1 < completed part key=_multipart_A8O0S3S45RGM.2~QL7R2BUWBBG8.0 size=1048576 2024-06-04T15:59:28.544 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.544+0000 7f5e9aacc780 1 < completed part key=_multipart_A8O0S3S45RGM.2~QL7R2BUWBBG8.1 size=1048576 2024-06-04T15:59:28.545 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.544+0000 7f5e9aacc780 1 < canceled part key=_multipart_A8O0S3S45RGM.2~QL7R2BUWBBG8.2 size=223345 2024-06-04T15:59:28.546 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.547+0000 7f5e9aacc780 1 < canceled multipart upload key=A8O0S3S45RGM upload=QL7R2BUWBBG8 tag=99SMN2YEQHPN type=write size=3369073 2024-06-04T15:59:28.549 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.549+0000 7f5e9aacc780 1 > prepared part key=_multipart_RP8K6QJUZAH1.2~JFX2N00FY16M.0 size=663527 2024-06-04T15:59:28.549 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.549+0000 7f5e9aacc780 1 > prepared multipart upload key=RP8K6QJUZAH1 upload=JFX2N00FY16M tag=O3EDYBJDZVNN type=write size=1712103 2024-06-04T15:59:28.552 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.552+0000 7f5e9aacc780 1 < suggested update operation key=RP8K6QJUZAH1 tag=UIZXDBL6IUOP type=del size=4173963 2024-06-04T15:59:28.554 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.553+0000 7f5e9aacc780 1 > prepared operation key=FBV2MAG130M6 tag=GJP3EYEY8O1I type=del size=1594409 2024-06-04T15:59:28.555 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.555+0000 7f5e9aacc780 1 < completed delete operation key=TUGKW7F4V9NO tag=Z9QUEK6TZMUU type=del 2024-06-04T15:59:28.558 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.557+0000 7f5e9aacc780 1 > prepared part key=_multipart_K01DAK0M4I4M.2~ZX8IRYMB7K5L.0 size=1048576 2024-06-04T15:59:28.559 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.558+0000 7f5e9aacc780 1 > prepared part key=_multipart_K01DAK0M4I4M.2~ZX8IRYMB7K5L.1 size=1048576 2024-06-04T15:59:28.560 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.559+0000 7f5e9aacc780 1 > prepared part key=_multipart_K01DAK0M4I4M.2~ZX8IRYMB7K5L.2 size=979983 2024-06-04T15:59:28.560 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.559+0000 7f5e9aacc780 1 > prepared multipart upload key=K01DAK0M4I4M upload=ZX8IRYMB7K5L tag=RYE1YIYWV1HV type=write size=4125711 2024-06-04T15:59:28.561 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.561+0000 7f5e9aacc780 -1 < failed to complete operation key=PASGIP872OVX tag=3S5485J7HAQP type=write size=1014306: (22) Invalid argument 2024-06-04T15:59:28.563 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.562+0000 7f5e9aacc780 1 > prepared operation key=9MPRI6LW3956 tag=BQRPEUMGX9DK type=write size=215667 2024-06-04T15:59:28.564 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.564+0000 7f5e9aacc780 1 < completed part key=_multipart_AOCB36Y5Q7B0.2~W311AYZ9Q3QU.0 size=1048576 2024-06-04T15:59:28.565 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.565+0000 7f5e9aacc780 1 < completed part key=_multipart_AOCB36Y5Q7B0.2~W311AYZ9Q3QU.1 size=1048576 2024-06-04T15:59:28.566 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.566+0000 7f5e9aacc780 1 < completed part key=_multipart_AOCB36Y5Q7B0.2~W311AYZ9Q3QU.2 size=1012391 2024-06-04T15:59:28.568 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.568+0000 7f5e9aacc780 1 < completed multipart upload key=AOCB36Y5Q7B0 upload=W311AYZ9Q3QU tag=OBXPJ0DGG0H4 type=write size=4158119 2024-06-04T15:59:28.571 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.571+0000 7f5e9aacc780 1 > prepared part key=_multipart_1IKNQXU3Y2JJ.2~KUM75KHR43L0.0 size=1048576 2024-06-04T15:59:28.572 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.571+0000 7f5e9aacc780 1 > prepared part key=_multipart_1IKNQXU3Y2JJ.2~KUM75KHR43L0.1 size=619574 2024-06-04T15:59:28.572 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.571+0000 7f5e9aacc780 1 > prepared multipart upload key=1IKNQXU3Y2JJ upload=KUM75KHR43L0 tag=0OVCXYAXRRLP type=write size=2716726 2024-06-04T15:59:28.573 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.573+0000 7f5e9aacc780 1 < completed delete operation key=NHPH4LYPP0LL tag=WQPFGRS9G0S8 type=del 2024-06-04T15:59:28.574 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.574+0000 7f5e9aacc780 1 > prepared operation key=DY9JWHWNAUO1 tag=QMSVVZ98AVDI type=del size=1922942 2024-06-04T15:59:28.576 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.576+0000 7f5e9aacc780 1 < completed part key=_multipart_NHPH4LYPP0LL.2~RNJKKFW3X1HG.0 size=1048576 2024-06-04T15:59:28.577 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.577+0000 7f5e9aacc780 1 < completed part key=_multipart_NHPH4LYPP0LL.2~RNJKKFW3X1HG.1 size=753317 2024-06-04T15:59:28.579 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.579+0000 7f5e9aacc780 1 < completed multipart upload key=NHPH4LYPP0LL upload=RNJKKFW3X1HG tag=BX3BXCUJ4IEJ type=write size=2850469 2024-06-04T15:59:28.582 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.581+0000 7f5e9aacc780 1 > prepared part key=_multipart_PNDPO2WUW7UX.2~LEUY3DMS62A3.0 size=1048576 2024-06-04T15:59:28.583 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.583+0000 7f5e9aacc780 1 > prepared part key=_multipart_PNDPO2WUW7UX.2~LEUY3DMS62A3.1 size=1048576 2024-06-04T15:59:28.584 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.584+0000 7f5e9aacc780 1 > prepared part key=_multipart_PNDPO2WUW7UX.2~LEUY3DMS62A3.2 size=257372 2024-06-04T15:59:28.584 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.584+0000 7f5e9aacc780 1 > prepared multipart upload key=PNDPO2WUW7UX upload=LEUY3DMS62A3 tag=RI8V8IPW6HXD type=write size=3403100 2024-06-04T15:59:28.585 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.585+0000 7f5e9aacc780 1 < completed part key=_multipart_PNDPO2WUW7UX.2~2CPHNFEZDJD8.0 size=2657 2024-06-04T15:59:28.587 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.588+0000 7f5e9aacc780 1 < completed multipart upload key=PNDPO2WUW7UX upload=2CPHNFEZDJD8 tag=AUHGAE6R3ZHU type=write size=1051233 2024-06-04T15:59:28.589 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.589+0000 7f5e9aacc780 1 > prepared operation key=XH0N984YVGKP tag=93TOLIGDM7ZP type=del size=2702290 2024-06-04T15:59:28.591 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.591+0000 7f5e9aacc780 1 < suggested update operation key=Q4OFQI0F5YLG tag=ATIZHGU1HWSD type=del size=2435728 2024-06-04T15:59:28.593 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.592+0000 7f5e9aacc780 1 > prepared operation key=NHPH4LYPP0LL tag=22C1EEDJDFGI type=write size=788702 2024-06-04T15:59:28.595 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.595+0000 7f5e9aacc780 1 < completed part key=_multipart_QUIVPH3OB6KN.2~S7BVA81TRCAH.0 size=1048576 2024-06-04T15:59:28.596 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.596+0000 7f5e9aacc780 1 < completed part key=_multipart_QUIVPH3OB6KN.2~S7BVA81TRCAH.1 size=587124 2024-06-04T15:59:28.598 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.598+0000 7f5e9aacc780 1 < completed multipart upload key=QUIVPH3OB6KN upload=S7BVA81TRCAH tag=V8E8LHCF6A7E type=write size=2684276 2024-06-04T15:59:28.601 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.601+0000 7f5e9aacc780 1 > prepared part key=_multipart_SUBHZJ7HUV3H.2~6F5UYVTOLX2R.0 size=375929 2024-06-04T15:59:28.601 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.601+0000 7f5e9aacc780 1 > prepared multipart upload key=SUBHZJ7HUV3H upload=6F5UYVTOLX2R tag=AN91ITFTIZDI type=write size=1424505 2024-06-04T15:59:28.602 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.602+0000 7f5e9aacc780 1 < completed part key=_multipart_JL69PUHT6NNT.2~TZKT31QP6XSJ.0 size=503170 2024-06-04T15:59:28.605 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.605+0000 7f5e9aacc780 1 < completed multipart upload key=JL69PUHT6NNT upload=TZKT31QP6XSJ tag=8L8EW36DTKBI type=write size=1551746 2024-06-04T15:59:28.606 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.606+0000 7f5e9aacc780 1 > prepared operation key=QJA2JPATITNH tag=BN4Y653JZ735 type=del size=3470065 2024-06-04T15:59:28.608 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.608+0000 7f5e9aacc780 1 < completed delete operation key=TUGKW7F4V9NO tag=07UVEP5O9JZK type=del 2024-06-04T15:59:28.611 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.610+0000 7f5e9aacc780 1 > prepared part key=_multipart_Q2V1ICTBSCV1.2~Z1UURVAPK0TT.0 size=1048576 2024-06-04T15:59:28.612 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.612+0000 7f5e9aacc780 1 > prepared part key=_multipart_Q2V1ICTBSCV1.2~Z1UURVAPK0TT.1 size=1048576 2024-06-04T15:59:28.613 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.613+0000 7f5e9aacc780 1 > prepared part key=_multipart_Q2V1ICTBSCV1.2~Z1UURVAPK0TT.2 size=1043490 2024-06-04T15:59:28.613 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.613+0000 7f5e9aacc780 1 > prepared multipart upload key=Q2V1ICTBSCV1 upload=Z1UURVAPK0TT tag=CJBY03PHY410 type=write size=4189218 2024-06-04T15:59:28.615 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.614+0000 7f5e9aacc780 1 < completed delete operation key=QJA2JPATITNH tag=GI5P5PMLHYTY type=del 2024-06-04T15:59:28.616 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.616+0000 7f5e9aacc780 1 > prepared operation key=JL69PUHT6NNT tag=5NDSIKNO03IM type=del size=307102 2024-06-04T15:59:28.618 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.617+0000 7f5e9aacc780 1 < completed part key=_multipart_03ZNYG3WLMP4.2~XFVMTRY4LLEK.0 size=1048576 2024-06-04T15:59:28.619 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.619+0000 7f5e9aacc780 1 < completed part key=_multipart_03ZNYG3WLMP4.2~XFVMTRY4LLEK.1 size=727036 2024-06-04T15:59:28.621 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.621+0000 7f5e9aacc780 1 < completed multipart upload key=03ZNYG3WLMP4 upload=XFVMTRY4LLEK tag=HYMCVFOZPEQQ type=write size=2824188 2024-06-04T15:59:28.624 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.624+0000 7f5e9aacc780 1 > prepared part key=_multipart_NJ5U8JTT32QK.2~43FLWVO3U95L.0 size=1048576 2024-06-04T15:59:28.625 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.625+0000 7f5e9aacc780 1 > prepared part key=_multipart_NJ5U8JTT32QK.2~43FLWVO3U95L.1 size=590833 2024-06-04T15:59:28.625 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.625+0000 7f5e9aacc780 1 > prepared multipart upload key=NJ5U8JTT32QK upload=43FLWVO3U95L tag=0MWR519DTV40 type=write size=2687985 2024-06-04T15:59:28.626 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.626+0000 7f5e9aacc780 1 < completed part key=_multipart_QUIVPH3OB6KN.2~DM4D0OL5PAJH.0 size=1048576 2024-06-04T15:59:28.628 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.627+0000 7f5e9aacc780 1 < completed part key=_multipart_QUIVPH3OB6KN.2~DM4D0OL5PAJH.1 size=754224 2024-06-04T15:59:28.630 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.630+0000 7f5e9aacc780 1 < completed multipart upload key=QUIVPH3OB6KN upload=DM4D0OL5PAJH tag=G56JWI5DOQB4 type=write size=2851376 2024-06-04T15:59:28.632 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.631+0000 7f5e9aacc780 1 > prepared operation key=QUIVPH3OB6KN tag=6ST4UMU3MRQ8 type=del size=3130173 2024-06-04T15:59:28.633 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.633+0000 7f5e9aacc780 1 < completed delete operation key=Q2V1ICTBSCV1 tag=9YPSFLQ1JN6M type=del 2024-06-04T15:59:28.635 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.635+0000 7f5e9aacc780 1 > prepared operation key=TUGKW7F4V9NO tag=PIPJBNS7LHQ3 type=del size=980897 2024-06-04T15:59:28.636 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.636+0000 7f5e9aacc780 1 < completed part key=_multipart_RP8K6QJUZAH1.2~JFX2N00FY16M.0 size=663527 2024-06-04T15:59:28.639 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.639+0000 7f5e9aacc780 1 < completed multipart upload key=RP8K6QJUZAH1 upload=JFX2N00FY16M tag=O3EDYBJDZVNN type=write size=1712103 2024-06-04T15:59:28.640 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.640+0000 7f5e9aacc780 1 > prepared operation key=Q4OFQI0F5YLG tag=KD9T4GD0C2O9 type=del size=910559 2024-06-04T15:59:28.642 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.642+0000 7f5e9aacc780 1 < completed delete operation key=FBV2MAG130M6 tag=GJP3EYEY8O1I type=del 2024-06-04T15:59:28.643 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.643+0000 7f5e9aacc780 1 > prepared operation key=NHPH4LYPP0LL tag=W6F3UTC6B4GA type=del size=3634124 2024-06-04T15:59:28.646 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.646+0000 7f5e9aacc780 1 < completed part key=_multipart_K01DAK0M4I4M.2~ZX8IRYMB7K5L.0 size=1048576 2024-06-04T15:59:28.647 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.647+0000 7f5e9aacc780 1 < completed part key=_multipart_K01DAK0M4I4M.2~ZX8IRYMB7K5L.1 size=1048576 2024-06-04T15:59:28.648 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.649+0000 7f5e9aacc780 1 < completed part key=_multipart_K01DAK0M4I4M.2~ZX8IRYMB7K5L.2 size=979983 2024-06-04T15:59:28.651 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.650+0000 7f5e9aacc780 1 < completed multipart upload key=K01DAK0M4I4M upload=ZX8IRYMB7K5L tag=RYE1YIYWV1HV type=write size=4125711 2024-06-04T15:59:28.653 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.653+0000 7f5e9aacc780 1 > prepared part key=_multipart_Q2V1ICTBSCV1.2~QCZ3YQS4GXWL.0 size=1048576 2024-06-04T15:59:28.654 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.654+0000 7f5e9aacc780 1 > prepared part key=_multipart_Q2V1ICTBSCV1.2~QCZ3YQS4GXWL.1 size=1048576 2024-06-04T15:59:28.655 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.655+0000 7f5e9aacc780 1 > prepared part key=_multipart_Q2V1ICTBSCV1.2~QCZ3YQS4GXWL.2 size=627423 2024-06-04T15:59:28.655 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.655+0000 7f5e9aacc780 1 > prepared multipart upload key=Q2V1ICTBSCV1 upload=QCZ3YQS4GXWL tag=DA5R3B8OCB1G type=write size=3773151 2024-06-04T15:59:28.657 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.657+0000 7f5e9aacc780 1 < completed write operation key=9MPRI6LW3956 tag=BQRPEUMGX9DK type=write size=215667 2024-06-04T15:59:28.659 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.659+0000 7f5e9aacc780 1 > prepared part key=_multipart_GCPC9OJH7KWU.2~V3UZ2U9TJMOB.0 size=1048576 2024-06-04T15:59:28.661 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.660+0000 7f5e9aacc780 1 > prepared part key=_multipart_GCPC9OJH7KWU.2~V3UZ2U9TJMOB.1 size=1048576 2024-06-04T15:59:28.662 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.661+0000 7f5e9aacc780 1 > prepared part key=_multipart_GCPC9OJH7KWU.2~V3UZ2U9TJMOB.2 size=538066 2024-06-04T15:59:28.662 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.661+0000 7f5e9aacc780 1 > prepared multipart upload key=GCPC9OJH7KWU upload=V3UZ2U9TJMOB tag=FA2J0HCW6E2O type=write size=3683794 2024-06-04T15:59:28.663 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.663+0000 7f5e9aacc780 1 < completed part key=_multipart_1IKNQXU3Y2JJ.2~KUM75KHR43L0.0 size=1048576 2024-06-04T15:59:28.665 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.665+0000 7f5e9aacc780 1 < completed part key=_multipart_1IKNQXU3Y2JJ.2~KUM75KHR43L0.1 size=619574 2024-06-04T15:59:28.667 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.667+0000 7f5e9aacc780 1 < completed multipart upload key=1IKNQXU3Y2JJ upload=KUM75KHR43L0 tag=0OVCXYAXRRLP type=write size=2716726 2024-06-04T15:59:28.670 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.669+0000 7f5e9aacc780 1 > prepared part key=_multipart_JL69PUHT6NNT.2~3P3FSIC5SBLZ.0 size=1048576 2024-06-04T15:59:28.671 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.670+0000 7f5e9aacc780 1 > prepared part key=_multipart_JL69PUHT6NNT.2~3P3FSIC5SBLZ.1 size=1048576 2024-06-04T15:59:28.672 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.672+0000 7f5e9aacc780 1 > prepared part key=_multipart_JL69PUHT6NNT.2~3P3FSIC5SBLZ.2 size=569182 2024-06-04T15:59:28.672 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.672+0000 7f5e9aacc780 1 > prepared multipart upload key=JL69PUHT6NNT upload=3P3FSIC5SBLZ tag=73EHQCLI6T62 type=write size=3714910 2024-06-04T15:59:28.673 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.673+0000 7f5e9aacc780 1 < completed delete operation key=DY9JWHWNAUO1 tag=QMSVVZ98AVDI type=del 2024-06-04T15:59:28.675 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.674+0000 7f5e9aacc780 1 > prepared operation key=NJ5U8JTT32QK tag=J0PKP0HPV4JQ type=del size=3509423 2024-06-04T15:59:28.676 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.676+0000 7f5e9aacc780 1 < completed part key=_multipart_PNDPO2WUW7UX.2~LEUY3DMS62A3.0 size=1048576 2024-06-04T15:59:28.677 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.677+0000 7f5e9aacc780 1 < completed part key=_multipart_PNDPO2WUW7UX.2~LEUY3DMS62A3.1 size=1048576 2024-06-04T15:59:28.679 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.678+0000 7f5e9aacc780 1 < completed part key=_multipart_PNDPO2WUW7UX.2~LEUY3DMS62A3.2 size=257372 2024-06-04T15:59:28.681 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.681+0000 7f5e9aacc780 1 < completed multipart upload key=PNDPO2WUW7UX upload=LEUY3DMS62A3 tag=RI8V8IPW6HXD type=write size=3403100 2024-06-04T15:59:28.684 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.683+0000 7f5e9aacc780 1 > prepared part key=_multipart_NHPH4LYPP0LL.2~23K42GBNVU4L.0 size=1048576 2024-06-04T15:59:28.685 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.685+0000 7f5e9aacc780 1 > prepared part key=_multipart_NHPH4LYPP0LL.2~23K42GBNVU4L.1 size=1048576 2024-06-04T15:59:28.686 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.686+0000 7f5e9aacc780 1 > prepared part key=_multipart_NHPH4LYPP0LL.2~23K42GBNVU4L.2 size=760895 2024-06-04T15:59:28.686 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.686+0000 7f5e9aacc780 1 > prepared multipart upload key=NHPH4LYPP0LL upload=23K42GBNVU4L tag=9QP6DE93Y6OK type=write size=3906623 2024-06-04T15:59:28.688 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.687+0000 7f5e9aacc780 1 < completed delete operation key=XH0N984YVGKP tag=93TOLIGDM7ZP type=del 2024-06-04T15:59:28.691 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.691+0000 7f5e9aacc780 1 > prepared part key=_multipart_HD6SNICRCDLL.2~IDSIMK6YGGYO.0 size=1048576 2024-06-04T15:59:28.692 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.692+0000 7f5e9aacc780 1 > prepared part key=_multipart_HD6SNICRCDLL.2~IDSIMK6YGGYO.1 size=1048576 2024-06-04T15:59:28.693 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.693+0000 7f5e9aacc780 1 > prepared part key=_multipart_HD6SNICRCDLL.2~IDSIMK6YGGYO.2 size=621040 2024-06-04T15:59:28.693 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.693+0000 7f5e9aacc780 1 > prepared multipart upload key=HD6SNICRCDLL upload=IDSIMK6YGGYO tag=2HCH11YFLWDV type=write size=3766768 2024-06-04T15:59:28.695 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.695+0000 7f5e9aacc780 1 < completed write operation key=NHPH4LYPP0LL tag=22C1EEDJDFGI type=write size=788702 2024-06-04T15:59:28.696 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.696+0000 7f5e9aacc780 1 > prepared operation key=PASGIP872OVX tag=LX7X1AOT5FS5 type=del size=1663090 2024-06-04T15:59:28.698 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.698+0000 7f5e9aacc780 1 < completed part key=_multipart_SUBHZJ7HUV3H.2~6F5UYVTOLX2R.0 size=375929 2024-06-04T15:59:28.701 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.700+0000 7f5e9aacc780 1 < completed multipart upload key=SUBHZJ7HUV3H upload=6F5UYVTOLX2R tag=AN91ITFTIZDI type=write size=1424505 2024-06-04T15:59:28.701 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.701+0000 7f5e9aacc780 1 > prepared operation key=NHPH4LYPP0LL tag=2CYQK3FP42OU type=del size=1057935 2024-06-04T15:59:28.703 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.702+0000 7f5e9aacc780 1 < completed delete operation key=QJA2JPATITNH tag=BN4Y653JZ735 type=del 2024-06-04T15:59:28.705 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.705+0000 7f5e9aacc780 1 > prepared part key=_multipart_Q4OFQI0F5YLG.2~ZI70EDXZ1QLM.0 size=1048576 2024-06-04T15:59:28.706 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.706+0000 7f5e9aacc780 1 > prepared part key=_multipart_Q4OFQI0F5YLG.2~ZI70EDXZ1QLM.1 size=2341 2024-06-04T15:59:28.707 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.706+0000 7f5e9aacc780 1 > prepared multipart upload key=Q4OFQI0F5YLG upload=ZI70EDXZ1QLM tag=MPP58DSGHZDB type=write size=2099493 2024-06-04T15:59:28.708 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.708+0000 7f5e9aacc780 1 < completed part key=_multipart_Q2V1ICTBSCV1.2~Z1UURVAPK0TT.0 size=1048576 2024-06-04T15:59:28.709 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.709+0000 7f5e9aacc780 1 < completed part key=_multipart_Q2V1ICTBSCV1.2~Z1UURVAPK0TT.1 size=1048576 2024-06-04T15:59:28.710 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.710+0000 7f5e9aacc780 1 < completed part key=_multipart_Q2V1ICTBSCV1.2~Z1UURVAPK0TT.2 size=1043490 2024-06-04T15:59:28.712 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.712+0000 7f5e9aacc780 1 < completed multipart upload key=Q2V1ICTBSCV1 upload=Z1UURVAPK0TT tag=CJBY03PHY410 type=write size=4189218 2024-06-04T15:59:28.715 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.715+0000 7f5e9aacc780 1 > prepared part key=_multipart_2BT2AXKB1RTA.2~U27617Y4MD75.0 size=1048576 2024-06-04T15:59:28.716 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.715+0000 7f5e9aacc780 1 > prepared part key=_multipart_2BT2AXKB1RTA.2~U27617Y4MD75.1 size=1048576 2024-06-04T15:59:28.717 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.717+0000 7f5e9aacc780 1 > prepared part key=_multipart_2BT2AXKB1RTA.2~U27617Y4MD75.2 size=225824 2024-06-04T15:59:28.717 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.717+0000 7f5e9aacc780 1 > prepared multipart upload key=2BT2AXKB1RTA upload=U27617Y4MD75 tag=LATL96CMD7MS type=write size=3371552 2024-06-04T15:59:28.718 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.718+0000 7f5e9aacc780 1 < completed delete operation key=JL69PUHT6NNT tag=5NDSIKNO03IM type=del 2024-06-04T15:59:28.720 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.720+0000 7f5e9aacc780 1 > prepared operation key=NJ5U8JTT32QK tag=O8T04NFSLP2V type=del size=3135208 2024-06-04T15:59:28.721 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.721+0000 7f5e9aacc780 1 < completed part key=_multipart_NJ5U8JTT32QK.2~43FLWVO3U95L.0 size=1048576 2024-06-04T15:59:28.722 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.722+0000 7f5e9aacc780 1 < completed part key=_multipart_NJ5U8JTT32QK.2~43FLWVO3U95L.1 size=590833 2024-06-04T15:59:28.724 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.724+0000 7f5e9aacc780 1 < completed multipart upload key=NJ5U8JTT32QK upload=43FLWVO3U95L tag=0MWR519DTV40 type=write size=2687985 2024-06-04T15:59:28.726 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.726+0000 7f5e9aacc780 1 > prepared operation key=NJ5U8JTT32QK tag=MW29BTSRPNYR type=write size=270171 2024-06-04T15:59:28.727 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.727+0000 7f5e9aacc780 1 < completed delete operation key=QUIVPH3OB6KN tag=6ST4UMU3MRQ8 type=del 2024-06-04T15:59:28.730 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.730+0000 7f5e9aacc780 1 > prepared part key=_multipart_QUIVPH3OB6KN.2~X4O9PWY4M833.0 size=879402 2024-06-04T15:59:28.730 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.730+0000 7f5e9aacc780 1 > prepared multipart upload key=QUIVPH3OB6KN upload=X4O9PWY4M833 tag=KFJ1AHYYT3VG type=write size=1927978 2024-06-04T15:59:28.731 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.731+0000 7f5e9aacc780 1 < completed delete operation key=TUGKW7F4V9NO tag=PIPJBNS7LHQ3 type=del 2024-06-04T15:59:28.733 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.732+0000 7f5e9aacc780 1 > prepared operation key=QUIVPH3OB6KN tag=7CK9522TD9C7 type=del size=2825112 2024-06-04T15:59:28.734 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.734+0000 7f5e9aacc780 1 < completed delete operation key=Q4OFQI0F5YLG tag=KD9T4GD0C2O9 type=del 2024-06-04T15:59:28.736 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.735+0000 7f5e9aacc780 1 > prepared operation key=9MPRI6LW3956 tag=6A0JZXOQNXVC type=del size=3634719 2024-06-04T15:59:28.738 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.738+0000 7f5e9aacc780 1 < suggested remove operation key=NHPH4LYPP0LL tag=W6F3UTC6B4GA type=del 2024-06-04T15:59:28.740 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.740+0000 7f5e9aacc780 1 > prepared operation key=Q4OFQI0F5YLG tag=65KST7CYZXTV type=del size=1360313 2024-06-04T15:59:28.741 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.741+0000 7f5e9aacc780 1 < completed part key=_multipart_Q2V1ICTBSCV1.2~QCZ3YQS4GXWL.0 size=1048576 2024-06-04T15:59:28.743 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.742+0000 7f5e9aacc780 1 < completed part key=_multipart_Q2V1ICTBSCV1.2~QCZ3YQS4GXWL.1 size=1048576 2024-06-04T15:59:28.744 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.743+0000 7f5e9aacc780 1 < completed part key=_multipart_Q2V1ICTBSCV1.2~QCZ3YQS4GXWL.2 size=627423 2024-06-04T15:59:28.746 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.746+0000 7f5e9aacc780 1 < completed multipart upload key=Q2V1ICTBSCV1 upload=QCZ3YQS4GXWL tag=DA5R3B8OCB1G type=write size=3773151 2024-06-04T15:59:28.748 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.747+0000 7f5e9aacc780 1 > prepared operation key=NHPH4LYPP0LL tag=HL10MZGLGIVZ type=del size=2241799 2024-06-04T15:59:28.749 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.749+0000 7f5e9aacc780 1 < completed part key=_multipart_GCPC9OJH7KWU.2~V3UZ2U9TJMOB.0 size=1048576 2024-06-04T15:59:28.750 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.750+0000 7f5e9aacc780 1 < completed part key=_multipart_GCPC9OJH7KWU.2~V3UZ2U9TJMOB.1 size=1048576 2024-06-04T15:59:28.751 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.751+0000 7f5e9aacc780 1 < completed part key=_multipart_GCPC9OJH7KWU.2~V3UZ2U9TJMOB.2 size=538066 2024-06-04T15:59:28.754 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.753+0000 7f5e9aacc780 1 < completed multipart upload key=GCPC9OJH7KWU upload=V3UZ2U9TJMOB tag=FA2J0HCW6E2O type=write size=3683794 2024-06-04T15:59:28.756 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.756+0000 7f5e9aacc780 1 > prepared part key=_multipart_QJA2JPATITNH.2~3VYCE1Z1ZJRR.0 size=374553 2024-06-04T15:59:28.756 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.756+0000 7f5e9aacc780 1 > prepared multipart upload key=QJA2JPATITNH upload=3VYCE1Z1ZJRR tag=FXKCW8958AJO type=write size=1423129 2024-06-04T15:59:28.757 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.757+0000 7f5e9aacc780 1 < completed part key=_multipart_JL69PUHT6NNT.2~3P3FSIC5SBLZ.0 size=1048576 2024-06-04T15:59:28.758 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.758+0000 7f5e9aacc780 1 < completed part key=_multipart_JL69PUHT6NNT.2~3P3FSIC5SBLZ.1 size=1048576 2024-06-04T15:59:28.961 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.961+0000 7f5e9aacc780 1 < completed part key=_multipart_JL69PUHT6NNT.2~3P3FSIC5SBLZ.2 size=569182 2024-06-04T15:59:28.964 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.963+0000 7f5e9aacc780 1 < completed multipart upload key=JL69PUHT6NNT upload=3P3FSIC5SBLZ tag=73EHQCLI6T62 type=write size=3714910 2024-06-04T15:59:28.967 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.967+0000 7f5e9aacc780 1 > prepared part key=_multipart_DY9JWHWNAUO1.2~9ZCEDW2K0WGU.0 size=1048576 2024-06-04T15:59:28.968 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.967+0000 7f5e9aacc780 1 > prepared part key=_multipart_DY9JWHWNAUO1.2~9ZCEDW2K0WGU.1 size=994524 2024-06-04T15:59:28.968 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.967+0000 7f5e9aacc780 1 > prepared multipart upload key=DY9JWHWNAUO1 upload=9ZCEDW2K0WGU tag=BKUZFWHYCPUX type=write size=3091676 2024-06-04T15:59:28.969 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.969+0000 7f5e9aacc780 1 < completed delete operation key=NJ5U8JTT32QK tag=J0PKP0HPV4JQ type=del 2024-06-04T15:59:28.972 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.971+0000 7f5e9aacc780 1 > prepared operation key=SUBHZJ7HUV3H tag=1IZ16XY56U1M type=del size=204915 2024-06-04T15:59:28.973 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.973+0000 7f5e9aacc780 1 < completed part key=_multipart_NHPH4LYPP0LL.2~23K42GBNVU4L.0 size=1048576 2024-06-04T15:59:28.975 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.974+0000 7f5e9aacc780 1 < completed part key=_multipart_NHPH4LYPP0LL.2~23K42GBNVU4L.1 size=1048576 2024-06-04T15:59:28.976 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.976+0000 7f5e9aacc780 1 < completed part key=_multipart_NHPH4LYPP0LL.2~23K42GBNVU4L.2 size=760895 2024-06-04T15:59:28.980 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.980+0000 7f5e9aacc780 1 < completed multipart upload key=NHPH4LYPP0LL upload=23K42GBNVU4L tag=9QP6DE93Y6OK type=write size=3906623 2024-06-04T15:59:28.983 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.983+0000 7f5e9aacc780 1 > prepared part key=_multipart_XH0N984YVGKP.2~K0GBZI9OE3AZ.0 size=1048576 2024-06-04T15:59:28.984 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.984+0000 7f5e9aacc780 1 > prepared part key=_multipart_XH0N984YVGKP.2~K0GBZI9OE3AZ.1 size=1048576 2024-06-04T15:59:28.985 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.985+0000 7f5e9aacc780 1 > prepared part key=_multipart_XH0N984YVGKP.2~K0GBZI9OE3AZ.2 size=296600 2024-06-04T15:59:28.985 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.985+0000 7f5e9aacc780 1 > prepared multipart upload key=XH0N984YVGKP upload=K0GBZI9OE3AZ tag=P37AG18JQEV3 type=write size=3442328 2024-06-04T15:59:28.987 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.987+0000 7f5e9aacc780 1 < completed part key=_multipart_HD6SNICRCDLL.2~IDSIMK6YGGYO.0 size=1048576 2024-06-04T15:59:28.989 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.989+0000 7f5e9aacc780 1 < completed part key=_multipart_HD6SNICRCDLL.2~IDSIMK6YGGYO.1 size=1048576 2024-06-04T15:59:28.990 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.990+0000 7f5e9aacc780 1 < completed part key=_multipart_HD6SNICRCDLL.2~IDSIMK6YGGYO.2 size=621040 2024-06-04T15:59:28.993 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.993+0000 7f5e9aacc780 1 < completed multipart upload key=HD6SNICRCDLL upload=IDSIMK6YGGYO tag=2HCH11YFLWDV type=write size=3766768 2024-06-04T15:59:28.995 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.995+0000 7f5e9aacc780 1 > prepared operation key=AOCB36Y5Q7B0 tag=OP9G87W0Q030 type=del size=2436709 2024-06-04T15:59:28.996 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.996+0000 7f5e9aacc780 1 < canceled operation key=PASGIP872OVX tag=LX7X1AOT5FS5 type=del size=1663090 2024-06-04T15:59:28.998 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.997+0000 7f5e9aacc780 1 > prepared operation key=4W5HB9WQQHR6 tag=1TI0770CHRSM type=del size=3963794 2024-06-04T15:59:28.999 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:28.999+0000 7f5e9aacc780 -1 < failed to complete operation key=NHPH4LYPP0LL tag=2CYQK3FP42OU type=del size=1057935: (22) Invalid argument 2024-06-04T15:59:29.002 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.002+0000 7f5e9aacc780 1 > prepared part key=_multipart_DY9JWHWNAUO1.2~EM2J4O9WDMN8.0 size=1048576 2024-06-04T15:59:29.003 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.003+0000 7f5e9aacc780 1 > prepared part key=_multipart_DY9JWHWNAUO1.2~EM2J4O9WDMN8.1 size=159892 2024-06-04T15:59:29.003 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.003+0000 7f5e9aacc780 1 > prepared multipart upload key=DY9JWHWNAUO1 upload=EM2J4O9WDMN8 tag=KL5BQZL3HLIR type=write size=2257044 2024-06-04T15:59:29.005 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.005+0000 7f5e9aacc780 1 < completed part key=_multipart_Q4OFQI0F5YLG.2~ZI70EDXZ1QLM.0 size=1048576 2024-06-04T15:59:29.006 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.006+0000 7f5e9aacc780 1 < completed part key=_multipart_Q4OFQI0F5YLG.2~ZI70EDXZ1QLM.1 size=2341 2024-06-04T15:59:29.009 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.008+0000 7f5e9aacc780 1 < completed multipart upload key=Q4OFQI0F5YLG upload=ZI70EDXZ1QLM tag=MPP58DSGHZDB type=write size=2099493 2024-06-04T15:59:29.010 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.010+0000 7f5e9aacc780 1 > prepared operation key=TUGKW7F4V9NO tag=E9PBV18LG44J type=del size=518872 2024-06-04T15:59:29.012 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.012+0000 7f5e9aacc780 1 < completed part key=_multipart_2BT2AXKB1RTA.2~U27617Y4MD75.0 size=1048576 2024-06-04T15:59:29.014 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.013+0000 7f5e9aacc780 1 < completed part key=_multipart_2BT2AXKB1RTA.2~U27617Y4MD75.1 size=1048576 2024-06-04T15:59:29.015 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.015+0000 7f5e9aacc780 1 < completed part key=_multipart_2BT2AXKB1RTA.2~U27617Y4MD75.2 size=225824 2024-06-04T15:59:29.018 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.017+0000 7f5e9aacc780 1 < completed multipart upload key=2BT2AXKB1RTA upload=U27617Y4MD75 tag=LATL96CMD7MS type=write size=3371552 2024-06-04T15:59:29.019 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.019+0000 7f5e9aacc780 1 > prepared operation key=QJA2JPATITNH tag=SNP47JYJMAMG type=del size=1054907 2024-06-04T15:59:29.021 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.021+0000 7f5e9aacc780 1 < completed delete operation key=NJ5U8JTT32QK tag=O8T04NFSLP2V type=del 2024-06-04T15:59:29.023 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.022+0000 7f5e9aacc780 1 > prepared operation key=AOCB36Y5Q7B0 tag=YBB9JBY26PSA type=del size=2495868 2024-06-04T15:59:29.025 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.024+0000 7f5e9aacc780 1 < completed write operation key=NJ5U8JTT32QK tag=MW29BTSRPNYR type=write size=270171 2024-06-04T15:59:29.026 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.026+0000 7f5e9aacc780 1 > prepared operation key=JL69PUHT6NNT tag=AYHO7GI33Y4U type=del size=234330 2024-06-04T15:59:29.028 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.028+0000 7f5e9aacc780 1 < completed part key=_multipart_QUIVPH3OB6KN.2~X4O9PWY4M833.0 size=879402 2024-06-04T15:59:29.030 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.030+0000 7f5e9aacc780 1 < completed multipart upload key=QUIVPH3OB6KN upload=X4O9PWY4M833 tag=KFJ1AHYYT3VG type=write size=1927978 2024-06-04T15:59:29.032 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.032+0000 7f5e9aacc780 1 > prepared operation key=NJ5U8JTT32QK tag=DOR9RDP8AE05 type=del size=758186 2024-06-04T15:59:29.035 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.034+0000 7f5e9aacc780 1 < suggested update operation key=QUIVPH3OB6KN tag=7CK9522TD9C7 type=del size=2825112 2024-06-04T15:59:29.036 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.036+0000 7f5e9aacc780 1 > prepared operation key=UW5LVIBG09SV tag=7SDZT3SN974W type=del size=620003 2024-06-04T15:59:29.038 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.037+0000 7f5e9aacc780 1 < completed delete operation key=9MPRI6LW3956 tag=6A0JZXOQNXVC type=del 2024-06-04T15:59:29.041 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.040+0000 7f5e9aacc780 1 > prepared part key=_multipart_QUIVPH3OB6KN.2~TABIC1LBVWZ2.0 size=422654 2024-06-04T15:59:29.041 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.040+0000 7f5e9aacc780 1 > prepared multipart upload key=QUIVPH3OB6KN upload=TABIC1LBVWZ2 tag=HH59JQZPEH52 type=write size=1471230 2024-06-04T15:59:29.042 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.042+0000 7f5e9aacc780 1 < completed delete operation key=Q4OFQI0F5YLG tag=65KST7CYZXTV type=del 2024-06-04T15:59:29.045 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.045+0000 7f5e9aacc780 1 > prepared part key=_multipart_B0HK5FJ2RGJE.2~INWOP9PR1TSW.0 size=595406 2024-06-04T15:59:29.045 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.045+0000 7f5e9aacc780 1 > prepared multipart upload key=B0HK5FJ2RGJE upload=INWOP9PR1TSW tag=CGS6NYFZSPT3 type=write size=1643982 2024-06-04T15:59:29.046 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.046+0000 7f5e9aacc780 1 < completed delete operation key=NHPH4LYPP0LL tag=HL10MZGLGIVZ type=del 2024-06-04T15:59:29.049 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.049+0000 7f5e9aacc780 1 > prepared part key=_multipart_4W5HB9WQQHR6.2~IDB14W6A6JBC.0 size=1048576 2024-06-04T15:59:29.050 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.050+0000 7f5e9aacc780 1 > prepared part key=_multipart_4W5HB9WQQHR6.2~IDB14W6A6JBC.1 size=1048576 2024-06-04T15:59:29.051 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.051+0000 7f5e9aacc780 1 > prepared part key=_multipart_4W5HB9WQQHR6.2~IDB14W6A6JBC.2 size=431864 2024-06-04T15:59:29.051 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.051+0000 7f5e9aacc780 1 > prepared multipart upload key=4W5HB9WQQHR6 upload=IDB14W6A6JBC tag=K341NFHUAWCI type=write size=3577592 2024-06-04T15:59:29.053 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.052+0000 7f5e9aacc780 1 < completed part key=_multipart_QJA2JPATITNH.2~3VYCE1Z1ZJRR.0 size=374553 2024-06-04T15:59:29.055 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.055+0000 7f5e9aacc780 1 < completed multipart upload key=QJA2JPATITNH upload=3VYCE1Z1ZJRR tag=FXKCW8958AJO type=write size=1423129 2024-06-04T15:59:29.057 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.057+0000 7f5e9aacc780 1 > prepared operation key=7S9S3MIG7WIT tag=5ZIZL83HB79B type=del size=1626093 2024-06-04T15:59:29.058 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.058+0000 7f5e9aacc780 1 < completed part key=_multipart_DY9JWHWNAUO1.2~9ZCEDW2K0WGU.0 size=1048576 2024-06-04T15:59:29.059 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.059+0000 7f5e9aacc780 1 < completed part key=_multipart_DY9JWHWNAUO1.2~9ZCEDW2K0WGU.1 size=994524 2024-06-04T15:59:29.062 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.062+0000 7f5e9aacc780 1 < completed multipart upload key=DY9JWHWNAUO1 upload=9ZCEDW2K0WGU tag=BKUZFWHYCPUX type=write size=3091676 2024-06-04T15:59:29.064 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.064+0000 7f5e9aacc780 1 > prepared part key=_multipart_4W5HB9WQQHR6.2~ZGXFKAQM62UU.0 size=1048576 2024-06-04T15:59:29.065 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.065+0000 7f5e9aacc780 1 > prepared part key=_multipart_4W5HB9WQQHR6.2~ZGXFKAQM62UU.1 size=1048576 2024-06-04T15:59:29.066 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.066+0000 7f5e9aacc780 1 > prepared part key=_multipart_4W5HB9WQQHR6.2~ZGXFKAQM62UU.2 size=266210 2024-06-04T15:59:29.067 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.066+0000 7f5e9aacc780 1 > prepared multipart upload key=4W5HB9WQQHR6 upload=ZGXFKAQM62UU tag=0416RF9XWMQ2 type=write size=3411938 2024-06-04T15:59:29.069 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.069+0000 7f5e9aacc780 1 < suggested remove operation key=SUBHZJ7HUV3H tag=1IZ16XY56U1M type=del 2024-06-04T15:59:29.070 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.070+0000 7f5e9aacc780 1 > prepared operation key=TUGKW7F4V9NO tag=QYHME3QWBR1F type=del size=2752332 2024-06-04T15:59:29.072 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.072+0000 7f5e9aacc780 1 < completed part key=_multipart_XH0N984YVGKP.2~K0GBZI9OE3AZ.0 size=1048576 2024-06-04T15:59:29.073 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.073+0000 7f5e9aacc780 1 < completed part key=_multipart_XH0N984YVGKP.2~K0GBZI9OE3AZ.1 size=1048576 2024-06-04T15:59:29.074 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.074+0000 7f5e9aacc780 1 < completed part key=_multipart_XH0N984YVGKP.2~K0GBZI9OE3AZ.2 size=296600 2024-06-04T15:59:29.076 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.076+0000 7f5e9aacc780 1 < completed multipart upload key=XH0N984YVGKP upload=K0GBZI9OE3AZ tag=P37AG18JQEV3 type=write size=3442328 2024-06-04T15:59:29.079 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.079+0000 7f5e9aacc780 1 > prepared part key=_multipart_7S9S3MIG7WIT.2~OERPYT10XX9T.0 size=12507 2024-06-04T15:59:29.079 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.079+0000 7f5e9aacc780 1 > prepared multipart upload key=7S9S3MIG7WIT upload=OERPYT10XX9T tag=9MU61PG2GEDA type=write size=1061083 2024-06-04T15:59:29.081 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.080+0000 7f5e9aacc780 1 < completed delete operation key=AOCB36Y5Q7B0 tag=OP9G87W0Q030 type=del 2024-06-04T15:59:29.082 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.082+0000 7f5e9aacc780 1 > prepared operation key=AOCB36Y5Q7B0 tag=S4LAN8Z96P2Y type=del size=2067695 2024-06-04T15:59:29.085 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.085+0000 7f5e9aacc780 1 < suggested remove operation key=4W5HB9WQQHR6 tag=1TI0770CHRSM type=del 2024-06-04T15:59:29.087 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.087+0000 7f5e9aacc780 1 > prepared operation key=K01DAK0M4I4M tag=95VEO9IJR23E type=write size=699515 2024-06-04T15:59:29.089 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.089+0000 7f5e9aacc780 1 < completed part key=_multipart_DY9JWHWNAUO1.2~EM2J4O9WDMN8.0 size=1048576 2024-06-04T15:59:29.090 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.090+0000 7f5e9aacc780 1 < completed part key=_multipart_DY9JWHWNAUO1.2~EM2J4O9WDMN8.1 size=159892 2024-06-04T15:59:29.093 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.093+0000 7f5e9aacc780 1 < completed multipart upload key=DY9JWHWNAUO1 upload=EM2J4O9WDMN8 tag=KL5BQZL3HLIR type=write size=2257044 2024-06-04T15:59:29.095 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.094+0000 7f5e9aacc780 1 > prepared operation key=QJA2JPATITNH tag=3TYHEQG2OMYN type=write size=531099 2024-06-04T15:59:29.096 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.096+0000 7f5e9aacc780 1 < canceled operation key=TUGKW7F4V9NO tag=E9PBV18LG44J type=del size=518872 2024-06-04T15:59:29.097 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.097+0000 7f5e9aacc780 1 > prepared operation key=AOCB36Y5Q7B0 tag=NPES54UY4L5H type=del size=630594 2024-06-04T15:59:29.099 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.099+0000 7f5e9aacc780 1 < completed delete operation key=QJA2JPATITNH tag=SNP47JYJMAMG type=del 2024-06-04T15:59:29.100 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.100+0000 7f5e9aacc780 1 > prepared operation key=Q4OFQI0F5YLG tag=O76R7QZC2EW4 type=del size=2934135 2024-06-04T15:59:29.102 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.101+0000 7f5e9aacc780 1 < completed delete operation key=AOCB36Y5Q7B0 tag=YBB9JBY26PSA type=del 2024-06-04T15:59:29.103 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.103+0000 7f5e9aacc780 1 > prepared operation key=JL69PUHT6NNT tag=TGR7HE689UC7 type=del size=2796070 2024-06-04T15:59:29.106 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.106+0000 7f5e9aacc780 1 < suggested remove operation key=JL69PUHT6NNT tag=AYHO7GI33Y4U type=del 2024-06-04T15:59:29.109 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.108+0000 7f5e9aacc780 1 > prepared operation key=GTRMEQJK675Z tag=A41ZWHQ1J6LU type=del size=1059950 2024-06-04T15:59:29.110 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.109+0000 7f5e9aacc780 1 < canceled operation key=NJ5U8JTT32QK tag=DOR9RDP8AE05 type=del size=758186 2024-06-04T15:59:29.112 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.112+0000 7f5e9aacc780 1 > prepared part key=_multipart_4W5HB9WQQHR6.2~2IH9Q3VWGSXQ.0 size=1048576 2024-06-04T15:59:29.114 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.113+0000 7f5e9aacc780 1 > prepared part key=_multipart_4W5HB9WQQHR6.2~2IH9Q3VWGSXQ.1 size=12251 2024-06-04T15:59:29.114 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.113+0000 7f5e9aacc780 1 > prepared multipart upload key=4W5HB9WQQHR6 upload=2IH9Q3VWGSXQ tag=5JEGVBFF001M type=write size=2109403 2024-06-04T15:59:29.115 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.115+0000 7f5e9aacc780 1 < canceled operation key=UW5LVIBG09SV tag=7SDZT3SN974W type=del size=620003 2024-06-04T15:59:29.118 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.118+0000 7f5e9aacc780 1 > prepared part key=_multipart_PASGIP872OVX.2~PCI1SQI2QAQ3.0 size=1048576 2024-06-04T15:59:29.119 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.119+0000 7f5e9aacc780 1 > prepared part key=_multipart_PASGIP872OVX.2~PCI1SQI2QAQ3.1 size=361307 2024-06-04T15:59:29.119 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.119+0000 7f5e9aacc780 1 > prepared multipart upload key=PASGIP872OVX upload=PCI1SQI2QAQ3 tag=6VIDRR7NWGL8 type=write size=2458459 2024-06-04T15:59:29.120 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.119+0000 7f5e9aacc780 1 < canceled part key=_multipart_QUIVPH3OB6KN.2~TABIC1LBVWZ2.0 size=422654 2024-06-04T15:59:29.123 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.123+0000 7f5e9aacc780 1 < canceled multipart upload key=QUIVPH3OB6KN upload=TABIC1LBVWZ2 tag=HH59JQZPEH52 type=write size=1471230 2024-06-04T15:59:29.125 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.124+0000 7f5e9aacc780 1 > prepared operation key=GTRMEQJK675Z tag=IET7DLVEO45F type=del size=720559 2024-06-04T15:59:29.126 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.126+0000 7f5e9aacc780 1 < completed part key=_multipart_B0HK5FJ2RGJE.2~INWOP9PR1TSW.0 size=595406 2024-06-04T15:59:29.128 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.128+0000 7f5e9aacc780 1 < completed multipart upload key=B0HK5FJ2RGJE upload=INWOP9PR1TSW tag=CGS6NYFZSPT3 type=write size=1643982 2024-06-04T15:59:29.131 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.131+0000 7f5e9aacc780 1 > prepared part key=_multipart_DY9JWHWNAUO1.2~CD0R0SV1OVXU.0 size=748067 2024-06-04T15:59:29.131 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.131+0000 7f5e9aacc780 1 > prepared multipart upload key=DY9JWHWNAUO1 upload=CD0R0SV1OVXU tag=4WL1TKSNXH0B type=write size=1796643 2024-06-04T15:59:29.133 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.133+0000 7f5e9aacc780 1 < completed part key=_multipart_4W5HB9WQQHR6.2~IDB14W6A6JBC.0 size=1048576 2024-06-04T15:59:29.134 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.133+0000 7f5e9aacc780 1 < completed part key=_multipart_4W5HB9WQQHR6.2~IDB14W6A6JBC.1 size=1048576 2024-06-04T15:59:29.135 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.134+0000 7f5e9aacc780 1 < completed part key=_multipart_4W5HB9WQQHR6.2~IDB14W6A6JBC.2 size=431864 2024-06-04T15:59:29.137 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.137+0000 7f5e9aacc780 1 < completed multipart upload key=4W5HB9WQQHR6 upload=IDB14W6A6JBC tag=K341NFHUAWCI type=write size=3577592 2024-06-04T15:59:29.140 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.139+0000 7f5e9aacc780 1 > prepared part key=_multipart_1IKNQXU3Y2JJ.2~U61WCDC6643G.0 size=1048576 2024-06-04T15:59:29.141 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.140+0000 7f5e9aacc780 1 > prepared part key=_multipart_1IKNQXU3Y2JJ.2~U61WCDC6643G.1 size=383973 2024-06-04T15:59:29.141 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.140+0000 7f5e9aacc780 1 > prepared multipart upload key=1IKNQXU3Y2JJ upload=U61WCDC6643G tag=NP24GBVOU3ZD type=write size=2481125 2024-06-04T15:59:29.142 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.142+0000 7f5e9aacc780 1 < completed delete operation key=7S9S3MIG7WIT tag=5ZIZL83HB79B type=del 2024-06-04T15:59:29.143 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.143+0000 7f5e9aacc780 1 > prepared operation key=UTZHANL9ER2Q tag=0HIT8DS4GFB0 type=write size=664534 2024-06-04T15:59:29.145 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.144+0000 7f5e9aacc780 1 < completed part key=_multipart_4W5HB9WQQHR6.2~ZGXFKAQM62UU.0 size=1048576 2024-06-04T15:59:29.146 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.146+0000 7f5e9aacc780 1 < completed part key=_multipart_4W5HB9WQQHR6.2~ZGXFKAQM62UU.1 size=1048576 2024-06-04T15:59:29.147 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.147+0000 7f5e9aacc780 1 < completed part key=_multipart_4W5HB9WQQHR6.2~ZGXFKAQM62UU.2 size=266210 2024-06-04T15:59:29.149 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.149+0000 7f5e9aacc780 1 < completed multipart upload key=4W5HB9WQQHR6 upload=ZGXFKAQM62UU tag=0416RF9XWMQ2 type=write size=3411938 2024-06-04T15:59:29.151 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.150+0000 7f5e9aacc780 1 > prepared operation key=9MPRI6LW3956 tag=QB11MGIGSZ8O type=del size=3035924 2024-06-04T15:59:29.152 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.152+0000 7f5e9aacc780 1 < completed delete operation key=TUGKW7F4V9NO tag=QYHME3QWBR1F type=del 2024-06-04T15:59:29.154 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.153+0000 7f5e9aacc780 1 > prepared operation key=Q2V1ICTBSCV1 tag=UO36YGSX9F25 type=del size=11272 2024-06-04T15:59:29.154 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.154+0000 7f5e9aacc780 1 < canceled part key=_multipart_7S9S3MIG7WIT.2~OERPYT10XX9T.0 size=12507 2024-06-04T15:59:29.156 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.156+0000 7f5e9aacc780 1 < canceled multipart upload key=7S9S3MIG7WIT upload=OERPYT10XX9T tag=9MU61PG2GEDA type=write size=1061083 2024-06-04T15:59:29.160 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.160+0000 7f5e9aacc780 1 > prepared part key=_multipart_XH0N984YVGKP.2~NB95C2VRYIQT.0 size=560960 2024-06-04T15:59:29.160 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.160+0000 7f5e9aacc780 1 > prepared multipart upload key=XH0N984YVGKP upload=NB95C2VRYIQT tag=5SJUKFZ3XI9K type=write size=1609536 2024-06-04T15:59:29.162 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.161+0000 7f5e9aacc780 1 < completed delete operation key=AOCB36Y5Q7B0 tag=S4LAN8Z96P2Y type=del 2024-06-04T15:59:29.163 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.163+0000 7f5e9aacc780 1 > prepared operation key=1IKNQXU3Y2JJ tag=THO2JMM5TNT3 type=write size=649510 2024-06-04T15:59:29.165 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.165+0000 7f5e9aacc780 1 < completed write operation key=K01DAK0M4I4M tag=95VEO9IJR23E type=write size=699515 2024-06-04T15:59:29.166 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.166+0000 7f5e9aacc780 1 > prepared operation key=03ZNYG3WLMP4 tag=TWRUHQUZDN6C type=del size=2437909 2024-06-04T15:59:29.168 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.168+0000 7f5e9aacc780 1 < completed write operation key=QJA2JPATITNH tag=3TYHEQG2OMYN type=write size=531099 2024-06-04T15:59:29.169 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.169+0000 7f5e9aacc780 1 > prepared operation key=Q4OFQI0F5YLG tag=X03Q2Q2GTM1I type=del size=2623454 2024-06-04T15:59:29.171 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.170+0000 7f5e9aacc780 1 < completed delete operation key=AOCB36Y5Q7B0 tag=NPES54UY4L5H type=del 2024-06-04T15:59:29.174 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.173+0000 7f5e9aacc780 1 > prepared part key=_multipart_A8O0S3S45RGM.2~0SK986PW0WWH.0 size=243886 2024-06-04T15:59:29.174 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.173+0000 7f5e9aacc780 1 > prepared multipart upload key=A8O0S3S45RGM upload=0SK986PW0WWH tag=A9N2P6THRURH type=write size=1292462 2024-06-04T15:59:29.175 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.175+0000 7f5e9aacc780 1 < completed delete operation key=Q4OFQI0F5YLG tag=O76R7QZC2EW4 type=del 2024-06-04T15:59:29.177 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.177+0000 7f5e9aacc780 1 > prepared part key=_multipart_Q2V1ICTBSCV1.2~YNXGKK6AOOCU.0 size=1048576 2024-06-04T15:59:29.178 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.178+0000 7f5e9aacc780 1 > prepared part key=_multipart_Q2V1ICTBSCV1.2~YNXGKK6AOOCU.1 size=1048576 2024-06-04T15:59:29.179 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.179+0000 7f5e9aacc780 1 > prepared part key=_multipart_Q2V1ICTBSCV1.2~YNXGKK6AOOCU.2 size=729893 2024-06-04T15:59:29.179 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.179+0000 7f5e9aacc780 1 > prepared multipart upload key=Q2V1ICTBSCV1 upload=YNXGKK6AOOCU tag=W2W5I9494LMC type=write size=3875621 2024-06-04T15:59:29.181 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.180+0000 7f5e9aacc780 -1 < failed to complete operation key=JL69PUHT6NNT tag=TGR7HE689UC7 type=del size=2796070: (22) Invalid argument 2024-06-04T15:59:29.183 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.183+0000 7f5e9aacc780 1 > prepared part key=_multipart_1IKNQXU3Y2JJ.2~6NHAS2FAOOY1.0 size=290515 2024-06-04T15:59:29.183 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.183+0000 7f5e9aacc780 1 > prepared multipart upload key=1IKNQXU3Y2JJ upload=6NHAS2FAOOY1 tag=T6VS45M79JLF type=write size=1339091 2024-06-04T15:59:29.184 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.184+0000 7f5e9aacc780 1 < completed delete operation key=GTRMEQJK675Z tag=A41ZWHQ1J6LU type=del 2024-06-04T15:59:29.187 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.187+0000 7f5e9aacc780 1 > prepared part key=_multipart_TUGKW7F4V9NO.2~ABZE5O927P5Y.0 size=1048576 2024-06-04T15:59:29.188 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.188+0000 7f5e9aacc780 1 > prepared part key=_multipart_TUGKW7F4V9NO.2~ABZE5O927P5Y.1 size=749276 2024-06-04T15:59:29.188 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.188+0000 7f5e9aacc780 1 > prepared multipart upload key=TUGKW7F4V9NO upload=ABZE5O927P5Y tag=17SF7NU826O1 type=write size=2846428 2024-06-04T15:59:29.190 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.189+0000 7f5e9aacc780 1 < completed part key=_multipart_4W5HB9WQQHR6.2~2IH9Q3VWGSXQ.0 size=1048576 2024-06-04T15:59:29.191 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.191+0000 7f5e9aacc780 1 < completed part key=_multipart_4W5HB9WQQHR6.2~2IH9Q3VWGSXQ.1 size=12251 2024-06-04T15:59:29.193 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.193+0000 7f5e9aacc780 1 < completed multipart upload key=4W5HB9WQQHR6 upload=2IH9Q3VWGSXQ tag=5JEGVBFF001M type=write size=2109403 2024-06-04T15:59:29.195 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.195+0000 7f5e9aacc780 1 > prepared operation key=03ZNYG3WLMP4 tag=2N0W87I9OD15 type=del size=4081722 2024-06-04T15:59:29.197 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.196+0000 7f5e9aacc780 1 < completed part key=_multipart_PASGIP872OVX.2~PCI1SQI2QAQ3.0 size=1048576 2024-06-04T15:59:29.198 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.197+0000 7f5e9aacc780 1 < completed part key=_multipart_PASGIP872OVX.2~PCI1SQI2QAQ3.1 size=361307 2024-06-04T15:59:29.201 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.201+0000 7f5e9aacc780 1 < completed multipart upload key=PASGIP872OVX upload=PCI1SQI2QAQ3 tag=6VIDRR7NWGL8 type=write size=2458459 2024-06-04T15:59:29.202 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.202+0000 7f5e9aacc780 1 > prepared operation key=AOCB36Y5Q7B0 tag=YIGUH21Z6SKF type=del size=1439640 2024-06-04T15:59:29.204 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.204+0000 7f5e9aacc780 1 < completed delete operation key=GTRMEQJK675Z tag=IET7DLVEO45F type=del 2024-06-04T15:59:29.205 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.205+0000 7f5e9aacc780 1 > prepared operation key=W1T4O3EAE7JN tag=MDQJ99ZVMAPI type=del size=560119 2024-06-04T15:59:29.206 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.206+0000 7f5e9aacc780 1 < canceled part key=_multipart_DY9JWHWNAUO1.2~CD0R0SV1OVXU.0 size=748067 2024-06-04T15:59:29.208 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.208+0000 7f5e9aacc780 1 < canceled multipart upload key=DY9JWHWNAUO1 upload=CD0R0SV1OVXU tag=4WL1TKSNXH0B type=write size=1796643 2024-06-04T15:59:29.211 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.211+0000 7f5e9aacc780 1 > prepared part key=_multipart_Q2V1ICTBSCV1.2~0XC3EVNX6T1M.0 size=220088 2024-06-04T15:59:29.211 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.211+0000 7f5e9aacc780 1 > prepared multipart upload key=Q2V1ICTBSCV1 upload=0XC3EVNX6T1M tag=N5IUV0IRWB1G type=write size=1268664 2024-06-04T15:59:29.213 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.212+0000 7f5e9aacc780 1 < completed part key=_multipart_1IKNQXU3Y2JJ.2~U61WCDC6643G.0 size=1048576 2024-06-04T15:59:29.214 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.214+0000 7f5e9aacc780 1 < completed part key=_multipart_1IKNQXU3Y2JJ.2~U61WCDC6643G.1 size=383973 2024-06-04T15:59:29.216 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.216+0000 7f5e9aacc780 1 < completed multipart upload key=1IKNQXU3Y2JJ upload=U61WCDC6643G tag=NP24GBVOU3ZD type=write size=2481125 2024-06-04T15:59:29.219 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.218+0000 7f5e9aacc780 1 > prepared part key=_multipart_SUBHZJ7HUV3H.2~03HR3WKVIWSE.0 size=1048576 2024-06-04T15:59:29.220 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.220+0000 7f5e9aacc780 1 > prepared part key=_multipart_SUBHZJ7HUV3H.2~03HR3WKVIWSE.1 size=586256 2024-06-04T15:59:29.220 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.220+0000 7f5e9aacc780 1 > prepared multipart upload key=SUBHZJ7HUV3H upload=03HR3WKVIWSE tag=EQZ53BE5HYFQ type=write size=2683408 2024-06-04T15:59:29.221 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.221+0000 7f5e9aacc780 1 < completed write operation key=UTZHANL9ER2Q tag=0HIT8DS4GFB0 type=write size=664534 2024-06-04T15:59:29.222 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.222+0000 7f5e9aacc780 1 > prepared operation key=XH0N984YVGKP tag=G50SM8JP8XRG type=del size=371877 2024-06-04T15:59:29.225 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.225+0000 7f5e9aacc780 1 < suggested remove operation key=9MPRI6LW3956 tag=QB11MGIGSZ8O type=del 2024-06-04T15:59:29.227 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.227+0000 7f5e9aacc780 1 > prepared part key=_multipart_AOCB36Y5Q7B0.2~P95USMWFQQU4.0 size=1048576 2024-06-04T15:59:29.228 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.228+0000 7f5e9aacc780 1 > prepared part key=_multipart_AOCB36Y5Q7B0.2~P95USMWFQQU4.1 size=1048576 2024-06-04T15:59:29.229 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.229+0000 7f5e9aacc780 1 > prepared part key=_multipart_AOCB36Y5Q7B0.2~P95USMWFQQU4.2 size=334134 2024-06-04T15:59:29.230 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.229+0000 7f5e9aacc780 1 > prepared multipart upload key=AOCB36Y5Q7B0 upload=P95USMWFQQU4 tag=PIUFSSUM77VM type=write size=3479862 2024-06-04T15:59:29.231 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.231+0000 7f5e9aacc780 1 < completed delete operation key=Q2V1ICTBSCV1 tag=UO36YGSX9F25 type=del 2024-06-04T15:59:29.233 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.232+0000 7f5e9aacc780 1 > prepared operation key=K01DAK0M4I4M tag=ABW08ONYGSJE type=del size=3230603 2024-06-04T15:59:29.233 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.233+0000 7f5e9aacc780 1 < canceled part key=_multipart_XH0N984YVGKP.2~NB95C2VRYIQT.0 size=560960 2024-06-04T15:59:29.235 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.235+0000 7f5e9aacc780 1 < canceled multipart upload key=XH0N984YVGKP upload=NB95C2VRYIQT tag=5SJUKFZ3XI9K type=write size=1609536 2024-06-04T15:59:29.237 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.236+0000 7f5e9aacc780 1 > prepared operation key=9MPRI6LW3956 tag=1QIALLI38ZDV type=del size=738744 2024-06-04T15:59:29.238 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.238+0000 7f5e9aacc780 1 < completed write operation key=1IKNQXU3Y2JJ tag=THO2JMM5TNT3 type=write size=649510 2024-06-04T15:59:29.239 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.239+0000 7f5e9aacc780 1 > prepared operation key=03ZNYG3WLMP4 tag=MNLM30X42M0L type=del size=2040875 2024-06-04T15:59:29.241 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.241+0000 7f5e9aacc780 1 < canceled operation key=03ZNYG3WLMP4 tag=TWRUHQUZDN6C type=del size=2437909 2024-06-04T15:59:29.244 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.243+0000 7f5e9aacc780 1 > prepared part key=_multipart_7S9S3MIG7WIT.2~VHY1DASI1709.0 size=224156 2024-06-04T15:59:29.244 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.243+0000 7f5e9aacc780 1 > prepared multipart upload key=7S9S3MIG7WIT upload=VHY1DASI1709 tag=MPAJK4CSVKLB type=write size=1272732 2024-06-04T15:59:29.245 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.245+0000 7f5e9aacc780 1 < canceled operation key=Q4OFQI0F5YLG tag=X03Q2Q2GTM1I type=del size=2623454 2024-06-04T15:59:29.246 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.246+0000 7f5e9aacc780 1 > prepared operation key=W1T4O3EAE7JN tag=65MXRPAHBE1B type=del size=2903612 2024-06-04T15:59:29.248 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.248+0000 7f5e9aacc780 1 < completed part key=_multipart_A8O0S3S45RGM.2~0SK986PW0WWH.0 size=243886 2024-06-04T15:59:29.250 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.250+0000 7f5e9aacc780 1 < completed multipart upload key=A8O0S3S45RGM upload=0SK986PW0WWH tag=A9N2P6THRURH type=write size=1292462 2024-06-04T15:59:29.252 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.251+0000 7f5e9aacc780 1 > prepared operation key=NHPH4LYPP0LL tag=6OK0VCBPC82L type=del size=664115 2024-06-04T15:59:29.253 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.253+0000 7f5e9aacc780 1 < completed part key=_multipart_Q2V1ICTBSCV1.2~YNXGKK6AOOCU.0 size=1048576 2024-06-04T15:59:29.255 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.254+0000 7f5e9aacc780 1 < completed part key=_multipart_Q2V1ICTBSCV1.2~YNXGKK6AOOCU.1 size=1048576 2024-06-04T15:59:29.256 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.256+0000 7f5e9aacc780 1 < completed part key=_multipart_Q2V1ICTBSCV1.2~YNXGKK6AOOCU.2 size=729893 2024-06-04T15:59:29.260 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.260+0000 7f5e9aacc780 1 < completed multipart upload key=Q2V1ICTBSCV1 upload=YNXGKK6AOOCU tag=W2W5I9494LMC type=write size=3875621 2024-06-04T15:59:29.263 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.263+0000 7f5e9aacc780 1 > prepared part key=_multipart_SUBHZJ7HUV3H.2~QWO1WPHLGZQ4.0 size=655847 2024-06-04T15:59:29.263 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.263+0000 7f5e9aacc780 1 > prepared multipart upload key=SUBHZJ7HUV3H upload=QWO1WPHLGZQ4 tag=1TZ4KH1D9980 type=write size=1704423 2024-06-04T15:59:29.265 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.264+0000 7f5e9aacc780 1 < completed part key=_multipart_1IKNQXU3Y2JJ.2~6NHAS2FAOOY1.0 size=290515 2024-06-04T15:59:29.267 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.267+0000 7f5e9aacc780 1 < completed multipart upload key=1IKNQXU3Y2JJ upload=6NHAS2FAOOY1 tag=T6VS45M79JLF type=write size=1339091 2024-06-04T15:59:29.270 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.270+0000 7f5e9aacc780 1 > prepared part key=_multipart_4W5HB9WQQHR6.2~9YG3BK4MB6BV.0 size=584700 2024-06-04T15:59:29.270 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.270+0000 7f5e9aacc780 1 > prepared multipart upload key=4W5HB9WQQHR6 upload=9YG3BK4MB6BV tag=9GO6QI916NJM type=write size=1633276 2024-06-04T15:59:29.272 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.272+0000 7f5e9aacc780 1 < completed part key=_multipart_TUGKW7F4V9NO.2~ABZE5O927P5Y.0 size=1048576 2024-06-04T15:59:29.272 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.272+0000 7f5e9aacc780 1 < canceled part key=_multipart_TUGKW7F4V9NO.2~ABZE5O927P5Y.1 size=749276 2024-06-04T15:59:29.274 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.274+0000 7f5e9aacc780 1 < canceled multipart upload key=TUGKW7F4V9NO upload=ABZE5O927P5Y tag=17SF7NU826O1 type=write size=2846428 2024-06-04T15:59:29.276 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.276+0000 7f5e9aacc780 1 > prepared operation key=4W5HB9WQQHR6 tag=WZRADRA86WIX type=write size=726132 2024-06-04T15:59:29.278 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.277+0000 7f5e9aacc780 1 < completed delete operation key=03ZNYG3WLMP4 tag=2N0W87I9OD15 type=del 2024-06-04T15:59:29.279 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.278+0000 7f5e9aacc780 1 > prepared operation key=GTRMEQJK675Z tag=8E8NMD7V51S1 type=del size=3930498 2024-06-04T15:59:29.282 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.281+0000 7f5e9aacc780 1 < suggested update operation key=AOCB36Y5Q7B0 tag=YIGUH21Z6SKF type=del size=1439640 2024-06-04T15:59:29.285 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.284+0000 7f5e9aacc780 1 > prepared part key=_multipart_QJA2JPATITNH.2~F9X8FL396WDF.0 size=609471 2024-06-04T15:59:29.285 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.284+0000 7f5e9aacc780 1 > prepared multipart upload key=QJA2JPATITNH upload=F9X8FL396WDF tag=SC2I1GZHTZYA type=write size=1658047 2024-06-04T15:59:29.286 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.287+0000 7f5e9aacc780 1 < completed delete operation key=W1T4O3EAE7JN tag=MDQJ99ZVMAPI type=del 2024-06-04T15:59:29.288 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.288+0000 7f5e9aacc780 1 > prepared operation key=PASGIP872OVX tag=KSUN6HP33DL8 type=del size=1194676 2024-06-04T15:59:29.290 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.290+0000 7f5e9aacc780 1 < completed part key=_multipart_Q2V1ICTBSCV1.2~0XC3EVNX6T1M.0 size=220088 2024-06-04T15:59:29.293 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.293+0000 7f5e9aacc780 1 < completed multipart upload key=Q2V1ICTBSCV1 upload=0XC3EVNX6T1M tag=N5IUV0IRWB1G type=write size=1268664 2024-06-04T15:59:29.294 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.294+0000 7f5e9aacc780 1 > prepared operation key=JL69PUHT6NNT tag=CDS4XQ4GPNGE type=del size=2081667 2024-06-04T15:59:29.296 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.296+0000 7f5e9aacc780 1 < completed part key=_multipart_SUBHZJ7HUV3H.2~03HR3WKVIWSE.0 size=1048576 2024-06-04T15:59:29.297 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.297+0000 7f5e9aacc780 1 < completed part key=_multipart_SUBHZJ7HUV3H.2~03HR3WKVIWSE.1 size=586256 2024-06-04T15:59:29.299 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.299+0000 7f5e9aacc780 1 < completed multipart upload key=SUBHZJ7HUV3H upload=03HR3WKVIWSE tag=EQZ53BE5HYFQ type=write size=2683408 2024-06-04T15:59:29.301 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.301+0000 7f5e9aacc780 1 > prepared operation key=RP8K6QJUZAH1 tag=Z8A22XHRH9NG type=del size=3759620 2024-06-04T15:59:29.303 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.302+0000 7f5e9aacc780 1 < completed delete operation key=XH0N984YVGKP tag=G50SM8JP8XRG type=del 2024-06-04T15:59:29.304 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.304+0000 7f5e9aacc780 1 > prepared operation key=TUGKW7F4V9NO tag=M7282OHP12GJ type=del size=630790 2024-06-04T15:59:29.306 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.305+0000 7f5e9aacc780 1 < completed part key=_multipart_AOCB36Y5Q7B0.2~P95USMWFQQU4.0 size=1048576 2024-06-04T15:59:29.307 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.307+0000 7f5e9aacc780 1 < completed part key=_multipart_AOCB36Y5Q7B0.2~P95USMWFQQU4.1 size=1048576 2024-06-04T15:59:29.308 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.308+0000 7f5e9aacc780 1 < completed part key=_multipart_AOCB36Y5Q7B0.2~P95USMWFQQU4.2 size=334134 2024-06-04T15:59:29.311 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.311+0000 7f5e9aacc780 1 < completed multipart upload key=AOCB36Y5Q7B0 upload=P95USMWFQQU4 tag=PIUFSSUM77VM type=write size=3479862 2024-06-04T15:59:29.313 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.312+0000 7f5e9aacc780 1 > prepared operation key=GTRMEQJK675Z tag=W5QAXN3QA48H type=del size=2113861 2024-06-04T15:59:29.314 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.314+0000 7f5e9aacc780 1 < completed delete operation key=K01DAK0M4I4M tag=ABW08ONYGSJE type=del 2024-06-04T15:59:29.316 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.316+0000 7f5e9aacc780 1 > prepared operation key=NHPH4LYPP0LL tag=77ZWJ5S9OEAO type=del size=3852802 2024-06-04T15:59:29.318 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.317+0000 7f5e9aacc780 1 < completed delete operation key=9MPRI6LW3956 tag=1QIALLI38ZDV type=del 2024-06-04T15:59:29.321 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.321+0000 7f5e9aacc780 1 > prepared part key=_multipart_GCPC9OJH7KWU.2~QQDNXWU111SZ.0 size=1048576 2024-06-04T15:59:29.322 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.322+0000 7f5e9aacc780 1 > prepared part key=_multipart_GCPC9OJH7KWU.2~QQDNXWU111SZ.1 size=1048576 2024-06-04T15:59:29.323 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.323+0000 7f5e9aacc780 1 > prepared part key=_multipart_GCPC9OJH7KWU.2~QQDNXWU111SZ.2 size=445633 2024-06-04T15:59:29.323 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.323+0000 7f5e9aacc780 1 > prepared multipart upload key=GCPC9OJH7KWU upload=QQDNXWU111SZ tag=M084O6QLMKWP type=write size=3591361 2024-06-04T15:59:29.325 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.324+0000 7f5e9aacc780 1 < completed delete operation key=03ZNYG3WLMP4 tag=MNLM30X42M0L type=del 2024-06-04T15:59:29.327 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.327+0000 7f5e9aacc780 1 > prepared part key=_multipart_9MPRI6LW3956.2~PWDTG8GJLH19.0 size=1048576 2024-06-04T15:59:29.329 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.328+0000 7f5e9aacc780 1 > prepared part key=_multipart_9MPRI6LW3956.2~PWDTG8GJLH19.1 size=1048576 2024-06-04T15:59:29.330 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.330+0000 7f5e9aacc780 1 > prepared part key=_multipart_9MPRI6LW3956.2~PWDTG8GJLH19.2 size=426970 2024-06-04T15:59:29.330 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.330+0000 7f5e9aacc780 1 > prepared multipart upload key=9MPRI6LW3956 upload=PWDTG8GJLH19 tag=5YAPZFOURTX0 type=write size=3572698 2024-06-04T15:59:29.332 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.331+0000 7f5e9aacc780 1 < completed part key=_multipart_7S9S3MIG7WIT.2~VHY1DASI1709.0 size=224156 2024-06-04T15:59:29.334 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.334+0000 7f5e9aacc780 1 < completed multipart upload key=7S9S3MIG7WIT upload=VHY1DASI1709 tag=MPAJK4CSVKLB type=write size=1272732 2024-06-04T15:59:29.337 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.337+0000 7f5e9aacc780 1 > prepared part key=_multipart_QJA2JPATITNH.2~ZQMRWWYCUL3W.0 size=126486 2024-06-04T15:59:29.337 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.337+0000 7f5e9aacc780 1 > prepared multipart upload key=QJA2JPATITNH upload=ZQMRWWYCUL3W tag=7N4JBO6WX05E type=write size=1175062 2024-06-04T15:59:29.338 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.338+0000 7f5e9aacc780 1 < completed delete operation key=W1T4O3EAE7JN tag=65MXRPAHBE1B type=del 2024-06-04T15:59:29.341 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.341+0000 7f5e9aacc780 1 > prepared part key=_multipart_1IKNQXU3Y2JJ.2~ZQW1CH9UKC0M.0 size=1048576 2024-06-04T15:59:29.342 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.342+0000 7f5e9aacc780 1 > prepared part key=_multipart_1IKNQXU3Y2JJ.2~ZQW1CH9UKC0M.1 size=174444 2024-06-04T15:59:29.342 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.342+0000 7f5e9aacc780 1 > prepared multipart upload key=1IKNQXU3Y2JJ upload=ZQW1CH9UKC0M tag=JN7Q5K55J12S type=write size=2271596 2024-06-04T15:59:29.344 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.344+0000 7f5e9aacc780 1 < completed delete operation key=NHPH4LYPP0LL tag=6OK0VCBPC82L type=del 2024-06-04T15:59:29.346 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.346+0000 7f5e9aacc780 1 > prepared part key=_multipart_4W5HB9WQQHR6.2~2T20FD1HRBNY.0 size=1048576 2024-06-04T15:59:29.348 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.348+0000 7f5e9aacc780 1 > prepared part key=_multipart_4W5HB9WQQHR6.2~2T20FD1HRBNY.1 size=1048576 2024-06-04T15:59:29.349 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.348+0000 7f5e9aacc780 1 > prepared part key=_multipart_4W5HB9WQQHR6.2~2T20FD1HRBNY.2 size=844087 2024-06-04T15:59:29.349 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.349+0000 7f5e9aacc780 1 > prepared multipart upload key=4W5HB9WQQHR6 upload=2T20FD1HRBNY tag=WEHOK9EW8CYW type=write size=3989815 2024-06-04T15:59:29.350 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.350+0000 7f5e9aacc780 1 < completed part key=_multipart_SUBHZJ7HUV3H.2~QWO1WPHLGZQ4.0 size=655847 2024-06-04T15:59:29.353 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.353+0000 7f5e9aacc780 1 < completed multipart upload key=SUBHZJ7HUV3H upload=QWO1WPHLGZQ4 tag=1TZ4KH1D9980 type=write size=1704423 2024-06-04T15:59:29.356 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.355+0000 7f5e9aacc780 1 > prepared part key=_multipart_SUBHZJ7HUV3H.2~2J2NY41OE68T.0 size=1048576 2024-06-04T15:59:29.357 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.357+0000 7f5e9aacc780 1 > prepared part key=_multipart_SUBHZJ7HUV3H.2~2J2NY41OE68T.1 size=1048576 2024-06-04T15:59:29.358 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.358+0000 7f5e9aacc780 1 > prepared part key=_multipart_SUBHZJ7HUV3H.2~2J2NY41OE68T.2 size=461683 2024-06-04T15:59:29.358 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.358+0000 7f5e9aacc780 1 > prepared multipart upload key=SUBHZJ7HUV3H upload=2J2NY41OE68T tag=5DJMQ39TRVKN type=write size=3607411 2024-06-04T15:59:29.358 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.358+0000 7f5e9aacc780 1 < canceled part key=_multipart_4W5HB9WQQHR6.2~9YG3BK4MB6BV.0 size=584700 2024-06-04T15:59:29.361 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.360+0000 7f5e9aacc780 1 < canceled multipart upload key=4W5HB9WQQHR6 upload=9YG3BK4MB6BV tag=9GO6QI916NJM type=write size=1633276 2024-06-04T15:59:29.363 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.363+0000 7f5e9aacc780 1 > prepared part key=_multipart_DY9JWHWNAUO1.2~GL9YGNHDCMBA.0 size=682189 2024-06-04T15:59:29.363 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.363+0000 7f5e9aacc780 1 > prepared multipart upload key=DY9JWHWNAUO1 upload=GL9YGNHDCMBA tag=FCR10ZP6AUR6 type=write size=1730765 2024-06-04T15:59:29.365 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.364+0000 7f5e9aacc780 1 < completed write operation key=4W5HB9WQQHR6 tag=WZRADRA86WIX type=write size=726132 2024-06-04T15:59:29.366 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.366+0000 7f5e9aacc780 1 > prepared operation key=PCLJXQHJ4HTY tag=PIQJWYFW0B95 type=del size=4115924 2024-06-04T15:59:29.367 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.367+0000 7f5e9aacc780 1 < completed delete operation key=GTRMEQJK675Z tag=8E8NMD7V51S1 type=del 2024-06-04T15:59:29.370 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.370+0000 7f5e9aacc780 1 > prepared part key=_multipart_03ZNYG3WLMP4.2~VHVNIAFEXV73.0 size=270171 2024-06-04T15:59:29.370 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.370+0000 7f5e9aacc780 1 > prepared multipart upload key=03ZNYG3WLMP4 upload=VHVNIAFEXV73 tag=Q8CLK5ZQ6VH3 type=write size=1318747 2024-06-04T15:59:29.371 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.370+0000 7f5e9aacc780 1 < canceled part key=_multipart_QJA2JPATITNH.2~F9X8FL396WDF.0 size=609471 2024-06-04T15:59:29.373 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.373+0000 7f5e9aacc780 1 < canceled multipart upload key=QJA2JPATITNH upload=F9X8FL396WDF tag=SC2I1GZHTZYA type=write size=1658047 2024-06-04T15:59:29.374 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.374+0000 7f5e9aacc780 1 > prepared operation key=1IKNQXU3Y2JJ tag=SQVWVBC2MERV type=del size=1435915 2024-06-04T15:59:29.376 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.376+0000 7f5e9aacc780 1 < completed delete operation key=PASGIP872OVX tag=KSUN6HP33DL8 type=del 2024-06-04T15:59:29.378 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.377+0000 7f5e9aacc780 1 > prepared operation key=UTZHANL9ER2Q tag=5EP9GCA2QAXB type=write size=216616 2024-06-04T15:59:29.379 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.379+0000 7f5e9aacc780 1 < completed delete operation key=JL69PUHT6NNT tag=CDS4XQ4GPNGE type=del 2024-06-04T15:59:29.381 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.380+0000 7f5e9aacc780 1 > prepared operation key=TUGKW7F4V9NO tag=NSQP2PT1I19B type=del size=4138199 2024-06-04T15:59:29.382 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.382+0000 7f5e9aacc780 1 < completed delete operation key=RP8K6QJUZAH1 tag=Z8A22XHRH9NG type=del 2024-06-04T15:59:29.384 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.383+0000 7f5e9aacc780 1 > prepared operation key=4W5HB9WQQHR6 tag=Z4NUUM8P3IUI type=del size=580627 2024-06-04T15:59:29.385 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.385+0000 7f5e9aacc780 1 < canceled operation key=TUGKW7F4V9NO tag=M7282OHP12GJ type=del size=630790 2024-06-04T15:59:29.387 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.386+0000 7f5e9aacc780 1 > prepared operation key=4W5HB9WQQHR6 tag=3KSDZ4W09XHM type=del size=1795881 2024-06-04T15:59:29.390 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.389+0000 7f5e9aacc780 1 < suggested remove operation key=GTRMEQJK675Z tag=W5QAXN3QA48H type=del 2024-06-04T15:59:29.391 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.390+0000 7f5e9aacc780 1 > prepared operation key=7S9S3MIG7WIT tag=0UQ165DNWPQY type=del size=2506381 2024-06-04T15:59:29.392 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.392+0000 7f5e9aacc780 1 < completed delete operation key=NHPH4LYPP0LL tag=77ZWJ5S9OEAO type=del 2024-06-04T15:59:29.394 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.394+0000 7f5e9aacc780 1 > prepared part key=_multipart_AOCB36Y5Q7B0.2~2J6IEVD5IEMU.0 size=1048576 2024-06-04T15:59:29.396 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.395+0000 7f5e9aacc780 1 > prepared part key=_multipart_AOCB36Y5Q7B0.2~2J6IEVD5IEMU.1 size=944001 2024-06-04T15:59:29.396 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.395+0000 7f5e9aacc780 1 > prepared multipart upload key=AOCB36Y5Q7B0 upload=2J6IEVD5IEMU tag=RGIFDKIG0T1G type=write size=3041153 2024-06-04T15:59:29.397 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.397+0000 7f5e9aacc780 1 < completed part key=_multipart_GCPC9OJH7KWU.2~QQDNXWU111SZ.0 size=1048576 2024-06-04T15:59:29.399 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.399+0000 7f5e9aacc780 1 < completed part key=_multipart_GCPC9OJH7KWU.2~QQDNXWU111SZ.1 size=1048576 2024-06-04T15:59:29.400 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.400+0000 7f5e9aacc780 1 < completed part key=_multipart_GCPC9OJH7KWU.2~QQDNXWU111SZ.2 size=445633 2024-06-04T15:59:29.404 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.404+0000 7f5e9aacc780 1 < completed multipart upload key=GCPC9OJH7KWU upload=QQDNXWU111SZ tag=M084O6QLMKWP type=write size=3591361 2024-06-04T15:59:29.405 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.405+0000 7f5e9aacc780 1 > prepared operation key=FBV2MAG130M6 tag=CK8VIURI40WN type=del size=2952609 2024-06-04T15:59:29.407 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.407+0000 7f5e9aacc780 1 < completed part key=_multipart_9MPRI6LW3956.2~PWDTG8GJLH19.0 size=1048576 2024-06-04T15:59:29.408 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.408+0000 7f5e9aacc780 1 < completed part key=_multipart_9MPRI6LW3956.2~PWDTG8GJLH19.1 size=1048576 2024-06-04T15:59:29.409 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.409+0000 7f5e9aacc780 1 < completed part key=_multipart_9MPRI6LW3956.2~PWDTG8GJLH19.2 size=426970 2024-06-04T15:59:29.412 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.411+0000 7f5e9aacc780 1 < completed multipart upload key=9MPRI6LW3956 upload=PWDTG8GJLH19 tag=5YAPZFOURTX0 type=write size=3572698 2024-06-04T15:59:29.413 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.413+0000 7f5e9aacc780 1 > prepared operation key=UW5LVIBG09SV tag=17Z0ELAP86W8 type=del size=1292069 2024-06-04T15:59:29.414 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.415+0000 7f5e9aacc780 1 < completed part key=_multipart_QJA2JPATITNH.2~ZQMRWWYCUL3W.0 size=126486 2024-06-04T15:59:29.417 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.416+0000 7f5e9aacc780 1 < completed multipart upload key=QJA2JPATITNH upload=ZQMRWWYCUL3W tag=7N4JBO6WX05E type=write size=1175062 2024-06-04T15:59:29.419 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.419+0000 7f5e9aacc780 1 > prepared part key=_multipart_FBV2MAG130M6.2~OT4FYGIKULIH.0 size=1048576 2024-06-04T15:59:29.420 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.420+0000 7f5e9aacc780 1 > prepared part key=_multipart_FBV2MAG130M6.2~OT4FYGIKULIH.1 size=800942 2024-06-04T15:59:29.421 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.420+0000 7f5e9aacc780 1 > prepared multipart upload key=FBV2MAG130M6 upload=OT4FYGIKULIH tag=C8YJU55JY1AB type=write size=2898094 2024-06-04T15:59:29.422 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.421+0000 7f5e9aacc780 1 < completed part key=_multipart_1IKNQXU3Y2JJ.2~ZQW1CH9UKC0M.0 size=1048576 2024-06-04T15:59:29.422 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.422+0000 7f5e9aacc780 1 < canceled part key=_multipart_1IKNQXU3Y2JJ.2~ZQW1CH9UKC0M.1 size=174444 2024-06-04T15:59:29.424 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.424+0000 7f5e9aacc780 1 < canceled multipart upload key=1IKNQXU3Y2JJ upload=ZQW1CH9UKC0M tag=JN7Q5K55J12S type=write size=2271596 2024-06-04T15:59:29.426 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.425+0000 7f5e9aacc780 1 > prepared operation key=HD6SNICRCDLL tag=3J0ECJ7Y8P68 type=del size=981507 2024-06-04T15:59:29.428 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.428+0000 7f5e9aacc780 1 < completed part key=_multipart_4W5HB9WQQHR6.2~2T20FD1HRBNY.0 size=1048576 2024-06-04T15:59:29.429 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.428+0000 7f5e9aacc780 1 < completed part key=_multipart_4W5HB9WQQHR6.2~2T20FD1HRBNY.1 size=1048576 2024-06-04T15:59:29.430 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.430+0000 7f5e9aacc780 1 < completed part key=_multipart_4W5HB9WQQHR6.2~2T20FD1HRBNY.2 size=844087 2024-06-04T15:59:29.432 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.433+0000 7f5e9aacc780 1 < completed multipart upload key=4W5HB9WQQHR6 upload=2T20FD1HRBNY tag=WEHOK9EW8CYW type=write size=3989815 2024-06-04T15:59:29.434 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.434+0000 7f5e9aacc780 1 > prepared operation key=Q2V1ICTBSCV1 tag=7AYN3JNN33A5 type=del size=1925765 2024-06-04T15:59:29.436 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.435+0000 7f5e9aacc780 1 < completed part key=_multipart_SUBHZJ7HUV3H.2~2J2NY41OE68T.0 size=1048576 2024-06-04T15:59:29.437 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.436+0000 7f5e9aacc780 1 < completed part key=_multipart_SUBHZJ7HUV3H.2~2J2NY41OE68T.1 size=1048576 2024-06-04T15:59:29.439 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.439+0000 7f5e9aacc780 1 < completed part key=_multipart_SUBHZJ7HUV3H.2~2J2NY41OE68T.2 size=461683 2024-06-04T15:59:29.442 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.442+0000 7f5e9aacc780 1 < completed multipart upload key=SUBHZJ7HUV3H upload=2J2NY41OE68T tag=5DJMQ39TRVKN type=write size=3607411 2024-06-04T15:59:29.443 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.443+0000 7f5e9aacc780 1 > prepared operation key=K01DAK0M4I4M tag=OZ9UQEI5PCGH type=del size=3154095 2024-06-04T15:59:29.444 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.444+0000 7f5e9aacc780 1 < canceled part key=_multipart_DY9JWHWNAUO1.2~GL9YGNHDCMBA.0 size=682189 2024-06-04T15:59:29.446 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.446+0000 7f5e9aacc780 1 < canceled multipart upload key=DY9JWHWNAUO1 upload=GL9YGNHDCMBA tag=FCR10ZP6AUR6 type=write size=1730765 2024-06-04T15:59:29.449 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.448+0000 7f5e9aacc780 1 > prepared part key=_multipart_RP8K6QJUZAH1.2~ULU2G76YKOD3.0 size=1048576 2024-06-04T15:59:29.450 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.450+0000 7f5e9aacc780 1 > prepared part key=_multipart_RP8K6QJUZAH1.2~ULU2G76YKOD3.1 size=1048576 2024-06-04T15:59:29.451 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.451+0000 7f5e9aacc780 1 > prepared part key=_multipart_RP8K6QJUZAH1.2~ULU2G76YKOD3.2 size=877943 2024-06-04T15:59:29.451 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.451+0000 7f5e9aacc780 1 > prepared multipart upload key=RP8K6QJUZAH1 upload=ULU2G76YKOD3 tag=6VC9VJ3SK0JW type=write size=4023671 2024-06-04T15:59:29.453 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.452+0000 7f5e9aacc780 1 < completed delete operation key=PCLJXQHJ4HTY tag=PIQJWYFW0B95 type=del 2024-06-04T15:59:29.454 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.454+0000 7f5e9aacc780 1 > prepared operation key=Q4OFQI0F5YLG tag=0F37NW3W8EBK type=del size=4012552 2024-06-04T15:59:29.456 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.455+0000 7f5e9aacc780 1 < completed part key=_multipart_03ZNYG3WLMP4.2~VHVNIAFEXV73.0 size=270171 2024-06-04T15:59:29.458 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.458+0000 7f5e9aacc780 1 < completed multipart upload key=03ZNYG3WLMP4 upload=VHVNIAFEXV73 tag=Q8CLK5ZQ6VH3 type=write size=1318747 2024-06-04T15:59:29.461 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.461+0000 7f5e9aacc780 1 > prepared part key=_multipart_NJ5U8JTT32QK.2~5E4MLWQ2C7GV.0 size=194941 2024-06-04T15:59:29.461 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.461+0000 7f5e9aacc780 1 > prepared multipart upload key=NJ5U8JTT32QK upload=5E4MLWQ2C7GV tag=UURN7KQWHJHL type=write size=1243517 2024-06-04T15:59:29.464 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.464+0000 7f5e9aacc780 1 < suggested update operation key=1IKNQXU3Y2JJ tag=SQVWVBC2MERV type=del size=1435915 2024-06-04T15:59:29.466 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.465+0000 7f5e9aacc780 1 > prepared operation key=A8O0S3S45RGM tag=8F72G0UUTPQ7 type=del size=1293306 2024-06-04T15:59:29.469 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.469+0000 7f5e9aacc780 1 < suggested remove operation key=UTZHANL9ER2Q tag=5EP9GCA2QAXB type=write 2024-06-04T15:59:29.471 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.470+0000 7f5e9aacc780 1 > prepared operation key=B0HK5FJ2RGJE tag=0PX2EV8UUDY7 type=del size=3738191 2024-06-04T15:59:29.472 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.472+0000 7f5e9aacc780 1 < canceled operation key=TUGKW7F4V9NO tag=NSQP2PT1I19B type=del size=4138199 2024-06-04T15:59:29.475 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.475+0000 7f5e9aacc780 1 > prepared part key=_multipart_4W5HB9WQQHR6.2~DOOJPF135H0S.0 size=1048576 2024-06-04T15:59:29.476 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.476+0000 7f5e9aacc780 1 > prepared part key=_multipart_4W5HB9WQQHR6.2~DOOJPF135H0S.1 size=1048576 2024-06-04T15:59:29.477 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.477+0000 7f5e9aacc780 1 > prepared part key=_multipart_4W5HB9WQQHR6.2~DOOJPF135H0S.2 size=870054 2024-06-04T15:59:29.477 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.477+0000 7f5e9aacc780 1 > prepared multipart upload key=4W5HB9WQQHR6 upload=DOOJPF135H0S tag=42T7APONT7Y5 type=write size=4015782 2024-06-04T15:59:29.480 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.480+0000 7f5e9aacc780 1 < suggested remove operation key=4W5HB9WQQHR6 tag=Z4NUUM8P3IUI type=del 2024-06-04T15:59:29.483 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.483+0000 7f5e9aacc780 1 > prepared part key=_multipart_QUIVPH3OB6KN.2~1IP72PNBSTR5.0 size=1048576 2024-06-04T15:59:29.484 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.484+0000 7f5e9aacc780 1 > prepared part key=_multipart_QUIVPH3OB6KN.2~1IP72PNBSTR5.1 size=1048576 2024-06-04T15:59:29.485 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.485+0000 7f5e9aacc780 1 > prepared part key=_multipart_QUIVPH3OB6KN.2~1IP72PNBSTR5.2 size=556362 2024-06-04T15:59:29.485 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.485+0000 7f5e9aacc780 1 > prepared multipart upload key=QUIVPH3OB6KN upload=1IP72PNBSTR5 tag=O0585M7MJLHO type=write size=3702090 2024-06-04T15:59:29.487 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.486+0000 7f5e9aacc780 -1 < failed to complete operation key=4W5HB9WQQHR6 tag=3KSDZ4W09XHM type=del size=1795881: (22) Invalid argument 2024-06-04T15:59:29.489 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.489+0000 7f5e9aacc780 1 > prepared part key=_multipart_03ZNYG3WLMP4.2~5FLR0QT28GFE.0 size=725250 2024-06-04T15:59:29.489 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.489+0000 7f5e9aacc780 1 > prepared multipart upload key=03ZNYG3WLMP4 upload=5FLR0QT28GFE tag=CI2WSGX3P3NL type=write size=1773826 2024-06-04T15:59:29.491 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.490+0000 7f5e9aacc780 1 < canceled operation key=7S9S3MIG7WIT tag=0UQ165DNWPQY type=del size=2506381 2024-06-04T15:59:29.493 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.493+0000 7f5e9aacc780 1 > prepared part key=_multipart_HD6SNICRCDLL.2~0SH6PUCI2SFC.0 size=31260 2024-06-04T15:59:29.493 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.493+0000 7f5e9aacc780 1 > prepared multipart upload key=HD6SNICRCDLL upload=0SH6PUCI2SFC tag=ADPEAYQE5VB6 type=write size=1079836 2024-06-04T15:59:29.494 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.494+0000 7f5e9aacc780 1 < completed part key=_multipart_AOCB36Y5Q7B0.2~2J6IEVD5IEMU.0 size=1048576 2024-06-04T15:59:29.495 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.495+0000 7f5e9aacc780 1 < completed part key=_multipart_AOCB36Y5Q7B0.2~2J6IEVD5IEMU.1 size=944001 2024-06-04T15:59:29.497 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.497+0000 7f5e9aacc780 1 < completed multipart upload key=AOCB36Y5Q7B0 upload=2J6IEVD5IEMU tag=RGIFDKIG0T1G type=write size=3041153 2024-06-04T15:59:29.499 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.498+0000 7f5e9aacc780 1 > prepared operation key=B0HK5FJ2RGJE tag=65QD2UJ4SY4F type=write size=534949 2024-06-04T15:59:29.500 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.500+0000 7f5e9aacc780 1 < completed delete operation key=FBV2MAG130M6 tag=CK8VIURI40WN type=del 2024-06-04T15:59:29.501 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.501+0000 7f5e9aacc780 1 > prepared operation key=9MPRI6LW3956 tag=49BI5DWQ80RR type=del size=3816693 2024-06-04T15:59:29.503 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.503+0000 7f5e9aacc780 1 < canceled operation key=UW5LVIBG09SV tag=17Z0ELAP86W8 type=del size=1292069 2024-06-04T15:59:29.505 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.505+0000 7f5e9aacc780 1 > prepared part key=_multipart_AOCB36Y5Q7B0.2~C310P1M7S1WU.0 size=1048576 2024-06-04T15:59:29.507 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.506+0000 7f5e9aacc780 1 > prepared part key=_multipart_AOCB36Y5Q7B0.2~C310P1M7S1WU.1 size=857311 2024-06-04T15:59:29.507 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.506+0000 7f5e9aacc780 1 > prepared multipart upload key=AOCB36Y5Q7B0 upload=C310P1M7S1WU tag=0KA2GZM3THKO type=write size=2954463 2024-06-04T15:59:29.508 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.507+0000 7f5e9aacc780 1 < completed part key=_multipart_FBV2MAG130M6.2~OT4FYGIKULIH.0 size=1048576 2024-06-04T15:59:29.509 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.509+0000 7f5e9aacc780 1 < completed part key=_multipart_FBV2MAG130M6.2~OT4FYGIKULIH.1 size=800942 2024-06-04T15:59:29.511 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.511+0000 7f5e9aacc780 1 < completed multipart upload key=FBV2MAG130M6 upload=OT4FYGIKULIH tag=C8YJU55JY1AB type=write size=2898094 2024-06-04T15:59:29.512 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.512+0000 7f5e9aacc780 1 > prepared operation key=B0HK5FJ2RGJE tag=GL9XZVCIKZF3 type=del size=2344813 2024-06-04T15:59:29.514 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.513+0000 7f5e9aacc780 1 < completed delete operation key=HD6SNICRCDLL tag=3J0ECJ7Y8P68 type=del 2024-06-04T15:59:29.515 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.515+0000 7f5e9aacc780 1 > prepared operation key=2BT2AXKB1RTA tag=4MBQICX9UWPQ type=write size=694719 2024-06-04T15:59:29.516 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.516+0000 7f5e9aacc780 1 < completed delete operation key=Q2V1ICTBSCV1 tag=7AYN3JNN33A5 type=del 2024-06-04T15:59:29.518 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.518+0000 7f5e9aacc780 1 > prepared operation key=XH0N984YVGKP tag=UT6T0OU39AVE type=del size=4019053 2024-06-04T15:59:29.521 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.521+0000 7f5e9aacc780 1 < suggested remove operation key=K01DAK0M4I4M tag=OZ9UQEI5PCGH type=del 2024-06-04T15:59:29.522 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.522+0000 7f5e9aacc780 1 > prepared operation key=UW5LVIBG09SV tag=EXLL345SQNB2 type=del size=1379828 2024-06-04T15:59:29.524 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.524+0000 7f5e9aacc780 1 < completed part key=_multipart_RP8K6QJUZAH1.2~ULU2G76YKOD3.0 size=1048576 2024-06-04T15:59:29.525 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.525+0000 7f5e9aacc780 1 < completed part key=_multipart_RP8K6QJUZAH1.2~ULU2G76YKOD3.1 size=1048576 2024-06-04T15:59:29.526 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.526+0000 7f5e9aacc780 1 < completed part key=_multipart_RP8K6QJUZAH1.2~ULU2G76YKOD3.2 size=877943 2024-06-04T15:59:29.528 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.528+0000 7f5e9aacc780 1 < completed multipart upload key=RP8K6QJUZAH1 upload=ULU2G76YKOD3 tag=6VC9VJ3SK0JW type=write size=4023671 2024-06-04T15:59:29.531 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.531+0000 7f5e9aacc780 1 > prepared part key=_multipart_RP8K6QJUZAH1.2~0ZHDT8KUW88L.0 size=1048576 2024-06-04T15:59:29.532 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.532+0000 7f5e9aacc780 1 > prepared part key=_multipart_RP8K6QJUZAH1.2~0ZHDT8KUW88L.1 size=1048576 2024-06-04T15:59:29.535 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.535+0000 7f5e9aacc780 1 > prepared part key=_multipart_RP8K6QJUZAH1.2~0ZHDT8KUW88L.2 size=658815 2024-06-04T15:59:29.535 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.535+0000 7f5e9aacc780 1 > prepared multipart upload key=RP8K6QJUZAH1 upload=0ZHDT8KUW88L tag=L5D8S6RV5TSB type=write size=3804543 2024-06-04T15:59:29.537 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.536+0000 7f5e9aacc780 1 < completed delete operation key=Q4OFQI0F5YLG tag=0F37NW3W8EBK type=del 2024-06-04T15:59:29.538 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.538+0000 7f5e9aacc780 1 > prepared operation key=PNDPO2WUW7UX tag=03F7FHPCQUOX type=write size=657676 2024-06-04T15:59:29.540 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.540+0000 7f5e9aacc780 1 < completed part key=_multipart_NJ5U8JTT32QK.2~5E4MLWQ2C7GV.0 size=194941 2024-06-04T15:59:29.542 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.542+0000 7f5e9aacc780 1 < completed multipart upload key=NJ5U8JTT32QK upload=5E4MLWQ2C7GV tag=UURN7KQWHJHL type=write size=1243517 2024-06-04T15:59:29.545 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.545+0000 7f5e9aacc780 1 > prepared part key=_multipart_NJ5U8JTT32QK.2~96NRRR0O2LV5.0 size=1048576 2024-06-04T15:59:29.546 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.546+0000 7f5e9aacc780 1 > prepared part key=_multipart_NJ5U8JTT32QK.2~96NRRR0O2LV5.1 size=1048576 2024-06-04T15:59:29.547 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.547+0000 7f5e9aacc780 1 > prepared part key=_multipart_NJ5U8JTT32QK.2~96NRRR0O2LV5.2 size=938192 2024-06-04T15:59:29.547 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.547+0000 7f5e9aacc780 1 > prepared multipart upload key=NJ5U8JTT32QK upload=96NRRR0O2LV5 tag=RYTPWD5047H4 type=write size=4083920 2024-06-04T15:59:29.549 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.548+0000 7f5e9aacc780 1 < completed delete operation key=A8O0S3S45RGM tag=8F72G0UUTPQ7 type=del 2024-06-04T15:59:29.551 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.551+0000 7f5e9aacc780 1 > prepared part key=_multipart_NHPH4LYPP0LL.2~MVKD8XR5MIUA.0 size=1048576 2024-06-04T15:59:29.553 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.552+0000 7f5e9aacc780 1 > prepared part key=_multipart_NHPH4LYPP0LL.2~MVKD8XR5MIUA.1 size=886004 2024-06-04T15:59:29.553 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.552+0000 7f5e9aacc780 1 > prepared multipart upload key=NHPH4LYPP0LL upload=MVKD8XR5MIUA tag=6TQMYY5TU1FC type=write size=2983156 2024-06-04T15:59:29.554 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.554+0000 7f5e9aacc780 1 < completed delete operation key=B0HK5FJ2RGJE tag=0PX2EV8UUDY7 type=del 2024-06-04T15:59:29.556 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.555+0000 7f5e9aacc780 1 > prepared operation key=GTRMEQJK675Z tag=073H3YUSX5UG type=del size=1338163 2024-06-04T15:59:29.557 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.557+0000 7f5e9aacc780 1 < completed part key=_multipart_4W5HB9WQQHR6.2~DOOJPF135H0S.0 size=1048576 2024-06-04T15:59:29.558 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.558+0000 7f5e9aacc780 1 < completed part key=_multipart_4W5HB9WQQHR6.2~DOOJPF135H0S.1 size=1048576 2024-06-04T15:59:29.559 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.559+0000 7f5e9aacc780 1 < completed part key=_multipart_4W5HB9WQQHR6.2~DOOJPF135H0S.2 size=870054 2024-06-04T15:59:29.561 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.561+0000 7f5e9aacc780 1 < completed multipart upload key=4W5HB9WQQHR6 upload=DOOJPF135H0S tag=42T7APONT7Y5 type=write size=4015782 2024-06-04T15:59:29.564 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.564+0000 7f5e9aacc780 1 > prepared part key=_multipart_PNDPO2WUW7UX.2~ZO698J2YBM69.0 size=1048576 2024-06-04T15:59:29.565 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.565+0000 7f5e9aacc780 1 > prepared part key=_multipart_PNDPO2WUW7UX.2~ZO698J2YBM69.1 size=1048576 2024-06-04T15:59:29.566 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.566+0000 7f5e9aacc780 1 > prepared part key=_multipart_PNDPO2WUW7UX.2~ZO698J2YBM69.2 size=799262 2024-06-04T15:59:29.566 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.566+0000 7f5e9aacc780 1 > prepared multipart upload key=PNDPO2WUW7UX upload=ZO698J2YBM69 tag=C421S3W5XT71 type=write size=3944990 2024-06-04T15:59:29.566 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.566+0000 7f5e9aacc780 1 < canceled part key=_multipart_QUIVPH3OB6KN.2~1IP72PNBSTR5.0 size=1048576 2024-06-04T15:59:29.567 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.567+0000 7f5e9aacc780 1 < completed part key=_multipart_QUIVPH3OB6KN.2~1IP72PNBSTR5.1 size=1048576 2024-06-04T15:59:29.568 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.568+0000 7f5e9aacc780 1 < completed part key=_multipart_QUIVPH3OB6KN.2~1IP72PNBSTR5.2 size=556362 2024-06-04T15:59:29.571 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.571+0000 7f5e9aacc780 1 < canceled multipart upload key=QUIVPH3OB6KN upload=1IP72PNBSTR5 tag=O0585M7MJLHO type=write size=3702090 2024-06-04T15:59:29.572 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.572+0000 7f5e9aacc780 1 > prepared operation key=SUBHZJ7HUV3H tag=E9V8K06YLO00 type=del size=2614283 2024-06-04T15:59:29.574 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.573+0000 7f5e9aacc780 1 < completed part key=_multipart_03ZNYG3WLMP4.2~5FLR0QT28GFE.0 size=725250 2024-06-04T15:59:29.576 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.576+0000 7f5e9aacc780 1 < completed multipart upload key=03ZNYG3WLMP4 upload=5FLR0QT28GFE tag=CI2WSGX3P3NL type=write size=1773826 2024-06-04T15:59:29.577 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.577+0000 7f5e9aacc780 1 > prepared operation key=A8O0S3S45RGM tag=OZXAT36B61KN type=del size=113647 2024-06-04T15:59:29.579 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.579+0000 7f5e9aacc780 1 < completed part key=_multipart_HD6SNICRCDLL.2~0SH6PUCI2SFC.0 size=31260 2024-06-04T15:59:29.581 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.581+0000 7f5e9aacc780 1 < completed multipart upload key=HD6SNICRCDLL upload=0SH6PUCI2SFC tag=ADPEAYQE5VB6 type=write size=1079836 2024-06-04T15:59:29.584 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.584+0000 7f5e9aacc780 1 > prepared part key=_multipart_Q4OFQI0F5YLG.2~XUF1ZOCQCG1L.0 size=1048576 2024-06-04T15:59:29.585 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.585+0000 7f5e9aacc780 1 > prepared part key=_multipart_Q4OFQI0F5YLG.2~XUF1ZOCQCG1L.1 size=1048576 2024-06-04T15:59:29.587 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.587+0000 7f5e9aacc780 1 > prepared part key=_multipart_Q4OFQI0F5YLG.2~XUF1ZOCQCG1L.2 size=43915 2024-06-04T15:59:29.587 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.587+0000 7f5e9aacc780 1 > prepared multipart upload key=Q4OFQI0F5YLG upload=XUF1ZOCQCG1L tag=R1JT9PEG1MO0 type=write size=3189643 2024-06-04T15:59:29.590 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.590+0000 7f5e9aacc780 1 < suggested remove operation key=B0HK5FJ2RGJE tag=65QD2UJ4SY4F type=write 2024-06-04T15:59:29.591 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.591+0000 7f5e9aacc780 1 > prepared operation key=K01DAK0M4I4M tag=2ZBHKPOH5V1J type=del size=514279 2024-06-04T15:59:29.593 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.593+0000 7f5e9aacc780 1 < completed delete operation key=9MPRI6LW3956 tag=49BI5DWQ80RR type=del 2024-06-04T15:59:29.594 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.594+0000 7f5e9aacc780 1 > prepared operation key=JL69PUHT6NNT tag=40XO9QHSIN8N type=del size=4116727 2024-06-04T15:59:29.596 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.596+0000 7f5e9aacc780 1 < completed part key=_multipart_AOCB36Y5Q7B0.2~C310P1M7S1WU.0 size=1048576 2024-06-04T15:59:29.597 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.597+0000 7f5e9aacc780 1 < completed part key=_multipart_AOCB36Y5Q7B0.2~C310P1M7S1WU.1 size=857311 2024-06-04T15:59:29.599 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.599+0000 7f5e9aacc780 1 < completed multipart upload key=AOCB36Y5Q7B0 upload=C310P1M7S1WU tag=0KA2GZM3THKO type=write size=2954463 2024-06-04T15:59:29.601 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.600+0000 7f5e9aacc780 1 > prepared operation key=AOCB36Y5Q7B0 tag=VJI707611YE4 type=del size=69600 2024-06-04T15:59:29.602 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.602+0000 7f5e9aacc780 -1 < failed to complete operation key=B0HK5FJ2RGJE tag=GL9XZVCIKZF3 type=del size=2344813: (22) Invalid argument 2024-06-04T15:59:29.603 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.603+0000 7f5e9aacc780 1 > prepared operation key=QUIVPH3OB6KN tag=M5MWV8A6PHG0 type=del size=3582599 2024-06-04T15:59:29.605 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.605+0000 7f5e9aacc780 1 < completed write operation key=2BT2AXKB1RTA tag=4MBQICX9UWPQ type=write size=694719 2024-06-04T15:59:29.608 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.608+0000 7f5e9aacc780 1 > prepared part key=_multipart_DY9JWHWNAUO1.2~59UYWUDK841F.0 size=205507 2024-06-04T15:59:29.608 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.608+0000 7f5e9aacc780 1 > prepared multipart upload key=DY9JWHWNAUO1 upload=59UYWUDK841F tag=AHK86ZNUXW6T type=write size=1254083 2024-06-04T15:59:29.609 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.609+0000 7f5e9aacc780 1 < completed delete operation key=XH0N984YVGKP tag=UT6T0OU39AVE type=del 2024-06-04T15:59:29.611 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.610+0000 7f5e9aacc780 1 > prepared operation key=NHPH4LYPP0LL tag=YF52SY6CB19B type=del size=42831 2024-06-04T15:59:29.614 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.613+0000 7f5e9aacc780 1 < suggested remove operation key=UW5LVIBG09SV tag=EXLL345SQNB2 type=del 2024-06-04T15:59:29.616 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.616+0000 7f5e9aacc780 1 > prepared part key=_multipart_NJ5U8JTT32QK.2~S1CKW4EPZC2S.0 size=1048576 2024-06-04T15:59:29.617 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.617+0000 7f5e9aacc780 1 > prepared part key=_multipart_NJ5U8JTT32QK.2~S1CKW4EPZC2S.1 size=520224 2024-06-04T15:59:29.617 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.617+0000 7f5e9aacc780 1 > prepared multipart upload key=NJ5U8JTT32QK upload=S1CKW4EPZC2S tag=5OAJ03WYQOQV type=write size=2617376 2024-06-04T15:59:29.618 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.618+0000 7f5e9aacc780 1 < completed part key=_multipart_RP8K6QJUZAH1.2~0ZHDT8KUW88L.0 size=1048576 2024-06-04T15:59:29.620 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.619+0000 7f5e9aacc780 1 < completed part key=_multipart_RP8K6QJUZAH1.2~0ZHDT8KUW88L.1 size=1048576 2024-06-04T15:59:29.621 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.620+0000 7f5e9aacc780 1 < completed part key=_multipart_RP8K6QJUZAH1.2~0ZHDT8KUW88L.2 size=658815 2024-06-04T15:59:29.623 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.623+0000 7f5e9aacc780 1 < completed multipart upload key=RP8K6QJUZAH1 upload=0ZHDT8KUW88L tag=L5D8S6RV5TSB type=write size=3804543 2024-06-04T15:59:29.625 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.624+0000 7f5e9aacc780 1 > prepared operation key=A8O0S3S45RGM tag=YHIYC2DPZZIN type=del size=368321 2024-06-04T15:59:29.626 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.626+0000 7f5e9aacc780 1 < canceled operation key=PNDPO2WUW7UX tag=03F7FHPCQUOX type=write size=657676 2024-06-04T15:59:29.627 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.627+0000 7f5e9aacc780 1 > prepared operation key=W1T4O3EAE7JN tag=RLDUQ8JUG2AX type=del size=2292361 2024-06-04T15:59:29.629 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.629+0000 7f5e9aacc780 1 < completed part key=_multipart_NJ5U8JTT32QK.2~96NRRR0O2LV5.0 size=1048576 2024-06-04T15:59:29.630 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.630+0000 7f5e9aacc780 1 < completed part key=_multipart_NJ5U8JTT32QK.2~96NRRR0O2LV5.1 size=1048576 2024-06-04T15:59:29.631 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.631+0000 7f5e9aacc780 1 < completed part key=_multipart_NJ5U8JTT32QK.2~96NRRR0O2LV5.2 size=938192 2024-06-04T15:59:29.633 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.633+0000 7f5e9aacc780 1 < completed multipart upload key=NJ5U8JTT32QK upload=96NRRR0O2LV5 tag=RYTPWD5047H4 type=write size=4083920 2024-06-04T15:59:29.636 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.635+0000 7f5e9aacc780 1 > prepared part key=_multipart_UTZHANL9ER2Q.2~VW3KSJ59QI3F.0 size=34560 2024-06-04T15:59:29.636 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.635+0000 7f5e9aacc780 1 > prepared multipart upload key=UTZHANL9ER2Q upload=VW3KSJ59QI3F tag=OHO4M3Q2CGB5 type=write size=1083136 2024-06-04T15:59:29.637 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.637+0000 7f5e9aacc780 1 < completed part key=_multipart_NHPH4LYPP0LL.2~MVKD8XR5MIUA.0 size=1048576 2024-06-04T15:59:29.637 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.637+0000 7f5e9aacc780 1 < canceled part key=_multipart_NHPH4LYPP0LL.2~MVKD8XR5MIUA.1 size=886004 2024-06-04T15:59:29.640 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.639+0000 7f5e9aacc780 1 < canceled multipart upload key=NHPH4LYPP0LL upload=MVKD8XR5MIUA tag=6TQMYY5TU1FC type=write size=2983156 2024-06-04T15:59:29.641 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.641+0000 7f5e9aacc780 1 > prepared operation key=PNDPO2WUW7UX tag=CEVGCWEATEH4 type=write size=129148 2024-06-04T15:59:29.643 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.643+0000 7f5e9aacc780 1 < completed delete operation key=GTRMEQJK675Z tag=073H3YUSX5UG type=del 2024-06-04T15:59:29.644 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.644+0000 7f5e9aacc780 1 > prepared operation key=7S9S3MIG7WIT tag=KQ2AP2DGKR9W type=del size=1024854 2024-06-04T15:59:29.646 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.647+0000 7f5e9aacc780 1 < completed part key=_multipart_PNDPO2WUW7UX.2~ZO698J2YBM69.0 size=1048576 2024-06-04T15:59:29.648 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.647+0000 7f5e9aacc780 1 < completed part key=_multipart_PNDPO2WUW7UX.2~ZO698J2YBM69.1 size=1048576 2024-06-04T15:59:29.648 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.647+0000 7f5e9aacc780 1 < canceled part key=_multipart_PNDPO2WUW7UX.2~ZO698J2YBM69.2 size=799262 2024-06-04T15:59:29.650 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.650+0000 7f5e9aacc780 1 < canceled multipart upload key=PNDPO2WUW7UX upload=ZO698J2YBM69 tag=C421S3W5XT71 type=write size=3944990 2024-06-04T15:59:29.653 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.652+0000 7f5e9aacc780 1 > prepared part key=_multipart_Q2V1ICTBSCV1.2~X3D4TYGSKDPB.0 size=1048576 2024-06-04T15:59:29.654 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.654+0000 7f5e9aacc780 1 > prepared part key=_multipart_Q2V1ICTBSCV1.2~X3D4TYGSKDPB.1 size=1048576 2024-06-04T15:59:29.655 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.654+0000 7f5e9aacc780 1 > prepared part key=_multipart_Q2V1ICTBSCV1.2~X3D4TYGSKDPB.2 size=502658 2024-06-04T15:59:29.655 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.654+0000 7f5e9aacc780 1 > prepared multipart upload key=Q2V1ICTBSCV1 upload=X3D4TYGSKDPB tag=GL1HUVA4ASYN type=write size=3648386 2024-06-04T15:59:29.656 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.656+0000 7f5e9aacc780 1 < completed delete operation key=SUBHZJ7HUV3H tag=E9V8K06YLO00 type=del 2024-06-04T15:59:29.659 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.659+0000 7f5e9aacc780 1 > prepared part key=_multipart_QUIVPH3OB6KN.2~AKAHPMTT5YVG.0 size=1048576 2024-06-04T15:59:29.660 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.660+0000 7f5e9aacc780 1 > prepared part key=_multipart_QUIVPH3OB6KN.2~AKAHPMTT5YVG.1 size=1048576 2024-06-04T15:59:29.662 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.661+0000 7f5e9aacc780 1 > prepared part key=_multipart_QUIVPH3OB6KN.2~AKAHPMTT5YVG.2 size=215829 2024-06-04T15:59:29.662 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.661+0000 7f5e9aacc780 1 > prepared multipart upload key=QUIVPH3OB6KN upload=AKAHPMTT5YVG tag=CTTHM0CMCZMU type=write size=3361557 2024-06-04T15:59:29.663 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.663+0000 7f5e9aacc780 1 < completed delete operation key=A8O0S3S45RGM tag=OZXAT36B61KN type=del 2024-06-04T15:59:29.664 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.664+0000 7f5e9aacc780 1 > prepared operation key=SUBHZJ7HUV3H tag=PTZIWW5Z0AJ4 type=del size=2730298 2024-06-04T15:59:29.666 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.666+0000 7f5e9aacc780 1 < completed part key=_multipart_Q4OFQI0F5YLG.2~XUF1ZOCQCG1L.0 size=1048576 2024-06-04T15:59:29.669 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.668+0000 7f5e9aacc780 1 < completed part key=_multipart_Q4OFQI0F5YLG.2~XUF1ZOCQCG1L.1 size=1048576 2024-06-04T15:59:29.669 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.669+0000 7f5e9aacc780 1 < completed part key=_multipart_Q4OFQI0F5YLG.2~XUF1ZOCQCG1L.2 size=43915 2024-06-04T15:59:29.672 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.671+0000 7f5e9aacc780 1 < completed multipart upload key=Q4OFQI0F5YLG upload=XUF1ZOCQCG1L tag=R1JT9PEG1MO0 type=write size=3189643 2024-06-04T15:59:29.674 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.674+0000 7f5e9aacc780 1 > prepared part key=_multipart_GCPC9OJH7KWU.2~Z6UE7YJMB262.0 size=1048576 2024-06-04T15:59:29.675 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.675+0000 7f5e9aacc780 1 > prepared part key=_multipart_GCPC9OJH7KWU.2~Z6UE7YJMB262.1 size=1048576 2024-06-04T15:59:29.676 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.676+0000 7f5e9aacc780 1 > prepared part key=_multipart_GCPC9OJH7KWU.2~Z6UE7YJMB262.2 size=906721 2024-06-04T15:59:29.676 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.676+0000 7f5e9aacc780 1 > prepared multipart upload key=GCPC9OJH7KWU upload=Z6UE7YJMB262 tag=AS3NT16OUCLI type=write size=4052449 2024-06-04T15:59:29.677 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.677+0000 7f5e9aacc780 1 < completed delete operation key=K01DAK0M4I4M tag=2ZBHKPOH5V1J type=del 2024-06-04T15:59:29.680 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.680+0000 7f5e9aacc780 1 > prepared part key=_multipart_JL69PUHT6NNT.2~9IB0W7EHOM0V.0 size=861854 2024-06-04T15:59:29.680 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.680+0000 7f5e9aacc780 1 > prepared multipart upload key=JL69PUHT6NNT upload=9IB0W7EHOM0V tag=IBPKOH72L6TB type=write size=1910430 2024-06-04T15:59:29.681 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.681+0000 7f5e9aacc780 1 < completed delete operation key=JL69PUHT6NNT tag=40XO9QHSIN8N type=del 2024-06-04T15:59:29.683 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.683+0000 7f5e9aacc780 1 > prepared operation key=2BT2AXKB1RTA tag=JE3WSH3V2HGO type=del size=3380077 2024-06-04T15:59:29.684 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.684+0000 7f5e9aacc780 1 < completed delete operation key=AOCB36Y5Q7B0 tag=VJI707611YE4 type=del 2024-06-04T15:59:29.687 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.687+0000 7f5e9aacc780 1 > prepared part key=_multipart_GCPC9OJH7KWU.2~6A4TK2XSXW70.0 size=1048576 2024-06-04T15:59:29.688 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.688+0000 7f5e9aacc780 1 > prepared part key=_multipart_GCPC9OJH7KWU.2~6A4TK2XSXW70.1 size=1048576 2024-06-04T15:59:29.689 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.689+0000 7f5e9aacc780 1 > prepared part key=_multipart_GCPC9OJH7KWU.2~6A4TK2XSXW70.2 size=364233 2024-06-04T15:59:29.690 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.689+0000 7f5e9aacc780 1 > prepared multipart upload key=GCPC9OJH7KWU upload=6A4TK2XSXW70 tag=W3CHJC4O8LWU type=write size=3509961 2024-06-04T15:59:29.692 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.692+0000 7f5e9aacc780 1 < suggested remove operation key=QUIVPH3OB6KN tag=M5MWV8A6PHG0 type=del 2024-06-04T15:59:29.695 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.694+0000 7f5e9aacc780 1 > prepared part key=_multipart_2BT2AXKB1RTA.2~XCBPD6NR7Y0R.0 size=1048576 2024-06-04T15:59:29.696 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.695+0000 7f5e9aacc780 1 > prepared part key=_multipart_2BT2AXKB1RTA.2~XCBPD6NR7Y0R.1 size=663874 2024-06-04T15:59:29.696 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.695+0000 7f5e9aacc780 1 > prepared multipart upload key=2BT2AXKB1RTA upload=XCBPD6NR7Y0R tag=L602Q03C96NB type=write size=2761026 2024-06-04T15:59:29.697 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.697+0000 7f5e9aacc780 1 < completed part key=_multipart_DY9JWHWNAUO1.2~59UYWUDK841F.0 size=205507 2024-06-04T15:59:29.699 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.699+0000 7f5e9aacc780 1 < completed multipart upload key=DY9JWHWNAUO1 upload=59UYWUDK841F tag=AHK86ZNUXW6T type=write size=1254083 2024-06-04T15:59:29.701 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.700+0000 7f5e9aacc780 1 > prepared operation key=NJ5U8JTT32QK tag=BQG1X4XC0Q3W type=del size=1138750 2024-06-04T15:59:29.704 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.703+0000 7f5e9aacc780 1 < suggested update operation key=NHPH4LYPP0LL tag=YF52SY6CB19B type=del size=42831 2024-06-04T15:59:29.705 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.705+0000 7f5e9aacc780 1 > prepared operation key=JL69PUHT6NNT tag=Y6N0BJ40IMSR type=del size=391638 2024-06-04T15:59:29.707 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.706+0000 7f5e9aacc780 1 < completed part key=_multipart_NJ5U8JTT32QK.2~S1CKW4EPZC2S.0 size=1048576 2024-06-04T15:59:29.708 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.707+0000 7f5e9aacc780 1 < completed part key=_multipart_NJ5U8JTT32QK.2~S1CKW4EPZC2S.1 size=520224 2024-06-04T15:59:29.710 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.710+0000 7f5e9aacc780 1 < completed multipart upload key=NJ5U8JTT32QK upload=S1CKW4EPZC2S tag=5OAJ03WYQOQV type=write size=2617376 2024-06-04T15:59:29.713 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.712+0000 7f5e9aacc780 1 > prepared part key=_multipart_QJA2JPATITNH.2~0DK4CWT2LMZX.0 size=1048576 2024-06-04T15:59:29.714 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.713+0000 7f5e9aacc780 1 > prepared part key=_multipart_QJA2JPATITNH.2~0DK4CWT2LMZX.1 size=383236 2024-06-04T15:59:29.714 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.713+0000 7f5e9aacc780 1 > prepared multipart upload key=QJA2JPATITNH upload=0DK4CWT2LMZX tag=G27O0WCN4116 type=write size=2480388 2024-06-04T15:59:29.715 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.715+0000 7f5e9aacc780 1 < completed delete operation key=A8O0S3S45RGM tag=YHIYC2DPZZIN type=del 2024-06-04T15:59:29.717 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.716+0000 7f5e9aacc780 1 > prepared operation key=JL69PUHT6NNT tag=D8CPQINFLWQ6 type=del size=1929049 2024-06-04T15:59:29.718 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.718+0000 7f5e9aacc780 1 < completed delete operation key=W1T4O3EAE7JN tag=RLDUQ8JUG2AX type=del 2024-06-04T15:59:29.719 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.719+0000 7f5e9aacc780 1 > prepared operation key=GTRMEQJK675Z tag=YGIMTDP3TGI6 type=write size=927544 2024-06-04T15:59:29.721 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.721+0000 7f5e9aacc780 1 < completed part key=_multipart_UTZHANL9ER2Q.2~VW3KSJ59QI3F.0 size=34560 2024-06-04T15:59:29.724 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.723+0000 7f5e9aacc780 1 < completed multipart upload key=UTZHANL9ER2Q upload=VW3KSJ59QI3F tag=OHO4M3Q2CGB5 type=write size=1083136 2024-06-04T15:59:29.725 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.725+0000 7f5e9aacc780 1 > prepared operation key=RP8K6QJUZAH1 tag=G504JO2PCV44 type=del size=1607560 2024-06-04T15:59:29.726 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.726+0000 7f5e9aacc780 1 < canceled operation key=PNDPO2WUW7UX tag=CEVGCWEATEH4 type=write size=129148 2024-06-04T15:59:29.729 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.728+0000 7f5e9aacc780 1 > prepared part key=_multipart_FBV2MAG130M6.2~ZV2MZHYVF4E9.0 size=1048576 2024-06-04T15:59:29.730 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.729+0000 7f5e9aacc780 1 > prepared part key=_multipart_FBV2MAG130M6.2~ZV2MZHYVF4E9.1 size=1048576 2024-06-04T15:59:29.731 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.730+0000 7f5e9aacc780 1 > prepared part key=_multipart_FBV2MAG130M6.2~ZV2MZHYVF4E9.2 size=347273 2024-06-04T15:59:29.731 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.730+0000 7f5e9aacc780 1 > prepared multipart upload key=FBV2MAG130M6 upload=ZV2MZHYVF4E9 tag=93A074WTZWF2 type=write size=3493001 2024-06-04T15:59:29.732 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.732+0000 7f5e9aacc780 1 < completed delete operation key=7S9S3MIG7WIT tag=KQ2AP2DGKR9W type=del 2024-06-04T15:59:29.734 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.734+0000 7f5e9aacc780 1 > prepared operation key=PNDPO2WUW7UX tag=D1RNPC3COD91 type=write size=264432 2024-06-04T15:59:29.735 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.735+0000 7f5e9aacc780 1 < completed part key=_multipart_Q2V1ICTBSCV1.2~X3D4TYGSKDPB.0 size=1048576 2024-06-04T15:59:29.736 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.736+0000 7f5e9aacc780 1 < completed part key=_multipart_Q2V1ICTBSCV1.2~X3D4TYGSKDPB.1 size=1048576 2024-06-04T15:59:29.737 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.737+0000 7f5e9aacc780 1 < completed part key=_multipart_Q2V1ICTBSCV1.2~X3D4TYGSKDPB.2 size=502658 2024-06-04T15:59:29.740 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.740+0000 7f5e9aacc780 1 < completed multipart upload key=Q2V1ICTBSCV1 upload=X3D4TYGSKDPB tag=GL1HUVA4ASYN type=write size=3648386 2024-06-04T15:59:29.742 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.742+0000 7f5e9aacc780 1 > prepared operation key=RP8K6QJUZAH1 tag=YKUSKFE5VHJ6 type=del size=1162942 2024-06-04T15:59:29.744 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.743+0000 7f5e9aacc780 1 < completed part key=_multipart_QUIVPH3OB6KN.2~AKAHPMTT5YVG.0 size=1048576 2024-06-04T15:59:29.744 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.744+0000 7f5e9aacc780 1 < completed part key=_multipart_QUIVPH3OB6KN.2~AKAHPMTT5YVG.1 size=1048576 2024-06-04T15:59:29.746 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.745+0000 7f5e9aacc780 1 < completed part key=_multipart_QUIVPH3OB6KN.2~AKAHPMTT5YVG.2 size=215829 2024-06-04T15:59:29.748 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.748+0000 7f5e9aacc780 1 < completed multipart upload key=QUIVPH3OB6KN upload=AKAHPMTT5YVG tag=CTTHM0CMCZMU type=write size=3361557 2024-06-04T15:59:29.750 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.749+0000 7f5e9aacc780 1 > prepared operation key=PASGIP872OVX tag=O22FG1MAM9BK type=del size=1996247 2024-06-04T15:59:29.751 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.751+0000 7f5e9aacc780 1 < completed delete operation key=SUBHZJ7HUV3H tag=PTZIWW5Z0AJ4 type=del 2024-06-04T15:59:29.753 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.753+0000 7f5e9aacc780 1 > prepared operation key=GCPC9OJH7KWU tag=CO1AEDD3R80E type=del size=68338 2024-06-04T15:59:29.754 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.754+0000 7f5e9aacc780 1 < completed part key=_multipart_GCPC9OJH7KWU.2~Z6UE7YJMB262.0 size=1048576 2024-06-04T15:59:29.755 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.755+0000 7f5e9aacc780 1 < completed part key=_multipart_GCPC9OJH7KWU.2~Z6UE7YJMB262.1 size=1048576 2024-06-04T15:59:29.756 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.756+0000 7f5e9aacc780 1 < completed part key=_multipart_GCPC9OJH7KWU.2~Z6UE7YJMB262.2 size=906721 2024-06-04T15:59:29.759 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.758+0000 7f5e9aacc780 1 < completed multipart upload key=GCPC9OJH7KWU upload=Z6UE7YJMB262 tag=AS3NT16OUCLI type=write size=4052449 2024-06-04T15:59:29.762 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.761+0000 7f5e9aacc780 1 > prepared part key=_multipart_HD6SNICRCDLL.2~526VIEJVX40L.0 size=80898 2024-06-04T15:59:29.762 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.761+0000 7f5e9aacc780 1 > prepared multipart upload key=HD6SNICRCDLL upload=526VIEJVX40L tag=6TQYHGN6YIRY type=write size=1129474 2024-06-04T15:59:29.762 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.762+0000 7f5e9aacc780 1 < canceled part key=_multipart_JL69PUHT6NNT.2~9IB0W7EHOM0V.0 size=861854 2024-06-04T15:59:29.765 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.764+0000 7f5e9aacc780 1 < canceled multipart upload key=JL69PUHT6NNT upload=9IB0W7EHOM0V tag=IBPKOH72L6TB type=write size=1910430 2024-06-04T15:59:29.766 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.766+0000 7f5e9aacc780 1 > prepared operation key=2BT2AXKB1RTA tag=KRYEQPE01CV3 type=write size=923607 2024-06-04T15:59:29.768 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.768+0000 7f5e9aacc780 1 < completed delete operation key=2BT2AXKB1RTA tag=JE3WSH3V2HGO type=del 2024-06-04T15:59:29.770 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.770+0000 7f5e9aacc780 1 > prepared operation key=XH0N984YVGKP tag=OE8BKNKSJ0X3 type=del size=2728671 2024-06-04T15:59:29.771 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.771+0000 7f5e9aacc780 1 < completed part key=_multipart_GCPC9OJH7KWU.2~6A4TK2XSXW70.0 size=1048576 2024-06-04T15:59:29.771 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.771+0000 7f5e9aacc780 1 < canceled part key=_multipart_GCPC9OJH7KWU.2~6A4TK2XSXW70.1 size=1048576 2024-06-04T15:59:29.773 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.772+0000 7f5e9aacc780 1 < completed part key=_multipart_GCPC9OJH7KWU.2~6A4TK2XSXW70.2 size=364233 2024-06-04T15:59:29.775 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.775+0000 7f5e9aacc780 1 < canceled multipart upload key=GCPC9OJH7KWU upload=6A4TK2XSXW70 tag=W3CHJC4O8LWU type=write size=3509961 2024-06-04T15:59:29.777 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.777+0000 7f5e9aacc780 1 > prepared operation key=AOCB36Y5Q7B0 tag=C2FPVPMWOPB0 type=del size=831595 2024-06-04T15:59:29.778 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.778+0000 7f5e9aacc780 1 < completed part key=_multipart_2BT2AXKB1RTA.2~XCBPD6NR7Y0R.0 size=1048576 2024-06-04T15:59:29.779 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.779+0000 7f5e9aacc780 1 < completed part key=_multipart_2BT2AXKB1RTA.2~XCBPD6NR7Y0R.1 size=663874 2024-06-04T15:59:29.782 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.781+0000 7f5e9aacc780 1 < completed multipart upload key=2BT2AXKB1RTA upload=XCBPD6NR7Y0R tag=L602Q03C96NB type=write size=2761026 2024-06-04T15:59:29.784 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.784+0000 7f5e9aacc780 1 > prepared part key=_multipart_K01DAK0M4I4M.2~KLN15MVIABK8.0 size=1048576 2024-06-04T15:59:29.786 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.786+0000 7f5e9aacc780 1 > prepared part key=_multipart_K01DAK0M4I4M.2~KLN15MVIABK8.1 size=1048576 2024-06-04T15:59:29.787 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.786+0000 7f5e9aacc780 1 > prepared part key=_multipart_K01DAK0M4I4M.2~KLN15MVIABK8.2 size=952313 2024-06-04T15:59:29.787 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.786+0000 7f5e9aacc780 1 > prepared multipart upload key=K01DAK0M4I4M upload=KLN15MVIABK8 tag=2LLHB6R730TZ type=write size=4098041 2024-06-04T15:59:29.790 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.790+0000 7f5e9aacc780 1 < suggested update operation key=NJ5U8JTT32QK tag=BQG1X4XC0Q3W type=del size=1138750 2024-06-04T15:59:29.791 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.791+0000 7f5e9aacc780 1 > prepared operation key=PCLJXQHJ4HTY tag=12P8OD65X3TY type=del size=2307191 2024-06-04T15:59:29.793 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.792+0000 7f5e9aacc780 1 < canceled operation key=JL69PUHT6NNT tag=Y6N0BJ40IMSR type=del size=391638 2024-06-04T15:59:29.795 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.795+0000 7f5e9aacc780 1 > prepared part key=_multipart_RP8K6QJUZAH1.2~GPOF9S8LO6C8.0 size=1048576 2024-06-04T15:59:29.796 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.796+0000 7f5e9aacc780 1 > prepared part key=_multipart_RP8K6QJUZAH1.2~GPOF9S8LO6C8.1 size=1048576 2024-06-04T15:59:29.797 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.797+0000 7f5e9aacc780 1 > prepared part key=_multipart_RP8K6QJUZAH1.2~GPOF9S8LO6C8.2 size=254901 2024-06-04T15:59:29.797 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.797+0000 7f5e9aacc780 1 > prepared multipart upload key=RP8K6QJUZAH1 upload=GPOF9S8LO6C8 tag=ZFQZKLP8ZZWZ type=write size=3400629 2024-06-04T15:59:29.797 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.797+0000 7f5e9aacc780 1 < canceled part key=_multipart_QJA2JPATITNH.2~0DK4CWT2LMZX.0 size=1048576 2024-06-04T15:59:29.798 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.798+0000 7f5e9aacc780 1 < completed part key=_multipart_QJA2JPATITNH.2~0DK4CWT2LMZX.1 size=383236 2024-06-04T15:59:29.802 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.802+0000 7f5e9aacc780 1 < canceled multipart upload key=QJA2JPATITNH upload=0DK4CWT2LMZX tag=G27O0WCN4116 type=write size=2480388 2024-06-04T15:59:29.805 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.804+0000 7f5e9aacc780 1 > prepared part key=_multipart_2BT2AXKB1RTA.2~QOE2DBLHU3EX.0 size=1048576 2024-06-04T15:59:29.806 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.805+0000 7f5e9aacc780 1 > prepared part key=_multipart_2BT2AXKB1RTA.2~QOE2DBLHU3EX.1 size=1039730 2024-06-04T15:59:29.806 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.805+0000 7f5e9aacc780 1 > prepared multipart upload key=2BT2AXKB1RTA upload=QOE2DBLHU3EX tag=76YTB5P15KCX type=write size=3136882 2024-06-04T15:59:29.808 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.808+0000 7f5e9aacc780 1 < suggested remove operation key=JL69PUHT6NNT tag=D8CPQINFLWQ6 type=del 2024-06-04T15:59:29.810 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.810+0000 7f5e9aacc780 1 > prepared operation key=GCPC9OJH7KWU tag=VW3BUO4YAT5L type=del size=2775134 2024-06-04T15:59:29.811 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.811+0000 7f5e9aacc780 1 < completed write operation key=GTRMEQJK675Z tag=YGIMTDP3TGI6 type=write size=927544 2024-06-04T15:59:29.814 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.814+0000 7f5e9aacc780 1 > prepared part key=_multipart_4W5HB9WQQHR6.2~VMGBXXCWBIMC.0 size=706153 2024-06-04T15:59:29.814 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.814+0000 7f5e9aacc780 1 > prepared multipart upload key=4W5HB9WQQHR6 upload=VMGBXXCWBIMC tag=LB26Y2L3S0V4 type=write size=1754729 2024-06-04T15:59:29.815 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.815+0000 7f5e9aacc780 1 < completed delete operation key=RP8K6QJUZAH1 tag=G504JO2PCV44 type=del 2024-06-04T15:59:29.818 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.818+0000 7f5e9aacc780 1 > prepared part key=_multipart_Q2V1ICTBSCV1.2~58ZO3JY7NQDZ.0 size=1048576 2024-06-04T15:59:29.819 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.819+0000 7f5e9aacc780 1 > prepared part key=_multipart_Q2V1ICTBSCV1.2~58ZO3JY7NQDZ.1 size=855854 2024-06-04T15:59:29.819 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.819+0000 7f5e9aacc780 1 > prepared multipart upload key=Q2V1ICTBSCV1 upload=58ZO3JY7NQDZ tag=U90GV4R2F5BL type=write size=2953006 2024-06-04T15:59:29.820 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.820+0000 7f5e9aacc780 1 < completed part key=_multipart_FBV2MAG130M6.2~ZV2MZHYVF4E9.0 size=1048576 2024-06-04T15:59:29.822 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.821+0000 7f5e9aacc780 1 < completed part key=_multipart_FBV2MAG130M6.2~ZV2MZHYVF4E9.1 size=1048576 2024-06-04T15:59:29.823 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.822+0000 7f5e9aacc780 1 < completed part key=_multipart_FBV2MAG130M6.2~ZV2MZHYVF4E9.2 size=347273 2024-06-04T15:59:29.825 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.825+0000 7f5e9aacc780 1 < completed multipart upload key=FBV2MAG130M6 upload=ZV2MZHYVF4E9 tag=93A074WTZWF2 type=write size=3493001 2024-06-04T15:59:29.828 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.828+0000 7f5e9aacc780 1 > prepared part key=_multipart_03ZNYG3WLMP4.2~TXQ2XF5YTRN5.0 size=1048576 2024-06-04T15:59:29.829 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.829+0000 7f5e9aacc780 1 > prepared part key=_multipart_03ZNYG3WLMP4.2~TXQ2XF5YTRN5.1 size=1048576 2024-06-04T15:59:29.830 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.830+0000 7f5e9aacc780 1 > prepared part key=_multipart_03ZNYG3WLMP4.2~TXQ2XF5YTRN5.2 size=555099 2024-06-04T15:59:29.830 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.830+0000 7f5e9aacc780 1 > prepared multipart upload key=03ZNYG3WLMP4 upload=TXQ2XF5YTRN5 tag=3S3WSIJFFK03 type=write size=3700827 2024-06-04T15:59:29.832 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.832+0000 7f5e9aacc780 1 < completed write operation key=PNDPO2WUW7UX tag=D1RNPC3COD91 type=write size=264432 2024-06-04T15:59:29.833 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.833+0000 7f5e9aacc780 1 > prepared operation key=PASGIP872OVX tag=GJQZV1SKC2O5 type=del size=1272575 2024-06-04T15:59:29.835 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.834+0000 7f5e9aacc780 1 < completed delete operation key=RP8K6QJUZAH1 tag=YKUSKFE5VHJ6 type=del 2024-06-04T15:59:29.836 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.836+0000 7f5e9aacc780 1 > prepared operation key=03ZNYG3WLMP4 tag=WJEK5UN79R6I type=del size=480513 2024-06-04T15:59:29.838 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.837+0000 7f5e9aacc780 1 < completed delete operation key=PASGIP872OVX tag=O22FG1MAM9BK type=del 2024-06-04T15:59:29.839 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.839+0000 7f5e9aacc780 1 > prepared operation key=9MPRI6LW3956 tag=AXR82BUQVGKH type=del size=2627639 2024-06-04T15:59:29.841 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.840+0000 7f5e9aacc780 1 < completed delete operation key=GCPC9OJH7KWU tag=CO1AEDD3R80E type=del 2024-06-04T15:59:29.842 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.842+0000 7f5e9aacc780 1 > prepared operation key=A8O0S3S45RGM tag=F40L7HUAJY7W type=del size=1061205 2024-06-04T15:59:29.842 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.842+0000 7f5e9aacc780 1 < canceled part key=_multipart_HD6SNICRCDLL.2~526VIEJVX40L.0 size=80898 2024-06-04T15:59:29.845 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.844+0000 7f5e9aacc780 1 < canceled multipart upload key=HD6SNICRCDLL upload=526VIEJVX40L tag=6TQYHGN6YIRY type=write size=1129474 2024-06-04T15:59:29.847 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.847+0000 7f5e9aacc780 1 > prepared part key=_multipart_B0HK5FJ2RGJE.2~6L410CDM42T3.0 size=1048576 2024-06-04T15:59:29.848 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.848+0000 7f5e9aacc780 1 > prepared part key=_multipart_B0HK5FJ2RGJE.2~6L410CDM42T3.1 size=1048576 2024-06-04T15:59:29.849 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.849+0000 7f5e9aacc780 1 > prepared part key=_multipart_B0HK5FJ2RGJE.2~6L410CDM42T3.2 size=221024 2024-06-04T15:59:29.849 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.849+0000 7f5e9aacc780 1 > prepared multipart upload key=B0HK5FJ2RGJE upload=6L410CDM42T3 tag=5OJXNTB54RVL type=write size=3366752 2024-06-04T15:59:29.851 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.850+0000 7f5e9aacc780 1 < completed write operation key=2BT2AXKB1RTA tag=KRYEQPE01CV3 type=write size=923607 2024-06-04T15:59:29.853 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.853+0000 7f5e9aacc780 1 > prepared part key=_multipart_DY9JWHWNAUO1.2~MM6H2YFW1GG7.0 size=451352 2024-06-04T15:59:29.853 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.853+0000 7f5e9aacc780 1 > prepared multipart upload key=DY9JWHWNAUO1 upload=MM6H2YFW1GG7 tag=57PUA0TJ35SZ type=write size=1499928 2024-06-04T15:59:29.855 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.854+0000 7f5e9aacc780 1 < completed delete operation key=XH0N984YVGKP tag=OE8BKNKSJ0X3 type=del 2024-06-04T15:59:29.856 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.856+0000 7f5e9aacc780 1 > prepared operation key=7S9S3MIG7WIT tag=RXVY612K6MYC type=del size=113025 2024-06-04T15:59:29.857 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.857+0000 7f5e9aacc780 1 < canceled operation key=AOCB36Y5Q7B0 tag=C2FPVPMWOPB0 type=del size=831595 2024-06-04T15:59:29.860 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.859+0000 7f5e9aacc780 1 > prepared part key=_multipart_JL69PUHT6NNT.2~T0XDNBRF92H3.0 size=255395 2024-06-04T15:59:29.860 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.859+0000 7f5e9aacc780 1 > prepared multipart upload key=JL69PUHT6NNT upload=T0XDNBRF92H3 tag=QCJ9K5OLFQ2F type=write size=1303971 2024-06-04T15:59:29.861 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.861+0000 7f5e9aacc780 1 < completed part key=_multipart_K01DAK0M4I4M.2~KLN15MVIABK8.0 size=1048576 2024-06-04T15:59:29.862 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.862+0000 7f5e9aacc780 1 < completed part key=_multipart_K01DAK0M4I4M.2~KLN15MVIABK8.1 size=1048576 2024-06-04T15:59:29.863 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.863+0000 7f5e9aacc780 1 < completed part key=_multipart_K01DAK0M4I4M.2~KLN15MVIABK8.2 size=952313 2024-06-04T15:59:29.865 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.865+0000 7f5e9aacc780 1 < completed multipart upload key=K01DAK0M4I4M upload=KLN15MVIABK8 tag=2LLHB6R730TZ type=write size=4098041 2024-06-04T15:59:29.867 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.866+0000 7f5e9aacc780 1 > prepared operation key=NJ5U8JTT32QK tag=7ADEMY9B7ADW type=del size=2720 2024-06-04T15:59:29.868 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.868+0000 7f5e9aacc780 1 < completed delete operation key=PCLJXQHJ4HTY tag=12P8OD65X3TY type=del 2024-06-04T15:59:29.871 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.870+0000 7f5e9aacc780 1 > prepared part key=_multipart_K01DAK0M4I4M.2~3JOZ1H828MFE.0 size=1048576 2024-06-04T15:59:29.872 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.872+0000 7f5e9aacc780 1 > prepared part key=_multipart_K01DAK0M4I4M.2~3JOZ1H828MFE.1 size=1048576 2024-06-04T15:59:29.873 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.873+0000 7f5e9aacc780 1 > prepared part key=_multipart_K01DAK0M4I4M.2~3JOZ1H828MFE.2 size=1048510 2024-06-04T15:59:29.873 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.873+0000 7f5e9aacc780 1 > prepared multipart upload key=K01DAK0M4I4M upload=3JOZ1H828MFE tag=VQZRZYW9KLZ5 type=write size=4194238 2024-06-04T15:59:29.875 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.874+0000 7f5e9aacc780 1 < completed part key=_multipart_RP8K6QJUZAH1.2~GPOF9S8LO6C8.0 size=1048576 2024-06-04T15:59:29.876 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.875+0000 7f5e9aacc780 1 < completed part key=_multipart_RP8K6QJUZAH1.2~GPOF9S8LO6C8.1 size=1048576 2024-06-04T15:59:29.877 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.877+0000 7f5e9aacc780 1 < completed part key=_multipart_RP8K6QJUZAH1.2~GPOF9S8LO6C8.2 size=254901 2024-06-04T15:59:29.879 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.879+0000 7f5e9aacc780 1 < completed multipart upload key=RP8K6QJUZAH1 upload=GPOF9S8LO6C8 tag=ZFQZKLP8ZZWZ type=write size=3400629 2024-06-04T15:59:29.880 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.880+0000 7f5e9aacc780 1 > prepared operation key=PCLJXQHJ4HTY tag=YQ858GD5FDUC type=write size=648218 2024-06-04T15:59:29.882 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.881+0000 7f5e9aacc780 1 < completed part key=_multipart_2BT2AXKB1RTA.2~QOE2DBLHU3EX.0 size=1048576 2024-06-04T15:59:29.883 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.882+0000 7f5e9aacc780 1 < completed part key=_multipart_2BT2AXKB1RTA.2~QOE2DBLHU3EX.1 size=1039730 2024-06-04T15:59:29.885 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.885+0000 7f5e9aacc780 1 < completed multipart upload key=2BT2AXKB1RTA upload=QOE2DBLHU3EX tag=76YTB5P15KCX type=write size=3136882 2024-06-04T15:59:29.888 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.887+0000 7f5e9aacc780 1 > prepared part key=_multipart_XH0N984YVGKP.2~P64ZCYIJ6A1S.0 size=876450 2024-06-04T15:59:29.888 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.887+0000 7f5e9aacc780 1 > prepared multipart upload key=XH0N984YVGKP upload=P64ZCYIJ6A1S tag=IZ5TGYA8W1P1 type=write size=1925026 2024-06-04T15:59:29.889 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.889+0000 7f5e9aacc780 1 < completed delete operation key=GCPC9OJH7KWU tag=VW3BUO4YAT5L type=del 2024-06-04T15:59:29.892 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.891+0000 7f5e9aacc780 1 > prepared part key=_multipart_NJ5U8JTT32QK.2~6FD52H4S73NM.0 size=189946 2024-06-04T15:59:29.892 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.891+0000 7f5e9aacc780 1 > prepared multipart upload key=NJ5U8JTT32QK upload=6FD52H4S73NM tag=CXPO1YUGA6XC type=write size=1238522 2024-06-04T15:59:29.893 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.893+0000 7f5e9aacc780 1 < completed part key=_multipart_4W5HB9WQQHR6.2~VMGBXXCWBIMC.0 size=706153 2024-06-04T15:59:29.895 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.895+0000 7f5e9aacc780 1 < completed multipart upload key=4W5HB9WQQHR6 upload=VMGBXXCWBIMC tag=LB26Y2L3S0V4 type=write size=1754729 2024-06-04T15:59:29.896 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.896+0000 7f5e9aacc780 1 > prepared operation key=Q2V1ICTBSCV1 tag=CQ9NXF63K11Z type=del size=3711205 2024-06-04T15:59:29.898 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.897+0000 7f5e9aacc780 1 < completed part key=_multipart_Q2V1ICTBSCV1.2~58ZO3JY7NQDZ.0 size=1048576 2024-06-04T15:59:29.899 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.899+0000 7f5e9aacc780 1 < completed part key=_multipart_Q2V1ICTBSCV1.2~58ZO3JY7NQDZ.1 size=855854 2024-06-04T15:59:29.901 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.901+0000 7f5e9aacc780 1 < completed multipart upload key=Q2V1ICTBSCV1 upload=58ZO3JY7NQDZ tag=U90GV4R2F5BL type=write size=2953006 2024-06-04T15:59:29.903 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.902+0000 7f5e9aacc780 1 > prepared operation key=2BT2AXKB1RTA tag=MXFPB5PBUYLV type=del size=3343895 2024-06-04T15:59:29.904 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.904+0000 7f5e9aacc780 1 < completed part key=_multipart_03ZNYG3WLMP4.2~TXQ2XF5YTRN5.0 size=1048576 2024-06-04T15:59:29.905 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.905+0000 7f5e9aacc780 1 < completed part key=_multipart_03ZNYG3WLMP4.2~TXQ2XF5YTRN5.1 size=1048576 2024-06-04T15:59:29.906 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.906+0000 7f5e9aacc780 1 < completed part key=_multipart_03ZNYG3WLMP4.2~TXQ2XF5YTRN5.2 size=555099 2024-06-04T15:59:29.909 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.908+0000 7f5e9aacc780 1 < completed multipart upload key=03ZNYG3WLMP4 upload=TXQ2XF5YTRN5 tag=3S3WSIJFFK03 type=write size=3700827 2024-06-04T15:59:29.911 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.911+0000 7f5e9aacc780 1 > prepared part key=_multipart_RP8K6QJUZAH1.2~JSW28AH27GOM.0 size=592422 2024-06-04T15:59:29.911 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.911+0000 7f5e9aacc780 1 > prepared multipart upload key=RP8K6QJUZAH1 upload=JSW28AH27GOM tag=OLERF8M1SJX0 type=write size=1640998 2024-06-04T15:59:29.913 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.913+0000 7f5e9aacc780 1 < completed delete operation key=PASGIP872OVX tag=GJQZV1SKC2O5 type=del 2024-06-04T15:59:29.915 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.914+0000 7f5e9aacc780 1 > prepared operation key=DY9JWHWNAUO1 tag=XZQPF39RPZBB type=del size=47472 2024-06-04T15:59:29.916 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.916+0000 7f5e9aacc780 1 < completed delete operation key=03ZNYG3WLMP4 tag=WJEK5UN79R6I type=del 2024-06-04T15:59:29.918 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.917+0000 7f5e9aacc780 1 > prepared operation key=HD6SNICRCDLL tag=E3V22UDTFPIK type=del size=2171209 2024-06-04T15:59:29.920 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.920+0000 7f5e9aacc780 1 < suggested remove operation key=9MPRI6LW3956 tag=AXR82BUQVGKH type=del 2024-06-04T15:59:29.923 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.923+0000 7f5e9aacc780 1 > prepared part key=_multipart_1IKNQXU3Y2JJ.2~VO5UY6OE7WXO.0 size=1048576 2024-06-04T15:59:29.924 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.924+0000 7f5e9aacc780 1 > prepared part key=_multipart_1IKNQXU3Y2JJ.2~VO5UY6OE7WXO.1 size=1048576 2024-06-04T15:59:29.925 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.925+0000 7f5e9aacc780 1 > prepared part key=_multipart_1IKNQXU3Y2JJ.2~VO5UY6OE7WXO.2 size=940981 2024-06-04T15:59:29.925 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.925+0000 7f5e9aacc780 1 > prepared multipart upload key=1IKNQXU3Y2JJ upload=VO5UY6OE7WXO tag=DJWFM6XKOJBT type=write size=4086709 2024-06-04T15:59:29.926 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.926+0000 7f5e9aacc780 1 < completed delete operation key=A8O0S3S45RGM tag=F40L7HUAJY7W type=del 2024-06-04T15:59:29.930 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.930+0000 7f5e9aacc780 1 > prepared part key=_multipart_Q4OFQI0F5YLG.2~1Q4LCEOFGVXZ.0 size=335658 2024-06-04T15:59:29.930 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.930+0000 7f5e9aacc780 1 > prepared multipart upload key=Q4OFQI0F5YLG upload=1Q4LCEOFGVXZ tag=9ADQ67JN7NA9 type=write size=1384234 2024-06-04T15:59:29.932 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.932+0000 7f5e9aacc780 1 < completed part key=_multipart_B0HK5FJ2RGJE.2~6L410CDM42T3.0 size=1048576 2024-06-04T15:59:29.933 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.933+0000 7f5e9aacc780 1 < completed part key=_multipart_B0HK5FJ2RGJE.2~6L410CDM42T3.1 size=1048576 2024-06-04T15:59:29.934 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.934+0000 7f5e9aacc780 1 < completed part key=_multipart_B0HK5FJ2RGJE.2~6L410CDM42T3.2 size=221024 2024-06-04T15:59:29.937 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.936+0000 7f5e9aacc780 1 < completed multipart upload key=B0HK5FJ2RGJE upload=6L410CDM42T3 tag=5OJXNTB54RVL type=write size=3366752 2024-06-04T15:59:29.938 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.938+0000 7f5e9aacc780 1 > prepared operation key=GCPC9OJH7KWU tag=5FFCZCIK0G37 type=del size=1652676 2024-06-04T15:59:29.940 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.940+0000 7f5e9aacc780 1 < completed part key=_multipart_DY9JWHWNAUO1.2~MM6H2YFW1GG7.0 size=451352 2024-06-04T15:59:29.942 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.942+0000 7f5e9aacc780 1 < completed multipart upload key=DY9JWHWNAUO1 upload=MM6H2YFW1GG7 tag=57PUA0TJ35SZ type=write size=1499928 2024-06-04T15:59:29.945 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.945+0000 7f5e9aacc780 1 > prepared part key=_multipart_TUGKW7F4V9NO.2~2KMUXRBV0QW8.0 size=1048576 2024-06-04T15:59:29.946 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.946+0000 7f5e9aacc780 1 > prepared part key=_multipart_TUGKW7F4V9NO.2~2KMUXRBV0QW8.1 size=1048576 2024-06-04T15:59:29.947 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.947+0000 7f5e9aacc780 1 > prepared part key=_multipart_TUGKW7F4V9NO.2~2KMUXRBV0QW8.2 size=693594 2024-06-04T15:59:29.948 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.947+0000 7f5e9aacc780 1 > prepared multipart upload key=TUGKW7F4V9NO upload=2KMUXRBV0QW8 tag=JBGQIBNPE53J type=write size=3839322 2024-06-04T15:59:29.949 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.949+0000 7f5e9aacc780 1 < completed delete operation key=7S9S3MIG7WIT tag=RXVY612K6MYC type=del 2024-06-04T15:59:29.951 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.950+0000 7f5e9aacc780 1 > prepared operation key=PCLJXQHJ4HTY tag=YC45RPOPG7I4 type=del size=250505 2024-06-04T15:59:29.952 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.952+0000 7f5e9aacc780 1 < completed part key=_multipart_JL69PUHT6NNT.2~T0XDNBRF92H3.0 size=255395 2024-06-04T15:59:29.954 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.954+0000 7f5e9aacc780 1 < completed multipart upload key=JL69PUHT6NNT upload=T0XDNBRF92H3 tag=QCJ9K5OLFQ2F type=write size=1303971 2024-06-04T15:59:29.957 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.957+0000 7f5e9aacc780 1 > prepared part key=_multipart_NJ5U8JTT32QK.2~R6TSBXCBNTAW.0 size=1048576 2024-06-04T15:59:29.958 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.958+0000 7f5e9aacc780 1 > prepared part key=_multipart_NJ5U8JTT32QK.2~R6TSBXCBNTAW.1 size=37267 2024-06-04T15:59:29.958 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.958+0000 7f5e9aacc780 1 > prepared multipart upload key=NJ5U8JTT32QK upload=R6TSBXCBNTAW tag=LIIL9ASVX0X5 type=write size=2134419 2024-06-04T15:59:29.961 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.960+0000 7f5e9aacc780 1 < suggested update operation key=NJ5U8JTT32QK tag=7ADEMY9B7ADW type=del size=2720 2024-06-04T15:59:29.962 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.962+0000 7f5e9aacc780 1 > prepared operation key=AOCB36Y5Q7B0 tag=DCK048ZF40JU type=del size=3748551 2024-06-04T15:59:29.964 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.964+0000 7f5e9aacc780 1 < completed part key=_multipart_K01DAK0M4I4M.2~3JOZ1H828MFE.0 size=1048576 2024-06-04T15:59:29.965 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.964+0000 7f5e9aacc780 1 < completed part key=_multipart_K01DAK0M4I4M.2~3JOZ1H828MFE.1 size=1048576 2024-06-04T15:59:29.966 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.966+0000 7f5e9aacc780 1 < completed part key=_multipart_K01DAK0M4I4M.2~3JOZ1H828MFE.2 size=1048510 2024-06-04T15:59:29.968 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.968+0000 7f5e9aacc780 1 < completed multipart upload key=K01DAK0M4I4M upload=3JOZ1H828MFE tag=VQZRZYW9KLZ5 type=write size=4194238 2024-06-04T15:59:29.971 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.971+0000 7f5e9aacc780 1 > prepared part key=_multipart_9MPRI6LW3956.2~ZNTHYDHTH5E2.0 size=1048576 2024-06-04T15:59:29.972 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.972+0000 7f5e9aacc780 1 > prepared part key=_multipart_9MPRI6LW3956.2~ZNTHYDHTH5E2.1 size=467718 2024-06-04T15:59:29.972 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.972+0000 7f5e9aacc780 1 > prepared multipart upload key=9MPRI6LW3956 upload=ZNTHYDHTH5E2 tag=LDINLU5MQY0U type=write size=2564870 2024-06-04T15:59:29.973 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.973+0000 7f5e9aacc780 1 < completed write operation key=PCLJXQHJ4HTY tag=YQ858GD5FDUC type=write size=648218 2024-06-04T15:59:29.976 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.976+0000 7f5e9aacc780 1 > prepared part key=_multipart_2BT2AXKB1RTA.2~D7F8FTCSOXBT.0 size=1048576 2024-06-04T15:59:29.978 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.977+0000 7f5e9aacc780 1 > prepared part key=_multipart_2BT2AXKB1RTA.2~D7F8FTCSOXBT.1 size=22732 2024-06-04T15:59:29.978 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.977+0000 7f5e9aacc780 1 > prepared multipart upload key=2BT2AXKB1RTA upload=D7F8FTCSOXBT tag=QKD7DE04AUH1 type=write size=2119884 2024-06-04T15:59:29.979 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.979+0000 7f5e9aacc780 1 < completed part key=_multipart_XH0N984YVGKP.2~P64ZCYIJ6A1S.0 size=876450 2024-06-04T15:59:29.981 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.981+0000 7f5e9aacc780 1 < completed multipart upload key=XH0N984YVGKP upload=P64ZCYIJ6A1S tag=IZ5TGYA8W1P1 type=write size=1925026 2024-06-04T15:59:29.983 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.983+0000 7f5e9aacc780 1 > prepared operation key=K01DAK0M4I4M tag=12QZTTGEAJ0U type=del size=2680739 2024-06-04T15:59:29.984 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.983+0000 7f5e9aacc780 1 < canceled part key=_multipart_NJ5U8JTT32QK.2~6FD52H4S73NM.0 size=189946 2024-06-04T15:59:29.986 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.986+0000 7f5e9aacc780 1 < canceled multipart upload key=NJ5U8JTT32QK upload=6FD52H4S73NM tag=CXPO1YUGA6XC type=write size=1238522 2024-06-04T15:59:29.988 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.987+0000 7f5e9aacc780 1 > prepared operation key=HD6SNICRCDLL tag=Z8AG8CIDN6G0 type=del size=1078894 2024-06-04T15:59:29.989 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.989+0000 7f5e9aacc780 1 < completed delete operation key=Q2V1ICTBSCV1 tag=CQ9NXF63K11Z type=del 2024-06-04T15:59:29.991 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.990+0000 7f5e9aacc780 1 > prepared operation key=UW5LVIBG09SV tag=6FBRWV2Y78AB type=write size=722767 2024-06-04T15:59:29.992 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.992+0000 7f5e9aacc780 1 < completed delete operation key=2BT2AXKB1RTA tag=MXFPB5PBUYLV type=del 2024-06-04T15:59:29.993 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.993+0000 7f5e9aacc780 1 > prepared operation key=W1T4O3EAE7JN tag=K98E391FZRLJ type=del size=3456199 2024-06-04T15:59:29.995 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.995+0000 7f5e9aacc780 1 < completed part key=_multipart_RP8K6QJUZAH1.2~JSW28AH27GOM.0 size=592422 2024-06-04T15:59:29.997 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.997+0000 7f5e9aacc780 1 < completed multipart upload key=RP8K6QJUZAH1 upload=JSW28AH27GOM tag=OLERF8M1SJX0 type=write size=1640998 2024-06-04T15:59:29.998 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:29.998+0000 7f5e9aacc780 1 > prepared operation key=SUBHZJ7HUV3H tag=A06Y73IIWSRJ type=del size=1987039 2024-06-04T15:59:30.000 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.000+0000 7f5e9aacc780 1 < completed delete operation key=DY9JWHWNAUO1 tag=XZQPF39RPZBB type=del 2024-06-04T15:59:30.001 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.001+0000 7f5e9aacc780 1 > prepared operation key=Q2V1ICTBSCV1 tag=VA62EEJ9F5KR type=write size=479984 2024-06-04T15:59:30.003 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.003+0000 7f5e9aacc780 1 < completed delete operation key=HD6SNICRCDLL tag=E3V22UDTFPIK type=del 2024-06-04T15:59:30.006 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.006+0000 7f5e9aacc780 1 > prepared part key=_multipart_Q2V1ICTBSCV1.2~UFNN2BAENZHJ.0 size=1048576 2024-06-04T15:59:30.007 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.006+0000 7f5e9aacc780 1 > prepared part key=_multipart_Q2V1ICTBSCV1.2~UFNN2BAENZHJ.1 size=1048576 2024-06-04T15:59:30.008 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.008+0000 7f5e9aacc780 1 > prepared part key=_multipart_Q2V1ICTBSCV1.2~UFNN2BAENZHJ.2 size=446881 2024-06-04T15:59:30.008 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.008+0000 7f5e9aacc780 1 > prepared multipart upload key=Q2V1ICTBSCV1 upload=UFNN2BAENZHJ tag=8780SIAYL9U0 type=write size=3592609 2024-06-04T15:59:30.009 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.009+0000 7f5e9aacc780 1 < completed part key=_multipart_1IKNQXU3Y2JJ.2~VO5UY6OE7WXO.0 size=1048576 2024-06-04T15:59:30.010 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.010+0000 7f5e9aacc780 1 < completed part key=_multipart_1IKNQXU3Y2JJ.2~VO5UY6OE7WXO.1 size=1048576 2024-06-04T15:59:30.012 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.011+0000 7f5e9aacc780 1 < completed part key=_multipart_1IKNQXU3Y2JJ.2~VO5UY6OE7WXO.2 size=940981 2024-06-04T15:59:30.014 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.014+0000 7f5e9aacc780 1 < completed multipart upload key=1IKNQXU3Y2JJ upload=VO5UY6OE7WXO tag=DJWFM6XKOJBT type=write size=4086709 2024-06-04T15:59:30.016 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.016+0000 7f5e9aacc780 1 > prepared part key=_multipart_FBV2MAG130M6.2~WMHHBC0YT00Q.0 size=1048576 2024-06-04T15:59:30.017 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.017+0000 7f5e9aacc780 1 > prepared part key=_multipart_FBV2MAG130M6.2~WMHHBC0YT00Q.1 size=1048576 2024-06-04T15:59:30.019 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.018+0000 7f5e9aacc780 1 > prepared part key=_multipart_FBV2MAG130M6.2~WMHHBC0YT00Q.2 size=740080 2024-06-04T15:59:30.019 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.018+0000 7f5e9aacc780 1 > prepared multipart upload key=FBV2MAG130M6 upload=WMHHBC0YT00Q tag=4K4Z7O73J1QY type=write size=3885808 2024-06-04T15:59:30.020 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.020+0000 7f5e9aacc780 1 < completed part key=_multipart_Q4OFQI0F5YLG.2~1Q4LCEOFGVXZ.0 size=335658 2024-06-04T15:59:30.023 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.023+0000 7f5e9aacc780 1 < completed multipart upload key=Q4OFQI0F5YLG upload=1Q4LCEOFGVXZ tag=9ADQ67JN7NA9 type=write size=1384234 2024-06-04T15:59:30.025 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.024+0000 7f5e9aacc780 1 > prepared operation key=HD6SNICRCDLL tag=8VGTLQIDB4Q8 type=del size=3767251 2024-06-04T15:59:30.028 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.028+0000 7f5e9aacc780 1 < suggested remove operation key=GCPC9OJH7KWU tag=5FFCZCIK0G37 type=del 2024-06-04T15:59:30.029 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.029+0000 7f5e9aacc780 1 > prepared operation key=HD6SNICRCDLL tag=T9TZ30JJCZ7D type=write size=981526 2024-06-04T15:59:30.031 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.030+0000 7f5e9aacc780 1 < completed part key=_multipart_TUGKW7F4V9NO.2~2KMUXRBV0QW8.0 size=1048576 2024-06-04T15:59:30.032 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.031+0000 7f5e9aacc780 1 < completed part key=_multipart_TUGKW7F4V9NO.2~2KMUXRBV0QW8.1 size=1048576 2024-06-04T15:59:30.033 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.033+0000 7f5e9aacc780 1 < completed part key=_multipart_TUGKW7F4V9NO.2~2KMUXRBV0QW8.2 size=693594 2024-06-04T15:59:30.035 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.035+0000 7f5e9aacc780 1 < completed multipart upload key=TUGKW7F4V9NO upload=2KMUXRBV0QW8 tag=JBGQIBNPE53J type=write size=3839322 2024-06-04T15:59:30.038 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.037+0000 7f5e9aacc780 1 > prepared part key=_multipart_SUBHZJ7HUV3H.2~0X4R16MXTVQK.0 size=1048576 2024-06-04T15:59:30.039 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.039+0000 7f5e9aacc780 1 > prepared part key=_multipart_SUBHZJ7HUV3H.2~0X4R16MXTVQK.1 size=878490 2024-06-04T15:59:30.039 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.039+0000 7f5e9aacc780 1 > prepared multipart upload key=SUBHZJ7HUV3H upload=0X4R16MXTVQK tag=HTR4CMSY2OOB type=write size=2975642 2024-06-04T15:59:30.040 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.040+0000 7f5e9aacc780 1 < completed delete operation key=PCLJXQHJ4HTY tag=YC45RPOPG7I4 type=del 2024-06-04T15:59:30.043 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.043+0000 7f5e9aacc780 1 > prepared part key=_multipart_GTRMEQJK675Z.2~32HO51H8QU6X.0 size=1048576 2024-06-04T15:59:30.044 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.044+0000 7f5e9aacc780 1 > prepared part key=_multipart_GTRMEQJK675Z.2~32HO51H8QU6X.1 size=1048576 2024-06-04T15:59:30.045 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.045+0000 7f5e9aacc780 1 > prepared part key=_multipart_GTRMEQJK675Z.2~32HO51H8QU6X.2 size=399717 2024-06-04T15:59:30.045 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.045+0000 7f5e9aacc780 1 > prepared multipart upload key=GTRMEQJK675Z upload=32HO51H8QU6X tag=VFR5GF2MDFKU type=write size=3545445 2024-06-04T15:59:30.047 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.047+0000 7f5e9aacc780 1 < completed part key=_multipart_NJ5U8JTT32QK.2~R6TSBXCBNTAW.0 size=1048576 2024-06-04T15:59:30.048 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.048+0000 7f5e9aacc780 1 < completed part key=_multipart_NJ5U8JTT32QK.2~R6TSBXCBNTAW.1 size=37267 2024-06-04T15:59:30.050 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.050+0000 7f5e9aacc780 1 < completed multipart upload key=NJ5U8JTT32QK upload=R6TSBXCBNTAW tag=LIIL9ASVX0X5 type=write size=2134419 2024-06-04T15:59:30.053 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.052+0000 7f5e9aacc780 1 > prepared part key=_multipart_HD6SNICRCDLL.2~BC1O24BJOR78.0 size=347150 2024-06-04T15:59:30.053 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.052+0000 7f5e9aacc780 1 > prepared multipart upload key=HD6SNICRCDLL upload=BC1O24BJOR78 tag=5VQV7NURBKDS type=write size=1395726 2024-06-04T15:59:30.054 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.054+0000 7f5e9aacc780 1 < completed delete operation key=AOCB36Y5Q7B0 tag=DCK048ZF40JU type=del 2024-06-04T15:59:30.055 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.055+0000 7f5e9aacc780 1 > prepared operation key=W1T4O3EAE7JN tag=87QHCN683QL9 type=del size=225283 2024-06-04T15:59:30.057 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.057+0000 7f5e9aacc780 1 < completed part key=_multipart_9MPRI6LW3956.2~ZNTHYDHTH5E2.0 size=1048576 2024-06-04T15:59:30.058 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.058+0000 7f5e9aacc780 1 < completed part key=_multipart_9MPRI6LW3956.2~ZNTHYDHTH5E2.1 size=467718 2024-06-04T15:59:30.060 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.060+0000 7f5e9aacc780 1 < completed multipart upload key=9MPRI6LW3956 upload=ZNTHYDHTH5E2 tag=LDINLU5MQY0U type=write size=2564870 2024-06-04T15:59:30.063 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.063+0000 7f5e9aacc780 1 > prepared operation key=Q2V1ICTBSCV1 tag=OAYQC1I418ES type=del size=1129585 2024-06-04T15:59:30.065 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.064+0000 7f5e9aacc780 1 < completed part key=_multipart_2BT2AXKB1RTA.2~D7F8FTCSOXBT.0 size=1048576 2024-06-04T15:59:30.066 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.065+0000 7f5e9aacc780 1 < completed part key=_multipart_2BT2AXKB1RTA.2~D7F8FTCSOXBT.1 size=22732 2024-06-04T15:59:30.068 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.068+0000 7f5e9aacc780 1 < completed multipart upload key=2BT2AXKB1RTA upload=D7F8FTCSOXBT tag=QKD7DE04AUH1 type=write size=2119884 2024-06-04T15:59:30.069 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.069+0000 7f5e9aacc780 1 > prepared operation key=1IKNQXU3Y2JJ tag=7UZNRZO48HDD type=del size=1002229 2024-06-04T15:59:30.072 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.072+0000 7f5e9aacc780 1 < suggested update operation key=K01DAK0M4I4M tag=12QZTTGEAJ0U type=del size=2680739 2024-06-04T15:59:30.074 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.073+0000 7f5e9aacc780 1 > prepared operation key=4W5HB9WQQHR6 tag=UYEJ3P503VOC type=del size=418076 2024-06-04T15:59:30.075 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.075+0000 7f5e9aacc780 1 < completed delete operation key=HD6SNICRCDLL tag=Z8AG8CIDN6G0 type=del 2024-06-04T15:59:30.077 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.077+0000 7f5e9aacc780 1 > prepared operation key=9MPRI6LW3956 tag=MSNQ60GFDJRZ type=del size=1004381 2024-06-04T15:59:30.078 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.078+0000 7f5e9aacc780 1 < completed write operation key=UW5LVIBG09SV tag=6FBRWV2Y78AB type=write size=722767 2024-06-04T15:59:30.080 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.079+0000 7f5e9aacc780 1 > prepared operation key=2BT2AXKB1RTA tag=PB5KQPT0IGYA type=del size=1535235 2024-06-04T15:59:30.081 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.081+0000 7f5e9aacc780 1 < completed delete operation key=W1T4O3EAE7JN tag=K98E391FZRLJ type=del 2024-06-04T15:59:30.083 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.083+0000 7f5e9aacc780 1 > prepared operation key=Q2V1ICTBSCV1 tag=F3VXEU2I02IZ type=del size=2242407 2024-06-04T15:59:30.084 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.084+0000 7f5e9aacc780 1 < completed delete operation key=SUBHZJ7HUV3H tag=A06Y73IIWSRJ type=del 2024-06-04T15:59:30.087 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.086+0000 7f5e9aacc780 1 > prepared part key=_multipart_PNDPO2WUW7UX.2~Z6B2GD300FTR.0 size=1048576 2024-06-04T15:59:30.088 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.087+0000 7f5e9aacc780 1 > prepared part key=_multipart_PNDPO2WUW7UX.2~Z6B2GD300FTR.1 size=700546 2024-06-04T15:59:30.088 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.087+0000 7f5e9aacc780 1 > prepared multipart upload key=PNDPO2WUW7UX upload=Z6B2GD300FTR tag=9507F55U35FP type=write size=2797698 2024-06-04T15:59:30.089 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.089+0000 7f5e9aacc780 1 < completed write operation key=Q2V1ICTBSCV1 tag=VA62EEJ9F5KR type=write size=479984 2024-06-04T15:59:30.090 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.090+0000 7f5e9aacc780 1 > prepared operation key=A8O0S3S45RGM tag=E4CHCB1281KQ type=del size=1054321 2024-06-04T15:59:30.092 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.092+0000 7f5e9aacc780 1 < completed part key=_multipart_Q2V1ICTBSCV1.2~UFNN2BAENZHJ.0 size=1048576 2024-06-04T15:59:30.093 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.093+0000 7f5e9aacc780 1 < completed part key=_multipart_Q2V1ICTBSCV1.2~UFNN2BAENZHJ.1 size=1048576 2024-06-04T15:59:30.094 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.094+0000 7f5e9aacc780 1 < completed part key=_multipart_Q2V1ICTBSCV1.2~UFNN2BAENZHJ.2 size=446881 2024-06-04T15:59:30.097 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.096+0000 7f5e9aacc780 1 < completed multipart upload key=Q2V1ICTBSCV1 upload=UFNN2BAENZHJ tag=8780SIAYL9U0 type=write size=3592609 2024-06-04T15:59:30.098 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.098+0000 7f5e9aacc780 1 > prepared operation key=1IKNQXU3Y2JJ tag=Y5JOZZM7L676 type=del size=2083733 2024-06-04T15:59:30.099 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.099+0000 7f5e9aacc780 1 < completed part key=_multipart_FBV2MAG130M6.2~WMHHBC0YT00Q.0 size=1048576 2024-06-04T15:59:30.100 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.100+0000 7f5e9aacc780 1 < completed part key=_multipart_FBV2MAG130M6.2~WMHHBC0YT00Q.1 size=1048576 2024-06-04T15:59:30.102 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.101+0000 7f5e9aacc780 1 < completed part key=_multipart_FBV2MAG130M6.2~WMHHBC0YT00Q.2 size=740080 2024-06-04T15:59:30.104 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.104+0000 7f5e9aacc780 1 < completed multipart upload key=FBV2MAG130M6 upload=WMHHBC0YT00Q tag=4K4Z7O73J1QY type=write size=3885808 2024-06-04T15:59:30.105 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.105+0000 7f5e9aacc780 1 > prepared operation key=NJ5U8JTT32QK tag=5ZO4W04GXA2F type=del size=148521 2024-06-04T15:59:30.107 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.107+0000 7f5e9aacc780 1 < completed delete operation key=HD6SNICRCDLL tag=8VGTLQIDB4Q8 type=del 2024-06-04T15:59:30.108 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.108+0000 7f5e9aacc780 1 > prepared operation key=DY9JWHWNAUO1 tag=U1QIUW2MO7WX type=del size=4074791 2024-06-04T15:59:30.111 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.111+0000 7f5e9aacc780 1 < suggested remove operation key=HD6SNICRCDLL tag=T9TZ30JJCZ7D type=write 2024-06-04T15:59:30.113 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.112+0000 7f5e9aacc780 1 > prepared operation key=9MPRI6LW3956 tag=R7BTNU77SYTA type=del size=1747080 2024-06-04T15:59:30.113 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.113+0000 7f5e9aacc780 1 < canceled part key=_multipart_SUBHZJ7HUV3H.2~0X4R16MXTVQK.0 size=1048576 2024-06-04T15:59:30.114 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.114+0000 7f5e9aacc780 1 < completed part key=_multipart_SUBHZJ7HUV3H.2~0X4R16MXTVQK.1 size=878490 2024-06-04T15:59:30.116 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.116+0000 7f5e9aacc780 1 < canceled multipart upload key=SUBHZJ7HUV3H upload=0X4R16MXTVQK tag=HTR4CMSY2OOB type=write size=2975642 2024-06-04T15:59:30.118 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.117+0000 7f5e9aacc780 1 > prepared operation key=PNDPO2WUW7UX tag=XD079OT4447A type=del size=551446 2024-06-04T15:59:30.119 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.119+0000 7f5e9aacc780 1 < completed part key=_multipart_GTRMEQJK675Z.2~32HO51H8QU6X.0 size=1048576 2024-06-04T15:59:30.120 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.120+0000 7f5e9aacc780 1 < completed part key=_multipart_GTRMEQJK675Z.2~32HO51H8QU6X.1 size=1048576 2024-06-04T15:59:30.121 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.121+0000 7f5e9aacc780 1 < completed part key=_multipart_GTRMEQJK675Z.2~32HO51H8QU6X.2 size=399717 2024-06-04T15:59:30.123 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.123+0000 7f5e9aacc780 1 < completed multipart upload key=GTRMEQJK675Z upload=32HO51H8QU6X tag=VFR5GF2MDFKU type=write size=3545445 2024-06-04T15:59:30.125 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.125+0000 7f5e9aacc780 1 > prepared operation key=PCLJXQHJ4HTY tag=02KWZ2D7RISM type=del size=2260874 2024-06-04T15:59:30.126 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.126+0000 7f5e9aacc780 1 < completed part key=_multipart_HD6SNICRCDLL.2~BC1O24BJOR78.0 size=347150 2024-06-04T15:59:30.129 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.129+0000 7f5e9aacc780 1 < completed multipart upload key=HD6SNICRCDLL upload=BC1O24BJOR78 tag=5VQV7NURBKDS type=write size=1395726 2024-06-04T15:59:30.130 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.130+0000 7f5e9aacc780 1 > prepared operation key=XH0N984YVGKP tag=2FOY03T9RV3J type=write size=400084 2024-06-04T15:59:30.132 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.132+0000 7f5e9aacc780 1 < canceled operation key=W1T4O3EAE7JN tag=87QHCN683QL9 type=del size=225283 2024-06-04T15:59:30.133 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.133+0000 7f5e9aacc780 1 > prepared operation key=FBV2MAG130M6 tag=7GI85PI4EOSX type=del size=1716667 2024-06-04T15:59:30.135 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.134+0000 7f5e9aacc780 1 < completed delete operation key=Q2V1ICTBSCV1 tag=OAYQC1I418ES type=del 2024-06-04T15:59:30.137 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.137+0000 7f5e9aacc780 1 > prepared part key=_multipart_B0HK5FJ2RGJE.2~U5KFBSCYKVC2.0 size=185136 2024-06-04T15:59:30.138 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.137+0000 7f5e9aacc780 1 > prepared multipart upload key=B0HK5FJ2RGJE upload=U5KFBSCYKVC2 tag=AITHA4F5T7IB type=write size=1233712 2024-06-04T15:59:30.139 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.139+0000 7f5e9aacc780 1 < completed delete operation key=1IKNQXU3Y2JJ tag=7UZNRZO48HDD type=del 2024-06-04T15:59:30.142 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.141+0000 7f5e9aacc780 1 > prepared part key=_multipart_AOCB36Y5Q7B0.2~3615S69ZUD4F.0 size=1014625 2024-06-04T15:59:30.142 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.141+0000 7f5e9aacc780 1 > prepared multipart upload key=AOCB36Y5Q7B0 upload=3615S69ZUD4F tag=4JLD0Q5SSW3A type=write size=2063201 2024-06-04T15:59:30.143 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.143+0000 7f5e9aacc780 1 < completed delete operation key=4W5HB9WQQHR6 tag=UYEJ3P503VOC type=del 2024-06-04T15:59:30.144 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.144+0000 7f5e9aacc780 1 > prepared operation key=NJ5U8JTT32QK tag=B672AL4BOBBJ type=del size=2759211 2024-06-04T15:59:30.146 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.146+0000 7f5e9aacc780 1 < completed delete operation key=9MPRI6LW3956 tag=MSNQ60GFDJRZ type=del 2024-06-04T15:59:30.148 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.148+0000 7f5e9aacc780 1 > prepared part key=_multipart_W1T4O3EAE7JN.2~S6FSRPDOC6MJ.0 size=542712 2024-06-04T15:59:30.149 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.148+0000 7f5e9aacc780 1 > prepared multipart upload key=W1T4O3EAE7JN upload=S6FSRPDOC6MJ tag=3MY1Z58YTOWT type=write size=1591288 2024-06-04T15:59:30.150 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.150+0000 7f5e9aacc780 1 < completed delete operation key=2BT2AXKB1RTA tag=PB5KQPT0IGYA type=del 2024-06-04T15:59:30.151 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.151+0000 7f5e9aacc780 1 > prepared operation key=4W5HB9WQQHR6 tag=I845AI7OKONZ type=del size=1259992 2024-06-04T15:59:30.153 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.153+0000 7f5e9aacc780 1 < canceled operation key=Q2V1ICTBSCV1 tag=F3VXEU2I02IZ type=del size=2242407 2024-06-04T15:59:30.155 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.155+0000 7f5e9aacc780 1 > prepared part key=_multipart_W1T4O3EAE7JN.2~4JDWZZJWT17F.0 size=1048576 2024-06-04T15:59:30.156 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.156+0000 7f5e9aacc780 1 > prepared part key=_multipart_W1T4O3EAE7JN.2~4JDWZZJWT17F.1 size=1048576 2024-06-04T15:59:30.157 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.157+0000 7f5e9aacc780 1 > prepared part key=_multipart_W1T4O3EAE7JN.2~4JDWZZJWT17F.2 size=744698 2024-06-04T15:59:30.158 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.157+0000 7f5e9aacc780 1 > prepared multipart upload key=W1T4O3EAE7JN upload=4JDWZZJWT17F tag=ODXMFFMK2PXY type=write size=3890426 2024-06-04T15:59:30.159 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.159+0000 7f5e9aacc780 1 < completed part key=_multipart_PNDPO2WUW7UX.2~Z6B2GD300FTR.0 size=1048576 2024-06-04T15:59:30.160 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.160+0000 7f5e9aacc780 1 < completed part key=_multipart_PNDPO2WUW7UX.2~Z6B2GD300FTR.1 size=700546 2024-06-04T15:59:30.162 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.162+0000 7f5e9aacc780 1 < completed multipart upload key=PNDPO2WUW7UX upload=Z6B2GD300FTR tag=9507F55U35FP type=write size=2797698 2024-06-04T15:59:30.164 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.163+0000 7f5e9aacc780 1 > prepared operation key=03ZNYG3WLMP4 tag=UWC5B9P93IBU type=del size=516405 2024-06-04T15:59:30.166 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.166+0000 7f5e9aacc780 1 < suggested remove operation key=A8O0S3S45RGM tag=E4CHCB1281KQ type=del 2024-06-04T15:59:30.168 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.168+0000 7f5e9aacc780 1 > prepared operation key=7S9S3MIG7WIT tag=JVFJ22ZZPDVF type=del size=2848403 2024-06-04T15:59:30.169 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.169+0000 7f5e9aacc780 1 < completed delete operation key=1IKNQXU3Y2JJ tag=Y5JOZZM7L676 type=del 2024-06-04T15:59:30.171 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.171+0000 7f5e9aacc780 1 > prepared operation key=NHPH4LYPP0LL tag=8G58F6J2BEX3 type=del size=1189575 2024-06-04T15:59:30.172 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.172+0000 7f5e9aacc780 1 < completed delete operation key=NJ5U8JTT32QK tag=5ZO4W04GXA2F type=del 2024-06-04T15:59:30.174 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.173+0000 7f5e9aacc780 1 > prepared operation key=Q2V1ICTBSCV1 tag=LX3W7AR5IULL type=write size=923422 2024-06-04T15:59:30.175 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.175+0000 7f5e9aacc780 1 < canceled operation key=DY9JWHWNAUO1 tag=U1QIUW2MO7WX type=del size=4074791 2024-06-04T15:59:30.179 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.179+0000 7f5e9aacc780 1 > prepared part key=_multipart_NHPH4LYPP0LL.2~FCNU1SVABD9H.0 size=534764 2024-06-04T15:59:30.179 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.179+0000 7f5e9aacc780 1 > prepared multipart upload key=NHPH4LYPP0LL upload=FCNU1SVABD9H tag=4Y2F2JRZZ2WR type=write size=1583340 2024-06-04T15:59:30.182 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.182+0000 7f5e9aacc780 1 < suggested remove operation key=9MPRI6LW3956 tag=R7BTNU77SYTA type=del 2024-06-04T15:59:30.183 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.183+0000 7f5e9aacc780 1 > prepared operation key=PASGIP872OVX tag=XUWYAXHFE1CD type=del size=3096094 2024-06-04T15:59:30.186 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.185+0000 7f5e9aacc780 1 < suggested update operation key=PNDPO2WUW7UX tag=XD079OT4447A type=del size=551446 2024-06-04T15:59:30.188 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.188+0000 7f5e9aacc780 1 > prepared part key=_multipart_JL69PUHT6NNT.2~NFBZUW86D8H1.0 size=661509 2024-06-04T15:59:30.188 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.188+0000 7f5e9aacc780 1 > prepared multipart upload key=JL69PUHT6NNT upload=NFBZUW86D8H1 tag=ZCOSOCZCCNKF type=write size=1710085 2024-06-04T15:59:30.190 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.189+0000 7f5e9aacc780 1 < canceled operation key=PCLJXQHJ4HTY tag=02KWZ2D7RISM type=del size=2260874 2024-06-04T15:59:30.191 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.190+0000 7f5e9aacc780 1 > prepared operation key=2BT2AXKB1RTA tag=COEEAI3Q5AC1 type=del size=3997676 2024-06-04T15:59:30.192 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.192+0000 7f5e9aacc780 1 < completed write operation key=XH0N984YVGKP tag=2FOY03T9RV3J type=write size=400084 2024-06-04T15:59:30.195 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.194+0000 7f5e9aacc780 1 > prepared part key=_multipart_1IKNQXU3Y2JJ.2~PK21BWZYG3HL.0 size=385991 2024-06-04T15:59:30.195 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.194+0000 7f5e9aacc780 1 > prepared multipart upload key=1IKNQXU3Y2JJ upload=PK21BWZYG3HL tag=AVIWACETICNN type=write size=1434567 2024-06-04T15:59:30.198 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.198+0000 7f5e9aacc780 1 < suggested remove operation key=FBV2MAG130M6 tag=7GI85PI4EOSX type=del 2024-06-04T15:59:30.200 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.200+0000 7f5e9aacc780 1 > prepared operation key=HD6SNICRCDLL tag=XT4EN0YKB63K type=del size=1385730 2024-06-04T15:59:30.202 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.201+0000 7f5e9aacc780 1 < completed part key=_multipart_B0HK5FJ2RGJE.2~U5KFBSCYKVC2.0 size=185136 2024-06-04T15:59:30.204 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.204+0000 7f5e9aacc780 1 < completed multipart upload key=B0HK5FJ2RGJE upload=U5KFBSCYKVC2 tag=AITHA4F5T7IB type=write size=1233712 2024-06-04T15:59:30.207 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.206+0000 7f5e9aacc780 1 > prepared part key=_multipart_PCLJXQHJ4HTY.2~H0YPIW4TCQUW.0 size=1048576 2024-06-04T15:59:30.208 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.207+0000 7f5e9aacc780 1 > prepared part key=_multipart_PCLJXQHJ4HTY.2~H0YPIW4TCQUW.1 size=1048576 2024-06-04T15:59:30.209 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.209+0000 7f5e9aacc780 1 > prepared part key=_multipart_PCLJXQHJ4HTY.2~H0YPIW4TCQUW.2 size=290225 2024-06-04T15:59:30.209 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.209+0000 7f5e9aacc780 1 > prepared multipart upload key=PCLJXQHJ4HTY upload=H0YPIW4TCQUW tag=00I1QH08Y5WK type=write size=3435953 2024-06-04T15:59:30.210 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.210+0000 7f5e9aacc780 1 < completed part key=_multipart_AOCB36Y5Q7B0.2~3615S69ZUD4F.0 size=1014625 2024-06-04T15:59:30.213 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.213+0000 7f5e9aacc780 1 < completed multipart upload key=AOCB36Y5Q7B0 upload=3615S69ZUD4F tag=4JLD0Q5SSW3A type=write size=2063201 2024-06-04T15:59:30.215 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.214+0000 7f5e9aacc780 1 > prepared operation key=7S9S3MIG7WIT tag=YD27TTC4AK11 type=del size=2204089 2024-06-04T15:59:30.216 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.217+0000 7f5e9aacc780 1 < completed delete operation key=NJ5U8JTT32QK tag=B672AL4BOBBJ type=del 2024-06-04T15:59:30.218 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.218+0000 7f5e9aacc780 1 > prepared operation key=2BT2AXKB1RTA tag=ZIDFPMEQOJGB type=del size=1324146 2024-06-04T15:59:30.219 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.219+0000 7f5e9aacc780 1 < completed part key=_multipart_W1T4O3EAE7JN.2~S6FSRPDOC6MJ.0 size=542712 2024-06-04T15:59:30.222 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.222+0000 7f5e9aacc780 1 < completed multipart upload key=W1T4O3EAE7JN upload=S6FSRPDOC6MJ tag=3MY1Z58YTOWT type=write size=1591288 2024-06-04T15:59:30.223 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.223+0000 7f5e9aacc780 1 > prepared operation key=JL69PUHT6NNT tag=CFTRDR0U9FCC type=write size=617328 2024-06-04T15:59:30.225 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.224+0000 7f5e9aacc780 1 < completed delete operation key=4W5HB9WQQHR6 tag=I845AI7OKONZ type=del 2024-06-04T15:59:30.230 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.227+0000 7f5e9aacc780 1 > prepared part key=_multipart_Q4OFQI0F5YLG.2~WFVSXYWYE50I.0 size=289599 2024-06-04T15:59:30.230 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.227+0000 7f5e9aacc780 1 > prepared multipart upload key=Q4OFQI0F5YLG upload=WFVSXYWYE50I tag=ZEX30RVPBXKP type=write size=1338175 2024-06-04T15:59:30.230 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.228+0000 7f5e9aacc780 1 < completed part key=_multipart_W1T4O3EAE7JN.2~4JDWZZJWT17F.0 size=1048576 2024-06-04T15:59:30.230 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.229+0000 7f5e9aacc780 1 < completed part key=_multipart_W1T4O3EAE7JN.2~4JDWZZJWT17F.1 size=1048576 2024-06-04T15:59:30.230 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.230+0000 7f5e9aacc780 1 < completed part key=_multipart_W1T4O3EAE7JN.2~4JDWZZJWT17F.2 size=744698 2024-06-04T15:59:30.233 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.233+0000 7f5e9aacc780 1 < completed multipart upload key=W1T4O3EAE7JN upload=4JDWZZJWT17F tag=ODXMFFMK2PXY type=write size=3890426 2024-06-04T15:59:30.235 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.235+0000 7f5e9aacc780 1 > prepared part key=_multipart_PCLJXQHJ4HTY.2~FLD4TFARLR08.0 size=1048576 2024-06-04T15:59:30.236 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.236+0000 7f5e9aacc780 1 > prepared part key=_multipart_PCLJXQHJ4HTY.2~FLD4TFARLR08.1 size=578235 2024-06-04T15:59:30.236 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.236+0000 7f5e9aacc780 1 > prepared multipart upload key=PCLJXQHJ4HTY upload=FLD4TFARLR08 tag=WJVKRWRTPKBJ type=write size=2675387 2024-06-04T15:59:30.238 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.237+0000 7f5e9aacc780 1 < completed delete operation key=03ZNYG3WLMP4 tag=UWC5B9P93IBU type=del 2024-06-04T15:59:30.239 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.239+0000 7f5e9aacc780 1 > prepared operation key=QUIVPH3OB6KN tag=SZPZDI89D4I2 type=del size=3175812 2024-06-04T15:59:30.240 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.240+0000 7f5e9aacc780 1 < completed delete operation key=7S9S3MIG7WIT tag=JVFJ22ZZPDVF type=del 2024-06-04T15:59:30.242 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.242+0000 7f5e9aacc780 1 > prepared operation key=7S9S3MIG7WIT tag=4Z006HUO23LE type=write size=534827 2024-06-04T15:59:30.244 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.243+0000 7f5e9aacc780 1 < completed delete operation key=NHPH4LYPP0LL tag=8G58F6J2BEX3 type=del 2024-06-04T15:59:30.245 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.245+0000 7f5e9aacc780 1 > prepared operation key=RP8K6QJUZAH1 tag=UHZPGRXPNPXD type=del size=3022980 2024-06-04T15:59:30.247 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.246+0000 7f5e9aacc780 1 < completed write operation key=Q2V1ICTBSCV1 tag=LX3W7AR5IULL type=write size=923422 2024-06-04T15:59:30.249 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.249+0000 7f5e9aacc780 1 > prepared part key=_multipart_A8O0S3S45RGM.2~RGM4ON1T9GSV.0 size=336537 2024-06-04T15:59:30.249 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.249+0000 7f5e9aacc780 1 > prepared multipart upload key=A8O0S3S45RGM upload=RGM4ON1T9GSV tag=W07AFTAZLAY8 type=write size=1385113 2024-06-04T15:59:30.251 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.251+0000 7f5e9aacc780 1 < completed part key=_multipart_NHPH4LYPP0LL.2~FCNU1SVABD9H.0 size=534764 2024-06-04T15:59:30.253 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.253+0000 7f5e9aacc780 1 < completed multipart upload key=NHPH4LYPP0LL upload=FCNU1SVABD9H tag=4Y2F2JRZZ2WR type=write size=1583340 2024-06-04T15:59:30.255 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.254+0000 7f5e9aacc780 1 > prepared operation key=TUGKW7F4V9NO tag=2WE0SADH2ON0 type=del size=4058288 2024-06-04T15:59:30.258 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.257+0000 7f5e9aacc780 1 < suggested remove operation key=PASGIP872OVX tag=XUWYAXHFE1CD type=del 2024-06-04T15:59:30.259 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.259+0000 7f5e9aacc780 1 > prepared operation key=PCLJXQHJ4HTY tag=FXFVL2KWB0KT type=del size=359893 2024-06-04T15:59:30.261 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.260+0000 7f5e9aacc780 1 < completed part key=_multipart_JL69PUHT6NNT.2~NFBZUW86D8H1.0 size=661509 2024-06-04T15:59:30.263 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.263+0000 7f5e9aacc780 1 < completed multipart upload key=JL69PUHT6NNT upload=NFBZUW86D8H1 tag=ZCOSOCZCCNKF type=write size=1710085 2024-06-04T15:59:30.264 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.264+0000 7f5e9aacc780 1 > prepared operation key=NHPH4LYPP0LL tag=31YT574R508U type=del size=2153019 2024-06-04T15:59:30.266 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.266+0000 7f5e9aacc780 1 < completed delete operation key=2BT2AXKB1RTA tag=COEEAI3Q5AC1 type=del 2024-06-04T15:59:30.267 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.267+0000 7f5e9aacc780 1 > prepared operation key=PASGIP872OVX tag=AIJ81H17JHSM type=del size=1402307 2024-06-04T15:59:30.269 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.269+0000 7f5e9aacc780 1 < completed part key=_multipart_1IKNQXU3Y2JJ.2~PK21BWZYG3HL.0 size=385991 2024-06-04T15:59:30.271 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.271+0000 7f5e9aacc780 1 < completed multipart upload key=1IKNQXU3Y2JJ upload=PK21BWZYG3HL tag=AVIWACETICNN type=write size=1434567 2024-06-04T15:59:30.273 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.273+0000 7f5e9aacc780 1 > prepared operation key=JL69PUHT6NNT tag=YS0GCMCL6DKL type=del size=293807 2024-06-04T15:59:30.274 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.274+0000 7f5e9aacc780 1 < canceled operation key=HD6SNICRCDLL tag=XT4EN0YKB63K type=del size=1385730 2024-06-04T15:59:30.277 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.277+0000 7f5e9aacc780 1 > prepared part key=_multipart_K01DAK0M4I4M.2~TJA7XYPWA4T0.0 size=1048576 2024-06-04T15:59:30.278 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.278+0000 7f5e9aacc780 1 > prepared part key=_multipart_K01DAK0M4I4M.2~TJA7XYPWA4T0.1 size=1048576 2024-06-04T15:59:30.279 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.279+0000 7f5e9aacc780 1 > prepared part key=_multipart_K01DAK0M4I4M.2~TJA7XYPWA4T0.2 size=870002 2024-06-04T15:59:30.279 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.279+0000 7f5e9aacc780 1 > prepared multipart upload key=K01DAK0M4I4M upload=TJA7XYPWA4T0 tag=5EZFVOY37GFS type=write size=4015730 2024-06-04T15:59:30.280 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.279+0000 7f5e9aacc780 1 < canceled part key=_multipart_PCLJXQHJ4HTY.2~H0YPIW4TCQUW.0 size=1048576 2024-06-04T15:59:30.281 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.280+0000 7f5e9aacc780 1 < completed part key=_multipart_PCLJXQHJ4HTY.2~H0YPIW4TCQUW.1 size=1048576 2024-06-04T15:59:30.282 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.282+0000 7f5e9aacc780 1 < completed part key=_multipart_PCLJXQHJ4HTY.2~H0YPIW4TCQUW.2 size=290225 2024-06-04T15:59:30.284 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.284+0000 7f5e9aacc780 1 < canceled multipart upload key=PCLJXQHJ4HTY upload=H0YPIW4TCQUW tag=00I1QH08Y5WK type=write size=3435953 2024-06-04T15:59:30.287 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.287+0000 7f5e9aacc780 1 > prepared part key=_multipart_A8O0S3S45RGM.2~ODCSBBBHK41A.0 size=414733 2024-06-04T15:59:30.287 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.287+0000 7f5e9aacc780 1 > prepared multipart upload key=A8O0S3S45RGM upload=ODCSBBBHK41A tag=CIMI3EXU6OWN type=write size=1463309 2024-06-04T15:59:30.290 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.289+0000 7f5e9aacc780 1 < suggested update operation key=7S9S3MIG7WIT tag=YD27TTC4AK11 type=del size=2204089 2024-06-04T15:59:30.291 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.291+0000 7f5e9aacc780 1 > prepared operation key=Q4OFQI0F5YLG tag=ZI5N00F24Z18 type=write size=21179 2024-06-04T15:59:30.293 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.292+0000 7f5e9aacc780 1 < completed delete operation key=2BT2AXKB1RTA tag=ZIDFPMEQOJGB type=del 2024-06-04T15:59:30.295 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.295+0000 7f5e9aacc780 1 > prepared part key=_multipart_UW5LVIBG09SV.2~H9LC011KD6AL.0 size=1048576 2024-06-04T15:59:30.296 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.296+0000 7f5e9aacc780 1 > prepared part key=_multipart_UW5LVIBG09SV.2~H9LC011KD6AL.1 size=1048576 2024-06-04T15:59:30.298 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.297+0000 7f5e9aacc780 1 > prepared part key=_multipart_UW5LVIBG09SV.2~H9LC011KD6AL.2 size=165992 2024-06-04T15:59:30.298 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.297+0000 7f5e9aacc780 1 > prepared multipart upload key=UW5LVIBG09SV upload=H9LC011KD6AL tag=I9VCO3QBMHFG type=write size=3311720 2024-06-04T15:59:30.299 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.299+0000 7f5e9aacc780 1 < completed write operation key=JL69PUHT6NNT tag=CFTRDR0U9FCC type=write size=617328 2024-06-04T15:59:30.300 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.300+0000 7f5e9aacc780 1 > prepared operation key=4W5HB9WQQHR6 tag=WIA3X9XD1YL5 type=del size=79711 2024-06-04T15:59:30.302 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.301+0000 7f5e9aacc780 1 < completed part key=_multipart_Q4OFQI0F5YLG.2~WFVSXYWYE50I.0 size=289599 2024-06-04T15:59:30.304 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.304+0000 7f5e9aacc780 1 < completed multipart upload key=Q4OFQI0F5YLG upload=WFVSXYWYE50I tag=ZEX30RVPBXKP type=write size=1338175 2024-06-04T15:59:30.306 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.306+0000 7f5e9aacc780 1 > prepared part key=_multipart_JL69PUHT6NNT.2~3MQ4H6HQNMQ6.0 size=1048576 2024-06-04T15:59:30.307 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.307+0000 7f5e9aacc780 1 > prepared part key=_multipart_JL69PUHT6NNT.2~3MQ4H6HQNMQ6.1 size=525575 2024-06-04T15:59:30.307 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.307+0000 7f5e9aacc780 1 > prepared multipart upload key=JL69PUHT6NNT upload=3MQ4H6HQNMQ6 tag=6FCC2Z73XYDY type=write size=2622727 2024-06-04T15:59:30.308 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.307+0000 7f5e9aacc780 1 < canceled part key=_multipart_PCLJXQHJ4HTY.2~FLD4TFARLR08.0 size=1048576 2024-06-04T15:59:30.309 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.309+0000 7f5e9aacc780 1 < completed part key=_multipart_PCLJXQHJ4HTY.2~FLD4TFARLR08.1 size=578235 2024-06-04T15:59:30.311 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.311+0000 7f5e9aacc780 1 < canceled multipart upload key=PCLJXQHJ4HTY upload=FLD4TFARLR08 tag=WJVKRWRTPKBJ type=write size=2675387 2024-06-04T15:59:30.313 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.313+0000 7f5e9aacc780 1 > prepared operation key=W1T4O3EAE7JN tag=17WEX25A8H71 type=del size=976234 2024-06-04T15:59:30.316 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.316+0000 7f5e9aacc780 1 < suggested remove operation key=QUIVPH3OB6KN tag=SZPZDI89D4I2 type=del 2024-06-04T15:59:30.318 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.318+0000 7f5e9aacc780 1 > prepared operation key=B0HK5FJ2RGJE tag=9S5CQQRD6TXW type=del size=3560599 2024-06-04T15:59:30.320 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.319+0000 7f5e9aacc780 -1 < failed to complete operation key=7S9S3MIG7WIT tag=4Z006HUO23LE type=write size=534827: (22) Invalid argument 2024-06-04T15:59:30.321 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.321+0000 7f5e9aacc780 1 > prepared operation key=GCPC9OJH7KWU tag=SAVTL5YKK3C9 type=del size=54340 2024-06-04T15:59:30.323 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.322+0000 7f5e9aacc780 1 < completed delete operation key=RP8K6QJUZAH1 tag=UHZPGRXPNPXD type=del 2024-06-04T15:59:30.324 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.324+0000 7f5e9aacc780 1 > prepared operation key=A8O0S3S45RGM tag=OTL66OPJV7ZV type=del size=2453441 2024-06-04T15:59:30.326 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.325+0000 7f5e9aacc780 1 < completed part key=_multipart_A8O0S3S45RGM.2~RGM4ON1T9GSV.0 size=336537 2024-06-04T15:59:30.328 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.328+0000 7f5e9aacc780 1 < completed multipart upload key=A8O0S3S45RGM upload=RGM4ON1T9GSV tag=W07AFTAZLAY8 type=write size=1385113 2024-06-04T15:59:30.331 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.331+0000 7f5e9aacc780 1 > prepared part key=_multipart_QJA2JPATITNH.2~QLNOY3SJVN9V.0 size=1048576 2024-06-04T15:59:30.333 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.333+0000 7f5e9aacc780 1 > prepared part key=_multipart_QJA2JPATITNH.2~QLNOY3SJVN9V.1 size=1048576 2024-06-04T15:59:30.335 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.335+0000 7f5e9aacc780 1 > prepared part key=_multipart_QJA2JPATITNH.2~QLNOY3SJVN9V.2 size=141310 2024-06-04T15:59:30.335 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.335+0000 7f5e9aacc780 1 > prepared multipart upload key=QJA2JPATITNH upload=QLNOY3SJVN9V tag=49H3S564IM66 type=write size=3287038 2024-06-04T15:59:30.337 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.336+0000 7f5e9aacc780 1 < completed delete operation key=TUGKW7F4V9NO tag=2WE0SADH2ON0 type=del 2024-06-04T15:59:30.341 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.339+0000 7f5e9aacc780 1 > prepared part key=_multipart_UTZHANL9ER2Q.2~HWJ80RL2ZS7B.0 size=1048576 2024-06-04T15:59:30.341 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.340+0000 7f5e9aacc780 1 > prepared part key=_multipart_UTZHANL9ER2Q.2~HWJ80RL2ZS7B.1 size=1048576 2024-06-04T15:59:30.342 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.342+0000 7f5e9aacc780 1 > prepared part key=_multipart_UTZHANL9ER2Q.2~HWJ80RL2ZS7B.2 size=667441 2024-06-04T15:59:30.342 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.342+0000 7f5e9aacc780 1 > prepared multipart upload key=UTZHANL9ER2Q upload=HWJ80RL2ZS7B tag=JE3E796UYJ37 type=write size=3813169 2024-06-04T15:59:30.344 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.344+0000 7f5e9aacc780 1 < completed delete operation key=PCLJXQHJ4HTY tag=FXFVL2KWB0KT type=del 2024-06-04T15:59:30.346 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.345+0000 7f5e9aacc780 1 > prepared operation key=Q4OFQI0F5YLG tag=RPDQ6PVRYNZK type=del size=1661094 2024-06-04T15:59:30.349 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.349+0000 7f5e9aacc780 1 < suggested update operation key=NHPH4LYPP0LL tag=31YT574R508U type=del size=2153019 2024-06-04T15:59:30.352 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.352+0000 7f5e9aacc780 1 > prepared part key=_multipart_A8O0S3S45RGM.2~WOHK0WV8U7JW.0 size=866000 2024-06-04T15:59:30.352 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.352+0000 7f5e9aacc780 1 > prepared multipart upload key=A8O0S3S45RGM upload=WOHK0WV8U7JW tag=OPJMGO1SRMAU type=write size=1914576 2024-06-04T15:59:30.354 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.354+0000 7f5e9aacc780 1 < completed delete operation key=PASGIP872OVX tag=AIJ81H17JHSM type=del 2024-06-04T15:59:30.355 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.355+0000 7f5e9aacc780 1 > prepared operation key=K01DAK0M4I4M tag=N25MYMJY8WSJ type=del size=1471762 2024-06-04T15:59:30.357 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.357+0000 7f5e9aacc780 1 < completed delete operation key=JL69PUHT6NNT tag=YS0GCMCL6DKL type=del 2024-06-04T15:59:30.360 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.360+0000 7f5e9aacc780 1 > prepared part key=_multipart_UW5LVIBG09SV.2~2ZU7A0B9ZL08.0 size=1048576 2024-06-04T15:59:30.361 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.361+0000 7f5e9aacc780 1 > prepared part key=_multipart_UW5LVIBG09SV.2~2ZU7A0B9ZL08.1 size=1048576 2024-06-04T15:59:30.362 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.362+0000 7f5e9aacc780 1 > prepared part key=_multipart_UW5LVIBG09SV.2~2ZU7A0B9ZL08.2 size=846508 2024-06-04T15:59:30.362 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.362+0000 7f5e9aacc780 1 > prepared multipart upload key=UW5LVIBG09SV upload=2ZU7A0B9ZL08 tag=CTP5VKDPNF3G type=write size=3992236 2024-06-04T15:59:30.363 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.362+0000 7f5e9aacc780 1 < canceled part key=_multipart_K01DAK0M4I4M.2~TJA7XYPWA4T0.0 size=1048576 2024-06-04T15:59:30.364 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.363+0000 7f5e9aacc780 1 < completed part key=_multipart_K01DAK0M4I4M.2~TJA7XYPWA4T0.1 size=1048576 2024-06-04T15:59:30.365 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.365+0000 7f5e9aacc780 1 < completed part key=_multipart_K01DAK0M4I4M.2~TJA7XYPWA4T0.2 size=870002 2024-06-04T15:59:30.367 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.367+0000 7f5e9aacc780 1 < canceled multipart upload key=K01DAK0M4I4M upload=TJA7XYPWA4T0 tag=5EZFVOY37GFS type=write size=4015730 2024-06-04T15:59:30.370 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.370+0000 7f5e9aacc780 1 > prepared part key=_multipart_PNDPO2WUW7UX.2~E41QWGYL0IRS.0 size=1048576 2024-06-04T15:59:30.371 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.371+0000 7f5e9aacc780 1 > prepared part key=_multipart_PNDPO2WUW7UX.2~E41QWGYL0IRS.1 size=925578 2024-06-04T15:59:30.371 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.371+0000 7f5e9aacc780 1 > prepared multipart upload key=PNDPO2WUW7UX upload=E41QWGYL0IRS tag=5R36G45E7PPG type=write size=3022730 2024-06-04T15:59:30.373 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.372+0000 7f5e9aacc780 1 < completed part key=_multipart_A8O0S3S45RGM.2~ODCSBBBHK41A.0 size=414733 2024-06-04T15:59:30.375 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.375+0000 7f5e9aacc780 1 < completed multipart upload key=A8O0S3S45RGM upload=ODCSBBBHK41A tag=CIMI3EXU6OWN type=write size=1463309 2024-06-04T15:59:30.377 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.377+0000 7f5e9aacc780 1 > prepared operation key=9MPRI6LW3956 tag=NH7P518O8UMG type=del size=385648 2024-06-04T15:59:30.379 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.378+0000 7f5e9aacc780 1 < completed write operation key=Q4OFQI0F5YLG tag=ZI5N00F24Z18 type=write size=21179 2024-06-04T15:59:30.381 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.380+0000 7f5e9aacc780 1 > prepared operation key=9MPRI6LW3956 tag=KM2LHPB3AC6T type=del size=2352112 2024-06-04T15:59:30.382 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.382+0000 7f5e9aacc780 1 < completed part key=_multipart_UW5LVIBG09SV.2~H9LC011KD6AL.0 size=1048576 2024-06-04T15:59:30.383 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.383+0000 7f5e9aacc780 1 < completed part key=_multipart_UW5LVIBG09SV.2~H9LC011KD6AL.1 size=1048576 2024-06-04T15:59:30.385 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.384+0000 7f5e9aacc780 1 < completed part key=_multipart_UW5LVIBG09SV.2~H9LC011KD6AL.2 size=165992 2024-06-04T15:59:30.387 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.387+0000 7f5e9aacc780 1 < completed multipart upload key=UW5LVIBG09SV upload=H9LC011KD6AL tag=I9VCO3QBMHFG type=write size=3311720 2024-06-04T15:59:30.389 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.388+0000 7f5e9aacc780 1 > prepared operation key=QJA2JPATITNH tag=0RE5FBXA740E type=del size=2481769 2024-06-04T15:59:30.392 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.392+0000 7f5e9aacc780 1 < suggested remove operation key=4W5HB9WQQHR6 tag=WIA3X9XD1YL5 type=del 2024-06-04T15:59:30.395 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.395+0000 7f5e9aacc780 1 > prepared part key=_multipart_NJ5U8JTT32QK.2~KNB8GLFJZW31.0 size=1048576 2024-06-04T15:59:30.396 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.396+0000 7f5e9aacc780 1 > prepared part key=_multipart_NJ5U8JTT32QK.2~KNB8GLFJZW31.1 size=332496 2024-06-04T15:59:30.396 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.396+0000 7f5e9aacc780 1 > prepared multipart upload key=NJ5U8JTT32QK upload=KNB8GLFJZW31 tag=3YOP9XMFMJ0A type=write size=2429648 2024-06-04T15:59:30.397 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.397+0000 7f5e9aacc780 1 < completed part key=_multipart_JL69PUHT6NNT.2~3MQ4H6HQNMQ6.0 size=1048576 2024-06-04T15:59:30.399 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.398+0000 7f5e9aacc780 1 < completed part key=_multipart_JL69PUHT6NNT.2~3MQ4H6HQNMQ6.1 size=525575 2024-06-04T15:59:30.401 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.401+0000 7f5e9aacc780 1 < completed multipart upload key=JL69PUHT6NNT upload=3MQ4H6HQNMQ6 tag=6FCC2Z73XYDY type=write size=2622727 2024-06-04T15:59:30.403 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.403+0000 7f5e9aacc780 1 > prepared operation key=Q4OFQI0F5YLG tag=Z4PYYONVGTSO type=del size=2064675 2024-06-04T15:59:30.406 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.406+0000 7f5e9aacc780 1 < suggested update operation key=W1T4O3EAE7JN tag=17WEX25A8H71 type=del size=976234 2024-06-04T15:59:30.408 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.407+0000 7f5e9aacc780 1 > prepared operation key=DY9JWHWNAUO1 tag=PCCMJNLJF7Y7 type=del size=48292 2024-06-04T15:59:30.411 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.411+0000 7f5e9aacc780 1 < suggested update operation key=B0HK5FJ2RGJE tag=9S5CQQRD6TXW type=del size=3560599 2024-06-04T15:59:30.414 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.413+0000 7f5e9aacc780 1 > prepared part key=_multipart_AOCB36Y5Q7B0.2~R282L7NNB1P8.0 size=1048576 2024-06-04T15:59:30.414 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.414+0000 7f5e9aacc780 1 > prepared part key=_multipart_AOCB36Y5Q7B0.2~R282L7NNB1P8.1 size=1048576 2024-06-04T15:59:30.416 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.416+0000 7f5e9aacc780 1 > prepared part key=_multipart_AOCB36Y5Q7B0.2~R282L7NNB1P8.2 size=728658 2024-06-04T15:59:30.416 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.416+0000 7f5e9aacc780 1 > prepared multipart upload key=AOCB36Y5Q7B0 upload=R282L7NNB1P8 tag=DO62LL3AOCTO type=write size=3874386 2024-06-04T15:59:30.417 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.417+0000 7f5e9aacc780 1 < completed delete operation key=GCPC9OJH7KWU tag=SAVTL5YKK3C9 type=del 2024-06-04T15:59:30.419 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.419+0000 7f5e9aacc780 1 > prepared operation key=NHPH4LYPP0LL tag=P1WBJY40L2IS type=del size=1213737 2024-06-04T15:59:30.420 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.420+0000 7f5e9aacc780 1 < canceled operation key=A8O0S3S45RGM tag=OTL66OPJV7ZV type=del size=2453441 2024-06-04T15:59:30.423 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.423+0000 7f5e9aacc780 1 > prepared part key=_multipart_PCLJXQHJ4HTY.2~2L6GWYWMRSHN.0 size=1048576 2024-06-04T15:59:30.424 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.424+0000 7f5e9aacc780 1 > prepared part key=_multipart_PCLJXQHJ4HTY.2~2L6GWYWMRSHN.1 size=1048576 2024-06-04T15:59:30.425 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.425+0000 7f5e9aacc780 1 > prepared part key=_multipart_PCLJXQHJ4HTY.2~2L6GWYWMRSHN.2 size=171226 2024-06-04T15:59:30.425 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.425+0000 7f5e9aacc780 1 > prepared multipart upload key=PCLJXQHJ4HTY upload=2L6GWYWMRSHN tag=D3HJRU6B68LS type=write size=3316954 2024-06-04T15:59:30.427 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.426+0000 7f5e9aacc780 1 < completed part key=_multipart_QJA2JPATITNH.2~QLNOY3SJVN9V.0 size=1048576 2024-06-04T15:59:30.427 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.426+0000 7f5e9aacc780 1 < canceled part key=_multipart_QJA2JPATITNH.2~QLNOY3SJVN9V.1 size=1048576 2024-06-04T15:59:30.428 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.427+0000 7f5e9aacc780 1 < completed part key=_multipart_QJA2JPATITNH.2~QLNOY3SJVN9V.2 size=141310 2024-06-04T15:59:30.430 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.430+0000 7f5e9aacc780 1 < canceled multipart upload key=QJA2JPATITNH upload=QLNOY3SJVN9V tag=49H3S564IM66 type=write size=3287038 2024-06-04T15:59:30.433 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.433+0000 7f5e9aacc780 1 > prepared part key=_multipart_PCLJXQHJ4HTY.2~W6LDM0R6JGSS.0 size=1048576 2024-06-04T15:59:30.434 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.434+0000 7f5e9aacc780 1 > prepared part key=_multipart_PCLJXQHJ4HTY.2~W6LDM0R6JGSS.1 size=1048576 2024-06-04T15:59:30.435 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.435+0000 7f5e9aacc780 1 > prepared part key=_multipart_PCLJXQHJ4HTY.2~W6LDM0R6JGSS.2 size=776399 2024-06-04T15:59:30.435 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.435+0000 7f5e9aacc780 1 > prepared multipart upload key=PCLJXQHJ4HTY upload=W6LDM0R6JGSS tag=S4PFK8P2TSH6 type=write size=3922127 2024-06-04T15:59:30.437 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.436+0000 7f5e9aacc780 1 < completed part key=_multipart_UTZHANL9ER2Q.2~HWJ80RL2ZS7B.0 size=1048576 2024-06-04T15:59:30.437 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.436+0000 7f5e9aacc780 1 < canceled part key=_multipart_UTZHANL9ER2Q.2~HWJ80RL2ZS7B.1 size=1048576 2024-06-04T15:59:30.438 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.438+0000 7f5e9aacc780 1 < completed part key=_multipart_UTZHANL9ER2Q.2~HWJ80RL2ZS7B.2 size=667441 2024-06-04T15:59:30.440 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.440+0000 7f5e9aacc780 1 < canceled multipart upload key=UTZHANL9ER2Q upload=HWJ80RL2ZS7B tag=JE3E796UYJ37 type=write size=3813169 2024-06-04T15:59:30.441 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.441+0000 7f5e9aacc780 1 > prepared operation key=JL69PUHT6NNT tag=GWIXP2OCLDA1 type=del size=1086825 2024-06-04T15:59:30.443 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.443+0000 7f5e9aacc780 1 < completed delete operation key=Q4OFQI0F5YLG tag=RPDQ6PVRYNZK type=del 2024-06-04T15:59:30.446 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.446+0000 7f5e9aacc780 1 > prepared part key=_multipart_TUGKW7F4V9NO.2~WZ6N98FQS56U.0 size=1048576 2024-06-04T15:59:30.447 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.447+0000 7f5e9aacc780 1 > prepared part key=_multipart_TUGKW7F4V9NO.2~WZ6N98FQS56U.1 size=327012 2024-06-04T15:59:30.447 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.447+0000 7f5e9aacc780 1 > prepared multipart upload key=TUGKW7F4V9NO upload=WZ6N98FQS56U tag=B735MW1ZQS78 type=write size=2424164 2024-06-04T15:59:30.449 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.449+0000 7f5e9aacc780 1 < completed part key=_multipart_A8O0S3S45RGM.2~WOHK0WV8U7JW.0 size=866000 2024-06-04T15:59:30.452 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.452+0000 7f5e9aacc780 1 < completed multipart upload key=A8O0S3S45RGM upload=WOHK0WV8U7JW tag=OPJMGO1SRMAU type=write size=1914576 2024-06-04T15:59:30.453 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.453+0000 7f5e9aacc780 1 > prepared operation key=PCLJXQHJ4HTY tag=XND9MP1EKBM6 type=del size=1874200 2024-06-04T15:59:30.455 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.455+0000 7f5e9aacc780 1 < completed delete operation key=K01DAK0M4I4M tag=N25MYMJY8WSJ type=del 2024-06-04T15:59:30.457 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.456+0000 7f5e9aacc780 1 > prepared operation key=QUIVPH3OB6KN tag=MIM9YS1RQEVR type=del size=571069 2024-06-04T15:59:30.458 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.458+0000 7f5e9aacc780 1 < completed part key=_multipart_UW5LVIBG09SV.2~2ZU7A0B9ZL08.0 size=1048576 2024-06-04T15:59:30.459 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.459+0000 7f5e9aacc780 1 < completed part key=_multipart_UW5LVIBG09SV.2~2ZU7A0B9ZL08.1 size=1048576 2024-06-04T15:59:30.460 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.460+0000 7f5e9aacc780 1 < completed part key=_multipart_UW5LVIBG09SV.2~2ZU7A0B9ZL08.2 size=846508 2024-06-04T15:59:30.463 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.462+0000 7f5e9aacc780 1 < completed multipart upload key=UW5LVIBG09SV upload=2ZU7A0B9ZL08 tag=CTP5VKDPNF3G type=write size=3992236 2024-06-04T15:59:30.464 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.464+0000 7f5e9aacc780 1 > prepared operation key=QUIVPH3OB6KN tag=9K0PMVWW52NE type=del size=3715224 2024-06-04T15:59:30.466 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.466+0000 7f5e9aacc780 1 < completed part key=_multipart_PNDPO2WUW7UX.2~E41QWGYL0IRS.0 size=1048576 2024-06-04T15:59:30.467 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.467+0000 7f5e9aacc780 1 < completed part key=_multipart_PNDPO2WUW7UX.2~E41QWGYL0IRS.1 size=925578 2024-06-04T15:59:30.470 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.469+0000 7f5e9aacc780 1 < completed multipart upload key=PNDPO2WUW7UX upload=E41QWGYL0IRS tag=5R36G45E7PPG type=write size=3022730 2024-06-04T15:59:30.471 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.472+0000 7f5e9aacc780 1 > prepared operation key=XH0N984YVGKP tag=H077Z6O9M8TU type=del size=3716906 2024-06-04T15:59:30.473 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.473+0000 7f5e9aacc780 1 < completed delete operation key=9MPRI6LW3956 tag=NH7P518O8UMG type=del 2024-06-04T15:59:30.478 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.477+0000 7f5e9aacc780 1 > prepared part key=_multipart_A8O0S3S45RGM.2~RGWMGD3HU1KV.0 size=1048576 2024-06-04T15:59:30.479 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.479+0000 7f5e9aacc780 1 > prepared part key=_multipart_A8O0S3S45RGM.2~RGWMGD3HU1KV.1 size=1048576 2024-06-04T15:59:30.480 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.480+0000 7f5e9aacc780 1 > prepared part key=_multipart_A8O0S3S45RGM.2~RGWMGD3HU1KV.2 size=797454 2024-06-04T15:59:30.480 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.480+0000 7f5e9aacc780 1 > prepared multipart upload key=A8O0S3S45RGM upload=RGWMGD3HU1KV tag=I9Q8H5WCRK9H type=write size=3943182 2024-06-04T15:59:30.482 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.481+0000 7f5e9aacc780 1 < completed delete operation key=9MPRI6LW3956 tag=KM2LHPB3AC6T type=del 2024-06-04T15:59:30.483 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.483+0000 7f5e9aacc780 1 > prepared operation key=XH0N984YVGKP tag=4DG5Q29TAMV2 type=del size=816071 2024-06-04T15:59:30.485 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.485+0000 7f5e9aacc780 1 < completed delete operation key=QJA2JPATITNH tag=0RE5FBXA740E type=del 2024-06-04T15:59:30.486 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.486+0000 7f5e9aacc780 1 > prepared operation key=2BT2AXKB1RTA tag=FA3TK6QFGHOT type=del size=3259660 2024-06-04T15:59:30.488 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.488+0000 7f5e9aacc780 1 < completed part key=_multipart_NJ5U8JTT32QK.2~KNB8GLFJZW31.0 size=1048576 2024-06-04T15:59:30.489 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.489+0000 7f5e9aacc780 1 < completed part key=_multipart_NJ5U8JTT32QK.2~KNB8GLFJZW31.1 size=332496 2024-06-04T15:59:30.492 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.491+0000 7f5e9aacc780 1 < completed multipart upload key=NJ5U8JTT32QK upload=KNB8GLFJZW31 tag=3YOP9XMFMJ0A type=write size=2429648 2024-06-04T15:59:30.493 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.493+0000 7f5e9aacc780 1 > prepared operation key=RP8K6QJUZAH1 tag=D3MXZOITO9NJ type=del size=1156400 2024-06-04T15:59:30.494 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.494+0000 7f5e9aacc780 1 < completed delete operation key=Q4OFQI0F5YLG tag=Z4PYYONVGTSO type=del 2024-06-04T15:59:30.496 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.496+0000 7f5e9aacc780 1 > prepared operation key=2BT2AXKB1RTA tag=9V02IW7GF3LM type=del size=828602 2024-06-04T15:59:30.498 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.497+0000 7f5e9aacc780 1 < completed delete operation key=DY9JWHWNAUO1 tag=PCCMJNLJF7Y7 type=del 2024-06-04T15:59:30.500 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.500+0000 7f5e9aacc780 1 > prepared part key=_multipart_W1T4O3EAE7JN.2~6SDU130JZLVX.0 size=695017 2024-06-04T15:59:30.500 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.500+0000 7f5e9aacc780 1 > prepared multipart upload key=W1T4O3EAE7JN upload=6SDU130JZLVX tag=OFHK1VVH3CS8 type=write size=1743593 2024-06-04T15:59:30.501 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.502+0000 7f5e9aacc780 1 < completed part key=_multipart_AOCB36Y5Q7B0.2~R282L7NNB1P8.0 size=1048576 2024-06-04T15:59:30.503 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.502+0000 7f5e9aacc780 1 < completed part key=_multipart_AOCB36Y5Q7B0.2~R282L7NNB1P8.1 size=1048576 2024-06-04T15:59:30.504 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.504+0000 7f5e9aacc780 1 < completed part key=_multipart_AOCB36Y5Q7B0.2~R282L7NNB1P8.2 size=728658 2024-06-04T15:59:30.506 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.506+0000 7f5e9aacc780 1 < completed multipart upload key=AOCB36Y5Q7B0 upload=R282L7NNB1P8 tag=DO62LL3AOCTO type=write size=3874386 2024-06-04T15:59:30.508 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.507+0000 7f5e9aacc780 1 > prepared operation key=Q2V1ICTBSCV1 tag=K3P14AVI6XFU type=del size=478309 2024-06-04T15:59:30.509 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.509+0000 7f5e9aacc780 1 < completed delete operation key=NHPH4LYPP0LL tag=P1WBJY40L2IS type=del 2024-06-04T15:59:30.512 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.512+0000 7f5e9aacc780 1 > prepared part key=_multipart_B0HK5FJ2RGJE.2~HMVKWCPES5MP.0 size=1048576 2024-06-04T15:59:30.513 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.513+0000 7f5e9aacc780 1 > prepared part key=_multipart_B0HK5FJ2RGJE.2~HMVKWCPES5MP.1 size=1048576 2024-06-04T15:59:30.514 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.514+0000 7f5e9aacc780 1 > prepared part key=_multipart_B0HK5FJ2RGJE.2~HMVKWCPES5MP.2 size=1009735 2024-06-04T15:59:30.515 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.514+0000 7f5e9aacc780 1 > prepared multipart upload key=B0HK5FJ2RGJE upload=HMVKWCPES5MP tag=8XJ1RGWK8OEA type=write size=4155463 2024-06-04T15:59:30.516 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.515+0000 7f5e9aacc780 1 < completed part key=_multipart_PCLJXQHJ4HTY.2~2L6GWYWMRSHN.0 size=1048576 2024-06-04T15:59:30.517 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.517+0000 7f5e9aacc780 1 < completed part key=_multipart_PCLJXQHJ4HTY.2~2L6GWYWMRSHN.1 size=1048576 2024-06-04T15:59:30.517 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.517+0000 7f5e9aacc780 1 < canceled part key=_multipart_PCLJXQHJ4HTY.2~2L6GWYWMRSHN.2 size=171226 2024-06-04T15:59:30.519 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.519+0000 7f5e9aacc780 1 < canceled multipart upload key=PCLJXQHJ4HTY upload=2L6GWYWMRSHN tag=D3HJRU6B68LS type=write size=3316954 2024-06-04T15:59:30.522 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.521+0000 7f5e9aacc780 1 > prepared part key=_multipart_NHPH4LYPP0LL.2~VH76CCMV2MV9.0 size=210176 2024-06-04T15:59:30.522 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.521+0000 7f5e9aacc780 1 > prepared multipart upload key=NHPH4LYPP0LL upload=VH76CCMV2MV9 tag=RJACHE9L4JDO type=write size=1258752 2024-06-04T15:59:30.522 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.522+0000 7f5e9aacc780 1 < canceled part key=_multipart_PCLJXQHJ4HTY.2~W6LDM0R6JGSS.0 size=1048576 2024-06-04T15:59:30.523 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.523+0000 7f5e9aacc780 1 < completed part key=_multipart_PCLJXQHJ4HTY.2~W6LDM0R6JGSS.1 size=1048576 2024-06-04T15:59:30.524 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.524+0000 7f5e9aacc780 1 < completed part key=_multipart_PCLJXQHJ4HTY.2~W6LDM0R6JGSS.2 size=776399 2024-06-04T15:59:30.526 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.526+0000 7f5e9aacc780 1 < canceled multipart upload key=PCLJXQHJ4HTY upload=W6LDM0R6JGSS tag=S4PFK8P2TSH6 type=write size=3922127 2024-06-04T15:59:30.528 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.528+0000 7f5e9aacc780 1 > prepared operation key=NJ5U8JTT32QK tag=872ZF79ALMF9 type=del size=1226452 2024-06-04T15:59:30.529 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.529+0000 7f5e9aacc780 1 < completed delete operation key=JL69PUHT6NNT tag=GWIXP2OCLDA1 type=del 2024-06-04T15:59:30.532 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.532+0000 7f5e9aacc780 1 > prepared part key=_multipart_HD6SNICRCDLL.2~UYJA7K9FF2S2.0 size=333939 2024-06-04T15:59:30.532 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.532+0000 7f5e9aacc780 1 > prepared multipart upload key=HD6SNICRCDLL upload=UYJA7K9FF2S2 tag=FVEXK6A3UQN3 type=write size=1382515 2024-06-04T15:59:30.532 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.532+0000 7f5e9aacc780 1 < canceled part key=_multipart_TUGKW7F4V9NO.2~WZ6N98FQS56U.0 size=1048576 2024-06-04T15:59:30.533 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.533+0000 7f5e9aacc780 1 < completed part key=_multipart_TUGKW7F4V9NO.2~WZ6N98FQS56U.1 size=327012 2024-06-04T15:59:30.535 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.536+0000 7f5e9aacc780 1 < canceled multipart upload key=TUGKW7F4V9NO upload=WZ6N98FQS56U tag=B735MW1ZQS78 type=write size=2424164 2024-06-04T15:59:30.538 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.538+0000 7f5e9aacc780 1 > prepared part key=_multipart_UW5LVIBG09SV.2~GHCLY9RQ8S1C.0 size=1048576 2024-06-04T15:59:30.539 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.539+0000 7f5e9aacc780 1 > prepared part key=_multipart_UW5LVIBG09SV.2~GHCLY9RQ8S1C.1 size=1048576 2024-06-04T15:59:30.540 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.541+0000 7f5e9aacc780 1 > prepared part key=_multipart_UW5LVIBG09SV.2~GHCLY9RQ8S1C.2 size=790470 2024-06-04T15:59:30.541 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.541+0000 7f5e9aacc780 1 > prepared multipart upload key=UW5LVIBG09SV upload=GHCLY9RQ8S1C tag=RJV401M21QX0 type=write size=3936198 2024-06-04T15:59:30.542 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.542+0000 7f5e9aacc780 1 < completed delete operation key=PCLJXQHJ4HTY tag=XND9MP1EKBM6 type=del 2024-06-04T15:59:30.545 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.545+0000 7f5e9aacc780 1 > prepared part key=_multipart_QJA2JPATITNH.2~3VEBPYB8XEJO.0 size=885926 2024-06-04T15:59:30.545 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.545+0000 7f5e9aacc780 1 > prepared multipart upload key=QJA2JPATITNH upload=3VEBPYB8XEJO tag=NIKD3ST2FFMZ type=write size=1934502 2024-06-04T15:59:30.547 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.546+0000 7f5e9aacc780 1 < completed delete operation key=QUIVPH3OB6KN tag=MIM9YS1RQEVR type=del 2024-06-04T15:59:30.550 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.549+0000 7f5e9aacc780 1 > prepared part key=_multipart_FBV2MAG130M6.2~5EB161XQE63Y.0 size=1048576 2024-06-04T15:59:30.551 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.550+0000 7f5e9aacc780 1 > prepared part key=_multipart_FBV2MAG130M6.2~5EB161XQE63Y.1 size=755501 2024-06-04T15:59:30.551 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.550+0000 7f5e9aacc780 1 > prepared multipart upload key=FBV2MAG130M6 upload=5EB161XQE63Y tag=VVK2A7DVB80R type=write size=2852653 2024-06-04T15:59:30.552 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.552+0000 7f5e9aacc780 1 < completed delete operation key=QUIVPH3OB6KN tag=9K0PMVWW52NE type=del 2024-06-04T15:59:30.553 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.553+0000 7f5e9aacc780 1 > prepared operation key=03ZNYG3WLMP4 tag=TKKDA84SOQ4Y type=del size=384766 2024-06-04T15:59:30.555 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.555+0000 7f5e9aacc780 1 < completed delete operation key=XH0N984YVGKP tag=H077Z6O9M8TU type=del 2024-06-04T15:59:30.558 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.557+0000 7f5e9aacc780 1 > prepared part key=_multipart_PNDPO2WUW7UX.2~LUWNSFLGV70L.0 size=1048576 2024-06-04T15:59:30.559 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.558+0000 7f5e9aacc780 1 > prepared part key=_multipart_PNDPO2WUW7UX.2~LUWNSFLGV70L.1 size=323292 2024-06-04T15:59:30.559 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.558+0000 7f5e9aacc780 1 > prepared multipart upload key=PNDPO2WUW7UX upload=LUWNSFLGV70L tag=8HK32N4Q377T type=write size=2420444 2024-06-04T15:59:30.559 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.559+0000 7f5e9aacc780 1 < canceled part key=_multipart_A8O0S3S45RGM.2~RGWMGD3HU1KV.0 size=1048576 2024-06-04T15:59:30.559 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.559+0000 7f5e9aacc780 1 < canceled part key=_multipart_A8O0S3S45RGM.2~RGWMGD3HU1KV.1 size=1048576 2024-06-04T15:59:30.560 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.560+0000 7f5e9aacc780 1 < completed part key=_multipart_A8O0S3S45RGM.2~RGWMGD3HU1KV.2 size=797454 2024-06-04T15:59:30.563 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.562+0000 7f5e9aacc780 1 < canceled multipart upload key=A8O0S3S45RGM upload=RGWMGD3HU1KV tag=I9Q8H5WCRK9H type=write size=3943182 2024-06-04T15:59:30.565 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.564+0000 7f5e9aacc780 1 > prepared operation key=Q2V1ICTBSCV1 tag=KLKSGSGLKNCD type=del size=2112115 2024-06-04T15:59:30.566 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.566+0000 7f5e9aacc780 1 < completed delete operation key=XH0N984YVGKP tag=4DG5Q29TAMV2 type=del 2024-06-04T15:59:30.568 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.569+0000 7f5e9aacc780 1 > prepared part key=_multipart_2BT2AXKB1RTA.2~DIYUHVS326QX.0 size=875166 2024-06-04T15:59:30.569 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.569+0000 7f5e9aacc780 1 > prepared multipart upload key=2BT2AXKB1RTA upload=DIYUHVS326QX tag=JMLGLAM26XR2 type=write size=1923742 2024-06-04T15:59:30.570 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.570+0000 7f5e9aacc780 1 < completed delete operation key=2BT2AXKB1RTA tag=FA3TK6QFGHOT type=del 2024-06-04T15:59:30.571 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.571+0000 7f5e9aacc780 1 > prepared operation key=GTRMEQJK675Z tag=TSJR1301RPQT type=del size=865688 2024-06-04T15:59:30.574 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.574+0000 7f5e9aacc780 1 < suggested update operation key=RP8K6QJUZAH1 tag=D3MXZOITO9NJ type=del size=1156400 2024-06-04T15:59:30.575 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.575+0000 7f5e9aacc780 1 > prepared operation key=1IKNQXU3Y2JJ tag=KU9AIL3OGNNB type=del size=4058221 2024-06-04T15:59:30.577 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.576+0000 7f5e9aacc780 1 < completed delete operation key=2BT2AXKB1RTA tag=9V02IW7GF3LM type=del 2024-06-04T15:59:30.578 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.578+0000 7f5e9aacc780 1 > prepared operation key=AOCB36Y5Q7B0 tag=C10W0CX8R7GB type=del size=995385 2024-06-04T15:59:30.580 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.579+0000 7f5e9aacc780 1 < completed part key=_multipart_W1T4O3EAE7JN.2~6SDU130JZLVX.0 size=695017 2024-06-04T15:59:30.582 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.582+0000 7f5e9aacc780 1 < completed multipart upload key=W1T4O3EAE7JN upload=6SDU130JZLVX tag=OFHK1VVH3CS8 type=write size=1743593 2024-06-04T15:59:30.585 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.584+0000 7f5e9aacc780 1 > prepared part key=_multipart_4W5HB9WQQHR6.2~N48MAYY4IDRW.0 size=344593 2024-06-04T15:59:30.585 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.584+0000 7f5e9aacc780 1 > prepared multipart upload key=4W5HB9WQQHR6 upload=N48MAYY4IDRW tag=1XTMMT5IMDGW type=write size=1393169 2024-06-04T15:59:30.586 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.586+0000 7f5e9aacc780 1 < completed delete operation key=Q2V1ICTBSCV1 tag=K3P14AVI6XFU type=del 2024-06-04T15:59:30.589 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.588+0000 7f5e9aacc780 1 > prepared part key=_multipart_JL69PUHT6NNT.2~JKXRLMBS2TYN.0 size=1048576 2024-06-04T15:59:30.590 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.589+0000 7f5e9aacc780 1 > prepared part key=_multipart_JL69PUHT6NNT.2~JKXRLMBS2TYN.1 size=115586 2024-06-04T15:59:30.590 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.589+0000 7f5e9aacc780 1 > prepared multipart upload key=JL69PUHT6NNT upload=JKXRLMBS2TYN tag=HKL4CFS5WFPL type=write size=2212738 2024-06-04T15:59:30.591 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.591+0000 7f5e9aacc780 1 < completed part key=_multipart_B0HK5FJ2RGJE.2~HMVKWCPES5MP.0 size=1048576 2024-06-04T15:59:30.593 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.592+0000 7f5e9aacc780 1 < completed part key=_multipart_B0HK5FJ2RGJE.2~HMVKWCPES5MP.1 size=1048576 2024-06-04T15:59:30.594 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.594+0000 7f5e9aacc780 1 < completed part key=_multipart_B0HK5FJ2RGJE.2~HMVKWCPES5MP.2 size=1009735 2024-06-04T15:59:30.596 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.596+0000 7f5e9aacc780 1 < completed multipart upload key=B0HK5FJ2RGJE upload=HMVKWCPES5MP tag=8XJ1RGWK8OEA type=write size=4155463 2024-06-04T15:59:30.599 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.599+0000 7f5e9aacc780 1 > prepared part key=_multipart_B0HK5FJ2RGJE.2~IGL3B82M3VIV.0 size=1048576 2024-06-04T15:59:30.600 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.600+0000 7f5e9aacc780 1 > prepared part key=_multipart_B0HK5FJ2RGJE.2~IGL3B82M3VIV.1 size=352788 2024-06-04T15:59:30.601 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.600+0000 7f5e9aacc780 1 > prepared multipart upload key=B0HK5FJ2RGJE upload=IGL3B82M3VIV tag=DAZ3FQ8R9X3R type=write size=2449940 2024-06-04T15:59:30.602 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.601+0000 7f5e9aacc780 1 < completed part key=_multipart_NHPH4LYPP0LL.2~VH76CCMV2MV9.0 size=210176 2024-06-04T15:59:30.604 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.604+0000 7f5e9aacc780 1 < completed multipart upload key=NHPH4LYPP0LL upload=VH76CCMV2MV9 tag=RJACHE9L4JDO type=write size=1258752 2024-06-04T15:59:30.606 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.606+0000 7f5e9aacc780 1 > prepared operation key=QUIVPH3OB6KN tag=NVI1JQV2SQFE type=del size=304965 2024-06-04T15:59:30.608 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.607+0000 7f5e9aacc780 1 < completed delete operation key=NJ5U8JTT32QK tag=872ZF79ALMF9 type=del 2024-06-04T15:59:30.609 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.610+0000 7f5e9aacc780 1 > prepared operation key=PASGIP872OVX tag=OS1F2TCRZC86 type=del size=1069450 2024-06-04T15:59:30.610 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.610+0000 7f5e9aacc780 1 < canceled part key=_multipart_HD6SNICRCDLL.2~UYJA7K9FF2S2.0 size=333939 2024-06-04T15:59:30.613 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.613+0000 7f5e9aacc780 1 < canceled multipart upload key=HD6SNICRCDLL upload=UYJA7K9FF2S2 tag=FVEXK6A3UQN3 type=write size=1382515 2024-06-04T15:59:30.615 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.614+0000 7f5e9aacc780 1 > prepared operation key=UTZHANL9ER2Q tag=38GYNHG6THZP type=del size=614656 2024-06-04T15:59:30.616 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.616+0000 7f5e9aacc780 1 < completed part key=_multipart_UW5LVIBG09SV.2~GHCLY9RQ8S1C.0 size=1048576 2024-06-04T15:59:30.617 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.617+0000 7f5e9aacc780 1 < completed part key=_multipart_UW5LVIBG09SV.2~GHCLY9RQ8S1C.1 size=1048576 2024-06-04T15:59:30.618 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.618+0000 7f5e9aacc780 1 < completed part key=_multipart_UW5LVIBG09SV.2~GHCLY9RQ8S1C.2 size=790470 2024-06-04T15:59:30.621 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.620+0000 7f5e9aacc780 1 < completed multipart upload key=UW5LVIBG09SV upload=GHCLY9RQ8S1C tag=RJV401M21QX0 type=write size=3936198 2024-06-04T15:59:30.622 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.622+0000 7f5e9aacc780 1 > prepared operation key=RP8K6QJUZAH1 tag=ZINQKDGEN0EA type=del size=746208 2024-06-04T15:59:30.624 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.624+0000 7f5e9aacc780 1 < completed part key=_multipart_QJA2JPATITNH.2~3VEBPYB8XEJO.0 size=885926 2024-06-04T15:59:30.626 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.626+0000 7f5e9aacc780 1 < completed multipart upload key=QJA2JPATITNH upload=3VEBPYB8XEJO tag=NIKD3ST2FFMZ type=write size=1934502 2024-06-04T15:59:30.629 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.629+0000 7f5e9aacc780 1 > prepared part key=_multipart_JL69PUHT6NNT.2~ID1T9CI02IQA.0 size=1048576 2024-06-04T15:59:30.630 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.630+0000 7f5e9aacc780 1 > prepared part key=_multipart_JL69PUHT6NNT.2~ID1T9CI02IQA.1 size=962462 2024-06-04T15:59:30.630 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.630+0000 7f5e9aacc780 1 > prepared multipart upload key=JL69PUHT6NNT upload=ID1T9CI02IQA tag=NFU1TL1RY61S type=write size=3059614 2024-06-04T15:59:30.632 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.632+0000 7f5e9aacc780 1 < completed part key=_multipart_FBV2MAG130M6.2~5EB161XQE63Y.0 size=1048576 2024-06-04T15:59:30.633 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.633+0000 7f5e9aacc780 1 < completed part key=_multipart_FBV2MAG130M6.2~5EB161XQE63Y.1 size=755501 2024-06-04T15:59:30.636 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.635+0000 7f5e9aacc780 1 < completed multipart upload key=FBV2MAG130M6 upload=5EB161XQE63Y tag=VVK2A7DVB80R type=write size=2852653 2024-06-04T15:59:30.637 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.637+0000 7f5e9aacc780 1 > prepared operation key=NJ5U8JTT32QK tag=BFWLNDMP34J2 type=del size=270983 2024-06-04T15:59:30.639 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.638+0000 7f5e9aacc780 1 < completed delete operation key=03ZNYG3WLMP4 tag=TKKDA84SOQ4Y type=del 2024-06-04T15:59:30.641 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.641+0000 7f5e9aacc780 1 > prepared part key=_multipart_1IKNQXU3Y2JJ.2~J7RAPEEE5NQ6.0 size=1048576 2024-06-04T15:59:30.642 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.642+0000 7f5e9aacc780 1 > prepared part key=_multipart_1IKNQXU3Y2JJ.2~J7RAPEEE5NQ6.1 size=272655 2024-06-04T15:59:30.643 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.642+0000 7f5e9aacc780 1 > prepared multipart upload key=1IKNQXU3Y2JJ upload=J7RAPEEE5NQ6 tag=98LGEC8YQH75 type=write size=2369807 2024-06-04T15:59:30.644 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.644+0000 7f5e9aacc780 1 < completed part key=_multipart_PNDPO2WUW7UX.2~LUWNSFLGV70L.0 size=1048576 2024-06-04T15:59:30.645 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.645+0000 7f5e9aacc780 1 < completed part key=_multipart_PNDPO2WUW7UX.2~LUWNSFLGV70L.1 size=323292 2024-06-04T15:59:30.647 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.647+0000 7f5e9aacc780 1 < completed multipart upload key=PNDPO2WUW7UX upload=LUWNSFLGV70L tag=8HK32N4Q377T type=write size=2420444 2024-06-04T15:59:30.649 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.648+0000 7f5e9aacc780 1 > prepared operation key=NJ5U8JTT32QK tag=GBDZXTI60400 type=del size=3183195 2024-06-04T15:59:30.650 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.650+0000 7f5e9aacc780 1 < completed delete operation key=Q2V1ICTBSCV1 tag=KLKSGSGLKNCD type=del 2024-06-04T15:59:30.652 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.652+0000 7f5e9aacc780 1 > prepared operation key=Q2V1ICTBSCV1 tag=5D5KV7PYJ554 type=del size=1829301 2024-06-04T15:59:30.653 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.653+0000 7f5e9aacc780 1 < completed part key=_multipart_2BT2AXKB1RTA.2~DIYUHVS326QX.0 size=875166 2024-06-04T15:59:30.656 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.656+0000 7f5e9aacc780 1 < completed multipart upload key=2BT2AXKB1RTA upload=DIYUHVS326QX tag=JMLGLAM26XR2 type=write size=1923742 2024-06-04T15:59:30.657 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.657+0000 7f5e9aacc780 1 > prepared operation key=DY9JWHWNAUO1 tag=ZFQ9Z7L3K1FO type=del size=1925387 2024-06-04T15:59:30.660 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.660+0000 7f5e9aacc780 1 < suggested update operation key=GTRMEQJK675Z tag=TSJR1301RPQT type=del size=865688 2024-06-04T15:59:30.662 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.661+0000 7f5e9aacc780 1 > prepared operation key=PASGIP872OVX tag=LS8EMZOVJ4HY type=del size=3552341 2024-06-04T15:59:30.663 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.663+0000 7f5e9aacc780 1 < completed delete operation key=1IKNQXU3Y2JJ tag=KU9AIL3OGNNB type=del 2024-06-04T15:59:30.666 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.666+0000 7f5e9aacc780 1 > prepared part key=_multipart_GTRMEQJK675Z.2~8M4165TF4Z23.0 size=1048576 2024-06-04T15:59:30.667 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.667+0000 7f5e9aacc780 1 > prepared part key=_multipart_GTRMEQJK675Z.2~8M4165TF4Z23.1 size=39828 2024-06-04T15:59:30.667 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.667+0000 7f5e9aacc780 1 > prepared multipart upload key=GTRMEQJK675Z upload=8M4165TF4Z23 tag=LI5LSRIHPJIE type=write size=2136980 2024-06-04T15:59:30.668 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.669+0000 7f5e9aacc780 1 < completed delete operation key=AOCB36Y5Q7B0 tag=C10W0CX8R7GB type=del 2024-06-04T15:59:30.670 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.670+0000 7f5e9aacc780 1 > prepared operation key=4W5HB9WQQHR6 tag=F7DY0CK118CT type=del size=3991869 2024-06-04T15:59:30.672 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.671+0000 7f5e9aacc780 1 < completed part key=_multipart_4W5HB9WQQHR6.2~N48MAYY4IDRW.0 size=344593 2024-06-04T15:59:30.674 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.674+0000 7f5e9aacc780 1 < completed multipart upload key=4W5HB9WQQHR6 upload=N48MAYY4IDRW tag=1XTMMT5IMDGW type=write size=1393169 2024-06-04T15:59:30.675 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.675+0000 7f5e9aacc780 1 > prepared operation key=HD6SNICRCDLL tag=XDQA3HA88JZA type=del size=3316745 2024-06-04T15:59:30.677 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.676+0000 7f5e9aacc780 1 < completed part key=_multipart_JL69PUHT6NNT.2~JKXRLMBS2TYN.0 size=1048576 2024-06-04T15:59:30.678 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.677+0000 7f5e9aacc780 1 < completed part key=_multipart_JL69PUHT6NNT.2~JKXRLMBS2TYN.1 size=115586 2024-06-04T15:59:30.680 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.680+0000 7f5e9aacc780 1 < completed multipart upload key=JL69PUHT6NNT upload=JKXRLMBS2TYN tag=HKL4CFS5WFPL type=write size=2212738 2024-06-04T15:59:30.683 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.682+0000 7f5e9aacc780 1 > prepared part key=_multipart_PNDPO2WUW7UX.2~TAB5JAP0RD1H.0 size=1048576 2024-06-04T15:59:30.684 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.683+0000 7f5e9aacc780 1 > prepared part key=_multipart_PNDPO2WUW7UX.2~TAB5JAP0RD1H.1 size=986397 2024-06-04T15:59:30.684 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.683+0000 7f5e9aacc780 1 > prepared multipart upload key=PNDPO2WUW7UX upload=TAB5JAP0RD1H tag=EE0TVGEXLUDU type=write size=3083549 2024-06-04T15:59:30.685 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.685+0000 7f5e9aacc780 1 < completed part key=_multipart_B0HK5FJ2RGJE.2~IGL3B82M3VIV.0 size=1048576 2024-06-04T15:59:30.685 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.685+0000 7f5e9aacc780 1 < canceled part key=_multipart_B0HK5FJ2RGJE.2~IGL3B82M3VIV.1 size=352788 2024-06-04T15:59:30.687 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.688+0000 7f5e9aacc780 1 < canceled multipart upload key=B0HK5FJ2RGJE upload=IGL3B82M3VIV tag=DAZ3FQ8R9X3R type=write size=2449940 2024-06-04T15:59:30.690 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.690+0000 7f5e9aacc780 1 > prepared part key=_multipart_GTRMEQJK675Z.2~XMSMPVGULP4T.0 size=398222 2024-06-04T15:59:30.690 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.690+0000 7f5e9aacc780 1 > prepared multipart upload key=GTRMEQJK675Z upload=XMSMPVGULP4T tag=T8JM3PRLKGGL type=write size=1446798 2024-06-04T15:59:30.693 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.693+0000 7f5e9aacc780 1 < suggested update operation key=QUIVPH3OB6KN tag=NVI1JQV2SQFE type=del size=304965 2024-06-04T15:59:30.694 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.694+0000 7f5e9aacc780 1 > prepared operation key=XH0N984YVGKP tag=7005WXNYMP1S type=del size=442554 2024-06-04T15:59:30.696 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.695+0000 7f5e9aacc780 1 < completed delete operation key=PASGIP872OVX tag=OS1F2TCRZC86 type=del 2024-06-04T15:59:30.697 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.697+0000 7f5e9aacc780 1 > prepared operation key=4W5HB9WQQHR6 tag=IFFU2HBVR6YO type=del size=2875080 2024-06-04T15:59:30.700 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.700+0000 7f5e9aacc780 1 < suggested remove operation key=UTZHANL9ER2Q tag=38GYNHG6THZP type=del 2024-06-04T15:59:30.701 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.701+0000 7f5e9aacc780 1 > prepared operation key=QUIVPH3OB6KN tag=G93A69SQMO0Y type=del size=3796203 2024-06-04T15:59:30.703 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.703+0000 7f5e9aacc780 1 < canceled operation key=RP8K6QJUZAH1 tag=ZINQKDGEN0EA type=del size=746208 2024-06-04T15:59:30.704 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.704+0000 7f5e9aacc780 1 > prepared operation key=4W5HB9WQQHR6 tag=PU1Q38G1XZ31 type=del size=1430219 2024-06-04T15:59:30.706 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.705+0000 7f5e9aacc780 1 < completed part key=_multipart_JL69PUHT6NNT.2~ID1T9CI02IQA.0 size=1048576 2024-06-04T15:59:30.706 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.706+0000 7f5e9aacc780 1 < completed part key=_multipart_JL69PUHT6NNT.2~ID1T9CI02IQA.1 size=962462 2024-06-04T15:59:30.709 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.709+0000 7f5e9aacc780 1 < completed multipart upload key=JL69PUHT6NNT upload=ID1T9CI02IQA tag=NFU1TL1RY61S type=write size=3059614 2024-06-04T15:59:30.710 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.710+0000 7f5e9aacc780 1 > prepared operation key=4W5HB9WQQHR6 tag=GQE655U8CT07 type=del size=2522382 2024-06-04T15:59:30.712 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.712+0000 7f5e9aacc780 1 < completed delete operation key=NJ5U8JTT32QK tag=BFWLNDMP34J2 type=del 2024-06-04T15:59:30.715 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.715+0000 7f5e9aacc780 1 > prepared part key=_multipart_GTRMEQJK675Z.2~LJHRD0VNGJJN.0 size=342639 2024-06-04T15:59:30.715 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.715+0000 7f5e9aacc780 1 > prepared multipart upload key=GTRMEQJK675Z upload=LJHRD0VNGJJN tag=DXTVM31BZ37E type=write size=1391215 2024-06-04T15:59:30.716 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.716+0000 7f5e9aacc780 1 < completed part key=_multipart_1IKNQXU3Y2JJ.2~J7RAPEEE5NQ6.0 size=1048576 2024-06-04T15:59:30.716 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.716+0000 7f5e9aacc780 1 < canceled part key=_multipart_1IKNQXU3Y2JJ.2~J7RAPEEE5NQ6.1 size=272655 2024-06-04T15:59:30.719 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.719+0000 7f5e9aacc780 1 < canceled multipart upload key=1IKNQXU3Y2JJ upload=J7RAPEEE5NQ6 tag=98LGEC8YQH75 type=write size=2369807 2024-06-04T15:59:30.720 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.720+0000 7f5e9aacc780 1 > prepared operation key=PNDPO2WUW7UX tag=EZ4O84B89OZ7 type=del size=3044768 2024-06-04T15:59:30.722 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.721+0000 7f5e9aacc780 1 < completed delete operation key=NJ5U8JTT32QK tag=GBDZXTI60400 type=del 2024-06-04T15:59:30.723 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.723+0000 7f5e9aacc780 1 > prepared operation key=QJA2JPATITNH tag=WT4AH5FQQ29R type=del size=3675865 2024-06-04T15:59:30.724 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.724+0000 7f5e9aacc780 1 < completed delete operation key=Q2V1ICTBSCV1 tag=5D5KV7PYJ554 type=del 2024-06-04T15:59:30.726 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.725+0000 7f5e9aacc780 1 > prepared operation key=SUBHZJ7HUV3H tag=WS4GD0D0Z170 type=del size=1122150 2024-06-04T15:59:30.727 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.727+0000 7f5e9aacc780 1 < completed delete operation key=DY9JWHWNAUO1 tag=ZFQ9Z7L3K1FO type=del 2024-06-04T15:59:30.729 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.729+0000 7f5e9aacc780 1 > prepared part key=_multipart_9MPRI6LW3956.2~IJX1J1GUFQUG.0 size=672389 2024-06-04T15:59:30.729 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.729+0000 7f5e9aacc780 1 > prepared multipart upload key=9MPRI6LW3956 upload=IJX1J1GUFQUG tag=23950TQ39K9R type=write size=1720965 2024-06-04T15:59:30.731 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.731+0000 7f5e9aacc780 1 < completed delete operation key=PASGIP872OVX tag=LS8EMZOVJ4HY type=del 2024-06-04T15:59:30.732 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.732+0000 7f5e9aacc780 1 > prepared operation key=HD6SNICRCDLL tag=CFPMJVP9MPFW type=del size=1791302 2024-06-04T15:59:30.733 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.733+0000 7f5e9aacc780 1 < completed part key=_multipart_GTRMEQJK675Z.2~8M4165TF4Z23.0 size=1048576 2024-06-04T15:59:30.734 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.734+0000 7f5e9aacc780 1 < completed part key=_multipart_GTRMEQJK675Z.2~8M4165TF4Z23.1 size=39828 2024-06-04T15:59:30.737 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.736+0000 7f5e9aacc780 1 < completed multipart upload key=GTRMEQJK675Z upload=8M4165TF4Z23 tag=LI5LSRIHPJIE type=write size=2136980 2024-06-04T15:59:30.739 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.739+0000 7f5e9aacc780 1 > prepared part key=_multipart_NHPH4LYPP0LL.2~V3AY98D57TFA.0 size=1048576 2024-06-04T15:59:30.740 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.740+0000 7f5e9aacc780 1 > prepared part key=_multipart_NHPH4LYPP0LL.2~V3AY98D57TFA.1 size=1048576 2024-06-04T15:59:30.741 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.741+0000 7f5e9aacc780 1 > prepared part key=_multipart_NHPH4LYPP0LL.2~V3AY98D57TFA.2 size=794464 2024-06-04T15:59:30.741 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.741+0000 7f5e9aacc780 1 > prepared multipart upload key=NHPH4LYPP0LL upload=V3AY98D57TFA tag=96HJ8NUAHA27 type=write size=3940192 2024-06-04T15:59:30.743 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.742+0000 7f5e9aacc780 1 < completed delete operation key=4W5HB9WQQHR6 tag=F7DY0CK118CT type=del 2024-06-04T15:59:30.744 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.744+0000 7f5e9aacc780 1 > prepared operation key=AOCB36Y5Q7B0 tag=A2SQYBBI5S7I type=del size=706401 2024-06-04T15:59:30.746 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.746+0000 7f5e9aacc780 1 < canceled operation key=HD6SNICRCDLL tag=XDQA3HA88JZA type=del size=3316745 2024-06-04T15:59:30.748 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.748+0000 7f5e9aacc780 1 > prepared operation key=4W5HB9WQQHR6 tag=N6CWYQ1YDWCA type=del size=991195 2024-06-04T15:59:30.748 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.748+0000 7f5e9aacc780 1 < canceled part key=_multipart_PNDPO2WUW7UX.2~TAB5JAP0RD1H.0 size=1048576 2024-06-04T15:59:30.749 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.749+0000 7f5e9aacc780 1 < completed part key=_multipart_PNDPO2WUW7UX.2~TAB5JAP0RD1H.1 size=986397 2024-06-04T15:59:30.752 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.751+0000 7f5e9aacc780 1 < canceled multipart upload key=PNDPO2WUW7UX upload=TAB5JAP0RD1H tag=EE0TVGEXLUDU type=write size=3083549 2024-06-04T15:59:30.753 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.753+0000 7f5e9aacc780 1 > prepared operation key=PNDPO2WUW7UX tag=5FBOQHXI6GUN type=write size=843923 2024-06-04T15:59:30.753 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.753+0000 7f5e9aacc780 1 < canceled part key=_multipart_GTRMEQJK675Z.2~XMSMPVGULP4T.0 size=398222 2024-06-04T15:59:30.755 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.756+0000 7f5e9aacc780 1 < canceled multipart upload key=GTRMEQJK675Z upload=XMSMPVGULP4T tag=T8JM3PRLKGGL type=write size=1446798 2024-06-04T15:59:30.758 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.758+0000 7f5e9aacc780 1 > prepared part key=_multipart_GCPC9OJH7KWU.2~1XMWCU4FVMCB.0 size=1048576 2024-06-04T15:59:30.759 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.759+0000 7f5e9aacc780 1 > prepared part key=_multipart_GCPC9OJH7KWU.2~1XMWCU4FVMCB.1 size=797868 2024-06-04T15:59:30.759 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.759+0000 7f5e9aacc780 1 > prepared multipart upload key=GCPC9OJH7KWU upload=1XMWCU4FVMCB tag=9L57Q4RZDJAH type=write size=2895020 2024-06-04T15:59:30.762 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.762+0000 7f5e9aacc780 1 < completed delete operation key=XH0N984YVGKP tag=7005WXNYMP1S type=del 2024-06-04T15:59:30.764 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.764+0000 7f5e9aacc780 1 > prepared operation key=GCPC9OJH7KWU tag=W9BM0719AZ3P type=del size=2406967 2024-06-04T15:59:30.766 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.766+0000 7f5e9aacc780 1 < suggested update operation key=4W5HB9WQQHR6 tag=IFFU2HBVR6YO type=del size=2875080 2024-06-04T15:59:30.768 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.768+0000 7f5e9aacc780 1 > prepared operation key=AOCB36Y5Q7B0 tag=R9JHKTYRW9PK type=write size=302116 2024-06-04T15:59:30.771 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.771+0000 7f5e9aacc780 1 < suggested remove operation key=QUIVPH3OB6KN tag=G93A69SQMO0Y type=del 2024-06-04T15:59:30.772 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.772+0000 7f5e9aacc780 1 > prepared operation key=B0HK5FJ2RGJE tag=TEP5G5DSZ1HK type=del size=2973486 2024-06-04T15:59:30.773 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.773+0000 7f5e9aacc780 -1 < failed to complete operation key=4W5HB9WQQHR6 tag=PU1Q38G1XZ31 type=del size=1430219: (22) Invalid argument 2024-06-04T15:59:30.776 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.776+0000 7f5e9aacc780 1 > prepared part key=_multipart_7S9S3MIG7WIT.2~YKL8TG0DEI49.0 size=1048576 2024-06-04T15:59:30.778 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.777+0000 7f5e9aacc780 1 > prepared part key=_multipart_7S9S3MIG7WIT.2~YKL8TG0DEI49.1 size=365565 2024-06-04T15:59:30.778 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.777+0000 7f5e9aacc780 1 > prepared multipart upload key=7S9S3MIG7WIT upload=YKL8TG0DEI49 tag=U5A9V1D22AGX type=write size=2462717 2024-06-04T15:59:30.779 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.779+0000 7f5e9aacc780 -1 < failed to complete operation key=4W5HB9WQQHR6 tag=GQE655U8CT07 type=del size=2522382: (22) Invalid argument 2024-06-04T15:59:30.780 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.780+0000 7f5e9aacc780 1 > prepared operation key=HD6SNICRCDLL tag=C3SRPO51TZND type=del size=1364883 2024-06-04T15:59:30.782 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.781+0000 7f5e9aacc780 1 < completed part key=_multipart_GTRMEQJK675Z.2~LJHRD0VNGJJN.0 size=342639 2024-06-04T15:59:30.784 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.784+0000 7f5e9aacc780 1 < completed multipart upload key=GTRMEQJK675Z upload=LJHRD0VNGJJN tag=DXTVM31BZ37E type=write size=1391215 2024-06-04T15:59:30.785 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.785+0000 7f5e9aacc780 1 > prepared operation key=UTZHANL9ER2Q tag=56BFRAJ5GG8Q type=del size=96825 2024-06-04T15:59:30.788 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.788+0000 7f5e9aacc780 1 < suggested remove operation key=PNDPO2WUW7UX tag=EZ4O84B89OZ7 type=del 2024-06-04T15:59:30.789 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.789+0000 7f5e9aacc780 1 > prepared operation key=XH0N984YVGKP tag=I3ZEYUNFPE92 type=write size=158422 2024-06-04T15:59:30.791 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.791+0000 7f5e9aacc780 1 < completed delete operation key=QJA2JPATITNH tag=WT4AH5FQQ29R type=del 2024-06-04T15:59:30.793 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.793+0000 7f5e9aacc780 1 > prepared operation key=PCLJXQHJ4HTY tag=QO3LIJO8F5V3 type=del size=1812913 2024-06-04T15:59:30.794 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.794+0000 7f5e9aacc780 1 < completed delete operation key=SUBHZJ7HUV3H tag=WS4GD0D0Z170 type=del 2024-06-04T15:59:30.796 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.795+0000 7f5e9aacc780 1 > prepared operation key=GTRMEQJK675Z tag=UFTCLCFYYQNY type=del size=2898610 2024-06-04T15:59:30.797 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.797+0000 7f5e9aacc780 1 < completed part key=_multipart_9MPRI6LW3956.2~IJX1J1GUFQUG.0 size=672389 2024-06-04T15:59:30.799 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.799+0000 7f5e9aacc780 1 < completed multipart upload key=9MPRI6LW3956 upload=IJX1J1GUFQUG tag=23950TQ39K9R type=write size=1720965 2024-06-04T15:59:30.801 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.801+0000 7f5e9aacc780 1 > prepared operation key=QJA2JPATITNH tag=GWA4OT5JR06Z type=del size=3344557 2024-06-04T15:59:30.803 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.803+0000 7f5e9aacc780 1 < completed delete operation key=HD6SNICRCDLL tag=CFPMJVP9MPFW type=del 2024-06-04T15:59:30.804 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.804+0000 7f5e9aacc780 1 > prepared operation key=XH0N984YVGKP tag=08DF62A7C0EJ type=del size=53030 2024-06-04T15:59:30.804 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.804+0000 7f5e9aacc780 1 < canceled part key=_multipart_NHPH4LYPP0LL.2~V3AY98D57TFA.0 size=1048576 2024-06-04T15:59:30.806 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.806+0000 7f5e9aacc780 1 < completed part key=_multipart_NHPH4LYPP0LL.2~V3AY98D57TFA.1 size=1048576 2024-06-04T15:59:30.807 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.807+0000 7f5e9aacc780 1 < completed part key=_multipart_NHPH4LYPP0LL.2~V3AY98D57TFA.2 size=794464 2024-06-04T15:59:30.810 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.809+0000 7f5e9aacc780 1 < canceled multipart upload key=NHPH4LYPP0LL upload=V3AY98D57TFA tag=96HJ8NUAHA27 type=write size=3940192 2024-06-04T15:59:30.812 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.812+0000 7f5e9aacc780 1 > prepared part key=_multipart_PCLJXQHJ4HTY.2~QT1W2ECQZWVE.0 size=1048576 2024-06-04T15:59:30.814 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.814+0000 7f5e9aacc780 1 > prepared part key=_multipart_PCLJXQHJ4HTY.2~QT1W2ECQZWVE.1 size=1048576 2024-06-04T15:59:30.815 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.815+0000 7f5e9aacc780 1 > prepared part key=_multipart_PCLJXQHJ4HTY.2~QT1W2ECQZWVE.2 size=979750 2024-06-04T15:59:30.815 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.815+0000 7f5e9aacc780 1 > prepared multipart upload key=PCLJXQHJ4HTY upload=QT1W2ECQZWVE tag=0L49QWL6YA7P type=write size=4125478 2024-06-04T15:59:30.817 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.817+0000 7f5e9aacc780 1 < completed delete operation key=AOCB36Y5Q7B0 tag=A2SQYBBI5S7I type=del 2024-06-04T15:59:30.818 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.818+0000 7f5e9aacc780 1 > prepared operation key=Q4OFQI0F5YLG tag=AMQAAEJCDVDI type=del size=3260825 2024-06-04T15:59:30.820 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.820+0000 7f5e9aacc780 -1 < failed to complete operation key=4W5HB9WQQHR6 tag=N6CWYQ1YDWCA type=del size=991195: (22) Invalid argument 2024-06-04T15:59:30.821 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.821+0000 7f5e9aacc780 1 > prepared operation key=JL69PUHT6NNT tag=53WJXSI23IZK type=del size=181967 2024-06-04T15:59:30.823 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.823+0000 7f5e9aacc780 -1 < failed to complete operation key=PNDPO2WUW7UX tag=5FBOQHXI6GUN type=write size=843923: (22) Invalid argument 2024-06-04T15:59:30.825 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.825+0000 7f5e9aacc780 1 > prepared operation key=SUBHZJ7HUV3H tag=N1Y995PCPEVK type=del size=3278832 2024-06-04T15:59:30.827 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.826+0000 7f5e9aacc780 1 < completed part key=_multipart_GCPC9OJH7KWU.2~1XMWCU4FVMCB.0 size=1048576 2024-06-04T15:59:30.828 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.827+0000 7f5e9aacc780 1 < completed part key=_multipart_GCPC9OJH7KWU.2~1XMWCU4FVMCB.1 size=797868 2024-06-04T15:59:30.830 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.830+0000 7f5e9aacc780 1 < completed multipart upload key=GCPC9OJH7KWU upload=1XMWCU4FVMCB tag=9L57Q4RZDJAH type=write size=2895020 2024-06-04T15:59:30.833 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.833+0000 7f5e9aacc780 1 > prepared part key=_multipart_GTRMEQJK675Z.2~CN87QWB6SAQR.0 size=1048576 2024-06-04T15:59:30.834 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.833+0000 7f5e9aacc780 1 > prepared part key=_multipart_GTRMEQJK675Z.2~CN87QWB6SAQR.1 size=1048576 2024-06-04T15:59:30.835 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.834+0000 7f5e9aacc780 1 > prepared part key=_multipart_GTRMEQJK675Z.2~CN87QWB6SAQR.2 size=330449 2024-06-04T15:59:30.835 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.834+0000 7f5e9aacc780 1 > prepared multipart upload key=GTRMEQJK675Z upload=CN87QWB6SAQR tag=7CLLZG0WOZFJ type=write size=3476177 2024-06-04T15:59:30.837 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.837+0000 7f5e9aacc780 1 < suggested update operation key=GCPC9OJH7KWU tag=W9BM0719AZ3P type=del size=2406967 2024-06-04T15:59:30.840 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.839+0000 7f5e9aacc780 1 > prepared part key=_multipart_B0HK5FJ2RGJE.2~07C2DGH9LTBY.0 size=1048576 2024-06-04T15:59:30.841 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.840+0000 7f5e9aacc780 1 > prepared part key=_multipart_B0HK5FJ2RGJE.2~07C2DGH9LTBY.1 size=461350 2024-06-04T15:59:30.841 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.840+0000 7f5e9aacc780 1 > prepared multipart upload key=B0HK5FJ2RGJE upload=07C2DGH9LTBY tag=OX0VC80VOY8J type=write size=2558502 2024-06-04T15:59:30.843 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.843+0000 7f5e9aacc780 1 < suggested update operation key=AOCB36Y5Q7B0 tag=R9JHKTYRW9PK type=write size=302116 2024-06-04T15:59:30.845 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.844+0000 7f5e9aacc780 1 > prepared operation key=PASGIP872OVX tag=2DSRLLJZZPNG type=del size=2801801 2024-06-04T15:59:30.847 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.848+0000 7f5e9aacc780 1 < suggested update operation key=B0HK5FJ2RGJE tag=TEP5G5DSZ1HK type=del size=2973486 2024-06-04T15:59:30.850 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.849+0000 7f5e9aacc780 1 > prepared part key=_multipart_PASGIP872OVX.2~2B4NPP3MOUO5.0 size=1048576 2024-06-04T15:59:30.851 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.851+0000 7f5e9aacc780 1 > prepared part key=_multipart_PASGIP872OVX.2~2B4NPP3MOUO5.1 size=1048576 2024-06-04T15:59:30.852 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.852+0000 7f5e9aacc780 1 > prepared part key=_multipart_PASGIP872OVX.2~2B4NPP3MOUO5.2 size=507811 2024-06-04T15:59:30.852 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.852+0000 7f5e9aacc780 1 > prepared multipart upload key=PASGIP872OVX upload=2B4NPP3MOUO5 tag=S92WQYS7PPGM type=write size=3653539 2024-06-04T15:59:30.853 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.853+0000 7f5e9aacc780 1 < completed part key=_multipart_7S9S3MIG7WIT.2~YKL8TG0DEI49.0 size=1048576 2024-06-04T15:59:30.854 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.854+0000 7f5e9aacc780 1 < completed part key=_multipart_7S9S3MIG7WIT.2~YKL8TG0DEI49.1 size=365565 2024-06-04T15:59:30.857 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.856+0000 7f5e9aacc780 1 < completed multipart upload key=7S9S3MIG7WIT upload=YKL8TG0DEI49 tag=U5A9V1D22AGX type=write size=2462717 2024-06-04T15:59:30.858 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.858+0000 7f5e9aacc780 1 > prepared operation key=NJ5U8JTT32QK tag=JQH0GUTCMEXA type=del size=2163700 2024-06-04T15:59:30.861 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.861+0000 7f5e9aacc780 1 < suggested remove operation key=HD6SNICRCDLL tag=C3SRPO51TZND type=del 2024-06-04T15:59:30.862 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.862+0000 7f5e9aacc780 1 > prepared operation key=K01DAK0M4I4M tag=PE8BJSEHHCQK type=del size=3674831 2024-06-04T15:59:30.864 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.864+0000 7f5e9aacc780 1 < completed delete operation key=UTZHANL9ER2Q tag=56BFRAJ5GG8Q type=del 2024-06-04T15:59:30.865 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.865+0000 7f5e9aacc780 1 > prepared operation key=QJA2JPATITNH tag=L5IG4TZ3NM2J type=del size=3364599 2024-06-04T15:59:30.866 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.866+0000 7f5e9aacc780 1 < completed write operation key=XH0N984YVGKP tag=I3ZEYUNFPE92 type=write size=158422 2024-06-04T15:59:30.868 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.868+0000 7f5e9aacc780 1 > prepared operation key=FBV2MAG130M6 tag=2HKBVBE7PWHE type=del size=3384844 2024-06-04T15:59:30.870 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.870+0000 7f5e9aacc780 1 < completed delete operation key=PCLJXQHJ4HTY tag=QO3LIJO8F5V3 type=del 2024-06-04T15:59:30.872 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.872+0000 7f5e9aacc780 1 > prepared part key=_multipart_03ZNYG3WLMP4.2~T2EIL2ZY3QCZ.0 size=1048576 2024-06-04T15:59:30.873 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.873+0000 7f5e9aacc780 1 > prepared part key=_multipart_03ZNYG3WLMP4.2~T2EIL2ZY3QCZ.1 size=553509 2024-06-04T15:59:30.873 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.873+0000 7f5e9aacc780 1 > prepared multipart upload key=03ZNYG3WLMP4 upload=T2EIL2ZY3QCZ tag=A11OO8YWMR6L type=write size=2650661 2024-06-04T15:59:30.875 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.875+0000 7f5e9aacc780 1 < completed delete operation key=GTRMEQJK675Z tag=UFTCLCFYYQNY type=del 2024-06-04T15:59:30.877 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.877+0000 7f5e9aacc780 1 > prepared part key=_multipart_W1T4O3EAE7JN.2~9BP1HRBDHIJQ.0 size=1048576 2024-06-04T15:59:30.878 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.878+0000 7f5e9aacc780 1 > prepared part key=_multipart_W1T4O3EAE7JN.2~9BP1HRBDHIJQ.1 size=1048576 2024-06-04T15:59:30.879 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.879+0000 7f5e9aacc780 1 > prepared part key=_multipart_W1T4O3EAE7JN.2~9BP1HRBDHIJQ.2 size=547390 2024-06-04T15:59:30.879 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.879+0000 7f5e9aacc780 1 > prepared multipart upload key=W1T4O3EAE7JN upload=9BP1HRBDHIJQ tag=NWIXF27IZDIG type=write size=3693118 2024-06-04T15:59:30.881 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.881+0000 7f5e9aacc780 1 < completed delete operation key=QJA2JPATITNH tag=GWA4OT5JR06Z type=del 2024-06-04T15:59:30.884 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.883+0000 7f5e9aacc780 1 > prepared operation key=QUIVPH3OB6KN tag=R3T6EKSWRTCW type=del size=3713952 2024-06-04T15:59:30.887 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.887+0000 7f5e9aacc780 1 < suggested update operation key=XH0N984YVGKP tag=08DF62A7C0EJ type=del size=53030 2024-06-04T15:59:30.888 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.888+0000 7f5e9aacc780 1 > prepared operation key=4W5HB9WQQHR6 tag=SNL4D64TRWM8 type=del size=385368 2024-06-04T15:59:30.890 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.889+0000 7f5e9aacc780 1 < completed part key=_multipart_PCLJXQHJ4HTY.2~QT1W2ECQZWVE.0 size=1048576 2024-06-04T15:59:30.890 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.889+0000 7f5e9aacc780 1 < canceled part key=_multipart_PCLJXQHJ4HTY.2~QT1W2ECQZWVE.1 size=1048576 2024-06-04T15:59:30.891 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.890+0000 7f5e9aacc780 1 < completed part key=_multipart_PCLJXQHJ4HTY.2~QT1W2ECQZWVE.2 size=979750 2024-06-04T15:59:30.893 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.892+0000 7f5e9aacc780 1 < canceled multipart upload key=PCLJXQHJ4HTY upload=QT1W2ECQZWVE tag=0L49QWL6YA7P type=write size=4125478 2024-06-04T15:59:30.894 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.894+0000 7f5e9aacc780 1 > prepared operation key=QUIVPH3OB6KN tag=KWSJOULRZMW0 type=del size=2272359 2024-06-04T15:59:30.895 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.896+0000 7f5e9aacc780 1 < completed delete operation key=Q4OFQI0F5YLG tag=AMQAAEJCDVDI type=del 2024-06-04T15:59:30.897 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.897+0000 7f5e9aacc780 1 > prepared operation key=NJ5U8JTT32QK tag=CO0I7RF9UE3W type=del size=1821137 2024-06-04T15:59:30.900 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.900+0000 7f5e9aacc780 1 < suggested remove operation key=JL69PUHT6NNT tag=53WJXSI23IZK type=del 2024-06-04T15:59:30.902 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.902+0000 7f5e9aacc780 1 > prepared operation key=B0HK5FJ2RGJE tag=ZDFXDAW31ZEA type=write size=173179 2024-06-04T15:59:30.903 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.903+0000 7f5e9aacc780 1 < completed delete operation key=SUBHZJ7HUV3H tag=N1Y995PCPEVK type=del 2024-06-04T15:59:30.906 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.905+0000 7f5e9aacc780 1 > prepared part key=_multipart_RP8K6QJUZAH1.2~YLOANUU0NDY6.0 size=1048576 2024-06-04T15:59:30.907 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.907+0000 7f5e9aacc780 1 > prepared part key=_multipart_RP8K6QJUZAH1.2~YLOANUU0NDY6.1 size=1048576 2024-06-04T15:59:30.908 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.908+0000 7f5e9aacc780 1 > prepared part key=_multipart_RP8K6QJUZAH1.2~YLOANUU0NDY6.2 size=80817 2024-06-04T15:59:30.908 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.908+0000 7f5e9aacc780 1 > prepared multipart upload key=RP8K6QJUZAH1 upload=YLOANUU0NDY6 tag=YHUBFNGILS7H type=write size=3226545 2024-06-04T15:59:30.909 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.909+0000 7f5e9aacc780 1 < completed part key=_multipart_GTRMEQJK675Z.2~CN87QWB6SAQR.0 size=1048576 2024-06-04T15:59:30.910 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.910+0000 7f5e9aacc780 1 < completed part key=_multipart_GTRMEQJK675Z.2~CN87QWB6SAQR.1 size=1048576 2024-06-04T15:59:30.912 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.912+0000 7f5e9aacc780 1 < completed part key=_multipart_GTRMEQJK675Z.2~CN87QWB6SAQR.2 size=330449 2024-06-04T15:59:30.914 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.914+0000 7f5e9aacc780 1 < completed multipart upload key=GTRMEQJK675Z upload=CN87QWB6SAQR tag=7CLLZG0WOZFJ type=write size=3476177 2024-06-04T15:59:30.915 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.915+0000 7f5e9aacc780 1 > prepared operation key=NJ5U8JTT32QK tag=2N5Q6TLP9GWZ type=del size=1382914 2024-06-04T15:59:30.917 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.916+0000 7f5e9aacc780 1 < completed part key=_multipart_B0HK5FJ2RGJE.2~07C2DGH9LTBY.0 size=1048576 2024-06-04T15:59:30.918 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.917+0000 7f5e9aacc780 1 < completed part key=_multipart_B0HK5FJ2RGJE.2~07C2DGH9LTBY.1 size=461350 2024-06-04T15:59:30.920 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.920+0000 7f5e9aacc780 1 < completed multipart upload key=B0HK5FJ2RGJE upload=07C2DGH9LTBY tag=OX0VC80VOY8J type=write size=2558502 2024-06-04T15:59:30.922 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.921+0000 7f5e9aacc780 1 > prepared operation key=7S9S3MIG7WIT tag=DPBZO8EQ49SY type=del size=3653437 2024-06-04T15:59:30.923 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.923+0000 7f5e9aacc780 1 < canceled operation key=PASGIP872OVX tag=2DSRLLJZZPNG type=del size=2801801 2024-06-04T15:59:30.925 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.925+0000 7f5e9aacc780 1 > prepared part key=_multipart_1IKNQXU3Y2JJ.2~Q9D3NIH7YU6R.0 size=567253 2024-06-04T15:59:30.925 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.925+0000 7f5e9aacc780 1 > prepared multipart upload key=1IKNQXU3Y2JJ upload=Q9D3NIH7YU6R tag=NIXZWQBO4E87 type=write size=1615829 2024-06-04T15:59:30.926 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.926+0000 7f5e9aacc780 1 < completed part key=_multipart_PASGIP872OVX.2~2B4NPP3MOUO5.0 size=1048576 2024-06-04T15:59:30.928 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.927+0000 7f5e9aacc780 1 < completed part key=_multipart_PASGIP872OVX.2~2B4NPP3MOUO5.1 size=1048576 2024-06-04T15:59:30.929 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.928+0000 7f5e9aacc780 1 < completed part key=_multipart_PASGIP872OVX.2~2B4NPP3MOUO5.2 size=507811 2024-06-04T15:59:30.931 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.931+0000 7f5e9aacc780 1 < completed multipart upload key=PASGIP872OVX upload=2B4NPP3MOUO5 tag=S92WQYS7PPGM type=write size=3653539 2024-06-04T15:59:30.934 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.934+0000 7f5e9aacc780 1 > prepared part key=_multipart_UTZHANL9ER2Q.2~C3JLFMMHTPNT.0 size=1048576 2024-06-04T15:59:30.935 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.934+0000 7f5e9aacc780 1 > prepared part key=_multipart_UTZHANL9ER2Q.2~C3JLFMMHTPNT.1 size=344731 2024-06-04T15:59:30.935 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.934+0000 7f5e9aacc780 1 > prepared multipart upload key=UTZHANL9ER2Q upload=C3JLFMMHTPNT tag=GAKD51BITTXN type=write size=2441883 2024-06-04T15:59:30.936 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.936+0000 7f5e9aacc780 1 < completed delete operation key=NJ5U8JTT32QK tag=JQH0GUTCMEXA type=del 2024-06-04T15:59:30.938 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.937+0000 7f5e9aacc780 1 > prepared operation key=FBV2MAG130M6 tag=22SGOCJMWODP type=del size=3181366 2024-06-04T15:59:30.940 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.940+0000 7f5e9aacc780 1 < suggested update operation key=K01DAK0M4I4M tag=PE8BJSEHHCQK type=del size=3674831 2024-06-04T15:59:30.941 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.941+0000 7f5e9aacc780 1 > prepared operation key=RP8K6QJUZAH1 tag=WETUEDZBYEXM type=del size=3088601 2024-06-04T15:59:30.944 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.944+0000 7f5e9aacc780 1 < suggested update operation key=QJA2JPATITNH tag=L5IG4TZ3NM2J type=del size=3364599 2024-06-04T15:59:30.947 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.946+0000 7f5e9aacc780 1 > prepared part key=_multipart_7S9S3MIG7WIT.2~G31JB09CI06O.0 size=1048576 2024-06-04T15:59:30.948 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.947+0000 7f5e9aacc780 1 > prepared part key=_multipart_7S9S3MIG7WIT.2~G31JB09CI06O.1 size=109897 2024-06-04T15:59:30.948 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.947+0000 7f5e9aacc780 1 > prepared multipart upload key=7S9S3MIG7WIT upload=G31JB09CI06O tag=V3WXQ06OTJPY type=write size=2207049 2024-06-04T15:59:30.949 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.949+0000 7f5e9aacc780 1 < completed delete operation key=FBV2MAG130M6 tag=2HKBVBE7PWHE type=del 2024-06-04T15:59:30.951 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.951+0000 7f5e9aacc780 1 > prepared operation key=4W5HB9WQQHR6 tag=5QYP63SXK41Z type=del size=3890407 2024-06-04T15:59:30.953 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.952+0000 7f5e9aacc780 1 < completed part key=_multipart_03ZNYG3WLMP4.2~T2EIL2ZY3QCZ.0 size=1048576 2024-06-04T15:59:30.953 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.953+0000 7f5e9aacc780 1 < completed part key=_multipart_03ZNYG3WLMP4.2~T2EIL2ZY3QCZ.1 size=553509 2024-06-04T15:59:30.956 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.956+0000 7f5e9aacc780 1 < completed multipart upload key=03ZNYG3WLMP4 upload=T2EIL2ZY3QCZ tag=A11OO8YWMR6L type=write size=2650661 2024-06-04T15:59:30.957 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.957+0000 7f5e9aacc780 1 > prepared operation key=UTZHANL9ER2Q tag=EJF1XM12T0PW type=write size=485988 2024-06-04T15:59:30.959 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.958+0000 7f5e9aacc780 1 < completed part key=_multipart_W1T4O3EAE7JN.2~9BP1HRBDHIJQ.0 size=1048576 2024-06-04T15:59:30.960 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.960+0000 7f5e9aacc780 1 < completed part key=_multipart_W1T4O3EAE7JN.2~9BP1HRBDHIJQ.1 size=1048576 2024-06-04T15:59:30.961 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.961+0000 7f5e9aacc780 1 < completed part key=_multipart_W1T4O3EAE7JN.2~9BP1HRBDHIJQ.2 size=547390 2024-06-04T15:59:30.963 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.963+0000 7f5e9aacc780 1 < completed multipart upload key=W1T4O3EAE7JN upload=9BP1HRBDHIJQ tag=NWIXF27IZDIG type=write size=3693118 2024-06-04T15:59:30.966 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.965+0000 7f5e9aacc780 1 > prepared part key=_multipart_NJ5U8JTT32QK.2~MLGX003WTI5G.0 size=730816 2024-06-04T15:59:30.966 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.965+0000 7f5e9aacc780 1 > prepared multipart upload key=NJ5U8JTT32QK upload=MLGX003WTI5G tag=S8PU78VPHDFQ type=write size=1779392 2024-06-04T15:59:30.969 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.968+0000 7f5e9aacc780 1 < suggested remove operation key=QUIVPH3OB6KN tag=R3T6EKSWRTCW type=del 2024-06-04T15:59:30.971 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.972+0000 7f5e9aacc780 1 > prepared part key=_multipart_AOCB36Y5Q7B0.2~E251JUT3F0N7.0 size=1003554 2024-06-04T15:59:30.972 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.972+0000 7f5e9aacc780 1 > prepared multipart upload key=AOCB36Y5Q7B0 upload=E251JUT3F0N7 tag=5JMQT2HZGTSG type=write size=2052130 2024-06-04T15:59:30.973 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.973+0000 7f5e9aacc780 1 < canceled operation key=4W5HB9WQQHR6 tag=SNL4D64TRWM8 type=del size=385368 2024-06-04T15:59:30.974 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.975+0000 7f5e9aacc780 1 > prepared operation key=03ZNYG3WLMP4 tag=PFZGG5B8I9OI type=del size=1086617 2024-06-04T15:59:30.976 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.976+0000 7f5e9aacc780 -1 < failed to complete operation key=QUIVPH3OB6KN tag=KWSJOULRZMW0 type=del size=2272359: (22) Invalid argument 2024-06-04T15:59:30.978 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.977+0000 7f5e9aacc780 1 > prepared operation key=9MPRI6LW3956 tag=46P8CUAUQATA type=del size=1265687 2024-06-04T15:59:30.979 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.979+0000 7f5e9aacc780 1 < completed delete operation key=NJ5U8JTT32QK tag=CO0I7RF9UE3W type=del 2024-06-04T15:59:30.982 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.982+0000 7f5e9aacc780 1 > prepared part key=_multipart_FBV2MAG130M6.2~5ABUIFCCO50J.0 size=1048576 2024-06-04T15:59:30.983 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.983+0000 7f5e9aacc780 1 > prepared part key=_multipart_FBV2MAG130M6.2~5ABUIFCCO50J.1 size=1048576 2024-06-04T15:59:30.984 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.984+0000 7f5e9aacc780 1 > prepared part key=_multipart_FBV2MAG130M6.2~5ABUIFCCO50J.2 size=35073 2024-06-04T15:59:30.984 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.984+0000 7f5e9aacc780 1 > prepared multipart upload key=FBV2MAG130M6 upload=5ABUIFCCO50J tag=IRZXJD1NHOP9 type=write size=3180801 2024-06-04T15:59:30.986 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.986+0000 7f5e9aacc780 1 < completed write operation key=B0HK5FJ2RGJE tag=ZDFXDAW31ZEA type=write size=173179 2024-06-04T15:59:30.988 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.988+0000 7f5e9aacc780 1 > prepared operation key=QUIVPH3OB6KN tag=4GJGPYV5II0T type=del size=880132 2024-06-04T15:59:30.990 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.989+0000 7f5e9aacc780 1 < completed part key=_multipart_RP8K6QJUZAH1.2~YLOANUU0NDY6.0 size=1048576 2024-06-04T15:59:30.991 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.991+0000 7f5e9aacc780 1 < completed part key=_multipart_RP8K6QJUZAH1.2~YLOANUU0NDY6.1 size=1048576 2024-06-04T15:59:30.991 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.991+0000 7f5e9aacc780 1 < canceled part key=_multipart_RP8K6QJUZAH1.2~YLOANUU0NDY6.2 size=80817 2024-06-04T15:59:30.993 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.993+0000 7f5e9aacc780 1 < canceled multipart upload key=RP8K6QJUZAH1 upload=YLOANUU0NDY6 tag=YHUBFNGILS7H type=write size=3226545 2024-06-04T15:59:30.995 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.995+0000 7f5e9aacc780 1 > prepared operation key=4W5HB9WQQHR6 tag=GDONDDPROTH1 type=del size=735485 2024-06-04T15:59:30.996 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.996+0000 7f5e9aacc780 1 < completed delete operation key=NJ5U8JTT32QK tag=2N5Q6TLP9GWZ type=del 2024-06-04T15:59:30.998 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:30.998+0000 7f5e9aacc780 1 > prepared operation key=NJ5U8JTT32QK tag=4ITY0RZP4TOX type=del size=3726475 2024-06-04T15:59:31.001 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.001+0000 7f5e9aacc780 1 < suggested update operation key=7S9S3MIG7WIT tag=DPBZO8EQ49SY type=del size=3653437 2024-06-04T15:59:31.003 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.002+0000 7f5e9aacc780 1 > prepared operation key=1IKNQXU3Y2JJ tag=0C2CVDSVDH4M type=del size=2405771 2024-06-04T15:59:31.004 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.004+0000 7f5e9aacc780 1 < completed part key=_multipart_1IKNQXU3Y2JJ.2~Q9D3NIH7YU6R.0 size=567253 2024-06-04T15:59:31.006 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.006+0000 7f5e9aacc780 1 < completed multipart upload key=1IKNQXU3Y2JJ upload=Q9D3NIH7YU6R tag=NIXZWQBO4E87 type=write size=1615829 2024-06-04T15:59:31.008 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.008+0000 7f5e9aacc780 1 > prepared part key=_multipart_W1T4O3EAE7JN.2~YQZL3KN3TMSC.0 size=1048576 2024-06-04T15:59:31.009 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.009+0000 7f5e9aacc780 1 > prepared part key=_multipart_W1T4O3EAE7JN.2~YQZL3KN3TMSC.1 size=44238 2024-06-04T15:59:31.009 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.009+0000 7f5e9aacc780 1 > prepared multipart upload key=W1T4O3EAE7JN upload=YQZL3KN3TMSC tag=FKXOGQ6WOEL0 type=write size=2141390 2024-06-04T15:59:31.010 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.009+0000 7f5e9aacc780 1 < canceled part key=_multipart_UTZHANL9ER2Q.2~C3JLFMMHTPNT.0 size=1048576 2024-06-04T15:59:31.011 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.010+0000 7f5e9aacc780 1 < completed part key=_multipart_UTZHANL9ER2Q.2~C3JLFMMHTPNT.1 size=344731 2024-06-04T15:59:31.013 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.013+0000 7f5e9aacc780 1 < canceled multipart upload key=UTZHANL9ER2Q upload=C3JLFMMHTPNT tag=GAKD51BITTXN type=write size=2441883 2024-06-04T15:59:31.017 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.017+0000 7f5e9aacc780 1 > prepared part key=_multipart_FBV2MAG130M6.2~QU0MNCB7XPO9.0 size=723973 2024-06-04T15:59:31.017 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.017+0000 7f5e9aacc780 1 > prepared multipart upload key=FBV2MAG130M6 upload=QU0MNCB7XPO9 tag=DLJVTPOYOIGY type=write size=1772549 2024-06-04T15:59:31.018 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.018+0000 7f5e9aacc780 1 < completed delete operation key=FBV2MAG130M6 tag=22SGOCJMWODP type=del 2024-06-04T15:59:31.021 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.021+0000 7f5e9aacc780 1 > prepared part key=_multipart_7S9S3MIG7WIT.2~QV8BS1G9H97U.0 size=1048576 2024-06-04T15:59:31.022 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.022+0000 7f5e9aacc780 1 > prepared part key=_multipart_7S9S3MIG7WIT.2~QV8BS1G9H97U.1 size=1048576 2024-06-04T15:59:31.023 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.023+0000 7f5e9aacc780 1 > prepared part key=_multipart_7S9S3MIG7WIT.2~QV8BS1G9H97U.2 size=488591 2024-06-04T15:59:31.023 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.023+0000 7f5e9aacc780 1 > prepared multipart upload key=7S9S3MIG7WIT upload=QV8BS1G9H97U tag=CU8BVSNK6SST type=write size=3634319 2024-06-04T15:59:31.024 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.024+0000 7f5e9aacc780 1 < completed delete operation key=RP8K6QJUZAH1 tag=WETUEDZBYEXM type=del 2024-06-04T15:59:31.026 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.025+0000 7f5e9aacc780 1 > prepared operation key=Q4OFQI0F5YLG tag=4PMZ76XCO7PK type=del size=455580 2024-06-04T15:59:31.027 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.027+0000 7f5e9aacc780 1 < completed part key=_multipart_7S9S3MIG7WIT.2~G31JB09CI06O.0 size=1048576 2024-06-04T15:59:31.028 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.028+0000 7f5e9aacc780 1 < completed part key=_multipart_7S9S3MIG7WIT.2~G31JB09CI06O.1 size=109897 2024-06-04T15:59:31.030 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.030+0000 7f5e9aacc780 1 < completed multipart upload key=7S9S3MIG7WIT upload=G31JB09CI06O tag=V3WXQ06OTJPY type=write size=2207049 2024-06-04T15:59:31.032 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.032+0000 7f5e9aacc780 1 > prepared operation key=K01DAK0M4I4M tag=WB1VHR7NOUAH type=del size=3946111 2024-06-04T15:59:31.033 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.033+0000 7f5e9aacc780 1 < completed delete operation key=4W5HB9WQQHR6 tag=5QYP63SXK41Z type=del 2024-06-04T15:59:31.036 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.036+0000 7f5e9aacc780 1 > prepared part key=_multipart_FBV2MAG130M6.2~RSJVKPM6GVIA.0 size=1048576 2024-06-04T15:59:31.037 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.037+0000 7f5e9aacc780 1 > prepared part key=_multipart_FBV2MAG130M6.2~RSJVKPM6GVIA.1 size=1048576 2024-06-04T15:59:31.038 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.038+0000 7f5e9aacc780 1 > prepared part key=_multipart_FBV2MAG130M6.2~RSJVKPM6GVIA.2 size=789805 2024-06-04T15:59:31.038 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.038+0000 7f5e9aacc780 1 > prepared multipart upload key=FBV2MAG130M6 upload=RSJVKPM6GVIA tag=RFQ1YX73AREX type=write size=3935533 2024-06-04T15:59:31.041 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.040+0000 7f5e9aacc780 1 < suggested remove operation key=UTZHANL9ER2Q tag=EJF1XM12T0PW type=write 2024-06-04T15:59:31.042 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.042+0000 7f5e9aacc780 1 > prepared operation key=4W5HB9WQQHR6 tag=TP3T1CQXM8C7 type=write size=1022887 2024-06-04T15:59:31.044 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.044+0000 7f5e9aacc780 1 < completed part key=_multipart_NJ5U8JTT32QK.2~MLGX003WTI5G.0 size=730816 2024-06-04T15:59:31.046 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.046+0000 7f5e9aacc780 1 < completed multipart upload key=NJ5U8JTT32QK upload=MLGX003WTI5G tag=S8PU78VPHDFQ type=write size=1779392 2024-06-04T15:59:31.048 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.048+0000 7f5e9aacc780 1 > prepared operation key=Q4OFQI0F5YLG tag=A9YSIAY3WZLR type=del size=2839983 2024-06-04T15:59:31.050 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.050+0000 7f5e9aacc780 1 < completed part key=_multipart_AOCB36Y5Q7B0.2~E251JUT3F0N7.0 size=1003554 2024-06-04T15:59:31.052 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.052+0000 7f5e9aacc780 1 < completed multipart upload key=AOCB36Y5Q7B0 upload=E251JUT3F0N7 tag=5JMQT2HZGTSG type=write size=2052130 2024-06-04T15:59:31.054 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.055+0000 7f5e9aacc780 1 > prepared part key=_multipart_GCPC9OJH7KWU.2~DGCQ8KVBPB4P.0 size=218400 2024-06-04T15:59:31.055 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.055+0000 7f5e9aacc780 1 > prepared multipart upload key=GCPC9OJH7KWU upload=DGCQ8KVBPB4P tag=1HWILQF3ZDMH type=write size=1266976 2024-06-04T15:59:31.057 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.057+0000 7f5e9aacc780 1 < completed delete operation key=03ZNYG3WLMP4 tag=PFZGG5B8I9OI type=del 2024-06-04T15:59:31.059 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.058+0000 7f5e9aacc780 1 > prepared operation key=PNDPO2WUW7UX tag=UPLHRVEV3QB1 type=del size=3431206 2024-06-04T15:59:31.060 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.060+0000 7f5e9aacc780 1 < completed delete operation key=9MPRI6LW3956 tag=46P8CUAUQATA type=del 2024-06-04T15:59:31.062 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.062+0000 7f5e9aacc780 1 > prepared operation key=UTZHANL9ER2Q tag=YQI3ANFKM3GU type=write size=648154 2024-06-04T15:59:31.064 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.063+0000 7f5e9aacc780 1 < completed part key=_multipart_FBV2MAG130M6.2~5ABUIFCCO50J.0 size=1048576 2024-06-04T15:59:31.065 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.065+0000 7f5e9aacc780 1 < completed part key=_multipart_FBV2MAG130M6.2~5ABUIFCCO50J.1 size=1048576 2024-06-04T15:59:31.066 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.066+0000 7f5e9aacc780 1 < completed part key=_multipart_FBV2MAG130M6.2~5ABUIFCCO50J.2 size=35073 2024-06-04T15:59:31.068 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.069+0000 7f5e9aacc780 1 < completed multipart upload key=FBV2MAG130M6 upload=5ABUIFCCO50J tag=IRZXJD1NHOP9 type=write size=3180801 2024-06-04T15:59:31.070 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.070+0000 7f5e9aacc780 1 > prepared operation key=PNDPO2WUW7UX tag=ZAE7UCOMTEJV type=del size=1251760 2024-06-04T15:59:31.073 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.073+0000 7f5e9aacc780 1 < suggested update operation key=QUIVPH3OB6KN tag=4GJGPYV5II0T type=del size=880132 2024-06-04T15:59:31.075 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.076+0000 7f5e9aacc780 1 > prepared part key=_multipart_Q4OFQI0F5YLG.2~1YSGNDCEOE0W.0 size=1048576 2024-06-04T15:59:31.077 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.076+0000 7f5e9aacc780 1 > prepared part key=_multipart_Q4OFQI0F5YLG.2~1YSGNDCEOE0W.1 size=1048576 2024-06-04T15:59:31.078 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.077+0000 7f5e9aacc780 1 > prepared part key=_multipart_Q4OFQI0F5YLG.2~1YSGNDCEOE0W.2 size=622950 2024-06-04T15:59:31.078 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.077+0000 7f5e9aacc780 1 > prepared multipart upload key=Q4OFQI0F5YLG upload=1YSGNDCEOE0W tag=MUYTK8SJ3BOI type=write size=3768678 2024-06-04T15:59:31.079 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.079+0000 7f5e9aacc780 1 < completed delete operation key=4W5HB9WQQHR6 tag=GDONDDPROTH1 type=del 2024-06-04T15:59:31.082 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.082+0000 7f5e9aacc780 1 > prepared part key=_multipart_TUGKW7F4V9NO.2~KBGTH4SCXX3P.0 size=1048576 2024-06-04T15:59:31.083 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.083+0000 7f5e9aacc780 1 > prepared part key=_multipart_TUGKW7F4V9NO.2~KBGTH4SCXX3P.1 size=875181 2024-06-04T15:59:31.083 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.083+0000 7f5e9aacc780 1 > prepared multipart upload key=TUGKW7F4V9NO upload=KBGTH4SCXX3P tag=G245ZWTAHN9A type=write size=2972333 2024-06-04T15:59:31.086 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.086+0000 7f5e9aacc780 1 < suggested update operation key=NJ5U8JTT32QK tag=4ITY0RZP4TOX type=del size=3726475 2024-06-04T15:59:31.088 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.088+0000 7f5e9aacc780 1 > prepared part key=_multipart_NJ5U8JTT32QK.2~OX6HZWYH0OOC.0 size=1048576 2024-06-04T15:59:31.089 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.089+0000 7f5e9aacc780 1 > prepared part key=_multipart_NJ5U8JTT32QK.2~OX6HZWYH0OOC.1 size=1048576 2024-06-04T15:59:31.090 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.090+0000 7f5e9aacc780 1 > prepared part key=_multipart_NJ5U8JTT32QK.2~OX6HZWYH0OOC.2 size=318 2024-06-04T15:59:31.091 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.090+0000 7f5e9aacc780 1 > prepared multipart upload key=NJ5U8JTT32QK upload=OX6HZWYH0OOC tag=XJT057IAVM9M type=write size=3146046 2024-06-04T15:59:31.092 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.091+0000 7f5e9aacc780 1 < completed delete operation key=1IKNQXU3Y2JJ tag=0C2CVDSVDH4M type=del 2024-06-04T15:59:31.093 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.093+0000 7f5e9aacc780 1 > prepared operation key=GCPC9OJH7KWU tag=Y3TX9IAJPOCD type=del size=3956943 2024-06-04T15:59:31.095 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.094+0000 7f5e9aacc780 1 < completed part key=_multipart_W1T4O3EAE7JN.2~YQZL3KN3TMSC.0 size=1048576 2024-06-04T15:59:31.095 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.094+0000 7f5e9aacc780 1 < canceled part key=_multipart_W1T4O3EAE7JN.2~YQZL3KN3TMSC.1 size=44238 2024-06-04T15:59:31.097 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.097+0000 7f5e9aacc780 1 < canceled multipart upload key=W1T4O3EAE7JN upload=YQZL3KN3TMSC tag=FKXOGQ6WOEL0 type=write size=2141390 2024-06-04T15:59:31.099 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.100+0000 7f5e9aacc780 1 > prepared part key=_multipart_AOCB36Y5Q7B0.2~T56W71HKQOC0.0 size=1048576 2024-06-04T15:59:31.101 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.101+0000 7f5e9aacc780 1 > prepared part key=_multipart_AOCB36Y5Q7B0.2~T56W71HKQOC0.1 size=1048576 2024-06-04T15:59:31.102 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.101+0000 7f5e9aacc780 1 > prepared part key=_multipart_AOCB36Y5Q7B0.2~T56W71HKQOC0.2 size=728235 2024-06-04T15:59:31.102 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.102+0000 7f5e9aacc780 1 > prepared multipart upload key=AOCB36Y5Q7B0 upload=T56W71HKQOC0 tag=SK8CDRKXFZZ8 type=write size=3873963 2024-06-04T15:59:31.102 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.102+0000 7f5e9aacc780 1 < canceled part key=_multipart_FBV2MAG130M6.2~QU0MNCB7XPO9.0 size=723973 2024-06-04T15:59:31.104 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.104+0000 7f5e9aacc780 1 < canceled multipart upload key=FBV2MAG130M6 upload=QU0MNCB7XPO9 tag=DLJVTPOYOIGY type=write size=1772549 2024-06-04T15:59:31.107 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.107+0000 7f5e9aacc780 1 > prepared part key=_multipart_NJ5U8JTT32QK.2~11FU9YFT8DF8.0 size=415766 2024-06-04T15:59:31.107 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.107+0000 7f5e9aacc780 1 > prepared multipart upload key=NJ5U8JTT32QK upload=11FU9YFT8DF8 tag=AG3N0HC0PXS9 type=write size=1464342 2024-06-04T15:59:31.108 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.108+0000 7f5e9aacc780 1 < completed part key=_multipart_7S9S3MIG7WIT.2~QV8BS1G9H97U.0 size=1048576 2024-06-04T15:59:31.109 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.109+0000 7f5e9aacc780 1 < completed part key=_multipart_7S9S3MIG7WIT.2~QV8BS1G9H97U.1 size=1048576 2024-06-04T15:59:31.111 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.110+0000 7f5e9aacc780 1 < completed part key=_multipart_7S9S3MIG7WIT.2~QV8BS1G9H97U.2 size=488591 2024-06-04T15:59:31.113 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.113+0000 7f5e9aacc780 1 < completed multipart upload key=7S9S3MIG7WIT upload=QV8BS1G9H97U tag=CU8BVSNK6SST type=write size=3634319 2024-06-04T15:59:31.114 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.114+0000 7f5e9aacc780 1 > prepared operation key=FBV2MAG130M6 tag=5NB1UQ07BMIB type=del size=1720578 2024-06-04T15:59:31.116 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.116+0000 7f5e9aacc780 1 < canceled operation key=Q4OFQI0F5YLG tag=4PMZ76XCO7PK type=del size=455580 2024-06-04T15:59:31.119 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.119+0000 7f5e9aacc780 1 > prepared part key=_multipart_03ZNYG3WLMP4.2~WRGKR4GIDG9Y.0 size=1048576 2024-06-04T15:59:31.120 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.120+0000 7f5e9aacc780 1 > prepared part key=_multipart_03ZNYG3WLMP4.2~WRGKR4GIDG9Y.1 size=65969 2024-06-04T15:59:31.120 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.120+0000 7f5e9aacc780 1 > prepared multipart upload key=03ZNYG3WLMP4 upload=WRGKR4GIDG9Y tag=NEPULMR7IGOS type=write size=2163121 2024-06-04T15:59:31.121 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.121+0000 7f5e9aacc780 1 < completed delete operation key=K01DAK0M4I4M tag=WB1VHR7NOUAH type=del 2024-06-04T15:59:31.124 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.124+0000 7f5e9aacc780 1 > prepared part key=_multipart_2BT2AXKB1RTA.2~5C0DGC4WR1EW.0 size=1048576 2024-06-04T15:59:31.125 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.125+0000 7f5e9aacc780 1 > prepared part key=_multipart_2BT2AXKB1RTA.2~5C0DGC4WR1EW.1 size=301817 2024-06-04T15:59:31.125 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.125+0000 7f5e9aacc780 1 > prepared multipart upload key=2BT2AXKB1RTA upload=5C0DGC4WR1EW tag=QB4MZZRW9CVA type=write size=2398969 2024-06-04T15:59:31.127 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.127+0000 7f5e9aacc780 1 < completed part key=_multipart_FBV2MAG130M6.2~RSJVKPM6GVIA.0 size=1048576 2024-06-04T15:59:31.127 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.127+0000 7f5e9aacc780 1 < canceled part key=_multipart_FBV2MAG130M6.2~RSJVKPM6GVIA.1 size=1048576 2024-06-04T15:59:31.128 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.128+0000 7f5e9aacc780 1 < completed part key=_multipart_FBV2MAG130M6.2~RSJVKPM6GVIA.2 size=789805 2024-06-04T15:59:31.131 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.130+0000 7f5e9aacc780 1 < canceled multipart upload key=FBV2MAG130M6 upload=RSJVKPM6GVIA tag=RFQ1YX73AREX type=write size=3935533 2024-06-04T15:59:31.132 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.132+0000 7f5e9aacc780 1 > prepared operation key=4W5HB9WQQHR6 tag=N1BJQYSNCRR6 type=del size=211000 2024-06-04T15:59:31.133 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.133+0000 7f5e9aacc780 1 < completed write operation key=4W5HB9WQQHR6 tag=TP3T1CQXM8C7 type=write size=1022887 2024-06-04T15:59:31.135 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.135+0000 7f5e9aacc780 1 > prepared operation key=UW5LVIBG09SV tag=H85IZ93LYQ9S type=del size=1839902 2024-06-04T15:59:31.137 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.137+0000 7f5e9aacc780 1 < suggested remove operation key=Q4OFQI0F5YLG tag=A9YSIAY3WZLR type=del 2024-06-04T15:59:31.139 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.139+0000 7f5e9aacc780 1 > prepared operation key=RP8K6QJUZAH1 tag=6AFZQU7QTSQG type=del size=2302332 2024-06-04T15:59:31.141 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.140+0000 7f5e9aacc780 1 < completed part key=_multipart_GCPC9OJH7KWU.2~DGCQ8KVBPB4P.0 size=218400 2024-06-04T15:59:31.143 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.142+0000 7f5e9aacc780 1 < completed multipart upload key=GCPC9OJH7KWU upload=DGCQ8KVBPB4P tag=1HWILQF3ZDMH type=write size=1266976 2024-06-04T15:59:31.144 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.144+0000 7f5e9aacc780 1 > prepared operation key=B0HK5FJ2RGJE tag=J3O8G0QL2L14 type=del size=1886608 2024-06-04T15:59:31.145 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.145+0000 7f5e9aacc780 1 < canceled operation key=PNDPO2WUW7UX tag=UPLHRVEV3QB1 type=del size=3431206 2024-06-04T15:59:31.147 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.146+0000 7f5e9aacc780 1 > prepared operation key=PASGIP872OVX tag=AJYNJEHW2YMM type=del size=2959319 2024-06-04T15:59:31.150 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.150+0000 7f5e9aacc780 1 < suggested update operation key=UTZHANL9ER2Q tag=YQI3ANFKM3GU type=write size=648154 2024-06-04T15:59:31.153 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.153+0000 7f5e9aacc780 1 > prepared part key=_multipart_JL69PUHT6NNT.2~1BNECNN7V969.0 size=1048576 2024-06-04T15:59:31.154 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.154+0000 7f5e9aacc780 1 > prepared part key=_multipart_JL69PUHT6NNT.2~1BNECNN7V969.1 size=1043260 2024-06-04T15:59:31.154 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.154+0000 7f5e9aacc780 1 > prepared multipart upload key=JL69PUHT6NNT upload=1BNECNN7V969 tag=BYI3RDSTGXJ9 type=write size=3140412 2024-06-04T15:59:31.156 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.155+0000 7f5e9aacc780 1 < completed delete operation key=PNDPO2WUW7UX tag=ZAE7UCOMTEJV type=del 2024-06-04T15:59:31.158 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.158+0000 7f5e9aacc780 1 > prepared part key=_multipart_Q4OFQI0F5YLG.2~L45OI0C7KGTC.0 size=1048576 2024-06-04T15:59:31.161 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.159+0000 7f5e9aacc780 1 > prepared part key=_multipart_Q4OFQI0F5YLG.2~L45OI0C7KGTC.1 size=470524 2024-06-04T15:59:31.161 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.159+0000 7f5e9aacc780 1 > prepared multipart upload key=Q4OFQI0F5YLG upload=L45OI0C7KGTC tag=R9K9LV8UFBY0 type=write size=2567676 2024-06-04T15:59:31.161 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.160+0000 7f5e9aacc780 1 < completed part key=_multipart_Q4OFQI0F5YLG.2~1YSGNDCEOE0W.0 size=1048576 2024-06-04T15:59:31.161 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.160+0000 7f5e9aacc780 1 < canceled part key=_multipart_Q4OFQI0F5YLG.2~1YSGNDCEOE0W.1 size=1048576 2024-06-04T15:59:31.162 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.161+0000 7f5e9aacc780 1 < completed part key=_multipart_Q4OFQI0F5YLG.2~1YSGNDCEOE0W.2 size=622950 2024-06-04T15:59:31.164 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.164+0000 7f5e9aacc780 1 < canceled multipart upload key=Q4OFQI0F5YLG upload=1YSGNDCEOE0W tag=MUYTK8SJ3BOI type=write size=3768678 2024-06-04T15:59:31.166 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.165+0000 7f5e9aacc780 1 > prepared operation key=DY9JWHWNAUO1 tag=9KWC54TNHB2W type=del size=2562671 2024-06-04T15:59:31.167 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.167+0000 7f5e9aacc780 1 < completed part key=_multipart_TUGKW7F4V9NO.2~KBGTH4SCXX3P.0 size=1048576 2024-06-04T15:59:31.168 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.168+0000 7f5e9aacc780 1 < completed part key=_multipart_TUGKW7F4V9NO.2~KBGTH4SCXX3P.1 size=875181 2024-06-04T15:59:31.170 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.170+0000 7f5e9aacc780 1 < completed multipart upload key=TUGKW7F4V9NO upload=KBGTH4SCXX3P tag=G245ZWTAHN9A type=write size=2972333 2024-06-04T15:59:31.172 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.171+0000 7f5e9aacc780 1 > prepared operation key=W1T4O3EAE7JN tag=SGNQ20HVK0LB type=write size=1011970 2024-06-04T15:59:31.173 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.173+0000 7f5e9aacc780 1 < completed part key=_multipart_NJ5U8JTT32QK.2~OX6HZWYH0OOC.0 size=1048576 2024-06-04T15:59:31.174 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.174+0000 7f5e9aacc780 1 < completed part key=_multipart_NJ5U8JTT32QK.2~OX6HZWYH0OOC.1 size=1048576 2024-06-04T15:59:31.175 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.175+0000 7f5e9aacc780 1 < completed part key=_multipart_NJ5U8JTT32QK.2~OX6HZWYH0OOC.2 size=318 2024-06-04T15:59:31.177 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.177+0000 7f5e9aacc780 1 < completed multipart upload key=NJ5U8JTT32QK upload=OX6HZWYH0OOC tag=XJT057IAVM9M type=write size=3146046 2024-06-04T15:59:31.180 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.180+0000 7f5e9aacc780 1 > prepared part key=_multipart_QUIVPH3OB6KN.2~NJYNXTWQ82VP.0 size=497578 2024-06-04T15:59:31.181 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.180+0000 7f5e9aacc780 1 > prepared multipart upload key=QUIVPH3OB6KN upload=NJYNXTWQ82VP tag=TIXH333XZO8T type=write size=1546154 2024-06-04T15:59:31.182 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.182+0000 7f5e9aacc780 1 < completed delete operation key=GCPC9OJH7KWU tag=Y3TX9IAJPOCD type=del 2024-06-04T15:59:31.183 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.183+0000 7f5e9aacc780 1 > prepared operation key=XH0N984YVGKP tag=VFMLT0F8XF6B type=del size=3590421 2024-06-04T15:59:31.183 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.183+0000 7f5e9aacc780 1 < canceled part key=_multipart_AOCB36Y5Q7B0.2~T56W71HKQOC0.0 size=1048576 2024-06-04T15:59:31.184 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.184+0000 7f5e9aacc780 1 < completed part key=_multipart_AOCB36Y5Q7B0.2~T56W71HKQOC0.1 size=1048576 2024-06-04T15:59:31.186 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.185+0000 7f5e9aacc780 1 < completed part key=_multipart_AOCB36Y5Q7B0.2~T56W71HKQOC0.2 size=728235 2024-06-04T15:59:31.188 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.188+0000 7f5e9aacc780 1 < canceled multipart upload key=AOCB36Y5Q7B0 upload=T56W71HKQOC0 tag=SK8CDRKXFZZ8 type=write size=3873963 2024-06-04T15:59:31.191 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.191+0000 7f5e9aacc780 1 > prepared part key=_multipart_7S9S3MIG7WIT.2~ST5A2OLGXO1A.0 size=1048576 2024-06-04T15:59:31.192 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.191+0000 7f5e9aacc780 1 > prepared part key=_multipart_7S9S3MIG7WIT.2~ST5A2OLGXO1A.1 size=1048576 2024-06-04T15:59:31.193 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.193+0000 7f5e9aacc780 1 > prepared part key=_multipart_7S9S3MIG7WIT.2~ST5A2OLGXO1A.2 size=731979 2024-06-04T15:59:31.193 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.193+0000 7f5e9aacc780 1 > prepared multipart upload key=7S9S3MIG7WIT upload=ST5A2OLGXO1A tag=VY6T5SNA9595 type=write size=3877707 2024-06-04T15:59:31.193 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.193+0000 7f5e9aacc780 1 < canceled part key=_multipart_NJ5U8JTT32QK.2~11FU9YFT8DF8.0 size=415766 2024-06-04T15:59:31.196 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.195+0000 7f5e9aacc780 1 < canceled multipart upload key=NJ5U8JTT32QK upload=11FU9YFT8DF8 tag=AG3N0HC0PXS9 type=write size=1464342 2024-06-04T15:59:31.197 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.197+0000 7f5e9aacc780 1 > prepared operation key=A8O0S3S45RGM tag=DH0F2EB247UB type=write size=249429 2024-06-04T15:59:31.198 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.198+0000 7f5e9aacc780 1 < completed delete operation key=FBV2MAG130M6 tag=5NB1UQ07BMIB type=del 2024-06-04T15:59:31.200 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.200+0000 7f5e9aacc780 1 > prepared operation key=UTZHANL9ER2Q tag=EPYHYHOAP7LE type=del size=1497923 2024-06-04T15:59:31.202 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.202+0000 7f5e9aacc780 1 < completed part key=_multipart_03ZNYG3WLMP4.2~WRGKR4GIDG9Y.0 size=1048576 2024-06-04T15:59:31.203 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.203+0000 7f5e9aacc780 1 < completed part key=_multipart_03ZNYG3WLMP4.2~WRGKR4GIDG9Y.1 size=65969 2024-06-04T15:59:31.206 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.206+0000 7f5e9aacc780 1 < completed multipart upload key=03ZNYG3WLMP4 upload=WRGKR4GIDG9Y tag=NEPULMR7IGOS type=write size=2163121 2024-06-04T15:59:31.208 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.207+0000 7f5e9aacc780 1 > prepared operation key=SUBHZJ7HUV3H tag=A2JIYOTX9LD5 type=del size=4072236 2024-06-04T15:59:31.209 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.209+0000 7f5e9aacc780 1 < completed part key=_multipart_2BT2AXKB1RTA.2~5C0DGC4WR1EW.0 size=1048576 2024-06-04T15:59:31.210 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.210+0000 7f5e9aacc780 1 < completed part key=_multipart_2BT2AXKB1RTA.2~5C0DGC4WR1EW.1 size=301817 2024-06-04T15:59:31.213 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.213+0000 7f5e9aacc780 1 < completed multipart upload key=2BT2AXKB1RTA upload=5C0DGC4WR1EW tag=QB4MZZRW9CVA type=write size=2398969 2024-06-04T15:59:31.214 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.214+0000 7f5e9aacc780 1 > prepared operation key=7S9S3MIG7WIT tag=GWD4W9GSXM0Y type=del size=1821947 2024-06-04T15:59:31.216 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.216+0000 7f5e9aacc780 1 < completed delete operation key=4W5HB9WQQHR6 tag=N1BJQYSNCRR6 type=del 2024-06-04T15:59:31.217 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.217+0000 7f5e9aacc780 1 > prepared operation key=GTRMEQJK675Z tag=DUPWGC2805CO type=del size=2562654 2024-06-04T15:59:31.219 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.218+0000 7f5e9aacc780 1 < completed delete operation key=UW5LVIBG09SV tag=H85IZ93LYQ9S type=del 2024-06-04T15:59:31.221 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.221+0000 7f5e9aacc780 1 > prepared part key=_multipart_DY9JWHWNAUO1.2~MPPZNZMVL0TI.0 size=47899 2024-06-04T15:59:31.221 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.221+0000 7f5e9aacc780 1 > prepared multipart upload key=DY9JWHWNAUO1 upload=MPPZNZMVL0TI tag=E3RE8SJITLKM type=write size=1096475 2024-06-04T15:59:31.224 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.224+0000 7f5e9aacc780 1 < suggested update operation key=RP8K6QJUZAH1 tag=6AFZQU7QTSQG type=del size=2302332 2024-06-04T15:59:31.226 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.225+0000 7f5e9aacc780 1 > prepared operation key=Q4OFQI0F5YLG tag=LS594337W93S type=del size=3387462 2024-06-04T15:59:31.228 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.227+0000 7f5e9aacc780 1 < completed delete operation key=B0HK5FJ2RGJE tag=J3O8G0QL2L14 type=del 2024-06-04T15:59:31.229 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.229+0000 7f5e9aacc780 1 > prepared operation key=7S9S3MIG7WIT tag=APQPUMCXPBCD type=write size=679581 2024-06-04T15:59:31.231 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.231+0000 7f5e9aacc780 1 < completed delete operation key=PASGIP872OVX tag=AJYNJEHW2YMM type=del 2024-06-04T15:59:31.232 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.232+0000 7f5e9aacc780 1 > prepared operation key=UW5LVIBG09SV tag=3YZPR8IQI5RO type=write size=18393 2024-06-04T15:59:31.234 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.233+0000 7f5e9aacc780 1 < completed part key=_multipart_JL69PUHT6NNT.2~1BNECNN7V969.0 size=1048576 2024-06-04T15:59:31.235 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.234+0000 7f5e9aacc780 1 < completed part key=_multipart_JL69PUHT6NNT.2~1BNECNN7V969.1 size=1043260 2024-06-04T15:59:31.237 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.237+0000 7f5e9aacc780 1 < completed multipart upload key=JL69PUHT6NNT upload=1BNECNN7V969 tag=BYI3RDSTGXJ9 type=write size=3140412 2024-06-04T15:59:31.239 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.238+0000 7f5e9aacc780 1 > prepared operation key=K01DAK0M4I4M tag=LBLGSU43G097 type=write size=111254 2024-06-04T15:59:31.240 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.240+0000 7f5e9aacc780 1 < completed part key=_multipart_Q4OFQI0F5YLG.2~L45OI0C7KGTC.0 size=1048576 2024-06-04T15:59:31.242 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.241+0000 7f5e9aacc780 1 < completed part key=_multipart_Q4OFQI0F5YLG.2~L45OI0C7KGTC.1 size=470524 2024-06-04T15:59:31.244 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.244+0000 7f5e9aacc780 1 < completed multipart upload key=Q4OFQI0F5YLG upload=L45OI0C7KGTC tag=R9K9LV8UFBY0 type=write size=2567676 2024-06-04T15:59:31.247 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.247+0000 7f5e9aacc780 1 > prepared part key=_multipart_TUGKW7F4V9NO.2~GU00ACL5ZAVV.0 size=1048576 2024-06-04T15:59:31.248 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.248+0000 7f5e9aacc780 1 > prepared part key=_multipart_TUGKW7F4V9NO.2~GU00ACL5ZAVV.1 size=1048576 2024-06-04T15:59:31.249 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.249+0000 7f5e9aacc780 1 > prepared part key=_multipart_TUGKW7F4V9NO.2~GU00ACL5ZAVV.2 size=691241 2024-06-04T15:59:31.249 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.249+0000 7f5e9aacc780 1 > prepared multipart upload key=TUGKW7F4V9NO upload=GU00ACL5ZAVV tag=ORIBXLM6OG1C type=write size=3836969 2024-06-04T15:59:31.251 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.250+0000 7f5e9aacc780 1 < canceled operation key=DY9JWHWNAUO1 tag=9KWC54TNHB2W type=del size=2562671 2024-06-04T15:59:31.252 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.252+0000 7f5e9aacc780 1 > prepared operation key=03ZNYG3WLMP4 tag=NPLYCX9FRLAY type=del size=1259556 2024-06-04T15:59:31.253 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.253+0000 7f5e9aacc780 1 < completed write operation key=W1T4O3EAE7JN tag=SGNQ20HVK0LB type=write size=1011970 2024-06-04T15:59:31.255 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.254+0000 7f5e9aacc780 1 > prepared operation key=HD6SNICRCDLL tag=A5EGQEAYCH3I type=del size=597309 2024-06-04T15:59:31.256 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.256+0000 7f5e9aacc780 1 < completed part key=_multipart_QUIVPH3OB6KN.2~NJYNXTWQ82VP.0 size=497578 2024-06-04T15:59:31.258 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.259+0000 7f5e9aacc780 1 < completed multipart upload key=QUIVPH3OB6KN upload=NJYNXTWQ82VP tag=TIXH333XZO8T type=write size=1546154 2024-06-04T15:59:31.261 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.261+0000 7f5e9aacc780 1 > prepared part key=_multipart_K01DAK0M4I4M.2~NTR97WUR7EC0.0 size=74758 2024-06-04T15:59:31.261 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.261+0000 7f5e9aacc780 1 > prepared multipart upload key=K01DAK0M4I4M upload=NTR97WUR7EC0 tag=KGSHCFZNRPGJ type=write size=1123334 2024-06-04T15:59:31.263 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.263+0000 7f5e9aacc780 1 < completed delete operation key=XH0N984YVGKP tag=VFMLT0F8XF6B type=del 2024-06-04T15:59:31.264 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.264+0000 7f5e9aacc780 1 > prepared operation key=UW5LVIBG09SV tag=BCIWL4P82ZAM type=del size=2947249 2024-06-04T15:59:31.266 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.266+0000 7f5e9aacc780 1 < completed part key=_multipart_7S9S3MIG7WIT.2~ST5A2OLGXO1A.0 size=1048576 2024-06-04T15:59:31.267 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.267+0000 7f5e9aacc780 1 < completed part key=_multipart_7S9S3MIG7WIT.2~ST5A2OLGXO1A.1 size=1048576 2024-06-04T15:59:31.268 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.268+0000 7f5e9aacc780 1 < completed part key=_multipart_7S9S3MIG7WIT.2~ST5A2OLGXO1A.2 size=731979 2024-06-04T15:59:31.270 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.270+0000 7f5e9aacc780 1 < completed multipart upload key=7S9S3MIG7WIT upload=ST5A2OLGXO1A tag=VY6T5SNA9595 type=write size=3877707 2024-06-04T15:59:31.272 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.272+0000 7f5e9aacc780 1 > prepared operation key=HD6SNICRCDLL tag=ZJ99SKD2JGTO type=del size=1878505 2024-06-04T15:59:31.273 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.273+0000 7f5e9aacc780 1 < completed write operation key=A8O0S3S45RGM tag=DH0F2EB247UB type=write size=249429 2024-06-04T15:59:31.276 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.276+0000 7f5e9aacc780 1 > prepared part key=_multipart_B0HK5FJ2RGJE.2~OVEOYJV0VCD1.0 size=1048576 2024-06-04T15:59:31.277 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.277+0000 7f5e9aacc780 1 > prepared part key=_multipart_B0HK5FJ2RGJE.2~OVEOYJV0VCD1.1 size=1048576 2024-06-04T15:59:31.278 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.278+0000 7f5e9aacc780 1 > prepared part key=_multipart_B0HK5FJ2RGJE.2~OVEOYJV0VCD1.2 size=572525 2024-06-04T15:59:31.278 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.278+0000 7f5e9aacc780 1 > prepared multipart upload key=B0HK5FJ2RGJE upload=OVEOYJV0VCD1 tag=I6Y03RLD9REQ type=write size=3718253 2024-06-04T15:59:31.280 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.279+0000 7f5e9aacc780 1 < completed delete operation key=UTZHANL9ER2Q tag=EPYHYHOAP7LE type=del 2024-06-04T15:59:31.282 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.282+0000 7f5e9aacc780 1 > prepared part key=_multipart_UTZHANL9ER2Q.2~H7WU0XKE31JR.0 size=1048576 2024-06-04T15:59:31.284 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.284+0000 7f5e9aacc780 1 > prepared part key=_multipart_UTZHANL9ER2Q.2~H7WU0XKE31JR.1 size=295453 2024-06-04T15:59:31.284 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.284+0000 7f5e9aacc780 1 > prepared multipart upload key=UTZHANL9ER2Q upload=H7WU0XKE31JR tag=2SEQ0I0ZWMOL type=write size=2392605 2024-06-04T15:59:31.286 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.285+0000 7f5e9aacc780 1 < completed delete operation key=SUBHZJ7HUV3H tag=A2JIYOTX9LD5 type=del 2024-06-04T15:59:31.288 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.287+0000 7f5e9aacc780 1 > prepared operation key=TUGKW7F4V9NO tag=MHKIUDFB1KD5 type=write size=576823 2024-06-04T15:59:31.289 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.289+0000 7f5e9aacc780 1 < completed delete operation key=7S9S3MIG7WIT tag=GWD4W9GSXM0Y type=del 2024-06-04T15:59:31.291 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.290+0000 7f5e9aacc780 1 > prepared operation key=4W5HB9WQQHR6 tag=OVUPWHCOI9ZO type=del size=3697372 2024-06-04T15:59:31.292 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.292+0000 7f5e9aacc780 1 < completed delete operation key=GTRMEQJK675Z tag=DUPWGC2805CO type=del 2024-06-04T15:59:31.294 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.294+0000 7f5e9aacc780 1 > prepared operation key=A8O0S3S45RGM tag=RXZ6PRJ280RT type=del size=3595863 2024-06-04T15:59:31.295 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.295+0000 7f5e9aacc780 1 < completed part key=_multipart_DY9JWHWNAUO1.2~MPPZNZMVL0TI.0 size=47899 2024-06-04T15:59:31.298 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.298+0000 7f5e9aacc780 1 < completed multipart upload key=DY9JWHWNAUO1 upload=MPPZNZMVL0TI tag=E3RE8SJITLKM type=write size=1096475 2024-06-04T15:59:31.300 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.300+0000 7f5e9aacc780 1 > prepared part key=_multipart_2BT2AXKB1RTA.2~F7OB2TYGHY1T.0 size=1048576 2024-06-04T15:59:31.302 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.302+0000 7f5e9aacc780 1 > prepared part key=_multipart_2BT2AXKB1RTA.2~F7OB2TYGHY1T.1 size=1048576 2024-06-04T15:59:31.302 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.302+0000 7f5e9aacc780 1 > prepared part key=_multipart_2BT2AXKB1RTA.2~F7OB2TYGHY1T.2 size=669297 2024-06-04T15:59:31.303 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.302+0000 7f5e9aacc780 1 > prepared multipart upload key=2BT2AXKB1RTA upload=F7OB2TYGHY1T tag=5ABK1BDL67TL type=write size=3815025 2024-06-04T15:59:31.304 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.305+0000 7f5e9aacc780 1 < completed delete operation key=Q4OFQI0F5YLG tag=LS594337W93S type=del 2024-06-04T15:59:31.306 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.306+0000 7f5e9aacc780 1 > prepared operation key=B0HK5FJ2RGJE tag=8FR902X9J2IT type=del size=2717477 2024-06-04T15:59:31.307 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.307+0000 7f5e9aacc780 1 < completed write operation key=7S9S3MIG7WIT tag=APQPUMCXPBCD type=write size=679581 2024-06-04T15:59:31.309 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.309+0000 7f5e9aacc780 1 > prepared operation key=RP8K6QJUZAH1 tag=KHLAT1152TBA type=del size=3045455 2024-06-04T15:59:31.311 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.310+0000 7f5e9aacc780 1 < completed write operation key=UW5LVIBG09SV tag=3YZPR8IQI5RO type=write size=18393 2024-06-04T15:59:31.312 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.312+0000 7f5e9aacc780 1 > prepared operation key=FBV2MAG130M6 tag=SMJFJVVY9GRB type=del size=3458200 2024-06-04T15:59:31.315 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.315+0000 7f5e9aacc780 1 < suggested remove operation key=K01DAK0M4I4M tag=LBLGSU43G097 type=write 2024-06-04T15:59:31.316 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.316+0000 7f5e9aacc780 1 > prepared operation key=SUBHZJ7HUV3H tag=1WHSSD1JCZT1 type=del size=3596628 2024-06-04T15:59:31.318 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.318+0000 7f5e9aacc780 1 < completed part key=_multipart_TUGKW7F4V9NO.2~GU00ACL5ZAVV.0 size=1048576 2024-06-04T15:59:31.319 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.319+0000 7f5e9aacc780 1 < completed part key=_multipart_TUGKW7F4V9NO.2~GU00ACL5ZAVV.1 size=1048576 2024-06-04T15:59:31.320 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.320+0000 7f5e9aacc780 1 < completed part key=_multipart_TUGKW7F4V9NO.2~GU00ACL5ZAVV.2 size=691241 2024-06-04T15:59:31.323 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.323+0000 7f5e9aacc780 1 < completed multipart upload key=TUGKW7F4V9NO upload=GU00ACL5ZAVV tag=ORIBXLM6OG1C type=write size=3836969 2024-06-04T15:59:31.325 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.324+0000 7f5e9aacc780 1 > prepared operation key=JL69PUHT6NNT tag=DLWK4LB5V1AH type=write size=542073 2024-06-04T15:59:31.326 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.326+0000 7f5e9aacc780 1 < completed delete operation key=03ZNYG3WLMP4 tag=NPLYCX9FRLAY type=del 2024-06-04T15:59:31.329 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.328+0000 7f5e9aacc780 1 > prepared part key=_multipart_PCLJXQHJ4HTY.2~2T789ID27V10.0 size=1048576 2024-06-04T15:59:31.330 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.329+0000 7f5e9aacc780 1 > prepared part key=_multipart_PCLJXQHJ4HTY.2~2T789ID27V10.1 size=78271 2024-06-04T15:59:31.330 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.329+0000 7f5e9aacc780 1 > prepared multipart upload key=PCLJXQHJ4HTY upload=2T789ID27V10 tag=AI6PKVDY2H6Z type=write size=2175423 2024-06-04T15:59:31.333 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.333+0000 7f5e9aacc780 1 < suggested update operation key=HD6SNICRCDLL tag=A5EGQEAYCH3I type=del size=597309 2024-06-04T15:59:31.334 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.334+0000 7f5e9aacc780 1 > prepared operation key=4W5HB9WQQHR6 tag=FIMO25B2EXLT type=write size=1047384 2024-06-04T15:59:31.336 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.335+0000 7f5e9aacc780 1 < completed part key=_multipart_K01DAK0M4I4M.2~NTR97WUR7EC0.0 size=74758 2024-06-04T15:59:31.338 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.338+0000 7f5e9aacc780 1 < completed multipart upload key=K01DAK0M4I4M upload=NTR97WUR7EC0 tag=KGSHCFZNRPGJ type=write size=1123334 2024-06-04T15:59:31.340 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.339+0000 7f5e9aacc780 1 > prepared operation key=FBV2MAG130M6 tag=X3EOPEI61BUC type=del size=1063056 2024-06-04T15:59:31.341 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.341+0000 7f5e9aacc780 1 < completed delete operation key=UW5LVIBG09SV tag=BCIWL4P82ZAM type=del 2024-06-04T15:59:31.342 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.342+0000 7f5e9aacc780 1 > prepared operation key=9MPRI6LW3956 tag=3F1U7V22ZC1T type=del size=692564 2024-06-04T15:59:31.344 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.344+0000 7f5e9aacc780 -1 < failed to complete operation key=HD6SNICRCDLL tag=ZJ99SKD2JGTO type=del size=1878505: (22) Invalid argument 2024-06-04T15:59:31.346 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.345+0000 7f5e9aacc780 1 > prepared operation key=NHPH4LYPP0LL tag=PE0EGRLD1L7D type=del size=2226964 2024-06-04T15:59:31.347 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.347+0000 7f5e9aacc780 1 < completed part key=_multipart_B0HK5FJ2RGJE.2~OVEOYJV0VCD1.0 size=1048576 2024-06-04T15:59:31.348 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.348+0000 7f5e9aacc780 1 < completed part key=_multipart_B0HK5FJ2RGJE.2~OVEOYJV0VCD1.1 size=1048576 2024-06-04T15:59:31.350 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.349+0000 7f5e9aacc780 1 < completed part key=_multipart_B0HK5FJ2RGJE.2~OVEOYJV0VCD1.2 size=572525 2024-06-04T15:59:31.352 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.352+0000 7f5e9aacc780 1 < completed multipart upload key=B0HK5FJ2RGJE upload=OVEOYJV0VCD1 tag=I6Y03RLD9REQ type=write size=3718253 2024-06-04T15:59:31.354 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.354+0000 7f5e9aacc780 1 > prepared operation key=FBV2MAG130M6 tag=I7CNE2EBJ0FX type=write size=188525 2024-06-04T15:59:31.355 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.355+0000 7f5e9aacc780 1 < completed part key=_multipart_UTZHANL9ER2Q.2~H7WU0XKE31JR.0 size=1048576 2024-06-04T15:59:31.357 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.356+0000 7f5e9aacc780 1 < completed part key=_multipart_UTZHANL9ER2Q.2~H7WU0XKE31JR.1 size=295453 2024-06-04T15:59:31.359 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.358+0000 7f5e9aacc780 1 < completed multipart upload key=UTZHANL9ER2Q upload=H7WU0XKE31JR tag=2SEQ0I0ZWMOL type=write size=2392605 2024-06-04T15:59:31.360 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.360+0000 7f5e9aacc780 1 > prepared operation key=XH0N984YVGKP tag=JX3PDIULCA41 type=del size=584920 2024-06-04T15:59:31.363 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.363+0000 7f5e9aacc780 1 < suggested remove operation key=TUGKW7F4V9NO tag=MHKIUDFB1KD5 type=write 2024-06-04T15:59:31.366 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.365+0000 7f5e9aacc780 1 > prepared part key=_multipart_PNDPO2WUW7UX.2~6VG3BESUY5YA.0 size=1048576 2024-06-04T15:59:31.367 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.367+0000 7f5e9aacc780 1 > prepared part key=_multipart_PNDPO2WUW7UX.2~6VG3BESUY5YA.1 size=162941 2024-06-04T15:59:31.367 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.367+0000 7f5e9aacc780 1 > prepared multipart upload key=PNDPO2WUW7UX upload=6VG3BESUY5YA tag=5WYTF3IPH3ZL type=write size=2260093 2024-06-04T15:59:31.368 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.368+0000 7f5e9aacc780 1 < completed delete operation key=4W5HB9WQQHR6 tag=OVUPWHCOI9ZO type=del 2024-06-04T15:59:31.371 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.371+0000 7f5e9aacc780 1 > prepared part key=_multipart_Q4OFQI0F5YLG.2~9GIFRQHTYNEN.0 size=625612 2024-06-04T15:59:31.371 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.371+0000 7f5e9aacc780 1 > prepared multipart upload key=Q4OFQI0F5YLG upload=9GIFRQHTYNEN tag=FK61MU0HN0KD type=write size=1674188 2024-06-04T15:59:31.372 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.372+0000 7f5e9aacc780 1 < completed delete operation key=A8O0S3S45RGM tag=RXZ6PRJ280RT type=del 2024-06-04T15:59:31.375 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.375+0000 7f5e9aacc780 1 > prepared part key=_multipart_4W5HB9WQQHR6.2~VZEJ6C2M0YRA.0 size=691757 2024-06-04T15:59:31.375 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.375+0000 7f5e9aacc780 1 > prepared multipart upload key=4W5HB9WQQHR6 upload=VZEJ6C2M0YRA tag=XYIGIPJNZVY5 type=write size=1740333 2024-06-04T15:59:31.375 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.375+0000 7f5e9aacc780 1 < canceled part key=_multipart_2BT2AXKB1RTA.2~F7OB2TYGHY1T.0 size=1048576 2024-06-04T15:59:31.376 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.375+0000 7f5e9aacc780 1 < canceled part key=_multipart_2BT2AXKB1RTA.2~F7OB2TYGHY1T.1 size=1048576 2024-06-04T15:59:31.376 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.375+0000 7f5e9aacc780 1 < canceled part key=_multipart_2BT2AXKB1RTA.2~F7OB2TYGHY1T.2 size=669297 2024-06-04T15:59:31.378 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.377+0000 7f5e9aacc780 1 < canceled multipart upload key=2BT2AXKB1RTA upload=F7OB2TYGHY1T tag=5ABK1BDL67TL type=write size=3815025 2024-06-04T15:59:31.379 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.379+0000 7f5e9aacc780 1 > prepared operation key=PASGIP872OVX tag=WWVGWOJ5DF6I type=del size=3389048 2024-06-04T15:59:31.381 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.380+0000 7f5e9aacc780 1 < completed delete operation key=B0HK5FJ2RGJE tag=8FR902X9J2IT type=del 2024-06-04T15:59:31.382 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.382+0000 7f5e9aacc780 1 > prepared operation key=UTZHANL9ER2Q tag=6P9P8FYQC6ID type=del size=3737218 2024-06-04T15:59:31.385 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.385+0000 7f5e9aacc780 1 < suggested update operation key=RP8K6QJUZAH1 tag=KHLAT1152TBA type=del size=3045455 2024-06-04T15:59:31.386 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.386+0000 7f5e9aacc780 1 > prepared operation key=A8O0S3S45RGM tag=ZA4EW7NLTKI1 type=del size=2231856 2024-06-04T15:59:31.388 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.387+0000 7f5e9aacc780 1 < completed delete operation key=FBV2MAG130M6 tag=SMJFJVVY9GRB type=del 2024-06-04T15:59:31.390 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.390+0000 7f5e9aacc780 1 > prepared part key=_multipart_Q2V1ICTBSCV1.2~SV63FB7REK1Y.0 size=1048576 2024-06-04T15:59:31.391 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.391+0000 7f5e9aacc780 1 > prepared part key=_multipart_Q2V1ICTBSCV1.2~SV63FB7REK1Y.1 size=1048576 2024-06-04T15:59:31.393 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.392+0000 7f5e9aacc780 1 > prepared part key=_multipart_Q2V1ICTBSCV1.2~SV63FB7REK1Y.2 size=417171 2024-06-04T15:59:31.393 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.392+0000 7f5e9aacc780 1 > prepared multipart upload key=Q2V1ICTBSCV1 upload=SV63FB7REK1Y tag=GT7D3XKXK64K type=write size=3562899 2024-06-04T15:59:31.394 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.394+0000 7f5e9aacc780 1 < canceled operation key=SUBHZJ7HUV3H tag=1WHSSD1JCZT1 type=del size=3596628 2024-06-04T15:59:31.396 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.395+0000 7f5e9aacc780 1 > prepared operation key=7S9S3MIG7WIT tag=8L1OSPVMIO82 type=del size=3671836 2024-06-04T15:59:31.397 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.397+0000 7f5e9aacc780 1 < completed write operation key=JL69PUHT6NNT tag=DLWK4LB5V1AH type=write size=542073 2024-06-04T15:59:31.399 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.399+0000 7f5e9aacc780 1 > prepared part key=_multipart_PCLJXQHJ4HTY.2~G46MW57U20PX.0 size=1048576 2024-06-04T15:59:31.401 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.400+0000 7f5e9aacc780 1 > prepared part key=_multipart_PCLJXQHJ4HTY.2~G46MW57U20PX.1 size=998530 2024-06-04T15:59:31.401 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.400+0000 7f5e9aacc780 1 > prepared multipart upload key=PCLJXQHJ4HTY upload=G46MW57U20PX tag=91CVPHACEZB0 type=write size=3095682 2024-06-04T15:59:31.402 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.402+0000 7f5e9aacc780 1 < completed part key=_multipart_PCLJXQHJ4HTY.2~2T789ID27V10.0 size=1048576 2024-06-04T15:59:31.403 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.403+0000 7f5e9aacc780 1 < completed part key=_multipart_PCLJXQHJ4HTY.2~2T789ID27V10.1 size=78271 2024-06-04T15:59:31.405 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.405+0000 7f5e9aacc780 1 < completed multipart upload key=PCLJXQHJ4HTY upload=2T789ID27V10 tag=AI6PKVDY2H6Z type=write size=2175423 2024-06-04T15:59:31.408 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.408+0000 7f5e9aacc780 1 > prepared part key=_multipart_DY9JWHWNAUO1.2~8IYX4PWKM540.0 size=1048576 2024-06-04T15:59:31.409 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.409+0000 7f5e9aacc780 1 > prepared part key=_multipart_DY9JWHWNAUO1.2~8IYX4PWKM540.1 size=1048576 2024-06-04T15:59:31.410 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.410+0000 7f5e9aacc780 1 > prepared part key=_multipart_DY9JWHWNAUO1.2~8IYX4PWKM540.2 size=828150 2024-06-04T15:59:31.410 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.410+0000 7f5e9aacc780 1 > prepared multipart upload key=DY9JWHWNAUO1 upload=8IYX4PWKM540 tag=LYSK2K64VNHU type=write size=3973878 2024-06-04T15:59:31.412 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.411+0000 7f5e9aacc780 1 < completed write operation key=4W5HB9WQQHR6 tag=FIMO25B2EXLT type=write size=1047384 2024-06-04T15:59:31.413 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.413+0000 7f5e9aacc780 1 > prepared operation key=TUGKW7F4V9NO tag=6BTR5ZHFMKKX type=del size=2423037 2024-06-04T15:59:31.414 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.414+0000 7f5e9aacc780 1 < completed delete operation key=FBV2MAG130M6 tag=X3EOPEI61BUC type=del 2024-06-04T15:59:31.417 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.417+0000 7f5e9aacc780 1 > prepared part key=_multipart_B0HK5FJ2RGJE.2~8VOVRA0NQTZ9.0 size=1048576 2024-06-04T15:59:31.418 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.418+0000 7f5e9aacc780 1 > prepared part key=_multipart_B0HK5FJ2RGJE.2~8VOVRA0NQTZ9.1 size=620981 2024-06-04T15:59:31.418 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.418+0000 7f5e9aacc780 1 > prepared multipart upload key=B0HK5FJ2RGJE upload=8VOVRA0NQTZ9 tag=QKA1GY7DXSQM type=write size=2718133 2024-06-04T15:59:31.419 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.419+0000 7f5e9aacc780 1 < completed delete operation key=9MPRI6LW3956 tag=3F1U7V22ZC1T type=del 2024-06-04T15:59:31.422 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.421+0000 7f5e9aacc780 1 > prepared operation key=Q4OFQI0F5YLG tag=9470YVTWT5B4 type=del size=3289063 2024-06-04T15:59:31.423 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.423+0000 7f5e9aacc780 1 < completed delete operation key=NHPH4LYPP0LL tag=PE0EGRLD1L7D type=del 2024-06-04T15:59:31.424 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.424+0000 7f5e9aacc780 1 > prepared operation key=W1T4O3EAE7JN tag=3IIK087PUUKQ type=del size=1279098 2024-06-04T15:59:31.426 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.426+0000 7f5e9aacc780 1 < completed write operation key=FBV2MAG130M6 tag=I7CNE2EBJ0FX type=write size=188525 2024-06-04T15:59:31.427 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.427+0000 7f5e9aacc780 1 > prepared operation key=AOCB36Y5Q7B0 tag=0U4ZQJ1BHMZS type=write size=1001610 2024-06-04T15:59:31.429 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.429+0000 7f5e9aacc780 1 < completed delete operation key=XH0N984YVGKP tag=JX3PDIULCA41 type=del 2024-06-04T15:59:31.430 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.430+0000 7f5e9aacc780 1 > prepared operation key=JL69PUHT6NNT tag=7NEMZOC3NK0J type=del size=3928944 2024-06-04T15:59:31.432 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.432+0000 7f5e9aacc780 1 < completed part key=_multipart_PNDPO2WUW7UX.2~6VG3BESUY5YA.0 size=1048576 2024-06-04T15:59:31.433 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.433+0000 7f5e9aacc780 1 < completed part key=_multipart_PNDPO2WUW7UX.2~6VG3BESUY5YA.1 size=162941 2024-06-04T15:59:31.435 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.435+0000 7f5e9aacc780 1 < completed multipart upload key=PNDPO2WUW7UX upload=6VG3BESUY5YA tag=5WYTF3IPH3ZL type=write size=2260093 2024-06-04T15:59:31.437 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.436+0000 7f5e9aacc780 1 > prepared operation key=4W5HB9WQQHR6 tag=BJZ5QETF475O type=write size=959815 2024-06-04T15:59:31.438 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.438+0000 7f5e9aacc780 1 < completed part key=_multipart_Q4OFQI0F5YLG.2~9GIFRQHTYNEN.0 size=625612 2024-06-04T15:59:31.440 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.440+0000 7f5e9aacc780 1 < completed multipart upload key=Q4OFQI0F5YLG upload=9GIFRQHTYNEN tag=FK61MU0HN0KD type=write size=1674188 2024-06-04T15:59:31.442 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.442+0000 7f5e9aacc780 1 > prepared operation key=PCLJXQHJ4HTY tag=U1J7UQ8U09Q5 type=write size=29656 2024-06-04T15:59:31.443 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.443+0000 7f5e9aacc780 1 < completed part key=_multipart_4W5HB9WQQHR6.2~VZEJ6C2M0YRA.0 size=691757 2024-06-04T15:59:31.446 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.445+0000 7f5e9aacc780 1 < completed multipart upload key=4W5HB9WQQHR6 upload=VZEJ6C2M0YRA tag=XYIGIPJNZVY5 type=write size=1740333 2024-06-04T15:59:31.447 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.447+0000 7f5e9aacc780 1 > prepared operation key=HD6SNICRCDLL tag=65B7NKZM408E type=del size=1715014 2024-06-04T15:59:31.449 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.448+0000 7f5e9aacc780 1 < completed delete operation key=PASGIP872OVX tag=WWVGWOJ5DF6I type=del 2024-06-04T15:59:31.450 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.450+0000 7f5e9aacc780 1 > prepared operation key=4W5HB9WQQHR6 tag=XGJUGMKXFIGM type=del size=791165 2024-06-04T15:59:31.452 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.451+0000 7f5e9aacc780 1 < canceled operation key=UTZHANL9ER2Q tag=6P9P8FYQC6ID type=del size=3737218 2024-06-04T15:59:31.453 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.453+0000 7f5e9aacc780 1 > prepared operation key=GCPC9OJH7KWU tag=UVP9EDBGM370 type=del size=1318593 2024-06-04T15:59:31.454 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.454+0000 7f5e9aacc780 1 < completed delete operation key=A8O0S3S45RGM tag=ZA4EW7NLTKI1 type=del 2024-06-04T15:59:31.456 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.456+0000 7f5e9aacc780 1 > prepared operation key=TUGKW7F4V9NO tag=8SB01ZI1AOB6 type=del size=1067594 2024-06-04T15:59:31.457 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.457+0000 7f5e9aacc780 1 < completed part key=_multipart_Q2V1ICTBSCV1.2~SV63FB7REK1Y.0 size=1048576 2024-06-04T15:59:31.459 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.458+0000 7f5e9aacc780 1 < completed part key=_multipart_Q2V1ICTBSCV1.2~SV63FB7REK1Y.1 size=1048576 2024-06-04T15:59:31.459 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.458+0000 7f5e9aacc780 1 < canceled part key=_multipart_Q2V1ICTBSCV1.2~SV63FB7REK1Y.2 size=417171 2024-06-04T15:59:31.461 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.461+0000 7f5e9aacc780 1 < canceled multipart upload key=Q2V1ICTBSCV1 upload=SV63FB7REK1Y tag=GT7D3XKXK64K type=write size=3562899 2024-06-04T15:59:31.464 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.463+0000 7f5e9aacc780 1 > prepared part key=_multipart_UW5LVIBG09SV.2~RTVIE0JPXU0F.0 size=728396 2024-06-04T15:59:31.464 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.463+0000 7f5e9aacc780 1 > prepared multipart upload key=UW5LVIBG09SV upload=RTVIE0JPXU0F tag=K2G0B61FX553 type=write size=1776972 2024-06-04T15:59:31.465 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.465+0000 7f5e9aacc780 1 < completed delete operation key=7S9S3MIG7WIT tag=8L1OSPVMIO82 type=del 2024-06-04T15:59:31.468 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.467+0000 7f5e9aacc780 1 > prepared part key=_multipart_UW5LVIBG09SV.2~4FU2WISBF3DM.0 size=1048576 2024-06-04T15:59:31.469 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.468+0000 7f5e9aacc780 1 > prepared part key=_multipart_UW5LVIBG09SV.2~4FU2WISBF3DM.1 size=862650 2024-06-04T15:59:31.469 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.468+0000 7f5e9aacc780 1 > prepared multipart upload key=UW5LVIBG09SV upload=4FU2WISBF3DM tag=9ISL12SVVWDO type=write size=2959802 2024-06-04T15:59:31.469 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.469+0000 7f5e9aacc780 1 < canceled part key=_multipart_PCLJXQHJ4HTY.2~G46MW57U20PX.0 size=1048576 2024-06-04T15:59:31.470 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.470+0000 7f5e9aacc780 1 < completed part key=_multipart_PCLJXQHJ4HTY.2~G46MW57U20PX.1 size=998530 2024-06-04T15:59:31.473 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.473+0000 7f5e9aacc780 1 < canceled multipart upload key=PCLJXQHJ4HTY upload=G46MW57U20PX tag=91CVPHACEZB0 type=write size=3095682 2024-06-04T15:59:31.475 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.475+0000 7f5e9aacc780 1 > prepared operation key=03ZNYG3WLMP4 tag=F6PVMQ2AV5WK type=del size=777107 2024-06-04T15:59:31.477 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.477+0000 7f5e9aacc780 1 < completed part key=_multipart_DY9JWHWNAUO1.2~8IYX4PWKM540.0 size=1048576 2024-06-04T15:59:31.478 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.478+0000 7f5e9aacc780 1 < completed part key=_multipart_DY9JWHWNAUO1.2~8IYX4PWKM540.1 size=1048576 2024-06-04T15:59:31.478 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.478+0000 7f5e9aacc780 1 < canceled part key=_multipart_DY9JWHWNAUO1.2~8IYX4PWKM540.2 size=828150 2024-06-04T15:59:31.480 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.480+0000 7f5e9aacc780 1 < canceled multipart upload key=DY9JWHWNAUO1 upload=8IYX4PWKM540 tag=LYSK2K64VNHU type=write size=3973878 2024-06-04T15:59:31.482 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.482+0000 7f5e9aacc780 1 > prepared operation key=B0HK5FJ2RGJE tag=MYUHTWNK3N1N type=del size=2221202 2024-06-04T15:59:31.485 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.485+0000 7f5e9aacc780 1 < suggested update operation key=TUGKW7F4V9NO tag=6BTR5ZHFMKKX type=del size=2423037 2024-06-04T15:59:31.486 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.486+0000 7f5e9aacc780 1 > prepared operation key=RP8K6QJUZAH1 tag=R598RRHK6EHF type=write size=931367 2024-06-04T15:59:31.488 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.488+0000 7f5e9aacc780 1 < completed part key=_multipart_B0HK5FJ2RGJE.2~8VOVRA0NQTZ9.0 size=1048576 2024-06-04T15:59:31.489 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.489+0000 7f5e9aacc780 1 < completed part key=_multipart_B0HK5FJ2RGJE.2~8VOVRA0NQTZ9.1 size=620981 2024-06-04T15:59:31.491 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.491+0000 7f5e9aacc780 1 < completed multipart upload key=B0HK5FJ2RGJE upload=8VOVRA0NQTZ9 tag=QKA1GY7DXSQM type=write size=2718133 2024-06-04T15:59:31.493 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.492+0000 7f5e9aacc780 1 > prepared operation key=AOCB36Y5Q7B0 tag=N1FEYAF177TH type=del size=1638048 2024-06-04T15:59:31.494 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.494+0000 7f5e9aacc780 1 < canceled operation key=Q4OFQI0F5YLG tag=9470YVTWT5B4 type=del size=3289063 2024-06-04T15:59:31.496 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.495+0000 7f5e9aacc780 1 > prepared operation key=PASGIP872OVX tag=N2Y9F54GAH1R type=del size=2579326 2024-06-04T15:59:31.497 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.497+0000 7f5e9aacc780 1 < completed delete operation key=W1T4O3EAE7JN tag=3IIK087PUUKQ type=del 2024-06-04T15:59:31.499 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.498+0000 7f5e9aacc780 1 > prepared operation key=1IKNQXU3Y2JJ tag=M7I6V1L9P8GK type=del size=1641628 2024-06-04T15:59:31.500 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.500+0000 7f5e9aacc780 1 < completed write operation key=AOCB36Y5Q7B0 tag=0U4ZQJ1BHMZS type=write size=1001610 2024-06-04T15:59:31.501 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.501+0000 7f5e9aacc780 1 > prepared operation key=Q2V1ICTBSCV1 tag=H2I1724IJVZY type=del size=1388924 2024-06-04T15:59:31.503 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.502+0000 7f5e9aacc780 1 < completed delete operation key=JL69PUHT6NNT tag=7NEMZOC3NK0J type=del 2024-06-04T15:59:31.505 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.505+0000 7f5e9aacc780 1 > prepared part key=_multipart_Q2V1ICTBSCV1.2~ZGZFBAGFE0PX.0 size=1048576 2024-06-04T15:59:31.506 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.506+0000 7f5e9aacc780 1 > prepared part key=_multipart_Q2V1ICTBSCV1.2~ZGZFBAGFE0PX.1 size=1048576 2024-06-04T15:59:31.508 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.507+0000 7f5e9aacc780 1 > prepared part key=_multipart_Q2V1ICTBSCV1.2~ZGZFBAGFE0PX.2 size=166735 2024-06-04T15:59:31.508 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.507+0000 7f5e9aacc780 1 > prepared multipart upload key=Q2V1ICTBSCV1 upload=ZGZFBAGFE0PX tag=SS5BRPF16U6O type=write size=3312463 2024-06-04T15:59:31.509 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.509+0000 7f5e9aacc780 1 < completed write operation key=4W5HB9WQQHR6 tag=BJZ5QETF475O type=write size=959815 2024-06-04T15:59:31.512 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.512+0000 7f5e9aacc780 1 > prepared part key=_multipart_QUIVPH3OB6KN.2~249MYEPSF2QH.0 size=1048576 2024-06-04T15:59:31.513 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.512+0000 7f5e9aacc780 1 > prepared part key=_multipart_QUIVPH3OB6KN.2~249MYEPSF2QH.1 size=272620 2024-06-04T15:59:31.513 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.512+0000 7f5e9aacc780 1 > prepared multipart upload key=QUIVPH3OB6KN upload=249MYEPSF2QH tag=OITKM6EY9IBE type=write size=2369772 2024-06-04T15:59:31.514 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.514+0000 7f5e9aacc780 1 < completed write operation key=PCLJXQHJ4HTY tag=U1J7UQ8U09Q5 type=write size=29656 2024-06-04T15:59:31.516 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.515+0000 7f5e9aacc780 1 > prepared operation key=K01DAK0M4I4M tag=HI7SG3SAR1TV type=del size=853517 2024-06-04T15:59:31.517 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.517+0000 7f5e9aacc780 1 < completed delete operation key=HD6SNICRCDLL tag=65B7NKZM408E type=del 2024-06-04T15:59:31.519 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.519+0000 7f5e9aacc780 1 > prepared part key=_multipart_NJ5U8JTT32QK.2~3346BX1BUYA9.0 size=993179 2024-06-04T15:59:31.520 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.519+0000 7f5e9aacc780 1 > prepared multipart upload key=NJ5U8JTT32QK upload=3346BX1BUYA9 tag=8I9SIGJPIVH8 type=write size=2041755 2024-06-04T15:59:31.521 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.521+0000 7f5e9aacc780 1 < completed delete operation key=4W5HB9WQQHR6 tag=XGJUGMKXFIGM type=del 2024-06-04T15:59:31.522 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.522+0000 7f5e9aacc780 1 > prepared operation key=7S9S3MIG7WIT tag=HA9R1KQ5R418 type=write size=20197 2024-06-04T15:59:31.524 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.524+0000 7f5e9aacc780 1 < completed delete operation key=GCPC9OJH7KWU tag=UVP9EDBGM370 type=del 2024-06-04T15:59:31.525 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.525+0000 7f5e9aacc780 1 > prepared operation key=W1T4O3EAE7JN tag=S7BDHEC6EVQT type=write size=923692 2024-06-04T15:59:31.527 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.527+0000 7f5e9aacc780 -1 < failed to complete operation key=TUGKW7F4V9NO tag=8SB01ZI1AOB6 type=del size=1067594: (22) Invalid argument 2024-06-04T15:59:31.528 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.528+0000 7f5e9aacc780 1 > prepared operation key=JL69PUHT6NNT tag=IVYIUODE0JG5 type=del size=209345 2024-06-04T15:59:31.530 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.529+0000 7f5e9aacc780 1 < completed part key=_multipart_UW5LVIBG09SV.2~RTVIE0JPXU0F.0 size=728396 2024-06-04T15:59:31.532 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.532+0000 7f5e9aacc780 1 < completed multipart upload key=UW5LVIBG09SV upload=RTVIE0JPXU0F tag=K2G0B61FX553 type=write size=1776972 2024-06-04T15:59:31.533 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.533+0000 7f5e9aacc780 1 > prepared operation key=PCLJXQHJ4HTY tag=SB7UUQHIKS4G type=del size=2522098 2024-06-04T15:59:31.535 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.534+0000 7f5e9aacc780 1 < completed part key=_multipart_UW5LVIBG09SV.2~4FU2WISBF3DM.0 size=1048576 2024-06-04T15:59:31.535 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.534+0000 7f5e9aacc780 1 < canceled part key=_multipart_UW5LVIBG09SV.2~4FU2WISBF3DM.1 size=862650 2024-06-04T15:59:31.537 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.537+0000 7f5e9aacc780 1 < canceled multipart upload key=UW5LVIBG09SV upload=4FU2WISBF3DM tag=9ISL12SVVWDO type=write size=2959802 2024-06-04T15:59:31.538 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.538+0000 7f5e9aacc780 1 > prepared operation key=PCLJXQHJ4HTY tag=OYRMCP9D3O9O type=write size=742864 2024-06-04T15:59:31.540 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.540+0000 7f5e9aacc780 1 < completed delete operation key=03ZNYG3WLMP4 tag=F6PVMQ2AV5WK type=del 2024-06-04T15:59:31.541 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.541+0000 7f5e9aacc780 1 > prepared operation key=03ZNYG3WLMP4 tag=5RFJKT67U800 type=del size=153845 2024-06-04T15:59:31.544 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.545+0000 7f5e9aacc780 1 < suggested remove operation key=B0HK5FJ2RGJE tag=MYUHTWNK3N1N type=del 2024-06-04T15:59:31.546 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.546+0000 7f5e9aacc780 1 > prepared operation key=PASGIP872OVX tag=EASBWUKSGVXD type=del size=2938082 2024-06-04T15:59:31.549 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.548+0000 7f5e9aacc780 1 < suggested update operation key=RP8K6QJUZAH1 tag=R598RRHK6EHF type=write size=931367 2024-06-04T15:59:31.551 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.551+0000 7f5e9aacc780 1 > prepared part key=_multipart_HD6SNICRCDLL.2~TAXZ88394E69.0 size=1048576 2024-06-04T15:59:31.552 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.552+0000 7f5e9aacc780 1 > prepared part key=_multipart_HD6SNICRCDLL.2~TAXZ88394E69.1 size=569267 2024-06-04T15:59:31.552 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.552+0000 7f5e9aacc780 1 > prepared multipart upload key=HD6SNICRCDLL upload=TAXZ88394E69 tag=9YX06SL5MMFM type=write size=2666419 2024-06-04T15:59:31.554 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.553+0000 7f5e9aacc780 1 < completed delete operation key=AOCB36Y5Q7B0 tag=N1FEYAF177TH type=del 2024-06-04T15:59:31.556 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.556+0000 7f5e9aacc780 1 > prepared part key=_multipart_FBV2MAG130M6.2~PCO9AICURN1H.0 size=1048576 2024-06-04T15:59:31.558 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.558+0000 7f5e9aacc780 1 > prepared part key=_multipart_FBV2MAG130M6.2~PCO9AICURN1H.1 size=649350 2024-06-04T15:59:31.559 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.558+0000 7f5e9aacc780 1 > prepared multipart upload key=FBV2MAG130M6 upload=PCO9AICURN1H tag=VRSHL2AAA887 type=write size=2746502 2024-06-04T15:59:31.560 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.559+0000 7f5e9aacc780 1 < canceled operation key=PASGIP872OVX tag=N2Y9F54GAH1R type=del size=2579326 2024-06-04T15:59:31.562 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.562+0000 7f5e9aacc780 1 > prepared part key=_multipart_B0HK5FJ2RGJE.2~E663VDVOTIGS.0 size=560943 2024-06-04T15:59:31.562 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.562+0000 7f5e9aacc780 1 > prepared multipart upload key=B0HK5FJ2RGJE upload=E663VDVOTIGS tag=V6BZVZK6R8MS type=write size=1609519 2024-06-04T15:59:31.563 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.563+0000 7f5e9aacc780 1 < completed delete operation key=1IKNQXU3Y2JJ tag=M7I6V1L9P8GK type=del 2024-06-04T15:59:31.566 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.566+0000 7f5e9aacc780 1 > prepared part key=_multipart_SUBHZJ7HUV3H.2~Z3E2D5XX8OIR.0 size=1048576 2024-06-04T15:59:31.567 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.567+0000 7f5e9aacc780 1 > prepared part key=_multipart_SUBHZJ7HUV3H.2~Z3E2D5XX8OIR.1 size=1048576 2024-06-04T15:59:31.568 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.568+0000 7f5e9aacc780 1 > prepared part key=_multipart_SUBHZJ7HUV3H.2~Z3E2D5XX8OIR.2 size=160368 2024-06-04T15:59:31.568 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.568+0000 7f5e9aacc780 1 > prepared multipart upload key=SUBHZJ7HUV3H upload=Z3E2D5XX8OIR tag=U9VHQVVPK0K2 type=write size=3306096 2024-06-04T15:59:31.570 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.569+0000 7f5e9aacc780 1 < completed delete operation key=Q2V1ICTBSCV1 tag=H2I1724IJVZY type=del 2024-06-04T15:59:31.571 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.571+0000 7f5e9aacc780 1 > prepared operation key=A8O0S3S45RGM tag=WQ6JKDCYNBTX type=del size=2146682 2024-06-04T15:59:31.572 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.572+0000 7f5e9aacc780 1 < completed part key=_multipart_Q2V1ICTBSCV1.2~ZGZFBAGFE0PX.0 size=1048576 2024-06-04T15:59:31.574 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.573+0000 7f5e9aacc780 1 < completed part key=_multipart_Q2V1ICTBSCV1.2~ZGZFBAGFE0PX.1 size=1048576 2024-06-04T15:59:31.575 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.574+0000 7f5e9aacc780 1 < completed part key=_multipart_Q2V1ICTBSCV1.2~ZGZFBAGFE0PX.2 size=166735 2024-06-04T15:59:31.577 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.577+0000 7f5e9aacc780 1 < completed multipart upload key=Q2V1ICTBSCV1 upload=ZGZFBAGFE0PX tag=SS5BRPF16U6O type=write size=3312463 2024-06-04T15:59:31.578 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.578+0000 7f5e9aacc780 1 > prepared operation key=HD6SNICRCDLL tag=069ANOT2BDBH type=del size=1045990 2024-06-04T15:59:31.579 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.579+0000 7f5e9aacc780 1 < completed part key=_multipart_QUIVPH3OB6KN.2~249MYEPSF2QH.0 size=1048576 2024-06-04T15:59:31.581 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.580+0000 7f5e9aacc780 1 < completed part key=_multipart_QUIVPH3OB6KN.2~249MYEPSF2QH.1 size=272620 2024-06-04T15:59:31.583 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.582+0000 7f5e9aacc780 1 < completed multipart upload key=QUIVPH3OB6KN upload=249MYEPSF2QH tag=OITKM6EY9IBE type=write size=2369772 2024-06-04T15:59:31.585 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.585+0000 7f5e9aacc780 1 > prepared part key=_multipart_GTRMEQJK675Z.2~9UFULVS2N6NG.0 size=17813 2024-06-04T15:59:31.585 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.585+0000 7f5e9aacc780 1 > prepared multipart upload key=GTRMEQJK675Z upload=9UFULVS2N6NG tag=OFBEL4H4VPKS type=write size=1066389 2024-06-04T15:59:31.588 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.588+0000 7f5e9aacc780 1 < completed delete operation key=K01DAK0M4I4M tag=HI7SG3SAR1TV type=del 2024-06-04T15:59:31.589 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.589+0000 7f5e9aacc780 1 > prepared operation key=DY9JWHWNAUO1 tag=JUJ0VUPGUO3J type=del size=2409263 2024-06-04T15:59:31.590 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.590+0000 7f5e9aacc780 1 < completed part key=_multipart_NJ5U8JTT32QK.2~3346BX1BUYA9.0 size=993179 2024-06-04T15:59:31.593 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.592+0000 7f5e9aacc780 1 < completed multipart upload key=NJ5U8JTT32QK upload=3346BX1BUYA9 tag=8I9SIGJPIVH8 type=write size=2041755 2024-06-04T15:59:31.594 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.594+0000 7f5e9aacc780 1 > prepared operation key=PNDPO2WUW7UX tag=4VNDMUJP30CN type=del size=260805 2024-06-04T15:59:31.596 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.596+0000 7f5e9aacc780 1 < canceled operation key=7S9S3MIG7WIT tag=HA9R1KQ5R418 type=write size=20197 2024-06-04T15:59:31.598 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.598+0000 7f5e9aacc780 1 > prepared part key=_multipart_2BT2AXKB1RTA.2~CBE48R0YCF62.0 size=1048576 2024-06-04T15:59:31.599 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.599+0000 7f5e9aacc780 1 > prepared part key=_multipart_2BT2AXKB1RTA.2~CBE48R0YCF62.1 size=28533 2024-06-04T15:59:31.599 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.599+0000 7f5e9aacc780 1 > prepared multipart upload key=2BT2AXKB1RTA upload=CBE48R0YCF62 tag=ZZATYKHBBSHA type=write size=2125685 2024-06-04T15:59:31.602 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.601+0000 7f5e9aacc780 1 < suggested update operation key=W1T4O3EAE7JN tag=S7BDHEC6EVQT type=write size=923692 2024-06-04T15:59:31.604 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.604+0000 7f5e9aacc780 1 > prepared part key=_multipart_JL69PUHT6NNT.2~8M8W1W1VS6X9.0 size=397922 2024-06-04T15:59:31.604 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.604+0000 7f5e9aacc780 1 > prepared multipart upload key=JL69PUHT6NNT upload=8M8W1W1VS6X9 tag=1H4QSGBYAQF0 type=write size=1446498 2024-06-04T15:59:31.605 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.605+0000 7f5e9aacc780 1 < completed delete operation key=JL69PUHT6NNT tag=IVYIUODE0JG5 type=del 2024-06-04T15:59:31.608 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.608+0000 7f5e9aacc780 1 > prepared part key=_multipart_QUIVPH3OB6KN.2~FFLFHA5KDDFC.0 size=1048576 2024-06-04T15:59:31.609 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.610+0000 7f5e9aacc780 1 > prepared part key=_multipart_QUIVPH3OB6KN.2~FFLFHA5KDDFC.1 size=1048576 2024-06-04T15:59:31.611 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.610+0000 7f5e9aacc780 1 > prepared part key=_multipart_QUIVPH3OB6KN.2~FFLFHA5KDDFC.2 size=22832 2024-06-04T15:59:31.611 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.610+0000 7f5e9aacc780 1 > prepared multipart upload key=QUIVPH3OB6KN upload=FFLFHA5KDDFC tag=OQ5UD3TMZ7MW type=write size=3168560 2024-06-04T15:59:31.612 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.612+0000 7f5e9aacc780 1 < completed delete operation key=PCLJXQHJ4HTY tag=SB7UUQHIKS4G type=del 2024-06-04T15:59:31.613 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.613+0000 7f5e9aacc780 1 > prepared operation key=PNDPO2WUW7UX tag=35FGRBZOMTF9 type=del size=1397167 2024-06-04T15:59:31.615 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.615+0000 7f5e9aacc780 1 < completed write operation key=PCLJXQHJ4HTY tag=OYRMCP9D3O9O type=write size=742864 2024-06-04T15:59:31.616 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.617+0000 7f5e9aacc780 1 > prepared operation key=NJ5U8JTT32QK tag=DZXX1JCS545O type=write size=672457 2024-06-04T15:59:31.618 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.617+0000 7f5e9aacc780 1 < completed delete operation key=03ZNYG3WLMP4 tag=5RFJKT67U800 type=del 2024-06-04T15:59:31.619 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.619+0000 7f5e9aacc780 1 > prepared operation key=PASGIP872OVX tag=UE42JR35VG79 type=del size=3844729 2024-06-04T15:59:31.622 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.622+0000 7f5e9aacc780 1 < suggested update operation key=PASGIP872OVX tag=EASBWUKSGVXD type=del size=2938082 2024-06-04T15:59:31.624 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.624+0000 7f5e9aacc780 1 > prepared operation key=9MPRI6LW3956 tag=JK5IO1ZABP1V type=del size=247897 2024-06-04T15:59:31.625 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.625+0000 7f5e9aacc780 1 < completed part key=_multipart_HD6SNICRCDLL.2~TAXZ88394E69.0 size=1048576 2024-06-04T15:59:31.627 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.627+0000 7f5e9aacc780 1 < completed part key=_multipart_HD6SNICRCDLL.2~TAXZ88394E69.1 size=569267 2024-06-04T15:59:31.629 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.629+0000 7f5e9aacc780 1 < completed multipart upload key=HD6SNICRCDLL upload=TAXZ88394E69 tag=9YX06SL5MMFM type=write size=2666419 2024-06-04T15:59:31.632 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.632+0000 7f5e9aacc780 1 > prepared part key=_multipart_2BT2AXKB1RTA.2~SX1UJH7WK3D0.0 size=984192 2024-06-04T15:59:31.632 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.632+0000 7f5e9aacc780 1 > prepared multipart upload key=2BT2AXKB1RTA upload=SX1UJH7WK3D0 tag=Y3RWLF3D95CO type=write size=2032768 2024-06-04T15:59:31.633 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.633+0000 7f5e9aacc780 1 < completed part key=_multipart_FBV2MAG130M6.2~PCO9AICURN1H.0 size=1048576 2024-06-04T15:59:31.635 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.634+0000 7f5e9aacc780 1 < completed part key=_multipart_FBV2MAG130M6.2~PCO9AICURN1H.1 size=649350 2024-06-04T15:59:31.637 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.637+0000 7f5e9aacc780 1 < completed multipart upload key=FBV2MAG130M6 upload=PCO9AICURN1H tag=VRSHL2AAA887 type=write size=2746502 2024-06-04T15:59:31.638 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.638+0000 7f5e9aacc780 1 > prepared operation key=A8O0S3S45RGM tag=6M3VSM8SPZZ6 type=del size=1137432 2024-06-04T15:59:31.640 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.640+0000 7f5e9aacc780 1 < completed part key=_multipart_B0HK5FJ2RGJE.2~E663VDVOTIGS.0 size=560943 2024-06-04T15:59:31.642 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.642+0000 7f5e9aacc780 1 < completed multipart upload key=B0HK5FJ2RGJE upload=E663VDVOTIGS tag=V6BZVZK6R8MS type=write size=1609519 2024-06-04T15:59:31.644 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.644+0000 7f5e9aacc780 1 > prepared operation key=DY9JWHWNAUO1 tag=WHWAOD8RP0RQ type=del size=646249 2024-06-04T15:59:31.646 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.646+0000 7f5e9aacc780 1 < completed part key=_multipart_SUBHZJ7HUV3H.2~Z3E2D5XX8OIR.0 size=1048576 2024-06-04T15:59:31.646 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.646+0000 7f5e9aacc780 1 < canceled part key=_multipart_SUBHZJ7HUV3H.2~Z3E2D5XX8OIR.1 size=1048576 2024-06-04T15:59:31.647 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.647+0000 7f5e9aacc780 1 < completed part key=_multipart_SUBHZJ7HUV3H.2~Z3E2D5XX8OIR.2 size=160368 2024-06-04T15:59:31.649 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.649+0000 7f5e9aacc780 1 < canceled multipart upload key=SUBHZJ7HUV3H upload=Z3E2D5XX8OIR tag=U9VHQVVPK0K2 type=write size=3306096 2024-06-04T15:59:31.651 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.650+0000 7f5e9aacc780 1 > prepared operation key=FBV2MAG130M6 tag=R2NOJ6LZ7L7O type=del size=308802 2024-06-04T15:59:31.652 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.652+0000 7f5e9aacc780 1 < completed delete operation key=A8O0S3S45RGM tag=WQ6JKDCYNBTX type=del 2024-06-04T15:59:31.655 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.654+0000 7f5e9aacc780 1 > prepared part key=_multipart_AOCB36Y5Q7B0.2~NUQV25HJELMV.0 size=1048576 2024-06-04T15:59:31.656 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.655+0000 7f5e9aacc780 1 > prepared part key=_multipart_AOCB36Y5Q7B0.2~NUQV25HJELMV.1 size=1048576 2024-06-04T15:59:31.657 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.656+0000 7f5e9aacc780 1 > prepared part key=_multipart_AOCB36Y5Q7B0.2~NUQV25HJELMV.2 size=126734 2024-06-04T15:59:31.657 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.656+0000 7f5e9aacc780 1 > prepared multipart upload key=AOCB36Y5Q7B0 upload=NUQV25HJELMV tag=75FQ920WSRYO type=write size=3272462 2024-06-04T15:59:31.658 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.658+0000 7f5e9aacc780 1 < completed delete operation key=HD6SNICRCDLL tag=069ANOT2BDBH type=del 2024-06-04T15:59:31.661 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.661+0000 7f5e9aacc780 1 > prepared part key=_multipart_PASGIP872OVX.2~WPF98BHGAQC4.0 size=1048576 2024-06-04T15:59:31.662 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.661+0000 7f5e9aacc780 1 > prepared part key=_multipart_PASGIP872OVX.2~WPF98BHGAQC4.1 size=1048576 2024-06-04T15:59:31.663 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.662+0000 7f5e9aacc780 1 > prepared part key=_multipart_PASGIP872OVX.2~WPF98BHGAQC4.2 size=841094 2024-06-04T15:59:31.663 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.662+0000 7f5e9aacc780 1 > prepared multipart upload key=PASGIP872OVX upload=WPF98BHGAQC4 tag=T2OF29NYMGDT type=write size=3986822 2024-06-04T15:59:31.664 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.664+0000 7f5e9aacc780 1 < completed part key=_multipart_GTRMEQJK675Z.2~9UFULVS2N6NG.0 size=17813 2024-06-04T15:59:31.667 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.667+0000 7f5e9aacc780 1 < completed multipart upload key=GTRMEQJK675Z upload=9UFULVS2N6NG tag=OFBEL4H4VPKS type=write size=1066389 2024-06-04T15:59:31.668 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.668+0000 7f5e9aacc780 1 > prepared operation key=GTRMEQJK675Z tag=N79X1P906VWY type=del size=695755 2024-06-04T15:59:31.669 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.669+0000 7f5e9aacc780 1 < completed delete operation key=DY9JWHWNAUO1 tag=JUJ0VUPGUO3J type=del 2024-06-04T15:59:31.671 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.671+0000 7f5e9aacc780 1 > prepared operation key=W1T4O3EAE7JN tag=KGAE34Y7G94E type=del size=2331585 2024-06-04T15:59:31.672 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.672+0000 7f5e9aacc780 1 < completed delete operation key=PNDPO2WUW7UX tag=4VNDMUJP30CN type=del 2024-06-04T15:59:31.674 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.673+0000 7f5e9aacc780 1 > prepared operation key=GTRMEQJK675Z tag=98M38Z3AQ8GE type=del size=2703298 2024-06-04T15:59:31.675 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.675+0000 7f5e9aacc780 1 < completed part key=_multipart_2BT2AXKB1RTA.2~CBE48R0YCF62.0 size=1048576 2024-06-04T15:59:31.676 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.676+0000 7f5e9aacc780 1 < completed part key=_multipart_2BT2AXKB1RTA.2~CBE48R0YCF62.1 size=28533 2024-06-04T15:59:31.679 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.679+0000 7f5e9aacc780 1 < completed multipart upload key=2BT2AXKB1RTA upload=CBE48R0YCF62 tag=ZZATYKHBBSHA type=write size=2125685 2024-06-04T15:59:31.681 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.681+0000 7f5e9aacc780 1 > prepared part key=_multipart_UW5LVIBG09SV.2~8H0RL7S9YKZ8.0 size=492467 2024-06-04T15:59:31.681 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.681+0000 7f5e9aacc780 1 > prepared multipart upload key=UW5LVIBG09SV upload=8H0RL7S9YKZ8 tag=GJ8D4JOPKPSH type=write size=1541043 2024-06-04T15:59:31.681 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.681+0000 7f5e9aacc780 1 < canceled part key=_multipart_JL69PUHT6NNT.2~8M8W1W1VS6X9.0 size=397922 2024-06-04T15:59:31.683 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.683+0000 7f5e9aacc780 1 < canceled multipart upload key=JL69PUHT6NNT upload=8M8W1W1VS6X9 tag=1H4QSGBYAQF0 type=write size=1446498 2024-06-04T15:59:31.685 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.685+0000 7f5e9aacc780 1 > prepared operation key=SUBHZJ7HUV3H tag=DJWJZF85PNFH type=del size=2826973 2024-06-04T15:59:31.686 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.686+0000 7f5e9aacc780 1 < completed part key=_multipart_QUIVPH3OB6KN.2~FFLFHA5KDDFC.0 size=1048576 2024-06-04T15:59:31.687 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.687+0000 7f5e9aacc780 1 < completed part key=_multipart_QUIVPH3OB6KN.2~FFLFHA5KDDFC.1 size=1048576 2024-06-04T15:59:31.690 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.690+0000 7f5e9aacc780 1 < completed part key=_multipart_QUIVPH3OB6KN.2~FFLFHA5KDDFC.2 size=22832 2024-06-04T15:59:31.692 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.692+0000 7f5e9aacc780 1 < completed multipart upload key=QUIVPH3OB6KN upload=FFLFHA5KDDFC tag=OQ5UD3TMZ7MW type=write size=3168560 2024-06-04T15:59:31.695 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.695+0000 7f5e9aacc780 1 > prepared part key=_multipart_DY9JWHWNAUO1.2~FTIUJLGV547R.0 size=1048576 2024-06-04T15:59:31.696 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.696+0000 7f5e9aacc780 1 > prepared part key=_multipart_DY9JWHWNAUO1.2~FTIUJLGV547R.1 size=187658 2024-06-04T15:59:31.696 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.696+0000 7f5e9aacc780 1 > prepared multipart upload key=DY9JWHWNAUO1 upload=FTIUJLGV547R tag=E2IX09ZR0931 type=write size=2284810 2024-06-04T15:59:31.698 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.697+0000 7f5e9aacc780 1 < completed delete operation key=PNDPO2WUW7UX tag=35FGRBZOMTF9 type=del 2024-06-04T15:59:31.700 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.700+0000 7f5e9aacc780 1 > prepared part key=_multipart_QJA2JPATITNH.2~C7D43JKZTUAA.0 size=1048576 2024-06-04T15:59:31.701 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.701+0000 7f5e9aacc780 1 > prepared part key=_multipart_QJA2JPATITNH.2~C7D43JKZTUAA.1 size=1048576 2024-06-04T15:59:31.702 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.702+0000 7f5e9aacc780 1 > prepared part key=_multipart_QJA2JPATITNH.2~C7D43JKZTUAA.2 size=23734 2024-06-04T15:59:31.702 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.702+0000 7f5e9aacc780 1 > prepared multipart upload key=QJA2JPATITNH upload=C7D43JKZTUAA tag=M7QM96JYRY8C type=write size=3169462 2024-06-04T15:59:31.703 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.703+0000 7f5e9aacc780 1 < completed write operation key=NJ5U8JTT32QK tag=DZXX1JCS545O type=write size=672457 2024-06-04T15:59:31.705 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.705+0000 7f5e9aacc780 1 > prepared operation key=1IKNQXU3Y2JJ tag=N6I4WCS8IBD1 type=del size=3437600 2024-06-04T15:59:31.706 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.706+0000 7f5e9aacc780 -1 < failed to complete operation key=PASGIP872OVX tag=UE42JR35VG79 type=del size=3844729: (22) Invalid argument 2024-06-04T15:59:31.709 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.709+0000 7f5e9aacc780 1 > prepared part key=_multipart_PNDPO2WUW7UX.2~2QN9O02YX7MH.0 size=1048576 2024-06-04T15:59:31.710 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.710+0000 7f5e9aacc780 1 > prepared part key=_multipart_PNDPO2WUW7UX.2~2QN9O02YX7MH.1 size=1037659 2024-06-04T15:59:31.710 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.710+0000 7f5e9aacc780 1 > prepared multipart upload key=PNDPO2WUW7UX upload=2QN9O02YX7MH tag=J363FYROEQOP type=write size=3134811 2024-06-04T15:59:31.711 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.711+0000 7f5e9aacc780 1 < completed delete operation key=9MPRI6LW3956 tag=JK5IO1ZABP1V type=del 2024-06-04T15:59:31.714 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.714+0000 7f5e9aacc780 1 > prepared part key=_multipart_UW5LVIBG09SV.2~PQ8U6L4Y2AJR.0 size=535203 2024-06-04T15:59:31.714 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.714+0000 7f5e9aacc780 1 > prepared multipart upload key=UW5LVIBG09SV upload=PQ8U6L4Y2AJR tag=M3UYKCP3Z8JE type=write size=1583779 2024-06-04T15:59:31.715 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.715+0000 7f5e9aacc780 1 < completed part key=_multipart_2BT2AXKB1RTA.2~SX1UJH7WK3D0.0 size=984192 2024-06-04T15:59:31.717 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.717+0000 7f5e9aacc780 1 < completed multipart upload key=2BT2AXKB1RTA upload=SX1UJH7WK3D0 tag=Y3RWLF3D95CO type=write size=2032768 2024-06-04T15:59:31.719 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.718+0000 7f5e9aacc780 1 > prepared operation key=UTZHANL9ER2Q tag=PQ57G5YHV75B type=del size=692282 2024-06-04T15:59:31.720 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.720+0000 7f5e9aacc780 1 < completed delete operation key=A8O0S3S45RGM tag=6M3VSM8SPZZ6 type=del 2024-06-04T15:59:31.722 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.721+0000 7f5e9aacc780 1 > prepared operation key=GTRMEQJK675Z tag=FXAE2G25ZHF3 type=del size=2148411 2024-06-04T15:59:31.723 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.723+0000 7f5e9aacc780 1 < canceled operation key=DY9JWHWNAUO1 tag=WHWAOD8RP0RQ type=del size=646249 2024-06-04T15:59:31.724 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.724+0000 7f5e9aacc780 1 > prepared operation key=PASGIP872OVX tag=CA3TRE1HD54R type=del size=1243157 2024-06-04T15:59:31.726 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.725+0000 7f5e9aacc780 1 < completed delete operation key=FBV2MAG130M6 tag=R2NOJ6LZ7L7O type=del 2024-06-04T15:59:31.727 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.727+0000 7f5e9aacc780 1 > prepared operation key=NJ5U8JTT32QK tag=14G4FJD9VA9C type=del size=2269134 2024-06-04T15:59:31.728 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.728+0000 7f5e9aacc780 1 < completed part key=_multipart_AOCB36Y5Q7B0.2~NUQV25HJELMV.0 size=1048576 2024-06-04T15:59:31.730 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.730+0000 7f5e9aacc780 1 < completed part key=_multipart_AOCB36Y5Q7B0.2~NUQV25HJELMV.1 size=1048576 2024-06-04T15:59:31.731 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.731+0000 7f5e9aacc780 1 < completed part key=_multipart_AOCB36Y5Q7B0.2~NUQV25HJELMV.2 size=126734 2024-06-04T15:59:31.733 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.733+0000 7f5e9aacc780 1 < completed multipart upload key=AOCB36Y5Q7B0 upload=NUQV25HJELMV tag=75FQ920WSRYO type=write size=3272462 2024-06-04T15:59:31.735 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.734+0000 7f5e9aacc780 1 > prepared operation key=B0HK5FJ2RGJE tag=WILU4G086KDP type=write size=637851 2024-06-04T15:59:31.736 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.736+0000 7f5e9aacc780 1 < completed part key=_multipart_PASGIP872OVX.2~WPF98BHGAQC4.0 size=1048576 2024-06-04T15:59:31.737 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.737+0000 7f5e9aacc780 1 < completed part key=_multipart_PASGIP872OVX.2~WPF98BHGAQC4.1 size=1048576 2024-06-04T15:59:31.738 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.738+0000 7f5e9aacc780 1 < completed part key=_multipart_PASGIP872OVX.2~WPF98BHGAQC4.2 size=841094 2024-06-04T15:59:31.740 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.740+0000 7f5e9aacc780 1 < completed multipart upload key=PASGIP872OVX upload=WPF98BHGAQC4 tag=T2OF29NYMGDT type=write size=3986822 2024-06-04T15:59:31.742 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.741+0000 7f5e9aacc780 1 > prepared operation key=JL69PUHT6NNT tag=E2V0N7CFD090 type=del size=1690724 2024-06-04T15:59:31.743 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.743+0000 7f5e9aacc780 1 < completed delete operation key=GTRMEQJK675Z tag=N79X1P906VWY type=del 2024-06-04T15:59:31.745 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.745+0000 7f5e9aacc780 1 > prepared part key=_multipart_UW5LVIBG09SV.2~F7YK21E1QG06.0 size=1048576 2024-06-04T15:59:31.747 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.747+0000 7f5e9aacc780 1 > prepared part key=_multipart_UW5LVIBG09SV.2~F7YK21E1QG06.1 size=1048576 2024-06-04T15:59:31.748 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.747+0000 7f5e9aacc780 1 > prepared part key=_multipart_UW5LVIBG09SV.2~F7YK21E1QG06.2 size=7663 2024-06-04T15:59:31.748 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.747+0000 7f5e9aacc780 1 > prepared multipart upload key=UW5LVIBG09SV upload=F7YK21E1QG06 tag=91XCTOZEQ4LH type=write size=3153391 2024-06-04T15:59:31.750 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.750+0000 7f5e9aacc780 1 < suggested remove operation key=W1T4O3EAE7JN tag=KGAE34Y7G94E type=del 2024-06-04T15:59:31.752 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.751+0000 7f5e9aacc780 1 > prepared operation key=AOCB36Y5Q7B0 tag=Z9S217NSMC3W type=del size=668141 2024-06-04T15:59:31.753 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.753+0000 7f5e9aacc780 1 < canceled operation key=GTRMEQJK675Z tag=98M38Z3AQ8GE type=del size=2703298 2024-06-04T15:59:31.754 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.754+0000 7f5e9aacc780 1 > prepared operation key=03ZNYG3WLMP4 tag=ZFOP2IWXY3EQ type=del size=678925 2024-06-04T15:59:31.756 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.755+0000 7f5e9aacc780 1 < completed part key=_multipart_UW5LVIBG09SV.2~8H0RL7S9YKZ8.0 size=492467 2024-06-04T15:59:31.758 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.758+0000 7f5e9aacc780 1 < completed multipart upload key=UW5LVIBG09SV upload=8H0RL7S9YKZ8 tag=GJ8D4JOPKPSH type=write size=1541043 2024-06-04T15:59:31.760 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.761+0000 7f5e9aacc780 1 > prepared part key=_multipart_HD6SNICRCDLL.2~F77J0T0L0HPO.0 size=843440 2024-06-04T15:59:31.761 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.761+0000 7f5e9aacc780 1 > prepared multipart upload key=HD6SNICRCDLL upload=F77J0T0L0HPO tag=66N4W1DS81A0 type=write size=1892016 2024-06-04T15:59:31.762 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.762+0000 7f5e9aacc780 1 < completed delete operation key=SUBHZJ7HUV3H tag=DJWJZF85PNFH type=del 2024-06-04T15:59:31.764 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.764+0000 7f5e9aacc780 1 > prepared operation key=QUIVPH3OB6KN tag=1NPYIPW7VG8M type=del size=4035233 2024-06-04T15:59:31.764 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.764+0000 7f5e9aacc780 1 < canceled part key=_multipart_DY9JWHWNAUO1.2~FTIUJLGV547R.0 size=1048576 2024-06-04T15:59:31.765 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.765+0000 7f5e9aacc780 1 < completed part key=_multipart_DY9JWHWNAUO1.2~FTIUJLGV547R.1 size=187658 2024-06-04T15:59:31.767 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.767+0000 7f5e9aacc780 1 < canceled multipart upload key=DY9JWHWNAUO1 upload=FTIUJLGV547R tag=E2IX09ZR0931 type=write size=2284810 2024-06-04T15:59:31.770 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.769+0000 7f5e9aacc780 1 > prepared part key=_multipart_03ZNYG3WLMP4.2~LO36DVK76GWC.0 size=1048576 2024-06-04T15:59:31.771 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.770+0000 7f5e9aacc780 1 > prepared part key=_multipart_03ZNYG3WLMP4.2~LO36DVK76GWC.1 size=610995 2024-06-04T15:59:31.771 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.770+0000 7f5e9aacc780 1 > prepared multipart upload key=03ZNYG3WLMP4 upload=LO36DVK76GWC tag=L99HL6WV8QKC type=write size=2708147 2024-06-04T15:59:31.772 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.772+0000 7f5e9aacc780 1 < completed part key=_multipart_QJA2JPATITNH.2~C7D43JKZTUAA.0 size=1048576 2024-06-04T15:59:31.773 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.773+0000 7f5e9aacc780 1 < completed part key=_multipart_QJA2JPATITNH.2~C7D43JKZTUAA.1 size=1048576 2024-06-04T15:59:31.774 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.774+0000 7f5e9aacc780 1 < completed part key=_multipart_QJA2JPATITNH.2~C7D43JKZTUAA.2 size=23734 2024-06-04T15:59:31.777 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.776+0000 7f5e9aacc780 1 < completed multipart upload key=QJA2JPATITNH upload=C7D43JKZTUAA tag=M7QM96JYRY8C type=write size=3169462 2024-06-04T15:59:31.779 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.779+0000 7f5e9aacc780 1 > prepared part key=_multipart_9MPRI6LW3956.2~SMHWX4P3X2KE.0 size=1048576 2024-06-04T15:59:31.780 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.780+0000 7f5e9aacc780 1 > prepared part key=_multipart_9MPRI6LW3956.2~SMHWX4P3X2KE.1 size=296301 2024-06-04T15:59:31.780 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.780+0000 7f5e9aacc780 1 > prepared multipart upload key=9MPRI6LW3956 upload=SMHWX4P3X2KE tag=C8HZAEMH9XWG type=write size=2393453 2024-06-04T15:59:31.782 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.782+0000 7f5e9aacc780 1 < canceled operation key=1IKNQXU3Y2JJ tag=N6I4WCS8IBD1 type=del size=3437600 2024-06-04T15:59:31.785 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.785+0000 7f5e9aacc780 1 > prepared part key=_multipart_Q2V1ICTBSCV1.2~C1HKDGN0GEFN.0 size=1048576 2024-06-04T15:59:31.786 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.786+0000 7f5e9aacc780 1 > prepared part key=_multipart_Q2V1ICTBSCV1.2~C1HKDGN0GEFN.1 size=520898 2024-06-04T15:59:31.786 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.786+0000 7f5e9aacc780 1 > prepared multipart upload key=Q2V1ICTBSCV1 upload=C1HKDGN0GEFN tag=YREPGE6IT3O8 type=write size=2618050 2024-06-04T15:59:31.787 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.787+0000 7f5e9aacc780 1 < completed part key=_multipart_PNDPO2WUW7UX.2~2QN9O02YX7MH.0 size=1048576 2024-06-04T15:59:31.788 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.788+0000 7f5e9aacc780 1 < completed part key=_multipart_PNDPO2WUW7UX.2~2QN9O02YX7MH.1 size=1037659 2024-06-04T15:59:31.791 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.790+0000 7f5e9aacc780 1 < completed multipart upload key=PNDPO2WUW7UX upload=2QN9O02YX7MH tag=J363FYROEQOP type=write size=3134811 2024-06-04T15:59:31.793 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.793+0000 7f5e9aacc780 1 > prepared part key=_multipart_4W5HB9WQQHR6.2~0T3TXP3D1WIR.0 size=113175 2024-06-04T15:59:31.793 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.793+0000 7f5e9aacc780 1 > prepared multipart upload key=4W5HB9WQQHR6 upload=0T3TXP3D1WIR tag=39OX8TYPR86T type=write size=1161751 2024-06-04T15:59:31.795 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.794+0000 7f5e9aacc780 1 < completed part key=_multipart_UW5LVIBG09SV.2~PQ8U6L4Y2AJR.0 size=535203 2024-06-04T15:59:31.797 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.797+0000 7f5e9aacc780 1 < completed multipart upload key=UW5LVIBG09SV upload=PQ8U6L4Y2AJR tag=M3UYKCP3Z8JE type=write size=1583779 2024-06-04T15:59:31.799 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.798+0000 7f5e9aacc780 1 > prepared operation key=NJ5U8JTT32QK tag=8GIERPDNPOTU type=del size=2361018 2024-06-04T15:59:31.800 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.800+0000 7f5e9aacc780 1 < completed delete operation key=UTZHANL9ER2Q tag=PQ57G5YHV75B type=del 2024-06-04T15:59:31.803 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.803+0000 7f5e9aacc780 1 > prepared part key=_multipart_SUBHZJ7HUV3H.2~UWMICY3DL8SJ.0 size=964694 2024-06-04T15:59:31.803 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.803+0000 7f5e9aacc780 1 > prepared multipart upload key=SUBHZJ7HUV3H upload=UWMICY3DL8SJ tag=3LKQ0PSK0EXD type=write size=2013270 2024-06-04T15:59:31.805 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.804+0000 7f5e9aacc780 1 < completed delete operation key=GTRMEQJK675Z tag=FXAE2G25ZHF3 type=del 2024-06-04T15:59:31.807 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.807+0000 7f5e9aacc780 1 > prepared part key=_multipart_GCPC9OJH7KWU.2~5QGCQ1V1ZN6Y.0 size=1048576 2024-06-04T15:59:31.808 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.808+0000 7f5e9aacc780 1 > prepared part key=_multipart_GCPC9OJH7KWU.2~5QGCQ1V1ZN6Y.1 size=1048576 2024-06-04T15:59:31.809 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.809+0000 7f5e9aacc780 1 > prepared part key=_multipart_GCPC9OJH7KWU.2~5QGCQ1V1ZN6Y.2 size=551948 2024-06-04T15:59:31.809 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.809+0000 7f5e9aacc780 1 > prepared multipart upload key=GCPC9OJH7KWU upload=5QGCQ1V1ZN6Y tag=Q46AUTH91RWF type=write size=3697676 2024-06-04T15:59:31.811 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.810+0000 7f5e9aacc780 1 < canceled operation key=PASGIP872OVX tag=CA3TRE1HD54R type=del size=1243157 2024-06-04T15:59:31.812 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.812+0000 7f5e9aacc780 1 > prepared operation key=Q2V1ICTBSCV1 tag=ZC77WNR1X5KI type=del size=2385374 2024-06-04T15:59:31.814 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.813+0000 7f5e9aacc780 1 < completed delete operation key=NJ5U8JTT32QK tag=14G4FJD9VA9C type=del 2024-06-04T15:59:31.815 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.815+0000 7f5e9aacc780 1 > prepared operation key=UTZHANL9ER2Q tag=YSMW2QNSXGTJ type=del size=176177 2024-06-04T15:59:31.817 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.816+0000 7f5e9aacc780 1 < completed write operation key=B0HK5FJ2RGJE tag=WILU4G086KDP type=write size=637851 2024-06-04T15:59:31.819 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.819+0000 7f5e9aacc780 1 > prepared operation key=FBV2MAG130M6 tag=TBY2E9YG1VCB type=del size=3648815 2024-06-04T15:59:31.820 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.820+0000 7f5e9aacc780 1 < completed delete operation key=JL69PUHT6NNT tag=E2V0N7CFD090 type=del 2024-06-04T15:59:31.823 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.823+0000 7f5e9aacc780 1 > prepared part key=_multipart_DY9JWHWNAUO1.2~OPGFY1BSAJOX.0 size=1048576 2024-06-04T15:59:31.824 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.824+0000 7f5e9aacc780 1 > prepared part key=_multipart_DY9JWHWNAUO1.2~OPGFY1BSAJOX.1 size=1048576 2024-06-04T15:59:31.825 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.825+0000 7f5e9aacc780 1 > prepared part key=_multipart_DY9JWHWNAUO1.2~OPGFY1BSAJOX.2 size=228188 2024-06-04T15:59:31.825 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.825+0000 7f5e9aacc780 1 > prepared multipart upload key=DY9JWHWNAUO1 upload=OPGFY1BSAJOX tag=DFATRZ5KHQK0 type=write size=3373916 2024-06-04T15:59:31.827 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.826+0000 7f5e9aacc780 1 < completed part key=_multipart_UW5LVIBG09SV.2~F7YK21E1QG06.0 size=1048576 2024-06-04T15:59:31.834 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.833+0000 7f5e9aacc780 1 < completed part key=_multipart_UW5LVIBG09SV.2~F7YK21E1QG06.1 size=1048576 2024-06-04T15:59:31.835 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.835+0000 7f5e9aacc780 1 < completed part key=_multipart_UW5LVIBG09SV.2~F7YK21E1QG06.2 size=7663 2024-06-04T15:59:31.837 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.837+0000 7f5e9aacc780 1 < completed multipart upload key=UW5LVIBG09SV upload=F7YK21E1QG06 tag=91XCTOZEQ4LH type=write size=3153391 2024-06-04T15:59:31.840 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.840+0000 7f5e9aacc780 1 > prepared part key=_multipart_GCPC9OJH7KWU.2~G50ODPB6KE7Z.0 size=536628 2024-06-04T15:59:31.840 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.840+0000 7f5e9aacc780 1 > prepared multipart upload key=GCPC9OJH7KWU upload=G50ODPB6KE7Z tag=TDHO8AWEV2R1 type=write size=1585204 2024-06-04T15:59:31.842 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.841+0000 7f5e9aacc780 1 < completed delete operation key=AOCB36Y5Q7B0 tag=Z9S217NSMC3W type=del 2024-06-04T15:59:31.843 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.843+0000 7f5e9aacc780 1 > prepared operation key=GTRMEQJK675Z tag=33BWLKATMFMF type=write size=642065 2024-06-04T15:59:31.844 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.845+0000 7f5e9aacc780 1 < completed delete operation key=03ZNYG3WLMP4 tag=ZFOP2IWXY3EQ type=del 2024-06-04T15:59:31.847 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.847+0000 7f5e9aacc780 1 > prepared part key=_multipart_7S9S3MIG7WIT.2~386DKTWUGYWR.0 size=356231 2024-06-04T15:59:31.847 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.847+0000 7f5e9aacc780 1 > prepared multipart upload key=7S9S3MIG7WIT upload=386DKTWUGYWR tag=ZYN0O4W2J330 type=write size=1404807 2024-06-04T15:59:31.849 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.848+0000 7f5e9aacc780 1 < completed part key=_multipart_HD6SNICRCDLL.2~F77J0T0L0HPO.0 size=843440 2024-06-04T15:59:31.851 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.851+0000 7f5e9aacc780 1 < completed multipart upload key=HD6SNICRCDLL upload=F77J0T0L0HPO tag=66N4W1DS81A0 type=write size=1892016 2024-06-04T15:59:31.852 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.852+0000 7f5e9aacc780 1 > prepared operation key=UTZHANL9ER2Q tag=AUJA2LSFP7OG type=del size=4067981 2024-06-04T15:59:31.854 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.854+0000 7f5e9aacc780 1 < completed delete operation key=QUIVPH3OB6KN tag=1NPYIPW7VG8M type=del 2024-06-04T15:59:31.856 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.856+0000 7f5e9aacc780 1 > prepared part key=_multipart_B0HK5FJ2RGJE.2~VCSADJW3CU7K.0 size=1048576 2024-06-04T15:59:31.857 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.857+0000 7f5e9aacc780 1 > prepared part key=_multipart_B0HK5FJ2RGJE.2~VCSADJW3CU7K.1 size=662682 2024-06-04T15:59:31.857 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.857+0000 7f5e9aacc780 1 > prepared multipart upload key=B0HK5FJ2RGJE upload=VCSADJW3CU7K tag=FXS6U3K39M0Y type=write size=2759834 2024-06-04T15:59:31.859 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.858+0000 7f5e9aacc780 1 < completed part key=_multipart_03ZNYG3WLMP4.2~LO36DVK76GWC.0 size=1048576 2024-06-04T15:59:31.860 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.859+0000 7f5e9aacc780 1 < completed part key=_multipart_03ZNYG3WLMP4.2~LO36DVK76GWC.1 size=610995 2024-06-04T15:59:31.862 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.862+0000 7f5e9aacc780 1 < completed multipart upload key=03ZNYG3WLMP4 upload=LO36DVK76GWC tag=L99HL6WV8QKC type=write size=2708147 2024-06-04T15:59:31.864 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.864+0000 7f5e9aacc780 1 > prepared part key=_multipart_UW5LVIBG09SV.2~CW1VI0CQZC4P.0 size=1048576 2024-06-04T15:59:31.865 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.865+0000 7f5e9aacc780 1 > prepared part key=_multipart_UW5LVIBG09SV.2~CW1VI0CQZC4P.1 size=559487 2024-06-04T15:59:31.866 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.865+0000 7f5e9aacc780 1 > prepared multipart upload key=UW5LVIBG09SV upload=CW1VI0CQZC4P tag=XMSGGD2HTFZQ type=write size=2656639 2024-06-04T15:59:31.867 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.867+0000 7f5e9aacc780 1 < completed part key=_multipart_9MPRI6LW3956.2~SMHWX4P3X2KE.0 size=1048576 2024-06-04T15:59:31.867 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.867+0000 7f5e9aacc780 1 < canceled part key=_multipart_9MPRI6LW3956.2~SMHWX4P3X2KE.1 size=296301 2024-06-04T15:59:31.869 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.869+0000 7f5e9aacc780 1 < canceled multipart upload key=9MPRI6LW3956 upload=SMHWX4P3X2KE tag=C8HZAEMH9XWG type=write size=2393453 2024-06-04T15:59:31.871 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.870+0000 7f5e9aacc780 1 > prepared operation key=RP8K6QJUZAH1 tag=1LL4XRPOCPNY type=del size=4111426 2024-06-04T15:59:31.872 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.872+0000 7f5e9aacc780 1 < completed part key=_multipart_Q2V1ICTBSCV1.2~C1HKDGN0GEFN.0 size=1048576 2024-06-04T15:59:31.873 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.873+0000 7f5e9aacc780 1 < completed part key=_multipart_Q2V1ICTBSCV1.2~C1HKDGN0GEFN.1 size=520898 2024-06-04T15:59:31.876 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.876+0000 7f5e9aacc780 1 < completed multipart upload key=Q2V1ICTBSCV1 upload=C1HKDGN0GEFN tag=YREPGE6IT3O8 type=write size=2618050 2024-06-04T15:59:31.877 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.877+0000 7f5e9aacc780 1 > prepared operation key=A8O0S3S45RGM tag=HEU1DZN8RPHE type=del size=2101606 2024-06-04T15:59:31.879 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.879+0000 7f5e9aacc780 1 < completed part key=_multipart_4W5HB9WQQHR6.2~0T3TXP3D1WIR.0 size=113175 2024-06-04T15:59:31.881 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.881+0000 7f5e9aacc780 1 < completed multipart upload key=4W5HB9WQQHR6 upload=0T3TXP3D1WIR tag=39OX8TYPR86T type=write size=1161751 2024-06-04T15:59:31.884 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.884+0000 7f5e9aacc780 1 > prepared part key=_multipart_Q4OFQI0F5YLG.2~HKIONRO2AITA.0 size=123121 2024-06-04T15:59:31.884 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.884+0000 7f5e9aacc780 1 > prepared multipart upload key=Q4OFQI0F5YLG upload=HKIONRO2AITA tag=K86FWAV1RE73 type=write size=1171697 2024-06-04T15:59:31.886 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.886+0000 7f5e9aacc780 1 < completed delete operation key=NJ5U8JTT32QK tag=8GIERPDNPOTU type=del 2024-06-04T15:59:31.889 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.889+0000 7f5e9aacc780 1 > prepared part key=_multipart_UTZHANL9ER2Q.2~HKU2XDOKDYKJ.0 size=83615 2024-06-04T15:59:31.889 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.889+0000 7f5e9aacc780 1 > prepared multipart upload key=UTZHANL9ER2Q upload=HKU2XDOKDYKJ tag=7OCK1NX23REP type=write size=1132191 2024-06-04T15:59:31.890 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.890+0000 7f5e9aacc780 1 < completed part key=_multipart_SUBHZJ7HUV3H.2~UWMICY3DL8SJ.0 size=964694 2024-06-04T15:59:31.892 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.892+0000 7f5e9aacc780 1 < completed multipart upload key=SUBHZJ7HUV3H upload=UWMICY3DL8SJ tag=3LKQ0PSK0EXD type=write size=2013270 2024-06-04T15:59:31.895 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.895+0000 7f5e9aacc780 1 > prepared part key=_multipart_XH0N984YVGKP.2~183WOK89RQ18.0 size=1048576 2024-06-04T15:59:31.896 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.896+0000 7f5e9aacc780 1 > prepared part key=_multipart_XH0N984YVGKP.2~183WOK89RQ18.1 size=1041609 2024-06-04T15:59:31.896 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.896+0000 7f5e9aacc780 1 > prepared multipart upload key=XH0N984YVGKP upload=183WOK89RQ18 tag=GJF4XBDEE7YY type=write size=3138761 2024-06-04T15:59:31.898 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.897+0000 7f5e9aacc780 1 < completed part key=_multipart_GCPC9OJH7KWU.2~5QGCQ1V1ZN6Y.0 size=1048576 2024-06-04T15:59:31.899 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.898+0000 7f5e9aacc780 1 < completed part key=_multipart_GCPC9OJH7KWU.2~5QGCQ1V1ZN6Y.1 size=1048576 2024-06-04T15:59:31.900 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.900+0000 7f5e9aacc780 1 < completed part key=_multipart_GCPC9OJH7KWU.2~5QGCQ1V1ZN6Y.2 size=551948 2024-06-04T15:59:31.902 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.902+0000 7f5e9aacc780 1 < completed multipart upload key=GCPC9OJH7KWU upload=5QGCQ1V1ZN6Y tag=Q46AUTH91RWF type=write size=3697676 2024-06-04T15:59:31.904 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.903+0000 7f5e9aacc780 1 > prepared operation key=9MPRI6LW3956 tag=RR09D969C42L type=del size=2848485 2024-06-04T15:59:31.905 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.905+0000 7f5e9aacc780 1 < completed delete operation key=Q2V1ICTBSCV1 tag=ZC77WNR1X5KI type=del 2024-06-04T15:59:31.908 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.908+0000 7f5e9aacc780 1 > prepared part key=_multipart_9MPRI6LW3956.2~PCCSUHEYNYRI.0 size=859719 2024-06-04T15:59:31.908 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.908+0000 7f5e9aacc780 1 > prepared multipart upload key=9MPRI6LW3956 upload=PCCSUHEYNYRI tag=I7UEMGTRB02H type=write size=1908295 2024-06-04T15:59:31.909 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.909+0000 7f5e9aacc780 1 < completed delete operation key=UTZHANL9ER2Q tag=YSMW2QNSXGTJ type=del 2024-06-04T15:59:31.912 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.912+0000 7f5e9aacc780 1 > prepared part key=_multipart_PASGIP872OVX.2~2SCA2GWJK9RK.0 size=1048576 2024-06-04T15:59:31.913 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.913+0000 7f5e9aacc780 1 > prepared part key=_multipart_PASGIP872OVX.2~2SCA2GWJK9RK.1 size=900577 2024-06-04T15:59:31.913 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.913+0000 7f5e9aacc780 1 > prepared multipart upload key=PASGIP872OVX upload=2SCA2GWJK9RK tag=NIEGT0YVWM3A type=write size=2997729 2024-06-04T15:59:31.915 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.915+0000 7f5e9aacc780 1 < completed delete operation key=FBV2MAG130M6 tag=TBY2E9YG1VCB type=del 2024-06-04T15:59:31.916 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.916+0000 7f5e9aacc780 1 > prepared operation key=B0HK5FJ2RGJE tag=J7D8AM9FT78B type=del size=3733520 2024-06-04T15:59:31.918 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.918+0000 7f5e9aacc780 1 < completed part key=_multipart_DY9JWHWNAUO1.2~OPGFY1BSAJOX.0 size=1048576 2024-06-04T15:59:31.919 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.919+0000 7f5e9aacc780 1 < completed part key=_multipart_DY9JWHWNAUO1.2~OPGFY1BSAJOX.1 size=1048576 2024-06-04T15:59:31.920 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.920+0000 7f5e9aacc780 1 < completed part key=_multipart_DY9JWHWNAUO1.2~OPGFY1BSAJOX.2 size=228188 2024-06-04T15:59:31.922 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.922+0000 7f5e9aacc780 1 < completed multipart upload key=DY9JWHWNAUO1 upload=OPGFY1BSAJOX tag=DFATRZ5KHQK0 type=write size=3373916 2024-06-04T15:59:31.924 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.923+0000 7f5e9aacc780 1 > prepared operation key=UTZHANL9ER2Q tag=18JKXELG7TIE type=del size=3293868 2024-06-04T15:59:31.924 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.924+0000 7f5e9aacc780 1 < canceled part key=_multipart_GCPC9OJH7KWU.2~G50ODPB6KE7Z.0 size=536628 2024-06-04T15:59:31.926 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.926+0000 7f5e9aacc780 1 < canceled multipart upload key=GCPC9OJH7KWU upload=G50ODPB6KE7Z tag=TDHO8AWEV2R1 type=write size=1585204 2024-06-04T15:59:31.927 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.927+0000 7f5e9aacc780 1 > prepared operation key=PCLJXQHJ4HTY tag=0YLRYYIYD48W type=del size=3427066 2024-06-04T15:59:31.929 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.929+0000 7f5e9aacc780 1 < completed write operation key=GTRMEQJK675Z tag=33BWLKATMFMF type=write size=642065 2024-06-04T15:59:31.930 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.930+0000 7f5e9aacc780 1 > prepared operation key=Q2V1ICTBSCV1 tag=G9C8GTLG5BVS type=del size=3302648 2024-06-04T15:59:31.932 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.931+0000 7f5e9aacc780 1 < completed part key=_multipart_7S9S3MIG7WIT.2~386DKTWUGYWR.0 size=356231 2024-06-04T15:59:31.934 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.934+0000 7f5e9aacc780 1 < completed multipart upload key=7S9S3MIG7WIT upload=386DKTWUGYWR tag=ZYN0O4W2J330 type=write size=1404807 2024-06-04T15:59:31.937 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.937+0000 7f5e9aacc780 1 > prepared part key=_multipart_FBV2MAG130M6.2~9L5ZRALUHJ4A.0 size=1039655 2024-06-04T15:59:31.937 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.937+0000 7f5e9aacc780 1 > prepared multipart upload key=FBV2MAG130M6 upload=9L5ZRALUHJ4A tag=SF4VP3F7SZF7 type=write size=2088231 2024-06-04T15:59:31.938 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.938+0000 7f5e9aacc780 1 < completed delete operation key=UTZHANL9ER2Q tag=AUJA2LSFP7OG type=del 2024-06-04T15:59:31.941 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.941+0000 7f5e9aacc780 1 > prepared part key=_multipart_4W5HB9WQQHR6.2~FOD8FFYBH5B1.0 size=1048576 2024-06-04T15:59:31.942 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.942+0000 7f5e9aacc780 1 > prepared part key=_multipart_4W5HB9WQQHR6.2~FOD8FFYBH5B1.1 size=1048576 2024-06-04T15:59:31.943 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.943+0000 7f5e9aacc780 1 > prepared part key=_multipart_4W5HB9WQQHR6.2~FOD8FFYBH5B1.2 size=786011 2024-06-04T15:59:31.943 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.943+0000 7f5e9aacc780 1 > prepared multipart upload key=4W5HB9WQQHR6 upload=FOD8FFYBH5B1 tag=AP1D332SKUEK type=write size=3931739 2024-06-04T15:59:31.944 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.944+0000 7f5e9aacc780 1 < completed part key=_multipart_B0HK5FJ2RGJE.2~VCSADJW3CU7K.0 size=1048576 2024-06-04T15:59:31.946 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.945+0000 7f5e9aacc780 1 < completed part key=_multipart_B0HK5FJ2RGJE.2~VCSADJW3CU7K.1 size=662682 2024-06-04T15:59:31.948 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.948+0000 7f5e9aacc780 1 < completed multipart upload key=B0HK5FJ2RGJE upload=VCSADJW3CU7K tag=FXS6U3K39M0Y type=write size=2759834 2024-06-04T15:59:31.950 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.949+0000 7f5e9aacc780 1 > prepared operation key=NJ5U8JTT32QK tag=RC87E68PGLO1 type=del size=40976 2024-06-04T15:59:31.951 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.951+0000 7f5e9aacc780 1 < completed part key=_multipart_UW5LVIBG09SV.2~CW1VI0CQZC4P.0 size=1048576 2024-06-04T15:59:31.952 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.952+0000 7f5e9aacc780 1 < completed part key=_multipart_UW5LVIBG09SV.2~CW1VI0CQZC4P.1 size=559487 2024-06-04T15:59:31.955 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.955+0000 7f5e9aacc780 1 < completed multipart upload key=UW5LVIBG09SV upload=CW1VI0CQZC4P tag=XMSGGD2HTFZQ type=write size=2656639 2024-06-04T15:59:31.957 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.956+0000 7f5e9aacc780 1 > prepared operation key=PCLJXQHJ4HTY tag=F2LF7BVKC5P6 type=del size=3328656 2024-06-04T15:59:31.960 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.959+0000 7f5e9aacc780 1 < suggested remove operation key=RP8K6QJUZAH1 tag=1LL4XRPOCPNY type=del 2024-06-04T15:59:31.962 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.962+0000 7f5e9aacc780 1 > prepared part key=_multipart_PASGIP872OVX.2~IUNEF03W5ICX.0 size=1048576 2024-06-04T15:59:31.963 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.963+0000 7f5e9aacc780 1 > prepared part key=_multipart_PASGIP872OVX.2~IUNEF03W5ICX.1 size=1048576 2024-06-04T15:59:31.964 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.964+0000 7f5e9aacc780 1 > prepared part key=_multipart_PASGIP872OVX.2~IUNEF03W5ICX.2 size=985577 2024-06-04T15:59:31.964 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.964+0000 7f5e9aacc780 1 > prepared multipart upload key=PASGIP872OVX upload=IUNEF03W5ICX tag=HKIB039J5TEJ type=write size=4131305 2024-06-04T15:59:31.968 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.967+0000 7f5e9aacc780 1 < suggested remove operation key=A8O0S3S45RGM tag=HEU1DZN8RPHE type=del 2024-06-04T15:59:31.970 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.970+0000 7f5e9aacc780 1 > prepared part key=_multipart_1IKNQXU3Y2JJ.2~P65ICZD1KGAW.0 size=481366 2024-06-04T15:59:31.970 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.970+0000 7f5e9aacc780 1 > prepared multipart upload key=1IKNQXU3Y2JJ upload=P65ICZD1KGAW tag=K49A1U2SMXD6 type=write size=1529942 2024-06-04T15:59:31.973 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.971+0000 7f5e9aacc780 1 < completed part key=_multipart_Q4OFQI0F5YLG.2~HKIONRO2AITA.0 size=123121 2024-06-04T15:59:31.974 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.974+0000 7f5e9aacc780 1 < completed multipart upload key=Q4OFQI0F5YLG upload=HKIONRO2AITA tag=K86FWAV1RE73 type=write size=1171697 2024-06-04T15:59:31.977 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.977+0000 7f5e9aacc780 1 > prepared part key=_multipart_4W5HB9WQQHR6.2~C39YOGFRV5Z1.0 size=824661 2024-06-04T15:59:31.977 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.977+0000 7f5e9aacc780 1 > prepared multipart upload key=4W5HB9WQQHR6 upload=C39YOGFRV5Z1 tag=XAZBK2I71VEC type=write size=1873237 2024-06-04T15:59:31.978 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.978+0000 7f5e9aacc780 1 < completed part key=_multipart_UTZHANL9ER2Q.2~HKU2XDOKDYKJ.0 size=83615 2024-06-04T15:59:31.981 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.980+0000 7f5e9aacc780 1 < completed multipart upload key=UTZHANL9ER2Q upload=HKU2XDOKDYKJ tag=7OCK1NX23REP type=write size=1132191 2024-06-04T15:59:31.983 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.983+0000 7f5e9aacc780 1 > prepared part key=_multipart_PCLJXQHJ4HTY.2~GDBP9968D7UW.0 size=373867 2024-06-04T15:59:31.983 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.983+0000 7f5e9aacc780 1 > prepared multipart upload key=PCLJXQHJ4HTY upload=GDBP9968D7UW tag=D6L64ICKOPAI type=write size=1422443 2024-06-04T15:59:31.984 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.984+0000 7f5e9aacc780 1 < completed part key=_multipart_XH0N984YVGKP.2~183WOK89RQ18.0 size=1048576 2024-06-04T15:59:31.986 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.986+0000 7f5e9aacc780 1 < completed part key=_multipart_XH0N984YVGKP.2~183WOK89RQ18.1 size=1041609 2024-06-04T15:59:31.988 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.988+0000 7f5e9aacc780 1 < completed multipart upload key=XH0N984YVGKP upload=183WOK89RQ18 tag=GJF4XBDEE7YY type=write size=3138761 2024-06-04T15:59:31.990 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.990+0000 7f5e9aacc780 1 > prepared operation key=QUIVPH3OB6KN tag=PC3XXB29WLS1 type=write size=476648 2024-06-04T15:59:31.993 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.993+0000 7f5e9aacc780 1 < suggested remove operation key=9MPRI6LW3956 tag=RR09D969C42L type=del 2024-06-04T15:59:31.995 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.994+0000 7f5e9aacc780 1 > prepared operation key=1IKNQXU3Y2JJ tag=CSL5P8O43HIV type=del size=3276436 2024-06-04T15:59:31.996 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.996+0000 7f5e9aacc780 1 < completed part key=_multipart_9MPRI6LW3956.2~PCCSUHEYNYRI.0 size=859719 2024-06-04T15:59:31.998 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.998+0000 7f5e9aacc780 1 < completed multipart upload key=9MPRI6LW3956 upload=PCCSUHEYNYRI tag=I7UEMGTRB02H type=write size=1908295 2024-06-04T15:59:32.000 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:31.999+0000 7f5e9aacc780 1 > prepared operation key=Q2V1ICTBSCV1 tag=U99SRKVF2Q24 type=del size=1816475 2024-06-04T15:59:32.001 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.001+0000 7f5e9aacc780 1 < completed part key=_multipart_PASGIP872OVX.2~2SCA2GWJK9RK.0 size=1048576 2024-06-04T15:59:32.003 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.003+0000 7f5e9aacc780 1 < completed part key=_multipart_PASGIP872OVX.2~2SCA2GWJK9RK.1 size=900577 2024-06-04T15:59:32.005 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.005+0000 7f5e9aacc780 1 < completed multipart upload key=PASGIP872OVX upload=2SCA2GWJK9RK tag=NIEGT0YVWM3A type=write size=2997729 2024-06-04T15:59:32.007 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.006+0000 7f5e9aacc780 1 > prepared operation key=9MPRI6LW3956 tag=1Z0CQHO78X6R type=write size=683184 2024-06-04T15:59:32.010 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.010+0000 7f5e9aacc780 1 < suggested remove operation key=B0HK5FJ2RGJE tag=J7D8AM9FT78B type=del 2024-06-04T15:59:32.011 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.011+0000 7f5e9aacc780 1 > prepared operation key=7S9S3MIG7WIT tag=9ZHEZEOZ9CQK type=del size=2696102 2024-06-04T15:59:32.013 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.013+0000 7f5e9aacc780 1 < completed delete operation key=UTZHANL9ER2Q tag=18JKXELG7TIE type=del 2024-06-04T15:59:32.014 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.014+0000 7f5e9aacc780 1 > prepared operation key=AOCB36Y5Q7B0 tag=1XOTHF1WT546 type=write size=81886 2024-06-04T15:59:32.016 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.016+0000 7f5e9aacc780 1 < completed delete operation key=PCLJXQHJ4HTY tag=0YLRYYIYD48W type=del 2024-06-04T15:59:32.017 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.017+0000 7f5e9aacc780 1 > prepared operation key=QJA2JPATITNH tag=PMYITRK476MD type=del size=1697740 2024-06-04T15:59:32.019 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.019+0000 7f5e9aacc780 1 < completed delete operation key=Q2V1ICTBSCV1 tag=G9C8GTLG5BVS type=del 2024-06-04T15:59:32.021 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.020+0000 7f5e9aacc780 1 > prepared operation key=NJ5U8JTT32QK tag=S4ZKPBZ5QCW2 type=del size=664749 2024-06-04T15:59:32.022 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.022+0000 7f5e9aacc780 1 < completed part key=_multipart_FBV2MAG130M6.2~9L5ZRALUHJ4A.0 size=1039655 2024-06-04T15:59:32.024 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.024+0000 7f5e9aacc780 1 < completed multipart upload key=FBV2MAG130M6 upload=9L5ZRALUHJ4A tag=SF4VP3F7SZF7 type=write size=2088231 2024-06-04T15:59:32.025 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.025+0000 7f5e9aacc780 1 > prepared operation key=QUIVPH3OB6KN tag=2G6F6HKZ3I4U type=del size=1993632 2024-06-04T15:59:32.026 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.025+0000 7f5e9aacc780 1 < canceled part key=_multipart_4W5HB9WQQHR6.2~FOD8FFYBH5B1.0 size=1048576 2024-06-04T15:59:32.027 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.026+0000 7f5e9aacc780 1 < completed part key=_multipart_4W5HB9WQQHR6.2~FOD8FFYBH5B1.1 size=1048576 2024-06-04T15:59:32.028 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.028+0000 7f5e9aacc780 1 < completed part key=_multipart_4W5HB9WQQHR6.2~FOD8FFYBH5B1.2 size=786011 2024-06-04T15:59:32.031 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.030+0000 7f5e9aacc780 1 < canceled multipart upload key=4W5HB9WQQHR6 upload=FOD8FFYBH5B1 tag=AP1D332SKUEK type=write size=3931739 2024-06-04T15:59:32.034 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.034+0000 7f5e9aacc780 1 > prepared part key=_multipart_1IKNQXU3Y2JJ.2~CDIX56NX9HQX.0 size=1048576 2024-06-04T15:59:32.035 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.035+0000 7f5e9aacc780 1 > prepared part key=_multipart_1IKNQXU3Y2JJ.2~CDIX56NX9HQX.1 size=685410 2024-06-04T15:59:32.035 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.035+0000 7f5e9aacc780 1 > prepared multipart upload key=1IKNQXU3Y2JJ upload=CDIX56NX9HQX tag=HE119AIYT1Y4 type=write size=2782562 2024-06-04T15:59:32.038 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.038+0000 7f5e9aacc780 1 < suggested remove operation key=NJ5U8JTT32QK tag=RC87E68PGLO1 type=del 2024-06-04T15:59:32.041 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.041+0000 7f5e9aacc780 1 > prepared part key=_multipart_SUBHZJ7HUV3H.2~92IVBXUUJMWB.0 size=1048576 2024-06-04T15:59:32.042 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.042+0000 7f5e9aacc780 1 > prepared part key=_multipart_SUBHZJ7HUV3H.2~92IVBXUUJMWB.1 size=1048576 2024-06-04T15:59:32.043 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.043+0000 7f5e9aacc780 1 > prepared part key=_multipart_SUBHZJ7HUV3H.2~92IVBXUUJMWB.2 size=906537 2024-06-04T15:59:32.043 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.043+0000 7f5e9aacc780 1 > prepared multipart upload key=SUBHZJ7HUV3H upload=92IVBXUUJMWB tag=GVWUY7ZTL1C0 type=write size=4052265 2024-06-04T15:59:32.047 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.046+0000 7f5e9aacc780 1 < suggested update operation key=PCLJXQHJ4HTY tag=F2LF7BVKC5P6 type=del size=3328656 2024-06-04T15:59:32.049 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.049+0000 7f5e9aacc780 1 > prepared part key=_multipart_1IKNQXU3Y2JJ.2~6ASPDYD9MKMW.0 size=765057 2024-06-04T15:59:32.049 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.049+0000 7f5e9aacc780 1 > prepared multipart upload key=1IKNQXU3Y2JJ upload=6ASPDYD9MKMW tag=LOORLOKLD988 type=write size=1813633 2024-06-04T15:59:32.051 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.050+0000 7f5e9aacc780 1 < completed part key=_multipart_PASGIP872OVX.2~IUNEF03W5ICX.0 size=1048576 2024-06-04T15:59:32.052 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.052+0000 7f5e9aacc780 1 < completed part key=_multipart_PASGIP872OVX.2~IUNEF03W5ICX.1 size=1048576 2024-06-04T15:59:32.053 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.053+0000 7f5e9aacc780 1 < completed part key=_multipart_PASGIP872OVX.2~IUNEF03W5ICX.2 size=985577 2024-06-04T15:59:32.055 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.055+0000 7f5e9aacc780 1 < completed multipart upload key=PASGIP872OVX upload=IUNEF03W5ICX tag=HKIB039J5TEJ type=write size=4131305 2024-06-04T15:59:32.058 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.058+0000 7f5e9aacc780 1 > prepared part key=_multipart_DY9JWHWNAUO1.2~AHEOAMT04X86.0 size=1048576 2024-06-04T15:59:32.059 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.059+0000 7f5e9aacc780 1 > prepared part key=_multipart_DY9JWHWNAUO1.2~AHEOAMT04X86.1 size=1048576 2024-06-04T15:59:32.060 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.060+0000 7f5e9aacc780 1 > prepared part key=_multipart_DY9JWHWNAUO1.2~AHEOAMT04X86.2 size=222497 2024-06-04T15:59:32.060 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.060+0000 7f5e9aacc780 1 > prepared multipart upload key=DY9JWHWNAUO1 upload=AHEOAMT04X86 tag=QFA3IPUS4PS2 type=write size=3368225 2024-06-04T15:59:32.062 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.062+0000 7f5e9aacc780 1 < completed part key=_multipart_1IKNQXU3Y2JJ.2~P65ICZD1KGAW.0 size=481366 2024-06-04T15:59:32.064 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.064+0000 7f5e9aacc780 1 < completed multipart upload key=1IKNQXU3Y2JJ upload=P65ICZD1KGAW tag=K49A1U2SMXD6 type=write size=1529942 2024-06-04T15:59:32.066 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.065+0000 7f5e9aacc780 1 > prepared operation key=W1T4O3EAE7JN tag=2Q3I7YLMVN7F type=del size=424990 2024-06-04T15:59:32.067 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.067+0000 7f5e9aacc780 1 < completed part key=_multipart_4W5HB9WQQHR6.2~C39YOGFRV5Z1.0 size=824661 2024-06-04T15:59:32.070 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.069+0000 7f5e9aacc780 1 < completed multipart upload key=4W5HB9WQQHR6 upload=C39YOGFRV5Z1 tag=XAZBK2I71VEC type=write size=1873237 2024-06-04T15:59:32.071 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.071+0000 7f5e9aacc780 1 > prepared operation key=UTZHANL9ER2Q tag=91W3SNT8EG8T type=write size=152281 2024-06-04T15:59:32.071 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.071+0000 7f5e9aacc780 1 < canceled part key=_multipart_PCLJXQHJ4HTY.2~GDBP9968D7UW.0 size=373867 2024-06-04T15:59:32.074 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.074+0000 7f5e9aacc780 1 < canceled multipart upload key=PCLJXQHJ4HTY upload=GDBP9968D7UW tag=D6L64ICKOPAI type=write size=1422443 2024-06-04T15:59:32.075 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.075+0000 7f5e9aacc780 1 > prepared operation key=B0HK5FJ2RGJE tag=7GCA4ZR53D7X type=del size=1933165 2024-06-04T15:59:32.078 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.078+0000 7f5e9aacc780 1 < suggested remove operation key=QUIVPH3OB6KN tag=PC3XXB29WLS1 type=write 2024-06-04T15:59:32.081 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.080+0000 7f5e9aacc780 1 > prepared part key=_multipart_Q4OFQI0F5YLG.2~RIDXVPHR95JU.0 size=1048576 2024-06-04T15:59:32.082 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.081+0000 7f5e9aacc780 1 > prepared part key=_multipart_Q4OFQI0F5YLG.2~RIDXVPHR95JU.1 size=485213 2024-06-04T15:59:32.082 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.081+0000 7f5e9aacc780 1 > prepared multipart upload key=Q4OFQI0F5YLG upload=RIDXVPHR95JU tag=SMJXXFBA1ST7 type=write size=2582365 2024-06-04T15:59:32.083 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.083+0000 7f5e9aacc780 1 < completed delete operation key=1IKNQXU3Y2JJ tag=CSL5P8O43HIV type=del 2024-06-04T15:59:32.086 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.086+0000 7f5e9aacc780 1 > prepared part key=_multipart_PASGIP872OVX.2~MCSLBF8MK851.0 size=1048576 2024-06-04T15:59:32.088 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.087+0000 7f5e9aacc780 1 > prepared part key=_multipart_PASGIP872OVX.2~MCSLBF8MK851.1 size=1032263 2024-06-04T15:59:32.088 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.087+0000 7f5e9aacc780 1 > prepared multipart upload key=PASGIP872OVX upload=MCSLBF8MK851 tag=S8HK5L0FR72B type=write size=3129415 2024-06-04T15:59:32.089 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.089+0000 7f5e9aacc780 1 < completed delete operation key=Q2V1ICTBSCV1 tag=U99SRKVF2Q24 type=del 2024-06-04T15:59:32.090 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.090+0000 7f5e9aacc780 1 > prepared operation key=PCLJXQHJ4HTY tag=DSBX3DWTEE3C type=del size=2305995 2024-06-04T15:59:32.093 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.093+0000 7f5e9aacc780 1 < completed write operation key=9MPRI6LW3956 tag=1Z0CQHO78X6R type=write size=683184 2024-06-04T15:59:32.095 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.094+0000 7f5e9aacc780 1 > prepared operation key=Q4OFQI0F5YLG tag=H3BSWWGKVM3M type=del size=1474901 2024-06-04T15:59:32.096 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.097+0000 7f5e9aacc780 1 < completed delete operation key=7S9S3MIG7WIT tag=9ZHEZEOZ9CQK type=del 2024-06-04T15:59:32.099 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.099+0000 7f5e9aacc780 1 > prepared part key=_multipart_1IKNQXU3Y2JJ.2~0WSE7D9CG1QD.0 size=1048576 2024-06-04T15:59:32.100 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.100+0000 7f5e9aacc780 1 > prepared part key=_multipart_1IKNQXU3Y2JJ.2~0WSE7D9CG1QD.1 size=436282 2024-06-04T15:59:32.100 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.100+0000 7f5e9aacc780 1 > prepared multipart upload key=1IKNQXU3Y2JJ upload=0WSE7D9CG1QD tag=Q96QQMT0KG34 type=write size=2533434 2024-06-04T15:59:32.102 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.102+0000 7f5e9aacc780 1 < completed write operation key=AOCB36Y5Q7B0 tag=1XOTHF1WT546 type=write size=81886 2024-06-04T15:59:32.105 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.105+0000 7f5e9aacc780 1 > prepared part key=_multipart_4W5HB9WQQHR6.2~C00QEIOIPZ6O.0 size=42137 2024-06-04T15:59:32.105 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.105+0000 7f5e9aacc780 1 > prepared multipart upload key=4W5HB9WQQHR6 upload=C00QEIOIPZ6O tag=8FDWXEZFIHMI type=write size=1090713 2024-06-04T15:59:32.106 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.106+0000 7f5e9aacc780 1 < canceled operation key=QJA2JPATITNH tag=PMYITRK476MD type=del size=1697740 2024-06-04T15:59:32.108 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.108+0000 7f5e9aacc780 1 > prepared operation key=JL69PUHT6NNT tag=7PESTOTRI6IW type=del size=1594834 2024-06-04T15:59:32.109 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.108+0000 7f5e9aacc780 -1 < no bi entry to suggest for operation key=NJ5U8JTT32QK tag=S4ZKPBZ5QCW2 type=del size=664749: (2) No such file or directory 2024-06-04T15:59:32.110 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.110+0000 7f5e9aacc780 1 > prepared operation key=QUIVPH3OB6KN tag=1A6DLONA3A0I type=write size=796822 2024-06-04T15:59:32.111 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.111+0000 7f5e9aacc780 -1 < failed to complete operation key=QUIVPH3OB6KN tag=2G6F6HKZ3I4U type=del size=1993632: (22) Invalid argument 2024-06-04T15:59:32.114 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.114+0000 7f5e9aacc780 1 > prepared part key=_multipart_GTRMEQJK675Z.2~EH2IER5DUW52.0 size=1048576 2024-06-04T15:59:32.115 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.115+0000 7f5e9aacc780 1 > prepared part key=_multipart_GTRMEQJK675Z.2~EH2IER5DUW52.1 size=725606 2024-06-04T15:59:32.115 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.115+0000 7f5e9aacc780 1 > prepared multipart upload key=GTRMEQJK675Z upload=EH2IER5DUW52 tag=6TN2KY40UOKA type=write size=2822758 2024-06-04T15:59:32.116 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.117+0000 7f5e9aacc780 1 < completed part key=_multipart_1IKNQXU3Y2JJ.2~CDIX56NX9HQX.0 size=1048576 2024-06-04T15:59:32.118 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.117+0000 7f5e9aacc780 1 < completed part key=_multipart_1IKNQXU3Y2JJ.2~CDIX56NX9HQX.1 size=685410 2024-06-04T15:59:32.120 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.120+0000 7f5e9aacc780 1 < completed multipart upload key=1IKNQXU3Y2JJ upload=CDIX56NX9HQX tag=HE119AIYT1Y4 type=write size=2782562 2024-06-04T15:59:32.122 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.123+0000 7f5e9aacc780 1 > prepared part key=_multipart_PCLJXQHJ4HTY.2~DOJH9JVA7R2X.0 size=1048576 2024-06-04T15:59:32.124 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.124+0000 7f5e9aacc780 1 > prepared part key=_multipart_PCLJXQHJ4HTY.2~DOJH9JVA7R2X.1 size=327763 2024-06-04T15:59:32.124 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.124+0000 7f5e9aacc780 1 > prepared multipart upload key=PCLJXQHJ4HTY upload=DOJH9JVA7R2X tag=WHIVB88FX44Y type=write size=2424915 2024-06-04T15:59:32.126 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.125+0000 7f5e9aacc780 1 < completed part key=_multipart_SUBHZJ7HUV3H.2~92IVBXUUJMWB.0 size=1048576 2024-06-04T15:59:32.127 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.126+0000 7f5e9aacc780 1 < completed part key=_multipart_SUBHZJ7HUV3H.2~92IVBXUUJMWB.1 size=1048576 2024-06-04T15:59:32.128 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.127+0000 7f5e9aacc780 1 < completed part key=_multipart_SUBHZJ7HUV3H.2~92IVBXUUJMWB.2 size=906537 2024-06-04T15:59:32.130 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.130+0000 7f5e9aacc780 1 < completed multipart upload key=SUBHZJ7HUV3H upload=92IVBXUUJMWB tag=GVWUY7ZTL1C0 type=write size=4052265 2024-06-04T15:59:32.132 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.131+0000 7f5e9aacc780 1 > prepared operation key=B0HK5FJ2RGJE tag=FAPCZGMYQROH type=write size=11732 2024-06-04T15:59:32.133 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.133+0000 7f5e9aacc780 1 < completed part key=_multipart_1IKNQXU3Y2JJ.2~6ASPDYD9MKMW.0 size=765057 2024-06-04T15:59:32.135 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.135+0000 7f5e9aacc780 1 < completed multipart upload key=1IKNQXU3Y2JJ upload=6ASPDYD9MKMW tag=LOORLOKLD988 type=write size=1813633 2024-06-04T15:59:32.137 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.137+0000 7f5e9aacc780 1 > prepared operation key=03ZNYG3WLMP4 tag=HA0P5K00F25D type=del size=183850 2024-06-04T15:59:32.138 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.138+0000 7f5e9aacc780 1 < completed part key=_multipart_DY9JWHWNAUO1.2~AHEOAMT04X86.0 size=1048576 2024-06-04T15:59:32.139 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.139+0000 7f5e9aacc780 1 < completed part key=_multipart_DY9JWHWNAUO1.2~AHEOAMT04X86.1 size=1048576 2024-06-04T15:59:32.141 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.141+0000 7f5e9aacc780 1 < completed part key=_multipart_DY9JWHWNAUO1.2~AHEOAMT04X86.2 size=222497 2024-06-04T15:59:32.143 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.143+0000 7f5e9aacc780 1 < completed multipart upload key=DY9JWHWNAUO1 upload=AHEOAMT04X86 tag=QFA3IPUS4PS2 type=write size=3368225 2024-06-04T15:59:32.146 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.146+0000 7f5e9aacc780 1 > prepared part key=_multipart_NJ5U8JTT32QK.2~DEVUQQ2JVAF9.0 size=1048576 2024-06-04T15:59:32.146 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.146+0000 7f5e9aacc780 1 > prepared part key=_multipart_NJ5U8JTT32QK.2~DEVUQQ2JVAF9.1 size=615 2024-06-04T15:59:32.147 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.146+0000 7f5e9aacc780 1 > prepared multipart upload key=NJ5U8JTT32QK upload=DEVUQQ2JVAF9 tag=5IZBNW1X6YAF type=write size=2097767 2024-06-04T15:59:32.148 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.148+0000 7f5e9aacc780 1 < completed delete operation key=W1T4O3EAE7JN tag=2Q3I7YLMVN7F type=del 2024-06-04T15:59:32.149 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.149+0000 7f5e9aacc780 1 > prepared operation key=4W5HB9WQQHR6 tag=A2UBTEL7V2LQ type=write size=89497 2024-06-04T15:59:32.151 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.150+0000 7f5e9aacc780 1 < completed write operation key=UTZHANL9ER2Q tag=91W3SNT8EG8T type=write size=152281 2024-06-04T15:59:32.153 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.153+0000 7f5e9aacc780 1 > prepared part key=_multipart_HD6SNICRCDLL.2~DW6HSWKN3JH5.0 size=1048576 2024-06-04T15:59:32.154 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.154+0000 7f5e9aacc780 1 > prepared part key=_multipart_HD6SNICRCDLL.2~DW6HSWKN3JH5.1 size=722719 2024-06-04T15:59:32.154 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.154+0000 7f5e9aacc780 1 > prepared multipart upload key=HD6SNICRCDLL upload=DW6HSWKN3JH5 tag=QYG8CECB882I type=write size=2819871 2024-06-04T15:59:32.158 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.158+0000 7f5e9aacc780 1 < completed delete operation key=B0HK5FJ2RGJE tag=7GCA4ZR53D7X type=del 2024-06-04T15:59:32.161 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.161+0000 7f5e9aacc780 1 > prepared part key=_multipart_4W5HB9WQQHR6.2~RP07K2XYNUB2.0 size=1048576 2024-06-04T15:59:32.162 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.162+0000 7f5e9aacc780 1 > prepared part key=_multipart_4W5HB9WQQHR6.2~RP07K2XYNUB2.1 size=1048576 2024-06-04T15:59:32.163 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.163+0000 7f5e9aacc780 1 > prepared part key=_multipart_4W5HB9WQQHR6.2~RP07K2XYNUB2.2 size=932105 2024-06-04T15:59:32.163 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.163+0000 7f5e9aacc780 1 > prepared multipart upload key=4W5HB9WQQHR6 upload=RP07K2XYNUB2 tag=112I1GI7CYZ9 type=write size=4077833 2024-06-04T15:59:32.164 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.164+0000 7f5e9aacc780 1 < completed part key=_multipart_Q4OFQI0F5YLG.2~RIDXVPHR95JU.0 size=1048576 2024-06-04T15:59:32.166 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.165+0000 7f5e9aacc780 1 < completed part key=_multipart_Q4OFQI0F5YLG.2~RIDXVPHR95JU.1 size=485213 2024-06-04T15:59:32.171 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.170+0000 7f5e9aacc780 1 < completed multipart upload key=Q4OFQI0F5YLG upload=RIDXVPHR95JU tag=SMJXXFBA1ST7 type=write size=2582365 2024-06-04T15:59:32.172 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.172+0000 7f5e9aacc780 1 > prepared operation key=UTZHANL9ER2Q tag=NWG6EY4BDVD1 type=write size=676644 2024-06-04T15:59:32.172 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.172+0000 7f5e9aacc780 1 < canceled part key=_multipart_PASGIP872OVX.2~MCSLBF8MK851.0 size=1048576 2024-06-04T15:59:32.173 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.173+0000 7f5e9aacc780 1 < completed part key=_multipart_PASGIP872OVX.2~MCSLBF8MK851.1 size=1032263 2024-06-04T15:59:32.177 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.176+0000 7f5e9aacc780 1 < canceled multipart upload key=PASGIP872OVX upload=MCSLBF8MK851 tag=S8HK5L0FR72B type=write size=3129415 2024-06-04T15:59:32.178 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.178+0000 7f5e9aacc780 1 > prepared part key=_multipart_QUIVPH3OB6KN.2~NBJUSEYSZ42B.0 size=1048576 2024-06-04T15:59:32.179 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.179+0000 7f5e9aacc780 1 > prepared part key=_multipart_QUIVPH3OB6KN.2~NBJUSEYSZ42B.1 size=632852 2024-06-04T15:59:32.179 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.179+0000 7f5e9aacc780 1 > prepared multipart upload key=QUIVPH3OB6KN upload=NBJUSEYSZ42B tag=Z9SHZKW24HO8 type=write size=2730004 2024-06-04T15:59:32.181 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.181+0000 7f5e9aacc780 1 < canceled operation key=PCLJXQHJ4HTY tag=DSBX3DWTEE3C type=del size=2305995 2024-06-04T15:59:32.182 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.182+0000 7f5e9aacc780 1 > prepared operation key=UW5LVIBG09SV tag=79O5228082G4 type=del size=3421502 2024-06-04T15:59:32.184 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.184+0000 7f5e9aacc780 1 < completed delete operation key=Q4OFQI0F5YLG tag=H3BSWWGKVM3M type=del 2024-06-04T15:59:32.186 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.186+0000 7f5e9aacc780 1 > prepared part key=_multipart_QJA2JPATITNH.2~6EAYL2N4S7K5.0 size=1048576 2024-06-04T15:59:32.187 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.187+0000 7f5e9aacc780 1 > prepared part key=_multipart_QJA2JPATITNH.2~6EAYL2N4S7K5.1 size=151099 2024-06-04T15:59:32.187 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.187+0000 7f5e9aacc780 1 > prepared multipart upload key=QJA2JPATITNH upload=6EAYL2N4S7K5 tag=D53LYE53AUCD type=write size=2248251 2024-06-04T15:59:32.189 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.188+0000 7f5e9aacc780 1 < completed part key=_multipart_1IKNQXU3Y2JJ.2~0WSE7D9CG1QD.0 size=1048576 2024-06-04T15:59:32.190 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.190+0000 7f5e9aacc780 1 < completed part key=_multipart_1IKNQXU3Y2JJ.2~0WSE7D9CG1QD.1 size=436282 2024-06-04T15:59:32.192 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.192+0000 7f5e9aacc780 1 < completed multipart upload key=1IKNQXU3Y2JJ upload=0WSE7D9CG1QD tag=Q96QQMT0KG34 type=write size=2533434 2024-06-04T15:59:32.193 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.193+0000 7f5e9aacc780 1 > prepared operation key=NJ5U8JTT32QK tag=WH7VJMO9WC62 type=del size=1554634 2024-06-04T15:59:32.195 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.194+0000 7f5e9aacc780 1 < completed part key=_multipart_4W5HB9WQQHR6.2~C00QEIOIPZ6O.0 size=42137 2024-06-04T15:59:32.197 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.197+0000 7f5e9aacc780 1 < completed multipart upload key=4W5HB9WQQHR6 upload=C00QEIOIPZ6O tag=8FDWXEZFIHMI type=write size=1090713 2024-06-04T15:59:32.199 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.198+0000 7f5e9aacc780 1 > prepared operation key=UW5LVIBG09SV tag=B2HE13M2E9Q1 type=del size=4128631 2024-06-04T15:59:32.200 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.200+0000 7f5e9aacc780 1 < completed delete operation key=JL69PUHT6NNT tag=7PESTOTRI6IW type=del 2024-06-04T15:59:32.202 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.201+0000 7f5e9aacc780 1 > prepared operation key=QUIVPH3OB6KN tag=ETZO1WYFD2K0 type=del size=1408676 2024-06-04T15:59:32.203 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.203+0000 7f5e9aacc780 1 < completed write operation key=QUIVPH3OB6KN tag=1A6DLONA3A0I type=write size=796822 2024-06-04T15:59:32.205 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.204+0000 7f5e9aacc780 1 > prepared operation key=FBV2MAG130M6 tag=U52DVXDYGWTT type=write size=570462 2024-06-04T15:59:32.206 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.206+0000 7f5e9aacc780 1 < completed part key=_multipart_GTRMEQJK675Z.2~EH2IER5DUW52.0 size=1048576 2024-06-04T15:59:32.208 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.207+0000 7f5e9aacc780 1 < completed part key=_multipart_GTRMEQJK675Z.2~EH2IER5DUW52.1 size=725606 2024-06-04T15:59:32.210 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.210+0000 7f5e9aacc780 1 < completed multipart upload key=GTRMEQJK675Z upload=EH2IER5DUW52 tag=6TN2KY40UOKA type=write size=2822758 2024-06-04T15:59:32.212 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.211+0000 7f5e9aacc780 1 > prepared operation key=SUBHZJ7HUV3H tag=2OROJ3KD5UMI type=del size=2543258 2024-06-04T15:59:32.213 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.213+0000 7f5e9aacc780 1 < completed part key=_multipart_PCLJXQHJ4HTY.2~DOJH9JVA7R2X.0 size=1048576 2024-06-04T15:59:32.214 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.215+0000 7f5e9aacc780 1 < completed part key=_multipart_PCLJXQHJ4HTY.2~DOJH9JVA7R2X.1 size=327763 2024-06-04T15:59:32.217 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.217+0000 7f5e9aacc780 1 < completed multipart upload key=PCLJXQHJ4HTY upload=DOJH9JVA7R2X tag=WHIVB88FX44Y type=write size=2424915 2024-06-04T15:59:32.219 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.218+0000 7f5e9aacc780 1 > prepared operation key=RP8K6QJUZAH1 tag=FFEIP1M1UUC7 type=del size=3026214 2024-06-04T15:59:32.221 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.220+0000 7f5e9aacc780 1 < completed write operation key=B0HK5FJ2RGJE tag=FAPCZGMYQROH type=write size=11732 2024-06-04T15:59:32.222 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.222+0000 7f5e9aacc780 1 > prepared operation key=W1T4O3EAE7JN tag=QZMR60BBHS0I type=del size=3587552 2024-06-04T15:59:32.223 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.223+0000 7f5e9aacc780 1 < completed delete operation key=03ZNYG3WLMP4 tag=HA0P5K00F25D type=del 2024-06-04T15:59:32.225 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.225+0000 7f5e9aacc780 1 > prepared operation key=1IKNQXU3Y2JJ tag=ROXJLT0UFD1U type=write size=291491 2024-06-04T15:59:32.227 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.226+0000 7f5e9aacc780 1 < completed part key=_multipart_NJ5U8JTT32QK.2~DEVUQQ2JVAF9.0 size=1048576 2024-06-04T15:59:32.228 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.228+0000 7f5e9aacc780 1 < completed part key=_multipart_NJ5U8JTT32QK.2~DEVUQQ2JVAF9.1 size=615 2024-06-04T15:59:32.230 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.230+0000 7f5e9aacc780 1 < completed multipart upload key=NJ5U8JTT32QK upload=DEVUQQ2JVAF9 tag=5IZBNW1X6YAF type=write size=2097767 2024-06-04T15:59:32.233 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.233+0000 7f5e9aacc780 1 > prepared operation key=SUBHZJ7HUV3H tag=NAPBRLX7K4GV type=del size=2630090 2024-06-04T15:59:32.236 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.235+0000 7f5e9aacc780 1 < completed write operation key=4W5HB9WQQHR6 tag=A2UBTEL7V2LQ type=write size=89497 2024-06-04T15:59:32.238 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.238+0000 7f5e9aacc780 1 > prepared operation key=UTZHANL9ER2Q tag=IUM8KROPYZKY type=del size=2786261 2024-06-04T15:59:32.239 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.238+0000 7f5e9aacc780 1 < canceled part key=_multipart_HD6SNICRCDLL.2~DW6HSWKN3JH5.0 size=1048576 2024-06-04T15:59:32.240 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.240+0000 7f5e9aacc780 1 < completed part key=_multipart_HD6SNICRCDLL.2~DW6HSWKN3JH5.1 size=722719 2024-06-04T15:59:32.242 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.242+0000 7f5e9aacc780 1 < canceled multipart upload key=HD6SNICRCDLL upload=DW6HSWKN3JH5 tag=QYG8CECB882I type=write size=2819871 2024-06-04T15:59:32.244 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.244+0000 7f5e9aacc780 1 > prepared operation key=W1T4O3EAE7JN tag=5JV5V7DQP2VP type=del size=513775 2024-06-04T15:59:32.246 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.245+0000 7f5e9aacc780 1 < completed part key=_multipart_4W5HB9WQQHR6.2~RP07K2XYNUB2.0 size=1048576 2024-06-04T15:59:32.246 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.245+0000 7f5e9aacc780 1 < canceled part key=_multipart_4W5HB9WQQHR6.2~RP07K2XYNUB2.1 size=1048576 2024-06-04T15:59:32.247 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.247+0000 7f5e9aacc780 1 < completed part key=_multipart_4W5HB9WQQHR6.2~RP07K2XYNUB2.2 size=932105 2024-06-04T15:59:32.250 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.250+0000 7f5e9aacc780 1 < canceled multipart upload key=4W5HB9WQQHR6 upload=RP07K2XYNUB2 tag=112I1GI7CYZ9 type=write size=4077833 2024-06-04T15:59:32.252 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.252+0000 7f5e9aacc780 1 > prepared part key=_multipart_XH0N984YVGKP.2~KK2PQ287EH66.0 size=1048576 2024-06-04T15:59:32.253 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.253+0000 7f5e9aacc780 1 > prepared part key=_multipart_XH0N984YVGKP.2~KK2PQ287EH66.1 size=1048576 2024-06-04T15:59:32.254 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.254+0000 7f5e9aacc780 1 > prepared part key=_multipart_XH0N984YVGKP.2~KK2PQ287EH66.2 size=150764 2024-06-04T15:59:32.254 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.254+0000 7f5e9aacc780 1 > prepared multipart upload key=XH0N984YVGKP upload=KK2PQ287EH66 tag=WE9B3IPFM8U9 type=write size=3296492 2024-06-04T15:59:32.256 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.255+0000 7f5e9aacc780 1 < completed write operation key=UTZHANL9ER2Q tag=NWG6EY4BDVD1 type=write size=676644 2024-06-04T15:59:32.257 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.257+0000 7f5e9aacc780 1 > prepared operation key=NJ5U8JTT32QK tag=5IID0RNVW793 type=del size=2691791 2024-06-04T15:59:32.259 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.259+0000 7f5e9aacc780 1 < completed part key=_multipart_QUIVPH3OB6KN.2~NBJUSEYSZ42B.0 size=1048576 2024-06-04T15:59:32.260 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.260+0000 7f5e9aacc780 1 < completed part key=_multipart_QUIVPH3OB6KN.2~NBJUSEYSZ42B.1 size=632852 2024-06-04T15:59:32.263 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.262+0000 7f5e9aacc780 1 < completed multipart upload key=QUIVPH3OB6KN upload=NBJUSEYSZ42B tag=Z9SHZKW24HO8 type=write size=2730004 2024-06-04T15:59:32.265 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.265+0000 7f5e9aacc780 1 > prepared part key=_multipart_SUBHZJ7HUV3H.2~BA494OORTFDF.0 size=169450 2024-06-04T15:59:32.265 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.265+0000 7f5e9aacc780 1 > prepared multipart upload key=SUBHZJ7HUV3H upload=BA494OORTFDF tag=PK94QUY6M4YM type=write size=1218026 2024-06-04T15:59:32.268 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.268+0000 7f5e9aacc780 1 < suggested remove operation key=UW5LVIBG09SV tag=79O5228082G4 type=del 2024-06-04T15:59:32.269 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.269+0000 7f5e9aacc780 1 > prepared operation key=PASGIP872OVX tag=WCV7SV1ACYFW type=del size=3621919 2024-06-04T15:59:32.270 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.269+0000 7f5e9aacc780 1 < canceled part key=_multipart_QJA2JPATITNH.2~6EAYL2N4S7K5.0 size=1048576 2024-06-04T15:59:32.271 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.270+0000 7f5e9aacc780 1 < completed part key=_multipart_QJA2JPATITNH.2~6EAYL2N4S7K5.1 size=151099 2024-06-04T15:59:32.273 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.273+0000 7f5e9aacc780 1 < canceled multipart upload key=QJA2JPATITNH upload=6EAYL2N4S7K5 tag=D53LYE53AUCD type=write size=2248251 2024-06-04T15:59:32.276 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.275+0000 7f5e9aacc780 1 > prepared part key=_multipart_HD6SNICRCDLL.2~JSAETV5X1D6E.0 size=237146 2024-06-04T15:59:32.276 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.275+0000 7f5e9aacc780 1 > prepared multipart upload key=HD6SNICRCDLL upload=JSAETV5X1D6E tag=RHL9ORJ6XQSJ type=write size=1285722 2024-06-04T15:59:32.277 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.277+0000 7f5e9aacc780 1 < completed delete operation key=NJ5U8JTT32QK tag=WH7VJMO9WC62 type=del 2024-06-04T15:59:32.278 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.278+0000 7f5e9aacc780 1 > prepared operation key=B0HK5FJ2RGJE tag=0Q00PBK9ZXN2 type=del size=3012120 2024-06-04T15:59:32.279 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.279+0000 7f5e9aacc780 -1 < no bi entry to suggest for operation key=UW5LVIBG09SV tag=B2HE13M2E9Q1 type=del size=4128631: (2) No such file or directory 2024-06-04T15:59:32.281 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.281+0000 7f5e9aacc780 1 > prepared part key=_multipart_QJA2JPATITNH.2~INR5CJ19E2RU.0 size=1048576 2024-06-04T15:59:32.283 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.283+0000 7f5e9aacc780 1 > prepared part key=_multipart_QJA2JPATITNH.2~INR5CJ19E2RU.1 size=1048576 2024-06-04T15:59:32.284 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.284+0000 7f5e9aacc780 1 > prepared part key=_multipart_QJA2JPATITNH.2~INR5CJ19E2RU.2 size=874802 2024-06-04T15:59:32.284 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.284+0000 7f5e9aacc780 1 > prepared multipart upload key=QJA2JPATITNH upload=INR5CJ19E2RU tag=M40ZIWEC5X60 type=write size=4020530 2024-06-04T15:59:32.286 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.286+0000 7f5e9aacc780 1 < suggested remove operation key=QUIVPH3OB6KN tag=ETZO1WYFD2K0 type=del 2024-06-04T15:59:32.288 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.288+0000 7f5e9aacc780 1 > prepared operation key=RP8K6QJUZAH1 tag=WOGC3I4JV2ZW type=del size=2255951 2024-06-04T15:59:32.291 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.291+0000 7f5e9aacc780 1 < suggested update operation key=FBV2MAG130M6 tag=U52DVXDYGWTT type=write size=570462 2024-06-04T15:59:32.292 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.292+0000 7f5e9aacc780 1 > prepared operation key=Q2V1ICTBSCV1 tag=5HL8F34A6I5L type=write size=108487 2024-06-04T15:59:32.294 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.293+0000 7f5e9aacc780 1 < completed delete operation key=SUBHZJ7HUV3H tag=2OROJ3KD5UMI type=del 2024-06-04T15:59:32.296 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.296+0000 7f5e9aacc780 1 > prepared part key=_multipart_QJA2JPATITNH.2~6HJ36I4THCAM.0 size=1040176 2024-06-04T15:59:32.296 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.296+0000 7f5e9aacc780 1 > prepared multipart upload key=QJA2JPATITNH upload=6HJ36I4THCAM tag=4ZNSR6NV6NJ4 type=write size=2088752 2024-06-04T15:59:32.298 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.297+0000 7f5e9aacc780 1 < completed delete operation key=RP8K6QJUZAH1 tag=FFEIP1M1UUC7 type=del 2024-06-04T15:59:32.299 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.299+0000 7f5e9aacc780 1 > prepared operation key=9MPRI6LW3956 tag=JDN8OB7F0NMT type=del size=2334644 2024-06-04T15:59:32.300 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.300+0000 7f5e9aacc780 1 < completed delete operation key=W1T4O3EAE7JN tag=QZMR60BBHS0I type=del 2024-06-04T15:59:32.302 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.302+0000 7f5e9aacc780 1 > prepared operation key=JL69PUHT6NNT tag=I1R6JU1Q5TOB type=write size=964736 2024-06-04T15:59:32.305 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.304+0000 7f5e9aacc780 1 < suggested remove operation key=1IKNQXU3Y2JJ tag=ROXJLT0UFD1U type=write 2024-06-04T15:59:32.306 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.306+0000 7f5e9aacc780 1 > prepared operation key=PNDPO2WUW7UX tag=61JF00CLII9Q type=del size=1250353 2024-06-04T15:59:32.308 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.307+0000 7f5e9aacc780 1 < completed delete operation key=SUBHZJ7HUV3H tag=NAPBRLX7K4GV type=del 2024-06-04T15:59:32.310 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.310+0000 7f5e9aacc780 1 > prepared part key=_multipart_QUIVPH3OB6KN.2~NUU146UXV7HE.0 size=1048576 2024-06-04T15:59:32.311 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.311+0000 7f5e9aacc780 1 > prepared part key=_multipart_QUIVPH3OB6KN.2~NUU146UXV7HE.1 size=1048576 2024-06-04T15:59:32.312 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.312+0000 7f5e9aacc780 1 > prepared part key=_multipart_QUIVPH3OB6KN.2~NUU146UXV7HE.2 size=77767 2024-06-04T15:59:32.313 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.312+0000 7f5e9aacc780 1 > prepared multipart upload key=QUIVPH3OB6KN upload=NUU146UXV7HE tag=9SWO00E42FBE type=write size=3223495 2024-06-04T15:59:32.314 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.313+0000 7f5e9aacc780 1 < completed delete operation key=UTZHANL9ER2Q tag=IUM8KROPYZKY type=del 2024-06-04T15:59:32.316 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.316+0000 7f5e9aacc780 1 > prepared part key=_multipart_9MPRI6LW3956.2~7VQWZQQNCAV3.0 size=1048576 2024-06-04T15:59:32.317 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.317+0000 7f5e9aacc780 1 > prepared part key=_multipart_9MPRI6LW3956.2~7VQWZQQNCAV3.1 size=720277 2024-06-04T15:59:32.317 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.317+0000 7f5e9aacc780 1 > prepared multipart upload key=9MPRI6LW3956 upload=7VQWZQQNCAV3 tag=1D42TYU11NN2 type=write size=2817429 2024-06-04T15:59:32.319 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.319+0000 7f5e9aacc780 1 < completed delete operation key=W1T4O3EAE7JN tag=5JV5V7DQP2VP type=del 2024-06-04T15:59:32.320 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.320+0000 7f5e9aacc780 1 > prepared operation key=UW5LVIBG09SV tag=RZ2MRX4G7ZOQ type=del size=871599 2024-06-04T15:59:32.322 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.321+0000 7f5e9aacc780 1 < completed part key=_multipart_XH0N984YVGKP.2~KK2PQ287EH66.0 size=1048576 2024-06-04T15:59:32.322 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.321+0000 7f5e9aacc780 1 < canceled part key=_multipart_XH0N984YVGKP.2~KK2PQ287EH66.1 size=1048576 2024-06-04T15:59:32.323 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.322+0000 7f5e9aacc780 1 < completed part key=_multipart_XH0N984YVGKP.2~KK2PQ287EH66.2 size=150764 2024-06-04T15:59:32.325 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.325+0000 7f5e9aacc780 1 < canceled multipart upload key=XH0N984YVGKP upload=KK2PQ287EH66 tag=WE9B3IPFM8U9 type=write size=3296492 2024-06-04T15:59:32.326 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.326+0000 7f5e9aacc780 1 > prepared operation key=PASGIP872OVX tag=XLY58JVRT3FG type=del size=2360211 2024-06-04T15:59:32.329 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.329+0000 7f5e9aacc780 1 < suggested update operation key=NJ5U8JTT32QK tag=5IID0RNVW793 type=del size=2691791 2024-06-04T15:59:32.330 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.330+0000 7f5e9aacc780 1 > prepared operation key=1IKNQXU3Y2JJ tag=PYH8K978MC10 type=del size=2777258 2024-06-04T15:59:32.331 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.330+0000 7f5e9aacc780 1 < canceled part key=_multipart_SUBHZJ7HUV3H.2~BA494OORTFDF.0 size=169450 2024-06-04T15:59:32.333 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.333+0000 7f5e9aacc780 1 < canceled multipart upload key=SUBHZJ7HUV3H upload=BA494OORTFDF tag=PK94QUY6M4YM type=write size=1218026 2024-06-04T15:59:32.336 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.335+0000 7f5e9aacc780 1 > prepared part key=_multipart_UTZHANL9ER2Q.2~F1GBCAYLUO9K.0 size=1048576 2024-06-04T15:59:32.337 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.337+0000 7f5e9aacc780 1 > prepared part key=_multipart_UTZHANL9ER2Q.2~F1GBCAYLUO9K.1 size=1048576 2024-06-04T15:59:32.338 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.338+0000 7f5e9aacc780 1 > prepared part key=_multipart_UTZHANL9ER2Q.2~F1GBCAYLUO9K.2 size=738484 2024-06-04T15:59:32.338 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.338+0000 7f5e9aacc780 1 > prepared multipart upload key=UTZHANL9ER2Q upload=F1GBCAYLUO9K tag=TUC07NUJYJ74 type=write size=3884212 2024-06-04T15:59:32.340 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.340+0000 7f5e9aacc780 1 < canceled operation key=PASGIP872OVX tag=WCV7SV1ACYFW type=del size=3621919 2024-06-04T15:59:32.341 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.341+0000 7f5e9aacc780 1 > prepared operation key=A8O0S3S45RGM tag=ASHLDH30EVHO type=write size=95688 2024-06-04T15:59:32.343 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.343+0000 7f5e9aacc780 1 < completed part key=_multipart_HD6SNICRCDLL.2~JSAETV5X1D6E.0 size=237146 2024-06-04T15:59:32.346 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.346+0000 7f5e9aacc780 1 < completed multipart upload key=HD6SNICRCDLL upload=JSAETV5X1D6E tag=RHL9ORJ6XQSJ type=write size=1285722 2024-06-04T15:59:32.348 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.349+0000 7f5e9aacc780 1 > prepared part key=_multipart_GTRMEQJK675Z.2~VITCCDQ58WL6.0 size=320553 2024-06-04T15:59:32.349 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.349+0000 7f5e9aacc780 1 > prepared multipart upload key=GTRMEQJK675Z upload=VITCCDQ58WL6 tag=BWWUNCBAJJ5L type=write size=1369129 2024-06-04T15:59:32.350 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.350+0000 7f5e9aacc780 1 < completed delete operation key=B0HK5FJ2RGJE tag=0Q00PBK9ZXN2 type=del 2024-06-04T15:59:32.351 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.351+0000 7f5e9aacc780 1 > prepared operation key=AOCB36Y5Q7B0 tag=4MSQSQB6QPI9 type=del size=1375846 2024-06-04T15:59:32.353 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.353+0000 7f5e9aacc780 1 < completed part key=_multipart_QJA2JPATITNH.2~INR5CJ19E2RU.0 size=1048576 2024-06-04T15:59:32.354 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.354+0000 7f5e9aacc780 1 < completed part key=_multipart_QJA2JPATITNH.2~INR5CJ19E2RU.1 size=1048576 2024-06-04T15:59:32.355 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.355+0000 7f5e9aacc780 1 < completed part key=_multipart_QJA2JPATITNH.2~INR5CJ19E2RU.2 size=874802 2024-06-04T15:59:32.358 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.358+0000 7f5e9aacc780 1 < completed multipart upload key=QJA2JPATITNH upload=INR5CJ19E2RU tag=M40ZIWEC5X60 type=write size=4020530 2024-06-04T15:59:32.359 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.359+0000 7f5e9aacc780 1 > prepared operation key=03ZNYG3WLMP4 tag=72MVG30KF7UP type=del size=1700573 2024-06-04T15:59:32.360 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.360+0000 7f5e9aacc780 1 < canceled operation key=RP8K6QJUZAH1 tag=WOGC3I4JV2ZW type=del size=2255951 2024-06-04T15:59:32.362 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.362+0000 7f5e9aacc780 1 > prepared operation key=W1T4O3EAE7JN tag=P01FRV5VU4D9 type=del size=4041841 2024-06-04T15:59:32.364 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.363+0000 7f5e9aacc780 1 < completed write operation key=Q2V1ICTBSCV1 tag=5HL8F34A6I5L type=write size=108487 2024-06-04T15:59:32.365 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.365+0000 7f5e9aacc780 1 > prepared operation key=GCPC9OJH7KWU tag=UZT5UKGBWO92 type=write size=915114 2024-06-04T15:59:32.366 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.366+0000 7f5e9aacc780 1 < completed part key=_multipart_QJA2JPATITNH.2~6HJ36I4THCAM.0 size=1040176 2024-06-04T15:59:32.369 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.368+0000 7f5e9aacc780 1 < completed multipart upload key=QJA2JPATITNH upload=6HJ36I4THCAM tag=4ZNSR6NV6NJ4 type=write size=2088752 2024-06-04T15:59:32.372 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.372+0000 7f5e9aacc780 1 > prepared part key=_multipart_JL69PUHT6NNT.2~1ADPDNSKLDJ0.0 size=1048576 2024-06-04T15:59:32.373 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.374+0000 7f5e9aacc780 1 > prepared part key=_multipart_JL69PUHT6NNT.2~1ADPDNSKLDJ0.1 size=310660 2024-06-04T15:59:32.374 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.374+0000 7f5e9aacc780 1 > prepared multipart upload key=JL69PUHT6NNT upload=1ADPDNSKLDJ0 tag=VOF3UGE2TUHB type=write size=2407812 2024-06-04T15:59:32.375 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.375+0000 7f5e9aacc780 1 < completed delete operation key=9MPRI6LW3956 tag=JDN8OB7F0NMT type=del 2024-06-04T15:59:32.376 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.376+0000 7f5e9aacc780 1 > prepared operation key=NJ5U8JTT32QK tag=VX76D9HCBDNJ type=del size=1846373 2024-06-04T15:59:32.379 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.379+0000 7f5e9aacc780 1 < suggested update operation key=JL69PUHT6NNT tag=I1R6JU1Q5TOB type=write size=964736 2024-06-04T15:59:32.381 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.380+0000 7f5e9aacc780 1 > prepared operation key=PNDPO2WUW7UX tag=RE35NCM2LULD type=write size=530995 2024-06-04T15:59:32.382 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.381+0000 7f5e9aacc780 1 < completed delete operation key=PNDPO2WUW7UX tag=61JF00CLII9Q type=del 2024-06-04T15:59:32.383 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.383+0000 7f5e9aacc780 1 > prepared operation key=SUBHZJ7HUV3H tag=6I1FBDK8PGTF type=del size=4173004 2024-06-04T15:59:32.384 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.384+0000 7f5e9aacc780 1 < completed part key=_multipart_QUIVPH3OB6KN.2~NUU146UXV7HE.0 size=1048576 2024-06-04T15:59:32.386 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.385+0000 7f5e9aacc780 1 < completed part key=_multipart_QUIVPH3OB6KN.2~NUU146UXV7HE.1 size=1048576 2024-06-04T15:59:32.386 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.385+0000 7f5e9aacc780 1 < canceled part key=_multipart_QUIVPH3OB6KN.2~NUU146UXV7HE.2 size=77767 2024-06-04T15:59:32.388 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.387+0000 7f5e9aacc780 1 < canceled multipart upload key=QUIVPH3OB6KN upload=NUU146UXV7HE tag=9SWO00E42FBE type=write size=3223495 2024-06-04T15:59:32.389 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.389+0000 7f5e9aacc780 1 > prepared operation key=GCPC9OJH7KWU tag=PX7B2JQ0UK6I type=del size=1726341 2024-06-04T15:59:32.391 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.390+0000 7f5e9aacc780 1 < completed part key=_multipart_9MPRI6LW3956.2~7VQWZQQNCAV3.0 size=1048576 2024-06-04T15:59:32.392 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.392+0000 7f5e9aacc780 1 < completed part key=_multipart_9MPRI6LW3956.2~7VQWZQQNCAV3.1 size=720277 2024-06-04T15:59:32.394 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.394+0000 7f5e9aacc780 1 < completed multipart upload key=9MPRI6LW3956 upload=7VQWZQQNCAV3 tag=1D42TYU11NN2 type=write size=2817429 2024-06-04T15:59:32.397 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.397+0000 7f5e9aacc780 1 > prepared part key=_multipart_9MPRI6LW3956.2~X5OABLZKE65C.0 size=1048576 2024-06-04T15:59:32.398 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.398+0000 7f5e9aacc780 1 > prepared part key=_multipart_9MPRI6LW3956.2~X5OABLZKE65C.1 size=882290 2024-06-04T15:59:32.398 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.398+0000 7f5e9aacc780 1 > prepared multipart upload key=9MPRI6LW3956 upload=X5OABLZKE65C tag=D22ZTS1CVN3P type=write size=2979442 2024-06-04T15:59:32.400 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.399+0000 7f5e9aacc780 1 < completed delete operation key=UW5LVIBG09SV tag=RZ2MRX4G7ZOQ type=del 2024-06-04T15:59:32.401 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.401+0000 7f5e9aacc780 1 > prepared operation key=Q4OFQI0F5YLG tag=H63FZ13HA4I8 type=write size=975433 2024-06-04T15:59:32.402 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.402+0000 7f5e9aacc780 1 < canceled operation key=PASGIP872OVX tag=XLY58JVRT3FG type=del size=2360211 2024-06-04T15:59:32.404 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.403+0000 7f5e9aacc780 1 > prepared operation key=PASGIP872OVX tag=T5BBXFEL6D4X type=del size=3864436 2024-06-04T15:59:32.405 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.405+0000 7f5e9aacc780 1 < completed delete operation key=1IKNQXU3Y2JJ tag=PYH8K978MC10 type=del 2024-06-04T15:59:32.407 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.407+0000 7f5e9aacc780 1 > prepared part key=_multipart_JL69PUHT6NNT.2~YIL0WIVXOYUG.0 size=1048576 2024-06-04T15:59:32.408 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.408+0000 7f5e9aacc780 1 > prepared part key=_multipart_JL69PUHT6NNT.2~YIL0WIVXOYUG.1 size=1048576 2024-06-04T15:59:32.409 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.409+0000 7f5e9aacc780 1 > prepared part key=_multipart_JL69PUHT6NNT.2~YIL0WIVXOYUG.2 size=583821 2024-06-04T15:59:32.409 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.409+0000 7f5e9aacc780 1 > prepared multipart upload key=JL69PUHT6NNT upload=YIL0WIVXOYUG tag=LII5PMIA1UOD type=write size=3729549 2024-06-04T15:59:32.411 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.411+0000 7f5e9aacc780 1 < completed part key=_multipart_UTZHANL9ER2Q.2~F1GBCAYLUO9K.0 size=1048576 2024-06-04T15:59:32.412 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.412+0000 7f5e9aacc780 1 < completed part key=_multipart_UTZHANL9ER2Q.2~F1GBCAYLUO9K.1 size=1048576 2024-06-04T15:59:32.413 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.413+0000 7f5e9aacc780 1 < completed part key=_multipart_UTZHANL9ER2Q.2~F1GBCAYLUO9K.2 size=738484 2024-06-04T15:59:32.415 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.415+0000 7f5e9aacc780 1 < completed multipart upload key=UTZHANL9ER2Q upload=F1GBCAYLUO9K tag=TUC07NUJYJ74 type=write size=3884212 2024-06-04T15:59:32.417 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.417+0000 7f5e9aacc780 1 > prepared operation key=QJA2JPATITNH tag=WKW6IRXC8MWP type=write size=243364 2024-06-04T15:59:32.420 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.419+0000 7f5e9aacc780 1 < suggested remove operation key=A8O0S3S45RGM tag=ASHLDH30EVHO type=write 2024-06-04T15:59:32.421 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.421+0000 7f5e9aacc780 1 > prepared operation key=PCLJXQHJ4HTY tag=L8ZV4O3TN5KL type=del size=1780465 2024-06-04T15:59:32.423 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.422+0000 7f5e9aacc780 1 < completed part key=_multipart_GTRMEQJK675Z.2~VITCCDQ58WL6.0 size=320553 2024-06-04T15:59:32.425 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.425+0000 7f5e9aacc780 1 < completed multipart upload key=GTRMEQJK675Z upload=VITCCDQ58WL6 tag=BWWUNCBAJJ5L type=write size=1369129 2024-06-04T15:59:32.427 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.427+0000 7f5e9aacc780 1 > prepared part key=_multipart_PNDPO2WUW7UX.2~74DYPT0RD7ER.0 size=1048576 2024-06-04T15:59:32.428 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.428+0000 7f5e9aacc780 1 > prepared part key=_multipart_PNDPO2WUW7UX.2~74DYPT0RD7ER.1 size=1048576 2024-06-04T15:59:32.430 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.429+0000 7f5e9aacc780 1 > prepared part key=_multipart_PNDPO2WUW7UX.2~74DYPT0RD7ER.2 size=589982 2024-06-04T15:59:32.430 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.429+0000 7f5e9aacc780 1 > prepared multipart upload key=PNDPO2WUW7UX upload=74DYPT0RD7ER tag=WII10QZJ2C3X type=write size=3735710 2024-06-04T15:59:32.432 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.432+0000 7f5e9aacc780 1 < suggested update operation key=AOCB36Y5Q7B0 tag=4MSQSQB6QPI9 type=del size=1375846 2024-06-04T15:59:32.434 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.434+0000 7f5e9aacc780 1 > prepared operation key=PASGIP872OVX tag=MKD0FW5H5F71 type=del size=2194541 2024-06-04T15:59:32.435 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.435+0000 7f5e9aacc780 1 < completed delete operation key=03ZNYG3WLMP4 tag=72MVG30KF7UP type=del 2024-06-04T15:59:32.437 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.436+0000 7f5e9aacc780 1 > prepared operation key=UTZHANL9ER2Q tag=8F4PEHH5A7KN type=del size=967385 2024-06-04T15:59:32.438 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.438+0000 7f5e9aacc780 1 < completed delete operation key=W1T4O3EAE7JN tag=P01FRV5VU4D9 type=del 2024-06-04T15:59:32.439 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.439+0000 7f5e9aacc780 1 > prepared operation key=QJA2JPATITNH tag=EUW12VNDJ717 type=del size=2858784 2024-06-04T15:59:32.440 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.440+0000 7f5e9aacc780 1 < canceled operation key=GCPC9OJH7KWU tag=UZT5UKGBWO92 type=write size=915114 2024-06-04T15:59:32.442 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.442+0000 7f5e9aacc780 1 > prepared operation key=TUGKW7F4V9NO tag=F0V5OSVDDBNV type=write size=1038810 2024-06-04T15:59:32.444 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.443+0000 7f5e9aacc780 1 < completed part key=_multipart_JL69PUHT6NNT.2~1ADPDNSKLDJ0.0 size=1048576 2024-06-04T15:59:32.445 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.445+0000 7f5e9aacc780 1 < completed part key=_multipart_JL69PUHT6NNT.2~1ADPDNSKLDJ0.1 size=310660 2024-06-04T15:59:32.447 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.447+0000 7f5e9aacc780 1 < completed multipart upload key=JL69PUHT6NNT upload=1ADPDNSKLDJ0 tag=VOF3UGE2TUHB type=write size=2407812 2024-06-04T15:59:32.449 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.448+0000 7f5e9aacc780 1 > prepared operation key=DY9JWHWNAUO1 tag=IFBR3N9LQEBM type=del size=1525019 2024-06-04T15:59:32.450 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.450+0000 7f5e9aacc780 1 < completed delete operation key=NJ5U8JTT32QK tag=VX76D9HCBDNJ type=del 2024-06-04T15:59:32.452 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.451+0000 7f5e9aacc780 1 > prepared operation key=4W5HB9WQQHR6 tag=KHY8Q9RN3MVA type=del size=924394 2024-06-04T15:59:32.453 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.452+0000 7f5e9aacc780 1 < completed write operation key=PNDPO2WUW7UX tag=RE35NCM2LULD type=write size=530995 2024-06-04T15:59:32.454 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.454+0000 7f5e9aacc780 1 > prepared operation key=XH0N984YVGKP tag=9NJ523PO5FG5 type=del size=1270197 2024-06-04T15:59:32.456 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.456+0000 7f5e9aacc780 1 < completed delete operation key=SUBHZJ7HUV3H tag=6I1FBDK8PGTF type=del 2024-06-04T15:59:32.457 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.457+0000 7f5e9aacc780 1 > prepared operation key=QJA2JPATITNH tag=QD4DTNCMWBDE type=del size=765606 2024-06-04T15:59:32.459 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.458+0000 7f5e9aacc780 1 < completed delete operation key=GCPC9OJH7KWU tag=PX7B2JQ0UK6I type=del 2024-06-04T15:59:32.460 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.460+0000 7f5e9aacc780 1 > prepared operation key=4W5HB9WQQHR6 tag=2YPBNLOI5BK9 type=del size=2916604 2024-06-04T15:59:32.462 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.462+0000 7f5e9aacc780 1 < completed part key=_multipart_9MPRI6LW3956.2~X5OABLZKE65C.0 size=1048576 2024-06-04T15:59:32.463 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.463+0000 7f5e9aacc780 1 < completed part key=_multipart_9MPRI6LW3956.2~X5OABLZKE65C.1 size=882290 2024-06-04T15:59:32.466 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.465+0000 7f5e9aacc780 1 < completed multipart upload key=9MPRI6LW3956 upload=X5OABLZKE65C tag=D22ZTS1CVN3P type=write size=2979442 2024-06-04T15:59:32.468 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.469+0000 7f5e9aacc780 1 > prepared part key=_multipart_DY9JWHWNAUO1.2~CS5O33MI5BXW.0 size=458043 2024-06-04T15:59:32.469 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.469+0000 7f5e9aacc780 1 > prepared multipart upload key=DY9JWHWNAUO1 upload=CS5O33MI5BXW tag=9T2CBER2V1RI type=write size=1506619 2024-06-04T15:59:32.470 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.470+0000 7f5e9aacc780 1 < completed write operation key=Q4OFQI0F5YLG tag=H63FZ13HA4I8 type=write size=975433 2024-06-04T15:59:32.472 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.471+0000 7f5e9aacc780 1 > prepared operation key=SUBHZJ7HUV3H tag=EI44B8L0PAXL type=del size=1112474 2024-06-04T15:59:32.473 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.473+0000 7f5e9aacc780 1 < canceled operation key=PASGIP872OVX tag=T5BBXFEL6D4X type=del size=3864436 2024-06-04T15:59:32.475 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.475+0000 7f5e9aacc780 1 > prepared operation key=PNDPO2WUW7UX tag=8GYGY32WCPN1 type=write size=655072 2024-06-04T15:59:32.476 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.476+0000 7f5e9aacc780 1 < completed part key=_multipart_JL69PUHT6NNT.2~YIL0WIVXOYUG.0 size=1048576 2024-06-04T15:59:32.477 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.477+0000 7f5e9aacc780 1 < completed part key=_multipart_JL69PUHT6NNT.2~YIL0WIVXOYUG.1 size=1048576 2024-06-04T15:59:32.478 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.478+0000 7f5e9aacc780 1 < completed part key=_multipart_JL69PUHT6NNT.2~YIL0WIVXOYUG.2 size=583821 2024-06-04T15:59:32.481 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.481+0000 7f5e9aacc780 1 < completed multipart upload key=JL69PUHT6NNT upload=YIL0WIVXOYUG tag=LII5PMIA1UOD type=write size=3729549 2024-06-04T15:59:32.483 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.483+0000 7f5e9aacc780 1 > prepared part key=_multipart_PASGIP872OVX.2~UBNJKXAVJ1RB.0 size=1048576 2024-06-04T15:59:32.485 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.484+0000 7f5e9aacc780 1 > prepared part key=_multipart_PASGIP872OVX.2~UBNJKXAVJ1RB.1 size=1048576 2024-06-04T15:59:32.486 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.485+0000 7f5e9aacc780 1 > prepared part key=_multipart_PASGIP872OVX.2~UBNJKXAVJ1RB.2 size=166281 2024-06-04T15:59:32.486 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.485+0000 7f5e9aacc780 1 > prepared multipart upload key=PASGIP872OVX upload=UBNJKXAVJ1RB tag=FTLOO1RRMF6J type=write size=3312009 2024-06-04T15:59:32.487 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.487+0000 7f5e9aacc780 1 < completed write operation key=QJA2JPATITNH tag=WKW6IRXC8MWP type=write size=243364 2024-06-04T15:59:32.489 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.488+0000 7f5e9aacc780 1 > prepared operation key=7S9S3MIG7WIT tag=FRR776LH1950 type=del size=2512402 2024-06-04T15:59:32.491 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.490+0000 7f5e9aacc780 1 < completed delete operation key=PCLJXQHJ4HTY tag=L8ZV4O3TN5KL type=del 2024-06-04T15:59:32.492 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.492+0000 7f5e9aacc780 1 > prepared operation key=7S9S3MIG7WIT tag=17PS9O0OA3PE type=del size=782708 2024-06-04T15:59:32.494 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.494+0000 7f5e9aacc780 1 < completed part key=_multipart_PNDPO2WUW7UX.2~74DYPT0RD7ER.0 size=1048576 2024-06-04T15:59:32.495 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.495+0000 7f5e9aacc780 1 < completed part key=_multipart_PNDPO2WUW7UX.2~74DYPT0RD7ER.1 size=1048576 2024-06-04T15:59:32.495 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.495+0000 7f5e9aacc780 1 < canceled part key=_multipart_PNDPO2WUW7UX.2~74DYPT0RD7ER.2 size=589982 2024-06-04T15:59:32.497 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.497+0000 7f5e9aacc780 1 < canceled multipart upload key=PNDPO2WUW7UX upload=74DYPT0RD7ER tag=WII10QZJ2C3X type=write size=3735710 2024-06-04T15:59:32.500 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.499+0000 7f5e9aacc780 1 > prepared part key=_multipart_QJA2JPATITNH.2~J1XTPJPA0323.0 size=1048576 2024-06-04T15:59:32.501 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.500+0000 7f5e9aacc780 1 > prepared part key=_multipart_QJA2JPATITNH.2~J1XTPJPA0323.1 size=204611 2024-06-04T15:59:32.501 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.500+0000 7f5e9aacc780 1 > prepared multipart upload key=QJA2JPATITNH upload=J1XTPJPA0323 tag=L4KJKCYU8Q6T type=write size=2301763 2024-06-04T15:59:32.502 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.502+0000 7f5e9aacc780 1 < completed delete operation key=PASGIP872OVX tag=MKD0FW5H5F71 type=del 2024-06-04T15:59:32.505 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.505+0000 7f5e9aacc780 1 > prepared operation key=Q2V1ICTBSCV1 tag=Z94XSKBY5F3I type=del size=3052369 2024-06-04T15:59:32.509 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.508+0000 7f5e9aacc780 1 < suggested remove operation key=UTZHANL9ER2Q tag=8F4PEHH5A7KN type=del 2024-06-04T15:59:32.510 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.510+0000 7f5e9aacc780 1 > prepared operation key=GTRMEQJK675Z tag=BPLMJEKNWNAS type=del size=3169453 2024-06-04T15:59:32.512 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.511+0000 7f5e9aacc780 1 < completed delete operation key=QJA2JPATITNH tag=EUW12VNDJ717 type=del 2024-06-04T15:59:32.513 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.513+0000 7f5e9aacc780 1 > prepared operation key=Q2V1ICTBSCV1 tag=6EC2E14U70VR type=del size=2042548 2024-06-04T15:59:32.515 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.514+0000 7f5e9aacc780 1 < completed write operation key=TUGKW7F4V9NO tag=F0V5OSVDDBNV type=write size=1038810 2024-06-04T15:59:32.516 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.516+0000 7f5e9aacc780 1 > prepared operation key=PNDPO2WUW7UX tag=72POF28NNMKS type=del size=2719465 2024-06-04T15:59:32.517 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.517+0000 7f5e9aacc780 1 < completed delete operation key=DY9JWHWNAUO1 tag=IFBR3N9LQEBM type=del 2024-06-04T15:59:32.520 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.520+0000 7f5e9aacc780 1 > prepared part key=_multipart_Q4OFQI0F5YLG.2~CAL0ZAU2AQJN.0 size=1048576 2024-06-04T15:59:32.521 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.521+0000 7f5e9aacc780 1 > prepared part key=_multipart_Q4OFQI0F5YLG.2~CAL0ZAU2AQJN.1 size=344380 2024-06-04T15:59:32.521 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.521+0000 7f5e9aacc780 1 > prepared multipart upload key=Q4OFQI0F5YLG upload=CAL0ZAU2AQJN tag=2VB7T15FLLU0 type=write size=2441532 2024-06-04T15:59:32.523 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.522+0000 7f5e9aacc780 1 < completed delete operation key=4W5HB9WQQHR6 tag=KHY8Q9RN3MVA type=del 2024-06-04T15:59:32.524 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.524+0000 7f5e9aacc780 1 > prepared operation key=UTZHANL9ER2Q tag=IK95C3JNMY49 type=write size=309058 2024-06-04T15:59:32.526 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.526+0000 7f5e9aacc780 1 < canceled operation key=XH0N984YVGKP tag=9NJ523PO5FG5 type=del size=1270197 2024-06-04T15:59:32.527 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.527+0000 7f5e9aacc780 1 > prepared operation key=TUGKW7F4V9NO tag=BCJB5A5P6LSP type=del size=436096 2024-06-04T15:59:32.529 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.528+0000 7f5e9aacc780 1 < canceled operation key=QJA2JPATITNH tag=QD4DTNCMWBDE type=del size=765606 2024-06-04T15:59:32.530 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.530+0000 7f5e9aacc780 1 > prepared operation key=NHPH4LYPP0LL tag=9CGXMI1XQ8YA type=del size=917717 2024-06-04T15:59:32.533 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.532+0000 7f5e9aacc780 1 < suggested remove operation key=4W5HB9WQQHR6 tag=2YPBNLOI5BK9 type=del 2024-06-04T15:59:32.534 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.534+0000 7f5e9aacc780 1 > prepared operation key=TUGKW7F4V9NO tag=XX9LUV5BVD81 type=del size=700304 2024-06-04T15:59:32.536 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.535+0000 7f5e9aacc780 1 < completed part key=_multipart_DY9JWHWNAUO1.2~CS5O33MI5BXW.0 size=458043 2024-06-04T15:59:32.538 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.538+0000 7f5e9aacc780 1 < completed multipart upload key=DY9JWHWNAUO1 upload=CS5O33MI5BXW tag=9T2CBER2V1RI type=write size=1506619 2024-06-04T15:59:32.540 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.539+0000 7f5e9aacc780 1 > prepared operation key=NHPH4LYPP0LL tag=4KCIG1CDKQYX type=del size=1884948 2024-06-04T15:59:32.541 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.540+0000 7f5e9aacc780 1 < completed delete operation key=SUBHZJ7HUV3H tag=EI44B8L0PAXL type=del 2024-06-04T15:59:32.542 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.542+0000 7f5e9aacc780 1 > prepared operation key=RP8K6QJUZAH1 tag=I4PHZI1P1SBU type=del size=440381 2024-06-04T15:59:32.545 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.544+0000 7f5e9aacc780 1 < suggested remove operation key=PNDPO2WUW7UX tag=8GYGY32WCPN1 type=write 2024-06-04T15:59:32.546 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.546+0000 7f5e9aacc780 1 > prepared operation key=W1T4O3EAE7JN tag=1HCMFB3M783D type=write size=881545 2024-06-04T15:59:32.547 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.547+0000 7f5e9aacc780 1 < completed part key=_multipart_PASGIP872OVX.2~UBNJKXAVJ1RB.0 size=1048576 2024-06-04T15:59:32.548 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.548+0000 7f5e9aacc780 1 < completed part key=_multipart_PASGIP872OVX.2~UBNJKXAVJ1RB.1 size=1048576 2024-06-04T15:59:32.550 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.550+0000 7f5e9aacc780 1 < completed part key=_multipart_PASGIP872OVX.2~UBNJKXAVJ1RB.2 size=166281 2024-06-04T15:59:32.552 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.552+0000 7f5e9aacc780 1 < completed multipart upload key=PASGIP872OVX upload=UBNJKXAVJ1RB tag=FTLOO1RRMF6J type=write size=3312009 2024-06-04T15:59:32.553 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.553+0000 7f5e9aacc780 1 > prepared operation key=Q2V1ICTBSCV1 tag=2928TMLSHYDR type=del size=728356 2024-06-04T15:59:32.555 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.554+0000 7f5e9aacc780 1 < completed delete operation key=7S9S3MIG7WIT tag=FRR776LH1950 type=del 2024-06-04T15:59:32.556 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.556+0000 7f5e9aacc780 1 > prepared operation key=PASGIP872OVX tag=86K9VMXMXM91 type=del size=2516122 2024-06-04T15:59:32.558 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.557+0000 7f5e9aacc780 1 < completed delete operation key=7S9S3MIG7WIT tag=17PS9O0OA3PE type=del 2024-06-04T15:59:32.559 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.558+0000 7f5e9aacc780 1 > prepared operation key=Q2V1ICTBSCV1 tag=Q571NBMSKWJN type=del size=3425847 2024-06-04T15:59:32.560 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.560+0000 7f5e9aacc780 1 < completed part key=_multipart_QJA2JPATITNH.2~J1XTPJPA0323.0 size=1048576 2024-06-04T15:59:32.561 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.561+0000 7f5e9aacc780 1 < completed part key=_multipart_QJA2JPATITNH.2~J1XTPJPA0323.1 size=204611 2024-06-04T15:59:32.563 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.563+0000 7f5e9aacc780 1 < completed multipart upload key=QJA2JPATITNH upload=J1XTPJPA0323 tag=L4KJKCYU8Q6T type=write size=2301763 2024-06-04T15:59:32.565 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.564+0000 7f5e9aacc780 1 > prepared operation key=TUGKW7F4V9NO tag=3HTFO436AY07 type=write size=403430 2024-06-04T15:59:32.566 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.566+0000 7f5e9aacc780 1 < completed delete operation key=Q2V1ICTBSCV1 tag=Z94XSKBY5F3I type=del 2024-06-04T15:59:32.567 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.567+0000 7f5e9aacc780 1 > prepared operation key=QUIVPH3OB6KN tag=M5G6RB9DY0XZ type=write size=875117 2024-06-04T15:59:32.568 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.568+0000 7f5e9aacc780 1 < completed delete operation key=GTRMEQJK675Z tag=BPLMJEKNWNAS type=del 2024-06-04T15:59:32.570 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.569+0000 7f5e9aacc780 1 > prepared operation key=Q2V1ICTBSCV1 tag=HY6MQTYFIRVJ type=del size=3071670 2024-06-04T15:59:32.571 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.571+0000 7f5e9aacc780 1 < completed delete operation key=Q2V1ICTBSCV1 tag=6EC2E14U70VR type=del 2024-06-04T15:59:32.573 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.572+0000 7f5e9aacc780 1 > prepared operation key=PCLJXQHJ4HTY tag=QRM1MR9HMVGD type=del size=3435974 2024-06-04T15:59:32.574 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.574+0000 7f5e9aacc780 -1 < failed to complete operation key=PNDPO2WUW7UX tag=72POF28NNMKS type=del size=2719465: (22) Invalid argument 2024-06-04T15:59:32.576 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.575+0000 7f5e9aacc780 1 > prepared operation key=SUBHZJ7HUV3H tag=99TF15X2SHCS type=del size=1322569 2024-06-04T15:59:32.577 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.577+0000 7f5e9aacc780 1 < completed part key=_multipart_Q4OFQI0F5YLG.2~CAL0ZAU2AQJN.0 size=1048576 2024-06-04T15:59:32.578 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.578+0000 7f5e9aacc780 1 < completed part key=_multipart_Q4OFQI0F5YLG.2~CAL0ZAU2AQJN.1 size=344380 2024-06-04T15:59:32.580 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.580+0000 7f5e9aacc780 1 < completed multipart upload key=Q4OFQI0F5YLG upload=CAL0ZAU2AQJN tag=2VB7T15FLLU0 type=write size=2441532 2024-06-04T15:59:32.582 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.582+0000 7f5e9aacc780 1 > prepared operation key=DY9JWHWNAUO1 tag=YVQMQ6EJILT3 type=write size=444338 2024-06-04T15:59:32.583 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.583+0000 7f5e9aacc780 1 < canceled operation key=UTZHANL9ER2Q tag=IK95C3JNMY49 type=write size=309058 2024-06-04T15:59:32.586 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.586+0000 7f5e9aacc780 1 > prepared part key=_multipart_1IKNQXU3Y2JJ.2~NX7R34N7YN5K.0 size=447018 2024-06-04T15:59:32.586 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.586+0000 7f5e9aacc780 1 > prepared multipart upload key=1IKNQXU3Y2JJ upload=NX7R34N7YN5K tag=LPYBZRLCJ9KS type=write size=1495594 2024-06-04T15:59:32.588 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.588+0000 7f5e9aacc780 1 < suggested remove operation key=TUGKW7F4V9NO tag=BCJB5A5P6LSP type=del 2024-06-04T15:59:32.591 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.590+0000 7f5e9aacc780 1 > prepared part key=_multipart_A8O0S3S45RGM.2~N3XPNXA5VGN0.0 size=251188 2024-06-04T15:59:32.591 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.590+0000 7f5e9aacc780 1 > prepared multipart upload key=A8O0S3S45RGM upload=N3XPNXA5VGN0 tag=VIXEPB108D05 type=write size=1299764 2024-06-04T15:59:32.594 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.594+0000 7f5e9aacc780 1 < suggested update operation key=NHPH4LYPP0LL tag=9CGXMI1XQ8YA type=del size=917717 2024-06-04T15:59:32.595 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.595+0000 7f5e9aacc780 1 > prepared operation key=7S9S3MIG7WIT tag=YOI6UW62O6H6 type=del size=444506 2024-06-04T15:59:32.597 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.596+0000 7f5e9aacc780 -1 < failed to complete operation key=TUGKW7F4V9NO tag=XX9LUV5BVD81 type=del size=700304: (22) Invalid argument 2024-06-04T15:59:32.600 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.599+0000 7f5e9aacc780 1 > prepared part key=_multipart_QUIVPH3OB6KN.2~UIQ9GBDAC05K.0 size=1048576 2024-06-04T15:59:32.601 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.601+0000 7f5e9aacc780 1 > prepared part key=_multipart_QUIVPH3OB6KN.2~UIQ9GBDAC05K.1 size=1048576 2024-06-04T15:59:32.602 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.602+0000 7f5e9aacc780 1 > prepared part key=_multipart_QUIVPH3OB6KN.2~UIQ9GBDAC05K.2 size=629858 2024-06-04T15:59:32.602 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.602+0000 7f5e9aacc780 1 > prepared multipart upload key=QUIVPH3OB6KN upload=UIQ9GBDAC05K tag=X7OPGYCSI8F8 type=write size=3775586 2024-06-04T15:59:32.604 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.603+0000 7f5e9aacc780 -1 < failed to complete operation key=NHPH4LYPP0LL tag=4KCIG1CDKQYX type=del size=1884948: (22) Invalid argument 2024-06-04T15:59:32.605 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.605+0000 7f5e9aacc780 1 > prepared operation key=AOCB36Y5Q7B0 tag=3SU8T73525WY type=del size=2698370 2024-06-04T15:59:32.607 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.607+0000 7f5e9aacc780 1 < completed delete operation key=RP8K6QJUZAH1 tag=I4PHZI1P1SBU type=del 2024-06-04T15:59:32.609 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.609+0000 7f5e9aacc780 1 > prepared operation key=2BT2AXKB1RTA tag=HXLLU3L3XHPA type=del size=3106227 2024-06-04T15:59:32.610 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.610+0000 7f5e9aacc780 1 < completed write operation key=W1T4O3EAE7JN tag=1HCMFB3M783D type=write size=881545 2024-06-04T15:59:32.613 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.613+0000 7f5e9aacc780 1 > prepared part key=_multipart_RP8K6QJUZAH1.2~PRQQ0UZNFKKF.0 size=1048576 2024-06-04T15:59:32.614 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.614+0000 7f5e9aacc780 1 > prepared part key=_multipart_RP8K6QJUZAH1.2~PRQQ0UZNFKKF.1 size=1048576 2024-06-04T15:59:32.615 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.615+0000 7f5e9aacc780 1 > prepared part key=_multipart_RP8K6QJUZAH1.2~PRQQ0UZNFKKF.2 size=168444 2024-06-04T15:59:32.616 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.615+0000 7f5e9aacc780 1 > prepared multipart upload key=RP8K6QJUZAH1 upload=PRQQ0UZNFKKF tag=3L11F65S75QZ type=write size=3314172 2024-06-04T15:59:32.618 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.618+0000 7f5e9aacc780 1 < suggested remove operation key=Q2V1ICTBSCV1 tag=2928TMLSHYDR type=del 2024-06-04T15:59:32.620 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.619+0000 7f5e9aacc780 1 > prepared operation key=03ZNYG3WLMP4 tag=DFC0R7Y5G7X5 type=del size=2471837 2024-06-04T15:59:32.621 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.621+0000 7f5e9aacc780 1 < completed delete operation key=PASGIP872OVX tag=86K9VMXMXM91 type=del 2024-06-04T15:59:32.623 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.622+0000 7f5e9aacc780 1 > prepared operation key=DY9JWHWNAUO1 tag=TZEQ9ZYP7VHK type=del size=289111 2024-06-04T15:59:32.623 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.623+0000 7f5e9aacc780 -1 < no bi entry to suggest for operation key=Q2V1ICTBSCV1 tag=Q571NBMSKWJN type=del size=3425847: (2) No such file or directory 2024-06-04T15:59:32.625 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.625+0000 7f5e9aacc780 1 > prepared operation key=UW5LVIBG09SV tag=ZNDLEOTXZNHS type=del size=2439351 2024-06-04T15:59:32.626 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.626+0000 7f5e9aacc780 -1 < failed to complete operation key=TUGKW7F4V9NO tag=3HTFO436AY07 type=write size=403430: (22) Invalid argument 2024-06-04T15:59:32.629 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.629+0000 7f5e9aacc780 1 > prepared part key=_multipart_QUIVPH3OB6KN.2~465PJPYYA1SM.0 size=16397 2024-06-04T15:59:32.629 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.629+0000 7f5e9aacc780 1 > prepared multipart upload key=QUIVPH3OB6KN upload=465PJPYYA1SM tag=26Z4MSBUQPBL type=write size=1064973 2024-06-04T15:59:32.632 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.632+0000 7f5e9aacc780 1 < suggested update operation key=QUIVPH3OB6KN tag=M5G6RB9DY0XZ type=write size=875117 2024-06-04T15:59:32.634 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.633+0000 7f5e9aacc780 1 > prepared operation key=QUIVPH3OB6KN tag=H8G2NUIPH44W type=del size=1891167 2024-06-04T15:59:32.634 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.634+0000 7f5e9aacc780 -1 < no bi entry to suggest for operation key=Q2V1ICTBSCV1 tag=HY6MQTYFIRVJ type=del size=3071670: (2) No such file or directory 2024-06-04T15:59:32.637 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.636+0000 7f5e9aacc780 1 > prepared part key=_multipart_FBV2MAG130M6.2~IOLIL4SBM29A.0 size=1048576 2024-06-04T15:59:32.638 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.638+0000 7f5e9aacc780 1 > prepared part key=_multipart_FBV2MAG130M6.2~IOLIL4SBM29A.1 size=1048576 2024-06-04T15:59:32.639 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.639+0000 7f5e9aacc780 1 > prepared part key=_multipart_FBV2MAG130M6.2~IOLIL4SBM29A.2 size=166700 2024-06-04T15:59:32.639 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.639+0000 7f5e9aacc780 1 > prepared multipart upload key=FBV2MAG130M6 upload=IOLIL4SBM29A tag=28E3FLTSFMPU type=write size=3312428 2024-06-04T15:59:32.641 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.640+0000 7f5e9aacc780 1 < completed delete operation key=PCLJXQHJ4HTY tag=QRM1MR9HMVGD type=del 2024-06-04T15:59:32.645 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.645+0000 7f5e9aacc780 1 > prepared part key=_multipart_B0HK5FJ2RGJE.2~SQ1J180OWDE3.0 size=965976 2024-06-04T15:59:32.645 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.645+0000 7f5e9aacc780 1 > prepared multipart upload key=B0HK5FJ2RGJE upload=SQ1J180OWDE3 tag=V5T4DCYT7DNB type=write size=2014552 2024-06-04T15:59:32.646 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.646+0000 7f5e9aacc780 1 < completed delete operation key=SUBHZJ7HUV3H tag=99TF15X2SHCS type=del 2024-06-04T15:59:32.648 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.647+0000 7f5e9aacc780 1 > prepared operation key=PCLJXQHJ4HTY tag=KQM9IXDZW21Q type=write size=739087 2024-06-04T15:59:32.649 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.649+0000 7f5e9aacc780 1 < completed write operation key=DY9JWHWNAUO1 tag=YVQMQ6EJILT3 type=write size=444338 2024-06-04T15:59:32.651 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.651+0000 7f5e9aacc780 1 > prepared operation key=B0HK5FJ2RGJE tag=0702S2QWWNVM type=del size=899484 2024-06-04T15:59:32.652 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.652+0000 7f5e9aacc780 1 < completed part key=_multipart_1IKNQXU3Y2JJ.2~NX7R34N7YN5K.0 size=447018 2024-06-04T15:59:32.655 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.655+0000 7f5e9aacc780 1 < completed multipart upload key=1IKNQXU3Y2JJ upload=NX7R34N7YN5K tag=LPYBZRLCJ9KS type=write size=1495594 2024-06-04T15:59:32.656 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.656+0000 7f5e9aacc780 1 > prepared operation key=GCPC9OJH7KWU tag=I29JGEC0AAN3 type=del size=1890281 2024-06-04T15:59:32.658 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.658+0000 7f5e9aacc780 1 < completed part key=_multipart_A8O0S3S45RGM.2~N3XPNXA5VGN0.0 size=251188 2024-06-04T15:59:32.660 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.660+0000 7f5e9aacc780 1 < completed multipart upload key=A8O0S3S45RGM upload=N3XPNXA5VGN0 tag=VIXEPB108D05 type=write size=1299764 2024-06-04T15:59:32.663 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.663+0000 7f5e9aacc780 1 > prepared part key=_multipart_XH0N984YVGKP.2~NGBC0TDIA1F4.0 size=1048576 2024-06-04T15:59:32.664 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.664+0000 7f5e9aacc780 1 > prepared part key=_multipart_XH0N984YVGKP.2~NGBC0TDIA1F4.1 size=1048576 2024-06-04T15:59:32.665 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.665+0000 7f5e9aacc780 1 > prepared part key=_multipart_XH0N984YVGKP.2~NGBC0TDIA1F4.2 size=740891 2024-06-04T15:59:32.665 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.665+0000 7f5e9aacc780 1 > prepared multipart upload key=XH0N984YVGKP upload=NGBC0TDIA1F4 tag=0PUPUY7TY1DB type=write size=3886619 2024-06-04T15:59:32.667 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.667+0000 7f5e9aacc780 1 < completed delete operation key=7S9S3MIG7WIT tag=YOI6UW62O6H6 type=del 2024-06-04T15:59:32.670 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.669+0000 7f5e9aacc780 1 > prepared part key=_multipart_XH0N984YVGKP.2~2ILBH6EIRRN2.0 size=276414 2024-06-04T15:59:32.670 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.669+0000 7f5e9aacc780 1 > prepared multipart upload key=XH0N984YVGKP upload=2ILBH6EIRRN2 tag=B0WAYSEOO04X type=write size=1324990 2024-06-04T15:59:32.671 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.671+0000 7f5e9aacc780 1 < completed part key=_multipart_QUIVPH3OB6KN.2~UIQ9GBDAC05K.0 size=1048576 2024-06-04T15:59:32.672 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.672+0000 7f5e9aacc780 1 < completed part key=_multipart_QUIVPH3OB6KN.2~UIQ9GBDAC05K.1 size=1048576 2024-06-04T15:59:32.674 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.673+0000 7f5e9aacc780 1 < completed part key=_multipart_QUIVPH3OB6KN.2~UIQ9GBDAC05K.2 size=629858 2024-06-04T15:59:32.676 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.676+0000 7f5e9aacc780 1 < completed multipart upload key=QUIVPH3OB6KN upload=UIQ9GBDAC05K tag=X7OPGYCSI8F8 type=write size=3775586 2024-06-04T15:59:32.679 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.679+0000 7f5e9aacc780 1 > prepared part key=_multipart_2BT2AXKB1RTA.2~XO2NC6OITIF3.0 size=701797 2024-06-04T15:59:32.679 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.679+0000 7f5e9aacc780 1 > prepared multipart upload key=2BT2AXKB1RTA upload=XO2NC6OITIF3 tag=JH0PFHRE006J type=write size=1750373 2024-06-04T15:59:32.682 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.681+0000 7f5e9aacc780 1 < suggested remove operation key=AOCB36Y5Q7B0 tag=3SU8T73525WY type=del 2024-06-04T15:59:32.683 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.683+0000 7f5e9aacc780 1 > prepared operation key=9MPRI6LW3956 tag=NGDQM1SPR7DG type=del size=882659 2024-06-04T15:59:32.684 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.684+0000 7f5e9aacc780 1 < completed delete operation key=2BT2AXKB1RTA tag=HXLLU3L3XHPA type=del 2024-06-04T15:59:32.686 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.686+0000 7f5e9aacc780 1 > prepared operation key=03ZNYG3WLMP4 tag=5GR4QIQDJY0N type=del size=1108546 2024-06-04T15:59:32.687 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.687+0000 7f5e9aacc780 1 < completed part key=_multipart_RP8K6QJUZAH1.2~PRQQ0UZNFKKF.0 size=1048576 2024-06-04T15:59:32.689 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.689+0000 7f5e9aacc780 1 < completed part key=_multipart_RP8K6QJUZAH1.2~PRQQ0UZNFKKF.1 size=1048576 2024-06-04T15:59:32.690 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.689+0000 7f5e9aacc780 1 < completed part key=_multipart_RP8K6QJUZAH1.2~PRQQ0UZNFKKF.2 size=168444 2024-06-04T15:59:32.692 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.691+0000 7f5e9aacc780 1 < completed multipart upload key=RP8K6QJUZAH1 upload=PRQQ0UZNFKKF tag=3L11F65S75QZ type=write size=3314172 2024-06-04T15:59:32.693 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.693+0000 7f5e9aacc780 1 > prepared operation key=B0HK5FJ2RGJE tag=1FHW96HZSMQB type=write size=733550 2024-06-04T15:59:32.695 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.694+0000 7f5e9aacc780 1 < completed delete operation key=03ZNYG3WLMP4 tag=DFC0R7Y5G7X5 type=del 2024-06-04T15:59:32.696 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.696+0000 7f5e9aacc780 1 > prepared operation key=7S9S3MIG7WIT tag=G1QA1I9BT3Y5 type=del size=3462959 2024-06-04T15:59:32.697 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.697+0000 7f5e9aacc780 1 < completed delete operation key=DY9JWHWNAUO1 tag=TZEQ9ZYP7VHK type=del 2024-06-04T15:59:32.699 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.699+0000 7f5e9aacc780 1 > prepared operation key=W1T4O3EAE7JN tag=969DIDYQC793 type=write size=59735 2024-06-04T15:59:32.700 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.700+0000 7f5e9aacc780 1 < completed delete operation key=UW5LVIBG09SV tag=ZNDLEOTXZNHS type=del 2024-06-04T15:59:32.702 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.702+0000 7f5e9aacc780 1 > prepared operation key=RP8K6QJUZAH1 tag=K75HPVM61PHB type=del size=3525004 2024-06-04T15:59:32.703 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.703+0000 7f5e9aacc780 1 < completed part key=_multipart_QUIVPH3OB6KN.2~465PJPYYA1SM.0 size=16397 2024-06-04T15:59:32.706 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.706+0000 7f5e9aacc780 1 < completed multipart upload key=QUIVPH3OB6KN upload=465PJPYYA1SM tag=26Z4MSBUQPBL type=write size=1064973 2024-06-04T15:59:32.707 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.707+0000 7f5e9aacc780 1 > prepared operation key=HD6SNICRCDLL tag=PKGBN926EGME type=del size=995002 2024-06-04T15:59:32.710 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.710+0000 7f5e9aacc780 1 < suggested remove operation key=QUIVPH3OB6KN tag=H8G2NUIPH44W type=del 2024-06-04T15:59:32.711 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.711+0000 7f5e9aacc780 1 > prepared operation key=AOCB36Y5Q7B0 tag=T146X3U46HQN type=write size=941570 2024-06-04T15:59:32.713 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.712+0000 7f5e9aacc780 1 < completed part key=_multipart_FBV2MAG130M6.2~IOLIL4SBM29A.0 size=1048576 2024-06-04T15:59:32.714 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.713+0000 7f5e9aacc780 1 < completed part key=_multipart_FBV2MAG130M6.2~IOLIL4SBM29A.1 size=1048576 2024-06-04T15:59:32.715 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.714+0000 7f5e9aacc780 1 < completed part key=_multipart_FBV2MAG130M6.2~IOLIL4SBM29A.2 size=166700 2024-06-04T15:59:32.717 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.717+0000 7f5e9aacc780 1 < completed multipart upload key=FBV2MAG130M6 upload=IOLIL4SBM29A tag=28E3FLTSFMPU type=write size=3312428 2024-06-04T15:59:32.720 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.719+0000 7f5e9aacc780 1 > prepared part key=_multipart_SUBHZJ7HUV3H.2~MRTLZUCVZ11D.0 size=1048576 2024-06-04T15:59:32.721 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.720+0000 7f5e9aacc780 1 > prepared part key=_multipart_SUBHZJ7HUV3H.2~MRTLZUCVZ11D.1 size=262024 2024-06-04T15:59:32.721 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.720+0000 7f5e9aacc780 1 > prepared multipart upload key=SUBHZJ7HUV3H upload=MRTLZUCVZ11D tag=3NJO4L31EIN6 type=write size=2359176 2024-06-04T15:59:32.722 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.722+0000 7f5e9aacc780 1 < completed part key=_multipart_B0HK5FJ2RGJE.2~SQ1J180OWDE3.0 size=965976 2024-06-04T15:59:32.724 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.724+0000 7f5e9aacc780 1 < completed multipart upload key=B0HK5FJ2RGJE upload=SQ1J180OWDE3 tag=V5T4DCYT7DNB type=write size=2014552 2024-06-04T15:59:32.726 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.725+0000 7f5e9aacc780 1 > prepared operation key=GTRMEQJK675Z tag=NS1M5VY0QZHU type=write size=427871 2024-06-04T15:59:32.728 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.728+0000 7f5e9aacc780 1 < suggested update operation key=PCLJXQHJ4HTY tag=KQM9IXDZW21Q type=write size=739087 2024-06-04T15:59:32.730 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.729+0000 7f5e9aacc780 1 > prepared operation key=2BT2AXKB1RTA tag=0AUW1SG9Q11I type=del size=3950883 2024-06-04T15:59:32.731 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.731+0000 7f5e9aacc780 1 < completed delete operation key=B0HK5FJ2RGJE tag=0702S2QWWNVM type=del 2024-06-04T15:59:32.734 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.734+0000 7f5e9aacc780 1 > prepared part key=_multipart_DY9JWHWNAUO1.2~2U49K90DU00B.0 size=582875 2024-06-04T15:59:32.734 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.734+0000 7f5e9aacc780 1 > prepared multipart upload key=DY9JWHWNAUO1 upload=2U49K90DU00B tag=N71UG0HIE911 type=write size=1631451 2024-06-04T15:59:32.735 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.735+0000 7f5e9aacc780 1 < completed delete operation key=GCPC9OJH7KWU tag=I29JGEC0AAN3 type=del 2024-06-04T15:59:32.737 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.737+0000 7f5e9aacc780 1 > prepared operation key=7S9S3MIG7WIT tag=JDSX52OABY6Y type=del size=365640 2024-06-04T15:59:32.738 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.738+0000 7f5e9aacc780 1 < completed part key=_multipart_XH0N984YVGKP.2~NGBC0TDIA1F4.0 size=1048576 2024-06-04T15:59:32.739 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.739+0000 7f5e9aacc780 1 < completed part key=_multipart_XH0N984YVGKP.2~NGBC0TDIA1F4.1 size=1048576 2024-06-04T15:59:32.740 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.740+0000 7f5e9aacc780 1 < completed part key=_multipart_XH0N984YVGKP.2~NGBC0TDIA1F4.2 size=740891 2024-06-04T15:59:32.742 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.742+0000 7f5e9aacc780 1 < completed multipart upload key=XH0N984YVGKP upload=NGBC0TDIA1F4 tag=0PUPUY7TY1DB type=write size=3886619 2024-06-04T15:59:32.744 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.744+0000 7f5e9aacc780 1 > prepared operation key=SUBHZJ7HUV3H tag=UB0H1LEGK7H5 type=del size=3835756 2024-06-04T15:59:32.745 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.745+0000 7f5e9aacc780 1 < completed part key=_multipart_XH0N984YVGKP.2~2ILBH6EIRRN2.0 size=276414 2024-06-04T15:59:32.748 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.748+0000 7f5e9aacc780 1 < completed multipart upload key=XH0N984YVGKP upload=2ILBH6EIRRN2 tag=B0WAYSEOO04X type=write size=1324990 2024-06-04T15:59:32.750 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.750+0000 7f5e9aacc780 1 > prepared part key=_multipart_RP8K6QJUZAH1.2~KQYKQ7FL3LJP.0 size=504329 2024-06-04T15:59:32.750 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.750+0000 7f5e9aacc780 1 > prepared multipart upload key=RP8K6QJUZAH1 upload=KQYKQ7FL3LJP tag=TLV7CH8851DM type=write size=1552905 2024-06-04T15:59:32.752 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.751+0000 7f5e9aacc780 1 < completed part key=_multipart_2BT2AXKB1RTA.2~XO2NC6OITIF3.0 size=701797 2024-06-04T15:59:32.754 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.754+0000 7f5e9aacc780 1 < completed multipart upload key=2BT2AXKB1RTA upload=XO2NC6OITIF3 tag=JH0PFHRE006J type=write size=1750373 2024-06-04T15:59:32.755 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.755+0000 7f5e9aacc780 1 > prepared operation key=PASGIP872OVX tag=HHDPB2EOJKXP type=del size=2453132 2024-06-04T15:59:32.757 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.757+0000 7f5e9aacc780 1 < completed delete operation key=9MPRI6LW3956 tag=NGDQM1SPR7DG type=del 2024-06-04T15:59:32.758 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.758+0000 7f5e9aacc780 1 > prepared operation key=NHPH4LYPP0LL tag=R14C724OL95N type=del size=1488108 2024-06-04T15:59:32.760 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.759+0000 7f5e9aacc780 1 < completed delete operation key=03ZNYG3WLMP4 tag=5GR4QIQDJY0N type=del 2024-06-04T15:59:32.762 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.762+0000 7f5e9aacc780 1 > prepared part key=_multipart_1IKNQXU3Y2JJ.2~0SR3CRSU07Q4.0 size=579501 2024-06-04T15:59:32.762 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.762+0000 7f5e9aacc780 1 > prepared multipart upload key=1IKNQXU3Y2JJ upload=0SR3CRSU07Q4 tag=1GV2B2H6TDQL type=write size=1628077 2024-06-04T15:59:32.765 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.764+0000 7f5e9aacc780 1 < suggested update operation key=B0HK5FJ2RGJE tag=1FHW96HZSMQB type=write size=733550 2024-06-04T15:59:32.766 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.766+0000 7f5e9aacc780 1 > prepared operation key=W1T4O3EAE7JN tag=4N9K8HIVZTMG type=write size=517664 2024-06-04T15:59:32.769 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.769+0000 7f5e9aacc780 1 < suggested remove operation key=7S9S3MIG7WIT tag=G1QA1I9BT3Y5 type=del 2024-06-04T15:59:32.770 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.770+0000 7f5e9aacc780 1 > prepared operation key=JL69PUHT6NNT tag=RQG8R5O3LWXL type=del size=98369 2024-06-04T15:59:32.772 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.772+0000 7f5e9aacc780 1 < completed write operation key=W1T4O3EAE7JN tag=969DIDYQC793 type=write size=59735 2024-06-04T15:59:32.773 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.773+0000 7f5e9aacc780 1 > prepared operation key=DY9JWHWNAUO1 tag=P7ITEGA8OKMQ type=del size=3029489 2024-06-04T15:59:32.775 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.775+0000 7f5e9aacc780 1 < completed delete operation key=RP8K6QJUZAH1 tag=K75HPVM61PHB type=del 2024-06-04T15:59:32.776 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.776+0000 7f5e9aacc780 1 > prepared operation key=UW5LVIBG09SV tag=TLSUZTSQ647E type=del size=3731519 2024-06-04T15:59:32.779 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.779+0000 7f5e9aacc780 1 < completed delete operation key=HD6SNICRCDLL tag=PKGBN926EGME type=del 2024-06-04T15:59:32.781 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.780+0000 7f5e9aacc780 1 > prepared operation key=GTRMEQJK675Z tag=SIXWQEASVVQ1 type=del size=3890743 2024-06-04T15:59:32.783 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.783+0000 7f5e9aacc780 1 < suggested update operation key=AOCB36Y5Q7B0 tag=T146X3U46HQN type=write size=941570 2024-06-04T15:59:32.784 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.785+0000 7f5e9aacc780 1 > prepared operation key=RP8K6QJUZAH1 tag=V8M2I8FOKFVI type=del size=1211062 2024-06-04T15:59:32.786 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.786+0000 7f5e9aacc780 1 < completed part key=_multipart_SUBHZJ7HUV3H.2~MRTLZUCVZ11D.0 size=1048576 2024-06-04T15:59:32.787 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.787+0000 7f5e9aacc780 1 < completed part key=_multipart_SUBHZJ7HUV3H.2~MRTLZUCVZ11D.1 size=262024 2024-06-04T15:59:32.790 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.790+0000 7f5e9aacc780 1 < completed multipart upload key=SUBHZJ7HUV3H upload=MRTLZUCVZ11D tag=3NJO4L31EIN6 type=write size=2359176 2024-06-04T15:59:32.792 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.792+0000 7f5e9aacc780 1 > prepared part key=_multipart_9MPRI6LW3956.2~JY5283TGTRXP.0 size=1048576 2024-06-04T15:59:32.793 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.793+0000 7f5e9aacc780 1 > prepared part key=_multipart_9MPRI6LW3956.2~JY5283TGTRXP.1 size=1048576 2024-06-04T15:59:32.794 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.794+0000 7f5e9aacc780 1 > prepared part key=_multipart_9MPRI6LW3956.2~JY5283TGTRXP.2 size=880473 2024-06-04T15:59:32.794 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.794+0000 7f5e9aacc780 1 > prepared multipart upload key=9MPRI6LW3956 upload=JY5283TGTRXP tag=4GXHELTUH42H type=write size=4026201 2024-06-04T15:59:32.796 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.795+0000 7f5e9aacc780 1 < completed write operation key=GTRMEQJK675Z tag=NS1M5VY0QZHU type=write size=427871 2024-06-04T15:59:32.797 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.797+0000 7f5e9aacc780 1 > prepared operation key=GCPC9OJH7KWU tag=11OMKB04UW3C type=write size=328813 2024-06-04T15:59:32.798 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.798+0000 7f5e9aacc780 1 < canceled operation key=2BT2AXKB1RTA tag=0AUW1SG9Q11I type=del size=3950883 2024-06-04T15:59:32.800 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.800+0000 7f5e9aacc780 1 > prepared operation key=9MPRI6LW3956 tag=I708IFPFEROE type=del size=3963688 2024-06-04T15:59:32.801 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.801+0000 7f5e9aacc780 1 < completed part key=_multipart_DY9JWHWNAUO1.2~2U49K90DU00B.0 size=582875 2024-06-04T15:59:32.804 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.803+0000 7f5e9aacc780 1 < completed multipart upload key=DY9JWHWNAUO1 upload=2U49K90DU00B tag=N71UG0HIE911 type=write size=1631451 2024-06-04T15:59:32.805 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.805+0000 7f5e9aacc780 1 > prepared operation key=GCPC9OJH7KWU tag=D7Z98THS37ZS type=del size=3131171 2024-06-04T15:59:32.807 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.806+0000 7f5e9aacc780 -1 < failed to complete operation key=7S9S3MIG7WIT tag=JDSX52OABY6Y type=del size=365640: (22) Invalid argument 2024-06-04T15:59:32.808 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.808+0000 7f5e9aacc780 1 > prepared operation key=SUBHZJ7HUV3H tag=15P6701HMM83 type=del size=2923463 2024-06-04T15:59:32.810 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.809+0000 7f5e9aacc780 1 < completed delete operation key=SUBHZJ7HUV3H tag=UB0H1LEGK7H5 type=del 2024-06-04T15:59:32.812 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.812+0000 7f5e9aacc780 1 > prepared part key=_multipart_Q4OFQI0F5YLG.2~I9SKV90DC85P.0 size=1048576 2024-06-04T15:59:32.813 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.813+0000 7f5e9aacc780 1 > prepared part key=_multipart_Q4OFQI0F5YLG.2~I9SKV90DC85P.1 size=1048576 2024-06-04T15:59:32.814 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.814+0000 7f5e9aacc780 1 > prepared part key=_multipart_Q4OFQI0F5YLG.2~I9SKV90DC85P.2 size=1017912 2024-06-04T15:59:32.814 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.814+0000 7f5e9aacc780 1 > prepared multipart upload key=Q4OFQI0F5YLG upload=I9SKV90DC85P tag=7WDVPAHQZ5VK type=write size=4163640 2024-06-04T15:59:32.816 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.816+0000 7f5e9aacc780 1 < completed part key=_multipart_RP8K6QJUZAH1.2~KQYKQ7FL3LJP.0 size=504329 2024-06-04T15:59:32.818 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.818+0000 7f5e9aacc780 1 < completed multipart upload key=RP8K6QJUZAH1 upload=KQYKQ7FL3LJP tag=TLV7CH8851DM type=write size=1552905 2024-06-04T15:59:32.821 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.820+0000 7f5e9aacc780 1 > prepared part key=_multipart_TUGKW7F4V9NO.2~EMB0E4HE2357.0 size=1048576 2024-06-04T15:59:32.822 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.821+0000 7f5e9aacc780 1 > prepared part key=_multipart_TUGKW7F4V9NO.2~EMB0E4HE2357.1 size=1048576 2024-06-04T15:59:32.823 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.822+0000 7f5e9aacc780 1 > prepared part key=_multipart_TUGKW7F4V9NO.2~EMB0E4HE2357.2 size=795121 2024-06-04T15:59:32.823 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.822+0000 7f5e9aacc780 1 > prepared multipart upload key=TUGKW7F4V9NO upload=EMB0E4HE2357 tag=JDOA53X69ZL9 type=write size=3940849 2024-06-04T15:59:32.824 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.824+0000 7f5e9aacc780 1 < completed delete operation key=PASGIP872OVX tag=HHDPB2EOJKXP type=del 2024-06-04T15:59:32.826 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.825+0000 7f5e9aacc780 1 > prepared operation key=UW5LVIBG09SV tag=8T49NM3G5ZRW type=del size=2290046 2024-06-04T15:59:32.827 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.827+0000 7f5e9aacc780 1 < completed delete operation key=NHPH4LYPP0LL tag=R14C724OL95N type=del 2024-06-04T15:59:32.830 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.829+0000 7f5e9aacc780 1 > prepared part key=_multipart_AOCB36Y5Q7B0.2~KAP7Y6OWVNRN.0 size=1048576 2024-06-04T15:59:32.831 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.830+0000 7f5e9aacc780 1 > prepared part key=_multipart_AOCB36Y5Q7B0.2~KAP7Y6OWVNRN.1 size=945304 2024-06-04T15:59:32.831 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.830+0000 7f5e9aacc780 1 > prepared multipart upload key=AOCB36Y5Q7B0 upload=KAP7Y6OWVNRN tag=NG9ZARX6TB4A type=write size=3042456 2024-06-04T15:59:32.832 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.832+0000 7f5e9aacc780 1 < completed part key=_multipart_1IKNQXU3Y2JJ.2~0SR3CRSU07Q4.0 size=579501 2024-06-04T15:59:32.834 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.834+0000 7f5e9aacc780 1 < completed multipart upload key=1IKNQXU3Y2JJ upload=0SR3CRSU07Q4 tag=1GV2B2H6TDQL type=write size=1628077 2024-06-04T15:59:32.836 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.836+0000 7f5e9aacc780 1 > prepared operation key=4W5HB9WQQHR6 tag=NM0PL781HFW9 type=del size=4110522 2024-06-04T15:59:32.839 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.839+0000 7f5e9aacc780 1 < suggested update operation key=W1T4O3EAE7JN tag=4N9K8HIVZTMG type=write size=517664 2024-06-04T15:59:32.840 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.840+0000 7f5e9aacc780 1 > prepared operation key=Q4OFQI0F5YLG tag=FX8EN1ACT1MB type=del size=3413979 2024-06-04T15:59:32.842 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.841+0000 7f5e9aacc780 1 < completed delete operation key=JL69PUHT6NNT tag=RQG8R5O3LWXL type=del 2024-06-04T15:59:32.843 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.843+0000 7f5e9aacc780 1 > prepared operation key=W1T4O3EAE7JN tag=K9FGMNNRFRVX type=del size=691560 2024-06-04T15:59:32.845 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.845+0000 7f5e9aacc780 1 < completed delete operation key=DY9JWHWNAUO1 tag=P7ITEGA8OKMQ type=del 2024-06-04T15:59:32.848 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.847+0000 7f5e9aacc780 1 > prepared part key=_multipart_Q2V1ICTBSCV1.2~ZKR6QTJ5YJ9Z.0 size=608839 2024-06-04T15:59:32.848 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.847+0000 7f5e9aacc780 1 > prepared multipart upload key=Q2V1ICTBSCV1 upload=ZKR6QTJ5YJ9Z tag=TFHGZB4903RU type=write size=1657415 2024-06-04T15:59:32.849 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.849+0000 7f5e9aacc780 1 < completed delete operation key=UW5LVIBG09SV tag=TLSUZTSQ647E type=del 2024-06-04T15:59:32.850 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.850+0000 7f5e9aacc780 1 > prepared operation key=JL69PUHT6NNT tag=K5GRVFGVORDY type=del size=716453 2024-06-04T15:59:32.853 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.853+0000 7f5e9aacc780 1 < suggested remove operation key=GTRMEQJK675Z tag=SIXWQEASVVQ1 type=del 2024-06-04T15:59:32.855 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.854+0000 7f5e9aacc780 1 > prepared operation key=DY9JWHWNAUO1 tag=J1C8K8H1OR94 type=del size=3348336 2024-06-04T15:59:32.856 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.856+0000 7f5e9aacc780 1 < completed delete operation key=RP8K6QJUZAH1 tag=V8M2I8FOKFVI type=del 2024-06-04T15:59:32.858 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.857+0000 7f5e9aacc780 1 > prepared operation key=QUIVPH3OB6KN tag=LU6MHOLUCKWF type=write size=22133 2024-06-04T15:59:32.859 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.859+0000 7f5e9aacc780 1 < completed part key=_multipart_9MPRI6LW3956.2~JY5283TGTRXP.0 size=1048576 2024-06-04T15:59:32.860 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.860+0000 7f5e9aacc780 1 < completed part key=_multipart_9MPRI6LW3956.2~JY5283TGTRXP.1 size=1048576 2024-06-04T15:59:32.861 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.861+0000 7f5e9aacc780 1 < completed part key=_multipart_9MPRI6LW3956.2~JY5283TGTRXP.2 size=880473 2024-06-04T15:59:32.864 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.863+0000 7f5e9aacc780 1 < completed multipart upload key=9MPRI6LW3956 upload=JY5283TGTRXP tag=4GXHELTUH42H type=write size=4026201 2024-06-04T15:59:32.866 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.866+0000 7f5e9aacc780 1 > prepared part key=_multipart_B0HK5FJ2RGJE.2~MKQUBZMMSP2Y.0 size=15188 2024-06-04T15:59:32.866 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.866+0000 7f5e9aacc780 1 > prepared multipart upload key=B0HK5FJ2RGJE upload=MKQUBZMMSP2Y tag=7NT94FYYE4ZG type=write size=1063764 2024-06-04T15:59:32.869 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.869+0000 7f5e9aacc780 1 < suggested remove operation key=GCPC9OJH7KWU tag=11OMKB04UW3C type=write 2024-06-04T15:59:32.870 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.870+0000 7f5e9aacc780 1 > prepared operation key=A8O0S3S45RGM tag=EY8ZOFSLYPK9 type=del size=2779308 2024-06-04T15:59:32.873 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.874+0000 7f5e9aacc780 1 < suggested remove operation key=9MPRI6LW3956 tag=I708IFPFEROE type=del 2024-06-04T15:59:32.875 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.875+0000 7f5e9aacc780 1 > prepared operation key=PASGIP872OVX tag=RPTYNEPQVH7T type=del size=1636591 2024-06-04T15:59:32.876 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.875+0000 7f5e9aacc780 -1 < no bi entry to suggest for operation key=GCPC9OJH7KWU tag=D7Z98THS37ZS type=del size=3131171: (2) No such file or directory 2024-06-04T15:59:32.877 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.877+0000 7f5e9aacc780 1 > prepared operation key=AOCB36Y5Q7B0 tag=4OHPRZCJFA4S type=del size=3268777 2024-06-04T15:59:32.878 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.878+0000 7f5e9aacc780 1 < completed delete operation key=SUBHZJ7HUV3H tag=15P6701HMM83 type=del 2024-06-04T15:59:32.880 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.880+0000 7f5e9aacc780 1 > prepared operation key=NJ5U8JTT32QK tag=02DWTAJYMXG8 type=del size=814059 2024-06-04T15:59:32.881 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.881+0000 7f5e9aacc780 1 < completed part key=_multipart_Q4OFQI0F5YLG.2~I9SKV90DC85P.0 size=1048576 2024-06-04T15:59:32.882 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.882+0000 7f5e9aacc780 1 < completed part key=_multipart_Q4OFQI0F5YLG.2~I9SKV90DC85P.1 size=1048576 2024-06-04T15:59:32.884 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.883+0000 7f5e9aacc780 1 < completed part key=_multipart_Q4OFQI0F5YLG.2~I9SKV90DC85P.2 size=1017912 2024-06-04T15:59:32.886 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.886+0000 7f5e9aacc780 1 < completed multipart upload key=Q4OFQI0F5YLG upload=I9SKV90DC85P tag=7WDVPAHQZ5VK type=write size=4163640 2024-06-04T15:59:32.889 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.889+0000 7f5e9aacc780 1 > prepared part key=_multipart_GCPC9OJH7KWU.2~7CJJSAEZT6Q1.0 size=225019 2024-06-04T15:59:32.889 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.889+0000 7f5e9aacc780 1 > prepared multipart upload key=GCPC9OJH7KWU upload=7CJJSAEZT6Q1 tag=LIZ4PN7M04RK type=write size=1273595 2024-06-04T15:59:32.890 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.890+0000 7f5e9aacc780 1 < completed part key=_multipart_TUGKW7F4V9NO.2~EMB0E4HE2357.0 size=1048576 2024-06-04T15:59:32.891 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.892+0000 7f5e9aacc780 1 < completed part key=_multipart_TUGKW7F4V9NO.2~EMB0E4HE2357.1 size=1048576 2024-06-04T15:59:32.893 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.893+0000 7f5e9aacc780 1 < completed part key=_multipart_TUGKW7F4V9NO.2~EMB0E4HE2357.2 size=795121 2024-06-04T15:59:32.895 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.895+0000 7f5e9aacc780 1 < completed multipart upload key=TUGKW7F4V9NO upload=EMB0E4HE2357 tag=JDOA53X69ZL9 type=write size=3940849 2024-06-04T15:59:32.898 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.898+0000 7f5e9aacc780 1 > prepared part key=_multipart_UW5LVIBG09SV.2~6DQI8LJ8JBRD.0 size=141989 2024-06-04T15:59:32.898 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.898+0000 7f5e9aacc780 1 > prepared multipart upload key=UW5LVIBG09SV upload=6DQI8LJ8JBRD tag=C7OMWDG9141X type=write size=1190565 2024-06-04T15:59:32.900 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.899+0000 7f5e9aacc780 1 < completed delete operation key=UW5LVIBG09SV tag=8T49NM3G5ZRW type=del 2024-06-04T15:59:32.901 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.901+0000 7f5e9aacc780 1 > prepared operation key=DY9JWHWNAUO1 tag=F5C9RXBHVZ5P type=write size=26669 2024-06-04T15:59:32.903 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.902+0000 7f5e9aacc780 1 < completed part key=_multipart_AOCB36Y5Q7B0.2~KAP7Y6OWVNRN.0 size=1048576 2024-06-04T15:59:32.904 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.903+0000 7f5e9aacc780 1 < completed part key=_multipart_AOCB36Y5Q7B0.2~KAP7Y6OWVNRN.1 size=945304 2024-06-04T15:59:32.906 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.906+0000 7f5e9aacc780 1 < completed multipart upload key=AOCB36Y5Q7B0 upload=KAP7Y6OWVNRN tag=NG9ZARX6TB4A type=write size=3042456 2024-06-04T15:59:32.908 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.908+0000 7f5e9aacc780 1 > prepared part key=_multipart_Q2V1ICTBSCV1.2~WT2C9M4LVWTH.0 size=1048576 2024-06-04T15:59:32.909 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.909+0000 7f5e9aacc780 1 > prepared part key=_multipart_Q2V1ICTBSCV1.2~WT2C9M4LVWTH.1 size=626139 2024-06-04T15:59:32.910 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.909+0000 7f5e9aacc780 1 > prepared multipart upload key=Q2V1ICTBSCV1 upload=WT2C9M4LVWTH tag=KLMQP5RP7T3J type=write size=2723291 2024-06-04T15:59:32.913 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.913+0000 7f5e9aacc780 1 < suggested update operation key=4W5HB9WQQHR6 tag=NM0PL781HFW9 type=del size=4110522 2024-06-04T15:59:32.914 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.914+0000 7f5e9aacc780 1 > prepared operation key=9MPRI6LW3956 tag=2EYOFAYE7LPF type=del size=2316978 2024-06-04T15:59:32.917 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.917+0000 7f5e9aacc780 1 < suggested remove operation key=Q4OFQI0F5YLG tag=FX8EN1ACT1MB type=del 2024-06-04T15:59:32.919 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.918+0000 7f5e9aacc780 1 > prepared operation key=03ZNYG3WLMP4 tag=N5AV3KT35CH8 type=del size=1766148 2024-06-04T15:59:32.920 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.920+0000 7f5e9aacc780 1 < completed delete operation key=W1T4O3EAE7JN tag=K9FGMNNRFRVX type=del 2024-06-04T15:59:32.923 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.923+0000 7f5e9aacc780 1 > prepared part key=_multipart_GCPC9OJH7KWU.2~ZGVK8ZM2FCC1.0 size=1048576 2024-06-04T15:59:32.924 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.924+0000 7f5e9aacc780 1 > prepared part key=_multipart_GCPC9OJH7KWU.2~ZGVK8ZM2FCC1.1 size=1048576 2024-06-04T15:59:32.925 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.925+0000 7f5e9aacc780 1 > prepared part key=_multipart_GCPC9OJH7KWU.2~ZGVK8ZM2FCC1.2 size=483460 2024-06-04T15:59:32.925 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.925+0000 7f5e9aacc780 1 > prepared multipart upload key=GCPC9OJH7KWU upload=ZGVK8ZM2FCC1 tag=2EK5UG1Y2RCJ type=write size=3629188 2024-06-04T15:59:32.927 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.926+0000 7f5e9aacc780 1 < completed part key=_multipart_Q2V1ICTBSCV1.2~ZKR6QTJ5YJ9Z.0 size=608839 2024-06-04T15:59:32.929 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.929+0000 7f5e9aacc780 1 < completed multipart upload key=Q2V1ICTBSCV1 upload=ZKR6QTJ5YJ9Z tag=TFHGZB4903RU type=write size=1657415 2024-06-04T15:59:32.931 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.931+0000 7f5e9aacc780 1 > prepared part key=_multipart_PNDPO2WUW7UX.2~9KQHOGAI3JVV.0 size=1048576 2024-06-04T15:59:32.932 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.932+0000 7f5e9aacc780 1 > prepared part key=_multipart_PNDPO2WUW7UX.2~9KQHOGAI3JVV.1 size=1048576 2024-06-04T15:59:32.934 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.933+0000 7f5e9aacc780 1 > prepared part key=_multipart_PNDPO2WUW7UX.2~9KQHOGAI3JVV.2 size=983014 2024-06-04T15:59:32.934 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.933+0000 7f5e9aacc780 1 > prepared multipart upload key=PNDPO2WUW7UX upload=9KQHOGAI3JVV tag=6XGP6J9YK1N3 type=write size=4128742 2024-06-04T15:59:32.935 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.935+0000 7f5e9aacc780 1 < completed delete operation key=JL69PUHT6NNT tag=K5GRVFGVORDY type=del 2024-06-04T15:59:32.936 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.936+0000 7f5e9aacc780 1 > prepared operation key=4W5HB9WQQHR6 tag=H0CR2Y7SSJR1 type=del size=2563269 2024-06-04T15:59:32.939 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.939+0000 7f5e9aacc780 1 < suggested remove operation key=DY9JWHWNAUO1 tag=J1C8K8H1OR94 type=del 2024-06-04T15:59:32.940 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.940+0000 7f5e9aacc780 1 > prepared operation key=QUIVPH3OB6KN tag=0Z22ISC27HU6 type=del size=3746103 2024-06-04T15:59:32.942 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.941+0000 7f5e9aacc780 1 < completed write operation key=QUIVPH3OB6KN tag=LU6MHOLUCKWF type=write size=22133 2024-06-04T15:59:32.943 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.943+0000 7f5e9aacc780 1 > prepared operation key=A8O0S3S45RGM tag=NL629IYZWMVL type=write size=743974 2024-06-04T15:59:32.945 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.944+0000 7f5e9aacc780 1 < completed part key=_multipart_B0HK5FJ2RGJE.2~MKQUBZMMSP2Y.0 size=15188 2024-06-04T15:59:32.947 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.947+0000 7f5e9aacc780 1 < completed multipart upload key=B0HK5FJ2RGJE upload=MKQUBZMMSP2Y tag=7NT94FYYE4ZG type=write size=1063764 2024-06-04T15:59:32.949 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.949+0000 7f5e9aacc780 1 > prepared part key=_multipart_JL69PUHT6NNT.2~19H4KUTW98MM.0 size=153030 2024-06-04T15:59:32.949 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.949+0000 7f5e9aacc780 1 > prepared multipart upload key=JL69PUHT6NNT upload=19H4KUTW98MM tag=HXRCXRL54LVT type=write size=1201606 2024-06-04T15:59:32.951 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.951+0000 7f5e9aacc780 1 < completed delete operation key=A8O0S3S45RGM tag=EY8ZOFSLYPK9 type=del 2024-06-04T15:59:32.952 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.952+0000 7f5e9aacc780 1 > prepared operation key=UW5LVIBG09SV tag=I3T234IDCB1W type=write size=1033829 2024-06-04T15:59:32.954 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.954+0000 7f5e9aacc780 1 < completed delete operation key=PASGIP872OVX tag=RPTYNEPQVH7T type=del 2024-06-04T15:59:32.955 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.955+0000 7f5e9aacc780 1 > prepared operation key=QUIVPH3OB6KN tag=F0Q45M5M0PCB type=del size=1015214 2024-06-04T15:59:32.958 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.958+0000 7f5e9aacc780 1 < suggested update operation key=AOCB36Y5Q7B0 tag=4OHPRZCJFA4S type=del size=3268777 2024-06-04T15:59:32.961 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.960+0000 7f5e9aacc780 1 > prepared part key=_multipart_K01DAK0M4I4M.2~EV5HSCXECFG4.0 size=1048576 2024-06-04T15:59:32.961 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.961+0000 7f5e9aacc780 1 > prepared part key=_multipart_K01DAK0M4I4M.2~EV5HSCXECFG4.1 size=105739 2024-06-04T15:59:32.962 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.961+0000 7f5e9aacc780 1 > prepared multipart upload key=K01DAK0M4I4M upload=EV5HSCXECFG4 tag=LZ7I2KTIW99A type=write size=2202891 2024-06-04T15:59:32.963 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.963+0000 7f5e9aacc780 1 < completed delete operation key=NJ5U8JTT32QK tag=02DWTAJYMXG8 type=del 2024-06-04T15:59:32.964 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.964+0000 7f5e9aacc780 1 > prepared operation key=JL69PUHT6NNT tag=UJA2NCM1R1EA type=del size=2610406 2024-06-04T15:59:32.966 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.966+0000 7f5e9aacc780 1 < completed part key=_multipart_GCPC9OJH7KWU.2~7CJJSAEZT6Q1.0 size=225019 2024-06-04T15:59:32.968 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.968+0000 7f5e9aacc780 1 < completed multipart upload key=GCPC9OJH7KWU upload=7CJJSAEZT6Q1 tag=LIZ4PN7M04RK type=write size=1273595 2024-06-04T15:59:32.970 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.970+0000 7f5e9aacc780 1 > prepared operation key=K01DAK0M4I4M tag=2CMWFBCZZPOZ type=write size=991584 2024-06-04T15:59:32.971 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.971+0000 7f5e9aacc780 1 < completed part key=_multipart_UW5LVIBG09SV.2~6DQI8LJ8JBRD.0 size=141989 2024-06-04T15:59:32.973 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.973+0000 7f5e9aacc780 1 < completed multipart upload key=UW5LVIBG09SV upload=6DQI8LJ8JBRD tag=C7OMWDG9141X type=write size=1190565 2024-06-04T15:59:32.975 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.975+0000 7f5e9aacc780 1 > prepared operation key=GTRMEQJK675Z tag=60SA2QZH43FR type=del size=2403408 2024-06-04T15:59:32.976 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.976+0000 7f5e9aacc780 -1 < failed to complete operation key=DY9JWHWNAUO1 tag=F5C9RXBHVZ5P type=write size=26669: (22) Invalid argument 2024-06-04T15:59:32.979 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.978+0000 7f5e9aacc780 1 > prepared part key=_multipart_NJ5U8JTT32QK.2~2YL3N9GV0X0Y.0 size=1044535 2024-06-04T15:59:32.979 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.978+0000 7f5e9aacc780 1 > prepared multipart upload key=NJ5U8JTT32QK upload=2YL3N9GV0X0Y tag=MMF8BE4CFAN6 type=write size=2093111 2024-06-04T15:59:32.980 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.980+0000 7f5e9aacc780 1 < completed part key=_multipart_Q2V1ICTBSCV1.2~WT2C9M4LVWTH.0 size=1048576 2024-06-04T15:59:32.981 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.981+0000 7f5e9aacc780 1 < completed part key=_multipart_Q2V1ICTBSCV1.2~WT2C9M4LVWTH.1 size=626139 2024-06-04T15:59:32.983 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.983+0000 7f5e9aacc780 1 < completed multipart upload key=Q2V1ICTBSCV1 upload=WT2C9M4LVWTH tag=KLMQP5RP7T3J type=write size=2723291 2024-06-04T15:59:32.985 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.984+0000 7f5e9aacc780 1 > prepared operation key=2BT2AXKB1RTA tag=9YHPH239CPAN type=del size=3870836 2024-06-04T15:59:32.986 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.986+0000 7f5e9aacc780 1 < completed delete operation key=9MPRI6LW3956 tag=2EYOFAYE7LPF type=del 2024-06-04T15:59:32.988 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.987+0000 7f5e9aacc780 1 > prepared operation key=FBV2MAG130M6 tag=YQHN7UNECW9A type=write size=163356 2024-06-04T15:59:32.989 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.989+0000 7f5e9aacc780 1 < completed delete operation key=03ZNYG3WLMP4 tag=N5AV3KT35CH8 type=del 2024-06-04T15:59:32.990 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.990+0000 7f5e9aacc780 1 > prepared operation key=W1T4O3EAE7JN tag=I14OQIL7MF6W type=del size=2310915 2024-06-04T15:59:32.992 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.991+0000 7f5e9aacc780 1 < completed part key=_multipart_GCPC9OJH7KWU.2~ZGVK8ZM2FCC1.0 size=1048576 2024-06-04T15:59:32.992 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.991+0000 7f5e9aacc780 1 < canceled part key=_multipart_GCPC9OJH7KWU.2~ZGVK8ZM2FCC1.1 size=1048576 2024-06-04T15:59:32.993 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.992+0000 7f5e9aacc780 1 < completed part key=_multipart_GCPC9OJH7KWU.2~ZGVK8ZM2FCC1.2 size=483460 2024-06-04T15:59:32.995 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.995+0000 7f5e9aacc780 1 < canceled multipart upload key=GCPC9OJH7KWU upload=ZGVK8ZM2FCC1 tag=2EK5UG1Y2RCJ type=write size=3629188 2024-06-04T15:59:32.998 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.998+0000 7f5e9aacc780 1 > prepared part key=_multipart_2BT2AXKB1RTA.2~GZTE5A4SPSYG.0 size=1048576 2024-06-04T15:59:32.999 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.998+0000 7f5e9aacc780 1 > prepared part key=_multipart_2BT2AXKB1RTA.2~GZTE5A4SPSYG.1 size=799176 2024-06-04T15:59:32.999 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:32.998+0000 7f5e9aacc780 1 > prepared multipart upload key=2BT2AXKB1RTA upload=GZTE5A4SPSYG tag=IOK8K5K59JDN type=write size=2896328 2024-06-04T15:59:33.000 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.000+0000 7f5e9aacc780 1 < completed part key=_multipart_PNDPO2WUW7UX.2~9KQHOGAI3JVV.0 size=1048576 2024-06-04T15:59:33.001 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.001+0000 7f5e9aacc780 1 < completed part key=_multipart_PNDPO2WUW7UX.2~9KQHOGAI3JVV.1 size=1048576 2024-06-04T15:59:33.002 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.002+0000 7f5e9aacc780 1 < completed part key=_multipart_PNDPO2WUW7UX.2~9KQHOGAI3JVV.2 size=983014 2024-06-04T15:59:33.005 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.005+0000 7f5e9aacc780 1 < completed multipart upload key=PNDPO2WUW7UX upload=9KQHOGAI3JVV tag=6XGP6J9YK1N3 type=write size=4128742 2024-06-04T15:59:33.006 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.006+0000 7f5e9aacc780 1 > prepared operation key=FBV2MAG130M6 tag=PGMKGTE36MAU type=write size=547371 2024-06-04T15:59:33.008 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.008+0000 7f5e9aacc780 1 < canceled operation key=4W5HB9WQQHR6 tag=H0CR2Y7SSJR1 type=del size=2563269 2024-06-04T15:59:33.009 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.009+0000 7f5e9aacc780 1 > prepared operation key=W1T4O3EAE7JN tag=Y3XEOU0ZGYAI type=del size=3147244 2024-06-04T15:59:33.011 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.010+0000 7f5e9aacc780 1 < completed delete operation key=QUIVPH3OB6KN tag=0Z22ISC27HU6 type=del 2024-06-04T15:59:33.012 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.012+0000 7f5e9aacc780 1 > prepared operation key=GCPC9OJH7KWU tag=26BVL7LKRCXY type=del size=3749206 2024-06-04T15:59:33.015 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.015+0000 7f5e9aacc780 1 < suggested update operation key=A8O0S3S45RGM tag=NL629IYZWMVL type=write size=743974 2024-06-04T15:59:33.016 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.016+0000 7f5e9aacc780 1 > prepared operation key=UW5LVIBG09SV tag=2FRAPP28VDBY type=del size=3847721 2024-06-04T15:59:33.017 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.016+0000 7f5e9aacc780 1 < canceled part key=_multipart_JL69PUHT6NNT.2~19H4KUTW98MM.0 size=153030 2024-06-04T15:59:33.019 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.019+0000 7f5e9aacc780 1 < canceled multipart upload key=JL69PUHT6NNT upload=19H4KUTW98MM tag=HXRCXRL54LVT type=write size=1201606 2024-06-04T15:59:33.021 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.020+0000 7f5e9aacc780 1 > prepared operation key=NHPH4LYPP0LL tag=6RT23OL8F8L1 type=del size=2260956 2024-06-04T15:59:33.024 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.024+0000 7f5e9aacc780 1 < suggested update operation key=UW5LVIBG09SV tag=I3T234IDCB1W type=write size=1033829 2024-06-04T15:59:33.026 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.026+0000 7f5e9aacc780 1 > prepared operation key=UW5LVIBG09SV tag=VVNNEUVSYSXR type=del size=453698 2024-06-04T15:59:33.027 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.027+0000 7f5e9aacc780 1 < completed delete operation key=QUIVPH3OB6KN tag=F0Q45M5M0PCB type=del 2024-06-04T15:59:33.029 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.029+0000 7f5e9aacc780 1 > prepared operation key=GTRMEQJK675Z tag=57K4VYV23ETX type=del size=2610929 2024-06-04T15:59:33.030 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.030+0000 7f5e9aacc780 1 < completed part key=_multipart_K01DAK0M4I4M.2~EV5HSCXECFG4.0 size=1048576 2024-06-04T15:59:33.031 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.031+0000 7f5e9aacc780 1 < completed part key=_multipart_K01DAK0M4I4M.2~EV5HSCXECFG4.1 size=105739 2024-06-04T15:59:33.034 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.033+0000 7f5e9aacc780 1 < completed multipart upload key=K01DAK0M4I4M upload=EV5HSCXECFG4 tag=LZ7I2KTIW99A type=write size=2202891 2024-06-04T15:59:33.036 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.036+0000 7f5e9aacc780 1 > prepared part key=_multipart_AOCB36Y5Q7B0.2~44VME938G3GX.0 size=1048576 2024-06-04T15:59:33.037 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.037+0000 7f5e9aacc780 1 > prepared part key=_multipart_AOCB36Y5Q7B0.2~44VME938G3GX.1 size=1048576 2024-06-04T15:59:33.038 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.038+0000 7f5e9aacc780 1 > prepared part key=_multipart_AOCB36Y5Q7B0.2~44VME938G3GX.2 size=464402 2024-06-04T15:59:33.038 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.038+0000 7f5e9aacc780 1 > prepared multipart upload key=AOCB36Y5Q7B0 upload=44VME938G3GX tag=I2YDR09C80FJ type=write size=3610130 2024-06-04T15:59:33.039 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.039+0000 7f5e9aacc780 1 < completed delete operation key=JL69PUHT6NNT tag=UJA2NCM1R1EA type=del 2024-06-04T15:59:33.041 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.041+0000 7f5e9aacc780 1 > prepared operation key=03ZNYG3WLMP4 tag=ZBRSK0D7MSDA type=del size=2038085 2024-06-04T15:59:33.042 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.043+0000 7f5e9aacc780 1 < completed write operation key=K01DAK0M4I4M tag=2CMWFBCZZPOZ type=write size=991584 2024-06-04T15:59:33.044 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.044+0000 7f5e9aacc780 1 > prepared operation key=AOCB36Y5Q7B0 tag=93JYTAB0VUSG type=del size=2903607 2024-06-04T15:59:33.046 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.046+0000 7f5e9aacc780 1 < completed delete operation key=GTRMEQJK675Z tag=60SA2QZH43FR type=del 2024-06-04T15:59:33.048 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.047+0000 7f5e9aacc780 1 > prepared operation key=QUIVPH3OB6KN tag=LZF7CCKV97JU type=del size=1319911 2024-06-04T15:59:33.049 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.049+0000 7f5e9aacc780 1 < completed part key=_multipart_NJ5U8JTT32QK.2~2YL3N9GV0X0Y.0 size=1044535 2024-06-04T15:59:33.051 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.051+0000 7f5e9aacc780 1 < completed multipart upload key=NJ5U8JTT32QK upload=2YL3N9GV0X0Y tag=MMF8BE4CFAN6 type=write size=2093111 2024-06-04T15:59:33.052 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.052+0000 7f5e9aacc780 1 > prepared operation key=4W5HB9WQQHR6 tag=2JB6AINOMR0S type=del size=1154635 2024-06-04T15:59:33.054 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.054+0000 7f5e9aacc780 1 < completed delete operation key=2BT2AXKB1RTA tag=9YHPH239CPAN type=del 2024-06-04T15:59:33.056 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.055+0000 7f5e9aacc780 1 > prepared operation key=PASGIP872OVX tag=8397T297RMDR type=del size=2103763 2024-06-04T15:59:33.057 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.057+0000 7f5e9aacc780 1 < completed write operation key=FBV2MAG130M6 tag=YQHN7UNECW9A type=write size=163356 2024-06-04T15:59:33.059 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.059+0000 7f5e9aacc780 1 > prepared part key=_multipart_FBV2MAG130M6.2~7YEL5OOOGX43.0 size=1048576 2024-06-04T15:59:33.060 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.060+0000 7f5e9aacc780 1 > prepared part key=_multipart_FBV2MAG130M6.2~7YEL5OOOGX43.1 size=1048576 2024-06-04T15:59:33.061 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.061+0000 7f5e9aacc780 1 > prepared part key=_multipart_FBV2MAG130M6.2~7YEL5OOOGX43.2 size=722550 2024-06-04T15:59:33.062 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.061+0000 7f5e9aacc780 1 > prepared multipart upload key=FBV2MAG130M6 upload=7YEL5OOOGX43 tag=11G7ADYK5LN7 type=write size=3868278 2024-06-04T15:59:33.063 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.063+0000 7f5e9aacc780 1 < completed delete operation key=W1T4O3EAE7JN tag=I14OQIL7MF6W type=del 2024-06-04T15:59:33.064 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.064+0000 7f5e9aacc780 1 > prepared operation key=RP8K6QJUZAH1 tag=4ECT6TDZTLW1 type=del size=3916566 2024-06-04T15:59:33.066 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.066+0000 7f5e9aacc780 1 < completed part key=_multipart_2BT2AXKB1RTA.2~GZTE5A4SPSYG.0 size=1048576 2024-06-04T15:59:33.067 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.067+0000 7f5e9aacc780 1 < completed part key=_multipart_2BT2AXKB1RTA.2~GZTE5A4SPSYG.1 size=799176 2024-06-04T15:59:33.069 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.069+0000 7f5e9aacc780 1 < completed multipart upload key=2BT2AXKB1RTA upload=GZTE5A4SPSYG tag=IOK8K5K59JDN type=write size=2896328 2024-06-04T15:59:33.072 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.072+0000 7f5e9aacc780 1 > prepared part key=_multipart_DY9JWHWNAUO1.2~8CMH1PTT8KVS.0 size=1048576 2024-06-04T15:59:33.073 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.073+0000 7f5e9aacc780 1 > prepared part key=_multipart_DY9JWHWNAUO1.2~8CMH1PTT8KVS.1 size=193909 2024-06-04T15:59:33.073 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.073+0000 7f5e9aacc780 1 > prepared multipart upload key=DY9JWHWNAUO1 upload=8CMH1PTT8KVS tag=6B5ZK8BYOAAR type=write size=2291061 2024-06-04T15:59:33.075 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.074+0000 7f5e9aacc780 1 < completed write operation key=FBV2MAG130M6 tag=PGMKGTE36MAU type=write size=547371 2024-06-04T15:59:33.076 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.076+0000 7f5e9aacc780 1 > prepared operation key=PASGIP872OVX tag=ANPDOZ0ROOTZ type=del size=656572 2024-06-04T15:59:33.077 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.077+0000 7f5e9aacc780 1 < completed delete operation key=W1T4O3EAE7JN tag=Y3XEOU0ZGYAI type=del 2024-06-04T15:59:33.080 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.079+0000 7f5e9aacc780 1 > prepared part key=_multipart_TUGKW7F4V9NO.2~A2KVJFL1FJH7.0 size=988171 2024-06-04T15:59:33.080 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.079+0000 7f5e9aacc780 1 > prepared multipart upload key=TUGKW7F4V9NO upload=A2KVJFL1FJH7 tag=8RJLUXJRAQWJ type=write size=2036747 2024-06-04T15:59:33.082 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.081+0000 7f5e9aacc780 1 < completed delete operation key=GCPC9OJH7KWU tag=26BVL7LKRCXY type=del 2024-06-04T15:59:33.083 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.083+0000 7f5e9aacc780 1 > prepared operation key=UTZHANL9ER2Q tag=IIWE31PY8QI5 type=del size=2497650 2024-06-04T15:59:33.084 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.084+0000 7f5e9aacc780 -1 < failed to complete operation key=UW5LVIBG09SV tag=2FRAPP28VDBY type=del size=3847721: (22) Invalid argument 2024-06-04T15:59:33.086 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.086+0000 7f5e9aacc780 1 > prepared operation key=QJA2JPATITNH tag=C14R8GT0XUF4 type=del size=2690161 2024-06-04T15:59:33.087 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.087+0000 7f5e9aacc780 1 < completed delete operation key=NHPH4LYPP0LL tag=6RT23OL8F8L1 type=del 2024-06-04T15:59:33.089 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.088+0000 7f5e9aacc780 1 > prepared operation key=QJA2JPATITNH tag=BMZVOBRX35QO type=write size=227076 2024-06-04T15:59:33.091 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.091+0000 7f5e9aacc780 1 < suggested update operation key=UW5LVIBG09SV tag=VVNNEUVSYSXR type=del size=453698 2024-06-04T15:59:33.093 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.093+0000 7f5e9aacc780 1 > prepared operation key=03ZNYG3WLMP4 tag=F3OOI7CM335M type=del size=538074 2024-06-04T15:59:33.094 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.094+0000 7f5e9aacc780 1 < completed delete operation key=GTRMEQJK675Z tag=57K4VYV23ETX type=del 2024-06-04T15:59:33.096 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.095+0000 7f5e9aacc780 1 > prepared operation key=W1T4O3EAE7JN tag=T7K287JCRUA5 type=write size=893554 2024-06-04T15:59:33.097 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.097+0000 7f5e9aacc780 1 < completed part key=_multipart_AOCB36Y5Q7B0.2~44VME938G3GX.0 size=1048576 2024-06-04T15:59:33.098 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.098+0000 7f5e9aacc780 1 < completed part key=_multipart_AOCB36Y5Q7B0.2~44VME938G3GX.1 size=1048576 2024-06-04T15:59:33.100 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.099+0000 7f5e9aacc780 1 < completed part key=_multipart_AOCB36Y5Q7B0.2~44VME938G3GX.2 size=464402 2024-06-04T15:59:33.102 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.102+0000 7f5e9aacc780 1 < completed multipart upload key=AOCB36Y5Q7B0 upload=44VME938G3GX tag=I2YDR09C80FJ type=write size=3610130 2024-06-04T15:59:33.106 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.105+0000 7f5e9aacc780 1 > prepared part key=_multipart_XH0N984YVGKP.2~RIBSFVMGS4WX.0 size=1048576 2024-06-04T15:59:33.107 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.107+0000 7f5e9aacc780 1 > prepared part key=_multipart_XH0N984YVGKP.2~RIBSFVMGS4WX.1 size=865589 2024-06-04T15:59:33.107 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.107+0000 7f5e9aacc780 1 > prepared multipart upload key=XH0N984YVGKP upload=RIBSFVMGS4WX tag=OTOSYM4KN5D8 type=write size=2962741 2024-06-04T15:59:33.108 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.108+0000 7f5e9aacc780 1 < completed delete operation key=03ZNYG3WLMP4 tag=ZBRSK0D7MSDA type=del 2024-06-04T15:59:33.110 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.110+0000 7f5e9aacc780 1 > prepared operation key=9MPRI6LW3956 tag=0Y3SDDDJG7L4 type=del size=3342064 2024-06-04T15:59:33.112 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.111+0000 7f5e9aacc780 1 < completed delete operation key=AOCB36Y5Q7B0 tag=93JYTAB0VUSG type=del 2024-06-04T15:59:33.115 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.114+0000 7f5e9aacc780 1 > prepared part key=_multipart_1IKNQXU3Y2JJ.2~9191CJK9LQUA.0 size=568295 2024-06-04T15:59:33.115 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.114+0000 7f5e9aacc780 1 > prepared multipart upload key=1IKNQXU3Y2JJ upload=9191CJK9LQUA tag=KVZ6H5UOA3BW type=write size=1616871 2024-06-04T15:59:33.116 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.116+0000 7f5e9aacc780 1 < completed delete operation key=QUIVPH3OB6KN tag=LZF7CCKV97JU type=del 2024-06-04T15:59:33.119 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.118+0000 7f5e9aacc780 1 > prepared part key=_multipart_03ZNYG3WLMP4.2~MIKA3JCIEMED.0 size=1048576 2024-06-04T15:59:33.120 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.120+0000 7f5e9aacc780 1 > prepared part key=_multipart_03ZNYG3WLMP4.2~MIKA3JCIEMED.1 size=1048576 2024-06-04T15:59:33.122 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.121+0000 7f5e9aacc780 1 > prepared part key=_multipart_03ZNYG3WLMP4.2~MIKA3JCIEMED.2 size=426142 2024-06-04T15:59:33.122 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.121+0000 7f5e9aacc780 1 > prepared multipart upload key=03ZNYG3WLMP4 upload=MIKA3JCIEMED tag=2IGQHKRJ7K3P type=write size=3571870 2024-06-04T15:59:33.123 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.123+0000 7f5e9aacc780 1 < completed delete operation key=4W5HB9WQQHR6 tag=2JB6AINOMR0S type=del 2024-06-04T15:59:33.124 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.124+0000 7f5e9aacc780 1 > prepared operation key=NHPH4LYPP0LL tag=OY0RW2T3Q71X type=del size=491461 2024-06-04T15:59:33.126 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.126+0000 7f5e9aacc780 1 < completed delete operation key=PASGIP872OVX tag=8397T297RMDR type=del 2024-06-04T15:59:33.129 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.129+0000 7f5e9aacc780 1 > prepared part key=_multipart_JL69PUHT6NNT.2~3GZ9NTUSNYA1.0 size=428709 2024-06-04T15:59:33.129 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.129+0000 7f5e9aacc780 1 > prepared multipart upload key=JL69PUHT6NNT upload=3GZ9NTUSNYA1 tag=0V007HVUIDBV type=write size=1477285 2024-06-04T15:59:33.129 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.129+0000 7f5e9aacc780 1 < canceled part key=_multipart_FBV2MAG130M6.2~7YEL5OOOGX43.0 size=1048576 2024-06-04T15:59:33.131 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.130+0000 7f5e9aacc780 1 < completed part key=_multipart_FBV2MAG130M6.2~7YEL5OOOGX43.1 size=1048576 2024-06-04T15:59:33.132 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.131+0000 7f5e9aacc780 1 < completed part key=_multipart_FBV2MAG130M6.2~7YEL5OOOGX43.2 size=722550 2024-06-04T15:59:33.134 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.134+0000 7f5e9aacc780 1 < canceled multipart upload key=FBV2MAG130M6 upload=7YEL5OOOGX43 tag=11G7ADYK5LN7 type=write size=3868278 2024-06-04T15:59:33.137 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.137+0000 7f5e9aacc780 1 > prepared part key=_multipart_NJ5U8JTT32QK.2~0A27J1EJI66O.0 size=1048576 2024-06-04T15:59:33.139 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.138+0000 7f5e9aacc780 1 > prepared part key=_multipart_NJ5U8JTT32QK.2~0A27J1EJI66O.1 size=1048576 2024-06-04T15:59:33.140 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.139+0000 7f5e9aacc780 1 > prepared part key=_multipart_NJ5U8JTT32QK.2~0A27J1EJI66O.2 size=766701 2024-06-04T15:59:33.140 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.139+0000 7f5e9aacc780 1 > prepared multipart upload key=NJ5U8JTT32QK upload=0A27J1EJI66O tag=17CGZ04E7R85 type=write size=3912429 2024-06-04T15:59:33.141 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.141+0000 7f5e9aacc780 1 < completed delete operation key=RP8K6QJUZAH1 tag=4ECT6TDZTLW1 type=del 2024-06-04T15:59:33.144 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.144+0000 7f5e9aacc780 1 > prepared part key=_multipart_7S9S3MIG7WIT.2~A2EG2SOUYSXF.0 size=1048576 2024-06-04T15:59:33.145 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.145+0000 7f5e9aacc780 1 > prepared part key=_multipart_7S9S3MIG7WIT.2~A2EG2SOUYSXF.1 size=1048576 2024-06-04T15:59:33.146 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.146+0000 7f5e9aacc780 1 > prepared part key=_multipart_7S9S3MIG7WIT.2~A2EG2SOUYSXF.2 size=310939 2024-06-04T15:59:33.146 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.146+0000 7f5e9aacc780 1 > prepared multipart upload key=7S9S3MIG7WIT upload=A2EG2SOUYSXF tag=R6PEZ02LVHYY type=write size=3456667 2024-06-04T15:59:33.148 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.148+0000 7f5e9aacc780 1 < completed part key=_multipart_DY9JWHWNAUO1.2~8CMH1PTT8KVS.0 size=1048576 2024-06-04T15:59:33.149 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.149+0000 7f5e9aacc780 1 < completed part key=_multipart_DY9JWHWNAUO1.2~8CMH1PTT8KVS.1 size=193909 2024-06-04T15:59:33.152 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.152+0000 7f5e9aacc780 1 < completed multipart upload key=DY9JWHWNAUO1 upload=8CMH1PTT8KVS tag=6B5ZK8BYOAAR type=write size=2291061 2024-06-04T15:59:33.155 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.155+0000 7f5e9aacc780 1 > prepared part key=_multipart_GCPC9OJH7KWU.2~B35QUI2PLWIA.0 size=1048576 2024-06-04T15:59:33.156 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.156+0000 7f5e9aacc780 1 > prepared part key=_multipart_GCPC9OJH7KWU.2~B35QUI2PLWIA.1 size=1048576 2024-06-04T15:59:33.159 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.158+0000 7f5e9aacc780 1 > prepared part key=_multipart_GCPC9OJH7KWU.2~B35QUI2PLWIA.2 size=974992 2024-06-04T15:59:33.159 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.158+0000 7f5e9aacc780 1 > prepared multipart upload key=GCPC9OJH7KWU upload=B35QUI2PLWIA tag=4DKLH9R39BJK type=write size=4120720 2024-06-04T15:59:33.160 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.160+0000 7f5e9aacc780 1 < completed delete operation key=PASGIP872OVX tag=ANPDOZ0ROOTZ type=del 2024-06-04T15:59:33.162 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.162+0000 7f5e9aacc780 1 > prepared operation key=DY9JWHWNAUO1 tag=R1P6HIZR86LK type=del size=1122915 2024-06-04T15:59:33.163 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.163+0000 7f5e9aacc780 1 < completed part key=_multipart_TUGKW7F4V9NO.2~A2KVJFL1FJH7.0 size=988171 2024-06-04T15:59:33.166 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.166+0000 7f5e9aacc780 1 < completed multipart upload key=TUGKW7F4V9NO upload=A2KVJFL1FJH7 tag=8RJLUXJRAQWJ type=write size=2036747 2024-06-04T15:59:33.167 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.167+0000 7f5e9aacc780 1 > prepared operation key=GTRMEQJK675Z tag=B4ZTYHJ5F0YT type=del size=1903010 2024-06-04T15:59:33.169 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.169+0000 7f5e9aacc780 1 < completed delete operation key=UTZHANL9ER2Q tag=IIWE31PY8QI5 type=del 2024-06-04T15:59:33.172 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.172+0000 7f5e9aacc780 1 > prepared part key=_multipart_K01DAK0M4I4M.2~J4PXAVHSOH17.0 size=984 2024-06-04T15:59:33.172 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.172+0000 7f5e9aacc780 1 > prepared multipart upload key=K01DAK0M4I4M upload=J4PXAVHSOH17 tag=7EVMHZ3OELD2 type=write size=1049560 2024-06-04T15:59:33.173 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.173+0000 7f5e9aacc780 1 < completed delete operation key=QJA2JPATITNH tag=C14R8GT0XUF4 type=del 2024-06-04T15:59:33.175 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.175+0000 7f5e9aacc780 1 > prepared operation key=TUGKW7F4V9NO tag=Z2CU6EZ92N0I type=del size=2001648 2024-06-04T15:59:33.178 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.178+0000 7f5e9aacc780 1 < suggested update operation key=QJA2JPATITNH tag=BMZVOBRX35QO type=write size=227076 2024-06-04T15:59:33.181 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.180+0000 7f5e9aacc780 1 > prepared part key=_multipart_GCPC9OJH7KWU.2~RB0AJ7HE4VEA.0 size=1048576 2024-06-04T15:59:33.182 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.182+0000 7f5e9aacc780 1 > prepared part key=_multipart_GCPC9OJH7KWU.2~RB0AJ7HE4VEA.1 size=725887 2024-06-04T15:59:33.182 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.182+0000 7f5e9aacc780 1 > prepared multipart upload key=GCPC9OJH7KWU upload=RB0AJ7HE4VEA tag=PO79099NPCXG type=write size=2823039 2024-06-04T15:59:33.185 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.184+0000 7f5e9aacc780 1 < suggested update operation key=03ZNYG3WLMP4 tag=F3OOI7CM335M type=del size=538074 2024-06-04T15:59:33.188 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.189+0000 7f5e9aacc780 1 > prepared part key=_multipart_XH0N984YVGKP.2~1ECPR25XEB6M.0 size=1048576 2024-06-04T15:59:33.190 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.190+0000 7f5e9aacc780 1 > prepared part key=_multipart_XH0N984YVGKP.2~1ECPR25XEB6M.1 size=1048576 2024-06-04T15:59:33.191 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.190+0000 7f5e9aacc780 1 > prepared part key=_multipart_XH0N984YVGKP.2~1ECPR25XEB6M.2 size=861853 2024-06-04T15:59:33.191 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.190+0000 7f5e9aacc780 1 > prepared multipart upload key=XH0N984YVGKP upload=1ECPR25XEB6M tag=6Y4IKN8MK7TS type=write size=4007581 2024-06-04T15:59:33.192 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.192+0000 7f5e9aacc780 1 < completed write operation key=W1T4O3EAE7JN tag=T7K287JCRUA5 type=write size=893554 2024-06-04T15:59:33.194 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.194+0000 7f5e9aacc780 1 > prepared operation key=Q2V1ICTBSCV1 tag=719IW2DG6YLK type=del size=3342735 2024-06-04T15:59:33.195 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.195+0000 7f5e9aacc780 1 < completed part key=_multipart_XH0N984YVGKP.2~RIBSFVMGS4WX.0 size=1048576 2024-06-04T15:59:33.195 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.195+0000 7f5e9aacc780 1 < canceled part key=_multipart_XH0N984YVGKP.2~RIBSFVMGS4WX.1 size=865589 2024-06-04T15:59:33.197 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.197+0000 7f5e9aacc780 1 < canceled multipart upload key=XH0N984YVGKP upload=RIBSFVMGS4WX tag=OTOSYM4KN5D8 type=write size=2962741 2024-06-04T15:59:33.199 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.198+0000 7f5e9aacc780 1 > prepared operation key=UW5LVIBG09SV tag=8606BMTAAJ9D type=del size=550497 2024-06-04T15:59:33.200 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.200+0000 7f5e9aacc780 1 < completed delete operation key=9MPRI6LW3956 tag=0Y3SDDDJG7L4 type=del 2024-06-04T15:59:33.202 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.202+0000 7f5e9aacc780 1 > prepared part key=_multipart_PNDPO2WUW7UX.2~I05CZ8L2C7N1.0 size=605528 2024-06-04T15:59:33.203 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.202+0000 7f5e9aacc780 1 > prepared multipart upload key=PNDPO2WUW7UX upload=I05CZ8L2C7N1 tag=PZDMPPXFUXD3 type=write size=1654104 2024-06-04T15:59:33.204 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.203+0000 7f5e9aacc780 1 < completed part key=_multipart_1IKNQXU3Y2JJ.2~9191CJK9LQUA.0 size=568295 2024-06-04T15:59:33.206 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.206+0000 7f5e9aacc780 1 < completed multipart upload key=1IKNQXU3Y2JJ upload=9191CJK9LQUA tag=KVZ6H5UOA3BW type=write size=1616871 2024-06-04T15:59:33.208 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.207+0000 7f5e9aacc780 1 > prepared operation key=RP8K6QJUZAH1 tag=LHP4R7HY3NG0 type=del size=1947141 2024-06-04T15:59:33.209 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.209+0000 7f5e9aacc780 1 < completed part key=_multipart_03ZNYG3WLMP4.2~MIKA3JCIEMED.0 size=1048576 2024-06-04T15:59:33.210 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.210+0000 7f5e9aacc780 1 < completed part key=_multipart_03ZNYG3WLMP4.2~MIKA3JCIEMED.1 size=1048576 2024-06-04T15:59:33.211 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.211+0000 7f5e9aacc780 1 < completed part key=_multipart_03ZNYG3WLMP4.2~MIKA3JCIEMED.2 size=426142 2024-06-04T15:59:33.213 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.213+0000 7f5e9aacc780 1 < completed multipart upload key=03ZNYG3WLMP4 upload=MIKA3JCIEMED tag=2IGQHKRJ7K3P type=write size=3571870 2024-06-04T15:59:33.215 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.214+0000 7f5e9aacc780 1 > prepared operation key=W1T4O3EAE7JN tag=HD7YZIX02D2I type=del size=510955 2024-06-04T15:59:33.216 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.216+0000 7f5e9aacc780 1 < completed delete operation key=NHPH4LYPP0LL tag=OY0RW2T3Q71X type=del 2024-06-04T15:59:33.219 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.219+0000 7f5e9aacc780 1 > prepared part key=_multipart_A8O0S3S45RGM.2~TCM8KBQSC92T.0 size=1048576 2024-06-04T15:59:33.220 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.219+0000 7f5e9aacc780 1 > prepared part key=_multipart_A8O0S3S45RGM.2~TCM8KBQSC92T.1 size=1048576 2024-06-04T15:59:33.221 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.220+0000 7f5e9aacc780 1 > prepared part key=_multipart_A8O0S3S45RGM.2~TCM8KBQSC92T.2 size=777161 2024-06-04T15:59:33.221 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.220+0000 7f5e9aacc780 1 > prepared multipart upload key=A8O0S3S45RGM upload=TCM8KBQSC92T tag=DF9AAY3E18DJ type=write size=3922889 2024-06-04T15:59:33.222 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.222+0000 7f5e9aacc780 1 < completed part key=_multipart_JL69PUHT6NNT.2~3GZ9NTUSNYA1.0 size=428709 2024-06-04T15:59:33.224 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.224+0000 7f5e9aacc780 1 < completed multipart upload key=JL69PUHT6NNT upload=3GZ9NTUSNYA1 tag=0V007HVUIDBV type=write size=1477285 2024-06-04T15:59:33.226 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.226+0000 7f5e9aacc780 1 > prepared part key=_multipart_RP8K6QJUZAH1.2~EV5BC0CFFW0Q.0 size=1048576 2024-06-04T15:59:33.228 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.228+0000 7f5e9aacc780 1 > prepared part key=_multipart_RP8K6QJUZAH1.2~EV5BC0CFFW0Q.1 size=66372 2024-06-04T15:59:33.228 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.228+0000 7f5e9aacc780 1 > prepared multipart upload key=RP8K6QJUZAH1 upload=EV5BC0CFFW0Q tag=U2RM2YNO36NO type=write size=2163524 2024-06-04T15:59:33.229 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.229+0000 7f5e9aacc780 1 < completed part key=_multipart_NJ5U8JTT32QK.2~0A27J1EJI66O.0 size=1048576 2024-06-04T15:59:33.231 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.230+0000 7f5e9aacc780 1 < completed part key=_multipart_NJ5U8JTT32QK.2~0A27J1EJI66O.1 size=1048576 2024-06-04T15:59:33.232 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.231+0000 7f5e9aacc780 1 < completed part key=_multipart_NJ5U8JTT32QK.2~0A27J1EJI66O.2 size=766701 2024-06-04T15:59:33.234 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.234+0000 7f5e9aacc780 1 < completed multipart upload key=NJ5U8JTT32QK upload=0A27J1EJI66O tag=17CGZ04E7R85 type=write size=3912429 2024-06-04T15:59:33.237 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.236+0000 7f5e9aacc780 1 > prepared part key=_multipart_HD6SNICRCDLL.2~UBIWY83WEZ5K.0 size=953135 2024-06-04T15:59:33.237 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.236+0000 7f5e9aacc780 1 > prepared multipart upload key=HD6SNICRCDLL upload=UBIWY83WEZ5K tag=G7DNF8O1QCPG type=write size=2001711 2024-06-04T15:59:33.238 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.238+0000 7f5e9aacc780 1 < completed part key=_multipart_7S9S3MIG7WIT.2~A2EG2SOUYSXF.0 size=1048576 2024-06-04T15:59:33.239 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.239+0000 7f5e9aacc780 1 < completed part key=_multipart_7S9S3MIG7WIT.2~A2EG2SOUYSXF.1 size=1048576 2024-06-04T15:59:33.240 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.240+0000 7f5e9aacc780 1 < completed part key=_multipart_7S9S3MIG7WIT.2~A2EG2SOUYSXF.2 size=310939 2024-06-04T15:59:33.243 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.243+0000 7f5e9aacc780 1 < completed multipart upload key=7S9S3MIG7WIT upload=A2EG2SOUYSXF tag=R6PEZ02LVHYY type=write size=3456667 2024-06-04T15:59:33.244 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.244+0000 7f5e9aacc780 1 > prepared operation key=NHPH4LYPP0LL tag=XI9IY7KM2Z3P type=del size=1192213 2024-06-04T15:59:33.245 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.245+0000 7f5e9aacc780 1 < completed part key=_multipart_GCPC9OJH7KWU.2~B35QUI2PLWIA.0 size=1048576 2024-06-04T15:59:33.247 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.246+0000 7f5e9aacc780 1 < completed part key=_multipart_GCPC9OJH7KWU.2~B35QUI2PLWIA.1 size=1048576 2024-06-04T15:59:33.248 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.247+0000 7f5e9aacc780 1 < completed part key=_multipart_GCPC9OJH7KWU.2~B35QUI2PLWIA.2 size=974992 2024-06-04T15:59:33.250 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.250+0000 7f5e9aacc780 1 < completed multipart upload key=GCPC9OJH7KWU upload=B35QUI2PLWIA tag=4DKLH9R39BJK type=write size=4120720 2024-06-04T15:59:33.251 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.251+0000 7f5e9aacc780 1 > prepared operation key=DY9JWHWNAUO1 tag=3ZBVXN74MZ0C type=del size=498576 2024-06-04T15:59:33.253 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.253+0000 7f5e9aacc780 1 < completed delete operation key=DY9JWHWNAUO1 tag=R1P6HIZR86LK type=del 2024-06-04T15:59:33.255 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.255+0000 7f5e9aacc780 1 > prepared operation key=UW5LVIBG09SV tag=P6E6WA0N0O6O type=del size=1694728 2024-06-04T15:59:33.256 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.256+0000 7f5e9aacc780 1 < completed delete operation key=GTRMEQJK675Z tag=B4ZTYHJ5F0YT type=del 2024-06-04T15:59:33.258 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.258+0000 7f5e9aacc780 1 > prepared part key=_multipart_JL69PUHT6NNT.2~B5D4PRKKLRY7.0 size=1048576 2024-06-04T15:59:33.259 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.259+0000 7f5e9aacc780 1 > prepared part key=_multipart_JL69PUHT6NNT.2~B5D4PRKKLRY7.1 size=601826 2024-06-04T15:59:33.260 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.259+0000 7f5e9aacc780 1 > prepared multipart upload key=JL69PUHT6NNT upload=B5D4PRKKLRY7 tag=6X6CU3TTLS97 type=write size=2698978 2024-06-04T15:59:33.261 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.260+0000 7f5e9aacc780 1 < completed part key=_multipart_K01DAK0M4I4M.2~J4PXAVHSOH17.0 size=984 2024-06-04T15:59:33.263 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.263+0000 7f5e9aacc780 1 < completed multipart upload key=K01DAK0M4I4M upload=J4PXAVHSOH17 tag=7EVMHZ3OELD2 type=write size=1049560 2024-06-04T15:59:33.265 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.266+0000 7f5e9aacc780 1 > prepared part key=_multipart_PCLJXQHJ4HTY.2~GLJXDX1DYEZP.0 size=1048576 2024-06-04T15:59:33.267 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.266+0000 7f5e9aacc780 1 > prepared part key=_multipart_PCLJXQHJ4HTY.2~GLJXDX1DYEZP.1 size=259960 2024-06-04T15:59:33.267 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.266+0000 7f5e9aacc780 1 > prepared multipart upload key=PCLJXQHJ4HTY upload=GLJXDX1DYEZP tag=26WQ89N0BLRO type=write size=2357112 2024-06-04T15:59:33.268 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.268+0000 7f5e9aacc780 1 < completed delete operation key=TUGKW7F4V9NO tag=Z2CU6EZ92N0I type=del 2024-06-04T15:59:33.269 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.269+0000 7f5e9aacc780 1 > prepared operation key=QUIVPH3OB6KN tag=87JRW7MPMJJ2 type=del size=1654559 2024-06-04T15:59:33.270 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.269+0000 7f5e9aacc780 1 < canceled part key=_multipart_GCPC9OJH7KWU.2~RB0AJ7HE4VEA.0 size=1048576 2024-06-04T15:59:33.271 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.270+0000 7f5e9aacc780 1 < completed part key=_multipart_GCPC9OJH7KWU.2~RB0AJ7HE4VEA.1 size=725887 2024-06-04T15:59:33.273 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.273+0000 7f5e9aacc780 1 < canceled multipart upload key=GCPC9OJH7KWU upload=RB0AJ7HE4VEA tag=PO79099NPCXG type=write size=2823039 2024-06-04T15:59:33.275 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.274+0000 7f5e9aacc780 1 > prepared operation key=W1T4O3EAE7JN tag=CDFI8AUD9KVJ type=del size=800729 2024-06-04T15:59:33.276 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.276+0000 7f5e9aacc780 1 < completed part key=_multipart_XH0N984YVGKP.2~1ECPR25XEB6M.0 size=1048576 2024-06-04T15:59:33.277 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.277+0000 7f5e9aacc780 1 < completed part key=_multipart_XH0N984YVGKP.2~1ECPR25XEB6M.1 size=1048576 2024-06-04T15:59:33.278 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.277+0000 7f5e9aacc780 1 < canceled part key=_multipart_XH0N984YVGKP.2~1ECPR25XEB6M.2 size=861853 2024-06-04T15:59:33.280 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.279+0000 7f5e9aacc780 1 < canceled multipart upload key=XH0N984YVGKP upload=1ECPR25XEB6M tag=6Y4IKN8MK7TS type=write size=4007581 2024-06-04T15:59:33.281 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.281+0000 7f5e9aacc780 1 > prepared operation key=XH0N984YVGKP tag=DVE95H0OXP0A type=del size=723917 2024-06-04T15:59:33.284 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.284+0000 7f5e9aacc780 1 < suggested update operation key=Q2V1ICTBSCV1 tag=719IW2DG6YLK type=del size=3342735 2024-06-04T15:59:33.285 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.285+0000 7f5e9aacc780 1 > prepared operation key=A8O0S3S45RGM tag=XTEOAIK2QC4N type=del size=3574160 2024-06-04T15:59:33.287 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.286+0000 7f5e9aacc780 1 < canceled operation key=UW5LVIBG09SV tag=8606BMTAAJ9D type=del size=550497 2024-06-04T15:59:33.288 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.288+0000 7f5e9aacc780 1 > prepared operation key=UW5LVIBG09SV tag=D9CC0BRFEJ4I type=write size=556861 2024-06-04T15:59:33.289 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.288+0000 7f5e9aacc780 1 < canceled part key=_multipart_PNDPO2WUW7UX.2~I05CZ8L2C7N1.0 size=605528 2024-06-04T15:59:33.291 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.290+0000 7f5e9aacc780 1 < canceled multipart upload key=PNDPO2WUW7UX upload=I05CZ8L2C7N1 tag=PZDMPPXFUXD3 type=write size=1654104 2024-06-04T15:59:33.292 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.292+0000 7f5e9aacc780 1 > prepared operation key=K01DAK0M4I4M tag=IEQ62HWB5HJ8 type=del size=3405528 2024-06-04T15:59:33.294 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.293+0000 7f5e9aacc780 1 < completed delete operation key=RP8K6QJUZAH1 tag=LHP4R7HY3NG0 type=del 2024-06-04T15:59:33.295 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.295+0000 7f5e9aacc780 1 > prepared operation key=DY9JWHWNAUO1 tag=IO8O91QRNAU9 type=del size=1665779 2024-06-04T15:59:33.297 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.297+0000 7f5e9aacc780 1 < completed delete operation key=W1T4O3EAE7JN tag=HD7YZIX02D2I type=del 2024-06-04T15:59:33.299 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.299+0000 7f5e9aacc780 1 > prepared operation key=2BT2AXKB1RTA tag=RICHZ3RJM4II type=del size=1043438 2024-06-04T15:59:33.301 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.300+0000 7f5e9aacc780 1 < completed part key=_multipart_A8O0S3S45RGM.2~TCM8KBQSC92T.0 size=1048576 2024-06-04T15:59:33.302 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.302+0000 7f5e9aacc780 1 < completed part key=_multipart_A8O0S3S45RGM.2~TCM8KBQSC92T.1 size=1048576 2024-06-04T15:59:33.303 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.303+0000 7f5e9aacc780 1 < completed part key=_multipart_A8O0S3S45RGM.2~TCM8KBQSC92T.2 size=777161 2024-06-04T15:59:33.306 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.306+0000 7f5e9aacc780 1 < completed multipart upload key=A8O0S3S45RGM upload=TCM8KBQSC92T tag=DF9AAY3E18DJ type=write size=3922889 2024-06-04T15:59:33.309 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.309+0000 7f5e9aacc780 1 > prepared part key=_multipart_HD6SNICRCDLL.2~ES5PD4WY0JVN.0 size=1048576 2024-06-04T15:59:33.310 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.310+0000 7f5e9aacc780 1 > prepared part key=_multipart_HD6SNICRCDLL.2~ES5PD4WY0JVN.1 size=1048576 2024-06-04T15:59:33.311 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.311+0000 7f5e9aacc780 1 > prepared part key=_multipart_HD6SNICRCDLL.2~ES5PD4WY0JVN.2 size=782105 2024-06-04T15:59:33.311 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.311+0000 7f5e9aacc780 1 > prepared multipart upload key=HD6SNICRCDLL upload=ES5PD4WY0JVN tag=LHST3WDQ4V3B type=write size=3927833 2024-06-04T15:59:33.313 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.312+0000 7f5e9aacc780 1 < completed part key=_multipart_RP8K6QJUZAH1.2~EV5BC0CFFW0Q.0 size=1048576 2024-06-04T15:59:33.314 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.313+0000 7f5e9aacc780 1 < completed part key=_multipart_RP8K6QJUZAH1.2~EV5BC0CFFW0Q.1 size=66372 2024-06-04T15:59:33.317 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.317+0000 7f5e9aacc780 1 < completed multipart upload key=RP8K6QJUZAH1 upload=EV5BC0CFFW0Q tag=U2RM2YNO36NO type=write size=2163524 2024-06-04T15:59:33.319 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.319+0000 7f5e9aacc780 1 > prepared operation key=GTRMEQJK675Z tag=A8O5AVQ3KK0K type=del size=1186360 2024-06-04T15:59:33.320 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.320+0000 7f5e9aacc780 1 < completed part key=_multipart_HD6SNICRCDLL.2~UBIWY83WEZ5K.0 size=953135 2024-06-04T15:59:33.322 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.322+0000 7f5e9aacc780 1 < completed multipart upload key=HD6SNICRCDLL upload=UBIWY83WEZ5K tag=G7DNF8O1QCPG type=write size=2001711 2024-06-04T15:59:33.325 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.325+0000 7f5e9aacc780 1 > prepared part key=_multipart_AOCB36Y5Q7B0.2~Y7YTBYANFJBS.0 size=1048576 2024-06-04T15:59:33.326 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.326+0000 7f5e9aacc780 1 > prepared part key=_multipart_AOCB36Y5Q7B0.2~Y7YTBYANFJBS.1 size=1048576 2024-06-04T15:59:33.327 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.327+0000 7f5e9aacc780 1 > prepared part key=_multipart_AOCB36Y5Q7B0.2~Y7YTBYANFJBS.2 size=774093 2024-06-04T15:59:33.327 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.327+0000 7f5e9aacc780 1 > prepared multipart upload key=AOCB36Y5Q7B0 upload=Y7YTBYANFJBS tag=ZHB9QOQ0VKPS type=write size=3919821 2024-06-04T15:59:33.328 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.328+0000 7f5e9aacc780 1 < completed delete operation key=NHPH4LYPP0LL tag=XI9IY7KM2Z3P type=del 2024-06-04T15:59:33.329 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.329+0000 7f5e9aacc780 1 > prepared operation key=XH0N984YVGKP tag=JGV9F4VQ30SG type=del size=3487734 2024-06-04T15:59:33.331 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.331+0000 7f5e9aacc780 1 < completed delete operation key=DY9JWHWNAUO1 tag=3ZBVXN74MZ0C type=del 2024-06-04T15:59:33.332 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.332+0000 7f5e9aacc780 1 > prepared operation key=GCPC9OJH7KWU tag=09NQ257GF26N type=del size=1801460 2024-06-04T15:59:33.334 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.334+0000 7f5e9aacc780 1 < completed delete operation key=UW5LVIBG09SV tag=P6E6WA0N0O6O type=del 2024-06-04T15:59:33.335 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.335+0000 7f5e9aacc780 1 > prepared operation key=TUGKW7F4V9NO tag=V1NPJ4BR0D9X type=del size=3928395 2024-06-04T15:59:33.337 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.337+0000 7f5e9aacc780 1 < completed part key=_multipart_JL69PUHT6NNT.2~B5D4PRKKLRY7.0 size=1048576 2024-06-04T15:59:33.338 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.338+0000 7f5e9aacc780 1 < completed part key=_multipart_JL69PUHT6NNT.2~B5D4PRKKLRY7.1 size=601826 2024-06-04T15:59:33.340 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.340+0000 7f5e9aacc780 1 < completed multipart upload key=JL69PUHT6NNT upload=B5D4PRKKLRY7 tag=6X6CU3TTLS97 type=write size=2698978 2024-06-04T15:59:33.343 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.343+0000 7f5e9aacc780 1 > prepared part key=_multipart_PCLJXQHJ4HTY.2~RUPKTE8YYB06.0 size=1048576 2024-06-04T15:59:33.344 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.344+0000 7f5e9aacc780 1 > prepared part key=_multipart_PCLJXQHJ4HTY.2~RUPKTE8YYB06.1 size=468498 2024-06-04T15:59:33.344 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.344+0000 7f5e9aacc780 1 > prepared multipart upload key=PCLJXQHJ4HTY upload=RUPKTE8YYB06 tag=VSRKTQCWFS65 type=write size=2565650 2024-06-04T15:59:33.345 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.345+0000 7f5e9aacc780 1 < completed part key=_multipart_PCLJXQHJ4HTY.2~GLJXDX1DYEZP.0 size=1048576 2024-06-04T15:59:33.347 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.346+0000 7f5e9aacc780 1 < completed part key=_multipart_PCLJXQHJ4HTY.2~GLJXDX1DYEZP.1 size=259960 2024-06-04T15:59:33.349 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.349+0000 7f5e9aacc780 1 < completed multipart upload key=PCLJXQHJ4HTY upload=GLJXDX1DYEZP tag=26WQ89N0BLRO type=write size=2357112 2024-06-04T15:59:33.351 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.350+0000 7f5e9aacc780 1 > prepared operation key=9MPRI6LW3956 tag=BVCE4MJCURWH type=del size=155001 2024-06-04T15:59:33.353 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.352+0000 7f5e9aacc780 1 < completed delete operation key=QUIVPH3OB6KN tag=87JRW7MPMJJ2 type=del 2024-06-04T15:59:33.355 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.355+0000 7f5e9aacc780 1 > prepared part key=_multipart_FBV2MAG130M6.2~IENULLWQVURA.0 size=1048576 2024-06-04T15:59:33.356 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.356+0000 7f5e9aacc780 1 > prepared part key=_multipart_FBV2MAG130M6.2~IENULLWQVURA.1 size=1004083 2024-06-04T15:59:33.357 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.356+0000 7f5e9aacc780 1 > prepared multipart upload key=FBV2MAG130M6 upload=IENULLWQVURA tag=0HIO6OA0TUKZ type=write size=3101235 2024-06-04T15:59:33.358 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.358+0000 7f5e9aacc780 1 < completed delete operation key=W1T4O3EAE7JN tag=CDFI8AUD9KVJ type=del 2024-06-04T15:59:33.359 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.359+0000 7f5e9aacc780 1 > prepared operation key=RP8K6QJUZAH1 tag=8AUDN2ENB9AJ type=del size=3955976 2024-06-04T15:59:33.361 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.361+0000 7f5e9aacc780 1 < canceled operation key=XH0N984YVGKP tag=DVE95H0OXP0A type=del size=723917 2024-06-04T15:59:33.362 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.362+0000 7f5e9aacc780 1 > prepared operation key=GTRMEQJK675Z tag=1AIOYMXC3755 type=write size=1026935 2024-06-04T15:59:33.364 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.363+0000 7f5e9aacc780 1 < completed delete operation key=A8O0S3S45RGM tag=XTEOAIK2QC4N type=del 2024-06-04T15:59:33.366 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.366+0000 7f5e9aacc780 1 > prepared part key=_multipart_PCLJXQHJ4HTY.2~R5FSGNUL90L5.0 size=117143 2024-06-04T15:59:33.366 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.366+0000 7f5e9aacc780 1 > prepared multipart upload key=PCLJXQHJ4HTY upload=R5FSGNUL90L5 tag=1RINW4ISY2Q5 type=write size=1165719 2024-06-04T15:59:33.368 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.367+0000 7f5e9aacc780 1 < canceled operation key=UW5LVIBG09SV tag=D9CC0BRFEJ4I type=write size=556861 2024-06-04T15:59:33.369 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.369+0000 7f5e9aacc780 1 > prepared operation key=B0HK5FJ2RGJE tag=JGZWKJW2BW7K type=del size=940360 2024-06-04T15:59:33.371 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.370+0000 7f5e9aacc780 1 < completed delete operation key=K01DAK0M4I4M tag=IEQ62HWB5HJ8 type=del 2024-06-04T15:59:33.373 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.373+0000 7f5e9aacc780 1 > prepared part key=_multipart_SUBHZJ7HUV3H.2~GHWHZFF1H61K.0 size=1048576 2024-06-04T15:59:33.374 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.375+0000 7f5e9aacc780 1 > prepared part key=_multipart_SUBHZJ7HUV3H.2~GHWHZFF1H61K.1 size=900938 2024-06-04T15:59:33.375 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.375+0000 7f5e9aacc780 1 > prepared multipart upload key=SUBHZJ7HUV3H upload=GHWHZFF1H61K tag=08974264D75R type=write size=2998090 2024-06-04T15:59:33.378 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.377+0000 7f5e9aacc780 1 < suggested update operation key=DY9JWHWNAUO1 tag=IO8O91QRNAU9 type=del size=1665779 2024-06-04T15:59:33.379 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.378+0000 7f5e9aacc780 1 > prepared operation key=4W5HB9WQQHR6 tag=9O64P07MOBK3 type=del size=3452785 2024-06-04T15:59:33.380 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.380+0000 7f5e9aacc780 1 < completed delete operation key=2BT2AXKB1RTA tag=RICHZ3RJM4II type=del 2024-06-04T15:59:33.382 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.381+0000 7f5e9aacc780 1 > prepared operation key=UW5LVIBG09SV tag=WG313RMLKD1K type=del size=3957636 2024-06-04T15:59:33.383 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.383+0000 7f5e9aacc780 1 < completed part key=_multipart_HD6SNICRCDLL.2~ES5PD4WY0JVN.0 size=1048576 2024-06-04T15:59:33.384 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.384+0000 7f5e9aacc780 1 < completed part key=_multipart_HD6SNICRCDLL.2~ES5PD4WY0JVN.1 size=1048576 2024-06-04T15:59:33.385 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.385+0000 7f5e9aacc780 1 < completed part key=_multipart_HD6SNICRCDLL.2~ES5PD4WY0JVN.2 size=782105 2024-06-04T15:59:33.388 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.387+0000 7f5e9aacc780 1 < completed multipart upload key=HD6SNICRCDLL upload=ES5PD4WY0JVN tag=LHST3WDQ4V3B type=write size=3927833 2024-06-04T15:59:33.389 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.389+0000 7f5e9aacc780 1 > prepared operation key=UTZHANL9ER2Q tag=1NCOMB1J7BY5 type=del size=2161058 2024-06-04T15:59:33.391 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.390+0000 7f5e9aacc780 1 < completed delete operation key=GTRMEQJK675Z tag=A8O5AVQ3KK0K type=del 2024-06-04T15:59:33.394 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.394+0000 7f5e9aacc780 1 > prepared part key=_multipart_7S9S3MIG7WIT.2~H86O43Y908P5.0 size=1048576 2024-06-04T15:59:33.395 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.395+0000 7f5e9aacc780 1 > prepared part key=_multipart_7S9S3MIG7WIT.2~H86O43Y908P5.1 size=777367 2024-06-04T15:59:33.395 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.395+0000 7f5e9aacc780 1 > prepared multipart upload key=7S9S3MIG7WIT upload=H86O43Y908P5 tag=08KIU3DCS6Z8 type=write size=2874519 2024-06-04T15:59:33.396 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.396+0000 7f5e9aacc780 1 < completed part key=_multipart_AOCB36Y5Q7B0.2~Y7YTBYANFJBS.0 size=1048576 2024-06-04T15:59:33.397 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.397+0000 7f5e9aacc780 1 < completed part key=_multipart_AOCB36Y5Q7B0.2~Y7YTBYANFJBS.1 size=1048576 2024-06-04T15:59:33.398 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.398+0000 7f5e9aacc780 1 < completed part key=_multipart_AOCB36Y5Q7B0.2~Y7YTBYANFJBS.2 size=774093 2024-06-04T15:59:33.401 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.401+0000 7f5e9aacc780 1 < completed multipart upload key=AOCB36Y5Q7B0 upload=Y7YTBYANFJBS tag=ZHB9QOQ0VKPS type=write size=3919821 2024-06-04T15:59:33.403 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.403+0000 7f5e9aacc780 1 > prepared operation key=7S9S3MIG7WIT tag=9WLZG8OA8BEH type=del size=2587766 2024-06-04T15:59:33.406 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.406+0000 7f5e9aacc780 1 < suggested update operation key=XH0N984YVGKP tag=JGV9F4VQ30SG type=del size=3487734 2024-06-04T15:59:33.407 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.407+0000 7f5e9aacc780 1 > prepared operation key=PNDPO2WUW7UX tag=6TBQIZVIU07V type=del size=3579100 2024-06-04T15:59:33.409 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.408+0000 7f5e9aacc780 1 < completed delete operation key=GCPC9OJH7KWU tag=09NQ257GF26N type=del 2024-06-04T15:59:33.410 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.410+0000 7f5e9aacc780 1 > prepared operation key=PASGIP872OVX tag=RSK28WOZN44D type=write size=339091 2024-06-04T15:59:33.413 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.413+0000 7f5e9aacc780 1 < suggested update operation key=TUGKW7F4V9NO tag=V1NPJ4BR0D9X type=del size=3928395 2024-06-04T15:59:33.415 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.415+0000 7f5e9aacc780 1 > prepared operation key=JL69PUHT6NNT tag=6S5B8AZDBCRS type=del size=3955561 2024-06-04T15:59:33.416 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.416+0000 7f5e9aacc780 1 < completed part key=_multipart_PCLJXQHJ4HTY.2~RUPKTE8YYB06.0 size=1048576 2024-06-04T15:59:33.418 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.417+0000 7f5e9aacc780 1 < completed part key=_multipart_PCLJXQHJ4HTY.2~RUPKTE8YYB06.1 size=468498 2024-06-04T15:59:33.420 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.420+0000 7f5e9aacc780 1 < completed multipart upload key=PCLJXQHJ4HTY upload=RUPKTE8YYB06 tag=VSRKTQCWFS65 type=write size=2565650 2024-06-04T15:59:33.423 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.423+0000 7f5e9aacc780 1 > prepared part key=_multipart_XH0N984YVGKP.2~XNYACM3347UG.0 size=322425 2024-06-04T15:59:33.423 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.423+0000 7f5e9aacc780 1 > prepared multipart upload key=XH0N984YVGKP upload=XNYACM3347UG tag=GF8L6A3PU1NJ type=write size=1371001 2024-06-04T15:59:33.424 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.424+0000 7f5e9aacc780 1 < canceled operation key=9MPRI6LW3956 tag=BVCE4MJCURWH type=del size=155001 2024-06-04T15:59:33.426 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.426+0000 7f5e9aacc780 1 > prepared operation key=7S9S3MIG7WIT tag=AW895QGVEMU6 type=del size=1071937 2024-06-04T15:59:33.427 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.427+0000 7f5e9aacc780 1 < completed part key=_multipart_FBV2MAG130M6.2~IENULLWQVURA.0 size=1048576 2024-06-04T15:59:33.429 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.429+0000 7f5e9aacc780 1 < completed part key=_multipart_FBV2MAG130M6.2~IENULLWQVURA.1 size=1004083 2024-06-04T15:59:33.431 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.432+0000 7f5e9aacc780 1 < completed multipart upload key=FBV2MAG130M6 upload=IENULLWQVURA tag=0HIO6OA0TUKZ type=write size=3101235 2024-06-04T15:59:33.433 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.433+0000 7f5e9aacc780 1 > prepared operation key=HD6SNICRCDLL tag=PBAUEBP8BJ5T type=del size=948623 2024-06-04T15:59:33.434 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.434+0000 7f5e9aacc780 1 < completed delete operation key=RP8K6QJUZAH1 tag=8AUDN2ENB9AJ type=del 2024-06-04T15:59:33.437 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.437+0000 7f5e9aacc780 1 > prepared part key=_multipart_PNDPO2WUW7UX.2~UNIPW3EX5JLJ.0 size=54145 2024-06-04T15:59:33.437 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.437+0000 7f5e9aacc780 1 > prepared multipart upload key=PNDPO2WUW7UX upload=UNIPW3EX5JLJ tag=3D9STB0H2F2D type=write size=1102721 2024-06-04T15:59:33.439 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.439+0000 7f5e9aacc780 1 < canceled operation key=GTRMEQJK675Z tag=1AIOYMXC3755 type=write size=1026935 2024-06-04T15:59:33.441 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.440+0000 7f5e9aacc780 1 > prepared operation key=7S9S3MIG7WIT tag=03UPTR89BOMR type=del size=4057087 2024-06-04T15:59:33.442 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.442+0000 7f5e9aacc780 1 < completed part key=_multipart_PCLJXQHJ4HTY.2~R5FSGNUL90L5.0 size=117143 2024-06-04T15:59:33.445 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.445+0000 7f5e9aacc780 1 < completed multipart upload key=PCLJXQHJ4HTY upload=R5FSGNUL90L5 tag=1RINW4ISY2Q5 type=write size=1165719 2024-06-04T15:59:33.448 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.447+0000 7f5e9aacc780 1 > prepared part key=_multipart_RP8K6QJUZAH1.2~NMQHJ04Y4Z57.0 size=707703 2024-06-04T15:59:33.448 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.447+0000 7f5e9aacc780 1 > prepared multipart upload key=RP8K6QJUZAH1 upload=NMQHJ04Y4Z57 tag=8YIY2SUFB9TR type=write size=1756279 2024-06-04T15:59:33.449 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.449+0000 7f5e9aacc780 1 < completed delete operation key=B0HK5FJ2RGJE tag=JGZWKJW2BW7K type=del 2024-06-04T15:59:33.451 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.450+0000 7f5e9aacc780 1 > prepared operation key=PCLJXQHJ4HTY tag=WIU13G8PXOQ2 type=write size=719971 2024-06-04T15:59:33.452 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.452+0000 7f5e9aacc780 1 < completed part key=_multipart_SUBHZJ7HUV3H.2~GHWHZFF1H61K.0 size=1048576 2024-06-04T15:59:33.454 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.453+0000 7f5e9aacc780 1 < completed part key=_multipart_SUBHZJ7HUV3H.2~GHWHZFF1H61K.1 size=900938 2024-06-04T15:59:33.457 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.457+0000 7f5e9aacc780 1 < completed multipart upload key=SUBHZJ7HUV3H upload=GHWHZFF1H61K tag=08974264D75R type=write size=2998090 2024-06-04T15:59:33.459 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.459+0000 7f5e9aacc780 1 > prepared operation key=TUGKW7F4V9NO tag=5SJSRBRY6PS3 type=del size=1992116 2024-06-04T15:59:33.461 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.460+0000 7f5e9aacc780 1 < canceled operation key=4W5HB9WQQHR6 tag=9O64P07MOBK3 type=del size=3452785 2024-06-04T15:59:33.463 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.463+0000 7f5e9aacc780 1 > prepared part key=_multipart_A8O0S3S45RGM.2~IFMIFQ87C1KO.0 size=1048576 2024-06-04T15:59:33.465 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.464+0000 7f5e9aacc780 1 > prepared part key=_multipart_A8O0S3S45RGM.2~IFMIFQ87C1KO.1 size=23450 2024-06-04T15:59:33.465 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.464+0000 7f5e9aacc780 1 > prepared multipart upload key=A8O0S3S45RGM upload=IFMIFQ87C1KO tag=26QEWI7IRZYG type=write size=2120602 2024-06-04T15:59:33.466 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.466+0000 7f5e9aacc780 1 < completed delete operation key=UW5LVIBG09SV tag=WG313RMLKD1K type=del 2024-06-04T15:59:33.467 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.468+0000 7f5e9aacc780 1 > prepared operation key=B0HK5FJ2RGJE tag=Q7ELYTLCO5PM type=del size=3144227 2024-06-04T15:59:33.469 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.469+0000 7f5e9aacc780 1 < completed delete operation key=UTZHANL9ER2Q tag=1NCOMB1J7BY5 type=del 2024-06-04T15:59:33.470 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.471+0000 7f5e9aacc780 1 > prepared operation key=HD6SNICRCDLL tag=0AMP3UEP4CYN type=del size=1411850 2024-06-04T15:59:33.472 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.472+0000 7f5e9aacc780 1 < completed part key=_multipart_7S9S3MIG7WIT.2~H86O43Y908P5.0 size=1048576 2024-06-04T15:59:33.473 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.473+0000 7f5e9aacc780 1 < completed part key=_multipart_7S9S3MIG7WIT.2~H86O43Y908P5.1 size=777367 2024-06-04T15:59:33.475 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.476+0000 7f5e9aacc780 1 < completed multipart upload key=7S9S3MIG7WIT upload=H86O43Y908P5 tag=08KIU3DCS6Z8 type=write size=2874519 2024-06-04T15:59:33.477 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.477+0000 7f5e9aacc780 1 > prepared operation key=4W5HB9WQQHR6 tag=9R5VBHHFJH4V type=del size=1077138 2024-06-04T15:59:33.479 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.479+0000 7f5e9aacc780 1 < completed delete operation key=7S9S3MIG7WIT tag=9WLZG8OA8BEH type=del 2024-06-04T15:59:33.482 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.482+0000 7f5e9aacc780 1 > prepared part key=_multipart_Q4OFQI0F5YLG.2~H0WN63MLGA0M.0 size=1048576 2024-06-04T15:59:33.483 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.483+0000 7f5e9aacc780 1 > prepared part key=_multipart_Q4OFQI0F5YLG.2~H0WN63MLGA0M.1 size=157331 2024-06-04T15:59:33.483 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.483+0000 7f5e9aacc780 1 > prepared multipart upload key=Q4OFQI0F5YLG upload=H0WN63MLGA0M tag=M2RUWV8PP24M type=write size=2254483 2024-06-04T15:59:33.486 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.486+0000 7f5e9aacc780 1 < suggested remove operation key=PNDPO2WUW7UX tag=6TBQIZVIU07V type=del 2024-06-04T15:59:33.488 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.488+0000 7f5e9aacc780 1 > prepared operation key=RP8K6QJUZAH1 tag=B25BSWDQP00G type=del size=2612909 2024-06-04T15:59:33.490 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.489+0000 7f5e9aacc780 1 < completed write operation key=PASGIP872OVX tag=RSK28WOZN44D type=write size=339091 2024-06-04T15:59:33.491 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.491+0000 7f5e9aacc780 1 > prepared operation key=4W5HB9WQQHR6 tag=Z7UMMYAG603Y type=del size=3517135 2024-06-04T15:59:33.493 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.492+0000 7f5e9aacc780 1 < completed delete operation key=JL69PUHT6NNT tag=6S5B8AZDBCRS type=del 2024-06-04T15:59:33.494 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.494+0000 7f5e9aacc780 1 > prepared operation key=PNDPO2WUW7UX tag=KAIMYD42D9JQ type=del size=3774006 2024-06-04T15:59:33.496 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.496+0000 7f5e9aacc780 1 < completed part key=_multipart_XH0N984YVGKP.2~XNYACM3347UG.0 size=322425 2024-06-04T15:59:33.498 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.499+0000 7f5e9aacc780 1 < completed multipart upload key=XH0N984YVGKP upload=XNYACM3347UG tag=GF8L6A3PU1NJ type=write size=1371001 2024-06-04T15:59:33.500 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.500+0000 7f5e9aacc780 1 > prepared operation key=NJ5U8JTT32QK tag=KL9OZ5OQX3N9 type=del size=3852555 2024-06-04T15:59:33.502 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.501+0000 7f5e9aacc780 1 < completed delete operation key=7S9S3MIG7WIT tag=AW895QGVEMU6 type=del 2024-06-04T15:59:33.503 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.503+0000 7f5e9aacc780 1 > prepared operation key=RP8K6QJUZAH1 tag=63WX7TVSR803 type=del size=4155599 2024-06-04T15:59:33.505 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.504+0000 7f5e9aacc780 1 < completed delete operation key=HD6SNICRCDLL tag=PBAUEBP8BJ5T type=del 2024-06-04T15:59:33.507 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.507+0000 7f5e9aacc780 1 > prepared part key=_multipart_A8O0S3S45RGM.2~PR80BIHN5J04.0 size=1048576 2024-06-04T15:59:33.508 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.508+0000 7f5e9aacc780 1 > prepared part key=_multipart_A8O0S3S45RGM.2~PR80BIHN5J04.1 size=4289 2024-06-04T15:59:33.509 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.508+0000 7f5e9aacc780 1 > prepared multipart upload key=A8O0S3S45RGM upload=PR80BIHN5J04 tag=L88GIX315KK8 type=write size=2101441 2024-06-04T15:59:33.510 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.510+0000 7f5e9aacc780 1 < completed part key=_multipart_PNDPO2WUW7UX.2~UNIPW3EX5JLJ.0 size=54145 2024-06-04T15:59:33.512 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.512+0000 7f5e9aacc780 1 < completed multipart upload key=PNDPO2WUW7UX upload=UNIPW3EX5JLJ tag=3D9STB0H2F2D type=write size=1102721 2024-06-04T15:59:33.514 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.513+0000 7f5e9aacc780 1 > prepared operation key=DY9JWHWNAUO1 tag=56CCV3CQ9XVD type=del size=2802201 2024-06-04T15:59:33.515 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.515+0000 7f5e9aacc780 1 < completed delete operation key=7S9S3MIG7WIT tag=03UPTR89BOMR type=del 2024-06-04T15:59:33.517 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.516+0000 7f5e9aacc780 1 > prepared operation key=SUBHZJ7HUV3H tag=JS5UWAEEURDF type=del size=231880 2024-06-04T15:59:33.518 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.518+0000 7f5e9aacc780 1 < completed part key=_multipart_RP8K6QJUZAH1.2~NMQHJ04Y4Z57.0 size=707703 2024-06-04T15:59:33.521 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.520+0000 7f5e9aacc780 1 < completed multipart upload key=RP8K6QJUZAH1 upload=NMQHJ04Y4Z57 tag=8YIY2SUFB9TR type=write size=1756279 2024-06-04T15:59:33.523 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.523+0000 7f5e9aacc780 1 > prepared part key=_multipart_AOCB36Y5Q7B0.2~N5X4M0OY3HD5.0 size=1048576 2024-06-04T15:59:33.524 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.524+0000 7f5e9aacc780 1 > prepared part key=_multipart_AOCB36Y5Q7B0.2~N5X4M0OY3HD5.1 size=453221 2024-06-04T15:59:33.524 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.524+0000 7f5e9aacc780 1 > prepared multipart upload key=AOCB36Y5Q7B0 upload=N5X4M0OY3HD5 tag=KXX38GJILRSO type=write size=2550373 2024-06-04T15:59:33.526 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.525+0000 7f5e9aacc780 1 < completed write operation key=PCLJXQHJ4HTY tag=WIU13G8PXOQ2 type=write size=719971 2024-06-04T15:59:33.527 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.527+0000 7f5e9aacc780 1 > prepared operation key=Q2V1ICTBSCV1 tag=M3VYY5C8SJ1T type=del size=1820194 2024-06-04T15:59:33.528 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.528+0000 7f5e9aacc780 1 < completed delete operation key=TUGKW7F4V9NO tag=5SJSRBRY6PS3 type=del 2024-06-04T15:59:33.530 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.529+0000 7f5e9aacc780 1 > prepared operation key=GCPC9OJH7KWU tag=14XPPRKIHDZF type=del size=2626010 2024-06-04T15:59:33.531 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.531+0000 7f5e9aacc780 1 < completed part key=_multipart_A8O0S3S45RGM.2~IFMIFQ87C1KO.0 size=1048576 2024-06-04T15:59:33.532 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.532+0000 7f5e9aacc780 1 < completed part key=_multipart_A8O0S3S45RGM.2~IFMIFQ87C1KO.1 size=23450 2024-06-04T15:59:33.535 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.535+0000 7f5e9aacc780 1 < completed multipart upload key=A8O0S3S45RGM upload=IFMIFQ87C1KO tag=26QEWI7IRZYG type=write size=2120602 2024-06-04T15:59:33.536 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.536+0000 7f5e9aacc780 1 > prepared operation key=Q2V1ICTBSCV1 tag=RQ6VS8P0UHNZ type=write size=816282 2024-06-04T15:59:33.537 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.537+0000 7f5e9aacc780 1 < completed delete operation key=B0HK5FJ2RGJE tag=Q7ELYTLCO5PM type=del 2024-06-04T15:59:33.539 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.539+0000 7f5e9aacc780 1 > prepared operation key=4W5HB9WQQHR6 tag=EGEGWMG9M77K type=del size=618703 2024-06-04T15:59:33.541 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.540+0000 7f5e9aacc780 1 < completed delete operation key=HD6SNICRCDLL tag=0AMP3UEP4CYN type=del 2024-06-04T15:59:33.543 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.543+0000 7f5e9aacc780 1 > prepared part key=_multipart_XH0N984YVGKP.2~E18PFZI0QLVD.0 size=1048576 2024-06-04T15:59:33.544 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.544+0000 7f5e9aacc780 1 > prepared part key=_multipart_XH0N984YVGKP.2~E18PFZI0QLVD.1 size=1048576 2024-06-04T15:59:33.545 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.545+0000 7f5e9aacc780 1 > prepared part key=_multipart_XH0N984YVGKP.2~E18PFZI0QLVD.2 size=800968 2024-06-04T15:59:33.546 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.545+0000 7f5e9aacc780 1 > prepared multipart upload key=XH0N984YVGKP upload=E18PFZI0QLVD tag=7DSOJ138T1GD type=write size=3946696 2024-06-04T15:59:33.547 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.546+0000 7f5e9aacc780 1 < completed delete operation key=4W5HB9WQQHR6 tag=9R5VBHHFJH4V type=del 2024-06-04T15:59:33.549 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.548+0000 7f5e9aacc780 1 > prepared operation key=HD6SNICRCDLL tag=U04EQBON77ML type=del size=676540 2024-06-04T15:59:33.550 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.549+0000 7f5e9aacc780 1 < completed part key=_multipart_Q4OFQI0F5YLG.2~H0WN63MLGA0M.0 size=1048576 2024-06-04T15:59:33.550 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.549+0000 7f5e9aacc780 1 < canceled part key=_multipart_Q4OFQI0F5YLG.2~H0WN63MLGA0M.1 size=157331 2024-06-04T15:59:33.552 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.552+0000 7f5e9aacc780 1 < canceled multipart upload key=Q4OFQI0F5YLG upload=H0WN63MLGA0M tag=M2RUWV8PP24M type=write size=2254483 2024-06-04T15:59:33.554 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.554+0000 7f5e9aacc780 1 > prepared operation key=K01DAK0M4I4M tag=593YZNHFA7U7 type=del size=2073194 2024-06-04T15:59:33.557 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.557+0000 7f5e9aacc780 1 < suggested remove operation key=RP8K6QJUZAH1 tag=B25BSWDQP00G type=del 2024-06-04T15:59:33.560 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.559+0000 7f5e9aacc780 1 > prepared part key=_multipart_QUIVPH3OB6KN.2~KLCYIAZ8FE00.0 size=431892 2024-06-04T15:59:33.560 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.559+0000 7f5e9aacc780 1 > prepared multipart upload key=QUIVPH3OB6KN upload=KLCYIAZ8FE00 tag=L0IS6JR2HZRX type=write size=1480468 2024-06-04T15:59:33.561 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.561+0000 7f5e9aacc780 1 < completed delete operation key=4W5HB9WQQHR6 tag=Z7UMMYAG603Y type=del 2024-06-04T15:59:33.563 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.563+0000 7f5e9aacc780 1 > prepared part key=_multipart_SUBHZJ7HUV3H.2~41IB6Z3LJWXQ.0 size=1048576 2024-06-04T15:59:33.564 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.564+0000 7f5e9aacc780 1 > prepared part key=_multipart_SUBHZJ7HUV3H.2~41IB6Z3LJWXQ.1 size=407713 2024-06-04T15:59:33.565 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.564+0000 7f5e9aacc780 1 > prepared multipart upload key=SUBHZJ7HUV3H upload=41IB6Z3LJWXQ tag=ATJYDYD73JQL type=write size=2504865 2024-06-04T15:59:33.566 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.566+0000 7f5e9aacc780 1 < completed delete operation key=PNDPO2WUW7UX tag=KAIMYD42D9JQ type=del 2024-06-04T15:59:33.567 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.567+0000 7f5e9aacc780 1 > prepared operation key=PASGIP872OVX tag=TB2AX3AX7XIG type=del size=3504316 2024-06-04T15:59:33.570 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.570+0000 7f5e9aacc780 1 < completed delete operation key=NJ5U8JTT32QK tag=KL9OZ5OQX3N9 type=del 2024-06-04T15:59:33.572 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.572+0000 7f5e9aacc780 1 > prepared part key=_multipart_1IKNQXU3Y2JJ.2~IDNYN0IT58T6.0 size=1048576 2024-06-04T15:59:33.574 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.573+0000 7f5e9aacc780 1 > prepared part key=_multipart_1IKNQXU3Y2JJ.2~IDNYN0IT58T6.1 size=1048576 2024-06-04T15:59:33.575 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.574+0000 7f5e9aacc780 1 > prepared part key=_multipart_1IKNQXU3Y2JJ.2~IDNYN0IT58T6.2 size=921915 2024-06-04T15:59:33.575 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.574+0000 7f5e9aacc780 1 > prepared multipart upload key=1IKNQXU3Y2JJ upload=IDNYN0IT58T6 tag=VC5BH5680A8R type=write size=4067643 2024-06-04T15:59:33.576 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.576+0000 7f5e9aacc780 -1 < failed to complete operation key=RP8K6QJUZAH1 tag=63WX7TVSR803 type=del size=4155599: (22) Invalid argument 2024-06-04T15:59:33.579 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.579+0000 7f5e9aacc780 1 > prepared part key=_multipart_RP8K6QJUZAH1.2~D6ZLTJMDOTVX.0 size=1048576 2024-06-04T15:59:33.580 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.580+0000 7f5e9aacc780 1 > prepared part key=_multipart_RP8K6QJUZAH1.2~D6ZLTJMDOTVX.1 size=700943 2024-06-04T15:59:33.580 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.580+0000 7f5e9aacc780 1 > prepared multipart upload key=RP8K6QJUZAH1 upload=D6ZLTJMDOTVX tag=TKHXY5OAS0KX type=write size=2798095 2024-06-04T15:59:33.582 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.581+0000 7f5e9aacc780 1 < completed part key=_multipart_A8O0S3S45RGM.2~PR80BIHN5J04.0 size=1048576 2024-06-04T15:59:33.583 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.583+0000 7f5e9aacc780 1 < completed part key=_multipart_A8O0S3S45RGM.2~PR80BIHN5J04.1 size=4289 2024-06-04T15:59:33.585 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.585+0000 7f5e9aacc780 1 < completed multipart upload key=A8O0S3S45RGM upload=PR80BIHN5J04 tag=L88GIX315KK8 type=write size=2101441 2024-06-04T15:59:33.587 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.587+0000 7f5e9aacc780 1 > prepared operation key=JL69PUHT6NNT tag=L4YVWKOBRJZH type=del size=1214547 2024-06-04T15:59:33.588 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.588+0000 7f5e9aacc780 1 < completed delete operation key=DY9JWHWNAUO1 tag=56CCV3CQ9XVD type=del 2024-06-04T15:59:33.590 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.589+0000 7f5e9aacc780 1 > prepared operation key=TUGKW7F4V9NO tag=2CCVKEQXLP0P type=del size=297586 2024-06-04T15:59:33.592 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.592+0000 7f5e9aacc780 1 < suggested update operation key=SUBHZJ7HUV3H tag=JS5UWAEEURDF type=del size=231880 2024-06-04T15:59:33.594 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.593+0000 7f5e9aacc780 1 > prepared operation key=RP8K6QJUZAH1 tag=5ZP09DVBNPA5 type=del size=3755272 2024-06-04T15:59:33.596 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.596+0000 7f5e9aacc780 1 < completed part key=_multipart_AOCB36Y5Q7B0.2~N5X4M0OY3HD5.0 size=1048576 2024-06-04T15:59:33.598 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.597+0000 7f5e9aacc780 1 < completed part key=_multipart_AOCB36Y5Q7B0.2~N5X4M0OY3HD5.1 size=453221 2024-06-04T15:59:33.600 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.600+0000 7f5e9aacc780 1 < completed multipart upload key=AOCB36Y5Q7B0 upload=N5X4M0OY3HD5 tag=KXX38GJILRSO type=write size=2550373 2024-06-04T15:59:33.601 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.601+0000 7f5e9aacc780 1 > prepared operation key=W1T4O3EAE7JN tag=8YRL344J0AM3 type=del size=902576 2024-06-04T15:59:33.603 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.602+0000 7f5e9aacc780 1 < completed delete operation key=Q2V1ICTBSCV1 tag=M3VYY5C8SJ1T type=del 2024-06-04T15:59:33.605 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.605+0000 7f5e9aacc780 1 > prepared part key=_multipart_Q2V1ICTBSCV1.2~ATZR9DRQ05SW.0 size=1048576 2024-06-04T15:59:33.606 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.606+0000 7f5e9aacc780 1 > prepared part key=_multipart_Q2V1ICTBSCV1.2~ATZR9DRQ05SW.1 size=1048576 2024-06-04T15:59:33.607 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.607+0000 7f5e9aacc780 1 > prepared part key=_multipart_Q2V1ICTBSCV1.2~ATZR9DRQ05SW.2 size=511258 2024-06-04T15:59:33.607 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.607+0000 7f5e9aacc780 1 > prepared multipart upload key=Q2V1ICTBSCV1 upload=ATZR9DRQ05SW tag=96FGNMOYPBE7 type=write size=3656986 2024-06-04T15:59:33.610 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.609+0000 7f5e9aacc780 1 < suggested remove operation key=GCPC9OJH7KWU tag=14XPPRKIHDZF type=del 2024-06-04T15:59:33.612 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.612+0000 7f5e9aacc780 1 > prepared part key=_multipart_JL69PUHT6NNT.2~MR0CTDYKMY3R.0 size=1048576 2024-06-04T15:59:33.613 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.613+0000 7f5e9aacc780 1 > prepared part key=_multipart_JL69PUHT6NNT.2~MR0CTDYKMY3R.1 size=1048576 2024-06-04T15:59:33.615 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.614+0000 7f5e9aacc780 1 > prepared part key=_multipart_JL69PUHT6NNT.2~MR0CTDYKMY3R.2 size=201822 2024-06-04T15:59:33.615 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.614+0000 7f5e9aacc780 1 > prepared multipart upload key=JL69PUHT6NNT upload=MR0CTDYKMY3R tag=SHJ1GA69KS2T type=write size=3347550 2024-06-04T15:59:33.616 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.616+0000 7f5e9aacc780 1 < completed write operation key=Q2V1ICTBSCV1 tag=RQ6VS8P0UHNZ type=write size=816282 2024-06-04T15:59:33.618 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.617+0000 7f5e9aacc780 1 > prepared operation key=QUIVPH3OB6KN tag=33BE0JFC4AOT type=write size=278205 2024-06-04T15:59:33.619 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.619+0000 7f5e9aacc780 1 < completed delete operation key=4W5HB9WQQHR6 tag=EGEGWMG9M77K type=del 2024-06-04T15:59:33.621 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.620+0000 7f5e9aacc780 1 > prepared operation key=GTRMEQJK675Z tag=OEK6PXRZPU3E type=del size=2859479 2024-06-04T15:59:33.622 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.622+0000 7f5e9aacc780 1 < completed part key=_multipart_XH0N984YVGKP.2~E18PFZI0QLVD.0 size=1048576 2024-06-04T15:59:33.623 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.623+0000 7f5e9aacc780 1 < completed part key=_multipart_XH0N984YVGKP.2~E18PFZI0QLVD.1 size=1048576 2024-06-04T15:59:33.624 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.624+0000 7f5e9aacc780 1 < completed part key=_multipart_XH0N984YVGKP.2~E18PFZI0QLVD.2 size=800968 2024-06-04T15:59:33.627 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.626+0000 7f5e9aacc780 1 < completed multipart upload key=XH0N984YVGKP upload=E18PFZI0QLVD tag=7DSOJ138T1GD type=write size=3946696 2024-06-04T15:59:33.628 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.628+0000 7f5e9aacc780 1 > prepared operation key=GCPC9OJH7KWU tag=1F3JIHF0XN0K type=del size=3888509 2024-06-04T15:59:33.631 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.631+0000 7f5e9aacc780 1 < suggested remove operation key=HD6SNICRCDLL tag=U04EQBON77ML type=del 2024-06-04T15:59:33.634 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.634+0000 7f5e9aacc780 1 > prepared part key=_multipart_Q4OFQI0F5YLG.2~HCY1Q3K3K01H.0 size=1048576 2024-06-04T15:59:33.635 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.635+0000 7f5e9aacc780 1 > prepared part key=_multipart_Q4OFQI0F5YLG.2~HCY1Q3K3K01H.1 size=699416 2024-06-04T15:59:33.635 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.635+0000 7f5e9aacc780 1 > prepared multipart upload key=Q4OFQI0F5YLG upload=HCY1Q3K3K01H tag=EQC7CEXQVYJI type=write size=2796568 2024-06-04T15:59:33.638 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.638+0000 7f5e9aacc780 1 < suggested remove operation key=K01DAK0M4I4M tag=593YZNHFA7U7 type=del 2024-06-04T15:59:33.640 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.639+0000 7f5e9aacc780 1 > prepared operation key=HD6SNICRCDLL tag=UKEX0LDPZ4VQ type=del size=2607616 2024-06-04T15:59:33.642 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.642+0000 7f5e9aacc780 1 < completed part key=_multipart_QUIVPH3OB6KN.2~KLCYIAZ8FE00.0 size=431892 2024-06-04T15:59:33.644 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.644+0000 7f5e9aacc780 1 < completed multipart upload key=QUIVPH3OB6KN upload=KLCYIAZ8FE00 tag=L0IS6JR2HZRX type=write size=1480468 2024-06-04T15:59:33.646 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.645+0000 7f5e9aacc780 1 > prepared operation key=QUIVPH3OB6KN tag=XQL57C8W18DP type=del size=2678504 2024-06-04T15:59:33.646 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.646+0000 7f5e9aacc780 1 < canceled part key=_multipart_SUBHZJ7HUV3H.2~41IB6Z3LJWXQ.0 size=1048576 2024-06-04T15:59:33.647 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.647+0000 7f5e9aacc780 1 < completed part key=_multipart_SUBHZJ7HUV3H.2~41IB6Z3LJWXQ.1 size=407713 2024-06-04T15:59:33.649 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.649+0000 7f5e9aacc780 1 < canceled multipart upload key=SUBHZJ7HUV3H upload=41IB6Z3LJWXQ tag=ATJYDYD73JQL type=write size=2504865 2024-06-04T15:59:33.650 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.650+0000 7f5e9aacc780 1 > prepared operation key=HD6SNICRCDLL tag=TPJ4O8ZH5W6G type=del size=1888203 2024-06-04T15:59:33.652 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.652+0000 7f5e9aacc780 1 < completed delete operation key=PASGIP872OVX tag=TB2AX3AX7XIG type=del 2024-06-04T15:59:33.654 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.655+0000 7f5e9aacc780 1 > prepared part key=_multipart_03ZNYG3WLMP4.2~3X6I8IHEDKWJ.0 size=900508 2024-06-04T15:59:33.655 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.655+0000 7f5e9aacc780 1 > prepared multipart upload key=03ZNYG3WLMP4 upload=3X6I8IHEDKWJ tag=LWJFXGKIFSMI type=write size=1949084 2024-06-04T15:59:33.656 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.656+0000 7f5e9aacc780 1 < completed part key=_multipart_1IKNQXU3Y2JJ.2~IDNYN0IT58T6.0 size=1048576 2024-06-04T15:59:33.657 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.657+0000 7f5e9aacc780 1 < completed part key=_multipart_1IKNQXU3Y2JJ.2~IDNYN0IT58T6.1 size=1048576 2024-06-04T15:59:33.659 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.658+0000 7f5e9aacc780 1 < completed part key=_multipart_1IKNQXU3Y2JJ.2~IDNYN0IT58T6.2 size=921915 2024-06-04T15:59:33.661 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.661+0000 7f5e9aacc780 1 < completed multipart upload key=1IKNQXU3Y2JJ upload=IDNYN0IT58T6 tag=VC5BH5680A8R type=write size=4067643 2024-06-04T15:59:33.662 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.662+0000 7f5e9aacc780 1 > prepared operation key=XH0N984YVGKP tag=8C0EXBSL2TMK type=del size=3167986 2024-06-04T15:59:33.663 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.663+0000 7f5e9aacc780 1 < completed part key=_multipart_RP8K6QJUZAH1.2~D6ZLTJMDOTVX.0 size=1048576 2024-06-04T15:59:33.663 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.663+0000 7f5e9aacc780 1 < canceled part key=_multipart_RP8K6QJUZAH1.2~D6ZLTJMDOTVX.1 size=700943 2024-06-04T15:59:33.666 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.666+0000 7f5e9aacc780 1 < canceled multipart upload key=RP8K6QJUZAH1 upload=D6ZLTJMDOTVX tag=TKHXY5OAS0KX type=write size=2798095 2024-06-04T15:59:33.668 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.667+0000 7f5e9aacc780 1 > prepared operation key=PCLJXQHJ4HTY tag=I22933QEPT4Y type=del size=2344471 2024-06-04T15:59:33.670 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.670+0000 7f5e9aacc780 1 < suggested update operation key=JL69PUHT6NNT tag=L4YVWKOBRJZH type=del size=1214547 2024-06-04T15:59:33.673 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.673+0000 7f5e9aacc780 1 > prepared part key=_multipart_QJA2JPATITNH.2~04Y8PSNGUVS7.0 size=1048576 2024-06-04T15:59:33.674 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.674+0000 7f5e9aacc780 1 > prepared part key=_multipart_QJA2JPATITNH.2~04Y8PSNGUVS7.1 size=1048576 2024-06-04T15:59:33.675 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.675+0000 7f5e9aacc780 1 > prepared part key=_multipart_QJA2JPATITNH.2~04Y8PSNGUVS7.2 size=815473 2024-06-04T15:59:33.675 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.675+0000 7f5e9aacc780 1 > prepared multipart upload key=QJA2JPATITNH upload=04Y8PSNGUVS7 tag=MSOPLP8N2VHQ type=write size=3961201 2024-06-04T15:59:33.677 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.677+0000 7f5e9aacc780 1 < completed delete operation key=TUGKW7F4V9NO tag=2CCVKEQXLP0P type=del 2024-06-04T15:59:33.679 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.679+0000 7f5e9aacc780 1 > prepared operation key=PNDPO2WUW7UX tag=WWL195OMVZ8R type=del size=469858 2024-06-04T15:59:33.680 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.680+0000 7f5e9aacc780 1 < canceled operation key=RP8K6QJUZAH1 tag=5ZP09DVBNPA5 type=del size=3755272 2024-06-04T15:59:33.682 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.682+0000 7f5e9aacc780 1 > prepared operation key=DY9JWHWNAUO1 tag=K630K3CSTMY3 type=del size=2760761 2024-06-04T15:59:33.683 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.683+0000 7f5e9aacc780 1 < canceled operation key=W1T4O3EAE7JN tag=8YRL344J0AM3 type=del size=902576 2024-06-04T15:59:33.685 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.684+0000 7f5e9aacc780 1 > prepared operation key=UW5LVIBG09SV tag=F739S1WUCRYL type=del size=3652692 2024-06-04T15:59:33.686 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.686+0000 7f5e9aacc780 1 < completed part key=_multipart_Q2V1ICTBSCV1.2~ATZR9DRQ05SW.0 size=1048576 2024-06-04T15:59:33.687 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.687+0000 7f5e9aacc780 1 < completed part key=_multipart_Q2V1ICTBSCV1.2~ATZR9DRQ05SW.1 size=1048576 2024-06-04T15:59:33.689 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.688+0000 7f5e9aacc780 1 < completed part key=_multipart_Q2V1ICTBSCV1.2~ATZR9DRQ05SW.2 size=511258 2024-06-04T15:59:33.691 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.691+0000 7f5e9aacc780 1 < completed multipart upload key=Q2V1ICTBSCV1 upload=ATZR9DRQ05SW tag=96FGNMOYPBE7 type=write size=3656986 2024-06-04T15:59:33.694 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.694+0000 7f5e9aacc780 1 > prepared part key=_multipart_03ZNYG3WLMP4.2~YB68XGT22PJY.0 size=1048576 2024-06-04T15:59:33.698 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.695+0000 7f5e9aacc780 1 > prepared part key=_multipart_03ZNYG3WLMP4.2~YB68XGT22PJY.1 size=1048576 2024-06-04T15:59:33.698 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.696+0000 7f5e9aacc780 1 > prepared part key=_multipart_03ZNYG3WLMP4.2~YB68XGT22PJY.2 size=5810 2024-06-04T15:59:33.698 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.696+0000 7f5e9aacc780 1 > prepared multipart upload key=03ZNYG3WLMP4 upload=YB68XGT22PJY tag=DOPI7M71231S type=write size=3151538 2024-06-04T15:59:33.698 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.697+0000 7f5e9aacc780 1 < completed part key=_multipart_JL69PUHT6NNT.2~MR0CTDYKMY3R.0 size=1048576 2024-06-04T15:59:33.699 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.698+0000 7f5e9aacc780 1 < completed part key=_multipart_JL69PUHT6NNT.2~MR0CTDYKMY3R.1 size=1048576 2024-06-04T15:59:33.700 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.700+0000 7f5e9aacc780 1 < completed part key=_multipart_JL69PUHT6NNT.2~MR0CTDYKMY3R.2 size=201822 2024-06-04T15:59:33.702 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.702+0000 7f5e9aacc780 1 < completed multipart upload key=JL69PUHT6NNT upload=MR0CTDYKMY3R tag=SHJ1GA69KS2T type=write size=3347550 2024-06-04T15:59:33.704 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.704+0000 7f5e9aacc780 1 > prepared operation key=B0HK5FJ2RGJE tag=ESZDLPL7VUJ0 type=del size=183255 2024-06-04T15:59:33.706 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.706+0000 7f5e9aacc780 1 < completed write operation key=QUIVPH3OB6KN tag=33BE0JFC4AOT type=write size=278205 2024-06-04T15:59:33.709 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.709+0000 7f5e9aacc780 1 > prepared part key=_multipart_XH0N984YVGKP.2~0KUMEXESIR23.0 size=1048576 2024-06-04T15:59:33.710 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.710+0000 7f5e9aacc780 1 > prepared part key=_multipart_XH0N984YVGKP.2~0KUMEXESIR23.1 size=409608 2024-06-04T15:59:33.710 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.710+0000 7f5e9aacc780 1 > prepared multipart upload key=XH0N984YVGKP upload=0KUMEXESIR23 tag=TO5MV8KBBAUE type=write size=2506760 2024-06-04T15:59:33.713 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.713+0000 7f5e9aacc780 1 < suggested remove operation key=GTRMEQJK675Z tag=OEK6PXRZPU3E type=del 2024-06-04T15:59:33.715 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.714+0000 7f5e9aacc780 1 > prepared operation key=Q4OFQI0F5YLG tag=229F8Q3KZILU type=del size=3307446 2024-06-04T15:59:33.716 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.716+0000 7f5e9aacc780 1 < completed delete operation key=GCPC9OJH7KWU tag=1F3JIHF0XN0K type=del 2024-06-04T15:59:33.718 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.718+0000 7f5e9aacc780 1 > prepared operation key=TUGKW7F4V9NO tag=PEF58XV6XW8X type=del size=3548029 2024-06-04T15:59:33.719 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.719+0000 7f5e9aacc780 1 < completed part key=_multipart_Q4OFQI0F5YLG.2~HCY1Q3K3K01H.0 size=1048576 2024-06-04T15:59:33.721 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.721+0000 7f5e9aacc780 1 < completed part key=_multipart_Q4OFQI0F5YLG.2~HCY1Q3K3K01H.1 size=699416 2024-06-04T15:59:33.723 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.723+0000 7f5e9aacc780 1 < completed multipart upload key=Q4OFQI0F5YLG upload=HCY1Q3K3K01H tag=EQC7CEXQVYJI type=write size=2796568 2024-06-04T15:59:33.726 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.726+0000 7f5e9aacc780 1 > prepared part key=_multipart_Q4OFQI0F5YLG.2~2RBLI5MEQ7RP.0 size=1048576 2024-06-04T15:59:33.727 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.727+0000 7f5e9aacc780 1 > prepared part key=_multipart_Q4OFQI0F5YLG.2~2RBLI5MEQ7RP.1 size=1048576 2024-06-04T15:59:33.728 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.728+0000 7f5e9aacc780 1 > prepared part key=_multipart_Q4OFQI0F5YLG.2~2RBLI5MEQ7RP.2 size=493749 2024-06-04T15:59:33.728 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.728+0000 7f5e9aacc780 1 > prepared multipart upload key=Q4OFQI0F5YLG upload=2RBLI5MEQ7RP tag=EZUILBUBNRFQ type=write size=3639477 2024-06-04T15:59:33.732 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.732+0000 7f5e9aacc780 1 < suggested remove operation key=HD6SNICRCDLL tag=UKEX0LDPZ4VQ type=del 2024-06-04T15:59:33.735 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.734+0000 7f5e9aacc780 1 > prepared part key=_multipart_UW5LVIBG09SV.2~65540Y7U5F9L.0 size=1048576 2024-06-04T15:59:33.736 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.735+0000 7f5e9aacc780 1 > prepared part key=_multipart_UW5LVIBG09SV.2~65540Y7U5F9L.1 size=709907 2024-06-04T15:59:33.736 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.735+0000 7f5e9aacc780 1 > prepared multipart upload key=UW5LVIBG09SV upload=65540Y7U5F9L tag=JEPX526E4SXE type=write size=2807059 2024-06-04T15:59:33.739 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.739+0000 7f5e9aacc780 1 < suggested update operation key=QUIVPH3OB6KN tag=XQL57C8W18DP type=del size=2678504 2024-06-04T15:59:33.740 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.740+0000 7f5e9aacc780 1 > prepared operation key=PASGIP872OVX tag=5W7ZW7ZQNXC6 type=del size=3439892 2024-06-04T15:59:33.742 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.741+0000 7f5e9aacc780 -1 < failed to complete operation key=HD6SNICRCDLL tag=TPJ4O8ZH5W6G type=del size=1888203: (22) Invalid argument 2024-06-04T15:59:33.743 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.743+0000 7f5e9aacc780 1 > prepared operation key=A8O0S3S45RGM tag=05BIEBTAS41O type=del size=2209172 2024-06-04T15:59:33.743 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.743+0000 7f5e9aacc780 1 < canceled part key=_multipart_03ZNYG3WLMP4.2~3X6I8IHEDKWJ.0 size=900508 2024-06-04T15:59:33.745 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.745+0000 7f5e9aacc780 1 < canceled multipart upload key=03ZNYG3WLMP4 upload=3X6I8IHEDKWJ tag=LWJFXGKIFSMI type=write size=1949084 2024-06-04T15:59:33.747 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.746+0000 7f5e9aacc780 1 > prepared operation key=1IKNQXU3Y2JJ tag=V8UZJ8RD6YFJ type=write size=385416 2024-06-04T15:59:33.748 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.748+0000 7f5e9aacc780 1 < completed delete operation key=XH0N984YVGKP tag=8C0EXBSL2TMK type=del 2024-06-04T15:59:33.750 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.750+0000 7f5e9aacc780 1 > prepared operation key=UW5LVIBG09SV tag=RPX74RIRZ8DI type=del size=1827911 2024-06-04T15:59:33.752 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.751+0000 7f5e9aacc780 1 < completed delete operation key=PCLJXQHJ4HTY tag=I22933QEPT4Y type=del 2024-06-04T15:59:33.754 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.754+0000 7f5e9aacc780 1 > prepared part key=_multipart_Q4OFQI0F5YLG.2~T1Z28F1C65HS.0 size=1048576 2024-06-04T15:59:33.755 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.755+0000 7f5e9aacc780 1 > prepared part key=_multipart_Q4OFQI0F5YLG.2~T1Z28F1C65HS.1 size=1026586 2024-06-04T15:59:33.755 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.755+0000 7f5e9aacc780 1 > prepared multipart upload key=Q4OFQI0F5YLG upload=T1Z28F1C65HS tag=K6XM4SI93HID type=write size=3123738 2024-06-04T15:59:33.757 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.756+0000 7f5e9aacc780 1 < completed part key=_multipart_QJA2JPATITNH.2~04Y8PSNGUVS7.0 size=1048576 2024-06-04T15:59:33.758 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.757+0000 7f5e9aacc780 1 < completed part key=_multipart_QJA2JPATITNH.2~04Y8PSNGUVS7.1 size=1048576 2024-06-04T15:59:33.758 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.757+0000 7f5e9aacc780 1 < canceled part key=_multipart_QJA2JPATITNH.2~04Y8PSNGUVS7.2 size=815473 2024-06-04T15:59:33.760 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.759+0000 7f5e9aacc780 1 < canceled multipart upload key=QJA2JPATITNH upload=04Y8PSNGUVS7 tag=MSOPLP8N2VHQ type=write size=3961201 2024-06-04T15:59:33.761 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.761+0000 7f5e9aacc780 1 > prepared operation key=QUIVPH3OB6KN tag=GVLXZEMG4DKB type=del size=243394 2024-06-04T15:59:33.763 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.762+0000 7f5e9aacc780 1 < completed delete operation key=PNDPO2WUW7UX tag=WWL195OMVZ8R type=del 2024-06-04T15:59:33.765 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.765+0000 7f5e9aacc780 1 > prepared part key=_multipart_QUIVPH3OB6KN.2~BV2U153BH9EK.0 size=520339 2024-06-04T15:59:33.765 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.765+0000 7f5e9aacc780 1 > prepared multipart upload key=QUIVPH3OB6KN upload=BV2U153BH9EK tag=XOQ0E879T8Z4 type=write size=1568915 2024-06-04T15:59:33.767 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.766+0000 7f5e9aacc780 1 < completed delete operation key=DY9JWHWNAUO1 tag=K630K3CSTMY3 type=del 2024-06-04T15:59:33.769 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.769+0000 7f5e9aacc780 1 > prepared part key=_multipart_RP8K6QJUZAH1.2~ZNEW02FZX84J.0 size=931898 2024-06-04T15:59:33.769 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.769+0000 7f5e9aacc780 1 > prepared multipart upload key=RP8K6QJUZAH1 upload=ZNEW02FZX84J tag=U7Y41U5W3TIC type=write size=1980474 2024-06-04T15:59:33.771 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.770+0000 7f5e9aacc780 1 < completed delete operation key=UW5LVIBG09SV tag=F739S1WUCRYL type=del 2024-06-04T15:59:33.772 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.772+0000 7f5e9aacc780 1 > prepared operation key=1IKNQXU3Y2JJ tag=CLJWDYVE33PZ type=del size=3713317 2024-06-04T15:59:33.773 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.773+0000 7f5e9aacc780 1 < completed part key=_multipart_03ZNYG3WLMP4.2~YB68XGT22PJY.0 size=1048576 2024-06-04T15:59:33.775 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.774+0000 7f5e9aacc780 1 < completed part key=_multipart_03ZNYG3WLMP4.2~YB68XGT22PJY.1 size=1048576 2024-06-04T15:59:33.776 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.776+0000 7f5e9aacc780 1 < completed part key=_multipart_03ZNYG3WLMP4.2~YB68XGT22PJY.2 size=5810 2024-06-04T15:59:33.779 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.778+0000 7f5e9aacc780 1 < completed multipart upload key=03ZNYG3WLMP4 upload=YB68XGT22PJY tag=DOPI7M71231S type=write size=3151538 2024-06-04T15:59:33.780 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.780+0000 7f5e9aacc780 1 > prepared operation key=XH0N984YVGKP tag=WI6120C61TSZ type=del size=23125 2024-06-04T15:59:33.781 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.781+0000 7f5e9aacc780 1 < completed delete operation key=B0HK5FJ2RGJE tag=ESZDLPL7VUJ0 type=del 2024-06-04T15:59:33.783 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.782+0000 7f5e9aacc780 1 > prepared operation key=1IKNQXU3Y2JJ tag=R165YNTIDUQ4 type=del size=1450566 2024-06-04T15:59:33.784 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.784+0000 7f5e9aacc780 1 < completed part key=_multipart_XH0N984YVGKP.2~0KUMEXESIR23.0 size=1048576 2024-06-04T15:59:33.785 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.785+0000 7f5e9aacc780 1 < completed part key=_multipart_XH0N984YVGKP.2~0KUMEXESIR23.1 size=409608 2024-06-04T15:59:33.788 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.787+0000 7f5e9aacc780 1 < completed multipart upload key=XH0N984YVGKP upload=0KUMEXESIR23 tag=TO5MV8KBBAUE type=write size=2506760 2024-06-04T15:59:33.789 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.789+0000 7f5e9aacc780 1 > prepared operation key=GCPC9OJH7KWU tag=A3I5PS21D6EQ type=del size=3155668 2024-06-04T15:59:33.790 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.790+0000 7f5e9aacc780 1 < completed delete operation key=Q4OFQI0F5YLG tag=229F8Q3KZILU type=del 2024-06-04T15:59:33.792 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.792+0000 7f5e9aacc780 1 > prepared operation key=NHPH4LYPP0LL tag=3R0HIMBZA4KK type=write size=319703 2024-06-04T15:59:33.794 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.793+0000 7f5e9aacc780 1 < completed delete operation key=TUGKW7F4V9NO tag=PEF58XV6XW8X type=del 2024-06-04T15:59:33.797 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.796+0000 7f5e9aacc780 1 > prepared part key=_multipart_B0HK5FJ2RGJE.2~QT6QDK50I7GB.0 size=1048576 2024-06-04T15:59:33.798 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.797+0000 7f5e9aacc780 1 > prepared part key=_multipart_B0HK5FJ2RGJE.2~QT6QDK50I7GB.1 size=1048576 2024-06-04T15:59:33.799 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.799+0000 7f5e9aacc780 1 > prepared part key=_multipart_B0HK5FJ2RGJE.2~QT6QDK50I7GB.2 size=302428 2024-06-04T15:59:33.799 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.799+0000 7f5e9aacc780 1 > prepared multipart upload key=B0HK5FJ2RGJE upload=QT6QDK50I7GB tag=Y57OS4Q6TH12 type=write size=3448156 2024-06-04T15:59:33.800 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.800+0000 7f5e9aacc780 1 < completed part key=_multipart_Q4OFQI0F5YLG.2~2RBLI5MEQ7RP.0 size=1048576 2024-06-04T15:59:33.801 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.801+0000 7f5e9aacc780 1 < completed part key=_multipart_Q4OFQI0F5YLG.2~2RBLI5MEQ7RP.1 size=1048576 2024-06-04T15:59:33.802 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.801+0000 7f5e9aacc780 1 < canceled part key=_multipart_Q4OFQI0F5YLG.2~2RBLI5MEQ7RP.2 size=493749 2024-06-04T15:59:33.804 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.803+0000 7f5e9aacc780 1 < canceled multipart upload key=Q4OFQI0F5YLG upload=2RBLI5MEQ7RP tag=EZUILBUBNRFQ type=write size=3639477 2024-06-04T15:59:33.806 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.805+0000 7f5e9aacc780 1 > prepared operation key=UW5LVIBG09SV tag=V3KPS7KRTO2D type=del size=3856758 2024-06-04T15:59:33.807 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.808+0000 7f5e9aacc780 1 < completed part key=_multipart_UW5LVIBG09SV.2~65540Y7U5F9L.0 size=1048576 2024-06-04T15:59:33.808 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.808+0000 7f5e9aacc780 1 < canceled part key=_multipart_UW5LVIBG09SV.2~65540Y7U5F9L.1 size=709907 2024-06-04T15:59:33.810 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.810+0000 7f5e9aacc780 1 < canceled multipart upload key=UW5LVIBG09SV upload=65540Y7U5F9L tag=JEPX526E4SXE type=write size=2807059 2024-06-04T15:59:33.813 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.812+0000 7f5e9aacc780 1 > prepared part key=_multipart_9MPRI6LW3956.2~B5W0SOT6DO4O.0 size=1048576 2024-06-04T15:59:33.814 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.814+0000 7f5e9aacc780 1 > prepared part key=_multipart_9MPRI6LW3956.2~B5W0SOT6DO4O.1 size=1048576 2024-06-04T15:59:33.815 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.815+0000 7f5e9aacc780 1 > prepared part key=_multipart_9MPRI6LW3956.2~B5W0SOT6DO4O.2 size=811640 2024-06-04T15:59:33.815 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.815+0000 7f5e9aacc780 1 > prepared multipart upload key=9MPRI6LW3956 upload=B5W0SOT6DO4O tag=8VWQDINF2D1X type=write size=3957368 2024-06-04T15:59:33.816 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.817+0000 7f5e9aacc780 1 < completed delete operation key=PASGIP872OVX tag=5W7ZW7ZQNXC6 type=del 2024-06-04T15:59:33.818 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.818+0000 7f5e9aacc780 1 > prepared operation key=NJ5U8JTT32QK tag=30F1N91MRAUB type=del size=3573423 2024-06-04T15:59:33.820 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.819+0000 7f5e9aacc780 1 < canceled operation key=A8O0S3S45RGM tag=05BIEBTAS41O type=del size=2209172 2024-06-04T15:59:33.822 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.821+0000 7f5e9aacc780 1 > prepared operation key=RP8K6QJUZAH1 tag=46JSCNEST72U type=del size=1719624 2024-06-04T15:59:33.824 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.824+0000 7f5e9aacc780 1 < suggested remove operation key=1IKNQXU3Y2JJ tag=V8UZJ8RD6YFJ type=write 2024-06-04T15:59:33.826 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.825+0000 7f5e9aacc780 1 > prepared operation key=2BT2AXKB1RTA tag=18289F6VD68O type=write size=578675 2024-06-04T15:59:33.829 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.829+0000 7f5e9aacc780 1 < suggested remove operation key=UW5LVIBG09SV tag=RPX74RIRZ8DI type=del 2024-06-04T15:59:33.831 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.830+0000 7f5e9aacc780 1 > prepared operation key=B0HK5FJ2RGJE tag=L5DNDGOA62Z2 type=write size=272045 2024-06-04T15:59:33.832 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.832+0000 7f5e9aacc780 1 < completed part key=_multipart_Q4OFQI0F5YLG.2~T1Z28F1C65HS.0 size=1048576 2024-06-04T15:59:33.833 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.833+0000 7f5e9aacc780 1 < completed part key=_multipart_Q4OFQI0F5YLG.2~T1Z28F1C65HS.1 size=1026586 2024-06-04T15:59:33.836 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.835+0000 7f5e9aacc780 1 < completed multipart upload key=Q4OFQI0F5YLG upload=T1Z28F1C65HS tag=K6XM4SI93HID type=write size=3123738 2024-06-04T15:59:33.838 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.838+0000 7f5e9aacc780 1 > prepared part key=_multipart_NHPH4LYPP0LL.2~527HOOG0Q2R6.0 size=1048576 2024-06-04T15:59:33.839 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.840+0000 7f5e9aacc780 1 > prepared part key=_multipart_NHPH4LYPP0LL.2~527HOOG0Q2R6.1 size=1048576 2024-06-04T15:59:33.841 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.841+0000 7f5e9aacc780 1 > prepared part key=_multipart_NHPH4LYPP0LL.2~527HOOG0Q2R6.2 size=859301 2024-06-04T15:59:33.841 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.841+0000 7f5e9aacc780 1 > prepared multipart upload key=NHPH4LYPP0LL upload=527HOOG0Q2R6 tag=Z9UCESM5RLDV type=write size=4005029 2024-06-04T15:59:33.844 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.843+0000 7f5e9aacc780 1 < suggested remove operation key=QUIVPH3OB6KN tag=GVLXZEMG4DKB type=del 2024-06-04T15:59:33.845 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.845+0000 7f5e9aacc780 1 > prepared operation key=03ZNYG3WLMP4 tag=5VF4GCNNB30B type=del size=3665671 2024-06-04T15:59:33.845 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.845+0000 7f5e9aacc780 1 < canceled part key=_multipart_QUIVPH3OB6KN.2~BV2U153BH9EK.0 size=520339 2024-06-04T15:59:33.848 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.847+0000 7f5e9aacc780 1 < canceled multipart upload key=QUIVPH3OB6KN upload=BV2U153BH9EK tag=XOQ0E879T8Z4 type=write size=1568915 2024-06-04T15:59:33.850 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.850+0000 7f5e9aacc780 1 > prepared part key=_multipart_PASGIP872OVX.2~A31MO1B0ZI5L.0 size=1048576 2024-06-04T15:59:33.851 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.851+0000 7f5e9aacc780 1 > prepared part key=_multipart_PASGIP872OVX.2~A31MO1B0ZI5L.1 size=1048576 2024-06-04T15:59:33.853 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.852+0000 7f5e9aacc780 1 > prepared part key=_multipart_PASGIP872OVX.2~A31MO1B0ZI5L.2 size=109175 2024-06-04T15:59:33.853 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.852+0000 7f5e9aacc780 1 > prepared multipart upload key=PASGIP872OVX upload=A31MO1B0ZI5L tag=QOX4X8C5T4P9 type=write size=3254903 2024-06-04T15:59:33.854 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.854+0000 7f5e9aacc780 1 < completed part key=_multipart_RP8K6QJUZAH1.2~ZNEW02FZX84J.0 size=931898 2024-06-04T15:59:33.857 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.857+0000 7f5e9aacc780 1 < completed multipart upload key=RP8K6QJUZAH1 upload=ZNEW02FZX84J tag=U7Y41U5W3TIC type=write size=1980474 2024-06-04T15:59:33.859 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.859+0000 7f5e9aacc780 1 > prepared part key=_multipart_1IKNQXU3Y2JJ.2~EMEMA1IN1MCN.0 size=119075 2024-06-04T15:59:33.859 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.859+0000 7f5e9aacc780 1 > prepared multipart upload key=1IKNQXU3Y2JJ upload=EMEMA1IN1MCN tag=SO4BSM23VCE5 type=write size=1167651 2024-06-04T15:59:33.861 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.861+0000 7f5e9aacc780 -1 < failed to complete operation key=1IKNQXU3Y2JJ tag=CLJWDYVE33PZ type=del size=3713317: (22) Invalid argument 2024-06-04T15:59:33.862 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.862+0000 7f5e9aacc780 1 > prepared operation key=B0HK5FJ2RGJE tag=UG19O5FBF78U type=write size=736894 2024-06-04T15:59:33.864 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.864+0000 7f5e9aacc780 1 < canceled operation key=XH0N984YVGKP tag=WI6120C61TSZ type=del size=23125 2024-06-04T15:59:33.865 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.865+0000 7f5e9aacc780 1 > prepared operation key=Q2V1ICTBSCV1 tag=JGRNZI8H2C9N type=del size=1189445 2024-06-04T15:59:33.867 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.867+0000 7f5e9aacc780 -1 < failed to complete operation key=1IKNQXU3Y2JJ tag=R165YNTIDUQ4 type=del size=1450566: (22) Invalid argument 2024-06-04T15:59:33.869 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.869+0000 7f5e9aacc780 1 > prepared operation key=HD6SNICRCDLL tag=TU8UAPVCTK6C type=del size=608059 2024-06-04T15:59:33.871 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.871+0000 7f5e9aacc780 1 < completed delete operation key=GCPC9OJH7KWU tag=A3I5PS21D6EQ type=del 2024-06-04T15:59:33.873 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.873+0000 7f5e9aacc780 1 > prepared part key=_multipart_4W5HB9WQQHR6.2~DYJR5QX41NZ7.0 size=812680 2024-06-04T15:59:33.874 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.873+0000 7f5e9aacc780 1 > prepared multipart upload key=4W5HB9WQQHR6 upload=DYJR5QX41NZ7 tag=L0E5UOUALZAU type=write size=1861256 2024-06-04T15:59:33.875 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.875+0000 7f5e9aacc780 1 < completed write operation key=NHPH4LYPP0LL tag=3R0HIMBZA4KK type=write size=319703 2024-06-04T15:59:33.876 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.876+0000 7f5e9aacc780 1 > prepared operation key=SUBHZJ7HUV3H tag=EPR7V7TH18SZ type=write size=710555 2024-06-04T15:59:33.878 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.878+0000 7f5e9aacc780 1 < completed part key=_multipart_B0HK5FJ2RGJE.2~QT6QDK50I7GB.0 size=1048576 2024-06-04T15:59:33.879 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.879+0000 7f5e9aacc780 1 < completed part key=_multipart_B0HK5FJ2RGJE.2~QT6QDK50I7GB.1 size=1048576 2024-06-04T15:59:33.880 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.881+0000 7f5e9aacc780 1 < completed part key=_multipart_B0HK5FJ2RGJE.2~QT6QDK50I7GB.2 size=302428 2024-06-04T15:59:33.883 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.883+0000 7f5e9aacc780 1 < completed multipart upload key=B0HK5FJ2RGJE upload=QT6QDK50I7GB tag=Y57OS4Q6TH12 type=write size=3448156 2024-06-04T15:59:33.884 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.884+0000 7f5e9aacc780 1 > prepared operation key=7S9S3MIG7WIT tag=JKMHFWP31R60 type=write size=1035098 2024-06-04T15:59:33.886 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.886+0000 7f5e9aacc780 -1 < failed to complete operation key=UW5LVIBG09SV tag=V3KPS7KRTO2D type=del size=3856758: (22) Invalid argument 2024-06-04T15:59:33.888 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.887+0000 7f5e9aacc780 1 > prepared operation key=RP8K6QJUZAH1 tag=UYQRM4GTH9AQ type=write size=291421 2024-06-04T15:59:33.889 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.889+0000 7f5e9aacc780 1 < completed part key=_multipart_9MPRI6LW3956.2~B5W0SOT6DO4O.0 size=1048576 2024-06-04T15:59:33.890 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.890+0000 7f5e9aacc780 1 < completed part key=_multipart_9MPRI6LW3956.2~B5W0SOT6DO4O.1 size=1048576 2024-06-04T15:59:33.891 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.891+0000 7f5e9aacc780 1 < completed part key=_multipart_9MPRI6LW3956.2~B5W0SOT6DO4O.2 size=811640 2024-06-04T15:59:33.894 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.894+0000 7f5e9aacc780 1 < completed multipart upload key=9MPRI6LW3956 upload=B5W0SOT6DO4O tag=8VWQDINF2D1X type=write size=3957368 2024-06-04T15:59:33.897 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.897+0000 7f5e9aacc780 1 > prepared part key=_multipart_SUBHZJ7HUV3H.2~IP5AT4O2RQCM.0 size=428433 2024-06-04T15:59:33.897 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.897+0000 7f5e9aacc780 1 > prepared multipart upload key=SUBHZJ7HUV3H upload=IP5AT4O2RQCM tag=RYT6OLT8920Y type=write size=1477009 2024-06-04T15:59:33.899 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.899+0000 7f5e9aacc780 1 < completed delete operation key=NJ5U8JTT32QK tag=30F1N91MRAUB type=del 2024-06-04T15:59:33.900 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.900+0000 7f5e9aacc780 1 > prepared operation key=Q2V1ICTBSCV1 tag=GS1D32NKUH0A type=write size=214704 2024-06-04T15:59:33.902 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.902+0000 7f5e9aacc780 1 < completed delete operation key=RP8K6QJUZAH1 tag=46JSCNEST72U type=del 2024-06-04T15:59:33.904 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.903+0000 7f5e9aacc780 1 > prepared operation key=2BT2AXKB1RTA tag=TYTHOK1D3N51 type=write size=286517 2024-06-04T15:59:33.905 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.905+0000 7f5e9aacc780 1 < completed write operation key=2BT2AXKB1RTA tag=18289F6VD68O type=write size=578675 2024-06-04T15:59:33.906 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.906+0000 7f5e9aacc780 1 > prepared operation key=Q4OFQI0F5YLG tag=X8ZSMVLZWIOZ type=write size=1025770 2024-06-04T15:59:33.908 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.908+0000 7f5e9aacc780 1 < completed write operation key=B0HK5FJ2RGJE tag=L5DNDGOA62Z2 type=write size=272045 2024-06-04T15:59:33.910 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.910+0000 7f5e9aacc780 1 > prepared part key=_multipart_NHPH4LYPP0LL.2~JEOZ1BVVFXRN.0 size=138874 2024-06-04T15:59:33.911 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.910+0000 7f5e9aacc780 1 > prepared multipart upload key=NHPH4LYPP0LL upload=JEOZ1BVVFXRN tag=Y5HF520UKG3Y type=write size=1187450 2024-06-04T15:59:33.912 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.912+0000 7f5e9aacc780 1 < completed part key=_multipart_NHPH4LYPP0LL.2~527HOOG0Q2R6.0 size=1048576 2024-06-04T15:59:33.913 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.913+0000 7f5e9aacc780 1 < completed part key=_multipart_NHPH4LYPP0LL.2~527HOOG0Q2R6.1 size=1048576 2024-06-04T15:59:33.914 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.914+0000 7f5e9aacc780 1 < completed part key=_multipart_NHPH4LYPP0LL.2~527HOOG0Q2R6.2 size=859301 2024-06-04T15:59:33.917 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.917+0000 7f5e9aacc780 1 < completed multipart upload key=NHPH4LYPP0LL upload=527HOOG0Q2R6 tag=Z9UCESM5RLDV type=write size=4005029 2024-06-04T15:59:33.919 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.919+0000 7f5e9aacc780 1 > prepared part key=_multipart_RP8K6QJUZAH1.2~EFBR3ZPU2WLX.0 size=1048576 2024-06-04T15:59:33.920 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.920+0000 7f5e9aacc780 1 > prepared part key=_multipart_RP8K6QJUZAH1.2~EFBR3ZPU2WLX.1 size=483849 2024-06-04T15:59:33.920 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.920+0000 7f5e9aacc780 1 > prepared multipart upload key=RP8K6QJUZAH1 upload=EFBR3ZPU2WLX tag=74FE178NXOHW type=write size=2581001 2024-06-04T15:59:33.923 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.923+0000 7f5e9aacc780 1 < suggested update operation key=03ZNYG3WLMP4 tag=5VF4GCNNB30B type=del size=3665671 2024-06-04T15:59:33.926 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.925+0000 7f5e9aacc780 1 > prepared part key=_multipart_DY9JWHWNAUO1.2~A7R702N9HJ0J.0 size=1048576 2024-06-04T15:59:33.926 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.926+0000 7f5e9aacc780 1 > prepared part key=_multipart_DY9JWHWNAUO1.2~A7R702N9HJ0J.1 size=1048576 2024-06-04T15:59:33.928 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.927+0000 7f5e9aacc780 1 > prepared part key=_multipart_DY9JWHWNAUO1.2~A7R702N9HJ0J.2 size=46349 2024-06-04T15:59:33.928 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.927+0000 7f5e9aacc780 1 > prepared multipart upload key=DY9JWHWNAUO1 upload=A7R702N9HJ0J tag=VW2TXVBEWPF2 type=write size=3192077 2024-06-04T15:59:33.929 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.929+0000 7f5e9aacc780 1 < completed part key=_multipart_PASGIP872OVX.2~A31MO1B0ZI5L.0 size=1048576 2024-06-04T15:59:33.930 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.930+0000 7f5e9aacc780 1 < completed part key=_multipart_PASGIP872OVX.2~A31MO1B0ZI5L.1 size=1048576 2024-06-04T15:59:33.931 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.931+0000 7f5e9aacc780 1 < completed part key=_multipart_PASGIP872OVX.2~A31MO1B0ZI5L.2 size=109175 2024-06-04T15:59:33.934 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.933+0000 7f5e9aacc780 1 < completed multipart upload key=PASGIP872OVX upload=A31MO1B0ZI5L tag=QOX4X8C5T4P9 type=write size=3254903 2024-06-04T15:59:33.935 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.935+0000 7f5e9aacc780 1 > prepared operation key=XH0N984YVGKP tag=2PG9NXRIGDRJ type=del size=1251261 2024-06-04T15:59:33.937 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.936+0000 7f5e9aacc780 1 < completed part key=_multipart_1IKNQXU3Y2JJ.2~EMEMA1IN1MCN.0 size=119075 2024-06-04T15:59:33.939 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.938+0000 7f5e9aacc780 1 < completed multipart upload key=1IKNQXU3Y2JJ upload=EMEMA1IN1MCN tag=SO4BSM23VCE5 type=write size=1167651 2024-06-04T15:59:33.940 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.940+0000 7f5e9aacc780 1 > prepared operation key=7S9S3MIG7WIT tag=5T4V4PIPIN3A type=write size=379562 2024-06-04T15:59:33.942 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.941+0000 7f5e9aacc780 1 < completed write operation key=B0HK5FJ2RGJE tag=UG19O5FBF78U type=write size=736894 2024-06-04T15:59:33.944 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.944+0000 7f5e9aacc780 1 > prepared part key=_multipart_PNDPO2WUW7UX.2~8BEDU4B9YHXE.0 size=322344 2024-06-04T15:59:33.944 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.944+0000 7f5e9aacc780 1 > prepared multipart upload key=PNDPO2WUW7UX upload=8BEDU4B9YHXE tag=F27XMWEILVIN type=write size=1370920 2024-06-04T15:59:33.946 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.945+0000 7f5e9aacc780 1 < completed delete operation key=Q2V1ICTBSCV1 tag=JGRNZI8H2C9N type=del 2024-06-04T15:59:33.947 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.947+0000 7f5e9aacc780 1 > prepared operation key=UTZHANL9ER2Q tag=31UYHC740T72 type=del size=738611 2024-06-04T15:59:33.948 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.948+0000 7f5e9aacc780 1 < completed delete operation key=HD6SNICRCDLL tag=TU8UAPVCTK6C type=del 2024-06-04T15:59:33.951 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.951+0000 7f5e9aacc780 1 > prepared part key=_multipart_GTRMEQJK675Z.2~Q9KN334WXT33.0 size=18239 2024-06-04T15:59:33.951 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.951+0000 7f5e9aacc780 1 > prepared multipart upload key=GTRMEQJK675Z upload=Q9KN334WXT33 tag=UFBGCIZA238E type=write size=1066815 2024-06-04T15:59:33.952 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.952+0000 7f5e9aacc780 1 < completed part key=_multipart_4W5HB9WQQHR6.2~DYJR5QX41NZ7.0 size=812680 2024-06-04T15:59:33.954 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.954+0000 7f5e9aacc780 1 < completed multipart upload key=4W5HB9WQQHR6 upload=DYJR5QX41NZ7 tag=L0E5UOUALZAU type=write size=1861256 2024-06-04T15:59:33.956 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.956+0000 7f5e9aacc780 1 > prepared operation key=7S9S3MIG7WIT tag=78H3URF3AJ49 type=del size=2621711 2024-06-04T15:59:33.958 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.958+0000 7f5e9aacc780 1 < completed write operation key=SUBHZJ7HUV3H tag=EPR7V7TH18SZ type=write size=710555 2024-06-04T15:59:33.961 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.960+0000 7f5e9aacc780 1 > prepared part key=_multipart_NJ5U8JTT32QK.2~FACVB6ZKKXYY.0 size=1048576 2024-06-04T15:59:33.962 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.962+0000 7f5e9aacc780 1 > prepared part key=_multipart_NJ5U8JTT32QK.2~FACVB6ZKKXYY.1 size=1048576 2024-06-04T15:59:33.963 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.963+0000 7f5e9aacc780 1 > prepared part key=_multipart_NJ5U8JTT32QK.2~FACVB6ZKKXYY.2 size=971236 2024-06-04T15:59:33.963 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.963+0000 7f5e9aacc780 1 > prepared multipart upload key=NJ5U8JTT32QK upload=FACVB6ZKKXYY tag=Z1I4CNM3K2A3 type=write size=4116964 2024-06-04T15:59:33.965 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.964+0000 7f5e9aacc780 1 < completed write operation key=7S9S3MIG7WIT tag=JKMHFWP31R60 type=write size=1035098 2024-06-04T15:59:33.967 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.967+0000 7f5e9aacc780 1 > prepared part key=_multipart_QUIVPH3OB6KN.2~IP7NMSRC4SH2.0 size=659608 2024-06-04T15:59:33.967 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.967+0000 7f5e9aacc780 1 > prepared multipart upload key=QUIVPH3OB6KN upload=IP7NMSRC4SH2 tag=2BYH29YKQ1VN type=write size=1708184 2024-06-04T15:59:33.969 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.969+0000 7f5e9aacc780 1 < completed write operation key=RP8K6QJUZAH1 tag=UYQRM4GTH9AQ type=write size=291421 2024-06-04T15:59:33.971 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.971+0000 7f5e9aacc780 1 > prepared part key=_multipart_A8O0S3S45RGM.2~GMFWIMQLQ7D3.0 size=1048576 2024-06-04T15:59:33.972 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.972+0000 7f5e9aacc780 1 > prepared part key=_multipart_A8O0S3S45RGM.2~GMFWIMQLQ7D3.1 size=783931 2024-06-04T15:59:33.972 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.972+0000 7f5e9aacc780 1 > prepared multipart upload key=A8O0S3S45RGM upload=GMFWIMQLQ7D3 tag=WI9BW30BJR59 type=write size=2881083 2024-06-04T15:59:33.974 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.973+0000 7f5e9aacc780 1 < completed part key=_multipart_SUBHZJ7HUV3H.2~IP5AT4O2RQCM.0 size=428433 2024-06-04T15:59:33.976 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.976+0000 7f5e9aacc780 1 < completed multipart upload key=SUBHZJ7HUV3H upload=IP5AT4O2RQCM tag=RYT6OLT8920Y type=write size=1477009 2024-06-04T15:59:33.978 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.978+0000 7f5e9aacc780 1 > prepared operation key=7S9S3MIG7WIT tag=Z54OOGI08519 type=del size=2322908 2024-06-04T15:59:33.980 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.979+0000 7f5e9aacc780 1 < completed write operation key=Q2V1ICTBSCV1 tag=GS1D32NKUH0A type=write size=214704 2024-06-04T15:59:33.981 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.981+0000 7f5e9aacc780 1 > prepared operation key=FBV2MAG130M6 tag=M5OTJIFSUXZH type=del size=1975943 2024-06-04T15:59:33.982 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.982+0000 7f5e9aacc780 1 < completed write operation key=2BT2AXKB1RTA tag=TYTHOK1D3N51 type=write size=286517 2024-06-04T15:59:33.984 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.983+0000 7f5e9aacc780 1 > prepared operation key=NHPH4LYPP0LL tag=30XKCPPMURVH type=del size=2751475 2024-06-04T15:59:33.985 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.985+0000 7f5e9aacc780 1 < completed write operation key=Q4OFQI0F5YLG tag=X8ZSMVLZWIOZ type=write size=1025770 2024-06-04T15:59:33.988 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.988+0000 7f5e9aacc780 1 > prepared part key=_multipart_UW5LVIBG09SV.2~WFQC3ICP7TUD.0 size=1048576 2024-06-04T15:59:33.989 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.989+0000 7f5e9aacc780 1 > prepared part key=_multipart_UW5LVIBG09SV.2~WFQC3ICP7TUD.1 size=340981 2024-06-04T15:59:33.989 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.989+0000 7f5e9aacc780 1 > prepared multipart upload key=UW5LVIBG09SV upload=WFQC3ICP7TUD tag=8OADXA0B7ORQ type=write size=2438133 2024-06-04T15:59:33.990 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.990+0000 7f5e9aacc780 1 < completed part key=_multipart_NHPH4LYPP0LL.2~JEOZ1BVVFXRN.0 size=138874 2024-06-04T15:59:33.993 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.993+0000 7f5e9aacc780 1 < completed multipart upload key=NHPH4LYPP0LL upload=JEOZ1BVVFXRN tag=Y5HF520UKG3Y type=write size=1187450 2024-06-04T15:59:33.996 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.996+0000 7f5e9aacc780 1 > prepared part key=_multipart_W1T4O3EAE7JN.2~2Y41WGT7FVLG.0 size=1048576 2024-06-04T15:59:33.997 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.997+0000 7f5e9aacc780 1 > prepared part key=_multipart_W1T4O3EAE7JN.2~2Y41WGT7FVLG.1 size=640082 2024-06-04T15:59:33.997 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.997+0000 7f5e9aacc780 1 > prepared multipart upload key=W1T4O3EAE7JN upload=2Y41WGT7FVLG tag=1SJHUNJEJ7A4 type=write size=2737234 2024-06-04T15:59:33.999 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:33.999+0000 7f5e9aacc780 1 < completed part key=_multipart_RP8K6QJUZAH1.2~EFBR3ZPU2WLX.0 size=1048576 2024-06-04T15:59:34.000 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.000+0000 7f5e9aacc780 1 < completed part key=_multipart_RP8K6QJUZAH1.2~EFBR3ZPU2WLX.1 size=483849 2024-06-04T15:59:34.003 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.003+0000 7f5e9aacc780 1 < completed multipart upload key=RP8K6QJUZAH1 upload=EFBR3ZPU2WLX tag=74FE178NXOHW type=write size=2581001 2024-06-04T15:59:34.007 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.007+0000 7f5e9aacc780 1 > prepared part key=_multipart_PCLJXQHJ4HTY.2~7DXYK0MCTS2E.0 size=998065 2024-06-04T15:59:34.007 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.007+0000 7f5e9aacc780 1 > prepared multipart upload key=PCLJXQHJ4HTY upload=7DXYK0MCTS2E tag=HN28DPYV04M4 type=write size=2046641 2024-06-04T15:59:34.007 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.007+0000 7f5e9aacc780 1 < canceled part key=_multipart_DY9JWHWNAUO1.2~A7R702N9HJ0J.0 size=1048576 2024-06-04T15:59:34.009 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.009+0000 7f5e9aacc780 1 < completed part key=_multipart_DY9JWHWNAUO1.2~A7R702N9HJ0J.1 size=1048576 2024-06-04T15:59:34.010 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.010+0000 7f5e9aacc780 1 < completed part key=_multipart_DY9JWHWNAUO1.2~A7R702N9HJ0J.2 size=46349 2024-06-04T15:59:34.012 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.012+0000 7f5e9aacc780 1 < canceled multipart upload key=DY9JWHWNAUO1 upload=A7R702N9HJ0J tag=VW2TXVBEWPF2 type=write size=3192077 2024-06-04T15:59:34.014 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.014+0000 7f5e9aacc780 1 > prepared operation key=1IKNQXU3Y2JJ tag=8QZ86L3H5YJ5 type=write size=144711 2024-06-04T15:59:34.015 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.015+0000 7f5e9aacc780 1 < completed delete operation key=XH0N984YVGKP tag=2PG9NXRIGDRJ type=del 2024-06-04T15:59:34.017 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.017+0000 7f5e9aacc780 1 > prepared operation key=GCPC9OJH7KWU tag=WIM2OKJGMHGS type=del size=116690 2024-06-04T15:59:34.019 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.018+0000 7f5e9aacc780 1 < completed write operation key=7S9S3MIG7WIT tag=5T4V4PIPIN3A type=write size=379562 2024-06-04T15:59:34.020 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.020+0000 7f5e9aacc780 1 > prepared operation key=A8O0S3S45RGM tag=HPKK6CZ074TK type=del size=2935252 2024-06-04T15:59:34.022 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.021+0000 7f5e9aacc780 1 < completed part key=_multipart_PNDPO2WUW7UX.2~8BEDU4B9YHXE.0 size=322344 2024-06-04T15:59:34.024 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.024+0000 7f5e9aacc780 1 < completed multipart upload key=PNDPO2WUW7UX upload=8BEDU4B9YHXE tag=F27XMWEILVIN type=write size=1370920 2024-06-04T15:59:34.025 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.025+0000 7f5e9aacc780 1 > prepared operation key=Q2V1ICTBSCV1 tag=C5OFP8DD70AJ type=del size=3709098 2024-06-04T15:59:34.027 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.026+0000 7f5e9aacc780 1 < completed delete operation key=UTZHANL9ER2Q tag=31UYHC740T72 type=del 2024-06-04T15:59:34.028 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.028+0000 7f5e9aacc780 1 > prepared operation key=W1T4O3EAE7JN tag=SQCP46KDR7DZ type=del size=1780980 2024-06-04T15:59:34.030 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.030+0000 7f5e9aacc780 1 < completed part key=_multipart_GTRMEQJK675Z.2~Q9KN334WXT33.0 size=18239 2024-06-04T15:59:34.032 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.032+0000 7f5e9aacc780 1 < completed multipart upload key=GTRMEQJK675Z upload=Q9KN334WXT33 tag=UFBGCIZA238E type=write size=1066815 2024-06-04T15:59:34.034 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.033+0000 7f5e9aacc780 1 > prepared operation key=9MPRI6LW3956 tag=GZU14FKOMTX9 type=del size=2950243 2024-06-04T15:59:34.035 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.035+0000 7f5e9aacc780 1 < completed delete operation key=7S9S3MIG7WIT tag=78H3URF3AJ49 type=del 2024-06-04T15:59:34.036 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.036+0000 7f5e9aacc780 1 > prepared operation key=03ZNYG3WLMP4 tag=QYU3MEJTEZBR type=write size=976922 2024-06-04T15:59:34.038 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.038+0000 7f5e9aacc780 1 < completed part key=_multipart_NJ5U8JTT32QK.2~FACVB6ZKKXYY.0 size=1048576 2024-06-04T15:59:34.038 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.038+0000 7f5e9aacc780 1 < canceled part key=_multipart_NJ5U8JTT32QK.2~FACVB6ZKKXYY.1 size=1048576 2024-06-04T15:59:34.039 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.039+0000 7f5e9aacc780 1 < completed part key=_multipart_NJ5U8JTT32QK.2~FACVB6ZKKXYY.2 size=971236 2024-06-04T15:59:34.041 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.041+0000 7f5e9aacc780 1 < canceled multipart upload key=NJ5U8JTT32QK upload=FACVB6ZKKXYY tag=Z1I4CNM3K2A3 type=write size=4116964 2024-06-04T15:59:34.043 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.043+0000 7f5e9aacc780 1 > prepared operation key=GTRMEQJK675Z tag=FDDEC0OVONOJ type=del size=1247894 2024-06-04T15:59:34.044 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.044+0000 7f5e9aacc780 1 < completed part key=_multipart_QUIVPH3OB6KN.2~IP7NMSRC4SH2.0 size=659608 2024-06-04T15:59:34.047 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.047+0000 7f5e9aacc780 1 < completed multipart upload key=QUIVPH3OB6KN upload=IP7NMSRC4SH2 tag=2BYH29YKQ1VN type=write size=1708184 2024-06-04T15:59:34.049 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.048+0000 7f5e9aacc780 1 > prepared operation key=UTZHANL9ER2Q tag=2YQCDTI5MB82 type=del size=3147239 2024-06-04T15:59:34.050 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.050+0000 7f5e9aacc780 1 < completed part key=_multipart_A8O0S3S45RGM.2~GMFWIMQLQ7D3.0 size=1048576 2024-06-04T15:59:34.050 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.050+0000 7f5e9aacc780 1 < canceled part key=_multipart_A8O0S3S45RGM.2~GMFWIMQLQ7D3.1 size=783931 2024-06-04T15:59:34.052 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.052+0000 7f5e9aacc780 1 < canceled multipart upload key=A8O0S3S45RGM upload=GMFWIMQLQ7D3 tag=WI9BW30BJR59 type=write size=2881083 2024-06-04T15:59:34.055 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.055+0000 7f5e9aacc780 1 > prepared part key=_multipart_QUIVPH3OB6KN.2~2NUP30U82H5W.0 size=1048576 2024-06-04T15:59:34.056 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.056+0000 7f5e9aacc780 1 > prepared part key=_multipart_QUIVPH3OB6KN.2~2NUP30U82H5W.1 size=1048576 2024-06-04T15:59:34.057 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.057+0000 7f5e9aacc780 1 > prepared part key=_multipart_QUIVPH3OB6KN.2~2NUP30U82H5W.2 size=933508 2024-06-04T15:59:34.057 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.057+0000 7f5e9aacc780 1 > prepared multipart upload key=QUIVPH3OB6KN upload=2NUP30U82H5W tag=RHINQ0ZFA2HL type=write size=4079236 2024-06-04T15:59:34.058 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.058+0000 7f5e9aacc780 1 < completed delete operation key=7S9S3MIG7WIT tag=Z54OOGI08519 type=del 2024-06-04T15:59:34.060 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.060+0000 7f5e9aacc780 1 > prepared operation key=W1T4O3EAE7JN tag=R14BGCGC4DM7 type=del size=3548524 2024-06-04T15:59:34.061 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.061+0000 7f5e9aacc780 1 < completed delete operation key=FBV2MAG130M6 tag=M5OTJIFSUXZH type=del 2024-06-04T15:59:34.062 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.062+0000 7f5e9aacc780 1 > prepared operation key=UW5LVIBG09SV tag=TJQ09ZVIFLDN type=del size=2803695 2024-06-04T15:59:34.064 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.064+0000 7f5e9aacc780 1 < completed delete operation key=NHPH4LYPP0LL tag=30XKCPPMURVH type=del 2024-06-04T15:59:34.065 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.065+0000 7f5e9aacc780 1 > prepared operation key=NHPH4LYPP0LL tag=HSHROSLJ7980 type=write size=1019912 2024-06-04T15:59:34.067 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.067+0000 7f5e9aacc780 1 < completed part key=_multipart_UW5LVIBG09SV.2~WFQC3ICP7TUD.0 size=1048576 2024-06-04T15:59:34.068 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.068+0000 7f5e9aacc780 1 < completed part key=_multipart_UW5LVIBG09SV.2~WFQC3ICP7TUD.1 size=340981 2024-06-04T15:59:34.071 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.070+0000 7f5e9aacc780 1 < completed multipart upload key=UW5LVIBG09SV upload=WFQC3ICP7TUD tag=8OADXA0B7ORQ type=write size=2438133 2024-06-04T15:59:34.072 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.072+0000 7f5e9aacc780 1 > prepared operation key=QUIVPH3OB6KN tag=FMFCEORZCSIS type=del size=1069082 2024-06-04T15:59:34.073 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.073+0000 7f5e9aacc780 1 < completed part key=_multipart_W1T4O3EAE7JN.2~2Y41WGT7FVLG.0 size=1048576 2024-06-04T15:59:34.075 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.074+0000 7f5e9aacc780 1 < completed part key=_multipart_W1T4O3EAE7JN.2~2Y41WGT7FVLG.1 size=640082 2024-06-04T15:59:34.077 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.077+0000 7f5e9aacc780 1 < completed multipart upload key=W1T4O3EAE7JN upload=2Y41WGT7FVLG tag=1SJHUNJEJ7A4 type=write size=2737234 2024-06-04T15:59:34.078 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.078+0000 7f5e9aacc780 1 > prepared operation key=QUIVPH3OB6KN tag=YDQUFWY3XGY7 type=del size=1840408 2024-06-04T15:59:34.080 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.079+0000 7f5e9aacc780 1 < completed part key=_multipart_PCLJXQHJ4HTY.2~7DXYK0MCTS2E.0 size=998065 2024-06-04T15:59:34.082 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.082+0000 7f5e9aacc780 1 < completed multipart upload key=PCLJXQHJ4HTY upload=7DXYK0MCTS2E tag=HN28DPYV04M4 type=write size=2046641 2024-06-04T15:59:34.085 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.085+0000 7f5e9aacc780 1 > prepared part key=_multipart_UW5LVIBG09SV.2~GFSD74LH78C1.0 size=1048576 2024-06-04T15:59:34.086 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.085+0000 7f5e9aacc780 1 > prepared part key=_multipart_UW5LVIBG09SV.2~GFSD74LH78C1.1 size=1048576 2024-06-04T15:59:34.087 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.087+0000 7f5e9aacc780 1 > prepared part key=_multipart_UW5LVIBG09SV.2~GFSD74LH78C1.2 size=663429 2024-06-04T15:59:34.087 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.087+0000 7f5e9aacc780 1 > prepared multipart upload key=UW5LVIBG09SV upload=GFSD74LH78C1 tag=QTACSZW9PXCR type=write size=3809157 2024-06-04T15:59:34.088 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.088+0000 7f5e9aacc780 1 < completed write operation key=1IKNQXU3Y2JJ tag=8QZ86L3H5YJ5 type=write size=144711 2024-06-04T15:59:34.091 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.091+0000 7f5e9aacc780 1 > prepared part key=_multipart_UW5LVIBG09SV.2~VNUFPQHACCQ4.0 size=1048576 2024-06-04T15:59:34.092 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.092+0000 7f5e9aacc780 1 > prepared part key=_multipart_UW5LVIBG09SV.2~VNUFPQHACCQ4.1 size=1048576 2024-06-04T15:59:34.093 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.093+0000 7f5e9aacc780 1 > prepared part key=_multipart_UW5LVIBG09SV.2~VNUFPQHACCQ4.2 size=209092 2024-06-04T15:59:34.093 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.093+0000 7f5e9aacc780 1 > prepared multipart upload key=UW5LVIBG09SV upload=VNUFPQHACCQ4 tag=72Q0KPKHN970 type=write size=3354820 2024-06-04T15:59:34.094 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.094+0000 7f5e9aacc780 1 < completed delete operation key=GCPC9OJH7KWU tag=WIM2OKJGMHGS type=del 2024-06-04T15:59:34.097 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.097+0000 7f5e9aacc780 1 > prepared part key=_multipart_JL69PUHT6NNT.2~QSH2O7M1HXXW.0 size=1048576 2024-06-04T15:59:34.098 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.098+0000 7f5e9aacc780 1 > prepared part key=_multipart_JL69PUHT6NNT.2~QSH2O7M1HXXW.1 size=644149 2024-06-04T15:59:34.098 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.098+0000 7f5e9aacc780 1 > prepared multipart upload key=JL69PUHT6NNT upload=QSH2O7M1HXXW tag=DT91VY46ACZG type=write size=2741301 2024-06-04T15:59:34.102 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.101+0000 7f5e9aacc780 1 < suggested remove operation key=A8O0S3S45RGM tag=HPKK6CZ074TK type=del 2024-06-04T15:59:34.104 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.104+0000 7f5e9aacc780 1 > prepared part key=_multipart_SUBHZJ7HUV3H.2~3BIF167R0CBH.0 size=36411 2024-06-04T15:59:34.105 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.104+0000 7f5e9aacc780 1 > prepared multipart upload key=SUBHZJ7HUV3H upload=3BIF167R0CBH tag=YR6SP5P88W3I type=write size=1084987 2024-06-04T15:59:34.107 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.107+0000 7f5e9aacc780 1 < suggested update operation key=Q2V1ICTBSCV1 tag=C5OFP8DD70AJ type=del size=3709098 2024-06-04T15:59:34.110 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.110+0000 7f5e9aacc780 1 > prepared part key=_multipart_K01DAK0M4I4M.2~ZPEXUAZ9KE4Z.0 size=1048576 2024-06-04T15:59:34.111 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.110+0000 7f5e9aacc780 1 > prepared part key=_multipart_K01DAK0M4I4M.2~ZPEXUAZ9KE4Z.1 size=414927 2024-06-04T15:59:34.111 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.110+0000 7f5e9aacc780 1 > prepared multipart upload key=K01DAK0M4I4M upload=ZPEXUAZ9KE4Z tag=JO66DN30CL62 type=write size=2512079 2024-06-04T15:59:34.112 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.112+0000 7f5e9aacc780 1 < completed delete operation key=W1T4O3EAE7JN tag=SQCP46KDR7DZ type=del 2024-06-04T15:59:34.115 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.114+0000 7f5e9aacc780 1 > prepared part key=_multipart_UW5LVIBG09SV.2~5AOK2WQWO9OJ.0 size=899008 2024-06-04T15:59:34.115 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.114+0000 7f5e9aacc780 1 > prepared multipart upload key=UW5LVIBG09SV upload=5AOK2WQWO9OJ tag=CN62NIV5UYPX type=write size=1947584 2024-06-04T15:59:34.116 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.116+0000 7f5e9aacc780 1 < completed delete operation key=9MPRI6LW3956 tag=GZU14FKOMTX9 type=del 2024-06-04T15:59:34.118 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.117+0000 7f5e9aacc780 1 > prepared operation key=QJA2JPATITNH tag=SY4LH1IA1ISU type=del size=2867738 2024-06-04T15:59:34.119 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.120+0000 7f5e9aacc780 1 < completed write operation key=03ZNYG3WLMP4 tag=QYU3MEJTEZBR type=write size=976922 2024-06-04T15:59:34.122 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.122+0000 7f5e9aacc780 1 > prepared part key=_multipart_UW5LVIBG09SV.2~8N3VFRALG2BR.0 size=317371 2024-06-04T15:59:34.122 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.122+0000 7f5e9aacc780 1 > prepared multipart upload key=UW5LVIBG09SV upload=8N3VFRALG2BR tag=RELPL472UT1G type=write size=1365947 2024-06-04T15:59:34.123 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.123+0000 7f5e9aacc780 1 < completed delete operation key=GTRMEQJK675Z tag=FDDEC0OVONOJ type=del 2024-06-04T15:59:34.126 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.126+0000 7f5e9aacc780 1 > prepared part key=_multipart_HD6SNICRCDLL.2~QNK1N8052OWP.0 size=69718 2024-06-04T15:59:34.126 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.126+0000 7f5e9aacc780 1 > prepared multipart upload key=HD6SNICRCDLL upload=QNK1N8052OWP tag=8CYLR8Z47LWI type=write size=1118294 2024-06-04T15:59:34.128 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.127+0000 7f5e9aacc780 1 < completed delete operation key=UTZHANL9ER2Q tag=2YQCDTI5MB82 type=del 2024-06-04T15:59:34.129 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.129+0000 7f5e9aacc780 1 > prepared operation key=QJA2JPATITNH tag=LBC9DEMJ872Y type=del size=2718244 2024-06-04T15:59:34.130 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.129+0000 7f5e9aacc780 1 < canceled part key=_multipart_QUIVPH3OB6KN.2~2NUP30U82H5W.0 size=1048576 2024-06-04T15:59:34.130 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.130+0000 7f5e9aacc780 1 < completed part key=_multipart_QUIVPH3OB6KN.2~2NUP30U82H5W.1 size=1048576 2024-06-04T15:59:34.132 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.132+0000 7f5e9aacc780 1 < completed part key=_multipart_QUIVPH3OB6KN.2~2NUP30U82H5W.2 size=933508 2024-06-04T15:59:34.134 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.134+0000 7f5e9aacc780 1 < canceled multipart upload key=QUIVPH3OB6KN upload=2NUP30U82H5W tag=RHINQ0ZFA2HL type=write size=4079236 2024-06-04T15:59:34.136 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.135+0000 7f5e9aacc780 1 > prepared operation key=TUGKW7F4V9NO tag=T8TNGNI2PC2F type=del size=2177593 2024-06-04T15:59:34.137 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.137+0000 7f5e9aacc780 1 < completed delete operation key=W1T4O3EAE7JN tag=R14BGCGC4DM7 type=del 2024-06-04T15:59:34.141 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.141+0000 7f5e9aacc780 1 > prepared part key=_multipart_AOCB36Y5Q7B0.2~KK3TIX9MRBUT.0 size=45212 2024-06-04T15:59:34.141 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.141+0000 7f5e9aacc780 1 > prepared multipart upload key=AOCB36Y5Q7B0 upload=KK3TIX9MRBUT tag=MSU7116B8I7N type=write size=1093788 2024-06-04T15:59:34.143 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.142+0000 7f5e9aacc780 1 < completed delete operation key=UW5LVIBG09SV tag=TJQ09ZVIFLDN type=del 2024-06-04T15:59:34.145 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.145+0000 7f5e9aacc780 1 > prepared part key=_multipart_7S9S3MIG7WIT.2~DE1E00AG8IPU.0 size=1048576 2024-06-04T15:59:34.146 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.146+0000 7f5e9aacc780 1 > prepared part key=_multipart_7S9S3MIG7WIT.2~DE1E00AG8IPU.1 size=90101 2024-06-04T15:59:34.146 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.146+0000 7f5e9aacc780 1 > prepared multipart upload key=7S9S3MIG7WIT upload=DE1E00AG8IPU tag=IBOA39XLAAIX type=write size=2187253 2024-06-04T15:59:34.148 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.148+0000 7f5e9aacc780 1 < completed write operation key=NHPH4LYPP0LL tag=HSHROSLJ7980 type=write size=1019912 2024-06-04T15:59:34.149 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.149+0000 7f5e9aacc780 1 > prepared operation key=HD6SNICRCDLL tag=MB213ZKT3FXO type=del size=3240260 2024-06-04T15:59:34.151 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.151+0000 7f5e9aacc780 1 < completed delete operation key=QUIVPH3OB6KN tag=FMFCEORZCSIS type=del 2024-06-04T15:59:34.152 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.152+0000 7f5e9aacc780 1 > prepared operation key=AOCB36Y5Q7B0 tag=HB2B6RQKY95T type=write size=83230 2024-06-04T15:59:34.154 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.154+0000 7f5e9aacc780 1 < completed delete operation key=QUIVPH3OB6KN tag=YDQUFWY3XGY7 type=del 2024-06-04T15:59:34.157 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.156+0000 7f5e9aacc780 1 > prepared part key=_multipart_B0HK5FJ2RGJE.2~K9PA9EC7YK98.0 size=1048576 2024-06-04T15:59:34.158 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.158+0000 7f5e9aacc780 1 > prepared part key=_multipart_B0HK5FJ2RGJE.2~K9PA9EC7YK98.1 size=708984 2024-06-04T15:59:34.158 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.158+0000 7f5e9aacc780 1 > prepared multipart upload key=B0HK5FJ2RGJE upload=K9PA9EC7YK98 tag=5R17U7G7THUS type=write size=2806136 2024-06-04T15:59:34.159 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.159+0000 7f5e9aacc780 1 < completed part key=_multipart_UW5LVIBG09SV.2~GFSD74LH78C1.0 size=1048576 2024-06-04T15:59:34.160 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.160+0000 7f5e9aacc780 1 < completed part key=_multipart_UW5LVIBG09SV.2~GFSD74LH78C1.1 size=1048576 2024-06-04T15:59:34.162 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.161+0000 7f5e9aacc780 1 < completed part key=_multipart_UW5LVIBG09SV.2~GFSD74LH78C1.2 size=663429 2024-06-04T15:59:34.164 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.164+0000 7f5e9aacc780 1 < completed multipart upload key=UW5LVIBG09SV upload=GFSD74LH78C1 tag=QTACSZW9PXCR type=write size=3809157 2024-06-04T15:59:34.165 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.165+0000 7f5e9aacc780 1 > prepared operation key=GTRMEQJK675Z tag=E8YCFJZHQXMH type=write size=458430 2024-06-04T15:59:34.167 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.166+0000 7f5e9aacc780 1 < completed part key=_multipart_UW5LVIBG09SV.2~VNUFPQHACCQ4.0 size=1048576 2024-06-04T15:59:34.168 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.168+0000 7f5e9aacc780 1 < completed part key=_multipart_UW5LVIBG09SV.2~VNUFPQHACCQ4.1 size=1048576 2024-06-04T15:59:34.169 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.169+0000 7f5e9aacc780 1 < completed part key=_multipart_UW5LVIBG09SV.2~VNUFPQHACCQ4.2 size=209092 2024-06-04T15:59:34.171 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.171+0000 7f5e9aacc780 1 < completed multipart upload key=UW5LVIBG09SV upload=VNUFPQHACCQ4 tag=72Q0KPKHN970 type=write size=3354820 2024-06-04T15:59:34.173 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.172+0000 7f5e9aacc780 1 > prepared operation key=Q2V1ICTBSCV1 tag=16D66SZZQN1S type=del size=2389462 2024-06-04T15:59:34.174 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.174+0000 7f5e9aacc780 1 < completed part key=_multipart_JL69PUHT6NNT.2~QSH2O7M1HXXW.0 size=1048576 2024-06-04T15:59:34.175 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.175+0000 7f5e9aacc780 1 < completed part key=_multipart_JL69PUHT6NNT.2~QSH2O7M1HXXW.1 size=644149 2024-06-04T15:59:34.178 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.177+0000 7f5e9aacc780 1 < completed multipart upload key=JL69PUHT6NNT upload=QSH2O7M1HXXW tag=DT91VY46ACZG type=write size=2741301 2024-06-04T15:59:34.180 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.180+0000 7f5e9aacc780 1 > prepared part key=_multipart_03ZNYG3WLMP4.2~9KH7N7OLLXBU.0 size=1048576 2024-06-04T15:59:34.181 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.181+0000 7f5e9aacc780 1 > prepared part key=_multipart_03ZNYG3WLMP4.2~9KH7N7OLLXBU.1 size=597356 2024-06-04T15:59:34.181 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.181+0000 7f5e9aacc780 1 > prepared multipart upload key=03ZNYG3WLMP4 upload=9KH7N7OLLXBU tag=JWI2CP1INFNI type=write size=2694508 2024-06-04T15:59:34.182 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.181+0000 7f5e9aacc780 1 < canceled part key=_multipart_SUBHZJ7HUV3H.2~3BIF167R0CBH.0 size=36411 2024-06-04T15:59:34.185 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.185+0000 7f5e9aacc780 1 < canceled multipart upload key=SUBHZJ7HUV3H upload=3BIF167R0CBH tag=YR6SP5P88W3I type=write size=1084987 2024-06-04T15:59:34.187 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.187+0000 7f5e9aacc780 1 > prepared operation key=03ZNYG3WLMP4 tag=U8N3VFH7NYSZ type=del size=686564 2024-06-04T15:59:34.188 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.188+0000 7f5e9aacc780 1 < completed part key=_multipart_K01DAK0M4I4M.2~ZPEXUAZ9KE4Z.0 size=1048576 2024-06-04T15:59:34.189 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.189+0000 7f5e9aacc780 1 < completed part key=_multipart_K01DAK0M4I4M.2~ZPEXUAZ9KE4Z.1 size=414927 2024-06-04T15:59:34.192 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.191+0000 7f5e9aacc780 1 < completed multipart upload key=K01DAK0M4I4M upload=ZPEXUAZ9KE4Z tag=JO66DN30CL62 type=write size=2512079 2024-06-04T15:59:34.193 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.193+0000 7f5e9aacc780 1 > prepared operation key=K01DAK0M4I4M tag=5V5AO6RNA7S8 type=del size=823845 2024-06-04T15:59:34.195 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.194+0000 7f5e9aacc780 1 < completed part key=_multipart_UW5LVIBG09SV.2~5AOK2WQWO9OJ.0 size=899008 2024-06-04T15:59:34.197 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.197+0000 7f5e9aacc780 1 < completed multipart upload key=UW5LVIBG09SV upload=5AOK2WQWO9OJ tag=CN62NIV5UYPX type=write size=1947584 2024-06-04T15:59:34.200 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.199+0000 7f5e9aacc780 1 > prepared part key=_multipart_PNDPO2WUW7UX.2~96VMNEAAO32G.0 size=260923 2024-06-04T15:59:34.200 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.199+0000 7f5e9aacc780 1 > prepared multipart upload key=PNDPO2WUW7UX upload=96VMNEAAO32G tag=MG81Z28FU6H9 type=write size=1309499 2024-06-04T15:59:34.201 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.201+0000 7f5e9aacc780 1 < canceled operation key=QJA2JPATITNH tag=SY4LH1IA1ISU type=del size=2867738 2024-06-04T15:59:34.203 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.203+0000 7f5e9aacc780 1 > prepared operation key=QJA2JPATITNH tag=QMETUIGX705S type=write size=510191 2024-06-04T15:59:34.204 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.204+0000 7f5e9aacc780 1 < completed part key=_multipart_UW5LVIBG09SV.2~8N3VFRALG2BR.0 size=317371 2024-06-04T15:59:34.207 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.207+0000 7f5e9aacc780 1 < completed multipart upload key=UW5LVIBG09SV upload=8N3VFRALG2BR tag=RELPL472UT1G type=write size=1365947 2024-06-04T15:59:34.209 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.209+0000 7f5e9aacc780 1 > prepared part key=_multipart_7S9S3MIG7WIT.2~JUWYMXC0HU70.0 size=1048576 2024-06-04T15:59:34.210 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.210+0000 7f5e9aacc780 1 > prepared part key=_multipart_7S9S3MIG7WIT.2~JUWYMXC0HU70.1 size=137485 2024-06-04T15:59:34.211 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.210+0000 7f5e9aacc780 1 > prepared multipart upload key=7S9S3MIG7WIT upload=JUWYMXC0HU70 tag=11UF1I0DHV02 type=write size=2234637 2024-06-04T15:59:34.212 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.212+0000 7f5e9aacc780 1 < completed part key=_multipart_HD6SNICRCDLL.2~QNK1N8052OWP.0 size=69718 2024-06-04T15:59:34.214 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.214+0000 7f5e9aacc780 1 < completed multipart upload key=HD6SNICRCDLL upload=QNK1N8052OWP tag=8CYLR8Z47LWI type=write size=1118294 2024-06-04T15:59:34.217 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.216+0000 7f5e9aacc780 1 > prepared part key=_multipart_XH0N984YVGKP.2~NL4U919676ZA.0 size=1048576 2024-06-04T15:59:34.218 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.218+0000 7f5e9aacc780 1 > prepared part key=_multipart_XH0N984YVGKP.2~NL4U919676ZA.1 size=782684 2024-06-04T15:59:34.218 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.218+0000 7f5e9aacc780 1 > prepared multipart upload key=XH0N984YVGKP upload=NL4U919676ZA tag=ZWDMJ5WBL7PN type=write size=2879836 2024-06-04T15:59:34.221 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.221+0000 7f5e9aacc780 1 < suggested remove operation key=QJA2JPATITNH tag=LBC9DEMJ872Y type=del 2024-06-04T15:59:34.222 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.222+0000 7f5e9aacc780 1 > prepared operation key=7S9S3MIG7WIT tag=I0EER1G6B2AA type=del size=2674453 2024-06-04T15:59:34.225 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.223+0000 7f5e9aacc780 1 < completed delete operation key=TUGKW7F4V9NO tag=T8TNGNI2PC2F type=del 2024-06-04T15:59:34.226 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.226+0000 7f5e9aacc780 1 > prepared part key=_multipart_W1T4O3EAE7JN.2~0FXXEE056DBW.0 size=638040 2024-06-04T15:59:34.227 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.226+0000 7f5e9aacc780 1 > prepared multipart upload key=W1T4O3EAE7JN upload=0FXXEE056DBW tag=ZBDAH86DZR0X type=write size=1686616 2024-06-04T15:59:34.228 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.228+0000 7f5e9aacc780 1 < completed part key=_multipart_AOCB36Y5Q7B0.2~KK3TIX9MRBUT.0 size=45212 2024-06-04T15:59:34.230 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.230+0000 7f5e9aacc780 1 < completed multipart upload key=AOCB36Y5Q7B0 upload=KK3TIX9MRBUT tag=MSU7116B8I7N type=write size=1093788 2024-06-04T15:59:34.232 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.231+0000 7f5e9aacc780 1 > prepared operation key=TUGKW7F4V9NO tag=1G1M7OG0RPFY type=del size=1871145 2024-06-04T15:59:34.233 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.233+0000 7f5e9aacc780 1 < completed part key=_multipart_7S9S3MIG7WIT.2~DE1E00AG8IPU.0 size=1048576 2024-06-04T15:59:34.234 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.235+0000 7f5e9aacc780 1 < completed part key=_multipart_7S9S3MIG7WIT.2~DE1E00AG8IPU.1 size=90101 2024-06-04T15:59:34.237 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.237+0000 7f5e9aacc780 1 < completed multipart upload key=7S9S3MIG7WIT upload=DE1E00AG8IPU tag=IBOA39XLAAIX type=write size=2187253 2024-06-04T15:59:34.239 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.238+0000 7f5e9aacc780 1 > prepared operation key=RP8K6QJUZAH1 tag=2KPQXBH10JLO type=del size=614715 2024-06-04T15:59:34.240 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.240+0000 7f5e9aacc780 1 < completed delete operation key=HD6SNICRCDLL tag=MB213ZKT3FXO type=del 2024-06-04T15:59:34.242 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.242+0000 7f5e9aacc780 1 > prepared part key=_multipart_GTRMEQJK675Z.2~TICW70EXPNP0.0 size=1048576 2024-06-04T15:59:34.244 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.243+0000 7f5e9aacc780 1 > prepared part key=_multipart_GTRMEQJK675Z.2~TICW70EXPNP0.1 size=1048576 2024-06-04T15:59:34.245 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.244+0000 7f5e9aacc780 1 > prepared part key=_multipart_GTRMEQJK675Z.2~TICW70EXPNP0.2 size=208719 2024-06-04T15:59:34.245 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.244+0000 7f5e9aacc780 1 > prepared multipart upload key=GTRMEQJK675Z upload=TICW70EXPNP0 tag=KYIVN4QOOS15 type=write size=3354447 2024-06-04T15:59:34.246 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.246+0000 7f5e9aacc780 1 < completed write operation key=AOCB36Y5Q7B0 tag=HB2B6RQKY95T type=write size=83230 2024-06-04T15:59:34.248 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.248+0000 7f5e9aacc780 1 > prepared part key=_multipart_9MPRI6LW3956.2~Q0RNT68R6V8O.0 size=1048576 2024-06-04T15:59:34.249 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.249+0000 7f5e9aacc780 1 > prepared part key=_multipart_9MPRI6LW3956.2~Q0RNT68R6V8O.1 size=1048576 2024-06-04T15:59:34.250 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.250+0000 7f5e9aacc780 1 > prepared part key=_multipart_9MPRI6LW3956.2~Q0RNT68R6V8O.2 size=505110 2024-06-04T15:59:34.250 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.250+0000 7f5e9aacc780 1 > prepared multipart upload key=9MPRI6LW3956 upload=Q0RNT68R6V8O tag=XF99VBRZ29M9 type=write size=3650838 2024-06-04T15:59:34.252 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.251+0000 7f5e9aacc780 1 < completed part key=_multipart_B0HK5FJ2RGJE.2~K9PA9EC7YK98.0 size=1048576 2024-06-04T15:59:34.253 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.253+0000 7f5e9aacc780 1 < completed part key=_multipart_B0HK5FJ2RGJE.2~K9PA9EC7YK98.1 size=708984 2024-06-04T15:59:34.255 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.255+0000 7f5e9aacc780 1 < completed multipart upload key=B0HK5FJ2RGJE upload=K9PA9EC7YK98 tag=5R17U7G7THUS type=write size=2806136 2024-06-04T15:59:34.258 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.258+0000 7f5e9aacc780 1 > prepared part key=_multipart_FBV2MAG130M6.2~MW4MFLG5WL04.0 size=1048576 2024-06-04T15:59:34.259 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.259+0000 7f5e9aacc780 1 > prepared part key=_multipart_FBV2MAG130M6.2~MW4MFLG5WL04.1 size=152960 2024-06-04T15:59:34.259 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.259+0000 7f5e9aacc780 1 > prepared multipart upload key=FBV2MAG130M6 upload=MW4MFLG5WL04 tag=8KHKI0OYEYPB type=write size=2250112 2024-06-04T15:59:34.261 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.261+0000 7f5e9aacc780 1 < completed write operation key=GTRMEQJK675Z tag=E8YCFJZHQXMH type=write size=458430 2024-06-04T15:59:34.263 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.262+0000 7f5e9aacc780 1 > prepared operation key=PNDPO2WUW7UX tag=ULGRS87GCAPA type=del size=43205 2024-06-04T15:59:34.264 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.264+0000 7f5e9aacc780 1 < completed delete operation key=Q2V1ICTBSCV1 tag=16D66SZZQN1S type=del 2024-06-04T15:59:34.267 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.267+0000 7f5e9aacc780 1 > prepared part key=_multipart_GCPC9OJH7KWU.2~QZI3Z6HC3TP7.0 size=1048576 2024-06-04T15:59:34.268 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.268+0000 7f5e9aacc780 1 > prepared part key=_multipart_GCPC9OJH7KWU.2~QZI3Z6HC3TP7.1 size=1048576 2024-06-04T15:59:34.269 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.269+0000 7f5e9aacc780 1 > prepared part key=_multipart_GCPC9OJH7KWU.2~QZI3Z6HC3TP7.2 size=559394 2024-06-04T15:59:34.269 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.269+0000 7f5e9aacc780 1 > prepared multipart upload key=GCPC9OJH7KWU upload=QZI3Z6HC3TP7 tag=3UHEQX60Z0TD type=write size=3705122 2024-06-04T15:59:34.271 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.271+0000 7f5e9aacc780 1 < completed part key=_multipart_03ZNYG3WLMP4.2~9KH7N7OLLXBU.0 size=1048576 2024-06-04T15:59:34.272 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.272+0000 7f5e9aacc780 1 < completed part key=_multipart_03ZNYG3WLMP4.2~9KH7N7OLLXBU.1 size=597356 2024-06-04T15:59:34.275 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.275+0000 7f5e9aacc780 1 < completed multipart upload key=03ZNYG3WLMP4 upload=9KH7N7OLLXBU tag=JWI2CP1INFNI type=write size=2694508 2024-06-04T15:59:34.278 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.278+0000 7f5e9aacc780 1 > prepared operation key=HD6SNICRCDLL tag=L0MH5LXQJKIQ type=del size=2084176 2024-06-04T15:59:34.281 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.281+0000 7f5e9aacc780 1 < suggested update operation key=03ZNYG3WLMP4 tag=U8N3VFH7NYSZ type=del size=686564 2024-06-04T15:59:34.283 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.282+0000 7f5e9aacc780 1 > prepared operation key=9MPRI6LW3956 tag=M7WPFD9HUDW5 type=del size=2864506 2024-06-04T15:59:34.284 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.284+0000 7f5e9aacc780 1 < completed delete operation key=K01DAK0M4I4M tag=5V5AO6RNA7S8 type=del 2024-06-04T15:59:34.287 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.287+0000 7f5e9aacc780 1 > prepared part key=_multipart_Q2V1ICTBSCV1.2~8DRUC4DICOOK.0 size=405680 2024-06-04T15:59:34.287 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.287+0000 7f5e9aacc780 1 > prepared multipart upload key=Q2V1ICTBSCV1 upload=8DRUC4DICOOK tag=S8D331H9XFMG type=write size=1454256 2024-06-04T15:59:34.289 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.289+0000 7f5e9aacc780 1 < completed part key=_multipart_PNDPO2WUW7UX.2~96VMNEAAO32G.0 size=260923 2024-06-04T15:59:34.291 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.291+0000 7f5e9aacc780 1 < completed multipart upload key=PNDPO2WUW7UX upload=96VMNEAAO32G tag=MG81Z28FU6H9 type=write size=1309499 2024-06-04T15:59:34.293 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.293+0000 7f5e9aacc780 1 > prepared operation key=Q2V1ICTBSCV1 tag=CSZEW3T17A5J type=del size=3343584 2024-06-04T15:59:34.294 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.294+0000 7f5e9aacc780 -1 < failed to complete operation key=QJA2JPATITNH tag=QMETUIGX705S type=write size=510191: (22) Invalid argument 2024-06-04T15:59:34.297 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.297+0000 7f5e9aacc780 1 > prepared part key=_multipart_RP8K6QJUZAH1.2~4XTQ3ELYWJIZ.0 size=190650 2024-06-04T15:59:34.297 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.297+0000 7f5e9aacc780 1 > prepared multipart upload key=RP8K6QJUZAH1 upload=4XTQ3ELYWJIZ tag=R61LC5DK0VV1 type=write size=1239226 2024-06-04T15:59:34.298 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.297+0000 7f5e9aacc780 1 < canceled part key=_multipart_7S9S3MIG7WIT.2~JUWYMXC0HU70.0 size=1048576 2024-06-04T15:59:34.298 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.297+0000 7f5e9aacc780 1 < canceled part key=_multipart_7S9S3MIG7WIT.2~JUWYMXC0HU70.1 size=137485 2024-06-04T15:59:34.300 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.299+0000 7f5e9aacc780 1 < canceled multipart upload key=7S9S3MIG7WIT upload=JUWYMXC0HU70 tag=11UF1I0DHV02 type=write size=2234637 2024-06-04T15:59:34.301 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.301+0000 7f5e9aacc780 1 > prepared operation key=HD6SNICRCDLL tag=4HQSR7QJJAH2 type=del size=795666 2024-06-04T15:59:34.302 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.301+0000 7f5e9aacc780 1 < canceled part key=_multipart_XH0N984YVGKP.2~NL4U919676ZA.0 size=1048576 2024-06-04T15:59:34.303 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.303+0000 7f5e9aacc780 1 < completed part key=_multipart_XH0N984YVGKP.2~NL4U919676ZA.1 size=782684 2024-06-04T15:59:34.305 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.305+0000 7f5e9aacc780 1 < canceled multipart upload key=XH0N984YVGKP upload=NL4U919676ZA tag=ZWDMJ5WBL7PN type=write size=2879836 2024-06-04T15:59:34.308 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.307+0000 7f5e9aacc780 1 > prepared part key=_multipart_DY9JWHWNAUO1.2~PURY3NIKDMCV.0 size=1048576 2024-06-04T15:59:34.309 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.308+0000 7f5e9aacc780 1 > prepared part key=_multipart_DY9JWHWNAUO1.2~PURY3NIKDMCV.1 size=1048576 2024-06-04T15:59:34.310 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.309+0000 7f5e9aacc780 1 > prepared part key=_multipart_DY9JWHWNAUO1.2~PURY3NIKDMCV.2 size=357980 2024-06-04T15:59:34.310 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.309+0000 7f5e9aacc780 1 > prepared multipart upload key=DY9JWHWNAUO1 upload=PURY3NIKDMCV tag=GA087DE7RO72 type=write size=3503708 2024-06-04T15:59:34.313 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.313+0000 7f5e9aacc780 1 < suggested remove operation key=7S9S3MIG7WIT tag=I0EER1G6B2AA type=del 2024-06-04T15:59:34.315 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.315+0000 7f5e9aacc780 1 > prepared part key=_multipart_A8O0S3S45RGM.2~UE71D0CW3N5Q.0 size=1048576 2024-06-04T15:59:34.316 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.316+0000 7f5e9aacc780 1 > prepared part key=_multipart_A8O0S3S45RGM.2~UE71D0CW3N5Q.1 size=316767 2024-06-04T15:59:34.316 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.316+0000 7f5e9aacc780 1 > prepared multipart upload key=A8O0S3S45RGM upload=UE71D0CW3N5Q tag=FFSSVPUAHI4Q type=write size=2413919 2024-06-04T15:59:34.318 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.318+0000 7f5e9aacc780 1 < completed part key=_multipart_W1T4O3EAE7JN.2~0FXXEE056DBW.0 size=638040 2024-06-04T15:59:34.320 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.321+0000 7f5e9aacc780 1 < completed multipart upload key=W1T4O3EAE7JN upload=0FXXEE056DBW tag=ZBDAH86DZR0X type=write size=1686616 2024-06-04T15:59:34.323 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.323+0000 7f5e9aacc780 1 > prepared part key=_multipart_PASGIP872OVX.2~VKGN6LIDY5IN.0 size=1048576 2024-06-04T15:59:34.324 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.324+0000 7f5e9aacc780 1 > prepared part key=_multipart_PASGIP872OVX.2~VKGN6LIDY5IN.1 size=292297 2024-06-04T15:59:34.324 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.324+0000 7f5e9aacc780 1 > prepared multipart upload key=PASGIP872OVX upload=VKGN6LIDY5IN tag=9UGZIO1TF5FP type=write size=2389449 2024-06-04T15:59:34.326 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.325+0000 7f5e9aacc780 1 < canceled operation key=TUGKW7F4V9NO tag=1G1M7OG0RPFY type=del size=1871145 2024-06-04T15:59:34.329 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.328+0000 7f5e9aacc780 1 > prepared part key=_multipart_A8O0S3S45RGM.2~VQ4HTNVB0KRC.0 size=1048576 2024-06-04T15:59:34.330 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.329+0000 7f5e9aacc780 1 > prepared part key=_multipart_A8O0S3S45RGM.2~VQ4HTNVB0KRC.1 size=1048576 2024-06-04T15:59:34.331 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.330+0000 7f5e9aacc780 1 > prepared part key=_multipart_A8O0S3S45RGM.2~VQ4HTNVB0KRC.2 size=907435 2024-06-04T15:59:34.331 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.330+0000 7f5e9aacc780 1 > prepared multipart upload key=A8O0S3S45RGM upload=VQ4HTNVB0KRC tag=XXQZ9OJD1PSD type=write size=4053163 2024-06-04T15:59:34.332 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.332+0000 7f5e9aacc780 1 < completed delete operation key=RP8K6QJUZAH1 tag=2KPQXBH10JLO type=del 2024-06-04T15:59:34.334 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.333+0000 7f5e9aacc780 1 > prepared operation key=UTZHANL9ER2Q tag=XB3M9XBQB44M type=del size=2182717 2024-06-04T15:59:34.335 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.335+0000 7f5e9aacc780 1 < completed part key=_multipart_GTRMEQJK675Z.2~TICW70EXPNP0.0 size=1048576 2024-06-04T15:59:34.336 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.336+0000 7f5e9aacc780 1 < completed part key=_multipart_GTRMEQJK675Z.2~TICW70EXPNP0.1 size=1048576 2024-06-04T15:59:34.338 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.337+0000 7f5e9aacc780 1 < completed part key=_multipart_GTRMEQJK675Z.2~TICW70EXPNP0.2 size=208719 2024-06-04T15:59:34.340 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.340+0000 7f5e9aacc780 1 < completed multipart upload key=GTRMEQJK675Z upload=TICW70EXPNP0 tag=KYIVN4QOOS15 type=write size=3354447 2024-06-04T15:59:34.342 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.341+0000 7f5e9aacc780 1 > prepared operation key=B0HK5FJ2RGJE tag=777WB9LJ4K1F type=write size=273347 2024-06-04T15:59:34.343 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.343+0000 7f5e9aacc780 1 < completed part key=_multipart_9MPRI6LW3956.2~Q0RNT68R6V8O.0 size=1048576 2024-06-04T15:59:34.344 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.344+0000 7f5e9aacc780 1 < completed part key=_multipart_9MPRI6LW3956.2~Q0RNT68R6V8O.1 size=1048576 2024-06-04T15:59:34.344 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.344+0000 7f5e9aacc780 1 < canceled part key=_multipart_9MPRI6LW3956.2~Q0RNT68R6V8O.2 size=505110 2024-06-04T15:59:34.346 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.346+0000 7f5e9aacc780 1 < canceled multipart upload key=9MPRI6LW3956 upload=Q0RNT68R6V8O tag=XF99VBRZ29M9 type=write size=3650838 2024-06-04T15:59:34.349 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.349+0000 7f5e9aacc780 1 > prepared part key=_multipart_PASGIP872OVX.2~Q0BZJYRXDFGF.0 size=553616 2024-06-04T15:59:34.349 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.349+0000 7f5e9aacc780 1 > prepared multipart upload key=PASGIP872OVX upload=Q0BZJYRXDFGF tag=VU8B6MNLQBPL type=write size=1602192 2024-06-04T15:59:34.351 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.350+0000 7f5e9aacc780 1 < completed part key=_multipart_FBV2MAG130M6.2~MW4MFLG5WL04.0 size=1048576 2024-06-04T15:59:34.352 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.351+0000 7f5e9aacc780 1 < completed part key=_multipart_FBV2MAG130M6.2~MW4MFLG5WL04.1 size=152960 2024-06-04T15:59:34.354 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.354+0000 7f5e9aacc780 1 < completed multipart upload key=FBV2MAG130M6 upload=MW4MFLG5WL04 tag=8KHKI0OYEYPB type=write size=2250112 2024-06-04T15:59:34.357 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.356+0000 7f5e9aacc780 1 > prepared part key=_multipart_Q4OFQI0F5YLG.2~JVWGR6QLYSTC.0 size=1048576 2024-06-04T15:59:34.358 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.358+0000 7f5e9aacc780 1 > prepared part key=_multipart_Q4OFQI0F5YLG.2~JVWGR6QLYSTC.1 size=305147 2024-06-04T15:59:34.358 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.358+0000 7f5e9aacc780 1 > prepared multipart upload key=Q4OFQI0F5YLG upload=JVWGR6QLYSTC tag=0V4AVADMZ8VK type=write size=2402299 2024-06-04T15:59:34.359 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.359+0000 7f5e9aacc780 1 < completed delete operation key=PNDPO2WUW7UX tag=ULGRS87GCAPA type=del 2024-06-04T15:59:34.361 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.361+0000 7f5e9aacc780 1 > prepared operation key=UW5LVIBG09SV tag=57XSN1RMPW1P type=del size=1402722 2024-06-04T15:59:34.362 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.362+0000 7f5e9aacc780 1 < completed part key=_multipart_GCPC9OJH7KWU.2~QZI3Z6HC3TP7.0 size=1048576 2024-06-04T15:59:34.364 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.364+0000 7f5e9aacc780 1 < completed part key=_multipart_GCPC9OJH7KWU.2~QZI3Z6HC3TP7.1 size=1048576 2024-06-04T15:59:34.364 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.364+0000 7f5e9aacc780 1 < canceled part key=_multipart_GCPC9OJH7KWU.2~QZI3Z6HC3TP7.2 size=559394 2024-06-04T15:59:34.366 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.366+0000 7f5e9aacc780 1 < canceled multipart upload key=GCPC9OJH7KWU upload=QZI3Z6HC3TP7 tag=3UHEQX60Z0TD type=write size=3705122 2024-06-04T15:59:34.367 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.368+0000 7f5e9aacc780 1 > prepared operation key=A8O0S3S45RGM tag=ZMSCAENSTMSF type=del size=3585904 2024-06-04T15:59:34.369 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.369+0000 7f5e9aacc780 1 < canceled operation key=HD6SNICRCDLL tag=L0MH5LXQJKIQ type=del size=2084176 2024-06-04T15:59:34.370 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.370+0000 7f5e9aacc780 1 > prepared operation key=Q2V1ICTBSCV1 tag=ZHRHGP4PUJ49 type=del size=1438190 2024-06-04T15:59:34.372 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.371+0000 7f5e9aacc780 1 < completed delete operation key=9MPRI6LW3956 tag=M7WPFD9HUDW5 type=del 2024-06-04T15:59:34.373 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.373+0000 7f5e9aacc780 1 > prepared operation key=2BT2AXKB1RTA tag=NOQ6SPFBWDUC type=del size=895099 2024-06-04T15:59:34.375 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.374+0000 7f5e9aacc780 1 < completed part key=_multipart_Q2V1ICTBSCV1.2~8DRUC4DICOOK.0 size=405680 2024-06-04T15:59:34.377 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.377+0000 7f5e9aacc780 1 < completed multipart upload key=Q2V1ICTBSCV1 upload=8DRUC4DICOOK tag=S8D331H9XFMG type=write size=1454256 2024-06-04T15:59:34.379 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.380+0000 7f5e9aacc780 1 > prepared part key=_multipart_Q4OFQI0F5YLG.2~F0NE8Y1FWMXK.0 size=37336 2024-06-04T15:59:34.380 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.380+0000 7f5e9aacc780 1 > prepared multipart upload key=Q4OFQI0F5YLG upload=F0NE8Y1FWMXK tag=4U38Q8X7FBE6 type=write size=1085912 2024-06-04T15:59:34.381 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.381+0000 7f5e9aacc780 1 < completed delete operation key=Q2V1ICTBSCV1 tag=CSZEW3T17A5J type=del 2024-06-04T15:59:34.384 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.384+0000 7f5e9aacc780 1 > prepared part key=_multipart_03ZNYG3WLMP4.2~Q5ZYEBK9KYP1.0 size=1048576 2024-06-04T15:59:34.385 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.384+0000 7f5e9aacc780 1 > prepared part key=_multipart_03ZNYG3WLMP4.2~Q5ZYEBK9KYP1.1 size=477119 2024-06-04T15:59:34.385 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.384+0000 7f5e9aacc780 1 > prepared multipart upload key=03ZNYG3WLMP4 upload=Q5ZYEBK9KYP1 tag=OL8M4H5DG6YD type=write size=2574271 2024-06-04T15:59:34.386 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.386+0000 7f5e9aacc780 1 < completed part key=_multipart_RP8K6QJUZAH1.2~4XTQ3ELYWJIZ.0 size=190650 2024-06-04T15:59:34.389 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.389+0000 7f5e9aacc780 1 < completed multipart upload key=RP8K6QJUZAH1 upload=4XTQ3ELYWJIZ tag=R61LC5DK0VV1 type=write size=1239226 2024-06-04T15:59:34.391 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.391+0000 7f5e9aacc780 1 > prepared part key=_multipart_JL69PUHT6NNT.2~LBFI1CIOX341.0 size=1048576 2024-06-04T15:59:34.392 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.392+0000 7f5e9aacc780 1 > prepared part key=_multipart_JL69PUHT6NNT.2~LBFI1CIOX341.1 size=1048576 2024-06-04T15:59:34.393 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.393+0000 7f5e9aacc780 1 > prepared part key=_multipart_JL69PUHT6NNT.2~LBFI1CIOX341.2 size=22406 2024-06-04T15:59:34.393 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.393+0000 7f5e9aacc780 1 > prepared multipart upload key=JL69PUHT6NNT upload=LBFI1CIOX341 tag=PXD31293KNMV type=write size=3168134 2024-06-04T15:59:34.396 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.395+0000 7f5e9aacc780 1 < suggested remove operation key=HD6SNICRCDLL tag=4HQSR7QJJAH2 type=del 2024-06-04T15:59:34.397 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.397+0000 7f5e9aacc780 1 > prepared operation key=QJA2JPATITNH tag=5ITE3KRHBEHU type=del size=2572941 2024-06-04T15:59:34.398 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.398+0000 7f5e9aacc780 1 < completed part key=_multipart_DY9JWHWNAUO1.2~PURY3NIKDMCV.0 size=1048576 2024-06-04T15:59:34.399 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.399+0000 7f5e9aacc780 1 < completed part key=_multipart_DY9JWHWNAUO1.2~PURY3NIKDMCV.1 size=1048576 2024-06-04T15:59:34.400 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.399+0000 7f5e9aacc780 1 < canceled part key=_multipart_DY9JWHWNAUO1.2~PURY3NIKDMCV.2 size=357980 2024-06-04T15:59:34.402 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.402+0000 7f5e9aacc780 1 < canceled multipart upload key=DY9JWHWNAUO1 upload=PURY3NIKDMCV tag=GA087DE7RO72 type=write size=3503708 2024-06-04T15:59:34.403 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.403+0000 7f5e9aacc780 1 > prepared operation key=QUIVPH3OB6KN tag=ETT8PGDEKZF1 type=del size=1622680 2024-06-04T15:59:34.404 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.404+0000 7f5e9aacc780 1 < completed part key=_multipart_A8O0S3S45RGM.2~UE71D0CW3N5Q.0 size=1048576 2024-06-04T15:59:34.405 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.405+0000 7f5e9aacc780 1 < completed part key=_multipart_A8O0S3S45RGM.2~UE71D0CW3N5Q.1 size=316767 2024-06-04T15:59:34.409 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.408+0000 7f5e9aacc780 1 < completed multipart upload key=A8O0S3S45RGM upload=UE71D0CW3N5Q tag=FFSSVPUAHI4Q type=write size=2413919 2024-06-04T15:59:34.411 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.411+0000 7f5e9aacc780 1 > prepared part key=_multipart_JL69PUHT6NNT.2~PH8Y1CLX1BX5.0 size=1048576 2024-06-04T15:59:34.412 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.412+0000 7f5e9aacc780 1 > prepared part key=_multipart_JL69PUHT6NNT.2~PH8Y1CLX1BX5.1 size=1048576 2024-06-04T15:59:34.413 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.413+0000 7f5e9aacc780 1 > prepared part key=_multipart_JL69PUHT6NNT.2~PH8Y1CLX1BX5.2 size=71363 2024-06-04T15:59:34.414 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.413+0000 7f5e9aacc780 1 > prepared multipart upload key=JL69PUHT6NNT upload=PH8Y1CLX1BX5 tag=BL3I215GXMLB type=write size=3217091 2024-06-04T15:59:34.414 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.414+0000 7f5e9aacc780 1 < canceled part key=_multipart_PASGIP872OVX.2~VKGN6LIDY5IN.0 size=1048576 2024-06-04T15:59:34.415 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.415+0000 7f5e9aacc780 1 < completed part key=_multipart_PASGIP872OVX.2~VKGN6LIDY5IN.1 size=292297 2024-06-04T15:59:34.418 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.418+0000 7f5e9aacc780 1 < canceled multipart upload key=PASGIP872OVX upload=VKGN6LIDY5IN tag=9UGZIO1TF5FP type=write size=2389449 2024-06-04T15:59:34.419 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.419+0000 7f5e9aacc780 1 > prepared operation key=K01DAK0M4I4M tag=G45AIRZLQ0AL type=del size=3372515 2024-06-04T15:59:34.421 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.421+0000 7f5e9aacc780 1 < completed part key=_multipart_A8O0S3S45RGM.2~VQ4HTNVB0KRC.0 size=1048576 2024-06-04T15:59:34.422 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.422+0000 7f5e9aacc780 1 < completed part key=_multipart_A8O0S3S45RGM.2~VQ4HTNVB0KRC.1 size=1048576 2024-06-04T15:59:34.423 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.423+0000 7f5e9aacc780 1 < completed part key=_multipart_A8O0S3S45RGM.2~VQ4HTNVB0KRC.2 size=907435 2024-06-04T15:59:34.425 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.425+0000 7f5e9aacc780 1 < completed multipart upload key=A8O0S3S45RGM upload=VQ4HTNVB0KRC tag=XXQZ9OJD1PSD type=write size=4053163 2024-06-04T15:59:34.427 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.426+0000 7f5e9aacc780 1 > prepared operation key=K01DAK0M4I4M tag=63GFSYWF0DFP type=del size=2548769 2024-06-04T15:59:34.429 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.429+0000 7f5e9aacc780 1 < suggested remove operation key=UTZHANL9ER2Q tag=XB3M9XBQB44M type=del 2024-06-04T15:59:34.431 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.430+0000 7f5e9aacc780 1 > prepared operation key=TUGKW7F4V9NO tag=4YNV7GW5RQ3U type=del size=3990118 2024-06-04T15:59:34.433 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.432+0000 7f5e9aacc780 1 < completed write operation key=B0HK5FJ2RGJE tag=777WB9LJ4K1F type=write size=273347 2024-06-04T15:59:34.434 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.433+0000 7f5e9aacc780 1 > prepared operation key=NHPH4LYPP0LL tag=ZI3TYCU7YUAY type=del size=3401715 2024-06-04T15:59:34.435 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.435+0000 7f5e9aacc780 1 < completed part key=_multipart_PASGIP872OVX.2~Q0BZJYRXDFGF.0 size=553616 2024-06-04T15:59:34.437 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.437+0000 7f5e9aacc780 1 < completed multipart upload key=PASGIP872OVX upload=Q0BZJYRXDFGF tag=VU8B6MNLQBPL type=write size=1602192 2024-06-04T15:59:34.440 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.439+0000 7f5e9aacc780 1 > prepared part key=_multipart_TUGKW7F4V9NO.2~2ZQ9VER2E1LN.0 size=266822 2024-06-04T15:59:34.440 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.439+0000 7f5e9aacc780 1 > prepared multipart upload key=TUGKW7F4V9NO upload=2ZQ9VER2E1LN tag=7J1ULN87392D type=write size=1315398 2024-06-04T15:59:34.441 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.441+0000 7f5e9aacc780 1 < completed part key=_multipart_Q4OFQI0F5YLG.2~JVWGR6QLYSTC.0 size=1048576 2024-06-04T15:59:34.442 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.442+0000 7f5e9aacc780 1 < completed part key=_multipart_Q4OFQI0F5YLG.2~JVWGR6QLYSTC.1 size=305147 2024-06-04T15:59:34.444 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.444+0000 7f5e9aacc780 1 < completed multipart upload key=Q4OFQI0F5YLG upload=JVWGR6QLYSTC tag=0V4AVADMZ8VK type=write size=2402299 2024-06-04T15:59:34.447 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.447+0000 7f5e9aacc780 1 > prepared part key=_multipart_03ZNYG3WLMP4.2~TRL82CNW2TO5.0 size=1048576 2024-06-04T15:59:34.448 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.448+0000 7f5e9aacc780 1 > prepared part key=_multipart_03ZNYG3WLMP4.2~TRL82CNW2TO5.1 size=1048576 2024-06-04T15:59:34.449 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.449+0000 7f5e9aacc780 1 > prepared part key=_multipart_03ZNYG3WLMP4.2~TRL82CNW2TO5.2 size=643672 2024-06-04T15:59:34.449 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.449+0000 7f5e9aacc780 1 > prepared multipart upload key=03ZNYG3WLMP4 upload=TRL82CNW2TO5 tag=CO5EECQ0DSHS type=write size=3789400 2024-06-04T15:59:34.451 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.450+0000 7f5e9aacc780 1 < completed delete operation key=UW5LVIBG09SV tag=57XSN1RMPW1P type=del 2024-06-04T15:59:34.453 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.453+0000 7f5e9aacc780 1 > prepared part key=_multipart_FBV2MAG130M6.2~VN8MC09N5WHP.0 size=1048576 2024-06-04T15:59:34.454 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.454+0000 7f5e9aacc780 1 > prepared part key=_multipart_FBV2MAG130M6.2~VN8MC09N5WHP.1 size=900286 2024-06-04T15:59:34.454 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.454+0000 7f5e9aacc780 1 > prepared multipart upload key=FBV2MAG130M6 upload=VN8MC09N5WHP tag=D7WDTTRH16LA type=write size=2997438 2024-06-04T15:59:34.456 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.456+0000 7f5e9aacc780 1 < completed delete operation key=A8O0S3S45RGM tag=ZMSCAENSTMSF type=del 2024-06-04T15:59:34.457 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.457+0000 7f5e9aacc780 1 > prepared operation key=PNDPO2WUW7UX tag=24XHE5X0AFXI type=del size=1313132 2024-06-04T15:59:34.459 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.458+0000 7f5e9aacc780 1 < completed delete operation key=Q2V1ICTBSCV1 tag=ZHRHGP4PUJ49 type=del 2024-06-04T15:59:34.460 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.460+0000 7f5e9aacc780 1 > prepared operation key=SUBHZJ7HUV3H tag=4AH8I4Z9Q39O type=del size=1704150 2024-06-04T15:59:34.461 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.461+0000 7f5e9aacc780 1 < completed delete operation key=2BT2AXKB1RTA tag=NOQ6SPFBWDUC type=del 2024-06-04T15:59:34.464 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.463+0000 7f5e9aacc780 1 > prepared part key=_multipart_QUIVPH3OB6KN.2~J16O6CP8HQ07.0 size=1048576 2024-06-04T15:59:34.465 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.464+0000 7f5e9aacc780 1 > prepared part key=_multipart_QUIVPH3OB6KN.2~J16O6CP8HQ07.1 size=1048576 2024-06-04T15:59:34.466 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.466+0000 7f5e9aacc780 1 > prepared part key=_multipart_QUIVPH3OB6KN.2~J16O6CP8HQ07.2 size=1036436 2024-06-04T15:59:34.466 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.466+0000 7f5e9aacc780 1 > prepared multipart upload key=QUIVPH3OB6KN upload=J16O6CP8HQ07 tag=CSDRV8MN2M9B type=write size=4182164 2024-06-04T15:59:34.467 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.467+0000 7f5e9aacc780 1 < completed part key=_multipart_Q4OFQI0F5YLG.2~F0NE8Y1FWMXK.0 size=37336 2024-06-04T15:59:34.470 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.470+0000 7f5e9aacc780 1 < completed multipart upload key=Q4OFQI0F5YLG upload=F0NE8Y1FWMXK tag=4U38Q8X7FBE6 type=write size=1085912 2024-06-04T15:59:34.472 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.472+0000 7f5e9aacc780 1 > prepared part key=_multipart_2BT2AXKB1RTA.2~OQDU53D7LGJZ.0 size=1048576 2024-06-04T15:59:34.474 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.473+0000 7f5e9aacc780 1 > prepared part key=_multipart_2BT2AXKB1RTA.2~OQDU53D7LGJZ.1 size=1048576 2024-06-04T15:59:34.475 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.475+0000 7f5e9aacc780 1 > prepared part key=_multipart_2BT2AXKB1RTA.2~OQDU53D7LGJZ.2 size=407750 2024-06-04T15:59:34.475 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.475+0000 7f5e9aacc780 1 > prepared multipart upload key=2BT2AXKB1RTA upload=OQDU53D7LGJZ tag=43YZUV63SWP5 type=write size=3553478 2024-06-04T15:59:34.477 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.476+0000 7f5e9aacc780 1 < completed part key=_multipart_03ZNYG3WLMP4.2~Q5ZYEBK9KYP1.0 size=1048576 2024-06-04T15:59:34.478 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.477+0000 7f5e9aacc780 1 < completed part key=_multipart_03ZNYG3WLMP4.2~Q5ZYEBK9KYP1.1 size=477119 2024-06-04T15:59:34.480 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.480+0000 7f5e9aacc780 1 < completed multipart upload key=03ZNYG3WLMP4 upload=Q5ZYEBK9KYP1 tag=OL8M4H5DG6YD type=write size=2574271 2024-06-04T15:59:34.482 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.482+0000 7f5e9aacc780 1 > prepared part key=_multipart_K01DAK0M4I4M.2~ORHV3DVR2EW4.0 size=341211 2024-06-04T15:59:34.483 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.482+0000 7f5e9aacc780 1 > prepared multipart upload key=K01DAK0M4I4M upload=ORHV3DVR2EW4 tag=NZU9TFWKXM5I type=write size=1389787 2024-06-04T15:59:34.484 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.484+0000 7f5e9aacc780 1 < completed part key=_multipart_JL69PUHT6NNT.2~LBFI1CIOX341.0 size=1048576 2024-06-04T15:59:34.485 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.485+0000 7f5e9aacc780 1 < completed part key=_multipart_JL69PUHT6NNT.2~LBFI1CIOX341.1 size=1048576 2024-06-04T15:59:34.486 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.486+0000 7f5e9aacc780 1 < completed part key=_multipart_JL69PUHT6NNT.2~LBFI1CIOX341.2 size=22406 2024-06-04T15:59:34.489 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.489+0000 7f5e9aacc780 1 < completed multipart upload key=JL69PUHT6NNT upload=LBFI1CIOX341 tag=PXD31293KNMV type=write size=3168134 2024-06-04T15:59:34.490 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.490+0000 7f5e9aacc780 1 > prepared operation key=GCPC9OJH7KWU tag=B6AK88I095KD type=write size=108132 2024-06-04T15:59:34.492 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.491+0000 7f5e9aacc780 1 < completed delete operation key=QJA2JPATITNH tag=5ITE3KRHBEHU type=del 2024-06-04T15:59:34.494 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.494+0000 7f5e9aacc780 1 > prepared part key=_multipart_Q4OFQI0F5YLG.2~TOV4S5LL4JAE.0 size=1048576 2024-06-04T15:59:34.496 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.495+0000 7f5e9aacc780 1 > prepared part key=_multipart_Q4OFQI0F5YLG.2~TOV4S5LL4JAE.1 size=1048576 2024-06-04T15:59:34.497 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.496+0000 7f5e9aacc780 1 > prepared part key=_multipart_Q4OFQI0F5YLG.2~TOV4S5LL4JAE.2 size=343542 2024-06-04T15:59:34.497 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.496+0000 7f5e9aacc780 1 > prepared multipart upload key=Q4OFQI0F5YLG upload=TOV4S5LL4JAE tag=JHDQ37WC1U4C type=write size=3489270 2024-06-04T15:59:34.498 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.498+0000 7f5e9aacc780 1 < completed delete operation key=QUIVPH3OB6KN tag=ETT8PGDEKZF1 type=del 2024-06-04T15:59:34.499 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.499+0000 7f5e9aacc780 1 > prepared operation key=JL69PUHT6NNT tag=KS82HVVXVFSP type=del size=191332 2024-06-04T15:59:34.501 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.500+0000 7f5e9aacc780 1 < completed part key=_multipart_JL69PUHT6NNT.2~PH8Y1CLX1BX5.0 size=1048576 2024-06-04T15:59:34.502 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.502+0000 7f5e9aacc780 1 < completed part key=_multipart_JL69PUHT6NNT.2~PH8Y1CLX1BX5.1 size=1048576 2024-06-04T15:59:34.503 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.503+0000 7f5e9aacc780 1 < completed part key=_multipart_JL69PUHT6NNT.2~PH8Y1CLX1BX5.2 size=71363 2024-06-04T15:59:34.505 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.505+0000 7f5e9aacc780 1 < completed multipart upload key=JL69PUHT6NNT upload=PH8Y1CLX1BX5 tag=BL3I215GXMLB type=write size=3217091 2024-06-04T15:59:34.507 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.506+0000 7f5e9aacc780 1 > prepared operation key=4W5HB9WQQHR6 tag=G4I4OV07GM90 type=del size=2183047 2024-06-04T15:59:34.508 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.508+0000 7f5e9aacc780 1 < completed delete operation key=K01DAK0M4I4M tag=G45AIRZLQ0AL type=del 2024-06-04T15:59:34.511 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.510+0000 7f5e9aacc780 1 > prepared part key=_multipart_PNDPO2WUW7UX.2~TV2AQ0O9VO3W.0 size=198671 2024-06-04T15:59:34.511 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.510+0000 7f5e9aacc780 1 > prepared multipart upload key=PNDPO2WUW7UX upload=TV2AQ0O9VO3W tag=74K7ME46LYN9 type=write size=1247247 2024-06-04T15:59:34.512 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.512+0000 7f5e9aacc780 1 < canceled operation key=K01DAK0M4I4M tag=63GFSYWF0DFP type=del size=2548769 2024-06-04T15:59:34.515 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.514+0000 7f5e9aacc780 1 > prepared part key=_multipart_Q4OFQI0F5YLG.2~TBWR3TBNI4UU.0 size=785327 2024-06-04T15:59:34.515 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.514+0000 7f5e9aacc780 1 > prepared multipart upload key=Q4OFQI0F5YLG upload=TBWR3TBNI4UU tag=64V3JAX0MP4S type=write size=1833903 2024-06-04T15:59:34.517 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.517+0000 7f5e9aacc780 1 < suggested remove operation key=TUGKW7F4V9NO tag=4YNV7GW5RQ3U type=del 2024-06-04T15:59:34.519 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.518+0000 7f5e9aacc780 1 > prepared operation key=4W5HB9WQQHR6 tag=I6T2AYJ2X2T6 type=write size=679146 2024-06-04T15:59:34.520 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.520+0000 7f5e9aacc780 1 < canceled operation key=NHPH4LYPP0LL tag=ZI3TYCU7YUAY type=del size=3401715 2024-06-04T15:59:34.522 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.521+0000 7f5e9aacc780 1 > prepared operation key=GTRMEQJK675Z tag=SD0QFL0E4IMO type=del size=683958 2024-06-04T15:59:34.523 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.523+0000 7f5e9aacc780 1 < completed part key=_multipart_TUGKW7F4V9NO.2~2ZQ9VER2E1LN.0 size=266822 2024-06-04T15:59:34.525 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.525+0000 7f5e9aacc780 1 < completed multipart upload key=TUGKW7F4V9NO upload=2ZQ9VER2E1LN tag=7J1ULN87392D type=write size=1315398 2024-06-04T15:59:34.528 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.527+0000 7f5e9aacc780 1 > prepared part key=_multipart_AOCB36Y5Q7B0.2~G55C70JAVTHH.0 size=258431 2024-06-04T15:59:34.528 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.527+0000 7f5e9aacc780 1 > prepared multipart upload key=AOCB36Y5Q7B0 upload=G55C70JAVTHH tag=TH4IU3GLMCZS type=write size=1307007 2024-06-04T15:59:34.528 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.528+0000 7f5e9aacc780 1 < canceled part key=_multipart_03ZNYG3WLMP4.2~TRL82CNW2TO5.0 size=1048576 2024-06-04T15:59:34.529 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.529+0000 7f5e9aacc780 1 < completed part key=_multipart_03ZNYG3WLMP4.2~TRL82CNW2TO5.1 size=1048576 2024-06-04T15:59:34.529 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.529+0000 7f5e9aacc780 1 < canceled part key=_multipart_03ZNYG3WLMP4.2~TRL82CNW2TO5.2 size=643672 2024-06-04T15:59:34.532 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.531+0000 7f5e9aacc780 1 < canceled multipart upload key=03ZNYG3WLMP4 upload=TRL82CNW2TO5 tag=CO5EECQ0DSHS type=write size=3789400 2024-06-04T15:59:34.535 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.534+0000 7f5e9aacc780 1 > prepared part key=_multipart_NHPH4LYPP0LL.2~BVGWQ03CI9B7.0 size=900144 2024-06-04T15:59:34.535 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.534+0000 7f5e9aacc780 1 > prepared multipart upload key=NHPH4LYPP0LL upload=BVGWQ03CI9B7 tag=FQZ1YQZLPAAS type=write size=1948720 2024-06-04T15:59:34.537 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.536+0000 7f5e9aacc780 1 < completed part key=_multipart_FBV2MAG130M6.2~VN8MC09N5WHP.0 size=1048576 2024-06-04T15:59:34.538 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.538+0000 7f5e9aacc780 1 < completed part key=_multipart_FBV2MAG130M6.2~VN8MC09N5WHP.1 size=900286 2024-06-04T15:59:34.540 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.540+0000 7f5e9aacc780 1 < completed multipart upload key=FBV2MAG130M6 upload=VN8MC09N5WHP tag=D7WDTTRH16LA type=write size=2997438 2024-06-04T15:59:34.541 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.541+0000 7f5e9aacc780 1 > prepared operation key=QJA2JPATITNH tag=D4J5EZPEA1WF type=del size=1022425 2024-06-04T15:59:34.543 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.543+0000 7f5e9aacc780 1 < completed delete operation key=PNDPO2WUW7UX tag=24XHE5X0AFXI type=del 2024-06-04T15:59:34.544 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.544+0000 7f5e9aacc780 1 > prepared operation key=W1T4O3EAE7JN tag=KH0LCSBO05VL type=write size=486912 2024-06-04T15:59:34.548 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.547+0000 7f5e9aacc780 1 < suggested remove operation key=SUBHZJ7HUV3H tag=4AH8I4Z9Q39O type=del 2024-06-04T15:59:34.549 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.549+0000 7f5e9aacc780 1 > prepared operation key=7S9S3MIG7WIT tag=TE3ZYFJOQYCR type=del size=2271468 2024-06-04T15:59:34.550 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.550+0000 7f5e9aacc780 1 < completed part key=_multipart_QUIVPH3OB6KN.2~J16O6CP8HQ07.0 size=1048576 2024-06-04T15:59:34.551 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.551+0000 7f5e9aacc780 1 < completed part key=_multipart_QUIVPH3OB6KN.2~J16O6CP8HQ07.1 size=1048576 2024-06-04T15:59:34.553 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.552+0000 7f5e9aacc780 1 < completed part key=_multipart_QUIVPH3OB6KN.2~J16O6CP8HQ07.2 size=1036436 2024-06-04T15:59:34.555 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.554+0000 7f5e9aacc780 1 < completed multipart upload key=QUIVPH3OB6KN upload=J16O6CP8HQ07 tag=CSDRV8MN2M9B type=write size=4182164 2024-06-04T15:59:34.556 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.556+0000 7f5e9aacc780 1 > prepared operation key=UW5LVIBG09SV tag=IZ70H0CYE5WO type=del size=276966 2024-06-04T15:59:34.557 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.557+0000 7f5e9aacc780 1 < completed part key=_multipart_2BT2AXKB1RTA.2~OQDU53D7LGJZ.0 size=1048576 2024-06-04T15:59:34.558 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.558+0000 7f5e9aacc780 1 < completed part key=_multipart_2BT2AXKB1RTA.2~OQDU53D7LGJZ.1 size=1048576 2024-06-04T15:59:34.559 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.559+0000 7f5e9aacc780 1 < completed part key=_multipart_2BT2AXKB1RTA.2~OQDU53D7LGJZ.2 size=407750 2024-06-04T15:59:34.562 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.561+0000 7f5e9aacc780 1 < completed multipart upload key=2BT2AXKB1RTA upload=OQDU53D7LGJZ tag=43YZUV63SWP5 type=write size=3553478 2024-06-04T15:59:34.564 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.564+0000 7f5e9aacc780 1 > prepared part key=_multipart_PNDPO2WUW7UX.2~DD31QCKOSUCB.0 size=1048576 2024-06-04T15:59:34.565 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.565+0000 7f5e9aacc780 1 > prepared part key=_multipart_PNDPO2WUW7UX.2~DD31QCKOSUCB.1 size=690196 2024-06-04T15:59:34.565 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.565+0000 7f5e9aacc780 1 > prepared multipart upload key=PNDPO2WUW7UX upload=DD31QCKOSUCB tag=3MFPP7L4JOQC type=write size=2787348 2024-06-04T15:59:34.566 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.566+0000 7f5e9aacc780 1 < completed part key=_multipart_K01DAK0M4I4M.2~ORHV3DVR2EW4.0 size=341211 2024-06-04T15:59:34.569 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.568+0000 7f5e9aacc780 1 < completed multipart upload key=K01DAK0M4I4M upload=ORHV3DVR2EW4 tag=NZU9TFWKXM5I type=write size=1389787 2024-06-04T15:59:34.570 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.570+0000 7f5e9aacc780 1 > prepared operation key=Q2V1ICTBSCV1 tag=3L3PU8LYZLO6 type=del size=651884 2024-06-04T15:59:34.571 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.571+0000 7f5e9aacc780 1 < canceled operation key=GCPC9OJH7KWU tag=B6AK88I095KD type=write size=108132 2024-06-04T15:59:34.573 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.573+0000 7f5e9aacc780 1 > prepared operation key=B0HK5FJ2RGJE tag=J6511SBNPEFC type=del size=2063368 2024-06-04T15:59:34.574 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.574+0000 7f5e9aacc780 1 < completed part key=_multipart_Q4OFQI0F5YLG.2~TOV4S5LL4JAE.0 size=1048576 2024-06-04T15:59:34.575 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.575+0000 7f5e9aacc780 1 < completed part key=_multipart_Q4OFQI0F5YLG.2~TOV4S5LL4JAE.1 size=1048576 2024-06-04T15:59:34.577 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.576+0000 7f5e9aacc780 1 < completed part key=_multipart_Q4OFQI0F5YLG.2~TOV4S5LL4JAE.2 size=343542 2024-06-04T15:59:34.579 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.579+0000 7f5e9aacc780 1 < completed multipart upload key=Q4OFQI0F5YLG upload=TOV4S5LL4JAE tag=JHDQ37WC1U4C type=write size=3489270 2024-06-04T15:59:34.581 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.581+0000 7f5e9aacc780 1 > prepared operation key=TUGKW7F4V9NO tag=YO42DDVFPICW type=write size=296842 2024-06-04T15:59:34.583 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.584+0000 7f5e9aacc780 1 < suggested update operation key=JL69PUHT6NNT tag=KS82HVVXVFSP type=del size=191332 2024-06-04T15:59:34.585 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.585+0000 7f5e9aacc780 1 > prepared operation key=7S9S3MIG7WIT tag=LSP43V4SHGHR type=del size=226927 2024-06-04T15:59:34.586 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.586+0000 7f5e9aacc780 1 < completed delete operation key=4W5HB9WQQHR6 tag=G4I4OV07GM90 type=del 2024-06-04T15:59:34.588 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.587+0000 7f5e9aacc780 1 > prepared operation key=GTRMEQJK675Z tag=Z6TJTKR5JE02 type=write size=580690 2024-06-04T15:59:34.589 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.589+0000 7f5e9aacc780 1 < completed part key=_multipart_PNDPO2WUW7UX.2~TV2AQ0O9VO3W.0 size=198671 2024-06-04T15:59:34.591 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.591+0000 7f5e9aacc780 1 < completed multipart upload key=PNDPO2WUW7UX upload=TV2AQ0O9VO3W tag=74K7ME46LYN9 type=write size=1247247 2024-06-04T15:59:34.593 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.592+0000 7f5e9aacc780 1 > prepared operation key=DY9JWHWNAUO1 tag=IDZDV8NOBWVX type=del size=1766035 2024-06-04T15:59:34.594 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.594+0000 7f5e9aacc780 1 < completed part key=_multipart_Q4OFQI0F5YLG.2~TBWR3TBNI4UU.0 size=785327 2024-06-04T15:59:34.597 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.596+0000 7f5e9aacc780 1 < completed multipart upload key=Q4OFQI0F5YLG upload=TBWR3TBNI4UU tag=64V3JAX0MP4S type=write size=1833903 2024-06-04T15:59:34.598 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.598+0000 7f5e9aacc780 1 > prepared operation key=9MPRI6LW3956 tag=66WEHCSV50LE type=del size=3022231 2024-06-04T15:59:34.600 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.599+0000 7f5e9aacc780 1 < completed write operation key=4W5HB9WQQHR6 tag=I6T2AYJ2X2T6 type=write size=679146 2024-06-04T15:59:34.602 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.602+0000 7f5e9aacc780 1 > prepared part key=_multipart_QUIVPH3OB6KN.2~U0TBXFYWIW3J.0 size=843597 2024-06-04T15:59:34.602 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.602+0000 7f5e9aacc780 1 > prepared multipart upload key=QUIVPH3OB6KN upload=U0TBXFYWIW3J tag=A1WCOZQSLRNF type=write size=1892173 2024-06-04T15:59:34.604 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.603+0000 7f5e9aacc780 1 < completed delete operation key=GTRMEQJK675Z tag=SD0QFL0E4IMO type=del 2024-06-04T15:59:34.605 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.605+0000 7f5e9aacc780 1 > prepared operation key=B0HK5FJ2RGJE tag=TE12OB5WQPLF type=del size=731930 2024-06-04T15:59:34.606 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.606+0000 7f5e9aacc780 1 < completed part key=_multipart_AOCB36Y5Q7B0.2~G55C70JAVTHH.0 size=258431 2024-06-04T15:59:34.609 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.609+0000 7f5e9aacc780 1 < completed multipart upload key=AOCB36Y5Q7B0 upload=G55C70JAVTHH tag=TH4IU3GLMCZS type=write size=1307007 2024-06-04T15:59:34.610 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.610+0000 7f5e9aacc780 1 > prepared operation key=UTZHANL9ER2Q tag=OMXHM84AAGF0 type=del size=4154793 2024-06-04T15:59:34.611 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.611+0000 7f5e9aacc780 1 < completed part key=_multipart_NHPH4LYPP0LL.2~BVGWQ03CI9B7.0 size=900144 2024-06-04T15:59:34.613 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.613+0000 7f5e9aacc780 1 < completed multipart upload key=NHPH4LYPP0LL upload=BVGWQ03CI9B7 tag=FQZ1YQZLPAAS type=write size=1948720 2024-06-04T15:59:34.616 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.616+0000 7f5e9aacc780 1 > prepared part key=_multipart_A8O0S3S45RGM.2~ERQ7D8951S3K.0 size=182837 2024-06-04T15:59:34.616 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.616+0000 7f5e9aacc780 1 > prepared multipart upload key=A8O0S3S45RGM upload=ERQ7D8951S3K tag=NLJHYJ7XSF1W type=write size=1231413 2024-06-04T15:59:34.618 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.617+0000 7f5e9aacc780 1 < completed delete operation key=QJA2JPATITNH tag=D4J5EZPEA1WF type=del 2024-06-04T15:59:34.619 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.619+0000 7f5e9aacc780 1 > prepared operation key=NHPH4LYPP0LL tag=UVNZREHRWMQY type=del size=2244625 2024-06-04T15:59:34.621 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.621+0000 7f5e9aacc780 1 < completed write operation key=W1T4O3EAE7JN tag=KH0LCSBO05VL type=write size=486912 2024-06-04T15:59:34.624 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.623+0000 7f5e9aacc780 1 > prepared part key=_multipart_Q2V1ICTBSCV1.2~OKYAYVBVSIHK.0 size=766874 2024-06-04T15:59:34.624 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.623+0000 7f5e9aacc780 1 > prepared multipart upload key=Q2V1ICTBSCV1 upload=OKYAYVBVSIHK tag=74XLPLYD0RNE type=write size=1815450 2024-06-04T15:59:34.625 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.625+0000 7f5e9aacc780 1 < completed delete operation key=7S9S3MIG7WIT tag=TE3ZYFJOQYCR type=del 2024-06-04T15:59:34.627 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.626+0000 7f5e9aacc780 1 > prepared operation key=QJA2JPATITNH tag=Y3C0U39LRDH0 type=del size=532264 2024-06-04T15:59:34.629 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.629+0000 7f5e9aacc780 1 < completed delete operation key=UW5LVIBG09SV tag=IZ70H0CYE5WO type=del 2024-06-04T15:59:34.631 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.631+0000 7f5e9aacc780 1 > prepared operation key=GCPC9OJH7KWU tag=YNO48HSJ63PI type=del size=3922603 2024-06-04T15:59:34.632 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.633+0000 7f5e9aacc780 1 < completed part key=_multipart_PNDPO2WUW7UX.2~DD31QCKOSUCB.0 size=1048576 2024-06-04T15:59:34.634 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.633+0000 7f5e9aacc780 1 < completed part key=_multipart_PNDPO2WUW7UX.2~DD31QCKOSUCB.1 size=690196 2024-06-04T15:59:34.636 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.636+0000 7f5e9aacc780 1 < completed multipart upload key=PNDPO2WUW7UX upload=DD31QCKOSUCB tag=3MFPP7L4JOQC type=write size=2787348 2024-06-04T15:59:34.638 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.637+0000 7f5e9aacc780 1 > prepared operation key=UTZHANL9ER2Q tag=M5M6PBX66OKV type=del size=1261391 2024-06-04T15:59:34.639 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.639+0000 7f5e9aacc780 1 < completed delete operation key=Q2V1ICTBSCV1 tag=3L3PU8LYZLO6 type=del 2024-06-04T15:59:34.641 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.640+0000 7f5e9aacc780 1 > prepared operation key=9MPRI6LW3956 tag=1HXVUBSWXNMS type=del size=2063787 2024-06-04T15:59:34.642 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.641+0000 7f5e9aacc780 1 < completed delete operation key=B0HK5FJ2RGJE tag=J6511SBNPEFC type=del 2024-06-04T15:59:34.644 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.644+0000 7f5e9aacc780 1 > prepared part key=_multipart_NHPH4LYPP0LL.2~WL2FDX0LKATU.0 size=1048576 2024-06-04T15:59:34.645 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.645+0000 7f5e9aacc780 1 > prepared part key=_multipart_NHPH4LYPP0LL.2~WL2FDX0LKATU.1 size=127394 2024-06-04T15:59:34.646 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.645+0000 7f5e9aacc780 1 > prepared multipart upload key=NHPH4LYPP0LL upload=WL2FDX0LKATU tag=MH3966IN0RGV type=write size=2224546 2024-06-04T15:59:34.647 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.647+0000 7f5e9aacc780 1 < completed write operation key=TUGKW7F4V9NO tag=YO42DDVFPICW type=write size=296842 2024-06-04T15:59:34.648 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.648+0000 7f5e9aacc780 1 > prepared operation key=4W5HB9WQQHR6 tag=M8ORJL0RRSLL type=del size=2698639 2024-06-04T15:59:34.650 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.650+0000 7f5e9aacc780 1 < completed delete operation key=7S9S3MIG7WIT tag=LSP43V4SHGHR type=del 2024-06-04T15:59:34.651 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.651+0000 7f5e9aacc780 1 > prepared operation key=DY9JWHWNAUO1 tag=3CO1FVQER0NF type=write size=176389 2024-06-04T15:59:34.653 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.653+0000 7f5e9aacc780 1 < completed write operation key=GTRMEQJK675Z tag=Z6TJTKR5JE02 type=write size=580690 2024-06-04T15:59:34.654 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.654+0000 7f5e9aacc780 1 > prepared operation key=NHPH4LYPP0LL tag=BCHHWUT2XKZ7 type=del size=3160972 2024-06-04T15:59:34.656 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.655+0000 7f5e9aacc780 1 < completed delete operation key=DY9JWHWNAUO1 tag=IDZDV8NOBWVX type=del 2024-06-04T15:59:34.657 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.657+0000 7f5e9aacc780 1 > prepared operation key=PCLJXQHJ4HTY tag=A8OCYX421349 type=del size=3833448 2024-06-04T15:59:34.659 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.658+0000 7f5e9aacc780 1 < canceled operation key=9MPRI6LW3956 tag=66WEHCSV50LE type=del size=3022231 2024-06-04T15:59:34.660 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.660+0000 7f5e9aacc780 1 > prepared operation key=SUBHZJ7HUV3H tag=GJHYIM8UPMDL type=del size=806774 2024-06-04T15:59:34.662 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.661+0000 7f5e9aacc780 1 < completed part key=_multipart_QUIVPH3OB6KN.2~U0TBXFYWIW3J.0 size=843597 2024-06-04T15:59:34.664 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.663+0000 7f5e9aacc780 1 < completed multipart upload key=QUIVPH3OB6KN upload=U0TBXFYWIW3J tag=A1WCOZQSLRNF type=write size=1892173 2024-06-04T15:59:34.666 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.666+0000 7f5e9aacc780 1 > prepared part key=_multipart_Q4OFQI0F5YLG.2~L2KSUMGUM4B9.0 size=1048576 2024-06-04T15:59:34.667 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.667+0000 7f5e9aacc780 1 > prepared part key=_multipart_Q4OFQI0F5YLG.2~L2KSUMGUM4B9.1 size=1048576 2024-06-04T15:59:34.668 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.668+0000 7f5e9aacc780 1 > prepared part key=_multipart_Q4OFQI0F5YLG.2~L2KSUMGUM4B9.2 size=710414 2024-06-04T15:59:34.669 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.668+0000 7f5e9aacc780 1 > prepared multipart upload key=Q4OFQI0F5YLG upload=L2KSUMGUM4B9 tag=XOY3IED7G0E6 type=write size=3856142 2024-06-04T15:59:34.671 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.671+0000 7f5e9aacc780 1 < completed delete operation key=B0HK5FJ2RGJE tag=TE12OB5WQPLF type=del 2024-06-04T15:59:34.673 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.673+0000 7f5e9aacc780 1 > prepared operation key=03ZNYG3WLMP4 tag=KML80R6VMIPV type=del size=3369724 2024-06-04T15:59:34.674 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.674+0000 7f5e9aacc780 1 < completed delete operation key=UTZHANL9ER2Q tag=OMXHM84AAGF0 type=del 2024-06-04T15:59:34.676 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.675+0000 7f5e9aacc780 1 > prepared operation key=GTRMEQJK675Z tag=NK8W8EL0TA7P type=del size=3870966 2024-06-04T15:59:34.676 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.676+0000 7f5e9aacc780 1 < canceled part key=_multipart_A8O0S3S45RGM.2~ERQ7D8951S3K.0 size=182837 2024-06-04T15:59:34.679 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.678+0000 7f5e9aacc780 1 < canceled multipart upload key=A8O0S3S45RGM upload=ERQ7D8951S3K tag=NLJHYJ7XSF1W type=write size=1231413 2024-06-04T15:59:34.682 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.682+0000 7f5e9aacc780 1 > prepared part key=_multipart_UTZHANL9ER2Q.2~E29D4DYOE2TP.0 size=3321 2024-06-04T15:59:34.682 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.682+0000 7f5e9aacc780 1 > prepared multipart upload key=UTZHANL9ER2Q upload=E29D4DYOE2TP tag=A8H8W4DGJTKF type=write size=1051897 2024-06-04T15:59:34.683 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.683+0000 7f5e9aacc780 1 < completed delete operation key=NHPH4LYPP0LL tag=UVNZREHRWMQY type=del 2024-06-04T15:59:34.686 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.686+0000 7f5e9aacc780 1 > prepared part key=_multipart_HD6SNICRCDLL.2~2GKQNJUH6U2K.0 size=902686 2024-06-04T15:59:34.686 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.686+0000 7f5e9aacc780 1 > prepared multipart upload key=HD6SNICRCDLL upload=2GKQNJUH6U2K tag=CFVR7PTTXZJF type=write size=1951262 2024-06-04T15:59:34.688 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.687+0000 7f5e9aacc780 1 < completed part key=_multipart_Q2V1ICTBSCV1.2~OKYAYVBVSIHK.0 size=766874 2024-06-04T15:59:34.690 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.690+0000 7f5e9aacc780 1 < completed multipart upload key=Q2V1ICTBSCV1 upload=OKYAYVBVSIHK tag=74XLPLYD0RNE type=write size=1815450 2024-06-04T15:59:34.692 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.692+0000 7f5e9aacc780 1 > prepared operation key=9MPRI6LW3956 tag=VTVPVPVB5ZUT type=write size=864212 2024-06-04T15:59:34.695 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.696+0000 7f5e9aacc780 1 < suggested remove operation key=QJA2JPATITNH tag=Y3C0U39LRDH0 type=del 2024-06-04T15:59:34.697 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.697+0000 7f5e9aacc780 1 > prepared operation key=PNDPO2WUW7UX tag=0FSR5ITSGJZA type=del size=283740 2024-06-04T15:59:34.699 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.698+0000 7f5e9aacc780 1 < completed delete operation key=GCPC9OJH7KWU tag=YNO48HSJ63PI type=del 2024-06-04T15:59:34.700 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.700+0000 7f5e9aacc780 1 > prepared operation key=UW5LVIBG09SV tag=997V2H8B67TX type=del size=909508 2024-06-04T15:59:34.702 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.701+0000 7f5e9aacc780 1 < completed delete operation key=UTZHANL9ER2Q tag=M5M6PBX66OKV type=del 2024-06-04T15:59:34.704 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.703+0000 7f5e9aacc780 1 > prepared operation key=4W5HB9WQQHR6 tag=R3EC0KSNHEN6 type=del size=2237508 2024-06-04T15:59:34.705 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.706+0000 7f5e9aacc780 1 < completed delete operation key=9MPRI6LW3956 tag=1HXVUBSWXNMS type=del 2024-06-04T15:59:34.709 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.708+0000 7f5e9aacc780 1 > prepared part key=_multipart_DY9JWHWNAUO1.2~T1UBWD6VGPPO.0 size=599582 2024-06-04T15:59:34.709 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.708+0000 7f5e9aacc780 1 > prepared multipart upload key=DY9JWHWNAUO1 upload=T1UBWD6VGPPO tag=3998OSAJCKZM type=write size=1648158 2024-06-04T15:59:34.710 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.710+0000 7f5e9aacc780 1 < completed part key=_multipart_NHPH4LYPP0LL.2~WL2FDX0LKATU.0 size=1048576 2024-06-04T15:59:34.711 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.711+0000 7f5e9aacc780 1 < completed part key=_multipart_NHPH4LYPP0LL.2~WL2FDX0LKATU.1 size=127394 2024-06-04T15:59:34.714 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.713+0000 7f5e9aacc780 1 < completed multipart upload key=NHPH4LYPP0LL upload=WL2FDX0LKATU tag=MH3966IN0RGV type=write size=2224546 2024-06-04T15:59:34.715 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.715+0000 7f5e9aacc780 1 > prepared operation key=NJ5U8JTT32QK tag=OHIPX1WU10Y6 type=del size=937974 2024-06-04T15:59:34.718 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.717+0000 7f5e9aacc780 1 < suggested remove operation key=4W5HB9WQQHR6 tag=M8ORJL0RRSLL type=del 2024-06-04T15:59:34.719 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.719+0000 7f5e9aacc780 1 > prepared operation key=1IKNQXU3Y2JJ tag=CY5YGLJTOH1A type=write size=1007217 2024-06-04T15:59:34.722 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.722+0000 7f5e9aacc780 1 < suggested update operation key=DY9JWHWNAUO1 tag=3CO1FVQER0NF type=write size=176389 2024-06-04T15:59:34.725 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.724+0000 7f5e9aacc780 1 > prepared part key=_multipart_1IKNQXU3Y2JJ.2~646G0CE52Y7P.0 size=1048576 2024-06-04T15:59:34.726 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.725+0000 7f5e9aacc780 1 > prepared part key=_multipart_1IKNQXU3Y2JJ.2~646G0CE52Y7P.1 size=497854 2024-06-04T15:59:34.726 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.725+0000 7f5e9aacc780 1 > prepared multipart upload key=1IKNQXU3Y2JJ upload=646G0CE52Y7P tag=73MPW8EQ7HZP type=write size=2595006 2024-06-04T15:59:34.729 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.728+0000 7f5e9aacc780 1 < suggested update operation key=NHPH4LYPP0LL tag=BCHHWUT2XKZ7 type=del size=3160972 2024-06-04T15:59:34.730 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.730+0000 7f5e9aacc780 1 > prepared operation key=UTZHANL9ER2Q tag=F3T6OMOR0HEF type=del size=2308817 2024-06-04T15:59:34.731 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.731+0000 7f5e9aacc780 1 < completed delete operation key=PCLJXQHJ4HTY tag=A8OCYX421349 type=del 2024-06-04T15:59:34.734 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.734+0000 7f5e9aacc780 1 > prepared part key=_multipart_JL69PUHT6NNT.2~HFDL8YN30AM0.0 size=1048576 2024-06-04T15:59:34.735 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.735+0000 7f5e9aacc780 1 > prepared part key=_multipart_JL69PUHT6NNT.2~HFDL8YN30AM0.1 size=874608 2024-06-04T15:59:34.736 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.735+0000 7f5e9aacc780 1 > prepared multipart upload key=JL69PUHT6NNT upload=HFDL8YN30AM0 tag=37DE00Z1N8TM type=write size=2971760 2024-06-04T15:59:34.737 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.737+0000 7f5e9aacc780 1 < completed delete operation key=SUBHZJ7HUV3H tag=GJHYIM8UPMDL type=del 2024-06-04T15:59:34.740 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.740+0000 7f5e9aacc780 1 > prepared part key=_multipart_FBV2MAG130M6.2~Y9AEN5APCF9Z.0 size=1048576 2024-06-04T15:59:34.741 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.740+0000 7f5e9aacc780 1 > prepared part key=_multipart_FBV2MAG130M6.2~Y9AEN5APCF9Z.1 size=1048576 2024-06-04T15:59:34.742 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.741+0000 7f5e9aacc780 1 > prepared part key=_multipart_FBV2MAG130M6.2~Y9AEN5APCF9Z.2 size=1010760 2024-06-04T15:59:34.742 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.742+0000 7f5e9aacc780 1 > prepared multipart upload key=FBV2MAG130M6 upload=Y9AEN5APCF9Z tag=9XMOSERJJIWP type=write size=4156488 2024-06-04T15:59:34.744 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.744+0000 7f5e9aacc780 1 < completed part key=_multipart_Q4OFQI0F5YLG.2~L2KSUMGUM4B9.0 size=1048576 2024-06-04T15:59:34.745 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.745+0000 7f5e9aacc780 1 < completed part key=_multipart_Q4OFQI0F5YLG.2~L2KSUMGUM4B9.1 size=1048576 2024-06-04T15:59:34.746 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.746+0000 7f5e9aacc780 1 < completed part key=_multipart_Q4OFQI0F5YLG.2~L2KSUMGUM4B9.2 size=710414 2024-06-04T15:59:34.749 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.749+0000 7f5e9aacc780 1 < completed multipart upload key=Q4OFQI0F5YLG upload=L2KSUMGUM4B9 tag=XOY3IED7G0E6 type=write size=3856142 2024-06-04T15:59:34.752 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.751+0000 7f5e9aacc780 1 > prepared part key=_multipart_SUBHZJ7HUV3H.2~PM5RCB9UZFBW.0 size=229914 2024-06-04T15:59:34.752 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.751+0000 7f5e9aacc780 1 > prepared multipart upload key=SUBHZJ7HUV3H upload=PM5RCB9UZFBW tag=SUFL3FTG742E type=write size=1278490 2024-06-04T15:59:34.753 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.753+0000 7f5e9aacc780 1 < canceled operation key=03ZNYG3WLMP4 tag=KML80R6VMIPV type=del size=3369724 2024-06-04T15:59:34.754 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.754+0000 7f5e9aacc780 1 > prepared operation key=NHPH4LYPP0LL tag=JY241P2FF0S9 type=write size=550288 2024-06-04T15:59:34.756 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.756+0000 7f5e9aacc780 1 < completed delete operation key=GTRMEQJK675Z tag=NK8W8EL0TA7P type=del 2024-06-04T15:59:34.757 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.757+0000 7f5e9aacc780 1 > prepared operation key=K01DAK0M4I4M tag=8YBF1QJ3YRBO type=write size=959194 2024-06-04T15:59:34.758 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.757+0000 7f5e9aacc780 1 < canceled part key=_multipart_UTZHANL9ER2Q.2~E29D4DYOE2TP.0 size=3321 2024-06-04T15:59:34.760 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.760+0000 7f5e9aacc780 1 < canceled multipart upload key=UTZHANL9ER2Q upload=E29D4DYOE2TP tag=A8H8W4DGJTKF type=write size=1051897 2024-06-04T15:59:34.763 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.762+0000 7f5e9aacc780 1 > prepared part key=_multipart_03ZNYG3WLMP4.2~JLNXTC8197OE.0 size=1048576 2024-06-04T15:59:34.764 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.763+0000 7f5e9aacc780 1 > prepared part key=_multipart_03ZNYG3WLMP4.2~JLNXTC8197OE.1 size=1048576 2024-06-04T15:59:34.765 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.764+0000 7f5e9aacc780 1 > prepared part key=_multipart_03ZNYG3WLMP4.2~JLNXTC8197OE.2 size=441018 2024-06-04T15:59:34.765 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.764+0000 7f5e9aacc780 1 > prepared multipart upload key=03ZNYG3WLMP4 upload=JLNXTC8197OE tag=5VEM49DXENSB type=write size=3586746 2024-06-04T15:59:34.766 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.766+0000 7f5e9aacc780 1 < completed part key=_multipart_HD6SNICRCDLL.2~2GKQNJUH6U2K.0 size=902686 2024-06-04T15:59:34.768 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.769+0000 7f5e9aacc780 1 < completed multipart upload key=HD6SNICRCDLL upload=2GKQNJUH6U2K tag=CFVR7PTTXZJF type=write size=1951262 2024-06-04T15:59:34.770 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.770+0000 7f5e9aacc780 1 > prepared operation key=SUBHZJ7HUV3H tag=4PHF3UEIW2W9 type=del size=1566718 2024-06-04T15:59:34.771 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.771+0000 7f5e9aacc780 1 < completed write operation key=9MPRI6LW3956 tag=VTVPVPVB5ZUT type=write size=864212 2024-06-04T15:59:34.774 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.774+0000 7f5e9aacc780 1 > prepared part key=_multipart_A8O0S3S45RGM.2~QEP0PWFNA783.0 size=235779 2024-06-04T15:59:34.774 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.774+0000 7f5e9aacc780 1 > prepared multipart upload key=A8O0S3S45RGM upload=QEP0PWFNA783 tag=O2LTTLL8KG4H type=write size=1284355 2024-06-04T15:59:34.776 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.775+0000 7f5e9aacc780 1 < completed delete operation key=PNDPO2WUW7UX tag=0FSR5ITSGJZA type=del 2024-06-04T15:59:34.777 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.777+0000 7f5e9aacc780 1 > prepared operation key=B0HK5FJ2RGJE tag=07Z0KBSKPA35 type=del size=3150990 2024-06-04T15:59:34.778 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.778+0000 7f5e9aacc780 1 < completed delete operation key=UW5LVIBG09SV tag=997V2H8B67TX type=del 2024-06-04T15:59:34.842 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.842+0000 7f5e9aacc780 1 > prepared part key=_multipart_2BT2AXKB1RTA.2~I7FOC0Y7N4BX.0 size=1048576 2024-06-04T15:59:34.845 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.844+0000 7f5e9aacc780 1 > prepared part key=_multipart_2BT2AXKB1RTA.2~I7FOC0Y7N4BX.1 size=638679 2024-06-04T15:59:34.845 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.844+0000 7f5e9aacc780 1 > prepared multipart upload key=2BT2AXKB1RTA upload=I7FOC0Y7N4BX tag=60K92GZWHQ29 type=write size=2735831 2024-06-04T15:59:34.846 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.845+0000 7f5e9aacc780 -1 < failed to complete operation key=4W5HB9WQQHR6 tag=R3EC0KSNHEN6 type=del size=2237508: (22) Invalid argument 2024-06-04T15:59:34.847 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.847+0000 7f5e9aacc780 1 > prepared operation key=XH0N984YVGKP tag=W0QXHRM1NV1J type=del size=803811 2024-06-04T15:59:34.849 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.848+0000 7f5e9aacc780 1 < completed part key=_multipart_DY9JWHWNAUO1.2~T1UBWD6VGPPO.0 size=599582 2024-06-04T15:59:34.851 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.851+0000 7f5e9aacc780 1 < completed multipart upload key=DY9JWHWNAUO1 upload=T1UBWD6VGPPO tag=3998OSAJCKZM type=write size=1648158 2024-06-04T15:59:34.853 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.852+0000 7f5e9aacc780 1 > prepared operation key=JL69PUHT6NNT tag=ZRLR67I4048R type=del size=3766964 2024-06-04T15:59:34.855 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.855+0000 7f5e9aacc780 1 < suggested update operation key=NJ5U8JTT32QK tag=OHIPX1WU10Y6 type=del size=937974 2024-06-04T15:59:34.858 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.858+0000 7f5e9aacc780 1 > prepared part key=_multipart_9MPRI6LW3956.2~YPU3W7R5IHO2.0 size=1048576 2024-06-04T15:59:34.859 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.859+0000 7f5e9aacc780 1 > prepared part key=_multipart_9MPRI6LW3956.2~YPU3W7R5IHO2.1 size=921603 2024-06-04T15:59:34.859 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.859+0000 7f5e9aacc780 1 > prepared multipart upload key=9MPRI6LW3956 upload=YPU3W7R5IHO2 tag=IHF0787WP26H type=write size=3018755 2024-06-04T15:59:34.861 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.860+0000 7f5e9aacc780 1 < completed write operation key=1IKNQXU3Y2JJ tag=CY5YGLJTOH1A type=write size=1007217 2024-06-04T15:59:34.864 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.864+0000 7f5e9aacc780 1 > prepared part key=_multipart_UW5LVIBG09SV.2~VQJB15GRMW12.0 size=133466 2024-06-04T15:59:34.864 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.864+0000 7f5e9aacc780 1 > prepared multipart upload key=UW5LVIBG09SV upload=VQJB15GRMW12 tag=PYZ5XO5XPMC3 type=write size=1182042 2024-06-04T15:59:34.865 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.865+0000 7f5e9aacc780 1 < completed part key=_multipart_1IKNQXU3Y2JJ.2~646G0CE52Y7P.0 size=1048576 2024-06-04T15:59:34.866 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.866+0000 7f5e9aacc780 1 < completed part key=_multipart_1IKNQXU3Y2JJ.2~646G0CE52Y7P.1 size=497854 2024-06-04T15:59:34.869 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.868+0000 7f5e9aacc780 1 < completed multipart upload key=1IKNQXU3Y2JJ upload=646G0CE52Y7P tag=73MPW8EQ7HZP type=write size=2595006 2024-06-04T15:59:34.870 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.870+0000 7f5e9aacc780 1 > prepared operation key=Q4OFQI0F5YLG tag=P765SI4IFDUR type=del size=243732 2024-06-04T15:59:34.872 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.871+0000 7f5e9aacc780 1 < completed delete operation key=UTZHANL9ER2Q tag=F3T6OMOR0HEF type=del 2024-06-04T15:59:34.877 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.877+0000 7f5e9aacc780 1 > prepared part key=_multipart_NJ5U8JTT32QK.2~SK0HGDVXFAYU.0 size=791777 2024-06-04T15:59:34.877 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.877+0000 7f5e9aacc780 1 > prepared multipart upload key=NJ5U8JTT32QK upload=SK0HGDVXFAYU tag=SSS8XZWQX8MT type=write size=1840353 2024-06-04T15:59:34.877 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.877+0000 7f5e9aacc780 1 < canceled part key=_multipart_JL69PUHT6NNT.2~HFDL8YN30AM0.0 size=1048576 2024-06-04T15:59:34.879 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.878+0000 7f5e9aacc780 1 < completed part key=_multipart_JL69PUHT6NNT.2~HFDL8YN30AM0.1 size=874608 2024-06-04T15:59:34.881 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.881+0000 7f5e9aacc780 1 < canceled multipart upload key=JL69PUHT6NNT upload=HFDL8YN30AM0 tag=37DE00Z1N8TM type=write size=2971760 2024-06-04T15:59:34.883 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.883+0000 7f5e9aacc780 1 > prepared operation key=Q2V1ICTBSCV1 tag=27K4KJ8NPADY type=del size=410851 2024-06-04T15:59:34.884 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.884+0000 7f5e9aacc780 1 < completed part key=_multipart_FBV2MAG130M6.2~Y9AEN5APCF9Z.0 size=1048576 2024-06-04T15:59:34.886 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.885+0000 7f5e9aacc780 1 < completed part key=_multipart_FBV2MAG130M6.2~Y9AEN5APCF9Z.1 size=1048576 2024-06-04T15:59:34.887 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.886+0000 7f5e9aacc780 1 < completed part key=_multipart_FBV2MAG130M6.2~Y9AEN5APCF9Z.2 size=1010760 2024-06-04T15:59:34.889 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.889+0000 7f5e9aacc780 1 < completed multipart upload key=FBV2MAG130M6 upload=Y9AEN5APCF9Z tag=9XMOSERJJIWP type=write size=4156488 2024-06-04T15:59:34.891 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.891+0000 7f5e9aacc780 1 > prepared operation key=4W5HB9WQQHR6 tag=HHVRAIFF4EWG type=del size=4127539 2024-06-04T15:59:34.892 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.892+0000 7f5e9aacc780 1 < completed part key=_multipart_SUBHZJ7HUV3H.2~PM5RCB9UZFBW.0 size=229914 2024-06-04T15:59:34.895 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.895+0000 7f5e9aacc780 1 < completed multipart upload key=SUBHZJ7HUV3H upload=PM5RCB9UZFBW tag=SUFL3FTG742E type=write size=1278490 2024-06-04T15:59:34.896 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.896+0000 7f5e9aacc780 1 > prepared operation key=4W5HB9WQQHR6 tag=F9ZRYP1CYNTQ type=del size=1912736 2024-06-04T15:59:34.898 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.898+0000 7f5e9aacc780 1 < completed write operation key=NHPH4LYPP0LL tag=JY241P2FF0S9 type=write size=550288 2024-06-04T15:59:34.899 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.899+0000 7f5e9aacc780 1 > prepared operation key=QUIVPH3OB6KN tag=UCORKENUZ0VW type=del size=2207099 2024-06-04T15:59:34.901 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.901+0000 7f5e9aacc780 1 < completed write operation key=K01DAK0M4I4M tag=8YBF1QJ3YRBO type=write size=959194 2024-06-04T15:59:34.903 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.902+0000 7f5e9aacc780 1 > prepared operation key=W1T4O3EAE7JN tag=I246BN267W5L type=del size=2719678 2024-06-04T15:59:34.904 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.904+0000 7f5e9aacc780 1 < completed part key=_multipart_03ZNYG3WLMP4.2~JLNXTC8197OE.0 size=1048576 2024-06-04T15:59:34.905 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.906+0000 7f5e9aacc780 1 < completed part key=_multipart_03ZNYG3WLMP4.2~JLNXTC8197OE.1 size=1048576 2024-06-04T15:59:34.907 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.907+0000 7f5e9aacc780 1 < completed part key=_multipart_03ZNYG3WLMP4.2~JLNXTC8197OE.2 size=441018 2024-06-04T15:59:34.909 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.909+0000 7f5e9aacc780 1 < completed multipart upload key=03ZNYG3WLMP4 upload=JLNXTC8197OE tag=5VEM49DXENSB type=write size=3586746 2024-06-04T15:59:34.911 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.910+0000 7f5e9aacc780 1 > prepared operation key=K01DAK0M4I4M tag=MPSZS86VPZPC type=del size=2292891 2024-06-04T15:59:34.912 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.912+0000 7f5e9aacc780 1 < completed delete operation key=SUBHZJ7HUV3H tag=4PHF3UEIW2W9 type=del 2024-06-04T15:59:34.914 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.913+0000 7f5e9aacc780 1 > prepared operation key=QUIVPH3OB6KN tag=N2BG2CRI551O type=del size=3885391 2024-06-04T15:59:34.915 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.915+0000 7f5e9aacc780 1 < completed part key=_multipart_A8O0S3S45RGM.2~QEP0PWFNA783.0 size=235779 2024-06-04T15:59:34.917 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.917+0000 7f5e9aacc780 1 < completed multipart upload key=A8O0S3S45RGM upload=QEP0PWFNA783 tag=O2LTTLL8KG4H type=write size=1284355 2024-06-04T15:59:34.920 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.919+0000 7f5e9aacc780 1 > prepared part key=_multipart_PNDPO2WUW7UX.2~0HSYANDW38RT.0 size=1048576 2024-06-04T15:59:34.921 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.920+0000 7f5e9aacc780 1 > prepared part key=_multipart_PNDPO2WUW7UX.2~0HSYANDW38RT.1 size=1048576 2024-06-04T15:59:34.922 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.921+0000 7f5e9aacc780 1 > prepared part key=_multipart_PNDPO2WUW7UX.2~0HSYANDW38RT.2 size=62465 2024-06-04T15:59:34.922 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.921+0000 7f5e9aacc780 1 > prepared multipart upload key=PNDPO2WUW7UX upload=0HSYANDW38RT tag=K4HUXZO32KN3 type=write size=3208193 2024-06-04T15:59:34.923 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.923+0000 7f5e9aacc780 1 < completed delete operation key=B0HK5FJ2RGJE tag=07Z0KBSKPA35 type=del 2024-06-04T15:59:34.925 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.925+0000 7f5e9aacc780 1 > prepared part key=_multipart_2BT2AXKB1RTA.2~G3QIKSK30LV6.0 size=1048576 2024-06-04T15:59:34.926 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.926+0000 7f5e9aacc780 1 > prepared part key=_multipart_2BT2AXKB1RTA.2~G3QIKSK30LV6.1 size=531259 2024-06-04T15:59:34.926 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.926+0000 7f5e9aacc780 1 > prepared multipart upload key=2BT2AXKB1RTA upload=G3QIKSK30LV6 tag=S0UMVTUO02DR type=write size=2628411 2024-06-04T15:59:34.928 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.927+0000 7f5e9aacc780 1 < completed part key=_multipart_2BT2AXKB1RTA.2~I7FOC0Y7N4BX.0 size=1048576 2024-06-04T15:59:34.929 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.929+0000 7f5e9aacc780 1 < completed part key=_multipart_2BT2AXKB1RTA.2~I7FOC0Y7N4BX.1 size=638679 2024-06-04T15:59:34.931 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.931+0000 7f5e9aacc780 1 < completed multipart upload key=2BT2AXKB1RTA upload=I7FOC0Y7N4BX tag=60K92GZWHQ29 type=write size=2735831 2024-06-04T15:59:34.932 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.932+0000 7f5e9aacc780 1 > prepared operation key=03ZNYG3WLMP4 tag=GNJX0Q1INGO5 type=del size=2722753 2024-06-04T15:59:34.934 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.934+0000 7f5e9aacc780 1 < canceled operation key=XH0N984YVGKP tag=W0QXHRM1NV1J type=del size=803811 2024-06-04T15:59:34.936 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.935+0000 7f5e9aacc780 1 > prepared operation key=GCPC9OJH7KWU tag=S8QNOFRR41KI type=del size=3472728 2024-06-04T15:59:34.937 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.937+0000 7f5e9aacc780 1 < completed delete operation key=JL69PUHT6NNT tag=ZRLR67I4048R type=del 2024-06-04T15:59:34.939 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.939+0000 7f5e9aacc780 1 > prepared operation key=1IKNQXU3Y2JJ tag=UT5KULIEQ0NK type=del size=1068087 2024-06-04T15:59:34.940 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.940+0000 7f5e9aacc780 1 < completed part key=_multipart_9MPRI6LW3956.2~YPU3W7R5IHO2.0 size=1048576 2024-06-04T15:59:34.942 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.941+0000 7f5e9aacc780 1 < completed part key=_multipart_9MPRI6LW3956.2~YPU3W7R5IHO2.1 size=921603 2024-06-04T15:59:34.944 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.944+0000 7f5e9aacc780 1 < completed multipart upload key=9MPRI6LW3956 upload=YPU3W7R5IHO2 tag=IHF0787WP26H type=write size=3018755 2024-06-04T15:59:34.947 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.947+0000 7f5e9aacc780 1 > prepared part key=_multipart_03ZNYG3WLMP4.2~UU4D3Z57RUA6.0 size=1048576 2024-06-04T15:59:34.948 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.948+0000 7f5e9aacc780 1 > prepared part key=_multipart_03ZNYG3WLMP4.2~UU4D3Z57RUA6.1 size=893328 2024-06-04T15:59:34.948 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.948+0000 7f5e9aacc780 1 > prepared multipart upload key=03ZNYG3WLMP4 upload=UU4D3Z57RUA6 tag=Q13YH2ALE9EI type=write size=2990480 2024-06-04T15:59:34.950 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.949+0000 7f5e9aacc780 1 < completed part key=_multipart_UW5LVIBG09SV.2~VQJB15GRMW12.0 size=133466 2024-06-04T15:59:34.952 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.952+0000 7f5e9aacc780 1 < completed multipart upload key=UW5LVIBG09SV upload=VQJB15GRMW12 tag=PYZ5XO5XPMC3 type=write size=1182042 2024-06-04T15:59:34.954 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.953+0000 7f5e9aacc780 1 > prepared operation key=AOCB36Y5Q7B0 tag=JOEG1TAW3QS8 type=del size=65449 2024-06-04T15:59:34.956 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.956+0000 7f5e9aacc780 1 < completed delete operation key=Q4OFQI0F5YLG tag=P765SI4IFDUR type=del 2024-06-04T15:59:34.957 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.957+0000 7f5e9aacc780 1 > prepared operation key=PNDPO2WUW7UX tag=UMU3NO8POG7I type=del size=1065249 2024-06-04T15:59:34.959 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.959+0000 7f5e9aacc780 1 < completed part key=_multipart_NJ5U8JTT32QK.2~SK0HGDVXFAYU.0 size=791777 2024-06-04T15:59:34.962 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.961+0000 7f5e9aacc780 1 < completed multipart upload key=NJ5U8JTT32QK upload=SK0HGDVXFAYU tag=SSS8XZWQX8MT type=write size=1840353 2024-06-04T15:59:34.964 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.964+0000 7f5e9aacc780 1 > prepared part key=_multipart_UW5LVIBG09SV.2~OG4EG61U2TV1.0 size=1048576 2024-06-04T15:59:34.965 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.965+0000 7f5e9aacc780 1 > prepared part key=_multipart_UW5LVIBG09SV.2~OG4EG61U2TV1.1 size=1048576 2024-06-04T15:59:34.966 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.966+0000 7f5e9aacc780 1 > prepared part key=_multipart_UW5LVIBG09SV.2~OG4EG61U2TV1.2 size=228962 2024-06-04T15:59:34.966 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.966+0000 7f5e9aacc780 1 > prepared multipart upload key=UW5LVIBG09SV upload=OG4EG61U2TV1 tag=4C0NTFAZVW57 type=write size=3374690 2024-06-04T15:59:34.968 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.967+0000 7f5e9aacc780 1 < completed delete operation key=Q2V1ICTBSCV1 tag=27K4KJ8NPADY type=del 2024-06-04T15:59:34.969 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.969+0000 7f5e9aacc780 1 > prepared operation key=B0HK5FJ2RGJE tag=ZHGFC61BUFQS type=del size=3066592 2024-06-04T15:59:34.972 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.972+0000 7f5e9aacc780 1 < suggested update operation key=4W5HB9WQQHR6 tag=HHVRAIFF4EWG type=del size=4127539 2024-06-04T15:59:34.973 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.973+0000 7f5e9aacc780 1 > prepared operation key=PNDPO2WUW7UX tag=6GITI53DF971 type=del size=1156308 2024-06-04T15:59:34.975 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.975+0000 7f5e9aacc780 -1 < failed to complete operation key=4W5HB9WQQHR6 tag=F9ZRYP1CYNTQ type=del size=1912736: (22) Invalid argument 2024-06-04T15:59:34.977 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.976+0000 7f5e9aacc780 1 > prepared operation key=W1T4O3EAE7JN tag=UOIUAQ0S71WS type=del size=2380046 2024-06-04T15:59:34.978 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.979+0000 7f5e9aacc780 1 < completed delete operation key=QUIVPH3OB6KN tag=UCORKENUZ0VW type=del 2024-06-04T15:59:34.980 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.980+0000 7f5e9aacc780 1 > prepared operation key=JL69PUHT6NNT tag=WDAXOGJZ2D70 type=del size=2995089 2024-06-04T15:59:34.984 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.983+0000 7f5e9aacc780 1 < suggested update operation key=W1T4O3EAE7JN tag=I246BN267W5L type=del size=2719678 2024-06-04T15:59:34.986 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.985+0000 7f5e9aacc780 1 > prepared operation key=PASGIP872OVX tag=BVDX42XLH6CV type=del size=420243 2024-06-04T15:59:34.987 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.988+0000 7f5e9aacc780 1 < completed delete operation key=K01DAK0M4I4M tag=MPSZS86VPZPC type=del 2024-06-04T15:59:34.989 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.989+0000 7f5e9aacc780 1 > prepared operation key=QJA2JPATITNH tag=UDHPQD05FBNJ type=del size=495805 2024-06-04T15:59:34.991 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.990+0000 7f5e9aacc780 1 < completed delete operation key=QUIVPH3OB6KN tag=N2BG2CRI551O type=del 2024-06-04T15:59:34.993 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.993+0000 7f5e9aacc780 1 > prepared part key=_multipart_PASGIP872OVX.2~61VOVZM54FT6.0 size=1048576 2024-06-04T15:59:34.994 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.994+0000 7f5e9aacc780 1 > prepared part key=_multipart_PASGIP872OVX.2~61VOVZM54FT6.1 size=1048576 2024-06-04T15:59:34.996 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.995+0000 7f5e9aacc780 1 > prepared part key=_multipart_PASGIP872OVX.2~61VOVZM54FT6.2 size=728867 2024-06-04T15:59:34.996 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.995+0000 7f5e9aacc780 1 > prepared multipart upload key=PASGIP872OVX upload=61VOVZM54FT6 tag=H5TVEMA72VPT type=write size=3874595 2024-06-04T15:59:34.997 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.997+0000 7f5e9aacc780 1 < completed part key=_multipart_PNDPO2WUW7UX.2~0HSYANDW38RT.0 size=1048576 2024-06-04T15:59:34.998 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.998+0000 7f5e9aacc780 1 < completed part key=_multipart_PNDPO2WUW7UX.2~0HSYANDW38RT.1 size=1048576 2024-06-04T15:59:34.999 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:34.999+0000 7f5e9aacc780 1 < completed part key=_multipart_PNDPO2WUW7UX.2~0HSYANDW38RT.2 size=62465 2024-06-04T15:59:35.001 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:35.001+0000 7f5e9aacc780 1 < completed multipart upload key=PNDPO2WUW7UX upload=0HSYANDW38RT tag=K4HUXZO32KN3 type=write size=3208193 2024-06-04T15:59:35.003 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:35.003+0000 7f5e9aacc780 1 > prepared operation key=QJA2JPATITNH tag=0675NMZZH3TN type=del size=2748497 2024-06-04T15:59:35.005 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:35.004+0000 7f5e9aacc780 1 < completed part key=_multipart_2BT2AXKB1RTA.2~G3QIKSK30LV6.0 size=1048576 2024-06-04T15:59:35.006 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:35.006+0000 7f5e9aacc780 1 < completed part key=_multipart_2BT2AXKB1RTA.2~G3QIKSK30LV6.1 size=531259 2024-06-04T15:59:35.009 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:35.008+0000 7f5e9aacc780 1 < completed multipart upload key=2BT2AXKB1RTA upload=G3QIKSK30LV6 tag=S0UMVTUO02DR type=write size=2628411 2024-06-04T15:59:35.010 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:35.010+0000 7f5e9aacc780 1 > prepared operation key=GCPC9OJH7KWU tag=YMFHCI50V9IW type=del size=2428941 2024-06-04T15:59:35.012 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:35.011+0000 7f5e9aacc780 1 < completed delete operation key=03ZNYG3WLMP4 tag=GNJX0Q1INGO5 type=del 2024-06-04T15:59:35.013 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:35.013+0000 7f5e9aacc780 1 > prepared operation key=A8O0S3S45RGM tag=UFHB02JRCEXM type=write size=1025660 2024-06-04T15:59:35.016 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:35.015+0000 7f5e9aacc780 1 < completed delete operation key=GCPC9OJH7KWU tag=S8QNOFRR41KI type=del 2024-06-04T15:59:35.018 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:35.018+0000 7f5e9aacc780 1 > prepared part key=_multipart_XH0N984YVGKP.2~C4ILC5LVEA1D.0 size=1048576 2024-06-04T15:59:35.020 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:35.019+0000 7f5e9aacc780 1 > prepared part key=_multipart_XH0N984YVGKP.2~C4ILC5LVEA1D.1 size=1048576 2024-06-04T15:59:35.021 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:35.021+0000 7f5e9aacc780 1 > prepared part key=_multipart_XH0N984YVGKP.2~C4ILC5LVEA1D.2 size=24874 2024-06-04T15:59:35.021 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:35.021+0000 7f5e9aacc780 1 > prepared multipart upload key=XH0N984YVGKP upload=C4ILC5LVEA1D tag=NCD835ZN360H type=write size=3170602 2024-06-04T15:59:35.024 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:35.023+0000 7f5e9aacc780 1 < suggested update operation key=1IKNQXU3Y2JJ tag=UT5KULIEQ0NK type=del size=1068087 2024-06-04T15:59:35.025 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:35.025+0000 7f5e9aacc780 1 > prepared operation key=K01DAK0M4I4M tag=GDM5GT9LQQ2M type=del size=1363664 2024-06-04T15:59:35.026 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:35.026+0000 7f5e9aacc780 1 < completed part key=_multipart_03ZNYG3WLMP4.2~UU4D3Z57RUA6.0 size=1048576 2024-06-04T15:59:35.027 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:35.027+0000 7f5e9aacc780 1 < completed part key=_multipart_03ZNYG3WLMP4.2~UU4D3Z57RUA6.1 size=893328 2024-06-04T15:59:35.030 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:35.029+0000 7f5e9aacc780 1 < completed multipart upload key=03ZNYG3WLMP4 upload=UU4D3Z57RUA6 tag=Q13YH2ALE9EI type=write size=2990480 2024-06-04T15:59:35.032 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:35.032+0000 7f5e9aacc780 1 > prepared part key=_multipart_SUBHZJ7HUV3H.2~S425AEZHO7MV.0 size=1048576 2024-06-04T15:59:35.033 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:35.033+0000 7f5e9aacc780 1 > prepared part key=_multipart_SUBHZJ7HUV3H.2~S425AEZHO7MV.1 size=1048576 2024-06-04T15:59:35.034 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:35.034+0000 7f5e9aacc780 1 > prepared part key=_multipart_SUBHZJ7HUV3H.2~S425AEZHO7MV.2 size=955927 2024-06-04T15:59:35.034 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:35.034+0000 7f5e9aacc780 1 > prepared multipart upload key=SUBHZJ7HUV3H upload=S425AEZHO7MV tag=EBTMTCOQMMU5 type=write size=4101655 2024-06-04T15:59:35.036 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:35.035+0000 7f5e9aacc780 1 < completed delete operation key=AOCB36Y5Q7B0 tag=JOEG1TAW3QS8 type=del 2024-06-04T15:59:35.037 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:35.037+0000 7f5e9aacc780 1 > prepared operation key=PNDPO2WUW7UX tag=Q07I9UWI5NUO type=del size=1468079 2024-06-04T15:59:35.040 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:35.040+0000 7f5e9aacc780 1 < suggested remove operation key=PNDPO2WUW7UX tag=UMU3NO8POG7I type=del 2024-06-04T15:59:35.043 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:35.043+0000 7f5e9aacc780 1 > prepared part key=_multipart_A8O0S3S45RGM.2~PMTT0IT9GMHX.0 size=1048576 2024-06-04T15:59:35.044 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:35.044+0000 7f5e9aacc780 1 > prepared part key=_multipart_A8O0S3S45RGM.2~PMTT0IT9GMHX.1 size=659628 2024-06-04T15:59:35.044 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:35.044+0000 7f5e9aacc780 1 > prepared multipart upload key=A8O0S3S45RGM upload=PMTT0IT9GMHX tag=N24YKR7KVY4M type=write size=2756780 2024-06-04T15:59:35.046 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:35.046+0000 7f5e9aacc780 1 < completed part key=_multipart_UW5LVIBG09SV.2~OG4EG61U2TV1.0 size=1048576 2024-06-04T15:59:35.049 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:35.047+0000 7f5e9aacc780 1 < completed part key=_multipart_UW5LVIBG09SV.2~OG4EG61U2TV1.1 size=1048576 2024-06-04T15:59:35.049 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:35.048+0000 7f5e9aacc780 1 < completed part key=_multipart_UW5LVIBG09SV.2~OG4EG61U2TV1.2 size=228962 2024-06-04T15:59:35.050 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:35.050+0000 7f5e9aacc780 1 < completed multipart upload key=UW5LVIBG09SV upload=OG4EG61U2TV1 tag=4C0NTFAZVW57 type=write size=3374690 2024-06-04T15:59:35.052 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:35.051+0000 7f5e9aacc780 1 > prepared operation key=SUBHZJ7HUV3H tag=4IHRMVV3ESNP type=del size=2400111 2024-06-04T15:59:35.053 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:35.053+0000 7f5e9aacc780 1 < completed delete operation key=B0HK5FJ2RGJE tag=ZHGFC61BUFQS type=del 2024-06-04T15:59:35.054 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:35.054+0000 7f5e9aacc780 1 > prepared operation key=03ZNYG3WLMP4 tag=YXF9F2TNCKZT type=write size=873195 2024-06-04T15:59:35.055 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:35.055+0000 7f5e9aacc780 -1 < no bi entry to suggest for operation key=PNDPO2WUW7UX tag=6GITI53DF971 type=del size=1156308: (2) No such file or directory 2024-06-04T15:59:35.056 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:35.056+0000 7f5e9aacc780 1 > prepared operation key=UTZHANL9ER2Q tag=236CB3DXUSUA type=del size=2690590 2024-06-04T15:59:35.058 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:35.057+0000 7f5e9aacc780 -1 < failed to complete operation key=W1T4O3EAE7JN tag=UOIUAQ0S71WS type=del size=2380046: (22) Invalid argument 2024-06-04T15:59:35.060 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:35.060+0000 7f5e9aacc780 1 > prepared part key=_multipart_Q2V1ICTBSCV1.2~AHTEKKHNCDXA.0 size=1048576 2024-06-04T15:59:35.061 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:35.061+0000 7f5e9aacc780 1 > prepared part key=_multipart_Q2V1ICTBSCV1.2~AHTEKKHNCDXA.1 size=1048576 2024-06-04T15:59:35.062 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:35.062+0000 7f5e9aacc780 1 > prepared part key=_multipart_Q2V1ICTBSCV1.2~AHTEKKHNCDXA.2 size=285532 2024-06-04T15:59:35.062 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:35.062+0000 7f5e9aacc780 1 > prepared multipart upload key=Q2V1ICTBSCV1 upload=AHTEKKHNCDXA tag=R7XTZQ96S2S1 type=write size=3431260 2024-06-04T15:59:35.064 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:35.064+0000 7f5e9aacc780 1 < completed delete operation key=JL69PUHT6NNT tag=WDAXOGJZ2D70 type=del 2024-06-04T15:59:35.065 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:35.065+0000 7f5e9aacc780 1 > prepared operation key=GTRMEQJK675Z tag=Q8U7GAEQJEUS type=del size=3489672 2024-06-04T15:59:35.068 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:35.068+0000 7f5e9aacc780 1 < suggested update operation key=PASGIP872OVX tag=BVDX42XLH6CV type=del size=420243 2024-06-04T15:59:35.070 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:35.069+0000 7f5e9aacc780 1 > prepared operation key=W1T4O3EAE7JN tag=52REPUORB4HC type=del size=1774925 2024-06-04T15:59:35.071 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:35.071+0000 7f5e9aacc780 1 < completed delete operation key=QJA2JPATITNH tag=UDHPQD05FBNJ type=del 2024-06-04T15:59:35.072 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:35.072+0000 7f5e9aacc780 1 > prepared operation key=NJ5U8JTT32QK tag=RH2KCFOKGRZZ type=del size=3784770 2024-06-04T15:59:35.074 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:35.074+0000 7f5e9aacc780 1 < completed part key=_multipart_PASGIP872OVX.2~61VOVZM54FT6.0 size=1048576 2024-06-04T15:59:35.075 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:35.075+0000 7f5e9aacc780 1 < completed part key=_multipart_PASGIP872OVX.2~61VOVZM54FT6.1 size=1048576 2024-06-04T15:59:35.076 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:35.076+0000 7f5e9aacc780 1 < completed part key=_multipart_PASGIP872OVX.2~61VOVZM54FT6.2 size=728867 2024-06-04T15:59:35.079 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:35.078+0000 7f5e9aacc780 1 < completed multipart upload key=PASGIP872OVX upload=61VOVZM54FT6 tag=H5TVEMA72VPT type=write size=3874595 2024-06-04T15:59:35.080 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:35.080+0000 7f5e9aacc780 1 > prepared operation key=PASGIP872OVX tag=1RGPFYOHJ8AE type=del size=2362333 2024-06-04T15:59:35.082 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:35.081+0000 7f5e9aacc780 1 < completed delete operation key=QJA2JPATITNH tag=0675NMZZH3TN type=del 2024-06-04T15:59:35.083 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:35.083+0000 7f5e9aacc780 1 > prepared operation key=QJA2JPATITNH tag=BNITDD5A7SWM type=del size=59287 2024-06-04T15:59:35.086 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:35.085+0000 7f5e9aacc780 1 < suggested update operation key=GCPC9OJH7KWU tag=YMFHCI50V9IW type=del size=2428941 2024-06-04T15:59:35.088 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:35.089+0000 7f5e9aacc780 1 > prepared part key=_multipart_NJ5U8JTT32QK.2~3JGLVFSH8QOH.0 size=1048576 2024-06-04T15:59:35.091 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:35.091+0000 7f5e9aacc780 1 > prepared part key=_multipart_NJ5U8JTT32QK.2~3JGLVFSH8QOH.1 size=97679 2024-06-04T15:59:35.091 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:35.091+0000 7f5e9aacc780 1 > prepared multipart upload key=NJ5U8JTT32QK upload=3JGLVFSH8QOH tag=XLUW419NUE2S type=write size=2194831 2024-06-04T15:59:35.093 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:35.093+0000 7f5e9aacc780 1 < completed write operation key=A8O0S3S45RGM tag=UFHB02JRCEXM type=write size=1025660 2024-06-04T15:59:35.094 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:35.094+0000 7f5e9aacc780 1 > prepared operation key=RP8K6QJUZAH1 tag=MKJXZ9BQEU4G type=del size=533670 2024-06-04T15:59:35.095 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:35.095+0000 7f5e9aacc780 1 < completed part key=_multipart_XH0N984YVGKP.2~C4ILC5LVEA1D.0 size=1048576 2024-06-04T15:59:35.097 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:35.096+0000 7f5e9aacc780 1 < completed part key=_multipart_XH0N984YVGKP.2~C4ILC5LVEA1D.1 size=1048576 2024-06-04T15:59:35.098 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:35.097+0000 7f5e9aacc780 1 < completed part key=_multipart_XH0N984YVGKP.2~C4ILC5LVEA1D.2 size=24874 2024-06-04T15:59:35.100 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:35.100+0000 7f5e9aacc780 1 < completed multipart upload key=XH0N984YVGKP upload=C4ILC5LVEA1D tag=NCD835ZN360H type=write size=3170602 2024-06-04T15:59:35.103 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:35.103+0000 7f5e9aacc780 1 > prepared part key=_multipart_JL69PUHT6NNT.2~1C8HEW815QYQ.0 size=1048576 2024-06-04T15:59:35.104 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:35.103+0000 7f5e9aacc780 1 > prepared part key=_multipart_JL69PUHT6NNT.2~1C8HEW815QYQ.1 size=1048576 2024-06-04T15:59:35.105 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:35.105+0000 7f5e9aacc780 1 > prepared part key=_multipart_JL69PUHT6NNT.2~1C8HEW815QYQ.2 size=977926 2024-06-04T15:59:35.105 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:35.105+0000 7f5e9aacc780 1 > prepared multipart upload key=JL69PUHT6NNT upload=1C8HEW815QYQ tag=LH192JR2ZT3H type=write size=4123654 2024-06-04T15:59:35.106 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:35.106+0000 7f5e9aacc780 1 < completed delete operation key=K01DAK0M4I4M tag=GDM5GT9LQQ2M type=del 2024-06-04T15:59:35.108 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:35.107+0000 7f5e9aacc780 1 > prepared operation key=UTZHANL9ER2Q tag=LFN3CLEBN8HF type=write size=838161 2024-06-04T15:59:35.108 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:35.108+0000 7f5e9aacc780 1 < canceled part key=_multipart_SUBHZJ7HUV3H.2~S425AEZHO7MV.0 size=1048576 2024-06-04T15:59:35.109 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:35.109+0000 7f5e9aacc780 1 < completed part key=_multipart_SUBHZJ7HUV3H.2~S425AEZHO7MV.1 size=1048576 2024-06-04T15:59:35.110 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:35.110+0000 7f5e9aacc780 1 < completed part key=_multipart_SUBHZJ7HUV3H.2~S425AEZHO7MV.2 size=955927 2024-06-04T15:59:35.113 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:35.112+0000 7f5e9aacc780 1 < canceled multipart upload key=SUBHZJ7HUV3H upload=S425AEZHO7MV tag=EBTMTCOQMMU5 type=write size=4101655 2024-06-04T15:59:35.115 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:35.115+0000 7f5e9aacc780 1 > prepared part key=_multipart_UTZHANL9ER2Q.2~PBPI0YMBIXNC.0 size=1048576 2024-06-04T15:59:35.116 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:35.116+0000 7f5e9aacc780 1 > prepared part key=_multipart_UTZHANL9ER2Q.2~PBPI0YMBIXNC.1 size=751872 2024-06-04T15:59:35.116 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:35.116+0000 7f5e9aacc780 1 > prepared multipart upload key=UTZHANL9ER2Q upload=PBPI0YMBIXNC tag=XPUGD2JORFKS type=write size=2849024 2024-06-04T15:59:35.117 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:35.117+0000 7f5e9aacc780 -1 < failed to complete operation key=PNDPO2WUW7UX tag=Q07I9UWI5NUO type=del size=1468079: (22) Invalid argument 2024-06-04T15:59:35.120 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:35.120+0000 7f5e9aacc780 1 > prepared part key=_multipart_UTZHANL9ER2Q.2~E39OPWAN420H.0 size=1048576 2024-06-04T15:59:35.121 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:35.121+0000 7f5e9aacc780 1 > prepared part key=_multipart_UTZHANL9ER2Q.2~E39OPWAN420H.1 size=1048576 2024-06-04T15:59:35.122 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:35.122+0000 7f5e9aacc780 1 > prepared part key=_multipart_UTZHANL9ER2Q.2~E39OPWAN420H.2 size=682622 2024-06-04T15:59:35.122 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:35.122+0000 7f5e9aacc780 1 > prepared multipart upload key=UTZHANL9ER2Q upload=E39OPWAN420H tag=JIFYPBI2IPXU type=write size=3828350 2024-06-04T15:59:35.123 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:35.123+0000 7f5e9aacc780 1 < completed part key=_multipart_A8O0S3S45RGM.2~PMTT0IT9GMHX.0 size=1048576 2024-06-04T15:59:35.125 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:35.124+0000 7f5e9aacc780 1 < completed part key=_multipart_A8O0S3S45RGM.2~PMTT0IT9GMHX.1 size=659628 2024-06-04T15:59:35.127 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:35.127+0000 7f5e9aacc780 1 < completed multipart upload key=A8O0S3S45RGM upload=PMTT0IT9GMHX tag=N24YKR7KVY4M type=write size=2756780 2024-06-04T15:59:35.128 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:35.128+0000 7f5e9aacc780 1 > prepared operation key=UW5LVIBG09SV tag=R7JEB6M52IDK type=del size=3054747 2024-06-04T15:59:35.130 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:35.130+0000 7f5e9aacc780 1 < completed delete operation key=SUBHZJ7HUV3H tag=4IHRMVV3ESNP type=del 2024-06-04T15:59:35.132 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:35.131+0000 7f5e9aacc780 1 > prepared operation key=DY9JWHWNAUO1 tag=ODGE1FH0AKJF type=del size=175752 2024-06-04T15:59:35.133 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:35.133+0000 7f5e9aacc780 1 < completed write operation key=03ZNYG3WLMP4 tag=YXF9F2TNCKZT type=write size=873195 2024-06-04T15:59:35.134 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T15:59:35.134+0000 7f5e9aacc780 1 > prepared operation key=QUIVPH3OB6KN tag=XJQ0W20Y7SBR type=del size=86746 2024-06-04T15:59:35.135 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] cls_rgw_stats.simulate (10959 ms) 2024-06-04T15:59:35.135 INFO:tasks.workunit.client.0.smithi144.stdout:[----------] 1 test from cls_rgw_stats (10959 ms total) 2024-06-04T15:59:35.135 INFO:tasks.workunit.client.0.smithi144.stdout: 2024-06-04T15:59:35.135 INFO:tasks.workunit.client.0.smithi144.stdout:[----------] Global test environment tear-down 2024-06-04T15:59:35.197 INFO:tasks.workunit.client.0.smithi144.stdout:[==========] 1 test from 1 test suite ran. (12902 ms total) 2024-06-04T15:59:35.198 INFO:tasks.workunit.client.0.smithi144.stdout:[ PASSED ] 1 test. 2024-06-04T15:59:35.201 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-06-04T15:59:35.201 DEBUG:teuthology.orchestra.run.smithi144:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-06-04T15:59:35.286 INFO:tasks.workunit:Running workunits matching cls/test_cls_cmpomap.sh on client.0... 2024-06-04T15:59:35.287 INFO:tasks.workunit:Running workunit cls/test_cls_cmpomap.sh... 2024-06-04T15:59:35.287 DEBUG:teuthology.orchestra.run.smithi144:workunit test cls/test_cls_cmpomap.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1fb5d10608dccee73edd6ef8a2c7b804a097c324 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_cmpomap.sh 2024-06-04T15:59:35.333 INFO:tasks.workunit.client.0.smithi144.stdout:Running main() from gmock_main.cc 2024-06-04T15:59:35.333 INFO:tasks.workunit.client.0.smithi144.stdout:[==========] Running 31 tests from 1 test suite. 2024-06-04T15:59:35.333 INFO:tasks.workunit.client.0.smithi144.stdout:[----------] Global test environment set-up. 2024-06-04T15:59:37.210 INFO:tasks.workunit.client.0.smithi144.stdout:[----------] 31 tests from CmpOmap 2024-06-04T15:59:37.210 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] CmpOmap.cmp_vals_noexist_str 2024-06-04T15:59:37.221 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] CmpOmap.cmp_vals_noexist_str (12 ms) 2024-06-04T15:59:37.221 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] CmpOmap.cmp_vals_noexist_str_default 2024-06-04T15:59:37.230 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] CmpOmap.cmp_vals_noexist_str_default (8 ms) 2024-06-04T15:59:37.230 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] CmpOmap.cmp_vals_noexist_u64 2024-06-04T15:59:37.232 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] CmpOmap.cmp_vals_noexist_u64 (3 ms) 2024-06-04T15:59:37.232 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] CmpOmap.cmp_vals_noexist_u64_default 2024-06-04T15:59:37.236 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] CmpOmap.cmp_vals_noexist_u64_default (3 ms) 2024-06-04T15:59:37.236 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] CmpOmap.cmp_vals_str 2024-06-04T15:59:37.242 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] CmpOmap.cmp_vals_str (7 ms) 2024-06-04T15:59:37.242 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] CmpOmap.cmp_vals_u64 2024-06-04T15:59:37.250 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] CmpOmap.cmp_vals_u64 (8 ms) 2024-06-04T15:59:37.251 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] CmpOmap.cmp_vals_u64_invalid_input 2024-06-04T15:59:37.254 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] CmpOmap.cmp_vals_u64_invalid_input (3 ms) 2024-06-04T15:59:37.254 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] CmpOmap.cmp_vals_u64_invalid_default 2024-06-04T15:59:37.257 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] CmpOmap.cmp_vals_u64_invalid_default (3 ms) 2024-06-04T15:59:37.257 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] CmpOmap.cmp_vals_u64_empty_default 2024-06-04T15:59:37.260 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] CmpOmap.cmp_vals_u64_empty_default (4 ms) 2024-06-04T15:59:37.260 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] CmpOmap.cmp_vals_u64_invalid_value 2024-06-04T15:59:37.264 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] CmpOmap.cmp_vals_u64_invalid_value (4 ms) 2024-06-04T15:59:37.264 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] CmpOmap.cmp_vals_at_max_keys 2024-06-04T15:59:37.265 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] CmpOmap.cmp_vals_at_max_keys (0 ms) 2024-06-04T15:59:37.265 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] CmpOmap.cmp_vals_over_max_keys 2024-06-04T15:59:37.265 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] CmpOmap.cmp_vals_over_max_keys (1 ms) 2024-06-04T15:59:37.266 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] CmpOmap.cmp_set_vals_noexist_str 2024-06-04T15:59:37.271 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] CmpOmap.cmp_set_vals_noexist_str (6 ms) 2024-06-04T15:59:37.271 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] CmpOmap.cmp_set_vals_noexist_str_default 2024-06-04T15:59:37.278 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] CmpOmap.cmp_set_vals_noexist_str_default (6 ms) 2024-06-04T15:59:37.278 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] CmpOmap.cmp_set_vals_noexist_u64 2024-06-04T15:59:37.284 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] CmpOmap.cmp_set_vals_noexist_u64 (6 ms) 2024-06-04T15:59:37.284 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] CmpOmap.cmp_set_vals_noexist_u64_default 2024-06-04T15:59:37.293 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] CmpOmap.cmp_set_vals_noexist_u64_default (9 ms) 2024-06-04T15:59:37.293 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] CmpOmap.cmp_set_vals_str 2024-06-04T15:59:37.301 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] CmpOmap.cmp_set_vals_str (9 ms) 2024-06-04T15:59:37.301 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] CmpOmap.cmp_set_vals_u64 2024-06-04T15:59:37.309 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] CmpOmap.cmp_set_vals_u64 (7 ms) 2024-06-04T15:59:37.309 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] CmpOmap.cmp_set_vals_u64_einval 2024-06-04T15:59:37.312 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] CmpOmap.cmp_set_vals_u64_einval (3 ms) 2024-06-04T15:59:37.312 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] CmpOmap.cmp_set_vals_u64_eio 2024-06-04T15:59:37.314 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] CmpOmap.cmp_set_vals_u64_eio (3 ms) 2024-06-04T15:59:37.314 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] CmpOmap.cmp_set_vals_at_max_keys 2024-06-04T15:59:37.315 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] CmpOmap.cmp_set_vals_at_max_keys (1 ms) 2024-06-04T15:59:37.315 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] CmpOmap.cmp_set_vals_over_max_keys 2024-06-04T15:59:37.316 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] CmpOmap.cmp_set_vals_over_max_keys (0 ms) 2024-06-04T15:59:37.316 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] CmpOmap.cmp_rm_keys_noexist_str 2024-06-04T15:59:37.322 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] CmpOmap.cmp_rm_keys_noexist_str (7 ms) 2024-06-04T15:59:37.323 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] CmpOmap.cmp_rm_keys_noexist_u64 2024-06-04T15:59:37.330 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] CmpOmap.cmp_rm_keys_noexist_u64 (7 ms) 2024-06-04T15:59:37.330 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] CmpOmap.cmp_rm_keys_str 2024-06-04T15:59:37.338 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] CmpOmap.cmp_rm_keys_str (8 ms) 2024-06-04T15:59:37.338 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] CmpOmap.cmp_rm_keys_u64 2024-06-04T15:59:37.346 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] CmpOmap.cmp_rm_keys_u64 (9 ms) 2024-06-04T15:59:37.346 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] CmpOmap.cmp_rm_keys_u64_einval 2024-06-04T15:59:37.348 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] CmpOmap.cmp_rm_keys_u64_einval (2 ms) 2024-06-04T15:59:37.348 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] CmpOmap.cmp_rm_keys_u64_eio 2024-06-04T15:59:37.351 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] CmpOmap.cmp_rm_keys_u64_eio (3 ms) 2024-06-04T15:59:37.351 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] CmpOmap.cmp_rm_keys_at_max_keys 2024-06-04T15:59:37.352 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] CmpOmap.cmp_rm_keys_at_max_keys (1 ms) 2024-06-04T15:59:37.352 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] CmpOmap.cmp_rm_keys_over_max_keys 2024-06-04T15:59:37.353 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] CmpOmap.cmp_rm_keys_over_max_keys (1 ms) 2024-06-04T15:59:37.353 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] CmpOmap.cmp_rm_keys_u64_empty 2024-06-04T15:59:37.360 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] CmpOmap.cmp_rm_keys_u64_empty (7 ms) 2024-06-04T15:59:37.361 INFO:tasks.workunit.client.0.smithi144.stdout:[----------] 31 tests from CmpOmap (151 ms total) 2024-06-04T15:59:37.361 INFO:tasks.workunit.client.0.smithi144.stdout: 2024-06-04T15:59:37.361 INFO:tasks.workunit.client.0.smithi144.stdout:[----------] Global test environment tear-down 2024-06-04T15:59:38.218 INFO:tasks.workunit.client.0.smithi144.stdout:[==========] 31 tests from 1 test suite ran. (2885 ms total) 2024-06-04T15:59:38.218 INFO:tasks.workunit.client.0.smithi144.stdout:[ PASSED ] 31 tests. 2024-06-04T15:59:38.221 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-06-04T15:59:38.222 DEBUG:teuthology.orchestra.run.smithi144:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-06-04T15:59:38.265 INFO:tasks.workunit:Running workunits matching cls/test_cls_2pc_queue.sh on client.0... 2024-06-04T15:59:38.266 INFO:tasks.workunit:Running workunit cls/test_cls_2pc_queue.sh... 2024-06-04T15:59:38.266 DEBUG:teuthology.orchestra.run.smithi144:workunit test cls/test_cls_2pc_queue.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1fb5d10608dccee73edd6ef8a2c7b804a097c324 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_2pc_queue.sh 2024-06-04T15:59:38.353 INFO:tasks.workunit.client.0.smithi144.stdout:Running main() from gmock_main.cc 2024-06-04T15:59:38.353 INFO:tasks.workunit.client.0.smithi144.stdout:[==========] Running 24 tests from 1 test suite. 2024-06-04T15:59:38.353 INFO:tasks.workunit.client.0.smithi144.stdout:[----------] Global test environment set-up. 2024-06-04T15:59:38.353 INFO:tasks.workunit.client.0.smithi144.stdout:[----------] 24 tests from TestCls2PCQueue 2024-06-04T15:59:38.353 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] TestCls2PCQueue.GetCapacity 2024-06-04T15:59:41.236 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] TestCls2PCQueue.GetCapacity (2882 ms) 2024-06-04T15:59:41.236 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] TestCls2PCQueue.AsyncGetCapacity 2024-06-04T15:59:44.251 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] TestCls2PCQueue.AsyncGetCapacity (3015 ms) 2024-06-04T15:59:44.252 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] TestCls2PCQueue.Reserve 2024-06-04T15:59:47.279 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] TestCls2PCQueue.Reserve (3028 ms) 2024-06-04T15:59:47.279 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] TestCls2PCQueue.AsyncReserve 2024-06-04T15:59:50.293 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] TestCls2PCQueue.AsyncReserve (3015 ms) 2024-06-04T15:59:50.294 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] TestCls2PCQueue.Commit 2024-06-04T15:59:53.322 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] TestCls2PCQueue.Commit (3028 ms) 2024-06-04T15:59:53.322 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] TestCls2PCQueue.Stats 2024-06-04T15:59:56.336 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] TestCls2PCQueue.Stats (3014 ms) 2024-06-04T15:59:56.336 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] TestCls2PCQueue.UpgradeFromReef 2024-06-04T16:00:00.371 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] TestCls2PCQueue.UpgradeFromReef (4035 ms) 2024-06-04T16:00:00.371 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] TestCls2PCQueue.Abort 2024-06-04T16:00:03.392 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] TestCls2PCQueue.Abort (3022 ms) 2024-06-04T16:00:03.393 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] TestCls2PCQueue.ReserveError 2024-06-04T16:00:06.418 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] TestCls2PCQueue.ReserveError (3024 ms) 2024-06-04T16:00:06.418 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] TestCls2PCQueue.CommitError 2024-06-04T16:00:09.443 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] TestCls2PCQueue.CommitError (3027 ms) 2024-06-04T16:00:09.444 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] TestCls2PCQueue.AbortError 2024-06-04T16:00:12.455 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] TestCls2PCQueue.AbortError (3012 ms) 2024-06-04T16:00:12.456 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] TestCls2PCQueue.MultiReserve 2024-06-04T16:00:15.478 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] TestCls2PCQueue.MultiReserve (3022 ms) 2024-06-04T16:00:15.478 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] TestCls2PCQueue.MultiCommit 2024-06-04T16:00:18.505 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] TestCls2PCQueue.MultiCommit (3022 ms) 2024-06-04T16:00:18.506 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] TestCls2PCQueue.MultiAbort 2024-06-04T16:00:21.513 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] TestCls2PCQueue.MultiAbort (3013 ms) 2024-06-04T16:00:21.513 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] TestCls2PCQueue.ReserveCommit 2024-06-04T16:00:24.532 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] TestCls2PCQueue.ReserveCommit (3019 ms) 2024-06-04T16:00:24.532 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] TestCls2PCQueue.ReserveAbort 2024-06-04T16:00:27.555 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] TestCls2PCQueue.ReserveAbort (3023 ms) 2024-06-04T16:00:27.555 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] TestCls2PCQueue.ManualCleanup 2024-06-04T16:00:30.560 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] TestCls2PCQueue.ManualCleanup (3005 ms) 2024-06-04T16:00:30.560 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] TestCls2PCQueue.Cleanup 2024-06-04T16:00:33.595 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] TestCls2PCQueue.Cleanup (3035 ms) 2024-06-04T16:00:33.595 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] TestCls2PCQueue.MultiProducer 2024-06-04T16:00:44.121 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] TestCls2PCQueue.MultiProducer (10526 ms) 2024-06-04T16:00:44.122 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] TestCls2PCQueue.AsyncConsumer 2024-06-04T16:00:47.145 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] TestCls2PCQueue.AsyncConsumer (3025 ms) 2024-06-04T16:00:47.145 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] TestCls2PCQueue.MultiProducerConsumer 2024-06-04T16:00:59.241 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] TestCls2PCQueue.MultiProducerConsumer (12094 ms) 2024-06-04T16:00:59.241 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] TestCls2PCQueue.ReserveSpillover 2024-06-04T16:01:03.269 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] TestCls2PCQueue.ReserveSpillover (4027 ms) 2024-06-04T16:01:03.269 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] TestCls2PCQueue.CommitSpillover 2024-06-04T16:01:08.301 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] TestCls2PCQueue.CommitSpillover (5034 ms) 2024-06-04T16:01:08.301 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] TestCls2PCQueue.AbortSpillover 2024-06-04T16:01:13.325 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] TestCls2PCQueue.AbortSpillover (5024 ms) 2024-06-04T16:01:13.325 INFO:tasks.workunit.client.0.smithi144.stdout:[----------] 24 tests from TestCls2PCQueue (94971 ms total) 2024-06-04T16:01:13.325 INFO:tasks.workunit.client.0.smithi144.stdout: 2024-06-04T16:01:13.325 INFO:tasks.workunit.client.0.smithi144.stdout:[----------] Global test environment tear-down 2024-06-04T16:01:13.325 INFO:tasks.workunit.client.0.smithi144.stdout:[==========] 24 tests from 1 test suite ran. (94971 ms total) 2024-06-04T16:01:13.325 INFO:tasks.workunit.client.0.smithi144.stdout:[ PASSED ] 24 tests. 2024-06-04T16:01:13.328 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-06-04T16:01:13.328 DEBUG:teuthology.orchestra.run.smithi144:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-06-04T16:01:13.370 INFO:tasks.workunit:Running workunits matching rgw/test_rgw_gc_log.sh on client.0... 2024-06-04T16:01:13.371 INFO:tasks.workunit:Running workunit rgw/test_rgw_gc_log.sh... 2024-06-04T16:01:13.371 DEBUG:teuthology.orchestra.run.smithi144:workunit test rgw/test_rgw_gc_log.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1fb5d10608dccee73edd6ef8a2c7b804a097c324 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_gc_log.sh 2024-06-04T16:01:13.463 INFO:tasks.workunit.client.0.smithi144.stderr:ignoring --setuser ceph since I am not root 2024-06-04T16:01:13.463 INFO:tasks.workunit.client.0.smithi144.stderr:ignoring --setgroup ceph since I am not root 2024-06-04T16:01:13.463 INFO:tasks.workunit.client.0.smithi144.stdout:[==========] Running 6 tests from 1 test suite. 2024-06-04T16:01:13.463 INFO:tasks.workunit.client.0.smithi144.stdout:[----------] Global test environment set-up. 2024-06-04T16:01:15.348 INFO:tasks.workunit.client.0.smithi144.stdout:[----------] 6 tests from rgw_gc_log 2024-06-04T16:01:15.348 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] rgw_gc_log.init_existing_queue 2024-06-04T16:01:15.362 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] rgw_gc_log.init_existing_queue (15 ms) 2024-06-04T16:01:15.362 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] rgw_gc_log.init_existing_omap 2024-06-04T16:01:15.365 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] rgw_gc_log.init_existing_omap (3 ms) 2024-06-04T16:01:15.365 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] rgw_gc_log.enqueue1_after_init 2024-06-04T16:01:15.368 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] rgw_gc_log.enqueue1_after_init (3 ms) 2024-06-04T16:01:15.368 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] rgw_gc_log.enqueue2_before_init 2024-06-04T16:01:15.369 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] rgw_gc_log.enqueue2_before_init (1 ms) 2024-06-04T16:01:15.369 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] rgw_gc_log.defer1_after_init 2024-06-04T16:01:15.372 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] rgw_gc_log.defer1_after_init (3 ms) 2024-06-04T16:01:15.372 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] rgw_gc_log.defer2_before_init 2024-06-04T16:01:15.373 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] rgw_gc_log.defer2_before_init (2 ms) 2024-06-04T16:01:15.373 INFO:tasks.workunit.client.0.smithi144.stdout:[----------] 6 tests from rgw_gc_log (27 ms total) 2024-06-04T16:01:15.373 INFO:tasks.workunit.client.0.smithi144.stdout: 2024-06-04T16:01:15.373 INFO:tasks.workunit.client.0.smithi144.stdout:[----------] Global test environment tear-down 2024-06-04T16:01:16.349 INFO:tasks.workunit.client.0.smithi144.stdout:[==========] 6 tests from 1 test suite ran. (2887 ms total) 2024-06-04T16:01:16.349 INFO:tasks.workunit.client.0.smithi144.stdout:[ PASSED ] 6 tests. 2024-06-04T16:01:16.353 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-06-04T16:01:16.353 DEBUG:teuthology.orchestra.run.smithi144:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-06-04T16:01:16.395 INFO:tasks.workunit:Running workunits matching rgw/test_rgw_obj.sh on client.0... 2024-06-04T16:01:16.397 INFO:tasks.workunit:Running workunit rgw/test_rgw_obj.sh... 2024-06-04T16:01:16.397 DEBUG:teuthology.orchestra.run.smithi144:workunit test rgw/test_rgw_obj.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1fb5d10608dccee73edd6ef8a2c7b804a097c324 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_obj.sh 2024-06-04T16:01:16.492 INFO:tasks.workunit.client.0.smithi144.stdout:Running main() from gmock_main.cc 2024-06-04T16:01:16.492 INFO:tasks.workunit.client.0.smithi144.stdout:[==========] Running 4 tests from 1 test suite. 2024-06-04T16:01:16.492 INFO:tasks.workunit.client.0.smithi144.stdout:[----------] Global test environment set-up. 2024-06-04T16:01:16.492 INFO:tasks.workunit.client.0.smithi144.stdout:[----------] 4 tests from TestRGWObj 2024-06-04T16:01:16.492 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] TestRGWObj.underscore 2024-06-04T16:01:16.492 INFO:tasks.workunit.client.0.smithi144.stdout:parsed: _obj 2024-06-04T16:01:16.492 INFO:tasks.workunit.client.0.smithi144.stdout:parsed: _obj 2024-06-04T16:01:16.492 INFO:tasks.workunit.client.0.smithi144.stdout:stripped: _obj ns= i= 2024-06-04T16:01:16.492 INFO:tasks.workunit.client.0.smithi144.stdout:parsed: _obj 2024-06-04T16:01:16.492 INFO:tasks.workunit.client.0.smithi144.stdout:parsed: _obj 2024-06-04T16:01:16.492 INFO:tasks.workunit.client.0.smithi144.stdout:stripped: _obj ns= i= 2024-06-04T16:01:16.492 INFO:tasks.workunit.client.0.smithi144.stdout:parsed: _obj 2024-06-04T16:01:16.493 INFO:tasks.workunit.client.0.smithi144.stdout:parsed: _obj 2024-06-04T16:01:16.493 INFO:tasks.workunit.client.0.smithi144.stdout:stripped: _obj ns= i= 2024-06-04T16:01:16.493 INFO:tasks.workunit.client.0.smithi144.stdout:{ 2024-06-04T16:01:16.493 INFO:tasks.workunit.client.0.smithi144.stdout: "obj1": { 2024-06-04T16:01:16.493 INFO:tasks.workunit.client.0.smithi144.stdout: "bucket": { 2024-06-04T16:01:16.493 INFO:tasks.workunit.client.0.smithi144.stdout: "name": "test", 2024-06-04T16:01:16.493 INFO:tasks.workunit.client.0.smithi144.stdout: "marker": "marker", 2024-06-04T16:01:16.493 INFO:tasks.workunit.client.0.smithi144.stdout: "bucket_id": "bucket-id", 2024-06-04T16:01:16.493 INFO:tasks.workunit.client.0.smithi144.stdout: "tenant": "", 2024-06-04T16:01:16.493 INFO:tasks.workunit.client.0.smithi144.stdout: "explicit_placement": { 2024-06-04T16:01:16.493 INFO:tasks.workunit.client.0.smithi144.stdout: "data_pool": "", 2024-06-04T16:01:16.493 INFO:tasks.workunit.client.0.smithi144.stdout: "data_extra_pool": "", 2024-06-04T16:01:16.493 INFO:tasks.workunit.client.0.smithi144.stdout: "index_pool": "" 2024-06-04T16:01:16.493 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.494 INFO:tasks.workunit.client.0.smithi144.stdout: }, 2024-06-04T16:01:16.494 INFO:tasks.workunit.client.0.smithi144.stdout: "key": { 2024-06-04T16:01:16.494 INFO:tasks.workunit.client.0.smithi144.stdout: "name": "_obj", 2024-06-04T16:01:16.494 INFO:tasks.workunit.client.0.smithi144.stdout: "instance": "", 2024-06-04T16:01:16.494 INFO:tasks.workunit.client.0.smithi144.stdout: "ns": "" 2024-06-04T16:01:16.494 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.494 INFO:tasks.workunit.client.0.smithi144.stdout: }, 2024-06-04T16:01:16.494 INFO:tasks.workunit.client.0.smithi144.stdout: "obj2": { 2024-06-04T16:01:16.494 INFO:tasks.workunit.client.0.smithi144.stdout: "bucket": { 2024-06-04T16:01:16.494 INFO:tasks.workunit.client.0.smithi144.stdout: "name": "test", 2024-06-04T16:01:16.494 INFO:tasks.workunit.client.0.smithi144.stdout: "marker": "marker", 2024-06-04T16:01:16.494 INFO:tasks.workunit.client.0.smithi144.stdout: "bucket_id": "bucket-id", 2024-06-04T16:01:16.494 INFO:tasks.workunit.client.0.smithi144.stdout: "tenant": "", 2024-06-04T16:01:16.494 INFO:tasks.workunit.client.0.smithi144.stdout: "explicit_placement": { 2024-06-04T16:01:16.494 INFO:tasks.workunit.client.0.smithi144.stdout: "data_pool": "", 2024-06-04T16:01:16.494 INFO:tasks.workunit.client.0.smithi144.stdout: "data_extra_pool": "", 2024-06-04T16:01:16.495 INFO:tasks.workunit.client.0.smithi144.stdout: "index_pool": "" 2024-06-04T16:01:16.495 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.495 INFO:tasks.workunit.client.0.smithi144.stdout: }, 2024-06-04T16:01:16.495 INFO:tasks.workunit.client.0.smithi144.stdout: "key": { 2024-06-04T16:01:16.495 INFO:tasks.workunit.client.0.smithi144.stdout: "name": "_obj", 2024-06-04T16:01:16.495 INFO:tasks.workunit.client.0.smithi144.stdout: "instance": "", 2024-06-04T16:01:16.495 INFO:tasks.workunit.client.0.smithi144.stdout: "ns": "" 2024-06-04T16:01:16.495 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.495 INFO:tasks.workunit.client.0.smithi144.stdout: }, 2024-06-04T16:01:16.495 INFO:tasks.workunit.client.0.smithi144.stdout: "obj3": { 2024-06-04T16:01:16.495 INFO:tasks.workunit.client.0.smithi144.stdout: "bucket": { 2024-06-04T16:01:16.495 INFO:tasks.workunit.client.0.smithi144.stdout: "name": "test", 2024-06-04T16:01:16.496 INFO:tasks.workunit.client.0.smithi144.stdout: "marker": "marker", 2024-06-04T16:01:16.496 INFO:tasks.workunit.client.0.smithi144.stdout: "bucket_id": "bucket-id", 2024-06-04T16:01:16.496 INFO:tasks.workunit.client.0.smithi144.stdout: "tenant": "", 2024-06-04T16:01:16.496 INFO:tasks.workunit.client.0.smithi144.stdout: "explicit_placement": { 2024-06-04T16:01:16.496 INFO:tasks.workunit.client.0.smithi144.stdout: "data_pool": "", 2024-06-04T16:01:16.496 INFO:tasks.workunit.client.0.smithi144.stdout: "data_extra_pool": "", 2024-06-04T16:01:16.496 INFO:tasks.workunit.client.0.smithi144.stdout: "index_pool": "" 2024-06-04T16:01:16.496 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.496 INFO:tasks.workunit.client.0.smithi144.stdout: }, 2024-06-04T16:01:16.496 INFO:tasks.workunit.client.0.smithi144.stdout: "key": { 2024-06-04T16:01:16.497 INFO:tasks.workunit.client.0.smithi144.stdout: "name": "_obj", 2024-06-04T16:01:16.497 INFO:tasks.workunit.client.0.smithi144.stdout: "instance": "", 2024-06-04T16:01:16.497 INFO:tasks.workunit.client.0.smithi144.stdout: "ns": "" 2024-06-04T16:01:16.497 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.497 INFO:tasks.workunit.client.0.smithi144.stdout: }, 2024-06-04T16:01:16.497 INFO:tasks.workunit.client.0.smithi144.stdout: "obj3-2": { 2024-06-04T16:01:16.497 INFO:tasks.workunit.client.0.smithi144.stdout: "bucket": { 2024-06-04T16:01:16.497 INFO:tasks.workunit.client.0.smithi144.stdout: "name": "test", 2024-06-04T16:01:16.497 INFO:tasks.workunit.client.0.smithi144.stdout: "marker": "marker", 2024-06-04T16:01:16.497 INFO:tasks.workunit.client.0.smithi144.stdout: "bucket_id": "bucket-id", 2024-06-04T16:01:16.497 INFO:tasks.workunit.client.0.smithi144.stdout: "tenant": "", 2024-06-04T16:01:16.497 INFO:tasks.workunit.client.0.smithi144.stdout: "explicit_placement": { 2024-06-04T16:01:16.497 INFO:tasks.workunit.client.0.smithi144.stdout: "data_pool": "", 2024-06-04T16:01:16.497 INFO:tasks.workunit.client.0.smithi144.stdout: "data_extra_pool": "", 2024-06-04T16:01:16.497 INFO:tasks.workunit.client.0.smithi144.stdout: "index_pool": "" 2024-06-04T16:01:16.498 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.498 INFO:tasks.workunit.client.0.smithi144.stdout: }, 2024-06-04T16:01:16.498 INFO:tasks.workunit.client.0.smithi144.stdout: "key": { 2024-06-04T16:01:16.498 INFO:tasks.workunit.client.0.smithi144.stdout: "name": "_obj", 2024-06-04T16:01:16.498 INFO:tasks.workunit.client.0.smithi144.stdout: "instance": "", 2024-06-04T16:01:16.498 INFO:tasks.workunit.client.0.smithi144.stdout: "ns": "" 2024-06-04T16:01:16.498 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.498 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.498 INFO:tasks.workunit.client.0.smithi144.stdout:} 2024-06-04T16:01:16.498 INFO:tasks.workunit.client.0.smithi144.stdout:parsed: _obj 2024-06-04T16:01:16.498 INFO:tasks.workunit.client.0.smithi144.stdout:parsed: _obj 2024-06-04T16:01:16.498 INFO:tasks.workunit.client.0.smithi144.stdout:stripped: _obj ns=ns i= 2024-06-04T16:01:16.498 INFO:tasks.workunit.client.0.smithi144.stdout:parsed: _obj 2024-06-04T16:01:16.498 INFO:tasks.workunit.client.0.smithi144.stdout:parsed: _obj 2024-06-04T16:01:16.499 INFO:tasks.workunit.client.0.smithi144.stdout:stripped: _obj ns=ns i= 2024-06-04T16:01:16.499 INFO:tasks.workunit.client.0.smithi144.stdout:parsed: _obj 2024-06-04T16:01:16.499 INFO:tasks.workunit.client.0.smithi144.stdout:parsed: _obj 2024-06-04T16:01:16.499 INFO:tasks.workunit.client.0.smithi144.stdout:stripped: _obj ns=ns i= 2024-06-04T16:01:16.499 INFO:tasks.workunit.client.0.smithi144.stdout:{ 2024-06-04T16:01:16.499 INFO:tasks.workunit.client.0.smithi144.stdout: "obj1": { 2024-06-04T16:01:16.499 INFO:tasks.workunit.client.0.smithi144.stdout: "bucket": { 2024-06-04T16:01:16.499 INFO:tasks.workunit.client.0.smithi144.stdout: "name": "test", 2024-06-04T16:01:16.499 INFO:tasks.workunit.client.0.smithi144.stdout: "marker": "marker", 2024-06-04T16:01:16.499 INFO:tasks.workunit.client.0.smithi144.stdout: "bucket_id": "bucket-id", 2024-06-04T16:01:16.499 INFO:tasks.workunit.client.0.smithi144.stdout: "tenant": "", 2024-06-04T16:01:16.499 INFO:tasks.workunit.client.0.smithi144.stdout: "explicit_placement": { 2024-06-04T16:01:16.499 INFO:tasks.workunit.client.0.smithi144.stdout: "data_pool": "", 2024-06-04T16:01:16.499 INFO:tasks.workunit.client.0.smithi144.stdout: "data_extra_pool": "", 2024-06-04T16:01:16.499 INFO:tasks.workunit.client.0.smithi144.stdout: "index_pool": "" 2024-06-04T16:01:16.499 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.500 INFO:tasks.workunit.client.0.smithi144.stdout: }, 2024-06-04T16:01:16.500 INFO:tasks.workunit.client.0.smithi144.stdout: "key": { 2024-06-04T16:01:16.500 INFO:tasks.workunit.client.0.smithi144.stdout: "name": "_obj", 2024-06-04T16:01:16.500 INFO:tasks.workunit.client.0.smithi144.stdout: "instance": "", 2024-06-04T16:01:16.500 INFO:tasks.workunit.client.0.smithi144.stdout: "ns": "ns" 2024-06-04T16:01:16.500 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.500 INFO:tasks.workunit.client.0.smithi144.stdout: }, 2024-06-04T16:01:16.500 INFO:tasks.workunit.client.0.smithi144.stdout: "obj2": { 2024-06-04T16:01:16.500 INFO:tasks.workunit.client.0.smithi144.stdout: "bucket": { 2024-06-04T16:01:16.500 INFO:tasks.workunit.client.0.smithi144.stdout: "name": "test", 2024-06-04T16:01:16.500 INFO:tasks.workunit.client.0.smithi144.stdout: "marker": "marker", 2024-06-04T16:01:16.500 INFO:tasks.workunit.client.0.smithi144.stdout: "bucket_id": "bucket-id", 2024-06-04T16:01:16.500 INFO:tasks.workunit.client.0.smithi144.stdout: "tenant": "", 2024-06-04T16:01:16.500 INFO:tasks.workunit.client.0.smithi144.stdout: "explicit_placement": { 2024-06-04T16:01:16.500 INFO:tasks.workunit.client.0.smithi144.stdout: "data_pool": "", 2024-06-04T16:01:16.501 INFO:tasks.workunit.client.0.smithi144.stdout: "data_extra_pool": "", 2024-06-04T16:01:16.501 INFO:tasks.workunit.client.0.smithi144.stdout: "index_pool": "" 2024-06-04T16:01:16.501 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.501 INFO:tasks.workunit.client.0.smithi144.stdout: }, 2024-06-04T16:01:16.501 INFO:tasks.workunit.client.0.smithi144.stdout: "key": { 2024-06-04T16:01:16.501 INFO:tasks.workunit.client.0.smithi144.stdout: "name": "_obj", 2024-06-04T16:01:16.501 INFO:tasks.workunit.client.0.smithi144.stdout: "instance": "", 2024-06-04T16:01:16.501 INFO:tasks.workunit.client.0.smithi144.stdout: "ns": "ns" 2024-06-04T16:01:16.501 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.501 INFO:tasks.workunit.client.0.smithi144.stdout: }, 2024-06-04T16:01:16.501 INFO:tasks.workunit.client.0.smithi144.stdout: "obj3": { 2024-06-04T16:01:16.501 INFO:tasks.workunit.client.0.smithi144.stdout: "bucket": { 2024-06-04T16:01:16.501 INFO:tasks.workunit.client.0.smithi144.stdout: "name": "test", 2024-06-04T16:01:16.502 INFO:tasks.workunit.client.0.smithi144.stdout: "marker": "marker", 2024-06-04T16:01:16.502 INFO:tasks.workunit.client.0.smithi144.stdout: "bucket_id": "bucket-id", 2024-06-04T16:01:16.502 INFO:tasks.workunit.client.0.smithi144.stdout: "tenant": "", 2024-06-04T16:01:16.502 INFO:tasks.workunit.client.0.smithi144.stdout: "explicit_placement": { 2024-06-04T16:01:16.502 INFO:tasks.workunit.client.0.smithi144.stdout: "data_pool": "", 2024-06-04T16:01:16.502 INFO:tasks.workunit.client.0.smithi144.stdout: "data_extra_pool": "", 2024-06-04T16:01:16.502 INFO:tasks.workunit.client.0.smithi144.stdout: "index_pool": "" 2024-06-04T16:01:16.502 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.502 INFO:tasks.workunit.client.0.smithi144.stdout: }, 2024-06-04T16:01:16.502 INFO:tasks.workunit.client.0.smithi144.stdout: "key": { 2024-06-04T16:01:16.502 INFO:tasks.workunit.client.0.smithi144.stdout: "name": "_obj", 2024-06-04T16:01:16.502 INFO:tasks.workunit.client.0.smithi144.stdout: "instance": "", 2024-06-04T16:01:16.502 INFO:tasks.workunit.client.0.smithi144.stdout: "ns": "" 2024-06-04T16:01:16.503 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.503 INFO:tasks.workunit.client.0.smithi144.stdout: }, 2024-06-04T16:01:16.503 INFO:tasks.workunit.client.0.smithi144.stdout: "obj3-2": { 2024-06-04T16:01:16.503 INFO:tasks.workunit.client.0.smithi144.stdout: "bucket": { 2024-06-04T16:01:16.503 INFO:tasks.workunit.client.0.smithi144.stdout: "name": "test", 2024-06-04T16:01:16.503 INFO:tasks.workunit.client.0.smithi144.stdout: "marker": "marker", 2024-06-04T16:01:16.503 INFO:tasks.workunit.client.0.smithi144.stdout: "bucket_id": "bucket-id", 2024-06-04T16:01:16.503 INFO:tasks.workunit.client.0.smithi144.stdout: "tenant": "", 2024-06-04T16:01:16.503 INFO:tasks.workunit.client.0.smithi144.stdout: "explicit_placement": { 2024-06-04T16:01:16.503 INFO:tasks.workunit.client.0.smithi144.stdout: "data_pool": "", 2024-06-04T16:01:16.503 INFO:tasks.workunit.client.0.smithi144.stdout: "data_extra_pool": "", 2024-06-04T16:01:16.503 INFO:tasks.workunit.client.0.smithi144.stdout: "index_pool": "" 2024-06-04T16:01:16.503 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.503 INFO:tasks.workunit.client.0.smithi144.stdout: }, 2024-06-04T16:01:16.503 INFO:tasks.workunit.client.0.smithi144.stdout: "key": { 2024-06-04T16:01:16.503 INFO:tasks.workunit.client.0.smithi144.stdout: "name": "_obj", 2024-06-04T16:01:16.504 INFO:tasks.workunit.client.0.smithi144.stdout: "instance": "", 2024-06-04T16:01:16.504 INFO:tasks.workunit.client.0.smithi144.stdout: "ns": "ns" 2024-06-04T16:01:16.504 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.504 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.504 INFO:tasks.workunit.client.0.smithi144.stdout:} 2024-06-04T16:01:16.504 INFO:tasks.workunit.client.0.smithi144.stdout:parsed: _obj[v1] 2024-06-04T16:01:16.504 INFO:tasks.workunit.client.0.smithi144.stdout:parsed: _obj[v1] 2024-06-04T16:01:16.504 INFO:tasks.workunit.client.0.smithi144.stdout:stripped: _obj ns= i=v1 2024-06-04T16:01:16.504 INFO:tasks.workunit.client.0.smithi144.stdout:parsed: _obj[v1] 2024-06-04T16:01:16.504 INFO:tasks.workunit.client.0.smithi144.stdout:parsed: _obj[v1] 2024-06-04T16:01:16.504 INFO:tasks.workunit.client.0.smithi144.stdout:stripped: _obj ns= i=v1 2024-06-04T16:01:16.504 INFO:tasks.workunit.client.0.smithi144.stdout:parsed: _obj[v1] 2024-06-04T16:01:16.504 INFO:tasks.workunit.client.0.smithi144.stdout:parsed: _obj[v1] 2024-06-04T16:01:16.504 INFO:tasks.workunit.client.0.smithi144.stdout:stripped: _obj ns= i=v1 2024-06-04T16:01:16.504 INFO:tasks.workunit.client.0.smithi144.stdout:{ 2024-06-04T16:01:16.504 INFO:tasks.workunit.client.0.smithi144.stdout: "obj1": { 2024-06-04T16:01:16.505 INFO:tasks.workunit.client.0.smithi144.stdout: "bucket": { 2024-06-04T16:01:16.505 INFO:tasks.workunit.client.0.smithi144.stdout: "name": "test", 2024-06-04T16:01:16.505 INFO:tasks.workunit.client.0.smithi144.stdout: "marker": "marker", 2024-06-04T16:01:16.505 INFO:tasks.workunit.client.0.smithi144.stdout: "bucket_id": "bucket-id", 2024-06-04T16:01:16.505 INFO:tasks.workunit.client.0.smithi144.stdout: "tenant": "", 2024-06-04T16:01:16.505 INFO:tasks.workunit.client.0.smithi144.stdout: "explicit_placement": { 2024-06-04T16:01:16.505 INFO:tasks.workunit.client.0.smithi144.stdout: "data_pool": "", 2024-06-04T16:01:16.505 INFO:tasks.workunit.client.0.smithi144.stdout: "data_extra_pool": "", 2024-06-04T16:01:16.505 INFO:tasks.workunit.client.0.smithi144.stdout: "index_pool": "" 2024-06-04T16:01:16.505 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.505 INFO:tasks.workunit.client.0.smithi144.stdout: }, 2024-06-04T16:01:16.505 INFO:tasks.workunit.client.0.smithi144.stdout: "key": { 2024-06-04T16:01:16.505 INFO:tasks.workunit.client.0.smithi144.stdout: "name": "_obj", 2024-06-04T16:01:16.505 INFO:tasks.workunit.client.0.smithi144.stdout: "instance": "v1", 2024-06-04T16:01:16.506 INFO:tasks.workunit.client.0.smithi144.stdout: "ns": "" 2024-06-04T16:01:16.506 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.506 INFO:tasks.workunit.client.0.smithi144.stdout: }, 2024-06-04T16:01:16.506 INFO:tasks.workunit.client.0.smithi144.stdout: "obj2": { 2024-06-04T16:01:16.506 INFO:tasks.workunit.client.0.smithi144.stdout: "bucket": { 2024-06-04T16:01:16.506 INFO:tasks.workunit.client.0.smithi144.stdout: "name": "test", 2024-06-04T16:01:16.506 INFO:tasks.workunit.client.0.smithi144.stdout: "marker": "marker", 2024-06-04T16:01:16.506 INFO:tasks.workunit.client.0.smithi144.stdout: "bucket_id": "bucket-id", 2024-06-04T16:01:16.506 INFO:tasks.workunit.client.0.smithi144.stdout: "tenant": "", 2024-06-04T16:01:16.506 INFO:tasks.workunit.client.0.smithi144.stdout: "explicit_placement": { 2024-06-04T16:01:16.506 INFO:tasks.workunit.client.0.smithi144.stdout: "data_pool": "", 2024-06-04T16:01:16.506 INFO:tasks.workunit.client.0.smithi144.stdout: "data_extra_pool": "", 2024-06-04T16:01:16.506 INFO:tasks.workunit.client.0.smithi144.stdout: "index_pool": "" 2024-06-04T16:01:16.507 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.507 INFO:tasks.workunit.client.0.smithi144.stdout: }, 2024-06-04T16:01:16.507 INFO:tasks.workunit.client.0.smithi144.stdout: "key": { 2024-06-04T16:01:16.507 INFO:tasks.workunit.client.0.smithi144.stdout: "name": "_obj", 2024-06-04T16:01:16.507 INFO:tasks.workunit.client.0.smithi144.stdout: "instance": "v1", 2024-06-04T16:01:16.507 INFO:tasks.workunit.client.0.smithi144.stdout: "ns": "" 2024-06-04T16:01:16.507 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.507 INFO:tasks.workunit.client.0.smithi144.stdout: }, 2024-06-04T16:01:16.507 INFO:tasks.workunit.client.0.smithi144.stdout: "obj3": { 2024-06-04T16:01:16.507 INFO:tasks.workunit.client.0.smithi144.stdout: "bucket": { 2024-06-04T16:01:16.507 INFO:tasks.workunit.client.0.smithi144.stdout: "name": "test", 2024-06-04T16:01:16.507 INFO:tasks.workunit.client.0.smithi144.stdout: "marker": "marker", 2024-06-04T16:01:16.508 INFO:tasks.workunit.client.0.smithi144.stdout: "bucket_id": "bucket-id", 2024-06-04T16:01:16.508 INFO:tasks.workunit.client.0.smithi144.stdout: "tenant": "", 2024-06-04T16:01:16.508 INFO:tasks.workunit.client.0.smithi144.stdout: "explicit_placement": { 2024-06-04T16:01:16.508 INFO:tasks.workunit.client.0.smithi144.stdout: "data_pool": "", 2024-06-04T16:01:16.508 INFO:tasks.workunit.client.0.smithi144.stdout: "data_extra_pool": "", 2024-06-04T16:01:16.508 INFO:tasks.workunit.client.0.smithi144.stdout: "index_pool": "" 2024-06-04T16:01:16.508 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.508 INFO:tasks.workunit.client.0.smithi144.stdout: }, 2024-06-04T16:01:16.508 INFO:tasks.workunit.client.0.smithi144.stdout: "key": { 2024-06-04T16:01:16.508 INFO:tasks.workunit.client.0.smithi144.stdout: "name": "_obj", 2024-06-04T16:01:16.508 INFO:tasks.workunit.client.0.smithi144.stdout: "instance": "", 2024-06-04T16:01:16.508 INFO:tasks.workunit.client.0.smithi144.stdout: "ns": "" 2024-06-04T16:01:16.508 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.508 INFO:tasks.workunit.client.0.smithi144.stdout: }, 2024-06-04T16:01:16.508 INFO:tasks.workunit.client.0.smithi144.stdout: "obj3-2": { 2024-06-04T16:01:16.508 INFO:tasks.workunit.client.0.smithi144.stdout: "bucket": { 2024-06-04T16:01:16.509 INFO:tasks.workunit.client.0.smithi144.stdout: "name": "test", 2024-06-04T16:01:16.509 INFO:tasks.workunit.client.0.smithi144.stdout: "marker": "marker", 2024-06-04T16:01:16.509 INFO:tasks.workunit.client.0.smithi144.stdout: "bucket_id": "bucket-id", 2024-06-04T16:01:16.509 INFO:tasks.workunit.client.0.smithi144.stdout: "tenant": "", 2024-06-04T16:01:16.509 INFO:tasks.workunit.client.0.smithi144.stdout: "explicit_placement": { 2024-06-04T16:01:16.509 INFO:tasks.workunit.client.0.smithi144.stdout: "data_pool": "", 2024-06-04T16:01:16.509 INFO:tasks.workunit.client.0.smithi144.stdout: "data_extra_pool": "", 2024-06-04T16:01:16.509 INFO:tasks.workunit.client.0.smithi144.stdout: "index_pool": "" 2024-06-04T16:01:16.509 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.509 INFO:tasks.workunit.client.0.smithi144.stdout: }, 2024-06-04T16:01:16.509 INFO:tasks.workunit.client.0.smithi144.stdout: "key": { 2024-06-04T16:01:16.509 INFO:tasks.workunit.client.0.smithi144.stdout: "name": "_obj", 2024-06-04T16:01:16.510 INFO:tasks.workunit.client.0.smithi144.stdout: "instance": "v1", 2024-06-04T16:01:16.510 INFO:tasks.workunit.client.0.smithi144.stdout: "ns": "" 2024-06-04T16:01:16.510 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.510 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.510 INFO:tasks.workunit.client.0.smithi144.stdout:} 2024-06-04T16:01:16.510 INFO:tasks.workunit.client.0.smithi144.stdout:parsed: _obj[v1] 2024-06-04T16:01:16.510 INFO:tasks.workunit.client.0.smithi144.stdout:parsed: _obj[v1] 2024-06-04T16:01:16.510 INFO:tasks.workunit.client.0.smithi144.stdout:stripped: _obj ns=ns i=v1 2024-06-04T16:01:16.510 INFO:tasks.workunit.client.0.smithi144.stdout:parsed: _obj[v1] 2024-06-04T16:01:16.510 INFO:tasks.workunit.client.0.smithi144.stdout:parsed: _obj[v1] 2024-06-04T16:01:16.510 INFO:tasks.workunit.client.0.smithi144.stdout:stripped: _obj ns=ns i=v1 2024-06-04T16:01:16.510 INFO:tasks.workunit.client.0.smithi144.stdout:parsed: _obj[v1] 2024-06-04T16:01:16.510 INFO:tasks.workunit.client.0.smithi144.stdout:parsed: _obj[v1] 2024-06-04T16:01:16.510 INFO:tasks.workunit.client.0.smithi144.stdout:stripped: _obj ns=ns i=v1 2024-06-04T16:01:16.511 INFO:tasks.workunit.client.0.smithi144.stdout:{ 2024-06-04T16:01:16.511 INFO:tasks.workunit.client.0.smithi144.stdout: "obj1": { 2024-06-04T16:01:16.511 INFO:tasks.workunit.client.0.smithi144.stdout: "bucket": { 2024-06-04T16:01:16.511 INFO:tasks.workunit.client.0.smithi144.stdout: "name": "test", 2024-06-04T16:01:16.511 INFO:tasks.workunit.client.0.smithi144.stdout: "marker": "marker", 2024-06-04T16:01:16.511 INFO:tasks.workunit.client.0.smithi144.stdout: "bucket_id": "bucket-id", 2024-06-04T16:01:16.511 INFO:tasks.workunit.client.0.smithi144.stdout: "tenant": "", 2024-06-04T16:01:16.511 INFO:tasks.workunit.client.0.smithi144.stdout: "explicit_placement": { 2024-06-04T16:01:16.511 INFO:tasks.workunit.client.0.smithi144.stdout: "data_pool": "", 2024-06-04T16:01:16.511 INFO:tasks.workunit.client.0.smithi144.stdout: "data_extra_pool": "", 2024-06-04T16:01:16.514 INFO:tasks.workunit.client.0.smithi144.stdout: "index_pool": "" 2024-06-04T16:01:16.514 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.514 INFO:tasks.workunit.client.0.smithi144.stdout: }, 2024-06-04T16:01:16.514 INFO:tasks.workunit.client.0.smithi144.stdout: "key": { 2024-06-04T16:01:16.514 INFO:tasks.workunit.client.0.smithi144.stdout: "name": "_obj", 2024-06-04T16:01:16.514 INFO:tasks.workunit.client.0.smithi144.stdout: "instance": "v1", 2024-06-04T16:01:16.514 INFO:tasks.workunit.client.0.smithi144.stdout: "ns": "ns" 2024-06-04T16:01:16.514 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.514 INFO:tasks.workunit.client.0.smithi144.stdout: }, 2024-06-04T16:01:16.514 INFO:tasks.workunit.client.0.smithi144.stdout: "obj2": { 2024-06-04T16:01:16.514 INFO:tasks.workunit.client.0.smithi144.stdout: "bucket": { 2024-06-04T16:01:16.515 INFO:tasks.workunit.client.0.smithi144.stdout: "name": "test", 2024-06-04T16:01:16.515 INFO:tasks.workunit.client.0.smithi144.stdout: "marker": "marker", 2024-06-04T16:01:16.515 INFO:tasks.workunit.client.0.smithi144.stdout: "bucket_id": "bucket-id", 2024-06-04T16:01:16.515 INFO:tasks.workunit.client.0.smithi144.stdout: "tenant": "", 2024-06-04T16:01:16.515 INFO:tasks.workunit.client.0.smithi144.stdout: "explicit_placement": { 2024-06-04T16:01:16.515 INFO:tasks.workunit.client.0.smithi144.stdout: "data_pool": "", 2024-06-04T16:01:16.515 INFO:tasks.workunit.client.0.smithi144.stdout: "data_extra_pool": "", 2024-06-04T16:01:16.515 INFO:tasks.workunit.client.0.smithi144.stdout: "index_pool": "" 2024-06-04T16:01:16.515 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.515 INFO:tasks.workunit.client.0.smithi144.stdout: }, 2024-06-04T16:01:16.515 INFO:tasks.workunit.client.0.smithi144.stdout: "key": { 2024-06-04T16:01:16.515 INFO:tasks.workunit.client.0.smithi144.stdout: "name": "_obj", 2024-06-04T16:01:16.515 INFO:tasks.workunit.client.0.smithi144.stdout: "instance": "v1", 2024-06-04T16:01:16.515 INFO:tasks.workunit.client.0.smithi144.stdout: "ns": "ns" 2024-06-04T16:01:16.515 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.515 INFO:tasks.workunit.client.0.smithi144.stdout: }, 2024-06-04T16:01:16.516 INFO:tasks.workunit.client.0.smithi144.stdout: "obj3": { 2024-06-04T16:01:16.516 INFO:tasks.workunit.client.0.smithi144.stdout: "bucket": { 2024-06-04T16:01:16.516 INFO:tasks.workunit.client.0.smithi144.stdout: "name": "test", 2024-06-04T16:01:16.516 INFO:tasks.workunit.client.0.smithi144.stdout: "marker": "marker", 2024-06-04T16:01:16.516 INFO:tasks.workunit.client.0.smithi144.stdout: "bucket_id": "bucket-id", 2024-06-04T16:01:16.516 INFO:tasks.workunit.client.0.smithi144.stdout: "tenant": "", 2024-06-04T16:01:16.516 INFO:tasks.workunit.client.0.smithi144.stdout: "explicit_placement": { 2024-06-04T16:01:16.516 INFO:tasks.workunit.client.0.smithi144.stdout: "data_pool": "", 2024-06-04T16:01:16.516 INFO:tasks.workunit.client.0.smithi144.stdout: "data_extra_pool": "", 2024-06-04T16:01:16.516 INFO:tasks.workunit.client.0.smithi144.stdout: "index_pool": "" 2024-06-04T16:01:16.516 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.516 INFO:tasks.workunit.client.0.smithi144.stdout: }, 2024-06-04T16:01:16.516 INFO:tasks.workunit.client.0.smithi144.stdout: "key": { 2024-06-04T16:01:16.516 INFO:tasks.workunit.client.0.smithi144.stdout: "name": "_obj", 2024-06-04T16:01:16.516 INFO:tasks.workunit.client.0.smithi144.stdout: "instance": "", 2024-06-04T16:01:16.517 INFO:tasks.workunit.client.0.smithi144.stdout: "ns": "" 2024-06-04T16:01:16.517 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.517 INFO:tasks.workunit.client.0.smithi144.stdout: }, 2024-06-04T16:01:16.517 INFO:tasks.workunit.client.0.smithi144.stdout: "obj3-2": { 2024-06-04T16:01:16.517 INFO:tasks.workunit.client.0.smithi144.stdout: "bucket": { 2024-06-04T16:01:16.517 INFO:tasks.workunit.client.0.smithi144.stdout: "name": "test", 2024-06-04T16:01:16.517 INFO:tasks.workunit.client.0.smithi144.stdout: "marker": "marker", 2024-06-04T16:01:16.517 INFO:tasks.workunit.client.0.smithi144.stdout: "bucket_id": "bucket-id", 2024-06-04T16:01:16.517 INFO:tasks.workunit.client.0.smithi144.stdout: "tenant": "", 2024-06-04T16:01:16.517 INFO:tasks.workunit.client.0.smithi144.stdout: "explicit_placement": { 2024-06-04T16:01:16.517 INFO:tasks.workunit.client.0.smithi144.stdout: "data_pool": "", 2024-06-04T16:01:16.517 INFO:tasks.workunit.client.0.smithi144.stdout: "data_extra_pool": "", 2024-06-04T16:01:16.517 INFO:tasks.workunit.client.0.smithi144.stdout: "index_pool": "" 2024-06-04T16:01:16.517 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.517 INFO:tasks.workunit.client.0.smithi144.stdout: }, 2024-06-04T16:01:16.518 INFO:tasks.workunit.client.0.smithi144.stdout: "key": { 2024-06-04T16:01:16.518 INFO:tasks.workunit.client.0.smithi144.stdout: "name": "_obj", 2024-06-04T16:01:16.518 INFO:tasks.workunit.client.0.smithi144.stdout: "instance": "v1", 2024-06-04T16:01:16.518 INFO:tasks.workunit.client.0.smithi144.stdout: "ns": "ns" 2024-06-04T16:01:16.518 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.518 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.518 INFO:tasks.workunit.client.0.smithi144.stdout:} 2024-06-04T16:01:16.518 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] TestRGWObj.underscore (0 ms) 2024-06-04T16:01:16.518 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] TestRGWObj.no_underscore 2024-06-04T16:01:16.518 INFO:tasks.workunit.client.0.smithi144.stdout:parsed: obj 2024-06-04T16:01:16.518 INFO:tasks.workunit.client.0.smithi144.stdout:parsed: obj 2024-06-04T16:01:16.518 INFO:tasks.workunit.client.0.smithi144.stdout:stripped: obj ns= i= 2024-06-04T16:01:16.518 INFO:tasks.workunit.client.0.smithi144.stdout:parsed: obj 2024-06-04T16:01:16.518 INFO:tasks.workunit.client.0.smithi144.stdout:parsed: obj 2024-06-04T16:01:16.519 INFO:tasks.workunit.client.0.smithi144.stdout:stripped: obj ns= i= 2024-06-04T16:01:16.519 INFO:tasks.workunit.client.0.smithi144.stdout:parsed: obj 2024-06-04T16:01:16.519 INFO:tasks.workunit.client.0.smithi144.stdout:parsed: obj 2024-06-04T16:01:16.519 INFO:tasks.workunit.client.0.smithi144.stdout:stripped: obj ns= i= 2024-06-04T16:01:16.519 INFO:tasks.workunit.client.0.smithi144.stdout:{ 2024-06-04T16:01:16.519 INFO:tasks.workunit.client.0.smithi144.stdout: "obj1": { 2024-06-04T16:01:16.519 INFO:tasks.workunit.client.0.smithi144.stdout: "bucket": { 2024-06-04T16:01:16.519 INFO:tasks.workunit.client.0.smithi144.stdout: "name": "test", 2024-06-04T16:01:16.519 INFO:tasks.workunit.client.0.smithi144.stdout: "marker": "marker", 2024-06-04T16:01:16.519 INFO:tasks.workunit.client.0.smithi144.stdout: "bucket_id": "bucket-id", 2024-06-04T16:01:16.519 INFO:tasks.workunit.client.0.smithi144.stdout: "tenant": "", 2024-06-04T16:01:16.519 INFO:tasks.workunit.client.0.smithi144.stdout: "explicit_placement": { 2024-06-04T16:01:16.519 INFO:tasks.workunit.client.0.smithi144.stdout: "data_pool": "", 2024-06-04T16:01:16.519 INFO:tasks.workunit.client.0.smithi144.stdout: "data_extra_pool": "", 2024-06-04T16:01:16.520 INFO:tasks.workunit.client.0.smithi144.stdout: "index_pool": "" 2024-06-04T16:01:16.520 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.520 INFO:tasks.workunit.client.0.smithi144.stdout: }, 2024-06-04T16:01:16.520 INFO:tasks.workunit.client.0.smithi144.stdout: "key": { 2024-06-04T16:01:16.520 INFO:tasks.workunit.client.0.smithi144.stdout: "name": "obj", 2024-06-04T16:01:16.520 INFO:tasks.workunit.client.0.smithi144.stdout: "instance": "", 2024-06-04T16:01:16.520 INFO:tasks.workunit.client.0.smithi144.stdout: "ns": "" 2024-06-04T16:01:16.520 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.520 INFO:tasks.workunit.client.0.smithi144.stdout: }, 2024-06-04T16:01:16.520 INFO:tasks.workunit.client.0.smithi144.stdout: "obj2": { 2024-06-04T16:01:16.520 INFO:tasks.workunit.client.0.smithi144.stdout: "bucket": { 2024-06-04T16:01:16.520 INFO:tasks.workunit.client.0.smithi144.stdout: "name": "test", 2024-06-04T16:01:16.520 INFO:tasks.workunit.client.0.smithi144.stdout: "marker": "marker", 2024-06-04T16:01:16.521 INFO:tasks.workunit.client.0.smithi144.stdout: "bucket_id": "bucket-id", 2024-06-04T16:01:16.521 INFO:tasks.workunit.client.0.smithi144.stdout: "tenant": "", 2024-06-04T16:01:16.521 INFO:tasks.workunit.client.0.smithi144.stdout: "explicit_placement": { 2024-06-04T16:01:16.521 INFO:tasks.workunit.client.0.smithi144.stdout: "data_pool": "", 2024-06-04T16:01:16.521 INFO:tasks.workunit.client.0.smithi144.stdout: "data_extra_pool": "", 2024-06-04T16:01:16.521 INFO:tasks.workunit.client.0.smithi144.stdout: "index_pool": "" 2024-06-04T16:01:16.521 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.521 INFO:tasks.workunit.client.0.smithi144.stdout: }, 2024-06-04T16:01:16.521 INFO:tasks.workunit.client.0.smithi144.stdout: "key": { 2024-06-04T16:01:16.521 INFO:tasks.workunit.client.0.smithi144.stdout: "name": "obj", 2024-06-04T16:01:16.521 INFO:tasks.workunit.client.0.smithi144.stdout: "instance": "", 2024-06-04T16:01:16.521 INFO:tasks.workunit.client.0.smithi144.stdout: "ns": "" 2024-06-04T16:01:16.521 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.521 INFO:tasks.workunit.client.0.smithi144.stdout: }, 2024-06-04T16:01:16.521 INFO:tasks.workunit.client.0.smithi144.stdout: "obj3": { 2024-06-04T16:01:16.521 INFO:tasks.workunit.client.0.smithi144.stdout: "bucket": { 2024-06-04T16:01:16.522 INFO:tasks.workunit.client.0.smithi144.stdout: "name": "test", 2024-06-04T16:01:16.522 INFO:tasks.workunit.client.0.smithi144.stdout: "marker": "marker", 2024-06-04T16:01:16.522 INFO:tasks.workunit.client.0.smithi144.stdout: "bucket_id": "bucket-id", 2024-06-04T16:01:16.522 INFO:tasks.workunit.client.0.smithi144.stdout: "tenant": "", 2024-06-04T16:01:16.522 INFO:tasks.workunit.client.0.smithi144.stdout: "explicit_placement": { 2024-06-04T16:01:16.522 INFO:tasks.workunit.client.0.smithi144.stdout: "data_pool": "", 2024-06-04T16:01:16.522 INFO:tasks.workunit.client.0.smithi144.stdout: "data_extra_pool": "", 2024-06-04T16:01:16.522 INFO:tasks.workunit.client.0.smithi144.stdout: "index_pool": "" 2024-06-04T16:01:16.522 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.522 INFO:tasks.workunit.client.0.smithi144.stdout: }, 2024-06-04T16:01:16.522 INFO:tasks.workunit.client.0.smithi144.stdout: "key": { 2024-06-04T16:01:16.522 INFO:tasks.workunit.client.0.smithi144.stdout: "name": "obj", 2024-06-04T16:01:16.522 INFO:tasks.workunit.client.0.smithi144.stdout: "instance": "", 2024-06-04T16:01:16.522 INFO:tasks.workunit.client.0.smithi144.stdout: "ns": "" 2024-06-04T16:01:16.523 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.523 INFO:tasks.workunit.client.0.smithi144.stdout: }, 2024-06-04T16:01:16.523 INFO:tasks.workunit.client.0.smithi144.stdout: "obj3-2": { 2024-06-04T16:01:16.523 INFO:tasks.workunit.client.0.smithi144.stdout: "bucket": { 2024-06-04T16:01:16.523 INFO:tasks.workunit.client.0.smithi144.stdout: "name": "test", 2024-06-04T16:01:16.523 INFO:tasks.workunit.client.0.smithi144.stdout: "marker": "marker", 2024-06-04T16:01:16.523 INFO:tasks.workunit.client.0.smithi144.stdout: "bucket_id": "bucket-id", 2024-06-04T16:01:16.523 INFO:tasks.workunit.client.0.smithi144.stdout: "tenant": "", 2024-06-04T16:01:16.523 INFO:tasks.workunit.client.0.smithi144.stdout: "explicit_placement": { 2024-06-04T16:01:16.523 INFO:tasks.workunit.client.0.smithi144.stdout: "data_pool": "", 2024-06-04T16:01:16.523 INFO:tasks.workunit.client.0.smithi144.stdout: "data_extra_pool": "", 2024-06-04T16:01:16.523 INFO:tasks.workunit.client.0.smithi144.stdout: "index_pool": "" 2024-06-04T16:01:16.524 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.524 INFO:tasks.workunit.client.0.smithi144.stdout: }, 2024-06-04T16:01:16.524 INFO:tasks.workunit.client.0.smithi144.stdout: "key": { 2024-06-04T16:01:16.524 INFO:tasks.workunit.client.0.smithi144.stdout: "name": "obj", 2024-06-04T16:01:16.524 INFO:tasks.workunit.client.0.smithi144.stdout: "instance": "", 2024-06-04T16:01:16.524 INFO:tasks.workunit.client.0.smithi144.stdout: "ns": "" 2024-06-04T16:01:16.524 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.524 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.524 INFO:tasks.workunit.client.0.smithi144.stdout:} 2024-06-04T16:01:16.524 INFO:tasks.workunit.client.0.smithi144.stdout:parsed: obj 2024-06-04T16:01:16.524 INFO:tasks.workunit.client.0.smithi144.stdout:parsed: obj 2024-06-04T16:01:16.524 INFO:tasks.workunit.client.0.smithi144.stdout:stripped: obj ns=ns i= 2024-06-04T16:01:16.524 INFO:tasks.workunit.client.0.smithi144.stdout:parsed: obj 2024-06-04T16:01:16.524 INFO:tasks.workunit.client.0.smithi144.stdout:parsed: obj 2024-06-04T16:01:16.524 INFO:tasks.workunit.client.0.smithi144.stdout:stripped: obj ns=ns i= 2024-06-04T16:01:16.525 INFO:tasks.workunit.client.0.smithi144.stdout:parsed: obj 2024-06-04T16:01:16.525 INFO:tasks.workunit.client.0.smithi144.stdout:parsed: obj 2024-06-04T16:01:16.525 INFO:tasks.workunit.client.0.smithi144.stdout:stripped: obj ns=ns i= 2024-06-04T16:01:16.525 INFO:tasks.workunit.client.0.smithi144.stdout:{ 2024-06-04T16:01:16.525 INFO:tasks.workunit.client.0.smithi144.stdout: "obj1": { 2024-06-04T16:01:16.525 INFO:tasks.workunit.client.0.smithi144.stdout: "bucket": { 2024-06-04T16:01:16.525 INFO:tasks.workunit.client.0.smithi144.stdout: "name": "test", 2024-06-04T16:01:16.525 INFO:tasks.workunit.client.0.smithi144.stdout: "marker": "marker", 2024-06-04T16:01:16.525 INFO:tasks.workunit.client.0.smithi144.stdout: "bucket_id": "bucket-id", 2024-06-04T16:01:16.525 INFO:tasks.workunit.client.0.smithi144.stdout: "tenant": "", 2024-06-04T16:01:16.525 INFO:tasks.workunit.client.0.smithi144.stdout: "explicit_placement": { 2024-06-04T16:01:16.525 INFO:tasks.workunit.client.0.smithi144.stdout: "data_pool": "", 2024-06-04T16:01:16.525 INFO:tasks.workunit.client.0.smithi144.stdout: "data_extra_pool": "", 2024-06-04T16:01:16.525 INFO:tasks.workunit.client.0.smithi144.stdout: "index_pool": "" 2024-06-04T16:01:16.525 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.526 INFO:tasks.workunit.client.0.smithi144.stdout: }, 2024-06-04T16:01:16.526 INFO:tasks.workunit.client.0.smithi144.stdout: "key": { 2024-06-04T16:01:16.526 INFO:tasks.workunit.client.0.smithi144.stdout: "name": "obj", 2024-06-04T16:01:16.526 INFO:tasks.workunit.client.0.smithi144.stdout: "instance": "", 2024-06-04T16:01:16.526 INFO:tasks.workunit.client.0.smithi144.stdout: "ns": "ns" 2024-06-04T16:01:16.526 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.526 INFO:tasks.workunit.client.0.smithi144.stdout: }, 2024-06-04T16:01:16.526 INFO:tasks.workunit.client.0.smithi144.stdout: "obj2": { 2024-06-04T16:01:16.526 INFO:tasks.workunit.client.0.smithi144.stdout: "bucket": { 2024-06-04T16:01:16.526 INFO:tasks.workunit.client.0.smithi144.stdout: "name": "test", 2024-06-04T16:01:16.526 INFO:tasks.workunit.client.0.smithi144.stdout: "marker": "marker", 2024-06-04T16:01:16.526 INFO:tasks.workunit.client.0.smithi144.stdout: "bucket_id": "bucket-id", 2024-06-04T16:01:16.526 INFO:tasks.workunit.client.0.smithi144.stdout: "tenant": "", 2024-06-04T16:01:16.526 INFO:tasks.workunit.client.0.smithi144.stdout: "explicit_placement": { 2024-06-04T16:01:16.527 INFO:tasks.workunit.client.0.smithi144.stdout: "data_pool": "", 2024-06-04T16:01:16.527 INFO:tasks.workunit.client.0.smithi144.stdout: "data_extra_pool": "", 2024-06-04T16:01:16.527 INFO:tasks.workunit.client.0.smithi144.stdout: "index_pool": "" 2024-06-04T16:01:16.527 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.527 INFO:tasks.workunit.client.0.smithi144.stdout: }, 2024-06-04T16:01:16.527 INFO:tasks.workunit.client.0.smithi144.stdout: "key": { 2024-06-04T16:01:16.527 INFO:tasks.workunit.client.0.smithi144.stdout: "name": "obj", 2024-06-04T16:01:16.527 INFO:tasks.workunit.client.0.smithi144.stdout: "instance": "", 2024-06-04T16:01:16.527 INFO:tasks.workunit.client.0.smithi144.stdout: "ns": "ns" 2024-06-04T16:01:16.527 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.527 INFO:tasks.workunit.client.0.smithi144.stdout: }, 2024-06-04T16:01:16.527 INFO:tasks.workunit.client.0.smithi144.stdout: "obj3": { 2024-06-04T16:01:16.527 INFO:tasks.workunit.client.0.smithi144.stdout: "bucket": { 2024-06-04T16:01:16.527 INFO:tasks.workunit.client.0.smithi144.stdout: "name": "test", 2024-06-04T16:01:16.528 INFO:tasks.workunit.client.0.smithi144.stdout: "marker": "marker", 2024-06-04T16:01:16.528 INFO:tasks.workunit.client.0.smithi144.stdout: "bucket_id": "bucket-id", 2024-06-04T16:01:16.528 INFO:tasks.workunit.client.0.smithi144.stdout: "tenant": "", 2024-06-04T16:01:16.528 INFO:tasks.workunit.client.0.smithi144.stdout: "explicit_placement": { 2024-06-04T16:01:16.528 INFO:tasks.workunit.client.0.smithi144.stdout: "data_pool": "", 2024-06-04T16:01:16.528 INFO:tasks.workunit.client.0.smithi144.stdout: "data_extra_pool": "", 2024-06-04T16:01:16.528 INFO:tasks.workunit.client.0.smithi144.stdout: "index_pool": "" 2024-06-04T16:01:16.528 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.528 INFO:tasks.workunit.client.0.smithi144.stdout: }, 2024-06-04T16:01:16.528 INFO:tasks.workunit.client.0.smithi144.stdout: "key": { 2024-06-04T16:01:16.528 INFO:tasks.workunit.client.0.smithi144.stdout: "name": "obj", 2024-06-04T16:01:16.528 INFO:tasks.workunit.client.0.smithi144.stdout: "instance": "", 2024-06-04T16:01:16.528 INFO:tasks.workunit.client.0.smithi144.stdout: "ns": "" 2024-06-04T16:01:16.528 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.528 INFO:tasks.workunit.client.0.smithi144.stdout: }, 2024-06-04T16:01:16.529 INFO:tasks.workunit.client.0.smithi144.stdout: "obj3-2": { 2024-06-04T16:01:16.529 INFO:tasks.workunit.client.0.smithi144.stdout: "bucket": { 2024-06-04T16:01:16.529 INFO:tasks.workunit.client.0.smithi144.stdout: "name": "test", 2024-06-04T16:01:16.529 INFO:tasks.workunit.client.0.smithi144.stdout: "marker": "marker", 2024-06-04T16:01:16.529 INFO:tasks.workunit.client.0.smithi144.stdout: "bucket_id": "bucket-id", 2024-06-04T16:01:16.529 INFO:tasks.workunit.client.0.smithi144.stdout: "tenant": "", 2024-06-04T16:01:16.529 INFO:tasks.workunit.client.0.smithi144.stdout: "explicit_placement": { 2024-06-04T16:01:16.529 INFO:tasks.workunit.client.0.smithi144.stdout: "data_pool": "", 2024-06-04T16:01:16.529 INFO:tasks.workunit.client.0.smithi144.stdout: "data_extra_pool": "", 2024-06-04T16:01:16.529 INFO:tasks.workunit.client.0.smithi144.stdout: "index_pool": "" 2024-06-04T16:01:16.529 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.529 INFO:tasks.workunit.client.0.smithi144.stdout: }, 2024-06-04T16:01:16.529 INFO:tasks.workunit.client.0.smithi144.stdout: "key": { 2024-06-04T16:01:16.530 INFO:tasks.workunit.client.0.smithi144.stdout: "name": "obj", 2024-06-04T16:01:16.530 INFO:tasks.workunit.client.0.smithi144.stdout: "instance": "", 2024-06-04T16:01:16.530 INFO:tasks.workunit.client.0.smithi144.stdout: "ns": "ns" 2024-06-04T16:01:16.530 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.530 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.530 INFO:tasks.workunit.client.0.smithi144.stdout:} 2024-06-04T16:01:16.530 INFO:tasks.workunit.client.0.smithi144.stdout:parsed: obj[v1] 2024-06-04T16:01:16.530 INFO:tasks.workunit.client.0.smithi144.stdout:parsed: obj[v1] 2024-06-04T16:01:16.530 INFO:tasks.workunit.client.0.smithi144.stdout:stripped: obj ns= i=v1 2024-06-04T16:01:16.530 INFO:tasks.workunit.client.0.smithi144.stdout:parsed: obj[v1] 2024-06-04T16:01:16.530 INFO:tasks.workunit.client.0.smithi144.stdout:parsed: obj[v1] 2024-06-04T16:01:16.530 INFO:tasks.workunit.client.0.smithi144.stdout:stripped: obj ns= i=v1 2024-06-04T16:01:16.531 INFO:tasks.workunit.client.0.smithi144.stdout:parsed: obj[v1] 2024-06-04T16:01:16.531 INFO:tasks.workunit.client.0.smithi144.stdout:parsed: obj[v1] 2024-06-04T16:01:16.531 INFO:tasks.workunit.client.0.smithi144.stdout:stripped: obj ns= i=v1 2024-06-04T16:01:16.531 INFO:tasks.workunit.client.0.smithi144.stdout:{ 2024-06-04T16:01:16.531 INFO:tasks.workunit.client.0.smithi144.stdout: "obj1": { 2024-06-04T16:01:16.531 INFO:tasks.workunit.client.0.smithi144.stdout: "bucket": { 2024-06-04T16:01:16.531 INFO:tasks.workunit.client.0.smithi144.stdout: "name": "test", 2024-06-04T16:01:16.531 INFO:tasks.workunit.client.0.smithi144.stdout: "marker": "marker", 2024-06-04T16:01:16.531 INFO:tasks.workunit.client.0.smithi144.stdout: "bucket_id": "bucket-id", 2024-06-04T16:01:16.531 INFO:tasks.workunit.client.0.smithi144.stdout: "tenant": "", 2024-06-04T16:01:16.531 INFO:tasks.workunit.client.0.smithi144.stdout: "explicit_placement": { 2024-06-04T16:01:16.531 INFO:tasks.workunit.client.0.smithi144.stdout: "data_pool": "", 2024-06-04T16:01:16.531 INFO:tasks.workunit.client.0.smithi144.stdout: "data_extra_pool": "", 2024-06-04T16:01:16.531 INFO:tasks.workunit.client.0.smithi144.stdout: "index_pool": "" 2024-06-04T16:01:16.532 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.532 INFO:tasks.workunit.client.0.smithi144.stdout: }, 2024-06-04T16:01:16.532 INFO:tasks.workunit.client.0.smithi144.stdout: "key": { 2024-06-04T16:01:16.532 INFO:tasks.workunit.client.0.smithi144.stdout: "name": "obj", 2024-06-04T16:01:16.532 INFO:tasks.workunit.client.0.smithi144.stdout: "instance": "v1", 2024-06-04T16:01:16.532 INFO:tasks.workunit.client.0.smithi144.stdout: "ns": "" 2024-06-04T16:01:16.532 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.532 INFO:tasks.workunit.client.0.smithi144.stdout: }, 2024-06-04T16:01:16.532 INFO:tasks.workunit.client.0.smithi144.stdout: "obj2": { 2024-06-04T16:01:16.532 INFO:tasks.workunit.client.0.smithi144.stdout: "bucket": { 2024-06-04T16:01:16.532 INFO:tasks.workunit.client.0.smithi144.stdout: "name": "test", 2024-06-04T16:01:16.532 INFO:tasks.workunit.client.0.smithi144.stdout: "marker": "marker", 2024-06-04T16:01:16.532 INFO:tasks.workunit.client.0.smithi144.stdout: "bucket_id": "bucket-id", 2024-06-04T16:01:16.532 INFO:tasks.workunit.client.0.smithi144.stdout: "tenant": "", 2024-06-04T16:01:16.533 INFO:tasks.workunit.client.0.smithi144.stdout: "explicit_placement": { 2024-06-04T16:01:16.533 INFO:tasks.workunit.client.0.smithi144.stdout: "data_pool": "", 2024-06-04T16:01:16.533 INFO:tasks.workunit.client.0.smithi144.stdout: "data_extra_pool": "", 2024-06-04T16:01:16.533 INFO:tasks.workunit.client.0.smithi144.stdout: "index_pool": "" 2024-06-04T16:01:16.533 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.533 INFO:tasks.workunit.client.0.smithi144.stdout: }, 2024-06-04T16:01:16.533 INFO:tasks.workunit.client.0.smithi144.stdout: "key": { 2024-06-04T16:01:16.533 INFO:tasks.workunit.client.0.smithi144.stdout: "name": "obj", 2024-06-04T16:01:16.533 INFO:tasks.workunit.client.0.smithi144.stdout: "instance": "v1", 2024-06-04T16:01:16.533 INFO:tasks.workunit.client.0.smithi144.stdout: "ns": "" 2024-06-04T16:01:16.533 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.533 INFO:tasks.workunit.client.0.smithi144.stdout: }, 2024-06-04T16:01:16.533 INFO:tasks.workunit.client.0.smithi144.stdout: "obj3": { 2024-06-04T16:01:16.533 INFO:tasks.workunit.client.0.smithi144.stdout: "bucket": { 2024-06-04T16:01:16.533 INFO:tasks.workunit.client.0.smithi144.stdout: "name": "test", 2024-06-04T16:01:16.534 INFO:tasks.workunit.client.0.smithi144.stdout: "marker": "marker", 2024-06-04T16:01:16.534 INFO:tasks.workunit.client.0.smithi144.stdout: "bucket_id": "bucket-id", 2024-06-04T16:01:16.534 INFO:tasks.workunit.client.0.smithi144.stdout: "tenant": "", 2024-06-04T16:01:16.534 INFO:tasks.workunit.client.0.smithi144.stdout: "explicit_placement": { 2024-06-04T16:01:16.534 INFO:tasks.workunit.client.0.smithi144.stdout: "data_pool": "", 2024-06-04T16:01:16.534 INFO:tasks.workunit.client.0.smithi144.stdout: "data_extra_pool": "", 2024-06-04T16:01:16.534 INFO:tasks.workunit.client.0.smithi144.stdout: "index_pool": "" 2024-06-04T16:01:16.534 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.534 INFO:tasks.workunit.client.0.smithi144.stdout: }, 2024-06-04T16:01:16.534 INFO:tasks.workunit.client.0.smithi144.stdout: "key": { 2024-06-04T16:01:16.534 INFO:tasks.workunit.client.0.smithi144.stdout: "name": "obj", 2024-06-04T16:01:16.534 INFO:tasks.workunit.client.0.smithi144.stdout: "instance": "", 2024-06-04T16:01:16.534 INFO:tasks.workunit.client.0.smithi144.stdout: "ns": "" 2024-06-04T16:01:16.535 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.535 INFO:tasks.workunit.client.0.smithi144.stdout: }, 2024-06-04T16:01:16.535 INFO:tasks.workunit.client.0.smithi144.stdout: "obj3-2": { 2024-06-04T16:01:16.535 INFO:tasks.workunit.client.0.smithi144.stdout: "bucket": { 2024-06-04T16:01:16.535 INFO:tasks.workunit.client.0.smithi144.stdout: "name": "test", 2024-06-04T16:01:16.535 INFO:tasks.workunit.client.0.smithi144.stdout: "marker": "marker", 2024-06-04T16:01:16.535 INFO:tasks.workunit.client.0.smithi144.stdout: "bucket_id": "bucket-id", 2024-06-04T16:01:16.535 INFO:tasks.workunit.client.0.smithi144.stdout: "tenant": "", 2024-06-04T16:01:16.535 INFO:tasks.workunit.client.0.smithi144.stdout: "explicit_placement": { 2024-06-04T16:01:16.535 INFO:tasks.workunit.client.0.smithi144.stdout: "data_pool": "", 2024-06-04T16:01:16.535 INFO:tasks.workunit.client.0.smithi144.stdout: "data_extra_pool": "", 2024-06-04T16:01:16.535 INFO:tasks.workunit.client.0.smithi144.stdout: "index_pool": "" 2024-06-04T16:01:16.535 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.535 INFO:tasks.workunit.client.0.smithi144.stdout: }, 2024-06-04T16:01:16.536 INFO:tasks.workunit.client.0.smithi144.stdout: "key": { 2024-06-04T16:01:16.536 INFO:tasks.workunit.client.0.smithi144.stdout: "name": "obj", 2024-06-04T16:01:16.536 INFO:tasks.workunit.client.0.smithi144.stdout: "instance": "v1", 2024-06-04T16:01:16.536 INFO:tasks.workunit.client.0.smithi144.stdout: "ns": "" 2024-06-04T16:01:16.536 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.536 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.536 INFO:tasks.workunit.client.0.smithi144.stdout:} 2024-06-04T16:01:16.536 INFO:tasks.workunit.client.0.smithi144.stdout:parsed: obj[v1] 2024-06-04T16:01:16.536 INFO:tasks.workunit.client.0.smithi144.stdout:parsed: obj[v1] 2024-06-04T16:01:16.536 INFO:tasks.workunit.client.0.smithi144.stdout:stripped: obj ns=ns i=v1 2024-06-04T16:01:16.536 INFO:tasks.workunit.client.0.smithi144.stdout:parsed: obj[v1] 2024-06-04T16:01:16.536 INFO:tasks.workunit.client.0.smithi144.stdout:parsed: obj[v1] 2024-06-04T16:01:16.536 INFO:tasks.workunit.client.0.smithi144.stdout:stripped: obj ns=ns i=v1 2024-06-04T16:01:16.536 INFO:tasks.workunit.client.0.smithi144.stdout:parsed: obj[v1] 2024-06-04T16:01:16.537 INFO:tasks.workunit.client.0.smithi144.stdout:parsed: obj[v1] 2024-06-04T16:01:16.537 INFO:tasks.workunit.client.0.smithi144.stdout:stripped: obj ns=ns i=v1 2024-06-04T16:01:16.537 INFO:tasks.workunit.client.0.smithi144.stdout:{ 2024-06-04T16:01:16.537 INFO:tasks.workunit.client.0.smithi144.stdout: "obj1": { 2024-06-04T16:01:16.537 INFO:tasks.workunit.client.0.smithi144.stdout: "bucket": { 2024-06-04T16:01:16.537 INFO:tasks.workunit.client.0.smithi144.stdout: "name": "test", 2024-06-04T16:01:16.537 INFO:tasks.workunit.client.0.smithi144.stdout: "marker": "marker", 2024-06-04T16:01:16.537 INFO:tasks.workunit.client.0.smithi144.stdout: "bucket_id": "bucket-id", 2024-06-04T16:01:16.537 INFO:tasks.workunit.client.0.smithi144.stdout: "tenant": "", 2024-06-04T16:01:16.537 INFO:tasks.workunit.client.0.smithi144.stdout: "explicit_placement": { 2024-06-04T16:01:16.537 INFO:tasks.workunit.client.0.smithi144.stdout: "data_pool": "", 2024-06-04T16:01:16.537 INFO:tasks.workunit.client.0.smithi144.stdout: "data_extra_pool": "", 2024-06-04T16:01:16.537 INFO:tasks.workunit.client.0.smithi144.stdout: "index_pool": "" 2024-06-04T16:01:16.537 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.537 INFO:tasks.workunit.client.0.smithi144.stdout: }, 2024-06-04T16:01:16.537 INFO:tasks.workunit.client.0.smithi144.stdout: "key": { 2024-06-04T16:01:16.538 INFO:tasks.workunit.client.0.smithi144.stdout: "name": "obj", 2024-06-04T16:01:16.538 INFO:tasks.workunit.client.0.smithi144.stdout: "instance": "v1", 2024-06-04T16:01:16.538 INFO:tasks.workunit.client.0.smithi144.stdout: "ns": "ns" 2024-06-04T16:01:16.538 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.538 INFO:tasks.workunit.client.0.smithi144.stdout: }, 2024-06-04T16:01:16.538 INFO:tasks.workunit.client.0.smithi144.stdout: "obj2": { 2024-06-04T16:01:16.538 INFO:tasks.workunit.client.0.smithi144.stdout: "bucket": { 2024-06-04T16:01:16.538 INFO:tasks.workunit.client.0.smithi144.stdout: "name": "test", 2024-06-04T16:01:16.538 INFO:tasks.workunit.client.0.smithi144.stdout: "marker": "marker", 2024-06-04T16:01:16.538 INFO:tasks.workunit.client.0.smithi144.stdout: "bucket_id": "bucket-id", 2024-06-04T16:01:16.538 INFO:tasks.workunit.client.0.smithi144.stdout: "tenant": "", 2024-06-04T16:01:16.538 INFO:tasks.workunit.client.0.smithi144.stdout: "explicit_placement": { 2024-06-04T16:01:16.538 INFO:tasks.workunit.client.0.smithi144.stdout: "data_pool": "", 2024-06-04T16:01:16.539 INFO:tasks.workunit.client.0.smithi144.stdout: "data_extra_pool": "", 2024-06-04T16:01:16.539 INFO:tasks.workunit.client.0.smithi144.stdout: "index_pool": "" 2024-06-04T16:01:16.539 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.539 INFO:tasks.workunit.client.0.smithi144.stdout: }, 2024-06-04T16:01:16.539 INFO:tasks.workunit.client.0.smithi144.stdout: "key": { 2024-06-04T16:01:16.539 INFO:tasks.workunit.client.0.smithi144.stdout: "name": "obj", 2024-06-04T16:01:16.539 INFO:tasks.workunit.client.0.smithi144.stdout: "instance": "v1", 2024-06-04T16:01:16.539 INFO:tasks.workunit.client.0.smithi144.stdout: "ns": "ns" 2024-06-04T16:01:16.539 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.539 INFO:tasks.workunit.client.0.smithi144.stdout: }, 2024-06-04T16:01:16.540 INFO:tasks.workunit.client.0.smithi144.stdout: "obj3": { 2024-06-04T16:01:16.540 INFO:tasks.workunit.client.0.smithi144.stdout: "bucket": { 2024-06-04T16:01:16.540 INFO:tasks.workunit.client.0.smithi144.stdout: "name": "test", 2024-06-04T16:01:16.540 INFO:tasks.workunit.client.0.smithi144.stdout: "marker": "marker", 2024-06-04T16:01:16.540 INFO:tasks.workunit.client.0.smithi144.stdout: "bucket_id": "bucket-id", 2024-06-04T16:01:16.540 INFO:tasks.workunit.client.0.smithi144.stdout: "tenant": "", 2024-06-04T16:01:16.540 INFO:tasks.workunit.client.0.smithi144.stdout: "explicit_placement": { 2024-06-04T16:01:16.540 INFO:tasks.workunit.client.0.smithi144.stdout: "data_pool": "", 2024-06-04T16:01:16.540 INFO:tasks.workunit.client.0.smithi144.stdout: "data_extra_pool": "", 2024-06-04T16:01:16.540 INFO:tasks.workunit.client.0.smithi144.stdout: "index_pool": "" 2024-06-04T16:01:16.540 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.540 INFO:tasks.workunit.client.0.smithi144.stdout: }, 2024-06-04T16:01:16.540 INFO:tasks.workunit.client.0.smithi144.stdout: "key": { 2024-06-04T16:01:16.541 INFO:tasks.workunit.client.0.smithi144.stdout: "name": "obj", 2024-06-04T16:01:16.541 INFO:tasks.workunit.client.0.smithi144.stdout: "instance": "", 2024-06-04T16:01:16.541 INFO:tasks.workunit.client.0.smithi144.stdout: "ns": "" 2024-06-04T16:01:16.541 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.541 INFO:tasks.workunit.client.0.smithi144.stdout: }, 2024-06-04T16:01:16.541 INFO:tasks.workunit.client.0.smithi144.stdout: "obj3-2": { 2024-06-04T16:01:16.541 INFO:tasks.workunit.client.0.smithi144.stdout: "bucket": { 2024-06-04T16:01:16.541 INFO:tasks.workunit.client.0.smithi144.stdout: "name": "test", 2024-06-04T16:01:16.541 INFO:tasks.workunit.client.0.smithi144.stdout: "marker": "marker", 2024-06-04T16:01:16.541 INFO:tasks.workunit.client.0.smithi144.stdout: "bucket_id": "bucket-id", 2024-06-04T16:01:16.541 INFO:tasks.workunit.client.0.smithi144.stdout: "tenant": "", 2024-06-04T16:01:16.541 INFO:tasks.workunit.client.0.smithi144.stdout: "explicit_placement": { 2024-06-04T16:01:16.541 INFO:tasks.workunit.client.0.smithi144.stdout: "data_pool": "", 2024-06-04T16:01:16.541 INFO:tasks.workunit.client.0.smithi144.stdout: "data_extra_pool": "", 2024-06-04T16:01:16.541 INFO:tasks.workunit.client.0.smithi144.stdout: "index_pool": "" 2024-06-04T16:01:16.542 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.542 INFO:tasks.workunit.client.0.smithi144.stdout: }, 2024-06-04T16:01:16.542 INFO:tasks.workunit.client.0.smithi144.stdout: "key": { 2024-06-04T16:01:16.542 INFO:tasks.workunit.client.0.smithi144.stdout: "name": "obj", 2024-06-04T16:01:16.542 INFO:tasks.workunit.client.0.smithi144.stdout: "instance": "v1", 2024-06-04T16:01:16.542 INFO:tasks.workunit.client.0.smithi144.stdout: "ns": "ns" 2024-06-04T16:01:16.542 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.542 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.542 INFO:tasks.workunit.client.0.smithi144.stdout:} 2024-06-04T16:01:16.542 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] TestRGWObj.no_underscore (0 ms) 2024-06-04T16:01:16.542 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] TestRGWObj.obj_to_raw 2024-06-04T16:01:16.542 INFO:tasks.workunit.client.0.smithi144.stdout:{ 2024-06-04T16:01:16.542 INFO:tasks.workunit.client.0.smithi144.stdout: "bucket": { 2024-06-04T16:01:16.543 INFO:tasks.workunit.client.0.smithi144.stdout: "name": "test", 2024-06-04T16:01:16.543 INFO:tasks.workunit.client.0.smithi144.stdout: "marker": "marker", 2024-06-04T16:01:16.543 INFO:tasks.workunit.client.0.smithi144.stdout: "bucket_id": "bucket-id", 2024-06-04T16:01:16.543 INFO:tasks.workunit.client.0.smithi144.stdout: "tenant": "", 2024-06-04T16:01:16.543 INFO:tasks.workunit.client.0.smithi144.stdout: "explicit_placement": { 2024-06-04T16:01:16.543 INFO:tasks.workunit.client.0.smithi144.stdout: "data_pool": "", 2024-06-04T16:01:16.543 INFO:tasks.workunit.client.0.smithi144.stdout: "data_extra_pool": "", 2024-06-04T16:01:16.543 INFO:tasks.workunit.client.0.smithi144.stdout: "index_pool": "" 2024-06-04T16:01:16.543 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.543 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.543 INFO:tasks.workunit.client.0.smithi144.stdout:} 2024-06-04T16:01:16.543 INFO:tasks.workunit.client.0.smithi144.stdout:{ 2024-06-04T16:01:16.543 INFO:tasks.workunit.client.0.smithi144.stdout: "obj": { 2024-06-04T16:01:16.543 INFO:tasks.workunit.client.0.smithi144.stdout: "bucket": { 2024-06-04T16:01:16.544 INFO:tasks.workunit.client.0.smithi144.stdout: "name": "test", 2024-06-04T16:01:16.544 INFO:tasks.workunit.client.0.smithi144.stdout: "marker": "marker", 2024-06-04T16:01:16.544 INFO:tasks.workunit.client.0.smithi144.stdout: "bucket_id": "bucket-id", 2024-06-04T16:01:16.544 INFO:tasks.workunit.client.0.smithi144.stdout: "tenant": "", 2024-06-04T16:01:16.544 INFO:tasks.workunit.client.0.smithi144.stdout: "explicit_placement": { 2024-06-04T16:01:16.544 INFO:tasks.workunit.client.0.smithi144.stdout: "data_pool": "", 2024-06-04T16:01:16.544 INFO:tasks.workunit.client.0.smithi144.stdout: "data_extra_pool": "", 2024-06-04T16:01:16.544 INFO:tasks.workunit.client.0.smithi144.stdout: "index_pool": "" 2024-06-04T16:01:16.544 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.544 INFO:tasks.workunit.client.0.smithi144.stdout: }, 2024-06-04T16:01:16.544 INFO:tasks.workunit.client.0.smithi144.stdout: "key": { 2024-06-04T16:01:16.544 INFO:tasks.workunit.client.0.smithi144.stdout: "name": "myobj", 2024-06-04T16:01:16.544 INFO:tasks.workunit.client.0.smithi144.stdout: "instance": "", 2024-06-04T16:01:16.544 INFO:tasks.workunit.client.0.smithi144.stdout: "ns": "" 2024-06-04T16:01:16.544 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.545 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.545 INFO:tasks.workunit.client.0.smithi144.stdout:} 2024-06-04T16:01:16.545 INFO:tasks.workunit.client.0.smithi144.stdout:{ 2024-06-04T16:01:16.545 INFO:tasks.workunit.client.0.smithi144.stdout: "raw_obj": { 2024-06-04T16:01:16.545 INFO:tasks.workunit.client.0.smithi144.stdout: "pool": "default-placement.data", 2024-06-04T16:01:16.545 INFO:tasks.workunit.client.0.smithi144.stdout: "oid": "marker_myobj", 2024-06-04T16:01:16.545 INFO:tasks.workunit.client.0.smithi144.stdout: "loc": "" 2024-06-04T16:01:16.545 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.545 INFO:tasks.workunit.client.0.smithi144.stdout:} 2024-06-04T16:01:16.545 INFO:tasks.workunit.client.0.smithi144.stdout:{ 2024-06-04T16:01:16.545 INFO:tasks.workunit.client.0.smithi144.stdout: "new_obj": { 2024-06-04T16:01:16.546 INFO:tasks.workunit.client.0.smithi144.stdout: "bucket": { 2024-06-04T16:01:16.546 INFO:tasks.workunit.client.0.smithi144.stdout: "name": "test", 2024-06-04T16:01:16.546 INFO:tasks.workunit.client.0.smithi144.stdout: "marker": "marker", 2024-06-04T16:01:16.546 INFO:tasks.workunit.client.0.smithi144.stdout: "bucket_id": "bucket-id", 2024-06-04T16:01:16.546 INFO:tasks.workunit.client.0.smithi144.stdout: "tenant": "", 2024-06-04T16:01:16.546 INFO:tasks.workunit.client.0.smithi144.stdout: "explicit_placement": { 2024-06-04T16:01:16.546 INFO:tasks.workunit.client.0.smithi144.stdout: "data_pool": "", 2024-06-04T16:01:16.546 INFO:tasks.workunit.client.0.smithi144.stdout: "data_extra_pool": "", 2024-06-04T16:01:16.546 INFO:tasks.workunit.client.0.smithi144.stdout: "index_pool": "" 2024-06-04T16:01:16.546 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.546 INFO:tasks.workunit.client.0.smithi144.stdout: }, 2024-06-04T16:01:16.546 INFO:tasks.workunit.client.0.smithi144.stdout: "key": { 2024-06-04T16:01:16.546 INFO:tasks.workunit.client.0.smithi144.stdout: "name": "myobj", 2024-06-04T16:01:16.546 INFO:tasks.workunit.client.0.smithi144.stdout: "instance": "", 2024-06-04T16:01:16.547 INFO:tasks.workunit.client.0.smithi144.stdout: "ns": "" 2024-06-04T16:01:16.547 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.547 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.547 INFO:tasks.workunit.client.0.smithi144.stdout:} 2024-06-04T16:01:16.547 INFO:tasks.workunit.client.0.smithi144.stdout:{ 2024-06-04T16:01:16.547 INFO:tasks.workunit.client.0.smithi144.stdout: "bucket": { 2024-06-04T16:01:16.547 INFO:tasks.workunit.client.0.smithi144.stdout: "name": "ebtest", 2024-06-04T16:01:16.547 INFO:tasks.workunit.client.0.smithi144.stdout: "marker": "marker", 2024-06-04T16:01:16.547 INFO:tasks.workunit.client.0.smithi144.stdout: "bucket_id": "bucket-id", 2024-06-04T16:01:16.547 INFO:tasks.workunit.client.0.smithi144.stdout: "tenant": "", 2024-06-04T16:01:16.547 INFO:tasks.workunit.client.0.smithi144.stdout: "explicit_placement": { 2024-06-04T16:01:16.547 INFO:tasks.workunit.client.0.smithi144.stdout: "data_pool": ".data-pool", 2024-06-04T16:01:16.547 INFO:tasks.workunit.client.0.smithi144.stdout: "data_extra_pool": "", 2024-06-04T16:01:16.547 INFO:tasks.workunit.client.0.smithi144.stdout: "index_pool": ".index-pool" 2024-06-04T16:01:16.548 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.548 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.548 INFO:tasks.workunit.client.0.smithi144.stdout:} 2024-06-04T16:01:16.548 INFO:tasks.workunit.client.0.smithi144.stdout:{ 2024-06-04T16:01:16.548 INFO:tasks.workunit.client.0.smithi144.stdout: "obj": { 2024-06-04T16:01:16.548 INFO:tasks.workunit.client.0.smithi144.stdout: "bucket": { 2024-06-04T16:01:16.548 INFO:tasks.workunit.client.0.smithi144.stdout: "name": "ebtest", 2024-06-04T16:01:16.548 INFO:tasks.workunit.client.0.smithi144.stdout: "marker": "marker", 2024-06-04T16:01:16.548 INFO:tasks.workunit.client.0.smithi144.stdout: "bucket_id": "bucket-id", 2024-06-04T16:01:16.548 INFO:tasks.workunit.client.0.smithi144.stdout: "tenant": "", 2024-06-04T16:01:16.548 INFO:tasks.workunit.client.0.smithi144.stdout: "explicit_placement": { 2024-06-04T16:01:16.548 INFO:tasks.workunit.client.0.smithi144.stdout: "data_pool": ".data-pool", 2024-06-04T16:01:16.548 INFO:tasks.workunit.client.0.smithi144.stdout: "data_extra_pool": "", 2024-06-04T16:01:16.548 INFO:tasks.workunit.client.0.smithi144.stdout: "index_pool": ".index-pool" 2024-06-04T16:01:16.549 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.549 INFO:tasks.workunit.client.0.smithi144.stdout: }, 2024-06-04T16:01:16.549 INFO:tasks.workunit.client.0.smithi144.stdout: "key": { 2024-06-04T16:01:16.549 INFO:tasks.workunit.client.0.smithi144.stdout: "name": "myobj", 2024-06-04T16:01:16.549 INFO:tasks.workunit.client.0.smithi144.stdout: "instance": "", 2024-06-04T16:01:16.549 INFO:tasks.workunit.client.0.smithi144.stdout: "ns": "" 2024-06-04T16:01:16.549 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.549 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.549 INFO:tasks.workunit.client.0.smithi144.stdout:} 2024-06-04T16:01:16.549 INFO:tasks.workunit.client.0.smithi144.stdout:{ 2024-06-04T16:01:16.549 INFO:tasks.workunit.client.0.smithi144.stdout: "raw_obj": { 2024-06-04T16:01:16.549 INFO:tasks.workunit.client.0.smithi144.stdout: "pool": ".data-pool", 2024-06-04T16:01:16.549 INFO:tasks.workunit.client.0.smithi144.stdout: "oid": "marker_myobj", 2024-06-04T16:01:16.549 INFO:tasks.workunit.client.0.smithi144.stdout: "loc": "" 2024-06-04T16:01:16.550 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.550 INFO:tasks.workunit.client.0.smithi144.stdout:} 2024-06-04T16:01:16.550 INFO:tasks.workunit.client.0.smithi144.stdout:{ 2024-06-04T16:01:16.550 INFO:tasks.workunit.client.0.smithi144.stdout: "new_obj": { 2024-06-04T16:01:16.550 INFO:tasks.workunit.client.0.smithi144.stdout: "bucket": { 2024-06-04T16:01:16.550 INFO:tasks.workunit.client.0.smithi144.stdout: "name": "ebtest", 2024-06-04T16:01:16.550 INFO:tasks.workunit.client.0.smithi144.stdout: "marker": "marker", 2024-06-04T16:01:16.550 INFO:tasks.workunit.client.0.smithi144.stdout: "bucket_id": "bucket-id", 2024-06-04T16:01:16.550 INFO:tasks.workunit.client.0.smithi144.stdout: "tenant": "", 2024-06-04T16:01:16.550 INFO:tasks.workunit.client.0.smithi144.stdout: "explicit_placement": { 2024-06-04T16:01:16.550 INFO:tasks.workunit.client.0.smithi144.stdout: "data_pool": ".data-pool", 2024-06-04T16:01:16.550 INFO:tasks.workunit.client.0.smithi144.stdout: "data_extra_pool": "", 2024-06-04T16:01:16.550 INFO:tasks.workunit.client.0.smithi144.stdout: "index_pool": ".index-pool" 2024-06-04T16:01:16.551 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.551 INFO:tasks.workunit.client.0.smithi144.stdout: }, 2024-06-04T16:01:16.551 INFO:tasks.workunit.client.0.smithi144.stdout: "key": { 2024-06-04T16:01:16.551 INFO:tasks.workunit.client.0.smithi144.stdout: "name": "myobj", 2024-06-04T16:01:16.551 INFO:tasks.workunit.client.0.smithi144.stdout: "instance": "", 2024-06-04T16:01:16.551 INFO:tasks.workunit.client.0.smithi144.stdout: "ns": "" 2024-06-04T16:01:16.551 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.551 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.551 INFO:tasks.workunit.client.0.smithi144.stdout:} 2024-06-04T16:01:16.551 INFO:tasks.workunit.client.0.smithi144.stdout:{ 2024-06-04T16:01:16.551 INFO:tasks.workunit.client.0.smithi144.stdout: "bucket": { 2024-06-04T16:01:16.551 INFO:tasks.workunit.client.0.smithi144.stdout: "name": "test", 2024-06-04T16:01:16.551 INFO:tasks.workunit.client.0.smithi144.stdout: "marker": "marker", 2024-06-04T16:01:16.551 INFO:tasks.workunit.client.0.smithi144.stdout: "bucket_id": "bucket-id", 2024-06-04T16:01:16.552 INFO:tasks.workunit.client.0.smithi144.stdout: "tenant": "", 2024-06-04T16:01:16.552 INFO:tasks.workunit.client.0.smithi144.stdout: "explicit_placement": { 2024-06-04T16:01:16.552 INFO:tasks.workunit.client.0.smithi144.stdout: "data_pool": "", 2024-06-04T16:01:16.552 INFO:tasks.workunit.client.0.smithi144.stdout: "data_extra_pool": "", 2024-06-04T16:01:16.552 INFO:tasks.workunit.client.0.smithi144.stdout: "index_pool": "" 2024-06-04T16:01:16.552 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.552 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.552 INFO:tasks.workunit.client.0.smithi144.stdout:} 2024-06-04T16:01:16.552 INFO:tasks.workunit.client.0.smithi144.stdout:{ 2024-06-04T16:01:16.552 INFO:tasks.workunit.client.0.smithi144.stdout: "obj": { 2024-06-04T16:01:16.552 INFO:tasks.workunit.client.0.smithi144.stdout: "bucket": { 2024-06-04T16:01:16.552 INFO:tasks.workunit.client.0.smithi144.stdout: "name": "test", 2024-06-04T16:01:16.552 INFO:tasks.workunit.client.0.smithi144.stdout: "marker": "marker", 2024-06-04T16:01:16.552 INFO:tasks.workunit.client.0.smithi144.stdout: "bucket_id": "bucket-id", 2024-06-04T16:01:16.553 INFO:tasks.workunit.client.0.smithi144.stdout: "tenant": "", 2024-06-04T16:01:16.553 INFO:tasks.workunit.client.0.smithi144.stdout: "explicit_placement": { 2024-06-04T16:01:16.553 INFO:tasks.workunit.client.0.smithi144.stdout: "data_pool": "", 2024-06-04T16:01:16.553 INFO:tasks.workunit.client.0.smithi144.stdout: "data_extra_pool": "", 2024-06-04T16:01:16.553 INFO:tasks.workunit.client.0.smithi144.stdout: "index_pool": "" 2024-06-04T16:01:16.553 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.553 INFO:tasks.workunit.client.0.smithi144.stdout: }, 2024-06-04T16:01:16.553 INFO:tasks.workunit.client.0.smithi144.stdout: "key": { 2024-06-04T16:01:16.553 INFO:tasks.workunit.client.0.smithi144.stdout: "name": "myobj", 2024-06-04T16:01:16.553 INFO:tasks.workunit.client.0.smithi144.stdout: "instance": "", 2024-06-04T16:01:16.553 INFO:tasks.workunit.client.0.smithi144.stdout: "ns": "ns" 2024-06-04T16:01:16.553 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.553 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.553 INFO:tasks.workunit.client.0.smithi144.stdout:} 2024-06-04T16:01:16.554 INFO:tasks.workunit.client.0.smithi144.stdout:{ 2024-06-04T16:01:16.554 INFO:tasks.workunit.client.0.smithi144.stdout: "raw_obj": { 2024-06-04T16:01:16.554 INFO:tasks.workunit.client.0.smithi144.stdout: "pool": "default-placement.data", 2024-06-04T16:01:16.554 INFO:tasks.workunit.client.0.smithi144.stdout: "oid": "marker__ns_myobj", 2024-06-04T16:01:16.554 INFO:tasks.workunit.client.0.smithi144.stdout: "loc": "" 2024-06-04T16:01:16.554 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.554 INFO:tasks.workunit.client.0.smithi144.stdout:} 2024-06-04T16:01:16.554 INFO:tasks.workunit.client.0.smithi144.stdout:{ 2024-06-04T16:01:16.554 INFO:tasks.workunit.client.0.smithi144.stdout: "new_obj": { 2024-06-04T16:01:16.554 INFO:tasks.workunit.client.0.smithi144.stdout: "bucket": { 2024-06-04T16:01:16.554 INFO:tasks.workunit.client.0.smithi144.stdout: "name": "test", 2024-06-04T16:01:16.554 INFO:tasks.workunit.client.0.smithi144.stdout: "marker": "marker", 2024-06-04T16:01:16.554 INFO:tasks.workunit.client.0.smithi144.stdout: "bucket_id": "bucket-id", 2024-06-04T16:01:16.554 INFO:tasks.workunit.client.0.smithi144.stdout: "tenant": "", 2024-06-04T16:01:16.555 INFO:tasks.workunit.client.0.smithi144.stdout: "explicit_placement": { 2024-06-04T16:01:16.555 INFO:tasks.workunit.client.0.smithi144.stdout: "data_pool": "", 2024-06-04T16:01:16.555 INFO:tasks.workunit.client.0.smithi144.stdout: "data_extra_pool": "", 2024-06-04T16:01:16.555 INFO:tasks.workunit.client.0.smithi144.stdout: "index_pool": "" 2024-06-04T16:01:16.555 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.555 INFO:tasks.workunit.client.0.smithi144.stdout: }, 2024-06-04T16:01:16.555 INFO:tasks.workunit.client.0.smithi144.stdout: "key": { 2024-06-04T16:01:16.555 INFO:tasks.workunit.client.0.smithi144.stdout: "name": "myobj", 2024-06-04T16:01:16.555 INFO:tasks.workunit.client.0.smithi144.stdout: "instance": "", 2024-06-04T16:01:16.555 INFO:tasks.workunit.client.0.smithi144.stdout: "ns": "ns" 2024-06-04T16:01:16.555 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.555 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.555 INFO:tasks.workunit.client.0.smithi144.stdout:} 2024-06-04T16:01:16.555 INFO:tasks.workunit.client.0.smithi144.stdout:{ 2024-06-04T16:01:16.556 INFO:tasks.workunit.client.0.smithi144.stdout: "bucket": { 2024-06-04T16:01:16.556 INFO:tasks.workunit.client.0.smithi144.stdout: "name": "ebtest", 2024-06-04T16:01:16.556 INFO:tasks.workunit.client.0.smithi144.stdout: "marker": "marker", 2024-06-04T16:01:16.556 INFO:tasks.workunit.client.0.smithi144.stdout: "bucket_id": "bucket-id", 2024-06-04T16:01:16.556 INFO:tasks.workunit.client.0.smithi144.stdout: "tenant": "", 2024-06-04T16:01:16.556 INFO:tasks.workunit.client.0.smithi144.stdout: "explicit_placement": { 2024-06-04T16:01:16.556 INFO:tasks.workunit.client.0.smithi144.stdout: "data_pool": ".data-pool", 2024-06-04T16:01:16.556 INFO:tasks.workunit.client.0.smithi144.stdout: "data_extra_pool": "", 2024-06-04T16:01:16.556 INFO:tasks.workunit.client.0.smithi144.stdout: "index_pool": ".index-pool" 2024-06-04T16:01:16.556 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.556 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.556 INFO:tasks.workunit.client.0.smithi144.stdout:} 2024-06-04T16:01:16.556 INFO:tasks.workunit.client.0.smithi144.stdout:{ 2024-06-04T16:01:16.556 INFO:tasks.workunit.client.0.smithi144.stdout: "obj": { 2024-06-04T16:01:16.557 INFO:tasks.workunit.client.0.smithi144.stdout: "bucket": { 2024-06-04T16:01:16.557 INFO:tasks.workunit.client.0.smithi144.stdout: "name": "ebtest", 2024-06-04T16:01:16.557 INFO:tasks.workunit.client.0.smithi144.stdout: "marker": "marker", 2024-06-04T16:01:16.557 INFO:tasks.workunit.client.0.smithi144.stdout: "bucket_id": "bucket-id", 2024-06-04T16:01:16.557 INFO:tasks.workunit.client.0.smithi144.stdout: "tenant": "", 2024-06-04T16:01:16.557 INFO:tasks.workunit.client.0.smithi144.stdout: "explicit_placement": { 2024-06-04T16:01:16.557 INFO:tasks.workunit.client.0.smithi144.stdout: "data_pool": ".data-pool", 2024-06-04T16:01:16.557 INFO:tasks.workunit.client.0.smithi144.stdout: "data_extra_pool": "", 2024-06-04T16:01:16.557 INFO:tasks.workunit.client.0.smithi144.stdout: "index_pool": ".index-pool" 2024-06-04T16:01:16.557 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.557 INFO:tasks.workunit.client.0.smithi144.stdout: }, 2024-06-04T16:01:16.557 INFO:tasks.workunit.client.0.smithi144.stdout: "key": { 2024-06-04T16:01:16.557 INFO:tasks.workunit.client.0.smithi144.stdout: "name": "myobj", 2024-06-04T16:01:16.557 INFO:tasks.workunit.client.0.smithi144.stdout: "instance": "", 2024-06-04T16:01:16.557 INFO:tasks.workunit.client.0.smithi144.stdout: "ns": "ns" 2024-06-04T16:01:16.558 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.558 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.558 INFO:tasks.workunit.client.0.smithi144.stdout:} 2024-06-04T16:01:16.558 INFO:tasks.workunit.client.0.smithi144.stdout:{ 2024-06-04T16:01:16.558 INFO:tasks.workunit.client.0.smithi144.stdout: "raw_obj": { 2024-06-04T16:01:16.558 INFO:tasks.workunit.client.0.smithi144.stdout: "pool": ".data-pool", 2024-06-04T16:01:16.558 INFO:tasks.workunit.client.0.smithi144.stdout: "oid": "marker__ns_myobj", 2024-06-04T16:01:16.558 INFO:tasks.workunit.client.0.smithi144.stdout: "loc": "" 2024-06-04T16:01:16.558 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.558 INFO:tasks.workunit.client.0.smithi144.stdout:} 2024-06-04T16:01:16.558 INFO:tasks.workunit.client.0.smithi144.stdout:{ 2024-06-04T16:01:16.558 INFO:tasks.workunit.client.0.smithi144.stdout: "new_obj": { 2024-06-04T16:01:16.559 INFO:tasks.workunit.client.0.smithi144.stdout: "bucket": { 2024-06-04T16:01:16.559 INFO:tasks.workunit.client.0.smithi144.stdout: "name": "ebtest", 2024-06-04T16:01:16.559 INFO:tasks.workunit.client.0.smithi144.stdout: "marker": "marker", 2024-06-04T16:01:16.559 INFO:tasks.workunit.client.0.smithi144.stdout: "bucket_id": "bucket-id", 2024-06-04T16:01:16.559 INFO:tasks.workunit.client.0.smithi144.stdout: "tenant": "", 2024-06-04T16:01:16.559 INFO:tasks.workunit.client.0.smithi144.stdout: "explicit_placement": { 2024-06-04T16:01:16.559 INFO:tasks.workunit.client.0.smithi144.stdout: "data_pool": ".data-pool", 2024-06-04T16:01:16.559 INFO:tasks.workunit.client.0.smithi144.stdout: "data_extra_pool": "", 2024-06-04T16:01:16.559 INFO:tasks.workunit.client.0.smithi144.stdout: "index_pool": ".index-pool" 2024-06-04T16:01:16.559 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.559 INFO:tasks.workunit.client.0.smithi144.stdout: }, 2024-06-04T16:01:16.560 INFO:tasks.workunit.client.0.smithi144.stdout: "key": { 2024-06-04T16:01:16.560 INFO:tasks.workunit.client.0.smithi144.stdout: "name": "myobj", 2024-06-04T16:01:16.560 INFO:tasks.workunit.client.0.smithi144.stdout: "instance": "", 2024-06-04T16:01:16.560 INFO:tasks.workunit.client.0.smithi144.stdout: "ns": "ns" 2024-06-04T16:01:16.560 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.560 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.560 INFO:tasks.workunit.client.0.smithi144.stdout:} 2024-06-04T16:01:16.560 INFO:tasks.workunit.client.0.smithi144.stdout:{ 2024-06-04T16:01:16.560 INFO:tasks.workunit.client.0.smithi144.stdout: "bucket": { 2024-06-04T16:01:16.560 INFO:tasks.workunit.client.0.smithi144.stdout: "name": "test", 2024-06-04T16:01:16.560 INFO:tasks.workunit.client.0.smithi144.stdout: "marker": "marker", 2024-06-04T16:01:16.560 INFO:tasks.workunit.client.0.smithi144.stdout: "bucket_id": "bucket-id", 2024-06-04T16:01:16.561 INFO:tasks.workunit.client.0.smithi144.stdout: "tenant": "", 2024-06-04T16:01:16.561 INFO:tasks.workunit.client.0.smithi144.stdout: "explicit_placement": { 2024-06-04T16:01:16.561 INFO:tasks.workunit.client.0.smithi144.stdout: "data_pool": "", 2024-06-04T16:01:16.561 INFO:tasks.workunit.client.0.smithi144.stdout: "data_extra_pool": "", 2024-06-04T16:01:16.561 INFO:tasks.workunit.client.0.smithi144.stdout: "index_pool": "" 2024-06-04T16:01:16.561 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.561 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.561 INFO:tasks.workunit.client.0.smithi144.stdout:} 2024-06-04T16:01:16.561 INFO:tasks.workunit.client.0.smithi144.stdout:{ 2024-06-04T16:01:16.561 INFO:tasks.workunit.client.0.smithi144.stdout: "obj": { 2024-06-04T16:01:16.561 INFO:tasks.workunit.client.0.smithi144.stdout: "bucket": { 2024-06-04T16:01:16.562 INFO:tasks.workunit.client.0.smithi144.stdout: "name": "test", 2024-06-04T16:01:16.562 INFO:tasks.workunit.client.0.smithi144.stdout: "marker": "marker", 2024-06-04T16:01:16.562 INFO:tasks.workunit.client.0.smithi144.stdout: "bucket_id": "bucket-id", 2024-06-04T16:01:16.562 INFO:tasks.workunit.client.0.smithi144.stdout: "tenant": "", 2024-06-04T16:01:16.562 INFO:tasks.workunit.client.0.smithi144.stdout: "explicit_placement": { 2024-06-04T16:01:16.562 INFO:tasks.workunit.client.0.smithi144.stdout: "data_pool": "", 2024-06-04T16:01:16.562 INFO:tasks.workunit.client.0.smithi144.stdout: "data_extra_pool": "", 2024-06-04T16:01:16.563 INFO:tasks.workunit.client.0.smithi144.stdout: "index_pool": "" 2024-06-04T16:01:16.563 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.563 INFO:tasks.workunit.client.0.smithi144.stdout: }, 2024-06-04T16:01:16.563 INFO:tasks.workunit.client.0.smithi144.stdout: "key": { 2024-06-04T16:01:16.563 INFO:tasks.workunit.client.0.smithi144.stdout: "name": "myobj", 2024-06-04T16:01:16.563 INFO:tasks.workunit.client.0.smithi144.stdout: "instance": "inst", 2024-06-04T16:01:16.563 INFO:tasks.workunit.client.0.smithi144.stdout: "ns": "" 2024-06-04T16:01:16.563 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.563 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.563 INFO:tasks.workunit.client.0.smithi144.stdout:} 2024-06-04T16:01:16.563 INFO:tasks.workunit.client.0.smithi144.stdout:{ 2024-06-04T16:01:16.563 INFO:tasks.workunit.client.0.smithi144.stdout: "raw_obj": { 2024-06-04T16:01:16.564 INFO:tasks.workunit.client.0.smithi144.stdout: "pool": "default-placement.data", 2024-06-04T16:01:16.564 INFO:tasks.workunit.client.0.smithi144.stdout: "oid": "marker__:inst_myobj", 2024-06-04T16:01:16.564 INFO:tasks.workunit.client.0.smithi144.stdout: "loc": "" 2024-06-04T16:01:16.564 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.564 INFO:tasks.workunit.client.0.smithi144.stdout:} 2024-06-04T16:01:16.564 INFO:tasks.workunit.client.0.smithi144.stdout:{ 2024-06-04T16:01:16.564 INFO:tasks.workunit.client.0.smithi144.stdout: "new_obj": { 2024-06-04T16:01:16.564 INFO:tasks.workunit.client.0.smithi144.stdout: "bucket": { 2024-06-04T16:01:16.564 INFO:tasks.workunit.client.0.smithi144.stdout: "name": "test", 2024-06-04T16:01:16.564 INFO:tasks.workunit.client.0.smithi144.stdout: "marker": "marker", 2024-06-04T16:01:16.565 INFO:tasks.workunit.client.0.smithi144.stdout: "bucket_id": "bucket-id", 2024-06-04T16:01:16.565 INFO:tasks.workunit.client.0.smithi144.stdout: "tenant": "", 2024-06-04T16:01:16.565 INFO:tasks.workunit.client.0.smithi144.stdout: "explicit_placement": { 2024-06-04T16:01:16.565 INFO:tasks.workunit.client.0.smithi144.stdout: "data_pool": "", 2024-06-04T16:01:16.565 INFO:tasks.workunit.client.0.smithi144.stdout: "data_extra_pool": "", 2024-06-04T16:01:16.565 INFO:tasks.workunit.client.0.smithi144.stdout: "index_pool": "" 2024-06-04T16:01:16.565 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.565 INFO:tasks.workunit.client.0.smithi144.stdout: }, 2024-06-04T16:01:16.565 INFO:tasks.workunit.client.0.smithi144.stdout: "key": { 2024-06-04T16:01:16.565 INFO:tasks.workunit.client.0.smithi144.stdout: "name": "myobj", 2024-06-04T16:01:16.565 INFO:tasks.workunit.client.0.smithi144.stdout: "instance": "inst", 2024-06-04T16:01:16.565 INFO:tasks.workunit.client.0.smithi144.stdout: "ns": "" 2024-06-04T16:01:16.565 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.565 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.565 INFO:tasks.workunit.client.0.smithi144.stdout:} 2024-06-04T16:01:16.566 INFO:tasks.workunit.client.0.smithi144.stdout:{ 2024-06-04T16:01:16.566 INFO:tasks.workunit.client.0.smithi144.stdout: "bucket": { 2024-06-04T16:01:16.566 INFO:tasks.workunit.client.0.smithi144.stdout: "name": "ebtest", 2024-06-04T16:01:16.566 INFO:tasks.workunit.client.0.smithi144.stdout: "marker": "marker", 2024-06-04T16:01:16.566 INFO:tasks.workunit.client.0.smithi144.stdout: "bucket_id": "bucket-id", 2024-06-04T16:01:16.566 INFO:tasks.workunit.client.0.smithi144.stdout: "tenant": "", 2024-06-04T16:01:16.566 INFO:tasks.workunit.client.0.smithi144.stdout: "explicit_placement": { 2024-06-04T16:01:16.566 INFO:tasks.workunit.client.0.smithi144.stdout: "data_pool": ".data-pool", 2024-06-04T16:01:16.566 INFO:tasks.workunit.client.0.smithi144.stdout: "data_extra_pool": "", 2024-06-04T16:01:16.566 INFO:tasks.workunit.client.0.smithi144.stdout: "index_pool": ".index-pool" 2024-06-04T16:01:16.566 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.566 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.566 INFO:tasks.workunit.client.0.smithi144.stdout:} 2024-06-04T16:01:16.567 INFO:tasks.workunit.client.0.smithi144.stdout:{ 2024-06-04T16:01:16.567 INFO:tasks.workunit.client.0.smithi144.stdout: "obj": { 2024-06-04T16:01:16.567 INFO:tasks.workunit.client.0.smithi144.stdout: "bucket": { 2024-06-04T16:01:16.567 INFO:tasks.workunit.client.0.smithi144.stdout: "name": "ebtest", 2024-06-04T16:01:16.567 INFO:tasks.workunit.client.0.smithi144.stdout: "marker": "marker", 2024-06-04T16:01:16.567 INFO:tasks.workunit.client.0.smithi144.stdout: "bucket_id": "bucket-id", 2024-06-04T16:01:16.567 INFO:tasks.workunit.client.0.smithi144.stdout: "tenant": "", 2024-06-04T16:01:16.567 INFO:tasks.workunit.client.0.smithi144.stdout: "explicit_placement": { 2024-06-04T16:01:16.567 INFO:tasks.workunit.client.0.smithi144.stdout: "data_pool": ".data-pool", 2024-06-04T16:01:16.567 INFO:tasks.workunit.client.0.smithi144.stdout: "data_extra_pool": "", 2024-06-04T16:01:16.567 INFO:tasks.workunit.client.0.smithi144.stdout: "index_pool": ".index-pool" 2024-06-04T16:01:16.567 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.568 INFO:tasks.workunit.client.0.smithi144.stdout: }, 2024-06-04T16:01:16.568 INFO:tasks.workunit.client.0.smithi144.stdout: "key": { 2024-06-04T16:01:16.568 INFO:tasks.workunit.client.0.smithi144.stdout: "name": "myobj", 2024-06-04T16:01:16.568 INFO:tasks.workunit.client.0.smithi144.stdout: "instance": "inst", 2024-06-04T16:01:16.568 INFO:tasks.workunit.client.0.smithi144.stdout: "ns": "" 2024-06-04T16:01:16.568 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.568 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.568 INFO:tasks.workunit.client.0.smithi144.stdout:} 2024-06-04T16:01:16.568 INFO:tasks.workunit.client.0.smithi144.stdout:{ 2024-06-04T16:01:16.568 INFO:tasks.workunit.client.0.smithi144.stdout: "raw_obj": { 2024-06-04T16:01:16.568 INFO:tasks.workunit.client.0.smithi144.stdout: "pool": ".data-pool", 2024-06-04T16:01:16.568 INFO:tasks.workunit.client.0.smithi144.stdout: "oid": "marker__:inst_myobj", 2024-06-04T16:01:16.568 INFO:tasks.workunit.client.0.smithi144.stdout: "loc": "" 2024-06-04T16:01:16.568 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.569 INFO:tasks.workunit.client.0.smithi144.stdout:} 2024-06-04T16:01:16.569 INFO:tasks.workunit.client.0.smithi144.stdout:{ 2024-06-04T16:01:16.569 INFO:tasks.workunit.client.0.smithi144.stdout: "new_obj": { 2024-06-04T16:01:16.569 INFO:tasks.workunit.client.0.smithi144.stdout: "bucket": { 2024-06-04T16:01:16.569 INFO:tasks.workunit.client.0.smithi144.stdout: "name": "ebtest", 2024-06-04T16:01:16.569 INFO:tasks.workunit.client.0.smithi144.stdout: "marker": "marker", 2024-06-04T16:01:16.569 INFO:tasks.workunit.client.0.smithi144.stdout: "bucket_id": "bucket-id", 2024-06-04T16:01:16.569 INFO:tasks.workunit.client.0.smithi144.stdout: "tenant": "", 2024-06-04T16:01:16.569 INFO:tasks.workunit.client.0.smithi144.stdout: "explicit_placement": { 2024-06-04T16:01:16.569 INFO:tasks.workunit.client.0.smithi144.stdout: "data_pool": ".data-pool", 2024-06-04T16:01:16.569 INFO:tasks.workunit.client.0.smithi144.stdout: "data_extra_pool": "", 2024-06-04T16:01:16.569 INFO:tasks.workunit.client.0.smithi144.stdout: "index_pool": ".index-pool" 2024-06-04T16:01:16.569 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.569 INFO:tasks.workunit.client.0.smithi144.stdout: }, 2024-06-04T16:01:16.569 INFO:tasks.workunit.client.0.smithi144.stdout: "key": { 2024-06-04T16:01:16.570 INFO:tasks.workunit.client.0.smithi144.stdout: "name": "myobj", 2024-06-04T16:01:16.570 INFO:tasks.workunit.client.0.smithi144.stdout: "instance": "inst", 2024-06-04T16:01:16.570 INFO:tasks.workunit.client.0.smithi144.stdout: "ns": "" 2024-06-04T16:01:16.570 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.570 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.570 INFO:tasks.workunit.client.0.smithi144.stdout:} 2024-06-04T16:01:16.570 INFO:tasks.workunit.client.0.smithi144.stdout:{ 2024-06-04T16:01:16.570 INFO:tasks.workunit.client.0.smithi144.stdout: "bucket": { 2024-06-04T16:01:16.570 INFO:tasks.workunit.client.0.smithi144.stdout: "name": "test", 2024-06-04T16:01:16.571 INFO:tasks.workunit.client.0.smithi144.stdout: "marker": "marker", 2024-06-04T16:01:16.571 INFO:tasks.workunit.client.0.smithi144.stdout: "bucket_id": "bucket-id", 2024-06-04T16:01:16.571 INFO:tasks.workunit.client.0.smithi144.stdout: "tenant": "", 2024-06-04T16:01:16.571 INFO:tasks.workunit.client.0.smithi144.stdout: "explicit_placement": { 2024-06-04T16:01:16.571 INFO:tasks.workunit.client.0.smithi144.stdout: "data_pool": "", 2024-06-04T16:01:16.571 INFO:tasks.workunit.client.0.smithi144.stdout: "data_extra_pool": "", 2024-06-04T16:01:16.571 INFO:tasks.workunit.client.0.smithi144.stdout: "index_pool": "" 2024-06-04T16:01:16.571 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.571 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.571 INFO:tasks.workunit.client.0.smithi144.stdout:} 2024-06-04T16:01:16.571 INFO:tasks.workunit.client.0.smithi144.stdout:{ 2024-06-04T16:01:16.571 INFO:tasks.workunit.client.0.smithi144.stdout: "obj": { 2024-06-04T16:01:16.571 INFO:tasks.workunit.client.0.smithi144.stdout: "bucket": { 2024-06-04T16:01:16.571 INFO:tasks.workunit.client.0.smithi144.stdout: "name": "test", 2024-06-04T16:01:16.572 INFO:tasks.workunit.client.0.smithi144.stdout: "marker": "marker", 2024-06-04T16:01:16.572 INFO:tasks.workunit.client.0.smithi144.stdout: "bucket_id": "bucket-id", 2024-06-04T16:01:16.572 INFO:tasks.workunit.client.0.smithi144.stdout: "tenant": "", 2024-06-04T16:01:16.572 INFO:tasks.workunit.client.0.smithi144.stdout: "explicit_placement": { 2024-06-04T16:01:16.572 INFO:tasks.workunit.client.0.smithi144.stdout: "data_pool": "", 2024-06-04T16:01:16.572 INFO:tasks.workunit.client.0.smithi144.stdout: "data_extra_pool": "", 2024-06-04T16:01:16.572 INFO:tasks.workunit.client.0.smithi144.stdout: "index_pool": "" 2024-06-04T16:01:16.572 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.572 INFO:tasks.workunit.client.0.smithi144.stdout: }, 2024-06-04T16:01:16.572 INFO:tasks.workunit.client.0.smithi144.stdout: "key": { 2024-06-04T16:01:16.572 INFO:tasks.workunit.client.0.smithi144.stdout: "name": "myobj", 2024-06-04T16:01:16.572 INFO:tasks.workunit.client.0.smithi144.stdout: "instance": "inst", 2024-06-04T16:01:16.572 INFO:tasks.workunit.client.0.smithi144.stdout: "ns": "ns" 2024-06-04T16:01:16.572 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.573 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.573 INFO:tasks.workunit.client.0.smithi144.stdout:} 2024-06-04T16:01:16.573 INFO:tasks.workunit.client.0.smithi144.stdout:{ 2024-06-04T16:01:16.573 INFO:tasks.workunit.client.0.smithi144.stdout: "raw_obj": { 2024-06-04T16:01:16.573 INFO:tasks.workunit.client.0.smithi144.stdout: "pool": "default-placement.data", 2024-06-04T16:01:16.573 INFO:tasks.workunit.client.0.smithi144.stdout: "oid": "marker__ns:inst_myobj", 2024-06-04T16:01:16.573 INFO:tasks.workunit.client.0.smithi144.stdout: "loc": "" 2024-06-04T16:01:16.573 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.573 INFO:tasks.workunit.client.0.smithi144.stdout:} 2024-06-04T16:01:16.573 INFO:tasks.workunit.client.0.smithi144.stdout:{ 2024-06-04T16:01:16.573 INFO:tasks.workunit.client.0.smithi144.stdout: "new_obj": { 2024-06-04T16:01:16.573 INFO:tasks.workunit.client.0.smithi144.stdout: "bucket": { 2024-06-04T16:01:16.573 INFO:tasks.workunit.client.0.smithi144.stdout: "name": "test", 2024-06-04T16:01:16.574 INFO:tasks.workunit.client.0.smithi144.stdout: "marker": "marker", 2024-06-04T16:01:16.574 INFO:tasks.workunit.client.0.smithi144.stdout: "bucket_id": "bucket-id", 2024-06-04T16:01:16.574 INFO:tasks.workunit.client.0.smithi144.stdout: "tenant": "", 2024-06-04T16:01:16.574 INFO:tasks.workunit.client.0.smithi144.stdout: "explicit_placement": { 2024-06-04T16:01:16.574 INFO:tasks.workunit.client.0.smithi144.stdout: "data_pool": "", 2024-06-04T16:01:16.574 INFO:tasks.workunit.client.0.smithi144.stdout: "data_extra_pool": "", 2024-06-04T16:01:16.574 INFO:tasks.workunit.client.0.smithi144.stdout: "index_pool": "" 2024-06-04T16:01:16.574 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.574 INFO:tasks.workunit.client.0.smithi144.stdout: }, 2024-06-04T16:01:16.574 INFO:tasks.workunit.client.0.smithi144.stdout: "key": { 2024-06-04T16:01:16.574 INFO:tasks.workunit.client.0.smithi144.stdout: "name": "myobj", 2024-06-04T16:01:16.575 INFO:tasks.workunit.client.0.smithi144.stdout: "instance": "inst", 2024-06-04T16:01:16.575 INFO:tasks.workunit.client.0.smithi144.stdout: "ns": "ns" 2024-06-04T16:01:16.575 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.575 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.575 INFO:tasks.workunit.client.0.smithi144.stdout:} 2024-06-04T16:01:16.575 INFO:tasks.workunit.client.0.smithi144.stdout:{ 2024-06-04T16:01:16.575 INFO:tasks.workunit.client.0.smithi144.stdout: "bucket": { 2024-06-04T16:01:16.575 INFO:tasks.workunit.client.0.smithi144.stdout: "name": "ebtest", 2024-06-04T16:01:16.575 INFO:tasks.workunit.client.0.smithi144.stdout: "marker": "marker", 2024-06-04T16:01:16.575 INFO:tasks.workunit.client.0.smithi144.stdout: "bucket_id": "bucket-id", 2024-06-04T16:01:16.575 INFO:tasks.workunit.client.0.smithi144.stdout: "tenant": "", 2024-06-04T16:01:16.575 INFO:tasks.workunit.client.0.smithi144.stdout: "explicit_placement": { 2024-06-04T16:01:16.575 INFO:tasks.workunit.client.0.smithi144.stdout: "data_pool": ".data-pool", 2024-06-04T16:01:16.575 INFO:tasks.workunit.client.0.smithi144.stdout: "data_extra_pool": "", 2024-06-04T16:01:16.576 INFO:tasks.workunit.client.0.smithi144.stdout: "index_pool": ".index-pool" 2024-06-04T16:01:16.576 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.576 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.576 INFO:tasks.workunit.client.0.smithi144.stdout:} 2024-06-04T16:01:16.576 INFO:tasks.workunit.client.0.smithi144.stdout:{ 2024-06-04T16:01:16.576 INFO:tasks.workunit.client.0.smithi144.stdout: "obj": { 2024-06-04T16:01:16.576 INFO:tasks.workunit.client.0.smithi144.stdout: "bucket": { 2024-06-04T16:01:16.576 INFO:tasks.workunit.client.0.smithi144.stdout: "name": "ebtest", 2024-06-04T16:01:16.576 INFO:tasks.workunit.client.0.smithi144.stdout: "marker": "marker", 2024-06-04T16:01:16.576 INFO:tasks.workunit.client.0.smithi144.stdout: "bucket_id": "bucket-id", 2024-06-04T16:01:16.576 INFO:tasks.workunit.client.0.smithi144.stdout: "tenant": "", 2024-06-04T16:01:16.576 INFO:tasks.workunit.client.0.smithi144.stdout: "explicit_placement": { 2024-06-04T16:01:16.576 INFO:tasks.workunit.client.0.smithi144.stdout: "data_pool": ".data-pool", 2024-06-04T16:01:16.576 INFO:tasks.workunit.client.0.smithi144.stdout: "data_extra_pool": "", 2024-06-04T16:01:16.577 INFO:tasks.workunit.client.0.smithi144.stdout: "index_pool": ".index-pool" 2024-06-04T16:01:16.577 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.577 INFO:tasks.workunit.client.0.smithi144.stdout: }, 2024-06-04T16:01:16.577 INFO:tasks.workunit.client.0.smithi144.stdout: "key": { 2024-06-04T16:01:16.577 INFO:tasks.workunit.client.0.smithi144.stdout: "name": "myobj", 2024-06-04T16:01:16.577 INFO:tasks.workunit.client.0.smithi144.stdout: "instance": "inst", 2024-06-04T16:01:16.577 INFO:tasks.workunit.client.0.smithi144.stdout: "ns": "ns" 2024-06-04T16:01:16.577 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.577 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.577 INFO:tasks.workunit.client.0.smithi144.stdout:} 2024-06-04T16:01:16.577 INFO:tasks.workunit.client.0.smithi144.stdout:{ 2024-06-04T16:01:16.577 INFO:tasks.workunit.client.0.smithi144.stdout: "raw_obj": { 2024-06-04T16:01:16.577 INFO:tasks.workunit.client.0.smithi144.stdout: "pool": ".data-pool", 2024-06-04T16:01:16.577 INFO:tasks.workunit.client.0.smithi144.stdout: "oid": "marker__ns:inst_myobj", 2024-06-04T16:01:16.578 INFO:tasks.workunit.client.0.smithi144.stdout: "loc": "" 2024-06-04T16:01:16.578 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.578 INFO:tasks.workunit.client.0.smithi144.stdout:} 2024-06-04T16:01:16.578 INFO:tasks.workunit.client.0.smithi144.stdout:{ 2024-06-04T16:01:16.578 INFO:tasks.workunit.client.0.smithi144.stdout: "new_obj": { 2024-06-04T16:01:16.578 INFO:tasks.workunit.client.0.smithi144.stdout: "bucket": { 2024-06-04T16:01:16.578 INFO:tasks.workunit.client.0.smithi144.stdout: "name": "ebtest", 2024-06-04T16:01:16.578 INFO:tasks.workunit.client.0.smithi144.stdout: "marker": "marker", 2024-06-04T16:01:16.578 INFO:tasks.workunit.client.0.smithi144.stdout: "bucket_id": "bucket-id", 2024-06-04T16:01:16.578 INFO:tasks.workunit.client.0.smithi144.stdout: "tenant": "", 2024-06-04T16:01:16.578 INFO:tasks.workunit.client.0.smithi144.stdout: "explicit_placement": { 2024-06-04T16:01:16.578 INFO:tasks.workunit.client.0.smithi144.stdout: "data_pool": ".data-pool", 2024-06-04T16:01:16.579 INFO:tasks.workunit.client.0.smithi144.stdout: "data_extra_pool": "", 2024-06-04T16:01:16.579 INFO:tasks.workunit.client.0.smithi144.stdout: "index_pool": ".index-pool" 2024-06-04T16:01:16.579 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.579 INFO:tasks.workunit.client.0.smithi144.stdout: }, 2024-06-04T16:01:16.579 INFO:tasks.workunit.client.0.smithi144.stdout: "key": { 2024-06-04T16:01:16.579 INFO:tasks.workunit.client.0.smithi144.stdout: "name": "myobj", 2024-06-04T16:01:16.579 INFO:tasks.workunit.client.0.smithi144.stdout: "instance": "inst", 2024-06-04T16:01:16.579 INFO:tasks.workunit.client.0.smithi144.stdout: "ns": "ns" 2024-06-04T16:01:16.579 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.579 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.579 INFO:tasks.workunit.client.0.smithi144.stdout:} 2024-06-04T16:01:16.579 INFO:tasks.workunit.client.0.smithi144.stdout:{ 2024-06-04T16:01:16.579 INFO:tasks.workunit.client.0.smithi144.stdout: "bucket": { 2024-06-04T16:01:16.579 INFO:tasks.workunit.client.0.smithi144.stdout: "name": "test", 2024-06-04T16:01:16.580 INFO:tasks.workunit.client.0.smithi144.stdout: "marker": "marker", 2024-06-04T16:01:16.580 INFO:tasks.workunit.client.0.smithi144.stdout: "bucket_id": "bucket-id", 2024-06-04T16:01:16.580 INFO:tasks.workunit.client.0.smithi144.stdout: "tenant": "", 2024-06-04T16:01:16.580 INFO:tasks.workunit.client.0.smithi144.stdout: "explicit_placement": { 2024-06-04T16:01:16.580 INFO:tasks.workunit.client.0.smithi144.stdout: "data_pool": "", 2024-06-04T16:01:16.580 INFO:tasks.workunit.client.0.smithi144.stdout: "data_extra_pool": "", 2024-06-04T16:01:16.580 INFO:tasks.workunit.client.0.smithi144.stdout: "index_pool": "" 2024-06-04T16:01:16.580 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.580 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.580 INFO:tasks.workunit.client.0.smithi144.stdout:} 2024-06-04T16:01:16.580 INFO:tasks.workunit.client.0.smithi144.stdout:{ 2024-06-04T16:01:16.580 INFO:tasks.workunit.client.0.smithi144.stdout: "obj": { 2024-06-04T16:01:16.580 INFO:tasks.workunit.client.0.smithi144.stdout: "bucket": { 2024-06-04T16:01:16.580 INFO:tasks.workunit.client.0.smithi144.stdout: "name": "test", 2024-06-04T16:01:16.581 INFO:tasks.workunit.client.0.smithi144.stdout: "marker": "marker", 2024-06-04T16:01:16.581 INFO:tasks.workunit.client.0.smithi144.stdout: "bucket_id": "bucket-id", 2024-06-04T16:01:16.581 INFO:tasks.workunit.client.0.smithi144.stdout: "tenant": "", 2024-06-04T16:01:16.581 INFO:tasks.workunit.client.0.smithi144.stdout: "explicit_placement": { 2024-06-04T16:01:16.581 INFO:tasks.workunit.client.0.smithi144.stdout: "data_pool": "", 2024-06-04T16:01:16.581 INFO:tasks.workunit.client.0.smithi144.stdout: "data_extra_pool": "", 2024-06-04T16:01:16.581 INFO:tasks.workunit.client.0.smithi144.stdout: "index_pool": "" 2024-06-04T16:01:16.581 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.581 INFO:tasks.workunit.client.0.smithi144.stdout: }, 2024-06-04T16:01:16.581 INFO:tasks.workunit.client.0.smithi144.stdout: "key": { 2024-06-04T16:01:16.581 INFO:tasks.workunit.client.0.smithi144.stdout: "name": "_myobj", 2024-06-04T16:01:16.581 INFO:tasks.workunit.client.0.smithi144.stdout: "instance": "", 2024-06-04T16:01:16.581 INFO:tasks.workunit.client.0.smithi144.stdout: "ns": "" 2024-06-04T16:01:16.581 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.582 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.582 INFO:tasks.workunit.client.0.smithi144.stdout:} 2024-06-04T16:01:16.582 INFO:tasks.workunit.client.0.smithi144.stdout:{ 2024-06-04T16:01:16.582 INFO:tasks.workunit.client.0.smithi144.stdout: "raw_obj": { 2024-06-04T16:01:16.582 INFO:tasks.workunit.client.0.smithi144.stdout: "pool": "default-placement.data", 2024-06-04T16:01:16.582 INFO:tasks.workunit.client.0.smithi144.stdout: "oid": "marker___myobj", 2024-06-04T16:01:16.582 INFO:tasks.workunit.client.0.smithi144.stdout: "loc": "marker__myobj" 2024-06-04T16:01:16.582 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.582 INFO:tasks.workunit.client.0.smithi144.stdout:} 2024-06-04T16:01:16.582 INFO:tasks.workunit.client.0.smithi144.stdout:{ 2024-06-04T16:01:16.582 INFO:tasks.workunit.client.0.smithi144.stdout: "new_obj": { 2024-06-04T16:01:16.582 INFO:tasks.workunit.client.0.smithi144.stdout: "bucket": { 2024-06-04T16:01:16.582 INFO:tasks.workunit.client.0.smithi144.stdout: "name": "test", 2024-06-04T16:01:16.583 INFO:tasks.workunit.client.0.smithi144.stdout: "marker": "marker", 2024-06-04T16:01:16.583 INFO:tasks.workunit.client.0.smithi144.stdout: "bucket_id": "bucket-id", 2024-06-04T16:01:16.583 INFO:tasks.workunit.client.0.smithi144.stdout: "tenant": "", 2024-06-04T16:01:16.583 INFO:tasks.workunit.client.0.smithi144.stdout: "explicit_placement": { 2024-06-04T16:01:16.583 INFO:tasks.workunit.client.0.smithi144.stdout: "data_pool": "", 2024-06-04T16:01:16.583 INFO:tasks.workunit.client.0.smithi144.stdout: "data_extra_pool": "", 2024-06-04T16:01:16.583 INFO:tasks.workunit.client.0.smithi144.stdout: "index_pool": "" 2024-06-04T16:01:16.583 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.583 INFO:tasks.workunit.client.0.smithi144.stdout: }, 2024-06-04T16:01:16.583 INFO:tasks.workunit.client.0.smithi144.stdout: "key": { 2024-06-04T16:01:16.583 INFO:tasks.workunit.client.0.smithi144.stdout: "name": "_myobj", 2024-06-04T16:01:16.583 INFO:tasks.workunit.client.0.smithi144.stdout: "instance": "", 2024-06-04T16:01:16.583 INFO:tasks.workunit.client.0.smithi144.stdout: "ns": "" 2024-06-04T16:01:16.583 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.584 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.584 INFO:tasks.workunit.client.0.smithi144.stdout:} 2024-06-04T16:01:16.584 INFO:tasks.workunit.client.0.smithi144.stdout:{ 2024-06-04T16:01:16.584 INFO:tasks.workunit.client.0.smithi144.stdout: "bucket": { 2024-06-04T16:01:16.584 INFO:tasks.workunit.client.0.smithi144.stdout: "name": "ebtest", 2024-06-04T16:01:16.584 INFO:tasks.workunit.client.0.smithi144.stdout: "marker": "marker", 2024-06-04T16:01:16.584 INFO:tasks.workunit.client.0.smithi144.stdout: "bucket_id": "bucket-id", 2024-06-04T16:01:16.584 INFO:tasks.workunit.client.0.smithi144.stdout: "tenant": "", 2024-06-04T16:01:16.584 INFO:tasks.workunit.client.0.smithi144.stdout: "explicit_placement": { 2024-06-04T16:01:16.584 INFO:tasks.workunit.client.0.smithi144.stdout: "data_pool": ".data-pool", 2024-06-04T16:01:16.584 INFO:tasks.workunit.client.0.smithi144.stdout: "data_extra_pool": "", 2024-06-04T16:01:16.584 INFO:tasks.workunit.client.0.smithi144.stdout: "index_pool": ".index-pool" 2024-06-04T16:01:16.584 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.584 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.584 INFO:tasks.workunit.client.0.smithi144.stdout:} 2024-06-04T16:01:16.585 INFO:tasks.workunit.client.0.smithi144.stdout:{ 2024-06-04T16:01:16.585 INFO:tasks.workunit.client.0.smithi144.stdout: "obj": { 2024-06-04T16:01:16.585 INFO:tasks.workunit.client.0.smithi144.stdout: "bucket": { 2024-06-04T16:01:16.585 INFO:tasks.workunit.client.0.smithi144.stdout: "name": "ebtest", 2024-06-04T16:01:16.585 INFO:tasks.workunit.client.0.smithi144.stdout: "marker": "marker", 2024-06-04T16:01:16.585 INFO:tasks.workunit.client.0.smithi144.stdout: "bucket_id": "bucket-id", 2024-06-04T16:01:16.585 INFO:tasks.workunit.client.0.smithi144.stdout: "tenant": "", 2024-06-04T16:01:16.585 INFO:tasks.workunit.client.0.smithi144.stdout: "explicit_placement": { 2024-06-04T16:01:16.585 INFO:tasks.workunit.client.0.smithi144.stdout: "data_pool": ".data-pool", 2024-06-04T16:01:16.585 INFO:tasks.workunit.client.0.smithi144.stdout: "data_extra_pool": "", 2024-06-04T16:01:16.585 INFO:tasks.workunit.client.0.smithi144.stdout: "index_pool": ".index-pool" 2024-06-04T16:01:16.585 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.585 INFO:tasks.workunit.client.0.smithi144.stdout: }, 2024-06-04T16:01:16.585 INFO:tasks.workunit.client.0.smithi144.stdout: "key": { 2024-06-04T16:01:16.585 INFO:tasks.workunit.client.0.smithi144.stdout: "name": "_myobj", 2024-06-04T16:01:16.586 INFO:tasks.workunit.client.0.smithi144.stdout: "instance": "", 2024-06-04T16:01:16.586 INFO:tasks.workunit.client.0.smithi144.stdout: "ns": "" 2024-06-04T16:01:16.586 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.586 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.586 INFO:tasks.workunit.client.0.smithi144.stdout:} 2024-06-04T16:01:16.586 INFO:tasks.workunit.client.0.smithi144.stdout:{ 2024-06-04T16:01:16.586 INFO:tasks.workunit.client.0.smithi144.stdout: "raw_obj": { 2024-06-04T16:01:16.586 INFO:tasks.workunit.client.0.smithi144.stdout: "pool": ".data-pool", 2024-06-04T16:01:16.586 INFO:tasks.workunit.client.0.smithi144.stdout: "oid": "marker___myobj", 2024-06-04T16:01:16.586 INFO:tasks.workunit.client.0.smithi144.stdout: "loc": "marker__myobj" 2024-06-04T16:01:16.586 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.586 INFO:tasks.workunit.client.0.smithi144.stdout:} 2024-06-04T16:01:16.586 INFO:tasks.workunit.client.0.smithi144.stdout:{ 2024-06-04T16:01:16.586 INFO:tasks.workunit.client.0.smithi144.stdout: "new_obj": { 2024-06-04T16:01:16.587 INFO:tasks.workunit.client.0.smithi144.stdout: "bucket": { 2024-06-04T16:01:16.587 INFO:tasks.workunit.client.0.smithi144.stdout: "name": "ebtest", 2024-06-04T16:01:16.587 INFO:tasks.workunit.client.0.smithi144.stdout: "marker": "marker", 2024-06-04T16:01:16.587 INFO:tasks.workunit.client.0.smithi144.stdout: "bucket_id": "bucket-id", 2024-06-04T16:01:16.587 INFO:tasks.workunit.client.0.smithi144.stdout: "tenant": "", 2024-06-04T16:01:16.587 INFO:tasks.workunit.client.0.smithi144.stdout: "explicit_placement": { 2024-06-04T16:01:16.587 INFO:tasks.workunit.client.0.smithi144.stdout: "data_pool": ".data-pool", 2024-06-04T16:01:16.587 INFO:tasks.workunit.client.0.smithi144.stdout: "data_extra_pool": "", 2024-06-04T16:01:16.587 INFO:tasks.workunit.client.0.smithi144.stdout: "index_pool": ".index-pool" 2024-06-04T16:01:16.587 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.587 INFO:tasks.workunit.client.0.smithi144.stdout: }, 2024-06-04T16:01:16.587 INFO:tasks.workunit.client.0.smithi144.stdout: "key": { 2024-06-04T16:01:16.587 INFO:tasks.workunit.client.0.smithi144.stdout: "name": "_myobj", 2024-06-04T16:01:16.587 INFO:tasks.workunit.client.0.smithi144.stdout: "instance": "", 2024-06-04T16:01:16.588 INFO:tasks.workunit.client.0.smithi144.stdout: "ns": "" 2024-06-04T16:01:16.588 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.588 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.588 INFO:tasks.workunit.client.0.smithi144.stdout:} 2024-06-04T16:01:16.588 INFO:tasks.workunit.client.0.smithi144.stdout:{ 2024-06-04T16:01:16.588 INFO:tasks.workunit.client.0.smithi144.stdout: "bucket": { 2024-06-04T16:01:16.588 INFO:tasks.workunit.client.0.smithi144.stdout: "name": "test", 2024-06-04T16:01:16.588 INFO:tasks.workunit.client.0.smithi144.stdout: "marker": "marker", 2024-06-04T16:01:16.588 INFO:tasks.workunit.client.0.smithi144.stdout: "bucket_id": "bucket-id", 2024-06-04T16:01:16.588 INFO:tasks.workunit.client.0.smithi144.stdout: "tenant": "", 2024-06-04T16:01:16.588 INFO:tasks.workunit.client.0.smithi144.stdout: "explicit_placement": { 2024-06-04T16:01:16.588 INFO:tasks.workunit.client.0.smithi144.stdout: "data_pool": "", 2024-06-04T16:01:16.588 INFO:tasks.workunit.client.0.smithi144.stdout: "data_extra_pool": "", 2024-06-04T16:01:16.588 INFO:tasks.workunit.client.0.smithi144.stdout: "index_pool": "" 2024-06-04T16:01:16.589 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.589 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.589 INFO:tasks.workunit.client.0.smithi144.stdout:} 2024-06-04T16:01:16.589 INFO:tasks.workunit.client.0.smithi144.stdout:{ 2024-06-04T16:01:16.589 INFO:tasks.workunit.client.0.smithi144.stdout: "obj": { 2024-06-04T16:01:16.589 INFO:tasks.workunit.client.0.smithi144.stdout: "bucket": { 2024-06-04T16:01:16.589 INFO:tasks.workunit.client.0.smithi144.stdout: "name": "test", 2024-06-04T16:01:16.589 INFO:tasks.workunit.client.0.smithi144.stdout: "marker": "marker", 2024-06-04T16:01:16.589 INFO:tasks.workunit.client.0.smithi144.stdout: "bucket_id": "bucket-id", 2024-06-04T16:01:16.589 INFO:tasks.workunit.client.0.smithi144.stdout: "tenant": "", 2024-06-04T16:01:16.589 INFO:tasks.workunit.client.0.smithi144.stdout: "explicit_placement": { 2024-06-04T16:01:16.590 INFO:tasks.workunit.client.0.smithi144.stdout: "data_pool": "", 2024-06-04T16:01:16.590 INFO:tasks.workunit.client.0.smithi144.stdout: "data_extra_pool": "", 2024-06-04T16:01:16.590 INFO:tasks.workunit.client.0.smithi144.stdout: "index_pool": "" 2024-06-04T16:01:16.590 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.590 INFO:tasks.workunit.client.0.smithi144.stdout: }, 2024-06-04T16:01:16.590 INFO:tasks.workunit.client.0.smithi144.stdout: "key": { 2024-06-04T16:01:16.590 INFO:tasks.workunit.client.0.smithi144.stdout: "name": "_myobj", 2024-06-04T16:01:16.590 INFO:tasks.workunit.client.0.smithi144.stdout: "instance": "", 2024-06-04T16:01:16.590 INFO:tasks.workunit.client.0.smithi144.stdout: "ns": "ns" 2024-06-04T16:01:16.590 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.590 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.590 INFO:tasks.workunit.client.0.smithi144.stdout:} 2024-06-04T16:01:16.591 INFO:tasks.workunit.client.0.smithi144.stdout:{ 2024-06-04T16:01:16.591 INFO:tasks.workunit.client.0.smithi144.stdout: "raw_obj": { 2024-06-04T16:01:16.591 INFO:tasks.workunit.client.0.smithi144.stdout: "pool": "default-placement.data", 2024-06-04T16:01:16.591 INFO:tasks.workunit.client.0.smithi144.stdout: "oid": "marker__ns__myobj", 2024-06-04T16:01:16.591 INFO:tasks.workunit.client.0.smithi144.stdout: "loc": "" 2024-06-04T16:01:16.591 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.591 INFO:tasks.workunit.client.0.smithi144.stdout:} 2024-06-04T16:01:16.591 INFO:tasks.workunit.client.0.smithi144.stdout:{ 2024-06-04T16:01:16.591 INFO:tasks.workunit.client.0.smithi144.stdout: "new_obj": { 2024-06-04T16:01:16.591 INFO:tasks.workunit.client.0.smithi144.stdout: "bucket": { 2024-06-04T16:01:16.591 INFO:tasks.workunit.client.0.smithi144.stdout: "name": "test", 2024-06-04T16:01:16.591 INFO:tasks.workunit.client.0.smithi144.stdout: "marker": "marker", 2024-06-04T16:01:16.591 INFO:tasks.workunit.client.0.smithi144.stdout: "bucket_id": "bucket-id", 2024-06-04T16:01:16.591 INFO:tasks.workunit.client.0.smithi144.stdout: "tenant": "", 2024-06-04T16:01:16.592 INFO:tasks.workunit.client.0.smithi144.stdout: "explicit_placement": { 2024-06-04T16:01:16.592 INFO:tasks.workunit.client.0.smithi144.stdout: "data_pool": "", 2024-06-04T16:01:16.592 INFO:tasks.workunit.client.0.smithi144.stdout: "data_extra_pool": "", 2024-06-04T16:01:16.592 INFO:tasks.workunit.client.0.smithi144.stdout: "index_pool": "" 2024-06-04T16:01:16.592 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.592 INFO:tasks.workunit.client.0.smithi144.stdout: }, 2024-06-04T16:01:16.592 INFO:tasks.workunit.client.0.smithi144.stdout: "key": { 2024-06-04T16:01:16.592 INFO:tasks.workunit.client.0.smithi144.stdout: "name": "_myobj", 2024-06-04T16:01:16.592 INFO:tasks.workunit.client.0.smithi144.stdout: "instance": "", 2024-06-04T16:01:16.592 INFO:tasks.workunit.client.0.smithi144.stdout: "ns": "ns" 2024-06-04T16:01:16.592 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.592 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.592 INFO:tasks.workunit.client.0.smithi144.stdout:} 2024-06-04T16:01:16.592 INFO:tasks.workunit.client.0.smithi144.stdout:{ 2024-06-04T16:01:16.593 INFO:tasks.workunit.client.0.smithi144.stdout: "bucket": { 2024-06-04T16:01:16.593 INFO:tasks.workunit.client.0.smithi144.stdout: "name": "ebtest", 2024-06-04T16:01:16.593 INFO:tasks.workunit.client.0.smithi144.stdout: "marker": "marker", 2024-06-04T16:01:16.593 INFO:tasks.workunit.client.0.smithi144.stdout: "bucket_id": "bucket-id", 2024-06-04T16:01:16.593 INFO:tasks.workunit.client.0.smithi144.stdout: "tenant": "", 2024-06-04T16:01:16.593 INFO:tasks.workunit.client.0.smithi144.stdout: "explicit_placement": { 2024-06-04T16:01:16.593 INFO:tasks.workunit.client.0.smithi144.stdout: "data_pool": ".data-pool", 2024-06-04T16:01:16.593 INFO:tasks.workunit.client.0.smithi144.stdout: "data_extra_pool": "", 2024-06-04T16:01:16.593 INFO:tasks.workunit.client.0.smithi144.stdout: "index_pool": ".index-pool" 2024-06-04T16:01:16.593 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.593 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.593 INFO:tasks.workunit.client.0.smithi144.stdout:} 2024-06-04T16:01:16.593 INFO:tasks.workunit.client.0.smithi144.stdout:{ 2024-06-04T16:01:16.593 INFO:tasks.workunit.client.0.smithi144.stdout: "obj": { 2024-06-04T16:01:16.594 INFO:tasks.workunit.client.0.smithi144.stdout: "bucket": { 2024-06-04T16:01:16.594 INFO:tasks.workunit.client.0.smithi144.stdout: "name": "ebtest", 2024-06-04T16:01:16.594 INFO:tasks.workunit.client.0.smithi144.stdout: "marker": "marker", 2024-06-04T16:01:16.594 INFO:tasks.workunit.client.0.smithi144.stdout: "bucket_id": "bucket-id", 2024-06-04T16:01:16.594 INFO:tasks.workunit.client.0.smithi144.stdout: "tenant": "", 2024-06-04T16:01:16.594 INFO:tasks.workunit.client.0.smithi144.stdout: "explicit_placement": { 2024-06-04T16:01:16.594 INFO:tasks.workunit.client.0.smithi144.stdout: "data_pool": ".data-pool", 2024-06-04T16:01:16.594 INFO:tasks.workunit.client.0.smithi144.stdout: "data_extra_pool": "", 2024-06-04T16:01:16.594 INFO:tasks.workunit.client.0.smithi144.stdout: "index_pool": ".index-pool" 2024-06-04T16:01:16.594 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.594 INFO:tasks.workunit.client.0.smithi144.stdout: }, 2024-06-04T16:01:16.594 INFO:tasks.workunit.client.0.smithi144.stdout: "key": { 2024-06-04T16:01:16.594 INFO:tasks.workunit.client.0.smithi144.stdout: "name": "_myobj", 2024-06-04T16:01:16.594 INFO:tasks.workunit.client.0.smithi144.stdout: "instance": "", 2024-06-04T16:01:16.595 INFO:tasks.workunit.client.0.smithi144.stdout: "ns": "ns" 2024-06-04T16:01:16.595 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.595 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.595 INFO:tasks.workunit.client.0.smithi144.stdout:} 2024-06-04T16:01:16.595 INFO:tasks.workunit.client.0.smithi144.stdout:{ 2024-06-04T16:01:16.595 INFO:tasks.workunit.client.0.smithi144.stdout: "raw_obj": { 2024-06-04T16:01:16.595 INFO:tasks.workunit.client.0.smithi144.stdout: "pool": ".data-pool", 2024-06-04T16:01:16.595 INFO:tasks.workunit.client.0.smithi144.stdout: "oid": "marker__ns__myobj", 2024-06-04T16:01:16.595 INFO:tasks.workunit.client.0.smithi144.stdout: "loc": "" 2024-06-04T16:01:16.595 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.595 INFO:tasks.workunit.client.0.smithi144.stdout:} 2024-06-04T16:01:16.595 INFO:tasks.workunit.client.0.smithi144.stdout:{ 2024-06-04T16:01:16.595 INFO:tasks.workunit.client.0.smithi144.stdout: "new_obj": { 2024-06-04T16:01:16.595 INFO:tasks.workunit.client.0.smithi144.stdout: "bucket": { 2024-06-04T16:01:16.596 INFO:tasks.workunit.client.0.smithi144.stdout: "name": "ebtest", 2024-06-04T16:01:16.596 INFO:tasks.workunit.client.0.smithi144.stdout: "marker": "marker", 2024-06-04T16:01:16.596 INFO:tasks.workunit.client.0.smithi144.stdout: "bucket_id": "bucket-id", 2024-06-04T16:01:16.596 INFO:tasks.workunit.client.0.smithi144.stdout: "tenant": "", 2024-06-04T16:01:16.596 INFO:tasks.workunit.client.0.smithi144.stdout: "explicit_placement": { 2024-06-04T16:01:16.596 INFO:tasks.workunit.client.0.smithi144.stdout: "data_pool": ".data-pool", 2024-06-04T16:01:16.596 INFO:tasks.workunit.client.0.smithi144.stdout: "data_extra_pool": "", 2024-06-04T16:01:16.596 INFO:tasks.workunit.client.0.smithi144.stdout: "index_pool": ".index-pool" 2024-06-04T16:01:16.596 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.596 INFO:tasks.workunit.client.0.smithi144.stdout: }, 2024-06-04T16:01:16.596 INFO:tasks.workunit.client.0.smithi144.stdout: "key": { 2024-06-04T16:01:16.596 INFO:tasks.workunit.client.0.smithi144.stdout: "name": "_myobj", 2024-06-04T16:01:16.596 INFO:tasks.workunit.client.0.smithi144.stdout: "instance": "", 2024-06-04T16:01:16.596 INFO:tasks.workunit.client.0.smithi144.stdout: "ns": "ns" 2024-06-04T16:01:16.597 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.597 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.597 INFO:tasks.workunit.client.0.smithi144.stdout:} 2024-06-04T16:01:16.597 INFO:tasks.workunit.client.0.smithi144.stdout:{ 2024-06-04T16:01:16.597 INFO:tasks.workunit.client.0.smithi144.stdout: "bucket": { 2024-06-04T16:01:16.597 INFO:tasks.workunit.client.0.smithi144.stdout: "name": "test", 2024-06-04T16:01:16.597 INFO:tasks.workunit.client.0.smithi144.stdout: "marker": "marker", 2024-06-04T16:01:16.597 INFO:tasks.workunit.client.0.smithi144.stdout: "bucket_id": "bucket-id", 2024-06-04T16:01:16.597 INFO:tasks.workunit.client.0.smithi144.stdout: "tenant": "", 2024-06-04T16:01:16.597 INFO:tasks.workunit.client.0.smithi144.stdout: "explicit_placement": { 2024-06-04T16:01:16.597 INFO:tasks.workunit.client.0.smithi144.stdout: "data_pool": "", 2024-06-04T16:01:16.597 INFO:tasks.workunit.client.0.smithi144.stdout: "data_extra_pool": "", 2024-06-04T16:01:16.598 INFO:tasks.workunit.client.0.smithi144.stdout: "index_pool": "" 2024-06-04T16:01:16.598 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.598 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.598 INFO:tasks.workunit.client.0.smithi144.stdout:} 2024-06-04T16:01:16.598 INFO:tasks.workunit.client.0.smithi144.stdout:{ 2024-06-04T16:01:16.598 INFO:tasks.workunit.client.0.smithi144.stdout: "obj": { 2024-06-04T16:01:16.598 INFO:tasks.workunit.client.0.smithi144.stdout: "bucket": { 2024-06-04T16:01:16.598 INFO:tasks.workunit.client.0.smithi144.stdout: "name": "test", 2024-06-04T16:01:16.598 INFO:tasks.workunit.client.0.smithi144.stdout: "marker": "marker", 2024-06-04T16:01:16.598 INFO:tasks.workunit.client.0.smithi144.stdout: "bucket_id": "bucket-id", 2024-06-04T16:01:16.598 INFO:tasks.workunit.client.0.smithi144.stdout: "tenant": "", 2024-06-04T16:01:16.598 INFO:tasks.workunit.client.0.smithi144.stdout: "explicit_placement": { 2024-06-04T16:01:16.598 INFO:tasks.workunit.client.0.smithi144.stdout: "data_pool": "", 2024-06-04T16:01:16.598 INFO:tasks.workunit.client.0.smithi144.stdout: "data_extra_pool": "", 2024-06-04T16:01:16.599 INFO:tasks.workunit.client.0.smithi144.stdout: "index_pool": "" 2024-06-04T16:01:16.599 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.599 INFO:tasks.workunit.client.0.smithi144.stdout: }, 2024-06-04T16:01:16.599 INFO:tasks.workunit.client.0.smithi144.stdout: "key": { 2024-06-04T16:01:16.599 INFO:tasks.workunit.client.0.smithi144.stdout: "name": "_myobj", 2024-06-04T16:01:16.599 INFO:tasks.workunit.client.0.smithi144.stdout: "instance": "inst", 2024-06-04T16:01:16.599 INFO:tasks.workunit.client.0.smithi144.stdout: "ns": "" 2024-06-04T16:01:16.599 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.599 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.599 INFO:tasks.workunit.client.0.smithi144.stdout:} 2024-06-04T16:01:16.599 INFO:tasks.workunit.client.0.smithi144.stdout:{ 2024-06-04T16:01:16.600 INFO:tasks.workunit.client.0.smithi144.stdout: "raw_obj": { 2024-06-04T16:01:16.600 INFO:tasks.workunit.client.0.smithi144.stdout: "pool": "default-placement.data", 2024-06-04T16:01:16.600 INFO:tasks.workunit.client.0.smithi144.stdout: "oid": "marker__:inst__myobj", 2024-06-04T16:01:16.600 INFO:tasks.workunit.client.0.smithi144.stdout: "loc": "marker__myobj" 2024-06-04T16:01:16.600 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.600 INFO:tasks.workunit.client.0.smithi144.stdout:} 2024-06-04T16:01:16.600 INFO:tasks.workunit.client.0.smithi144.stdout:{ 2024-06-04T16:01:16.600 INFO:tasks.workunit.client.0.smithi144.stdout: "new_obj": { 2024-06-04T16:01:16.600 INFO:tasks.workunit.client.0.smithi144.stdout: "bucket": { 2024-06-04T16:01:16.600 INFO:tasks.workunit.client.0.smithi144.stdout: "name": "test", 2024-06-04T16:01:16.600 INFO:tasks.workunit.client.0.smithi144.stdout: "marker": "marker", 2024-06-04T16:01:16.600 INFO:tasks.workunit.client.0.smithi144.stdout: "bucket_id": "bucket-id", 2024-06-04T16:01:16.600 INFO:tasks.workunit.client.0.smithi144.stdout: "tenant": "", 2024-06-04T16:01:16.600 INFO:tasks.workunit.client.0.smithi144.stdout: "explicit_placement": { 2024-06-04T16:01:16.601 INFO:tasks.workunit.client.0.smithi144.stdout: "data_pool": "", 2024-06-04T16:01:16.601 INFO:tasks.workunit.client.0.smithi144.stdout: "data_extra_pool": "", 2024-06-04T16:01:16.601 INFO:tasks.workunit.client.0.smithi144.stdout: "index_pool": "" 2024-06-04T16:01:16.601 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.601 INFO:tasks.workunit.client.0.smithi144.stdout: }, 2024-06-04T16:01:16.601 INFO:tasks.workunit.client.0.smithi144.stdout: "key": { 2024-06-04T16:01:16.601 INFO:tasks.workunit.client.0.smithi144.stdout: "name": "_myobj", 2024-06-04T16:01:16.601 INFO:tasks.workunit.client.0.smithi144.stdout: "instance": "inst", 2024-06-04T16:01:16.601 INFO:tasks.workunit.client.0.smithi144.stdout: "ns": "" 2024-06-04T16:01:16.601 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.601 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.601 INFO:tasks.workunit.client.0.smithi144.stdout:} 2024-06-04T16:01:16.601 INFO:tasks.workunit.client.0.smithi144.stdout:{ 2024-06-04T16:01:16.601 INFO:tasks.workunit.client.0.smithi144.stdout: "bucket": { 2024-06-04T16:01:16.601 INFO:tasks.workunit.client.0.smithi144.stdout: "name": "ebtest", 2024-06-04T16:01:16.602 INFO:tasks.workunit.client.0.smithi144.stdout: "marker": "marker", 2024-06-04T16:01:16.602 INFO:tasks.workunit.client.0.smithi144.stdout: "bucket_id": "bucket-id", 2024-06-04T16:01:16.602 INFO:tasks.workunit.client.0.smithi144.stdout: "tenant": "", 2024-06-04T16:01:16.602 INFO:tasks.workunit.client.0.smithi144.stdout: "explicit_placement": { 2024-06-04T16:01:16.602 INFO:tasks.workunit.client.0.smithi144.stdout: "data_pool": ".data-pool", 2024-06-04T16:01:16.602 INFO:tasks.workunit.client.0.smithi144.stdout: "data_extra_pool": "", 2024-06-04T16:01:16.602 INFO:tasks.workunit.client.0.smithi144.stdout: "index_pool": ".index-pool" 2024-06-04T16:01:16.602 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.602 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.602 INFO:tasks.workunit.client.0.smithi144.stdout:} 2024-06-04T16:01:16.602 INFO:tasks.workunit.client.0.smithi144.stdout:{ 2024-06-04T16:01:16.602 INFO:tasks.workunit.client.0.smithi144.stdout: "obj": { 2024-06-04T16:01:16.603 INFO:tasks.workunit.client.0.smithi144.stdout: "bucket": { 2024-06-04T16:01:16.603 INFO:tasks.workunit.client.0.smithi144.stdout: "name": "ebtest", 2024-06-04T16:01:16.603 INFO:tasks.workunit.client.0.smithi144.stdout: "marker": "marker", 2024-06-04T16:01:16.603 INFO:tasks.workunit.client.0.smithi144.stdout: "bucket_id": "bucket-id", 2024-06-04T16:01:16.603 INFO:tasks.workunit.client.0.smithi144.stdout: "tenant": "", 2024-06-04T16:01:16.603 INFO:tasks.workunit.client.0.smithi144.stdout: "explicit_placement": { 2024-06-04T16:01:16.603 INFO:tasks.workunit.client.0.smithi144.stdout: "data_pool": ".data-pool", 2024-06-04T16:01:16.603 INFO:tasks.workunit.client.0.smithi144.stdout: "data_extra_pool": "", 2024-06-04T16:01:16.603 INFO:tasks.workunit.client.0.smithi144.stdout: "index_pool": ".index-pool" 2024-06-04T16:01:16.603 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.603 INFO:tasks.workunit.client.0.smithi144.stdout: }, 2024-06-04T16:01:16.603 INFO:tasks.workunit.client.0.smithi144.stdout: "key": { 2024-06-04T16:01:16.603 INFO:tasks.workunit.client.0.smithi144.stdout: "name": "_myobj", 2024-06-04T16:01:16.603 INFO:tasks.workunit.client.0.smithi144.stdout: "instance": "inst", 2024-06-04T16:01:16.604 INFO:tasks.workunit.client.0.smithi144.stdout: "ns": "" 2024-06-04T16:01:16.604 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.604 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.604 INFO:tasks.workunit.client.0.smithi144.stdout:} 2024-06-04T16:01:16.604 INFO:tasks.workunit.client.0.smithi144.stdout:{ 2024-06-04T16:01:16.604 INFO:tasks.workunit.client.0.smithi144.stdout: "raw_obj": { 2024-06-04T16:01:16.604 INFO:tasks.workunit.client.0.smithi144.stdout: "pool": ".data-pool", 2024-06-04T16:01:16.604 INFO:tasks.workunit.client.0.smithi144.stdout: "oid": "marker__:inst__myobj", 2024-06-04T16:01:16.604 INFO:tasks.workunit.client.0.smithi144.stdout: "loc": "marker__myobj" 2024-06-04T16:01:16.604 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.604 INFO:tasks.workunit.client.0.smithi144.stdout:} 2024-06-04T16:01:16.604 INFO:tasks.workunit.client.0.smithi144.stdout:{ 2024-06-04T16:01:16.604 INFO:tasks.workunit.client.0.smithi144.stdout: "new_obj": { 2024-06-04T16:01:16.604 INFO:tasks.workunit.client.0.smithi144.stdout: "bucket": { 2024-06-04T16:01:16.604 INFO:tasks.workunit.client.0.smithi144.stdout: "name": "ebtest", 2024-06-04T16:01:16.605 INFO:tasks.workunit.client.0.smithi144.stdout: "marker": "marker", 2024-06-04T16:01:16.605 INFO:tasks.workunit.client.0.smithi144.stdout: "bucket_id": "bucket-id", 2024-06-04T16:01:16.605 INFO:tasks.workunit.client.0.smithi144.stdout: "tenant": "", 2024-06-04T16:01:16.605 INFO:tasks.workunit.client.0.smithi144.stdout: "explicit_placement": { 2024-06-04T16:01:16.605 INFO:tasks.workunit.client.0.smithi144.stdout: "data_pool": ".data-pool", 2024-06-04T16:01:16.605 INFO:tasks.workunit.client.0.smithi144.stdout: "data_extra_pool": "", 2024-06-04T16:01:16.605 INFO:tasks.workunit.client.0.smithi144.stdout: "index_pool": ".index-pool" 2024-06-04T16:01:16.605 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.605 INFO:tasks.workunit.client.0.smithi144.stdout: }, 2024-06-04T16:01:16.605 INFO:tasks.workunit.client.0.smithi144.stdout: "key": { 2024-06-04T16:01:16.605 INFO:tasks.workunit.client.0.smithi144.stdout: "name": "_myobj", 2024-06-04T16:01:16.605 INFO:tasks.workunit.client.0.smithi144.stdout: "instance": "inst", 2024-06-04T16:01:16.605 INFO:tasks.workunit.client.0.smithi144.stdout: "ns": "" 2024-06-04T16:01:16.605 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.606 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.606 INFO:tasks.workunit.client.0.smithi144.stdout:} 2024-06-04T16:01:16.606 INFO:tasks.workunit.client.0.smithi144.stdout:{ 2024-06-04T16:01:16.606 INFO:tasks.workunit.client.0.smithi144.stdout: "bucket": { 2024-06-04T16:01:16.606 INFO:tasks.workunit.client.0.smithi144.stdout: "name": "test", 2024-06-04T16:01:16.606 INFO:tasks.workunit.client.0.smithi144.stdout: "marker": "marker", 2024-06-04T16:01:16.606 INFO:tasks.workunit.client.0.smithi144.stdout: "bucket_id": "bucket-id", 2024-06-04T16:01:16.606 INFO:tasks.workunit.client.0.smithi144.stdout: "tenant": "", 2024-06-04T16:01:16.606 INFO:tasks.workunit.client.0.smithi144.stdout: "explicit_placement": { 2024-06-04T16:01:16.606 INFO:tasks.workunit.client.0.smithi144.stdout: "data_pool": "", 2024-06-04T16:01:16.606 INFO:tasks.workunit.client.0.smithi144.stdout: "data_extra_pool": "", 2024-06-04T16:01:16.606 INFO:tasks.workunit.client.0.smithi144.stdout: "index_pool": "" 2024-06-04T16:01:16.606 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.607 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.607 INFO:tasks.workunit.client.0.smithi144.stdout:} 2024-06-04T16:01:16.607 INFO:tasks.workunit.client.0.smithi144.stdout:{ 2024-06-04T16:01:16.607 INFO:tasks.workunit.client.0.smithi144.stdout: "obj": { 2024-06-04T16:01:16.607 INFO:tasks.workunit.client.0.smithi144.stdout: "bucket": { 2024-06-04T16:01:16.607 INFO:tasks.workunit.client.0.smithi144.stdout: "name": "test", 2024-06-04T16:01:16.607 INFO:tasks.workunit.client.0.smithi144.stdout: "marker": "marker", 2024-06-04T16:01:16.607 INFO:tasks.workunit.client.0.smithi144.stdout: "bucket_id": "bucket-id", 2024-06-04T16:01:16.607 INFO:tasks.workunit.client.0.smithi144.stdout: "tenant": "", 2024-06-04T16:01:16.607 INFO:tasks.workunit.client.0.smithi144.stdout: "explicit_placement": { 2024-06-04T16:01:16.607 INFO:tasks.workunit.client.0.smithi144.stdout: "data_pool": "", 2024-06-04T16:01:16.607 INFO:tasks.workunit.client.0.smithi144.stdout: "data_extra_pool": "", 2024-06-04T16:01:16.607 INFO:tasks.workunit.client.0.smithi144.stdout: "index_pool": "" 2024-06-04T16:01:16.607 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.608 INFO:tasks.workunit.client.0.smithi144.stdout: }, 2024-06-04T16:01:16.608 INFO:tasks.workunit.client.0.smithi144.stdout: "key": { 2024-06-04T16:01:16.608 INFO:tasks.workunit.client.0.smithi144.stdout: "name": "_myobj", 2024-06-04T16:01:16.608 INFO:tasks.workunit.client.0.smithi144.stdout: "instance": "inst", 2024-06-04T16:01:16.608 INFO:tasks.workunit.client.0.smithi144.stdout: "ns": "ns" 2024-06-04T16:01:16.608 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.608 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.608 INFO:tasks.workunit.client.0.smithi144.stdout:} 2024-06-04T16:01:16.608 INFO:tasks.workunit.client.0.smithi144.stdout:{ 2024-06-04T16:01:16.608 INFO:tasks.workunit.client.0.smithi144.stdout: "raw_obj": { 2024-06-04T16:01:16.608 INFO:tasks.workunit.client.0.smithi144.stdout: "pool": "default-placement.data", 2024-06-04T16:01:16.608 INFO:tasks.workunit.client.0.smithi144.stdout: "oid": "marker__ns:inst__myobj", 2024-06-04T16:01:16.608 INFO:tasks.workunit.client.0.smithi144.stdout: "loc": "" 2024-06-04T16:01:16.608 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.608 INFO:tasks.workunit.client.0.smithi144.stdout:} 2024-06-04T16:01:16.609 INFO:tasks.workunit.client.0.smithi144.stdout:{ 2024-06-04T16:01:16.609 INFO:tasks.workunit.client.0.smithi144.stdout: "new_obj": { 2024-06-04T16:01:16.609 INFO:tasks.workunit.client.0.smithi144.stdout: "bucket": { 2024-06-04T16:01:16.609 INFO:tasks.workunit.client.0.smithi144.stdout: "name": "test", 2024-06-04T16:01:16.609 INFO:tasks.workunit.client.0.smithi144.stdout: "marker": "marker", 2024-06-04T16:01:16.609 INFO:tasks.workunit.client.0.smithi144.stdout: "bucket_id": "bucket-id", 2024-06-04T16:01:16.609 INFO:tasks.workunit.client.0.smithi144.stdout: "tenant": "", 2024-06-04T16:01:16.609 INFO:tasks.workunit.client.0.smithi144.stdout: "explicit_placement": { 2024-06-04T16:01:16.609 INFO:tasks.workunit.client.0.smithi144.stdout: "data_pool": "", 2024-06-04T16:01:16.609 INFO:tasks.workunit.client.0.smithi144.stdout: "data_extra_pool": "", 2024-06-04T16:01:16.609 INFO:tasks.workunit.client.0.smithi144.stdout: "index_pool": "" 2024-06-04T16:01:16.609 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.609 INFO:tasks.workunit.client.0.smithi144.stdout: }, 2024-06-04T16:01:16.609 INFO:tasks.workunit.client.0.smithi144.stdout: "key": { 2024-06-04T16:01:16.610 INFO:tasks.workunit.client.0.smithi144.stdout: "name": "_myobj", 2024-06-04T16:01:16.610 INFO:tasks.workunit.client.0.smithi144.stdout: "instance": "inst", 2024-06-04T16:01:16.610 INFO:tasks.workunit.client.0.smithi144.stdout: "ns": "ns" 2024-06-04T16:01:16.610 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.610 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.610 INFO:tasks.workunit.client.0.smithi144.stdout:} 2024-06-04T16:01:16.610 INFO:tasks.workunit.client.0.smithi144.stdout:{ 2024-06-04T16:01:16.610 INFO:tasks.workunit.client.0.smithi144.stdout: "bucket": { 2024-06-04T16:01:16.610 INFO:tasks.workunit.client.0.smithi144.stdout: "name": "ebtest", 2024-06-04T16:01:16.610 INFO:tasks.workunit.client.0.smithi144.stdout: "marker": "marker", 2024-06-04T16:01:16.610 INFO:tasks.workunit.client.0.smithi144.stdout: "bucket_id": "bucket-id", 2024-06-04T16:01:16.610 INFO:tasks.workunit.client.0.smithi144.stdout: "tenant": "", 2024-06-04T16:01:16.610 INFO:tasks.workunit.client.0.smithi144.stdout: "explicit_placement": { 2024-06-04T16:01:16.611 INFO:tasks.workunit.client.0.smithi144.stdout: "data_pool": ".data-pool", 2024-06-04T16:01:16.611 INFO:tasks.workunit.client.0.smithi144.stdout: "data_extra_pool": "", 2024-06-04T16:01:16.611 INFO:tasks.workunit.client.0.smithi144.stdout: "index_pool": ".index-pool" 2024-06-04T16:01:16.611 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.611 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.611 INFO:tasks.workunit.client.0.smithi144.stdout:} 2024-06-04T16:01:16.611 INFO:tasks.workunit.client.0.smithi144.stdout:{ 2024-06-04T16:01:16.611 INFO:tasks.workunit.client.0.smithi144.stdout: "obj": { 2024-06-04T16:01:16.611 INFO:tasks.workunit.client.0.smithi144.stdout: "bucket": { 2024-06-04T16:01:16.611 INFO:tasks.workunit.client.0.smithi144.stdout: "name": "ebtest", 2024-06-04T16:01:16.611 INFO:tasks.workunit.client.0.smithi144.stdout: "marker": "marker", 2024-06-04T16:01:16.611 INFO:tasks.workunit.client.0.smithi144.stdout: "bucket_id": "bucket-id", 2024-06-04T16:01:16.611 INFO:tasks.workunit.client.0.smithi144.stdout: "tenant": "", 2024-06-04T16:01:16.611 INFO:tasks.workunit.client.0.smithi144.stdout: "explicit_placement": { 2024-06-04T16:01:16.611 INFO:tasks.workunit.client.0.smithi144.stdout: "data_pool": ".data-pool", 2024-06-04T16:01:16.612 INFO:tasks.workunit.client.0.smithi144.stdout: "data_extra_pool": "", 2024-06-04T16:01:16.612 INFO:tasks.workunit.client.0.smithi144.stdout: "index_pool": ".index-pool" 2024-06-04T16:01:16.612 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.612 INFO:tasks.workunit.client.0.smithi144.stdout: }, 2024-06-04T16:01:16.612 INFO:tasks.workunit.client.0.smithi144.stdout: "key": { 2024-06-04T16:01:16.612 INFO:tasks.workunit.client.0.smithi144.stdout: "name": "_myobj", 2024-06-04T16:01:16.612 INFO:tasks.workunit.client.0.smithi144.stdout: "instance": "inst", 2024-06-04T16:01:16.612 INFO:tasks.workunit.client.0.smithi144.stdout: "ns": "ns" 2024-06-04T16:01:16.612 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.612 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.612 INFO:tasks.workunit.client.0.smithi144.stdout:} 2024-06-04T16:01:16.612 INFO:tasks.workunit.client.0.smithi144.stdout:{ 2024-06-04T16:01:16.612 INFO:tasks.workunit.client.0.smithi144.stdout: "raw_obj": { 2024-06-04T16:01:16.612 INFO:tasks.workunit.client.0.smithi144.stdout: "pool": ".data-pool", 2024-06-04T16:01:16.613 INFO:tasks.workunit.client.0.smithi144.stdout: "oid": "marker__ns:inst__myobj", 2024-06-04T16:01:16.613 INFO:tasks.workunit.client.0.smithi144.stdout: "loc": "" 2024-06-04T16:01:16.613 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.613 INFO:tasks.workunit.client.0.smithi144.stdout:} 2024-06-04T16:01:16.613 INFO:tasks.workunit.client.0.smithi144.stdout:{ 2024-06-04T16:01:16.613 INFO:tasks.workunit.client.0.smithi144.stdout: "new_obj": { 2024-06-04T16:01:16.613 INFO:tasks.workunit.client.0.smithi144.stdout: "bucket": { 2024-06-04T16:01:16.613 INFO:tasks.workunit.client.0.smithi144.stdout: "name": "ebtest", 2024-06-04T16:01:16.613 INFO:tasks.workunit.client.0.smithi144.stdout: "marker": "marker", 2024-06-04T16:01:16.613 INFO:tasks.workunit.client.0.smithi144.stdout: "bucket_id": "bucket-id", 2024-06-04T16:01:16.613 INFO:tasks.workunit.client.0.smithi144.stdout: "tenant": "", 2024-06-04T16:01:16.613 INFO:tasks.workunit.client.0.smithi144.stdout: "explicit_placement": { 2024-06-04T16:01:16.613 INFO:tasks.workunit.client.0.smithi144.stdout: "data_pool": ".data-pool", 2024-06-04T16:01:16.614 INFO:tasks.workunit.client.0.smithi144.stdout: "data_extra_pool": "", 2024-06-04T16:01:16.614 INFO:tasks.workunit.client.0.smithi144.stdout: "index_pool": ".index-pool" 2024-06-04T16:01:16.614 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.614 INFO:tasks.workunit.client.0.smithi144.stdout: }, 2024-06-04T16:01:16.614 INFO:tasks.workunit.client.0.smithi144.stdout: "key": { 2024-06-04T16:01:16.614 INFO:tasks.workunit.client.0.smithi144.stdout: "name": "_myobj", 2024-06-04T16:01:16.614 INFO:tasks.workunit.client.0.smithi144.stdout: "instance": "inst", 2024-06-04T16:01:16.614 INFO:tasks.workunit.client.0.smithi144.stdout: "ns": "ns" 2024-06-04T16:01:16.614 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.614 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.614 INFO:tasks.workunit.client.0.smithi144.stdout:} 2024-06-04T16:01:16.614 INFO:tasks.workunit.client.0.smithi144.stdout:{ 2024-06-04T16:01:16.615 INFO:tasks.workunit.client.0.smithi144.stdout: "bucket": { 2024-06-04T16:01:16.615 INFO:tasks.workunit.client.0.smithi144.stdout: "name": "test", 2024-06-04T16:01:16.615 INFO:tasks.workunit.client.0.smithi144.stdout: "marker": "marker", 2024-06-04T16:01:16.615 INFO:tasks.workunit.client.0.smithi144.stdout: "bucket_id": "bucket-id", 2024-06-04T16:01:16.615 INFO:tasks.workunit.client.0.smithi144.stdout: "tenant": "", 2024-06-04T16:01:16.615 INFO:tasks.workunit.client.0.smithi144.stdout: "explicit_placement": { 2024-06-04T16:01:16.615 INFO:tasks.workunit.client.0.smithi144.stdout: "data_pool": "", 2024-06-04T16:01:16.615 INFO:tasks.workunit.client.0.smithi144.stdout: "data_extra_pool": "", 2024-06-04T16:01:16.615 INFO:tasks.workunit.client.0.smithi144.stdout: "index_pool": "" 2024-06-04T16:01:16.615 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.615 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.615 INFO:tasks.workunit.client.0.smithi144.stdout:} 2024-06-04T16:01:16.615 INFO:tasks.workunit.client.0.smithi144.stdout:{ 2024-06-04T16:01:16.616 INFO:tasks.workunit.client.0.smithi144.stdout: "obj": { 2024-06-04T16:01:16.616 INFO:tasks.workunit.client.0.smithi144.stdout: "bucket": { 2024-06-04T16:01:16.616 INFO:tasks.workunit.client.0.smithi144.stdout: "name": "test", 2024-06-04T16:01:16.616 INFO:tasks.workunit.client.0.smithi144.stdout: "marker": "marker", 2024-06-04T16:01:16.616 INFO:tasks.workunit.client.0.smithi144.stdout: "bucket_id": "bucket-id", 2024-06-04T16:01:16.616 INFO:tasks.workunit.client.0.smithi144.stdout: "tenant": "", 2024-06-04T16:01:16.616 INFO:tasks.workunit.client.0.smithi144.stdout: "explicit_placement": { 2024-06-04T16:01:16.616 INFO:tasks.workunit.client.0.smithi144.stdout: "data_pool": "", 2024-06-04T16:01:16.616 INFO:tasks.workunit.client.0.smithi144.stdout: "data_extra_pool": "", 2024-06-04T16:01:16.616 INFO:tasks.workunit.client.0.smithi144.stdout: "index_pool": "" 2024-06-04T16:01:16.616 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.616 INFO:tasks.workunit.client.0.smithi144.stdout: }, 2024-06-04T16:01:16.616 INFO:tasks.workunit.client.0.smithi144.stdout: "key": { 2024-06-04T16:01:16.616 INFO:tasks.workunit.client.0.smithi144.stdout: "name": "_myobj_", 2024-06-04T16:01:16.617 INFO:tasks.workunit.client.0.smithi144.stdout: "instance": "", 2024-06-04T16:01:16.617 INFO:tasks.workunit.client.0.smithi144.stdout: "ns": "" 2024-06-04T16:01:16.617 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.617 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.617 INFO:tasks.workunit.client.0.smithi144.stdout:} 2024-06-04T16:01:16.617 INFO:tasks.workunit.client.0.smithi144.stdout:{ 2024-06-04T16:01:16.617 INFO:tasks.workunit.client.0.smithi144.stdout: "raw_obj": { 2024-06-04T16:01:16.617 INFO:tasks.workunit.client.0.smithi144.stdout: "pool": "default-placement.data", 2024-06-04T16:01:16.617 INFO:tasks.workunit.client.0.smithi144.stdout: "oid": "marker___myobj_", 2024-06-04T16:01:16.617 INFO:tasks.workunit.client.0.smithi144.stdout: "loc": "marker__myobj_" 2024-06-04T16:01:16.617 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.617 INFO:tasks.workunit.client.0.smithi144.stdout:} 2024-06-04T16:01:16.617 INFO:tasks.workunit.client.0.smithi144.stdout:{ 2024-06-04T16:01:16.617 INFO:tasks.workunit.client.0.smithi144.stdout: "new_obj": { 2024-06-04T16:01:16.618 INFO:tasks.workunit.client.0.smithi144.stdout: "bucket": { 2024-06-04T16:01:16.618 INFO:tasks.workunit.client.0.smithi144.stdout: "name": "test", 2024-06-04T16:01:16.618 INFO:tasks.workunit.client.0.smithi144.stdout: "marker": "marker", 2024-06-04T16:01:16.618 INFO:tasks.workunit.client.0.smithi144.stdout: "bucket_id": "bucket-id", 2024-06-04T16:01:16.618 INFO:tasks.workunit.client.0.smithi144.stdout: "tenant": "", 2024-06-04T16:01:16.618 INFO:tasks.workunit.client.0.smithi144.stdout: "explicit_placement": { 2024-06-04T16:01:16.618 INFO:tasks.workunit.client.0.smithi144.stdout: "data_pool": "", 2024-06-04T16:01:16.618 INFO:tasks.workunit.client.0.smithi144.stdout: "data_extra_pool": "", 2024-06-04T16:01:16.618 INFO:tasks.workunit.client.0.smithi144.stdout: "index_pool": "" 2024-06-04T16:01:16.618 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.618 INFO:tasks.workunit.client.0.smithi144.stdout: }, 2024-06-04T16:01:16.618 INFO:tasks.workunit.client.0.smithi144.stdout: "key": { 2024-06-04T16:01:16.618 INFO:tasks.workunit.client.0.smithi144.stdout: "name": "_myobj_", 2024-06-04T16:01:16.619 INFO:tasks.workunit.client.0.smithi144.stdout: "instance": "", 2024-06-04T16:01:16.619 INFO:tasks.workunit.client.0.smithi144.stdout: "ns": "" 2024-06-04T16:01:16.619 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.619 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.619 INFO:tasks.workunit.client.0.smithi144.stdout:} 2024-06-04T16:01:16.619 INFO:tasks.workunit.client.0.smithi144.stdout:{ 2024-06-04T16:01:16.619 INFO:tasks.workunit.client.0.smithi144.stdout: "bucket": { 2024-06-04T16:01:16.619 INFO:tasks.workunit.client.0.smithi144.stdout: "name": "ebtest", 2024-06-04T16:01:16.619 INFO:tasks.workunit.client.0.smithi144.stdout: "marker": "marker", 2024-06-04T16:01:16.619 INFO:tasks.workunit.client.0.smithi144.stdout: "bucket_id": "bucket-id", 2024-06-04T16:01:16.619 INFO:tasks.workunit.client.0.smithi144.stdout: "tenant": "", 2024-06-04T16:01:16.619 INFO:tasks.workunit.client.0.smithi144.stdout: "explicit_placement": { 2024-06-04T16:01:16.619 INFO:tasks.workunit.client.0.smithi144.stdout: "data_pool": ".data-pool", 2024-06-04T16:01:16.620 INFO:tasks.workunit.client.0.smithi144.stdout: "data_extra_pool": "", 2024-06-04T16:01:16.620 INFO:tasks.workunit.client.0.smithi144.stdout: "index_pool": ".index-pool" 2024-06-04T16:01:16.620 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.620 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.620 INFO:tasks.workunit.client.0.smithi144.stdout:} 2024-06-04T16:01:16.620 INFO:tasks.workunit.client.0.smithi144.stdout:{ 2024-06-04T16:01:16.620 INFO:tasks.workunit.client.0.smithi144.stdout: "obj": { 2024-06-04T16:01:16.620 INFO:tasks.workunit.client.0.smithi144.stdout: "bucket": { 2024-06-04T16:01:16.620 INFO:tasks.workunit.client.0.smithi144.stdout: "name": "ebtest", 2024-06-04T16:01:16.620 INFO:tasks.workunit.client.0.smithi144.stdout: "marker": "marker", 2024-06-04T16:01:16.621 INFO:tasks.workunit.client.0.smithi144.stdout: "bucket_id": "bucket-id", 2024-06-04T16:01:16.621 INFO:tasks.workunit.client.0.smithi144.stdout: "tenant": "", 2024-06-04T16:01:16.621 INFO:tasks.workunit.client.0.smithi144.stdout: "explicit_placement": { 2024-06-04T16:01:16.621 INFO:tasks.workunit.client.0.smithi144.stdout: "data_pool": ".data-pool", 2024-06-04T16:01:16.621 INFO:tasks.workunit.client.0.smithi144.stdout: "data_extra_pool": "", 2024-06-04T16:01:16.621 INFO:tasks.workunit.client.0.smithi144.stdout: "index_pool": ".index-pool" 2024-06-04T16:01:16.621 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.621 INFO:tasks.workunit.client.0.smithi144.stdout: }, 2024-06-04T16:01:16.621 INFO:tasks.workunit.client.0.smithi144.stdout: "key": { 2024-06-04T16:01:16.621 INFO:tasks.workunit.client.0.smithi144.stdout: "name": "_myobj_", 2024-06-04T16:01:16.621 INFO:tasks.workunit.client.0.smithi144.stdout: "instance": "", 2024-06-04T16:01:16.621 INFO:tasks.workunit.client.0.smithi144.stdout: "ns": "" 2024-06-04T16:01:16.621 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.621 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.621 INFO:tasks.workunit.client.0.smithi144.stdout:} 2024-06-04T16:01:16.621 INFO:tasks.workunit.client.0.smithi144.stdout:{ 2024-06-04T16:01:16.622 INFO:tasks.workunit.client.0.smithi144.stdout: "raw_obj": { 2024-06-04T16:01:16.622 INFO:tasks.workunit.client.0.smithi144.stdout: "pool": ".data-pool", 2024-06-04T16:01:16.622 INFO:tasks.workunit.client.0.smithi144.stdout: "oid": "marker___myobj_", 2024-06-04T16:01:16.622 INFO:tasks.workunit.client.0.smithi144.stdout: "loc": "marker__myobj_" 2024-06-04T16:01:16.622 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.622 INFO:tasks.workunit.client.0.smithi144.stdout:} 2024-06-04T16:01:16.622 INFO:tasks.workunit.client.0.smithi144.stdout:{ 2024-06-04T16:01:16.622 INFO:tasks.workunit.client.0.smithi144.stdout: "new_obj": { 2024-06-04T16:01:16.622 INFO:tasks.workunit.client.0.smithi144.stdout: "bucket": { 2024-06-04T16:01:16.622 INFO:tasks.workunit.client.0.smithi144.stdout: "name": "ebtest", 2024-06-04T16:01:16.622 INFO:tasks.workunit.client.0.smithi144.stdout: "marker": "marker", 2024-06-04T16:01:16.622 INFO:tasks.workunit.client.0.smithi144.stdout: "bucket_id": "bucket-id", 2024-06-04T16:01:16.622 INFO:tasks.workunit.client.0.smithi144.stdout: "tenant": "", 2024-06-04T16:01:16.623 INFO:tasks.workunit.client.0.smithi144.stdout: "explicit_placement": { 2024-06-04T16:01:16.623 INFO:tasks.workunit.client.0.smithi144.stdout: "data_pool": ".data-pool", 2024-06-04T16:01:16.623 INFO:tasks.workunit.client.0.smithi144.stdout: "data_extra_pool": "", 2024-06-04T16:01:16.623 INFO:tasks.workunit.client.0.smithi144.stdout: "index_pool": ".index-pool" 2024-06-04T16:01:16.623 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.623 INFO:tasks.workunit.client.0.smithi144.stdout: }, 2024-06-04T16:01:16.623 INFO:tasks.workunit.client.0.smithi144.stdout: "key": { 2024-06-04T16:01:16.623 INFO:tasks.workunit.client.0.smithi144.stdout: "name": "_myobj_", 2024-06-04T16:01:16.623 INFO:tasks.workunit.client.0.smithi144.stdout: "instance": "", 2024-06-04T16:01:16.623 INFO:tasks.workunit.client.0.smithi144.stdout: "ns": "" 2024-06-04T16:01:16.623 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.623 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.623 INFO:tasks.workunit.client.0.smithi144.stdout:} 2024-06-04T16:01:16.624 INFO:tasks.workunit.client.0.smithi144.stdout:{ 2024-06-04T16:01:16.624 INFO:tasks.workunit.client.0.smithi144.stdout: "bucket": { 2024-06-04T16:01:16.624 INFO:tasks.workunit.client.0.smithi144.stdout: "name": "test", 2024-06-04T16:01:16.624 INFO:tasks.workunit.client.0.smithi144.stdout: "marker": "marker", 2024-06-04T16:01:16.624 INFO:tasks.workunit.client.0.smithi144.stdout: "bucket_id": "bucket-id", 2024-06-04T16:01:16.624 INFO:tasks.workunit.client.0.smithi144.stdout: "tenant": "", 2024-06-04T16:01:16.624 INFO:tasks.workunit.client.0.smithi144.stdout: "explicit_placement": { 2024-06-04T16:01:16.624 INFO:tasks.workunit.client.0.smithi144.stdout: "data_pool": "", 2024-06-04T16:01:16.624 INFO:tasks.workunit.client.0.smithi144.stdout: "data_extra_pool": "", 2024-06-04T16:01:16.624 INFO:tasks.workunit.client.0.smithi144.stdout: "index_pool": "" 2024-06-04T16:01:16.624 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.624 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.625 INFO:tasks.workunit.client.0.smithi144.stdout:} 2024-06-04T16:01:16.625 INFO:tasks.workunit.client.0.smithi144.stdout:{ 2024-06-04T16:01:16.625 INFO:tasks.workunit.client.0.smithi144.stdout: "obj": { 2024-06-04T16:01:16.625 INFO:tasks.workunit.client.0.smithi144.stdout: "bucket": { 2024-06-04T16:01:16.625 INFO:tasks.workunit.client.0.smithi144.stdout: "name": "test", 2024-06-04T16:01:16.625 INFO:tasks.workunit.client.0.smithi144.stdout: "marker": "marker", 2024-06-04T16:01:16.625 INFO:tasks.workunit.client.0.smithi144.stdout: "bucket_id": "bucket-id", 2024-06-04T16:01:16.625 INFO:tasks.workunit.client.0.smithi144.stdout: "tenant": "", 2024-06-04T16:01:16.625 INFO:tasks.workunit.client.0.smithi144.stdout: "explicit_placement": { 2024-06-04T16:01:16.625 INFO:tasks.workunit.client.0.smithi144.stdout: "data_pool": "", 2024-06-04T16:01:16.625 INFO:tasks.workunit.client.0.smithi144.stdout: "data_extra_pool": "", 2024-06-04T16:01:16.625 INFO:tasks.workunit.client.0.smithi144.stdout: "index_pool": "" 2024-06-04T16:01:16.625 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.625 INFO:tasks.workunit.client.0.smithi144.stdout: }, 2024-06-04T16:01:16.625 INFO:tasks.workunit.client.0.smithi144.stdout: "key": { 2024-06-04T16:01:16.626 INFO:tasks.workunit.client.0.smithi144.stdout: "name": "_myobj_", 2024-06-04T16:01:16.626 INFO:tasks.workunit.client.0.smithi144.stdout: "instance": "", 2024-06-04T16:01:16.626 INFO:tasks.workunit.client.0.smithi144.stdout: "ns": "ns" 2024-06-04T16:01:16.626 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.626 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.626 INFO:tasks.workunit.client.0.smithi144.stdout:} 2024-06-04T16:01:16.626 INFO:tasks.workunit.client.0.smithi144.stdout:{ 2024-06-04T16:01:16.626 INFO:tasks.workunit.client.0.smithi144.stdout: "raw_obj": { 2024-06-04T16:01:16.626 INFO:tasks.workunit.client.0.smithi144.stdout: "pool": "default-placement.data", 2024-06-04T16:01:16.626 INFO:tasks.workunit.client.0.smithi144.stdout: "oid": "marker__ns__myobj_", 2024-06-04T16:01:16.626 INFO:tasks.workunit.client.0.smithi144.stdout: "loc": "" 2024-06-04T16:01:16.626 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.626 INFO:tasks.workunit.client.0.smithi144.stdout:} 2024-06-04T16:01:16.627 INFO:tasks.workunit.client.0.smithi144.stdout:{ 2024-06-04T16:01:16.627 INFO:tasks.workunit.client.0.smithi144.stdout: "new_obj": { 2024-06-04T16:01:16.627 INFO:tasks.workunit.client.0.smithi144.stdout: "bucket": { 2024-06-04T16:01:16.627 INFO:tasks.workunit.client.0.smithi144.stdout: "name": "test", 2024-06-04T16:01:16.627 INFO:tasks.workunit.client.0.smithi144.stdout: "marker": "marker", 2024-06-04T16:01:16.627 INFO:tasks.workunit.client.0.smithi144.stdout: "bucket_id": "bucket-id", 2024-06-04T16:01:16.627 INFO:tasks.workunit.client.0.smithi144.stdout: "tenant": "", 2024-06-04T16:01:16.627 INFO:tasks.workunit.client.0.smithi144.stdout: "explicit_placement": { 2024-06-04T16:01:16.627 INFO:tasks.workunit.client.0.smithi144.stdout: "data_pool": "", 2024-06-04T16:01:16.627 INFO:tasks.workunit.client.0.smithi144.stdout: "data_extra_pool": "", 2024-06-04T16:01:16.627 INFO:tasks.workunit.client.0.smithi144.stdout: "index_pool": "" 2024-06-04T16:01:16.627 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.627 INFO:tasks.workunit.client.0.smithi144.stdout: }, 2024-06-04T16:01:16.627 INFO:tasks.workunit.client.0.smithi144.stdout: "key": { 2024-06-04T16:01:16.628 INFO:tasks.workunit.client.0.smithi144.stdout: "name": "_myobj_", 2024-06-04T16:01:16.628 INFO:tasks.workunit.client.0.smithi144.stdout: "instance": "", 2024-06-04T16:01:16.628 INFO:tasks.workunit.client.0.smithi144.stdout: "ns": "ns" 2024-06-04T16:01:16.628 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.628 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.628 INFO:tasks.workunit.client.0.smithi144.stdout:} 2024-06-04T16:01:16.628 INFO:tasks.workunit.client.0.smithi144.stdout:{ 2024-06-04T16:01:16.628 INFO:tasks.workunit.client.0.smithi144.stdout: "bucket": { 2024-06-04T16:01:16.628 INFO:tasks.workunit.client.0.smithi144.stdout: "name": "ebtest", 2024-06-04T16:01:16.628 INFO:tasks.workunit.client.0.smithi144.stdout: "marker": "marker", 2024-06-04T16:01:16.628 INFO:tasks.workunit.client.0.smithi144.stdout: "bucket_id": "bucket-id", 2024-06-04T16:01:16.628 INFO:tasks.workunit.client.0.smithi144.stdout: "tenant": "", 2024-06-04T16:01:16.628 INFO:tasks.workunit.client.0.smithi144.stdout: "explicit_placement": { 2024-06-04T16:01:16.628 INFO:tasks.workunit.client.0.smithi144.stdout: "data_pool": ".data-pool", 2024-06-04T16:01:16.629 INFO:tasks.workunit.client.0.smithi144.stdout: "data_extra_pool": "", 2024-06-04T16:01:16.629 INFO:tasks.workunit.client.0.smithi144.stdout: "index_pool": ".index-pool" 2024-06-04T16:01:16.629 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.629 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.629 INFO:tasks.workunit.client.0.smithi144.stdout:} 2024-06-04T16:01:16.629 INFO:tasks.workunit.client.0.smithi144.stdout:{ 2024-06-04T16:01:16.629 INFO:tasks.workunit.client.0.smithi144.stdout: "obj": { 2024-06-04T16:01:16.629 INFO:tasks.workunit.client.0.smithi144.stdout: "bucket": { 2024-06-04T16:01:16.629 INFO:tasks.workunit.client.0.smithi144.stdout: "name": "ebtest", 2024-06-04T16:01:16.629 INFO:tasks.workunit.client.0.smithi144.stdout: "marker": "marker", 2024-06-04T16:01:16.629 INFO:tasks.workunit.client.0.smithi144.stdout: "bucket_id": "bucket-id", 2024-06-04T16:01:16.629 INFO:tasks.workunit.client.0.smithi144.stdout: "tenant": "", 2024-06-04T16:01:16.629 INFO:tasks.workunit.client.0.smithi144.stdout: "explicit_placement": { 2024-06-04T16:01:16.629 INFO:tasks.workunit.client.0.smithi144.stdout: "data_pool": ".data-pool", 2024-06-04T16:01:16.630 INFO:tasks.workunit.client.0.smithi144.stdout: "data_extra_pool": "", 2024-06-04T16:01:16.630 INFO:tasks.workunit.client.0.smithi144.stdout: "index_pool": ".index-pool" 2024-06-04T16:01:16.630 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.630 INFO:tasks.workunit.client.0.smithi144.stdout: }, 2024-06-04T16:01:16.630 INFO:tasks.workunit.client.0.smithi144.stdout: "key": { 2024-06-04T16:01:16.630 INFO:tasks.workunit.client.0.smithi144.stdout: "name": "_myobj_", 2024-06-04T16:01:16.630 INFO:tasks.workunit.client.0.smithi144.stdout: "instance": "", 2024-06-04T16:01:16.630 INFO:tasks.workunit.client.0.smithi144.stdout: "ns": "ns" 2024-06-04T16:01:16.630 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.630 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.630 INFO:tasks.workunit.client.0.smithi144.stdout:} 2024-06-04T16:01:16.631 INFO:tasks.workunit.client.0.smithi144.stdout:{ 2024-06-04T16:01:16.631 INFO:tasks.workunit.client.0.smithi144.stdout: "raw_obj": { 2024-06-04T16:01:16.631 INFO:tasks.workunit.client.0.smithi144.stdout: "pool": ".data-pool", 2024-06-04T16:01:16.631 INFO:tasks.workunit.client.0.smithi144.stdout: "oid": "marker__ns__myobj_", 2024-06-04T16:01:16.631 INFO:tasks.workunit.client.0.smithi144.stdout: "loc": "" 2024-06-04T16:01:16.631 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.631 INFO:tasks.workunit.client.0.smithi144.stdout:} 2024-06-04T16:01:16.631 INFO:tasks.workunit.client.0.smithi144.stdout:{ 2024-06-04T16:01:16.631 INFO:tasks.workunit.client.0.smithi144.stdout: "new_obj": { 2024-06-04T16:01:16.631 INFO:tasks.workunit.client.0.smithi144.stdout: "bucket": { 2024-06-04T16:01:16.631 INFO:tasks.workunit.client.0.smithi144.stdout: "name": "ebtest", 2024-06-04T16:01:16.631 INFO:tasks.workunit.client.0.smithi144.stdout: "marker": "marker", 2024-06-04T16:01:16.631 INFO:tasks.workunit.client.0.smithi144.stdout: "bucket_id": "bucket-id", 2024-06-04T16:01:16.631 INFO:tasks.workunit.client.0.smithi144.stdout: "tenant": "", 2024-06-04T16:01:16.632 INFO:tasks.workunit.client.0.smithi144.stdout: "explicit_placement": { 2024-06-04T16:01:16.632 INFO:tasks.workunit.client.0.smithi144.stdout: "data_pool": ".data-pool", 2024-06-04T16:01:16.632 INFO:tasks.workunit.client.0.smithi144.stdout: "data_extra_pool": "", 2024-06-04T16:01:16.632 INFO:tasks.workunit.client.0.smithi144.stdout: "index_pool": ".index-pool" 2024-06-04T16:01:16.632 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.632 INFO:tasks.workunit.client.0.smithi144.stdout: }, 2024-06-04T16:01:16.632 INFO:tasks.workunit.client.0.smithi144.stdout: "key": { 2024-06-04T16:01:16.632 INFO:tasks.workunit.client.0.smithi144.stdout: "name": "_myobj_", 2024-06-04T16:01:16.632 INFO:tasks.workunit.client.0.smithi144.stdout: "instance": "", 2024-06-04T16:01:16.632 INFO:tasks.workunit.client.0.smithi144.stdout: "ns": "ns" 2024-06-04T16:01:16.632 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.632 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.632 INFO:tasks.workunit.client.0.smithi144.stdout:} 2024-06-04T16:01:16.632 INFO:tasks.workunit.client.0.smithi144.stdout:{ 2024-06-04T16:01:16.633 INFO:tasks.workunit.client.0.smithi144.stdout: "bucket": { 2024-06-04T16:01:16.633 INFO:tasks.workunit.client.0.smithi144.stdout: "name": "test", 2024-06-04T16:01:16.633 INFO:tasks.workunit.client.0.smithi144.stdout: "marker": "marker", 2024-06-04T16:01:16.633 INFO:tasks.workunit.client.0.smithi144.stdout: "bucket_id": "bucket-id", 2024-06-04T16:01:16.633 INFO:tasks.workunit.client.0.smithi144.stdout: "tenant": "", 2024-06-04T16:01:16.633 INFO:tasks.workunit.client.0.smithi144.stdout: "explicit_placement": { 2024-06-04T16:01:16.633 INFO:tasks.workunit.client.0.smithi144.stdout: "data_pool": "", 2024-06-04T16:01:16.633 INFO:tasks.workunit.client.0.smithi144.stdout: "data_extra_pool": "", 2024-06-04T16:01:16.633 INFO:tasks.workunit.client.0.smithi144.stdout: "index_pool": "" 2024-06-04T16:01:16.633 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.633 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.633 INFO:tasks.workunit.client.0.smithi144.stdout:} 2024-06-04T16:01:16.633 INFO:tasks.workunit.client.0.smithi144.stdout:{ 2024-06-04T16:01:16.633 INFO:tasks.workunit.client.0.smithi144.stdout: "obj": { 2024-06-04T16:01:16.634 INFO:tasks.workunit.client.0.smithi144.stdout: "bucket": { 2024-06-04T16:01:16.634 INFO:tasks.workunit.client.0.smithi144.stdout: "name": "test", 2024-06-04T16:01:16.634 INFO:tasks.workunit.client.0.smithi144.stdout: "marker": "marker", 2024-06-04T16:01:16.634 INFO:tasks.workunit.client.0.smithi144.stdout: "bucket_id": "bucket-id", 2024-06-04T16:01:16.634 INFO:tasks.workunit.client.0.smithi144.stdout: "tenant": "", 2024-06-04T16:01:16.634 INFO:tasks.workunit.client.0.smithi144.stdout: "explicit_placement": { 2024-06-04T16:01:16.634 INFO:tasks.workunit.client.0.smithi144.stdout: "data_pool": "", 2024-06-04T16:01:16.634 INFO:tasks.workunit.client.0.smithi144.stdout: "data_extra_pool": "", 2024-06-04T16:01:16.634 INFO:tasks.workunit.client.0.smithi144.stdout: "index_pool": "" 2024-06-04T16:01:16.634 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.634 INFO:tasks.workunit.client.0.smithi144.stdout: }, 2024-06-04T16:01:16.634 INFO:tasks.workunit.client.0.smithi144.stdout: "key": { 2024-06-04T16:01:16.634 INFO:tasks.workunit.client.0.smithi144.stdout: "name": "_myobj_", 2024-06-04T16:01:16.634 INFO:tasks.workunit.client.0.smithi144.stdout: "instance": "inst", 2024-06-04T16:01:16.635 INFO:tasks.workunit.client.0.smithi144.stdout: "ns": "" 2024-06-04T16:01:16.635 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.635 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.635 INFO:tasks.workunit.client.0.smithi144.stdout:} 2024-06-04T16:01:16.635 INFO:tasks.workunit.client.0.smithi144.stdout:{ 2024-06-04T16:01:16.635 INFO:tasks.workunit.client.0.smithi144.stdout: "raw_obj": { 2024-06-04T16:01:16.635 INFO:tasks.workunit.client.0.smithi144.stdout: "pool": "default-placement.data", 2024-06-04T16:01:16.635 INFO:tasks.workunit.client.0.smithi144.stdout: "oid": "marker__:inst__myobj_", 2024-06-04T16:01:16.635 INFO:tasks.workunit.client.0.smithi144.stdout: "loc": "marker__myobj_" 2024-06-04T16:01:16.635 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.635 INFO:tasks.workunit.client.0.smithi144.stdout:} 2024-06-04T16:01:16.635 INFO:tasks.workunit.client.0.smithi144.stdout:{ 2024-06-04T16:01:16.635 INFO:tasks.workunit.client.0.smithi144.stdout: "new_obj": { 2024-06-04T16:01:16.635 INFO:tasks.workunit.client.0.smithi144.stdout: "bucket": { 2024-06-04T16:01:16.636 INFO:tasks.workunit.client.0.smithi144.stdout: "name": "test", 2024-06-04T16:01:16.636 INFO:tasks.workunit.client.0.smithi144.stdout: "marker": "marker", 2024-06-04T16:01:16.636 INFO:tasks.workunit.client.0.smithi144.stdout: "bucket_id": "bucket-id", 2024-06-04T16:01:16.636 INFO:tasks.workunit.client.0.smithi144.stdout: "tenant": "", 2024-06-04T16:01:16.636 INFO:tasks.workunit.client.0.smithi144.stdout: "explicit_placement": { 2024-06-04T16:01:16.636 INFO:tasks.workunit.client.0.smithi144.stdout: "data_pool": "", 2024-06-04T16:01:16.636 INFO:tasks.workunit.client.0.smithi144.stdout: "data_extra_pool": "", 2024-06-04T16:01:16.636 INFO:tasks.workunit.client.0.smithi144.stdout: "index_pool": "" 2024-06-04T16:01:16.636 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.636 INFO:tasks.workunit.client.0.smithi144.stdout: }, 2024-06-04T16:01:16.636 INFO:tasks.workunit.client.0.smithi144.stdout: "key": { 2024-06-04T16:01:16.636 INFO:tasks.workunit.client.0.smithi144.stdout: "name": "_myobj_", 2024-06-04T16:01:16.636 INFO:tasks.workunit.client.0.smithi144.stdout: "instance": "inst", 2024-06-04T16:01:16.636 INFO:tasks.workunit.client.0.smithi144.stdout: "ns": "" 2024-06-04T16:01:16.637 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.637 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.637 INFO:tasks.workunit.client.0.smithi144.stdout:} 2024-06-04T16:01:16.637 INFO:tasks.workunit.client.0.smithi144.stdout:{ 2024-06-04T16:01:16.637 INFO:tasks.workunit.client.0.smithi144.stdout: "bucket": { 2024-06-04T16:01:16.637 INFO:tasks.workunit.client.0.smithi144.stdout: "name": "ebtest", 2024-06-04T16:01:16.637 INFO:tasks.workunit.client.0.smithi144.stdout: "marker": "marker", 2024-06-04T16:01:16.637 INFO:tasks.workunit.client.0.smithi144.stdout: "bucket_id": "bucket-id", 2024-06-04T16:01:16.637 INFO:tasks.workunit.client.0.smithi144.stdout: "tenant": "", 2024-06-04T16:01:16.637 INFO:tasks.workunit.client.0.smithi144.stdout: "explicit_placement": { 2024-06-04T16:01:16.637 INFO:tasks.workunit.client.0.smithi144.stdout: "data_pool": ".data-pool", 2024-06-04T16:01:16.637 INFO:tasks.workunit.client.0.smithi144.stdout: "data_extra_pool": "", 2024-06-04T16:01:16.637 INFO:tasks.workunit.client.0.smithi144.stdout: "index_pool": ".index-pool" 2024-06-04T16:01:16.637 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.637 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.638 INFO:tasks.workunit.client.0.smithi144.stdout:} 2024-06-04T16:01:16.638 INFO:tasks.workunit.client.0.smithi144.stdout:{ 2024-06-04T16:01:16.638 INFO:tasks.workunit.client.0.smithi144.stdout: "obj": { 2024-06-04T16:01:16.638 INFO:tasks.workunit.client.0.smithi144.stdout: "bucket": { 2024-06-04T16:01:16.638 INFO:tasks.workunit.client.0.smithi144.stdout: "name": "ebtest", 2024-06-04T16:01:16.638 INFO:tasks.workunit.client.0.smithi144.stdout: "marker": "marker", 2024-06-04T16:01:16.638 INFO:tasks.workunit.client.0.smithi144.stdout: "bucket_id": "bucket-id", 2024-06-04T16:01:16.638 INFO:tasks.workunit.client.0.smithi144.stdout: "tenant": "", 2024-06-04T16:01:16.638 INFO:tasks.workunit.client.0.smithi144.stdout: "explicit_placement": { 2024-06-04T16:01:16.638 INFO:tasks.workunit.client.0.smithi144.stdout: "data_pool": ".data-pool", 2024-06-04T16:01:16.638 INFO:tasks.workunit.client.0.smithi144.stdout: "data_extra_pool": "", 2024-06-04T16:01:16.638 INFO:tasks.workunit.client.0.smithi144.stdout: "index_pool": ".index-pool" 2024-06-04T16:01:16.638 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.639 INFO:tasks.workunit.client.0.smithi144.stdout: }, 2024-06-04T16:01:16.639 INFO:tasks.workunit.client.0.smithi144.stdout: "key": { 2024-06-04T16:01:16.639 INFO:tasks.workunit.client.0.smithi144.stdout: "name": "_myobj_", 2024-06-04T16:01:16.639 INFO:tasks.workunit.client.0.smithi144.stdout: "instance": "inst", 2024-06-04T16:01:16.639 INFO:tasks.workunit.client.0.smithi144.stdout: "ns": "" 2024-06-04T16:01:16.639 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.639 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.639 INFO:tasks.workunit.client.0.smithi144.stdout:} 2024-06-04T16:01:16.639 INFO:tasks.workunit.client.0.smithi144.stdout:{ 2024-06-04T16:01:16.639 INFO:tasks.workunit.client.0.smithi144.stdout: "raw_obj": { 2024-06-04T16:01:16.639 INFO:tasks.workunit.client.0.smithi144.stdout: "pool": ".data-pool", 2024-06-04T16:01:16.639 INFO:tasks.workunit.client.0.smithi144.stdout: "oid": "marker__:inst__myobj_", 2024-06-04T16:01:16.639 INFO:tasks.workunit.client.0.smithi144.stdout: "loc": "marker__myobj_" 2024-06-04T16:01:16.639 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.639 INFO:tasks.workunit.client.0.smithi144.stdout:} 2024-06-04T16:01:16.640 INFO:tasks.workunit.client.0.smithi144.stdout:{ 2024-06-04T16:01:16.640 INFO:tasks.workunit.client.0.smithi144.stdout: "new_obj": { 2024-06-04T16:01:16.640 INFO:tasks.workunit.client.0.smithi144.stdout: "bucket": { 2024-06-04T16:01:16.640 INFO:tasks.workunit.client.0.smithi144.stdout: "name": "ebtest", 2024-06-04T16:01:16.640 INFO:tasks.workunit.client.0.smithi144.stdout: "marker": "marker", 2024-06-04T16:01:16.640 INFO:tasks.workunit.client.0.smithi144.stdout: "bucket_id": "bucket-id", 2024-06-04T16:01:16.640 INFO:tasks.workunit.client.0.smithi144.stdout: "tenant": "", 2024-06-04T16:01:16.640 INFO:tasks.workunit.client.0.smithi144.stdout: "explicit_placement": { 2024-06-04T16:01:16.640 INFO:tasks.workunit.client.0.smithi144.stdout: "data_pool": ".data-pool", 2024-06-04T16:01:16.640 INFO:tasks.workunit.client.0.smithi144.stdout: "data_extra_pool": "", 2024-06-04T16:01:16.640 INFO:tasks.workunit.client.0.smithi144.stdout: "index_pool": ".index-pool" 2024-06-04T16:01:16.640 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.640 INFO:tasks.workunit.client.0.smithi144.stdout: }, 2024-06-04T16:01:16.640 INFO:tasks.workunit.client.0.smithi144.stdout: "key": { 2024-06-04T16:01:16.641 INFO:tasks.workunit.client.0.smithi144.stdout: "name": "_myobj_", 2024-06-04T16:01:16.641 INFO:tasks.workunit.client.0.smithi144.stdout: "instance": "inst", 2024-06-04T16:01:16.641 INFO:tasks.workunit.client.0.smithi144.stdout: "ns": "" 2024-06-04T16:01:16.641 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.641 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.641 INFO:tasks.workunit.client.0.smithi144.stdout:} 2024-06-04T16:01:16.641 INFO:tasks.workunit.client.0.smithi144.stdout:{ 2024-06-04T16:01:16.641 INFO:tasks.workunit.client.0.smithi144.stdout: "bucket": { 2024-06-04T16:01:16.641 INFO:tasks.workunit.client.0.smithi144.stdout: "name": "test", 2024-06-04T16:01:16.641 INFO:tasks.workunit.client.0.smithi144.stdout: "marker": "marker", 2024-06-04T16:01:16.641 INFO:tasks.workunit.client.0.smithi144.stdout: "bucket_id": "bucket-id", 2024-06-04T16:01:16.641 INFO:tasks.workunit.client.0.smithi144.stdout: "tenant": "", 2024-06-04T16:01:16.641 INFO:tasks.workunit.client.0.smithi144.stdout: "explicit_placement": { 2024-06-04T16:01:16.641 INFO:tasks.workunit.client.0.smithi144.stdout: "data_pool": "", 2024-06-04T16:01:16.642 INFO:tasks.workunit.client.0.smithi144.stdout: "data_extra_pool": "", 2024-06-04T16:01:16.642 INFO:tasks.workunit.client.0.smithi144.stdout: "index_pool": "" 2024-06-04T16:01:16.642 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.642 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.642 INFO:tasks.workunit.client.0.smithi144.stdout:} 2024-06-04T16:01:16.642 INFO:tasks.workunit.client.0.smithi144.stdout:{ 2024-06-04T16:01:16.642 INFO:tasks.workunit.client.0.smithi144.stdout: "obj": { 2024-06-04T16:01:16.642 INFO:tasks.workunit.client.0.smithi144.stdout: "bucket": { 2024-06-04T16:01:16.642 INFO:tasks.workunit.client.0.smithi144.stdout: "name": "test", 2024-06-04T16:01:16.642 INFO:tasks.workunit.client.0.smithi144.stdout: "marker": "marker", 2024-06-04T16:01:16.642 INFO:tasks.workunit.client.0.smithi144.stdout: "bucket_id": "bucket-id", 2024-06-04T16:01:16.642 INFO:tasks.workunit.client.0.smithi144.stdout: "tenant": "", 2024-06-04T16:01:16.642 INFO:tasks.workunit.client.0.smithi144.stdout: "explicit_placement": { 2024-06-04T16:01:16.642 INFO:tasks.workunit.client.0.smithi144.stdout: "data_pool": "", 2024-06-04T16:01:16.643 INFO:tasks.workunit.client.0.smithi144.stdout: "data_extra_pool": "", 2024-06-04T16:01:16.643 INFO:tasks.workunit.client.0.smithi144.stdout: "index_pool": "" 2024-06-04T16:01:16.643 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.643 INFO:tasks.workunit.client.0.smithi144.stdout: }, 2024-06-04T16:01:16.643 INFO:tasks.workunit.client.0.smithi144.stdout: "key": { 2024-06-04T16:01:16.643 INFO:tasks.workunit.client.0.smithi144.stdout: "name": "_myobj_", 2024-06-04T16:01:16.643 INFO:tasks.workunit.client.0.smithi144.stdout: "instance": "inst", 2024-06-04T16:01:16.643 INFO:tasks.workunit.client.0.smithi144.stdout: "ns": "ns" 2024-06-04T16:01:16.643 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.643 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.643 INFO:tasks.workunit.client.0.smithi144.stdout:} 2024-06-04T16:01:16.643 INFO:tasks.workunit.client.0.smithi144.stdout:{ 2024-06-04T16:01:16.643 INFO:tasks.workunit.client.0.smithi144.stdout: "raw_obj": { 2024-06-04T16:01:16.643 INFO:tasks.workunit.client.0.smithi144.stdout: "pool": "default-placement.data", 2024-06-04T16:01:16.644 INFO:tasks.workunit.client.0.smithi144.stdout: "oid": "marker__ns:inst__myobj_", 2024-06-04T16:01:16.644 INFO:tasks.workunit.client.0.smithi144.stdout: "loc": "" 2024-06-04T16:01:16.644 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.644 INFO:tasks.workunit.client.0.smithi144.stdout:} 2024-06-04T16:01:16.644 INFO:tasks.workunit.client.0.smithi144.stdout:{ 2024-06-04T16:01:16.644 INFO:tasks.workunit.client.0.smithi144.stdout: "new_obj": { 2024-06-04T16:01:16.644 INFO:tasks.workunit.client.0.smithi144.stdout: "bucket": { 2024-06-04T16:01:16.644 INFO:tasks.workunit.client.0.smithi144.stdout: "name": "test", 2024-06-04T16:01:16.644 INFO:tasks.workunit.client.0.smithi144.stdout: "marker": "marker", 2024-06-04T16:01:16.644 INFO:tasks.workunit.client.0.smithi144.stdout: "bucket_id": "bucket-id", 2024-06-04T16:01:16.644 INFO:tasks.workunit.client.0.smithi144.stdout: "tenant": "", 2024-06-04T16:01:16.644 INFO:tasks.workunit.client.0.smithi144.stdout: "explicit_placement": { 2024-06-04T16:01:16.644 INFO:tasks.workunit.client.0.smithi144.stdout: "data_pool": "", 2024-06-04T16:01:16.645 INFO:tasks.workunit.client.0.smithi144.stdout: "data_extra_pool": "", 2024-06-04T16:01:16.645 INFO:tasks.workunit.client.0.smithi144.stdout: "index_pool": "" 2024-06-04T16:01:16.645 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.645 INFO:tasks.workunit.client.0.smithi144.stdout: }, 2024-06-04T16:01:16.645 INFO:tasks.workunit.client.0.smithi144.stdout: "key": { 2024-06-04T16:01:16.645 INFO:tasks.workunit.client.0.smithi144.stdout: "name": "_myobj_", 2024-06-04T16:01:16.645 INFO:tasks.workunit.client.0.smithi144.stdout: "instance": "inst", 2024-06-04T16:01:16.645 INFO:tasks.workunit.client.0.smithi144.stdout: "ns": "ns" 2024-06-04T16:01:16.645 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.645 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.645 INFO:tasks.workunit.client.0.smithi144.stdout:} 2024-06-04T16:01:16.645 INFO:tasks.workunit.client.0.smithi144.stdout:{ 2024-06-04T16:01:16.645 INFO:tasks.workunit.client.0.smithi144.stdout: "bucket": { 2024-06-04T16:01:16.646 INFO:tasks.workunit.client.0.smithi144.stdout: "name": "ebtest", 2024-06-04T16:01:16.646 INFO:tasks.workunit.client.0.smithi144.stdout: "marker": "marker", 2024-06-04T16:01:16.646 INFO:tasks.workunit.client.0.smithi144.stdout: "bucket_id": "bucket-id", 2024-06-04T16:01:16.646 INFO:tasks.workunit.client.0.smithi144.stdout: "tenant": "", 2024-06-04T16:01:16.646 INFO:tasks.workunit.client.0.smithi144.stdout: "explicit_placement": { 2024-06-04T16:01:16.646 INFO:tasks.workunit.client.0.smithi144.stdout: "data_pool": ".data-pool", 2024-06-04T16:01:16.646 INFO:tasks.workunit.client.0.smithi144.stdout: "data_extra_pool": "", 2024-06-04T16:01:16.646 INFO:tasks.workunit.client.0.smithi144.stdout: "index_pool": ".index-pool" 2024-06-04T16:01:16.646 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.646 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.646 INFO:tasks.workunit.client.0.smithi144.stdout:} 2024-06-04T16:01:16.646 INFO:tasks.workunit.client.0.smithi144.stdout:{ 2024-06-04T16:01:16.646 INFO:tasks.workunit.client.0.smithi144.stdout: "obj": { 2024-06-04T16:01:16.647 INFO:tasks.workunit.client.0.smithi144.stdout: "bucket": { 2024-06-04T16:01:16.647 INFO:tasks.workunit.client.0.smithi144.stdout: "name": "ebtest", 2024-06-04T16:01:16.647 INFO:tasks.workunit.client.0.smithi144.stdout: "marker": "marker", 2024-06-04T16:01:16.647 INFO:tasks.workunit.client.0.smithi144.stdout: "bucket_id": "bucket-id", 2024-06-04T16:01:16.647 INFO:tasks.workunit.client.0.smithi144.stdout: "tenant": "", 2024-06-04T16:01:16.647 INFO:tasks.workunit.client.0.smithi144.stdout: "explicit_placement": { 2024-06-04T16:01:16.647 INFO:tasks.workunit.client.0.smithi144.stdout: "data_pool": ".data-pool", 2024-06-04T16:01:16.647 INFO:tasks.workunit.client.0.smithi144.stdout: "data_extra_pool": "", 2024-06-04T16:01:16.647 INFO:tasks.workunit.client.0.smithi144.stdout: "index_pool": ".index-pool" 2024-06-04T16:01:16.647 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.647 INFO:tasks.workunit.client.0.smithi144.stdout: }, 2024-06-04T16:01:16.647 INFO:tasks.workunit.client.0.smithi144.stdout: "key": { 2024-06-04T16:01:16.647 INFO:tasks.workunit.client.0.smithi144.stdout: "name": "_myobj_", 2024-06-04T16:01:16.647 INFO:tasks.workunit.client.0.smithi144.stdout: "instance": "inst", 2024-06-04T16:01:16.647 INFO:tasks.workunit.client.0.smithi144.stdout: "ns": "ns" 2024-06-04T16:01:16.648 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.648 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.648 INFO:tasks.workunit.client.0.smithi144.stdout:} 2024-06-04T16:01:16.648 INFO:tasks.workunit.client.0.smithi144.stdout:{ 2024-06-04T16:01:16.648 INFO:tasks.workunit.client.0.smithi144.stdout: "raw_obj": { 2024-06-04T16:01:16.648 INFO:tasks.workunit.client.0.smithi144.stdout: "pool": ".data-pool", 2024-06-04T16:01:16.648 INFO:tasks.workunit.client.0.smithi144.stdout: "oid": "marker__ns:inst__myobj_", 2024-06-04T16:01:16.648 INFO:tasks.workunit.client.0.smithi144.stdout: "loc": "" 2024-06-04T16:01:16.648 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.648 INFO:tasks.workunit.client.0.smithi144.stdout:} 2024-06-04T16:01:16.648 INFO:tasks.workunit.client.0.smithi144.stdout:{ 2024-06-04T16:01:16.648 INFO:tasks.workunit.client.0.smithi144.stdout: "new_obj": { 2024-06-04T16:01:16.648 INFO:tasks.workunit.client.0.smithi144.stdout: "bucket": { 2024-06-04T16:01:16.648 INFO:tasks.workunit.client.0.smithi144.stdout: "name": "ebtest", 2024-06-04T16:01:16.649 INFO:tasks.workunit.client.0.smithi144.stdout: "marker": "marker", 2024-06-04T16:01:16.649 INFO:tasks.workunit.client.0.smithi144.stdout: "bucket_id": "bucket-id", 2024-06-04T16:01:16.649 INFO:tasks.workunit.client.0.smithi144.stdout: "tenant": "", 2024-06-04T16:01:16.649 INFO:tasks.workunit.client.0.smithi144.stdout: "explicit_placement": { 2024-06-04T16:01:16.649 INFO:tasks.workunit.client.0.smithi144.stdout: "data_pool": ".data-pool", 2024-06-04T16:01:16.649 INFO:tasks.workunit.client.0.smithi144.stdout: "data_extra_pool": "", 2024-06-04T16:01:16.649 INFO:tasks.workunit.client.0.smithi144.stdout: "index_pool": ".index-pool" 2024-06-04T16:01:16.649 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.649 INFO:tasks.workunit.client.0.smithi144.stdout: }, 2024-06-04T16:01:16.649 INFO:tasks.workunit.client.0.smithi144.stdout: "key": { 2024-06-04T16:01:16.649 INFO:tasks.workunit.client.0.smithi144.stdout: "name": "_myobj_", 2024-06-04T16:01:16.649 INFO:tasks.workunit.client.0.smithi144.stdout: "instance": "inst", 2024-06-04T16:01:16.649 INFO:tasks.workunit.client.0.smithi144.stdout: "ns": "ns" 2024-06-04T16:01:16.649 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.649 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.650 INFO:tasks.workunit.client.0.smithi144.stdout:} 2024-06-04T16:01:16.650 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] TestRGWObj.obj_to_raw (1 ms) 2024-06-04T16:01:16.650 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] TestRGWObj.old_to_raw 2024-06-04T16:01:16.650 INFO:tasks.workunit.client.0.smithi144.stdout:{ 2024-06-04T16:01:16.650 INFO:tasks.workunit.client.0.smithi144.stdout: "raw_obj": { 2024-06-04T16:01:16.650 INFO:tasks.workunit.client.0.smithi144.stdout: "pool": ".data-pool", 2024-06-04T16:01:16.650 INFO:tasks.workunit.client.0.smithi144.stdout: "oid": "marker_myobj", 2024-06-04T16:01:16.650 INFO:tasks.workunit.client.0.smithi144.stdout: "loc": "" 2024-06-04T16:01:16.650 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.650 INFO:tasks.workunit.client.0.smithi144.stdout:} 2024-06-04T16:01:16.650 INFO:tasks.workunit.client.0.smithi144.stdout:{ 2024-06-04T16:01:16.650 INFO:tasks.workunit.client.0.smithi144.stdout: "new_obj": { 2024-06-04T16:01:16.650 INFO:tasks.workunit.client.0.smithi144.stdout: "bucket": { 2024-06-04T16:01:16.650 INFO:tasks.workunit.client.0.smithi144.stdout: "name": "ebtest", 2024-06-04T16:01:16.651 INFO:tasks.workunit.client.0.smithi144.stdout: "marker": "marker", 2024-06-04T16:01:16.651 INFO:tasks.workunit.client.0.smithi144.stdout: "bucket_id": "bucket-id", 2024-06-04T16:01:16.651 INFO:tasks.workunit.client.0.smithi144.stdout: "tenant": "", 2024-06-04T16:01:16.651 INFO:tasks.workunit.client.0.smithi144.stdout: "explicit_placement": { 2024-06-04T16:01:16.651 INFO:tasks.workunit.client.0.smithi144.stdout: "data_pool": ".data-pool", 2024-06-04T16:01:16.651 INFO:tasks.workunit.client.0.smithi144.stdout: "data_extra_pool": "", 2024-06-04T16:01:16.651 INFO:tasks.workunit.client.0.smithi144.stdout: "index_pool": ".index-pool" 2024-06-04T16:01:16.651 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.651 INFO:tasks.workunit.client.0.smithi144.stdout: }, 2024-06-04T16:01:16.651 INFO:tasks.workunit.client.0.smithi144.stdout: "key": { 2024-06-04T16:01:16.651 INFO:tasks.workunit.client.0.smithi144.stdout: "name": "myobj", 2024-06-04T16:01:16.651 INFO:tasks.workunit.client.0.smithi144.stdout: "instance": "", 2024-06-04T16:01:16.651 INFO:tasks.workunit.client.0.smithi144.stdout: "ns": "" 2024-06-04T16:01:16.651 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.652 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.652 INFO:tasks.workunit.client.0.smithi144.stdout:} 2024-06-04T16:01:16.652 INFO:tasks.workunit.client.0.smithi144.stdout:raw=.data-pool:marker_myobj 2024-06-04T16:01:16.652 INFO:tasks.workunit.client.0.smithi144.stdout:{ 2024-06-04T16:01:16.652 INFO:tasks.workunit.client.0.smithi144.stdout: "raw_obj2": { 2024-06-04T16:01:16.652 INFO:tasks.workunit.client.0.smithi144.stdout: "pool": ".data-pool", 2024-06-04T16:01:16.652 INFO:tasks.workunit.client.0.smithi144.stdout: "oid": "marker_myobj", 2024-06-04T16:01:16.652 INFO:tasks.workunit.client.0.smithi144.stdout: "loc": "" 2024-06-04T16:01:16.652 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.652 INFO:tasks.workunit.client.0.smithi144.stdout:} 2024-06-04T16:01:16.652 INFO:tasks.workunit.client.0.smithi144.stdout:{ 2024-06-04T16:01:16.652 INFO:tasks.workunit.client.0.smithi144.stdout: "new_obj2": { 2024-06-04T16:01:16.652 INFO:tasks.workunit.client.0.smithi144.stdout: "bucket": { 2024-06-04T16:01:16.652 INFO:tasks.workunit.client.0.smithi144.stdout: "name": "ebtest", 2024-06-04T16:01:16.653 INFO:tasks.workunit.client.0.smithi144.stdout: "marker": "marker", 2024-06-04T16:01:16.653 INFO:tasks.workunit.client.0.smithi144.stdout: "bucket_id": "bucket-id", 2024-06-04T16:01:16.653 INFO:tasks.workunit.client.0.smithi144.stdout: "tenant": "", 2024-06-04T16:01:16.653 INFO:tasks.workunit.client.0.smithi144.stdout: "explicit_placement": { 2024-06-04T16:01:16.653 INFO:tasks.workunit.client.0.smithi144.stdout: "data_pool": ".data-pool", 2024-06-04T16:01:16.653 INFO:tasks.workunit.client.0.smithi144.stdout: "data_extra_pool": "", 2024-06-04T16:01:16.653 INFO:tasks.workunit.client.0.smithi144.stdout: "index_pool": ".index-pool" 2024-06-04T16:01:16.653 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.653 INFO:tasks.workunit.client.0.smithi144.stdout: }, 2024-06-04T16:01:16.653 INFO:tasks.workunit.client.0.smithi144.stdout: "key": { 2024-06-04T16:01:16.653 INFO:tasks.workunit.client.0.smithi144.stdout: "name": "myobj", 2024-06-04T16:01:16.653 INFO:tasks.workunit.client.0.smithi144.stdout: "instance": "", 2024-06-04T16:01:16.653 INFO:tasks.workunit.client.0.smithi144.stdout: "ns": "" 2024-06-04T16:01:16.653 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.653 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.654 INFO:tasks.workunit.client.0.smithi144.stdout:} 2024-06-04T16:01:16.654 INFO:tasks.workunit.client.0.smithi144.stdout:raw2=.data-pool:marker_myobj 2024-06-04T16:01:16.654 INFO:tasks.workunit.client.0.smithi144.stdout:{ 2024-06-04T16:01:16.654 INFO:tasks.workunit.client.0.smithi144.stdout: "raw_obj": { 2024-06-04T16:01:16.654 INFO:tasks.workunit.client.0.smithi144.stdout: "pool": ".data-pool", 2024-06-04T16:01:16.654 INFO:tasks.workunit.client.0.smithi144.stdout: "oid": "marker__ns_myobj", 2024-06-04T16:01:16.654 INFO:tasks.workunit.client.0.smithi144.stdout: "loc": "" 2024-06-04T16:01:16.654 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.654 INFO:tasks.workunit.client.0.smithi144.stdout:} 2024-06-04T16:01:16.654 INFO:tasks.workunit.client.0.smithi144.stdout:{ 2024-06-04T16:01:16.654 INFO:tasks.workunit.client.0.smithi144.stdout: "new_obj": { 2024-06-04T16:01:16.654 INFO:tasks.workunit.client.0.smithi144.stdout: "bucket": { 2024-06-04T16:01:16.654 INFO:tasks.workunit.client.0.smithi144.stdout: "name": "ebtest", 2024-06-04T16:01:16.655 INFO:tasks.workunit.client.0.smithi144.stdout: "marker": "marker", 2024-06-04T16:01:16.655 INFO:tasks.workunit.client.0.smithi144.stdout: "bucket_id": "bucket-id", 2024-06-04T16:01:16.655 INFO:tasks.workunit.client.0.smithi144.stdout: "tenant": "", 2024-06-04T16:01:16.655 INFO:tasks.workunit.client.0.smithi144.stdout: "explicit_placement": { 2024-06-04T16:01:16.655 INFO:tasks.workunit.client.0.smithi144.stdout: "data_pool": ".data-pool", 2024-06-04T16:01:16.655 INFO:tasks.workunit.client.0.smithi144.stdout: "data_extra_pool": "", 2024-06-04T16:01:16.655 INFO:tasks.workunit.client.0.smithi144.stdout: "index_pool": ".index-pool" 2024-06-04T16:01:16.655 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.655 INFO:tasks.workunit.client.0.smithi144.stdout: }, 2024-06-04T16:01:16.655 INFO:tasks.workunit.client.0.smithi144.stdout: "key": { 2024-06-04T16:01:16.656 INFO:tasks.workunit.client.0.smithi144.stdout: "name": "myobj", 2024-06-04T16:01:16.656 INFO:tasks.workunit.client.0.smithi144.stdout: "instance": "", 2024-06-04T16:01:16.656 INFO:tasks.workunit.client.0.smithi144.stdout: "ns": "ns" 2024-06-04T16:01:16.656 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.656 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.656 INFO:tasks.workunit.client.0.smithi144.stdout:} 2024-06-04T16:01:16.656 INFO:tasks.workunit.client.0.smithi144.stdout:raw=.data-pool:marker__ns_myobj 2024-06-04T16:01:16.657 INFO:tasks.workunit.client.0.smithi144.stdout:{ 2024-06-04T16:01:16.657 INFO:tasks.workunit.client.0.smithi144.stdout: "raw_obj2": { 2024-06-04T16:01:16.657 INFO:tasks.workunit.client.0.smithi144.stdout: "pool": ".data-pool", 2024-06-04T16:01:16.657 INFO:tasks.workunit.client.0.smithi144.stdout: "oid": "marker__ns_myobj", 2024-06-04T16:01:16.657 INFO:tasks.workunit.client.0.smithi144.stdout: "loc": "" 2024-06-04T16:01:16.657 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.657 INFO:tasks.workunit.client.0.smithi144.stdout:} 2024-06-04T16:01:16.658 INFO:tasks.workunit.client.0.smithi144.stdout:{ 2024-06-04T16:01:16.658 INFO:tasks.workunit.client.0.smithi144.stdout: "new_obj2": { 2024-06-04T16:01:16.658 INFO:tasks.workunit.client.0.smithi144.stdout: "bucket": { 2024-06-04T16:01:16.658 INFO:tasks.workunit.client.0.smithi144.stdout: "name": "ebtest", 2024-06-04T16:01:16.658 INFO:tasks.workunit.client.0.smithi144.stdout: "marker": "marker", 2024-06-04T16:01:16.658 INFO:tasks.workunit.client.0.smithi144.stdout: "bucket_id": "bucket-id", 2024-06-04T16:01:16.658 INFO:tasks.workunit.client.0.smithi144.stdout: "tenant": "", 2024-06-04T16:01:16.658 INFO:tasks.workunit.client.0.smithi144.stdout: "explicit_placement": { 2024-06-04T16:01:16.658 INFO:tasks.workunit.client.0.smithi144.stdout: "data_pool": ".data-pool", 2024-06-04T16:01:16.658 INFO:tasks.workunit.client.0.smithi144.stdout: "data_extra_pool": "", 2024-06-04T16:01:16.659 INFO:tasks.workunit.client.0.smithi144.stdout: "index_pool": ".index-pool" 2024-06-04T16:01:16.659 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.659 INFO:tasks.workunit.client.0.smithi144.stdout: }, 2024-06-04T16:01:16.659 INFO:tasks.workunit.client.0.smithi144.stdout: "key": { 2024-06-04T16:01:16.659 INFO:tasks.workunit.client.0.smithi144.stdout: "name": "myobj", 2024-06-04T16:01:16.659 INFO:tasks.workunit.client.0.smithi144.stdout: "instance": "", 2024-06-04T16:01:16.659 INFO:tasks.workunit.client.0.smithi144.stdout: "ns": "ns" 2024-06-04T16:01:16.659 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.659 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.659 INFO:tasks.workunit.client.0.smithi144.stdout:} 2024-06-04T16:01:16.660 INFO:tasks.workunit.client.0.smithi144.stdout:raw2=.data-pool:marker__ns_myobj 2024-06-04T16:01:16.660 INFO:tasks.workunit.client.0.smithi144.stdout:{ 2024-06-04T16:01:16.660 INFO:tasks.workunit.client.0.smithi144.stdout: "raw_obj": { 2024-06-04T16:01:16.660 INFO:tasks.workunit.client.0.smithi144.stdout: "pool": ".data-pool", 2024-06-04T16:01:16.660 INFO:tasks.workunit.client.0.smithi144.stdout: "oid": "marker__:inst_myobj", 2024-06-04T16:01:16.660 INFO:tasks.workunit.client.0.smithi144.stdout: "loc": "" 2024-06-04T16:01:16.660 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.660 INFO:tasks.workunit.client.0.smithi144.stdout:} 2024-06-04T16:01:16.660 INFO:tasks.workunit.client.0.smithi144.stdout:{ 2024-06-04T16:01:16.660 INFO:tasks.workunit.client.0.smithi144.stdout: "new_obj": { 2024-06-04T16:01:16.660 INFO:tasks.workunit.client.0.smithi144.stdout: "bucket": { 2024-06-04T16:01:16.660 INFO:tasks.workunit.client.0.smithi144.stdout: "name": "ebtest", 2024-06-04T16:01:16.661 INFO:tasks.workunit.client.0.smithi144.stdout: "marker": "marker", 2024-06-04T16:01:16.661 INFO:tasks.workunit.client.0.smithi144.stdout: "bucket_id": "bucket-id", 2024-06-04T16:01:16.661 INFO:tasks.workunit.client.0.smithi144.stdout: "tenant": "", 2024-06-04T16:01:16.661 INFO:tasks.workunit.client.0.smithi144.stdout: "explicit_placement": { 2024-06-04T16:01:16.661 INFO:tasks.workunit.client.0.smithi144.stdout: "data_pool": ".data-pool", 2024-06-04T16:01:16.661 INFO:tasks.workunit.client.0.smithi144.stdout: "data_extra_pool": "", 2024-06-04T16:01:16.661 INFO:tasks.workunit.client.0.smithi144.stdout: "index_pool": ".index-pool" 2024-06-04T16:01:16.661 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.661 INFO:tasks.workunit.client.0.smithi144.stdout: }, 2024-06-04T16:01:16.661 INFO:tasks.workunit.client.0.smithi144.stdout: "key": { 2024-06-04T16:01:16.661 INFO:tasks.workunit.client.0.smithi144.stdout: "name": "myobj", 2024-06-04T16:01:16.661 INFO:tasks.workunit.client.0.smithi144.stdout: "instance": "inst", 2024-06-04T16:01:16.661 INFO:tasks.workunit.client.0.smithi144.stdout: "ns": "" 2024-06-04T16:01:16.661 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.662 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.662 INFO:tasks.workunit.client.0.smithi144.stdout:} 2024-06-04T16:01:16.662 INFO:tasks.workunit.client.0.smithi144.stdout:raw=.data-pool:marker__:inst_myobj 2024-06-04T16:01:16.662 INFO:tasks.workunit.client.0.smithi144.stdout:{ 2024-06-04T16:01:16.662 INFO:tasks.workunit.client.0.smithi144.stdout: "raw_obj2": { 2024-06-04T16:01:16.662 INFO:tasks.workunit.client.0.smithi144.stdout: "pool": ".data-pool", 2024-06-04T16:01:16.662 INFO:tasks.workunit.client.0.smithi144.stdout: "oid": "marker__:inst_myobj", 2024-06-04T16:01:16.662 INFO:tasks.workunit.client.0.smithi144.stdout: "loc": "" 2024-06-04T16:01:16.662 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.662 INFO:tasks.workunit.client.0.smithi144.stdout:} 2024-06-04T16:01:16.663 INFO:tasks.workunit.client.0.smithi144.stdout:{ 2024-06-04T16:01:16.663 INFO:tasks.workunit.client.0.smithi144.stdout: "new_obj2": { 2024-06-04T16:01:16.663 INFO:tasks.workunit.client.0.smithi144.stdout: "bucket": { 2024-06-04T16:01:16.663 INFO:tasks.workunit.client.0.smithi144.stdout: "name": "ebtest", 2024-06-04T16:01:16.663 INFO:tasks.workunit.client.0.smithi144.stdout: "marker": "marker", 2024-06-04T16:01:16.663 INFO:tasks.workunit.client.0.smithi144.stdout: "bucket_id": "bucket-id", 2024-06-04T16:01:16.663 INFO:tasks.workunit.client.0.smithi144.stdout: "tenant": "", 2024-06-04T16:01:16.663 INFO:tasks.workunit.client.0.smithi144.stdout: "explicit_placement": { 2024-06-04T16:01:16.663 INFO:tasks.workunit.client.0.smithi144.stdout: "data_pool": ".data-pool", 2024-06-04T16:01:16.663 INFO:tasks.workunit.client.0.smithi144.stdout: "data_extra_pool": "", 2024-06-04T16:01:16.663 INFO:tasks.workunit.client.0.smithi144.stdout: "index_pool": ".index-pool" 2024-06-04T16:01:16.664 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.664 INFO:tasks.workunit.client.0.smithi144.stdout: }, 2024-06-04T16:01:16.664 INFO:tasks.workunit.client.0.smithi144.stdout: "key": { 2024-06-04T16:01:16.664 INFO:tasks.workunit.client.0.smithi144.stdout: "name": "myobj", 2024-06-04T16:01:16.664 INFO:tasks.workunit.client.0.smithi144.stdout: "instance": "inst", 2024-06-04T16:01:16.664 INFO:tasks.workunit.client.0.smithi144.stdout: "ns": "" 2024-06-04T16:01:16.664 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.664 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.664 INFO:tasks.workunit.client.0.smithi144.stdout:} 2024-06-04T16:01:16.664 INFO:tasks.workunit.client.0.smithi144.stdout:raw2=.data-pool:marker__:inst_myobj 2024-06-04T16:01:16.664 INFO:tasks.workunit.client.0.smithi144.stdout:{ 2024-06-04T16:01:16.664 INFO:tasks.workunit.client.0.smithi144.stdout: "raw_obj": { 2024-06-04T16:01:16.664 INFO:tasks.workunit.client.0.smithi144.stdout: "pool": ".data-pool", 2024-06-04T16:01:16.665 INFO:tasks.workunit.client.0.smithi144.stdout: "oid": "marker__ns:inst_myobj", 2024-06-04T16:01:16.665 INFO:tasks.workunit.client.0.smithi144.stdout: "loc": "" 2024-06-04T16:01:16.665 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.665 INFO:tasks.workunit.client.0.smithi144.stdout:} 2024-06-04T16:01:16.665 INFO:tasks.workunit.client.0.smithi144.stdout:{ 2024-06-04T16:01:16.665 INFO:tasks.workunit.client.0.smithi144.stdout: "new_obj": { 2024-06-04T16:01:16.665 INFO:tasks.workunit.client.0.smithi144.stdout: "bucket": { 2024-06-04T16:01:16.665 INFO:tasks.workunit.client.0.smithi144.stdout: "name": "ebtest", 2024-06-04T16:01:16.665 INFO:tasks.workunit.client.0.smithi144.stdout: "marker": "marker", 2024-06-04T16:01:16.665 INFO:tasks.workunit.client.0.smithi144.stdout: "bucket_id": "bucket-id", 2024-06-04T16:01:16.665 INFO:tasks.workunit.client.0.smithi144.stdout: "tenant": "", 2024-06-04T16:01:16.665 INFO:tasks.workunit.client.0.smithi144.stdout: "explicit_placement": { 2024-06-04T16:01:16.665 INFO:tasks.workunit.client.0.smithi144.stdout: "data_pool": ".data-pool", 2024-06-04T16:01:16.666 INFO:tasks.workunit.client.0.smithi144.stdout: "data_extra_pool": "", 2024-06-04T16:01:16.666 INFO:tasks.workunit.client.0.smithi144.stdout: "index_pool": ".index-pool" 2024-06-04T16:01:16.666 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.666 INFO:tasks.workunit.client.0.smithi144.stdout: }, 2024-06-04T16:01:16.666 INFO:tasks.workunit.client.0.smithi144.stdout: "key": { 2024-06-04T16:01:16.666 INFO:tasks.workunit.client.0.smithi144.stdout: "name": "myobj", 2024-06-04T16:01:16.666 INFO:tasks.workunit.client.0.smithi144.stdout: "instance": "inst", 2024-06-04T16:01:16.666 INFO:tasks.workunit.client.0.smithi144.stdout: "ns": "ns" 2024-06-04T16:01:16.666 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.666 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.666 INFO:tasks.workunit.client.0.smithi144.stdout:} 2024-06-04T16:01:16.666 INFO:tasks.workunit.client.0.smithi144.stdout:raw=.data-pool:marker__ns:inst_myobj 2024-06-04T16:01:16.666 INFO:tasks.workunit.client.0.smithi144.stdout:{ 2024-06-04T16:01:16.667 INFO:tasks.workunit.client.0.smithi144.stdout: "raw_obj2": { 2024-06-04T16:01:16.667 INFO:tasks.workunit.client.0.smithi144.stdout: "pool": ".data-pool", 2024-06-04T16:01:16.667 INFO:tasks.workunit.client.0.smithi144.stdout: "oid": "marker__ns:inst_myobj", 2024-06-04T16:01:16.667 INFO:tasks.workunit.client.0.smithi144.stdout: "loc": "" 2024-06-04T16:01:16.667 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.667 INFO:tasks.workunit.client.0.smithi144.stdout:} 2024-06-04T16:01:16.667 INFO:tasks.workunit.client.0.smithi144.stdout:{ 2024-06-04T16:01:16.667 INFO:tasks.workunit.client.0.smithi144.stdout: "new_obj2": { 2024-06-04T16:01:16.667 INFO:tasks.workunit.client.0.smithi144.stdout: "bucket": { 2024-06-04T16:01:16.667 INFO:tasks.workunit.client.0.smithi144.stdout: "name": "ebtest", 2024-06-04T16:01:16.667 INFO:tasks.workunit.client.0.smithi144.stdout: "marker": "marker", 2024-06-04T16:01:16.667 INFO:tasks.workunit.client.0.smithi144.stdout: "bucket_id": "bucket-id", 2024-06-04T16:01:16.667 INFO:tasks.workunit.client.0.smithi144.stdout: "tenant": "", 2024-06-04T16:01:16.667 INFO:tasks.workunit.client.0.smithi144.stdout: "explicit_placement": { 2024-06-04T16:01:16.667 INFO:tasks.workunit.client.0.smithi144.stdout: "data_pool": ".data-pool", 2024-06-04T16:01:16.668 INFO:tasks.workunit.client.0.smithi144.stdout: "data_extra_pool": "", 2024-06-04T16:01:16.668 INFO:tasks.workunit.client.0.smithi144.stdout: "index_pool": ".index-pool" 2024-06-04T16:01:16.668 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.668 INFO:tasks.workunit.client.0.smithi144.stdout: }, 2024-06-04T16:01:16.668 INFO:tasks.workunit.client.0.smithi144.stdout: "key": { 2024-06-04T16:01:16.668 INFO:tasks.workunit.client.0.smithi144.stdout: "name": "myobj", 2024-06-04T16:01:16.668 INFO:tasks.workunit.client.0.smithi144.stdout: "instance": "inst", 2024-06-04T16:01:16.668 INFO:tasks.workunit.client.0.smithi144.stdout: "ns": "ns" 2024-06-04T16:01:16.668 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.668 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.668 INFO:tasks.workunit.client.0.smithi144.stdout:} 2024-06-04T16:01:16.668 INFO:tasks.workunit.client.0.smithi144.stdout:raw2=.data-pool:marker__ns:inst_myobj 2024-06-04T16:01:16.668 INFO:tasks.workunit.client.0.smithi144.stdout:{ 2024-06-04T16:01:16.668 INFO:tasks.workunit.client.0.smithi144.stdout: "raw_obj": { 2024-06-04T16:01:16.668 INFO:tasks.workunit.client.0.smithi144.stdout: "pool": ".data-pool", 2024-06-04T16:01:16.669 INFO:tasks.workunit.client.0.smithi144.stdout: "oid": "marker___myobj", 2024-06-04T16:01:16.669 INFO:tasks.workunit.client.0.smithi144.stdout: "loc": "marker__myobj" 2024-06-04T16:01:16.669 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.669 INFO:tasks.workunit.client.0.smithi144.stdout:} 2024-06-04T16:01:16.669 INFO:tasks.workunit.client.0.smithi144.stdout:{ 2024-06-04T16:01:16.669 INFO:tasks.workunit.client.0.smithi144.stdout: "new_obj": { 2024-06-04T16:01:16.669 INFO:tasks.workunit.client.0.smithi144.stdout: "bucket": { 2024-06-04T16:01:16.669 INFO:tasks.workunit.client.0.smithi144.stdout: "name": "ebtest", 2024-06-04T16:01:16.669 INFO:tasks.workunit.client.0.smithi144.stdout: "marker": "marker", 2024-06-04T16:01:16.669 INFO:tasks.workunit.client.0.smithi144.stdout: "bucket_id": "bucket-id", 2024-06-04T16:01:16.670 INFO:tasks.workunit.client.0.smithi144.stdout: "tenant": "", 2024-06-04T16:01:16.670 INFO:tasks.workunit.client.0.smithi144.stdout: "explicit_placement": { 2024-06-04T16:01:16.670 INFO:tasks.workunit.client.0.smithi144.stdout: "data_pool": ".data-pool", 2024-06-04T16:01:16.670 INFO:tasks.workunit.client.0.smithi144.stdout: "data_extra_pool": "", 2024-06-04T16:01:16.670 INFO:tasks.workunit.client.0.smithi144.stdout: "index_pool": ".index-pool" 2024-06-04T16:01:16.670 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.670 INFO:tasks.workunit.client.0.smithi144.stdout: }, 2024-06-04T16:01:16.670 INFO:tasks.workunit.client.0.smithi144.stdout: "key": { 2024-06-04T16:01:16.670 INFO:tasks.workunit.client.0.smithi144.stdout: "name": "_myobj", 2024-06-04T16:01:16.670 INFO:tasks.workunit.client.0.smithi144.stdout: "instance": "", 2024-06-04T16:01:16.671 INFO:tasks.workunit.client.0.smithi144.stdout: "ns": "" 2024-06-04T16:01:16.671 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.671 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.671 INFO:tasks.workunit.client.0.smithi144.stdout:} 2024-06-04T16:01:16.671 INFO:tasks.workunit.client.0.smithi144.stdout:raw=.data-pool:marker___myobj 2024-06-04T16:01:16.671 INFO:tasks.workunit.client.0.smithi144.stdout:{ 2024-06-04T16:01:16.671 INFO:tasks.workunit.client.0.smithi144.stdout: "raw_obj2": { 2024-06-04T16:01:16.672 INFO:tasks.workunit.client.0.smithi144.stdout: "pool": ".data-pool", 2024-06-04T16:01:16.672 INFO:tasks.workunit.client.0.smithi144.stdout: "oid": "marker___myobj", 2024-06-04T16:01:16.672 INFO:tasks.workunit.client.0.smithi144.stdout: "loc": "marker__myobj" 2024-06-04T16:01:16.672 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.672 INFO:tasks.workunit.client.0.smithi144.stdout:} 2024-06-04T16:01:16.672 INFO:tasks.workunit.client.0.smithi144.stdout:{ 2024-06-04T16:01:16.672 INFO:tasks.workunit.client.0.smithi144.stdout: "new_obj2": { 2024-06-04T16:01:16.672 INFO:tasks.workunit.client.0.smithi144.stdout: "bucket": { 2024-06-04T16:01:16.673 INFO:tasks.workunit.client.0.smithi144.stdout: "name": "ebtest", 2024-06-04T16:01:16.673 INFO:tasks.workunit.client.0.smithi144.stdout: "marker": "marker", 2024-06-04T16:01:16.673 INFO:tasks.workunit.client.0.smithi144.stdout: "bucket_id": "bucket-id", 2024-06-04T16:01:16.673 INFO:tasks.workunit.client.0.smithi144.stdout: "tenant": "", 2024-06-04T16:01:16.673 INFO:tasks.workunit.client.0.smithi144.stdout: "explicit_placement": { 2024-06-04T16:01:16.673 INFO:tasks.workunit.client.0.smithi144.stdout: "data_pool": ".data-pool", 2024-06-04T16:01:16.673 INFO:tasks.workunit.client.0.smithi144.stdout: "data_extra_pool": "", 2024-06-04T16:01:16.673 INFO:tasks.workunit.client.0.smithi144.stdout: "index_pool": ".index-pool" 2024-06-04T16:01:16.673 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.673 INFO:tasks.workunit.client.0.smithi144.stdout: }, 2024-06-04T16:01:16.673 INFO:tasks.workunit.client.0.smithi144.stdout: "key": { 2024-06-04T16:01:16.673 INFO:tasks.workunit.client.0.smithi144.stdout: "name": "_myobj", 2024-06-04T16:01:16.673 INFO:tasks.workunit.client.0.smithi144.stdout: "instance": "", 2024-06-04T16:01:16.673 INFO:tasks.workunit.client.0.smithi144.stdout: "ns": "" 2024-06-04T16:01:16.674 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.674 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.674 INFO:tasks.workunit.client.0.smithi144.stdout:} 2024-06-04T16:01:16.674 INFO:tasks.workunit.client.0.smithi144.stdout:raw2=.data-pool:marker___myobj 2024-06-04T16:01:16.674 INFO:tasks.workunit.client.0.smithi144.stdout:{ 2024-06-04T16:01:16.674 INFO:tasks.workunit.client.0.smithi144.stdout: "raw_obj": { 2024-06-04T16:01:16.674 INFO:tasks.workunit.client.0.smithi144.stdout: "pool": ".data-pool", 2024-06-04T16:01:16.674 INFO:tasks.workunit.client.0.smithi144.stdout: "oid": "marker__ns__myobj", 2024-06-04T16:01:16.674 INFO:tasks.workunit.client.0.smithi144.stdout: "loc": "" 2024-06-04T16:01:16.674 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.674 INFO:tasks.workunit.client.0.smithi144.stdout:} 2024-06-04T16:01:16.674 INFO:tasks.workunit.client.0.smithi144.stdout:{ 2024-06-04T16:01:16.674 INFO:tasks.workunit.client.0.smithi144.stdout: "new_obj": { 2024-06-04T16:01:16.675 INFO:tasks.workunit.client.0.smithi144.stdout: "bucket": { 2024-06-04T16:01:16.675 INFO:tasks.workunit.client.0.smithi144.stdout: "name": "ebtest", 2024-06-04T16:01:16.675 INFO:tasks.workunit.client.0.smithi144.stdout: "marker": "marker", 2024-06-04T16:01:16.675 INFO:tasks.workunit.client.0.smithi144.stdout: "bucket_id": "bucket-id", 2024-06-04T16:01:16.675 INFO:tasks.workunit.client.0.smithi144.stdout: "tenant": "", 2024-06-04T16:01:16.675 INFO:tasks.workunit.client.0.smithi144.stdout: "explicit_placement": { 2024-06-04T16:01:16.675 INFO:tasks.workunit.client.0.smithi144.stdout: "data_pool": ".data-pool", 2024-06-04T16:01:16.675 INFO:tasks.workunit.client.0.smithi144.stdout: "data_extra_pool": "", 2024-06-04T16:01:16.675 INFO:tasks.workunit.client.0.smithi144.stdout: "index_pool": ".index-pool" 2024-06-04T16:01:16.675 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.675 INFO:tasks.workunit.client.0.smithi144.stdout: }, 2024-06-04T16:01:16.675 INFO:tasks.workunit.client.0.smithi144.stdout: "key": { 2024-06-04T16:01:16.675 INFO:tasks.workunit.client.0.smithi144.stdout: "name": "_myobj", 2024-06-04T16:01:16.676 INFO:tasks.workunit.client.0.smithi144.stdout: "instance": "", 2024-06-04T16:01:16.676 INFO:tasks.workunit.client.0.smithi144.stdout: "ns": "ns" 2024-06-04T16:01:16.676 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.676 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.676 INFO:tasks.workunit.client.0.smithi144.stdout:} 2024-06-04T16:01:16.676 INFO:tasks.workunit.client.0.smithi144.stdout:raw=.data-pool:marker__ns__myobj 2024-06-04T16:01:16.676 INFO:tasks.workunit.client.0.smithi144.stdout:{ 2024-06-04T16:01:16.676 INFO:tasks.workunit.client.0.smithi144.stdout: "raw_obj2": { 2024-06-04T16:01:16.676 INFO:tasks.workunit.client.0.smithi144.stdout: "pool": ".data-pool", 2024-06-04T16:01:16.676 INFO:tasks.workunit.client.0.smithi144.stdout: "oid": "marker__ns__myobj", 2024-06-04T16:01:16.676 INFO:tasks.workunit.client.0.smithi144.stdout: "loc": "" 2024-06-04T16:01:16.676 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.676 INFO:tasks.workunit.client.0.smithi144.stdout:} 2024-06-04T16:01:16.676 INFO:tasks.workunit.client.0.smithi144.stdout:{ 2024-06-04T16:01:16.676 INFO:tasks.workunit.client.0.smithi144.stdout: "new_obj2": { 2024-06-04T16:01:16.676 INFO:tasks.workunit.client.0.smithi144.stdout: "bucket": { 2024-06-04T16:01:16.677 INFO:tasks.workunit.client.0.smithi144.stdout: "name": "ebtest", 2024-06-04T16:01:16.677 INFO:tasks.workunit.client.0.smithi144.stdout: "marker": "marker", 2024-06-04T16:01:16.677 INFO:tasks.workunit.client.0.smithi144.stdout: "bucket_id": "bucket-id", 2024-06-04T16:01:16.677 INFO:tasks.workunit.client.0.smithi144.stdout: "tenant": "", 2024-06-04T16:01:16.677 INFO:tasks.workunit.client.0.smithi144.stdout: "explicit_placement": { 2024-06-04T16:01:16.677 INFO:tasks.workunit.client.0.smithi144.stdout: "data_pool": ".data-pool", 2024-06-04T16:01:16.677 INFO:tasks.workunit.client.0.smithi144.stdout: "data_extra_pool": "", 2024-06-04T16:01:16.677 INFO:tasks.workunit.client.0.smithi144.stdout: "index_pool": ".index-pool" 2024-06-04T16:01:16.677 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.677 INFO:tasks.workunit.client.0.smithi144.stdout: }, 2024-06-04T16:01:16.677 INFO:tasks.workunit.client.0.smithi144.stdout: "key": { 2024-06-04T16:01:16.677 INFO:tasks.workunit.client.0.smithi144.stdout: "name": "_myobj", 2024-06-04T16:01:16.677 INFO:tasks.workunit.client.0.smithi144.stdout: "instance": "", 2024-06-04T16:01:16.677 INFO:tasks.workunit.client.0.smithi144.stdout: "ns": "ns" 2024-06-04T16:01:16.677 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.677 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.677 INFO:tasks.workunit.client.0.smithi144.stdout:} 2024-06-04T16:01:16.678 INFO:tasks.workunit.client.0.smithi144.stdout:raw2=.data-pool:marker__ns__myobj 2024-06-04T16:01:16.678 INFO:tasks.workunit.client.0.smithi144.stdout:{ 2024-06-04T16:01:16.678 INFO:tasks.workunit.client.0.smithi144.stdout: "raw_obj": { 2024-06-04T16:01:16.678 INFO:tasks.workunit.client.0.smithi144.stdout: "pool": ".data-pool", 2024-06-04T16:01:16.678 INFO:tasks.workunit.client.0.smithi144.stdout: "oid": "marker__:inst__myobj", 2024-06-04T16:01:16.678 INFO:tasks.workunit.client.0.smithi144.stdout: "loc": "marker__myobj" 2024-06-04T16:01:16.678 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.678 INFO:tasks.workunit.client.0.smithi144.stdout:} 2024-06-04T16:01:16.678 INFO:tasks.workunit.client.0.smithi144.stdout:{ 2024-06-04T16:01:16.678 INFO:tasks.workunit.client.0.smithi144.stdout: "new_obj": { 2024-06-04T16:01:16.678 INFO:tasks.workunit.client.0.smithi144.stdout: "bucket": { 2024-06-04T16:01:16.678 INFO:tasks.workunit.client.0.smithi144.stdout: "name": "ebtest", 2024-06-04T16:01:16.678 INFO:tasks.workunit.client.0.smithi144.stdout: "marker": "marker", 2024-06-04T16:01:16.679 INFO:tasks.workunit.client.0.smithi144.stdout: "bucket_id": "bucket-id", 2024-06-04T16:01:16.679 INFO:tasks.workunit.client.0.smithi144.stdout: "tenant": "", 2024-06-04T16:01:16.679 INFO:tasks.workunit.client.0.smithi144.stdout: "explicit_placement": { 2024-06-04T16:01:16.679 INFO:tasks.workunit.client.0.smithi144.stdout: "data_pool": ".data-pool", 2024-06-04T16:01:16.679 INFO:tasks.workunit.client.0.smithi144.stdout: "data_extra_pool": "", 2024-06-04T16:01:16.679 INFO:tasks.workunit.client.0.smithi144.stdout: "index_pool": ".index-pool" 2024-06-04T16:01:16.679 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.679 INFO:tasks.workunit.client.0.smithi144.stdout: }, 2024-06-04T16:01:16.679 INFO:tasks.workunit.client.0.smithi144.stdout: "key": { 2024-06-04T16:01:16.679 INFO:tasks.workunit.client.0.smithi144.stdout: "name": "_myobj", 2024-06-04T16:01:16.679 INFO:tasks.workunit.client.0.smithi144.stdout: "instance": "inst", 2024-06-04T16:01:16.679 INFO:tasks.workunit.client.0.smithi144.stdout: "ns": "" 2024-06-04T16:01:16.679 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.679 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.679 INFO:tasks.workunit.client.0.smithi144.stdout:} 2024-06-04T16:01:16.680 INFO:tasks.workunit.client.0.smithi144.stdout:raw=.data-pool:marker__:inst__myobj 2024-06-04T16:01:16.680 INFO:tasks.workunit.client.0.smithi144.stdout:{ 2024-06-04T16:01:16.680 INFO:tasks.workunit.client.0.smithi144.stdout: "raw_obj2": { 2024-06-04T16:01:16.680 INFO:tasks.workunit.client.0.smithi144.stdout: "pool": ".data-pool", 2024-06-04T16:01:16.680 INFO:tasks.workunit.client.0.smithi144.stdout: "oid": "marker__:inst__myobj", 2024-06-04T16:01:16.680 INFO:tasks.workunit.client.0.smithi144.stdout: "loc": "marker__myobj" 2024-06-04T16:01:16.680 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.680 INFO:tasks.workunit.client.0.smithi144.stdout:} 2024-06-04T16:01:16.680 INFO:tasks.workunit.client.0.smithi144.stdout:{ 2024-06-04T16:01:16.680 INFO:tasks.workunit.client.0.smithi144.stdout: "new_obj2": { 2024-06-04T16:01:16.680 INFO:tasks.workunit.client.0.smithi144.stdout: "bucket": { 2024-06-04T16:01:16.680 INFO:tasks.workunit.client.0.smithi144.stdout: "name": "ebtest", 2024-06-04T16:01:16.680 INFO:tasks.workunit.client.0.smithi144.stdout: "marker": "marker", 2024-06-04T16:01:16.680 INFO:tasks.workunit.client.0.smithi144.stdout: "bucket_id": "bucket-id", 2024-06-04T16:01:16.680 INFO:tasks.workunit.client.0.smithi144.stdout: "tenant": "", 2024-06-04T16:01:16.680 INFO:tasks.workunit.client.0.smithi144.stdout: "explicit_placement": { 2024-06-04T16:01:16.681 INFO:tasks.workunit.client.0.smithi144.stdout: "data_pool": ".data-pool", 2024-06-04T16:01:16.681 INFO:tasks.workunit.client.0.smithi144.stdout: "data_extra_pool": "", 2024-06-04T16:01:16.681 INFO:tasks.workunit.client.0.smithi144.stdout: "index_pool": ".index-pool" 2024-06-04T16:01:16.681 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.681 INFO:tasks.workunit.client.0.smithi144.stdout: }, 2024-06-04T16:01:16.681 INFO:tasks.workunit.client.0.smithi144.stdout: "key": { 2024-06-04T16:01:16.681 INFO:tasks.workunit.client.0.smithi144.stdout: "name": "_myobj", 2024-06-04T16:01:16.681 INFO:tasks.workunit.client.0.smithi144.stdout: "instance": "inst", 2024-06-04T16:01:16.681 INFO:tasks.workunit.client.0.smithi144.stdout: "ns": "" 2024-06-04T16:01:16.681 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.681 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.681 INFO:tasks.workunit.client.0.smithi144.stdout:} 2024-06-04T16:01:16.681 INFO:tasks.workunit.client.0.smithi144.stdout:raw2=.data-pool:marker__:inst__myobj 2024-06-04T16:01:16.681 INFO:tasks.workunit.client.0.smithi144.stdout:{ 2024-06-04T16:01:16.682 INFO:tasks.workunit.client.0.smithi144.stdout: "raw_obj": { 2024-06-04T16:01:16.682 INFO:tasks.workunit.client.0.smithi144.stdout: "pool": ".data-pool", 2024-06-04T16:01:16.682 INFO:tasks.workunit.client.0.smithi144.stdout: "oid": "marker__ns:inst__myobj", 2024-06-04T16:01:16.682 INFO:tasks.workunit.client.0.smithi144.stdout: "loc": "" 2024-06-04T16:01:16.682 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.682 INFO:tasks.workunit.client.0.smithi144.stdout:} 2024-06-04T16:01:16.682 INFO:tasks.workunit.client.0.smithi144.stdout:{ 2024-06-04T16:01:16.682 INFO:tasks.workunit.client.0.smithi144.stdout: "new_obj": { 2024-06-04T16:01:16.682 INFO:tasks.workunit.client.0.smithi144.stdout: "bucket": { 2024-06-04T16:01:16.682 INFO:tasks.workunit.client.0.smithi144.stdout: "name": "ebtest", 2024-06-04T16:01:16.682 INFO:tasks.workunit.client.0.smithi144.stdout: "marker": "marker", 2024-06-04T16:01:16.682 INFO:tasks.workunit.client.0.smithi144.stdout: "bucket_id": "bucket-id", 2024-06-04T16:01:16.682 INFO:tasks.workunit.client.0.smithi144.stdout: "tenant": "", 2024-06-04T16:01:16.683 INFO:tasks.workunit.client.0.smithi144.stdout: "explicit_placement": { 2024-06-04T16:01:16.683 INFO:tasks.workunit.client.0.smithi144.stdout: "data_pool": ".data-pool", 2024-06-04T16:01:16.683 INFO:tasks.workunit.client.0.smithi144.stdout: "data_extra_pool": "", 2024-06-04T16:01:16.683 INFO:tasks.workunit.client.0.smithi144.stdout: "index_pool": ".index-pool" 2024-06-04T16:01:16.683 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.683 INFO:tasks.workunit.client.0.smithi144.stdout: }, 2024-06-04T16:01:16.683 INFO:tasks.workunit.client.0.smithi144.stdout: "key": { 2024-06-04T16:01:16.683 INFO:tasks.workunit.client.0.smithi144.stdout: "name": "_myobj", 2024-06-04T16:01:16.683 INFO:tasks.workunit.client.0.smithi144.stdout: "instance": "inst", 2024-06-04T16:01:16.683 INFO:tasks.workunit.client.0.smithi144.stdout: "ns": "ns" 2024-06-04T16:01:16.683 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.683 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.683 INFO:tasks.workunit.client.0.smithi144.stdout:} 2024-06-04T16:01:16.683 INFO:tasks.workunit.client.0.smithi144.stdout:raw=.data-pool:marker__ns:inst__myobj 2024-06-04T16:01:16.683 INFO:tasks.workunit.client.0.smithi144.stdout:{ 2024-06-04T16:01:16.684 INFO:tasks.workunit.client.0.smithi144.stdout: "raw_obj2": { 2024-06-04T16:01:16.684 INFO:tasks.workunit.client.0.smithi144.stdout: "pool": ".data-pool", 2024-06-04T16:01:16.684 INFO:tasks.workunit.client.0.smithi144.stdout: "oid": "marker__ns:inst__myobj", 2024-06-04T16:01:16.684 INFO:tasks.workunit.client.0.smithi144.stdout: "loc": "" 2024-06-04T16:01:16.684 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.684 INFO:tasks.workunit.client.0.smithi144.stdout:} 2024-06-04T16:01:16.684 INFO:tasks.workunit.client.0.smithi144.stdout:{ 2024-06-04T16:01:16.684 INFO:tasks.workunit.client.0.smithi144.stdout: "new_obj2": { 2024-06-04T16:01:16.684 INFO:tasks.workunit.client.0.smithi144.stdout: "bucket": { 2024-06-04T16:01:16.684 INFO:tasks.workunit.client.0.smithi144.stdout: "name": "ebtest", 2024-06-04T16:01:16.684 INFO:tasks.workunit.client.0.smithi144.stdout: "marker": "marker", 2024-06-04T16:01:16.684 INFO:tasks.workunit.client.0.smithi144.stdout: "bucket_id": "bucket-id", 2024-06-04T16:01:16.684 INFO:tasks.workunit.client.0.smithi144.stdout: "tenant": "", 2024-06-04T16:01:16.684 INFO:tasks.workunit.client.0.smithi144.stdout: "explicit_placement": { 2024-06-04T16:01:16.684 INFO:tasks.workunit.client.0.smithi144.stdout: "data_pool": ".data-pool", 2024-06-04T16:01:16.685 INFO:tasks.workunit.client.0.smithi144.stdout: "data_extra_pool": "", 2024-06-04T16:01:16.685 INFO:tasks.workunit.client.0.smithi144.stdout: "index_pool": ".index-pool" 2024-06-04T16:01:16.685 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.685 INFO:tasks.workunit.client.0.smithi144.stdout: }, 2024-06-04T16:01:16.685 INFO:tasks.workunit.client.0.smithi144.stdout: "key": { 2024-06-04T16:01:16.685 INFO:tasks.workunit.client.0.smithi144.stdout: "name": "_myobj", 2024-06-04T16:01:16.685 INFO:tasks.workunit.client.0.smithi144.stdout: "instance": "inst", 2024-06-04T16:01:16.685 INFO:tasks.workunit.client.0.smithi144.stdout: "ns": "ns" 2024-06-04T16:01:16.685 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.685 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.685 INFO:tasks.workunit.client.0.smithi144.stdout:} 2024-06-04T16:01:16.685 INFO:tasks.workunit.client.0.smithi144.stdout:raw2=.data-pool:marker__ns:inst__myobj 2024-06-04T16:01:16.685 INFO:tasks.workunit.client.0.smithi144.stdout:{ 2024-06-04T16:01:16.685 INFO:tasks.workunit.client.0.smithi144.stdout: "raw_obj": { 2024-06-04T16:01:16.686 INFO:tasks.workunit.client.0.smithi144.stdout: "pool": ".data-pool", 2024-06-04T16:01:16.686 INFO:tasks.workunit.client.0.smithi144.stdout: "oid": "marker___myobj_", 2024-06-04T16:01:16.686 INFO:tasks.workunit.client.0.smithi144.stdout: "loc": "marker__myobj_" 2024-06-04T16:01:16.686 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.686 INFO:tasks.workunit.client.0.smithi144.stdout:} 2024-06-04T16:01:16.686 INFO:tasks.workunit.client.0.smithi144.stdout:{ 2024-06-04T16:01:16.686 INFO:tasks.workunit.client.0.smithi144.stdout: "new_obj": { 2024-06-04T16:01:16.686 INFO:tasks.workunit.client.0.smithi144.stdout: "bucket": { 2024-06-04T16:01:16.686 INFO:tasks.workunit.client.0.smithi144.stdout: "name": "ebtest", 2024-06-04T16:01:16.686 INFO:tasks.workunit.client.0.smithi144.stdout: "marker": "marker", 2024-06-04T16:01:16.686 INFO:tasks.workunit.client.0.smithi144.stdout: "bucket_id": "bucket-id", 2024-06-04T16:01:16.686 INFO:tasks.workunit.client.0.smithi144.stdout: "tenant": "", 2024-06-04T16:01:16.686 INFO:tasks.workunit.client.0.smithi144.stdout: "explicit_placement": { 2024-06-04T16:01:16.686 INFO:tasks.workunit.client.0.smithi144.stdout: "data_pool": ".data-pool", 2024-06-04T16:01:16.687 INFO:tasks.workunit.client.0.smithi144.stdout: "data_extra_pool": "", 2024-06-04T16:01:16.687 INFO:tasks.workunit.client.0.smithi144.stdout: "index_pool": ".index-pool" 2024-06-04T16:01:16.687 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.687 INFO:tasks.workunit.client.0.smithi144.stdout: }, 2024-06-04T16:01:16.687 INFO:tasks.workunit.client.0.smithi144.stdout: "key": { 2024-06-04T16:01:16.687 INFO:tasks.workunit.client.0.smithi144.stdout: "name": "_myobj_", 2024-06-04T16:01:16.687 INFO:tasks.workunit.client.0.smithi144.stdout: "instance": "", 2024-06-04T16:01:16.687 INFO:tasks.workunit.client.0.smithi144.stdout: "ns": "" 2024-06-04T16:01:16.687 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.687 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.687 INFO:tasks.workunit.client.0.smithi144.stdout:} 2024-06-04T16:01:16.687 INFO:tasks.workunit.client.0.smithi144.stdout:raw=.data-pool:marker___myobj_ 2024-06-04T16:01:16.687 INFO:tasks.workunit.client.0.smithi144.stdout:{ 2024-06-04T16:01:16.687 INFO:tasks.workunit.client.0.smithi144.stdout: "raw_obj2": { 2024-06-04T16:01:16.687 INFO:tasks.workunit.client.0.smithi144.stdout: "pool": ".data-pool", 2024-06-04T16:01:16.688 INFO:tasks.workunit.client.0.smithi144.stdout: "oid": "marker___myobj_", 2024-06-04T16:01:16.688 INFO:tasks.workunit.client.0.smithi144.stdout: "loc": "marker__myobj_" 2024-06-04T16:01:16.688 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.688 INFO:tasks.workunit.client.0.smithi144.stdout:} 2024-06-04T16:01:16.688 INFO:tasks.workunit.client.0.smithi144.stdout:{ 2024-06-04T16:01:16.688 INFO:tasks.workunit.client.0.smithi144.stdout: "new_obj2": { 2024-06-04T16:01:16.688 INFO:tasks.workunit.client.0.smithi144.stdout: "bucket": { 2024-06-04T16:01:16.688 INFO:tasks.workunit.client.0.smithi144.stdout: "name": "ebtest", 2024-06-04T16:01:16.688 INFO:tasks.workunit.client.0.smithi144.stdout: "marker": "marker", 2024-06-04T16:01:16.688 INFO:tasks.workunit.client.0.smithi144.stdout: "bucket_id": "bucket-id", 2024-06-04T16:01:16.688 INFO:tasks.workunit.client.0.smithi144.stdout: "tenant": "", 2024-06-04T16:01:16.688 INFO:tasks.workunit.client.0.smithi144.stdout: "explicit_placement": { 2024-06-04T16:01:16.688 INFO:tasks.workunit.client.0.smithi144.stdout: "data_pool": ".data-pool", 2024-06-04T16:01:16.688 INFO:tasks.workunit.client.0.smithi144.stdout: "data_extra_pool": "", 2024-06-04T16:01:16.688 INFO:tasks.workunit.client.0.smithi144.stdout: "index_pool": ".index-pool" 2024-06-04T16:01:16.688 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.689 INFO:tasks.workunit.client.0.smithi144.stdout: }, 2024-06-04T16:01:16.689 INFO:tasks.workunit.client.0.smithi144.stdout: "key": { 2024-06-04T16:01:16.689 INFO:tasks.workunit.client.0.smithi144.stdout: "name": "_myobj_", 2024-06-04T16:01:16.689 INFO:tasks.workunit.client.0.smithi144.stdout: "instance": "", 2024-06-04T16:01:16.689 INFO:tasks.workunit.client.0.smithi144.stdout: "ns": "" 2024-06-04T16:01:16.689 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.689 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.689 INFO:tasks.workunit.client.0.smithi144.stdout:} 2024-06-04T16:01:16.689 INFO:tasks.workunit.client.0.smithi144.stdout:raw2=.data-pool:marker___myobj_ 2024-06-04T16:01:16.689 INFO:tasks.workunit.client.0.smithi144.stdout:{ 2024-06-04T16:01:16.689 INFO:tasks.workunit.client.0.smithi144.stdout: "raw_obj": { 2024-06-04T16:01:16.689 INFO:tasks.workunit.client.0.smithi144.stdout: "pool": ".data-pool", 2024-06-04T16:01:16.689 INFO:tasks.workunit.client.0.smithi144.stdout: "oid": "marker__ns__myobj_", 2024-06-04T16:01:16.689 INFO:tasks.workunit.client.0.smithi144.stdout: "loc": "" 2024-06-04T16:01:16.689 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.689 INFO:tasks.workunit.client.0.smithi144.stdout:} 2024-06-04T16:01:16.690 INFO:tasks.workunit.client.0.smithi144.stdout:{ 2024-06-04T16:01:16.690 INFO:tasks.workunit.client.0.smithi144.stdout: "new_obj": { 2024-06-04T16:01:16.690 INFO:tasks.workunit.client.0.smithi144.stdout: "bucket": { 2024-06-04T16:01:16.690 INFO:tasks.workunit.client.0.smithi144.stdout: "name": "ebtest", 2024-06-04T16:01:16.690 INFO:tasks.workunit.client.0.smithi144.stdout: "marker": "marker", 2024-06-04T16:01:16.690 INFO:tasks.workunit.client.0.smithi144.stdout: "bucket_id": "bucket-id", 2024-06-04T16:01:16.690 INFO:tasks.workunit.client.0.smithi144.stdout: "tenant": "", 2024-06-04T16:01:16.690 INFO:tasks.workunit.client.0.smithi144.stdout: "explicit_placement": { 2024-06-04T16:01:16.690 INFO:tasks.workunit.client.0.smithi144.stdout: "data_pool": ".data-pool", 2024-06-04T16:01:16.690 INFO:tasks.workunit.client.0.smithi144.stdout: "data_extra_pool": "", 2024-06-04T16:01:16.690 INFO:tasks.workunit.client.0.smithi144.stdout: "index_pool": ".index-pool" 2024-06-04T16:01:16.690 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.691 INFO:tasks.workunit.client.0.smithi144.stdout: }, 2024-06-04T16:01:16.691 INFO:tasks.workunit.client.0.smithi144.stdout: "key": { 2024-06-04T16:01:16.691 INFO:tasks.workunit.client.0.smithi144.stdout: "name": "_myobj_", 2024-06-04T16:01:16.691 INFO:tasks.workunit.client.0.smithi144.stdout: "instance": "", 2024-06-04T16:01:16.691 INFO:tasks.workunit.client.0.smithi144.stdout: "ns": "ns" 2024-06-04T16:01:16.691 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.691 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.691 INFO:tasks.workunit.client.0.smithi144.stdout:} 2024-06-04T16:01:16.691 INFO:tasks.workunit.client.0.smithi144.stdout:raw=.data-pool:marker__ns__myobj_ 2024-06-04T16:01:16.691 INFO:tasks.workunit.client.0.smithi144.stdout:{ 2024-06-04T16:01:16.691 INFO:tasks.workunit.client.0.smithi144.stdout: "raw_obj2": { 2024-06-04T16:01:16.691 INFO:tasks.workunit.client.0.smithi144.stdout: "pool": ".data-pool", 2024-06-04T16:01:16.691 INFO:tasks.workunit.client.0.smithi144.stdout: "oid": "marker__ns__myobj_", 2024-06-04T16:01:16.691 INFO:tasks.workunit.client.0.smithi144.stdout: "loc": "" 2024-06-04T16:01:16.692 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.692 INFO:tasks.workunit.client.0.smithi144.stdout:} 2024-06-04T16:01:16.692 INFO:tasks.workunit.client.0.smithi144.stdout:{ 2024-06-04T16:01:16.692 INFO:tasks.workunit.client.0.smithi144.stdout: "new_obj2": { 2024-06-04T16:01:16.692 INFO:tasks.workunit.client.0.smithi144.stdout: "bucket": { 2024-06-04T16:01:16.692 INFO:tasks.workunit.client.0.smithi144.stdout: "name": "ebtest", 2024-06-04T16:01:16.692 INFO:tasks.workunit.client.0.smithi144.stdout: "marker": "marker", 2024-06-04T16:01:16.692 INFO:tasks.workunit.client.0.smithi144.stdout: "bucket_id": "bucket-id", 2024-06-04T16:01:16.692 INFO:tasks.workunit.client.0.smithi144.stdout: "tenant": "", 2024-06-04T16:01:16.692 INFO:tasks.workunit.client.0.smithi144.stdout: "explicit_placement": { 2024-06-04T16:01:16.692 INFO:tasks.workunit.client.0.smithi144.stdout: "data_pool": ".data-pool", 2024-06-04T16:01:16.692 INFO:tasks.workunit.client.0.smithi144.stdout: "data_extra_pool": "", 2024-06-04T16:01:16.692 INFO:tasks.workunit.client.0.smithi144.stdout: "index_pool": ".index-pool" 2024-06-04T16:01:16.692 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.692 INFO:tasks.workunit.client.0.smithi144.stdout: }, 2024-06-04T16:01:16.692 INFO:tasks.workunit.client.0.smithi144.stdout: "key": { 2024-06-04T16:01:16.693 INFO:tasks.workunit.client.0.smithi144.stdout: "name": "_myobj_", 2024-06-04T16:01:16.693 INFO:tasks.workunit.client.0.smithi144.stdout: "instance": "", 2024-06-04T16:01:16.693 INFO:tasks.workunit.client.0.smithi144.stdout: "ns": "ns" 2024-06-04T16:01:16.693 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.693 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.693 INFO:tasks.workunit.client.0.smithi144.stdout:} 2024-06-04T16:01:16.693 INFO:tasks.workunit.client.0.smithi144.stdout:raw2=.data-pool:marker__ns__myobj_ 2024-06-04T16:01:16.693 INFO:tasks.workunit.client.0.smithi144.stdout:{ 2024-06-04T16:01:16.693 INFO:tasks.workunit.client.0.smithi144.stdout: "raw_obj": { 2024-06-04T16:01:16.693 INFO:tasks.workunit.client.0.smithi144.stdout: "pool": ".data-pool", 2024-06-04T16:01:16.693 INFO:tasks.workunit.client.0.smithi144.stdout: "oid": "marker__:inst__myobj_", 2024-06-04T16:01:16.693 INFO:tasks.workunit.client.0.smithi144.stdout: "loc": "marker__myobj_" 2024-06-04T16:01:16.693 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.693 INFO:tasks.workunit.client.0.smithi144.stdout:} 2024-06-04T16:01:16.693 INFO:tasks.workunit.client.0.smithi144.stdout:{ 2024-06-04T16:01:16.694 INFO:tasks.workunit.client.0.smithi144.stdout: "new_obj": { 2024-06-04T16:01:16.694 INFO:tasks.workunit.client.0.smithi144.stdout: "bucket": { 2024-06-04T16:01:16.694 INFO:tasks.workunit.client.0.smithi144.stdout: "name": "ebtest", 2024-06-04T16:01:16.694 INFO:tasks.workunit.client.0.smithi144.stdout: "marker": "marker", 2024-06-04T16:01:16.694 INFO:tasks.workunit.client.0.smithi144.stdout: "bucket_id": "bucket-id", 2024-06-04T16:01:16.694 INFO:tasks.workunit.client.0.smithi144.stdout: "tenant": "", 2024-06-04T16:01:16.694 INFO:tasks.workunit.client.0.smithi144.stdout: "explicit_placement": { 2024-06-04T16:01:16.694 INFO:tasks.workunit.client.0.smithi144.stdout: "data_pool": ".data-pool", 2024-06-04T16:01:16.694 INFO:tasks.workunit.client.0.smithi144.stdout: "data_extra_pool": "", 2024-06-04T16:01:16.694 INFO:tasks.workunit.client.0.smithi144.stdout: "index_pool": ".index-pool" 2024-06-04T16:01:16.694 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.694 INFO:tasks.workunit.client.0.smithi144.stdout: }, 2024-06-04T16:01:16.694 INFO:tasks.workunit.client.0.smithi144.stdout: "key": { 2024-06-04T16:01:16.695 INFO:tasks.workunit.client.0.smithi144.stdout: "name": "_myobj_", 2024-06-04T16:01:16.695 INFO:tasks.workunit.client.0.smithi144.stdout: "instance": "inst", 2024-06-04T16:01:16.695 INFO:tasks.workunit.client.0.smithi144.stdout: "ns": "" 2024-06-04T16:01:16.695 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.695 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.695 INFO:tasks.workunit.client.0.smithi144.stdout:} 2024-06-04T16:01:16.695 INFO:tasks.workunit.client.0.smithi144.stdout:raw=.data-pool:marker__:inst__myobj_ 2024-06-04T16:01:16.695 INFO:tasks.workunit.client.0.smithi144.stdout:{ 2024-06-04T16:01:16.695 INFO:tasks.workunit.client.0.smithi144.stdout: "raw_obj2": { 2024-06-04T16:01:16.695 INFO:tasks.workunit.client.0.smithi144.stdout: "pool": ".data-pool", 2024-06-04T16:01:16.695 INFO:tasks.workunit.client.0.smithi144.stdout: "oid": "marker__:inst__myobj_", 2024-06-04T16:01:16.695 INFO:tasks.workunit.client.0.smithi144.stdout: "loc": "marker__myobj_" 2024-06-04T16:01:16.695 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.695 INFO:tasks.workunit.client.0.smithi144.stdout:} 2024-06-04T16:01:16.696 INFO:tasks.workunit.client.0.smithi144.stdout:{ 2024-06-04T16:01:16.696 INFO:tasks.workunit.client.0.smithi144.stdout: "new_obj2": { 2024-06-04T16:01:16.696 INFO:tasks.workunit.client.0.smithi144.stdout: "bucket": { 2024-06-04T16:01:16.696 INFO:tasks.workunit.client.0.smithi144.stdout: "name": "ebtest", 2024-06-04T16:01:16.696 INFO:tasks.workunit.client.0.smithi144.stdout: "marker": "marker", 2024-06-04T16:01:16.696 INFO:tasks.workunit.client.0.smithi144.stdout: "bucket_id": "bucket-id", 2024-06-04T16:01:16.696 INFO:tasks.workunit.client.0.smithi144.stdout: "tenant": "", 2024-06-04T16:01:16.696 INFO:tasks.workunit.client.0.smithi144.stdout: "explicit_placement": { 2024-06-04T16:01:16.696 INFO:tasks.workunit.client.0.smithi144.stdout: "data_pool": ".data-pool", 2024-06-04T16:01:16.696 INFO:tasks.workunit.client.0.smithi144.stdout: "data_extra_pool": "", 2024-06-04T16:01:16.696 INFO:tasks.workunit.client.0.smithi144.stdout: "index_pool": ".index-pool" 2024-06-04T16:01:16.696 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.696 INFO:tasks.workunit.client.0.smithi144.stdout: }, 2024-06-04T16:01:16.696 INFO:tasks.workunit.client.0.smithi144.stdout: "key": { 2024-06-04T16:01:16.696 INFO:tasks.workunit.client.0.smithi144.stdout: "name": "_myobj_", 2024-06-04T16:01:16.696 INFO:tasks.workunit.client.0.smithi144.stdout: "instance": "inst", 2024-06-04T16:01:16.697 INFO:tasks.workunit.client.0.smithi144.stdout: "ns": "" 2024-06-04T16:01:16.697 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.697 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.697 INFO:tasks.workunit.client.0.smithi144.stdout:} 2024-06-04T16:01:16.697 INFO:tasks.workunit.client.0.smithi144.stdout:raw2=.data-pool:marker__:inst__myobj_ 2024-06-04T16:01:16.697 INFO:tasks.workunit.client.0.smithi144.stdout:{ 2024-06-04T16:01:16.697 INFO:tasks.workunit.client.0.smithi144.stdout: "raw_obj": { 2024-06-04T16:01:16.697 INFO:tasks.workunit.client.0.smithi144.stdout: "pool": ".data-pool", 2024-06-04T16:01:16.697 INFO:tasks.workunit.client.0.smithi144.stdout: "oid": "marker__ns:inst__myobj_", 2024-06-04T16:01:16.697 INFO:tasks.workunit.client.0.smithi144.stdout: "loc": "" 2024-06-04T16:01:16.697 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.697 INFO:tasks.workunit.client.0.smithi144.stdout:} 2024-06-04T16:01:16.697 INFO:tasks.workunit.client.0.smithi144.stdout:{ 2024-06-04T16:01:16.697 INFO:tasks.workunit.client.0.smithi144.stdout: "new_obj": { 2024-06-04T16:01:16.697 INFO:tasks.workunit.client.0.smithi144.stdout: "bucket": { 2024-06-04T16:01:16.697 INFO:tasks.workunit.client.0.smithi144.stdout: "name": "ebtest", 2024-06-04T16:01:16.698 INFO:tasks.workunit.client.0.smithi144.stdout: "marker": "marker", 2024-06-04T16:01:16.698 INFO:tasks.workunit.client.0.smithi144.stdout: "bucket_id": "bucket-id", 2024-06-04T16:01:16.698 INFO:tasks.workunit.client.0.smithi144.stdout: "tenant": "", 2024-06-04T16:01:16.698 INFO:tasks.workunit.client.0.smithi144.stdout: "explicit_placement": { 2024-06-04T16:01:16.698 INFO:tasks.workunit.client.0.smithi144.stdout: "data_pool": ".data-pool", 2024-06-04T16:01:16.698 INFO:tasks.workunit.client.0.smithi144.stdout: "data_extra_pool": "", 2024-06-04T16:01:16.698 INFO:tasks.workunit.client.0.smithi144.stdout: "index_pool": ".index-pool" 2024-06-04T16:01:16.698 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.698 INFO:tasks.workunit.client.0.smithi144.stdout: }, 2024-06-04T16:01:16.698 INFO:tasks.workunit.client.0.smithi144.stdout: "key": { 2024-06-04T16:01:16.698 INFO:tasks.workunit.client.0.smithi144.stdout: "name": "_myobj_", 2024-06-04T16:01:16.699 INFO:tasks.workunit.client.0.smithi144.stdout: "instance": "inst", 2024-06-04T16:01:16.699 INFO:tasks.workunit.client.0.smithi144.stdout: "ns": "ns" 2024-06-04T16:01:16.699 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.699 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.699 INFO:tasks.workunit.client.0.smithi144.stdout:} 2024-06-04T16:01:16.699 INFO:tasks.workunit.client.0.smithi144.stdout:raw=.data-pool:marker__ns:inst__myobj_ 2024-06-04T16:01:16.699 INFO:tasks.workunit.client.0.smithi144.stdout:{ 2024-06-04T16:01:16.699 INFO:tasks.workunit.client.0.smithi144.stdout: "raw_obj2": { 2024-06-04T16:01:16.699 INFO:tasks.workunit.client.0.smithi144.stdout: "pool": ".data-pool", 2024-06-04T16:01:16.699 INFO:tasks.workunit.client.0.smithi144.stdout: "oid": "marker__ns:inst__myobj_", 2024-06-04T16:01:16.699 INFO:tasks.workunit.client.0.smithi144.stdout: "loc": "" 2024-06-04T16:01:16.699 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.699 INFO:tasks.workunit.client.0.smithi144.stdout:} 2024-06-04T16:01:16.699 INFO:tasks.workunit.client.0.smithi144.stdout:{ 2024-06-04T16:01:16.699 INFO:tasks.workunit.client.0.smithi144.stdout: "new_obj2": { 2024-06-04T16:01:16.700 INFO:tasks.workunit.client.0.smithi144.stdout: "bucket": { 2024-06-04T16:01:16.700 INFO:tasks.workunit.client.0.smithi144.stdout: "name": "ebtest", 2024-06-04T16:01:16.700 INFO:tasks.workunit.client.0.smithi144.stdout: "marker": "marker", 2024-06-04T16:01:16.700 INFO:tasks.workunit.client.0.smithi144.stdout: "bucket_id": "bucket-id", 2024-06-04T16:01:16.700 INFO:tasks.workunit.client.0.smithi144.stdout: "tenant": "", 2024-06-04T16:01:16.700 INFO:tasks.workunit.client.0.smithi144.stdout: "explicit_placement": { 2024-06-04T16:01:16.700 INFO:tasks.workunit.client.0.smithi144.stdout: "data_pool": ".data-pool", 2024-06-04T16:01:16.700 INFO:tasks.workunit.client.0.smithi144.stdout: "data_extra_pool": "", 2024-06-04T16:01:16.700 INFO:tasks.workunit.client.0.smithi144.stdout: "index_pool": ".index-pool" 2024-06-04T16:01:16.700 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.700 INFO:tasks.workunit.client.0.smithi144.stdout: }, 2024-06-04T16:01:16.700 INFO:tasks.workunit.client.0.smithi144.stdout: "key": { 2024-06-04T16:01:16.700 INFO:tasks.workunit.client.0.smithi144.stdout: "name": "_myobj_", 2024-06-04T16:01:16.700 INFO:tasks.workunit.client.0.smithi144.stdout: "instance": "inst", 2024-06-04T16:01:16.700 INFO:tasks.workunit.client.0.smithi144.stdout: "ns": "ns" 2024-06-04T16:01:16.701 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.701 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.701 INFO:tasks.workunit.client.0.smithi144.stdout:} 2024-06-04T16:01:16.701 INFO:tasks.workunit.client.0.smithi144.stdout:raw2=.data-pool:marker__ns:inst__myobj_ 2024-06-04T16:01:16.701 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] TestRGWObj.old_to_raw (0 ms) 2024-06-04T16:01:16.701 INFO:tasks.workunit.client.0.smithi144.stdout:[----------] 4 tests from TestRGWObj (1 ms total) 2024-06-04T16:01:16.701 INFO:tasks.workunit.client.0.smithi144.stdout: 2024-06-04T16:01:16.701 INFO:tasks.workunit.client.0.smithi144.stdout:[----------] Global test environment tear-down 2024-06-04T16:01:16.701 INFO:tasks.workunit.client.0.smithi144.stdout:[==========] 4 tests from 1 test suite ran. (1 ms total) 2024-06-04T16:01:16.701 INFO:tasks.workunit.client.0.smithi144.stdout:[ PASSED ] 4 tests. 2024-06-04T16:01:16.701 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-06-04T16:01:16.702 DEBUG:teuthology.orchestra.run.smithi144:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-06-04T16:01:16.741 INFO:tasks.workunit:Running workunits matching rgw/test_librgw_file.sh on client.0... 2024-06-04T16:01:16.742 INFO:tasks.workunit:Running workunit rgw/test_librgw_file.sh... 2024-06-04T16:01:16.742 DEBUG:teuthology.orchestra.run.smithi144:workunit test rgw/test_librgw_file.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1fb5d10608dccee73edd6ef8a2c7b804a097c324 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_librgw_file.sh 2024-06-04T16:01:16.857 INFO:tasks.workunit.client.0.smithi144.stderr:ignoring --setuser ceph since I am not root 2024-06-04T16:01:16.857 INFO:tasks.workunit.client.0.smithi144.stderr:ignoring --setgroup ceph since I am not root 2024-06-04T16:01:16.894 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:01:16.894+0000 7fc607c62800 20 rados->read ofs=0 len=0 2024-06-04T16:01:16.896 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:01:16.895+0000 7fc607c62800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:01:16.897 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:01:16.895+0000 7fc607c62800 20 realm 2024-06-04T16:01:16.897 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:01:16.895+0000 7fc607c62800 20 rados->read ofs=0 len=0 2024-06-04T16:01:16.897 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:01:16.896+0000 7fc607c62800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:01:16.897 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:01:16.896+0000 7fc607c62800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-06-04T16:01:16.897 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:01:16.896+0000 7fc607c62800 20 rados->read ofs=0 len=0 2024-06-04T16:01:16.897 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:01:16.896+0000 7fc607c62800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:01:16.897 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:01:16.896+0000 7fc607c62800 20 rados->read ofs=0 len=0 2024-06-04T16:01:16.898 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:01:16.896+0000 7fc607c62800 20 rados_obj.operate() r=0 bl.length=46 2024-06-04T16:01:16.898 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:01:16.897+0000 7fc607c62800 20 rados->read ofs=0 len=0 2024-06-04T16:01:16.898 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:01:16.897+0000 7fc607c62800 20 rados_obj.operate() r=0 bl.length=1139 2024-06-04T16:01:16.898 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:01:16.897+0000 7fc607c62800 20 searching for the correct realm 2024-06-04T16:01:16.900 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:01:16.900+0000 7fc605f58640 0 -- 172.21.15.144:0/3664750783 >> [v2:172.21.15.144:6800/1453747520,v1:172.21.15.144:6801/1453747520] conn(0x7fc5f004c070 msgr2=0x7fc5f0086890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-06-04T16:01:16.904 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:01:16.903+0000 7fc605f58640 0 -- 172.21.15.144:0/3664750783 >> [v2:172.21.15.144:6824/166159729,v1:172.21.15.144:6825/166159729] conn(0x560278371590 msgr2=0x5602783739a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-06-04T16:01:16.909 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:01:16.908+0000 7fc607c62800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-06-04T16:01:16.909 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:01:16.908+0000 7fc607c62800 20 RGWRados::pool_iterate: got zone_info.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767 2024-06-04T16:01:16.909 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:01:16.908+0000 7fc607c62800 20 RGWRados::pool_iterate: got default.zone. 2024-06-04T16:01:16.909 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:01:16.908+0000 7fc607c62800 20 RGWRados::pool_iterate: got zonegroup_info.abb22408-c332-4e28-8f7a-ff254ea2fed2 2024-06-04T16:01:16.909 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:01:16.908+0000 7fc607c62800 20 RGWRados::pool_iterate: got zone_names.default 2024-06-04T16:01:16.909 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:01:16.908+0000 7fc607c62800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-06-04T16:01:16.910 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:01:16.908+0000 7fc607c62800 20 rados->read ofs=0 len=0 2024-06-04T16:01:16.910 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:01:16.908+0000 7fc607c62800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:01:16.910 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:01:16.908+0000 7fc607c62800 20 rados->read ofs=0 len=0 2024-06-04T16:01:16.910 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:01:16.909+0000 7fc607c62800 20 rados_obj.operate() r=0 bl.length=46 2024-06-04T16:01:16.910 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:01:16.909+0000 7fc607c62800 20 rados->read ofs=0 len=0 2024-06-04T16:01:16.911 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:01:16.909+0000 7fc607c62800 20 rados_obj.operate() r=0 bl.length=470 2024-06-04T16:01:16.911 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:01:16.909+0000 7fc607c62800 20 zone default found 2024-06-04T16:01:16.911 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:01:16.909+0000 7fc607c62800 4 Realm: () 2024-06-04T16:01:16.911 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:01:16.909+0000 7fc607c62800 4 ZoneGroup: default (abb22408-c332-4e28-8f7a-ff254ea2fed2) 2024-06-04T16:01:16.911 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:01:16.909+0000 7fc607c62800 4 Zone: default (be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767) 2024-06-04T16:01:16.911 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:01:16.909+0000 7fc607c62800 10 cannot find current period zonegroup using local zonegroup configuration 2024-06-04T16:01:16.911 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:01:16.909+0000 7fc607c62800 20 zonegroup default 2024-06-04T16:01:16.911 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:01:16.909+0000 7fc607c62800 20 rados->read ofs=0 len=0 2024-06-04T16:01:16.912 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:01:16.909+0000 7fc607c62800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:01:16.912 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:01:16.909+0000 7fc607c62800 20 rados->read ofs=0 len=0 2024-06-04T16:01:16.912 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:01:16.910+0000 7fc607c62800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:01:16.912 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:01:16.910+0000 7fc607c62800 20 rados->read ofs=0 len=0 2024-06-04T16:01:16.912 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:01:16.910+0000 7fc607c62800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:01:16.912 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:01:16.910+0000 7fc607c62800 20 started sync module instance, tier type = 2024-06-04T16:01:16.912 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:01:16.910+0000 7fc607c62800 20 started zone id=be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767 (name=default) with tier type = 2024-06-04T16:01:16.920 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:01:16.919+0000 7fc607c62800 20 add_watcher() i=0 2024-06-04T16:01:16.920 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:01:16.919+0000 7fc607c62800 20 add_watcher() i=1 2024-06-04T16:01:16.920 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:01:16.919+0000 7fc607c62800 20 add_watcher() i=2 2024-06-04T16:01:16.920 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:01:16.919+0000 7fc607c62800 20 add_watcher() i=3 2024-06-04T16:01:16.920 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:01:16.919+0000 7fc607c62800 20 add_watcher() i=4 2024-06-04T16:01:16.920 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:01:16.919+0000 7fc607c62800 20 add_watcher() i=5 2024-06-04T16:01:16.920 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:01:16.919+0000 7fc607c62800 20 add_watcher() i=6 2024-06-04T16:01:16.921 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:01:16.920+0000 7fc607c62800 20 add_watcher() i=7 2024-06-04T16:01:16.921 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:01:16.920+0000 7fc607c62800 2 all 8 watchers are set, enabling cache 2024-06-04T16:01:16.923 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:01:16.922+0000 7fc4bb7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-06-04T16:01:16.923 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:01:16.922+0000 7fc607c62800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-06-04T16:01:16.923 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:01:16.922+0000 7fc607c62800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-06-04T16:01:16.923 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:01:16.922+0000 7fc607c62800 5 note: GC not initialized 2024-06-04T16:01:16.924 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:01:16.923+0000 7fc4ba7e4640 20 reqs_thread_entry: start 2024-06-04T16:01:16.924 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:01:16.923+0000 7fc607c62800 20 init_complete bucket index max shards: 11 2024-06-04T16:01:16.924 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:01:16.923+0000 7fc607c62800 20 Filter name: none 2024-06-04T16:01:16.924 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:01:16.923+0000 7fc42bfff640 20 reqs_thread_entry: start 2024-06-04T16:01:16.924 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:01:16.923+0000 7fc607c62800 10 cache get: name=default.rgw.meta+users.uid+ceph-test-librgw-file : miss 2024-06-04T16:01:16.924 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:01:16.923+0000 7fc607c62800 20 rados->read ofs=0 len=0 2024-06-04T16:01:16.924 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:01:16.923+0000 7fc607c62800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:01:16.924 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:01:16.923+0000 7fc607c62800 10 cache put: name=default.rgw.meta+users.uid+ceph-test-librgw-file info.flags=0x0 2024-06-04T16:01:16.924 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:01:16.923+0000 7fc607c62800 10 adding default.rgw.meta+users.uid+ceph-test-librgw-file to cache LRU end 2024-06-04T16:01:16.925 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:01:16.923+0000 7fc607c62800 10 cache get: name=default.rgw.meta+users.email+librgw@example.com : miss 2024-06-04T16:01:16.925 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:01:16.923+0000 7fc607c62800 20 rados->read ofs=0 len=0 2024-06-04T16:01:16.925 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:01:16.924+0000 7fc607c62800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:01:16.925 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:01:16.924+0000 7fc607c62800 10 cache put: name=default.rgw.meta+users.email+librgw@example.com info.flags=0x0 2024-06-04T16:01:16.926 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:01:16.924+0000 7fc607c62800 10 adding default.rgw.meta+users.email+librgw@example.com to cache LRU end 2024-06-04T16:01:16.926 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:01:16.924+0000 7fc607c62800 10 cache get: name=default.rgw.meta+users.keys+qVIpCLeMJA2QBNwOPRbRTOALUQM= : miss 2024-06-04T16:01:16.926 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:01:16.924+0000 7fc607c62800 20 rados->read ofs=0 len=0 2024-06-04T16:01:16.926 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:01:16.924+0000 7fc607c62800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:01:16.926 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:01:16.924+0000 7fc607c62800 10 cache put: name=default.rgw.meta+users.keys+qVIpCLeMJA2QBNwOPRbRTOALUQM= info.flags=0x0 2024-06-04T16:01:16.926 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:01:16.924+0000 7fc607c62800 10 adding default.rgw.meta+users.keys+qVIpCLeMJA2QBNwOPRbRTOALUQM= to cache LRU end 2024-06-04T16:01:16.926 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:01:16.924+0000 7fc607c62800 10 cache get: name=default.rgw.meta+users.keys+qVIpCLeMJA2QBNwOPRbRTOALUQM= : hit (negative entry) 2024-06-04T16:01:16.926 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:01:16.924+0000 7fc607c62800 10 cache get: name=default.rgw.meta+users.keys+qVIpCLeMJA2QBNwOPRbRTOALUQM= : hit (negative entry) 2024-06-04T16:01:16.926 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:01:16.925+0000 7fc607c62800 10 cache put: name=default.rgw.meta+users.uid+ceph-test-librgw-file info.flags=0x17 2024-06-04T16:01:16.926 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:01:16.925+0000 7fc607c62800 10 moving default.rgw.meta+users.uid+ceph-test-librgw-file to cache LRU end 2024-06-04T16:01:16.926 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:01:16.925+0000 7fc607c62800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.uid:ceph-test-librgw-file, ofs0, ns] 2024-06-04T16:01:16.927 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:01:16.925+0000 7fc4e8ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1039382085633 cookie 94568606835520 notifier 5475 bl.length()=697 2024-06-04T16:01:16.927 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:01:16.925+0000 7fc4e8ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ceph-test-librgw-file info.flags=0x17 2024-06-04T16:01:16.927 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:01:16.925+0000 7fc4e8ff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ceph-test-librgw-file to cache LRU end 2024-06-04T16:01:16.928 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:01:16.927+0000 7fc607c62800 10 cache put: name=default.rgw.meta+users.email+librgw@example.com info.flags=0x7 2024-06-04T16:01:16.928 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:01:16.927+0000 7fc607c62800 10 moving default.rgw.meta+users.email+librgw@example.com to cache LRU end 2024-06-04T16:01:16.928 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:01:16.927+0000 7fc607c62800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.email:librgw@example.com, ofs0, ns] 2024-06-04T16:01:16.928 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:01:16.928+0000 7fc4dbfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1039382085635 cookie 94568606832048 notifier 5475 bl.length()=194 2024-06-04T16:01:16.928 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:01:16.928+0000 7fc4dbfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+librgw@example.com info.flags=0x7 2024-06-04T16:01:16.928 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:01:16.928+0000 7fc4dbfff640 10 rgw watcher librados: moving default.rgw.meta+users.email+librgw@example.com to cache LRU end 2024-06-04T16:01:16.930 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:01:16.929+0000 7fc607c62800 10 cache put: name=default.rgw.meta+users.keys+qVIpCLeMJA2QBNwOPRbRTOALUQM= info.flags=0x7 2024-06-04T16:01:16.930 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:01:16.929+0000 7fc607c62800 10 moving default.rgw.meta+users.keys+qVIpCLeMJA2QBNwOPRbRTOALUQM= to cache LRU end 2024-06-04T16:01:16.930 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:01:16.929+0000 7fc607c62800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:users.keys:qVIpCLeMJA2QBNwOPRbRTOALUQM=, ofs0, ns] 2024-06-04T16:01:16.930 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:01:16.929+0000 7fc4dbfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1039382085632 cookie 94568606846288 notifier 5475 bl.length()=203 2024-06-04T16:01:16.930 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:01:16.929+0000 7fc4dbfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+qVIpCLeMJA2QBNwOPRbRTOALUQM= info.flags=0x7 2024-06-04T16:01:16.930 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:01:16.929+0000 7fc4dbfff640 10 rgw watcher librados: moving default.rgw.meta+users.keys+qVIpCLeMJA2QBNwOPRbRTOALUQM= to cache LRU end 2024-06-04T16:01:16.931 INFO:tasks.workunit.client.0.smithi144.stdout:{ 2024-06-04T16:01:16.931 INFO:tasks.workunit.client.0.smithi144.stdout: "user_id": "ceph-test-librgw-file", 2024-06-04T16:01:16.931 INFO:tasks.workunit.client.0.smithi144.stdout: "display_name": "librgw test user", 2024-06-04T16:01:16.931 INFO:tasks.workunit.client.0.smithi144.stdout: "email": "librgw@example.com", 2024-06-04T16:01:16.931 INFO:tasks.workunit.client.0.smithi144.stdout: "suspended": 0, 2024-06-04T16:01:16.932 INFO:tasks.workunit.client.0.smithi144.stdout: "max_buckets": 1000, 2024-06-04T16:01:16.932 INFO:tasks.workunit.client.0.smithi144.stdout: "subusers": [], 2024-06-04T16:01:16.932 INFO:tasks.workunit.client.0.smithi144.stdout: "keys": [ 2024-06-04T16:01:16.932 INFO:tasks.workunit.client.0.smithi144.stdout: { 2024-06-04T16:01:16.934 INFO:tasks.workunit.client.0.smithi144.stdout: "user": "ceph-test-librgw-file", 2024-06-04T16:01:16.934 INFO:tasks.workunit.client.0.smithi144.stdout: "access_key": "qVIpCLeMJA2QBNwOPRbRTOALUQM=", 2024-06-04T16:01:16.934 INFO:tasks.workunit.client.0.smithi144.stdout: "secret_key": "UkaF5gWZwB3uqU246gT/W1ABx7R7PHT7RVU3lwHdhRjOL/5KrMr7kw==", 2024-06-04T16:01:16.934 INFO:tasks.workunit.client.0.smithi144.stdout: "active": true, 2024-06-04T16:01:16.935 INFO:tasks.workunit.client.0.smithi144.stdout: "create_date": "2024-06-04T16:01:16.925354Z" 2024-06-04T16:01:16.935 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:01:16.935 INFO:tasks.workunit.client.0.smithi144.stdout: ], 2024-06-04T16:01:16.935 INFO:tasks.workunit.client.0.smithi144.stdout: "swift_keys": [], 2024-06-04T16:01:16.935 INFO:tasks.workunit.client.0.smithi144.stdout: "caps": [], 2024-06-04T16:01:16.935 INFO:tasks.workunit.client.0.smithi144.stdout: "op_mask": "read, write, delete", 2024-06-04T16:01:16.935 INFO:tasks.workunit.client.0.smithi144.stdout: "default_placement": "", 2024-06-04T16:01:16.935 INFO:tasks.workunit.client.0.smithi144.stdout: "default_storage_class": "", 2024-06-04T16:01:16.935 INFO:tasks.workunit.client.0.smithi144.stdout: "placement_tags": [], 2024-06-04T16:01:16.935 INFO:tasks.workunit.client.0.smithi144.stdout: "bucket_quota": { 2024-06-04T16:01:16.935 INFO:tasks.workunit.client.0.smithi144.stdout: "enabled": false, 2024-06-04T16:01:16.935 INFO:tasks.workunit.client.0.smithi144.stdout: "check_on_raw": false, 2024-06-04T16:01:16.935 INFO:tasks.workunit.client.0.smithi144.stdout: "max_size": -1, 2024-06-04T16:01:16.935 INFO:tasks.workunit.client.0.smithi144.stdout: "max_size_kb": 0, 2024-06-04T16:01:16.936 INFO:tasks.workunit.client.0.smithi144.stdout: "max_objects": -1 2024-06-04T16:01:16.936 INFO:tasks.workunit.client.0.smithi144.stdout: }, 2024-06-04T16:01:16.936 INFO:tasks.workunit.client.0.smithi144.stdout: "user_quota": { 2024-06-04T16:01:16.936 INFO:tasks.workunit.client.0.smithi144.stdout: "enabled": false, 2024-06-04T16:01:16.936 INFO:tasks.workunit.client.0.smithi144.stdout: "check_on_raw": false, 2024-06-04T16:01:16.936 INFO:tasks.workunit.client.0.smithi144.stdout: "max_size": -1, 2024-06-04T16:01:16.936 INFO:tasks.workunit.client.0.smithi144.stdout: "max_size_kb": 0, 2024-06-04T16:01:16.936 INFO:tasks.workunit.client.0.smithi144.stdout: "max_objects": -1 2024-06-04T16:01:16.936 INFO:tasks.workunit.client.0.smithi144.stdout: }, 2024-06-04T16:01:16.936 INFO:tasks.workunit.client.0.smithi144.stdout: "temp_url_keys": [], 2024-06-04T16:01:16.936 INFO:tasks.workunit.client.0.smithi144.stdout: "type": "rgw", 2024-06-04T16:01:16.936 INFO:tasks.workunit.client.0.smithi144.stdout: "mfa_ids": [], 2024-06-04T16:01:16.936 INFO:tasks.workunit.client.0.smithi144.stdout: "account_id": "", 2024-06-04T16:01:16.936 INFO:tasks.workunit.client.0.smithi144.stdout: "path": "/", 2024-06-04T16:01:16.937 INFO:tasks.workunit.client.0.smithi144.stdout: "create_date": "2024-06-04T16:01:16.925339Z", 2024-06-04T16:01:16.937 INFO:tasks.workunit.client.0.smithi144.stdout: "tags": [], 2024-06-04T16:01:16.937 INFO:tasks.workunit.client.0.smithi144.stdout: "group_ids": [] 2024-06-04T16:01:16.937 INFO:tasks.workunit.client.0.smithi144.stdout:} 2024-06-04T16:01:16.937 INFO:tasks.workunit.client.0.smithi144.stdout: 2024-06-04T16:01:16.938 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:01:16.931+0000 7fc4bb7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-06-04T16:01:16.938 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:01:16.933+0000 7fc607c62800 20 remove_watcher() i=0 2024-06-04T16:01:16.938 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:01:16.933+0000 7fc607c62800 2 removed watcher, disabling cache 2024-06-04T16:01:16.938 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:01:16.934+0000 7fc607c62800 20 remove_watcher() i=1 2024-06-04T16:01:16.938 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:01:16.935+0000 7fc607c62800 20 remove_watcher() i=2 2024-06-04T16:01:16.938 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:01:16.936+0000 7fc607c62800 20 remove_watcher() i=3 2024-06-04T16:01:16.938 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:01:16.937+0000 7fc607c62800 20 remove_watcher() i=4 2024-06-04T16:01:16.939 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:01:16.938+0000 7fc607c62800 20 remove_watcher() i=5 2024-06-04T16:01:16.940 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:01:16.939+0000 7fc607c62800 20 remove_watcher() i=6 2024-06-04T16:01:16.941 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:01:16.940+0000 7fc607c62800 20 remove_watcher() i=7 2024-06-04T16:01:16.951 INFO:tasks.workunit.client.0.smithi144.stdout:phase 1.1 2024-06-04T16:01:16.973 INFO:tasks.workunit.client.0.smithi144.stdout:[==========] Running 24 tests from 1 test suite. 2024-06-04T16:01:16.973 INFO:tasks.workunit.client.0.smithi144.stdout:[----------] Global test environment set-up. 2024-06-04T16:01:16.973 INFO:tasks.workunit.client.0.smithi144.stdout:[----------] 24 tests from LibRGW 2024-06-04T16:01:16.973 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] LibRGW.INIT 2024-06-04T16:01:16.984 INFO:tasks.workunit.client.0.smithi144.stderr:ignoring --setuser ceph since I am not root 2024-06-04T16:01:16.984 INFO:tasks.workunit.client.0.smithi144.stderr:ignoring --setgroup ceph since I am not root 2024-06-04T16:01:17.359 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] LibRGW.INIT (385 ms) 2024-06-04T16:01:17.359 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] LibRGW.MOUNT_NOROOT 2024-06-04T16:01:17.360 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] LibRGW.MOUNT_NOROOT (1 ms) 2024-06-04T16:01:17.360 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] LibRGW.MOUNT 2024-06-04T16:01:17.360 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] LibRGW.MOUNT (0 ms) 2024-06-04T16:01:17.360 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] LibRGW.SETUP_HIER1 2024-06-04T16:01:17.368 INFO:tasks.workunit.client.0.smithi144.stdout:creating: nfsroot:foo/bar/baz/quux 2024-06-04T16:01:17.372 INFO:tasks.workunit.client.0.smithi144.stdout:creating: nfsroot:foo/f1 2024-06-04T16:01:17.375 INFO:tasks.workunit.client.0.smithi144.stdout:creating: nfsroot:foo/f2 2024-06-04T16:01:17.378 INFO:tasks.workunit.client.0.smithi144.stdout:creating: nfsroot:foo/bar/f1 2024-06-04T16:01:17.381 INFO:tasks.workunit.client.0.smithi144.stdout:creating: nfsroot:foo/bar/d1/ 2024-06-04T16:01:17.383 INFO:tasks.workunit.client.0.smithi144.stdout:creating: nfsroot:foo/bar/baz/hungry 2024-06-04T16:01:17.387 INFO:tasks.workunit.client.0.smithi144.stdout:creating: nfsroot:foo/bar/baz/hungry/ 2024-06-04T16:01:17.389 INFO:tasks.workunit.client.0.smithi144.stdout:creating: nfsroot:foo/bar/baz/momma 2024-06-04T16:01:17.392 INFO:tasks.workunit.client.0.smithi144.stdout:creating: nfsroot:foo/bar/baz/bear/ 2024-06-04T16:01:17.395 INFO:tasks.workunit.client.0.smithi144.stdout:creating: nfsroot:foo/bar/baz/sasquatch 2024-06-04T16:01:17.398 INFO:tasks.workunit.client.0.smithi144.stdout:creating: nfsroot:foo/bar/baz/sasquatch/ 2024-06-04T16:01:17.401 INFO:tasks.workunit.client.0.smithi144.stdout:creating: nfsroot:foo/bar/baz/frobozz 2024-06-04T16:01:17.404 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] LibRGW.SETUP_HIER1 (44 ms) 2024-06-04T16:01:17.404 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] LibRGW.SETUP_DIRS1 2024-06-04T16:01:17.502 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] LibRGW.SETUP_DIRS1 (99 ms) 2024-06-04T16:01:17.503 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] LibRGW.SETATTR 2024-06-04T16:01:17.503 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] LibRGW.SETATTR (0 ms) 2024-06-04T16:01:17.503 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] LibRGW.RGW_CREATE_DIRS1 2024-06-04T16:01:17.520 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] LibRGW.RGW_CREATE_DIRS1 (17 ms) 2024-06-04T16:01:17.520 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] LibRGW.RGW_SETUP_RENAME1 2024-06-04T16:01:17.559 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] LibRGW.RGW_SETUP_RENAME1 (39 ms) 2024-06-04T16:01:17.559 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] LibRGW.RGW_INTRABUCKET_RENAME1 2024-06-04T16:01:17.559 INFO:tasks.workunit.client.0.smithi144.stdout:rename file rfile_0 to rfile_r0 (bucket brename0) 2024-06-04T16:01:17.565 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] LibRGW.RGW_INTRABUCKET_RENAME1 (7 ms) 2024-06-04T16:01:17.565 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] LibRGW.RGW_CROSSBUCKET_RENAME1 2024-06-04T16:01:17.565 INFO:tasks.workunit.client.0.smithi144.stdout:rename file rfile_1 (bucket brename0) to rfile_rhilldog (bucket brename1) 2024-06-04T16:01:17.572 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] LibRGW.RGW_CROSSBUCKET_RENAME1 (6 ms) 2024-06-04T16:01:17.572 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] LibRGW.GETATTR_DIRS1 2024-06-04T16:01:17.572 INFO:tasks.workunit.client.0.smithi144.stdout:scanning objects in /bdirs1/dir_0 2024-06-04T16:01:17.572 INFO:tasks.workunit.client.0.smithi144.stdout: /bdirs1/dir_0/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-06-04T16:01:17.572 INFO:tasks.workunit.client.0.smithi144.stdout: /bdirs1/dir_0/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-06-04T16:01:17.572 INFO:tasks.workunit.client.0.smithi144.stdout: /bdirs1/dir_0/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-06-04T16:01:17.572 INFO:tasks.workunit.client.0.smithi144.stdout: /bdirs1/dir_0/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-06-04T16:01:17.573 INFO:tasks.workunit.client.0.smithi144.stdout:scanning objects in /bdirs1/dir_1 2024-06-04T16:01:17.573 INFO:tasks.workunit.client.0.smithi144.stdout: /bdirs1/dir_1/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-06-04T16:01:17.573 INFO:tasks.workunit.client.0.smithi144.stdout: /bdirs1/dir_1/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-06-04T16:01:17.573 INFO:tasks.workunit.client.0.smithi144.stdout: /bdirs1/dir_1/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-06-04T16:01:17.573 INFO:tasks.workunit.client.0.smithi144.stdout: /bdirs1/dir_1/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-06-04T16:01:17.573 INFO:tasks.workunit.client.0.smithi144.stdout:scanning objects in /bdirs1/dir_2 2024-06-04T16:01:17.573 INFO:tasks.workunit.client.0.smithi144.stdout: /bdirs1/dir_2/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-06-04T16:01:17.573 INFO:tasks.workunit.client.0.smithi144.stdout: /bdirs1/dir_2/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-06-04T16:01:17.573 INFO:tasks.workunit.client.0.smithi144.stdout: /bdirs1/dir_2/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-06-04T16:01:17.573 INFO:tasks.workunit.client.0.smithi144.stdout: /bdirs1/dir_2/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-06-04T16:01:17.573 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] LibRGW.GETATTR_DIRS1 (0 ms) 2024-06-04T16:01:17.573 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] LibRGW.READ_DIRS1 2024-06-04T16:01:17.573 INFO:tasks.workunit.client.0.smithi144.stdout:read back objects in /bdirs1/dir_0 2024-06-04T16:01:17.573 INFO:tasks.workunit.client.0.smithi144.stdout:reading 0,256 dir_0/sfile_0 2024-06-04T16:01:17.574 INFO:tasks.workunit.client.0.smithi144.stdout: read back from sfile_0 : "data for sfile_0" 2024-06-04T16:01:17.574 INFO:tasks.workunit.client.0.smithi144.stdout:reading 0,256 dir_0/sfile_1 2024-06-04T16:01:17.575 INFO:tasks.workunit.client.0.smithi144.stdout: read back from sfile_1 : "data for sfile_1" 2024-06-04T16:01:17.576 INFO:tasks.workunit.client.0.smithi144.stdout:read back objects in /bdirs1/dir_1 2024-06-04T16:01:17.576 INFO:tasks.workunit.client.0.smithi144.stdout:reading 0,256 dir_1/sfile_0 2024-06-04T16:01:17.577 INFO:tasks.workunit.client.0.smithi144.stdout: read back from sfile_0 : "data for sfile_0" 2024-06-04T16:01:17.577 INFO:tasks.workunit.client.0.smithi144.stdout:reading 0,256 dir_1/sfile_1 2024-06-04T16:01:17.578 INFO:tasks.workunit.client.0.smithi144.stdout: read back from sfile_1 : "data for sfile_1" 2024-06-04T16:01:17.578 INFO:tasks.workunit.client.0.smithi144.stdout:read back objects in /bdirs1/dir_2 2024-06-04T16:01:17.578 INFO:tasks.workunit.client.0.smithi144.stdout:reading 0,256 dir_2/sfile_0 2024-06-04T16:01:17.580 INFO:tasks.workunit.client.0.smithi144.stdout: read back from sfile_0 : "data for sfile_0" 2024-06-04T16:01:17.580 INFO:tasks.workunit.client.0.smithi144.stdout:reading 0,256 dir_2/sfile_1 2024-06-04T16:01:17.582 INFO:tasks.workunit.client.0.smithi144.stdout: read back from sfile_1 : "data for sfile_1" 2024-06-04T16:01:17.582 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] LibRGW.READ_DIRS1 (10 ms) 2024-06-04T16:01:17.582 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] LibRGW.READF_SETUP1 2024-06-04T16:01:17.754 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] LibRGW.READF_SETUP1 (172 ms) 2024-06-04T16:01:17.754 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] LibRGW.READF_DIRS1 2024-06-04T16:01:17.755 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] LibRGW.READF_DIRS1 (0 ms) 2024-06-04T16:01:17.755 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] LibRGW.WRITEF_DIRS1 2024-06-04T16:01:17.755 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] LibRGW.WRITEF_DIRS1 (0 ms) 2024-06-04T16:01:17.755 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] LibRGW.RELEASE_DIRS1 2024-06-04T16:01:17.755 INFO:tasks.workunit.client.0.smithi144.stdout:release sdir_0 type: DIR refs: 2 2024-06-04T16:01:17.755 INFO:tasks.workunit.client.0.smithi144.stdout:release sfile_0 type: FILE refs: 2 2024-06-04T16:01:17.755 INFO:tasks.workunit.client.0.smithi144.stdout:release sdir_1 type: DIR refs: 2 2024-06-04T16:01:17.755 INFO:tasks.workunit.client.0.smithi144.stdout:release sfile_1 type: FILE refs: 2 2024-06-04T16:01:17.755 INFO:tasks.workunit.client.0.smithi144.stdout:release sdir_0 type: DIR refs: 2 2024-06-04T16:01:17.755 INFO:tasks.workunit.client.0.smithi144.stdout:release sfile_0 type: FILE refs: 2 2024-06-04T16:01:17.755 INFO:tasks.workunit.client.0.smithi144.stdout:release sdir_1 type: DIR refs: 2 2024-06-04T16:01:17.755 INFO:tasks.workunit.client.0.smithi144.stdout:release sfile_1 type: FILE refs: 2 2024-06-04T16:01:17.755 INFO:tasks.workunit.client.0.smithi144.stdout:release sdir_0 type: DIR refs: 2 2024-06-04T16:01:17.755 INFO:tasks.workunit.client.0.smithi144.stdout:release sfile_0 type: FILE refs: 2 2024-06-04T16:01:17.755 INFO:tasks.workunit.client.0.smithi144.stdout:release sdir_1 type: DIR refs: 2 2024-06-04T16:01:17.755 INFO:tasks.workunit.client.0.smithi144.stdout:release sfile_1 type: FILE refs: 2 2024-06-04T16:01:17.756 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] LibRGW.RELEASE_DIRS1 (0 ms) 2024-06-04T16:01:17.756 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] LibRGW.HIER1 2024-06-04T16:01:17.761 INFO:tasks.workunit.client.0.smithi144.stdout:/nfsroot/foo/f2 (f2): FILE 2024-06-04T16:01:17.761 INFO:tasks.workunit.client.0.smithi144.stdout:/nfsroot/foo/f1 (f1): FILE 2024-06-04T16:01:17.764 INFO:tasks.workunit.client.0.smithi144.stdout:/nfsroot/foo/bar/f1 (f1): FILE 2024-06-04T16:01:17.766 INFO:tasks.workunit.client.0.smithi144.stdout:/nfsroot/foo/bar/d1 (d1): DIR 2024-06-04T16:01:17.769 INFO:tasks.workunit.client.0.smithi144.stdout:/nfsroot/foo/bar/baz/sasquatch (sasquatch): FILE 2024-06-04T16:01:17.770 INFO:tasks.workunit.client.0.smithi144.stdout:/nfsroot/foo/bar/baz/sasquatch (sasquatch): FILE 2024-06-04T16:01:17.770 INFO:tasks.workunit.client.0.smithi144.stdout:/nfsroot/foo/bar/baz/quux (quux): FILE 2024-06-04T16:01:17.770 INFO:tasks.workunit.client.0.smithi144.stdout:/nfsroot/foo/bar/baz/momma (momma): FILE 2024-06-04T16:01:17.771 INFO:tasks.workunit.client.0.smithi144.stdout:/nfsroot/foo/bar/baz/hungry (hungry): FILE 2024-06-04T16:01:17.771 INFO:tasks.workunit.client.0.smithi144.stdout:/nfsroot/foo/bar/baz/hungry (hungry): FILE 2024-06-04T16:01:17.772 INFO:tasks.workunit.client.0.smithi144.stdout:/nfsroot/foo/bar/baz/frobozz (frobozz): FILE 2024-06-04T16:01:17.774 INFO:tasks.workunit.client.0.smithi144.stdout:/nfsroot/foo/bar/baz/bear (bear): DIR 2024-06-04T16:01:17.774 INFO:tasks.workunit.client.0.smithi144.stdout:/nfsroot/foo/bar/baz (baz): DIR 2024-06-04T16:01:17.774 INFO:tasks.workunit.client.0.smithi144.stdout:/nfsroot/foo/bar (bar): DIR 2024-06-04T16:01:17.774 INFO:tasks.workunit.client.0.smithi144.stdout:/nfsroot/foo (foo): DIR 2024-06-04T16:01:17.775 INFO:tasks.workunit.client.0.smithi144.stdout:/nfsroot (nfsroot): DIR 2024-06-04T16:01:17.775 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] LibRGW.HIER1 (19 ms) 2024-06-04T16:01:17.775 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2024-06-04T16:01:17.775 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (0 ms) 2024-06-04T16:01:17.775 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2024-06-04T16:01:17.775 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (0 ms) 2024-06-04T16:01:17.775 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2024-06-04T16:01:17.775 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] LibRGW.MARKER1_READDIR (0 ms) 2024-06-04T16:01:17.775 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2024-06-04T16:01:17.776 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2024-06-04T16:01:17.776 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] LibRGW.CLEANUP 2024-06-04T16:01:17.776 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-06-04T16:01:17.776 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] LibRGW.UMOUNT 2024-06-04T16:01:17.776 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-06-04T16:01:17.776 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-06-04T16:01:17.776 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:01:17.773+0000 7ffa6bd198c0 -1 shutting down 2024-06-04T16:01:17.776 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:01:17.774+0000 7ff945a58640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 64065, si_uid : 1000, si_addr0x3e80000fa41, si_status0 2024-06-04T16:01:47.448 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] LibRGW.SHUTDOWN (29674 ms) 2024-06-04T16:01:47.449 INFO:tasks.workunit.client.0.smithi144.stdout:[----------] 24 tests from LibRGW (30474 ms total) 2024-06-04T16:01:47.449 INFO:tasks.workunit.client.0.smithi144.stdout: 2024-06-04T16:01:47.449 INFO:tasks.workunit.client.0.smithi144.stdout:[----------] Global test environment tear-down 2024-06-04T16:01:47.449 INFO:tasks.workunit.client.0.smithi144.stdout:[==========] 24 tests from 1 test suite ran. (30474 ms total) 2024-06-04T16:01:47.449 INFO:tasks.workunit.client.0.smithi144.stdout:[ PASSED ] 24 tests. 2024-06-04T16:01:47.454 INFO:tasks.workunit.client.0.smithi144.stdout:phase 1.2 2024-06-04T16:01:47.478 INFO:tasks.workunit.client.0.smithi144.stdout:[==========] Running 24 tests from 1 test suite. 2024-06-04T16:01:47.478 INFO:tasks.workunit.client.0.smithi144.stdout:[----------] Global test environment set-up. 2024-06-04T16:01:47.478 INFO:tasks.workunit.client.0.smithi144.stdout:[----------] 24 tests from LibRGW 2024-06-04T16:01:47.478 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] LibRGW.INIT 2024-06-04T16:01:47.486 INFO:tasks.workunit.client.0.smithi144.stderr:ignoring --setuser ceph since I am not root 2024-06-04T16:01:47.486 INFO:tasks.workunit.client.0.smithi144.stderr:ignoring --setgroup ceph since I am not root 2024-06-04T16:01:47.657 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] LibRGW.INIT (179 ms) 2024-06-04T16:01:47.657 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] LibRGW.MOUNT_NOROOT 2024-06-04T16:01:47.658 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] LibRGW.MOUNT_NOROOT (1 ms) 2024-06-04T16:01:47.659 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] LibRGW.MOUNT 2024-06-04T16:01:47.659 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] LibRGW.MOUNT (0 ms) 2024-06-04T16:01:47.659 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] LibRGW.SETUP_HIER1 2024-06-04T16:01:47.659 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] LibRGW.SETUP_HIER1 (0 ms) 2024-06-04T16:01:47.659 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] LibRGW.SETUP_DIRS1 2024-06-04T16:01:47.659 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] LibRGW.SETUP_DIRS1 (0 ms) 2024-06-04T16:01:47.659 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] LibRGW.SETATTR 2024-06-04T16:01:47.659 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] LibRGW.SETATTR (0 ms) 2024-06-04T16:01:47.659 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] LibRGW.RGW_CREATE_DIRS1 2024-06-04T16:01:47.659 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] LibRGW.RGW_CREATE_DIRS1 (0 ms) 2024-06-04T16:01:47.659 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] LibRGW.RGW_SETUP_RENAME1 2024-06-04T16:01:47.659 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] LibRGW.RGW_SETUP_RENAME1 (0 ms) 2024-06-04T16:01:47.659 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] LibRGW.RGW_INTRABUCKET_RENAME1 2024-06-04T16:01:47.660 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] LibRGW.RGW_INTRABUCKET_RENAME1 (0 ms) 2024-06-04T16:01:47.660 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] LibRGW.RGW_CROSSBUCKET_RENAME1 2024-06-04T16:01:47.660 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] LibRGW.RGW_CROSSBUCKET_RENAME1 (0 ms) 2024-06-04T16:01:47.660 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] LibRGW.GETATTR_DIRS1 2024-06-04T16:01:47.660 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] LibRGW.GETATTR_DIRS1 (0 ms) 2024-06-04T16:01:47.660 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] LibRGW.READ_DIRS1 2024-06-04T16:01:47.660 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] LibRGW.READ_DIRS1 (0 ms) 2024-06-04T16:01:47.660 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] LibRGW.READF_SETUP1 2024-06-04T16:01:47.660 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] LibRGW.READF_SETUP1 (0 ms) 2024-06-04T16:01:47.660 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] LibRGW.READF_DIRS1 2024-06-04T16:01:47.660 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] LibRGW.READF_DIRS1 (0 ms) 2024-06-04T16:01:47.660 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] LibRGW.WRITEF_DIRS1 2024-06-04T16:01:47.660 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] LibRGW.WRITEF_DIRS1 (0 ms) 2024-06-04T16:01:47.660 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] LibRGW.RELEASE_DIRS1 2024-06-04T16:01:47.661 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] LibRGW.RELEASE_DIRS1 (0 ms) 2024-06-04T16:01:47.661 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] LibRGW.HIER1 2024-06-04T16:01:47.661 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] LibRGW.HIER1 (0 ms) 2024-06-04T16:01:47.661 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2024-06-04T16:01:47.661 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (0 ms) 2024-06-04T16:01:47.661 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2024-06-04T16:01:47.661 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (0 ms) 2024-06-04T16:01:47.661 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2024-06-04T16:01:47.661 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] LibRGW.MARKER1_READDIR (0 ms) 2024-06-04T16:01:47.661 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2024-06-04T16:01:47.661 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2024-06-04T16:01:47.661 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] LibRGW.CLEANUP 2024-06-04T16:01:47.661 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-06-04T16:01:47.662 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] LibRGW.UMOUNT 2024-06-04T16:01:47.662 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-06-04T16:01:47.662 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-06-04T16:01:47.662 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:01:47.657+0000 7f7c2c72f8c0 -1 shutting down 2024-06-04T16:01:47.662 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:01:47.658+0000 7f7b0472e640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 64685, si_uid : 1000, si_addr0x3e80000fcad, si_status0 2024-06-04T16:02:17.915 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] LibRGW.SHUTDOWN (30256 ms) 2024-06-04T16:02:17.915 INFO:tasks.workunit.client.0.smithi144.stdout:[----------] 24 tests from LibRGW (30436 ms total) 2024-06-04T16:02:17.916 INFO:tasks.workunit.client.0.smithi144.stdout: 2024-06-04T16:02:17.916 INFO:tasks.workunit.client.0.smithi144.stdout:[----------] Global test environment tear-down 2024-06-04T16:02:17.916 INFO:tasks.workunit.client.0.smithi144.stdout:[==========] 24 tests from 1 test suite ran. (30436 ms total) 2024-06-04T16:02:17.916 INFO:tasks.workunit.client.0.smithi144.stdout:[ PASSED ] 24 tests. 2024-06-04T16:02:17.920 INFO:tasks.workunit.client.0.smithi144.stdout:phase 1.3 2024-06-04T16:02:17.945 INFO:tasks.workunit.client.0.smithi144.stdout:[==========] Running 24 tests from 1 test suite. 2024-06-04T16:02:17.945 INFO:tasks.workunit.client.0.smithi144.stdout:[----------] Global test environment set-up. 2024-06-04T16:02:17.945 INFO:tasks.workunit.client.0.smithi144.stdout:[----------] 24 tests from LibRGW 2024-06-04T16:02:17.945 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] LibRGW.INIT 2024-06-04T16:02:17.955 INFO:tasks.workunit.client.0.smithi144.stderr:ignoring --setuser ceph since I am not root 2024-06-04T16:02:17.955 INFO:tasks.workunit.client.0.smithi144.stderr:ignoring --setgroup ceph since I am not root 2024-06-04T16:02:18.585 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] LibRGW.INIT (640 ms) 2024-06-04T16:02:18.585 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] LibRGW.MOUNT_NOROOT 2024-06-04T16:02:18.586 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] LibRGW.MOUNT_NOROOT (1 ms) 2024-06-04T16:02:18.586 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] LibRGW.MOUNT 2024-06-04T16:02:18.586 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] LibRGW.MOUNT (0 ms) 2024-06-04T16:02:18.586 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] LibRGW.SETUP_HIER1 2024-06-04T16:02:18.590 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] LibRGW.SETUP_HIER1 (5 ms) 2024-06-04T16:02:18.591 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] LibRGW.SETUP_DIRS1 2024-06-04T16:02:18.650 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] LibRGW.SETUP_DIRS1 (59 ms) 2024-06-04T16:02:18.651 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] LibRGW.SETATTR 2024-06-04T16:02:18.651 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] LibRGW.SETATTR (0 ms) 2024-06-04T16:02:18.651 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] LibRGW.RGW_CREATE_DIRS1 2024-06-04T16:02:18.651 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] LibRGW.RGW_CREATE_DIRS1 (0 ms) 2024-06-04T16:02:18.651 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] LibRGW.RGW_SETUP_RENAME1 2024-06-04T16:02:18.651 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] LibRGW.RGW_SETUP_RENAME1 (0 ms) 2024-06-04T16:02:18.651 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] LibRGW.RGW_INTRABUCKET_RENAME1 2024-06-04T16:02:18.651 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] LibRGW.RGW_INTRABUCKET_RENAME1 (0 ms) 2024-06-04T16:02:18.651 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] LibRGW.RGW_CROSSBUCKET_RENAME1 2024-06-04T16:02:18.651 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] LibRGW.RGW_CROSSBUCKET_RENAME1 (0 ms) 2024-06-04T16:02:18.651 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] LibRGW.GETATTR_DIRS1 2024-06-04T16:02:18.651 INFO:tasks.workunit.client.0.smithi144.stdout:scanning objects in /bdirs1/dir_0 2024-06-04T16:02:18.651 INFO:tasks.workunit.client.0.smithi144.stdout: /bdirs1/dir_0/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-06-04T16:02:18.652 INFO:tasks.workunit.client.0.smithi144.stdout: /bdirs1/dir_0/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-06-04T16:02:18.652 INFO:tasks.workunit.client.0.smithi144.stdout: /bdirs1/dir_0/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-06-04T16:02:18.652 INFO:tasks.workunit.client.0.smithi144.stdout: /bdirs1/dir_0/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-06-04T16:02:18.652 INFO:tasks.workunit.client.0.smithi144.stdout:scanning objects in /bdirs1/dir_1 2024-06-04T16:02:18.652 INFO:tasks.workunit.client.0.smithi144.stdout: /bdirs1/dir_1/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-06-04T16:02:18.652 INFO:tasks.workunit.client.0.smithi144.stdout: /bdirs1/dir_1/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-06-04T16:02:18.652 INFO:tasks.workunit.client.0.smithi144.stdout: /bdirs1/dir_1/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-06-04T16:02:18.652 INFO:tasks.workunit.client.0.smithi144.stdout: /bdirs1/dir_1/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-06-04T16:02:18.652 INFO:tasks.workunit.client.0.smithi144.stdout:scanning objects in /bdirs1/dir_2 2024-06-04T16:02:18.652 INFO:tasks.workunit.client.0.smithi144.stdout: /bdirs1/dir_2/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-06-04T16:02:18.652 INFO:tasks.workunit.client.0.smithi144.stdout: /bdirs1/dir_2/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-06-04T16:02:18.652 INFO:tasks.workunit.client.0.smithi144.stdout: /bdirs1/dir_2/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-06-04T16:02:18.652 INFO:tasks.workunit.client.0.smithi144.stdout: /bdirs1/dir_2/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-06-04T16:02:18.653 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] LibRGW.GETATTR_DIRS1 (0 ms) 2024-06-04T16:02:18.653 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] LibRGW.READ_DIRS1 2024-06-04T16:02:18.653 INFO:tasks.workunit.client.0.smithi144.stdout:read back objects in /bdirs1/dir_0 2024-06-04T16:02:18.653 INFO:tasks.workunit.client.0.smithi144.stdout:reading 0,256 dir_0/sfile_0 2024-06-04T16:02:18.653 INFO:tasks.workunit.client.0.smithi144.stdout: read back from sfile_0 : "data for sfile_0" 2024-06-04T16:02:18.653 INFO:tasks.workunit.client.0.smithi144.stdout:reading 0,256 dir_0/sfile_1 2024-06-04T16:02:18.654 INFO:tasks.workunit.client.0.smithi144.stdout: read back from sfile_1 : "data for sfile_1" 2024-06-04T16:02:18.654 INFO:tasks.workunit.client.0.smithi144.stdout:read back objects in /bdirs1/dir_1 2024-06-04T16:02:18.654 INFO:tasks.workunit.client.0.smithi144.stdout:reading 0,256 dir_1/sfile_0 2024-06-04T16:02:18.655 INFO:tasks.workunit.client.0.smithi144.stdout: read back from sfile_0 : "data for sfile_0" 2024-06-04T16:02:18.656 INFO:tasks.workunit.client.0.smithi144.stdout:reading 0,256 dir_1/sfile_1 2024-06-04T16:02:18.657 INFO:tasks.workunit.client.0.smithi144.stdout: read back from sfile_1 : "data for sfile_1" 2024-06-04T16:02:18.657 INFO:tasks.workunit.client.0.smithi144.stdout:read back objects in /bdirs1/dir_2 2024-06-04T16:02:18.657 INFO:tasks.workunit.client.0.smithi144.stdout:reading 0,256 dir_2/sfile_0 2024-06-04T16:02:18.658 INFO:tasks.workunit.client.0.smithi144.stdout: read back from sfile_0 : "data for sfile_0" 2024-06-04T16:02:18.658 INFO:tasks.workunit.client.0.smithi144.stdout:reading 0,256 dir_2/sfile_1 2024-06-04T16:02:18.660 INFO:tasks.workunit.client.0.smithi144.stdout: read back from sfile_1 : "data for sfile_1" 2024-06-04T16:02:18.660 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] LibRGW.READ_DIRS1 (10 ms) 2024-06-04T16:02:18.660 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] LibRGW.READF_SETUP1 2024-06-04T16:02:18.660 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] LibRGW.READF_SETUP1 (0 ms) 2024-06-04T16:02:18.660 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] LibRGW.READF_DIRS1 2024-06-04T16:02:18.660 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] LibRGW.READF_DIRS1 (0 ms) 2024-06-04T16:02:18.660 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] LibRGW.WRITEF_DIRS1 2024-06-04T16:02:18.660 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] LibRGW.WRITEF_DIRS1 (0 ms) 2024-06-04T16:02:18.661 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] LibRGW.RELEASE_DIRS1 2024-06-04T16:02:18.661 INFO:tasks.workunit.client.0.smithi144.stdout:release sdir_0 type: DIR refs: 2 2024-06-04T16:02:18.661 INFO:tasks.workunit.client.0.smithi144.stdout:release sfile_0 type: FILE refs: 2 2024-06-04T16:02:18.661 INFO:tasks.workunit.client.0.smithi144.stdout:release sdir_1 type: DIR refs: 2 2024-06-04T16:02:18.661 INFO:tasks.workunit.client.0.smithi144.stdout:release sfile_1 type: FILE refs: 2 2024-06-04T16:02:18.661 INFO:tasks.workunit.client.0.smithi144.stdout:release sdir_0 type: DIR refs: 2 2024-06-04T16:02:18.661 INFO:tasks.workunit.client.0.smithi144.stdout:release sfile_0 type: FILE refs: 2 2024-06-04T16:02:18.661 INFO:tasks.workunit.client.0.smithi144.stdout:release sdir_1 type: DIR refs: 2 2024-06-04T16:02:18.661 INFO:tasks.workunit.client.0.smithi144.stdout:release sfile_1 type: FILE refs: 2 2024-06-04T16:02:18.661 INFO:tasks.workunit.client.0.smithi144.stdout:release sdir_0 type: DIR refs: 2 2024-06-04T16:02:18.661 INFO:tasks.workunit.client.0.smithi144.stdout:release sfile_0 type: FILE refs: 2 2024-06-04T16:02:18.661 INFO:tasks.workunit.client.0.smithi144.stdout:release sdir_1 type: DIR refs: 2 2024-06-04T16:02:18.661 INFO:tasks.workunit.client.0.smithi144.stdout:release sfile_1 type: FILE refs: 2 2024-06-04T16:02:18.661 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] LibRGW.RELEASE_DIRS1 (0 ms) 2024-06-04T16:02:18.662 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] LibRGW.HIER1 2024-06-04T16:02:18.666 INFO:tasks.workunit.client.0.smithi144.stdout:/nfsroot/foo/f2 (f2): FILE 2024-06-04T16:02:18.666 INFO:tasks.workunit.client.0.smithi144.stdout:/nfsroot/foo/f1 (f1): FILE 2024-06-04T16:02:18.669 INFO:tasks.workunit.client.0.smithi144.stdout:/nfsroot/foo/bar/f1 (f1): FILE 2024-06-04T16:02:18.671 INFO:tasks.workunit.client.0.smithi144.stdout:/nfsroot/foo/bar/d1 (d1): DIR 2024-06-04T16:02:18.674 INFO:tasks.workunit.client.0.smithi144.stdout:/nfsroot/foo/bar/baz/sasquatch (sasquatch): FILE 2024-06-04T16:02:18.674 INFO:tasks.workunit.client.0.smithi144.stdout:/nfsroot/foo/bar/baz/sasquatch (sasquatch): FILE 2024-06-04T16:02:18.675 INFO:tasks.workunit.client.0.smithi144.stdout:/nfsroot/foo/bar/baz/quux (quux): FILE 2024-06-04T16:02:18.675 INFO:tasks.workunit.client.0.smithi144.stdout:/nfsroot/foo/bar/baz/momma (momma): FILE 2024-06-04T16:02:18.675 INFO:tasks.workunit.client.0.smithi144.stdout:/nfsroot/foo/bar/baz/hungry (hungry): FILE 2024-06-04T16:02:18.676 INFO:tasks.workunit.client.0.smithi144.stdout:/nfsroot/foo/bar/baz/hungry (hungry): FILE 2024-06-04T16:02:18.676 INFO:tasks.workunit.client.0.smithi144.stdout:/nfsroot/foo/bar/baz/frobozz (frobozz): FILE 2024-06-04T16:02:18.678 INFO:tasks.workunit.client.0.smithi144.stdout:/nfsroot/foo/bar/baz/bear (bear): DIR 2024-06-04T16:02:18.678 INFO:tasks.workunit.client.0.smithi144.stdout:/nfsroot/foo/bar/baz (baz): DIR 2024-06-04T16:02:18.679 INFO:tasks.workunit.client.0.smithi144.stdout:/nfsroot/foo/bar (bar): DIR 2024-06-04T16:02:18.679 INFO:tasks.workunit.client.0.smithi144.stdout:/nfsroot/foo (foo): DIR 2024-06-04T16:02:18.679 INFO:tasks.workunit.client.0.smithi144.stdout:/nfsroot (nfsroot): DIR 2024-06-04T16:02:18.679 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] LibRGW.HIER1 (18 ms) 2024-06-04T16:02:18.679 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2024-06-04T16:02:18.679 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (0 ms) 2024-06-04T16:02:18.679 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2024-06-04T16:02:18.679 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (0 ms) 2024-06-04T16:02:18.679 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2024-06-04T16:02:18.679 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] LibRGW.MARKER1_READDIR (0 ms) 2024-06-04T16:02:18.679 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2024-06-04T16:02:18.679 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2024-06-04T16:02:18.679 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] LibRGW.CLEANUP 2024-06-04T16:02:18.679 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-06-04T16:02:18.680 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] LibRGW.UMOUNT 2024-06-04T16:02:18.680 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-06-04T16:02:18.680 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-06-04T16:02:18.680 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:02:18.678+0000 7fc77dc2e8c0 -1 shutting down 2024-06-04T16:02:18.680 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:02:18.679+0000 7fc65796d640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 65304, si_uid : 1000, si_addr0x3e80000ff18, si_status0 2024-06-04T16:02:48.980 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] LibRGW.SHUTDOWN (30301 ms) 2024-06-04T16:02:48.980 INFO:tasks.workunit.client.0.smithi144.stdout:[----------] 24 tests from LibRGW (31034 ms total) 2024-06-04T16:02:48.980 INFO:tasks.workunit.client.0.smithi144.stdout: 2024-06-04T16:02:48.980 INFO:tasks.workunit.client.0.smithi144.stdout:[----------] Global test environment tear-down 2024-06-04T16:02:48.980 INFO:tasks.workunit.client.0.smithi144.stdout:[==========] 24 tests from 1 test suite ran. (31034 ms total) 2024-06-04T16:02:48.981 INFO:tasks.workunit.client.0.smithi144.stdout:[ PASSED ] 24 tests. 2024-06-04T16:02:48.985 INFO:tasks.workunit.client.0.smithi144.stdout:phase 2.1 2024-06-04T16:02:49.010 INFO:tasks.workunit.client.0.smithi144.stdout:[==========] Running 9 tests from 1 test suite. 2024-06-04T16:02:49.031 INFO:tasks.workunit.client.0.smithi144.stdout:[----------] Global test environment set-up. 2024-06-04T16:02:49.031 INFO:tasks.workunit.client.0.smithi144.stdout:[----------] 9 tests from LibRGW 2024-06-04T16:02:49.032 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] LibRGW.INIT 2024-06-04T16:02:49.032 INFO:tasks.workunit.client.0.smithi144.stderr:ignoring --setuser ceph since I am not root 2024-06-04T16:02:49.032 INFO:tasks.workunit.client.0.smithi144.stderr:ignoring --setgroup ceph since I am not root 2024-06-04T16:02:49.397 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] LibRGW.INIT (387 ms) 2024-06-04T16:02:49.397 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] LibRGW.MOUNT 2024-06-04T16:02:49.398 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] LibRGW.MOUNT (0 ms) 2024-06-04T16:02:49.398 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-06-04T16:02:49.406 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] LibRGW.CREATE_BUCKET (8 ms) 2024-06-04T16:02:49.406 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-06-04T16:02:49.406 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] LibRGW.DELETE_BUCKET (0 ms) 2024-06-04T16:02:49.406 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] LibRGW.CREATE_BUCKET_MULTI 2024-06-04T16:02:49.414 INFO:tasks.workunit.client.0.smithi144.stdout:created: sorrydave0 2024-06-04T16:02:49.421 INFO:tasks.workunit.client.0.smithi144.stdout:created: sorrydave1 2024-06-04T16:02:49.432 INFO:tasks.workunit.client.0.smithi144.stdout:created: sorrydave2 2024-06-04T16:02:49.439 INFO:tasks.workunit.client.0.smithi144.stdout:created: sorrydave3 2024-06-04T16:02:49.449 INFO:tasks.workunit.client.0.smithi144.stdout:created: sorrydave4 2024-06-04T16:02:49.456 INFO:tasks.workunit.client.0.smithi144.stdout:created: sorrydave5 2024-06-04T16:02:49.464 INFO:tasks.workunit.client.0.smithi144.stdout:created: sorrydave6 2024-06-04T16:02:49.471 INFO:tasks.workunit.client.0.smithi144.stdout:created: sorrydave7 2024-06-04T16:02:49.479 INFO:tasks.workunit.client.0.smithi144.stdout:created: sorrydave8 2024-06-04T16:02:49.487 INFO:tasks.workunit.client.0.smithi144.stdout:created: sorrydave9 2024-06-04T16:02:49.487 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] LibRGW.CREATE_BUCKET_MULTI (81 ms) 2024-06-04T16:02:49.487 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] LibRGW.DELETE_BUCKET_MULTI 2024-06-04T16:02:49.741 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] LibRGW.DELETE_BUCKET_MULTI (253 ms) 2024-06-04T16:02:49.742 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] LibRGW.CLEANUP 2024-06-04T16:02:49.742 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-06-04T16:02:49.742 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] LibRGW.UMOUNT 2024-06-04T16:02:49.742 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-06-04T16:02:49.742 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-06-04T16:02:49.742 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:02:49.741+0000 7f294d63a8c0 -1 shutting down 2024-06-04T16:02:49.742 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:02:49.742+0000 7f2824ba4640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 65923, si_uid : 1000, si_addr0x3e800010183, si_status0 2024-06-04T16:03:19.728 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] LibRGW.SHUTDOWN (29986 ms) 2024-06-04T16:03:19.744 INFO:tasks.workunit.client.0.smithi144.stdout:[----------] 9 tests from LibRGW (30718 ms total) 2024-06-04T16:03:19.744 INFO:tasks.workunit.client.0.smithi144.stdout: 2024-06-04T16:03:19.744 INFO:tasks.workunit.client.0.smithi144.stdout:[----------] Global test environment tear-down 2024-06-04T16:03:19.744 INFO:tasks.workunit.client.0.smithi144.stdout:[==========] 9 tests from 1 test suite ran. (30718 ms total) 2024-06-04T16:03:19.744 INFO:tasks.workunit.client.0.smithi144.stdout:[ PASSED ] 9 tests. 2024-06-04T16:03:19.745 INFO:tasks.workunit.client.0.smithi144.stdout:phase 2.2 2024-06-04T16:03:19.758 INFO:tasks.workunit.client.0.smithi144.stdout:[==========] Running 9 tests from 1 test suite. 2024-06-04T16:03:19.758 INFO:tasks.workunit.client.0.smithi144.stdout:[----------] Global test environment set-up. 2024-06-04T16:03:19.758 INFO:tasks.workunit.client.0.smithi144.stdout:[----------] 9 tests from LibRGW 2024-06-04T16:03:19.758 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] LibRGW.INIT 2024-06-04T16:03:19.767 INFO:tasks.workunit.client.0.smithi144.stderr:ignoring --setuser ceph since I am not root 2024-06-04T16:03:19.767 INFO:tasks.workunit.client.0.smithi144.stderr:ignoring --setgroup ceph since I am not root 2024-06-04T16:03:19.953 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] LibRGW.INIT (195 ms) 2024-06-04T16:03:19.953 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] LibRGW.MOUNT 2024-06-04T16:03:19.954 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] LibRGW.MOUNT (0 ms) 2024-06-04T16:03:19.954 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-06-04T16:03:19.954 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] LibRGW.CREATE_BUCKET (0 ms) 2024-06-04T16:03:19.954 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-06-04T16:03:19.982 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] LibRGW.DELETE_BUCKET (29 ms) 2024-06-04T16:03:19.982 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] LibRGW.CREATE_BUCKET_MULTI 2024-06-04T16:03:19.991 INFO:tasks.workunit.client.0.smithi144.stdout:created: sorrydave0 2024-06-04T16:03:19.998 INFO:tasks.workunit.client.0.smithi144.stdout:created: sorrydave1 2024-06-04T16:03:20.007 INFO:tasks.workunit.client.0.smithi144.stdout:created: sorrydave2 2024-06-04T16:03:20.016 INFO:tasks.workunit.client.0.smithi144.stdout:created: sorrydave3 2024-06-04T16:03:20.023 INFO:tasks.workunit.client.0.smithi144.stdout:created: sorrydave4 2024-06-04T16:03:20.031 INFO:tasks.workunit.client.0.smithi144.stdout:created: sorrydave5 2024-06-04T16:03:20.038 INFO:tasks.workunit.client.0.smithi144.stdout:created: sorrydave6 2024-06-04T16:03:20.046 INFO:tasks.workunit.client.0.smithi144.stdout:created: sorrydave7 2024-06-04T16:03:20.053 INFO:tasks.workunit.client.0.smithi144.stdout:created: sorrydave8 2024-06-04T16:03:20.061 INFO:tasks.workunit.client.0.smithi144.stdout:created: sorrydave9 2024-06-04T16:03:20.061 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] LibRGW.CREATE_BUCKET_MULTI (79 ms) 2024-06-04T16:03:20.061 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] LibRGW.DELETE_BUCKET_MULTI 2024-06-04T16:03:20.316 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] LibRGW.DELETE_BUCKET_MULTI (254 ms) 2024-06-04T16:03:20.316 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] LibRGW.CLEANUP 2024-06-04T16:03:20.316 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-06-04T16:03:20.316 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] LibRGW.UMOUNT 2024-06-04T16:03:20.316 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-06-04T16:03:20.316 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-06-04T16:03:20.317 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:03:20.315+0000 7fbacf3248c0 -1 shutting down 2024-06-04T16:03:20.317 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:03:20.316+0000 7fb9a71ab640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 66542, si_uid : 1000, si_addr0x3e8000103ee, si_status0 2024-06-04T16:03:50.063 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] LibRGW.SHUTDOWN (29746 ms) 2024-06-04T16:03:50.063 INFO:tasks.workunit.client.0.smithi144.stdout:[----------] 9 tests from LibRGW (30304 ms total) 2024-06-04T16:03:50.063 INFO:tasks.workunit.client.0.smithi144.stdout: 2024-06-04T16:03:50.063 INFO:tasks.workunit.client.0.smithi144.stdout:[----------] Global test environment tear-down 2024-06-04T16:03:50.063 INFO:tasks.workunit.client.0.smithi144.stdout:[==========] 9 tests from 1 test suite ran. (30304 ms total) 2024-06-04T16:03:50.063 INFO:tasks.workunit.client.0.smithi144.stdout:[ PASSED ] 9 tests. 2024-06-04T16:03:50.068 INFO:tasks.workunit.client.0.smithi144.stdout:phase 3.1 2024-06-04T16:03:50.384 INFO:tasks.workunit.client.0.smithi144.stdout:[==========] Running 13 tests from 1 test suite. 2024-06-04T16:03:50.385 INFO:tasks.workunit.client.0.smithi144.stdout:[----------] Global test environment set-up. 2024-06-04T16:03:50.385 INFO:tasks.workunit.client.0.smithi144.stdout:[----------] 13 tests from LibRGW 2024-06-04T16:03:50.385 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] LibRGW.INIT 2024-06-04T16:03:50.393 INFO:tasks.workunit.client.0.smithi144.stderr:ignoring --setuser ceph since I am not root 2024-06-04T16:03:50.394 INFO:tasks.workunit.client.0.smithi144.stderr:ignoring --setgroup ceph since I am not root 2024-06-04T16:03:50.766 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] LibRGW.INIT (381 ms) 2024-06-04T16:03:50.767 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] LibRGW.MOUNT 2024-06-04T16:03:50.767 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] LibRGW.MOUNT (0 ms) 2024-06-04T16:03:50.767 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-06-04T16:03:50.776 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] LibRGW.CREATE_BUCKET (9 ms) 2024-06-04T16:03:50.776 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] LibRGW.LOOKUP_BUCKET 2024-06-04T16:03:50.779 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] LibRGW.LOOKUP_BUCKET (3 ms) 2024-06-04T16:03:50.779 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] LibRGW.LOOKUP_OBJECT 2024-06-04T16:03:50.781 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] LibRGW.LOOKUP_OBJECT (3 ms) 2024-06-04T16:03:50.781 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] LibRGW.LARGE1 2024-06-04T16:03:50.848 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] LibRGW.LARGE1 (66 ms) 2024-06-04T16:03:50.848 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] LibRGW.LARGE2 2024-06-04T16:03:50.898 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] LibRGW.LARGE2 (50 ms) 2024-06-04T16:03:50.898 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] LibRGW.STAT_OBJECT 2024-06-04T16:03:50.898 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] LibRGW.STAT_OBJECT (0 ms) 2024-06-04T16:03:50.898 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] LibRGW.DELETE_OBJECT 2024-06-04T16:03:50.898 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] LibRGW.DELETE_OBJECT (0 ms) 2024-06-04T16:03:50.898 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-06-04T16:03:50.899 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] LibRGW.DELETE_BUCKET (0 ms) 2024-06-04T16:03:50.899 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] LibRGW.CLEANUP 2024-06-04T16:03:50.899 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-06-04T16:03:50.899 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] LibRGW.UMOUNT 2024-06-04T16:03:50.899 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-06-04T16:03:50.899 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-06-04T16:03:50.899 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:03:50.896+0000 7f567b5378c0 -1 shutting down 2024-06-04T16:03:50.899 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:03:50.898+0000 7f55533c3640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 67162, si_uid : 1000, si_addr0x3e80001065a, si_status0 2024-06-04T16:04:20.816 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] LibRGW.SHUTDOWN (29918 ms) 2024-06-04T16:04:20.817 INFO:tasks.workunit.client.0.smithi144.stdout:[----------] 13 tests from LibRGW (30431 ms total) 2024-06-04T16:04:20.817 INFO:tasks.workunit.client.0.smithi144.stdout: 2024-06-04T16:04:20.817 INFO:tasks.workunit.client.0.smithi144.stdout:[----------] Global test environment tear-down 2024-06-04T16:04:20.817 INFO:tasks.workunit.client.0.smithi144.stdout:[==========] 13 tests from 1 test suite ran. (30431 ms total) 2024-06-04T16:04:20.817 INFO:tasks.workunit.client.0.smithi144.stdout:[ PASSED ] 13 tests. 2024-06-04T16:04:20.824 INFO:tasks.workunit.client.0.smithi144.stdout:phase 3.2 2024-06-04T16:04:21.141 INFO:tasks.workunit.client.0.smithi144.stdout:[==========] Running 13 tests from 1 test suite. 2024-06-04T16:04:21.141 INFO:tasks.workunit.client.0.smithi144.stdout:[----------] Global test environment set-up. 2024-06-04T16:04:21.141 INFO:tasks.workunit.client.0.smithi144.stdout:[----------] 13 tests from LibRGW 2024-06-04T16:04:21.141 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] LibRGW.INIT 2024-06-04T16:04:21.149 INFO:tasks.workunit.client.0.smithi144.stderr:ignoring --setuser ceph since I am not root 2024-06-04T16:04:21.149 INFO:tasks.workunit.client.0.smithi144.stderr:ignoring --setgroup ceph since I am not root 2024-06-04T16:04:21.521 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] LibRGW.INIT (381 ms) 2024-06-04T16:04:21.522 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] LibRGW.MOUNT 2024-06-04T16:04:21.522 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-06-04T16:04:21.522 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-06-04T16:04:21.522 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] LibRGW.CREATE_BUCKET (0 ms) 2024-06-04T16:04:21.523 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] LibRGW.LOOKUP_BUCKET 2024-06-04T16:04:21.527 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] LibRGW.LOOKUP_BUCKET (4 ms) 2024-06-04T16:04:21.527 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] LibRGW.LOOKUP_OBJECT 2024-06-04T16:04:21.531 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] LibRGW.LOOKUP_OBJECT (4 ms) 2024-06-04T16:04:21.531 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] LibRGW.LARGE1 2024-06-04T16:04:21.600 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] LibRGW.LARGE1 (69 ms) 2024-06-04T16:04:21.600 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] LibRGW.LARGE2 2024-06-04T16:04:21.600 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] LibRGW.LARGE2 (0 ms) 2024-06-04T16:04:21.600 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] LibRGW.STAT_OBJECT 2024-06-04T16:04:21.600 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] LibRGW.STAT_OBJECT (0 ms) 2024-06-04T16:04:21.600 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] LibRGW.DELETE_OBJECT 2024-06-04T16:04:21.608 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] LibRGW.DELETE_OBJECT (9 ms) 2024-06-04T16:04:21.609 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-06-04T16:04:21.637 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] LibRGW.DELETE_BUCKET (29 ms) 2024-06-04T16:04:21.638 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] LibRGW.CLEANUP 2024-06-04T16:04:21.638 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-06-04T16:04:21.638 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] LibRGW.UMOUNT 2024-06-04T16:04:21.638 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-06-04T16:04:21.638 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-06-04T16:04:21.638 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:04:21.637+0000 7f56408398c0 -1 shutting down 2024-06-04T16:04:21.639 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:04:21.638+0000 7f5517e04640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 67781, si_uid : 1000, si_addr0x3e8000108c5, si_status0 2024-06-04T16:04:51.708 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] LibRGW.SHUTDOWN (30069 ms) 2024-06-04T16:04:51.708 INFO:tasks.workunit.client.0.smithi144.stdout:[----------] 13 tests from LibRGW (30566 ms total) 2024-06-04T16:04:51.708 INFO:tasks.workunit.client.0.smithi144.stdout: 2024-06-04T16:04:51.708 INFO:tasks.workunit.client.0.smithi144.stdout:[----------] Global test environment tear-down 2024-06-04T16:04:51.708 INFO:tasks.workunit.client.0.smithi144.stdout:[==========] 13 tests from 1 test suite ran. (30566 ms total) 2024-06-04T16:04:51.709 INFO:tasks.workunit.client.0.smithi144.stdout:[ PASSED ] 13 tests. 2024-06-04T16:04:51.714 INFO:tasks.workunit.client.0.smithi144.stdout:phase 4.1 2024-06-04T16:04:51.739 INFO:tasks.workunit.client.0.smithi144.stdout:[==========] Running 11 tests from 1 test suite. 2024-06-04T16:04:51.739 INFO:tasks.workunit.client.0.smithi144.stdout:[----------] Global test environment set-up. 2024-06-04T16:04:51.739 INFO:tasks.workunit.client.0.smithi144.stdout:[----------] 11 tests from LibRGW 2024-06-04T16:04:51.739 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] LibRGW.TVAR 2024-06-04T16:04:51.739 INFO:tasks.workunit.client.0.smithi144.stdout:read i1: 64001 2024-06-04T16:04:51.740 INFO:tasks.workunit.client.0.smithi144.stdout:read s1: blunderbuss 2024-06-04T16:04:51.740 INFO:tasks.workunit.client.0.smithi144.stdout:read s3: [ OK ] LibRGW.TVAR (0 ms) 2024-06-04T16:04:51.740 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] LibRGW.INIT 2024-06-04T16:04:51.750 INFO:tasks.workunit.client.0.smithi144.stderr:ignoring --setuser ceph since I am not root 2024-06-04T16:04:51.750 INFO:tasks.workunit.client.0.smithi144.stderr:ignoring --setgroup ceph since I am not root 2024-06-04T16:04:52.136 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] LibRGW.INIT (397 ms) 2024-06-04T16:04:52.136 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] LibRGW.MOUNT 2024-06-04T16:04:52.137 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-06-04T16:04:52.137 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2024-06-04T16:04:52.152 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (16 ms) 2024-06-04T16:04:52.152 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2024-06-04T16:04:52.598 INFO:tasks.workunit.client.0.smithi144.stdout:created: dmarker:f_0 2024-06-04T16:04:52.599 INFO:tasks.workunit.client.0.smithi144.stdout:created: dmarker:f_1 2024-06-04T16:04:52.599 INFO:tasks.workunit.client.0.smithi144.stdout:created: dmarker:f_2 2024-06-04T16:04:52.599 INFO:tasks.workunit.client.0.smithi144.stdout:created: dmarker:f_3 2024-06-04T16:04:52.599 INFO:tasks.workunit.client.0.smithi144.stdout:created: dmarker:f_4 2024-06-04T16:04:52.599 INFO:tasks.workunit.client.0.smithi144.stdout:created: dmarker:f_5 2024-06-04T16:04:52.599 INFO:tasks.workunit.client.0.smithi144.stdout:created: dmarker:f_6 2024-06-04T16:04:52.599 INFO:tasks.workunit.client.0.smithi144.stdout:created: dmarker:f_7 2024-06-04T16:04:52.599 INFO:tasks.workunit.client.0.smithi144.stdout:created: dmarker:f_8 2024-06-04T16:04:52.599 INFO:tasks.workunit.client.0.smithi144.stdout:created: dmarker:f_9 2024-06-04T16:04:52.599 INFO:tasks.workunit.client.0.smithi144.stdout:created: dmarker:f_10 2024-06-04T16:04:52.599 INFO:tasks.workunit.client.0.smithi144.stdout:created: dmarker:f_11 2024-06-04T16:04:52.599 INFO:tasks.workunit.client.0.smithi144.stdout:created: dmarker:f_12 2024-06-04T16:04:52.599 INFO:tasks.workunit.client.0.smithi144.stdout:created: dmarker:f_13 2024-06-04T16:04:52.599 INFO:tasks.workunit.client.0.smithi144.stdout:created: dmarker:f_14 2024-06-04T16:04:52.600 INFO:tasks.workunit.client.0.smithi144.stdout:created: dmarker:f_15 2024-06-04T16:04:52.600 INFO:tasks.workunit.client.0.smithi144.stdout:created: dmarker:f_16 2024-06-04T16:04:52.600 INFO:tasks.workunit.client.0.smithi144.stdout:created: dmarker:f_17 2024-06-04T16:04:52.600 INFO:tasks.workunit.client.0.smithi144.stdout:created: dmarker:f_18 2024-06-04T16:04:52.600 INFO:tasks.workunit.client.0.smithi144.stdout:created: dmarker:f_19 2024-06-04T16:04:52.600 INFO:tasks.workunit.client.0.smithi144.stdout:created: dmarker:f_20 2024-06-04T16:04:52.600 INFO:tasks.workunit.client.0.smithi144.stdout:created: dmarker:f_21 2024-06-04T16:04:52.600 INFO:tasks.workunit.client.0.smithi144.stdout:created: dmarker:f_22 2024-06-04T16:04:52.600 INFO:tasks.workunit.client.0.smithi144.stdout:created: dmarker:f_23 2024-06-04T16:04:52.600 INFO:tasks.workunit.client.0.smithi144.stdout:created: dmarker:f_24 2024-06-04T16:04:52.600 INFO:tasks.workunit.client.0.smithi144.stdout:created: dmarker:f_25 2024-06-04T16:04:52.600 INFO:tasks.workunit.client.0.smithi144.stdout:created: dmarker:f_26 2024-06-04T16:04:52.600 INFO:tasks.workunit.client.0.smithi144.stdout:created: dmarker:f_27 2024-06-04T16:04:52.600 INFO:tasks.workunit.client.0.smithi144.stdout:created: dmarker:f_28 2024-06-04T16:04:52.601 INFO:tasks.workunit.client.0.smithi144.stdout:created: dmarker:f_29 2024-06-04T16:04:52.601 INFO:tasks.workunit.client.0.smithi144.stdout:created: dmarker:f_30 2024-06-04T16:04:52.601 INFO:tasks.workunit.client.0.smithi144.stdout:created: dmarker:f_31 2024-06-04T16:04:52.601 INFO:tasks.workunit.client.0.smithi144.stdout:created: dmarker:f_32 2024-06-04T16:04:52.601 INFO:tasks.workunit.client.0.smithi144.stdout:created: dmarker:f_33 2024-06-04T16:04:52.601 INFO:tasks.workunit.client.0.smithi144.stdout:created: dmarker:f_34 2024-06-04T16:04:52.601 INFO:tasks.workunit.client.0.smithi144.stdout:created: dmarker:f_35 2024-06-04T16:04:52.601 INFO:tasks.workunit.client.0.smithi144.stdout:created: dmarker:f_36 2024-06-04T16:04:52.601 INFO:tasks.workunit.client.0.smithi144.stdout:created: dmarker:f_37 2024-06-04T16:04:52.601 INFO:tasks.workunit.client.0.smithi144.stdout:created: dmarker:f_38 2024-06-04T16:04:52.601 INFO:tasks.workunit.client.0.smithi144.stdout:created: dmarker:f_39 2024-06-04T16:04:52.601 INFO:tasks.workunit.client.0.smithi144.stdout:created: dmarker:f_40 2024-06-04T16:04:52.601 INFO:tasks.workunit.client.0.smithi144.stdout:created: dmarker:f_41 2024-06-04T16:04:52.601 INFO:tasks.workunit.client.0.smithi144.stdout:created: dmarker:f_42 2024-06-04T16:04:52.602 INFO:tasks.workunit.client.0.smithi144.stdout:created: dmarker:f_43 2024-06-04T16:04:52.602 INFO:tasks.workunit.client.0.smithi144.stdout:created: dmarker:f_44 2024-06-04T16:04:52.602 INFO:tasks.workunit.client.0.smithi144.stdout:created: dmarker:f_45 2024-06-04T16:04:52.602 INFO:tasks.workunit.client.0.smithi144.stdout:created: dmarker:f_46 2024-06-04T16:04:52.602 INFO:tasks.workunit.client.0.smithi144.stdout:created: dmarker:f_47 2024-06-04T16:04:52.602 INFO:tasks.workunit.client.0.smithi144.stdout:created: dmarker:f_48 2024-06-04T16:04:52.602 INFO:tasks.workunit.client.0.smithi144.stdout:created: dmarker:f_49 2024-06-04T16:04:52.602 INFO:tasks.workunit.client.0.smithi144.stdout:created: dmarker:f_50 2024-06-04T16:04:52.602 INFO:tasks.workunit.client.0.smithi144.stdout:created: dmarker:f_51 2024-06-04T16:04:52.602 INFO:tasks.workunit.client.0.smithi144.stdout:created: dmarker:f_52 2024-06-04T16:04:52.602 INFO:tasks.workunit.client.0.smithi144.stdout:created: dmarker:f_53 2024-06-04T16:04:52.602 INFO:tasks.workunit.client.0.smithi144.stdout:created: dmarker:f_54 2024-06-04T16:04:52.603 INFO:tasks.workunit.client.0.smithi144.stdout:created: dmarker:f_55 2024-06-04T16:04:52.603 INFO:tasks.workunit.client.0.smithi144.stdout:created: dmarker:f_56 2024-06-04T16:04:52.603 INFO:tasks.workunit.client.0.smithi144.stdout:created: dmarker:f_57 2024-06-04T16:04:52.603 INFO:tasks.workunit.client.0.smithi144.stdout:created: dmarker:f_58 2024-06-04T16:04:52.603 INFO:tasks.workunit.client.0.smithi144.stdout:created: dmarker:f_59 2024-06-04T16:04:52.603 INFO:tasks.workunit.client.0.smithi144.stdout:created: dmarker:f_60 2024-06-04T16:04:52.603 INFO:tasks.workunit.client.0.smithi144.stdout:created: dmarker:f_61 2024-06-04T16:04:52.603 INFO:tasks.workunit.client.0.smithi144.stdout:created: dmarker:f_62 2024-06-04T16:04:52.603 INFO:tasks.workunit.client.0.smithi144.stdout:created: dmarker:f_63 2024-06-04T16:04:52.603 INFO:tasks.workunit.client.0.smithi144.stdout:created: dmarker:f_64 2024-06-04T16:04:52.603 INFO:tasks.workunit.client.0.smithi144.stdout:created: dmarker:f_65 2024-06-04T16:04:52.603 INFO:tasks.workunit.client.0.smithi144.stdout:created: dmarker:f_66 2024-06-04T16:04:52.603 INFO:tasks.workunit.client.0.smithi144.stdout:created: dmarker:f_67 2024-06-04T16:04:52.603 INFO:tasks.workunit.client.0.smithi144.stdout:created: dmarker:f_68 2024-06-04T16:04:52.603 INFO:tasks.workunit.client.0.smithi144.stdout:created: dmarker:f_69 2024-06-04T16:04:52.604 INFO:tasks.workunit.client.0.smithi144.stdout:created: dmarker:f_70 2024-06-04T16:04:52.604 INFO:tasks.workunit.client.0.smithi144.stdout:created: dmarker:f_71 2024-06-04T16:04:52.604 INFO:tasks.workunit.client.0.smithi144.stdout:created: dmarker:f_72 2024-06-04T16:04:52.604 INFO:tasks.workunit.client.0.smithi144.stdout:created: dmarker:f_73 2024-06-04T16:04:52.604 INFO:tasks.workunit.client.0.smithi144.stdout:created: dmarker:f_74 2024-06-04T16:04:52.604 INFO:tasks.workunit.client.0.smithi144.stdout:created: dmarker:f_75 2024-06-04T16:04:52.604 INFO:tasks.workunit.client.0.smithi144.stdout:created: dmarker:f_76 2024-06-04T16:04:52.604 INFO:tasks.workunit.client.0.smithi144.stdout:created: dmarker:f_77 2024-06-04T16:04:52.604 INFO:tasks.workunit.client.0.smithi144.stdout:created: dmarker:f_78 2024-06-04T16:04:52.604 INFO:tasks.workunit.client.0.smithi144.stdout:created: dmarker:f_79 2024-06-04T16:04:52.604 INFO:tasks.workunit.client.0.smithi144.stdout:created: dmarker:f_80 2024-06-04T16:04:52.604 INFO:tasks.workunit.client.0.smithi144.stdout:created: dmarker:f_81 2024-06-04T16:04:52.604 INFO:tasks.workunit.client.0.smithi144.stdout:created: dmarker:f_82 2024-06-04T16:04:52.604 INFO:tasks.workunit.client.0.smithi144.stdout:created: dmarker:f_83 2024-06-04T16:04:52.605 INFO:tasks.workunit.client.0.smithi144.stdout:created: dmarker:f_84 2024-06-04T16:04:52.605 INFO:tasks.workunit.client.0.smithi144.stdout:created: dmarker:f_85 2024-06-04T16:04:52.605 INFO:tasks.workunit.client.0.smithi144.stdout:created: dmarker:f_86 2024-06-04T16:04:52.605 INFO:tasks.workunit.client.0.smithi144.stdout:created: dmarker:f_87 2024-06-04T16:04:52.605 INFO:tasks.workunit.client.0.smithi144.stdout:created: dmarker:f_88 2024-06-04T16:04:52.605 INFO:tasks.workunit.client.0.smithi144.stdout:created: dmarker:f_89 2024-06-04T16:04:52.605 INFO:tasks.workunit.client.0.smithi144.stdout:created: dmarker:f_90 2024-06-04T16:04:52.605 INFO:tasks.workunit.client.0.smithi144.stdout:created: dmarker:f_91 2024-06-04T16:04:52.605 INFO:tasks.workunit.client.0.smithi144.stdout:created: dmarker:f_92 2024-06-04T16:04:52.605 INFO:tasks.workunit.client.0.smithi144.stdout:created: dmarker:f_93 2024-06-04T16:04:52.605 INFO:tasks.workunit.client.0.smithi144.stdout:created: dmarker:f_94 2024-06-04T16:04:52.605 INFO:tasks.workunit.client.0.smithi144.stdout:created: dmarker:f_95 2024-06-04T16:04:52.605 INFO:tasks.workunit.client.0.smithi144.stdout:created: dmarker:f_96 2024-06-04T16:04:52.605 INFO:tasks.workunit.client.0.smithi144.stdout:created: dmarker:f_97 2024-06-04T16:04:52.605 INFO:tasks.workunit.client.0.smithi144.stdout:created: dmarker:f_98 2024-06-04T16:04:52.606 INFO:tasks.workunit.client.0.smithi144.stdout:created: dmarker:f_99 2024-06-04T16:04:52.606 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (446 ms) 2024-06-04T16:04:52.606 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2024-06-04T16:04:52.607 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=. flags=4 2024-06-04T16:04:52.607 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=.. flags=4 2024-06-04T16:04:52.607 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_0 flags=8 2024-06-04T16:04:52.607 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_1 flags=8 2024-06-04T16:04:52.607 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_10 flags=8 2024-06-04T16:04:52.607 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_11 flags=8 2024-06-04T16:04:52.607 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_12 flags=8 2024-06-04T16:04:52.608 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_13 flags=8 2024-06-04T16:04:52.608 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_14 flags=8 2024-06-04T16:04:52.608 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_15 flags=8 2024-06-04T16:04:52.608 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_16 flags=8 2024-06-04T16:04:52.608 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_17 flags=8 2024-06-04T16:04:52.608 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_18 flags=8 2024-06-04T16:04:52.608 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_19 flags=8 2024-06-04T16:04:52.608 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_2 flags=8 2024-06-04T16:04:52.608 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_20 flags=8 2024-06-04T16:04:52.608 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_21 flags=8 2024-06-04T16:04:52.608 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_22 flags=8 2024-06-04T16:04:52.608 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_23 flags=8 2024-06-04T16:04:52.608 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_24 flags=8 2024-06-04T16:04:52.608 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_25 flags=8 2024-06-04T16:04:52.609 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_26 flags=8 2024-06-04T16:04:52.609 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_27 flags=8 2024-06-04T16:04:52.609 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_28 flags=8 2024-06-04T16:04:52.609 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_29 flags=8 2024-06-04T16:04:52.609 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_3 flags=8 2024-06-04T16:04:52.609 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_30 flags=8 2024-06-04T16:04:52.609 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_31 flags=8 2024-06-04T16:04:52.609 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_32 flags=8 2024-06-04T16:04:52.609 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_33 flags=8 2024-06-04T16:04:52.609 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_34 flags=8 2024-06-04T16:04:52.609 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_35 flags=8 2024-06-04T16:04:52.609 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_36 flags=8 2024-06-04T16:04:52.609 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_37 flags=8 2024-06-04T16:04:52.609 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_38 flags=8 2024-06-04T16:04:52.609 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_39 flags=8 2024-06-04T16:04:52.610 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_4 flags=8 2024-06-04T16:04:52.610 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_40 flags=8 2024-06-04T16:04:52.610 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_41 flags=8 2024-06-04T16:04:52.610 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_42 flags=8 2024-06-04T16:04:52.610 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_43 flags=8 2024-06-04T16:04:52.610 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_44 flags=8 2024-06-04T16:04:52.610 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_45 flags=8 2024-06-04T16:04:52.610 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_46 flags=8 2024-06-04T16:04:52.610 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_47 flags=8 2024-06-04T16:04:52.610 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_48 flags=8 2024-06-04T16:04:52.610 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_49 flags=8 2024-06-04T16:04:52.610 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_5 flags=8 2024-06-04T16:04:52.610 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_50 flags=8 2024-06-04T16:04:52.611 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_51 flags=8 2024-06-04T16:04:52.611 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_52 flags=8 2024-06-04T16:04:52.611 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_53 flags=8 2024-06-04T16:04:52.611 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_54 flags=8 2024-06-04T16:04:52.611 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_55 flags=8 2024-06-04T16:04:52.611 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_56 flags=8 2024-06-04T16:04:52.611 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_57 flags=8 2024-06-04T16:04:52.611 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_58 flags=8 2024-06-04T16:04:52.611 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_59 flags=8 2024-06-04T16:04:52.611 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_6 flags=8 2024-06-04T16:04:52.611 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_60 flags=8 2024-06-04T16:04:52.611 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_61 flags=8 2024-06-04T16:04:52.612 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_62 flags=8 2024-06-04T16:04:52.612 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_63 flags=8 2024-06-04T16:04:52.612 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_64 flags=8 2024-06-04T16:04:52.612 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_65 flags=8 2024-06-04T16:04:52.613 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_66 flags=8 2024-06-04T16:04:52.613 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_67 flags=8 2024-06-04T16:04:52.613 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_68 flags=8 2024-06-04T16:04:52.613 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_69 flags=8 2024-06-04T16:04:52.613 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_7 flags=8 2024-06-04T16:04:52.613 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_70 flags=8 2024-06-04T16:04:52.613 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_71 flags=8 2024-06-04T16:04:52.613 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_72 flags=8 2024-06-04T16:04:52.613 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_73 flags=8 2024-06-04T16:04:52.613 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_74 flags=8 2024-06-04T16:04:52.613 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_75 flags=8 2024-06-04T16:04:52.613 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_76 flags=8 2024-06-04T16:04:52.613 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_77 flags=8 2024-06-04T16:04:52.613 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_78 flags=8 2024-06-04T16:04:52.614 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_79 flags=8 2024-06-04T16:04:52.614 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_8 flags=8 2024-06-04T16:04:52.614 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_80 flags=8 2024-06-04T16:04:52.614 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_81 flags=8 2024-06-04T16:04:52.614 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_82 flags=8 2024-06-04T16:04:52.614 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_83 flags=8 2024-06-04T16:04:52.614 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_84 flags=8 2024-06-04T16:04:52.614 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_85 flags=8 2024-06-04T16:04:52.614 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_86 flags=8 2024-06-04T16:04:52.614 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_87 flags=8 2024-06-04T16:04:52.614 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_88 flags=8 2024-06-04T16:04:52.614 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_89 flags=8 2024-06-04T16:04:52.615 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_9 flags=8 2024-06-04T16:04:52.615 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_90 flags=8 2024-06-04T16:04:52.615 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_91 flags=8 2024-06-04T16:04:52.615 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_92 flags=8 2024-06-04T16:04:52.615 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_93 flags=8 2024-06-04T16:04:52.615 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_94 flags=8 2024-06-04T16:04:52.615 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_95 flags=8 2024-06-04T16:04:52.615 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_96 flags=8 2024-06-04T16:04:52.615 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_97 flags=8 2024-06-04T16:04:52.615 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_98 flags=8 2024-06-04T16:04:52.615 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_99 flags=8 2024-06-04T16:04:52.615 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] LibRGW.MARKER1_READDIR (2 ms) 2024-06-04T16:04:52.615 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] LibRGW.MARKER2_READDIR 2024-06-04T16:04:52.615 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_0 flags=8 2024-06-04T16:04:52.616 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_1 flags=8 2024-06-04T16:04:52.616 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_10 flags=8 2024-06-04T16:04:52.616 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_11 flags=8 2024-06-04T16:04:52.616 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_12 flags=8 2024-06-04T16:04:52.616 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_13 flags=8 2024-06-04T16:04:52.616 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_14 flags=8 2024-06-04T16:04:52.616 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_15 flags=8 2024-06-04T16:04:52.616 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_16 flags=8 2024-06-04T16:04:52.616 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_17 flags=8 2024-06-04T16:04:52.616 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_18 flags=8 2024-06-04T16:04:52.616 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_19 flags=8 2024-06-04T16:04:52.616 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_2 flags=8 2024-06-04T16:04:52.616 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_20 flags=8 2024-06-04T16:04:52.616 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_21 flags=8 2024-06-04T16:04:52.617 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_22 flags=8 2024-06-04T16:04:52.617 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_23 flags=8 2024-06-04T16:04:52.617 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_24 flags=8 2024-06-04T16:04:52.617 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_25 flags=8 2024-06-04T16:04:52.617 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_26 flags=8 2024-06-04T16:04:52.617 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_27 flags=8 2024-06-04T16:04:52.617 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_28 flags=8 2024-06-04T16:04:52.617 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_29 flags=8 2024-06-04T16:04:52.617 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_3 flags=8 2024-06-04T16:04:52.617 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_30 flags=8 2024-06-04T16:04:52.617 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_31 flags=8 2024-06-04T16:04:52.617 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_32 flags=8 2024-06-04T16:04:52.617 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_33 flags=8 2024-06-04T16:04:52.617 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_34 flags=8 2024-06-04T16:04:52.617 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_35 flags=8 2024-06-04T16:04:52.618 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_36 flags=8 2024-06-04T16:04:52.618 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_37 flags=8 2024-06-04T16:04:52.618 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_38 flags=8 2024-06-04T16:04:52.618 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_39 flags=8 2024-06-04T16:04:52.618 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_4 flags=8 2024-06-04T16:04:52.618 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_40 flags=8 2024-06-04T16:04:52.618 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_41 flags=8 2024-06-04T16:04:52.618 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_42 flags=8 2024-06-04T16:04:52.618 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_43 flags=8 2024-06-04T16:04:52.618 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_44 flags=8 2024-06-04T16:04:52.618 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_45 flags=8 2024-06-04T16:04:52.618 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_46 flags=8 2024-06-04T16:04:52.618 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_47 flags=8 2024-06-04T16:04:52.618 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_48 flags=8 2024-06-04T16:04:52.619 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_49 flags=8 2024-06-04T16:04:52.619 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_5 flags=8 2024-06-04T16:04:52.619 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_50 flags=8 2024-06-04T16:04:52.619 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_51 flags=8 2024-06-04T16:04:52.619 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_52 flags=8 2024-06-04T16:04:52.619 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_53 flags=8 2024-06-04T16:04:52.619 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_54 flags=8 2024-06-04T16:04:52.619 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_55 flags=8 2024-06-04T16:04:52.619 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_56 flags=8 2024-06-04T16:04:52.619 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_57 flags=8 2024-06-04T16:04:52.619 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_58 flags=8 2024-06-04T16:04:52.619 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_59 flags=8 2024-06-04T16:04:52.619 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_6 flags=8 2024-06-04T16:04:52.619 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_60 flags=8 2024-06-04T16:04:52.619 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_61 flags=8 2024-06-04T16:04:52.620 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_62 flags=8 2024-06-04T16:04:52.620 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_63 flags=8 2024-06-04T16:04:52.620 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_64 flags=8 2024-06-04T16:04:52.620 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_65 flags=8 2024-06-04T16:04:52.620 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_66 flags=8 2024-06-04T16:04:52.620 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_67 flags=8 2024-06-04T16:04:52.620 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_68 flags=8 2024-06-04T16:04:52.620 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_69 flags=8 2024-06-04T16:04:52.620 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_7 flags=8 2024-06-04T16:04:52.620 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_70 flags=8 2024-06-04T16:04:52.620 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_71 flags=8 2024-06-04T16:04:52.620 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_72 flags=8 2024-06-04T16:04:52.620 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_73 flags=8 2024-06-04T16:04:52.620 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_74 flags=8 2024-06-04T16:04:52.620 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_75 flags=8 2024-06-04T16:04:52.621 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_76 flags=8 2024-06-04T16:04:52.621 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_77 flags=8 2024-06-04T16:04:52.621 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_78 flags=8 2024-06-04T16:04:52.621 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_79 flags=8 2024-06-04T16:04:52.621 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_8 flags=8 2024-06-04T16:04:52.621 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_80 flags=8 2024-06-04T16:04:52.621 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_81 flags=8 2024-06-04T16:04:52.621 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_82 flags=8 2024-06-04T16:04:52.621 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_83 flags=8 2024-06-04T16:04:52.621 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_84 flags=8 2024-06-04T16:04:52.621 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_85 flags=8 2024-06-04T16:04:52.621 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_86 flags=8 2024-06-04T16:04:52.621 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_87 flags=8 2024-06-04T16:04:52.621 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_88 flags=8 2024-06-04T16:04:52.621 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_89 flags=8 2024-06-04T16:04:52.622 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_9 flags=8 2024-06-04T16:04:52.622 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_90 flags=8 2024-06-04T16:04:52.622 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_91 flags=8 2024-06-04T16:04:52.622 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_92 flags=8 2024-06-04T16:04:52.622 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_93 flags=8 2024-06-04T16:04:52.622 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_94 flags=8 2024-06-04T16:04:52.622 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_95 flags=8 2024-06-04T16:04:52.622 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_96 flags=8 2024-06-04T16:04:52.622 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_97 flags=8 2024-06-04T16:04:52.622 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_98 flags=8 2024-06-04T16:04:52.622 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_99 flags=8 2024-06-04T16:04:52.622 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] LibRGW.MARKER2_READDIR (2 ms) 2024-06-04T16:04:52.622 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2024-06-04T16:04:52.622 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2024-06-04T16:04:52.623 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] LibRGW.CLEANUP 2024-06-04T16:04:52.623 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-06-04T16:04:52.623 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] LibRGW.UMOUNT 2024-06-04T16:04:52.623 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-06-04T16:04:52.623 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-06-04T16:04:52.623 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:04:52.601+0000 7f16ebe328c0 -1 shutting down 2024-06-04T16:04:52.623 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:04:52.602+0000 7f15c13e1640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 68400, si_uid : 1000, si_addr0x3e800010b30, si_status0 2024-06-04T16:05:22.539 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] LibRGW.SHUTDOWN (29936 ms) 2024-06-04T16:05:22.540 INFO:tasks.workunit.client.0.smithi144.stdout:[----------] 11 tests from LibRGW (30800 ms total) 2024-06-04T16:05:22.540 INFO:tasks.workunit.client.0.smithi144.stdout: 2024-06-04T16:05:22.540 INFO:tasks.workunit.client.0.smithi144.stdout:[----------] Global test environment tear-down 2024-06-04T16:05:22.540 INFO:tasks.workunit.client.0.smithi144.stdout:[==========] 11 tests from 1 test suite ran. (30800 ms total) 2024-06-04T16:05:22.540 INFO:tasks.workunit.client.0.smithi144.stdout:[ PASSED ] 11 tests. 2024-06-04T16:05:22.546 INFO:tasks.workunit.client.0.smithi144.stdout:phase 4.2 2024-06-04T16:05:22.571 INFO:tasks.workunit.client.0.smithi144.stdout:[==========] Running 11 tests from 1 test suite. 2024-06-04T16:05:22.571 INFO:tasks.workunit.client.0.smithi144.stdout:[----------] Global test environment set-up. 2024-06-04T16:05:22.571 INFO:tasks.workunit.client.0.smithi144.stdout:[----------] 11 tests from LibRGW 2024-06-04T16:05:22.571 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] LibRGW.TVAR 2024-06-04T16:05:22.571 INFO:tasks.workunit.client.0.smithi144.stdout:read i1: 64001 2024-06-04T16:05:22.572 INFO:tasks.workunit.client.0.smithi144.stdout:read s1: blunderbuss 2024-06-04T16:05:22.572 INFO:tasks.workunit.client.0.smithi144.stdout:read s3: [ OK ] LibRGW.TVAR (0 ms) 2024-06-04T16:05:22.572 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] LibRGW.INIT 2024-06-04T16:05:22.579 INFO:tasks.workunit.client.0.smithi144.stderr:ignoring --setuser ceph since I am not root 2024-06-04T16:05:22.579 INFO:tasks.workunit.client.0.smithi144.stderr:ignoring --setgroup ceph since I am not root 2024-06-04T16:05:22.962 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] LibRGW.INIT (390 ms) 2024-06-04T16:05:22.962 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] LibRGW.MOUNT 2024-06-04T16:05:22.962 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-06-04T16:05:22.962 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2024-06-04T16:05:22.970 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (8 ms) 2024-06-04T16:05:22.971 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2024-06-04T16:05:22.971 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (0 ms) 2024-06-04T16:05:22.971 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2024-06-04T16:05:22.971 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] LibRGW.MARKER1_READDIR (0 ms) 2024-06-04T16:05:22.971 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] LibRGW.MARKER2_READDIR 2024-06-04T16:05:22.973 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_0 flags=8 2024-06-04T16:05:22.973 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_1 flags=8 2024-06-04T16:05:22.973 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_10 flags=8 2024-06-04T16:05:22.974 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_11 flags=8 2024-06-04T16:05:22.974 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_12 flags=8 2024-06-04T16:05:22.974 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_13 flags=8 2024-06-04T16:05:22.974 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_14 flags=8 2024-06-04T16:05:22.974 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_15 flags=8 2024-06-04T16:05:22.974 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_16 flags=8 2024-06-04T16:05:22.974 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_17 flags=8 2024-06-04T16:05:22.974 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_18 flags=8 2024-06-04T16:05:22.974 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_19 flags=8 2024-06-04T16:05:22.974 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_2 flags=8 2024-06-04T16:05:22.974 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_20 flags=8 2024-06-04T16:05:22.975 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_21 flags=8 2024-06-04T16:05:22.975 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_22 flags=8 2024-06-04T16:05:22.975 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_23 flags=8 2024-06-04T16:05:22.975 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_24 flags=8 2024-06-04T16:05:22.975 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_25 flags=8 2024-06-04T16:05:22.975 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_26 flags=8 2024-06-04T16:05:22.975 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_27 flags=8 2024-06-04T16:05:22.975 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_28 flags=8 2024-06-04T16:05:22.975 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_29 flags=8 2024-06-04T16:05:22.976 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_3 flags=8 2024-06-04T16:05:22.976 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_30 flags=8 2024-06-04T16:05:22.976 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_31 flags=8 2024-06-04T16:05:22.976 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_32 flags=8 2024-06-04T16:05:22.976 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_33 flags=8 2024-06-04T16:05:22.976 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_34 flags=8 2024-06-04T16:05:22.976 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_35 flags=8 2024-06-04T16:05:22.976 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_36 flags=8 2024-06-04T16:05:22.976 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_37 flags=8 2024-06-04T16:05:22.976 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_38 flags=8 2024-06-04T16:05:22.976 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_39 flags=8 2024-06-04T16:05:22.976 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_4 flags=8 2024-06-04T16:05:22.976 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_40 flags=8 2024-06-04T16:05:22.977 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_41 flags=8 2024-06-04T16:05:22.977 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_42 flags=8 2024-06-04T16:05:22.977 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_43 flags=8 2024-06-04T16:05:22.977 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_44 flags=8 2024-06-04T16:05:22.977 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_45 flags=8 2024-06-04T16:05:22.977 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_46 flags=8 2024-06-04T16:05:22.977 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_47 flags=8 2024-06-04T16:05:22.977 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_48 flags=8 2024-06-04T16:05:22.977 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_49 flags=8 2024-06-04T16:05:22.977 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_5 flags=8 2024-06-04T16:05:22.977 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_50 flags=8 2024-06-04T16:05:22.977 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_51 flags=8 2024-06-04T16:05:22.977 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_52 flags=8 2024-06-04T16:05:22.978 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_53 flags=8 2024-06-04T16:05:22.978 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_54 flags=8 2024-06-04T16:05:22.978 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_55 flags=8 2024-06-04T16:05:22.978 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_56 flags=8 2024-06-04T16:05:22.978 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_57 flags=8 2024-06-04T16:05:22.978 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_58 flags=8 2024-06-04T16:05:22.978 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_59 flags=8 2024-06-04T16:05:22.978 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_6 flags=8 2024-06-04T16:05:22.978 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_60 flags=8 2024-06-04T16:05:22.978 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_61 flags=8 2024-06-04T16:05:22.978 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_62 flags=8 2024-06-04T16:05:22.978 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_63 flags=8 2024-06-04T16:05:22.979 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_64 flags=8 2024-06-04T16:05:22.979 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_65 flags=8 2024-06-04T16:05:22.979 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_66 flags=8 2024-06-04T16:05:22.979 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_67 flags=8 2024-06-04T16:05:22.979 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_68 flags=8 2024-06-04T16:05:22.979 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_69 flags=8 2024-06-04T16:05:22.979 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_7 flags=8 2024-06-04T16:05:22.979 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_70 flags=8 2024-06-04T16:05:22.979 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_71 flags=8 2024-06-04T16:05:22.979 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_72 flags=8 2024-06-04T16:05:22.979 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_73 flags=8 2024-06-04T16:05:22.979 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_74 flags=8 2024-06-04T16:05:22.979 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_75 flags=8 2024-06-04T16:05:22.979 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_76 flags=8 2024-06-04T16:05:22.979 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_77 flags=8 2024-06-04T16:05:22.980 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_78 flags=8 2024-06-04T16:05:22.980 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_79 flags=8 2024-06-04T16:05:22.980 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_8 flags=8 2024-06-04T16:05:22.980 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_80 flags=8 2024-06-04T16:05:22.980 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_81 flags=8 2024-06-04T16:05:22.980 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_82 flags=8 2024-06-04T16:05:22.980 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_83 flags=8 2024-06-04T16:05:22.980 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_84 flags=8 2024-06-04T16:05:22.980 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_85 flags=8 2024-06-04T16:05:22.980 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_86 flags=8 2024-06-04T16:05:22.980 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_87 flags=8 2024-06-04T16:05:22.980 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_88 flags=8 2024-06-04T16:05:22.980 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_89 flags=8 2024-06-04T16:05:22.981 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_9 flags=8 2024-06-04T16:05:22.981 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_90 flags=8 2024-06-04T16:05:22.981 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_91 flags=8 2024-06-04T16:05:22.981 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_92 flags=8 2024-06-04T16:05:22.981 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_93 flags=8 2024-06-04T16:05:22.981 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_94 flags=8 2024-06-04T16:05:22.981 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_95 flags=8 2024-06-04T16:05:22.981 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_96 flags=8 2024-06-04T16:05:22.981 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_97 flags=8 2024-06-04T16:05:22.981 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_98 flags=8 2024-06-04T16:05:22.981 INFO:tasks.workunit.client.0.smithi144.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_99 flags=8 2024-06-04T16:05:22.981 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] LibRGW.MARKER2_READDIR (2 ms) 2024-06-04T16:05:22.981 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2024-06-04T16:05:22.981 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2024-06-04T16:05:22.982 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] LibRGW.CLEANUP 2024-06-04T16:05:22.982 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-06-04T16:05:22.982 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] LibRGW.UMOUNT 2024-06-04T16:05:22.982 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-06-04T16:05:22.982 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-06-04T16:05:22.982 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:05:22.972+0000 7f22980df8c0 -1 shutting down 2024-06-04T16:05:22.983 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:05:22.973+0000 7f2171e1e640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 69019, si_uid : 1000, si_addr0x3e800010d9b, si_status0 2024-06-04T16:05:53.087 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] LibRGW.SHUTDOWN (30113 ms) 2024-06-04T16:05:53.088 INFO:tasks.workunit.client.0.smithi144.stdout:[----------] 11 tests from LibRGW (30514 ms total) 2024-06-04T16:05:53.088 INFO:tasks.workunit.client.0.smithi144.stdout: 2024-06-04T16:05:53.088 INFO:tasks.workunit.client.0.smithi144.stdout:[----------] Global test environment tear-down 2024-06-04T16:05:53.088 INFO:tasks.workunit.client.0.smithi144.stdout:[==========] 11 tests from 1 test suite ran. (30514 ms total) 2024-06-04T16:05:53.088 INFO:tasks.workunit.client.0.smithi144.stdout:[ PASSED ] 11 tests. 2024-06-04T16:05:53.092 INFO:tasks.workunit.client.0.smithi144.stdout:phase 5.1 2024-06-04T16:05:53.125 INFO:tasks.workunit.client.0.smithi144.stdout:[==========] Running 19 tests from 1 test suite. 2024-06-04T16:05:53.125 INFO:tasks.workunit.client.0.smithi144.stdout:[----------] Global test environment set-up. 2024-06-04T16:05:53.125 INFO:tasks.workunit.client.0.smithi144.stdout:[----------] 19 tests from LibRGW 2024-06-04T16:05:53.125 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] LibRGW.INIT 2024-06-04T16:05:53.135 INFO:tasks.workunit.client.0.smithi144.stderr:ignoring --setuser ceph since I am not root 2024-06-04T16:05:53.135 INFO:tasks.workunit.client.0.smithi144.stderr:ignoring --setgroup ceph since I am not root 2024-06-04T16:05:53.514 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] LibRGW.INIT (390 ms) 2024-06-04T16:05:53.515 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] LibRGW.MOUNT 2024-06-04T16:05:53.515 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-06-04T16:05:53.515 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-06-04T16:05:53.523 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] LibRGW.CREATE_BUCKET (8 ms) 2024-06-04T16:05:53.524 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] LibRGW.LOOKUP_BUCKET 2024-06-04T16:05:53.526 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] LibRGW.LOOKUP_BUCKET (3 ms) 2024-06-04T16:05:53.526 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] LibRGW.LIST_OBJECTS 2024-06-04T16:05:53.526 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] LibRGW.LIST_OBJECTS (0 ms) 2024-06-04T16:05:53.527 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] LibRGW.LOOKUP_OBJECT 2024-06-04T16:05:53.528 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] LibRGW.LOOKUP_OBJECT (1 ms) 2024-06-04T16:05:53.528 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] LibRGW.OBJ_OPEN 2024-06-04T16:05:53.528 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] LibRGW.OBJ_OPEN (0 ms) 2024-06-04T16:05:53.528 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] LibRGW.PUT_OBJECT 2024-06-04T16:05:53.532 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] LibRGW.PUT_OBJECT (4 ms) 2024-06-04T16:05:53.532 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] LibRGW.GET_OBJECT 2024-06-04T16:05:53.537 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] LibRGW.GET_OBJECT (5 ms) 2024-06-04T16:05:53.537 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] LibRGW.STAT_OBJECT 2024-06-04T16:05:53.537 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] LibRGW.STAT_OBJECT (0 ms) 2024-06-04T16:05:53.537 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] LibRGW.WRITE_READ_VERIFY 2024-06-04T16:05:53.537 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] LibRGW.WRITE_READ_VERIFY (0 ms) 2024-06-04T16:05:53.538 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] LibRGW.WRITEV 2024-06-04T16:05:53.538 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] LibRGW.WRITEV (0 ms) 2024-06-04T16:05:53.538 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] LibRGW.READV 2024-06-04T16:05:53.538 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] LibRGW.READV (0 ms) 2024-06-04T16:05:53.538 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] LibRGW.READV_AFTER_WRITEV 2024-06-04T16:05:53.538 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] LibRGW.READV_AFTER_WRITEV (0 ms) 2024-06-04T16:05:53.538 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] LibRGW.DELETE_OBJECT 2024-06-04T16:05:53.538 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] LibRGW.DELETE_OBJECT (0 ms) 2024-06-04T16:05:53.538 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-06-04T16:05:53.538 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] LibRGW.DELETE_BUCKET (0 ms) 2024-06-04T16:05:53.538 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] LibRGW.CLEANUP 2024-06-04T16:05:53.539 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-06-04T16:05:53.539 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] LibRGW.UMOUNT 2024-06-04T16:05:53.539 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-06-04T16:05:53.539 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-06-04T16:05:53.539 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:05:53.535+0000 7fc80af2f8c0 -1 shutting down 2024-06-04T16:05:53.539 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:05:53.536+0000 7fc6e2f2e640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 69638, si_uid : 1000, si_addr0x3e800011006, si_status0 2024-06-04T16:06:23.569 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] LibRGW.SHUTDOWN (30032 ms) 2024-06-04T16:06:23.569 INFO:tasks.workunit.client.0.smithi144.stdout:[----------] 19 tests from LibRGW (30444 ms total) 2024-06-04T16:06:23.570 INFO:tasks.workunit.client.0.smithi144.stdout: 2024-06-04T16:06:23.570 INFO:tasks.workunit.client.0.smithi144.stdout:[----------] Global test environment tear-down 2024-06-04T16:06:23.570 INFO:tasks.workunit.client.0.smithi144.stdout:[==========] 19 tests from 1 test suite ran. (30444 ms total) 2024-06-04T16:06:23.570 INFO:tasks.workunit.client.0.smithi144.stdout:[ PASSED ] 19 tests. 2024-06-04T16:06:23.575 INFO:tasks.workunit.client.0.smithi144.stdout:phase 5.2 2024-06-04T16:06:23.609 INFO:tasks.workunit.client.0.smithi144.stdout:[==========] Running 19 tests from 1 test suite. 2024-06-04T16:06:23.609 INFO:tasks.workunit.client.0.smithi144.stdout:[----------] Global test environment set-up. 2024-06-04T16:06:23.609 INFO:tasks.workunit.client.0.smithi144.stdout:[----------] 19 tests from LibRGW 2024-06-04T16:06:23.609 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] LibRGW.INIT 2024-06-04T16:06:23.616 INFO:tasks.workunit.client.0.smithi144.stderr:ignoring --setuser ceph since I am not root 2024-06-04T16:06:23.616 INFO:tasks.workunit.client.0.smithi144.stderr:ignoring --setgroup ceph since I am not root 2024-06-04T16:06:23.997 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] LibRGW.INIT (389 ms) 2024-06-04T16:06:23.998 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] LibRGW.MOUNT 2024-06-04T16:06:23.998 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] LibRGW.MOUNT (0 ms) 2024-06-04T16:06:23.998 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-06-04T16:06:23.998 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] LibRGW.CREATE_BUCKET (0 ms) 2024-06-04T16:06:23.998 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] LibRGW.LOOKUP_BUCKET 2024-06-04T16:06:24.003 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] LibRGW.LOOKUP_BUCKET (5 ms) 2024-06-04T16:06:24.003 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] LibRGW.LIST_OBJECTS 2024-06-04T16:06:24.003 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] LibRGW.LIST_OBJECTS (0 ms) 2024-06-04T16:06:24.003 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] LibRGW.LOOKUP_OBJECT 2024-06-04T16:06:24.003 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] LibRGW.LOOKUP_OBJECT (0 ms) 2024-06-04T16:06:24.003 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] LibRGW.OBJ_OPEN 2024-06-04T16:06:24.003 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] LibRGW.OBJ_OPEN (0 ms) 2024-06-04T16:06:24.003 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] LibRGW.PUT_OBJECT 2024-06-04T16:06:24.003 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] LibRGW.PUT_OBJECT (0 ms) 2024-06-04T16:06:24.003 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] LibRGW.GET_OBJECT 2024-06-04T16:06:24.003 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] LibRGW.GET_OBJECT (0 ms) 2024-06-04T16:06:24.004 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] LibRGW.STAT_OBJECT 2024-06-04T16:06:24.004 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] LibRGW.STAT_OBJECT (0 ms) 2024-06-04T16:06:24.004 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] LibRGW.WRITE_READ_VERIFY 2024-06-04T16:06:24.004 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] LibRGW.WRITE_READ_VERIFY (0 ms) 2024-06-04T16:06:24.004 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] LibRGW.WRITEV 2024-06-04T16:06:24.004 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] LibRGW.WRITEV (0 ms) 2024-06-04T16:06:24.004 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] LibRGW.READV 2024-06-04T16:06:24.004 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] LibRGW.READV (0 ms) 2024-06-04T16:06:24.004 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] LibRGW.READV_AFTER_WRITEV 2024-06-04T16:06:24.004 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] LibRGW.READV_AFTER_WRITEV (0 ms) 2024-06-04T16:06:24.004 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] LibRGW.DELETE_OBJECT 2024-06-04T16:06:24.006 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] LibRGW.DELETE_OBJECT (3 ms) 2024-06-04T16:06:24.006 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-06-04T16:06:24.035 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] LibRGW.DELETE_BUCKET (29 ms) 2024-06-04T16:06:24.035 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] LibRGW.CLEANUP 2024-06-04T16:06:24.035 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-06-04T16:06:24.035 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] LibRGW.UMOUNT 2024-06-04T16:06:24.035 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-06-04T16:06:24.035 INFO:tasks.workunit.client.0.smithi144.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-06-04T16:06:24.035 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:06:24.034+0000 7f10990128c0 -1 shutting down 2024-06-04T16:06:24.035 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:06:24.035+0000 7f0f6ec4a640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 70258, si_uid : 1000, si_addr0x3e800011272, si_status0 2024-06-04T16:06:54.232 INFO:tasks.workunit.client.0.smithi144.stdout:[ OK ] LibRGW.SHUTDOWN (30196 ms) 2024-06-04T16:06:54.232 INFO:tasks.workunit.client.0.smithi144.stdout:[----------] 19 tests from LibRGW (30622 ms total) 2024-06-04T16:06:54.232 INFO:tasks.workunit.client.0.smithi144.stdout: 2024-06-04T16:06:54.232 INFO:tasks.workunit.client.0.smithi144.stdout:[----------] Global test environment tear-down 2024-06-04T16:06:54.233 INFO:tasks.workunit.client.0.smithi144.stdout:[==========] 19 tests from 1 test suite ran. (30622 ms total) 2024-06-04T16:06:54.233 INFO:tasks.workunit.client.0.smithi144.stdout:[ PASSED ] 19 tests. 2024-06-04T16:06:54.239 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-06-04T16:06:54.239 DEBUG:teuthology.orchestra.run.smithi144:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-06-04T16:06:54.285 INFO:tasks.workunit:Running workunits matching rgw/test_awssdkv4_sig.sh on client.0... 2024-06-04T16:06:54.286 INFO:tasks.workunit:Running workunit rgw/test_awssdkv4_sig.sh... 2024-06-04T16:06:54.286 DEBUG:teuthology.orchestra.run.smithi144:workunit test rgw/test_awssdkv4_sig.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1fb5d10608dccee73edd6ef8a2c7b804a097c324 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_awssdkv4_sig.sh 2024-06-04T16:06:54.322 INFO:tasks.workunit.client.0.smithi144.stderr:+ '[' -z ']' 2024-06-04T16:06:54.322 INFO:tasks.workunit.client.0.smithi144.stderr:+ export AWS_ACCESS_KEY_ID=lNCnR47C2g+ZidCWBAUuwfSAA7Q= 2024-06-04T16:06:54.322 INFO:tasks.workunit.client.0.smithi144.stderr:+ AWS_ACCESS_KEY_ID=lNCnR47C2g+ZidCWBAUuwfSAA7Q= 2024-06-04T16:06:54.323 INFO:tasks.workunit.client.0.smithi144.stderr:+ export AWS_SECRET_ACCESS_KEY=tYuA2Y+Uu1ow2l9Xe59tWKVml3gMuVfyhUjjJwfwEI0vFFONIcqf4g== 2024-06-04T16:06:54.323 INFO:tasks.workunit.client.0.smithi144.stderr:+ AWS_SECRET_ACCESS_KEY=tYuA2Y+Uu1ow2l9Xe59tWKVml3gMuVfyhUjjJwfwEI0vFFONIcqf4g== 2024-06-04T16:06:54.323 INFO:tasks.workunit.client.0.smithi144.stderr:+ radosgw-admin user create --uid ceph-test-maven --access-key lNCnR47C2g+ZidCWBAUuwfSAA7Q= --secret tYuA2Y+Uu1ow2l9Xe59tWKVml3gMuVfyhUjjJwfwEI0vFFONIcqf4g== --display-name 'maven test user' --email sigv4@example.com 2024-06-04T16:06:54.359 INFO:tasks.workunit.client.0.smithi144.stderr:ignoring --setuser ceph since I am not root 2024-06-04T16:06:54.360 INFO:tasks.workunit.client.0.smithi144.stderr:ignoring --setgroup ceph since I am not root 2024-06-04T16:06:54.398 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:06:54.397+0000 7f5486736800 20 rados->read ofs=0 len=0 2024-06-04T16:06:54.400 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:06:54.398+0000 7f5486736800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:06:54.400 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:06:54.398+0000 7f5486736800 20 realm 2024-06-04T16:06:54.400 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:06:54.398+0000 7f5486736800 20 rados->read ofs=0 len=0 2024-06-04T16:06:54.400 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:06:54.398+0000 7f5486736800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:06:54.400 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:06:54.398+0000 7f5486736800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-06-04T16:06:54.400 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:06:54.398+0000 7f5486736800 20 rados->read ofs=0 len=0 2024-06-04T16:06:54.400 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:06:54.399+0000 7f5486736800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:06:54.400 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:06:54.399+0000 7f5486736800 20 rados->read ofs=0 len=0 2024-06-04T16:06:54.401 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:06:54.399+0000 7f5486736800 20 rados_obj.operate() r=0 bl.length=46 2024-06-04T16:06:54.401 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:06:54.399+0000 7f5486736800 20 rados->read ofs=0 len=0 2024-06-04T16:06:54.402 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:06:54.400+0000 7f5486736800 20 rados_obj.operate() r=0 bl.length=1139 2024-06-04T16:06:54.402 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:06:54.400+0000 7f5486736800 20 searching for the correct realm 2024-06-04T16:06:54.605 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:06:54.604+0000 7f5482cc3640 0 -- 172.21.15.144:0/1280110990 >> [v2:172.21.15.144:6800/1453747520,v1:172.21.15.144:6801/1453747520] conn(0x7f5478087070 msgr2=0x7f547800c340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-06-04T16:06:55.012 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:06:55.010+0000 7f5482cc3640 0 -- 172.21.15.144:0/1280110990 >> [v2:172.21.15.144:6824/166159729,v1:172.21.15.144:6825/166159729] conn(0x55838db26c50 msgr2=0x55838db29040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-06-04T16:06:55.018 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:06:55.015+0000 7f5486736800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-06-04T16:06:55.018 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:06:55.015+0000 7f5486736800 20 RGWRados::pool_iterate: got zone_info.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767 2024-06-04T16:06:55.018 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:06:55.015+0000 7f5486736800 20 RGWRados::pool_iterate: got default.zone. 2024-06-04T16:06:55.018 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:06:55.015+0000 7f5486736800 20 RGWRados::pool_iterate: got zonegroup_info.abb22408-c332-4e28-8f7a-ff254ea2fed2 2024-06-04T16:06:55.018 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:06:55.015+0000 7f5486736800 20 RGWRados::pool_iterate: got zone_names.default 2024-06-04T16:06:55.018 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:06:55.015+0000 7f5486736800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-06-04T16:06:55.018 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:06:55.016+0000 7f5486736800 20 rados->read ofs=0 len=0 2024-06-04T16:06:55.019 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:06:55.016+0000 7f5486736800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:06:55.019 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:06:55.016+0000 7f5486736800 20 rados->read ofs=0 len=0 2024-06-04T16:06:55.019 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:06:55.016+0000 7f5486736800 20 rados_obj.operate() r=0 bl.length=46 2024-06-04T16:06:55.019 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:06:55.016+0000 7f5486736800 20 rados->read ofs=0 len=0 2024-06-04T16:06:55.020 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:06:55.017+0000 7f5486736800 20 rados_obj.operate() r=0 bl.length=470 2024-06-04T16:06:55.020 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:06:55.017+0000 7f5486736800 20 zone default found 2024-06-04T16:06:55.020 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:06:55.017+0000 7f5486736800 4 Realm: () 2024-06-04T16:06:55.020 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:06:55.017+0000 7f5486736800 4 ZoneGroup: default (abb22408-c332-4e28-8f7a-ff254ea2fed2) 2024-06-04T16:06:55.020 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:06:55.017+0000 7f5486736800 4 Zone: default (be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767) 2024-06-04T16:06:55.020 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:06:55.017+0000 7f5486736800 10 cannot find current period zonegroup using local zonegroup configuration 2024-06-04T16:06:55.020 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:06:55.017+0000 7f5486736800 20 zonegroup default 2024-06-04T16:06:55.020 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:06:55.017+0000 7f5486736800 20 rados->read ofs=0 len=0 2024-06-04T16:06:55.020 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:06:55.017+0000 7f5486736800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:06:55.021 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:06:55.017+0000 7f5486736800 20 rados->read ofs=0 len=0 2024-06-04T16:06:55.021 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:06:55.017+0000 7f5486736800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:06:55.021 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:06:55.017+0000 7f5486736800 20 rados->read ofs=0 len=0 2024-06-04T16:06:55.021 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:06:55.018+0000 7f5486736800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:06:55.021 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:06:55.018+0000 7f5486736800 20 started sync module instance, tier type = 2024-06-04T16:06:55.021 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:06:55.018+0000 7f5486736800 20 started zone id=be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767 (name=default) with tier type = 2024-06-04T16:06:55.029 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:06:55.027+0000 7f5486736800 20 add_watcher() i=0 2024-06-04T16:06:55.029 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:06:55.027+0000 7f5486736800 20 add_watcher() i=1 2024-06-04T16:06:55.029 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:06:55.027+0000 7f5486736800 20 add_watcher() i=2 2024-06-04T16:06:55.029 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:06:55.027+0000 7f5486736800 20 add_watcher() i=3 2024-06-04T16:06:55.030 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:06:55.027+0000 7f5486736800 20 add_watcher() i=4 2024-06-04T16:06:55.030 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:06:55.027+0000 7f5486736800 20 add_watcher() i=5 2024-06-04T16:06:55.030 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:06:55.028+0000 7f5486736800 20 add_watcher() i=6 2024-06-04T16:06:55.030 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:06:55.029+0000 7f5486736800 20 add_watcher() i=7 2024-06-04T16:06:55.030 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:06:55.029+0000 7f5486736800 2 all 8 watchers are set, enabling cache 2024-06-04T16:06:55.032 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:06:55.030+0000 7f5338fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-06-04T16:06:55.033 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:06:55.031+0000 7f5486736800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-06-04T16:06:55.033 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:06:55.031+0000 7f5486736800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-06-04T16:06:55.033 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:06:55.031+0000 7f5486736800 5 note: GC not initialized 2024-06-04T16:06:55.033 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:06:55.031+0000 7f52b37fe640 20 reqs_thread_entry: start 2024-06-04T16:06:55.033 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:06:55.031+0000 7f5486736800 20 init_complete bucket index max shards: 11 2024-06-04T16:06:55.033 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:06:55.031+0000 7f5486736800 20 Filter name: none 2024-06-04T16:06:55.033 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:06:55.031+0000 7f52b17fa640 20 reqs_thread_entry: start 2024-06-04T16:06:55.033 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:06:55.031+0000 7f5486736800 10 cache get: name=default.rgw.meta+users.uid+ceph-test-maven : miss 2024-06-04T16:06:55.033 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:06:55.031+0000 7f5486736800 20 rados->read ofs=0 len=0 2024-06-04T16:06:55.034 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:06:55.032+0000 7f5486736800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:06:55.034 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:06:55.032+0000 7f5486736800 10 cache put: name=default.rgw.meta+users.uid+ceph-test-maven info.flags=0x0 2024-06-04T16:06:55.035 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:06:55.032+0000 7f5486736800 10 adding default.rgw.meta+users.uid+ceph-test-maven to cache LRU end 2024-06-04T16:06:55.035 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:06:55.032+0000 7f5486736800 10 cache get: name=default.rgw.meta+users.email+sigv4@example.com : miss 2024-06-04T16:06:55.035 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:06:55.032+0000 7f5486736800 20 rados->read ofs=0 len=0 2024-06-04T16:06:55.035 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:06:55.032+0000 7f5486736800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:06:55.035 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:06:55.032+0000 7f5486736800 10 cache put: name=default.rgw.meta+users.email+sigv4@example.com info.flags=0x0 2024-06-04T16:06:55.035 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:06:55.032+0000 7f5486736800 10 adding default.rgw.meta+users.email+sigv4@example.com to cache LRU end 2024-06-04T16:06:55.035 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:06:55.032+0000 7f5486736800 10 cache get: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= : miss 2024-06-04T16:06:55.035 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:06:55.032+0000 7f5486736800 20 rados->read ofs=0 len=0 2024-06-04T16:06:55.035 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:06:55.032+0000 7f5486736800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:06:55.035 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:06:55.032+0000 7f5486736800 10 cache put: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= info.flags=0x0 2024-06-04T16:06:55.035 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:06:55.032+0000 7f5486736800 10 adding default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= to cache LRU end 2024-06-04T16:06:55.035 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:06:55.032+0000 7f5486736800 10 cache get: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= : hit (negative entry) 2024-06-04T16:06:55.035 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:06:55.032+0000 7f5486736800 10 cache get: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= : hit (negative entry) 2024-06-04T16:06:55.036 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:06:55.034+0000 7f5486736800 10 cache put: name=default.rgw.meta+users.uid+ceph-test-maven info.flags=0x17 2024-06-04T16:06:55.036 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:06:55.034+0000 7f5486736800 10 moving default.rgw.meta+users.uid+ceph-test-maven to cache LRU end 2024-06-04T16:06:55.036 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:06:55.034+0000 7f5486736800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:ceph-test-maven, ofs0, ns] 2024-06-04T16:06:55.036 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:06:55.034+0000 7f5365ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1039382085695 cookie 94023506408656 notifier 5450 bl.length()=677 2024-06-04T16:06:55.036 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:06:55.034+0000 7f5365ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ceph-test-maven info.flags=0x17 2024-06-04T16:06:55.036 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:06:55.034+0000 7f5365ffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ceph-test-maven to cache LRU end 2024-06-04T16:06:55.038 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:06:55.036+0000 7f5486736800 10 cache put: name=default.rgw.meta+users.email+sigv4@example.com info.flags=0x7 2024-06-04T16:06:55.038 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:06:55.036+0000 7f5486736800 10 moving default.rgw.meta+users.email+sigv4@example.com to cache LRU end 2024-06-04T16:06:55.038 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:06:55.036+0000 7f5486736800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.email:sigv4@example.com, ofs0, ns] 2024-06-04T16:06:55.038 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:06:55.037+0000 7f5365ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1039382085636 cookie 94023506394544 notifier 5450 bl.length()=187 2024-06-04T16:06:55.038 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:06:55.037+0000 7f5365ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+sigv4@example.com info.flags=0x7 2024-06-04T16:06:55.038 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:06:55.037+0000 7f5365ffb640 10 rgw watcher librados: moving default.rgw.meta+users.email+sigv4@example.com to cache LRU end 2024-06-04T16:06:55.040 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:06:55.038+0000 7f5486736800 10 cache put: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= info.flags=0x7 2024-06-04T16:06:55.040 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:06:55.038+0000 7f5486736800 10 moving default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= to cache LRU end 2024-06-04T16:06:55.040 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:06:55.038+0000 7f5486736800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:lNCnR47C2g+ZidCWBAUuwfSAA7Q=, ofs0, ns] 2024-06-04T16:06:55.041 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:06:55.039+0000 7f53657fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1039382085637 cookie 94023506394544 notifier 5450 bl.length()=197 2024-06-04T16:06:55.041 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:06:55.039+0000 7f53657fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= info.flags=0x7 2024-06-04T16:06:55.041 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:06:55.039+0000 7f53657fa640 10 rgw watcher librados: moving default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= to cache LRU end 2024-06-04T16:06:55.041 INFO:tasks.workunit.client.0.smithi144.stdout:{ 2024-06-04T16:06:55.041 INFO:tasks.workunit.client.0.smithi144.stdout: "user_id": "ceph-test-maven", 2024-06-04T16:06:55.041 INFO:tasks.workunit.client.0.smithi144.stdout: "display_name": "maven test user", 2024-06-04T16:06:55.042 INFO:tasks.workunit.client.0.smithi144.stdout: "email": "sigv4@example.com", 2024-06-04T16:06:55.042 INFO:tasks.workunit.client.0.smithi144.stdout: "suspended": 0, 2024-06-04T16:06:55.042 INFO:tasks.workunit.client.0.smithi144.stdout: "max_buckets": 1000, 2024-06-04T16:06:55.042 INFO:tasks.workunit.client.0.smithi144.stdout: "subusers": [], 2024-06-04T16:06:55.042 INFO:tasks.workunit.client.0.smithi144.stdout: "keys": [ 2024-06-04T16:06:55.042 INFO:tasks.workunit.client.0.smithi144.stdout: { 2024-06-04T16:06:55.042 INFO:tasks.workunit.client.0.smithi144.stdout: "user": "ceph-test-maven", 2024-06-04T16:06:55.042 INFO:tasks.workunit.client.0.smithi144.stdout: "access_key": "lNCnR47C2g+ZidCWBAUuwfSAA7Q=", 2024-06-04T16:06:55.042 INFO:tasks.workunit.client.0.smithi144.stdout: "secret_key": "tYuA2Y+Uu1ow2l9Xe59tWKVml3gMuVfyhUjjJwfwEI0vFFONIcqf4g==", 2024-06-04T16:06:55.042 INFO:tasks.workunit.client.0.smithi144.stdout: "active": true, 2024-06-04T16:06:55.042 INFO:tasks.workunit.client.0.smithi144.stdout: "create_date": "2024-06-04T16:06:55.034786Z" 2024-06-04T16:06:55.042 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:06:55.042 INFO:tasks.workunit.client.0.smithi144.stdout: ], 2024-06-04T16:06:55.043 INFO:tasks.workunit.client.0.smithi144.stdout: "swift_keys": [], 2024-06-04T16:06:55.043 INFO:tasks.workunit.client.0.smithi144.stdout: "caps": [], 2024-06-04T16:06:55.043 INFO:tasks.workunit.client.0.smithi144.stdout: "op_mask": "read, write, delete", 2024-06-04T16:06:55.043 INFO:tasks.workunit.client.0.smithi144.stdout: "default_placement": "", 2024-06-04T16:06:55.043 INFO:tasks.workunit.client.0.smithi144.stdout: "default_storage_class": "", 2024-06-04T16:06:55.043 INFO:tasks.workunit.client.0.smithi144.stdout: "placement_tags": [], 2024-06-04T16:06:55.043 INFO:tasks.workunit.client.0.smithi144.stdout: "bucket_quota": { 2024-06-04T16:06:55.043 INFO:tasks.workunit.client.0.smithi144.stdout: "enabled": false, 2024-06-04T16:06:55.043 INFO:tasks.workunit.client.0.smithi144.stdout: "check_on_raw": false, 2024-06-04T16:06:55.043 INFO:tasks.workunit.client.0.smithi144.stdout: "max_size": -1, 2024-06-04T16:06:55.043 INFO:tasks.workunit.client.0.smithi144.stdout: "max_size_kb": 0, 2024-06-04T16:06:55.043 INFO:tasks.workunit.client.0.smithi144.stdout: "max_objects": -1 2024-06-04T16:06:55.044 INFO:tasks.workunit.client.0.smithi144.stdout: }, 2024-06-04T16:06:55.044 INFO:tasks.workunit.client.0.smithi144.stdout: "user_quota": { 2024-06-04T16:06:55.044 INFO:tasks.workunit.client.0.smithi144.stdout: "enabled": false, 2024-06-04T16:06:55.044 INFO:tasks.workunit.client.0.smithi144.stdout: "check_on_raw": false, 2024-06-04T16:06:55.044 INFO:tasks.workunit.client.0.smithi144.stdout: "max_size": -1, 2024-06-04T16:06:55.044 INFO:tasks.workunit.client.0.smithi144.stdout: "max_size_kb": 0, 2024-06-04T16:06:55.044 INFO:tasks.workunit.client.0.smithi144.stdout: "max_objects": -1 2024-06-04T16:06:55.044 INFO:tasks.workunit.client.0.smithi144.stdout: }, 2024-06-04T16:06:55.044 INFO:tasks.workunit.client.0.smithi144.stdout: "temp_url_keys": [], 2024-06-04T16:06:55.044 INFO:tasks.workunit.client.0.smithi144.stdout: "type": "rgw", 2024-06-04T16:06:55.044 INFO:tasks.workunit.client.0.smithi144.stdout: "mfa_ids": [], 2024-06-04T16:06:55.044 INFO:tasks.workunit.client.0.smithi144.stdout: "account_id": "", 2024-06-04T16:06:55.045 INFO:tasks.workunit.client.0.smithi144.stdout: "path": "/", 2024-06-04T16:06:55.045 INFO:tasks.workunit.client.0.smithi144.stdout: "create_date": "2024-06-04T16:06:55.034775Z", 2024-06-04T16:06:55.045 INFO:tasks.workunit.client.0.smithi144.stdout: "tags": [], 2024-06-04T16:06:55.045 INFO:tasks.workunit.client.0.smithi144.stdout: "group_ids": [] 2024-06-04T16:06:55.045 INFO:tasks.workunit.client.0.smithi144.stdout:} 2024-06-04T16:06:55.045 INFO:tasks.workunit.client.0.smithi144.stdout: 2024-06-04T16:06:55.045 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:06:55.040+0000 7f5338fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-06-04T16:06:55.045 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:06:55.042+0000 7f5486736800 20 remove_watcher() i=0 2024-06-04T16:06:55.046 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:06:55.042+0000 7f5486736800 2 removed watcher, disabling cache 2024-06-04T16:06:55.046 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:06:55.043+0000 7f5486736800 20 remove_watcher() i=1 2024-06-04T16:06:55.046 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:06:55.044+0000 7f5486736800 20 remove_watcher() i=2 2024-06-04T16:06:55.047 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:06:55.046+0000 7f5486736800 20 remove_watcher() i=3 2024-06-04T16:06:55.048 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:06:55.047+0000 7f5486736800 20 remove_watcher() i=4 2024-06-04T16:06:55.050 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:06:55.048+0000 7f5486736800 20 remove_watcher() i=5 2024-06-04T16:06:55.051 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:06:55.049+0000 7f5486736800 20 remove_watcher() i=6 2024-06-04T16:06:55.052 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:06:55.050+0000 7f5486736800 20 remove_watcher() i=7 2024-06-04T16:06:55.063 INFO:tasks.workunit.client.0.smithi144.stderr:+ '[' -z ']' 2024-06-04T16:06:55.063 INFO:tasks.workunit.client.0.smithi144.stderr:+ '[' -z /home/ubuntu/cephtest ']' 2024-06-04T16:06:55.063 INFO:tasks.workunit.client.0.smithi144.stderr:++ cat /home/ubuntu/cephtest/url_file 2024-06-04T16:06:55.064 INFO:tasks.workunit.client.0.smithi144.stderr:+ export RGW_HTTP_ENDPOINT_URL=https://smithi144.front.sepia.ceph.com:443 2024-06-04T16:06:55.064 INFO:tasks.workunit.client.0.smithi144.stderr:+ RGW_HTTP_ENDPOINT_URL=https://smithi144.front.sepia.ceph.com:443 2024-06-04T16:06:55.064 INFO:tasks.workunit.client.0.smithi144.stderr:+ '[' -z /home/ubuntu/cephtest/clone.client.0 ']' 2024-06-04T16:06:55.064 INFO:tasks.workunit.client.0.smithi144.stderr:+ cd /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum 2024-06-04T16:06:55.064 INFO:tasks.workunit.client.0.smithi144.stderr:+ ./mvnw clean package 2024-06-04T16:06:55.073 INFO:tasks.workunit.client.0.smithi144.stdout:Warning: JAVA_HOME environment variable is not set. 2024-06-04T16:06:56.604 INFO:tasks.workunit.client.0.smithi144.stdout:[INFO] Scanning for projects... 2024-06-04T16:06:56.731 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.10.1/junit-bom-5.10.1.pom 2024-06-04T16:06:56.826 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (1): 1.4/5.6 kB Progress (1): 2.8/5.6 kB Progress (1): 4.1/5.6 kB Progress (1): 5.5/5.6 kB Progress (1): 5.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.10.1/junit-bom-5.10.1.pom (5.6 kB at 58 kB/s) 2024-06-04T16:06:56.839 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/bom/2.20.43/bom-2.20.43.pom 2024-06-04T16:06:56.889 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (1): 1.4/83 kB Progress (1): 2.8/83 kB Progress (1): 4.1/83 kB Progress (1): 5.5/83 kB Progress (1): 6.9/83 kB Progress (1): 8.3/83 kB Progress (1): 9.7/83 kB Progress (1): 11/83 kB Progress (1): 12/83 kB Progress (1): 14/83 kB Progress (1): 15/83 kB Progress (1): 16/83 kB Progress (1): 33/83 kB Progress (1): 49/83 kB Progress (1): 62/83 kB Progress (1): 78/83 kB Progress (1): 83 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/bom/2.20.43/bom-2.20.43.pom (83 kB at 1.7 MB/s) 2024-06-04T16:06:56.899 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-sdk-java-pom/2.20.43/aws-sdk-java-pom-2.20.43.pom 2024-06-04T16:06:56.923 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (1): 16/77 kB Progress (1): 33/77 kB Progress (1): 49/77 kB Progress (1): 64/77 kB Progress (1): 77 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-sdk-java-pom/2.20.43/aws-sdk-java-pom-2.20.43.pom (77 kB at 3.2 MB/s) 2024-06-04T16:06:56.952 INFO:tasks.workunit.client.0.smithi144.stdout:[INFO] 2024-06-04T16:06:56.952 INFO:tasks.workunit.client.0.smithi144.stdout:[INFO] ---------------------------< io.ceph:jcksum >--------------------------- 2024-06-04T16:06:56.952 INFO:tasks.workunit.client.0.smithi144.stdout:[INFO] Building jcksum 1.0 2024-06-04T16:06:56.952 INFO:tasks.workunit.client.0.smithi144.stdout:[INFO] from pom.xml 2024-06-04T16:06:56.953 INFO:tasks.workunit.client.0.smithi144.stdout:[INFO] --------------------------------[ jar ]--------------------------------- 2024-06-04T16:06:56.956 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-clean-plugin/3.2.0/maven-clean-plugin-3.2.0.pom 2024-06-04T16:06:56.974 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (1): 5.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-clean-plugin/3.2.0/maven-clean-plugin-3.2.0.pom (5.3 kB at 295 kB/s) 2024-06-04T16:06:56.981 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/35/maven-plugins-35.pom 2024-06-04T16:06:56.998 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (1): 9.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/35/maven-plugins-35.pom (9.9 kB at 550 kB/s) 2024-06-04T16:06:57.001 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/35/maven-parent-35.pom 2024-06-04T16:06:57.020 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (1): 16/45 kB Progress (1): 33/45 kB Progress (1): 45 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/35/maven-parent-35.pom (45 kB at 2.4 MB/s) 2024-06-04T16:06:57.027 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/25/apache-25.pom 2024-06-04T16:06:57.046 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (1): 16/21 kB Progress (1): 21 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/25/apache-25.pom (21 kB at 1.1 MB/s) 2024-06-04T16:06:57.061 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-clean-plugin/3.2.0/maven-clean-plugin-3.2.0.jar 2024-06-04T16:06:57.079 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (1): 16/36 kB Progress (1): 33/36 kB Progress (1): 36 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-clean-plugin/3.2.0/maven-clean-plugin-3.2.0.jar (36 kB at 2.0 MB/s) 2024-06-04T16:06:57.086 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-resources-plugin/3.3.1/maven-resources-plugin-3.3.1.pom 2024-06-04T16:06:57.103 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (1): 8.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-resources-plugin/3.3.1/maven-resources-plugin-3.3.1.pom (8.2 kB at 480 kB/s) 2024-06-04T16:06:57.106 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/39/maven-plugins-39.pom 2024-06-04T16:06:57.123 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (1): 8.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/39/maven-plugins-39.pom (8.1 kB at 476 kB/s) 2024-06-04T16:06:57.125 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/39/maven-parent-39.pom 2024-06-04T16:06:57.144 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (1): 16/48 kB Progress (1): 33/48 kB Progress (1): 48 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/39/maven-parent-39.pom (48 kB at 2.5 MB/s) 2024-06-04T16:06:57.149 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/29/apache-29.pom 2024-06-04T16:06:57.167 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (1): 16/21 kB Progress (1): 21 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/29/apache-29.pom (21 kB at 1.1 MB/s) 2024-06-04T16:06:57.175 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-resources-plugin/3.3.1/maven-resources-plugin-3.3.1.jar 2024-06-04T16:06:57.193 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (1): 16/31 kB Progress (1): 31 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-resources-plugin/3.3.1/maven-resources-plugin-3.3.1.jar (31 kB at 1.7 MB/s) 2024-06-04T16:06:57.200 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-compiler-plugin/3.11.0/maven-compiler-plugin-3.11.0.pom 2024-06-04T16:06:57.218 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (1): 9.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-compiler-plugin/3.11.0/maven-compiler-plugin-3.11.0.pom (9.8 kB at 545 kB/s) 2024-06-04T16:06:57.224 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-compiler-plugin/3.11.0/maven-compiler-plugin-3.11.0.jar 2024-06-04T16:06:57.245 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (1): 16/66 kB Progress (1): 33/66 kB Progress (1): 49/66 kB Progress (1): 66/66 kB Progress (1): 66 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-compiler-plugin/3.11.0/maven-compiler-plugin-3.11.0.jar (66 kB at 3.1 MB/s) 2024-06-04T16:06:57.252 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-surefire-plugin/3.2.3/maven-surefire-plugin-3.2.3.pom 2024-06-04T16:06:57.271 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (1): 5.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-surefire-plugin/3.2.3/maven-surefire-plugin-3.2.3.pom (5.3 kB at 280 kB/s) 2024-06-04T16:06:57.274 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire/3.2.3/surefire-3.2.3.pom 2024-06-04T16:06:57.294 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (1): 16/22 kB Progress (1): 22 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire/3.2.3/surefire-3.2.3.pom (22 kB at 1.1 MB/s) 2024-06-04T16:06:57.297 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/41/maven-parent-41.pom 2024-06-04T16:06:57.316 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (1): 16/50 kB Progress (1): 33/50 kB Progress (1): 49/50 kB Progress (1): 50 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/41/maven-parent-41.pom (50 kB at 2.6 MB/s) 2024-06-04T16:06:57.320 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/31/apache-31.pom 2024-06-04T16:06:57.338 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (1): 16/24 kB Progress (1): 24 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/31/apache-31.pom (24 kB at 1.3 MB/s) 2024-06-04T16:06:57.343 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.9.3/junit-bom-5.9.3.pom 2024-06-04T16:06:57.360 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (1): 5.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.9.3/junit-bom-5.9.3.pom (5.6 kB at 313 kB/s) 2024-06-04T16:06:57.364 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-surefire-plugin/3.2.3/maven-surefire-plugin-3.2.3.jar 2024-06-04T16:06:57.383 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (1): 16/45 kB Progress (1): 33/45 kB Progress (1): 45 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-surefire-plugin/3.2.3/maven-surefire-plugin-3.2.3.jar (45 kB at 2.2 MB/s) 2024-06-04T16:06:57.392 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-jar-plugin/3.3.0/maven-jar-plugin-3.3.0.pom 2024-06-04T16:06:57.411 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (1): 5.5/6.8 kB Progress (1): 6.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-jar-plugin/3.3.0/maven-jar-plugin-3.3.0.pom (6.8 kB at 356 kB/s) 2024-06-04T16:06:57.414 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/37/maven-plugins-37.pom 2024-06-04T16:06:57.432 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (1): 9.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/37/maven-plugins-37.pom (9.9 kB at 550 kB/s) 2024-06-04T16:06:57.435 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/37/maven-parent-37.pom 2024-06-04T16:06:57.453 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (1): 16/46 kB Progress (1): 33/46 kB Progress (1): 46 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/37/maven-parent-37.pom (46 kB at 2.5 MB/s) 2024-06-04T16:06:57.456 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/27/apache-27.pom 2024-06-04T16:06:57.473 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/27/apache-27.pom (20 kB at 1.1 MB/s) 2024-06-04T16:06:57.477 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-jar-plugin/3.3.0/maven-jar-plugin-3.3.0.jar 2024-06-04T16:06:57.495 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (1): 16/27 kB Progress (1): 27 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-jar-plugin/3.3.0/maven-jar-plugin-3.3.0.jar (27 kB at 1.6 MB/s) 2024-06-04T16:06:57.509 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/s3/2.20.43/s3-2.20.43.pom 2024-06-04T16:06:57.527 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (1): 6.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/s3/2.20.43/s3-2.20.43.pom (6.1 kB at 338 kB/s) 2024-06-04T16:06:57.529 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/services/2.20.43/services-2.20.43.pom 2024-06-04T16:06:57.549 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (1): 5.5/21 kB Progress (1): 12/21 kB Progress (1): 18/21 kB Progress (1): 21 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/services/2.20.43/services-2.20.43.pom (21 kB at 1.1 MB/s) 2024-06-04T16:06:57.554 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/bom-internal/2.20.43/bom-internal-2.20.43.pom 2024-06-04T16:06:57.573 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/bom-internal/2.20.43/bom-internal-2.20.43.pom (20 kB at 1.1 MB/s) 2024-06-04T16:06:57.583 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-xml-protocol/2.20.43/aws-xml-protocol-2.20.43.pom 2024-06-04T16:06:57.601 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (1): 4.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-xml-protocol/2.20.43/aws-xml-protocol-2.20.43.pom (4.0 kB at 222 kB/s) 2024-06-04T16:06:57.604 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocols/2.20.43/protocols-2.20.43.pom 2024-06-04T16:06:57.622 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (1): 1.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocols/2.20.43/protocols-2.20.43.pom (1.6 kB at 82 kB/s) 2024-06-04T16:06:57.624 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/core/2.20.43/core-2.20.43.pom 2024-06-04T16:06:57.642 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (1): 2.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/core/2.20.43/core-2.20.43.pom (2.2 kB at 131 kB/s) 2024-06-04T16:06:57.647 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-query-protocol/2.20.43/aws-query-protocol-2.20.43.pom 2024-06-04T16:06:57.666 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (1): 3.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-query-protocol/2.20.43/aws-query-protocol-2.20.43.pom (3.6 kB at 191 kB/s) 2024-06-04T16:06:57.672 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocol-core/2.20.43/protocol-core-2.20.43.pom 2024-06-04T16:06:57.692 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocol-core/2.20.43/protocol-core-2.20.43.pom (3.2 kB at 161 kB/s) 2024-06-04T16:06:57.698 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/sdk-core/2.20.43/sdk-core-2.20.43.pom 2024-06-04T16:06:57.716 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (1): 11 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/sdk-core/2.20.43/sdk-core-2.20.43.pom (11 kB at 609 kB/s) 2024-06-04T16:06:57.721 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/annotations/2.20.43/annotations-2.20.43.pom 2024-06-04T16:06:57.746 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (1): 1.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/annotations/2.20.43/annotations-2.20.43.pom (1.7 kB at 70 kB/s) 2024-06-04T16:06:57.750 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-client-spi/2.20.43/http-client-spi-2.20.43.pom 2024-06-04T16:06:57.767 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (1): 3.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-client-spi/2.20.43/http-client-spi-2.20.43.pom (3.8 kB at 212 kB/s) 2024-06-04T16:06:57.771 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/utils/2.20.43/utils-2.20.43.pom 2024-06-04T16:06:57.788 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (1): 4.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/utils/2.20.43/utils-2.20.43.pom (4.9 kB at 273 kB/s) 2024-06-04T16:06:57.792 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/reactivestreams/reactive-streams/1.0.3/reactive-streams-1.0.3.pom 2024-06-04T16:06:57.812 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (1): 1.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/reactivestreams/reactive-streams/1.0.3/reactive-streams-1.0.3.pom (1.2 kB at 58 kB/s) 2024-06-04T16:06:57.814 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.30/slf4j-api-1.7.30.pom 2024-06-04T16:06:57.831 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (1): 3.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.30/slf4j-api-1.7.30.pom (3.8 kB at 240 kB/s) 2024-06-04T16:06:57.833 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.30/slf4j-parent-1.7.30.pom 2024-06-04T16:06:57.850 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.30/slf4j-parent-1.7.30.pom (14 kB at 767 kB/s) 2024-06-04T16:06:57.853 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/metrics-spi/2.20.43/metrics-spi-2.20.43.pom 2024-06-04T16:06:57.872 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (1): 3.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/metrics-spi/2.20.43/metrics-spi-2.20.43.pom (3.7 kB at 193 kB/s) 2024-06-04T16:06:57.875 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/endpoints-spi/2.20.43/endpoints-spi-2.20.43.pom 2024-06-04T16:06:57.894 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (1): 2.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/endpoints-spi/2.20.43/endpoints-spi-2.20.43.pom (2.5 kB at 136 kB/s) 2024-06-04T16:06:57.898 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/profiles/2.20.43/profiles-2.20.43.pom 2024-06-04T16:06:57.915 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (1): 2.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/profiles/2.20.43/profiles-2.20.43.pom (2.9 kB at 162 kB/s) 2024-06-04T16:06:57.920 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-core/2.20.43/aws-core-2.20.43.pom 2024-06-04T16:06:57.938 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (1): 7.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-core/2.20.43/aws-core-2.20.43.pom (7.4 kB at 412 kB/s) 2024-06-04T16:06:57.942 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/regions/2.20.43/regions-2.20.43.pom 2024-06-04T16:06:57.959 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (1): 5.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/regions/2.20.43/regions-2.20.43.pom (5.5 kB at 303 kB/s) 2024-06-04T16:06:57.964 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/json-utils/2.20.43/json-utils-2.20.43.pom 2024-06-04T16:06:57.982 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (1): 3.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/json-utils/2.20.43/json-utils-2.20.43.pom (3.5 kB at 184 kB/s) 2024-06-04T16:06:57.987 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party-jackson-core/2.20.43/third-party-jackson-core-2.20.43.pom 2024-06-04T16:06:58.006 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (1): 4.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party-jackson-core/2.20.43/third-party-jackson-core-2.20.43.pom (4.4 kB at 244 kB/s) 2024-06-04T16:06:58.009 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party/2.20.43/third-party-2.20.43.pom 2024-06-04T16:06:58.027 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (1): 2.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party/2.20.43/third-party-2.20.43.pom (2.4 kB at 134 kB/s) 2024-06-04T16:06:58.030 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/auth/2.20.43/auth-2.20.43.pom 2024-06-04T16:06:58.048 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (1): 6.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/auth/2.20.43/auth-2.20.43.pom (6.4 kB at 339 kB/s) 2024-06-04T16:06:58.052 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/eventstream/eventstream/1.0.1/eventstream-1.0.1.pom 2024-06-04T16:06:58.070 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (1): 6.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/eventstream/eventstream/1.0.1/eventstream-1.0.1.pom (6.1 kB at 337 kB/s) 2024-06-04T16:06:58.075 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/arns/2.20.43/arns-2.20.43.pom 2024-06-04T16:06:58.093 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/arns/2.20.43/arns-2.20.43.pom (3.0 kB at 165 kB/s) 2024-06-04T16:06:58.097 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/crt-core/2.20.43/crt-core-2.20.43.pom 2024-06-04T16:06:58.115 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (1): 3.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/crt-core/2.20.43/crt-core-2.20.43.pom (3.5 kB at 193 kB/s) 2024-06-04T16:06:58.119 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/apache-client/2.20.43/apache-client-2.20.43.pom 2024-06-04T16:06:58.136 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (1): 4.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/apache-client/2.20.43/apache-client-2.20.43.pom (4.1 kB at 240 kB/s) 2024-06-04T16:06:58.138 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-clients/2.20.43/http-clients-2.20.43.pom 2024-06-04T16:06:58.155 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (1): 1.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-clients/2.20.43/http-clients-2.20.43.pom (1.8 kB at 105 kB/s) 2024-06-04T16:06:58.159 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpclient/4.5.13/httpclient-4.5.13.pom 2024-06-04T16:06:58.176 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (1): 6.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpclient/4.5.13/httpclient-4.5.13.pom (6.6 kB at 389 kB/s) 2024-06-04T16:06:58.179 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-client/4.5.13/httpcomponents-client-4.5.13.pom 2024-06-04T16:06:58.196 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (1): 16 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-client/4.5.13/httpcomponents-client-4.5.13.pom (16 kB at 910 kB/s) 2024-06-04T16:06:58.199 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-parent/11/httpcomponents-parent-11.pom 2024-06-04T16:06:58.219 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (1): 16/35 kB Progress (1): 33/35 kB Progress (1): 35 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-parent/11/httpcomponents-parent-11.pom (35 kB at 1.7 MB/s) 2024-06-04T16:06:58.223 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/21/apache-21.pom 2024-06-04T16:06:58.241 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (1): 16/17 kB Progress (1): 17 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/21/apache-21.pom (17 kB at 950 kB/s) 2024-06-04T16:06:58.246 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcore/4.4.13/httpcore-4.4.13.pom 2024-06-04T16:06:58.264 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (1): 5.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcore/4.4.13/httpcore-4.4.13.pom (5.0 kB at 276 kB/s) 2024-06-04T16:06:58.266 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-core/4.4.13/httpcomponents-core-4.4.13.pom 2024-06-04T16:06:58.284 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (1): 13 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-core/4.4.13/httpcomponents-core-4.4.13.pom (13 kB at 775 kB/s) 2024-06-04T16:06:58.288 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.11/commons-codec-1.11.pom 2024-06-04T16:06:58.305 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.11/commons-codec-1.11.pom (14 kB at 822 kB/s) 2024-06-04T16:06:58.308 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/42/commons-parent-42.pom 2024-06-04T16:06:58.327 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (1): 16/68 kB Progress (1): 33/68 kB Progress (1): 49/68 kB Progress (1): 64/68 kB Progress (1): 68 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/42/commons-parent-42.pom (68 kB at 3.4 MB/s) 2024-06-04T16:06:58.333 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/18/apache-18.pom 2024-06-04T16:06:58.350 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (1): 16 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/18/apache-18.pom (16 kB at 922 kB/s) 2024-06-04T16:06:58.355 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.15/commons-codec-1.15.pom 2024-06-04T16:06:58.372 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.15/commons-codec-1.15.pom (15 kB at 858 kB/s) 2024-06-04T16:06:58.374 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/52/commons-parent-52.pom 2024-06-04T16:06:58.394 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (1): 16/79 kB Progress (1): 33/79 kB Progress (1): 49/79 kB Progress (1): 64/79 kB Progress (1): 79 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/52/commons-parent-52.pom (79 kB at 4.2 MB/s) 2024-06-04T16:06:58.398 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/23/apache-23.pom 2024-06-04T16:06:58.416 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (1): 16/18 kB Progress (1): 18 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/23/apache-23.pom (18 kB at 1.1 MB/s) 2024-06-04T16:06:58.421 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.1/commons-io-2.15.1.pom 2024-06-04T16:06:58.438 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.1/commons-io-2.15.1.pom (20 kB at 1.2 MB/s) 2024-06-04T16:06:58.440 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/65/commons-parent-65.pom 2024-06-04T16:06:58.461 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (1): 15/78 kB Progress (1): 31/78 kB Progress (1): 48/78 kB Progress (1): 64/78 kB Progress (1): 78 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/65/commons-parent-65.pom (78 kB at 3.9 MB/s) 2024-06-04T16:06:58.468 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.28/slf4j-api-1.7.28.pom 2024-06-04T16:06:58.486 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (1): 3.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.28/slf4j-api-1.7.28.pom (3.8 kB at 213 kB/s) 2024-06-04T16:06:58.488 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.28/slf4j-parent-1.7.28.pom 2024-06-04T16:06:58.505 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.28/slf4j-parent-1.7.28.pom (14 kB at 767 kB/s) 2024-06-04T16:06:58.508 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter/5.10.1/junit-jupiter-5.10.1.pom 2024-06-04T16:06:58.526 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter/5.10.1/junit-jupiter-5.10.1.pom (3.2 kB at 178 kB/s) 2024-06-04T16:06:58.529 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-api/5.10.1/junit-jupiter-api-5.10.1.pom 2024-06-04T16:06:58.565 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-api/5.10.1/junit-jupiter-api-5.10.1.pom (3.2 kB at 86 kB/s) 2024-06-04T16:06:58.568 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.3.0/opentest4j-1.3.0.pom 2024-06-04T16:06:58.585 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (1): 2.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.3.0/opentest4j-1.3.0.pom (2.0 kB at 120 kB/s) 2024-06-04T16:06:58.587 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.10.1/junit-platform-commons-1.10.1.pom 2024-06-04T16:06:58.606 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (1): 2.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.10.1/junit-platform-commons-1.10.1.pom (2.8 kB at 157 kB/s) 2024-06-04T16:06:58.608 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apiguardian/apiguardian-api/1.1.2/apiguardian-api-1.1.2.pom 2024-06-04T16:06:58.625 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (1): 1.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apiguardian/apiguardian-api/1.1.2/apiguardian-api-1.1.2.pom (1.5 kB at 90 kB/s) 2024-06-04T16:06:58.628 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-params/5.10.1/junit-jupiter-params-5.10.1.pom 2024-06-04T16:06:58.645 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-params/5.10.1/junit-jupiter-params-5.10.1.pom (3.0 kB at 177 kB/s) 2024-06-04T16:06:58.647 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-engine/5.10.1/junit-jupiter-engine-5.10.1.pom 2024-06-04T16:06:58.664 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-engine/5.10.1/junit-jupiter-engine-5.10.1.pom (3.2 kB at 188 kB/s) 2024-06-04T16:06:58.666 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.10.1/junit-platform-engine-1.10.1.pom 2024-06-04T16:06:58.684 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.10.1/junit-platform-engine-1.10.1.pom (3.2 kB at 189 kB/s) 2024-06-04T16:06:58.687 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-simple/1.7.28/slf4j-simple-1.7.28.pom 2024-06-04T16:06:58.704 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (1): 1.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-simple/1.7.28/slf4j-simple-1.7.28.pom (1.0 kB at 60 kB/s) 2024-06-04T16:06:58.707 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/jcl-over-slf4j/1.7.28/jcl-over-slf4j-1.7.28.pom 2024-06-04T16:06:58.725 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (1): 964 B Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/jcl-over-slf4j/1.7.28/jcl-over-slf4j-1.7.28.pom (964 B at 54 kB/s) 2024-06-04T16:06:58.727 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite/1.10.1/junit-platform-suite-1.10.1.pom 2024-06-04T16:06:58.745 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (1): 3.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite/1.10.1/junit-platform-suite-1.10.1.pom (3.1 kB at 180 kB/s) 2024-06-04T16:06:58.747 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-api/1.10.1/junit-platform-suite-api-1.10.1.pom 2024-06-04T16:06:58.764 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-api/1.10.1/junit-platform-suite-api-1.10.1.pom (3.0 kB at 168 kB/s) 2024-06-04T16:06:58.767 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-engine/1.10.1/junit-platform-suite-engine-1.10.1.pom 2024-06-04T16:06:58.784 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (1): 3.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-engine/1.10.1/junit-platform-suite-engine-1.10.1.pom (3.4 kB at 202 kB/s) 2024-06-04T16:06:58.786 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-commons/1.10.1/junit-platform-suite-commons-1.10.1.pom 2024-06-04T16:06:58.803 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (1): 3.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-commons/1.10.1/junit-platform-suite-commons-1.10.1.pom (3.4 kB at 191 kB/s) 2024-06-04T16:06:58.805 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.10.1/junit-platform-launcher-1.10.1.pom 2024-06-04T16:06:58.823 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.10.1/junit-platform-launcher-1.10.1.pom (3.0 kB at 168 kB/s) 2024-06-04T16:06:58.841 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/s3/2.20.43/s3-2.20.43.jar 2024-06-04T16:06:58.935 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (1): 0/3.3 MB Progress (1): 0/3.3 MB Progress (1): 0/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.3/3.3 MB Progress (1): 3.3/3.3 MB Progress (1): 3.3 MB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/s3/2.20.43/s3-2.20.43.jar (3.3 MB at 35 MB/s) 2024-06-04T16:06:58.936 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-xml-protocol/2.20.43/aws-xml-protocol-2.20.43.jar 2024-06-04T16:06:58.936 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-query-protocol/2.20.43/aws-query-protocol-2.20.43.jar 2024-06-04T16:06:58.936 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocol-core/2.20.43/protocol-core-2.20.43.jar 2024-06-04T16:06:58.937 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/arns/2.20.43/arns-2.20.43.jar 2024-06-04T16:06:58.937 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/profiles/2.20.43/profiles-2.20.43.jar 2024-06-04T16:06:58.957 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (1): 16/71 kB Progress (1): 33/71 kB Progress (1): 49/71 kB Progress (1): 66/71 kB Progress (1): 71 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-query-protocol/2.20.43/aws-query-protocol-2.20.43.jar (71 kB at 3.2 MB/s) 2024-06-04T16:06:58.957 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/crt-core/2.20.43/crt-core-2.20.43.jar 2024-06-04T16:06:58.976 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (1): 16 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/crt-core/2.20.43/crt-core-2.20.43.jar (16 kB at 411 kB/s) 2024-06-04T16:06:58.976 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/sdk-core/2.20.43/sdk-core-2.20.43.jar 2024-06-04T16:06:58.998 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (1): 1.4/98 kB Progress (2): 1.4/98 kB | 1.4/16 kB Progress (2): 2.8/98 kB | 1.4/16 kB Progress (2): 2.8/98 kB | 2.8/16 kB Progress (2): 4.1/98 kB | 2.8/16 kB Progress (2): 4.1/98 kB | 4.1/16 kB Progress (2): 5.5/98 kB | 4.1/16 kB Progress (2): 5.5/98 kB | 5.5/16 kB Progress (3): 5.5/98 kB | 5.5/16 kB | 1.4/35 kB Progress (4): 5.5/98 kB | 5.5/16 kB | 1.4/35 kB | 1.4/49 kB Progress (4): 6.9/98 kB | 5.5/16 kB | 1.4/35 kB | 1.4/49 kB Progress (4): 6.9/98 kB | 6.9/16 kB | 1.4/35 kB | 1.4/49 kB Progress (4): 8.3/98 kB | 6.9/16 kB | 1.4/35 kB | 1.4/49 kB Progress (4): 8.3/98 kB | 6.9/16 kB | 1.4/35 kB | 2.8/49 kB Progress (4): 8.3/98 kB | 6.9/16 kB | 2.8/35 kB | 2.8/49 kB Progress (4): 9.7/98 kB | 6.9/16 kB | 2.8/35 kB | 2.8/49 kB Progress (4): 9.7/98 kB | 8.3/16 kB | 2.8/35 kB | 2.8/49 kB Progress (4): 11/98 kB | 8.3/16 kB | 2.8/35 kB | 2.8/49 kB Progress (4): 11/98 kB | 8.3/16 kB | 4.1/35 kB | 2.8/49 kB Progress (4): 11/98 kB | 8.3/16 kB | 4.1/35 kB | 4.1/49 kB Progress (4): 11/98 kB | 8.3/16 kB | 5.5/35 kB | 4.1/49 kB Progress (4): 12/98 kB | 8.3/16 kB | 5.5/35 kB | 4.1/49 kB Progress (4): 12/98 kB | 8.3/16 kB | 6.9/35 kB | 4.1/49 kB Progress (4): 12/98 kB | 9.7/16 kB | 6.9/35 kB | 4.1/49 kB Progress (4): 14/98 kB | 9.7/16 kB | 6.9/35 kB | 4.1/49 kB Progress (4): 14/98 kB | 9.7/16 kB | 6.9/35 kB | 5.5/49 kB Progress (4): 15/98 kB | 9.7/16 kB | 6.9/35 kB | 5.5/49 kB Progress (4): 15/98 kB | 11/16 kB | 6.9/35 kB | 5.5/49 kB Progress (4): 17/98 kB | 11/16 kB | 6.9/35 kB | 5.5/49 kB Progress (4): 17/98 kB | 11/16 kB | 8.3/35 kB | 5.5/49 kB Progress (4): 18/98 kB | 11/16 kB | 8.3/35 kB | 5.5/49 kB Progress (4): 18/98 kB | 11/16 kB | 9.7/35 kB | 5.5/49 kB Progress (4): 19/98 kB | 11/16 kB | 9.7/35 kB | 5.5/49 kB Progress (4): 19/98 kB | 12/16 kB | 9.7/35 kB | 5.5/49 kB Progress (4): 19/98 kB | 12/16 kB | 9.7/35 kB | 6.9/49 kB Progress (4): 19/98 kB | 14/16 kB | 9.7/35 kB | 6.9/49 kB Progress (4): 19/98 kB | 14/16 kB | 11/35 kB | 6.9/49 kB Progress (4): 19/98 kB | 14/16 kB | 11/35 kB | 8.3/49 kB Progress (4): 19/98 kB | 15/16 kB | 11/35 kB | 8.3/49 kB Progress (4): 19/98 kB | 15/16 kB | 12/35 kB | 8.3/49 kB Progress (4): 19/98 kB | 15/16 kB | 12/35 kB | 9.7/49 kB Progress (4): 19/98 kB | 16 kB | 12/35 kB | 9.7/49 kB Progress (4): 19/98 kB | 16 kB | 12/35 kB | 11/49 kB Progress (4): 19/98 kB | 16 kB | 14/35 kB | 11/49 kB Progress (4): 21/98 kB | 16 kB | 14/35 kB | 11/49 kB Progress (4): 21/98 kB | 16 kB | 15/35 kB | 11/49 kB Progress (4): 21/98 kB | 16 kB | 15/35 kB | 12/49 kB Progress (4): 21/98 kB | 16 kB | 17/35 kB | 12/49 kB Progress (5): 21/98 kB | 16 kB | 17/35 kB | 12/49 kB | 16/782 kB Progress (5): 22/98 kB | 16 kB | 17/35 kB | 12/49 kB | 16/782 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/arns/2.20.43/arns-2.20.43.jar (16 kB at 272 kB/s) 2024-06-04T16:06:58.998 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (4): 22/98 kB | 18/35 kB | 12/49 kB | 16/782 kB Progress (4): 22/98 kB | 18/35 kB | 14/49 kB | 16/782 kB Progress (4): 22/98 kB | 19/35 kB | 14/49 kB | 16/782 kB Progress (4): 23/98 kB | 19/35 kB | 14/49 kB | 16/782 kB Downloading from central: https://repo.maven.apache.org/maven2/org/reactivestreams/reactive-streams/1.0.3/reactive-streams-1.0.3.jar 2024-06-04T16:06:59.010 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (4): 23/98 kB | 21/35 kB | 14/49 kB | 16/782 kB Progress (4): 23/98 kB | 21/35 kB | 15/49 kB | 16/782 kB Progress (4): 23/98 kB | 21/35 kB | 15/49 kB | 33/782 kB Progress (4): 23/98 kB | 22/35 kB | 15/49 kB | 33/782 kB Progress (4): 23/98 kB | 22/35 kB | 16/49 kB | 33/782 kB Progress (4): 25/98 kB | 22/35 kB | 16/49 kB | 33/782 kB Progress (4): 25/98 kB | 23/35 kB | 16/49 kB | 33/782 kB Progress (4): 26/98 kB | 23/35 kB | 16/49 kB | 33/782 kB Progress (4): 26/98 kB | 23/35 kB | 18/49 kB | 33/782 kB Progress (4): 28/98 kB | 23/35 kB | 18/49 kB | 33/782 kB Progress (4): 28/98 kB | 23/35 kB | 18/49 kB | 49/782 kB Progress (4): 28/98 kB | 23/35 kB | 19/49 kB | 49/782 kB Progress (4): 28/98 kB | 25/35 kB | 19/49 kB | 49/782 kB Progress (4): 28/98 kB | 25/35 kB | 21/49 kB | 49/782 kB Progress (4): 28/98 kB | 26/35 kB | 21/49 kB | 49/782 kB Progress (4): 28/98 kB | 26/35 kB | 22/49 kB | 49/782 kB Progress (4): 28/98 kB | 26/35 kB | 22/49 kB | 63/782 kB Progress (4): 28/98 kB | 26/35 kB | 23/49 kB | 63/782 kB Progress (4): 28/98 kB | 26/35 kB | 25/49 kB | 63/782 kB Progress (4): 28/98 kB | 26/35 kB | 26/49 kB | 63/782 kB Progress (4): 28/98 kB | 26/35 kB | 27/49 kB | 63/782 kB Progress (4): 28/98 kB | 26/35 kB | 27/49 kB | 79/782 kB Progress (4): 28/98 kB | 28/35 kB | 27/49 kB | 79/782 kB Progress (4): 29/98 kB | 28/35 kB | 27/49 kB | 79/782 kB Progress (4): 29/98 kB | 29/35 kB | 27/49 kB | 79/782 kB Progress (4): 29/98 kB | 29/35 kB | 29/49 kB | 79/782 kB Progress (4): 30/98 kB | 29/35 kB | 29/49 kB | 79/782 kB Progress (4): 30/98 kB | 29/35 kB | 30/49 kB | 79/782 kB Progress (4): 30/98 kB | 30/35 kB | 30/49 kB | 79/782 kB Progress (4): 30/98 kB | 30/35 kB | 30/49 kB | 96/782 kB Progress (4): 30/98 kB | 30/35 kB | 30/49 kB | 112/782 kB Progress (4): 30/98 kB | 30/35 kB | 30/49 kB | 128/782 kB Progress (4): 30/98 kB | 30/35 kB | 30/49 kB | 145/782 kB Progress (4): 30/98 kB | 30/35 kB | 30/49 kB | 161/782 kB Progress (4): 30/98 kB | 30/35 kB | 30/49 kB | 178/782 kB Progress (4): 30/98 kB | 30/35 kB | 30/49 kB | 194/782 kB Progress (4): 30/98 kB | 30/35 kB | 30/49 kB | 210/782 kB Progress (4): 30/98 kB | 30/35 kB | 30/49 kB | 227/782 kB Progress (4): 30/98 kB | 30/35 kB | 30/49 kB | 243/782 kB Progress (4): 30/98 kB | 30/35 kB | 30/49 kB | 259/782 kB Progress (4): 30/98 kB | 30/35 kB | 30/49 kB | 276/782 kB Progress (4): 30/98 kB | 30/35 kB | 30/49 kB | 292/782 kB Progress (4): 30/98 kB | 30/35 kB | 30/49 kB | 309/782 kB Progress (4): 30/98 kB | 30/35 kB | 30/49 kB | 325/782 kB Progress (4): 30/98 kB | 30/35 kB | 30/49 kB | 341/782 kB Progress (4): 30/98 kB | 30/35 kB | 30/49 kB | 358/782 kB Progress (4): 30/98 kB | 30/35 kB | 30/49 kB | 374/782 kB Progress (4): 30/98 kB | 30/35 kB | 30/49 kB | 391/782 kB Progress (4): 30/98 kB | 30/35 kB | 30/49 kB | 407/782 kB Progress (4): 30/98 kB | 30/35 kB | 30/49 kB | 423/782 kB Progress (4): 30/98 kB | 30/35 kB | 30/49 kB | 440/782 kB Progress (4): 32/98 kB | 30/35 kB | 30/49 kB | 440/782 kB Progress (4): 33/98 kB | 30/35 kB | 30/49 kB | 440/782 kB Progress (4): 34/98 kB | 30/35 kB | 30/49 kB | 440/782 kB Progress (4): 34/98 kB | 30/35 kB | 32/49 kB | 440/782 kB Progress (4): 34/98 kB | 30/35 kB | 32/49 kB | 456/782 kB Progress (4): 34/98 kB | 32/35 kB | 32/49 kB | 456/782 kB Progress (4): 34/98 kB | 32/35 kB | 33/49 kB | 456/782 kB Progress (4): 34/98 kB | 32/35 kB | 34/49 kB | 456/782 kB Progress (4): 34/98 kB | 33/35 kB | 34/49 kB | 456/782 kB Progress (4): 34/98 kB | 33/35 kB | 36/49 kB | 456/782 kB Progress (4): 34/98 kB | 33/35 kB | 36/49 kB | 472/782 kB Progress (4): 34/98 kB | 33/35 kB | 37/49 kB | 472/782 kB Progress (4): 34/98 kB | 34/35 kB | 37/49 kB | 472/782 kB Progress (4): 36/98 kB | 34/35 kB | 37/49 kB | 472/782 kB Progress (4): 36/98 kB | 35 kB | 37/49 kB | 472/782 kB Progress (4): 37/98 kB | 35 kB | 37/49 kB | 472/782 kB Progress (4): 37/98 kB | 35 kB | 37/49 kB | 489/782 kB Progress (4): 39/98 kB | 35 kB | 37/49 kB | 489/782 kB Progress (4): 40/98 kB | 35 kB | 37/49 kB | 489/782 kB Progress (4): 40/98 kB | 35 kB | 37/49 kB | 505/782 kB Progress (4): 40/98 kB | 35 kB | 38/49 kB | 505/782 kB Progress (4): 41/98 kB | 35 kB | 38/49 kB | 505/782 kB Progress (4): 41/98 kB | 35 kB | 40/49 kB | 505/782 kB Progress (4): 43/98 kB | 35 kB | 40/49 kB | 505/782 kB Progress (4): 43/98 kB | 35 kB | 41/49 kB | 505/782 kB Progress (4): 43/98 kB | 35 kB | 41/49 kB | 522/782 kB Progress (4): 43/98 kB | 35 kB | 43/49 kB | 522/782 kB Progress (4): 44/98 kB | 35 kB | 43/49 kB | 522/782 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocol-core/2.20.43/protocol-core-2.20.43.jar (35 kB at 489 kB/s) 2024-06-04T16:06:59.010 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (3): 46/98 kB | 43/49 kB | 522/782 kB Progress (3): 46/98 kB | 44/49 kB | 522/782 kB Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/auth/2.20.43/auth-2.20.43.jar 2024-06-04T16:06:59.010 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (3): 46/98 kB | 44/49 kB | 538/782 kB Progress (3): 47/98 kB | 44/49 kB | 538/782 kB Progress (3): 47/98 kB | 45/49 kB | 538/782 kB Progress (3): 48/98 kB | 45/49 kB | 538/782 kB Progress (3): 48/98 kB | 47/49 kB | 538/782 kB Progress (3): 50/98 kB | 47/49 kB | 538/782 kB Progress (3): 50/98 kB | 48/49 kB | 538/782 kB Progress (3): 51/98 kB | 48/49 kB | 538/782 kB Progress (3): 51/98 kB | 48/49 kB | 554/782 kB Progress (3): 51/98 kB | 49 kB | 554/782 kB Progress (3): 52/98 kB | 49 kB | 554/782 kB Progress (3): 52/98 kB | 49 kB | 571/782 kB Progress (3): 52/98 kB | 49 kB | 587/782 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/profiles/2.20.43/profiles-2.20.43.jar (49 kB at 684 kB/s) 2024-06-04T16:06:59.010 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/eventstream/eventstream/1.0.1/eventstream-1.0.1.jar 2024-06-04T16:06:59.015 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (2): 52/98 kB | 604/782 kB Progress (2): 52/98 kB | 620/782 kB Progress (2): 54/98 kB | 620/782 kB Progress (2): 55/98 kB | 620/782 kB Progress (2): 57/98 kB | 620/782 kB Progress (2): 57/98 kB | 636/782 kB Progress (2): 57/98 kB | 653/782 kB Progress (2): 58/98 kB | 653/782 kB Progress (2): 59/98 kB | 653/782 kB Progress (2): 61/98 kB | 653/782 kB Progress (2): 61/98 kB | 669/782 kB Progress (2): 61/98 kB | 685/782 kB Progress (2): 61/98 kB | 702/782 kB Progress (3): 61/98 kB | 702/782 kB | 1.4/11 kB Progress (3): 61/98 kB | 702/782 kB | 2.8/11 kB Progress (3): 61/98 kB | 718/782 kB | 2.8/11 kB Progress (3): 61/98 kB | 718/782 kB | 4.1/11 kB Progress (3): 61/98 kB | 718/782 kB | 5.5/11 kB Progress (3): 61/98 kB | 735/782 kB | 5.5/11 kB Progress (3): 61/98 kB | 735/782 kB | 6.9/11 kB Progress (3): 61/98 kB | 751/782 kB | 6.9/11 kB Progress (3): 61/98 kB | 751/782 kB | 8.3/11 kB Progress (3): 61/98 kB | 767/782 kB | 8.3/11 kB Progress (3): 61/98 kB | 767/782 kB | 9.7/11 kB Progress (3): 61/98 kB | 767/782 kB | 11/11 kB Progress (3): 61/98 kB | 767/782 kB | 11 kB Progress (3): 61/98 kB | 782 kB | 11 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/sdk-core/2.20.43/sdk-core-2.20.43.jar (782 kB at 10 MB/s) 2024-06-04T16:06:59.015 INFO:tasks.workunit.client.0.smithi144.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/reactivestreams/reactive-streams/1.0.3/reactive-streams-1.0.3.jar (11 kB at 146 kB/s) 2024-06-04T16:06:59.015 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-client-spi/2.20.43/http-client-spi-2.20.43.jar 2024-06-04T16:06:59.015 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/regions/2.20.43/regions-2.20.43.jar 2024-06-04T16:06:59.025 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (1): 62/98 kB Progress (1): 78/98 kB Progress (1): 95/98 kB Progress (1): 98 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-xml-protocol/2.20.43/aws-xml-protocol-2.20.43.jar (98 kB at 1.1 MB/s) 2024-06-04T16:06:59.025 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/annotations/2.20.43/annotations-2.20.43.jar 2024-06-04T16:06:59.029 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (1): 16/30 kB Progress (2): 16/30 kB | 16/205 kB Progress (2): 30 kB | 16/205 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/eventstream/eventstream/1.0.1/eventstream-1.0.1.jar (30 kB at 328 kB/s) 2024-06-04T16:06:59.029 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/utils/2.20.43/utils-2.20.43.jar 2024-06-04T16:06:59.045 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (1): 33/205 kB Progress (2): 33/205 kB | 1.4/81 kB Progress (2): 33/205 kB | 2.8/81 kB Progress (3): 33/205 kB | 2.8/81 kB | 16/798 kB Progress (3): 33/205 kB | 2.8/81 kB | 33/798 kB Progress (3): 33/205 kB | 2.8/81 kB | 49/798 kB Progress (3): 33/205 kB | 2.8/81 kB | 65/798 kB Progress (3): 33/205 kB | 4.1/81 kB | 65/798 kB Progress (3): 33/205 kB | 5.5/81 kB | 65/798 kB Progress (3): 33/205 kB | 6.9/81 kB | 65/798 kB Progress (3): 33/205 kB | 6.9/81 kB | 81/798 kB Progress (3): 33/205 kB | 6.9/81 kB | 98/798 kB Progress (3): 33/205 kB | 6.9/81 kB | 114/798 kB Progress (3): 33/205 kB | 6.9/81 kB | 131/798 kB Progress (3): 33/205 kB | 6.9/81 kB | 147/798 kB Progress (3): 33/205 kB | 8.3/81 kB | 147/798 kB Progress (3): 33/205 kB | 9.7/81 kB | 147/798 kB Progress (3): 33/205 kB | 11/81 kB | 147/798 kB Progress (3): 33/205 kB | 11/81 kB | 163/798 kB Progress (3): 33/205 kB | 11/81 kB | 180/798 kB Progress (3): 33/205 kB | 11/81 kB | 196/798 kB Progress (3): 33/205 kB | 11/81 kB | 213/798 kB Progress (3): 33/205 kB | 11/81 kB | 229/798 kB Progress (3): 33/205 kB | 11/81 kB | 245/798 kB Progress (3): 33/205 kB | 12/81 kB | 245/798 kB Progress (3): 33/205 kB | 14/81 kB | 245/798 kB Progress (3): 33/205 kB | 14/81 kB | 262/798 kB Progress (3): 33/205 kB | 15/81 kB | 262/798 kB Progress (3): 33/205 kB | 16/81 kB | 262/798 kB Progress (3): 33/205 kB | 16/81 kB | 278/798 kB Progress (3): 33/205 kB | 16/81 kB | 294/798 kB Progress (3): 33/205 kB | 16/81 kB | 311/798 kB Progress (3): 33/205 kB | 16/81 kB | 327/798 kB Progress (3): 33/205 kB | 16/81 kB | 344/798 kB Progress (3): 33/205 kB | 16/81 kB | 360/798 kB Progress (3): 33/205 kB | 16/81 kB | 376/798 kB Progress (3): 33/205 kB | 16/81 kB | 393/798 kB Progress (3): 33/205 kB | 16/81 kB | 409/798 kB Progress (3): 33/205 kB | 16/81 kB | 426/798 kB Progress (3): 33/205 kB | 16/81 kB | 442/798 kB Progress (3): 33/205 kB | 16/81 kB | 458/798 kB Progress (3): 33/205 kB | 16/81 kB | 475/798 kB Progress (3): 33/205 kB | 16/81 kB | 491/798 kB Progress (3): 49/205 kB | 16/81 kB | 491/798 kB Progress (3): 49/205 kB | 16/81 kB | 507/798 kB Progress (3): 49/205 kB | 16/81 kB | 524/798 kB Progress (3): 49/205 kB | 16/81 kB | 540/798 kB Progress (3): 49/205 kB | 16/81 kB | 557/798 kB Progress (4): 49/205 kB | 16/81 kB | 557/798 kB | 13 kB Progress (4): 66/205 kB | 16/81 kB | 557/798 kB | 13 kB Progress (4): 66/205 kB | 16/81 kB | 573/798 kB | 13 kB Progress (4): 66/205 kB | 16/81 kB | 589/798 kB | 13 kB Progress (4): 82/205 kB | 16/81 kB | 589/798 kB | 13 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/annotations/2.20.43/annotations-2.20.43.jar (13 kB at 124 kB/s) 2024-06-04T16:06:59.045 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (3): 82/205 kB | 16/81 kB | 606/798 kB Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-core/2.20.43/aws-core-2.20.43.jar 2024-06-04T16:06:59.049 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (3): 82/205 kB | 16/81 kB | 622/798 kB Progress (3): 82/205 kB | 16/81 kB | 639/798 kB Progress (3): 98/205 kB | 16/81 kB | 639/798 kB Progress (3): 98/205 kB | 16/81 kB | 655/798 kB Progress (3): 98/205 kB | 16/81 kB | 671/798 kB Progress (3): 98/205 kB | 16/81 kB | 688/798 kB Progress (3): 98/205 kB | 16/81 kB | 704/798 kB Progress (3): 98/205 kB | 16/81 kB | 720/798 kB Progress (3): 98/205 kB | 16/81 kB | 737/798 kB Progress (3): 98/205 kB | 16/81 kB | 753/798 kB Progress (3): 98/205 kB | 16/81 kB | 770/798 kB Progress (3): 115/205 kB | 16/81 kB | 770/798 kB Progress (3): 115/205 kB | 16/81 kB | 786/798 kB Progress (4): 115/205 kB | 16/81 kB | 786/798 kB | 16/182 kB Progress (4): 115/205 kB | 16/81 kB | 798 kB | 16/182 kB Progress (4): 131/205 kB | 16/81 kB | 798 kB | 16/182 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/regions/2.20.43/regions-2.20.43.jar (798 kB at 7.2 MB/s) 2024-06-04T16:06:59.049 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/metrics-spi/2.20.43/metrics-spi-2.20.43.jar 2024-06-04T16:06:59.057 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (3): 131/205 kB | 16/81 kB | 33/182 kB Progress (3): 131/205 kB | 33/81 kB | 33/182 kB Progress (3): 131/205 kB | 33/81 kB | 49/182 kB Progress (3): 131/205 kB | 49/81 kB | 49/182 kB Progress (3): 131/205 kB | 49/81 kB | 66/182 kB Progress (3): 131/205 kB | 66/81 kB | 66/182 kB Progress (3): 131/205 kB | 81 kB | 66/182 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-client-spi/2.20.43/http-client-spi-2.20.43.jar (81 kB at 677 kB/s) 2024-06-04T16:06:59.057 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/json-utils/2.20.43/json-utils-2.20.43.jar 2024-06-04T16:06:59.062 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (2): 147/205 kB | 66/182 kB Progress (2): 164/205 kB | 66/182 kB Progress (2): 176/205 kB | 66/182 kB Progress (2): 192/205 kB | 66/182 kB Progress (2): 205 kB | 66/182 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/auth/2.20.43/auth-2.20.43.jar (205 kB at 1.6 MB/s) 2024-06-04T16:06:59.062 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party-jackson-core/2.20.43/third-party-jackson-core-2.20.43.jar 2024-06-04T16:06:59.066 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (1): 80/182 kB Progress (2): 80/182 kB | 16/151 kB Progress (2): 80/182 kB | 33/151 kB Progress (2): 96/182 kB | 33/151 kB Progress (2): 96/182 kB | 49/151 kB Progress (3): 96/182 kB | 49/151 kB | 16/27 kB Progress (3): 96/182 kB | 49/151 kB | 27 kB Progress (3): 96/182 kB | 61/151 kB | 27 kB Progress (3): 112/182 kB | 61/151 kB | 27 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/metrics-spi/2.20.43/metrics-spi-2.20.43.jar (27 kB at 213 kB/s) 2024-06-04T16:06:59.066 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/endpoints-spi/2.20.43/endpoints-spi-2.20.43.jar 2024-06-04T16:06:59.071 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (2): 112/182 kB | 78/151 kB Progress (2): 129/182 kB | 78/151 kB Progress (2): 145/182 kB | 78/151 kB Progress (2): 145/182 kB | 94/151 kB Progress (2): 162/182 kB | 94/151 kB Progress (2): 178/182 kB | 94/151 kB Progress (2): 182 kB | 94/151 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/utils/2.20.43/utils-2.20.43.jar (182 kB at 1.4 MB/s) 2024-06-04T16:06:59.071 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/apache-client/2.20.43/apache-client-2.20.43.jar 2024-06-04T16:06:59.075 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (2): 94/151 kB | 16/30 kB Progress (2): 94/151 kB | 30 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/json-utils/2.20.43/json-utils-2.20.43.jar (30 kB at 219 kB/s) 2024-06-04T16:06:59.075 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpclient/4.5.13/httpclient-4.5.13.jar 2024-06-04T16:06:59.079 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (1): 111/151 kB Progress (1): 127/151 kB Progress (1): 143/151 kB Progress (1): 151 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-core/2.20.43/aws-core-2.20.43.jar (151 kB at 1.1 MB/s) 2024-06-04T16:06:59.080 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcore/4.4.13/httpcore-4.4.13.jar 2024-06-04T16:06:59.083 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (1): 16/385 kB Progress (1): 33/385 kB Progress (1): 49/385 kB Progress (1): 61/385 kB Progress (1): 78/385 kB Progress (1): 94/385 kB Progress (1): 111/385 kB Progress (1): 127/385 kB Progress (1): 143/385 kB Progress (2): 143/385 kB | 13 kB Progress (2): 160/385 kB | 13 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/endpoints-spi/2.20.43/endpoints-spi-2.20.43.jar (13 kB at 91 kB/s) 2024-06-04T16:06:59.083 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.1/commons-io-2.15.1.jar 2024-06-04T16:06:59.090 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (1): 176/385 kB Progress (1): 193/385 kB Progress (1): 209/385 kB Progress (1): 225/385 kB Progress (1): 242/385 kB Progress (1): 258/385 kB Progress (2): 258/385 kB | 16/75 kB Progress (2): 258/385 kB | 33/75 kB Progress (2): 258/385 kB | 49/75 kB Progress (2): 258/385 kB | 64/75 kB Progress (2): 258/385 kB | 75 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/apache-client/2.20.43/apache-client-2.20.43.jar (75 kB at 490 kB/s) 2024-06-04T16:06:59.090 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.15/commons-codec-1.15.jar 2024-06-04T16:06:59.098 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (2): 258/385 kB | 16/780 kB Progress (2): 274/385 kB | 16/780 kB Progress (2): 291/385 kB | 16/780 kB Progress (2): 291/385 kB | 32/780 kB Progress (2): 307/385 kB | 32/780 kB Progress (2): 324/385 kB | 32/780 kB Progress (2): 340/385 kB | 32/780 kB Progress (2): 340/385 kB | 49/780 kB Progress (2): 356/385 kB | 49/780 kB Progress (2): 373/385 kB | 49/780 kB Progress (2): 385 kB | 49/780 kB Progress (2): 385 kB | 65/780 kB Progress (3): 385 kB | 65/780 kB | 16/329 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party-jackson-core/2.20.43/third-party-jackson-core-2.20.43.jar (385 kB at 2.4 MB/s) 2024-06-04T16:06:59.099 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (2): 65/780 kB | 33/329 kB Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.28/slf4j-api-1.7.28.jar 2024-06-04T16:06:59.110 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (2): 81/780 kB | 33/329 kB Progress (2): 81/780 kB | 49/329 kB Progress (2): 98/780 kB | 49/329 kB Progress (2): 98/780 kB | 66/329 kB Progress (2): 98/780 kB | 82/329 kB Progress (2): 98/780 kB | 98/329 kB Progress (3): 98/780 kB | 98/329 kB | 16/501 kB Progress (3): 114/780 kB | 98/329 kB | 16/501 kB Progress (3): 114/780 kB | 98/329 kB | 33/501 kB Progress (3): 114/780 kB | 115/329 kB | 33/501 kB Progress (3): 114/780 kB | 115/329 kB | 49/501 kB Progress (3): 114/780 kB | 131/329 kB | 49/501 kB Progress (3): 114/780 kB | 131/329 kB | 65/501 kB Progress (3): 114/780 kB | 131/329 kB | 81/501 kB Progress (3): 114/780 kB | 131/329 kB | 97/501 kB Progress (3): 114/780 kB | 131/329 kB | 114/501 kB Progress (3): 114/780 kB | 131/329 kB | 130/501 kB Progress (3): 114/780 kB | 131/329 kB | 147/501 kB Progress (3): 114/780 kB | 131/329 kB | 163/501 kB Progress (3): 114/780 kB | 131/329 kB | 179/501 kB Progress (3): 114/780 kB | 131/329 kB | 196/501 kB Progress (3): 114/780 kB | 131/329 kB | 212/501 kB Progress (3): 114/780 kB | 131/329 kB | 228/501 kB Progress (3): 114/780 kB | 147/329 kB | 228/501 kB Progress (3): 114/780 kB | 147/329 kB | 245/501 kB Progress (3): 114/780 kB | 164/329 kB | 245/501 kB Progress (3): 114/780 kB | 164/329 kB | 261/501 kB Progress (3): 114/780 kB | 164/329 kB | 278/501 kB Progress (3): 114/780 kB | 164/329 kB | 294/501 kB Progress (3): 114/780 kB | 164/329 kB | 310/501 kB Progress (3): 114/780 kB | 180/329 kB | 310/501 kB Progress (3): 114/780 kB | 180/329 kB | 327/501 kB Progress (3): 114/780 kB | 197/329 kB | 327/501 kB Progress (3): 114/780 kB | 197/329 kB | 343/501 kB Progress (3): 114/780 kB | 213/329 kB | 343/501 kB Progress (3): 114/780 kB | 213/329 kB | 360/501 kB Progress (3): 114/780 kB | 229/329 kB | 360/501 kB Progress (3): 114/780 kB | 229/329 kB | 376/501 kB Progress (3): 114/780 kB | 229/329 kB | 392/501 kB Progress (3): 114/780 kB | 229/329 kB | 409/501 kB Progress (3): 114/780 kB | 229/329 kB | 425/501 kB Progress (3): 114/780 kB | 246/329 kB | 425/501 kB Progress (3): 114/780 kB | 246/329 kB | 441/501 kB Progress (3): 114/780 kB | 256/329 kB | 441/501 kB Progress (3): 114/780 kB | 256/329 kB | 458/501 kB Progress (3): 114/780 kB | 256/329 kB | 474/501 kB Progress (3): 114/780 kB | 256/329 kB | 491/501 kB Progress (3): 114/780 kB | 256/329 kB | 501 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.1/commons-io-2.15.1.jar (501 kB at 2.9 MB/s) 2024-06-04T16:06:59.110 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter/5.10.1/junit-jupiter-5.10.1.jar 2024-06-04T16:06:59.115 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (3): 114/780 kB | 256/329 kB | 16/354 kB Progress (3): 130/780 kB | 256/329 kB | 16/354 kB Progress (3): 130/780 kB | 256/329 kB | 33/354 kB Progress (3): 147/780 kB | 256/329 kB | 33/354 kB Progress (3): 147/780 kB | 256/329 kB | 49/354 kB Progress (3): 147/780 kB | 256/329 kB | 66/354 kB Progress (3): 147/780 kB | 256/329 kB | 82/354 kB Progress (3): 163/780 kB | 256/329 kB | 82/354 kB Progress (3): 180/780 kB | 256/329 kB | 82/354 kB Progress (3): 180/780 kB | 256/329 kB | 98/354 kB Progress (3): 180/780 kB | 256/329 kB | 115/354 kB Progress (3): 196/780 kB | 256/329 kB | 115/354 kB Progress (3): 196/780 kB | 256/329 kB | 131/354 kB Progress (3): 212/780 kB | 256/329 kB | 131/354 kB Progress (3): 212/780 kB | 272/329 kB | 131/354 kB Progress (3): 212/780 kB | 272/329 kB | 147/354 kB Progress (3): 212/780 kB | 289/329 kB | 147/354 kB Progress (3): 229/780 kB | 289/329 kB | 147/354 kB Progress (3): 229/780 kB | 289/329 kB | 164/354 kB Progress (3): 229/780 kB | 305/329 kB | 164/354 kB Progress (3): 229/780 kB | 305/329 kB | 180/354 kB Progress (3): 229/780 kB | 321/329 kB | 180/354 kB Progress (3): 245/780 kB | 321/329 kB | 180/354 kB Progress (3): 245/780 kB | 329 kB | 180/354 kB Progress (3): 245/780 kB | 329 kB | 197/354 kB Progress (3): 262/780 kB | 329 kB | 197/354 kB Progress (3): 262/780 kB | 329 kB | 213/354 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcore/4.4.13/httpcore-4.4.13.jar (329 kB at 1.8 MB/s) 2024-06-04T16:06:59.129 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (2): 278/780 kB | 213/354 kB Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-params/5.10.1/junit-jupiter-params-5.10.1.jar 2024-06-04T16:06:59.129 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (2): 294/780 kB | 213/354 kB Progress (3): 294/780 kB | 213/354 kB | 6.4 kB Progress (3): 311/780 kB | 213/354 kB | 6.4 kB Progress (4): 311/780 kB | 213/354 kB | 6.4 kB | 16/41 kB Progress (4): 327/780 kB | 213/354 kB | 6.4 kB | 16/41 kB Progress (4): 327/780 kB | 229/354 kB | 6.4 kB | 16/41 kB Progress (4): 327/780 kB | 229/354 kB | 6.4 kB | 33/41 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter/5.10.1/junit-jupiter-5.10.1.jar (6.4 kB at 33 kB/s) 2024-06-04T16:06:59.129 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (3): 343/780 kB | 229/354 kB | 33/41 kB Progress (3): 343/780 kB | 229/354 kB | 41 kB Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-api/5.10.1/junit-jupiter-api-5.10.1.jar 2024-06-04T16:06:59.130 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (3): 343/780 kB | 246/354 kB | 41 kB Progress (3): 360/780 kB | 246/354 kB | 41 kB Progress (3): 360/780 kB | 262/354 kB | 41 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.28/slf4j-api-1.7.28.jar (41 kB at 215 kB/s) 2024-06-04T16:06:59.131 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (2): 376/780 kB | 262/354 kB Downloading from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.3.0/opentest4j-1.3.0.jar 2024-06-04T16:06:59.133 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (2): 376/780 kB | 279/354 kB Progress (2): 393/780 kB | 279/354 kB Progress (2): 402/780 kB | 279/354 kB Progress (2): 402/780 kB | 295/354 kB Progress (2): 418/780 kB | 295/354 kB Progress (2): 418/780 kB | 311/354 kB Progress (2): 435/780 kB | 311/354 kB Progress (2): 451/780 kB | 311/354 kB Progress (2): 451/780 kB | 328/354 kB Progress (2): 468/780 kB | 328/354 kB Progress (2): 468/780 kB | 344/354 kB Progress (2): 484/780 kB | 344/354 kB Progress (2): 484/780 kB | 354 kB Progress (2): 500/780 kB | 354 kB Progress (2): 517/780 kB | 354 kB Progress (2): 533/780 kB | 354 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.15/commons-codec-1.15.jar (354 kB at 1.8 MB/s) 2024-06-04T16:06:59.133 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.10.1/junit-platform-commons-1.10.1.jar 2024-06-04T16:06:59.141 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (1): 549/780 kB Progress (1): 566/780 kB Progress (1): 582/780 kB Progress (1): 599/780 kB Progress (1): 615/780 kB Progress (1): 621/780 kB Progress (1): 638/780 kB Progress (1): 654/780 kB Progress (1): 670/780 kB Progress (1): 687/780 kB Progress (1): 703/780 kB Progress (1): 720/780 kB Progress (1): 736/780 kB Progress (1): 752/780 kB Progress (1): 769/780 kB Progress (1): 780 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpclient/4.5.13/httpclient-4.5.13.jar (780 kB at 3.8 MB/s) 2024-06-04T16:06:59.141 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apiguardian/apiguardian-api/1.1.2/apiguardian-api-1.1.2.jar 2024-06-04T16:06:59.154 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (1): 16/586 kB Progress (1): 33/586 kB Progress (1): 49/586 kB Progress (1): 66/586 kB Progress (1): 82/586 kB Progress (1): 98/586 kB Progress (1): 115/586 kB Progress (1): 131/586 kB Progress (1): 147/586 kB Progress (1): 164/586 kB Progress (1): 180/586 kB Progress (1): 197/586 kB Progress (1): 213/586 kB Progress (1): 229/586 kB Progress (2): 229/586 kB | 16/211 kB Progress (2): 246/586 kB | 16/211 kB Progress (2): 246/586 kB | 33/211 kB Progress (3): 246/586 kB | 33/211 kB | 14 kB Progress (3): 262/586 kB | 33/211 kB | 14 kB Progress (3): 262/586 kB | 48/211 kB | 14 kB Progress (3): 262/586 kB | 64/211 kB | 14 kB Progress (3): 279/586 kB | 64/211 kB | 14 kB Progress (3): 279/586 kB | 78/211 kB | 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.3.0/opentest4j-1.3.0.jar (14 kB at 67 kB/s) 2024-06-04T16:06:59.154 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-engine/5.10.1/junit-jupiter-engine-5.10.1.jar 2024-06-04T16:06:59.154 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (2): 295/586 kB | 78/211 kB Progress (2): 295/586 kB | 95/211 kB Progress (2): 295/586 kB | 111/211 kB Progress (2): 311/586 kB | 111/211 kB Progress (2): 311/586 kB | 127/211 kB Progress (2): 328/586 kB | 127/211 kB Progress (2): 328/586 kB | 144/211 kB Progress (3): 328/586 kB | 144/211 kB | 16/106 kB Progress (3): 344/586 kB | 144/211 kB | 16/106 kB Progress (3): 344/586 kB | 160/211 kB | 16/106 kB Progress (3): 344/586 kB | 160/211 kB | 32/106 kB Progress (3): 344/586 kB | 177/211 kB | 32/106 kB Progress (3): 344/586 kB | 177/211 kB | 49/106 kB Progress (3): 360/586 kB | 177/211 kB | 49/106 kB Progress (3): 360/586 kB | 193/211 kB | 49/106 kB Progress (3): 360/586 kB | 193/211 kB | 65/106 kB Progress (3): 377/586 kB | 193/211 kB | 65/106 kB Progress (3): 377/586 kB | 209/211 kB | 65/106 kB Progress (3): 377/586 kB | 209/211 kB | 79/106 kB Progress (3): 377/586 kB | 211 kB | 79/106 kB Progress (3): 377/586 kB | 211 kB | 96/106 kB Progress (3): 393/586 kB | 211 kB | 96/106 kB Progress (3): 393/586 kB | 211 kB | 106 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-api/5.10.1/junit-jupiter-api-5.10.1.jar (211 kB at 981 kB/s) 2024-06-04T16:06:59.155 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (2): 410/586 kB | 106 kB Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.10.1/junit-platform-engine-1.10.1.jar 2024-06-04T16:06:59.155 INFO:tasks.workunit.client.0.smithi144.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.10.1/junit-platform-commons-1.10.1.jar (106 kB at 494 kB/s) 2024-06-04T16:06:59.155 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-simple/1.7.28/slf4j-simple-1.7.28.jar 2024-06-04T16:06:59.158 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (1): 426/586 kB Progress (1): 442/586 kB Progress (1): 459/586 kB Progress (1): 475/586 kB Progress (1): 492/586 kB Progress (1): 508/586 kB Progress (1): 524/586 kB Progress (1): 541/586 kB Progress (1): 557/586 kB Progress (2): 557/586 kB | 6.8 kB Progress (2): 573/586 kB | 6.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apiguardian/apiguardian-api/1.1.2/apiguardian-api-1.1.2.jar (6.8 kB at 31 kB/s) 2024-06-04T16:06:59.158 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/jcl-over-slf4j/1.7.28/jcl-over-slf4j-1.7.28.jar 2024-06-04T16:06:59.158 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (1): 586 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-params/5.10.1/junit-jupiter-params-5.10.1.jar (586 kB at 2.7 MB/s) 2024-06-04T16:06:59.158 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite/1.10.1/junit-platform-suite-1.10.1.jar 2024-06-04T16:06:59.173 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (1): 16/245 kB Progress (1): 33/245 kB Progress (1): 49/245 kB Progress (1): 66/245 kB Progress (1): 82/245 kB Progress (1): 98/245 kB Progress (1): 115/245 kB Progress (2): 115/245 kB | 16/205 kB Progress (2): 131/245 kB | 16/205 kB Progress (2): 131/245 kB | 33/205 kB Progress (2): 147/245 kB | 33/205 kB Progress (2): 147/245 kB | 49/205 kB Progress (2): 147/245 kB | 62/205 kB Progress (3): 147/245 kB | 62/205 kB | 15 kB Progress (3): 164/245 kB | 62/205 kB | 15 kB Progress (3): 164/245 kB | 78/205 kB | 15 kB Progress (3): 180/245 kB | 78/205 kB | 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-simple/1.7.28/slf4j-simple-1.7.28.jar (15 kB at 65 kB/s) 2024-06-04T16:06:59.173 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-api/1.10.1/junit-platform-suite-api-1.10.1.jar 2024-06-04T16:06:59.176 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (2): 180/245 kB | 94/205 kB Progress (2): 197/245 kB | 94/205 kB Progress (2): 197/245 kB | 111/205 kB Progress (2): 213/245 kB | 111/205 kB Progress (2): 213/245 kB | 127/205 kB Progress (2): 213/245 kB | 144/205 kB Progress (2): 229/245 kB | 144/205 kB Progress (2): 229/245 kB | 160/205 kB Progress (2): 245 kB | 160/205 kB Progress (2): 245 kB | 176/205 kB Progress (2): 245 kB | 193/205 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-engine/5.10.1/junit-jupiter-engine-5.10.1.jar (245 kB at 1.0 MB/s) 2024-06-04T16:06:59.176 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (1): 205 kB Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-engine/1.10.1/junit-platform-suite-engine-1.10.1.jar 2024-06-04T16:06:59.176 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (2): 205 kB | 16/16 kB Progress (2): 205 kB | 16 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.10.1/junit-platform-engine-1.10.1.jar (205 kB at 868 kB/s) 2024-06-04T16:06:59.176 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-commons/1.10.1/junit-platform-suite-commons-1.10.1.jar 2024-06-04T16:06:59.176 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (2): 16 kB | 6.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/jcl-over-slf4j/1.7.28/jcl-over-slf4j-1.7.28.jar (16 kB at 69 kB/s) 2024-06-04T16:06:59.176 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.10.1/junit-platform-launcher-1.10.1.jar 2024-06-04T16:06:59.176 INFO:tasks.workunit.client.0.smithi144.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite/1.10.1/junit-platform-suite-1.10.1.jar (6.4 kB at 27 kB/s) 2024-06-04T16:06:59.190 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (1): 16/23 kB Progress (1): 23 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-api/1.10.1/junit-platform-suite-api-1.10.1.jar (23 kB at 90 kB/s) 2024-06-04T16:06:59.192 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (1): 16/17 kB Progress (1): 17 kB Progress (2): 17 kB | 16/24 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-commons/1.10.1/junit-platform-suite-commons-1.10.1.jar (17 kB at 68 kB/s) 2024-06-04T16:06:59.192 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (1): 24 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-engine/1.10.1/junit-platform-suite-engine-1.10.1.jar (24 kB at 95 kB/s) 2024-06-04T16:06:59.199 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (1): 2.7/184 kB Progress (1): 19/184 kB Progress (1): 25/184 kB Progress (1): 41/184 kB Progress (1): 43/184 kB Progress (1): 55/184 kB Progress (1): 71/184 kB Progress (1): 78/184 kB Progress (1): 95/184 kB Progress (1): 111/184 kB Progress (1): 127/184 kB Progress (1): 144/184 kB Progress (1): 160/184 kB Progress (1): 177/184 kB Progress (1): 184 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.10.1/junit-platform-launcher-1.10.1.jar (184 kB at 707 kB/s) 2024-06-04T16:06:59.224 INFO:tasks.workunit.client.0.smithi144.stdout:[INFO] 2024-06-04T16:06:59.224 INFO:tasks.workunit.client.0.smithi144.stdout:[INFO] --- clean:3.2.0:clean (default-clean) @ jcksum --- 2024-06-04T16:06:59.233 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-utils/3.3.4/maven-shared-utils-3.3.4.pom 2024-06-04T16:06:59.248 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (1): 5.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-utils/3.3.4/maven-shared-utils-3.3.4.pom (5.8 kB at 343 kB/s) 2024-06-04T16:06:59.250 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/34/maven-shared-components-34.pom 2024-06-04T16:06:59.267 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (1): 5.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/34/maven-shared-components-34.pom (5.1 kB at 283 kB/s) 2024-06-04T16:06:59.269 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/34/maven-parent-34.pom 2024-06-04T16:06:59.287 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (1): 16/43 kB Progress (1): 32/43 kB Progress (1): 43 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/34/maven-parent-34.pom (43 kB at 2.4 MB/s) 2024-06-04T16:06:59.291 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.6/commons-io-2.6.pom 2024-06-04T16:06:59.308 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.6/commons-io-2.6.pom (14 kB at 792 kB/s) 2024-06-04T16:06:59.313 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-utils/3.3.4/maven-shared-utils-3.3.4.jar 2024-06-04T16:06:59.334 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (1): 16/153 kB Progress (1): 33/153 kB Progress (1): 49/153 kB Progress (1): 63/153 kB Progress (1): 79/153 kB Progress (1): 96/153 kB Progress (1): 112/153 kB Progress (1): 128/153 kB Progress (1): 145/153 kB Progress (1): 153 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-utils/3.3.4/maven-shared-utils-3.3.4.jar (153 kB at 7.7 MB/s) 2024-06-04T16:06:59.334 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.6/commons-io-2.6.jar 2024-06-04T16:06:59.354 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (1): 16/215 kB Progress (1): 33/215 kB Progress (1): 49/215 kB Progress (1): 66/215 kB Progress (1): 79/215 kB Progress (1): 96/215 kB Progress (1): 112/215 kB Progress (1): 128/215 kB Progress (1): 145/215 kB Progress (1): 161/215 kB Progress (1): 178/215 kB Progress (1): 194/215 kB Progress (1): 210/215 kB Progress (1): 215 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.6/commons-io-2.6.jar (215 kB at 10 MB/s) 2024-06-04T16:06:59.392 INFO:tasks.workunit.client.0.smithi144.stdout:[INFO] 2024-06-04T16:06:59.392 INFO:tasks.workunit.client.0.smithi144.stdout:[INFO] --- resources:3.3.1:resources (default-resources) @ jcksum --- 2024-06-04T16:06:59.395 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.26/plexus-interpolation-1.26.pom 2024-06-04T16:06:59.412 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (1): 2.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.26/plexus-interpolation-1.26.pom (2.7 kB at 156 kB/s) 2024-06-04T16:06:59.414 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/5.1/plexus-5.1.pom 2024-06-04T16:06:59.431 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (1): 16/23 kB Progress (1): 23 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/5.1/plexus-5.1.pom (23 kB at 1.3 MB/s) 2024-06-04T16:06:59.433 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.1/plexus-utils-3.5.1.pom 2024-06-04T16:06:59.451 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (1): 8.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.1/plexus-utils-3.5.1.pom (8.8 kB at 516 kB/s) 2024-06-04T16:06:59.453 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/10/plexus-10.pom 2024-06-04T16:06:59.470 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (1): 16/25 kB Progress (1): 25 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/10/plexus-10.pom (25 kB at 1.5 MB/s) 2024-06-04T16:06:59.473 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-filtering/3.3.1/maven-filtering-3.3.1.pom 2024-06-04T16:06:59.490 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (1): 6.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-filtering/3.3.1/maven-filtering-3.3.1.pom (6.0 kB at 355 kB/s) 2024-06-04T16:06:59.492 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/39/maven-shared-components-39.pom 2024-06-04T16:06:59.508 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/39/maven-shared-components-39.pom (3.2 kB at 189 kB/s) 2024-06-04T16:06:59.511 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/javax/inject/javax.inject/1/javax.inject-1.pom 2024-06-04T16:06:59.528 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (1): 612 B Downloaded from central: https://repo.maven.apache.org/maven2/javax/inject/javax.inject/1/javax.inject-1.pom (612 B at 38 kB/s) 2024-06-04T16:06:59.529 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.36/slf4j-api-1.7.36.pom 2024-06-04T16:06:59.547 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (1): 2.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.36/slf4j-api-1.7.36.pom (2.7 kB at 161 kB/s) 2024-06-04T16:06:59.548 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.36/slf4j-parent-1.7.36.pom 2024-06-04T16:06:59.564 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.36/slf4j-parent-1.7.36.pom (14 kB at 829 kB/s) 2024-06-04T16:06:59.566 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-build-api/0.0.7/plexus-build-api-0.0.7.pom 2024-06-04T16:06:59.583 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-build-api/0.0.7/plexus-build-api-0.0.7.pom (3.2 kB at 200 kB/s) 2024-06-04T16:06:59.584 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/15/spice-parent-15.pom 2024-06-04T16:06:59.602 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (1): 8.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/15/spice-parent-15.pom (8.4 kB at 492 kB/s) 2024-06-04T16:06:59.603 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/5/forge-parent-5.pom 2024-06-04T16:06:59.621 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (1): 8.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/5/forge-parent-5.pom (8.4 kB at 492 kB/s) 2024-06-04T16:06:59.623 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.0/plexus-utils-3.5.0.pom 2024-06-04T16:06:59.641 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (1): 8.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.0/plexus-utils-3.5.0.pom (8.0 kB at 422 kB/s) 2024-06-04T16:06:59.644 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.11.0/commons-io-2.11.0.pom 2024-06-04T16:06:59.661 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.11.0/commons-io-2.11.0.pom (20 kB at 1.2 MB/s) 2024-06-04T16:06:59.665 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.7.2/junit-bom-5.7.2.pom 2024-06-04T16:06:59.681 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (1): 5.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.7.2/junit-bom-5.7.2.pom (5.1 kB at 300 kB/s) 2024-06-04T16:06:59.684 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-lang3/3.12.0/commons-lang3-3.12.0.pom 2024-06-04T16:06:59.701 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (1): 16/31 kB Progress (1): 31 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-lang3/3.12.0/commons-lang3-3.12.0.pom (31 kB at 1.8 MB/s) 2024-06-04T16:06:59.705 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.7.1/junit-bom-5.7.1.pom 2024-06-04T16:06:59.723 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (1): 5.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.7.1/junit-bom-5.7.1.pom (5.1 kB at 283 kB/s) 2024-06-04T16:06:59.726 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.26/plexus-interpolation-1.26.jar 2024-06-04T16:06:59.747 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (1): 16/85 kB Progress (1): 33/85 kB Progress (1): 49/85 kB Progress (1): 66/85 kB Progress (1): 80/85 kB Progress (1): 85 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.26/plexus-interpolation-1.26.jar (85 kB at 4.3 MB/s) 2024-06-04T16:06:59.748 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.1/plexus-utils-3.5.1.jar 2024-06-04T16:06:59.748 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-filtering/3.3.1/maven-filtering-3.3.1.jar 2024-06-04T16:06:59.748 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/javax/inject/javax.inject/1/javax.inject-1.jar 2024-06-04T16:06:59.748 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.36/slf4j-api-1.7.36.jar 2024-06-04T16:06:59.748 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-build-api/0.0.7/plexus-build-api-0.0.7.jar 2024-06-04T16:06:59.767 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (1): 2.5 kB Progress (2): 2.5 kB | 8.5 kB Progress (3): 2.5 kB | 8.5 kB | 16/55 kB Progress (3): 2.5 kB | 8.5 kB | 33/55 kB Downloaded from central: https://repo.maven.apache.org/maven2/javax/inject/javax.inject/1/javax.inject-1.jar (2.5 kB at 147 kB/s) 2024-06-04T16:06:59.767 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (2): 8.5 kB | 49/55 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-build-api/0.0.7/plexus-build-api-0.0.7.jar (8.5 kB at 530 kB/s) 2024-06-04T16:06:59.767 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.11.0/commons-io-2.11.0.jar 2024-06-04T16:06:59.767 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-lang3/3.12.0/commons-lang3-3.12.0.jar 2024-06-04T16:06:59.767 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (1): 55 kB Progress (2): 55 kB | 16/269 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-filtering/3.3.1/maven-filtering-3.3.1.jar (55 kB at 3.1 MB/s) 2024-06-04T16:06:59.767 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (1): 33/269 kB Progress (2): 33/269 kB | 16/41 kB Progress (2): 49/269 kB | 16/41 kB Progress (2): 49/269 kB | 33/41 kB Progress (2): 66/269 kB | 33/41 kB Progress (2): 66/269 kB | 41 kB Progress (2): 82/269 kB | 41 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.36/slf4j-api-1.7.36.jar (41 kB at 2.3 MB/s) 2024-06-04T16:06:59.768 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (1): 95/269 kB Progress (1): 111/269 kB Progress (1): 128/269 kB Progress (1): 144/269 kB Progress (1): 160/269 kB Progress (1): 177/269 kB Progress (1): 193/269 kB Progress (1): 210/269 kB Progress (1): 226/269 kB Progress (1): 242/269 kB Progress (1): 259/269 kB Progress (1): 269 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.1/plexus-utils-3.5.1.jar (269 kB at 12 MB/s) 2024-06-04T16:06:59.787 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (1): 15/327 kB Progress (1): 31/327 kB Progress (1): 48/327 kB Progress (1): 64/327 kB Progress (1): 81/327 kB Progress (1): 97/327 kB Progress (1): 113/327 kB Progress (1): 127/327 kB Progress (1): 144/327 kB Progress (1): 160/327 kB Progress (2): 160/327 kB | 16/587 kB Progress (2): 176/327 kB | 16/587 kB Progress (2): 176/327 kB | 33/587 kB Progress (2): 193/327 kB | 33/587 kB Progress (2): 193/327 kB | 49/587 kB Progress (2): 209/327 kB | 49/587 kB Progress (2): 225/327 kB | 49/587 kB Progress (2): 242/327 kB | 49/587 kB Progress (2): 242/327 kB | 66/587 kB Progress (2): 242/327 kB | 82/587 kB Progress (2): 242/327 kB | 98/587 kB Progress (2): 258/327 kB | 98/587 kB Progress (2): 258/327 kB | 115/587 kB Progress (2): 275/327 kB | 115/587 kB Progress (2): 291/327 kB | 115/587 kB Progress (2): 307/327 kB | 115/587 kB Progress (2): 324/327 kB | 115/587 kB Progress (2): 324/327 kB | 131/587 kB Progress (2): 327 kB | 131/587 kB Progress (2): 327 kB | 147/587 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.11.0/commons-io-2.11.0.jar (327 kB at 8.4 MB/s) 2024-06-04T16:06:59.794 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (1): 164/587 kB Progress (1): 180/587 kB Progress (1): 197/587 kB Progress (1): 213/587 kB Progress (1): 229/587 kB Progress (1): 246/587 kB Progress (1): 256/587 kB Progress (1): 272/587 kB Progress (1): 289/587 kB Progress (1): 305/587 kB Progress (1): 321/587 kB Progress (1): 338/587 kB Progress (1): 354/587 kB Progress (1): 370/587 kB Progress (1): 387/587 kB Progress (1): 403/587 kB Progress (1): 420/587 kB Progress (1): 436/587 kB Progress (1): 452/587 kB Progress (1): 469/587 kB Progress (1): 485/587 kB Progress (1): 502/587 kB Progress (1): 518/587 kB Progress (1): 534/587 kB Progress (1): 551/587 kB Progress (1): 567/587 kB Progress (1): 583/587 kB Progress (1): 587 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-lang3/3.12.0/commons-lang3-3.12.0.jar (587 kB at 13 MB/s) 2024-06-04T16:06:59.830 INFO:tasks.workunit.client.0.smithi144.stdout:[INFO] skip non existing resourceDirectory /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/src/main/resources 2024-06-04T16:06:59.830 INFO:tasks.workunit.client.0.smithi144.stdout:[INFO] 2024-06-04T16:06:59.830 INFO:tasks.workunit.client.0.smithi144.stdout:[INFO] --- compiler:3.11.0:compile (default-compile) @ jcksum --- 2024-06-04T16:06:59.835 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-incremental/1.1/maven-shared-incremental-1.1.pom 2024-06-04T16:06:59.852 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (1): 4.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-incremental/1.1/maven-shared-incremental-1.1.pom (4.7 kB at 279 kB/s) 2024-06-04T16:06:59.854 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/19/maven-shared-components-19.pom 2024-06-04T16:06:59.871 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (1): 6.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/19/maven-shared-components-19.pom (6.4 kB at 374 kB/s) 2024-06-04T16:06:59.872 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/23/maven-parent-23.pom 2024-06-04T16:06:59.891 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (1): 16/33 kB Progress (1): 32/33 kB Progress (1): 33 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/23/maven-parent-23.pom (33 kB at 1.7 MB/s) 2024-06-04T16:06:59.893 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/13/apache-13.pom 2024-06-04T16:06:59.914 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/13/apache-13.pom (14 kB at 699 kB/s) 2024-06-04T16:06:59.918 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/1.5.5/plexus-component-annotations-1.5.5.pom 2024-06-04T16:06:59.935 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (1): 815 B Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/1.5.5/plexus-component-annotations-1.5.5.pom (815 B at 48 kB/s) 2024-06-04T16:06:59.937 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/1.5.5/plexus-containers-1.5.5.pom 2024-06-04T16:06:59.954 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (1): 4.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/1.5.5/plexus-containers-1.5.5.pom (4.2 kB at 236 kB/s) 2024-06-04T16:06:59.956 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/2.0.7/plexus-2.0.7.pom 2024-06-04T16:06:59.974 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (1): 16/17 kB Progress (1): 17 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/2.0.7/plexus-2.0.7.pom (17 kB at 1.0 MB/s) 2024-06-04T16:06:59.977 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.1.2/plexus-java-1.1.2.pom 2024-06-04T16:06:59.994 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (1): 5.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.1.2/plexus-java-1.1.2.pom (5.0 kB at 276 kB/s) 2024-06-04T16:06:59.997 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-languages/1.1.2/plexus-languages-1.1.2.pom 2024-06-04T16:07:00.015 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (1): 4.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-languages/1.1.2/plexus-languages-1.1.2.pom (4.1 kB at 230 kB/s) 2024-06-04T16:07:00.018 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.4/asm-9.4.pom 2024-06-04T16:07:00.037 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (1): 2.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.4/asm-9.4.pom (2.4 kB at 132 kB/s) 2024-06-04T16:07:00.039 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/ow2/ow2/1.5.1/ow2-1.5.1.pom 2024-06-04T16:07:00.056 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (1): 11 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/ow2/ow2/1.5.1/ow2-1.5.1.pom (11 kB at 627 kB/s) 2024-06-04T16:07:00.059 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/com/thoughtworks/qdox/qdox/2.0.3/qdox-2.0.3.pom 2024-06-04T16:07:00.078 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (1): 16/17 kB Progress (1): 17 kB Downloaded from central: https://repo.maven.apache.org/maven2/com/thoughtworks/qdox/qdox/2.0.3/qdox-2.0.3.pom (17 kB at 907 kB/s) 2024-06-04T16:07:00.081 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/oss/oss-parent/9/oss-parent-9.pom 2024-06-04T16:07:00.100 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (1): 6.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/oss/oss-parent/9/oss-parent-9.pom (6.6 kB at 346 kB/s) 2024-06-04T16:07:00.106 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-api/2.13.0/plexus-compiler-api-2.13.0.pom 2024-06-04T16:07:00.122 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (1): 1.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-api/2.13.0/plexus-compiler-api-2.13.0.pom (1.1 kB at 59 kB/s) 2024-06-04T16:07:00.124 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler/2.13.0/plexus-compiler-2.13.0.pom 2024-06-04T16:07:00.142 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (1): 8.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler/2.13.0/plexus-compiler-2.13.0.pom (8.4 kB at 466 kB/s) 2024-06-04T16:07:00.144 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-components/10.0/plexus-components-10.0.pom 2024-06-04T16:07:00.162 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (1): 2.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-components/10.0/plexus-components-10.0.pom (2.7 kB at 149 kB/s) 2024-06-04T16:07:00.165 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.9.1/junit-bom-5.9.1.pom 2024-06-04T16:07:00.184 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (1): 5.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.9.1/junit-bom-5.9.1.pom (5.6 kB at 282 kB/s) 2024-06-04T16:07:00.188 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-manager/2.13.0/plexus-compiler-manager-2.13.0.pom 2024-06-04T16:07:00.208 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (1): 1.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-manager/2.13.0/plexus-compiler-manager-2.13.0.pom (1.1 kB at 57 kB/s) 2024-06-04T16:07:00.211 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/2.1.1/plexus-component-annotations-2.1.1.pom 2024-06-04T16:07:00.234 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (1): 770 B Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/2.1.1/plexus-component-annotations-2.1.1.pom (770 B at 33 kB/s) 2024-06-04T16:07:00.240 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/2.1.1/plexus-containers-2.1.1.pom 2024-06-04T16:07:00.254 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (1): 6.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/2.1.1/plexus-containers-2.1.1.pom (6.0 kB at 318 kB/s) 2024-06-04T16:07:00.255 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/6.5/plexus-6.5.pom 2024-06-04T16:07:00.272 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (1): 16/26 kB Progress (1): 26 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/6.5/plexus-6.5.pom (26 kB at 1.4 MB/s) 2024-06-04T16:07:00.275 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-javac/2.13.0/plexus-compiler-javac-2.13.0.pom 2024-06-04T16:07:00.297 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (1): 1.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-javac/2.13.0/plexus-compiler-javac-2.13.0.pom (1.2 kB at 55 kB/s) 2024-06-04T16:07:00.299 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compilers/2.13.0/plexus-compilers-2.13.0.pom 2024-06-04T16:07:00.323 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (1): 1.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compilers/2.13.0/plexus-compilers-2.13.0.pom (1.3 kB at 55 kB/s) 2024-06-04T16:07:00.330 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-incremental/1.1/maven-shared-incremental-1.1.jar 2024-06-04T16:07:00.355 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-incremental/1.1/maven-shared-incremental-1.1.jar (14 kB at 542 kB/s) 2024-06-04T16:07:00.356 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/1.5.5/plexus-component-annotations-1.5.5.jar 2024-06-04T16:07:00.356 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.1.2/plexus-java-1.1.2.jar 2024-06-04T16:07:00.356 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.4/asm-9.4.jar 2024-06-04T16:07:00.356 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/com/thoughtworks/qdox/qdox/2.0.3/qdox-2.0.3.jar 2024-06-04T16:07:00.356 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-api/2.13.0/plexus-compiler-api-2.13.0.jar 2024-06-04T16:07:00.374 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (1): 4.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/1.5.5/plexus-component-annotations-1.5.5.jar (4.2 kB at 222 kB/s) 2024-06-04T16:07:00.374 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.0/plexus-utils-3.5.0.jar 2024-06-04T16:07:00.378 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (1): 16/122 kB Progress (1): 33/122 kB Progress (1): 49/122 kB Progress (1): 63/122 kB Progress (1): 79/122 kB Progress (1): 96/122 kB Progress (1): 112/122 kB Progress (1): 122 kB Progress (2): 122 kB | 16/27 kB Progress (3): 122 kB | 16/27 kB | 15/334 kB Progress (3): 122 kB | 27 kB | 15/334 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.4/asm-9.4.jar (122 kB at 5.6 MB/s) 2024-06-04T16:07:00.378 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-manager/2.13.0/plexus-compiler-manager-2.13.0.jar 2024-06-04T16:07:00.378 INFO:tasks.workunit.client.0.smithi144.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-api/2.13.0/plexus-compiler-api-2.13.0.jar (27 kB at 1.2 MB/s) 2024-06-04T16:07:00.378 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-javac/2.13.0/plexus-compiler-javac-2.13.0.jar 2024-06-04T16:07:00.380 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (1): 31/334 kB Progress (1): 48/334 kB Progress (1): 64/334 kB Progress (2): 64/334 kB | 16/55 kB Progress (2): 64/334 kB | 33/55 kB Progress (2): 80/334 kB | 33/55 kB Progress (2): 80/334 kB | 49/55 kB Progress (2): 80/334 kB | 55 kB Progress (2): 96/334 kB | 55 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.1.2/plexus-java-1.1.2.jar (55 kB at 2.3 MB/s) 2024-06-04T16:07:00.384 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (1): 113/334 kB Progress (1): 129/334 kB Progress (1): 146/334 kB Progress (1): 162/334 kB Progress (1): 178/334 kB Progress (1): 195/334 kB Progress (1): 211/334 kB Progress (1): 227/334 kB Progress (1): 244/334 kB Progress (1): 260/334 kB Progress (1): 277/334 kB Progress (1): 293/334 kB Progress (1): 309/334 kB Progress (1): 326/334 kB Progress (1): 334 kB Downloaded from central: https://repo.maven.apache.org/maven2/com/thoughtworks/qdox/qdox/2.0.3/qdox-2.0.3.jar (334 kB at 12 MB/s) 2024-06-04T16:07:00.395 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (1): 16/267 kB Progress (1): 32/267 kB Progress (1): 49/267 kB Progress (1): 65/267 kB Progress (1): 65/267 kB Progress (1): 81/267 kB Progress (1): 98/267 kB Progress (1): 114/267 kB Progress (1): 130/267 kB Progress (1): 147/267 kB Progress (1): 163/267 kB Progress (1): 180/267 kB Progress (1): 196/267 kB Progress (1): 212/267 kB Progress (1): 229/267 kB Progress (1): 245/267 kB Progress (1): 262/267 kB Progress (2): 262/267 kB | 4.7 kB Progress (2): 267 kB | 4.7 kB Progress (3): 267 kB | 4.7 kB | 16/23 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-manager/2.13.0/plexus-compiler-manager-2.13.0.jar (4.7 kB at 119 kB/s) 2024-06-04T16:07:00.395 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (2): 267 kB | 23 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.0/plexus-utils-3.5.0.jar (267 kB at 6.9 MB/s) 2024-06-04T16:07:00.395 INFO:tasks.workunit.client.0.smithi144.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-javac/2.13.0/plexus-compiler-javac-2.13.0.jar (23 kB at 584 kB/s) 2024-06-04T16:07:00.442 INFO:tasks.workunit.client.0.smithi144.stdout:[INFO] Changes detected - recompiling the module! :source 2024-06-04T16:07:00.443 INFO:tasks.workunit.client.0.smithi144.stdout:[INFO] Compiling 1 source file with javac [debug target 1.9] to target/classes 2024-06-04T16:07:01.012 INFO:tasks.workunit.client.0.smithi144.stdout:[WARNING] bootstrap class path not set in conjunction with -source 9 2024-06-04T16:07:01.012 INFO:tasks.workunit.client.0.smithi144.stdout:[INFO] 2024-06-04T16:07:01.012 INFO:tasks.workunit.client.0.smithi144.stdout:[INFO] --- resources:3.3.1:testResources (default-testResources) @ jcksum --- 2024-06-04T16:07:01.015 INFO:tasks.workunit.client.0.smithi144.stdout:[INFO] skip non existing resourceDirectory /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/src/test/resources 2024-06-04T16:07:01.015 INFO:tasks.workunit.client.0.smithi144.stdout:[INFO] 2024-06-04T16:07:01.015 INFO:tasks.workunit.client.0.smithi144.stdout:[INFO] --- compiler:3.11.0:testCompile (default-testCompile) @ jcksum --- 2024-06-04T16:07:01.019 INFO:tasks.workunit.client.0.smithi144.stdout:[INFO] Changes detected - recompiling the module! :dependency 2024-06-04T16:07:01.019 INFO:tasks.workunit.client.0.smithi144.stdout:[INFO] Compiling 1 source file with javac [debug target 1.9] to target/test-classes 2024-06-04T16:07:01.192 INFO:tasks.workunit.client.0.smithi144.stdout:[WARNING] bootstrap class path not set in conjunction with -source 9 2024-06-04T16:07:01.192 INFO:tasks.workunit.client.0.smithi144.stdout:[INFO] 2024-06-04T16:07:01.192 INFO:tasks.workunit.client.0.smithi144.stdout:[INFO] --- surefire:3.2.3:test (default-test) @ jcksum --- 2024-06-04T16:07:01.196 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/maven-surefire-common/3.2.3/maven-surefire-common-3.2.3.pom 2024-06-04T16:07:01.214 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (1): 6.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/maven-surefire-common/3.2.3/maven-surefire-common-3.2.3.pom (6.2 kB at 347 kB/s) 2024-06-04T16:07:01.217 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-api/3.2.3/surefire-api-3.2.3.pom 2024-06-04T16:07:01.238 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (1): 3.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-api/3.2.3/surefire-api-3.2.3.pom (3.5 kB at 176 kB/s) 2024-06-04T16:07:01.241 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-logger-api/3.2.3/surefire-logger-api-3.2.3.pom 2024-06-04T16:07:01.259 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (1): 3.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-logger-api/3.2.3/surefire-logger-api-3.2.3.pom (3.3 kB at 192 kB/s) 2024-06-04T16:07:01.262 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-shared-utils/3.2.3/surefire-shared-utils-3.2.3.pom 2024-06-04T16:07:01.281 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (1): 4.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-shared-utils/3.2.3/surefire-shared-utils-3.2.3.pom (4.1 kB at 214 kB/s) 2024-06-04T16:07:01.284 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-api/3.2.3/surefire-extensions-api-3.2.3.pom 2024-06-04T16:07:01.301 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (1): 3.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-api/3.2.3/surefire-extensions-api-3.2.3.pom (3.3 kB at 184 kB/s) 2024-06-04T16:07:01.304 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-booter/3.2.3/surefire-booter-3.2.3.pom 2024-06-04T16:07:01.322 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (1): 4.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-booter/3.2.3/surefire-booter-3.2.3.pom (4.5 kB at 262 kB/s) 2024-06-04T16:07:01.325 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-spi/3.2.3/surefire-extensions-spi-3.2.3.pom 2024-06-04T16:07:01.342 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (1): 1.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-spi/3.2.3/surefire-extensions-spi-3.2.3.pom (1.8 kB at 104 kB/s) 2024-06-04T16:07:01.345 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-util/1.0.0.v20140518/aether-util-1.0.0.v20140518.pom 2024-06-04T16:07:01.362 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (1): 2.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-util/1.0.0.v20140518/aether-util-1.0.0.v20140518.pom (2.2 kB at 129 kB/s) 2024-06-04T16:07:01.363 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether/1.0.0.v20140518/aether-1.0.0.v20140518.pom 2024-06-04T16:07:01.380 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (1): 16/30 kB Progress (1): 30 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether/1.0.0.v20140518/aether-1.0.0.v20140518.pom (30 kB at 1.9 MB/s) 2024-06-04T16:07:01.382 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-api/1.0.0.v20140518/aether-api-1.0.0.v20140518.pom 2024-06-04T16:07:01.399 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (1): 1.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-api/1.0.0.v20140518/aether-api-1.0.0.v20140518.pom (1.9 kB at 118 kB/s) 2024-06-04T16:07:01.401 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-common-artifact-filters/3.1.1/maven-common-artifact-filters-3.1.1.pom 2024-06-04T16:07:01.419 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (1): 5.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-common-artifact-filters/3.1.1/maven-common-artifact-filters-3.1.1.pom (5.8 kB at 341 kB/s) 2024-06-04T16:07:01.422 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-artifact/3.2.5/maven-artifact-3.2.5.pom 2024-06-04T16:07:01.439 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (1): 2.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-artifact/3.2.5/maven-artifact-3.2.5.pom (2.3 kB at 138 kB/s) 2024-06-04T16:07:01.441 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven/3.2.5/maven-3.2.5.pom 2024-06-04T16:07:01.458 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (1): 16/22 kB Progress (1): 22 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven/3.2.5/maven-3.2.5.pom (22 kB at 1.2 MB/s) 2024-06-04T16:07:01.460 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/25/maven-parent-25.pom 2024-06-04T16:07:01.478 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (1): 16/37 kB Progress (1): 33/37 kB Progress (1): 37 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/25/maven-parent-25.pom (37 kB at 2.2 MB/s) 2024-06-04T16:07:01.480 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/15/apache-15.pom 2024-06-04T16:07:01.497 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/15/apache-15.pom (15 kB at 896 kB/s) 2024-06-04T16:07:01.500 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/4.0.0/plexus-utils-4.0.0.pom 2024-06-04T16:07:01.519 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (1): 8.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/4.0.0/plexus-utils-4.0.0.pom (8.7 kB at 433 kB/s) 2024-06-04T16:07:01.521 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/13/plexus-13.pom 2024-06-04T16:07:01.538 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (1): 16/27 kB Progress (1): 27 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/13/plexus-13.pom (27 kB at 1.6 MB/s) 2024-06-04T16:07:01.541 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-core/3.2.5/maven-core-3.2.5.pom 2024-06-04T16:07:01.558 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (1): 8.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-core/3.2.5/maven-core-3.2.5.pom (8.1 kB at 474 kB/s) 2024-06-04T16:07:01.561 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-settings/3.2.5/maven-settings-3.2.5.pom 2024-06-04T16:07:01.578 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (1): 2.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-settings/3.2.5/maven-settings-3.2.5.pom (2.2 kB at 128 kB/s) 2024-06-04T16:07:01.581 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-settings-builder/3.2.5/maven-settings-builder-3.2.5.pom 2024-06-04T16:07:01.598 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (1): 2.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-settings-builder/3.2.5/maven-settings-builder-3.2.5.pom (2.6 kB at 153 kB/s) 2024-06-04T16:07:01.601 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.21/plexus-interpolation-1.21.pom 2024-06-04T16:07:01.617 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (1): 1.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.21/plexus-interpolation-1.21.pom (1.5 kB at 91 kB/s) 2024-06-04T16:07:01.619 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-components/1.3.1/plexus-components-1.3.1.pom 2024-06-04T16:07:01.636 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (1): 3.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-components/1.3.1/plexus-components-1.3.1.pom (3.1 kB at 180 kB/s) 2024-06-04T16:07:01.637 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/3.3.1/plexus-3.3.1.pom 2024-06-04T16:07:01.653 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/3.3.1/plexus-3.3.1.pom (20 kB at 1.2 MB/s) 2024-06-04T16:07:01.655 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/17/spice-parent-17.pom 2024-06-04T16:07:01.672 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (1): 6.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/17/spice-parent-17.pom (6.8 kB at 398 kB/s) 2024-06-04T16:07:01.673 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/10/forge-parent-10.pom 2024-06-04T16:07:01.690 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/10/forge-parent-10.pom (14 kB at 798 kB/s) 2024-06-04T16:07:01.693 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-sec-dispatcher/1.3/plexus-sec-dispatcher-1.3.pom 2024-06-04T16:07:01.710 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-sec-dispatcher/1.3/plexus-sec-dispatcher-1.3.pom (3.0 kB at 185 kB/s) 2024-06-04T16:07:01.711 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/12/spice-parent-12.pom 2024-06-04T16:07:01.727 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (1): 6.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/12/spice-parent-12.pom (6.8 kB at 425 kB/s) 2024-06-04T16:07:01.728 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/4/forge-parent-4.pom 2024-06-04T16:07:01.745 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (1): 8.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/4/forge-parent-4.pom (8.4 kB at 494 kB/s) 2024-06-04T16:07:01.748 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-cipher/1.4/plexus-cipher-1.4.pom 2024-06-04T16:07:01.764 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (1): 2.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-cipher/1.4/plexus-cipher-1.4.pom (2.1 kB at 129 kB/s) 2024-06-04T16:07:01.766 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-repository-metadata/3.2.5/maven-repository-metadata-3.2.5.pom 2024-06-04T16:07:01.783 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (1): 2.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-repository-metadata/3.2.5/maven-repository-metadata-3.2.5.pom (2.2 kB at 131 kB/s) 2024-06-04T16:07:01.787 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-plugin-api/3.2.5/maven-plugin-api-3.2.5.pom 2024-06-04T16:07:01.805 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-plugin-api/3.2.5/maven-plugin-api-3.2.5.pom (3.0 kB at 168 kB/s) 2024-06-04T16:07:01.809 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/org.eclipse.sisu.plexus/0.9.0.M2/org.eclipse.sisu.plexus-0.9.0.M2.pom 2024-06-04T16:07:01.826 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/org.eclipse.sisu.plexus/0.9.0.M2/org.eclipse.sisu.plexus-0.9.0.M2.pom (15 kB at 880 kB/s) 2024-06-04T16:07:01.828 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/sisu-plexus/0.9.0.M2/sisu-plexus-0.9.0.M2.pom 2024-06-04T16:07:01.845 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/sisu-plexus/0.9.0.M2/sisu-plexus-0.9.0.M2.pom (15 kB at 853 kB/s) 2024-06-04T16:07:01.848 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/javax/annotation/javax.annotation-api/1.2/javax.annotation-api-1.2.pom 2024-06-04T16:07:01.865 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (1): 13 kB Downloaded from central: https://repo.maven.apache.org/maven2/javax/annotation/javax.annotation-api/1.2/javax.annotation-api-1.2.pom (13 kB at 746 kB/s) 2024-06-04T16:07:01.867 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/net/java/jvnet-parent/3/jvnet-parent-3.pom 2024-06-04T16:07:01.883 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (1): 4.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/net/java/jvnet-parent/3/jvnet-parent-3.pom (4.8 kB at 282 kB/s) 2024-06-04T16:07:01.885 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/javax/enterprise/cdi-api/1.2/cdi-api-1.2.pom 2024-06-04T16:07:01.903 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (1): 6.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/javax/enterprise/cdi-api/1.2/cdi-api-1.2.pom (6.3 kB at 369 kB/s) 2024-06-04T16:07:01.904 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/jboss/weld/weld-parent/26/weld-parent-26.pom 2024-06-04T16:07:01.922 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (1): 16/32 kB Progress (1): 32 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/jboss/weld/weld-parent/26/weld-parent-26.pom (32 kB at 1.9 MB/s) 2024-06-04T16:07:01.926 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/org.eclipse.sisu.inject/0.9.0.M2/org.eclipse.sisu.inject-0.9.0.M2.pom 2024-06-04T16:07:01.943 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (1): 16/17 kB Progress (1): 17 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/org.eclipse.sisu.inject/0.9.0.M2/org.eclipse.sisu.inject-0.9.0.M2.pom (17 kB at 963 kB/s) 2024-06-04T16:07:01.946 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/sisu-inject/0.9.0.M2/sisu-inject-0.9.0.M2.pom 2024-06-04T16:07:01.964 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/sisu-inject/0.9.0.M2/sisu-inject-0.9.0.M2.pom (15 kB at 822 kB/s) 2024-06-04T16:07:01.968 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/2.1.0/plexus-component-annotations-2.1.0.pom 2024-06-04T16:07:01.985 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (1): 750 B Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/2.1.0/plexus-component-annotations-2.1.0.pom (750 B at 44 kB/s) 2024-06-04T16:07:01.986 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/2.1.0/plexus-containers-2.1.0.pom 2024-06-04T16:07:02.004 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (1): 4.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/2.1.0/plexus-containers-2.1.0.pom (4.8 kB at 283 kB/s) 2024-06-04T16:07:02.007 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-classworlds/2.6.0/plexus-classworlds-2.6.0.pom 2024-06-04T16:07:02.024 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (1): 7.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-classworlds/2.6.0/plexus-classworlds-2.6.0.pom (7.9 kB at 465 kB/s) 2024-06-04T16:07:02.026 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-model-builder/3.2.5/maven-model-builder-3.2.5.pom 2024-06-04T16:07:02.043 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-model-builder/3.2.5/maven-model-builder-3.2.5.pom (3.0 kB at 176 kB/s) 2024-06-04T16:07:02.046 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-aether-provider/3.2.5/maven-aether-provider-3.2.5.pom 2024-06-04T16:07:02.064 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (1): 4.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-aether-provider/3.2.5/maven-aether-provider-3.2.5.pom (4.2 kB at 236 kB/s) 2024-06-04T16:07:02.066 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-spi/1.0.0.v20140518/aether-spi-1.0.0.v20140518.pom 2024-06-04T16:07:02.082 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (1): 2.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-spi/1.0.0.v20140518/aether-spi-1.0.0.v20140518.pom (2.1 kB at 128 kB/s) 2024-06-04T16:07:02.084 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-impl/1.0.0.v20140518/aether-impl-1.0.0.v20140518.pom 2024-06-04T16:07:02.106 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (1): 3.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-impl/1.0.0.v20140518/aether-impl-1.0.0.v20140518.pom (3.5 kB at 158 kB/s) 2024-06-04T16:07:02.109 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/sisu/sisu-guice/3.2.3/sisu-guice-3.2.3.pom 2024-06-04T16:07:02.127 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (1): 11 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/sisu/sisu-guice/3.2.3/sisu-guice-3.2.3.pom (11 kB at 643 kB/s) 2024-06-04T16:07:02.128 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/sisu/inject/guice-parent/3.2.3/guice-parent-3.2.3.pom 2024-06-04T16:07:02.147 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (1): 13 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/sisu/inject/guice-parent/3.2.3/guice-parent-3.2.3.pom (13 kB at 842 kB/s) 2024-06-04T16:07:02.147 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/38/forge-parent-38.pom 2024-06-04T16:07:02.163 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (1): 16/19 kB Progress (1): 19 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/38/forge-parent-38.pom (19 kB at 1.1 MB/s) 2024-06-04T16:07:02.166 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/aopalliance/aopalliance/1.0/aopalliance-1.0.pom 2024-06-04T16:07:02.182 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (1): 363 B Downloaded from central: https://repo.maven.apache.org/maven2/aopalliance/aopalliance/1.0/aopalliance-1.0.pom (363 B at 23 kB/s) 2024-06-04T16:07:02.183 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/com/google/guava/guava/16.0.1/guava-16.0.1.pom 2024-06-04T16:07:02.200 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (1): 6.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/com/google/guava/guava/16.0.1/guava-16.0.1.pom (6.1 kB at 359 kB/s) 2024-06-04T16:07:02.201 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/com/google/guava/guava-parent/16.0.1/guava-parent-16.0.1.pom 2024-06-04T16:07:02.218 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (1): 7.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/com/google/guava/guava-parent/16.0.1/guava-parent-16.0.1.pom (7.3 kB at 432 kB/s) 2024-06-04T16:07:02.219 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/oss/oss-parent/7/oss-parent-7.pom 2024-06-04T16:07:02.235 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (1): 4.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/oss/oss-parent/7/oss-parent-7.pom (4.8 kB at 302 kB/s) 2024-06-04T16:07:02.237 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-classworlds/2.5.2/plexus-classworlds-2.5.2.pom 2024-06-04T16:07:02.254 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (1): 7.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-classworlds/2.5.2/plexus-classworlds-2.5.2.pom (7.3 kB at 430 kB/s) 2024-06-04T16:07:02.257 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.0/commons-io-2.15.0.pom 2024-06-04T16:07:02.274 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (1): 16/22 kB Progress (1): 22 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.0/commons-io-2.15.0.pom (22 kB at 1.3 MB/s) 2024-06-04T16:07:02.276 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/64/commons-parent-64.pom 2024-06-04T16:07:02.293 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (1): 16/78 kB Progress (1): 33/78 kB Progress (1): 49/78 kB Progress (1): 64/78 kB Progress (1): 78 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/64/commons-parent-64.pom (78 kB at 4.6 MB/s) 2024-06-04T16:07:02.298 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/30/apache-30.pom 2024-06-04T16:07:02.314 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (1): 16/23 kB Progress (1): 23 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/30/apache-30.pom (23 kB at 1.4 MB/s) 2024-06-04T16:07:02.317 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.10.0/junit-bom-5.10.0.pom 2024-06-04T16:07:02.334 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (1): 5.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.10.0/junit-bom-5.10.0.pom (5.6 kB at 353 kB/s) 2024-06-04T16:07:02.336 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.2.0/plexus-java-1.2.0.pom 2024-06-04T16:07:02.352 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (1): 4.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.2.0/plexus-java-1.2.0.pom (4.3 kB at 251 kB/s) 2024-06-04T16:07:02.354 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-languages/1.2.0/plexus-languages-1.2.0.pom 2024-06-04T16:07:02.370 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-languages/1.2.0/plexus-languages-1.2.0.pom (3.2 kB at 188 kB/s) 2024-06-04T16:07:02.372 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/15/plexus-15.pom 2024-06-04T16:07:02.390 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (1): 16/28 kB Progress (1): 28 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/15/plexus-15.pom (28 kB at 1.5 MB/s) 2024-06-04T16:07:02.392 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.6/asm-9.6.pom 2024-06-04T16:07:02.410 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (1): 2.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.6/asm-9.6.pom (2.4 kB at 139 kB/s) 2024-06-04T16:07:02.416 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/maven-surefire-common/3.2.3/maven-surefire-common-3.2.3.jar 2024-06-04T16:07:02.437 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (1): 16/308 kB Progress (1): 33/308 kB Progress (1): 49/308 kB Progress (1): 62/308 kB Progress (1): 78/308 kB Progress (1): 95/308 kB Progress (1): 111/308 kB Progress (1): 128/308 kB Progress (1): 144/308 kB Progress (1): 160/308 kB Progress (1): 177/308 kB Progress (1): 193/308 kB Progress (1): 209/308 kB Progress (1): 226/308 kB Progress (1): 242/308 kB Progress (1): 259/308 kB Progress (1): 275/308 kB Progress (1): 291/308 kB Progress (1): 308/308 kB Progress (1): 308 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/maven-surefire-common/3.2.3/maven-surefire-common-3.2.3.jar (308 kB at 14 MB/s) 2024-06-04T16:07:02.438 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-api/3.2.3/surefire-api-3.2.3.jar 2024-06-04T16:07:02.438 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-logger-api/3.2.3/surefire-logger-api-3.2.3.jar 2024-06-04T16:07:02.438 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-api/3.2.3/surefire-extensions-api-3.2.3.jar 2024-06-04T16:07:02.438 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-booter/3.2.3/surefire-booter-3.2.3.jar 2024-06-04T16:07:02.439 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-spi/3.2.3/surefire-extensions-spi-3.2.3.jar 2024-06-04T16:07:02.460 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (1): 16/171 kB Progress (1): 33/171 kB Progress (1): 49/171 kB Progress (1): 65/171 kB Progress (2): 65/171 kB | 14 kB Progress (2): 81/171 kB | 14 kB Progress (3): 81/171 kB | 14 kB | 16/26 kB Progress (3): 98/171 kB | 14 kB | 16/26 kB Progress (3): 98/171 kB | 14 kB | 26 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-logger-api/3.2.3/surefire-logger-api-3.2.3.jar (14 kB at 715 kB/s) 2024-06-04T16:07:02.460 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-util/1.0.0.v20140518/aether-util-1.0.0.v20140518.jar 2024-06-04T16:07:02.460 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (3): 98/171 kB | 26 kB | 16/118 kB Progress (3): 114/171 kB | 26 kB | 16/118 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-api/3.2.3/surefire-extensions-api-3.2.3.jar (26 kB at 1.3 MB/s) 2024-06-04T16:07:02.460 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-api/1.0.0.v20140518/aether-api-1.0.0.v20140518.jar 2024-06-04T16:07:02.460 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (3): 114/171 kB | 16/118 kB | 8.2 kB Progress (3): 114/171 kB | 33/118 kB | 8.2 kB Progress (3): 130/171 kB | 33/118 kB | 8.2 kB Progress (3): 130/171 kB | 49/118 kB | 8.2 kB Progress (3): 147/171 kB | 49/118 kB | 8.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-spi/3.2.3/surefire-extensions-spi-3.2.3.jar (8.2 kB at 389 kB/s) 2024-06-04T16:07:02.460 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (2): 147/171 kB | 64/118 kB Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-common-artifact-filters/3.1.1/maven-common-artifact-filters-3.1.1.jar 2024-06-04T16:07:02.460 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (2): 163/171 kB | 64/118 kB Progress (2): 171 kB | 64/118 kB Progress (2): 171 kB | 81/118 kB Progress (2): 171 kB | 97/118 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-api/3.2.3/surefire-api-3.2.3.jar (171 kB at 8.1 MB/s) 2024-06-04T16:07:02.461 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.0/commons-io-2.15.0.jar 2024-06-04T16:07:02.461 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (1): 113/118 kB Progress (1): 118 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-booter/3.2.3/surefire-booter-3.2.3.jar (118 kB at 5.3 MB/s) 2024-06-04T16:07:02.461 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.2.0/plexus-java-1.2.0.jar 2024-06-04T16:07:02.476 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (1): 16/136 kB Progress (2): 16/136 kB | 16/146 kB Progress (2): 33/136 kB | 16/146 kB Progress (2): 33/136 kB | 33/146 kB Progress (3): 33/136 kB | 33/146 kB | 16/61 kB Progress (3): 33/136 kB | 33/146 kB | 33/61 kB Progress (3): 33/136 kB | 33/146 kB | 49/61 kB Progress (3): 49/136 kB | 33/146 kB | 49/61 kB Progress (3): 49/136 kB | 33/146 kB | 61 kB Progress (3): 63/136 kB | 33/146 kB | 61 kB Progress (3): 63/136 kB | 49/146 kB | 61 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-common-artifact-filters/3.1.1/maven-common-artifact-filters-3.1.1.jar (61 kB at 1.6 MB/s) 2024-06-04T16:07:02.476 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.6/asm-9.6.jar 2024-06-04T16:07:02.480 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (2): 79/136 kB | 49/146 kB Progress (2): 79/136 kB | 66/146 kB Progress (2): 96/136 kB | 66/146 kB Progress (2): 112/136 kB | 66/146 kB Progress (3): 112/136 kB | 66/146 kB | 16/58 kB Progress (3): 129/136 kB | 66/146 kB | 16/58 kB Progress (3): 129/136 kB | 66/146 kB | 33/58 kB Progress (3): 129/136 kB | 82/146 kB | 33/58 kB Progress (4): 129/136 kB | 82/146 kB | 33/58 kB | 16/501 kB Progress (4): 129/136 kB | 82/146 kB | 49/58 kB | 16/501 kB Progress (4): 129/136 kB | 82/146 kB | 58 kB | 16/501 kB Progress (4): 129/136 kB | 98/146 kB | 58 kB | 16/501 kB Progress (4): 129/136 kB | 98/146 kB | 58 kB | 32/501 kB Progress (4): 136 kB | 98/146 kB | 58 kB | 32/501 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.2.0/plexus-java-1.2.0.jar (58 kB at 1.5 MB/s) 2024-06-04T16:07:02.480 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (3): 136 kB | 98/146 kB | 49/501 kB Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-shared-utils/3.2.3/surefire-shared-utils-3.2.3.jar 2024-06-04T16:07:02.480 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (3): 136 kB | 115/146 kB | 49/501 kB Progress (3): 136 kB | 115/146 kB | 65/501 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-api/1.0.0.v20140518/aether-api-1.0.0.v20140518.jar (136 kB at 3.4 MB/s) 2024-06-04T16:07:02.480 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (2): 115/146 kB | 81/501 kB Progress (2): 131/146 kB | 81/501 kB Progress (2): 131/146 kB | 98/501 kB Progress (2): 146 kB | 98/501 kB Progress (2): 146 kB | 114/501 kB Progress (2): 146 kB | 130/501 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-util/1.0.0.v20140518/aether-util-1.0.0.v20140518.jar (146 kB at 3.6 MB/s) 2024-06-04T16:07:02.486 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (1): 147/501 kB Progress (1): 163/501 kB Progress (1): 180/501 kB Progress (1): 196/501 kB Progress (1): 212/501 kB Progress (1): 229/501 kB Progress (1): 245/501 kB Progress (1): 262/501 kB Progress (1): 278/501 kB Progress (1): 294/501 kB Progress (1): 311/501 kB Progress (1): 327/501 kB Progress (1): 343/501 kB Progress (1): 360/501 kB Progress (1): 376/501 kB Progress (1): 393/501 kB Progress (1): 409/501 kB Progress (1): 425/501 kB Progress (1): 442/501 kB Progress (1): 458/501 kB Progress (1): 475/501 kB Progress (1): 491/501 kB Progress (1): 501 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.0/commons-io-2.15.0.jar (501 kB at 11 MB/s) 2024-06-04T16:07:02.494 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (1): 16/124 kB Progress (1): 33/124 kB Progress (1): 49/124 kB Progress (1): 66/124 kB Progress (1): 82/124 kB Progress (1): 98/124 kB Progress (1): 115/124 kB Progress (1): 124 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.6/asm-9.6.jar (124 kB at 2.2 MB/s) 2024-06-04T16:07:02.534 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (1): 0/2.4 MB Progress (1): 0/2.4 MB Progress (1): 0/2.4 MB Progress (1): 0.1/2.4 MB Progress (1): 0.1/2.4 MB Progress (1): 0.1/2.4 MB Progress (1): 0.1/2.4 MB Progress (1): 0.1/2.4 MB Progress (1): 0.1/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4 MB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-shared-utils/3.2.3/surefire-shared-utils-3.2.3.jar (2.4 MB at 25 MB/s) 2024-06-04T16:07:02.625 INFO:tasks.workunit.client.0.smithi144.stdout:[INFO] 2024-06-04T16:07:02.626 INFO:tasks.workunit.client.0.smithi144.stdout:[INFO] --- jar:3.3.0:jar (default-jar) @ jcksum --- 2024-06-04T16:07:02.629 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/file-management/3.1.0/file-management-3.1.0.pom 2024-06-04T16:07:02.647 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (1): 4.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/file-management/3.1.0/file-management-3.1.0.pom (4.5 kB at 249 kB/s) 2024-06-04T16:07:02.649 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/36/maven-shared-components-36.pom 2024-06-04T16:07:02.667 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (1): 4.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/36/maven-shared-components-36.pom (4.9 kB at 288 kB/s) 2024-06-04T16:07:02.669 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/36/maven-parent-36.pom 2024-06-04T16:07:02.687 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (1): 16/45 kB Progress (1): 33/45 kB Progress (1): 45 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/36/maven-parent-36.pom (45 kB at 2.5 MB/s) 2024-06-04T16:07:02.690 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/26/apache-26.pom 2024-06-04T16:07:02.707 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (1): 16/21 kB Progress (1): 21 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/26/apache-26.pom (21 kB at 1.2 MB/s) 2024-06-04T16:07:02.710 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.3.0/plexus-utils-3.3.0.pom 2024-06-04T16:07:02.726 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (1): 5.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.3.0/plexus-utils-3.3.0.pom (5.2 kB at 305 kB/s) 2024-06-04T16:07:02.730 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-archiver/3.6.0/maven-archiver-3.6.0.pom 2024-06-04T16:07:02.747 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (1): 3.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-archiver/3.6.0/maven-archiver-3.6.0.pom (3.9 kB at 231 kB/s) 2024-06-04T16:07:02.750 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-io/3.4.0/plexus-io-3.4.0.pom 2024-06-04T16:07:02.767 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (1): 6.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-io/3.4.0/plexus-io-3.4.0.pom (6.0 kB at 354 kB/s) 2024-06-04T16:07:02.769 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-archiver/4.4.0/plexus-archiver-4.4.0.pom 2024-06-04T16:07:02.787 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (1): 6.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-archiver/4.4.0/plexus-archiver-4.4.0.pom (6.3 kB at 348 kB/s) 2024-06-04T16:07:02.789 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-compress/1.21/commons-compress-1.21.pom 2024-06-04T16:07:02.806 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-compress/1.21/commons-compress-1.21.pom (20 kB at 1.2 MB/s) 2024-06-04T16:07:02.810 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/iq80/snappy/snappy/0.4/snappy-0.4.pom 2024-06-04T16:07:02.828 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/iq80/snappy/snappy/0.4/snappy-0.4.pom (15 kB at 808 kB/s) 2024-06-04T16:07:02.831 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/tukaani/xz/1.9/xz-1.9.pom 2024-06-04T16:07:02.848 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (1): 2.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/tukaani/xz/1.9/xz-1.9.pom (2.0 kB at 120 kB/s) 2024-06-04T16:07:02.851 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.4.2/plexus-utils-3.4.2.pom 2024-06-04T16:07:02.868 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (1): 8.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.4.2/plexus-utils-3.4.2.pom (8.2 kB at 483 kB/s) 2024-06-04T16:07:02.871 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/8/plexus-8.pom 2024-06-04T16:07:02.888 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (1): 16/25 kB Progress (1): 25 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/8/plexus-8.pom (25 kB at 1.4 MB/s) 2024-06-04T16:07:02.895 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/file-management/3.1.0/file-management-3.1.0.jar 2024-06-04T16:07:02.915 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (1): 16/36 kB Progress (1): 33/36 kB Progress (1): 36 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/file-management/3.1.0/file-management-3.1.0.jar (36 kB at 1.8 MB/s) 2024-06-04T16:07:02.916 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-archiver/3.6.0/maven-archiver-3.6.0.jar 2024-06-04T16:07:02.916 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-io/3.4.0/plexus-io-3.4.0.jar 2024-06-04T16:07:02.916 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-archiver/4.4.0/plexus-archiver-4.4.0.jar 2024-06-04T16:07:02.916 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-compress/1.21/commons-compress-1.21.jar 2024-06-04T16:07:02.916 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/iq80/snappy/snappy/0.4/snappy-0.4.jar 2024-06-04T16:07:02.938 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (1): 16/26 kB Progress (2): 16/26 kB | 16/79 kB Progress (3): 16/26 kB | 16/79 kB | 16/58 kB Progress (3): 26 kB | 16/79 kB | 16/58 kB Progress (3): 26 kB | 16/79 kB | 32/58 kB Progress (3): 26 kB | 33/79 kB | 32/58 kB Progress (3): 26 kB | 33/79 kB | 49/58 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-archiver/3.6.0/maven-archiver-3.6.0.jar (26 kB at 1.4 MB/s) 2024-06-04T16:07:02.938 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (2): 33/79 kB | 58 kB Downloading from central: https://repo.maven.apache.org/maven2/org/tukaani/xz/1.9/xz-1.9.jar 2024-06-04T16:07:02.938 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (2): 49/79 kB | 58 kB Progress (3): 49/79 kB | 58 kB | 16/211 kB Progress (4): 49/79 kB | 58 kB | 16/211 kB | 0/1.0 MB Downloaded from central: https://repo.maven.apache.org/maven2/org/iq80/snappy/snappy/0.4/snappy-0.4.jar (58 kB at 3.2 MB/s) 2024-06-04T16:07:02.938 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.4.2/plexus-utils-3.4.2.jar 2024-06-04T16:07:02.938 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (3): 66/79 kB | 16/211 kB | 0/1.0 MB Progress (3): 66/79 kB | 33/211 kB | 0/1.0 MB Progress (3): 66/79 kB | 33/211 kB | 0/1.0 MB Progress (3): 79 kB | 33/211 kB | 0/1.0 MB Progress (3): 79 kB | 49/211 kB | 0/1.0 MB Progress (3): 79 kB | 49/211 kB | 0/1.0 MB Progress (3): 79 kB | 62/211 kB | 0/1.0 MB Progress (3): 79 kB | 78/211 kB | 0/1.0 MB Progress (3): 79 kB | 78/211 kB | 0.1/1.0 MB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-io/3.4.0/plexus-io-3.4.0.jar (79 kB at 4.2 MB/s) 2024-06-04T16:07:02.938 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (2): 95/211 kB | 0.1/1.0 MB Progress (2): 95/211 kB | 0.1/1.0 MB Progress (2): 111/211 kB | 0.1/1.0 MB Progress (2): 111/211 kB | 0.1/1.0 MB Progress (2): 111/211 kB | 0.1/1.0 MB Progress (2): 128/211 kB | 0.1/1.0 MB Progress (2): 144/211 kB | 0.1/1.0 MB Progress (2): 144/211 kB | 0.1/1.0 MB Progress (2): 160/211 kB | 0.1/1.0 MB Progress (2): 160/211 kB | 0.1/1.0 MB Progress (2): 177/211 kB | 0.1/1.0 MB Progress (2): 177/211 kB | 0.2/1.0 MB Progress (2): 193/211 kB | 0.2/1.0 MB Progress (2): 209/211 kB | 0.2/1.0 MB Progress (2): 211 kB | 0.2/1.0 MB Progress (2): 211 kB | 0.2/1.0 MB Progress (2): 211 kB | 0.2/1.0 MB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-archiver/4.4.0/plexus-archiver-4.4.0.jar (211 kB at 9.6 MB/s) 2024-06-04T16:07:02.952 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (1): 0.2/1.0 MB Progress (1): 0.2/1.0 MB Progress (1): 0.2/1.0 MB Progress (1): 0.3/1.0 MB Progress (1): 0.3/1.0 MB Progress (1): 0.3/1.0 MB Progress (1): 0.3/1.0 MB Progress (1): 0.3/1.0 MB Progress (1): 0.3/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.6/1.0 MB Progress (1): 0.6/1.0 MB Progress (1): 0.6/1.0 MB Progress (1): 0.6/1.0 MB Progress (1): 0.6/1.0 MB Progress (1): 0.6/1.0 MB Progress (2): 0.6/1.0 MB | 16/116 kB Progress (2): 0.7/1.0 MB | 16/116 kB Progress (2): 0.7/1.0 MB | 33/116 kB Progress (2): 0.7/1.0 MB | 33/116 kB Progress (2): 0.7/1.0 MB | 49/116 kB Progress (2): 0.7/1.0 MB | 65/116 kB Progress (2): 0.7/1.0 MB | 65/116 kB Progress (2): 0.7/1.0 MB | 81/116 kB Progress (2): 0.7/1.0 MB | 98/116 kB Progress (2): 0.7/1.0 MB | 98/116 kB Progress (2): 0.7/1.0 MB | 114/116 kB Progress (2): 0.7/1.0 MB | 116 kB Progress (3): 0.7/1.0 MB | 116 kB | 16/267 kB Progress (3): 0.7/1.0 MB | 116 kB | 16/267 kB Progress (3): 0.7/1.0 MB | 116 kB | 33/267 kB Progress (3): 0.7/1.0 MB | 116 kB | 33/267 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/tukaani/xz/1.9/xz-1.9.jar (116 kB at 3.2 MB/s) 2024-06-04T16:07:02.958 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (2): 0.7/1.0 MB | 49/267 kB Progress (2): 0.8/1.0 MB | 49/267 kB Progress (2): 0.8/1.0 MB | 63/267 kB Progress (2): 0.8/1.0 MB | 79/267 kB Progress (2): 0.8/1.0 MB | 79/267 kB Progress (2): 0.8/1.0 MB | 96/267 kB Progress (2): 0.8/1.0 MB | 96/267 kB Progress (2): 0.8/1.0 MB | 112/267 kB Progress (2): 0.8/1.0 MB | 112/267 kB Progress (2): 0.8/1.0 MB | 129/267 kB Progress (2): 0.8/1.0 MB | 129/267 kB Progress (2): 0.8/1.0 MB | 145/267 kB Progress (2): 0.8/1.0 MB | 145/267 kB Progress (2): 0.8/1.0 MB | 161/267 kB Progress (2): 0.9/1.0 MB | 161/267 kB Progress (2): 0.9/1.0 MB | 178/267 kB Progress (2): 0.9/1.0 MB | 178/267 kB Progress (2): 0.9/1.0 MB | 194/267 kB Progress (2): 0.9/1.0 MB | 194/267 kB Progress (2): 0.9/1.0 MB | 210/267 kB Progress (2): 0.9/1.0 MB | 210/267 kB Progress (2): 0.9/1.0 MB | 227/267 kB Progress (2): 0.9/1.0 MB | 227/267 kB Progress (2): 0.9/1.0 MB | 243/267 kB Progress (2): 0.9/1.0 MB | 243/267 kB Progress (2): 0.9/1.0 MB | 260/267 kB Progress (2): 0.9/1.0 MB | 260/267 kB Progress (2): 0.9/1.0 MB | 267 kB Progress (2): 1.0/1.0 MB | 267 kB Progress (2): 1.0/1.0 MB | 267 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.4.2/plexus-utils-3.4.2.jar (267 kB at 6.4 MB/s) 2024-06-04T16:07:02.959 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (1): 1.0/1.0 MB Progress (1): 1.0/1.0 MB Progress (1): 1.0 MB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-compress/1.21/commons-compress-1.21.jar (1.0 MB at 23 MB/s) 2024-06-04T16:07:03.145 INFO:tasks.workunit.client.0.smithi144.stdout:[INFO] Building jar: /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/target/jcksum-1.0.jar 2024-06-04T16:07:03.169 INFO:tasks.workunit.client.0.smithi144.stdout:[INFO] ------------------------------------------------------------------------ 2024-06-04T16:07:03.169 INFO:tasks.workunit.client.0.smithi144.stdout:[INFO] BUILD SUCCESS 2024-06-04T16:07:03.169 INFO:tasks.workunit.client.0.smithi144.stdout:[INFO] ------------------------------------------------------------------------ 2024-06-04T16:07:03.170 INFO:tasks.workunit.client.0.smithi144.stdout:[INFO] Total time: 6.598 s 2024-06-04T16:07:03.170 INFO:tasks.workunit.client.0.smithi144.stdout:[INFO] Finished at: 2024-06-04T16:07:03Z 2024-06-04T16:07:03.170 INFO:tasks.workunit.client.0.smithi144.stdout:[INFO] ------------------------------------------------------------------------ 2024-06-04T16:07:03.194 INFO:tasks.workunit.client.0.smithi144.stderr:+ ./mvnw test -Dtest=PutObjects 2024-06-04T16:07:03.203 INFO:tasks.workunit.client.0.smithi144.stdout:Warning: JAVA_HOME environment variable is not set. 2024-06-04T16:07:04.202 INFO:tasks.workunit.client.0.smithi144.stdout:[INFO] Scanning for projects... 2024-06-04T16:07:04.285 INFO:tasks.workunit.client.0.smithi144.stdout:[INFO] 2024-06-04T16:07:04.285 INFO:tasks.workunit.client.0.smithi144.stdout:[INFO] ---------------------------< io.ceph:jcksum >--------------------------- 2024-06-04T16:07:04.285 INFO:tasks.workunit.client.0.smithi144.stdout:[INFO] Building jcksum 1.0 2024-06-04T16:07:04.285 INFO:tasks.workunit.client.0.smithi144.stdout:[INFO] from pom.xml 2024-06-04T16:07:04.285 INFO:tasks.workunit.client.0.smithi144.stdout:[INFO] --------------------------------[ jar ]--------------------------------- 2024-06-04T16:07:04.526 INFO:tasks.workunit.client.0.smithi144.stdout:[INFO] 2024-06-04T16:07:04.526 INFO:tasks.workunit.client.0.smithi144.stdout:[INFO] --- resources:3.3.1:resources (default-resources) @ jcksum --- 2024-06-04T16:07:04.614 INFO:tasks.workunit.client.0.smithi144.stdout:[INFO] skip non existing resourceDirectory /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/src/main/resources 2024-06-04T16:07:04.615 INFO:tasks.workunit.client.0.smithi144.stdout:[INFO] 2024-06-04T16:07:04.615 INFO:tasks.workunit.client.0.smithi144.stdout:[INFO] --- compiler:3.11.0:compile (default-compile) @ jcksum --- 2024-06-04T16:07:04.706 INFO:tasks.workunit.client.0.smithi144.stdout:[INFO] Nothing to compile - all classes are up to date 2024-06-04T16:07:04.707 INFO:tasks.workunit.client.0.smithi144.stdout:[INFO] 2024-06-04T16:07:04.707 INFO:tasks.workunit.client.0.smithi144.stdout:[INFO] --- resources:3.3.1:testResources (default-testResources) @ jcksum --- 2024-06-04T16:07:04.708 INFO:tasks.workunit.client.0.smithi144.stdout:[INFO] skip non existing resourceDirectory /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/src/test/resources 2024-06-04T16:07:04.709 INFO:tasks.workunit.client.0.smithi144.stdout:[INFO] 2024-06-04T16:07:04.709 INFO:tasks.workunit.client.0.smithi144.stdout:[INFO] --- compiler:3.11.0:testCompile (default-testCompile) @ jcksum --- 2024-06-04T16:07:04.713 INFO:tasks.workunit.client.0.smithi144.stdout:[INFO] Nothing to compile - all classes are up to date 2024-06-04T16:07:04.713 INFO:tasks.workunit.client.0.smithi144.stdout:[INFO] 2024-06-04T16:07:04.713 INFO:tasks.workunit.client.0.smithi144.stdout:[INFO] --- surefire:3.2.3:test (default-test) @ jcksum --- 2024-06-04T16:07:04.900 INFO:tasks.workunit.client.0.smithi144.stdout:[INFO] Using auto detected provider org.apache.maven.surefire.junitplatform.JUnitPlatformProvider 2024-06-04T16:07:05.117 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-junit-platform/3.2.3/surefire-junit-platform-3.2.3.pom 2024-06-04T16:07:05.311 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (1): 1.4/4.7 kB Progress (1): 2.8/4.7 kB Progress (1): 4.1/4.7 kB Progress (1): 4.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-junit-platform/3.2.3/surefire-junit-platform-3.2.3.pom (4.7 kB at 24 kB/s) 2024-06-04T16:07:05.319 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-providers/3.2.3/surefire-providers-3.2.3.pom 2024-06-04T16:07:05.340 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (1): 1.4/2.6 kB Progress (1): 2.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-providers/3.2.3/surefire-providers-3.2.3.pom (2.6 kB at 124 kB/s) 2024-06-04T16:07:05.345 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/common-java5/3.2.3/common-java5-3.2.3.pom 2024-06-04T16:07:05.365 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (1): 1.4/2.8 kB Progress (1): 2.8/2.8 kB Progress (1): 2.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/common-java5/3.2.3/common-java5-3.2.3.pom (2.8 kB at 141 kB/s) 2024-06-04T16:07:05.369 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.9.3/junit-platform-launcher-1.9.3.pom 2024-06-04T16:07:05.388 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (1): 1.4/3.0 kB Progress (1): 2.8/3.0 kB Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.9.3/junit-platform-launcher-1.9.3.pom (3.0 kB at 151 kB/s) 2024-06-04T16:07:05.391 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.9.3/junit-platform-engine-1.9.3.pom 2024-06-04T16:07:05.411 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (1): 1.4/3.2 kB Progress (1): 2.8/3.2 kB Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.9.3/junit-platform-engine-1.9.3.pom (3.2 kB at 160 kB/s) 2024-06-04T16:07:05.413 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.2.0/opentest4j-1.2.0.pom 2024-06-04T16:07:05.431 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (1): 1.4/1.7 kB Progress (1): 1.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.2.0/opentest4j-1.2.0.pom (1.7 kB at 89 kB/s) 2024-06-04T16:07:05.434 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.9.3/junit-platform-commons-1.9.3.pom 2024-06-04T16:07:05.452 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (1): 1.4/2.8 kB Progress (1): 2.8/2.8 kB Progress (1): 2.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.9.3/junit-platform-commons-1.9.3.pom (2.8 kB at 157 kB/s) 2024-06-04T16:07:05.458 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-junit-platform/3.2.3/surefire-junit-platform-3.2.3.jar 2024-06-04T16:07:05.483 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (1): 1.4/27 kB Progress (1): 2.8/27 kB Progress (1): 4.1/27 kB Progress (1): 5.5/27 kB Progress (1): 6.9/27 kB Progress (1): 8.3/27 kB Progress (1): 9.7/27 kB Progress (1): 11/27 kB Progress (1): 12/27 kB Progress (1): 14/27 kB Progress (1): 15/27 kB Progress (1): 17/27 kB Progress (1): 18/27 kB Progress (1): 19/27 kB Progress (1): 21/27 kB Progress (1): 22/27 kB Progress (1): 23/27 kB Progress (1): 25/27 kB Progress (1): 26/27 kB Progress (1): 27 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-junit-platform/3.2.3/surefire-junit-platform-3.2.3.jar (27 kB at 1.1 MB/s) 2024-06-04T16:07:05.484 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/common-java5/3.2.3/common-java5-3.2.3.jar 2024-06-04T16:07:05.484 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.9.3/junit-platform-launcher-1.9.3.jar 2024-06-04T16:07:05.485 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.9.3/junit-platform-engine-1.9.3.jar 2024-06-04T16:07:05.485 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.2.0/opentest4j-1.2.0.jar 2024-06-04T16:07:05.487 INFO:tasks.workunit.client.0.smithi144.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.9.3/junit-platform-commons-1.9.3.jar 2024-06-04T16:07:05.534 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (1): 16/169 kB Progress (1): 33/169 kB Progress (1): 49/169 kB Progress (1): 65/169 kB Progress (1): 81/169 kB Progress (1): 97/169 kB Progress (1): 114/169 kB Progress (1): 130/169 kB Progress (1): 146/169 kB Progress (1): 163/169 kB Progress (1): 169 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.9.3/junit-platform-launcher-1.9.3.jar (169 kB at 3.3 MB/s) 2024-06-04T16:07:05.550 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (1): 1.4/18 kB Progress (2): 1.4/18 kB | 1.4/7.7 kB Progress (2): 2.8/18 kB | 1.4/7.7 kB Progress (2): 2.8/18 kB | 2.8/7.7 kB Progress (2): 4.1/18 kB | 2.8/7.7 kB Progress (2): 4.1/18 kB | 4.1/7.7 kB Progress (2): 5.5/18 kB | 4.1/7.7 kB Progress (2): 5.5/18 kB | 5.5/7.7 kB Progress (2): 6.9/18 kB | 5.5/7.7 kB Progress (3): 6.9/18 kB | 5.5/7.7 kB | 16/103 kB Progress (3): 8.3/18 kB | 5.5/7.7 kB | 16/103 kB Progress (4): 8.3/18 kB | 5.5/7.7 kB | 16/103 kB | 16/189 kB Progress (4): 8.3/18 kB | 6.9/7.7 kB | 16/103 kB | 16/189 kB Progress (4): 9.7/18 kB | 6.9/7.7 kB | 16/103 kB | 16/189 kB Progress (4): 9.7/18 kB | 7.7 kB | 16/103 kB | 16/189 kB Progress (4): 11/18 kB | 7.7 kB | 16/103 kB | 16/189 kB Progress (4): 12/18 kB | 7.7 kB | 16/103 kB | 16/189 kB Progress (4): 14/18 kB | 7.7 kB | 16/103 kB | 16/189 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.2.0/opentest4j-1.2.0.jar (7.7 kB at 118 kB/s) 2024-06-04T16:07:05.552 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (3): 15/18 kB | 16/103 kB | 16/189 kB Progress (3): 17/18 kB | 16/103 kB | 16/189 kB Progress (3): 18 kB | 16/103 kB | 16/189 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/common-java5/3.2.3/common-java5-3.2.3.jar (18 kB at 251 kB/s) 2024-06-04T16:07:05.578 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (2): 16/103 kB | 33/189 kB Progress (2): 33/103 kB | 33/189 kB Progress (2): 49/103 kB | 33/189 kB Progress (2): 49/103 kB | 49/189 kB Progress (2): 49/103 kB | 66/189 kB Progress (2): 66/103 kB | 66/189 kB Progress (2): 82/103 kB | 66/189 kB Progress (2): 82/103 kB | 82/189 kB Progress (2): 98/103 kB | 82/189 kB Progress (2): 98/103 kB | 98/189 kB Progress (2): 103 kB | 98/189 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.9.3/junit-platform-commons-1.9.3.jar (103 kB at 1.1 MB/s) 2024-06-04T16:07:05.592 INFO:tasks.workunit.client.0.smithi144.stdout:Progress (1): 115/189 kB Progress (1): 131/189 kB Progress (1): 147/189 kB Progress (1): 164/189 kB Progress (1): 180/189 kB Progress (1): 189 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.9.3/junit-platform-engine-1.9.3.jar (189 kB at 1.8 MB/s) 2024-06-04T16:07:05.606 INFO:tasks.workunit.client.0.smithi144.stdout:[INFO] 2024-06-04T16:07:05.606 INFO:tasks.workunit.client.0.smithi144.stdout:[INFO] ------------------------------------------------------- 2024-06-04T16:07:05.606 INFO:tasks.workunit.client.0.smithi144.stdout:[INFO] T E S T S 2024-06-04T16:07:05.606 INFO:tasks.workunit.client.0.smithi144.stdout:[INFO] ------------------------------------------------------- 2024-06-04T16:07:06.026 INFO:tasks.workunit.client.0.smithi144.stdout:[INFO] Running io.ceph.jcksum.PutObjects 2024-06-04T16:07:06.065 INFO:tasks.workunit.client.0.smithi144.stdout:PutObjects.java: starting test run: 2024-06-04T16:07:06.066 INFO:tasks.workunit.client.0.smithi144.stdout: AccessKey=lNCnR47C2g+ZidCWBAUuwfSAA7Q= 2024-06-04T16:07:06.066 INFO:tasks.workunit.client.0.smithi144.stdout: SecretKey=tYuA2Y+Uu1ow2l9Xe59tWKVml3gMuVfyhUjjJwfwEI0vFFONIcqf4g== 2024-06-04T16:07:06.066 INFO:tasks.workunit.client.0.smithi144.stdout: EndpointUrl=https://smithi144.front.sepia.ceph.com:443 2024-06-04T16:07:06.164 INFO:tasks.workunit.client.0.smithi144.stderr:[main] WARN software.amazon.awssdk.http.apache.ApacheHttpClient - SSL Certificate verification is disabled. This is not a safe setting and should only be used for testing. 2024-06-04T16:07:06.263 INFO:tasks.workunit.client.0.smithi144.stdout:DEBUG: Environment Variables Read 2024-06-04T16:07:06.565 INFO:tasks.workunit.client.0.smithi144.stdout:DEBUG: S3 Client Initialized 2024-06-04T16:07:06.565 INFO:tasks.workunit.client.0.smithi144.stdout:DEBUG: Generating File 2024-06-04T16:07:06.565 INFO:tasks.workunit.client.0.smithi144.stdout:DEBUG: File Generated 2024-06-04T16:07:06.565 INFO:tasks.workunit.client.0.smithi144.stdout:DEBUG: Generating File 2024-06-04T16:07:06.566 INFO:tasks.workunit.client.0.smithi144.stdout:DEBUG: File Generated 2024-06-04T16:07:06.566 INFO:tasks.workunit.client.0.smithi144.stdout:DEBUG: Generating File 2024-06-04T16:07:06.566 INFO:tasks.workunit.client.0.smithi144.stdout:DEBUG: File Generated 2024-06-04T16:07:06.566 INFO:tasks.workunit.client.0.smithi144.stdout:DEBUG: Generating File 2024-06-04T16:07:06.566 INFO:tasks.workunit.client.0.smithi144.stdout:DEBUG: File Generated 2024-06-04T16:07:06.566 INFO:tasks.workunit.client.0.smithi144.stdout:DEBUG: Generating File 2024-06-04T16:07:06.566 INFO:tasks.workunit.client.0.smithi144.stdout:DEBUG: File Generated 2024-06-04T16:07:06.566 INFO:tasks.workunit.client.0.smithi144.stdout:DEBUG: Generating File 2024-06-04T16:07:06.566 INFO:tasks.workunit.client.0.smithi144.stdout:DEBUG: File Generated 2024-06-04T16:07:06.566 INFO:tasks.workunit.client.0.smithi144.stdout:DEBUG: Generated Big Files 2024-06-04T16:07:06.815 INFO:tasks.workunit.client.0.smithi144.stdout:HeadBucketResponse() 2024-06-04T16:07:06.816 INFO:tasks.workunit.client.0.smithi144.stdout:sheik is ready 2024-06-04T16:07:06.816 INFO:tasks.workunit.client.0.smithi144.stdout:DEBUG: Test Bucket Created 2024-06-04T16:07:06.864 INFO:tasks.workunit.client.0.smithi144.stdout:putObjectFromFileNoCksum called with file-0b 2024-06-04T16:07:06.965 INFO:tasks.workunit.client.0.smithi144.stdout:putObjectFromFileNoCksum called with file-8b 2024-06-04T16:07:07.032 INFO:tasks.workunit.client.0.smithi144.stdout:putObjectFromFileNoCksum called with file-200b 2024-06-04T16:07:07.062 INFO:tasks.workunit.client.0.smithi144.stdout:putObjectFromFileNoCksum called with file-21983b 2024-06-04T16:07:07.066 INFO:tasks.workunit.client.0.smithi144.stdout:putObjectFromFileNoCksum called with file-5519b 2024-06-04T16:07:07.165 INFO:tasks.workunit.client.0.smithi144.stdout:putObjectFromFileNoCksum called with file-204329b 2024-06-04T16:07:07.232 INFO:tasks.workunit.client.0.smithi144.stdout:putObjectFromFileNoCksum called with file-256k 2024-06-04T16:07:07.265 INFO:tasks.workunit.client.0.smithi144.stdout:putObjectFromFileNoCksum called with file-1m 2024-06-04T16:07:07.365 INFO:tasks.workunit.client.0.smithi144.stdout:putObjectFromFileNoCksum called with file-1038757b 2024-06-04T16:07:07.466 INFO:tasks.workunit.client.0.smithi144.stdout:mpuObjectFromFileNoCksum called with file-5m 2024-06-04T16:07:09.869 INFO:tasks.workunit.client.0.smithi144.stdout:mpuObjectFromFileNoCksum called with file-10m 2024-06-04T16:07:10.470 INFO:tasks.workunit.client.0.smithi144.stdout:mpuObjectFromFileNoCksum called with file-100m 2024-06-04T16:07:12.209 INFO:tasks.workunit.client.0.smithi144.stdout:arg: file-0b 2024-06-04T16:07:12.210 INFO:tasks.workunit.client.0.smithi144.stdout:arg: file-8b 2024-06-04T16:07:12.211 INFO:tasks.workunit.client.0.smithi144.stdout:arg: file-200b 2024-06-04T16:07:12.213 INFO:tasks.workunit.client.0.smithi144.stdout:arg: file-21983b 2024-06-04T16:07:12.214 INFO:tasks.workunit.client.0.smithi144.stdout:arg: file-5519b 2024-06-04T16:07:12.215 INFO:tasks.workunit.client.0.smithi144.stdout:arg: file-204329b 2024-06-04T16:07:12.216 INFO:tasks.workunit.client.0.smithi144.stdout:arg: file-256k 2024-06-04T16:07:12.217 INFO:tasks.workunit.client.0.smithi144.stdout:arg: file-1m 2024-06-04T16:07:12.218 INFO:tasks.workunit.client.0.smithi144.stdout:arg: file-1038757b 2024-06-04T16:07:12.254 INFO:tasks.workunit.client.0.smithi144.stdout:putObjectFromFileCksum called with file-0b 2024-06-04T16:07:12.254 INFO:tasks.workunit.client.0.smithi144.stdout:PutObjectResponse 2024-06-04T16:07:12.273 INFO:tasks.workunit.client.0.smithi144.stdout:putObjectFromFileCksum called with file-8b 2024-06-04T16:07:12.273 INFO:tasks.workunit.client.0.smithi144.stdout:PutObjectResponse 2024-06-04T16:07:12.365 INFO:tasks.workunit.client.0.smithi144.stdout:putObjectFromFileCksum called with file-200b 2024-06-04T16:07:12.366 INFO:tasks.workunit.client.0.smithi144.stdout:PutObjectResponse 2024-06-04T16:07:12.373 INFO:tasks.workunit.client.0.smithi144.stdout:putObjectFromFileCksum called with file-21983b 2024-06-04T16:07:12.421 INFO:tasks.workunit.client.0.smithi144.stdout:PutObjectResponse 2024-06-04T16:07:12.473 INFO:tasks.workunit.client.0.smithi144.stdout:putObjectFromFileCksum called with file-5519b 2024-06-04T16:07:12.474 INFO:tasks.workunit.client.0.smithi144.stdout:PutObjectResponse 2024-06-04T16:07:12.497 INFO:tasks.workunit.client.0.smithi144.stdout:putObjectFromFileCksum called with file-204329b 2024-06-04T16:07:12.497 INFO:tasks.workunit.client.0.smithi144.stdout:PutObjectResponse 2024-06-04T16:07:12.520 INFO:tasks.workunit.client.0.smithi144.stdout:putObjectFromFileCksum called with file-256k 2024-06-04T16:07:12.521 INFO:tasks.workunit.client.0.smithi144.stdout:PutObjectResponse 2024-06-04T16:07:12.574 INFO:tasks.workunit.client.0.smithi144.stdout:putObjectFromFileCksum called with file-1m 2024-06-04T16:07:12.574 INFO:tasks.workunit.client.0.smithi144.stdout:PutObjectResponse 2024-06-04T16:07:12.674 INFO:tasks.workunit.client.0.smithi144.stdout:putObjectFromFileCksum called with file-1038757b 2024-06-04T16:07:12.674 INFO:tasks.workunit.client.0.smithi144.stdout:PutObjectResponse 2024-06-04T16:07:12.774 INFO:tasks.workunit.client.0.smithi144.stdout:mpuObjectFromFileCksum called with file-5m 2024-06-04T16:07:12.974 INFO:tasks.workunit.client.0.smithi144.stdout:mpuObjectFromFileCksum called with file-10m 2024-06-04T16:07:13.375 INFO:tasks.workunit.client.0.smithi144.stdout:mpuObjectFromFileCksum called with file-100m 2024-06-04T16:07:15.487 INFO:tasks.workunit.client.0.smithi144.stdout:[INFO] Tests run: 33, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 9.449 s -- in io.ceph.jcksum.PutObjects 2024-06-04T16:07:15.497 INFO:tasks.workunit.client.0.smithi144.stdout:[INFO] 2024-06-04T16:07:15.497 INFO:tasks.workunit.client.0.smithi144.stdout:[INFO] Results: 2024-06-04T16:07:15.497 INFO:tasks.workunit.client.0.smithi144.stdout:[INFO] 2024-06-04T16:07:15.498 INFO:tasks.workunit.client.0.smithi144.stdout:[INFO] Tests run: 33, Failures: 0, Errors: 0, Skipped: 0 2024-06-04T16:07:15.498 INFO:tasks.workunit.client.0.smithi144.stdout:[INFO] 2024-06-04T16:07:15.500 INFO:tasks.workunit.client.0.smithi144.stdout:[INFO] ------------------------------------------------------------------------ 2024-06-04T16:07:15.500 INFO:tasks.workunit.client.0.smithi144.stdout:[INFO] BUILD SUCCESS 2024-06-04T16:07:15.500 INFO:tasks.workunit.client.0.smithi144.stdout:[INFO] ------------------------------------------------------------------------ 2024-06-04T16:07:15.500 INFO:tasks.workunit.client.0.smithi144.stdout:[INFO] Total time: 11.318 s 2024-06-04T16:07:15.501 INFO:tasks.workunit.client.0.smithi144.stdout:[INFO] Finished at: 2024-06-04T16:07:15Z 2024-06-04T16:07:15.501 INFO:tasks.workunit.client.0.smithi144.stdout:[INFO] ------------------------------------------------------------------------ 2024-06-04T16:07:15.523 INFO:tasks.workunit.client.0.smithi144.stderr:+ exit 2024-06-04T16:07:15.523 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-06-04T16:07:15.523 DEBUG:teuthology.orchestra.run.smithi144:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-06-04T16:07:15.604 INFO:tasks.workunit:Stopping ['cls/test_cls_lock.sh', 'cls/test_cls_log.sh', 'cls/test_cls_refcount.sh', 'cls/test_cls_rgw.sh', 'cls/test_cls_rgw_gc.sh', 'cls/test_cls_rgw_stats.sh', 'cls/test_cls_cmpomap.sh', 'cls/test_cls_2pc_queue.sh', 'rgw/test_rgw_gc_log.sh', 'rgw/test_rgw_obj.sh', 'rgw/test_librgw_file.sh', 'rgw/test_awssdkv4_sig.sh'] on client.0... 2024-06-04T16:07:15.604 DEBUG:teuthology.orchestra.run.smithi144:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-06-04T16:07:15.944 DEBUG:teuthology.parallel:result is None 2024-06-04T16:07:15.945 DEBUG:teuthology.orchestra.run.smithi144:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-06-04T16:07:15.983 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-06-04T16:07:15.984 DEBUG:teuthology.orchestra.run.smithi144:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-06-04T16:07:16.053 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-06-04T16:07:16.053 INFO:teuthology.run_tasks:Running task workunit... 2024-06-04T16:07:16.064 INFO:tasks.workunit:Pulling workunits from ref 1fb5d10608dccee73edd6ef8a2c7b804a097c324 2024-06-04T16:07:16.064 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-06-04T16:07:16.064 DEBUG:teuthology.orchestra.run.smithi144:> stat -- /home/ubuntu/cephtest/mnt.0 2024-06-04T16:07:16.122 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-06-04T16:07:16.123 INFO:teuthology.orchestra.run.smithi144.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-06-04T16:07:16.123 DEBUG:teuthology.orchestra.run.smithi144:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-06-04T16:07:16.193 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-06-04T16:07:16.193 DEBUG:teuthology.orchestra.run.smithi144:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-06-04T16:07:16.261 INFO:tasks.workunit:timeout=3h 2024-06-04T16:07:16.261 INFO:tasks.workunit:cleanup=True 2024-06-04T16:07:16.262 DEBUG:teuthology.orchestra.run.smithi144:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 1fb5d10608dccee73edd6ef8a2c7b804a097c324 2024-06-04T16:07:16.330 INFO:tasks.workunit.client.0.smithi144.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-06-04T16:08:43.493 INFO:tasks.workunit.client.0.smithi144.stderr:Note: switching to '1fb5d10608dccee73edd6ef8a2c7b804a097c324'. 2024-06-04T16:08:43.493 INFO:tasks.workunit.client.0.smithi144.stderr: 2024-06-04T16:08:43.493 INFO:tasks.workunit.client.0.smithi144.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-06-04T16:08:43.493 INFO:tasks.workunit.client.0.smithi144.stderr:changes and commit them, and you can discard any commits you make in this 2024-06-04T16:08:43.494 INFO:tasks.workunit.client.0.smithi144.stderr:state without impacting any branches by switching back to a branch. 2024-06-04T16:08:43.494 INFO:tasks.workunit.client.0.smithi144.stderr: 2024-06-04T16:08:43.494 INFO:tasks.workunit.client.0.smithi144.stderr:If you want to create a new branch to retain commits you create, you may 2024-06-04T16:08:43.494 INFO:tasks.workunit.client.0.smithi144.stderr:do so (now or later) by using -c with the switch command. Example: 2024-06-04T16:08:43.494 INFO:tasks.workunit.client.0.smithi144.stderr: 2024-06-04T16:08:43.494 INFO:tasks.workunit.client.0.smithi144.stderr: git switch -c 2024-06-04T16:08:43.494 INFO:tasks.workunit.client.0.smithi144.stderr: 2024-06-04T16:08:43.494 INFO:tasks.workunit.client.0.smithi144.stderr:Or undo this operation with: 2024-06-04T16:08:43.494 INFO:tasks.workunit.client.0.smithi144.stderr: 2024-06-04T16:08:43.494 INFO:tasks.workunit.client.0.smithi144.stderr: git switch - 2024-06-04T16:08:43.494 INFO:tasks.workunit.client.0.smithi144.stderr: 2024-06-04T16:08:43.495 INFO:tasks.workunit.client.0.smithi144.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-06-04T16:08:43.495 INFO:tasks.workunit.client.0.smithi144.stderr: 2024-06-04T16:08:43.495 INFO:tasks.workunit.client.0.smithi144.stderr:HEAD is now at 1fb5d10608d Merge pull request #55565 from BBoozmen/oozmen_avoid_path_normalization 2024-06-04T16:08:43.495 DEBUG:teuthology.orchestra.run.smithi144:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-06-04T16:08:43.563 INFO:tasks.workunit.client.0.smithi144.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-06-04T16:08:43.565 INFO:tasks.workunit.client.0.smithi144.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-06-04T16:08:43.565 INFO:tasks.workunit.client.0.smithi144.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-06-04T16:08:43.613 INFO:tasks.workunit.client.0.smithi144.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-06-04T16:08:43.662 INFO:tasks.workunit.client.0.smithi144.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-06-04T16:08:43.701 INFO:tasks.workunit.client.0.smithi144.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-06-04T16:08:43.703 INFO:tasks.workunit.client.0.smithi144.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-06-04T16:08:43.703 INFO:tasks.workunit.client.0.smithi144.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-06-04T16:08:43.742 INFO:tasks.workunit.client.0.smithi144.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-06-04T16:08:43.745 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-06-04T16:08:43.745 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-06-04T16:08:43.815 INFO:tasks.workunit:Running workunits matching rgw/test_rgw_s3_mp_reupload.sh on client.0... 2024-06-04T16:08:43.816 INFO:tasks.workunit:Running workunit rgw/test_rgw_s3_mp_reupload.sh... 2024-06-04T16:08:43.817 DEBUG:teuthology.orchestra.run.smithi144:workunit test rgw/test_rgw_s3_mp_reupload.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1fb5d10608dccee73edd6ef8a2c7b804a097c324 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_s3_mp_reupload.sh 2024-06-04T16:08:43.890 INFO:tasks.workunit.client.0.smithi144.stdout:INFO: fully qualified domain name: smithi144.front.sepia.ceph.com 2024-06-04T16:08:43.891 INFO:tasks.workunit.client.0.smithi144.stdout:== TESTING *COMPLETING* MULTIPART UPLOAD WITH RE-UPLOADS == 2024-06-04T16:08:43.891 INFO:tasks.workunit.client.0.smithi144.stdout:== TESTING VERSIONED BUCKET == 2024-06-04T16:08:46.669 INFO:tasks.workunit.client.0.smithi144.stdout:Requirement already satisfied: pip in /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.9/site-packages (21.3.1) 2024-06-04T16:08:46.876 INFO:tasks.workunit.client.0.smithi144.stdout:Collecting pip 2024-06-04T16:08:46.882 INFO:tasks.workunit.client.0.smithi144.stdout: Using cached pip-24.0-py3-none-any.whl (2.1 MB) 2024-06-04T16:08:46.929 INFO:tasks.workunit.client.0.smithi144.stdout:Installing collected packages: pip 2024-06-04T16:08:46.929 INFO:tasks.workunit.client.0.smithi144.stdout: Attempting uninstall: pip 2024-06-04T16:08:46.929 INFO:tasks.workunit.client.0.smithi144.stdout: Found existing installation: pip 21.3.1 2024-06-04T16:08:47.083 INFO:tasks.workunit.client.0.smithi144.stdout: Uninstalling pip-21.3.1: 2024-06-04T16:08:47.089 INFO:tasks.workunit.client.0.smithi144.stdout: Successfully uninstalled pip-21.3.1 2024-06-04T16:08:48.049 INFO:tasks.workunit.client.0.smithi144.stdout:Successfully installed pip-24.0 2024-06-04T16:08:48.944 INFO:tasks.workunit.client.0.smithi144.stdout:Collecting boto3 2024-06-04T16:08:48.946 INFO:tasks.workunit.client.0.smithi144.stdout: Using cached boto3-1.34.118-py3-none-any.whl.metadata (6.6 kB) 2024-06-04T16:08:49.502 INFO:tasks.workunit.client.0.smithi144.stdout:Collecting botocore<1.35.0,>=1.34.118 (from boto3) 2024-06-04T16:08:49.503 INFO:tasks.workunit.client.0.smithi144.stdout: Using cached botocore-1.34.118-py3-none-any.whl.metadata (5.7 kB) 2024-06-04T16:08:49.566 INFO:tasks.workunit.client.0.smithi144.stdout:Collecting jmespath<2.0.0,>=0.7.1 (from boto3) 2024-06-04T16:08:49.567 INFO:tasks.workunit.client.0.smithi144.stdout: Using cached jmespath-1.0.1-py3-none-any.whl.metadata (7.6 kB) 2024-06-04T16:08:49.628 INFO:tasks.workunit.client.0.smithi144.stdout:Collecting s3transfer<0.11.0,>=0.10.0 (from boto3) 2024-06-04T16:08:49.629 INFO:tasks.workunit.client.0.smithi144.stdout: Using cached s3transfer-0.10.1-py3-none-any.whl.metadata (1.7 kB) 2024-06-04T16:08:49.705 INFO:tasks.workunit.client.0.smithi144.stdout:Collecting python-dateutil<3.0.0,>=2.1 (from botocore<1.35.0,>=1.34.118->boto3) 2024-06-04T16:08:49.706 INFO:tasks.workunit.client.0.smithi144.stdout: Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl.metadata (8.4 kB) 2024-06-04T16:08:49.797 INFO:tasks.workunit.client.0.smithi144.stdout:Collecting urllib3<1.27,>=1.25.4 (from botocore<1.35.0,>=1.34.118->boto3) 2024-06-04T16:08:49.798 INFO:tasks.workunit.client.0.smithi144.stdout: Using cached urllib3-1.26.18-py2.py3-none-any.whl.metadata (48 kB) 2024-06-04T16:08:50.018 INFO:tasks.workunit.client.0.smithi144.stdout:Collecting six>=1.5 (from python-dateutil<3.0.0,>=2.1->botocore<1.35.0,>=1.34.118->boto3) 2024-06-04T16:08:50.020 INFO:tasks.workunit.client.0.smithi144.stdout: Using cached six-1.16.0-py2.py3-none-any.whl.metadata (1.8 kB) 2024-06-04T16:08:50.042 INFO:tasks.workunit.client.0.smithi144.stdout:Using cached boto3-1.34.118-py3-none-any.whl (139 kB) 2024-06-04T16:08:50.044 INFO:tasks.workunit.client.0.smithi144.stdout:Using cached botocore-1.34.118-py3-none-any.whl (12.3 MB) 2024-06-04T16:08:50.064 INFO:tasks.workunit.client.0.smithi144.stdout:Using cached jmespath-1.0.1-py3-none-any.whl (20 kB) 2024-06-04T16:08:50.065 INFO:tasks.workunit.client.0.smithi144.stdout:Using cached s3transfer-0.10.1-py3-none-any.whl (82 kB) 2024-06-04T16:08:50.067 INFO:tasks.workunit.client.0.smithi144.stdout:Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl (229 kB) 2024-06-04T16:08:50.068 INFO:tasks.workunit.client.0.smithi144.stdout:Using cached urllib3-1.26.18-py2.py3-none-any.whl (143 kB) 2024-06-04T16:08:50.070 INFO:tasks.workunit.client.0.smithi144.stdout:Using cached six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-06-04T16:08:50.173 INFO:tasks.workunit.client.0.smithi144.stdout:Installing collected packages: urllib3, six, jmespath, python-dateutil, botocore, s3transfer, boto3 2024-06-04T16:08:51.261 INFO:tasks.workunit.client.0.smithi144.stdout:Successfully installed boto3-1.34.118 botocore-1.34.118 jmespath-1.0.1 python-dateutil-2.9.0.post0 s3transfer-0.10.1 six-1.16.0 urllib3-1.26.18 2024-06-04T16:08:51.724 INFO:tasks.workunit.client.0.smithi144.stdout:INFO: creating user 2024-06-04T16:08:52.036 INFO:tasks.workunit.client.0.smithi144.stdout:{ 2024-06-04T16:08:52.036 INFO:tasks.workunit.client.0.smithi144.stdout: "user_id": "testid", 2024-06-04T16:08:52.036 INFO:tasks.workunit.client.0.smithi144.stdout: "display_name": "M. Tester", 2024-06-04T16:08:52.036 INFO:tasks.workunit.client.0.smithi144.stdout: "email": "tester@ceph.com", 2024-06-04T16:08:52.036 INFO:tasks.workunit.client.0.smithi144.stdout: "suspended": 0, 2024-06-04T16:08:52.036 INFO:tasks.workunit.client.0.smithi144.stdout: "max_buckets": 1000, 2024-06-04T16:08:52.036 INFO:tasks.workunit.client.0.smithi144.stdout: "subusers": [], 2024-06-04T16:08:52.036 INFO:tasks.workunit.client.0.smithi144.stdout: "keys": [ 2024-06-04T16:08:52.037 INFO:tasks.workunit.client.0.smithi144.stdout: { 2024-06-04T16:08:52.037 INFO:tasks.workunit.client.0.smithi144.stdout: "user": "testid", 2024-06-04T16:08:52.037 INFO:tasks.workunit.client.0.smithi144.stdout: "access_key": "0555b35654ad1656d804", 2024-06-04T16:08:52.037 INFO:tasks.workunit.client.0.smithi144.stdout: "secret_key": "h7GhxuBLTrlhVUyxSPUKUV8r/2EI4ngqJxD7iBdBYLhwluN30JaT3Q==", 2024-06-04T16:08:52.037 INFO:tasks.workunit.client.0.smithi144.stdout: "active": true, 2024-06-04T16:08:52.037 INFO:tasks.workunit.client.0.smithi144.stdout: "create_date": "2024-06-04T16:08:52.029863Z" 2024-06-04T16:08:52.037 INFO:tasks.workunit.client.0.smithi144.stdout: } 2024-06-04T16:08:52.037 INFO:tasks.workunit.client.0.smithi144.stdout: ], 2024-06-04T16:08:52.038 INFO:tasks.workunit.client.0.smithi144.stdout: "swift_keys": [], 2024-06-04T16:08:52.038 INFO:tasks.workunit.client.0.smithi144.stdout: "caps": [], 2024-06-04T16:08:52.038 INFO:tasks.workunit.client.0.smithi144.stdout: "op_mask": "read, write, delete", 2024-06-04T16:08:52.038 INFO:tasks.workunit.client.0.smithi144.stdout: "default_placement": "", 2024-06-04T16:08:52.038 INFO:tasks.workunit.client.0.smithi144.stdout: "default_storage_class": "", 2024-06-04T16:08:52.038 INFO:tasks.workunit.client.0.smithi144.stdout: "placement_tags": [], 2024-06-04T16:08:52.038 INFO:tasks.workunit.client.0.smithi144.stdout: "bucket_quota": { 2024-06-04T16:08:52.038 INFO:tasks.workunit.client.0.smithi144.stdout: "enabled": false, 2024-06-04T16:08:52.038 INFO:tasks.workunit.client.0.smithi144.stdout: "check_on_raw": false, 2024-06-04T16:08:52.038 INFO:tasks.workunit.client.0.smithi144.stdout: "max_size": -1, 2024-06-04T16:08:52.038 INFO:tasks.workunit.client.0.smithi144.stdout: "max_size_kb": 0, 2024-06-04T16:08:52.038 INFO:tasks.workunit.client.0.smithi144.stdout: "max_objects": -1 2024-06-04T16:08:52.038 INFO:tasks.workunit.client.0.smithi144.stdout: }, 2024-06-04T16:08:52.039 INFO:tasks.workunit.client.0.smithi144.stdout: "user_quota": { 2024-06-04T16:08:52.039 INFO:tasks.workunit.client.0.smithi144.stdout: "enabled": false, 2024-06-04T16:08:52.039 INFO:tasks.workunit.client.0.smithi144.stdout: "check_on_raw": false, 2024-06-04T16:08:52.039 INFO:tasks.workunit.client.0.smithi144.stdout: "max_size": -1, 2024-06-04T16:08:52.039 INFO:tasks.workunit.client.0.smithi144.stdout: "max_size_kb": 0, 2024-06-04T16:08:52.039 INFO:tasks.workunit.client.0.smithi144.stdout: "max_objects": -1 2024-06-04T16:08:52.039 INFO:tasks.workunit.client.0.smithi144.stdout: }, 2024-06-04T16:08:52.039 INFO:tasks.workunit.client.0.smithi144.stdout: "temp_url_keys": [], 2024-06-04T16:08:52.039 INFO:tasks.workunit.client.0.smithi144.stdout: "type": "rgw", 2024-06-04T16:08:52.039 INFO:tasks.workunit.client.0.smithi144.stdout: "mfa_ids": [], 2024-06-04T16:08:52.039 INFO:tasks.workunit.client.0.smithi144.stdout: "account_id": "", 2024-06-04T16:08:52.039 INFO:tasks.workunit.client.0.smithi144.stdout: "path": "/", 2024-06-04T16:08:52.039 INFO:tasks.workunit.client.0.smithi144.stdout: "create_date": "2024-06-04T16:08:52.029848Z", 2024-06-04T16:08:52.039 INFO:tasks.workunit.client.0.smithi144.stdout: "tags": [], 2024-06-04T16:08:52.040 INFO:tasks.workunit.client.0.smithi144.stdout: "group_ids": [] 2024-06-04T16:08:52.040 INFO:tasks.workunit.client.0.smithi144.stdout:} 2024-06-04T16:08:52.040 INFO:tasks.workunit.client.0.smithi144.stdout: 2024-06-04T16:09:02.573 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi144.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:09:02.574 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:09:02.588 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi144.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:09:02.588 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:09:02.610 INFO:tasks.workunit.client.0.smithi144.stderr:5+0 records in 2024-06-04T16:09:02.610 INFO:tasks.workunit.client.0.smithi144.stderr:5+0 records out 2024-06-04T16:09:02.610 INFO:tasks.workunit.client.0.smithi144.stderr:5242880 bytes (5.2 MB, 5.0 MiB) copied, 0.0152185 s, 345 MB/s 2024-06-04T16:09:02.612 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi144.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:09:02.613 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:09:02.668 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi144.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:09:02.669 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:09:02.726 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi144.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:09:02.727 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:09:02.782 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi144.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:09:02.783 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:09:02.838 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi144.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:09:02.838 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:09:02.896 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi144.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:09:02.896 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:09:02.953 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi144.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:09:02.953 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:09:03.009 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi144.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:09:03.010 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:09:03.068 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi144.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:09:03.068 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:09:03.125 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi144.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:09:03.126 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:09:03.179 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi144.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:09:03.180 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:09:03.233 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi144.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:09:03.233 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:09:03.290 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi144.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:09:03.338 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:09:03.347 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi144.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:09:03.347 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:09:03.395 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi144.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:09:03.396 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:09:03.454 INFO:tasks.workunit.client.0.smithi144.stdout:bucket nams is reupload-bkt-117836 2024-06-04T16:09:03.454 INFO:tasks.workunit.client.0.smithi144.stdout:endpoint is https://smithi144.front.sepia.ceph.com:443 2024-06-04T16:09:03.454 INFO:tasks.workunit.client.0.smithi144.stdout:start UploadId=2~6RDzoQa02P8HAuPvHXipkygfEuedA4F 2024-06-04T16:09:03.454 INFO:tasks.workunit.client.0.smithi144.stdout:phase 1 uploaded part {'ETag': '"c62ced9b116fc3bdeb8edfaaa43cc68b"', 'PartNumber': 1} 2024-06-04T16:09:03.454 INFO:tasks.workunit.client.0.smithi144.stdout:phase 1 uploaded part {'ETag': '"c62ced9b116fc3bdeb8edfaaa43cc68b"', 'PartNumber': 2} 2024-06-04T16:09:03.454 INFO:tasks.workunit.client.0.smithi144.stdout:phase 2 uploaded part {'ETag': '"c62ced9b116fc3bdeb8edfaaa43cc68b"', 'PartNumber': 1} 2024-06-04T16:09:03.455 INFO:tasks.workunit.client.0.smithi144.stdout:phase 2 uploaded part {'ETag': '"c62ced9b116fc3bdeb8edfaaa43cc68b"', 'PartNumber': 1} 2024-06-04T16:09:03.455 INFO:tasks.workunit.client.0.smithi144.stdout:phase 2 uploaded part {'ETag': '"c62ced9b116fc3bdeb8edfaaa43cc68b"', 'PartNumber': 1} 2024-06-04T16:09:03.455 INFO:tasks.workunit.client.0.smithi144.stdout:phase 2 uploaded part {'ETag': '"c62ced9b116fc3bdeb8edfaaa43cc68b"', 'PartNumber': 1} 2024-06-04T16:09:03.455 INFO:tasks.workunit.client.0.smithi144.stdout:phase 2 uploaded part {'ETag': '"c62ced9b116fc3bdeb8edfaaa43cc68b"', 'PartNumber': 1} 2024-06-04T16:09:03.455 INFO:tasks.workunit.client.0.smithi144.stdout:phase 2 uploaded part {'ETag': '"c62ced9b116fc3bdeb8edfaaa43cc68b"', 'PartNumber': 1} 2024-06-04T16:09:03.455 INFO:tasks.workunit.client.0.smithi144.stdout:phase 2 uploaded part {'ETag': '"c62ced9b116fc3bdeb8edfaaa43cc68b"', 'PartNumber': 1} 2024-06-04T16:09:03.455 INFO:tasks.workunit.client.0.smithi144.stdout:phase 2 uploaded part {'ETag': '"c62ced9b116fc3bdeb8edfaaa43cc68b"', 'PartNumber': 1} 2024-06-04T16:09:03.455 INFO:tasks.workunit.client.0.smithi144.stdout:phase 2 uploaded part {'ETag': '"c62ced9b116fc3bdeb8edfaaa43cc68b"', 'PartNumber': 1} 2024-06-04T16:09:03.455 INFO:tasks.workunit.client.0.smithi144.stdout:phase 2 uploaded part {'ETag': '"c62ced9b116fc3bdeb8edfaaa43cc68b"', 'PartNumber': 1} 2024-06-04T16:09:03.455 INFO:tasks.workunit.client.0.smithi144.stdout:phase 2 uploaded part {'ETag': '"c62ced9b116fc3bdeb8edfaaa43cc68b"', 'PartNumber': 1} 2024-06-04T16:09:03.455 INFO:tasks.workunit.client.0.smithi144.stdout:completing multipart upload, parts=[{'ETag': '"c62ced9b116fc3bdeb8edfaaa43cc68b"', 'PartNumber': 1}, {'ETag': '"c62ced9b116fc3bdeb8edfaaa43cc68b"', 'PartNumber': 2}] 2024-06-04T16:09:04.442 INFO:tasks.workunit.client.0.smithi144.stdout:radosgw-admin bucket radoslist: 2024-06-04T16:09:04.442 INFO:tasks.workunit.client.0.smithi144.stdout:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.3_mpu_test4 2024-06-04T16:09:04.442 INFO:tasks.workunit.client.0.smithi144.stdout:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.3__multipart_mpu_test4.2~6RDzoQa02P8HAuPvHXipkygfEuedA4F.2 2024-06-04T16:09:04.442 INFO:tasks.workunit.client.0.smithi144.stdout:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.3__multipart_mpu_test4.OPgo2To1J5zaFMQlHbANtnLcWndS96QS.1 2024-06-04T16:09:04.442 INFO:tasks.workunit.client.0.smithi144.stdout:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.3__shadow_mpu_test4.2~6RDzoQa02P8HAuPvHXipkygfEuedA4F.2_1 2024-06-04T16:09:04.443 INFO:tasks.workunit.client.0.smithi144.stdout:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.3__shadow_mpu_test4.OPgo2To1J5zaFMQlHbANtnLcWndS96QS.1_1 2024-06-04T16:09:04.443 INFO:tasks.workunit.client.0.smithi144.stdout:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.3__:wIo4PzfQH4cA3451UITdmQrAtAn483L_mpu_test4 2024-06-04T16:09:04.499 INFO:tasks.workunit.client.0.smithi144.stdout:rados ls: 2024-06-04T16:09:04.500 INFO:tasks.workunit.client.0.smithi144.stdout:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.3_mpu_test4 2024-06-04T16:09:04.500 INFO:tasks.workunit.client.0.smithi144.stdout:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.3__multipart_mpu_test4.2~6RDzoQa02P8HAuPvHXipkygfEuedA4F.2 2024-06-04T16:09:04.500 INFO:tasks.workunit.client.0.smithi144.stdout:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.3__multipart_mpu_test4.OPgo2To1J5zaFMQlHbANtnLcWndS96QS.1 2024-06-04T16:09:04.500 INFO:tasks.workunit.client.0.smithi144.stdout:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.3__shadow_mpu_test4.2~6RDzoQa02P8HAuPvHXipkygfEuedA4F.2_1 2024-06-04T16:09:04.500 INFO:tasks.workunit.client.0.smithi144.stdout:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.3__shadow_mpu_test4.OPgo2To1J5zaFMQlHbANtnLcWndS96QS.1_1 2024-06-04T16:09:04.500 INFO:tasks.workunit.client.0.smithi144.stdout:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.3__:wIo4PzfQH4cA3451UITdmQrAtAn483L_mpu_test4 2024-06-04T16:09:04.584 INFO:tasks.workunit.client.0.smithi144.stdout:== PASSED == 2024-06-04T16:09:04.585 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-06-04T16:09:04.585 DEBUG:teuthology.orchestra.run.smithi144:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-06-04T16:09:04.664 INFO:tasks.workunit:Stopping ['rgw/test_rgw_s3_mp_reupload.sh'] on client.0... 2024-06-04T16:09:04.664 DEBUG:teuthology.orchestra.run.smithi144:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-06-04T16:09:05.010 DEBUG:teuthology.parallel:result is None 2024-06-04T16:09:05.010 DEBUG:teuthology.orchestra.run.smithi144:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-06-04T16:09:05.048 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-06-04T16:09:05.048 DEBUG:teuthology.orchestra.run.smithi144:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-06-04T16:09:05.117 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-06-04T16:09:05.117 INFO:teuthology.run_tasks:Running task ragweed... 2024-06-04T16:09:05.132 DEBUG:tasks.ragweed:ragweed config is {'client.0': {'default-branch': 'ceph-master', 'rgw_server': 'client.0', 'stages': 'prepare,check'}} 2024-06-04T16:09:05.133 INFO:tasks.ragweed:Downloading ragweed... 2024-06-04T16:09:05.133 INFO:tasks.ragweed:Using branch 'main' for ragweed 2024-06-04T16:09:05.133 DEBUG:teuthology.orchestra.run.smithi144:> git clone -b main https://git.ceph.com/ragweed.git /home/ubuntu/cephtest/ragweed.client.0 2024-06-04T16:09:05.186 INFO:teuthology.orchestra.run.smithi144.stderr:Cloning into '/home/ubuntu/cephtest/ragweed.client.0'... 2024-06-04T16:09:05.232 INFO:teuthology.orchestra.run.smithi144.stderr:fatal: Remote branch main not found in upstream origin 2024-06-04T16:09:05.232 DEBUG:teuthology.orchestra.run:got remote process result: 128 2024-06-04T16:09:05.233 INFO:tasks.ragweed:Using branch 'ceph-master' for ragweed 2024-06-04T16:09:05.234 DEBUG:teuthology.orchestra.run.smithi144:> git clone -b ceph-master https://git.ceph.com/ragweed.git /home/ubuntu/cephtest/ragweed.client.0 2024-06-04T16:09:05.304 INFO:teuthology.orchestra.run.smithi144.stderr:Cloning into '/home/ubuntu/cephtest/ragweed.client.0'... 2024-06-04T16:09:05.479 INFO:tasks.ragweed:Creating rgw users... 2024-06-04T16:09:05.480 DEBUG:tasks.ragweed:Creating user ragweed.client.0 on client.0 2024-06-04T16:09:05.481 DEBUG:teuthology.orchestra.run.smithi144:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid ragweed.client.0 --display-name 'Mr. ragweed.client.0' --access-key BZVIEGNMAFYVKLISTBJQ --secret hyMbHANNbVWh1Ht+zDiYbuVmStUdXiny/eGpCuq5h2Z1qT+ocFnXTQ== --email ragweed.client.0+test@test.test --system false 2024-06-04T16:09:05.587 INFO:teuthology.orchestra.run.smithi144.stderr:ignoring --setuser ceph since I am not root 2024-06-04T16:09:05.587 INFO:teuthology.orchestra.run.smithi144.stderr:ignoring --setgroup ceph since I am not root 2024-06-04T16:09:05.621 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:05.620+0000 7fea5512b800 20 rados->read ofs=0 len=0 2024-06-04T16:09:05.622 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:05.622+0000 7fea5512b800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:09:05.622 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:05.622+0000 7fea5512b800 20 realm 2024-06-04T16:09:05.623 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:05.622+0000 7fea5512b800 20 rados->read ofs=0 len=0 2024-06-04T16:09:05.623 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:05.622+0000 7fea5512b800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:09:05.623 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:05.622+0000 7fea5512b800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-06-04T16:09:05.623 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:05.622+0000 7fea5512b800 20 rados->read ofs=0 len=0 2024-06-04T16:09:05.623 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:05.622+0000 7fea5512b800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:09:05.624 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:05.622+0000 7fea5512b800 20 rados->read ofs=0 len=0 2024-06-04T16:09:05.624 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:05.623+0000 7fea5512b800 20 rados_obj.operate() r=0 bl.length=46 2024-06-04T16:09:05.624 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:05.623+0000 7fea5512b800 20 rados->read ofs=0 len=0 2024-06-04T16:09:05.624 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:05.624+0000 7fea5512b800 20 rados_obj.operate() r=0 bl.length=1139 2024-06-04T16:09:05.625 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:05.624+0000 7fea5512b800 20 searching for the correct realm 2024-06-04T16:09:05.626 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:05.626+0000 7fea51549640 0 -- 172.21.15.144:0/2313782433 >> [v2:172.21.15.144:6800/1453747520,v1:172.21.15.144:6801/1453747520] conn(0x7fea3802d060 msgr2=0x7fea38063600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-06-04T16:09:05.832 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:05.831+0000 7fea51549640 0 -- 172.21.15.144:0/2313782433 >> [v2:172.21.15.144:6824/166159729,v1:172.21.15.144:6825/166159729] conn(0x56548616d970 msgr2=0x56548616fd60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-06-04T16:09:05.838 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:05.836+0000 7fea5512b800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-06-04T16:09:05.838 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:05.837+0000 7fea5512b800 20 RGWRados::pool_iterate: got zone_info.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767 2024-06-04T16:09:05.838 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:05.837+0000 7fea5512b800 20 RGWRados::pool_iterate: got default.zone. 2024-06-04T16:09:05.838 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:05.837+0000 7fea5512b800 20 RGWRados::pool_iterate: got zonegroup_info.abb22408-c332-4e28-8f7a-ff254ea2fed2 2024-06-04T16:09:05.838 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:05.837+0000 7fea5512b800 20 RGWRados::pool_iterate: got zone_names.default 2024-06-04T16:09:05.838 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:05.837+0000 7fea5512b800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-06-04T16:09:05.838 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:05.837+0000 7fea5512b800 20 rados->read ofs=0 len=0 2024-06-04T16:09:05.838 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:05.837+0000 7fea5512b800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:09:05.839 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:05.837+0000 7fea5512b800 20 rados->read ofs=0 len=0 2024-06-04T16:09:05.839 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:05.837+0000 7fea5512b800 20 rados_obj.operate() r=0 bl.length=46 2024-06-04T16:09:05.839 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:05.837+0000 7fea5512b800 20 rados->read ofs=0 len=0 2024-06-04T16:09:05.840 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:05.838+0000 7fea5512b800 20 rados_obj.operate() r=0 bl.length=470 2024-06-04T16:09:05.841 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:05.838+0000 7fea5512b800 20 zone default found 2024-06-04T16:09:05.841 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:05.838+0000 7fea5512b800 4 Realm: () 2024-06-04T16:09:05.841 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:05.838+0000 7fea5512b800 4 ZoneGroup: default (abb22408-c332-4e28-8f7a-ff254ea2fed2) 2024-06-04T16:09:05.841 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:05.838+0000 7fea5512b800 4 Zone: default (be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767) 2024-06-04T16:09:05.841 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:05.838+0000 7fea5512b800 10 cannot find current period zonegroup using local zonegroup configuration 2024-06-04T16:09:05.841 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:05.838+0000 7fea5512b800 20 zonegroup default 2024-06-04T16:09:05.841 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:05.838+0000 7fea5512b800 20 rados->read ofs=0 len=0 2024-06-04T16:09:05.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:05.838+0000 7fea5512b800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:09:05.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:05.838+0000 7fea5512b800 20 rados->read ofs=0 len=0 2024-06-04T16:09:05.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:05.838+0000 7fea5512b800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:09:05.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:05.838+0000 7fea5512b800 20 rados->read ofs=0 len=0 2024-06-04T16:09:05.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:05.839+0000 7fea5512b800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:09:05.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:05.839+0000 7fea5512b800 20 started sync module instance, tier type = 2024-06-04T16:09:05.843 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:05.839+0000 7fea5512b800 20 started zone id=be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767 (name=default) with tier type = 2024-06-04T16:09:05.850 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:05.849+0000 7fea5512b800 20 add_watcher() i=0 2024-06-04T16:09:05.850 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:05.849+0000 7fea5512b800 20 add_watcher() i=1 2024-06-04T16:09:05.850 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:05.849+0000 7fea5512b800 20 add_watcher() i=2 2024-06-04T16:09:05.850 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:05.849+0000 7fea5512b800 20 add_watcher() i=3 2024-06-04T16:09:05.850 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:05.849+0000 7fea5512b800 20 add_watcher() i=4 2024-06-04T16:09:05.851 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:05.849+0000 7fea5512b800 20 add_watcher() i=5 2024-06-04T16:09:05.851 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:05.849+0000 7fea5512b800 20 add_watcher() i=6 2024-06-04T16:09:05.851 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:05.850+0000 7fea5512b800 20 add_watcher() i=7 2024-06-04T16:09:05.852 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:05.850+0000 7fea5512b800 2 all 8 watchers are set, enabling cache 2024-06-04T16:09:05.856 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:05.852+0000 7fe906fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-06-04T16:09:05.856 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:05.852+0000 7fea5512b800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-06-04T16:09:05.856 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:05.852+0000 7fea5512b800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-06-04T16:09:05.856 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:05.852+0000 7fea5512b800 5 note: GC not initialized 2024-06-04T16:09:05.856 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:05.852+0000 7fe905fe3640 20 reqs_thread_entry: start 2024-06-04T16:09:05.857 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:05.852+0000 7fea5512b800 20 init_complete bucket index max shards: 11 2024-06-04T16:09:05.857 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:05.852+0000 7fea5512b800 20 Filter name: none 2024-06-04T16:09:05.857 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:05.852+0000 7fe8777fe640 20 reqs_thread_entry: start 2024-06-04T16:09:05.857 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:05.852+0000 7fea5512b800 10 cache get: name=default.rgw.meta+users.uid+ragweed.client.0 : miss 2024-06-04T16:09:05.857 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:05.852+0000 7fea5512b800 20 rados->read ofs=0 len=0 2024-06-04T16:09:05.857 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:05.852+0000 7fea5512b800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:09:05.857 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:05.852+0000 7fea5512b800 10 cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x0 2024-06-04T16:09:05.858 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:05.852+0000 7fea5512b800 10 adding default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2024-06-04T16:09:05.858 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:05.853+0000 7fea5512b800 10 cache get: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test : miss 2024-06-04T16:09:05.858 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:05.853+0000 7fea5512b800 20 rados->read ofs=0 len=0 2024-06-04T16:09:05.858 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:05.853+0000 7fea5512b800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:09:05.858 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:05.853+0000 7fea5512b800 10 cache put: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test info.flags=0x0 2024-06-04T16:09:05.859 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:05.853+0000 7fea5512b800 10 adding default.rgw.meta+users.email+ragweed.client.0+test@test.test to cache LRU end 2024-06-04T16:09:05.859 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:05.853+0000 7fea5512b800 10 cache get: name=default.rgw.meta+users.keys+BZVIEGNMAFYVKLISTBJQ : miss 2024-06-04T16:09:05.859 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:05.853+0000 7fea5512b800 20 rados->read ofs=0 len=0 2024-06-04T16:09:05.859 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:05.853+0000 7fea5512b800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:09:05.859 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:05.853+0000 7fea5512b800 10 cache put: name=default.rgw.meta+users.keys+BZVIEGNMAFYVKLISTBJQ info.flags=0x0 2024-06-04T16:09:05.860 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:05.853+0000 7fea5512b800 10 adding default.rgw.meta+users.keys+BZVIEGNMAFYVKLISTBJQ to cache LRU end 2024-06-04T16:09:05.860 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:05.853+0000 7fea5512b800 10 cache get: name=default.rgw.meta+users.keys+BZVIEGNMAFYVKLISTBJQ : hit (negative entry) 2024-06-04T16:09:05.860 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:05.853+0000 7fea5512b800 10 cache get: name=default.rgw.meta+users.keys+BZVIEGNMAFYVKLISTBJQ : hit (negative entry) 2024-06-04T16:09:05.860 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:05.854+0000 7fea5512b800 10 cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x17 2024-06-04T16:09:05.860 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:05.854+0000 7fea5512b800 10 moving default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2024-06-04T16:09:05.860 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:05.854+0000 7fea5512b800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ragweed.client.0, ofs0, ns] 2024-06-04T16:09:05.861 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:05.855+0000 7fe927fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1052266987578 cookie 94921026930128 notifier 5829 bl.length()=675 2024-06-04T16:09:05.861 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:05.855+0000 7fe927fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x17 2024-06-04T16:09:05.861 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:05.855+0000 7fe927fff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2024-06-04T16:09:05.862 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:05.856+0000 7fea5512b800 10 cache put: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test info.flags=0x7 2024-06-04T16:09:05.863 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:05.856+0000 7fea5512b800 10 moving default.rgw.meta+users.email+ragweed.client.0+test@test.test to cache LRU end 2024-06-04T16:09:05.863 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:05.856+0000 7fea5512b800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.email:ragweed.client.0+test@test.test, ofs0, ns] 2024-06-04T16:09:05.863 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:05.856+0000 7fe927fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1052266987526 cookie 94921026922384 notifier 5829 bl.length()=202 2024-06-04T16:09:05.863 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:05.856+0000 7fe927fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test info.flags=0x7 2024-06-04T16:09:05.863 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:05.856+0000 7fe927fff640 10 rgw watcher librados: moving default.rgw.meta+users.email+ragweed.client.0+test@test.test to cache LRU end 2024-06-04T16:09:05.863 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:05.858+0000 7fea5512b800 10 cache put: name=default.rgw.meta+users.keys+BZVIEGNMAFYVKLISTBJQ info.flags=0x7 2024-06-04T16:09:05.863 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:05.858+0000 7fea5512b800 10 moving default.rgw.meta+users.keys+BZVIEGNMAFYVKLISTBJQ to cache LRU end 2024-06-04T16:09:05.863 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:05.858+0000 7fea5512b800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.keys:BZVIEGNMAFYVKLISTBJQ, ofs0, ns] 2024-06-04T16:09:05.864 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:05.858+0000 7fe9277fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1052266987579 cookie 94921026930128 notifier 5829 bl.length()=190 2024-06-04T16:09:05.864 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:05.858+0000 7fe9277fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+BZVIEGNMAFYVKLISTBJQ info.flags=0x7 2024-06-04T16:09:05.864 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:05.858+0000 7fe9277fe640 10 rgw watcher librados: moving default.rgw.meta+users.keys+BZVIEGNMAFYVKLISTBJQ to cache LRU end 2024-06-04T16:09:05.864 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-06-04T16:09:05.864 INFO:teuthology.orchestra.run.smithi144.stdout: "user_id": "ragweed.client.0", 2024-06-04T16:09:05.864 INFO:teuthology.orchestra.run.smithi144.stdout: "display_name": "Mr. ragweed.client.0", 2024-06-04T16:09:05.864 INFO:teuthology.orchestra.run.smithi144.stdout: "email": "ragweed.client.0+test@test.test", 2024-06-04T16:09:05.864 INFO:teuthology.orchestra.run.smithi144.stdout: "suspended": 0, 2024-06-04T16:09:05.864 INFO:teuthology.orchestra.run.smithi144.stdout: "max_buckets": 1000, 2024-06-04T16:09:05.864 INFO:teuthology.orchestra.run.smithi144.stdout: "subusers": [], 2024-06-04T16:09:05.865 INFO:teuthology.orchestra.run.smithi144.stdout: "keys": [ 2024-06-04T16:09:05.865 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-06-04T16:09:05.865 INFO:teuthology.orchestra.run.smithi144.stdout: "user": "ragweed.client.0", 2024-06-04T16:09:05.865 INFO:teuthology.orchestra.run.smithi144.stdout: "access_key": "BZVIEGNMAFYVKLISTBJQ", 2024-06-04T16:09:05.865 INFO:teuthology.orchestra.run.smithi144.stdout: "secret_key": "hyMbHANNbVWh1Ht+zDiYbuVmStUdXiny/eGpCuq5h2Z1qT+ocFnXTQ==", 2024-06-04T16:09:05.865 INFO:teuthology.orchestra.run.smithi144.stdout: "active": true, 2024-06-04T16:09:05.865 INFO:teuthology.orchestra.run.smithi144.stdout: "create_date": "2024-06-04T16:09:05.854346Z" 2024-06-04T16:09:05.865 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-06-04T16:09:05.865 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-06-04T16:09:05.865 INFO:teuthology.orchestra.run.smithi144.stdout: "swift_keys": [], 2024-06-04T16:09:05.865 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": [], 2024-06-04T16:09:05.865 INFO:teuthology.orchestra.run.smithi144.stdout: "op_mask": "read, write, delete", 2024-06-04T16:09:05.865 INFO:teuthology.orchestra.run.smithi144.stdout: "default_placement": "", 2024-06-04T16:09:05.865 INFO:teuthology.orchestra.run.smithi144.stdout: "default_storage_class": "", 2024-06-04T16:09:05.866 INFO:teuthology.orchestra.run.smithi144.stdout: "placement_tags": [], 2024-06-04T16:09:05.866 INFO:teuthology.orchestra.run.smithi144.stdout: "bucket_quota": { 2024-06-04T16:09:05.866 INFO:teuthology.orchestra.run.smithi144.stdout: "enabled": false, 2024-06-04T16:09:05.866 INFO:teuthology.orchestra.run.smithi144.stdout: "check_on_raw": false, 2024-06-04T16:09:05.866 INFO:teuthology.orchestra.run.smithi144.stdout: "max_size": -1, 2024-06-04T16:09:05.866 INFO:teuthology.orchestra.run.smithi144.stdout: "max_size_kb": 0, 2024-06-04T16:09:05.866 INFO:teuthology.orchestra.run.smithi144.stdout: "max_objects": -1 2024-06-04T16:09:05.866 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-06-04T16:09:05.866 INFO:teuthology.orchestra.run.smithi144.stdout: "user_quota": { 2024-06-04T16:09:05.866 INFO:teuthology.orchestra.run.smithi144.stdout: "enabled": false, 2024-06-04T16:09:05.866 INFO:teuthology.orchestra.run.smithi144.stdout: "check_on_raw": false, 2024-06-04T16:09:05.867 INFO:teuthology.orchestra.run.smithi144.stdout: "max_size": -1, 2024-06-04T16:09:05.867 INFO:teuthology.orchestra.run.smithi144.stdout: "max_size_kb": 0, 2024-06-04T16:09:05.867 INFO:teuthology.orchestra.run.smithi144.stdout: "max_objects": -1 2024-06-04T16:09:05.867 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-06-04T16:09:05.867 INFO:teuthology.orchestra.run.smithi144.stdout: "temp_url_keys": [], 2024-06-04T16:09:05.867 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "rgw", 2024-06-04T16:09:05.867 INFO:teuthology.orchestra.run.smithi144.stdout: "mfa_ids": [], 2024-06-04T16:09:05.867 INFO:teuthology.orchestra.run.smithi144.stdout: "account_id": "", 2024-06-04T16:09:05.867 INFO:teuthology.orchestra.run.smithi144.stdout: "path": "/", 2024-06-04T16:09:05.867 INFO:teuthology.orchestra.run.smithi144.stdout: "create_date": "2024-06-04T16:09:05.854334Z", 2024-06-04T16:09:05.867 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-06-04T16:09:05.867 INFO:teuthology.orchestra.run.smithi144.stdout: "group_ids": [] 2024-06-04T16:09:05.867 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-06-04T16:09:05.867 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:09:05.868 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:05.860+0000 7fe906fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-06-04T16:09:05.868 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:05.862+0000 7fea5512b800 20 remove_watcher() i=0 2024-06-04T16:09:05.868 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:05.862+0000 7fea5512b800 2 removed watcher, disabling cache 2024-06-04T16:09:05.869 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:05.863+0000 7fea5512b800 20 remove_watcher() i=1 2024-06-04T16:09:05.869 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:05.864+0000 7fea5512b800 20 remove_watcher() i=2 2024-06-04T16:09:05.869 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:05.865+0000 7fea5512b800 20 remove_watcher() i=3 2024-06-04T16:09:05.869 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:05.866+0000 7fea5512b800 20 remove_watcher() i=4 2024-06-04T16:09:05.869 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:05.867+0000 7fea5512b800 20 remove_watcher() i=5 2024-06-04T16:09:05.869 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:05.868+0000 7fea5512b800 20 remove_watcher() i=6 2024-06-04T16:09:05.870 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:05.869+0000 7fea5512b800 20 remove_watcher() i=7 2024-06-04T16:09:05.881 DEBUG:tasks.ragweed:Creating user sysuser.client.0 on client.0 2024-06-04T16:09:05.882 DEBUG:teuthology.orchestra.run.smithi144:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid sysuser.client.0 --display-name 'Mr. sysuser.client.0' --access-key IBWSYDSTHYVKJDZLKOGP --secret Skbo3t1GEzDb4uaFfzZFCrt/gtd3jetHPfsgHnfOyMrX9v8PVmHHAw== --email sysuser.client.0+test@test.test --system true 2024-06-04T16:09:05.947 INFO:teuthology.orchestra.run.smithi144.stderr:ignoring --setuser ceph since I am not root 2024-06-04T16:09:05.948 INFO:teuthology.orchestra.run.smithi144.stderr:ignoring --setgroup ceph since I am not root 2024-06-04T16:09:05.981 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:05.981+0000 7f89fe616800 20 rados->read ofs=0 len=0 2024-06-04T16:09:05.983 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:05.982+0000 7f89fe616800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:09:05.983 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:05.982+0000 7f89fe616800 20 realm 2024-06-04T16:09:05.983 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:05.982+0000 7f89fe616800 20 rados->read ofs=0 len=0 2024-06-04T16:09:05.983 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:05.982+0000 7f89fe616800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:09:05.983 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:05.982+0000 7f89fe616800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-06-04T16:09:05.983 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:05.982+0000 7f89fe616800 20 rados->read ofs=0 len=0 2024-06-04T16:09:05.983 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:05.982+0000 7f89fe616800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:09:05.983 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:05.982+0000 7f89fe616800 20 rados->read ofs=0 len=0 2024-06-04T16:09:05.984 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:05.983+0000 7f89fe616800 20 rados_obj.operate() r=0 bl.length=46 2024-06-04T16:09:05.984 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:05.983+0000 7f89fe616800 20 rados->read ofs=0 len=0 2024-06-04T16:09:05.984 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:05.983+0000 7f89fe616800 20 rados_obj.operate() r=0 bl.length=1139 2024-06-04T16:09:05.985 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:05.983+0000 7f89fe616800 20 searching for the correct realm 2024-06-04T16:09:05.986 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:05.985+0000 7f89fa47b640 0 -- 172.21.15.144:0/1250279058 >> [v2:172.21.15.177:6824/800067290,v1:172.21.15.177:6825/800067290] conn(0x55e6695ba030 msgr2=0x55e6695bc4f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-06-04T16:09:05.989 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:05.988+0000 7f89f9479640 0 -- 172.21.15.144:0/1250279058 >> [v2:172.21.15.177:6808/2618477608,v1:172.21.15.177:6809/2618477608] conn(0x7f89e4082410 msgr2=0x7f89e4082890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-06-04T16:09:06.198 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:06.196+0000 7f89fe616800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-06-04T16:09:06.198 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:06.196+0000 7f89fe616800 20 RGWRados::pool_iterate: got zone_info.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767 2024-06-04T16:09:06.198 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:06.196+0000 7f89fe616800 20 RGWRados::pool_iterate: got default.zone. 2024-06-04T16:09:06.198 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:06.196+0000 7f89fe616800 20 RGWRados::pool_iterate: got zonegroup_info.abb22408-c332-4e28-8f7a-ff254ea2fed2 2024-06-04T16:09:06.198 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:06.196+0000 7f89fe616800 20 RGWRados::pool_iterate: got zone_names.default 2024-06-04T16:09:06.198 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:06.196+0000 7f89fe616800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-06-04T16:09:06.198 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:06.196+0000 7f89fe616800 20 rados->read ofs=0 len=0 2024-06-04T16:09:06.198 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:06.197+0000 7f89fe616800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:09:06.198 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:06.197+0000 7f89fe616800 20 rados->read ofs=0 len=0 2024-06-04T16:09:06.199 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:06.197+0000 7f89fe616800 20 rados_obj.operate() r=0 bl.length=46 2024-06-04T16:09:06.199 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:06.197+0000 7f89fe616800 20 rados->read ofs=0 len=0 2024-06-04T16:09:06.200 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:06.197+0000 7f89fe616800 20 rados_obj.operate() r=0 bl.length=470 2024-06-04T16:09:06.200 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:06.197+0000 7f89fe616800 20 zone default found 2024-06-04T16:09:06.200 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:06.197+0000 7f89fe616800 4 Realm: () 2024-06-04T16:09:06.200 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:06.197+0000 7f89fe616800 4 ZoneGroup: default (abb22408-c332-4e28-8f7a-ff254ea2fed2) 2024-06-04T16:09:06.200 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:06.197+0000 7f89fe616800 4 Zone: default (be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767) 2024-06-04T16:09:06.200 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:06.197+0000 7f89fe616800 10 cannot find current period zonegroup using local zonegroup configuration 2024-06-04T16:09:06.200 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:06.197+0000 7f89fe616800 20 zonegroup default 2024-06-04T16:09:06.200 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:06.197+0000 7f89fe616800 20 rados->read ofs=0 len=0 2024-06-04T16:09:06.200 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:06.198+0000 7f89fe616800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:09:06.200 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:06.198+0000 7f89fe616800 20 rados->read ofs=0 len=0 2024-06-04T16:09:06.200 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:06.198+0000 7f89fe616800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:09:06.200 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:06.198+0000 7f89fe616800 20 rados->read ofs=0 len=0 2024-06-04T16:09:06.201 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:06.198+0000 7f89fe616800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:09:06.201 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:06.198+0000 7f89fe616800 20 started sync module instance, tier type = 2024-06-04T16:09:06.201 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:06.198+0000 7f89fe616800 20 started zone id=be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767 (name=default) with tier type = 2024-06-04T16:09:06.209 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:06.208+0000 7f89fe616800 20 add_watcher() i=0 2024-06-04T16:09:06.209 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:06.208+0000 7f89fe616800 20 add_watcher() i=1 2024-06-04T16:09:06.209 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:06.208+0000 7f89fe616800 20 add_watcher() i=2 2024-06-04T16:09:06.209 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:06.208+0000 7f89fe616800 20 add_watcher() i=3 2024-06-04T16:09:06.209 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:06.208+0000 7f89fe616800 20 add_watcher() i=4 2024-06-04T16:09:06.209 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:06.208+0000 7f89fe616800 20 add_watcher() i=5 2024-06-04T16:09:06.209 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:06.208+0000 7f89fe616800 20 add_watcher() i=6 2024-06-04T16:09:06.210 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:06.209+0000 7f89fe616800 20 add_watcher() i=7 2024-06-04T16:09:06.210 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:06.209+0000 7f89fe616800 2 all 8 watchers are set, enabling cache 2024-06-04T16:09:06.213 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:06.211+0000 7f88ab7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-06-04T16:09:06.213 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:06.211+0000 7f89fe616800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-06-04T16:09:06.213 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:06.211+0000 7f89fe616800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-06-04T16:09:06.213 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:06.211+0000 7f89fe616800 5 note: GC not initialized 2024-06-04T16:09:06.213 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:06.212+0000 7f88aa7fc640 20 reqs_thread_entry: start 2024-06-04T16:09:06.213 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:06.212+0000 7f89fe616800 20 init_complete bucket index max shards: 11 2024-06-04T16:09:06.213 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:06.212+0000 7f89fe616800 20 Filter name: none 2024-06-04T16:09:06.213 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:06.212+0000 7f881bfff640 20 reqs_thread_entry: start 2024-06-04T16:09:06.214 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:06.212+0000 7f89fe616800 10 cache get: name=default.rgw.meta+users.uid+sysuser.client.0 : miss 2024-06-04T16:09:06.214 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:06.212+0000 7f89fe616800 20 rados->read ofs=0 len=0 2024-06-04T16:09:06.214 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:06.212+0000 7f89fe616800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:09:06.214 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:06.212+0000 7f89fe616800 10 cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x0 2024-06-04T16:09:06.214 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:06.212+0000 7f89fe616800 10 adding default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2024-06-04T16:09:06.214 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:06.212+0000 7f89fe616800 10 cache get: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test : miss 2024-06-04T16:09:06.214 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:06.212+0000 7f89fe616800 20 rados->read ofs=0 len=0 2024-06-04T16:09:06.215 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:06.213+0000 7f89fe616800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:09:06.215 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:06.213+0000 7f89fe616800 10 cache put: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test info.flags=0x0 2024-06-04T16:09:06.215 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:06.213+0000 7f89fe616800 10 adding default.rgw.meta+users.email+sysuser.client.0+test@test.test to cache LRU end 2024-06-04T16:09:06.215 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:06.213+0000 7f89fe616800 10 cache get: name=default.rgw.meta+users.keys+IBWSYDSTHYVKJDZLKOGP : miss 2024-06-04T16:09:06.215 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:06.213+0000 7f89fe616800 20 rados->read ofs=0 len=0 2024-06-04T16:09:06.215 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:06.213+0000 7f89fe616800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:09:06.215 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:06.213+0000 7f89fe616800 10 cache put: name=default.rgw.meta+users.keys+IBWSYDSTHYVKJDZLKOGP info.flags=0x0 2024-06-04T16:09:06.216 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:06.213+0000 7f89fe616800 10 adding default.rgw.meta+users.keys+IBWSYDSTHYVKJDZLKOGP to cache LRU end 2024-06-04T16:09:06.216 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:06.213+0000 7f89fe616800 10 cache get: name=default.rgw.meta+users.keys+IBWSYDSTHYVKJDZLKOGP : hit (negative entry) 2024-06-04T16:09:06.216 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:06.213+0000 7f89fe616800 10 cache get: name=default.rgw.meta+users.keys+IBWSYDSTHYVKJDZLKOGP : hit (negative entry) 2024-06-04T16:09:06.216 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:06.214+0000 7f89fe616800 10 cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x17 2024-06-04T16:09:06.216 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:06.214+0000 7f89fe616800 10 moving default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2024-06-04T16:09:06.216 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:06.214+0000 7f89fe616800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.uid:sysuser.client.0, ofs0, ns] 2024-06-04T16:09:06.216 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:06.214+0000 7f88dd7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1052266987527 cookie 94448098455840 notifier 5850 bl.length()=675 2024-06-04T16:09:06.216 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:06.214+0000 7f88dd7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x17 2024-06-04T16:09:06.216 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:06.214+0000 7f88dd7fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2024-06-04T16:09:06.217 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:06.216+0000 7f89fe616800 10 cache put: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test info.flags=0x7 2024-06-04T16:09:06.217 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:06.216+0000 7f89fe616800 10 moving default.rgw.meta+users.email+sysuser.client.0+test@test.test to cache LRU end 2024-06-04T16:09:06.217 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:06.216+0000 7f89fe616800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.email:sysuser.client.0+test@test.test, ofs0, ns] 2024-06-04T16:09:06.217 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:06.216+0000 7f88dcff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1052266987580 cookie 94448098515888 notifier 5850 bl.length()=202 2024-06-04T16:09:06.217 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:06.216+0000 7f88dcff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test info.flags=0x7 2024-06-04T16:09:06.217 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:06.216+0000 7f88dcff9640 10 rgw watcher librados: moving default.rgw.meta+users.email+sysuser.client.0+test@test.test to cache LRU end 2024-06-04T16:09:06.218 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:06.218+0000 7f89fe616800 10 cache put: name=default.rgw.meta+users.keys+IBWSYDSTHYVKJDZLKOGP info.flags=0x7 2024-06-04T16:09:06.218 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:06.218+0000 7f89fe616800 10 moving default.rgw.meta+users.keys+IBWSYDSTHYVKJDZLKOGP to cache LRU end 2024-06-04T16:09:06.219 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:06.218+0000 7f89fe616800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:users.keys:IBWSYDSTHYVKJDZLKOGP, ofs0, ns] 2024-06-04T16:09:06.219 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:06.218+0000 7f88dd7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1052266987585 cookie 94448098520816 notifier 5850 bl.length()=190 2024-06-04T16:09:06.219 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:06.218+0000 7f88dd7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+IBWSYDSTHYVKJDZLKOGP info.flags=0x7 2024-06-04T16:09:06.219 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:06.218+0000 7f88dd7fa640 10 rgw watcher librados: moving default.rgw.meta+users.keys+IBWSYDSTHYVKJDZLKOGP to cache LRU end 2024-06-04T16:09:06.219 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-06-04T16:09:06.220 INFO:teuthology.orchestra.run.smithi144.stdout: "user_id": "sysuser.client.0", 2024-06-04T16:09:06.220 INFO:teuthology.orchestra.run.smithi144.stdout: "display_name": "Mr. sysuser.client.0", 2024-06-04T16:09:06.220 INFO:teuthology.orchestra.run.smithi144.stdout: "email": "sysuser.client.0+test@test.test", 2024-06-04T16:09:06.220 INFO:teuthology.orchestra.run.smithi144.stdout: "suspended": 0, 2024-06-04T16:09:06.220 INFO:teuthology.orchestra.run.smithi144.stdout: "max_buckets": 1000, 2024-06-04T16:09:06.220 INFO:teuthology.orchestra.run.smithi144.stdout: "subusers": [], 2024-06-04T16:09:06.220 INFO:teuthology.orchestra.run.smithi144.stdout: "keys": [ 2024-06-04T16:09:06.220 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-06-04T16:09:06.220 INFO:teuthology.orchestra.run.smithi144.stdout: "user": "sysuser.client.0", 2024-06-04T16:09:06.220 INFO:teuthology.orchestra.run.smithi144.stdout: "access_key": "IBWSYDSTHYVKJDZLKOGP", 2024-06-04T16:09:06.220 INFO:teuthology.orchestra.run.smithi144.stdout: "secret_key": "Skbo3t1GEzDb4uaFfzZFCrt/gtd3jetHPfsgHnfOyMrX9v8PVmHHAw==", 2024-06-04T16:09:06.220 INFO:teuthology.orchestra.run.smithi144.stdout: "active": true, 2024-06-04T16:09:06.220 INFO:teuthology.orchestra.run.smithi144.stdout: "create_date": "2024-06-04T16:09:06.214245Z" 2024-06-04T16:09:06.220 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-06-04T16:09:06.221 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-06-04T16:09:06.221 INFO:teuthology.orchestra.run.smithi144.stdout: "swift_keys": [], 2024-06-04T16:09:06.221 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": [], 2024-06-04T16:09:06.221 INFO:teuthology.orchestra.run.smithi144.stdout: "op_mask": "read, write, delete", 2024-06-04T16:09:06.221 INFO:teuthology.orchestra.run.smithi144.stdout: "system": true, 2024-06-04T16:09:06.221 INFO:teuthology.orchestra.run.smithi144.stdout: "default_placement": "", 2024-06-04T16:09:06.221 INFO:teuthology.orchestra.run.smithi144.stdout: "default_storage_class": "", 2024-06-04T16:09:06.221 INFO:teuthology.orchestra.run.smithi144.stdout: "placement_tags": [], 2024-06-04T16:09:06.221 INFO:teuthology.orchestra.run.smithi144.stdout: "bucket_quota": { 2024-06-04T16:09:06.221 INFO:teuthology.orchestra.run.smithi144.stdout: "enabled": false, 2024-06-04T16:09:06.221 INFO:teuthology.orchestra.run.smithi144.stdout: "check_on_raw": false, 2024-06-04T16:09:06.221 INFO:teuthology.orchestra.run.smithi144.stdout: "max_size": -1, 2024-06-04T16:09:06.221 INFO:teuthology.orchestra.run.smithi144.stdout: "max_size_kb": 0, 2024-06-04T16:09:06.221 INFO:teuthology.orchestra.run.smithi144.stdout: "max_objects": -1 2024-06-04T16:09:06.222 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-06-04T16:09:06.222 INFO:teuthology.orchestra.run.smithi144.stdout: "user_quota": { 2024-06-04T16:09:06.222 INFO:teuthology.orchestra.run.smithi144.stdout: "enabled": false, 2024-06-04T16:09:06.222 INFO:teuthology.orchestra.run.smithi144.stdout: "check_on_raw": false, 2024-06-04T16:09:06.222 INFO:teuthology.orchestra.run.smithi144.stdout: "max_size": -1, 2024-06-04T16:09:06.222 INFO:teuthology.orchestra.run.smithi144.stdout: "max_size_kb": 0, 2024-06-04T16:09:06.222 INFO:teuthology.orchestra.run.smithi144.stdout: "max_objects": -1 2024-06-04T16:09:06.222 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-06-04T16:09:06.222 INFO:teuthology.orchestra.run.smithi144.stdout: "temp_url_keys": [], 2024-06-04T16:09:06.222 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "rgw", 2024-06-04T16:09:06.223 INFO:teuthology.orchestra.run.smithi144.stdout: "mfa_ids": [], 2024-06-04T16:09:06.223 INFO:teuthology.orchestra.run.smithi144.stdout: "account_id": "", 2024-06-04T16:09:06.223 INFO:teuthology.orchestra.run.smithi144.stdout: "path": "/", 2024-06-04T16:09:06.223 INFO:teuthology.orchestra.run.smithi144.stdout: "create_date": "2024-06-04T16:09:06.214233Z", 2024-06-04T16:09:06.223 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-06-04T16:09:06.223 INFO:teuthology.orchestra.run.smithi144.stdout: "group_ids": [] 2024-06-04T16:09:06.223 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-06-04T16:09:06.223 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:09:06.224 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:06.220+0000 7f88ab7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-06-04T16:09:06.224 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:06.222+0000 7f89fe616800 20 remove_watcher() i=0 2024-06-04T16:09:06.224 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:06.222+0000 7f89fe616800 2 removed watcher, disabling cache 2024-06-04T16:09:06.224 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:06.223+0000 7f89fe616800 20 remove_watcher() i=1 2024-06-04T16:09:06.225 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:06.224+0000 7f89fe616800 20 remove_watcher() i=2 2024-06-04T16:09:06.225 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:06.225+0000 7f89fe616800 20 remove_watcher() i=3 2024-06-04T16:09:06.227 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:06.226+0000 7f89fe616800 20 remove_watcher() i=4 2024-06-04T16:09:06.228 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:06.227+0000 7f89fe616800 20 remove_watcher() i=5 2024-06-04T16:09:06.229 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:06.228+0000 7f89fe616800 20 remove_watcher() i=6 2024-06-04T16:09:06.230 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:06.229+0000 7f89fe616800 20 remove_watcher() i=7 2024-06-04T16:09:06.241 INFO:tasks.ragweed:Configuring ragweed... 2024-06-04T16:09:06.241 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-06-04T16:09:06.241 DEBUG:teuthology.orchestra.run.smithi144:> dd of=/home/ubuntu/cephtest/archive/ragweed.client.0.conf 2024-06-04T16:09:06.269 INFO:tasks.ragweed:Configuring boto... 2024-06-04T16:09:06.270 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-06-04T16:09:06.270 DEBUG:teuthology.orchestra.run.smithi144:> dd of=/home/ubuntu/cephtest/boto.cfg 2024-06-04T16:09:06.338 DEBUG:teuthology.orchestra.run.smithi144:ragweed tests against rgw> source /home/ubuntu/cephtest/tox-venv/bin/activate && cd /home/ubuntu/cephtest/ragweed.client.0 && RAGWEED_CONF=/home/ubuntu/cephtest/archive/ragweed.client.0.conf RAGWEED_STAGES=prepare,check BOTO_CONFIG=/home/ubuntu/cephtest/boto.cfg tox --sitepackages -- -v -m 'not fails_on_rgw' 2024-06-04T16:09:06.524 INFO:teuthology.orchestra.run.smithi144.stdout:GLOB sdist-make: /home/ubuntu/cephtest/ragweed.client.0/setup.py 2024-06-04T16:09:06.690 INFO:teuthology.orchestra.run.smithi144.stdout:py create: /home/ubuntu/cephtest/ragweed.client.0/.tox/py 2024-06-04T16:09:07.177 INFO:teuthology.orchestra.run.smithi144.stdout:py installdeps: -rrequirements.txt 2024-06-04T16:09:14.223 INFO:teuthology.orchestra.run.smithi144.stdout:py inst: /home/ubuntu/cephtest/ragweed.client.0/.tox/.tmp/package/1/ragweed-0.0.1.zip 2024-06-04T16:09:16.368 INFO:teuthology.orchestra.run.smithi144.stdout:py installed: asyncssh==2.13.2,Babel==2.9.1,bcrypt==3.2.2,boto==2.49.0,cachetools==4.2.4,ceph==1.0.0,ceph-volume==1.0.0,cephfs==2.0.0,certifi==2021.10.8,cffi==1.14.5,chardet==4.0.0,cheroot==8.6.0,CherryPy==18.6.1,cockpit @ file:///builddir/build/BUILD/cockpit-314/tmp/wheel/cockpit-314-py3-none-any.whl,cryptography==36.0.1,dasbus==1.4,dbus-python==1.2.18,distro==1.5.0,docopt==0.6.2,exceptiongroup==1.2.1,execnet==2.1.1,file-magic==0.4.0,gevent==24.2.1,google-auth==2.29.0,gpg==1.15.1,greenlet==3.0.3,grpcio==1.46.7,grpcio-tools==1.46.7,httplib2==0.22.0,idna==2.10,iniconfig==2.0.0,isodate==0.6.1,jaraco.classes==3.2.1,jaraco.collections==3.0.0,jaraco.functools==3.5.0,jaraco.text==3.2.0,Jinja2==2.11.3,jsonpatch==1.21,jsonpointer==2.0,kubernetes==26.1.0,libcomps==0.1.18,logutils==0.3.5,lxml==4.6.5,Mako==1.1.4.dev0,MarkupSafe==1.1.1,more-itertools==8.12.0,munch==4.0.0,natsort==7.1.1,nftables==0.1,numpy==1.20.1,oauthlib==3.1.1,packaging==20.9,pecan==1.4.2,perf==0.1,pexpect==4.8.0,pluggy==1.5.0,ply==3.11,portend==3.1.0,prettytable==0.7.2,protobuf==3.14.0,psutil==5.8.0,ptyprocess==0.6.0,pyasn1==0.4.8,pyasn1-modules==0.2.8,pycparser==2.20,PyGObject==3.40.1,pyOpenSSL==21.0.0,pyparsing==2.4.7,PySocks==1.7.1,pytest==8.2.2,python-dateutil==2.8.1,python-linux-procfs==0.7.3,pytz==2021.1,pyudev==0.22.0,PyYAML==5.4.1,rados==2.0.0,ragweed @ file:///home/ubuntu/cephtest/ragweed.client.0/.tox/.tmp/package/1/ragweed-0.0.1.zip#sha256=13727894a5ecd6cec11c8920d33c02bc5cd89c13a1033498e00c31ff121b3e53,rbd==2.0.0,registries-conf-ctl==1.0,remoto==1.2.1,repoze.lru==0.7,requests==2.25.1,requests-oauthlib==1.3.0,rgw==2.0.0,Routes==2.5.1,rpm==4.16.1.3,rsa==4.9,s3cmd==2.4.0,scipy==1.6.2,selinux==3.6,sepolicy==3.6,setools==4.4.4,setroubleshoot @ file:///builddir/build/BUILD/setroubleshoot-3.3.32/src,six==1.15.0,systemd-python==234,tempora==5.0.0,toml==0.10.2,tomli==2.0.1,typing_extensions==4.4.0,urllib3==1.26.5,WebOb==1.8.7,websocket-client==1.2.3,Werkzeug==2.0.3,zc.lockfile==2.0,zope.event==5.0,zope.interface==6.4.post2 2024-06-04T16:09:16.368 INFO:teuthology.orchestra.run.smithi144.stdout:py run-test-pre: PYTHONHASHSEED='282931017' 2024-06-04T16:09:16.368 INFO:teuthology.orchestra.run.smithi144.stdout:py run-test: commands[0] | python -m pytest -v -m 'not fails_on_rgw' 2024-06-04T16:09:16.572 INFO:teuthology.orchestra.run.smithi144.stdout:============================= test session starts ============================== 2024-06-04T16:09:16.572 INFO:teuthology.orchestra.run.smithi144.stdout:platform linux -- Python 3.9.18, pytest-8.2.2, pluggy-1.5.0 -- /home/ubuntu/cephtest/ragweed.client.0/.tox/py/bin/python 2024-06-04T16:09:16.572 INFO:teuthology.orchestra.run.smithi144.stdout:cachedir: .tox/py/.pytest_cache 2024-06-04T16:09:16.572 INFO:teuthology.orchestra.run.smithi144.stdout:rootdir: /home/ubuntu/cephtest/ragweed.client.0 2024-06-04T16:09:16.572 INFO:teuthology.orchestra.run.smithi144.stdout:configfile: pytest.ini 2024-06-04T16:09:16.671 INFO:teuthology.orchestra.run.smithi144.stdout:collecting ... collected 9 items 2024-06-04T16:09:16.671 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:09:19.021 INFO:teuthology.orchestra.run.smithi144.stdout:ragweed/tests/tests.py::r_test_small_obj_data::test PASSED [ 11%] 2024-06-04T16:09:19.846 INFO:teuthology.orchestra.run.smithi144.stdout:ragweed/tests/tests.py::r_test_multipart_simple::test PASSED [ 22%] 2024-06-04T16:09:20.644 INFO:teuthology.orchestra.run.smithi144.stdout:ragweed/tests/tests.py::r_test_multipart_index_versioning::test PASSED [ 33%] 2024-06-04T16:09:21.471 INFO:teuthology.orchestra.run.smithi144.stdout:ragweed/tests/tests.py::r_test_multipart_defer_complete::test PASSED [ 44%] 2024-06-04T16:09:22.287 INFO:teuthology.orchestra.run.smithi144.stdout:ragweed/tests/tests.py::r_test_multipart_defer_update_complete::test PASSED [ 55%] 2024-06-04T16:09:28.427 INFO:teuthology.orchestra.run.smithi144.stdout:ragweed/tests/tests.py::r_test_obj_storage_class::test PASSED [ 66%] 2024-06-04T16:09:30.182 INFO:teuthology.orchestra.run.smithi144.stdout:ragweed/tests/tests.py::r_test_obj_storage_class_multipart::test PASSED [ 77%] 2024-06-04T16:09:32.421 INFO:teuthology.orchestra.run.smithi144.stdout:ragweed/tests/tests.py::r_test_obj_storage_class_copy::test PASSED [ 88%] 2024-06-04T16:09:35.794 INFO:teuthology.orchestra.run.smithi144.stdout:ragweed/tests/tests.py::r_test_obj_storage_class_multipart_copy::test PASSED [100%] 2024-06-04T16:09:35.794 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:09:35.794 INFO:teuthology.orchestra.run.smithi144.stdout:=============================== warnings summary =============================== 2024-06-04T16:09:35.794 INFO:teuthology.orchestra.run.smithi144.stdout:.tox/py/lib/python3.9/site-packages/boto/plugin.py:40 2024-06-04T16:09:35.794 INFO:teuthology.orchestra.run.smithi144.stdout: /home/ubuntu/cephtest/ragweed.client.0/.tox/py/lib/python3.9/site-packages/boto/plugin.py:40: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses 2024-06-04T16:09:35.794 INFO:teuthology.orchestra.run.smithi144.stdout: import imp 2024-06-04T16:09:35.794 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:09:35.794 INFO:teuthology.orchestra.run.smithi144.stdout:-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html 2024-06-04T16:09:35.794 INFO:teuthology.orchestra.run.smithi144.stdout:======================== 9 passed, 1 warning in 19.22s ========================= 2024-06-04T16:09:35.826 INFO:teuthology.orchestra.run.smithi144.stdout:___________________________________ summary ____________________________________ 2024-06-04T16:09:35.826 INFO:teuthology.orchestra.run.smithi144.stdout: py: commands succeeded 2024-06-04T16:09:35.826 INFO:teuthology.orchestra.run.smithi144.stdout: congratulations :) 2024-06-04T16:09:35.840 INFO:tasks.ragweed:Cleaning up boto... 2024-06-04T16:09:35.841 DEBUG:teuthology.orchestra.run.smithi144:> rm -f /home/ubuntu/cephtest/boto.cfg 2024-06-04T16:09:35.870 DEBUG:teuthology.orchestra.run.smithi144:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid ragweed.client.0 --purge-data 2024-06-04T16:09:35.969 INFO:teuthology.orchestra.run.smithi144.stderr:ignoring --setuser ceph since I am not root 2024-06-04T16:09:35.969 INFO:teuthology.orchestra.run.smithi144.stderr:ignoring --setgroup ceph since I am not root 2024-06-04T16:09:36.003 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.002+0000 7fadd0216800 20 rados->read ofs=0 len=0 2024-06-04T16:09:36.004 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.003+0000 7fadd0216800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:09:36.005 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.003+0000 7fadd0216800 20 realm 2024-06-04T16:09:36.005 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.003+0000 7fadd0216800 20 rados->read ofs=0 len=0 2024-06-04T16:09:36.005 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.004+0000 7fadd0216800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:09:36.005 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.004+0000 7fadd0216800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-06-04T16:09:36.005 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.004+0000 7fadd0216800 20 rados->read ofs=0 len=0 2024-06-04T16:09:36.005 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.004+0000 7fadd0216800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:09:36.005 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.004+0000 7fadd0216800 20 rados->read ofs=0 len=0 2024-06-04T16:09:36.005 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.005+0000 7fadd0216800 20 rados_obj.operate() r=0 bl.length=46 2024-06-04T16:09:36.005 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.005+0000 7fadd0216800 20 rados->read ofs=0 len=0 2024-06-04T16:09:36.006 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.005+0000 7fadd0216800 20 rados_obj.operate() r=0 bl.length=1139 2024-06-04T16:09:36.006 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.005+0000 7fadd0216800 20 searching for the correct realm 2024-06-04T16:09:36.008 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.008+0000 7fadcc07b640 0 -- 172.21.15.144:0/2847095715 >> [v2:172.21.15.144:6800/1453747520,v1:172.21.15.144:6801/1453747520] conn(0x7fadb4048410 msgr2=0x7fadb4048870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-06-04T16:09:36.214 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.213+0000 7fadcc07b640 0 -- 172.21.15.144:0/2847095715 >> [v2:172.21.15.144:6824/166159729,v1:172.21.15.144:6825/166159729] conn(0x562620ac9480 msgr2=0x562620acb870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-06-04T16:09:36.220 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.219+0000 7fadd0216800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-06-04T16:09:36.220 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.219+0000 7fadd0216800 20 RGWRados::pool_iterate: got zone_info.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767 2024-06-04T16:09:36.220 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.219+0000 7fadd0216800 20 RGWRados::pool_iterate: got default.zone. 2024-06-04T16:09:36.220 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.219+0000 7fadd0216800 20 RGWRados::pool_iterate: got zonegroup_info.abb22408-c332-4e28-8f7a-ff254ea2fed2 2024-06-04T16:09:36.220 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.219+0000 7fadd0216800 20 RGWRados::pool_iterate: got zone_names.default 2024-06-04T16:09:36.220 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.219+0000 7fadd0216800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-06-04T16:09:36.220 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.219+0000 7fadd0216800 20 rados->read ofs=0 len=0 2024-06-04T16:09:36.220 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.219+0000 7fadd0216800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:09:36.220 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.219+0000 7fadd0216800 20 rados->read ofs=0 len=0 2024-06-04T16:09:36.221 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.219+0000 7fadd0216800 20 rados_obj.operate() r=0 bl.length=46 2024-06-04T16:09:36.221 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.220+0000 7fadd0216800 20 rados->read ofs=0 len=0 2024-06-04T16:09:36.221 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.220+0000 7fadd0216800 20 rados_obj.operate() r=0 bl.length=470 2024-06-04T16:09:36.221 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.220+0000 7fadd0216800 20 zone default found 2024-06-04T16:09:36.221 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.220+0000 7fadd0216800 4 Realm: () 2024-06-04T16:09:36.221 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.220+0000 7fadd0216800 4 ZoneGroup: default (abb22408-c332-4e28-8f7a-ff254ea2fed2) 2024-06-04T16:09:36.222 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.220+0000 7fadd0216800 4 Zone: default (be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767) 2024-06-04T16:09:36.222 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.220+0000 7fadd0216800 10 cannot find current period zonegroup using local zonegroup configuration 2024-06-04T16:09:36.222 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.220+0000 7fadd0216800 20 zonegroup default 2024-06-04T16:09:36.222 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.220+0000 7fadd0216800 20 rados->read ofs=0 len=0 2024-06-04T16:09:36.222 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.220+0000 7fadd0216800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:09:36.222 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.220+0000 7fadd0216800 20 rados->read ofs=0 len=0 2024-06-04T16:09:36.222 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.221+0000 7fadd0216800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:09:36.223 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.221+0000 7fadd0216800 20 rados->read ofs=0 len=0 2024-06-04T16:09:36.223 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.221+0000 7fadd0216800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:09:36.223 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.221+0000 7fadd0216800 20 started sync module instance, tier type = 2024-06-04T16:09:36.223 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.221+0000 7fadd0216800 20 started zone id=be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767 (name=default) with tier type = 2024-06-04T16:09:36.232 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.231+0000 7fadd0216800 20 add_watcher() i=0 2024-06-04T16:09:36.232 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.231+0000 7fadd0216800 20 add_watcher() i=1 2024-06-04T16:09:36.232 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.231+0000 7fadd0216800 20 add_watcher() i=2 2024-06-04T16:09:36.233 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.231+0000 7fadd0216800 20 add_watcher() i=3 2024-06-04T16:09:36.233 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.231+0000 7fadd0216800 20 add_watcher() i=4 2024-06-04T16:09:36.233 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.231+0000 7fadd0216800 20 add_watcher() i=5 2024-06-04T16:09:36.233 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.231+0000 7fadd0216800 20 add_watcher() i=6 2024-06-04T16:09:36.233 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.232+0000 7fadd0216800 20 add_watcher() i=7 2024-06-04T16:09:36.233 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.232+0000 7fadd0216800 2 all 8 watchers are set, enabling cache 2024-06-04T16:09:36.235 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.234+0000 7fac81fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-06-04T16:09:36.235 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.234+0000 7fadd0216800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-06-04T16:09:36.235 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.234+0000 7fadd0216800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-06-04T16:09:36.272 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.271+0000 7fac80fe1640 20 reqs_thread_entry: start 2024-06-04T16:09:36.272 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.271+0000 7fadd0216800 20 init_complete bucket index max shards: 11 2024-06-04T16:09:36.272 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.271+0000 7fadd0216800 20 Filter name: none 2024-06-04T16:09:36.273 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.271+0000 7fabfa7fc640 20 reqs_thread_entry: start 2024-06-04T16:09:36.273 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.271+0000 7fadd0216800 10 cache get: name=default.rgw.meta+users.uid+ragweed.client.0 : miss 2024-06-04T16:09:36.273 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.271+0000 7fadd0216800 20 rados->read ofs=0 len=0 2024-06-04T16:09:36.273 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.271+0000 7fadd0216800 20 rados_obj.operate() r=0 bl.length=486 2024-06-04T16:09:36.273 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.271+0000 7fadd0216800 10 cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x13 2024-06-04T16:09:36.273 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.271+0000 7fadd0216800 10 adding default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2024-06-04T16:09:36.273 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.271+0000 7fadd0216800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-06-04T16:09:36.274 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.272+0000 7fadd0216800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-conf:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.4 : miss 2024-06-04T16:09:36.274 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.272+0000 7fadd0216800 20 rados->read ofs=0 len=0 2024-06-04T16:09:36.274 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.273+0000 7fadd0216800 20 rados_obj.operate() r=0 bl.length=418 2024-06-04T16:09:36.274 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.273+0000 7fadd0216800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-conf:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.4 info.flags=0x17 2024-06-04T16:09:36.274 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.273+0000 7fadd0216800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-conf:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.4 to cache LRU end 2024-06-04T16:09:36.274 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.273+0000 7fadd0216800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-06-04T16:09:36.274 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.273+0000 7fadd0216800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-06-04T16:09:36.274 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.273+0000 7fadd0216800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-conf:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.4 2024-06-04T16:09:36.275 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.274+0000 7fadd0216800 10 cls_bucket_list_unordered: got tests/r_test_obj_storage_class_multipart_copy 2024-06-04T16:09:36.275 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.274+0000 7fadd0216800 10 cls_bucket_list_unordered: got tests/r_test_multipart_index_versioning 2024-06-04T16:09:36.275 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.274+0000 7fadd0216800 10 cls_bucket_list_unordered: got tests/r_test_obj_storage_class_copy 2024-06-04T16:09:36.276 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.274+0000 7fadd0216800 10 cls_bucket_list_unordered: got tests/r_test_multipart_defer_update_complete 2024-06-04T16:09:36.276 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.275+0000 7fadd0216800 10 cls_bucket_list_unordered: got tests/r_test_multipart_defer_complete 2024-06-04T16:09:36.276 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.275+0000 7fadd0216800 10 cls_bucket_list_unordered: got tests/r_test_obj_storage_class 2024-06-04T16:09:36.276 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.275+0000 7fadd0216800 10 cls_bucket_list_unordered: got tests/r_test_multipart_simple 2024-06-04T16:09:36.277 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.276+0000 7fadd0216800 10 cls_bucket_list_unordered: got tests/r_test_obj_storage_class_multipart 2024-06-04T16:09:36.277 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.277+0000 7fadd0216800 10 cls_bucket_list_unordered: got tests/r_test_small_obj_data 2024-06-04T16:09:36.278 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.277+0000 7fadd0216800 20 get_obj_state: octx=0x7fadb402cbb0 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart_copy state=0x562620b8f1e8 s->prefetch_data=0 2024-06-04T16:09:36.278 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.278+0000 7fadd0216800 10 manifest: total_size = 7730 2024-06-04T16:09:36.278 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.278+0000 7fadd0216800 20 get_obj_state: setting s->obj_tag to be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.5088044311241052790 2024-06-04T16:09:36.279 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.278+0000 7fadd0216800 20 get_obj_state: octx=0x7fadb402cbb0 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart_copy state=0x562620b8f1e8 s->prefetch_data=0 2024-06-04T16:09:36.279 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.278+0000 7fadd0216800 20 prepare_atomic_modification: state is not atomic. state=0x562620b8f1e8 2024-06-04T16:09:36.279 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.278+0000 7fadd0216800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.4.1 2024-06-04T16:09:36.281 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.281+0000 7fadd0216800 20 get_obj_state: octx=0x7fadb402cbb0 obj=test-client.0-conf:tests/r_test_multipart_index_versioning state=0x562620b8f1c8 s->prefetch_data=0 2024-06-04T16:09:36.282 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.281+0000 7fadd0216800 10 manifest: total_size = 4889 2024-06-04T16:09:36.282 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.281+0000 7fadd0216800 20 get_obj_state: setting s->obj_tag to be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1119941193919759273 2024-06-04T16:09:36.282 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.281+0000 7fadd0216800 20 get_obj_state: octx=0x7fadb402cbb0 obj=test-client.0-conf:tests/r_test_multipart_index_versioning state=0x562620b8f1c8 s->prefetch_data=0 2024-06-04T16:09:36.282 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.281+0000 7fadd0216800 20 prepare_atomic_modification: state is not atomic. state=0x562620b8f1c8 2024-06-04T16:09:36.282 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.281+0000 7fadd0216800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.4.2 2024-06-04T16:09:36.283 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.282+0000 7facaaffd640 20 handle_completion(): completion ok for obj=tests/r_test_obj_storage_class_multipart_copy 2024-06-04T16:09:36.284 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.284+0000 7fadd0216800 20 get_obj_state: octx=0x7fadb402cbb0 obj=test-client.0-conf:tests/r_test_obj_storage_class_copy state=0x562620b8f158 s->prefetch_data=0 2024-06-04T16:09:36.285 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.284+0000 7fadd0216800 10 manifest: total_size = 5046 2024-06-04T16:09:36.285 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.284+0000 7fadd0216800 20 get_obj_state: setting s->obj_tag to be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.12645598352506417467 2024-06-04T16:09:36.285 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.284+0000 7fadd0216800 20 get_obj_state: octx=0x7fadb402cbb0 obj=test-client.0-conf:tests/r_test_obj_storage_class_copy state=0x562620b8f158 s->prefetch_data=0 2024-06-04T16:09:36.285 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.284+0000 7fadd0216800 20 prepare_atomic_modification: state is not atomic. state=0x562620b8f158 2024-06-04T16:09:36.285 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.284+0000 7fadd0216800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.4.2 2024-06-04T16:09:36.286 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.285+0000 7facaa7fc640 20 handle_completion(): completion ok for obj=tests/r_test_multipart_index_versioning 2024-06-04T16:09:36.288 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.287+0000 7fadd0216800 20 get_obj_state: octx=0x7fadb402cbb0 obj=test-client.0-conf:tests/r_test_multipart_defer_update_complete state=0x562620b8f158 s->prefetch_data=0 2024-06-04T16:09:36.288 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.287+0000 7fadd0216800 10 manifest: total_size = 5204 2024-06-04T16:09:36.288 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.287+0000 7fadd0216800 20 get_obj_state: setting s->obj_tag to be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.6826512058179968482 2024-06-04T16:09:36.288 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.287+0000 7fadd0216800 20 get_obj_state: octx=0x7fadb402cbb0 obj=test-client.0-conf:tests/r_test_multipart_defer_update_complete state=0x562620b8f158 s->prefetch_data=0 2024-06-04T16:09:36.288 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.287+0000 7fadd0216800 20 prepare_atomic_modification: state is not atomic. state=0x562620b8f158 2024-06-04T16:09:36.288 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.287+0000 7fadd0216800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.4.3 2024-06-04T16:09:36.290 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.289+0000 7facaaffd640 20 handle_completion(): completion ok for obj=tests/r_test_obj_storage_class_copy 2024-06-04T16:09:36.292 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.292+0000 7fadd0216800 20 get_obj_state: octx=0x7fadb402cbb0 obj=test-client.0-conf:tests/r_test_multipart_defer_complete state=0x562620b8f158 s->prefetch_data=0 2024-06-04T16:09:36.293 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.292+0000 7fadd0216800 10 manifest: total_size = 13114 2024-06-04T16:09:36.293 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.292+0000 7fadd0216800 20 get_obj_state: setting s->obj_tag to be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.13360217693099065265 2024-06-04T16:09:36.293 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.292+0000 7fadd0216800 20 get_obj_state: octx=0x7fadb402cbb0 obj=test-client.0-conf:tests/r_test_multipart_defer_complete state=0x562620b8f158 s->prefetch_data=0 2024-06-04T16:09:36.293 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.292+0000 7fadd0216800 20 prepare_atomic_modification: state is not atomic. state=0x562620b8f158 2024-06-04T16:09:36.293 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.292+0000 7fadd0216800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.4.4 2024-06-04T16:09:36.294 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.293+0000 7facaa7fc640 20 handle_completion(): completion ok for obj=tests/r_test_multipart_defer_update_complete 2024-06-04T16:09:36.295 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.295+0000 7fadd0216800 20 get_obj_state: octx=0x7fadb402cbb0 obj=test-client.0-conf:tests/r_test_obj_storage_class state=0x562620b8f158 s->prefetch_data=0 2024-06-04T16:09:36.296 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.295+0000 7fadd0216800 10 manifest: total_size = 5176 2024-06-04T16:09:36.296 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.295+0000 7fadd0216800 20 get_obj_state: setting s->obj_tag to be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.16379130787759802205 2024-06-04T16:09:36.296 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.295+0000 7fadd0216800 20 get_obj_state: octx=0x7fadb402cbb0 obj=test-client.0-conf:tests/r_test_obj_storage_class state=0x562620b8f158 s->prefetch_data=0 2024-06-04T16:09:36.296 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.295+0000 7fadd0216800 20 prepare_atomic_modification: state is not atomic. state=0x562620b8f158 2024-06-04T16:09:36.296 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.295+0000 7fadd0216800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.4.4 2024-06-04T16:09:36.297 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.296+0000 7facaaffd640 20 handle_completion(): completion ok for obj=tests/r_test_multipart_defer_complete 2024-06-04T16:09:36.299 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.298+0000 7fadd0216800 20 get_obj_state: octx=0x7fadb402cbb0 obj=test-client.0-conf:tests/r_test_multipart_simple state=0x562620b8f158 s->prefetch_data=0 2024-06-04T16:09:36.299 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.298+0000 7fadd0216800 10 manifest: total_size = 7417 2024-06-04T16:09:36.299 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.298+0000 7fadd0216800 20 get_obj_state: setting s->obj_tag to be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.17614795380135184315 2024-06-04T16:09:36.299 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.298+0000 7fadd0216800 20 get_obj_state: octx=0x7fadb402cbb0 obj=test-client.0-conf:tests/r_test_multipart_simple state=0x562620b8f158 s->prefetch_data=0 2024-06-04T16:09:36.299 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.298+0000 7fadd0216800 20 prepare_atomic_modification: state is not atomic. state=0x562620b8f158 2024-06-04T16:09:36.299 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.298+0000 7fadd0216800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.4.5 2024-06-04T16:09:36.299 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.299+0000 7facaa7fc640 20 handle_completion(): completion ok for obj=tests/r_test_obj_storage_class 2024-06-04T16:09:36.301 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.300+0000 7fadd0216800 20 get_obj_state: octx=0x7fadb402ccc0 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart state=0x562620b8f158 s->prefetch_data=0 2024-06-04T16:09:36.301 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.301+0000 7fadd0216800 10 manifest: total_size = 5178 2024-06-04T16:09:36.302 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.301+0000 7fadd0216800 20 get_obj_state: setting s->obj_tag to be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.11464476822754852233 2024-06-04T16:09:36.302 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.301+0000 7fadd0216800 20 get_obj_state: octx=0x7fadb402ccc0 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart state=0x562620b8f158 s->prefetch_data=0 2024-06-04T16:09:36.302 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.301+0000 7fadd0216800 20 prepare_atomic_modification: state is not atomic. state=0x562620b8f158 2024-06-04T16:09:36.302 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.301+0000 7fadd0216800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.4.7 2024-06-04T16:09:36.302 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.302+0000 7facaaffd640 20 handle_completion(): completion ok for obj=tests/r_test_multipart_simple 2024-06-04T16:09:36.304 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.303+0000 7fadd0216800 20 get_obj_state: octx=0x7fadb402cbb0 obj=test-client.0-conf:tests/r_test_small_obj_data state=0x562620b8f158 s->prefetch_data=0 2024-06-04T16:09:36.304 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.304+0000 7fadd0216800 10 manifest: total_size = 7770 2024-06-04T16:09:36.304 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.304+0000 7fadd0216800 20 get_obj_state: setting s->obj_tag to be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.11018448419728512128 2024-06-04T16:09:36.305 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.304+0000 7fadd0216800 20 get_obj_state: octx=0x7fadb402cbb0 obj=test-client.0-conf:tests/r_test_small_obj_data state=0x562620b8f158 s->prefetch_data=0 2024-06-04T16:09:36.305 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.304+0000 7fadd0216800 20 prepare_atomic_modification: state is not atomic. state=0x562620b8f158 2024-06-04T16:09:36.305 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.304+0000 7fadd0216800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.4.8 2024-06-04T16:09:36.305 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.305+0000 7facaa7fc640 20 handle_completion(): completion ok for obj=tests/r_test_obj_storage_class_multipart 2024-06-04T16:09:36.307 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.306+0000 7fadd0216800 20 list_objects_ordered: starting attempt 1 2024-06-04T16:09:36.307 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.307+0000 7fadd0216800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-06-04T16:09:36.309 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.308+0000 7facaaffd640 20 handle_completion(): completion ok for obj=tests/r_test_small_obj_data 2024-06-04T16:09:36.309 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.308+0000 7fadd0216800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-06-04T16:09:36.309 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.308+0000 7fadd0216800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-06-04T16:09:36.309 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.308+0000 7fadd0216800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-06-04T16:09:36.310 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.308+0000 7fadd0216800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-06-04T16:09:36.310 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.308+0000 7fadd0216800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-conf[be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.4])"; uploads.size()=0; is_truncated=0 2024-06-04T16:09:36.311 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.310+0000 7fadd0216800 10 cache get: name=default.rgw.meta+root+test-client.0-conf : miss 2024-06-04T16:09:36.311 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.310+0000 7fadd0216800 20 rados->read ofs=0 len=0 2024-06-04T16:09:36.311 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.310+0000 7fadd0216800 20 rados_obj.operate() r=0 bl.length=204 2024-06-04T16:09:36.311 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.310+0000 7fadd0216800 10 cache put: name=default.rgw.meta+root+test-client.0-conf info.flags=0x11 2024-06-04T16:09:36.311 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.310+0000 7fadd0216800 10 adding default.rgw.meta+root+test-client.0-conf to cache LRU end 2024-06-04T16:09:36.312 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.311+0000 7fadd0216800 10 removing default.rgw.meta+root+test-client.0-conf from cache 2024-06-04T16:09:36.312 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.311+0000 7fadd0216800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-conf, ofs0, ns] 2024-06-04T16:09:36.312 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.312+0000 7facaa7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1078036791313 cookie 94721756935216 notifier 5600 bl.length()=162 2024-06-04T16:09:36.314 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.314+0000 7fadd0216800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-conf:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.4 from cache 2024-06-04T16:09:36.315 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.314+0000 7fadd0216800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-conf:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.4, ofs0, ns] 2024-06-04T16:09:36.315 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.314+0000 7facaaffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1078036791369 cookie 94721756964496 notifier 5600 bl.length()=219 2024-06-04T16:09:36.318 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.317+0000 7fadd0216800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-conf/be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.4 : miss 2024-06-04T16:09:36.318 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.317+0000 7fadd0216800 20 rados->read ofs=0 len=0 2024-06-04T16:09:36.318 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.317+0000 7fadd0216800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:09:36.318 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.317+0000 7fadd0216800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-conf/be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.4 info.flags=0x0 2024-06-04T16:09:36.318 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.317+0000 7fadd0216800 10 adding default.rgw.log++pubsub..bucket.test-client.0-conf/be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.4 to cache LRU end 2024-06-04T16:09:36.320 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.319+0000 7fadd0216800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.11 : miss 2024-06-04T16:09:36.320 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.319+0000 7fadd0216800 20 rados->read ofs=0 len=0 2024-06-04T16:09:36.321 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.320+0000 7fadd0216800 20 rados_obj.operate() r=0 bl.length=449 2024-06-04T16:09:36.321 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.320+0000 7fadd0216800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.11 info.flags=0x17 2024-06-04T16:09:36.321 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.320+0000 7fadd0216800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.11 to cache LRU end 2024-06-04T16:09:36.321 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.320+0000 7fadd0216800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-06-04T16:09:36.321 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.320+0000 7fadd0216800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-06-04T16:09:36.321 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.320+0000 7fadd0216800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.11 2024-06-04T16:09:36.324 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.324+0000 7fadd0216800 10 cls_bucket_list_unordered: got foo 2024-06-04T16:09:36.324 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.324+0000 7fadd0216800 20 get_obj_state: octx=0x562620b13730 obj=test-client.0-r-test-multipart-defer-complete.1:foo state=0x562620b12bb8 s->prefetch_data=0 2024-06-04T16:09:36.325 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.324+0000 7fadd0216800 10 manifest: total_size = 886297 2024-06-04T16:09:36.325 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.324+0000 7fadd0216800 20 get_obj_state: setting s->obj_tag to be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.10522384710002003206 2024-06-04T16:09:36.325 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.324+0000 7fadd0216800 20 get_obj_state: octx=0x562620b13730 obj=test-client.0-r-test-multipart-defer-complete.1:foo state=0x562620b12bb8 s->prefetch_data=0 2024-06-04T16:09:36.325 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.324+0000 7fadd0216800 20 prepare_atomic_modification: state is not atomic. state=0x562620b12bb8 2024-06-04T16:09:36.325 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.324+0000 7fadd0216800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.11.10 2024-06-04T16:09:36.327 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.327+0000 7fadd0216800 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2024-06-04T16:09:36.328 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.327+0000 7fadd0216800 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=246247 2024-06-04T16:09:36.328 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.327+0000 7fadd0216800 20 RGWObjManifest::operator++(): result: ofs=246247 stripe_ofs=246247 part_ofs=246247 rule->part_size=246247 2024-06-04T16:09:36.328 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.327+0000 7fadd0216800 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2024-06-04T16:09:36.328 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.327+0000 7fadd0216800 20 RGWObjManifest::operator++(): stripe_ofs=4440551 part_ofs=246247 rule->part_size=246247 2024-06-04T16:09:36.328 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.327+0000 7fadd0216800 20 RGWObjManifest::operator++(): result: ofs=492494 stripe_ofs=492494 part_ofs=492494 rule->part_size=246247 2024-06-04T16:09:36.328 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.327+0000 7fadd0216800 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2024-06-04T16:09:36.328 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.327+0000 7fadd0216800 20 RGWObjManifest::operator++(): stripe_ofs=4686798 part_ofs=492494 rule->part_size=246247 2024-06-04T16:09:36.328 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.327+0000 7fadd0216800 20 RGWObjManifest::operator++(): result: ofs=738741 stripe_ofs=738741 part_ofs=738741 rule->part_size=147556 2024-06-04T16:09:36.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.327+0000 7fadd0216800 20 RGWObjManifest::operator++(): rule->part_size=147556 rules.size()=2 2024-06-04T16:09:36.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.327+0000 7fadd0216800 20 RGWObjManifest::operator++(): stripe_ofs=4933045 part_ofs=738741 rule->part_size=147556 2024-06-04T16:09:36.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.327+0000 7fadd0216800 20 RGWObjManifest::operator++(): result: ofs=886297 stripe_ofs=886297 part_ofs=886297 rule->part_size=147556 2024-06-04T16:09:36.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.327+0000 7fadd0216800 20 garbage collection: RGWGC::send_split_chain - tag is: be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.10522384710002003206 2024-06-04T16:09:36.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.327+0000 7fadd0216800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-06-04T16:09:36.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.327+0000 7fadd0216800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.11__multipart_foo.2~FtMAjISn4-tikF0udJCpeZ_yZbFyG3g.1 2024-06-04T16:09:36.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.327+0000 7fadd0216800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 347 2024-06-04T16:09:36.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.327+0000 7fadd0216800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.11__multipart_foo.2~FtMAjISn4-tikF0udJCpeZ_yZbFyG3g.2 2024-06-04T16:09:36.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.327+0000 7fadd0216800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 593 2024-06-04T16:09:36.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.327+0000 7fadd0216800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.11__multipart_foo.2~FtMAjISn4-tikF0udJCpeZ_yZbFyG3g.3 2024-06-04T16:09:36.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.327+0000 7fadd0216800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 839 2024-06-04T16:09:36.331 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.327+0000 7fadd0216800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.11__multipart_foo.2~FtMAjISn4-tikF0udJCpeZ_yZbFyG3g.4 2024-06-04T16:09:36.331 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.327+0000 7fadd0216800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1085 2024-06-04T16:09:36.331 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.327+0000 7fadd0216800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-06-04T16:09:36.331 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.327+0000 7fadd0216800 20 garbage collection: RGWGC::send_chain - on object name: gc.9tag is: be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.10522384710002003206 2024-06-04T16:09:36.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.328+0000 7facaaffd640 20 handle_completion(): completion ok for obj=foo 2024-06-04T16:09:36.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.328+0000 7fadd0216800 20 list_objects_ordered: starting attempt 1 2024-06-04T16:09:36.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.328+0000 7fadd0216800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-06-04T16:09:36.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.329+0000 7fadd0216800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-06-04T16:09:36.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.329+0000 7fadd0216800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-06-04T16:09:36.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.329+0000 7fadd0216800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-06-04T16:09:36.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.329+0000 7fadd0216800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-06-04T16:09:36.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.329+0000 7fadd0216800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-defer-complete.1[be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.11])"; uploads.size()=0; is_truncated=0 2024-06-04T16:09:36.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.331+0000 7fadd0216800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 : miss 2024-06-04T16:09:36.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.331+0000 7fadd0216800 20 rados->read ofs=0 len=0 2024-06-04T16:09:36.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.331+0000 7fadd0216800 20 rados_obj.operate() r=0 bl.length=235 2024-06-04T16:09:36.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.331+0000 7fadd0216800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 info.flags=0x11 2024-06-04T16:09:36.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.331+0000 7fadd0216800 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 to cache LRU end 2024-06-04T16:09:36.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.332+0000 7fadd0216800 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 from cache 2024-06-04T16:09:36.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.332+0000 7fadd0216800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-multipart-defer-complete.1, ofs0, ns] 2024-06-04T16:09:36.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.332+0000 7facaaffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1078036791369 cookie 94721756963440 notifier 5600 bl.length()=191 2024-06-04T16:09:36.335 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.334+0000 7fadd0216800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.11 from cache 2024-06-04T16:09:36.335 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.334+0000 7fadd0216800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.11, ofs0, ns] 2024-06-04T16:09:36.335 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.334+0000 7facaa7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1078036791370 cookie 94721756972944 notifier 5600 bl.length()=249 2024-06-04T16:09:36.338 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.337+0000 7fadd0216800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-complete.1/be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.11 : miss 2024-06-04T16:09:36.338 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.337+0000 7fadd0216800 20 rados->read ofs=0 len=0 2024-06-04T16:09:36.338 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.337+0000 7fadd0216800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:09:36.338 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.337+0000 7fadd0216800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-complete.1/be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.11 info.flags=0x0 2024-06-04T16:09:36.338 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.337+0000 7fadd0216800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-complete.1/be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.11 to cache LRU end 2024-06-04T16:09:36.340 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.339+0000 7fadd0216800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.12 : miss 2024-06-04T16:09:36.340 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.339+0000 7fadd0216800 20 rados->read ofs=0 len=0 2024-06-04T16:09:36.340 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.340+0000 7fadd0216800 20 rados_obj.operate() r=0 bl.length=456 2024-06-04T16:09:36.341 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.340+0000 7fadd0216800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.12 info.flags=0x17 2024-06-04T16:09:36.341 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.340+0000 7fadd0216800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.12 to cache LRU end 2024-06-04T16:09:36.341 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.340+0000 7fadd0216800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-06-04T16:09:36.341 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.340+0000 7fadd0216800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-06-04T16:09:36.341 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.340+0000 7fadd0216800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.12 2024-06-04T16:09:36.345 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.343+0000 7fadd0216800 10 cls_bucket_list_unordered: got foo 2024-06-04T16:09:36.345 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.343+0000 7fadd0216800 20 get_obj_state: octx=0x562620b17dd0 obj=test-client.0-r-test-multipart-defer-update-complete.1:foo state=0x562620b126a8 s->prefetch_data=0 2024-06-04T16:09:36.345 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.344+0000 7fadd0216800 10 manifest: total_size = 886297 2024-06-04T16:09:36.345 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.344+0000 7fadd0216800 20 get_obj_state: setting s->obj_tag to be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.14773477925080379115 2024-06-04T16:09:36.345 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.344+0000 7fadd0216800 20 get_obj_state: octx=0x562620b17dd0 obj=test-client.0-r-test-multipart-defer-update-complete.1:foo state=0x562620b126a8 s->prefetch_data=0 2024-06-04T16:09:36.346 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.344+0000 7fadd0216800 20 prepare_atomic_modification: state is not atomic. state=0x562620b126a8 2024-06-04T16:09:36.346 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.344+0000 7fadd0216800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.12.10 2024-06-04T16:09:36.348 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.346+0000 7fadd0216800 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2024-06-04T16:09:36.348 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.346+0000 7fadd0216800 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=246247 2024-06-04T16:09:36.348 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.346+0000 7fadd0216800 20 RGWObjManifest::operator++(): result: ofs=246247 stripe_ofs=246247 part_ofs=246247 rule->part_size=246247 2024-06-04T16:09:36.348 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.346+0000 7fadd0216800 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2024-06-04T16:09:36.348 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.346+0000 7fadd0216800 20 RGWObjManifest::operator++(): stripe_ofs=4440551 part_ofs=246247 rule->part_size=246247 2024-06-04T16:09:36.349 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.346+0000 7fadd0216800 20 RGWObjManifest::operator++(): result: ofs=492494 stripe_ofs=492494 part_ofs=492494 rule->part_size=246247 2024-06-04T16:09:36.349 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.346+0000 7fadd0216800 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2024-06-04T16:09:36.349 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.346+0000 7fadd0216800 20 RGWObjManifest::operator++(): stripe_ofs=4686798 part_ofs=492494 rule->part_size=246247 2024-06-04T16:09:36.349 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.346+0000 7fadd0216800 20 RGWObjManifest::operator++(): result: ofs=738741 stripe_ofs=738741 part_ofs=738741 rule->part_size=147556 2024-06-04T16:09:36.349 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.346+0000 7fadd0216800 20 RGWObjManifest::operator++(): rule->part_size=147556 rules.size()=2 2024-06-04T16:09:36.349 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.346+0000 7fadd0216800 20 RGWObjManifest::operator++(): stripe_ofs=4933045 part_ofs=738741 rule->part_size=147556 2024-06-04T16:09:36.349 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.346+0000 7fadd0216800 20 RGWObjManifest::operator++(): result: ofs=886297 stripe_ofs=886297 part_ofs=886297 rule->part_size=147556 2024-06-04T16:09:36.349 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.346+0000 7fadd0216800 20 garbage collection: RGWGC::send_split_chain - tag is: be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.14773477925080379115 2024-06-04T16:09:36.349 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.346+0000 7fadd0216800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-06-04T16:09:36.349 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.346+0000 7fadd0216800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.12__multipart_foo.2~F9RQEBgw4ueHwJew9KY_l-_LJWGSSsw.1 2024-06-04T16:09:36.349 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.346+0000 7fadd0216800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 347 2024-06-04T16:09:36.349 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.346+0000 7fadd0216800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.12__multipart_foo.2~F9RQEBgw4ueHwJew9KY_l-_LJWGSSsw.2 2024-06-04T16:09:36.350 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.346+0000 7fadd0216800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 593 2024-06-04T16:09:36.350 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.346+0000 7fadd0216800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.12__multipart_foo.2~F9RQEBgw4ueHwJew9KY_l-_LJWGSSsw.3 2024-06-04T16:09:36.350 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.346+0000 7fadd0216800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 839 2024-06-04T16:09:36.350 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.346+0000 7fadd0216800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.12__multipart_foo.2~F9RQEBgw4ueHwJew9KY_l-_LJWGSSsw.4 2024-06-04T16:09:36.350 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.346+0000 7fadd0216800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1085 2024-06-04T16:09:36.350 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.346+0000 7fadd0216800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-06-04T16:09:36.350 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.346+0000 7fadd0216800 20 garbage collection: RGWGC::send_chain - on object name: gc.3tag is: be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.14773477925080379115 2024-06-04T16:09:36.351 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.348+0000 7facaa7fc640 20 handle_completion(): completion ok for obj=foo 2024-06-04T16:09:36.351 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.348+0000 7fadd0216800 20 list_objects_ordered: starting attempt 1 2024-06-04T16:09:36.351 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.348+0000 7fadd0216800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-06-04T16:09:36.352 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.348+0000 7fadd0216800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-06-04T16:09:36.352 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.348+0000 7fadd0216800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-06-04T16:09:36.352 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.348+0000 7fadd0216800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-06-04T16:09:36.352 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.348+0000 7fadd0216800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-06-04T16:09:36.352 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.348+0000 7fadd0216800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-defer-update-complete.1[be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.12])"; uploads.size()=0; is_truncated=0 2024-06-04T16:09:36.352 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.350+0000 7fadd0216800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 : miss 2024-06-04T16:09:36.352 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.350+0000 7fadd0216800 20 rados->read ofs=0 len=0 2024-06-04T16:09:36.352 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.350+0000 7fadd0216800 20 rados_obj.operate() r=0 bl.length=242 2024-06-04T16:09:36.352 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.350+0000 7fadd0216800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 info.flags=0x11 2024-06-04T16:09:36.352 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.350+0000 7fadd0216800 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 to cache LRU end 2024-06-04T16:09:36.353 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.351+0000 7fadd0216800 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 from cache 2024-06-04T16:09:36.353 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.351+0000 7fadd0216800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-multipart-defer-update-complete.1, ofs0, ns] 2024-06-04T16:09:36.353 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.352+0000 7facaaffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1078036791310 cookie 94721756967088 notifier 5600 bl.length()=198 2024-06-04T16:09:36.354 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.353+0000 7fadd0216800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.12 from cache 2024-06-04T16:09:36.354 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.353+0000 7fadd0216800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.12, ofs0, ns] 2024-06-04T16:09:36.354 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.354+0000 7facaa7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1078036791371 cookie 94721756963440 notifier 5600 bl.length()=256 2024-06-04T16:09:36.357 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.356+0000 7fadd0216800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-update-complete.1/be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.12 : miss 2024-06-04T16:09:36.357 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.356+0000 7fadd0216800 20 rados->read ofs=0 len=0 2024-06-04T16:09:36.357 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.356+0000 7fadd0216800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:09:36.357 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.356+0000 7fadd0216800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-update-complete.1/be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.12 info.flags=0x0 2024-06-04T16:09:36.357 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.356+0000 7fadd0216800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-update-complete.1/be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.12 to cache LRU end 2024-06-04T16:09:36.359 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.358+0000 7fadd0216800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.10 : miss 2024-06-04T16:09:36.359 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.358+0000 7fadd0216800 20 rados->read ofs=0 len=0 2024-06-04T16:09:36.360 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.359+0000 7fadd0216800 20 rados_obj.operate() r=0 bl.length=451 2024-06-04T16:09:36.360 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.359+0000 7fadd0216800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.10 info.flags=0x17 2024-06-04T16:09:36.360 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.359+0000 7fadd0216800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.10 to cache LRU end 2024-06-04T16:09:36.360 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.359+0000 7fadd0216800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-06-04T16:09:36.360 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.359+0000 7fadd0216800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-06-04T16:09:36.360 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.359+0000 7fadd0216800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.10 2024-06-04T16:09:36.363 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.362+0000 7fadd0216800 10 cls_bucket_list_unordered: got foo[tSpqOEPwxa281pZDblyn0dumFA8YAOh] 2024-06-04T16:09:36.363 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.362+0000 7fadd0216800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.10.10 2024-06-04T16:09:36.364 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.363+0000 7fadd0216800 20 get_obj_state: octx=0x562620b17b20 obj=test-client.0-r-test-multipart-index-versioning.1:foo state=0x562620b126a8 s->prefetch_data=0 2024-06-04T16:09:36.364 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.363+0000 7fadd0216800 20 get_obj_state: setting s->obj_tag to 8owriqzg7hc5djgmqxavnk0bj5z9h1n0 2024-06-04T16:09:36.364 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.363+0000 7fadd0216800 20 get_obj_state_impl: setting s->olh_tag to 700qhr8dy962tff01xpn7kut1aclei2r 2024-06-04T16:09:36.364 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.363+0000 7fadd0216800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=700qhr8dy962tff01xpn7kut1aclei2r 2024-06-04T16:09:36.365 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.364+0000 7fadd0216800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.10.10 2024-06-04T16:09:36.367 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.366+0000 7fadd0216800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.10.10 2024-06-04T16:09:36.367 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.366+0000 7fadd0216800 20 olh_log_entry: epoch=3 op=2 key=foo[] 2024-06-04T16:09:36.367 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.366+0000 7fadd0216800 20 olh_log_entry: epoch=3 op=3 key=foo[tSpqOEPwxa281pZDblyn0dumFA8YAOh] 2024-06-04T16:09:36.367 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.366+0000 7fadd0216800 20 get_obj_state: octx=0x562620b17b20 obj=test-client.0-r-test-multipart-index-versioning.1:_:tSpqOEPwxa281pZDblyn0dumFA8YAOh_foo state=0x562620b8ec48 s->prefetch_data=0 2024-06-04T16:09:36.368 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.366+0000 7fadd0216800 10 manifest: total_size = 74198 2024-06-04T16:09:36.368 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.366+0000 7fadd0216800 20 get_obj_state: setting s->obj_tag to be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.17955365544246902861 2024-06-04T16:09:36.368 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.366+0000 7fadd0216800 20 get_obj_state: octx=0x562620b17b20 obj=test-client.0-r-test-multipart-index-versioning.1:_:tSpqOEPwxa281pZDblyn0dumFA8YAOh_foo state=0x562620b8ec48 s->prefetch_data=0 2024-06-04T16:09:36.368 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.366+0000 7fadd0216800 20 prepare_atomic_modification: state is not atomic. state=0x562620b8ec48 2024-06-04T16:09:36.368 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.366+0000 7fadd0216800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.10.10 2024-06-04T16:09:36.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.369+0000 7fadd0216800 20 RGWObjManifest::operator++(): rule->part_size=20613 rules.size()=2 2024-06-04T16:09:36.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.369+0000 7fadd0216800 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=20613 2024-06-04T16:09:36.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.369+0000 7fadd0216800 20 RGWObjManifest::operator++(): result: ofs=20613 stripe_ofs=20613 part_ofs=20613 rule->part_size=20613 2024-06-04T16:09:36.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.369+0000 7fadd0216800 20 RGWObjManifest::operator++(): rule->part_size=20613 rules.size()=2 2024-06-04T16:09:36.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.369+0000 7fadd0216800 20 RGWObjManifest::operator++(): stripe_ofs=4214917 part_ofs=20613 rule->part_size=20613 2024-06-04T16:09:36.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.369+0000 7fadd0216800 20 RGWObjManifest::operator++(): result: ofs=41226 stripe_ofs=41226 part_ofs=41226 rule->part_size=20613 2024-06-04T16:09:36.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.369+0000 7fadd0216800 20 RGWObjManifest::operator++(): rule->part_size=20613 rules.size()=2 2024-06-04T16:09:36.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.369+0000 7fadd0216800 20 RGWObjManifest::operator++(): stripe_ofs=4235530 part_ofs=41226 rule->part_size=20613 2024-06-04T16:09:36.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.369+0000 7fadd0216800 20 RGWObjManifest::operator++(): result: ofs=61839 stripe_ofs=61839 part_ofs=61839 rule->part_size=12359 2024-06-04T16:09:36.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.369+0000 7fadd0216800 20 RGWObjManifest::operator++(): rule->part_size=12359 rules.size()=2 2024-06-04T16:09:36.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.369+0000 7fadd0216800 20 RGWObjManifest::operator++(): stripe_ofs=4256143 part_ofs=61839 rule->part_size=12359 2024-06-04T16:09:36.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.369+0000 7fadd0216800 20 RGWObjManifest::operator++(): result: ofs=74198 stripe_ofs=74198 part_ofs=74198 rule->part_size=12359 2024-06-04T16:09:36.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.369+0000 7fadd0216800 20 garbage collection: RGWGC::send_split_chain - tag is: be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.17955365544246902861 2024-06-04T16:09:36.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.369+0000 7fadd0216800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-06-04T16:09:36.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.369+0000 7fadd0216800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.10__multipart_foo.2~Y7vtrf-Gd6m-eNBlibsSA1ksskix6cx.1 2024-06-04T16:09:36.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.369+0000 7fadd0216800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 347 2024-06-04T16:09:36.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.369+0000 7fadd0216800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.10__multipart_foo.2~Y7vtrf-Gd6m-eNBlibsSA1ksskix6cx.2 2024-06-04T16:09:36.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.369+0000 7fadd0216800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 593 2024-06-04T16:09:36.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.369+0000 7fadd0216800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.10__multipart_foo.2~Y7vtrf-Gd6m-eNBlibsSA1ksskix6cx.3 2024-06-04T16:09:36.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.369+0000 7fadd0216800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 839 2024-06-04T16:09:36.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.369+0000 7fadd0216800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.10__multipart_foo.2~Y7vtrf-Gd6m-eNBlibsSA1ksskix6cx.4 2024-06-04T16:09:36.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.369+0000 7fadd0216800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1085 2024-06-04T16:09:36.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.369+0000 7fadd0216800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-06-04T16:09:36.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.369+0000 7fadd0216800 20 garbage collection: RGWGC::send_chain - on object name: gc.29tag is: be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.17955365544246902861 2024-06-04T16:09:36.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.370+0000 7facaa7fc640 20 handle_completion(): completion ok for obj=foo[tSpqOEPwxa281pZDblyn0dumFA8YAOh] 2024-06-04T16:09:36.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.371+0000 7fadd0216800 20 get_obj_state: octx=0x562620b17b20 obj=test-client.0-r-test-multipart-index-versioning.1:foo state=0x562620b126a8 s->prefetch_data=0 2024-06-04T16:09:36.373 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.372+0000 7fadd0216800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.10.10 2024-06-04T16:09:36.374 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.373+0000 7fadd0216800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.10.10 2024-06-04T16:09:36.374 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.373+0000 7fadd0216800 20 list_objects_ordered: starting attempt 1 2024-06-04T16:09:36.374 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.373+0000 7fadd0216800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-06-04T16:09:36.375 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.374+0000 7fadd0216800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-06-04T16:09:36.375 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.374+0000 7fadd0216800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-06-04T16:09:36.375 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.374+0000 7fadd0216800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-06-04T16:09:36.375 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.374+0000 7fadd0216800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-06-04T16:09:36.375 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.374+0000 7fadd0216800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-index-versioning.1[be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.10])"; uploads.size()=0; is_truncated=0 2024-06-04T16:09:36.376 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.376+0000 7fadd0216800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 : miss 2024-06-04T16:09:36.376 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.376+0000 7fadd0216800 20 rados->read ofs=0 len=0 2024-06-04T16:09:36.377 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.376+0000 7fadd0216800 20 rados_obj.operate() r=0 bl.length=237 2024-06-04T16:09:36.377 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.376+0000 7fadd0216800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 info.flags=0x11 2024-06-04T16:09:36.377 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.376+0000 7fadd0216800 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 to cache LRU end 2024-06-04T16:09:36.378 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.377+0000 7fadd0216800 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 from cache 2024-06-04T16:09:36.378 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.377+0000 7fadd0216800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-multipart-index-versioning.1, ofs0, ns] 2024-06-04T16:09:36.378 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.377+0000 7facaaffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1078036791311 cookie 94721756967088 notifier 5600 bl.length()=193 2024-06-04T16:09:36.380 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.379+0000 7fadd0216800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.10 from cache 2024-06-04T16:09:36.380 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.379+0000 7fadd0216800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.10, ofs0, ns] 2024-06-04T16:09:36.380 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.379+0000 7facaa7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1078036791370 cookie 94721756975760 notifier 5600 bl.length()=251 2024-06-04T16:09:36.382 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.382+0000 7fadd0216800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-index-versioning.1/be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.10 : miss 2024-06-04T16:09:36.383 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.382+0000 7fadd0216800 20 rados->read ofs=0 len=0 2024-06-04T16:09:36.383 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.382+0000 7fadd0216800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:09:36.383 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.382+0000 7fadd0216800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-index-versioning.1/be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.10 info.flags=0x0 2024-06-04T16:09:36.383 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.382+0000 7fadd0216800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-index-versioning.1/be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.10 to cache LRU end 2024-06-04T16:09:36.384 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.384+0000 7fadd0216800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.9 : miss 2024-06-04T16:09:36.385 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.384+0000 7fadd0216800 20 rados->read ofs=0 len=0 2024-06-04T16:09:36.385 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.384+0000 7fadd0216800 20 rados_obj.operate() r=0 bl.length=439 2024-06-04T16:09:36.385 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.384+0000 7fadd0216800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.9 info.flags=0x17 2024-06-04T16:09:36.385 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.384+0000 7fadd0216800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.9 to cache LRU end 2024-06-04T16:09:36.385 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.384+0000 7fadd0216800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-06-04T16:09:36.385 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.384+0000 7fadd0216800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-06-04T16:09:36.385 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.384+0000 7fadd0216800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.9 2024-06-04T16:09:36.389 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.388+0000 7fadd0216800 10 cls_bucket_list_unordered: got foo 2024-06-04T16:09:36.389 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.388+0000 7fadd0216800 20 get_obj_state: octx=0x562620b1a850 obj=test-client.0-r-test-multipart-simple.1:foo state=0x562620b8ec48 s->prefetch_data=0 2024-06-04T16:09:36.389 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.389+0000 7fadd0216800 10 manifest: total_size = 1667 2024-06-04T16:09:36.390 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.389+0000 7fadd0216800 20 get_obj_state: setting s->obj_tag to be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.11735943295640401781 2024-06-04T16:09:36.390 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.389+0000 7fadd0216800 20 get_obj_state: octx=0x562620b1a850 obj=test-client.0-r-test-multipart-simple.1:foo state=0x562620b8ec48 s->prefetch_data=0 2024-06-04T16:09:36.390 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.389+0000 7fadd0216800 20 prepare_atomic_modification: state is not atomic. state=0x562620b8ec48 2024-06-04T16:09:36.390 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.389+0000 7fadd0216800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.9.10 2024-06-04T16:09:36.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.391+0000 7fadd0216800 20 RGWObjManifest::operator++(): rule->part_size=516 rules.size()=2 2024-06-04T16:09:36.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.391+0000 7fadd0216800 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=516 2024-06-04T16:09:36.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.391+0000 7fadd0216800 20 RGWObjManifest::operator++(): result: ofs=516 stripe_ofs=516 part_ofs=516 rule->part_size=516 2024-06-04T16:09:36.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.391+0000 7fadd0216800 20 RGWObjManifest::operator++(): rule->part_size=516 rules.size()=2 2024-06-04T16:09:36.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.391+0000 7fadd0216800 20 RGWObjManifest::operator++(): stripe_ofs=4194820 part_ofs=516 rule->part_size=516 2024-06-04T16:09:36.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.391+0000 7fadd0216800 20 RGWObjManifest::operator++(): result: ofs=1032 stripe_ofs=1032 part_ofs=1032 rule->part_size=516 2024-06-04T16:09:36.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.391+0000 7fadd0216800 20 RGWObjManifest::operator++(): rule->part_size=516 rules.size()=2 2024-06-04T16:09:36.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.391+0000 7fadd0216800 20 RGWObjManifest::operator++(): stripe_ofs=4195336 part_ofs=1032 rule->part_size=516 2024-06-04T16:09:36.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.391+0000 7fadd0216800 20 RGWObjManifest::operator++(): result: ofs=1548 stripe_ofs=1548 part_ofs=1548 rule->part_size=119 2024-06-04T16:09:36.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.391+0000 7fadd0216800 20 RGWObjManifest::operator++(): rule->part_size=119 rules.size()=2 2024-06-04T16:09:36.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.391+0000 7fadd0216800 20 RGWObjManifest::operator++(): stripe_ofs=4195852 part_ofs=1548 rule->part_size=119 2024-06-04T16:09:36.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.391+0000 7fadd0216800 20 RGWObjManifest::operator++(): result: ofs=1667 stripe_ofs=1667 part_ofs=1667 rule->part_size=119 2024-06-04T16:09:36.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.391+0000 7fadd0216800 20 garbage collection: RGWGC::send_split_chain - tag is: be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.11735943295640401781 2024-06-04T16:09:36.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.391+0000 7fadd0216800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-06-04T16:09:36.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.391+0000 7fadd0216800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.9__multipart_foo.2~LZjwLUgNEeDATXkOnRRuxQuN4KeNLE5.1 2024-06-04T16:09:36.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.391+0000 7fadd0216800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 345 2024-06-04T16:09:36.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.391+0000 7fadd0216800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.9__multipart_foo.2~LZjwLUgNEeDATXkOnRRuxQuN4KeNLE5.2 2024-06-04T16:09:36.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.391+0000 7fadd0216800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 589 2024-06-04T16:09:36.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.391+0000 7fadd0216800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.9__multipart_foo.2~LZjwLUgNEeDATXkOnRRuxQuN4KeNLE5.3 2024-06-04T16:09:36.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.391+0000 7fadd0216800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 833 2024-06-04T16:09:36.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.391+0000 7fadd0216800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.9__multipart_foo.2~LZjwLUgNEeDATXkOnRRuxQuN4KeNLE5.4 2024-06-04T16:09:36.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.391+0000 7fadd0216800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1077 2024-06-04T16:09:36.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.391+0000 7fadd0216800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-06-04T16:09:36.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.391+0000 7fadd0216800 20 garbage collection: RGWGC::send_chain - on object name: gc.31tag is: be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.11735943295640401781 2024-06-04T16:09:36.394 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.392+0000 7facaa7fc640 20 handle_completion(): completion ok for obj=foo 2024-06-04T16:09:36.394 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.392+0000 7fadd0216800 20 list_objects_ordered: starting attempt 1 2024-06-04T16:09:36.394 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.392+0000 7fadd0216800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-06-04T16:09:36.394 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.393+0000 7fadd0216800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-06-04T16:09:36.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.393+0000 7fadd0216800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-06-04T16:09:36.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.393+0000 7fadd0216800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-06-04T16:09:36.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.393+0000 7fadd0216800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-06-04T16:09:36.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.393+0000 7fadd0216800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-simple.1[be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.9])"; uploads.size()=0; is_truncated=0 2024-06-04T16:09:36.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.394+0000 7fadd0216800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 : miss 2024-06-04T16:09:36.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.394+0000 7fadd0216800 20 rados->read ofs=0 len=0 2024-06-04T16:09:36.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.395+0000 7fadd0216800 20 rados_obj.operate() r=0 bl.length=225 2024-06-04T16:09:36.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.395+0000 7fadd0216800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 info.flags=0x11 2024-06-04T16:09:36.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.395+0000 7fadd0216800 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 to cache LRU end 2024-06-04T16:09:36.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.396+0000 7fadd0216800 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 from cache 2024-06-04T16:09:36.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.396+0000 7fadd0216800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-multipart-simple.1, ofs0, ns] 2024-06-04T16:09:36.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.396+0000 7facaaffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1078036791372 cookie 94721756972944 notifier 5600 bl.length()=183 2024-06-04T16:09:36.398 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.397+0000 7fadd0216800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.9 from cache 2024-06-04T16:09:36.398 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.398+0000 7fadd0216800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-simple.1:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.9, ofs0, ns] 2024-06-04T16:09:36.398 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.398+0000 7facaa7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1078036791373 cookie 94721756972944 notifier 5600 bl.length()=240 2024-06-04T16:09:36.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.400+0000 7fadd0216800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-simple.1/be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.9 : miss 2024-06-04T16:09:36.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.400+0000 7fadd0216800 20 rados->read ofs=0 len=0 2024-06-04T16:09:36.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.400+0000 7fadd0216800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:09:36.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.400+0000 7fadd0216800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-simple.1/be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.9 info.flags=0x0 2024-06-04T16:09:36.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.400+0000 7fadd0216800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-simple.1/be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.9 to cache LRU end 2024-06-04T16:09:36.406 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.402+0000 7fadd0216800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.15 : miss 2024-06-04T16:09:36.407 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.402+0000 7fadd0216800 20 rados->read ofs=0 len=0 2024-06-04T16:09:36.407 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.403+0000 7fadd0216800 20 rados_obj.operate() r=0 bl.length=447 2024-06-04T16:09:36.407 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.403+0000 7fadd0216800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.15 info.flags=0x17 2024-06-04T16:09:36.407 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.403+0000 7fadd0216800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.15 to cache LRU end 2024-06-04T16:09:36.407 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.403+0000 7fadd0216800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-06-04T16:09:36.407 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.403+0000 7fadd0216800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-06-04T16:09:36.407 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.403+0000 7fadd0216800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.15 2024-06-04T16:09:36.407 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.403+0000 7fadd0216800 10 cls_bucket_list_unordered: got foo-STANDARD-LUKEWARM 2024-06-04T16:09:36.407 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.404+0000 7fadd0216800 10 cls_bucket_list_unordered: got foo-LUKEWARM-STANDARD 2024-06-04T16:09:36.407 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.404+0000 7fadd0216800 10 cls_bucket_list_unordered: got foo-FROZEN 2024-06-04T16:09:36.407 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.405+0000 7fadd0216800 10 cls_bucket_list_unordered: got foo-FROZEN-LUKEWARM 2024-06-04T16:09:36.407 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.405+0000 7fadd0216800 10 cls_bucket_list_unordered: got foo-LUKEWARM-FROZEN 2024-06-04T16:09:36.407 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.405+0000 7fadd0216800 10 cls_bucket_list_unordered: got foo-STANDARD 2024-06-04T16:09:36.408 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.406+0000 7fadd0216800 10 cls_bucket_list_unordered: got foo-FROZEN-STANDARD 2024-06-04T16:09:36.408 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.406+0000 7fadd0216800 10 cls_bucket_list_unordered: got foo-LUKEWARM 2024-06-04T16:09:36.409 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.406+0000 7fadd0216800 10 cls_bucket_list_unordered: got foo-STANDARD-STANDARD 2024-06-04T16:09:36.409 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.407+0000 7fadd0216800 10 cls_bucket_list_unordered: got foo-LUKEWARM-LUKEWARM 2024-06-04T16:09:36.409 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.407+0000 7fadd0216800 10 cls_bucket_list_unordered: got foo-STANDARD-FROZEN 2024-06-04T16:09:36.409 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.407+0000 7fadd0216800 10 cls_bucket_list_unordered: got foo-FROZEN-FROZEN 2024-06-04T16:09:36.409 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.407+0000 7fadd0216800 20 get_obj_state: octx=0x562620b0faf0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-LUKEWARM state=0x562620b126a8 s->prefetch_data=0 2024-06-04T16:09:36.409 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.408+0000 7fadd0216800 10 manifest: total_size = 2046 2024-06-04T16:09:36.409 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.408+0000 7fadd0216800 20 get_obj_state: setting s->obj_tag to _sZMISx1vyJkgodbciGC-m6JMHG8D-Qw 2024-06-04T16:09:36.409 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.408+0000 7fadd0216800 20 get_obj_state: octx=0x562620b0faf0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-LUKEWARM state=0x562620b126a8 s->prefetch_data=0 2024-06-04T16:09:36.409 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.408+0000 7fadd0216800 20 prepare_atomic_modification: state is not atomic. state=0x562620b126a8 2024-06-04T16:09:36.409 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.408+0000 7fadd0216800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.15.0 2024-06-04T16:09:36.411 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.410+0000 7fadd0216800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-06-04T16:09:36.411 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.410+0000 7fadd0216800 20 RGWObjManifest::operator++(): result: ofs=2046 stripe_ofs=2046 part_ofs=0 rule->part_size=0 2024-06-04T16:09:36.411 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.410+0000 7fadd0216800 20 garbage collection: RGWGC::send_split_chain - tag is: _sZMISx1vyJkgodbciGC-m6JMHG8D-Qw 2024-06-04T16:09:36.411 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.410+0000 7fadd0216800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-06-04T16:09:36.411 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.410+0000 7fadd0216800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.15__shadow_.JxiXc2iOV7LX8X-H3WxM3yPnF43fXiU_0 2024-06-04T16:09:36.411 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.410+0000 7fadd0216800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 310 2024-06-04T16:09:36.411 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.410+0000 7fadd0216800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-06-04T16:09:36.411 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.410+0000 7fadd0216800 20 garbage collection: RGWGC::send_chain - on object name: gc.12tag is: _sZMISx1vyJkgodbciGC-m6JMHG8D-Qw 2024-06-04T16:09:36.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.411+0000 7facaaffd640 20 handle_completion(): completion ok for obj=foo-STANDARD-LUKEWARM 2024-06-04T16:09:36.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.412+0000 7fadd0216800 20 get_obj_state: octx=0x562620b910f0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-STANDARD state=0x562620b126a8 s->prefetch_data=0 2024-06-04T16:09:36.413 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.412+0000 7fadd0216800 10 manifest: total_size = 5242880 2024-06-04T16:09:36.413 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.412+0000 7fadd0216800 20 get_obj_state: setting s->obj_tag to _lwAHcTpdp0joNkRxr72-SnS73b6ogkv 2024-06-04T16:09:36.413 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.412+0000 7fadd0216800 20 get_obj_state: octx=0x562620b910f0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-STANDARD state=0x562620b126a8 s->prefetch_data=0 2024-06-04T16:09:36.413 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.412+0000 7fadd0216800 20 prepare_atomic_modification: state is not atomic. state=0x562620b126a8 2024-06-04T16:09:36.413 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.412+0000 7fadd0216800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.15.2 2024-06-04T16:09:36.415 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.415+0000 7fadd0216800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-06-04T16:09:36.415 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.415+0000 7fadd0216800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-06-04T16:09:36.415 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.415+0000 7fadd0216800 20 garbage collection: RGWGC::send_split_chain - tag is: _lwAHcTpdp0joNkRxr72-SnS73b6ogkv 2024-06-04T16:09:36.415 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.415+0000 7fadd0216800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-06-04T16:09:36.416 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.415+0000 7fadd0216800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.15__shadow_.8WmVyD0RW3A4E7Lp8Um6gV-bOjagKVW_1 2024-06-04T16:09:36.416 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.415+0000 7fadd0216800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 301 2024-06-04T16:09:36.416 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.415+0000 7fadd0216800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-06-04T16:09:36.416 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.415+0000 7fadd0216800 20 garbage collection: RGWGC::send_chain - on object name: gc.7tag is: _lwAHcTpdp0joNkRxr72-SnS73b6ogkv 2024-06-04T16:09:36.416 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.416+0000 7facaa7fc640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-STANDARD 2024-06-04T16:09:36.417 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.417+0000 7fadd0216800 20 get_obj_state: octx=0x562620b1a850 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN state=0x562620b126a8 s->prefetch_data=0 2024-06-04T16:09:36.418 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.417+0000 7fadd0216800 10 manifest: total_size = 5242880 2024-06-04T16:09:36.418 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.417+0000 7fadd0216800 20 get_obj_state: setting s->obj_tag to be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.9878319443786539676 2024-06-04T16:09:36.418 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.417+0000 7fadd0216800 20 get_obj_state: octx=0x562620b1a850 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN state=0x562620b126a8 s->prefetch_data=0 2024-06-04T16:09:36.418 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.417+0000 7fadd0216800 20 prepare_atomic_modification: state is not atomic. state=0x562620b126a8 2024-06-04T16:09:36.418 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.417+0000 7fadd0216800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.15.3 2024-06-04T16:09:36.420 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.419+0000 7fadd0216800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-06-04T16:09:36.420 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.419+0000 7fadd0216800 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2024-06-04T16:09:36.420 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.419+0000 7fadd0216800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-06-04T16:09:36.420 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.419+0000 7fadd0216800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-06-04T16:09:36.420 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.419+0000 7fadd0216800 20 garbage collection: RGWGC::send_split_chain - tag is: be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.9878319443786539676 2024-06-04T16:09:36.420 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.419+0000 7fadd0216800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-06-04T16:09:36.421 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.419+0000 7fadd0216800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.15__shadow_.ePvfnTEwm5fPwgkwsZoNuKRGCgJNIFx_0 2024-06-04T16:09:36.421 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.419+0000 7fadd0216800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 337 2024-06-04T16:09:36.421 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.419+0000 7fadd0216800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.15__shadow_.ePvfnTEwm5fPwgkwsZoNuKRGCgJNIFx_1 2024-06-04T16:09:36.421 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.419+0000 7fadd0216800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 574 2024-06-04T16:09:36.421 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.419+0000 7fadd0216800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-06-04T16:09:36.421 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.419+0000 7fadd0216800 20 garbage collection: RGWGC::send_chain - on object name: gc.27tag is: be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.9878319443786539676 2024-06-04T16:09:36.423 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.422+0000 7facaaffd640 20 handle_completion(): completion ok for obj=foo-FROZEN 2024-06-04T16:09:36.423 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.422+0000 7fadd0216800 20 get_obj_state: octx=0x562620b1a850 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-LUKEWARM state=0x562620b126a8 s->prefetch_data=0 2024-06-04T16:09:36.423 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.422+0000 7fadd0216800 10 manifest: total_size = 5242880 2024-06-04T16:09:36.423 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.422+0000 7fadd0216800 20 get_obj_state: setting s->obj_tag to _ffwaJpUq8VhiAtsPrBM1b6DlfjMZt0k 2024-06-04T16:09:36.423 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.422+0000 7fadd0216800 20 get_obj_state: octx=0x562620b1a850 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-LUKEWARM state=0x562620b126a8 s->prefetch_data=0 2024-06-04T16:09:36.423 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.422+0000 7fadd0216800 20 prepare_atomic_modification: state is not atomic. state=0x562620b126a8 2024-06-04T16:09:36.423 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.422+0000 7fadd0216800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.15.5 2024-06-04T16:09:36.426 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.425+0000 7fadd0216800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-06-04T16:09:36.426 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.425+0000 7fadd0216800 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2024-06-04T16:09:36.426 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.425+0000 7fadd0216800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-06-04T16:09:36.426 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.425+0000 7fadd0216800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-06-04T16:09:36.426 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.425+0000 7fadd0216800 20 garbage collection: RGWGC::send_split_chain - tag is: _ffwaJpUq8VhiAtsPrBM1b6DlfjMZt0k 2024-06-04T16:09:36.426 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.425+0000 7fadd0216800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-06-04T16:09:36.426 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.425+0000 7fadd0216800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.15__shadow_.Qs_bBAzcNdKXlCYNIgCsdRFVOn2O1AO_0 2024-06-04T16:09:36.426 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.425+0000 7fadd0216800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 310 2024-06-04T16:09:36.426 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.425+0000 7fadd0216800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.15__shadow_.Qs_bBAzcNdKXlCYNIgCsdRFVOn2O1AO_1 2024-06-04T16:09:36.426 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.425+0000 7fadd0216800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 549 2024-06-04T16:09:36.426 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.425+0000 7fadd0216800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-06-04T16:09:36.427 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.425+0000 7fadd0216800 20 garbage collection: RGWGC::send_chain - on object name: gc.11tag is: _ffwaJpUq8VhiAtsPrBM1b6DlfjMZt0k 2024-06-04T16:09:36.427 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.426+0000 7facaa7fc640 20 handle_completion(): completion ok for obj=foo-FROZEN-LUKEWARM 2024-06-04T16:09:36.427 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.426+0000 7fadd0216800 20 get_obj_state: octx=0x562620b1a850 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-FROZEN state=0x562620b126a8 s->prefetch_data=0 2024-06-04T16:09:36.427 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.427+0000 7fadd0216800 10 manifest: total_size = 5242880 2024-06-04T16:09:36.427 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.427+0000 7fadd0216800 20 get_obj_state: setting s->obj_tag to _j5ycqr-PIvlby7TfkKv-dIwAXsPq8Fv 2024-06-04T16:09:36.428 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.427+0000 7fadd0216800 20 get_obj_state: octx=0x562620b1a850 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-FROZEN state=0x562620b126a8 s->prefetch_data=0 2024-06-04T16:09:36.428 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.427+0000 7fadd0216800 20 prepare_atomic_modification: state is not atomic. state=0x562620b126a8 2024-06-04T16:09:36.428 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.427+0000 7fadd0216800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.15.5 2024-06-04T16:09:36.430 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.429+0000 7fadd0216800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-06-04T16:09:36.430 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.429+0000 7fadd0216800 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2024-06-04T16:09:36.430 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.429+0000 7fadd0216800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-06-04T16:09:36.430 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.429+0000 7fadd0216800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-06-04T16:09:36.430 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.429+0000 7fadd0216800 20 garbage collection: RGWGC::send_split_chain - tag is: _j5ycqr-PIvlby7TfkKv-dIwAXsPq8Fv 2024-06-04T16:09:36.430 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.429+0000 7fadd0216800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-06-04T16:09:36.431 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.429+0000 7fadd0216800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.15__shadow_._hXJWKhAv-yQdau8l_CecxjWy4Nqhc2_0 2024-06-04T16:09:36.431 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.429+0000 7fadd0216800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 308 2024-06-04T16:09:36.431 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.429+0000 7fadd0216800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.15__shadow_._hXJWKhAv-yQdau8l_CecxjWy4Nqhc2_1 2024-06-04T16:09:36.431 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.429+0000 7fadd0216800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 545 2024-06-04T16:09:36.431 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.429+0000 7fadd0216800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-06-04T16:09:36.431 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.429+0000 7fadd0216800 20 garbage collection: RGWGC::send_chain - on object name: gc.14tag is: _j5ycqr-PIvlby7TfkKv-dIwAXsPq8Fv 2024-06-04T16:09:36.432 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.430+0000 7facaaffd640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-FROZEN 2024-06-04T16:09:36.432 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.430+0000 7fadd0216800 20 get_obj_state: octx=0x562620b1a850 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD state=0x562620b126a8 s->prefetch_data=0 2024-06-04T16:09:36.432 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.431+0000 7fadd0216800 10 manifest: total_size = 2046 2024-06-04T16:09:36.432 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.431+0000 7fadd0216800 20 get_obj_state: setting s->obj_tag to be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.10024887835783094362 2024-06-04T16:09:36.432 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.431+0000 7fadd0216800 20 get_obj_state: octx=0x562620b1a850 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD state=0x562620b126a8 s->prefetch_data=0 2024-06-04T16:09:36.432 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.431+0000 7fadd0216800 20 prepare_atomic_modification: state is not atomic. state=0x562620b126a8 2024-06-04T16:09:36.432 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.431+0000 7fadd0216800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.15.5 2024-06-04T16:09:36.433 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.433+0000 7fadd0216800 20 get_obj_state: octx=0x562620b1a850 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-STANDARD state=0x562620b126a8 s->prefetch_data=0 2024-06-04T16:09:36.434 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.433+0000 7fadd0216800 10 manifest: total_size = 5242880 2024-06-04T16:09:36.434 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.433+0000 7fadd0216800 20 get_obj_state: setting s->obj_tag to _3PGdrFw1eIdvmG76Nk0Vah1OSstBQVO 2024-06-04T16:09:36.434 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.433+0000 7fadd0216800 20 get_obj_state: octx=0x562620b1a850 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-STANDARD state=0x562620b126a8 s->prefetch_data=0 2024-06-04T16:09:36.434 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.433+0000 7fadd0216800 20 prepare_atomic_modification: state is not atomic. state=0x562620b126a8 2024-06-04T16:09:36.434 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.433+0000 7fadd0216800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.15.7 2024-06-04T16:09:36.435 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.434+0000 7facaa7fc640 20 handle_completion(): completion ok for obj=foo-STANDARD 2024-06-04T16:09:36.436 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.436+0000 7fadd0216800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-06-04T16:09:36.436 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.436+0000 7fadd0216800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-06-04T16:09:36.436 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.436+0000 7fadd0216800 20 garbage collection: RGWGC::send_split_chain - tag is: _3PGdrFw1eIdvmG76Nk0Vah1OSstBQVO 2024-06-04T16:09:36.437 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.436+0000 7fadd0216800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-06-04T16:09:36.437 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.436+0000 7fadd0216800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.15__shadow_.xa3cYOWRfq3U9-lo3NIIVnedPS4AT19_1 2024-06-04T16:09:36.437 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.436+0000 7fadd0216800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 301 2024-06-04T16:09:36.437 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.436+0000 7fadd0216800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-06-04T16:09:36.437 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.436+0000 7fadd0216800 20 garbage collection: RGWGC::send_chain - on object name: gc.12tag is: _3PGdrFw1eIdvmG76Nk0Vah1OSstBQVO 2024-06-04T16:09:36.439 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.437+0000 7fadd0216800 20 get_obj_state: octx=0x7fadb4015f80 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM state=0x562620b126a8 s->prefetch_data=0 2024-06-04T16:09:36.439 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.437+0000 7facaaffd640 20 handle_completion(): completion ok for obj=foo-FROZEN-STANDARD 2024-06-04T16:09:36.439 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.437+0000 7fadd0216800 10 manifest: total_size = 5242880 2024-06-04T16:09:36.439 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.437+0000 7fadd0216800 20 get_obj_state: setting s->obj_tag to be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.8971505154207448580 2024-06-04T16:09:36.439 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.437+0000 7fadd0216800 20 get_obj_state: octx=0x7fadb4015f80 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM state=0x562620b126a8 s->prefetch_data=0 2024-06-04T16:09:36.439 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.437+0000 7fadd0216800 20 prepare_atomic_modification: state is not atomic. state=0x562620b126a8 2024-06-04T16:09:36.440 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.437+0000 7fadd0216800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.15.7 2024-06-04T16:09:36.441 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.440+0000 7fadd0216800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-06-04T16:09:36.441 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.440+0000 7fadd0216800 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2024-06-04T16:09:36.441 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.440+0000 7fadd0216800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-06-04T16:09:36.441 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.440+0000 7fadd0216800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-06-04T16:09:36.441 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.440+0000 7fadd0216800 20 garbage collection: RGWGC::send_split_chain - tag is: be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.8971505154207448580 2024-06-04T16:09:36.441 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.440+0000 7fadd0216800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-06-04T16:09:36.441 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.440+0000 7fadd0216800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.15__shadow_.ugOrn690nemembk4D1Z3uKpeCIh7ByF_0 2024-06-04T16:09:36.441 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.440+0000 7fadd0216800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 339 2024-06-04T16:09:36.442 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.440+0000 7fadd0216800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.15__shadow_.ugOrn690nemembk4D1Z3uKpeCIh7ByF_1 2024-06-04T16:09:36.442 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.440+0000 7fadd0216800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 578 2024-06-04T16:09:36.442 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.440+0000 7fadd0216800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-06-04T16:09:36.442 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.440+0000 7fadd0216800 20 garbage collection: RGWGC::send_chain - on object name: gc.5tag is: be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.8971505154207448580 2024-06-04T16:09:36.443 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.441+0000 7facaa7fc640 20 handle_completion(): completion ok for obj=foo-LUKEWARM 2024-06-04T16:09:36.443 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.441+0000 7fadd0216800 20 get_obj_state: octx=0x7fadc40b3050 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-STANDARD state=0x562620b126a8 s->prefetch_data=0 2024-06-04T16:09:36.443 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.441+0000 7fadd0216800 10 manifest: total_size = 2046 2024-06-04T16:09:36.443 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.441+0000 7fadd0216800 20 get_obj_state: setting s->obj_tag to _-wxc0xcNxGLkF4B8DFMqZ48Jdd-MD2p 2024-06-04T16:09:36.443 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.441+0000 7fadd0216800 20 get_obj_state: octx=0x7fadc40b3050 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-STANDARD state=0x562620b126a8 s->prefetch_data=0 2024-06-04T16:09:36.443 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.441+0000 7fadd0216800 20 prepare_atomic_modification: state is not atomic. state=0x562620b126a8 2024-06-04T16:09:36.443 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.441+0000 7fadd0216800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.15.7 2024-06-04T16:09:36.444 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.444+0000 7fadd0216800 20 get_obj_state: octx=0x7fadc40b3050 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-LUKEWARM state=0x562620b126a8 s->prefetch_data=0 2024-06-04T16:09:36.446 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.444+0000 7fadd0216800 10 manifest: total_size = 5242880 2024-06-04T16:09:36.446 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.444+0000 7fadd0216800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-06-04T16:09:36.446 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.444+0000 7fadd0216800 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2024-06-04T16:09:36.446 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.444+0000 7fadd0216800 10 generate_fake_tag new tag=be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.15__shadow_.ugOrn690nemembk4D1Z3uKpeCIh7ByF_1_11cb8b22e63584017441743a3703ccfc 2024-06-04T16:09:36.446 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.444+0000 7fadd0216800 20 get_obj_state: setting s->obj_tag to be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.15__shadow_.ugOrn690nemembk4D1Z3uKpeCIh7ByF_1_11cb8b22e63584017441743a3703ccfc 2024-06-04T16:09:36.447 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.444+0000 7fadd0216800 20 get_obj_state: octx=0x7fadc40b3050 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-LUKEWARM state=0x562620b126a8 s->prefetch_data=0 2024-06-04T16:09:36.447 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.444+0000 7fadd0216800 20 prepare_atomic_modification: state is not atomic. state=0x562620b126a8 2024-06-04T16:09:36.447 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.444+0000 7fadd0216800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.15.8 2024-06-04T16:09:36.447 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.445+0000 7facaaffd640 20 handle_completion(): completion ok for obj=foo-STANDARD-STANDARD 2024-06-04T16:09:36.448 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.446+0000 7fadd0216800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-06-04T16:09:36.448 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.446+0000 7fadd0216800 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2024-06-04T16:09:36.448 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.446+0000 7fadd0216800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-06-04T16:09:36.448 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.446+0000 7fadd0216800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-06-04T16:09:36.449 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.446+0000 7fadd0216800 20 garbage collection: RGWGC::send_split_chain - tag is: be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.15__shadow_.ugOrn690nemembk4D1Z3uKpeCIh7ByF_1_11cb8b22e63584017441743a3703ccfc 2024-06-04T16:09:36.449 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.446+0000 7fadd0216800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-06-04T16:09:36.449 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.446+0000 7fadd0216800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.15__shadow_.ugOrn690nemembk4D1Z3uKpeCIh7ByF_0 2024-06-04T16:09:36.449 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.446+0000 7fadd0216800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 398 2024-06-04T16:09:36.449 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.446+0000 7fadd0216800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.15__shadow_.ugOrn690nemembk4D1Z3uKpeCIh7ByF_1 2024-06-04T16:09:36.449 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.446+0000 7fadd0216800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 637 2024-06-04T16:09:36.450 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.446+0000 7fadd0216800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-06-04T16:09:36.450 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.446+0000 7fadd0216800 20 garbage collection: RGWGC::send_chain - on object name: gc.21tag is: be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.15__shadow_.ugOrn690nemembk4D1Z3uKpeCIh7ByF_1_11cb8b22e63584017441743a3703ccfc 2024-06-04T16:09:36.451 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.448+0000 7facaa7fc640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-LUKEWARM 2024-06-04T16:09:36.451 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.448+0000 7fadd0216800 20 get_obj_state: octx=0x7fadc40b3050 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-FROZEN state=0x562620b126a8 s->prefetch_data=0 2024-06-04T16:09:36.451 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.448+0000 7fadd0216800 10 manifest: total_size = 2046 2024-06-04T16:09:36.451 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.448+0000 7fadd0216800 20 get_obj_state: setting s->obj_tag to _-Kf3IqGiScurijHeoUCCRmcQHXPaDkB 2024-06-04T16:09:36.451 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.448+0000 7fadd0216800 20 get_obj_state: octx=0x7fadc40b3050 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-FROZEN state=0x562620b126a8 s->prefetch_data=0 2024-06-04T16:09:36.452 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.448+0000 7fadd0216800 20 prepare_atomic_modification: state is not atomic. state=0x562620b126a8 2024-06-04T16:09:36.452 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.448+0000 7fadd0216800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.15.8 2024-06-04T16:09:36.452 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.451+0000 7fadd0216800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-06-04T16:09:36.452 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.451+0000 7fadd0216800 20 RGWObjManifest::operator++(): result: ofs=2046 stripe_ofs=2046 part_ofs=0 rule->part_size=0 2024-06-04T16:09:36.452 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.451+0000 7fadd0216800 20 garbage collection: RGWGC::send_split_chain - tag is: _-Kf3IqGiScurijHeoUCCRmcQHXPaDkB 2024-06-04T16:09:36.453 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.451+0000 7fadd0216800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-06-04T16:09:36.453 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.451+0000 7fadd0216800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.15__shadow_.SvY_id66vIshqoAkANsI6bJOEnf9HfX_0 2024-06-04T16:09:36.453 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.451+0000 7fadd0216800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 308 2024-06-04T16:09:36.453 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.451+0000 7fadd0216800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-06-04T16:09:36.453 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.451+0000 7fadd0216800 20 garbage collection: RGWGC::send_chain - on object name: gc.24tag is: _-Kf3IqGiScurijHeoUCCRmcQHXPaDkB 2024-06-04T16:09:36.454 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.452+0000 7facaaffd640 20 handle_completion(): completion ok for obj=foo-STANDARD-FROZEN 2024-06-04T16:09:36.454 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.452+0000 7fadd0216800 20 get_obj_state: octx=0x7fadb4015f80 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-FROZEN state=0x562620b126a8 s->prefetch_data=0 2024-06-04T16:09:36.454 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.453+0000 7fadd0216800 10 manifest: total_size = 5242880 2024-06-04T16:09:36.454 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.453+0000 7fadd0216800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-06-04T16:09:36.454 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.453+0000 7fadd0216800 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2024-06-04T16:09:36.454 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.453+0000 7fadd0216800 10 generate_fake_tag new tag=be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.15__shadow_.ePvfnTEwm5fPwgkwsZoNuKRGCgJNIFx_1_ceb6dab11c68b86ee3a7ee2620893bd3 2024-06-04T16:09:36.454 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.453+0000 7fadd0216800 20 get_obj_state: setting s->obj_tag to be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.15__shadow_.ePvfnTEwm5fPwgkwsZoNuKRGCgJNIFx_1_ceb6dab11c68b86ee3a7ee2620893bd3 2024-06-04T16:09:36.454 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.453+0000 7fadd0216800 20 get_obj_state: octx=0x7fadb4015f80 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-FROZEN state=0x562620b126a8 s->prefetch_data=0 2024-06-04T16:09:36.455 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.453+0000 7fadd0216800 20 prepare_atomic_modification: state is not atomic. state=0x562620b126a8 2024-06-04T16:09:36.455 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.453+0000 7fadd0216800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.15.9 2024-06-04T16:09:36.456 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.455+0000 7fadd0216800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-06-04T16:09:36.456 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.455+0000 7fadd0216800 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2024-06-04T16:09:36.456 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.455+0000 7fadd0216800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-06-04T16:09:36.456 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.455+0000 7fadd0216800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-06-04T16:09:36.456 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.455+0000 7fadd0216800 20 garbage collection: RGWGC::send_split_chain - tag is: be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.15__shadow_.ePvfnTEwm5fPwgkwsZoNuKRGCgJNIFx_1_ceb6dab11c68b86ee3a7ee2620893bd3 2024-06-04T16:09:36.456 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.455+0000 7fadd0216800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-06-04T16:09:36.456 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.455+0000 7fadd0216800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.15__shadow_.ePvfnTEwm5fPwgkwsZoNuKRGCgJNIFx_0 2024-06-04T16:09:36.456 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.455+0000 7fadd0216800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 396 2024-06-04T16:09:36.456 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.455+0000 7fadd0216800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.15__shadow_.ePvfnTEwm5fPwgkwsZoNuKRGCgJNIFx_1 2024-06-04T16:09:36.456 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.455+0000 7fadd0216800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 633 2024-06-04T16:09:36.457 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.455+0000 7fadd0216800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-06-04T16:09:36.457 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.455+0000 7fadd0216800 20 garbage collection: RGWGC::send_chain - on object name: gc.27tag is: be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.15__shadow_.ePvfnTEwm5fPwgkwsZoNuKRGCgJNIFx_1_ceb6dab11c68b86ee3a7ee2620893bd3 2024-06-04T16:09:36.457 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.456+0000 7facaa7fc640 20 handle_completion(): completion ok for obj=foo-FROZEN-FROZEN 2024-06-04T16:09:36.457 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.456+0000 7fadd0216800 20 list_objects_ordered: starting attempt 1 2024-06-04T16:09:36.457 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.456+0000 7fadd0216800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-06-04T16:09:36.458 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.457+0000 7fadd0216800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-06-04T16:09:36.458 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.457+0000 7fadd0216800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-06-04T16:09:36.458 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.457+0000 7fadd0216800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-06-04T16:09:36.458 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.457+0000 7fadd0216800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-06-04T16:09:36.458 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.457+0000 7fadd0216800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class-copy.1[be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.15])"; uploads.size()=0; is_truncated=0 2024-06-04T16:09:36.460 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.460+0000 7fadd0216800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 : miss 2024-06-04T16:09:36.460 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.460+0000 7fadd0216800 20 rados->read ofs=0 len=0 2024-06-04T16:09:36.462 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.462+0000 7fadd0216800 20 rados_obj.operate() r=0 bl.length=233 2024-06-04T16:09:36.462 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.462+0000 7fadd0216800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 info.flags=0x11 2024-06-04T16:09:36.463 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.462+0000 7fadd0216800 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 to cache LRU end 2024-06-04T16:09:36.464 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.463+0000 7fadd0216800 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 from cache 2024-06-04T16:09:36.464 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.463+0000 7fadd0216800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-obj-storage-class-copy.1, ofs0, ns] 2024-06-04T16:09:36.464 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.463+0000 7facaa7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1078036791312 cookie 94721756967088 notifier 5600 bl.length()=189 2024-06-04T16:09:36.466 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.465+0000 7fadd0216800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.15 from cache 2024-06-04T16:09:36.466 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.465+0000 7fadd0216800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.15, ofs0, ns] 2024-06-04T16:09:36.466 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.465+0000 7facaaffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1078036791371 cookie 94721756975760 notifier 5600 bl.length()=247 2024-06-04T16:09:36.468 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.468+0000 7fadd0216800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-copy.1/be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.15 : miss 2024-06-04T16:09:36.469 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.468+0000 7fadd0216800 20 rados->read ofs=0 len=0 2024-06-04T16:09:36.469 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.468+0000 7fadd0216800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:09:36.469 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.468+0000 7fadd0216800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-copy.1/be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.15 info.flags=0x0 2024-06-04T16:09:36.469 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.468+0000 7fadd0216800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-copy.1/be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.15 to cache LRU end 2024-06-04T16:09:36.470 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.470+0000 7fadd0216800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.16 : miss 2024-06-04T16:09:36.470 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.470+0000 7fadd0216800 20 rados->read ofs=0 len=0 2024-06-04T16:09:36.471 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.470+0000 7fadd0216800 20 rados_obj.operate() r=0 bl.length=457 2024-06-04T16:09:36.471 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.470+0000 7fadd0216800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.16 info.flags=0x17 2024-06-04T16:09:36.471 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.470+0000 7fadd0216800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.16 to cache LRU end 2024-06-04T16:09:36.471 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.470+0000 7fadd0216800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-06-04T16:09:36.471 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.470+0000 7fadd0216800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-06-04T16:09:36.471 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.470+0000 7fadd0216800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.16 2024-06-04T16:09:36.471 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.471+0000 7fadd0216800 10 cls_bucket_list_unordered: got foo-STANDARD-LUKEWARM 2024-06-04T16:09:36.472 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.471+0000 7fadd0216800 10 cls_bucket_list_unordered: got foo-LUKEWARM-STANDARD 2024-06-04T16:09:36.472 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.472+0000 7fadd0216800 10 cls_bucket_list_unordered: got foo-FROZEN 2024-06-04T16:09:36.473 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.472+0000 7fadd0216800 10 cls_bucket_list_unordered: got foo-FROZEN-LUKEWARM 2024-06-04T16:09:36.473 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.472+0000 7fadd0216800 10 cls_bucket_list_unordered: got foo-LUKEWARM-FROZEN 2024-06-04T16:09:36.473 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.472+0000 7fadd0216800 10 cls_bucket_list_unordered: got foo-STANDARD 2024-06-04T16:09:36.474 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.473+0000 7fadd0216800 10 cls_bucket_list_unordered: got foo-FROZEN-STANDARD 2024-06-04T16:09:36.474 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.473+0000 7fadd0216800 10 cls_bucket_list_unordered: got foo-LUKEWARM 2024-06-04T16:09:36.474 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.473+0000 7fadd0216800 10 cls_bucket_list_unordered: got foo-STANDARD-STANDARD 2024-06-04T16:09:36.474 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.473+0000 7fadd0216800 10 cls_bucket_list_unordered: got foo-LUKEWARM-LUKEWARM 2024-06-04T16:09:36.474 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.473+0000 7fadd0216800 10 cls_bucket_list_unordered: got foo-STANDARD-FROZEN 2024-06-04T16:09:36.475 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.474+0000 7fadd0216800 10 cls_bucket_list_unordered: got foo-FROZEN-FROZEN 2024-06-04T16:09:36.475 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.474+0000 7fadd0216800 20 get_obj_state: octx=0x562620b27d60 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-LUKEWARM state=0x562620b26068 s->prefetch_data=0 2024-06-04T16:09:36.475 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.475+0000 7fadd0216800 10 manifest: total_size = 45360 2024-06-04T16:09:36.475 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.475+0000 7fadd0216800 20 get_obj_state: setting s->obj_tag to _2ml_If96gJo0Up14rftVX-I7yO7qoeo 2024-06-04T16:09:36.475 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.475+0000 7fadd0216800 20 get_obj_state: octx=0x562620b27d60 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-LUKEWARM state=0x562620b26068 s->prefetch_data=0 2024-06-04T16:09:36.476 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.475+0000 7fadd0216800 20 prepare_atomic_modification: state is not atomic. state=0x562620b26068 2024-06-04T16:09:36.476 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.475+0000 7fadd0216800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.16.0 2024-06-04T16:09:36.477 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.477+0000 7fadd0216800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-06-04T16:09:36.478 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.477+0000 7fadd0216800 20 RGWObjManifest::operator++(): result: ofs=45360 stripe_ofs=45360 part_ofs=0 rule->part_size=0 2024-06-04T16:09:36.478 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.477+0000 7fadd0216800 20 garbage collection: RGWGC::send_split_chain - tag is: _2ml_If96gJo0Up14rftVX-I7yO7qoeo 2024-06-04T16:09:36.478 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.477+0000 7fadd0216800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-06-04T16:09:36.478 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.477+0000 7fadd0216800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.16__shadow_.bjZI61oHYBwdOcVmM10NdpWadVpVyGt_0 2024-06-04T16:09:36.479 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.477+0000 7fadd0216800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 310 2024-06-04T16:09:36.479 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.477+0000 7fadd0216800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-06-04T16:09:36.479 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.477+0000 7fadd0216800 20 garbage collection: RGWGC::send_chain - on object name: gc.21tag is: _2ml_If96gJo0Up14rftVX-I7yO7qoeo 2024-06-04T16:09:36.480 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.478+0000 7facaaffd640 20 handle_completion(): completion ok for obj=foo-STANDARD-LUKEWARM 2024-06-04T16:09:36.480 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.478+0000 7fadd0216800 20 get_obj_state: octx=0x562620b90d80 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-STANDARD state=0x562620b26068 s->prefetch_data=0 2024-06-04T16:09:36.480 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.478+0000 7fadd0216800 10 manifest: total_size = 11534336 2024-06-04T16:09:36.480 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.478+0000 7fadd0216800 20 get_obj_state: setting s->obj_tag to _5zk1psZrkC2Nqo73FKuQeFIblxd_758 2024-06-04T16:09:36.481 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.478+0000 7fadd0216800 20 get_obj_state: octx=0x562620b90d80 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-STANDARD state=0x562620b26068 s->prefetch_data=0 2024-06-04T16:09:36.481 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.478+0000 7fadd0216800 20 prepare_atomic_modification: state is not atomic. state=0x562620b26068 2024-06-04T16:09:36.481 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.478+0000 7fadd0216800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.16.2 2024-06-04T16:09:36.481 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.481+0000 7fadd0216800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-06-04T16:09:36.482 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.481+0000 7fadd0216800 20 RGWObjManifest::operator++(): result: ofs=8388608 stripe_ofs=8388608 part_ofs=0 rule->part_size=0 2024-06-04T16:09:36.482 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.481+0000 7fadd0216800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-06-04T16:09:36.482 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.481+0000 7fadd0216800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2024-06-04T16:09:36.482 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.481+0000 7fadd0216800 20 garbage collection: RGWGC::send_split_chain - tag is: _5zk1psZrkC2Nqo73FKuQeFIblxd_758 2024-06-04T16:09:36.482 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.481+0000 7fadd0216800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-06-04T16:09:36.482 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.481+0000 7fadd0216800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.16__shadow_.JKHHvWqKZTiMh3Et-hYgJYq5BWWugTO_1 2024-06-04T16:09:36.482 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.481+0000 7fadd0216800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 301 2024-06-04T16:09:36.483 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.481+0000 7fadd0216800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.16__shadow_.JKHHvWqKZTiMh3Et-hYgJYq5BWWugTO_2 2024-06-04T16:09:36.483 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.481+0000 7fadd0216800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 531 2024-06-04T16:09:36.483 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.481+0000 7fadd0216800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-06-04T16:09:36.483 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.481+0000 7fadd0216800 20 garbage collection: RGWGC::send_chain - on object name: gc.21tag is: _5zk1psZrkC2Nqo73FKuQeFIblxd_758 2024-06-04T16:09:36.484 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.482+0000 7facaa7fc640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-STANDARD 2024-06-04T16:09:36.484 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.482+0000 7fadd0216800 20 get_obj_state: octx=0x562620b90d80 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN state=0x562620b26068 s->prefetch_data=0 2024-06-04T16:09:36.484 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.482+0000 7fadd0216800 10 manifest: total_size = 11534336 2024-06-04T16:09:36.484 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.482+0000 7fadd0216800 20 get_obj_state: setting s->obj_tag to be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.13852691355450577467 2024-06-04T16:09:36.484 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.482+0000 7fadd0216800 20 get_obj_state: octx=0x562620b90d80 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN state=0x562620b26068 s->prefetch_data=0 2024-06-04T16:09:36.484 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.482+0000 7fadd0216800 20 prepare_atomic_modification: state is not atomic. state=0x562620b26068 2024-06-04T16:09:36.485 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.482+0000 7fadd0216800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.16.3 2024-06-04T16:09:36.486 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.484+0000 7fadd0216800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-06-04T16:09:36.486 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.484+0000 7fadd0216800 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-06-04T16:09:36.486 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.484+0000 7fadd0216800 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-06-04T16:09:36.486 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.484+0000 7fadd0216800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-06-04T16:09:36.486 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.484+0000 7fadd0216800 20 RGWObjManifest::operator++(): stripe_ofs=8388608 part_ofs=0 rule->part_size=5242880 2024-06-04T16:09:36.486 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.484+0000 7fadd0216800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-06-04T16:09:36.486 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.484+0000 7fadd0216800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-06-04T16:09:36.487 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.484+0000 7fadd0216800 20 RGWObjManifest::operator++(): stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-06-04T16:09:36.487 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.484+0000 7fadd0216800 20 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-06-04T16:09:36.487 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.484+0000 7fadd0216800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-06-04T16:09:36.487 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.484+0000 7fadd0216800 20 RGWObjManifest::operator++(): stripe_ofs=13631488 part_ofs=5242880 rule->part_size=5242880 2024-06-04T16:09:36.487 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.484+0000 7fadd0216800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-06-04T16:09:36.487 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.484+0000 7fadd0216800 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-06-04T16:09:36.487 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.484+0000 7fadd0216800 20 RGWObjManifest::operator++(): stripe_ofs=14680064 part_ofs=10485760 rule->part_size=1048576 2024-06-04T16:09:36.487 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.484+0000 7fadd0216800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-06-04T16:09:36.487 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.484+0000 7fadd0216800 20 garbage collection: RGWGC::send_split_chain - tag is: be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.13852691355450577467 2024-06-04T16:09:36.487 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.484+0000 7fadd0216800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-06-04T16:09:36.487 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.484+0000 7fadd0216800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.16__multipart_foo-FROZEN.2~lkaHT8quzFXpVBXAABUXtSMFtHto0EW.1 2024-06-04T16:09:36.487 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.484+0000 7fadd0216800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 368 2024-06-04T16:09:36.487 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.484+0000 7fadd0216800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.16__shadow_foo-FROZEN.2~lkaHT8quzFXpVBXAABUXtSMFtHto0EW.1_1 2024-06-04T16:09:36.487 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.484+0000 7fadd0216800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 633 2024-06-04T16:09:36.488 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.484+0000 7fadd0216800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.16__multipart_foo-FROZEN.2~lkaHT8quzFXpVBXAABUXtSMFtHto0EW.2 2024-06-04T16:09:36.488 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.484+0000 7fadd0216800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 900 2024-06-04T16:09:36.488 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.484+0000 7fadd0216800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.16__shadow_foo-FROZEN.2~lkaHT8quzFXpVBXAABUXtSMFtHto0EW.2_1 2024-06-04T16:09:36.488 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.484+0000 7fadd0216800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1165 2024-06-04T16:09:36.488 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.484+0000 7fadd0216800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.16__multipart_foo-FROZEN.2~lkaHT8quzFXpVBXAABUXtSMFtHto0EW.3 2024-06-04T16:09:36.488 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.484+0000 7fadd0216800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1432 2024-06-04T16:09:36.488 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.484+0000 7fadd0216800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-06-04T16:09:36.488 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.484+0000 7fadd0216800 20 garbage collection: RGWGC::send_chain - on object name: gc.29tag is: be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.13852691355450577467 2024-06-04T16:09:36.489 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.485+0000 7facaaffd640 20 handle_completion(): completion ok for obj=foo-FROZEN 2024-06-04T16:09:36.489 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.486+0000 7fadd0216800 20 get_obj_state: octx=0x562620b17da0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-LUKEWARM state=0x562620b26068 s->prefetch_data=0 2024-06-04T16:09:36.489 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.486+0000 7fadd0216800 10 manifest: total_size = 11534336 2024-06-04T16:09:36.489 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.486+0000 7fadd0216800 20 get_obj_state: setting s->obj_tag to _eklndsPP-TZvGwaiLoWxvmZcRjUgRyk 2024-06-04T16:09:36.489 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.486+0000 7fadd0216800 20 get_obj_state: octx=0x562620b17da0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-LUKEWARM state=0x562620b26068 s->prefetch_data=0 2024-06-04T16:09:36.489 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.486+0000 7fadd0216800 20 prepare_atomic_modification: state is not atomic. state=0x562620b26068 2024-06-04T16:09:36.490 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.486+0000 7fadd0216800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.16.5 2024-06-04T16:09:36.490 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.488+0000 7fadd0216800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-06-04T16:09:36.490 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.488+0000 7fadd0216800 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2024-06-04T16:09:36.490 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.488+0000 7fadd0216800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-06-04T16:09:36.490 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.488+0000 7fadd0216800 20 RGWObjManifest::operator++(): result: ofs=8388608 stripe_ofs=8388608 part_ofs=0 rule->part_size=0 2024-06-04T16:09:36.490 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.488+0000 7fadd0216800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-06-04T16:09:36.490 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.488+0000 7fadd0216800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2024-06-04T16:09:36.490 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.488+0000 7fadd0216800 20 garbage collection: RGWGC::send_split_chain - tag is: _eklndsPP-TZvGwaiLoWxvmZcRjUgRyk 2024-06-04T16:09:36.490 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.488+0000 7fadd0216800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-06-04T16:09:36.490 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.488+0000 7fadd0216800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.16__shadow_.CoeSzcmfuYeAKPprIqxhEAyC-0b8sL2_0 2024-06-04T16:09:36.490 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.488+0000 7fadd0216800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 310 2024-06-04T16:09:36.490 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.488+0000 7fadd0216800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.16__shadow_.CoeSzcmfuYeAKPprIqxhEAyC-0b8sL2_1 2024-06-04T16:09:36.491 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.488+0000 7fadd0216800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 549 2024-06-04T16:09:36.491 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.488+0000 7fadd0216800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.16__shadow_.CoeSzcmfuYeAKPprIqxhEAyC-0b8sL2_2 2024-06-04T16:09:36.491 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.488+0000 7fadd0216800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 788 2024-06-04T16:09:36.491 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.488+0000 7fadd0216800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-06-04T16:09:36.491 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.488+0000 7fadd0216800 20 garbage collection: RGWGC::send_chain - on object name: gc.29tag is: _eklndsPP-TZvGwaiLoWxvmZcRjUgRyk 2024-06-04T16:09:36.492 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.490+0000 7facaa7fc640 20 handle_completion(): completion ok for obj=foo-FROZEN-LUKEWARM 2024-06-04T16:09:36.492 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.490+0000 7fadd0216800 20 get_obj_state: octx=0x7fadc40045a0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-FROZEN state=0x562620b26068 s->prefetch_data=0 2024-06-04T16:09:36.492 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.490+0000 7fadd0216800 10 manifest: total_size = 11534336 2024-06-04T16:09:36.492 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.490+0000 7fadd0216800 20 get_obj_state: setting s->obj_tag to _Dh3wgspyuk5_IWbBR5BAXlVJx96OcVL 2024-06-04T16:09:36.492 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.490+0000 7fadd0216800 20 get_obj_state: octx=0x7fadc40045a0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-FROZEN state=0x562620b26068 s->prefetch_data=0 2024-06-04T16:09:36.492 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.490+0000 7fadd0216800 20 prepare_atomic_modification: state is not atomic. state=0x562620b26068 2024-06-04T16:09:36.492 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.490+0000 7fadd0216800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.16.5 2024-06-04T16:09:36.493 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.492+0000 7fadd0216800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-06-04T16:09:36.493 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.492+0000 7fadd0216800 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2024-06-04T16:09:36.493 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.492+0000 7fadd0216800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-06-04T16:09:36.493 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.492+0000 7fadd0216800 20 RGWObjManifest::operator++(): result: ofs=8388608 stripe_ofs=8388608 part_ofs=0 rule->part_size=0 2024-06-04T16:09:36.493 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.492+0000 7fadd0216800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-06-04T16:09:36.493 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.492+0000 7fadd0216800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2024-06-04T16:09:36.493 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.492+0000 7fadd0216800 20 garbage collection: RGWGC::send_split_chain - tag is: _Dh3wgspyuk5_IWbBR5BAXlVJx96OcVL 2024-06-04T16:09:36.493 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.492+0000 7fadd0216800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-06-04T16:09:36.493 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.492+0000 7fadd0216800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.16__shadow_.EGkYrQDmcaKl7ALvDrdsm9qS7UmEoEO_0 2024-06-04T16:09:36.493 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.492+0000 7fadd0216800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 308 2024-06-04T16:09:36.494 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.492+0000 7fadd0216800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.16__shadow_.EGkYrQDmcaKl7ALvDrdsm9qS7UmEoEO_1 2024-06-04T16:09:36.494 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.492+0000 7fadd0216800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 545 2024-06-04T16:09:36.494 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.492+0000 7fadd0216800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.16__shadow_.EGkYrQDmcaKl7ALvDrdsm9qS7UmEoEO_2 2024-06-04T16:09:36.494 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.492+0000 7fadd0216800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 782 2024-06-04T16:09:36.494 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.492+0000 7fadd0216800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-06-04T16:09:36.494 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.492+0000 7fadd0216800 20 garbage collection: RGWGC::send_chain - on object name: gc.31tag is: _Dh3wgspyuk5_IWbBR5BAXlVJx96OcVL 2024-06-04T16:09:36.495 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.493+0000 7facaaffd640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-FROZEN 2024-06-04T16:09:36.495 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.493+0000 7fadd0216800 20 get_obj_state: octx=0x7fadc4086f20 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD state=0x562620b26068 s->prefetch_data=0 2024-06-04T16:09:36.495 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.494+0000 7fadd0216800 10 manifest: total_size = 45360 2024-06-04T16:09:36.495 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.494+0000 7fadd0216800 20 get_obj_state: setting s->obj_tag to be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.17535742630697210180 2024-06-04T16:09:36.495 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.494+0000 7fadd0216800 20 get_obj_state: octx=0x7fadc4086f20 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD state=0x562620b26068 s->prefetch_data=0 2024-06-04T16:09:36.495 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.494+0000 7fadd0216800 20 prepare_atomic_modification: state is not atomic. state=0x562620b26068 2024-06-04T16:09:36.495 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.494+0000 7fadd0216800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.16.5 2024-06-04T16:09:36.497 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.496+0000 7fadd0216800 20 RGWObjManifest::operator++(): rule->part_size=20613 rules.size()=2 2024-06-04T16:09:36.497 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.496+0000 7fadd0216800 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=20613 2024-06-04T16:09:36.497 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.496+0000 7fadd0216800 20 RGWObjManifest::operator++(): result: ofs=20613 stripe_ofs=20613 part_ofs=20613 rule->part_size=20613 2024-06-04T16:09:36.497 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.496+0000 7fadd0216800 20 RGWObjManifest::operator++(): rule->part_size=20613 rules.size()=2 2024-06-04T16:09:36.497 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.496+0000 7fadd0216800 20 RGWObjManifest::operator++(): stripe_ofs=4214917 part_ofs=20613 rule->part_size=20613 2024-06-04T16:09:36.498 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.496+0000 7fadd0216800 20 RGWObjManifest::operator++(): result: ofs=41226 stripe_ofs=41226 part_ofs=41226 rule->part_size=4134 2024-06-04T16:09:36.498 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.496+0000 7fadd0216800 20 RGWObjManifest::operator++(): rule->part_size=4134 rules.size()=2 2024-06-04T16:09:36.498 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.496+0000 7fadd0216800 20 RGWObjManifest::operator++(): stripe_ofs=4235530 part_ofs=41226 rule->part_size=4134 2024-06-04T16:09:36.498 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.496+0000 7fadd0216800 20 RGWObjManifest::operator++(): result: ofs=45360 stripe_ofs=45360 part_ofs=45360 rule->part_size=4134 2024-06-04T16:09:36.498 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.496+0000 7fadd0216800 20 garbage collection: RGWGC::send_split_chain - tag is: be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.17535742630697210180 2024-06-04T16:09:36.498 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.496+0000 7fadd0216800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-06-04T16:09:36.498 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.496+0000 7fadd0216800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.16__multipart_foo-STANDARD.2~U0JhkapXSzFfp-gru_214XqQGZHhyYX.1 2024-06-04T16:09:36.498 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.496+0000 7fadd0216800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 365 2024-06-04T16:09:36.498 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.496+0000 7fadd0216800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.16__multipart_foo-STANDARD.2~U0JhkapXSzFfp-gru_214XqQGZHhyYX.2 2024-06-04T16:09:36.498 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.496+0000 7fadd0216800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 629 2024-06-04T16:09:36.498 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.496+0000 7fadd0216800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.16__multipart_foo-STANDARD.2~U0JhkapXSzFfp-gru_214XqQGZHhyYX.3 2024-06-04T16:09:36.498 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.496+0000 7fadd0216800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 893 2024-06-04T16:09:36.498 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.496+0000 7fadd0216800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-06-04T16:09:36.499 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.496+0000 7fadd0216800 20 garbage collection: RGWGC::send_chain - on object name: gc.27tag is: be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.17535742630697210180 2024-06-04T16:09:36.499 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.497+0000 7facaa7fc640 20 handle_completion(): completion ok for obj=foo-STANDARD 2024-06-04T16:09:36.499 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.498+0000 7fadd0216800 20 get_obj_state: octx=0x562620b8f8a0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-STANDARD state=0x562620b26068 s->prefetch_data=0 2024-06-04T16:09:36.499 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.498+0000 7fadd0216800 10 manifest: total_size = 11534336 2024-06-04T16:09:36.499 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.498+0000 7fadd0216800 20 get_obj_state: setting s->obj_tag to _nwuYYM1n2pEECBoGhJzDiOn3mJIC2OR 2024-06-04T16:09:36.500 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.498+0000 7fadd0216800 20 get_obj_state: octx=0x562620b8f8a0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-STANDARD state=0x562620b26068 s->prefetch_data=0 2024-06-04T16:09:36.500 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.498+0000 7fadd0216800 20 prepare_atomic_modification: state is not atomic. state=0x562620b26068 2024-06-04T16:09:36.500 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.498+0000 7fadd0216800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.16.7 2024-06-04T16:09:36.501 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.500+0000 7fadd0216800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-06-04T16:09:36.501 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.500+0000 7fadd0216800 20 RGWObjManifest::operator++(): result: ofs=8388608 stripe_ofs=8388608 part_ofs=0 rule->part_size=0 2024-06-04T16:09:36.501 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.501+0000 7fadd0216800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-06-04T16:09:36.501 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.501+0000 7fadd0216800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2024-06-04T16:09:36.502 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.501+0000 7fadd0216800 20 garbage collection: RGWGC::send_split_chain - tag is: _nwuYYM1n2pEECBoGhJzDiOn3mJIC2OR 2024-06-04T16:09:36.502 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.501+0000 7fadd0216800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-06-04T16:09:36.502 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.501+0000 7fadd0216800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.16__shadow_.tDJPduOPCSTlie-VMaT5asBz0UP7OhT_1 2024-06-04T16:09:36.502 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.501+0000 7fadd0216800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 301 2024-06-04T16:09:36.502 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.501+0000 7fadd0216800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.16__shadow_.tDJPduOPCSTlie-VMaT5asBz0UP7OhT_2 2024-06-04T16:09:36.502 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.501+0000 7fadd0216800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 531 2024-06-04T16:09:36.502 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.501+0000 7fadd0216800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-06-04T16:09:36.502 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.501+0000 7fadd0216800 20 garbage collection: RGWGC::send_chain - on object name: gc.31tag is: _nwuYYM1n2pEECBoGhJzDiOn3mJIC2OR 2024-06-04T16:09:36.503 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.502+0000 7facaaffd640 20 handle_completion(): completion ok for obj=foo-FROZEN-STANDARD 2024-06-04T16:09:36.503 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.502+0000 7fadd0216800 20 get_obj_state: octx=0x7fadb402c830 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM state=0x562620b26068 s->prefetch_data=0 2024-06-04T16:09:36.503 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.502+0000 7fadd0216800 10 manifest: total_size = 11534336 2024-06-04T16:09:36.503 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.502+0000 7fadd0216800 20 get_obj_state: setting s->obj_tag to be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.7020005450365376393 2024-06-04T16:09:36.503 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.502+0000 7fadd0216800 20 get_obj_state: octx=0x7fadb402c830 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM state=0x562620b26068 s->prefetch_data=0 2024-06-04T16:09:36.503 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.502+0000 7fadd0216800 20 prepare_atomic_modification: state is not atomic. state=0x562620b26068 2024-06-04T16:09:36.503 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.502+0000 7fadd0216800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.16.7 2024-06-04T16:09:36.505 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.505+0000 7fadd0216800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-06-04T16:09:36.506 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.505+0000 7fadd0216800 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-06-04T16:09:36.506 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.505+0000 7fadd0216800 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-06-04T16:09:36.506 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.505+0000 7fadd0216800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-06-04T16:09:36.506 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.505+0000 7fadd0216800 20 RGWObjManifest::operator++(): stripe_ofs=8388608 part_ofs=0 rule->part_size=5242880 2024-06-04T16:09:36.506 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.505+0000 7fadd0216800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-06-04T16:09:36.506 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.505+0000 7fadd0216800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-06-04T16:09:36.506 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.505+0000 7fadd0216800 20 RGWObjManifest::operator++(): stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-06-04T16:09:36.506 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.505+0000 7fadd0216800 20 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-06-04T16:09:36.506 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.505+0000 7fadd0216800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-06-04T16:09:36.507 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.505+0000 7fadd0216800 20 RGWObjManifest::operator++(): stripe_ofs=13631488 part_ofs=5242880 rule->part_size=5242880 2024-06-04T16:09:36.507 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.505+0000 7fadd0216800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-06-04T16:09:36.507 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.505+0000 7fadd0216800 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-06-04T16:09:36.507 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.505+0000 7fadd0216800 20 RGWObjManifest::operator++(): stripe_ofs=14680064 part_ofs=10485760 rule->part_size=1048576 2024-06-04T16:09:36.507 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.505+0000 7fadd0216800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-06-04T16:09:36.507 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.505+0000 7fadd0216800 20 garbage collection: RGWGC::send_split_chain - tag is: be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.7020005450365376393 2024-06-04T16:09:36.507 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.505+0000 7fadd0216800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-06-04T16:09:36.507 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.505+0000 7fadd0216800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.16__multipart_foo-LUKEWARM.2~KDdYPCgJb6LvMg0JlPPA9rxdK00r3FF.1 2024-06-04T16:09:36.507 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.505+0000 7fadd0216800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 373 2024-06-04T16:09:36.507 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.505+0000 7fadd0216800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.16__shadow_foo-LUKEWARM.2~KDdYPCgJb6LvMg0JlPPA9rxdK00r3FF.1_1 2024-06-04T16:09:36.507 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.505+0000 7fadd0216800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 644 2024-06-04T16:09:36.507 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.505+0000 7fadd0216800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.16__multipart_foo-LUKEWARM.2~KDdYPCgJb6LvMg0JlPPA9rxdK00r3FF.2 2024-06-04T16:09:36.507 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.505+0000 7fadd0216800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 917 2024-06-04T16:09:36.508 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.505+0000 7fadd0216800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.16__shadow_foo-LUKEWARM.2~KDdYPCgJb6LvMg0JlPPA9rxdK00r3FF.2_1 2024-06-04T16:09:36.508 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.505+0000 7fadd0216800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1188 2024-06-04T16:09:36.508 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.505+0000 7fadd0216800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.16__multipart_foo-LUKEWARM.2~KDdYPCgJb6LvMg0JlPPA9rxdK00r3FF.3 2024-06-04T16:09:36.508 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.505+0000 7fadd0216800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1461 2024-06-04T16:09:36.508 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.505+0000 7fadd0216800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-06-04T16:09:36.508 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.505+0000 7fadd0216800 20 garbage collection: RGWGC::send_chain - on object name: gc.23tag is: be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.7020005450365376393 2024-06-04T16:09:36.509 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.506+0000 7facaa7fc640 20 handle_completion(): completion ok for obj=foo-LUKEWARM 2024-06-04T16:09:36.509 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.506+0000 7fadd0216800 20 get_obj_state: octx=0x7fadc4086f20 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-STANDARD state=0x562620b26068 s->prefetch_data=0 2024-06-04T16:09:36.509 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.506+0000 7fadd0216800 10 manifest: total_size = 45360 2024-06-04T16:09:36.509 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.506+0000 7fadd0216800 20 RGWObjManifest::operator++(): rule->part_size=20613 rules.size()=2 2024-06-04T16:09:36.509 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.506+0000 7fadd0216800 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=20613 2024-06-04T16:09:36.509 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.506+0000 7fadd0216800 20 RGWObjManifest::operator++(): result: ofs=20613 stripe_ofs=20613 part_ofs=20613 rule->part_size=20613 2024-06-04T16:09:36.509 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.506+0000 7fadd0216800 10 generate_fake_tag new tag=be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.16__multipart_foo-STANDARD.2~U0JhkapXSzFfp-gru_214XqQGZHhyYX.2_78f1e93757d27fcde2fa055560824590 2024-06-04T16:09:36.509 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.506+0000 7fadd0216800 20 get_obj_state: setting s->obj_tag to be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.16__multipart_foo-STANDARD.2~U0JhkapXSzFfp-gru_214XqQGZHhyYX.2_78f1e93757d27fcde2fa055560824590 2024-06-04T16:09:36.509 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.506+0000 7fadd0216800 20 get_obj_state: octx=0x7fadc4086f20 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-STANDARD state=0x562620b26068 s->prefetch_data=0 2024-06-04T16:09:36.510 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.506+0000 7fadd0216800 20 prepare_atomic_modification: state is not atomic. state=0x562620b26068 2024-06-04T16:09:36.510 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.506+0000 7fadd0216800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.16.7 2024-06-04T16:09:36.510 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.509+0000 7fadd0216800 20 RGWObjManifest::operator++(): rule->part_size=20613 rules.size()=2 2024-06-04T16:09:36.510 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.509+0000 7fadd0216800 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=20613 2024-06-04T16:09:36.510 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.509+0000 7fadd0216800 20 RGWObjManifest::operator++(): result: ofs=20613 stripe_ofs=20613 part_ofs=20613 rule->part_size=20613 2024-06-04T16:09:36.511 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.509+0000 7fadd0216800 20 RGWObjManifest::operator++(): rule->part_size=20613 rules.size()=2 2024-06-04T16:09:36.511 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.509+0000 7fadd0216800 20 RGWObjManifest::operator++(): stripe_ofs=4214917 part_ofs=20613 rule->part_size=20613 2024-06-04T16:09:36.511 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.509+0000 7fadd0216800 20 RGWObjManifest::operator++(): result: ofs=41226 stripe_ofs=41226 part_ofs=41226 rule->part_size=4134 2024-06-04T16:09:36.511 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.509+0000 7fadd0216800 20 RGWObjManifest::operator++(): rule->part_size=4134 rules.size()=2 2024-06-04T16:09:36.511 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.509+0000 7fadd0216800 20 RGWObjManifest::operator++(): stripe_ofs=4235530 part_ofs=41226 rule->part_size=4134 2024-06-04T16:09:36.511 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.509+0000 7fadd0216800 20 RGWObjManifest::operator++(): result: ofs=45360 stripe_ofs=45360 part_ofs=45360 rule->part_size=4134 2024-06-04T16:09:36.511 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.509+0000 7fadd0216800 20 garbage collection: RGWGC::send_split_chain - tag is: be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.16__multipart_foo-STANDARD.2~U0JhkapXSzFfp-gru_214XqQGZHhyYX.2_78f1e93757d27fcde2fa055560824590 2024-06-04T16:09:36.511 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.509+0000 7fadd0216800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-06-04T16:09:36.511 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.509+0000 7fadd0216800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.16__multipart_foo-STANDARD.2~U0JhkapXSzFfp-gru_214XqQGZHhyYX.1 2024-06-04T16:09:36.511 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.509+0000 7fadd0216800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 440 2024-06-04T16:09:36.511 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.509+0000 7fadd0216800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.16__multipart_foo-STANDARD.2~U0JhkapXSzFfp-gru_214XqQGZHhyYX.2 2024-06-04T16:09:36.512 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.509+0000 7fadd0216800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 704 2024-06-04T16:09:36.512 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.509+0000 7fadd0216800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.16__multipart_foo-STANDARD.2~U0JhkapXSzFfp-gru_214XqQGZHhyYX.3 2024-06-04T16:09:36.512 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.509+0000 7fadd0216800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 968 2024-06-04T16:09:36.512 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.509+0000 7fadd0216800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-06-04T16:09:36.512 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.509+0000 7fadd0216800 20 garbage collection: RGWGC::send_chain - on object name: gc.14tag is: be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.16__multipart_foo-STANDARD.2~U0JhkapXSzFfp-gru_214XqQGZHhyYX.2_78f1e93757d27fcde2fa055560824590 2024-06-04T16:09:36.513 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.510+0000 7facaaffd640 20 handle_completion(): completion ok for obj=foo-STANDARD-STANDARD 2024-06-04T16:09:36.513 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.511+0000 7fadd0216800 20 get_obj_state: octx=0x7fadb402c830 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-LUKEWARM state=0x562620b26068 s->prefetch_data=0 2024-06-04T16:09:36.513 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.511+0000 7fadd0216800 10 manifest: total_size = 11534336 2024-06-04T16:09:36.513 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.511+0000 7fadd0216800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-06-04T16:09:36.513 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.511+0000 7fadd0216800 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-06-04T16:09:36.513 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.511+0000 7fadd0216800 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-06-04T16:09:36.513 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.511+0000 7fadd0216800 10 generate_fake_tag new tag=be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.16__shadow_foo-LUKEWARM.2~KDdYPCgJb6LvMg0JlPPA9rxdK00r3FF.1_1_ab96485f4a51d5cde2c6c807a4fae7e1 2024-06-04T16:09:36.513 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.511+0000 7fadd0216800 20 get_obj_state: setting s->obj_tag to be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.16__shadow_foo-LUKEWARM.2~KDdYPCgJb6LvMg0JlPPA9rxdK00r3FF.1_1_ab96485f4a51d5cde2c6c807a4fae7e1 2024-06-04T16:09:36.513 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.511+0000 7fadd0216800 20 get_obj_state: octx=0x7fadb402c830 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-LUKEWARM state=0x562620b26068 s->prefetch_data=0 2024-06-04T16:09:36.513 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.511+0000 7fadd0216800 20 prepare_atomic_modification: state is not atomic. state=0x562620b26068 2024-06-04T16:09:36.513 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.511+0000 7fadd0216800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.16.8 2024-06-04T16:09:36.514 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.513+0000 7fadd0216800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-06-04T16:09:36.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.513+0000 7fadd0216800 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-06-04T16:09:36.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.513+0000 7fadd0216800 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-06-04T16:09:36.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.513+0000 7fadd0216800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-06-04T16:09:36.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.513+0000 7fadd0216800 20 RGWObjManifest::operator++(): stripe_ofs=8388608 part_ofs=0 rule->part_size=5242880 2024-06-04T16:09:36.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.513+0000 7fadd0216800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-06-04T16:09:36.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.513+0000 7fadd0216800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-06-04T16:09:36.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.513+0000 7fadd0216800 20 RGWObjManifest::operator++(): stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-06-04T16:09:36.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.513+0000 7fadd0216800 20 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-06-04T16:09:36.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.513+0000 7fadd0216800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-06-04T16:09:36.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.513+0000 7fadd0216800 20 RGWObjManifest::operator++(): stripe_ofs=13631488 part_ofs=5242880 rule->part_size=5242880 2024-06-04T16:09:36.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.513+0000 7fadd0216800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-06-04T16:09:36.516 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.513+0000 7fadd0216800 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-06-04T16:09:36.516 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.513+0000 7fadd0216800 20 RGWObjManifest::operator++(): stripe_ofs=14680064 part_ofs=10485760 rule->part_size=1048576 2024-06-04T16:09:36.516 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.513+0000 7fadd0216800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-06-04T16:09:36.516 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.513+0000 7fadd0216800 20 garbage collection: RGWGC::send_split_chain - tag is: be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.16__shadow_foo-LUKEWARM.2~KDdYPCgJb6LvMg0JlPPA9rxdK00r3FF.1_1_ab96485f4a51d5cde2c6c807a4fae7e1 2024-06-04T16:09:36.516 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.513+0000 7fadd0216800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-06-04T16:09:36.516 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.513+0000 7fadd0216800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.16__multipart_foo-LUKEWARM.2~KDdYPCgJb6LvMg0JlPPA9rxdK00r3FF.1 2024-06-04T16:09:36.516 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.513+0000 7fadd0216800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 448 2024-06-04T16:09:36.516 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.513+0000 7fadd0216800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.16__shadow_foo-LUKEWARM.2~KDdYPCgJb6LvMg0JlPPA9rxdK00r3FF.1_1 2024-06-04T16:09:36.516 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.513+0000 7fadd0216800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 719 2024-06-04T16:09:36.516 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.513+0000 7fadd0216800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.16__multipart_foo-LUKEWARM.2~KDdYPCgJb6LvMg0JlPPA9rxdK00r3FF.2 2024-06-04T16:09:36.516 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.513+0000 7fadd0216800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 992 2024-06-04T16:09:36.516 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.513+0000 7fadd0216800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.16__shadow_foo-LUKEWARM.2~KDdYPCgJb6LvMg0JlPPA9rxdK00r3FF.2_1 2024-06-04T16:09:36.516 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.513+0000 7fadd0216800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1263 2024-06-04T16:09:36.517 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.513+0000 7fadd0216800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.16__multipart_foo-LUKEWARM.2~KDdYPCgJb6LvMg0JlPPA9rxdK00r3FF.3 2024-06-04T16:09:36.517 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.513+0000 7fadd0216800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1536 2024-06-04T16:09:36.517 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.513+0000 7fadd0216800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-06-04T16:09:36.517 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.513+0000 7fadd0216800 20 garbage collection: RGWGC::send_chain - on object name: gc.1tag is: be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.16__shadow_foo-LUKEWARM.2~KDdYPCgJb6LvMg0JlPPA9rxdK00r3FF.1_1_ab96485f4a51d5cde2c6c807a4fae7e1 2024-06-04T16:09:36.517 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.514+0000 7facaa7fc640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-LUKEWARM 2024-06-04T16:09:36.517 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.515+0000 7fadd0216800 20 get_obj_state: octx=0x7fadb402cbb0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-FROZEN state=0x562620b26068 s->prefetch_data=0 2024-06-04T16:09:36.518 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.515+0000 7fadd0216800 10 manifest: total_size = 45360 2024-06-04T16:09:36.518 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.515+0000 7fadd0216800 20 get_obj_state: setting s->obj_tag to __KSBYwZUmphFzYGrCz8YFR0zN_r7m7V 2024-06-04T16:09:36.518 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.515+0000 7fadd0216800 20 get_obj_state: octx=0x7fadb402cbb0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-FROZEN state=0x562620b26068 s->prefetch_data=0 2024-06-04T16:09:36.518 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.515+0000 7fadd0216800 20 prepare_atomic_modification: state is not atomic. state=0x562620b26068 2024-06-04T16:09:36.518 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.515+0000 7fadd0216800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.16.8 2024-06-04T16:09:36.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.517+0000 7fadd0216800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-06-04T16:09:36.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.517+0000 7fadd0216800 20 RGWObjManifest::operator++(): result: ofs=45360 stripe_ofs=45360 part_ofs=0 rule->part_size=0 2024-06-04T16:09:36.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.517+0000 7fadd0216800 20 garbage collection: RGWGC::send_split_chain - tag is: __KSBYwZUmphFzYGrCz8YFR0zN_r7m7V 2024-06-04T16:09:36.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.517+0000 7fadd0216800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-06-04T16:09:36.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.517+0000 7fadd0216800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.16__shadow_.ZNoD6u8yGZTCTYNrGIIfZ4XIJkXJV2g_0 2024-06-04T16:09:36.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.517+0000 7fadd0216800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 308 2024-06-04T16:09:36.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.517+0000 7fadd0216800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-06-04T16:09:36.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.517+0000 7fadd0216800 20 garbage collection: RGWGC::send_chain - on object name: gc.21tag is: __KSBYwZUmphFzYGrCz8YFR0zN_r7m7V 2024-06-04T16:09:36.520 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.518+0000 7facaaffd640 20 handle_completion(): completion ok for obj=foo-STANDARD-FROZEN 2024-06-04T16:09:36.520 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.519+0000 7fadd0216800 20 get_obj_state: octx=0x7fadb402cbb0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-FROZEN state=0x562620b26068 s->prefetch_data=0 2024-06-04T16:09:36.520 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.519+0000 7fadd0216800 10 manifest: total_size = 11534336 2024-06-04T16:09:36.520 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.519+0000 7fadd0216800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-06-04T16:09:36.520 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.519+0000 7fadd0216800 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-06-04T16:09:36.520 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.519+0000 7fadd0216800 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-06-04T16:09:36.520 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.519+0000 7fadd0216800 10 generate_fake_tag new tag=be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.16__shadow_foo-FROZEN.2~lkaHT8quzFXpVBXAABUXtSMFtHto0EW.1_1_5a1f086901129bc3689d9633db6219cb 2024-06-04T16:09:36.520 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.519+0000 7fadd0216800 20 get_obj_state: setting s->obj_tag to be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.16__shadow_foo-FROZEN.2~lkaHT8quzFXpVBXAABUXtSMFtHto0EW.1_1_5a1f086901129bc3689d9633db6219cb 2024-06-04T16:09:36.521 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.519+0000 7fadd0216800 20 get_obj_state: octx=0x7fadb402cbb0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-FROZEN state=0x562620b26068 s->prefetch_data=0 2024-06-04T16:09:36.521 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.519+0000 7fadd0216800 20 prepare_atomic_modification: state is not atomic. state=0x562620b26068 2024-06-04T16:09:36.521 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.519+0000 7fadd0216800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.16.9 2024-06-04T16:09:36.523 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.522+0000 7fadd0216800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-06-04T16:09:36.523 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.522+0000 7fadd0216800 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-06-04T16:09:36.523 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.522+0000 7fadd0216800 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-06-04T16:09:36.523 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.522+0000 7fadd0216800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-06-04T16:09:36.523 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.522+0000 7fadd0216800 20 RGWObjManifest::operator++(): stripe_ofs=8388608 part_ofs=0 rule->part_size=5242880 2024-06-04T16:09:36.523 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.522+0000 7fadd0216800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-06-04T16:09:36.523 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.522+0000 7fadd0216800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-06-04T16:09:36.523 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.522+0000 7fadd0216800 20 RGWObjManifest::operator++(): stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-06-04T16:09:36.523 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.522+0000 7fadd0216800 20 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-06-04T16:09:36.523 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.522+0000 7fadd0216800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-06-04T16:09:36.523 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.522+0000 7fadd0216800 20 RGWObjManifest::operator++(): stripe_ofs=13631488 part_ofs=5242880 rule->part_size=5242880 2024-06-04T16:09:36.523 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.522+0000 7fadd0216800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-06-04T16:09:36.523 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.522+0000 7fadd0216800 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-06-04T16:09:36.523 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.522+0000 7fadd0216800 20 RGWObjManifest::operator++(): stripe_ofs=14680064 part_ofs=10485760 rule->part_size=1048576 2024-06-04T16:09:36.524 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.522+0000 7fadd0216800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-06-04T16:09:36.524 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.522+0000 7fadd0216800 20 garbage collection: RGWGC::send_split_chain - tag is: be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.16__shadow_foo-FROZEN.2~lkaHT8quzFXpVBXAABUXtSMFtHto0EW.1_1_5a1f086901129bc3689d9633db6219cb 2024-06-04T16:09:36.524 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.522+0000 7fadd0216800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-06-04T16:09:36.524 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.522+0000 7fadd0216800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.16__multipart_foo-FROZEN.2~lkaHT8quzFXpVBXAABUXtSMFtHto0EW.1 2024-06-04T16:09:36.524 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.522+0000 7fadd0216800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 440 2024-06-04T16:09:36.524 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.522+0000 7fadd0216800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.16__shadow_foo-FROZEN.2~lkaHT8quzFXpVBXAABUXtSMFtHto0EW.1_1 2024-06-04T16:09:36.524 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.522+0000 7fadd0216800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 705 2024-06-04T16:09:36.524 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.522+0000 7fadd0216800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.16__multipart_foo-FROZEN.2~lkaHT8quzFXpVBXAABUXtSMFtHto0EW.2 2024-06-04T16:09:36.524 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.522+0000 7fadd0216800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 972 2024-06-04T16:09:36.524 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.522+0000 7fadd0216800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.16__shadow_foo-FROZEN.2~lkaHT8quzFXpVBXAABUXtSMFtHto0EW.2_1 2024-06-04T16:09:36.524 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.522+0000 7fadd0216800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1237 2024-06-04T16:09:36.524 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.522+0000 7fadd0216800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.16__multipart_foo-FROZEN.2~lkaHT8quzFXpVBXAABUXtSMFtHto0EW.3 2024-06-04T16:09:36.524 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.522+0000 7fadd0216800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1504 2024-06-04T16:09:36.524 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.522+0000 7fadd0216800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-06-04T16:09:36.524 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.522+0000 7fadd0216800 20 garbage collection: RGWGC::send_chain - on object name: gc.9tag is: be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.16__shadow_foo-FROZEN.2~lkaHT8quzFXpVBXAABUXtSMFtHto0EW.1_1_5a1f086901129bc3689d9633db6219cb 2024-06-04T16:09:36.525 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.523+0000 7facaa7fc640 20 handle_completion(): completion ok for obj=foo-FROZEN-FROZEN 2024-06-04T16:09:36.525 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.523+0000 7fadd0216800 20 list_objects_ordered: starting attempt 1 2024-06-04T16:09:36.525 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.523+0000 7fadd0216800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-06-04T16:09:36.526 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.524+0000 7fadd0216800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-06-04T16:09:36.526 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.524+0000 7fadd0216800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-06-04T16:09:36.526 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.524+0000 7fadd0216800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-06-04T16:09:36.526 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.524+0000 7fadd0216800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-06-04T16:09:36.526 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.524+0000 7fadd0216800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class-multipart-copy.1[be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.16])"; uploads.size()=0; is_truncated=0 2024-06-04T16:09:36.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.525+0000 7fadd0216800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 : miss 2024-06-04T16:09:36.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.525+0000 7fadd0216800 20 rados->read ofs=0 len=0 2024-06-04T16:09:36.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.526+0000 7fadd0216800 20 rados_obj.operate() r=0 bl.length=243 2024-06-04T16:09:36.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.526+0000 7fadd0216800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 info.flags=0x11 2024-06-04T16:09:36.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.526+0000 7fadd0216800 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 to cache LRU end 2024-06-04T16:09:36.528 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.527+0000 7fadd0216800 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 from cache 2024-06-04T16:09:36.528 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.527+0000 7fadd0216800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-obj-storage-class-multipart-copy.1, ofs0, ns] 2024-06-04T16:09:36.528 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.527+0000 7facaaffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1078036791307 cookie 94721756970640 notifier 5600 bl.length()=199 2024-06-04T16:09:36.529 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.528+0000 7fadd0216800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.16 from cache 2024-06-04T16:09:36.529 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.528+0000 7fadd0216800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.16, ofs0, ns] 2024-06-04T16:09:36.530 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.528+0000 7facaa7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1078036791313 cookie 94721756967088 notifier 5600 bl.length()=257 2024-06-04T16:09:36.532 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.531+0000 7fadd0216800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart-copy.1/be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.16 : miss 2024-06-04T16:09:36.532 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.531+0000 7fadd0216800 20 rados->read ofs=0 len=0 2024-06-04T16:09:36.532 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.531+0000 7fadd0216800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:09:36.532 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.531+0000 7fadd0216800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart-copy.1/be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.16 info.flags=0x0 2024-06-04T16:09:36.532 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.531+0000 7fadd0216800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart-copy.1/be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.16 to cache LRU end 2024-06-04T16:09:36.534 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.533+0000 7fadd0216800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.14 : miss 2024-06-04T16:09:36.534 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.533+0000 7fadd0216800 20 rados->read ofs=0 len=0 2024-06-04T16:09:36.534 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.534+0000 7fadd0216800 20 rados_obj.operate() r=0 bl.length=452 2024-06-04T16:09:36.535 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.534+0000 7fadd0216800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.14 info.flags=0x17 2024-06-04T16:09:36.535 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.534+0000 7fadd0216800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.14 to cache LRU end 2024-06-04T16:09:36.535 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.534+0000 7fadd0216800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-06-04T16:09:36.535 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.534+0000 7fadd0216800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-06-04T16:09:36.535 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.534+0000 7fadd0216800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.14 2024-06-04T16:09:36.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.535+0000 7fadd0216800 10 cls_bucket_list_unordered: got foo-FROZEN 2024-06-04T16:09:36.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.536+0000 7fadd0216800 10 cls_bucket_list_unordered: got foo-STANDARD 2024-06-04T16:09:36.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.537+0000 7fadd0216800 10 cls_bucket_list_unordered: got foo-LUKEWARM 2024-06-04T16:09:36.539 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.538+0000 7fadd0216800 20 get_obj_state: octx=0x562620b90d80 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-FROZEN state=0x562620ac60d8 s->prefetch_data=0 2024-06-04T16:09:36.539 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.538+0000 7fadd0216800 10 manifest: total_size = 11534336 2024-06-04T16:09:36.539 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.538+0000 7fadd0216800 20 get_obj_state: setting s->obj_tag to be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.7978906938230085934 2024-06-04T16:09:36.539 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.538+0000 7fadd0216800 20 get_obj_state: octx=0x562620b90d80 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-FROZEN state=0x562620ac60d8 s->prefetch_data=0 2024-06-04T16:09:36.539 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.538+0000 7fadd0216800 20 prepare_atomic_modification: state is not atomic. state=0x562620ac60d8 2024-06-04T16:09:36.539 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.538+0000 7fadd0216800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.14.3 2024-06-04T16:09:36.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.541+0000 7fadd0216800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-06-04T16:09:36.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.541+0000 7fadd0216800 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-06-04T16:09:36.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.541+0000 7fadd0216800 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-06-04T16:09:36.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.541+0000 7fadd0216800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-06-04T16:09:36.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.541+0000 7fadd0216800 20 RGWObjManifest::operator++(): stripe_ofs=8388608 part_ofs=0 rule->part_size=5242880 2024-06-04T16:09:36.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.541+0000 7fadd0216800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-06-04T16:09:36.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.541+0000 7fadd0216800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-06-04T16:09:36.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.541+0000 7fadd0216800 20 RGWObjManifest::operator++(): stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-06-04T16:09:36.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.541+0000 7fadd0216800 20 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-06-04T16:09:36.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.541+0000 7fadd0216800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-06-04T16:09:36.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.541+0000 7fadd0216800 20 RGWObjManifest::operator++(): stripe_ofs=13631488 part_ofs=5242880 rule->part_size=5242880 2024-06-04T16:09:36.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.541+0000 7fadd0216800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-06-04T16:09:36.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.541+0000 7fadd0216800 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-06-04T16:09:36.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.541+0000 7fadd0216800 20 RGWObjManifest::operator++(): stripe_ofs=14680064 part_ofs=10485760 rule->part_size=1048576 2024-06-04T16:09:36.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.541+0000 7fadd0216800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-06-04T16:09:36.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.541+0000 7fadd0216800 20 garbage collection: RGWGC::send_split_chain - tag is: be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.7978906938230085934 2024-06-04T16:09:36.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.541+0000 7fadd0216800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-06-04T16:09:36.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.541+0000 7fadd0216800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.14__multipart_foo-FROZEN.2~XF8mWqTh5UnxYb-JtvLnMh75R5uqAO6.1 2024-06-04T16:09:36.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.541+0000 7fadd0216800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 367 2024-06-04T16:09:36.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.541+0000 7fadd0216800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.14__shadow_foo-FROZEN.2~XF8mWqTh5UnxYb-JtvLnMh75R5uqAO6.1_1 2024-06-04T16:09:36.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.541+0000 7fadd0216800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 632 2024-06-04T16:09:36.544 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.541+0000 7fadd0216800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.14__multipart_foo-FROZEN.2~XF8mWqTh5UnxYb-JtvLnMh75R5uqAO6.2 2024-06-04T16:09:36.544 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.541+0000 7fadd0216800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 899 2024-06-04T16:09:36.544 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.541+0000 7fadd0216800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.14__shadow_foo-FROZEN.2~XF8mWqTh5UnxYb-JtvLnMh75R5uqAO6.2_1 2024-06-04T16:09:36.544 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.541+0000 7fadd0216800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1164 2024-06-04T16:09:36.544 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.541+0000 7fadd0216800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.14__multipart_foo-FROZEN.2~XF8mWqTh5UnxYb-JtvLnMh75R5uqAO6.3 2024-06-04T16:09:36.544 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.541+0000 7fadd0216800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1431 2024-06-04T16:09:36.544 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.541+0000 7fadd0216800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-06-04T16:09:36.544 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.541+0000 7fadd0216800 20 garbage collection: RGWGC::send_chain - on object name: gc.24tag is: be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.7978906938230085934 2024-06-04T16:09:36.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.542+0000 7facaa7fc640 20 handle_completion(): completion ok for obj=foo-FROZEN 2024-06-04T16:09:36.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.542+0000 7fadd0216800 20 get_obj_state: octx=0x562620b1db20 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-STANDARD state=0x562620ac60d8 s->prefetch_data=0 2024-06-04T16:09:36.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.543+0000 7fadd0216800 10 manifest: total_size = 11534336 2024-06-04T16:09:36.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.543+0000 7fadd0216800 20 get_obj_state: setting s->obj_tag to be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.13380312825509217859 2024-06-04T16:09:36.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.543+0000 7fadd0216800 20 get_obj_state: octx=0x562620b1db20 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-STANDARD state=0x562620ac60d8 s->prefetch_data=0 2024-06-04T16:09:36.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.543+0000 7fadd0216800 20 prepare_atomic_modification: state is not atomic. state=0x562620ac60d8 2024-06-04T16:09:36.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.543+0000 7fadd0216800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.14.5 2024-06-04T16:09:36.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.545+0000 7fadd0216800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-06-04T16:09:36.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.545+0000 7fadd0216800 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-06-04T16:09:36.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.545+0000 7fadd0216800 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-06-04T16:09:36.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.545+0000 7fadd0216800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-06-04T16:09:36.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.545+0000 7fadd0216800 20 RGWObjManifest::operator++(): stripe_ofs=8388608 part_ofs=0 rule->part_size=5242880 2024-06-04T16:09:36.547 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.545+0000 7fadd0216800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-06-04T16:09:36.547 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.545+0000 7fadd0216800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-06-04T16:09:36.547 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.545+0000 7fadd0216800 20 RGWObjManifest::operator++(): stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-06-04T16:09:36.547 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.545+0000 7fadd0216800 20 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-06-04T16:09:36.547 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.545+0000 7fadd0216800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-06-04T16:09:36.547 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.545+0000 7fadd0216800 20 RGWObjManifest::operator++(): stripe_ofs=13631488 part_ofs=5242880 rule->part_size=5242880 2024-06-04T16:09:36.547 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.545+0000 7fadd0216800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-06-04T16:09:36.547 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.545+0000 7fadd0216800 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-06-04T16:09:36.547 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.545+0000 7fadd0216800 20 RGWObjManifest::operator++(): stripe_ofs=14680064 part_ofs=10485760 rule->part_size=1048576 2024-06-04T16:09:36.547 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.545+0000 7fadd0216800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-06-04T16:09:36.547 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.545+0000 7fadd0216800 20 garbage collection: RGWGC::send_split_chain - tag is: be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.13380312825509217859 2024-06-04T16:09:36.547 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.545+0000 7fadd0216800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-06-04T16:09:36.547 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.545+0000 7fadd0216800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.14__multipart_foo-STANDARD.2~E6psHHZa3SBHUZDS18nIDEywWfzPpA-.1 2024-06-04T16:09:36.547 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.545+0000 7fadd0216800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 365 2024-06-04T16:09:36.548 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.545+0000 7fadd0216800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.14__shadow_foo-STANDARD.2~E6psHHZa3SBHUZDS18nIDEywWfzPpA-.1_1 2024-06-04T16:09:36.548 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.545+0000 7fadd0216800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 627 2024-06-04T16:09:36.548 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.545+0000 7fadd0216800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.14__multipart_foo-STANDARD.2~E6psHHZa3SBHUZDS18nIDEywWfzPpA-.2 2024-06-04T16:09:36.548 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.545+0000 7fadd0216800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 891 2024-06-04T16:09:36.548 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.545+0000 7fadd0216800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.14__shadow_foo-STANDARD.2~E6psHHZa3SBHUZDS18nIDEywWfzPpA-.2_1 2024-06-04T16:09:36.548 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.545+0000 7fadd0216800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1153 2024-06-04T16:09:36.548 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.545+0000 7fadd0216800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.14__multipart_foo-STANDARD.2~E6psHHZa3SBHUZDS18nIDEywWfzPpA-.3 2024-06-04T16:09:36.548 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.545+0000 7fadd0216800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1417 2024-06-04T16:09:36.548 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.545+0000 7fadd0216800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-06-04T16:09:36.548 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.545+0000 7fadd0216800 20 garbage collection: RGWGC::send_chain - on object name: gc.25tag is: be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.13380312825509217859 2024-06-04T16:09:36.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.546+0000 7facaaffd640 20 handle_completion(): completion ok for obj=foo-STANDARD 2024-06-04T16:09:36.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.546+0000 7fadd0216800 20 get_obj_state: octx=0x7fadc40045a0 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-LUKEWARM state=0x562620ac60d8 s->prefetch_data=0 2024-06-04T16:09:36.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.547+0000 7fadd0216800 10 manifest: total_size = 11534336 2024-06-04T16:09:36.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.547+0000 7fadd0216800 20 get_obj_state: setting s->obj_tag to be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.5200684822471160745 2024-06-04T16:09:36.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.547+0000 7fadd0216800 20 get_obj_state: octx=0x7fadc40045a0 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-LUKEWARM state=0x562620ac60d8 s->prefetch_data=0 2024-06-04T16:09:36.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.547+0000 7fadd0216800 20 prepare_atomic_modification: state is not atomic. state=0x562620ac60d8 2024-06-04T16:09:36.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.547+0000 7fadd0216800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.14.7 2024-06-04T16:09:36.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.549+0000 7fadd0216800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-06-04T16:09:36.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.549+0000 7fadd0216800 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-06-04T16:09:36.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.549+0000 7fadd0216800 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-06-04T16:09:36.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.549+0000 7fadd0216800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-06-04T16:09:36.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.549+0000 7fadd0216800 20 RGWObjManifest::operator++(): stripe_ofs=8388608 part_ofs=0 rule->part_size=5242880 2024-06-04T16:09:36.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.549+0000 7fadd0216800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-06-04T16:09:36.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.549+0000 7fadd0216800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-06-04T16:09:36.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.549+0000 7fadd0216800 20 RGWObjManifest::operator++(): stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-06-04T16:09:36.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.549+0000 7fadd0216800 20 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-06-04T16:09:36.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.549+0000 7fadd0216800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-06-04T16:09:36.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.549+0000 7fadd0216800 20 RGWObjManifest::operator++(): stripe_ofs=13631488 part_ofs=5242880 rule->part_size=5242880 2024-06-04T16:09:36.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.549+0000 7fadd0216800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-06-04T16:09:36.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.549+0000 7fadd0216800 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-06-04T16:09:36.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.549+0000 7fadd0216800 20 RGWObjManifest::operator++(): stripe_ofs=14680064 part_ofs=10485760 rule->part_size=1048576 2024-06-04T16:09:36.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.549+0000 7fadd0216800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-06-04T16:09:36.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.549+0000 7fadd0216800 20 garbage collection: RGWGC::send_split_chain - tag is: be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.5200684822471160745 2024-06-04T16:09:36.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.549+0000 7fadd0216800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-06-04T16:09:36.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.549+0000 7fadd0216800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.14__multipart_foo-LUKEWARM.2~Q0eiY4dZv2_5JlktS3pb3VRb4O7AGgO.1 2024-06-04T16:09:36.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.549+0000 7fadd0216800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 373 2024-06-04T16:09:36.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.549+0000 7fadd0216800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.14__shadow_foo-LUKEWARM.2~Q0eiY4dZv2_5JlktS3pb3VRb4O7AGgO.1_1 2024-06-04T16:09:36.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.549+0000 7fadd0216800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 644 2024-06-04T16:09:36.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.549+0000 7fadd0216800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.14__multipart_foo-LUKEWARM.2~Q0eiY4dZv2_5JlktS3pb3VRb4O7AGgO.2 2024-06-04T16:09:36.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.549+0000 7fadd0216800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 917 2024-06-04T16:09:36.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.549+0000 7fadd0216800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.14__shadow_foo-LUKEWARM.2~Q0eiY4dZv2_5JlktS3pb3VRb4O7AGgO.2_1 2024-06-04T16:09:36.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.549+0000 7fadd0216800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1188 2024-06-04T16:09:36.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.549+0000 7fadd0216800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.14__multipart_foo-LUKEWARM.2~Q0eiY4dZv2_5JlktS3pb3VRb4O7AGgO.3 2024-06-04T16:09:36.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.549+0000 7fadd0216800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1461 2024-06-04T16:09:36.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.549+0000 7fadd0216800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-06-04T16:09:36.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.549+0000 7fadd0216800 20 garbage collection: RGWGC::send_chain - on object name: gc.4tag is: be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.5200684822471160745 2024-06-04T16:09:36.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.550+0000 7facaa7fc640 20 handle_completion(): completion ok for obj=foo-LUKEWARM 2024-06-04T16:09:36.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.550+0000 7fadd0216800 20 list_objects_ordered: starting attempt 1 2024-06-04T16:09:36.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.550+0000 7fadd0216800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-06-04T16:09:36.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.551+0000 7fadd0216800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-06-04T16:09:36.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.551+0000 7fadd0216800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-06-04T16:09:36.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.551+0000 7fadd0216800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-06-04T16:09:36.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.551+0000 7fadd0216800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-06-04T16:09:36.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.551+0000 7fadd0216800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class-multipart.1[be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.14])"; uploads.size()=0; is_truncated=0 2024-06-04T16:09:36.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.552+0000 7fadd0216800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 : miss 2024-06-04T16:09:36.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.552+0000 7fadd0216800 20 rados->read ofs=0 len=0 2024-06-04T16:09:36.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.553+0000 7fadd0216800 20 rados_obj.operate() r=0 bl.length=238 2024-06-04T16:09:36.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.553+0000 7fadd0216800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 info.flags=0x11 2024-06-04T16:09:36.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.553+0000 7fadd0216800 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 to cache LRU end 2024-06-04T16:09:36.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.554+0000 7fadd0216800 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 from cache 2024-06-04T16:09:36.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.554+0000 7fadd0216800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-obj-storage-class-multipart.1, ofs0, ns] 2024-06-04T16:09:36.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.554+0000 7facaa7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1078036791372 cookie 94721756974480 notifier 5600 bl.length()=194 2024-06-04T16:09:36.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.555+0000 7fadd0216800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.14 from cache 2024-06-04T16:09:36.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.555+0000 7fadd0216800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.14, ofs0, ns] 2024-06-04T16:09:36.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.556+0000 7facaaffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1078036791314 cookie 94721756967088 notifier 5600 bl.length()=252 2024-06-04T16:09:36.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.558+0000 7fadd0216800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart.1/be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.14 : miss 2024-06-04T16:09:36.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.558+0000 7fadd0216800 20 rados->read ofs=0 len=0 2024-06-04T16:09:36.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.558+0000 7fadd0216800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:09:36.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.558+0000 7fadd0216800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart.1/be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.14 info.flags=0x0 2024-06-04T16:09:36.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.558+0000 7fadd0216800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart.1/be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.14 to cache LRU end 2024-06-04T16:09:36.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.560+0000 7fadd0216800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.13 : miss 2024-06-04T16:09:36.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.560+0000 7fadd0216800 20 rados->read ofs=0 len=0 2024-06-04T16:09:36.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.561+0000 7fadd0216800 20 rados_obj.operate() r=0 bl.length=442 2024-06-04T16:09:36.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.561+0000 7fadd0216800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.13 info.flags=0x17 2024-06-04T16:09:36.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.561+0000 7fadd0216800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.13 to cache LRU end 2024-06-04T16:09:36.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.561+0000 7fadd0216800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-06-04T16:09:36.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.561+0000 7fadd0216800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-06-04T16:09:36.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.561+0000 7fadd0216800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.13 2024-06-04T16:09:36.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.562+0000 7fadd0216800 10 cls_bucket_list_unordered: got foo-FROZEN 2024-06-04T16:09:36.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.563+0000 7fadd0216800 10 cls_bucket_list_unordered: got foo-STANDARD 2024-06-04T16:09:36.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.563+0000 7fadd0216800 10 cls_bucket_list_unordered: got foo-LUKEWARM 2024-06-04T16:09:36.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.564+0000 7fadd0216800 20 get_obj_state: octx=0x562620b1a7d0 obj=test-client.0-r-test-obj-storage-class.1:foo-FROZEN state=0x562620b23be8 s->prefetch_data=0 2024-06-04T16:09:36.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.565+0000 7fadd0216800 10 manifest: total_size = 10485760 2024-06-04T16:09:36.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.565+0000 7fadd0216800 20 get_obj_state: setting s->obj_tag to be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.226221174536118357 2024-06-04T16:09:36.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.565+0000 7fadd0216800 20 get_obj_state: octx=0x562620b1a7d0 obj=test-client.0-r-test-obj-storage-class.1:foo-FROZEN state=0x562620b23be8 s->prefetch_data=0 2024-06-04T16:09:36.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.565+0000 7fadd0216800 20 prepare_atomic_modification: state is not atomic. state=0x562620b23be8 2024-06-04T16:09:36.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.565+0000 7fadd0216800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.13.3 2024-06-04T16:09:36.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.567+0000 7fadd0216800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-06-04T16:09:36.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.567+0000 7fadd0216800 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2024-06-04T16:09:36.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.567+0000 7fadd0216800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-06-04T16:09:36.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.567+0000 7fadd0216800 20 RGWObjManifest::operator++(): result: ofs=8388608 stripe_ofs=8388608 part_ofs=0 rule->part_size=0 2024-06-04T16:09:36.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.567+0000 7fadd0216800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-06-04T16:09:36.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.567+0000 7fadd0216800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=0 rule->part_size=0 2024-06-04T16:09:36.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.567+0000 7fadd0216800 20 garbage collection: RGWGC::send_split_chain - tag is: be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.226221174536118357 2024-06-04T16:09:36.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.567+0000 7fadd0216800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-06-04T16:09:36.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.567+0000 7fadd0216800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.13__shadow_.p-awvWEhdhrqxKvnvlGh3R9z6Kd32sX_0 2024-06-04T16:09:36.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.567+0000 7fadd0216800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 336 2024-06-04T16:09:36.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.567+0000 7fadd0216800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.13__shadow_.p-awvWEhdhrqxKvnvlGh3R9z6Kd32sX_1 2024-06-04T16:09:36.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.567+0000 7fadd0216800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 573 2024-06-04T16:09:36.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.567+0000 7fadd0216800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.13__shadow_.p-awvWEhdhrqxKvnvlGh3R9z6Kd32sX_2 2024-06-04T16:09:36.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.567+0000 7fadd0216800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 810 2024-06-04T16:09:36.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.567+0000 7fadd0216800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-06-04T16:09:36.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.567+0000 7fadd0216800 20 garbage collection: RGWGC::send_chain - on object name: gc.10tag is: be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.226221174536118357 2024-06-04T16:09:36.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.568+0000 7facaa7fc640 20 handle_completion(): completion ok for obj=foo-FROZEN 2024-06-04T16:09:36.570 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.568+0000 7fadd0216800 20 get_obj_state: octx=0x7fadb402cbb0 obj=test-client.0-r-test-obj-storage-class.1:foo-STANDARD state=0x562620b23be8 s->prefetch_data=0 2024-06-04T16:09:36.570 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.569+0000 7fadd0216800 10 manifest: total_size = 53502 2024-06-04T16:09:36.570 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.569+0000 7fadd0216800 20 get_obj_state: setting s->obj_tag to be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.9684727290202798748 2024-06-04T16:09:36.570 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.569+0000 7fadd0216800 20 get_obj_state: octx=0x7fadb402cbb0 obj=test-client.0-r-test-obj-storage-class.1:foo-STANDARD state=0x562620b23be8 s->prefetch_data=0 2024-06-04T16:09:36.570 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.569+0000 7fadd0216800 20 prepare_atomic_modification: state is not atomic. state=0x562620b23be8 2024-06-04T16:09:36.570 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.569+0000 7fadd0216800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.13.5 2024-06-04T16:09:36.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.571+0000 7fadd0216800 20 get_obj_state: octx=0x7fadc40045a0 obj=test-client.0-r-test-obj-storage-class.1:foo-LUKEWARM state=0x562620b23be8 s->prefetch_data=0 2024-06-04T16:09:36.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.571+0000 7fadd0216800 10 manifest: total_size = 10485760 2024-06-04T16:09:36.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.571+0000 7fadd0216800 20 get_obj_state: setting s->obj_tag to be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.17169267022589342066 2024-06-04T16:09:36.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.571+0000 7fadd0216800 20 get_obj_state: octx=0x7fadc40045a0 obj=test-client.0-r-test-obj-storage-class.1:foo-LUKEWARM state=0x562620b23be8 s->prefetch_data=0 2024-06-04T16:09:36.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.571+0000 7fadd0216800 20 prepare_atomic_modification: state is not atomic. state=0x562620b23be8 2024-06-04T16:09:36.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.571+0000 7fadd0216800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.13.7 2024-06-04T16:09:36.573 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.572+0000 7facaaffd640 20 handle_completion(): completion ok for obj=foo-STANDARD 2024-06-04T16:09:36.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.574+0000 7fadd0216800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-06-04T16:09:36.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.574+0000 7fadd0216800 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2024-06-04T16:09:36.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.574+0000 7fadd0216800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-06-04T16:09:36.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.574+0000 7fadd0216800 20 RGWObjManifest::operator++(): result: ofs=8388608 stripe_ofs=8388608 part_ofs=0 rule->part_size=0 2024-06-04T16:09:36.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.574+0000 7fadd0216800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-06-04T16:09:36.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.574+0000 7fadd0216800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=0 rule->part_size=0 2024-06-04T16:09:36.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.574+0000 7fadd0216800 20 garbage collection: RGWGC::send_split_chain - tag is: be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.17169267022589342066 2024-06-04T16:09:36.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.574+0000 7fadd0216800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-06-04T16:09:36.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.574+0000 7fadd0216800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.13__shadow_.sFTaAHkZlO2kMQKibrPcM2TYbJr3Zt2_0 2024-06-04T16:09:36.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.574+0000 7fadd0216800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 340 2024-06-04T16:09:36.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.574+0000 7fadd0216800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.13__shadow_.sFTaAHkZlO2kMQKibrPcM2TYbJr3Zt2_1 2024-06-04T16:09:36.576 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.574+0000 7fadd0216800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 579 2024-06-04T16:09:36.576 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.574+0000 7fadd0216800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.13__shadow_.sFTaAHkZlO2kMQKibrPcM2TYbJr3Zt2_2 2024-06-04T16:09:36.576 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.574+0000 7fadd0216800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 818 2024-06-04T16:09:36.576 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.574+0000 7fadd0216800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-06-04T16:09:36.576 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.574+0000 7fadd0216800 20 garbage collection: RGWGC::send_chain - on object name: gc.10tag is: be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.17169267022589342066 2024-06-04T16:09:36.577 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.575+0000 7facaa7fc640 20 handle_completion(): completion ok for obj=foo-LUKEWARM 2024-06-04T16:09:36.577 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.575+0000 7fadd0216800 20 list_objects_ordered: starting attempt 1 2024-06-04T16:09:36.577 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.575+0000 7fadd0216800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-06-04T16:09:36.577 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.576+0000 7fadd0216800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-06-04T16:09:36.577 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.576+0000 7fadd0216800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-06-04T16:09:36.577 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.576+0000 7fadd0216800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-06-04T16:09:36.577 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.576+0000 7fadd0216800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-06-04T16:09:36.577 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.576+0000 7fadd0216800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class.1[be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.13])"; uploads.size()=0; is_truncated=0 2024-06-04T16:09:36.578 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.577+0000 7fadd0216800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 : miss 2024-06-04T16:09:36.578 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.577+0000 7fadd0216800 20 rados->read ofs=0 len=0 2024-06-04T16:09:36.578 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.578+0000 7fadd0216800 20 rados_obj.operate() r=0 bl.length=228 2024-06-04T16:09:36.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.578+0000 7fadd0216800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 info.flags=0x11 2024-06-04T16:09:36.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.578+0000 7fadd0216800 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 to cache LRU end 2024-06-04T16:09:36.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.579+0000 7fadd0216800 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 from cache 2024-06-04T16:09:36.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.579+0000 7fadd0216800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-obj-storage-class.1, ofs0, ns] 2024-06-04T16:09:36.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.579+0000 7facaaffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1078036791315 cookie 94721756967088 notifier 5600 bl.length()=184 2024-06-04T16:09:36.581 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.580+0000 7fadd0216800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.13 from cache 2024-06-04T16:09:36.581 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.580+0000 7fadd0216800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class.1:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.13, ofs0, ns] 2024-06-04T16:09:36.581 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.581+0000 7facaa7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1078036791374 cookie 94721756963440 notifier 5600 bl.length()=242 2024-06-04T16:09:36.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.583+0000 7fadd0216800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class.1/be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.13 : miss 2024-06-04T16:09:36.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.583+0000 7fadd0216800 20 rados->read ofs=0 len=0 2024-06-04T16:09:36.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.583+0000 7fadd0216800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:09:36.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.583+0000 7fadd0216800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class.1/be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.13 info.flags=0x0 2024-06-04T16:09:36.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.583+0000 7fadd0216800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class.1/be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.13 to cache LRU end 2024-06-04T16:09:36.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.585+0000 7fadd0216800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.6 : miss 2024-06-04T16:09:36.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.585+0000 7fadd0216800 20 rados->read ofs=0 len=0 2024-06-04T16:09:36.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.586+0000 7fadd0216800 20 rados_obj.operate() r=0 bl.length=437 2024-06-04T16:09:36.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.586+0000 7fadd0216800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.6 info.flags=0x17 2024-06-04T16:09:36.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.586+0000 7fadd0216800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.6 to cache LRU end 2024-06-04T16:09:36.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.586+0000 7fadd0216800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-06-04T16:09:36.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.586+0000 7fadd0216800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-06-04T16:09:36.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.586+0000 7fadd0216800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.6 2024-06-04T16:09:36.588 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.587+0000 7fadd0216800 10 cls_bucket_list_unordered: got ___ 2024-06-04T16:09:36.588 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.588+0000 7fadd0216800 10 cls_bucket_list_unordered: got __ _ 2024-06-04T16:09:36.589 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.589+0000 7fadd0216800 10 cls_bucket_list_unordered: got __ 2024-06-04T16:09:36.590 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.589+0000 7fadd0216800 10 cls_bucket_list_unordered: got obj 2024-06-04T16:09:36.590 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.590+0000 7fadd0216800 20 get_obj_state: octx=0x562620b1b3a0 obj=test-client.0-r-test-small-obj-data.1:___ state=0x562620ac7388 s->prefetch_data=0 2024-06-04T16:09:36.591 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.590+0000 7fadd0216800 10 manifest: total_size = 0 2024-06-04T16:09:36.591 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.590+0000 7fadd0216800 20 get_obj_state: setting s->obj_tag to be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.5590466550764235044 2024-06-04T16:09:36.591 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.590+0000 7fadd0216800 20 get_obj_state: octx=0x562620b1b3a0 obj=test-client.0-r-test-small-obj-data.1:___ state=0x562620ac7388 s->prefetch_data=0 2024-06-04T16:09:36.591 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.590+0000 7fadd0216800 20 prepare_atomic_modification: state is not atomic. state=0x562620ac7388 2024-06-04T16:09:36.591 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.590+0000 7fadd0216800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.6.2 2024-06-04T16:09:36.593 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.593+0000 7fadd0216800 20 get_obj_state: octx=0x7fadc40b3050 obj=test-client.0-r-test-small-obj-data.1:__ _ state=0x562620ac7388 s->prefetch_data=0 2024-06-04T16:09:36.594 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.593+0000 7fadd0216800 10 manifest: total_size = 0 2024-06-04T16:09:36.594 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.593+0000 7fadd0216800 20 get_obj_state: setting s->obj_tag to be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.17516209716053187051 2024-06-04T16:09:36.594 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.593+0000 7fadd0216800 20 get_obj_state: octx=0x7fadc40b3050 obj=test-client.0-r-test-small-obj-data.1:__ _ state=0x562620ac7388 s->prefetch_data=0 2024-06-04T16:09:36.594 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.593+0000 7fadd0216800 20 prepare_atomic_modification: state is not atomic. state=0x562620ac7388 2024-06-04T16:09:36.594 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.593+0000 7fadd0216800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.6.3 2024-06-04T16:09:36.594 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.594+0000 7facaaffd640 20 handle_completion(): completion ok for obj=___ 2024-06-04T16:09:36.596 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.595+0000 7fadd0216800 20 get_obj_state: octx=0x7fadb4017f80 obj=test-client.0-r-test-small-obj-data.1:__ state=0x562620ac7388 s->prefetch_data=0 2024-06-04T16:09:36.597 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.596+0000 7fadd0216800 10 manifest: total_size = 0 2024-06-04T16:09:36.597 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.596+0000 7fadd0216800 20 get_obj_state: setting s->obj_tag to be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.9690853977998049847 2024-06-04T16:09:36.597 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.596+0000 7fadd0216800 20 get_obj_state: octx=0x7fadb4017f80 obj=test-client.0-r-test-small-obj-data.1:__ state=0x562620ac7388 s->prefetch_data=0 2024-06-04T16:09:36.597 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.596+0000 7fadd0216800 20 prepare_atomic_modification: state is not atomic. state=0x562620ac7388 2024-06-04T16:09:36.597 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.596+0000 7fadd0216800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.6.6 2024-06-04T16:09:36.597 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.597+0000 7facaa7fc640 20 handle_completion(): completion ok for obj=__ _ 2024-06-04T16:09:36.599 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.598+0000 7fadd0216800 20 get_obj_state: octx=0x7fadbc0701b0 obj=test-client.0-r-test-small-obj-data.1:obj state=0x562620ac7388 s->prefetch_data=0 2024-06-04T16:09:36.599 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.599+0000 7fadd0216800 10 manifest: total_size = 0 2024-06-04T16:09:36.599 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.599+0000 7fadd0216800 20 get_obj_state: setting s->obj_tag to be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.15706661555260992285 2024-06-04T16:09:36.600 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.599+0000 7fadd0216800 20 get_obj_state: octx=0x7fadbc0701b0 obj=test-client.0-r-test-small-obj-data.1:obj state=0x562620ac7388 s->prefetch_data=0 2024-06-04T16:09:36.600 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.599+0000 7fadd0216800 20 prepare_atomic_modification: state is not atomic. state=0x562620ac7388 2024-06-04T16:09:36.600 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.599+0000 7fadd0216800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.6.8 2024-06-04T16:09:36.600 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.600+0000 7facaaffd640 20 handle_completion(): completion ok for obj=__ 2024-06-04T16:09:36.602 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.601+0000 7fadd0216800 20 list_objects_ordered: starting attempt 1 2024-06-04T16:09:36.602 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.601+0000 7fadd0216800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-06-04T16:09:36.603 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.602+0000 7facaaffd640 20 handle_completion(): completion ok for obj=obj 2024-06-04T16:09:36.603 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.602+0000 7fadd0216800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-06-04T16:09:36.604 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.602+0000 7fadd0216800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-06-04T16:09:36.604 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.602+0000 7fadd0216800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-06-04T16:09:36.604 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.602+0000 7fadd0216800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-06-04T16:09:36.604 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.602+0000 7fadd0216800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-small-obj-data.1[be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.6])"; uploads.size()=0; is_truncated=0 2024-06-04T16:09:36.605 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.604+0000 7fadd0216800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 : miss 2024-06-04T16:09:36.605 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.604+0000 7fadd0216800 20 rados->read ofs=0 len=0 2024-06-04T16:09:36.606 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.605+0000 7fadd0216800 20 rados_obj.operate() r=0 bl.length=223 2024-06-04T16:09:36.606 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.605+0000 7fadd0216800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 info.flags=0x11 2024-06-04T16:09:36.606 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.605+0000 7fadd0216800 10 adding default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 to cache LRU end 2024-06-04T16:09:36.610 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.606+0000 7fadd0216800 10 removing default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 from cache 2024-06-04T16:09:36.610 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.606+0000 7fadd0216800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-small-obj-data.1, ofs0, ns] 2024-06-04T16:09:36.610 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.606+0000 7facaa7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1078036791375 cookie 94721756963440 notifier 5600 bl.length()=181 2024-06-04T16:09:36.610 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.608+0000 7fadd0216800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.6 from cache 2024-06-04T16:09:36.610 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.608+0000 7fadd0216800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-small-obj-data.1:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.6, ofs0, ns] 2024-06-04T16:09:36.610 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.608+0000 7facaaffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1078036791376 cookie 94721756963440 notifier 5600 bl.length()=238 2024-06-04T16:09:36.613 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.613+0000 7fadd0216800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.1/be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.6 : miss 2024-06-04T16:09:36.613 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.613+0000 7fadd0216800 20 rados->read ofs=0 len=0 2024-06-04T16:09:36.614 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.613+0000 7fadd0216800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:09:36.614 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.613+0000 7fadd0216800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.1/be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.6 info.flags=0x0 2024-06-04T16:09:36.614 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.613+0000 7fadd0216800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.1/be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.6 to cache LRU end 2024-06-04T16:09:36.615 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.615+0000 7fadd0216800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.7 : miss 2024-06-04T16:09:36.616 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.615+0000 7fadd0216800 20 rados->read ofs=0 len=0 2024-06-04T16:09:36.616 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.615+0000 7fadd0216800 20 rados_obj.operate() r=0 bl.length=437 2024-06-04T16:09:36.616 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.615+0000 7fadd0216800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.7 info.flags=0x17 2024-06-04T16:09:36.617 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.615+0000 7fadd0216800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.7 to cache LRU end 2024-06-04T16:09:36.617 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.615+0000 7fadd0216800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-06-04T16:09:36.617 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.615+0000 7fadd0216800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-06-04T16:09:36.617 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.615+0000 7fadd0216800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.7 2024-06-04T16:09:36.618 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.617+0000 7fadd0216800 10 cls_bucket_list_unordered: got ___ 2024-06-04T16:09:36.618 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.617+0000 7fadd0216800 10 cls_bucket_list_unordered: got __ _ 2024-06-04T16:09:36.619 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.618+0000 7fadd0216800 10 cls_bucket_list_unordered: got __ 2024-06-04T16:09:36.619 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.619+0000 7fadd0216800 10 cls_bucket_list_unordered: got obj 2024-06-04T16:09:36.621 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.619+0000 7fadd0216800 20 get_obj_state: octx=0x7fadc4068670 obj=test-client.0-r-test-small-obj-data.2:___ state=0x562620ac7328 s->prefetch_data=0 2024-06-04T16:09:36.621 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.620+0000 7fadd0216800 10 manifest: total_size = 527 2024-06-04T16:09:36.621 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.620+0000 7fadd0216800 20 get_obj_state: setting s->obj_tag to be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.15227488868613566937 2024-06-04T16:09:36.621 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.620+0000 7fadd0216800 20 get_obj_state: octx=0x7fadc4068670 obj=test-client.0-r-test-small-obj-data.2:___ state=0x562620ac7328 s->prefetch_data=0 2024-06-04T16:09:36.621 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.620+0000 7fadd0216800 20 prepare_atomic_modification: state is not atomic. state=0x562620ac7328 2024-06-04T16:09:36.621 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.620+0000 7fadd0216800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.7.2 2024-06-04T16:09:36.623 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.622+0000 7fadd0216800 20 get_obj_state: octx=0x7fadc4068670 obj=test-client.0-r-test-small-obj-data.2:__ _ state=0x562620ac7328 s->prefetch_data=0 2024-06-04T16:09:36.623 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.622+0000 7fadd0216800 10 manifest: total_size = 24595 2024-06-04T16:09:36.623 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.622+0000 7fadd0216800 20 get_obj_state: setting s->obj_tag to be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.12206027275035090959 2024-06-04T16:09:36.623 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.622+0000 7fadd0216800 20 get_obj_state: octx=0x7fadc4068670 obj=test-client.0-r-test-small-obj-data.2:__ _ state=0x562620ac7328 s->prefetch_data=0 2024-06-04T16:09:36.623 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.622+0000 7fadd0216800 20 prepare_atomic_modification: state is not atomic. state=0x562620ac7328 2024-06-04T16:09:36.624 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.622+0000 7fadd0216800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.7.3 2024-06-04T16:09:36.624 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.623+0000 7facaaffd640 20 handle_completion(): completion ok for obj=___ 2024-06-04T16:09:36.625 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.625+0000 7fadd0216800 20 get_obj_state: octx=0x7fadb402c830 obj=test-client.0-r-test-small-obj-data.2:__ state=0x562620ac7328 s->prefetch_data=0 2024-06-04T16:09:36.626 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.625+0000 7fadd0216800 10 manifest: total_size = 2078 2024-06-04T16:09:36.626 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.625+0000 7fadd0216800 20 get_obj_state: setting s->obj_tag to be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.12275632852149646034 2024-06-04T16:09:36.626 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.625+0000 7fadd0216800 20 get_obj_state: octx=0x7fadb402c830 obj=test-client.0-r-test-small-obj-data.2:__ state=0x562620ac7328 s->prefetch_data=0 2024-06-04T16:09:36.626 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.625+0000 7fadd0216800 20 prepare_atomic_modification: state is not atomic. state=0x562620ac7328 2024-06-04T16:09:36.626 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.625+0000 7fadd0216800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.7.6 2024-06-04T16:09:36.626 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.626+0000 7facaa7fc640 20 handle_completion(): completion ok for obj=__ _ 2024-06-04T16:09:36.628 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.628+0000 7fadd0216800 20 get_obj_state: octx=0x7fadc4068670 obj=test-client.0-r-test-small-obj-data.2:obj state=0x562620ac7328 s->prefetch_data=0 2024-06-04T16:09:36.629 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.628+0000 7fadd0216800 10 manifest: total_size = 524288 2024-06-04T16:09:36.629 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.628+0000 7fadd0216800 20 get_obj_state: setting s->obj_tag to be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.3635067559481883717 2024-06-04T16:09:36.629 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.628+0000 7fadd0216800 20 get_obj_state: octx=0x7fadc4068670 obj=test-client.0-r-test-small-obj-data.2:obj state=0x562620ac7328 s->prefetch_data=0 2024-06-04T16:09:36.629 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.628+0000 7fadd0216800 20 prepare_atomic_modification: state is not atomic. state=0x562620ac7328 2024-06-04T16:09:36.629 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.628+0000 7fadd0216800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.7.8 2024-06-04T16:09:36.629 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.629+0000 7facaaffd640 20 handle_completion(): completion ok for obj=__ 2024-06-04T16:09:36.631 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.630+0000 7fadd0216800 20 list_objects_ordered: starting attempt 1 2024-06-04T16:09:36.631 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.630+0000 7fadd0216800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-06-04T16:09:36.633 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.632+0000 7facaaffd640 20 handle_completion(): completion ok for obj=obj 2024-06-04T16:09:36.633 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.632+0000 7fadd0216800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-06-04T16:09:36.633 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.632+0000 7fadd0216800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-06-04T16:09:36.633 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.632+0000 7fadd0216800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-06-04T16:09:36.633 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.632+0000 7fadd0216800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-06-04T16:09:36.633 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.632+0000 7fadd0216800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-small-obj-data.2[be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.7])"; uploads.size()=0; is_truncated=0 2024-06-04T16:09:36.635 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.634+0000 7fadd0216800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 : miss 2024-06-04T16:09:36.635 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.634+0000 7fadd0216800 20 rados->read ofs=0 len=0 2024-06-04T16:09:36.636 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.634+0000 7fadd0216800 20 rados_obj.operate() r=0 bl.length=223 2024-06-04T16:09:36.636 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.634+0000 7fadd0216800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 info.flags=0x11 2024-06-04T16:09:36.636 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.634+0000 7fadd0216800 10 adding default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 to cache LRU end 2024-06-04T16:09:36.636 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.636+0000 7fadd0216800 10 removing default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 from cache 2024-06-04T16:09:36.637 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.636+0000 7fadd0216800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-small-obj-data.2, ofs0, ns] 2024-06-04T16:09:36.637 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.636+0000 7facaa7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1078036791377 cookie 94721756963440 notifier 5600 bl.length()=181 2024-06-04T16:09:36.638 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.637+0000 7fadd0216800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.7 from cache 2024-06-04T16:09:36.638 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.637+0000 7fadd0216800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-small-obj-data.2:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.7, ofs0, ns] 2024-06-04T16:09:36.638 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.638+0000 7facaaffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1078036791378 cookie 94721756963440 notifier 5600 bl.length()=238 2024-06-04T16:09:36.641 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.640+0000 7fadd0216800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.2/be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.7 : miss 2024-06-04T16:09:36.641 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.640+0000 7fadd0216800 20 rados->read ofs=0 len=0 2024-06-04T16:09:36.641 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.640+0000 7fadd0216800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:09:36.641 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.640+0000 7fadd0216800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.2/be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.7 info.flags=0x0 2024-06-04T16:09:36.641 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.640+0000 7fadd0216800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.2/be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.7 to cache LRU end 2024-06-04T16:09:36.643 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.642+0000 7fadd0216800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.8 : miss 2024-06-04T16:09:36.643 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.642+0000 7fadd0216800 20 rados->read ofs=0 len=0 2024-06-04T16:09:36.645 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.644+0000 7fadd0216800 20 rados_obj.operate() r=0 bl.length=437 2024-06-04T16:09:36.645 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.644+0000 7fadd0216800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.8 info.flags=0x17 2024-06-04T16:09:36.645 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.644+0000 7fadd0216800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.8 to cache LRU end 2024-06-04T16:09:36.645 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.644+0000 7fadd0216800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-06-04T16:09:36.645 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.644+0000 7fadd0216800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-06-04T16:09:36.645 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.644+0000 7fadd0216800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.8 2024-06-04T16:09:36.646 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.645+0000 7fadd0216800 10 cls_bucket_list_unordered: got ___ 2024-06-04T16:09:36.646 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.646+0000 7fadd0216800 10 cls_bucket_list_unordered: got __ _ 2024-06-04T16:09:36.647 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.647+0000 7fadd0216800 10 cls_bucket_list_unordered: got __ 2024-06-04T16:09:36.648 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.648+0000 7fadd0216800 10 cls_bucket_list_unordered: got obj 2024-06-04T16:09:36.649 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.648+0000 7fadd0216800 20 get_obj_state: octx=0x7fadb402cbb0 obj=test-client.0-r-test-small-obj-data.3:___ state=0x562620a679a8 s->prefetch_data=0 2024-06-04T16:09:36.649 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.648+0000 7fadd0216800 10 manifest: total_size = 49187 2024-06-04T16:09:36.649 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.649+0000 7fadd0216800 20 get_obj_state: setting s->obj_tag to be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.14440683338266834058 2024-06-04T16:09:36.650 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.649+0000 7fadd0216800 20 get_obj_state: octx=0x7fadb402cbb0 obj=test-client.0-r-test-small-obj-data.3:___ state=0x562620a679a8 s->prefetch_data=0 2024-06-04T16:09:36.650 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.649+0000 7fadd0216800 20 prepare_atomic_modification: state is not atomic. state=0x562620a679a8 2024-06-04T16:09:36.650 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.649+0000 7fadd0216800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.8.2 2024-06-04T16:09:36.651 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.651+0000 7fadd0216800 20 get_obj_state: octx=0x562620b27170 obj=test-client.0-r-test-small-obj-data.3:__ _ state=0x562620a679a8 s->prefetch_data=0 2024-06-04T16:09:36.652 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.651+0000 7fadd0216800 10 manifest: total_size = 4134 2024-06-04T16:09:36.652 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.651+0000 7fadd0216800 20 get_obj_state: setting s->obj_tag to be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.9961253536150990876 2024-06-04T16:09:36.652 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.651+0000 7fadd0216800 20 get_obj_state: octx=0x562620b27170 obj=test-client.0-r-test-small-obj-data.3:__ _ state=0x562620a679a8 s->prefetch_data=0 2024-06-04T16:09:36.652 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.651+0000 7fadd0216800 20 prepare_atomic_modification: state is not atomic. state=0x562620a679a8 2024-06-04T16:09:36.652 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.651+0000 7fadd0216800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.8.3 2024-06-04T16:09:36.653 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.652+0000 7facaa7fc640 20 handle_completion(): completion ok for obj=___ 2024-06-04T16:09:36.654 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.653+0000 7fadd0216800 20 get_obj_state: octx=0x562620b27170 obj=test-client.0-r-test-small-obj-data.3:__ state=0x562620a679a8 s->prefetch_data=0 2024-06-04T16:09:36.654 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.654+0000 7fadd0216800 10 manifest: total_size = 1048576 2024-06-04T16:09:36.654 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.654+0000 7fadd0216800 20 get_obj_state: setting s->obj_tag to be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.10321686649218867756 2024-06-04T16:09:36.655 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.654+0000 7fadd0216800 20 get_obj_state: octx=0x562620b27170 obj=test-client.0-r-test-small-obj-data.3:__ state=0x562620a679a8 s->prefetch_data=0 2024-06-04T16:09:36.655 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.654+0000 7fadd0216800 20 prepare_atomic_modification: state is not atomic. state=0x562620a679a8 2024-06-04T16:09:36.655 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.654+0000 7fadd0216800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.8.6 2024-06-04T16:09:36.655 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.655+0000 7facaaffd640 20 handle_completion(): completion ok for obj=__ _ 2024-06-04T16:09:36.656 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.656+0000 7fadd0216800 20 get_obj_state: octx=0x562620b27170 obj=test-client.0-r-test-small-obj-data.3:obj state=0x562620a679a8 s->prefetch_data=0 2024-06-04T16:09:36.657 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.656+0000 7fadd0216800 10 manifest: total_size = 1048576 2024-06-04T16:09:36.657 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.656+0000 7fadd0216800 20 get_obj_state: setting s->obj_tag to be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.12575634355418722627 2024-06-04T16:09:36.657 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.656+0000 7fadd0216800 20 get_obj_state: octx=0x562620b27170 obj=test-client.0-r-test-small-obj-data.3:obj state=0x562620a679a8 s->prefetch_data=0 2024-06-04T16:09:36.657 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.656+0000 7fadd0216800 20 prepare_atomic_modification: state is not atomic. state=0x562620a679a8 2024-06-04T16:09:36.657 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.656+0000 7fadd0216800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.8.8 2024-06-04T16:09:36.658 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.657+0000 7facaa7fc640 20 handle_completion(): completion ok for obj=__ 2024-06-04T16:09:36.659 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.659+0000 7fadd0216800 20 list_objects_ordered: starting attempt 1 2024-06-04T16:09:36.659 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.659+0000 7fadd0216800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-06-04T16:09:36.661 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.660+0000 7facaa7fc640 20 handle_completion(): completion ok for obj=obj 2024-06-04T16:09:36.661 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.660+0000 7fadd0216800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-06-04T16:09:36.661 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.660+0000 7fadd0216800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-06-04T16:09:36.661 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.660+0000 7fadd0216800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-06-04T16:09:36.661 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.660+0000 7fadd0216800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-06-04T16:09:36.661 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.660+0000 7fadd0216800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-small-obj-data.3[be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.8])"; uploads.size()=0; is_truncated=0 2024-06-04T16:09:36.662 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.662+0000 7fadd0216800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 : miss 2024-06-04T16:09:36.662 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.662+0000 7fadd0216800 20 rados->read ofs=0 len=0 2024-06-04T16:09:36.663 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.662+0000 7fadd0216800 20 rados_obj.operate() r=0 bl.length=223 2024-06-04T16:09:36.663 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.662+0000 7fadd0216800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 info.flags=0x11 2024-06-04T16:09:36.663 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.662+0000 7fadd0216800 10 adding default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 to cache LRU end 2024-06-04T16:09:36.664 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.663+0000 7fadd0216800 10 removing default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 from cache 2024-06-04T16:09:36.664 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.663+0000 7fadd0216800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-small-obj-data.3, ofs0, ns] 2024-06-04T16:09:36.665 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.664+0000 7facaaffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1078036791379 cookie 94721756963440 notifier 5600 bl.length()=181 2024-06-04T16:09:36.665 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.665+0000 7fadd0216800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.8 from cache 2024-06-04T16:09:36.666 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.665+0000 7fadd0216800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-small-obj-data.3:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.8, ofs0, ns] 2024-06-04T16:09:36.666 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.665+0000 7facaa7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1078036791380 cookie 94721756963440 notifier 5600 bl.length()=238 2024-06-04T16:09:36.669 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.668+0000 7fadd0216800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.3/be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.8 : miss 2024-06-04T16:09:36.669 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.668+0000 7fadd0216800 20 rados->read ofs=0 len=0 2024-06-04T16:09:36.669 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.668+0000 7fadd0216800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:09:36.669 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.668+0000 7fadd0216800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.3/be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.8 info.flags=0x0 2024-06-04T16:09:36.669 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.668+0000 7fadd0216800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.3/be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.8 to cache LRU end 2024-06-04T16:09:36.671 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.670+0000 7fadd0216800 10 removing key index: BZVIEGNMAFYVKLISTBJQ 2024-06-04T16:09:36.672 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.671+0000 7fadd0216800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:users.keys:BZVIEGNMAFYVKLISTBJQ, ofs0, ns] 2024-06-04T16:09:36.672 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.671+0000 7facaaffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1078036791381 cookie 94721756972944 notifier 5600 bl.length()=170 2024-06-04T16:09:36.672 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.672+0000 7fadd0216800 10 removing email index: ragweed.client.0+test@test.test 2024-06-04T16:09:36.673 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.673+0000 7fadd0216800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.email:ragweed.client.0+test@test.test, ofs0, ns] 2024-06-04T16:09:36.674 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.673+0000 7facaa7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1078036791316 cookie 94721756967088 notifier 5600 bl.length()=182 2024-06-04T16:09:36.674 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.673+0000 7fadd0216800 10 removing user buckets index 2024-06-04T16:09:36.675 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.674+0000 7fadd0216800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.uid:ragweed.client.0.buckets, ofs0, ns] 2024-06-04T16:09:36.675 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.674+0000 7facaaffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1078036791373 cookie 94721756974480 notifier 5600 bl.length()=173 2024-06-04T16:09:36.675 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.675+0000 7fadd0216800 10 removing user index: ragweed.client.0 2024-06-04T16:09:36.677 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.676+0000 7fadd0216800 10 removing default.rgw.meta+users.uid+ragweed.client.0 from cache 2024-06-04T16:09:36.677 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.676+0000 7fadd0216800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:users.uid:ragweed.client.0, ofs0, ns] 2024-06-04T16:09:36.677 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.676+0000 7facaa7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1078036791382 cookie 94721756972944 notifier 5600 bl.length()=165 2024-06-04T16:09:36.678 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.677+0000 7fac81fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-06-04T16:09:36.681 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.680+0000 7fadd0216800 20 remove_watcher() i=0 2024-06-04T16:09:36.681 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.680+0000 7fadd0216800 2 removed watcher, disabling cache 2024-06-04T16:09:36.682 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.681+0000 7fadd0216800 20 remove_watcher() i=1 2024-06-04T16:09:36.682 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.681+0000 7fadd0216800 20 remove_watcher() i=2 2024-06-04T16:09:36.683 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.682+0000 7fadd0216800 20 remove_watcher() i=3 2024-06-04T16:09:36.684 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.684+0000 7fadd0216800 20 remove_watcher() i=4 2024-06-04T16:09:36.685 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.685+0000 7fadd0216800 20 remove_watcher() i=5 2024-06-04T16:09:36.686 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.686+0000 7fadd0216800 20 remove_watcher() i=6 2024-06-04T16:09:36.687 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.687+0000 7fadd0216800 20 remove_watcher() i=7 2024-06-04T16:09:36.699 DEBUG:teuthology.orchestra.run.smithi144:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid sysuser.client.0 --purge-data 2024-06-04T16:09:36.755 INFO:teuthology.orchestra.run.smithi144.stderr:ignoring --setuser ceph since I am not root 2024-06-04T16:09:36.755 INFO:teuthology.orchestra.run.smithi144.stderr:ignoring --setgroup ceph since I am not root 2024-06-04T16:09:36.788 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.787+0000 7fa3df00e800 20 rados->read ofs=0 len=0 2024-06-04T16:09:36.791 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.789+0000 7fa3df00e800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:09:36.791 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.789+0000 7fa3df00e800 20 realm 2024-06-04T16:09:36.791 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.789+0000 7fa3df00e800 20 rados->read ofs=0 len=0 2024-06-04T16:09:36.791 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.789+0000 7fa3df00e800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:09:36.791 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.789+0000 7fa3df00e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-06-04T16:09:36.791 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.789+0000 7fa3df00e800 20 rados->read ofs=0 len=0 2024-06-04T16:09:36.791 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.790+0000 7fa3df00e800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:09:36.791 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.790+0000 7fa3df00e800 20 rados->read ofs=0 len=0 2024-06-04T16:09:36.791 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.790+0000 7fa3df00e800 20 rados_obj.operate() r=0 bl.length=46 2024-06-04T16:09:36.791 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.790+0000 7fa3df00e800 20 rados->read ofs=0 len=0 2024-06-04T16:09:36.792 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.791+0000 7fa3df00e800 20 rados_obj.operate() r=0 bl.length=1139 2024-06-04T16:09:36.792 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.791+0000 7fa3df00e800 20 searching for the correct realm 2024-06-04T16:09:36.793 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.793+0000 7fa3dd30b640 0 -- 172.21.15.144:0/1022502762 >> [v2:172.21.15.144:6800/1453747520,v1:172.21.15.144:6801/1453747520] conn(0x7fa3c8040020 msgr2=0x7fa3c806a870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-06-04T16:09:36.998 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:36.997+0000 7fa3dd30b640 0 -- 172.21.15.144:0/1022502762 >> [v2:172.21.15.144:6824/166159729,v1:172.21.15.144:6825/166159729] conn(0x556645df4b70 msgr2=0x556645df6f60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-06-04T16:09:37.003 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:37.002+0000 7fa3df00e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-06-04T16:09:37.003 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:37.002+0000 7fa3df00e800 20 RGWRados::pool_iterate: got zone_info.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767 2024-06-04T16:09:37.003 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:37.002+0000 7fa3df00e800 20 RGWRados::pool_iterate: got default.zone. 2024-06-04T16:09:37.003 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:37.002+0000 7fa3df00e800 20 RGWRados::pool_iterate: got zonegroup_info.abb22408-c332-4e28-8f7a-ff254ea2fed2 2024-06-04T16:09:37.003 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:37.002+0000 7fa3df00e800 20 RGWRados::pool_iterate: got zone_names.default 2024-06-04T16:09:37.003 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:37.002+0000 7fa3df00e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-06-04T16:09:37.003 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:37.002+0000 7fa3df00e800 20 rados->read ofs=0 len=0 2024-06-04T16:09:37.004 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:37.002+0000 7fa3df00e800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:09:37.004 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:37.002+0000 7fa3df00e800 20 rados->read ofs=0 len=0 2024-06-04T16:09:37.004 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:37.002+0000 7fa3df00e800 20 rados_obj.operate() r=0 bl.length=46 2024-06-04T16:09:37.004 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:37.002+0000 7fa3df00e800 20 rados->read ofs=0 len=0 2024-06-04T16:09:37.005 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:37.003+0000 7fa3df00e800 20 rados_obj.operate() r=0 bl.length=470 2024-06-04T16:09:37.005 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:37.003+0000 7fa3df00e800 20 zone default found 2024-06-04T16:09:37.005 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:37.003+0000 7fa3df00e800 4 Realm: () 2024-06-04T16:09:37.005 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:37.003+0000 7fa3df00e800 4 ZoneGroup: default (abb22408-c332-4e28-8f7a-ff254ea2fed2) 2024-06-04T16:09:37.005 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:37.003+0000 7fa3df00e800 4 Zone: default (be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767) 2024-06-04T16:09:37.005 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:37.003+0000 7fa3df00e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-06-04T16:09:37.005 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:37.003+0000 7fa3df00e800 20 zonegroup default 2024-06-04T16:09:37.005 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:37.003+0000 7fa3df00e800 20 rados->read ofs=0 len=0 2024-06-04T16:09:37.005 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:37.003+0000 7fa3df00e800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:09:37.005 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:37.003+0000 7fa3df00e800 20 rados->read ofs=0 len=0 2024-06-04T16:09:37.005 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:37.003+0000 7fa3df00e800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:09:37.005 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:37.003+0000 7fa3df00e800 20 rados->read ofs=0 len=0 2024-06-04T16:09:37.006 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:37.004+0000 7fa3df00e800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:09:37.006 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:37.004+0000 7fa3df00e800 20 started sync module instance, tier type = 2024-06-04T16:09:37.006 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:37.004+0000 7fa3df00e800 20 started zone id=be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767 (name=default) with tier type = 2024-06-04T16:09:37.012 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:37.012+0000 7fa3df00e800 20 add_watcher() i=0 2024-06-04T16:09:37.012 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:37.012+0000 7fa3df00e800 20 add_watcher() i=1 2024-06-04T16:09:37.013 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:37.012+0000 7fa3df00e800 20 add_watcher() i=2 2024-06-04T16:09:37.013 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:37.012+0000 7fa3df00e800 20 add_watcher() i=3 2024-06-04T16:09:37.013 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:37.012+0000 7fa3df00e800 20 add_watcher() i=4 2024-06-04T16:09:37.013 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:37.012+0000 7fa3df00e800 20 add_watcher() i=5 2024-06-04T16:09:37.013 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:37.012+0000 7fa3df00e800 20 add_watcher() i=6 2024-06-04T16:09:37.013 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:37.012+0000 7fa3df00e800 20 add_watcher() i=7 2024-06-04T16:09:37.013 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:37.012+0000 7fa3df00e800 2 all 8 watchers are set, enabling cache 2024-06-04T16:09:37.015 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:37.014+0000 7fa292fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-06-04T16:09:37.015 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:37.015+0000 7fa3df00e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-06-04T16:09:37.015 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:37.015+0000 7fa3df00e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-06-04T16:09:37.050 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:37.048+0000 7fa291fe3640 20 reqs_thread_entry: start 2024-06-04T16:09:37.050 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:37.048+0000 7fa3df00e800 20 init_complete bucket index max shards: 11 2024-06-04T16:09:37.050 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:37.049+0000 7fa3df00e800 20 Filter name: none 2024-06-04T16:09:37.050 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:37.049+0000 7fa2037fe640 20 reqs_thread_entry: start 2024-06-04T16:09:37.050 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:37.049+0000 7fa3df00e800 10 cache get: name=default.rgw.meta+users.uid+sysuser.client.0 : miss 2024-06-04T16:09:37.051 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:37.049+0000 7fa3df00e800 20 rados->read ofs=0 len=0 2024-06-04T16:09:37.051 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:37.049+0000 7fa3df00e800 20 rados_obj.operate() r=0 bl.length=486 2024-06-04T16:09:37.051 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:37.049+0000 7fa3df00e800 10 cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x13 2024-06-04T16:09:37.051 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:37.049+0000 7fa3df00e800 10 adding default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2024-06-04T16:09:37.051 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:37.049+0000 7fa3df00e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-06-04T16:09:37.051 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:37.049+0000 7fa3df00e800 10 removing key index: IBWSYDSTHYVKJDZLKOGP 2024-06-04T16:09:37.051 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:37.050+0000 7fa3df00e800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:users.keys:IBWSYDSTHYVKJDZLKOGP, ofs0, ns] 2024-06-04T16:09:37.051 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:37.051+0000 7fa2b3fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1078036791374 cookie 93897747330592 notifier 5895 bl.length()=170 2024-06-04T16:09:37.052 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:37.051+0000 7fa3df00e800 10 removing email index: sysuser.client.0+test@test.test 2024-06-04T16:09:37.053 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:37.053+0000 7fa3df00e800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:users.email:sysuser.client.0+test@test.test, ofs0, ns] 2024-06-04T16:09:37.053 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:37.053+0000 7fa2b37fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1078036791383 cookie 93897747332928 notifier 5895 bl.length()=182 2024-06-04T16:09:37.054 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:37.053+0000 7fa3df00e800 10 removing user buckets index 2024-06-04T16:09:37.055 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:37.054+0000 7fa3df00e800 10 removing user index: sysuser.client.0 2024-06-04T16:09:37.056 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:37.055+0000 7fa3df00e800 10 removing default.rgw.meta+users.uid+sysuser.client.0 from cache 2024-06-04T16:09:37.056 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:37.055+0000 7fa3df00e800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.uid:sysuser.client.0, ofs0, ns] 2024-06-04T16:09:37.056 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:37.055+0000 7fa2b37fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1078036791317 cookie 93897747319216 notifier 5895 bl.length()=165 2024-06-04T16:09:37.057 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:37.057+0000 7fa292fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-06-04T16:09:37.059 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:37.058+0000 7fa3df00e800 20 remove_watcher() i=0 2024-06-04T16:09:37.059 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:37.058+0000 7fa3df00e800 2 removed watcher, disabling cache 2024-06-04T16:09:37.060 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:37.060+0000 7fa3df00e800 20 remove_watcher() i=1 2024-06-04T16:09:37.061 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:37.060+0000 7fa3df00e800 20 remove_watcher() i=2 2024-06-04T16:09:37.062 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:37.061+0000 7fa3df00e800 20 remove_watcher() i=3 2024-06-04T16:09:37.063 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:37.062+0000 7fa3df00e800 20 remove_watcher() i=4 2024-06-04T16:09:37.064 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:37.063+0000 7fa3df00e800 20 remove_watcher() i=5 2024-06-04T16:09:37.065 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:37.064+0000 7fa3df00e800 20 remove_watcher() i=6 2024-06-04T16:09:37.066 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:09:37.065+0000 7fa3df00e800 20 remove_watcher() i=7 2024-06-04T16:09:37.077 INFO:tasks.ragweed:Removing ragweed... 2024-06-04T16:09:37.077 DEBUG:teuthology.orchestra.run.smithi144:> rm -rf /home/ubuntu/cephtest/ragweed.client.0 2024-06-04T16:09:37.149 INFO:teuthology.run_tasks:Running task workunit... 2024-06-04T16:09:37.160 INFO:tasks.workunit:Pulling workunits from ref 1fb5d10608dccee73edd6ef8a2c7b804a097c324 2024-06-04T16:09:37.160 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-06-04T16:09:37.160 DEBUG:teuthology.orchestra.run.smithi144:> stat -- /home/ubuntu/cephtest/mnt.0 2024-06-04T16:09:37.189 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-06-04T16:09:37.189 INFO:teuthology.orchestra.run.smithi144.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-06-04T16:09:37.189 DEBUG:teuthology.orchestra.run.smithi144:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-06-04T16:09:37.258 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-06-04T16:09:37.259 DEBUG:teuthology.orchestra.run.smithi144:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-06-04T16:09:37.327 INFO:tasks.workunit:timeout=3h 2024-06-04T16:09:37.327 INFO:tasks.workunit:cleanup=True 2024-06-04T16:09:37.328 DEBUG:teuthology.orchestra.run.smithi144:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 1fb5d10608dccee73edd6ef8a2c7b804a097c324 2024-06-04T16:09:37.397 INFO:tasks.workunit.client.0.smithi144.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-06-04T16:11:05.111 INFO:tasks.workunit.client.0.smithi144.stderr:Note: switching to '1fb5d10608dccee73edd6ef8a2c7b804a097c324'. 2024-06-04T16:11:05.112 INFO:tasks.workunit.client.0.smithi144.stderr: 2024-06-04T16:11:05.112 INFO:tasks.workunit.client.0.smithi144.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-06-04T16:11:05.112 INFO:tasks.workunit.client.0.smithi144.stderr:changes and commit them, and you can discard any commits you make in this 2024-06-04T16:11:05.112 INFO:tasks.workunit.client.0.smithi144.stderr:state without impacting any branches by switching back to a branch. 2024-06-04T16:11:05.112 INFO:tasks.workunit.client.0.smithi144.stderr: 2024-06-04T16:11:05.112 INFO:tasks.workunit.client.0.smithi144.stderr:If you want to create a new branch to retain commits you create, you may 2024-06-04T16:11:05.112 INFO:tasks.workunit.client.0.smithi144.stderr:do so (now or later) by using -c with the switch command. Example: 2024-06-04T16:11:05.112 INFO:tasks.workunit.client.0.smithi144.stderr: 2024-06-04T16:11:05.112 INFO:tasks.workunit.client.0.smithi144.stderr: git switch -c 2024-06-04T16:11:05.112 INFO:tasks.workunit.client.0.smithi144.stderr: 2024-06-04T16:11:05.113 INFO:tasks.workunit.client.0.smithi144.stderr:Or undo this operation with: 2024-06-04T16:11:05.113 INFO:tasks.workunit.client.0.smithi144.stderr: 2024-06-04T16:11:05.113 INFO:tasks.workunit.client.0.smithi144.stderr: git switch - 2024-06-04T16:11:05.113 INFO:tasks.workunit.client.0.smithi144.stderr: 2024-06-04T16:11:05.113 INFO:tasks.workunit.client.0.smithi144.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-06-04T16:11:05.113 INFO:tasks.workunit.client.0.smithi144.stderr: 2024-06-04T16:11:05.113 INFO:tasks.workunit.client.0.smithi144.stderr:HEAD is now at 1fb5d10608d Merge pull request #55565 from BBoozmen/oozmen_avoid_path_normalization 2024-06-04T16:11:05.113 DEBUG:teuthology.orchestra.run.smithi144:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-06-04T16:11:05.181 INFO:tasks.workunit.client.0.smithi144.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-06-04T16:11:05.183 INFO:tasks.workunit.client.0.smithi144.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-06-04T16:11:05.183 INFO:tasks.workunit.client.0.smithi144.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-06-04T16:11:05.232 INFO:tasks.workunit.client.0.smithi144.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-06-04T16:11:05.281 INFO:tasks.workunit.client.0.smithi144.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-06-04T16:11:05.320 INFO:tasks.workunit.client.0.smithi144.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-06-04T16:11:05.322 INFO:tasks.workunit.client.0.smithi144.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-06-04T16:11:05.322 INFO:tasks.workunit.client.0.smithi144.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-06-04T16:11:05.361 INFO:tasks.workunit.client.0.smithi144.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-06-04T16:11:05.365 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-06-04T16:11:05.365 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-06-04T16:11:05.435 INFO:tasks.workunit:Running workunits matching rgw/run-reshard.sh on client.0... 2024-06-04T16:11:05.436 INFO:tasks.workunit:Running workunit rgw/run-reshard.sh... 2024-06-04T16:11:05.436 DEBUG:teuthology.orchestra.run.smithi144:workunit test rgw/run-reshard.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1fb5d10608dccee73edd6ef8a2c7b804a097c324 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-reshard.sh 2024-06-04T16:11:05.508 INFO:tasks.workunit.client.0.smithi144.stderr:+ ulimit -c 0 2024-06-04T16:11:05.508 INFO:tasks.workunit.client.0.smithi144.stderr:++ dirname /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-reshard.sh 2024-06-04T16:11:05.508 INFO:tasks.workunit.client.0.smithi144.stderr:+ mydir=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-06-04T16:11:05.508 INFO:tasks.workunit.client.0.smithi144.stderr:+ python3 -m venv /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-06-04T16:11:08.056 INFO:tasks.workunit.client.0.smithi144.stderr:+ source /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/activate 2024-06-04T16:11:08.057 INFO:tasks.workunit.client.0.smithi144.stderr:++ deactivate nondestructive 2024-06-04T16:11:08.057 INFO:tasks.workunit.client.0.smithi144.stderr:++ '[' -n '' ']' 2024-06-04T16:11:08.057 INFO:tasks.workunit.client.0.smithi144.stderr:++ '[' -n '' ']' 2024-06-04T16:11:08.057 INFO:tasks.workunit.client.0.smithi144.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-06-04T16:11:08.057 INFO:tasks.workunit.client.0.smithi144.stderr:++ hash -r 2024-06-04T16:11:08.057 INFO:tasks.workunit.client.0.smithi144.stderr:++ '[' -n '' ']' 2024-06-04T16:11:08.057 INFO:tasks.workunit.client.0.smithi144.stderr:++ unset VIRTUAL_ENV 2024-06-04T16:11:08.057 INFO:tasks.workunit.client.0.smithi144.stderr:++ '[' '!' nondestructive = nondestructive ']' 2024-06-04T16:11:08.057 INFO:tasks.workunit.client.0.smithi144.stderr:++ VIRTUAL_ENV=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-06-04T16:11:08.057 INFO:tasks.workunit.client.0.smithi144.stderr:++ export VIRTUAL_ENV 2024-06-04T16:11:08.057 INFO:tasks.workunit.client.0.smithi144.stderr:++ _OLD_VIRTUAL_PATH=/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-06-04T16:11:08.058 INFO:tasks.workunit.client.0.smithi144.stderr:++ PATH=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-06-04T16:11:08.058 INFO:tasks.workunit.client.0.smithi144.stderr:++ export PATH 2024-06-04T16:11:08.058 INFO:tasks.workunit.client.0.smithi144.stderr:++ '[' -n '' ']' 2024-06-04T16:11:08.059 INFO:tasks.workunit.client.0.smithi144.stderr:++ '[' -z '' ']' 2024-06-04T16:11:08.059 INFO:tasks.workunit.client.0.smithi144.stderr:++ _OLD_VIRTUAL_PS1= 2024-06-04T16:11:08.059 INFO:tasks.workunit.client.0.smithi144.stderr:++ PS1='(rgw) ' 2024-06-04T16:11:08.059 INFO:tasks.workunit.client.0.smithi144.stderr:++ export PS1 2024-06-04T16:11:08.059 INFO:tasks.workunit.client.0.smithi144.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-06-04T16:11:08.059 INFO:tasks.workunit.client.0.smithi144.stderr:++ hash -r 2024-06-04T16:11:08.059 INFO:tasks.workunit.client.0.smithi144.stderr:+ pip install pip --upgrade 2024-06-04T16:11:08.289 INFO:tasks.workunit.client.0.smithi144.stdout:Requirement already satisfied: pip in /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.9/site-packages (21.3.1) 2024-06-04T16:11:08.496 INFO:tasks.workunit.client.0.smithi144.stdout:Collecting pip 2024-06-04T16:11:08.503 INFO:tasks.workunit.client.0.smithi144.stdout: Using cached pip-24.0-py3-none-any.whl (2.1 MB) 2024-06-04T16:11:08.553 INFO:tasks.workunit.client.0.smithi144.stdout:Installing collected packages: pip 2024-06-04T16:11:08.554 INFO:tasks.workunit.client.0.smithi144.stdout: Attempting uninstall: pip 2024-06-04T16:11:08.554 INFO:tasks.workunit.client.0.smithi144.stdout: Found existing installation: pip 21.3.1 2024-06-04T16:11:08.708 INFO:tasks.workunit.client.0.smithi144.stdout: Uninstalling pip-21.3.1: 2024-06-04T16:11:08.713 INFO:tasks.workunit.client.0.smithi144.stdout: Successfully uninstalled pip-21.3.1 2024-06-04T16:11:09.679 INFO:tasks.workunit.client.0.smithi144.stdout:Successfully installed pip-24.0 2024-06-04T16:11:09.729 INFO:tasks.workunit.client.0.smithi144.stderr:+ pip install boto3 2024-06-04T16:11:10.575 INFO:tasks.workunit.client.0.smithi144.stdout:Collecting boto3 2024-06-04T16:11:10.576 INFO:tasks.workunit.client.0.smithi144.stdout: Using cached boto3-1.34.118-py3-none-any.whl.metadata (6.6 kB) 2024-06-04T16:11:11.182 INFO:tasks.workunit.client.0.smithi144.stdout:Collecting botocore<1.35.0,>=1.34.118 (from boto3) 2024-06-04T16:11:11.183 INFO:tasks.workunit.client.0.smithi144.stdout: Using cached botocore-1.34.118-py3-none-any.whl.metadata (5.7 kB) 2024-06-04T16:11:11.246 INFO:tasks.workunit.client.0.smithi144.stdout:Collecting jmespath<2.0.0,>=0.7.1 (from boto3) 2024-06-04T16:11:11.247 INFO:tasks.workunit.client.0.smithi144.stdout: Using cached jmespath-1.0.1-py3-none-any.whl.metadata (7.6 kB) 2024-06-04T16:11:11.309 INFO:tasks.workunit.client.0.smithi144.stdout:Collecting s3transfer<0.11.0,>=0.10.0 (from boto3) 2024-06-04T16:11:11.311 INFO:tasks.workunit.client.0.smithi144.stdout: Using cached s3transfer-0.10.1-py3-none-any.whl.metadata (1.7 kB) 2024-06-04T16:11:11.377 INFO:tasks.workunit.client.0.smithi144.stdout:Collecting python-dateutil<3.0.0,>=2.1 (from botocore<1.35.0,>=1.34.118->boto3) 2024-06-04T16:11:11.379 INFO:tasks.workunit.client.0.smithi144.stdout: Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl.metadata (8.4 kB) 2024-06-04T16:11:11.460 INFO:tasks.workunit.client.0.smithi144.stdout:Collecting urllib3<1.27,>=1.25.4 (from botocore<1.35.0,>=1.34.118->boto3) 2024-06-04T16:11:11.461 INFO:tasks.workunit.client.0.smithi144.stdout: Using cached urllib3-1.26.18-py2.py3-none-any.whl.metadata (48 kB) 2024-06-04T16:11:11.724 INFO:tasks.workunit.client.0.smithi144.stdout:Collecting six>=1.5 (from python-dateutil<3.0.0,>=2.1->botocore<1.35.0,>=1.34.118->boto3) 2024-06-04T16:11:11.725 INFO:tasks.workunit.client.0.smithi144.stdout: Using cached six-1.16.0-py2.py3-none-any.whl.metadata (1.8 kB) 2024-06-04T16:11:11.748 INFO:tasks.workunit.client.0.smithi144.stdout:Using cached boto3-1.34.118-py3-none-any.whl (139 kB) 2024-06-04T16:11:11.750 INFO:tasks.workunit.client.0.smithi144.stdout:Using cached botocore-1.34.118-py3-none-any.whl (12.3 MB) 2024-06-04T16:11:11.769 INFO:tasks.workunit.client.0.smithi144.stdout:Using cached jmespath-1.0.1-py3-none-any.whl (20 kB) 2024-06-04T16:11:11.771 INFO:tasks.workunit.client.0.smithi144.stdout:Using cached s3transfer-0.10.1-py3-none-any.whl (82 kB) 2024-06-04T16:11:11.772 INFO:tasks.workunit.client.0.smithi144.stdout:Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl (229 kB) 2024-06-04T16:11:11.774 INFO:tasks.workunit.client.0.smithi144.stdout:Using cached urllib3-1.26.18-py2.py3-none-any.whl (143 kB) 2024-06-04T16:11:11.775 INFO:tasks.workunit.client.0.smithi144.stdout:Using cached six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-06-04T16:11:11.877 INFO:tasks.workunit.client.0.smithi144.stdout:Installing collected packages: urllib3, six, jmespath, python-dateutil, botocore, s3transfer, boto3 2024-06-04T16:11:12.915 INFO:tasks.workunit.client.0.smithi144.stdout:Successfully installed boto3-1.34.118 botocore-1.34.118 jmespath-1.0.1 python-dateutil-2.9.0.post0 s3transfer-0.10.1 six-1.16.0 urllib3-1.26.18 2024-06-04T16:11:13.063 INFO:tasks.workunit.client.0.smithi144.stderr:+ /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/python3 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_reshard.py 2024-06-04T16:11:13.189 INFO:tasks.workunit.client.0.smithi144.stderr:radosgw-admin user create --uid tester --display-name "Testing" --access-key NX5QOQKC6BH2IDN8HC7A --secret LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn 2024-06-04T16:11:13.223 INFO:tasks.workunit.client.0.smithi144.stderr:ignoring --setuser ceph since I am not root 2024-06-04T16:11:13.223 INFO:tasks.workunit.client.0.smithi144.stderr:ignoring --setgroup ceph since I am not root 2024-06-04T16:11:13.261 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:13.260+0000 7f12aef2e800 20 rados->read ofs=0 len=0 2024-06-04T16:11:13.263 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:13.262+0000 7f12aef2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:11:13.263 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:13.262+0000 7f12aef2e800 20 realm 2024-06-04T16:11:13.263 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:13.262+0000 7f12aef2e800 20 rados->read ofs=0 len=0 2024-06-04T16:11:13.263 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:13.262+0000 7f12aef2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:11:13.263 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:13.262+0000 7f12aef2e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-06-04T16:11:13.263 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:13.262+0000 7f12aef2e800 20 rados->read ofs=0 len=0 2024-06-04T16:11:13.264 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:13.262+0000 7f12aef2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:11:13.264 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:13.262+0000 7f12aef2e800 20 rados->read ofs=0 len=0 2024-06-04T16:11:13.264 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:13.263+0000 7f12aef2e800 20 rados_obj.operate() r=0 bl.length=46 2024-06-04T16:11:13.264 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:13.263+0000 7f12aef2e800 20 rados->read ofs=0 len=0 2024-06-04T16:11:13.265 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:13.264+0000 7f12aef2e800 20 rados_obj.operate() r=0 bl.length=1139 2024-06-04T16:11:13.265 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:13.264+0000 7f12aef2e800 20 searching for the correct realm 2024-06-04T16:11:13.267 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:13.266+0000 7f12ab45e640 0 -- 172.21.15.144:0/2005741149 >> [v2:172.21.15.144:6800/1453747520,v1:172.21.15.144:6801/1453747520] conn(0x7f129405b050 msgr2=0x7f12940cdb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-06-04T16:11:13.473 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:13.472+0000 7f12ab45e640 0 -- 172.21.15.144:0/2005741149 >> [v2:172.21.15.144:6824/166159729,v1:172.21.15.144:6825/166159729] conn(0x5628e0de8050 msgr2=0x5628e0dea440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-06-04T16:11:13.478 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:13.477+0000 7f12aef2e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-06-04T16:11:13.478 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:13.477+0000 7f12aef2e800 20 RGWRados::pool_iterate: got zone_info.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767 2024-06-04T16:11:13.478 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:13.477+0000 7f12aef2e800 20 RGWRados::pool_iterate: got default.zone. 2024-06-04T16:11:13.478 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:13.477+0000 7f12aef2e800 20 RGWRados::pool_iterate: got zonegroup_info.abb22408-c332-4e28-8f7a-ff254ea2fed2 2024-06-04T16:11:13.478 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:13.477+0000 7f12aef2e800 20 RGWRados::pool_iterate: got zone_names.default 2024-06-04T16:11:13.478 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:13.477+0000 7f12aef2e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-06-04T16:11:13.479 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:13.477+0000 7f12aef2e800 20 rados->read ofs=0 len=0 2024-06-04T16:11:13.479 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:13.477+0000 7f12aef2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:11:13.479 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:13.477+0000 7f12aef2e800 20 rados->read ofs=0 len=0 2024-06-04T16:11:13.480 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:13.478+0000 7f12aef2e800 20 rados_obj.operate() r=0 bl.length=46 2024-06-04T16:11:13.480 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:13.478+0000 7f12aef2e800 20 rados->read ofs=0 len=0 2024-06-04T16:11:13.480 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:13.478+0000 7f12aef2e800 20 rados_obj.operate() r=0 bl.length=470 2024-06-04T16:11:13.480 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:13.478+0000 7f12aef2e800 20 zone default found 2024-06-04T16:11:13.480 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:13.478+0000 7f12aef2e800 4 Realm: () 2024-06-04T16:11:13.480 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:13.478+0000 7f12aef2e800 4 ZoneGroup: default (abb22408-c332-4e28-8f7a-ff254ea2fed2) 2024-06-04T16:11:13.480 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:13.478+0000 7f12aef2e800 4 Zone: default (be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767) 2024-06-04T16:11:13.480 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:13.478+0000 7f12aef2e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-06-04T16:11:13.480 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:13.478+0000 7f12aef2e800 20 zonegroup default 2024-06-04T16:11:13.480 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:13.478+0000 7f12aef2e800 20 rados->read ofs=0 len=0 2024-06-04T16:11:13.481 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:13.479+0000 7f12aef2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:11:13.481 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:13.479+0000 7f12aef2e800 20 rados->read ofs=0 len=0 2024-06-04T16:11:13.481 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:13.479+0000 7f12aef2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:11:13.481 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:13.479+0000 7f12aef2e800 20 rados->read ofs=0 len=0 2024-06-04T16:11:13.481 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:13.479+0000 7f12aef2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:11:13.481 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:13.479+0000 7f12aef2e800 20 started sync module instance, tier type = 2024-06-04T16:11:13.481 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:13.479+0000 7f12aef2e800 20 started zone id=be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767 (name=default) with tier type = 2024-06-04T16:11:13.490 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:13.489+0000 7f12aef2e800 20 add_watcher() i=0 2024-06-04T16:11:13.490 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:13.489+0000 7f12aef2e800 20 add_watcher() i=1 2024-06-04T16:11:13.490 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:13.489+0000 7f12aef2e800 20 add_watcher() i=2 2024-06-04T16:11:13.490 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:13.489+0000 7f12aef2e800 20 add_watcher() i=3 2024-06-04T16:11:13.490 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:13.489+0000 7f12aef2e800 20 add_watcher() i=4 2024-06-04T16:11:13.490 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:13.489+0000 7f12aef2e800 20 add_watcher() i=5 2024-06-04T16:11:13.490 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:13.489+0000 7f12aef2e800 20 add_watcher() i=6 2024-06-04T16:11:13.491 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:13.490+0000 7f12aef2e800 20 add_watcher() i=7 2024-06-04T16:11:13.491 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:13.490+0000 7f12aef2e800 2 all 8 watchers are set, enabling cache 2024-06-04T16:11:13.494 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:13.492+0000 7f11617e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-06-04T16:11:13.494 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:13.493+0000 7f12aef2e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-06-04T16:11:13.494 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:13.493+0000 7f12aef2e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-06-04T16:11:13.494 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:13.493+0000 7f12aef2e800 5 note: GC not initialized 2024-06-04T16:11:13.494 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:13.493+0000 7f10dbfff640 20 reqs_thread_entry: start 2024-06-04T16:11:13.494 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:13.493+0000 7f12aef2e800 20 init_complete bucket index max shards: 11 2024-06-04T16:11:13.494 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:13.493+0000 7f12aef2e800 20 Filter name: none 2024-06-04T16:11:13.494 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:13.493+0000 7f10d9ffb640 20 reqs_thread_entry: start 2024-06-04T16:11:13.495 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:13.493+0000 7f12aef2e800 10 cache get: name=default.rgw.meta+users.uid+tester : miss 2024-06-04T16:11:13.495 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:13.493+0000 7f12aef2e800 20 rados->read ofs=0 len=0 2024-06-04T16:11:13.495 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:13.494+0000 7f12aef2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:11:13.496 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:13.494+0000 7f12aef2e800 10 cache put: name=default.rgw.meta+users.uid+tester info.flags=0x0 2024-06-04T16:11:13.496 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:13.494+0000 7f12aef2e800 10 adding default.rgw.meta+users.uid+tester to cache LRU end 2024-06-04T16:11:13.496 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:13.494+0000 7f12aef2e800 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : miss 2024-06-04T16:11:13.496 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:13.494+0000 7f12aef2e800 20 rados->read ofs=0 len=0 2024-06-04T16:11:13.496 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:13.494+0000 7f12aef2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:11:13.496 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:13.494+0000 7f12aef2e800 10 cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x0 2024-06-04T16:11:13.496 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:13.494+0000 7f12aef2e800 10 adding default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-06-04T16:11:13.496 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:13.494+0000 7f12aef2e800 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : hit (negative entry) 2024-06-04T16:11:13.496 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:13.494+0000 7f12aef2e800 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : hit (negative entry) 2024-06-04T16:11:13.497 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:13.495+0000 7f12aef2e800 10 cache put: name=default.rgw.meta+users.uid+tester info.flags=0x17 2024-06-04T16:11:13.497 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:13.495+0000 7f12aef2e800 10 moving default.rgw.meta+users.uid+tester to cache LRU end 2024-06-04T16:11:13.497 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:13.496+0000 7f12aef2e800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:users.uid:tester, ofs0, ns] 2024-06-04T16:11:13.497 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:13.496+0000 7f118e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1078036791375 cookie 94733571407360 notifier 5913 bl.length()=569 2024-06-04T16:11:13.497 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:13.496+0000 7f118e7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+tester info.flags=0x17 2024-06-04T16:11:13.498 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:13.496+0000 7f118e7fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+tester to cache LRU end 2024-06-04T16:11:13.499 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:13.498+0000 7f12aef2e800 10 cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2024-06-04T16:11:13.499 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:13.498+0000 7f12aef2e800 10 moving default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-06-04T16:11:13.499 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:13.498+0000 7f12aef2e800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.keys:NX5QOQKC6BH2IDN8HC7A, ofs0, ns] 2024-06-04T16:11:13.500 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:13.498+0000 7f118e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1078036791376 cookie 94733571404240 notifier 5913 bl.length()=180 2024-06-04T16:11:13.500 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:13.498+0000 7f118e7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2024-06-04T16:11:13.500 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:13.498+0000 7f118e7fc640 10 rgw watcher librados: moving default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-06-04T16:11:13.500 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:13.499+0000 7f11617e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-06-04T16:11:13.502 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:13.502+0000 7f12aef2e800 20 remove_watcher() i=0 2024-06-04T16:11:13.503 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:13.502+0000 7f12aef2e800 2 removed watcher, disabling cache 2024-06-04T16:11:13.504 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:13.503+0000 7f12aef2e800 20 remove_watcher() i=1 2024-06-04T16:11:13.505 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:13.504+0000 7f12aef2e800 20 remove_watcher() i=2 2024-06-04T16:11:13.506 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:13.506+0000 7f12aef2e800 20 remove_watcher() i=3 2024-06-04T16:11:13.507 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:13.507+0000 7f12aef2e800 20 remove_watcher() i=4 2024-06-04T16:11:13.508 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:13.508+0000 7f12aef2e800 20 remove_watcher() i=5 2024-06-04T16:11:13.509 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:13.509+0000 7f12aef2e800 20 remove_watcher() i=6 2024-06-04T16:11:13.510 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:13.510+0000 7f12aef2e800 20 remove_watcher() i=7 2024-06-04T16:11:27.252 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:11:27.252 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:11:27.297 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:11:27.297 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:11:27.310 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:11:27.310 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:11:27.325 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:11:27.325 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:11:27.330 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:11:27.330 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:11:27.373 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:11:27.373 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:11:27.415 INFO:tasks.workunit.client.0.smithi144.stderr:TEST: reshard add 2024-06-04T16:11:27.415 INFO:tasks.workunit.client.0.smithi144.stderr: 2024-06-04T16:11:27.417 INFO:tasks.workunit.client.0.smithi144.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-06-04T16:11:27.445 INFO:tasks.workunit.client.0.smithi144.stderr:ignoring --setuser ceph since I am not root 2024-06-04T16:11:27.446 INFO:tasks.workunit.client.0.smithi144.stderr:ignoring --setgroup ceph since I am not root 2024-06-04T16:11:27.484 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:27.484+0000 7f1e4d096800 20 rados->read ofs=0 len=0 2024-06-04T16:11:27.487 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:27.486+0000 7f1e4d096800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:11:27.487 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:27.486+0000 7f1e4d096800 20 realm 2024-06-04T16:11:27.487 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:27.486+0000 7f1e4d096800 20 rados->read ofs=0 len=0 2024-06-04T16:11:27.487 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:27.486+0000 7f1e4d096800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:11:27.487 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:27.486+0000 7f1e4d096800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-06-04T16:11:27.487 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:27.486+0000 7f1e4d096800 20 rados->read ofs=0 len=0 2024-06-04T16:11:27.487 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:27.486+0000 7f1e4d096800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:11:27.487 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:27.486+0000 7f1e4d096800 20 rados->read ofs=0 len=0 2024-06-04T16:11:27.488 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:27.487+0000 7f1e4d096800 20 rados_obj.operate() r=0 bl.length=46 2024-06-04T16:11:27.488 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:27.487+0000 7f1e4d096800 20 rados->read ofs=0 len=0 2024-06-04T16:11:27.488 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:27.487+0000 7f1e4d096800 20 rados_obj.operate() r=0 bl.length=1139 2024-06-04T16:11:27.488 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:27.487+0000 7f1e4d096800 20 searching for the correct realm 2024-06-04T16:11:27.490 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:27.489+0000 7f1e4a38a640 0 -- 172.21.15.144:0/291172405 >> [v2:172.21.15.144:6816/2358575268,v1:172.21.15.144:6817/2358575268] conn(0x5635bd0d47f0 msgr2=0x5635bd0d6be0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-06-04T16:11:27.493 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:27.493+0000 7f1e4a38a640 0 -- 172.21.15.144:0/291172405 >> [v2:172.21.15.177:6808/2618477608,v1:172.21.15.177:6809/2618477608] conn(0x7f1e40081700 msgr2=0x7f1e400668c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-06-04T16:11:28.103 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.102+0000 7f1e4d096800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-06-04T16:11:28.103 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.102+0000 7f1e4d096800 20 RGWRados::pool_iterate: got zone_info.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767 2024-06-04T16:11:28.103 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.102+0000 7f1e4d096800 20 RGWRados::pool_iterate: got default.zone. 2024-06-04T16:11:28.103 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.102+0000 7f1e4d096800 20 RGWRados::pool_iterate: got zonegroup_info.abb22408-c332-4e28-8f7a-ff254ea2fed2 2024-06-04T16:11:28.103 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.102+0000 7f1e4d096800 20 RGWRados::pool_iterate: got zone_names.default 2024-06-04T16:11:28.103 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.102+0000 7f1e4d096800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-06-04T16:11:28.103 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.102+0000 7f1e4d096800 20 rados->read ofs=0 len=0 2024-06-04T16:11:28.104 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.102+0000 7f1e4d096800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:11:28.104 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.102+0000 7f1e4d096800 20 rados->read ofs=0 len=0 2024-06-04T16:11:28.105 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.103+0000 7f1e4d096800 20 rados_obj.operate() r=0 bl.length=46 2024-06-04T16:11:28.105 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.103+0000 7f1e4d096800 20 rados->read ofs=0 len=0 2024-06-04T16:11:28.105 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.103+0000 7f1e4d096800 20 rados_obj.operate() r=0 bl.length=470 2024-06-04T16:11:28.105 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.103+0000 7f1e4d096800 20 zone default found 2024-06-04T16:11:28.105 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.103+0000 7f1e4d096800 4 Realm: () 2024-06-04T16:11:28.105 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.103+0000 7f1e4d096800 4 ZoneGroup: default (abb22408-c332-4e28-8f7a-ff254ea2fed2) 2024-06-04T16:11:28.105 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.103+0000 7f1e4d096800 4 Zone: default (be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767) 2024-06-04T16:11:28.105 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.103+0000 7f1e4d096800 10 cannot find current period zonegroup using local zonegroup configuration 2024-06-04T16:11:28.105 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.103+0000 7f1e4d096800 20 zonegroup default 2024-06-04T16:11:28.105 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.103+0000 7f1e4d096800 20 rados->read ofs=0 len=0 2024-06-04T16:11:28.106 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.103+0000 7f1e4d096800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:11:28.106 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.103+0000 7f1e4d096800 20 rados->read ofs=0 len=0 2024-06-04T16:11:28.106 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.104+0000 7f1e4d096800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:11:28.106 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.104+0000 7f1e4d096800 20 rados->read ofs=0 len=0 2024-06-04T16:11:28.106 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.104+0000 7f1e4d096800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:11:28.106 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.104+0000 7f1e4d096800 20 started sync module instance, tier type = 2024-06-04T16:11:28.106 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.104+0000 7f1e4d096800 20 started zone id=be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767 (name=default) with tier type = 2024-06-04T16:11:28.115 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.114+0000 7f1e4d096800 20 add_watcher() i=0 2024-06-04T16:11:28.115 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.114+0000 7f1e4d096800 20 add_watcher() i=1 2024-06-04T16:11:28.115 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.114+0000 7f1e4d096800 20 add_watcher() i=2 2024-06-04T16:11:28.115 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.114+0000 7f1e4d096800 20 add_watcher() i=3 2024-06-04T16:11:28.115 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.114+0000 7f1e4d096800 20 add_watcher() i=4 2024-06-04T16:11:28.115 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.114+0000 7f1e4d096800 20 add_watcher() i=5 2024-06-04T16:11:28.115 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.114+0000 7f1e4d096800 20 add_watcher() i=6 2024-06-04T16:11:28.115 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.115+0000 7f1e4d096800 20 add_watcher() i=7 2024-06-04T16:11:28.116 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.115+0000 7f1e4d096800 2 all 8 watchers are set, enabling cache 2024-06-04T16:11:28.117 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.117+0000 7f1d017e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-06-04T16:11:28.118 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.117+0000 7f1e4d096800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-06-04T16:11:28.118 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.117+0000 7f1e4d096800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-06-04T16:11:28.119 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.117+0000 7f1e4d096800 5 note: GC not initialized 2024-06-04T16:11:28.119 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.117+0000 7f1c7bfff640 20 reqs_thread_entry: start 2024-06-04T16:11:28.119 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.117+0000 7f1e4d096800 20 init_complete bucket index max shards: 11 2024-06-04T16:11:28.119 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.118+0000 7f1e4d096800 20 Filter name: none 2024-06-04T16:11:28.119 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.118+0000 7f1c79ffb640 20 reqs_thread_entry: start 2024-06-04T16:11:28.119 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.118+0000 7f1e4d096800 20 rados->read ofs=0 len=0 2024-06-04T16:11:28.120 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.118+0000 7f1e4d096800 20 rados_obj.operate() r=0 bl.length=176 2024-06-04T16:11:28.120 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.118+0000 7f1e4d096800 20 rados->read ofs=0 len=0 2024-06-04T16:11:28.120 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.119+0000 7f1e4d096800 20 rados_obj.operate() r=0 bl.length=390 2024-06-04T16:11:28.120 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.119+0000 7f1e4d096800 20 couldn't put binfo cache entry, might have raced with data changes 2024-06-04T16:11:28.120 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.119+0000 7f1e4d096800 20 rados->read ofs=0 len=0 2024-06-04T16:11:28.120 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.119+0000 7f1e4d096800 20 rados_obj.operate() r=0 bl.length=176 2024-06-04T16:11:28.120 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.119+0000 7f1e4d096800 20 rados->read ofs=0 len=0 2024-06-04T16:11:28.121 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.120+0000 7f1e4d096800 20 rados_obj.operate() r=0 bl.length=390 2024-06-04T16:11:28.121 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.120+0000 7f1e4d096800 20 couldn't put binfo cache entry, might have raced with data changes 2024-06-04T16:11:28.122 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.121+0000 7f1d017e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-06-04T16:11:28.124 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.124+0000 7f1e4d096800 20 remove_watcher() i=0 2024-06-04T16:11:28.124 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.124+0000 7f1e4d096800 2 removed watcher, disabling cache 2024-06-04T16:11:28.125 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.125+0000 7f1e4d096800 20 remove_watcher() i=1 2024-06-04T16:11:28.126 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.126+0000 7f1e4d096800 20 remove_watcher() i=2 2024-06-04T16:11:28.128 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.127+0000 7f1e4d096800 20 remove_watcher() i=3 2024-06-04T16:11:28.129 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.128+0000 7f1e4d096800 20 remove_watcher() i=4 2024-06-04T16:11:28.130 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.129+0000 7f1e4d096800 20 remove_watcher() i=5 2024-06-04T16:11:28.131 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.130+0000 7f1e4d096800 20 remove_watcher() i=6 2024-06-04T16:11:28.132 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.132+0000 7f1e4d096800 20 remove_watcher() i=7 2024-06-04T16:11:28.143 INFO:tasks.workunit.client.0.smithi144.stderr: 2024-06-04T16:11:28.143 INFO:tasks.workunit.client.0.smithi144.stderr:BUCKET_STATS: 2024-06-04T16:11:28.143 INFO:tasks.workunit.client.0.smithi144.stderr:bucket: a-bucket id: be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.17 num_objects: 0 size_kb: 0 num_shards: 11 2024-06-04T16:11:28.144 INFO:tasks.workunit.client.0.smithi144.stderr: 2024-06-04T16:11:28.145 INFO:tasks.workunit.client.0.smithi144.stderr:radosgw-admin reshard add --bucket a-bucket --num-shards 12 2024-06-04T16:11:28.175 INFO:tasks.workunit.client.0.smithi144.stderr:ignoring --setuser ceph since I am not root 2024-06-04T16:11:28.176 INFO:tasks.workunit.client.0.smithi144.stderr:ignoring --setgroup ceph since I am not root 2024-06-04T16:11:28.214 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.213+0000 7f43ae462800 20 rados->read ofs=0 len=0 2024-06-04T16:11:28.216 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.215+0000 7f43ae462800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:11:28.216 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.215+0000 7f43ae462800 20 realm 2024-06-04T16:11:28.216 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.215+0000 7f43ae462800 20 rados->read ofs=0 len=0 2024-06-04T16:11:28.216 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.215+0000 7f43ae462800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:11:28.216 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.215+0000 7f43ae462800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-06-04T16:11:28.216 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.215+0000 7f43ae462800 20 rados->read ofs=0 len=0 2024-06-04T16:11:28.216 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.215+0000 7f43ae462800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:11:28.216 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.215+0000 7f43ae462800 20 rados->read ofs=0 len=0 2024-06-04T16:11:28.217 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.216+0000 7f43ae462800 20 rados_obj.operate() r=0 bl.length=46 2024-06-04T16:11:28.217 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.216+0000 7f43ae462800 20 rados->read ofs=0 len=0 2024-06-04T16:11:28.217 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.216+0000 7f43ae462800 20 rados_obj.operate() r=0 bl.length=1139 2024-06-04T16:11:28.217 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.216+0000 7f43ae462800 20 searching for the correct realm 2024-06-04T16:11:28.218 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.217+0000 7f43abf5e640 0 -- 172.21.15.144:0/1680443811 >> [v2:172.21.15.177:6816/2039473917,v1:172.21.15.177:6817/2039473917] conn(0x563ce23b7130 msgr2=0x563ce23b95f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-06-04T16:11:28.220 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.220+0000 7f43abf5e640 0 -- 172.21.15.144:0/1680443811 >> [v2:172.21.15.177:6800/3891611393,v1:172.21.15.177:6801/3891611393] conn(0x7f439c0c3a50 msgr2=0x7f439c0df040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-06-04T16:11:28.228 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.226+0000 7f43ae462800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-06-04T16:11:28.228 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.226+0000 7f43ae462800 20 RGWRados::pool_iterate: got zone_info.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767 2024-06-04T16:11:28.228 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.226+0000 7f43ae462800 20 RGWRados::pool_iterate: got default.zone. 2024-06-04T16:11:28.228 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.226+0000 7f43ae462800 20 RGWRados::pool_iterate: got zonegroup_info.abb22408-c332-4e28-8f7a-ff254ea2fed2 2024-06-04T16:11:28.228 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.226+0000 7f43ae462800 20 RGWRados::pool_iterate: got zone_names.default 2024-06-04T16:11:28.228 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.226+0000 7f43ae462800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-06-04T16:11:28.228 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.226+0000 7f43ae462800 20 rados->read ofs=0 len=0 2024-06-04T16:11:28.228 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.227+0000 7f43ae462800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:11:28.228 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.227+0000 7f43ae462800 20 rados->read ofs=0 len=0 2024-06-04T16:11:28.228 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.227+0000 7f43ae462800 20 rados_obj.operate() r=0 bl.length=46 2024-06-04T16:11:28.228 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.227+0000 7f43ae462800 20 rados->read ofs=0 len=0 2024-06-04T16:11:28.230 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.227+0000 7f43ae462800 20 rados_obj.operate() r=0 bl.length=470 2024-06-04T16:11:28.230 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.227+0000 7f43ae462800 20 zone default found 2024-06-04T16:11:28.230 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.227+0000 7f43ae462800 4 Realm: () 2024-06-04T16:11:28.230 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.227+0000 7f43ae462800 4 ZoneGroup: default (abb22408-c332-4e28-8f7a-ff254ea2fed2) 2024-06-04T16:11:28.230 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.227+0000 7f43ae462800 4 Zone: default (be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767) 2024-06-04T16:11:28.230 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.227+0000 7f43ae462800 10 cannot find current period zonegroup using local zonegroup configuration 2024-06-04T16:11:28.230 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.227+0000 7f43ae462800 20 zonegroup default 2024-06-04T16:11:28.230 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.227+0000 7f43ae462800 20 rados->read ofs=0 len=0 2024-06-04T16:11:28.230 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.228+0000 7f43ae462800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:11:28.230 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.228+0000 7f43ae462800 20 rados->read ofs=0 len=0 2024-06-04T16:11:28.230 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.228+0000 7f43ae462800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:11:28.231 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.228+0000 7f43ae462800 20 rados->read ofs=0 len=0 2024-06-04T16:11:28.231 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.228+0000 7f43ae462800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:11:28.231 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.228+0000 7f43ae462800 20 started sync module instance, tier type = 2024-06-04T16:11:28.231 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.228+0000 7f43ae462800 20 started zone id=be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767 (name=default) with tier type = 2024-06-04T16:11:28.238 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.237+0000 7f43ae462800 20 add_watcher() i=0 2024-06-04T16:11:28.238 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.237+0000 7f43ae462800 20 add_watcher() i=1 2024-06-04T16:11:28.238 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.237+0000 7f43ae462800 20 add_watcher() i=2 2024-06-04T16:11:28.238 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.237+0000 7f43ae462800 20 add_watcher() i=3 2024-06-04T16:11:28.238 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.237+0000 7f43ae462800 20 add_watcher() i=4 2024-06-04T16:11:28.238 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.237+0000 7f43ae462800 20 add_watcher() i=5 2024-06-04T16:11:28.238 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.237+0000 7f43ae462800 20 add_watcher() i=6 2024-06-04T16:11:28.239 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.238+0000 7f43ae462800 20 add_watcher() i=7 2024-06-04T16:11:28.239 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.238+0000 7f43ae462800 2 all 8 watchers are set, enabling cache 2024-06-04T16:11:28.240 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.240+0000 7f4261fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-06-04T16:11:28.241 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.240+0000 7f43ae462800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-06-04T16:11:28.241 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.240+0000 7f43ae462800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-06-04T16:11:28.242 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.240+0000 7f43ae462800 5 note: GC not initialized 2024-06-04T16:11:28.242 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.240+0000 7f4260fe1640 20 reqs_thread_entry: start 2024-06-04T16:11:28.242 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.240+0000 7f43ae462800 20 init_complete bucket index max shards: 11 2024-06-04T16:11:28.242 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.240+0000 7f43ae462800 20 Filter name: none 2024-06-04T16:11:28.242 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.240+0000 7f41da7fc640 20 reqs_thread_entry: start 2024-06-04T16:11:28.242 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.240+0000 7f43ae462800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-06-04T16:11:28.242 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.240+0000 7f43ae462800 20 rados->read ofs=0 len=0 2024-06-04T16:11:28.242 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.241+0000 7f43ae462800 20 rados_obj.operate() r=0 bl.length=176 2024-06-04T16:11:28.242 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.241+0000 7f43ae462800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-06-04T16:11:28.242 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.241+0000 7f43ae462800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-06-04T16:11:28.242 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.241+0000 7f43ae462800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.17 : miss 2024-06-04T16:11:28.242 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.241+0000 7f43ae462800 20 rados->read ofs=0 len=0 2024-06-04T16:11:28.243 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.241+0000 7f43ae462800 20 rados_obj.operate() r=0 bl.length=390 2024-06-04T16:11:28.243 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.241+0000 7f43ae462800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.17 info.flags=0x17 2024-06-04T16:11:28.243 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.241+0000 7f43ae462800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.17 to cache LRU end 2024-06-04T16:11:28.243 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.241+0000 7f43ae462800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-06-04T16:11:28.243 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.241+0000 7f43ae462800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-06-04T16:11:28.243 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.241+0000 7f43ae462800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.17 2024-06-04T16:11:28.244 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.243+0000 7f4261fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-06-04T16:11:28.246 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.245+0000 7f43ae462800 20 remove_watcher() i=0 2024-06-04T16:11:28.246 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.245+0000 7f43ae462800 2 removed watcher, disabling cache 2024-06-04T16:11:28.247 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.246+0000 7f43ae462800 20 remove_watcher() i=1 2024-06-04T16:11:28.248 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.247+0000 7f43ae462800 20 remove_watcher() i=2 2024-06-04T16:11:28.249 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.248+0000 7f43ae462800 20 remove_watcher() i=3 2024-06-04T16:11:28.250 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.249+0000 7f43ae462800 20 remove_watcher() i=4 2024-06-04T16:11:28.251 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.250+0000 7f43ae462800 20 remove_watcher() i=5 2024-06-04T16:11:28.252 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.251+0000 7f43ae462800 20 remove_watcher() i=6 2024-06-04T16:11:28.253 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.252+0000 7f43ae462800 20 remove_watcher() i=7 2024-06-04T16:11:28.264 INFO:tasks.workunit.client.0.smithi144.stderr:radosgw-admin reshard list 2024-06-04T16:11:28.290 INFO:tasks.workunit.client.0.smithi144.stderr:ignoring --setuser ceph since I am not root 2024-06-04T16:11:28.290 INFO:tasks.workunit.client.0.smithi144.stderr:ignoring --setgroup ceph since I am not root 2024-06-04T16:11:28.326 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.325+0000 7fd151a16800 20 rados->read ofs=0 len=0 2024-06-04T16:11:28.329 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.327+0000 7fd151a16800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:11:28.329 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.327+0000 7fd151a16800 20 realm 2024-06-04T16:11:28.329 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.327+0000 7fd151a16800 20 rados->read ofs=0 len=0 2024-06-04T16:11:28.329 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.328+0000 7fd151a16800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:11:28.329 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.328+0000 7fd151a16800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-06-04T16:11:28.329 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.328+0000 7fd151a16800 20 rados->read ofs=0 len=0 2024-06-04T16:11:28.329 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.328+0000 7fd151a16800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:11:28.329 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.328+0000 7fd151a16800 20 rados->read ofs=0 len=0 2024-06-04T16:11:28.330 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.328+0000 7fd151a16800 20 rados_obj.operate() r=0 bl.length=46 2024-06-04T16:11:28.330 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.329+0000 7fd151a16800 20 rados->read ofs=0 len=0 2024-06-04T16:11:28.330 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.329+0000 7fd151a16800 20 rados_obj.operate() r=0 bl.length=1139 2024-06-04T16:11:28.330 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.329+0000 7fd151a16800 20 searching for the correct realm 2024-06-04T16:11:28.332 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.332+0000 7fd14d87b640 0 -- 172.21.15.144:0/3571532008 >> [v2:172.21.15.144:6800/1453747520,v1:172.21.15.144:6801/1453747520] conn(0x7fd13807e020 msgr2=0x7fd138046100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-06-04T16:11:28.538 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.537+0000 7fd14d87b640 0 -- 172.21.15.144:0/3571532008 >> [v2:172.21.15.144:6824/166159729,v1:172.21.15.144:6825/166159729] conn(0x55fe1d03d3f0 msgr2=0x55fe1d03f7e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-06-04T16:11:28.543 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.542+0000 7fd151a16800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-06-04T16:11:28.543 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.542+0000 7fd151a16800 20 RGWRados::pool_iterate: got zone_info.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767 2024-06-04T16:11:28.543 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.542+0000 7fd151a16800 20 RGWRados::pool_iterate: got default.zone. 2024-06-04T16:11:28.543 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.542+0000 7fd151a16800 20 RGWRados::pool_iterate: got zonegroup_info.abb22408-c332-4e28-8f7a-ff254ea2fed2 2024-06-04T16:11:28.543 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.542+0000 7fd151a16800 20 RGWRados::pool_iterate: got zone_names.default 2024-06-04T16:11:28.543 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.542+0000 7fd151a16800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-06-04T16:11:28.543 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.542+0000 7fd151a16800 20 rados->read ofs=0 len=0 2024-06-04T16:11:28.544 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.542+0000 7fd151a16800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:11:28.544 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.542+0000 7fd151a16800 20 rados->read ofs=0 len=0 2024-06-04T16:11:28.545 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.543+0000 7fd151a16800 20 rados_obj.operate() r=0 bl.length=46 2024-06-04T16:11:28.545 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.543+0000 7fd151a16800 20 rados->read ofs=0 len=0 2024-06-04T16:11:28.545 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.543+0000 7fd151a16800 20 rados_obj.operate() r=0 bl.length=470 2024-06-04T16:11:28.545 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.543+0000 7fd151a16800 20 zone default found 2024-06-04T16:11:28.545 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.543+0000 7fd151a16800 4 Realm: () 2024-06-04T16:11:28.545 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.543+0000 7fd151a16800 4 ZoneGroup: default (abb22408-c332-4e28-8f7a-ff254ea2fed2) 2024-06-04T16:11:28.545 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.543+0000 7fd151a16800 4 Zone: default (be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767) 2024-06-04T16:11:28.545 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.543+0000 7fd151a16800 10 cannot find current period zonegroup using local zonegroup configuration 2024-06-04T16:11:28.545 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.543+0000 7fd151a16800 20 zonegroup default 2024-06-04T16:11:28.545 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.543+0000 7fd151a16800 20 rados->read ofs=0 len=0 2024-06-04T16:11:28.545 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.543+0000 7fd151a16800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:11:28.545 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.543+0000 7fd151a16800 20 rados->read ofs=0 len=0 2024-06-04T16:11:28.546 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.544+0000 7fd151a16800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:11:28.546 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.544+0000 7fd151a16800 20 rados->read ofs=0 len=0 2024-06-04T16:11:28.546 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.544+0000 7fd151a16800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:11:28.546 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.544+0000 7fd151a16800 20 started sync module instance, tier type = 2024-06-04T16:11:28.546 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.544+0000 7fd151a16800 20 started zone id=be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767 (name=default) with tier type = 2024-06-04T16:11:28.554 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.554+0000 7fd151a16800 20 add_watcher() i=0 2024-06-04T16:11:28.555 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.554+0000 7fd151a16800 20 add_watcher() i=1 2024-06-04T16:11:28.555 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.554+0000 7fd151a16800 20 add_watcher() i=2 2024-06-04T16:11:28.555 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.554+0000 7fd151a16800 20 add_watcher() i=3 2024-06-04T16:11:28.555 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.554+0000 7fd151a16800 20 add_watcher() i=4 2024-06-04T16:11:28.555 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.554+0000 7fd151a16800 20 add_watcher() i=5 2024-06-04T16:11:28.555 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.554+0000 7fd151a16800 20 add_watcher() i=6 2024-06-04T16:11:28.556 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.555+0000 7fd151a16800 20 add_watcher() i=7 2024-06-04T16:11:28.556 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.555+0000 7fd151a16800 2 all 8 watchers are set, enabling cache 2024-06-04T16:11:28.557 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.557+0000 7fd0037e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-06-04T16:11:28.558 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.557+0000 7fd151a16800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-06-04T16:11:28.558 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.557+0000 7fd151a16800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-06-04T16:11:28.558 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.557+0000 7fd151a16800 5 note: GC not initialized 2024-06-04T16:11:28.558 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.557+0000 7fd0027e4640 20 reqs_thread_entry: start 2024-06-04T16:11:28.559 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.557+0000 7fd151a16800 20 init_complete bucket index max shards: 11 2024-06-04T16:11:28.559 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.557+0000 7fd151a16800 20 Filter name: none 2024-06-04T16:11:28.559 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.557+0000 7fcf73fff640 20 reqs_thread_entry: start 2024-06-04T16:11:28.564 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.563+0000 7fd0037e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-06-04T16:11:28.566 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.565+0000 7fd151a16800 20 remove_watcher() i=0 2024-06-04T16:11:28.566 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.565+0000 7fd151a16800 2 removed watcher, disabling cache 2024-06-04T16:11:28.567 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.567+0000 7fd151a16800 20 remove_watcher() i=1 2024-06-04T16:11:28.568 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.568+0000 7fd151a16800 20 remove_watcher() i=2 2024-06-04T16:11:28.570 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.569+0000 7fd151a16800 20 remove_watcher() i=3 2024-06-04T16:11:28.570 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.570+0000 7fd151a16800 20 remove_watcher() i=4 2024-06-04T16:11:28.571 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.571+0000 7fd151a16800 20 remove_watcher() i=5 2024-06-04T16:11:28.572 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.572+0000 7fd151a16800 20 remove_watcher() i=6 2024-06-04T16:11:28.574 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.573+0000 7fd151a16800 20 remove_watcher() i=7 2024-06-04T16:11:28.584 INFO:tasks.workunit.client.0.smithi144.stderr:bucket name a-bucket 2024-06-04T16:11:28.584 INFO:tasks.workunit.client.0.smithi144.stderr:TEST: reshard process 2024-06-04T16:11:28.584 INFO:tasks.workunit.client.0.smithi144.stderr: 2024-06-04T16:11:28.586 INFO:tasks.workunit.client.0.smithi144.stderr:radosgw-admin reshard process 2024-06-04T16:11:28.612 INFO:tasks.workunit.client.0.smithi144.stderr:ignoring --setuser ceph since I am not root 2024-06-04T16:11:28.612 INFO:tasks.workunit.client.0.smithi144.stderr:ignoring --setgroup ceph since I am not root 2024-06-04T16:11:28.650 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.649+0000 7f192760f800 20 rados->read ofs=0 len=0 2024-06-04T16:11:28.651 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.650+0000 7f192760f800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:11:28.651 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.650+0000 7f192760f800 20 realm 2024-06-04T16:11:28.651 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.650+0000 7f192760f800 20 rados->read ofs=0 len=0 2024-06-04T16:11:28.651 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.650+0000 7f192760f800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:11:28.651 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.650+0000 7f192760f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-06-04T16:11:28.651 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.650+0000 7f192760f800 20 rados->read ofs=0 len=0 2024-06-04T16:11:28.651 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.650+0000 7f192760f800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:11:28.651 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.650+0000 7f192760f800 20 rados->read ofs=0 len=0 2024-06-04T16:11:28.652 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.651+0000 7f192760f800 20 rados_obj.operate() r=0 bl.length=46 2024-06-04T16:11:28.652 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.651+0000 7f192760f800 20 rados->read ofs=0 len=0 2024-06-04T16:11:28.652 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.652+0000 7f192760f800 20 rados_obj.operate() r=0 bl.length=1139 2024-06-04T16:11:28.652 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.652+0000 7f192760f800 20 searching for the correct realm 2024-06-04T16:11:28.654 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.654+0000 7f192340b640 0 -- 172.21.15.144:0/3599621993 >> [v2:172.21.15.144:6800/1453747520,v1:172.21.15.144:6801/1453747520] conn(0x7f190c01a040 msgr2=0x7f190c09d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-06-04T16:11:28.860 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.859+0000 7f192340b640 0 -- 172.21.15.144:0/3599621993 >> [v2:172.21.15.144:6824/166159729,v1:172.21.15.144:6825/166159729] conn(0x55d23f6aea60 msgr2=0x55d23f6b0e70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-06-04T16:11:28.865 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.864+0000 7f192760f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-06-04T16:11:28.865 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.864+0000 7f192760f800 20 RGWRados::pool_iterate: got zone_info.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767 2024-06-04T16:11:28.866 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.864+0000 7f192760f800 20 RGWRados::pool_iterate: got default.zone. 2024-06-04T16:11:28.866 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.864+0000 7f192760f800 20 RGWRados::pool_iterate: got zonegroup_info.abb22408-c332-4e28-8f7a-ff254ea2fed2 2024-06-04T16:11:28.866 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.864+0000 7f192760f800 20 RGWRados::pool_iterate: got zone_names.default 2024-06-04T16:11:28.866 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.864+0000 7f192760f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-06-04T16:11:28.866 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.864+0000 7f192760f800 20 rados->read ofs=0 len=0 2024-06-04T16:11:28.866 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.865+0000 7f192760f800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:11:28.866 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.865+0000 7f192760f800 20 rados->read ofs=0 len=0 2024-06-04T16:11:28.867 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.865+0000 7f192760f800 20 rados_obj.operate() r=0 bl.length=46 2024-06-04T16:11:28.867 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.865+0000 7f192760f800 20 rados->read ofs=0 len=0 2024-06-04T16:11:28.867 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.866+0000 7f192760f800 20 rados_obj.operate() r=0 bl.length=470 2024-06-04T16:11:28.867 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.866+0000 7f192760f800 20 zone default found 2024-06-04T16:11:28.868 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.866+0000 7f192760f800 4 Realm: () 2024-06-04T16:11:28.868 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.866+0000 7f192760f800 4 ZoneGroup: default (abb22408-c332-4e28-8f7a-ff254ea2fed2) 2024-06-04T16:11:28.868 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.866+0000 7f192760f800 4 Zone: default (be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767) 2024-06-04T16:11:28.868 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.866+0000 7f192760f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-06-04T16:11:28.868 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.866+0000 7f192760f800 20 zonegroup default 2024-06-04T16:11:28.868 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.866+0000 7f192760f800 20 rados->read ofs=0 len=0 2024-06-04T16:11:28.868 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.866+0000 7f192760f800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:11:28.868 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.866+0000 7f192760f800 20 rados->read ofs=0 len=0 2024-06-04T16:11:28.868 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.866+0000 7f192760f800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:11:28.868 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.866+0000 7f192760f800 20 rados->read ofs=0 len=0 2024-06-04T16:11:28.868 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.866+0000 7f192760f800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:11:28.868 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.866+0000 7f192760f800 20 started sync module instance, tier type = 2024-06-04T16:11:28.868 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.866+0000 7f192760f800 20 started zone id=be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767 (name=default) with tier type = 2024-06-04T16:11:28.877 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.877+0000 7f192760f800 20 add_watcher() i=0 2024-06-04T16:11:28.878 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.877+0000 7f192760f800 20 add_watcher() i=1 2024-06-04T16:11:28.878 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.877+0000 7f192760f800 20 add_watcher() i=2 2024-06-04T16:11:28.878 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.877+0000 7f192760f800 20 add_watcher() i=3 2024-06-04T16:11:28.878 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.877+0000 7f192760f800 20 add_watcher() i=4 2024-06-04T16:11:28.878 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.877+0000 7f192760f800 20 add_watcher() i=5 2024-06-04T16:11:28.878 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.877+0000 7f192760f800 20 add_watcher() i=6 2024-06-04T16:11:28.878 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.878+0000 7f192760f800 20 add_watcher() i=7 2024-06-04T16:11:28.878 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.878+0000 7f192760f800 2 all 8 watchers are set, enabling cache 2024-06-04T16:11:28.880 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.880+0000 7f17d97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-06-04T16:11:28.881 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.880+0000 7f192760f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-06-04T16:11:28.881 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.880+0000 7f192760f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-06-04T16:11:28.881 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.880+0000 7f192760f800 5 note: GC not initialized 2024-06-04T16:11:28.881 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.880+0000 7f1753fff640 20 reqs_thread_entry: start 2024-06-04T16:11:28.882 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.880+0000 7f192760f800 20 init_complete bucket index max shards: 11 2024-06-04T16:11:28.882 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.880+0000 7f192760f800 20 Filter name: none 2024-06-04T16:11:28.882 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.880+0000 7f1751ffb640 20 reqs_thread_entry: start 2024-06-04T16:11:28.882 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.880+0000 7f192760f800 20 processing logshard = reshard.0000000000 2024-06-04T16:11:28.884 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.883+0000 7f192760f800 20 finish processing logshard = reshard.0000000000 , ret = 0 2024-06-04T16:11:28.884 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.883+0000 7f192760f800 20 processing logshard = reshard.0000000001 2024-06-04T16:11:28.886 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.886+0000 7f192760f800 20 finish processing logshard = reshard.0000000001 , ret = 0 2024-06-04T16:11:28.887 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.886+0000 7f192760f800 20 processing logshard = reshard.0000000002 2024-06-04T16:11:28.889 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.888+0000 7f192760f800 20 finish processing logshard = reshard.0000000002 , ret = 0 2024-06-04T16:11:28.889 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.888+0000 7f192760f800 20 processing logshard = reshard.0000000003 2024-06-04T16:11:28.894 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.891+0000 7f192760f800 20 finish processing logshard = reshard.0000000003 , ret = 0 2024-06-04T16:11:28.894 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.891+0000 7f192760f800 20 processing logshard = reshard.0000000004 2024-06-04T16:11:28.894 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.893+0000 7f192760f800 20 finish processing logshard = reshard.0000000004 , ret = 0 2024-06-04T16:11:28.894 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.893+0000 7f192760f800 20 processing logshard = reshard.0000000005 2024-06-04T16:11:28.897 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.896+0000 7f192760f800 20 finish processing logshard = reshard.0000000005 , ret = 0 2024-06-04T16:11:28.897 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.896+0000 7f192760f800 20 processing logshard = reshard.0000000006 2024-06-04T16:11:28.899 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.897+0000 7f192760f800 20 process_entry resharding a-bucket 2024-06-04T16:11:28.899 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.897+0000 7f192760f800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-06-04T16:11:28.899 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.897+0000 7f192760f800 20 rados->read ofs=0 len=0 2024-06-04T16:11:28.899 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.898+0000 7f192760f800 20 rados_obj.operate() r=0 bl.length=176 2024-06-04T16:11:28.899 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.898+0000 7f192760f800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x1 2024-06-04T16:11:28.899 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.898+0000 7f192760f800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-06-04T16:11:28.899 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.898+0000 7f192760f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.17 : miss 2024-06-04T16:11:28.899 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.898+0000 7f192760f800 20 rados->read ofs=0 len=0 2024-06-04T16:11:28.899 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.898+0000 7f192760f800 20 rados_obj.operate() r=0 bl.length=390 2024-06-04T16:11:28.900 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.898+0000 7f192760f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.17 info.flags=0x17 2024-06-04T16:11:28.900 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.898+0000 7f192760f800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.17 to cache LRU end 2024-06-04T16:11:28.900 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.898+0000 7f192760f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-06-04T16:11:28.900 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.898+0000 7f192760f800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-06-04T16:11:28.900 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.898+0000 7f192760f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.17 2024-06-04T16:11:28.905 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.904+0000 7f192760f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.17 info.flags=0x17 2024-06-04T16:11:28.905 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.904+0000 7f192760f800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.17 to cache LRU end 2024-06-04T16:11:28.905 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.904+0000 7f192760f800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-06-04T16:11:28.905 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.904+0000 7f192760f800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.17, ofs0, ns] 2024-06-04T16:11:28.906 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.905+0000 7f18067fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1078036791386 cookie 94361495508352 notifier 5985 bl.length()=819 2024-06-04T16:11:28.906 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.905+0000 7f18067fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.17 info.flags=0x17 2024-06-04T16:11:28.906 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.905+0000 7f18067fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.17 to cache LRU end 2024-06-04T16:11:28.906 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.905+0000 7f18067fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-06-04T16:11:28.906 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.905+0000 7f192760f800 20 handle_bi_update(): bucket=:a-bucket[be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.17]): orig_sources= new_sources= 2024-06-04T16:11:28.906 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.905+0000 7f192760f800 20 handle_bi_update(): bucket=:a-bucket[be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.17]): potential sources added=[] removed=[] 2024-06-04T16:11:28.906 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.905+0000 7f192760f800 20 handle_bi_update(): bucket=:a-bucket[be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.17]): orig_dests= new_dests= 2024-06-04T16:11:28.906 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.905+0000 7f192760f800 20 handle_bi_update(): bucket=:a-bucket[be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.17]): potential dests added=[] removed=[] 2024-06-04T16:11:28.908 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.907+0000 7f192760f800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.17.1.0 2024-06-04T16:11:28.909 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.907+0000 7f192760f800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.17.1.0 2024-06-04T16:11:28.909 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.907+0000 7f192760f800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.17.1.1 2024-06-04T16:11:28.909 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.907+0000 7f192760f800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.17.1.1 2024-06-04T16:11:28.909 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.907+0000 7f192760f800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.17.1.2 2024-06-04T16:11:28.909 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.907+0000 7f192760f800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.17.1.2 2024-06-04T16:11:28.909 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.907+0000 7f192760f800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.17.1.3 2024-06-04T16:11:28.909 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.907+0000 7f192760f800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.17.1.3 2024-06-04T16:11:28.909 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.907+0000 7f192760f800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.17.1.4 2024-06-04T16:11:28.909 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.907+0000 7f192760f800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.17.1.4 2024-06-04T16:11:28.909 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.907+0000 7f192760f800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.17.1.5 2024-06-04T16:11:28.909 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.907+0000 7f192760f800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.17.1.5 2024-06-04T16:11:28.909 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.907+0000 7f192760f800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.17.1.6 2024-06-04T16:11:28.909 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.907+0000 7f192760f800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.17.1.6 2024-06-04T16:11:28.909 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.907+0000 7f192760f800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.17.1.7 2024-06-04T16:11:28.910 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.907+0000 7f192760f800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.17.1.7 2024-06-04T16:11:28.910 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.907+0000 7f192760f800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.17.1.8 2024-06-04T16:11:28.910 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.907+0000 7f192760f800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.17.1.8 2024-06-04T16:11:28.910 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.907+0000 7f192760f800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.17.1.9 2024-06-04T16:11:28.910 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.907+0000 7f192760f800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.17.1.9 2024-06-04T16:11:28.910 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.907+0000 7f192760f800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.17.1.10 2024-06-04T16:11:28.910 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.907+0000 7f192760f800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.17.1.10 2024-06-04T16:11:28.910 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.907+0000 7f192760f800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.17.1.11 2024-06-04T16:11:28.910 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.907+0000 7f192760f800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.17.1.11 2024-06-04T16:11:28.910 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.907+0000 7f192760f800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.17.0 2024-06-04T16:11:28.910 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.908+0000 7f192760f800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.17.1 2024-06-04T16:11:28.911 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.908+0000 7f192760f800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.17.2 2024-06-04T16:11:28.911 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.909+0000 7f192760f800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.17.3 2024-06-04T16:11:28.911 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.909+0000 7f192760f800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.17.4 2024-06-04T16:11:28.911 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.910+0000 7f192760f800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.17.5 2024-06-04T16:11:28.912 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.910+0000 7f192760f800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.17.6 2024-06-04T16:11:28.912 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.911+0000 7f192760f800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.17.7 2024-06-04T16:11:28.912 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.911+0000 7f192760f800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.17.8 2024-06-04T16:11:28.912 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.911+0000 7f192760f800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.17.9 2024-06-04T16:11:28.912 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.912+0000 7f192760f800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.17.10 2024-06-04T16:11:28.913 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.912+0000 7f192760f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.17 : hit (requested=0x17, cached=0x17) 2024-06-04T16:11:28.913 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.912+0000 7f192760f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.17 2024-06-04T16:11:28.914 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.913+0000 7f192760f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.17 info.flags=0x17 2024-06-04T16:11:28.914 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.913+0000 7f192760f800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.17 to cache LRU end 2024-06-04T16:11:28.915 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.913+0000 7f192760f800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-06-04T16:11:28.915 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.913+0000 7f192760f800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.17, ofs0, ns] 2024-06-04T16:11:28.915 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.914+0000 7f1805ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1078036791387 cookie 94361495508352 notifier 5985 bl.length()=787 2024-06-04T16:11:28.915 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.914+0000 7f1805ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.17 info.flags=0x17 2024-06-04T16:11:28.915 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.914+0000 7f1805ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.17 to cache LRU end 2024-06-04T16:11:28.915 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.914+0000 7f1805ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-06-04T16:11:28.915 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.914+0000 7f192760f800 20 handle_bi_update(): bucket=:a-bucket[be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.17]): orig_sources= new_sources= 2024-06-04T16:11:28.915 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.914+0000 7f192760f800 20 handle_bi_update(): bucket=:a-bucket[be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.17]): potential sources added=[] removed=[] 2024-06-04T16:11:28.915 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.914+0000 7f192760f800 20 handle_bi_update(): bucket=:a-bucket[be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.17]): orig_dests= new_dests= 2024-06-04T16:11:28.915 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.914+0000 7f192760f800 20 handle_bi_update(): bucket=:a-bucket[be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.17]): potential dests added=[] removed=[] 2024-06-04T16:11:28.918 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.917+0000 7f192760f800 1 execute INFO: reshard of bucket "a-bucket" completed successfully 2024-06-04T16:11:28.919 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.918+0000 7f192760f800 20 process_entry removing reshard queue entry for bucket a-bucket 2024-06-04T16:11:28.921 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.920+0000 7f192760f800 20 finish processing logshard = reshard.0000000006 , ret = 0 2024-06-04T16:11:28.921 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.920+0000 7f192760f800 20 processing logshard = reshard.0000000007 2024-06-04T16:11:28.924 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.923+0000 7f192760f800 20 finish processing logshard = reshard.0000000007 , ret = 0 2024-06-04T16:11:28.924 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.923+0000 7f192760f800 20 processing logshard = reshard.0000000008 2024-06-04T16:11:28.926 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.925+0000 7f192760f800 20 finish processing logshard = reshard.0000000008 , ret = 0 2024-06-04T16:11:28.926 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.925+0000 7f192760f800 20 processing logshard = reshard.0000000009 2024-06-04T16:11:28.928 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.927+0000 7f192760f800 20 finish processing logshard = reshard.0000000009 , ret = 0 2024-06-04T16:11:28.928 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.927+0000 7f192760f800 20 processing logshard = reshard.0000000010 2024-06-04T16:11:28.931 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.930+0000 7f192760f800 20 finish processing logshard = reshard.0000000010 , ret = 0 2024-06-04T16:11:28.931 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.930+0000 7f192760f800 20 processing logshard = reshard.0000000011 2024-06-04T16:11:28.933 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.933+0000 7f192760f800 20 finish processing logshard = reshard.0000000011 , ret = 0 2024-06-04T16:11:28.933 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.933+0000 7f192760f800 20 processing logshard = reshard.0000000012 2024-06-04T16:11:28.935 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.935+0000 7f192760f800 20 finish processing logshard = reshard.0000000012 , ret = 0 2024-06-04T16:11:28.935 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.935+0000 7f192760f800 20 processing logshard = reshard.0000000013 2024-06-04T16:11:28.938 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.937+0000 7f192760f800 20 finish processing logshard = reshard.0000000013 , ret = 0 2024-06-04T16:11:28.938 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.937+0000 7f192760f800 20 processing logshard = reshard.0000000014 2024-06-04T16:11:28.941 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.940+0000 7f192760f800 20 finish processing logshard = reshard.0000000014 , ret = 0 2024-06-04T16:11:28.941 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.940+0000 7f192760f800 20 processing logshard = reshard.0000000015 2024-06-04T16:11:28.943 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.942+0000 7f192760f800 20 finish processing logshard = reshard.0000000015 , ret = 0 2024-06-04T16:11:28.944 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.943+0000 7f17d97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-06-04T16:11:28.946 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.945+0000 7f192760f800 20 remove_watcher() i=0 2024-06-04T16:11:28.946 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.945+0000 7f192760f800 2 removed watcher, disabling cache 2024-06-04T16:11:28.947 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.946+0000 7f192760f800 20 remove_watcher() i=1 2024-06-04T16:11:28.948 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.947+0000 7f192760f800 20 remove_watcher() i=2 2024-06-04T16:11:28.949 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.948+0000 7f192760f800 20 remove_watcher() i=3 2024-06-04T16:11:28.950 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.949+0000 7f192760f800 20 remove_watcher() i=4 2024-06-04T16:11:28.951 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.950+0000 7f192760f800 20 remove_watcher() i=5 2024-06-04T16:11:28.952 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.951+0000 7f192760f800 20 remove_watcher() i=6 2024-06-04T16:11:28.953 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:28.953+0000 7f192760f800 20 remove_watcher() i=7 2024-06-04T16:11:33.971 INFO:tasks.workunit.client.0.smithi144.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-06-04T16:11:34.002 INFO:tasks.workunit.client.0.smithi144.stderr:ignoring --setuser ceph since I am not root 2024-06-04T16:11:34.002 INFO:tasks.workunit.client.0.smithi144.stderr:ignoring --setgroup ceph since I am not root 2024-06-04T16:11:34.042 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:34.042+0000 7f2085e1d800 20 rados->read ofs=0 len=0 2024-06-04T16:11:34.044 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:34.043+0000 7f2085e1d800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:11:34.044 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:34.043+0000 7f2085e1d800 20 realm 2024-06-04T16:11:34.044 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:34.043+0000 7f2085e1d800 20 rados->read ofs=0 len=0 2024-06-04T16:11:34.045 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:34.044+0000 7f2085e1d800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:11:34.045 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:34.044+0000 7f2085e1d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-06-04T16:11:34.045 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:34.044+0000 7f2085e1d800 20 rados->read ofs=0 len=0 2024-06-04T16:11:34.045 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:34.044+0000 7f2085e1d800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:11:34.045 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:34.044+0000 7f2085e1d800 20 rados->read ofs=0 len=0 2024-06-04T16:11:34.045 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:34.044+0000 7f2085e1d800 20 rados_obj.operate() r=0 bl.length=46 2024-06-04T16:11:34.045 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:34.044+0000 7f2085e1d800 20 rados->read ofs=0 len=0 2024-06-04T16:11:34.046 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:34.045+0000 7f2085e1d800 20 rados_obj.operate() r=0 bl.length=1139 2024-06-04T16:11:34.046 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:34.045+0000 7f2085e1d800 20 searching for the correct realm 2024-06-04T16:11:34.048 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:34.048+0000 7f207b111640 0 -- 172.21.15.144:0/3464961021 >> [v2:172.21.15.144:6816/2358575268,v1:172.21.15.144:6817/2358575268] conn(0x559b452f4710 msgr2=0x559b452f6b00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-06-04T16:11:34.052 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:34.051+0000 7f207b111640 0 -- 172.21.15.144:0/3464961021 >> [v2:172.21.15.177:6808/2618477608,v1:172.21.15.177:6809/2618477608] conn(0x7f206c0a0840 msgr2=0x7f206c085490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-06-04T16:11:34.260 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:34.259+0000 7f2085e1d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-06-04T16:11:34.260 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:34.259+0000 7f2085e1d800 20 RGWRados::pool_iterate: got zone_info.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767 2024-06-04T16:11:34.260 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:34.259+0000 7f2085e1d800 20 RGWRados::pool_iterate: got default.zone. 2024-06-04T16:11:34.260 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:34.259+0000 7f2085e1d800 20 RGWRados::pool_iterate: got zonegroup_info.abb22408-c332-4e28-8f7a-ff254ea2fed2 2024-06-04T16:11:34.260 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:34.259+0000 7f2085e1d800 20 RGWRados::pool_iterate: got zone_names.default 2024-06-04T16:11:34.260 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:34.259+0000 7f2085e1d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-06-04T16:11:34.260 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:34.259+0000 7f2085e1d800 20 rados->read ofs=0 len=0 2024-06-04T16:11:34.260 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:34.259+0000 7f2085e1d800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:11:34.260 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:34.259+0000 7f2085e1d800 20 rados->read ofs=0 len=0 2024-06-04T16:11:34.261 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:34.259+0000 7f2085e1d800 20 rados_obj.operate() r=0 bl.length=46 2024-06-04T16:11:34.262 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:34.259+0000 7f2085e1d800 20 rados->read ofs=0 len=0 2024-06-04T16:11:34.262 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:34.260+0000 7f2085e1d800 20 rados_obj.operate() r=0 bl.length=470 2024-06-04T16:11:34.262 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:34.260+0000 7f2085e1d800 20 zone default found 2024-06-04T16:11:34.262 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:34.260+0000 7f2085e1d800 4 Realm: () 2024-06-04T16:11:34.262 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:34.260+0000 7f2085e1d800 4 ZoneGroup: default (abb22408-c332-4e28-8f7a-ff254ea2fed2) 2024-06-04T16:11:34.262 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:34.260+0000 7f2085e1d800 4 Zone: default (be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767) 2024-06-04T16:11:34.262 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:34.260+0000 7f2085e1d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-06-04T16:11:34.262 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:34.260+0000 7f2085e1d800 20 zonegroup default 2024-06-04T16:11:34.262 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:34.260+0000 7f2085e1d800 20 rados->read ofs=0 len=0 2024-06-04T16:11:34.262 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:34.260+0000 7f2085e1d800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:11:34.262 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:34.260+0000 7f2085e1d800 20 rados->read ofs=0 len=0 2024-06-04T16:11:34.262 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:34.260+0000 7f2085e1d800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:11:34.262 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:34.260+0000 7f2085e1d800 20 rados->read ofs=0 len=0 2024-06-04T16:11:34.263 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:34.261+0000 7f2085e1d800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:11:34.263 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:34.261+0000 7f2085e1d800 20 started sync module instance, tier type = 2024-06-04T16:11:34.263 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:34.261+0000 7f2085e1d800 20 started zone id=be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767 (name=default) with tier type = 2024-06-04T16:11:34.272 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:34.271+0000 7f2085e1d800 20 add_watcher() i=0 2024-06-04T16:11:34.272 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:34.271+0000 7f2085e1d800 20 add_watcher() i=1 2024-06-04T16:11:34.272 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:34.271+0000 7f2085e1d800 20 add_watcher() i=2 2024-06-04T16:11:34.272 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:34.271+0000 7f2085e1d800 20 add_watcher() i=3 2024-06-04T16:11:34.272 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:34.271+0000 7f2085e1d800 20 add_watcher() i=4 2024-06-04T16:11:34.272 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:34.271+0000 7f2085e1d800 20 add_watcher() i=5 2024-06-04T16:11:34.272 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:34.271+0000 7f2085e1d800 20 add_watcher() i=6 2024-06-04T16:11:34.272 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:34.272+0000 7f2085e1d800 20 add_watcher() i=7 2024-06-04T16:11:34.272 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:34.272+0000 7f2085e1d800 2 all 8 watchers are set, enabling cache 2024-06-04T16:11:34.274 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:34.274+0000 7f1f39fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-06-04T16:11:34.275 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:34.274+0000 7f2085e1d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-06-04T16:11:34.275 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:34.274+0000 7f2085e1d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-06-04T16:11:34.276 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:34.274+0000 7f2085e1d800 5 note: GC not initialized 2024-06-04T16:11:34.276 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:34.274+0000 7f1f38fe1640 20 reqs_thread_entry: start 2024-06-04T16:11:34.276 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:34.275+0000 7f2085e1d800 20 init_complete bucket index max shards: 11 2024-06-04T16:11:34.276 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:34.275+0000 7f2085e1d800 20 Filter name: none 2024-06-04T16:11:34.276 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:34.275+0000 7f1eb27fc640 20 reqs_thread_entry: start 2024-06-04T16:11:34.276 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:34.275+0000 7f2085e1d800 20 rados->read ofs=0 len=0 2024-06-04T16:11:34.277 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:34.275+0000 7f2085e1d800 20 rados_obj.operate() r=0 bl.length=176 2024-06-04T16:11:34.277 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:34.275+0000 7f2085e1d800 20 rados->read ofs=0 len=0 2024-06-04T16:11:34.277 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:34.276+0000 7f2085e1d800 20 rados_obj.operate() r=0 bl.length=390 2024-06-04T16:11:34.277 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:34.276+0000 7f2085e1d800 20 couldn't put binfo cache entry, might have raced with data changes 2024-06-04T16:11:34.277 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:34.276+0000 7f2085e1d800 20 rados->read ofs=0 len=0 2024-06-04T16:11:34.277 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:34.276+0000 7f2085e1d800 20 rados_obj.operate() r=0 bl.length=176 2024-06-04T16:11:34.277 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:34.276+0000 7f2085e1d800 20 rados->read ofs=0 len=0 2024-06-04T16:11:34.278 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:34.276+0000 7f2085e1d800 20 rados_obj.operate() r=0 bl.length=390 2024-06-04T16:11:34.278 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:34.276+0000 7f2085e1d800 20 couldn't put binfo cache entry, might have raced with data changes 2024-06-04T16:11:34.279 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:34.278+0000 7f1f39fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-06-04T16:11:34.281 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:34.280+0000 7f2085e1d800 20 remove_watcher() i=0 2024-06-04T16:11:34.281 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:34.280+0000 7f2085e1d800 2 removed watcher, disabling cache 2024-06-04T16:11:34.282 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:34.282+0000 7f2085e1d800 20 remove_watcher() i=1 2024-06-04T16:11:34.283 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:34.283+0000 7f2085e1d800 20 remove_watcher() i=2 2024-06-04T16:11:34.284 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:34.284+0000 7f2085e1d800 20 remove_watcher() i=3 2024-06-04T16:11:34.285 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:34.285+0000 7f2085e1d800 20 remove_watcher() i=4 2024-06-04T16:11:34.286 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:34.286+0000 7f2085e1d800 20 remove_watcher() i=5 2024-06-04T16:11:34.287 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:34.287+0000 7f2085e1d800 20 remove_watcher() i=6 2024-06-04T16:11:34.289 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:34.288+0000 7f2085e1d800 20 remove_watcher() i=7 2024-06-04T16:11:34.300 INFO:tasks.workunit.client.0.smithi144.stderr: 2024-06-04T16:11:34.300 INFO:tasks.workunit.client.0.smithi144.stderr:BUCKET_STATS: 2024-06-04T16:11:34.300 INFO:tasks.workunit.client.0.smithi144.stderr:bucket: a-bucket id: be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.17 num_objects: 0 size_kb: 0 num_shards: 12 2024-06-04T16:11:34.300 INFO:tasks.workunit.client.0.smithi144.stderr: 2024-06-04T16:11:34.300 INFO:tasks.workunit.client.0.smithi144.stderr:TEST: reshard add non empty bucket 2024-06-04T16:11:34.300 INFO:tasks.workunit.client.0.smithi144.stderr: 2024-06-04T16:11:34.304 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:11:34.304 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:11:34.313 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:11:34.313 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:11:34.320 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:11:34.320 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:11:34.327 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:11:34.327 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:11:34.333 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:11:34.333 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:11:34.340 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:11:34.340 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:11:34.347 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:11:34.347 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:11:34.354 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:11:34.354 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:11:34.360 INFO:tasks.workunit.client.0.smithi144.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-06-04T16:11:34.388 INFO:tasks.workunit.client.0.smithi144.stderr:ignoring --setuser ceph since I am not root 2024-06-04T16:11:34.388 INFO:tasks.workunit.client.0.smithi144.stderr:ignoring --setgroup ceph since I am not root 2024-06-04T16:11:34.425 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:34.424+0000 7fb3bff2c800 20 rados->read ofs=0 len=0 2024-06-04T16:11:34.427 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:34.426+0000 7fb3bff2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:11:34.427 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:34.426+0000 7fb3bff2c800 20 realm 2024-06-04T16:11:34.427 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:34.426+0000 7fb3bff2c800 20 rados->read ofs=0 len=0 2024-06-04T16:11:34.427 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:34.426+0000 7fb3bff2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:11:34.427 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:34.426+0000 7fb3bff2c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-06-04T16:11:34.427 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:34.426+0000 7fb3bff2c800 20 rados->read ofs=0 len=0 2024-06-04T16:11:34.427 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:34.426+0000 7fb3bff2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:11:34.428 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:34.426+0000 7fb3bff2c800 20 rados->read ofs=0 len=0 2024-06-04T16:11:34.428 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:34.427+0000 7fb3bff2c800 20 rados_obj.operate() r=0 bl.length=46 2024-06-04T16:11:34.428 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:34.427+0000 7fb3bff2c800 20 rados->read ofs=0 len=0 2024-06-04T16:11:34.428 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:34.428+0000 7fb3bff2c800 20 rados_obj.operate() r=0 bl.length=1139 2024-06-04T16:11:34.429 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:34.428+0000 7fb3bff2c800 20 searching for the correct realm 2024-06-04T16:11:34.430 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:34.429+0000 7fb3b3fff640 0 -- 172.21.15.144:0/114298358 >> [v2:172.21.15.144:6808/86532035,v1:172.21.15.144:6809/86532035] conn(0x7fb3ac081bc0 msgr2=0x7fb3ac067130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-06-04T16:11:34.433 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:34.432+0000 7fb3b3fff640 0 -- 172.21.15.144:0/114298358 >> [v2:172.21.15.144:6816/2358575268,v1:172.21.15.144:6817/2358575268] conn(0x5562d68384d0 msgr2=0x5562d683a8c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-06-04T16:11:34.438 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:34.437+0000 7fb3bff2c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-06-04T16:11:34.438 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:34.437+0000 7fb3bff2c800 20 RGWRados::pool_iterate: got zone_info.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767 2024-06-04T16:11:34.438 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:34.437+0000 7fb3bff2c800 20 RGWRados::pool_iterate: got default.zone. 2024-06-04T16:11:34.438 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:34.437+0000 7fb3bff2c800 20 RGWRados::pool_iterate: got zonegroup_info.abb22408-c332-4e28-8f7a-ff254ea2fed2 2024-06-04T16:11:34.439 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:34.437+0000 7fb3bff2c800 20 RGWRados::pool_iterate: got zone_names.default 2024-06-04T16:11:34.439 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:34.437+0000 7fb3bff2c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-06-04T16:11:34.439 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:34.437+0000 7fb3bff2c800 20 rados->read ofs=0 len=0 2024-06-04T16:11:34.440 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:34.438+0000 7fb3bff2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:11:34.440 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:34.438+0000 7fb3bff2c800 20 rados->read ofs=0 len=0 2024-06-04T16:11:34.440 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:34.438+0000 7fb3bff2c800 20 rados_obj.operate() r=0 bl.length=46 2024-06-04T16:11:34.440 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:34.438+0000 7fb3bff2c800 20 rados->read ofs=0 len=0 2024-06-04T16:11:34.440 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:34.438+0000 7fb3bff2c800 20 rados_obj.operate() r=0 bl.length=470 2024-06-04T16:11:34.440 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:34.438+0000 7fb3bff2c800 20 zone default found 2024-06-04T16:11:34.440 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:34.438+0000 7fb3bff2c800 4 Realm: () 2024-06-04T16:11:34.441 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:34.438+0000 7fb3bff2c800 4 ZoneGroup: default (abb22408-c332-4e28-8f7a-ff254ea2fed2) 2024-06-04T16:11:34.441 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:34.438+0000 7fb3bff2c800 4 Zone: default (be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767) 2024-06-04T16:11:34.441 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:34.438+0000 7fb3bff2c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-06-04T16:11:34.441 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:34.438+0000 7fb3bff2c800 20 zonegroup default 2024-06-04T16:11:34.441 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:34.438+0000 7fb3bff2c800 20 rados->read ofs=0 len=0 2024-06-04T16:11:34.441 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:34.439+0000 7fb3bff2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:11:34.441 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:34.439+0000 7fb3bff2c800 20 rados->read ofs=0 len=0 2024-06-04T16:11:34.441 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:34.439+0000 7fb3bff2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:11:34.441 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:34.439+0000 7fb3bff2c800 20 rados->read ofs=0 len=0 2024-06-04T16:11:34.441 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:34.439+0000 7fb3bff2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:11:34.441 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:34.439+0000 7fb3bff2c800 20 started sync module instance, tier type = 2024-06-04T16:11:34.441 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:34.439+0000 7fb3bff2c800 20 started zone id=be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767 (name=default) with tier type = 2024-06-04T16:11:34.449 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:34.448+0000 7fb3bff2c800 20 add_watcher() i=0 2024-06-04T16:11:34.449 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:34.448+0000 7fb3bff2c800 20 add_watcher() i=1 2024-06-04T16:11:34.449 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:34.448+0000 7fb3bff2c800 20 add_watcher() i=2 2024-06-04T16:11:34.449 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:34.448+0000 7fb3bff2c800 20 add_watcher() i=3 2024-06-04T16:11:34.449 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:34.448+0000 7fb3bff2c800 20 add_watcher() i=4 2024-06-04T16:11:34.449 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:34.448+0000 7fb3bff2c800 20 add_watcher() i=5 2024-06-04T16:11:34.449 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:34.448+0000 7fb3bff2c800 20 add_watcher() i=6 2024-06-04T16:11:34.449 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:34.449+0000 7fb3bff2c800 20 add_watcher() i=7 2024-06-04T16:11:34.450 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:34.449+0000 7fb3bff2c800 2 all 8 watchers are set, enabling cache 2024-06-04T16:11:34.451 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:34.450+0000 7fb271fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-06-04T16:11:34.451 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:34.451+0000 7fb3bff2c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-06-04T16:11:34.451 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:34.451+0000 7fb3bff2c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-06-04T16:11:34.451 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:34.451+0000 7fb3bff2c800 5 note: GC not initialized 2024-06-04T16:11:34.453 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:34.451+0000 7fb270fe1640 20 reqs_thread_entry: start 2024-06-04T16:11:34.453 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:34.451+0000 7fb3bff2c800 20 init_complete bucket index max shards: 11 2024-06-04T16:11:34.453 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:34.451+0000 7fb3bff2c800 20 Filter name: none 2024-06-04T16:11:34.453 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:34.451+0000 7fb1ea7fc640 20 reqs_thread_entry: start 2024-06-04T16:11:34.453 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:34.451+0000 7fb3bff2c800 20 rados->read ofs=0 len=0 2024-06-04T16:11:34.453 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:34.452+0000 7fb3bff2c800 20 rados_obj.operate() r=0 bl.length=176 2024-06-04T16:11:34.453 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:34.452+0000 7fb3bff2c800 20 rados->read ofs=0 len=0 2024-06-04T16:11:34.453 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:34.452+0000 7fb3bff2c800 20 rados_obj.operate() r=0 bl.length=390 2024-06-04T16:11:34.453 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:34.452+0000 7fb3bff2c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-06-04T16:11:34.453 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:34.452+0000 7fb3bff2c800 20 rados->read ofs=0 len=0 2024-06-04T16:11:34.454 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:34.452+0000 7fb3bff2c800 20 rados_obj.operate() r=0 bl.length=176 2024-06-04T16:11:34.454 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:34.452+0000 7fb3bff2c800 20 rados->read ofs=0 len=0 2024-06-04T16:11:34.454 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:34.453+0000 7fb3bff2c800 20 rados_obj.operate() r=0 bl.length=390 2024-06-04T16:11:34.454 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:34.453+0000 7fb3bff2c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-06-04T16:11:34.455 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:34.454+0000 7fb271fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-06-04T16:11:34.457 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:34.456+0000 7fb3bff2c800 20 remove_watcher() i=0 2024-06-04T16:11:34.457 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:34.456+0000 7fb3bff2c800 2 removed watcher, disabling cache 2024-06-04T16:11:34.458 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:34.457+0000 7fb3bff2c800 20 remove_watcher() i=1 2024-06-04T16:11:34.459 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:34.458+0000 7fb3bff2c800 20 remove_watcher() i=2 2024-06-04T16:11:34.460 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:34.459+0000 7fb3bff2c800 20 remove_watcher() i=3 2024-06-04T16:11:34.460 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:34.460+0000 7fb3bff2c800 20 remove_watcher() i=4 2024-06-04T16:11:34.461 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:34.461+0000 7fb3bff2c800 20 remove_watcher() i=5 2024-06-04T16:11:34.463 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:34.462+0000 7fb3bff2c800 20 remove_watcher() i=6 2024-06-04T16:11:34.464 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:34.463+0000 7fb3bff2c800 20 remove_watcher() i=7 2024-06-04T16:11:34.474 INFO:tasks.workunit.client.0.smithi144.stderr: 2024-06-04T16:11:34.474 INFO:tasks.workunit.client.0.smithi144.stderr:BUCKET_STATS: 2024-06-04T16:11:34.474 INFO:tasks.workunit.client.0.smithi144.stderr:bucket: a-bucket id: be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.17 num_objects: 8 size_kb: 1 num_shards: 12 2024-06-04T16:11:34.475 INFO:tasks.workunit.client.0.smithi144.stderr: 2024-06-04T16:11:34.476 INFO:tasks.workunit.client.0.smithi144.stderr:radosgw-admin reshard add --bucket a-bucket --num-shards 13 2024-06-04T16:11:34.506 INFO:tasks.workunit.client.0.smithi144.stderr:ignoring --setuser ceph since I am not root 2024-06-04T16:11:34.507 INFO:tasks.workunit.client.0.smithi144.stderr:ignoring --setgroup ceph since I am not root 2024-06-04T16:11:34.544 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:34.544+0000 7f039ea31800 20 rados->read ofs=0 len=0 2024-06-04T16:11:34.546 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:34.545+0000 7f039ea31800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:11:34.546 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:34.545+0000 7f039ea31800 20 realm 2024-06-04T16:11:34.546 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:34.545+0000 7f039ea31800 20 rados->read ofs=0 len=0 2024-06-04T16:11:34.546 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:34.545+0000 7f039ea31800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:11:34.546 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:34.545+0000 7f039ea31800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-06-04T16:11:34.546 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:34.545+0000 7f039ea31800 20 rados->read ofs=0 len=0 2024-06-04T16:11:34.546 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:34.545+0000 7f039ea31800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:11:34.547 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:34.545+0000 7f039ea31800 20 rados->read ofs=0 len=0 2024-06-04T16:11:34.547 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:34.546+0000 7f039ea31800 20 rados_obj.operate() r=0 bl.length=46 2024-06-04T16:11:34.547 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:34.546+0000 7f039ea31800 20 rados->read ofs=0 len=0 2024-06-04T16:11:34.548 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:34.547+0000 7f039ea31800 20 rados_obj.operate() r=0 bl.length=1139 2024-06-04T16:11:34.548 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:34.547+0000 7f039ea31800 20 searching for the correct realm 2024-06-04T16:11:34.550 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:34.549+0000 7f039a3b5640 0 -- 172.21.15.144:0/2625170587 >> [v2:172.21.15.144:6800/1453747520,v1:172.21.15.144:6801/1453747520] conn(0x7f03840c6bf0 msgr2=0x7f03840c74b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-06-04T16:11:34.754 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:34.754+0000 7f039a3b5640 0 -- 172.21.15.144:0/2625170587 >> [v2:172.21.15.144:6824/166159729,v1:172.21.15.144:6825/166159729] conn(0x5557e23fd880 msgr2=0x5557e23ffc70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-06-04T16:11:34.759 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:34.758+0000 7f039ea31800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-06-04T16:11:34.759 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:34.758+0000 7f039ea31800 20 RGWRados::pool_iterate: got zone_info.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767 2024-06-04T16:11:34.760 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:34.758+0000 7f039ea31800 20 RGWRados::pool_iterate: got default.zone. 2024-06-04T16:11:34.760 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:34.758+0000 7f039ea31800 20 RGWRados::pool_iterate: got zonegroup_info.abb22408-c332-4e28-8f7a-ff254ea2fed2 2024-06-04T16:11:34.760 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:34.758+0000 7f039ea31800 20 RGWRados::pool_iterate: got zone_names.default 2024-06-04T16:11:34.760 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:34.758+0000 7f039ea31800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-06-04T16:11:34.760 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:34.758+0000 7f039ea31800 20 rados->read ofs=0 len=0 2024-06-04T16:11:34.760 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:34.759+0000 7f039ea31800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:11:34.760 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:34.759+0000 7f039ea31800 20 rados->read ofs=0 len=0 2024-06-04T16:11:34.761 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:34.759+0000 7f039ea31800 20 rados_obj.operate() r=0 bl.length=46 2024-06-04T16:11:34.761 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:34.759+0000 7f039ea31800 20 rados->read ofs=0 len=0 2024-06-04T16:11:34.762 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:34.759+0000 7f039ea31800 20 rados_obj.operate() r=0 bl.length=470 2024-06-04T16:11:34.762 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:34.759+0000 7f039ea31800 20 zone default found 2024-06-04T16:11:34.762 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:34.759+0000 7f039ea31800 4 Realm: () 2024-06-04T16:11:34.762 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:34.759+0000 7f039ea31800 4 ZoneGroup: default (abb22408-c332-4e28-8f7a-ff254ea2fed2) 2024-06-04T16:11:34.762 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:34.759+0000 7f039ea31800 4 Zone: default (be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767) 2024-06-04T16:11:34.762 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:34.759+0000 7f039ea31800 10 cannot find current period zonegroup using local zonegroup configuration 2024-06-04T16:11:34.762 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:34.759+0000 7f039ea31800 20 zonegroup default 2024-06-04T16:11:34.762 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:34.759+0000 7f039ea31800 20 rados->read ofs=0 len=0 2024-06-04T16:11:34.762 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:34.760+0000 7f039ea31800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:11:34.762 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:34.760+0000 7f039ea31800 20 rados->read ofs=0 len=0 2024-06-04T16:11:34.762 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:34.760+0000 7f039ea31800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:11:34.762 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:34.760+0000 7f039ea31800 20 rados->read ofs=0 len=0 2024-06-04T16:11:34.762 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:34.760+0000 7f039ea31800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:11:34.763 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:34.760+0000 7f039ea31800 20 started sync module instance, tier type = 2024-06-04T16:11:34.763 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:34.760+0000 7f039ea31800 20 started zone id=be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767 (name=default) with tier type = 2024-06-04T16:11:34.769 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:34.769+0000 7f039ea31800 20 add_watcher() i=0 2024-06-04T16:11:34.769 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:34.769+0000 7f039ea31800 20 add_watcher() i=1 2024-06-04T16:11:34.769 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:34.769+0000 7f039ea31800 20 add_watcher() i=2 2024-06-04T16:11:34.769 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:34.769+0000 7f039ea31800 20 add_watcher() i=3 2024-06-04T16:11:34.770 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:34.769+0000 7f039ea31800 20 add_watcher() i=4 2024-06-04T16:11:34.770 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:34.769+0000 7f039ea31800 20 add_watcher() i=5 2024-06-04T16:11:34.770 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:34.769+0000 7f039ea31800 20 add_watcher() i=6 2024-06-04T16:11:34.770 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:34.770+0000 7f039ea31800 20 add_watcher() i=7 2024-06-04T16:11:34.770 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:34.770+0000 7f039ea31800 2 all 8 watchers are set, enabling cache 2024-06-04T16:11:34.772 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:34.771+0000 7f024b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-06-04T16:11:34.773 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:34.771+0000 7f039ea31800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-06-04T16:11:34.773 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:34.771+0000 7f039ea31800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-06-04T16:11:34.773 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:34.771+0000 7f039ea31800 5 note: GC not initialized 2024-06-04T16:11:34.773 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:34.772+0000 7f024a7fc640 20 reqs_thread_entry: start 2024-06-04T16:11:34.773 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:34.772+0000 7f039ea31800 20 init_complete bucket index max shards: 11 2024-06-04T16:11:34.773 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:34.772+0000 7f039ea31800 20 Filter name: none 2024-06-04T16:11:34.773 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:34.772+0000 7f01bbfff640 20 reqs_thread_entry: start 2024-06-04T16:11:34.773 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:34.772+0000 7f039ea31800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-06-04T16:11:34.773 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:34.772+0000 7f039ea31800 20 rados->read ofs=0 len=0 2024-06-04T16:11:34.774 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:34.772+0000 7f039ea31800 20 rados_obj.operate() r=0 bl.length=176 2024-06-04T16:11:34.774 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:34.772+0000 7f039ea31800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-06-04T16:11:34.774 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:34.772+0000 7f039ea31800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-06-04T16:11:34.774 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:34.772+0000 7f039ea31800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.17 : miss 2024-06-04T16:11:34.774 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:34.772+0000 7f039ea31800 20 rados->read ofs=0 len=0 2024-06-04T16:11:34.774 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:34.773+0000 7f039ea31800 20 rados_obj.operate() r=0 bl.length=390 2024-06-04T16:11:34.774 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:34.773+0000 7f039ea31800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.17 info.flags=0x17 2024-06-04T16:11:34.775 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:34.773+0000 7f039ea31800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.17 to cache LRU end 2024-06-04T16:11:34.775 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:34.773+0000 7f039ea31800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-06-04T16:11:34.775 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:34.773+0000 7f039ea31800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-06-04T16:11:34.775 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:34.773+0000 7f039ea31800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.17 2024-06-04T16:11:34.776 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:34.775+0000 7f024b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-06-04T16:11:34.778 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:34.777+0000 7f039ea31800 20 remove_watcher() i=0 2024-06-04T16:11:34.778 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:34.777+0000 7f039ea31800 2 removed watcher, disabling cache 2024-06-04T16:11:34.779 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:34.778+0000 7f039ea31800 20 remove_watcher() i=1 2024-06-04T16:11:34.780 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:34.779+0000 7f039ea31800 20 remove_watcher() i=2 2024-06-04T16:11:34.781 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:34.780+0000 7f039ea31800 20 remove_watcher() i=3 2024-06-04T16:11:34.782 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:34.781+0000 7f039ea31800 20 remove_watcher() i=4 2024-06-04T16:11:34.783 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:34.782+0000 7f039ea31800 20 remove_watcher() i=5 2024-06-04T16:11:34.784 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:34.783+0000 7f039ea31800 20 remove_watcher() i=6 2024-06-04T16:11:34.785 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:34.784+0000 7f039ea31800 20 remove_watcher() i=7 2024-06-04T16:11:34.797 INFO:tasks.workunit.client.0.smithi144.stderr:radosgw-admin reshard list 2024-06-04T16:11:34.827 INFO:tasks.workunit.client.0.smithi144.stderr:ignoring --setuser ceph since I am not root 2024-06-04T16:11:34.827 INFO:tasks.workunit.client.0.smithi144.stderr:ignoring --setgroup ceph since I am not root 2024-06-04T16:11:34.860 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:34.859+0000 7fcf8123e800 20 rados->read ofs=0 len=0 2024-06-04T16:11:34.862 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:34.861+0000 7fcf8123e800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:11:34.862 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:34.861+0000 7fcf8123e800 20 realm 2024-06-04T16:11:34.862 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:34.861+0000 7fcf8123e800 20 rados->read ofs=0 len=0 2024-06-04T16:11:34.862 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:34.861+0000 7fcf8123e800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:11:34.862 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:34.861+0000 7fcf8123e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-06-04T16:11:34.862 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:34.861+0000 7fcf8123e800 20 rados->read ofs=0 len=0 2024-06-04T16:11:34.863 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:34.861+0000 7fcf8123e800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:11:34.863 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:34.861+0000 7fcf8123e800 20 rados->read ofs=0 len=0 2024-06-04T16:11:34.863 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:34.862+0000 7fcf8123e800 20 rados_obj.operate() r=0 bl.length=46 2024-06-04T16:11:34.864 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:34.862+0000 7fcf8123e800 20 rados->read ofs=0 len=0 2024-06-04T16:11:34.864 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:34.862+0000 7fcf8123e800 20 rados_obj.operate() r=0 bl.length=1139 2024-06-04T16:11:34.864 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:34.862+0000 7fcf8123e800 20 searching for the correct realm 2024-06-04T16:11:34.865 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:34.864+0000 7fcf7b6ca640 0 -- 172.21.15.144:0/4118705985 >> [v2:172.21.15.144:6816/2358575268,v1:172.21.15.144:6817/2358575268] conn(0x5601b17fc1c0 msgr2=0x5601b17fe5b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-06-04T16:11:34.868 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:34.867+0000 7fcf7b6ca640 0 -- 172.21.15.144:0/4118705985 >> [v2:172.21.15.177:6808/2618477608,v1:172.21.15.177:6809/2618477608] conn(0x7fcf700c0380 msgr2=0x7fcf700af0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-06-04T16:11:35.075 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.073+0000 7fcf8123e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-06-04T16:11:35.075 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.073+0000 7fcf8123e800 20 RGWRados::pool_iterate: got zone_info.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767 2024-06-04T16:11:35.075 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.073+0000 7fcf8123e800 20 RGWRados::pool_iterate: got default.zone. 2024-06-04T16:11:35.075 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.073+0000 7fcf8123e800 20 RGWRados::pool_iterate: got zonegroup_info.abb22408-c332-4e28-8f7a-ff254ea2fed2 2024-06-04T16:11:35.075 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.073+0000 7fcf8123e800 20 RGWRados::pool_iterate: got zone_names.default 2024-06-04T16:11:35.075 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.073+0000 7fcf8123e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-06-04T16:11:35.075 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.074+0000 7fcf8123e800 20 rados->read ofs=0 len=0 2024-06-04T16:11:35.076 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.074+0000 7fcf8123e800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:11:35.076 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.074+0000 7fcf8123e800 20 rados->read ofs=0 len=0 2024-06-04T16:11:35.076 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.074+0000 7fcf8123e800 20 rados_obj.operate() r=0 bl.length=46 2024-06-04T16:11:35.076 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.074+0000 7fcf8123e800 20 rados->read ofs=0 len=0 2024-06-04T16:11:35.077 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.074+0000 7fcf8123e800 20 rados_obj.operate() r=0 bl.length=470 2024-06-04T16:11:35.077 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.074+0000 7fcf8123e800 20 zone default found 2024-06-04T16:11:35.077 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.074+0000 7fcf8123e800 4 Realm: () 2024-06-04T16:11:35.077 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.074+0000 7fcf8123e800 4 ZoneGroup: default (abb22408-c332-4e28-8f7a-ff254ea2fed2) 2024-06-04T16:11:35.077 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.074+0000 7fcf8123e800 4 Zone: default (be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767) 2024-06-04T16:11:35.077 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.074+0000 7fcf8123e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-06-04T16:11:35.078 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.074+0000 7fcf8123e800 20 zonegroup default 2024-06-04T16:11:35.078 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.074+0000 7fcf8123e800 20 rados->read ofs=0 len=0 2024-06-04T16:11:35.078 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.075+0000 7fcf8123e800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:11:35.078 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.075+0000 7fcf8123e800 20 rados->read ofs=0 len=0 2024-06-04T16:11:35.078 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.075+0000 7fcf8123e800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:11:35.078 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.075+0000 7fcf8123e800 20 rados->read ofs=0 len=0 2024-06-04T16:11:35.078 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.075+0000 7fcf8123e800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:11:35.078 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.075+0000 7fcf8123e800 20 started sync module instance, tier type = 2024-06-04T16:11:35.078 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.075+0000 7fcf8123e800 20 started zone id=be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767 (name=default) with tier type = 2024-06-04T16:11:35.085 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.084+0000 7fcf8123e800 20 add_watcher() i=0 2024-06-04T16:11:35.085 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.084+0000 7fcf8123e800 20 add_watcher() i=1 2024-06-04T16:11:35.085 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.084+0000 7fcf8123e800 20 add_watcher() i=2 2024-06-04T16:11:35.085 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.084+0000 7fcf8123e800 20 add_watcher() i=3 2024-06-04T16:11:35.085 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.084+0000 7fcf8123e800 20 add_watcher() i=4 2024-06-04T16:11:35.085 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.084+0000 7fcf8123e800 20 add_watcher() i=5 2024-06-04T16:11:35.085 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.084+0000 7fcf8123e800 20 add_watcher() i=6 2024-06-04T16:11:35.086 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.085+0000 7fcf8123e800 20 add_watcher() i=7 2024-06-04T16:11:35.086 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.085+0000 7fcf8123e800 2 all 8 watchers are set, enabling cache 2024-06-04T16:11:35.087 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.087+0000 7fce31fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-06-04T16:11:35.088 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.087+0000 7fcf8123e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-06-04T16:11:35.088 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.087+0000 7fcf8123e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-06-04T16:11:35.088 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.087+0000 7fcf8123e800 5 note: GC not initialized 2024-06-04T16:11:35.089 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.087+0000 7fce30fe1640 20 reqs_thread_entry: start 2024-06-04T16:11:35.089 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.087+0000 7fcf8123e800 20 init_complete bucket index max shards: 11 2024-06-04T16:11:35.089 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.088+0000 7fcf8123e800 20 Filter name: none 2024-06-04T16:11:35.089 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.088+0000 7fcdaa7fc640 20 reqs_thread_entry: start 2024-06-04T16:11:35.094 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.093+0000 7fce31fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-06-04T16:11:35.097 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.096+0000 7fcf8123e800 20 remove_watcher() i=0 2024-06-04T16:11:35.097 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.096+0000 7fcf8123e800 2 removed watcher, disabling cache 2024-06-04T16:11:35.098 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.097+0000 7fcf8123e800 20 remove_watcher() i=1 2024-06-04T16:11:35.099 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.098+0000 7fcf8123e800 20 remove_watcher() i=2 2024-06-04T16:11:35.100 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.099+0000 7fcf8123e800 20 remove_watcher() i=3 2024-06-04T16:11:35.101 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.100+0000 7fcf8123e800 20 remove_watcher() i=4 2024-06-04T16:11:35.102 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.101+0000 7fcf8123e800 20 remove_watcher() i=5 2024-06-04T16:11:35.103 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.102+0000 7fcf8123e800 20 remove_watcher() i=6 2024-06-04T16:11:35.104 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.103+0000 7fcf8123e800 20 remove_watcher() i=7 2024-06-04T16:11:35.114 INFO:tasks.workunit.client.0.smithi144.stderr:TEST: reshard process non empty bucket 2024-06-04T16:11:35.114 INFO:tasks.workunit.client.0.smithi144.stderr: 2024-06-04T16:11:35.116 INFO:tasks.workunit.client.0.smithi144.stderr:radosgw-admin reshard process 2024-06-04T16:11:35.142 INFO:tasks.workunit.client.0.smithi144.stderr:ignoring --setuser ceph since I am not root 2024-06-04T16:11:35.142 INFO:tasks.workunit.client.0.smithi144.stderr:ignoring --setgroup ceph since I am not root 2024-06-04T16:11:35.180 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.179+0000 7fe10620e800 20 rados->read ofs=0 len=0 2024-06-04T16:11:35.181 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.180+0000 7fe10620e800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:11:35.182 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.180+0000 7fe10620e800 20 realm 2024-06-04T16:11:35.182 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.180+0000 7fe10620e800 20 rados->read ofs=0 len=0 2024-06-04T16:11:35.182 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.181+0000 7fe10620e800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:11:35.182 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.181+0000 7fe10620e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-06-04T16:11:35.182 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.181+0000 7fe10620e800 20 rados->read ofs=0 len=0 2024-06-04T16:11:35.182 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.181+0000 7fe10620e800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:11:35.182 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.181+0000 7fe10620e800 20 rados->read ofs=0 len=0 2024-06-04T16:11:35.183 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.182+0000 7fe10620e800 20 rados_obj.operate() r=0 bl.length=46 2024-06-04T16:11:35.183 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.182+0000 7fe10620e800 20 rados->read ofs=0 len=0 2024-06-04T16:11:35.183 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.182+0000 7fe10620e800 20 rados_obj.operate() r=0 bl.length=1139 2024-06-04T16:11:35.183 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.182+0000 7fe10620e800 20 searching for the correct realm 2024-06-04T16:11:35.185 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.184+0000 7fe104504640 0 -- 172.21.15.144:0/2201994742 >> [v2:172.21.15.144:6800/1453747520,v1:172.21.15.144:6801/1453747520] conn(0x7fe0f409b060 msgr2=0x7fe0f40889c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-06-04T16:11:35.390 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.389+0000 7fe104504640 0 -- 172.21.15.144:0/2201994742 >> [v2:172.21.15.144:6824/166159729,v1:172.21.15.144:6825/166159729] conn(0x55c5434362e0 msgr2=0x55c5434386f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-06-04T16:11:35.395 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.394+0000 7fe10620e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-06-04T16:11:35.395 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.394+0000 7fe10620e800 20 RGWRados::pool_iterate: got zone_info.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767 2024-06-04T16:11:35.395 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.394+0000 7fe10620e800 20 RGWRados::pool_iterate: got default.zone. 2024-06-04T16:11:35.395 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.394+0000 7fe10620e800 20 RGWRados::pool_iterate: got zonegroup_info.abb22408-c332-4e28-8f7a-ff254ea2fed2 2024-06-04T16:11:35.395 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.394+0000 7fe10620e800 20 RGWRados::pool_iterate: got zone_names.default 2024-06-04T16:11:35.395 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.394+0000 7fe10620e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-06-04T16:11:35.395 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.394+0000 7fe10620e800 20 rados->read ofs=0 len=0 2024-06-04T16:11:35.395 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.394+0000 7fe10620e800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:11:35.395 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.394+0000 7fe10620e800 20 rados->read ofs=0 len=0 2024-06-04T16:11:35.396 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.394+0000 7fe10620e800 20 rados_obj.operate() r=0 bl.length=46 2024-06-04T16:11:35.396 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.394+0000 7fe10620e800 20 rados->read ofs=0 len=0 2024-06-04T16:11:35.397 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.395+0000 7fe10620e800 20 rados_obj.operate() r=0 bl.length=470 2024-06-04T16:11:35.397 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.395+0000 7fe10620e800 20 zone default found 2024-06-04T16:11:35.397 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.395+0000 7fe10620e800 4 Realm: () 2024-06-04T16:11:35.397 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.395+0000 7fe10620e800 4 ZoneGroup: default (abb22408-c332-4e28-8f7a-ff254ea2fed2) 2024-06-04T16:11:35.397 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.395+0000 7fe10620e800 4 Zone: default (be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767) 2024-06-04T16:11:35.397 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.395+0000 7fe10620e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-06-04T16:11:35.397 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.395+0000 7fe10620e800 20 zonegroup default 2024-06-04T16:11:35.397 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.395+0000 7fe10620e800 20 rados->read ofs=0 len=0 2024-06-04T16:11:35.397 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.395+0000 7fe10620e800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:11:35.397 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.395+0000 7fe10620e800 20 rados->read ofs=0 len=0 2024-06-04T16:11:35.397 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.396+0000 7fe10620e800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:11:35.397 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.396+0000 7fe10620e800 20 rados->read ofs=0 len=0 2024-06-04T16:11:35.397 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.396+0000 7fe10620e800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:11:35.397 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.396+0000 7fe10620e800 20 started sync module instance, tier type = 2024-06-04T16:11:35.398 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.396+0000 7fe10620e800 20 started zone id=be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767 (name=default) with tier type = 2024-06-04T16:11:35.405 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.404+0000 7fe10620e800 20 add_watcher() i=0 2024-06-04T16:11:35.405 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.404+0000 7fe10620e800 20 add_watcher() i=1 2024-06-04T16:11:35.405 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.404+0000 7fe10620e800 20 add_watcher() i=2 2024-06-04T16:11:35.406 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.404+0000 7fe10620e800 20 add_watcher() i=3 2024-06-04T16:11:35.406 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.404+0000 7fe10620e800 20 add_watcher() i=4 2024-06-04T16:11:35.406 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.404+0000 7fe10620e800 20 add_watcher() i=5 2024-06-04T16:11:35.406 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.404+0000 7fe10620e800 20 add_watcher() i=6 2024-06-04T16:11:35.406 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.405+0000 7fe10620e800 20 add_watcher() i=7 2024-06-04T16:11:35.406 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.405+0000 7fe10620e800 2 all 8 watchers are set, enabling cache 2024-06-04T16:11:35.408 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.407+0000 7fdfb9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-06-04T16:11:35.408 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.407+0000 7fe10620e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-06-04T16:11:35.409 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.407+0000 7fe10620e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-06-04T16:11:35.409 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.407+0000 7fe10620e800 5 note: GC not initialized 2024-06-04T16:11:35.409 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.408+0000 7fdfb8fe1640 20 reqs_thread_entry: start 2024-06-04T16:11:35.409 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.408+0000 7fe10620e800 20 init_complete bucket index max shards: 11 2024-06-04T16:11:35.409 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.408+0000 7fe10620e800 20 Filter name: none 2024-06-04T16:11:35.409 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.408+0000 7fdf327fc640 20 reqs_thread_entry: start 2024-06-04T16:11:35.409 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.408+0000 7fe10620e800 20 processing logshard = reshard.0000000000 2024-06-04T16:11:35.411 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.410+0000 7fe10620e800 20 finish processing logshard = reshard.0000000000 , ret = 0 2024-06-04T16:11:35.411 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.410+0000 7fe10620e800 20 processing logshard = reshard.0000000001 2024-06-04T16:11:35.413 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.412+0000 7fe10620e800 20 finish processing logshard = reshard.0000000001 , ret = 0 2024-06-04T16:11:35.413 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.412+0000 7fe10620e800 20 processing logshard = reshard.0000000002 2024-06-04T16:11:35.415 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.415+0000 7fe10620e800 20 finish processing logshard = reshard.0000000002 , ret = 0 2024-06-04T16:11:35.415 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.415+0000 7fe10620e800 20 processing logshard = reshard.0000000003 2024-06-04T16:11:35.417 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.417+0000 7fe10620e800 20 finish processing logshard = reshard.0000000003 , ret = 0 2024-06-04T16:11:35.417 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.417+0000 7fe10620e800 20 processing logshard = reshard.0000000004 2024-06-04T16:11:35.420 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.420+0000 7fe10620e800 20 finish processing logshard = reshard.0000000004 , ret = 0 2024-06-04T16:11:35.420 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.420+0000 7fe10620e800 20 processing logshard = reshard.0000000005 2024-06-04T16:11:35.423 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.422+0000 7fe10620e800 20 finish processing logshard = reshard.0000000005 , ret = 0 2024-06-04T16:11:35.423 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.422+0000 7fe10620e800 20 processing logshard = reshard.0000000006 2024-06-04T16:11:35.425 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.424+0000 7fe10620e800 20 process_entry resharding a-bucket 2024-06-04T16:11:35.425 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.424+0000 7fe10620e800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-06-04T16:11:35.425 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.424+0000 7fe10620e800 20 rados->read ofs=0 len=0 2024-06-04T16:11:35.425 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.424+0000 7fe10620e800 20 rados_obj.operate() r=0 bl.length=176 2024-06-04T16:11:35.425 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.424+0000 7fe10620e800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x1 2024-06-04T16:11:35.425 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.424+0000 7fe10620e800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-06-04T16:11:35.425 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.424+0000 7fe10620e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.17 : miss 2024-06-04T16:11:35.425 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.424+0000 7fe10620e800 20 rados->read ofs=0 len=0 2024-06-04T16:11:35.426 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.425+0000 7fe10620e800 20 rados_obj.operate() r=0 bl.length=390 2024-06-04T16:11:35.426 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.425+0000 7fe10620e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.17 info.flags=0x17 2024-06-04T16:11:35.426 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.425+0000 7fe10620e800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.17 to cache LRU end 2024-06-04T16:11:35.426 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.425+0000 7fe10620e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-06-04T16:11:35.426 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.425+0000 7fe10620e800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-06-04T16:11:35.426 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.425+0000 7fe10620e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.17 2024-06-04T16:11:35.432 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.432+0000 7fe10620e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.17 info.flags=0x17 2024-06-04T16:11:35.433 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.432+0000 7fe10620e800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.17 to cache LRU end 2024-06-04T16:11:35.433 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.432+0000 7fe10620e800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-06-04T16:11:35.433 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.432+0000 7fe10620e800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.17, ofs0, ns] 2024-06-04T16:11:35.433 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.432+0000 7fdfe27fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1078036791388 cookie 94305725451936 notifier 5783 bl.length()=819 2024-06-04T16:11:35.433 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.432+0000 7fdfe27fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.17 info.flags=0x17 2024-06-04T16:11:35.433 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.432+0000 7fdfe27fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.17 to cache LRU end 2024-06-04T16:11:35.433 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.432+0000 7fdfe27fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-06-04T16:11:35.433 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.432+0000 7fe10620e800 20 handle_bi_update(): bucket=:a-bucket[be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.17]): orig_sources= new_sources= 2024-06-04T16:11:35.434 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.432+0000 7fe10620e800 20 handle_bi_update(): bucket=:a-bucket[be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.17]): potential sources added=[] removed=[] 2024-06-04T16:11:35.434 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.432+0000 7fe10620e800 20 handle_bi_update(): bucket=:a-bucket[be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.17]): orig_dests= new_dests= 2024-06-04T16:11:35.434 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.432+0000 7fe10620e800 20 handle_bi_update(): bucket=:a-bucket[be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.17]): potential dests added=[] removed=[] 2024-06-04T16:11:35.436 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.435+0000 7fe10620e800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.17.2.0 2024-06-04T16:11:35.436 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.435+0000 7fe10620e800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.17.2.0 2024-06-04T16:11:35.436 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.435+0000 7fe10620e800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.17.2.1 2024-06-04T16:11:35.436 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.435+0000 7fe10620e800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.17.2.1 2024-06-04T16:11:35.436 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.435+0000 7fe10620e800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.17.2.2 2024-06-04T16:11:35.436 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.435+0000 7fe10620e800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.17.2.2 2024-06-04T16:11:35.436 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.435+0000 7fe10620e800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.17.2.3 2024-06-04T16:11:35.436 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.435+0000 7fe10620e800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.17.2.3 2024-06-04T16:11:35.436 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.435+0000 7fe10620e800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.17.2.4 2024-06-04T16:11:35.436 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.435+0000 7fe10620e800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.17.2.4 2024-06-04T16:11:35.436 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.435+0000 7fe10620e800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.17.2.5 2024-06-04T16:11:35.437 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.435+0000 7fe10620e800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.17.2.5 2024-06-04T16:11:35.437 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.435+0000 7fe10620e800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.17.2.6 2024-06-04T16:11:35.437 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.435+0000 7fe10620e800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.17.2.6 2024-06-04T16:11:35.437 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.435+0000 7fe10620e800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.17.2.7 2024-06-04T16:11:35.437 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.435+0000 7fe10620e800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.17.2.7 2024-06-04T16:11:35.437 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.435+0000 7fe10620e800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.17.2.8 2024-06-04T16:11:35.437 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.435+0000 7fe10620e800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.17.2.8 2024-06-04T16:11:35.437 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.435+0000 7fe10620e800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.17.2.9 2024-06-04T16:11:35.437 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.435+0000 7fe10620e800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.17.2.9 2024-06-04T16:11:35.437 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.435+0000 7fe10620e800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.17.2.10 2024-06-04T16:11:35.437 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.435+0000 7fe10620e800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.17.2.10 2024-06-04T16:11:35.437 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.435+0000 7fe10620e800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.17.2.11 2024-06-04T16:11:35.437 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.435+0000 7fe10620e800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.17.2.11 2024-06-04T16:11:35.437 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.435+0000 7fe10620e800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.17.2.12 2024-06-04T16:11:35.437 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.435+0000 7fe10620e800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.17.2.12 2024-06-04T16:11:35.438 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.435+0000 7fe10620e800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.17.1.0 2024-06-04T16:11:35.438 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.435+0000 7fe10620e800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.17.1.0 2024-06-04T16:11:35.439 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.435+0000 7fe10620e800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.17.1.1 2024-06-04T16:11:35.439 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.435+0000 7fe10620e800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.17.1.1 2024-06-04T16:11:35.439 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.436+0000 7fe10620e800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.17.1.2 2024-06-04T16:11:35.439 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.436+0000 7fe10620e800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.17.1.2 2024-06-04T16:11:35.439 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.436+0000 7fe10620e800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.17.1.3 2024-06-04T16:11:35.439 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.436+0000 7fe10620e800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.17.1.3 2024-06-04T16:11:35.439 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.437+0000 7fe10620e800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.17.1.4 2024-06-04T16:11:35.439 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.437+0000 7fe10620e800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.17.1.4 2024-06-04T16:11:35.439 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.437+0000 7fe10620e800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.17.1.5 2024-06-04T16:11:35.439 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.437+0000 7fe10620e800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.17.1.5 2024-06-04T16:11:35.439 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.437+0000 7fe10620e800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.17.1.6 2024-06-04T16:11:35.439 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.437+0000 7fe10620e800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.17.1.6 2024-06-04T16:11:35.439 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.438+0000 7fe10620e800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.17.1.7 2024-06-04T16:11:35.440 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.438+0000 7fe10620e800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.17.1.7 2024-06-04T16:11:35.440 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.438+0000 7fe10620e800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.17.1.8 2024-06-04T16:11:35.440 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.438+0000 7fe10620e800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.17.1.8 2024-06-04T16:11:35.440 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.439+0000 7fe10620e800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.17.1.9 2024-06-04T16:11:35.440 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.439+0000 7fe10620e800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.17.1.9 2024-06-04T16:11:35.440 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.439+0000 7fe10620e800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.17.1.10 2024-06-04T16:11:35.440 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.439+0000 7fe10620e800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.17.1.10 2024-06-04T16:11:35.441 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.440+0000 7fe10620e800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.17.1.11 2024-06-04T16:11:35.441 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.440+0000 7fe10620e800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.17.1.11 2024-06-04T16:11:35.443 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.442+0000 7fe10620e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.17 : hit (requested=0x17, cached=0x17) 2024-06-04T16:11:35.443 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.442+0000 7fe10620e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.17 2024-06-04T16:11:35.444 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.444+0000 7fe10620e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.17 info.flags=0x17 2024-06-04T16:11:35.445 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.444+0000 7fe10620e800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.17 to cache LRU end 2024-06-04T16:11:35.445 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.444+0000 7fe10620e800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-06-04T16:11:35.445 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.444+0000 7fe10620e800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.17, ofs0, ns] 2024-06-04T16:11:35.445 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.444+0000 7fdfe2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1078036791389 cookie 94305725451936 notifier 5783 bl.length()=787 2024-06-04T16:11:35.445 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.444+0000 7fdfe2ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.17 info.flags=0x17 2024-06-04T16:11:35.445 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.444+0000 7fdfe2ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.17 to cache LRU end 2024-06-04T16:11:35.445 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.444+0000 7fdfe2ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-06-04T16:11:35.445 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.444+0000 7fe10620e800 20 handle_bi_update(): bucket=:a-bucket[be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.17]): orig_sources= new_sources= 2024-06-04T16:11:35.445 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.444+0000 7fe10620e800 20 handle_bi_update(): bucket=:a-bucket[be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.17]): potential sources added=[] removed=[] 2024-06-04T16:11:35.445 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.444+0000 7fe10620e800 20 handle_bi_update(): bucket=:a-bucket[be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.17]): orig_dests= new_dests= 2024-06-04T16:11:35.446 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.444+0000 7fe10620e800 20 handle_bi_update(): bucket=:a-bucket[be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.17]): potential dests added=[] removed=[] 2024-06-04T16:11:35.447 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.447+0000 7fe10620e800 1 execute INFO: reshard of bucket "a-bucket" completed successfully 2024-06-04T16:11:35.448 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.447+0000 7fe10620e800 20 process_entry removing reshard queue entry for bucket a-bucket 2024-06-04T16:11:35.450 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.450+0000 7fe10620e800 20 finish processing logshard = reshard.0000000006 , ret = 0 2024-06-04T16:11:35.450 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.450+0000 7fe10620e800 20 processing logshard = reshard.0000000007 2024-06-04T16:11:35.452 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.452+0000 7fe10620e800 20 finish processing logshard = reshard.0000000007 , ret = 0 2024-06-04T16:11:35.453 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.452+0000 7fe10620e800 20 processing logshard = reshard.0000000008 2024-06-04T16:11:35.455 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.454+0000 7fe10620e800 20 finish processing logshard = reshard.0000000008 , ret = 0 2024-06-04T16:11:35.455 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.454+0000 7fe10620e800 20 processing logshard = reshard.0000000009 2024-06-04T16:11:35.457 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.456+0000 7fe10620e800 20 finish processing logshard = reshard.0000000009 , ret = 0 2024-06-04T16:11:35.457 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.456+0000 7fe10620e800 20 processing logshard = reshard.0000000010 2024-06-04T16:11:35.459 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.458+0000 7fe10620e800 20 finish processing logshard = reshard.0000000010 , ret = 0 2024-06-04T16:11:35.459 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.458+0000 7fe10620e800 20 processing logshard = reshard.0000000011 2024-06-04T16:11:35.461 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.461+0000 7fe10620e800 20 finish processing logshard = reshard.0000000011 , ret = 0 2024-06-04T16:11:35.462 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.461+0000 7fe10620e800 20 processing logshard = reshard.0000000012 2024-06-04T16:11:35.463 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.463+0000 7fe10620e800 20 finish processing logshard = reshard.0000000012 , ret = 0 2024-06-04T16:11:35.464 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.463+0000 7fe10620e800 20 processing logshard = reshard.0000000013 2024-06-04T16:11:35.466 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.465+0000 7fe10620e800 20 finish processing logshard = reshard.0000000013 , ret = 0 2024-06-04T16:11:35.466 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.465+0000 7fe10620e800 20 processing logshard = reshard.0000000014 2024-06-04T16:11:35.469 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.468+0000 7fe10620e800 20 finish processing logshard = reshard.0000000014 , ret = 0 2024-06-04T16:11:35.469 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.468+0000 7fe10620e800 20 processing logshard = reshard.0000000015 2024-06-04T16:11:35.471 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.470+0000 7fe10620e800 20 finish processing logshard = reshard.0000000015 , ret = 0 2024-06-04T16:11:35.472 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.471+0000 7fdfb9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-06-04T16:11:35.474 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.473+0000 7fe10620e800 20 remove_watcher() i=0 2024-06-04T16:11:35.474 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.473+0000 7fe10620e800 2 removed watcher, disabling cache 2024-06-04T16:11:35.475 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.474+0000 7fe10620e800 20 remove_watcher() i=1 2024-06-04T16:11:35.476 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.475+0000 7fe10620e800 20 remove_watcher() i=2 2024-06-04T16:11:35.477 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.476+0000 7fe10620e800 20 remove_watcher() i=3 2024-06-04T16:11:35.477 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.477+0000 7fe10620e800 20 remove_watcher() i=4 2024-06-04T16:11:35.479 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.478+0000 7fe10620e800 20 remove_watcher() i=5 2024-06-04T16:11:35.480 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.479+0000 7fe10620e800 20 remove_watcher() i=6 2024-06-04T16:11:35.481 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.480+0000 7fe10620e800 20 remove_watcher() i=7 2024-06-04T16:11:35.493 INFO:tasks.workunit.client.0.smithi144.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-06-04T16:11:35.521 INFO:tasks.workunit.client.0.smithi144.stderr:ignoring --setuser ceph since I am not root 2024-06-04T16:11:35.522 INFO:tasks.workunit.client.0.smithi144.stderr:ignoring --setgroup ceph since I am not root 2024-06-04T16:11:35.559 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.558+0000 7fdb0ed75800 20 rados->read ofs=0 len=0 2024-06-04T16:11:35.560 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.559+0000 7fdb0ed75800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:11:35.561 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.559+0000 7fdb0ed75800 20 realm 2024-06-04T16:11:35.561 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.560+0000 7fdb0ed75800 20 rados->read ofs=0 len=0 2024-06-04T16:11:35.561 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.560+0000 7fdb0ed75800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:11:35.561 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.560+0000 7fdb0ed75800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-06-04T16:11:35.561 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.560+0000 7fdb0ed75800 20 rados->read ofs=0 len=0 2024-06-04T16:11:35.561 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.560+0000 7fdb0ed75800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:11:35.561 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.560+0000 7fdb0ed75800 20 rados->read ofs=0 len=0 2024-06-04T16:11:35.561 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.561+0000 7fdb0ed75800 20 rados_obj.operate() r=0 bl.length=46 2024-06-04T16:11:35.561 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.561+0000 7fdb0ed75800 20 rados->read ofs=0 len=0 2024-06-04T16:11:35.562 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.561+0000 7fdb0ed75800 20 rados_obj.operate() r=0 bl.length=1139 2024-06-04T16:11:35.562 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.561+0000 7fdb0ed75800 20 searching for the correct realm 2024-06-04T16:11:35.564 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.563+0000 7fdb0d072640 0 -- 172.21.15.144:0/2956795647 >> [v2:172.21.15.144:6800/1453747520,v1:172.21.15.144:6801/1453747520] conn(0x7fdaf806b250 msgr2=0x7fdaf80687a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-06-04T16:11:35.769 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.768+0000 7fdb0d072640 0 -- 172.21.15.144:0/2956795647 >> [v2:172.21.15.144:6824/166159729,v1:172.21.15.144:6825/166159729] conn(0x55b22b63b310 msgr2=0x55b22b63d700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-06-04T16:11:35.773 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.772+0000 7fdb0ed75800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-06-04T16:11:35.773 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.772+0000 7fdb0ed75800 20 RGWRados::pool_iterate: got zone_info.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767 2024-06-04T16:11:35.774 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.772+0000 7fdb0ed75800 20 RGWRados::pool_iterate: got default.zone. 2024-06-04T16:11:35.774 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.772+0000 7fdb0ed75800 20 RGWRados::pool_iterate: got zonegroup_info.abb22408-c332-4e28-8f7a-ff254ea2fed2 2024-06-04T16:11:35.774 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.772+0000 7fdb0ed75800 20 RGWRados::pool_iterate: got zone_names.default 2024-06-04T16:11:35.774 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.772+0000 7fdb0ed75800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-06-04T16:11:35.774 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.772+0000 7fdb0ed75800 20 rados->read ofs=0 len=0 2024-06-04T16:11:35.774 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.773+0000 7fdb0ed75800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:11:35.774 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.773+0000 7fdb0ed75800 20 rados->read ofs=0 len=0 2024-06-04T16:11:35.775 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.773+0000 7fdb0ed75800 20 rados_obj.operate() r=0 bl.length=46 2024-06-04T16:11:35.775 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.773+0000 7fdb0ed75800 20 rados->read ofs=0 len=0 2024-06-04T16:11:35.775 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.773+0000 7fdb0ed75800 20 rados_obj.operate() r=0 bl.length=470 2024-06-04T16:11:35.775 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.773+0000 7fdb0ed75800 20 zone default found 2024-06-04T16:11:35.775 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.773+0000 7fdb0ed75800 4 Realm: () 2024-06-04T16:11:35.776 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.773+0000 7fdb0ed75800 4 ZoneGroup: default (abb22408-c332-4e28-8f7a-ff254ea2fed2) 2024-06-04T16:11:35.776 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.773+0000 7fdb0ed75800 4 Zone: default (be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767) 2024-06-04T16:11:35.776 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.773+0000 7fdb0ed75800 10 cannot find current period zonegroup using local zonegroup configuration 2024-06-04T16:11:35.776 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.773+0000 7fdb0ed75800 20 zonegroup default 2024-06-04T16:11:35.776 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.773+0000 7fdb0ed75800 20 rados->read ofs=0 len=0 2024-06-04T16:11:35.776 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.774+0000 7fdb0ed75800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:11:35.776 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.774+0000 7fdb0ed75800 20 rados->read ofs=0 len=0 2024-06-04T16:11:35.776 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.774+0000 7fdb0ed75800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:11:35.776 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.774+0000 7fdb0ed75800 20 rados->read ofs=0 len=0 2024-06-04T16:11:35.776 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.774+0000 7fdb0ed75800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:11:35.776 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.774+0000 7fdb0ed75800 20 started sync module instance, tier type = 2024-06-04T16:11:35.776 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.774+0000 7fdb0ed75800 20 started zone id=be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767 (name=default) with tier type = 2024-06-04T16:11:35.784 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.783+0000 7fdb0ed75800 20 add_watcher() i=0 2024-06-04T16:11:35.784 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.783+0000 7fdb0ed75800 20 add_watcher() i=1 2024-06-04T16:11:35.784 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.783+0000 7fdb0ed75800 20 add_watcher() i=2 2024-06-04T16:11:35.784 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.783+0000 7fdb0ed75800 20 add_watcher() i=3 2024-06-04T16:11:35.784 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.783+0000 7fdb0ed75800 20 add_watcher() i=4 2024-06-04T16:11:35.784 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.783+0000 7fdb0ed75800 20 add_watcher() i=5 2024-06-04T16:11:35.784 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.783+0000 7fdb0ed75800 20 add_watcher() i=6 2024-06-04T16:11:35.785 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.784+0000 7fdb0ed75800 20 add_watcher() i=7 2024-06-04T16:11:35.785 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.784+0000 7fdb0ed75800 2 all 8 watchers are set, enabling cache 2024-06-04T16:11:35.787 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.786+0000 7fd9c2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-06-04T16:11:35.787 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.786+0000 7fdb0ed75800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-06-04T16:11:35.787 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.786+0000 7fdb0ed75800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-06-04T16:11:35.788 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.786+0000 7fdb0ed75800 5 note: GC not initialized 2024-06-04T16:11:35.788 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.786+0000 7fd9c1fe3640 20 reqs_thread_entry: start 2024-06-04T16:11:35.788 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.786+0000 7fdb0ed75800 20 init_complete bucket index max shards: 11 2024-06-04T16:11:35.788 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.787+0000 7fdb0ed75800 20 Filter name: none 2024-06-04T16:11:35.788 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.787+0000 7fd9337fe640 20 reqs_thread_entry: start 2024-06-04T16:11:35.788 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.787+0000 7fdb0ed75800 20 rados->read ofs=0 len=0 2024-06-04T16:11:35.789 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.787+0000 7fdb0ed75800 20 rados_obj.operate() r=0 bl.length=176 2024-06-04T16:11:35.789 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.787+0000 7fdb0ed75800 20 rados->read ofs=0 len=0 2024-06-04T16:11:35.789 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.788+0000 7fdb0ed75800 20 rados_obj.operate() r=0 bl.length=390 2024-06-04T16:11:35.789 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.788+0000 7fdb0ed75800 20 couldn't put binfo cache entry, might have raced with data changes 2024-06-04T16:11:35.789 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.788+0000 7fdb0ed75800 20 rados->read ofs=0 len=0 2024-06-04T16:11:35.789 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.788+0000 7fdb0ed75800 20 rados_obj.operate() r=0 bl.length=176 2024-06-04T16:11:35.789 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.788+0000 7fdb0ed75800 20 rados->read ofs=0 len=0 2024-06-04T16:11:35.789 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.788+0000 7fdb0ed75800 20 rados_obj.operate() r=0 bl.length=390 2024-06-04T16:11:35.789 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.788+0000 7fdb0ed75800 20 couldn't put binfo cache entry, might have raced with data changes 2024-06-04T16:11:35.791 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.790+0000 7fd9c2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-06-04T16:11:35.793 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.792+0000 7fdb0ed75800 20 remove_watcher() i=0 2024-06-04T16:11:35.793 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.792+0000 7fdb0ed75800 2 removed watcher, disabling cache 2024-06-04T16:11:35.794 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.793+0000 7fdb0ed75800 20 remove_watcher() i=1 2024-06-04T16:11:35.795 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.794+0000 7fdb0ed75800 20 remove_watcher() i=2 2024-06-04T16:11:35.796 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.795+0000 7fdb0ed75800 20 remove_watcher() i=3 2024-06-04T16:11:35.797 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.796+0000 7fdb0ed75800 20 remove_watcher() i=4 2024-06-04T16:11:35.798 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.797+0000 7fdb0ed75800 20 remove_watcher() i=5 2024-06-04T16:11:35.799 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.798+0000 7fdb0ed75800 20 remove_watcher() i=6 2024-06-04T16:11:35.800 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:35.799+0000 7fdb0ed75800 20 remove_watcher() i=7 2024-06-04T16:11:35.811 INFO:tasks.workunit.client.0.smithi144.stderr: 2024-06-04T16:11:35.811 INFO:tasks.workunit.client.0.smithi144.stderr:BUCKET_STATS: 2024-06-04T16:11:35.811 INFO:tasks.workunit.client.0.smithi144.stderr:bucket: a-bucket id: be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.17 num_objects: 8 size_kb: 1 num_shards: 13 2024-06-04T16:11:35.811 INFO:tasks.workunit.client.0.smithi144.stderr: 2024-06-04T16:11:35.811 INFO:tasks.workunit.client.0.smithi144.stderr:TEST: reshard bucket with EIO injected at set_target_layout 2024-06-04T16:11:35.811 INFO:tasks.workunit.client.0.smithi144.stderr: 2024-06-04T16:11:35.813 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:11:35.813 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:11:35.826 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:11:35.826 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:11:35.869 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:11:35.869 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:11:35.876 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:11:35.876 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:11:35.882 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:11:35.882 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:11:35.888 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:11:35.889 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:11:35.895 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:11:35.895 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:11:35.901 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:11:35.901 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:11:35.908 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:11:35.908 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:11:35.915 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:11:35.915 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:11:35.921 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:11:35.921 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:11:35.927 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:11:35.927 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:11:35.934 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:11:35.934 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:11:35.940 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:11:35.940 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:11:35.947 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:11:35.947 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:11:35.953 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:11:35.953 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:11:35.961 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:11:35.961 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:11:35.967 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:11:35.967 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:11:35.973 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:11:35.973 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:11:35.979 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:11:35.980 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:11:35.986 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:11:35.986 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:11:35.991 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:11:35.992 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:11:35.998 INFO:tasks.workunit.client.0.smithi144.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2024-06-04T16:11:36.026 INFO:tasks.workunit.client.0.smithi144.stderr:ignoring --setuser ceph since I am not root 2024-06-04T16:11:36.026 INFO:tasks.workunit.client.0.smithi144.stderr:ignoring --setgroup ceph since I am not root 2024-06-04T16:11:36.063 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:36.062+0000 7f5e02933800 20 rados->read ofs=0 len=0 2024-06-04T16:11:36.065 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:36.064+0000 7f5e02933800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:11:36.065 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:36.064+0000 7f5e02933800 20 realm 2024-06-04T16:11:36.065 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:36.064+0000 7f5e02933800 20 rados->read ofs=0 len=0 2024-06-04T16:11:36.065 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:36.064+0000 7f5e02933800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:11:36.065 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:36.064+0000 7f5e02933800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-06-04T16:11:36.066 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:36.064+0000 7f5e02933800 20 rados->read ofs=0 len=0 2024-06-04T16:11:36.066 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:36.064+0000 7f5e02933800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:11:36.066 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:36.064+0000 7f5e02933800 20 rados->read ofs=0 len=0 2024-06-04T16:11:36.066 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:36.065+0000 7f5e02933800 20 rados_obj.operate() r=0 bl.length=46 2024-06-04T16:11:36.066 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:36.065+0000 7f5e02933800 20 rados->read ofs=0 len=0 2024-06-04T16:11:36.067 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:36.066+0000 7f5e02933800 20 rados_obj.operate() r=0 bl.length=1139 2024-06-04T16:11:36.067 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:36.066+0000 7f5e02933800 20 searching for the correct realm 2024-06-04T16:11:36.068 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:36.068+0000 7f5dfedc8640 0 -- 172.21.15.144:0/3286191159 >> [v2:172.21.15.144:6800/1453747520,v1:172.21.15.144:6801/1453747520] conn(0x7f5de8040070 msgr2=0x7f5de806d0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-06-04T16:11:36.273 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:36.272+0000 7f5dfedc8640 0 -- 172.21.15.144:0/3286191159 >> [v2:172.21.15.144:6824/166159729,v1:172.21.15.144:6825/166159729] conn(0x565318883a80 msgr2=0x565318885e70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-06-04T16:11:36.278 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:36.278+0000 7f5e02933800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-06-04T16:11:36.279 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:36.278+0000 7f5e02933800 20 RGWRados::pool_iterate: got zone_info.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767 2024-06-04T16:11:36.279 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:36.278+0000 7f5e02933800 20 RGWRados::pool_iterate: got default.zone. 2024-06-04T16:11:36.279 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:36.278+0000 7f5e02933800 20 RGWRados::pool_iterate: got zonegroup_info.abb22408-c332-4e28-8f7a-ff254ea2fed2 2024-06-04T16:11:36.279 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:36.278+0000 7f5e02933800 20 RGWRados::pool_iterate: got zone_names.default 2024-06-04T16:11:36.279 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:36.278+0000 7f5e02933800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-06-04T16:11:36.279 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:36.278+0000 7f5e02933800 20 rados->read ofs=0 len=0 2024-06-04T16:11:36.279 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:36.278+0000 7f5e02933800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:11:36.279 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:36.278+0000 7f5e02933800 20 rados->read ofs=0 len=0 2024-06-04T16:11:36.280 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:36.278+0000 7f5e02933800 20 rados_obj.operate() r=0 bl.length=46 2024-06-04T16:11:36.280 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:36.278+0000 7f5e02933800 20 rados->read ofs=0 len=0 2024-06-04T16:11:36.280 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:36.278+0000 7f5e02933800 20 rados_obj.operate() r=0 bl.length=470 2024-06-04T16:11:36.281 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:36.278+0000 7f5e02933800 20 zone default found 2024-06-04T16:11:36.281 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:36.278+0000 7f5e02933800 4 Realm: () 2024-06-04T16:11:36.281 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:36.278+0000 7f5e02933800 4 ZoneGroup: default (abb22408-c332-4e28-8f7a-ff254ea2fed2) 2024-06-04T16:11:36.281 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:36.278+0000 7f5e02933800 4 Zone: default (be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767) 2024-06-04T16:11:36.281 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:36.278+0000 7f5e02933800 10 cannot find current period zonegroup using local zonegroup configuration 2024-06-04T16:11:36.281 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:36.278+0000 7f5e02933800 20 zonegroup default 2024-06-04T16:11:36.281 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:36.278+0000 7f5e02933800 20 rados->read ofs=0 len=0 2024-06-04T16:11:36.281 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:36.279+0000 7f5e02933800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:11:36.281 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:36.279+0000 7f5e02933800 20 rados->read ofs=0 len=0 2024-06-04T16:11:36.281 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:36.279+0000 7f5e02933800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:11:36.281 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:36.279+0000 7f5e02933800 20 rados->read ofs=0 len=0 2024-06-04T16:11:36.281 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:36.279+0000 7f5e02933800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:11:36.281 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:36.279+0000 7f5e02933800 20 started sync module instance, tier type = 2024-06-04T16:11:36.281 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:36.279+0000 7f5e02933800 20 started zone id=be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767 (name=default) with tier type = 2024-06-04T16:11:36.288 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:36.288+0000 7f5e02933800 20 add_watcher() i=0 2024-06-04T16:11:36.289 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:36.288+0000 7f5e02933800 20 add_watcher() i=1 2024-06-04T16:11:36.289 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:36.288+0000 7f5e02933800 20 add_watcher() i=2 2024-06-04T16:11:36.289 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:36.288+0000 7f5e02933800 20 add_watcher() i=3 2024-06-04T16:11:36.289 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:36.288+0000 7f5e02933800 20 add_watcher() i=4 2024-06-04T16:11:36.289 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:36.288+0000 7f5e02933800 20 add_watcher() i=5 2024-06-04T16:11:36.289 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:36.288+0000 7f5e02933800 20 add_watcher() i=6 2024-06-04T16:11:36.289 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:36.289+0000 7f5e02933800 20 add_watcher() i=7 2024-06-04T16:11:36.289 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:36.289+0000 7f5e02933800 2 all 8 watchers are set, enabling cache 2024-06-04T16:11:36.292 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:36.291+0000 7f5cb4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-06-04T16:11:36.292 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:36.292+0000 7f5e02933800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-06-04T16:11:36.292 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:36.292+0000 7f5e02933800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-06-04T16:11:36.292 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:36.292+0000 7f5e02933800 5 note: GC not initialized 2024-06-04T16:11:36.293 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:36.292+0000 7f5c2f7fe640 20 reqs_thread_entry: start 2024-06-04T16:11:36.293 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:36.292+0000 7f5e02933800 20 init_complete bucket index max shards: 11 2024-06-04T16:11:36.293 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:36.292+0000 7f5e02933800 20 Filter name: none 2024-06-04T16:11:36.294 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:36.292+0000 7f5c2d7fa640 20 reqs_thread_entry: start 2024-06-04T16:11:36.294 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:36.292+0000 7f5e02933800 20 rados->read ofs=0 len=0 2024-06-04T16:11:36.294 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:36.293+0000 7f5e02933800 20 rados_obj.operate() r=0 bl.length=194 2024-06-04T16:11:36.294 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:36.293+0000 7f5e02933800 20 rados->read ofs=0 len=0 2024-06-04T16:11:36.294 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:36.293+0000 7f5e02933800 20 rados_obj.operate() r=0 bl.length=408 2024-06-04T16:11:36.294 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:36.293+0000 7f5e02933800 20 couldn't put binfo cache entry, might have raced with data changes 2024-06-04T16:11:36.294 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:36.293+0000 7f5e02933800 20 rados->read ofs=0 len=0 2024-06-04T16:11:36.295 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:36.294+0000 7f5e02933800 20 rados_obj.operate() r=0 bl.length=194 2024-06-04T16:11:36.295 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:36.294+0000 7f5e02933800 20 rados->read ofs=0 len=0 2024-06-04T16:11:36.295 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:36.294+0000 7f5e02933800 20 rados_obj.operate() r=0 bl.length=408 2024-06-04T16:11:36.295 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:36.294+0000 7f5e02933800 20 couldn't put binfo cache entry, might have raced with data changes 2024-06-04T16:11:36.296 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:36.295+0000 7f5cb4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-06-04T16:11:36.298 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:36.298+0000 7f5e02933800 20 remove_watcher() i=0 2024-06-04T16:11:36.298 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:36.298+0000 7f5e02933800 2 removed watcher, disabling cache 2024-06-04T16:11:36.299 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:36.298+0000 7f5e02933800 20 remove_watcher() i=1 2024-06-04T16:11:36.300 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:36.299+0000 7f5e02933800 20 remove_watcher() i=2 2024-06-04T16:11:36.301 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:36.300+0000 7f5e02933800 20 remove_watcher() i=3 2024-06-04T16:11:36.302 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:36.301+0000 7f5e02933800 20 remove_watcher() i=4 2024-06-04T16:11:36.303 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:36.303+0000 7f5e02933800 20 remove_watcher() i=5 2024-06-04T16:11:36.304 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:36.303+0000 7f5e02933800 20 remove_watcher() i=6 2024-06-04T16:11:36.305 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:36.304+0000 7f5e02933800 20 remove_watcher() i=7 2024-06-04T16:11:36.315 INFO:tasks.workunit.client.0.smithi144.stderr: 2024-06-04T16:11:36.315 INFO:tasks.workunit.client.0.smithi144.stderr:BUCKET_STATS: 2024-06-04T16:11:36.316 INFO:tasks.workunit.client.0.smithi144.stderr:bucket: error-at-set-target-layout id: be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.19 num_objects: 20 size_kb: 1 num_shards: 11 2024-06-04T16:11:36.316 INFO:tasks.workunit.client.0.smithi144.stderr: 2024-06-04T16:11:36.317 INFO:tasks.workunit.client.0.smithi144.stderr:radosgw-admin bucket reshard --bucket error-at-set-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at set_target_layout 2024-06-04T16:11:36.350 INFO:tasks.workunit.client.0.smithi144.stderr:ignoring --setuser ceph since I am not root 2024-06-04T16:11:36.350 INFO:tasks.workunit.client.0.smithi144.stderr:ignoring --setgroup ceph since I am not root 2024-06-04T16:11:36.390 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:36.389+0000 7fbc0a53d800 20 rados->read ofs=0 len=0 2024-06-04T16:11:36.391 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:36.390+0000 7fbc0a53d800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:11:36.391 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:36.390+0000 7fbc0a53d800 20 realm 2024-06-04T16:11:36.391 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:36.390+0000 7fbc0a53d800 20 rados->read ofs=0 len=0 2024-06-04T16:11:36.391 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:36.390+0000 7fbc0a53d800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:11:36.391 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:36.390+0000 7fbc0a53d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-06-04T16:11:36.392 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:36.390+0000 7fbc0a53d800 20 rados->read ofs=0 len=0 2024-06-04T16:11:36.392 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:36.391+0000 7fbc0a53d800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:11:36.392 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:36.391+0000 7fbc0a53d800 20 rados->read ofs=0 len=0 2024-06-04T16:11:36.392 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:36.391+0000 7fbc0a53d800 20 rados_obj.operate() r=0 bl.length=46 2024-06-04T16:11:36.392 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:36.391+0000 7fbc0a53d800 20 rados->read ofs=0 len=0 2024-06-04T16:11:36.393 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:36.392+0000 7fbc0a53d800 20 rados_obj.operate() r=0 bl.length=1139 2024-06-04T16:11:36.393 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:36.392+0000 7fbc0a53d800 20 searching for the correct realm 2024-06-04T16:11:36.395 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:36.394+0000 7fbbfffff640 0 -- 172.21.15.144:0/253043419 >> [v2:172.21.15.144:6816/2358575268,v1:172.21.15.144:6817/2358575268] conn(0x55941273bc00 msgr2=0x55941273e050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-06-04T16:11:36.398 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:36.397+0000 7fbbfffff640 0 -- 172.21.15.144:0/253043419 >> [v2:172.21.15.177:6808/2618477608,v1:172.21.15.177:6809/2618477608] conn(0x7fbbf0058520 msgr2=0x7fbbf00036b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-06-04T16:11:36.605 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:36.603+0000 7fbc0a53d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-06-04T16:11:36.605 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:36.603+0000 7fbc0a53d800 20 RGWRados::pool_iterate: got zone_info.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767 2024-06-04T16:11:36.605 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:36.603+0000 7fbc0a53d800 20 RGWRados::pool_iterate: got default.zone. 2024-06-04T16:11:36.605 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:36.603+0000 7fbc0a53d800 20 RGWRados::pool_iterate: got zonegroup_info.abb22408-c332-4e28-8f7a-ff254ea2fed2 2024-06-04T16:11:36.605 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:36.603+0000 7fbc0a53d800 20 RGWRados::pool_iterate: got zone_names.default 2024-06-04T16:11:36.605 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:36.603+0000 7fbc0a53d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-06-04T16:11:36.605 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:36.603+0000 7fbc0a53d800 20 rados->read ofs=0 len=0 2024-06-04T16:11:36.605 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:36.604+0000 7fbc0a53d800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:11:36.605 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:36.604+0000 7fbc0a53d800 20 rados->read ofs=0 len=0 2024-06-04T16:11:36.606 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:36.604+0000 7fbc0a53d800 20 rados_obj.operate() r=0 bl.length=46 2024-06-04T16:11:36.606 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:36.604+0000 7fbc0a53d800 20 rados->read ofs=0 len=0 2024-06-04T16:11:36.607 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:36.604+0000 7fbc0a53d800 20 rados_obj.operate() r=0 bl.length=470 2024-06-04T16:11:36.607 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:36.604+0000 7fbc0a53d800 20 zone default found 2024-06-04T16:11:36.607 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:36.604+0000 7fbc0a53d800 4 Realm: () 2024-06-04T16:11:36.607 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:36.604+0000 7fbc0a53d800 4 ZoneGroup: default (abb22408-c332-4e28-8f7a-ff254ea2fed2) 2024-06-04T16:11:36.607 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:36.604+0000 7fbc0a53d800 4 Zone: default (be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767) 2024-06-04T16:11:36.608 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:36.604+0000 7fbc0a53d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-06-04T16:11:36.608 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:36.604+0000 7fbc0a53d800 20 zonegroup default 2024-06-04T16:11:36.608 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:36.604+0000 7fbc0a53d800 20 rados->read ofs=0 len=0 2024-06-04T16:11:36.608 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:36.605+0000 7fbc0a53d800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:11:36.608 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:36.605+0000 7fbc0a53d800 20 rados->read ofs=0 len=0 2024-06-04T16:11:36.608 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:36.605+0000 7fbc0a53d800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:11:36.608 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:36.605+0000 7fbc0a53d800 20 rados->read ofs=0 len=0 2024-06-04T16:11:36.608 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:36.605+0000 7fbc0a53d800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:11:36.608 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:36.605+0000 7fbc0a53d800 20 started sync module instance, tier type = 2024-06-04T16:11:36.608 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:36.605+0000 7fbc0a53d800 20 started zone id=be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767 (name=default) with tier type = 2024-06-04T16:11:36.711 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:36.710+0000 7fbc0a53d800 20 add_watcher() i=0 2024-06-04T16:11:36.711 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:36.710+0000 7fbc0a53d800 20 add_watcher() i=1 2024-06-04T16:11:36.711 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:36.710+0000 7fbc0a53d800 20 add_watcher() i=2 2024-06-04T16:11:36.711 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:36.710+0000 7fbc0a53d800 20 add_watcher() i=3 2024-06-04T16:11:36.711 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:36.710+0000 7fbc0a53d800 20 add_watcher() i=4 2024-06-04T16:11:36.711 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:36.710+0000 7fbc0a53d800 20 add_watcher() i=5 2024-06-04T16:11:36.711 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:36.710+0000 7fbc0a53d800 20 add_watcher() i=6 2024-06-04T16:11:36.712 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:36.711+0000 7fbc0a53d800 20 add_watcher() i=7 2024-06-04T16:11:36.712 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:36.711+0000 7fbc0a53d800 2 all 8 watchers are set, enabling cache 2024-06-04T16:11:36.713 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:36.713+0000 7fbabcfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-06-04T16:11:36.715 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:36.713+0000 7fbc0a53d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-06-04T16:11:36.715 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:36.713+0000 7fbc0a53d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-06-04T16:11:36.715 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:36.713+0000 7fbc0a53d800 5 note: GC not initialized 2024-06-04T16:11:36.715 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:36.713+0000 7fba377fe640 20 reqs_thread_entry: start 2024-06-04T16:11:36.715 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:36.713+0000 7fbc0a53d800 20 init_complete bucket index max shards: 11 2024-06-04T16:11:36.715 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:36.713+0000 7fbc0a53d800 20 Filter name: none 2024-06-04T16:11:36.715 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:36.714+0000 7fba357fa640 20 reqs_thread_entry: start 2024-06-04T16:11:36.715 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:36.714+0000 7fbc0a53d800 10 cache get: name=default.rgw.meta+root+error-at-set-target-layout : miss 2024-06-04T16:11:36.715 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:36.714+0000 7fbc0a53d800 20 rados->read ofs=0 len=0 2024-06-04T16:11:36.716 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:36.714+0000 7fbc0a53d800 20 rados_obj.operate() r=0 bl.length=194 2024-06-04T16:11:36.716 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:36.714+0000 7fbc0a53d800 10 cache put: name=default.rgw.meta+root+error-at-set-target-layout info.flags=0x11 2024-06-04T16:11:36.716 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:36.714+0000 7fbc0a53d800 10 adding default.rgw.meta+root+error-at-set-target-layout to cache LRU end 2024-06-04T16:11:36.716 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:36.714+0000 7fbc0a53d800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.19 : miss 2024-06-04T16:11:36.716 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:36.714+0000 7fbc0a53d800 20 rados->read ofs=0 len=0 2024-06-04T16:11:36.716 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:36.715+0000 7fbc0a53d800 20 rados_obj.operate() r=0 bl.length=408 2024-06-04T16:11:36.717 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:36.715+0000 7fbc0a53d800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.19 info.flags=0x17 2024-06-04T16:11:36.717 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:36.715+0000 7fbc0a53d800 10 adding default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.19 to cache LRU end 2024-06-04T16:11:36.717 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:36.715+0000 7fbc0a53d800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-06-04T16:11:36.717 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:36.715+0000 7fbc0a53d800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-06-04T16:11:36.717 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:36.715+0000 7fbc0a53d800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.19 2024-06-04T16:11:36.719 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:36.719+0000 7fbc0a53d800 -1 Injecting error=-5 at location=set_target_layout 2024-06-04T16:11:36.719 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:36.719+0000 7fbc0a53d800 0 ERROR: init_target_layout failed to write target index layout to bucket info: (5) Input/output error 2024-06-04T16:11:36.723 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:36.722+0000 7fbabcfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-06-04T16:11:36.725 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:36.725+0000 7fbc0a53d800 20 remove_watcher() i=0 2024-06-04T16:11:36.725 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:36.725+0000 7fbc0a53d800 2 removed watcher, disabling cache 2024-06-04T16:11:36.726 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:36.726+0000 7fbc0a53d800 20 remove_watcher() i=1 2024-06-04T16:11:36.727 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:36.727+0000 7fbc0a53d800 20 remove_watcher() i=2 2024-06-04T16:11:36.728 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:36.728+0000 7fbc0a53d800 20 remove_watcher() i=3 2024-06-04T16:11:36.729 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:36.729+0000 7fbc0a53d800 20 remove_watcher() i=4 2024-06-04T16:11:36.730 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:36.730+0000 7fbc0a53d800 20 remove_watcher() i=5 2024-06-04T16:11:36.731 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:36.731+0000 7fbc0a53d800 20 remove_watcher() i=6 2024-06-04T16:11:36.733 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:36.732+0000 7fbc0a53d800 20 remove_watcher() i=7 2024-06-04T16:11:36.745 INFO:tasks.workunit.client.0.smithi144.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2024-06-04T16:11:36.773 INFO:tasks.workunit.client.0.smithi144.stderr:ignoring --setuser ceph since I am not root 2024-06-04T16:11:36.773 INFO:tasks.workunit.client.0.smithi144.stderr:ignoring --setgroup ceph since I am not root 2024-06-04T16:11:36.810 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:36.809+0000 7fb23b41f800 20 rados->read ofs=0 len=0 2024-06-04T16:11:36.812 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:36.811+0000 7fb23b41f800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:11:36.812 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:36.811+0000 7fb23b41f800 20 realm 2024-06-04T16:11:36.812 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:36.811+0000 7fb23b41f800 20 rados->read ofs=0 len=0 2024-06-04T16:11:36.812 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:36.811+0000 7fb23b41f800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:11:36.812 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:36.811+0000 7fb23b41f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-06-04T16:11:36.812 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:36.811+0000 7fb23b41f800 20 rados->read ofs=0 len=0 2024-06-04T16:11:36.812 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:36.811+0000 7fb23b41f800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:11:36.812 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:36.811+0000 7fb23b41f800 20 rados->read ofs=0 len=0 2024-06-04T16:11:36.813 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:36.812+0000 7fb23b41f800 20 rados_obj.operate() r=0 bl.length=46 2024-06-04T16:11:36.813 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:36.812+0000 7fb23b41f800 20 rados->read ofs=0 len=0 2024-06-04T16:11:36.813 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:36.812+0000 7fb23b41f800 20 rados_obj.operate() r=0 bl.length=1139 2024-06-04T16:11:36.813 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:36.812+0000 7fb23b41f800 20 searching for the correct realm 2024-06-04T16:11:36.814 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:36.814+0000 7fb23071a640 0 -- 172.21.15.144:0/1228793790 >> [v2:172.21.15.144:6808/86532035,v1:172.21.15.144:6809/86532035] conn(0x7fb228019030 msgr2=0x7fb22805e060 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-06-04T16:11:36.818 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:36.817+0000 7fb23071a640 0 -- 172.21.15.144:0/1228793790 >> [v2:172.21.15.144:6816/2358575268,v1:172.21.15.144:6817/2358575268] conn(0x563ab2f17d80 msgr2=0x563ab2f1a170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-06-04T16:11:36.823 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:36.821+0000 7fb23b41f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-06-04T16:11:36.823 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:36.821+0000 7fb23b41f800 20 RGWRados::pool_iterate: got zone_info.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767 2024-06-04T16:11:36.823 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:36.821+0000 7fb23b41f800 20 RGWRados::pool_iterate: got default.zone. 2024-06-04T16:11:36.823 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:36.821+0000 7fb23b41f800 20 RGWRados::pool_iterate: got zonegroup_info.abb22408-c332-4e28-8f7a-ff254ea2fed2 2024-06-04T16:11:36.823 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:36.821+0000 7fb23b41f800 20 RGWRados::pool_iterate: got zone_names.default 2024-06-04T16:11:36.823 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:36.821+0000 7fb23b41f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-06-04T16:11:36.823 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:36.821+0000 7fb23b41f800 20 rados->read ofs=0 len=0 2024-06-04T16:11:36.823 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:36.822+0000 7fb23b41f800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:11:36.823 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:36.822+0000 7fb23b41f800 20 rados->read ofs=0 len=0 2024-06-04T16:11:36.823 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:36.822+0000 7fb23b41f800 20 rados_obj.operate() r=0 bl.length=46 2024-06-04T16:11:36.823 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:36.822+0000 7fb23b41f800 20 rados->read ofs=0 len=0 2024-06-04T16:11:36.824 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:36.823+0000 7fb23b41f800 20 rados_obj.operate() r=0 bl.length=470 2024-06-04T16:11:36.825 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:36.823+0000 7fb23b41f800 20 zone default found 2024-06-04T16:11:36.825 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:36.823+0000 7fb23b41f800 4 Realm: () 2024-06-04T16:11:36.825 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:36.823+0000 7fb23b41f800 4 ZoneGroup: default (abb22408-c332-4e28-8f7a-ff254ea2fed2) 2024-06-04T16:11:36.825 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:36.823+0000 7fb23b41f800 4 Zone: default (be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767) 2024-06-04T16:11:36.825 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:36.823+0000 7fb23b41f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-06-04T16:11:36.825 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:36.823+0000 7fb23b41f800 20 zonegroup default 2024-06-04T16:11:36.825 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:36.823+0000 7fb23b41f800 20 rados->read ofs=0 len=0 2024-06-04T16:11:36.825 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:36.823+0000 7fb23b41f800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:11:36.825 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:36.823+0000 7fb23b41f800 20 rados->read ofs=0 len=0 2024-06-04T16:11:36.825 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:36.823+0000 7fb23b41f800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:11:36.825 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:36.823+0000 7fb23b41f800 20 rados->read ofs=0 len=0 2024-06-04T16:11:36.825 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:36.824+0000 7fb23b41f800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:11:36.825 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:36.824+0000 7fb23b41f800 20 started sync module instance, tier type = 2024-06-04T16:11:36.826 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:36.824+0000 7fb23b41f800 20 started zone id=be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767 (name=default) with tier type = 2024-06-04T16:11:36.833 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:36.832+0000 7fb23b41f800 20 add_watcher() i=0 2024-06-04T16:11:36.833 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:36.832+0000 7fb23b41f800 20 add_watcher() i=1 2024-06-04T16:11:36.833 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:36.832+0000 7fb23b41f800 20 add_watcher() i=2 2024-06-04T16:11:36.833 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:36.832+0000 7fb23b41f800 20 add_watcher() i=3 2024-06-04T16:11:36.833 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:36.832+0000 7fb23b41f800 20 add_watcher() i=4 2024-06-04T16:11:36.833 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:36.832+0000 7fb23b41f800 20 add_watcher() i=5 2024-06-04T16:11:36.833 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:36.832+0000 7fb23b41f800 20 add_watcher() i=6 2024-06-04T16:11:36.834 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:36.833+0000 7fb23b41f800 20 add_watcher() i=7 2024-06-04T16:11:36.834 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:36.833+0000 7fb23b41f800 2 all 8 watchers are set, enabling cache 2024-06-04T16:11:36.835 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:36.835+0000 7fb0eefe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-06-04T16:11:36.836 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:36.835+0000 7fb23b41f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-06-04T16:11:36.836 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:36.835+0000 7fb23b41f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-06-04T16:11:36.836 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:36.835+0000 7fb23b41f800 5 note: GC not initialized 2024-06-04T16:11:36.836 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:36.835+0000 7fb0edfe3640 20 reqs_thread_entry: start 2024-06-04T16:11:36.837 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:36.835+0000 7fb23b41f800 20 init_complete bucket index max shards: 11 2024-06-04T16:11:36.837 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:36.835+0000 7fb23b41f800 20 Filter name: none 2024-06-04T16:11:36.837 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:36.836+0000 7fb05f7fe640 20 reqs_thread_entry: start 2024-06-04T16:11:36.837 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:36.836+0000 7fb23b41f800 20 rados->read ofs=0 len=0 2024-06-04T16:11:36.838 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:36.836+0000 7fb23b41f800 20 rados_obj.operate() r=0 bl.length=194 2024-06-04T16:11:36.838 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:36.836+0000 7fb23b41f800 20 rados->read ofs=0 len=0 2024-06-04T16:11:36.838 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:36.836+0000 7fb23b41f800 20 rados_obj.operate() r=0 bl.length=408 2024-06-04T16:11:36.838 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:36.836+0000 7fb23b41f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-06-04T16:11:36.838 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:36.836+0000 7fb23b41f800 20 rados->read ofs=0 len=0 2024-06-04T16:11:36.838 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:36.837+0000 7fb23b41f800 20 rados_obj.operate() r=0 bl.length=194 2024-06-04T16:11:36.838 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:36.837+0000 7fb23b41f800 20 rados->read ofs=0 len=0 2024-06-04T16:11:36.838 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:36.837+0000 7fb23b41f800 20 rados_obj.operate() r=0 bl.length=408 2024-06-04T16:11:36.838 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:36.837+0000 7fb23b41f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-06-04T16:11:36.839 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:36.839+0000 7fb0eefe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-06-04T16:11:36.841 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:36.841+0000 7fb23b41f800 20 remove_watcher() i=0 2024-06-04T16:11:36.841 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:36.841+0000 7fb23b41f800 2 removed watcher, disabling cache 2024-06-04T16:11:36.842 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:36.841+0000 7fb23b41f800 20 remove_watcher() i=1 2024-06-04T16:11:36.843 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:36.842+0000 7fb23b41f800 20 remove_watcher() i=2 2024-06-04T16:11:36.844 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:36.843+0000 7fb23b41f800 20 remove_watcher() i=3 2024-06-04T16:11:36.845 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:36.844+0000 7fb23b41f800 20 remove_watcher() i=4 2024-06-04T16:11:36.846 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:36.845+0000 7fb23b41f800 20 remove_watcher() i=5 2024-06-04T16:11:36.847 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:36.846+0000 7fb23b41f800 20 remove_watcher() i=6 2024-06-04T16:11:36.848 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:36.847+0000 7fb23b41f800 20 remove_watcher() i=7 2024-06-04T16:11:36.858 INFO:tasks.workunit.client.0.smithi144.stderr: 2024-06-04T16:11:36.859 INFO:tasks.workunit.client.0.smithi144.stderr:BUCKET_STATS: 2024-06-04T16:11:36.859 INFO:tasks.workunit.client.0.smithi144.stderr:bucket: error-at-set-target-layout id: be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.19 num_objects: 20 size_kb: 1 num_shards: 11 2024-06-04T16:11:36.859 INFO:tasks.workunit.client.0.smithi144.stderr: 2024-06-04T16:11:36.861 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:11:36.861 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:11:36.867 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:11:36.915 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:11:36.916 INFO:tasks.workunit.client.0.smithi144.stderr:radosgw-admin bucket reshard --bucket error-at-set-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-06-04T16:11:36.942 INFO:tasks.workunit.client.0.smithi144.stderr:ignoring --setuser ceph since I am not root 2024-06-04T16:11:36.943 INFO:tasks.workunit.client.0.smithi144.stderr:ignoring --setgroup ceph since I am not root 2024-06-04T16:11:37.172 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:37.172+0000 7f6fdc115640 0 --2- 172.21.15.144:0/2062433975 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x55cd7e8ce430 0x55cd7e8cd520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2024-06-04T16:11:37.180 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:37.180+0000 7f6fdde1f800 20 rados->read ofs=0 len=0 2024-06-04T16:11:37.182 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:37.181+0000 7f6fdde1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:11:37.182 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:37.181+0000 7f6fdde1f800 20 realm 2024-06-04T16:11:37.182 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:37.181+0000 7f6fdde1f800 20 rados->read ofs=0 len=0 2024-06-04T16:11:37.182 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:37.181+0000 7f6fdde1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:11:37.182 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:37.181+0000 7f6fdde1f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-06-04T16:11:37.183 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:37.181+0000 7f6fdde1f800 20 rados->read ofs=0 len=0 2024-06-04T16:11:37.183 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:37.181+0000 7f6fdde1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:11:37.183 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:37.181+0000 7f6fdde1f800 20 rados->read ofs=0 len=0 2024-06-04T16:11:37.183 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:37.182+0000 7f6fdde1f800 20 rados_obj.operate() r=0 bl.length=46 2024-06-04T16:11:37.183 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:37.182+0000 7f6fdde1f800 20 rados->read ofs=0 len=0 2024-06-04T16:11:37.183 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:37.183+0000 7f6fdde1f800 20 rados_obj.operate() r=0 bl.length=1139 2024-06-04T16:11:37.184 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:37.183+0000 7f6fdde1f800 20 searching for the correct realm 2024-06-04T16:11:37.184 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:37.184+0000 7f6fdb914640 0 -- 172.21.15.144:0/2134320798 >> [v2:172.21.15.177:6816/2039473917,v1:172.21.15.177:6817/2039473917] conn(0x55cd7e95e960 msgr2=0x55cd7e960e20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-06-04T16:11:37.187 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:37.187+0000 7f6fdb914640 0 -- 172.21.15.144:0/2134320798 >> [v2:172.21.15.177:6800/3891611393,v1:172.21.15.177:6801/3891611393] conn(0x7f6fcc02c440 msgr2=0x7f6fcc02c8a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-06-04T16:11:37.197 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:37.193+0000 7f6fdde1f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-06-04T16:11:37.197 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:37.193+0000 7f6fdde1f800 20 RGWRados::pool_iterate: got zone_info.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767 2024-06-04T16:11:37.197 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:37.193+0000 7f6fdde1f800 20 RGWRados::pool_iterate: got default.zone. 2024-06-04T16:11:37.197 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:37.193+0000 7f6fdde1f800 20 RGWRados::pool_iterate: got zonegroup_info.abb22408-c332-4e28-8f7a-ff254ea2fed2 2024-06-04T16:11:37.197 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:37.193+0000 7f6fdde1f800 20 RGWRados::pool_iterate: got zone_names.default 2024-06-04T16:11:37.197 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:37.193+0000 7f6fdde1f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-06-04T16:11:37.198 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:37.193+0000 7f6fdde1f800 20 rados->read ofs=0 len=0 2024-06-04T16:11:37.198 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:37.193+0000 7f6fdde1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:11:37.198 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:37.193+0000 7f6fdde1f800 20 rados->read ofs=0 len=0 2024-06-04T16:11:37.198 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:37.194+0000 7f6fdde1f800 20 rados_obj.operate() r=0 bl.length=46 2024-06-04T16:11:37.198 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:37.194+0000 7f6fdde1f800 20 rados->read ofs=0 len=0 2024-06-04T16:11:37.198 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:37.194+0000 7f6fdde1f800 20 rados_obj.operate() r=0 bl.length=470 2024-06-04T16:11:37.199 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:37.194+0000 7f6fdde1f800 20 zone default found 2024-06-04T16:11:37.199 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:37.194+0000 7f6fdde1f800 4 Realm: () 2024-06-04T16:11:37.199 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:37.194+0000 7f6fdde1f800 4 ZoneGroup: default (abb22408-c332-4e28-8f7a-ff254ea2fed2) 2024-06-04T16:11:37.199 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:37.194+0000 7f6fdde1f800 4 Zone: default (be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767) 2024-06-04T16:11:37.199 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:37.194+0000 7f6fdde1f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-06-04T16:11:37.199 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:37.194+0000 7f6fdde1f800 20 zonegroup default 2024-06-04T16:11:37.200 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:37.194+0000 7f6fdde1f800 20 rados->read ofs=0 len=0 2024-06-04T16:11:37.200 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:37.194+0000 7f6fdde1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:11:37.200 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:37.194+0000 7f6fdde1f800 20 rados->read ofs=0 len=0 2024-06-04T16:11:37.200 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:37.194+0000 7f6fdde1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:11:37.200 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:37.194+0000 7f6fdde1f800 20 rados->read ofs=0 len=0 2024-06-04T16:11:37.200 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:37.195+0000 7f6fdde1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:11:37.201 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:37.195+0000 7f6fdde1f800 20 started sync module instance, tier type = 2024-06-04T16:11:37.201 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:37.195+0000 7f6fdde1f800 20 started zone id=be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767 (name=default) with tier type = 2024-06-04T16:11:37.204 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:37.203+0000 7f6fdde1f800 20 add_watcher() i=0 2024-06-04T16:11:37.204 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:37.203+0000 7f6fdde1f800 20 add_watcher() i=1 2024-06-04T16:11:37.205 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:37.203+0000 7f6fdde1f800 20 add_watcher() i=2 2024-06-04T16:11:37.205 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:37.203+0000 7f6fdde1f800 20 add_watcher() i=3 2024-06-04T16:11:37.205 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:37.203+0000 7f6fdde1f800 20 add_watcher() i=4 2024-06-04T16:11:37.205 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:37.203+0000 7f6fdde1f800 20 add_watcher() i=5 2024-06-04T16:11:37.205 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:37.203+0000 7f6fdde1f800 20 add_watcher() i=6 2024-06-04T16:11:37.206 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:37.204+0000 7f6fdde1f800 20 add_watcher() i=7 2024-06-04T16:11:37.206 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:37.204+0000 7f6fdde1f800 2 all 8 watchers are set, enabling cache 2024-06-04T16:11:37.208 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:37.206+0000 7f6e91fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-06-04T16:11:37.208 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:37.207+0000 7f6fdde1f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-06-04T16:11:37.209 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:37.207+0000 7f6fdde1f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-06-04T16:11:37.209 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:37.207+0000 7f6fdde1f800 5 note: GC not initialized 2024-06-04T16:11:37.209 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:37.207+0000 7f6e90fe1640 20 reqs_thread_entry: start 2024-06-04T16:11:37.209 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:37.207+0000 7f6fdde1f800 20 init_complete bucket index max shards: 11 2024-06-04T16:11:37.209 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:37.207+0000 7f6fdde1f800 20 Filter name: none 2024-06-04T16:11:37.209 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:37.207+0000 7f6e0a7fc640 20 reqs_thread_entry: start 2024-06-04T16:11:37.209 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:37.207+0000 7f6fdde1f800 10 cache get: name=default.rgw.meta+root+error-at-set-target-layout : miss 2024-06-04T16:11:37.209 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:37.207+0000 7f6fdde1f800 20 rados->read ofs=0 len=0 2024-06-04T16:11:37.211 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:37.208+0000 7f6fdde1f800 20 rados_obj.operate() r=0 bl.length=194 2024-06-04T16:11:37.211 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:37.208+0000 7f6fdde1f800 10 cache put: name=default.rgw.meta+root+error-at-set-target-layout info.flags=0x11 2024-06-04T16:11:37.211 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:37.208+0000 7f6fdde1f800 10 adding default.rgw.meta+root+error-at-set-target-layout to cache LRU end 2024-06-04T16:11:37.211 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:37.208+0000 7f6fdde1f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.19 : miss 2024-06-04T16:11:37.211 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:37.208+0000 7f6fdde1f800 20 rados->read ofs=0 len=0 2024-06-04T16:11:37.211 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:37.208+0000 7f6fdde1f800 20 rados_obj.operate() r=0 bl.length=408 2024-06-04T16:11:37.211 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:37.208+0000 7f6fdde1f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.19 info.flags=0x17 2024-06-04T16:11:37.212 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:37.208+0000 7f6fdde1f800 10 adding default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.19 to cache LRU end 2024-06-04T16:11:37.212 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:37.208+0000 7f6fdde1f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-06-04T16:11:37.212 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:37.208+0000 7f6fdde1f800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-06-04T16:11:37.212 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:37.208+0000 7f6fdde1f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.19 2024-06-04T16:11:37.214 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:37.213+0000 7f6fdde1f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.19 info.flags=0x17 2024-06-04T16:11:37.214 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:37.213+0000 7f6fdde1f800 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.19 to cache LRU end 2024-06-04T16:11:37.214 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:37.213+0000 7f6fdde1f800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-06-04T16:11:37.214 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:37.213+0000 7f6fdde1f800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.19, ofs0, ns] 2024-06-04T16:11:37.215 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:37.213+0000 7f6ebaffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1078036791391 cookie 94341080433520 notifier 6177 bl.length()=917 2024-06-04T16:11:37.215 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:37.213+0000 7f6ebaffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.19 info.flags=0x17 2024-06-04T16:11:37.215 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:37.213+0000 7f6ebaffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.19 to cache LRU end 2024-06-04T16:11:37.215 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:37.213+0000 7f6ebaffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-06-04T16:11:37.215 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:37.214+0000 7f6fdde1f800 20 handle_bi_update(): bucket=:error-at-set-target-layout[be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.19]): orig_sources= new_sources= 2024-06-04T16:11:37.215 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:37.214+0000 7f6fdde1f800 20 handle_bi_update(): bucket=:error-at-set-target-layout[be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.19]): potential sources added=[] removed=[] 2024-06-04T16:11:37.215 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:37.214+0000 7f6fdde1f800 20 handle_bi_update(): bucket=:error-at-set-target-layout[be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.19]): orig_dests= new_dests= 2024-06-04T16:11:37.215 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:37.214+0000 7f6fdde1f800 20 handle_bi_update(): bucket=:error-at-set-target-layout[be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.19]): potential dests added=[] removed=[] 2024-06-04T16:11:37.218 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:37.216+0000 7f6fdde1f800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.19.1.0 2024-06-04T16:11:37.218 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:37.216+0000 7f6fdde1f800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.19.1.0 2024-06-04T16:11:37.218 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:37.216+0000 7f6fdde1f800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.19.1.1 2024-06-04T16:11:37.218 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:37.216+0000 7f6fdde1f800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.19.1.1 2024-06-04T16:11:37.218 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:37.216+0000 7f6fdde1f800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.19.1.2 2024-06-04T16:11:37.219 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:37.216+0000 7f6fdde1f800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.19.1.2 2024-06-04T16:11:37.219 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:37.216+0000 7f6fdde1f800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.19.1.3 2024-06-04T16:11:37.219 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:37.216+0000 7f6fdde1f800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.19.1.3 2024-06-04T16:11:37.219 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:37.216+0000 7f6fdde1f800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.19.1.4 2024-06-04T16:11:37.219 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:37.216+0000 7f6fdde1f800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.19.1.4 2024-06-04T16:11:37.219 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:37.216+0000 7f6fdde1f800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.19.1.5 2024-06-04T16:11:37.219 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:37.216+0000 7f6fdde1f800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.19.1.5 2024-06-04T16:11:37.219 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:37.216+0000 7f6fdde1f800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.19.1.6 2024-06-04T16:11:37.219 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:37.216+0000 7f6fdde1f800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.19.1.6 2024-06-04T16:11:37.220 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:37.216+0000 7f6fdde1f800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.19.1.7 2024-06-04T16:11:37.220 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:37.216+0000 7f6fdde1f800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.19.1.7 2024-06-04T16:11:37.220 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:37.216+0000 7f6fdde1f800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.19.1.8 2024-06-04T16:11:37.220 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:37.216+0000 7f6fdde1f800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.19.1.8 2024-06-04T16:11:37.220 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:37.216+0000 7f6fdde1f800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.19.1.9 2024-06-04T16:11:37.220 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:37.216+0000 7f6fdde1f800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.19.1.9 2024-06-04T16:11:37.220 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:37.216+0000 7f6fdde1f800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.19.1.10 2024-06-04T16:11:37.220 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:37.216+0000 7f6fdde1f800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.19.1.10 2024-06-04T16:11:37.220 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:37.216+0000 7f6fdde1f800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.19.1.11 2024-06-04T16:11:37.220 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:37.216+0000 7f6fdde1f800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.19.1.11 2024-06-04T16:11:37.220 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:37.216+0000 7f6fdde1f800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.19.0 2024-06-04T16:11:37.220 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:37.216+0000 7f6fdde1f800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.19.1 2024-06-04T16:11:37.220 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:37.217+0000 7f6fdde1f800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.19.2 2024-06-04T16:11:37.221 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:37.217+0000 7f6fdde1f800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.19.3 2024-06-04T16:11:37.221 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:37.218+0000 7f6fdde1f800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.19.4 2024-06-04T16:11:37.222 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:37.218+0000 7f6fdde1f800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.19.5 2024-06-04T16:11:37.222 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:37.219+0000 7f6fdde1f800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.19.6 2024-06-04T16:11:37.222 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:37.219+0000 7f6fdde1f800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.19.7 2024-06-04T16:11:37.222 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:37.220+0000 7f6fdde1f800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.19.8 2024-06-04T16:11:37.222 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:37.220+0000 7f6fdde1f800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.19.9 2024-06-04T16:11:37.222 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:37.221+0000 7f6fdde1f800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.19.10 2024-06-04T16:11:37.224 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:37.223+0000 7f6fdde1f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.19 : hit (requested=0x17, cached=0x17) 2024-06-04T16:11:37.224 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:37.223+0000 7f6fdde1f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.19 2024-06-04T16:11:37.226 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:37.225+0000 7f6fdde1f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.19 info.flags=0x17 2024-06-04T16:11:37.226 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:37.225+0000 7f6fdde1f800 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.19 to cache LRU end 2024-06-04T16:11:37.226 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:37.225+0000 7f6fdde1f800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-06-04T16:11:37.226 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:37.225+0000 7f6fdde1f800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.19, ofs0, ns] 2024-06-04T16:11:37.226 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:37.225+0000 7f6eba7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1078036791392 cookie 94341080433520 notifier 6177 bl.length()=885 2024-06-04T16:11:37.226 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:37.225+0000 7f6eba7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.19 info.flags=0x17 2024-06-04T16:11:37.226 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:37.225+0000 7f6eba7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.19 to cache LRU end 2024-06-04T16:11:37.226 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:37.225+0000 7f6eba7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-06-04T16:11:37.227 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:37.225+0000 7f6fdde1f800 20 handle_bi_update(): bucket=:error-at-set-target-layout[be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.19]): orig_sources= new_sources= 2024-06-04T16:11:37.227 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:37.225+0000 7f6fdde1f800 20 handle_bi_update(): bucket=:error-at-set-target-layout[be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.19]): potential sources added=[] removed=[] 2024-06-04T16:11:37.227 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:37.225+0000 7f6fdde1f800 20 handle_bi_update(): bucket=:error-at-set-target-layout[be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.19]): orig_dests= new_dests= 2024-06-04T16:11:37.227 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:37.225+0000 7f6fdde1f800 20 handle_bi_update(): bucket=:error-at-set-target-layout[be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.19]): potential dests added=[] removed=[] 2024-06-04T16:11:37.228 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:37.228+0000 7f6fdde1f800 1 execute INFO: reshard of bucket "error-at-set-target-layout" completed successfully 2024-06-04T16:11:37.230 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:37.229+0000 7f6e91fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-06-04T16:11:37.232 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:37.231+0000 7f6fdde1f800 20 remove_watcher() i=0 2024-06-04T16:11:37.232 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:37.231+0000 7f6fdde1f800 2 removed watcher, disabling cache 2024-06-04T16:11:37.233 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:37.233+0000 7f6fdde1f800 20 remove_watcher() i=1 2024-06-04T16:11:37.234 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:37.234+0000 7f6fdde1f800 20 remove_watcher() i=2 2024-06-04T16:11:37.235 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:37.235+0000 7f6fdde1f800 20 remove_watcher() i=3 2024-06-04T16:11:37.236 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:37.235+0000 7f6fdde1f800 20 remove_watcher() i=4 2024-06-04T16:11:37.237 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:37.236+0000 7f6fdde1f800 20 remove_watcher() i=5 2024-06-04T16:11:37.238 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:37.237+0000 7f6fdde1f800 20 remove_watcher() i=6 2024-06-04T16:11:37.239 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:37.238+0000 7f6fdde1f800 20 remove_watcher() i=7 2024-06-04T16:11:37.251 INFO:tasks.workunit.client.0.smithi144.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2024-06-04T16:11:37.280 INFO:tasks.workunit.client.0.smithi144.stderr:ignoring --setuser ceph since I am not root 2024-06-04T16:11:37.280 INFO:tasks.workunit.client.0.smithi144.stderr:ignoring --setgroup ceph since I am not root 2024-06-04T16:11:37.316 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:37.316+0000 7ff872298800 20 rados->read ofs=0 len=0 2024-06-04T16:11:37.318 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:37.317+0000 7ff872298800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:11:37.319 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:37.317+0000 7ff872298800 20 realm 2024-06-04T16:11:37.319 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:37.317+0000 7ff872298800 20 rados->read ofs=0 len=0 2024-06-04T16:11:37.319 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:37.318+0000 7ff872298800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:11:37.319 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:37.318+0000 7ff872298800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-06-04T16:11:37.319 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:37.318+0000 7ff872298800 20 rados->read ofs=0 len=0 2024-06-04T16:11:37.319 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:37.318+0000 7ff872298800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:11:37.319 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:37.318+0000 7ff872298800 20 rados->read ofs=0 len=0 2024-06-04T16:11:37.319 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:37.318+0000 7ff872298800 20 rados_obj.operate() r=0 bl.length=46 2024-06-04T16:11:37.319 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:37.318+0000 7ff872298800 20 rados->read ofs=0 len=0 2024-06-04T16:11:37.320 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:37.319+0000 7ff872298800 20 rados_obj.operate() r=0 bl.length=1139 2024-06-04T16:11:37.320 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:37.319+0000 7ff872298800 20 searching for the correct realm 2024-06-04T16:11:37.321 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:37.321+0000 7ff867fff640 0 -- 172.21.15.144:0/1419449722 >> [v2:172.21.15.144:6816/2358575268,v1:172.21.15.144:6817/2358575268] conn(0x562de67f8850 msgr2=0x562de67fad10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-06-04T16:11:37.325 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:37.324+0000 7ff867fff640 0 -- 172.21.15.144:0/1419449722 >> [v2:172.21.15.177:6808/2618477608,v1:172.21.15.177:6809/2618477608] conn(0x7ff85809b910 msgr2=0x7ff85808d400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-06-04T16:11:37.532 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:37.531+0000 7ff872298800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-06-04T16:11:37.532 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:37.531+0000 7ff872298800 20 RGWRados::pool_iterate: got zone_info.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767 2024-06-04T16:11:37.533 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:37.531+0000 7ff872298800 20 RGWRados::pool_iterate: got default.zone. 2024-06-04T16:11:37.533 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:37.531+0000 7ff872298800 20 RGWRados::pool_iterate: got zonegroup_info.abb22408-c332-4e28-8f7a-ff254ea2fed2 2024-06-04T16:11:37.533 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:37.531+0000 7ff872298800 20 RGWRados::pool_iterate: got zone_names.default 2024-06-04T16:11:37.533 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:37.531+0000 7ff872298800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-06-04T16:11:37.533 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:37.531+0000 7ff872298800 20 rados->read ofs=0 len=0 2024-06-04T16:11:37.533 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:37.531+0000 7ff872298800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:11:37.533 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:37.531+0000 7ff872298800 20 rados->read ofs=0 len=0 2024-06-04T16:11:37.533 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:37.531+0000 7ff872298800 20 rados_obj.operate() r=0 bl.length=46 2024-06-04T16:11:37.533 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:37.531+0000 7ff872298800 20 rados->read ofs=0 len=0 2024-06-04T16:11:37.534 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:37.532+0000 7ff872298800 20 rados_obj.operate() r=0 bl.length=470 2024-06-04T16:11:37.534 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:37.532+0000 7ff872298800 20 zone default found 2024-06-04T16:11:37.534 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:37.532+0000 7ff872298800 4 Realm: () 2024-06-04T16:11:37.534 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:37.532+0000 7ff872298800 4 ZoneGroup: default (abb22408-c332-4e28-8f7a-ff254ea2fed2) 2024-06-04T16:11:37.534 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:37.532+0000 7ff872298800 4 Zone: default (be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767) 2024-06-04T16:11:37.535 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:37.532+0000 7ff872298800 10 cannot find current period zonegroup using local zonegroup configuration 2024-06-04T16:11:37.535 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:37.532+0000 7ff872298800 20 zonegroup default 2024-06-04T16:11:37.535 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:37.532+0000 7ff872298800 20 rados->read ofs=0 len=0 2024-06-04T16:11:37.535 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:37.532+0000 7ff872298800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:11:37.535 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:37.532+0000 7ff872298800 20 rados->read ofs=0 len=0 2024-06-04T16:11:37.535 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:37.532+0000 7ff872298800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:11:37.535 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:37.532+0000 7ff872298800 20 rados->read ofs=0 len=0 2024-06-04T16:11:37.535 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:37.533+0000 7ff872298800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:11:37.535 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:37.533+0000 7ff872298800 20 started sync module instance, tier type = 2024-06-04T16:11:37.535 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:37.533+0000 7ff872298800 20 started zone id=be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767 (name=default) with tier type = 2024-06-04T16:11:37.542 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:37.541+0000 7ff872298800 20 add_watcher() i=0 2024-06-04T16:11:37.542 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:37.541+0000 7ff872298800 20 add_watcher() i=1 2024-06-04T16:11:37.542 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:37.541+0000 7ff872298800 20 add_watcher() i=2 2024-06-04T16:11:37.542 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:37.541+0000 7ff872298800 20 add_watcher() i=3 2024-06-04T16:11:37.542 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:37.541+0000 7ff872298800 20 add_watcher() i=4 2024-06-04T16:11:37.542 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:37.541+0000 7ff872298800 20 add_watcher() i=5 2024-06-04T16:11:37.542 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:37.541+0000 7ff872298800 20 add_watcher() i=6 2024-06-04T16:11:37.543 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:37.542+0000 7ff872298800 20 add_watcher() i=7 2024-06-04T16:11:37.543 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:37.542+0000 7ff872298800 2 all 8 watchers are set, enabling cache 2024-06-04T16:11:37.544 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:37.543+0000 7ff725fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-06-04T16:11:37.545 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:37.544+0000 7ff872298800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-06-04T16:11:37.545 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:37.544+0000 7ff872298800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-06-04T16:11:37.545 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:37.544+0000 7ff872298800 5 note: GC not initialized 2024-06-04T16:11:37.545 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:37.544+0000 7ff724fe1640 20 reqs_thread_entry: start 2024-06-04T16:11:37.545 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:37.544+0000 7ff872298800 20 init_complete bucket index max shards: 11 2024-06-04T16:11:37.545 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:37.544+0000 7ff872298800 20 Filter name: none 2024-06-04T16:11:37.545 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:37.544+0000 7ff69e7fc640 20 reqs_thread_entry: start 2024-06-04T16:11:37.545 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:37.544+0000 7ff872298800 20 rados->read ofs=0 len=0 2024-06-04T16:11:37.546 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:37.545+0000 7ff872298800 20 rados_obj.operate() r=0 bl.length=194 2024-06-04T16:11:37.546 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:37.545+0000 7ff872298800 20 rados->read ofs=0 len=0 2024-06-04T16:11:37.546 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:37.545+0000 7ff872298800 20 rados_obj.operate() r=0 bl.length=408 2024-06-04T16:11:37.546 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:37.545+0000 7ff872298800 20 couldn't put binfo cache entry, might have raced with data changes 2024-06-04T16:11:37.546 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:37.545+0000 7ff872298800 20 rados->read ofs=0 len=0 2024-06-04T16:11:37.546 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:37.546+0000 7ff872298800 20 rados_obj.operate() r=0 bl.length=194 2024-06-04T16:11:37.547 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:37.546+0000 7ff872298800 20 rados->read ofs=0 len=0 2024-06-04T16:11:37.547 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:37.546+0000 7ff872298800 20 rados_obj.operate() r=0 bl.length=408 2024-06-04T16:11:37.547 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:37.546+0000 7ff872298800 20 couldn't put binfo cache entry, might have raced with data changes 2024-06-04T16:11:37.548 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:37.547+0000 7ff725fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-06-04T16:11:37.550 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:37.549+0000 7ff872298800 20 remove_watcher() i=0 2024-06-04T16:11:37.550 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:37.549+0000 7ff872298800 2 removed watcher, disabling cache 2024-06-04T16:11:37.551 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:37.550+0000 7ff872298800 20 remove_watcher() i=1 2024-06-04T16:11:37.552 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:37.551+0000 7ff872298800 20 remove_watcher() i=2 2024-06-04T16:11:37.553 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:37.552+0000 7ff872298800 20 remove_watcher() i=3 2024-06-04T16:11:37.554 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:37.553+0000 7ff872298800 20 remove_watcher() i=4 2024-06-04T16:11:37.555 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:37.554+0000 7ff872298800 20 remove_watcher() i=5 2024-06-04T16:11:37.556 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:37.555+0000 7ff872298800 20 remove_watcher() i=6 2024-06-04T16:11:37.557 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:37.556+0000 7ff872298800 20 remove_watcher() i=7 2024-06-04T16:11:37.567 INFO:tasks.workunit.client.0.smithi144.stderr: 2024-06-04T16:11:37.567 INFO:tasks.workunit.client.0.smithi144.stderr:BUCKET_STATS: 2024-06-04T16:11:37.568 INFO:tasks.workunit.client.0.smithi144.stderr:bucket: error-at-set-target-layout id: be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.19 num_objects: 19 size_kb: 1 num_shards: 12 2024-06-04T16:11:37.568 INFO:tasks.workunit.client.0.smithi144.stderr: 2024-06-04T16:11:37.569 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:11:37.569 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:11:37.573 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:11:37.573 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:11:37.617 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:11:37.617 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:11:37.643 INFO:tasks.workunit.client.0.smithi144.stderr:TEST: reshard bucket with ECANCELED injected at set_target_layout 2024-06-04T16:11:37.643 INFO:tasks.workunit.client.0.smithi144.stderr: 2024-06-04T16:11:37.644 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:11:37.644 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:11:37.655 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:11:37.655 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:11:37.698 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:11:37.698 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:11:37.704 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:11:37.704 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:11:37.710 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:11:37.710 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:11:37.716 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:11:37.716 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:11:37.723 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:11:37.723 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:11:37.729 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:11:37.729 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:11:37.735 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:11:37.735 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:11:37.742 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:11:37.742 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:11:37.748 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:11:37.748 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:11:37.753 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:11:37.753 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:11:37.759 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:11:37.759 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:11:37.765 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:11:37.765 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:11:37.771 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:11:37.771 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:11:37.776 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:11:37.776 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:11:37.782 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:11:37.782 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:11:37.788 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:11:37.788 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:11:37.794 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:11:37.794 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:11:37.800 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:11:37.800 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:11:37.805 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:11:37.805 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:11:37.811 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:11:37.812 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:11:37.818 INFO:tasks.workunit.client.0.smithi144.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2024-06-04T16:11:37.846 INFO:tasks.workunit.client.0.smithi144.stderr:ignoring --setuser ceph since I am not root 2024-06-04T16:11:37.846 INFO:tasks.workunit.client.0.smithi144.stderr:ignoring --setgroup ceph since I am not root 2024-06-04T16:11:37.882 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:37.881+0000 7f2742546800 20 rados->read ofs=0 len=0 2024-06-04T16:11:37.884 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:37.883+0000 7f2742546800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:11:37.884 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:37.883+0000 7f2742546800 20 realm 2024-06-04T16:11:37.884 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:37.883+0000 7f2742546800 20 rados->read ofs=0 len=0 2024-06-04T16:11:37.884 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:37.883+0000 7f2742546800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:11:37.884 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:37.883+0000 7f2742546800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-06-04T16:11:37.884 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:37.883+0000 7f2742546800 20 rados->read ofs=0 len=0 2024-06-04T16:11:37.884 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:37.883+0000 7f2742546800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:11:37.884 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:37.883+0000 7f2742546800 20 rados->read ofs=0 len=0 2024-06-04T16:11:37.885 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:37.884+0000 7f2742546800 20 rados_obj.operate() r=0 bl.length=46 2024-06-04T16:11:37.885 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:37.884+0000 7f2742546800 20 rados->read ofs=0 len=0 2024-06-04T16:11:37.885 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:37.884+0000 7f2742546800 20 rados_obj.operate() r=0 bl.length=1139 2024-06-04T16:11:37.885 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:37.884+0000 7f2742546800 20 searching for the correct realm 2024-06-04T16:11:37.887 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:37.886+0000 7f274083c640 0 -- 172.21.15.144:0/177831198 >> [v2:172.21.15.144:6800/1453747520,v1:172.21.15.144:6801/1453747520] conn(0x7f27280b12c0 msgr2=0x7f27280a2d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-06-04T16:11:38.092 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.091+0000 7f274083c640 0 -- 172.21.15.144:0/177831198 >> [v2:172.21.15.144:6824/166159729,v1:172.21.15.144:6825/166159729] conn(0x56268f000cd0 msgr2=0x56268f0030c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-06-04T16:11:38.097 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.096+0000 7f2742546800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-06-04T16:11:38.097 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.096+0000 7f2742546800 20 RGWRados::pool_iterate: got zone_info.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767 2024-06-04T16:11:38.097 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.096+0000 7f2742546800 20 RGWRados::pool_iterate: got default.zone. 2024-06-04T16:11:38.097 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.096+0000 7f2742546800 20 RGWRados::pool_iterate: got zonegroup_info.abb22408-c332-4e28-8f7a-ff254ea2fed2 2024-06-04T16:11:38.097 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.096+0000 7f2742546800 20 RGWRados::pool_iterate: got zone_names.default 2024-06-04T16:11:38.097 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.096+0000 7f2742546800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-06-04T16:11:38.097 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.096+0000 7f2742546800 20 rados->read ofs=0 len=0 2024-06-04T16:11:38.097 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.096+0000 7f2742546800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:11:38.097 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.096+0000 7f2742546800 20 rados->read ofs=0 len=0 2024-06-04T16:11:38.098 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.096+0000 7f2742546800 20 rados_obj.operate() r=0 bl.length=46 2024-06-04T16:11:38.099 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.096+0000 7f2742546800 20 rados->read ofs=0 len=0 2024-06-04T16:11:38.099 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.097+0000 7f2742546800 20 rados_obj.operate() r=0 bl.length=470 2024-06-04T16:11:38.099 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.097+0000 7f2742546800 20 zone default found 2024-06-04T16:11:38.099 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.097+0000 7f2742546800 4 Realm: () 2024-06-04T16:11:38.099 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.097+0000 7f2742546800 4 ZoneGroup: default (abb22408-c332-4e28-8f7a-ff254ea2fed2) 2024-06-04T16:11:38.099 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.097+0000 7f2742546800 4 Zone: default (be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767) 2024-06-04T16:11:38.099 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.097+0000 7f2742546800 10 cannot find current period zonegroup using local zonegroup configuration 2024-06-04T16:11:38.099 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.097+0000 7f2742546800 20 zonegroup default 2024-06-04T16:11:38.099 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.097+0000 7f2742546800 20 rados->read ofs=0 len=0 2024-06-04T16:11:38.099 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.097+0000 7f2742546800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:11:38.099 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.097+0000 7f2742546800 20 rados->read ofs=0 len=0 2024-06-04T16:11:38.099 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.097+0000 7f2742546800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:11:38.099 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.097+0000 7f2742546800 20 rados->read ofs=0 len=0 2024-06-04T16:11:38.099 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.098+0000 7f2742546800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:11:38.099 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.098+0000 7f2742546800 20 started sync module instance, tier type = 2024-06-04T16:11:38.100 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.098+0000 7f2742546800 20 started zone id=be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767 (name=default) with tier type = 2024-06-04T16:11:38.107 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.106+0000 7f2742546800 20 add_watcher() i=0 2024-06-04T16:11:38.107 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.106+0000 7f2742546800 20 add_watcher() i=1 2024-06-04T16:11:38.107 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.106+0000 7f2742546800 20 add_watcher() i=2 2024-06-04T16:11:38.107 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.106+0000 7f2742546800 20 add_watcher() i=3 2024-06-04T16:11:38.107 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.106+0000 7f2742546800 20 add_watcher() i=4 2024-06-04T16:11:38.107 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.106+0000 7f2742546800 20 add_watcher() i=5 2024-06-04T16:11:38.107 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.106+0000 7f2742546800 20 add_watcher() i=6 2024-06-04T16:11:38.108 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.107+0000 7f2742546800 20 add_watcher() i=7 2024-06-04T16:11:38.108 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.107+0000 7f2742546800 2 all 8 watchers are set, enabling cache 2024-06-04T16:11:38.110 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.109+0000 7f25f6fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-06-04T16:11:38.110 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.109+0000 7f2742546800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-06-04T16:11:38.110 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.109+0000 7f2742546800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-06-04T16:11:38.110 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.109+0000 7f2742546800 5 note: GC not initialized 2024-06-04T16:11:38.110 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.109+0000 7f25f5fdb640 20 reqs_thread_entry: start 2024-06-04T16:11:38.111 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.109+0000 7f2742546800 20 init_complete bucket index max shards: 11 2024-06-04T16:11:38.111 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.109+0000 7f2742546800 20 Filter name: none 2024-06-04T16:11:38.111 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.109+0000 7f25677fe640 20 reqs_thread_entry: start 2024-06-04T16:11:38.111 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.109+0000 7f2742546800 20 rados->read ofs=0 len=0 2024-06-04T16:11:38.111 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.110+0000 7f2742546800 20 rados_obj.operate() r=0 bl.length=194 2024-06-04T16:11:38.111 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.110+0000 7f2742546800 20 rados->read ofs=0 len=0 2024-06-04T16:11:38.112 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.111+0000 7f2742546800 20 rados_obj.operate() r=0 bl.length=408 2024-06-04T16:11:38.112 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.111+0000 7f2742546800 20 couldn't put binfo cache entry, might have raced with data changes 2024-06-04T16:11:38.112 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.111+0000 7f2742546800 20 rados->read ofs=0 len=0 2024-06-04T16:11:38.112 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.111+0000 7f2742546800 20 rados_obj.operate() r=0 bl.length=194 2024-06-04T16:11:38.112 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.111+0000 7f2742546800 20 rados->read ofs=0 len=0 2024-06-04T16:11:38.113 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.112+0000 7f2742546800 20 rados_obj.operate() r=0 bl.length=408 2024-06-04T16:11:38.113 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.112+0000 7f2742546800 20 couldn't put binfo cache entry, might have raced with data changes 2024-06-04T16:11:38.114 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.113+0000 7f25f6fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-06-04T16:11:38.116 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.115+0000 7f2742546800 20 remove_watcher() i=0 2024-06-04T16:11:38.116 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.115+0000 7f2742546800 2 removed watcher, disabling cache 2024-06-04T16:11:38.117 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.117+0000 7f2742546800 20 remove_watcher() i=1 2024-06-04T16:11:38.118 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.118+0000 7f2742546800 20 remove_watcher() i=2 2024-06-04T16:11:38.119 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.118+0000 7f2742546800 20 remove_watcher() i=3 2024-06-04T16:11:38.120 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.119+0000 7f2742546800 20 remove_watcher() i=4 2024-06-04T16:11:38.121 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.120+0000 7f2742546800 20 remove_watcher() i=5 2024-06-04T16:11:38.122 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.121+0000 7f2742546800 20 remove_watcher() i=6 2024-06-04T16:11:38.123 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.122+0000 7f2742546800 20 remove_watcher() i=7 2024-06-04T16:11:38.133 INFO:tasks.workunit.client.0.smithi144.stderr: 2024-06-04T16:11:38.133 INFO:tasks.workunit.client.0.smithi144.stderr:BUCKET_STATS: 2024-06-04T16:11:38.133 INFO:tasks.workunit.client.0.smithi144.stderr:bucket: error-at-set-target-layout id: be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.20 num_objects: 20 size_kb: 1 num_shards: 11 2024-06-04T16:11:38.134 INFO:tasks.workunit.client.0.smithi144.stderr: 2024-06-04T16:11:38.135 INFO:tasks.workunit.client.0.smithi144.stderr:radosgw-admin bucket reshard --bucket error-at-set-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at set_target_layout --inject-error-code 125 2024-06-04T16:11:38.170 INFO:tasks.workunit.client.0.smithi144.stderr:ignoring --setuser ceph since I am not root 2024-06-04T16:11:38.170 INFO:tasks.workunit.client.0.smithi144.stderr:ignoring --setgroup ceph since I am not root 2024-06-04T16:11:38.208 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.207+0000 7f9d28410800 20 rados->read ofs=0 len=0 2024-06-04T16:11:38.209 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.208+0000 7f9d28410800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:11:38.209 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.208+0000 7f9d28410800 20 realm 2024-06-04T16:11:38.209 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.208+0000 7f9d28410800 20 rados->read ofs=0 len=0 2024-06-04T16:11:38.210 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.208+0000 7f9d28410800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:11:38.210 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.208+0000 7f9d28410800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-06-04T16:11:38.210 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.208+0000 7f9d28410800 20 rados->read ofs=0 len=0 2024-06-04T16:11:38.210 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.208+0000 7f9d28410800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:11:38.210 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.208+0000 7f9d28410800 20 rados->read ofs=0 len=0 2024-06-04T16:11:38.210 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.209+0000 7f9d28410800 20 rados_obj.operate() r=0 bl.length=46 2024-06-04T16:11:38.211 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.209+0000 7f9d28410800 20 rados->read ofs=0 len=0 2024-06-04T16:11:38.211 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.210+0000 7f9d28410800 20 rados_obj.operate() r=0 bl.length=1139 2024-06-04T16:11:38.211 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.210+0000 7f9d28410800 20 searching for the correct realm 2024-06-04T16:11:38.211 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.211+0000 7f9d23272640 0 -- 172.21.15.144:0/1681281644 >> [v2:172.21.15.144:6808/86532035,v1:172.21.15.144:6809/86532035] conn(0x7f9d1407c040 msgr2=0x7f9d1407c930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-06-04T16:11:38.416 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.415+0000 7f9d23a73640 0 -- 172.21.15.144:0/1681281644 >> [v2:172.21.15.177:6824/800067290,v1:172.21.15.177:6825/800067290] conn(0x55a3eeec82c0 msgr2=0x55a3eeeca750 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-06-04T16:11:38.422 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.421+0000 7f9d28410800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-06-04T16:11:38.422 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.421+0000 7f9d28410800 20 RGWRados::pool_iterate: got zone_info.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767 2024-06-04T16:11:38.422 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.421+0000 7f9d28410800 20 RGWRados::pool_iterate: got default.zone. 2024-06-04T16:11:38.422 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.421+0000 7f9d28410800 20 RGWRados::pool_iterate: got zonegroup_info.abb22408-c332-4e28-8f7a-ff254ea2fed2 2024-06-04T16:11:38.422 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.421+0000 7f9d28410800 20 RGWRados::pool_iterate: got zone_names.default 2024-06-04T16:11:38.422 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.421+0000 7f9d28410800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-06-04T16:11:38.422 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.421+0000 7f9d28410800 20 rados->read ofs=0 len=0 2024-06-04T16:11:38.423 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.421+0000 7f9d28410800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:11:38.423 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.421+0000 7f9d28410800 20 rados->read ofs=0 len=0 2024-06-04T16:11:38.423 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.422+0000 7f9d28410800 20 rados_obj.operate() r=0 bl.length=46 2024-06-04T16:11:38.423 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.422+0000 7f9d28410800 20 rados->read ofs=0 len=0 2024-06-04T16:11:38.424 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.422+0000 7f9d28410800 20 rados_obj.operate() r=0 bl.length=470 2024-06-04T16:11:38.424 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.422+0000 7f9d28410800 20 zone default found 2024-06-04T16:11:38.424 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.422+0000 7f9d28410800 4 Realm: () 2024-06-04T16:11:38.424 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.422+0000 7f9d28410800 4 ZoneGroup: default (abb22408-c332-4e28-8f7a-ff254ea2fed2) 2024-06-04T16:11:38.424 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.422+0000 7f9d28410800 4 Zone: default (be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767) 2024-06-04T16:11:38.424 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.422+0000 7f9d28410800 10 cannot find current period zonegroup using local zonegroup configuration 2024-06-04T16:11:38.424 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.422+0000 7f9d28410800 20 zonegroup default 2024-06-04T16:11:38.424 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.422+0000 7f9d28410800 20 rados->read ofs=0 len=0 2024-06-04T16:11:38.424 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.423+0000 7f9d28410800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:11:38.424 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.423+0000 7f9d28410800 20 rados->read ofs=0 len=0 2024-06-04T16:11:38.425 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.423+0000 7f9d28410800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:11:38.425 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.423+0000 7f9d28410800 20 rados->read ofs=0 len=0 2024-06-04T16:11:38.425 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.423+0000 7f9d28410800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:11:38.425 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.423+0000 7f9d28410800 20 started sync module instance, tier type = 2024-06-04T16:11:38.425 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.423+0000 7f9d28410800 20 started zone id=be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767 (name=default) with tier type = 2024-06-04T16:11:38.432 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.432+0000 7f9d28410800 20 add_watcher() i=0 2024-06-04T16:11:38.432 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.432+0000 7f9d28410800 20 add_watcher() i=1 2024-06-04T16:11:38.433 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.432+0000 7f9d28410800 20 add_watcher() i=2 2024-06-04T16:11:38.433 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.432+0000 7f9d28410800 20 add_watcher() i=3 2024-06-04T16:11:38.433 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.432+0000 7f9d28410800 20 add_watcher() i=4 2024-06-04T16:11:38.433 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.432+0000 7f9d28410800 20 add_watcher() i=5 2024-06-04T16:11:38.433 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.432+0000 7f9d28410800 20 add_watcher() i=6 2024-06-04T16:11:38.433 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.433+0000 7f9d28410800 20 add_watcher() i=7 2024-06-04T16:11:38.433 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.433+0000 7f9d28410800 2 all 8 watchers are set, enabling cache 2024-06-04T16:11:38.435 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.434+0000 7f9bd9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-06-04T16:11:38.436 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.435+0000 7f9d28410800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-06-04T16:11:38.436 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.435+0000 7f9d28410800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-06-04T16:11:38.436 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.435+0000 7f9d28410800 5 note: GC not initialized 2024-06-04T16:11:38.436 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.435+0000 7f9bd8fe1640 20 reqs_thread_entry: start 2024-06-04T16:11:38.436 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.435+0000 7f9d28410800 20 init_complete bucket index max shards: 11 2024-06-04T16:11:38.436 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.435+0000 7f9d28410800 20 Filter name: none 2024-06-04T16:11:38.437 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.435+0000 7f9b527fc640 20 reqs_thread_entry: start 2024-06-04T16:11:38.437 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.435+0000 7f9d28410800 10 cache get: name=default.rgw.meta+root+error-at-set-target-layout : miss 2024-06-04T16:11:38.437 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.435+0000 7f9d28410800 20 rados->read ofs=0 len=0 2024-06-04T16:11:38.437 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.436+0000 7f9d28410800 20 rados_obj.operate() r=0 bl.length=194 2024-06-04T16:11:38.437 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.436+0000 7f9d28410800 10 cache put: name=default.rgw.meta+root+error-at-set-target-layout info.flags=0x11 2024-06-04T16:11:38.438 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.436+0000 7f9d28410800 10 adding default.rgw.meta+root+error-at-set-target-layout to cache LRU end 2024-06-04T16:11:38.438 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.436+0000 7f9d28410800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.20 : miss 2024-06-04T16:11:38.438 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.436+0000 7f9d28410800 20 rados->read ofs=0 len=0 2024-06-04T16:11:38.438 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.436+0000 7f9d28410800 20 rados_obj.operate() r=0 bl.length=408 2024-06-04T16:11:38.438 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.436+0000 7f9d28410800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.20 info.flags=0x17 2024-06-04T16:11:38.438 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.436+0000 7f9d28410800 10 adding default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.20 to cache LRU end 2024-06-04T16:11:38.438 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.436+0000 7f9d28410800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-06-04T16:11:38.438 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.436+0000 7f9d28410800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-06-04T16:11:38.438 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.436+0000 7f9d28410800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.20 2024-06-04T16:11:38.440 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.440+0000 7f9d28410800 -1 Injecting error=-125 at location=set_target_layout 2024-06-04T16:11:38.442 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.441+0000 7f9d28410800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.20 info.flags=0x17 2024-06-04T16:11:38.442 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.441+0000 7f9d28410800 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.20 to cache LRU end 2024-06-04T16:11:38.442 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.441+0000 7f9d28410800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-06-04T16:11:38.442 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.441+0000 7f9d28410800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.20, ofs0, ns] 2024-06-04T16:11:38.442 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.441+0000 7f9c02ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1078036791395 cookie 94162576579936 notifier 6234 bl.length()=917 2024-06-04T16:11:38.442 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.441+0000 7f9c02ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.20 info.flags=0x17 2024-06-04T16:11:38.442 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.441+0000 7f9c02ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.20 to cache LRU end 2024-06-04T16:11:38.442 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.441+0000 7f9c02ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-06-04T16:11:38.443 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.442+0000 7f9d28410800 20 handle_bi_update(): bucket=:error-at-set-target-layout[be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.20]): orig_sources= new_sources= 2024-06-04T16:11:38.443 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.442+0000 7f9d28410800 20 handle_bi_update(): bucket=:error-at-set-target-layout[be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.20]): potential sources added=[] removed=[] 2024-06-04T16:11:38.443 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.442+0000 7f9d28410800 20 handle_bi_update(): bucket=:error-at-set-target-layout[be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.20]): orig_dests= new_dests= 2024-06-04T16:11:38.443 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.442+0000 7f9d28410800 20 handle_bi_update(): bucket=:error-at-set-target-layout[be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.20]): potential dests added=[] removed=[] 2024-06-04T16:11:38.445 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.444+0000 7f9d28410800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.20.1.0 2024-06-04T16:11:38.445 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.444+0000 7f9d28410800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.20.1.0 2024-06-04T16:11:38.445 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.444+0000 7f9d28410800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.20.1.1 2024-06-04T16:11:38.446 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.444+0000 7f9d28410800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.20.1.1 2024-06-04T16:11:38.446 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.444+0000 7f9d28410800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.20.1.2 2024-06-04T16:11:38.446 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.444+0000 7f9d28410800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.20.1.2 2024-06-04T16:11:38.446 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.444+0000 7f9d28410800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.20.1.3 2024-06-04T16:11:38.446 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.444+0000 7f9d28410800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.20.1.3 2024-06-04T16:11:38.446 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.444+0000 7f9d28410800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.20.1.4 2024-06-04T16:11:38.446 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.444+0000 7f9d28410800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.20.1.4 2024-06-04T16:11:38.446 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.444+0000 7f9d28410800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.20.1.5 2024-06-04T16:11:38.446 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.444+0000 7f9d28410800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.20.1.5 2024-06-04T16:11:38.446 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.444+0000 7f9d28410800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.20.1.6 2024-06-04T16:11:38.446 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.444+0000 7f9d28410800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.20.1.6 2024-06-04T16:11:38.446 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.444+0000 7f9d28410800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.20.1.7 2024-06-04T16:11:38.446 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.444+0000 7f9d28410800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.20.1.7 2024-06-04T16:11:38.447 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.444+0000 7f9d28410800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.20.1.8 2024-06-04T16:11:38.447 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.444+0000 7f9d28410800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.20.1.8 2024-06-04T16:11:38.447 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.444+0000 7f9d28410800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.20.1.9 2024-06-04T16:11:38.447 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.444+0000 7f9d28410800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.20.1.9 2024-06-04T16:11:38.447 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.444+0000 7f9d28410800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.20.1.10 2024-06-04T16:11:38.447 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.444+0000 7f9d28410800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.20.1.10 2024-06-04T16:11:38.447 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.444+0000 7f9d28410800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.20.1.11 2024-06-04T16:11:38.447 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.444+0000 7f9d28410800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.20.1.11 2024-06-04T16:11:38.447 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.444+0000 7f9d28410800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.20.0 2024-06-04T16:11:38.448 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.445+0000 7f9d28410800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.20.1 2024-06-04T16:11:38.448 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.445+0000 7f9d28410800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.20.2 2024-06-04T16:11:38.448 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.446+0000 7f9d28410800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.20.3 2024-06-04T16:11:38.448 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.446+0000 7f9d28410800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.20.4 2024-06-04T16:11:38.448 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.447+0000 7f9d28410800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.20.5 2024-06-04T16:11:38.448 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.447+0000 7f9d28410800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.20.6 2024-06-04T16:11:38.448 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.447+0000 7f9d28410800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.20.7 2024-06-04T16:11:38.449 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.448+0000 7f9d28410800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.20.8 2024-06-04T16:11:38.449 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.448+0000 7f9d28410800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.20.9 2024-06-04T16:11:38.450 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.449+0000 7f9d28410800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.20.10 2024-06-04T16:11:38.453 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.452+0000 7f9d28410800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.20 : hit (requested=0x17, cached=0x17) 2024-06-04T16:11:38.453 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.452+0000 7f9d28410800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.20 2024-06-04T16:11:38.454 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.453+0000 7f9d28410800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.20 info.flags=0x17 2024-06-04T16:11:38.454 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.453+0000 7f9d28410800 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.20 to cache LRU end 2024-06-04T16:11:38.454 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.453+0000 7f9d28410800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-06-04T16:11:38.454 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.453+0000 7f9d28410800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.20, ofs0, ns] 2024-06-04T16:11:38.454 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.453+0000 7f9c027fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1078036791396 cookie 94162576579936 notifier 6234 bl.length()=885 2024-06-04T16:11:38.454 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.453+0000 7f9c027fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.20 info.flags=0x17 2024-06-04T16:11:38.454 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.453+0000 7f9c027fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.20 to cache LRU end 2024-06-04T16:11:38.454 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.453+0000 7f9c027fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-06-04T16:11:38.455 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.454+0000 7f9d28410800 20 handle_bi_update(): bucket=:error-at-set-target-layout[be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.20]): orig_sources= new_sources= 2024-06-04T16:11:38.455 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.454+0000 7f9d28410800 20 handle_bi_update(): bucket=:error-at-set-target-layout[be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.20]): potential sources added=[] removed=[] 2024-06-04T16:11:38.455 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.454+0000 7f9d28410800 20 handle_bi_update(): bucket=:error-at-set-target-layout[be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.20]): orig_dests= new_dests= 2024-06-04T16:11:38.455 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.454+0000 7f9d28410800 20 handle_bi_update(): bucket=:error-at-set-target-layout[be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.20]): potential dests added=[] removed=[] 2024-06-04T16:11:38.456 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.456+0000 7f9d28410800 1 execute INFO: reshard of bucket "error-at-set-target-layout" completed successfully 2024-06-04T16:11:38.458 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.457+0000 7f9bd9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-06-04T16:11:38.460 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.459+0000 7f9d28410800 20 remove_watcher() i=0 2024-06-04T16:11:38.460 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.459+0000 7f9d28410800 2 removed watcher, disabling cache 2024-06-04T16:11:38.461 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.460+0000 7f9d28410800 20 remove_watcher() i=1 2024-06-04T16:11:38.462 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.461+0000 7f9d28410800 20 remove_watcher() i=2 2024-06-04T16:11:38.463 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.462+0000 7f9d28410800 20 remove_watcher() i=3 2024-06-04T16:11:38.464 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.463+0000 7f9d28410800 20 remove_watcher() i=4 2024-06-04T16:11:38.465 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.464+0000 7f9d28410800 20 remove_watcher() i=5 2024-06-04T16:11:38.466 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.465+0000 7f9d28410800 20 remove_watcher() i=6 2024-06-04T16:11:38.467 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.466+0000 7f9d28410800 20 remove_watcher() i=7 2024-06-04T16:11:38.479 INFO:tasks.workunit.client.0.smithi144.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2024-06-04T16:11:38.507 INFO:tasks.workunit.client.0.smithi144.stderr:ignoring --setuser ceph since I am not root 2024-06-04T16:11:38.507 INFO:tasks.workunit.client.0.smithi144.stderr:ignoring --setgroup ceph since I am not root 2024-06-04T16:11:38.544 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.543+0000 7f30b1c62800 20 rados->read ofs=0 len=0 2024-06-04T16:11:38.546 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.545+0000 7f30b1c62800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:11:38.546 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.545+0000 7f30b1c62800 20 realm 2024-06-04T16:11:38.546 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.545+0000 7f30b1c62800 20 rados->read ofs=0 len=0 2024-06-04T16:11:38.546 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.545+0000 7f30b1c62800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:11:38.546 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.545+0000 7f30b1c62800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-06-04T16:11:38.546 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.545+0000 7f30b1c62800 20 rados->read ofs=0 len=0 2024-06-04T16:11:38.546 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.545+0000 7f30b1c62800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:11:38.546 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.545+0000 7f30b1c62800 20 rados->read ofs=0 len=0 2024-06-04T16:11:38.747 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.747+0000 7f30b1c62800 20 rados_obj.operate() r=0 bl.length=46 2024-06-04T16:11:38.748 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.747+0000 7f30b1c62800 20 rados->read ofs=0 len=0 2024-06-04T16:11:38.748 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.747+0000 7f30b1c62800 20 rados_obj.operate() r=0 bl.length=1139 2024-06-04T16:11:38.748 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.747+0000 7f30b1c62800 20 searching for the correct realm 2024-06-04T16:11:38.750 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.749+0000 7f30af75e640 0 -- 172.21.15.144:0/2624256064 >> [v2:172.21.15.177:6824/800067290,v1:172.21.15.177:6825/800067290] conn(0x55bef485fb70 msgr2=0x55bef4862030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-06-04T16:11:38.753 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.752+0000 7f30aef5d640 0 -- 172.21.15.144:0/2624256064 >> [v2:172.21.15.177:6808/2618477608,v1:172.21.15.177:6809/2618477608] conn(0x7f30a4079400 msgr2=0x7f30a4065ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-06-04T16:11:38.960 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.958+0000 7f30b1c62800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-06-04T16:11:38.960 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.958+0000 7f30b1c62800 20 RGWRados::pool_iterate: got zone_info.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767 2024-06-04T16:11:38.960 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.958+0000 7f30b1c62800 20 RGWRados::pool_iterate: got default.zone. 2024-06-04T16:11:38.960 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.958+0000 7f30b1c62800 20 RGWRados::pool_iterate: got zonegroup_info.abb22408-c332-4e28-8f7a-ff254ea2fed2 2024-06-04T16:11:38.960 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.958+0000 7f30b1c62800 20 RGWRados::pool_iterate: got zone_names.default 2024-06-04T16:11:38.960 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.958+0000 7f30b1c62800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-06-04T16:11:38.960 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.958+0000 7f30b1c62800 20 rados->read ofs=0 len=0 2024-06-04T16:11:38.960 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.959+0000 7f30b1c62800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:11:38.960 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.959+0000 7f30b1c62800 20 rados->read ofs=0 len=0 2024-06-04T16:11:38.960 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.959+0000 7f30b1c62800 20 rados_obj.operate() r=0 bl.length=46 2024-06-04T16:11:38.961 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.959+0000 7f30b1c62800 20 rados->read ofs=0 len=0 2024-06-04T16:11:38.961 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.959+0000 7f30b1c62800 20 rados_obj.operate() r=0 bl.length=470 2024-06-04T16:11:38.962 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.959+0000 7f30b1c62800 20 zone default found 2024-06-04T16:11:38.962 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.959+0000 7f30b1c62800 4 Realm: () 2024-06-04T16:11:38.962 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.959+0000 7f30b1c62800 4 ZoneGroup: default (abb22408-c332-4e28-8f7a-ff254ea2fed2) 2024-06-04T16:11:38.962 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.959+0000 7f30b1c62800 4 Zone: default (be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767) 2024-06-04T16:11:38.962 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.959+0000 7f30b1c62800 10 cannot find current period zonegroup using local zonegroup configuration 2024-06-04T16:11:38.962 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.959+0000 7f30b1c62800 20 zonegroup default 2024-06-04T16:11:38.962 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.959+0000 7f30b1c62800 20 rados->read ofs=0 len=0 2024-06-04T16:11:38.962 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.960+0000 7f30b1c62800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:11:38.962 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.960+0000 7f30b1c62800 20 rados->read ofs=0 len=0 2024-06-04T16:11:38.962 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.960+0000 7f30b1c62800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:11:38.962 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.960+0000 7f30b1c62800 20 rados->read ofs=0 len=0 2024-06-04T16:11:38.963 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.960+0000 7f30b1c62800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:11:38.963 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.960+0000 7f30b1c62800 20 started sync module instance, tier type = 2024-06-04T16:11:38.963 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.960+0000 7f30b1c62800 20 started zone id=be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767 (name=default) with tier type = 2024-06-04T16:11:38.970 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.969+0000 7f30b1c62800 20 add_watcher() i=0 2024-06-04T16:11:38.970 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.969+0000 7f30b1c62800 20 add_watcher() i=1 2024-06-04T16:11:38.970 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.969+0000 7f30b1c62800 20 add_watcher() i=2 2024-06-04T16:11:38.970 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.969+0000 7f30b1c62800 20 add_watcher() i=3 2024-06-04T16:11:38.970 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.969+0000 7f30b1c62800 20 add_watcher() i=4 2024-06-04T16:11:38.970 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.969+0000 7f30b1c62800 20 add_watcher() i=5 2024-06-04T16:11:38.970 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.969+0000 7f30b1c62800 20 add_watcher() i=6 2024-06-04T16:11:38.971 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.970+0000 7f30b1c62800 20 add_watcher() i=7 2024-06-04T16:11:38.971 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.970+0000 7f30b1c62800 2 all 8 watchers are set, enabling cache 2024-06-04T16:11:38.973 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.972+0000 7f2f65fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-06-04T16:11:38.974 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.972+0000 7f30b1c62800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-06-04T16:11:38.974 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.972+0000 7f30b1c62800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-06-04T16:11:38.974 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.972+0000 7f30b1c62800 5 note: GC not initialized 2024-06-04T16:11:38.974 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.973+0000 7f2f64fe1640 20 reqs_thread_entry: start 2024-06-04T16:11:38.974 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.973+0000 7f30b1c62800 20 init_complete bucket index max shards: 11 2024-06-04T16:11:38.974 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.973+0000 7f30b1c62800 20 Filter name: none 2024-06-04T16:11:38.974 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.973+0000 7f2ede7fc640 20 reqs_thread_entry: start 2024-06-04T16:11:38.974 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.973+0000 7f30b1c62800 20 rados->read ofs=0 len=0 2024-06-04T16:11:38.975 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.974+0000 7f30b1c62800 20 rados_obj.operate() r=0 bl.length=194 2024-06-04T16:11:38.975 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.974+0000 7f30b1c62800 20 rados->read ofs=0 len=0 2024-06-04T16:11:38.975 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.974+0000 7f30b1c62800 20 rados_obj.operate() r=0 bl.length=408 2024-06-04T16:11:38.975 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.974+0000 7f30b1c62800 20 couldn't put binfo cache entry, might have raced with data changes 2024-06-04T16:11:38.975 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.974+0000 7f30b1c62800 20 rados->read ofs=0 len=0 2024-06-04T16:11:38.975 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.974+0000 7f30b1c62800 20 rados_obj.operate() r=0 bl.length=194 2024-06-04T16:11:38.976 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.974+0000 7f30b1c62800 20 rados->read ofs=0 len=0 2024-06-04T16:11:38.976 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.975+0000 7f30b1c62800 20 rados_obj.operate() r=0 bl.length=408 2024-06-04T16:11:38.976 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.975+0000 7f30b1c62800 20 couldn't put binfo cache entry, might have raced with data changes 2024-06-04T16:11:38.977 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.976+0000 7f2f65fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-06-04T16:11:38.979 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.978+0000 7f30b1c62800 20 remove_watcher() i=0 2024-06-04T16:11:38.979 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.978+0000 7f30b1c62800 2 removed watcher, disabling cache 2024-06-04T16:11:38.980 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.979+0000 7f30b1c62800 20 remove_watcher() i=1 2024-06-04T16:11:38.982 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.981+0000 7f30b1c62800 20 remove_watcher() i=2 2024-06-04T16:11:38.983 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.982+0000 7f30b1c62800 20 remove_watcher() i=3 2024-06-04T16:11:38.984 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.983+0000 7f30b1c62800 20 remove_watcher() i=4 2024-06-04T16:11:38.985 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.984+0000 7f30b1c62800 20 remove_watcher() i=5 2024-06-04T16:11:38.986 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.985+0000 7f30b1c62800 20 remove_watcher() i=6 2024-06-04T16:11:38.987 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:38.986+0000 7f30b1c62800 20 remove_watcher() i=7 2024-06-04T16:11:38.999 INFO:tasks.workunit.client.0.smithi144.stderr: 2024-06-04T16:11:38.999 INFO:tasks.workunit.client.0.smithi144.stderr:BUCKET_STATS: 2024-06-04T16:11:38.999 INFO:tasks.workunit.client.0.smithi144.stderr:bucket: error-at-set-target-layout id: be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.20 num_objects: 20 size_kb: 1 num_shards: 12 2024-06-04T16:11:38.999 INFO:tasks.workunit.client.0.smithi144.stderr: 2024-06-04T16:11:39.001 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:11:39.001 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:11:39.004 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:11:39.004 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:11:39.047 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:11:39.047 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:11:39.073 INFO:tasks.workunit.client.0.smithi144.stderr:TEST: reshard bucket with abort at set_target_layout 2024-06-04T16:11:39.073 INFO:tasks.workunit.client.0.smithi144.stderr: 2024-06-04T16:11:39.074 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:11:39.075 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:11:39.087 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:11:39.088 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:11:39.130 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:11:39.130 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:11:39.136 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:11:39.136 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:11:39.143 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:11:39.143 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:11:39.149 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:11:39.149 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:11:39.155 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:11:39.156 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:11:39.162 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:11:39.162 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:11:39.168 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:11:39.169 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:11:39.175 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:11:39.175 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:11:39.181 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:11:39.182 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:11:39.188 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:11:39.188 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:11:39.194 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:11:39.195 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:11:39.201 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:11:39.201 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:11:39.207 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:11:39.207 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:11:39.213 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:11:39.214 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:11:39.219 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:11:39.220 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:11:39.226 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:11:39.226 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:11:39.233 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:11:39.233 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:11:39.240 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:11:39.240 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:11:39.246 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:11:39.247 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:11:39.253 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:11:39.253 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:11:39.261 INFO:tasks.workunit.client.0.smithi144.stderr:radosgw-admin bucket stats --bucket abort-at-set-target-layout 2024-06-04T16:11:39.289 INFO:tasks.workunit.client.0.smithi144.stderr:ignoring --setuser ceph since I am not root 2024-06-04T16:11:39.289 INFO:tasks.workunit.client.0.smithi144.stderr:ignoring --setgroup ceph since I am not root 2024-06-04T16:11:39.324 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:39.323+0000 7fd2af132800 20 rados->read ofs=0 len=0 2024-06-04T16:11:39.327 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:39.325+0000 7fd2af132800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:11:39.327 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:39.325+0000 7fd2af132800 20 realm 2024-06-04T16:11:39.327 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:39.325+0000 7fd2af132800 20 rados->read ofs=0 len=0 2024-06-04T16:11:39.327 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:39.325+0000 7fd2af132800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:11:39.327 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:39.325+0000 7fd2af132800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-06-04T16:11:39.327 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:39.325+0000 7fd2af132800 20 rados->read ofs=0 len=0 2024-06-04T16:11:39.327 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:39.325+0000 7fd2af132800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:11:39.327 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:39.325+0000 7fd2af132800 20 rados->read ofs=0 len=0 2024-06-04T16:11:39.328 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:39.326+0000 7fd2af132800 20 rados_obj.operate() r=0 bl.length=46 2024-06-04T16:11:39.328 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:39.326+0000 7fd2af132800 20 rados->read ofs=0 len=0 2024-06-04T16:11:39.529 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:39.527+0000 7fd2af132800 20 rados_obj.operate() r=0 bl.length=1139 2024-06-04T16:11:39.529 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:39.527+0000 7fd2af132800 20 searching for the correct realm 2024-06-04T16:11:39.531 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:39.530+0000 7fd2ab626640 0 -- 172.21.15.144:0/2261090552 >> [v2:172.21.15.144:6800/1453747520,v1:172.21.15.144:6801/1453747520] conn(0x7fd29408d070 msgr2=0x7fd294086460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-06-04T16:11:39.737 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:39.735+0000 7fd2ab626640 0 -- 172.21.15.144:0/2261090552 >> [v2:172.21.15.144:6824/166159729,v1:172.21.15.144:6825/166159729] conn(0x55edd600f070 msgr2=0x55edd6011460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-06-04T16:11:39.742 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:39.740+0000 7fd2af132800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-06-04T16:11:39.743 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:39.740+0000 7fd2af132800 20 RGWRados::pool_iterate: got zone_info.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767 2024-06-04T16:11:39.743 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:39.740+0000 7fd2af132800 20 RGWRados::pool_iterate: got default.zone. 2024-06-04T16:11:39.743 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:39.740+0000 7fd2af132800 20 RGWRados::pool_iterate: got zonegroup_info.abb22408-c332-4e28-8f7a-ff254ea2fed2 2024-06-04T16:11:39.743 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:39.740+0000 7fd2af132800 20 RGWRados::pool_iterate: got zone_names.default 2024-06-04T16:11:39.743 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:39.740+0000 7fd2af132800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-06-04T16:11:39.743 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:39.740+0000 7fd2af132800 20 rados->read ofs=0 len=0 2024-06-04T16:11:39.743 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:39.741+0000 7fd2af132800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:11:39.743 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:39.741+0000 7fd2af132800 20 rados->read ofs=0 len=0 2024-06-04T16:11:39.743 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:39.741+0000 7fd2af132800 20 rados_obj.operate() r=0 bl.length=46 2024-06-04T16:11:39.743 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:39.741+0000 7fd2af132800 20 rados->read ofs=0 len=0 2024-06-04T16:11:39.744 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:39.741+0000 7fd2af132800 20 rados_obj.operate() r=0 bl.length=470 2024-06-04T16:11:39.744 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:39.741+0000 7fd2af132800 20 zone default found 2024-06-04T16:11:39.745 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:39.741+0000 7fd2af132800 4 Realm: () 2024-06-04T16:11:39.745 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:39.741+0000 7fd2af132800 4 ZoneGroup: default (abb22408-c332-4e28-8f7a-ff254ea2fed2) 2024-06-04T16:11:39.745 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:39.741+0000 7fd2af132800 4 Zone: default (be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767) 2024-06-04T16:11:39.745 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:39.741+0000 7fd2af132800 10 cannot find current period zonegroup using local zonegroup configuration 2024-06-04T16:11:39.745 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:39.741+0000 7fd2af132800 20 zonegroup default 2024-06-04T16:11:39.745 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:39.741+0000 7fd2af132800 20 rados->read ofs=0 len=0 2024-06-04T16:11:39.745 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:39.741+0000 7fd2af132800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:11:39.745 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:39.741+0000 7fd2af132800 20 rados->read ofs=0 len=0 2024-06-04T16:11:39.745 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:39.742+0000 7fd2af132800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:11:39.745 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:39.742+0000 7fd2af132800 20 rados->read ofs=0 len=0 2024-06-04T16:11:39.745 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:39.742+0000 7fd2af132800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:11:39.745 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:39.742+0000 7fd2af132800 20 started sync module instance, tier type = 2024-06-04T16:11:39.745 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:39.742+0000 7fd2af132800 20 started zone id=be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767 (name=default) with tier type = 2024-06-04T16:11:39.753 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:39.751+0000 7fd2af132800 20 add_watcher() i=0 2024-06-04T16:11:39.753 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:39.751+0000 7fd2af132800 20 add_watcher() i=1 2024-06-04T16:11:39.753 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:39.751+0000 7fd2af132800 20 add_watcher() i=2 2024-06-04T16:11:39.753 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:39.751+0000 7fd2af132800 20 add_watcher() i=3 2024-06-04T16:11:39.753 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:39.751+0000 7fd2af132800 20 add_watcher() i=4 2024-06-04T16:11:39.753 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:39.751+0000 7fd2af132800 20 add_watcher() i=5 2024-06-04T16:11:39.754 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:39.753+0000 7fd2af132800 20 add_watcher() i=6 2024-06-04T16:11:39.755 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:39.753+0000 7fd2af132800 20 add_watcher() i=7 2024-06-04T16:11:39.755 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:39.753+0000 7fd2af132800 2 all 8 watchers are set, enabling cache 2024-06-04T16:11:39.757 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:39.755+0000 7fd1617e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-06-04T16:11:39.758 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:39.756+0000 7fd2af132800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-06-04T16:11:39.758 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:39.756+0000 7fd2af132800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-06-04T16:11:39.758 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:39.756+0000 7fd2af132800 5 note: GC not initialized 2024-06-04T16:11:39.758 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:39.756+0000 7fd0dbfff640 20 reqs_thread_entry: start 2024-06-04T16:11:39.758 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:39.756+0000 7fd2af132800 20 init_complete bucket index max shards: 11 2024-06-04T16:11:39.758 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:39.756+0000 7fd2af132800 20 Filter name: none 2024-06-04T16:11:39.758 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:39.756+0000 7fd0d9ffb640 20 reqs_thread_entry: start 2024-06-04T16:11:39.758 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:39.756+0000 7fd2af132800 20 rados->read ofs=0 len=0 2024-06-04T16:11:39.759 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:39.757+0000 7fd2af132800 20 rados_obj.operate() r=0 bl.length=194 2024-06-04T16:11:39.760 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:39.757+0000 7fd2af132800 20 rados->read ofs=0 len=0 2024-06-04T16:11:39.760 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:39.757+0000 7fd2af132800 20 rados_obj.operate() r=0 bl.length=408 2024-06-04T16:11:39.760 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:39.757+0000 7fd2af132800 20 couldn't put binfo cache entry, might have raced with data changes 2024-06-04T16:11:39.760 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:39.757+0000 7fd2af132800 20 rados->read ofs=0 len=0 2024-06-04T16:11:39.760 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:39.758+0000 7fd2af132800 20 rados_obj.operate() r=0 bl.length=194 2024-06-04T16:11:39.760 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:39.758+0000 7fd2af132800 20 rados->read ofs=0 len=0 2024-06-04T16:11:39.760 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:39.758+0000 7fd2af132800 20 rados_obj.operate() r=0 bl.length=408 2024-06-04T16:11:39.760 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:39.758+0000 7fd2af132800 20 couldn't put binfo cache entry, might have raced with data changes 2024-06-04T16:11:39.761 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:39.760+0000 7fd1617e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-06-04T16:11:39.763 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:39.762+0000 7fd2af132800 20 remove_watcher() i=0 2024-06-04T16:11:39.764 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:39.762+0000 7fd2af132800 2 removed watcher, disabling cache 2024-06-04T16:11:39.764 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:39.763+0000 7fd2af132800 20 remove_watcher() i=1 2024-06-04T16:11:39.766 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:39.764+0000 7fd2af132800 20 remove_watcher() i=2 2024-06-04T16:11:39.767 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:39.765+0000 7fd2af132800 20 remove_watcher() i=3 2024-06-04T16:11:39.768 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:39.766+0000 7fd2af132800 20 remove_watcher() i=4 2024-06-04T16:11:39.769 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:39.768+0000 7fd2af132800 20 remove_watcher() i=5 2024-06-04T16:11:39.770 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:39.769+0000 7fd2af132800 20 remove_watcher() i=6 2024-06-04T16:11:39.771 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:39.769+0000 7fd2af132800 20 remove_watcher() i=7 2024-06-04T16:11:39.782 INFO:tasks.workunit.client.0.smithi144.stderr: 2024-06-04T16:11:39.782 INFO:tasks.workunit.client.0.smithi144.stderr:BUCKET_STATS: 2024-06-04T16:11:39.782 INFO:tasks.workunit.client.0.smithi144.stderr:bucket: abort-at-set-target-layout id: be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.21 num_objects: 20 size_kb: 1 num_shards: 11 2024-06-04T16:11:39.782 INFO:tasks.workunit.client.0.smithi144.stderr: 2024-06-04T16:11:39.784 INFO:tasks.workunit.client.0.smithi144.stderr:radosgw-admin bucket reshard --bucket abort-at-set-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at set_target_layout 2024-06-04T16:11:39.817 INFO:tasks.workunit.client.0.smithi144.stderr:ignoring --setuser ceph since I am not root 2024-06-04T16:11:39.817 INFO:tasks.workunit.client.0.smithi144.stderr:ignoring --setgroup ceph since I am not root 2024-06-04T16:11:39.853 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:39.852+0000 7f99e8281800 20 rados->read ofs=0 len=0 2024-06-04T16:11:39.855 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:39.853+0000 7f99e8281800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:11:39.855 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:39.853+0000 7f99e8281800 20 realm 2024-06-04T16:11:39.855 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:39.853+0000 7f99e8281800 20 rados->read ofs=0 len=0 2024-06-04T16:11:39.855 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:39.853+0000 7f99e8281800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:11:39.855 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:39.853+0000 7f99e8281800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-06-04T16:11:39.855 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:39.853+0000 7f99e8281800 20 rados->read ofs=0 len=0 2024-06-04T16:11:39.855 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:39.853+0000 7f99e8281800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:11:39.855 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:39.853+0000 7f99e8281800 20 rados->read ofs=0 len=0 2024-06-04T16:11:39.856 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:39.854+0000 7f99e8281800 20 rados_obj.operate() r=0 bl.length=46 2024-06-04T16:11:39.856 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:39.854+0000 7f99e8281800 20 rados->read ofs=0 len=0 2024-06-04T16:11:39.856 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:39.855+0000 7f99e8281800 20 rados_obj.operate() r=0 bl.length=1139 2024-06-04T16:11:39.856 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:39.855+0000 7f99e8281800 20 searching for the correct realm 2024-06-04T16:11:39.858 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:39.856+0000 7f99e5d76640 0 -- 172.21.15.144:0/533550037 >> [v2:172.21.15.177:6824/800067290,v1:172.21.15.177:6825/800067290] conn(0x55fb8c9e96a0 msgr2=0x55fb8c9ebb10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-06-04T16:11:39.861 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:39.859+0000 7f99dd575640 0 -- 172.21.15.144:0/533550037 >> [v2:172.21.15.177:6808/2618477608,v1:172.21.15.177:6809/2618477608] conn(0x7f99d006e060 msgr2=0x7f99d009d1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-06-04T16:11:40.068 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:40.065+0000 7f99e8281800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-06-04T16:11:40.068 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:40.065+0000 7f99e8281800 20 RGWRados::pool_iterate: got zone_info.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767 2024-06-04T16:11:40.068 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:40.065+0000 7f99e8281800 20 RGWRados::pool_iterate: got default.zone. 2024-06-04T16:11:40.068 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:40.065+0000 7f99e8281800 20 RGWRados::pool_iterate: got zonegroup_info.abb22408-c332-4e28-8f7a-ff254ea2fed2 2024-06-04T16:11:40.069 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:40.065+0000 7f99e8281800 20 RGWRados::pool_iterate: got zone_names.default 2024-06-04T16:11:40.069 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:40.065+0000 7f99e8281800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-06-04T16:11:40.069 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:40.065+0000 7f99e8281800 20 rados->read ofs=0 len=0 2024-06-04T16:11:40.069 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:40.065+0000 7f99e8281800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:11:40.069 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:40.065+0000 7f99e8281800 20 rados->read ofs=0 len=0 2024-06-04T16:11:40.069 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:40.066+0000 7f99e8281800 20 rados_obj.operate() r=0 bl.length=46 2024-06-04T16:11:40.069 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:40.066+0000 7f99e8281800 20 rados->read ofs=0 len=0 2024-06-04T16:11:40.069 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:40.066+0000 7f99e8281800 20 rados_obj.operate() r=0 bl.length=470 2024-06-04T16:11:40.069 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:40.066+0000 7f99e8281800 20 zone default found 2024-06-04T16:11:40.069 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:40.066+0000 7f99e8281800 4 Realm: () 2024-06-04T16:11:40.069 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:40.066+0000 7f99e8281800 4 ZoneGroup: default (abb22408-c332-4e28-8f7a-ff254ea2fed2) 2024-06-04T16:11:40.069 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:40.066+0000 7f99e8281800 4 Zone: default (be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767) 2024-06-04T16:11:40.069 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:40.066+0000 7f99e8281800 10 cannot find current period zonegroup using local zonegroup configuration 2024-06-04T16:11:40.069 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:40.066+0000 7f99e8281800 20 zonegroup default 2024-06-04T16:11:40.070 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:40.066+0000 7f99e8281800 20 rados->read ofs=0 len=0 2024-06-04T16:11:40.070 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:40.066+0000 7f99e8281800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:11:40.070 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:40.066+0000 7f99e8281800 20 rados->read ofs=0 len=0 2024-06-04T16:11:40.070 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:40.067+0000 7f99e8281800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:11:40.070 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:40.067+0000 7f99e8281800 20 rados->read ofs=0 len=0 2024-06-04T16:11:40.071 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:40.067+0000 7f99e8281800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:11:40.071 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:40.067+0000 7f99e8281800 20 started sync module instance, tier type = 2024-06-04T16:11:40.071 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:40.067+0000 7f99e8281800 20 started zone id=be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767 (name=default) with tier type = 2024-06-04T16:11:40.077 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:40.076+0000 7f99e8281800 20 add_watcher() i=0 2024-06-04T16:11:40.078 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:40.076+0000 7f99e8281800 20 add_watcher() i=1 2024-06-04T16:11:40.078 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:40.076+0000 7f99e8281800 20 add_watcher() i=2 2024-06-04T16:11:40.078 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:40.076+0000 7f99e8281800 20 add_watcher() i=3 2024-06-04T16:11:40.078 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:40.076+0000 7f99e8281800 20 add_watcher() i=4 2024-06-04T16:11:40.078 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:40.076+0000 7f99e8281800 20 add_watcher() i=5 2024-06-04T16:11:40.078 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:40.076+0000 7f99e8281800 20 add_watcher() i=6 2024-06-04T16:11:40.078 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:40.077+0000 7f99e8281800 20 add_watcher() i=7 2024-06-04T16:11:40.079 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:40.077+0000 7f99e8281800 2 all 8 watchers are set, enabling cache 2024-06-04T16:11:40.080 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:40.078+0000 7f98977fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-06-04T16:11:40.081 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:40.079+0000 7f99e8281800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-06-04T16:11:40.081 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:40.079+0000 7f99e8281800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-06-04T16:11:40.081 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:40.079+0000 7f99e8281800 5 note: GC not initialized 2024-06-04T16:11:40.081 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:40.079+0000 7f98967fc640 20 reqs_thread_entry: start 2024-06-04T16:11:40.081 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:40.079+0000 7f99e8281800 20 init_complete bucket index max shards: 11 2024-06-04T16:11:40.081 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:40.079+0000 7f99e8281800 20 Filter name: none 2024-06-04T16:11:40.081 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:40.079+0000 7f9807fff640 20 reqs_thread_entry: start 2024-06-04T16:11:40.082 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:40.079+0000 7f99e8281800 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2024-06-04T16:11:40.082 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:40.079+0000 7f99e8281800 20 rados->read ofs=0 len=0 2024-06-04T16:11:40.082 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:40.080+0000 7f99e8281800 20 rados_obj.operate() r=0 bl.length=194 2024-06-04T16:11:40.082 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:40.080+0000 7f99e8281800 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2024-06-04T16:11:40.082 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:40.080+0000 7f99e8281800 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2024-06-04T16:11:40.083 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:40.080+0000 7f99e8281800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.21 : miss 2024-06-04T16:11:40.083 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:40.080+0000 7f99e8281800 20 rados->read ofs=0 len=0 2024-06-04T16:11:40.083 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:40.080+0000 7f99e8281800 20 rados_obj.operate() r=0 bl.length=408 2024-06-04T16:11:40.083 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:40.080+0000 7f99e8281800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.21 info.flags=0x17 2024-06-04T16:11:40.083 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:40.080+0000 7f99e8281800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.21 to cache LRU end 2024-06-04T16:11:40.083 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:40.080+0000 7f99e8281800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-06-04T16:11:40.083 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:40.080+0000 7f99e8281800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-06-04T16:11:40.083 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:40.080+0000 7f99e8281800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.21 2024-06-04T16:11:40.090 INFO:tasks.workunit.client.0.smithi144.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-4027-g65533a90/rpm/el9/BUILD/ceph-19.0.0-4027-g65533a90/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f99e8281800 time 2024-06-04T16:11:40.090689+0000 2024-06-04T16:11:40.090 INFO:tasks.workunit.client.0.smithi144.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-4027-g65533a90/rpm/el9/BUILD/ceph-19.0.0-4027-g65533a90/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-06-04T16:11:40.091 INFO:tasks.workunit.client.0.smithi144.stderr: ceph version 19.0.0-4027-g65533a90 (65533a907fc9add1863609703fdbbea67993c8ef) squid (dev) 2024-06-04T16:11:40.091 INFO:tasks.workunit.client.0.smithi144.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f99eb581dce] 2024-06-04T16:11:40.091 INFO:tasks.workunit.client.0.smithi144.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x181f8c) [0x7f99eb581f8c] 2024-06-04T16:11:40.091 INFO:tasks.workunit.client.0.smithi144.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55fb8b980fb1] 2024-06-04T16:11:40.091 INFO:tasks.workunit.client.0.smithi144.stderr: 4: radosgw-admin(+0x845a9a) [0x55fb8b987a9a] 2024-06-04T16:11:40.091 INFO:tasks.workunit.client.0.smithi144.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x267) [0x55fb8b98c2d7] 2024-06-04T16:11:40.092 INFO:tasks.workunit.client.0.smithi144.stderr: 6: main() 2024-06-04T16:11:40.092 INFO:tasks.workunit.client.0.smithi144.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f99ea429590] 2024-06-04T16:11:40.092 INFO:tasks.workunit.client.0.smithi144.stderr: 8: __libc_start_main() 2024-06-04T16:11:40.092 INFO:tasks.workunit.client.0.smithi144.stderr: 9: _start() 2024-06-04T16:11:40.092 INFO:tasks.workunit.client.0.smithi144.stderr:*** Caught signal (Aborted) ** 2024-06-04T16:11:40.092 INFO:tasks.workunit.client.0.smithi144.stderr: in thread 7f99e8281800 thread_name:radosgw-admin 2024-06-04T16:11:40.092 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:40.089+0000 7f99e8281800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-4027-g65533a90/rpm/el9/BUILD/ceph-19.0.0-4027-g65533a90/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f99e8281800 time 2024-06-04T16:11:40.090689+0000 2024-06-04T16:11:40.092 INFO:tasks.workunit.client.0.smithi144.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-4027-g65533a90/rpm/el9/BUILD/ceph-19.0.0-4027-g65533a90/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-06-04T16:11:40.092 INFO:tasks.workunit.client.0.smithi144.stderr: 2024-06-04T16:11:40.092 INFO:tasks.workunit.client.0.smithi144.stderr: ceph version 19.0.0-4027-g65533a90 (65533a907fc9add1863609703fdbbea67993c8ef) squid (dev) 2024-06-04T16:11:40.092 INFO:tasks.workunit.client.0.smithi144.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f99eb581dce] 2024-06-04T16:11:40.092 INFO:tasks.workunit.client.0.smithi144.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x181f8c) [0x7f99eb581f8c] 2024-06-04T16:11:40.092 INFO:tasks.workunit.client.0.smithi144.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55fb8b980fb1] 2024-06-04T16:11:40.093 INFO:tasks.workunit.client.0.smithi144.stderr: 4: radosgw-admin(+0x845a9a) [0x55fb8b987a9a] 2024-06-04T16:11:40.093 INFO:tasks.workunit.client.0.smithi144.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x267) [0x55fb8b98c2d7] 2024-06-04T16:11:40.093 INFO:tasks.workunit.client.0.smithi144.stderr: 6: main() 2024-06-04T16:11:40.093 INFO:tasks.workunit.client.0.smithi144.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f99ea429590] 2024-06-04T16:11:40.093 INFO:tasks.workunit.client.0.smithi144.stderr: 8: __libc_start_main() 2024-06-04T16:11:40.093 INFO:tasks.workunit.client.0.smithi144.stderr: 9: _start() 2024-06-04T16:11:40.093 INFO:tasks.workunit.client.0.smithi144.stderr: 2024-06-04T16:11:40.111 INFO:tasks.workunit.client.0.smithi144.stderr: ceph version 19.0.0-4027-g65533a90 (65533a907fc9add1863609703fdbbea67993c8ef) squid (dev) 2024-06-04T16:11:40.111 INFO:tasks.workunit.client.0.smithi144.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f99ea43e6f0] 2024-06-04T16:11:40.112 INFO:tasks.workunit.client.0.smithi144.stderr: 2: /lib64/libc.so.6(+0x8b94c) [0x7f99ea48b94c] 2024-06-04T16:11:40.112 INFO:tasks.workunit.client.0.smithi144.stderr: 3: raise() 2024-06-04T16:11:40.112 INFO:tasks.workunit.client.0.smithi144.stderr: 4: abort() 2024-06-04T16:11:40.112 INFO:tasks.workunit.client.0.smithi144.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f99eb581e28] 2024-06-04T16:11:40.112 INFO:tasks.workunit.client.0.smithi144.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x181f8c) [0x7f99eb581f8c] 2024-06-04T16:11:40.112 INFO:tasks.workunit.client.0.smithi144.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55fb8b980fb1] 2024-06-04T16:11:40.112 INFO:tasks.workunit.client.0.smithi144.stderr: 8: radosgw-admin(+0x845a9a) [0x55fb8b987a9a] 2024-06-04T16:11:40.112 INFO:tasks.workunit.client.0.smithi144.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x267) [0x55fb8b98c2d7] 2024-06-04T16:11:40.112 INFO:tasks.workunit.client.0.smithi144.stderr: 10: main() 2024-06-04T16:11:40.112 INFO:tasks.workunit.client.0.smithi144.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f99ea429590] 2024-06-04T16:11:40.112 INFO:tasks.workunit.client.0.smithi144.stderr: 12: __libc_start_main() 2024-06-04T16:11:40.112 INFO:tasks.workunit.client.0.smithi144.stderr: 13: _start() 2024-06-04T16:11:40.112 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:40.090+0000 7f99e8281800 -1 *** Caught signal (Aborted) ** 2024-06-04T16:11:40.112 INFO:tasks.workunit.client.0.smithi144.stderr: in thread 7f99e8281800 thread_name:radosgw-admin 2024-06-04T16:11:40.112 INFO:tasks.workunit.client.0.smithi144.stderr: 2024-06-04T16:11:40.113 INFO:tasks.workunit.client.0.smithi144.stderr: ceph version 19.0.0-4027-g65533a90 (65533a907fc9add1863609703fdbbea67993c8ef) squid (dev) 2024-06-04T16:11:40.113 INFO:tasks.workunit.client.0.smithi144.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f99ea43e6f0] 2024-06-04T16:11:40.113 INFO:tasks.workunit.client.0.smithi144.stderr: 2: /lib64/libc.so.6(+0x8b94c) [0x7f99ea48b94c] 2024-06-04T16:11:40.113 INFO:tasks.workunit.client.0.smithi144.stderr: 3: raise() 2024-06-04T16:11:40.113 INFO:tasks.workunit.client.0.smithi144.stderr: 4: abort() 2024-06-04T16:11:40.113 INFO:tasks.workunit.client.0.smithi144.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f99eb581e28] 2024-06-04T16:11:40.113 INFO:tasks.workunit.client.0.smithi144.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x181f8c) [0x7f99eb581f8c] 2024-06-04T16:11:40.113 INFO:tasks.workunit.client.0.smithi144.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55fb8b980fb1] 2024-06-04T16:11:40.113 INFO:tasks.workunit.client.0.smithi144.stderr: 8: radosgw-admin(+0x845a9a) [0x55fb8b987a9a] 2024-06-04T16:11:40.113 INFO:tasks.workunit.client.0.smithi144.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x267) [0x55fb8b98c2d7] 2024-06-04T16:11:40.113 INFO:tasks.workunit.client.0.smithi144.stderr: 10: main() 2024-06-04T16:11:40.113 INFO:tasks.workunit.client.0.smithi144.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f99ea429590] 2024-06-04T16:11:40.113 INFO:tasks.workunit.client.0.smithi144.stderr: 12: __libc_start_main() 2024-06-04T16:11:40.113 INFO:tasks.workunit.client.0.smithi144.stderr: 13: _start() 2024-06-04T16:11:40.113 INFO:tasks.workunit.client.0.smithi144.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-06-04T16:11:40.114 INFO:tasks.workunit.client.0.smithi144.stderr: 2024-06-04T16:11:40.114 INFO:tasks.workunit.client.0.smithi144.stderr:--- begin dump of recent events --- 2024-06-04T16:11:40.114 INFO:tasks.workunit.client.0.smithi144.stderr: -499> 2024-06-04T16:11:39.835+0000 7f98d3e07640 10 monclient: _check_auth_tickets 2024-06-04T16:11:40.114 INFO:tasks.workunit.client.0.smithi144.stderr: -498> 2024-06-04T16:11:39.835+0000 7f98d3e07640 10 monclient: handle_config config(0 keys) 2024-06-04T16:11:40.114 INFO:tasks.workunit.client.0.smithi144.stderr: -497> 2024-06-04T16:11:39.835+0000 7f99e8281800 5 monclient: authenticate success, global_id 5957 2024-06-04T16:11:40.114 INFO:tasks.workunit.client.0.smithi144.stderr: -496> 2024-06-04T16:11:39.835+0000 7f99e8281800 10 monclient: get_monmap_and_config success 2024-06-04T16:11:40.114 INFO:tasks.workunit.client.0.smithi144.stderr: -495> 2024-06-04T16:11:39.835+0000 7f99e8281800 4 set_mon_vals no callback set 2024-06-04T16:11:40.114 INFO:tasks.workunit.client.0.smithi144.stderr: -494> 2024-06-04T16:11:39.835+0000 7f98d3e07640 10 monclient: handle_monmap mon_map magic: 0 2024-06-04T16:11:40.114 INFO:tasks.workunit.client.0.smithi144.stderr: -493> 2024-06-04T16:11:39.835+0000 7f98d3e07640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-06-04T16:11:40.114 INFO:tasks.workunit.client.0.smithi144.stderr: -492> 2024-06-04T16:11:39.835+0000 7f98d3e07640 10 monclient: dump: 2024-06-04T16:11:40.114 INFO:tasks.workunit.client.0.smithi144.stderr:epoch 1 2024-06-04T16:11:40.114 INFO:tasks.workunit.client.0.smithi144.stderr:fsid 15e56bb1-4856-42f3-b6db-a2c8f23c5557 2024-06-04T16:11:40.114 INFO:tasks.workunit.client.0.smithi144.stderr:last_changed 2024-06-04T15:51:29.789359+0000 2024-06-04T16:11:40.114 INFO:tasks.workunit.client.0.smithi144.stderr:created 2024-06-04T15:51:29.789359+0000 2024-06-04T16:11:40.115 INFO:tasks.workunit.client.0.smithi144.stderr:min_mon_release 19 (squid) 2024-06-04T16:11:40.115 INFO:tasks.workunit.client.0.smithi144.stderr:election_strategy: 1 2024-06-04T16:11:40.115 INFO:tasks.workunit.client.0.smithi144.stderr:0: [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] mon.a 2024-06-04T16:11:40.115 INFO:tasks.workunit.client.0.smithi144.stderr:1: [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] mon.b 2024-06-04T16:11:40.115 INFO:tasks.workunit.client.0.smithi144.stderr:2: [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] mon.c 2024-06-04T16:11:40.115 INFO:tasks.workunit.client.0.smithi144.stderr: 2024-06-04T16:11:40.115 INFO:tasks.workunit.client.0.smithi144.stderr: -491> 2024-06-04T16:11:39.835+0000 7f99e8281800 10 monclient: shutdown 2024-06-04T16:11:40.115 INFO:tasks.workunit.client.0.smithi144.stderr: -490> 2024-06-04T16:11:39.835+0000 7f99e8281800 5 asok(0x55fb8c6dbc60) unregister_commands rotate-key 2024-06-04T16:11:40.115 INFO:tasks.workunit.client.0.smithi144.stderr: -489> 2024-06-04T16:11:39.836+0000 7f99e8281800 10 monclient: build_initial_monmap 2024-06-04T16:11:40.115 INFO:tasks.workunit.client.0.smithi144.stderr: -488> 2024-06-04T16:11:39.836+0000 7f99e8281800 1 build_initial for_mkfs: 0 2024-06-04T16:11:40.115 INFO:tasks.workunit.client.0.smithi144.stderr: -487> 2024-06-04T16:11:39.836+0000 7f99e8281800 10 monclient: monmap: 2024-06-04T16:11:40.115 INFO:tasks.workunit.client.0.smithi144.stderr:epoch 0 2024-06-04T16:11:40.115 INFO:tasks.workunit.client.0.smithi144.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-06-04T16:11:40.115 INFO:tasks.workunit.client.0.smithi144.stderr:last_changed 0.000000 2024-06-04T16:11:40.115 INFO:tasks.workunit.client.0.smithi144.stderr:created 0.000000 2024-06-04T16:11:40.116 INFO:tasks.workunit.client.0.smithi144.stderr:min_mon_release 0 (unknown) 2024-06-04T16:11:40.116 INFO:tasks.workunit.client.0.smithi144.stderr:election_strategy: 1 2024-06-04T16:11:40.116 INFO:tasks.workunit.client.0.smithi144.stderr:0: [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] mon.noname-a 2024-06-04T16:11:40.116 INFO:tasks.workunit.client.0.smithi144.stderr:1: [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] mon.noname-b 2024-06-04T16:11:40.116 INFO:tasks.workunit.client.0.smithi144.stderr:2: [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] mon.noname-c 2024-06-04T16:11:40.116 INFO:tasks.workunit.client.0.smithi144.stderr: 2024-06-04T16:11:40.116 INFO:tasks.workunit.client.0.smithi144.stderr: -486> 2024-06-04T16:11:39.836+0000 7f99e8281800 5 AuthRegistry(0x55fb8c8ff8b0) adding auth protocol: cephx 2024-06-04T16:11:40.116 INFO:tasks.workunit.client.0.smithi144.stderr: -485> 2024-06-04T16:11:39.836+0000 7f99e8281800 5 AuthRegistry(0x55fb8c8ff8b0) adding auth protocol: cephx 2024-06-04T16:11:40.116 INFO:tasks.workunit.client.0.smithi144.stderr: -484> 2024-06-04T16:11:39.836+0000 7f99e8281800 5 AuthRegistry(0x55fb8c8ff8b0) adding auth protocol: cephx 2024-06-04T16:11:40.116 INFO:tasks.workunit.client.0.smithi144.stderr: -483> 2024-06-04T16:11:39.836+0000 7f99e8281800 5 AuthRegistry(0x55fb8c8ff8b0) adding con mode: secure 2024-06-04T16:11:40.116 INFO:tasks.workunit.client.0.smithi144.stderr: -482> 2024-06-04T16:11:39.836+0000 7f99e8281800 5 AuthRegistry(0x55fb8c8ff8b0) adding con mode: crc 2024-06-04T16:11:40.116 INFO:tasks.workunit.client.0.smithi144.stderr: -481> 2024-06-04T16:11:39.836+0000 7f99e8281800 5 AuthRegistry(0x55fb8c8ff8b0) adding con mode: secure 2024-06-04T16:11:40.116 INFO:tasks.workunit.client.0.smithi144.stderr: -480> 2024-06-04T16:11:39.836+0000 7f99e8281800 5 AuthRegistry(0x55fb8c8ff8b0) adding con mode: crc 2024-06-04T16:11:40.116 INFO:tasks.workunit.client.0.smithi144.stderr: -479> 2024-06-04T16:11:39.836+0000 7f99e8281800 5 AuthRegistry(0x55fb8c8ff8b0) adding con mode: secure 2024-06-04T16:11:40.116 INFO:tasks.workunit.client.0.smithi144.stderr: -478> 2024-06-04T16:11:39.836+0000 7f99e8281800 5 AuthRegistry(0x55fb8c8ff8b0) adding con mode: crc 2024-06-04T16:11:40.116 INFO:tasks.workunit.client.0.smithi144.stderr: -477> 2024-06-04T16:11:39.836+0000 7f99e8281800 5 AuthRegistry(0x55fb8c8ff8b0) adding con mode: crc 2024-06-04T16:11:40.116 INFO:tasks.workunit.client.0.smithi144.stderr: -476> 2024-06-04T16:11:39.836+0000 7f99e8281800 5 AuthRegistry(0x55fb8c8ff8b0) adding con mode: secure 2024-06-04T16:11:40.117 INFO:tasks.workunit.client.0.smithi144.stderr: -475> 2024-06-04T16:11:39.836+0000 7f99e8281800 5 AuthRegistry(0x55fb8c8ff8b0) adding con mode: crc 2024-06-04T16:11:40.117 INFO:tasks.workunit.client.0.smithi144.stderr: -474> 2024-06-04T16:11:39.836+0000 7f99e8281800 5 AuthRegistry(0x55fb8c8ff8b0) adding con mode: secure 2024-06-04T16:11:40.117 INFO:tasks.workunit.client.0.smithi144.stderr: -473> 2024-06-04T16:11:39.836+0000 7f99e8281800 5 AuthRegistry(0x55fb8c8ff8b0) adding con mode: crc 2024-06-04T16:11:40.117 INFO:tasks.workunit.client.0.smithi144.stderr: -472> 2024-06-04T16:11:39.836+0000 7f99e8281800 5 AuthRegistry(0x55fb8c8ff8b0) adding con mode: secure 2024-06-04T16:11:40.117 INFO:tasks.workunit.client.0.smithi144.stderr: -471> 2024-06-04T16:11:39.836+0000 7f99e8281800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-06-04T16:11:40.117 INFO:tasks.workunit.client.0.smithi144.stderr: -470> 2024-06-04T16:11:39.836+0000 7f99e8281800 1 librados: starting msgr at 2024-06-04T16:11:40.117 INFO:tasks.workunit.client.0.smithi144.stderr: -469> 2024-06-04T16:11:39.836+0000 7f99e8281800 1 librados: starting objecter 2024-06-04T16:11:40.117 INFO:tasks.workunit.client.0.smithi144.stderr: -468> 2024-06-04T16:11:39.836+0000 7f99e8281800 5 asok(0x55fb8c6dbc60) register_command objecter_requests hook 0x55fb8c901c50 2024-06-04T16:11:40.117 INFO:tasks.workunit.client.0.smithi144.stderr: -467> 2024-06-04T16:11:39.836+0000 7f99e8281800 1 librados: setting wanted keys 2024-06-04T16:11:40.117 INFO:tasks.workunit.client.0.smithi144.stderr: -466> 2024-06-04T16:11:39.836+0000 7f99e8281800 1 librados: calling monclient init 2024-06-04T16:11:40.117 INFO:tasks.workunit.client.0.smithi144.stderr: -465> 2024-06-04T16:11:39.836+0000 7f99e8281800 10 monclient: init 2024-06-04T16:11:40.117 INFO:tasks.workunit.client.0.smithi144.stderr: -464> 2024-06-04T16:11:39.836+0000 7f99e8281800 5 AuthRegistry(0x55fb8c8fc950) adding auth protocol: cephx 2024-06-04T16:11:40.117 INFO:tasks.workunit.client.0.smithi144.stderr: -463> 2024-06-04T16:11:39.836+0000 7f99e8281800 5 AuthRegistry(0x55fb8c8fc950) adding auth protocol: cephx 2024-06-04T16:11:40.117 INFO:tasks.workunit.client.0.smithi144.stderr: -462> 2024-06-04T16:11:39.836+0000 7f99e8281800 5 AuthRegistry(0x55fb8c8fc950) adding auth protocol: cephx 2024-06-04T16:11:40.117 INFO:tasks.workunit.client.0.smithi144.stderr: -461> 2024-06-04T16:11:39.836+0000 7f99e8281800 5 AuthRegistry(0x55fb8c8fc950) adding con mode: secure 2024-06-04T16:11:40.118 INFO:tasks.workunit.client.0.smithi144.stderr: -460> 2024-06-04T16:11:39.836+0000 7f99e8281800 5 AuthRegistry(0x55fb8c8fc950) adding con mode: crc 2024-06-04T16:11:40.118 INFO:tasks.workunit.client.0.smithi144.stderr: -459> 2024-06-04T16:11:39.836+0000 7f99e8281800 5 AuthRegistry(0x55fb8c8fc950) adding con mode: secure 2024-06-04T16:11:40.118 INFO:tasks.workunit.client.0.smithi144.stderr: -458> 2024-06-04T16:11:39.836+0000 7f99e8281800 5 AuthRegistry(0x55fb8c8fc950) adding con mode: crc 2024-06-04T16:11:40.118 INFO:tasks.workunit.client.0.smithi144.stderr: -457> 2024-06-04T16:11:39.836+0000 7f99e8281800 5 AuthRegistry(0x55fb8c8fc950) adding con mode: secure 2024-06-04T16:11:40.118 INFO:tasks.workunit.client.0.smithi144.stderr: -456> 2024-06-04T16:11:39.836+0000 7f99e8281800 5 AuthRegistry(0x55fb8c8fc950) adding con mode: crc 2024-06-04T16:11:40.118 INFO:tasks.workunit.client.0.smithi144.stderr: -455> 2024-06-04T16:11:39.836+0000 7f99e8281800 5 AuthRegistry(0x55fb8c8fc950) adding con mode: crc 2024-06-04T16:11:40.118 INFO:tasks.workunit.client.0.smithi144.stderr: -454> 2024-06-04T16:11:39.836+0000 7f99e8281800 5 AuthRegistry(0x55fb8c8fc950) adding con mode: secure 2024-06-04T16:11:40.118 INFO:tasks.workunit.client.0.smithi144.stderr: -453> 2024-06-04T16:11:39.836+0000 7f99e8281800 5 AuthRegistry(0x55fb8c8fc950) adding con mode: crc 2024-06-04T16:11:40.118 INFO:tasks.workunit.client.0.smithi144.stderr: -452> 2024-06-04T16:11:39.836+0000 7f99e8281800 5 AuthRegistry(0x55fb8c8fc950) adding con mode: secure 2024-06-04T16:11:40.118 INFO:tasks.workunit.client.0.smithi144.stderr: -451> 2024-06-04T16:11:39.836+0000 7f99e8281800 5 AuthRegistry(0x55fb8c8fc950) adding con mode: crc 2024-06-04T16:11:40.118 INFO:tasks.workunit.client.0.smithi144.stderr: -450> 2024-06-04T16:11:39.836+0000 7f99e8281800 5 AuthRegistry(0x55fb8c8fc950) adding con mode: secure 2024-06-04T16:11:40.118 INFO:tasks.workunit.client.0.smithi144.stderr: -449> 2024-06-04T16:11:39.836+0000 7f99e8281800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-06-04T16:11:40.118 INFO:tasks.workunit.client.0.smithi144.stderr: -448> 2024-06-04T16:11:39.837+0000 7f99e8281800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-06-04T16:11:40.119 INFO:tasks.workunit.client.0.smithi144.stderr: -447> 2024-06-04T16:11:39.837+0000 7f99e8281800 5 asok(0x55fb8c6dbc60) register_command rotate-key hook 0x55fb8c8fca98 2024-06-04T16:11:40.119 INFO:tasks.workunit.client.0.smithi144.stderr: -446> 2024-06-04T16:11:39.837+0000 7f99e8281800 10 monclient: _reopen_session rank -1 2024-06-04T16:11:40.119 INFO:tasks.workunit.client.0.smithi144.stderr: -445> 2024-06-04T16:11:39.837+0000 7f99e8281800 10 monclient: _add_conns ranks=[1,0,2] 2024-06-04T16:11:40.119 INFO:tasks.workunit.client.0.smithi144.stderr: -444> 2024-06-04T16:11:39.837+0000 7f99e8281800 10 monclient(hunting): picked mon.noname-b con 0x55fb8c7b31b0 addr [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] 2024-06-04T16:11:40.119 INFO:tasks.workunit.client.0.smithi144.stderr: -443> 2024-06-04T16:11:39.837+0000 7f99e8281800 10 monclient(hunting): picked mon.noname-a con 0x55fb8c83de80 addr [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] 2024-06-04T16:11:40.119 INFO:tasks.workunit.client.0.smithi144.stderr: -442> 2024-06-04T16:11:39.837+0000 7f99e8281800 10 monclient(hunting): picked mon.noname-c con 0x55fb8c844990 addr [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] 2024-06-04T16:11:40.119 INFO:tasks.workunit.client.0.smithi144.stderr: -441> 2024-06-04T16:11:39.837+0000 7f99e8281800 10 monclient(hunting): start opening mon connection 2024-06-04T16:11:40.119 INFO:tasks.workunit.client.0.smithi144.stderr: -440> 2024-06-04T16:11:39.837+0000 7f99e8281800 10 monclient(hunting): start opening mon connection 2024-06-04T16:11:40.119 INFO:tasks.workunit.client.0.smithi144.stderr: -439> 2024-06-04T16:11:39.837+0000 7f99e8281800 10 monclient(hunting): start opening mon connection 2024-06-04T16:11:40.119 INFO:tasks.workunit.client.0.smithi144.stderr: -438> 2024-06-04T16:11:39.837+0000 7f99e8281800 10 monclient(hunting): _renew_subs 2024-06-04T16:11:40.119 INFO:tasks.workunit.client.0.smithi144.stderr: -437> 2024-06-04T16:11:39.837+0000 7f99e8281800 10 monclient(hunting): authenticate will time out at 1937.654253s 2024-06-04T16:11:40.119 INFO:tasks.workunit.client.0.smithi144.stderr: -436> 2024-06-04T16:11:39.837+0000 7f99dd575640 10 monclient(hunting): get_auth_request con 0x55fb8c83de80 auth_method 0 2024-06-04T16:11:40.119 INFO:tasks.workunit.client.0.smithi144.stderr: -435> 2024-06-04T16:11:39.837+0000 7f99dd575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-06-04T16:11:40.119 INFO:tasks.workunit.client.0.smithi144.stderr: -434> 2024-06-04T16:11:39.837+0000 7f99dd575640 10 monclient(hunting): _init_auth method 2 2024-06-04T16:11:40.119 INFO:tasks.workunit.client.0.smithi144.stderr: -433> 2024-06-04T16:11:39.837+0000 7f99dd575640 10 monclient(hunting): _init_auth creating new auth 2024-06-04T16:11:40.120 INFO:tasks.workunit.client.0.smithi144.stderr: -432> 2024-06-04T16:11:39.837+0000 7f99e6577640 10 monclient(hunting): get_auth_request con 0x55fb8c844990 auth_method 0 2024-06-04T16:11:40.120 INFO:tasks.workunit.client.0.smithi144.stderr: -431> 2024-06-04T16:11:39.837+0000 7f99e6577640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-06-04T16:11:40.120 INFO:tasks.workunit.client.0.smithi144.stderr: -430> 2024-06-04T16:11:39.837+0000 7f99e6577640 10 monclient(hunting): _init_auth method 2 2024-06-04T16:11:40.120 INFO:tasks.workunit.client.0.smithi144.stderr: -429> 2024-06-04T16:11:39.837+0000 7f99e6577640 10 monclient(hunting): _init_auth creating new auth 2024-06-04T16:11:40.120 INFO:tasks.workunit.client.0.smithi144.stderr: -428> 2024-06-04T16:11:39.837+0000 7f99dd575640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-06-04T16:11:40.120 INFO:tasks.workunit.client.0.smithi144.stderr: -427> 2024-06-04T16:11:39.837+0000 7f99dd575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-06-04T16:11:40.120 INFO:tasks.workunit.client.0.smithi144.stderr: -426> 2024-06-04T16:11:39.837+0000 7f99dd575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-06-04T16:11:40.120 INFO:tasks.workunit.client.0.smithi144.stderr: -425> 2024-06-04T16:11:39.837+0000 7f99e6577640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-06-04T16:11:40.120 INFO:tasks.workunit.client.0.smithi144.stderr: -424> 2024-06-04T16:11:39.837+0000 7f99e6577640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-06-04T16:11:40.120 INFO:tasks.workunit.client.0.smithi144.stderr: -423> 2024-06-04T16:11:39.837+0000 7f99e6577640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-06-04T16:11:40.120 INFO:tasks.workunit.client.0.smithi144.stderr: -422> 2024-06-04T16:11:39.837+0000 7f99e5d76640 10 monclient(hunting): get_auth_request con 0x55fb8c7b31b0 auth_method 0 2024-06-04T16:11:40.120 INFO:tasks.workunit.client.0.smithi144.stderr: -421> 2024-06-04T16:11:39.837+0000 7f99e5d76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-06-04T16:11:40.120 INFO:tasks.workunit.client.0.smithi144.stderr: -420> 2024-06-04T16:11:39.837+0000 7f99e5d76640 10 monclient(hunting): _init_auth method 2 2024-06-04T16:11:40.120 INFO:tasks.workunit.client.0.smithi144.stderr: -419> 2024-06-04T16:11:39.837+0000 7f99e5d76640 10 monclient(hunting): _init_auth creating new auth 2024-06-04T16:11:40.120 INFO:tasks.workunit.client.0.smithi144.stderr: -418> 2024-06-04T16:11:39.837+0000 7f99e5d76640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-06-04T16:11:40.120 INFO:tasks.workunit.client.0.smithi144.stderr: -417> 2024-06-04T16:11:39.837+0000 7f99e5d76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-06-04T16:11:40.121 INFO:tasks.workunit.client.0.smithi144.stderr: -416> 2024-06-04T16:11:39.837+0000 7f99e5d76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-06-04T16:11:40.121 INFO:tasks.workunit.client.0.smithi144.stderr: -415> 2024-06-04T16:11:39.837+0000 7f99dd575640 10 monclient(hunting): handle_auth_done global_id 6279 payload 824 2024-06-04T16:11:40.121 INFO:tasks.workunit.client.0.smithi144.stderr: -414> 2024-06-04T16:11:39.837+0000 7f99dd575640 10 monclient: _finish_hunting 0 2024-06-04T16:11:40.121 INFO:tasks.workunit.client.0.smithi144.stderr: -413> 2024-06-04T16:11:39.837+0000 7f99dd575640 1 monclient: found mon.noname-a 2024-06-04T16:11:40.121 INFO:tasks.workunit.client.0.smithi144.stderr: -412> 2024-06-04T16:11:39.837+0000 7f99dd575640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.144:3300/0 2024-06-04T16:11:40.121 INFO:tasks.workunit.client.0.smithi144.stderr: -411> 2024-06-04T16:11:39.837+0000 7f98d2604640 10 monclient: handle_monmap mon_map magic: 0 2024-06-04T16:11:40.121 INFO:tasks.workunit.client.0.smithi144.stderr: -410> 2024-06-04T16:11:39.837+0000 7f98d2604640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-06-04T16:11:40.121 INFO:tasks.workunit.client.0.smithi144.stderr: -409> 2024-06-04T16:11:39.837+0000 7f98d2604640 10 monclient: dump: 2024-06-04T16:11:40.121 INFO:tasks.workunit.client.0.smithi144.stderr:epoch 1 2024-06-04T16:11:40.121 INFO:tasks.workunit.client.0.smithi144.stderr:fsid 15e56bb1-4856-42f3-b6db-a2c8f23c5557 2024-06-04T16:11:40.121 INFO:tasks.workunit.client.0.smithi144.stderr:last_changed 2024-06-04T15:51:29.789359+0000 2024-06-04T16:11:40.121 INFO:tasks.workunit.client.0.smithi144.stderr:created 2024-06-04T15:51:29.789359+0000 2024-06-04T16:11:40.121 INFO:tasks.workunit.client.0.smithi144.stderr:min_mon_release 19 (squid) 2024-06-04T16:11:40.121 INFO:tasks.workunit.client.0.smithi144.stderr:election_strategy: 1 2024-06-04T16:11:40.121 INFO:tasks.workunit.client.0.smithi144.stderr:0: [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] mon.a 2024-06-04T16:11:40.122 INFO:tasks.workunit.client.0.smithi144.stderr:1: [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] mon.b 2024-06-04T16:11:40.122 INFO:tasks.workunit.client.0.smithi144.stderr:2: [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] mon.c 2024-06-04T16:11:40.122 INFO:tasks.workunit.client.0.smithi144.stderr: 2024-06-04T16:11:40.122 INFO:tasks.workunit.client.0.smithi144.stderr: -408> 2024-06-04T16:11:39.837+0000 7f98d2604640 10 monclient: _finish_auth 0 2024-06-04T16:11:40.122 INFO:tasks.workunit.client.0.smithi144.stderr: -407> 2024-06-04T16:11:39.837+0000 7f98d2604640 10 monclient: _check_auth_tickets 2024-06-04T16:11:40.122 INFO:tasks.workunit.client.0.smithi144.stderr: -406> 2024-06-04T16:11:39.837+0000 7f98d2604640 10 monclient: handle_config config(0 keys) 2024-06-04T16:11:40.122 INFO:tasks.workunit.client.0.smithi144.stderr: -405> 2024-06-04T16:11:39.837+0000 7f98d2604640 10 monclient: handle_monmap mon_map magic: 0 2024-06-04T16:11:40.122 INFO:tasks.workunit.client.0.smithi144.stderr: -404> 2024-06-04T16:11:39.837+0000 7f98d2604640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-06-04T16:11:40.122 INFO:tasks.workunit.client.0.smithi144.stderr: -403> 2024-06-04T16:11:39.837+0000 7f98d2604640 10 monclient: dump: 2024-06-04T16:11:40.122 INFO:tasks.workunit.client.0.smithi144.stderr:epoch 1 2024-06-04T16:11:40.122 INFO:tasks.workunit.client.0.smithi144.stderr:fsid 15e56bb1-4856-42f3-b6db-a2c8f23c5557 2024-06-04T16:11:40.122 INFO:tasks.workunit.client.0.smithi144.stderr:last_changed 2024-06-04T15:51:29.789359+0000 2024-06-04T16:11:40.122 INFO:tasks.workunit.client.0.smithi144.stderr:created 2024-06-04T15:51:29.789359+0000 2024-06-04T16:11:40.122 INFO:tasks.workunit.client.0.smithi144.stderr:min_mon_release 19 (squid) 2024-06-04T16:11:40.122 INFO:tasks.workunit.client.0.smithi144.stderr:election_strategy: 1 2024-06-04T16:11:40.123 INFO:tasks.workunit.client.0.smithi144.stderr:0: [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] mon.a 2024-06-04T16:11:40.123 INFO:tasks.workunit.client.0.smithi144.stderr:1: [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] mon.b 2024-06-04T16:11:40.123 INFO:tasks.workunit.client.0.smithi144.stderr:2: [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] mon.c 2024-06-04T16:11:40.123 INFO:tasks.workunit.client.0.smithi144.stderr: 2024-06-04T16:11:40.123 INFO:tasks.workunit.client.0.smithi144.stderr: -402> 2024-06-04T16:11:39.837+0000 7f99e8281800 5 monclient: authenticate success, global_id 6279 2024-06-04T16:11:40.123 INFO:tasks.workunit.client.0.smithi144.stderr: -401> 2024-06-04T16:11:39.837+0000 7f99e8281800 10 monclient: _renew_subs 2024-06-04T16:11:40.123 INFO:tasks.workunit.client.0.smithi144.stderr: -400> 2024-06-04T16:11:39.837+0000 7f98d3e07640 4 set_mon_vals no callback set 2024-06-04T16:11:40.123 INFO:tasks.workunit.client.0.smithi144.stderr: -399> 2024-06-04T16:11:39.837+0000 7f99e8281800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.144:3300/0 2024-06-04T16:11:40.123 INFO:tasks.workunit.client.0.smithi144.stderr: -398> 2024-06-04T16:11:39.837+0000 7f99e8281800 10 monclient: _renew_subs 2024-06-04T16:11:40.123 INFO:tasks.workunit.client.0.smithi144.stderr: -397> 2024-06-04T16:11:39.837+0000 7f99e8281800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.144:3300/0 2024-06-04T16:11:40.123 INFO:tasks.workunit.client.0.smithi144.stderr: -396> 2024-06-04T16:11:39.837+0000 7f99e8281800 1 librados: init done 2024-06-04T16:11:40.123 INFO:tasks.workunit.client.0.smithi144.stderr: -395> 2024-06-04T16:11:39.839+0000 7f98d2604640 4 mgrc handle_mgr_map Got map version 5 2024-06-04T16:11:40.123 INFO:tasks.workunit.client.0.smithi144.stderr: -394> 2024-06-04T16:11:39.839+0000 7f98d2604640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.177:6832/2645786330,v1:172.21.15.177:6833/2645786330] 2024-06-04T16:11:40.123 INFO:tasks.workunit.client.0.smithi144.stderr: -393> 2024-06-04T16:11:39.839+0000 7f98d2604640 4 mgrc reconnect Starting new session with [v2:172.21.15.177:6832/2645786330,v1:172.21.15.177:6833/2645786330] 2024-06-04T16:11:40.123 INFO:tasks.workunit.client.0.smithi144.stderr: -392> 2024-06-04T16:11:39.839+0000 7f99e5d76640 10 monclient: get_auth_request con 0x7f98cc074cb0 auth_method 0 2024-06-04T16:11:40.123 INFO:tasks.workunit.client.0.smithi144.stderr: -391> 2024-06-04T16:11:39.840+0000 7f99e6577640 10 monclient: get_auth_request con 0x55fb8c944fd0 auth_method 0 2024-06-04T16:11:40.124 INFO:tasks.workunit.client.0.smithi144.stderr: -390> 2024-06-04T16:11:39.840+0000 7f99e5d76640 10 monclient: get_auth_request con 0x55fb8c9481b0 auth_method 0 2024-06-04T16:11:40.124 INFO:tasks.workunit.client.0.smithi144.stderr: -389> 2024-06-04T16:11:39.841+0000 7f99dd575640 10 monclient: get_auth_request con 0x55fb8c94c3a0 auth_method 0 2024-06-04T16:11:40.124 INFO:tasks.workunit.client.0.smithi144.stderr: -388> 2024-06-04T16:11:39.842+0000 7f99e6577640 10 monclient: get_auth_request con 0x55fb8c950080 auth_method 0 2024-06-04T16:11:40.124 INFO:tasks.workunit.client.0.smithi144.stderr: -387> 2024-06-04T16:11:39.843+0000 7f99e8281800 10 monclient: build_initial_monmap 2024-06-04T16:11:40.124 INFO:tasks.workunit.client.0.smithi144.stderr: -386> 2024-06-04T16:11:39.843+0000 7f99e8281800 1 build_initial for_mkfs: 0 2024-06-04T16:11:40.124 INFO:tasks.workunit.client.0.smithi144.stderr: -385> 2024-06-04T16:11:39.843+0000 7f99e8281800 10 monclient: monmap: 2024-06-04T16:11:40.124 INFO:tasks.workunit.client.0.smithi144.stderr:epoch 0 2024-06-04T16:11:40.124 INFO:tasks.workunit.client.0.smithi144.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-06-04T16:11:40.124 INFO:tasks.workunit.client.0.smithi144.stderr:last_changed 0.000000 2024-06-04T16:11:40.124 INFO:tasks.workunit.client.0.smithi144.stderr:created 0.000000 2024-06-04T16:11:40.124 INFO:tasks.workunit.client.0.smithi144.stderr:min_mon_release 0 (unknown) 2024-06-04T16:11:40.124 INFO:tasks.workunit.client.0.smithi144.stderr:election_strategy: 1 2024-06-04T16:11:40.124 INFO:tasks.workunit.client.0.smithi144.stderr:0: [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] mon.noname-a 2024-06-04T16:11:40.124 INFO:tasks.workunit.client.0.smithi144.stderr:1: [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] mon.noname-b 2024-06-04T16:11:40.125 INFO:tasks.workunit.client.0.smithi144.stderr:2: [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] mon.noname-c 2024-06-04T16:11:40.125 INFO:tasks.workunit.client.0.smithi144.stderr: 2024-06-04T16:11:40.125 INFO:tasks.workunit.client.0.smithi144.stderr: -384> 2024-06-04T16:11:39.843+0000 7f99e8281800 5 AuthRegistry(0x55fb8c954130) adding auth protocol: cephx 2024-06-04T16:11:40.125 INFO:tasks.workunit.client.0.smithi144.stderr: -383> 2024-06-04T16:11:39.843+0000 7f99e8281800 5 AuthRegistry(0x55fb8c954130) adding auth protocol: cephx 2024-06-04T16:11:40.125 INFO:tasks.workunit.client.0.smithi144.stderr: -382> 2024-06-04T16:11:39.843+0000 7f99e8281800 5 AuthRegistry(0x55fb8c954130) adding auth protocol: cephx 2024-06-04T16:11:40.125 INFO:tasks.workunit.client.0.smithi144.stderr: -381> 2024-06-04T16:11:39.843+0000 7f99e8281800 5 AuthRegistry(0x55fb8c954130) adding con mode: secure 2024-06-04T16:11:40.125 INFO:tasks.workunit.client.0.smithi144.stderr: -380> 2024-06-04T16:11:39.843+0000 7f99e8281800 5 AuthRegistry(0x55fb8c954130) adding con mode: crc 2024-06-04T16:11:40.125 INFO:tasks.workunit.client.0.smithi144.stderr: -379> 2024-06-04T16:11:39.843+0000 7f99e8281800 5 AuthRegistry(0x55fb8c954130) adding con mode: secure 2024-06-04T16:11:40.125 INFO:tasks.workunit.client.0.smithi144.stderr: -378> 2024-06-04T16:11:39.843+0000 7f99e8281800 5 AuthRegistry(0x55fb8c954130) adding con mode: crc 2024-06-04T16:11:40.125 INFO:tasks.workunit.client.0.smithi144.stderr: -377> 2024-06-04T16:11:39.843+0000 7f99e8281800 5 AuthRegistry(0x55fb8c954130) adding con mode: secure 2024-06-04T16:11:40.125 INFO:tasks.workunit.client.0.smithi144.stderr: -376> 2024-06-04T16:11:39.843+0000 7f99e8281800 5 AuthRegistry(0x55fb8c954130) adding con mode: crc 2024-06-04T16:11:40.125 INFO:tasks.workunit.client.0.smithi144.stderr: -375> 2024-06-04T16:11:39.843+0000 7f99e8281800 5 AuthRegistry(0x55fb8c954130) adding con mode: crc 2024-06-04T16:11:40.125 INFO:tasks.workunit.client.0.smithi144.stderr: -374> 2024-06-04T16:11:39.843+0000 7f99e8281800 5 AuthRegistry(0x55fb8c954130) adding con mode: secure 2024-06-04T16:11:40.125 INFO:tasks.workunit.client.0.smithi144.stderr: -373> 2024-06-04T16:11:39.843+0000 7f99e8281800 5 AuthRegistry(0x55fb8c954130) adding con mode: crc 2024-06-04T16:11:40.126 INFO:tasks.workunit.client.0.smithi144.stderr: -372> 2024-06-04T16:11:39.843+0000 7f99e8281800 5 AuthRegistry(0x55fb8c954130) adding con mode: secure 2024-06-04T16:11:40.126 INFO:tasks.workunit.client.0.smithi144.stderr: -371> 2024-06-04T16:11:39.843+0000 7f99e8281800 5 AuthRegistry(0x55fb8c954130) adding con mode: crc 2024-06-04T16:11:40.126 INFO:tasks.workunit.client.0.smithi144.stderr: -370> 2024-06-04T16:11:39.843+0000 7f99e8281800 5 AuthRegistry(0x55fb8c954130) adding con mode: secure 2024-06-04T16:11:40.126 INFO:tasks.workunit.client.0.smithi144.stderr: -369> 2024-06-04T16:11:39.843+0000 7f99e8281800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-06-04T16:11:40.126 INFO:tasks.workunit.client.0.smithi144.stderr: -368> 2024-06-04T16:11:39.843+0000 7f99e8281800 5 asok(0x55fb8c6dbc60) register_command objecter_requests cmddesc objecter_requests hook 0x55fb8c94fe10 EEXIST 2024-06-04T16:11:40.126 INFO:tasks.workunit.client.0.smithi144.stderr: -367> 2024-06-04T16:11:39.843+0000 7f99e8281800 10 monclient: init 2024-06-04T16:11:40.126 INFO:tasks.workunit.client.0.smithi144.stderr: -366> 2024-06-04T16:11:39.843+0000 7f99e8281800 5 AuthRegistry(0x55fb8c953028) adding auth protocol: cephx 2024-06-04T16:11:40.126 INFO:tasks.workunit.client.0.smithi144.stderr: -365> 2024-06-04T16:11:39.843+0000 7f99e8281800 5 AuthRegistry(0x55fb8c953028) adding auth protocol: cephx 2024-06-04T16:11:40.126 INFO:tasks.workunit.client.0.smithi144.stderr: -364> 2024-06-04T16:11:39.843+0000 7f99e8281800 5 AuthRegistry(0x55fb8c953028) adding auth protocol: cephx 2024-06-04T16:11:40.126 INFO:tasks.workunit.client.0.smithi144.stderr: -363> 2024-06-04T16:11:39.843+0000 7f99e8281800 5 AuthRegistry(0x55fb8c953028) adding con mode: secure 2024-06-04T16:11:40.126 INFO:tasks.workunit.client.0.smithi144.stderr: -362> 2024-06-04T16:11:39.843+0000 7f99e8281800 5 AuthRegistry(0x55fb8c953028) adding con mode: crc 2024-06-04T16:11:40.126 INFO:tasks.workunit.client.0.smithi144.stderr: -361> 2024-06-04T16:11:39.843+0000 7f99e8281800 5 AuthRegistry(0x55fb8c953028) adding con mode: secure 2024-06-04T16:11:40.126 INFO:tasks.workunit.client.0.smithi144.stderr: -360> 2024-06-04T16:11:39.843+0000 7f99e8281800 5 AuthRegistry(0x55fb8c953028) adding con mode: crc 2024-06-04T16:11:40.127 INFO:tasks.workunit.client.0.smithi144.stderr: -359> 2024-06-04T16:11:39.843+0000 7f99e8281800 5 AuthRegistry(0x55fb8c953028) adding con mode: secure 2024-06-04T16:11:40.127 INFO:tasks.workunit.client.0.smithi144.stderr: -358> 2024-06-04T16:11:39.843+0000 7f99e8281800 5 AuthRegistry(0x55fb8c953028) adding con mode: crc 2024-06-04T16:11:40.127 INFO:tasks.workunit.client.0.smithi144.stderr: -357> 2024-06-04T16:11:39.843+0000 7f99e8281800 5 AuthRegistry(0x55fb8c953028) adding con mode: crc 2024-06-04T16:11:40.127 INFO:tasks.workunit.client.0.smithi144.stderr: -356> 2024-06-04T16:11:39.843+0000 7f99e8281800 5 AuthRegistry(0x55fb8c953028) adding con mode: secure 2024-06-04T16:11:40.127 INFO:tasks.workunit.client.0.smithi144.stderr: -355> 2024-06-04T16:11:39.843+0000 7f99e8281800 5 AuthRegistry(0x55fb8c953028) adding con mode: crc 2024-06-04T16:11:40.127 INFO:tasks.workunit.client.0.smithi144.stderr: -354> 2024-06-04T16:11:39.843+0000 7f99e8281800 5 AuthRegistry(0x55fb8c953028) adding con mode: secure 2024-06-04T16:11:40.127 INFO:tasks.workunit.client.0.smithi144.stderr: -353> 2024-06-04T16:11:39.843+0000 7f99e8281800 5 AuthRegistry(0x55fb8c953028) adding con mode: crc 2024-06-04T16:11:40.127 INFO:tasks.workunit.client.0.smithi144.stderr: -352> 2024-06-04T16:11:39.843+0000 7f99e8281800 5 AuthRegistry(0x55fb8c953028) adding con mode: secure 2024-06-04T16:11:40.127 INFO:tasks.workunit.client.0.smithi144.stderr: -351> 2024-06-04T16:11:39.843+0000 7f99e8281800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-06-04T16:11:40.127 INFO:tasks.workunit.client.0.smithi144.stderr: -350> 2024-06-04T16:11:39.843+0000 7f99e8281800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-06-04T16:11:40.127 INFO:tasks.workunit.client.0.smithi144.stderr: -349> 2024-06-04T16:11:39.844+0000 7f99e8281800 5 asok(0x55fb8c6dbc60) register_command rotate-key cmddesc rotate-key hook 0x55fb8c953170 EEXIST 2024-06-04T16:11:40.127 INFO:tasks.workunit.client.0.smithi144.stderr: -348> 2024-06-04T16:11:39.844+0000 7f99e8281800 10 monclient: _reopen_session rank -1 2024-06-04T16:11:40.127 INFO:tasks.workunit.client.0.smithi144.stderr: -347> 2024-06-04T16:11:39.844+0000 7f99e8281800 10 monclient: _add_conns ranks=[1,0,2] 2024-06-04T16:11:40.127 INFO:tasks.workunit.client.0.smithi144.stderr: -346> 2024-06-04T16:11:39.844+0000 7f99e8281800 10 monclient(hunting): picked mon.noname-b con 0x55fb8c95e950 addr [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] 2024-06-04T16:11:40.127 INFO:tasks.workunit.client.0.smithi144.stderr: -345> 2024-06-04T16:11:39.844+0000 7f99e8281800 10 monclient(hunting): picked mon.noname-a con 0x55fb8c95ed30 addr [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] 2024-06-04T16:11:40.128 INFO:tasks.workunit.client.0.smithi144.stderr: -344> 2024-06-04T16:11:39.844+0000 7f99e8281800 10 monclient(hunting): picked mon.noname-c con 0x55fb8c981080 addr [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] 2024-06-04T16:11:40.128 INFO:tasks.workunit.client.0.smithi144.stderr: -343> 2024-06-04T16:11:39.844+0000 7f99e8281800 10 monclient(hunting): start opening mon connection 2024-06-04T16:11:40.128 INFO:tasks.workunit.client.0.smithi144.stderr: -342> 2024-06-04T16:11:39.844+0000 7f99e8281800 10 monclient(hunting): start opening mon connection 2024-06-04T16:11:40.128 INFO:tasks.workunit.client.0.smithi144.stderr: -341> 2024-06-04T16:11:39.844+0000 7f99e8281800 10 monclient(hunting): start opening mon connection 2024-06-04T16:11:40.128 INFO:tasks.workunit.client.0.smithi144.stderr: -340> 2024-06-04T16:11:39.844+0000 7f99e8281800 10 monclient(hunting): _renew_subs 2024-06-04T16:11:40.128 INFO:tasks.workunit.client.0.smithi144.stderr: -339> 2024-06-04T16:11:39.844+0000 7f99e8281800 10 monclient(hunting): authenticate will time out at 1937.661196s 2024-06-04T16:11:40.128 INFO:tasks.workunit.client.0.smithi144.stderr: -338> 2024-06-04T16:11:39.844+0000 7f99e5d76640 10 monclient(hunting): get_auth_request con 0x55fb8c981080 auth_method 0 2024-06-04T16:11:40.128 INFO:tasks.workunit.client.0.smithi144.stderr: -337> 2024-06-04T16:11:39.844+0000 7f99e5d76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-06-04T16:11:40.128 INFO:tasks.workunit.client.0.smithi144.stderr: -336> 2024-06-04T16:11:39.844+0000 7f99e5d76640 10 monclient(hunting): _init_auth method 2 2024-06-04T16:11:40.128 INFO:tasks.workunit.client.0.smithi144.stderr: -335> 2024-06-04T16:11:39.844+0000 7f99e5d76640 10 monclient(hunting): _init_auth creating new auth 2024-06-04T16:11:40.128 INFO:tasks.workunit.client.0.smithi144.stderr: -334> 2024-06-04T16:11:39.844+0000 7f99e6577640 10 monclient(hunting): get_auth_request con 0x55fb8c95ed30 auth_method 0 2024-06-04T16:11:40.128 INFO:tasks.workunit.client.0.smithi144.stderr: -333> 2024-06-04T16:11:39.844+0000 7f99e6577640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-06-04T16:11:40.128 INFO:tasks.workunit.client.0.smithi144.stderr: -332> 2024-06-04T16:11:39.844+0000 7f99e6577640 10 monclient(hunting): _init_auth method 2 2024-06-04T16:11:40.128 INFO:tasks.workunit.client.0.smithi144.stderr: -331> 2024-06-04T16:11:39.844+0000 7f99e6577640 10 monclient(hunting): _init_auth creating new auth 2024-06-04T16:11:40.129 INFO:tasks.workunit.client.0.smithi144.stderr: -330> 2024-06-04T16:11:39.844+0000 7f99dd575640 10 monclient(hunting): get_auth_request con 0x55fb8c95e950 auth_method 0 2024-06-04T16:11:40.129 INFO:tasks.workunit.client.0.smithi144.stderr: -329> 2024-06-04T16:11:39.844+0000 7f99dd575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-06-04T16:11:40.129 INFO:tasks.workunit.client.0.smithi144.stderr: -328> 2024-06-04T16:11:39.844+0000 7f99dd575640 10 monclient(hunting): _init_auth method 2 2024-06-04T16:11:40.129 INFO:tasks.workunit.client.0.smithi144.stderr: -327> 2024-06-04T16:11:39.844+0000 7f99dd575640 10 monclient(hunting): _init_auth creating new auth 2024-06-04T16:11:40.129 INFO:tasks.workunit.client.0.smithi144.stderr: -326> 2024-06-04T16:11:39.844+0000 7f99e5d76640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-06-04T16:11:40.129 INFO:tasks.workunit.client.0.smithi144.stderr: -325> 2024-06-04T16:11:39.844+0000 7f99e5d76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-06-04T16:11:40.129 INFO:tasks.workunit.client.0.smithi144.stderr: -324> 2024-06-04T16:11:39.844+0000 7f99e5d76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-06-04T16:11:40.129 INFO:tasks.workunit.client.0.smithi144.stderr: -323> 2024-06-04T16:11:39.844+0000 7f99e6577640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-06-04T16:11:40.129 INFO:tasks.workunit.client.0.smithi144.stderr: -322> 2024-06-04T16:11:39.844+0000 7f99e6577640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-06-04T16:11:40.129 INFO:tasks.workunit.client.0.smithi144.stderr: -321> 2024-06-04T16:11:39.844+0000 7f99e6577640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-06-04T16:11:40.129 INFO:tasks.workunit.client.0.smithi144.stderr: -320> 2024-06-04T16:11:39.844+0000 7f99dd575640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-06-04T16:11:40.129 INFO:tasks.workunit.client.0.smithi144.stderr: -319> 2024-06-04T16:11:39.844+0000 7f99dd575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-06-04T16:11:40.129 INFO:tasks.workunit.client.0.smithi144.stderr: -318> 2024-06-04T16:11:39.844+0000 7f99dd575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-06-04T16:11:40.129 INFO:tasks.workunit.client.0.smithi144.stderr: -317> 2024-06-04T16:11:39.844+0000 7f99e5d76640 10 monclient(hunting): handle_auth_done global_id 5963 payload 824 2024-06-04T16:11:40.129 INFO:tasks.workunit.client.0.smithi144.stderr: -316> 2024-06-04T16:11:39.844+0000 7f99e5d76640 10 monclient: _finish_hunting 0 2024-06-04T16:11:40.129 INFO:tasks.workunit.client.0.smithi144.stderr: -315> 2024-06-04T16:11:39.844+0000 7f99e5d76640 1 monclient: found mon.noname-c 2024-06-04T16:11:40.130 INFO:tasks.workunit.client.0.smithi144.stderr: -314> 2024-06-04T16:11:39.844+0000 7f99e5d76640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.144:3301/0 2024-06-04T16:11:40.130 INFO:tasks.workunit.client.0.smithi144.stderr: -313> 2024-06-04T16:11:39.844+0000 7f98cb7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-06-04T16:11:40.130 INFO:tasks.workunit.client.0.smithi144.stderr: -312> 2024-06-04T16:11:39.844+0000 7f98cb7fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-06-04T16:11:40.130 INFO:tasks.workunit.client.0.smithi144.stderr: -311> 2024-06-04T16:11:39.844+0000 7f98cb7fe640 10 monclient: dump: 2024-06-04T16:11:40.130 INFO:tasks.workunit.client.0.smithi144.stderr:epoch 1 2024-06-04T16:11:40.130 INFO:tasks.workunit.client.0.smithi144.stderr:fsid 15e56bb1-4856-42f3-b6db-a2c8f23c5557 2024-06-04T16:11:40.130 INFO:tasks.workunit.client.0.smithi144.stderr:last_changed 2024-06-04T15:51:29.789359+0000 2024-06-04T16:11:40.130 INFO:tasks.workunit.client.0.smithi144.stderr:created 2024-06-04T15:51:29.789359+0000 2024-06-04T16:11:40.130 INFO:tasks.workunit.client.0.smithi144.stderr:min_mon_release 19 (squid) 2024-06-04T16:11:40.130 INFO:tasks.workunit.client.0.smithi144.stderr:election_strategy: 1 2024-06-04T16:11:40.130 INFO:tasks.workunit.client.0.smithi144.stderr:0: [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] mon.a 2024-06-04T16:11:40.130 INFO:tasks.workunit.client.0.smithi144.stderr:1: [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] mon.b 2024-06-04T16:11:40.130 INFO:tasks.workunit.client.0.smithi144.stderr:2: [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] mon.c 2024-06-04T16:11:40.131 INFO:tasks.workunit.client.0.smithi144.stderr: 2024-06-04T16:11:40.131 INFO:tasks.workunit.client.0.smithi144.stderr: -310> 2024-06-04T16:11:39.844+0000 7f98cb7fe640 10 monclient: _finish_auth 0 2024-06-04T16:11:40.131 INFO:tasks.workunit.client.0.smithi144.stderr: -309> 2024-06-04T16:11:39.844+0000 7f98cb7fe640 10 monclient: _check_auth_tickets 2024-06-04T16:11:40.131 INFO:tasks.workunit.client.0.smithi144.stderr: -308> 2024-06-04T16:11:39.844+0000 7f98cb7fe640 10 monclient: handle_config config(0 keys) 2024-06-04T16:11:40.131 INFO:tasks.workunit.client.0.smithi144.stderr: -307> 2024-06-04T16:11:39.844+0000 7f98cb7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-06-04T16:11:40.131 INFO:tasks.workunit.client.0.smithi144.stderr: -306> 2024-06-04T16:11:39.844+0000 7f98cb7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-06-04T16:11:40.131 INFO:tasks.workunit.client.0.smithi144.stderr: -305> 2024-06-04T16:11:39.844+0000 7f98cb7fe640 10 monclient: dump: 2024-06-04T16:11:40.131 INFO:tasks.workunit.client.0.smithi144.stderr:epoch 1 2024-06-04T16:11:40.131 INFO:tasks.workunit.client.0.smithi144.stderr:fsid 15e56bb1-4856-42f3-b6db-a2c8f23c5557 2024-06-04T16:11:40.131 INFO:tasks.workunit.client.0.smithi144.stderr:last_changed 2024-06-04T15:51:29.789359+0000 2024-06-04T16:11:40.131 INFO:tasks.workunit.client.0.smithi144.stderr:created 2024-06-04T15:51:29.789359+0000 2024-06-04T16:11:40.131 INFO:tasks.workunit.client.0.smithi144.stderr:min_mon_release 19 (squid) 2024-06-04T16:11:40.131 INFO:tasks.workunit.client.0.smithi144.stderr:election_strategy: 1 2024-06-04T16:11:40.132 INFO:tasks.workunit.client.0.smithi144.stderr:0: [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] mon.a 2024-06-04T16:11:40.132 INFO:tasks.workunit.client.0.smithi144.stderr:1: [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] mon.b 2024-06-04T16:11:40.132 INFO:tasks.workunit.client.0.smithi144.stderr:2: [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] mon.c 2024-06-04T16:11:40.132 INFO:tasks.workunit.client.0.smithi144.stderr: 2024-06-04T16:11:40.132 INFO:tasks.workunit.client.0.smithi144.stderr: -304> 2024-06-04T16:11:39.844+0000 7f99e8281800 5 monclient: authenticate success, global_id 5963 2024-06-04T16:11:40.132 INFO:tasks.workunit.client.0.smithi144.stderr: -303> 2024-06-04T16:11:39.844+0000 7f99e8281800 10 monclient: _renew_subs 2024-06-04T16:11:40.132 INFO:tasks.workunit.client.0.smithi144.stderr: -302> 2024-06-04T16:11:39.844+0000 7f99e6d78640 4 set_mon_vals no callback set 2024-06-04T16:11:40.132 INFO:tasks.workunit.client.0.smithi144.stderr: -301> 2024-06-04T16:11:39.844+0000 7f99e8281800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.144:3301/0 2024-06-04T16:11:40.132 INFO:tasks.workunit.client.0.smithi144.stderr: -300> 2024-06-04T16:11:39.844+0000 7f99e8281800 10 monclient: _renew_subs 2024-06-04T16:11:40.132 INFO:tasks.workunit.client.0.smithi144.stderr: -299> 2024-06-04T16:11:39.844+0000 7f99e8281800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.144:3301/0 2024-06-04T16:11:40.132 INFO:tasks.workunit.client.0.smithi144.stderr: -298> 2024-06-04T16:11:39.846+0000 7f98cb7fe640 4 mgrc handle_mgr_map Got map version 5 2024-06-04T16:11:40.132 INFO:tasks.workunit.client.0.smithi144.stderr: -297> 2024-06-04T16:11:39.846+0000 7f98cb7fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.177:6832/2645786330,v1:172.21.15.177:6833/2645786330] 2024-06-04T16:11:40.132 INFO:tasks.workunit.client.0.smithi144.stderr: -296> 2024-06-04T16:11:39.846+0000 7f98cb7fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.177:6832/2645786330,v1:172.21.15.177:6833/2645786330] 2024-06-04T16:11:40.132 INFO:tasks.workunit.client.0.smithi144.stderr: -295> 2024-06-04T16:11:39.846+0000 7f99dd575640 10 monclient: get_auth_request con 0x7f98c0074bc0 auth_method 0 2024-06-04T16:11:40.133 INFO:tasks.workunit.client.0.smithi144.stderr: -294> 2024-06-04T16:11:39.846+0000 7f99e8281800 10 monclient: get_monmap_and_config 2024-06-04T16:11:40.133 INFO:tasks.workunit.client.0.smithi144.stderr: -293> 2024-06-04T16:11:39.846+0000 7f99e8281800 10 monclient: build_initial_monmap 2024-06-04T16:11:40.133 INFO:tasks.workunit.client.0.smithi144.stderr: -292> 2024-06-04T16:11:39.846+0000 7f99e8281800 1 build_initial for_mkfs: 0 2024-06-04T16:11:40.133 INFO:tasks.workunit.client.0.smithi144.stderr: -291> 2024-06-04T16:11:39.846+0000 7f99e8281800 10 monclient: monmap: 2024-06-04T16:11:40.133 INFO:tasks.workunit.client.0.smithi144.stderr:epoch 0 2024-06-04T16:11:40.133 INFO:tasks.workunit.client.0.smithi144.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-06-04T16:11:40.133 INFO:tasks.workunit.client.0.smithi144.stderr:last_changed 0.000000 2024-06-04T16:11:40.133 INFO:tasks.workunit.client.0.smithi144.stderr:created 0.000000 2024-06-04T16:11:40.133 INFO:tasks.workunit.client.0.smithi144.stderr:min_mon_release 0 (unknown) 2024-06-04T16:11:40.133 INFO:tasks.workunit.client.0.smithi144.stderr:election_strategy: 1 2024-06-04T16:11:40.133 INFO:tasks.workunit.client.0.smithi144.stderr:0: [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] mon.noname-a 2024-06-04T16:11:40.133 INFO:tasks.workunit.client.0.smithi144.stderr:1: [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] mon.noname-b 2024-06-04T16:11:40.133 INFO:tasks.workunit.client.0.smithi144.stderr:2: [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] mon.noname-c 2024-06-04T16:11:40.133 INFO:tasks.workunit.client.0.smithi144.stderr: 2024-06-04T16:11:40.133 INFO:tasks.workunit.client.0.smithi144.stderr: -290> 2024-06-04T16:11:39.846+0000 7f99e8281800 5 AuthRegistry(0x55fb8c99b9a0) adding auth protocol: cephx 2024-06-04T16:11:40.134 INFO:tasks.workunit.client.0.smithi144.stderr: -289> 2024-06-04T16:11:39.846+0000 7f99e8281800 5 AuthRegistry(0x55fb8c99b9a0) adding auth protocol: cephx 2024-06-04T16:11:40.134 INFO:tasks.workunit.client.0.smithi144.stderr: -288> 2024-06-04T16:11:39.846+0000 7f99e8281800 5 AuthRegistry(0x55fb8c99b9a0) adding auth protocol: cephx 2024-06-04T16:11:40.134 INFO:tasks.workunit.client.0.smithi144.stderr: -287> 2024-06-04T16:11:39.846+0000 7f99e8281800 5 AuthRegistry(0x55fb8c99b9a0) adding con mode: secure 2024-06-04T16:11:40.134 INFO:tasks.workunit.client.0.smithi144.stderr: -286> 2024-06-04T16:11:39.846+0000 7f99e8281800 5 AuthRegistry(0x55fb8c99b9a0) adding con mode: crc 2024-06-04T16:11:40.134 INFO:tasks.workunit.client.0.smithi144.stderr: -285> 2024-06-04T16:11:39.846+0000 7f99e8281800 5 AuthRegistry(0x55fb8c99b9a0) adding con mode: secure 2024-06-04T16:11:40.134 INFO:tasks.workunit.client.0.smithi144.stderr: -284> 2024-06-04T16:11:39.846+0000 7f99e8281800 5 AuthRegistry(0x55fb8c99b9a0) adding con mode: crc 2024-06-04T16:11:40.134 INFO:tasks.workunit.client.0.smithi144.stderr: -283> 2024-06-04T16:11:39.846+0000 7f99e8281800 5 AuthRegistry(0x55fb8c99b9a0) adding con mode: secure 2024-06-04T16:11:40.134 INFO:tasks.workunit.client.0.smithi144.stderr: -282> 2024-06-04T16:11:39.846+0000 7f99e8281800 5 AuthRegistry(0x55fb8c99b9a0) adding con mode: crc 2024-06-04T16:11:40.134 INFO:tasks.workunit.client.0.smithi144.stderr: -281> 2024-06-04T16:11:39.846+0000 7f99e8281800 5 AuthRegistry(0x55fb8c99b9a0) adding con mode: crc 2024-06-04T16:11:40.134 INFO:tasks.workunit.client.0.smithi144.stderr: -280> 2024-06-04T16:11:39.846+0000 7f99e8281800 5 AuthRegistry(0x55fb8c99b9a0) adding con mode: secure 2024-06-04T16:11:40.134 INFO:tasks.workunit.client.0.smithi144.stderr: -279> 2024-06-04T16:11:39.846+0000 7f99e8281800 5 AuthRegistry(0x55fb8c99b9a0) adding con mode: crc 2024-06-04T16:11:40.134 INFO:tasks.workunit.client.0.smithi144.stderr: -278> 2024-06-04T16:11:39.846+0000 7f99e8281800 5 AuthRegistry(0x55fb8c99b9a0) adding con mode: secure 2024-06-04T16:11:40.134 INFO:tasks.workunit.client.0.smithi144.stderr: -277> 2024-06-04T16:11:39.846+0000 7f99e8281800 5 AuthRegistry(0x55fb8c99b9a0) adding con mode: crc 2024-06-04T16:11:40.134 INFO:tasks.workunit.client.0.smithi144.stderr: -276> 2024-06-04T16:11:39.846+0000 7f99e8281800 5 AuthRegistry(0x55fb8c99b9a0) adding con mode: secure 2024-06-04T16:11:40.135 INFO:tasks.workunit.client.0.smithi144.stderr: -275> 2024-06-04T16:11:39.847+0000 7f99e8281800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-06-04T16:11:40.135 INFO:tasks.workunit.client.0.smithi144.stderr: -274> 2024-06-04T16:11:39.847+0000 7f99e8281800 10 monclient: init 2024-06-04T16:11:40.135 INFO:tasks.workunit.client.0.smithi144.stderr: -273> 2024-06-04T16:11:39.847+0000 7f99e8281800 5 AuthRegistry(0x7ffdc44e9cb0) adding auth protocol: cephx 2024-06-04T16:11:40.135 INFO:tasks.workunit.client.0.smithi144.stderr: -272> 2024-06-04T16:11:39.847+0000 7f99e8281800 5 AuthRegistry(0x7ffdc44e9cb0) adding auth protocol: cephx 2024-06-04T16:11:40.135 INFO:tasks.workunit.client.0.smithi144.stderr: -271> 2024-06-04T16:11:39.847+0000 7f99e8281800 5 AuthRegistry(0x7ffdc44e9cb0) adding auth protocol: cephx 2024-06-04T16:11:40.135 INFO:tasks.workunit.client.0.smithi144.stderr: -270> 2024-06-04T16:11:39.847+0000 7f99e8281800 5 AuthRegistry(0x7ffdc44e9cb0) adding con mode: secure 2024-06-04T16:11:40.135 INFO:tasks.workunit.client.0.smithi144.stderr: -269> 2024-06-04T16:11:39.847+0000 7f99e8281800 5 AuthRegistry(0x7ffdc44e9cb0) adding con mode: crc 2024-06-04T16:11:40.135 INFO:tasks.workunit.client.0.smithi144.stderr: -268> 2024-06-04T16:11:39.847+0000 7f99e8281800 5 AuthRegistry(0x7ffdc44e9cb0) adding con mode: secure 2024-06-04T16:11:40.135 INFO:tasks.workunit.client.0.smithi144.stderr: -267> 2024-06-04T16:11:39.847+0000 7f99e8281800 5 AuthRegistry(0x7ffdc44e9cb0) adding con mode: crc 2024-06-04T16:11:40.135 INFO:tasks.workunit.client.0.smithi144.stderr: -266> 2024-06-04T16:11:39.847+0000 7f99e8281800 5 AuthRegistry(0x7ffdc44e9cb0) adding con mode: secure 2024-06-04T16:11:40.135 INFO:tasks.workunit.client.0.smithi144.stderr: -265> 2024-06-04T16:11:39.847+0000 7f99e8281800 5 AuthRegistry(0x7ffdc44e9cb0) adding con mode: crc 2024-06-04T16:11:40.135 INFO:tasks.workunit.client.0.smithi144.stderr: -264> 2024-06-04T16:11:39.847+0000 7f99e8281800 5 AuthRegistry(0x7ffdc44e9cb0) adding con mode: crc 2024-06-04T16:11:40.135 INFO:tasks.workunit.client.0.smithi144.stderr: -263> 2024-06-04T16:11:39.847+0000 7f99e8281800 5 AuthRegistry(0x7ffdc44e9cb0) adding con mode: secure 2024-06-04T16:11:40.135 INFO:tasks.workunit.client.0.smithi144.stderr: -262> 2024-06-04T16:11:39.847+0000 7f99e8281800 5 AuthRegistry(0x7ffdc44e9cb0) adding con mode: crc 2024-06-04T16:11:40.135 INFO:tasks.workunit.client.0.smithi144.stderr: -261> 2024-06-04T16:11:39.847+0000 7f99e8281800 5 AuthRegistry(0x7ffdc44e9cb0) adding con mode: secure 2024-06-04T16:11:40.136 INFO:tasks.workunit.client.0.smithi144.stderr: -260> 2024-06-04T16:11:39.847+0000 7f99e8281800 5 AuthRegistry(0x7ffdc44e9cb0) adding con mode: crc 2024-06-04T16:11:40.136 INFO:tasks.workunit.client.0.smithi144.stderr: -259> 2024-06-04T16:11:39.847+0000 7f99e8281800 5 AuthRegistry(0x7ffdc44e9cb0) adding con mode: secure 2024-06-04T16:11:40.136 INFO:tasks.workunit.client.0.smithi144.stderr: -258> 2024-06-04T16:11:39.847+0000 7f99e8281800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-06-04T16:11:40.136 INFO:tasks.workunit.client.0.smithi144.stderr: -257> 2024-06-04T16:11:39.847+0000 7f99e8281800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-06-04T16:11:40.136 INFO:tasks.workunit.client.0.smithi144.stderr: -256> 2024-06-04T16:11:39.847+0000 7f99e8281800 5 asok(0x55fb8c6dbc60) register_command rotate-key cmddesc rotate-key hook 0x7ffdc44e9df8 EEXIST 2024-06-04T16:11:40.136 INFO:tasks.workunit.client.0.smithi144.stderr: -255> 2024-06-04T16:11:39.847+0000 7f99e8281800 10 monclient: _reopen_session rank -1 2024-06-04T16:11:40.136 INFO:tasks.workunit.client.0.smithi144.stderr: -254> 2024-06-04T16:11:39.847+0000 7f99e8281800 10 monclient: _add_conns ranks=[0,1,2] 2024-06-04T16:11:40.136 INFO:tasks.workunit.client.0.smithi144.stderr: -253> 2024-06-04T16:11:39.847+0000 7f99e8281800 10 monclient(hunting): picked mon.noname-a con 0x55fb8c9c1900 addr [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] 2024-06-04T16:11:40.136 INFO:tasks.workunit.client.0.smithi144.stderr: -252> 2024-06-04T16:11:39.847+0000 7f99e8281800 10 monclient(hunting): picked mon.noname-b con 0x55fb8c9a1100 addr [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] 2024-06-04T16:11:40.136 INFO:tasks.workunit.client.0.smithi144.stderr: -251> 2024-06-04T16:11:39.847+0000 7f99e8281800 10 monclient(hunting): picked mon.noname-c con 0x55fb8c9cb880 addr [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] 2024-06-04T16:11:40.136 INFO:tasks.workunit.client.0.smithi144.stderr: -250> 2024-06-04T16:11:39.847+0000 7f99e8281800 10 monclient(hunting): start opening mon connection 2024-06-04T16:11:40.136 INFO:tasks.workunit.client.0.smithi144.stderr: -249> 2024-06-04T16:11:39.847+0000 7f99e8281800 10 monclient(hunting): start opening mon connection 2024-06-04T16:11:40.136 INFO:tasks.workunit.client.0.smithi144.stderr: -248> 2024-06-04T16:11:39.847+0000 7f99e8281800 10 monclient(hunting): start opening mon connection 2024-06-04T16:11:40.136 INFO:tasks.workunit.client.0.smithi144.stderr: -247> 2024-06-04T16:11:39.847+0000 7f99e8281800 10 monclient(hunting): _renew_subs 2024-06-04T16:11:40.137 INFO:tasks.workunit.client.0.smithi144.stderr: -246> 2024-06-04T16:11:39.847+0000 7f99e8281800 10 monclient(hunting): authenticate will time out at 1937.664877s 2024-06-04T16:11:40.137 INFO:tasks.workunit.client.0.smithi144.stderr: -245> 2024-06-04T16:11:39.847+0000 7f99dd575640 10 monclient(hunting): get_auth_request con 0x55fb8c9c1900 auth_method 0 2024-06-04T16:11:40.137 INFO:tasks.workunit.client.0.smithi144.stderr: -244> 2024-06-04T16:11:39.847+0000 7f99dd575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-06-04T16:11:40.137 INFO:tasks.workunit.client.0.smithi144.stderr: -243> 2024-06-04T16:11:39.847+0000 7f99dd575640 10 monclient(hunting): _init_auth method 2 2024-06-04T16:11:40.137 INFO:tasks.workunit.client.0.smithi144.stderr: -242> 2024-06-04T16:11:39.847+0000 7f99dd575640 10 monclient(hunting): _init_auth creating new auth 2024-06-04T16:11:40.137 INFO:tasks.workunit.client.0.smithi144.stderr: -241> 2024-06-04T16:11:39.847+0000 7f99e5d76640 10 monclient(hunting): get_auth_request con 0x55fb8c9cb880 auth_method 0 2024-06-04T16:11:40.137 INFO:tasks.workunit.client.0.smithi144.stderr: -240> 2024-06-04T16:11:39.847+0000 7f99e5d76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-06-04T16:11:40.137 INFO:tasks.workunit.client.0.smithi144.stderr: -239> 2024-06-04T16:11:39.847+0000 7f99e5d76640 10 monclient(hunting): _init_auth method 2 2024-06-04T16:11:40.137 INFO:tasks.workunit.client.0.smithi144.stderr: -238> 2024-06-04T16:11:39.847+0000 7f99e5d76640 10 monclient(hunting): _init_auth creating new auth 2024-06-04T16:11:40.137 INFO:tasks.workunit.client.0.smithi144.stderr: -237> 2024-06-04T16:11:39.847+0000 7f99e6577640 10 monclient(hunting): get_auth_request con 0x55fb8c9a1100 auth_method 0 2024-06-04T16:11:40.137 INFO:tasks.workunit.client.0.smithi144.stderr: -236> 2024-06-04T16:11:39.847+0000 7f99e6577640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-06-04T16:11:40.137 INFO:tasks.workunit.client.0.smithi144.stderr: -235> 2024-06-04T16:11:39.847+0000 7f99e6577640 10 monclient(hunting): _init_auth method 2 2024-06-04T16:11:40.137 INFO:tasks.workunit.client.0.smithi144.stderr: -234> 2024-06-04T16:11:39.847+0000 7f99e6577640 10 monclient(hunting): _init_auth creating new auth 2024-06-04T16:11:40.137 INFO:tasks.workunit.client.0.smithi144.stderr: -233> 2024-06-04T16:11:39.847+0000 7f99dd575640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-06-04T16:11:40.137 INFO:tasks.workunit.client.0.smithi144.stderr: -232> 2024-06-04T16:11:39.847+0000 7f99dd575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-06-04T16:11:40.138 INFO:tasks.workunit.client.0.smithi144.stderr: -231> 2024-06-04T16:11:39.847+0000 7f99dd575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-06-04T16:11:40.138 INFO:tasks.workunit.client.0.smithi144.stderr: -230> 2024-06-04T16:11:39.847+0000 7f99e5d76640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-06-04T16:11:40.138 INFO:tasks.workunit.client.0.smithi144.stderr: -229> 2024-06-04T16:11:39.847+0000 7f99e5d76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-06-04T16:11:40.138 INFO:tasks.workunit.client.0.smithi144.stderr: -228> 2024-06-04T16:11:39.847+0000 7f99e5d76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-06-04T16:11:40.138 INFO:tasks.workunit.client.0.smithi144.stderr: -227> 2024-06-04T16:11:39.847+0000 7f99e6577640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-06-04T16:11:40.138 INFO:tasks.workunit.client.0.smithi144.stderr: -226> 2024-06-04T16:11:39.847+0000 7f99e6577640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-06-04T16:11:40.138 INFO:tasks.workunit.client.0.smithi144.stderr: -225> 2024-06-04T16:11:39.848+0000 7f99e6577640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-06-04T16:11:40.138 INFO:tasks.workunit.client.0.smithi144.stderr: -224> 2024-06-04T16:11:39.848+0000 7f99dd575640 10 monclient(hunting): handle_auth_done global_id 6285 payload 274 2024-06-04T16:11:40.138 INFO:tasks.workunit.client.0.smithi144.stderr: -223> 2024-06-04T16:11:39.848+0000 7f99dd575640 10 monclient: _finish_hunting 0 2024-06-04T16:11:40.138 INFO:tasks.workunit.client.0.smithi144.stderr: -222> 2024-06-04T16:11:39.848+0000 7f99dd575640 1 monclient: found mon.noname-a 2024-06-04T16:11:40.138 INFO:tasks.workunit.client.0.smithi144.stderr: -221> 2024-06-04T16:11:39.848+0000 7f99dd575640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.144:3300/0 2024-06-04T16:11:40.138 INFO:tasks.workunit.client.0.smithi144.stderr: -220> 2024-06-04T16:11:39.848+0000 7f98c97fa640 10 monclient: handle_monmap mon_map magic: 0 2024-06-04T16:11:40.138 INFO:tasks.workunit.client.0.smithi144.stderr: -219> 2024-06-04T16:11:39.848+0000 7f98c97fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-06-04T16:11:40.139 INFO:tasks.workunit.client.0.smithi144.stderr: -218> 2024-06-04T16:11:39.848+0000 7f98c97fa640 10 monclient: dump: 2024-06-04T16:11:40.139 INFO:tasks.workunit.client.0.smithi144.stderr:epoch 1 2024-06-04T16:11:40.139 INFO:tasks.workunit.client.0.smithi144.stderr:fsid 15e56bb1-4856-42f3-b6db-a2c8f23c5557 2024-06-04T16:11:40.139 INFO:tasks.workunit.client.0.smithi144.stderr:last_changed 2024-06-04T15:51:29.789359+0000 2024-06-04T16:11:40.139 INFO:tasks.workunit.client.0.smithi144.stderr:created 2024-06-04T15:51:29.789359+0000 2024-06-04T16:11:40.139 INFO:tasks.workunit.client.0.smithi144.stderr:min_mon_release 19 (squid) 2024-06-04T16:11:40.139 INFO:tasks.workunit.client.0.smithi144.stderr:election_strategy: 1 2024-06-04T16:11:40.139 INFO:tasks.workunit.client.0.smithi144.stderr:0: [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] mon.a 2024-06-04T16:11:40.139 INFO:tasks.workunit.client.0.smithi144.stderr:1: [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] mon.b 2024-06-04T16:11:40.139 INFO:tasks.workunit.client.0.smithi144.stderr:2: [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] mon.c 2024-06-04T16:11:40.139 INFO:tasks.workunit.client.0.smithi144.stderr: 2024-06-04T16:11:40.139 INFO:tasks.workunit.client.0.smithi144.stderr: -217> 2024-06-04T16:11:39.848+0000 7f98c97fa640 10 monclient: _finish_auth 0 2024-06-04T16:11:40.139 INFO:tasks.workunit.client.0.smithi144.stderr: -216> 2024-06-04T16:11:39.848+0000 7f98c97fa640 10 monclient: _check_auth_tickets 2024-06-04T16:11:40.139 INFO:tasks.workunit.client.0.smithi144.stderr: -215> 2024-06-04T16:11:39.848+0000 7f98c97fa640 10 monclient: handle_config config(0 keys) 2024-06-04T16:11:40.140 INFO:tasks.workunit.client.0.smithi144.stderr: -214> 2024-06-04T16:11:39.848+0000 7f98c97fa640 10 monclient: handle_monmap mon_map magic: 0 2024-06-04T16:11:40.140 INFO:tasks.workunit.client.0.smithi144.stderr: -213> 2024-06-04T16:11:39.848+0000 7f98c97fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-06-04T16:11:40.140 INFO:tasks.workunit.client.0.smithi144.stderr: -212> 2024-06-04T16:11:39.848+0000 7f98c97fa640 10 monclient: dump: 2024-06-04T16:11:40.140 INFO:tasks.workunit.client.0.smithi144.stderr:epoch 1 2024-06-04T16:11:40.140 INFO:tasks.workunit.client.0.smithi144.stderr:fsid 15e56bb1-4856-42f3-b6db-a2c8f23c5557 2024-06-04T16:11:40.140 INFO:tasks.workunit.client.0.smithi144.stderr:last_changed 2024-06-04T15:51:29.789359+0000 2024-06-04T16:11:40.140 INFO:tasks.workunit.client.0.smithi144.stderr:created 2024-06-04T15:51:29.789359+0000 2024-06-04T16:11:40.140 INFO:tasks.workunit.client.0.smithi144.stderr:min_mon_release 19 (squid) 2024-06-04T16:11:40.140 INFO:tasks.workunit.client.0.smithi144.stderr:election_strategy: 1 2024-06-04T16:11:40.140 INFO:tasks.workunit.client.0.smithi144.stderr:0: [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] mon.a 2024-06-04T16:11:40.140 INFO:tasks.workunit.client.0.smithi144.stderr:1: [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] mon.b 2024-06-04T16:11:40.140 INFO:tasks.workunit.client.0.smithi144.stderr:2: [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] mon.c 2024-06-04T16:11:40.140 INFO:tasks.workunit.client.0.smithi144.stderr: 2024-06-04T16:11:40.140 INFO:tasks.workunit.client.0.smithi144.stderr: -211> 2024-06-04T16:11:39.848+0000 7f99e8281800 5 monclient: authenticate success, global_id 6285 2024-06-04T16:11:40.141 INFO:tasks.workunit.client.0.smithi144.stderr: -210> 2024-06-04T16:11:39.848+0000 7f99e8281800 10 monclient: get_monmap_and_config success 2024-06-04T16:11:40.141 INFO:tasks.workunit.client.0.smithi144.stderr: -209> 2024-06-04T16:11:39.848+0000 7f99e8281800 4 set_mon_vals no callback set 2024-06-04T16:11:40.141 INFO:tasks.workunit.client.0.smithi144.stderr: -208> 2024-06-04T16:11:39.848+0000 7f99e8281800 10 monclient: shutdown 2024-06-04T16:11:40.141 INFO:tasks.workunit.client.0.smithi144.stderr: -207> 2024-06-04T16:11:39.848+0000 7f99e8281800 10 monclient: build_initial_monmap 2024-06-04T16:11:40.141 INFO:tasks.workunit.client.0.smithi144.stderr: -206> 2024-06-04T16:11:39.848+0000 7f99e8281800 1 build_initial for_mkfs: 0 2024-06-04T16:11:40.141 INFO:tasks.workunit.client.0.smithi144.stderr: -205> 2024-06-04T16:11:39.849+0000 7f99e8281800 10 monclient: monmap: 2024-06-04T16:11:40.141 INFO:tasks.workunit.client.0.smithi144.stderr:epoch 0 2024-06-04T16:11:40.141 INFO:tasks.workunit.client.0.smithi144.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-06-04T16:11:40.141 INFO:tasks.workunit.client.0.smithi144.stderr:last_changed 0.000000 2024-06-04T16:11:40.141 INFO:tasks.workunit.client.0.smithi144.stderr:created 0.000000 2024-06-04T16:11:40.141 INFO:tasks.workunit.client.0.smithi144.stderr:min_mon_release 0 (unknown) 2024-06-04T16:11:40.141 INFO:tasks.workunit.client.0.smithi144.stderr:election_strategy: 1 2024-06-04T16:11:40.141 INFO:tasks.workunit.client.0.smithi144.stderr:0: [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] mon.noname-a 2024-06-04T16:11:40.141 INFO:tasks.workunit.client.0.smithi144.stderr:1: [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] mon.noname-b 2024-06-04T16:11:40.142 INFO:tasks.workunit.client.0.smithi144.stderr:2: [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] mon.noname-c 2024-06-04T16:11:40.142 INFO:tasks.workunit.client.0.smithi144.stderr: 2024-06-04T16:11:40.142 INFO:tasks.workunit.client.0.smithi144.stderr: -204> 2024-06-04T16:11:39.849+0000 7f99e8281800 5 AuthRegistry(0x55fb8c9c9560) adding auth protocol: cephx 2024-06-04T16:11:40.142 INFO:tasks.workunit.client.0.smithi144.stderr: -203> 2024-06-04T16:11:39.849+0000 7f99e8281800 5 AuthRegistry(0x55fb8c9c9560) adding auth protocol: cephx 2024-06-04T16:11:40.142 INFO:tasks.workunit.client.0.smithi144.stderr: -202> 2024-06-04T16:11:39.849+0000 7f99e8281800 5 AuthRegistry(0x55fb8c9c9560) adding auth protocol: cephx 2024-06-04T16:11:40.142 INFO:tasks.workunit.client.0.smithi144.stderr: -201> 2024-06-04T16:11:39.849+0000 7f99e8281800 5 AuthRegistry(0x55fb8c9c9560) adding con mode: secure 2024-06-04T16:11:40.142 INFO:tasks.workunit.client.0.smithi144.stderr: -200> 2024-06-04T16:11:39.849+0000 7f99e8281800 5 AuthRegistry(0x55fb8c9c9560) adding con mode: crc 2024-06-04T16:11:40.142 INFO:tasks.workunit.client.0.smithi144.stderr: -199> 2024-06-04T16:11:39.849+0000 7f99e8281800 5 AuthRegistry(0x55fb8c9c9560) adding con mode: secure 2024-06-04T16:11:40.142 INFO:tasks.workunit.client.0.smithi144.stderr: -198> 2024-06-04T16:11:39.849+0000 7f99e8281800 5 AuthRegistry(0x55fb8c9c9560) adding con mode: crc 2024-06-04T16:11:40.142 INFO:tasks.workunit.client.0.smithi144.stderr: -197> 2024-06-04T16:11:39.849+0000 7f99e8281800 5 AuthRegistry(0x55fb8c9c9560) adding con mode: secure 2024-06-04T16:11:40.142 INFO:tasks.workunit.client.0.smithi144.stderr: -196> 2024-06-04T16:11:39.849+0000 7f99e8281800 5 AuthRegistry(0x55fb8c9c9560) adding con mode: crc 2024-06-04T16:11:40.142 INFO:tasks.workunit.client.0.smithi144.stderr: -195> 2024-06-04T16:11:39.849+0000 7f99e8281800 5 AuthRegistry(0x55fb8c9c9560) adding con mode: crc 2024-06-04T16:11:40.142 INFO:tasks.workunit.client.0.smithi144.stderr: -194> 2024-06-04T16:11:39.849+0000 7f99e8281800 5 AuthRegistry(0x55fb8c9c9560) adding con mode: secure 2024-06-04T16:11:40.142 INFO:tasks.workunit.client.0.smithi144.stderr: -193> 2024-06-04T16:11:39.849+0000 7f99e8281800 5 AuthRegistry(0x55fb8c9c9560) adding con mode: crc 2024-06-04T16:11:40.143 INFO:tasks.workunit.client.0.smithi144.stderr: -192> 2024-06-04T16:11:39.849+0000 7f99e8281800 5 AuthRegistry(0x55fb8c9c9560) adding con mode: secure 2024-06-04T16:11:40.143 INFO:tasks.workunit.client.0.smithi144.stderr: -191> 2024-06-04T16:11:39.849+0000 7f99e8281800 5 AuthRegistry(0x55fb8c9c9560) adding con mode: crc 2024-06-04T16:11:40.143 INFO:tasks.workunit.client.0.smithi144.stderr: -190> 2024-06-04T16:11:39.849+0000 7f99e8281800 5 AuthRegistry(0x55fb8c9c9560) adding con mode: secure 2024-06-04T16:11:40.143 INFO:tasks.workunit.client.0.smithi144.stderr: -189> 2024-06-04T16:11:39.849+0000 7f99e8281800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-06-04T16:11:40.143 INFO:tasks.workunit.client.0.smithi144.stderr: -188> 2024-06-04T16:11:39.849+0000 7f99e8281800 1 librados: starting msgr at 2024-06-04T16:11:40.143 INFO:tasks.workunit.client.0.smithi144.stderr: -187> 2024-06-04T16:11:39.849+0000 7f99e8281800 1 librados: starting objecter 2024-06-04T16:11:40.143 INFO:tasks.workunit.client.0.smithi144.stderr: -186> 2024-06-04T16:11:39.849+0000 7f99e8281800 5 asok(0x55fb8c6dbc60) register_command objecter_requests cmddesc objecter_requests hook 0x55fb8c9ca0a0 EEXIST 2024-06-04T16:11:40.143 INFO:tasks.workunit.client.0.smithi144.stderr: -185> 2024-06-04T16:11:39.849+0000 7f99e8281800 1 librados: setting wanted keys 2024-06-04T16:11:40.143 INFO:tasks.workunit.client.0.smithi144.stderr: -184> 2024-06-04T16:11:39.849+0000 7f99e8281800 1 librados: calling monclient init 2024-06-04T16:11:40.143 INFO:tasks.workunit.client.0.smithi144.stderr: -183> 2024-06-04T16:11:39.849+0000 7f99e8281800 10 monclient: init 2024-06-04T16:11:40.143 INFO:tasks.workunit.client.0.smithi144.stderr: -182> 2024-06-04T16:11:39.849+0000 7f99e8281800 5 AuthRegistry(0x55fb8c99ab90) adding auth protocol: cephx 2024-06-04T16:11:40.143 INFO:tasks.workunit.client.0.smithi144.stderr: -181> 2024-06-04T16:11:39.849+0000 7f99e8281800 5 AuthRegistry(0x55fb8c99ab90) adding auth protocol: cephx 2024-06-04T16:11:40.143 INFO:tasks.workunit.client.0.smithi144.stderr: -180> 2024-06-04T16:11:39.849+0000 7f99e8281800 5 AuthRegistry(0x55fb8c99ab90) adding auth protocol: cephx 2024-06-04T16:11:40.143 INFO:tasks.workunit.client.0.smithi144.stderr: -179> 2024-06-04T16:11:39.849+0000 7f99e8281800 5 AuthRegistry(0x55fb8c99ab90) adding con mode: secure 2024-06-04T16:11:40.144 INFO:tasks.workunit.client.0.smithi144.stderr: -178> 2024-06-04T16:11:39.849+0000 7f99e8281800 5 AuthRegistry(0x55fb8c99ab90) adding con mode: crc 2024-06-04T16:11:40.144 INFO:tasks.workunit.client.0.smithi144.stderr: -177> 2024-06-04T16:11:39.849+0000 7f99e8281800 5 AuthRegistry(0x55fb8c99ab90) adding con mode: secure 2024-06-04T16:11:40.144 INFO:tasks.workunit.client.0.smithi144.stderr: -176> 2024-06-04T16:11:39.849+0000 7f99e8281800 5 AuthRegistry(0x55fb8c99ab90) adding con mode: crc 2024-06-04T16:11:40.144 INFO:tasks.workunit.client.0.smithi144.stderr: -175> 2024-06-04T16:11:39.849+0000 7f99e8281800 5 AuthRegistry(0x55fb8c99ab90) adding con mode: secure 2024-06-04T16:11:40.144 INFO:tasks.workunit.client.0.smithi144.stderr: -174> 2024-06-04T16:11:39.849+0000 7f99e8281800 5 AuthRegistry(0x55fb8c99ab90) adding con mode: crc 2024-06-04T16:11:40.144 INFO:tasks.workunit.client.0.smithi144.stderr: -173> 2024-06-04T16:11:39.849+0000 7f99e8281800 5 AuthRegistry(0x55fb8c99ab90) adding con mode: crc 2024-06-04T16:11:40.144 INFO:tasks.workunit.client.0.smithi144.stderr: -172> 2024-06-04T16:11:39.849+0000 7f99e8281800 5 AuthRegistry(0x55fb8c99ab90) adding con mode: secure 2024-06-04T16:11:40.144 INFO:tasks.workunit.client.0.smithi144.stderr: -171> 2024-06-04T16:11:39.849+0000 7f99e8281800 5 AuthRegistry(0x55fb8c99ab90) adding con mode: crc 2024-06-04T16:11:40.144 INFO:tasks.workunit.client.0.smithi144.stderr: -170> 2024-06-04T16:11:39.849+0000 7f99e8281800 5 AuthRegistry(0x55fb8c99ab90) adding con mode: secure 2024-06-04T16:11:40.144 INFO:tasks.workunit.client.0.smithi144.stderr: -169> 2024-06-04T16:11:39.849+0000 7f99e8281800 5 AuthRegistry(0x55fb8c99ab90) adding con mode: crc 2024-06-04T16:11:40.144 INFO:tasks.workunit.client.0.smithi144.stderr: -168> 2024-06-04T16:11:39.849+0000 7f99e8281800 5 AuthRegistry(0x55fb8c99ab90) adding con mode: secure 2024-06-04T16:11:40.144 INFO:tasks.workunit.client.0.smithi144.stderr: -167> 2024-06-04T16:11:39.849+0000 7f99e8281800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-06-04T16:11:40.144 INFO:tasks.workunit.client.0.smithi144.stderr: -166> 2024-06-04T16:11:39.849+0000 7f99e8281800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-06-04T16:11:40.144 INFO:tasks.workunit.client.0.smithi144.stderr: -165> 2024-06-04T16:11:39.849+0000 7f99e8281800 5 asok(0x55fb8c6dbc60) register_command rotate-key cmddesc rotate-key hook 0x55fb8c99acd8 EEXIST 2024-06-04T16:11:40.145 INFO:tasks.workunit.client.0.smithi144.stderr: -164> 2024-06-04T16:11:39.849+0000 7f99e8281800 10 monclient: _reopen_session rank -1 2024-06-04T16:11:40.145 INFO:tasks.workunit.client.0.smithi144.stderr: -163> 2024-06-04T16:11:39.849+0000 7f99e8281800 10 monclient: _add_conns ranks=[2,1,0] 2024-06-04T16:11:40.145 INFO:tasks.workunit.client.0.smithi144.stderr: -162> 2024-06-04T16:11:39.849+0000 7f99e8281800 10 monclient(hunting): picked mon.noname-c con 0x55fb8c9a1100 addr [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] 2024-06-04T16:11:40.145 INFO:tasks.workunit.client.0.smithi144.stderr: -161> 2024-06-04T16:11:39.849+0000 7f99e8281800 10 monclient(hunting): picked mon.noname-b con 0x55fb8c9c1900 addr [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] 2024-06-04T16:11:40.145 INFO:tasks.workunit.client.0.smithi144.stderr: -160> 2024-06-04T16:11:39.849+0000 7f99e8281800 10 monclient(hunting): picked mon.noname-a con 0x55fb8c9cb880 addr [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] 2024-06-04T16:11:40.145 INFO:tasks.workunit.client.0.smithi144.stderr: -159> 2024-06-04T16:11:39.849+0000 7f99e8281800 10 monclient(hunting): start opening mon connection 2024-06-04T16:11:40.145 INFO:tasks.workunit.client.0.smithi144.stderr: -158> 2024-06-04T16:11:39.849+0000 7f99e8281800 10 monclient(hunting): start opening mon connection 2024-06-04T16:11:40.145 INFO:tasks.workunit.client.0.smithi144.stderr: -157> 2024-06-04T16:11:39.849+0000 7f99e8281800 10 monclient(hunting): start opening mon connection 2024-06-04T16:11:40.145 INFO:tasks.workunit.client.0.smithi144.stderr: -156> 2024-06-04T16:11:39.849+0000 7f99e8281800 10 monclient(hunting): _renew_subs 2024-06-04T16:11:40.145 INFO:tasks.workunit.client.0.smithi144.stderr: -155> 2024-06-04T16:11:39.849+0000 7f99e8281800 10 monclient(hunting): authenticate will time out at 1937.667061s 2024-06-04T16:11:40.145 INFO:tasks.workunit.client.0.smithi144.stderr: -154> 2024-06-04T16:11:39.850+0000 7f99dd575640 10 monclient(hunting): get_auth_request con 0x55fb8c9a1100 auth_method 0 2024-06-04T16:11:40.145 INFO:tasks.workunit.client.0.smithi144.stderr: -153> 2024-06-04T16:11:39.850+0000 7f99dd575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-06-04T16:11:40.145 INFO:tasks.workunit.client.0.smithi144.stderr: -152> 2024-06-04T16:11:39.850+0000 7f99dd575640 10 monclient(hunting): _init_auth method 2 2024-06-04T16:11:40.145 INFO:tasks.workunit.client.0.smithi144.stderr: -151> 2024-06-04T16:11:39.850+0000 7f99dd575640 10 monclient(hunting): _init_auth creating new auth 2024-06-04T16:11:40.146 INFO:tasks.workunit.client.0.smithi144.stderr: -150> 2024-06-04T16:11:39.850+0000 7f99e5d76640 10 monclient(hunting): get_auth_request con 0x55fb8c9cb880 auth_method 0 2024-06-04T16:11:40.146 INFO:tasks.workunit.client.0.smithi144.stderr: -149> 2024-06-04T16:11:39.850+0000 7f99e5d76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-06-04T16:11:40.146 INFO:tasks.workunit.client.0.smithi144.stderr: -148> 2024-06-04T16:11:39.850+0000 7f99e5d76640 10 monclient(hunting): _init_auth method 2 2024-06-04T16:11:40.146 INFO:tasks.workunit.client.0.smithi144.stderr: -147> 2024-06-04T16:11:39.850+0000 7f99e5d76640 10 monclient(hunting): _init_auth creating new auth 2024-06-04T16:11:40.146 INFO:tasks.workunit.client.0.smithi144.stderr: -146> 2024-06-04T16:11:39.850+0000 7f99e6577640 10 monclient(hunting): get_auth_request con 0x55fb8c9c1900 auth_method 0 2024-06-04T16:11:40.146 INFO:tasks.workunit.client.0.smithi144.stderr: -145> 2024-06-04T16:11:39.850+0000 7f99e6577640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-06-04T16:11:40.146 INFO:tasks.workunit.client.0.smithi144.stderr: -144> 2024-06-04T16:11:39.850+0000 7f99e6577640 10 monclient(hunting): _init_auth method 2 2024-06-04T16:11:40.146 INFO:tasks.workunit.client.0.smithi144.stderr: -143> 2024-06-04T16:11:39.850+0000 7f99e6577640 10 monclient(hunting): _init_auth creating new auth 2024-06-04T16:11:40.146 INFO:tasks.workunit.client.0.smithi144.stderr: -142> 2024-06-04T16:11:39.850+0000 7f99dd575640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-06-04T16:11:40.146 INFO:tasks.workunit.client.0.smithi144.stderr: -141> 2024-06-04T16:11:39.850+0000 7f99dd575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-06-04T16:11:40.146 INFO:tasks.workunit.client.0.smithi144.stderr: -140> 2024-06-04T16:11:39.850+0000 7f99dd575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-06-04T16:11:40.146 INFO:tasks.workunit.client.0.smithi144.stderr: -139> 2024-06-04T16:11:39.850+0000 7f99e5d76640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-06-04T16:11:40.146 INFO:tasks.workunit.client.0.smithi144.stderr: -138> 2024-06-04T16:11:39.850+0000 7f99e5d76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-06-04T16:11:40.146 INFO:tasks.workunit.client.0.smithi144.stderr: -137> 2024-06-04T16:11:39.850+0000 7f99e5d76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-06-04T16:11:40.147 INFO:tasks.workunit.client.0.smithi144.stderr: -136> 2024-06-04T16:11:39.850+0000 7f99e6577640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-06-04T16:11:40.150 INFO:tasks.workunit.client.0.smithi144.stderr: -135> 2024-06-04T16:11:39.850+0000 7f99e6577640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-06-04T16:11:40.150 INFO:tasks.workunit.client.0.smithi144.stderr: -134> 2024-06-04T16:11:39.850+0000 7f99e6577640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-06-04T16:11:40.150 INFO:tasks.workunit.client.0.smithi144.stderr: -133> 2024-06-04T16:11:39.850+0000 7f99dd575640 10 monclient(hunting): handle_auth_done global_id 5969 payload 824 2024-06-04T16:11:40.150 INFO:tasks.workunit.client.0.smithi144.stderr: -132> 2024-06-04T16:11:39.850+0000 7f99dd575640 10 monclient: _finish_hunting 0 2024-06-04T16:11:40.150 INFO:tasks.workunit.client.0.smithi144.stderr: -131> 2024-06-04T16:11:39.850+0000 7f99dd575640 1 monclient: found mon.noname-c 2024-06-04T16:11:40.150 INFO:tasks.workunit.client.0.smithi144.stderr: -130> 2024-06-04T16:11:39.850+0000 7f99dd575640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.144:3301/0 2024-06-04T16:11:40.150 INFO:tasks.workunit.client.0.smithi144.stderr: -129> 2024-06-04T16:11:39.850+0000 7f98b77fe640 10 monclient: handle_monmap mon_map magic: 0 2024-06-04T16:11:40.150 INFO:tasks.workunit.client.0.smithi144.stderr: -128> 2024-06-04T16:11:39.850+0000 7f98b77fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-06-04T16:11:40.151 INFO:tasks.workunit.client.0.smithi144.stderr: -127> 2024-06-04T16:11:39.850+0000 7f98b77fe640 10 monclient: dump: 2024-06-04T16:11:40.151 INFO:tasks.workunit.client.0.smithi144.stderr:epoch 1 2024-06-04T16:11:40.151 INFO:tasks.workunit.client.0.smithi144.stderr:fsid 15e56bb1-4856-42f3-b6db-a2c8f23c5557 2024-06-04T16:11:40.151 INFO:tasks.workunit.client.0.smithi144.stderr:last_changed 2024-06-04T15:51:29.789359+0000 2024-06-04T16:11:40.151 INFO:tasks.workunit.client.0.smithi144.stderr:created 2024-06-04T15:51:29.789359+0000 2024-06-04T16:11:40.151 INFO:tasks.workunit.client.0.smithi144.stderr:min_mon_release 19 (squid) 2024-06-04T16:11:40.151 INFO:tasks.workunit.client.0.smithi144.stderr:election_strategy: 1 2024-06-04T16:11:40.151 INFO:tasks.workunit.client.0.smithi144.stderr:0: [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] mon.a 2024-06-04T16:11:40.151 INFO:tasks.workunit.client.0.smithi144.stderr:1: [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] mon.b 2024-06-04T16:11:40.151 INFO:tasks.workunit.client.0.smithi144.stderr:2: [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] mon.c 2024-06-04T16:11:40.151 INFO:tasks.workunit.client.0.smithi144.stderr: 2024-06-04T16:11:40.151 INFO:tasks.workunit.client.0.smithi144.stderr: -126> 2024-06-04T16:11:39.850+0000 7f98b77fe640 10 monclient: _finish_auth 0 2024-06-04T16:11:40.151 INFO:tasks.workunit.client.0.smithi144.stderr: -125> 2024-06-04T16:11:39.850+0000 7f98b77fe640 10 monclient: _check_auth_tickets 2024-06-04T16:11:40.151 INFO:tasks.workunit.client.0.smithi144.stderr: -124> 2024-06-04T16:11:39.850+0000 7f98b77fe640 10 monclient: handle_config config(0 keys) 2024-06-04T16:11:40.152 INFO:tasks.workunit.client.0.smithi144.stderr: -123> 2024-06-04T16:11:39.850+0000 7f98b77fe640 10 monclient: handle_monmap mon_map magic: 0 2024-06-04T16:11:40.152 INFO:tasks.workunit.client.0.smithi144.stderr: -122> 2024-06-04T16:11:39.850+0000 7f98b77fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-06-04T16:11:40.152 INFO:tasks.workunit.client.0.smithi144.stderr: -121> 2024-06-04T16:11:39.850+0000 7f98b77fe640 10 monclient: dump: 2024-06-04T16:11:40.152 INFO:tasks.workunit.client.0.smithi144.stderr:epoch 1 2024-06-04T16:11:40.152 INFO:tasks.workunit.client.0.smithi144.stderr:fsid 15e56bb1-4856-42f3-b6db-a2c8f23c5557 2024-06-04T16:11:40.152 INFO:tasks.workunit.client.0.smithi144.stderr:last_changed 2024-06-04T15:51:29.789359+0000 2024-06-04T16:11:40.152 INFO:tasks.workunit.client.0.smithi144.stderr:created 2024-06-04T15:51:29.789359+0000 2024-06-04T16:11:40.152 INFO:tasks.workunit.client.0.smithi144.stderr:min_mon_release 19 (squid) 2024-06-04T16:11:40.152 INFO:tasks.workunit.client.0.smithi144.stderr:election_strategy: 1 2024-06-04T16:11:40.152 INFO:tasks.workunit.client.0.smithi144.stderr:0: [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] mon.a 2024-06-04T16:11:40.152 INFO:tasks.workunit.client.0.smithi144.stderr:1: [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] mon.b 2024-06-04T16:11:40.152 INFO:tasks.workunit.client.0.smithi144.stderr:2: [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] mon.c 2024-06-04T16:11:40.152 INFO:tasks.workunit.client.0.smithi144.stderr: 2024-06-04T16:11:40.152 INFO:tasks.workunit.client.0.smithi144.stderr: -120> 2024-06-04T16:11:39.850+0000 7f99e8281800 5 monclient: authenticate success, global_id 5969 2024-06-04T16:11:40.153 INFO:tasks.workunit.client.0.smithi144.stderr: -119> 2024-06-04T16:11:39.850+0000 7f99e8281800 10 monclient: _renew_subs 2024-06-04T16:11:40.153 INFO:tasks.workunit.client.0.smithi144.stderr: -118> 2024-06-04T16:11:39.850+0000 7f98c97fa640 4 set_mon_vals no callback set 2024-06-04T16:11:40.153 INFO:tasks.workunit.client.0.smithi144.stderr: -117> 2024-06-04T16:11:39.850+0000 7f99e8281800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.144:3301/0 2024-06-04T16:11:40.153 INFO:tasks.workunit.client.0.smithi144.stderr: -116> 2024-06-04T16:11:39.850+0000 7f99e8281800 10 monclient: _renew_subs 2024-06-04T16:11:40.153 INFO:tasks.workunit.client.0.smithi144.stderr: -115> 2024-06-04T16:11:39.850+0000 7f99e8281800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.144:3301/0 2024-06-04T16:11:40.153 INFO:tasks.workunit.client.0.smithi144.stderr: -114> 2024-06-04T16:11:39.850+0000 7f99e8281800 1 librados: init done 2024-06-04T16:11:40.153 INFO:tasks.workunit.client.0.smithi144.stderr: -113> 2024-06-04T16:11:39.850+0000 7f99e8281800 5 asok(0x55fb8c6dbc60) register_command cr dump hook 0x55fb8c9cabf8 2024-06-04T16:11:40.153 INFO:tasks.workunit.client.0.smithi144.stderr: -112> 2024-06-04T16:11:39.852+0000 7f99e8281800 20 rados->read ofs=0 len=0 2024-06-04T16:11:40.153 INFO:tasks.workunit.client.0.smithi144.stderr: -111> 2024-06-04T16:11:39.852+0000 7f98b77fe640 4 mgrc handle_mgr_map Got map version 5 2024-06-04T16:11:40.153 INFO:tasks.workunit.client.0.smithi144.stderr: -110> 2024-06-04T16:11:39.852+0000 7f98b77fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.177:6832/2645786330,v1:172.21.15.177:6833/2645786330] 2024-06-04T16:11:40.153 INFO:tasks.workunit.client.0.smithi144.stderr: -109> 2024-06-04T16:11:39.852+0000 7f98b77fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.177:6832/2645786330,v1:172.21.15.177:6833/2645786330] 2024-06-04T16:11:40.153 INFO:tasks.workunit.client.0.smithi144.stderr: -108> 2024-06-04T16:11:39.852+0000 7f99e6577640 10 monclient: get_auth_request con 0x7f98b0074ce0 auth_method 0 2024-06-04T16:11:40.153 INFO:tasks.workunit.client.0.smithi144.stderr: -107> 2024-06-04T16:11:39.852+0000 7f99e5d76640 10 monclient: get_auth_request con 0x55fb8c9e96a0 auth_method 0 2024-06-04T16:11:40.154 INFO:tasks.workunit.client.0.smithi144.stderr: -106> 2024-06-04T16:11:39.853+0000 7f99e8281800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:11:40.154 INFO:tasks.workunit.client.0.smithi144.stderr: -105> 2024-06-04T16:11:39.853+0000 7f99e8281800 20 realm 2024-06-04T16:11:40.154 INFO:tasks.workunit.client.0.smithi144.stderr: -104> 2024-06-04T16:11:39.853+0000 7f99e8281800 20 rados->read ofs=0 len=0 2024-06-04T16:11:40.154 INFO:tasks.workunit.client.0.smithi144.stderr: -103> 2024-06-04T16:11:39.853+0000 7f99e8281800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:11:40.154 INFO:tasks.workunit.client.0.smithi144.stderr: -102> 2024-06-04T16:11:39.853+0000 7f99e8281800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-06-04T16:11:40.154 INFO:tasks.workunit.client.0.smithi144.stderr: -101> 2024-06-04T16:11:39.853+0000 7f99e8281800 20 rados->read ofs=0 len=0 2024-06-04T16:11:40.154 INFO:tasks.workunit.client.0.smithi144.stderr: -100> 2024-06-04T16:11:39.853+0000 7f99e8281800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:11:40.154 INFO:tasks.workunit.client.0.smithi144.stderr: -99> 2024-06-04T16:11:39.853+0000 7f99e8281800 20 rados->read ofs=0 len=0 2024-06-04T16:11:40.154 INFO:tasks.workunit.client.0.smithi144.stderr: -98> 2024-06-04T16:11:39.853+0000 7f99dd575640 10 monclient: get_auth_request con 0x55fb8c9ed880 auth_method 0 2024-06-04T16:11:40.154 INFO:tasks.workunit.client.0.smithi144.stderr: -97> 2024-06-04T16:11:39.854+0000 7f99e8281800 20 rados_obj.operate() r=0 bl.length=46 2024-06-04T16:11:40.154 INFO:tasks.workunit.client.0.smithi144.stderr: -96> 2024-06-04T16:11:39.854+0000 7f99e8281800 20 rados->read ofs=0 len=0 2024-06-04T16:11:40.154 INFO:tasks.workunit.client.0.smithi144.stderr: -95> 2024-06-04T16:11:39.854+0000 7f99e6577640 10 monclient: get_auth_request con 0x55fb8c9f1100 auth_method 0 2024-06-04T16:11:40.154 INFO:tasks.workunit.client.0.smithi144.stderr: -94> 2024-06-04T16:11:39.855+0000 7f99e8281800 20 rados_obj.operate() r=0 bl.length=1139 2024-06-04T16:11:40.155 INFO:tasks.workunit.client.0.smithi144.stderr: -93> 2024-06-04T16:11:39.855+0000 7f99e8281800 20 searching for the correct realm 2024-06-04T16:11:40.155 INFO:tasks.workunit.client.0.smithi144.stderr: -92> 2024-06-04T16:11:39.855+0000 7f99e5d76640 10 monclient: get_auth_request con 0x55fb8c9f5ee0 auth_method 0 2024-06-04T16:11:40.155 INFO:tasks.workunit.client.0.smithi144.stderr: -91> 2024-06-04T16:11:39.855+0000 7f99dd575640 10 monclient: get_auth_request con 0x7f99d803e060 auth_method 0 2024-06-04T16:11:40.155 INFO:tasks.workunit.client.0.smithi144.stderr: -90> 2024-06-04T16:11:39.856+0000 7f99e5d76640 0 -- 172.21.15.144:0/533550037 >> [v2:172.21.15.177:6824/800067290,v1:172.21.15.177:6825/800067290] conn(0x55fb8c9e96a0 msgr2=0x55fb8c9ebb10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-06-04T16:11:40.155 INFO:tasks.workunit.client.0.smithi144.stderr: -89> 2024-06-04T16:11:39.856+0000 7f98b77fe640 1 client.5969.objecter ms_handle_reset 0x55fb8c9e96a0 session 0x55fb8c9e8fd0 osd.6 2024-06-04T16:11:40.155 INFO:tasks.workunit.client.0.smithi144.stderr: -88> 2024-06-04T16:11:39.856+0000 7f98b77fe640 10 monclient: _renew_subs 2024-06-04T16:11:40.155 INFO:tasks.workunit.client.0.smithi144.stderr: -87> 2024-06-04T16:11:39.856+0000 7f98b77fe640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.144:3301/0 2024-06-04T16:11:40.155 INFO:tasks.workunit.client.0.smithi144.stderr: -86> 2024-06-04T16:11:39.856+0000 7f99e5d76640 10 monclient: get_auth_request con 0x7f98b0085070 auth_method 0 2024-06-04T16:11:40.155 INFO:tasks.workunit.client.0.smithi144.stderr: -85> 2024-06-04T16:11:39.857+0000 7f99e6577640 10 monclient: get_auth_request con 0x7f99d00cd070 auth_method 0 2024-06-04T16:11:40.155 INFO:tasks.workunit.client.0.smithi144.stderr: -84> 2024-06-04T16:11:39.857+0000 7f99e5d76640 10 monclient: get_auth_request con 0x7f99d8025040 auth_method 0 2024-06-04T16:11:40.155 INFO:tasks.workunit.client.0.smithi144.stderr: -83> 2024-06-04T16:11:39.859+0000 7f99dd575640 0 -- 172.21.15.144:0/533550037 >> [v2:172.21.15.177:6808/2618477608,v1:172.21.15.177:6809/2618477608] conn(0x7f99d006e060 msgr2=0x7f99d009d1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-06-04T16:11:40.155 INFO:tasks.workunit.client.0.smithi144.stderr: -82> 2024-06-04T16:11:40.060+0000 7f99dd575640 10 monclient: get_auth_request con 0x7f99d006e060 auth_method 0 2024-06-04T16:11:40.155 INFO:tasks.workunit.client.0.smithi144.stderr: -81> 2024-06-04T16:11:40.065+0000 7f99e8281800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-06-04T16:11:40.155 INFO:tasks.workunit.client.0.smithi144.stderr: -80> 2024-06-04T16:11:40.065+0000 7f99e8281800 20 RGWRados::pool_iterate: got zone_info.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767 2024-06-04T16:11:40.155 INFO:tasks.workunit.client.0.smithi144.stderr: -79> 2024-06-04T16:11:40.065+0000 7f99e8281800 20 RGWRados::pool_iterate: got default.zone. 2024-06-04T16:11:40.156 INFO:tasks.workunit.client.0.smithi144.stderr: -78> 2024-06-04T16:11:40.065+0000 7f99e8281800 20 RGWRados::pool_iterate: got zonegroup_info.abb22408-c332-4e28-8f7a-ff254ea2fed2 2024-06-04T16:11:40.156 INFO:tasks.workunit.client.0.smithi144.stderr: -77> 2024-06-04T16:11:40.065+0000 7f99e8281800 20 RGWRados::pool_iterate: got zone_names.default 2024-06-04T16:11:40.156 INFO:tasks.workunit.client.0.smithi144.stderr: -76> 2024-06-04T16:11:40.065+0000 7f99e8281800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-06-04T16:11:40.156 INFO:tasks.workunit.client.0.smithi144.stderr: -75> 2024-06-04T16:11:40.065+0000 7f99e8281800 20 rados->read ofs=0 len=0 2024-06-04T16:11:40.156 INFO:tasks.workunit.client.0.smithi144.stderr: -74> 2024-06-04T16:11:40.065+0000 7f99e8281800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:11:40.156 INFO:tasks.workunit.client.0.smithi144.stderr: -73> 2024-06-04T16:11:40.065+0000 7f99e8281800 20 rados->read ofs=0 len=0 2024-06-04T16:11:40.156 INFO:tasks.workunit.client.0.smithi144.stderr: -72> 2024-06-04T16:11:40.066+0000 7f99e8281800 20 rados_obj.operate() r=0 bl.length=46 2024-06-04T16:11:40.156 INFO:tasks.workunit.client.0.smithi144.stderr: -71> 2024-06-04T16:11:40.066+0000 7f99e8281800 20 rados->read ofs=0 len=0 2024-06-04T16:11:40.156 INFO:tasks.workunit.client.0.smithi144.stderr: -70> 2024-06-04T16:11:40.066+0000 7f99e8281800 20 rados_obj.operate() r=0 bl.length=470 2024-06-04T16:11:40.156 INFO:tasks.workunit.client.0.smithi144.stderr: -69> 2024-06-04T16:11:40.066+0000 7f99e8281800 20 zone default found 2024-06-04T16:11:40.156 INFO:tasks.workunit.client.0.smithi144.stderr: -68> 2024-06-04T16:11:40.066+0000 7f99e8281800 4 Realm: () 2024-06-04T16:11:40.156 INFO:tasks.workunit.client.0.smithi144.stderr: -67> 2024-06-04T16:11:40.066+0000 7f99e8281800 4 ZoneGroup: default (abb22408-c332-4e28-8f7a-ff254ea2fed2) 2024-06-04T16:11:40.156 INFO:tasks.workunit.client.0.smithi144.stderr: -66> 2024-06-04T16:11:40.066+0000 7f99e8281800 4 Zone: default (be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767) 2024-06-04T16:11:40.157 INFO:tasks.workunit.client.0.smithi144.stderr: -65> 2024-06-04T16:11:40.066+0000 7f99e8281800 10 cannot find current period zonegroup using local zonegroup configuration 2024-06-04T16:11:40.157 INFO:tasks.workunit.client.0.smithi144.stderr: -64> 2024-06-04T16:11:40.066+0000 7f99e8281800 20 zonegroup default 2024-06-04T16:11:40.157 INFO:tasks.workunit.client.0.smithi144.stderr: -63> 2024-06-04T16:11:40.066+0000 7f99e8281800 20 rados->read ofs=0 len=0 2024-06-04T16:11:40.157 INFO:tasks.workunit.client.0.smithi144.stderr: -62> 2024-06-04T16:11:40.066+0000 7f99e8281800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:11:40.157 INFO:tasks.workunit.client.0.smithi144.stderr: -61> 2024-06-04T16:11:40.066+0000 7f99e8281800 20 rados->read ofs=0 len=0 2024-06-04T16:11:40.157 INFO:tasks.workunit.client.0.smithi144.stderr: -60> 2024-06-04T16:11:40.067+0000 7f99e8281800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:11:40.157 INFO:tasks.workunit.client.0.smithi144.stderr: -59> 2024-06-04T16:11:40.067+0000 7f99e8281800 20 rados->read ofs=0 len=0 2024-06-04T16:11:40.157 INFO:tasks.workunit.client.0.smithi144.stderr: -58> 2024-06-04T16:11:40.067+0000 7f99e8281800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:11:40.157 INFO:tasks.workunit.client.0.smithi144.stderr: -57> 2024-06-04T16:11:40.067+0000 7f99e8281800 20 started sync module instance, tier type = 2024-06-04T16:11:40.157 INFO:tasks.workunit.client.0.smithi144.stderr: -56> 2024-06-04T16:11:40.067+0000 7f99e8281800 20 started zone id=be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767 (name=default) with tier type = 2024-06-04T16:11:40.157 INFO:tasks.workunit.client.0.smithi144.stderr: -55> 2024-06-04T16:11:40.076+0000 7f99e8281800 20 add_watcher() i=0 2024-06-04T16:11:40.157 INFO:tasks.workunit.client.0.smithi144.stderr: -54> 2024-06-04T16:11:40.076+0000 7f99e8281800 20 add_watcher() i=1 2024-06-04T16:11:40.157 INFO:tasks.workunit.client.0.smithi144.stderr: -53> 2024-06-04T16:11:40.076+0000 7f99e8281800 20 add_watcher() i=2 2024-06-04T16:11:40.158 INFO:tasks.workunit.client.0.smithi144.stderr: -52> 2024-06-04T16:11:40.076+0000 7f99e8281800 20 add_watcher() i=3 2024-06-04T16:11:40.158 INFO:tasks.workunit.client.0.smithi144.stderr: -51> 2024-06-04T16:11:40.076+0000 7f99e8281800 20 add_watcher() i=4 2024-06-04T16:11:40.158 INFO:tasks.workunit.client.0.smithi144.stderr: -50> 2024-06-04T16:11:40.076+0000 7f99e8281800 20 add_watcher() i=5 2024-06-04T16:11:40.158 INFO:tasks.workunit.client.0.smithi144.stderr: -49> 2024-06-04T16:11:40.076+0000 7f99e8281800 20 add_watcher() i=6 2024-06-04T16:11:40.158 INFO:tasks.workunit.client.0.smithi144.stderr: -48> 2024-06-04T16:11:40.077+0000 7f99e8281800 20 add_watcher() i=7 2024-06-04T16:11:40.158 INFO:tasks.workunit.client.0.smithi144.stderr: -47> 2024-06-04T16:11:40.077+0000 7f99e8281800 2 all 8 watchers are set, enabling cache 2024-06-04T16:11:40.158 INFO:tasks.workunit.client.0.smithi144.stderr: -46> 2024-06-04T16:11:40.078+0000 7f99e8281800 5 AuthRegistry(0x7ffdc44ea190) adding auth protocol: cephx 2024-06-04T16:11:40.158 INFO:tasks.workunit.client.0.smithi144.stderr: -45> 2024-06-04T16:11:40.078+0000 7f99e8281800 5 AuthRegistry(0x7ffdc44ea190) adding auth protocol: cephx 2024-06-04T16:11:40.158 INFO:tasks.workunit.client.0.smithi144.stderr: -44> 2024-06-04T16:11:40.078+0000 7f99e8281800 5 AuthRegistry(0x7ffdc44ea190) adding auth protocol: cephx 2024-06-04T16:11:40.158 INFO:tasks.workunit.client.0.smithi144.stderr: -43> 2024-06-04T16:11:40.078+0000 7f99e8281800 5 AuthRegistry(0x7ffdc44ea190) adding con mode: secure 2024-06-04T16:11:40.158 INFO:tasks.workunit.client.0.smithi144.stderr: -42> 2024-06-04T16:11:40.078+0000 7f99e8281800 5 AuthRegistry(0x7ffdc44ea190) adding con mode: crc 2024-06-04T16:11:40.158 INFO:tasks.workunit.client.0.smithi144.stderr: -41> 2024-06-04T16:11:40.078+0000 7f99e8281800 5 AuthRegistry(0x7ffdc44ea190) adding con mode: secure 2024-06-04T16:11:40.158 INFO:tasks.workunit.client.0.smithi144.stderr: -40> 2024-06-04T16:11:40.078+0000 7f99e8281800 5 AuthRegistry(0x7ffdc44ea190) adding con mode: crc 2024-06-04T16:11:40.159 INFO:tasks.workunit.client.0.smithi144.stderr: -39> 2024-06-04T16:11:40.078+0000 7f99e8281800 5 AuthRegistry(0x7ffdc44ea190) adding con mode: secure 2024-06-04T16:11:40.159 INFO:tasks.workunit.client.0.smithi144.stderr: -38> 2024-06-04T16:11:40.078+0000 7f99e8281800 5 AuthRegistry(0x7ffdc44ea190) adding con mode: crc 2024-06-04T16:11:40.159 INFO:tasks.workunit.client.0.smithi144.stderr: -37> 2024-06-04T16:11:40.078+0000 7f98977fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-06-04T16:11:40.159 INFO:tasks.workunit.client.0.smithi144.stderr: -36> 2024-06-04T16:11:40.078+0000 7f99e8281800 5 AuthRegistry(0x7ffdc44ea190) adding con mode: crc 2024-06-04T16:11:40.159 INFO:tasks.workunit.client.0.smithi144.stderr: -35> 2024-06-04T16:11:40.078+0000 7f99e8281800 5 AuthRegistry(0x7ffdc44ea190) adding con mode: secure 2024-06-04T16:11:40.159 INFO:tasks.workunit.client.0.smithi144.stderr: -34> 2024-06-04T16:11:40.078+0000 7f99e8281800 5 AuthRegistry(0x7ffdc44ea190) adding con mode: crc 2024-06-04T16:11:40.159 INFO:tasks.workunit.client.0.smithi144.stderr: -33> 2024-06-04T16:11:40.078+0000 7f99e8281800 5 AuthRegistry(0x7ffdc44ea190) adding con mode: secure 2024-06-04T16:11:40.159 INFO:tasks.workunit.client.0.smithi144.stderr: -32> 2024-06-04T16:11:40.078+0000 7f99e8281800 5 AuthRegistry(0x7ffdc44ea190) adding con mode: crc 2024-06-04T16:11:40.159 INFO:tasks.workunit.client.0.smithi144.stderr: -31> 2024-06-04T16:11:40.078+0000 7f99e8281800 5 AuthRegistry(0x7ffdc44ea190) adding con mode: secure 2024-06-04T16:11:40.159 INFO:tasks.workunit.client.0.smithi144.stderr: -30> 2024-06-04T16:11:40.079+0000 7f99e8281800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-06-04T16:11:40.159 INFO:tasks.workunit.client.0.smithi144.stderr: -29> 2024-06-04T16:11:40.079+0000 7f99e8281800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-06-04T16:11:40.159 INFO:tasks.workunit.client.0.smithi144.stderr: -28> 2024-06-04T16:11:40.079+0000 7f99e8281800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-06-04T16:11:40.159 INFO:tasks.workunit.client.0.smithi144.stderr: -27> 2024-06-04T16:11:40.079+0000 7f99e8281800 5 asok(0x55fb8c6dbc60) register_command cache list hook 0x55fb8c9d3490 2024-06-04T16:11:40.159 INFO:tasks.workunit.client.0.smithi144.stderr: -26> 2024-06-04T16:11:40.079+0000 7f99e8281800 5 asok(0x55fb8c6dbc60) register_command cache inspect hook 0x55fb8c9d3490 2024-06-04T16:11:40.160 INFO:tasks.workunit.client.0.smithi144.stderr: -25> 2024-06-04T16:11:40.079+0000 7f99e8281800 5 asok(0x55fb8c6dbc60) register_command cache erase hook 0x55fb8c9d3490 2024-06-04T16:11:40.160 INFO:tasks.workunit.client.0.smithi144.stderr: -24> 2024-06-04T16:11:40.079+0000 7f99e8281800 5 asok(0x55fb8c6dbc60) register_command cache zap hook 0x55fb8c9d3490 2024-06-04T16:11:40.160 INFO:tasks.workunit.client.0.smithi144.stderr: -23> 2024-06-04T16:11:40.079+0000 7f99e8281800 5 note: GC not initialized 2024-06-04T16:11:40.160 INFO:tasks.workunit.client.0.smithi144.stderr: -22> 2024-06-04T16:11:40.079+0000 7f98967fc640 20 reqs_thread_entry: start 2024-06-04T16:11:40.160 INFO:tasks.workunit.client.0.smithi144.stderr: -21> 2024-06-04T16:11:40.079+0000 7f99e8281800 5 asok(0x55fb8c6dbc60) register_command sync trace show hook 0x7f99d4001d30 2024-06-04T16:11:40.160 INFO:tasks.workunit.client.0.smithi144.stderr: -20> 2024-06-04T16:11:40.079+0000 7f99e8281800 5 asok(0x55fb8c6dbc60) register_command sync trace history hook 0x7f99d4001d30 2024-06-04T16:11:40.160 INFO:tasks.workunit.client.0.smithi144.stderr: -19> 2024-06-04T16:11:40.079+0000 7f99e8281800 5 asok(0x55fb8c6dbc60) register_command sync trace active hook 0x7f99d4001d30 2024-06-04T16:11:40.160 INFO:tasks.workunit.client.0.smithi144.stderr: -18> 2024-06-04T16:11:40.079+0000 7f99e8281800 5 asok(0x55fb8c6dbc60) register_command sync trace active_short hook 0x7f99d4001d30 2024-06-04T16:11:40.160 INFO:tasks.workunit.client.0.smithi144.stderr: -17> 2024-06-04T16:11:40.079+0000 7f99e8281800 20 init_complete bucket index max shards: 11 2024-06-04T16:11:40.160 INFO:tasks.workunit.client.0.smithi144.stderr: -16> 2024-06-04T16:11:40.079+0000 7f99e8281800 20 Filter name: none 2024-06-04T16:11:40.160 INFO:tasks.workunit.client.0.smithi144.stderr: -15> 2024-06-04T16:11:40.079+0000 7f9807fff640 20 reqs_thread_entry: start 2024-06-04T16:11:40.160 INFO:tasks.workunit.client.0.smithi144.stderr: -14> 2024-06-04T16:11:40.079+0000 7f99e8281800 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2024-06-04T16:11:40.160 INFO:tasks.workunit.client.0.smithi144.stderr: -13> 2024-06-04T16:11:40.079+0000 7f99e8281800 20 rados->read ofs=0 len=0 2024-06-04T16:11:40.160 INFO:tasks.workunit.client.0.smithi144.stderr: -12> 2024-06-04T16:11:40.080+0000 7f99e8281800 20 rados_obj.operate() r=0 bl.length=194 2024-06-04T16:11:40.161 INFO:tasks.workunit.client.0.smithi144.stderr: -11> 2024-06-04T16:11:40.080+0000 7f99e8281800 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2024-06-04T16:11:40.161 INFO:tasks.workunit.client.0.smithi144.stderr: -10> 2024-06-04T16:11:40.080+0000 7f99e8281800 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2024-06-04T16:11:40.161 INFO:tasks.workunit.client.0.smithi144.stderr: -9> 2024-06-04T16:11:40.080+0000 7f99e8281800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.21 : miss 2024-06-04T16:11:40.161 INFO:tasks.workunit.client.0.smithi144.stderr: -8> 2024-06-04T16:11:40.080+0000 7f99e8281800 20 rados->read ofs=0 len=0 2024-06-04T16:11:40.161 INFO:tasks.workunit.client.0.smithi144.stderr: -7> 2024-06-04T16:11:40.080+0000 7f99e8281800 20 rados_obj.operate() r=0 bl.length=408 2024-06-04T16:11:40.161 INFO:tasks.workunit.client.0.smithi144.stderr: -6> 2024-06-04T16:11:40.080+0000 7f99e8281800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.21 info.flags=0x17 2024-06-04T16:11:40.161 INFO:tasks.workunit.client.0.smithi144.stderr: -5> 2024-06-04T16:11:40.080+0000 7f99e8281800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.21 to cache LRU end 2024-06-04T16:11:40.161 INFO:tasks.workunit.client.0.smithi144.stderr: -4> 2024-06-04T16:11:40.080+0000 7f99e8281800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-06-04T16:11:40.161 INFO:tasks.workunit.client.0.smithi144.stderr: -3> 2024-06-04T16:11:40.080+0000 7f99e8281800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-06-04T16:11:40.161 INFO:tasks.workunit.client.0.smithi144.stderr: -2> 2024-06-04T16:11:40.080+0000 7f99e8281800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.21 2024-06-04T16:11:40.161 INFO:tasks.workunit.client.0.smithi144.stderr: -1> 2024-06-04T16:11:40.089+0000 7f99e8281800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-4027-g65533a90/rpm/el9/BUILD/ceph-19.0.0-4027-g65533a90/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f99e8281800 time 2024-06-04T16:11:40.090689+0000 2024-06-04T16:11:40.161 INFO:tasks.workunit.client.0.smithi144.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-4027-g65533a90/rpm/el9/BUILD/ceph-19.0.0-4027-g65533a90/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-06-04T16:11:40.161 INFO:tasks.workunit.client.0.smithi144.stderr: 2024-06-04T16:11:40.162 INFO:tasks.workunit.client.0.smithi144.stderr: ceph version 19.0.0-4027-g65533a90 (65533a907fc9add1863609703fdbbea67993c8ef) squid (dev) 2024-06-04T16:11:40.162 INFO:tasks.workunit.client.0.smithi144.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f99eb581dce] 2024-06-04T16:11:40.162 INFO:tasks.workunit.client.0.smithi144.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x181f8c) [0x7f99eb581f8c] 2024-06-04T16:11:40.162 INFO:tasks.workunit.client.0.smithi144.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55fb8b980fb1] 2024-06-04T16:11:40.162 INFO:tasks.workunit.client.0.smithi144.stderr: 4: radosgw-admin(+0x845a9a) [0x55fb8b987a9a] 2024-06-04T16:11:40.162 INFO:tasks.workunit.client.0.smithi144.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x267) [0x55fb8b98c2d7] 2024-06-04T16:11:40.162 INFO:tasks.workunit.client.0.smithi144.stderr: 6: main() 2024-06-04T16:11:40.162 INFO:tasks.workunit.client.0.smithi144.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f99ea429590] 2024-06-04T16:11:40.162 INFO:tasks.workunit.client.0.smithi144.stderr: 8: __libc_start_main() 2024-06-04T16:11:40.162 INFO:tasks.workunit.client.0.smithi144.stderr: 9: _start() 2024-06-04T16:11:40.162 INFO:tasks.workunit.client.0.smithi144.stderr: 2024-06-04T16:11:40.162 INFO:tasks.workunit.client.0.smithi144.stderr: 0> 2024-06-04T16:11:40.090+0000 7f99e8281800 -1 *** Caught signal (Aborted) ** 2024-06-04T16:11:40.162 INFO:tasks.workunit.client.0.smithi144.stderr: in thread 7f99e8281800 thread_name:radosgw-admin 2024-06-04T16:11:40.162 INFO:tasks.workunit.client.0.smithi144.stderr: 2024-06-04T16:11:40.163 INFO:tasks.workunit.client.0.smithi144.stderr: ceph version 19.0.0-4027-g65533a90 (65533a907fc9add1863609703fdbbea67993c8ef) squid (dev) 2024-06-04T16:11:40.163 INFO:tasks.workunit.client.0.smithi144.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f99ea43e6f0] 2024-06-04T16:11:40.163 INFO:tasks.workunit.client.0.smithi144.stderr: 2: /lib64/libc.so.6(+0x8b94c) [0x7f99ea48b94c] 2024-06-04T16:11:40.163 INFO:tasks.workunit.client.0.smithi144.stderr: 3: raise() 2024-06-04T16:11:40.163 INFO:tasks.workunit.client.0.smithi144.stderr: 4: abort() 2024-06-04T16:11:40.163 INFO:tasks.workunit.client.0.smithi144.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f99eb581e28] 2024-06-04T16:11:40.163 INFO:tasks.workunit.client.0.smithi144.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x181f8c) [0x7f99eb581f8c] 2024-06-04T16:11:40.163 INFO:tasks.workunit.client.0.smithi144.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55fb8b980fb1] 2024-06-04T16:11:40.163 INFO:tasks.workunit.client.0.smithi144.stderr: 8: radosgw-admin(+0x845a9a) [0x55fb8b987a9a] 2024-06-04T16:11:40.163 INFO:tasks.workunit.client.0.smithi144.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x267) [0x55fb8b98c2d7] 2024-06-04T16:11:40.163 INFO:tasks.workunit.client.0.smithi144.stderr: 10: main() 2024-06-04T16:11:40.163 INFO:tasks.workunit.client.0.smithi144.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f99ea429590] 2024-06-04T16:11:40.163 INFO:tasks.workunit.client.0.smithi144.stderr: 12: __libc_start_main() 2024-06-04T16:11:40.164 INFO:tasks.workunit.client.0.smithi144.stderr: 13: _start() 2024-06-04T16:11:40.164 INFO:tasks.workunit.client.0.smithi144.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-06-04T16:11:40.164 INFO:tasks.workunit.client.0.smithi144.stderr: 2024-06-04T16:11:40.164 INFO:tasks.workunit.client.0.smithi144.stderr:--- logging levels --- 2024-06-04T16:11:40.164 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 5 none 2024-06-04T16:11:40.164 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 1 lockdep 2024-06-04T16:11:40.164 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 1 context 2024-06-04T16:11:40.164 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 1 crush 2024-06-04T16:11:40.164 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 5 mds 2024-06-04T16:11:40.164 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 5 mds_balancer 2024-06-04T16:11:40.164 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 5 mds_locker 2024-06-04T16:11:40.164 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 5 mds_log 2024-06-04T16:11:40.164 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 5 mds_log_expire 2024-06-04T16:11:40.164 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 5 mds_migrator 2024-06-04T16:11:40.165 INFO:tasks.workunit.client.0.smithi144.stderr: 3/ 5 mds_quiesce 2024-06-04T16:11:40.165 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 1 buffer 2024-06-04T16:11:40.165 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 1 timer 2024-06-04T16:11:40.165 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 1 filer 2024-06-04T16:11:40.165 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 1 striper 2024-06-04T16:11:40.165 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 1 objecter 2024-06-04T16:11:40.165 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 5 rados 2024-06-04T16:11:40.165 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 5 rbd 2024-06-04T16:11:40.165 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 5 rbd_mirror 2024-06-04T16:11:40.165 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 5 rbd_replay 2024-06-04T16:11:40.165 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 5 rbd_pwl 2024-06-04T16:11:40.165 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 5 journaler 2024-06-04T16:11:40.165 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 5 objectcacher 2024-06-04T16:11:40.165 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 5 immutable_obj_cache 2024-06-04T16:11:40.165 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 5 client 2024-06-04T16:11:40.166 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 5 osd 2024-06-04T16:11:40.166 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 5 optracker 2024-06-04T16:11:40.166 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 5 objclass 2024-06-04T16:11:40.166 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 3 filestore 2024-06-04T16:11:40.166 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 3 journal 2024-06-04T16:11:40.166 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 0 ms 2024-06-04T16:11:40.166 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 5 mon 2024-06-04T16:11:40.166 INFO:tasks.workunit.client.0.smithi144.stderr: 0/10 monc 2024-06-04T16:11:40.166 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 5 paxos 2024-06-04T16:11:40.166 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 5 tp 2024-06-04T16:11:40.166 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 5 auth 2024-06-04T16:11:40.166 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 5 crypto 2024-06-04T16:11:40.166 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 1 finisher 2024-06-04T16:11:40.167 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 1 reserver 2024-06-04T16:11:40.167 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 5 heartbeatmap 2024-06-04T16:11:40.167 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 5 perfcounter 2024-06-04T16:11:40.167 INFO:tasks.workunit.client.0.smithi144.stderr: 20/20 rgw 2024-06-04T16:11:40.167 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 5 rgw_sync 2024-06-04T16:11:40.167 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 5 rgw_datacache 2024-06-04T16:11:40.167 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 5 rgw_access 2024-06-04T16:11:40.167 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 5 rgw_dbstore 2024-06-04T16:11:40.167 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 5 rgw_flight 2024-06-04T16:11:40.167 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 5 rgw_lifecycle 2024-06-04T16:11:40.167 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 5 rgw_notification 2024-06-04T16:11:40.167 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 5 javaclient 2024-06-04T16:11:40.167 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 5 asok 2024-06-04T16:11:40.167 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 1 throttle 2024-06-04T16:11:40.168 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 0 refs 2024-06-04T16:11:40.168 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 5 compressor 2024-06-04T16:11:40.168 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 5 bluestore 2024-06-04T16:11:40.168 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 5 bluefs 2024-06-04T16:11:40.168 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 3 bdev 2024-06-04T16:11:40.168 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 5 kstore 2024-06-04T16:11:40.168 INFO:tasks.workunit.client.0.smithi144.stderr: 4/ 5 rocksdb 2024-06-04T16:11:40.168 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 5 fuse 2024-06-04T16:11:40.168 INFO:tasks.workunit.client.0.smithi144.stderr: 2/ 5 mgr 2024-06-04T16:11:40.168 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 5 mgrc 2024-06-04T16:11:40.168 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 5 dpdk 2024-06-04T16:11:40.168 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 5 eventtrace 2024-06-04T16:11:40.168 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 5 prioritycache 2024-06-04T16:11:40.168 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 5 test 2024-06-04T16:11:40.168 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 5 cephfs_mirror 2024-06-04T16:11:40.169 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 5 cephsqlite 2024-06-04T16:11:40.169 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 5 crimson_interrupt 2024-06-04T16:11:40.169 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 5 seastore 2024-06-04T16:11:40.169 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 5 seastore_onode 2024-06-04T16:11:40.169 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 5 seastore_odata 2024-06-04T16:11:40.169 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 5 seastore_omap 2024-06-04T16:11:40.169 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 5 seastore_tm 2024-06-04T16:11:40.169 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 5 seastore_t 2024-06-04T16:11:40.169 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 5 seastore_cleaner 2024-06-04T16:11:40.169 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 5 seastore_epm 2024-06-04T16:11:40.169 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 5 seastore_lba 2024-06-04T16:11:40.169 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 5 seastore_fixedkv_tree 2024-06-04T16:11:40.169 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 5 seastore_cache 2024-06-04T16:11:40.169 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 5 seastore_journal 2024-06-04T16:11:40.170 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 5 seastore_device 2024-06-04T16:11:40.170 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 5 seastore_backref 2024-06-04T16:11:40.170 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 5 alienstore 2024-06-04T16:11:40.170 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 5 mclock 2024-06-04T16:11:40.170 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 5 cyanstore 2024-06-04T16:11:40.170 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 5 ceph_exporter 2024-06-04T16:11:40.170 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 5 memstore 2024-06-04T16:11:40.170 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 5 trace 2024-06-04T16:11:40.170 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 5 ceph_dedup 2024-06-04T16:11:40.170 INFO:tasks.workunit.client.0.smithi144.stderr: -2/-2 (syslog threshold) 2024-06-04T16:11:40.170 INFO:tasks.workunit.client.0.smithi144.stderr: 99/99 (stderr threshold) 2024-06-04T16:11:40.170 INFO:tasks.workunit.client.0.smithi144.stderr:--- pthread ID / name mapping for recent threads --- 2024-06-04T16:11:40.170 INFO:tasks.workunit.client.0.smithi144.stderr: 7f9807fff640 / http_manager 2024-06-04T16:11:40.170 INFO:tasks.workunit.client.0.smithi144.stderr: 7f98967fc640 / http_manager 2024-06-04T16:11:40.171 INFO:tasks.workunit.client.0.smithi144.stderr: 7f98977fe640 / rgw_dt_lg_renew 2024-06-04T16:11:40.171 INFO:tasks.workunit.client.0.smithi144.stderr: 7f98b77fe640 / ms_dispatch 2024-06-04T16:11:40.171 INFO:tasks.workunit.client.0.smithi144.stderr: 7f98c97fa640 / io_context_pool 2024-06-04T16:11:40.171 INFO:tasks.workunit.client.0.smithi144.stderr: 7f98cb7fe640 / ms_dispatch 2024-06-04T16:11:40.171 INFO:tasks.workunit.client.0.smithi144.stderr: 7f98d2604640 / ms_dispatch 2024-06-04T16:11:40.171 INFO:tasks.workunit.client.0.smithi144.stderr: 7f98d3e07640 / io_context_pool 2024-06-04T16:11:40.171 INFO:tasks.workunit.client.0.smithi144.stderr: 7f99dd575640 / msgr-worker-2 2024-06-04T16:11:40.171 INFO:tasks.workunit.client.0.smithi144.stderr: 7f99e5d76640 / msgr-worker-1 2024-06-04T16:11:40.171 INFO:tasks.workunit.client.0.smithi144.stderr: 7f99e6577640 / msgr-worker-0 2024-06-04T16:11:40.171 INFO:tasks.workunit.client.0.smithi144.stderr: 7f99e6d78640 / io_context_pool 2024-06-04T16:11:40.171 INFO:tasks.workunit.client.0.smithi144.stderr: 7f99e8281800 / radosgw-admin 2024-06-04T16:11:40.171 INFO:tasks.workunit.client.0.smithi144.stderr: max_recent 500 2024-06-04T16:11:40.171 INFO:tasks.workunit.client.0.smithi144.stderr: max_new 1000 2024-06-04T16:11:40.171 INFO:tasks.workunit.client.0.smithi144.stderr: log_file /var/log/ceph/ceph-client.admin.89775.log 2024-06-04T16:11:40.172 INFO:tasks.workunit.client.0.smithi144.stderr:--- end dump of recent events --- 2024-06-04T16:11:40.172 INFO:tasks.workunit.client.0.smithi144.stderr:--- begin dump of recent events --- 2024-06-04T16:11:40.172 INFO:tasks.workunit.client.0.smithi144.stderr: -499> 2024-06-04T16:11:39.835+0000 7f98d3e07640 10 monclient: _check_auth_tickets 2024-06-04T16:11:40.172 INFO:tasks.workunit.client.0.smithi144.stderr: -498> 2024-06-04T16:11:39.835+0000 7f98d3e07640 10 monclient: handle_config config(0 keys) 2024-06-04T16:11:40.172 INFO:tasks.workunit.client.0.smithi144.stderr: -497> 2024-06-04T16:11:39.835+0000 7f99e8281800 5 monclient: authenticate success, global_id 5957 2024-06-04T16:11:40.172 INFO:tasks.workunit.client.0.smithi144.stderr: -496> 2024-06-04T16:11:39.835+0000 7f99e8281800 10 monclient: get_monmap_and_config success 2024-06-04T16:11:40.172 INFO:tasks.workunit.client.0.smithi144.stderr: -495> 2024-06-04T16:11:39.835+0000 7f99e8281800 4 set_mon_vals no callback set 2024-06-04T16:11:40.172 INFO:tasks.workunit.client.0.smithi144.stderr: -494> 2024-06-04T16:11:39.835+0000 7f98d3e07640 10 monclient: handle_monmap mon_map magic: 0 2024-06-04T16:11:40.172 INFO:tasks.workunit.client.0.smithi144.stderr: -493> 2024-06-04T16:11:39.835+0000 7f98d3e07640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-06-04T16:11:40.172 INFO:tasks.workunit.client.0.smithi144.stderr: -492> 2024-06-04T16:11:39.835+0000 7f98d3e07640 10 monclient: dump: 2024-06-04T16:11:40.172 INFO:tasks.workunit.client.0.smithi144.stderr:epoch 1 2024-06-04T16:11:40.172 INFO:tasks.workunit.client.0.smithi144.stderr:fsid 15e56bb1-4856-42f3-b6db-a2c8f23c5557 2024-06-04T16:11:40.172 INFO:tasks.workunit.client.0.smithi144.stderr:last_changed 2024-06-04T15:51:29.789359+0000 2024-06-04T16:11:40.172 INFO:tasks.workunit.client.0.smithi144.stderr:created 2024-06-04T15:51:29.789359+0000 2024-06-04T16:11:40.173 INFO:tasks.workunit.client.0.smithi144.stderr:min_mon_release 19 (squid) 2024-06-04T16:11:40.173 INFO:tasks.workunit.client.0.smithi144.stderr:election_strategy: 1 2024-06-04T16:11:40.173 INFO:tasks.workunit.client.0.smithi144.stderr:0: [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] mon.a 2024-06-04T16:11:40.173 INFO:tasks.workunit.client.0.smithi144.stderr:1: [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] mon.b 2024-06-04T16:11:40.173 INFO:tasks.workunit.client.0.smithi144.stderr:2: [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] mon.c 2024-06-04T16:11:40.173 INFO:tasks.workunit.client.0.smithi144.stderr: 2024-06-04T16:11:40.173 INFO:tasks.workunit.client.0.smithi144.stderr: -491> 2024-06-04T16:11:39.835+0000 7f99e8281800 10 monclient: shutdown 2024-06-04T16:11:40.173 INFO:tasks.workunit.client.0.smithi144.stderr: -490> 2024-06-04T16:11:39.835+0000 7f99e8281800 5 asok(0x55fb8c6dbc60) unregister_commands rotate-key 2024-06-04T16:11:40.173 INFO:tasks.workunit.client.0.smithi144.stderr: -489> 2024-06-04T16:11:39.836+0000 7f99e8281800 10 monclient: build_initial_monmap 2024-06-04T16:11:40.173 INFO:tasks.workunit.client.0.smithi144.stderr: -488> 2024-06-04T16:11:39.836+0000 7f99e8281800 1 build_initial for_mkfs: 0 2024-06-04T16:11:40.173 INFO:tasks.workunit.client.0.smithi144.stderr: -487> 2024-06-04T16:11:39.836+0000 7f99e8281800 10 monclient: monmap: 2024-06-04T16:11:40.173 INFO:tasks.workunit.client.0.smithi144.stderr:epoch 0 2024-06-04T16:11:40.173 INFO:tasks.workunit.client.0.smithi144.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-06-04T16:11:40.174 INFO:tasks.workunit.client.0.smithi144.stderr:last_changed 0.000000 2024-06-04T16:11:40.174 INFO:tasks.workunit.client.0.smithi144.stderr:created 0.000000 2024-06-04T16:11:40.174 INFO:tasks.workunit.client.0.smithi144.stderr:min_mon_release 0 (unknown) 2024-06-04T16:11:40.174 INFO:tasks.workunit.client.0.smithi144.stderr:election_strategy: 1 2024-06-04T16:11:40.174 INFO:tasks.workunit.client.0.smithi144.stderr:0: [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] mon.noname-a 2024-06-04T16:11:40.174 INFO:tasks.workunit.client.0.smithi144.stderr:1: [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] mon.noname-b 2024-06-04T16:11:40.174 INFO:tasks.workunit.client.0.smithi144.stderr:2: [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] mon.noname-c 2024-06-04T16:11:40.174 INFO:tasks.workunit.client.0.smithi144.stderr: 2024-06-04T16:11:40.174 INFO:tasks.workunit.client.0.smithi144.stderr: -486> 2024-06-04T16:11:39.836+0000 7f99e8281800 5 AuthRegistry(0x55fb8c8ff8b0) adding auth protocol: cephx 2024-06-04T16:11:40.174 INFO:tasks.workunit.client.0.smithi144.stderr: -485> 2024-06-04T16:11:39.836+0000 7f99e8281800 5 AuthRegistry(0x55fb8c8ff8b0) adding auth protocol: cephx 2024-06-04T16:11:40.174 INFO:tasks.workunit.client.0.smithi144.stderr: -484> 2024-06-04T16:11:39.836+0000 7f99e8281800 5 AuthRegistry(0x55fb8c8ff8b0) adding auth protocol: cephx 2024-06-04T16:11:40.174 INFO:tasks.workunit.client.0.smithi144.stderr: -483> 2024-06-04T16:11:39.836+0000 7f99e8281800 5 AuthRegistry(0x55fb8c8ff8b0) adding con mode: secure 2024-06-04T16:11:40.174 INFO:tasks.workunit.client.0.smithi144.stderr: -482> 2024-06-04T16:11:39.836+0000 7f99e8281800 5 AuthRegistry(0x55fb8c8ff8b0) adding con mode: crc 2024-06-04T16:11:40.174 INFO:tasks.workunit.client.0.smithi144.stderr: -481> 2024-06-04T16:11:39.836+0000 7f99e8281800 5 AuthRegistry(0x55fb8c8ff8b0) adding con mode: secure 2024-06-04T16:11:40.175 INFO:tasks.workunit.client.0.smithi144.stderr: -480> 2024-06-04T16:11:39.836+0000 7f99e8281800 5 AuthRegistry(0x55fb8c8ff8b0) adding con mode: crc 2024-06-04T16:11:40.175 INFO:tasks.workunit.client.0.smithi144.stderr: -479> 2024-06-04T16:11:39.836+0000 7f99e8281800 5 AuthRegistry(0x55fb8c8ff8b0) adding con mode: secure 2024-06-04T16:11:40.175 INFO:tasks.workunit.client.0.smithi144.stderr: -478> 2024-06-04T16:11:39.836+0000 7f99e8281800 5 AuthRegistry(0x55fb8c8ff8b0) adding con mode: crc 2024-06-04T16:11:40.175 INFO:tasks.workunit.client.0.smithi144.stderr: -477> 2024-06-04T16:11:39.836+0000 7f99e8281800 5 AuthRegistry(0x55fb8c8ff8b0) adding con mode: crc 2024-06-04T16:11:40.175 INFO:tasks.workunit.client.0.smithi144.stderr: -476> 2024-06-04T16:11:39.836+0000 7f99e8281800 5 AuthRegistry(0x55fb8c8ff8b0) adding con mode: secure 2024-06-04T16:11:40.175 INFO:tasks.workunit.client.0.smithi144.stderr: -475> 2024-06-04T16:11:39.836+0000 7f99e8281800 5 AuthRegistry(0x55fb8c8ff8b0) adding con mode: crc 2024-06-04T16:11:40.175 INFO:tasks.workunit.client.0.smithi144.stderr: -474> 2024-06-04T16:11:39.836+0000 7f99e8281800 5 AuthRegistry(0x55fb8c8ff8b0) adding con mode: secure 2024-06-04T16:11:40.175 INFO:tasks.workunit.client.0.smithi144.stderr: -473> 2024-06-04T16:11:39.836+0000 7f99e8281800 5 AuthRegistry(0x55fb8c8ff8b0) adding con mode: crc 2024-06-04T16:11:40.175 INFO:tasks.workunit.client.0.smithi144.stderr: -472> 2024-06-04T16:11:39.836+0000 7f99e8281800 5 AuthRegistry(0x55fb8c8ff8b0) adding con mode: secure 2024-06-04T16:11:40.175 INFO:tasks.workunit.client.0.smithi144.stderr: -471> 2024-06-04T16:11:39.836+0000 7f99e8281800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-06-04T16:11:40.175 INFO:tasks.workunit.client.0.smithi144.stderr: -470> 2024-06-04T16:11:39.836+0000 7f99e8281800 1 librados: starting msgr at 2024-06-04T16:11:40.175 INFO:tasks.workunit.client.0.smithi144.stderr: -469> 2024-06-04T16:11:39.836+0000 7f99e8281800 1 librados: starting objecter 2024-06-04T16:11:40.175 INFO:tasks.workunit.client.0.smithi144.stderr: -468> 2024-06-04T16:11:39.836+0000 7f99e8281800 5 asok(0x55fb8c6dbc60) register_command objecter_requests hook 0x55fb8c901c50 2024-06-04T16:11:40.175 INFO:tasks.workunit.client.0.smithi144.stderr: -467> 2024-06-04T16:11:39.836+0000 7f99e8281800 1 librados: setting wanted keys 2024-06-04T16:11:40.176 INFO:tasks.workunit.client.0.smithi144.stderr: -466> 2024-06-04T16:11:39.836+0000 7f99e8281800 1 librados: calling monclient init 2024-06-04T16:11:40.176 INFO:tasks.workunit.client.0.smithi144.stderr: -465> 2024-06-04T16:11:39.836+0000 7f99e8281800 10 monclient: init 2024-06-04T16:11:40.176 INFO:tasks.workunit.client.0.smithi144.stderr: -464> 2024-06-04T16:11:39.836+0000 7f99e8281800 5 AuthRegistry(0x55fb8c8fc950) adding auth protocol: cephx 2024-06-04T16:11:40.176 INFO:tasks.workunit.client.0.smithi144.stderr: -463> 2024-06-04T16:11:39.836+0000 7f99e8281800 5 AuthRegistry(0x55fb8c8fc950) adding auth protocol: cephx 2024-06-04T16:11:40.176 INFO:tasks.workunit.client.0.smithi144.stderr: -462> 2024-06-04T16:11:39.836+0000 7f99e8281800 5 AuthRegistry(0x55fb8c8fc950) adding auth protocol: cephx 2024-06-04T16:11:40.176 INFO:tasks.workunit.client.0.smithi144.stderr: -461> 2024-06-04T16:11:39.836+0000 7f99e8281800 5 AuthRegistry(0x55fb8c8fc950) adding con mode: secure 2024-06-04T16:11:40.176 INFO:tasks.workunit.client.0.smithi144.stderr: -460> 2024-06-04T16:11:39.836+0000 7f99e8281800 5 AuthRegistry(0x55fb8c8fc950) adding con mode: crc 2024-06-04T16:11:40.176 INFO:tasks.workunit.client.0.smithi144.stderr: -459> 2024-06-04T16:11:39.836+0000 7f99e8281800 5 AuthRegistry(0x55fb8c8fc950) adding con mode: secure 2024-06-04T16:11:40.176 INFO:tasks.workunit.client.0.smithi144.stderr: -458> 2024-06-04T16:11:39.836+0000 7f99e8281800 5 AuthRegistry(0x55fb8c8fc950) adding con mode: crc 2024-06-04T16:11:40.176 INFO:tasks.workunit.client.0.smithi144.stderr: -457> 2024-06-04T16:11:39.836+0000 7f99e8281800 5 AuthRegistry(0x55fb8c8fc950) adding con mode: secure 2024-06-04T16:11:40.176 INFO:tasks.workunit.client.0.smithi144.stderr: -456> 2024-06-04T16:11:39.836+0000 7f99e8281800 5 AuthRegistry(0x55fb8c8fc950) adding con mode: crc 2024-06-04T16:11:40.176 INFO:tasks.workunit.client.0.smithi144.stderr: -455> 2024-06-04T16:11:39.836+0000 7f99e8281800 5 AuthRegistry(0x55fb8c8fc950) adding con mode: crc 2024-06-04T16:11:40.176 INFO:tasks.workunit.client.0.smithi144.stderr: -454> 2024-06-04T16:11:39.836+0000 7f99e8281800 5 AuthRegistry(0x55fb8c8fc950) adding con mode: secure 2024-06-04T16:11:40.176 INFO:tasks.workunit.client.0.smithi144.stderr: -453> 2024-06-04T16:11:39.836+0000 7f99e8281800 5 AuthRegistry(0x55fb8c8fc950) adding con mode: crc 2024-06-04T16:11:40.176 INFO:tasks.workunit.client.0.smithi144.stderr: -452> 2024-06-04T16:11:39.836+0000 7f99e8281800 5 AuthRegistry(0x55fb8c8fc950) adding con mode: secure 2024-06-04T16:11:40.177 INFO:tasks.workunit.client.0.smithi144.stderr: -451> 2024-06-04T16:11:39.836+0000 7f99e8281800 5 AuthRegistry(0x55fb8c8fc950) adding con mode: crc 2024-06-04T16:11:40.177 INFO:tasks.workunit.client.0.smithi144.stderr: -450> 2024-06-04T16:11:39.836+0000 7f99e8281800 5 AuthRegistry(0x55fb8c8fc950) adding con mode: secure 2024-06-04T16:11:40.177 INFO:tasks.workunit.client.0.smithi144.stderr: -449> 2024-06-04T16:11:39.836+0000 7f99e8281800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-06-04T16:11:40.177 INFO:tasks.workunit.client.0.smithi144.stderr: -448> 2024-06-04T16:11:39.837+0000 7f99e8281800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-06-04T16:11:40.177 INFO:tasks.workunit.client.0.smithi144.stderr: -447> 2024-06-04T16:11:39.837+0000 7f99e8281800 5 asok(0x55fb8c6dbc60) register_command rotate-key hook 0x55fb8c8fca98 2024-06-04T16:11:40.177 INFO:tasks.workunit.client.0.smithi144.stderr: -446> 2024-06-04T16:11:39.837+0000 7f99e8281800 10 monclient: _reopen_session rank -1 2024-06-04T16:11:40.177 INFO:tasks.workunit.client.0.smithi144.stderr: -445> 2024-06-04T16:11:39.837+0000 7f99e8281800 10 monclient: _add_conns ranks=[1,0,2] 2024-06-04T16:11:40.177 INFO:tasks.workunit.client.0.smithi144.stderr: -444> 2024-06-04T16:11:39.837+0000 7f99e8281800 10 monclient(hunting): picked mon.noname-b con 0x55fb8c7b31b0 addr [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] 2024-06-04T16:11:40.177 INFO:tasks.workunit.client.0.smithi144.stderr: -443> 2024-06-04T16:11:39.837+0000 7f99e8281800 10 monclient(hunting): picked mon.noname-a con 0x55fb8c83de80 addr [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] 2024-06-04T16:11:40.177 INFO:tasks.workunit.client.0.smithi144.stderr: -442> 2024-06-04T16:11:39.837+0000 7f99e8281800 10 monclient(hunting): picked mon.noname-c con 0x55fb8c844990 addr [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] 2024-06-04T16:11:40.177 INFO:tasks.workunit.client.0.smithi144.stderr: -441> 2024-06-04T16:11:39.837+0000 7f99e8281800 10 monclient(hunting): start opening mon connection 2024-06-04T16:11:40.177 INFO:tasks.workunit.client.0.smithi144.stderr: -440> 2024-06-04T16:11:39.837+0000 7f99e8281800 10 monclient(hunting): start opening mon connection 2024-06-04T16:11:40.177 INFO:tasks.workunit.client.0.smithi144.stderr: -439> 2024-06-04T16:11:39.837+0000 7f99e8281800 10 monclient(hunting): start opening mon connection 2024-06-04T16:11:40.177 INFO:tasks.workunit.client.0.smithi144.stderr: -438> 2024-06-04T16:11:39.837+0000 7f99e8281800 10 monclient(hunting): _renew_subs 2024-06-04T16:11:40.177 INFO:tasks.workunit.client.0.smithi144.stderr: -437> 2024-06-04T16:11:39.837+0000 7f99e8281800 10 monclient(hunting): authenticate will time out at 1937.654253s 2024-06-04T16:11:40.178 INFO:tasks.workunit.client.0.smithi144.stderr: -436> 2024-06-04T16:11:39.837+0000 7f99dd575640 10 monclient(hunting): get_auth_request con 0x55fb8c83de80 auth_method 0 2024-06-04T16:11:40.178 INFO:tasks.workunit.client.0.smithi144.stderr: -435> 2024-06-04T16:11:39.837+0000 7f99dd575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-06-04T16:11:40.178 INFO:tasks.workunit.client.0.smithi144.stderr: -434> 2024-06-04T16:11:39.837+0000 7f99dd575640 10 monclient(hunting): _init_auth method 2 2024-06-04T16:11:40.178 INFO:tasks.workunit.client.0.smithi144.stderr: -433> 2024-06-04T16:11:39.837+0000 7f99dd575640 10 monclient(hunting): _init_auth creating new auth 2024-06-04T16:11:40.178 INFO:tasks.workunit.client.0.smithi144.stderr: -432> 2024-06-04T16:11:39.837+0000 7f99e6577640 10 monclient(hunting): get_auth_request con 0x55fb8c844990 auth_method 0 2024-06-04T16:11:40.178 INFO:tasks.workunit.client.0.smithi144.stderr: -431> 2024-06-04T16:11:39.837+0000 7f99e6577640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-06-04T16:11:40.178 INFO:tasks.workunit.client.0.smithi144.stderr: -430> 2024-06-04T16:11:39.837+0000 7f99e6577640 10 monclient(hunting): _init_auth method 2 2024-06-04T16:11:40.178 INFO:tasks.workunit.client.0.smithi144.stderr: -429> 2024-06-04T16:11:39.837+0000 7f99e6577640 10 monclient(hunting): _init_auth creating new auth 2024-06-04T16:11:40.178 INFO:tasks.workunit.client.0.smithi144.stderr: -428> 2024-06-04T16:11:39.837+0000 7f99dd575640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-06-04T16:11:40.178 INFO:tasks.workunit.client.0.smithi144.stderr: -427> 2024-06-04T16:11:39.837+0000 7f99dd575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-06-04T16:11:40.178 INFO:tasks.workunit.client.0.smithi144.stderr: -426> 2024-06-04T16:11:39.837+0000 7f99dd575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-06-04T16:11:40.178 INFO:tasks.workunit.client.0.smithi144.stderr: -425> 2024-06-04T16:11:39.837+0000 7f99e6577640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-06-04T16:11:40.179 INFO:tasks.workunit.client.0.smithi144.stderr: -424> 2024-06-04T16:11:39.837+0000 7f99e6577640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-06-04T16:11:40.179 INFO:tasks.workunit.client.0.smithi144.stderr: -423> 2024-06-04T16:11:39.837+0000 7f99e6577640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-06-04T16:11:40.179 INFO:tasks.workunit.client.0.smithi144.stderr: -422> 2024-06-04T16:11:39.837+0000 7f99e5d76640 10 monclient(hunting): get_auth_request con 0x55fb8c7b31b0 auth_method 0 2024-06-04T16:11:40.179 INFO:tasks.workunit.client.0.smithi144.stderr: -421> 2024-06-04T16:11:39.837+0000 7f99e5d76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-06-04T16:11:40.179 INFO:tasks.workunit.client.0.smithi144.stderr: -420> 2024-06-04T16:11:39.837+0000 7f99e5d76640 10 monclient(hunting): _init_auth method 2 2024-06-04T16:11:40.179 INFO:tasks.workunit.client.0.smithi144.stderr: -419> 2024-06-04T16:11:39.837+0000 7f99e5d76640 10 monclient(hunting): _init_auth creating new auth 2024-06-04T16:11:40.179 INFO:tasks.workunit.client.0.smithi144.stderr: -418> 2024-06-04T16:11:39.837+0000 7f99e5d76640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-06-04T16:11:40.179 INFO:tasks.workunit.client.0.smithi144.stderr: -417> 2024-06-04T16:11:39.837+0000 7f99e5d76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-06-04T16:11:40.179 INFO:tasks.workunit.client.0.smithi144.stderr: -416> 2024-06-04T16:11:39.837+0000 7f99e5d76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-06-04T16:11:40.179 INFO:tasks.workunit.client.0.smithi144.stderr: -415> 2024-06-04T16:11:39.837+0000 7f99dd575640 10 monclient(hunting): handle_auth_done global_id 6279 payload 824 2024-06-04T16:11:40.179 INFO:tasks.workunit.client.0.smithi144.stderr: -414> 2024-06-04T16:11:39.837+0000 7f99dd575640 10 monclient: _finish_hunting 0 2024-06-04T16:11:40.179 INFO:tasks.workunit.client.0.smithi144.stderr: -413> 2024-06-04T16:11:39.837+0000 7f99dd575640 1 monclient: found mon.noname-a 2024-06-04T16:11:40.179 INFO:tasks.workunit.client.0.smithi144.stderr: -412> 2024-06-04T16:11:39.837+0000 7f99dd575640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.144:3300/0 2024-06-04T16:11:40.179 INFO:tasks.workunit.client.0.smithi144.stderr: -411> 2024-06-04T16:11:39.837+0000 7f98d2604640 10 monclient: handle_monmap mon_map magic: 0 2024-06-04T16:11:40.180 INFO:tasks.workunit.client.0.smithi144.stderr: -410> 2024-06-04T16:11:39.837+0000 7f98d2604640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-06-04T16:11:40.180 INFO:tasks.workunit.client.0.smithi144.stderr: -409> 2024-06-04T16:11:39.837+0000 7f98d2604640 10 monclient: dump: 2024-06-04T16:11:40.180 INFO:tasks.workunit.client.0.smithi144.stderr:epoch 1 2024-06-04T16:11:40.180 INFO:tasks.workunit.client.0.smithi144.stderr:fsid 15e56bb1-4856-42f3-b6db-a2c8f23c5557 2024-06-04T16:11:40.180 INFO:tasks.workunit.client.0.smithi144.stderr:last_changed 2024-06-04T15:51:29.789359+0000 2024-06-04T16:11:40.180 INFO:tasks.workunit.client.0.smithi144.stderr:created 2024-06-04T15:51:29.789359+0000 2024-06-04T16:11:40.180 INFO:tasks.workunit.client.0.smithi144.stderr:min_mon_release 19 (squid) 2024-06-04T16:11:40.180 INFO:tasks.workunit.client.0.smithi144.stderr:election_strategy: 1 2024-06-04T16:11:40.180 INFO:tasks.workunit.client.0.smithi144.stderr:0: [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] mon.a 2024-06-04T16:11:40.180 INFO:tasks.workunit.client.0.smithi144.stderr:1: [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] mon.b 2024-06-04T16:11:40.180 INFO:tasks.workunit.client.0.smithi144.stderr:2: [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] mon.c 2024-06-04T16:11:40.180 INFO:tasks.workunit.client.0.smithi144.stderr: 2024-06-04T16:11:40.180 INFO:tasks.workunit.client.0.smithi144.stderr: -408> 2024-06-04T16:11:39.837+0000 7f98d2604640 10 monclient: _finish_auth 0 2024-06-04T16:11:40.180 INFO:tasks.workunit.client.0.smithi144.stderr: -407> 2024-06-04T16:11:39.837+0000 7f98d2604640 10 monclient: _check_auth_tickets 2024-06-04T16:11:40.180 INFO:tasks.workunit.client.0.smithi144.stderr: -406> 2024-06-04T16:11:39.837+0000 7f98d2604640 10 monclient: handle_config config(0 keys) 2024-06-04T16:11:40.181 INFO:tasks.workunit.client.0.smithi144.stderr: -405> 2024-06-04T16:11:39.837+0000 7f98d2604640 10 monclient: handle_monmap mon_map magic: 0 2024-06-04T16:11:40.181 INFO:tasks.workunit.client.0.smithi144.stderr: -404> 2024-06-04T16:11:39.837+0000 7f98d2604640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-06-04T16:11:40.181 INFO:tasks.workunit.client.0.smithi144.stderr: -403> 2024-06-04T16:11:39.837+0000 7f98d2604640 10 monclient: dump: 2024-06-04T16:11:40.181 INFO:tasks.workunit.client.0.smithi144.stderr:epoch 1 2024-06-04T16:11:40.181 INFO:tasks.workunit.client.0.smithi144.stderr:fsid 15e56bb1-4856-42f3-b6db-a2c8f23c5557 2024-06-04T16:11:40.181 INFO:tasks.workunit.client.0.smithi144.stderr:last_changed 2024-06-04T15:51:29.789359+0000 2024-06-04T16:11:40.181 INFO:tasks.workunit.client.0.smithi144.stderr:created 2024-06-04T15:51:29.789359+0000 2024-06-04T16:11:40.181 INFO:tasks.workunit.client.0.smithi144.stderr:min_mon_release 19 (squid) 2024-06-04T16:11:40.181 INFO:tasks.workunit.client.0.smithi144.stderr:election_strategy: 1 2024-06-04T16:11:40.181 INFO:tasks.workunit.client.0.smithi144.stderr:0: [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] mon.a 2024-06-04T16:11:40.181 INFO:tasks.workunit.client.0.smithi144.stderr:1: [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] mon.b 2024-06-04T16:11:40.181 INFO:tasks.workunit.client.0.smithi144.stderr:2: [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] mon.c 2024-06-04T16:11:40.181 INFO:tasks.workunit.client.0.smithi144.stderr: 2024-06-04T16:11:40.181 INFO:tasks.workunit.client.0.smithi144.stderr: -402> 2024-06-04T16:11:39.837+0000 7f99e8281800 5 monclient: authenticate success, global_id 6279 2024-06-04T16:11:40.181 INFO:tasks.workunit.client.0.smithi144.stderr: -401> 2024-06-04T16:11:39.837+0000 7f99e8281800 10 monclient: _renew_subs 2024-06-04T16:11:40.182 INFO:tasks.workunit.client.0.smithi144.stderr: -400> 2024-06-04T16:11:39.837+0000 7f98d3e07640 4 set_mon_vals no callback set 2024-06-04T16:11:40.182 INFO:tasks.workunit.client.0.smithi144.stderr: -399> 2024-06-04T16:11:39.837+0000 7f99e8281800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.144:3300/0 2024-06-04T16:11:40.182 INFO:tasks.workunit.client.0.smithi144.stderr: -398> 2024-06-04T16:11:39.837+0000 7f99e8281800 10 monclient: _renew_subs 2024-06-04T16:11:40.182 INFO:tasks.workunit.client.0.smithi144.stderr: -397> 2024-06-04T16:11:39.837+0000 7f99e8281800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.144:3300/0 2024-06-04T16:11:40.182 INFO:tasks.workunit.client.0.smithi144.stderr: -396> 2024-06-04T16:11:39.837+0000 7f99e8281800 1 librados: init done 2024-06-04T16:11:40.182 INFO:tasks.workunit.client.0.smithi144.stderr: -395> 2024-06-04T16:11:39.839+0000 7f98d2604640 4 mgrc handle_mgr_map Got map version 5 2024-06-04T16:11:40.182 INFO:tasks.workunit.client.0.smithi144.stderr: -394> 2024-06-04T16:11:39.839+0000 7f98d2604640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.177:6832/2645786330,v1:172.21.15.177:6833/2645786330] 2024-06-04T16:11:40.182 INFO:tasks.workunit.client.0.smithi144.stderr: -393> 2024-06-04T16:11:39.839+0000 7f98d2604640 4 mgrc reconnect Starting new session with [v2:172.21.15.177:6832/2645786330,v1:172.21.15.177:6833/2645786330] 2024-06-04T16:11:40.182 INFO:tasks.workunit.client.0.smithi144.stderr: -392> 2024-06-04T16:11:39.839+0000 7f99e5d76640 10 monclient: get_auth_request con 0x7f98cc074cb0 auth_method 0 2024-06-04T16:11:40.182 INFO:tasks.workunit.client.0.smithi144.stderr: -391> 2024-06-04T16:11:39.840+0000 7f99e6577640 10 monclient: get_auth_request con 0x55fb8c944fd0 auth_method 0 2024-06-04T16:11:40.182 INFO:tasks.workunit.client.0.smithi144.stderr: -390> 2024-06-04T16:11:39.840+0000 7f99e5d76640 10 monclient: get_auth_request con 0x55fb8c9481b0 auth_method 0 2024-06-04T16:11:40.182 INFO:tasks.workunit.client.0.smithi144.stderr: -389> 2024-06-04T16:11:39.841+0000 7f99dd575640 10 monclient: get_auth_request con 0x55fb8c94c3a0 auth_method 0 2024-06-04T16:11:40.182 INFO:tasks.workunit.client.0.smithi144.stderr: -388> 2024-06-04T16:11:39.842+0000 7f99e6577640 10 monclient: get_auth_request con 0x55fb8c950080 auth_method 0 2024-06-04T16:11:40.183 INFO:tasks.workunit.client.0.smithi144.stderr: -387> 2024-06-04T16:11:39.843+0000 7f99e8281800 10 monclient: build_initial_monmap 2024-06-04T16:11:40.183 INFO:tasks.workunit.client.0.smithi144.stderr: -386> 2024-06-04T16:11:39.843+0000 7f99e8281800 1 build_initial for_mkfs: 0 2024-06-04T16:11:40.183 INFO:tasks.workunit.client.0.smithi144.stderr: -385> 2024-06-04T16:11:39.843+0000 7f99e8281800 10 monclient: monmap: 2024-06-04T16:11:40.183 INFO:tasks.workunit.client.0.smithi144.stderr:epoch 0 2024-06-04T16:11:40.183 INFO:tasks.workunit.client.0.smithi144.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-06-04T16:11:40.183 INFO:tasks.workunit.client.0.smithi144.stderr:last_changed 0.000000 2024-06-04T16:11:40.183 INFO:tasks.workunit.client.0.smithi144.stderr:created 0.000000 2024-06-04T16:11:40.183 INFO:tasks.workunit.client.0.smithi144.stderr:min_mon_release 0 (unknown) 2024-06-04T16:11:40.183 INFO:tasks.workunit.client.0.smithi144.stderr:election_strategy: 1 2024-06-04T16:11:40.183 INFO:tasks.workunit.client.0.smithi144.stderr:0: [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] mon.noname-a 2024-06-04T16:11:40.183 INFO:tasks.workunit.client.0.smithi144.stderr:1: [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] mon.noname-b 2024-06-04T16:11:40.183 INFO:tasks.workunit.client.0.smithi144.stderr:2: [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] mon.noname-c 2024-06-04T16:11:40.183 INFO:tasks.workunit.client.0.smithi144.stderr: 2024-06-04T16:11:40.184 INFO:tasks.workunit.client.0.smithi144.stderr: -384> 2024-06-04T16:11:39.843+0000 7f99e8281800 5 AuthRegistry(0x55fb8c954130) adding auth protocol: cephx 2024-06-04T16:11:40.184 INFO:tasks.workunit.client.0.smithi144.stderr: -383> 2024-06-04T16:11:39.843+0000 7f99e8281800 5 AuthRegistry(0x55fb8c954130) adding auth protocol: cephx 2024-06-04T16:11:40.184 INFO:tasks.workunit.client.0.smithi144.stderr: -382> 2024-06-04T16:11:39.843+0000 7f99e8281800 5 AuthRegistry(0x55fb8c954130) adding auth protocol: cephx 2024-06-04T16:11:40.184 INFO:tasks.workunit.client.0.smithi144.stderr: -381> 2024-06-04T16:11:39.843+0000 7f99e8281800 5 AuthRegistry(0x55fb8c954130) adding con mode: secure 2024-06-04T16:11:40.184 INFO:tasks.workunit.client.0.smithi144.stderr: -380> 2024-06-04T16:11:39.843+0000 7f99e8281800 5 AuthRegistry(0x55fb8c954130) adding con mode: crc 2024-06-04T16:11:40.184 INFO:tasks.workunit.client.0.smithi144.stderr: -379> 2024-06-04T16:11:39.843+0000 7f99e8281800 5 AuthRegistry(0x55fb8c954130) adding con mode: secure 2024-06-04T16:11:40.184 INFO:tasks.workunit.client.0.smithi144.stderr: -378> 2024-06-04T16:11:39.843+0000 7f99e8281800 5 AuthRegistry(0x55fb8c954130) adding con mode: crc 2024-06-04T16:11:40.184 INFO:tasks.workunit.client.0.smithi144.stderr: -377> 2024-06-04T16:11:39.843+0000 7f99e8281800 5 AuthRegistry(0x55fb8c954130) adding con mode: secure 2024-06-04T16:11:40.184 INFO:tasks.workunit.client.0.smithi144.stderr: -376> 2024-06-04T16:11:39.843+0000 7f99e8281800 5 AuthRegistry(0x55fb8c954130) adding con mode: crc 2024-06-04T16:11:40.184 INFO:tasks.workunit.client.0.smithi144.stderr: -375> 2024-06-04T16:11:39.843+0000 7f99e8281800 5 AuthRegistry(0x55fb8c954130) adding con mode: crc 2024-06-04T16:11:40.184 INFO:tasks.workunit.client.0.smithi144.stderr: -374> 2024-06-04T16:11:39.843+0000 7f99e8281800 5 AuthRegistry(0x55fb8c954130) adding con mode: secure 2024-06-04T16:11:40.184 INFO:tasks.workunit.client.0.smithi144.stderr: -373> 2024-06-04T16:11:39.843+0000 7f99e8281800 5 AuthRegistry(0x55fb8c954130) adding con mode: crc 2024-06-04T16:11:40.184 INFO:tasks.workunit.client.0.smithi144.stderr: -372> 2024-06-04T16:11:39.843+0000 7f99e8281800 5 AuthRegistry(0x55fb8c954130) adding con mode: secure 2024-06-04T16:11:40.184 INFO:tasks.workunit.client.0.smithi144.stderr: -371> 2024-06-04T16:11:39.843+0000 7f99e8281800 5 AuthRegistry(0x55fb8c954130) adding con mode: crc 2024-06-04T16:11:40.184 INFO:tasks.workunit.client.0.smithi144.stderr: -370> 2024-06-04T16:11:39.843+0000 7f99e8281800 5 AuthRegistry(0x55fb8c954130) adding con mode: secure 2024-06-04T16:11:40.185 INFO:tasks.workunit.client.0.smithi144.stderr: -369> 2024-06-04T16:11:39.843+0000 7f99e8281800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-06-04T16:11:40.185 INFO:tasks.workunit.client.0.smithi144.stderr: -368> 2024-06-04T16:11:39.843+0000 7f99e8281800 5 asok(0x55fb8c6dbc60) register_command objecter_requests cmddesc objecter_requests hook 0x55fb8c94fe10 EEXIST 2024-06-04T16:11:40.185 INFO:tasks.workunit.client.0.smithi144.stderr: -367> 2024-06-04T16:11:39.843+0000 7f99e8281800 10 monclient: init 2024-06-04T16:11:40.185 INFO:tasks.workunit.client.0.smithi144.stderr: -366> 2024-06-04T16:11:39.843+0000 7f99e8281800 5 AuthRegistry(0x55fb8c953028) adding auth protocol: cephx 2024-06-04T16:11:40.185 INFO:tasks.workunit.client.0.smithi144.stderr: -365> 2024-06-04T16:11:39.843+0000 7f99e8281800 5 AuthRegistry(0x55fb8c953028) adding auth protocol: cephx 2024-06-04T16:11:40.185 INFO:tasks.workunit.client.0.smithi144.stderr: -364> 2024-06-04T16:11:39.843+0000 7f99e8281800 5 AuthRegistry(0x55fb8c953028) adding auth protocol: cephx 2024-06-04T16:11:40.185 INFO:tasks.workunit.client.0.smithi144.stderr: -363> 2024-06-04T16:11:39.843+0000 7f99e8281800 5 AuthRegistry(0x55fb8c953028) adding con mode: secure 2024-06-04T16:11:40.185 INFO:tasks.workunit.client.0.smithi144.stderr: -362> 2024-06-04T16:11:39.843+0000 7f99e8281800 5 AuthRegistry(0x55fb8c953028) adding con mode: crc 2024-06-04T16:11:40.185 INFO:tasks.workunit.client.0.smithi144.stderr: -361> 2024-06-04T16:11:39.843+0000 7f99e8281800 5 AuthRegistry(0x55fb8c953028) adding con mode: secure 2024-06-04T16:11:40.185 INFO:tasks.workunit.client.0.smithi144.stderr: -360> 2024-06-04T16:11:39.843+0000 7f99e8281800 5 AuthRegistry(0x55fb8c953028) adding con mode: crc 2024-06-04T16:11:40.185 INFO:tasks.workunit.client.0.smithi144.stderr: -359> 2024-06-04T16:11:39.843+0000 7f99e8281800 5 AuthRegistry(0x55fb8c953028) adding con mode: secure 2024-06-04T16:11:40.185 INFO:tasks.workunit.client.0.smithi144.stderr: -358> 2024-06-04T16:11:39.843+0000 7f99e8281800 5 AuthRegistry(0x55fb8c953028) adding con mode: crc 2024-06-04T16:11:40.185 INFO:tasks.workunit.client.0.smithi144.stderr: -357> 2024-06-04T16:11:39.843+0000 7f99e8281800 5 AuthRegistry(0x55fb8c953028) adding con mode: crc 2024-06-04T16:11:40.185 INFO:tasks.workunit.client.0.smithi144.stderr: -356> 2024-06-04T16:11:39.843+0000 7f99e8281800 5 AuthRegistry(0x55fb8c953028) adding con mode: secure 2024-06-04T16:11:40.185 INFO:tasks.workunit.client.0.smithi144.stderr: -355> 2024-06-04T16:11:39.843+0000 7f99e8281800 5 AuthRegistry(0x55fb8c953028) adding con mode: crc 2024-06-04T16:11:40.186 INFO:tasks.workunit.client.0.smithi144.stderr: -354> 2024-06-04T16:11:39.843+0000 7f99e8281800 5 AuthRegistry(0x55fb8c953028) adding con mode: secure 2024-06-04T16:11:40.186 INFO:tasks.workunit.client.0.smithi144.stderr: -353> 2024-06-04T16:11:39.843+0000 7f99e8281800 5 AuthRegistry(0x55fb8c953028) adding con mode: crc 2024-06-04T16:11:40.186 INFO:tasks.workunit.client.0.smithi144.stderr: -352> 2024-06-04T16:11:39.843+0000 7f99e8281800 5 AuthRegistry(0x55fb8c953028) adding con mode: secure 2024-06-04T16:11:40.186 INFO:tasks.workunit.client.0.smithi144.stderr: -351> 2024-06-04T16:11:39.843+0000 7f99e8281800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-06-04T16:11:40.186 INFO:tasks.workunit.client.0.smithi144.stderr: -350> 2024-06-04T16:11:39.843+0000 7f99e8281800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-06-04T16:11:40.186 INFO:tasks.workunit.client.0.smithi144.stderr: -349> 2024-06-04T16:11:39.844+0000 7f99e8281800 5 asok(0x55fb8c6dbc60) register_command rotate-key cmddesc rotate-key hook 0x55fb8c953170 EEXIST 2024-06-04T16:11:40.186 INFO:tasks.workunit.client.0.smithi144.stderr: -348> 2024-06-04T16:11:39.844+0000 7f99e8281800 10 monclient: _reopen_session rank -1 2024-06-04T16:11:40.186 INFO:tasks.workunit.client.0.smithi144.stderr: -347> 2024-06-04T16:11:39.844+0000 7f99e8281800 10 monclient: _add_conns ranks=[1,0,2] 2024-06-04T16:11:40.186 INFO:tasks.workunit.client.0.smithi144.stderr: -346> 2024-06-04T16:11:39.844+0000 7f99e8281800 10 monclient(hunting): picked mon.noname-b con 0x55fb8c95e950 addr [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] 2024-06-04T16:11:40.186 INFO:tasks.workunit.client.0.smithi144.stderr: -345> 2024-06-04T16:11:39.844+0000 7f99e8281800 10 monclient(hunting): picked mon.noname-a con 0x55fb8c95ed30 addr [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] 2024-06-04T16:11:40.186 INFO:tasks.workunit.client.0.smithi144.stderr: -344> 2024-06-04T16:11:39.844+0000 7f99e8281800 10 monclient(hunting): picked mon.noname-c con 0x55fb8c981080 addr [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] 2024-06-04T16:11:40.186 INFO:tasks.workunit.client.0.smithi144.stderr: -343> 2024-06-04T16:11:39.844+0000 7f99e8281800 10 monclient(hunting): start opening mon connection 2024-06-04T16:11:40.186 INFO:tasks.workunit.client.0.smithi144.stderr: -342> 2024-06-04T16:11:39.844+0000 7f99e8281800 10 monclient(hunting): start opening mon connection 2024-06-04T16:11:40.187 INFO:tasks.workunit.client.0.smithi144.stderr: -341> 2024-06-04T16:11:39.844+0000 7f99e8281800 10 monclient(hunting): start opening mon connection 2024-06-04T16:11:40.187 INFO:tasks.workunit.client.0.smithi144.stderr: -340> 2024-06-04T16:11:39.844+0000 7f99e8281800 10 monclient(hunting): _renew_subs 2024-06-04T16:11:40.187 INFO:tasks.workunit.client.0.smithi144.stderr: -339> 2024-06-04T16:11:39.844+0000 7f99e8281800 10 monclient(hunting): authenticate will time out at 1937.661196s 2024-06-04T16:11:40.187 INFO:tasks.workunit.client.0.smithi144.stderr: -338> 2024-06-04T16:11:39.844+0000 7f99e5d76640 10 monclient(hunting): get_auth_request con 0x55fb8c981080 auth_method 0 2024-06-04T16:11:40.187 INFO:tasks.workunit.client.0.smithi144.stderr: -337> 2024-06-04T16:11:39.844+0000 7f99e5d76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-06-04T16:11:40.187 INFO:tasks.workunit.client.0.smithi144.stderr: -336> 2024-06-04T16:11:39.844+0000 7f99e5d76640 10 monclient(hunting): _init_auth method 2 2024-06-04T16:11:40.187 INFO:tasks.workunit.client.0.smithi144.stderr: -335> 2024-06-04T16:11:39.844+0000 7f99e5d76640 10 monclient(hunting): _init_auth creating new auth 2024-06-04T16:11:40.187 INFO:tasks.workunit.client.0.smithi144.stderr: -334> 2024-06-04T16:11:39.844+0000 7f99e6577640 10 monclient(hunting): get_auth_request con 0x55fb8c95ed30 auth_method 0 2024-06-04T16:11:40.187 INFO:tasks.workunit.client.0.smithi144.stderr: -333> 2024-06-04T16:11:39.844+0000 7f99e6577640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-06-04T16:11:40.187 INFO:tasks.workunit.client.0.smithi144.stderr: -332> 2024-06-04T16:11:39.844+0000 7f99e6577640 10 monclient(hunting): _init_auth method 2 2024-06-04T16:11:40.187 INFO:tasks.workunit.client.0.smithi144.stderr: -331> 2024-06-04T16:11:39.844+0000 7f99e6577640 10 monclient(hunting): _init_auth creating new auth 2024-06-04T16:11:40.187 INFO:tasks.workunit.client.0.smithi144.stderr: -330> 2024-06-04T16:11:39.844+0000 7f99dd575640 10 monclient(hunting): get_auth_request con 0x55fb8c95e950 auth_method 0 2024-06-04T16:11:40.187 INFO:tasks.workunit.client.0.smithi144.stderr: -329> 2024-06-04T16:11:39.844+0000 7f99dd575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-06-04T16:11:40.187 INFO:tasks.workunit.client.0.smithi144.stderr: -328> 2024-06-04T16:11:39.844+0000 7f99dd575640 10 monclient(hunting): _init_auth method 2 2024-06-04T16:11:40.188 INFO:tasks.workunit.client.0.smithi144.stderr: -327> 2024-06-04T16:11:39.844+0000 7f99dd575640 10 monclient(hunting): _init_auth creating new auth 2024-06-04T16:11:40.188 INFO:tasks.workunit.client.0.smithi144.stderr: -326> 2024-06-04T16:11:39.844+0000 7f99e5d76640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-06-04T16:11:40.188 INFO:tasks.workunit.client.0.smithi144.stderr: -325> 2024-06-04T16:11:39.844+0000 7f99e5d76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-06-04T16:11:40.188 INFO:tasks.workunit.client.0.smithi144.stderr: -324> 2024-06-04T16:11:39.844+0000 7f99e5d76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-06-04T16:11:40.188 INFO:tasks.workunit.client.0.smithi144.stderr: -323> 2024-06-04T16:11:39.844+0000 7f99e6577640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-06-04T16:11:40.188 INFO:tasks.workunit.client.0.smithi144.stderr: -322> 2024-06-04T16:11:39.844+0000 7f99e6577640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-06-04T16:11:40.188 INFO:tasks.workunit.client.0.smithi144.stderr: -321> 2024-06-04T16:11:39.844+0000 7f99e6577640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-06-04T16:11:40.188 INFO:tasks.workunit.client.0.smithi144.stderr: -320> 2024-06-04T16:11:39.844+0000 7f99dd575640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-06-04T16:11:40.188 INFO:tasks.workunit.client.0.smithi144.stderr: -319> 2024-06-04T16:11:39.844+0000 7f99dd575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-06-04T16:11:40.188 INFO:tasks.workunit.client.0.smithi144.stderr: -318> 2024-06-04T16:11:39.844+0000 7f99dd575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-06-04T16:11:40.188 INFO:tasks.workunit.client.0.smithi144.stderr: -317> 2024-06-04T16:11:39.844+0000 7f99e5d76640 10 monclient(hunting): handle_auth_done global_id 5963 payload 824 2024-06-04T16:11:40.188 INFO:tasks.workunit.client.0.smithi144.stderr: -316> 2024-06-04T16:11:39.844+0000 7f99e5d76640 10 monclient: _finish_hunting 0 2024-06-04T16:11:40.188 INFO:tasks.workunit.client.0.smithi144.stderr: -315> 2024-06-04T16:11:39.844+0000 7f99e5d76640 1 monclient: found mon.noname-c 2024-06-04T16:11:40.188 INFO:tasks.workunit.client.0.smithi144.stderr: -314> 2024-06-04T16:11:39.844+0000 7f99e5d76640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.144:3301/0 2024-06-04T16:11:40.189 INFO:tasks.workunit.client.0.smithi144.stderr: -313> 2024-06-04T16:11:39.844+0000 7f98cb7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-06-04T16:11:40.189 INFO:tasks.workunit.client.0.smithi144.stderr: -312> 2024-06-04T16:11:39.844+0000 7f98cb7fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-06-04T16:11:40.189 INFO:tasks.workunit.client.0.smithi144.stderr: -311> 2024-06-04T16:11:39.844+0000 7f98cb7fe640 10 monclient: dump: 2024-06-04T16:11:40.189 INFO:tasks.workunit.client.0.smithi144.stderr:epoch 1 2024-06-04T16:11:40.189 INFO:tasks.workunit.client.0.smithi144.stderr:fsid 15e56bb1-4856-42f3-b6db-a2c8f23c5557 2024-06-04T16:11:40.189 INFO:tasks.workunit.client.0.smithi144.stderr:last_changed 2024-06-04T15:51:29.789359+0000 2024-06-04T16:11:40.189 INFO:tasks.workunit.client.0.smithi144.stderr:created 2024-06-04T15:51:29.789359+0000 2024-06-04T16:11:40.189 INFO:tasks.workunit.client.0.smithi144.stderr:min_mon_release 19 (squid) 2024-06-04T16:11:40.189 INFO:tasks.workunit.client.0.smithi144.stderr:election_strategy: 1 2024-06-04T16:11:40.189 INFO:tasks.workunit.client.0.smithi144.stderr:0: [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] mon.a 2024-06-04T16:11:40.189 INFO:tasks.workunit.client.0.smithi144.stderr:1: [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] mon.b 2024-06-04T16:11:40.189 INFO:tasks.workunit.client.0.smithi144.stderr:2: [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] mon.c 2024-06-04T16:11:40.189 INFO:tasks.workunit.client.0.smithi144.stderr: 2024-06-04T16:11:40.189 INFO:tasks.workunit.client.0.smithi144.stderr: -310> 2024-06-04T16:11:39.844+0000 7f98cb7fe640 10 monclient: _finish_auth 0 2024-06-04T16:11:40.189 INFO:tasks.workunit.client.0.smithi144.stderr: -309> 2024-06-04T16:11:39.844+0000 7f98cb7fe640 10 monclient: _check_auth_tickets 2024-06-04T16:11:40.190 INFO:tasks.workunit.client.0.smithi144.stderr: -308> 2024-06-04T16:11:39.844+0000 7f98cb7fe640 10 monclient: handle_config config(0 keys) 2024-06-04T16:11:40.190 INFO:tasks.workunit.client.0.smithi144.stderr: -307> 2024-06-04T16:11:39.844+0000 7f98cb7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-06-04T16:11:40.190 INFO:tasks.workunit.client.0.smithi144.stderr: -306> 2024-06-04T16:11:39.844+0000 7f98cb7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-06-04T16:11:40.190 INFO:tasks.workunit.client.0.smithi144.stderr: -305> 2024-06-04T16:11:39.844+0000 7f98cb7fe640 10 monclient: dump: 2024-06-04T16:11:40.190 INFO:tasks.workunit.client.0.smithi144.stderr:epoch 1 2024-06-04T16:11:40.190 INFO:tasks.workunit.client.0.smithi144.stderr:fsid 15e56bb1-4856-42f3-b6db-a2c8f23c5557 2024-06-04T16:11:40.190 INFO:tasks.workunit.client.0.smithi144.stderr:last_changed 2024-06-04T15:51:29.789359+0000 2024-06-04T16:11:40.190 INFO:tasks.workunit.client.0.smithi144.stderr:created 2024-06-04T15:51:29.789359+0000 2024-06-04T16:11:40.190 INFO:tasks.workunit.client.0.smithi144.stderr:min_mon_release 19 (squid) 2024-06-04T16:11:40.190 INFO:tasks.workunit.client.0.smithi144.stderr:election_strategy: 1 2024-06-04T16:11:40.190 INFO:tasks.workunit.client.0.smithi144.stderr:0: [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] mon.a 2024-06-04T16:11:40.190 INFO:tasks.workunit.client.0.smithi144.stderr:1: [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] mon.b 2024-06-04T16:11:40.190 INFO:tasks.workunit.client.0.smithi144.stderr:2: [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] mon.c 2024-06-04T16:11:40.190 INFO:tasks.workunit.client.0.smithi144.stderr: 2024-06-04T16:11:40.191 INFO:tasks.workunit.client.0.smithi144.stderr: -304> 2024-06-04T16:11:39.844+0000 7f99e8281800 5 monclient: authenticate success, global_id 5963 2024-06-04T16:11:40.191 INFO:tasks.workunit.client.0.smithi144.stderr: -303> 2024-06-04T16:11:39.844+0000 7f99e8281800 10 monclient: _renew_subs 2024-06-04T16:11:40.191 INFO:tasks.workunit.client.0.smithi144.stderr: -302> 2024-06-04T16:11:39.844+0000 7f99e6d78640 4 set_mon_vals no callback set 2024-06-04T16:11:40.191 INFO:tasks.workunit.client.0.smithi144.stderr: -301> 2024-06-04T16:11:39.844+0000 7f99e8281800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.144:3301/0 2024-06-04T16:11:40.191 INFO:tasks.workunit.client.0.smithi144.stderr: -300> 2024-06-04T16:11:39.844+0000 7f99e8281800 10 monclient: _renew_subs 2024-06-04T16:11:40.191 INFO:tasks.workunit.client.0.smithi144.stderr: -299> 2024-06-04T16:11:39.844+0000 7f99e8281800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.144:3301/0 2024-06-04T16:11:40.191 INFO:tasks.workunit.client.0.smithi144.stderr: -298> 2024-06-04T16:11:39.846+0000 7f98cb7fe640 4 mgrc handle_mgr_map Got map version 5 2024-06-04T16:11:40.191 INFO:tasks.workunit.client.0.smithi144.stderr: -297> 2024-06-04T16:11:39.846+0000 7f98cb7fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.177:6832/2645786330,v1:172.21.15.177:6833/2645786330] 2024-06-04T16:11:40.191 INFO:tasks.workunit.client.0.smithi144.stderr: -296> 2024-06-04T16:11:39.846+0000 7f98cb7fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.177:6832/2645786330,v1:172.21.15.177:6833/2645786330] 2024-06-04T16:11:40.191 INFO:tasks.workunit.client.0.smithi144.stderr: -295> 2024-06-04T16:11:39.846+0000 7f99dd575640 10 monclient: get_auth_request con 0x7f98c0074bc0 auth_method 0 2024-06-04T16:11:40.191 INFO:tasks.workunit.client.0.smithi144.stderr: -294> 2024-06-04T16:11:39.846+0000 7f99e8281800 10 monclient: get_monmap_and_config 2024-06-04T16:11:40.191 INFO:tasks.workunit.client.0.smithi144.stderr: -293> 2024-06-04T16:11:39.846+0000 7f99e8281800 10 monclient: build_initial_monmap 2024-06-04T16:11:40.191 INFO:tasks.workunit.client.0.smithi144.stderr: -292> 2024-06-04T16:11:39.846+0000 7f99e8281800 1 build_initial for_mkfs: 0 2024-06-04T16:11:40.191 INFO:tasks.workunit.client.0.smithi144.stderr: -291> 2024-06-04T16:11:39.846+0000 7f99e8281800 10 monclient: monmap: 2024-06-04T16:11:40.192 INFO:tasks.workunit.client.0.smithi144.stderr:epoch 0 2024-06-04T16:11:40.192 INFO:tasks.workunit.client.0.smithi144.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-06-04T16:11:40.192 INFO:tasks.workunit.client.0.smithi144.stderr:last_changed 0.000000 2024-06-04T16:11:40.192 INFO:tasks.workunit.client.0.smithi144.stderr:created 0.000000 2024-06-04T16:11:40.192 INFO:tasks.workunit.client.0.smithi144.stderr:min_mon_release 0 (unknown) 2024-06-04T16:11:40.192 INFO:tasks.workunit.client.0.smithi144.stderr:election_strategy: 1 2024-06-04T16:11:40.192 INFO:tasks.workunit.client.0.smithi144.stderr:0: [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] mon.noname-a 2024-06-04T16:11:40.192 INFO:tasks.workunit.client.0.smithi144.stderr:1: [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] mon.noname-b 2024-06-04T16:11:40.192 INFO:tasks.workunit.client.0.smithi144.stderr:2: [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] mon.noname-c 2024-06-04T16:11:40.192 INFO:tasks.workunit.client.0.smithi144.stderr: 2024-06-04T16:11:40.192 INFO:tasks.workunit.client.0.smithi144.stderr: -290> 2024-06-04T16:11:39.846+0000 7f99e8281800 5 AuthRegistry(0x55fb8c99b9a0) adding auth protocol: cephx 2024-06-04T16:11:40.192 INFO:tasks.workunit.client.0.smithi144.stderr: -289> 2024-06-04T16:11:39.846+0000 7f99e8281800 5 AuthRegistry(0x55fb8c99b9a0) adding auth protocol: cephx 2024-06-04T16:11:40.192 INFO:tasks.workunit.client.0.smithi144.stderr: -288> 2024-06-04T16:11:39.846+0000 7f99e8281800 5 AuthRegistry(0x55fb8c99b9a0) adding auth protocol: cephx 2024-06-04T16:11:40.192 INFO:tasks.workunit.client.0.smithi144.stderr: -287> 2024-06-04T16:11:39.846+0000 7f99e8281800 5 AuthRegistry(0x55fb8c99b9a0) adding con mode: secure 2024-06-04T16:11:40.193 INFO:tasks.workunit.client.0.smithi144.stderr: -286> 2024-06-04T16:11:39.846+0000 7f99e8281800 5 AuthRegistry(0x55fb8c99b9a0) adding con mode: crc 2024-06-04T16:11:40.193 INFO:tasks.workunit.client.0.smithi144.stderr: -285> 2024-06-04T16:11:39.846+0000 7f99e8281800 5 AuthRegistry(0x55fb8c99b9a0) adding con mode: secure 2024-06-04T16:11:40.193 INFO:tasks.workunit.client.0.smithi144.stderr: -284> 2024-06-04T16:11:39.846+0000 7f99e8281800 5 AuthRegistry(0x55fb8c99b9a0) adding con mode: crc 2024-06-04T16:11:40.193 INFO:tasks.workunit.client.0.smithi144.stderr: -283> 2024-06-04T16:11:39.846+0000 7f99e8281800 5 AuthRegistry(0x55fb8c99b9a0) adding con mode: secure 2024-06-04T16:11:40.193 INFO:tasks.workunit.client.0.smithi144.stderr: -282> 2024-06-04T16:11:39.846+0000 7f99e8281800 5 AuthRegistry(0x55fb8c99b9a0) adding con mode: crc 2024-06-04T16:11:40.193 INFO:tasks.workunit.client.0.smithi144.stderr: -281> 2024-06-04T16:11:39.846+0000 7f99e8281800 5 AuthRegistry(0x55fb8c99b9a0) adding con mode: crc 2024-06-04T16:11:40.193 INFO:tasks.workunit.client.0.smithi144.stderr: -280> 2024-06-04T16:11:39.846+0000 7f99e8281800 5 AuthRegistry(0x55fb8c99b9a0) adding con mode: secure 2024-06-04T16:11:40.193 INFO:tasks.workunit.client.0.smithi144.stderr: -279> 2024-06-04T16:11:39.846+0000 7f99e8281800 5 AuthRegistry(0x55fb8c99b9a0) adding con mode: crc 2024-06-04T16:11:40.193 INFO:tasks.workunit.client.0.smithi144.stderr: -278> 2024-06-04T16:11:39.846+0000 7f99e8281800 5 AuthRegistry(0x55fb8c99b9a0) adding con mode: secure 2024-06-04T16:11:40.193 INFO:tasks.workunit.client.0.smithi144.stderr: -277> 2024-06-04T16:11:39.846+0000 7f99e8281800 5 AuthRegistry(0x55fb8c99b9a0) adding con mode: crc 2024-06-04T16:11:40.193 INFO:tasks.workunit.client.0.smithi144.stderr: -276> 2024-06-04T16:11:39.846+0000 7f99e8281800 5 AuthRegistry(0x55fb8c99b9a0) adding con mode: secure 2024-06-04T16:11:40.193 INFO:tasks.workunit.client.0.smithi144.stderr: -275> 2024-06-04T16:11:39.847+0000 7f99e8281800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-06-04T16:11:40.193 INFO:tasks.workunit.client.0.smithi144.stderr: -274> 2024-06-04T16:11:39.847+0000 7f99e8281800 10 monclient: init 2024-06-04T16:11:40.193 INFO:tasks.workunit.client.0.smithi144.stderr: -273> 2024-06-04T16:11:39.847+0000 7f99e8281800 5 AuthRegistry(0x7ffdc44e9cb0) adding auth protocol: cephx 2024-06-04T16:11:40.193 INFO:tasks.workunit.client.0.smithi144.stderr: -272> 2024-06-04T16:11:39.847+0000 7f99e8281800 5 AuthRegistry(0x7ffdc44e9cb0) adding auth protocol: cephx 2024-06-04T16:11:40.194 INFO:tasks.workunit.client.0.smithi144.stderr: -271> 2024-06-04T16:11:39.847+0000 7f99e8281800 5 AuthRegistry(0x7ffdc44e9cb0) adding auth protocol: cephx 2024-06-04T16:11:40.194 INFO:tasks.workunit.client.0.smithi144.stderr: -270> 2024-06-04T16:11:39.847+0000 7f99e8281800 5 AuthRegistry(0x7ffdc44e9cb0) adding con mode: secure 2024-06-04T16:11:40.194 INFO:tasks.workunit.client.0.smithi144.stderr: -269> 2024-06-04T16:11:39.847+0000 7f99e8281800 5 AuthRegistry(0x7ffdc44e9cb0) adding con mode: crc 2024-06-04T16:11:40.194 INFO:tasks.workunit.client.0.smithi144.stderr: -268> 2024-06-04T16:11:39.847+0000 7f99e8281800 5 AuthRegistry(0x7ffdc44e9cb0) adding con mode: secure 2024-06-04T16:11:40.194 INFO:tasks.workunit.client.0.smithi144.stderr: -267> 2024-06-04T16:11:39.847+0000 7f99e8281800 5 AuthRegistry(0x7ffdc44e9cb0) adding con mode: crc 2024-06-04T16:11:40.194 INFO:tasks.workunit.client.0.smithi144.stderr: -266> 2024-06-04T16:11:39.847+0000 7f99e8281800 5 AuthRegistry(0x7ffdc44e9cb0) adding con mode: secure 2024-06-04T16:11:40.194 INFO:tasks.workunit.client.0.smithi144.stderr: -265> 2024-06-04T16:11:39.847+0000 7f99e8281800 5 AuthRegistry(0x7ffdc44e9cb0) adding con mode: crc 2024-06-04T16:11:40.194 INFO:tasks.workunit.client.0.smithi144.stderr: -264> 2024-06-04T16:11:39.847+0000 7f99e8281800 5 AuthRegistry(0x7ffdc44e9cb0) adding con mode: crc 2024-06-04T16:11:40.194 INFO:tasks.workunit.client.0.smithi144.stderr: -263> 2024-06-04T16:11:39.847+0000 7f99e8281800 5 AuthRegistry(0x7ffdc44e9cb0) adding con mode: secure 2024-06-04T16:11:40.194 INFO:tasks.workunit.client.0.smithi144.stderr: -262> 2024-06-04T16:11:39.847+0000 7f99e8281800 5 AuthRegistry(0x7ffdc44e9cb0) adding con mode: crc 2024-06-04T16:11:40.194 INFO:tasks.workunit.client.0.smithi144.stderr: -261> 2024-06-04T16:11:39.847+0000 7f99e8281800 5 AuthRegistry(0x7ffdc44e9cb0) adding con mode: secure 2024-06-04T16:11:40.194 INFO:tasks.workunit.client.0.smithi144.stderr: -260> 2024-06-04T16:11:39.847+0000 7f99e8281800 5 AuthRegistry(0x7ffdc44e9cb0) adding con mode: crc 2024-06-04T16:11:40.194 INFO:tasks.workunit.client.0.smithi144.stderr: -259> 2024-06-04T16:11:39.847+0000 7f99e8281800 5 AuthRegistry(0x7ffdc44e9cb0) adding con mode: secure 2024-06-04T16:11:40.194 INFO:tasks.workunit.client.0.smithi144.stderr: -258> 2024-06-04T16:11:39.847+0000 7f99e8281800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-06-04T16:11:40.195 INFO:tasks.workunit.client.0.smithi144.stderr: -257> 2024-06-04T16:11:39.847+0000 7f99e8281800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-06-04T16:11:40.195 INFO:tasks.workunit.client.0.smithi144.stderr: -256> 2024-06-04T16:11:39.847+0000 7f99e8281800 5 asok(0x55fb8c6dbc60) register_command rotate-key cmddesc rotate-key hook 0x7ffdc44e9df8 EEXIST 2024-06-04T16:11:40.195 INFO:tasks.workunit.client.0.smithi144.stderr: -255> 2024-06-04T16:11:39.847+0000 7f99e8281800 10 monclient: _reopen_session rank -1 2024-06-04T16:11:40.195 INFO:tasks.workunit.client.0.smithi144.stderr: -254> 2024-06-04T16:11:39.847+0000 7f99e8281800 10 monclient: _add_conns ranks=[0,1,2] 2024-06-04T16:11:40.195 INFO:tasks.workunit.client.0.smithi144.stderr: -253> 2024-06-04T16:11:39.847+0000 7f99e8281800 10 monclient(hunting): picked mon.noname-a con 0x55fb8c9c1900 addr [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] 2024-06-04T16:11:40.195 INFO:tasks.workunit.client.0.smithi144.stderr: -252> 2024-06-04T16:11:39.847+0000 7f99e8281800 10 monclient(hunting): picked mon.noname-b con 0x55fb8c9a1100 addr [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] 2024-06-04T16:11:40.195 INFO:tasks.workunit.client.0.smithi144.stderr: -251> 2024-06-04T16:11:39.847+0000 7f99e8281800 10 monclient(hunting): picked mon.noname-c con 0x55fb8c9cb880 addr [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] 2024-06-04T16:11:40.195 INFO:tasks.workunit.client.0.smithi144.stderr: -250> 2024-06-04T16:11:39.847+0000 7f99e8281800 10 monclient(hunting): start opening mon connection 2024-06-04T16:11:40.195 INFO:tasks.workunit.client.0.smithi144.stderr: -249> 2024-06-04T16:11:39.847+0000 7f99e8281800 10 monclient(hunting): start opening mon connection 2024-06-04T16:11:40.195 INFO:tasks.workunit.client.0.smithi144.stderr: -248> 2024-06-04T16:11:39.847+0000 7f99e8281800 10 monclient(hunting): start opening mon connection 2024-06-04T16:11:40.195 INFO:tasks.workunit.client.0.smithi144.stderr: -247> 2024-06-04T16:11:39.847+0000 7f99e8281800 10 monclient(hunting): _renew_subs 2024-06-04T16:11:40.195 INFO:tasks.workunit.client.0.smithi144.stderr: -246> 2024-06-04T16:11:39.847+0000 7f99e8281800 10 monclient(hunting): authenticate will time out at 1937.664877s 2024-06-04T16:11:40.195 INFO:tasks.workunit.client.0.smithi144.stderr: -245> 2024-06-04T16:11:39.847+0000 7f99dd575640 10 monclient(hunting): get_auth_request con 0x55fb8c9c1900 auth_method 0 2024-06-04T16:11:40.195 INFO:tasks.workunit.client.0.smithi144.stderr: -244> 2024-06-04T16:11:39.847+0000 7f99dd575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-06-04T16:11:40.196 INFO:tasks.workunit.client.0.smithi144.stderr: -243> 2024-06-04T16:11:39.847+0000 7f99dd575640 10 monclient(hunting): _init_auth method 2 2024-06-04T16:11:40.196 INFO:tasks.workunit.client.0.smithi144.stderr: -242> 2024-06-04T16:11:39.847+0000 7f99dd575640 10 monclient(hunting): _init_auth creating new auth 2024-06-04T16:11:40.196 INFO:tasks.workunit.client.0.smithi144.stderr: -241> 2024-06-04T16:11:39.847+0000 7f99e5d76640 10 monclient(hunting): get_auth_request con 0x55fb8c9cb880 auth_method 0 2024-06-04T16:11:40.196 INFO:tasks.workunit.client.0.smithi144.stderr: -240> 2024-06-04T16:11:39.847+0000 7f99e5d76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-06-04T16:11:40.196 INFO:tasks.workunit.client.0.smithi144.stderr: -239> 2024-06-04T16:11:39.847+0000 7f99e5d76640 10 monclient(hunting): _init_auth method 2 2024-06-04T16:11:40.196 INFO:tasks.workunit.client.0.smithi144.stderr: -238> 2024-06-04T16:11:39.847+0000 7f99e5d76640 10 monclient(hunting): _init_auth creating new auth 2024-06-04T16:11:40.196 INFO:tasks.workunit.client.0.smithi144.stderr: -237> 2024-06-04T16:11:39.847+0000 7f99e6577640 10 monclient(hunting): get_auth_request con 0x55fb8c9a1100 auth_method 0 2024-06-04T16:11:40.196 INFO:tasks.workunit.client.0.smithi144.stderr: -236> 2024-06-04T16:11:39.847+0000 7f99e6577640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-06-04T16:11:40.196 INFO:tasks.workunit.client.0.smithi144.stderr: -235> 2024-06-04T16:11:39.847+0000 7f99e6577640 10 monclient(hunting): _init_auth method 2 2024-06-04T16:11:40.196 INFO:tasks.workunit.client.0.smithi144.stderr: -234> 2024-06-04T16:11:39.847+0000 7f99e6577640 10 monclient(hunting): _init_auth creating new auth 2024-06-04T16:11:40.196 INFO:tasks.workunit.client.0.smithi144.stderr: -233> 2024-06-04T16:11:39.847+0000 7f99dd575640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-06-04T16:11:40.196 INFO:tasks.workunit.client.0.smithi144.stderr: -232> 2024-06-04T16:11:39.847+0000 7f99dd575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-06-04T16:11:40.196 INFO:tasks.workunit.client.0.smithi144.stderr: -231> 2024-06-04T16:11:39.847+0000 7f99dd575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-06-04T16:11:40.196 INFO:tasks.workunit.client.0.smithi144.stderr: -230> 2024-06-04T16:11:39.847+0000 7f99e5d76640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-06-04T16:11:40.197 INFO:tasks.workunit.client.0.smithi144.stderr: -229> 2024-06-04T16:11:39.847+0000 7f99e5d76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-06-04T16:11:40.197 INFO:tasks.workunit.client.0.smithi144.stderr: -228> 2024-06-04T16:11:39.847+0000 7f99e5d76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-06-04T16:11:40.197 INFO:tasks.workunit.client.0.smithi144.stderr: -227> 2024-06-04T16:11:39.847+0000 7f99e6577640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-06-04T16:11:40.197 INFO:tasks.workunit.client.0.smithi144.stderr: -226> 2024-06-04T16:11:39.847+0000 7f99e6577640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-06-04T16:11:40.197 INFO:tasks.workunit.client.0.smithi144.stderr: -225> 2024-06-04T16:11:39.848+0000 7f99e6577640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-06-04T16:11:40.197 INFO:tasks.workunit.client.0.smithi144.stderr: -224> 2024-06-04T16:11:39.848+0000 7f99dd575640 10 monclient(hunting): handle_auth_done global_id 6285 payload 274 2024-06-04T16:11:40.197 INFO:tasks.workunit.client.0.smithi144.stderr: -223> 2024-06-04T16:11:39.848+0000 7f99dd575640 10 monclient: _finish_hunting 0 2024-06-04T16:11:40.197 INFO:tasks.workunit.client.0.smithi144.stderr: -222> 2024-06-04T16:11:39.848+0000 7f99dd575640 1 monclient: found mon.noname-a 2024-06-04T16:11:40.197 INFO:tasks.workunit.client.0.smithi144.stderr: -221> 2024-06-04T16:11:39.848+0000 7f99dd575640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.144:3300/0 2024-06-04T16:11:40.197 INFO:tasks.workunit.client.0.smithi144.stderr: -220> 2024-06-04T16:11:39.848+0000 7f98c97fa640 10 monclient: handle_monmap mon_map magic: 0 2024-06-04T16:11:40.197 INFO:tasks.workunit.client.0.smithi144.stderr: -219> 2024-06-04T16:11:39.848+0000 7f98c97fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-06-04T16:11:40.197 INFO:tasks.workunit.client.0.smithi144.stderr: -218> 2024-06-04T16:11:39.848+0000 7f98c97fa640 10 monclient: dump: 2024-06-04T16:11:40.197 INFO:tasks.workunit.client.0.smithi144.stderr:epoch 1 2024-06-04T16:11:40.197 INFO:tasks.workunit.client.0.smithi144.stderr:fsid 15e56bb1-4856-42f3-b6db-a2c8f23c5557 2024-06-04T16:11:40.198 INFO:tasks.workunit.client.0.smithi144.stderr:last_changed 2024-06-04T15:51:29.789359+0000 2024-06-04T16:11:40.198 INFO:tasks.workunit.client.0.smithi144.stderr:created 2024-06-04T15:51:29.789359+0000 2024-06-04T16:11:40.198 INFO:tasks.workunit.client.0.smithi144.stderr:min_mon_release 19 (squid) 2024-06-04T16:11:40.198 INFO:tasks.workunit.client.0.smithi144.stderr:election_strategy: 1 2024-06-04T16:11:40.198 INFO:tasks.workunit.client.0.smithi144.stderr:0: [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] mon.a 2024-06-04T16:11:40.198 INFO:tasks.workunit.client.0.smithi144.stderr:1: [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] mon.b 2024-06-04T16:11:40.198 INFO:tasks.workunit.client.0.smithi144.stderr:2: [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] mon.c 2024-06-04T16:11:40.198 INFO:tasks.workunit.client.0.smithi144.stderr: 2024-06-04T16:11:40.198 INFO:tasks.workunit.client.0.smithi144.stderr: -217> 2024-06-04T16:11:39.848+0000 7f98c97fa640 10 monclient: _finish_auth 0 2024-06-04T16:11:40.198 INFO:tasks.workunit.client.0.smithi144.stderr: -216> 2024-06-04T16:11:39.848+0000 7f98c97fa640 10 monclient: _check_auth_tickets 2024-06-04T16:11:40.198 INFO:tasks.workunit.client.0.smithi144.stderr: -215> 2024-06-04T16:11:39.848+0000 7f98c97fa640 10 monclient: handle_config config(0 keys) 2024-06-04T16:11:40.198 INFO:tasks.workunit.client.0.smithi144.stderr: -214> 2024-06-04T16:11:39.848+0000 7f98c97fa640 10 monclient: handle_monmap mon_map magic: 0 2024-06-04T16:11:40.198 INFO:tasks.workunit.client.0.smithi144.stderr: -213> 2024-06-04T16:11:39.848+0000 7f98c97fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-06-04T16:11:40.198 INFO:tasks.workunit.client.0.smithi144.stderr: -212> 2024-06-04T16:11:39.848+0000 7f98c97fa640 10 monclient: dump: 2024-06-04T16:11:40.199 INFO:tasks.workunit.client.0.smithi144.stderr:epoch 1 2024-06-04T16:11:40.199 INFO:tasks.workunit.client.0.smithi144.stderr:fsid 15e56bb1-4856-42f3-b6db-a2c8f23c5557 2024-06-04T16:11:40.199 INFO:tasks.workunit.client.0.smithi144.stderr:last_changed 2024-06-04T15:51:29.789359+0000 2024-06-04T16:11:40.199 INFO:tasks.workunit.client.0.smithi144.stderr:created 2024-06-04T15:51:29.789359+0000 2024-06-04T16:11:40.199 INFO:tasks.workunit.client.0.smithi144.stderr:min_mon_release 19 (squid) 2024-06-04T16:11:40.199 INFO:tasks.workunit.client.0.smithi144.stderr:election_strategy: 1 2024-06-04T16:11:40.199 INFO:tasks.workunit.client.0.smithi144.stderr:0: [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] mon.a 2024-06-04T16:11:40.199 INFO:tasks.workunit.client.0.smithi144.stderr:1: [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] mon.b 2024-06-04T16:11:40.199 INFO:tasks.workunit.client.0.smithi144.stderr:2: [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] mon.c 2024-06-04T16:11:40.199 INFO:tasks.workunit.client.0.smithi144.stderr: 2024-06-04T16:11:40.199 INFO:tasks.workunit.client.0.smithi144.stderr: -211> 2024-06-04T16:11:39.848+0000 7f99e8281800 5 monclient: authenticate success, global_id 6285 2024-06-04T16:11:40.199 INFO:tasks.workunit.client.0.smithi144.stderr: -210> 2024-06-04T16:11:39.848+0000 7f99e8281800 10 monclient: get_monmap_and_config success 2024-06-04T16:11:40.199 INFO:tasks.workunit.client.0.smithi144.stderr: -209> 2024-06-04T16:11:39.848+0000 7f99e8281800 4 set_mon_vals no callback set 2024-06-04T16:11:40.199 INFO:tasks.workunit.client.0.smithi144.stderr: -208> 2024-06-04T16:11:39.848+0000 7f99e8281800 10 monclient: shutdown 2024-06-04T16:11:40.200 INFO:tasks.workunit.client.0.smithi144.stderr: -207> 2024-06-04T16:11:39.848+0000 7f99e8281800 10 monclient: build_initial_monmap 2024-06-04T16:11:40.200 INFO:tasks.workunit.client.0.smithi144.stderr: -206> 2024-06-04T16:11:39.848+0000 7f99e8281800 1 build_initial for_mkfs: 0 2024-06-04T16:11:40.200 INFO:tasks.workunit.client.0.smithi144.stderr: -205> 2024-06-04T16:11:39.849+0000 7f99e8281800 10 monclient: monmap: 2024-06-04T16:11:40.200 INFO:tasks.workunit.client.0.smithi144.stderr:epoch 0 2024-06-04T16:11:40.200 INFO:tasks.workunit.client.0.smithi144.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-06-04T16:11:40.200 INFO:tasks.workunit.client.0.smithi144.stderr:last_changed 0.000000 2024-06-04T16:11:40.200 INFO:tasks.workunit.client.0.smithi144.stderr:created 0.000000 2024-06-04T16:11:40.200 INFO:tasks.workunit.client.0.smithi144.stderr:min_mon_release 0 (unknown) 2024-06-04T16:11:40.200 INFO:tasks.workunit.client.0.smithi144.stderr:election_strategy: 1 2024-06-04T16:11:40.200 INFO:tasks.workunit.client.0.smithi144.stderr:0: [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] mon.noname-a 2024-06-04T16:11:40.200 INFO:tasks.workunit.client.0.smithi144.stderr:1: [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] mon.noname-b 2024-06-04T16:11:40.200 INFO:tasks.workunit.client.0.smithi144.stderr:2: [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] mon.noname-c 2024-06-04T16:11:40.200 INFO:tasks.workunit.client.0.smithi144.stderr: 2024-06-04T16:11:40.200 INFO:tasks.workunit.client.0.smithi144.stderr: -204> 2024-06-04T16:11:39.849+0000 7f99e8281800 5 AuthRegistry(0x55fb8c9c9560) adding auth protocol: cephx 2024-06-04T16:11:40.201 INFO:tasks.workunit.client.0.smithi144.stderr: -203> 2024-06-04T16:11:39.849+0000 7f99e8281800 5 AuthRegistry(0x55fb8c9c9560) adding auth protocol: cephx 2024-06-04T16:11:40.201 INFO:tasks.workunit.client.0.smithi144.stderr: -202> 2024-06-04T16:11:39.849+0000 7f99e8281800 5 AuthRegistry(0x55fb8c9c9560) adding auth protocol: cephx 2024-06-04T16:11:40.201 INFO:tasks.workunit.client.0.smithi144.stderr: -201> 2024-06-04T16:11:39.849+0000 7f99e8281800 5 AuthRegistry(0x55fb8c9c9560) adding con mode: secure 2024-06-04T16:11:40.201 INFO:tasks.workunit.client.0.smithi144.stderr: -200> 2024-06-04T16:11:39.849+0000 7f99e8281800 5 AuthRegistry(0x55fb8c9c9560) adding con mode: crc 2024-06-04T16:11:40.201 INFO:tasks.workunit.client.0.smithi144.stderr: -199> 2024-06-04T16:11:39.849+0000 7f99e8281800 5 AuthRegistry(0x55fb8c9c9560) adding con mode: secure 2024-06-04T16:11:40.201 INFO:tasks.workunit.client.0.smithi144.stderr: -198> 2024-06-04T16:11:39.849+0000 7f99e8281800 5 AuthRegistry(0x55fb8c9c9560) adding con mode: crc 2024-06-04T16:11:40.201 INFO:tasks.workunit.client.0.smithi144.stderr: -197> 2024-06-04T16:11:39.849+0000 7f99e8281800 5 AuthRegistry(0x55fb8c9c9560) adding con mode: secure 2024-06-04T16:11:40.201 INFO:tasks.workunit.client.0.smithi144.stderr: -196> 2024-06-04T16:11:39.849+0000 7f99e8281800 5 AuthRegistry(0x55fb8c9c9560) adding con mode: crc 2024-06-04T16:11:40.201 INFO:tasks.workunit.client.0.smithi144.stderr: -195> 2024-06-04T16:11:39.849+0000 7f99e8281800 5 AuthRegistry(0x55fb8c9c9560) adding con mode: crc 2024-06-04T16:11:40.201 INFO:tasks.workunit.client.0.smithi144.stderr: -194> 2024-06-04T16:11:39.849+0000 7f99e8281800 5 AuthRegistry(0x55fb8c9c9560) adding con mode: secure 2024-06-04T16:11:40.201 INFO:tasks.workunit.client.0.smithi144.stderr: -193> 2024-06-04T16:11:39.849+0000 7f99e8281800 5 AuthRegistry(0x55fb8c9c9560) adding con mode: crc 2024-06-04T16:11:40.201 INFO:tasks.workunit.client.0.smithi144.stderr: -192> 2024-06-04T16:11:39.849+0000 7f99e8281800 5 AuthRegistry(0x55fb8c9c9560) adding con mode: secure 2024-06-04T16:11:40.201 INFO:tasks.workunit.client.0.smithi144.stderr: -191> 2024-06-04T16:11:39.849+0000 7f99e8281800 5 AuthRegistry(0x55fb8c9c9560) adding con mode: crc 2024-06-04T16:11:40.201 INFO:tasks.workunit.client.0.smithi144.stderr: -190> 2024-06-04T16:11:39.849+0000 7f99e8281800 5 AuthRegistry(0x55fb8c9c9560) adding con mode: secure 2024-06-04T16:11:40.202 INFO:tasks.workunit.client.0.smithi144.stderr: -189> 2024-06-04T16:11:39.849+0000 7f99e8281800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-06-04T16:11:40.202 INFO:tasks.workunit.client.0.smithi144.stderr: -188> 2024-06-04T16:11:39.849+0000 7f99e8281800 1 librados: starting msgr at 2024-06-04T16:11:40.202 INFO:tasks.workunit.client.0.smithi144.stderr: -187> 2024-06-04T16:11:39.849+0000 7f99e8281800 1 librados: starting objecter 2024-06-04T16:11:40.202 INFO:tasks.workunit.client.0.smithi144.stderr: -186> 2024-06-04T16:11:39.849+0000 7f99e8281800 5 asok(0x55fb8c6dbc60) register_command objecter_requests cmddesc objecter_requests hook 0x55fb8c9ca0a0 EEXIST 2024-06-04T16:11:40.202 INFO:tasks.workunit.client.0.smithi144.stderr: -185> 2024-06-04T16:11:39.849+0000 7f99e8281800 1 librados: setting wanted keys 2024-06-04T16:11:40.202 INFO:tasks.workunit.client.0.smithi144.stderr: -184> 2024-06-04T16:11:39.849+0000 7f99e8281800 1 librados: calling monclient init 2024-06-04T16:11:40.202 INFO:tasks.workunit.client.0.smithi144.stderr: -183> 2024-06-04T16:11:39.849+0000 7f99e8281800 10 monclient: init 2024-06-04T16:11:40.202 INFO:tasks.workunit.client.0.smithi144.stderr: -182> 2024-06-04T16:11:39.849+0000 7f99e8281800 5 AuthRegistry(0x55fb8c99ab90) adding auth protocol: cephx 2024-06-04T16:11:40.202 INFO:tasks.workunit.client.0.smithi144.stderr: -181> 2024-06-04T16:11:39.849+0000 7f99e8281800 5 AuthRegistry(0x55fb8c99ab90) adding auth protocol: cephx 2024-06-04T16:11:40.202 INFO:tasks.workunit.client.0.smithi144.stderr: -180> 2024-06-04T16:11:39.849+0000 7f99e8281800 5 AuthRegistry(0x55fb8c99ab90) adding auth protocol: cephx 2024-06-04T16:11:40.202 INFO:tasks.workunit.client.0.smithi144.stderr: -179> 2024-06-04T16:11:39.849+0000 7f99e8281800 5 AuthRegistry(0x55fb8c99ab90) adding con mode: secure 2024-06-04T16:11:40.202 INFO:tasks.workunit.client.0.smithi144.stderr: -178> 2024-06-04T16:11:39.849+0000 7f99e8281800 5 AuthRegistry(0x55fb8c99ab90) adding con mode: crc 2024-06-04T16:11:40.202 INFO:tasks.workunit.client.0.smithi144.stderr: -177> 2024-06-04T16:11:39.849+0000 7f99e8281800 5 AuthRegistry(0x55fb8c99ab90) adding con mode: secure 2024-06-04T16:11:40.202 INFO:tasks.workunit.client.0.smithi144.stderr: -176> 2024-06-04T16:11:39.849+0000 7f99e8281800 5 AuthRegistry(0x55fb8c99ab90) adding con mode: crc 2024-06-04T16:11:40.203 INFO:tasks.workunit.client.0.smithi144.stderr: -175> 2024-06-04T16:11:39.849+0000 7f99e8281800 5 AuthRegistry(0x55fb8c99ab90) adding con mode: secure 2024-06-04T16:11:40.203 INFO:tasks.workunit.client.0.smithi144.stderr: -174> 2024-06-04T16:11:39.849+0000 7f99e8281800 5 AuthRegistry(0x55fb8c99ab90) adding con mode: crc 2024-06-04T16:11:40.203 INFO:tasks.workunit.client.0.smithi144.stderr: -173> 2024-06-04T16:11:39.849+0000 7f99e8281800 5 AuthRegistry(0x55fb8c99ab90) adding con mode: crc 2024-06-04T16:11:40.203 INFO:tasks.workunit.client.0.smithi144.stderr: -172> 2024-06-04T16:11:39.849+0000 7f99e8281800 5 AuthRegistry(0x55fb8c99ab90) adding con mode: secure 2024-06-04T16:11:40.203 INFO:tasks.workunit.client.0.smithi144.stderr: -171> 2024-06-04T16:11:39.849+0000 7f99e8281800 5 AuthRegistry(0x55fb8c99ab90) adding con mode: crc 2024-06-04T16:11:40.203 INFO:tasks.workunit.client.0.smithi144.stderr: -170> 2024-06-04T16:11:39.849+0000 7f99e8281800 5 AuthRegistry(0x55fb8c99ab90) adding con mode: secure 2024-06-04T16:11:40.203 INFO:tasks.workunit.client.0.smithi144.stderr: -169> 2024-06-04T16:11:39.849+0000 7f99e8281800 5 AuthRegistry(0x55fb8c99ab90) adding con mode: crc 2024-06-04T16:11:40.203 INFO:tasks.workunit.client.0.smithi144.stderr: -168> 2024-06-04T16:11:39.849+0000 7f99e8281800 5 AuthRegistry(0x55fb8c99ab90) adding con mode: secure 2024-06-04T16:11:40.203 INFO:tasks.workunit.client.0.smithi144.stderr: -167> 2024-06-04T16:11:39.849+0000 7f99e8281800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-06-04T16:11:40.203 INFO:tasks.workunit.client.0.smithi144.stderr: -166> 2024-06-04T16:11:39.849+0000 7f99e8281800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-06-04T16:11:40.203 INFO:tasks.workunit.client.0.smithi144.stderr: -165> 2024-06-04T16:11:39.849+0000 7f99e8281800 5 asok(0x55fb8c6dbc60) register_command rotate-key cmddesc rotate-key hook 0x55fb8c99acd8 EEXIST 2024-06-04T16:11:40.203 INFO:tasks.workunit.client.0.smithi144.stderr: -164> 2024-06-04T16:11:39.849+0000 7f99e8281800 10 monclient: _reopen_session rank -1 2024-06-04T16:11:40.203 INFO:tasks.workunit.client.0.smithi144.stderr: -163> 2024-06-04T16:11:39.849+0000 7f99e8281800 10 monclient: _add_conns ranks=[2,1,0] 2024-06-04T16:11:40.203 INFO:tasks.workunit.client.0.smithi144.stderr: -162> 2024-06-04T16:11:39.849+0000 7f99e8281800 10 monclient(hunting): picked mon.noname-c con 0x55fb8c9a1100 addr [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] 2024-06-04T16:11:40.204 INFO:tasks.workunit.client.0.smithi144.stderr: -161> 2024-06-04T16:11:39.849+0000 7f99e8281800 10 monclient(hunting): picked mon.noname-b con 0x55fb8c9c1900 addr [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] 2024-06-04T16:11:40.204 INFO:tasks.workunit.client.0.smithi144.stderr: -160> 2024-06-04T16:11:39.849+0000 7f99e8281800 10 monclient(hunting): picked mon.noname-a con 0x55fb8c9cb880 addr [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] 2024-06-04T16:11:40.204 INFO:tasks.workunit.client.0.smithi144.stderr: -159> 2024-06-04T16:11:39.849+0000 7f99e8281800 10 monclient(hunting): start opening mon connection 2024-06-04T16:11:40.204 INFO:tasks.workunit.client.0.smithi144.stderr: -158> 2024-06-04T16:11:39.849+0000 7f99e8281800 10 monclient(hunting): start opening mon connection 2024-06-04T16:11:40.204 INFO:tasks.workunit.client.0.smithi144.stderr: -157> 2024-06-04T16:11:39.849+0000 7f99e8281800 10 monclient(hunting): start opening mon connection 2024-06-04T16:11:40.204 INFO:tasks.workunit.client.0.smithi144.stderr: -156> 2024-06-04T16:11:39.849+0000 7f99e8281800 10 monclient(hunting): _renew_subs 2024-06-04T16:11:40.204 INFO:tasks.workunit.client.0.smithi144.stderr: -155> 2024-06-04T16:11:39.849+0000 7f99e8281800 10 monclient(hunting): authenticate will time out at 1937.667061s 2024-06-04T16:11:40.204 INFO:tasks.workunit.client.0.smithi144.stderr: -154> 2024-06-04T16:11:39.850+0000 7f99dd575640 10 monclient(hunting): get_auth_request con 0x55fb8c9a1100 auth_method 0 2024-06-04T16:11:40.204 INFO:tasks.workunit.client.0.smithi144.stderr: -153> 2024-06-04T16:11:39.850+0000 7f99dd575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-06-04T16:11:40.204 INFO:tasks.workunit.client.0.smithi144.stderr: -152> 2024-06-04T16:11:39.850+0000 7f99dd575640 10 monclient(hunting): _init_auth method 2 2024-06-04T16:11:40.204 INFO:tasks.workunit.client.0.smithi144.stderr: -151> 2024-06-04T16:11:39.850+0000 7f99dd575640 10 monclient(hunting): _init_auth creating new auth 2024-06-04T16:11:40.204 INFO:tasks.workunit.client.0.smithi144.stderr: -150> 2024-06-04T16:11:39.850+0000 7f99e5d76640 10 monclient(hunting): get_auth_request con 0x55fb8c9cb880 auth_method 0 2024-06-04T16:11:40.204 INFO:tasks.workunit.client.0.smithi144.stderr: -149> 2024-06-04T16:11:39.850+0000 7f99e5d76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-06-04T16:11:40.204 INFO:tasks.workunit.client.0.smithi144.stderr: -148> 2024-06-04T16:11:39.850+0000 7f99e5d76640 10 monclient(hunting): _init_auth method 2 2024-06-04T16:11:40.205 INFO:tasks.workunit.client.0.smithi144.stderr: -147> 2024-06-04T16:11:39.850+0000 7f99e5d76640 10 monclient(hunting): _init_auth creating new auth 2024-06-04T16:11:40.205 INFO:tasks.workunit.client.0.smithi144.stderr: -146> 2024-06-04T16:11:39.850+0000 7f99e6577640 10 monclient(hunting): get_auth_request con 0x55fb8c9c1900 auth_method 0 2024-06-04T16:11:40.205 INFO:tasks.workunit.client.0.smithi144.stderr: -145> 2024-06-04T16:11:39.850+0000 7f99e6577640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-06-04T16:11:40.205 INFO:tasks.workunit.client.0.smithi144.stderr: -144> 2024-06-04T16:11:39.850+0000 7f99e6577640 10 monclient(hunting): _init_auth method 2 2024-06-04T16:11:40.205 INFO:tasks.workunit.client.0.smithi144.stderr: -143> 2024-06-04T16:11:39.850+0000 7f99e6577640 10 monclient(hunting): _init_auth creating new auth 2024-06-04T16:11:40.205 INFO:tasks.workunit.client.0.smithi144.stderr: -142> 2024-06-04T16:11:39.850+0000 7f99dd575640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-06-04T16:11:40.205 INFO:tasks.workunit.client.0.smithi144.stderr: -141> 2024-06-04T16:11:39.850+0000 7f99dd575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-06-04T16:11:40.205 INFO:tasks.workunit.client.0.smithi144.stderr: -140> 2024-06-04T16:11:39.850+0000 7f99dd575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-06-04T16:11:40.205 INFO:tasks.workunit.client.0.smithi144.stderr: -139> 2024-06-04T16:11:39.850+0000 7f99e5d76640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-06-04T16:11:40.205 INFO:tasks.workunit.client.0.smithi144.stderr: -138> 2024-06-04T16:11:39.850+0000 7f99e5d76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-06-04T16:11:40.205 INFO:tasks.workunit.client.0.smithi144.stderr: -137> 2024-06-04T16:11:39.850+0000 7f99e5d76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-06-04T16:11:40.205 INFO:tasks.workunit.client.0.smithi144.stderr: -136> 2024-06-04T16:11:39.850+0000 7f99e6577640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-06-04T16:11:40.205 INFO:tasks.workunit.client.0.smithi144.stderr: -135> 2024-06-04T16:11:39.850+0000 7f99e6577640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-06-04T16:11:40.205 INFO:tasks.workunit.client.0.smithi144.stderr: -134> 2024-06-04T16:11:39.850+0000 7f99e6577640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-06-04T16:11:40.206 INFO:tasks.workunit.client.0.smithi144.stderr: -133> 2024-06-04T16:11:39.850+0000 7f99dd575640 10 monclient(hunting): handle_auth_done global_id 5969 payload 824 2024-06-04T16:11:40.206 INFO:tasks.workunit.client.0.smithi144.stderr: -132> 2024-06-04T16:11:39.850+0000 7f99dd575640 10 monclient: _finish_hunting 0 2024-06-04T16:11:40.206 INFO:tasks.workunit.client.0.smithi144.stderr: -131> 2024-06-04T16:11:39.850+0000 7f99dd575640 1 monclient: found mon.noname-c 2024-06-04T16:11:40.206 INFO:tasks.workunit.client.0.smithi144.stderr: -130> 2024-06-04T16:11:39.850+0000 7f99dd575640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.144:3301/0 2024-06-04T16:11:40.206 INFO:tasks.workunit.client.0.smithi144.stderr: -129> 2024-06-04T16:11:39.850+0000 7f98b77fe640 10 monclient: handle_monmap mon_map magic: 0 2024-06-04T16:11:40.206 INFO:tasks.workunit.client.0.smithi144.stderr: -128> 2024-06-04T16:11:39.850+0000 7f98b77fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-06-04T16:11:40.206 INFO:tasks.workunit.client.0.smithi144.stderr: -127> 2024-06-04T16:11:39.850+0000 7f98b77fe640 10 monclient: dump: 2024-06-04T16:11:40.206 INFO:tasks.workunit.client.0.smithi144.stderr:epoch 1 2024-06-04T16:11:40.206 INFO:tasks.workunit.client.0.smithi144.stderr:fsid 15e56bb1-4856-42f3-b6db-a2c8f23c5557 2024-06-04T16:11:40.206 INFO:tasks.workunit.client.0.smithi144.stderr:last_changed 2024-06-04T15:51:29.789359+0000 2024-06-04T16:11:40.206 INFO:tasks.workunit.client.0.smithi144.stderr:created 2024-06-04T15:51:29.789359+0000 2024-06-04T16:11:40.206 INFO:tasks.workunit.client.0.smithi144.stderr:min_mon_release 19 (squid) 2024-06-04T16:11:40.206 INFO:tasks.workunit.client.0.smithi144.stderr:election_strategy: 1 2024-06-04T16:11:40.206 INFO:tasks.workunit.client.0.smithi144.stderr:0: [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] mon.a 2024-06-04T16:11:40.207 INFO:tasks.workunit.client.0.smithi144.stderr:1: [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] mon.b 2024-06-04T16:11:40.207 INFO:tasks.workunit.client.0.smithi144.stderr:2: [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] mon.c 2024-06-04T16:11:40.207 INFO:tasks.workunit.client.0.smithi144.stderr: 2024-06-04T16:11:40.207 INFO:tasks.workunit.client.0.smithi144.stderr: -126> 2024-06-04T16:11:39.850+0000 7f98b77fe640 10 monclient: _finish_auth 0 2024-06-04T16:11:40.207 INFO:tasks.workunit.client.0.smithi144.stderr: -125> 2024-06-04T16:11:39.850+0000 7f98b77fe640 10 monclient: _check_auth_tickets 2024-06-04T16:11:40.207 INFO:tasks.workunit.client.0.smithi144.stderr: -124> 2024-06-04T16:11:39.850+0000 7f98b77fe640 10 monclient: handle_config config(0 keys) 2024-06-04T16:11:40.207 INFO:tasks.workunit.client.0.smithi144.stderr: -123> 2024-06-04T16:11:39.850+0000 7f98b77fe640 10 monclient: handle_monmap mon_map magic: 0 2024-06-04T16:11:40.207 INFO:tasks.workunit.client.0.smithi144.stderr: -122> 2024-06-04T16:11:39.850+0000 7f98b77fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-06-04T16:11:40.207 INFO:tasks.workunit.client.0.smithi144.stderr: -121> 2024-06-04T16:11:39.850+0000 7f98b77fe640 10 monclient: dump: 2024-06-04T16:11:40.207 INFO:tasks.workunit.client.0.smithi144.stderr:epoch 1 2024-06-04T16:11:40.207 INFO:tasks.workunit.client.0.smithi144.stderr:fsid 15e56bb1-4856-42f3-b6db-a2c8f23c5557 2024-06-04T16:11:40.207 INFO:tasks.workunit.client.0.smithi144.stderr:last_changed 2024-06-04T15:51:29.789359+0000 2024-06-04T16:11:40.207 INFO:tasks.workunit.client.0.smithi144.stderr:created 2024-06-04T15:51:29.789359+0000 2024-06-04T16:11:40.207 INFO:tasks.workunit.client.0.smithi144.stderr:min_mon_release 19 (squid) 2024-06-04T16:11:40.208 INFO:tasks.workunit.client.0.smithi144.stderr:election_strategy: 1 2024-06-04T16:11:40.208 INFO:tasks.workunit.client.0.smithi144.stderr:0: [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] mon.a 2024-06-04T16:11:40.208 INFO:tasks.workunit.client.0.smithi144.stderr:1: [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] mon.b 2024-06-04T16:11:40.208 INFO:tasks.workunit.client.0.smithi144.stderr:2: [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] mon.c 2024-06-04T16:11:40.208 INFO:tasks.workunit.client.0.smithi144.stderr: 2024-06-04T16:11:40.208 INFO:tasks.workunit.client.0.smithi144.stderr: -120> 2024-06-04T16:11:39.850+0000 7f99e8281800 5 monclient: authenticate success, global_id 5969 2024-06-04T16:11:40.208 INFO:tasks.workunit.client.0.smithi144.stderr: -119> 2024-06-04T16:11:39.850+0000 7f99e8281800 10 monclient: _renew_subs 2024-06-04T16:11:40.208 INFO:tasks.workunit.client.0.smithi144.stderr: -118> 2024-06-04T16:11:39.850+0000 7f98c97fa640 4 set_mon_vals no callback set 2024-06-04T16:11:40.208 INFO:tasks.workunit.client.0.smithi144.stderr: -117> 2024-06-04T16:11:39.850+0000 7f99e8281800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.144:3301/0 2024-06-04T16:11:40.208 INFO:tasks.workunit.client.0.smithi144.stderr: -116> 2024-06-04T16:11:39.850+0000 7f99e8281800 10 monclient: _renew_subs 2024-06-04T16:11:40.208 INFO:tasks.workunit.client.0.smithi144.stderr: -115> 2024-06-04T16:11:39.850+0000 7f99e8281800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.144:3301/0 2024-06-04T16:11:40.208 INFO:tasks.workunit.client.0.smithi144.stderr: -114> 2024-06-04T16:11:39.850+0000 7f99e8281800 1 librados: init done 2024-06-04T16:11:40.208 INFO:tasks.workunit.client.0.smithi144.stderr: -113> 2024-06-04T16:11:39.850+0000 7f99e8281800 5 asok(0x55fb8c6dbc60) register_command cr dump hook 0x55fb8c9cabf8 2024-06-04T16:11:40.208 INFO:tasks.workunit.client.0.smithi144.stderr: -112> 2024-06-04T16:11:39.852+0000 7f99e8281800 20 rados->read ofs=0 len=0 2024-06-04T16:11:40.209 INFO:tasks.workunit.client.0.smithi144.stderr: -111> 2024-06-04T16:11:39.852+0000 7f98b77fe640 4 mgrc handle_mgr_map Got map version 5 2024-06-04T16:11:40.209 INFO:tasks.workunit.client.0.smithi144.stderr: -110> 2024-06-04T16:11:39.852+0000 7f98b77fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.177:6832/2645786330,v1:172.21.15.177:6833/2645786330] 2024-06-04T16:11:40.209 INFO:tasks.workunit.client.0.smithi144.stderr: -109> 2024-06-04T16:11:39.852+0000 7f98b77fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.177:6832/2645786330,v1:172.21.15.177:6833/2645786330] 2024-06-04T16:11:40.209 INFO:tasks.workunit.client.0.smithi144.stderr: -108> 2024-06-04T16:11:39.852+0000 7f99e6577640 10 monclient: get_auth_request con 0x7f98b0074ce0 auth_method 0 2024-06-04T16:11:40.209 INFO:tasks.workunit.client.0.smithi144.stderr: -107> 2024-06-04T16:11:39.852+0000 7f99e5d76640 10 monclient: get_auth_request con 0x55fb8c9e96a0 auth_method 0 2024-06-04T16:11:40.209 INFO:tasks.workunit.client.0.smithi144.stderr: -106> 2024-06-04T16:11:39.853+0000 7f99e8281800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:11:40.209 INFO:tasks.workunit.client.0.smithi144.stderr: -105> 2024-06-04T16:11:39.853+0000 7f99e8281800 20 realm 2024-06-04T16:11:40.209 INFO:tasks.workunit.client.0.smithi144.stderr: -104> 2024-06-04T16:11:39.853+0000 7f99e8281800 20 rados->read ofs=0 len=0 2024-06-04T16:11:40.209 INFO:tasks.workunit.client.0.smithi144.stderr: -103> 2024-06-04T16:11:39.853+0000 7f99e8281800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:11:40.209 INFO:tasks.workunit.client.0.smithi144.stderr: -102> 2024-06-04T16:11:39.853+0000 7f99e8281800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-06-04T16:11:40.209 INFO:tasks.workunit.client.0.smithi144.stderr: -101> 2024-06-04T16:11:39.853+0000 7f99e8281800 20 rados->read ofs=0 len=0 2024-06-04T16:11:40.209 INFO:tasks.workunit.client.0.smithi144.stderr: -100> 2024-06-04T16:11:39.853+0000 7f99e8281800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:11:40.209 INFO:tasks.workunit.client.0.smithi144.stderr: -99> 2024-06-04T16:11:39.853+0000 7f99e8281800 20 rados->read ofs=0 len=0 2024-06-04T16:11:40.209 INFO:tasks.workunit.client.0.smithi144.stderr: -98> 2024-06-04T16:11:39.853+0000 7f99dd575640 10 monclient: get_auth_request con 0x55fb8c9ed880 auth_method 0 2024-06-04T16:11:40.210 INFO:tasks.workunit.client.0.smithi144.stderr: -97> 2024-06-04T16:11:39.854+0000 7f99e8281800 20 rados_obj.operate() r=0 bl.length=46 2024-06-04T16:11:40.210 INFO:tasks.workunit.client.0.smithi144.stderr: -96> 2024-06-04T16:11:39.854+0000 7f99e8281800 20 rados->read ofs=0 len=0 2024-06-04T16:11:40.210 INFO:tasks.workunit.client.0.smithi144.stderr: -95> 2024-06-04T16:11:39.854+0000 7f99e6577640 10 monclient: get_auth_request con 0x55fb8c9f1100 auth_method 0 2024-06-04T16:11:40.210 INFO:tasks.workunit.client.0.smithi144.stderr: -94> 2024-06-04T16:11:39.855+0000 7f99e8281800 20 rados_obj.operate() r=0 bl.length=1139 2024-06-04T16:11:40.210 INFO:tasks.workunit.client.0.smithi144.stderr: -93> 2024-06-04T16:11:39.855+0000 7f99e8281800 20 searching for the correct realm 2024-06-04T16:11:40.210 INFO:tasks.workunit.client.0.smithi144.stderr: -92> 2024-06-04T16:11:39.855+0000 7f99e5d76640 10 monclient: get_auth_request con 0x55fb8c9f5ee0 auth_method 0 2024-06-04T16:11:40.210 INFO:tasks.workunit.client.0.smithi144.stderr: -91> 2024-06-04T16:11:39.855+0000 7f99dd575640 10 monclient: get_auth_request con 0x7f99d803e060 auth_method 0 2024-06-04T16:11:40.210 INFO:tasks.workunit.client.0.smithi144.stderr: -90> 2024-06-04T16:11:39.856+0000 7f99e5d76640 0 -- 172.21.15.144:0/533550037 >> [v2:172.21.15.177:6824/800067290,v1:172.21.15.177:6825/800067290] conn(0x55fb8c9e96a0 msgr2=0x55fb8c9ebb10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-06-04T16:11:40.210 INFO:tasks.workunit.client.0.smithi144.stderr: -89> 2024-06-04T16:11:39.856+0000 7f98b77fe640 1 client.5969.objecter ms_handle_reset 0x55fb8c9e96a0 session 0x55fb8c9e8fd0 osd.6 2024-06-04T16:11:40.210 INFO:tasks.workunit.client.0.smithi144.stderr: -88> 2024-06-04T16:11:39.856+0000 7f98b77fe640 10 monclient: _renew_subs 2024-06-04T16:11:40.210 INFO:tasks.workunit.client.0.smithi144.stderr: -87> 2024-06-04T16:11:39.856+0000 7f98b77fe640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.144:3301/0 2024-06-04T16:11:40.210 INFO:tasks.workunit.client.0.smithi144.stderr: -86> 2024-06-04T16:11:39.856+0000 7f99e5d76640 10 monclient: get_auth_request con 0x7f98b0085070 auth_method 0 2024-06-04T16:11:40.210 INFO:tasks.workunit.client.0.smithi144.stderr: -85> 2024-06-04T16:11:39.857+0000 7f99e6577640 10 monclient: get_auth_request con 0x7f99d00cd070 auth_method 0 2024-06-04T16:11:40.210 INFO:tasks.workunit.client.0.smithi144.stderr: -84> 2024-06-04T16:11:39.857+0000 7f99e5d76640 10 monclient: get_auth_request con 0x7f99d8025040 auth_method 0 2024-06-04T16:11:40.211 INFO:tasks.workunit.client.0.smithi144.stderr: -83> 2024-06-04T16:11:39.859+0000 7f99dd575640 0 -- 172.21.15.144:0/533550037 >> [v2:172.21.15.177:6808/2618477608,v1:172.21.15.177:6809/2618477608] conn(0x7f99d006e060 msgr2=0x7f99d009d1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-06-04T16:11:40.211 INFO:tasks.workunit.client.0.smithi144.stderr: -82> 2024-06-04T16:11:40.060+0000 7f99dd575640 10 monclient: get_auth_request con 0x7f99d006e060 auth_method 0 2024-06-04T16:11:40.211 INFO:tasks.workunit.client.0.smithi144.stderr: -81> 2024-06-04T16:11:40.065+0000 7f99e8281800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-06-04T16:11:40.211 INFO:tasks.workunit.client.0.smithi144.stderr: -80> 2024-06-04T16:11:40.065+0000 7f99e8281800 20 RGWRados::pool_iterate: got zone_info.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767 2024-06-04T16:11:40.211 INFO:tasks.workunit.client.0.smithi144.stderr: -79> 2024-06-04T16:11:40.065+0000 7f99e8281800 20 RGWRados::pool_iterate: got default.zone. 2024-06-04T16:11:40.211 INFO:tasks.workunit.client.0.smithi144.stderr: -78> 2024-06-04T16:11:40.065+0000 7f99e8281800 20 RGWRados::pool_iterate: got zonegroup_info.abb22408-c332-4e28-8f7a-ff254ea2fed2 2024-06-04T16:11:40.211 INFO:tasks.workunit.client.0.smithi144.stderr: -77> 2024-06-04T16:11:40.065+0000 7f99e8281800 20 RGWRados::pool_iterate: got zone_names.default 2024-06-04T16:11:40.211 INFO:tasks.workunit.client.0.smithi144.stderr: -76> 2024-06-04T16:11:40.065+0000 7f99e8281800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-06-04T16:11:40.211 INFO:tasks.workunit.client.0.smithi144.stderr: -75> 2024-06-04T16:11:40.065+0000 7f99e8281800 20 rados->read ofs=0 len=0 2024-06-04T16:11:40.211 INFO:tasks.workunit.client.0.smithi144.stderr: -74> 2024-06-04T16:11:40.065+0000 7f99e8281800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:11:40.211 INFO:tasks.workunit.client.0.smithi144.stderr: -73> 2024-06-04T16:11:40.065+0000 7f99e8281800 20 rados->read ofs=0 len=0 2024-06-04T16:11:40.211 INFO:tasks.workunit.client.0.smithi144.stderr: -72> 2024-06-04T16:11:40.066+0000 7f99e8281800 20 rados_obj.operate() r=0 bl.length=46 2024-06-04T16:11:40.211 INFO:tasks.workunit.client.0.smithi144.stderr: -71> 2024-06-04T16:11:40.066+0000 7f99e8281800 20 rados->read ofs=0 len=0 2024-06-04T16:11:40.211 INFO:tasks.workunit.client.0.smithi144.stderr: -70> 2024-06-04T16:11:40.066+0000 7f99e8281800 20 rados_obj.operate() r=0 bl.length=470 2024-06-04T16:11:40.212 INFO:tasks.workunit.client.0.smithi144.stderr: -69> 2024-06-04T16:11:40.066+0000 7f99e8281800 20 zone default found 2024-06-04T16:11:40.212 INFO:tasks.workunit.client.0.smithi144.stderr: -68> 2024-06-04T16:11:40.066+0000 7f99e8281800 4 Realm: () 2024-06-04T16:11:40.212 INFO:tasks.workunit.client.0.smithi144.stderr: -67> 2024-06-04T16:11:40.066+0000 7f99e8281800 4 ZoneGroup: default (abb22408-c332-4e28-8f7a-ff254ea2fed2) 2024-06-04T16:11:40.212 INFO:tasks.workunit.client.0.smithi144.stderr: -66> 2024-06-04T16:11:40.066+0000 7f99e8281800 4 Zone: default (be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767) 2024-06-04T16:11:40.212 INFO:tasks.workunit.client.0.smithi144.stderr: -65> 2024-06-04T16:11:40.066+0000 7f99e8281800 10 cannot find current period zonegroup using local zonegroup configuration 2024-06-04T16:11:40.212 INFO:tasks.workunit.client.0.smithi144.stderr: -64> 2024-06-04T16:11:40.066+0000 7f99e8281800 20 zonegroup default 2024-06-04T16:11:40.212 INFO:tasks.workunit.client.0.smithi144.stderr: -63> 2024-06-04T16:11:40.066+0000 7f99e8281800 20 rados->read ofs=0 len=0 2024-06-04T16:11:40.212 INFO:tasks.workunit.client.0.smithi144.stderr: -62> 2024-06-04T16:11:40.066+0000 7f99e8281800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:11:40.212 INFO:tasks.workunit.client.0.smithi144.stderr: -61> 2024-06-04T16:11:40.066+0000 7f99e8281800 20 rados->read ofs=0 len=0 2024-06-04T16:11:40.212 INFO:tasks.workunit.client.0.smithi144.stderr: -60> 2024-06-04T16:11:40.067+0000 7f99e8281800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:11:40.212 INFO:tasks.workunit.client.0.smithi144.stderr: -59> 2024-06-04T16:11:40.067+0000 7f99e8281800 20 rados->read ofs=0 len=0 2024-06-04T16:11:40.212 INFO:tasks.workunit.client.0.smithi144.stderr: -58> 2024-06-04T16:11:40.067+0000 7f99e8281800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:11:40.212 INFO:tasks.workunit.client.0.smithi144.stderr: -57> 2024-06-04T16:11:40.067+0000 7f99e8281800 20 started sync module instance, tier type = 2024-06-04T16:11:40.212 INFO:tasks.workunit.client.0.smithi144.stderr: -56> 2024-06-04T16:11:40.067+0000 7f99e8281800 20 started zone id=be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767 (name=default) with tier type = 2024-06-04T16:11:40.212 INFO:tasks.workunit.client.0.smithi144.stderr: -55> 2024-06-04T16:11:40.076+0000 7f99e8281800 20 add_watcher() i=0 2024-06-04T16:11:40.213 INFO:tasks.workunit.client.0.smithi144.stderr: -54> 2024-06-04T16:11:40.076+0000 7f99e8281800 20 add_watcher() i=1 2024-06-04T16:11:40.213 INFO:tasks.workunit.client.0.smithi144.stderr: -53> 2024-06-04T16:11:40.076+0000 7f99e8281800 20 add_watcher() i=2 2024-06-04T16:11:40.213 INFO:tasks.workunit.client.0.smithi144.stderr: -52> 2024-06-04T16:11:40.076+0000 7f99e8281800 20 add_watcher() i=3 2024-06-04T16:11:40.213 INFO:tasks.workunit.client.0.smithi144.stderr: -51> 2024-06-04T16:11:40.076+0000 7f99e8281800 20 add_watcher() i=4 2024-06-04T16:11:40.213 INFO:tasks.workunit.client.0.smithi144.stderr: -50> 2024-06-04T16:11:40.076+0000 7f99e8281800 20 add_watcher() i=5 2024-06-04T16:11:40.213 INFO:tasks.workunit.client.0.smithi144.stderr: -49> 2024-06-04T16:11:40.076+0000 7f99e8281800 20 add_watcher() i=6 2024-06-04T16:11:40.213 INFO:tasks.workunit.client.0.smithi144.stderr: -48> 2024-06-04T16:11:40.077+0000 7f99e8281800 20 add_watcher() i=7 2024-06-04T16:11:40.213 INFO:tasks.workunit.client.0.smithi144.stderr: -47> 2024-06-04T16:11:40.077+0000 7f99e8281800 2 all 8 watchers are set, enabling cache 2024-06-04T16:11:40.213 INFO:tasks.workunit.client.0.smithi144.stderr: -46> 2024-06-04T16:11:40.078+0000 7f99e8281800 5 AuthRegistry(0x7ffdc44ea190) adding auth protocol: cephx 2024-06-04T16:11:40.213 INFO:tasks.workunit.client.0.smithi144.stderr: -45> 2024-06-04T16:11:40.078+0000 7f99e8281800 5 AuthRegistry(0x7ffdc44ea190) adding auth protocol: cephx 2024-06-04T16:11:40.213 INFO:tasks.workunit.client.0.smithi144.stderr: -44> 2024-06-04T16:11:40.078+0000 7f99e8281800 5 AuthRegistry(0x7ffdc44ea190) adding auth protocol: cephx 2024-06-04T16:11:40.213 INFO:tasks.workunit.client.0.smithi144.stderr: -43> 2024-06-04T16:11:40.078+0000 7f99e8281800 5 AuthRegistry(0x7ffdc44ea190) adding con mode: secure 2024-06-04T16:11:40.213 INFO:tasks.workunit.client.0.smithi144.stderr: -42> 2024-06-04T16:11:40.078+0000 7f99e8281800 5 AuthRegistry(0x7ffdc44ea190) adding con mode: crc 2024-06-04T16:11:40.213 INFO:tasks.workunit.client.0.smithi144.stderr: -41> 2024-06-04T16:11:40.078+0000 7f99e8281800 5 AuthRegistry(0x7ffdc44ea190) adding con mode: secure 2024-06-04T16:11:40.214 INFO:tasks.workunit.client.0.smithi144.stderr: -40> 2024-06-04T16:11:40.078+0000 7f99e8281800 5 AuthRegistry(0x7ffdc44ea190) adding con mode: crc 2024-06-04T16:11:40.214 INFO:tasks.workunit.client.0.smithi144.stderr: -39> 2024-06-04T16:11:40.078+0000 7f99e8281800 5 AuthRegistry(0x7ffdc44ea190) adding con mode: secure 2024-06-04T16:11:40.214 INFO:tasks.workunit.client.0.smithi144.stderr: -38> 2024-06-04T16:11:40.078+0000 7f99e8281800 5 AuthRegistry(0x7ffdc44ea190) adding con mode: crc 2024-06-04T16:11:40.214 INFO:tasks.workunit.client.0.smithi144.stderr: -37> 2024-06-04T16:11:40.078+0000 7f98977fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-06-04T16:11:40.214 INFO:tasks.workunit.client.0.smithi144.stderr: -36> 2024-06-04T16:11:40.078+0000 7f99e8281800 5 AuthRegistry(0x7ffdc44ea190) adding con mode: crc 2024-06-04T16:11:40.214 INFO:tasks.workunit.client.0.smithi144.stderr: -35> 2024-06-04T16:11:40.078+0000 7f99e8281800 5 AuthRegistry(0x7ffdc44ea190) adding con mode: secure 2024-06-04T16:11:40.214 INFO:tasks.workunit.client.0.smithi144.stderr: -34> 2024-06-04T16:11:40.078+0000 7f99e8281800 5 AuthRegistry(0x7ffdc44ea190) adding con mode: crc 2024-06-04T16:11:40.214 INFO:tasks.workunit.client.0.smithi144.stderr: -33> 2024-06-04T16:11:40.078+0000 7f99e8281800 5 AuthRegistry(0x7ffdc44ea190) adding con mode: secure 2024-06-04T16:11:40.214 INFO:tasks.workunit.client.0.smithi144.stderr: -32> 2024-06-04T16:11:40.078+0000 7f99e8281800 5 AuthRegistry(0x7ffdc44ea190) adding con mode: crc 2024-06-04T16:11:40.214 INFO:tasks.workunit.client.0.smithi144.stderr: -31> 2024-06-04T16:11:40.078+0000 7f99e8281800 5 AuthRegistry(0x7ffdc44ea190) adding con mode: secure 2024-06-04T16:11:40.214 INFO:tasks.workunit.client.0.smithi144.stderr: -30> 2024-06-04T16:11:40.079+0000 7f99e8281800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-06-04T16:11:40.214 INFO:tasks.workunit.client.0.smithi144.stderr: -29> 2024-06-04T16:11:40.079+0000 7f99e8281800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-06-04T16:11:40.214 INFO:tasks.workunit.client.0.smithi144.stderr: -28> 2024-06-04T16:11:40.079+0000 7f99e8281800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-06-04T16:11:40.215 INFO:tasks.workunit.client.0.smithi144.stderr: -27> 2024-06-04T16:11:40.079+0000 7f99e8281800 5 asok(0x55fb8c6dbc60) register_command cache list hook 0x55fb8c9d3490 2024-06-04T16:11:40.215 INFO:tasks.workunit.client.0.smithi144.stderr: -26> 2024-06-04T16:11:40.079+0000 7f99e8281800 5 asok(0x55fb8c6dbc60) register_command cache inspect hook 0x55fb8c9d3490 2024-06-04T16:11:40.215 INFO:tasks.workunit.client.0.smithi144.stderr: -25> 2024-06-04T16:11:40.079+0000 7f99e8281800 5 asok(0x55fb8c6dbc60) register_command cache erase hook 0x55fb8c9d3490 2024-06-04T16:11:40.215 INFO:tasks.workunit.client.0.smithi144.stderr: -24> 2024-06-04T16:11:40.079+0000 7f99e8281800 5 asok(0x55fb8c6dbc60) register_command cache zap hook 0x55fb8c9d3490 2024-06-04T16:11:40.215 INFO:tasks.workunit.client.0.smithi144.stderr: -23> 2024-06-04T16:11:40.079+0000 7f99e8281800 5 note: GC not initialized 2024-06-04T16:11:40.215 INFO:tasks.workunit.client.0.smithi144.stderr: -22> 2024-06-04T16:11:40.079+0000 7f98967fc640 20 reqs_thread_entry: start 2024-06-04T16:11:40.215 INFO:tasks.workunit.client.0.smithi144.stderr: -21> 2024-06-04T16:11:40.079+0000 7f99e8281800 5 asok(0x55fb8c6dbc60) register_command sync trace show hook 0x7f99d4001d30 2024-06-04T16:11:40.215 INFO:tasks.workunit.client.0.smithi144.stderr: -20> 2024-06-04T16:11:40.079+0000 7f99e8281800 5 asok(0x55fb8c6dbc60) register_command sync trace history hook 0x7f99d4001d30 2024-06-04T16:11:40.215 INFO:tasks.workunit.client.0.smithi144.stderr: -19> 2024-06-04T16:11:40.079+0000 7f99e8281800 5 asok(0x55fb8c6dbc60) register_command sync trace active hook 0x7f99d4001d30 2024-06-04T16:11:40.215 INFO:tasks.workunit.client.0.smithi144.stderr: -18> 2024-06-04T16:11:40.079+0000 7f99e8281800 5 asok(0x55fb8c6dbc60) register_command sync trace active_short hook 0x7f99d4001d30 2024-06-04T16:11:40.215 INFO:tasks.workunit.client.0.smithi144.stderr: -17> 2024-06-04T16:11:40.079+0000 7f99e8281800 20 init_complete bucket index max shards: 11 2024-06-04T16:11:40.215 INFO:tasks.workunit.client.0.smithi144.stderr: -16> 2024-06-04T16:11:40.079+0000 7f99e8281800 20 Filter name: none 2024-06-04T16:11:40.215 INFO:tasks.workunit.client.0.smithi144.stderr: -15> 2024-06-04T16:11:40.079+0000 7f9807fff640 20 reqs_thread_entry: start 2024-06-04T16:11:40.215 INFO:tasks.workunit.client.0.smithi144.stderr: -14> 2024-06-04T16:11:40.079+0000 7f99e8281800 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2024-06-04T16:11:40.215 INFO:tasks.workunit.client.0.smithi144.stderr: -13> 2024-06-04T16:11:40.079+0000 7f99e8281800 20 rados->read ofs=0 len=0 2024-06-04T16:11:40.216 INFO:tasks.workunit.client.0.smithi144.stderr: -12> 2024-06-04T16:11:40.080+0000 7f99e8281800 20 rados_obj.operate() r=0 bl.length=194 2024-06-04T16:11:40.216 INFO:tasks.workunit.client.0.smithi144.stderr: -11> 2024-06-04T16:11:40.080+0000 7f99e8281800 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2024-06-04T16:11:40.216 INFO:tasks.workunit.client.0.smithi144.stderr: -10> 2024-06-04T16:11:40.080+0000 7f99e8281800 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2024-06-04T16:11:40.216 INFO:tasks.workunit.client.0.smithi144.stderr: -9> 2024-06-04T16:11:40.080+0000 7f99e8281800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.21 : miss 2024-06-04T16:11:40.216 INFO:tasks.workunit.client.0.smithi144.stderr: -8> 2024-06-04T16:11:40.080+0000 7f99e8281800 20 rados->read ofs=0 len=0 2024-06-04T16:11:40.216 INFO:tasks.workunit.client.0.smithi144.stderr: -7> 2024-06-04T16:11:40.080+0000 7f99e8281800 20 rados_obj.operate() r=0 bl.length=408 2024-06-04T16:11:40.216 INFO:tasks.workunit.client.0.smithi144.stderr: -6> 2024-06-04T16:11:40.080+0000 7f99e8281800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.21 info.flags=0x17 2024-06-04T16:11:40.216 INFO:tasks.workunit.client.0.smithi144.stderr: -5> 2024-06-04T16:11:40.080+0000 7f99e8281800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.21 to cache LRU end 2024-06-04T16:11:40.216 INFO:tasks.workunit.client.0.smithi144.stderr: -4> 2024-06-04T16:11:40.080+0000 7f99e8281800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-06-04T16:11:40.216 INFO:tasks.workunit.client.0.smithi144.stderr: -3> 2024-06-04T16:11:40.080+0000 7f99e8281800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-06-04T16:11:40.216 INFO:tasks.workunit.client.0.smithi144.stderr: -2> 2024-06-04T16:11:40.080+0000 7f99e8281800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.21 2024-06-04T16:11:40.216 INFO:tasks.workunit.client.0.smithi144.stderr: -1> 2024-06-04T16:11:40.089+0000 7f99e8281800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-4027-g65533a90/rpm/el9/BUILD/ceph-19.0.0-4027-g65533a90/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f99e8281800 time 2024-06-04T16:11:40.090689+0000 2024-06-04T16:11:40.216 INFO:tasks.workunit.client.0.smithi144.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-4027-g65533a90/rpm/el9/BUILD/ceph-19.0.0-4027-g65533a90/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-06-04T16:11:40.216 INFO:tasks.workunit.client.0.smithi144.stderr: 2024-06-04T16:11:40.217 INFO:tasks.workunit.client.0.smithi144.stderr: ceph version 19.0.0-4027-g65533a90 (65533a907fc9add1863609703fdbbea67993c8ef) squid (dev) 2024-06-04T16:11:40.217 INFO:tasks.workunit.client.0.smithi144.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f99eb581dce] 2024-06-04T16:11:40.217 INFO:tasks.workunit.client.0.smithi144.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x181f8c) [0x7f99eb581f8c] 2024-06-04T16:11:40.217 INFO:tasks.workunit.client.0.smithi144.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55fb8b980fb1] 2024-06-04T16:11:40.217 INFO:tasks.workunit.client.0.smithi144.stderr: 4: radosgw-admin(+0x845a9a) [0x55fb8b987a9a] 2024-06-04T16:11:40.217 INFO:tasks.workunit.client.0.smithi144.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x267) [0x55fb8b98c2d7] 2024-06-04T16:11:40.217 INFO:tasks.workunit.client.0.smithi144.stderr: 6: main() 2024-06-04T16:11:40.217 INFO:tasks.workunit.client.0.smithi144.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f99ea429590] 2024-06-04T16:11:40.217 INFO:tasks.workunit.client.0.smithi144.stderr: 8: __libc_start_main() 2024-06-04T16:11:40.217 INFO:tasks.workunit.client.0.smithi144.stderr: 9: _start() 2024-06-04T16:11:40.217 INFO:tasks.workunit.client.0.smithi144.stderr: 2024-06-04T16:11:40.217 INFO:tasks.workunit.client.0.smithi144.stderr: 0> 2024-06-04T16:11:40.090+0000 7f99e8281800 -1 *** Caught signal (Aborted) ** 2024-06-04T16:11:40.217 INFO:tasks.workunit.client.0.smithi144.stderr: in thread 7f99e8281800 thread_name:radosgw-admin 2024-06-04T16:11:40.217 INFO:tasks.workunit.client.0.smithi144.stderr: 2024-06-04T16:11:40.218 INFO:tasks.workunit.client.0.smithi144.stderr: ceph version 19.0.0-4027-g65533a90 (65533a907fc9add1863609703fdbbea67993c8ef) squid (dev) 2024-06-04T16:11:40.218 INFO:tasks.workunit.client.0.smithi144.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f99ea43e6f0] 2024-06-04T16:11:40.218 INFO:tasks.workunit.client.0.smithi144.stderr: 2: /lib64/libc.so.6(+0x8b94c) [0x7f99ea48b94c] 2024-06-04T16:11:40.218 INFO:tasks.workunit.client.0.smithi144.stderr: 3: raise() 2024-06-04T16:11:40.218 INFO:tasks.workunit.client.0.smithi144.stderr: 4: abort() 2024-06-04T16:11:40.218 INFO:tasks.workunit.client.0.smithi144.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f99eb581e28] 2024-06-04T16:11:40.218 INFO:tasks.workunit.client.0.smithi144.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x181f8c) [0x7f99eb581f8c] 2024-06-04T16:11:40.218 INFO:tasks.workunit.client.0.smithi144.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55fb8b980fb1] 2024-06-04T16:11:40.218 INFO:tasks.workunit.client.0.smithi144.stderr: 8: radosgw-admin(+0x845a9a) [0x55fb8b987a9a] 2024-06-04T16:11:40.218 INFO:tasks.workunit.client.0.smithi144.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x267) [0x55fb8b98c2d7] 2024-06-04T16:11:40.218 INFO:tasks.workunit.client.0.smithi144.stderr: 10: main() 2024-06-04T16:11:40.218 INFO:tasks.workunit.client.0.smithi144.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f99ea429590] 2024-06-04T16:11:40.218 INFO:tasks.workunit.client.0.smithi144.stderr: 12: __libc_start_main() 2024-06-04T16:11:40.219 INFO:tasks.workunit.client.0.smithi144.stderr: 13: _start() 2024-06-04T16:11:40.219 INFO:tasks.workunit.client.0.smithi144.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-06-04T16:11:40.219 INFO:tasks.workunit.client.0.smithi144.stderr: 2024-06-04T16:11:40.219 INFO:tasks.workunit.client.0.smithi144.stderr:--- logging levels --- 2024-06-04T16:11:40.219 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 5 none 2024-06-04T16:11:40.219 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 1 lockdep 2024-06-04T16:11:40.219 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 1 context 2024-06-04T16:11:40.219 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 1 crush 2024-06-04T16:11:40.219 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 5 mds 2024-06-04T16:11:40.219 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 5 mds_balancer 2024-06-04T16:11:40.219 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 5 mds_locker 2024-06-04T16:11:40.219 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 5 mds_log 2024-06-04T16:11:40.219 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 5 mds_log_expire 2024-06-04T16:11:40.219 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 5 mds_migrator 2024-06-04T16:11:40.220 INFO:tasks.workunit.client.0.smithi144.stderr: 3/ 5 mds_quiesce 2024-06-04T16:11:40.220 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 1 buffer 2024-06-04T16:11:40.220 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 1 timer 2024-06-04T16:11:40.220 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 1 filer 2024-06-04T16:11:40.220 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 1 striper 2024-06-04T16:11:40.220 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 1 objecter 2024-06-04T16:11:40.220 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 5 rados 2024-06-04T16:11:40.220 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 5 rbd 2024-06-04T16:11:40.220 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 5 rbd_mirror 2024-06-04T16:11:40.220 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 5 rbd_replay 2024-06-04T16:11:40.220 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 5 rbd_pwl 2024-06-04T16:11:40.220 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 5 journaler 2024-06-04T16:11:40.220 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 5 objectcacher 2024-06-04T16:11:40.220 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 5 immutable_obj_cache 2024-06-04T16:11:40.220 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 5 client 2024-06-04T16:11:40.220 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 5 osd 2024-06-04T16:11:40.221 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 5 optracker 2024-06-04T16:11:40.221 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 5 objclass 2024-06-04T16:11:40.221 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 3 filestore 2024-06-04T16:11:40.221 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 3 journal 2024-06-04T16:11:40.221 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 0 ms 2024-06-04T16:11:40.221 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 5 mon 2024-06-04T16:11:40.221 INFO:tasks.workunit.client.0.smithi144.stderr: 0/10 monc 2024-06-04T16:11:40.221 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 5 paxos 2024-06-04T16:11:40.221 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 5 tp 2024-06-04T16:11:40.221 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 5 auth 2024-06-04T16:11:40.221 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 5 crypto 2024-06-04T16:11:40.221 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 1 finisher 2024-06-04T16:11:40.221 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 1 reserver 2024-06-04T16:11:40.221 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 5 heartbeatmap 2024-06-04T16:11:40.221 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 5 perfcounter 2024-06-04T16:11:40.222 INFO:tasks.workunit.client.0.smithi144.stderr: 20/20 rgw 2024-06-04T16:11:40.222 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 5 rgw_sync 2024-06-04T16:11:40.222 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 5 rgw_datacache 2024-06-04T16:11:40.222 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 5 rgw_access 2024-06-04T16:11:40.222 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 5 rgw_dbstore 2024-06-04T16:11:40.222 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 5 rgw_flight 2024-06-04T16:11:40.222 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 5 rgw_lifecycle 2024-06-04T16:11:40.222 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 5 rgw_notification 2024-06-04T16:11:40.222 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 5 javaclient 2024-06-04T16:11:40.222 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 5 asok 2024-06-04T16:11:40.222 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 1 throttle 2024-06-04T16:11:40.222 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 0 refs 2024-06-04T16:11:40.222 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 5 compressor 2024-06-04T16:11:40.223 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 5 bluestore 2024-06-04T16:11:40.223 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 5 bluefs 2024-06-04T16:11:40.223 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 3 bdev 2024-06-04T16:11:40.223 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 5 kstore 2024-06-04T16:11:40.223 INFO:tasks.workunit.client.0.smithi144.stderr: 4/ 5 rocksdb 2024-06-04T16:11:40.223 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 5 fuse 2024-06-04T16:11:40.223 INFO:tasks.workunit.client.0.smithi144.stderr: 2/ 5 mgr 2024-06-04T16:11:40.223 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 5 mgrc 2024-06-04T16:11:40.223 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 5 dpdk 2024-06-04T16:11:40.223 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 5 eventtrace 2024-06-04T16:11:40.223 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 5 prioritycache 2024-06-04T16:11:40.223 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 5 test 2024-06-04T16:11:40.223 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 5 cephfs_mirror 2024-06-04T16:11:40.223 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 5 cephsqlite 2024-06-04T16:11:40.224 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 5 crimson_interrupt 2024-06-04T16:11:40.224 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 5 seastore 2024-06-04T16:11:40.224 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 5 seastore_onode 2024-06-04T16:11:40.224 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 5 seastore_odata 2024-06-04T16:11:40.224 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 5 seastore_omap 2024-06-04T16:11:40.224 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 5 seastore_tm 2024-06-04T16:11:40.224 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 5 seastore_t 2024-06-04T16:11:40.224 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 5 seastore_cleaner 2024-06-04T16:11:40.224 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 5 seastore_epm 2024-06-04T16:11:40.224 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 5 seastore_lba 2024-06-04T16:11:40.224 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 5 seastore_fixedkv_tree 2024-06-04T16:11:40.224 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 5 seastore_cache 2024-06-04T16:11:40.224 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 5 seastore_journal 2024-06-04T16:11:40.224 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 5 seastore_device 2024-06-04T16:11:40.224 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 5 seastore_backref 2024-06-04T16:11:40.225 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 5 alienstore 2024-06-04T16:11:40.225 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 5 mclock 2024-06-04T16:11:40.225 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 5 cyanstore 2024-06-04T16:11:40.225 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 5 ceph_exporter 2024-06-04T16:11:40.225 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 5 memstore 2024-06-04T16:11:40.225 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 5 trace 2024-06-04T16:11:40.225 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 5 ceph_dedup 2024-06-04T16:11:40.225 INFO:tasks.workunit.client.0.smithi144.stderr: -2/-2 (syslog threshold) 2024-06-04T16:11:40.225 INFO:tasks.workunit.client.0.smithi144.stderr: 99/99 (stderr threshold) 2024-06-04T16:11:40.225 INFO:tasks.workunit.client.0.smithi144.stderr:--- pthread ID / name mapping for recent threads --- 2024-06-04T16:11:40.225 INFO:tasks.workunit.client.0.smithi144.stderr: 7f9807fff640 / http_manager 2024-06-04T16:11:40.225 INFO:tasks.workunit.client.0.smithi144.stderr: 7f98967fc640 / http_manager 2024-06-04T16:11:40.225 INFO:tasks.workunit.client.0.smithi144.stderr: 7f98977fe640 / rgw_dt_lg_renew 2024-06-04T16:11:40.226 INFO:tasks.workunit.client.0.smithi144.stderr: 7f98b77fe640 / ms_dispatch 2024-06-04T16:11:40.226 INFO:tasks.workunit.client.0.smithi144.stderr: 7f98c97fa640 / io_context_pool 2024-06-04T16:11:40.226 INFO:tasks.workunit.client.0.smithi144.stderr: 7f98cb7fe640 / ms_dispatch 2024-06-04T16:11:40.226 INFO:tasks.workunit.client.0.smithi144.stderr: 7f98d2604640 / ms_dispatch 2024-06-04T16:11:40.226 INFO:tasks.workunit.client.0.smithi144.stderr: 7f98d3e07640 / io_context_pool 2024-06-04T16:11:40.226 INFO:tasks.workunit.client.0.smithi144.stderr: 7f99dd575640 / msgr-worker-2 2024-06-04T16:11:40.226 INFO:tasks.workunit.client.0.smithi144.stderr: 7f99e5d76640 / msgr-worker-1 2024-06-04T16:11:40.226 INFO:tasks.workunit.client.0.smithi144.stderr: 7f99e6577640 / msgr-worker-0 2024-06-04T16:11:40.226 INFO:tasks.workunit.client.0.smithi144.stderr: 7f99e6d78640 / io_context_pool 2024-06-04T16:11:40.226 INFO:tasks.workunit.client.0.smithi144.stderr: 7f99e8281800 / radosgw-admin 2024-06-04T16:11:40.226 INFO:tasks.workunit.client.0.smithi144.stderr: max_recent 500 2024-06-04T16:11:40.226 INFO:tasks.workunit.client.0.smithi144.stderr: max_new 1000 2024-06-04T16:11:40.226 INFO:tasks.workunit.client.0.smithi144.stderr: log_file /var/lib/ceph/crash/2024-06-04T16:11:40.092329Z_45bd999c-c1ca-466f-af0f-ae013c5968fa/log 2024-06-04T16:11:40.226 INFO:tasks.workunit.client.0.smithi144.stderr:--- end dump of recent events --- 2024-06-04T16:11:40.227 INFO:tasks.workunit.client.0.smithi144.stderr:radosgw-admin bucket stats --bucket abort-at-set-target-layout 2024-06-04T16:11:40.228 INFO:tasks.workunit.client.0.smithi144.stderr:ignoring --setuser ceph since I am not root 2024-06-04T16:11:40.229 INFO:tasks.workunit.client.0.smithi144.stderr:ignoring --setgroup ceph since I am not root 2024-06-04T16:11:40.229 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:40.163+0000 7f93fe928800 20 rados->read ofs=0 len=0 2024-06-04T16:11:40.229 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:40.165+0000 7f93fe928800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:11:40.229 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:40.165+0000 7f93fe928800 20 realm 2024-06-04T16:11:40.229 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:40.165+0000 7f93fe928800 20 rados->read ofs=0 len=0 2024-06-04T16:11:40.229 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:40.165+0000 7f93fe928800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:11:40.229 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:40.165+0000 7f93fe928800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-06-04T16:11:40.229 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:40.165+0000 7f93fe928800 20 rados->read ofs=0 len=0 2024-06-04T16:11:40.229 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:40.165+0000 7f93fe928800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:11:40.229 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:40.165+0000 7f93fe928800 20 rados->read ofs=0 len=0 2024-06-04T16:11:40.229 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:40.166+0000 7f93fe928800 20 rados_obj.operate() r=0 bl.length=46 2024-06-04T16:11:40.229 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:40.166+0000 7f93fe928800 20 rados->read ofs=0 len=0 2024-06-04T16:11:40.229 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:40.166+0000 7f93fe928800 20 rados_obj.operate() r=0 bl.length=1139 2024-06-04T16:11:40.229 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:40.167+0000 7f93fe928800 20 searching for the correct realm 2024-06-04T16:11:40.230 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:40.168+0000 7f93fa656640 0 -- 172.21.15.144:0/3649165069 >> [v2:172.21.15.177:6824/800067290,v1:172.21.15.177:6825/800067290] conn(0x5565c27df5c0 msgr2=0x5565c27e1a30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-06-04T16:11:40.230 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:40.171+0000 7f93f3fff640 0 -- 172.21.15.144:0/3649165069 >> [v2:172.21.15.177:6808/2618477608,v1:172.21.15.177:6809/2618477608] conn(0x7f93e402a020 msgr2=0x7f93e4066a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-06-04T16:11:40.380 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:40.378+0000 7f93fe928800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-06-04T16:11:40.380 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:40.378+0000 7f93fe928800 20 RGWRados::pool_iterate: got zone_info.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767 2024-06-04T16:11:40.380 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:40.378+0000 7f93fe928800 20 RGWRados::pool_iterate: got default.zone. 2024-06-04T16:11:40.380 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:40.378+0000 7f93fe928800 20 RGWRados::pool_iterate: got zonegroup_info.abb22408-c332-4e28-8f7a-ff254ea2fed2 2024-06-04T16:11:40.380 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:40.378+0000 7f93fe928800 20 RGWRados::pool_iterate: got zone_names.default 2024-06-04T16:11:40.381 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:40.378+0000 7f93fe928800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-06-04T16:11:40.381 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:40.378+0000 7f93fe928800 20 rados->read ofs=0 len=0 2024-06-04T16:11:40.381 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:40.378+0000 7f93fe928800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:11:40.381 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:40.378+0000 7f93fe928800 20 rados->read ofs=0 len=0 2024-06-04T16:11:40.381 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:40.378+0000 7f93fe928800 20 rados_obj.operate() r=0 bl.length=46 2024-06-04T16:11:40.381 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:40.378+0000 7f93fe928800 20 rados->read ofs=0 len=0 2024-06-04T16:11:40.382 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:40.379+0000 7f93fe928800 20 rados_obj.operate() r=0 bl.length=470 2024-06-04T16:11:40.382 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:40.379+0000 7f93fe928800 20 zone default found 2024-06-04T16:11:40.382 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:40.379+0000 7f93fe928800 4 Realm: () 2024-06-04T16:11:40.382 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:40.379+0000 7f93fe928800 4 ZoneGroup: default (abb22408-c332-4e28-8f7a-ff254ea2fed2) 2024-06-04T16:11:40.383 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:40.379+0000 7f93fe928800 4 Zone: default (be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767) 2024-06-04T16:11:40.383 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:40.379+0000 7f93fe928800 10 cannot find current period zonegroup using local zonegroup configuration 2024-06-04T16:11:40.383 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:40.379+0000 7f93fe928800 20 zonegroup default 2024-06-04T16:11:40.383 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:40.379+0000 7f93fe928800 20 rados->read ofs=0 len=0 2024-06-04T16:11:40.383 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:40.379+0000 7f93fe928800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:11:40.383 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:40.379+0000 7f93fe928800 20 rados->read ofs=0 len=0 2024-06-04T16:11:40.383 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:40.379+0000 7f93fe928800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:11:40.383 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:40.379+0000 7f93fe928800 20 rados->read ofs=0 len=0 2024-06-04T16:11:40.383 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:40.379+0000 7f93fe928800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:11:40.383 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:40.379+0000 7f93fe928800 20 started sync module instance, tier type = 2024-06-04T16:11:40.383 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:40.379+0000 7f93fe928800 20 started zone id=be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767 (name=default) with tier type = 2024-06-04T16:11:40.392 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:40.390+0000 7f93fe928800 20 add_watcher() i=0 2024-06-04T16:11:40.392 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:40.390+0000 7f93fe928800 20 add_watcher() i=1 2024-06-04T16:11:40.392 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:40.390+0000 7f93fe928800 20 add_watcher() i=2 2024-06-04T16:11:40.392 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:40.390+0000 7f93fe928800 20 add_watcher() i=3 2024-06-04T16:11:40.392 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:40.390+0000 7f93fe928800 20 add_watcher() i=4 2024-06-04T16:11:40.392 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:40.390+0000 7f93fe928800 20 add_watcher() i=5 2024-06-04T16:11:40.392 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:40.390+0000 7f93fe928800 20 add_watcher() i=6 2024-06-04T16:11:40.393 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:40.391+0000 7f93fe928800 20 add_watcher() i=7 2024-06-04T16:11:40.393 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:40.391+0000 7f93fe928800 2 all 8 watchers are set, enabling cache 2024-06-04T16:11:40.395 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:40.393+0000 7f92b0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-06-04T16:11:40.395 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:40.393+0000 7f93fe928800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-06-04T16:11:40.396 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:40.393+0000 7f93fe928800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-06-04T16:11:40.396 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:40.393+0000 7f93fe928800 5 note: GC not initialized 2024-06-04T16:11:40.396 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:40.393+0000 7f922b7fe640 20 reqs_thread_entry: start 2024-06-04T16:11:40.396 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:40.394+0000 7f93fe928800 20 init_complete bucket index max shards: 11 2024-06-04T16:11:40.396 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:40.394+0000 7f93fe928800 20 Filter name: none 2024-06-04T16:11:40.396 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:40.394+0000 7f92297fa640 20 reqs_thread_entry: start 2024-06-04T16:11:40.396 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:40.394+0000 7f93fe928800 20 rados->read ofs=0 len=0 2024-06-04T16:11:40.397 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:40.394+0000 7f93fe928800 20 rados_obj.operate() r=0 bl.length=194 2024-06-04T16:11:40.397 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:40.394+0000 7f93fe928800 20 rados->read ofs=0 len=0 2024-06-04T16:11:40.397 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:40.395+0000 7f93fe928800 20 rados_obj.operate() r=0 bl.length=408 2024-06-04T16:11:40.397 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:40.395+0000 7f93fe928800 20 couldn't put binfo cache entry, might have raced with data changes 2024-06-04T16:11:40.397 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:40.395+0000 7f93fe928800 20 rados->read ofs=0 len=0 2024-06-04T16:11:40.397 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:40.395+0000 7f93fe928800 20 rados_obj.operate() r=0 bl.length=194 2024-06-04T16:11:40.398 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:40.395+0000 7f93fe928800 20 rados->read ofs=0 len=0 2024-06-04T16:11:40.398 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:40.395+0000 7f93fe928800 20 rados_obj.operate() r=0 bl.length=408 2024-06-04T16:11:40.398 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:40.395+0000 7f93fe928800 20 couldn't put binfo cache entry, might have raced with data changes 2024-06-04T16:11:40.399 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:40.397+0000 7f92b0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-06-04T16:11:40.401 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:40.399+0000 7f93fe928800 20 remove_watcher() i=0 2024-06-04T16:11:40.401 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:40.399+0000 7f93fe928800 2 removed watcher, disabling cache 2024-06-04T16:11:40.402 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:40.400+0000 7f93fe928800 20 remove_watcher() i=1 2024-06-04T16:11:40.403 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:40.401+0000 7f93fe928800 20 remove_watcher() i=2 2024-06-04T16:11:40.404 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:40.402+0000 7f93fe928800 20 remove_watcher() i=3 2024-06-04T16:11:40.405 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:40.403+0000 7f93fe928800 20 remove_watcher() i=4 2024-06-04T16:11:40.406 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:40.404+0000 7f93fe928800 20 remove_watcher() i=5 2024-06-04T16:11:40.407 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:40.405+0000 7f93fe928800 20 remove_watcher() i=6 2024-06-04T16:11:40.408 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:40.406+0000 7f93fe928800 20 remove_watcher() i=7 2024-06-04T16:11:40.418 INFO:tasks.workunit.client.0.smithi144.stderr: 2024-06-04T16:11:40.418 INFO:tasks.workunit.client.0.smithi144.stderr:BUCKET_STATS: 2024-06-04T16:11:40.418 INFO:tasks.workunit.client.0.smithi144.stderr:bucket: abort-at-set-target-layout id: be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.21 num_objects: 20 size_kb: 1 num_shards: 11 2024-06-04T16:11:40.418 INFO:tasks.workunit.client.0.smithi144.stderr: 2024-06-04T16:11:40.420 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:11:40.420 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:11:40.426 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:11:40.426 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:11:40.469 INFO:tasks.workunit.client.0.smithi144.stderr:radosgw-admin bucket reshard --bucket abort-at-set-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-06-04T16:11:40.499 INFO:tasks.workunit.client.0.smithi144.stderr:ignoring --setuser ceph since I am not root 2024-06-04T16:11:40.499 INFO:tasks.workunit.client.0.smithi144.stderr:ignoring --setgroup ceph since I am not root 2024-06-04T16:11:40.538 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:40.537+0000 7fe944a38800 20 rados->read ofs=0 len=0 2024-06-04T16:11:40.540 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:40.538+0000 7fe944a38800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:11:40.540 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:40.538+0000 7fe944a38800 20 realm 2024-06-04T16:11:40.541 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:40.538+0000 7fe944a38800 20 rados->read ofs=0 len=0 2024-06-04T16:11:40.541 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:40.538+0000 7fe944a38800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:11:40.541 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:40.538+0000 7fe944a38800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-06-04T16:11:40.541 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:40.538+0000 7fe944a38800 20 rados->read ofs=0 len=0 2024-06-04T16:11:40.541 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:40.539+0000 7fe944a38800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:11:40.541 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:40.539+0000 7fe944a38800 20 rados->read ofs=0 len=0 2024-06-04T16:11:40.541 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:40.539+0000 7fe944a38800 20 rados_obj.operate() r=0 bl.length=46 2024-06-04T16:11:40.542 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:40.539+0000 7fe944a38800 20 rados->read ofs=0 len=0 2024-06-04T16:11:40.542 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:40.540+0000 7fe944a38800 20 rados_obj.operate() r=0 bl.length=1139 2024-06-04T16:11:40.542 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:40.540+0000 7fe944a38800 20 searching for the correct realm 2024-06-04T16:11:40.543 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:40.542+0000 7fe93bfff640 0 -- 172.21.15.144:0/1365117315 >> [v2:172.21.15.144:6816/2358575268,v1:172.21.15.144:6817/2358575268] conn(0x56361bc4a880 msgr2=0x56361bc4ccb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-06-04T16:11:40.546 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:40.545+0000 7fe93bfff640 0 -- 172.21.15.144:0/1365117315 >> [v2:172.21.15.177:6808/2618477608,v1:172.21.15.177:6809/2618477608] conn(0x7fe92c070d30 msgr2=0x7fe92c079a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-06-04T16:11:40.753 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:40.751+0000 7fe944a38800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-06-04T16:11:40.753 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:40.751+0000 7fe944a38800 20 RGWRados::pool_iterate: got zone_info.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767 2024-06-04T16:11:40.753 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:40.751+0000 7fe944a38800 20 RGWRados::pool_iterate: got default.zone. 2024-06-04T16:11:40.753 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:40.751+0000 7fe944a38800 20 RGWRados::pool_iterate: got zonegroup_info.abb22408-c332-4e28-8f7a-ff254ea2fed2 2024-06-04T16:11:40.753 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:40.751+0000 7fe944a38800 20 RGWRados::pool_iterate: got zone_names.default 2024-06-04T16:11:40.754 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:40.751+0000 7fe944a38800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-06-04T16:11:40.754 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:40.751+0000 7fe944a38800 20 rados->read ofs=0 len=0 2024-06-04T16:11:40.754 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:40.751+0000 7fe944a38800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:11:40.754 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:40.751+0000 7fe944a38800 20 rados->read ofs=0 len=0 2024-06-04T16:11:40.754 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:40.751+0000 7fe944a38800 20 rados_obj.operate() r=0 bl.length=46 2024-06-04T16:11:40.754 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:40.751+0000 7fe944a38800 20 rados->read ofs=0 len=0 2024-06-04T16:11:40.755 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:40.752+0000 7fe944a38800 20 rados_obj.operate() r=0 bl.length=470 2024-06-04T16:11:40.755 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:40.752+0000 7fe944a38800 20 zone default found 2024-06-04T16:11:40.755 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:40.752+0000 7fe944a38800 4 Realm: () 2024-06-04T16:11:40.755 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:40.752+0000 7fe944a38800 4 ZoneGroup: default (abb22408-c332-4e28-8f7a-ff254ea2fed2) 2024-06-04T16:11:40.755 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:40.752+0000 7fe944a38800 4 Zone: default (be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767) 2024-06-04T16:11:40.755 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:40.752+0000 7fe944a38800 10 cannot find current period zonegroup using local zonegroup configuration 2024-06-04T16:11:40.755 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:40.752+0000 7fe944a38800 20 zonegroup default 2024-06-04T16:11:40.756 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:40.752+0000 7fe944a38800 20 rados->read ofs=0 len=0 2024-06-04T16:11:40.756 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:40.752+0000 7fe944a38800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:11:40.756 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:40.752+0000 7fe944a38800 20 rados->read ofs=0 len=0 2024-06-04T16:11:40.756 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:40.752+0000 7fe944a38800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:11:40.756 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:40.752+0000 7fe944a38800 20 rados->read ofs=0 len=0 2024-06-04T16:11:40.756 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:40.753+0000 7fe944a38800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:11:40.756 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:40.753+0000 7fe944a38800 20 started sync module instance, tier type = 2024-06-04T16:11:40.756 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:40.753+0000 7fe944a38800 20 started zone id=be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767 (name=default) with tier type = 2024-06-04T16:11:40.763 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:40.761+0000 7fe944a38800 20 add_watcher() i=0 2024-06-04T16:11:40.763 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:40.761+0000 7fe944a38800 20 add_watcher() i=1 2024-06-04T16:11:40.763 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:40.761+0000 7fe944a38800 20 add_watcher() i=2 2024-06-04T16:11:40.763 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:40.761+0000 7fe944a38800 20 add_watcher() i=3 2024-06-04T16:11:40.763 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:40.761+0000 7fe944a38800 20 add_watcher() i=4 2024-06-04T16:11:40.763 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:40.761+0000 7fe944a38800 20 add_watcher() i=5 2024-06-04T16:11:40.763 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:40.761+0000 7fe944a38800 20 add_watcher() i=6 2024-06-04T16:11:40.764 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:40.762+0000 7fe944a38800 20 add_watcher() i=7 2024-06-04T16:11:40.764 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:40.762+0000 7fe944a38800 2 all 8 watchers are set, enabling cache 2024-06-04T16:11:40.765 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:40.764+0000 7fe7f8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-06-04T16:11:40.766 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:40.764+0000 7fe944a38800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-06-04T16:11:40.767 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:40.764+0000 7fe944a38800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-06-04T16:11:40.767 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:40.764+0000 7fe944a38800 5 note: GC not initialized 2024-06-04T16:11:40.767 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:40.764+0000 7fe7737fe640 20 reqs_thread_entry: start 2024-06-04T16:11:40.767 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:40.764+0000 7fe944a38800 20 init_complete bucket index max shards: 11 2024-06-04T16:11:40.767 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:40.765+0000 7fe944a38800 20 Filter name: none 2024-06-04T16:11:40.767 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:40.765+0000 7fe7717fa640 20 reqs_thread_entry: start 2024-06-04T16:11:40.767 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:40.765+0000 7fe944a38800 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2024-06-04T16:11:40.767 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:40.765+0000 7fe944a38800 20 rados->read ofs=0 len=0 2024-06-04T16:11:40.768 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:40.765+0000 7fe944a38800 20 rados_obj.operate() r=0 bl.length=194 2024-06-04T16:11:40.768 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:40.765+0000 7fe944a38800 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2024-06-04T16:11:40.768 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:40.765+0000 7fe944a38800 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2024-06-04T16:11:40.768 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:40.765+0000 7fe944a38800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.21 : miss 2024-06-04T16:11:40.768 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:40.765+0000 7fe944a38800 20 rados->read ofs=0 len=0 2024-06-04T16:11:40.768 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:40.765+0000 7fe944a38800 20 rados_obj.operate() r=0 bl.length=408 2024-06-04T16:11:40.768 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:40.765+0000 7fe944a38800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.21 info.flags=0x17 2024-06-04T16:11:40.768 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:40.765+0000 7fe944a38800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.21 to cache LRU end 2024-06-04T16:11:40.769 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:40.765+0000 7fe944a38800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-06-04T16:11:40.769 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:40.765+0000 7fe944a38800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-06-04T16:11:40.769 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:40.765+0000 7fe944a38800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.21 2024-06-04T16:11:40.769 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:40.767+0000 7fe944a38800 0 INFO: RGWReshardLock::lock found lock on abort-at-set-target-layout:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.21 to be held by another RGW process; skipping for now 2024-06-04T16:11:40.769 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:40.767+0000 7fe7f8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-06-04T16:11:40.771 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:40.769+0000 7fe944a38800 20 remove_watcher() i=0 2024-06-04T16:11:40.771 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:40.769+0000 7fe944a38800 2 removed watcher, disabling cache 2024-06-04T16:11:40.772 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:40.770+0000 7fe944a38800 20 remove_watcher() i=1 2024-06-04T16:11:40.773 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:40.771+0000 7fe944a38800 20 remove_watcher() i=2 2024-06-04T16:11:40.774 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:40.772+0000 7fe944a38800 20 remove_watcher() i=3 2024-06-04T16:11:40.775 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:40.773+0000 7fe944a38800 20 remove_watcher() i=4 2024-06-04T16:11:40.776 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:40.774+0000 7fe944a38800 20 remove_watcher() i=5 2024-06-04T16:11:40.777 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:40.775+0000 7fe944a38800 20 remove_watcher() i=6 2024-06-04T16:11:40.778 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:11:40.776+0000 7fe944a38800 20 remove_watcher() i=7 2024-06-04T16:11:40.788 INFO:tasks.workunit.client.0.smithi144.stderr:waiting 30 seconds for reshard lock to expire... 2024-06-04T16:12:10.800 INFO:tasks.workunit.client.0.smithi144.stderr:radosgw-admin bucket reshard --bucket abort-at-set-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-06-04T16:12:10.836 INFO:tasks.workunit.client.0.smithi144.stderr:ignoring --setuser ceph since I am not root 2024-06-04T16:12:10.837 INFO:tasks.workunit.client.0.smithi144.stderr:ignoring --setgroup ceph since I am not root 2024-06-04T16:12:10.878 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:10.877+0000 7f20fe522800 20 rados->read ofs=0 len=0 2024-06-04T16:12:10.880 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:10.879+0000 7f20fe522800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:12:10.880 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:10.879+0000 7f20fe522800 20 realm 2024-06-04T16:12:10.880 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:10.879+0000 7f20fe522800 20 rados->read ofs=0 len=0 2024-06-04T16:12:10.880 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:10.879+0000 7f20fe522800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:12:10.880 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:10.879+0000 7f20fe522800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-06-04T16:12:10.880 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:10.879+0000 7f20fe522800 20 rados->read ofs=0 len=0 2024-06-04T16:12:10.880 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:10.879+0000 7f20fe522800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:12:10.880 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:10.879+0000 7f20fe522800 20 rados->read ofs=0 len=0 2024-06-04T16:12:10.881 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:10.880+0000 7f20fe522800 20 rados_obj.operate() r=0 bl.length=46 2024-06-04T16:12:10.881 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:10.880+0000 7f20fe522800 20 rados->read ofs=0 len=0 2024-06-04T16:12:10.881 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:10.880+0000 7f20fe522800 20 rados_obj.operate() r=0 bl.length=1139 2024-06-04T16:12:10.881 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:10.881+0000 7f20fe522800 20 searching for the correct realm 2024-06-04T16:12:10.883 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:10.883+0000 7f20fa997640 0 -- 172.21.15.144:0/1003338391 >> [v2:172.21.15.144:6800/1453747520,v1:172.21.15.144:6801/1453747520] conn(0x7f20f00c1000 msgr2=0x7f20f00a6210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-06-04T16:12:11.090 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:11.089+0000 7f20fa997640 0 -- 172.21.15.144:0/1003338391 >> [v2:172.21.15.144:6824/166159729,v1:172.21.15.144:6825/166159729] conn(0x561deb5da020 msgr2=0x561deb5dc430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-06-04T16:12:11.096 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:11.095+0000 7f20fe522800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-06-04T16:12:11.096 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:11.095+0000 7f20fe522800 20 RGWRados::pool_iterate: got zone_info.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767 2024-06-04T16:12:11.096 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:11.095+0000 7f20fe522800 20 RGWRados::pool_iterate: got default.zone. 2024-06-04T16:12:11.096 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:11.095+0000 7f20fe522800 20 RGWRados::pool_iterate: got zonegroup_info.abb22408-c332-4e28-8f7a-ff254ea2fed2 2024-06-04T16:12:11.096 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:11.095+0000 7f20fe522800 20 RGWRados::pool_iterate: got zone_names.default 2024-06-04T16:12:11.097 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:11.095+0000 7f20fe522800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-06-04T16:12:11.097 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:11.095+0000 7f20fe522800 20 rados->read ofs=0 len=0 2024-06-04T16:12:11.097 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:11.095+0000 7f20fe522800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:12:11.097 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:11.096+0000 7f20fe522800 20 rados->read ofs=0 len=0 2024-06-04T16:12:11.098 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:11.096+0000 7f20fe522800 20 rados_obj.operate() r=0 bl.length=46 2024-06-04T16:12:11.098 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:11.096+0000 7f20fe522800 20 rados->read ofs=0 len=0 2024-06-04T16:12:11.098 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:11.096+0000 7f20fe522800 20 rados_obj.operate() r=0 bl.length=470 2024-06-04T16:12:11.098 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:11.096+0000 7f20fe522800 20 zone default found 2024-06-04T16:12:11.098 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:11.096+0000 7f20fe522800 4 Realm: () 2024-06-04T16:12:11.098 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:11.096+0000 7f20fe522800 4 ZoneGroup: default (abb22408-c332-4e28-8f7a-ff254ea2fed2) 2024-06-04T16:12:11.098 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:11.096+0000 7f20fe522800 4 Zone: default (be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767) 2024-06-04T16:12:11.098 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:11.096+0000 7f20fe522800 10 cannot find current period zonegroup using local zonegroup configuration 2024-06-04T16:12:11.098 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:11.096+0000 7f20fe522800 20 zonegroup default 2024-06-04T16:12:11.099 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:11.096+0000 7f20fe522800 20 rados->read ofs=0 len=0 2024-06-04T16:12:11.099 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:11.097+0000 7f20fe522800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:12:11.099 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:11.097+0000 7f20fe522800 20 rados->read ofs=0 len=0 2024-06-04T16:12:11.099 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:11.097+0000 7f20fe522800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:12:11.099 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:11.097+0000 7f20fe522800 20 rados->read ofs=0 len=0 2024-06-04T16:12:11.099 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:11.097+0000 7f20fe522800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:12:11.099 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:11.097+0000 7f20fe522800 20 started sync module instance, tier type = 2024-06-04T16:12:11.099 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:11.097+0000 7f20fe522800 20 started zone id=be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767 (name=default) with tier type = 2024-06-04T16:12:11.108 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:11.107+0000 7f20fe522800 20 add_watcher() i=0 2024-06-04T16:12:11.108 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:11.107+0000 7f20fe522800 20 add_watcher() i=1 2024-06-04T16:12:11.108 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:11.107+0000 7f20fe522800 20 add_watcher() i=2 2024-06-04T16:12:11.108 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:11.107+0000 7f20fe522800 20 add_watcher() i=3 2024-06-04T16:12:11.108 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:11.107+0000 7f20fe522800 20 add_watcher() i=4 2024-06-04T16:12:11.108 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:11.107+0000 7f20fe522800 20 add_watcher() i=5 2024-06-04T16:12:11.108 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:11.107+0000 7f20fe522800 20 add_watcher() i=6 2024-06-04T16:12:11.109 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:11.108+0000 7f20fe522800 20 add_watcher() i=7 2024-06-04T16:12:11.109 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:11.108+0000 7f20fe522800 2 all 8 watchers are set, enabling cache 2024-06-04T16:12:11.111 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:11.110+0000 7f1fb0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-06-04T16:12:11.111 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:11.110+0000 7f20fe522800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-06-04T16:12:11.111 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:11.110+0000 7f20fe522800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-06-04T16:12:11.111 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:11.111+0000 7f20fe522800 5 note: GC not initialized 2024-06-04T16:12:11.112 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:11.111+0000 7f1f2b7fe640 20 reqs_thread_entry: start 2024-06-04T16:12:11.112 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:11.111+0000 7f20fe522800 20 init_complete bucket index max shards: 11 2024-06-04T16:12:11.112 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:11.111+0000 7f20fe522800 20 Filter name: none 2024-06-04T16:12:11.113 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:11.111+0000 7f1f297fa640 20 reqs_thread_entry: start 2024-06-04T16:12:11.113 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:11.111+0000 7f20fe522800 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2024-06-04T16:12:11.113 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:11.111+0000 7f20fe522800 20 rados->read ofs=0 len=0 2024-06-04T16:12:11.113 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:11.112+0000 7f20fe522800 20 rados_obj.operate() r=0 bl.length=194 2024-06-04T16:12:11.113 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:11.112+0000 7f20fe522800 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2024-06-04T16:12:11.113 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:11.112+0000 7f20fe522800 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2024-06-04T16:12:11.113 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:11.112+0000 7f20fe522800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.21 : miss 2024-06-04T16:12:11.113 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:11.112+0000 7f20fe522800 20 rados->read ofs=0 len=0 2024-06-04T16:12:11.114 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:11.112+0000 7f20fe522800 20 rados_obj.operate() r=0 bl.length=408 2024-06-04T16:12:11.114 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:11.112+0000 7f20fe522800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.21 info.flags=0x17 2024-06-04T16:12:11.114 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:11.112+0000 7f20fe522800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.21 to cache LRU end 2024-06-04T16:12:11.114 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:11.112+0000 7f20fe522800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-06-04T16:12:11.114 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:11.112+0000 7f20fe522800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-06-04T16:12:11.114 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:11.112+0000 7f20fe522800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.21 2024-06-04T16:12:11.118 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:11.117+0000 7f20fe522800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.21 info.flags=0x17 2024-06-04T16:12:11.118 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:11.117+0000 7f20fe522800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.21 to cache LRU end 2024-06-04T16:12:11.118 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:11.117+0000 7f20fe522800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-06-04T16:12:11.118 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:11.117+0000 7f20fe522800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-set-target-layout:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.21, ofs0, ns] 2024-06-04T16:12:11.119 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:11.117+0000 7f1fdd7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1078036791399 cookie 94686502855248 notifier 6342 bl.length()=917 2024-06-04T16:12:11.119 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:11.117+0000 7f1fdd7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.21 info.flags=0x17 2024-06-04T16:12:11.119 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:11.117+0000 7f1fdd7fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.21 to cache LRU end 2024-06-04T16:12:11.119 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:11.117+0000 7f1fdd7fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-06-04T16:12:11.119 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:11.118+0000 7f20fe522800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.21]): orig_sources= new_sources= 2024-06-04T16:12:11.119 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:11.118+0000 7f20fe522800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.21]): potential sources added=[] removed=[] 2024-06-04T16:12:11.119 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:11.118+0000 7f20fe522800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.21]): orig_dests= new_dests= 2024-06-04T16:12:11.119 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:11.118+0000 7f20fe522800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.21]): potential dests added=[] removed=[] 2024-06-04T16:12:11.122 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:11.120+0000 7f20fe522800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.21.1.0 2024-06-04T16:12:11.122 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:11.120+0000 7f20fe522800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.21.1.0 2024-06-04T16:12:11.122 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:11.120+0000 7f20fe522800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.21.1.1 2024-06-04T16:12:11.122 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:11.120+0000 7f20fe522800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.21.1.1 2024-06-04T16:12:11.122 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:11.120+0000 7f20fe522800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.21.1.2 2024-06-04T16:12:11.122 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:11.120+0000 7f20fe522800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.21.1.2 2024-06-04T16:12:11.122 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:11.120+0000 7f20fe522800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.21.1.3 2024-06-04T16:12:11.122 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:11.120+0000 7f20fe522800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.21.1.3 2024-06-04T16:12:11.122 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:11.120+0000 7f20fe522800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.21.1.4 2024-06-04T16:12:11.122 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:11.120+0000 7f20fe522800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.21.1.4 2024-06-04T16:12:11.122 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:11.120+0000 7f20fe522800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.21.1.5 2024-06-04T16:12:11.123 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:11.120+0000 7f20fe522800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.21.1.5 2024-06-04T16:12:11.123 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:11.120+0000 7f20fe522800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.21.1.6 2024-06-04T16:12:11.123 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:11.120+0000 7f20fe522800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.21.1.6 2024-06-04T16:12:11.123 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:11.120+0000 7f20fe522800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.21.1.7 2024-06-04T16:12:11.123 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:11.120+0000 7f20fe522800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.21.1.7 2024-06-04T16:12:11.123 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:11.120+0000 7f20fe522800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.21.1.8 2024-06-04T16:12:11.123 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:11.120+0000 7f20fe522800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.21.1.8 2024-06-04T16:12:11.123 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:11.120+0000 7f20fe522800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.21.1.9 2024-06-04T16:12:11.123 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:11.120+0000 7f20fe522800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.21.1.9 2024-06-04T16:12:11.123 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:11.120+0000 7f20fe522800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.21.1.10 2024-06-04T16:12:11.123 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:11.120+0000 7f20fe522800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.21.1.10 2024-06-04T16:12:11.123 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:11.120+0000 7f20fe522800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.21.1.11 2024-06-04T16:12:11.123 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:11.120+0000 7f20fe522800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.21.1.11 2024-06-04T16:12:11.123 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:11.120+0000 7f20fe522800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.21.0 2024-06-04T16:12:11.123 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:11.121+0000 7f20fe522800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.21.1 2024-06-04T16:12:11.124 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:11.121+0000 7f20fe522800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.21.2 2024-06-04T16:12:11.124 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:11.122+0000 7f20fe522800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.21.3 2024-06-04T16:12:11.124 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:11.122+0000 7f20fe522800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.21.4 2024-06-04T16:12:11.124 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:11.123+0000 7f20fe522800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.21.5 2024-06-04T16:12:11.124 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:11.123+0000 7f20fe522800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.21.6 2024-06-04T16:12:11.125 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:11.124+0000 7f20fe522800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.21.7 2024-06-04T16:12:11.125 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:11.124+0000 7f20fe522800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.21.8 2024-06-04T16:12:11.126 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:11.125+0000 7f20fe522800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.21.9 2024-06-04T16:12:11.126 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:11.126+0000 7f20fe522800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.21.10 2024-06-04T16:12:11.129 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:11.129+0000 7f20fe522800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.21 : hit (requested=0x17, cached=0x17) 2024-06-04T16:12:11.130 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:11.129+0000 7f20fe522800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.21 2024-06-04T16:12:11.131 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:11.130+0000 7f20fe522800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.21 info.flags=0x17 2024-06-04T16:12:11.131 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:11.130+0000 7f20fe522800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.21 to cache LRU end 2024-06-04T16:12:11.131 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:11.130+0000 7f20fe522800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-06-04T16:12:11.131 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:11.130+0000 7f20fe522800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-set-target-layout:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.21, ofs0, ns] 2024-06-04T16:12:11.131 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:11.130+0000 7f1fdd7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1078036791400 cookie 94686502855248 notifier 6342 bl.length()=885 2024-06-04T16:12:11.131 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:11.130+0000 7f1fdd7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.21 info.flags=0x17 2024-06-04T16:12:11.132 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:11.130+0000 7f1fdd7fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.21 to cache LRU end 2024-06-04T16:12:11.132 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:11.130+0000 7f1fdd7fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-06-04T16:12:11.132 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:11.131+0000 7f20fe522800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.21]): orig_sources= new_sources= 2024-06-04T16:12:11.132 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:11.131+0000 7f20fe522800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.21]): potential sources added=[] removed=[] 2024-06-04T16:12:11.132 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:11.131+0000 7f20fe522800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.21]): orig_dests= new_dests= 2024-06-04T16:12:11.132 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:11.131+0000 7f20fe522800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.21]): potential dests added=[] removed=[] 2024-06-04T16:12:11.134 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:11.133+0000 7f20fe522800 1 execute INFO: reshard of bucket "abort-at-set-target-layout" completed successfully 2024-06-04T16:12:11.136 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:11.135+0000 7f1fb0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-06-04T16:12:11.138 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:11.138+0000 7f20fe522800 20 remove_watcher() i=0 2024-06-04T16:12:11.138 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:11.138+0000 7f20fe522800 2 removed watcher, disabling cache 2024-06-04T16:12:11.139 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:11.139+0000 7f20fe522800 20 remove_watcher() i=1 2024-06-04T16:12:11.140 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:11.140+0000 7f20fe522800 20 remove_watcher() i=2 2024-06-04T16:12:11.141 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:11.141+0000 7f20fe522800 20 remove_watcher() i=3 2024-06-04T16:12:11.143 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:11.142+0000 7f20fe522800 20 remove_watcher() i=4 2024-06-04T16:12:11.144 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:11.143+0000 7f20fe522800 20 remove_watcher() i=5 2024-06-04T16:12:11.145 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:11.144+0000 7f20fe522800 20 remove_watcher() i=6 2024-06-04T16:12:11.146 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:11.146+0000 7f20fe522800 20 remove_watcher() i=7 2024-06-04T16:12:11.159 INFO:tasks.workunit.client.0.smithi144.stderr:radosgw-admin bucket stats --bucket abort-at-set-target-layout 2024-06-04T16:12:11.188 INFO:tasks.workunit.client.0.smithi144.stderr:ignoring --setuser ceph since I am not root 2024-06-04T16:12:11.188 INFO:tasks.workunit.client.0.smithi144.stderr:ignoring --setgroup ceph since I am not root 2024-06-04T16:12:11.225 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:11.224+0000 7fdbc091f800 20 rados->read ofs=0 len=0 2024-06-04T16:12:11.227 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:11.226+0000 7fdbc091f800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:12:11.227 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:11.226+0000 7fdbc091f800 20 realm 2024-06-04T16:12:11.227 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:11.226+0000 7fdbc091f800 20 rados->read ofs=0 len=0 2024-06-04T16:12:11.227 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:11.226+0000 7fdbc091f800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:12:11.227 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:11.226+0000 7fdbc091f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-06-04T16:12:11.227 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:11.226+0000 7fdbc091f800 20 rados->read ofs=0 len=0 2024-06-04T16:12:11.227 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:11.226+0000 7fdbc091f800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:12:11.227 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:11.226+0000 7fdbc091f800 20 rados->read ofs=0 len=0 2024-06-04T16:12:11.228 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:11.227+0000 7fdbc091f800 20 rados_obj.operate() r=0 bl.length=46 2024-06-04T16:12:11.228 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:11.227+0000 7fdbc091f800 20 rados->read ofs=0 len=0 2024-06-04T16:12:11.228 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:11.227+0000 7fdbc091f800 20 rados_obj.operate() r=0 bl.length=1139 2024-06-04T16:12:11.228 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:11.227+0000 7fdbc091f800 20 searching for the correct realm 2024-06-04T16:12:11.230 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:11.230+0000 7fdbbcdba640 0 -- 172.21.15.144:0/3815028255 >> [v2:172.21.15.144:6800/1453747520,v1:172.21.15.144:6801/1453747520] conn(0x7fdba40ce070 msgr2=0x7fdba40c2db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-06-04T16:12:11.436 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:11.436+0000 7fdbbcdba640 0 -- 172.21.15.144:0/3815028255 >> [v2:172.21.15.144:6824/166159729,v1:172.21.15.144:6825/166159729] conn(0x7fda84085090 msgr2=0x7fda840874c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-06-04T16:12:11.644 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:11.643+0000 7fdbc091f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-06-04T16:12:11.644 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:11.643+0000 7fdbc091f800 20 RGWRados::pool_iterate: got zone_info.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767 2024-06-04T16:12:11.644 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:11.643+0000 7fdbc091f800 20 RGWRados::pool_iterate: got default.zone. 2024-06-04T16:12:11.644 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:11.643+0000 7fdbc091f800 20 RGWRados::pool_iterate: got zonegroup_info.abb22408-c332-4e28-8f7a-ff254ea2fed2 2024-06-04T16:12:11.644 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:11.643+0000 7fdbc091f800 20 RGWRados::pool_iterate: got zone_names.default 2024-06-04T16:12:11.644 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:11.643+0000 7fdbc091f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-06-04T16:12:11.644 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:11.643+0000 7fdbc091f800 20 rados->read ofs=0 len=0 2024-06-04T16:12:11.644 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:11.643+0000 7fdbc091f800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:12:11.644 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:11.643+0000 7fdbc091f800 20 rados->read ofs=0 len=0 2024-06-04T16:12:11.646 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:11.643+0000 7fdbc091f800 20 rados_obj.operate() r=0 bl.length=46 2024-06-04T16:12:11.646 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:11.643+0000 7fdbc091f800 20 rados->read ofs=0 len=0 2024-06-04T16:12:11.646 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:11.644+0000 7fdbc091f800 20 rados_obj.operate() r=0 bl.length=470 2024-06-04T16:12:11.646 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:11.644+0000 7fdbc091f800 20 zone default found 2024-06-04T16:12:11.646 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:11.644+0000 7fdbc091f800 4 Realm: () 2024-06-04T16:12:11.646 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:11.644+0000 7fdbc091f800 4 ZoneGroup: default (abb22408-c332-4e28-8f7a-ff254ea2fed2) 2024-06-04T16:12:11.646 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:11.644+0000 7fdbc091f800 4 Zone: default (be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767) 2024-06-04T16:12:11.646 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:11.644+0000 7fdbc091f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-06-04T16:12:11.646 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:11.644+0000 7fdbc091f800 20 zonegroup default 2024-06-04T16:12:11.646 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:11.644+0000 7fdbc091f800 20 rados->read ofs=0 len=0 2024-06-04T16:12:11.646 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:11.644+0000 7fdbc091f800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:12:11.647 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:11.644+0000 7fdbc091f800 20 rados->read ofs=0 len=0 2024-06-04T16:12:11.647 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:11.644+0000 7fdbc091f800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:12:11.647 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:11.645+0000 7fdbc091f800 20 rados->read ofs=0 len=0 2024-06-04T16:12:11.647 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:11.645+0000 7fdbc091f800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:12:11.647 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:11.645+0000 7fdbc091f800 20 started sync module instance, tier type = 2024-06-04T16:12:11.647 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:11.645+0000 7fdbc091f800 20 started zone id=be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767 (name=default) with tier type = 2024-06-04T16:12:11.655 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:11.654+0000 7fdbc091f800 20 add_watcher() i=0 2024-06-04T16:12:11.655 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:11.654+0000 7fdbc091f800 20 add_watcher() i=1 2024-06-04T16:12:11.655 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:11.654+0000 7fdbc091f800 20 add_watcher() i=2 2024-06-04T16:12:11.655 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:11.654+0000 7fdbc091f800 20 add_watcher() i=3 2024-06-04T16:12:11.655 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:11.654+0000 7fdbc091f800 20 add_watcher() i=4 2024-06-04T16:12:11.656 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:11.654+0000 7fdbc091f800 20 add_watcher() i=5 2024-06-04T16:12:11.656 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:11.654+0000 7fdbc091f800 20 add_watcher() i=6 2024-06-04T16:12:11.656 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:11.656+0000 7fdbc091f800 20 add_watcher() i=7 2024-06-04T16:12:11.656 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:11.656+0000 7fdbc091f800 2 all 8 watchers are set, enabling cache 2024-06-04T16:12:11.658 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:11.658+0000 7fda72fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-06-04T16:12:11.659 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:11.658+0000 7fdbc091f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-06-04T16:12:11.659 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:11.658+0000 7fdbc091f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-06-04T16:12:11.659 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:11.658+0000 7fdbc091f800 5 note: GC not initialized 2024-06-04T16:12:11.659 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:11.658+0000 7fda71fdb640 20 reqs_thread_entry: start 2024-06-04T16:12:11.659 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:11.658+0000 7fdbc091f800 20 init_complete bucket index max shards: 11 2024-06-04T16:12:11.659 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:11.658+0000 7fdbc091f800 20 Filter name: none 2024-06-04T16:12:11.660 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:11.658+0000 7fd9e37fe640 20 reqs_thread_entry: start 2024-06-04T16:12:11.660 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:11.658+0000 7fdbc091f800 20 rados->read ofs=0 len=0 2024-06-04T16:12:11.661 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:11.659+0000 7fdbc091f800 20 rados_obj.operate() r=0 bl.length=194 2024-06-04T16:12:11.661 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:11.659+0000 7fdbc091f800 20 rados->read ofs=0 len=0 2024-06-04T16:12:11.661 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:11.659+0000 7fdbc091f800 20 rados_obj.operate() r=0 bl.length=408 2024-06-04T16:12:11.661 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:11.659+0000 7fdbc091f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-06-04T16:12:11.661 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:11.659+0000 7fdbc091f800 20 rados->read ofs=0 len=0 2024-06-04T16:12:11.661 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:11.660+0000 7fdbc091f800 20 rados_obj.operate() r=0 bl.length=194 2024-06-04T16:12:11.661 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:11.660+0000 7fdbc091f800 20 rados->read ofs=0 len=0 2024-06-04T16:12:11.661 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:11.660+0000 7fdbc091f800 20 rados_obj.operate() r=0 bl.length=408 2024-06-04T16:12:11.661 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:11.660+0000 7fdbc091f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-06-04T16:12:11.663 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:11.662+0000 7fda72fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-06-04T16:12:11.665 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:11.664+0000 7fdbc091f800 20 remove_watcher() i=0 2024-06-04T16:12:11.665 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:11.664+0000 7fdbc091f800 2 removed watcher, disabling cache 2024-06-04T16:12:11.666 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:11.665+0000 7fdbc091f800 20 remove_watcher() i=1 2024-06-04T16:12:11.667 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:11.666+0000 7fdbc091f800 20 remove_watcher() i=2 2024-06-04T16:12:11.668 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:11.667+0000 7fdbc091f800 20 remove_watcher() i=3 2024-06-04T16:12:11.670 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:11.668+0000 7fdbc091f800 20 remove_watcher() i=4 2024-06-04T16:12:11.670 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:11.669+0000 7fdbc091f800 20 remove_watcher() i=5 2024-06-04T16:12:11.671 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:11.671+0000 7fdbc091f800 20 remove_watcher() i=6 2024-06-04T16:12:11.673 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:11.672+0000 7fdbc091f800 20 remove_watcher() i=7 2024-06-04T16:12:11.683 INFO:tasks.workunit.client.0.smithi144.stderr: 2024-06-04T16:12:11.683 INFO:tasks.workunit.client.0.smithi144.stderr:BUCKET_STATS: 2024-06-04T16:12:11.683 INFO:tasks.workunit.client.0.smithi144.stderr:bucket: abort-at-set-target-layout id: be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.21 num_objects: 19 size_kb: 1 num_shards: 12 2024-06-04T16:12:11.683 INFO:tasks.workunit.client.0.smithi144.stderr: 2024-06-04T16:12:11.685 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:12:11.685 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:12:11.688 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:12:11.688 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:12:11.731 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:12:11.732 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:12:11.760 INFO:tasks.workunit.client.0.smithi144.stderr:TEST: reshard bucket with EIO injected at block_writes 2024-06-04T16:12:11.761 INFO:tasks.workunit.client.0.smithi144.stderr: 2024-06-04T16:12:11.762 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:12:11.762 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:12:11.775 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:12:11.775 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:12:11.817 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:12:11.817 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:12:11.824 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:12:11.824 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:12:11.830 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:12:11.830 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:12:11.837 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:12:11.837 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:12:11.843 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:12:11.843 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:12:11.850 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:12:11.850 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:12:11.856 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:12:11.857 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:12:11.862 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:12:11.863 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:12:11.869 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:12:11.869 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:12:11.876 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:12:11.876 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:12:11.883 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:12:11.884 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:12:11.889 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:12:11.889 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:12:11.895 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:12:11.895 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:12:11.902 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:12:11.902 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:12:11.908 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:12:11.908 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:12:11.914 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:12:11.914 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:12:11.920 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:12:11.920 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:12:11.926 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:12:11.926 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:12:11.932 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:12:11.932 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:12:11.939 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:12:11.939 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:12:11.945 INFO:tasks.workunit.client.0.smithi144.stderr:radosgw-admin bucket stats --bucket error-at-block-writes 2024-06-04T16:12:11.973 INFO:tasks.workunit.client.0.smithi144.stderr:ignoring --setuser ceph since I am not root 2024-06-04T16:12:11.973 INFO:tasks.workunit.client.0.smithi144.stderr:ignoring --setgroup ceph since I am not root 2024-06-04T16:12:12.009 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:12.008+0000 7fbfa0b22800 20 rados->read ofs=0 len=0 2024-06-04T16:12:12.011 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:12.010+0000 7fbfa0b22800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:12:12.011 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:12.010+0000 7fbfa0b22800 20 realm 2024-06-04T16:12:12.011 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:12.010+0000 7fbfa0b22800 20 rados->read ofs=0 len=0 2024-06-04T16:12:12.011 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:12.010+0000 7fbfa0b22800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:12:12.011 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:12.010+0000 7fbfa0b22800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-06-04T16:12:12.011 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:12.010+0000 7fbfa0b22800 20 rados->read ofs=0 len=0 2024-06-04T16:12:12.011 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:12.010+0000 7fbfa0b22800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:12:12.011 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:12.010+0000 7fbfa0b22800 20 rados->read ofs=0 len=0 2024-06-04T16:12:12.012 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:12.011+0000 7fbfa0b22800 20 rados_obj.operate() r=0 bl.length=46 2024-06-04T16:12:12.012 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:12.011+0000 7fbfa0b22800 20 rados->read ofs=0 len=0 2024-06-04T16:12:12.012 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:12.011+0000 7fbfa0b22800 20 rados_obj.operate() r=0 bl.length=1139 2024-06-04T16:12:12.012 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:12.011+0000 7fbfa0b22800 20 searching for the correct realm 2024-06-04T16:12:12.014 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:12.014+0000 7fbf9cf97640 0 -- 172.21.15.144:0/3577713418 >> [v2:172.21.15.144:6800/1453747520,v1:172.21.15.144:6801/1453747520] conn(0x7fbf90038070 msgr2=0x7fbf90072a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-06-04T16:12:12.220 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:12.219+0000 7fbf9cf97640 0 -- 172.21.15.144:0/3577713418 >> [v2:172.21.15.144:6824/166159729,v1:172.21.15.144:6825/166159729] conn(0x562fc6af7690 msgr2=0x562fc6af9a80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-06-04T16:12:12.225 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:12.224+0000 7fbfa0b22800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-06-04T16:12:12.225 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:12.224+0000 7fbfa0b22800 20 RGWRados::pool_iterate: got zone_info.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767 2024-06-04T16:12:12.225 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:12.224+0000 7fbfa0b22800 20 RGWRados::pool_iterate: got default.zone. 2024-06-04T16:12:12.225 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:12.224+0000 7fbfa0b22800 20 RGWRados::pool_iterate: got zonegroup_info.abb22408-c332-4e28-8f7a-ff254ea2fed2 2024-06-04T16:12:12.225 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:12.224+0000 7fbfa0b22800 20 RGWRados::pool_iterate: got zone_names.default 2024-06-04T16:12:12.225 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:12.224+0000 7fbfa0b22800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-06-04T16:12:12.225 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:12.224+0000 7fbfa0b22800 20 rados->read ofs=0 len=0 2024-06-04T16:12:12.225 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:12.224+0000 7fbfa0b22800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:12:12.226 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:12.224+0000 7fbfa0b22800 20 rados->read ofs=0 len=0 2024-06-04T16:12:12.226 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:12.224+0000 7fbfa0b22800 20 rados_obj.operate() r=0 bl.length=46 2024-06-04T16:12:12.226 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:12.224+0000 7fbfa0b22800 20 rados->read ofs=0 len=0 2024-06-04T16:12:12.227 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:12.225+0000 7fbfa0b22800 20 rados_obj.operate() r=0 bl.length=470 2024-06-04T16:12:12.227 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:12.225+0000 7fbfa0b22800 20 zone default found 2024-06-04T16:12:12.227 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:12.225+0000 7fbfa0b22800 4 Realm: () 2024-06-04T16:12:12.227 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:12.225+0000 7fbfa0b22800 4 ZoneGroup: default (abb22408-c332-4e28-8f7a-ff254ea2fed2) 2024-06-04T16:12:12.227 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:12.225+0000 7fbfa0b22800 4 Zone: default (be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767) 2024-06-04T16:12:12.227 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:12.225+0000 7fbfa0b22800 10 cannot find current period zonegroup using local zonegroup configuration 2024-06-04T16:12:12.227 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:12.225+0000 7fbfa0b22800 20 zonegroup default 2024-06-04T16:12:12.227 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:12.225+0000 7fbfa0b22800 20 rados->read ofs=0 len=0 2024-06-04T16:12:12.228 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:12.225+0000 7fbfa0b22800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:12:12.228 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:12.225+0000 7fbfa0b22800 20 rados->read ofs=0 len=0 2024-06-04T16:12:12.228 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:12.225+0000 7fbfa0b22800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:12:12.228 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:12.225+0000 7fbfa0b22800 20 rados->read ofs=0 len=0 2024-06-04T16:12:12.228 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:12.226+0000 7fbfa0b22800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:12:12.228 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:12.226+0000 7fbfa0b22800 20 started sync module instance, tier type = 2024-06-04T16:12:12.228 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:12.226+0000 7fbfa0b22800 20 started zone id=be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767 (name=default) with tier type = 2024-06-04T16:12:12.235 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:12.234+0000 7fbfa0b22800 20 add_watcher() i=0 2024-06-04T16:12:12.235 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:12.234+0000 7fbfa0b22800 20 add_watcher() i=1 2024-06-04T16:12:12.235 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:12.234+0000 7fbfa0b22800 20 add_watcher() i=2 2024-06-04T16:12:12.235 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:12.234+0000 7fbfa0b22800 20 add_watcher() i=3 2024-06-04T16:12:12.236 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:12.234+0000 7fbfa0b22800 20 add_watcher() i=4 2024-06-04T16:12:12.236 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:12.234+0000 7fbfa0b22800 20 add_watcher() i=5 2024-06-04T16:12:12.236 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:12.234+0000 7fbfa0b22800 20 add_watcher() i=6 2024-06-04T16:12:12.236 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:12.235+0000 7fbfa0b22800 20 add_watcher() i=7 2024-06-04T16:12:12.236 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:12.235+0000 7fbfa0b22800 2 all 8 watchers are set, enabling cache 2024-06-04T16:12:12.238 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:12.237+0000 7fbe52fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-06-04T16:12:12.239 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:12.237+0000 7fbfa0b22800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-06-04T16:12:12.239 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:12.237+0000 7fbfa0b22800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-06-04T16:12:12.239 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:12.237+0000 7fbfa0b22800 5 note: GC not initialized 2024-06-04T16:12:12.239 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:12.238+0000 7fbe51fdb640 20 reqs_thread_entry: start 2024-06-04T16:12:12.239 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:12.238+0000 7fbfa0b22800 20 init_complete bucket index max shards: 11 2024-06-04T16:12:12.239 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:12.238+0000 7fbfa0b22800 20 Filter name: none 2024-06-04T16:12:12.239 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:12.238+0000 7fbdc37fe640 20 reqs_thread_entry: start 2024-06-04T16:12:12.239 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:12.238+0000 7fbfa0b22800 20 rados->read ofs=0 len=0 2024-06-04T16:12:12.240 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:12.238+0000 7fbfa0b22800 20 rados_obj.operate() r=0 bl.length=189 2024-06-04T16:12:12.240 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:12.238+0000 7fbfa0b22800 20 rados->read ofs=0 len=0 2024-06-04T16:12:12.240 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:12.239+0000 7fbfa0b22800 20 rados_obj.operate() r=0 bl.length=403 2024-06-04T16:12:12.240 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:12.239+0000 7fbfa0b22800 20 couldn't put binfo cache entry, might have raced with data changes 2024-06-04T16:12:12.240 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:12.239+0000 7fbfa0b22800 20 rados->read ofs=0 len=0 2024-06-04T16:12:12.241 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:12.239+0000 7fbfa0b22800 20 rados_obj.operate() r=0 bl.length=189 2024-06-04T16:12:12.241 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:12.239+0000 7fbfa0b22800 20 rados->read ofs=0 len=0 2024-06-04T16:12:12.241 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:12.240+0000 7fbfa0b22800 20 rados_obj.operate() r=0 bl.length=403 2024-06-04T16:12:12.241 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:12.240+0000 7fbfa0b22800 20 couldn't put binfo cache entry, might have raced with data changes 2024-06-04T16:12:12.242 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:12.242+0000 7fbe52fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-06-04T16:12:12.244 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:12.243+0000 7fbfa0b22800 20 remove_watcher() i=0 2024-06-04T16:12:12.244 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:12.243+0000 7fbfa0b22800 2 removed watcher, disabling cache 2024-06-04T16:12:12.245 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:12.244+0000 7fbfa0b22800 20 remove_watcher() i=1 2024-06-04T16:12:12.246 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:12.245+0000 7fbfa0b22800 20 remove_watcher() i=2 2024-06-04T16:12:12.247 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:12.246+0000 7fbfa0b22800 20 remove_watcher() i=3 2024-06-04T16:12:12.248 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:12.247+0000 7fbfa0b22800 20 remove_watcher() i=4 2024-06-04T16:12:12.249 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:12.248+0000 7fbfa0b22800 20 remove_watcher() i=5 2024-06-04T16:12:12.250 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:12.249+0000 7fbfa0b22800 20 remove_watcher() i=6 2024-06-04T16:12:12.251 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:12.250+0000 7fbfa0b22800 20 remove_watcher() i=7 2024-06-04T16:12:12.262 INFO:tasks.workunit.client.0.smithi144.stderr: 2024-06-04T16:12:12.262 INFO:tasks.workunit.client.0.smithi144.stderr:BUCKET_STATS: 2024-06-04T16:12:12.262 INFO:tasks.workunit.client.0.smithi144.stderr:bucket: error-at-block-writes id: be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.22 num_objects: 20 size_kb: 1 num_shards: 11 2024-06-04T16:12:12.262 INFO:tasks.workunit.client.0.smithi144.stderr: 2024-06-04T16:12:12.264 INFO:tasks.workunit.client.0.smithi144.stderr:radosgw-admin bucket reshard --bucket error-at-block-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at block_writes 2024-06-04T16:12:12.297 INFO:tasks.workunit.client.0.smithi144.stderr:ignoring --setuser ceph since I am not root 2024-06-04T16:12:12.297 INFO:tasks.workunit.client.0.smithi144.stderr:ignoring --setgroup ceph since I am not root 2024-06-04T16:12:12.333 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:12.332+0000 7fd85a32b800 20 rados->read ofs=0 len=0 2024-06-04T16:12:12.334 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:12.333+0000 7fd85a32b800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:12:12.335 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:12.334+0000 7fd85a32b800 20 realm 2024-06-04T16:12:12.335 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:12.334+0000 7fd85a32b800 20 rados->read ofs=0 len=0 2024-06-04T16:12:12.335 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:12.334+0000 7fd85a32b800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:12:12.335 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:12.334+0000 7fd85a32b800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-06-04T16:12:12.335 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:12.334+0000 7fd85a32b800 20 rados->read ofs=0 len=0 2024-06-04T16:12:12.335 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:12.334+0000 7fd85a32b800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:12:12.335 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:12.334+0000 7fd85a32b800 20 rados->read ofs=0 len=0 2024-06-04T16:12:12.335 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:12.335+0000 7fd85a32b800 20 rados_obj.operate() r=0 bl.length=46 2024-06-04T16:12:12.336 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:12.335+0000 7fd85a32b800 20 rados->read ofs=0 len=0 2024-06-04T16:12:12.336 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:12.335+0000 7fd85a32b800 20 rados_obj.operate() r=0 bl.length=1139 2024-06-04T16:12:12.336 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:12.335+0000 7fd85a32b800 20 searching for the correct realm 2024-06-04T16:12:12.339 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:12.338+0000 7fd855f48640 0 -- 172.21.15.144:0/2031598348 >> [v2:172.21.15.177:6816/2039473917,v1:172.21.15.177:6817/2039473917] conn(0x55f04556d4b0 msgr2=0x55f04556f970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-06-04T16:12:12.343 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:12.342+0000 7fd855f48640 0 -- 172.21.15.144:0/2031598348 >> [v2:172.21.15.177:6824/800067290,v1:172.21.15.177:6825/800067290] conn(0x55f045560ca0 msgr2=0x55f045563100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-06-04T16:12:12.347 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:12.346+0000 7fd85a32b800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-06-04T16:12:12.347 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:12.346+0000 7fd85a32b800 20 RGWRados::pool_iterate: got zone_info.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767 2024-06-04T16:12:12.347 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:12.346+0000 7fd85a32b800 20 RGWRados::pool_iterate: got default.zone. 2024-06-04T16:12:12.347 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:12.346+0000 7fd85a32b800 20 RGWRados::pool_iterate: got zonegroup_info.abb22408-c332-4e28-8f7a-ff254ea2fed2 2024-06-04T16:12:12.347 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:12.346+0000 7fd85a32b800 20 RGWRados::pool_iterate: got zone_names.default 2024-06-04T16:12:12.347 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:12.346+0000 7fd85a32b800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-06-04T16:12:12.347 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:12.346+0000 7fd85a32b800 20 rados->read ofs=0 len=0 2024-06-04T16:12:12.347 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:12.346+0000 7fd85a32b800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:12:12.347 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:12.346+0000 7fd85a32b800 20 rados->read ofs=0 len=0 2024-06-04T16:12:12.347 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:12.346+0000 7fd85a32b800 20 rados_obj.operate() r=0 bl.length=46 2024-06-04T16:12:12.348 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:12.346+0000 7fd85a32b800 20 rados->read ofs=0 len=0 2024-06-04T16:12:12.349 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:12.347+0000 7fd85a32b800 20 rados_obj.operate() r=0 bl.length=470 2024-06-04T16:12:12.349 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:12.347+0000 7fd85a32b800 20 zone default found 2024-06-04T16:12:12.349 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:12.347+0000 7fd85a32b800 4 Realm: () 2024-06-04T16:12:12.349 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:12.347+0000 7fd85a32b800 4 ZoneGroup: default (abb22408-c332-4e28-8f7a-ff254ea2fed2) 2024-06-04T16:12:12.349 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:12.347+0000 7fd85a32b800 4 Zone: default (be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767) 2024-06-04T16:12:12.349 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:12.347+0000 7fd85a32b800 10 cannot find current period zonegroup using local zonegroup configuration 2024-06-04T16:12:12.349 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:12.347+0000 7fd85a32b800 20 zonegroup default 2024-06-04T16:12:12.349 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:12.347+0000 7fd85a32b800 20 rados->read ofs=0 len=0 2024-06-04T16:12:12.349 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:12.347+0000 7fd85a32b800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:12:12.349 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:12.347+0000 7fd85a32b800 20 rados->read ofs=0 len=0 2024-06-04T16:12:12.349 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:12.347+0000 7fd85a32b800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:12:12.350 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:12.347+0000 7fd85a32b800 20 rados->read ofs=0 len=0 2024-06-04T16:12:12.350 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:12.347+0000 7fd85a32b800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:12:12.350 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:12.347+0000 7fd85a32b800 20 started sync module instance, tier type = 2024-06-04T16:12:12.350 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:12.347+0000 7fd85a32b800 20 started zone id=be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767 (name=default) with tier type = 2024-06-04T16:12:12.357 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:12.356+0000 7fd85a32b800 20 add_watcher() i=0 2024-06-04T16:12:12.357 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:12.356+0000 7fd85a32b800 20 add_watcher() i=1 2024-06-04T16:12:12.357 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:12.356+0000 7fd85a32b800 20 add_watcher() i=2 2024-06-04T16:12:12.357 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:12.356+0000 7fd85a32b800 20 add_watcher() i=3 2024-06-04T16:12:12.357 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:12.356+0000 7fd85a32b800 20 add_watcher() i=4 2024-06-04T16:12:12.357 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:12.356+0000 7fd85a32b800 20 add_watcher() i=5 2024-06-04T16:12:12.357 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:12.356+0000 7fd85a32b800 20 add_watcher() i=6 2024-06-04T16:12:12.357 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:12.357+0000 7fd85a32b800 20 add_watcher() i=7 2024-06-04T16:12:12.358 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:12.357+0000 7fd85a32b800 2 all 8 watchers are set, enabling cache 2024-06-04T16:12:12.359 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:12.358+0000 7fd7077fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-06-04T16:12:12.360 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:12.359+0000 7fd85a32b800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-06-04T16:12:12.360 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:12.359+0000 7fd85a32b800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-06-04T16:12:12.360 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:12.359+0000 7fd85a32b800 5 note: GC not initialized 2024-06-04T16:12:12.360 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:12.359+0000 7fd7067fc640 20 reqs_thread_entry: start 2024-06-04T16:12:12.360 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:12.359+0000 7fd85a32b800 20 init_complete bucket index max shards: 11 2024-06-04T16:12:12.361 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:12.359+0000 7fd85a32b800 20 Filter name: none 2024-06-04T16:12:12.361 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:12.359+0000 7fd677fff640 20 reqs_thread_entry: start 2024-06-04T16:12:12.361 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:12.359+0000 7fd85a32b800 10 cache get: name=default.rgw.meta+root+error-at-block-writes : miss 2024-06-04T16:12:12.361 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:12.359+0000 7fd85a32b800 20 rados->read ofs=0 len=0 2024-06-04T16:12:12.361 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:12.360+0000 7fd85a32b800 20 rados_obj.operate() r=0 bl.length=189 2024-06-04T16:12:12.362 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:12.360+0000 7fd85a32b800 10 cache put: name=default.rgw.meta+root+error-at-block-writes info.flags=0x11 2024-06-04T16:12:12.362 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:12.360+0000 7fd85a32b800 10 adding default.rgw.meta+root+error-at-block-writes to cache LRU end 2024-06-04T16:12:12.362 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:12.360+0000 7fd85a32b800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.22 : miss 2024-06-04T16:12:12.362 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:12.360+0000 7fd85a32b800 20 rados->read ofs=0 len=0 2024-06-04T16:12:12.362 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:12.360+0000 7fd85a32b800 20 rados_obj.operate() r=0 bl.length=403 2024-06-04T16:12:12.362 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:12.360+0000 7fd85a32b800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.22 info.flags=0x17 2024-06-04T16:12:12.362 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:12.360+0000 7fd85a32b800 10 adding default.rgw.meta+root+.bucket.meta.error-at-block-writes:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.22 to cache LRU end 2024-06-04T16:12:12.362 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:12.360+0000 7fd85a32b800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-06-04T16:12:12.362 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:12.360+0000 7fd85a32b800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-06-04T16:12:12.362 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:12.360+0000 7fd85a32b800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.22 2024-06-04T16:12:12.366 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:12.365+0000 7fd85a32b800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.22 info.flags=0x17 2024-06-04T16:12:12.366 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:12.365+0000 7fd85a32b800 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.22 to cache LRU end 2024-06-04T16:12:12.366 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:12.365+0000 7fd85a32b800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-06-04T16:12:12.366 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:12.365+0000 7fd85a32b800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.22, ofs0, ns] 2024-06-04T16:12:12.367 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:12.366+0000 7fd7397fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1078036791321 cookie 94490443835216 notifier 6393 bl.length()=907 2024-06-04T16:12:12.367 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:12.366+0000 7fd7397fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.22 info.flags=0x17 2024-06-04T16:12:12.367 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:12.366+0000 7fd7397fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.22 to cache LRU end 2024-06-04T16:12:12.367 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:12.366+0000 7fd7397fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-06-04T16:12:12.367 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:12.366+0000 7fd85a32b800 20 handle_bi_update(): bucket=:error-at-block-writes[be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.22]): orig_sources= new_sources= 2024-06-04T16:12:12.367 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:12.366+0000 7fd85a32b800 20 handle_bi_update(): bucket=:error-at-block-writes[be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.22]): potential sources added=[] removed=[] 2024-06-04T16:12:12.367 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:12.366+0000 7fd85a32b800 20 handle_bi_update(): bucket=:error-at-block-writes[be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.22]): orig_dests= new_dests= 2024-06-04T16:12:12.367 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:12.366+0000 7fd85a32b800 20 handle_bi_update(): bucket=:error-at-block-writes[be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.22]): potential dests added=[] removed=[] 2024-06-04T16:12:12.367 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:12.366+0000 7fd85a32b800 -1 Injecting error=-5 at location=block_writes 2024-06-04T16:12:12.368 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:12.366+0000 7fd85a32b800 0 ERROR: init_reshard failed to pause writes to the current index: (5) Input/output error 2024-06-04T16:12:12.369 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:12.368+0000 7fd85a32b800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.22 : hit (requested=0x17, cached=0x17) 2024-06-04T16:12:12.369 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:12.368+0000 7fd85a32b800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.22 2024-06-04T16:12:12.370 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:12.369+0000 7fd85a32b800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.22 info.flags=0x17 2024-06-04T16:12:12.370 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:12.369+0000 7fd85a32b800 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.22 to cache LRU end 2024-06-04T16:12:12.370 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:12.369+0000 7fd85a32b800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-06-04T16:12:12.370 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:12.369+0000 7fd85a32b800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.22, ofs0, ns] 2024-06-04T16:12:12.370 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:12.370+0000 7fd7397fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1078036791322 cookie 94490443835216 notifier 6393 bl.length()=875 2024-06-04T16:12:12.371 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:12.370+0000 7fd7397fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.22 info.flags=0x17 2024-06-04T16:12:12.371 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:12.370+0000 7fd7397fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.22 to cache LRU end 2024-06-04T16:12:12.371 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:12.370+0000 7fd7397fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-06-04T16:12:12.371 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:12.370+0000 7fd85a32b800 20 handle_bi_update(): bucket=:error-at-block-writes[be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.22]): orig_sources= new_sources= 2024-06-04T16:12:12.371 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:12.370+0000 7fd85a32b800 20 handle_bi_update(): bucket=:error-at-block-writes[be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.22]): potential sources added=[] removed=[] 2024-06-04T16:12:12.371 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:12.370+0000 7fd85a32b800 20 handle_bi_update(): bucket=:error-at-block-writes[be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.22]): orig_dests= new_dests= 2024-06-04T16:12:12.371 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:12.370+0000 7fd85a32b800 20 handle_bi_update(): bucket=:error-at-block-writes[be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.22]): potential dests added=[] removed=[] 2024-06-04T16:12:12.372 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:12.372+0000 7fd7077fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-06-04T16:12:12.374 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:12.374+0000 7fd85a32b800 20 remove_watcher() i=0 2024-06-04T16:12:12.375 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:12.374+0000 7fd85a32b800 2 removed watcher, disabling cache 2024-06-04T16:12:12.375 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:12.375+0000 7fd85a32b800 20 remove_watcher() i=1 2024-06-04T16:12:12.377 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:12.376+0000 7fd85a32b800 20 remove_watcher() i=2 2024-06-04T16:12:12.378 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:12.377+0000 7fd85a32b800 20 remove_watcher() i=3 2024-06-04T16:12:12.379 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:12.378+0000 7fd85a32b800 20 remove_watcher() i=4 2024-06-04T16:12:12.380 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:12.379+0000 7fd85a32b800 20 remove_watcher() i=5 2024-06-04T16:12:12.381 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:12.380+0000 7fd85a32b800 20 remove_watcher() i=6 2024-06-04T16:12:12.382 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:12.381+0000 7fd85a32b800 20 remove_watcher() i=7 2024-06-04T16:12:12.394 INFO:tasks.workunit.client.0.smithi144.stderr:radosgw-admin bucket stats --bucket error-at-block-writes 2024-06-04T16:12:12.422 INFO:tasks.workunit.client.0.smithi144.stderr:ignoring --setuser ceph since I am not root 2024-06-04T16:12:12.422 INFO:tasks.workunit.client.0.smithi144.stderr:ignoring --setgroup ceph since I am not root 2024-06-04T16:12:12.459 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:12.458+0000 7f4679532800 20 rados->read ofs=0 len=0 2024-06-04T16:12:12.461 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:12.460+0000 7f4679532800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:12:12.461 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:12.460+0000 7f4679532800 20 realm 2024-06-04T16:12:12.461 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:12.460+0000 7f4679532800 20 rados->read ofs=0 len=0 2024-06-04T16:12:12.461 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:12.460+0000 7f4679532800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:12:12.461 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:12.460+0000 7f4679532800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-06-04T16:12:12.461 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:12.460+0000 7f4679532800 20 rados->read ofs=0 len=0 2024-06-04T16:12:12.462 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:12.460+0000 7f4679532800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:12:12.462 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:12.460+0000 7f4679532800 20 rados->read ofs=0 len=0 2024-06-04T16:12:12.462 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:12.461+0000 7f4679532800 20 rados_obj.operate() r=0 bl.length=46 2024-06-04T16:12:12.462 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:12.461+0000 7f4679532800 20 rados->read ofs=0 len=0 2024-06-04T16:12:12.462 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:12.461+0000 7f4679532800 20 rados_obj.operate() r=0 bl.length=1139 2024-06-04T16:12:12.462 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:12.462+0000 7f4679532800 20 searching for the correct realm 2024-06-04T16:12:12.463 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:12.462+0000 7f467522c640 0 -- 172.21.15.144:0/2787945004 >> [v2:172.21.15.177:6816/2039473917,v1:172.21.15.177:6817/2039473917] conn(0x5571793c6d80 msgr2=0x5571793c9240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-06-04T16:12:12.667 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:12.666+0000 7f467522c640 0 -- 172.21.15.144:0/2787945004 >> [v2:172.21.15.177:6800/3891611393,v1:172.21.15.177:6801/3891611393] conn(0x7f4668064930 msgr2=0x7f466807e410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-06-04T16:12:12.674 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:12.673+0000 7f4679532800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-06-04T16:12:12.674 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:12.673+0000 7f4679532800 20 RGWRados::pool_iterate: got zone_info.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767 2024-06-04T16:12:12.675 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:12.673+0000 7f4679532800 20 RGWRados::pool_iterate: got default.zone. 2024-06-04T16:12:12.675 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:12.673+0000 7f4679532800 20 RGWRados::pool_iterate: got zonegroup_info.abb22408-c332-4e28-8f7a-ff254ea2fed2 2024-06-04T16:12:12.675 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:12.673+0000 7f4679532800 20 RGWRados::pool_iterate: got zone_names.default 2024-06-04T16:12:12.675 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:12.673+0000 7f4679532800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-06-04T16:12:12.675 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:12.673+0000 7f4679532800 20 rados->read ofs=0 len=0 2024-06-04T16:12:12.675 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:12.673+0000 7f4679532800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:12:12.675 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:12.673+0000 7f4679532800 20 rados->read ofs=0 len=0 2024-06-04T16:12:12.675 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:12.674+0000 7f4679532800 20 rados_obj.operate() r=0 bl.length=46 2024-06-04T16:12:12.675 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:12.674+0000 7f4679532800 20 rados->read ofs=0 len=0 2024-06-04T16:12:12.676 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:12.674+0000 7f4679532800 20 rados_obj.operate() r=0 bl.length=470 2024-06-04T16:12:12.677 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:12.674+0000 7f4679532800 20 zone default found 2024-06-04T16:12:12.677 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:12.674+0000 7f4679532800 4 Realm: () 2024-06-04T16:12:12.677 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:12.674+0000 7f4679532800 4 ZoneGroup: default (abb22408-c332-4e28-8f7a-ff254ea2fed2) 2024-06-04T16:12:12.677 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:12.674+0000 7f4679532800 4 Zone: default (be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767) 2024-06-04T16:12:12.677 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:12.674+0000 7f4679532800 10 cannot find current period zonegroup using local zonegroup configuration 2024-06-04T16:12:12.677 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:12.674+0000 7f4679532800 20 zonegroup default 2024-06-04T16:12:12.677 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:12.674+0000 7f4679532800 20 rados->read ofs=0 len=0 2024-06-04T16:12:12.677 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:12.674+0000 7f4679532800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:12:12.677 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:12.674+0000 7f4679532800 20 rados->read ofs=0 len=0 2024-06-04T16:12:12.677 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:12.675+0000 7f4679532800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:12:12.677 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:12.675+0000 7f4679532800 20 rados->read ofs=0 len=0 2024-06-04T16:12:12.677 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:12.675+0000 7f4679532800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:12:12.677 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:12.675+0000 7f4679532800 20 started sync module instance, tier type = 2024-06-04T16:12:12.678 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:12.675+0000 7f4679532800 20 started zone id=be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767 (name=default) with tier type = 2024-06-04T16:12:12.684 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:12.683+0000 7f4679532800 20 add_watcher() i=0 2024-06-04T16:12:12.684 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:12.683+0000 7f4679532800 20 add_watcher() i=1 2024-06-04T16:12:12.684 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:12.683+0000 7f4679532800 20 add_watcher() i=2 2024-06-04T16:12:12.684 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:12.683+0000 7f4679532800 20 add_watcher() i=3 2024-06-04T16:12:12.685 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:12.683+0000 7f4679532800 20 add_watcher() i=4 2024-06-04T16:12:12.685 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:12.683+0000 7f4679532800 20 add_watcher() i=5 2024-06-04T16:12:12.685 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:12.683+0000 7f4679532800 20 add_watcher() i=6 2024-06-04T16:12:12.685 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:12.684+0000 7f4679532800 20 add_watcher() i=7 2024-06-04T16:12:12.685 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:12.684+0000 7f4679532800 2 all 8 watchers are set, enabling cache 2024-06-04T16:12:12.689 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:12.686+0000 7f452b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-06-04T16:12:12.689 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:12.686+0000 7f4679532800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-06-04T16:12:12.689 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:12.686+0000 7f4679532800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-06-04T16:12:12.689 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:12.686+0000 7f4679532800 5 note: GC not initialized 2024-06-04T16:12:12.689 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:12.687+0000 7f452a7e4640 20 reqs_thread_entry: start 2024-06-04T16:12:12.690 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:12.687+0000 7f4679532800 20 init_complete bucket index max shards: 11 2024-06-04T16:12:12.690 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:12.687+0000 7f4679532800 20 Filter name: none 2024-06-04T16:12:12.690 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:12.687+0000 7f449bfff640 20 reqs_thread_entry: start 2024-06-04T16:12:12.690 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:12.687+0000 7f4679532800 20 rados->read ofs=0 len=0 2024-06-04T16:12:12.690 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:12.687+0000 7f4679532800 20 rados_obj.operate() r=0 bl.length=189 2024-06-04T16:12:12.690 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:12.687+0000 7f4679532800 20 rados->read ofs=0 len=0 2024-06-04T16:12:12.690 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:12.688+0000 7f4679532800 20 rados_obj.operate() r=0 bl.length=403 2024-06-04T16:12:12.690 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:12.688+0000 7f4679532800 20 couldn't put binfo cache entry, might have raced with data changes 2024-06-04T16:12:12.690 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:12.688+0000 7f4679532800 20 rados->read ofs=0 len=0 2024-06-04T16:12:12.690 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:12.688+0000 7f4679532800 20 rados_obj.operate() r=0 bl.length=189 2024-06-04T16:12:12.690 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:12.688+0000 7f4679532800 20 rados->read ofs=0 len=0 2024-06-04T16:12:12.691 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:12.689+0000 7f4679532800 20 rados_obj.operate() r=0 bl.length=403 2024-06-04T16:12:12.691 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:12.689+0000 7f4679532800 20 couldn't put binfo cache entry, might have raced with data changes 2024-06-04T16:12:12.691 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:12.690+0000 7f452b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-06-04T16:12:12.693 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:12.692+0000 7f4679532800 20 remove_watcher() i=0 2024-06-04T16:12:12.693 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:12.692+0000 7f4679532800 2 removed watcher, disabling cache 2024-06-04T16:12:12.694 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:12.693+0000 7f4679532800 20 remove_watcher() i=1 2024-06-04T16:12:12.695 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:12.694+0000 7f4679532800 20 remove_watcher() i=2 2024-06-04T16:12:12.696 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:12.695+0000 7f4679532800 20 remove_watcher() i=3 2024-06-04T16:12:12.697 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:12.696+0000 7f4679532800 20 remove_watcher() i=4 2024-06-04T16:12:12.697 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:12.697+0000 7f4679532800 20 remove_watcher() i=5 2024-06-04T16:12:12.698 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:12.698+0000 7f4679532800 20 remove_watcher() i=6 2024-06-04T16:12:12.699 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:12.699+0000 7f4679532800 20 remove_watcher() i=7 2024-06-04T16:12:12.710 INFO:tasks.workunit.client.0.smithi144.stderr: 2024-06-04T16:12:12.710 INFO:tasks.workunit.client.0.smithi144.stderr:BUCKET_STATS: 2024-06-04T16:12:12.710 INFO:tasks.workunit.client.0.smithi144.stderr:bucket: error-at-block-writes id: be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.22 num_objects: 20 size_kb: 1 num_shards: 11 2024-06-04T16:12:12.711 INFO:tasks.workunit.client.0.smithi144.stderr: 2024-06-04T16:12:12.712 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:12:12.712 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:12:12.718 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:12:12.718 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:12:12.762 INFO:tasks.workunit.client.0.smithi144.stderr:radosgw-admin bucket reshard --bucket error-at-block-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-06-04T16:12:12.792 INFO:tasks.workunit.client.0.smithi144.stderr:ignoring --setuser ceph since I am not root 2024-06-04T16:12:12.792 INFO:tasks.workunit.client.0.smithi144.stderr:ignoring --setgroup ceph since I am not root 2024-06-04T16:12:12.828 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:12.827+0000 7f5754010800 20 rados->read ofs=0 len=0 2024-06-04T16:12:12.830 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:12.829+0000 7f5754010800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:12:12.830 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:12.829+0000 7f5754010800 20 realm 2024-06-04T16:12:12.830 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:12.829+0000 7f5754010800 20 rados->read ofs=0 len=0 2024-06-04T16:12:12.830 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:12.829+0000 7f5754010800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:12:12.830 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:12.829+0000 7f5754010800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-06-04T16:12:12.830 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:12.829+0000 7f5754010800 20 rados->read ofs=0 len=0 2024-06-04T16:12:12.830 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:12.829+0000 7f5754010800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:12:12.830 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:12.829+0000 7f5754010800 20 rados->read ofs=0 len=0 2024-06-04T16:12:12.831 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:12.830+0000 7f5754010800 20 rados_obj.operate() r=0 bl.length=46 2024-06-04T16:12:12.831 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:12.830+0000 7f5754010800 20 rados->read ofs=0 len=0 2024-06-04T16:12:12.831 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:12.830+0000 7f5754010800 20 rados_obj.operate() r=0 bl.length=1139 2024-06-04T16:12:12.831 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:12.830+0000 7f5754010800 20 searching for the correct realm 2024-06-04T16:12:12.833 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:12.832+0000 7f5747fff640 0 -- 172.21.15.144:0/1647820562 >> [v2:172.21.15.144:6816/2358575268,v1:172.21.15.144:6817/2358575268] conn(0x56170f360500 msgr2=0x56170f362930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-06-04T16:12:12.836 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:12.835+0000 7f5747fff640 0 -- 172.21.15.144:0/1647820562 >> [v2:172.21.15.177:6808/2618477608,v1:172.21.15.177:6809/2618477608] conn(0x7f57380a90d0 msgr2=0x7f573806da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-06-04T16:12:13.042 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.041+0000 7f5754010800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-06-04T16:12:13.043 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.041+0000 7f5754010800 20 RGWRados::pool_iterate: got zone_info.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767 2024-06-04T16:12:13.043 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.041+0000 7f5754010800 20 RGWRados::pool_iterate: got default.zone. 2024-06-04T16:12:13.043 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.041+0000 7f5754010800 20 RGWRados::pool_iterate: got zonegroup_info.abb22408-c332-4e28-8f7a-ff254ea2fed2 2024-06-04T16:12:13.043 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.041+0000 7f5754010800 20 RGWRados::pool_iterate: got zone_names.default 2024-06-04T16:12:13.043 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.041+0000 7f5754010800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-06-04T16:12:13.043 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.041+0000 7f5754010800 20 rados->read ofs=0 len=0 2024-06-04T16:12:13.043 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.041+0000 7f5754010800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:12:13.043 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.041+0000 7f5754010800 20 rados->read ofs=0 len=0 2024-06-04T16:12:13.043 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.042+0000 7f5754010800 20 rados_obj.operate() r=0 bl.length=46 2024-06-04T16:12:13.043 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.042+0000 7f5754010800 20 rados->read ofs=0 len=0 2024-06-04T16:12:13.044 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.042+0000 7f5754010800 20 rados_obj.operate() r=0 bl.length=470 2024-06-04T16:12:13.044 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.042+0000 7f5754010800 20 zone default found 2024-06-04T16:12:13.044 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.042+0000 7f5754010800 4 Realm: () 2024-06-04T16:12:13.045 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.042+0000 7f5754010800 4 ZoneGroup: default (abb22408-c332-4e28-8f7a-ff254ea2fed2) 2024-06-04T16:12:13.045 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.042+0000 7f5754010800 4 Zone: default (be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767) 2024-06-04T16:12:13.045 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.042+0000 7f5754010800 10 cannot find current period zonegroup using local zonegroup configuration 2024-06-04T16:12:13.045 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.042+0000 7f5754010800 20 zonegroup default 2024-06-04T16:12:13.045 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.042+0000 7f5754010800 20 rados->read ofs=0 len=0 2024-06-04T16:12:13.045 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.042+0000 7f5754010800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:12:13.045 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.042+0000 7f5754010800 20 rados->read ofs=0 len=0 2024-06-04T16:12:13.045 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.043+0000 7f5754010800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:12:13.045 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.043+0000 7f5754010800 20 rados->read ofs=0 len=0 2024-06-04T16:12:13.045 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.043+0000 7f5754010800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:12:13.045 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.043+0000 7f5754010800 20 started sync module instance, tier type = 2024-06-04T16:12:13.045 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.043+0000 7f5754010800 20 started zone id=be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767 (name=default) with tier type = 2024-06-04T16:12:13.054 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.053+0000 7f5754010800 20 add_watcher() i=0 2024-06-04T16:12:13.054 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.053+0000 7f5754010800 20 add_watcher() i=1 2024-06-04T16:12:13.054 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.053+0000 7f5754010800 20 add_watcher() i=2 2024-06-04T16:12:13.054 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.053+0000 7f5754010800 20 add_watcher() i=3 2024-06-04T16:12:13.054 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.053+0000 7f5754010800 20 add_watcher() i=4 2024-06-04T16:12:13.054 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.053+0000 7f5754010800 20 add_watcher() i=5 2024-06-04T16:12:13.054 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.053+0000 7f5754010800 20 add_watcher() i=6 2024-06-04T16:12:13.055 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.054+0000 7f5754010800 20 add_watcher() i=7 2024-06-04T16:12:13.055 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.054+0000 7f5754010800 2 all 8 watchers are set, enabling cache 2024-06-04T16:12:13.057 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.056+0000 7f5605fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-06-04T16:12:13.057 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.056+0000 7f5754010800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-06-04T16:12:13.057 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.056+0000 7f5754010800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-06-04T16:12:13.057 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.056+0000 7f5754010800 5 note: GC not initialized 2024-06-04T16:12:13.057 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.056+0000 7f5604fe1640 20 reqs_thread_entry: start 2024-06-04T16:12:13.057 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.056+0000 7f5754010800 20 init_complete bucket index max shards: 11 2024-06-04T16:12:13.058 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.056+0000 7f5754010800 20 Filter name: none 2024-06-04T16:12:13.058 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.056+0000 7f557e7fc640 20 reqs_thread_entry: start 2024-06-04T16:12:13.058 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.056+0000 7f5754010800 10 cache get: name=default.rgw.meta+root+error-at-block-writes : miss 2024-06-04T16:12:13.058 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.056+0000 7f5754010800 20 rados->read ofs=0 len=0 2024-06-04T16:12:13.059 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.057+0000 7f5754010800 20 rados_obj.operate() r=0 bl.length=189 2024-06-04T16:12:13.059 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.057+0000 7f5754010800 10 cache put: name=default.rgw.meta+root+error-at-block-writes info.flags=0x11 2024-06-04T16:12:13.059 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.057+0000 7f5754010800 10 adding default.rgw.meta+root+error-at-block-writes to cache LRU end 2024-06-04T16:12:13.059 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.057+0000 7f5754010800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.22 : miss 2024-06-04T16:12:13.059 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.057+0000 7f5754010800 20 rados->read ofs=0 len=0 2024-06-04T16:12:13.059 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.057+0000 7f5754010800 20 rados_obj.operate() r=0 bl.length=403 2024-06-04T16:12:13.059 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.057+0000 7f5754010800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.22 info.flags=0x17 2024-06-04T16:12:13.059 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.057+0000 7f5754010800 10 adding default.rgw.meta+root+.bucket.meta.error-at-block-writes:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.22 to cache LRU end 2024-06-04T16:12:13.059 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.057+0000 7f5754010800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-06-04T16:12:13.059 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.057+0000 7f5754010800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-06-04T16:12:13.060 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.057+0000 7f5754010800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.22 2024-06-04T16:12:13.065 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.064+0000 7f5754010800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.22 info.flags=0x17 2024-06-04T16:12:13.065 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.064+0000 7f5754010800 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.22 to cache LRU end 2024-06-04T16:12:13.065 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.064+0000 7f5754010800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-06-04T16:12:13.065 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.064+0000 7f5754010800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.22, ofs0, ns] 2024-06-04T16:12:13.065 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.064+0000 7f56327fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1078036791323 cookie 94657039443952 notifier 6432 bl.length()=907 2024-06-04T16:12:13.065 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.064+0000 7f56327fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.22 info.flags=0x17 2024-06-04T16:12:13.065 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.064+0000 7f56327fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.22 to cache LRU end 2024-06-04T16:12:13.066 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.064+0000 7f56327fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-06-04T16:12:13.066 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.065+0000 7f5754010800 20 handle_bi_update(): bucket=:error-at-block-writes[be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.22]): orig_sources= new_sources= 2024-06-04T16:12:13.066 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.065+0000 7f5754010800 20 handle_bi_update(): bucket=:error-at-block-writes[be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.22]): potential sources added=[] removed=[] 2024-06-04T16:12:13.066 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.065+0000 7f5754010800 20 handle_bi_update(): bucket=:error-at-block-writes[be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.22]): orig_dests= new_dests= 2024-06-04T16:12:13.066 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.065+0000 7f5754010800 20 handle_bi_update(): bucket=:error-at-block-writes[be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.22]): potential dests added=[] removed=[] 2024-06-04T16:12:13.068 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.067+0000 7f5754010800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.22.1.0 2024-06-04T16:12:13.068 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.067+0000 7f5754010800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.22.1.0 2024-06-04T16:12:13.068 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.067+0000 7f5754010800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.22.1.1 2024-06-04T16:12:13.068 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.067+0000 7f5754010800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.22.1.1 2024-06-04T16:12:13.068 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.067+0000 7f5754010800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.22.1.2 2024-06-04T16:12:13.068 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.067+0000 7f5754010800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.22.1.2 2024-06-04T16:12:13.069 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.067+0000 7f5754010800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.22.1.3 2024-06-04T16:12:13.069 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.067+0000 7f5754010800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.22.1.3 2024-06-04T16:12:13.069 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.067+0000 7f5754010800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.22.1.4 2024-06-04T16:12:13.069 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.067+0000 7f5754010800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.22.1.4 2024-06-04T16:12:13.069 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.067+0000 7f5754010800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.22.1.5 2024-06-04T16:12:13.069 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.067+0000 7f5754010800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.22.1.5 2024-06-04T16:12:13.069 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.067+0000 7f5754010800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.22.1.6 2024-06-04T16:12:13.069 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.067+0000 7f5754010800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.22.1.6 2024-06-04T16:12:13.069 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.067+0000 7f5754010800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.22.1.7 2024-06-04T16:12:13.069 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.067+0000 7f5754010800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.22.1.7 2024-06-04T16:12:13.069 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.067+0000 7f5754010800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.22.1.8 2024-06-04T16:12:13.069 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.067+0000 7f5754010800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.22.1.8 2024-06-04T16:12:13.069 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.067+0000 7f5754010800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.22.1.9 2024-06-04T16:12:13.069 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.067+0000 7f5754010800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.22.1.9 2024-06-04T16:12:13.070 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.067+0000 7f5754010800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.22.1.10 2024-06-04T16:12:13.070 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.067+0000 7f5754010800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.22.1.10 2024-06-04T16:12:13.070 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.067+0000 7f5754010800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.22.1.11 2024-06-04T16:12:13.070 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.067+0000 7f5754010800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.22.1.11 2024-06-04T16:12:13.070 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.067+0000 7f5754010800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.22.0 2024-06-04T16:12:13.070 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.067+0000 7f5754010800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.22.1 2024-06-04T16:12:13.071 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.068+0000 7f5754010800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.22.2 2024-06-04T16:12:13.071 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.068+0000 7f5754010800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.22.3 2024-06-04T16:12:13.071 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.069+0000 7f5754010800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.22.4 2024-06-04T16:12:13.071 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.069+0000 7f5754010800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.22.5 2024-06-04T16:12:13.071 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.070+0000 7f5754010800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.22.6 2024-06-04T16:12:13.071 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.070+0000 7f5754010800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.22.7 2024-06-04T16:12:13.072 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.070+0000 7f5754010800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.22.8 2024-06-04T16:12:13.072 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.071+0000 7f5754010800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.22.9 2024-06-04T16:12:13.072 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.072+0000 7f5754010800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.22.10 2024-06-04T16:12:13.077 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.076+0000 7f5754010800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.22 : hit (requested=0x17, cached=0x17) 2024-06-04T16:12:13.077 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.076+0000 7f5754010800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.22 2024-06-04T16:12:13.079 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.078+0000 7f5754010800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.22 info.flags=0x17 2024-06-04T16:12:13.079 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.078+0000 7f5754010800 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.22 to cache LRU end 2024-06-04T16:12:13.079 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.078+0000 7f5754010800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-06-04T16:12:13.079 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.078+0000 7f5754010800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.22, ofs0, ns] 2024-06-04T16:12:13.080 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.078+0000 7f56327fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1078036791324 cookie 94657039443952 notifier 6432 bl.length()=875 2024-06-04T16:12:13.080 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.078+0000 7f56327fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.22 info.flags=0x17 2024-06-04T16:12:13.080 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.078+0000 7f56327fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.22 to cache LRU end 2024-06-04T16:12:13.080 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.078+0000 7f56327fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-06-04T16:12:13.081 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.078+0000 7f5754010800 20 handle_bi_update(): bucket=:error-at-block-writes[be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.22]): orig_sources= new_sources= 2024-06-04T16:12:13.081 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.078+0000 7f5754010800 20 handle_bi_update(): bucket=:error-at-block-writes[be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.22]): potential sources added=[] removed=[] 2024-06-04T16:12:13.081 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.078+0000 7f5754010800 20 handle_bi_update(): bucket=:error-at-block-writes[be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.22]): orig_dests= new_dests= 2024-06-04T16:12:13.081 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.078+0000 7f5754010800 20 handle_bi_update(): bucket=:error-at-block-writes[be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.22]): potential dests added=[] removed=[] 2024-06-04T16:12:13.082 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.081+0000 7f5754010800 1 execute INFO: reshard of bucket "error-at-block-writes" completed successfully 2024-06-04T16:12:13.083 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.082+0000 7f5605fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-06-04T16:12:13.085 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.085+0000 7f5754010800 20 remove_watcher() i=0 2024-06-04T16:12:13.086 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.085+0000 7f5754010800 2 removed watcher, disabling cache 2024-06-04T16:12:13.086 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.086+0000 7f5754010800 20 remove_watcher() i=1 2024-06-04T16:12:13.087 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.087+0000 7f5754010800 20 remove_watcher() i=2 2024-06-04T16:12:13.088 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.087+0000 7f5754010800 20 remove_watcher() i=3 2024-06-04T16:12:13.089 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.088+0000 7f5754010800 20 remove_watcher() i=4 2024-06-04T16:12:13.090 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.089+0000 7f5754010800 20 remove_watcher() i=5 2024-06-04T16:12:13.091 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.090+0000 7f5754010800 20 remove_watcher() i=6 2024-06-04T16:12:13.092 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.091+0000 7f5754010800 20 remove_watcher() i=7 2024-06-04T16:12:13.105 INFO:tasks.workunit.client.0.smithi144.stderr:radosgw-admin bucket stats --bucket error-at-block-writes 2024-06-04T16:12:13.132 INFO:tasks.workunit.client.0.smithi144.stderr:ignoring --setuser ceph since I am not root 2024-06-04T16:12:13.133 INFO:tasks.workunit.client.0.smithi144.stderr:ignoring --setgroup ceph since I am not root 2024-06-04T16:12:13.168 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.167+0000 7fb37fb33800 20 rados->read ofs=0 len=0 2024-06-04T16:12:13.170 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.169+0000 7fb37fb33800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:12:13.170 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.169+0000 7fb37fb33800 20 realm 2024-06-04T16:12:13.170 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.169+0000 7fb37fb33800 20 rados->read ofs=0 len=0 2024-06-04T16:12:13.170 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.169+0000 7fb37fb33800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:12:13.170 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.169+0000 7fb37fb33800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-06-04T16:12:13.170 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.169+0000 7fb37fb33800 20 rados->read ofs=0 len=0 2024-06-04T16:12:13.171 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.169+0000 7fb37fb33800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:12:13.171 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.169+0000 7fb37fb33800 20 rados->read ofs=0 len=0 2024-06-04T16:12:13.171 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.170+0000 7fb37fb33800 20 rados_obj.operate() r=0 bl.length=46 2024-06-04T16:12:13.171 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.170+0000 7fb37fb33800 20 rados->read ofs=0 len=0 2024-06-04T16:12:13.172 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.171+0000 7fb37fb33800 20 rados_obj.operate() r=0 bl.length=1139 2024-06-04T16:12:13.172 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.171+0000 7fb37fb33800 20 searching for the correct realm 2024-06-04T16:12:13.174 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.173+0000 7fb37bfc8640 0 -- 172.21.15.144:0/3142444975 >> [v2:172.21.15.144:6800/1453747520,v1:172.21.15.144:6801/1453747520] conn(0x7fb3640d98c0 msgr2=0x7fb3640a41d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-06-04T16:12:13.378 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.378+0000 7fb37bfc8640 0 -- 172.21.15.144:0/3142444975 >> [v2:172.21.15.144:6824/166159729,v1:172.21.15.144:6825/166159729] conn(0x556a613d8df0 msgr2=0x556a613db1e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-06-04T16:12:13.386 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.382+0000 7fb37fb33800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-06-04T16:12:13.386 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.382+0000 7fb37fb33800 20 RGWRados::pool_iterate: got zone_info.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767 2024-06-04T16:12:13.386 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.382+0000 7fb37fb33800 20 RGWRados::pool_iterate: got default.zone. 2024-06-04T16:12:13.386 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.382+0000 7fb37fb33800 20 RGWRados::pool_iterate: got zonegroup_info.abb22408-c332-4e28-8f7a-ff254ea2fed2 2024-06-04T16:12:13.386 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.382+0000 7fb37fb33800 20 RGWRados::pool_iterate: got zone_names.default 2024-06-04T16:12:13.387 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.382+0000 7fb37fb33800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-06-04T16:12:13.387 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.382+0000 7fb37fb33800 20 rados->read ofs=0 len=0 2024-06-04T16:12:13.387 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.383+0000 7fb37fb33800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:12:13.387 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.383+0000 7fb37fb33800 20 rados->read ofs=0 len=0 2024-06-04T16:12:13.387 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.383+0000 7fb37fb33800 20 rados_obj.operate() r=0 bl.length=46 2024-06-04T16:12:13.387 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.383+0000 7fb37fb33800 20 rados->read ofs=0 len=0 2024-06-04T16:12:13.387 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.383+0000 7fb37fb33800 20 rados_obj.operate() r=0 bl.length=470 2024-06-04T16:12:13.388 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.383+0000 7fb37fb33800 20 zone default found 2024-06-04T16:12:13.388 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.383+0000 7fb37fb33800 4 Realm: () 2024-06-04T16:12:13.388 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.383+0000 7fb37fb33800 4 ZoneGroup: default (abb22408-c332-4e28-8f7a-ff254ea2fed2) 2024-06-04T16:12:13.388 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.383+0000 7fb37fb33800 4 Zone: default (be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767) 2024-06-04T16:12:13.388 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.383+0000 7fb37fb33800 10 cannot find current period zonegroup using local zonegroup configuration 2024-06-04T16:12:13.388 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.383+0000 7fb37fb33800 20 zonegroup default 2024-06-04T16:12:13.388 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.383+0000 7fb37fb33800 20 rados->read ofs=0 len=0 2024-06-04T16:12:13.388 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.383+0000 7fb37fb33800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:12:13.388 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.383+0000 7fb37fb33800 20 rados->read ofs=0 len=0 2024-06-04T16:12:13.389 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.384+0000 7fb37fb33800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:12:13.389 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.384+0000 7fb37fb33800 20 rados->read ofs=0 len=0 2024-06-04T16:12:13.389 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.384+0000 7fb37fb33800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:12:13.389 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.384+0000 7fb37fb33800 20 started sync module instance, tier type = 2024-06-04T16:12:13.389 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.384+0000 7fb37fb33800 20 started zone id=be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767 (name=default) with tier type = 2024-06-04T16:12:13.394 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.393+0000 7fb37fb33800 20 add_watcher() i=0 2024-06-04T16:12:13.394 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.393+0000 7fb37fb33800 20 add_watcher() i=1 2024-06-04T16:12:13.394 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.393+0000 7fb37fb33800 20 add_watcher() i=2 2024-06-04T16:12:13.394 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.393+0000 7fb37fb33800 20 add_watcher() i=3 2024-06-04T16:12:13.394 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.393+0000 7fb37fb33800 20 add_watcher() i=4 2024-06-04T16:12:13.394 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.393+0000 7fb37fb33800 20 add_watcher() i=5 2024-06-04T16:12:13.394 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.393+0000 7fb37fb33800 20 add_watcher() i=6 2024-06-04T16:12:13.394 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.394+0000 7fb37fb33800 20 add_watcher() i=7 2024-06-04T16:12:13.395 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.394+0000 7fb37fb33800 2 all 8 watchers are set, enabling cache 2024-06-04T16:12:13.396 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.395+0000 7fb231fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-06-04T16:12:13.397 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.396+0000 7fb37fb33800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-06-04T16:12:13.397 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.396+0000 7fb37fb33800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-06-04T16:12:13.397 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.396+0000 7fb37fb33800 5 note: GC not initialized 2024-06-04T16:12:13.397 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.396+0000 7fb230fe1640 20 reqs_thread_entry: start 2024-06-04T16:12:13.398 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.396+0000 7fb37fb33800 20 init_complete bucket index max shards: 11 2024-06-04T16:12:13.398 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.396+0000 7fb37fb33800 20 Filter name: none 2024-06-04T16:12:13.398 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.396+0000 7fb1aa7fc640 20 reqs_thread_entry: start 2024-06-04T16:12:13.398 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.396+0000 7fb37fb33800 20 rados->read ofs=0 len=0 2024-06-04T16:12:13.398 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.397+0000 7fb37fb33800 20 rados_obj.operate() r=0 bl.length=189 2024-06-04T16:12:13.398 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.397+0000 7fb37fb33800 20 rados->read ofs=0 len=0 2024-06-04T16:12:13.399 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.397+0000 7fb37fb33800 20 rados_obj.operate() r=0 bl.length=403 2024-06-04T16:12:13.399 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.397+0000 7fb37fb33800 20 couldn't put binfo cache entry, might have raced with data changes 2024-06-04T16:12:13.399 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.397+0000 7fb37fb33800 20 rados->read ofs=0 len=0 2024-06-04T16:12:13.399 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.398+0000 7fb37fb33800 20 rados_obj.operate() r=0 bl.length=189 2024-06-04T16:12:13.399 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.398+0000 7fb37fb33800 20 rados->read ofs=0 len=0 2024-06-04T16:12:13.399 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.398+0000 7fb37fb33800 20 rados_obj.operate() r=0 bl.length=403 2024-06-04T16:12:13.399 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.398+0000 7fb37fb33800 20 couldn't put binfo cache entry, might have raced with data changes 2024-06-04T16:12:13.401 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.401+0000 7fb231fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-06-04T16:12:13.403 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.402+0000 7fb37fb33800 20 remove_watcher() i=0 2024-06-04T16:12:13.403 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.402+0000 7fb37fb33800 2 removed watcher, disabling cache 2024-06-04T16:12:13.404 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.403+0000 7fb37fb33800 20 remove_watcher() i=1 2024-06-04T16:12:13.405 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.404+0000 7fb37fb33800 20 remove_watcher() i=2 2024-06-04T16:12:13.406 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.405+0000 7fb37fb33800 20 remove_watcher() i=3 2024-06-04T16:12:13.407 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.406+0000 7fb37fb33800 20 remove_watcher() i=4 2024-06-04T16:12:13.408 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.407+0000 7fb37fb33800 20 remove_watcher() i=5 2024-06-04T16:12:13.409 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.408+0000 7fb37fb33800 20 remove_watcher() i=6 2024-06-04T16:12:13.410 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.409+0000 7fb37fb33800 20 remove_watcher() i=7 2024-06-04T16:12:13.420 INFO:tasks.workunit.client.0.smithi144.stderr: 2024-06-04T16:12:13.421 INFO:tasks.workunit.client.0.smithi144.stderr:BUCKET_STATS: 2024-06-04T16:12:13.421 INFO:tasks.workunit.client.0.smithi144.stderr:bucket: error-at-block-writes id: be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.22 num_objects: 19 size_kb: 1 num_shards: 12 2024-06-04T16:12:13.421 INFO:tasks.workunit.client.0.smithi144.stderr: 2024-06-04T16:12:13.422 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:12:13.422 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:12:13.426 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:12:13.426 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:12:13.470 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:12:13.470 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:12:13.496 INFO:tasks.workunit.client.0.smithi144.stderr:TEST: reshard bucket with abort at block_writes 2024-06-04T16:12:13.496 INFO:tasks.workunit.client.0.smithi144.stderr: 2024-06-04T16:12:13.497 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:12:13.498 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:12:13.508 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:12:13.508 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:12:13.550 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:12:13.550 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:12:13.556 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:12:13.556 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:12:13.563 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:12:13.564 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:12:13.570 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:12:13.571 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:12:13.577 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:12:13.577 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:12:13.584 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:12:13.584 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:12:13.590 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:12:13.590 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:12:13.597 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:12:13.597 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:12:13.603 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:12:13.603 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:12:13.609 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:12:13.609 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:12:13.615 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:12:13.615 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:12:13.621 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:12:13.621 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:12:13.627 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:12:13.627 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:12:13.634 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:12:13.634 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:12:13.640 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:12:13.640 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:12:13.647 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:12:13.647 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:12:13.653 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:12:13.654 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:12:13.660 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:12:13.660 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:12:13.667 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:12:13.667 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:12:13.673 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:12:13.673 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:12:13.680 INFO:tasks.workunit.client.0.smithi144.stderr:radosgw-admin bucket stats --bucket abort-at-block-writes 2024-06-04T16:12:13.708 INFO:tasks.workunit.client.0.smithi144.stderr:ignoring --setuser ceph since I am not root 2024-06-04T16:12:13.708 INFO:tasks.workunit.client.0.smithi144.stderr:ignoring --setgroup ceph since I am not root 2024-06-04T16:12:13.745 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.744+0000 7f465c331800 20 rados->read ofs=0 len=0 2024-06-04T16:12:13.747 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.746+0000 7f465c331800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:12:13.747 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.746+0000 7f465c331800 20 realm 2024-06-04T16:12:13.747 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.746+0000 7f465c331800 20 rados->read ofs=0 len=0 2024-06-04T16:12:13.747 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.746+0000 7f465c331800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:12:13.747 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.746+0000 7f465c331800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-06-04T16:12:13.747 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.746+0000 7f465c331800 20 rados->read ofs=0 len=0 2024-06-04T16:12:13.747 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.746+0000 7f465c331800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:12:13.747 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.746+0000 7f465c331800 20 rados->read ofs=0 len=0 2024-06-04T16:12:13.748 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.747+0000 7f465c331800 20 rados_obj.operate() r=0 bl.length=46 2024-06-04T16:12:13.748 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.747+0000 7f465c331800 20 rados->read ofs=0 len=0 2024-06-04T16:12:13.748 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.747+0000 7f465c331800 20 rados_obj.operate() r=0 bl.length=1139 2024-06-04T16:12:13.748 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.747+0000 7f465c331800 20 searching for the correct realm 2024-06-04T16:12:13.750 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.749+0000 7f4657feb640 0 -- 172.21.15.144:0/2698024869 >> [v2:172.21.15.177:6824/800067290,v1:172.21.15.177:6825/800067290] conn(0x55b1de9d3b30 msgr2=0x55b1de9d5f20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-06-04T16:12:13.753 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.752+0000 7f464ffff640 0 -- 172.21.15.144:0/2698024869 >> [v2:172.21.15.177:6808/2618477608,v1:172.21.15.177:6809/2618477608] conn(0x7f4640020070 msgr2=0x7f4640017270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-06-04T16:12:13.960 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.958+0000 7f465c331800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-06-04T16:12:13.961 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.958+0000 7f465c331800 20 RGWRados::pool_iterate: got zone_info.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767 2024-06-04T16:12:13.961 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.958+0000 7f465c331800 20 RGWRados::pool_iterate: got default.zone. 2024-06-04T16:12:13.961 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.958+0000 7f465c331800 20 RGWRados::pool_iterate: got zonegroup_info.abb22408-c332-4e28-8f7a-ff254ea2fed2 2024-06-04T16:12:13.961 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.958+0000 7f465c331800 20 RGWRados::pool_iterate: got zone_names.default 2024-06-04T16:12:13.961 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.958+0000 7f465c331800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-06-04T16:12:13.961 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.958+0000 7f465c331800 20 rados->read ofs=0 len=0 2024-06-04T16:12:13.961 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.959+0000 7f465c331800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:12:13.961 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.959+0000 7f465c331800 20 rados->read ofs=0 len=0 2024-06-04T16:12:13.961 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.959+0000 7f465c331800 20 rados_obj.operate() r=0 bl.length=46 2024-06-04T16:12:13.961 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.959+0000 7f465c331800 20 rados->read ofs=0 len=0 2024-06-04T16:12:13.962 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.959+0000 7f465c331800 20 rados_obj.operate() r=0 bl.length=470 2024-06-04T16:12:13.963 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.959+0000 7f465c331800 20 zone default found 2024-06-04T16:12:13.963 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.959+0000 7f465c331800 4 Realm: () 2024-06-04T16:12:13.963 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.959+0000 7f465c331800 4 ZoneGroup: default (abb22408-c332-4e28-8f7a-ff254ea2fed2) 2024-06-04T16:12:13.963 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.959+0000 7f465c331800 4 Zone: default (be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767) 2024-06-04T16:12:13.963 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.959+0000 7f465c331800 10 cannot find current period zonegroup using local zonegroup configuration 2024-06-04T16:12:13.963 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.959+0000 7f465c331800 20 zonegroup default 2024-06-04T16:12:13.963 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.959+0000 7f465c331800 20 rados->read ofs=0 len=0 2024-06-04T16:12:13.963 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.960+0000 7f465c331800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:12:13.963 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.960+0000 7f465c331800 20 rados->read ofs=0 len=0 2024-06-04T16:12:13.963 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.960+0000 7f465c331800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:12:13.963 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.960+0000 7f465c331800 20 rados->read ofs=0 len=0 2024-06-04T16:12:13.964 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.960+0000 7f465c331800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:12:13.964 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.960+0000 7f465c331800 20 started sync module instance, tier type = 2024-06-04T16:12:13.964 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.960+0000 7f465c331800 20 started zone id=be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767 (name=default) with tier type = 2024-06-04T16:12:13.970 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.969+0000 7f465c331800 20 add_watcher() i=0 2024-06-04T16:12:13.970 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.969+0000 7f465c331800 20 add_watcher() i=1 2024-06-04T16:12:13.970 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.969+0000 7f465c331800 20 add_watcher() i=2 2024-06-04T16:12:13.970 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.969+0000 7f465c331800 20 add_watcher() i=3 2024-06-04T16:12:13.970 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.969+0000 7f465c331800 20 add_watcher() i=4 2024-06-04T16:12:13.970 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.969+0000 7f465c331800 20 add_watcher() i=5 2024-06-04T16:12:13.970 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.969+0000 7f465c331800 20 add_watcher() i=6 2024-06-04T16:12:13.971 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.970+0000 7f465c331800 20 add_watcher() i=7 2024-06-04T16:12:13.971 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.970+0000 7f465c331800 2 all 8 watchers are set, enabling cache 2024-06-04T16:12:13.973 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.972+0000 7f450dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-06-04T16:12:13.973 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.972+0000 7f465c331800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-06-04T16:12:13.974 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.972+0000 7f465c331800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-06-04T16:12:13.974 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.972+0000 7f465c331800 5 note: GC not initialized 2024-06-04T16:12:13.974 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.972+0000 7f450cfe1640 20 reqs_thread_entry: start 2024-06-04T16:12:13.974 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.973+0000 7f465c331800 20 init_complete bucket index max shards: 11 2024-06-04T16:12:13.974 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.973+0000 7f465c331800 20 Filter name: none 2024-06-04T16:12:13.974 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.973+0000 7f44867fc640 20 reqs_thread_entry: start 2024-06-04T16:12:13.974 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.973+0000 7f465c331800 20 rados->read ofs=0 len=0 2024-06-04T16:12:13.975 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.973+0000 7f465c331800 20 rados_obj.operate() r=0 bl.length=189 2024-06-04T16:12:13.975 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.973+0000 7f465c331800 20 rados->read ofs=0 len=0 2024-06-04T16:12:13.975 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.974+0000 7f465c331800 20 rados_obj.operate() r=0 bl.length=403 2024-06-04T16:12:13.975 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.974+0000 7f465c331800 20 couldn't put binfo cache entry, might have raced with data changes 2024-06-04T16:12:13.975 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.974+0000 7f465c331800 20 rados->read ofs=0 len=0 2024-06-04T16:12:13.976 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.974+0000 7f465c331800 20 rados_obj.operate() r=0 bl.length=189 2024-06-04T16:12:13.976 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.974+0000 7f465c331800 20 rados->read ofs=0 len=0 2024-06-04T16:12:13.976 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.975+0000 7f465c331800 20 rados_obj.operate() r=0 bl.length=403 2024-06-04T16:12:13.976 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.975+0000 7f465c331800 20 couldn't put binfo cache entry, might have raced with data changes 2024-06-04T16:12:13.977 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.976+0000 7f450dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-06-04T16:12:13.979 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.978+0000 7f465c331800 20 remove_watcher() i=0 2024-06-04T16:12:13.979 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.978+0000 7f465c331800 2 removed watcher, disabling cache 2024-06-04T16:12:13.980 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.979+0000 7f465c331800 20 remove_watcher() i=1 2024-06-04T16:12:13.980 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.980+0000 7f465c331800 20 remove_watcher() i=2 2024-06-04T16:12:13.982 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.981+0000 7f465c331800 20 remove_watcher() i=3 2024-06-04T16:12:13.983 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.982+0000 7f465c331800 20 remove_watcher() i=4 2024-06-04T16:12:13.983 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.983+0000 7f465c331800 20 remove_watcher() i=5 2024-06-04T16:12:13.984 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.984+0000 7f465c331800 20 remove_watcher() i=6 2024-06-04T16:12:13.985 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:13.985+0000 7f465c331800 20 remove_watcher() i=7 2024-06-04T16:12:13.996 INFO:tasks.workunit.client.0.smithi144.stderr: 2024-06-04T16:12:13.996 INFO:tasks.workunit.client.0.smithi144.stderr:BUCKET_STATS: 2024-06-04T16:12:13.996 INFO:tasks.workunit.client.0.smithi144.stderr:bucket: abort-at-block-writes id: be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.23 num_objects: 20 size_kb: 1 num_shards: 11 2024-06-04T16:12:13.996 INFO:tasks.workunit.client.0.smithi144.stderr: 2024-06-04T16:12:13.998 INFO:tasks.workunit.client.0.smithi144.stderr:radosgw-admin bucket reshard --bucket abort-at-block-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at block_writes 2024-06-04T16:12:14.030 INFO:tasks.workunit.client.0.smithi144.stderr:ignoring --setuser ceph since I am not root 2024-06-04T16:12:14.030 INFO:tasks.workunit.client.0.smithi144.stderr:ignoring --setgroup ceph since I am not root 2024-06-04T16:12:14.067 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:14.066+0000 7f6cbcd3f800 20 rados->read ofs=0 len=0 2024-06-04T16:12:14.069 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:14.067+0000 7f6cbcd3f800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:12:14.069 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:14.067+0000 7f6cbcd3f800 20 realm 2024-06-04T16:12:14.069 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:14.067+0000 7f6cbcd3f800 20 rados->read ofs=0 len=0 2024-06-04T16:12:14.069 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:14.067+0000 7f6cbcd3f800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:12:14.069 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:14.067+0000 7f6cbcd3f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-06-04T16:12:14.070 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:14.067+0000 7f6cbcd3f800 20 rados->read ofs=0 len=0 2024-06-04T16:12:14.070 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:14.068+0000 7f6cbcd3f800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:12:14.070 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:14.068+0000 7f6cbcd3f800 20 rados->read ofs=0 len=0 2024-06-04T16:12:14.070 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:14.068+0000 7f6cbcd3f800 20 rados_obj.operate() r=0 bl.length=46 2024-06-04T16:12:14.070 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:14.068+0000 7f6cbcd3f800 20 rados->read ofs=0 len=0 2024-06-04T16:12:14.071 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:14.069+0000 7f6cbcd3f800 20 rados_obj.operate() r=0 bl.length=1139 2024-06-04T16:12:14.071 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:14.069+0000 7f6cbcd3f800 20 searching for the correct realm 2024-06-04T16:12:14.071 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:14.071+0000 7f6cb3fff640 0 -- 172.21.15.144:0/1373499307 >> [v2:172.21.15.144:6816/2358575268,v1:172.21.15.144:6817/2358575268] conn(0x564235582da0 msgr2=0x564235585190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-06-04T16:12:14.074 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:14.073+0000 7f6cb3fff640 0 -- 172.21.15.144:0/1373499307 >> [v2:172.21.15.177:6808/2618477608,v1:172.21.15.177:6809/2618477608] conn(0x7f6ca404b5e0 msgr2=0x7f6ca404b000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-06-04T16:12:14.282 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:14.280+0000 7f6cbcd3f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-06-04T16:12:14.282 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:14.280+0000 7f6cbcd3f800 20 RGWRados::pool_iterate: got zone_info.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767 2024-06-04T16:12:14.282 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:14.280+0000 7f6cbcd3f800 20 RGWRados::pool_iterate: got default.zone. 2024-06-04T16:12:14.282 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:14.280+0000 7f6cbcd3f800 20 RGWRados::pool_iterate: got zonegroup_info.abb22408-c332-4e28-8f7a-ff254ea2fed2 2024-06-04T16:12:14.282 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:14.281+0000 7f6cbcd3f800 20 RGWRados::pool_iterate: got zone_names.default 2024-06-04T16:12:14.283 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:14.281+0000 7f6cbcd3f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-06-04T16:12:14.283 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:14.281+0000 7f6cbcd3f800 20 rados->read ofs=0 len=0 2024-06-04T16:12:14.283 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:14.281+0000 7f6cbcd3f800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:12:14.283 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:14.281+0000 7f6cbcd3f800 20 rados->read ofs=0 len=0 2024-06-04T16:12:14.283 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:14.281+0000 7f6cbcd3f800 20 rados_obj.operate() r=0 bl.length=46 2024-06-04T16:12:14.283 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:14.281+0000 7f6cbcd3f800 20 rados->read ofs=0 len=0 2024-06-04T16:12:14.284 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:14.282+0000 7f6cbcd3f800 20 rados_obj.operate() r=0 bl.length=470 2024-06-04T16:12:14.284 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:14.282+0000 7f6cbcd3f800 20 zone default found 2024-06-04T16:12:14.284 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:14.282+0000 7f6cbcd3f800 4 Realm: () 2024-06-04T16:12:14.284 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:14.282+0000 7f6cbcd3f800 4 ZoneGroup: default (abb22408-c332-4e28-8f7a-ff254ea2fed2) 2024-06-04T16:12:14.284 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:14.282+0000 7f6cbcd3f800 4 Zone: default (be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767) 2024-06-04T16:12:14.284 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:14.282+0000 7f6cbcd3f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-06-04T16:12:14.284 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:14.282+0000 7f6cbcd3f800 20 zonegroup default 2024-06-04T16:12:14.285 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:14.282+0000 7f6cbcd3f800 20 rados->read ofs=0 len=0 2024-06-04T16:12:14.285 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:14.282+0000 7f6cbcd3f800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:12:14.285 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:14.282+0000 7f6cbcd3f800 20 rados->read ofs=0 len=0 2024-06-04T16:12:14.285 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:14.282+0000 7f6cbcd3f800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:12:14.285 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:14.282+0000 7f6cbcd3f800 20 rados->read ofs=0 len=0 2024-06-04T16:12:14.285 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:14.283+0000 7f6cbcd3f800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:12:14.285 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:14.283+0000 7f6cbcd3f800 20 started sync module instance, tier type = 2024-06-04T16:12:14.285 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:14.283+0000 7f6cbcd3f800 20 started zone id=be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767 (name=default) with tier type = 2024-06-04T16:12:14.292 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:14.291+0000 7f6cbcd3f800 20 add_watcher() i=0 2024-06-04T16:12:14.292 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:14.291+0000 7f6cbcd3f800 20 add_watcher() i=1 2024-06-04T16:12:14.292 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:14.291+0000 7f6cbcd3f800 20 add_watcher() i=2 2024-06-04T16:12:14.292 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:14.291+0000 7f6cbcd3f800 20 add_watcher() i=3 2024-06-04T16:12:14.292 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:14.291+0000 7f6cbcd3f800 20 add_watcher() i=4 2024-06-04T16:12:14.292 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:14.291+0000 7f6cbcd3f800 20 add_watcher() i=5 2024-06-04T16:12:14.292 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:14.291+0000 7f6cbcd3f800 20 add_watcher() i=6 2024-06-04T16:12:14.293 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:14.292+0000 7f6cbcd3f800 20 add_watcher() i=7 2024-06-04T16:12:14.293 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:14.292+0000 7f6cbcd3f800 2 all 8 watchers are set, enabling cache 2024-06-04T16:12:14.295 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:14.294+0000 7f6b6efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-06-04T16:12:14.296 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:14.295+0000 7f6cbcd3f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-06-04T16:12:14.296 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:14.295+0000 7f6cbcd3f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-06-04T16:12:14.296 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:14.295+0000 7f6cbcd3f800 5 note: GC not initialized 2024-06-04T16:12:14.296 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:14.295+0000 7f6b6dfe3640 20 reqs_thread_entry: start 2024-06-04T16:12:14.296 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:14.295+0000 7f6cbcd3f800 20 init_complete bucket index max shards: 11 2024-06-04T16:12:14.296 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:14.295+0000 7f6cbcd3f800 20 Filter name: none 2024-06-04T16:12:14.296 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:14.295+0000 7f6adf7fe640 20 reqs_thread_entry: start 2024-06-04T16:12:14.296 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:14.295+0000 7f6cbcd3f800 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2024-06-04T16:12:14.297 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:14.295+0000 7f6cbcd3f800 20 rados->read ofs=0 len=0 2024-06-04T16:12:14.297 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:14.296+0000 7f6cbcd3f800 20 rados_obj.operate() r=0 bl.length=189 2024-06-04T16:12:14.297 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:14.296+0000 7f6cbcd3f800 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2024-06-04T16:12:14.297 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:14.296+0000 7f6cbcd3f800 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2024-06-04T16:12:14.297 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:14.296+0000 7f6cbcd3f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.23 : miss 2024-06-04T16:12:14.298 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:14.296+0000 7f6cbcd3f800 20 rados->read ofs=0 len=0 2024-06-04T16:12:14.298 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:14.296+0000 7f6cbcd3f800 20 rados_obj.operate() r=0 bl.length=403 2024-06-04T16:12:14.298 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:14.296+0000 7f6cbcd3f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.23 info.flags=0x17 2024-06-04T16:12:14.298 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:14.296+0000 7f6cbcd3f800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.23 to cache LRU end 2024-06-04T16:12:14.298 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:14.296+0000 7f6cbcd3f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-06-04T16:12:14.298 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:14.296+0000 7f6cbcd3f800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-06-04T16:12:14.298 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:14.296+0000 7f6cbcd3f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.23 2024-06-04T16:12:14.304 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:14.303+0000 7f6cbcd3f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.23 info.flags=0x17 2024-06-04T16:12:14.304 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:14.303+0000 7f6cbcd3f800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.23 to cache LRU end 2024-06-04T16:12:14.304 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:14.303+0000 7f6cbcd3f800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-06-04T16:12:14.304 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:14.303+0000 7f6cbcd3f800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.23, ofs0, ns] 2024-06-04T16:12:14.305 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:14.304+0000 7f6b8f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1078036791403 cookie 94842362851664 notifier 6161 bl.length()=907 2024-06-04T16:12:14.305 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:14.304+0000 7f6b8f7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.23 info.flags=0x17 2024-06-04T16:12:14.305 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:14.304+0000 7f6b8f7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.23 to cache LRU end 2024-06-04T16:12:14.305 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:14.304+0000 7f6b8f7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-06-04T16:12:14.305 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:14.304+0000 7f6cbcd3f800 20 handle_bi_update(): bucket=:abort-at-block-writes[be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.23]): orig_sources= new_sources= 2024-06-04T16:12:14.305 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:14.304+0000 7f6cbcd3f800 20 handle_bi_update(): bucket=:abort-at-block-writes[be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.23]): potential sources added=[] removed=[] 2024-06-04T16:12:14.305 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:14.304+0000 7f6cbcd3f800 20 handle_bi_update(): bucket=:abort-at-block-writes[be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.23]): orig_dests= new_dests= 2024-06-04T16:12:14.305 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:14.304+0000 7f6cbcd3f800 20 handle_bi_update(): bucket=:abort-at-block-writes[be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.23]): potential dests added=[] removed=[] 2024-06-04T16:12:14.305 INFO:tasks.workunit.client.0.smithi144.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-4027-g65533a90/rpm/el9/BUILD/ceph-19.0.0-4027-g65533a90/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f6cbcd3f800 time 2024-06-04T16:12:14.305342+0000 2024-06-04T16:12:14.306 INFO:tasks.workunit.client.0.smithi144.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-4027-g65533a90/rpm/el9/BUILD/ceph-19.0.0-4027-g65533a90/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-06-04T16:12:14.327 INFO:tasks.workunit.client.0.smithi144.stderr: ceph version 19.0.0-4027-g65533a90 (65533a907fc9add1863609703fdbbea67993c8ef) squid (dev) 2024-06-04T16:12:14.327 INFO:tasks.workunit.client.0.smithi144.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f6cbe381dce] 2024-06-04T16:12:14.327 INFO:tasks.workunit.client.0.smithi144.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x181f8c) [0x7f6cbe381f8c] 2024-06-04T16:12:14.327 INFO:tasks.workunit.client.0.smithi144.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x564234414fb1] 2024-06-04T16:12:14.327 INFO:tasks.workunit.client.0.smithi144.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x2bf) [0x56423442032f] 2024-06-04T16:12:14.327 INFO:tasks.workunit.client.0.smithi144.stderr: 5: main() 2024-06-04T16:12:14.327 INFO:tasks.workunit.client.0.smithi144.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7f6cbd229590] 2024-06-04T16:12:14.327 INFO:tasks.workunit.client.0.smithi144.stderr: 7: __libc_start_main() 2024-06-04T16:12:14.327 INFO:tasks.workunit.client.0.smithi144.stderr: 8: _start() 2024-06-04T16:12:14.327 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:14.305+0000 7f6cbcd3f800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-4027-g65533a90/rpm/el9/BUILD/ceph-19.0.0-4027-g65533a90/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f6cbcd3f800 time 2024-06-04T16:12:14.305342+0000 2024-06-04T16:12:14.327 INFO:tasks.workunit.client.0.smithi144.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-4027-g65533a90/rpm/el9/BUILD/ceph-19.0.0-4027-g65533a90/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-06-04T16:12:14.327 INFO:tasks.workunit.client.0.smithi144.stderr: 2024-06-04T16:12:14.328 INFO:tasks.workunit.client.0.smithi144.stderr: ceph version 19.0.0-4027-g65533a90 (65533a907fc9add1863609703fdbbea67993c8ef) squid (dev) 2024-06-04T16:12:14.328 INFO:tasks.workunit.client.0.smithi144.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f6cbe381dce] 2024-06-04T16:12:14.328 INFO:tasks.workunit.client.0.smithi144.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x181f8c) [0x7f6cbe381f8c] 2024-06-04T16:12:14.328 INFO:tasks.workunit.client.0.smithi144.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x564234414fb1] 2024-06-04T16:12:14.328 INFO:tasks.workunit.client.0.smithi144.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x2bf) [0x56423442032f] 2024-06-04T16:12:14.328 INFO:tasks.workunit.client.0.smithi144.stderr: 5: main() 2024-06-04T16:12:14.328 INFO:tasks.workunit.client.0.smithi144.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7f6cbd229590] 2024-06-04T16:12:14.328 INFO:tasks.workunit.client.0.smithi144.stderr: 7: __libc_start_main() 2024-06-04T16:12:14.328 INFO:tasks.workunit.client.0.smithi144.stderr: 8: _start() 2024-06-04T16:12:14.328 INFO:tasks.workunit.client.0.smithi144.stderr: 2024-06-04T16:12:14.328 INFO:tasks.workunit.client.0.smithi144.stderr:*** Caught signal (Aborted) ** 2024-06-04T16:12:14.328 INFO:tasks.workunit.client.0.smithi144.stderr: in thread 7f6cbcd3f800 thread_name:radosgw-admin 2024-06-04T16:12:14.328 INFO:tasks.workunit.client.0.smithi144.stderr: ceph version 19.0.0-4027-g65533a90 (65533a907fc9add1863609703fdbbea67993c8ef) squid (dev) 2024-06-04T16:12:14.329 INFO:tasks.workunit.client.0.smithi144.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f6cbd23e6f0] 2024-06-04T16:12:14.329 INFO:tasks.workunit.client.0.smithi144.stderr: 2: /lib64/libc.so.6(+0x8b94c) [0x7f6cbd28b94c] 2024-06-04T16:12:14.329 INFO:tasks.workunit.client.0.smithi144.stderr: 3: raise() 2024-06-04T16:12:14.329 INFO:tasks.workunit.client.0.smithi144.stderr: 4: abort() 2024-06-04T16:12:14.329 INFO:tasks.workunit.client.0.smithi144.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f6cbe381e28] 2024-06-04T16:12:14.329 INFO:tasks.workunit.client.0.smithi144.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x181f8c) [0x7f6cbe381f8c] 2024-06-04T16:12:14.329 INFO:tasks.workunit.client.0.smithi144.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x564234414fb1] 2024-06-04T16:12:14.329 INFO:tasks.workunit.client.0.smithi144.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x2bf) [0x56423442032f] 2024-06-04T16:12:14.329 INFO:tasks.workunit.client.0.smithi144.stderr: 9: main() 2024-06-04T16:12:14.329 INFO:tasks.workunit.client.0.smithi144.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7f6cbd229590] 2024-06-04T16:12:14.329 INFO:tasks.workunit.client.0.smithi144.stderr: 11: __libc_start_main() 2024-06-04T16:12:14.329 INFO:tasks.workunit.client.0.smithi144.stderr: 12: _start() 2024-06-04T16:12:14.329 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:14.305+0000 7f6cbcd3f800 -1 *** Caught signal (Aborted) ** 2024-06-04T16:12:14.330 INFO:tasks.workunit.client.0.smithi144.stderr: in thread 7f6cbcd3f800 thread_name:radosgw-admin 2024-06-04T16:12:14.330 INFO:tasks.workunit.client.0.smithi144.stderr: 2024-06-04T16:12:14.330 INFO:tasks.workunit.client.0.smithi144.stderr: ceph version 19.0.0-4027-g65533a90 (65533a907fc9add1863609703fdbbea67993c8ef) squid (dev) 2024-06-04T16:12:14.330 INFO:tasks.workunit.client.0.smithi144.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f6cbd23e6f0] 2024-06-04T16:12:14.330 INFO:tasks.workunit.client.0.smithi144.stderr: 2: /lib64/libc.so.6(+0x8b94c) [0x7f6cbd28b94c] 2024-06-04T16:12:14.330 INFO:tasks.workunit.client.0.smithi144.stderr: 3: raise() 2024-06-04T16:12:14.330 INFO:tasks.workunit.client.0.smithi144.stderr: 4: abort() 2024-06-04T16:12:14.330 INFO:tasks.workunit.client.0.smithi144.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f6cbe381e28] 2024-06-04T16:12:14.330 INFO:tasks.workunit.client.0.smithi144.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x181f8c) [0x7f6cbe381f8c] 2024-06-04T16:12:14.330 INFO:tasks.workunit.client.0.smithi144.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x564234414fb1] 2024-06-04T16:12:14.330 INFO:tasks.workunit.client.0.smithi144.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x2bf) [0x56423442032f] 2024-06-04T16:12:14.330 INFO:tasks.workunit.client.0.smithi144.stderr: 9: main() 2024-06-04T16:12:14.330 INFO:tasks.workunit.client.0.smithi144.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7f6cbd229590] 2024-06-04T16:12:14.331 INFO:tasks.workunit.client.0.smithi144.stderr: 11: __libc_start_main() 2024-06-04T16:12:14.331 INFO:tasks.workunit.client.0.smithi144.stderr: 12: _start() 2024-06-04T16:12:14.331 INFO:tasks.workunit.client.0.smithi144.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-06-04T16:12:14.331 INFO:tasks.workunit.client.0.smithi144.stderr: 2024-06-04T16:12:14.331 INFO:tasks.workunit.client.0.smithi144.stderr:--- begin dump of recent events --- 2024-06-04T16:12:14.331 INFO:tasks.workunit.client.0.smithi144.stderr: -499> 2024-06-04T16:12:14.050+0000 7f6cbcd3f800 10 monclient: build_initial_monmap 2024-06-04T16:12:14.331 INFO:tasks.workunit.client.0.smithi144.stderr: -498> 2024-06-04T16:12:14.050+0000 7f6cbcd3f800 1 build_initial for_mkfs: 0 2024-06-04T16:12:14.331 INFO:tasks.workunit.client.0.smithi144.stderr: -497> 2024-06-04T16:12:14.050+0000 7f6cbcd3f800 10 monclient: monmap: 2024-06-04T16:12:14.331 INFO:tasks.workunit.client.0.smithi144.stderr:epoch 0 2024-06-04T16:12:14.331 INFO:tasks.workunit.client.0.smithi144.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-06-04T16:12:14.331 INFO:tasks.workunit.client.0.smithi144.stderr:last_changed 0.000000 2024-06-04T16:12:14.331 INFO:tasks.workunit.client.0.smithi144.stderr:created 0.000000 2024-06-04T16:12:14.331 INFO:tasks.workunit.client.0.smithi144.stderr:min_mon_release 0 (unknown) 2024-06-04T16:12:14.332 INFO:tasks.workunit.client.0.smithi144.stderr:election_strategy: 1 2024-06-04T16:12:14.332 INFO:tasks.workunit.client.0.smithi144.stderr:0: [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] mon.noname-a 2024-06-04T16:12:14.332 INFO:tasks.workunit.client.0.smithi144.stderr:1: [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] mon.noname-b 2024-06-04T16:12:14.332 INFO:tasks.workunit.client.0.smithi144.stderr:2: [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] mon.noname-c 2024-06-04T16:12:14.332 INFO:tasks.workunit.client.0.smithi144.stderr: 2024-06-04T16:12:14.332 INFO:tasks.workunit.client.0.smithi144.stderr: -496> 2024-06-04T16:12:14.050+0000 7f6cbcd3f800 5 AuthRegistry(0x564235497c70) adding auth protocol: cephx 2024-06-04T16:12:14.332 INFO:tasks.workunit.client.0.smithi144.stderr: -495> 2024-06-04T16:12:14.050+0000 7f6cbcd3f800 5 AuthRegistry(0x564235497c70) adding auth protocol: cephx 2024-06-04T16:12:14.332 INFO:tasks.workunit.client.0.smithi144.stderr: -494> 2024-06-04T16:12:14.050+0000 7f6cbcd3f800 5 AuthRegistry(0x564235497c70) adding auth protocol: cephx 2024-06-04T16:12:14.332 INFO:tasks.workunit.client.0.smithi144.stderr: -493> 2024-06-04T16:12:14.050+0000 7f6cbcd3f800 5 AuthRegistry(0x564235497c70) adding con mode: secure 2024-06-04T16:12:14.332 INFO:tasks.workunit.client.0.smithi144.stderr: -492> 2024-06-04T16:12:14.050+0000 7f6cbcd3f800 5 AuthRegistry(0x564235497c70) adding con mode: crc 2024-06-04T16:12:14.332 INFO:tasks.workunit.client.0.smithi144.stderr: -491> 2024-06-04T16:12:14.050+0000 7f6cbcd3f800 5 AuthRegistry(0x564235497c70) adding con mode: secure 2024-06-04T16:12:14.332 INFO:tasks.workunit.client.0.smithi144.stderr: -490> 2024-06-04T16:12:14.050+0000 7f6cbcd3f800 5 AuthRegistry(0x564235497c70) adding con mode: crc 2024-06-04T16:12:14.332 INFO:tasks.workunit.client.0.smithi144.stderr: -489> 2024-06-04T16:12:14.050+0000 7f6cbcd3f800 5 AuthRegistry(0x564235497c70) adding con mode: secure 2024-06-04T16:12:14.332 INFO:tasks.workunit.client.0.smithi144.stderr: -488> 2024-06-04T16:12:14.050+0000 7f6cbcd3f800 5 AuthRegistry(0x564235497c70) adding con mode: crc 2024-06-04T16:12:14.332 INFO:tasks.workunit.client.0.smithi144.stderr: -487> 2024-06-04T16:12:14.050+0000 7f6cbcd3f800 5 AuthRegistry(0x564235497c70) adding con mode: crc 2024-06-04T16:12:14.333 INFO:tasks.workunit.client.0.smithi144.stderr: -486> 2024-06-04T16:12:14.050+0000 7f6cbcd3f800 5 AuthRegistry(0x564235497c70) adding con mode: secure 2024-06-04T16:12:14.333 INFO:tasks.workunit.client.0.smithi144.stderr: -485> 2024-06-04T16:12:14.050+0000 7f6cbcd3f800 5 AuthRegistry(0x564235497c70) adding con mode: crc 2024-06-04T16:12:14.333 INFO:tasks.workunit.client.0.smithi144.stderr: -484> 2024-06-04T16:12:14.050+0000 7f6cbcd3f800 5 AuthRegistry(0x564235497c70) adding con mode: secure 2024-06-04T16:12:14.333 INFO:tasks.workunit.client.0.smithi144.stderr: -483> 2024-06-04T16:12:14.050+0000 7f6cbcd3f800 5 AuthRegistry(0x564235497c70) adding con mode: crc 2024-06-04T16:12:14.333 INFO:tasks.workunit.client.0.smithi144.stderr: -482> 2024-06-04T16:12:14.050+0000 7f6cbcd3f800 5 AuthRegistry(0x564235497c70) adding con mode: secure 2024-06-04T16:12:14.333 INFO:tasks.workunit.client.0.smithi144.stderr: -481> 2024-06-04T16:12:14.050+0000 7f6cbcd3f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-06-04T16:12:14.333 INFO:tasks.workunit.client.0.smithi144.stderr: -480> 2024-06-04T16:12:14.050+0000 7f6cbcd3f800 1 librados: starting msgr at 2024-06-04T16:12:14.333 INFO:tasks.workunit.client.0.smithi144.stderr: -479> 2024-06-04T16:12:14.050+0000 7f6cbcd3f800 1 librados: starting objecter 2024-06-04T16:12:14.333 INFO:tasks.workunit.client.0.smithi144.stderr: -478> 2024-06-04T16:12:14.050+0000 7f6cbcd3f800 5 asok(0x564235270c60) register_command objecter_requests hook 0x5642354c2d30 2024-06-04T16:12:14.333 INFO:tasks.workunit.client.0.smithi144.stderr: -477> 2024-06-04T16:12:14.050+0000 7f6cbcd3f800 1 librados: setting wanted keys 2024-06-04T16:12:14.333 INFO:tasks.workunit.client.0.smithi144.stderr: -476> 2024-06-04T16:12:14.050+0000 7f6cbcd3f800 1 librados: calling monclient init 2024-06-04T16:12:14.333 INFO:tasks.workunit.client.0.smithi144.stderr: -475> 2024-06-04T16:12:14.050+0000 7f6cbcd3f800 10 monclient: init 2024-06-04T16:12:14.333 INFO:tasks.workunit.client.0.smithi144.stderr: -474> 2024-06-04T16:12:14.050+0000 7f6cbcd3f800 5 AuthRegistry(0x564235490db0) adding auth protocol: cephx 2024-06-04T16:12:14.333 INFO:tasks.workunit.client.0.smithi144.stderr: -473> 2024-06-04T16:12:14.050+0000 7f6cbcd3f800 5 AuthRegistry(0x564235490db0) adding auth protocol: cephx 2024-06-04T16:12:14.334 INFO:tasks.workunit.client.0.smithi144.stderr: -472> 2024-06-04T16:12:14.050+0000 7f6cbcd3f800 5 AuthRegistry(0x564235490db0) adding auth protocol: cephx 2024-06-04T16:12:14.334 INFO:tasks.workunit.client.0.smithi144.stderr: -471> 2024-06-04T16:12:14.050+0000 7f6cbcd3f800 5 AuthRegistry(0x564235490db0) adding con mode: secure 2024-06-04T16:12:14.334 INFO:tasks.workunit.client.0.smithi144.stderr: -470> 2024-06-04T16:12:14.050+0000 7f6cbcd3f800 5 AuthRegistry(0x564235490db0) adding con mode: crc 2024-06-04T16:12:14.334 INFO:tasks.workunit.client.0.smithi144.stderr: -469> 2024-06-04T16:12:14.050+0000 7f6cbcd3f800 5 AuthRegistry(0x564235490db0) adding con mode: secure 2024-06-04T16:12:14.334 INFO:tasks.workunit.client.0.smithi144.stderr: -468> 2024-06-04T16:12:14.050+0000 7f6cbcd3f800 5 AuthRegistry(0x564235490db0) adding con mode: crc 2024-06-04T16:12:14.334 INFO:tasks.workunit.client.0.smithi144.stderr: -467> 2024-06-04T16:12:14.050+0000 7f6cbcd3f800 5 AuthRegistry(0x564235490db0) adding con mode: secure 2024-06-04T16:12:14.334 INFO:tasks.workunit.client.0.smithi144.stderr: -466> 2024-06-04T16:12:14.050+0000 7f6cbcd3f800 5 AuthRegistry(0x564235490db0) adding con mode: crc 2024-06-04T16:12:14.334 INFO:tasks.workunit.client.0.smithi144.stderr: -465> 2024-06-04T16:12:14.050+0000 7f6cbcd3f800 5 AuthRegistry(0x564235490db0) adding con mode: crc 2024-06-04T16:12:14.334 INFO:tasks.workunit.client.0.smithi144.stderr: -464> 2024-06-04T16:12:14.050+0000 7f6cbcd3f800 5 AuthRegistry(0x564235490db0) adding con mode: secure 2024-06-04T16:12:14.334 INFO:tasks.workunit.client.0.smithi144.stderr: -463> 2024-06-04T16:12:14.050+0000 7f6cbcd3f800 5 AuthRegistry(0x564235490db0) adding con mode: crc 2024-06-04T16:12:14.334 INFO:tasks.workunit.client.0.smithi144.stderr: -462> 2024-06-04T16:12:14.050+0000 7f6cbcd3f800 5 AuthRegistry(0x564235490db0) adding con mode: secure 2024-06-04T16:12:14.334 INFO:tasks.workunit.client.0.smithi144.stderr: -461> 2024-06-04T16:12:14.050+0000 7f6cbcd3f800 5 AuthRegistry(0x564235490db0) adding con mode: crc 2024-06-04T16:12:14.335 INFO:tasks.workunit.client.0.smithi144.stderr: -460> 2024-06-04T16:12:14.050+0000 7f6cbcd3f800 5 AuthRegistry(0x564235490db0) adding con mode: secure 2024-06-04T16:12:14.335 INFO:tasks.workunit.client.0.smithi144.stderr: -459> 2024-06-04T16:12:14.050+0000 7f6cbcd3f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-06-04T16:12:14.335 INFO:tasks.workunit.client.0.smithi144.stderr: -458> 2024-06-04T16:12:14.051+0000 7f6cbcd3f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-06-04T16:12:14.335 INFO:tasks.workunit.client.0.smithi144.stderr: -457> 2024-06-04T16:12:14.051+0000 7f6cbcd3f800 5 asok(0x564235270c60) register_command rotate-key hook 0x564235490ef8 2024-06-04T16:12:14.335 INFO:tasks.workunit.client.0.smithi144.stderr: -456> 2024-06-04T16:12:14.051+0000 7f6cbcd3f800 10 monclient: _reopen_session rank -1 2024-06-04T16:12:14.335 INFO:tasks.workunit.client.0.smithi144.stderr: -455> 2024-06-04T16:12:14.051+0000 7f6cbcd3f800 10 monclient: _add_conns ranks=[0,1,2] 2024-06-04T16:12:14.335 INFO:tasks.workunit.client.0.smithi144.stderr: -454> 2024-06-04T16:12:14.051+0000 7f6cbcd3f800 10 monclient(hunting): picked mon.noname-a con 0x564235347e20 addr [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] 2024-06-04T16:12:14.335 INFO:tasks.workunit.client.0.smithi144.stderr: -453> 2024-06-04T16:12:14.051+0000 7f6cbcd3f800 10 monclient(hunting): picked mon.noname-b con 0x5642353d8080 addr [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] 2024-06-04T16:12:14.335 INFO:tasks.workunit.client.0.smithi144.stderr: -452> 2024-06-04T16:12:14.051+0000 7f6cbcd3f800 10 monclient(hunting): picked mon.noname-c con 0x564235497500 addr [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] 2024-06-04T16:12:14.335 INFO:tasks.workunit.client.0.smithi144.stderr: -451> 2024-06-04T16:12:14.051+0000 7f6cbcd3f800 10 monclient(hunting): start opening mon connection 2024-06-04T16:12:14.335 INFO:tasks.workunit.client.0.smithi144.stderr: -450> 2024-06-04T16:12:14.051+0000 7f6cbcd3f800 10 monclient(hunting): start opening mon connection 2024-06-04T16:12:14.335 INFO:tasks.workunit.client.0.smithi144.stderr: -449> 2024-06-04T16:12:14.051+0000 7f6cbcd3f800 10 monclient(hunting): start opening mon connection 2024-06-04T16:12:14.335 INFO:tasks.workunit.client.0.smithi144.stderr: -448> 2024-06-04T16:12:14.051+0000 7f6cbcd3f800 10 monclient(hunting): _renew_subs 2024-06-04T16:12:14.336 INFO:tasks.workunit.client.0.smithi144.stderr: -447> 2024-06-04T16:12:14.051+0000 7f6cbcd3f800 10 monclient(hunting): authenticate will time out at 1971.867366s 2024-06-04T16:12:14.336 INFO:tasks.workunit.client.0.smithi144.stderr: -446> 2024-06-04T16:12:14.051+0000 7f6cb8a91640 10 monclient(hunting): get_auth_request con 0x564235347e20 auth_method 0 2024-06-04T16:12:14.336 INFO:tasks.workunit.client.0.smithi144.stderr: -445> 2024-06-04T16:12:14.051+0000 7f6cb8a91640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-06-04T16:12:14.336 INFO:tasks.workunit.client.0.smithi144.stderr: -444> 2024-06-04T16:12:14.051+0000 7f6cb8a91640 10 monclient(hunting): _init_auth method 2 2024-06-04T16:12:14.336 INFO:tasks.workunit.client.0.smithi144.stderr: -443> 2024-06-04T16:12:14.051+0000 7f6cb8a91640 10 monclient(hunting): _init_auth creating new auth 2024-06-04T16:12:14.336 INFO:tasks.workunit.client.0.smithi144.stderr: -442> 2024-06-04T16:12:14.051+0000 7f6cb9292640 10 monclient(hunting): get_auth_request con 0x564235497500 auth_method 0 2024-06-04T16:12:14.336 INFO:tasks.workunit.client.0.smithi144.stderr: -441> 2024-06-04T16:12:14.051+0000 7f6cb9292640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-06-04T16:12:14.336 INFO:tasks.workunit.client.0.smithi144.stderr: -440> 2024-06-04T16:12:14.051+0000 7f6cb9292640 10 monclient(hunting): _init_auth method 2 2024-06-04T16:12:14.336 INFO:tasks.workunit.client.0.smithi144.stderr: -439> 2024-06-04T16:12:14.051+0000 7f6cb9292640 10 monclient(hunting): _init_auth creating new auth 2024-06-04T16:12:14.336 INFO:tasks.workunit.client.0.smithi144.stderr: -438> 2024-06-04T16:12:14.051+0000 7f6cb8a91640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-06-04T16:12:14.336 INFO:tasks.workunit.client.0.smithi144.stderr: -437> 2024-06-04T16:12:14.051+0000 7f6cb8a91640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-06-04T16:12:14.336 INFO:tasks.workunit.client.0.smithi144.stderr: -436> 2024-06-04T16:12:14.051+0000 7f6cb8a91640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-06-04T16:12:14.336 INFO:tasks.workunit.client.0.smithi144.stderr: -435> 2024-06-04T16:12:14.051+0000 7f6cb3fff640 10 monclient(hunting): get_auth_request con 0x5642353d8080 auth_method 0 2024-06-04T16:12:14.336 INFO:tasks.workunit.client.0.smithi144.stderr: -434> 2024-06-04T16:12:14.051+0000 7f6cb3fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-06-04T16:12:14.336 INFO:tasks.workunit.client.0.smithi144.stderr: -433> 2024-06-04T16:12:14.051+0000 7f6cb3fff640 10 monclient(hunting): _init_auth method 2 2024-06-04T16:12:14.336 INFO:tasks.workunit.client.0.smithi144.stderr: -432> 2024-06-04T16:12:14.051+0000 7f6cb3fff640 10 monclient(hunting): _init_auth creating new auth 2024-06-04T16:12:14.337 INFO:tasks.workunit.client.0.smithi144.stderr: -431> 2024-06-04T16:12:14.051+0000 7f6cb9292640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-06-04T16:12:14.337 INFO:tasks.workunit.client.0.smithi144.stderr: -430> 2024-06-04T16:12:14.051+0000 7f6cb9292640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-06-04T16:12:14.337 INFO:tasks.workunit.client.0.smithi144.stderr: -429> 2024-06-04T16:12:14.051+0000 7f6cb9292640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-06-04T16:12:14.337 INFO:tasks.workunit.client.0.smithi144.stderr: -428> 2024-06-04T16:12:14.051+0000 7f6cb3fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-06-04T16:12:14.337 INFO:tasks.workunit.client.0.smithi144.stderr: -427> 2024-06-04T16:12:14.051+0000 7f6cb3fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-06-04T16:12:14.337 INFO:tasks.workunit.client.0.smithi144.stderr: -426> 2024-06-04T16:12:14.051+0000 7f6cb3fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-06-04T16:12:14.337 INFO:tasks.workunit.client.0.smithi144.stderr: -425> 2024-06-04T16:12:14.051+0000 7f6cb8a91640 10 monclient(hunting): handle_auth_done global_id 6474 payload 824 2024-06-04T16:12:14.337 INFO:tasks.workunit.client.0.smithi144.stderr: -424> 2024-06-04T16:12:14.051+0000 7f6cb8a91640 10 monclient: _finish_hunting 0 2024-06-04T16:12:14.337 INFO:tasks.workunit.client.0.smithi144.stderr: -423> 2024-06-04T16:12:14.051+0000 7f6cb8a91640 1 monclient: found mon.noname-a 2024-06-04T16:12:14.337 INFO:tasks.workunit.client.0.smithi144.stderr: -422> 2024-06-04T16:12:14.051+0000 7f6cb8a91640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.144:3300/0 2024-06-04T16:12:14.337 INFO:tasks.workunit.client.0.smithi144.stderr: -421> 2024-06-04T16:12:14.051+0000 7f6ba5602640 10 monclient: handle_monmap mon_map magic: 0 2024-06-04T16:12:14.337 INFO:tasks.workunit.client.0.smithi144.stderr: -420> 2024-06-04T16:12:14.051+0000 7f6ba5602640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-06-04T16:12:14.337 INFO:tasks.workunit.client.0.smithi144.stderr: -419> 2024-06-04T16:12:14.051+0000 7f6ba5602640 10 monclient: dump: 2024-06-04T16:12:14.337 INFO:tasks.workunit.client.0.smithi144.stderr:epoch 1 2024-06-04T16:12:14.337 INFO:tasks.workunit.client.0.smithi144.stderr:fsid 15e56bb1-4856-42f3-b6db-a2c8f23c5557 2024-06-04T16:12:14.337 INFO:tasks.workunit.client.0.smithi144.stderr:last_changed 2024-06-04T15:51:29.789359+0000 2024-06-04T16:12:14.338 INFO:tasks.workunit.client.0.smithi144.stderr:created 2024-06-04T15:51:29.789359+0000 2024-06-04T16:12:14.338 INFO:tasks.workunit.client.0.smithi144.stderr:min_mon_release 19 (squid) 2024-06-04T16:12:14.338 INFO:tasks.workunit.client.0.smithi144.stderr:election_strategy: 1 2024-06-04T16:12:14.338 INFO:tasks.workunit.client.0.smithi144.stderr:0: [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] mon.a 2024-06-04T16:12:14.338 INFO:tasks.workunit.client.0.smithi144.stderr:1: [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] mon.b 2024-06-04T16:12:14.338 INFO:tasks.workunit.client.0.smithi144.stderr:2: [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] mon.c 2024-06-04T16:12:14.338 INFO:tasks.workunit.client.0.smithi144.stderr: 2024-06-04T16:12:14.338 INFO:tasks.workunit.client.0.smithi144.stderr: -418> 2024-06-04T16:12:14.051+0000 7f6ba5602640 10 monclient: _finish_auth 0 2024-06-04T16:12:14.338 INFO:tasks.workunit.client.0.smithi144.stderr: -417> 2024-06-04T16:12:14.051+0000 7f6ba5602640 10 monclient: _check_auth_tickets 2024-06-04T16:12:14.338 INFO:tasks.workunit.client.0.smithi144.stderr: -416> 2024-06-04T16:12:14.051+0000 7f6ba5602640 10 monclient: handle_config config(0 keys) 2024-06-04T16:12:14.338 INFO:tasks.workunit.client.0.smithi144.stderr: -415> 2024-06-04T16:12:14.051+0000 7f6ba5602640 10 monclient: handle_monmap mon_map magic: 0 2024-06-04T16:12:14.338 INFO:tasks.workunit.client.0.smithi144.stderr: -414> 2024-06-04T16:12:14.051+0000 7f6ba5602640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-06-04T16:12:14.338 INFO:tasks.workunit.client.0.smithi144.stderr: -413> 2024-06-04T16:12:14.051+0000 7f6ba5602640 10 monclient: dump: 2024-06-04T16:12:14.338 INFO:tasks.workunit.client.0.smithi144.stderr:epoch 1 2024-06-04T16:12:14.339 INFO:tasks.workunit.client.0.smithi144.stderr:fsid 15e56bb1-4856-42f3-b6db-a2c8f23c5557 2024-06-04T16:12:14.339 INFO:tasks.workunit.client.0.smithi144.stderr:last_changed 2024-06-04T15:51:29.789359+0000 2024-06-04T16:12:14.339 INFO:tasks.workunit.client.0.smithi144.stderr:created 2024-06-04T15:51:29.789359+0000 2024-06-04T16:12:14.339 INFO:tasks.workunit.client.0.smithi144.stderr:min_mon_release 19 (squid) 2024-06-04T16:12:14.339 INFO:tasks.workunit.client.0.smithi144.stderr:election_strategy: 1 2024-06-04T16:12:14.339 INFO:tasks.workunit.client.0.smithi144.stderr:0: [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] mon.a 2024-06-04T16:12:14.339 INFO:tasks.workunit.client.0.smithi144.stderr:1: [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] mon.b 2024-06-04T16:12:14.339 INFO:tasks.workunit.client.0.smithi144.stderr:2: [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] mon.c 2024-06-04T16:12:14.339 INFO:tasks.workunit.client.0.smithi144.stderr: 2024-06-04T16:12:14.339 INFO:tasks.workunit.client.0.smithi144.stderr: -412> 2024-06-04T16:12:14.051+0000 7f6cbcd3f800 5 monclient: authenticate success, global_id 6474 2024-06-04T16:12:14.339 INFO:tasks.workunit.client.0.smithi144.stderr: -411> 2024-06-04T16:12:14.051+0000 7f6cbcd3f800 10 monclient: _renew_subs 2024-06-04T16:12:14.339 INFO:tasks.workunit.client.0.smithi144.stderr: -410> 2024-06-04T16:12:14.051+0000 7f6cbcd3f800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.144:3300/0 2024-06-04T16:12:14.339 INFO:tasks.workunit.client.0.smithi144.stderr: -409> 2024-06-04T16:12:14.051+0000 7f6ba6e05640 4 set_mon_vals no callback set 2024-06-04T16:12:14.339 INFO:tasks.workunit.client.0.smithi144.stderr: -408> 2024-06-04T16:12:14.051+0000 7f6cbcd3f800 10 monclient: _renew_subs 2024-06-04T16:12:14.339 INFO:tasks.workunit.client.0.smithi144.stderr: -407> 2024-06-04T16:12:14.051+0000 7f6cbcd3f800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.144:3300/0 2024-06-04T16:12:14.340 INFO:tasks.workunit.client.0.smithi144.stderr: -406> 2024-06-04T16:12:14.051+0000 7f6cbcd3f800 1 librados: init done 2024-06-04T16:12:14.340 INFO:tasks.workunit.client.0.smithi144.stderr: -405> 2024-06-04T16:12:14.053+0000 7f6ba5602640 4 mgrc handle_mgr_map Got map version 5 2024-06-04T16:12:14.340 INFO:tasks.workunit.client.0.smithi144.stderr: -404> 2024-06-04T16:12:14.053+0000 7f6ba5602640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.177:6832/2645786330,v1:172.21.15.177:6833/2645786330] 2024-06-04T16:12:14.340 INFO:tasks.workunit.client.0.smithi144.stderr: -403> 2024-06-04T16:12:14.053+0000 7f6ba5602640 4 mgrc reconnect Starting new session with [v2:172.21.15.177:6832/2645786330,v1:172.21.15.177:6833/2645786330] 2024-06-04T16:12:14.340 INFO:tasks.workunit.client.0.smithi144.stderr: -402> 2024-06-04T16:12:14.054+0000 7f6cb3fff640 10 monclient: get_auth_request con 0x7f6ba0074ce0 auth_method 0 2024-06-04T16:12:14.340 INFO:tasks.workunit.client.0.smithi144.stderr: -401> 2024-06-04T16:12:14.054+0000 7f6cb9292640 10 monclient: get_auth_request con 0x5642354b9790 auth_method 0 2024-06-04T16:12:14.340 INFO:tasks.workunit.client.0.smithi144.stderr: -400> 2024-06-04T16:12:14.055+0000 7f6cb8a91640 10 monclient: get_auth_request con 0x5642354dc390 auth_method 0 2024-06-04T16:12:14.340 INFO:tasks.workunit.client.0.smithi144.stderr: -399> 2024-06-04T16:12:14.055+0000 7f6cb3fff640 10 monclient: get_auth_request con 0x5642354e0580 auth_method 0 2024-06-04T16:12:14.340 INFO:tasks.workunit.client.0.smithi144.stderr: -398> 2024-06-04T16:12:14.056+0000 7f6cb9292640 10 monclient: get_auth_request con 0x5642354dfc10 auth_method 0 2024-06-04T16:12:14.340 INFO:tasks.workunit.client.0.smithi144.stderr: -397> 2024-06-04T16:12:14.057+0000 7f6cbcd3f800 10 monclient: build_initial_monmap 2024-06-04T16:12:14.340 INFO:tasks.workunit.client.0.smithi144.stderr: -396> 2024-06-04T16:12:14.057+0000 7f6cbcd3f800 1 build_initial for_mkfs: 0 2024-06-04T16:12:14.340 INFO:tasks.workunit.client.0.smithi144.stderr: -395> 2024-06-04T16:12:14.057+0000 7f6cbcd3f800 10 monclient: monmap: 2024-06-04T16:12:14.340 INFO:tasks.workunit.client.0.smithi144.stderr:epoch 0 2024-06-04T16:12:14.340 INFO:tasks.workunit.client.0.smithi144.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-06-04T16:12:14.341 INFO:tasks.workunit.client.0.smithi144.stderr:last_changed 0.000000 2024-06-04T16:12:14.341 INFO:tasks.workunit.client.0.smithi144.stderr:created 0.000000 2024-06-04T16:12:14.341 INFO:tasks.workunit.client.0.smithi144.stderr:min_mon_release 0 (unknown) 2024-06-04T16:12:14.341 INFO:tasks.workunit.client.0.smithi144.stderr:election_strategy: 1 2024-06-04T16:12:14.341 INFO:tasks.workunit.client.0.smithi144.stderr:0: [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] mon.noname-a 2024-06-04T16:12:14.341 INFO:tasks.workunit.client.0.smithi144.stderr:1: [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] mon.noname-b 2024-06-04T16:12:14.341 INFO:tasks.workunit.client.0.smithi144.stderr:2: [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] mon.noname-c 2024-06-04T16:12:14.341 INFO:tasks.workunit.client.0.smithi144.stderr: 2024-06-04T16:12:14.341 INFO:tasks.workunit.client.0.smithi144.stderr: -394> 2024-06-04T16:12:14.057+0000 7f6cbcd3f800 5 AuthRegistry(0x5642354e8600) adding auth protocol: cephx 2024-06-04T16:12:14.341 INFO:tasks.workunit.client.0.smithi144.stderr: -393> 2024-06-04T16:12:14.057+0000 7f6cbcd3f800 5 AuthRegistry(0x5642354e8600) adding auth protocol: cephx 2024-06-04T16:12:14.341 INFO:tasks.workunit.client.0.smithi144.stderr: -392> 2024-06-04T16:12:14.057+0000 7f6cbcd3f800 5 AuthRegistry(0x5642354e8600) adding auth protocol: cephx 2024-06-04T16:12:14.341 INFO:tasks.workunit.client.0.smithi144.stderr: -391> 2024-06-04T16:12:14.057+0000 7f6cbcd3f800 5 AuthRegistry(0x5642354e8600) adding con mode: secure 2024-06-04T16:12:14.341 INFO:tasks.workunit.client.0.smithi144.stderr: -390> 2024-06-04T16:12:14.057+0000 7f6cbcd3f800 5 AuthRegistry(0x5642354e8600) adding con mode: crc 2024-06-04T16:12:14.342 INFO:tasks.workunit.client.0.smithi144.stderr: -389> 2024-06-04T16:12:14.057+0000 7f6cbcd3f800 5 AuthRegistry(0x5642354e8600) adding con mode: secure 2024-06-04T16:12:14.342 INFO:tasks.workunit.client.0.smithi144.stderr: -388> 2024-06-04T16:12:14.057+0000 7f6cbcd3f800 5 AuthRegistry(0x5642354e8600) adding con mode: crc 2024-06-04T16:12:14.342 INFO:tasks.workunit.client.0.smithi144.stderr: -387> 2024-06-04T16:12:14.057+0000 7f6cbcd3f800 5 AuthRegistry(0x5642354e8600) adding con mode: secure 2024-06-04T16:12:14.342 INFO:tasks.workunit.client.0.smithi144.stderr: -386> 2024-06-04T16:12:14.057+0000 7f6cbcd3f800 5 AuthRegistry(0x5642354e8600) adding con mode: crc 2024-06-04T16:12:14.342 INFO:tasks.workunit.client.0.smithi144.stderr: -385> 2024-06-04T16:12:14.057+0000 7f6cbcd3f800 5 AuthRegistry(0x5642354e8600) adding con mode: crc 2024-06-04T16:12:14.342 INFO:tasks.workunit.client.0.smithi144.stderr: -384> 2024-06-04T16:12:14.057+0000 7f6cbcd3f800 5 AuthRegistry(0x5642354e8600) adding con mode: secure 2024-06-04T16:12:14.342 INFO:tasks.workunit.client.0.smithi144.stderr: -383> 2024-06-04T16:12:14.057+0000 7f6cbcd3f800 5 AuthRegistry(0x5642354e8600) adding con mode: crc 2024-06-04T16:12:14.342 INFO:tasks.workunit.client.0.smithi144.stderr: -382> 2024-06-04T16:12:14.057+0000 7f6cbcd3f800 5 AuthRegistry(0x5642354e8600) adding con mode: secure 2024-06-04T16:12:14.342 INFO:tasks.workunit.client.0.smithi144.stderr: -381> 2024-06-04T16:12:14.057+0000 7f6cbcd3f800 5 AuthRegistry(0x5642354e8600) adding con mode: crc 2024-06-04T16:12:14.342 INFO:tasks.workunit.client.0.smithi144.stderr: -380> 2024-06-04T16:12:14.057+0000 7f6cbcd3f800 5 AuthRegistry(0x5642354e8600) adding con mode: secure 2024-06-04T16:12:14.342 INFO:tasks.workunit.client.0.smithi144.stderr: -379> 2024-06-04T16:12:14.057+0000 7f6cbcd3f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-06-04T16:12:14.342 INFO:tasks.workunit.client.0.smithi144.stderr: -378> 2024-06-04T16:12:14.057+0000 7f6cbcd3f800 5 asok(0x564235270c60) register_command objecter_requests cmddesc objecter_requests hook 0x5642354e4170 EEXIST 2024-06-04T16:12:14.342 INFO:tasks.workunit.client.0.smithi144.stderr: -377> 2024-06-04T16:12:14.058+0000 7f6cbcd3f800 10 monclient: init 2024-06-04T16:12:14.342 INFO:tasks.workunit.client.0.smithi144.stderr: -376> 2024-06-04T16:12:14.058+0000 7f6cbcd3f800 5 AuthRegistry(0x5642354e74f8) adding auth protocol: cephx 2024-06-04T16:12:14.343 INFO:tasks.workunit.client.0.smithi144.stderr: -375> 2024-06-04T16:12:14.058+0000 7f6cbcd3f800 5 AuthRegistry(0x5642354e74f8) adding auth protocol: cephx 2024-06-04T16:12:14.343 INFO:tasks.workunit.client.0.smithi144.stderr: -374> 2024-06-04T16:12:14.058+0000 7f6cbcd3f800 5 AuthRegistry(0x5642354e74f8) adding auth protocol: cephx 2024-06-04T16:12:14.343 INFO:tasks.workunit.client.0.smithi144.stderr: -373> 2024-06-04T16:12:14.058+0000 7f6cbcd3f800 5 AuthRegistry(0x5642354e74f8) adding con mode: secure 2024-06-04T16:12:14.343 INFO:tasks.workunit.client.0.smithi144.stderr: -372> 2024-06-04T16:12:14.058+0000 7f6cbcd3f800 5 AuthRegistry(0x5642354e74f8) adding con mode: crc 2024-06-04T16:12:14.343 INFO:tasks.workunit.client.0.smithi144.stderr: -371> 2024-06-04T16:12:14.058+0000 7f6cbcd3f800 5 AuthRegistry(0x5642354e74f8) adding con mode: secure 2024-06-04T16:12:14.343 INFO:tasks.workunit.client.0.smithi144.stderr: -370> 2024-06-04T16:12:14.058+0000 7f6cbcd3f800 5 AuthRegistry(0x5642354e74f8) adding con mode: crc 2024-06-04T16:12:14.343 INFO:tasks.workunit.client.0.smithi144.stderr: -369> 2024-06-04T16:12:14.058+0000 7f6cbcd3f800 5 AuthRegistry(0x5642354e74f8) adding con mode: secure 2024-06-04T16:12:14.343 INFO:tasks.workunit.client.0.smithi144.stderr: -368> 2024-06-04T16:12:14.058+0000 7f6cbcd3f800 5 AuthRegistry(0x5642354e74f8) adding con mode: crc 2024-06-04T16:12:14.343 INFO:tasks.workunit.client.0.smithi144.stderr: -367> 2024-06-04T16:12:14.058+0000 7f6cbcd3f800 5 AuthRegistry(0x5642354e74f8) adding con mode: crc 2024-06-04T16:12:14.343 INFO:tasks.workunit.client.0.smithi144.stderr: -366> 2024-06-04T16:12:14.058+0000 7f6cbcd3f800 5 AuthRegistry(0x5642354e74f8) adding con mode: secure 2024-06-04T16:12:14.343 INFO:tasks.workunit.client.0.smithi144.stderr: -365> 2024-06-04T16:12:14.058+0000 7f6cbcd3f800 5 AuthRegistry(0x5642354e74f8) adding con mode: crc 2024-06-04T16:12:14.343 INFO:tasks.workunit.client.0.smithi144.stderr: -364> 2024-06-04T16:12:14.058+0000 7f6cbcd3f800 5 AuthRegistry(0x5642354e74f8) adding con mode: secure 2024-06-04T16:12:14.343 INFO:tasks.workunit.client.0.smithi144.stderr: -363> 2024-06-04T16:12:14.058+0000 7f6cbcd3f800 5 AuthRegistry(0x5642354e74f8) adding con mode: crc 2024-06-04T16:12:14.344 INFO:tasks.workunit.client.0.smithi144.stderr: -362> 2024-06-04T16:12:14.058+0000 7f6cbcd3f800 5 AuthRegistry(0x5642354e74f8) adding con mode: secure 2024-06-04T16:12:14.344 INFO:tasks.workunit.client.0.smithi144.stderr: -361> 2024-06-04T16:12:14.058+0000 7f6cbcd3f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-06-04T16:12:14.344 INFO:tasks.workunit.client.0.smithi144.stderr: -360> 2024-06-04T16:12:14.058+0000 7f6cbcd3f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-06-04T16:12:14.344 INFO:tasks.workunit.client.0.smithi144.stderr: -359> 2024-06-04T16:12:14.058+0000 7f6cbcd3f800 5 asok(0x564235270c60) register_command rotate-key cmddesc rotate-key hook 0x5642354e7640 EEXIST 2024-06-04T16:12:14.344 INFO:tasks.workunit.client.0.smithi144.stderr: -358> 2024-06-04T16:12:14.058+0000 7f6cbcd3f800 10 monclient: _reopen_session rank -1 2024-06-04T16:12:14.344 INFO:tasks.workunit.client.0.smithi144.stderr: -357> 2024-06-04T16:12:14.058+0000 7f6cbcd3f800 10 monclient: _add_conns ranks=[2,0,1] 2024-06-04T16:12:14.344 INFO:tasks.workunit.client.0.smithi144.stderr: -356> 2024-06-04T16:12:14.058+0000 7f6cbcd3f800 10 monclient(hunting): picked mon.noname-c con 0x5642354f3f10 addr [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] 2024-06-04T16:12:14.344 INFO:tasks.workunit.client.0.smithi144.stderr: -355> 2024-06-04T16:12:14.058+0000 7f6cbcd3f800 10 monclient(hunting): picked mon.noname-a con 0x5642354f42f0 addr [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] 2024-06-04T16:12:14.344 INFO:tasks.workunit.client.0.smithi144.stderr: -354> 2024-06-04T16:12:14.058+0000 7f6cbcd3f800 10 monclient(hunting): picked mon.noname-b con 0x564235516640 addr [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] 2024-06-04T16:12:14.344 INFO:tasks.workunit.client.0.smithi144.stderr: -353> 2024-06-04T16:12:14.058+0000 7f6cbcd3f800 10 monclient(hunting): start opening mon connection 2024-06-04T16:12:14.344 INFO:tasks.workunit.client.0.smithi144.stderr: -352> 2024-06-04T16:12:14.058+0000 7f6cbcd3f800 10 monclient(hunting): start opening mon connection 2024-06-04T16:12:14.344 INFO:tasks.workunit.client.0.smithi144.stderr: -351> 2024-06-04T16:12:14.058+0000 7f6cbcd3f800 10 monclient(hunting): start opening mon connection 2024-06-04T16:12:14.344 INFO:tasks.workunit.client.0.smithi144.stderr: -350> 2024-06-04T16:12:14.058+0000 7f6cbcd3f800 10 monclient(hunting): _renew_subs 2024-06-04T16:12:14.345 INFO:tasks.workunit.client.0.smithi144.stderr: -349> 2024-06-04T16:12:14.058+0000 7f6cbcd3f800 10 monclient(hunting): authenticate will time out at 1971.874677s 2024-06-04T16:12:14.345 INFO:tasks.workunit.client.0.smithi144.stderr: -348> 2024-06-04T16:12:14.058+0000 7f6cb3fff640 10 monclient(hunting): get_auth_request con 0x5642354f3f10 auth_method 0 2024-06-04T16:12:14.345 INFO:tasks.workunit.client.0.smithi144.stderr: -347> 2024-06-04T16:12:14.058+0000 7f6cb3fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-06-04T16:12:14.345 INFO:tasks.workunit.client.0.smithi144.stderr: -346> 2024-06-04T16:12:14.058+0000 7f6cb3fff640 10 monclient(hunting): _init_auth method 2 2024-06-04T16:12:14.345 INFO:tasks.workunit.client.0.smithi144.stderr: -345> 2024-06-04T16:12:14.058+0000 7f6cb3fff640 10 monclient(hunting): _init_auth creating new auth 2024-06-04T16:12:14.345 INFO:tasks.workunit.client.0.smithi144.stderr: -344> 2024-06-04T16:12:14.058+0000 7f6cb9292640 10 monclient(hunting): get_auth_request con 0x5642354f42f0 auth_method 0 2024-06-04T16:12:14.345 INFO:tasks.workunit.client.0.smithi144.stderr: -343> 2024-06-04T16:12:14.058+0000 7f6cb9292640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-06-04T16:12:14.345 INFO:tasks.workunit.client.0.smithi144.stderr: -342> 2024-06-04T16:12:14.058+0000 7f6cb9292640 10 monclient(hunting): _init_auth method 2 2024-06-04T16:12:14.345 INFO:tasks.workunit.client.0.smithi144.stderr: -341> 2024-06-04T16:12:14.058+0000 7f6cb9292640 10 monclient(hunting): _init_auth creating new auth 2024-06-04T16:12:14.345 INFO:tasks.workunit.client.0.smithi144.stderr: -340> 2024-06-04T16:12:14.058+0000 7f6cb3fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-06-04T16:12:14.345 INFO:tasks.workunit.client.0.smithi144.stderr: -339> 2024-06-04T16:12:14.058+0000 7f6cb3fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-06-04T16:12:14.345 INFO:tasks.workunit.client.0.smithi144.stderr: -338> 2024-06-04T16:12:14.058+0000 7f6cb3fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-06-04T16:12:14.345 INFO:tasks.workunit.client.0.smithi144.stderr: -337> 2024-06-04T16:12:14.058+0000 7f6cb9292640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-06-04T16:12:14.345 INFO:tasks.workunit.client.0.smithi144.stderr: -336> 2024-06-04T16:12:14.058+0000 7f6cb9292640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-06-04T16:12:14.345 INFO:tasks.workunit.client.0.smithi144.stderr: -335> 2024-06-04T16:12:14.058+0000 7f6cb9292640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-06-04T16:12:14.346 INFO:tasks.workunit.client.0.smithi144.stderr: -334> 2024-06-04T16:12:14.058+0000 7f6cb8a91640 10 monclient(hunting): get_auth_request con 0x564235516640 auth_method 0 2024-06-04T16:12:14.346 INFO:tasks.workunit.client.0.smithi144.stderr: -333> 2024-06-04T16:12:14.058+0000 7f6cb8a91640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-06-04T16:12:14.346 INFO:tasks.workunit.client.0.smithi144.stderr: -332> 2024-06-04T16:12:14.058+0000 7f6cb8a91640 10 monclient(hunting): _init_auth method 2 2024-06-04T16:12:14.346 INFO:tasks.workunit.client.0.smithi144.stderr: -331> 2024-06-04T16:12:14.058+0000 7f6cb8a91640 10 monclient(hunting): _init_auth creating new auth 2024-06-04T16:12:14.346 INFO:tasks.workunit.client.0.smithi144.stderr: -330> 2024-06-04T16:12:14.058+0000 7f6cb8a91640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-06-04T16:12:14.346 INFO:tasks.workunit.client.0.smithi144.stderr: -329> 2024-06-04T16:12:14.058+0000 7f6cb8a91640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-06-04T16:12:14.346 INFO:tasks.workunit.client.0.smithi144.stderr: -328> 2024-06-04T16:12:14.058+0000 7f6cb8a91640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-06-04T16:12:14.346 INFO:tasks.workunit.client.0.smithi144.stderr: -327> 2024-06-04T16:12:14.058+0000 7f6cb3fff640 10 monclient(hunting): handle_auth_done global_id 6158 payload 824 2024-06-04T16:12:14.346 INFO:tasks.workunit.client.0.smithi144.stderr: -326> 2024-06-04T16:12:14.058+0000 7f6cb3fff640 10 monclient: _finish_hunting 0 2024-06-04T16:12:14.346 INFO:tasks.workunit.client.0.smithi144.stderr: -325> 2024-06-04T16:12:14.058+0000 7f6cb3fff640 1 monclient: found mon.noname-c 2024-06-04T16:12:14.346 INFO:tasks.workunit.client.0.smithi144.stderr: -324> 2024-06-04T16:12:14.058+0000 7f6cb3fff640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.144:3301/0 2024-06-04T16:12:14.346 INFO:tasks.workunit.client.0.smithi144.stderr: -323> 2024-06-04T16:12:14.059+0000 7f6b9e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-06-04T16:12:14.346 INFO:tasks.workunit.client.0.smithi144.stderr: -322> 2024-06-04T16:12:14.059+0000 7f6b9e7fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-06-04T16:12:14.347 INFO:tasks.workunit.client.0.smithi144.stderr: -321> 2024-06-04T16:12:14.059+0000 7f6b9e7fc640 10 monclient: dump: 2024-06-04T16:12:14.347 INFO:tasks.workunit.client.0.smithi144.stderr:epoch 1 2024-06-04T16:12:14.347 INFO:tasks.workunit.client.0.smithi144.stderr:fsid 15e56bb1-4856-42f3-b6db-a2c8f23c5557 2024-06-04T16:12:14.347 INFO:tasks.workunit.client.0.smithi144.stderr:last_changed 2024-06-04T15:51:29.789359+0000 2024-06-04T16:12:14.347 INFO:tasks.workunit.client.0.smithi144.stderr:created 2024-06-04T15:51:29.789359+0000 2024-06-04T16:12:14.347 INFO:tasks.workunit.client.0.smithi144.stderr:min_mon_release 19 (squid) 2024-06-04T16:12:14.347 INFO:tasks.workunit.client.0.smithi144.stderr:election_strategy: 1 2024-06-04T16:12:14.347 INFO:tasks.workunit.client.0.smithi144.stderr:0: [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] mon.a 2024-06-04T16:12:14.347 INFO:tasks.workunit.client.0.smithi144.stderr:1: [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] mon.b 2024-06-04T16:12:14.347 INFO:tasks.workunit.client.0.smithi144.stderr:2: [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] mon.c 2024-06-04T16:12:14.347 INFO:tasks.workunit.client.0.smithi144.stderr: 2024-06-04T16:12:14.347 INFO:tasks.workunit.client.0.smithi144.stderr: -320> 2024-06-04T16:12:14.059+0000 7f6b9e7fc640 10 monclient: _finish_auth 0 2024-06-04T16:12:14.347 INFO:tasks.workunit.client.0.smithi144.stderr: -319> 2024-06-04T16:12:14.059+0000 7f6b9e7fc640 10 monclient: _check_auth_tickets 2024-06-04T16:12:14.347 INFO:tasks.workunit.client.0.smithi144.stderr: -318> 2024-06-04T16:12:14.059+0000 7f6b9e7fc640 10 monclient: handle_config config(0 keys) 2024-06-04T16:12:14.348 INFO:tasks.workunit.client.0.smithi144.stderr: -317> 2024-06-04T16:12:14.059+0000 7f6b9e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-06-04T16:12:14.348 INFO:tasks.workunit.client.0.smithi144.stderr: -316> 2024-06-04T16:12:14.059+0000 7f6b9e7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-06-04T16:12:14.348 INFO:tasks.workunit.client.0.smithi144.stderr: -315> 2024-06-04T16:12:14.059+0000 7f6b9e7fc640 10 monclient: dump: 2024-06-04T16:12:14.348 INFO:tasks.workunit.client.0.smithi144.stderr:epoch 1 2024-06-04T16:12:14.348 INFO:tasks.workunit.client.0.smithi144.stderr:fsid 15e56bb1-4856-42f3-b6db-a2c8f23c5557 2024-06-04T16:12:14.348 INFO:tasks.workunit.client.0.smithi144.stderr:last_changed 2024-06-04T15:51:29.789359+0000 2024-06-04T16:12:14.348 INFO:tasks.workunit.client.0.smithi144.stderr:created 2024-06-04T15:51:29.789359+0000 2024-06-04T16:12:14.348 INFO:tasks.workunit.client.0.smithi144.stderr:min_mon_release 19 (squid) 2024-06-04T16:12:14.348 INFO:tasks.workunit.client.0.smithi144.stderr:election_strategy: 1 2024-06-04T16:12:14.348 INFO:tasks.workunit.client.0.smithi144.stderr:0: [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] mon.a 2024-06-04T16:12:14.348 INFO:tasks.workunit.client.0.smithi144.stderr:1: [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] mon.b 2024-06-04T16:12:14.348 INFO:tasks.workunit.client.0.smithi144.stderr:2: [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] mon.c 2024-06-04T16:12:14.348 INFO:tasks.workunit.client.0.smithi144.stderr: 2024-06-04T16:12:14.348 INFO:tasks.workunit.client.0.smithi144.stderr: -314> 2024-06-04T16:12:14.059+0000 7f6cbcd3f800 5 monclient: authenticate success, global_id 6158 2024-06-04T16:12:14.348 INFO:tasks.workunit.client.0.smithi144.stderr: -313> 2024-06-04T16:12:14.059+0000 7f6cbcd3f800 10 monclient: _renew_subs 2024-06-04T16:12:14.349 INFO:tasks.workunit.client.0.smithi144.stderr: -312> 2024-06-04T16:12:14.059+0000 7f6cb9a93640 4 set_mon_vals no callback set 2024-06-04T16:12:14.349 INFO:tasks.workunit.client.0.smithi144.stderr: -311> 2024-06-04T16:12:14.059+0000 7f6cbcd3f800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.144:3301/0 2024-06-04T16:12:14.349 INFO:tasks.workunit.client.0.smithi144.stderr: -310> 2024-06-04T16:12:14.059+0000 7f6cbcd3f800 10 monclient: _renew_subs 2024-06-04T16:12:14.349 INFO:tasks.workunit.client.0.smithi144.stderr: -309> 2024-06-04T16:12:14.059+0000 7f6cbcd3f800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.144:3301/0 2024-06-04T16:12:14.349 INFO:tasks.workunit.client.0.smithi144.stderr: -308> 2024-06-04T16:12:14.060+0000 7f6b9e7fc640 4 mgrc handle_mgr_map Got map version 5 2024-06-04T16:12:14.349 INFO:tasks.workunit.client.0.smithi144.stderr: -307> 2024-06-04T16:12:14.060+0000 7f6b9e7fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.177:6832/2645786330,v1:172.21.15.177:6833/2645786330] 2024-06-04T16:12:14.349 INFO:tasks.workunit.client.0.smithi144.stderr: -306> 2024-06-04T16:12:14.060+0000 7f6b9e7fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.177:6832/2645786330,v1:172.21.15.177:6833/2645786330] 2024-06-04T16:12:14.349 INFO:tasks.workunit.client.0.smithi144.stderr: -305> 2024-06-04T16:12:14.061+0000 7f6cb9292640 10 monclient: get_auth_request con 0x7f6b90074bc0 auth_method 0 2024-06-04T16:12:14.349 INFO:tasks.workunit.client.0.smithi144.stderr: -304> 2024-06-04T16:12:14.061+0000 7f6cbcd3f800 10 monclient: get_monmap_and_config 2024-06-04T16:12:14.349 INFO:tasks.workunit.client.0.smithi144.stderr: -303> 2024-06-04T16:12:14.061+0000 7f6cbcd3f800 10 monclient: build_initial_monmap 2024-06-04T16:12:14.349 INFO:tasks.workunit.client.0.smithi144.stderr: -302> 2024-06-04T16:12:14.061+0000 7f6cbcd3f800 1 build_initial for_mkfs: 0 2024-06-04T16:12:14.349 INFO:tasks.workunit.client.0.smithi144.stderr: -301> 2024-06-04T16:12:14.061+0000 7f6cbcd3f800 10 monclient: monmap: 2024-06-04T16:12:14.349 INFO:tasks.workunit.client.0.smithi144.stderr:epoch 0 2024-06-04T16:12:14.349 INFO:tasks.workunit.client.0.smithi144.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-06-04T16:12:14.349 INFO:tasks.workunit.client.0.smithi144.stderr:last_changed 0.000000 2024-06-04T16:12:14.350 INFO:tasks.workunit.client.0.smithi144.stderr:created 0.000000 2024-06-04T16:12:14.350 INFO:tasks.workunit.client.0.smithi144.stderr:min_mon_release 0 (unknown) 2024-06-04T16:12:14.350 INFO:tasks.workunit.client.0.smithi144.stderr:election_strategy: 1 2024-06-04T16:12:14.350 INFO:tasks.workunit.client.0.smithi144.stderr:0: [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] mon.noname-a 2024-06-04T16:12:14.350 INFO:tasks.workunit.client.0.smithi144.stderr:1: [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] mon.noname-b 2024-06-04T16:12:14.350 INFO:tasks.workunit.client.0.smithi144.stderr:2: [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] mon.noname-c 2024-06-04T16:12:14.350 INFO:tasks.workunit.client.0.smithi144.stderr: 2024-06-04T16:12:14.350 INFO:tasks.workunit.client.0.smithi144.stderr: -300> 2024-06-04T16:12:14.061+0000 7f6cbcd3f800 5 AuthRegistry(0x564235530bb0) adding auth protocol: cephx 2024-06-04T16:12:14.350 INFO:tasks.workunit.client.0.smithi144.stderr: -299> 2024-06-04T16:12:14.061+0000 7f6cbcd3f800 5 AuthRegistry(0x564235530bb0) adding auth protocol: cephx 2024-06-04T16:12:14.350 INFO:tasks.workunit.client.0.smithi144.stderr: -298> 2024-06-04T16:12:14.061+0000 7f6cbcd3f800 5 AuthRegistry(0x564235530bb0) adding auth protocol: cephx 2024-06-04T16:12:14.350 INFO:tasks.workunit.client.0.smithi144.stderr: -297> 2024-06-04T16:12:14.061+0000 7f6cbcd3f800 5 AuthRegistry(0x564235530bb0) adding con mode: secure 2024-06-04T16:12:14.350 INFO:tasks.workunit.client.0.smithi144.stderr: -296> 2024-06-04T16:12:14.061+0000 7f6cbcd3f800 5 AuthRegistry(0x564235530bb0) adding con mode: crc 2024-06-04T16:12:14.350 INFO:tasks.workunit.client.0.smithi144.stderr: -295> 2024-06-04T16:12:14.061+0000 7f6cbcd3f800 5 AuthRegistry(0x564235530bb0) adding con mode: secure 2024-06-04T16:12:14.351 INFO:tasks.workunit.client.0.smithi144.stderr: -294> 2024-06-04T16:12:14.061+0000 7f6cbcd3f800 5 AuthRegistry(0x564235530bb0) adding con mode: crc 2024-06-04T16:12:14.351 INFO:tasks.workunit.client.0.smithi144.stderr: -293> 2024-06-04T16:12:14.061+0000 7f6cbcd3f800 5 AuthRegistry(0x564235530bb0) adding con mode: secure 2024-06-04T16:12:14.351 INFO:tasks.workunit.client.0.smithi144.stderr: -292> 2024-06-04T16:12:14.061+0000 7f6cbcd3f800 5 AuthRegistry(0x564235530bb0) adding con mode: crc 2024-06-04T16:12:14.351 INFO:tasks.workunit.client.0.smithi144.stderr: -291> 2024-06-04T16:12:14.061+0000 7f6cbcd3f800 5 AuthRegistry(0x564235530bb0) adding con mode: crc 2024-06-04T16:12:14.351 INFO:tasks.workunit.client.0.smithi144.stderr: -290> 2024-06-04T16:12:14.061+0000 7f6cbcd3f800 5 AuthRegistry(0x564235530bb0) adding con mode: secure 2024-06-04T16:12:14.351 INFO:tasks.workunit.client.0.smithi144.stderr: -289> 2024-06-04T16:12:14.061+0000 7f6cbcd3f800 5 AuthRegistry(0x564235530bb0) adding con mode: crc 2024-06-04T16:12:14.351 INFO:tasks.workunit.client.0.smithi144.stderr: -288> 2024-06-04T16:12:14.061+0000 7f6cbcd3f800 5 AuthRegistry(0x564235530bb0) adding con mode: secure 2024-06-04T16:12:14.351 INFO:tasks.workunit.client.0.smithi144.stderr: -287> 2024-06-04T16:12:14.061+0000 7f6cbcd3f800 5 AuthRegistry(0x564235530bb0) adding con mode: crc 2024-06-04T16:12:14.351 INFO:tasks.workunit.client.0.smithi144.stderr: -286> 2024-06-04T16:12:14.061+0000 7f6cbcd3f800 5 AuthRegistry(0x564235530bb0) adding con mode: secure 2024-06-04T16:12:14.351 INFO:tasks.workunit.client.0.smithi144.stderr: -285> 2024-06-04T16:12:14.061+0000 7f6cbcd3f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-06-04T16:12:14.351 INFO:tasks.workunit.client.0.smithi144.stderr: -284> 2024-06-04T16:12:14.061+0000 7f6cbcd3f800 10 monclient: init 2024-06-04T16:12:14.351 INFO:tasks.workunit.client.0.smithi144.stderr: -283> 2024-06-04T16:12:14.061+0000 7f6cbcd3f800 5 AuthRegistry(0x7fff54a70a90) adding auth protocol: cephx 2024-06-04T16:12:14.351 INFO:tasks.workunit.client.0.smithi144.stderr: -282> 2024-06-04T16:12:14.061+0000 7f6cbcd3f800 5 AuthRegistry(0x7fff54a70a90) adding auth protocol: cephx 2024-06-04T16:12:14.351 INFO:tasks.workunit.client.0.smithi144.stderr: -281> 2024-06-04T16:12:14.061+0000 7f6cbcd3f800 5 AuthRegistry(0x7fff54a70a90) adding auth protocol: cephx 2024-06-04T16:12:14.352 INFO:tasks.workunit.client.0.smithi144.stderr: -280> 2024-06-04T16:12:14.061+0000 7f6cbcd3f800 5 AuthRegistry(0x7fff54a70a90) adding con mode: secure 2024-06-04T16:12:14.352 INFO:tasks.workunit.client.0.smithi144.stderr: -279> 2024-06-04T16:12:14.061+0000 7f6cbcd3f800 5 AuthRegistry(0x7fff54a70a90) adding con mode: crc 2024-06-04T16:12:14.352 INFO:tasks.workunit.client.0.smithi144.stderr: -278> 2024-06-04T16:12:14.061+0000 7f6cbcd3f800 5 AuthRegistry(0x7fff54a70a90) adding con mode: secure 2024-06-04T16:12:14.352 INFO:tasks.workunit.client.0.smithi144.stderr: -277> 2024-06-04T16:12:14.061+0000 7f6cbcd3f800 5 AuthRegistry(0x7fff54a70a90) adding con mode: crc 2024-06-04T16:12:14.352 INFO:tasks.workunit.client.0.smithi144.stderr: -276> 2024-06-04T16:12:14.061+0000 7f6cbcd3f800 5 AuthRegistry(0x7fff54a70a90) adding con mode: secure 2024-06-04T16:12:14.352 INFO:tasks.workunit.client.0.smithi144.stderr: -275> 2024-06-04T16:12:14.061+0000 7f6cbcd3f800 5 AuthRegistry(0x7fff54a70a90) adding con mode: crc 2024-06-04T16:12:14.352 INFO:tasks.workunit.client.0.smithi144.stderr: -274> 2024-06-04T16:12:14.061+0000 7f6cbcd3f800 5 AuthRegistry(0x7fff54a70a90) adding con mode: crc 2024-06-04T16:12:14.352 INFO:tasks.workunit.client.0.smithi144.stderr: -273> 2024-06-04T16:12:14.061+0000 7f6cbcd3f800 5 AuthRegistry(0x7fff54a70a90) adding con mode: secure 2024-06-04T16:12:14.352 INFO:tasks.workunit.client.0.smithi144.stderr: -272> 2024-06-04T16:12:14.061+0000 7f6cbcd3f800 5 AuthRegistry(0x7fff54a70a90) adding con mode: crc 2024-06-04T16:12:14.352 INFO:tasks.workunit.client.0.smithi144.stderr: -271> 2024-06-04T16:12:14.061+0000 7f6cbcd3f800 5 AuthRegistry(0x7fff54a70a90) adding con mode: secure 2024-06-04T16:12:14.352 INFO:tasks.workunit.client.0.smithi144.stderr: -270> 2024-06-04T16:12:14.061+0000 7f6cbcd3f800 5 AuthRegistry(0x7fff54a70a90) adding con mode: crc 2024-06-04T16:12:14.352 INFO:tasks.workunit.client.0.smithi144.stderr: -269> 2024-06-04T16:12:14.061+0000 7f6cbcd3f800 5 AuthRegistry(0x7fff54a70a90) adding con mode: secure 2024-06-04T16:12:14.352 INFO:tasks.workunit.client.0.smithi144.stderr: -268> 2024-06-04T16:12:14.061+0000 7f6cbcd3f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-06-04T16:12:14.352 INFO:tasks.workunit.client.0.smithi144.stderr: -267> 2024-06-04T16:12:14.062+0000 7f6cbcd3f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-06-04T16:12:14.353 INFO:tasks.workunit.client.0.smithi144.stderr: -266> 2024-06-04T16:12:14.062+0000 7f6cbcd3f800 5 asok(0x564235270c60) register_command rotate-key cmddesc rotate-key hook 0x7fff54a70bd8 EEXIST 2024-06-04T16:12:14.353 INFO:tasks.workunit.client.0.smithi144.stderr: -265> 2024-06-04T16:12:14.062+0000 7f6cbcd3f800 10 monclient: _reopen_session rank -1 2024-06-04T16:12:14.353 INFO:tasks.workunit.client.0.smithi144.stderr: -264> 2024-06-04T16:12:14.062+0000 7f6cbcd3f800 10 monclient: _add_conns ranks=[1,2,0] 2024-06-04T16:12:14.353 INFO:tasks.workunit.client.0.smithi144.stderr: -263> 2024-06-04T16:12:14.062+0000 7f6cbcd3f800 10 monclient(hunting): picked mon.noname-b con 0x564235556b30 addr [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] 2024-06-04T16:12:14.353 INFO:tasks.workunit.client.0.smithi144.stderr: -262> 2024-06-04T16:12:14.062+0000 7f6cbcd3f800 10 monclient(hunting): picked mon.noname-c con 0x564235536330 addr [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] 2024-06-04T16:12:14.353 INFO:tasks.workunit.client.0.smithi144.stderr: -261> 2024-06-04T16:12:14.062+0000 7f6cbcd3f800 10 monclient(hunting): picked mon.noname-a con 0x564235560ab0 addr [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] 2024-06-04T16:12:14.353 INFO:tasks.workunit.client.0.smithi144.stderr: -260> 2024-06-04T16:12:14.062+0000 7f6cbcd3f800 10 monclient(hunting): start opening mon connection 2024-06-04T16:12:14.353 INFO:tasks.workunit.client.0.smithi144.stderr: -259> 2024-06-04T16:12:14.062+0000 7f6cbcd3f800 10 monclient(hunting): start opening mon connection 2024-06-04T16:12:14.353 INFO:tasks.workunit.client.0.smithi144.stderr: -258> 2024-06-04T16:12:14.062+0000 7f6cbcd3f800 10 monclient(hunting): start opening mon connection 2024-06-04T16:12:14.353 INFO:tasks.workunit.client.0.smithi144.stderr: -257> 2024-06-04T16:12:14.062+0000 7f6cbcd3f800 10 monclient(hunting): _renew_subs 2024-06-04T16:12:14.353 INFO:tasks.workunit.client.0.smithi144.stderr: -256> 2024-06-04T16:12:14.062+0000 7f6cbcd3f800 10 monclient(hunting): authenticate will time out at 1971.878309s 2024-06-04T16:12:14.353 INFO:tasks.workunit.client.0.smithi144.stderr: -255> 2024-06-04T16:12:14.062+0000 7f6cb9292640 10 monclient(hunting): get_auth_request con 0x564235536330 auth_method 0 2024-06-04T16:12:14.353 INFO:tasks.workunit.client.0.smithi144.stderr: -254> 2024-06-04T16:12:14.062+0000 7f6cb9292640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-06-04T16:12:14.353 INFO:tasks.workunit.client.0.smithi144.stderr: -253> 2024-06-04T16:12:14.062+0000 7f6cb9292640 10 monclient(hunting): _init_auth method 2 2024-06-04T16:12:14.354 INFO:tasks.workunit.client.0.smithi144.stderr: -252> 2024-06-04T16:12:14.062+0000 7f6cb9292640 10 monclient(hunting): _init_auth creating new auth 2024-06-04T16:12:14.354 INFO:tasks.workunit.client.0.smithi144.stderr: -251> 2024-06-04T16:12:14.062+0000 7f6cb8a91640 10 monclient(hunting): get_auth_request con 0x564235560ab0 auth_method 0 2024-06-04T16:12:14.354 INFO:tasks.workunit.client.0.smithi144.stderr: -250> 2024-06-04T16:12:14.062+0000 7f6cb8a91640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-06-04T16:12:14.354 INFO:tasks.workunit.client.0.smithi144.stderr: -249> 2024-06-04T16:12:14.062+0000 7f6cb8a91640 10 monclient(hunting): _init_auth method 2 2024-06-04T16:12:14.354 INFO:tasks.workunit.client.0.smithi144.stderr: -248> 2024-06-04T16:12:14.062+0000 7f6cb8a91640 10 monclient(hunting): _init_auth creating new auth 2024-06-04T16:12:14.354 INFO:tasks.workunit.client.0.smithi144.stderr: -247> 2024-06-04T16:12:14.062+0000 7f6cb8a91640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-06-04T16:12:14.354 INFO:tasks.workunit.client.0.smithi144.stderr: -246> 2024-06-04T16:12:14.062+0000 7f6cb8a91640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-06-04T16:12:14.354 INFO:tasks.workunit.client.0.smithi144.stderr: -245> 2024-06-04T16:12:14.062+0000 7f6cb8a91640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-06-04T16:12:14.354 INFO:tasks.workunit.client.0.smithi144.stderr: -244> 2024-06-04T16:12:14.062+0000 7f6cb3fff640 10 monclient(hunting): get_auth_request con 0x564235556b30 auth_method 0 2024-06-04T16:12:14.354 INFO:tasks.workunit.client.0.smithi144.stderr: -243> 2024-06-04T16:12:14.062+0000 7f6cb3fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-06-04T16:12:14.354 INFO:tasks.workunit.client.0.smithi144.stderr: -242> 2024-06-04T16:12:14.062+0000 7f6cb3fff640 10 monclient(hunting): _init_auth method 2 2024-06-04T16:12:14.354 INFO:tasks.workunit.client.0.smithi144.stderr: -241> 2024-06-04T16:12:14.062+0000 7f6cb3fff640 10 monclient(hunting): _init_auth creating new auth 2024-06-04T16:12:14.354 INFO:tasks.workunit.client.0.smithi144.stderr: -240> 2024-06-04T16:12:14.062+0000 7f6cb3fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-06-04T16:12:14.355 INFO:tasks.workunit.client.0.smithi144.stderr: -239> 2024-06-04T16:12:14.062+0000 7f6cb3fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-06-04T16:12:14.355 INFO:tasks.workunit.client.0.smithi144.stderr: -238> 2024-06-04T16:12:14.062+0000 7f6cb3fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-06-04T16:12:14.355 INFO:tasks.workunit.client.0.smithi144.stderr: -237> 2024-06-04T16:12:14.062+0000 7f6cb8a91640 10 monclient(hunting): handle_auth_done global_id 6480 payload 274 2024-06-04T16:12:14.355 INFO:tasks.workunit.client.0.smithi144.stderr: -236> 2024-06-04T16:12:14.062+0000 7f6cb8a91640 10 monclient: _finish_hunting 0 2024-06-04T16:12:14.355 INFO:tasks.workunit.client.0.smithi144.stderr: -235> 2024-06-04T16:12:14.062+0000 7f6cb8a91640 1 monclient: found mon.noname-a 2024-06-04T16:12:14.355 INFO:tasks.workunit.client.0.smithi144.stderr: -234> 2024-06-04T16:12:14.062+0000 7f6cb8a91640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.144:3300/0 2024-06-04T16:12:14.355 INFO:tasks.workunit.client.0.smithi144.stderr: -233> 2024-06-04T16:12:14.062+0000 7f6b8ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-06-04T16:12:14.355 INFO:tasks.workunit.client.0.smithi144.stderr: -232> 2024-06-04T16:12:14.062+0000 7f6b8ffff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-06-04T16:12:14.355 INFO:tasks.workunit.client.0.smithi144.stderr: -231> 2024-06-04T16:12:14.062+0000 7f6b8ffff640 10 monclient: dump: 2024-06-04T16:12:14.355 INFO:tasks.workunit.client.0.smithi144.stderr:epoch 1 2024-06-04T16:12:14.355 INFO:tasks.workunit.client.0.smithi144.stderr:fsid 15e56bb1-4856-42f3-b6db-a2c8f23c5557 2024-06-04T16:12:14.355 INFO:tasks.workunit.client.0.smithi144.stderr:last_changed 2024-06-04T15:51:29.789359+0000 2024-06-04T16:12:14.355 INFO:tasks.workunit.client.0.smithi144.stderr:created 2024-06-04T15:51:29.789359+0000 2024-06-04T16:12:14.355 INFO:tasks.workunit.client.0.smithi144.stderr:min_mon_release 19 (squid) 2024-06-04T16:12:14.356 INFO:tasks.workunit.client.0.smithi144.stderr:election_strategy: 1 2024-06-04T16:12:14.356 INFO:tasks.workunit.client.0.smithi144.stderr:0: [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] mon.a 2024-06-04T16:12:14.356 INFO:tasks.workunit.client.0.smithi144.stderr:1: [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] mon.b 2024-06-04T16:12:14.356 INFO:tasks.workunit.client.0.smithi144.stderr:2: [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] mon.c 2024-06-04T16:12:14.356 INFO:tasks.workunit.client.0.smithi144.stderr: 2024-06-04T16:12:14.356 INFO:tasks.workunit.client.0.smithi144.stderr: -230> 2024-06-04T16:12:14.062+0000 7f6b8ffff640 10 monclient: _finish_auth 0 2024-06-04T16:12:14.356 INFO:tasks.workunit.client.0.smithi144.stderr: -229> 2024-06-04T16:12:14.062+0000 7f6b8ffff640 10 monclient: _check_auth_tickets 2024-06-04T16:12:14.356 INFO:tasks.workunit.client.0.smithi144.stderr: -228> 2024-06-04T16:12:14.062+0000 7f6b8ffff640 10 monclient: handle_config config(0 keys) 2024-06-04T16:12:14.356 INFO:tasks.workunit.client.0.smithi144.stderr: -227> 2024-06-04T16:12:14.062+0000 7f6cbcd3f800 5 monclient: authenticate success, global_id 6480 2024-06-04T16:12:14.356 INFO:tasks.workunit.client.0.smithi144.stderr: -226> 2024-06-04T16:12:14.062+0000 7f6cbcd3f800 10 monclient: get_monmap_and_config success 2024-06-04T16:12:14.356 INFO:tasks.workunit.client.0.smithi144.stderr: -225> 2024-06-04T16:12:14.062+0000 7f6cbcd3f800 4 set_mon_vals no callback set 2024-06-04T16:12:14.356 INFO:tasks.workunit.client.0.smithi144.stderr: -224> 2024-06-04T16:12:14.062+0000 7f6b8ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-06-04T16:12:14.356 INFO:tasks.workunit.client.0.smithi144.stderr: -223> 2024-06-04T16:12:14.062+0000 7f6b8ffff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-06-04T16:12:14.356 INFO:tasks.workunit.client.0.smithi144.stderr: -222> 2024-06-04T16:12:14.062+0000 7f6b8ffff640 10 monclient: dump: 2024-06-04T16:12:14.357 INFO:tasks.workunit.client.0.smithi144.stderr:epoch 1 2024-06-04T16:12:14.357 INFO:tasks.workunit.client.0.smithi144.stderr:fsid 15e56bb1-4856-42f3-b6db-a2c8f23c5557 2024-06-04T16:12:14.357 INFO:tasks.workunit.client.0.smithi144.stderr:last_changed 2024-06-04T15:51:29.789359+0000 2024-06-04T16:12:14.357 INFO:tasks.workunit.client.0.smithi144.stderr:created 2024-06-04T15:51:29.789359+0000 2024-06-04T16:12:14.357 INFO:tasks.workunit.client.0.smithi144.stderr:min_mon_release 19 (squid) 2024-06-04T16:12:14.357 INFO:tasks.workunit.client.0.smithi144.stderr:election_strategy: 1 2024-06-04T16:12:14.357 INFO:tasks.workunit.client.0.smithi144.stderr:0: [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] mon.a 2024-06-04T16:12:14.357 INFO:tasks.workunit.client.0.smithi144.stderr:1: [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] mon.b 2024-06-04T16:12:14.357 INFO:tasks.workunit.client.0.smithi144.stderr:2: [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] mon.c 2024-06-04T16:12:14.357 INFO:tasks.workunit.client.0.smithi144.stderr: 2024-06-04T16:12:14.357 INFO:tasks.workunit.client.0.smithi144.stderr: -221> 2024-06-04T16:12:14.063+0000 7f6cbcd3f800 10 monclient: shutdown 2024-06-04T16:12:14.357 INFO:tasks.workunit.client.0.smithi144.stderr: -220> 2024-06-04T16:12:14.063+0000 7f6cbcd3f800 10 monclient: build_initial_monmap 2024-06-04T16:12:14.357 INFO:tasks.workunit.client.0.smithi144.stderr: -219> 2024-06-04T16:12:14.063+0000 7f6cbcd3f800 1 build_initial for_mkfs: 0 2024-06-04T16:12:14.357 INFO:tasks.workunit.client.0.smithi144.stderr: -218> 2024-06-04T16:12:14.063+0000 7f6cbcd3f800 10 monclient: monmap: 2024-06-04T16:12:14.358 INFO:tasks.workunit.client.0.smithi144.stderr:epoch 0 2024-06-04T16:12:14.358 INFO:tasks.workunit.client.0.smithi144.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-06-04T16:12:14.358 INFO:tasks.workunit.client.0.smithi144.stderr:last_changed 0.000000 2024-06-04T16:12:14.358 INFO:tasks.workunit.client.0.smithi144.stderr:created 0.000000 2024-06-04T16:12:14.358 INFO:tasks.workunit.client.0.smithi144.stderr:min_mon_release 0 (unknown) 2024-06-04T16:12:14.358 INFO:tasks.workunit.client.0.smithi144.stderr:election_strategy: 1 2024-06-04T16:12:14.358 INFO:tasks.workunit.client.0.smithi144.stderr:0: [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] mon.noname-a 2024-06-04T16:12:14.358 INFO:tasks.workunit.client.0.smithi144.stderr:1: [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] mon.noname-b 2024-06-04T16:12:14.358 INFO:tasks.workunit.client.0.smithi144.stderr:2: [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] mon.noname-c 2024-06-04T16:12:14.358 INFO:tasks.workunit.client.0.smithi144.stderr: 2024-06-04T16:12:14.358 INFO:tasks.workunit.client.0.smithi144.stderr: -217> 2024-06-04T16:12:14.063+0000 7f6cbcd3f800 5 AuthRegistry(0x564235530bb0) adding auth protocol: cephx 2024-06-04T16:12:14.358 INFO:tasks.workunit.client.0.smithi144.stderr: -216> 2024-06-04T16:12:14.063+0000 7f6cbcd3f800 5 AuthRegistry(0x564235530bb0) adding auth protocol: cephx 2024-06-04T16:12:14.359 INFO:tasks.workunit.client.0.smithi144.stderr: -215> 2024-06-04T16:12:14.063+0000 7f6cbcd3f800 5 AuthRegistry(0x564235530bb0) adding auth protocol: cephx 2024-06-04T16:12:14.359 INFO:tasks.workunit.client.0.smithi144.stderr: -214> 2024-06-04T16:12:14.063+0000 7f6cbcd3f800 5 AuthRegistry(0x564235530bb0) adding con mode: secure 2024-06-04T16:12:14.359 INFO:tasks.workunit.client.0.smithi144.stderr: -213> 2024-06-04T16:12:14.063+0000 7f6cbcd3f800 5 AuthRegistry(0x564235530bb0) adding con mode: crc 2024-06-04T16:12:14.359 INFO:tasks.workunit.client.0.smithi144.stderr: -212> 2024-06-04T16:12:14.063+0000 7f6cbcd3f800 5 AuthRegistry(0x564235530bb0) adding con mode: secure 2024-06-04T16:12:14.359 INFO:tasks.workunit.client.0.smithi144.stderr: -211> 2024-06-04T16:12:14.063+0000 7f6cbcd3f800 5 AuthRegistry(0x564235530bb0) adding con mode: crc 2024-06-04T16:12:14.359 INFO:tasks.workunit.client.0.smithi144.stderr: -210> 2024-06-04T16:12:14.063+0000 7f6cbcd3f800 5 AuthRegistry(0x564235530bb0) adding con mode: secure 2024-06-04T16:12:14.359 INFO:tasks.workunit.client.0.smithi144.stderr: -209> 2024-06-04T16:12:14.063+0000 7f6cbcd3f800 5 AuthRegistry(0x564235530bb0) adding con mode: crc 2024-06-04T16:12:14.359 INFO:tasks.workunit.client.0.smithi144.stderr: -208> 2024-06-04T16:12:14.063+0000 7f6cbcd3f800 5 AuthRegistry(0x564235530bb0) adding con mode: crc 2024-06-04T16:12:14.359 INFO:tasks.workunit.client.0.smithi144.stderr: -207> 2024-06-04T16:12:14.063+0000 7f6cbcd3f800 5 AuthRegistry(0x564235530bb0) adding con mode: secure 2024-06-04T16:12:14.359 INFO:tasks.workunit.client.0.smithi144.stderr: -206> 2024-06-04T16:12:14.063+0000 7f6cbcd3f800 5 AuthRegistry(0x564235530bb0) adding con mode: crc 2024-06-04T16:12:14.359 INFO:tasks.workunit.client.0.smithi144.stderr: -205> 2024-06-04T16:12:14.063+0000 7f6cbcd3f800 5 AuthRegistry(0x564235530bb0) adding con mode: secure 2024-06-04T16:12:14.359 INFO:tasks.workunit.client.0.smithi144.stderr: -204> 2024-06-04T16:12:14.063+0000 7f6cbcd3f800 5 AuthRegistry(0x564235530bb0) adding con mode: crc 2024-06-04T16:12:14.359 INFO:tasks.workunit.client.0.smithi144.stderr: -203> 2024-06-04T16:12:14.063+0000 7f6cbcd3f800 5 AuthRegistry(0x564235530bb0) adding con mode: secure 2024-06-04T16:12:14.360 INFO:tasks.workunit.client.0.smithi144.stderr: -202> 2024-06-04T16:12:14.063+0000 7f6cbcd3f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-06-04T16:12:14.360 INFO:tasks.workunit.client.0.smithi144.stderr: -201> 2024-06-04T16:12:14.063+0000 7f6cbcd3f800 1 librados: starting msgr at 2024-06-04T16:12:14.360 INFO:tasks.workunit.client.0.smithi144.stderr: -200> 2024-06-04T16:12:14.063+0000 7f6cbcd3f800 1 librados: starting objecter 2024-06-04T16:12:14.360 INFO:tasks.workunit.client.0.smithi144.stderr: -199> 2024-06-04T16:12:14.063+0000 7f6cbcd3f800 5 asok(0x564235270c60) register_command objecter_requests cmddesc objecter_requests hook 0x564235534540 EEXIST 2024-06-04T16:12:14.360 INFO:tasks.workunit.client.0.smithi144.stderr: -198> 2024-06-04T16:12:14.063+0000 7f6cbcd3f800 1 librados: setting wanted keys 2024-06-04T16:12:14.360 INFO:tasks.workunit.client.0.smithi144.stderr: -197> 2024-06-04T16:12:14.063+0000 7f6cbcd3f800 1 librados: calling monclient init 2024-06-04T16:12:14.360 INFO:tasks.workunit.client.0.smithi144.stderr: -196> 2024-06-04T16:12:14.063+0000 7f6cbcd3f800 10 monclient: init 2024-06-04T16:12:14.360 INFO:tasks.workunit.client.0.smithi144.stderr: -195> 2024-06-04T16:12:14.063+0000 7f6cbcd3f800 5 AuthRegistry(0x564235528e30) adding auth protocol: cephx 2024-06-04T16:12:14.360 INFO:tasks.workunit.client.0.smithi144.stderr: -194> 2024-06-04T16:12:14.063+0000 7f6cbcd3f800 5 AuthRegistry(0x564235528e30) adding auth protocol: cephx 2024-06-04T16:12:14.360 INFO:tasks.workunit.client.0.smithi144.stderr: -193> 2024-06-04T16:12:14.063+0000 7f6cbcd3f800 5 AuthRegistry(0x564235528e30) adding auth protocol: cephx 2024-06-04T16:12:14.360 INFO:tasks.workunit.client.0.smithi144.stderr: -192> 2024-06-04T16:12:14.063+0000 7f6cbcd3f800 5 AuthRegistry(0x564235528e30) adding con mode: secure 2024-06-04T16:12:14.360 INFO:tasks.workunit.client.0.smithi144.stderr: -191> 2024-06-04T16:12:14.063+0000 7f6cbcd3f800 5 AuthRegistry(0x564235528e30) adding con mode: crc 2024-06-04T16:12:14.360 INFO:tasks.workunit.client.0.smithi144.stderr: -190> 2024-06-04T16:12:14.063+0000 7f6cbcd3f800 5 AuthRegistry(0x564235528e30) adding con mode: secure 2024-06-04T16:12:14.361 INFO:tasks.workunit.client.0.smithi144.stderr: -189> 2024-06-04T16:12:14.063+0000 7f6cbcd3f800 5 AuthRegistry(0x564235528e30) adding con mode: crc 2024-06-04T16:12:14.361 INFO:tasks.workunit.client.0.smithi144.stderr: -188> 2024-06-04T16:12:14.063+0000 7f6cbcd3f800 5 AuthRegistry(0x564235528e30) adding con mode: secure 2024-06-04T16:12:14.361 INFO:tasks.workunit.client.0.smithi144.stderr: -187> 2024-06-04T16:12:14.063+0000 7f6cbcd3f800 5 AuthRegistry(0x564235528e30) adding con mode: crc 2024-06-04T16:12:14.361 INFO:tasks.workunit.client.0.smithi144.stderr: -186> 2024-06-04T16:12:14.063+0000 7f6cbcd3f800 5 AuthRegistry(0x564235528e30) adding con mode: crc 2024-06-04T16:12:14.361 INFO:tasks.workunit.client.0.smithi144.stderr: -185> 2024-06-04T16:12:14.063+0000 7f6cbcd3f800 5 AuthRegistry(0x564235528e30) adding con mode: secure 2024-06-04T16:12:14.361 INFO:tasks.workunit.client.0.smithi144.stderr: -184> 2024-06-04T16:12:14.063+0000 7f6cbcd3f800 5 AuthRegistry(0x564235528e30) adding con mode: crc 2024-06-04T16:12:14.361 INFO:tasks.workunit.client.0.smithi144.stderr: -183> 2024-06-04T16:12:14.063+0000 7f6cbcd3f800 5 AuthRegistry(0x564235528e30) adding con mode: secure 2024-06-04T16:12:14.361 INFO:tasks.workunit.client.0.smithi144.stderr: -182> 2024-06-04T16:12:14.063+0000 7f6cbcd3f800 5 AuthRegistry(0x564235528e30) adding con mode: crc 2024-06-04T16:12:14.361 INFO:tasks.workunit.client.0.smithi144.stderr: -181> 2024-06-04T16:12:14.063+0000 7f6cbcd3f800 5 AuthRegistry(0x564235528e30) adding con mode: secure 2024-06-04T16:12:14.361 INFO:tasks.workunit.client.0.smithi144.stderr: -180> 2024-06-04T16:12:14.063+0000 7f6cbcd3f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-06-04T16:12:14.361 INFO:tasks.workunit.client.0.smithi144.stderr: -179> 2024-06-04T16:12:14.064+0000 7f6cbcd3f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-06-04T16:12:14.361 INFO:tasks.workunit.client.0.smithi144.stderr: -178> 2024-06-04T16:12:14.064+0000 7f6cbcd3f800 5 asok(0x564235270c60) register_command rotate-key cmddesc rotate-key hook 0x564235528f78 EEXIST 2024-06-04T16:12:14.361 INFO:tasks.workunit.client.0.smithi144.stderr: -177> 2024-06-04T16:12:14.064+0000 7f6cbcd3f800 10 monclient: _reopen_session rank -1 2024-06-04T16:12:14.362 INFO:tasks.workunit.client.0.smithi144.stderr: -176> 2024-06-04T16:12:14.064+0000 7f6cbcd3f800 10 monclient: _add_conns ranks=[2,1,0] 2024-06-04T16:12:14.362 INFO:tasks.workunit.client.0.smithi144.stderr: -175> 2024-06-04T16:12:14.064+0000 7f6cbcd3f800 10 monclient(hunting): picked mon.noname-c con 0x564235536330 addr [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] 2024-06-04T16:12:14.362 INFO:tasks.workunit.client.0.smithi144.stderr: -174> 2024-06-04T16:12:14.064+0000 7f6cbcd3f800 10 monclient(hunting): picked mon.noname-b con 0x564235556b30 addr [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] 2024-06-04T16:12:14.362 INFO:tasks.workunit.client.0.smithi144.stderr: -173> 2024-06-04T16:12:14.064+0000 7f6cbcd3f800 10 monclient(hunting): picked mon.noname-a con 0x564235560ab0 addr [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] 2024-06-04T16:12:14.362 INFO:tasks.workunit.client.0.smithi144.stderr: -172> 2024-06-04T16:12:14.064+0000 7f6cbcd3f800 10 monclient(hunting): start opening mon connection 2024-06-04T16:12:14.362 INFO:tasks.workunit.client.0.smithi144.stderr: -171> 2024-06-04T16:12:14.064+0000 7f6cbcd3f800 10 monclient(hunting): start opening mon connection 2024-06-04T16:12:14.362 INFO:tasks.workunit.client.0.smithi144.stderr: -170> 2024-06-04T16:12:14.064+0000 7f6cbcd3f800 10 monclient(hunting): start opening mon connection 2024-06-04T16:12:14.362 INFO:tasks.workunit.client.0.smithi144.stderr: -169> 2024-06-04T16:12:14.064+0000 7f6cbcd3f800 10 monclient(hunting): _renew_subs 2024-06-04T16:12:14.362 INFO:tasks.workunit.client.0.smithi144.stderr: -168> 2024-06-04T16:12:14.064+0000 7f6cbcd3f800 10 monclient(hunting): authenticate will time out at 1971.880340s 2024-06-04T16:12:14.362 INFO:tasks.workunit.client.0.smithi144.stderr: -167> 2024-06-04T16:12:14.064+0000 7f6cb3fff640 10 monclient(hunting): get_auth_request con 0x564235536330 auth_method 0 2024-06-04T16:12:14.362 INFO:tasks.workunit.client.0.smithi144.stderr: -166> 2024-06-04T16:12:14.064+0000 7f6cb3fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-06-04T16:12:14.362 INFO:tasks.workunit.client.0.smithi144.stderr: -165> 2024-06-04T16:12:14.064+0000 7f6cb3fff640 10 monclient(hunting): _init_auth method 2 2024-06-04T16:12:14.362 INFO:tasks.workunit.client.0.smithi144.stderr: -164> 2024-06-04T16:12:14.064+0000 7f6cb3fff640 10 monclient(hunting): _init_auth creating new auth 2024-06-04T16:12:14.362 INFO:tasks.workunit.client.0.smithi144.stderr: -163> 2024-06-04T16:12:14.064+0000 7f6cb8a91640 10 monclient(hunting): get_auth_request con 0x564235560ab0 auth_method 0 2024-06-04T16:12:14.363 INFO:tasks.workunit.client.0.smithi144.stderr: -162> 2024-06-04T16:12:14.064+0000 7f6cb8a91640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-06-04T16:12:14.363 INFO:tasks.workunit.client.0.smithi144.stderr: -161> 2024-06-04T16:12:14.064+0000 7f6cb8a91640 10 monclient(hunting): _init_auth method 2 2024-06-04T16:12:14.363 INFO:tasks.workunit.client.0.smithi144.stderr: -160> 2024-06-04T16:12:14.064+0000 7f6cb8a91640 10 monclient(hunting): _init_auth creating new auth 2024-06-04T16:12:14.363 INFO:tasks.workunit.client.0.smithi144.stderr: -159> 2024-06-04T16:12:14.064+0000 7f6cb3fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-06-04T16:12:14.363 INFO:tasks.workunit.client.0.smithi144.stderr: -158> 2024-06-04T16:12:14.064+0000 7f6cb3fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-06-04T16:12:14.363 INFO:tasks.workunit.client.0.smithi144.stderr: -157> 2024-06-04T16:12:14.064+0000 7f6cb3fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-06-04T16:12:14.363 INFO:tasks.workunit.client.0.smithi144.stderr: -156> 2024-06-04T16:12:14.064+0000 7f6cb9292640 10 monclient(hunting): get_auth_request con 0x564235556b30 auth_method 0 2024-06-04T16:12:14.363 INFO:tasks.workunit.client.0.smithi144.stderr: -155> 2024-06-04T16:12:14.064+0000 7f6cb9292640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-06-04T16:12:14.363 INFO:tasks.workunit.client.0.smithi144.stderr: -154> 2024-06-04T16:12:14.064+0000 7f6cb9292640 10 monclient(hunting): _init_auth method 2 2024-06-04T16:12:14.363 INFO:tasks.workunit.client.0.smithi144.stderr: -153> 2024-06-04T16:12:14.064+0000 7f6cb9292640 10 monclient(hunting): _init_auth creating new auth 2024-06-04T16:12:14.363 INFO:tasks.workunit.client.0.smithi144.stderr: -152> 2024-06-04T16:12:14.064+0000 7f6cb8a91640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-06-04T16:12:14.363 INFO:tasks.workunit.client.0.smithi144.stderr: -151> 2024-06-04T16:12:14.064+0000 7f6cb8a91640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-06-04T16:12:14.364 INFO:tasks.workunit.client.0.smithi144.stderr: -150> 2024-06-04T16:12:14.064+0000 7f6cb8a91640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-06-04T16:12:14.364 INFO:tasks.workunit.client.0.smithi144.stderr: -149> 2024-06-04T16:12:14.064+0000 7f6cb9292640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-06-04T16:12:14.364 INFO:tasks.workunit.client.0.smithi144.stderr: -148> 2024-06-04T16:12:14.064+0000 7f6cb9292640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-06-04T16:12:14.364 INFO:tasks.workunit.client.0.smithi144.stderr: -147> 2024-06-04T16:12:14.064+0000 7f6cb9292640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-06-04T16:12:14.364 INFO:tasks.workunit.client.0.smithi144.stderr: -146> 2024-06-04T16:12:14.064+0000 7f6cb3fff640 10 monclient(hunting): handle_auth_done global_id 6161 payload 824 2024-06-04T16:12:14.364 INFO:tasks.workunit.client.0.smithi144.stderr: -145> 2024-06-04T16:12:14.064+0000 7f6cb3fff640 10 monclient: _finish_hunting 0 2024-06-04T16:12:14.364 INFO:tasks.workunit.client.0.smithi144.stderr: -144> 2024-06-04T16:12:14.064+0000 7f6cb3fff640 1 monclient: found mon.noname-c 2024-06-04T16:12:14.364 INFO:tasks.workunit.client.0.smithi144.stderr: -143> 2024-06-04T16:12:14.064+0000 7f6cb3fff640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.144:3301/0 2024-06-04T16:12:14.364 INFO:tasks.workunit.client.0.smithi144.stderr: -142> 2024-06-04T16:12:14.064+0000 7f6b8e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-06-04T16:12:14.364 INFO:tasks.workunit.client.0.smithi144.stderr: -141> 2024-06-04T16:12:14.064+0000 7f6b8e7fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-06-04T16:12:14.364 INFO:tasks.workunit.client.0.smithi144.stderr: -140> 2024-06-04T16:12:14.064+0000 7f6b8e7fc640 10 monclient: dump: 2024-06-04T16:12:14.364 INFO:tasks.workunit.client.0.smithi144.stderr:epoch 1 2024-06-04T16:12:14.364 INFO:tasks.workunit.client.0.smithi144.stderr:fsid 15e56bb1-4856-42f3-b6db-a2c8f23c5557 2024-06-04T16:12:14.364 INFO:tasks.workunit.client.0.smithi144.stderr:last_changed 2024-06-04T15:51:29.789359+0000 2024-06-04T16:12:14.365 INFO:tasks.workunit.client.0.smithi144.stderr:created 2024-06-04T15:51:29.789359+0000 2024-06-04T16:12:14.365 INFO:tasks.workunit.client.0.smithi144.stderr:min_mon_release 19 (squid) 2024-06-04T16:12:14.365 INFO:tasks.workunit.client.0.smithi144.stderr:election_strategy: 1 2024-06-04T16:12:14.365 INFO:tasks.workunit.client.0.smithi144.stderr:0: [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] mon.a 2024-06-04T16:12:14.365 INFO:tasks.workunit.client.0.smithi144.stderr:1: [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] mon.b 2024-06-04T16:12:14.365 INFO:tasks.workunit.client.0.smithi144.stderr:2: [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] mon.c 2024-06-04T16:12:14.365 INFO:tasks.workunit.client.0.smithi144.stderr: 2024-06-04T16:12:14.365 INFO:tasks.workunit.client.0.smithi144.stderr: -139> 2024-06-04T16:12:14.064+0000 7f6b8e7fc640 10 monclient: _finish_auth 0 2024-06-04T16:12:14.365 INFO:tasks.workunit.client.0.smithi144.stderr: -138> 2024-06-04T16:12:14.064+0000 7f6b8e7fc640 10 monclient: _check_auth_tickets 2024-06-04T16:12:14.365 INFO:tasks.workunit.client.0.smithi144.stderr: -137> 2024-06-04T16:12:14.064+0000 7f6b8e7fc640 10 monclient: handle_config config(0 keys) 2024-06-04T16:12:14.365 INFO:tasks.workunit.client.0.smithi144.stderr: -136> 2024-06-04T16:12:14.064+0000 7f6b8e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-06-04T16:12:14.365 INFO:tasks.workunit.client.0.smithi144.stderr: -135> 2024-06-04T16:12:14.064+0000 7f6b8e7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-06-04T16:12:14.365 INFO:tasks.workunit.client.0.smithi144.stderr: -134> 2024-06-04T16:12:14.064+0000 7f6b8e7fc640 10 monclient: dump: 2024-06-04T16:12:14.365 INFO:tasks.workunit.client.0.smithi144.stderr:epoch 1 2024-06-04T16:12:14.366 INFO:tasks.workunit.client.0.smithi144.stderr:fsid 15e56bb1-4856-42f3-b6db-a2c8f23c5557 2024-06-04T16:12:14.366 INFO:tasks.workunit.client.0.smithi144.stderr:last_changed 2024-06-04T15:51:29.789359+0000 2024-06-04T16:12:14.366 INFO:tasks.workunit.client.0.smithi144.stderr:created 2024-06-04T15:51:29.789359+0000 2024-06-04T16:12:14.366 INFO:tasks.workunit.client.0.smithi144.stderr:min_mon_release 19 (squid) 2024-06-04T16:12:14.366 INFO:tasks.workunit.client.0.smithi144.stderr:election_strategy: 1 2024-06-04T16:12:14.366 INFO:tasks.workunit.client.0.smithi144.stderr:0: [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] mon.a 2024-06-04T16:12:14.366 INFO:tasks.workunit.client.0.smithi144.stderr:1: [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] mon.b 2024-06-04T16:12:14.366 INFO:tasks.workunit.client.0.smithi144.stderr:2: [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] mon.c 2024-06-04T16:12:14.366 INFO:tasks.workunit.client.0.smithi144.stderr: 2024-06-04T16:12:14.366 INFO:tasks.workunit.client.0.smithi144.stderr: -133> 2024-06-04T16:12:14.064+0000 7f6cbcd3f800 5 monclient: authenticate success, global_id 6161 2024-06-04T16:12:14.366 INFO:tasks.workunit.client.0.smithi144.stderr: -132> 2024-06-04T16:12:14.064+0000 7f6cbcd3f800 10 monclient: _renew_subs 2024-06-04T16:12:14.366 INFO:tasks.workunit.client.0.smithi144.stderr: -131> 2024-06-04T16:12:14.064+0000 7f6cbcd3f800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.144:3301/0 2024-06-04T16:12:14.366 INFO:tasks.workunit.client.0.smithi144.stderr: -130> 2024-06-04T16:12:14.064+0000 7f6b8ffff640 4 set_mon_vals no callback set 2024-06-04T16:12:14.367 INFO:tasks.workunit.client.0.smithi144.stderr: -129> 2024-06-04T16:12:14.064+0000 7f6cbcd3f800 10 monclient: _renew_subs 2024-06-04T16:12:14.367 INFO:tasks.workunit.client.0.smithi144.stderr: -128> 2024-06-04T16:12:14.064+0000 7f6cbcd3f800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.144:3301/0 2024-06-04T16:12:14.367 INFO:tasks.workunit.client.0.smithi144.stderr: -127> 2024-06-04T16:12:14.064+0000 7f6cbcd3f800 1 librados: init done 2024-06-04T16:12:14.367 INFO:tasks.workunit.client.0.smithi144.stderr: -126> 2024-06-04T16:12:14.064+0000 7f6cbcd3f800 5 asok(0x564235270c60) register_command cr dump hook 0x564235557818 2024-06-04T16:12:14.367 INFO:tasks.workunit.client.0.smithi144.stderr: -125> 2024-06-04T16:12:14.066+0000 7f6cbcd3f800 20 rados->read ofs=0 len=0 2024-06-04T16:12:14.367 INFO:tasks.workunit.client.0.smithi144.stderr: -124> 2024-06-04T16:12:14.066+0000 7f6b8e7fc640 4 mgrc handle_mgr_map Got map version 5 2024-06-04T16:12:14.367 INFO:tasks.workunit.client.0.smithi144.stderr: -123> 2024-06-04T16:12:14.066+0000 7f6b8e7fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.177:6832/2645786330,v1:172.21.15.177:6833/2645786330] 2024-06-04T16:12:14.367 INFO:tasks.workunit.client.0.smithi144.stderr: -122> 2024-06-04T16:12:14.066+0000 7f6b8e7fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.177:6832/2645786330,v1:172.21.15.177:6833/2645786330] 2024-06-04T16:12:14.367 INFO:tasks.workunit.client.0.smithi144.stderr: -121> 2024-06-04T16:12:14.067+0000 7f6cb9292640 10 monclient: get_auth_request con 0x7f6b84074cb0 auth_method 0 2024-06-04T16:12:14.367 INFO:tasks.workunit.client.0.smithi144.stderr: -120> 2024-06-04T16:12:14.067+0000 7f6cb8a91640 10 monclient: get_auth_request con 0x56423557eac0 auth_method 0 2024-06-04T16:12:14.367 INFO:tasks.workunit.client.0.smithi144.stderr: -119> 2024-06-04T16:12:14.067+0000 7f6cbcd3f800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:12:14.367 INFO:tasks.workunit.client.0.smithi144.stderr: -118> 2024-06-04T16:12:14.067+0000 7f6cbcd3f800 20 realm 2024-06-04T16:12:14.367 INFO:tasks.workunit.client.0.smithi144.stderr: -117> 2024-06-04T16:12:14.067+0000 7f6cbcd3f800 20 rados->read ofs=0 len=0 2024-06-04T16:12:14.367 INFO:tasks.workunit.client.0.smithi144.stderr: -116> 2024-06-04T16:12:14.067+0000 7f6cbcd3f800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:12:14.368 INFO:tasks.workunit.client.0.smithi144.stderr: -115> 2024-06-04T16:12:14.067+0000 7f6cbcd3f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-06-04T16:12:14.368 INFO:tasks.workunit.client.0.smithi144.stderr: -114> 2024-06-04T16:12:14.067+0000 7f6cbcd3f800 20 rados->read ofs=0 len=0 2024-06-04T16:12:14.368 INFO:tasks.workunit.client.0.smithi144.stderr: -113> 2024-06-04T16:12:14.068+0000 7f6cbcd3f800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:12:14.368 INFO:tasks.workunit.client.0.smithi144.stderr: -112> 2024-06-04T16:12:14.068+0000 7f6cbcd3f800 20 rados->read ofs=0 len=0 2024-06-04T16:12:14.368 INFO:tasks.workunit.client.0.smithi144.stderr: -111> 2024-06-04T16:12:14.068+0000 7f6cb3fff640 10 monclient: get_auth_request con 0x564235582da0 auth_method 0 2024-06-04T16:12:14.368 INFO:tasks.workunit.client.0.smithi144.stderr: -110> 2024-06-04T16:12:14.068+0000 7f6cbcd3f800 20 rados_obj.operate() r=0 bl.length=46 2024-06-04T16:12:14.368 INFO:tasks.workunit.client.0.smithi144.stderr: -109> 2024-06-04T16:12:14.068+0000 7f6cbcd3f800 20 rados->read ofs=0 len=0 2024-06-04T16:12:14.368 INFO:tasks.workunit.client.0.smithi144.stderr: -108> 2024-06-04T16:12:14.068+0000 7f6cb9292640 10 monclient: get_auth_request con 0x5642355864c0 auth_method 0 2024-06-04T16:12:14.368 INFO:tasks.workunit.client.0.smithi144.stderr: -107> 2024-06-04T16:12:14.069+0000 7f6cbcd3f800 20 rados_obj.operate() r=0 bl.length=1139 2024-06-04T16:12:14.368 INFO:tasks.workunit.client.0.smithi144.stderr: -106> 2024-06-04T16:12:14.069+0000 7f6cbcd3f800 20 searching for the correct realm 2024-06-04T16:12:14.368 INFO:tasks.workunit.client.0.smithi144.stderr: -105> 2024-06-04T16:12:14.069+0000 7f6cb8a91640 10 monclient: get_auth_request con 0x56423558b240 auth_method 0 2024-06-04T16:12:14.368 INFO:tasks.workunit.client.0.smithi144.stderr: -104> 2024-06-04T16:12:14.070+0000 7f6cb3fff640 10 monclient: get_auth_request con 0x7f6cac05e6f0 auth_method 0 2024-06-04T16:12:14.368 INFO:tasks.workunit.client.0.smithi144.stderr: -103> 2024-06-04T16:12:14.071+0000 7f6cb3fff640 0 -- 172.21.15.144:0/1373499307 >> [v2:172.21.15.144:6816/2358575268,v1:172.21.15.144:6817/2358575268] conn(0x564235582da0 msgr2=0x564235585190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-06-04T16:12:14.369 INFO:tasks.workunit.client.0.smithi144.stderr: -102> 2024-06-04T16:12:14.071+0000 7f6b8e7fc640 1 client.6161.objecter ms_handle_reset 0x564235582da0 session 0x564235581c70 osd.1 2024-06-04T16:12:14.369 INFO:tasks.workunit.client.0.smithi144.stderr: -101> 2024-06-04T16:12:14.071+0000 7f6b8e7fc640 10 monclient: _renew_subs 2024-06-04T16:12:14.369 INFO:tasks.workunit.client.0.smithi144.stderr: -100> 2024-06-04T16:12:14.071+0000 7f6b8e7fc640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.144:3301/0 2024-06-04T16:12:14.369 INFO:tasks.workunit.client.0.smithi144.stderr: -99> 2024-06-04T16:12:14.071+0000 7f6cb9292640 10 monclient: get_auth_request con 0x7f6ca40c6020 auth_method 0 2024-06-04T16:12:14.369 INFO:tasks.workunit.client.0.smithi144.stderr: -98> 2024-06-04T16:12:14.071+0000 7f6cb3fff640 10 monclient: get_auth_request con 0x7f6b84085060 auth_method 0 2024-06-04T16:12:14.369 INFO:tasks.workunit.client.0.smithi144.stderr: -97> 2024-06-04T16:12:14.072+0000 7f6cb8a91640 10 monclient: get_auth_request con 0x7f6cac08d220 auth_method 0 2024-06-04T16:12:14.369 INFO:tasks.workunit.client.0.smithi144.stderr: -96> 2024-06-04T16:12:14.073+0000 7f6cb3fff640 0 -- 172.21.15.144:0/1373499307 >> [v2:172.21.15.177:6808/2618477608,v1:172.21.15.177:6809/2618477608] conn(0x7f6ca404b5e0 msgr2=0x7f6ca404b000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-06-04T16:12:14.369 INFO:tasks.workunit.client.0.smithi144.stderr: -95> 2024-06-04T16:12:14.073+0000 7f6cb3fff640 10 monclient: get_auth_request con 0x7f6ca404b5e0 auth_method 0 2024-06-04T16:12:14.369 INFO:tasks.workunit.client.0.smithi144.stderr: -94> 2024-06-04T16:12:14.275+0000 7f6cb3fff640 10 monclient: get_auth_request con 0x7f6ca404b5e0 auth_method 0 2024-06-04T16:12:14.369 INFO:tasks.workunit.client.0.smithi144.stderr: -93> 2024-06-04T16:12:14.280+0000 7f6cbcd3f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-06-04T16:12:14.369 INFO:tasks.workunit.client.0.smithi144.stderr: -92> 2024-06-04T16:12:14.280+0000 7f6cbcd3f800 20 RGWRados::pool_iterate: got zone_info.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767 2024-06-04T16:12:14.369 INFO:tasks.workunit.client.0.smithi144.stderr: -91> 2024-06-04T16:12:14.280+0000 7f6cbcd3f800 20 RGWRados::pool_iterate: got default.zone. 2024-06-04T16:12:14.369 INFO:tasks.workunit.client.0.smithi144.stderr: -90> 2024-06-04T16:12:14.280+0000 7f6cbcd3f800 20 RGWRados::pool_iterate: got zonegroup_info.abb22408-c332-4e28-8f7a-ff254ea2fed2 2024-06-04T16:12:14.370 INFO:tasks.workunit.client.0.smithi144.stderr: -89> 2024-06-04T16:12:14.281+0000 7f6cbcd3f800 20 RGWRados::pool_iterate: got zone_names.default 2024-06-04T16:12:14.370 INFO:tasks.workunit.client.0.smithi144.stderr: -88> 2024-06-04T16:12:14.281+0000 7f6cbcd3f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-06-04T16:12:14.370 INFO:tasks.workunit.client.0.smithi144.stderr: -87> 2024-06-04T16:12:14.281+0000 7f6cbcd3f800 20 rados->read ofs=0 len=0 2024-06-04T16:12:14.370 INFO:tasks.workunit.client.0.smithi144.stderr: -86> 2024-06-04T16:12:14.281+0000 7f6cbcd3f800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:12:14.370 INFO:tasks.workunit.client.0.smithi144.stderr: -85> 2024-06-04T16:12:14.281+0000 7f6cbcd3f800 20 rados->read ofs=0 len=0 2024-06-04T16:12:14.370 INFO:tasks.workunit.client.0.smithi144.stderr: -84> 2024-06-04T16:12:14.281+0000 7f6cbcd3f800 20 rados_obj.operate() r=0 bl.length=46 2024-06-04T16:12:14.370 INFO:tasks.workunit.client.0.smithi144.stderr: -83> 2024-06-04T16:12:14.281+0000 7f6cbcd3f800 20 rados->read ofs=0 len=0 2024-06-04T16:12:14.370 INFO:tasks.workunit.client.0.smithi144.stderr: -82> 2024-06-04T16:12:14.282+0000 7f6cbcd3f800 20 rados_obj.operate() r=0 bl.length=470 2024-06-04T16:12:14.370 INFO:tasks.workunit.client.0.smithi144.stderr: -81> 2024-06-04T16:12:14.282+0000 7f6cbcd3f800 20 zone default found 2024-06-04T16:12:14.370 INFO:tasks.workunit.client.0.smithi144.stderr: -80> 2024-06-04T16:12:14.282+0000 7f6cbcd3f800 4 Realm: () 2024-06-04T16:12:14.370 INFO:tasks.workunit.client.0.smithi144.stderr: -79> 2024-06-04T16:12:14.282+0000 7f6cbcd3f800 4 ZoneGroup: default (abb22408-c332-4e28-8f7a-ff254ea2fed2) 2024-06-04T16:12:14.370 INFO:tasks.workunit.client.0.smithi144.stderr: -78> 2024-06-04T16:12:14.282+0000 7f6cbcd3f800 4 Zone: default (be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767) 2024-06-04T16:12:14.370 INFO:tasks.workunit.client.0.smithi144.stderr: -77> 2024-06-04T16:12:14.282+0000 7f6cbcd3f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-06-04T16:12:14.370 INFO:tasks.workunit.client.0.smithi144.stderr: -76> 2024-06-04T16:12:14.282+0000 7f6cbcd3f800 20 zonegroup default 2024-06-04T16:12:14.371 INFO:tasks.workunit.client.0.smithi144.stderr: -75> 2024-06-04T16:12:14.282+0000 7f6cbcd3f800 20 rados->read ofs=0 len=0 2024-06-04T16:12:14.371 INFO:tasks.workunit.client.0.smithi144.stderr: -74> 2024-06-04T16:12:14.282+0000 7f6cbcd3f800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:12:14.371 INFO:tasks.workunit.client.0.smithi144.stderr: -73> 2024-06-04T16:12:14.282+0000 7f6cbcd3f800 20 rados->read ofs=0 len=0 2024-06-04T16:12:14.371 INFO:tasks.workunit.client.0.smithi144.stderr: -72> 2024-06-04T16:12:14.282+0000 7f6cbcd3f800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:12:14.371 INFO:tasks.workunit.client.0.smithi144.stderr: -71> 2024-06-04T16:12:14.282+0000 7f6cbcd3f800 20 rados->read ofs=0 len=0 2024-06-04T16:12:14.371 INFO:tasks.workunit.client.0.smithi144.stderr: -70> 2024-06-04T16:12:14.283+0000 7f6cbcd3f800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:12:14.371 INFO:tasks.workunit.client.0.smithi144.stderr: -69> 2024-06-04T16:12:14.283+0000 7f6cbcd3f800 20 started sync module instance, tier type = 2024-06-04T16:12:14.371 INFO:tasks.workunit.client.0.smithi144.stderr: -68> 2024-06-04T16:12:14.283+0000 7f6cbcd3f800 20 started zone id=be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767 (name=default) with tier type = 2024-06-04T16:12:14.371 INFO:tasks.workunit.client.0.smithi144.stderr: -67> 2024-06-04T16:12:14.291+0000 7f6cbcd3f800 20 add_watcher() i=0 2024-06-04T16:12:14.371 INFO:tasks.workunit.client.0.smithi144.stderr: -66> 2024-06-04T16:12:14.291+0000 7f6cbcd3f800 20 add_watcher() i=1 2024-06-04T16:12:14.371 INFO:tasks.workunit.client.0.smithi144.stderr: -65> 2024-06-04T16:12:14.291+0000 7f6cbcd3f800 20 add_watcher() i=2 2024-06-04T16:12:14.371 INFO:tasks.workunit.client.0.smithi144.stderr: -64> 2024-06-04T16:12:14.291+0000 7f6cbcd3f800 20 add_watcher() i=3 2024-06-04T16:12:14.371 INFO:tasks.workunit.client.0.smithi144.stderr: -63> 2024-06-04T16:12:14.291+0000 7f6cbcd3f800 20 add_watcher() i=4 2024-06-04T16:12:14.371 INFO:tasks.workunit.client.0.smithi144.stderr: -62> 2024-06-04T16:12:14.291+0000 7f6cbcd3f800 20 add_watcher() i=5 2024-06-04T16:12:14.371 INFO:tasks.workunit.client.0.smithi144.stderr: -61> 2024-06-04T16:12:14.291+0000 7f6cbcd3f800 20 add_watcher() i=6 2024-06-04T16:12:14.372 INFO:tasks.workunit.client.0.smithi144.stderr: -60> 2024-06-04T16:12:14.292+0000 7f6cbcd3f800 20 add_watcher() i=7 2024-06-04T16:12:14.372 INFO:tasks.workunit.client.0.smithi144.stderr: -59> 2024-06-04T16:12:14.292+0000 7f6cbcd3f800 2 all 8 watchers are set, enabling cache 2024-06-04T16:12:14.372 INFO:tasks.workunit.client.0.smithi144.stderr: -58> 2024-06-04T16:12:14.294+0000 7f6cbcd3f800 5 AuthRegistry(0x7fff54a70f70) adding auth protocol: cephx 2024-06-04T16:12:14.372 INFO:tasks.workunit.client.0.smithi144.stderr: -57> 2024-06-04T16:12:14.294+0000 7f6cbcd3f800 5 AuthRegistry(0x7fff54a70f70) adding auth protocol: cephx 2024-06-04T16:12:14.372 INFO:tasks.workunit.client.0.smithi144.stderr: -56> 2024-06-04T16:12:14.294+0000 7f6cbcd3f800 5 AuthRegistry(0x7fff54a70f70) adding auth protocol: cephx 2024-06-04T16:12:14.372 INFO:tasks.workunit.client.0.smithi144.stderr: -55> 2024-06-04T16:12:14.294+0000 7f6cbcd3f800 5 AuthRegistry(0x7fff54a70f70) adding con mode: secure 2024-06-04T16:12:14.372 INFO:tasks.workunit.client.0.smithi144.stderr: -54> 2024-06-04T16:12:14.294+0000 7f6cbcd3f800 5 AuthRegistry(0x7fff54a70f70) adding con mode: crc 2024-06-04T16:12:14.372 INFO:tasks.workunit.client.0.smithi144.stderr: -53> 2024-06-04T16:12:14.294+0000 7f6cbcd3f800 5 AuthRegistry(0x7fff54a70f70) adding con mode: secure 2024-06-04T16:12:14.372 INFO:tasks.workunit.client.0.smithi144.stderr: -52> 2024-06-04T16:12:14.294+0000 7f6cbcd3f800 5 AuthRegistry(0x7fff54a70f70) adding con mode: crc 2024-06-04T16:12:14.372 INFO:tasks.workunit.client.0.smithi144.stderr: -51> 2024-06-04T16:12:14.294+0000 7f6cbcd3f800 5 AuthRegistry(0x7fff54a70f70) adding con mode: secure 2024-06-04T16:12:14.372 INFO:tasks.workunit.client.0.smithi144.stderr: -50> 2024-06-04T16:12:14.294+0000 7f6cbcd3f800 5 AuthRegistry(0x7fff54a70f70) adding con mode: crc 2024-06-04T16:12:14.372 INFO:tasks.workunit.client.0.smithi144.stderr: -49> 2024-06-04T16:12:14.294+0000 7f6cbcd3f800 5 AuthRegistry(0x7fff54a70f70) adding con mode: crc 2024-06-04T16:12:14.372 INFO:tasks.workunit.client.0.smithi144.stderr: -48> 2024-06-04T16:12:14.294+0000 7f6cbcd3f800 5 AuthRegistry(0x7fff54a70f70) adding con mode: secure 2024-06-04T16:12:14.373 INFO:tasks.workunit.client.0.smithi144.stderr: -47> 2024-06-04T16:12:14.294+0000 7f6cbcd3f800 5 AuthRegistry(0x7fff54a70f70) adding con mode: crc 2024-06-04T16:12:14.373 INFO:tasks.workunit.client.0.smithi144.stderr: -46> 2024-06-04T16:12:14.294+0000 7f6cbcd3f800 5 AuthRegistry(0x7fff54a70f70) adding con mode: secure 2024-06-04T16:12:14.373 INFO:tasks.workunit.client.0.smithi144.stderr: -45> 2024-06-04T16:12:14.294+0000 7f6b6efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-06-04T16:12:14.373 INFO:tasks.workunit.client.0.smithi144.stderr: -44> 2024-06-04T16:12:14.294+0000 7f6cbcd3f800 5 AuthRegistry(0x7fff54a70f70) adding con mode: crc 2024-06-04T16:12:14.373 INFO:tasks.workunit.client.0.smithi144.stderr: -43> 2024-06-04T16:12:14.294+0000 7f6cbcd3f800 5 AuthRegistry(0x7fff54a70f70) adding con mode: secure 2024-06-04T16:12:14.373 INFO:tasks.workunit.client.0.smithi144.stderr: -42> 2024-06-04T16:12:14.295+0000 7f6cbcd3f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-06-04T16:12:14.373 INFO:tasks.workunit.client.0.smithi144.stderr: -41> 2024-06-04T16:12:14.295+0000 7f6cbcd3f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-06-04T16:12:14.373 INFO:tasks.workunit.client.0.smithi144.stderr: -40> 2024-06-04T16:12:14.295+0000 7f6cbcd3f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-06-04T16:12:14.373 INFO:tasks.workunit.client.0.smithi144.stderr: -39> 2024-06-04T16:12:14.295+0000 7f6cbcd3f800 5 asok(0x564235270c60) register_command cache list hook 0x564235557380 2024-06-04T16:12:14.373 INFO:tasks.workunit.client.0.smithi144.stderr: -38> 2024-06-04T16:12:14.295+0000 7f6cbcd3f800 5 asok(0x564235270c60) register_command cache inspect hook 0x564235557380 2024-06-04T16:12:14.373 INFO:tasks.workunit.client.0.smithi144.stderr: -37> 2024-06-04T16:12:14.295+0000 7f6cbcd3f800 5 asok(0x564235270c60) register_command cache erase hook 0x564235557380 2024-06-04T16:12:14.373 INFO:tasks.workunit.client.0.smithi144.stderr: -36> 2024-06-04T16:12:14.295+0000 7f6cbcd3f800 5 asok(0x564235270c60) register_command cache zap hook 0x564235557380 2024-06-04T16:12:14.373 INFO:tasks.workunit.client.0.smithi144.stderr: -35> 2024-06-04T16:12:14.295+0000 7f6cbcd3f800 5 note: GC not initialized 2024-06-04T16:12:14.374 INFO:tasks.workunit.client.0.smithi144.stderr: -34> 2024-06-04T16:12:14.295+0000 7f6b6dfe3640 20 reqs_thread_entry: start 2024-06-04T16:12:14.374 INFO:tasks.workunit.client.0.smithi144.stderr: -33> 2024-06-04T16:12:14.295+0000 7f6cbcd3f800 5 asok(0x564235270c60) register_command sync trace show hook 0x7f6cac010050 2024-06-04T16:12:14.374 INFO:tasks.workunit.client.0.smithi144.stderr: -32> 2024-06-04T16:12:14.295+0000 7f6cbcd3f800 5 asok(0x564235270c60) register_command sync trace history hook 0x7f6cac010050 2024-06-04T16:12:14.374 INFO:tasks.workunit.client.0.smithi144.stderr: -31> 2024-06-04T16:12:14.295+0000 7f6cbcd3f800 5 asok(0x564235270c60) register_command sync trace active hook 0x7f6cac010050 2024-06-04T16:12:14.374 INFO:tasks.workunit.client.0.smithi144.stderr: -30> 2024-06-04T16:12:14.295+0000 7f6cbcd3f800 5 asok(0x564235270c60) register_command sync trace active_short hook 0x7f6cac010050 2024-06-04T16:12:14.374 INFO:tasks.workunit.client.0.smithi144.stderr: -29> 2024-06-04T16:12:14.295+0000 7f6cbcd3f800 20 init_complete bucket index max shards: 11 2024-06-04T16:12:14.374 INFO:tasks.workunit.client.0.smithi144.stderr: -28> 2024-06-04T16:12:14.295+0000 7f6cbcd3f800 20 Filter name: none 2024-06-04T16:12:14.374 INFO:tasks.workunit.client.0.smithi144.stderr: -27> 2024-06-04T16:12:14.295+0000 7f6adf7fe640 20 reqs_thread_entry: start 2024-06-04T16:12:14.374 INFO:tasks.workunit.client.0.smithi144.stderr: -26> 2024-06-04T16:12:14.295+0000 7f6cbcd3f800 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2024-06-04T16:12:14.374 INFO:tasks.workunit.client.0.smithi144.stderr: -25> 2024-06-04T16:12:14.295+0000 7f6cbcd3f800 20 rados->read ofs=0 len=0 2024-06-04T16:12:14.374 INFO:tasks.workunit.client.0.smithi144.stderr: -24> 2024-06-04T16:12:14.296+0000 7f6cbcd3f800 20 rados_obj.operate() r=0 bl.length=189 2024-06-04T16:12:14.375 INFO:tasks.workunit.client.0.smithi144.stderr: -23> 2024-06-04T16:12:14.296+0000 7f6cbcd3f800 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2024-06-04T16:12:14.375 INFO:tasks.workunit.client.0.smithi144.stderr: -22> 2024-06-04T16:12:14.296+0000 7f6cbcd3f800 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2024-06-04T16:12:14.375 INFO:tasks.workunit.client.0.smithi144.stderr: -21> 2024-06-04T16:12:14.296+0000 7f6cbcd3f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.23 : miss 2024-06-04T16:12:14.375 INFO:tasks.workunit.client.0.smithi144.stderr: -20> 2024-06-04T16:12:14.296+0000 7f6cbcd3f800 20 rados->read ofs=0 len=0 2024-06-04T16:12:14.375 INFO:tasks.workunit.client.0.smithi144.stderr: -19> 2024-06-04T16:12:14.296+0000 7f6cbcd3f800 20 rados_obj.operate() r=0 bl.length=403 2024-06-04T16:12:14.375 INFO:tasks.workunit.client.0.smithi144.stderr: -18> 2024-06-04T16:12:14.296+0000 7f6cbcd3f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.23 info.flags=0x17 2024-06-04T16:12:14.375 INFO:tasks.workunit.client.0.smithi144.stderr: -17> 2024-06-04T16:12:14.296+0000 7f6cbcd3f800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.23 to cache LRU end 2024-06-04T16:12:14.375 INFO:tasks.workunit.client.0.smithi144.stderr: -16> 2024-06-04T16:12:14.296+0000 7f6cbcd3f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-06-04T16:12:14.375 INFO:tasks.workunit.client.0.smithi144.stderr: -15> 2024-06-04T16:12:14.296+0000 7f6cbcd3f800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-06-04T16:12:14.375 INFO:tasks.workunit.client.0.smithi144.stderr: -14> 2024-06-04T16:12:14.296+0000 7f6cbcd3f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.23 2024-06-04T16:12:14.375 INFO:tasks.workunit.client.0.smithi144.stderr: -13> 2024-06-04T16:12:14.303+0000 7f6cbcd3f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.23 info.flags=0x17 2024-06-04T16:12:14.375 INFO:tasks.workunit.client.0.smithi144.stderr: -12> 2024-06-04T16:12:14.303+0000 7f6cbcd3f800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.23 to cache LRU end 2024-06-04T16:12:14.375 INFO:tasks.workunit.client.0.smithi144.stderr: -11> 2024-06-04T16:12:14.303+0000 7f6cbcd3f800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-06-04T16:12:14.376 INFO:tasks.workunit.client.0.smithi144.stderr: -10> 2024-06-04T16:12:14.303+0000 7f6cbcd3f800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.23, ofs0, ns] 2024-06-04T16:12:14.376 INFO:tasks.workunit.client.0.smithi144.stderr: -9> 2024-06-04T16:12:14.304+0000 7f6b8f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1078036791403 cookie 94842362851664 notifier 6161 bl.length()=907 2024-06-04T16:12:14.376 INFO:tasks.workunit.client.0.smithi144.stderr: -8> 2024-06-04T16:12:14.304+0000 7f6b8f7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.23 info.flags=0x17 2024-06-04T16:12:14.376 INFO:tasks.workunit.client.0.smithi144.stderr: -7> 2024-06-04T16:12:14.304+0000 7f6b8f7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.23 to cache LRU end 2024-06-04T16:12:14.376 INFO:tasks.workunit.client.0.smithi144.stderr: -6> 2024-06-04T16:12:14.304+0000 7f6b8f7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-06-04T16:12:14.376 INFO:tasks.workunit.client.0.smithi144.stderr: -5> 2024-06-04T16:12:14.304+0000 7f6cbcd3f800 20 handle_bi_update(): bucket=:abort-at-block-writes[be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.23]): orig_sources= new_sources= 2024-06-04T16:12:14.376 INFO:tasks.workunit.client.0.smithi144.stderr: -4> 2024-06-04T16:12:14.304+0000 7f6cbcd3f800 20 handle_bi_update(): bucket=:abort-at-block-writes[be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.23]): potential sources added=[] removed=[] 2024-06-04T16:12:14.376 INFO:tasks.workunit.client.0.smithi144.stderr: -3> 2024-06-04T16:12:14.304+0000 7f6cbcd3f800 20 handle_bi_update(): bucket=:abort-at-block-writes[be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.23]): orig_dests= new_dests= 2024-06-04T16:12:14.376 INFO:tasks.workunit.client.0.smithi144.stderr: -2> 2024-06-04T16:12:14.304+0000 7f6cbcd3f800 20 handle_bi_update(): bucket=:abort-at-block-writes[be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.23]): potential dests added=[] removed=[] 2024-06-04T16:12:14.376 INFO:tasks.workunit.client.0.smithi144.stderr: -1> 2024-06-04T16:12:14.305+0000 7f6cbcd3f800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-4027-g65533a90/rpm/el9/BUILD/ceph-19.0.0-4027-g65533a90/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f6cbcd3f800 time 2024-06-04T16:12:14.305342+0000 2024-06-04T16:12:14.376 INFO:tasks.workunit.client.0.smithi144.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-4027-g65533a90/rpm/el9/BUILD/ceph-19.0.0-4027-g65533a90/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-06-04T16:12:14.376 INFO:tasks.workunit.client.0.smithi144.stderr: 2024-06-04T16:12:14.376 INFO:tasks.workunit.client.0.smithi144.stderr: ceph version 19.0.0-4027-g65533a90 (65533a907fc9add1863609703fdbbea67993c8ef) squid (dev) 2024-06-04T16:12:14.376 INFO:tasks.workunit.client.0.smithi144.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f6cbe381dce] 2024-06-04T16:12:14.376 INFO:tasks.workunit.client.0.smithi144.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x181f8c) [0x7f6cbe381f8c] 2024-06-04T16:12:14.376 INFO:tasks.workunit.client.0.smithi144.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x564234414fb1] 2024-06-04T16:12:14.377 INFO:tasks.workunit.client.0.smithi144.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x2bf) [0x56423442032f] 2024-06-04T16:12:14.377 INFO:tasks.workunit.client.0.smithi144.stderr: 5: main() 2024-06-04T16:12:14.377 INFO:tasks.workunit.client.0.smithi144.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7f6cbd229590] 2024-06-04T16:12:14.377 INFO:tasks.workunit.client.0.smithi144.stderr: 7: __libc_start_main() 2024-06-04T16:12:14.377 INFO:tasks.workunit.client.0.smithi144.stderr: 8: _start() 2024-06-04T16:12:14.377 INFO:tasks.workunit.client.0.smithi144.stderr: 2024-06-04T16:12:14.377 INFO:tasks.workunit.client.0.smithi144.stderr: 0> 2024-06-04T16:12:14.305+0000 7f6cbcd3f800 -1 *** Caught signal (Aborted) ** 2024-06-04T16:12:14.377 INFO:tasks.workunit.client.0.smithi144.stderr: in thread 7f6cbcd3f800 thread_name:radosgw-admin 2024-06-04T16:12:14.377 INFO:tasks.workunit.client.0.smithi144.stderr: 2024-06-04T16:12:14.377 INFO:tasks.workunit.client.0.smithi144.stderr: ceph version 19.0.0-4027-g65533a90 (65533a907fc9add1863609703fdbbea67993c8ef) squid (dev) 2024-06-04T16:12:14.377 INFO:tasks.workunit.client.0.smithi144.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f6cbd23e6f0] 2024-06-04T16:12:14.377 INFO:tasks.workunit.client.0.smithi144.stderr: 2: /lib64/libc.so.6(+0x8b94c) [0x7f6cbd28b94c] 2024-06-04T16:12:14.377 INFO:tasks.workunit.client.0.smithi144.stderr: 3: raise() 2024-06-04T16:12:14.378 INFO:tasks.workunit.client.0.smithi144.stderr: 4: abort() 2024-06-04T16:12:14.378 INFO:tasks.workunit.client.0.smithi144.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f6cbe381e28] 2024-06-04T16:12:14.378 INFO:tasks.workunit.client.0.smithi144.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x181f8c) [0x7f6cbe381f8c] 2024-06-04T16:12:14.378 INFO:tasks.workunit.client.0.smithi144.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x564234414fb1] 2024-06-04T16:12:14.378 INFO:tasks.workunit.client.0.smithi144.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x2bf) [0x56423442032f] 2024-06-04T16:12:14.378 INFO:tasks.workunit.client.0.smithi144.stderr: 9: main() 2024-06-04T16:12:14.378 INFO:tasks.workunit.client.0.smithi144.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7f6cbd229590] 2024-06-04T16:12:14.378 INFO:tasks.workunit.client.0.smithi144.stderr: 11: __libc_start_main() 2024-06-04T16:12:14.378 INFO:tasks.workunit.client.0.smithi144.stderr: 12: _start() 2024-06-04T16:12:14.378 INFO:tasks.workunit.client.0.smithi144.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-06-04T16:12:14.378 INFO:tasks.workunit.client.0.smithi144.stderr: 2024-06-04T16:12:14.378 INFO:tasks.workunit.client.0.smithi144.stderr:--- logging levels --- 2024-06-04T16:12:14.378 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 5 none 2024-06-04T16:12:14.379 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 1 lockdep 2024-06-04T16:12:14.379 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 1 context 2024-06-04T16:12:14.379 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 1 crush 2024-06-04T16:12:14.379 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 5 mds 2024-06-04T16:12:14.379 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 5 mds_balancer 2024-06-04T16:12:14.379 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 5 mds_locker 2024-06-04T16:12:14.379 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 5 mds_log 2024-06-04T16:12:14.379 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 5 mds_log_expire 2024-06-04T16:12:14.379 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 5 mds_migrator 2024-06-04T16:12:14.379 INFO:tasks.workunit.client.0.smithi144.stderr: 3/ 5 mds_quiesce 2024-06-04T16:12:14.379 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 1 buffer 2024-06-04T16:12:14.379 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 1 timer 2024-06-04T16:12:14.379 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 1 filer 2024-06-04T16:12:14.379 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 1 striper 2024-06-04T16:12:14.379 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 1 objecter 2024-06-04T16:12:14.380 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 5 rados 2024-06-04T16:12:14.380 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 5 rbd 2024-06-04T16:12:14.380 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 5 rbd_mirror 2024-06-04T16:12:14.380 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 5 rbd_replay 2024-06-04T16:12:14.380 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 5 rbd_pwl 2024-06-04T16:12:14.380 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 5 journaler 2024-06-04T16:12:14.380 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 5 objectcacher 2024-06-04T16:12:14.380 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 5 immutable_obj_cache 2024-06-04T16:12:14.380 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 5 client 2024-06-04T16:12:14.380 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 5 osd 2024-06-04T16:12:14.380 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 5 optracker 2024-06-04T16:12:14.380 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 5 objclass 2024-06-04T16:12:14.380 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 3 filestore 2024-06-04T16:12:14.381 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 3 journal 2024-06-04T16:12:14.381 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 0 ms 2024-06-04T16:12:14.381 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 5 mon 2024-06-04T16:12:14.381 INFO:tasks.workunit.client.0.smithi144.stderr: 0/10 monc 2024-06-04T16:12:14.381 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 5 paxos 2024-06-04T16:12:14.381 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 5 tp 2024-06-04T16:12:14.381 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 5 auth 2024-06-04T16:12:14.381 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 5 crypto 2024-06-04T16:12:14.381 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 1 finisher 2024-06-04T16:12:14.381 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 1 reserver 2024-06-04T16:12:14.381 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 5 heartbeatmap 2024-06-04T16:12:14.381 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 5 perfcounter 2024-06-04T16:12:14.381 INFO:tasks.workunit.client.0.smithi144.stderr: 20/20 rgw 2024-06-04T16:12:14.382 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 5 rgw_sync 2024-06-04T16:12:14.382 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 5 rgw_datacache 2024-06-04T16:12:14.382 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 5 rgw_access 2024-06-04T16:12:14.382 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 5 rgw_dbstore 2024-06-04T16:12:14.382 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 5 rgw_flight 2024-06-04T16:12:14.382 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 5 rgw_lifecycle 2024-06-04T16:12:14.382 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 5 rgw_notification 2024-06-04T16:12:14.382 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 5 javaclient 2024-06-04T16:12:14.382 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 5 asok 2024-06-04T16:12:14.382 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 1 throttle 2024-06-04T16:12:14.382 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 0 refs 2024-06-04T16:12:14.382 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 5 compressor 2024-06-04T16:12:14.383 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 5 bluestore 2024-06-04T16:12:14.383 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 5 bluefs 2024-06-04T16:12:14.383 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 3 bdev 2024-06-04T16:12:14.383 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 5 kstore 2024-06-04T16:12:14.383 INFO:tasks.workunit.client.0.smithi144.stderr: 4/ 5 rocksdb 2024-06-04T16:12:14.383 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 5 fuse 2024-06-04T16:12:14.383 INFO:tasks.workunit.client.0.smithi144.stderr: 2/ 5 mgr 2024-06-04T16:12:14.383 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 5 mgrc 2024-06-04T16:12:14.383 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 5 dpdk 2024-06-04T16:12:14.383 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 5 eventtrace 2024-06-04T16:12:14.383 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 5 prioritycache 2024-06-04T16:12:14.383 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 5 test 2024-06-04T16:12:14.383 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 5 cephfs_mirror 2024-06-04T16:12:14.383 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 5 cephsqlite 2024-06-04T16:12:14.384 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 5 crimson_interrupt 2024-06-04T16:12:14.384 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 5 seastore 2024-06-04T16:12:14.384 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 5 seastore_onode 2024-06-04T16:12:14.384 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 5 seastore_odata 2024-06-04T16:12:14.384 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 5 seastore_omap 2024-06-04T16:12:14.384 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 5 seastore_tm 2024-06-04T16:12:14.384 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 5 seastore_t 2024-06-04T16:12:14.384 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 5 seastore_cleaner 2024-06-04T16:12:14.384 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 5 seastore_epm 2024-06-04T16:12:14.384 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 5 seastore_lba 2024-06-04T16:12:14.384 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 5 seastore_fixedkv_tree 2024-06-04T16:12:14.384 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 5 seastore_cache 2024-06-04T16:12:14.384 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 5 seastore_journal 2024-06-04T16:12:14.384 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 5 seastore_device 2024-06-04T16:12:14.385 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 5 seastore_backref 2024-06-04T16:12:14.385 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 5 alienstore 2024-06-04T16:12:14.385 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 5 mclock 2024-06-04T16:12:14.385 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 5 cyanstore 2024-06-04T16:12:14.385 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 5 ceph_exporter 2024-06-04T16:12:14.385 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 5 memstore 2024-06-04T16:12:14.385 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 5 trace 2024-06-04T16:12:14.385 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 5 ceph_dedup 2024-06-04T16:12:14.385 INFO:tasks.workunit.client.0.smithi144.stderr: -2/-2 (syslog threshold) 2024-06-04T16:12:14.385 INFO:tasks.workunit.client.0.smithi144.stderr: 99/99 (stderr threshold) 2024-06-04T16:12:14.385 INFO:tasks.workunit.client.0.smithi144.stderr:--- pthread ID / name mapping for recent threads --- 2024-06-04T16:12:14.385 INFO:tasks.workunit.client.0.smithi144.stderr: 7f6adf7fe640 / http_manager 2024-06-04T16:12:14.385 INFO:tasks.workunit.client.0.smithi144.stderr: 7f6b6dfe3640 / http_manager 2024-06-04T16:12:14.385 INFO:tasks.workunit.client.0.smithi144.stderr: 7f6b6efe5640 / rgw_dt_lg_renew 2024-06-04T16:12:14.385 INFO:tasks.workunit.client.0.smithi144.stderr: 7f6b8e7fc640 / ms_dispatch 2024-06-04T16:12:14.386 INFO:tasks.workunit.client.0.smithi144.stderr: 7f6b8f7fe640 / io_context_pool 2024-06-04T16:12:14.386 INFO:tasks.workunit.client.0.smithi144.stderr: 7f6b8ffff640 / io_context_pool 2024-06-04T16:12:14.386 INFO:tasks.workunit.client.0.smithi144.stderr: 7f6b9e7fc640 / ms_dispatch 2024-06-04T16:12:14.386 INFO:tasks.workunit.client.0.smithi144.stderr: 7f6ba5602640 / ms_dispatch 2024-06-04T16:12:14.386 INFO:tasks.workunit.client.0.smithi144.stderr: 7f6ba6e05640 / io_context_pool 2024-06-04T16:12:14.386 INFO:tasks.workunit.client.0.smithi144.stderr: 7f6cb3fff640 / msgr-worker-2 2024-06-04T16:12:14.386 INFO:tasks.workunit.client.0.smithi144.stderr: 7f6cb8a91640 / msgr-worker-1 2024-06-04T16:12:14.386 INFO:tasks.workunit.client.0.smithi144.stderr: 7f6cb9292640 / msgr-worker-0 2024-06-04T16:12:14.386 INFO:tasks.workunit.client.0.smithi144.stderr: 7f6cb9a93640 / io_context_pool 2024-06-04T16:12:14.386 INFO:tasks.workunit.client.0.smithi144.stderr: 7f6cbcd3f800 / radosgw-admin 2024-06-04T16:12:14.386 INFO:tasks.workunit.client.0.smithi144.stderr: max_recent 500 2024-06-04T16:12:14.386 INFO:tasks.workunit.client.0.smithi144.stderr: max_new 1000 2024-06-04T16:12:14.386 INFO:tasks.workunit.client.0.smithi144.stderr: log_file /var/log/ceph/ceph-client.admin.96254.log 2024-06-04T16:12:14.387 INFO:tasks.workunit.client.0.smithi144.stderr:--- end dump of recent events --- 2024-06-04T16:12:14.387 INFO:tasks.workunit.client.0.smithi144.stderr:--- begin dump of recent events --- 2024-06-04T16:12:14.387 INFO:tasks.workunit.client.0.smithi144.stderr: -499> 2024-06-04T16:12:14.050+0000 7f6cbcd3f800 10 monclient: build_initial_monmap 2024-06-04T16:12:14.387 INFO:tasks.workunit.client.0.smithi144.stderr: -498> 2024-06-04T16:12:14.050+0000 7f6cbcd3f800 1 build_initial for_mkfs: 0 2024-06-04T16:12:14.387 INFO:tasks.workunit.client.0.smithi144.stderr: -497> 2024-06-04T16:12:14.050+0000 7f6cbcd3f800 10 monclient: monmap: 2024-06-04T16:12:14.387 INFO:tasks.workunit.client.0.smithi144.stderr:epoch 0 2024-06-04T16:12:14.387 INFO:tasks.workunit.client.0.smithi144.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-06-04T16:12:14.387 INFO:tasks.workunit.client.0.smithi144.stderr:last_changed 0.000000 2024-06-04T16:12:14.387 INFO:tasks.workunit.client.0.smithi144.stderr:created 0.000000 2024-06-04T16:12:14.387 INFO:tasks.workunit.client.0.smithi144.stderr:min_mon_release 0 (unknown) 2024-06-04T16:12:14.387 INFO:tasks.workunit.client.0.smithi144.stderr:election_strategy: 1 2024-06-04T16:12:14.387 INFO:tasks.workunit.client.0.smithi144.stderr:0: [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] mon.noname-a 2024-06-04T16:12:14.387 INFO:tasks.workunit.client.0.smithi144.stderr:1: [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] mon.noname-b 2024-06-04T16:12:14.387 INFO:tasks.workunit.client.0.smithi144.stderr:2: [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] mon.noname-c 2024-06-04T16:12:14.388 INFO:tasks.workunit.client.0.smithi144.stderr: 2024-06-04T16:12:14.388 INFO:tasks.workunit.client.0.smithi144.stderr: -496> 2024-06-04T16:12:14.050+0000 7f6cbcd3f800 5 AuthRegistry(0x564235497c70) adding auth protocol: cephx 2024-06-04T16:12:14.388 INFO:tasks.workunit.client.0.smithi144.stderr: -495> 2024-06-04T16:12:14.050+0000 7f6cbcd3f800 5 AuthRegistry(0x564235497c70) adding auth protocol: cephx 2024-06-04T16:12:14.388 INFO:tasks.workunit.client.0.smithi144.stderr: -494> 2024-06-04T16:12:14.050+0000 7f6cbcd3f800 5 AuthRegistry(0x564235497c70) adding auth protocol: cephx 2024-06-04T16:12:14.388 INFO:tasks.workunit.client.0.smithi144.stderr: -493> 2024-06-04T16:12:14.050+0000 7f6cbcd3f800 5 AuthRegistry(0x564235497c70) adding con mode: secure 2024-06-04T16:12:14.388 INFO:tasks.workunit.client.0.smithi144.stderr: -492> 2024-06-04T16:12:14.050+0000 7f6cbcd3f800 5 AuthRegistry(0x564235497c70) adding con mode: crc 2024-06-04T16:12:14.388 INFO:tasks.workunit.client.0.smithi144.stderr: -491> 2024-06-04T16:12:14.050+0000 7f6cbcd3f800 5 AuthRegistry(0x564235497c70) adding con mode: secure 2024-06-04T16:12:14.388 INFO:tasks.workunit.client.0.smithi144.stderr: -490> 2024-06-04T16:12:14.050+0000 7f6cbcd3f800 5 AuthRegistry(0x564235497c70) adding con mode: crc 2024-06-04T16:12:14.388 INFO:tasks.workunit.client.0.smithi144.stderr: -489> 2024-06-04T16:12:14.050+0000 7f6cbcd3f800 5 AuthRegistry(0x564235497c70) adding con mode: secure 2024-06-04T16:12:14.388 INFO:tasks.workunit.client.0.smithi144.stderr: -488> 2024-06-04T16:12:14.050+0000 7f6cbcd3f800 5 AuthRegistry(0x564235497c70) adding con mode: crc 2024-06-04T16:12:14.388 INFO:tasks.workunit.client.0.smithi144.stderr: -487> 2024-06-04T16:12:14.050+0000 7f6cbcd3f800 5 AuthRegistry(0x564235497c70) adding con mode: crc 2024-06-04T16:12:14.388 INFO:tasks.workunit.client.0.smithi144.stderr: -486> 2024-06-04T16:12:14.050+0000 7f6cbcd3f800 5 AuthRegistry(0x564235497c70) adding con mode: secure 2024-06-04T16:12:14.388 INFO:tasks.workunit.client.0.smithi144.stderr: -485> 2024-06-04T16:12:14.050+0000 7f6cbcd3f800 5 AuthRegistry(0x564235497c70) adding con mode: crc 2024-06-04T16:12:14.388 INFO:tasks.workunit.client.0.smithi144.stderr: -484> 2024-06-04T16:12:14.050+0000 7f6cbcd3f800 5 AuthRegistry(0x564235497c70) adding con mode: secure 2024-06-04T16:12:14.388 INFO:tasks.workunit.client.0.smithi144.stderr: -483> 2024-06-04T16:12:14.050+0000 7f6cbcd3f800 5 AuthRegistry(0x564235497c70) adding con mode: crc 2024-06-04T16:12:14.389 INFO:tasks.workunit.client.0.smithi144.stderr: -482> 2024-06-04T16:12:14.050+0000 7f6cbcd3f800 5 AuthRegistry(0x564235497c70) adding con mode: secure 2024-06-04T16:12:14.389 INFO:tasks.workunit.client.0.smithi144.stderr: -481> 2024-06-04T16:12:14.050+0000 7f6cbcd3f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-06-04T16:12:14.389 INFO:tasks.workunit.client.0.smithi144.stderr: -480> 2024-06-04T16:12:14.050+0000 7f6cbcd3f800 1 librados: starting msgr at 2024-06-04T16:12:14.389 INFO:tasks.workunit.client.0.smithi144.stderr: -479> 2024-06-04T16:12:14.050+0000 7f6cbcd3f800 1 librados: starting objecter 2024-06-04T16:12:14.389 INFO:tasks.workunit.client.0.smithi144.stderr: -478> 2024-06-04T16:12:14.050+0000 7f6cbcd3f800 5 asok(0x564235270c60) register_command objecter_requests hook 0x5642354c2d30 2024-06-04T16:12:14.389 INFO:tasks.workunit.client.0.smithi144.stderr: -477> 2024-06-04T16:12:14.050+0000 7f6cbcd3f800 1 librados: setting wanted keys 2024-06-04T16:12:14.389 INFO:tasks.workunit.client.0.smithi144.stderr: -476> 2024-06-04T16:12:14.050+0000 7f6cbcd3f800 1 librados: calling monclient init 2024-06-04T16:12:14.389 INFO:tasks.workunit.client.0.smithi144.stderr: -475> 2024-06-04T16:12:14.050+0000 7f6cbcd3f800 10 monclient: init 2024-06-04T16:12:14.389 INFO:tasks.workunit.client.0.smithi144.stderr: -474> 2024-06-04T16:12:14.050+0000 7f6cbcd3f800 5 AuthRegistry(0x564235490db0) adding auth protocol: cephx 2024-06-04T16:12:14.389 INFO:tasks.workunit.client.0.smithi144.stderr: -473> 2024-06-04T16:12:14.050+0000 7f6cbcd3f800 5 AuthRegistry(0x564235490db0) adding auth protocol: cephx 2024-06-04T16:12:14.389 INFO:tasks.workunit.client.0.smithi144.stderr: -472> 2024-06-04T16:12:14.050+0000 7f6cbcd3f800 5 AuthRegistry(0x564235490db0) adding auth protocol: cephx 2024-06-04T16:12:14.389 INFO:tasks.workunit.client.0.smithi144.stderr: -471> 2024-06-04T16:12:14.050+0000 7f6cbcd3f800 5 AuthRegistry(0x564235490db0) adding con mode: secure 2024-06-04T16:12:14.389 INFO:tasks.workunit.client.0.smithi144.stderr: -470> 2024-06-04T16:12:14.050+0000 7f6cbcd3f800 5 AuthRegistry(0x564235490db0) adding con mode: crc 2024-06-04T16:12:14.389 INFO:tasks.workunit.client.0.smithi144.stderr: -469> 2024-06-04T16:12:14.050+0000 7f6cbcd3f800 5 AuthRegistry(0x564235490db0) adding con mode: secure 2024-06-04T16:12:14.390 INFO:tasks.workunit.client.0.smithi144.stderr: -468> 2024-06-04T16:12:14.050+0000 7f6cbcd3f800 5 AuthRegistry(0x564235490db0) adding con mode: crc 2024-06-04T16:12:14.390 INFO:tasks.workunit.client.0.smithi144.stderr: -467> 2024-06-04T16:12:14.050+0000 7f6cbcd3f800 5 AuthRegistry(0x564235490db0) adding con mode: secure 2024-06-04T16:12:14.390 INFO:tasks.workunit.client.0.smithi144.stderr: -466> 2024-06-04T16:12:14.050+0000 7f6cbcd3f800 5 AuthRegistry(0x564235490db0) adding con mode: crc 2024-06-04T16:12:14.390 INFO:tasks.workunit.client.0.smithi144.stderr: -465> 2024-06-04T16:12:14.050+0000 7f6cbcd3f800 5 AuthRegistry(0x564235490db0) adding con mode: crc 2024-06-04T16:12:14.390 INFO:tasks.workunit.client.0.smithi144.stderr: -464> 2024-06-04T16:12:14.050+0000 7f6cbcd3f800 5 AuthRegistry(0x564235490db0) adding con mode: secure 2024-06-04T16:12:14.390 INFO:tasks.workunit.client.0.smithi144.stderr: -463> 2024-06-04T16:12:14.050+0000 7f6cbcd3f800 5 AuthRegistry(0x564235490db0) adding con mode: crc 2024-06-04T16:12:14.390 INFO:tasks.workunit.client.0.smithi144.stderr: -462> 2024-06-04T16:12:14.050+0000 7f6cbcd3f800 5 AuthRegistry(0x564235490db0) adding con mode: secure 2024-06-04T16:12:14.390 INFO:tasks.workunit.client.0.smithi144.stderr: -461> 2024-06-04T16:12:14.050+0000 7f6cbcd3f800 5 AuthRegistry(0x564235490db0) adding con mode: crc 2024-06-04T16:12:14.390 INFO:tasks.workunit.client.0.smithi144.stderr: -460> 2024-06-04T16:12:14.050+0000 7f6cbcd3f800 5 AuthRegistry(0x564235490db0) adding con mode: secure 2024-06-04T16:12:14.390 INFO:tasks.workunit.client.0.smithi144.stderr: -459> 2024-06-04T16:12:14.050+0000 7f6cbcd3f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-06-04T16:12:14.390 INFO:tasks.workunit.client.0.smithi144.stderr: -458> 2024-06-04T16:12:14.051+0000 7f6cbcd3f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-06-04T16:12:14.390 INFO:tasks.workunit.client.0.smithi144.stderr: -457> 2024-06-04T16:12:14.051+0000 7f6cbcd3f800 5 asok(0x564235270c60) register_command rotate-key hook 0x564235490ef8 2024-06-04T16:12:14.390 INFO:tasks.workunit.client.0.smithi144.stderr: -456> 2024-06-04T16:12:14.051+0000 7f6cbcd3f800 10 monclient: _reopen_session rank -1 2024-06-04T16:12:14.391 INFO:tasks.workunit.client.0.smithi144.stderr: -455> 2024-06-04T16:12:14.051+0000 7f6cbcd3f800 10 monclient: _add_conns ranks=[0,1,2] 2024-06-04T16:12:14.391 INFO:tasks.workunit.client.0.smithi144.stderr: -454> 2024-06-04T16:12:14.051+0000 7f6cbcd3f800 10 monclient(hunting): picked mon.noname-a con 0x564235347e20 addr [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] 2024-06-04T16:12:14.391 INFO:tasks.workunit.client.0.smithi144.stderr: -453> 2024-06-04T16:12:14.051+0000 7f6cbcd3f800 10 monclient(hunting): picked mon.noname-b con 0x5642353d8080 addr [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] 2024-06-04T16:12:14.391 INFO:tasks.workunit.client.0.smithi144.stderr: -452> 2024-06-04T16:12:14.051+0000 7f6cbcd3f800 10 monclient(hunting): picked mon.noname-c con 0x564235497500 addr [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] 2024-06-04T16:12:14.391 INFO:tasks.workunit.client.0.smithi144.stderr: -451> 2024-06-04T16:12:14.051+0000 7f6cbcd3f800 10 monclient(hunting): start opening mon connection 2024-06-04T16:12:14.391 INFO:tasks.workunit.client.0.smithi144.stderr: -450> 2024-06-04T16:12:14.051+0000 7f6cbcd3f800 10 monclient(hunting): start opening mon connection 2024-06-04T16:12:14.391 INFO:tasks.workunit.client.0.smithi144.stderr: -449> 2024-06-04T16:12:14.051+0000 7f6cbcd3f800 10 monclient(hunting): start opening mon connection 2024-06-04T16:12:14.391 INFO:tasks.workunit.client.0.smithi144.stderr: -448> 2024-06-04T16:12:14.051+0000 7f6cbcd3f800 10 monclient(hunting): _renew_subs 2024-06-04T16:12:14.391 INFO:tasks.workunit.client.0.smithi144.stderr: -447> 2024-06-04T16:12:14.051+0000 7f6cbcd3f800 10 monclient(hunting): authenticate will time out at 1971.867366s 2024-06-04T16:12:14.391 INFO:tasks.workunit.client.0.smithi144.stderr: -446> 2024-06-04T16:12:14.051+0000 7f6cb8a91640 10 monclient(hunting): get_auth_request con 0x564235347e20 auth_method 0 2024-06-04T16:12:14.391 INFO:tasks.workunit.client.0.smithi144.stderr: -445> 2024-06-04T16:12:14.051+0000 7f6cb8a91640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-06-04T16:12:14.391 INFO:tasks.workunit.client.0.smithi144.stderr: -444> 2024-06-04T16:12:14.051+0000 7f6cb8a91640 10 monclient(hunting): _init_auth method 2 2024-06-04T16:12:14.391 INFO:tasks.workunit.client.0.smithi144.stderr: -443> 2024-06-04T16:12:14.051+0000 7f6cb8a91640 10 monclient(hunting): _init_auth creating new auth 2024-06-04T16:12:14.391 INFO:tasks.workunit.client.0.smithi144.stderr: -442> 2024-06-04T16:12:14.051+0000 7f6cb9292640 10 monclient(hunting): get_auth_request con 0x564235497500 auth_method 0 2024-06-04T16:12:14.392 INFO:tasks.workunit.client.0.smithi144.stderr: -441> 2024-06-04T16:12:14.051+0000 7f6cb9292640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-06-04T16:12:14.392 INFO:tasks.workunit.client.0.smithi144.stderr: -440> 2024-06-04T16:12:14.051+0000 7f6cb9292640 10 monclient(hunting): _init_auth method 2 2024-06-04T16:12:14.392 INFO:tasks.workunit.client.0.smithi144.stderr: -439> 2024-06-04T16:12:14.051+0000 7f6cb9292640 10 monclient(hunting): _init_auth creating new auth 2024-06-04T16:12:14.392 INFO:tasks.workunit.client.0.smithi144.stderr: -438> 2024-06-04T16:12:14.051+0000 7f6cb8a91640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-06-04T16:12:14.392 INFO:tasks.workunit.client.0.smithi144.stderr: -437> 2024-06-04T16:12:14.051+0000 7f6cb8a91640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-06-04T16:12:14.392 INFO:tasks.workunit.client.0.smithi144.stderr: -436> 2024-06-04T16:12:14.051+0000 7f6cb8a91640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-06-04T16:12:14.392 INFO:tasks.workunit.client.0.smithi144.stderr: -435> 2024-06-04T16:12:14.051+0000 7f6cb3fff640 10 monclient(hunting): get_auth_request con 0x5642353d8080 auth_method 0 2024-06-04T16:12:14.392 INFO:tasks.workunit.client.0.smithi144.stderr: -434> 2024-06-04T16:12:14.051+0000 7f6cb3fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-06-04T16:12:14.392 INFO:tasks.workunit.client.0.smithi144.stderr: -433> 2024-06-04T16:12:14.051+0000 7f6cb3fff640 10 monclient(hunting): _init_auth method 2 2024-06-04T16:12:14.392 INFO:tasks.workunit.client.0.smithi144.stderr: -432> 2024-06-04T16:12:14.051+0000 7f6cb3fff640 10 monclient(hunting): _init_auth creating new auth 2024-06-04T16:12:14.392 INFO:tasks.workunit.client.0.smithi144.stderr: -431> 2024-06-04T16:12:14.051+0000 7f6cb9292640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-06-04T16:12:14.392 INFO:tasks.workunit.client.0.smithi144.stderr: -430> 2024-06-04T16:12:14.051+0000 7f6cb9292640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-06-04T16:12:14.392 INFO:tasks.workunit.client.0.smithi144.stderr: -429> 2024-06-04T16:12:14.051+0000 7f6cb9292640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-06-04T16:12:14.392 INFO:tasks.workunit.client.0.smithi144.stderr: -428> 2024-06-04T16:12:14.051+0000 7f6cb3fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-06-04T16:12:14.392 INFO:tasks.workunit.client.0.smithi144.stderr: -427> 2024-06-04T16:12:14.051+0000 7f6cb3fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-06-04T16:12:14.393 INFO:tasks.workunit.client.0.smithi144.stderr: -426> 2024-06-04T16:12:14.051+0000 7f6cb3fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-06-04T16:12:14.393 INFO:tasks.workunit.client.0.smithi144.stderr: -425> 2024-06-04T16:12:14.051+0000 7f6cb8a91640 10 monclient(hunting): handle_auth_done global_id 6474 payload 824 2024-06-04T16:12:14.393 INFO:tasks.workunit.client.0.smithi144.stderr: -424> 2024-06-04T16:12:14.051+0000 7f6cb8a91640 10 monclient: _finish_hunting 0 2024-06-04T16:12:14.393 INFO:tasks.workunit.client.0.smithi144.stderr: -423> 2024-06-04T16:12:14.051+0000 7f6cb8a91640 1 monclient: found mon.noname-a 2024-06-04T16:12:14.393 INFO:tasks.workunit.client.0.smithi144.stderr: -422> 2024-06-04T16:12:14.051+0000 7f6cb8a91640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.144:3300/0 2024-06-04T16:12:14.393 INFO:tasks.workunit.client.0.smithi144.stderr: -421> 2024-06-04T16:12:14.051+0000 7f6ba5602640 10 monclient: handle_monmap mon_map magic: 0 2024-06-04T16:12:14.393 INFO:tasks.workunit.client.0.smithi144.stderr: -420> 2024-06-04T16:12:14.051+0000 7f6ba5602640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-06-04T16:12:14.393 INFO:tasks.workunit.client.0.smithi144.stderr: -419> 2024-06-04T16:12:14.051+0000 7f6ba5602640 10 monclient: dump: 2024-06-04T16:12:14.393 INFO:tasks.workunit.client.0.smithi144.stderr:epoch 1 2024-06-04T16:12:14.393 INFO:tasks.workunit.client.0.smithi144.stderr:fsid 15e56bb1-4856-42f3-b6db-a2c8f23c5557 2024-06-04T16:12:14.393 INFO:tasks.workunit.client.0.smithi144.stderr:last_changed 2024-06-04T15:51:29.789359+0000 2024-06-04T16:12:14.393 INFO:tasks.workunit.client.0.smithi144.stderr:created 2024-06-04T15:51:29.789359+0000 2024-06-04T16:12:14.393 INFO:tasks.workunit.client.0.smithi144.stderr:min_mon_release 19 (squid) 2024-06-04T16:12:14.394 INFO:tasks.workunit.client.0.smithi144.stderr:election_strategy: 1 2024-06-04T16:12:14.394 INFO:tasks.workunit.client.0.smithi144.stderr:0: [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] mon.a 2024-06-04T16:12:14.394 INFO:tasks.workunit.client.0.smithi144.stderr:1: [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] mon.b 2024-06-04T16:12:14.394 INFO:tasks.workunit.client.0.smithi144.stderr:2: [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] mon.c 2024-06-04T16:12:14.394 INFO:tasks.workunit.client.0.smithi144.stderr: 2024-06-04T16:12:14.394 INFO:tasks.workunit.client.0.smithi144.stderr: -418> 2024-06-04T16:12:14.051+0000 7f6ba5602640 10 monclient: _finish_auth 0 2024-06-04T16:12:14.394 INFO:tasks.workunit.client.0.smithi144.stderr: -417> 2024-06-04T16:12:14.051+0000 7f6ba5602640 10 monclient: _check_auth_tickets 2024-06-04T16:12:14.394 INFO:tasks.workunit.client.0.smithi144.stderr: -416> 2024-06-04T16:12:14.051+0000 7f6ba5602640 10 monclient: handle_config config(0 keys) 2024-06-04T16:12:14.394 INFO:tasks.workunit.client.0.smithi144.stderr: -415> 2024-06-04T16:12:14.051+0000 7f6ba5602640 10 monclient: handle_monmap mon_map magic: 0 2024-06-04T16:12:14.394 INFO:tasks.workunit.client.0.smithi144.stderr: -414> 2024-06-04T16:12:14.051+0000 7f6ba5602640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-06-04T16:12:14.394 INFO:tasks.workunit.client.0.smithi144.stderr: -413> 2024-06-04T16:12:14.051+0000 7f6ba5602640 10 monclient: dump: 2024-06-04T16:12:14.394 INFO:tasks.workunit.client.0.smithi144.stderr:epoch 1 2024-06-04T16:12:14.394 INFO:tasks.workunit.client.0.smithi144.stderr:fsid 15e56bb1-4856-42f3-b6db-a2c8f23c5557 2024-06-04T16:12:14.394 INFO:tasks.workunit.client.0.smithi144.stderr:last_changed 2024-06-04T15:51:29.789359+0000 2024-06-04T16:12:14.395 INFO:tasks.workunit.client.0.smithi144.stderr:created 2024-06-04T15:51:29.789359+0000 2024-06-04T16:12:14.395 INFO:tasks.workunit.client.0.smithi144.stderr:min_mon_release 19 (squid) 2024-06-04T16:12:14.395 INFO:tasks.workunit.client.0.smithi144.stderr:election_strategy: 1 2024-06-04T16:12:14.395 INFO:tasks.workunit.client.0.smithi144.stderr:0: [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] mon.a 2024-06-04T16:12:14.395 INFO:tasks.workunit.client.0.smithi144.stderr:1: [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] mon.b 2024-06-04T16:12:14.395 INFO:tasks.workunit.client.0.smithi144.stderr:2: [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] mon.c 2024-06-04T16:12:14.395 INFO:tasks.workunit.client.0.smithi144.stderr: 2024-06-04T16:12:14.395 INFO:tasks.workunit.client.0.smithi144.stderr: -412> 2024-06-04T16:12:14.051+0000 7f6cbcd3f800 5 monclient: authenticate success, global_id 6474 2024-06-04T16:12:14.395 INFO:tasks.workunit.client.0.smithi144.stderr: -411> 2024-06-04T16:12:14.051+0000 7f6cbcd3f800 10 monclient: _renew_subs 2024-06-04T16:12:14.395 INFO:tasks.workunit.client.0.smithi144.stderr: -410> 2024-06-04T16:12:14.051+0000 7f6cbcd3f800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.144:3300/0 2024-06-04T16:12:14.395 INFO:tasks.workunit.client.0.smithi144.stderr: -409> 2024-06-04T16:12:14.051+0000 7f6ba6e05640 4 set_mon_vals no callback set 2024-06-04T16:12:14.395 INFO:tasks.workunit.client.0.smithi144.stderr: -408> 2024-06-04T16:12:14.051+0000 7f6cbcd3f800 10 monclient: _renew_subs 2024-06-04T16:12:14.395 INFO:tasks.workunit.client.0.smithi144.stderr: -407> 2024-06-04T16:12:14.051+0000 7f6cbcd3f800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.144:3300/0 2024-06-04T16:12:14.395 INFO:tasks.workunit.client.0.smithi144.stderr: -406> 2024-06-04T16:12:14.051+0000 7f6cbcd3f800 1 librados: init done 2024-06-04T16:12:14.395 INFO:tasks.workunit.client.0.smithi144.stderr: -405> 2024-06-04T16:12:14.053+0000 7f6ba5602640 4 mgrc handle_mgr_map Got map version 5 2024-06-04T16:12:14.396 INFO:tasks.workunit.client.0.smithi144.stderr: -404> 2024-06-04T16:12:14.053+0000 7f6ba5602640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.177:6832/2645786330,v1:172.21.15.177:6833/2645786330] 2024-06-04T16:12:14.396 INFO:tasks.workunit.client.0.smithi144.stderr: -403> 2024-06-04T16:12:14.053+0000 7f6ba5602640 4 mgrc reconnect Starting new session with [v2:172.21.15.177:6832/2645786330,v1:172.21.15.177:6833/2645786330] 2024-06-04T16:12:14.396 INFO:tasks.workunit.client.0.smithi144.stderr: -402> 2024-06-04T16:12:14.054+0000 7f6cb3fff640 10 monclient: get_auth_request con 0x7f6ba0074ce0 auth_method 0 2024-06-04T16:12:14.396 INFO:tasks.workunit.client.0.smithi144.stderr: -401> 2024-06-04T16:12:14.054+0000 7f6cb9292640 10 monclient: get_auth_request con 0x5642354b9790 auth_method 0 2024-06-04T16:12:14.396 INFO:tasks.workunit.client.0.smithi144.stderr: -400> 2024-06-04T16:12:14.055+0000 7f6cb8a91640 10 monclient: get_auth_request con 0x5642354dc390 auth_method 0 2024-06-04T16:12:14.396 INFO:tasks.workunit.client.0.smithi144.stderr: -399> 2024-06-04T16:12:14.055+0000 7f6cb3fff640 10 monclient: get_auth_request con 0x5642354e0580 auth_method 0 2024-06-04T16:12:14.396 INFO:tasks.workunit.client.0.smithi144.stderr: -398> 2024-06-04T16:12:14.056+0000 7f6cb9292640 10 monclient: get_auth_request con 0x5642354dfc10 auth_method 0 2024-06-04T16:12:14.396 INFO:tasks.workunit.client.0.smithi144.stderr: -397> 2024-06-04T16:12:14.057+0000 7f6cbcd3f800 10 monclient: build_initial_monmap 2024-06-04T16:12:14.396 INFO:tasks.workunit.client.0.smithi144.stderr: -396> 2024-06-04T16:12:14.057+0000 7f6cbcd3f800 1 build_initial for_mkfs: 0 2024-06-04T16:12:14.396 INFO:tasks.workunit.client.0.smithi144.stderr: -395> 2024-06-04T16:12:14.057+0000 7f6cbcd3f800 10 monclient: monmap: 2024-06-04T16:12:14.396 INFO:tasks.workunit.client.0.smithi144.stderr:epoch 0 2024-06-04T16:12:14.396 INFO:tasks.workunit.client.0.smithi144.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-06-04T16:12:14.397 INFO:tasks.workunit.client.0.smithi144.stderr:last_changed 0.000000 2024-06-04T16:12:14.397 INFO:tasks.workunit.client.0.smithi144.stderr:created 0.000000 2024-06-04T16:12:14.397 INFO:tasks.workunit.client.0.smithi144.stderr:min_mon_release 0 (unknown) 2024-06-04T16:12:14.397 INFO:tasks.workunit.client.0.smithi144.stderr:election_strategy: 1 2024-06-04T16:12:14.397 INFO:tasks.workunit.client.0.smithi144.stderr:0: [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] mon.noname-a 2024-06-04T16:12:14.397 INFO:tasks.workunit.client.0.smithi144.stderr:1: [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] mon.noname-b 2024-06-04T16:12:14.397 INFO:tasks.workunit.client.0.smithi144.stderr:2: [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] mon.noname-c 2024-06-04T16:12:14.397 INFO:tasks.workunit.client.0.smithi144.stderr: 2024-06-04T16:12:14.397 INFO:tasks.workunit.client.0.smithi144.stderr: -394> 2024-06-04T16:12:14.057+0000 7f6cbcd3f800 5 AuthRegistry(0x5642354e8600) adding auth protocol: cephx 2024-06-04T16:12:14.397 INFO:tasks.workunit.client.0.smithi144.stderr: -393> 2024-06-04T16:12:14.057+0000 7f6cbcd3f800 5 AuthRegistry(0x5642354e8600) adding auth protocol: cephx 2024-06-04T16:12:14.397 INFO:tasks.workunit.client.0.smithi144.stderr: -392> 2024-06-04T16:12:14.057+0000 7f6cbcd3f800 5 AuthRegistry(0x5642354e8600) adding auth protocol: cephx 2024-06-04T16:12:14.397 INFO:tasks.workunit.client.0.smithi144.stderr: -391> 2024-06-04T16:12:14.057+0000 7f6cbcd3f800 5 AuthRegistry(0x5642354e8600) adding con mode: secure 2024-06-04T16:12:14.397 INFO:tasks.workunit.client.0.smithi144.stderr: -390> 2024-06-04T16:12:14.057+0000 7f6cbcd3f800 5 AuthRegistry(0x5642354e8600) adding con mode: crc 2024-06-04T16:12:14.398 INFO:tasks.workunit.client.0.smithi144.stderr: -389> 2024-06-04T16:12:14.057+0000 7f6cbcd3f800 5 AuthRegistry(0x5642354e8600) adding con mode: secure 2024-06-04T16:12:14.398 INFO:tasks.workunit.client.0.smithi144.stderr: -388> 2024-06-04T16:12:14.057+0000 7f6cbcd3f800 5 AuthRegistry(0x5642354e8600) adding con mode: crc 2024-06-04T16:12:14.398 INFO:tasks.workunit.client.0.smithi144.stderr: -387> 2024-06-04T16:12:14.057+0000 7f6cbcd3f800 5 AuthRegistry(0x5642354e8600) adding con mode: secure 2024-06-04T16:12:14.398 INFO:tasks.workunit.client.0.smithi144.stderr: -386> 2024-06-04T16:12:14.057+0000 7f6cbcd3f800 5 AuthRegistry(0x5642354e8600) adding con mode: crc 2024-06-04T16:12:14.398 INFO:tasks.workunit.client.0.smithi144.stderr: -385> 2024-06-04T16:12:14.057+0000 7f6cbcd3f800 5 AuthRegistry(0x5642354e8600) adding con mode: crc 2024-06-04T16:12:14.398 INFO:tasks.workunit.client.0.smithi144.stderr: -384> 2024-06-04T16:12:14.057+0000 7f6cbcd3f800 5 AuthRegistry(0x5642354e8600) adding con mode: secure 2024-06-04T16:12:14.398 INFO:tasks.workunit.client.0.smithi144.stderr: -383> 2024-06-04T16:12:14.057+0000 7f6cbcd3f800 5 AuthRegistry(0x5642354e8600) adding con mode: crc 2024-06-04T16:12:14.398 INFO:tasks.workunit.client.0.smithi144.stderr: -382> 2024-06-04T16:12:14.057+0000 7f6cbcd3f800 5 AuthRegistry(0x5642354e8600) adding con mode: secure 2024-06-04T16:12:14.398 INFO:tasks.workunit.client.0.smithi144.stderr: -381> 2024-06-04T16:12:14.057+0000 7f6cbcd3f800 5 AuthRegistry(0x5642354e8600) adding con mode: crc 2024-06-04T16:12:14.398 INFO:tasks.workunit.client.0.smithi144.stderr: -380> 2024-06-04T16:12:14.057+0000 7f6cbcd3f800 5 AuthRegistry(0x5642354e8600) adding con mode: secure 2024-06-04T16:12:14.398 INFO:tasks.workunit.client.0.smithi144.stderr: -379> 2024-06-04T16:12:14.057+0000 7f6cbcd3f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-06-04T16:12:14.398 INFO:tasks.workunit.client.0.smithi144.stderr: -378> 2024-06-04T16:12:14.057+0000 7f6cbcd3f800 5 asok(0x564235270c60) register_command objecter_requests cmddesc objecter_requests hook 0x5642354e4170 EEXIST 2024-06-04T16:12:14.398 INFO:tasks.workunit.client.0.smithi144.stderr: -377> 2024-06-04T16:12:14.058+0000 7f6cbcd3f800 10 monclient: init 2024-06-04T16:12:14.398 INFO:tasks.workunit.client.0.smithi144.stderr: -376> 2024-06-04T16:12:14.058+0000 7f6cbcd3f800 5 AuthRegistry(0x5642354e74f8) adding auth protocol: cephx 2024-06-04T16:12:14.399 INFO:tasks.workunit.client.0.smithi144.stderr: -375> 2024-06-04T16:12:14.058+0000 7f6cbcd3f800 5 AuthRegistry(0x5642354e74f8) adding auth protocol: cephx 2024-06-04T16:12:14.399 INFO:tasks.workunit.client.0.smithi144.stderr: -374> 2024-06-04T16:12:14.058+0000 7f6cbcd3f800 5 AuthRegistry(0x5642354e74f8) adding auth protocol: cephx 2024-06-04T16:12:14.399 INFO:tasks.workunit.client.0.smithi144.stderr: -373> 2024-06-04T16:12:14.058+0000 7f6cbcd3f800 5 AuthRegistry(0x5642354e74f8) adding con mode: secure 2024-06-04T16:12:14.399 INFO:tasks.workunit.client.0.smithi144.stderr: -372> 2024-06-04T16:12:14.058+0000 7f6cbcd3f800 5 AuthRegistry(0x5642354e74f8) adding con mode: crc 2024-06-04T16:12:14.399 INFO:tasks.workunit.client.0.smithi144.stderr: -371> 2024-06-04T16:12:14.058+0000 7f6cbcd3f800 5 AuthRegistry(0x5642354e74f8) adding con mode: secure 2024-06-04T16:12:14.399 INFO:tasks.workunit.client.0.smithi144.stderr: -370> 2024-06-04T16:12:14.058+0000 7f6cbcd3f800 5 AuthRegistry(0x5642354e74f8) adding con mode: crc 2024-06-04T16:12:14.399 INFO:tasks.workunit.client.0.smithi144.stderr: -369> 2024-06-04T16:12:14.058+0000 7f6cbcd3f800 5 AuthRegistry(0x5642354e74f8) adding con mode: secure 2024-06-04T16:12:14.399 INFO:tasks.workunit.client.0.smithi144.stderr: -368> 2024-06-04T16:12:14.058+0000 7f6cbcd3f800 5 AuthRegistry(0x5642354e74f8) adding con mode: crc 2024-06-04T16:12:14.399 INFO:tasks.workunit.client.0.smithi144.stderr: -367> 2024-06-04T16:12:14.058+0000 7f6cbcd3f800 5 AuthRegistry(0x5642354e74f8) adding con mode: crc 2024-06-04T16:12:14.399 INFO:tasks.workunit.client.0.smithi144.stderr: -366> 2024-06-04T16:12:14.058+0000 7f6cbcd3f800 5 AuthRegistry(0x5642354e74f8) adding con mode: secure 2024-06-04T16:12:14.399 INFO:tasks.workunit.client.0.smithi144.stderr: -365> 2024-06-04T16:12:14.058+0000 7f6cbcd3f800 5 AuthRegistry(0x5642354e74f8) adding con mode: crc 2024-06-04T16:12:14.399 INFO:tasks.workunit.client.0.smithi144.stderr: -364> 2024-06-04T16:12:14.058+0000 7f6cbcd3f800 5 AuthRegistry(0x5642354e74f8) adding con mode: secure 2024-06-04T16:12:14.399 INFO:tasks.workunit.client.0.smithi144.stderr: -363> 2024-06-04T16:12:14.058+0000 7f6cbcd3f800 5 AuthRegistry(0x5642354e74f8) adding con mode: crc 2024-06-04T16:12:14.399 INFO:tasks.workunit.client.0.smithi144.stderr: -362> 2024-06-04T16:12:14.058+0000 7f6cbcd3f800 5 AuthRegistry(0x5642354e74f8) adding con mode: secure 2024-06-04T16:12:14.400 INFO:tasks.workunit.client.0.smithi144.stderr: -361> 2024-06-04T16:12:14.058+0000 7f6cbcd3f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-06-04T16:12:14.400 INFO:tasks.workunit.client.0.smithi144.stderr: -360> 2024-06-04T16:12:14.058+0000 7f6cbcd3f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-06-04T16:12:14.400 INFO:tasks.workunit.client.0.smithi144.stderr: -359> 2024-06-04T16:12:14.058+0000 7f6cbcd3f800 5 asok(0x564235270c60) register_command rotate-key cmddesc rotate-key hook 0x5642354e7640 EEXIST 2024-06-04T16:12:14.400 INFO:tasks.workunit.client.0.smithi144.stderr: -358> 2024-06-04T16:12:14.058+0000 7f6cbcd3f800 10 monclient: _reopen_session rank -1 2024-06-04T16:12:14.400 INFO:tasks.workunit.client.0.smithi144.stderr: -357> 2024-06-04T16:12:14.058+0000 7f6cbcd3f800 10 monclient: _add_conns ranks=[2,0,1] 2024-06-04T16:12:14.400 INFO:tasks.workunit.client.0.smithi144.stderr: -356> 2024-06-04T16:12:14.058+0000 7f6cbcd3f800 10 monclient(hunting): picked mon.noname-c con 0x5642354f3f10 addr [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] 2024-06-04T16:12:14.400 INFO:tasks.workunit.client.0.smithi144.stderr: -355> 2024-06-04T16:12:14.058+0000 7f6cbcd3f800 10 monclient(hunting): picked mon.noname-a con 0x5642354f42f0 addr [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] 2024-06-04T16:12:14.400 INFO:tasks.workunit.client.0.smithi144.stderr: -354> 2024-06-04T16:12:14.058+0000 7f6cbcd3f800 10 monclient(hunting): picked mon.noname-b con 0x564235516640 addr [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] 2024-06-04T16:12:14.400 INFO:tasks.workunit.client.0.smithi144.stderr: -353> 2024-06-04T16:12:14.058+0000 7f6cbcd3f800 10 monclient(hunting): start opening mon connection 2024-06-04T16:12:14.400 INFO:tasks.workunit.client.0.smithi144.stderr: -352> 2024-06-04T16:12:14.058+0000 7f6cbcd3f800 10 monclient(hunting): start opening mon connection 2024-06-04T16:12:14.400 INFO:tasks.workunit.client.0.smithi144.stderr: -351> 2024-06-04T16:12:14.058+0000 7f6cbcd3f800 10 monclient(hunting): start opening mon connection 2024-06-04T16:12:14.400 INFO:tasks.workunit.client.0.smithi144.stderr: -350> 2024-06-04T16:12:14.058+0000 7f6cbcd3f800 10 monclient(hunting): _renew_subs 2024-06-04T16:12:14.400 INFO:tasks.workunit.client.0.smithi144.stderr: -349> 2024-06-04T16:12:14.058+0000 7f6cbcd3f800 10 monclient(hunting): authenticate will time out at 1971.874677s 2024-06-04T16:12:14.400 INFO:tasks.workunit.client.0.smithi144.stderr: -348> 2024-06-04T16:12:14.058+0000 7f6cb3fff640 10 monclient(hunting): get_auth_request con 0x5642354f3f10 auth_method 0 2024-06-04T16:12:14.400 INFO:tasks.workunit.client.0.smithi144.stderr: -347> 2024-06-04T16:12:14.058+0000 7f6cb3fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-06-04T16:12:14.401 INFO:tasks.workunit.client.0.smithi144.stderr: -346> 2024-06-04T16:12:14.058+0000 7f6cb3fff640 10 monclient(hunting): _init_auth method 2 2024-06-04T16:12:14.401 INFO:tasks.workunit.client.0.smithi144.stderr: -345> 2024-06-04T16:12:14.058+0000 7f6cb3fff640 10 monclient(hunting): _init_auth creating new auth 2024-06-04T16:12:14.401 INFO:tasks.workunit.client.0.smithi144.stderr: -344> 2024-06-04T16:12:14.058+0000 7f6cb9292640 10 monclient(hunting): get_auth_request con 0x5642354f42f0 auth_method 0 2024-06-04T16:12:14.401 INFO:tasks.workunit.client.0.smithi144.stderr: -343> 2024-06-04T16:12:14.058+0000 7f6cb9292640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-06-04T16:12:14.401 INFO:tasks.workunit.client.0.smithi144.stderr: -342> 2024-06-04T16:12:14.058+0000 7f6cb9292640 10 monclient(hunting): _init_auth method 2 2024-06-04T16:12:14.401 INFO:tasks.workunit.client.0.smithi144.stderr: -341> 2024-06-04T16:12:14.058+0000 7f6cb9292640 10 monclient(hunting): _init_auth creating new auth 2024-06-04T16:12:14.401 INFO:tasks.workunit.client.0.smithi144.stderr: -340> 2024-06-04T16:12:14.058+0000 7f6cb3fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-06-04T16:12:14.401 INFO:tasks.workunit.client.0.smithi144.stderr: -339> 2024-06-04T16:12:14.058+0000 7f6cb3fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-06-04T16:12:14.401 INFO:tasks.workunit.client.0.smithi144.stderr: -338> 2024-06-04T16:12:14.058+0000 7f6cb3fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-06-04T16:12:14.401 INFO:tasks.workunit.client.0.smithi144.stderr: -337> 2024-06-04T16:12:14.058+0000 7f6cb9292640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-06-04T16:12:14.401 INFO:tasks.workunit.client.0.smithi144.stderr: -336> 2024-06-04T16:12:14.058+0000 7f6cb9292640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-06-04T16:12:14.401 INFO:tasks.workunit.client.0.smithi144.stderr: -335> 2024-06-04T16:12:14.058+0000 7f6cb9292640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-06-04T16:12:14.401 INFO:tasks.workunit.client.0.smithi144.stderr: -334> 2024-06-04T16:12:14.058+0000 7f6cb8a91640 10 monclient(hunting): get_auth_request con 0x564235516640 auth_method 0 2024-06-04T16:12:14.401 INFO:tasks.workunit.client.0.smithi144.stderr: -333> 2024-06-04T16:12:14.058+0000 7f6cb8a91640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-06-04T16:12:14.402 INFO:tasks.workunit.client.0.smithi144.stderr: -332> 2024-06-04T16:12:14.058+0000 7f6cb8a91640 10 monclient(hunting): _init_auth method 2 2024-06-04T16:12:14.402 INFO:tasks.workunit.client.0.smithi144.stderr: -331> 2024-06-04T16:12:14.058+0000 7f6cb8a91640 10 monclient(hunting): _init_auth creating new auth 2024-06-04T16:12:14.402 INFO:tasks.workunit.client.0.smithi144.stderr: -330> 2024-06-04T16:12:14.058+0000 7f6cb8a91640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-06-04T16:12:14.402 INFO:tasks.workunit.client.0.smithi144.stderr: -329> 2024-06-04T16:12:14.058+0000 7f6cb8a91640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-06-04T16:12:14.402 INFO:tasks.workunit.client.0.smithi144.stderr: -328> 2024-06-04T16:12:14.058+0000 7f6cb8a91640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-06-04T16:12:14.402 INFO:tasks.workunit.client.0.smithi144.stderr: -327> 2024-06-04T16:12:14.058+0000 7f6cb3fff640 10 monclient(hunting): handle_auth_done global_id 6158 payload 824 2024-06-04T16:12:14.402 INFO:tasks.workunit.client.0.smithi144.stderr: -326> 2024-06-04T16:12:14.058+0000 7f6cb3fff640 10 monclient: _finish_hunting 0 2024-06-04T16:12:14.402 INFO:tasks.workunit.client.0.smithi144.stderr: -325> 2024-06-04T16:12:14.058+0000 7f6cb3fff640 1 monclient: found mon.noname-c 2024-06-04T16:12:14.402 INFO:tasks.workunit.client.0.smithi144.stderr: -324> 2024-06-04T16:12:14.058+0000 7f6cb3fff640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.144:3301/0 2024-06-04T16:12:14.402 INFO:tasks.workunit.client.0.smithi144.stderr: -323> 2024-06-04T16:12:14.059+0000 7f6b9e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-06-04T16:12:14.402 INFO:tasks.workunit.client.0.smithi144.stderr: -322> 2024-06-04T16:12:14.059+0000 7f6b9e7fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-06-04T16:12:14.402 INFO:tasks.workunit.client.0.smithi144.stderr: -321> 2024-06-04T16:12:14.059+0000 7f6b9e7fc640 10 monclient: dump: 2024-06-04T16:12:14.402 INFO:tasks.workunit.client.0.smithi144.stderr:epoch 1 2024-06-04T16:12:14.403 INFO:tasks.workunit.client.0.smithi144.stderr:fsid 15e56bb1-4856-42f3-b6db-a2c8f23c5557 2024-06-04T16:12:14.403 INFO:tasks.workunit.client.0.smithi144.stderr:last_changed 2024-06-04T15:51:29.789359+0000 2024-06-04T16:12:14.403 INFO:tasks.workunit.client.0.smithi144.stderr:created 2024-06-04T15:51:29.789359+0000 2024-06-04T16:12:14.403 INFO:tasks.workunit.client.0.smithi144.stderr:min_mon_release 19 (squid) 2024-06-04T16:12:14.403 INFO:tasks.workunit.client.0.smithi144.stderr:election_strategy: 1 2024-06-04T16:12:14.403 INFO:tasks.workunit.client.0.smithi144.stderr:0: [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] mon.a 2024-06-04T16:12:14.403 INFO:tasks.workunit.client.0.smithi144.stderr:1: [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] mon.b 2024-06-04T16:12:14.403 INFO:tasks.workunit.client.0.smithi144.stderr:2: [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] mon.c 2024-06-04T16:12:14.403 INFO:tasks.workunit.client.0.smithi144.stderr: 2024-06-04T16:12:14.403 INFO:tasks.workunit.client.0.smithi144.stderr: -320> 2024-06-04T16:12:14.059+0000 7f6b9e7fc640 10 monclient: _finish_auth 0 2024-06-04T16:12:14.403 INFO:tasks.workunit.client.0.smithi144.stderr: -319> 2024-06-04T16:12:14.059+0000 7f6b9e7fc640 10 monclient: _check_auth_tickets 2024-06-04T16:12:14.403 INFO:tasks.workunit.client.0.smithi144.stderr: -318> 2024-06-04T16:12:14.059+0000 7f6b9e7fc640 10 monclient: handle_config config(0 keys) 2024-06-04T16:12:14.403 INFO:tasks.workunit.client.0.smithi144.stderr: -317> 2024-06-04T16:12:14.059+0000 7f6b9e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-06-04T16:12:14.403 INFO:tasks.workunit.client.0.smithi144.stderr: -316> 2024-06-04T16:12:14.059+0000 7f6b9e7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-06-04T16:12:14.404 INFO:tasks.workunit.client.0.smithi144.stderr: -315> 2024-06-04T16:12:14.059+0000 7f6b9e7fc640 10 monclient: dump: 2024-06-04T16:12:14.404 INFO:tasks.workunit.client.0.smithi144.stderr:epoch 1 2024-06-04T16:12:14.404 INFO:tasks.workunit.client.0.smithi144.stderr:fsid 15e56bb1-4856-42f3-b6db-a2c8f23c5557 2024-06-04T16:12:14.404 INFO:tasks.workunit.client.0.smithi144.stderr:last_changed 2024-06-04T15:51:29.789359+0000 2024-06-04T16:12:14.404 INFO:tasks.workunit.client.0.smithi144.stderr:created 2024-06-04T15:51:29.789359+0000 2024-06-04T16:12:14.404 INFO:tasks.workunit.client.0.smithi144.stderr:min_mon_release 19 (squid) 2024-06-04T16:12:14.404 INFO:tasks.workunit.client.0.smithi144.stderr:election_strategy: 1 2024-06-04T16:12:14.404 INFO:tasks.workunit.client.0.smithi144.stderr:0: [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] mon.a 2024-06-04T16:12:14.404 INFO:tasks.workunit.client.0.smithi144.stderr:1: [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] mon.b 2024-06-04T16:12:14.404 INFO:tasks.workunit.client.0.smithi144.stderr:2: [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] mon.c 2024-06-04T16:12:14.404 INFO:tasks.workunit.client.0.smithi144.stderr: 2024-06-04T16:12:14.404 INFO:tasks.workunit.client.0.smithi144.stderr: -314> 2024-06-04T16:12:14.059+0000 7f6cbcd3f800 5 monclient: authenticate success, global_id 6158 2024-06-04T16:12:14.404 INFO:tasks.workunit.client.0.smithi144.stderr: -313> 2024-06-04T16:12:14.059+0000 7f6cbcd3f800 10 monclient: _renew_subs 2024-06-04T16:12:14.404 INFO:tasks.workunit.client.0.smithi144.stderr: -312> 2024-06-04T16:12:14.059+0000 7f6cb9a93640 4 set_mon_vals no callback set 2024-06-04T16:12:14.405 INFO:tasks.workunit.client.0.smithi144.stderr: -311> 2024-06-04T16:12:14.059+0000 7f6cbcd3f800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.144:3301/0 2024-06-04T16:12:14.405 INFO:tasks.workunit.client.0.smithi144.stderr: -310> 2024-06-04T16:12:14.059+0000 7f6cbcd3f800 10 monclient: _renew_subs 2024-06-04T16:12:14.405 INFO:tasks.workunit.client.0.smithi144.stderr: -309> 2024-06-04T16:12:14.059+0000 7f6cbcd3f800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.144:3301/0 2024-06-04T16:12:14.405 INFO:tasks.workunit.client.0.smithi144.stderr: -308> 2024-06-04T16:12:14.060+0000 7f6b9e7fc640 4 mgrc handle_mgr_map Got map version 5 2024-06-04T16:12:14.405 INFO:tasks.workunit.client.0.smithi144.stderr: -307> 2024-06-04T16:12:14.060+0000 7f6b9e7fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.177:6832/2645786330,v1:172.21.15.177:6833/2645786330] 2024-06-04T16:12:14.405 INFO:tasks.workunit.client.0.smithi144.stderr: -306> 2024-06-04T16:12:14.060+0000 7f6b9e7fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.177:6832/2645786330,v1:172.21.15.177:6833/2645786330] 2024-06-04T16:12:14.405 INFO:tasks.workunit.client.0.smithi144.stderr: -305> 2024-06-04T16:12:14.061+0000 7f6cb9292640 10 monclient: get_auth_request con 0x7f6b90074bc0 auth_method 0 2024-06-04T16:12:14.405 INFO:tasks.workunit.client.0.smithi144.stderr: -304> 2024-06-04T16:12:14.061+0000 7f6cbcd3f800 10 monclient: get_monmap_and_config 2024-06-04T16:12:14.405 INFO:tasks.workunit.client.0.smithi144.stderr: -303> 2024-06-04T16:12:14.061+0000 7f6cbcd3f800 10 monclient: build_initial_monmap 2024-06-04T16:12:14.405 INFO:tasks.workunit.client.0.smithi144.stderr: -302> 2024-06-04T16:12:14.061+0000 7f6cbcd3f800 1 build_initial for_mkfs: 0 2024-06-04T16:12:14.405 INFO:tasks.workunit.client.0.smithi144.stderr: -301> 2024-06-04T16:12:14.061+0000 7f6cbcd3f800 10 monclient: monmap: 2024-06-04T16:12:14.405 INFO:tasks.workunit.client.0.smithi144.stderr:epoch 0 2024-06-04T16:12:14.405 INFO:tasks.workunit.client.0.smithi144.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-06-04T16:12:14.405 INFO:tasks.workunit.client.0.smithi144.stderr:last_changed 0.000000 2024-06-04T16:12:14.406 INFO:tasks.workunit.client.0.smithi144.stderr:created 0.000000 2024-06-04T16:12:14.406 INFO:tasks.workunit.client.0.smithi144.stderr:min_mon_release 0 (unknown) 2024-06-04T16:12:14.406 INFO:tasks.workunit.client.0.smithi144.stderr:election_strategy: 1 2024-06-04T16:12:14.406 INFO:tasks.workunit.client.0.smithi144.stderr:0: [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] mon.noname-a 2024-06-04T16:12:14.406 INFO:tasks.workunit.client.0.smithi144.stderr:1: [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] mon.noname-b 2024-06-04T16:12:14.406 INFO:tasks.workunit.client.0.smithi144.stderr:2: [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] mon.noname-c 2024-06-04T16:12:14.406 INFO:tasks.workunit.client.0.smithi144.stderr: 2024-06-04T16:12:14.406 INFO:tasks.workunit.client.0.smithi144.stderr: -300> 2024-06-04T16:12:14.061+0000 7f6cbcd3f800 5 AuthRegistry(0x564235530bb0) adding auth protocol: cephx 2024-06-04T16:12:14.406 INFO:tasks.workunit.client.0.smithi144.stderr: -299> 2024-06-04T16:12:14.061+0000 7f6cbcd3f800 5 AuthRegistry(0x564235530bb0) adding auth protocol: cephx 2024-06-04T16:12:14.406 INFO:tasks.workunit.client.0.smithi144.stderr: -298> 2024-06-04T16:12:14.061+0000 7f6cbcd3f800 5 AuthRegistry(0x564235530bb0) adding auth protocol: cephx 2024-06-04T16:12:14.406 INFO:tasks.workunit.client.0.smithi144.stderr: -297> 2024-06-04T16:12:14.061+0000 7f6cbcd3f800 5 AuthRegistry(0x564235530bb0) adding con mode: secure 2024-06-04T16:12:14.406 INFO:tasks.workunit.client.0.smithi144.stderr: -296> 2024-06-04T16:12:14.061+0000 7f6cbcd3f800 5 AuthRegistry(0x564235530bb0) adding con mode: crc 2024-06-04T16:12:14.406 INFO:tasks.workunit.client.0.smithi144.stderr: -295> 2024-06-04T16:12:14.061+0000 7f6cbcd3f800 5 AuthRegistry(0x564235530bb0) adding con mode: secure 2024-06-04T16:12:14.406 INFO:tasks.workunit.client.0.smithi144.stderr: -294> 2024-06-04T16:12:14.061+0000 7f6cbcd3f800 5 AuthRegistry(0x564235530bb0) adding con mode: crc 2024-06-04T16:12:14.407 INFO:tasks.workunit.client.0.smithi144.stderr: -293> 2024-06-04T16:12:14.061+0000 7f6cbcd3f800 5 AuthRegistry(0x564235530bb0) adding con mode: secure 2024-06-04T16:12:14.407 INFO:tasks.workunit.client.0.smithi144.stderr: -292> 2024-06-04T16:12:14.061+0000 7f6cbcd3f800 5 AuthRegistry(0x564235530bb0) adding con mode: crc 2024-06-04T16:12:14.407 INFO:tasks.workunit.client.0.smithi144.stderr: -291> 2024-06-04T16:12:14.061+0000 7f6cbcd3f800 5 AuthRegistry(0x564235530bb0) adding con mode: crc 2024-06-04T16:12:14.407 INFO:tasks.workunit.client.0.smithi144.stderr: -290> 2024-06-04T16:12:14.061+0000 7f6cbcd3f800 5 AuthRegistry(0x564235530bb0) adding con mode: secure 2024-06-04T16:12:14.407 INFO:tasks.workunit.client.0.smithi144.stderr: -289> 2024-06-04T16:12:14.061+0000 7f6cbcd3f800 5 AuthRegistry(0x564235530bb0) adding con mode: crc 2024-06-04T16:12:14.407 INFO:tasks.workunit.client.0.smithi144.stderr: -288> 2024-06-04T16:12:14.061+0000 7f6cbcd3f800 5 AuthRegistry(0x564235530bb0) adding con mode: secure 2024-06-04T16:12:14.407 INFO:tasks.workunit.client.0.smithi144.stderr: -287> 2024-06-04T16:12:14.061+0000 7f6cbcd3f800 5 AuthRegistry(0x564235530bb0) adding con mode: crc 2024-06-04T16:12:14.407 INFO:tasks.workunit.client.0.smithi144.stderr: -286> 2024-06-04T16:12:14.061+0000 7f6cbcd3f800 5 AuthRegistry(0x564235530bb0) adding con mode: secure 2024-06-04T16:12:14.407 INFO:tasks.workunit.client.0.smithi144.stderr: -285> 2024-06-04T16:12:14.061+0000 7f6cbcd3f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-06-04T16:12:14.407 INFO:tasks.workunit.client.0.smithi144.stderr: -284> 2024-06-04T16:12:14.061+0000 7f6cbcd3f800 10 monclient: init 2024-06-04T16:12:14.407 INFO:tasks.workunit.client.0.smithi144.stderr: -283> 2024-06-04T16:12:14.061+0000 7f6cbcd3f800 5 AuthRegistry(0x7fff54a70a90) adding auth protocol: cephx 2024-06-04T16:12:14.407 INFO:tasks.workunit.client.0.smithi144.stderr: -282> 2024-06-04T16:12:14.061+0000 7f6cbcd3f800 5 AuthRegistry(0x7fff54a70a90) adding auth protocol: cephx 2024-06-04T16:12:14.407 INFO:tasks.workunit.client.0.smithi144.stderr: -281> 2024-06-04T16:12:14.061+0000 7f6cbcd3f800 5 AuthRegistry(0x7fff54a70a90) adding auth protocol: cephx 2024-06-04T16:12:14.407 INFO:tasks.workunit.client.0.smithi144.stderr: -280> 2024-06-04T16:12:14.061+0000 7f6cbcd3f800 5 AuthRegistry(0x7fff54a70a90) adding con mode: secure 2024-06-04T16:12:14.408 INFO:tasks.workunit.client.0.smithi144.stderr: -279> 2024-06-04T16:12:14.061+0000 7f6cbcd3f800 5 AuthRegistry(0x7fff54a70a90) adding con mode: crc 2024-06-04T16:12:14.408 INFO:tasks.workunit.client.0.smithi144.stderr: -278> 2024-06-04T16:12:14.061+0000 7f6cbcd3f800 5 AuthRegistry(0x7fff54a70a90) adding con mode: secure 2024-06-04T16:12:14.408 INFO:tasks.workunit.client.0.smithi144.stderr: -277> 2024-06-04T16:12:14.061+0000 7f6cbcd3f800 5 AuthRegistry(0x7fff54a70a90) adding con mode: crc 2024-06-04T16:12:14.408 INFO:tasks.workunit.client.0.smithi144.stderr: -276> 2024-06-04T16:12:14.061+0000 7f6cbcd3f800 5 AuthRegistry(0x7fff54a70a90) adding con mode: secure 2024-06-04T16:12:14.408 INFO:tasks.workunit.client.0.smithi144.stderr: -275> 2024-06-04T16:12:14.061+0000 7f6cbcd3f800 5 AuthRegistry(0x7fff54a70a90) adding con mode: crc 2024-06-04T16:12:14.408 INFO:tasks.workunit.client.0.smithi144.stderr: -274> 2024-06-04T16:12:14.061+0000 7f6cbcd3f800 5 AuthRegistry(0x7fff54a70a90) adding con mode: crc 2024-06-04T16:12:14.408 INFO:tasks.workunit.client.0.smithi144.stderr: -273> 2024-06-04T16:12:14.061+0000 7f6cbcd3f800 5 AuthRegistry(0x7fff54a70a90) adding con mode: secure 2024-06-04T16:12:14.408 INFO:tasks.workunit.client.0.smithi144.stderr: -272> 2024-06-04T16:12:14.061+0000 7f6cbcd3f800 5 AuthRegistry(0x7fff54a70a90) adding con mode: crc 2024-06-04T16:12:14.408 INFO:tasks.workunit.client.0.smithi144.stderr: -271> 2024-06-04T16:12:14.061+0000 7f6cbcd3f800 5 AuthRegistry(0x7fff54a70a90) adding con mode: secure 2024-06-04T16:12:14.408 INFO:tasks.workunit.client.0.smithi144.stderr: -270> 2024-06-04T16:12:14.061+0000 7f6cbcd3f800 5 AuthRegistry(0x7fff54a70a90) adding con mode: crc 2024-06-04T16:12:14.408 INFO:tasks.workunit.client.0.smithi144.stderr: -269> 2024-06-04T16:12:14.061+0000 7f6cbcd3f800 5 AuthRegistry(0x7fff54a70a90) adding con mode: secure 2024-06-04T16:12:14.408 INFO:tasks.workunit.client.0.smithi144.stderr: -268> 2024-06-04T16:12:14.061+0000 7f6cbcd3f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-06-04T16:12:14.408 INFO:tasks.workunit.client.0.smithi144.stderr: -267> 2024-06-04T16:12:14.062+0000 7f6cbcd3f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-06-04T16:12:14.408 INFO:tasks.workunit.client.0.smithi144.stderr: -266> 2024-06-04T16:12:14.062+0000 7f6cbcd3f800 5 asok(0x564235270c60) register_command rotate-key cmddesc rotate-key hook 0x7fff54a70bd8 EEXIST 2024-06-04T16:12:14.408 INFO:tasks.workunit.client.0.smithi144.stderr: -265> 2024-06-04T16:12:14.062+0000 7f6cbcd3f800 10 monclient: _reopen_session rank -1 2024-06-04T16:12:14.409 INFO:tasks.workunit.client.0.smithi144.stderr: -264> 2024-06-04T16:12:14.062+0000 7f6cbcd3f800 10 monclient: _add_conns ranks=[1,2,0] 2024-06-04T16:12:14.409 INFO:tasks.workunit.client.0.smithi144.stderr: -263> 2024-06-04T16:12:14.062+0000 7f6cbcd3f800 10 monclient(hunting): picked mon.noname-b con 0x564235556b30 addr [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] 2024-06-04T16:12:14.409 INFO:tasks.workunit.client.0.smithi144.stderr: -262> 2024-06-04T16:12:14.062+0000 7f6cbcd3f800 10 monclient(hunting): picked mon.noname-c con 0x564235536330 addr [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] 2024-06-04T16:12:14.409 INFO:tasks.workunit.client.0.smithi144.stderr: -261> 2024-06-04T16:12:14.062+0000 7f6cbcd3f800 10 monclient(hunting): picked mon.noname-a con 0x564235560ab0 addr [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] 2024-06-04T16:12:14.409 INFO:tasks.workunit.client.0.smithi144.stderr: -260> 2024-06-04T16:12:14.062+0000 7f6cbcd3f800 10 monclient(hunting): start opening mon connection 2024-06-04T16:12:14.409 INFO:tasks.workunit.client.0.smithi144.stderr: -259> 2024-06-04T16:12:14.062+0000 7f6cbcd3f800 10 monclient(hunting): start opening mon connection 2024-06-04T16:12:14.409 INFO:tasks.workunit.client.0.smithi144.stderr: -258> 2024-06-04T16:12:14.062+0000 7f6cbcd3f800 10 monclient(hunting): start opening mon connection 2024-06-04T16:12:14.409 INFO:tasks.workunit.client.0.smithi144.stderr: -257> 2024-06-04T16:12:14.062+0000 7f6cbcd3f800 10 monclient(hunting): _renew_subs 2024-06-04T16:12:14.409 INFO:tasks.workunit.client.0.smithi144.stderr: -256> 2024-06-04T16:12:14.062+0000 7f6cbcd3f800 10 monclient(hunting): authenticate will time out at 1971.878309s 2024-06-04T16:12:14.409 INFO:tasks.workunit.client.0.smithi144.stderr: -255> 2024-06-04T16:12:14.062+0000 7f6cb9292640 10 monclient(hunting): get_auth_request con 0x564235536330 auth_method 0 2024-06-04T16:12:14.409 INFO:tasks.workunit.client.0.smithi144.stderr: -254> 2024-06-04T16:12:14.062+0000 7f6cb9292640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-06-04T16:12:14.409 INFO:tasks.workunit.client.0.smithi144.stderr: -253> 2024-06-04T16:12:14.062+0000 7f6cb9292640 10 monclient(hunting): _init_auth method 2 2024-06-04T16:12:14.409 INFO:tasks.workunit.client.0.smithi144.stderr: -252> 2024-06-04T16:12:14.062+0000 7f6cb9292640 10 monclient(hunting): _init_auth creating new auth 2024-06-04T16:12:14.409 INFO:tasks.workunit.client.0.smithi144.stderr: -251> 2024-06-04T16:12:14.062+0000 7f6cb8a91640 10 monclient(hunting): get_auth_request con 0x564235560ab0 auth_method 0 2024-06-04T16:12:14.410 INFO:tasks.workunit.client.0.smithi144.stderr: -250> 2024-06-04T16:12:14.062+0000 7f6cb8a91640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-06-04T16:12:14.410 INFO:tasks.workunit.client.0.smithi144.stderr: -249> 2024-06-04T16:12:14.062+0000 7f6cb8a91640 10 monclient(hunting): _init_auth method 2 2024-06-04T16:12:14.410 INFO:tasks.workunit.client.0.smithi144.stderr: -248> 2024-06-04T16:12:14.062+0000 7f6cb8a91640 10 monclient(hunting): _init_auth creating new auth 2024-06-04T16:12:14.410 INFO:tasks.workunit.client.0.smithi144.stderr: -247> 2024-06-04T16:12:14.062+0000 7f6cb8a91640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-06-04T16:12:14.410 INFO:tasks.workunit.client.0.smithi144.stderr: -246> 2024-06-04T16:12:14.062+0000 7f6cb8a91640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-06-04T16:12:14.410 INFO:tasks.workunit.client.0.smithi144.stderr: -245> 2024-06-04T16:12:14.062+0000 7f6cb8a91640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-06-04T16:12:14.410 INFO:tasks.workunit.client.0.smithi144.stderr: -244> 2024-06-04T16:12:14.062+0000 7f6cb3fff640 10 monclient(hunting): get_auth_request con 0x564235556b30 auth_method 0 2024-06-04T16:12:14.410 INFO:tasks.workunit.client.0.smithi144.stderr: -243> 2024-06-04T16:12:14.062+0000 7f6cb3fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-06-04T16:12:14.410 INFO:tasks.workunit.client.0.smithi144.stderr: -242> 2024-06-04T16:12:14.062+0000 7f6cb3fff640 10 monclient(hunting): _init_auth method 2 2024-06-04T16:12:14.410 INFO:tasks.workunit.client.0.smithi144.stderr: -241> 2024-06-04T16:12:14.062+0000 7f6cb3fff640 10 monclient(hunting): _init_auth creating new auth 2024-06-04T16:12:14.410 INFO:tasks.workunit.client.0.smithi144.stderr: -240> 2024-06-04T16:12:14.062+0000 7f6cb3fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-06-04T16:12:14.410 INFO:tasks.workunit.client.0.smithi144.stderr: -239> 2024-06-04T16:12:14.062+0000 7f6cb3fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-06-04T16:12:14.410 INFO:tasks.workunit.client.0.smithi144.stderr: -238> 2024-06-04T16:12:14.062+0000 7f6cb3fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-06-04T16:12:14.411 INFO:tasks.workunit.client.0.smithi144.stderr: -237> 2024-06-04T16:12:14.062+0000 7f6cb8a91640 10 monclient(hunting): handle_auth_done global_id 6480 payload 274 2024-06-04T16:12:14.411 INFO:tasks.workunit.client.0.smithi144.stderr: -236> 2024-06-04T16:12:14.062+0000 7f6cb8a91640 10 monclient: _finish_hunting 0 2024-06-04T16:12:14.411 INFO:tasks.workunit.client.0.smithi144.stderr: -235> 2024-06-04T16:12:14.062+0000 7f6cb8a91640 1 monclient: found mon.noname-a 2024-06-04T16:12:14.411 INFO:tasks.workunit.client.0.smithi144.stderr: -234> 2024-06-04T16:12:14.062+0000 7f6cb8a91640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.144:3300/0 2024-06-04T16:12:14.411 INFO:tasks.workunit.client.0.smithi144.stderr: -233> 2024-06-04T16:12:14.062+0000 7f6b8ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-06-04T16:12:14.411 INFO:tasks.workunit.client.0.smithi144.stderr: -232> 2024-06-04T16:12:14.062+0000 7f6b8ffff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-06-04T16:12:14.411 INFO:tasks.workunit.client.0.smithi144.stderr: -231> 2024-06-04T16:12:14.062+0000 7f6b8ffff640 10 monclient: dump: 2024-06-04T16:12:14.411 INFO:tasks.workunit.client.0.smithi144.stderr:epoch 1 2024-06-04T16:12:14.411 INFO:tasks.workunit.client.0.smithi144.stderr:fsid 15e56bb1-4856-42f3-b6db-a2c8f23c5557 2024-06-04T16:12:14.411 INFO:tasks.workunit.client.0.smithi144.stderr:last_changed 2024-06-04T15:51:29.789359+0000 2024-06-04T16:12:14.411 INFO:tasks.workunit.client.0.smithi144.stderr:created 2024-06-04T15:51:29.789359+0000 2024-06-04T16:12:14.411 INFO:tasks.workunit.client.0.smithi144.stderr:min_mon_release 19 (squid) 2024-06-04T16:12:14.411 INFO:tasks.workunit.client.0.smithi144.stderr:election_strategy: 1 2024-06-04T16:12:14.411 INFO:tasks.workunit.client.0.smithi144.stderr:0: [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] mon.a 2024-06-04T16:12:14.412 INFO:tasks.workunit.client.0.smithi144.stderr:1: [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] mon.b 2024-06-04T16:12:14.412 INFO:tasks.workunit.client.0.smithi144.stderr:2: [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] mon.c 2024-06-04T16:12:14.412 INFO:tasks.workunit.client.0.smithi144.stderr: 2024-06-04T16:12:14.412 INFO:tasks.workunit.client.0.smithi144.stderr: -230> 2024-06-04T16:12:14.062+0000 7f6b8ffff640 10 monclient: _finish_auth 0 2024-06-04T16:12:14.412 INFO:tasks.workunit.client.0.smithi144.stderr: -229> 2024-06-04T16:12:14.062+0000 7f6b8ffff640 10 monclient: _check_auth_tickets 2024-06-04T16:12:14.412 INFO:tasks.workunit.client.0.smithi144.stderr: -228> 2024-06-04T16:12:14.062+0000 7f6b8ffff640 10 monclient: handle_config config(0 keys) 2024-06-04T16:12:14.412 INFO:tasks.workunit.client.0.smithi144.stderr: -227> 2024-06-04T16:12:14.062+0000 7f6cbcd3f800 5 monclient: authenticate success, global_id 6480 2024-06-04T16:12:14.412 INFO:tasks.workunit.client.0.smithi144.stderr: -226> 2024-06-04T16:12:14.062+0000 7f6cbcd3f800 10 monclient: get_monmap_and_config success 2024-06-04T16:12:14.412 INFO:tasks.workunit.client.0.smithi144.stderr: -225> 2024-06-04T16:12:14.062+0000 7f6cbcd3f800 4 set_mon_vals no callback set 2024-06-04T16:12:14.412 INFO:tasks.workunit.client.0.smithi144.stderr: -224> 2024-06-04T16:12:14.062+0000 7f6b8ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-06-04T16:12:14.412 INFO:tasks.workunit.client.0.smithi144.stderr: -223> 2024-06-04T16:12:14.062+0000 7f6b8ffff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-06-04T16:12:14.412 INFO:tasks.workunit.client.0.smithi144.stderr: -222> 2024-06-04T16:12:14.062+0000 7f6b8ffff640 10 monclient: dump: 2024-06-04T16:12:14.412 INFO:tasks.workunit.client.0.smithi144.stderr:epoch 1 2024-06-04T16:12:14.412 INFO:tasks.workunit.client.0.smithi144.stderr:fsid 15e56bb1-4856-42f3-b6db-a2c8f23c5557 2024-06-04T16:12:14.413 INFO:tasks.workunit.client.0.smithi144.stderr:last_changed 2024-06-04T15:51:29.789359+0000 2024-06-04T16:12:14.413 INFO:tasks.workunit.client.0.smithi144.stderr:created 2024-06-04T15:51:29.789359+0000 2024-06-04T16:12:14.413 INFO:tasks.workunit.client.0.smithi144.stderr:min_mon_release 19 (squid) 2024-06-04T16:12:14.413 INFO:tasks.workunit.client.0.smithi144.stderr:election_strategy: 1 2024-06-04T16:12:14.413 INFO:tasks.workunit.client.0.smithi144.stderr:0: [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] mon.a 2024-06-04T16:12:14.413 INFO:tasks.workunit.client.0.smithi144.stderr:1: [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] mon.b 2024-06-04T16:12:14.413 INFO:tasks.workunit.client.0.smithi144.stderr:2: [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] mon.c 2024-06-04T16:12:14.413 INFO:tasks.workunit.client.0.smithi144.stderr: 2024-06-04T16:12:14.413 INFO:tasks.workunit.client.0.smithi144.stderr: -221> 2024-06-04T16:12:14.063+0000 7f6cbcd3f800 10 monclient: shutdown 2024-06-04T16:12:14.413 INFO:tasks.workunit.client.0.smithi144.stderr: -220> 2024-06-04T16:12:14.063+0000 7f6cbcd3f800 10 monclient: build_initial_monmap 2024-06-04T16:12:14.413 INFO:tasks.workunit.client.0.smithi144.stderr: -219> 2024-06-04T16:12:14.063+0000 7f6cbcd3f800 1 build_initial for_mkfs: 0 2024-06-04T16:12:14.413 INFO:tasks.workunit.client.0.smithi144.stderr: -218> 2024-06-04T16:12:14.063+0000 7f6cbcd3f800 10 monclient: monmap: 2024-06-04T16:12:14.413 INFO:tasks.workunit.client.0.smithi144.stderr:epoch 0 2024-06-04T16:12:14.413 INFO:tasks.workunit.client.0.smithi144.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-06-04T16:12:14.414 INFO:tasks.workunit.client.0.smithi144.stderr:last_changed 0.000000 2024-06-04T16:12:14.414 INFO:tasks.workunit.client.0.smithi144.stderr:created 0.000000 2024-06-04T16:12:14.414 INFO:tasks.workunit.client.0.smithi144.stderr:min_mon_release 0 (unknown) 2024-06-04T16:12:14.414 INFO:tasks.workunit.client.0.smithi144.stderr:election_strategy: 1 2024-06-04T16:12:14.414 INFO:tasks.workunit.client.0.smithi144.stderr:0: [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] mon.noname-a 2024-06-04T16:12:14.414 INFO:tasks.workunit.client.0.smithi144.stderr:1: [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] mon.noname-b 2024-06-04T16:12:14.414 INFO:tasks.workunit.client.0.smithi144.stderr:2: [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] mon.noname-c 2024-06-04T16:12:14.414 INFO:tasks.workunit.client.0.smithi144.stderr: 2024-06-04T16:12:14.414 INFO:tasks.workunit.client.0.smithi144.stderr: -217> 2024-06-04T16:12:14.063+0000 7f6cbcd3f800 5 AuthRegistry(0x564235530bb0) adding auth protocol: cephx 2024-06-04T16:12:14.414 INFO:tasks.workunit.client.0.smithi144.stderr: -216> 2024-06-04T16:12:14.063+0000 7f6cbcd3f800 5 AuthRegistry(0x564235530bb0) adding auth protocol: cephx 2024-06-04T16:12:14.414 INFO:tasks.workunit.client.0.smithi144.stderr: -215> 2024-06-04T16:12:14.063+0000 7f6cbcd3f800 5 AuthRegistry(0x564235530bb0) adding auth protocol: cephx 2024-06-04T16:12:14.414 INFO:tasks.workunit.client.0.smithi144.stderr: -214> 2024-06-04T16:12:14.063+0000 7f6cbcd3f800 5 AuthRegistry(0x564235530bb0) adding con mode: secure 2024-06-04T16:12:14.414 INFO:tasks.workunit.client.0.smithi144.stderr: -213> 2024-06-04T16:12:14.063+0000 7f6cbcd3f800 5 AuthRegistry(0x564235530bb0) adding con mode: crc 2024-06-04T16:12:14.415 INFO:tasks.workunit.client.0.smithi144.stderr: -212> 2024-06-04T16:12:14.063+0000 7f6cbcd3f800 5 AuthRegistry(0x564235530bb0) adding con mode: secure 2024-06-04T16:12:14.415 INFO:tasks.workunit.client.0.smithi144.stderr: -211> 2024-06-04T16:12:14.063+0000 7f6cbcd3f800 5 AuthRegistry(0x564235530bb0) adding con mode: crc 2024-06-04T16:12:14.415 INFO:tasks.workunit.client.0.smithi144.stderr: -210> 2024-06-04T16:12:14.063+0000 7f6cbcd3f800 5 AuthRegistry(0x564235530bb0) adding con mode: secure 2024-06-04T16:12:14.415 INFO:tasks.workunit.client.0.smithi144.stderr: -209> 2024-06-04T16:12:14.063+0000 7f6cbcd3f800 5 AuthRegistry(0x564235530bb0) adding con mode: crc 2024-06-04T16:12:14.415 INFO:tasks.workunit.client.0.smithi144.stderr: -208> 2024-06-04T16:12:14.063+0000 7f6cbcd3f800 5 AuthRegistry(0x564235530bb0) adding con mode: crc 2024-06-04T16:12:14.415 INFO:tasks.workunit.client.0.smithi144.stderr: -207> 2024-06-04T16:12:14.063+0000 7f6cbcd3f800 5 AuthRegistry(0x564235530bb0) adding con mode: secure 2024-06-04T16:12:14.415 INFO:tasks.workunit.client.0.smithi144.stderr: -206> 2024-06-04T16:12:14.063+0000 7f6cbcd3f800 5 AuthRegistry(0x564235530bb0) adding con mode: crc 2024-06-04T16:12:14.415 INFO:tasks.workunit.client.0.smithi144.stderr: -205> 2024-06-04T16:12:14.063+0000 7f6cbcd3f800 5 AuthRegistry(0x564235530bb0) adding con mode: secure 2024-06-04T16:12:14.415 INFO:tasks.workunit.client.0.smithi144.stderr: -204> 2024-06-04T16:12:14.063+0000 7f6cbcd3f800 5 AuthRegistry(0x564235530bb0) adding con mode: crc 2024-06-04T16:12:14.415 INFO:tasks.workunit.client.0.smithi144.stderr: -203> 2024-06-04T16:12:14.063+0000 7f6cbcd3f800 5 AuthRegistry(0x564235530bb0) adding con mode: secure 2024-06-04T16:12:14.415 INFO:tasks.workunit.client.0.smithi144.stderr: -202> 2024-06-04T16:12:14.063+0000 7f6cbcd3f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-06-04T16:12:14.415 INFO:tasks.workunit.client.0.smithi144.stderr: -201> 2024-06-04T16:12:14.063+0000 7f6cbcd3f800 1 librados: starting msgr at 2024-06-04T16:12:14.415 INFO:tasks.workunit.client.0.smithi144.stderr: -200> 2024-06-04T16:12:14.063+0000 7f6cbcd3f800 1 librados: starting objecter 2024-06-04T16:12:14.415 INFO:tasks.workunit.client.0.smithi144.stderr: -199> 2024-06-04T16:12:14.063+0000 7f6cbcd3f800 5 asok(0x564235270c60) register_command objecter_requests cmddesc objecter_requests hook 0x564235534540 EEXIST 2024-06-04T16:12:14.416 INFO:tasks.workunit.client.0.smithi144.stderr: -198> 2024-06-04T16:12:14.063+0000 7f6cbcd3f800 1 librados: setting wanted keys 2024-06-04T16:12:14.416 INFO:tasks.workunit.client.0.smithi144.stderr: -197> 2024-06-04T16:12:14.063+0000 7f6cbcd3f800 1 librados: calling monclient init 2024-06-04T16:12:14.416 INFO:tasks.workunit.client.0.smithi144.stderr: -196> 2024-06-04T16:12:14.063+0000 7f6cbcd3f800 10 monclient: init 2024-06-04T16:12:14.416 INFO:tasks.workunit.client.0.smithi144.stderr: -195> 2024-06-04T16:12:14.063+0000 7f6cbcd3f800 5 AuthRegistry(0x564235528e30) adding auth protocol: cephx 2024-06-04T16:12:14.416 INFO:tasks.workunit.client.0.smithi144.stderr: -194> 2024-06-04T16:12:14.063+0000 7f6cbcd3f800 5 AuthRegistry(0x564235528e30) adding auth protocol: cephx 2024-06-04T16:12:14.416 INFO:tasks.workunit.client.0.smithi144.stderr: -193> 2024-06-04T16:12:14.063+0000 7f6cbcd3f800 5 AuthRegistry(0x564235528e30) adding auth protocol: cephx 2024-06-04T16:12:14.416 INFO:tasks.workunit.client.0.smithi144.stderr: -192> 2024-06-04T16:12:14.063+0000 7f6cbcd3f800 5 AuthRegistry(0x564235528e30) adding con mode: secure 2024-06-04T16:12:14.416 INFO:tasks.workunit.client.0.smithi144.stderr: -191> 2024-06-04T16:12:14.063+0000 7f6cbcd3f800 5 AuthRegistry(0x564235528e30) adding con mode: crc 2024-06-04T16:12:14.416 INFO:tasks.workunit.client.0.smithi144.stderr: -190> 2024-06-04T16:12:14.063+0000 7f6cbcd3f800 5 AuthRegistry(0x564235528e30) adding con mode: secure 2024-06-04T16:12:14.416 INFO:tasks.workunit.client.0.smithi144.stderr: -189> 2024-06-04T16:12:14.063+0000 7f6cbcd3f800 5 AuthRegistry(0x564235528e30) adding con mode: crc 2024-06-04T16:12:14.416 INFO:tasks.workunit.client.0.smithi144.stderr: -188> 2024-06-04T16:12:14.063+0000 7f6cbcd3f800 5 AuthRegistry(0x564235528e30) adding con mode: secure 2024-06-04T16:12:14.416 INFO:tasks.workunit.client.0.smithi144.stderr: -187> 2024-06-04T16:12:14.063+0000 7f6cbcd3f800 5 AuthRegistry(0x564235528e30) adding con mode: crc 2024-06-04T16:12:14.416 INFO:tasks.workunit.client.0.smithi144.stderr: -186> 2024-06-04T16:12:14.063+0000 7f6cbcd3f800 5 AuthRegistry(0x564235528e30) adding con mode: crc 2024-06-04T16:12:14.416 INFO:tasks.workunit.client.0.smithi144.stderr: -185> 2024-06-04T16:12:14.063+0000 7f6cbcd3f800 5 AuthRegistry(0x564235528e30) adding con mode: secure 2024-06-04T16:12:14.417 INFO:tasks.workunit.client.0.smithi144.stderr: -184> 2024-06-04T16:12:14.063+0000 7f6cbcd3f800 5 AuthRegistry(0x564235528e30) adding con mode: crc 2024-06-04T16:12:14.417 INFO:tasks.workunit.client.0.smithi144.stderr: -183> 2024-06-04T16:12:14.063+0000 7f6cbcd3f800 5 AuthRegistry(0x564235528e30) adding con mode: secure 2024-06-04T16:12:14.417 INFO:tasks.workunit.client.0.smithi144.stderr: -182> 2024-06-04T16:12:14.063+0000 7f6cbcd3f800 5 AuthRegistry(0x564235528e30) adding con mode: crc 2024-06-04T16:12:14.417 INFO:tasks.workunit.client.0.smithi144.stderr: -181> 2024-06-04T16:12:14.063+0000 7f6cbcd3f800 5 AuthRegistry(0x564235528e30) adding con mode: secure 2024-06-04T16:12:14.417 INFO:tasks.workunit.client.0.smithi144.stderr: -180> 2024-06-04T16:12:14.063+0000 7f6cbcd3f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-06-04T16:12:14.417 INFO:tasks.workunit.client.0.smithi144.stderr: -179> 2024-06-04T16:12:14.064+0000 7f6cbcd3f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-06-04T16:12:14.417 INFO:tasks.workunit.client.0.smithi144.stderr: -178> 2024-06-04T16:12:14.064+0000 7f6cbcd3f800 5 asok(0x564235270c60) register_command rotate-key cmddesc rotate-key hook 0x564235528f78 EEXIST 2024-06-04T16:12:14.417 INFO:tasks.workunit.client.0.smithi144.stderr: -177> 2024-06-04T16:12:14.064+0000 7f6cbcd3f800 10 monclient: _reopen_session rank -1 2024-06-04T16:12:14.417 INFO:tasks.workunit.client.0.smithi144.stderr: -176> 2024-06-04T16:12:14.064+0000 7f6cbcd3f800 10 monclient: _add_conns ranks=[2,1,0] 2024-06-04T16:12:14.417 INFO:tasks.workunit.client.0.smithi144.stderr: -175> 2024-06-04T16:12:14.064+0000 7f6cbcd3f800 10 monclient(hunting): picked mon.noname-c con 0x564235536330 addr [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] 2024-06-04T16:12:14.417 INFO:tasks.workunit.client.0.smithi144.stderr: -174> 2024-06-04T16:12:14.064+0000 7f6cbcd3f800 10 monclient(hunting): picked mon.noname-b con 0x564235556b30 addr [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] 2024-06-04T16:12:14.417 INFO:tasks.workunit.client.0.smithi144.stderr: -173> 2024-06-04T16:12:14.064+0000 7f6cbcd3f800 10 monclient(hunting): picked mon.noname-a con 0x564235560ab0 addr [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] 2024-06-04T16:12:14.417 INFO:tasks.workunit.client.0.smithi144.stderr: -172> 2024-06-04T16:12:14.064+0000 7f6cbcd3f800 10 monclient(hunting): start opening mon connection 2024-06-04T16:12:14.417 INFO:tasks.workunit.client.0.smithi144.stderr: -171> 2024-06-04T16:12:14.064+0000 7f6cbcd3f800 10 monclient(hunting): start opening mon connection 2024-06-04T16:12:14.417 INFO:tasks.workunit.client.0.smithi144.stderr: -170> 2024-06-04T16:12:14.064+0000 7f6cbcd3f800 10 monclient(hunting): start opening mon connection 2024-06-04T16:12:14.418 INFO:tasks.workunit.client.0.smithi144.stderr: -169> 2024-06-04T16:12:14.064+0000 7f6cbcd3f800 10 monclient(hunting): _renew_subs 2024-06-04T16:12:14.418 INFO:tasks.workunit.client.0.smithi144.stderr: -168> 2024-06-04T16:12:14.064+0000 7f6cbcd3f800 10 monclient(hunting): authenticate will time out at 1971.880340s 2024-06-04T16:12:14.418 INFO:tasks.workunit.client.0.smithi144.stderr: -167> 2024-06-04T16:12:14.064+0000 7f6cb3fff640 10 monclient(hunting): get_auth_request con 0x564235536330 auth_method 0 2024-06-04T16:12:14.418 INFO:tasks.workunit.client.0.smithi144.stderr: -166> 2024-06-04T16:12:14.064+0000 7f6cb3fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-06-04T16:12:14.418 INFO:tasks.workunit.client.0.smithi144.stderr: -165> 2024-06-04T16:12:14.064+0000 7f6cb3fff640 10 monclient(hunting): _init_auth method 2 2024-06-04T16:12:14.418 INFO:tasks.workunit.client.0.smithi144.stderr: -164> 2024-06-04T16:12:14.064+0000 7f6cb3fff640 10 monclient(hunting): _init_auth creating new auth 2024-06-04T16:12:14.418 INFO:tasks.workunit.client.0.smithi144.stderr: -163> 2024-06-04T16:12:14.064+0000 7f6cb8a91640 10 monclient(hunting): get_auth_request con 0x564235560ab0 auth_method 0 2024-06-04T16:12:14.418 INFO:tasks.workunit.client.0.smithi144.stderr: -162> 2024-06-04T16:12:14.064+0000 7f6cb8a91640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-06-04T16:12:14.418 INFO:tasks.workunit.client.0.smithi144.stderr: -161> 2024-06-04T16:12:14.064+0000 7f6cb8a91640 10 monclient(hunting): _init_auth method 2 2024-06-04T16:12:14.418 INFO:tasks.workunit.client.0.smithi144.stderr: -160> 2024-06-04T16:12:14.064+0000 7f6cb8a91640 10 monclient(hunting): _init_auth creating new auth 2024-06-04T16:12:14.418 INFO:tasks.workunit.client.0.smithi144.stderr: -159> 2024-06-04T16:12:14.064+0000 7f6cb3fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-06-04T16:12:14.418 INFO:tasks.workunit.client.0.smithi144.stderr: -158> 2024-06-04T16:12:14.064+0000 7f6cb3fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-06-04T16:12:14.418 INFO:tasks.workunit.client.0.smithi144.stderr: -157> 2024-06-04T16:12:14.064+0000 7f6cb3fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-06-04T16:12:14.419 INFO:tasks.workunit.client.0.smithi144.stderr: -156> 2024-06-04T16:12:14.064+0000 7f6cb9292640 10 monclient(hunting): get_auth_request con 0x564235556b30 auth_method 0 2024-06-04T16:12:14.419 INFO:tasks.workunit.client.0.smithi144.stderr: -155> 2024-06-04T16:12:14.064+0000 7f6cb9292640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-06-04T16:12:14.419 INFO:tasks.workunit.client.0.smithi144.stderr: -154> 2024-06-04T16:12:14.064+0000 7f6cb9292640 10 monclient(hunting): _init_auth method 2 2024-06-04T16:12:14.419 INFO:tasks.workunit.client.0.smithi144.stderr: -153> 2024-06-04T16:12:14.064+0000 7f6cb9292640 10 monclient(hunting): _init_auth creating new auth 2024-06-04T16:12:14.419 INFO:tasks.workunit.client.0.smithi144.stderr: -152> 2024-06-04T16:12:14.064+0000 7f6cb8a91640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-06-04T16:12:14.419 INFO:tasks.workunit.client.0.smithi144.stderr: -151> 2024-06-04T16:12:14.064+0000 7f6cb8a91640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-06-04T16:12:14.419 INFO:tasks.workunit.client.0.smithi144.stderr: -150> 2024-06-04T16:12:14.064+0000 7f6cb8a91640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-06-04T16:12:14.419 INFO:tasks.workunit.client.0.smithi144.stderr: -149> 2024-06-04T16:12:14.064+0000 7f6cb9292640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-06-04T16:12:14.419 INFO:tasks.workunit.client.0.smithi144.stderr: -148> 2024-06-04T16:12:14.064+0000 7f6cb9292640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-06-04T16:12:14.419 INFO:tasks.workunit.client.0.smithi144.stderr: -147> 2024-06-04T16:12:14.064+0000 7f6cb9292640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-06-04T16:12:14.419 INFO:tasks.workunit.client.0.smithi144.stderr: -146> 2024-06-04T16:12:14.064+0000 7f6cb3fff640 10 monclient(hunting): handle_auth_done global_id 6161 payload 824 2024-06-04T16:12:14.419 INFO:tasks.workunit.client.0.smithi144.stderr: -145> 2024-06-04T16:12:14.064+0000 7f6cb3fff640 10 monclient: _finish_hunting 0 2024-06-04T16:12:14.419 INFO:tasks.workunit.client.0.smithi144.stderr: -144> 2024-06-04T16:12:14.064+0000 7f6cb3fff640 1 monclient: found mon.noname-c 2024-06-04T16:12:14.419 INFO:tasks.workunit.client.0.smithi144.stderr: -143> 2024-06-04T16:12:14.064+0000 7f6cb3fff640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.144:3301/0 2024-06-04T16:12:14.420 INFO:tasks.workunit.client.0.smithi144.stderr: -142> 2024-06-04T16:12:14.064+0000 7f6b8e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-06-04T16:12:14.420 INFO:tasks.workunit.client.0.smithi144.stderr: -141> 2024-06-04T16:12:14.064+0000 7f6b8e7fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-06-04T16:12:14.420 INFO:tasks.workunit.client.0.smithi144.stderr: -140> 2024-06-04T16:12:14.064+0000 7f6b8e7fc640 10 monclient: dump: 2024-06-04T16:12:14.420 INFO:tasks.workunit.client.0.smithi144.stderr:epoch 1 2024-06-04T16:12:14.420 INFO:tasks.workunit.client.0.smithi144.stderr:fsid 15e56bb1-4856-42f3-b6db-a2c8f23c5557 2024-06-04T16:12:14.420 INFO:tasks.workunit.client.0.smithi144.stderr:last_changed 2024-06-04T15:51:29.789359+0000 2024-06-04T16:12:14.420 INFO:tasks.workunit.client.0.smithi144.stderr:created 2024-06-04T15:51:29.789359+0000 2024-06-04T16:12:14.420 INFO:tasks.workunit.client.0.smithi144.stderr:min_mon_release 19 (squid) 2024-06-04T16:12:14.420 INFO:tasks.workunit.client.0.smithi144.stderr:election_strategy: 1 2024-06-04T16:12:14.420 INFO:tasks.workunit.client.0.smithi144.stderr:0: [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] mon.a 2024-06-04T16:12:14.420 INFO:tasks.workunit.client.0.smithi144.stderr:1: [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] mon.b 2024-06-04T16:12:14.420 INFO:tasks.workunit.client.0.smithi144.stderr:2: [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] mon.c 2024-06-04T16:12:14.420 INFO:tasks.workunit.client.0.smithi144.stderr: 2024-06-04T16:12:14.420 INFO:tasks.workunit.client.0.smithi144.stderr: -139> 2024-06-04T16:12:14.064+0000 7f6b8e7fc640 10 monclient: _finish_auth 0 2024-06-04T16:12:14.421 INFO:tasks.workunit.client.0.smithi144.stderr: -138> 2024-06-04T16:12:14.064+0000 7f6b8e7fc640 10 monclient: _check_auth_tickets 2024-06-04T16:12:14.421 INFO:tasks.workunit.client.0.smithi144.stderr: -137> 2024-06-04T16:12:14.064+0000 7f6b8e7fc640 10 monclient: handle_config config(0 keys) 2024-06-04T16:12:14.421 INFO:tasks.workunit.client.0.smithi144.stderr: -136> 2024-06-04T16:12:14.064+0000 7f6b8e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-06-04T16:12:14.421 INFO:tasks.workunit.client.0.smithi144.stderr: -135> 2024-06-04T16:12:14.064+0000 7f6b8e7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-06-04T16:12:14.421 INFO:tasks.workunit.client.0.smithi144.stderr: -134> 2024-06-04T16:12:14.064+0000 7f6b8e7fc640 10 monclient: dump: 2024-06-04T16:12:14.421 INFO:tasks.workunit.client.0.smithi144.stderr:epoch 1 2024-06-04T16:12:14.421 INFO:tasks.workunit.client.0.smithi144.stderr:fsid 15e56bb1-4856-42f3-b6db-a2c8f23c5557 2024-06-04T16:12:14.421 INFO:tasks.workunit.client.0.smithi144.stderr:last_changed 2024-06-04T15:51:29.789359+0000 2024-06-04T16:12:14.421 INFO:tasks.workunit.client.0.smithi144.stderr:created 2024-06-04T15:51:29.789359+0000 2024-06-04T16:12:14.421 INFO:tasks.workunit.client.0.smithi144.stderr:min_mon_release 19 (squid) 2024-06-04T16:12:14.421 INFO:tasks.workunit.client.0.smithi144.stderr:election_strategy: 1 2024-06-04T16:12:14.421 INFO:tasks.workunit.client.0.smithi144.stderr:0: [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] mon.a 2024-06-04T16:12:14.421 INFO:tasks.workunit.client.0.smithi144.stderr:1: [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] mon.b 2024-06-04T16:12:14.421 INFO:tasks.workunit.client.0.smithi144.stderr:2: [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] mon.c 2024-06-04T16:12:14.422 INFO:tasks.workunit.client.0.smithi144.stderr: 2024-06-04T16:12:14.422 INFO:tasks.workunit.client.0.smithi144.stderr: -133> 2024-06-04T16:12:14.064+0000 7f6cbcd3f800 5 monclient: authenticate success, global_id 6161 2024-06-04T16:12:14.422 INFO:tasks.workunit.client.0.smithi144.stderr: -132> 2024-06-04T16:12:14.064+0000 7f6cbcd3f800 10 monclient: _renew_subs 2024-06-04T16:12:14.422 INFO:tasks.workunit.client.0.smithi144.stderr: -131> 2024-06-04T16:12:14.064+0000 7f6cbcd3f800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.144:3301/0 2024-06-04T16:12:14.422 INFO:tasks.workunit.client.0.smithi144.stderr: -130> 2024-06-04T16:12:14.064+0000 7f6b8ffff640 4 set_mon_vals no callback set 2024-06-04T16:12:14.422 INFO:tasks.workunit.client.0.smithi144.stderr: -129> 2024-06-04T16:12:14.064+0000 7f6cbcd3f800 10 monclient: _renew_subs 2024-06-04T16:12:14.422 INFO:tasks.workunit.client.0.smithi144.stderr: -128> 2024-06-04T16:12:14.064+0000 7f6cbcd3f800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.144:3301/0 2024-06-04T16:12:14.422 INFO:tasks.workunit.client.0.smithi144.stderr: -127> 2024-06-04T16:12:14.064+0000 7f6cbcd3f800 1 librados: init done 2024-06-04T16:12:14.422 INFO:tasks.workunit.client.0.smithi144.stderr: -126> 2024-06-04T16:12:14.064+0000 7f6cbcd3f800 5 asok(0x564235270c60) register_command cr dump hook 0x564235557818 2024-06-04T16:12:14.422 INFO:tasks.workunit.client.0.smithi144.stderr: -125> 2024-06-04T16:12:14.066+0000 7f6cbcd3f800 20 rados->read ofs=0 len=0 2024-06-04T16:12:14.422 INFO:tasks.workunit.client.0.smithi144.stderr: -124> 2024-06-04T16:12:14.066+0000 7f6b8e7fc640 4 mgrc handle_mgr_map Got map version 5 2024-06-04T16:12:14.422 INFO:tasks.workunit.client.0.smithi144.stderr: -123> 2024-06-04T16:12:14.066+0000 7f6b8e7fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.177:6832/2645786330,v1:172.21.15.177:6833/2645786330] 2024-06-04T16:12:14.422 INFO:tasks.workunit.client.0.smithi144.stderr: -122> 2024-06-04T16:12:14.066+0000 7f6b8e7fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.177:6832/2645786330,v1:172.21.15.177:6833/2645786330] 2024-06-04T16:12:14.423 INFO:tasks.workunit.client.0.smithi144.stderr: -121> 2024-06-04T16:12:14.067+0000 7f6cb9292640 10 monclient: get_auth_request con 0x7f6b84074cb0 auth_method 0 2024-06-04T16:12:14.423 INFO:tasks.workunit.client.0.smithi144.stderr: -120> 2024-06-04T16:12:14.067+0000 7f6cb8a91640 10 monclient: get_auth_request con 0x56423557eac0 auth_method 0 2024-06-04T16:12:14.423 INFO:tasks.workunit.client.0.smithi144.stderr: -119> 2024-06-04T16:12:14.067+0000 7f6cbcd3f800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:12:14.423 INFO:tasks.workunit.client.0.smithi144.stderr: -118> 2024-06-04T16:12:14.067+0000 7f6cbcd3f800 20 realm 2024-06-04T16:12:14.423 INFO:tasks.workunit.client.0.smithi144.stderr: -117> 2024-06-04T16:12:14.067+0000 7f6cbcd3f800 20 rados->read ofs=0 len=0 2024-06-04T16:12:14.423 INFO:tasks.workunit.client.0.smithi144.stderr: -116> 2024-06-04T16:12:14.067+0000 7f6cbcd3f800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:12:14.423 INFO:tasks.workunit.client.0.smithi144.stderr: -115> 2024-06-04T16:12:14.067+0000 7f6cbcd3f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-06-04T16:12:14.423 INFO:tasks.workunit.client.0.smithi144.stderr: -114> 2024-06-04T16:12:14.067+0000 7f6cbcd3f800 20 rados->read ofs=0 len=0 2024-06-04T16:12:14.423 INFO:tasks.workunit.client.0.smithi144.stderr: -113> 2024-06-04T16:12:14.068+0000 7f6cbcd3f800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:12:14.423 INFO:tasks.workunit.client.0.smithi144.stderr: -112> 2024-06-04T16:12:14.068+0000 7f6cbcd3f800 20 rados->read ofs=0 len=0 2024-06-04T16:12:14.423 INFO:tasks.workunit.client.0.smithi144.stderr: -111> 2024-06-04T16:12:14.068+0000 7f6cb3fff640 10 monclient: get_auth_request con 0x564235582da0 auth_method 0 2024-06-04T16:12:14.423 INFO:tasks.workunit.client.0.smithi144.stderr: -110> 2024-06-04T16:12:14.068+0000 7f6cbcd3f800 20 rados_obj.operate() r=0 bl.length=46 2024-06-04T16:12:14.423 INFO:tasks.workunit.client.0.smithi144.stderr: -109> 2024-06-04T16:12:14.068+0000 7f6cbcd3f800 20 rados->read ofs=0 len=0 2024-06-04T16:12:14.424 INFO:tasks.workunit.client.0.smithi144.stderr: -108> 2024-06-04T16:12:14.068+0000 7f6cb9292640 10 monclient: get_auth_request con 0x5642355864c0 auth_method 0 2024-06-04T16:12:14.424 INFO:tasks.workunit.client.0.smithi144.stderr: -107> 2024-06-04T16:12:14.069+0000 7f6cbcd3f800 20 rados_obj.operate() r=0 bl.length=1139 2024-06-04T16:12:14.424 INFO:tasks.workunit.client.0.smithi144.stderr: -106> 2024-06-04T16:12:14.069+0000 7f6cbcd3f800 20 searching for the correct realm 2024-06-04T16:12:14.424 INFO:tasks.workunit.client.0.smithi144.stderr: -105> 2024-06-04T16:12:14.069+0000 7f6cb8a91640 10 monclient: get_auth_request con 0x56423558b240 auth_method 0 2024-06-04T16:12:14.424 INFO:tasks.workunit.client.0.smithi144.stderr: -104> 2024-06-04T16:12:14.070+0000 7f6cb3fff640 10 monclient: get_auth_request con 0x7f6cac05e6f0 auth_method 0 2024-06-04T16:12:14.424 INFO:tasks.workunit.client.0.smithi144.stderr: -103> 2024-06-04T16:12:14.071+0000 7f6cb3fff640 0 -- 172.21.15.144:0/1373499307 >> [v2:172.21.15.144:6816/2358575268,v1:172.21.15.144:6817/2358575268] conn(0x564235582da0 msgr2=0x564235585190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-06-04T16:12:14.424 INFO:tasks.workunit.client.0.smithi144.stderr: -102> 2024-06-04T16:12:14.071+0000 7f6b8e7fc640 1 client.6161.objecter ms_handle_reset 0x564235582da0 session 0x564235581c70 osd.1 2024-06-04T16:12:14.424 INFO:tasks.workunit.client.0.smithi144.stderr: -101> 2024-06-04T16:12:14.071+0000 7f6b8e7fc640 10 monclient: _renew_subs 2024-06-04T16:12:14.424 INFO:tasks.workunit.client.0.smithi144.stderr: -100> 2024-06-04T16:12:14.071+0000 7f6b8e7fc640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.144:3301/0 2024-06-04T16:12:14.424 INFO:tasks.workunit.client.0.smithi144.stderr: -99> 2024-06-04T16:12:14.071+0000 7f6cb9292640 10 monclient: get_auth_request con 0x7f6ca40c6020 auth_method 0 2024-06-04T16:12:14.424 INFO:tasks.workunit.client.0.smithi144.stderr: -98> 2024-06-04T16:12:14.071+0000 7f6cb3fff640 10 monclient: get_auth_request con 0x7f6b84085060 auth_method 0 2024-06-04T16:12:14.424 INFO:tasks.workunit.client.0.smithi144.stderr: -97> 2024-06-04T16:12:14.072+0000 7f6cb8a91640 10 monclient: get_auth_request con 0x7f6cac08d220 auth_method 0 2024-06-04T16:12:14.424 INFO:tasks.workunit.client.0.smithi144.stderr: -96> 2024-06-04T16:12:14.073+0000 7f6cb3fff640 0 -- 172.21.15.144:0/1373499307 >> [v2:172.21.15.177:6808/2618477608,v1:172.21.15.177:6809/2618477608] conn(0x7f6ca404b5e0 msgr2=0x7f6ca404b000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-06-04T16:12:14.424 INFO:tasks.workunit.client.0.smithi144.stderr: -95> 2024-06-04T16:12:14.073+0000 7f6cb3fff640 10 monclient: get_auth_request con 0x7f6ca404b5e0 auth_method 0 2024-06-04T16:12:14.425 INFO:tasks.workunit.client.0.smithi144.stderr: -94> 2024-06-04T16:12:14.275+0000 7f6cb3fff640 10 monclient: get_auth_request con 0x7f6ca404b5e0 auth_method 0 2024-06-04T16:12:14.425 INFO:tasks.workunit.client.0.smithi144.stderr: -93> 2024-06-04T16:12:14.280+0000 7f6cbcd3f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-06-04T16:12:14.425 INFO:tasks.workunit.client.0.smithi144.stderr: -92> 2024-06-04T16:12:14.280+0000 7f6cbcd3f800 20 RGWRados::pool_iterate: got zone_info.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767 2024-06-04T16:12:14.425 INFO:tasks.workunit.client.0.smithi144.stderr: -91> 2024-06-04T16:12:14.280+0000 7f6cbcd3f800 20 RGWRados::pool_iterate: got default.zone. 2024-06-04T16:12:14.425 INFO:tasks.workunit.client.0.smithi144.stderr: -90> 2024-06-04T16:12:14.280+0000 7f6cbcd3f800 20 RGWRados::pool_iterate: got zonegroup_info.abb22408-c332-4e28-8f7a-ff254ea2fed2 2024-06-04T16:12:14.425 INFO:tasks.workunit.client.0.smithi144.stderr: -89> 2024-06-04T16:12:14.281+0000 7f6cbcd3f800 20 RGWRados::pool_iterate: got zone_names.default 2024-06-04T16:12:14.425 INFO:tasks.workunit.client.0.smithi144.stderr: -88> 2024-06-04T16:12:14.281+0000 7f6cbcd3f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-06-04T16:12:14.425 INFO:tasks.workunit.client.0.smithi144.stderr: -87> 2024-06-04T16:12:14.281+0000 7f6cbcd3f800 20 rados->read ofs=0 len=0 2024-06-04T16:12:14.425 INFO:tasks.workunit.client.0.smithi144.stderr: -86> 2024-06-04T16:12:14.281+0000 7f6cbcd3f800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:12:14.425 INFO:tasks.workunit.client.0.smithi144.stderr: -85> 2024-06-04T16:12:14.281+0000 7f6cbcd3f800 20 rados->read ofs=0 len=0 2024-06-04T16:12:14.425 INFO:tasks.workunit.client.0.smithi144.stderr: -84> 2024-06-04T16:12:14.281+0000 7f6cbcd3f800 20 rados_obj.operate() r=0 bl.length=46 2024-06-04T16:12:14.425 INFO:tasks.workunit.client.0.smithi144.stderr: -83> 2024-06-04T16:12:14.281+0000 7f6cbcd3f800 20 rados->read ofs=0 len=0 2024-06-04T16:12:14.425 INFO:tasks.workunit.client.0.smithi144.stderr: -82> 2024-06-04T16:12:14.282+0000 7f6cbcd3f800 20 rados_obj.operate() r=0 bl.length=470 2024-06-04T16:12:14.426 INFO:tasks.workunit.client.0.smithi144.stderr: -81> 2024-06-04T16:12:14.282+0000 7f6cbcd3f800 20 zone default found 2024-06-04T16:12:14.426 INFO:tasks.workunit.client.0.smithi144.stderr: -80> 2024-06-04T16:12:14.282+0000 7f6cbcd3f800 4 Realm: () 2024-06-04T16:12:14.426 INFO:tasks.workunit.client.0.smithi144.stderr: -79> 2024-06-04T16:12:14.282+0000 7f6cbcd3f800 4 ZoneGroup: default (abb22408-c332-4e28-8f7a-ff254ea2fed2) 2024-06-04T16:12:14.426 INFO:tasks.workunit.client.0.smithi144.stderr: -78> 2024-06-04T16:12:14.282+0000 7f6cbcd3f800 4 Zone: default (be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767) 2024-06-04T16:12:14.426 INFO:tasks.workunit.client.0.smithi144.stderr: -77> 2024-06-04T16:12:14.282+0000 7f6cbcd3f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-06-04T16:12:14.426 INFO:tasks.workunit.client.0.smithi144.stderr: -76> 2024-06-04T16:12:14.282+0000 7f6cbcd3f800 20 zonegroup default 2024-06-04T16:12:14.426 INFO:tasks.workunit.client.0.smithi144.stderr: -75> 2024-06-04T16:12:14.282+0000 7f6cbcd3f800 20 rados->read ofs=0 len=0 2024-06-04T16:12:14.426 INFO:tasks.workunit.client.0.smithi144.stderr: -74> 2024-06-04T16:12:14.282+0000 7f6cbcd3f800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:12:14.426 INFO:tasks.workunit.client.0.smithi144.stderr: -73> 2024-06-04T16:12:14.282+0000 7f6cbcd3f800 20 rados->read ofs=0 len=0 2024-06-04T16:12:14.426 INFO:tasks.workunit.client.0.smithi144.stderr: -72> 2024-06-04T16:12:14.282+0000 7f6cbcd3f800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:12:14.426 INFO:tasks.workunit.client.0.smithi144.stderr: -71> 2024-06-04T16:12:14.282+0000 7f6cbcd3f800 20 rados->read ofs=0 len=0 2024-06-04T16:12:14.426 INFO:tasks.workunit.client.0.smithi144.stderr: -70> 2024-06-04T16:12:14.283+0000 7f6cbcd3f800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:12:14.426 INFO:tasks.workunit.client.0.smithi144.stderr: -69> 2024-06-04T16:12:14.283+0000 7f6cbcd3f800 20 started sync module instance, tier type = 2024-06-04T16:12:14.426 INFO:tasks.workunit.client.0.smithi144.stderr: -68> 2024-06-04T16:12:14.283+0000 7f6cbcd3f800 20 started zone id=be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767 (name=default) with tier type = 2024-06-04T16:12:14.427 INFO:tasks.workunit.client.0.smithi144.stderr: -67> 2024-06-04T16:12:14.291+0000 7f6cbcd3f800 20 add_watcher() i=0 2024-06-04T16:12:14.427 INFO:tasks.workunit.client.0.smithi144.stderr: -66> 2024-06-04T16:12:14.291+0000 7f6cbcd3f800 20 add_watcher() i=1 2024-06-04T16:12:14.427 INFO:tasks.workunit.client.0.smithi144.stderr: -65> 2024-06-04T16:12:14.291+0000 7f6cbcd3f800 20 add_watcher() i=2 2024-06-04T16:12:14.427 INFO:tasks.workunit.client.0.smithi144.stderr: -64> 2024-06-04T16:12:14.291+0000 7f6cbcd3f800 20 add_watcher() i=3 2024-06-04T16:12:14.427 INFO:tasks.workunit.client.0.smithi144.stderr: -63> 2024-06-04T16:12:14.291+0000 7f6cbcd3f800 20 add_watcher() i=4 2024-06-04T16:12:14.427 INFO:tasks.workunit.client.0.smithi144.stderr: -62> 2024-06-04T16:12:14.291+0000 7f6cbcd3f800 20 add_watcher() i=5 2024-06-04T16:12:14.427 INFO:tasks.workunit.client.0.smithi144.stderr: -61> 2024-06-04T16:12:14.291+0000 7f6cbcd3f800 20 add_watcher() i=6 2024-06-04T16:12:14.427 INFO:tasks.workunit.client.0.smithi144.stderr: -60> 2024-06-04T16:12:14.292+0000 7f6cbcd3f800 20 add_watcher() i=7 2024-06-04T16:12:14.427 INFO:tasks.workunit.client.0.smithi144.stderr: -59> 2024-06-04T16:12:14.292+0000 7f6cbcd3f800 2 all 8 watchers are set, enabling cache 2024-06-04T16:12:14.427 INFO:tasks.workunit.client.0.smithi144.stderr: -58> 2024-06-04T16:12:14.294+0000 7f6cbcd3f800 5 AuthRegistry(0x7fff54a70f70) adding auth protocol: cephx 2024-06-04T16:12:14.427 INFO:tasks.workunit.client.0.smithi144.stderr: -57> 2024-06-04T16:12:14.294+0000 7f6cbcd3f800 5 AuthRegistry(0x7fff54a70f70) adding auth protocol: cephx 2024-06-04T16:12:14.427 INFO:tasks.workunit.client.0.smithi144.stderr: -56> 2024-06-04T16:12:14.294+0000 7f6cbcd3f800 5 AuthRegistry(0x7fff54a70f70) adding auth protocol: cephx 2024-06-04T16:12:14.427 INFO:tasks.workunit.client.0.smithi144.stderr: -55> 2024-06-04T16:12:14.294+0000 7f6cbcd3f800 5 AuthRegistry(0x7fff54a70f70) adding con mode: secure 2024-06-04T16:12:14.427 INFO:tasks.workunit.client.0.smithi144.stderr: -54> 2024-06-04T16:12:14.294+0000 7f6cbcd3f800 5 AuthRegistry(0x7fff54a70f70) adding con mode: crc 2024-06-04T16:12:14.428 INFO:tasks.workunit.client.0.smithi144.stderr: -53> 2024-06-04T16:12:14.294+0000 7f6cbcd3f800 5 AuthRegistry(0x7fff54a70f70) adding con mode: secure 2024-06-04T16:12:14.428 INFO:tasks.workunit.client.0.smithi144.stderr: -52> 2024-06-04T16:12:14.294+0000 7f6cbcd3f800 5 AuthRegistry(0x7fff54a70f70) adding con mode: crc 2024-06-04T16:12:14.428 INFO:tasks.workunit.client.0.smithi144.stderr: -51> 2024-06-04T16:12:14.294+0000 7f6cbcd3f800 5 AuthRegistry(0x7fff54a70f70) adding con mode: secure 2024-06-04T16:12:14.428 INFO:tasks.workunit.client.0.smithi144.stderr: -50> 2024-06-04T16:12:14.294+0000 7f6cbcd3f800 5 AuthRegistry(0x7fff54a70f70) adding con mode: crc 2024-06-04T16:12:14.428 INFO:tasks.workunit.client.0.smithi144.stderr: -49> 2024-06-04T16:12:14.294+0000 7f6cbcd3f800 5 AuthRegistry(0x7fff54a70f70) adding con mode: crc 2024-06-04T16:12:14.428 INFO:tasks.workunit.client.0.smithi144.stderr: -48> 2024-06-04T16:12:14.294+0000 7f6cbcd3f800 5 AuthRegistry(0x7fff54a70f70) adding con mode: secure 2024-06-04T16:12:14.428 INFO:tasks.workunit.client.0.smithi144.stderr: -47> 2024-06-04T16:12:14.294+0000 7f6cbcd3f800 5 AuthRegistry(0x7fff54a70f70) adding con mode: crc 2024-06-04T16:12:14.428 INFO:tasks.workunit.client.0.smithi144.stderr: -46> 2024-06-04T16:12:14.294+0000 7f6cbcd3f800 5 AuthRegistry(0x7fff54a70f70) adding con mode: secure 2024-06-04T16:12:14.428 INFO:tasks.workunit.client.0.smithi144.stderr: -45> 2024-06-04T16:12:14.294+0000 7f6b6efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-06-04T16:12:14.428 INFO:tasks.workunit.client.0.smithi144.stderr: -44> 2024-06-04T16:12:14.294+0000 7f6cbcd3f800 5 AuthRegistry(0x7fff54a70f70) adding con mode: crc 2024-06-04T16:12:14.428 INFO:tasks.workunit.client.0.smithi144.stderr: -43> 2024-06-04T16:12:14.294+0000 7f6cbcd3f800 5 AuthRegistry(0x7fff54a70f70) adding con mode: secure 2024-06-04T16:12:14.428 INFO:tasks.workunit.client.0.smithi144.stderr: -42> 2024-06-04T16:12:14.295+0000 7f6cbcd3f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-06-04T16:12:14.428 INFO:tasks.workunit.client.0.smithi144.stderr: -41> 2024-06-04T16:12:14.295+0000 7f6cbcd3f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-06-04T16:12:14.428 INFO:tasks.workunit.client.0.smithi144.stderr: -40> 2024-06-04T16:12:14.295+0000 7f6cbcd3f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-06-04T16:12:14.429 INFO:tasks.workunit.client.0.smithi144.stderr: -39> 2024-06-04T16:12:14.295+0000 7f6cbcd3f800 5 asok(0x564235270c60) register_command cache list hook 0x564235557380 2024-06-04T16:12:14.429 INFO:tasks.workunit.client.0.smithi144.stderr: -38> 2024-06-04T16:12:14.295+0000 7f6cbcd3f800 5 asok(0x564235270c60) register_command cache inspect hook 0x564235557380 2024-06-04T16:12:14.429 INFO:tasks.workunit.client.0.smithi144.stderr: -37> 2024-06-04T16:12:14.295+0000 7f6cbcd3f800 5 asok(0x564235270c60) register_command cache erase hook 0x564235557380 2024-06-04T16:12:14.429 INFO:tasks.workunit.client.0.smithi144.stderr: -36> 2024-06-04T16:12:14.295+0000 7f6cbcd3f800 5 asok(0x564235270c60) register_command cache zap hook 0x564235557380 2024-06-04T16:12:14.429 INFO:tasks.workunit.client.0.smithi144.stderr: -35> 2024-06-04T16:12:14.295+0000 7f6cbcd3f800 5 note: GC not initialized 2024-06-04T16:12:14.429 INFO:tasks.workunit.client.0.smithi144.stderr: -34> 2024-06-04T16:12:14.295+0000 7f6b6dfe3640 20 reqs_thread_entry: start 2024-06-04T16:12:14.429 INFO:tasks.workunit.client.0.smithi144.stderr: -33> 2024-06-04T16:12:14.295+0000 7f6cbcd3f800 5 asok(0x564235270c60) register_command sync trace show hook 0x7f6cac010050 2024-06-04T16:12:14.429 INFO:tasks.workunit.client.0.smithi144.stderr: -32> 2024-06-04T16:12:14.295+0000 7f6cbcd3f800 5 asok(0x564235270c60) register_command sync trace history hook 0x7f6cac010050 2024-06-04T16:12:14.429 INFO:tasks.workunit.client.0.smithi144.stderr: -31> 2024-06-04T16:12:14.295+0000 7f6cbcd3f800 5 asok(0x564235270c60) register_command sync trace active hook 0x7f6cac010050 2024-06-04T16:12:14.429 INFO:tasks.workunit.client.0.smithi144.stderr: -30> 2024-06-04T16:12:14.295+0000 7f6cbcd3f800 5 asok(0x564235270c60) register_command sync trace active_short hook 0x7f6cac010050 2024-06-04T16:12:14.429 INFO:tasks.workunit.client.0.smithi144.stderr: -29> 2024-06-04T16:12:14.295+0000 7f6cbcd3f800 20 init_complete bucket index max shards: 11 2024-06-04T16:12:14.429 INFO:tasks.workunit.client.0.smithi144.stderr: -28> 2024-06-04T16:12:14.295+0000 7f6cbcd3f800 20 Filter name: none 2024-06-04T16:12:14.429 INFO:tasks.workunit.client.0.smithi144.stderr: -27> 2024-06-04T16:12:14.295+0000 7f6adf7fe640 20 reqs_thread_entry: start 2024-06-04T16:12:14.429 INFO:tasks.workunit.client.0.smithi144.stderr: -26> 2024-06-04T16:12:14.295+0000 7f6cbcd3f800 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2024-06-04T16:12:14.430 INFO:tasks.workunit.client.0.smithi144.stderr: -25> 2024-06-04T16:12:14.295+0000 7f6cbcd3f800 20 rados->read ofs=0 len=0 2024-06-04T16:12:14.430 INFO:tasks.workunit.client.0.smithi144.stderr: -24> 2024-06-04T16:12:14.296+0000 7f6cbcd3f800 20 rados_obj.operate() r=0 bl.length=189 2024-06-04T16:12:14.430 INFO:tasks.workunit.client.0.smithi144.stderr: -23> 2024-06-04T16:12:14.296+0000 7f6cbcd3f800 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2024-06-04T16:12:14.430 INFO:tasks.workunit.client.0.smithi144.stderr: -22> 2024-06-04T16:12:14.296+0000 7f6cbcd3f800 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2024-06-04T16:12:14.430 INFO:tasks.workunit.client.0.smithi144.stderr: -21> 2024-06-04T16:12:14.296+0000 7f6cbcd3f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.23 : miss 2024-06-04T16:12:14.430 INFO:tasks.workunit.client.0.smithi144.stderr: -20> 2024-06-04T16:12:14.296+0000 7f6cbcd3f800 20 rados->read ofs=0 len=0 2024-06-04T16:12:14.430 INFO:tasks.workunit.client.0.smithi144.stderr: -19> 2024-06-04T16:12:14.296+0000 7f6cbcd3f800 20 rados_obj.operate() r=0 bl.length=403 2024-06-04T16:12:14.430 INFO:tasks.workunit.client.0.smithi144.stderr: -18> 2024-06-04T16:12:14.296+0000 7f6cbcd3f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.23 info.flags=0x17 2024-06-04T16:12:14.430 INFO:tasks.workunit.client.0.smithi144.stderr: -17> 2024-06-04T16:12:14.296+0000 7f6cbcd3f800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.23 to cache LRU end 2024-06-04T16:12:14.430 INFO:tasks.workunit.client.0.smithi144.stderr: -16> 2024-06-04T16:12:14.296+0000 7f6cbcd3f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-06-04T16:12:14.430 INFO:tasks.workunit.client.0.smithi144.stderr: -15> 2024-06-04T16:12:14.296+0000 7f6cbcd3f800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-06-04T16:12:14.430 INFO:tasks.workunit.client.0.smithi144.stderr: -14> 2024-06-04T16:12:14.296+0000 7f6cbcd3f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.23 2024-06-04T16:12:14.430 INFO:tasks.workunit.client.0.smithi144.stderr: -13> 2024-06-04T16:12:14.303+0000 7f6cbcd3f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.23 info.flags=0x17 2024-06-04T16:12:14.431 INFO:tasks.workunit.client.0.smithi144.stderr: -12> 2024-06-04T16:12:14.303+0000 7f6cbcd3f800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.23 to cache LRU end 2024-06-04T16:12:14.431 INFO:tasks.workunit.client.0.smithi144.stderr: -11> 2024-06-04T16:12:14.303+0000 7f6cbcd3f800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-06-04T16:12:14.431 INFO:tasks.workunit.client.0.smithi144.stderr: -10> 2024-06-04T16:12:14.303+0000 7f6cbcd3f800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.23, ofs0, ns] 2024-06-04T16:12:14.431 INFO:tasks.workunit.client.0.smithi144.stderr: -9> 2024-06-04T16:12:14.304+0000 7f6b8f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1078036791403 cookie 94842362851664 notifier 6161 bl.length()=907 2024-06-04T16:12:14.431 INFO:tasks.workunit.client.0.smithi144.stderr: -8> 2024-06-04T16:12:14.304+0000 7f6b8f7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.23 info.flags=0x17 2024-06-04T16:12:14.431 INFO:tasks.workunit.client.0.smithi144.stderr: -7> 2024-06-04T16:12:14.304+0000 7f6b8f7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.23 to cache LRU end 2024-06-04T16:12:14.431 INFO:tasks.workunit.client.0.smithi144.stderr: -6> 2024-06-04T16:12:14.304+0000 7f6b8f7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-06-04T16:12:14.431 INFO:tasks.workunit.client.0.smithi144.stderr: -5> 2024-06-04T16:12:14.304+0000 7f6cbcd3f800 20 handle_bi_update(): bucket=:abort-at-block-writes[be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.23]): orig_sources= new_sources= 2024-06-04T16:12:14.431 INFO:tasks.workunit.client.0.smithi144.stderr: -4> 2024-06-04T16:12:14.304+0000 7f6cbcd3f800 20 handle_bi_update(): bucket=:abort-at-block-writes[be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.23]): potential sources added=[] removed=[] 2024-06-04T16:12:14.431 INFO:tasks.workunit.client.0.smithi144.stderr: -3> 2024-06-04T16:12:14.304+0000 7f6cbcd3f800 20 handle_bi_update(): bucket=:abort-at-block-writes[be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.23]): orig_dests= new_dests= 2024-06-04T16:12:14.431 INFO:tasks.workunit.client.0.smithi144.stderr: -2> 2024-06-04T16:12:14.304+0000 7f6cbcd3f800 20 handle_bi_update(): bucket=:abort-at-block-writes[be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.23]): potential dests added=[] removed=[] 2024-06-04T16:12:14.431 INFO:tasks.workunit.client.0.smithi144.stderr: -1> 2024-06-04T16:12:14.305+0000 7f6cbcd3f800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-4027-g65533a90/rpm/el9/BUILD/ceph-19.0.0-4027-g65533a90/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f6cbcd3f800 time 2024-06-04T16:12:14.305342+0000 2024-06-04T16:12:14.431 INFO:tasks.workunit.client.0.smithi144.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-4027-g65533a90/rpm/el9/BUILD/ceph-19.0.0-4027-g65533a90/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-06-04T16:12:14.432 INFO:tasks.workunit.client.0.smithi144.stderr: 2024-06-04T16:12:14.432 INFO:tasks.workunit.client.0.smithi144.stderr: ceph version 19.0.0-4027-g65533a90 (65533a907fc9add1863609703fdbbea67993c8ef) squid (dev) 2024-06-04T16:12:14.432 INFO:tasks.workunit.client.0.smithi144.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f6cbe381dce] 2024-06-04T16:12:14.432 INFO:tasks.workunit.client.0.smithi144.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x181f8c) [0x7f6cbe381f8c] 2024-06-04T16:12:14.432 INFO:tasks.workunit.client.0.smithi144.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x564234414fb1] 2024-06-04T16:12:14.432 INFO:tasks.workunit.client.0.smithi144.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x2bf) [0x56423442032f] 2024-06-04T16:12:14.432 INFO:tasks.workunit.client.0.smithi144.stderr: 5: main() 2024-06-04T16:12:14.432 INFO:tasks.workunit.client.0.smithi144.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7f6cbd229590] 2024-06-04T16:12:14.432 INFO:tasks.workunit.client.0.smithi144.stderr: 7: __libc_start_main() 2024-06-04T16:12:14.432 INFO:tasks.workunit.client.0.smithi144.stderr: 8: _start() 2024-06-04T16:12:14.432 INFO:tasks.workunit.client.0.smithi144.stderr: 2024-06-04T16:12:14.432 INFO:tasks.workunit.client.0.smithi144.stderr: 0> 2024-06-04T16:12:14.305+0000 7f6cbcd3f800 -1 *** Caught signal (Aborted) ** 2024-06-04T16:12:14.432 INFO:tasks.workunit.client.0.smithi144.stderr: in thread 7f6cbcd3f800 thread_name:radosgw-admin 2024-06-04T16:12:14.432 INFO:tasks.workunit.client.0.smithi144.stderr: 2024-06-04T16:12:14.433 INFO:tasks.workunit.client.0.smithi144.stderr: ceph version 19.0.0-4027-g65533a90 (65533a907fc9add1863609703fdbbea67993c8ef) squid (dev) 2024-06-04T16:12:14.433 INFO:tasks.workunit.client.0.smithi144.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f6cbd23e6f0] 2024-06-04T16:12:14.433 INFO:tasks.workunit.client.0.smithi144.stderr: 2: /lib64/libc.so.6(+0x8b94c) [0x7f6cbd28b94c] 2024-06-04T16:12:14.433 INFO:tasks.workunit.client.0.smithi144.stderr: 3: raise() 2024-06-04T16:12:14.433 INFO:tasks.workunit.client.0.smithi144.stderr: 4: abort() 2024-06-04T16:12:14.433 INFO:tasks.workunit.client.0.smithi144.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f6cbe381e28] 2024-06-04T16:12:14.433 INFO:tasks.workunit.client.0.smithi144.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x181f8c) [0x7f6cbe381f8c] 2024-06-04T16:12:14.433 INFO:tasks.workunit.client.0.smithi144.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x564234414fb1] 2024-06-04T16:12:14.433 INFO:tasks.workunit.client.0.smithi144.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x2bf) [0x56423442032f] 2024-06-04T16:12:14.433 INFO:tasks.workunit.client.0.smithi144.stderr: 9: main() 2024-06-04T16:12:14.433 INFO:tasks.workunit.client.0.smithi144.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7f6cbd229590] 2024-06-04T16:12:14.433 INFO:tasks.workunit.client.0.smithi144.stderr: 11: __libc_start_main() 2024-06-04T16:12:14.433 INFO:tasks.workunit.client.0.smithi144.stderr: 12: _start() 2024-06-04T16:12:14.434 INFO:tasks.workunit.client.0.smithi144.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-06-04T16:12:14.434 INFO:tasks.workunit.client.0.smithi144.stderr: 2024-06-04T16:12:14.434 INFO:tasks.workunit.client.0.smithi144.stderr:--- logging levels --- 2024-06-04T16:12:14.434 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 5 none 2024-06-04T16:12:14.434 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 1 lockdep 2024-06-04T16:12:14.434 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 1 context 2024-06-04T16:12:14.434 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 1 crush 2024-06-04T16:12:14.434 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 5 mds 2024-06-04T16:12:14.434 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 5 mds_balancer 2024-06-04T16:12:14.434 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 5 mds_locker 2024-06-04T16:12:14.434 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 5 mds_log 2024-06-04T16:12:14.434 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 5 mds_log_expire 2024-06-04T16:12:14.434 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 5 mds_migrator 2024-06-04T16:12:14.435 INFO:tasks.workunit.client.0.smithi144.stderr: 3/ 5 mds_quiesce 2024-06-04T16:12:14.435 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 1 buffer 2024-06-04T16:12:14.435 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 1 timer 2024-06-04T16:12:14.435 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 1 filer 2024-06-04T16:12:14.435 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 1 striper 2024-06-04T16:12:14.435 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 1 objecter 2024-06-04T16:12:14.435 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 5 rados 2024-06-04T16:12:14.435 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 5 rbd 2024-06-04T16:12:14.435 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 5 rbd_mirror 2024-06-04T16:12:14.435 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 5 rbd_replay 2024-06-04T16:12:14.435 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 5 rbd_pwl 2024-06-04T16:12:14.435 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 5 journaler 2024-06-04T16:12:14.435 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 5 objectcacher 2024-06-04T16:12:14.435 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 5 immutable_obj_cache 2024-06-04T16:12:14.436 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 5 client 2024-06-04T16:12:14.436 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 5 osd 2024-06-04T16:12:14.436 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 5 optracker 2024-06-04T16:12:14.436 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 5 objclass 2024-06-04T16:12:14.436 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 3 filestore 2024-06-04T16:12:14.436 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 3 journal 2024-06-04T16:12:14.436 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 0 ms 2024-06-04T16:12:14.436 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 5 mon 2024-06-04T16:12:14.436 INFO:tasks.workunit.client.0.smithi144.stderr: 0/10 monc 2024-06-04T16:12:14.436 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 5 paxos 2024-06-04T16:12:14.436 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 5 tp 2024-06-04T16:12:14.436 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 5 auth 2024-06-04T16:12:14.436 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 5 crypto 2024-06-04T16:12:14.436 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 1 finisher 2024-06-04T16:12:14.437 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 1 reserver 2024-06-04T16:12:14.437 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 5 heartbeatmap 2024-06-04T16:12:14.437 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 5 perfcounter 2024-06-04T16:12:14.437 INFO:tasks.workunit.client.0.smithi144.stderr: 20/20 rgw 2024-06-04T16:12:14.437 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 5 rgw_sync 2024-06-04T16:12:14.437 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 5 rgw_datacache 2024-06-04T16:12:14.437 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 5 rgw_access 2024-06-04T16:12:14.437 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 5 rgw_dbstore 2024-06-04T16:12:14.437 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 5 rgw_flight 2024-06-04T16:12:14.437 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 5 rgw_lifecycle 2024-06-04T16:12:14.437 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 5 rgw_notification 2024-06-04T16:12:14.437 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 5 javaclient 2024-06-04T16:12:14.437 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 5 asok 2024-06-04T16:12:14.437 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 1 throttle 2024-06-04T16:12:14.438 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 0 refs 2024-06-04T16:12:14.438 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 5 compressor 2024-06-04T16:12:14.438 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 5 bluestore 2024-06-04T16:12:14.438 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 5 bluefs 2024-06-04T16:12:14.438 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 3 bdev 2024-06-04T16:12:14.438 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 5 kstore 2024-06-04T16:12:14.438 INFO:tasks.workunit.client.0.smithi144.stderr: 4/ 5 rocksdb 2024-06-04T16:12:14.438 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 5 fuse 2024-06-04T16:12:14.438 INFO:tasks.workunit.client.0.smithi144.stderr: 2/ 5 mgr 2024-06-04T16:12:14.438 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 5 mgrc 2024-06-04T16:12:14.438 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 5 dpdk 2024-06-04T16:12:14.438 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 5 eventtrace 2024-06-04T16:12:14.438 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 5 prioritycache 2024-06-04T16:12:14.439 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 5 test 2024-06-04T16:12:14.439 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 5 cephfs_mirror 2024-06-04T16:12:14.439 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 5 cephsqlite 2024-06-04T16:12:14.439 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 5 crimson_interrupt 2024-06-04T16:12:14.439 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 5 seastore 2024-06-04T16:12:14.439 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 5 seastore_onode 2024-06-04T16:12:14.439 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 5 seastore_odata 2024-06-04T16:12:14.439 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 5 seastore_omap 2024-06-04T16:12:14.439 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 5 seastore_tm 2024-06-04T16:12:14.439 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 5 seastore_t 2024-06-04T16:12:14.439 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 5 seastore_cleaner 2024-06-04T16:12:14.439 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 5 seastore_epm 2024-06-04T16:12:14.439 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 5 seastore_lba 2024-06-04T16:12:14.439 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 5 seastore_fixedkv_tree 2024-06-04T16:12:14.440 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 5 seastore_cache 2024-06-04T16:12:14.440 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 5 seastore_journal 2024-06-04T16:12:14.440 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 5 seastore_device 2024-06-04T16:12:14.440 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 5 seastore_backref 2024-06-04T16:12:14.440 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 5 alienstore 2024-06-04T16:12:14.440 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 5 mclock 2024-06-04T16:12:14.440 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 5 cyanstore 2024-06-04T16:12:14.440 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 5 ceph_exporter 2024-06-04T16:12:14.440 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 5 memstore 2024-06-04T16:12:14.440 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 5 trace 2024-06-04T16:12:14.440 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 5 ceph_dedup 2024-06-04T16:12:14.440 INFO:tasks.workunit.client.0.smithi144.stderr: -2/-2 (syslog threshold) 2024-06-04T16:12:14.440 INFO:tasks.workunit.client.0.smithi144.stderr: 99/99 (stderr threshold) 2024-06-04T16:12:14.440 INFO:tasks.workunit.client.0.smithi144.stderr:--- pthread ID / name mapping for recent threads --- 2024-06-04T16:12:14.441 INFO:tasks.workunit.client.0.smithi144.stderr: 7f6adf7fe640 / http_manager 2024-06-04T16:12:14.441 INFO:tasks.workunit.client.0.smithi144.stderr: 7f6b6dfe3640 / http_manager 2024-06-04T16:12:14.441 INFO:tasks.workunit.client.0.smithi144.stderr: 7f6b6efe5640 / rgw_dt_lg_renew 2024-06-04T16:12:14.441 INFO:tasks.workunit.client.0.smithi144.stderr: 7f6b8e7fc640 / ms_dispatch 2024-06-04T16:12:14.441 INFO:tasks.workunit.client.0.smithi144.stderr: 7f6b8f7fe640 / io_context_pool 2024-06-04T16:12:14.441 INFO:tasks.workunit.client.0.smithi144.stderr: 7f6b8ffff640 / io_context_pool 2024-06-04T16:12:14.441 INFO:tasks.workunit.client.0.smithi144.stderr: 7f6b9e7fc640 / ms_dispatch 2024-06-04T16:12:14.441 INFO:tasks.workunit.client.0.smithi144.stderr: 7f6ba5602640 / ms_dispatch 2024-06-04T16:12:14.441 INFO:tasks.workunit.client.0.smithi144.stderr: 7f6ba6e05640 / io_context_pool 2024-06-04T16:12:14.441 INFO:tasks.workunit.client.0.smithi144.stderr: 7f6cb3fff640 / msgr-worker-2 2024-06-04T16:12:14.441 INFO:tasks.workunit.client.0.smithi144.stderr: 7f6cb8a91640 / msgr-worker-1 2024-06-04T16:12:14.441 INFO:tasks.workunit.client.0.smithi144.stderr: 7f6cb9292640 / msgr-worker-0 2024-06-04T16:12:14.441 INFO:tasks.workunit.client.0.smithi144.stderr: 7f6cb9a93640 / io_context_pool 2024-06-04T16:12:14.441 INFO:tasks.workunit.client.0.smithi144.stderr: 7f6cbcd3f800 / radosgw-admin 2024-06-04T16:12:14.442 INFO:tasks.workunit.client.0.smithi144.stderr: max_recent 500 2024-06-04T16:12:14.442 INFO:tasks.workunit.client.0.smithi144.stderr: max_new 1000 2024-06-04T16:12:14.442 INFO:tasks.workunit.client.0.smithi144.stderr: log_file /var/lib/ceph/crash/2024-06-04T16:12:14.306720Z_1dc69c50-4d1a-44da-933a-317d95a6c7c0/log 2024-06-04T16:12:14.442 INFO:tasks.workunit.client.0.smithi144.stderr:--- end dump of recent events --- 2024-06-04T16:12:14.442 INFO:tasks.workunit.client.0.smithi144.stderr:radosgw-admin bucket stats --bucket abort-at-block-writes 2024-06-04T16:12:14.443 INFO:tasks.workunit.client.0.smithi144.stderr:ignoring --setuser ceph since I am not root 2024-06-04T16:12:14.444 INFO:tasks.workunit.client.0.smithi144.stderr:ignoring --setgroup ceph since I am not root 2024-06-04T16:12:14.444 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:14.379+0000 7fa18a92c800 20 rados->read ofs=0 len=0 2024-06-04T16:12:14.444 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:14.381+0000 7fa18a92c800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:12:14.444 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:14.381+0000 7fa18a92c800 20 realm 2024-06-04T16:12:14.444 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:14.381+0000 7fa18a92c800 20 rados->read ofs=0 len=0 2024-06-04T16:12:14.444 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:14.381+0000 7fa18a92c800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:12:14.444 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:14.381+0000 7fa18a92c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-06-04T16:12:14.444 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:14.381+0000 7fa18a92c800 20 rados->read ofs=0 len=0 2024-06-04T16:12:14.444 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:14.381+0000 7fa18a92c800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:12:14.444 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:14.381+0000 7fa18a92c800 20 rados->read ofs=0 len=0 2024-06-04T16:12:14.444 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:14.382+0000 7fa18a92c800 20 rados_obj.operate() r=0 bl.length=46 2024-06-04T16:12:14.444 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:14.382+0000 7fa18a92c800 20 rados->read ofs=0 len=0 2024-06-04T16:12:14.444 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:14.383+0000 7fa18a92c800 20 rados_obj.operate() r=0 bl.length=1139 2024-06-04T16:12:14.445 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:14.383+0000 7fa18a92c800 20 searching for the correct realm 2024-06-04T16:12:14.445 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:14.383+0000 7fa1865e8640 0 -- 172.21.15.144:0/2321700416 >> [v2:172.21.15.177:6816/2039473917,v1:172.21.15.177:6817/2039473917] conn(0x55d26a0cdf10 msgr2=0x55d26a0d03b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-06-04T16:12:14.588 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:14.587+0000 7fa1865e8640 0 -- 172.21.15.144:0/2321700416 >> [v2:172.21.15.177:6800/3891611393,v1:172.21.15.177:6801/3891611393] conn(0x7fa178068fe0 msgr2=0x7fa178069990 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-06-04T16:12:14.595 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:14.594+0000 7fa18a92c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-06-04T16:12:14.595 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:14.594+0000 7fa18a92c800 20 RGWRados::pool_iterate: got zone_info.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767 2024-06-04T16:12:14.596 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:14.594+0000 7fa18a92c800 20 RGWRados::pool_iterate: got default.zone. 2024-06-04T16:12:14.596 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:14.594+0000 7fa18a92c800 20 RGWRados::pool_iterate: got zonegroup_info.abb22408-c332-4e28-8f7a-ff254ea2fed2 2024-06-04T16:12:14.596 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:14.594+0000 7fa18a92c800 20 RGWRados::pool_iterate: got zone_names.default 2024-06-04T16:12:14.596 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:14.594+0000 7fa18a92c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-06-04T16:12:14.596 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:14.594+0000 7fa18a92c800 20 rados->read ofs=0 len=0 2024-06-04T16:12:14.596 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:14.595+0000 7fa18a92c800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:12:14.596 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:14.595+0000 7fa18a92c800 20 rados->read ofs=0 len=0 2024-06-04T16:12:14.596 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:14.595+0000 7fa18a92c800 20 rados_obj.operate() r=0 bl.length=46 2024-06-04T16:12:14.596 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:14.595+0000 7fa18a92c800 20 rados->read ofs=0 len=0 2024-06-04T16:12:14.597 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:14.596+0000 7fa18a92c800 20 rados_obj.operate() r=0 bl.length=470 2024-06-04T16:12:14.597 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:14.596+0000 7fa18a92c800 20 zone default found 2024-06-04T16:12:14.597 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:14.596+0000 7fa18a92c800 4 Realm: () 2024-06-04T16:12:14.597 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:14.596+0000 7fa18a92c800 4 ZoneGroup: default (abb22408-c332-4e28-8f7a-ff254ea2fed2) 2024-06-04T16:12:14.598 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:14.596+0000 7fa18a92c800 4 Zone: default (be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767) 2024-06-04T16:12:14.598 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:14.596+0000 7fa18a92c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-06-04T16:12:14.598 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:14.596+0000 7fa18a92c800 20 zonegroup default 2024-06-04T16:12:14.598 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:14.596+0000 7fa18a92c800 20 rados->read ofs=0 len=0 2024-06-04T16:12:14.598 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:14.596+0000 7fa18a92c800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:12:14.598 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:14.596+0000 7fa18a92c800 20 rados->read ofs=0 len=0 2024-06-04T16:12:14.598 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:14.596+0000 7fa18a92c800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:12:14.598 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:14.596+0000 7fa18a92c800 20 rados->read ofs=0 len=0 2024-06-04T16:12:14.598 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:14.596+0000 7fa18a92c800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:12:14.598 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:14.596+0000 7fa18a92c800 20 started sync module instance, tier type = 2024-06-04T16:12:14.598 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:14.596+0000 7fa18a92c800 20 started zone id=be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767 (name=default) with tier type = 2024-06-04T16:12:14.606 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:14.605+0000 7fa18a92c800 20 add_watcher() i=0 2024-06-04T16:12:14.606 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:14.605+0000 7fa18a92c800 20 add_watcher() i=1 2024-06-04T16:12:14.606 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:14.605+0000 7fa18a92c800 20 add_watcher() i=2 2024-06-04T16:12:14.606 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:14.605+0000 7fa18a92c800 20 add_watcher() i=3 2024-06-04T16:12:14.606 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:14.605+0000 7fa18a92c800 20 add_watcher() i=4 2024-06-04T16:12:14.606 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:14.605+0000 7fa18a92c800 20 add_watcher() i=5 2024-06-04T16:12:14.606 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:14.605+0000 7fa18a92c800 20 add_watcher() i=6 2024-06-04T16:12:14.607 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:14.606+0000 7fa18a92c800 20 add_watcher() i=7 2024-06-04T16:12:14.607 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:14.606+0000 7fa18a92c800 2 all 8 watchers are set, enabling cache 2024-06-04T16:12:14.608 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:14.608+0000 7fa03cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-06-04T16:12:14.609 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:14.608+0000 7fa18a92c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-06-04T16:12:14.609 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:14.608+0000 7fa18a92c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-06-04T16:12:14.609 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:14.608+0000 7fa18a92c800 5 note: GC not initialized 2024-06-04T16:12:14.609 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:14.608+0000 7f9fb77fe640 20 reqs_thread_entry: start 2024-06-04T16:12:14.609 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:14.608+0000 7fa18a92c800 20 init_complete bucket index max shards: 11 2024-06-04T16:12:14.610 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:14.608+0000 7fa18a92c800 20 Filter name: none 2024-06-04T16:12:14.610 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:14.608+0000 7f9fb57fa640 20 reqs_thread_entry: start 2024-06-04T16:12:14.610 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:14.608+0000 7fa18a92c800 20 rados->read ofs=0 len=0 2024-06-04T16:12:14.611 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:14.609+0000 7fa18a92c800 20 rados_obj.operate() r=0 bl.length=189 2024-06-04T16:12:14.611 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:14.609+0000 7fa18a92c800 20 rados->read ofs=0 len=0 2024-06-04T16:12:14.611 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:14.609+0000 7fa18a92c800 20 rados_obj.operate() r=0 bl.length=435 2024-06-04T16:12:14.611 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:14.609+0000 7fa18a92c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-06-04T16:12:14.611 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:14.609+0000 7fa18a92c800 20 rados->read ofs=0 len=0 2024-06-04T16:12:14.611 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:14.610+0000 7fa18a92c800 20 rados_obj.operate() r=0 bl.length=189 2024-06-04T16:12:14.611 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:14.610+0000 7fa18a92c800 20 rados->read ofs=0 len=0 2024-06-04T16:12:14.612 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:14.610+0000 7fa18a92c800 20 rados_obj.operate() r=0 bl.length=435 2024-06-04T16:12:14.612 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:14.610+0000 7fa18a92c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-06-04T16:12:14.612 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:14.612+0000 7fa03cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-06-04T16:12:14.615 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:14.614+0000 7fa18a92c800 20 remove_watcher() i=0 2024-06-04T16:12:14.615 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:14.614+0000 7fa18a92c800 2 removed watcher, disabling cache 2024-06-04T16:12:14.616 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:14.615+0000 7fa18a92c800 20 remove_watcher() i=1 2024-06-04T16:12:14.617 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:14.616+0000 7fa18a92c800 20 remove_watcher() i=2 2024-06-04T16:12:14.618 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:14.617+0000 7fa18a92c800 20 remove_watcher() i=3 2024-06-04T16:12:14.618 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:14.618+0000 7fa18a92c800 20 remove_watcher() i=4 2024-06-04T16:12:14.619 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:14.619+0000 7fa18a92c800 20 remove_watcher() i=5 2024-06-04T16:12:14.620 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:14.620+0000 7fa18a92c800 20 remove_watcher() i=6 2024-06-04T16:12:14.621 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:14.621+0000 7fa18a92c800 20 remove_watcher() i=7 2024-06-04T16:12:14.633 INFO:tasks.workunit.client.0.smithi144.stderr: 2024-06-04T16:12:14.633 INFO:tasks.workunit.client.0.smithi144.stderr:BUCKET_STATS: 2024-06-04T16:12:14.633 INFO:tasks.workunit.client.0.smithi144.stderr:bucket: abort-at-block-writes id: be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.23 num_objects: 20 size_kb: 1 num_shards: 11 2024-06-04T16:12:14.633 INFO:tasks.workunit.client.0.smithi144.stderr: 2024-06-04T16:12:14.635 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:12:14.635 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:12:14.641 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:12:14.641 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:12:14.683 INFO:tasks.workunit.client.0.smithi144.stderr:radosgw-admin bucket reshard --bucket abort-at-block-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-06-04T16:12:14.716 INFO:tasks.workunit.client.0.smithi144.stderr:ignoring --setuser ceph since I am not root 2024-06-04T16:12:14.716 INFO:tasks.workunit.client.0.smithi144.stderr:ignoring --setgroup ceph since I am not root 2024-06-04T16:12:14.753 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:14.752+0000 7fe47f30c800 20 rados->read ofs=0 len=0 2024-06-04T16:12:14.755 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:14.754+0000 7fe47f30c800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:12:14.755 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:14.754+0000 7fe47f30c800 20 realm 2024-06-04T16:12:14.755 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:14.754+0000 7fe47f30c800 20 rados->read ofs=0 len=0 2024-06-04T16:12:14.755 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:14.754+0000 7fe47f30c800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:12:14.755 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:14.754+0000 7fe47f30c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-06-04T16:12:14.755 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:14.754+0000 7fe47f30c800 20 rados->read ofs=0 len=0 2024-06-04T16:12:14.756 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:14.754+0000 7fe47f30c800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:12:14.756 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:14.754+0000 7fe47f30c800 20 rados->read ofs=0 len=0 2024-06-04T16:12:14.756 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:14.755+0000 7fe47f30c800 20 rados_obj.operate() r=0 bl.length=46 2024-06-04T16:12:14.756 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:14.755+0000 7fe47f30c800 20 rados->read ofs=0 len=0 2024-06-04T16:12:14.756 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:14.756+0000 7fe47f30c800 20 rados_obj.operate() r=0 bl.length=1139 2024-06-04T16:12:14.757 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:14.756+0000 7fe47f30c800 20 searching for the correct realm 2024-06-04T16:12:14.758 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:14.757+0000 7fe477fff640 0 -- 172.21.15.144:0/2318439777 >> [v2:172.21.15.144:6816/2358575268,v1:172.21.15.144:6817/2358575268] conn(0x55a74ad30fe0 msgr2=0x55a74ad33430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-06-04T16:12:14.761 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:14.761+0000 7fe477fff640 0 -- 172.21.15.144:0/2318439777 >> [v2:172.21.15.177:6808/2618477608,v1:172.21.15.177:6809/2618477608] conn(0x7fe468018070 msgr2=0x7fe468068a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-06-04T16:12:14.969 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:14.967+0000 7fe47f30c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-06-04T16:12:14.969 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:14.967+0000 7fe47f30c800 20 RGWRados::pool_iterate: got zone_info.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767 2024-06-04T16:12:14.969 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:14.967+0000 7fe47f30c800 20 RGWRados::pool_iterate: got default.zone. 2024-06-04T16:12:14.969 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:14.967+0000 7fe47f30c800 20 RGWRados::pool_iterate: got zonegroup_info.abb22408-c332-4e28-8f7a-ff254ea2fed2 2024-06-04T16:12:14.969 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:14.967+0000 7fe47f30c800 20 RGWRados::pool_iterate: got zone_names.default 2024-06-04T16:12:14.969 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:14.967+0000 7fe47f30c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-06-04T16:12:14.969 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:14.967+0000 7fe47f30c800 20 rados->read ofs=0 len=0 2024-06-04T16:12:14.969 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:14.968+0000 7fe47f30c800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:12:14.969 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:14.968+0000 7fe47f30c800 20 rados->read ofs=0 len=0 2024-06-04T16:12:14.969 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:14.968+0000 7fe47f30c800 20 rados_obj.operate() r=0 bl.length=46 2024-06-04T16:12:14.969 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:14.968+0000 7fe47f30c800 20 rados->read ofs=0 len=0 2024-06-04T16:12:14.971 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:14.968+0000 7fe47f30c800 20 rados_obj.operate() r=0 bl.length=470 2024-06-04T16:12:14.971 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:14.968+0000 7fe47f30c800 20 zone default found 2024-06-04T16:12:14.971 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:14.968+0000 7fe47f30c800 4 Realm: () 2024-06-04T16:12:14.971 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:14.968+0000 7fe47f30c800 4 ZoneGroup: default (abb22408-c332-4e28-8f7a-ff254ea2fed2) 2024-06-04T16:12:14.971 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:14.968+0000 7fe47f30c800 4 Zone: default (be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767) 2024-06-04T16:12:14.971 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:14.968+0000 7fe47f30c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-06-04T16:12:14.971 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:14.968+0000 7fe47f30c800 20 zonegroup default 2024-06-04T16:12:14.971 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:14.968+0000 7fe47f30c800 20 rados->read ofs=0 len=0 2024-06-04T16:12:14.971 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:14.969+0000 7fe47f30c800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:12:14.971 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:14.969+0000 7fe47f30c800 20 rados->read ofs=0 len=0 2024-06-04T16:12:14.971 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:14.969+0000 7fe47f30c800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:12:14.971 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:14.969+0000 7fe47f30c800 20 rados->read ofs=0 len=0 2024-06-04T16:12:14.971 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:14.969+0000 7fe47f30c800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:12:14.971 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:14.969+0000 7fe47f30c800 20 started sync module instance, tier type = 2024-06-04T16:12:14.972 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:14.969+0000 7fe47f30c800 20 started zone id=be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767 (name=default) with tier type = 2024-06-04T16:12:14.979 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:14.978+0000 7fe47f30c800 20 add_watcher() i=0 2024-06-04T16:12:14.979 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:14.978+0000 7fe47f30c800 20 add_watcher() i=1 2024-06-04T16:12:14.979 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:14.978+0000 7fe47f30c800 20 add_watcher() i=2 2024-06-04T16:12:14.979 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:14.978+0000 7fe47f30c800 20 add_watcher() i=3 2024-06-04T16:12:14.979 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:14.978+0000 7fe47f30c800 20 add_watcher() i=4 2024-06-04T16:12:14.979 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:14.978+0000 7fe47f30c800 20 add_watcher() i=5 2024-06-04T16:12:14.979 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:14.978+0000 7fe47f30c800 20 add_watcher() i=6 2024-06-04T16:12:14.980 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:14.979+0000 7fe47f30c800 20 add_watcher() i=7 2024-06-04T16:12:14.980 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:14.979+0000 7fe47f30c800 2 all 8 watchers are set, enabling cache 2024-06-04T16:12:14.981 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:14.981+0000 7fe332fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-06-04T16:12:14.983 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:14.981+0000 7fe47f30c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-06-04T16:12:14.983 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:14.981+0000 7fe47f30c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-06-04T16:12:14.983 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:14.981+0000 7fe47f30c800 5 note: GC not initialized 2024-06-04T16:12:14.983 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:14.981+0000 7fe331fe3640 20 reqs_thread_entry: start 2024-06-04T16:12:14.983 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:14.981+0000 7fe47f30c800 20 init_complete bucket index max shards: 11 2024-06-04T16:12:14.983 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:14.981+0000 7fe47f30c800 20 Filter name: none 2024-06-04T16:12:14.983 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:14.982+0000 7fe2a37fe640 20 reqs_thread_entry: start 2024-06-04T16:12:14.983 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:14.982+0000 7fe47f30c800 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2024-06-04T16:12:14.984 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:14.982+0000 7fe47f30c800 20 rados->read ofs=0 len=0 2024-06-04T16:12:14.984 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:14.982+0000 7fe47f30c800 20 rados_obj.operate() r=0 bl.length=189 2024-06-04T16:12:14.984 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:14.982+0000 7fe47f30c800 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2024-06-04T16:12:14.984 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:14.982+0000 7fe47f30c800 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2024-06-04T16:12:14.984 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:14.982+0000 7fe47f30c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.23 : miss 2024-06-04T16:12:14.984 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:14.982+0000 7fe47f30c800 20 rados->read ofs=0 len=0 2024-06-04T16:12:14.984 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:14.982+0000 7fe47f30c800 20 rados_obj.operate() r=0 bl.length=435 2024-06-04T16:12:14.985 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:14.982+0000 7fe47f30c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.23 info.flags=0x17 2024-06-04T16:12:14.985 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:14.982+0000 7fe47f30c800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.23 to cache LRU end 2024-06-04T16:12:14.985 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:14.982+0000 7fe47f30c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-06-04T16:12:14.985 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:14.982+0000 7fe47f30c800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-06-04T16:12:14.985 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:14.982+0000 7fe47f30c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.23 2024-06-04T16:12:14.985 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:14.983+0000 7fe47f30c800 0 INFO: RGWReshardLock::lock found lock on abort-at-block-writes:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.23 to be held by another RGW process; skipping for now 2024-06-04T16:12:14.985 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:14.984+0000 7fe332fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-06-04T16:12:14.987 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:14.986+0000 7fe47f30c800 20 remove_watcher() i=0 2024-06-04T16:12:14.987 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:14.986+0000 7fe47f30c800 2 removed watcher, disabling cache 2024-06-04T16:12:14.988 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:14.987+0000 7fe47f30c800 20 remove_watcher() i=1 2024-06-04T16:12:14.989 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:14.988+0000 7fe47f30c800 20 remove_watcher() i=2 2024-06-04T16:12:14.990 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:14.989+0000 7fe47f30c800 20 remove_watcher() i=3 2024-06-04T16:12:14.991 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:14.990+0000 7fe47f30c800 20 remove_watcher() i=4 2024-06-04T16:12:14.992 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:14.991+0000 7fe47f30c800 20 remove_watcher() i=5 2024-06-04T16:12:14.992 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:14.992+0000 7fe47f30c800 20 remove_watcher() i=6 2024-06-04T16:12:14.994 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:14.993+0000 7fe47f30c800 20 remove_watcher() i=7 2024-06-04T16:12:15.004 INFO:tasks.workunit.client.0.smithi144.stderr:waiting 30 seconds for reshard lock to expire... 2024-06-04T16:12:45.013 INFO:tasks.workunit.client.0.smithi144.stderr:radosgw-admin bucket reshard --bucket abort-at-block-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-06-04T16:12:45.048 INFO:tasks.workunit.client.0.smithi144.stderr:ignoring --setuser ceph since I am not root 2024-06-04T16:12:45.048 INFO:tasks.workunit.client.0.smithi144.stderr:ignoring --setgroup ceph since I am not root 2024-06-04T16:12:45.091 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:45.089+0000 7f51cb213800 20 rados->read ofs=0 len=0 2024-06-04T16:12:45.093 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:45.091+0000 7f51cb213800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:12:45.093 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:45.091+0000 7f51cb213800 20 realm 2024-06-04T16:12:45.093 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:45.091+0000 7f51cb213800 20 rados->read ofs=0 len=0 2024-06-04T16:12:45.093 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:45.091+0000 7f51cb213800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:12:45.093 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:45.091+0000 7f51cb213800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-06-04T16:12:45.093 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:45.091+0000 7f51cb213800 20 rados->read ofs=0 len=0 2024-06-04T16:12:45.093 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:45.091+0000 7f51cb213800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:12:45.093 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:45.091+0000 7f51cb213800 20 rados->read ofs=0 len=0 2024-06-04T16:12:45.094 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:45.092+0000 7f51cb213800 20 rados_obj.operate() r=0 bl.length=46 2024-06-04T16:12:45.094 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:45.092+0000 7f51cb213800 20 rados->read ofs=0 len=0 2024-06-04T16:12:45.094 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:45.093+0000 7f51cb213800 20 rados_obj.operate() r=0 bl.length=1139 2024-06-04T16:12:45.095 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:45.093+0000 7f51cb213800 20 searching for the correct realm 2024-06-04T16:12:45.298 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:45.296+0000 7f51c6063640 0 -- 172.21.15.144:0/3210478628 >> [v2:172.21.15.144:6808/86532035,v1:172.21.15.144:6809/86532035] conn(0x7f51b801d040 msgr2=0x7f51b8038910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-06-04T16:12:45.302 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:45.300+0000 7f51c6063640 0 -- 172.21.15.144:0/3210478628 >> [v2:172.21.15.144:6816/2358575268,v1:172.21.15.144:6817/2358575268] conn(0x55f5cfbde200 msgr2=0x55f5cfbe0610 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-06-04T16:12:45.309 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:45.307+0000 7f51cb213800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-06-04T16:12:45.309 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:45.307+0000 7f51cb213800 20 RGWRados::pool_iterate: got zone_info.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767 2024-06-04T16:12:45.309 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:45.307+0000 7f51cb213800 20 RGWRados::pool_iterate: got default.zone. 2024-06-04T16:12:45.309 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:45.307+0000 7f51cb213800 20 RGWRados::pool_iterate: got zonegroup_info.abb22408-c332-4e28-8f7a-ff254ea2fed2 2024-06-04T16:12:45.309 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:45.307+0000 7f51cb213800 20 RGWRados::pool_iterate: got zone_names.default 2024-06-04T16:12:45.309 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:45.307+0000 7f51cb213800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-06-04T16:12:45.309 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:45.307+0000 7f51cb213800 20 rados->read ofs=0 len=0 2024-06-04T16:12:45.311 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:45.307+0000 7f51cb213800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:12:45.311 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:45.307+0000 7f51cb213800 20 rados->read ofs=0 len=0 2024-06-04T16:12:45.311 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:45.308+0000 7f51cb213800 20 rados_obj.operate() r=0 bl.length=46 2024-06-04T16:12:45.311 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:45.308+0000 7f51cb213800 20 rados->read ofs=0 len=0 2024-06-04T16:12:45.311 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:45.308+0000 7f51cb213800 20 rados_obj.operate() r=0 bl.length=470 2024-06-04T16:12:45.311 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:45.308+0000 7f51cb213800 20 zone default found 2024-06-04T16:12:45.311 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:45.308+0000 7f51cb213800 4 Realm: () 2024-06-04T16:12:45.311 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:45.308+0000 7f51cb213800 4 ZoneGroup: default (abb22408-c332-4e28-8f7a-ff254ea2fed2) 2024-06-04T16:12:45.312 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:45.308+0000 7f51cb213800 4 Zone: default (be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767) 2024-06-04T16:12:45.312 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:45.308+0000 7f51cb213800 10 cannot find current period zonegroup using local zonegroup configuration 2024-06-04T16:12:45.312 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:45.308+0000 7f51cb213800 20 zonegroup default 2024-06-04T16:12:45.312 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:45.308+0000 7f51cb213800 20 rados->read ofs=0 len=0 2024-06-04T16:12:45.312 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:45.309+0000 7f51cb213800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:12:45.312 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:45.309+0000 7f51cb213800 20 rados->read ofs=0 len=0 2024-06-04T16:12:45.312 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:45.309+0000 7f51cb213800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:12:45.312 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:45.309+0000 7f51cb213800 20 rados->read ofs=0 len=0 2024-06-04T16:12:45.313 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:45.309+0000 7f51cb213800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:12:45.313 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:45.309+0000 7f51cb213800 20 started sync module instance, tier type = 2024-06-04T16:12:45.313 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:45.309+0000 7f51cb213800 20 started zone id=be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767 (name=default) with tier type = 2024-06-04T16:12:45.321 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:45.320+0000 7f51cb213800 20 add_watcher() i=0 2024-06-04T16:12:45.322 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:45.320+0000 7f51cb213800 20 add_watcher() i=1 2024-06-04T16:12:45.322 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:45.320+0000 7f51cb213800 20 add_watcher() i=2 2024-06-04T16:12:45.322 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:45.320+0000 7f51cb213800 20 add_watcher() i=3 2024-06-04T16:12:45.322 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:45.320+0000 7f51cb213800 20 add_watcher() i=4 2024-06-04T16:12:45.322 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:45.320+0000 7f51cb213800 20 add_watcher() i=5 2024-06-04T16:12:45.322 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:45.320+0000 7f51cb213800 20 add_watcher() i=6 2024-06-04T16:12:45.323 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:45.321+0000 7f51cb213800 20 add_watcher() i=7 2024-06-04T16:12:45.323 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:45.321+0000 7f51cb213800 2 all 8 watchers are set, enabling cache 2024-06-04T16:12:45.324 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:45.323+0000 7f507d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-06-04T16:12:45.326 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:45.323+0000 7f51cb213800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-06-04T16:12:45.326 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:45.323+0000 7f51cb213800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-06-04T16:12:45.326 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:45.323+0000 7f51cb213800 5 note: GC not initialized 2024-06-04T16:12:45.326 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:45.323+0000 7f4ff7fff640 20 reqs_thread_entry: start 2024-06-04T16:12:45.326 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:45.324+0000 7f51cb213800 20 init_complete bucket index max shards: 11 2024-06-04T16:12:45.326 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:45.324+0000 7f51cb213800 20 Filter name: none 2024-06-04T16:12:45.326 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:45.324+0000 7f4ff5ffb640 20 reqs_thread_entry: start 2024-06-04T16:12:45.326 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:45.324+0000 7f51cb213800 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2024-06-04T16:12:45.326 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:45.324+0000 7f51cb213800 20 rados->read ofs=0 len=0 2024-06-04T16:12:45.327 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:45.324+0000 7f51cb213800 20 rados_obj.operate() r=0 bl.length=189 2024-06-04T16:12:45.327 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:45.324+0000 7f51cb213800 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2024-06-04T16:12:45.327 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:45.324+0000 7f51cb213800 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2024-06-04T16:12:45.327 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:45.324+0000 7f51cb213800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.23 : miss 2024-06-04T16:12:45.328 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:45.324+0000 7f51cb213800 20 rados->read ofs=0 len=0 2024-06-04T16:12:45.328 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:45.325+0000 7f51cb213800 20 rados_obj.operate() r=0 bl.length=435 2024-06-04T16:12:45.328 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:45.325+0000 7f51cb213800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.23 info.flags=0x17 2024-06-04T16:12:45.328 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:45.325+0000 7f51cb213800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.23 to cache LRU end 2024-06-04T16:12:45.328 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:45.325+0000 7f51cb213800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-06-04T16:12:45.328 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:45.325+0000 7f51cb213800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-06-04T16:12:45.328 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:45.325+0000 7f51cb213800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.23 2024-06-04T16:12:45.328 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:45.326+0000 7f51cb213800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-06-04T16:12:45.337 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:45.335+0000 7f51cb213800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.23 info.flags=0x17 2024-06-04T16:12:45.337 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:45.335+0000 7f51cb213800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.23 to cache LRU end 2024-06-04T16:12:45.337 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:45.335+0000 7f51cb213800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-06-04T16:12:45.337 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:45.335+0000 7f51cb213800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.23, ofs0, ns] 2024-06-04T16:12:45.338 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:45.335+0000 7f50a9ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1078036791404 cookie 94514240723680 notifier 6209 bl.length()=907 2024-06-04T16:12:45.338 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:45.335+0000 7f50a9ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.23 info.flags=0x17 2024-06-04T16:12:45.338 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:45.335+0000 7f50a9ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.23 to cache LRU end 2024-06-04T16:12:45.338 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:45.335+0000 7f50a9ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-06-04T16:12:45.338 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:45.336+0000 7f51cb213800 20 handle_bi_update(): bucket=:abort-at-block-writes[be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.23]): orig_sources= new_sources= 2024-06-04T16:12:45.338 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:45.336+0000 7f51cb213800 20 handle_bi_update(): bucket=:abort-at-block-writes[be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.23]): potential sources added=[] removed=[] 2024-06-04T16:12:45.338 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:45.336+0000 7f51cb213800 20 handle_bi_update(): bucket=:abort-at-block-writes[be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.23]): orig_dests= new_dests= 2024-06-04T16:12:45.338 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:45.336+0000 7f51cb213800 20 handle_bi_update(): bucket=:abort-at-block-writes[be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.23]): potential dests added=[] removed=[] 2024-06-04T16:12:45.340 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:45.338+0000 7f51cb213800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.23.2.0 2024-06-04T16:12:45.340 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:45.338+0000 7f51cb213800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.23.2.0 2024-06-04T16:12:45.340 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:45.338+0000 7f51cb213800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.23.2.1 2024-06-04T16:12:45.341 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:45.338+0000 7f51cb213800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.23.2.1 2024-06-04T16:12:45.341 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:45.338+0000 7f51cb213800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.23.2.2 2024-06-04T16:12:45.341 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:45.338+0000 7f51cb213800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.23.2.2 2024-06-04T16:12:45.341 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:45.338+0000 7f51cb213800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.23.2.3 2024-06-04T16:12:45.341 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:45.338+0000 7f51cb213800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.23.2.3 2024-06-04T16:12:45.341 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:45.338+0000 7f51cb213800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.23.2.4 2024-06-04T16:12:45.341 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:45.338+0000 7f51cb213800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.23.2.4 2024-06-04T16:12:45.341 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:45.338+0000 7f51cb213800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.23.2.5 2024-06-04T16:12:45.341 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:45.338+0000 7f51cb213800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.23.2.5 2024-06-04T16:12:45.341 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:45.338+0000 7f51cb213800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.23.2.6 2024-06-04T16:12:45.341 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:45.338+0000 7f51cb213800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.23.2.6 2024-06-04T16:12:45.341 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:45.338+0000 7f51cb213800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.23.2.7 2024-06-04T16:12:45.341 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:45.338+0000 7f51cb213800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.23.2.7 2024-06-04T16:12:45.341 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:45.338+0000 7f51cb213800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.23.2.8 2024-06-04T16:12:45.342 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:45.338+0000 7f51cb213800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.23.2.8 2024-06-04T16:12:45.342 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:45.338+0000 7f51cb213800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.23.2.9 2024-06-04T16:12:45.342 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:45.338+0000 7f51cb213800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.23.2.9 2024-06-04T16:12:45.342 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:45.338+0000 7f51cb213800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.23.2.10 2024-06-04T16:12:45.342 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:45.338+0000 7f51cb213800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.23.2.10 2024-06-04T16:12:45.342 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:45.338+0000 7f51cb213800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.23.2.11 2024-06-04T16:12:45.342 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:45.338+0000 7f51cb213800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.23.2.11 2024-06-04T16:12:45.342 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:45.338+0000 7f51cb213800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.23.0 2024-06-04T16:12:45.343 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:45.339+0000 7f51cb213800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.23.1 2024-06-04T16:12:45.343 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:45.340+0000 7f51cb213800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.23.2 2024-06-04T16:12:45.343 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:45.340+0000 7f51cb213800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.23.3 2024-06-04T16:12:45.343 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:45.341+0000 7f51cb213800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.23.4 2024-06-04T16:12:45.343 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:45.342+0000 7f51cb213800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.23.5 2024-06-04T16:12:45.344 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:45.342+0000 7f51cb213800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.23.6 2024-06-04T16:12:45.344 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:45.343+0000 7f51cb213800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.23.7 2024-06-04T16:12:45.345 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:45.343+0000 7f51cb213800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.23.8 2024-06-04T16:12:45.346 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:45.344+0000 7f51cb213800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.23.9 2024-06-04T16:12:45.346 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:45.345+0000 7f51cb213800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.23.10 2024-06-04T16:12:45.349 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:45.347+0000 7f51cb213800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.23 : hit (requested=0x17, cached=0x17) 2024-06-04T16:12:45.349 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:45.347+0000 7f51cb213800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.23 2024-06-04T16:12:45.350 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:45.349+0000 7f51cb213800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.23 info.flags=0x17 2024-06-04T16:12:45.350 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:45.349+0000 7f51cb213800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.23 to cache LRU end 2024-06-04T16:12:45.351 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:45.349+0000 7f51cb213800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-06-04T16:12:45.351 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:45.349+0000 7f51cb213800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.23, ofs0, ns] 2024-06-04T16:12:45.351 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:45.349+0000 7f50a9ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1078036791405 cookie 94514240723680 notifier 6209 bl.length()=875 2024-06-04T16:12:45.351 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:45.349+0000 7f50a9ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.23 info.flags=0x17 2024-06-04T16:12:45.351 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:45.349+0000 7f50a9ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.23 to cache LRU end 2024-06-04T16:12:45.351 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:45.349+0000 7f50a9ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-06-04T16:12:45.351 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:45.349+0000 7f51cb213800 20 handle_bi_update(): bucket=:abort-at-block-writes[be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.23]): orig_sources= new_sources= 2024-06-04T16:12:45.352 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:45.349+0000 7f51cb213800 20 handle_bi_update(): bucket=:abort-at-block-writes[be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.23]): potential sources added=[] removed=[] 2024-06-04T16:12:45.352 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:45.349+0000 7f51cb213800 20 handle_bi_update(): bucket=:abort-at-block-writes[be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.23]): orig_dests= new_dests= 2024-06-04T16:12:45.352 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:45.349+0000 7f51cb213800 20 handle_bi_update(): bucket=:abort-at-block-writes[be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.23]): potential dests added=[] removed=[] 2024-06-04T16:12:45.353 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:45.352+0000 7f51cb213800 1 execute INFO: reshard of bucket "abort-at-block-writes" completed successfully 2024-06-04T16:12:45.355 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:45.354+0000 7f507d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-06-04T16:12:45.357 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:45.356+0000 7f51cb213800 20 remove_watcher() i=0 2024-06-04T16:12:45.358 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:45.356+0000 7f51cb213800 2 removed watcher, disabling cache 2024-06-04T16:12:45.358 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:45.357+0000 7f51cb213800 20 remove_watcher() i=1 2024-06-04T16:12:45.360 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:45.358+0000 7f51cb213800 20 remove_watcher() i=2 2024-06-04T16:12:45.361 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:45.359+0000 7f51cb213800 20 remove_watcher() i=3 2024-06-04T16:12:45.362 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:45.360+0000 7f51cb213800 20 remove_watcher() i=4 2024-06-04T16:12:45.363 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:45.361+0000 7f51cb213800 20 remove_watcher() i=5 2024-06-04T16:12:45.364 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:45.362+0000 7f51cb213800 20 remove_watcher() i=6 2024-06-04T16:12:45.365 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:45.363+0000 7f51cb213800 20 remove_watcher() i=7 2024-06-04T16:12:45.378 INFO:tasks.workunit.client.0.smithi144.stderr:radosgw-admin bucket stats --bucket abort-at-block-writes 2024-06-04T16:12:45.407 INFO:tasks.workunit.client.0.smithi144.stderr:ignoring --setuser ceph since I am not root 2024-06-04T16:12:45.407 INFO:tasks.workunit.client.0.smithi144.stderr:ignoring --setgroup ceph since I am not root 2024-06-04T16:12:45.447 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:45.442+0000 7f310b662800 20 rados->read ofs=0 len=0 2024-06-04T16:12:45.447 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:45.444+0000 7f310b662800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:12:45.447 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:45.444+0000 7f310b662800 20 realm 2024-06-04T16:12:45.447 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:45.444+0000 7f310b662800 20 rados->read ofs=0 len=0 2024-06-04T16:12:45.447 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:45.444+0000 7f310b662800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:12:45.448 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:45.444+0000 7f310b662800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-06-04T16:12:45.448 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:45.444+0000 7f310b662800 20 rados->read ofs=0 len=0 2024-06-04T16:12:45.448 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:45.444+0000 7f310b662800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:12:45.448 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:45.444+0000 7f310b662800 20 rados->read ofs=0 len=0 2024-06-04T16:12:45.448 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:45.445+0000 7f310b662800 20 rados_obj.operate() r=0 bl.length=46 2024-06-04T16:12:45.448 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:45.445+0000 7f310b662800 20 rados->read ofs=0 len=0 2024-06-04T16:12:45.449 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:45.446+0000 7f310b662800 20 rados_obj.operate() r=0 bl.length=1139 2024-06-04T16:12:45.449 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:45.446+0000 7f310b662800 20 searching for the correct realm 2024-06-04T16:12:45.449 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:45.448+0000 7f310895d640 0 -- 172.21.15.144:0/2338932880 >> [v2:172.21.15.144:6816/2358575268,v1:172.21.15.144:6817/2358575268] conn(0x5632eacc2850 msgr2=0x5632eacc4c40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-06-04T16:12:45.452 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:45.451+0000 7f310895d640 0 -- 172.21.15.144:0/2338932880 >> [v2:172.21.15.177:6808/2618477608,v1:172.21.15.177:6809/2618477608] conn(0x7f310001ab30 msgr2=0x7f310005e5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-06-04T16:12:45.660 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:45.658+0000 7f310b662800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-06-04T16:12:45.660 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:45.658+0000 7f310b662800 20 RGWRados::pool_iterate: got zone_info.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767 2024-06-04T16:12:45.660 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:45.658+0000 7f310b662800 20 RGWRados::pool_iterate: got default.zone. 2024-06-04T16:12:45.660 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:45.658+0000 7f310b662800 20 RGWRados::pool_iterate: got zonegroup_info.abb22408-c332-4e28-8f7a-ff254ea2fed2 2024-06-04T16:12:45.660 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:45.658+0000 7f310b662800 20 RGWRados::pool_iterate: got zone_names.default 2024-06-04T16:12:45.661 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:45.658+0000 7f310b662800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-06-04T16:12:45.661 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:45.658+0000 7f310b662800 20 rados->read ofs=0 len=0 2024-06-04T16:12:45.661 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:45.658+0000 7f310b662800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:12:45.661 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:45.658+0000 7f310b662800 20 rados->read ofs=0 len=0 2024-06-04T16:12:45.661 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:45.658+0000 7f310b662800 20 rados_obj.operate() r=0 bl.length=46 2024-06-04T16:12:45.661 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:45.658+0000 7f310b662800 20 rados->read ofs=0 len=0 2024-06-04T16:12:45.662 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:45.659+0000 7f310b662800 20 rados_obj.operate() r=0 bl.length=470 2024-06-04T16:12:45.662 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:45.659+0000 7f310b662800 20 zone default found 2024-06-04T16:12:45.662 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:45.659+0000 7f310b662800 4 Realm: () 2024-06-04T16:12:45.662 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:45.659+0000 7f310b662800 4 ZoneGroup: default (abb22408-c332-4e28-8f7a-ff254ea2fed2) 2024-06-04T16:12:45.662 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:45.659+0000 7f310b662800 4 Zone: default (be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767) 2024-06-04T16:12:45.662 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:45.659+0000 7f310b662800 10 cannot find current period zonegroup using local zonegroup configuration 2024-06-04T16:12:45.662 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:45.659+0000 7f310b662800 20 zonegroup default 2024-06-04T16:12:45.662 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:45.659+0000 7f310b662800 20 rados->read ofs=0 len=0 2024-06-04T16:12:45.662 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:45.659+0000 7f310b662800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:12:45.663 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:45.659+0000 7f310b662800 20 rados->read ofs=0 len=0 2024-06-04T16:12:45.663 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:45.659+0000 7f310b662800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:12:45.663 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:45.659+0000 7f310b662800 20 rados->read ofs=0 len=0 2024-06-04T16:12:45.663 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:45.660+0000 7f310b662800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:12:45.663 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:45.660+0000 7f310b662800 20 started sync module instance, tier type = 2024-06-04T16:12:45.663 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:45.660+0000 7f310b662800 20 started zone id=be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767 (name=default) with tier type = 2024-06-04T16:12:45.670 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:45.668+0000 7f310b662800 20 add_watcher() i=0 2024-06-04T16:12:45.670 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:45.668+0000 7f310b662800 20 add_watcher() i=1 2024-06-04T16:12:45.670 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:45.668+0000 7f310b662800 20 add_watcher() i=2 2024-06-04T16:12:45.671 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:45.668+0000 7f310b662800 20 add_watcher() i=3 2024-06-04T16:12:45.671 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:45.668+0000 7f310b662800 20 add_watcher() i=4 2024-06-04T16:12:45.671 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:45.668+0000 7f310b662800 20 add_watcher() i=5 2024-06-04T16:12:45.671 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:45.668+0000 7f310b662800 20 add_watcher() i=6 2024-06-04T16:12:45.671 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:45.670+0000 7f310b662800 20 add_watcher() i=7 2024-06-04T16:12:45.671 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:45.670+0000 7f310b662800 2 all 8 watchers are set, enabling cache 2024-06-04T16:12:45.674 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:45.672+0000 7f2fbf7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-06-04T16:12:45.674 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:45.672+0000 7f310b662800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-06-04T16:12:45.674 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:45.672+0000 7f310b662800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-06-04T16:12:45.674 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:45.672+0000 7f310b662800 5 note: GC not initialized 2024-06-04T16:12:45.674 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:45.672+0000 7f2fbe7e4640 20 reqs_thread_entry: start 2024-06-04T16:12:45.675 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:45.672+0000 7f310b662800 20 init_complete bucket index max shards: 11 2024-06-04T16:12:45.675 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:45.672+0000 7f310b662800 20 Filter name: none 2024-06-04T16:12:45.675 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:45.672+0000 7f2f2ffff640 20 reqs_thread_entry: start 2024-06-04T16:12:45.675 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:45.672+0000 7f310b662800 20 rados->read ofs=0 len=0 2024-06-04T16:12:45.675 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:45.673+0000 7f310b662800 20 rados_obj.operate() r=0 bl.length=189 2024-06-04T16:12:45.675 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:45.673+0000 7f310b662800 20 rados->read ofs=0 len=0 2024-06-04T16:12:45.676 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:45.674+0000 7f310b662800 20 rados_obj.operate() r=0 bl.length=403 2024-06-04T16:12:45.676 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:45.674+0000 7f310b662800 20 couldn't put binfo cache entry, might have raced with data changes 2024-06-04T16:12:45.676 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:45.674+0000 7f310b662800 20 rados->read ofs=0 len=0 2024-06-04T16:12:45.677 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:45.674+0000 7f310b662800 20 rados_obj.operate() r=0 bl.length=189 2024-06-04T16:12:45.677 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:45.674+0000 7f310b662800 20 rados->read ofs=0 len=0 2024-06-04T16:12:45.677 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:45.675+0000 7f310b662800 20 rados_obj.operate() r=0 bl.length=403 2024-06-04T16:12:45.677 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:45.675+0000 7f310b662800 20 couldn't put binfo cache entry, might have raced with data changes 2024-06-04T16:12:45.679 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:45.677+0000 7f2fbf7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-06-04T16:12:45.681 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:45.679+0000 7f310b662800 20 remove_watcher() i=0 2024-06-04T16:12:45.681 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:45.679+0000 7f310b662800 2 removed watcher, disabling cache 2024-06-04T16:12:45.682 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:45.681+0000 7f310b662800 20 remove_watcher() i=1 2024-06-04T16:12:45.683 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:45.682+0000 7f310b662800 20 remove_watcher() i=2 2024-06-04T16:12:45.684 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:45.683+0000 7f310b662800 20 remove_watcher() i=3 2024-06-04T16:12:45.685 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:45.684+0000 7f310b662800 20 remove_watcher() i=4 2024-06-04T16:12:45.686 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:45.685+0000 7f310b662800 20 remove_watcher() i=5 2024-06-04T16:12:45.688 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:45.686+0000 7f310b662800 20 remove_watcher() i=6 2024-06-04T16:12:45.689 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:45.687+0000 7f310b662800 20 remove_watcher() i=7 2024-06-04T16:12:45.699 INFO:tasks.workunit.client.0.smithi144.stderr: 2024-06-04T16:12:45.699 INFO:tasks.workunit.client.0.smithi144.stderr:BUCKET_STATS: 2024-06-04T16:12:45.699 INFO:tasks.workunit.client.0.smithi144.stderr:bucket: abort-at-block-writes id: be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.23 num_objects: 19 size_kb: 1 num_shards: 12 2024-06-04T16:12:45.699 INFO:tasks.workunit.client.0.smithi144.stderr: 2024-06-04T16:12:45.701 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:12:45.701 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:12:45.704 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:12:45.704 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:12:45.747 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:12:45.747 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:12:45.774 INFO:tasks.workunit.client.0.smithi144.stderr:TEST: reshard bucket with EIO injected at commit_target_layout 2024-06-04T16:12:45.775 INFO:tasks.workunit.client.0.smithi144.stderr: 2024-06-04T16:12:45.776 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:12:45.776 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:12:45.787 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:12:45.787 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:12:45.830 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:12:45.830 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:12:45.837 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:12:45.837 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:12:45.845 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:12:45.845 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:12:45.849 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:12:45.849 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:12:45.855 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:12:45.855 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:12:45.862 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:12:45.862 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:12:45.868 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:12:45.868 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:12:45.874 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:12:45.874 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:12:45.880 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:12:45.880 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:12:45.886 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:12:45.887 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:12:45.894 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:12:45.894 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:12:45.900 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:12:45.901 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:12:45.906 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:12:45.906 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:12:45.913 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:12:45.913 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:12:45.920 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:12:45.920 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:12:45.926 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:12:45.926 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:12:45.932 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:12:45.932 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:12:45.938 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:12:45.938 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:12:45.945 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:12:45.945 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:12:45.951 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:12:45.951 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:12:45.958 INFO:tasks.workunit.client.0.smithi144.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2024-06-04T16:12:45.986 INFO:tasks.workunit.client.0.smithi144.stderr:ignoring --setuser ceph since I am not root 2024-06-04T16:12:45.989 INFO:tasks.workunit.client.0.smithi144.stderr:ignoring --setgroup ceph since I am not root 2024-06-04T16:12:46.023 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.022+0000 7fdfdc32d800 20 rados->read ofs=0 len=0 2024-06-04T16:12:46.026 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.024+0000 7fdfdc32d800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:12:46.026 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.024+0000 7fdfdc32d800 20 realm 2024-06-04T16:12:46.026 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.024+0000 7fdfdc32d800 20 rados->read ofs=0 len=0 2024-06-04T16:12:46.026 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.024+0000 7fdfdc32d800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:12:46.026 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.024+0000 7fdfdc32d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-06-04T16:12:46.026 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.024+0000 7fdfdc32d800 20 rados->read ofs=0 len=0 2024-06-04T16:12:46.026 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.024+0000 7fdfdc32d800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:12:46.027 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.024+0000 7fdfdc32d800 20 rados->read ofs=0 len=0 2024-06-04T16:12:46.027 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.025+0000 7fdfdc32d800 20 rados_obj.operate() r=0 bl.length=46 2024-06-04T16:12:46.027 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.025+0000 7fdfdc32d800 20 rados->read ofs=0 len=0 2024-06-04T16:12:46.027 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.025+0000 7fdfdc32d800 20 rados_obj.operate() r=0 bl.length=1139 2024-06-04T16:12:46.027 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.025+0000 7fdfdc32d800 20 searching for the correct realm 2024-06-04T16:12:46.028 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.026+0000 7fdfd7f6e640 0 -- 172.21.15.144:0/2011400961 >> [v2:172.21.15.177:6816/2039473917,v1:172.21.15.177:6817/2039473917] conn(0x55b796152010 msgr2=0x55b7961544b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-06-04T16:12:46.232 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.230+0000 7fdfd7f6e640 0 -- 172.21.15.144:0/2011400961 >> [v2:172.21.15.177:6800/3891611393,v1:172.21.15.177:6801/3891611393] conn(0x7fdfc804bc20 msgr2=0x7fdfc80a7a00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-06-04T16:12:46.440 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.438+0000 7fdfdc32d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-06-04T16:12:46.440 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.438+0000 7fdfdc32d800 20 RGWRados::pool_iterate: got zone_info.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767 2024-06-04T16:12:46.440 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.438+0000 7fdfdc32d800 20 RGWRados::pool_iterate: got default.zone. 2024-06-04T16:12:46.440 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.438+0000 7fdfdc32d800 20 RGWRados::pool_iterate: got zonegroup_info.abb22408-c332-4e28-8f7a-ff254ea2fed2 2024-06-04T16:12:46.440 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.438+0000 7fdfdc32d800 20 RGWRados::pool_iterate: got zone_names.default 2024-06-04T16:12:46.440 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.438+0000 7fdfdc32d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-06-04T16:12:46.440 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.438+0000 7fdfdc32d800 20 rados->read ofs=0 len=0 2024-06-04T16:12:46.441 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.438+0000 7fdfdc32d800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:12:46.441 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.438+0000 7fdfdc32d800 20 rados->read ofs=0 len=0 2024-06-04T16:12:46.441 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.438+0000 7fdfdc32d800 20 rados_obj.operate() r=0 bl.length=46 2024-06-04T16:12:46.441 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.438+0000 7fdfdc32d800 20 rados->read ofs=0 len=0 2024-06-04T16:12:46.442 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.439+0000 7fdfdc32d800 20 rados_obj.operate() r=0 bl.length=470 2024-06-04T16:12:46.442 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.439+0000 7fdfdc32d800 20 zone default found 2024-06-04T16:12:46.442 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.439+0000 7fdfdc32d800 4 Realm: () 2024-06-04T16:12:46.442 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.439+0000 7fdfdc32d800 4 ZoneGroup: default (abb22408-c332-4e28-8f7a-ff254ea2fed2) 2024-06-04T16:12:46.442 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.439+0000 7fdfdc32d800 4 Zone: default (be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767) 2024-06-04T16:12:46.442 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.439+0000 7fdfdc32d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-06-04T16:12:46.442 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.439+0000 7fdfdc32d800 20 zonegroup default 2024-06-04T16:12:46.443 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.439+0000 7fdfdc32d800 20 rados->read ofs=0 len=0 2024-06-04T16:12:46.443 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.439+0000 7fdfdc32d800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:12:46.443 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.439+0000 7fdfdc32d800 20 rados->read ofs=0 len=0 2024-06-04T16:12:46.443 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.439+0000 7fdfdc32d800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:12:46.443 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.439+0000 7fdfdc32d800 20 rados->read ofs=0 len=0 2024-06-04T16:12:46.443 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.439+0000 7fdfdc32d800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:12:46.443 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.439+0000 7fdfdc32d800 20 started sync module instance, tier type = 2024-06-04T16:12:46.443 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.439+0000 7fdfdc32d800 20 started zone id=be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767 (name=default) with tier type = 2024-06-04T16:12:46.450 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.448+0000 7fdfdc32d800 20 add_watcher() i=0 2024-06-04T16:12:46.450 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.448+0000 7fdfdc32d800 20 add_watcher() i=1 2024-06-04T16:12:46.450 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.448+0000 7fdfdc32d800 20 add_watcher() i=2 2024-06-04T16:12:46.450 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.448+0000 7fdfdc32d800 20 add_watcher() i=3 2024-06-04T16:12:46.450 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.448+0000 7fdfdc32d800 20 add_watcher() i=4 2024-06-04T16:12:46.450 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.448+0000 7fdfdc32d800 20 add_watcher() i=5 2024-06-04T16:12:46.451 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.448+0000 7fdfdc32d800 20 add_watcher() i=6 2024-06-04T16:12:46.451 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.449+0000 7fdfdc32d800 20 add_watcher() i=7 2024-06-04T16:12:46.451 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.449+0000 7fdfdc32d800 2 all 8 watchers are set, enabling cache 2024-06-04T16:12:46.453 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.451+0000 7fde8dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-06-04T16:12:46.454 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.451+0000 7fdfdc32d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-06-04T16:12:46.454 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.451+0000 7fdfdc32d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-06-04T16:12:46.454 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.451+0000 7fdfdc32d800 5 note: GC not initialized 2024-06-04T16:12:46.454 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.451+0000 7fde8cfe1640 20 reqs_thread_entry: start 2024-06-04T16:12:46.454 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.452+0000 7fdfdc32d800 20 init_complete bucket index max shards: 11 2024-06-04T16:12:46.454 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.452+0000 7fdfdc32d800 20 Filter name: none 2024-06-04T16:12:46.454 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.452+0000 7fde067fc640 20 reqs_thread_entry: start 2024-06-04T16:12:46.454 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.452+0000 7fdfdc32d800 20 rados->read ofs=0 len=0 2024-06-04T16:12:46.455 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.452+0000 7fdfdc32d800 20 rados_obj.operate() r=0 bl.length=197 2024-06-04T16:12:46.455 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.452+0000 7fdfdc32d800 20 rados->read ofs=0 len=0 2024-06-04T16:12:46.455 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.453+0000 7fdfdc32d800 20 rados_obj.operate() r=0 bl.length=411 2024-06-04T16:12:46.455 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.453+0000 7fdfdc32d800 20 couldn't put binfo cache entry, might have raced with data changes 2024-06-04T16:12:46.455 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.453+0000 7fdfdc32d800 20 rados->read ofs=0 len=0 2024-06-04T16:12:46.456 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.453+0000 7fdfdc32d800 20 rados_obj.operate() r=0 bl.length=197 2024-06-04T16:12:46.456 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.453+0000 7fdfdc32d800 20 rados->read ofs=0 len=0 2024-06-04T16:12:46.456 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.453+0000 7fdfdc32d800 20 rados_obj.operate() r=0 bl.length=411 2024-06-04T16:12:46.456 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.453+0000 7fdfdc32d800 20 couldn't put binfo cache entry, might have raced with data changes 2024-06-04T16:12:46.457 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.455+0000 7fde8dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-06-04T16:12:46.459 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.457+0000 7fdfdc32d800 20 remove_watcher() i=0 2024-06-04T16:12:46.459 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.457+0000 7fdfdc32d800 2 removed watcher, disabling cache 2024-06-04T16:12:46.460 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.458+0000 7fdfdc32d800 20 remove_watcher() i=1 2024-06-04T16:12:46.461 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.459+0000 7fdfdc32d800 20 remove_watcher() i=2 2024-06-04T16:12:46.462 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.460+0000 7fdfdc32d800 20 remove_watcher() i=3 2024-06-04T16:12:46.463 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.461+0000 7fdfdc32d800 20 remove_watcher() i=4 2024-06-04T16:12:46.463 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.462+0000 7fdfdc32d800 20 remove_watcher() i=5 2024-06-04T16:12:46.464 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.463+0000 7fdfdc32d800 20 remove_watcher() i=6 2024-06-04T16:12:46.465 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.464+0000 7fdfdc32d800 20 remove_watcher() i=7 2024-06-04T16:12:46.478 INFO:tasks.workunit.client.0.smithi144.stderr: 2024-06-04T16:12:46.478 INFO:tasks.workunit.client.0.smithi144.stderr:BUCKET_STATS: 2024-06-04T16:12:46.478 INFO:tasks.workunit.client.0.smithi144.stderr:bucket: error-at-commit-target-layout id: be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.24 num_objects: 20 size_kb: 1 num_shards: 11 2024-06-04T16:12:46.478 INFO:tasks.workunit.client.0.smithi144.stderr: 2024-06-04T16:12:46.478 INFO:tasks.workunit.client.0.smithi144.stderr:radosgw-admin bucket reshard --bucket error-at-commit-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at commit_target_layout 2024-06-04T16:12:46.511 INFO:tasks.workunit.client.0.smithi144.stderr:ignoring --setuser ceph since I am not root 2024-06-04T16:12:46.512 INFO:tasks.workunit.client.0.smithi144.stderr:ignoring --setgroup ceph since I am not root 2024-06-04T16:12:46.549 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.547+0000 7fbbb4333800 20 rados->read ofs=0 len=0 2024-06-04T16:12:46.551 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.549+0000 7fbbb4333800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:12:46.551 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.549+0000 7fbbb4333800 20 realm 2024-06-04T16:12:46.551 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.549+0000 7fbbb4333800 20 rados->read ofs=0 len=0 2024-06-04T16:12:46.551 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.549+0000 7fbbb4333800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:12:46.551 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.549+0000 7fbbb4333800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-06-04T16:12:46.551 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.549+0000 7fbbb4333800 20 rados->read ofs=0 len=0 2024-06-04T16:12:46.551 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.549+0000 7fbbb4333800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:12:46.551 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.549+0000 7fbbb4333800 20 rados->read ofs=0 len=0 2024-06-04T16:12:46.552 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.550+0000 7fbbb4333800 20 rados_obj.operate() r=0 bl.length=46 2024-06-04T16:12:46.552 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.550+0000 7fbbb4333800 20 rados->read ofs=0 len=0 2024-06-04T16:12:46.552 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.550+0000 7fbbb4333800 20 rados_obj.operate() r=0 bl.length=1139 2024-06-04T16:12:46.552 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.550+0000 7fbbb4333800 20 searching for the correct realm 2024-06-04T16:12:46.554 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.552+0000 7fbbb08e9640 0 -- 172.21.15.144:0/1695454789 >> [v2:172.21.15.144:6800/1453747520,v1:172.21.15.144:6801/1453747520] conn(0x7fbb9801f070 msgr2=0x7fbb98001390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-06-04T16:12:46.759 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.757+0000 7fbbb08e9640 0 -- 172.21.15.144:0/1695454789 >> [v2:172.21.15.144:6824/166159729,v1:172.21.15.144:6825/166159729] conn(0x5594a83f7ef0 msgr2=0x5594a83fa300 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-06-04T16:12:46.764 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.761+0000 7fbbb4333800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-06-04T16:12:46.764 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.761+0000 7fbbb4333800 20 RGWRados::pool_iterate: got zone_info.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767 2024-06-04T16:12:46.764 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.761+0000 7fbbb4333800 20 RGWRados::pool_iterate: got default.zone. 2024-06-04T16:12:46.764 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.761+0000 7fbbb4333800 20 RGWRados::pool_iterate: got zonegroup_info.abb22408-c332-4e28-8f7a-ff254ea2fed2 2024-06-04T16:12:46.764 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.761+0000 7fbbb4333800 20 RGWRados::pool_iterate: got zone_names.default 2024-06-04T16:12:46.764 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.761+0000 7fbbb4333800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-06-04T16:12:46.764 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.762+0000 7fbbb4333800 20 rados->read ofs=0 len=0 2024-06-04T16:12:46.764 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.762+0000 7fbbb4333800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:12:46.764 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.762+0000 7fbbb4333800 20 rados->read ofs=0 len=0 2024-06-04T16:12:46.764 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.762+0000 7fbbb4333800 20 rados_obj.operate() r=0 bl.length=46 2024-06-04T16:12:46.764 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.762+0000 7fbbb4333800 20 rados->read ofs=0 len=0 2024-06-04T16:12:46.766 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.762+0000 7fbbb4333800 20 rados_obj.operate() r=0 bl.length=470 2024-06-04T16:12:46.766 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.762+0000 7fbbb4333800 20 zone default found 2024-06-04T16:12:46.766 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.762+0000 7fbbb4333800 4 Realm: () 2024-06-04T16:12:46.766 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.762+0000 7fbbb4333800 4 ZoneGroup: default (abb22408-c332-4e28-8f7a-ff254ea2fed2) 2024-06-04T16:12:46.766 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.762+0000 7fbbb4333800 4 Zone: default (be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767) 2024-06-04T16:12:46.766 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.762+0000 7fbbb4333800 10 cannot find current period zonegroup using local zonegroup configuration 2024-06-04T16:12:46.766 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.762+0000 7fbbb4333800 20 zonegroup default 2024-06-04T16:12:46.766 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.762+0000 7fbbb4333800 20 rados->read ofs=0 len=0 2024-06-04T16:12:46.766 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.763+0000 7fbbb4333800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:12:46.766 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.763+0000 7fbbb4333800 20 rados->read ofs=0 len=0 2024-06-04T16:12:46.767 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.763+0000 7fbbb4333800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:12:46.767 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.763+0000 7fbbb4333800 20 rados->read ofs=0 len=0 2024-06-04T16:12:46.767 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.763+0000 7fbbb4333800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:12:46.767 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.763+0000 7fbbb4333800 20 started sync module instance, tier type = 2024-06-04T16:12:46.767 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.763+0000 7fbbb4333800 20 started zone id=be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767 (name=default) with tier type = 2024-06-04T16:12:46.773 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.772+0000 7fbbb4333800 20 add_watcher() i=0 2024-06-04T16:12:46.774 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.772+0000 7fbbb4333800 20 add_watcher() i=1 2024-06-04T16:12:46.774 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.772+0000 7fbbb4333800 20 add_watcher() i=2 2024-06-04T16:12:46.774 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.772+0000 7fbbb4333800 20 add_watcher() i=3 2024-06-04T16:12:46.774 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.772+0000 7fbbb4333800 20 add_watcher() i=4 2024-06-04T16:12:46.774 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.772+0000 7fbbb4333800 20 add_watcher() i=5 2024-06-04T16:12:46.774 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.772+0000 7fbbb4333800 20 add_watcher() i=6 2024-06-04T16:12:46.774 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.773+0000 7fbbb4333800 20 add_watcher() i=7 2024-06-04T16:12:46.774 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.773+0000 7fbbb4333800 2 all 8 watchers are set, enabling cache 2024-06-04T16:12:46.776 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.774+0000 7fba66fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-06-04T16:12:46.777 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.775+0000 7fbbb4333800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-06-04T16:12:46.777 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.775+0000 7fbbb4333800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-06-04T16:12:46.777 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.775+0000 7fbbb4333800 5 note: GC not initialized 2024-06-04T16:12:46.777 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.775+0000 7fba65fdb640 20 reqs_thread_entry: start 2024-06-04T16:12:46.778 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.775+0000 7fbbb4333800 20 init_complete bucket index max shards: 11 2024-06-04T16:12:46.778 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.775+0000 7fbbb4333800 20 Filter name: none 2024-06-04T16:12:46.778 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.775+0000 7fb9d77fe640 20 reqs_thread_entry: start 2024-06-04T16:12:46.778 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.775+0000 7fbbb4333800 10 cache get: name=default.rgw.meta+root+error-at-commit-target-layout : miss 2024-06-04T16:12:46.778 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.775+0000 7fbbb4333800 20 rados->read ofs=0 len=0 2024-06-04T16:12:46.779 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.776+0000 7fbbb4333800 20 rados_obj.operate() r=0 bl.length=197 2024-06-04T16:12:46.779 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.776+0000 7fbbb4333800 10 cache put: name=default.rgw.meta+root+error-at-commit-target-layout info.flags=0x11 2024-06-04T16:12:46.779 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.776+0000 7fbbb4333800 10 adding default.rgw.meta+root+error-at-commit-target-layout to cache LRU end 2024-06-04T16:12:46.779 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.776+0000 7fbbb4333800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.24 : miss 2024-06-04T16:12:46.779 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.776+0000 7fbbb4333800 20 rados->read ofs=0 len=0 2024-06-04T16:12:46.779 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.776+0000 7fbbb4333800 20 rados_obj.operate() r=0 bl.length=411 2024-06-04T16:12:46.779 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.776+0000 7fbbb4333800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.24 info.flags=0x17 2024-06-04T16:12:46.779 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.776+0000 7fbbb4333800 10 adding default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.24 to cache LRU end 2024-06-04T16:12:46.779 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.776+0000 7fbbb4333800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-06-04T16:12:46.780 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.776+0000 7fbbb4333800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-06-04T16:12:46.780 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.776+0000 7fbbb4333800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.24 2024-06-04T16:12:46.783 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.781+0000 7fbbb4333800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.24 info.flags=0x17 2024-06-04T16:12:46.783 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.781+0000 7fbbb4333800 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.24 to cache LRU end 2024-06-04T16:12:46.783 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.781+0000 7fbbb4333800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-06-04T16:12:46.783 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.781+0000 7fbbb4333800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.24, ofs0, ns] 2024-06-04T16:12:46.783 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.781+0000 7fba877fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1078036791380 cookie 94096966295648 notifier 6254 bl.length()=923 2024-06-04T16:12:46.783 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.781+0000 7fba877fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.24 info.flags=0x17 2024-06-04T16:12:46.783 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.781+0000 7fba877fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.24 to cache LRU end 2024-06-04T16:12:46.783 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.781+0000 7fba877fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-06-04T16:12:46.784 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.782+0000 7fbbb4333800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.24]): orig_sources= new_sources= 2024-06-04T16:12:46.784 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.782+0000 7fbbb4333800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.24]): potential sources added=[] removed=[] 2024-06-04T16:12:46.784 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.782+0000 7fbbb4333800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.24]): orig_dests= new_dests= 2024-06-04T16:12:46.784 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.782+0000 7fbbb4333800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.24]): potential dests added=[] removed=[] 2024-06-04T16:12:46.786 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.784+0000 7fbbb4333800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.24.1.0 2024-06-04T16:12:46.786 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.784+0000 7fbbb4333800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.24.1.0 2024-06-04T16:12:46.786 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.784+0000 7fbbb4333800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.24.1.1 2024-06-04T16:12:46.786 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.784+0000 7fbbb4333800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.24.1.1 2024-06-04T16:12:46.786 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.784+0000 7fbbb4333800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.24.1.2 2024-06-04T16:12:46.786 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.784+0000 7fbbb4333800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.24.1.2 2024-06-04T16:12:46.787 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.784+0000 7fbbb4333800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.24.1.3 2024-06-04T16:12:46.787 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.784+0000 7fbbb4333800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.24.1.3 2024-06-04T16:12:46.787 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.784+0000 7fbbb4333800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.24.1.4 2024-06-04T16:12:46.787 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.784+0000 7fbbb4333800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.24.1.4 2024-06-04T16:12:46.787 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.784+0000 7fbbb4333800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.24.1.5 2024-06-04T16:12:46.787 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.784+0000 7fbbb4333800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.24.1.5 2024-06-04T16:12:46.787 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.784+0000 7fbbb4333800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.24.1.6 2024-06-04T16:12:46.787 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.784+0000 7fbbb4333800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.24.1.6 2024-06-04T16:12:46.787 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.784+0000 7fbbb4333800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.24.1.7 2024-06-04T16:12:46.787 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.784+0000 7fbbb4333800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.24.1.7 2024-06-04T16:12:46.787 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.784+0000 7fbbb4333800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.24.1.8 2024-06-04T16:12:46.787 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.784+0000 7fbbb4333800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.24.1.8 2024-06-04T16:12:46.787 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.784+0000 7fbbb4333800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.24.1.9 2024-06-04T16:12:46.787 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.784+0000 7fbbb4333800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.24.1.9 2024-06-04T16:12:46.788 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.784+0000 7fbbb4333800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.24.1.10 2024-06-04T16:12:46.788 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.784+0000 7fbbb4333800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.24.1.10 2024-06-04T16:12:46.788 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.784+0000 7fbbb4333800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.24.1.11 2024-06-04T16:12:46.788 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.784+0000 7fbbb4333800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.24.1.11 2024-06-04T16:12:46.788 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.784+0000 7fbbb4333800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.24.0 2024-06-04T16:12:46.788 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.784+0000 7fbbb4333800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.24.1 2024-06-04T16:12:46.789 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.785+0000 7fbbb4333800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.24.2 2024-06-04T16:12:46.789 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.785+0000 7fbbb4333800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.24.3 2024-06-04T16:12:46.789 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.786+0000 7fbbb4333800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.24.4 2024-06-04T16:12:46.789 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.786+0000 7fbbb4333800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.24.5 2024-06-04T16:12:46.789 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.787+0000 7fbbb4333800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.24.6 2024-06-04T16:12:46.790 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.788+0000 7fbbb4333800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.24.7 2024-06-04T16:12:46.790 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.788+0000 7fbbb4333800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.24.8 2024-06-04T16:12:46.790 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.790+0000 7fbbb4333800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.24.9 2024-06-04T16:12:46.791 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.790+0000 7fbbb4333800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.24.10 2024-06-04T16:12:46.794 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.792+0000 7fbbb4333800 -1 Injecting error=-5 at location=commit_target_layout 2024-06-04T16:12:46.794 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.792+0000 7fbbb4333800 0 ERROR: commit_reshard failed to commit target index layout: (5) Input/output error 2024-06-04T16:12:46.798 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.796+0000 7fba66fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-06-04T16:12:46.800 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.798+0000 7fbbb4333800 20 remove_watcher() i=0 2024-06-04T16:12:46.800 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.798+0000 7fbbb4333800 2 removed watcher, disabling cache 2024-06-04T16:12:46.801 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.799+0000 7fbbb4333800 20 remove_watcher() i=1 2024-06-04T16:12:46.802 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.800+0000 7fbbb4333800 20 remove_watcher() i=2 2024-06-04T16:12:46.803 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.801+0000 7fbbb4333800 20 remove_watcher() i=3 2024-06-04T16:12:46.803 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.802+0000 7fbbb4333800 20 remove_watcher() i=4 2024-06-04T16:12:46.804 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.803+0000 7fbbb4333800 20 remove_watcher() i=5 2024-06-04T16:12:46.805 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.804+0000 7fbbb4333800 20 remove_watcher() i=6 2024-06-04T16:12:46.806 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.805+0000 7fbbb4333800 20 remove_watcher() i=7 2024-06-04T16:12:46.818 INFO:tasks.workunit.client.0.smithi144.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2024-06-04T16:12:46.846 INFO:tasks.workunit.client.0.smithi144.stderr:ignoring --setuser ceph since I am not root 2024-06-04T16:12:46.846 INFO:tasks.workunit.client.0.smithi144.stderr:ignoring --setgroup ceph since I am not root 2024-06-04T16:12:46.883 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.881+0000 7f8e74d22800 20 rados->read ofs=0 len=0 2024-06-04T16:12:46.885 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.883+0000 7f8e74d22800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:12:46.885 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.883+0000 7f8e74d22800 20 realm 2024-06-04T16:12:46.885 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.883+0000 7f8e74d22800 20 rados->read ofs=0 len=0 2024-06-04T16:12:46.885 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.883+0000 7f8e74d22800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:12:46.885 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.883+0000 7f8e74d22800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-06-04T16:12:46.885 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.883+0000 7f8e74d22800 20 rados->read ofs=0 len=0 2024-06-04T16:12:46.885 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.883+0000 7f8e74d22800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:12:46.885 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.883+0000 7f8e74d22800 20 rados->read ofs=0 len=0 2024-06-04T16:12:46.885 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.884+0000 7f8e74d22800 20 rados_obj.operate() r=0 bl.length=46 2024-06-04T16:12:46.886 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.884+0000 7f8e74d22800 20 rados->read ofs=0 len=0 2024-06-04T16:12:46.886 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.884+0000 7f8e74d22800 20 rados_obj.operate() r=0 bl.length=1139 2024-06-04T16:12:46.886 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.884+0000 7f8e74d22800 20 searching for the correct realm 2024-06-04T16:12:46.889 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.887+0000 7f8e71197640 0 -- 172.21.15.144:0/240775859 >> [v2:172.21.15.144:6800/1453747520,v1:172.21.15.144:6801/1453747520] conn(0x7f8e5c02d070 msgr2=0x7f8e5c03b420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-06-04T16:12:46.891 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.890+0000 7f8e71197640 0 -- 172.21.15.144:0/240775859 >> [v2:172.21.15.144:6824/166159729,v1:172.21.15.144:6825/166159729] conn(0x562cb2902ad0 msgr2=0x562cb2904ec0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-06-04T16:12:46.896 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.894+0000 7f8e74d22800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-06-04T16:12:46.896 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.894+0000 7f8e74d22800 20 RGWRados::pool_iterate: got zone_info.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767 2024-06-04T16:12:46.896 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.894+0000 7f8e74d22800 20 RGWRados::pool_iterate: got default.zone. 2024-06-04T16:12:46.896 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.894+0000 7f8e74d22800 20 RGWRados::pool_iterate: got zonegroup_info.abb22408-c332-4e28-8f7a-ff254ea2fed2 2024-06-04T16:12:46.896 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.894+0000 7f8e74d22800 20 RGWRados::pool_iterate: got zone_names.default 2024-06-04T16:12:46.896 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.894+0000 7f8e74d22800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-06-04T16:12:46.896 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.894+0000 7f8e74d22800 20 rados->read ofs=0 len=0 2024-06-04T16:12:46.896 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.894+0000 7f8e74d22800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:12:46.896 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.894+0000 7f8e74d22800 20 rados->read ofs=0 len=0 2024-06-04T16:12:46.898 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.894+0000 7f8e74d22800 20 rados_obj.operate() r=0 bl.length=46 2024-06-04T16:12:46.898 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.894+0000 7f8e74d22800 20 rados->read ofs=0 len=0 2024-06-04T16:12:46.898 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.895+0000 7f8e74d22800 20 rados_obj.operate() r=0 bl.length=470 2024-06-04T16:12:46.898 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.895+0000 7f8e74d22800 20 zone default found 2024-06-04T16:12:46.898 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.895+0000 7f8e74d22800 4 Realm: () 2024-06-04T16:12:46.898 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.895+0000 7f8e74d22800 4 ZoneGroup: default (abb22408-c332-4e28-8f7a-ff254ea2fed2) 2024-06-04T16:12:46.898 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.895+0000 7f8e74d22800 4 Zone: default (be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767) 2024-06-04T16:12:46.898 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.895+0000 7f8e74d22800 10 cannot find current period zonegroup using local zonegroup configuration 2024-06-04T16:12:46.898 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.895+0000 7f8e74d22800 20 zonegroup default 2024-06-04T16:12:46.898 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.895+0000 7f8e74d22800 20 rados->read ofs=0 len=0 2024-06-04T16:12:46.898 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.895+0000 7f8e74d22800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:12:46.899 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.895+0000 7f8e74d22800 20 rados->read ofs=0 len=0 2024-06-04T16:12:46.899 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.895+0000 7f8e74d22800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:12:46.899 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.895+0000 7f8e74d22800 20 rados->read ofs=0 len=0 2024-06-04T16:12:46.899 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.896+0000 7f8e74d22800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:12:46.899 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.896+0000 7f8e74d22800 20 started sync module instance, tier type = 2024-06-04T16:12:46.899 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.896+0000 7f8e74d22800 20 started zone id=be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767 (name=default) with tier type = 2024-06-04T16:12:46.906 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.904+0000 7f8e74d22800 20 add_watcher() i=0 2024-06-04T16:12:46.906 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.904+0000 7f8e74d22800 20 add_watcher() i=1 2024-06-04T16:12:46.906 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.904+0000 7f8e74d22800 20 add_watcher() i=2 2024-06-04T16:12:46.906 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.904+0000 7f8e74d22800 20 add_watcher() i=3 2024-06-04T16:12:46.906 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.904+0000 7f8e74d22800 20 add_watcher() i=4 2024-06-04T16:12:46.906 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.904+0000 7f8e74d22800 20 add_watcher() i=5 2024-06-04T16:12:46.907 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.904+0000 7f8e74d22800 20 add_watcher() i=6 2024-06-04T16:12:46.907 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.905+0000 7f8e74d22800 20 add_watcher() i=7 2024-06-04T16:12:46.907 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.905+0000 7f8e74d22800 2 all 8 watchers are set, enabling cache 2024-06-04T16:12:46.909 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.907+0000 7f8d26fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-06-04T16:12:46.909 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.907+0000 7f8e74d22800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-06-04T16:12:46.909 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.907+0000 7f8e74d22800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-06-04T16:12:46.909 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.907+0000 7f8e74d22800 5 note: GC not initialized 2024-06-04T16:12:46.909 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.907+0000 7f8d25fe3640 20 reqs_thread_entry: start 2024-06-04T16:12:46.909 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.907+0000 7f8e74d22800 20 init_complete bucket index max shards: 11 2024-06-04T16:12:46.910 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.907+0000 7f8e74d22800 20 Filter name: none 2024-06-04T16:12:46.910 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.907+0000 7f8c977fe640 20 reqs_thread_entry: start 2024-06-04T16:12:46.910 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.907+0000 7f8e74d22800 20 rados->read ofs=0 len=0 2024-06-04T16:12:46.911 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.908+0000 7f8e74d22800 20 rados_obj.operate() r=0 bl.length=197 2024-06-04T16:12:46.911 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.908+0000 7f8e74d22800 20 rados->read ofs=0 len=0 2024-06-04T16:12:46.911 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.908+0000 7f8e74d22800 20 rados_obj.operate() r=0 bl.length=443 2024-06-04T16:12:46.911 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.908+0000 7f8e74d22800 20 couldn't put binfo cache entry, might have raced with data changes 2024-06-04T16:12:46.911 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.908+0000 7f8e74d22800 20 rados->read ofs=0 len=0 2024-06-04T16:12:46.911 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.909+0000 7f8e74d22800 20 rados_obj.operate() r=0 bl.length=197 2024-06-04T16:12:46.911 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.909+0000 7f8e74d22800 20 rados->read ofs=0 len=0 2024-06-04T16:12:46.911 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.909+0000 7f8e74d22800 20 rados_obj.operate() r=0 bl.length=443 2024-06-04T16:12:46.911 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.909+0000 7f8e74d22800 20 couldn't put binfo cache entry, might have raced with data changes 2024-06-04T16:12:46.912 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.910+0000 7f8d26fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-06-04T16:12:46.914 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.912+0000 7f8e74d22800 20 remove_watcher() i=0 2024-06-04T16:12:46.914 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.912+0000 7f8e74d22800 2 removed watcher, disabling cache 2024-06-04T16:12:46.915 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.913+0000 7f8e74d22800 20 remove_watcher() i=1 2024-06-04T16:12:46.916 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.914+0000 7f8e74d22800 20 remove_watcher() i=2 2024-06-04T16:12:46.917 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.915+0000 7f8e74d22800 20 remove_watcher() i=3 2024-06-04T16:12:46.918 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.916+0000 7f8e74d22800 20 remove_watcher() i=4 2024-06-04T16:12:46.919 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.917+0000 7f8e74d22800 20 remove_watcher() i=5 2024-06-04T16:12:46.920 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.918+0000 7f8e74d22800 20 remove_watcher() i=6 2024-06-04T16:12:46.921 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:46.919+0000 7f8e74d22800 20 remove_watcher() i=7 2024-06-04T16:12:46.931 INFO:tasks.workunit.client.0.smithi144.stderr: 2024-06-04T16:12:46.931 INFO:tasks.workunit.client.0.smithi144.stderr:BUCKET_STATS: 2024-06-04T16:12:46.931 INFO:tasks.workunit.client.0.smithi144.stderr:bucket: error-at-commit-target-layout id: be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.24 num_objects: 20 size_kb: 1 num_shards: 11 2024-06-04T16:12:46.931 INFO:tasks.workunit.client.0.smithi144.stderr: 2024-06-04T16:12:46.933 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:12:46.933 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:12:46.939 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:12:46.939 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:12:46.982 INFO:tasks.workunit.client.0.smithi144.stderr:radosgw-admin bucket reshard --bucket error-at-commit-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-06-04T16:12:47.013 INFO:tasks.workunit.client.0.smithi144.stderr:ignoring --setuser ceph since I am not root 2024-06-04T16:12:47.014 INFO:tasks.workunit.client.0.smithi144.stderr:ignoring --setgroup ceph since I am not root 2024-06-04T16:12:47.251 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:47.251+0000 7efe5741f800 20 rados->read ofs=0 len=0 2024-06-04T16:12:47.253 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:47.252+0000 7efe5741f800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:12:47.254 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:47.252+0000 7efe5741f800 20 realm 2024-06-04T16:12:47.254 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:47.252+0000 7efe5741f800 20 rados->read ofs=0 len=0 2024-06-04T16:12:47.254 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:47.252+0000 7efe5741f800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:12:47.254 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:47.252+0000 7efe5741f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-06-04T16:12:47.254 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:47.252+0000 7efe5741f800 20 rados->read ofs=0 len=0 2024-06-04T16:12:47.254 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:47.253+0000 7efe5741f800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:12:47.254 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:47.253+0000 7efe5741f800 20 rados->read ofs=0 len=0 2024-06-04T16:12:47.255 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:47.253+0000 7efe5741f800 20 rados_obj.operate() r=0 bl.length=46 2024-06-04T16:12:47.255 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:47.253+0000 7efe5741f800 20 rados->read ofs=0 len=0 2024-06-04T16:12:47.255 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:47.254+0000 7efe5741f800 20 rados_obj.operate() r=0 bl.length=1139 2024-06-04T16:12:47.255 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:47.254+0000 7efe5741f800 20 searching for the correct realm 2024-06-04T16:12:47.256 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:47.255+0000 7efe54713640 0 -- 172.21.15.144:0/3982121463 >> [v2:172.21.15.144:6808/86532035,v1:172.21.15.144:6809/86532035] conn(0x7efe44033040 msgr2=0x7efe44033420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-06-04T16:12:47.460 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:47.460+0000 7efe54f14640 0 -- 172.21.15.144:0/3982121463 >> [v2:172.21.15.177:6824/800067290,v1:172.21.15.177:6825/800067290] conn(0x55e5800ff270 msgr2=0x55e5801016a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-06-04T16:12:47.467 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:47.465+0000 7efe5741f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-06-04T16:12:47.467 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:47.465+0000 7efe5741f800 20 RGWRados::pool_iterate: got zone_info.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767 2024-06-04T16:12:47.467 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:47.465+0000 7efe5741f800 20 RGWRados::pool_iterate: got default.zone. 2024-06-04T16:12:47.467 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:47.465+0000 7efe5741f800 20 RGWRados::pool_iterate: got zonegroup_info.abb22408-c332-4e28-8f7a-ff254ea2fed2 2024-06-04T16:12:47.467 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:47.465+0000 7efe5741f800 20 RGWRados::pool_iterate: got zone_names.default 2024-06-04T16:12:47.467 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:47.465+0000 7efe5741f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-06-04T16:12:47.468 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:47.465+0000 7efe5741f800 20 rados->read ofs=0 len=0 2024-06-04T16:12:47.468 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:47.465+0000 7efe5741f800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:12:47.468 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:47.465+0000 7efe5741f800 20 rados->read ofs=0 len=0 2024-06-04T16:12:47.468 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:47.465+0000 7efe5741f800 20 rados_obj.operate() r=0 bl.length=46 2024-06-04T16:12:47.468 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:47.466+0000 7efe5741f800 20 rados->read ofs=0 len=0 2024-06-04T16:12:47.468 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:47.466+0000 7efe5741f800 20 rados_obj.operate() r=0 bl.length=470 2024-06-04T16:12:47.468 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:47.466+0000 7efe5741f800 20 zone default found 2024-06-04T16:12:47.468 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:47.466+0000 7efe5741f800 4 Realm: () 2024-06-04T16:12:47.468 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:47.466+0000 7efe5741f800 4 ZoneGroup: default (abb22408-c332-4e28-8f7a-ff254ea2fed2) 2024-06-04T16:12:47.468 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:47.466+0000 7efe5741f800 4 Zone: default (be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767) 2024-06-04T16:12:47.468 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:47.466+0000 7efe5741f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-06-04T16:12:47.468 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:47.466+0000 7efe5741f800 20 zonegroup default 2024-06-04T16:12:47.468 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:47.466+0000 7efe5741f800 20 rados->read ofs=0 len=0 2024-06-04T16:12:47.469 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:47.466+0000 7efe5741f800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:12:47.469 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:47.466+0000 7efe5741f800 20 rados->read ofs=0 len=0 2024-06-04T16:12:47.469 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:47.466+0000 7efe5741f800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:12:47.469 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:47.466+0000 7efe5741f800 20 rados->read ofs=0 len=0 2024-06-04T16:12:47.469 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:47.467+0000 7efe5741f800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:12:47.469 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:47.467+0000 7efe5741f800 20 started sync module instance, tier type = 2024-06-04T16:12:47.469 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:47.467+0000 7efe5741f800 20 started zone id=be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767 (name=default) with tier type = 2024-06-04T16:12:47.477 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:47.476+0000 7efe5741f800 20 add_watcher() i=0 2024-06-04T16:12:47.477 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:47.476+0000 7efe5741f800 20 add_watcher() i=1 2024-06-04T16:12:47.477 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:47.476+0000 7efe5741f800 20 add_watcher() i=2 2024-06-04T16:12:47.477 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:47.476+0000 7efe5741f800 20 add_watcher() i=3 2024-06-04T16:12:47.477 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:47.476+0000 7efe5741f800 20 add_watcher() i=4 2024-06-04T16:12:47.477 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:47.476+0000 7efe5741f800 20 add_watcher() i=5 2024-06-04T16:12:47.477 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:47.476+0000 7efe5741f800 20 add_watcher() i=6 2024-06-04T16:12:47.478 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:47.477+0000 7efe5741f800 20 add_watcher() i=7 2024-06-04T16:12:47.478 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:47.477+0000 7efe5741f800 2 all 8 watchers are set, enabling cache 2024-06-04T16:12:47.480 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:47.479+0000 7efd0afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-06-04T16:12:47.480 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:47.479+0000 7efe5741f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-06-04T16:12:47.480 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:47.479+0000 7efe5741f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-06-04T16:12:47.481 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:47.479+0000 7efe5741f800 5 note: GC not initialized 2024-06-04T16:12:47.481 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:47.479+0000 7efd09fe3640 20 reqs_thread_entry: start 2024-06-04T16:12:47.481 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:47.479+0000 7efe5741f800 20 init_complete bucket index max shards: 11 2024-06-04T16:12:47.481 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:47.479+0000 7efe5741f800 20 Filter name: none 2024-06-04T16:12:47.481 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:47.479+0000 7efc7b7fe640 20 reqs_thread_entry: start 2024-06-04T16:12:47.481 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:47.480+0000 7efe5741f800 10 cache get: name=default.rgw.meta+root+error-at-commit-target-layout : miss 2024-06-04T16:12:47.481 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:47.480+0000 7efe5741f800 20 rados->read ofs=0 len=0 2024-06-04T16:12:47.482 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:47.480+0000 7efe5741f800 20 rados_obj.operate() r=0 bl.length=197 2024-06-04T16:12:47.482 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:47.480+0000 7efe5741f800 10 cache put: name=default.rgw.meta+root+error-at-commit-target-layout info.flags=0x11 2024-06-04T16:12:47.482 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:47.480+0000 7efe5741f800 10 adding default.rgw.meta+root+error-at-commit-target-layout to cache LRU end 2024-06-04T16:12:47.482 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:47.480+0000 7efe5741f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.24 : miss 2024-06-04T16:12:47.482 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:47.480+0000 7efe5741f800 20 rados->read ofs=0 len=0 2024-06-04T16:12:47.482 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:47.480+0000 7efe5741f800 20 rados_obj.operate() r=0 bl.length=443 2024-06-04T16:12:47.482 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:47.480+0000 7efe5741f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.24 info.flags=0x17 2024-06-04T16:12:47.483 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:47.480+0000 7efe5741f800 10 adding default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.24 to cache LRU end 2024-06-04T16:12:47.483 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:47.480+0000 7efe5741f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-06-04T16:12:47.483 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:47.480+0000 7efe5741f800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-06-04T16:12:47.483 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:47.480+0000 7efe5741f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.24 2024-06-04T16:12:47.483 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:47.481+0000 7efe5741f800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-06-04T16:12:47.488 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:47.487+0000 7efe5741f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.24 info.flags=0x17 2024-06-04T16:12:47.488 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:47.487+0000 7efe5741f800 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.24 to cache LRU end 2024-06-04T16:12:47.488 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:47.487+0000 7efe5741f800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-06-04T16:12:47.488 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:47.487+0000 7efe5741f800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.24, ofs0, ns] 2024-06-04T16:12:47.489 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:47.488+0000 7efd2bfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1078036791381 cookie 94444184479952 notifier 6636 bl.length()=923 2024-06-04T16:12:47.489 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:47.488+0000 7efd2bfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.24 info.flags=0x17 2024-06-04T16:12:47.489 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:47.488+0000 7efd2bfff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.24 to cache LRU end 2024-06-04T16:12:47.489 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:47.488+0000 7efd2bfff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-06-04T16:12:47.489 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:47.488+0000 7efe5741f800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.24]): orig_sources= new_sources= 2024-06-04T16:12:47.489 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:47.488+0000 7efe5741f800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.24]): potential sources added=[] removed=[] 2024-06-04T16:12:47.490 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:47.488+0000 7efe5741f800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.24]): orig_dests= new_dests= 2024-06-04T16:12:47.490 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:47.488+0000 7efe5741f800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.24]): potential dests added=[] removed=[] 2024-06-04T16:12:47.494 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:47.493+0000 7efe5741f800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.24.2.0 2024-06-04T16:12:47.494 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:47.493+0000 7efe5741f800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.24.2.0 2024-06-04T16:12:47.494 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:47.493+0000 7efe5741f800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.24.2.1 2024-06-04T16:12:47.494 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:47.493+0000 7efe5741f800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.24.2.1 2024-06-04T16:12:47.494 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:47.493+0000 7efe5741f800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.24.2.2 2024-06-04T16:12:47.494 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:47.493+0000 7efe5741f800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.24.2.2 2024-06-04T16:12:47.494 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:47.493+0000 7efe5741f800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.24.2.3 2024-06-04T16:12:47.494 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:47.493+0000 7efe5741f800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.24.2.3 2024-06-04T16:12:47.495 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:47.493+0000 7efe5741f800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.24.2.4 2024-06-04T16:12:47.495 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:47.493+0000 7efe5741f800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.24.2.4 2024-06-04T16:12:47.495 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:47.493+0000 7efe5741f800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.24.2.5 2024-06-04T16:12:47.495 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:47.493+0000 7efe5741f800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.24.2.5 2024-06-04T16:12:47.495 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:47.493+0000 7efe5741f800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.24.2.6 2024-06-04T16:12:47.495 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:47.493+0000 7efe5741f800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.24.2.6 2024-06-04T16:12:47.495 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:47.493+0000 7efe5741f800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.24.2.7 2024-06-04T16:12:47.495 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:47.493+0000 7efe5741f800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.24.2.7 2024-06-04T16:12:47.495 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:47.493+0000 7efe5741f800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.24.2.8 2024-06-04T16:12:47.495 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:47.493+0000 7efe5741f800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.24.2.8 2024-06-04T16:12:47.495 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:47.493+0000 7efe5741f800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.24.2.9 2024-06-04T16:12:47.495 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:47.493+0000 7efe5741f800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.24.2.9 2024-06-04T16:12:47.495 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:47.493+0000 7efe5741f800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.24.2.10 2024-06-04T16:12:47.496 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:47.493+0000 7efe5741f800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.24.2.10 2024-06-04T16:12:47.496 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:47.493+0000 7efe5741f800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.24.2.11 2024-06-04T16:12:47.496 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:47.493+0000 7efe5741f800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.24.2.11 2024-06-04T16:12:47.496 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:47.493+0000 7efe5741f800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.24.0 2024-06-04T16:12:47.496 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:47.493+0000 7efe5741f800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.24.1 2024-06-04T16:12:47.497 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:47.494+0000 7efe5741f800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.24.2 2024-06-04T16:12:47.497 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:47.494+0000 7efe5741f800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.24.3 2024-06-04T16:12:47.497 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:47.495+0000 7efe5741f800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.24.4 2024-06-04T16:12:47.497 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:47.495+0000 7efe5741f800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.24.5 2024-06-04T16:12:47.497 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:47.496+0000 7efe5741f800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.24.6 2024-06-04T16:12:47.497 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:47.496+0000 7efe5741f800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.24.7 2024-06-04T16:12:47.498 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:47.496+0000 7efe5741f800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.24.8 2024-06-04T16:12:47.498 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:47.497+0000 7efe5741f800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.24.9 2024-06-04T16:12:47.498 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:47.497+0000 7efe5741f800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.24.10 2024-06-04T16:12:47.502 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:47.500+0000 7efe5741f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.24 : hit (requested=0x17, cached=0x17) 2024-06-04T16:12:47.502 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:47.500+0000 7efe5741f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.24 2024-06-04T16:12:47.503 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:47.501+0000 7efe5741f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.24 info.flags=0x17 2024-06-04T16:12:47.503 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:47.501+0000 7efe5741f800 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.24 to cache LRU end 2024-06-04T16:12:47.503 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:47.501+0000 7efe5741f800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-06-04T16:12:47.503 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:47.501+0000 7efe5741f800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.24, ofs0, ns] 2024-06-04T16:12:47.503 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:47.502+0000 7efd2b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1078036791382 cookie 94444184479952 notifier 6636 bl.length()=891 2024-06-04T16:12:47.503 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:47.502+0000 7efd2b7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.24 info.flags=0x17 2024-06-04T16:12:47.503 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:47.502+0000 7efd2b7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.24 to cache LRU end 2024-06-04T16:12:47.503 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:47.502+0000 7efd2b7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-06-04T16:12:47.503 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:47.502+0000 7efe5741f800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.24]): orig_sources= new_sources= 2024-06-04T16:12:47.504 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:47.502+0000 7efe5741f800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.24]): potential sources added=[] removed=[] 2024-06-04T16:12:47.504 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:47.502+0000 7efe5741f800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.24]): orig_dests= new_dests= 2024-06-04T16:12:47.504 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:47.502+0000 7efe5741f800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.24]): potential dests added=[] removed=[] 2024-06-04T16:12:47.505 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:47.504+0000 7efe5741f800 1 execute INFO: reshard of bucket "error-at-commit-target-layout" completed successfully 2024-06-04T16:12:47.507 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:47.506+0000 7efd0afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-06-04T16:12:47.509 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:47.509+0000 7efe5741f800 20 remove_watcher() i=0 2024-06-04T16:12:47.509 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:47.509+0000 7efe5741f800 2 removed watcher, disabling cache 2024-06-04T16:12:47.510 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:47.510+0000 7efe5741f800 20 remove_watcher() i=1 2024-06-04T16:12:47.511 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:47.511+0000 7efe5741f800 20 remove_watcher() i=2 2024-06-04T16:12:47.512 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:47.512+0000 7efe5741f800 20 remove_watcher() i=3 2024-06-04T16:12:47.514 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:47.513+0000 7efe5741f800 20 remove_watcher() i=4 2024-06-04T16:12:47.514 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:47.514+0000 7efe5741f800 20 remove_watcher() i=5 2024-06-04T16:12:47.515 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:47.514+0000 7efe5741f800 20 remove_watcher() i=6 2024-06-04T16:12:47.516 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:47.515+0000 7efe5741f800 20 remove_watcher() i=7 2024-06-04T16:12:47.528 INFO:tasks.workunit.client.0.smithi144.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2024-06-04T16:12:47.556 INFO:tasks.workunit.client.0.smithi144.stderr:ignoring --setuser ceph since I am not root 2024-06-04T16:12:47.556 INFO:tasks.workunit.client.0.smithi144.stderr:ignoring --setgroup ceph since I am not root 2024-06-04T16:12:47.592 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:47.591+0000 7f054ae11800 20 rados->read ofs=0 len=0 2024-06-04T16:12:47.594 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:47.593+0000 7f054ae11800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:12:47.594 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:47.593+0000 7f054ae11800 20 realm 2024-06-04T16:12:47.594 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:47.593+0000 7f054ae11800 20 rados->read ofs=0 len=0 2024-06-04T16:12:47.594 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:47.593+0000 7f054ae11800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:12:47.594 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:47.593+0000 7f054ae11800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-06-04T16:12:47.594 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:47.593+0000 7f054ae11800 20 rados->read ofs=0 len=0 2024-06-04T16:12:47.594 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:47.593+0000 7f054ae11800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:12:47.595 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:47.593+0000 7f054ae11800 20 rados->read ofs=0 len=0 2024-06-04T16:12:47.595 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:47.594+0000 7f054ae11800 20 rados_obj.operate() r=0 bl.length=46 2024-06-04T16:12:47.595 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:47.594+0000 7f054ae11800 20 rados->read ofs=0 len=0 2024-06-04T16:12:47.595 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:47.595+0000 7f054ae11800 20 rados_obj.operate() r=0 bl.length=1139 2024-06-04T16:12:47.596 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:47.595+0000 7f054ae11800 20 searching for the correct realm 2024-06-04T16:12:47.597 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:47.597+0000 7f0546ba2640 0 -- 172.21.15.144:0/2155671431 >> [v2:172.21.15.144:6800/1453747520,v1:172.21.15.144:6801/1453747520] conn(0x7f0530040060 msgr2=0x7f0530069330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-06-04T16:12:47.802 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:47.802+0000 7f0546ba2640 0 -- 172.21.15.144:0/2155671431 >> [v2:172.21.15.144:6824/166159729,v1:172.21.15.144:6825/166159729] conn(0x5580aa87dfc0 msgr2=0x5580aa8803b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-06-04T16:12:47.807 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:47.806+0000 7f054ae11800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-06-04T16:12:47.807 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:47.806+0000 7f054ae11800 20 RGWRados::pool_iterate: got zone_info.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767 2024-06-04T16:12:47.807 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:47.806+0000 7f054ae11800 20 RGWRados::pool_iterate: got default.zone. 2024-06-04T16:12:47.807 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:47.806+0000 7f054ae11800 20 RGWRados::pool_iterate: got zonegroup_info.abb22408-c332-4e28-8f7a-ff254ea2fed2 2024-06-04T16:12:47.808 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:47.806+0000 7f054ae11800 20 RGWRados::pool_iterate: got zone_names.default 2024-06-04T16:12:47.808 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:47.806+0000 7f054ae11800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-06-04T16:12:47.808 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:47.806+0000 7f054ae11800 20 rados->read ofs=0 len=0 2024-06-04T16:12:47.808 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:47.807+0000 7f054ae11800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:12:47.808 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:47.807+0000 7f054ae11800 20 rados->read ofs=0 len=0 2024-06-04T16:12:47.809 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:47.807+0000 7f054ae11800 20 rados_obj.operate() r=0 bl.length=46 2024-06-04T16:12:47.809 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:47.807+0000 7f054ae11800 20 rados->read ofs=0 len=0 2024-06-04T16:12:47.809 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:47.807+0000 7f054ae11800 20 rados_obj.operate() r=0 bl.length=470 2024-06-04T16:12:47.809 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:47.807+0000 7f054ae11800 20 zone default found 2024-06-04T16:12:47.809 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:47.807+0000 7f054ae11800 4 Realm: () 2024-06-04T16:12:47.809 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:47.807+0000 7f054ae11800 4 ZoneGroup: default (abb22408-c332-4e28-8f7a-ff254ea2fed2) 2024-06-04T16:12:47.809 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:47.807+0000 7f054ae11800 4 Zone: default (be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767) 2024-06-04T16:12:47.810 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:47.807+0000 7f054ae11800 10 cannot find current period zonegroup using local zonegroup configuration 2024-06-04T16:12:47.810 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:47.807+0000 7f054ae11800 20 zonegroup default 2024-06-04T16:12:47.810 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:47.807+0000 7f054ae11800 20 rados->read ofs=0 len=0 2024-06-04T16:12:47.810 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:47.807+0000 7f054ae11800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:12:47.810 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:47.807+0000 7f054ae11800 20 rados->read ofs=0 len=0 2024-06-04T16:12:47.810 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:47.808+0000 7f054ae11800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:12:47.810 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:47.808+0000 7f054ae11800 20 rados->read ofs=0 len=0 2024-06-04T16:12:47.810 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:47.808+0000 7f054ae11800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:12:47.810 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:47.808+0000 7f054ae11800 20 started sync module instance, tier type = 2024-06-04T16:12:47.810 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:47.808+0000 7f054ae11800 20 started zone id=be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767 (name=default) with tier type = 2024-06-04T16:12:47.817 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:47.816+0000 7f054ae11800 20 add_watcher() i=0 2024-06-04T16:12:47.817 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:47.816+0000 7f054ae11800 20 add_watcher() i=1 2024-06-04T16:12:47.817 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:47.816+0000 7f054ae11800 20 add_watcher() i=2 2024-06-04T16:12:47.817 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:47.816+0000 7f054ae11800 20 add_watcher() i=3 2024-06-04T16:12:47.818 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:47.816+0000 7f054ae11800 20 add_watcher() i=4 2024-06-04T16:12:47.818 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:47.816+0000 7f054ae11800 20 add_watcher() i=5 2024-06-04T16:12:47.818 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:47.816+0000 7f054ae11800 20 add_watcher() i=6 2024-06-04T16:12:47.818 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:47.817+0000 7f054ae11800 20 add_watcher() i=7 2024-06-04T16:12:47.818 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:47.817+0000 7f054ae11800 2 all 8 watchers are set, enabling cache 2024-06-04T16:12:47.820 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:47.819+0000 7f03fcfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-06-04T16:12:47.821 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:47.820+0000 7f054ae11800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-06-04T16:12:47.821 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:47.820+0000 7f054ae11800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-06-04T16:12:47.821 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:47.820+0000 7f054ae11800 5 note: GC not initialized 2024-06-04T16:12:47.821 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:47.820+0000 7f03777fe640 20 reqs_thread_entry: start 2024-06-04T16:12:47.821 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:47.820+0000 7f054ae11800 20 init_complete bucket index max shards: 11 2024-06-04T16:12:47.821 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:47.820+0000 7f054ae11800 20 Filter name: none 2024-06-04T16:12:47.822 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:47.820+0000 7f03757fa640 20 reqs_thread_entry: start 2024-06-04T16:12:47.822 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:47.820+0000 7f054ae11800 20 rados->read ofs=0 len=0 2024-06-04T16:12:47.823 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:47.821+0000 7f054ae11800 20 rados_obj.operate() r=0 bl.length=197 2024-06-04T16:12:47.823 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:47.821+0000 7f054ae11800 20 rados->read ofs=0 len=0 2024-06-04T16:12:47.823 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:47.821+0000 7f054ae11800 20 rados_obj.operate() r=0 bl.length=411 2024-06-04T16:12:47.823 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:47.821+0000 7f054ae11800 20 couldn't put binfo cache entry, might have raced with data changes 2024-06-04T16:12:47.823 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:47.821+0000 7f054ae11800 20 rados->read ofs=0 len=0 2024-06-04T16:12:47.823 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:47.822+0000 7f054ae11800 20 rados_obj.operate() r=0 bl.length=197 2024-06-04T16:12:47.823 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:47.822+0000 7f054ae11800 20 rados->read ofs=0 len=0 2024-06-04T16:12:47.823 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:47.822+0000 7f054ae11800 20 rados_obj.operate() r=0 bl.length=411 2024-06-04T16:12:47.823 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:47.822+0000 7f054ae11800 20 couldn't put binfo cache entry, might have raced with data changes 2024-06-04T16:12:47.824 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:47.824+0000 7f03fcfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-06-04T16:12:47.826 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:47.826+0000 7f054ae11800 20 remove_watcher() i=0 2024-06-04T16:12:47.827 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:47.826+0000 7f054ae11800 2 removed watcher, disabling cache 2024-06-04T16:12:47.827 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:47.827+0000 7f054ae11800 20 remove_watcher() i=1 2024-06-04T16:12:47.829 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:47.828+0000 7f054ae11800 20 remove_watcher() i=2 2024-06-04T16:12:47.830 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:47.829+0000 7f054ae11800 20 remove_watcher() i=3 2024-06-04T16:12:47.831 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:47.830+0000 7f054ae11800 20 remove_watcher() i=4 2024-06-04T16:12:47.832 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:47.831+0000 7f054ae11800 20 remove_watcher() i=5 2024-06-04T16:12:47.833 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:47.832+0000 7f054ae11800 20 remove_watcher() i=6 2024-06-04T16:12:47.834 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:47.833+0000 7f054ae11800 20 remove_watcher() i=7 2024-06-04T16:12:47.845 INFO:tasks.workunit.client.0.smithi144.stderr: 2024-06-04T16:12:47.845 INFO:tasks.workunit.client.0.smithi144.stderr:BUCKET_STATS: 2024-06-04T16:12:47.845 INFO:tasks.workunit.client.0.smithi144.stderr:bucket: error-at-commit-target-layout id: be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.24 num_objects: 19 size_kb: 1 num_shards: 12 2024-06-04T16:12:47.845 INFO:tasks.workunit.client.0.smithi144.stderr: 2024-06-04T16:12:47.847 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:12:47.847 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:12:47.850 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:12:47.851 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:12:47.893 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:12:47.893 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:12:47.919 INFO:tasks.workunit.client.0.smithi144.stderr:TEST: reshard bucket with ECANCELED injected at commit_target_layout 2024-06-04T16:12:47.919 INFO:tasks.workunit.client.0.smithi144.stderr: 2024-06-04T16:12:47.920 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:12:47.920 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:12:47.932 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:12:47.932 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:12:47.974 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:12:47.975 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:12:47.981 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:12:47.981 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:12:47.987 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:12:47.987 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:12:47.993 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:12:47.993 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:12:48.001 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:12:48.002 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:12:48.007 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:12:48.007 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:12:48.013 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:12:48.013 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:12:48.019 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:12:48.019 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:12:48.025 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:12:48.025 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:12:48.030 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:12:48.030 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:12:48.036 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:12:48.036 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:12:48.042 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:12:48.043 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:12:48.048 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:12:48.049 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:12:48.054 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:12:48.055 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:12:48.062 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:12:48.062 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:12:48.066 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:12:48.066 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:12:48.072 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:12:48.072 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:12:48.078 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:12:48.078 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:12:48.084 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:12:48.084 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:12:48.091 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:12:48.091 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:12:48.130 INFO:tasks.workunit.client.0.smithi144.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2024-06-04T16:12:48.157 INFO:tasks.workunit.client.0.smithi144.stderr:ignoring --setuser ceph since I am not root 2024-06-04T16:12:48.158 INFO:tasks.workunit.client.0.smithi144.stderr:ignoring --setgroup ceph since I am not root 2024-06-04T16:12:48.388 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:48.387+0000 7f563cbfa640 0 --2- 172.21.15.144:0/4104442656 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x55d861450f20 0x55d861482850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2024-06-04T16:12:48.395 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:48.395+0000 7f563f906800 20 rados->read ofs=0 len=0 2024-06-04T16:12:48.397 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:48.396+0000 7f563f906800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:12:48.398 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:48.396+0000 7f563f906800 20 realm 2024-06-04T16:12:48.398 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:48.396+0000 7f563f906800 20 rados->read ofs=0 len=0 2024-06-04T16:12:48.398 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:48.396+0000 7f563f906800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:12:48.398 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:48.396+0000 7f563f906800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-06-04T16:12:48.398 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:48.396+0000 7f563f906800 20 rados->read ofs=0 len=0 2024-06-04T16:12:48.398 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:48.397+0000 7f563f906800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:12:48.398 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:48.397+0000 7f563f906800 20 rados->read ofs=0 len=0 2024-06-04T16:12:48.399 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:48.397+0000 7f563f906800 20 rados_obj.operate() r=0 bl.length=46 2024-06-04T16:12:48.399 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:48.397+0000 7f563f906800 20 rados->read ofs=0 len=0 2024-06-04T16:12:48.399 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:48.398+0000 7f563f906800 20 rados_obj.operate() r=0 bl.length=1139 2024-06-04T16:12:48.399 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:48.398+0000 7f563f906800 20 searching for the correct realm 2024-06-04T16:12:48.400 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:48.399+0000 7f563cbfa640 0 -- 172.21.15.144:0/3977638313 >> [v2:172.21.15.144:6808/86532035,v1:172.21.15.144:6809/86532035] conn(0x7f5630071bc0 msgr2=0x7f5630081920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-06-04T16:12:48.604 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:48.603+0000 7f563d3fb640 0 -- 172.21.15.144:0/3977638313 >> [v2:172.21.15.177:6824/800067290,v1:172.21.15.177:6825/800067290] conn(0x55d8614d52a0 msgr2=0x55d8614d7700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-06-04T16:12:48.611 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:48.609+0000 7f563f906800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-06-04T16:12:48.612 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:48.609+0000 7f563f906800 20 RGWRados::pool_iterate: got zone_info.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767 2024-06-04T16:12:48.612 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:48.609+0000 7f563f906800 20 RGWRados::pool_iterate: got default.zone. 2024-06-04T16:12:48.612 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:48.609+0000 7f563f906800 20 RGWRados::pool_iterate: got zonegroup_info.abb22408-c332-4e28-8f7a-ff254ea2fed2 2024-06-04T16:12:48.612 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:48.609+0000 7f563f906800 20 RGWRados::pool_iterate: got zone_names.default 2024-06-04T16:12:48.612 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:48.609+0000 7f563f906800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-06-04T16:12:48.612 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:48.609+0000 7f563f906800 20 rados->read ofs=0 len=0 2024-06-04T16:12:48.612 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:48.609+0000 7f563f906800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:12:48.612 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:48.609+0000 7f563f906800 20 rados->read ofs=0 len=0 2024-06-04T16:12:48.612 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:48.609+0000 7f563f906800 20 rados_obj.operate() r=0 bl.length=46 2024-06-04T16:12:48.612 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:48.609+0000 7f563f906800 20 rados->read ofs=0 len=0 2024-06-04T16:12:48.612 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:48.610+0000 7f563f906800 20 rados_obj.operate() r=0 bl.length=470 2024-06-04T16:12:48.613 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:48.610+0000 7f563f906800 20 zone default found 2024-06-04T16:12:48.613 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:48.610+0000 7f563f906800 4 Realm: () 2024-06-04T16:12:48.613 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:48.610+0000 7f563f906800 4 ZoneGroup: default (abb22408-c332-4e28-8f7a-ff254ea2fed2) 2024-06-04T16:12:48.613 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:48.610+0000 7f563f906800 4 Zone: default (be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767) 2024-06-04T16:12:48.613 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:48.610+0000 7f563f906800 10 cannot find current period zonegroup using local zonegroup configuration 2024-06-04T16:12:48.613 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:48.610+0000 7f563f906800 20 zonegroup default 2024-06-04T16:12:48.613 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:48.610+0000 7f563f906800 20 rados->read ofs=0 len=0 2024-06-04T16:12:48.613 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:48.610+0000 7f563f906800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:12:48.613 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:48.610+0000 7f563f906800 20 rados->read ofs=0 len=0 2024-06-04T16:12:48.613 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:48.610+0000 7f563f906800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:12:48.613 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:48.610+0000 7f563f906800 20 rados->read ofs=0 len=0 2024-06-04T16:12:48.614 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:48.611+0000 7f563f906800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:12:48.614 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:48.611+0000 7f563f906800 20 started sync module instance, tier type = 2024-06-04T16:12:48.614 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:48.611+0000 7f563f906800 20 started zone id=be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767 (name=default) with tier type = 2024-06-04T16:12:48.620 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:48.619+0000 7f563f906800 20 add_watcher() i=0 2024-06-04T16:12:48.620 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:48.619+0000 7f563f906800 20 add_watcher() i=1 2024-06-04T16:12:48.620 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:48.619+0000 7f563f906800 20 add_watcher() i=2 2024-06-04T16:12:48.620 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:48.619+0000 7f563f906800 20 add_watcher() i=3 2024-06-04T16:12:48.620 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:48.619+0000 7f563f906800 20 add_watcher() i=4 2024-06-04T16:12:48.620 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:48.619+0000 7f563f906800 20 add_watcher() i=5 2024-06-04T16:12:48.621 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:48.619+0000 7f563f906800 20 add_watcher() i=6 2024-06-04T16:12:48.621 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:48.620+0000 7f563f906800 20 add_watcher() i=7 2024-06-04T16:12:48.621 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:48.620+0000 7f563f906800 2 all 8 watchers are set, enabling cache 2024-06-04T16:12:48.624 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:48.622+0000 7f54f37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-06-04T16:12:48.624 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:48.622+0000 7f563f906800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-06-04T16:12:48.624 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:48.622+0000 7f563f906800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-06-04T16:12:48.624 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:48.622+0000 7f563f906800 5 note: GC not initialized 2024-06-04T16:12:48.624 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:48.622+0000 7f54f27e4640 20 reqs_thread_entry: start 2024-06-04T16:12:48.624 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:48.622+0000 7f563f906800 20 init_complete bucket index max shards: 11 2024-06-04T16:12:48.624 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:48.623+0000 7f563f906800 20 Filter name: none 2024-06-04T16:12:48.624 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:48.623+0000 7f5463fff640 20 reqs_thread_entry: start 2024-06-04T16:12:48.624 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:48.623+0000 7f563f906800 20 rados->read ofs=0 len=0 2024-06-04T16:12:48.625 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:48.623+0000 7f563f906800 20 rados_obj.operate() r=0 bl.length=197 2024-06-04T16:12:48.625 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:48.623+0000 7f563f906800 20 rados->read ofs=0 len=0 2024-06-04T16:12:48.626 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:48.624+0000 7f563f906800 20 rados_obj.operate() r=0 bl.length=411 2024-06-04T16:12:48.626 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:48.624+0000 7f563f906800 20 couldn't put binfo cache entry, might have raced with data changes 2024-06-04T16:12:48.626 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:48.624+0000 7f563f906800 20 rados->read ofs=0 len=0 2024-06-04T16:12:48.626 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:48.624+0000 7f563f906800 20 rados_obj.operate() r=0 bl.length=197 2024-06-04T16:12:48.626 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:48.624+0000 7f563f906800 20 rados->read ofs=0 len=0 2024-06-04T16:12:48.626 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:48.625+0000 7f563f906800 20 rados_obj.operate() r=0 bl.length=411 2024-06-04T16:12:48.626 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:48.625+0000 7f563f906800 20 couldn't put binfo cache entry, might have raced with data changes 2024-06-04T16:12:48.627 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:48.626+0000 7f54f37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-06-04T16:12:48.629 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:48.628+0000 7f563f906800 20 remove_watcher() i=0 2024-06-04T16:12:48.629 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:48.628+0000 7f563f906800 2 removed watcher, disabling cache 2024-06-04T16:12:48.630 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:48.629+0000 7f563f906800 20 remove_watcher() i=1 2024-06-04T16:12:48.631 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:48.630+0000 7f563f906800 20 remove_watcher() i=2 2024-06-04T16:12:48.632 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:48.631+0000 7f563f906800 20 remove_watcher() i=3 2024-06-04T16:12:48.633 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:48.632+0000 7f563f906800 20 remove_watcher() i=4 2024-06-04T16:12:48.633 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:48.633+0000 7f563f906800 20 remove_watcher() i=5 2024-06-04T16:12:48.634 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:48.634+0000 7f563f906800 20 remove_watcher() i=6 2024-06-04T16:12:48.635 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:48.635+0000 7f563f906800 20 remove_watcher() i=7 2024-06-04T16:12:48.646 INFO:tasks.workunit.client.0.smithi144.stderr: 2024-06-04T16:12:48.646 INFO:tasks.workunit.client.0.smithi144.stderr:BUCKET_STATS: 2024-06-04T16:12:48.646 INFO:tasks.workunit.client.0.smithi144.stderr:bucket: error-at-commit-target-layout id: be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.25 num_objects: 20 size_kb: 1 num_shards: 11 2024-06-04T16:12:48.646 INFO:tasks.workunit.client.0.smithi144.stderr: 2024-06-04T16:12:48.648 INFO:tasks.workunit.client.0.smithi144.stderr:radosgw-admin bucket reshard --bucket error-at-commit-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at commit_target_layout --inject-error-code 125 2024-06-04T16:12:48.683 INFO:tasks.workunit.client.0.smithi144.stderr:ignoring --setuser ceph since I am not root 2024-06-04T16:12:48.683 INFO:tasks.workunit.client.0.smithi144.stderr:ignoring --setgroup ceph since I am not root 2024-06-04T16:12:48.720 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:48.719+0000 7f601080e800 20 rados->read ofs=0 len=0 2024-06-04T16:12:48.722 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:48.721+0000 7f601080e800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:12:48.722 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:48.721+0000 7f601080e800 20 realm 2024-06-04T16:12:48.722 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:48.721+0000 7f601080e800 20 rados->read ofs=0 len=0 2024-06-04T16:12:48.722 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:48.721+0000 7f601080e800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:12:48.722 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:48.721+0000 7f601080e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-06-04T16:12:48.722 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:48.721+0000 7f601080e800 20 rados->read ofs=0 len=0 2024-06-04T16:12:48.722 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:48.721+0000 7f601080e800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:12:48.723 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:48.721+0000 7f601080e800 20 rados->read ofs=0 len=0 2024-06-04T16:12:48.723 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:48.722+0000 7f601080e800 20 rados_obj.operate() r=0 bl.length=46 2024-06-04T16:12:48.723 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:48.722+0000 7f601080e800 20 rados->read ofs=0 len=0 2024-06-04T16:12:48.723 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:48.722+0000 7f601080e800 20 rados_obj.operate() r=0 bl.length=1139 2024-06-04T16:12:48.723 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:48.722+0000 7f601080e800 20 searching for the correct realm 2024-06-04T16:12:48.724 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:48.724+0000 7f600e303640 0 -- 172.21.15.144:0/3343037516 >> [v2:172.21.15.177:6824/800067290,v1:172.21.15.177:6825/800067290] conn(0x5616c5ca7290 msgr2=0x5616c5ca9700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-06-04T16:12:48.728 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:48.727+0000 7f6007fff640 0 -- 172.21.15.144:0/3343037516 >> [v2:172.21.15.177:6808/2618477608,v1:172.21.15.177:6809/2618477608] conn(0x7f5ff8051620 msgr2=0x7f5ff8096040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-06-04T16:12:48.935 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:48.933+0000 7f601080e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-06-04T16:12:48.936 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:48.933+0000 7f601080e800 20 RGWRados::pool_iterate: got zone_info.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767 2024-06-04T16:12:48.936 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:48.933+0000 7f601080e800 20 RGWRados::pool_iterate: got default.zone. 2024-06-04T16:12:48.936 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:48.933+0000 7f601080e800 20 RGWRados::pool_iterate: got zonegroup_info.abb22408-c332-4e28-8f7a-ff254ea2fed2 2024-06-04T16:12:48.936 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:48.933+0000 7f601080e800 20 RGWRados::pool_iterate: got zone_names.default 2024-06-04T16:12:48.936 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:48.933+0000 7f601080e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-06-04T16:12:48.936 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:48.933+0000 7f601080e800 20 rados->read ofs=0 len=0 2024-06-04T16:12:48.936 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:48.934+0000 7f601080e800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:12:48.936 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:48.934+0000 7f601080e800 20 rados->read ofs=0 len=0 2024-06-04T16:12:48.936 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:48.934+0000 7f601080e800 20 rados_obj.operate() r=0 bl.length=46 2024-06-04T16:12:48.936 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:48.934+0000 7f601080e800 20 rados->read ofs=0 len=0 2024-06-04T16:12:48.936 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:48.935+0000 7f601080e800 20 rados_obj.operate() r=0 bl.length=470 2024-06-04T16:12:48.936 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:48.935+0000 7f601080e800 20 zone default found 2024-06-04T16:12:48.936 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:48.935+0000 7f601080e800 4 Realm: () 2024-06-04T16:12:48.937 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:48.935+0000 7f601080e800 4 ZoneGroup: default (abb22408-c332-4e28-8f7a-ff254ea2fed2) 2024-06-04T16:12:48.937 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:48.935+0000 7f601080e800 4 Zone: default (be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767) 2024-06-04T16:12:48.937 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:48.935+0000 7f601080e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-06-04T16:12:48.937 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:48.935+0000 7f601080e800 20 zonegroup default 2024-06-04T16:12:48.937 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:48.935+0000 7f601080e800 20 rados->read ofs=0 len=0 2024-06-04T16:12:48.937 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:48.935+0000 7f601080e800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:12:48.937 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:48.935+0000 7f601080e800 20 rados->read ofs=0 len=0 2024-06-04T16:12:48.938 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:48.935+0000 7f601080e800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:12:48.938 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:48.935+0000 7f601080e800 20 rados->read ofs=0 len=0 2024-06-04T16:12:48.938 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:48.935+0000 7f601080e800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:12:48.938 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:48.935+0000 7f601080e800 20 started sync module instance, tier type = 2024-06-04T16:12:48.938 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:48.935+0000 7f601080e800 20 started zone id=be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767 (name=default) with tier type = 2024-06-04T16:12:48.945 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:48.944+0000 7f601080e800 20 add_watcher() i=0 2024-06-04T16:12:48.945 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:48.944+0000 7f601080e800 20 add_watcher() i=1 2024-06-04T16:12:48.945 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:48.944+0000 7f601080e800 20 add_watcher() i=2 2024-06-04T16:12:48.945 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:48.944+0000 7f601080e800 20 add_watcher() i=3 2024-06-04T16:12:48.945 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:48.944+0000 7f601080e800 20 add_watcher() i=4 2024-06-04T16:12:48.945 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:48.944+0000 7f601080e800 20 add_watcher() i=5 2024-06-04T16:12:48.945 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:48.944+0000 7f601080e800 20 add_watcher() i=6 2024-06-04T16:12:48.946 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:48.945+0000 7f601080e800 20 add_watcher() i=7 2024-06-04T16:12:48.946 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:48.945+0000 7f601080e800 2 all 8 watchers are set, enabling cache 2024-06-04T16:12:48.948 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:48.947+0000 7f5ec4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-06-04T16:12:48.948 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:48.947+0000 7f601080e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-06-04T16:12:48.948 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:48.947+0000 7f601080e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-06-04T16:12:48.948 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:48.947+0000 7f601080e800 5 note: GC not initialized 2024-06-04T16:12:48.949 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:48.947+0000 7f5e3f7fe640 20 reqs_thread_entry: start 2024-06-04T16:12:48.949 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:48.947+0000 7f601080e800 20 init_complete bucket index max shards: 11 2024-06-04T16:12:48.949 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:48.947+0000 7f601080e800 20 Filter name: none 2024-06-04T16:12:48.949 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:48.947+0000 7f5e3d7fa640 20 reqs_thread_entry: start 2024-06-04T16:12:48.949 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:48.947+0000 7f601080e800 10 cache get: name=default.rgw.meta+root+error-at-commit-target-layout : miss 2024-06-04T16:12:48.949 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:48.947+0000 7f601080e800 20 rados->read ofs=0 len=0 2024-06-04T16:12:48.949 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:48.948+0000 7f601080e800 20 rados_obj.operate() r=0 bl.length=197 2024-06-04T16:12:48.950 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:48.948+0000 7f601080e800 10 cache put: name=default.rgw.meta+root+error-at-commit-target-layout info.flags=0x11 2024-06-04T16:12:48.950 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:48.948+0000 7f601080e800 10 adding default.rgw.meta+root+error-at-commit-target-layout to cache LRU end 2024-06-04T16:12:48.950 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:48.948+0000 7f601080e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.25 : miss 2024-06-04T16:12:48.950 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:48.948+0000 7f601080e800 20 rados->read ofs=0 len=0 2024-06-04T16:12:48.950 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:48.948+0000 7f601080e800 20 rados_obj.operate() r=0 bl.length=411 2024-06-04T16:12:48.950 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:48.948+0000 7f601080e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.25 info.flags=0x17 2024-06-04T16:12:48.950 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:48.948+0000 7f601080e800 10 adding default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.25 to cache LRU end 2024-06-04T16:12:48.950 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:48.948+0000 7f601080e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-06-04T16:12:48.950 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:48.948+0000 7f601080e800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-06-04T16:12:48.950 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:48.948+0000 7f601080e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.25 2024-06-04T16:12:48.954 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:48.953+0000 7f601080e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.25 info.flags=0x17 2024-06-04T16:12:48.954 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:48.953+0000 7f601080e800 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.25 to cache LRU end 2024-06-04T16:12:48.954 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:48.953+0000 7f601080e800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-06-04T16:12:48.955 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:48.953+0000 7f601080e800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.25, ofs0, ns] 2024-06-04T16:12:48.955 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:48.953+0000 7f5ef1ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1078036791385 cookie 94655807722224 notifier 6341 bl.length()=923 2024-06-04T16:12:48.955 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:48.953+0000 7f5ef1ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.25 info.flags=0x17 2024-06-04T16:12:48.955 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:48.953+0000 7f5ef1ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.25 to cache LRU end 2024-06-04T16:12:48.955 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:48.953+0000 7f5ef1ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-06-04T16:12:48.955 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:48.953+0000 7f601080e800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.25]): orig_sources= new_sources= 2024-06-04T16:12:48.955 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:48.953+0000 7f601080e800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.25]): potential sources added=[] removed=[] 2024-06-04T16:12:48.955 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:48.953+0000 7f601080e800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.25]): orig_dests= new_dests= 2024-06-04T16:12:48.955 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:48.953+0000 7f601080e800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.25]): potential dests added=[] removed=[] 2024-06-04T16:12:48.957 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:48.956+0000 7f601080e800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.25.1.0 2024-06-04T16:12:48.957 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:48.956+0000 7f601080e800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.25.1.0 2024-06-04T16:12:48.957 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:48.956+0000 7f601080e800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.25.1.1 2024-06-04T16:12:48.957 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:48.956+0000 7f601080e800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.25.1.1 2024-06-04T16:12:48.957 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:48.956+0000 7f601080e800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.25.1.2 2024-06-04T16:12:48.957 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:48.956+0000 7f601080e800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.25.1.2 2024-06-04T16:12:48.957 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:48.956+0000 7f601080e800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.25.1.3 2024-06-04T16:12:48.957 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:48.956+0000 7f601080e800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.25.1.3 2024-06-04T16:12:48.958 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:48.956+0000 7f601080e800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.25.1.4 2024-06-04T16:12:48.958 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:48.956+0000 7f601080e800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.25.1.4 2024-06-04T16:12:48.958 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:48.956+0000 7f601080e800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.25.1.5 2024-06-04T16:12:48.958 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:48.956+0000 7f601080e800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.25.1.5 2024-06-04T16:12:48.958 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:48.956+0000 7f601080e800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.25.1.6 2024-06-04T16:12:48.958 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:48.956+0000 7f601080e800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.25.1.6 2024-06-04T16:12:48.958 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:48.956+0000 7f601080e800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.25.1.7 2024-06-04T16:12:48.958 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:48.956+0000 7f601080e800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.25.1.7 2024-06-04T16:12:48.958 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:48.956+0000 7f601080e800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.25.1.8 2024-06-04T16:12:48.958 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:48.956+0000 7f601080e800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.25.1.8 2024-06-04T16:12:48.958 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:48.956+0000 7f601080e800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.25.1.9 2024-06-04T16:12:48.958 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:48.956+0000 7f601080e800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.25.1.9 2024-06-04T16:12:48.958 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:48.956+0000 7f601080e800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.25.1.10 2024-06-04T16:12:48.959 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:48.956+0000 7f601080e800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.25.1.10 2024-06-04T16:12:48.959 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:48.956+0000 7f601080e800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.25.1.11 2024-06-04T16:12:48.959 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:48.956+0000 7f601080e800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.25.1.11 2024-06-04T16:12:48.959 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:48.956+0000 7f601080e800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.25.0 2024-06-04T16:12:48.959 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:48.956+0000 7f601080e800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.25.1 2024-06-04T16:12:48.960 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:48.957+0000 7f601080e800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.25.2 2024-06-04T16:12:48.960 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:48.957+0000 7f601080e800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.25.3 2024-06-04T16:12:48.960 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:48.958+0000 7f601080e800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.25.4 2024-06-04T16:12:48.960 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:48.958+0000 7f601080e800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.25.5 2024-06-04T16:12:48.960 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:48.958+0000 7f601080e800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.25.6 2024-06-04T16:12:48.960 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:48.959+0000 7f601080e800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.25.7 2024-06-04T16:12:48.960 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:48.959+0000 7f601080e800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.25.8 2024-06-04T16:12:48.961 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:48.960+0000 7f601080e800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.25.9 2024-06-04T16:12:48.961 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:48.960+0000 7f601080e800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.25.10 2024-06-04T16:12:48.963 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:48.963+0000 7f601080e800 -1 Injecting error=-125 at location=commit_target_layout 2024-06-04T16:12:48.963 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:48.963+0000 7f601080e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.25 : hit (requested=0x17, cached=0x17) 2024-06-04T16:12:48.964 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:48.963+0000 7f601080e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.25 2024-06-04T16:12:48.964 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:48.964+0000 7f601080e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.25 info.flags=0x17 2024-06-04T16:12:48.965 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:48.964+0000 7f601080e800 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.25 to cache LRU end 2024-06-04T16:12:48.965 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:48.964+0000 7f601080e800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-06-04T16:12:48.965 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:48.964+0000 7f601080e800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.25, ofs0, ns] 2024-06-04T16:12:48.965 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:48.964+0000 7f5ef17fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1078036791386 cookie 94655807722224 notifier 6341 bl.length()=891 2024-06-04T16:12:48.965 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:48.964+0000 7f5ef17fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.25 info.flags=0x17 2024-06-04T16:12:48.965 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:48.964+0000 7f5ef17fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.25 to cache LRU end 2024-06-04T16:12:48.966 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:48.964+0000 7f5ef17fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-06-04T16:12:48.966 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:48.965+0000 7f601080e800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.25]): orig_sources= new_sources= 2024-06-04T16:12:48.966 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:48.965+0000 7f601080e800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.25]): potential sources added=[] removed=[] 2024-06-04T16:12:48.966 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:48.965+0000 7f601080e800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.25]): orig_dests= new_dests= 2024-06-04T16:12:48.966 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:48.965+0000 7f601080e800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.25]): potential dests added=[] removed=[] 2024-06-04T16:12:48.968 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:48.967+0000 7f601080e800 1 execute INFO: reshard of bucket "error-at-commit-target-layout" completed successfully 2024-06-04T16:12:48.970 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:48.969+0000 7f5ec4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-06-04T16:12:48.972 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:48.972+0000 7f601080e800 20 remove_watcher() i=0 2024-06-04T16:12:48.972 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:48.972+0000 7f601080e800 2 removed watcher, disabling cache 2024-06-04T16:12:48.973 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:48.972+0000 7f601080e800 20 remove_watcher() i=1 2024-06-04T16:12:48.974 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:48.973+0000 7f601080e800 20 remove_watcher() i=2 2024-06-04T16:12:48.975 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:48.974+0000 7f601080e800 20 remove_watcher() i=3 2024-06-04T16:12:48.976 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:48.975+0000 7f601080e800 20 remove_watcher() i=4 2024-06-04T16:12:48.977 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:48.976+0000 7f601080e800 20 remove_watcher() i=5 2024-06-04T16:12:48.978 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:48.977+0000 7f601080e800 20 remove_watcher() i=6 2024-06-04T16:12:48.979 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:48.978+0000 7f601080e800 20 remove_watcher() i=7 2024-06-04T16:12:48.991 INFO:tasks.workunit.client.0.smithi144.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2024-06-04T16:12:49.019 INFO:tasks.workunit.client.0.smithi144.stderr:ignoring --setuser ceph since I am not root 2024-06-04T16:12:49.019 INFO:tasks.workunit.client.0.smithi144.stderr:ignoring --setgroup ceph since I am not root 2024-06-04T16:12:49.055 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:49.054+0000 7efc9bb42800 20 rados->read ofs=0 len=0 2024-06-04T16:12:49.057 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:49.056+0000 7efc9bb42800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:12:49.057 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:49.056+0000 7efc9bb42800 20 realm 2024-06-04T16:12:49.057 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:49.056+0000 7efc9bb42800 20 rados->read ofs=0 len=0 2024-06-04T16:12:49.057 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:49.056+0000 7efc9bb42800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:12:49.057 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:49.056+0000 7efc9bb42800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-06-04T16:12:49.057 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:49.056+0000 7efc9bb42800 20 rados->read ofs=0 len=0 2024-06-04T16:12:49.057 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:49.056+0000 7efc9bb42800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:12:49.058 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:49.056+0000 7efc9bb42800 20 rados->read ofs=0 len=0 2024-06-04T16:12:49.058 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:49.057+0000 7efc9bb42800 20 rados_obj.operate() r=0 bl.length=46 2024-06-04T16:12:49.058 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:49.057+0000 7efc9bb42800 20 rados->read ofs=0 len=0 2024-06-04T16:12:49.058 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:49.057+0000 7efc9bb42800 20 rados_obj.operate() r=0 bl.length=1139 2024-06-04T16:12:49.058 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:49.057+0000 7efc9bb42800 20 searching for the correct realm 2024-06-04T16:12:49.060 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:49.059+0000 7efc90e36640 0 -- 172.21.15.144:0/1423533367 >> [v2:172.21.15.144:6816/2358575268,v1:172.21.15.144:6817/2358575268] conn(0x562eb0a76860 msgr2=0x562eb0a78c50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-06-04T16:12:49.063 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:49.063+0000 7efc90e36640 0 -- 172.21.15.144:0/1423533367 >> [v2:172.21.15.177:6808/2618477608,v1:172.21.15.177:6809/2618477608] conn(0x7efc8408abf0 msgr2=0x7efc8403a970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-06-04T16:12:49.271 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:49.269+0000 7efc9bb42800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-06-04T16:12:49.271 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:49.269+0000 7efc9bb42800 20 RGWRados::pool_iterate: got zone_info.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767 2024-06-04T16:12:49.271 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:49.269+0000 7efc9bb42800 20 RGWRados::pool_iterate: got default.zone. 2024-06-04T16:12:49.271 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:49.269+0000 7efc9bb42800 20 RGWRados::pool_iterate: got zonegroup_info.abb22408-c332-4e28-8f7a-ff254ea2fed2 2024-06-04T16:12:49.271 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:49.269+0000 7efc9bb42800 20 RGWRados::pool_iterate: got zone_names.default 2024-06-04T16:12:49.271 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:49.269+0000 7efc9bb42800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-06-04T16:12:49.272 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:49.270+0000 7efc9bb42800 20 rados->read ofs=0 len=0 2024-06-04T16:12:49.272 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:49.270+0000 7efc9bb42800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:12:49.272 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:49.270+0000 7efc9bb42800 20 rados->read ofs=0 len=0 2024-06-04T16:12:49.272 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:49.270+0000 7efc9bb42800 20 rados_obj.operate() r=0 bl.length=46 2024-06-04T16:12:49.272 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:49.270+0000 7efc9bb42800 20 rados->read ofs=0 len=0 2024-06-04T16:12:49.273 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:49.271+0000 7efc9bb42800 20 rados_obj.operate() r=0 bl.length=470 2024-06-04T16:12:49.273 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:49.271+0000 7efc9bb42800 20 zone default found 2024-06-04T16:12:49.273 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:49.271+0000 7efc9bb42800 4 Realm: () 2024-06-04T16:12:49.273 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:49.271+0000 7efc9bb42800 4 ZoneGroup: default (abb22408-c332-4e28-8f7a-ff254ea2fed2) 2024-06-04T16:12:49.273 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:49.271+0000 7efc9bb42800 4 Zone: default (be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767) 2024-06-04T16:12:49.273 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:49.271+0000 7efc9bb42800 10 cannot find current period zonegroup using local zonegroup configuration 2024-06-04T16:12:49.273 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:49.271+0000 7efc9bb42800 20 zonegroup default 2024-06-04T16:12:49.274 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:49.271+0000 7efc9bb42800 20 rados->read ofs=0 len=0 2024-06-04T16:12:49.274 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:49.271+0000 7efc9bb42800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:12:49.274 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:49.271+0000 7efc9bb42800 20 rados->read ofs=0 len=0 2024-06-04T16:12:49.274 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:49.271+0000 7efc9bb42800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:12:49.274 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:49.271+0000 7efc9bb42800 20 rados->read ofs=0 len=0 2024-06-04T16:12:49.274 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:49.271+0000 7efc9bb42800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:12:49.274 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:49.271+0000 7efc9bb42800 20 started sync module instance, tier type = 2024-06-04T16:12:49.274 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:49.271+0000 7efc9bb42800 20 started zone id=be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767 (name=default) with tier type = 2024-06-04T16:12:49.281 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:49.280+0000 7efc9bb42800 20 add_watcher() i=0 2024-06-04T16:12:49.281 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:49.280+0000 7efc9bb42800 20 add_watcher() i=1 2024-06-04T16:12:49.281 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:49.280+0000 7efc9bb42800 20 add_watcher() i=2 2024-06-04T16:12:49.281 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:49.280+0000 7efc9bb42800 20 add_watcher() i=3 2024-06-04T16:12:49.281 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:49.280+0000 7efc9bb42800 20 add_watcher() i=4 2024-06-04T16:12:49.281 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:49.280+0000 7efc9bb42800 20 add_watcher() i=5 2024-06-04T16:12:49.281 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:49.280+0000 7efc9bb42800 20 add_watcher() i=6 2024-06-04T16:12:49.282 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:49.281+0000 7efc9bb42800 20 add_watcher() i=7 2024-06-04T16:12:49.282 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:49.281+0000 7efc9bb42800 2 all 8 watchers are set, enabling cache 2024-06-04T16:12:49.284 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:49.282+0000 7efb4f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-06-04T16:12:49.284 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:49.283+0000 7efc9bb42800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-06-04T16:12:49.284 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:49.283+0000 7efc9bb42800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-06-04T16:12:49.284 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:49.283+0000 7efc9bb42800 5 note: GC not initialized 2024-06-04T16:12:49.284 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:49.283+0000 7efb4e7e4640 20 reqs_thread_entry: start 2024-06-04T16:12:49.284 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:49.283+0000 7efc9bb42800 20 init_complete bucket index max shards: 11 2024-06-04T16:12:49.284 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:49.283+0000 7efc9bb42800 20 Filter name: none 2024-06-04T16:12:49.284 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:49.283+0000 7efabffff640 20 reqs_thread_entry: start 2024-06-04T16:12:49.285 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:49.283+0000 7efc9bb42800 20 rados->read ofs=0 len=0 2024-06-04T16:12:49.286 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:49.283+0000 7efc9bb42800 20 rados_obj.operate() r=0 bl.length=197 2024-06-04T16:12:49.286 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:49.284+0000 7efc9bb42800 20 rados->read ofs=0 len=0 2024-06-04T16:12:49.286 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:49.284+0000 7efc9bb42800 20 rados_obj.operate() r=0 bl.length=411 2024-06-04T16:12:49.286 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:49.284+0000 7efc9bb42800 20 couldn't put binfo cache entry, might have raced with data changes 2024-06-04T16:12:49.286 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:49.284+0000 7efc9bb42800 20 rados->read ofs=0 len=0 2024-06-04T16:12:49.286 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:49.284+0000 7efc9bb42800 20 rados_obj.operate() r=0 bl.length=197 2024-06-04T16:12:49.286 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:49.284+0000 7efc9bb42800 20 rados->read ofs=0 len=0 2024-06-04T16:12:49.286 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:49.285+0000 7efc9bb42800 20 rados_obj.operate() r=0 bl.length=411 2024-06-04T16:12:49.286 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:49.285+0000 7efc9bb42800 20 couldn't put binfo cache entry, might have raced with data changes 2024-06-04T16:12:49.287 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:49.286+0000 7efb4f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-06-04T16:12:49.289 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:49.288+0000 7efc9bb42800 20 remove_watcher() i=0 2024-06-04T16:12:49.289 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:49.288+0000 7efc9bb42800 2 removed watcher, disabling cache 2024-06-04T16:12:49.290 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:49.289+0000 7efc9bb42800 20 remove_watcher() i=1 2024-06-04T16:12:49.291 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:49.290+0000 7efc9bb42800 20 remove_watcher() i=2 2024-06-04T16:12:49.292 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:49.291+0000 7efc9bb42800 20 remove_watcher() i=3 2024-06-04T16:12:49.293 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:49.292+0000 7efc9bb42800 20 remove_watcher() i=4 2024-06-04T16:12:49.294 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:49.293+0000 7efc9bb42800 20 remove_watcher() i=5 2024-06-04T16:12:49.295 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:49.294+0000 7efc9bb42800 20 remove_watcher() i=6 2024-06-04T16:12:49.296 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:49.295+0000 7efc9bb42800 20 remove_watcher() i=7 2024-06-04T16:12:49.306 INFO:tasks.workunit.client.0.smithi144.stderr: 2024-06-04T16:12:49.306 INFO:tasks.workunit.client.0.smithi144.stderr:BUCKET_STATS: 2024-06-04T16:12:49.307 INFO:tasks.workunit.client.0.smithi144.stderr:bucket: error-at-commit-target-layout id: be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.25 num_objects: 20 size_kb: 1 num_shards: 12 2024-06-04T16:12:49.307 INFO:tasks.workunit.client.0.smithi144.stderr: 2024-06-04T16:12:49.308 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:12:49.308 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:12:49.311 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:12:49.312 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:12:49.355 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:12:49.355 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:12:49.380 INFO:tasks.workunit.client.0.smithi144.stderr:TEST: reshard bucket with abort at commit_target_layout 2024-06-04T16:12:49.380 INFO:tasks.workunit.client.0.smithi144.stderr: 2024-06-04T16:12:49.381 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:12:49.381 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:12:49.392 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:12:49.392 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:12:49.435 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:12:49.435 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:12:49.442 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:12:49.442 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:12:49.448 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:12:49.449 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:12:49.455 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:12:49.455 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:12:49.461 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:12:49.461 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:12:49.467 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:12:49.468 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:12:49.473 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:12:49.473 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:12:49.480 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:12:49.480 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:12:49.486 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:12:49.486 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:12:49.492 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:12:49.492 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:12:49.499 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:12:49.499 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:12:49.506 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:12:49.506 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:12:49.514 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:12:49.514 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:12:49.520 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:12:49.520 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:12:49.527 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:12:49.527 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:12:49.533 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:12:49.533 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:12:49.540 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:12:49.540 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:12:49.546 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:12:49.546 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:12:49.552 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:12:49.552 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:12:49.558 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:12:49.558 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:12:49.565 INFO:tasks.workunit.client.0.smithi144.stderr:radosgw-admin bucket stats --bucket abort-at-commit-target-layout 2024-06-04T16:12:49.593 INFO:tasks.workunit.client.0.smithi144.stderr:ignoring --setuser ceph since I am not root 2024-06-04T16:12:49.593 INFO:tasks.workunit.client.0.smithi144.stderr:ignoring --setgroup ceph since I am not root 2024-06-04T16:12:49.630 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:49.629+0000 7fd092611800 20 rados->read ofs=0 len=0 2024-06-04T16:12:49.632 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:49.631+0000 7fd092611800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:12:49.632 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:49.631+0000 7fd092611800 20 realm 2024-06-04T16:12:49.632 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:49.631+0000 7fd092611800 20 rados->read ofs=0 len=0 2024-06-04T16:12:49.632 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:49.631+0000 7fd092611800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:12:49.632 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:49.631+0000 7fd092611800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-06-04T16:12:49.632 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:49.631+0000 7fd092611800 20 rados->read ofs=0 len=0 2024-06-04T16:12:49.632 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:49.631+0000 7fd092611800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:12:49.632 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:49.631+0000 7fd092611800 20 rados->read ofs=0 len=0 2024-06-04T16:12:49.633 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:49.632+0000 7fd092611800 20 rados_obj.operate() r=0 bl.length=46 2024-06-04T16:12:49.633 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:49.632+0000 7fd092611800 20 rados->read ofs=0 len=0 2024-06-04T16:12:49.633 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:49.632+0000 7fd092611800 20 rados_obj.operate() r=0 bl.length=1139 2024-06-04T16:12:49.633 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:49.632+0000 7fd092611800 20 searching for the correct realm 2024-06-04T16:12:49.635 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:49.634+0000 7fd08e3a2640 0 -- 172.21.15.144:0/2154276546 >> [v2:172.21.15.144:6800/1453747520,v1:172.21.15.144:6801/1453747520] conn(0x7fd07807e040 msgr2=0x7fd07807d410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-06-04T16:12:49.840 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:49.839+0000 7fd08e3a2640 0 -- 172.21.15.144:0/2154276546 >> [v2:172.21.15.144:6824/166159729,v1:172.21.15.144:6825/166159729] conn(0x557869fdb710 msgr2=0x557869fddb00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-06-04T16:12:49.846 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:49.844+0000 7fd092611800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-06-04T16:12:49.846 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:49.844+0000 7fd092611800 20 RGWRados::pool_iterate: got zone_info.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767 2024-06-04T16:12:49.846 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:49.844+0000 7fd092611800 20 RGWRados::pool_iterate: got default.zone. 2024-06-04T16:12:49.846 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:49.844+0000 7fd092611800 20 RGWRados::pool_iterate: got zonegroup_info.abb22408-c332-4e28-8f7a-ff254ea2fed2 2024-06-04T16:12:49.846 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:49.844+0000 7fd092611800 20 RGWRados::pool_iterate: got zone_names.default 2024-06-04T16:12:49.846 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:49.844+0000 7fd092611800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-06-04T16:12:49.846 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:49.844+0000 7fd092611800 20 rados->read ofs=0 len=0 2024-06-04T16:12:49.846 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:49.844+0000 7fd092611800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:12:49.846 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:49.844+0000 7fd092611800 20 rados->read ofs=0 len=0 2024-06-04T16:12:49.847 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:49.844+0000 7fd092611800 20 rados_obj.operate() r=0 bl.length=46 2024-06-04T16:12:49.847 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:49.844+0000 7fd092611800 20 rados->read ofs=0 len=0 2024-06-04T16:12:49.847 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:49.845+0000 7fd092611800 20 rados_obj.operate() r=0 bl.length=470 2024-06-04T16:12:49.847 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:49.845+0000 7fd092611800 20 zone default found 2024-06-04T16:12:49.847 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:49.845+0000 7fd092611800 4 Realm: () 2024-06-04T16:12:49.847 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:49.845+0000 7fd092611800 4 ZoneGroup: default (abb22408-c332-4e28-8f7a-ff254ea2fed2) 2024-06-04T16:12:49.847 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:49.845+0000 7fd092611800 4 Zone: default (be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767) 2024-06-04T16:12:49.847 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:49.845+0000 7fd092611800 10 cannot find current period zonegroup using local zonegroup configuration 2024-06-04T16:12:49.847 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:49.845+0000 7fd092611800 20 zonegroup default 2024-06-04T16:12:49.847 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:49.845+0000 7fd092611800 20 rados->read ofs=0 len=0 2024-06-04T16:12:49.847 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:49.845+0000 7fd092611800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:12:49.847 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:49.845+0000 7fd092611800 20 rados->read ofs=0 len=0 2024-06-04T16:12:49.848 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:49.845+0000 7fd092611800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:12:49.848 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:49.845+0000 7fd092611800 20 rados->read ofs=0 len=0 2024-06-04T16:12:49.848 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:49.846+0000 7fd092611800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:12:49.848 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:49.846+0000 7fd092611800 20 started sync module instance, tier type = 2024-06-04T16:12:49.848 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:49.846+0000 7fd092611800 20 started zone id=be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767 (name=default) with tier type = 2024-06-04T16:12:49.855 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:49.854+0000 7fd092611800 20 add_watcher() i=0 2024-06-04T16:12:49.855 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:49.854+0000 7fd092611800 20 add_watcher() i=1 2024-06-04T16:12:49.855 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:49.854+0000 7fd092611800 20 add_watcher() i=2 2024-06-04T16:12:49.856 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:49.854+0000 7fd092611800 20 add_watcher() i=3 2024-06-04T16:12:49.856 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:49.854+0000 7fd092611800 20 add_watcher() i=4 2024-06-04T16:12:49.856 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:49.854+0000 7fd092611800 20 add_watcher() i=5 2024-06-04T16:12:49.856 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:49.854+0000 7fd092611800 20 add_watcher() i=6 2024-06-04T16:12:49.856 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:49.855+0000 7fd092611800 20 add_watcher() i=7 2024-06-04T16:12:49.856 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:49.855+0000 7fd092611800 2 all 8 watchers are set, enabling cache 2024-06-04T16:12:49.859 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:49.857+0000 7fcf3f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-06-04T16:12:49.859 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:49.857+0000 7fd092611800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-06-04T16:12:49.859 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:49.857+0000 7fd092611800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-06-04T16:12:49.859 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:49.857+0000 7fd092611800 5 note: GC not initialized 2024-06-04T16:12:49.859 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:49.858+0000 7fcf3e7fc640 20 reqs_thread_entry: start 2024-06-04T16:12:49.859 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:49.858+0000 7fd092611800 20 init_complete bucket index max shards: 11 2024-06-04T16:12:49.859 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:49.858+0000 7fd092611800 20 Filter name: none 2024-06-04T16:12:49.859 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:49.858+0000 7fceaffff640 20 reqs_thread_entry: start 2024-06-04T16:12:49.859 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:49.858+0000 7fd092611800 20 rados->read ofs=0 len=0 2024-06-04T16:12:49.860 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:49.858+0000 7fd092611800 20 rados_obj.operate() r=0 bl.length=197 2024-06-04T16:12:49.860 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:49.858+0000 7fd092611800 20 rados->read ofs=0 len=0 2024-06-04T16:12:49.860 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:49.859+0000 7fd092611800 20 rados_obj.operate() r=0 bl.length=411 2024-06-04T16:12:49.860 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:49.859+0000 7fd092611800 20 couldn't put binfo cache entry, might have raced with data changes 2024-06-04T16:12:49.860 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:49.859+0000 7fd092611800 20 rados->read ofs=0 len=0 2024-06-04T16:12:49.860 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:49.859+0000 7fd092611800 20 rados_obj.operate() r=0 bl.length=197 2024-06-04T16:12:49.861 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:49.859+0000 7fd092611800 20 rados->read ofs=0 len=0 2024-06-04T16:12:49.861 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:49.860+0000 7fd092611800 20 rados_obj.operate() r=0 bl.length=411 2024-06-04T16:12:49.861 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:49.860+0000 7fd092611800 20 couldn't put binfo cache entry, might have raced with data changes 2024-06-04T16:12:49.862 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:49.861+0000 7fcf3f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-06-04T16:12:49.864 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:49.864+0000 7fd092611800 20 remove_watcher() i=0 2024-06-04T16:12:49.864 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:49.864+0000 7fd092611800 2 removed watcher, disabling cache 2024-06-04T16:12:49.865 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:49.864+0000 7fd092611800 20 remove_watcher() i=1 2024-06-04T16:12:49.866 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:49.865+0000 7fd092611800 20 remove_watcher() i=2 2024-06-04T16:12:49.867 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:49.866+0000 7fd092611800 20 remove_watcher() i=3 2024-06-04T16:12:49.868 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:49.867+0000 7fd092611800 20 remove_watcher() i=4 2024-06-04T16:12:49.869 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:49.868+0000 7fd092611800 20 remove_watcher() i=5 2024-06-04T16:12:49.870 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:49.869+0000 7fd092611800 20 remove_watcher() i=6 2024-06-04T16:12:49.871 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:49.870+0000 7fd092611800 20 remove_watcher() i=7 2024-06-04T16:12:49.881 INFO:tasks.workunit.client.0.smithi144.stderr: 2024-06-04T16:12:49.882 INFO:tasks.workunit.client.0.smithi144.stderr:BUCKET_STATS: 2024-06-04T16:12:49.882 INFO:tasks.workunit.client.0.smithi144.stderr:bucket: abort-at-commit-target-layout id: be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.26 num_objects: 20 size_kb: 1 num_shards: 11 2024-06-04T16:12:49.882 INFO:tasks.workunit.client.0.smithi144.stderr: 2024-06-04T16:12:49.883 INFO:tasks.workunit.client.0.smithi144.stderr:radosgw-admin bucket reshard --bucket abort-at-commit-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at commit_target_layout 2024-06-04T16:12:49.916 INFO:tasks.workunit.client.0.smithi144.stderr:ignoring --setuser ceph since I am not root 2024-06-04T16:12:49.916 INFO:tasks.workunit.client.0.smithi144.stderr:ignoring --setgroup ceph since I am not root 2024-06-04T16:12:49.952 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:49.951+0000 7f9208b2a800 20 rados->read ofs=0 len=0 2024-06-04T16:12:49.954 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:49.953+0000 7f9208b2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:12:49.954 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:49.953+0000 7f9208b2a800 20 realm 2024-06-04T16:12:49.954 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:49.953+0000 7f9208b2a800 20 rados->read ofs=0 len=0 2024-06-04T16:12:49.954 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:49.953+0000 7f9208b2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:12:49.954 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:49.953+0000 7f9208b2a800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-06-04T16:12:49.955 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:49.953+0000 7f9208b2a800 20 rados->read ofs=0 len=0 2024-06-04T16:12:49.955 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:49.953+0000 7f9208b2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:12:49.955 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:49.953+0000 7f9208b2a800 20 rados->read ofs=0 len=0 2024-06-04T16:12:49.955 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:49.954+0000 7f9208b2a800 20 rados_obj.operate() r=0 bl.length=46 2024-06-04T16:12:49.955 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:49.954+0000 7f9208b2a800 20 rados->read ofs=0 len=0 2024-06-04T16:12:49.956 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:49.954+0000 7f9208b2a800 20 rados_obj.operate() r=0 bl.length=1139 2024-06-04T16:12:49.956 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:49.955+0000 7f9208b2a800 20 searching for the correct realm 2024-06-04T16:12:49.957 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:49.956+0000 7f9203fe7640 0 -- 172.21.15.144:0/3432075077 >> [v2:172.21.15.144:6816/2358575268,v1:172.21.15.144:6817/2358575268] conn(0x5557c0204360 msgr2=0x5557c0206750 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-06-04T16:12:49.960 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:49.959+0000 7f9203fe7640 0 -- 172.21.15.144:0/3432075077 >> [v2:172.21.15.177:6808/2618477608,v1:172.21.15.177:6809/2618477608] conn(0x7f91f80824f0 msgr2=0x7f91f8081920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-06-04T16:12:50.167 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:50.165+0000 7f9208b2a800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-06-04T16:12:50.167 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:50.165+0000 7f9208b2a800 20 RGWRados::pool_iterate: got zone_info.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767 2024-06-04T16:12:50.168 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:50.165+0000 7f9208b2a800 20 RGWRados::pool_iterate: got default.zone. 2024-06-04T16:12:50.168 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:50.165+0000 7f9208b2a800 20 RGWRados::pool_iterate: got zonegroup_info.abb22408-c332-4e28-8f7a-ff254ea2fed2 2024-06-04T16:12:50.168 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:50.165+0000 7f9208b2a800 20 RGWRados::pool_iterate: got zone_names.default 2024-06-04T16:12:50.168 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:50.165+0000 7f9208b2a800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-06-04T16:12:50.168 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:50.165+0000 7f9208b2a800 20 rados->read ofs=0 len=0 2024-06-04T16:12:50.168 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:50.166+0000 7f9208b2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:12:50.168 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:50.166+0000 7f9208b2a800 20 rados->read ofs=0 len=0 2024-06-04T16:12:50.168 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:50.166+0000 7f9208b2a800 20 rados_obj.operate() r=0 bl.length=46 2024-06-04T16:12:50.168 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:50.166+0000 7f9208b2a800 20 rados->read ofs=0 len=0 2024-06-04T16:12:50.168 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:50.166+0000 7f9208b2a800 20 rados_obj.operate() r=0 bl.length=470 2024-06-04T16:12:50.168 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:50.167+0000 7f9208b2a800 20 zone default found 2024-06-04T16:12:50.168 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:50.167+0000 7f9208b2a800 4 Realm: () 2024-06-04T16:12:50.169 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:50.167+0000 7f9208b2a800 4 ZoneGroup: default (abb22408-c332-4e28-8f7a-ff254ea2fed2) 2024-06-04T16:12:50.169 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:50.167+0000 7f9208b2a800 4 Zone: default (be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767) 2024-06-04T16:12:50.169 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:50.167+0000 7f9208b2a800 10 cannot find current period zonegroup using local zonegroup configuration 2024-06-04T16:12:50.169 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:50.167+0000 7f9208b2a800 20 zonegroup default 2024-06-04T16:12:50.169 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:50.167+0000 7f9208b2a800 20 rados->read ofs=0 len=0 2024-06-04T16:12:50.169 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:50.167+0000 7f9208b2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:12:50.170 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:50.167+0000 7f9208b2a800 20 rados->read ofs=0 len=0 2024-06-04T16:12:50.170 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:50.168+0000 7f9208b2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:12:50.170 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:50.168+0000 7f9208b2a800 20 rados->read ofs=0 len=0 2024-06-04T16:12:50.170 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:50.168+0000 7f9208b2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:12:50.170 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:50.168+0000 7f9208b2a800 20 started sync module instance, tier type = 2024-06-04T16:12:50.170 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:50.168+0000 7f9208b2a800 20 started zone id=be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767 (name=default) with tier type = 2024-06-04T16:12:50.177 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:50.177+0000 7f9208b2a800 20 add_watcher() i=0 2024-06-04T16:12:50.178 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:50.177+0000 7f9208b2a800 20 add_watcher() i=1 2024-06-04T16:12:50.178 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:50.177+0000 7f9208b2a800 20 add_watcher() i=2 2024-06-04T16:12:50.178 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:50.177+0000 7f9208b2a800 20 add_watcher() i=3 2024-06-04T16:12:50.178 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:50.177+0000 7f9208b2a800 20 add_watcher() i=4 2024-06-04T16:12:50.178 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:50.177+0000 7f9208b2a800 20 add_watcher() i=5 2024-06-04T16:12:50.178 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:50.177+0000 7f9208b2a800 20 add_watcher() i=6 2024-06-04T16:12:50.178 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:50.178+0000 7f9208b2a800 20 add_watcher() i=7 2024-06-04T16:12:50.178 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:50.178+0000 7f9208b2a800 2 all 8 watchers are set, enabling cache 2024-06-04T16:12:50.180 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:50.179+0000 7f90bafdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-06-04T16:12:50.181 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:50.179+0000 7f9208b2a800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-06-04T16:12:50.181 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:50.179+0000 7f9208b2a800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-06-04T16:12:50.181 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:50.180+0000 7f9208b2a800 5 note: GC not initialized 2024-06-04T16:12:50.181 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:50.180+0000 7f90b9fdb640 20 reqs_thread_entry: start 2024-06-04T16:12:50.181 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:50.180+0000 7f9208b2a800 20 init_complete bucket index max shards: 11 2024-06-04T16:12:50.182 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:50.180+0000 7f9208b2a800 20 Filter name: none 2024-06-04T16:12:50.182 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:50.180+0000 7f902b7fe640 20 reqs_thread_entry: start 2024-06-04T16:12:50.182 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:50.180+0000 7f9208b2a800 10 cache get: name=default.rgw.meta+root+abort-at-commit-target-layout : miss 2024-06-04T16:12:50.182 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:50.180+0000 7f9208b2a800 20 rados->read ofs=0 len=0 2024-06-04T16:12:50.183 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:50.181+0000 7f9208b2a800 20 rados_obj.operate() r=0 bl.length=197 2024-06-04T16:12:50.183 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:50.181+0000 7f9208b2a800 10 cache put: name=default.rgw.meta+root+abort-at-commit-target-layout info.flags=0x11 2024-06-04T16:12:50.183 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:50.181+0000 7f9208b2a800 10 adding default.rgw.meta+root+abort-at-commit-target-layout to cache LRU end 2024-06-04T16:12:50.183 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:50.181+0000 7f9208b2a800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.26 : miss 2024-06-04T16:12:50.183 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:50.181+0000 7f9208b2a800 20 rados->read ofs=0 len=0 2024-06-04T16:12:50.183 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:50.181+0000 7f9208b2a800 20 rados_obj.operate() r=0 bl.length=411 2024-06-04T16:12:50.183 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:50.181+0000 7f9208b2a800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.26 info.flags=0x17 2024-06-04T16:12:50.183 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:50.181+0000 7f9208b2a800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.26 to cache LRU end 2024-06-04T16:12:50.183 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:50.181+0000 7f9208b2a800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-06-04T16:12:50.184 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:50.181+0000 7f9208b2a800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-06-04T16:12:50.184 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:50.181+0000 7f9208b2a800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.26 2024-06-04T16:12:50.187 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:50.186+0000 7f9208b2a800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.26 info.flags=0x17 2024-06-04T16:12:50.188 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:50.186+0000 7f9208b2a800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.26 to cache LRU end 2024-06-04T16:12:50.188 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:50.186+0000 7f9208b2a800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-06-04T16:12:50.188 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:50.186+0000 7f9208b2a800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.26, ofs0, ns] 2024-06-04T16:12:50.188 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:50.187+0000 7f90db7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1078036791413 cookie 93835373909248 notifier 6392 bl.length()=923 2024-06-04T16:12:50.188 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:50.187+0000 7f90db7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.26 info.flags=0x17 2024-06-04T16:12:50.188 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:50.187+0000 7f90db7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.26 to cache LRU end 2024-06-04T16:12:50.188 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:50.187+0000 7f90db7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-06-04T16:12:50.188 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:50.187+0000 7f9208b2a800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.26]): orig_sources= new_sources= 2024-06-04T16:12:50.189 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:50.187+0000 7f9208b2a800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.26]): potential sources added=[] removed=[] 2024-06-04T16:12:50.189 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:50.187+0000 7f9208b2a800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.26]): orig_dests= new_dests= 2024-06-04T16:12:50.189 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:50.187+0000 7f9208b2a800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.26]): potential dests added=[] removed=[] 2024-06-04T16:12:50.191 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:50.190+0000 7f9208b2a800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.26.1.0 2024-06-04T16:12:50.191 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:50.190+0000 7f9208b2a800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.26.1.0 2024-06-04T16:12:50.191 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:50.190+0000 7f9208b2a800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.26.1.1 2024-06-04T16:12:50.191 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:50.190+0000 7f9208b2a800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.26.1.1 2024-06-04T16:12:50.191 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:50.190+0000 7f9208b2a800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.26.1.2 2024-06-04T16:12:50.191 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:50.190+0000 7f9208b2a800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.26.1.2 2024-06-04T16:12:50.191 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:50.190+0000 7f9208b2a800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.26.1.3 2024-06-04T16:12:50.192 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:50.190+0000 7f9208b2a800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.26.1.3 2024-06-04T16:12:50.192 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:50.190+0000 7f9208b2a800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.26.1.4 2024-06-04T16:12:50.192 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:50.190+0000 7f9208b2a800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.26.1.4 2024-06-04T16:12:50.192 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:50.190+0000 7f9208b2a800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.26.1.5 2024-06-04T16:12:50.192 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:50.190+0000 7f9208b2a800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.26.1.5 2024-06-04T16:12:50.192 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:50.190+0000 7f9208b2a800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.26.1.6 2024-06-04T16:12:50.192 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:50.190+0000 7f9208b2a800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.26.1.6 2024-06-04T16:12:50.192 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:50.190+0000 7f9208b2a800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.26.1.7 2024-06-04T16:12:50.192 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:50.190+0000 7f9208b2a800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.26.1.7 2024-06-04T16:12:50.192 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:50.190+0000 7f9208b2a800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.26.1.8 2024-06-04T16:12:50.192 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:50.190+0000 7f9208b2a800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.26.1.8 2024-06-04T16:12:50.192 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:50.190+0000 7f9208b2a800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.26.1.9 2024-06-04T16:12:50.193 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:50.190+0000 7f9208b2a800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.26.1.9 2024-06-04T16:12:50.193 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:50.190+0000 7f9208b2a800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.26.1.10 2024-06-04T16:12:50.193 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:50.190+0000 7f9208b2a800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.26.1.10 2024-06-04T16:12:50.193 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:50.190+0000 7f9208b2a800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.26.1.11 2024-06-04T16:12:50.193 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:50.190+0000 7f9208b2a800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.26.1.11 2024-06-04T16:12:50.193 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:50.190+0000 7f9208b2a800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.26.0 2024-06-04T16:12:50.194 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:50.190+0000 7f9208b2a800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.26.1 2024-06-04T16:12:50.194 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:50.191+0000 7f9208b2a800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.26.2 2024-06-04T16:12:50.194 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:50.191+0000 7f9208b2a800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.26.3 2024-06-04T16:12:50.194 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:50.192+0000 7f9208b2a800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.26.4 2024-06-04T16:12:50.194 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:50.192+0000 7f9208b2a800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.26.5 2024-06-04T16:12:50.194 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:50.193+0000 7f9208b2a800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.26.6 2024-06-04T16:12:50.195 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:50.193+0000 7f9208b2a800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.26.7 2024-06-04T16:12:50.195 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:50.194+0000 7f9208b2a800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.26.8 2024-06-04T16:12:50.195 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:50.194+0000 7f9208b2a800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.26.9 2024-06-04T16:12:50.196 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:50.195+0000 7f9208b2a800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.26.10 2024-06-04T16:12:50.199 INFO:tasks.workunit.client.0.smithi144.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-4027-g65533a90/rpm/el9/BUILD/ceph-19.0.0-4027-g65533a90/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f9208b2a800 time 2024-06-04T16:12:50.199416+0000 2024-06-04T16:12:50.199 INFO:tasks.workunit.client.0.smithi144.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-4027-g65533a90/rpm/el9/BUILD/ceph-19.0.0-4027-g65533a90/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-06-04T16:12:50.200 INFO:tasks.workunit.client.0.smithi144.stderr: ceph version 19.0.0-4027-g65533a90 (65533a907fc9add1863609703fdbbea67993c8ef) squid (dev) 2024-06-04T16:12:50.200 INFO:tasks.workunit.client.0.smithi144.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f920a181dce] 2024-06-04T16:12:50.200 INFO:tasks.workunit.client.0.smithi144.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x181f8c) [0x7f920a181f8c] 2024-06-04T16:12:50.200 INFO:tasks.workunit.client.0.smithi144.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5557be373fb1] 2024-06-04T16:12:50.200 INFO:tasks.workunit.client.0.smithi144.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x5bf) [0x5557be37f62f] 2024-06-04T16:12:50.200 INFO:tasks.workunit.client.0.smithi144.stderr: 5: main() 2024-06-04T16:12:50.201 INFO:tasks.workunit.client.0.smithi144.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7f9209029590] 2024-06-04T16:12:50.201 INFO:tasks.workunit.client.0.smithi144.stderr: 7: __libc_start_main() 2024-06-04T16:12:50.201 INFO:tasks.workunit.client.0.smithi144.stderr: 8: _start() 2024-06-04T16:12:50.201 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:50.199+0000 7f9208b2a800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-4027-g65533a90/rpm/el9/BUILD/ceph-19.0.0-4027-g65533a90/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f9208b2a800 time 2024-06-04T16:12:50.199416+0000 2024-06-04T16:12:50.202 INFO:tasks.workunit.client.0.smithi144.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-4027-g65533a90/rpm/el9/BUILD/ceph-19.0.0-4027-g65533a90/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-06-04T16:12:50.202 INFO:tasks.workunit.client.0.smithi144.stderr: 2024-06-04T16:12:50.202 INFO:tasks.workunit.client.0.smithi144.stderr: ceph version 19.0.0-4027-g65533a90 (65533a907fc9add1863609703fdbbea67993c8ef) squid (dev) 2024-06-04T16:12:50.202 INFO:tasks.workunit.client.0.smithi144.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f920a181dce] 2024-06-04T16:12:50.202 INFO:tasks.workunit.client.0.smithi144.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x181f8c) [0x7f920a181f8c] 2024-06-04T16:12:50.202 INFO:tasks.workunit.client.0.smithi144.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5557be373fb1] 2024-06-04T16:12:50.203 INFO:tasks.workunit.client.0.smithi144.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x5bf) [0x5557be37f62f] 2024-06-04T16:12:50.203 INFO:tasks.workunit.client.0.smithi144.stderr: 5: main() 2024-06-04T16:12:50.203 INFO:tasks.workunit.client.0.smithi144.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7f9209029590] 2024-06-04T16:12:50.203 INFO:tasks.workunit.client.0.smithi144.stderr: 7: __libc_start_main() 2024-06-04T16:12:50.203 INFO:tasks.workunit.client.0.smithi144.stderr: 8: _start() 2024-06-04T16:12:50.203 INFO:tasks.workunit.client.0.smithi144.stderr: 2024-06-04T16:12:50.203 INFO:tasks.workunit.client.0.smithi144.stderr:*** Caught signal (Aborted) ** 2024-06-04T16:12:50.203 INFO:tasks.workunit.client.0.smithi144.stderr: in thread 7f9208b2a800 thread_name:radosgw-admin 2024-06-04T16:12:50.225 INFO:tasks.workunit.client.0.smithi144.stderr: ceph version 19.0.0-4027-g65533a90 (65533a907fc9add1863609703fdbbea67993c8ef) squid (dev) 2024-06-04T16:12:50.225 INFO:tasks.workunit.client.0.smithi144.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f920903e6f0] 2024-06-04T16:12:50.225 INFO:tasks.workunit.client.0.smithi144.stderr: 2: /lib64/libc.so.6(+0x8b94c) [0x7f920908b94c] 2024-06-04T16:12:50.226 INFO:tasks.workunit.client.0.smithi144.stderr: 3: raise() 2024-06-04T16:12:50.226 INFO:tasks.workunit.client.0.smithi144.stderr: 4: abort() 2024-06-04T16:12:50.226 INFO:tasks.workunit.client.0.smithi144.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f920a181e28] 2024-06-04T16:12:50.226 INFO:tasks.workunit.client.0.smithi144.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x181f8c) [0x7f920a181f8c] 2024-06-04T16:12:50.226 INFO:tasks.workunit.client.0.smithi144.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5557be373fb1] 2024-06-04T16:12:50.226 INFO:tasks.workunit.client.0.smithi144.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x5bf) [0x5557be37f62f] 2024-06-04T16:12:50.226 INFO:tasks.workunit.client.0.smithi144.stderr: 9: main() 2024-06-04T16:12:50.226 INFO:tasks.workunit.client.0.smithi144.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7f9209029590] 2024-06-04T16:12:50.226 INFO:tasks.workunit.client.0.smithi144.stderr: 11: __libc_start_main() 2024-06-04T16:12:50.226 INFO:tasks.workunit.client.0.smithi144.stderr: 12: _start() 2024-06-04T16:12:50.226 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:50.199+0000 7f9208b2a800 -1 *** Caught signal (Aborted) ** 2024-06-04T16:12:50.226 INFO:tasks.workunit.client.0.smithi144.stderr: in thread 7f9208b2a800 thread_name:radosgw-admin 2024-06-04T16:12:50.226 INFO:tasks.workunit.client.0.smithi144.stderr: 2024-06-04T16:12:50.227 INFO:tasks.workunit.client.0.smithi144.stderr: ceph version 19.0.0-4027-g65533a90 (65533a907fc9add1863609703fdbbea67993c8ef) squid (dev) 2024-06-04T16:12:50.227 INFO:tasks.workunit.client.0.smithi144.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f920903e6f0] 2024-06-04T16:12:50.227 INFO:tasks.workunit.client.0.smithi144.stderr: 2: /lib64/libc.so.6(+0x8b94c) [0x7f920908b94c] 2024-06-04T16:12:50.227 INFO:tasks.workunit.client.0.smithi144.stderr: 3: raise() 2024-06-04T16:12:50.227 INFO:tasks.workunit.client.0.smithi144.stderr: 4: abort() 2024-06-04T16:12:50.227 INFO:tasks.workunit.client.0.smithi144.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f920a181e28] 2024-06-04T16:12:50.227 INFO:tasks.workunit.client.0.smithi144.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x181f8c) [0x7f920a181f8c] 2024-06-04T16:12:50.227 INFO:tasks.workunit.client.0.smithi144.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5557be373fb1] 2024-06-04T16:12:50.227 INFO:tasks.workunit.client.0.smithi144.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x5bf) [0x5557be37f62f] 2024-06-04T16:12:50.227 INFO:tasks.workunit.client.0.smithi144.stderr: 9: main() 2024-06-04T16:12:50.227 INFO:tasks.workunit.client.0.smithi144.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7f9209029590] 2024-06-04T16:12:50.227 INFO:tasks.workunit.client.0.smithi144.stderr: 11: __libc_start_main() 2024-06-04T16:12:50.227 INFO:tasks.workunit.client.0.smithi144.stderr: 12: _start() 2024-06-04T16:12:50.227 INFO:tasks.workunit.client.0.smithi144.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-06-04T16:12:50.228 INFO:tasks.workunit.client.0.smithi144.stderr: 2024-06-04T16:12:50.228 INFO:tasks.workunit.client.0.smithi144.stderr:--- begin dump of recent events --- 2024-06-04T16:12:50.228 INFO:tasks.workunit.client.0.smithi144.stderr: -499> 2024-06-04T16:12:49.936+0000 7f9208b2a800 5 AuthRegistry(0x5557c0110bf0) adding con mode: crc 2024-06-04T16:12:50.228 INFO:tasks.workunit.client.0.smithi144.stderr: -498> 2024-06-04T16:12:49.936+0000 7f9208b2a800 5 AuthRegistry(0x5557c0110bf0) adding con mode: secure 2024-06-04T16:12:50.228 INFO:tasks.workunit.client.0.smithi144.stderr: -497> 2024-06-04T16:12:49.936+0000 7f9208b2a800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-06-04T16:12:50.228 INFO:tasks.workunit.client.0.smithi144.stderr: -496> 2024-06-04T16:12:49.936+0000 7f9208b2a800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-06-04T16:12:50.228 INFO:tasks.workunit.client.0.smithi144.stderr: -495> 2024-06-04T16:12:49.936+0000 7f9208b2a800 5 asok(0x5557bfef0c60) register_command rotate-key hook 0x5557c0110d38 2024-06-04T16:12:50.228 INFO:tasks.workunit.client.0.smithi144.stderr: -494> 2024-06-04T16:12:49.936+0000 7f9208b2a800 10 monclient: _reopen_session rank -1 2024-06-04T16:12:50.228 INFO:tasks.workunit.client.0.smithi144.stderr: -493> 2024-06-04T16:12:49.936+0000 7f9208b2a800 10 monclient: _add_conns ranks=[0,2,1] 2024-06-04T16:12:50.228 INFO:tasks.workunit.client.0.smithi144.stderr: -492> 2024-06-04T16:12:49.936+0000 7f9208b2a800 10 monclient(hunting): picked mon.noname-a con 0x5557bffc4eb0 addr [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] 2024-06-04T16:12:50.228 INFO:tasks.workunit.client.0.smithi144.stderr: -491> 2024-06-04T16:12:49.936+0000 7f9208b2a800 10 monclient(hunting): picked mon.noname-c con 0x5557bffc7eb0 addr [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] 2024-06-04T16:12:50.229 INFO:tasks.workunit.client.0.smithi144.stderr: -490> 2024-06-04T16:12:49.936+0000 7f9208b2a800 10 monclient(hunting): picked mon.noname-b con 0x5557c0117400 addr [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] 2024-06-04T16:12:50.229 INFO:tasks.workunit.client.0.smithi144.stderr: -489> 2024-06-04T16:12:49.936+0000 7f9208b2a800 10 monclient(hunting): start opening mon connection 2024-06-04T16:12:50.229 INFO:tasks.workunit.client.0.smithi144.stderr: -488> 2024-06-04T16:12:49.936+0000 7f9208b2a800 10 monclient(hunting): start opening mon connection 2024-06-04T16:12:50.229 INFO:tasks.workunit.client.0.smithi144.stderr: -487> 2024-06-04T16:12:49.936+0000 7f9208b2a800 10 monclient(hunting): start opening mon connection 2024-06-04T16:12:50.229 INFO:tasks.workunit.client.0.smithi144.stderr: -486> 2024-06-04T16:12:49.936+0000 7f9208b2a800 10 monclient(hunting): _renew_subs 2024-06-04T16:12:50.229 INFO:tasks.workunit.client.0.smithi144.stderr: -485> 2024-06-04T16:12:49.936+0000 7f9208b2a800 10 monclient(hunting): authenticate will time out at 2007.753030s 2024-06-04T16:12:50.229 INFO:tasks.workunit.client.0.smithi144.stderr: -484> 2024-06-04T16:12:49.937+0000 7f92047e8640 10 monclient(hunting): get_auth_request con 0x5557bffc4eb0 auth_method 0 2024-06-04T16:12:50.229 INFO:tasks.workunit.client.0.smithi144.stderr: -483> 2024-06-04T16:12:49.937+0000 7f92047e8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-06-04T16:12:50.229 INFO:tasks.workunit.client.0.smithi144.stderr: -482> 2024-06-04T16:12:49.937+0000 7f92047e8640 10 monclient(hunting): _init_auth method 2 2024-06-04T16:12:50.229 INFO:tasks.workunit.client.0.smithi144.stderr: -481> 2024-06-04T16:12:49.937+0000 7f92047e8640 10 monclient(hunting): _init_auth creating new auth 2024-06-04T16:12:50.229 INFO:tasks.workunit.client.0.smithi144.stderr: -480> 2024-06-04T16:12:49.937+0000 7f9203fe7640 10 monclient(hunting): get_auth_request con 0x5557bffc7eb0 auth_method 0 2024-06-04T16:12:50.229 INFO:tasks.workunit.client.0.smithi144.stderr: -479> 2024-06-04T16:12:49.937+0000 7f9203fe7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-06-04T16:12:50.229 INFO:tasks.workunit.client.0.smithi144.stderr: -478> 2024-06-04T16:12:49.937+0000 7f9203fe7640 10 monclient(hunting): _init_auth method 2 2024-06-04T16:12:50.229 INFO:tasks.workunit.client.0.smithi144.stderr: -477> 2024-06-04T16:12:49.937+0000 7f9203fe7640 10 monclient(hunting): _init_auth creating new auth 2024-06-04T16:12:50.230 INFO:tasks.workunit.client.0.smithi144.stderr: -476> 2024-06-04T16:12:49.937+0000 7f92047e8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-06-04T16:12:50.230 INFO:tasks.workunit.client.0.smithi144.stderr: -475> 2024-06-04T16:12:49.937+0000 7f92047e8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-06-04T16:12:50.230 INFO:tasks.workunit.client.0.smithi144.stderr: -474> 2024-06-04T16:12:49.937+0000 7f92047e8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-06-04T16:12:50.230 INFO:tasks.workunit.client.0.smithi144.stderr: -473> 2024-06-04T16:12:49.937+0000 7f9203fe7640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-06-04T16:12:50.230 INFO:tasks.workunit.client.0.smithi144.stderr: -472> 2024-06-04T16:12:49.937+0000 7f9203fe7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-06-04T16:12:50.230 INFO:tasks.workunit.client.0.smithi144.stderr: -471> 2024-06-04T16:12:49.937+0000 7f9203fe7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-06-04T16:12:50.230 INFO:tasks.workunit.client.0.smithi144.stderr: -470> 2024-06-04T16:12:49.937+0000 7f9204fe9640 10 monclient(hunting): get_auth_request con 0x5557c0117400 auth_method 0 2024-06-04T16:12:50.230 INFO:tasks.workunit.client.0.smithi144.stderr: -469> 2024-06-04T16:12:49.937+0000 7f9204fe9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-06-04T16:12:50.230 INFO:tasks.workunit.client.0.smithi144.stderr: -468> 2024-06-04T16:12:49.937+0000 7f9204fe9640 10 monclient(hunting): _init_auth method 2 2024-06-04T16:12:50.230 INFO:tasks.workunit.client.0.smithi144.stderr: -467> 2024-06-04T16:12:49.937+0000 7f9204fe9640 10 monclient(hunting): _init_auth creating new auth 2024-06-04T16:12:50.230 INFO:tasks.workunit.client.0.smithi144.stderr: -466> 2024-06-04T16:12:49.937+0000 7f9204fe9640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-06-04T16:12:50.230 INFO:tasks.workunit.client.0.smithi144.stderr: -465> 2024-06-04T16:12:49.937+0000 7f9204fe9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-06-04T16:12:50.230 INFO:tasks.workunit.client.0.smithi144.stderr: -464> 2024-06-04T16:12:49.937+0000 7f9204fe9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-06-04T16:12:50.231 INFO:tasks.workunit.client.0.smithi144.stderr: -463> 2024-06-04T16:12:49.937+0000 7f92047e8640 10 monclient(hunting): handle_auth_done global_id 6741 payload 824 2024-06-04T16:12:50.231 INFO:tasks.workunit.client.0.smithi144.stderr: -462> 2024-06-04T16:12:49.937+0000 7f92047e8640 10 monclient: _finish_hunting 0 2024-06-04T16:12:50.231 INFO:tasks.workunit.client.0.smithi144.stderr: -461> 2024-06-04T16:12:49.937+0000 7f92047e8640 1 monclient: found mon.noname-a 2024-06-04T16:12:50.231 INFO:tasks.workunit.client.0.smithi144.stderr: -460> 2024-06-04T16:12:49.937+0000 7f92047e8640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.144:3300/0 2024-06-04T16:12:50.231 INFO:tasks.workunit.client.0.smithi144.stderr: -459> 2024-06-04T16:12:49.937+0000 7f90f0e09640 10 monclient: handle_monmap mon_map magic: 0 2024-06-04T16:12:50.231 INFO:tasks.workunit.client.0.smithi144.stderr: -458> 2024-06-04T16:12:49.937+0000 7f90f0e09640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-06-04T16:12:50.231 INFO:tasks.workunit.client.0.smithi144.stderr: -457> 2024-06-04T16:12:49.937+0000 7f90f0e09640 10 monclient: dump: 2024-06-04T16:12:50.231 INFO:tasks.workunit.client.0.smithi144.stderr:epoch 1 2024-06-04T16:12:50.231 INFO:tasks.workunit.client.0.smithi144.stderr:fsid 15e56bb1-4856-42f3-b6db-a2c8f23c5557 2024-06-04T16:12:50.231 INFO:tasks.workunit.client.0.smithi144.stderr:last_changed 2024-06-04T15:51:29.789359+0000 2024-06-04T16:12:50.231 INFO:tasks.workunit.client.0.smithi144.stderr:created 2024-06-04T15:51:29.789359+0000 2024-06-04T16:12:50.231 INFO:tasks.workunit.client.0.smithi144.stderr:min_mon_release 19 (squid) 2024-06-04T16:12:50.231 INFO:tasks.workunit.client.0.smithi144.stderr:election_strategy: 1 2024-06-04T16:12:50.231 INFO:tasks.workunit.client.0.smithi144.stderr:0: [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] mon.a 2024-06-04T16:12:50.231 INFO:tasks.workunit.client.0.smithi144.stderr:1: [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] mon.b 2024-06-04T16:12:50.232 INFO:tasks.workunit.client.0.smithi144.stderr:2: [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] mon.c 2024-06-04T16:12:50.232 INFO:tasks.workunit.client.0.smithi144.stderr: 2024-06-04T16:12:50.232 INFO:tasks.workunit.client.0.smithi144.stderr: -456> 2024-06-04T16:12:49.937+0000 7f90f0e09640 10 monclient: _finish_auth 0 2024-06-04T16:12:50.232 INFO:tasks.workunit.client.0.smithi144.stderr: -455> 2024-06-04T16:12:49.937+0000 7f90f0e09640 10 monclient: _check_auth_tickets 2024-06-04T16:12:50.232 INFO:tasks.workunit.client.0.smithi144.stderr: -454> 2024-06-04T16:12:49.937+0000 7f90f0e09640 10 monclient: handle_config config(0 keys) 2024-06-04T16:12:50.232 INFO:tasks.workunit.client.0.smithi144.stderr: -453> 2024-06-04T16:12:49.937+0000 7f90f0e09640 10 monclient: handle_monmap mon_map magic: 0 2024-06-04T16:12:50.232 INFO:tasks.workunit.client.0.smithi144.stderr: -452> 2024-06-04T16:12:49.937+0000 7f90f0e09640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-06-04T16:12:50.232 INFO:tasks.workunit.client.0.smithi144.stderr: -451> 2024-06-04T16:12:49.937+0000 7f90f0e09640 10 monclient: dump: 2024-06-04T16:12:50.232 INFO:tasks.workunit.client.0.smithi144.stderr:epoch 1 2024-06-04T16:12:50.232 INFO:tasks.workunit.client.0.smithi144.stderr:fsid 15e56bb1-4856-42f3-b6db-a2c8f23c5557 2024-06-04T16:12:50.232 INFO:tasks.workunit.client.0.smithi144.stderr:last_changed 2024-06-04T15:51:29.789359+0000 2024-06-04T16:12:50.232 INFO:tasks.workunit.client.0.smithi144.stderr:created 2024-06-04T15:51:29.789359+0000 2024-06-04T16:12:50.233 INFO:tasks.workunit.client.0.smithi144.stderr:min_mon_release 19 (squid) 2024-06-04T16:12:50.233 INFO:tasks.workunit.client.0.smithi144.stderr:election_strategy: 1 2024-06-04T16:12:50.233 INFO:tasks.workunit.client.0.smithi144.stderr:0: [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] mon.a 2024-06-04T16:12:50.233 INFO:tasks.workunit.client.0.smithi144.stderr:1: [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] mon.b 2024-06-04T16:12:50.233 INFO:tasks.workunit.client.0.smithi144.stderr:2: [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] mon.c 2024-06-04T16:12:50.233 INFO:tasks.workunit.client.0.smithi144.stderr: 2024-06-04T16:12:50.233 INFO:tasks.workunit.client.0.smithi144.stderr: -450> 2024-06-04T16:12:49.937+0000 7f9208b2a800 5 monclient: authenticate success, global_id 6741 2024-06-04T16:12:50.233 INFO:tasks.workunit.client.0.smithi144.stderr: -449> 2024-06-04T16:12:49.937+0000 7f9208b2a800 10 monclient: _renew_subs 2024-06-04T16:12:50.233 INFO:tasks.workunit.client.0.smithi144.stderr: -448> 2024-06-04T16:12:49.937+0000 7f9208b2a800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.144:3300/0 2024-06-04T16:12:50.233 INFO:tasks.workunit.client.0.smithi144.stderr: -447> 2024-06-04T16:12:49.937+0000 7f90f260c640 4 set_mon_vals no callback set 2024-06-04T16:12:50.233 INFO:tasks.workunit.client.0.smithi144.stderr: -446> 2024-06-04T16:12:49.937+0000 7f9208b2a800 10 monclient: _renew_subs 2024-06-04T16:12:50.233 INFO:tasks.workunit.client.0.smithi144.stderr: -445> 2024-06-04T16:12:49.937+0000 7f9208b2a800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.144:3300/0 2024-06-04T16:12:50.233 INFO:tasks.workunit.client.0.smithi144.stderr: -444> 2024-06-04T16:12:49.937+0000 7f9208b2a800 1 librados: init done 2024-06-04T16:12:50.234 INFO:tasks.workunit.client.0.smithi144.stderr: -443> 2024-06-04T16:12:49.939+0000 7f90f0e09640 4 mgrc handle_mgr_map Got map version 5 2024-06-04T16:12:50.234 INFO:tasks.workunit.client.0.smithi144.stderr: -442> 2024-06-04T16:12:49.939+0000 7f90f0e09640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.177:6832/2645786330,v1:172.21.15.177:6833/2645786330] 2024-06-04T16:12:50.234 INFO:tasks.workunit.client.0.smithi144.stderr: -441> 2024-06-04T16:12:49.939+0000 7f90f0e09640 4 mgrc reconnect Starting new session with [v2:172.21.15.177:6832/2645786330,v1:172.21.15.177:6833/2645786330] 2024-06-04T16:12:50.234 INFO:tasks.workunit.client.0.smithi144.stderr: -440> 2024-06-04T16:12:49.939+0000 7f9203fe7640 10 monclient: get_auth_request con 0x7f90ec074cb0 auth_method 0 2024-06-04T16:12:50.234 INFO:tasks.workunit.client.0.smithi144.stderr: -439> 2024-06-04T16:12:49.939+0000 7f9204fe9640 10 monclient: get_auth_request con 0x5557c0139a60 auth_method 0 2024-06-04T16:12:50.234 INFO:tasks.workunit.client.0.smithi144.stderr: -438> 2024-06-04T16:12:49.940+0000 7f92047e8640 10 monclient: get_auth_request con 0x5557c015c4b0 auth_method 0 2024-06-04T16:12:50.234 INFO:tasks.workunit.client.0.smithi144.stderr: -437> 2024-06-04T16:12:49.941+0000 7f9203fe7640 10 monclient: get_auth_request con 0x5557c0160860 auth_method 0 2024-06-04T16:12:50.234 INFO:tasks.workunit.client.0.smithi144.stderr: -436> 2024-06-04T16:12:49.942+0000 7f9204fe9640 10 monclient: get_auth_request con 0x5557c015fd30 auth_method 0 2024-06-04T16:12:50.234 INFO:tasks.workunit.client.0.smithi144.stderr: -435> 2024-06-04T16:12:49.942+0000 7f9208b2a800 10 monclient: build_initial_monmap 2024-06-04T16:12:50.234 INFO:tasks.workunit.client.0.smithi144.stderr: -434> 2024-06-04T16:12:49.942+0000 7f9208b2a800 1 build_initial for_mkfs: 0 2024-06-04T16:12:50.234 INFO:tasks.workunit.client.0.smithi144.stderr: -433> 2024-06-04T16:12:49.942+0000 7f9208b2a800 10 monclient: monmap: 2024-06-04T16:12:50.234 INFO:tasks.workunit.client.0.smithi144.stderr:epoch 0 2024-06-04T16:12:50.234 INFO:tasks.workunit.client.0.smithi144.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-06-04T16:12:50.235 INFO:tasks.workunit.client.0.smithi144.stderr:last_changed 0.000000 2024-06-04T16:12:50.235 INFO:tasks.workunit.client.0.smithi144.stderr:created 0.000000 2024-06-04T16:12:50.235 INFO:tasks.workunit.client.0.smithi144.stderr:min_mon_release 0 (unknown) 2024-06-04T16:12:50.235 INFO:tasks.workunit.client.0.smithi144.stderr:election_strategy: 1 2024-06-04T16:12:50.235 INFO:tasks.workunit.client.0.smithi144.stderr:0: [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] mon.noname-a 2024-06-04T16:12:50.235 INFO:tasks.workunit.client.0.smithi144.stderr:1: [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] mon.noname-b 2024-06-04T16:12:50.235 INFO:tasks.workunit.client.0.smithi144.stderr:2: [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] mon.noname-c 2024-06-04T16:12:50.235 INFO:tasks.workunit.client.0.smithi144.stderr: 2024-06-04T16:12:50.235 INFO:tasks.workunit.client.0.smithi144.stderr: -432> 2024-06-04T16:12:49.942+0000 7f9208b2a800 5 AuthRegistry(0x5557c0168a10) adding auth protocol: cephx 2024-06-04T16:12:50.235 INFO:tasks.workunit.client.0.smithi144.stderr: -431> 2024-06-04T16:12:49.942+0000 7f9208b2a800 5 AuthRegistry(0x5557c0168a10) adding auth protocol: cephx 2024-06-04T16:12:50.235 INFO:tasks.workunit.client.0.smithi144.stderr: -430> 2024-06-04T16:12:49.942+0000 7f9208b2a800 5 AuthRegistry(0x5557c0168a10) adding auth protocol: cephx 2024-06-04T16:12:50.235 INFO:tasks.workunit.client.0.smithi144.stderr: -429> 2024-06-04T16:12:49.942+0000 7f9208b2a800 5 AuthRegistry(0x5557c0168a10) adding con mode: secure 2024-06-04T16:12:50.236 INFO:tasks.workunit.client.0.smithi144.stderr: -428> 2024-06-04T16:12:49.942+0000 7f9208b2a800 5 AuthRegistry(0x5557c0168a10) adding con mode: crc 2024-06-04T16:12:50.236 INFO:tasks.workunit.client.0.smithi144.stderr: -427> 2024-06-04T16:12:49.942+0000 7f9208b2a800 5 AuthRegistry(0x5557c0168a10) adding con mode: secure 2024-06-04T16:12:50.236 INFO:tasks.workunit.client.0.smithi144.stderr: -426> 2024-06-04T16:12:49.942+0000 7f9208b2a800 5 AuthRegistry(0x5557c0168a10) adding con mode: crc 2024-06-04T16:12:50.236 INFO:tasks.workunit.client.0.smithi144.stderr: -425> 2024-06-04T16:12:49.942+0000 7f9208b2a800 5 AuthRegistry(0x5557c0168a10) adding con mode: secure 2024-06-04T16:12:50.236 INFO:tasks.workunit.client.0.smithi144.stderr: -424> 2024-06-04T16:12:49.942+0000 7f9208b2a800 5 AuthRegistry(0x5557c0168a10) adding con mode: crc 2024-06-04T16:12:50.236 INFO:tasks.workunit.client.0.smithi144.stderr: -423> 2024-06-04T16:12:49.942+0000 7f9208b2a800 5 AuthRegistry(0x5557c0168a10) adding con mode: crc 2024-06-04T16:12:50.236 INFO:tasks.workunit.client.0.smithi144.stderr: -422> 2024-06-04T16:12:49.942+0000 7f9208b2a800 5 AuthRegistry(0x5557c0168a10) adding con mode: secure 2024-06-04T16:12:50.236 INFO:tasks.workunit.client.0.smithi144.stderr: -421> 2024-06-04T16:12:49.942+0000 7f9208b2a800 5 AuthRegistry(0x5557c0168a10) adding con mode: crc 2024-06-04T16:12:50.236 INFO:tasks.workunit.client.0.smithi144.stderr: -420> 2024-06-04T16:12:49.942+0000 7f9208b2a800 5 AuthRegistry(0x5557c0168a10) adding con mode: secure 2024-06-04T16:12:50.236 INFO:tasks.workunit.client.0.smithi144.stderr: -419> 2024-06-04T16:12:49.942+0000 7f9208b2a800 5 AuthRegistry(0x5557c0168a10) adding con mode: crc 2024-06-04T16:12:50.236 INFO:tasks.workunit.client.0.smithi144.stderr: -418> 2024-06-04T16:12:49.942+0000 7f9208b2a800 5 AuthRegistry(0x5557c0168a10) adding con mode: secure 2024-06-04T16:12:50.236 INFO:tasks.workunit.client.0.smithi144.stderr: -417> 2024-06-04T16:12:49.943+0000 7f9208b2a800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-06-04T16:12:50.236 INFO:tasks.workunit.client.0.smithi144.stderr: -416> 2024-06-04T16:12:49.943+0000 7f9208b2a800 5 asok(0x5557bfef0c60) register_command objecter_requests cmddesc objecter_requests hook 0x5557c016bf90 EEXIST 2024-06-04T16:12:50.236 INFO:tasks.workunit.client.0.smithi144.stderr: -415> 2024-06-04T16:12:49.943+0000 7f9208b2a800 10 monclient: init 2024-06-04T16:12:50.237 INFO:tasks.workunit.client.0.smithi144.stderr: -414> 2024-06-04T16:12:49.943+0000 7f9208b2a800 5 AuthRegistry(0x5557c0167908) adding auth protocol: cephx 2024-06-04T16:12:50.237 INFO:tasks.workunit.client.0.smithi144.stderr: -413> 2024-06-04T16:12:49.943+0000 7f9208b2a800 5 AuthRegistry(0x5557c0167908) adding auth protocol: cephx 2024-06-04T16:12:50.237 INFO:tasks.workunit.client.0.smithi144.stderr: -412> 2024-06-04T16:12:49.943+0000 7f9208b2a800 5 AuthRegistry(0x5557c0167908) adding auth protocol: cephx 2024-06-04T16:12:50.237 INFO:tasks.workunit.client.0.smithi144.stderr: -411> 2024-06-04T16:12:49.943+0000 7f9208b2a800 5 AuthRegistry(0x5557c0167908) adding con mode: secure 2024-06-04T16:12:50.237 INFO:tasks.workunit.client.0.smithi144.stderr: -410> 2024-06-04T16:12:49.943+0000 7f9208b2a800 5 AuthRegistry(0x5557c0167908) adding con mode: crc 2024-06-04T16:12:50.237 INFO:tasks.workunit.client.0.smithi144.stderr: -409> 2024-06-04T16:12:49.943+0000 7f9208b2a800 5 AuthRegistry(0x5557c0167908) adding con mode: secure 2024-06-04T16:12:50.237 INFO:tasks.workunit.client.0.smithi144.stderr: -408> 2024-06-04T16:12:49.943+0000 7f9208b2a800 5 AuthRegistry(0x5557c0167908) adding con mode: crc 2024-06-04T16:12:50.237 INFO:tasks.workunit.client.0.smithi144.stderr: -407> 2024-06-04T16:12:49.943+0000 7f9208b2a800 5 AuthRegistry(0x5557c0167908) adding con mode: secure 2024-06-04T16:12:50.237 INFO:tasks.workunit.client.0.smithi144.stderr: -406> 2024-06-04T16:12:49.943+0000 7f9208b2a800 5 AuthRegistry(0x5557c0167908) adding con mode: crc 2024-06-04T16:12:50.237 INFO:tasks.workunit.client.0.smithi144.stderr: -405> 2024-06-04T16:12:49.943+0000 7f9208b2a800 5 AuthRegistry(0x5557c0167908) adding con mode: crc 2024-06-04T16:12:50.237 INFO:tasks.workunit.client.0.smithi144.stderr: -404> 2024-06-04T16:12:49.943+0000 7f9208b2a800 5 AuthRegistry(0x5557c0167908) adding con mode: secure 2024-06-04T16:12:50.237 INFO:tasks.workunit.client.0.smithi144.stderr: -403> 2024-06-04T16:12:49.943+0000 7f9208b2a800 5 AuthRegistry(0x5557c0167908) adding con mode: crc 2024-06-04T16:12:50.237 INFO:tasks.workunit.client.0.smithi144.stderr: -402> 2024-06-04T16:12:49.943+0000 7f9208b2a800 5 AuthRegistry(0x5557c0167908) adding con mode: secure 2024-06-04T16:12:50.238 INFO:tasks.workunit.client.0.smithi144.stderr: -401> 2024-06-04T16:12:49.943+0000 7f9208b2a800 5 AuthRegistry(0x5557c0167908) adding con mode: crc 2024-06-04T16:12:50.238 INFO:tasks.workunit.client.0.smithi144.stderr: -400> 2024-06-04T16:12:49.943+0000 7f9208b2a800 5 AuthRegistry(0x5557c0167908) adding con mode: secure 2024-06-04T16:12:50.238 INFO:tasks.workunit.client.0.smithi144.stderr: -399> 2024-06-04T16:12:49.943+0000 7f9208b2a800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-06-04T16:12:50.238 INFO:tasks.workunit.client.0.smithi144.stderr: -398> 2024-06-04T16:12:49.943+0000 7f9208b2a800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-06-04T16:12:50.238 INFO:tasks.workunit.client.0.smithi144.stderr: -397> 2024-06-04T16:12:49.943+0000 7f9208b2a800 5 asok(0x5557bfef0c60) register_command rotate-key cmddesc rotate-key hook 0x5557c0167a50 EEXIST 2024-06-04T16:12:50.238 INFO:tasks.workunit.client.0.smithi144.stderr: -396> 2024-06-04T16:12:49.943+0000 7f9208b2a800 10 monclient: _reopen_session rank -1 2024-06-04T16:12:50.238 INFO:tasks.workunit.client.0.smithi144.stderr: -395> 2024-06-04T16:12:49.943+0000 7f9208b2a800 10 monclient: _add_conns ranks=[1,0,2] 2024-06-04T16:12:50.238 INFO:tasks.workunit.client.0.smithi144.stderr: -394> 2024-06-04T16:12:49.943+0000 7f9208b2a800 10 monclient(hunting): picked mon.noname-b con 0x5557bff993c0 addr [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] 2024-06-04T16:12:50.238 INFO:tasks.workunit.client.0.smithi144.stderr: -393> 2024-06-04T16:12:49.943+0000 7f9208b2a800 10 monclient(hunting): picked mon.noname-a con 0x5557c01734c0 addr [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] 2024-06-04T16:12:50.238 INFO:tasks.workunit.client.0.smithi144.stderr: -392> 2024-06-04T16:12:49.943+0000 7f9208b2a800 10 monclient(hunting): picked mon.noname-c con 0x5557c0195920 addr [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] 2024-06-04T16:12:50.239 INFO:tasks.workunit.client.0.smithi144.stderr: -391> 2024-06-04T16:12:49.943+0000 7f9208b2a800 10 monclient(hunting): start opening mon connection 2024-06-04T16:12:50.239 INFO:tasks.workunit.client.0.smithi144.stderr: -390> 2024-06-04T16:12:49.943+0000 7f9208b2a800 10 monclient(hunting): start opening mon connection 2024-06-04T16:12:50.239 INFO:tasks.workunit.client.0.smithi144.stderr: -389> 2024-06-04T16:12:49.943+0000 7f9208b2a800 10 monclient(hunting): start opening mon connection 2024-06-04T16:12:50.239 INFO:tasks.workunit.client.0.smithi144.stderr: -388> 2024-06-04T16:12:49.943+0000 7f9208b2a800 10 monclient(hunting): _renew_subs 2024-06-04T16:12:50.239 INFO:tasks.workunit.client.0.smithi144.stderr: -387> 2024-06-04T16:12:49.943+0000 7f9208b2a800 10 monclient(hunting): authenticate will time out at 2007.759907s 2024-06-04T16:12:50.239 INFO:tasks.workunit.client.0.smithi144.stderr: -386> 2024-06-04T16:12:49.943+0000 7f9204fe9640 10 monclient(hunting): get_auth_request con 0x5557c01734c0 auth_method 0 2024-06-04T16:12:50.239 INFO:tasks.workunit.client.0.smithi144.stderr: -385> 2024-06-04T16:12:49.943+0000 7f9204fe9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-06-04T16:12:50.239 INFO:tasks.workunit.client.0.smithi144.stderr: -384> 2024-06-04T16:12:49.943+0000 7f9204fe9640 10 monclient(hunting): _init_auth method 2 2024-06-04T16:12:50.239 INFO:tasks.workunit.client.0.smithi144.stderr: -383> 2024-06-04T16:12:49.943+0000 7f9204fe9640 10 monclient(hunting): _init_auth creating new auth 2024-06-04T16:12:50.239 INFO:tasks.workunit.client.0.smithi144.stderr: -382> 2024-06-04T16:12:49.943+0000 7f92047e8640 10 monclient(hunting): get_auth_request con 0x5557c0195920 auth_method 0 2024-06-04T16:12:50.239 INFO:tasks.workunit.client.0.smithi144.stderr: -381> 2024-06-04T16:12:49.943+0000 7f92047e8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-06-04T16:12:50.239 INFO:tasks.workunit.client.0.smithi144.stderr: -380> 2024-06-04T16:12:49.943+0000 7f92047e8640 10 monclient(hunting): _init_auth method 2 2024-06-04T16:12:50.239 INFO:tasks.workunit.client.0.smithi144.stderr: -379> 2024-06-04T16:12:49.943+0000 7f92047e8640 10 monclient(hunting): _init_auth creating new auth 2024-06-04T16:12:50.239 INFO:tasks.workunit.client.0.smithi144.stderr: -378> 2024-06-04T16:12:49.943+0000 7f9204fe9640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-06-04T16:12:50.240 INFO:tasks.workunit.client.0.smithi144.stderr: -377> 2024-06-04T16:12:49.943+0000 7f9204fe9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-06-04T16:12:50.240 INFO:tasks.workunit.client.0.smithi144.stderr: -376> 2024-06-04T16:12:49.943+0000 7f9204fe9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-06-04T16:12:50.240 INFO:tasks.workunit.client.0.smithi144.stderr: -375> 2024-06-04T16:12:49.943+0000 7f9203fe7640 10 monclient(hunting): get_auth_request con 0x5557bff993c0 auth_method 0 2024-06-04T16:12:50.240 INFO:tasks.workunit.client.0.smithi144.stderr: -374> 2024-06-04T16:12:49.943+0000 7f9203fe7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-06-04T16:12:50.240 INFO:tasks.workunit.client.0.smithi144.stderr: -373> 2024-06-04T16:12:49.943+0000 7f9203fe7640 10 monclient(hunting): _init_auth method 2 2024-06-04T16:12:50.240 INFO:tasks.workunit.client.0.smithi144.stderr: -372> 2024-06-04T16:12:49.943+0000 7f9203fe7640 10 monclient(hunting): _init_auth creating new auth 2024-06-04T16:12:50.240 INFO:tasks.workunit.client.0.smithi144.stderr: -371> 2024-06-04T16:12:49.943+0000 7f92047e8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-06-04T16:12:50.240 INFO:tasks.workunit.client.0.smithi144.stderr: -370> 2024-06-04T16:12:49.943+0000 7f92047e8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-06-04T16:12:50.240 INFO:tasks.workunit.client.0.smithi144.stderr: -369> 2024-06-04T16:12:49.944+0000 7f92047e8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-06-04T16:12:50.240 INFO:tasks.workunit.client.0.smithi144.stderr: -368> 2024-06-04T16:12:49.944+0000 7f9203fe7640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-06-04T16:12:50.240 INFO:tasks.workunit.client.0.smithi144.stderr: -367> 2024-06-04T16:12:49.944+0000 7f9203fe7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-06-04T16:12:50.240 INFO:tasks.workunit.client.0.smithi144.stderr: -366> 2024-06-04T16:12:49.944+0000 7f9203fe7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-06-04T16:12:50.241 INFO:tasks.workunit.client.0.smithi144.stderr: -365> 2024-06-04T16:12:49.944+0000 7f9204fe9640 10 monclient(hunting): handle_auth_done global_id 6744 payload 824 2024-06-04T16:12:50.241 INFO:tasks.workunit.client.0.smithi144.stderr: -364> 2024-06-04T16:12:49.944+0000 7f9204fe9640 10 monclient: _finish_hunting 0 2024-06-04T16:12:50.241 INFO:tasks.workunit.client.0.smithi144.stderr: -363> 2024-06-04T16:12:49.944+0000 7f9204fe9640 1 monclient: found mon.noname-a 2024-06-04T16:12:50.241 INFO:tasks.workunit.client.0.smithi144.stderr: -362> 2024-06-04T16:12:49.944+0000 7f9204fe9640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.144:3300/0 2024-06-04T16:12:50.241 INFO:tasks.workunit.client.0.smithi144.stderr: -361> 2024-06-04T16:12:49.944+0000 7f90e9ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-06-04T16:12:50.241 INFO:tasks.workunit.client.0.smithi144.stderr: -360> 2024-06-04T16:12:49.944+0000 7f90e9ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-06-04T16:12:50.241 INFO:tasks.workunit.client.0.smithi144.stderr: -359> 2024-06-04T16:12:49.944+0000 7f90e9ffb640 10 monclient: dump: 2024-06-04T16:12:50.241 INFO:tasks.workunit.client.0.smithi144.stderr:epoch 1 2024-06-04T16:12:50.241 INFO:tasks.workunit.client.0.smithi144.stderr:fsid 15e56bb1-4856-42f3-b6db-a2c8f23c5557 2024-06-04T16:12:50.241 INFO:tasks.workunit.client.0.smithi144.stderr:last_changed 2024-06-04T15:51:29.789359+0000 2024-06-04T16:12:50.241 INFO:tasks.workunit.client.0.smithi144.stderr:created 2024-06-04T15:51:29.789359+0000 2024-06-04T16:12:50.241 INFO:tasks.workunit.client.0.smithi144.stderr:min_mon_release 19 (squid) 2024-06-04T16:12:50.241 INFO:tasks.workunit.client.0.smithi144.stderr:election_strategy: 1 2024-06-04T16:12:50.241 INFO:tasks.workunit.client.0.smithi144.stderr:0: [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] mon.a 2024-06-04T16:12:50.242 INFO:tasks.workunit.client.0.smithi144.stderr:1: [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] mon.b 2024-06-04T16:12:50.242 INFO:tasks.workunit.client.0.smithi144.stderr:2: [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] mon.c 2024-06-04T16:12:50.242 INFO:tasks.workunit.client.0.smithi144.stderr: 2024-06-04T16:12:50.242 INFO:tasks.workunit.client.0.smithi144.stderr: -358> 2024-06-04T16:12:49.944+0000 7f90e9ffb640 10 monclient: _finish_auth 0 2024-06-04T16:12:50.242 INFO:tasks.workunit.client.0.smithi144.stderr: -357> 2024-06-04T16:12:49.944+0000 7f90e9ffb640 10 monclient: _check_auth_tickets 2024-06-04T16:12:50.242 INFO:tasks.workunit.client.0.smithi144.stderr: -356> 2024-06-04T16:12:49.944+0000 7f90e9ffb640 10 monclient: handle_config config(0 keys) 2024-06-04T16:12:50.242 INFO:tasks.workunit.client.0.smithi144.stderr: -355> 2024-06-04T16:12:49.944+0000 7f90e9ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-06-04T16:12:50.242 INFO:tasks.workunit.client.0.smithi144.stderr: -354> 2024-06-04T16:12:49.944+0000 7f90e9ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-06-04T16:12:50.242 INFO:tasks.workunit.client.0.smithi144.stderr: -353> 2024-06-04T16:12:49.944+0000 7f90e9ffb640 10 monclient: dump: 2024-06-04T16:12:50.242 INFO:tasks.workunit.client.0.smithi144.stderr:epoch 1 2024-06-04T16:12:50.242 INFO:tasks.workunit.client.0.smithi144.stderr:fsid 15e56bb1-4856-42f3-b6db-a2c8f23c5557 2024-06-04T16:12:50.242 INFO:tasks.workunit.client.0.smithi144.stderr:last_changed 2024-06-04T15:51:29.789359+0000 2024-06-04T16:12:50.243 INFO:tasks.workunit.client.0.smithi144.stderr:created 2024-06-04T15:51:29.789359+0000 2024-06-04T16:12:50.243 INFO:tasks.workunit.client.0.smithi144.stderr:min_mon_release 19 (squid) 2024-06-04T16:12:50.243 INFO:tasks.workunit.client.0.smithi144.stderr:election_strategy: 1 2024-06-04T16:12:50.243 INFO:tasks.workunit.client.0.smithi144.stderr:0: [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] mon.a 2024-06-04T16:12:50.243 INFO:tasks.workunit.client.0.smithi144.stderr:1: [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] mon.b 2024-06-04T16:12:50.243 INFO:tasks.workunit.client.0.smithi144.stderr:2: [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] mon.c 2024-06-04T16:12:50.243 INFO:tasks.workunit.client.0.smithi144.stderr: 2024-06-04T16:12:50.243 INFO:tasks.workunit.client.0.smithi144.stderr: -352> 2024-06-04T16:12:49.944+0000 7f9208b2a800 5 monclient: authenticate success, global_id 6744 2024-06-04T16:12:50.243 INFO:tasks.workunit.client.0.smithi144.stderr: -351> 2024-06-04T16:12:49.944+0000 7f9208b2a800 10 monclient: _renew_subs 2024-06-04T16:12:50.243 INFO:tasks.workunit.client.0.smithi144.stderr: -350> 2024-06-04T16:12:49.944+0000 7f92057ea640 4 set_mon_vals no callback set 2024-06-04T16:12:50.243 INFO:tasks.workunit.client.0.smithi144.stderr: -349> 2024-06-04T16:12:49.944+0000 7f9208b2a800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.144:3300/0 2024-06-04T16:12:50.243 INFO:tasks.workunit.client.0.smithi144.stderr: -348> 2024-06-04T16:12:49.944+0000 7f9208b2a800 10 monclient: _renew_subs 2024-06-04T16:12:50.243 INFO:tasks.workunit.client.0.smithi144.stderr: -347> 2024-06-04T16:12:49.944+0000 7f9208b2a800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.144:3300/0 2024-06-04T16:12:50.243 INFO:tasks.workunit.client.0.smithi144.stderr: -346> 2024-06-04T16:12:49.946+0000 7f90e9ffb640 4 mgrc handle_mgr_map Got map version 5 2024-06-04T16:12:50.244 INFO:tasks.workunit.client.0.smithi144.stderr: -345> 2024-06-04T16:12:49.946+0000 7f90e9ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.177:6832/2645786330,v1:172.21.15.177:6833/2645786330] 2024-06-04T16:12:50.244 INFO:tasks.workunit.client.0.smithi144.stderr: -344> 2024-06-04T16:12:49.946+0000 7f90e9ffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.177:6832/2645786330,v1:172.21.15.177:6833/2645786330] 2024-06-04T16:12:50.244 INFO:tasks.workunit.client.0.smithi144.stderr: -343> 2024-06-04T16:12:49.946+0000 7f9203fe7640 10 monclient: get_auth_request con 0x7f90dc074bf0 auth_method 0 2024-06-04T16:12:50.244 INFO:tasks.workunit.client.0.smithi144.stderr: -342> 2024-06-04T16:12:49.946+0000 7f9208b2a800 10 monclient: get_monmap_and_config 2024-06-04T16:12:50.244 INFO:tasks.workunit.client.0.smithi144.stderr: -341> 2024-06-04T16:12:49.946+0000 7f9208b2a800 10 monclient: build_initial_monmap 2024-06-04T16:12:50.244 INFO:tasks.workunit.client.0.smithi144.stderr: -340> 2024-06-04T16:12:49.946+0000 7f9208b2a800 1 build_initial for_mkfs: 0 2024-06-04T16:12:50.244 INFO:tasks.workunit.client.0.smithi144.stderr: -339> 2024-06-04T16:12:49.946+0000 7f9208b2a800 10 monclient: monmap: 2024-06-04T16:12:50.244 INFO:tasks.workunit.client.0.smithi144.stderr:epoch 0 2024-06-04T16:12:50.244 INFO:tasks.workunit.client.0.smithi144.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-06-04T16:12:50.244 INFO:tasks.workunit.client.0.smithi144.stderr:last_changed 0.000000 2024-06-04T16:12:50.244 INFO:tasks.workunit.client.0.smithi144.stderr:created 0.000000 2024-06-04T16:12:50.244 INFO:tasks.workunit.client.0.smithi144.stderr:min_mon_release 0 (unknown) 2024-06-04T16:12:50.244 INFO:tasks.workunit.client.0.smithi144.stderr:election_strategy: 1 2024-06-04T16:12:50.245 INFO:tasks.workunit.client.0.smithi144.stderr:0: [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] mon.noname-a 2024-06-04T16:12:50.245 INFO:tasks.workunit.client.0.smithi144.stderr:1: [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] mon.noname-b 2024-06-04T16:12:50.245 INFO:tasks.workunit.client.0.smithi144.stderr:2: [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] mon.noname-c 2024-06-04T16:12:50.245 INFO:tasks.workunit.client.0.smithi144.stderr: 2024-06-04T16:12:50.245 INFO:tasks.workunit.client.0.smithi144.stderr: -338> 2024-06-04T16:12:49.946+0000 7f9208b2a800 5 AuthRegistry(0x5557c01b1220) adding auth protocol: cephx 2024-06-04T16:12:50.245 INFO:tasks.workunit.client.0.smithi144.stderr: -337> 2024-06-04T16:12:49.946+0000 7f9208b2a800 5 AuthRegistry(0x5557c01b1220) adding auth protocol: cephx 2024-06-04T16:12:50.245 INFO:tasks.workunit.client.0.smithi144.stderr: -336> 2024-06-04T16:12:49.946+0000 7f9208b2a800 5 AuthRegistry(0x5557c01b1220) adding auth protocol: cephx 2024-06-04T16:12:50.245 INFO:tasks.workunit.client.0.smithi144.stderr: -335> 2024-06-04T16:12:49.946+0000 7f9208b2a800 5 AuthRegistry(0x5557c01b1220) adding con mode: secure 2024-06-04T16:12:50.245 INFO:tasks.workunit.client.0.smithi144.stderr: -334> 2024-06-04T16:12:49.946+0000 7f9208b2a800 5 AuthRegistry(0x5557c01b1220) adding con mode: crc 2024-06-04T16:12:50.245 INFO:tasks.workunit.client.0.smithi144.stderr: -333> 2024-06-04T16:12:49.946+0000 7f9208b2a800 5 AuthRegistry(0x5557c01b1220) adding con mode: secure 2024-06-04T16:12:50.245 INFO:tasks.workunit.client.0.smithi144.stderr: -332> 2024-06-04T16:12:49.946+0000 7f9208b2a800 5 AuthRegistry(0x5557c01b1220) adding con mode: crc 2024-06-04T16:12:50.245 INFO:tasks.workunit.client.0.smithi144.stderr: -331> 2024-06-04T16:12:49.946+0000 7f9208b2a800 5 AuthRegistry(0x5557c01b1220) adding con mode: secure 2024-06-04T16:12:50.246 INFO:tasks.workunit.client.0.smithi144.stderr: -330> 2024-06-04T16:12:49.946+0000 7f9208b2a800 5 AuthRegistry(0x5557c01b1220) adding con mode: crc 2024-06-04T16:12:50.246 INFO:tasks.workunit.client.0.smithi144.stderr: -329> 2024-06-04T16:12:49.946+0000 7f9208b2a800 5 AuthRegistry(0x5557c01b1220) adding con mode: crc 2024-06-04T16:12:50.246 INFO:tasks.workunit.client.0.smithi144.stderr: -328> 2024-06-04T16:12:49.946+0000 7f9208b2a800 5 AuthRegistry(0x5557c01b1220) adding con mode: secure 2024-06-04T16:12:50.246 INFO:tasks.workunit.client.0.smithi144.stderr: -327> 2024-06-04T16:12:49.946+0000 7f9208b2a800 5 AuthRegistry(0x5557c01b1220) adding con mode: crc 2024-06-04T16:12:50.246 INFO:tasks.workunit.client.0.smithi144.stderr: -326> 2024-06-04T16:12:49.946+0000 7f9208b2a800 5 AuthRegistry(0x5557c01b1220) adding con mode: secure 2024-06-04T16:12:50.246 INFO:tasks.workunit.client.0.smithi144.stderr: -325> 2024-06-04T16:12:49.946+0000 7f9208b2a800 5 AuthRegistry(0x5557c01b1220) adding con mode: crc 2024-06-04T16:12:50.246 INFO:tasks.workunit.client.0.smithi144.stderr: -324> 2024-06-04T16:12:49.946+0000 7f9208b2a800 5 AuthRegistry(0x5557c01b1220) adding con mode: secure 2024-06-04T16:12:50.246 INFO:tasks.workunit.client.0.smithi144.stderr: -323> 2024-06-04T16:12:49.946+0000 7f9208b2a800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-06-04T16:12:50.246 INFO:tasks.workunit.client.0.smithi144.stderr: -322> 2024-06-04T16:12:49.947+0000 7f9208b2a800 10 monclient: init 2024-06-04T16:12:50.246 INFO:tasks.workunit.client.0.smithi144.stderr: -321> 2024-06-04T16:12:49.947+0000 7f9208b2a800 5 AuthRegistry(0x7ffecc2fe0a0) adding auth protocol: cephx 2024-06-04T16:12:50.246 INFO:tasks.workunit.client.0.smithi144.stderr: -320> 2024-06-04T16:12:49.947+0000 7f9208b2a800 5 AuthRegistry(0x7ffecc2fe0a0) adding auth protocol: cephx 2024-06-04T16:12:50.246 INFO:tasks.workunit.client.0.smithi144.stderr: -319> 2024-06-04T16:12:49.947+0000 7f9208b2a800 5 AuthRegistry(0x7ffecc2fe0a0) adding auth protocol: cephx 2024-06-04T16:12:50.247 INFO:tasks.workunit.client.0.smithi144.stderr: -318> 2024-06-04T16:12:49.947+0000 7f9208b2a800 5 AuthRegistry(0x7ffecc2fe0a0) adding con mode: secure 2024-06-04T16:12:50.247 INFO:tasks.workunit.client.0.smithi144.stderr: -317> 2024-06-04T16:12:49.947+0000 7f9208b2a800 5 AuthRegistry(0x7ffecc2fe0a0) adding con mode: crc 2024-06-04T16:12:50.247 INFO:tasks.workunit.client.0.smithi144.stderr: -316> 2024-06-04T16:12:49.947+0000 7f9208b2a800 5 AuthRegistry(0x7ffecc2fe0a0) adding con mode: secure 2024-06-04T16:12:50.247 INFO:tasks.workunit.client.0.smithi144.stderr: -315> 2024-06-04T16:12:49.947+0000 7f9208b2a800 5 AuthRegistry(0x7ffecc2fe0a0) adding con mode: crc 2024-06-04T16:12:50.247 INFO:tasks.workunit.client.0.smithi144.stderr: -314> 2024-06-04T16:12:49.947+0000 7f9208b2a800 5 AuthRegistry(0x7ffecc2fe0a0) adding con mode: secure 2024-06-04T16:12:50.247 INFO:tasks.workunit.client.0.smithi144.stderr: -313> 2024-06-04T16:12:49.947+0000 7f9208b2a800 5 AuthRegistry(0x7ffecc2fe0a0) adding con mode: crc 2024-06-04T16:12:50.247 INFO:tasks.workunit.client.0.smithi144.stderr: -312> 2024-06-04T16:12:49.947+0000 7f9208b2a800 5 AuthRegistry(0x7ffecc2fe0a0) adding con mode: crc 2024-06-04T16:12:50.247 INFO:tasks.workunit.client.0.smithi144.stderr: -311> 2024-06-04T16:12:49.947+0000 7f9208b2a800 5 AuthRegistry(0x7ffecc2fe0a0) adding con mode: secure 2024-06-04T16:12:50.247 INFO:tasks.workunit.client.0.smithi144.stderr: -310> 2024-06-04T16:12:49.947+0000 7f9208b2a800 5 AuthRegistry(0x7ffecc2fe0a0) adding con mode: crc 2024-06-04T16:12:50.247 INFO:tasks.workunit.client.0.smithi144.stderr: -309> 2024-06-04T16:12:49.947+0000 7f9208b2a800 5 AuthRegistry(0x7ffecc2fe0a0) adding con mode: secure 2024-06-04T16:12:50.247 INFO:tasks.workunit.client.0.smithi144.stderr: -308> 2024-06-04T16:12:49.947+0000 7f9208b2a800 5 AuthRegistry(0x7ffecc2fe0a0) adding con mode: crc 2024-06-04T16:12:50.247 INFO:tasks.workunit.client.0.smithi144.stderr: -307> 2024-06-04T16:12:49.947+0000 7f9208b2a800 5 AuthRegistry(0x7ffecc2fe0a0) adding con mode: secure 2024-06-04T16:12:50.248 INFO:tasks.workunit.client.0.smithi144.stderr: -306> 2024-06-04T16:12:49.947+0000 7f9208b2a800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-06-04T16:12:50.248 INFO:tasks.workunit.client.0.smithi144.stderr: -305> 2024-06-04T16:12:49.947+0000 7f9208b2a800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-06-04T16:12:50.248 INFO:tasks.workunit.client.0.smithi144.stderr: -304> 2024-06-04T16:12:49.947+0000 7f9208b2a800 5 asok(0x5557bfef0c60) register_command rotate-key cmddesc rotate-key hook 0x7ffecc2fe1e8 EEXIST 2024-06-04T16:12:50.248 INFO:tasks.workunit.client.0.smithi144.stderr: -303> 2024-06-04T16:12:49.947+0000 7f9208b2a800 10 monclient: _reopen_session rank -1 2024-06-04T16:12:50.248 INFO:tasks.workunit.client.0.smithi144.stderr: -302> 2024-06-04T16:12:49.947+0000 7f9208b2a800 10 monclient: _add_conns ranks=[0,2,1] 2024-06-04T16:12:50.248 INFO:tasks.workunit.client.0.smithi144.stderr: -301> 2024-06-04T16:12:49.947+0000 7f9208b2a800 10 monclient(hunting): picked mon.noname-a con 0x5557c01e10e0 addr [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] 2024-06-04T16:12:50.248 INFO:tasks.workunit.client.0.smithi144.stderr: -300> 2024-06-04T16:12:49.947+0000 7f9208b2a800 10 monclient(hunting): picked mon.noname-c con 0x5557c01e14c0 addr [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] 2024-06-04T16:12:50.248 INFO:tasks.workunit.client.0.smithi144.stderr: -299> 2024-06-04T16:12:49.947+0000 7f9208b2a800 10 monclient(hunting): picked mon.noname-b con 0x5557c01de260 addr [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] 2024-06-04T16:12:50.248 INFO:tasks.workunit.client.0.smithi144.stderr: -298> 2024-06-04T16:12:49.947+0000 7f9208b2a800 10 monclient(hunting): start opening mon connection 2024-06-04T16:12:50.248 INFO:tasks.workunit.client.0.smithi144.stderr: -297> 2024-06-04T16:12:49.947+0000 7f9208b2a800 10 monclient(hunting): start opening mon connection 2024-06-04T16:12:50.248 INFO:tasks.workunit.client.0.smithi144.stderr: -296> 2024-06-04T16:12:49.947+0000 7f9208b2a800 10 monclient(hunting): start opening mon connection 2024-06-04T16:12:50.248 INFO:tasks.workunit.client.0.smithi144.stderr: -295> 2024-06-04T16:12:49.947+0000 7f9208b2a800 10 monclient(hunting): _renew_subs 2024-06-04T16:12:50.248 INFO:tasks.workunit.client.0.smithi144.stderr: -294> 2024-06-04T16:12:49.947+0000 7f9208b2a800 10 monclient(hunting): authenticate will time out at 2007.763738s 2024-06-04T16:12:50.249 INFO:tasks.workunit.client.0.smithi144.stderr: -293> 2024-06-04T16:12:49.947+0000 7f9203fe7640 10 monclient(hunting): get_auth_request con 0x5557c01e10e0 auth_method 0 2024-06-04T16:12:50.249 INFO:tasks.workunit.client.0.smithi144.stderr: -292> 2024-06-04T16:12:49.947+0000 7f9203fe7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-06-04T16:12:50.249 INFO:tasks.workunit.client.0.smithi144.stderr: -291> 2024-06-04T16:12:49.947+0000 7f9203fe7640 10 monclient(hunting): _init_auth method 2 2024-06-04T16:12:50.249 INFO:tasks.workunit.client.0.smithi144.stderr: -290> 2024-06-04T16:12:49.947+0000 7f9203fe7640 10 monclient(hunting): _init_auth creating new auth 2024-06-04T16:12:50.249 INFO:tasks.workunit.client.0.smithi144.stderr: -289> 2024-06-04T16:12:49.947+0000 7f9204fe9640 10 monclient(hunting): get_auth_request con 0x5557c01e14c0 auth_method 0 2024-06-04T16:12:50.249 INFO:tasks.workunit.client.0.smithi144.stderr: -288> 2024-06-04T16:12:49.947+0000 7f9204fe9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-06-04T16:12:50.249 INFO:tasks.workunit.client.0.smithi144.stderr: -287> 2024-06-04T16:12:49.947+0000 7f9204fe9640 10 monclient(hunting): _init_auth method 2 2024-06-04T16:12:50.249 INFO:tasks.workunit.client.0.smithi144.stderr: -286> 2024-06-04T16:12:49.947+0000 7f9204fe9640 10 monclient(hunting): _init_auth creating new auth 2024-06-04T16:12:50.249 INFO:tasks.workunit.client.0.smithi144.stderr: -285> 2024-06-04T16:12:49.947+0000 7f9204fe9640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-06-04T16:12:50.249 INFO:tasks.workunit.client.0.smithi144.stderr: -284> 2024-06-04T16:12:49.947+0000 7f9204fe9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-06-04T16:12:50.249 INFO:tasks.workunit.client.0.smithi144.stderr: -283> 2024-06-04T16:12:49.947+0000 7f9204fe9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-06-04T16:12:50.249 INFO:tasks.workunit.client.0.smithi144.stderr: -282> 2024-06-04T16:12:49.947+0000 7f92047e8640 10 monclient(hunting): get_auth_request con 0x5557c01de260 auth_method 0 2024-06-04T16:12:50.249 INFO:tasks.workunit.client.0.smithi144.stderr: -281> 2024-06-04T16:12:49.947+0000 7f92047e8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-06-04T16:12:50.250 INFO:tasks.workunit.client.0.smithi144.stderr: -280> 2024-06-04T16:12:49.947+0000 7f92047e8640 10 monclient(hunting): _init_auth method 2 2024-06-04T16:12:50.250 INFO:tasks.workunit.client.0.smithi144.stderr: -279> 2024-06-04T16:12:49.947+0000 7f92047e8640 10 monclient(hunting): _init_auth creating new auth 2024-06-04T16:12:50.250 INFO:tasks.workunit.client.0.smithi144.stderr: -278> 2024-06-04T16:12:49.947+0000 7f9203fe7640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-06-04T16:12:50.250 INFO:tasks.workunit.client.0.smithi144.stderr: -277> 2024-06-04T16:12:49.947+0000 7f9203fe7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-06-04T16:12:50.250 INFO:tasks.workunit.client.0.smithi144.stderr: -276> 2024-06-04T16:12:49.947+0000 7f9203fe7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-06-04T16:12:50.250 INFO:tasks.workunit.client.0.smithi144.stderr: -275> 2024-06-04T16:12:49.947+0000 7f92047e8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-06-04T16:12:50.250 INFO:tasks.workunit.client.0.smithi144.stderr: -274> 2024-06-04T16:12:49.947+0000 7f92047e8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-06-04T16:12:50.250 INFO:tasks.workunit.client.0.smithi144.stderr: -273> 2024-06-04T16:12:49.947+0000 7f92047e8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-06-04T16:12:50.250 INFO:tasks.workunit.client.0.smithi144.stderr: -272> 2024-06-04T16:12:49.947+0000 7f9204fe9640 10 monclient(hunting): handle_auth_done global_id 6389 payload 274 2024-06-04T16:12:50.250 INFO:tasks.workunit.client.0.smithi144.stderr: -271> 2024-06-04T16:12:49.947+0000 7f9204fe9640 10 monclient: _finish_hunting 0 2024-06-04T16:12:50.250 INFO:tasks.workunit.client.0.smithi144.stderr: -270> 2024-06-04T16:12:49.947+0000 7f9204fe9640 1 monclient: found mon.noname-c 2024-06-04T16:12:50.250 INFO:tasks.workunit.client.0.smithi144.stderr: -269> 2024-06-04T16:12:49.947+0000 7f9204fe9640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.144:3301/0 2024-06-04T16:12:50.251 INFO:tasks.workunit.client.0.smithi144.stderr: -268> 2024-06-04T16:12:49.948+0000 7f90db7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-06-04T16:12:50.251 INFO:tasks.workunit.client.0.smithi144.stderr: -267> 2024-06-04T16:12:49.948+0000 7f90db7fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-06-04T16:12:50.251 INFO:tasks.workunit.client.0.smithi144.stderr: -266> 2024-06-04T16:12:49.948+0000 7f90db7fe640 10 monclient: dump: 2024-06-04T16:12:50.251 INFO:tasks.workunit.client.0.smithi144.stderr:epoch 1 2024-06-04T16:12:50.251 INFO:tasks.workunit.client.0.smithi144.stderr:fsid 15e56bb1-4856-42f3-b6db-a2c8f23c5557 2024-06-04T16:12:50.251 INFO:tasks.workunit.client.0.smithi144.stderr:last_changed 2024-06-04T15:51:29.789359+0000 2024-06-04T16:12:50.251 INFO:tasks.workunit.client.0.smithi144.stderr:created 2024-06-04T15:51:29.789359+0000 2024-06-04T16:12:50.251 INFO:tasks.workunit.client.0.smithi144.stderr:min_mon_release 19 (squid) 2024-06-04T16:12:50.251 INFO:tasks.workunit.client.0.smithi144.stderr:election_strategy: 1 2024-06-04T16:12:50.251 INFO:tasks.workunit.client.0.smithi144.stderr:0: [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] mon.a 2024-06-04T16:12:50.251 INFO:tasks.workunit.client.0.smithi144.stderr:1: [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] mon.b 2024-06-04T16:12:50.251 INFO:tasks.workunit.client.0.smithi144.stderr:2: [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] mon.c 2024-06-04T16:12:50.251 INFO:tasks.workunit.client.0.smithi144.stderr: 2024-06-04T16:12:50.251 INFO:tasks.workunit.client.0.smithi144.stderr: -265> 2024-06-04T16:12:49.948+0000 7f90db7fe640 10 monclient: _finish_auth 0 2024-06-04T16:12:50.252 INFO:tasks.workunit.client.0.smithi144.stderr: -264> 2024-06-04T16:12:49.948+0000 7f90db7fe640 10 monclient: _check_auth_tickets 2024-06-04T16:12:50.252 INFO:tasks.workunit.client.0.smithi144.stderr: -263> 2024-06-04T16:12:49.948+0000 7f90db7fe640 10 monclient: handle_config config(0 keys) 2024-06-04T16:12:50.252 INFO:tasks.workunit.client.0.smithi144.stderr: -262> 2024-06-04T16:12:49.948+0000 7f90db7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-06-04T16:12:50.252 INFO:tasks.workunit.client.0.smithi144.stderr: -261> 2024-06-04T16:12:49.948+0000 7f90db7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-06-04T16:12:50.252 INFO:tasks.workunit.client.0.smithi144.stderr: -260> 2024-06-04T16:12:49.948+0000 7f90db7fe640 10 monclient: dump: 2024-06-04T16:12:50.252 INFO:tasks.workunit.client.0.smithi144.stderr:epoch 1 2024-06-04T16:12:50.252 INFO:tasks.workunit.client.0.smithi144.stderr:fsid 15e56bb1-4856-42f3-b6db-a2c8f23c5557 2024-06-04T16:12:50.252 INFO:tasks.workunit.client.0.smithi144.stderr:last_changed 2024-06-04T15:51:29.789359+0000 2024-06-04T16:12:50.252 INFO:tasks.workunit.client.0.smithi144.stderr:created 2024-06-04T15:51:29.789359+0000 2024-06-04T16:12:50.252 INFO:tasks.workunit.client.0.smithi144.stderr:min_mon_release 19 (squid) 2024-06-04T16:12:50.252 INFO:tasks.workunit.client.0.smithi144.stderr:election_strategy: 1 2024-06-04T16:12:50.252 INFO:tasks.workunit.client.0.smithi144.stderr:0: [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] mon.a 2024-06-04T16:12:50.252 INFO:tasks.workunit.client.0.smithi144.stderr:1: [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] mon.b 2024-06-04T16:12:50.253 INFO:tasks.workunit.client.0.smithi144.stderr:2: [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] mon.c 2024-06-04T16:12:50.253 INFO:tasks.workunit.client.0.smithi144.stderr: 2024-06-04T16:12:50.253 INFO:tasks.workunit.client.0.smithi144.stderr: -259> 2024-06-04T16:12:49.948+0000 7f9208b2a800 5 monclient: authenticate success, global_id 6389 2024-06-04T16:12:50.253 INFO:tasks.workunit.client.0.smithi144.stderr: -258> 2024-06-04T16:12:49.948+0000 7f9208b2a800 10 monclient: get_monmap_and_config success 2024-06-04T16:12:50.253 INFO:tasks.workunit.client.0.smithi144.stderr: -257> 2024-06-04T16:12:49.948+0000 7f9208b2a800 4 set_mon_vals no callback set 2024-06-04T16:12:50.253 INFO:tasks.workunit.client.0.smithi144.stderr: -256> 2024-06-04T16:12:49.948+0000 7f9208b2a800 10 monclient: shutdown 2024-06-04T16:12:50.253 INFO:tasks.workunit.client.0.smithi144.stderr: -255> 2024-06-04T16:12:49.948+0000 7f9208b2a800 10 monclient: build_initial_monmap 2024-06-04T16:12:50.253 INFO:tasks.workunit.client.0.smithi144.stderr: -254> 2024-06-04T16:12:49.948+0000 7f9208b2a800 1 build_initial for_mkfs: 0 2024-06-04T16:12:50.253 INFO:tasks.workunit.client.0.smithi144.stderr: -253> 2024-06-04T16:12:49.948+0000 7f9208b2a800 10 monclient: monmap: 2024-06-04T16:12:50.253 INFO:tasks.workunit.client.0.smithi144.stderr:epoch 0 2024-06-04T16:12:50.253 INFO:tasks.workunit.client.0.smithi144.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-06-04T16:12:50.253 INFO:tasks.workunit.client.0.smithi144.stderr:last_changed 0.000000 2024-06-04T16:12:50.253 INFO:tasks.workunit.client.0.smithi144.stderr:created 0.000000 2024-06-04T16:12:50.253 INFO:tasks.workunit.client.0.smithi144.stderr:min_mon_release 0 (unknown) 2024-06-04T16:12:50.254 INFO:tasks.workunit.client.0.smithi144.stderr:election_strategy: 1 2024-06-04T16:12:50.254 INFO:tasks.workunit.client.0.smithi144.stderr:0: [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] mon.noname-a 2024-06-04T16:12:50.254 INFO:tasks.workunit.client.0.smithi144.stderr:1: [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] mon.noname-b 2024-06-04T16:12:50.254 INFO:tasks.workunit.client.0.smithi144.stderr:2: [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] mon.noname-c 2024-06-04T16:12:50.254 INFO:tasks.workunit.client.0.smithi144.stderr: 2024-06-04T16:12:50.254 INFO:tasks.workunit.client.0.smithi144.stderr: -252> 2024-06-04T16:12:49.948+0000 7f9208b2a800 5 AuthRegistry(0x5557c01b6010) adding auth protocol: cephx 2024-06-04T16:12:50.254 INFO:tasks.workunit.client.0.smithi144.stderr: -251> 2024-06-04T16:12:49.948+0000 7f9208b2a800 5 AuthRegistry(0x5557c01b6010) adding auth protocol: cephx 2024-06-04T16:12:50.254 INFO:tasks.workunit.client.0.smithi144.stderr: -250> 2024-06-04T16:12:49.948+0000 7f9208b2a800 5 AuthRegistry(0x5557c01b6010) adding auth protocol: cephx 2024-06-04T16:12:50.254 INFO:tasks.workunit.client.0.smithi144.stderr: -249> 2024-06-04T16:12:49.948+0000 7f9208b2a800 5 AuthRegistry(0x5557c01b6010) adding con mode: secure 2024-06-04T16:12:50.254 INFO:tasks.workunit.client.0.smithi144.stderr: -248> 2024-06-04T16:12:49.948+0000 7f9208b2a800 5 AuthRegistry(0x5557c01b6010) adding con mode: crc 2024-06-04T16:12:50.254 INFO:tasks.workunit.client.0.smithi144.stderr: -247> 2024-06-04T16:12:49.948+0000 7f9208b2a800 5 AuthRegistry(0x5557c01b6010) adding con mode: secure 2024-06-04T16:12:50.254 INFO:tasks.workunit.client.0.smithi144.stderr: -246> 2024-06-04T16:12:49.948+0000 7f9208b2a800 5 AuthRegistry(0x5557c01b6010) adding con mode: crc 2024-06-04T16:12:50.255 INFO:tasks.workunit.client.0.smithi144.stderr: -245> 2024-06-04T16:12:49.948+0000 7f9208b2a800 5 AuthRegistry(0x5557c01b6010) adding con mode: secure 2024-06-04T16:12:50.255 INFO:tasks.workunit.client.0.smithi144.stderr: -244> 2024-06-04T16:12:49.948+0000 7f9208b2a800 5 AuthRegistry(0x5557c01b6010) adding con mode: crc 2024-06-04T16:12:50.255 INFO:tasks.workunit.client.0.smithi144.stderr: -243> 2024-06-04T16:12:49.948+0000 7f9208b2a800 5 AuthRegistry(0x5557c01b6010) adding con mode: crc 2024-06-04T16:12:50.255 INFO:tasks.workunit.client.0.smithi144.stderr: -242> 2024-06-04T16:12:49.948+0000 7f9208b2a800 5 AuthRegistry(0x5557c01b6010) adding con mode: secure 2024-06-04T16:12:50.255 INFO:tasks.workunit.client.0.smithi144.stderr: -241> 2024-06-04T16:12:49.948+0000 7f9208b2a800 5 AuthRegistry(0x5557c01b6010) adding con mode: crc 2024-06-04T16:12:50.255 INFO:tasks.workunit.client.0.smithi144.stderr: -240> 2024-06-04T16:12:49.948+0000 7f9208b2a800 5 AuthRegistry(0x5557c01b6010) adding con mode: secure 2024-06-04T16:12:50.255 INFO:tasks.workunit.client.0.smithi144.stderr: -239> 2024-06-04T16:12:49.948+0000 7f9208b2a800 5 AuthRegistry(0x5557c01b6010) adding con mode: crc 2024-06-04T16:12:50.255 INFO:tasks.workunit.client.0.smithi144.stderr: -238> 2024-06-04T16:12:49.948+0000 7f9208b2a800 5 AuthRegistry(0x5557c01b6010) adding con mode: secure 2024-06-04T16:12:50.255 INFO:tasks.workunit.client.0.smithi144.stderr: -237> 2024-06-04T16:12:49.949+0000 7f9208b2a800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-06-04T16:12:50.255 INFO:tasks.workunit.client.0.smithi144.stderr: -236> 2024-06-04T16:12:49.949+0000 7f9208b2a800 1 librados: starting msgr at 2024-06-04T16:12:50.255 INFO:tasks.workunit.client.0.smithi144.stderr: -235> 2024-06-04T16:12:49.949+0000 7f9208b2a800 1 librados: starting objecter 2024-06-04T16:12:50.255 INFO:tasks.workunit.client.0.smithi144.stderr: -234> 2024-06-04T16:12:49.949+0000 7f9208b2a800 5 asok(0x5557bfef0c60) register_command objecter_requests cmddesc objecter_requests hook 0x5557c01e5c10 EEXIST 2024-06-04T16:12:50.255 INFO:tasks.workunit.client.0.smithi144.stderr: -233> 2024-06-04T16:12:49.949+0000 7f9208b2a800 1 librados: setting wanted keys 2024-06-04T16:12:50.256 INFO:tasks.workunit.client.0.smithi144.stderr: -232> 2024-06-04T16:12:49.949+0000 7f9208b2a800 1 librados: calling monclient init 2024-06-04T16:12:50.256 INFO:tasks.workunit.client.0.smithi144.stderr: -231> 2024-06-04T16:12:49.949+0000 7f9208b2a800 10 monclient: init 2024-06-04T16:12:50.256 INFO:tasks.workunit.client.0.smithi144.stderr: -230> 2024-06-04T16:12:49.949+0000 7f9208b2a800 5 AuthRegistry(0x5557c0171c50) adding auth protocol: cephx 2024-06-04T16:12:50.256 INFO:tasks.workunit.client.0.smithi144.stderr: -229> 2024-06-04T16:12:49.949+0000 7f9208b2a800 5 AuthRegistry(0x5557c0171c50) adding auth protocol: cephx 2024-06-04T16:12:50.256 INFO:tasks.workunit.client.0.smithi144.stderr: -228> 2024-06-04T16:12:49.949+0000 7f9208b2a800 5 AuthRegistry(0x5557c0171c50) adding auth protocol: cephx 2024-06-04T16:12:50.256 INFO:tasks.workunit.client.0.smithi144.stderr: -227> 2024-06-04T16:12:49.949+0000 7f9208b2a800 5 AuthRegistry(0x5557c0171c50) adding con mode: secure 2024-06-04T16:12:50.256 INFO:tasks.workunit.client.0.smithi144.stderr: -226> 2024-06-04T16:12:49.949+0000 7f9208b2a800 5 AuthRegistry(0x5557c0171c50) adding con mode: crc 2024-06-04T16:12:50.256 INFO:tasks.workunit.client.0.smithi144.stderr: -225> 2024-06-04T16:12:49.949+0000 7f9208b2a800 5 AuthRegistry(0x5557c0171c50) adding con mode: secure 2024-06-04T16:12:50.256 INFO:tasks.workunit.client.0.smithi144.stderr: -224> 2024-06-04T16:12:49.949+0000 7f9208b2a800 5 AuthRegistry(0x5557c0171c50) adding con mode: crc 2024-06-04T16:12:50.256 INFO:tasks.workunit.client.0.smithi144.stderr: -223> 2024-06-04T16:12:49.949+0000 7f9208b2a800 5 AuthRegistry(0x5557c0171c50) adding con mode: secure 2024-06-04T16:12:50.256 INFO:tasks.workunit.client.0.smithi144.stderr: -222> 2024-06-04T16:12:49.949+0000 7f9208b2a800 5 AuthRegistry(0x5557c0171c50) adding con mode: crc 2024-06-04T16:12:50.256 INFO:tasks.workunit.client.0.smithi144.stderr: -221> 2024-06-04T16:12:49.949+0000 7f9208b2a800 5 AuthRegistry(0x5557c0171c50) adding con mode: crc 2024-06-04T16:12:50.256 INFO:tasks.workunit.client.0.smithi144.stderr: -220> 2024-06-04T16:12:49.949+0000 7f9208b2a800 5 AuthRegistry(0x5557c0171c50) adding con mode: secure 2024-06-04T16:12:50.257 INFO:tasks.workunit.client.0.smithi144.stderr: -219> 2024-06-04T16:12:49.949+0000 7f9208b2a800 5 AuthRegistry(0x5557c0171c50) adding con mode: crc 2024-06-04T16:12:50.257 INFO:tasks.workunit.client.0.smithi144.stderr: -218> 2024-06-04T16:12:49.949+0000 7f9208b2a800 5 AuthRegistry(0x5557c0171c50) adding con mode: secure 2024-06-04T16:12:50.257 INFO:tasks.workunit.client.0.smithi144.stderr: -217> 2024-06-04T16:12:49.949+0000 7f9208b2a800 5 AuthRegistry(0x5557c0171c50) adding con mode: crc 2024-06-04T16:12:50.257 INFO:tasks.workunit.client.0.smithi144.stderr: -216> 2024-06-04T16:12:49.949+0000 7f9208b2a800 5 AuthRegistry(0x5557c0171c50) adding con mode: secure 2024-06-04T16:12:50.257 INFO:tasks.workunit.client.0.smithi144.stderr: -215> 2024-06-04T16:12:49.949+0000 7f9208b2a800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-06-04T16:12:50.257 INFO:tasks.workunit.client.0.smithi144.stderr: -214> 2024-06-04T16:12:49.949+0000 7f9208b2a800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-06-04T16:12:50.257 INFO:tasks.workunit.client.0.smithi144.stderr: -213> 2024-06-04T16:12:49.949+0000 7f9208b2a800 5 asok(0x5557bfef0c60) register_command rotate-key cmddesc rotate-key hook 0x5557c0171d98 EEXIST 2024-06-04T16:12:50.257 INFO:tasks.workunit.client.0.smithi144.stderr: -212> 2024-06-04T16:12:49.949+0000 7f9208b2a800 10 monclient: _reopen_session rank -1 2024-06-04T16:12:50.257 INFO:tasks.workunit.client.0.smithi144.stderr: -211> 2024-06-04T16:12:49.949+0000 7f9208b2a800 10 monclient: _add_conns ranks=[0,1,2] 2024-06-04T16:12:50.257 INFO:tasks.workunit.client.0.smithi144.stderr: -210> 2024-06-04T16:12:49.949+0000 7f9208b2a800 10 monclient(hunting): picked mon.noname-a con 0x5557c01de260 addr [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] 2024-06-04T16:12:50.257 INFO:tasks.workunit.client.0.smithi144.stderr: -209> 2024-06-04T16:12:49.949+0000 7f9208b2a800 10 monclient(hunting): picked mon.noname-b con 0x5557c01e10e0 addr [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] 2024-06-04T16:12:50.257 INFO:tasks.workunit.client.0.smithi144.stderr: -208> 2024-06-04T16:12:49.949+0000 7f9208b2a800 10 monclient(hunting): picked mon.noname-c con 0x5557c01e3a90 addr [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] 2024-06-04T16:12:50.258 INFO:tasks.workunit.client.0.smithi144.stderr: -207> 2024-06-04T16:12:49.949+0000 7f9208b2a800 10 monclient(hunting): start opening mon connection 2024-06-04T16:12:50.258 INFO:tasks.workunit.client.0.smithi144.stderr: -206> 2024-06-04T16:12:49.949+0000 7f9208b2a800 10 monclient(hunting): start opening mon connection 2024-06-04T16:12:50.258 INFO:tasks.workunit.client.0.smithi144.stderr: -205> 2024-06-04T16:12:49.949+0000 7f9208b2a800 10 monclient(hunting): start opening mon connection 2024-06-04T16:12:50.258 INFO:tasks.workunit.client.0.smithi144.stderr: -204> 2024-06-04T16:12:49.949+0000 7f9208b2a800 10 monclient(hunting): _renew_subs 2024-06-04T16:12:50.258 INFO:tasks.workunit.client.0.smithi144.stderr: -203> 2024-06-04T16:12:49.949+0000 7f9208b2a800 10 monclient(hunting): authenticate will time out at 2007.765942s 2024-06-04T16:12:50.258 INFO:tasks.workunit.client.0.smithi144.stderr: -202> 2024-06-04T16:12:49.949+0000 7f9203fe7640 10 monclient(hunting): get_auth_request con 0x5557c01de260 auth_method 0 2024-06-04T16:12:50.258 INFO:tasks.workunit.client.0.smithi144.stderr: -201> 2024-06-04T16:12:49.949+0000 7f9203fe7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-06-04T16:12:50.258 INFO:tasks.workunit.client.0.smithi144.stderr: -200> 2024-06-04T16:12:49.949+0000 7f9203fe7640 10 monclient(hunting): _init_auth method 2 2024-06-04T16:12:50.258 INFO:tasks.workunit.client.0.smithi144.stderr: -199> 2024-06-04T16:12:49.949+0000 7f9203fe7640 10 monclient(hunting): _init_auth creating new auth 2024-06-04T16:12:50.258 INFO:tasks.workunit.client.0.smithi144.stderr: -198> 2024-06-04T16:12:49.949+0000 7f92047e8640 10 monclient(hunting): get_auth_request con 0x5557c01e3a90 auth_method 0 2024-06-04T16:12:50.258 INFO:tasks.workunit.client.0.smithi144.stderr: -197> 2024-06-04T16:12:49.949+0000 7f92047e8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-06-04T16:12:50.258 INFO:tasks.workunit.client.0.smithi144.stderr: -196> 2024-06-04T16:12:49.949+0000 7f92047e8640 10 monclient(hunting): _init_auth method 2 2024-06-04T16:12:50.258 INFO:tasks.workunit.client.0.smithi144.stderr: -195> 2024-06-04T16:12:49.949+0000 7f92047e8640 10 monclient(hunting): _init_auth creating new auth 2024-06-04T16:12:50.259 INFO:tasks.workunit.client.0.smithi144.stderr: -194> 2024-06-04T16:12:49.949+0000 7f9204fe9640 10 monclient(hunting): get_auth_request con 0x5557c01e10e0 auth_method 0 2024-06-04T16:12:50.259 INFO:tasks.workunit.client.0.smithi144.stderr: -193> 2024-06-04T16:12:49.949+0000 7f9204fe9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-06-04T16:12:50.259 INFO:tasks.workunit.client.0.smithi144.stderr: -192> 2024-06-04T16:12:49.949+0000 7f9204fe9640 10 monclient(hunting): _init_auth method 2 2024-06-04T16:12:50.259 INFO:tasks.workunit.client.0.smithi144.stderr: -191> 2024-06-04T16:12:49.949+0000 7f9204fe9640 10 monclient(hunting): _init_auth creating new auth 2024-06-04T16:12:50.259 INFO:tasks.workunit.client.0.smithi144.stderr: -190> 2024-06-04T16:12:49.949+0000 7f92047e8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-06-04T16:12:50.259 INFO:tasks.workunit.client.0.smithi144.stderr: -189> 2024-06-04T16:12:49.949+0000 7f92047e8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-06-04T16:12:50.259 INFO:tasks.workunit.client.0.smithi144.stderr: -188> 2024-06-04T16:12:49.949+0000 7f92047e8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-06-04T16:12:50.259 INFO:tasks.workunit.client.0.smithi144.stderr: -187> 2024-06-04T16:12:49.949+0000 7f9203fe7640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-06-04T16:12:50.259 INFO:tasks.workunit.client.0.smithi144.stderr: -186> 2024-06-04T16:12:49.949+0000 7f9203fe7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-06-04T16:12:50.259 INFO:tasks.workunit.client.0.smithi144.stderr: -185> 2024-06-04T16:12:49.950+0000 7f9203fe7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-06-04T16:12:50.259 INFO:tasks.workunit.client.0.smithi144.stderr: -184> 2024-06-04T16:12:49.950+0000 7f9204fe9640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-06-04T16:12:50.259 INFO:tasks.workunit.client.0.smithi144.stderr: -183> 2024-06-04T16:12:49.950+0000 7f9204fe9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-06-04T16:12:50.259 INFO:tasks.workunit.client.0.smithi144.stderr: -182> 2024-06-04T16:12:49.950+0000 7f9204fe9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-06-04T16:12:50.259 INFO:tasks.workunit.client.0.smithi144.stderr: -181> 2024-06-04T16:12:49.950+0000 7f92047e8640 10 monclient(hunting): handle_auth_done global_id 6392 payload 824 2024-06-04T16:12:50.260 INFO:tasks.workunit.client.0.smithi144.stderr: -180> 2024-06-04T16:12:49.950+0000 7f92047e8640 10 monclient: _finish_hunting 0 2024-06-04T16:12:50.260 INFO:tasks.workunit.client.0.smithi144.stderr: -179> 2024-06-04T16:12:49.950+0000 7f92047e8640 1 monclient: found mon.noname-c 2024-06-04T16:12:50.260 INFO:tasks.workunit.client.0.smithi144.stderr: -178> 2024-06-04T16:12:49.950+0000 7f92047e8640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.144:3301/0 2024-06-04T16:12:50.260 INFO:tasks.workunit.client.0.smithi144.stderr: -177> 2024-06-04T16:12:49.950+0000 7f90d9ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-06-04T16:12:50.260 INFO:tasks.workunit.client.0.smithi144.stderr: -176> 2024-06-04T16:12:49.950+0000 7f90d9ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-06-04T16:12:50.260 INFO:tasks.workunit.client.0.smithi144.stderr: -175> 2024-06-04T16:12:49.950+0000 7f90d9ffb640 10 monclient: dump: 2024-06-04T16:12:50.260 INFO:tasks.workunit.client.0.smithi144.stderr:epoch 1 2024-06-04T16:12:50.260 INFO:tasks.workunit.client.0.smithi144.stderr:fsid 15e56bb1-4856-42f3-b6db-a2c8f23c5557 2024-06-04T16:12:50.260 INFO:tasks.workunit.client.0.smithi144.stderr:last_changed 2024-06-04T15:51:29.789359+0000 2024-06-04T16:12:50.260 INFO:tasks.workunit.client.0.smithi144.stderr:created 2024-06-04T15:51:29.789359+0000 2024-06-04T16:12:50.260 INFO:tasks.workunit.client.0.smithi144.stderr:min_mon_release 19 (squid) 2024-06-04T16:12:50.261 INFO:tasks.workunit.client.0.smithi144.stderr:election_strategy: 1 2024-06-04T16:12:50.261 INFO:tasks.workunit.client.0.smithi144.stderr:0: [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] mon.a 2024-06-04T16:12:50.261 INFO:tasks.workunit.client.0.smithi144.stderr:1: [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] mon.b 2024-06-04T16:12:50.261 INFO:tasks.workunit.client.0.smithi144.stderr:2: [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] mon.c 2024-06-04T16:12:50.261 INFO:tasks.workunit.client.0.smithi144.stderr: 2024-06-04T16:12:50.261 INFO:tasks.workunit.client.0.smithi144.stderr: -174> 2024-06-04T16:12:49.950+0000 7f90d9ffb640 10 monclient: _finish_auth 0 2024-06-04T16:12:50.261 INFO:tasks.workunit.client.0.smithi144.stderr: -173> 2024-06-04T16:12:49.950+0000 7f90d9ffb640 10 monclient: _check_auth_tickets 2024-06-04T16:12:50.261 INFO:tasks.workunit.client.0.smithi144.stderr: -172> 2024-06-04T16:12:49.950+0000 7f90d9ffb640 10 monclient: handle_config config(0 keys) 2024-06-04T16:12:50.261 INFO:tasks.workunit.client.0.smithi144.stderr: -171> 2024-06-04T16:12:49.950+0000 7f90d9ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-06-04T16:12:50.261 INFO:tasks.workunit.client.0.smithi144.stderr: -170> 2024-06-04T16:12:49.950+0000 7f90d9ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-06-04T16:12:50.261 INFO:tasks.workunit.client.0.smithi144.stderr: -169> 2024-06-04T16:12:49.950+0000 7f90d9ffb640 10 monclient: dump: 2024-06-04T16:12:50.261 INFO:tasks.workunit.client.0.smithi144.stderr:epoch 1 2024-06-04T16:12:50.261 INFO:tasks.workunit.client.0.smithi144.stderr:fsid 15e56bb1-4856-42f3-b6db-a2c8f23c5557 2024-06-04T16:12:50.261 INFO:tasks.workunit.client.0.smithi144.stderr:last_changed 2024-06-04T15:51:29.789359+0000 2024-06-04T16:12:50.262 INFO:tasks.workunit.client.0.smithi144.stderr:created 2024-06-04T15:51:29.789359+0000 2024-06-04T16:12:50.262 INFO:tasks.workunit.client.0.smithi144.stderr:min_mon_release 19 (squid) 2024-06-04T16:12:50.262 INFO:tasks.workunit.client.0.smithi144.stderr:election_strategy: 1 2024-06-04T16:12:50.262 INFO:tasks.workunit.client.0.smithi144.stderr:0: [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] mon.a 2024-06-04T16:12:50.262 INFO:tasks.workunit.client.0.smithi144.stderr:1: [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] mon.b 2024-06-04T16:12:50.262 INFO:tasks.workunit.client.0.smithi144.stderr:2: [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] mon.c 2024-06-04T16:12:50.262 INFO:tasks.workunit.client.0.smithi144.stderr: 2024-06-04T16:12:50.262 INFO:tasks.workunit.client.0.smithi144.stderr: -168> 2024-06-04T16:12:49.950+0000 7f9208b2a800 5 monclient: authenticate success, global_id 6392 2024-06-04T16:12:50.262 INFO:tasks.workunit.client.0.smithi144.stderr: -167> 2024-06-04T16:12:49.950+0000 7f90db7fe640 4 set_mon_vals no callback set 2024-06-04T16:12:50.262 INFO:tasks.workunit.client.0.smithi144.stderr: -166> 2024-06-04T16:12:49.950+0000 7f9208b2a800 10 monclient: _renew_subs 2024-06-04T16:12:50.262 INFO:tasks.workunit.client.0.smithi144.stderr: -165> 2024-06-04T16:12:49.950+0000 7f9208b2a800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.144:3301/0 2024-06-04T16:12:50.262 INFO:tasks.workunit.client.0.smithi144.stderr: -164> 2024-06-04T16:12:49.950+0000 7f9208b2a800 10 monclient: _renew_subs 2024-06-04T16:12:50.263 INFO:tasks.workunit.client.0.smithi144.stderr: -163> 2024-06-04T16:12:49.950+0000 7f9208b2a800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.144:3301/0 2024-06-04T16:12:50.263 INFO:tasks.workunit.client.0.smithi144.stderr: -162> 2024-06-04T16:12:49.950+0000 7f9208b2a800 1 librados: init done 2024-06-04T16:12:50.263 INFO:tasks.workunit.client.0.smithi144.stderr: -161> 2024-06-04T16:12:49.950+0000 7f9208b2a800 5 asok(0x5557bfef0c60) register_command cr dump hook 0x5557c01e9558 2024-06-04T16:12:50.263 INFO:tasks.workunit.client.0.smithi144.stderr: -160> 2024-06-04T16:12:49.951+0000 7f9208b2a800 20 rados->read ofs=0 len=0 2024-06-04T16:12:50.263 INFO:tasks.workunit.client.0.smithi144.stderr: -159> 2024-06-04T16:12:49.952+0000 7f90d9ffb640 4 mgrc handle_mgr_map Got map version 5 2024-06-04T16:12:50.263 INFO:tasks.workunit.client.0.smithi144.stderr: -158> 2024-06-04T16:12:49.952+0000 7f90d9ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.177:6832/2645786330,v1:172.21.15.177:6833/2645786330] 2024-06-04T16:12:50.263 INFO:tasks.workunit.client.0.smithi144.stderr: -157> 2024-06-04T16:12:49.952+0000 7f90d9ffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.177:6832/2645786330,v1:172.21.15.177:6833/2645786330] 2024-06-04T16:12:50.263 INFO:tasks.workunit.client.0.smithi144.stderr: -156> 2024-06-04T16:12:49.952+0000 7f9203fe7640 10 monclient: get_auth_request con 0x7f90cc074cb0 auth_method 0 2024-06-04T16:12:50.263 INFO:tasks.workunit.client.0.smithi144.stderr: -155> 2024-06-04T16:12:49.952+0000 7f9204fe9640 10 monclient: get_auth_request con 0x5557c01fffb0 auth_method 0 2024-06-04T16:12:50.263 INFO:tasks.workunit.client.0.smithi144.stderr: -154> 2024-06-04T16:12:49.953+0000 7f9208b2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:12:50.263 INFO:tasks.workunit.client.0.smithi144.stderr: -153> 2024-06-04T16:12:49.953+0000 7f9208b2a800 20 realm 2024-06-04T16:12:50.263 INFO:tasks.workunit.client.0.smithi144.stderr: -152> 2024-06-04T16:12:49.953+0000 7f9208b2a800 20 rados->read ofs=0 len=0 2024-06-04T16:12:50.263 INFO:tasks.workunit.client.0.smithi144.stderr: -151> 2024-06-04T16:12:49.953+0000 7f9208b2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:12:50.263 INFO:tasks.workunit.client.0.smithi144.stderr: -150> 2024-06-04T16:12:49.953+0000 7f9208b2a800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-06-04T16:12:50.263 INFO:tasks.workunit.client.0.smithi144.stderr: -149> 2024-06-04T16:12:49.953+0000 7f9208b2a800 20 rados->read ofs=0 len=0 2024-06-04T16:12:50.264 INFO:tasks.workunit.client.0.smithi144.stderr: -148> 2024-06-04T16:12:49.953+0000 7f9208b2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:12:50.264 INFO:tasks.workunit.client.0.smithi144.stderr: -147> 2024-06-04T16:12:49.953+0000 7f9208b2a800 20 rados->read ofs=0 len=0 2024-06-04T16:12:50.264 INFO:tasks.workunit.client.0.smithi144.stderr: -146> 2024-06-04T16:12:49.953+0000 7f9203fe7640 10 monclient: get_auth_request con 0x5557c0204360 auth_method 0 2024-06-04T16:12:50.264 INFO:tasks.workunit.client.0.smithi144.stderr: -145> 2024-06-04T16:12:49.954+0000 7f9208b2a800 20 rados_obj.operate() r=0 bl.length=46 2024-06-04T16:12:50.264 INFO:tasks.workunit.client.0.smithi144.stderr: -144> 2024-06-04T16:12:49.954+0000 7f9208b2a800 20 rados->read ofs=0 len=0 2024-06-04T16:12:50.264 INFO:tasks.workunit.client.0.smithi144.stderr: -143> 2024-06-04T16:12:49.954+0000 7f9204fe9640 10 monclient: get_auth_request con 0x5557c0207ad0 auth_method 0 2024-06-04T16:12:50.264 INFO:tasks.workunit.client.0.smithi144.stderr: -142> 2024-06-04T16:12:49.954+0000 7f9208b2a800 20 rados_obj.operate() r=0 bl.length=1139 2024-06-04T16:12:50.264 INFO:tasks.workunit.client.0.smithi144.stderr: -141> 2024-06-04T16:12:49.955+0000 7f9208b2a800 20 searching for the correct realm 2024-06-04T16:12:50.264 INFO:tasks.workunit.client.0.smithi144.stderr: -140> 2024-06-04T16:12:49.955+0000 7f92047e8640 10 monclient: get_auth_request con 0x5557c020c7f0 auth_method 0 2024-06-04T16:12:50.264 INFO:tasks.workunit.client.0.smithi144.stderr: -139> 2024-06-04T16:12:49.955+0000 7f9203fe7640 10 monclient: get_auth_request con 0x7f91f4081a30 auth_method 0 2024-06-04T16:12:50.264 INFO:tasks.workunit.client.0.smithi144.stderr: -138> 2024-06-04T16:12:49.956+0000 7f9203fe7640 0 -- 172.21.15.144:0/3432075077 >> [v2:172.21.15.144:6816/2358575268,v1:172.21.15.144:6817/2358575268] conn(0x5557c0204360 msgr2=0x5557c0206750 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-06-04T16:12:50.264 INFO:tasks.workunit.client.0.smithi144.stderr: -137> 2024-06-04T16:12:49.956+0000 7f90d9ffb640 1 client.6392.objecter ms_handle_reset 0x5557c0204360 session 0x5557c02031e0 osd.1 2024-06-04T16:12:50.264 INFO:tasks.workunit.client.0.smithi144.stderr: -136> 2024-06-04T16:12:49.956+0000 7f90d9ffb640 10 monclient: _renew_subs 2024-06-04T16:12:50.265 INFO:tasks.workunit.client.0.smithi144.stderr: -135> 2024-06-04T16:12:49.956+0000 7f90d9ffb640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.144:3301/0 2024-06-04T16:12:50.265 INFO:tasks.workunit.client.0.smithi144.stderr: -134> 2024-06-04T16:12:49.956+0000 7f9204fe9640 10 monclient: get_auth_request con 0x7f91f806d420 auth_method 0 2024-06-04T16:12:50.265 INFO:tasks.workunit.client.0.smithi144.stderr: -133> 2024-06-04T16:12:49.957+0000 7f9203fe7640 10 monclient: get_auth_request con 0x7f90cc085060 auth_method 0 2024-06-04T16:12:50.265 INFO:tasks.workunit.client.0.smithi144.stderr: -132> 2024-06-04T16:12:49.957+0000 7f92047e8640 10 monclient: get_auth_request con 0x7f91f408a060 auth_method 0 2024-06-04T16:12:50.265 INFO:tasks.workunit.client.0.smithi144.stderr: -131> 2024-06-04T16:12:49.959+0000 7f9203fe7640 10 monclient: get_auth_request con 0x7f91f80824f0 auth_method 0 2024-06-04T16:12:50.265 INFO:tasks.workunit.client.0.smithi144.stderr: -130> 2024-06-04T16:12:49.959+0000 7f9203fe7640 0 -- 172.21.15.144:0/3432075077 >> [v2:172.21.15.177:6808/2618477608,v1:172.21.15.177:6809/2618477608] conn(0x7f91f80824f0 msgr2=0x7f91f8081920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-06-04T16:12:50.265 INFO:tasks.workunit.client.0.smithi144.stderr: -129> 2024-06-04T16:12:50.160+0000 7f9203fe7640 10 monclient: get_auth_request con 0x7f91f80824f0 auth_method 0 2024-06-04T16:12:50.265 INFO:tasks.workunit.client.0.smithi144.stderr: -128> 2024-06-04T16:12:50.165+0000 7f9208b2a800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-06-04T16:12:50.265 INFO:tasks.workunit.client.0.smithi144.stderr: -127> 2024-06-04T16:12:50.165+0000 7f9208b2a800 20 RGWRados::pool_iterate: got zone_info.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767 2024-06-04T16:12:50.265 INFO:tasks.workunit.client.0.smithi144.stderr: -126> 2024-06-04T16:12:50.165+0000 7f9208b2a800 20 RGWRados::pool_iterate: got default.zone. 2024-06-04T16:12:50.265 INFO:tasks.workunit.client.0.smithi144.stderr: -125> 2024-06-04T16:12:50.165+0000 7f9208b2a800 20 RGWRados::pool_iterate: got zonegroup_info.abb22408-c332-4e28-8f7a-ff254ea2fed2 2024-06-04T16:12:50.265 INFO:tasks.workunit.client.0.smithi144.stderr: -124> 2024-06-04T16:12:50.165+0000 7f9208b2a800 20 RGWRados::pool_iterate: got zone_names.default 2024-06-04T16:12:50.265 INFO:tasks.workunit.client.0.smithi144.stderr: -123> 2024-06-04T16:12:50.165+0000 7f9208b2a800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-06-04T16:12:50.265 INFO:tasks.workunit.client.0.smithi144.stderr: -122> 2024-06-04T16:12:50.165+0000 7f9208b2a800 20 rados->read ofs=0 len=0 2024-06-04T16:12:50.266 INFO:tasks.workunit.client.0.smithi144.stderr: -121> 2024-06-04T16:12:50.166+0000 7f9208b2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:12:50.266 INFO:tasks.workunit.client.0.smithi144.stderr: -120> 2024-06-04T16:12:50.166+0000 7f9208b2a800 20 rados->read ofs=0 len=0 2024-06-04T16:12:50.266 INFO:tasks.workunit.client.0.smithi144.stderr: -119> 2024-06-04T16:12:50.166+0000 7f9208b2a800 20 rados_obj.operate() r=0 bl.length=46 2024-06-04T16:12:50.266 INFO:tasks.workunit.client.0.smithi144.stderr: -118> 2024-06-04T16:12:50.166+0000 7f9208b2a800 20 rados->read ofs=0 len=0 2024-06-04T16:12:50.266 INFO:tasks.workunit.client.0.smithi144.stderr: -117> 2024-06-04T16:12:50.166+0000 7f9208b2a800 20 rados_obj.operate() r=0 bl.length=470 2024-06-04T16:12:50.266 INFO:tasks.workunit.client.0.smithi144.stderr: -116> 2024-06-04T16:12:50.167+0000 7f9208b2a800 20 zone default found 2024-06-04T16:12:50.266 INFO:tasks.workunit.client.0.smithi144.stderr: -115> 2024-06-04T16:12:50.167+0000 7f9208b2a800 4 Realm: () 2024-06-04T16:12:50.266 INFO:tasks.workunit.client.0.smithi144.stderr: -114> 2024-06-04T16:12:50.167+0000 7f9208b2a800 4 ZoneGroup: default (abb22408-c332-4e28-8f7a-ff254ea2fed2) 2024-06-04T16:12:50.266 INFO:tasks.workunit.client.0.smithi144.stderr: -113> 2024-06-04T16:12:50.167+0000 7f9208b2a800 4 Zone: default (be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767) 2024-06-04T16:12:50.266 INFO:tasks.workunit.client.0.smithi144.stderr: -112> 2024-06-04T16:12:50.167+0000 7f9208b2a800 10 cannot find current period zonegroup using local zonegroup configuration 2024-06-04T16:12:50.266 INFO:tasks.workunit.client.0.smithi144.stderr: -111> 2024-06-04T16:12:50.167+0000 7f9208b2a800 20 zonegroup default 2024-06-04T16:12:50.266 INFO:tasks.workunit.client.0.smithi144.stderr: -110> 2024-06-04T16:12:50.167+0000 7f9208b2a800 20 rados->read ofs=0 len=0 2024-06-04T16:12:50.267 INFO:tasks.workunit.client.0.smithi144.stderr: -109> 2024-06-04T16:12:50.167+0000 7f9208b2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:12:50.267 INFO:tasks.workunit.client.0.smithi144.stderr: -108> 2024-06-04T16:12:50.167+0000 7f9208b2a800 20 rados->read ofs=0 len=0 2024-06-04T16:12:50.267 INFO:tasks.workunit.client.0.smithi144.stderr: -107> 2024-06-04T16:12:50.168+0000 7f9208b2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:12:50.267 INFO:tasks.workunit.client.0.smithi144.stderr: -106> 2024-06-04T16:12:50.168+0000 7f9208b2a800 20 rados->read ofs=0 len=0 2024-06-04T16:12:50.267 INFO:tasks.workunit.client.0.smithi144.stderr: -105> 2024-06-04T16:12:50.168+0000 7f9208b2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:12:50.267 INFO:tasks.workunit.client.0.smithi144.stderr: -104> 2024-06-04T16:12:50.168+0000 7f9208b2a800 20 started sync module instance, tier type = 2024-06-04T16:12:50.267 INFO:tasks.workunit.client.0.smithi144.stderr: -103> 2024-06-04T16:12:50.168+0000 7f9208b2a800 20 started zone id=be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767 (name=default) with tier type = 2024-06-04T16:12:50.267 INFO:tasks.workunit.client.0.smithi144.stderr: -102> 2024-06-04T16:12:50.177+0000 7f9208b2a800 20 add_watcher() i=0 2024-06-04T16:12:50.267 INFO:tasks.workunit.client.0.smithi144.stderr: -101> 2024-06-04T16:12:50.177+0000 7f9208b2a800 20 add_watcher() i=1 2024-06-04T16:12:50.267 INFO:tasks.workunit.client.0.smithi144.stderr: -100> 2024-06-04T16:12:50.177+0000 7f9208b2a800 20 add_watcher() i=2 2024-06-04T16:12:50.267 INFO:tasks.workunit.client.0.smithi144.stderr: -99> 2024-06-04T16:12:50.177+0000 7f9208b2a800 20 add_watcher() i=3 2024-06-04T16:12:50.267 INFO:tasks.workunit.client.0.smithi144.stderr: -98> 2024-06-04T16:12:50.177+0000 7f9208b2a800 20 add_watcher() i=4 2024-06-04T16:12:50.267 INFO:tasks.workunit.client.0.smithi144.stderr: -97> 2024-06-04T16:12:50.177+0000 7f9208b2a800 20 add_watcher() i=5 2024-06-04T16:12:50.268 INFO:tasks.workunit.client.0.smithi144.stderr: -96> 2024-06-04T16:12:50.177+0000 7f9208b2a800 20 add_watcher() i=6 2024-06-04T16:12:50.268 INFO:tasks.workunit.client.0.smithi144.stderr: -95> 2024-06-04T16:12:50.178+0000 7f9208b2a800 20 add_watcher() i=7 2024-06-04T16:12:50.268 INFO:tasks.workunit.client.0.smithi144.stderr: -94> 2024-06-04T16:12:50.178+0000 7f9208b2a800 2 all 8 watchers are set, enabling cache 2024-06-04T16:12:50.268 INFO:tasks.workunit.client.0.smithi144.stderr: -93> 2024-06-04T16:12:50.179+0000 7f9208b2a800 5 AuthRegistry(0x7ffecc2fe580) adding auth protocol: cephx 2024-06-04T16:12:50.268 INFO:tasks.workunit.client.0.smithi144.stderr: -92> 2024-06-04T16:12:50.179+0000 7f9208b2a800 5 AuthRegistry(0x7ffecc2fe580) adding auth protocol: cephx 2024-06-04T16:12:50.268 INFO:tasks.workunit.client.0.smithi144.stderr: -91> 2024-06-04T16:12:50.179+0000 7f9208b2a800 5 AuthRegistry(0x7ffecc2fe580) adding auth protocol: cephx 2024-06-04T16:12:50.268 INFO:tasks.workunit.client.0.smithi144.stderr: -90> 2024-06-04T16:12:50.179+0000 7f9208b2a800 5 AuthRegistry(0x7ffecc2fe580) adding con mode: secure 2024-06-04T16:12:50.268 INFO:tasks.workunit.client.0.smithi144.stderr: -89> 2024-06-04T16:12:50.179+0000 7f9208b2a800 5 AuthRegistry(0x7ffecc2fe580) adding con mode: crc 2024-06-04T16:12:50.268 INFO:tasks.workunit.client.0.smithi144.stderr: -88> 2024-06-04T16:12:50.179+0000 7f9208b2a800 5 AuthRegistry(0x7ffecc2fe580) adding con mode: secure 2024-06-04T16:12:50.268 INFO:tasks.workunit.client.0.smithi144.stderr: -87> 2024-06-04T16:12:50.179+0000 7f9208b2a800 5 AuthRegistry(0x7ffecc2fe580) adding con mode: crc 2024-06-04T16:12:50.268 INFO:tasks.workunit.client.0.smithi144.stderr: -86> 2024-06-04T16:12:50.179+0000 7f9208b2a800 5 AuthRegistry(0x7ffecc2fe580) adding con mode: secure 2024-06-04T16:12:50.268 INFO:tasks.workunit.client.0.smithi144.stderr: -85> 2024-06-04T16:12:50.179+0000 7f9208b2a800 5 AuthRegistry(0x7ffecc2fe580) adding con mode: crc 2024-06-04T16:12:50.269 INFO:tasks.workunit.client.0.smithi144.stderr: -84> 2024-06-04T16:12:50.179+0000 7f9208b2a800 5 AuthRegistry(0x7ffecc2fe580) adding con mode: crc 2024-06-04T16:12:50.269 INFO:tasks.workunit.client.0.smithi144.stderr: -83> 2024-06-04T16:12:50.179+0000 7f9208b2a800 5 AuthRegistry(0x7ffecc2fe580) adding con mode: secure 2024-06-04T16:12:50.269 INFO:tasks.workunit.client.0.smithi144.stderr: -82> 2024-06-04T16:12:50.179+0000 7f90bafdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-06-04T16:12:50.269 INFO:tasks.workunit.client.0.smithi144.stderr: -81> 2024-06-04T16:12:50.179+0000 7f9208b2a800 5 AuthRegistry(0x7ffecc2fe580) adding con mode: crc 2024-06-04T16:12:50.269 INFO:tasks.workunit.client.0.smithi144.stderr: -80> 2024-06-04T16:12:50.179+0000 7f9208b2a800 5 AuthRegistry(0x7ffecc2fe580) adding con mode: secure 2024-06-04T16:12:50.269 INFO:tasks.workunit.client.0.smithi144.stderr: -79> 2024-06-04T16:12:50.179+0000 7f9208b2a800 5 AuthRegistry(0x7ffecc2fe580) adding con mode: crc 2024-06-04T16:12:50.269 INFO:tasks.workunit.client.0.smithi144.stderr: -78> 2024-06-04T16:12:50.179+0000 7f9208b2a800 5 AuthRegistry(0x7ffecc2fe580) adding con mode: secure 2024-06-04T16:12:50.269 INFO:tasks.workunit.client.0.smithi144.stderr: -77> 2024-06-04T16:12:50.179+0000 7f9208b2a800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-06-04T16:12:50.269 INFO:tasks.workunit.client.0.smithi144.stderr: -76> 2024-06-04T16:12:50.179+0000 7f9208b2a800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-06-04T16:12:50.269 INFO:tasks.workunit.client.0.smithi144.stderr: -75> 2024-06-04T16:12:50.179+0000 7f9208b2a800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-06-04T16:12:50.269 INFO:tasks.workunit.client.0.smithi144.stderr: -74> 2024-06-04T16:12:50.180+0000 7f9208b2a800 5 asok(0x5557bfef0c60) register_command cache list hook 0x5557c01e8ab0 2024-06-04T16:12:50.269 INFO:tasks.workunit.client.0.smithi144.stderr: -73> 2024-06-04T16:12:50.180+0000 7f9208b2a800 5 asok(0x5557bfef0c60) register_command cache inspect hook 0x5557c01e8ab0 2024-06-04T16:12:50.269 INFO:tasks.workunit.client.0.smithi144.stderr: -72> 2024-06-04T16:12:50.180+0000 7f9208b2a800 5 asok(0x5557bfef0c60) register_command cache erase hook 0x5557c01e8ab0 2024-06-04T16:12:50.269 INFO:tasks.workunit.client.0.smithi144.stderr: -71> 2024-06-04T16:12:50.180+0000 7f9208b2a800 5 asok(0x5557bfef0c60) register_command cache zap hook 0x5557c01e8ab0 2024-06-04T16:12:50.270 INFO:tasks.workunit.client.0.smithi144.stderr: -70> 2024-06-04T16:12:50.180+0000 7f9208b2a800 5 note: GC not initialized 2024-06-04T16:12:50.270 INFO:tasks.workunit.client.0.smithi144.stderr: -69> 2024-06-04T16:12:50.180+0000 7f90b9fdb640 20 reqs_thread_entry: start 2024-06-04T16:12:50.270 INFO:tasks.workunit.client.0.smithi144.stderr: -68> 2024-06-04T16:12:50.180+0000 7f9208b2a800 5 asok(0x5557bfef0c60) register_command sync trace show hook 0x7f91f4004740 2024-06-04T16:12:50.270 INFO:tasks.workunit.client.0.smithi144.stderr: -67> 2024-06-04T16:12:50.180+0000 7f9208b2a800 5 asok(0x5557bfef0c60) register_command sync trace history hook 0x7f91f4004740 2024-06-04T16:12:50.270 INFO:tasks.workunit.client.0.smithi144.stderr: -66> 2024-06-04T16:12:50.180+0000 7f9208b2a800 5 asok(0x5557bfef0c60) register_command sync trace active hook 0x7f91f4004740 2024-06-04T16:12:50.270 INFO:tasks.workunit.client.0.smithi144.stderr: -65> 2024-06-04T16:12:50.180+0000 7f9208b2a800 5 asok(0x5557bfef0c60) register_command sync trace active_short hook 0x7f91f4004740 2024-06-04T16:12:50.270 INFO:tasks.workunit.client.0.smithi144.stderr: -64> 2024-06-04T16:12:50.180+0000 7f9208b2a800 20 init_complete bucket index max shards: 11 2024-06-04T16:12:50.270 INFO:tasks.workunit.client.0.smithi144.stderr: -63> 2024-06-04T16:12:50.180+0000 7f9208b2a800 20 Filter name: none 2024-06-04T16:12:50.270 INFO:tasks.workunit.client.0.smithi144.stderr: -62> 2024-06-04T16:12:50.180+0000 7f902b7fe640 20 reqs_thread_entry: start 2024-06-04T16:12:50.270 INFO:tasks.workunit.client.0.smithi144.stderr: -61> 2024-06-04T16:12:50.180+0000 7f9208b2a800 10 cache get: name=default.rgw.meta+root+abort-at-commit-target-layout : miss 2024-06-04T16:12:50.270 INFO:tasks.workunit.client.0.smithi144.stderr: -60> 2024-06-04T16:12:50.180+0000 7f9208b2a800 20 rados->read ofs=0 len=0 2024-06-04T16:12:50.270 INFO:tasks.workunit.client.0.smithi144.stderr: -59> 2024-06-04T16:12:50.181+0000 7f9208b2a800 20 rados_obj.operate() r=0 bl.length=197 2024-06-04T16:12:50.270 INFO:tasks.workunit.client.0.smithi144.stderr: -58> 2024-06-04T16:12:50.181+0000 7f9208b2a800 10 cache put: name=default.rgw.meta+root+abort-at-commit-target-layout info.flags=0x11 2024-06-04T16:12:50.271 INFO:tasks.workunit.client.0.smithi144.stderr: -57> 2024-06-04T16:12:50.181+0000 7f9208b2a800 10 adding default.rgw.meta+root+abort-at-commit-target-layout to cache LRU end 2024-06-04T16:12:50.271 INFO:tasks.workunit.client.0.smithi144.stderr: -56> 2024-06-04T16:12:50.181+0000 7f9208b2a800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.26 : miss 2024-06-04T16:12:50.271 INFO:tasks.workunit.client.0.smithi144.stderr: -55> 2024-06-04T16:12:50.181+0000 7f9208b2a800 20 rados->read ofs=0 len=0 2024-06-04T16:12:50.271 INFO:tasks.workunit.client.0.smithi144.stderr: -54> 2024-06-04T16:12:50.181+0000 7f9208b2a800 20 rados_obj.operate() r=0 bl.length=411 2024-06-04T16:12:50.271 INFO:tasks.workunit.client.0.smithi144.stderr: -53> 2024-06-04T16:12:50.181+0000 7f9208b2a800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.26 info.flags=0x17 2024-06-04T16:12:50.271 INFO:tasks.workunit.client.0.smithi144.stderr: -52> 2024-06-04T16:12:50.181+0000 7f9208b2a800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.26 to cache LRU end 2024-06-04T16:12:50.271 INFO:tasks.workunit.client.0.smithi144.stderr: -51> 2024-06-04T16:12:50.181+0000 7f9208b2a800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-06-04T16:12:50.271 INFO:tasks.workunit.client.0.smithi144.stderr: -50> 2024-06-04T16:12:50.181+0000 7f9208b2a800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-06-04T16:12:50.271 INFO:tasks.workunit.client.0.smithi144.stderr: -49> 2024-06-04T16:12:50.181+0000 7f9208b2a800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.26 2024-06-04T16:12:50.271 INFO:tasks.workunit.client.0.smithi144.stderr: -48> 2024-06-04T16:12:50.186+0000 7f9208b2a800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.26 info.flags=0x17 2024-06-04T16:12:50.271 INFO:tasks.workunit.client.0.smithi144.stderr: -47> 2024-06-04T16:12:50.186+0000 7f9208b2a800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.26 to cache LRU end 2024-06-04T16:12:50.271 INFO:tasks.workunit.client.0.smithi144.stderr: -46> 2024-06-04T16:12:50.186+0000 7f9208b2a800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-06-04T16:12:50.271 INFO:tasks.workunit.client.0.smithi144.stderr: -45> 2024-06-04T16:12:50.186+0000 7f9208b2a800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.26, ofs0, ns] 2024-06-04T16:12:50.271 INFO:tasks.workunit.client.0.smithi144.stderr: -44> 2024-06-04T16:12:50.187+0000 7f90db7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1078036791413 cookie 93835373909248 notifier 6392 bl.length()=923 2024-06-04T16:12:50.272 INFO:tasks.workunit.client.0.smithi144.stderr: -43> 2024-06-04T16:12:50.187+0000 7f90db7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.26 info.flags=0x17 2024-06-04T16:12:50.272 INFO:tasks.workunit.client.0.smithi144.stderr: -42> 2024-06-04T16:12:50.187+0000 7f90db7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.26 to cache LRU end 2024-06-04T16:12:50.272 INFO:tasks.workunit.client.0.smithi144.stderr: -41> 2024-06-04T16:12:50.187+0000 7f90db7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-06-04T16:12:50.272 INFO:tasks.workunit.client.0.smithi144.stderr: -40> 2024-06-04T16:12:50.187+0000 7f9208b2a800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.26]): orig_sources= new_sources= 2024-06-04T16:12:50.272 INFO:tasks.workunit.client.0.smithi144.stderr: -39> 2024-06-04T16:12:50.187+0000 7f9208b2a800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.26]): potential sources added=[] removed=[] 2024-06-04T16:12:50.272 INFO:tasks.workunit.client.0.smithi144.stderr: -38> 2024-06-04T16:12:50.187+0000 7f9208b2a800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.26]): orig_dests= new_dests= 2024-06-04T16:12:50.272 INFO:tasks.workunit.client.0.smithi144.stderr: -37> 2024-06-04T16:12:50.187+0000 7f9208b2a800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.26]): potential dests added=[] removed=[] 2024-06-04T16:12:50.272 INFO:tasks.workunit.client.0.smithi144.stderr: -36> 2024-06-04T16:12:50.190+0000 7f9208b2a800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.26.1.0 2024-06-04T16:12:50.272 INFO:tasks.workunit.client.0.smithi144.stderr: -35> 2024-06-04T16:12:50.190+0000 7f9208b2a800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.26.1.0 2024-06-04T16:12:50.272 INFO:tasks.workunit.client.0.smithi144.stderr: -34> 2024-06-04T16:12:50.190+0000 7f9208b2a800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.26.1.1 2024-06-04T16:12:50.272 INFO:tasks.workunit.client.0.smithi144.stderr: -33> 2024-06-04T16:12:50.190+0000 7f9208b2a800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.26.1.1 2024-06-04T16:12:50.272 INFO:tasks.workunit.client.0.smithi144.stderr: -32> 2024-06-04T16:12:50.190+0000 7f9208b2a800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.26.1.2 2024-06-04T16:12:50.272 INFO:tasks.workunit.client.0.smithi144.stderr: -31> 2024-06-04T16:12:50.190+0000 7f9208b2a800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.26.1.2 2024-06-04T16:12:50.273 INFO:tasks.workunit.client.0.smithi144.stderr: -30> 2024-06-04T16:12:50.190+0000 7f9208b2a800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.26.1.3 2024-06-04T16:12:50.273 INFO:tasks.workunit.client.0.smithi144.stderr: -29> 2024-06-04T16:12:50.190+0000 7f9208b2a800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.26.1.3 2024-06-04T16:12:50.273 INFO:tasks.workunit.client.0.smithi144.stderr: -28> 2024-06-04T16:12:50.190+0000 7f9208b2a800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.26.1.4 2024-06-04T16:12:50.273 INFO:tasks.workunit.client.0.smithi144.stderr: -27> 2024-06-04T16:12:50.190+0000 7f9208b2a800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.26.1.4 2024-06-04T16:12:50.273 INFO:tasks.workunit.client.0.smithi144.stderr: -26> 2024-06-04T16:12:50.190+0000 7f9208b2a800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.26.1.5 2024-06-04T16:12:50.273 INFO:tasks.workunit.client.0.smithi144.stderr: -25> 2024-06-04T16:12:50.190+0000 7f9208b2a800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.26.1.5 2024-06-04T16:12:50.273 INFO:tasks.workunit.client.0.smithi144.stderr: -24> 2024-06-04T16:12:50.190+0000 7f9208b2a800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.26.1.6 2024-06-04T16:12:50.273 INFO:tasks.workunit.client.0.smithi144.stderr: -23> 2024-06-04T16:12:50.190+0000 7f9208b2a800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.26.1.6 2024-06-04T16:12:50.273 INFO:tasks.workunit.client.0.smithi144.stderr: -22> 2024-06-04T16:12:50.190+0000 7f9208b2a800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.26.1.7 2024-06-04T16:12:50.273 INFO:tasks.workunit.client.0.smithi144.stderr: -21> 2024-06-04T16:12:50.190+0000 7f9208b2a800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.26.1.7 2024-06-04T16:12:50.273 INFO:tasks.workunit.client.0.smithi144.stderr: -20> 2024-06-04T16:12:50.190+0000 7f9208b2a800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.26.1.8 2024-06-04T16:12:50.273 INFO:tasks.workunit.client.0.smithi144.stderr: -19> 2024-06-04T16:12:50.190+0000 7f9208b2a800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.26.1.8 2024-06-04T16:12:50.273 INFO:tasks.workunit.client.0.smithi144.stderr: -18> 2024-06-04T16:12:50.190+0000 7f9208b2a800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.26.1.9 2024-06-04T16:12:50.273 INFO:tasks.workunit.client.0.smithi144.stderr: -17> 2024-06-04T16:12:50.190+0000 7f9208b2a800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.26.1.9 2024-06-04T16:12:50.274 INFO:tasks.workunit.client.0.smithi144.stderr: -16> 2024-06-04T16:12:50.190+0000 7f9208b2a800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.26.1.10 2024-06-04T16:12:50.274 INFO:tasks.workunit.client.0.smithi144.stderr: -15> 2024-06-04T16:12:50.190+0000 7f9208b2a800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.26.1.10 2024-06-04T16:12:50.274 INFO:tasks.workunit.client.0.smithi144.stderr: -14> 2024-06-04T16:12:50.190+0000 7f9208b2a800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.26.1.11 2024-06-04T16:12:50.274 INFO:tasks.workunit.client.0.smithi144.stderr: -13> 2024-06-04T16:12:50.190+0000 7f9208b2a800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.26.1.11 2024-06-04T16:12:50.274 INFO:tasks.workunit.client.0.smithi144.stderr: -12> 2024-06-04T16:12:50.190+0000 7f9208b2a800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.26.0 2024-06-04T16:12:50.274 INFO:tasks.workunit.client.0.smithi144.stderr: -11> 2024-06-04T16:12:50.190+0000 7f9208b2a800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.26.1 2024-06-04T16:12:50.274 INFO:tasks.workunit.client.0.smithi144.stderr: -10> 2024-06-04T16:12:50.191+0000 7f9208b2a800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.26.2 2024-06-04T16:12:50.274 INFO:tasks.workunit.client.0.smithi144.stderr: -9> 2024-06-04T16:12:50.191+0000 7f9208b2a800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.26.3 2024-06-04T16:12:50.274 INFO:tasks.workunit.client.0.smithi144.stderr: -8> 2024-06-04T16:12:50.192+0000 7f9208b2a800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.26.4 2024-06-04T16:12:50.274 INFO:tasks.workunit.client.0.smithi144.stderr: -7> 2024-06-04T16:12:50.192+0000 7f9208b2a800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.26.5 2024-06-04T16:12:50.274 INFO:tasks.workunit.client.0.smithi144.stderr: -6> 2024-06-04T16:12:50.193+0000 7f9208b2a800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.26.6 2024-06-04T16:12:50.274 INFO:tasks.workunit.client.0.smithi144.stderr: -5> 2024-06-04T16:12:50.193+0000 7f9208b2a800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.26.7 2024-06-04T16:12:50.275 INFO:tasks.workunit.client.0.smithi144.stderr: -4> 2024-06-04T16:12:50.194+0000 7f9208b2a800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.26.8 2024-06-04T16:12:50.275 INFO:tasks.workunit.client.0.smithi144.stderr: -3> 2024-06-04T16:12:50.194+0000 7f9208b2a800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.26.9 2024-06-04T16:12:50.275 INFO:tasks.workunit.client.0.smithi144.stderr: -2> 2024-06-04T16:12:50.195+0000 7f9208b2a800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.26.10 2024-06-04T16:12:50.275 INFO:tasks.workunit.client.0.smithi144.stderr: -1> 2024-06-04T16:12:50.199+0000 7f9208b2a800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-4027-g65533a90/rpm/el9/BUILD/ceph-19.0.0-4027-g65533a90/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f9208b2a800 time 2024-06-04T16:12:50.199416+0000 2024-06-04T16:12:50.275 INFO:tasks.workunit.client.0.smithi144.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-4027-g65533a90/rpm/el9/BUILD/ceph-19.0.0-4027-g65533a90/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-06-04T16:12:50.275 INFO:tasks.workunit.client.0.smithi144.stderr: 2024-06-04T16:12:50.275 INFO:tasks.workunit.client.0.smithi144.stderr: ceph version 19.0.0-4027-g65533a90 (65533a907fc9add1863609703fdbbea67993c8ef) squid (dev) 2024-06-04T16:12:50.275 INFO:tasks.workunit.client.0.smithi144.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f920a181dce] 2024-06-04T16:12:50.275 INFO:tasks.workunit.client.0.smithi144.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x181f8c) [0x7f920a181f8c] 2024-06-04T16:12:50.275 INFO:tasks.workunit.client.0.smithi144.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5557be373fb1] 2024-06-04T16:12:50.275 INFO:tasks.workunit.client.0.smithi144.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x5bf) [0x5557be37f62f] 2024-06-04T16:12:50.276 INFO:tasks.workunit.client.0.smithi144.stderr: 5: main() 2024-06-04T16:12:50.276 INFO:tasks.workunit.client.0.smithi144.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7f9209029590] 2024-06-04T16:12:50.276 INFO:tasks.workunit.client.0.smithi144.stderr: 7: __libc_start_main() 2024-06-04T16:12:50.276 INFO:tasks.workunit.client.0.smithi144.stderr: 8: _start() 2024-06-04T16:12:50.276 INFO:tasks.workunit.client.0.smithi144.stderr: 2024-06-04T16:12:50.276 INFO:tasks.workunit.client.0.smithi144.stderr: 0> 2024-06-04T16:12:50.199+0000 7f9208b2a800 -1 *** Caught signal (Aborted) ** 2024-06-04T16:12:50.276 INFO:tasks.workunit.client.0.smithi144.stderr: in thread 7f9208b2a800 thread_name:radosgw-admin 2024-06-04T16:12:50.276 INFO:tasks.workunit.client.0.smithi144.stderr: 2024-06-04T16:12:50.276 INFO:tasks.workunit.client.0.smithi144.stderr: ceph version 19.0.0-4027-g65533a90 (65533a907fc9add1863609703fdbbea67993c8ef) squid (dev) 2024-06-04T16:12:50.276 INFO:tasks.workunit.client.0.smithi144.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f920903e6f0] 2024-06-04T16:12:50.276 INFO:tasks.workunit.client.0.smithi144.stderr: 2: /lib64/libc.so.6(+0x8b94c) [0x7f920908b94c] 2024-06-04T16:12:50.276 INFO:tasks.workunit.client.0.smithi144.stderr: 3: raise() 2024-06-04T16:12:50.276 INFO:tasks.workunit.client.0.smithi144.stderr: 4: abort() 2024-06-04T16:12:50.276 INFO:tasks.workunit.client.0.smithi144.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f920a181e28] 2024-06-04T16:12:50.277 INFO:tasks.workunit.client.0.smithi144.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x181f8c) [0x7f920a181f8c] 2024-06-04T16:12:50.277 INFO:tasks.workunit.client.0.smithi144.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5557be373fb1] 2024-06-04T16:12:50.277 INFO:tasks.workunit.client.0.smithi144.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x5bf) [0x5557be37f62f] 2024-06-04T16:12:50.277 INFO:tasks.workunit.client.0.smithi144.stderr: 9: main() 2024-06-04T16:12:50.277 INFO:tasks.workunit.client.0.smithi144.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7f9209029590] 2024-06-04T16:12:50.277 INFO:tasks.workunit.client.0.smithi144.stderr: 11: __libc_start_main() 2024-06-04T16:12:50.277 INFO:tasks.workunit.client.0.smithi144.stderr: 12: _start() 2024-06-04T16:12:50.277 INFO:tasks.workunit.client.0.smithi144.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-06-04T16:12:50.277 INFO:tasks.workunit.client.0.smithi144.stderr: 2024-06-04T16:12:50.277 INFO:tasks.workunit.client.0.smithi144.stderr:--- logging levels --- 2024-06-04T16:12:50.277 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 5 none 2024-06-04T16:12:50.277 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 1 lockdep 2024-06-04T16:12:50.277 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 1 context 2024-06-04T16:12:50.277 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 1 crush 2024-06-04T16:12:50.278 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 5 mds 2024-06-04T16:12:50.278 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 5 mds_balancer 2024-06-04T16:12:50.278 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 5 mds_locker 2024-06-04T16:12:50.278 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 5 mds_log 2024-06-04T16:12:50.278 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 5 mds_log_expire 2024-06-04T16:12:50.278 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 5 mds_migrator 2024-06-04T16:12:50.278 INFO:tasks.workunit.client.0.smithi144.stderr: 3/ 5 mds_quiesce 2024-06-04T16:12:50.278 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 1 buffer 2024-06-04T16:12:50.278 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 1 timer 2024-06-04T16:12:50.278 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 1 filer 2024-06-04T16:12:50.278 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 1 striper 2024-06-04T16:12:50.278 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 1 objecter 2024-06-04T16:12:50.278 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 5 rados 2024-06-04T16:12:50.279 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 5 rbd 2024-06-04T16:12:50.279 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 5 rbd_mirror 2024-06-04T16:12:50.279 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 5 rbd_replay 2024-06-04T16:12:50.279 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 5 rbd_pwl 2024-06-04T16:12:50.279 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 5 journaler 2024-06-04T16:12:50.279 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 5 objectcacher 2024-06-04T16:12:50.279 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 5 immutable_obj_cache 2024-06-04T16:12:50.279 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 5 client 2024-06-04T16:12:50.279 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 5 osd 2024-06-04T16:12:50.279 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 5 optracker 2024-06-04T16:12:50.279 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 5 objclass 2024-06-04T16:12:50.279 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 3 filestore 2024-06-04T16:12:50.279 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 3 journal 2024-06-04T16:12:50.279 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 0 ms 2024-06-04T16:12:50.279 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 5 mon 2024-06-04T16:12:50.280 INFO:tasks.workunit.client.0.smithi144.stderr: 0/10 monc 2024-06-04T16:12:50.280 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 5 paxos 2024-06-04T16:12:50.280 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 5 tp 2024-06-04T16:12:50.280 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 5 auth 2024-06-04T16:12:50.280 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 5 crypto 2024-06-04T16:12:50.280 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 1 finisher 2024-06-04T16:12:50.280 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 1 reserver 2024-06-04T16:12:50.280 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 5 heartbeatmap 2024-06-04T16:12:50.280 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 5 perfcounter 2024-06-04T16:12:50.280 INFO:tasks.workunit.client.0.smithi144.stderr: 20/20 rgw 2024-06-04T16:12:50.280 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 5 rgw_sync 2024-06-04T16:12:50.280 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 5 rgw_datacache 2024-06-04T16:12:50.281 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 5 rgw_access 2024-06-04T16:12:50.281 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 5 rgw_dbstore 2024-06-04T16:12:50.281 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 5 rgw_flight 2024-06-04T16:12:50.281 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 5 rgw_lifecycle 2024-06-04T16:12:50.281 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 5 rgw_notification 2024-06-04T16:12:50.281 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 5 javaclient 2024-06-04T16:12:50.281 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 5 asok 2024-06-04T16:12:50.281 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 1 throttle 2024-06-04T16:12:50.281 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 0 refs 2024-06-04T16:12:50.281 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 5 compressor 2024-06-04T16:12:50.281 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 5 bluestore 2024-06-04T16:12:50.281 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 5 bluefs 2024-06-04T16:12:50.281 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 3 bdev 2024-06-04T16:12:50.281 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 5 kstore 2024-06-04T16:12:50.282 INFO:tasks.workunit.client.0.smithi144.stderr: 4/ 5 rocksdb 2024-06-04T16:12:50.282 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 5 fuse 2024-06-04T16:12:50.282 INFO:tasks.workunit.client.0.smithi144.stderr: 2/ 5 mgr 2024-06-04T16:12:50.282 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 5 mgrc 2024-06-04T16:12:50.282 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 5 dpdk 2024-06-04T16:12:50.282 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 5 eventtrace 2024-06-04T16:12:50.282 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 5 prioritycache 2024-06-04T16:12:50.282 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 5 test 2024-06-04T16:12:50.282 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 5 cephfs_mirror 2024-06-04T16:12:50.282 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 5 cephsqlite 2024-06-04T16:12:50.282 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 5 crimson_interrupt 2024-06-04T16:12:50.283 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 5 seastore 2024-06-04T16:12:50.283 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 5 seastore_onode 2024-06-04T16:12:50.283 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 5 seastore_odata 2024-06-04T16:12:50.283 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 5 seastore_omap 2024-06-04T16:12:50.283 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 5 seastore_tm 2024-06-04T16:12:50.283 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 5 seastore_t 2024-06-04T16:12:50.283 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 5 seastore_cleaner 2024-06-04T16:12:50.283 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 5 seastore_epm 2024-06-04T16:12:50.283 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 5 seastore_lba 2024-06-04T16:12:50.283 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 5 seastore_fixedkv_tree 2024-06-04T16:12:50.283 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 5 seastore_cache 2024-06-04T16:12:50.283 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 5 seastore_journal 2024-06-04T16:12:50.283 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 5 seastore_device 2024-06-04T16:12:50.284 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 5 seastore_backref 2024-06-04T16:12:50.284 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 5 alienstore 2024-06-04T16:12:50.284 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 5 mclock 2024-06-04T16:12:50.284 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 5 cyanstore 2024-06-04T16:12:50.284 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 5 ceph_exporter 2024-06-04T16:12:50.284 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 5 memstore 2024-06-04T16:12:50.284 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 5 trace 2024-06-04T16:12:50.284 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 5 ceph_dedup 2024-06-04T16:12:50.284 INFO:tasks.workunit.client.0.smithi144.stderr: -2/-2 (syslog threshold) 2024-06-04T16:12:50.284 INFO:tasks.workunit.client.0.smithi144.stderr: 99/99 (stderr threshold) 2024-06-04T16:12:50.284 INFO:tasks.workunit.client.0.smithi144.stderr:--- pthread ID / name mapping for recent threads --- 2024-06-04T16:12:50.284 INFO:tasks.workunit.client.0.smithi144.stderr: 7f902b7fe640 / http_manager 2024-06-04T16:12:50.284 INFO:tasks.workunit.client.0.smithi144.stderr: 7f90b9fdb640 / http_manager 2024-06-04T16:12:50.285 INFO:tasks.workunit.client.0.smithi144.stderr: 7f90bafdd640 / rgw_dt_lg_renew 2024-06-04T16:12:50.285 INFO:tasks.workunit.client.0.smithi144.stderr: 7f90d9ffb640 / ms_dispatch 2024-06-04T16:12:50.285 INFO:tasks.workunit.client.0.smithi144.stderr: 7f90db7fe640 / io_context_pool 2024-06-04T16:12:50.285 INFO:tasks.workunit.client.0.smithi144.stderr: 7f90e9ffb640 / ms_dispatch 2024-06-04T16:12:50.285 INFO:tasks.workunit.client.0.smithi144.stderr: 7f90f0e09640 / ms_dispatch 2024-06-04T16:12:50.285 INFO:tasks.workunit.client.0.smithi144.stderr: 7f90f260c640 / io_context_pool 2024-06-04T16:12:50.285 INFO:tasks.workunit.client.0.smithi144.stderr: 7f9203fe7640 / msgr-worker-2 2024-06-04T16:12:50.285 INFO:tasks.workunit.client.0.smithi144.stderr: 7f92047e8640 / msgr-worker-1 2024-06-04T16:12:50.285 INFO:tasks.workunit.client.0.smithi144.stderr: 7f9204fe9640 / msgr-worker-0 2024-06-04T16:12:50.285 INFO:tasks.workunit.client.0.smithi144.stderr: 7f92057ea640 / io_context_pool 2024-06-04T16:12:50.285 INFO:tasks.workunit.client.0.smithi144.stderr: 7f9208b2a800 / radosgw-admin 2024-06-04T16:12:50.285 INFO:tasks.workunit.client.0.smithi144.stderr: max_recent 500 2024-06-04T16:12:50.285 INFO:tasks.workunit.client.0.smithi144.stderr: max_new 1000 2024-06-04T16:12:50.285 INFO:tasks.workunit.client.0.smithi144.stderr: log_file /var/log/ceph/ceph-client.admin.104500.log 2024-06-04T16:12:50.286 INFO:tasks.workunit.client.0.smithi144.stderr:--- end dump of recent events --- 2024-06-04T16:12:50.286 INFO:tasks.workunit.client.0.smithi144.stderr:--- begin dump of recent events --- 2024-06-04T16:12:50.286 INFO:tasks.workunit.client.0.smithi144.stderr: -499> 2024-06-04T16:12:49.936+0000 7f9208b2a800 5 AuthRegistry(0x5557c0110bf0) adding con mode: crc 2024-06-04T16:12:50.286 INFO:tasks.workunit.client.0.smithi144.stderr: -498> 2024-06-04T16:12:49.936+0000 7f9208b2a800 5 AuthRegistry(0x5557c0110bf0) adding con mode: secure 2024-06-04T16:12:50.286 INFO:tasks.workunit.client.0.smithi144.stderr: -497> 2024-06-04T16:12:49.936+0000 7f9208b2a800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-06-04T16:12:50.286 INFO:tasks.workunit.client.0.smithi144.stderr: -496> 2024-06-04T16:12:49.936+0000 7f9208b2a800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-06-04T16:12:50.286 INFO:tasks.workunit.client.0.smithi144.stderr: -495> 2024-06-04T16:12:49.936+0000 7f9208b2a800 5 asok(0x5557bfef0c60) register_command rotate-key hook 0x5557c0110d38 2024-06-04T16:12:50.286 INFO:tasks.workunit.client.0.smithi144.stderr: -494> 2024-06-04T16:12:49.936+0000 7f9208b2a800 10 monclient: _reopen_session rank -1 2024-06-04T16:12:50.286 INFO:tasks.workunit.client.0.smithi144.stderr: -493> 2024-06-04T16:12:49.936+0000 7f9208b2a800 10 monclient: _add_conns ranks=[0,2,1] 2024-06-04T16:12:50.286 INFO:tasks.workunit.client.0.smithi144.stderr: -492> 2024-06-04T16:12:49.936+0000 7f9208b2a800 10 monclient(hunting): picked mon.noname-a con 0x5557bffc4eb0 addr [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] 2024-06-04T16:12:50.286 INFO:tasks.workunit.client.0.smithi144.stderr: -491> 2024-06-04T16:12:49.936+0000 7f9208b2a800 10 monclient(hunting): picked mon.noname-c con 0x5557bffc7eb0 addr [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] 2024-06-04T16:12:50.286 INFO:tasks.workunit.client.0.smithi144.stderr: -490> 2024-06-04T16:12:49.936+0000 7f9208b2a800 10 monclient(hunting): picked mon.noname-b con 0x5557c0117400 addr [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] 2024-06-04T16:12:50.287 INFO:tasks.workunit.client.0.smithi144.stderr: -489> 2024-06-04T16:12:49.936+0000 7f9208b2a800 10 monclient(hunting): start opening mon connection 2024-06-04T16:12:50.287 INFO:tasks.workunit.client.0.smithi144.stderr: -488> 2024-06-04T16:12:49.936+0000 7f9208b2a800 10 monclient(hunting): start opening mon connection 2024-06-04T16:12:50.287 INFO:tasks.workunit.client.0.smithi144.stderr: -487> 2024-06-04T16:12:49.936+0000 7f9208b2a800 10 monclient(hunting): start opening mon connection 2024-06-04T16:12:50.287 INFO:tasks.workunit.client.0.smithi144.stderr: -486> 2024-06-04T16:12:49.936+0000 7f9208b2a800 10 monclient(hunting): _renew_subs 2024-06-04T16:12:50.287 INFO:tasks.workunit.client.0.smithi144.stderr: -485> 2024-06-04T16:12:49.936+0000 7f9208b2a800 10 monclient(hunting): authenticate will time out at 2007.753030s 2024-06-04T16:12:50.287 INFO:tasks.workunit.client.0.smithi144.stderr: -484> 2024-06-04T16:12:49.937+0000 7f92047e8640 10 monclient(hunting): get_auth_request con 0x5557bffc4eb0 auth_method 0 2024-06-04T16:12:50.287 INFO:tasks.workunit.client.0.smithi144.stderr: -483> 2024-06-04T16:12:49.937+0000 7f92047e8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-06-04T16:12:50.287 INFO:tasks.workunit.client.0.smithi144.stderr: -482> 2024-06-04T16:12:49.937+0000 7f92047e8640 10 monclient(hunting): _init_auth method 2 2024-06-04T16:12:50.287 INFO:tasks.workunit.client.0.smithi144.stderr: -481> 2024-06-04T16:12:49.937+0000 7f92047e8640 10 monclient(hunting): _init_auth creating new auth 2024-06-04T16:12:50.287 INFO:tasks.workunit.client.0.smithi144.stderr: -480> 2024-06-04T16:12:49.937+0000 7f9203fe7640 10 monclient(hunting): get_auth_request con 0x5557bffc7eb0 auth_method 0 2024-06-04T16:12:50.287 INFO:tasks.workunit.client.0.smithi144.stderr: -479> 2024-06-04T16:12:49.937+0000 7f9203fe7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-06-04T16:12:50.287 INFO:tasks.workunit.client.0.smithi144.stderr: -478> 2024-06-04T16:12:49.937+0000 7f9203fe7640 10 monclient(hunting): _init_auth method 2 2024-06-04T16:12:50.287 INFO:tasks.workunit.client.0.smithi144.stderr: -477> 2024-06-04T16:12:49.937+0000 7f9203fe7640 10 monclient(hunting): _init_auth creating new auth 2024-06-04T16:12:50.288 INFO:tasks.workunit.client.0.smithi144.stderr: -476> 2024-06-04T16:12:49.937+0000 7f92047e8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-06-04T16:12:50.288 INFO:tasks.workunit.client.0.smithi144.stderr: -475> 2024-06-04T16:12:49.937+0000 7f92047e8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-06-04T16:12:50.288 INFO:tasks.workunit.client.0.smithi144.stderr: -474> 2024-06-04T16:12:49.937+0000 7f92047e8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-06-04T16:12:50.288 INFO:tasks.workunit.client.0.smithi144.stderr: -473> 2024-06-04T16:12:49.937+0000 7f9203fe7640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-06-04T16:12:50.288 INFO:tasks.workunit.client.0.smithi144.stderr: -472> 2024-06-04T16:12:49.937+0000 7f9203fe7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-06-04T16:12:50.288 INFO:tasks.workunit.client.0.smithi144.stderr: -471> 2024-06-04T16:12:49.937+0000 7f9203fe7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-06-04T16:12:50.288 INFO:tasks.workunit.client.0.smithi144.stderr: -470> 2024-06-04T16:12:49.937+0000 7f9204fe9640 10 monclient(hunting): get_auth_request con 0x5557c0117400 auth_method 0 2024-06-04T16:12:50.288 INFO:tasks.workunit.client.0.smithi144.stderr: -469> 2024-06-04T16:12:49.937+0000 7f9204fe9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-06-04T16:12:50.288 INFO:tasks.workunit.client.0.smithi144.stderr: -468> 2024-06-04T16:12:49.937+0000 7f9204fe9640 10 monclient(hunting): _init_auth method 2 2024-06-04T16:12:50.288 INFO:tasks.workunit.client.0.smithi144.stderr: -467> 2024-06-04T16:12:49.937+0000 7f9204fe9640 10 monclient(hunting): _init_auth creating new auth 2024-06-04T16:12:50.288 INFO:tasks.workunit.client.0.smithi144.stderr: -466> 2024-06-04T16:12:49.937+0000 7f9204fe9640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-06-04T16:12:50.288 INFO:tasks.workunit.client.0.smithi144.stderr: -465> 2024-06-04T16:12:49.937+0000 7f9204fe9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-06-04T16:12:50.288 INFO:tasks.workunit.client.0.smithi144.stderr: -464> 2024-06-04T16:12:49.937+0000 7f9204fe9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-06-04T16:12:50.288 INFO:tasks.workunit.client.0.smithi144.stderr: -463> 2024-06-04T16:12:49.937+0000 7f92047e8640 10 monclient(hunting): handle_auth_done global_id 6741 payload 824 2024-06-04T16:12:50.289 INFO:tasks.workunit.client.0.smithi144.stderr: -462> 2024-06-04T16:12:49.937+0000 7f92047e8640 10 monclient: _finish_hunting 0 2024-06-04T16:12:50.289 INFO:tasks.workunit.client.0.smithi144.stderr: -461> 2024-06-04T16:12:49.937+0000 7f92047e8640 1 monclient: found mon.noname-a 2024-06-04T16:12:50.289 INFO:tasks.workunit.client.0.smithi144.stderr: -460> 2024-06-04T16:12:49.937+0000 7f92047e8640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.144:3300/0 2024-06-04T16:12:50.289 INFO:tasks.workunit.client.0.smithi144.stderr: -459> 2024-06-04T16:12:49.937+0000 7f90f0e09640 10 monclient: handle_monmap mon_map magic: 0 2024-06-04T16:12:50.289 INFO:tasks.workunit.client.0.smithi144.stderr: -458> 2024-06-04T16:12:49.937+0000 7f90f0e09640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-06-04T16:12:50.289 INFO:tasks.workunit.client.0.smithi144.stderr: -457> 2024-06-04T16:12:49.937+0000 7f90f0e09640 10 monclient: dump: 2024-06-04T16:12:50.289 INFO:tasks.workunit.client.0.smithi144.stderr:epoch 1 2024-06-04T16:12:50.289 INFO:tasks.workunit.client.0.smithi144.stderr:fsid 15e56bb1-4856-42f3-b6db-a2c8f23c5557 2024-06-04T16:12:50.289 INFO:tasks.workunit.client.0.smithi144.stderr:last_changed 2024-06-04T15:51:29.789359+0000 2024-06-04T16:12:50.289 INFO:tasks.workunit.client.0.smithi144.stderr:created 2024-06-04T15:51:29.789359+0000 2024-06-04T16:12:50.289 INFO:tasks.workunit.client.0.smithi144.stderr:min_mon_release 19 (squid) 2024-06-04T16:12:50.289 INFO:tasks.workunit.client.0.smithi144.stderr:election_strategy: 1 2024-06-04T16:12:50.289 INFO:tasks.workunit.client.0.smithi144.stderr:0: [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] mon.a 2024-06-04T16:12:50.289 INFO:tasks.workunit.client.0.smithi144.stderr:1: [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] mon.b 2024-06-04T16:12:50.289 INFO:tasks.workunit.client.0.smithi144.stderr:2: [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] mon.c 2024-06-04T16:12:50.290 INFO:tasks.workunit.client.0.smithi144.stderr: 2024-06-04T16:12:50.290 INFO:tasks.workunit.client.0.smithi144.stderr: -456> 2024-06-04T16:12:49.937+0000 7f90f0e09640 10 monclient: _finish_auth 0 2024-06-04T16:12:50.290 INFO:tasks.workunit.client.0.smithi144.stderr: -455> 2024-06-04T16:12:49.937+0000 7f90f0e09640 10 monclient: _check_auth_tickets 2024-06-04T16:12:50.290 INFO:tasks.workunit.client.0.smithi144.stderr: -454> 2024-06-04T16:12:49.937+0000 7f90f0e09640 10 monclient: handle_config config(0 keys) 2024-06-04T16:12:50.290 INFO:tasks.workunit.client.0.smithi144.stderr: -453> 2024-06-04T16:12:49.937+0000 7f90f0e09640 10 monclient: handle_monmap mon_map magic: 0 2024-06-04T16:12:50.290 INFO:tasks.workunit.client.0.smithi144.stderr: -452> 2024-06-04T16:12:49.937+0000 7f90f0e09640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-06-04T16:12:50.290 INFO:tasks.workunit.client.0.smithi144.stderr: -451> 2024-06-04T16:12:49.937+0000 7f90f0e09640 10 monclient: dump: 2024-06-04T16:12:50.290 INFO:tasks.workunit.client.0.smithi144.stderr:epoch 1 2024-06-04T16:12:50.290 INFO:tasks.workunit.client.0.smithi144.stderr:fsid 15e56bb1-4856-42f3-b6db-a2c8f23c5557 2024-06-04T16:12:50.290 INFO:tasks.workunit.client.0.smithi144.stderr:last_changed 2024-06-04T15:51:29.789359+0000 2024-06-04T16:12:50.290 INFO:tasks.workunit.client.0.smithi144.stderr:created 2024-06-04T15:51:29.789359+0000 2024-06-04T16:12:50.290 INFO:tasks.workunit.client.0.smithi144.stderr:min_mon_release 19 (squid) 2024-06-04T16:12:50.290 INFO:tasks.workunit.client.0.smithi144.stderr:election_strategy: 1 2024-06-04T16:12:50.290 INFO:tasks.workunit.client.0.smithi144.stderr:0: [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] mon.a 2024-06-04T16:12:50.291 INFO:tasks.workunit.client.0.smithi144.stderr:1: [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] mon.b 2024-06-04T16:12:50.291 INFO:tasks.workunit.client.0.smithi144.stderr:2: [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] mon.c 2024-06-04T16:12:50.291 INFO:tasks.workunit.client.0.smithi144.stderr: 2024-06-04T16:12:50.291 INFO:tasks.workunit.client.0.smithi144.stderr: -450> 2024-06-04T16:12:49.937+0000 7f9208b2a800 5 monclient: authenticate success, global_id 6741 2024-06-04T16:12:50.291 INFO:tasks.workunit.client.0.smithi144.stderr: -449> 2024-06-04T16:12:49.937+0000 7f9208b2a800 10 monclient: _renew_subs 2024-06-04T16:12:50.291 INFO:tasks.workunit.client.0.smithi144.stderr: -448> 2024-06-04T16:12:49.937+0000 7f9208b2a800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.144:3300/0 2024-06-04T16:12:50.291 INFO:tasks.workunit.client.0.smithi144.stderr: -447> 2024-06-04T16:12:49.937+0000 7f90f260c640 4 set_mon_vals no callback set 2024-06-04T16:12:50.291 INFO:tasks.workunit.client.0.smithi144.stderr: -446> 2024-06-04T16:12:49.937+0000 7f9208b2a800 10 monclient: _renew_subs 2024-06-04T16:12:50.291 INFO:tasks.workunit.client.0.smithi144.stderr: -445> 2024-06-04T16:12:49.937+0000 7f9208b2a800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.144:3300/0 2024-06-04T16:12:50.291 INFO:tasks.workunit.client.0.smithi144.stderr: -444> 2024-06-04T16:12:49.937+0000 7f9208b2a800 1 librados: init done 2024-06-04T16:12:50.291 INFO:tasks.workunit.client.0.smithi144.stderr: -443> 2024-06-04T16:12:49.939+0000 7f90f0e09640 4 mgrc handle_mgr_map Got map version 5 2024-06-04T16:12:50.291 INFO:tasks.workunit.client.0.smithi144.stderr: -442> 2024-06-04T16:12:49.939+0000 7f90f0e09640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.177:6832/2645786330,v1:172.21.15.177:6833/2645786330] 2024-06-04T16:12:50.291 INFO:tasks.workunit.client.0.smithi144.stderr: -441> 2024-06-04T16:12:49.939+0000 7f90f0e09640 4 mgrc reconnect Starting new session with [v2:172.21.15.177:6832/2645786330,v1:172.21.15.177:6833/2645786330] 2024-06-04T16:12:50.291 INFO:tasks.workunit.client.0.smithi144.stderr: -440> 2024-06-04T16:12:49.939+0000 7f9203fe7640 10 monclient: get_auth_request con 0x7f90ec074cb0 auth_method 0 2024-06-04T16:12:50.292 INFO:tasks.workunit.client.0.smithi144.stderr: -439> 2024-06-04T16:12:49.939+0000 7f9204fe9640 10 monclient: get_auth_request con 0x5557c0139a60 auth_method 0 2024-06-04T16:12:50.292 INFO:tasks.workunit.client.0.smithi144.stderr: -438> 2024-06-04T16:12:49.940+0000 7f92047e8640 10 monclient: get_auth_request con 0x5557c015c4b0 auth_method 0 2024-06-04T16:12:50.292 INFO:tasks.workunit.client.0.smithi144.stderr: -437> 2024-06-04T16:12:49.941+0000 7f9203fe7640 10 monclient: get_auth_request con 0x5557c0160860 auth_method 0 2024-06-04T16:12:50.292 INFO:tasks.workunit.client.0.smithi144.stderr: -436> 2024-06-04T16:12:49.942+0000 7f9204fe9640 10 monclient: get_auth_request con 0x5557c015fd30 auth_method 0 2024-06-04T16:12:50.292 INFO:tasks.workunit.client.0.smithi144.stderr: -435> 2024-06-04T16:12:49.942+0000 7f9208b2a800 10 monclient: build_initial_monmap 2024-06-04T16:12:50.292 INFO:tasks.workunit.client.0.smithi144.stderr: -434> 2024-06-04T16:12:49.942+0000 7f9208b2a800 1 build_initial for_mkfs: 0 2024-06-04T16:12:50.292 INFO:tasks.workunit.client.0.smithi144.stderr: -433> 2024-06-04T16:12:49.942+0000 7f9208b2a800 10 monclient: monmap: 2024-06-04T16:12:50.292 INFO:tasks.workunit.client.0.smithi144.stderr:epoch 0 2024-06-04T16:12:50.292 INFO:tasks.workunit.client.0.smithi144.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-06-04T16:12:50.292 INFO:tasks.workunit.client.0.smithi144.stderr:last_changed 0.000000 2024-06-04T16:12:50.292 INFO:tasks.workunit.client.0.smithi144.stderr:created 0.000000 2024-06-04T16:12:50.292 INFO:tasks.workunit.client.0.smithi144.stderr:min_mon_release 0 (unknown) 2024-06-04T16:12:50.292 INFO:tasks.workunit.client.0.smithi144.stderr:election_strategy: 1 2024-06-04T16:12:50.293 INFO:tasks.workunit.client.0.smithi144.stderr:0: [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] mon.noname-a 2024-06-04T16:12:50.293 INFO:tasks.workunit.client.0.smithi144.stderr:1: [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] mon.noname-b 2024-06-04T16:12:50.293 INFO:tasks.workunit.client.0.smithi144.stderr:2: [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] mon.noname-c 2024-06-04T16:12:50.293 INFO:tasks.workunit.client.0.smithi144.stderr: 2024-06-04T16:12:50.293 INFO:tasks.workunit.client.0.smithi144.stderr: -432> 2024-06-04T16:12:49.942+0000 7f9208b2a800 5 AuthRegistry(0x5557c0168a10) adding auth protocol: cephx 2024-06-04T16:12:50.293 INFO:tasks.workunit.client.0.smithi144.stderr: -431> 2024-06-04T16:12:49.942+0000 7f9208b2a800 5 AuthRegistry(0x5557c0168a10) adding auth protocol: cephx 2024-06-04T16:12:50.293 INFO:tasks.workunit.client.0.smithi144.stderr: -430> 2024-06-04T16:12:49.942+0000 7f9208b2a800 5 AuthRegistry(0x5557c0168a10) adding auth protocol: cephx 2024-06-04T16:12:50.293 INFO:tasks.workunit.client.0.smithi144.stderr: -429> 2024-06-04T16:12:49.942+0000 7f9208b2a800 5 AuthRegistry(0x5557c0168a10) adding con mode: secure 2024-06-04T16:12:50.293 INFO:tasks.workunit.client.0.smithi144.stderr: -428> 2024-06-04T16:12:49.942+0000 7f9208b2a800 5 AuthRegistry(0x5557c0168a10) adding con mode: crc 2024-06-04T16:12:50.293 INFO:tasks.workunit.client.0.smithi144.stderr: -427> 2024-06-04T16:12:49.942+0000 7f9208b2a800 5 AuthRegistry(0x5557c0168a10) adding con mode: secure 2024-06-04T16:12:50.293 INFO:tasks.workunit.client.0.smithi144.stderr: -426> 2024-06-04T16:12:49.942+0000 7f9208b2a800 5 AuthRegistry(0x5557c0168a10) adding con mode: crc 2024-06-04T16:12:50.293 INFO:tasks.workunit.client.0.smithi144.stderr: -425> 2024-06-04T16:12:49.942+0000 7f9208b2a800 5 AuthRegistry(0x5557c0168a10) adding con mode: secure 2024-06-04T16:12:50.293 INFO:tasks.workunit.client.0.smithi144.stderr: -424> 2024-06-04T16:12:49.942+0000 7f9208b2a800 5 AuthRegistry(0x5557c0168a10) adding con mode: crc 2024-06-04T16:12:50.293 INFO:tasks.workunit.client.0.smithi144.stderr: -423> 2024-06-04T16:12:49.942+0000 7f9208b2a800 5 AuthRegistry(0x5557c0168a10) adding con mode: crc 2024-06-04T16:12:50.293 INFO:tasks.workunit.client.0.smithi144.stderr: -422> 2024-06-04T16:12:49.942+0000 7f9208b2a800 5 AuthRegistry(0x5557c0168a10) adding con mode: secure 2024-06-04T16:12:50.294 INFO:tasks.workunit.client.0.smithi144.stderr: -421> 2024-06-04T16:12:49.942+0000 7f9208b2a800 5 AuthRegistry(0x5557c0168a10) adding con mode: crc 2024-06-04T16:12:50.294 INFO:tasks.workunit.client.0.smithi144.stderr: -420> 2024-06-04T16:12:49.942+0000 7f9208b2a800 5 AuthRegistry(0x5557c0168a10) adding con mode: secure 2024-06-04T16:12:50.294 INFO:tasks.workunit.client.0.smithi144.stderr: -419> 2024-06-04T16:12:49.942+0000 7f9208b2a800 5 AuthRegistry(0x5557c0168a10) adding con mode: crc 2024-06-04T16:12:50.294 INFO:tasks.workunit.client.0.smithi144.stderr: -418> 2024-06-04T16:12:49.942+0000 7f9208b2a800 5 AuthRegistry(0x5557c0168a10) adding con mode: secure 2024-06-04T16:12:50.294 INFO:tasks.workunit.client.0.smithi144.stderr: -417> 2024-06-04T16:12:49.943+0000 7f9208b2a800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-06-04T16:12:50.294 INFO:tasks.workunit.client.0.smithi144.stderr: -416> 2024-06-04T16:12:49.943+0000 7f9208b2a800 5 asok(0x5557bfef0c60) register_command objecter_requests cmddesc objecter_requests hook 0x5557c016bf90 EEXIST 2024-06-04T16:12:50.294 INFO:tasks.workunit.client.0.smithi144.stderr: -415> 2024-06-04T16:12:49.943+0000 7f9208b2a800 10 monclient: init 2024-06-04T16:12:50.294 INFO:tasks.workunit.client.0.smithi144.stderr: -414> 2024-06-04T16:12:49.943+0000 7f9208b2a800 5 AuthRegistry(0x5557c0167908) adding auth protocol: cephx 2024-06-04T16:12:50.294 INFO:tasks.workunit.client.0.smithi144.stderr: -413> 2024-06-04T16:12:49.943+0000 7f9208b2a800 5 AuthRegistry(0x5557c0167908) adding auth protocol: cephx 2024-06-04T16:12:50.294 INFO:tasks.workunit.client.0.smithi144.stderr: -412> 2024-06-04T16:12:49.943+0000 7f9208b2a800 5 AuthRegistry(0x5557c0167908) adding auth protocol: cephx 2024-06-04T16:12:50.294 INFO:tasks.workunit.client.0.smithi144.stderr: -411> 2024-06-04T16:12:49.943+0000 7f9208b2a800 5 AuthRegistry(0x5557c0167908) adding con mode: secure 2024-06-04T16:12:50.294 INFO:tasks.workunit.client.0.smithi144.stderr: -410> 2024-06-04T16:12:49.943+0000 7f9208b2a800 5 AuthRegistry(0x5557c0167908) adding con mode: crc 2024-06-04T16:12:50.294 INFO:tasks.workunit.client.0.smithi144.stderr: -409> 2024-06-04T16:12:49.943+0000 7f9208b2a800 5 AuthRegistry(0x5557c0167908) adding con mode: secure 2024-06-04T16:12:50.295 INFO:tasks.workunit.client.0.smithi144.stderr: -408> 2024-06-04T16:12:49.943+0000 7f9208b2a800 5 AuthRegistry(0x5557c0167908) adding con mode: crc 2024-06-04T16:12:50.295 INFO:tasks.workunit.client.0.smithi144.stderr: -407> 2024-06-04T16:12:49.943+0000 7f9208b2a800 5 AuthRegistry(0x5557c0167908) adding con mode: secure 2024-06-04T16:12:50.295 INFO:tasks.workunit.client.0.smithi144.stderr: -406> 2024-06-04T16:12:49.943+0000 7f9208b2a800 5 AuthRegistry(0x5557c0167908) adding con mode: crc 2024-06-04T16:12:50.295 INFO:tasks.workunit.client.0.smithi144.stderr: -405> 2024-06-04T16:12:49.943+0000 7f9208b2a800 5 AuthRegistry(0x5557c0167908) adding con mode: crc 2024-06-04T16:12:50.295 INFO:tasks.workunit.client.0.smithi144.stderr: -404> 2024-06-04T16:12:49.943+0000 7f9208b2a800 5 AuthRegistry(0x5557c0167908) adding con mode: secure 2024-06-04T16:12:50.295 INFO:tasks.workunit.client.0.smithi144.stderr: -403> 2024-06-04T16:12:49.943+0000 7f9208b2a800 5 AuthRegistry(0x5557c0167908) adding con mode: crc 2024-06-04T16:12:50.295 INFO:tasks.workunit.client.0.smithi144.stderr: -402> 2024-06-04T16:12:49.943+0000 7f9208b2a800 5 AuthRegistry(0x5557c0167908) adding con mode: secure 2024-06-04T16:12:50.295 INFO:tasks.workunit.client.0.smithi144.stderr: -401> 2024-06-04T16:12:49.943+0000 7f9208b2a800 5 AuthRegistry(0x5557c0167908) adding con mode: crc 2024-06-04T16:12:50.295 INFO:tasks.workunit.client.0.smithi144.stderr: -400> 2024-06-04T16:12:49.943+0000 7f9208b2a800 5 AuthRegistry(0x5557c0167908) adding con mode: secure 2024-06-04T16:12:50.295 INFO:tasks.workunit.client.0.smithi144.stderr: -399> 2024-06-04T16:12:49.943+0000 7f9208b2a800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-06-04T16:12:50.295 INFO:tasks.workunit.client.0.smithi144.stderr: -398> 2024-06-04T16:12:49.943+0000 7f9208b2a800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-06-04T16:12:50.295 INFO:tasks.workunit.client.0.smithi144.stderr: -397> 2024-06-04T16:12:49.943+0000 7f9208b2a800 5 asok(0x5557bfef0c60) register_command rotate-key cmddesc rotate-key hook 0x5557c0167a50 EEXIST 2024-06-04T16:12:50.295 INFO:tasks.workunit.client.0.smithi144.stderr: -396> 2024-06-04T16:12:49.943+0000 7f9208b2a800 10 monclient: _reopen_session rank -1 2024-06-04T16:12:50.296 INFO:tasks.workunit.client.0.smithi144.stderr: -395> 2024-06-04T16:12:49.943+0000 7f9208b2a800 10 monclient: _add_conns ranks=[1,0,2] 2024-06-04T16:12:50.296 INFO:tasks.workunit.client.0.smithi144.stderr: -394> 2024-06-04T16:12:49.943+0000 7f9208b2a800 10 monclient(hunting): picked mon.noname-b con 0x5557bff993c0 addr [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] 2024-06-04T16:12:50.296 INFO:tasks.workunit.client.0.smithi144.stderr: -393> 2024-06-04T16:12:49.943+0000 7f9208b2a800 10 monclient(hunting): picked mon.noname-a con 0x5557c01734c0 addr [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] 2024-06-04T16:12:50.296 INFO:tasks.workunit.client.0.smithi144.stderr: -392> 2024-06-04T16:12:49.943+0000 7f9208b2a800 10 monclient(hunting): picked mon.noname-c con 0x5557c0195920 addr [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] 2024-06-04T16:12:50.296 INFO:tasks.workunit.client.0.smithi144.stderr: -391> 2024-06-04T16:12:49.943+0000 7f9208b2a800 10 monclient(hunting): start opening mon connection 2024-06-04T16:12:50.296 INFO:tasks.workunit.client.0.smithi144.stderr: -390> 2024-06-04T16:12:49.943+0000 7f9208b2a800 10 monclient(hunting): start opening mon connection 2024-06-04T16:12:50.296 INFO:tasks.workunit.client.0.smithi144.stderr: -389> 2024-06-04T16:12:49.943+0000 7f9208b2a800 10 monclient(hunting): start opening mon connection 2024-06-04T16:12:50.296 INFO:tasks.workunit.client.0.smithi144.stderr: -388> 2024-06-04T16:12:49.943+0000 7f9208b2a800 10 monclient(hunting): _renew_subs 2024-06-04T16:12:50.296 INFO:tasks.workunit.client.0.smithi144.stderr: -387> 2024-06-04T16:12:49.943+0000 7f9208b2a800 10 monclient(hunting): authenticate will time out at 2007.759907s 2024-06-04T16:12:50.296 INFO:tasks.workunit.client.0.smithi144.stderr: -386> 2024-06-04T16:12:49.943+0000 7f9204fe9640 10 monclient(hunting): get_auth_request con 0x5557c01734c0 auth_method 0 2024-06-04T16:12:50.296 INFO:tasks.workunit.client.0.smithi144.stderr: -385> 2024-06-04T16:12:49.943+0000 7f9204fe9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-06-04T16:12:50.296 INFO:tasks.workunit.client.0.smithi144.stderr: -384> 2024-06-04T16:12:49.943+0000 7f9204fe9640 10 monclient(hunting): _init_auth method 2 2024-06-04T16:12:50.296 INFO:tasks.workunit.client.0.smithi144.stderr: -383> 2024-06-04T16:12:49.943+0000 7f9204fe9640 10 monclient(hunting): _init_auth creating new auth 2024-06-04T16:12:50.296 INFO:tasks.workunit.client.0.smithi144.stderr: -382> 2024-06-04T16:12:49.943+0000 7f92047e8640 10 monclient(hunting): get_auth_request con 0x5557c0195920 auth_method 0 2024-06-04T16:12:50.297 INFO:tasks.workunit.client.0.smithi144.stderr: -381> 2024-06-04T16:12:49.943+0000 7f92047e8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-06-04T16:12:50.297 INFO:tasks.workunit.client.0.smithi144.stderr: -380> 2024-06-04T16:12:49.943+0000 7f92047e8640 10 monclient(hunting): _init_auth method 2 2024-06-04T16:12:50.297 INFO:tasks.workunit.client.0.smithi144.stderr: -379> 2024-06-04T16:12:49.943+0000 7f92047e8640 10 monclient(hunting): _init_auth creating new auth 2024-06-04T16:12:50.297 INFO:tasks.workunit.client.0.smithi144.stderr: -378> 2024-06-04T16:12:49.943+0000 7f9204fe9640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-06-04T16:12:50.297 INFO:tasks.workunit.client.0.smithi144.stderr: -377> 2024-06-04T16:12:49.943+0000 7f9204fe9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-06-04T16:12:50.297 INFO:tasks.workunit.client.0.smithi144.stderr: -376> 2024-06-04T16:12:49.943+0000 7f9204fe9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-06-04T16:12:50.297 INFO:tasks.workunit.client.0.smithi144.stderr: -375> 2024-06-04T16:12:49.943+0000 7f9203fe7640 10 monclient(hunting): get_auth_request con 0x5557bff993c0 auth_method 0 2024-06-04T16:12:50.297 INFO:tasks.workunit.client.0.smithi144.stderr: -374> 2024-06-04T16:12:49.943+0000 7f9203fe7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-06-04T16:12:50.297 INFO:tasks.workunit.client.0.smithi144.stderr: -373> 2024-06-04T16:12:49.943+0000 7f9203fe7640 10 monclient(hunting): _init_auth method 2 2024-06-04T16:12:50.297 INFO:tasks.workunit.client.0.smithi144.stderr: -372> 2024-06-04T16:12:49.943+0000 7f9203fe7640 10 monclient(hunting): _init_auth creating new auth 2024-06-04T16:12:50.297 INFO:tasks.workunit.client.0.smithi144.stderr: -371> 2024-06-04T16:12:49.943+0000 7f92047e8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-06-04T16:12:50.297 INFO:tasks.workunit.client.0.smithi144.stderr: -370> 2024-06-04T16:12:49.943+0000 7f92047e8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-06-04T16:12:50.297 INFO:tasks.workunit.client.0.smithi144.stderr: -369> 2024-06-04T16:12:49.944+0000 7f92047e8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-06-04T16:12:50.298 INFO:tasks.workunit.client.0.smithi144.stderr: -368> 2024-06-04T16:12:49.944+0000 7f9203fe7640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-06-04T16:12:50.298 INFO:tasks.workunit.client.0.smithi144.stderr: -367> 2024-06-04T16:12:49.944+0000 7f9203fe7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-06-04T16:12:50.298 INFO:tasks.workunit.client.0.smithi144.stderr: -366> 2024-06-04T16:12:49.944+0000 7f9203fe7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-06-04T16:12:50.298 INFO:tasks.workunit.client.0.smithi144.stderr: -365> 2024-06-04T16:12:49.944+0000 7f9204fe9640 10 monclient(hunting): handle_auth_done global_id 6744 payload 824 2024-06-04T16:12:50.298 INFO:tasks.workunit.client.0.smithi144.stderr: -364> 2024-06-04T16:12:49.944+0000 7f9204fe9640 10 monclient: _finish_hunting 0 2024-06-04T16:12:50.298 INFO:tasks.workunit.client.0.smithi144.stderr: -363> 2024-06-04T16:12:49.944+0000 7f9204fe9640 1 monclient: found mon.noname-a 2024-06-04T16:12:50.298 INFO:tasks.workunit.client.0.smithi144.stderr: -362> 2024-06-04T16:12:49.944+0000 7f9204fe9640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.144:3300/0 2024-06-04T16:12:50.298 INFO:tasks.workunit.client.0.smithi144.stderr: -361> 2024-06-04T16:12:49.944+0000 7f90e9ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-06-04T16:12:50.298 INFO:tasks.workunit.client.0.smithi144.stderr: -360> 2024-06-04T16:12:49.944+0000 7f90e9ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-06-04T16:12:50.298 INFO:tasks.workunit.client.0.smithi144.stderr: -359> 2024-06-04T16:12:49.944+0000 7f90e9ffb640 10 monclient: dump: 2024-06-04T16:12:50.298 INFO:tasks.workunit.client.0.smithi144.stderr:epoch 1 2024-06-04T16:12:50.298 INFO:tasks.workunit.client.0.smithi144.stderr:fsid 15e56bb1-4856-42f3-b6db-a2c8f23c5557 2024-06-04T16:12:50.298 INFO:tasks.workunit.client.0.smithi144.stderr:last_changed 2024-06-04T15:51:29.789359+0000 2024-06-04T16:12:50.299 INFO:tasks.workunit.client.0.smithi144.stderr:created 2024-06-04T15:51:29.789359+0000 2024-06-04T16:12:50.299 INFO:tasks.workunit.client.0.smithi144.stderr:min_mon_release 19 (squid) 2024-06-04T16:12:50.299 INFO:tasks.workunit.client.0.smithi144.stderr:election_strategy: 1 2024-06-04T16:12:50.299 INFO:tasks.workunit.client.0.smithi144.stderr:0: [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] mon.a 2024-06-04T16:12:50.299 INFO:tasks.workunit.client.0.smithi144.stderr:1: [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] mon.b 2024-06-04T16:12:50.299 INFO:tasks.workunit.client.0.smithi144.stderr:2: [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] mon.c 2024-06-04T16:12:50.299 INFO:tasks.workunit.client.0.smithi144.stderr: 2024-06-04T16:12:50.299 INFO:tasks.workunit.client.0.smithi144.stderr: -358> 2024-06-04T16:12:49.944+0000 7f90e9ffb640 10 monclient: _finish_auth 0 2024-06-04T16:12:50.299 INFO:tasks.workunit.client.0.smithi144.stderr: -357> 2024-06-04T16:12:49.944+0000 7f90e9ffb640 10 monclient: _check_auth_tickets 2024-06-04T16:12:50.299 INFO:tasks.workunit.client.0.smithi144.stderr: -356> 2024-06-04T16:12:49.944+0000 7f90e9ffb640 10 monclient: handle_config config(0 keys) 2024-06-04T16:12:50.299 INFO:tasks.workunit.client.0.smithi144.stderr: -355> 2024-06-04T16:12:49.944+0000 7f90e9ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-06-04T16:12:50.299 INFO:tasks.workunit.client.0.smithi144.stderr: -354> 2024-06-04T16:12:49.944+0000 7f90e9ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-06-04T16:12:50.299 INFO:tasks.workunit.client.0.smithi144.stderr: -353> 2024-06-04T16:12:49.944+0000 7f90e9ffb640 10 monclient: dump: 2024-06-04T16:12:50.300 INFO:tasks.workunit.client.0.smithi144.stderr:epoch 1 2024-06-04T16:12:50.300 INFO:tasks.workunit.client.0.smithi144.stderr:fsid 15e56bb1-4856-42f3-b6db-a2c8f23c5557 2024-06-04T16:12:50.300 INFO:tasks.workunit.client.0.smithi144.stderr:last_changed 2024-06-04T15:51:29.789359+0000 2024-06-04T16:12:50.300 INFO:tasks.workunit.client.0.smithi144.stderr:created 2024-06-04T15:51:29.789359+0000 2024-06-04T16:12:50.300 INFO:tasks.workunit.client.0.smithi144.stderr:min_mon_release 19 (squid) 2024-06-04T16:12:50.300 INFO:tasks.workunit.client.0.smithi144.stderr:election_strategy: 1 2024-06-04T16:12:50.300 INFO:tasks.workunit.client.0.smithi144.stderr:0: [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] mon.a 2024-06-04T16:12:50.300 INFO:tasks.workunit.client.0.smithi144.stderr:1: [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] mon.b 2024-06-04T16:12:50.300 INFO:tasks.workunit.client.0.smithi144.stderr:2: [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] mon.c 2024-06-04T16:12:50.300 INFO:tasks.workunit.client.0.smithi144.stderr: 2024-06-04T16:12:50.300 INFO:tasks.workunit.client.0.smithi144.stderr: -352> 2024-06-04T16:12:49.944+0000 7f9208b2a800 5 monclient: authenticate success, global_id 6744 2024-06-04T16:12:50.300 INFO:tasks.workunit.client.0.smithi144.stderr: -351> 2024-06-04T16:12:49.944+0000 7f9208b2a800 10 monclient: _renew_subs 2024-06-04T16:12:50.300 INFO:tasks.workunit.client.0.smithi144.stderr: -350> 2024-06-04T16:12:49.944+0000 7f92057ea640 4 set_mon_vals no callback set 2024-06-04T16:12:50.300 INFO:tasks.workunit.client.0.smithi144.stderr: -349> 2024-06-04T16:12:49.944+0000 7f9208b2a800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.144:3300/0 2024-06-04T16:12:50.301 INFO:tasks.workunit.client.0.smithi144.stderr: -348> 2024-06-04T16:12:49.944+0000 7f9208b2a800 10 monclient: _renew_subs 2024-06-04T16:12:50.301 INFO:tasks.workunit.client.0.smithi144.stderr: -347> 2024-06-04T16:12:49.944+0000 7f9208b2a800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.144:3300/0 2024-06-04T16:12:50.301 INFO:tasks.workunit.client.0.smithi144.stderr: -346> 2024-06-04T16:12:49.946+0000 7f90e9ffb640 4 mgrc handle_mgr_map Got map version 5 2024-06-04T16:12:50.301 INFO:tasks.workunit.client.0.smithi144.stderr: -345> 2024-06-04T16:12:49.946+0000 7f90e9ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.177:6832/2645786330,v1:172.21.15.177:6833/2645786330] 2024-06-04T16:12:50.301 INFO:tasks.workunit.client.0.smithi144.stderr: -344> 2024-06-04T16:12:49.946+0000 7f90e9ffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.177:6832/2645786330,v1:172.21.15.177:6833/2645786330] 2024-06-04T16:12:50.301 INFO:tasks.workunit.client.0.smithi144.stderr: -343> 2024-06-04T16:12:49.946+0000 7f9203fe7640 10 monclient: get_auth_request con 0x7f90dc074bf0 auth_method 0 2024-06-04T16:12:50.301 INFO:tasks.workunit.client.0.smithi144.stderr: -342> 2024-06-04T16:12:49.946+0000 7f9208b2a800 10 monclient: get_monmap_and_config 2024-06-04T16:12:50.301 INFO:tasks.workunit.client.0.smithi144.stderr: -341> 2024-06-04T16:12:49.946+0000 7f9208b2a800 10 monclient: build_initial_monmap 2024-06-04T16:12:50.301 INFO:tasks.workunit.client.0.smithi144.stderr: -340> 2024-06-04T16:12:49.946+0000 7f9208b2a800 1 build_initial for_mkfs: 0 2024-06-04T16:12:50.301 INFO:tasks.workunit.client.0.smithi144.stderr: -339> 2024-06-04T16:12:49.946+0000 7f9208b2a800 10 monclient: monmap: 2024-06-04T16:12:50.301 INFO:tasks.workunit.client.0.smithi144.stderr:epoch 0 2024-06-04T16:12:50.301 INFO:tasks.workunit.client.0.smithi144.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-06-04T16:12:50.301 INFO:tasks.workunit.client.0.smithi144.stderr:last_changed 0.000000 2024-06-04T16:12:50.301 INFO:tasks.workunit.client.0.smithi144.stderr:created 0.000000 2024-06-04T16:12:50.302 INFO:tasks.workunit.client.0.smithi144.stderr:min_mon_release 0 (unknown) 2024-06-04T16:12:50.302 INFO:tasks.workunit.client.0.smithi144.stderr:election_strategy: 1 2024-06-04T16:12:50.302 INFO:tasks.workunit.client.0.smithi144.stderr:0: [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] mon.noname-a 2024-06-04T16:12:50.302 INFO:tasks.workunit.client.0.smithi144.stderr:1: [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] mon.noname-b 2024-06-04T16:12:50.302 INFO:tasks.workunit.client.0.smithi144.stderr:2: [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] mon.noname-c 2024-06-04T16:12:50.302 INFO:tasks.workunit.client.0.smithi144.stderr: 2024-06-04T16:12:50.302 INFO:tasks.workunit.client.0.smithi144.stderr: -338> 2024-06-04T16:12:49.946+0000 7f9208b2a800 5 AuthRegistry(0x5557c01b1220) adding auth protocol: cephx 2024-06-04T16:12:50.302 INFO:tasks.workunit.client.0.smithi144.stderr: -337> 2024-06-04T16:12:49.946+0000 7f9208b2a800 5 AuthRegistry(0x5557c01b1220) adding auth protocol: cephx 2024-06-04T16:12:50.302 INFO:tasks.workunit.client.0.smithi144.stderr: -336> 2024-06-04T16:12:49.946+0000 7f9208b2a800 5 AuthRegistry(0x5557c01b1220) adding auth protocol: cephx 2024-06-04T16:12:50.302 INFO:tasks.workunit.client.0.smithi144.stderr: -335> 2024-06-04T16:12:49.946+0000 7f9208b2a800 5 AuthRegistry(0x5557c01b1220) adding con mode: secure 2024-06-04T16:12:50.302 INFO:tasks.workunit.client.0.smithi144.stderr: -334> 2024-06-04T16:12:49.946+0000 7f9208b2a800 5 AuthRegistry(0x5557c01b1220) adding con mode: crc 2024-06-04T16:12:50.302 INFO:tasks.workunit.client.0.smithi144.stderr: -333> 2024-06-04T16:12:49.946+0000 7f9208b2a800 5 AuthRegistry(0x5557c01b1220) adding con mode: secure 2024-06-04T16:12:50.303 INFO:tasks.workunit.client.0.smithi144.stderr: -332> 2024-06-04T16:12:49.946+0000 7f9208b2a800 5 AuthRegistry(0x5557c01b1220) adding con mode: crc 2024-06-04T16:12:50.303 INFO:tasks.workunit.client.0.smithi144.stderr: -331> 2024-06-04T16:12:49.946+0000 7f9208b2a800 5 AuthRegistry(0x5557c01b1220) adding con mode: secure 2024-06-04T16:12:50.303 INFO:tasks.workunit.client.0.smithi144.stderr: -330> 2024-06-04T16:12:49.946+0000 7f9208b2a800 5 AuthRegistry(0x5557c01b1220) adding con mode: crc 2024-06-04T16:12:50.303 INFO:tasks.workunit.client.0.smithi144.stderr: -329> 2024-06-04T16:12:49.946+0000 7f9208b2a800 5 AuthRegistry(0x5557c01b1220) adding con mode: crc 2024-06-04T16:12:50.303 INFO:tasks.workunit.client.0.smithi144.stderr: -328> 2024-06-04T16:12:49.946+0000 7f9208b2a800 5 AuthRegistry(0x5557c01b1220) adding con mode: secure 2024-06-04T16:12:50.303 INFO:tasks.workunit.client.0.smithi144.stderr: -327> 2024-06-04T16:12:49.946+0000 7f9208b2a800 5 AuthRegistry(0x5557c01b1220) adding con mode: crc 2024-06-04T16:12:50.303 INFO:tasks.workunit.client.0.smithi144.stderr: -326> 2024-06-04T16:12:49.946+0000 7f9208b2a800 5 AuthRegistry(0x5557c01b1220) adding con mode: secure 2024-06-04T16:12:50.303 INFO:tasks.workunit.client.0.smithi144.stderr: -325> 2024-06-04T16:12:49.946+0000 7f9208b2a800 5 AuthRegistry(0x5557c01b1220) adding con mode: crc 2024-06-04T16:12:50.303 INFO:tasks.workunit.client.0.smithi144.stderr: -324> 2024-06-04T16:12:49.946+0000 7f9208b2a800 5 AuthRegistry(0x5557c01b1220) adding con mode: secure 2024-06-04T16:12:50.303 INFO:tasks.workunit.client.0.smithi144.stderr: -323> 2024-06-04T16:12:49.946+0000 7f9208b2a800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-06-04T16:12:50.303 INFO:tasks.workunit.client.0.smithi144.stderr: -322> 2024-06-04T16:12:49.947+0000 7f9208b2a800 10 monclient: init 2024-06-04T16:12:50.303 INFO:tasks.workunit.client.0.smithi144.stderr: -321> 2024-06-04T16:12:49.947+0000 7f9208b2a800 5 AuthRegistry(0x7ffecc2fe0a0) adding auth protocol: cephx 2024-06-04T16:12:50.303 INFO:tasks.workunit.client.0.smithi144.stderr: -320> 2024-06-04T16:12:49.947+0000 7f9208b2a800 5 AuthRegistry(0x7ffecc2fe0a0) adding auth protocol: cephx 2024-06-04T16:12:50.303 INFO:tasks.workunit.client.0.smithi144.stderr: -319> 2024-06-04T16:12:49.947+0000 7f9208b2a800 5 AuthRegistry(0x7ffecc2fe0a0) adding auth protocol: cephx 2024-06-04T16:12:50.303 INFO:tasks.workunit.client.0.smithi144.stderr: -318> 2024-06-04T16:12:49.947+0000 7f9208b2a800 5 AuthRegistry(0x7ffecc2fe0a0) adding con mode: secure 2024-06-04T16:12:50.304 INFO:tasks.workunit.client.0.smithi144.stderr: -317> 2024-06-04T16:12:49.947+0000 7f9208b2a800 5 AuthRegistry(0x7ffecc2fe0a0) adding con mode: crc 2024-06-04T16:12:50.304 INFO:tasks.workunit.client.0.smithi144.stderr: -316> 2024-06-04T16:12:49.947+0000 7f9208b2a800 5 AuthRegistry(0x7ffecc2fe0a0) adding con mode: secure 2024-06-04T16:12:50.304 INFO:tasks.workunit.client.0.smithi144.stderr: -315> 2024-06-04T16:12:49.947+0000 7f9208b2a800 5 AuthRegistry(0x7ffecc2fe0a0) adding con mode: crc 2024-06-04T16:12:50.304 INFO:tasks.workunit.client.0.smithi144.stderr: -314> 2024-06-04T16:12:49.947+0000 7f9208b2a800 5 AuthRegistry(0x7ffecc2fe0a0) adding con mode: secure 2024-06-04T16:12:50.304 INFO:tasks.workunit.client.0.smithi144.stderr: -313> 2024-06-04T16:12:49.947+0000 7f9208b2a800 5 AuthRegistry(0x7ffecc2fe0a0) adding con mode: crc 2024-06-04T16:12:50.304 INFO:tasks.workunit.client.0.smithi144.stderr: -312> 2024-06-04T16:12:49.947+0000 7f9208b2a800 5 AuthRegistry(0x7ffecc2fe0a0) adding con mode: crc 2024-06-04T16:12:50.304 INFO:tasks.workunit.client.0.smithi144.stderr: -311> 2024-06-04T16:12:49.947+0000 7f9208b2a800 5 AuthRegistry(0x7ffecc2fe0a0) adding con mode: secure 2024-06-04T16:12:50.304 INFO:tasks.workunit.client.0.smithi144.stderr: -310> 2024-06-04T16:12:49.947+0000 7f9208b2a800 5 AuthRegistry(0x7ffecc2fe0a0) adding con mode: crc 2024-06-04T16:12:50.304 INFO:tasks.workunit.client.0.smithi144.stderr: -309> 2024-06-04T16:12:49.947+0000 7f9208b2a800 5 AuthRegistry(0x7ffecc2fe0a0) adding con mode: secure 2024-06-04T16:12:50.304 INFO:tasks.workunit.client.0.smithi144.stderr: -308> 2024-06-04T16:12:49.947+0000 7f9208b2a800 5 AuthRegistry(0x7ffecc2fe0a0) adding con mode: crc 2024-06-04T16:12:50.304 INFO:tasks.workunit.client.0.smithi144.stderr: -307> 2024-06-04T16:12:49.947+0000 7f9208b2a800 5 AuthRegistry(0x7ffecc2fe0a0) adding con mode: secure 2024-06-04T16:12:50.304 INFO:tasks.workunit.client.0.smithi144.stderr: -306> 2024-06-04T16:12:49.947+0000 7f9208b2a800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-06-04T16:12:50.304 INFO:tasks.workunit.client.0.smithi144.stderr: -305> 2024-06-04T16:12:49.947+0000 7f9208b2a800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-06-04T16:12:50.304 INFO:tasks.workunit.client.0.smithi144.stderr: -304> 2024-06-04T16:12:49.947+0000 7f9208b2a800 5 asok(0x5557bfef0c60) register_command rotate-key cmddesc rotate-key hook 0x7ffecc2fe1e8 EEXIST 2024-06-04T16:12:50.305 INFO:tasks.workunit.client.0.smithi144.stderr: -303> 2024-06-04T16:12:49.947+0000 7f9208b2a800 10 monclient: _reopen_session rank -1 2024-06-04T16:12:50.305 INFO:tasks.workunit.client.0.smithi144.stderr: -302> 2024-06-04T16:12:49.947+0000 7f9208b2a800 10 monclient: _add_conns ranks=[0,2,1] 2024-06-04T16:12:50.305 INFO:tasks.workunit.client.0.smithi144.stderr: -301> 2024-06-04T16:12:49.947+0000 7f9208b2a800 10 monclient(hunting): picked mon.noname-a con 0x5557c01e10e0 addr [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] 2024-06-04T16:12:50.305 INFO:tasks.workunit.client.0.smithi144.stderr: -300> 2024-06-04T16:12:49.947+0000 7f9208b2a800 10 monclient(hunting): picked mon.noname-c con 0x5557c01e14c0 addr [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] 2024-06-04T16:12:50.305 INFO:tasks.workunit.client.0.smithi144.stderr: -299> 2024-06-04T16:12:49.947+0000 7f9208b2a800 10 monclient(hunting): picked mon.noname-b con 0x5557c01de260 addr [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] 2024-06-04T16:12:50.305 INFO:tasks.workunit.client.0.smithi144.stderr: -298> 2024-06-04T16:12:49.947+0000 7f9208b2a800 10 monclient(hunting): start opening mon connection 2024-06-04T16:12:50.305 INFO:tasks.workunit.client.0.smithi144.stderr: -297> 2024-06-04T16:12:49.947+0000 7f9208b2a800 10 monclient(hunting): start opening mon connection 2024-06-04T16:12:50.305 INFO:tasks.workunit.client.0.smithi144.stderr: -296> 2024-06-04T16:12:49.947+0000 7f9208b2a800 10 monclient(hunting): start opening mon connection 2024-06-04T16:12:50.305 INFO:tasks.workunit.client.0.smithi144.stderr: -295> 2024-06-04T16:12:49.947+0000 7f9208b2a800 10 monclient(hunting): _renew_subs 2024-06-04T16:12:50.305 INFO:tasks.workunit.client.0.smithi144.stderr: -294> 2024-06-04T16:12:49.947+0000 7f9208b2a800 10 monclient(hunting): authenticate will time out at 2007.763738s 2024-06-04T16:12:50.305 INFO:tasks.workunit.client.0.smithi144.stderr: -293> 2024-06-04T16:12:49.947+0000 7f9203fe7640 10 monclient(hunting): get_auth_request con 0x5557c01e10e0 auth_method 0 2024-06-04T16:12:50.305 INFO:tasks.workunit.client.0.smithi144.stderr: -292> 2024-06-04T16:12:49.947+0000 7f9203fe7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-06-04T16:12:50.305 INFO:tasks.workunit.client.0.smithi144.stderr: -291> 2024-06-04T16:12:49.947+0000 7f9203fe7640 10 monclient(hunting): _init_auth method 2 2024-06-04T16:12:50.305 INFO:tasks.workunit.client.0.smithi144.stderr: -290> 2024-06-04T16:12:49.947+0000 7f9203fe7640 10 monclient(hunting): _init_auth creating new auth 2024-06-04T16:12:50.306 INFO:tasks.workunit.client.0.smithi144.stderr: -289> 2024-06-04T16:12:49.947+0000 7f9204fe9640 10 monclient(hunting): get_auth_request con 0x5557c01e14c0 auth_method 0 2024-06-04T16:12:50.306 INFO:tasks.workunit.client.0.smithi144.stderr: -288> 2024-06-04T16:12:49.947+0000 7f9204fe9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-06-04T16:12:50.306 INFO:tasks.workunit.client.0.smithi144.stderr: -287> 2024-06-04T16:12:49.947+0000 7f9204fe9640 10 monclient(hunting): _init_auth method 2 2024-06-04T16:12:50.306 INFO:tasks.workunit.client.0.smithi144.stderr: -286> 2024-06-04T16:12:49.947+0000 7f9204fe9640 10 monclient(hunting): _init_auth creating new auth 2024-06-04T16:12:50.306 INFO:tasks.workunit.client.0.smithi144.stderr: -285> 2024-06-04T16:12:49.947+0000 7f9204fe9640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-06-04T16:12:50.306 INFO:tasks.workunit.client.0.smithi144.stderr: -284> 2024-06-04T16:12:49.947+0000 7f9204fe9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-06-04T16:12:50.306 INFO:tasks.workunit.client.0.smithi144.stderr: -283> 2024-06-04T16:12:49.947+0000 7f9204fe9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-06-04T16:12:50.306 INFO:tasks.workunit.client.0.smithi144.stderr: -282> 2024-06-04T16:12:49.947+0000 7f92047e8640 10 monclient(hunting): get_auth_request con 0x5557c01de260 auth_method 0 2024-06-04T16:12:50.306 INFO:tasks.workunit.client.0.smithi144.stderr: -281> 2024-06-04T16:12:49.947+0000 7f92047e8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-06-04T16:12:50.306 INFO:tasks.workunit.client.0.smithi144.stderr: -280> 2024-06-04T16:12:49.947+0000 7f92047e8640 10 monclient(hunting): _init_auth method 2 2024-06-04T16:12:50.306 INFO:tasks.workunit.client.0.smithi144.stderr: -279> 2024-06-04T16:12:49.947+0000 7f92047e8640 10 monclient(hunting): _init_auth creating new auth 2024-06-04T16:12:50.306 INFO:tasks.workunit.client.0.smithi144.stderr: -278> 2024-06-04T16:12:49.947+0000 7f9203fe7640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-06-04T16:12:50.306 INFO:tasks.workunit.client.0.smithi144.stderr: -277> 2024-06-04T16:12:49.947+0000 7f9203fe7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-06-04T16:12:50.306 INFO:tasks.workunit.client.0.smithi144.stderr: -276> 2024-06-04T16:12:49.947+0000 7f9203fe7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-06-04T16:12:50.307 INFO:tasks.workunit.client.0.smithi144.stderr: -275> 2024-06-04T16:12:49.947+0000 7f92047e8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-06-04T16:12:50.307 INFO:tasks.workunit.client.0.smithi144.stderr: -274> 2024-06-04T16:12:49.947+0000 7f92047e8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-06-04T16:12:50.307 INFO:tasks.workunit.client.0.smithi144.stderr: -273> 2024-06-04T16:12:49.947+0000 7f92047e8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-06-04T16:12:50.307 INFO:tasks.workunit.client.0.smithi144.stderr: -272> 2024-06-04T16:12:49.947+0000 7f9204fe9640 10 monclient(hunting): handle_auth_done global_id 6389 payload 274 2024-06-04T16:12:50.307 INFO:tasks.workunit.client.0.smithi144.stderr: -271> 2024-06-04T16:12:49.947+0000 7f9204fe9640 10 monclient: _finish_hunting 0 2024-06-04T16:12:50.307 INFO:tasks.workunit.client.0.smithi144.stderr: -270> 2024-06-04T16:12:49.947+0000 7f9204fe9640 1 monclient: found mon.noname-c 2024-06-04T16:12:50.307 INFO:tasks.workunit.client.0.smithi144.stderr: -269> 2024-06-04T16:12:49.947+0000 7f9204fe9640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.144:3301/0 2024-06-04T16:12:50.307 INFO:tasks.workunit.client.0.smithi144.stderr: -268> 2024-06-04T16:12:49.948+0000 7f90db7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-06-04T16:12:50.307 INFO:tasks.workunit.client.0.smithi144.stderr: -267> 2024-06-04T16:12:49.948+0000 7f90db7fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-06-04T16:12:50.307 INFO:tasks.workunit.client.0.smithi144.stderr: -266> 2024-06-04T16:12:49.948+0000 7f90db7fe640 10 monclient: dump: 2024-06-04T16:12:50.307 INFO:tasks.workunit.client.0.smithi144.stderr:epoch 1 2024-06-04T16:12:50.307 INFO:tasks.workunit.client.0.smithi144.stderr:fsid 15e56bb1-4856-42f3-b6db-a2c8f23c5557 2024-06-04T16:12:50.307 INFO:tasks.workunit.client.0.smithi144.stderr:last_changed 2024-06-04T15:51:29.789359+0000 2024-06-04T16:12:50.307 INFO:tasks.workunit.client.0.smithi144.stderr:created 2024-06-04T15:51:29.789359+0000 2024-06-04T16:12:50.307 INFO:tasks.workunit.client.0.smithi144.stderr:min_mon_release 19 (squid) 2024-06-04T16:12:50.308 INFO:tasks.workunit.client.0.smithi144.stderr:election_strategy: 1 2024-06-04T16:12:50.308 INFO:tasks.workunit.client.0.smithi144.stderr:0: [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] mon.a 2024-06-04T16:12:50.308 INFO:tasks.workunit.client.0.smithi144.stderr:1: [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] mon.b 2024-06-04T16:12:50.308 INFO:tasks.workunit.client.0.smithi144.stderr:2: [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] mon.c 2024-06-04T16:12:50.308 INFO:tasks.workunit.client.0.smithi144.stderr: 2024-06-04T16:12:50.308 INFO:tasks.workunit.client.0.smithi144.stderr: -265> 2024-06-04T16:12:49.948+0000 7f90db7fe640 10 monclient: _finish_auth 0 2024-06-04T16:12:50.308 INFO:tasks.workunit.client.0.smithi144.stderr: -264> 2024-06-04T16:12:49.948+0000 7f90db7fe640 10 monclient: _check_auth_tickets 2024-06-04T16:12:50.308 INFO:tasks.workunit.client.0.smithi144.stderr: -263> 2024-06-04T16:12:49.948+0000 7f90db7fe640 10 monclient: handle_config config(0 keys) 2024-06-04T16:12:50.308 INFO:tasks.workunit.client.0.smithi144.stderr: -262> 2024-06-04T16:12:49.948+0000 7f90db7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-06-04T16:12:50.308 INFO:tasks.workunit.client.0.smithi144.stderr: -261> 2024-06-04T16:12:49.948+0000 7f90db7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-06-04T16:12:50.308 INFO:tasks.workunit.client.0.smithi144.stderr: -260> 2024-06-04T16:12:49.948+0000 7f90db7fe640 10 monclient: dump: 2024-06-04T16:12:50.308 INFO:tasks.workunit.client.0.smithi144.stderr:epoch 1 2024-06-04T16:12:50.308 INFO:tasks.workunit.client.0.smithi144.stderr:fsid 15e56bb1-4856-42f3-b6db-a2c8f23c5557 2024-06-04T16:12:50.308 INFO:tasks.workunit.client.0.smithi144.stderr:last_changed 2024-06-04T15:51:29.789359+0000 2024-06-04T16:12:50.308 INFO:tasks.workunit.client.0.smithi144.stderr:created 2024-06-04T15:51:29.789359+0000 2024-06-04T16:12:50.309 INFO:tasks.workunit.client.0.smithi144.stderr:min_mon_release 19 (squid) 2024-06-04T16:12:50.309 INFO:tasks.workunit.client.0.smithi144.stderr:election_strategy: 1 2024-06-04T16:12:50.309 INFO:tasks.workunit.client.0.smithi144.stderr:0: [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] mon.a 2024-06-04T16:12:50.309 INFO:tasks.workunit.client.0.smithi144.stderr:1: [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] mon.b 2024-06-04T16:12:50.309 INFO:tasks.workunit.client.0.smithi144.stderr:2: [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] mon.c 2024-06-04T16:12:50.309 INFO:tasks.workunit.client.0.smithi144.stderr: 2024-06-04T16:12:50.309 INFO:tasks.workunit.client.0.smithi144.stderr: -259> 2024-06-04T16:12:49.948+0000 7f9208b2a800 5 monclient: authenticate success, global_id 6389 2024-06-04T16:12:50.309 INFO:tasks.workunit.client.0.smithi144.stderr: -258> 2024-06-04T16:12:49.948+0000 7f9208b2a800 10 monclient: get_monmap_and_config success 2024-06-04T16:12:50.309 INFO:tasks.workunit.client.0.smithi144.stderr: -257> 2024-06-04T16:12:49.948+0000 7f9208b2a800 4 set_mon_vals no callback set 2024-06-04T16:12:50.309 INFO:tasks.workunit.client.0.smithi144.stderr: -256> 2024-06-04T16:12:49.948+0000 7f9208b2a800 10 monclient: shutdown 2024-06-04T16:12:50.309 INFO:tasks.workunit.client.0.smithi144.stderr: -255> 2024-06-04T16:12:49.948+0000 7f9208b2a800 10 monclient: build_initial_monmap 2024-06-04T16:12:50.309 INFO:tasks.workunit.client.0.smithi144.stderr: -254> 2024-06-04T16:12:49.948+0000 7f9208b2a800 1 build_initial for_mkfs: 0 2024-06-04T16:12:50.309 INFO:tasks.workunit.client.0.smithi144.stderr: -253> 2024-06-04T16:12:49.948+0000 7f9208b2a800 10 monclient: monmap: 2024-06-04T16:12:50.309 INFO:tasks.workunit.client.0.smithi144.stderr:epoch 0 2024-06-04T16:12:50.310 INFO:tasks.workunit.client.0.smithi144.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-06-04T16:12:50.310 INFO:tasks.workunit.client.0.smithi144.stderr:last_changed 0.000000 2024-06-04T16:12:50.310 INFO:tasks.workunit.client.0.smithi144.stderr:created 0.000000 2024-06-04T16:12:50.310 INFO:tasks.workunit.client.0.smithi144.stderr:min_mon_release 0 (unknown) 2024-06-04T16:12:50.310 INFO:tasks.workunit.client.0.smithi144.stderr:election_strategy: 1 2024-06-04T16:12:50.310 INFO:tasks.workunit.client.0.smithi144.stderr:0: [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] mon.noname-a 2024-06-04T16:12:50.310 INFO:tasks.workunit.client.0.smithi144.stderr:1: [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] mon.noname-b 2024-06-04T16:12:50.310 INFO:tasks.workunit.client.0.smithi144.stderr:2: [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] mon.noname-c 2024-06-04T16:12:50.310 INFO:tasks.workunit.client.0.smithi144.stderr: 2024-06-04T16:12:50.310 INFO:tasks.workunit.client.0.smithi144.stderr: -252> 2024-06-04T16:12:49.948+0000 7f9208b2a800 5 AuthRegistry(0x5557c01b6010) adding auth protocol: cephx 2024-06-04T16:12:50.310 INFO:tasks.workunit.client.0.smithi144.stderr: -251> 2024-06-04T16:12:49.948+0000 7f9208b2a800 5 AuthRegistry(0x5557c01b6010) adding auth protocol: cephx 2024-06-04T16:12:50.310 INFO:tasks.workunit.client.0.smithi144.stderr: -250> 2024-06-04T16:12:49.948+0000 7f9208b2a800 5 AuthRegistry(0x5557c01b6010) adding auth protocol: cephx 2024-06-04T16:12:50.310 INFO:tasks.workunit.client.0.smithi144.stderr: -249> 2024-06-04T16:12:49.948+0000 7f9208b2a800 5 AuthRegistry(0x5557c01b6010) adding con mode: secure 2024-06-04T16:12:50.310 INFO:tasks.workunit.client.0.smithi144.stderr: -248> 2024-06-04T16:12:49.948+0000 7f9208b2a800 5 AuthRegistry(0x5557c01b6010) adding con mode: crc 2024-06-04T16:12:50.311 INFO:tasks.workunit.client.0.smithi144.stderr: -247> 2024-06-04T16:12:49.948+0000 7f9208b2a800 5 AuthRegistry(0x5557c01b6010) adding con mode: secure 2024-06-04T16:12:50.311 INFO:tasks.workunit.client.0.smithi144.stderr: -246> 2024-06-04T16:12:49.948+0000 7f9208b2a800 5 AuthRegistry(0x5557c01b6010) adding con mode: crc 2024-06-04T16:12:50.311 INFO:tasks.workunit.client.0.smithi144.stderr: -245> 2024-06-04T16:12:49.948+0000 7f9208b2a800 5 AuthRegistry(0x5557c01b6010) adding con mode: secure 2024-06-04T16:12:50.311 INFO:tasks.workunit.client.0.smithi144.stderr: -244> 2024-06-04T16:12:49.948+0000 7f9208b2a800 5 AuthRegistry(0x5557c01b6010) adding con mode: crc 2024-06-04T16:12:50.311 INFO:tasks.workunit.client.0.smithi144.stderr: -243> 2024-06-04T16:12:49.948+0000 7f9208b2a800 5 AuthRegistry(0x5557c01b6010) adding con mode: crc 2024-06-04T16:12:50.311 INFO:tasks.workunit.client.0.smithi144.stderr: -242> 2024-06-04T16:12:49.948+0000 7f9208b2a800 5 AuthRegistry(0x5557c01b6010) adding con mode: secure 2024-06-04T16:12:50.311 INFO:tasks.workunit.client.0.smithi144.stderr: -241> 2024-06-04T16:12:49.948+0000 7f9208b2a800 5 AuthRegistry(0x5557c01b6010) adding con mode: crc 2024-06-04T16:12:50.311 INFO:tasks.workunit.client.0.smithi144.stderr: -240> 2024-06-04T16:12:49.948+0000 7f9208b2a800 5 AuthRegistry(0x5557c01b6010) adding con mode: secure 2024-06-04T16:12:50.311 INFO:tasks.workunit.client.0.smithi144.stderr: -239> 2024-06-04T16:12:49.948+0000 7f9208b2a800 5 AuthRegistry(0x5557c01b6010) adding con mode: crc 2024-06-04T16:12:50.311 INFO:tasks.workunit.client.0.smithi144.stderr: -238> 2024-06-04T16:12:49.948+0000 7f9208b2a800 5 AuthRegistry(0x5557c01b6010) adding con mode: secure 2024-06-04T16:12:50.311 INFO:tasks.workunit.client.0.smithi144.stderr: -237> 2024-06-04T16:12:49.949+0000 7f9208b2a800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-06-04T16:12:50.311 INFO:tasks.workunit.client.0.smithi144.stderr: -236> 2024-06-04T16:12:49.949+0000 7f9208b2a800 1 librados: starting msgr at 2024-06-04T16:12:50.312 INFO:tasks.workunit.client.0.smithi144.stderr: -235> 2024-06-04T16:12:49.949+0000 7f9208b2a800 1 librados: starting objecter 2024-06-04T16:12:50.312 INFO:tasks.workunit.client.0.smithi144.stderr: -234> 2024-06-04T16:12:49.949+0000 7f9208b2a800 5 asok(0x5557bfef0c60) register_command objecter_requests cmddesc objecter_requests hook 0x5557c01e5c10 EEXIST 2024-06-04T16:12:50.312 INFO:tasks.workunit.client.0.smithi144.stderr: -233> 2024-06-04T16:12:49.949+0000 7f9208b2a800 1 librados: setting wanted keys 2024-06-04T16:12:50.312 INFO:tasks.workunit.client.0.smithi144.stderr: -232> 2024-06-04T16:12:49.949+0000 7f9208b2a800 1 librados: calling monclient init 2024-06-04T16:12:50.312 INFO:tasks.workunit.client.0.smithi144.stderr: -231> 2024-06-04T16:12:49.949+0000 7f9208b2a800 10 monclient: init 2024-06-04T16:12:50.312 INFO:tasks.workunit.client.0.smithi144.stderr: -230> 2024-06-04T16:12:49.949+0000 7f9208b2a800 5 AuthRegistry(0x5557c0171c50) adding auth protocol: cephx 2024-06-04T16:12:50.312 INFO:tasks.workunit.client.0.smithi144.stderr: -229> 2024-06-04T16:12:49.949+0000 7f9208b2a800 5 AuthRegistry(0x5557c0171c50) adding auth protocol: cephx 2024-06-04T16:12:50.312 INFO:tasks.workunit.client.0.smithi144.stderr: -228> 2024-06-04T16:12:49.949+0000 7f9208b2a800 5 AuthRegistry(0x5557c0171c50) adding auth protocol: cephx 2024-06-04T16:12:50.312 INFO:tasks.workunit.client.0.smithi144.stderr: -227> 2024-06-04T16:12:49.949+0000 7f9208b2a800 5 AuthRegistry(0x5557c0171c50) adding con mode: secure 2024-06-04T16:12:50.312 INFO:tasks.workunit.client.0.smithi144.stderr: -226> 2024-06-04T16:12:49.949+0000 7f9208b2a800 5 AuthRegistry(0x5557c0171c50) adding con mode: crc 2024-06-04T16:12:50.312 INFO:tasks.workunit.client.0.smithi144.stderr: -225> 2024-06-04T16:12:49.949+0000 7f9208b2a800 5 AuthRegistry(0x5557c0171c50) adding con mode: secure 2024-06-04T16:12:50.312 INFO:tasks.workunit.client.0.smithi144.stderr: -224> 2024-06-04T16:12:49.949+0000 7f9208b2a800 5 AuthRegistry(0x5557c0171c50) adding con mode: crc 2024-06-04T16:12:50.312 INFO:tasks.workunit.client.0.smithi144.stderr: -223> 2024-06-04T16:12:49.949+0000 7f9208b2a800 5 AuthRegistry(0x5557c0171c50) adding con mode: secure 2024-06-04T16:12:50.312 INFO:tasks.workunit.client.0.smithi144.stderr: -222> 2024-06-04T16:12:49.949+0000 7f9208b2a800 5 AuthRegistry(0x5557c0171c50) adding con mode: crc 2024-06-04T16:12:50.312 INFO:tasks.workunit.client.0.smithi144.stderr: -221> 2024-06-04T16:12:49.949+0000 7f9208b2a800 5 AuthRegistry(0x5557c0171c50) adding con mode: crc 2024-06-04T16:12:50.313 INFO:tasks.workunit.client.0.smithi144.stderr: -220> 2024-06-04T16:12:49.949+0000 7f9208b2a800 5 AuthRegistry(0x5557c0171c50) adding con mode: secure 2024-06-04T16:12:50.313 INFO:tasks.workunit.client.0.smithi144.stderr: -219> 2024-06-04T16:12:49.949+0000 7f9208b2a800 5 AuthRegistry(0x5557c0171c50) adding con mode: crc 2024-06-04T16:12:50.313 INFO:tasks.workunit.client.0.smithi144.stderr: -218> 2024-06-04T16:12:49.949+0000 7f9208b2a800 5 AuthRegistry(0x5557c0171c50) adding con mode: secure 2024-06-04T16:12:50.313 INFO:tasks.workunit.client.0.smithi144.stderr: -217> 2024-06-04T16:12:49.949+0000 7f9208b2a800 5 AuthRegistry(0x5557c0171c50) adding con mode: crc 2024-06-04T16:12:50.313 INFO:tasks.workunit.client.0.smithi144.stderr: -216> 2024-06-04T16:12:49.949+0000 7f9208b2a800 5 AuthRegistry(0x5557c0171c50) adding con mode: secure 2024-06-04T16:12:50.313 INFO:tasks.workunit.client.0.smithi144.stderr: -215> 2024-06-04T16:12:49.949+0000 7f9208b2a800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-06-04T16:12:50.313 INFO:tasks.workunit.client.0.smithi144.stderr: -214> 2024-06-04T16:12:49.949+0000 7f9208b2a800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-06-04T16:12:50.313 INFO:tasks.workunit.client.0.smithi144.stderr: -213> 2024-06-04T16:12:49.949+0000 7f9208b2a800 5 asok(0x5557bfef0c60) register_command rotate-key cmddesc rotate-key hook 0x5557c0171d98 EEXIST 2024-06-04T16:12:50.313 INFO:tasks.workunit.client.0.smithi144.stderr: -212> 2024-06-04T16:12:49.949+0000 7f9208b2a800 10 monclient: _reopen_session rank -1 2024-06-04T16:12:50.313 INFO:tasks.workunit.client.0.smithi144.stderr: -211> 2024-06-04T16:12:49.949+0000 7f9208b2a800 10 monclient: _add_conns ranks=[0,1,2] 2024-06-04T16:12:50.313 INFO:tasks.workunit.client.0.smithi144.stderr: -210> 2024-06-04T16:12:49.949+0000 7f9208b2a800 10 monclient(hunting): picked mon.noname-a con 0x5557c01de260 addr [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] 2024-06-04T16:12:50.313 INFO:tasks.workunit.client.0.smithi144.stderr: -209> 2024-06-04T16:12:49.949+0000 7f9208b2a800 10 monclient(hunting): picked mon.noname-b con 0x5557c01e10e0 addr [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] 2024-06-04T16:12:50.313 INFO:tasks.workunit.client.0.smithi144.stderr: -208> 2024-06-04T16:12:49.949+0000 7f9208b2a800 10 monclient(hunting): picked mon.noname-c con 0x5557c01e3a90 addr [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] 2024-06-04T16:12:50.314 INFO:tasks.workunit.client.0.smithi144.stderr: -207> 2024-06-04T16:12:49.949+0000 7f9208b2a800 10 monclient(hunting): start opening mon connection 2024-06-04T16:12:50.314 INFO:tasks.workunit.client.0.smithi144.stderr: -206> 2024-06-04T16:12:49.949+0000 7f9208b2a800 10 monclient(hunting): start opening mon connection 2024-06-04T16:12:50.314 INFO:tasks.workunit.client.0.smithi144.stderr: -205> 2024-06-04T16:12:49.949+0000 7f9208b2a800 10 monclient(hunting): start opening mon connection 2024-06-04T16:12:50.314 INFO:tasks.workunit.client.0.smithi144.stderr: -204> 2024-06-04T16:12:49.949+0000 7f9208b2a800 10 monclient(hunting): _renew_subs 2024-06-04T16:12:50.314 INFO:tasks.workunit.client.0.smithi144.stderr: -203> 2024-06-04T16:12:49.949+0000 7f9208b2a800 10 monclient(hunting): authenticate will time out at 2007.765942s 2024-06-04T16:12:50.314 INFO:tasks.workunit.client.0.smithi144.stderr: -202> 2024-06-04T16:12:49.949+0000 7f9203fe7640 10 monclient(hunting): get_auth_request con 0x5557c01de260 auth_method 0 2024-06-04T16:12:50.314 INFO:tasks.workunit.client.0.smithi144.stderr: -201> 2024-06-04T16:12:49.949+0000 7f9203fe7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-06-04T16:12:50.314 INFO:tasks.workunit.client.0.smithi144.stderr: -200> 2024-06-04T16:12:49.949+0000 7f9203fe7640 10 monclient(hunting): _init_auth method 2 2024-06-04T16:12:50.314 INFO:tasks.workunit.client.0.smithi144.stderr: -199> 2024-06-04T16:12:49.949+0000 7f9203fe7640 10 monclient(hunting): _init_auth creating new auth 2024-06-04T16:12:50.314 INFO:tasks.workunit.client.0.smithi144.stderr: -198> 2024-06-04T16:12:49.949+0000 7f92047e8640 10 monclient(hunting): get_auth_request con 0x5557c01e3a90 auth_method 0 2024-06-04T16:12:50.314 INFO:tasks.workunit.client.0.smithi144.stderr: -197> 2024-06-04T16:12:49.949+0000 7f92047e8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-06-04T16:12:50.314 INFO:tasks.workunit.client.0.smithi144.stderr: -196> 2024-06-04T16:12:49.949+0000 7f92047e8640 10 monclient(hunting): _init_auth method 2 2024-06-04T16:12:50.314 INFO:tasks.workunit.client.0.smithi144.stderr: -195> 2024-06-04T16:12:49.949+0000 7f92047e8640 10 monclient(hunting): _init_auth creating new auth 2024-06-04T16:12:50.314 INFO:tasks.workunit.client.0.smithi144.stderr: -194> 2024-06-04T16:12:49.949+0000 7f9204fe9640 10 monclient(hunting): get_auth_request con 0x5557c01e10e0 auth_method 0 2024-06-04T16:12:50.314 INFO:tasks.workunit.client.0.smithi144.stderr: -193> 2024-06-04T16:12:49.949+0000 7f9204fe9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-06-04T16:12:50.315 INFO:tasks.workunit.client.0.smithi144.stderr: -192> 2024-06-04T16:12:49.949+0000 7f9204fe9640 10 monclient(hunting): _init_auth method 2 2024-06-04T16:12:50.315 INFO:tasks.workunit.client.0.smithi144.stderr: -191> 2024-06-04T16:12:49.949+0000 7f9204fe9640 10 monclient(hunting): _init_auth creating new auth 2024-06-04T16:12:50.315 INFO:tasks.workunit.client.0.smithi144.stderr: -190> 2024-06-04T16:12:49.949+0000 7f92047e8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-06-04T16:12:50.315 INFO:tasks.workunit.client.0.smithi144.stderr: -189> 2024-06-04T16:12:49.949+0000 7f92047e8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-06-04T16:12:50.315 INFO:tasks.workunit.client.0.smithi144.stderr: -188> 2024-06-04T16:12:49.949+0000 7f92047e8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-06-04T16:12:50.315 INFO:tasks.workunit.client.0.smithi144.stderr: -187> 2024-06-04T16:12:49.949+0000 7f9203fe7640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-06-04T16:12:50.315 INFO:tasks.workunit.client.0.smithi144.stderr: -186> 2024-06-04T16:12:49.949+0000 7f9203fe7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-06-04T16:12:50.315 INFO:tasks.workunit.client.0.smithi144.stderr: -185> 2024-06-04T16:12:49.950+0000 7f9203fe7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-06-04T16:12:50.315 INFO:tasks.workunit.client.0.smithi144.stderr: -184> 2024-06-04T16:12:49.950+0000 7f9204fe9640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-06-04T16:12:50.315 INFO:tasks.workunit.client.0.smithi144.stderr: -183> 2024-06-04T16:12:49.950+0000 7f9204fe9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-06-04T16:12:50.315 INFO:tasks.workunit.client.0.smithi144.stderr: -182> 2024-06-04T16:12:49.950+0000 7f9204fe9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-06-04T16:12:50.315 INFO:tasks.workunit.client.0.smithi144.stderr: -181> 2024-06-04T16:12:49.950+0000 7f92047e8640 10 monclient(hunting): handle_auth_done global_id 6392 payload 824 2024-06-04T16:12:50.315 INFO:tasks.workunit.client.0.smithi144.stderr: -180> 2024-06-04T16:12:49.950+0000 7f92047e8640 10 monclient: _finish_hunting 0 2024-06-04T16:12:50.316 INFO:tasks.workunit.client.0.smithi144.stderr: -179> 2024-06-04T16:12:49.950+0000 7f92047e8640 1 monclient: found mon.noname-c 2024-06-04T16:12:50.316 INFO:tasks.workunit.client.0.smithi144.stderr: -178> 2024-06-04T16:12:49.950+0000 7f92047e8640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.144:3301/0 2024-06-04T16:12:50.316 INFO:tasks.workunit.client.0.smithi144.stderr: -177> 2024-06-04T16:12:49.950+0000 7f90d9ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-06-04T16:12:50.316 INFO:tasks.workunit.client.0.smithi144.stderr: -176> 2024-06-04T16:12:49.950+0000 7f90d9ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-06-04T16:12:50.316 INFO:tasks.workunit.client.0.smithi144.stderr: -175> 2024-06-04T16:12:49.950+0000 7f90d9ffb640 10 monclient: dump: 2024-06-04T16:12:50.316 INFO:tasks.workunit.client.0.smithi144.stderr:epoch 1 2024-06-04T16:12:50.316 INFO:tasks.workunit.client.0.smithi144.stderr:fsid 15e56bb1-4856-42f3-b6db-a2c8f23c5557 2024-06-04T16:12:50.316 INFO:tasks.workunit.client.0.smithi144.stderr:last_changed 2024-06-04T15:51:29.789359+0000 2024-06-04T16:12:50.316 INFO:tasks.workunit.client.0.smithi144.stderr:created 2024-06-04T15:51:29.789359+0000 2024-06-04T16:12:50.316 INFO:tasks.workunit.client.0.smithi144.stderr:min_mon_release 19 (squid) 2024-06-04T16:12:50.316 INFO:tasks.workunit.client.0.smithi144.stderr:election_strategy: 1 2024-06-04T16:12:50.316 INFO:tasks.workunit.client.0.smithi144.stderr:0: [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] mon.a 2024-06-04T16:12:50.316 INFO:tasks.workunit.client.0.smithi144.stderr:1: [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] mon.b 2024-06-04T16:12:50.317 INFO:tasks.workunit.client.0.smithi144.stderr:2: [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] mon.c 2024-06-04T16:12:50.317 INFO:tasks.workunit.client.0.smithi144.stderr: 2024-06-04T16:12:50.317 INFO:tasks.workunit.client.0.smithi144.stderr: -174> 2024-06-04T16:12:49.950+0000 7f90d9ffb640 10 monclient: _finish_auth 0 2024-06-04T16:12:50.317 INFO:tasks.workunit.client.0.smithi144.stderr: -173> 2024-06-04T16:12:49.950+0000 7f90d9ffb640 10 monclient: _check_auth_tickets 2024-06-04T16:12:50.317 INFO:tasks.workunit.client.0.smithi144.stderr: -172> 2024-06-04T16:12:49.950+0000 7f90d9ffb640 10 monclient: handle_config config(0 keys) 2024-06-04T16:12:50.317 INFO:tasks.workunit.client.0.smithi144.stderr: -171> 2024-06-04T16:12:49.950+0000 7f90d9ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-06-04T16:12:50.317 INFO:tasks.workunit.client.0.smithi144.stderr: -170> 2024-06-04T16:12:49.950+0000 7f90d9ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-06-04T16:12:50.317 INFO:tasks.workunit.client.0.smithi144.stderr: -169> 2024-06-04T16:12:49.950+0000 7f90d9ffb640 10 monclient: dump: 2024-06-04T16:12:50.317 INFO:tasks.workunit.client.0.smithi144.stderr:epoch 1 2024-06-04T16:12:50.317 INFO:tasks.workunit.client.0.smithi144.stderr:fsid 15e56bb1-4856-42f3-b6db-a2c8f23c5557 2024-06-04T16:12:50.317 INFO:tasks.workunit.client.0.smithi144.stderr:last_changed 2024-06-04T15:51:29.789359+0000 2024-06-04T16:12:50.317 INFO:tasks.workunit.client.0.smithi144.stderr:created 2024-06-04T15:51:29.789359+0000 2024-06-04T16:12:50.317 INFO:tasks.workunit.client.0.smithi144.stderr:min_mon_release 19 (squid) 2024-06-04T16:12:50.317 INFO:tasks.workunit.client.0.smithi144.stderr:election_strategy: 1 2024-06-04T16:12:50.318 INFO:tasks.workunit.client.0.smithi144.stderr:0: [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] mon.a 2024-06-04T16:12:50.318 INFO:tasks.workunit.client.0.smithi144.stderr:1: [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] mon.b 2024-06-04T16:12:50.318 INFO:tasks.workunit.client.0.smithi144.stderr:2: [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] mon.c 2024-06-04T16:12:50.318 INFO:tasks.workunit.client.0.smithi144.stderr: 2024-06-04T16:12:50.318 INFO:tasks.workunit.client.0.smithi144.stderr: -168> 2024-06-04T16:12:49.950+0000 7f9208b2a800 5 monclient: authenticate success, global_id 6392 2024-06-04T16:12:50.318 INFO:tasks.workunit.client.0.smithi144.stderr: -167> 2024-06-04T16:12:49.950+0000 7f90db7fe640 4 set_mon_vals no callback set 2024-06-04T16:12:50.318 INFO:tasks.workunit.client.0.smithi144.stderr: -166> 2024-06-04T16:12:49.950+0000 7f9208b2a800 10 monclient: _renew_subs 2024-06-04T16:12:50.318 INFO:tasks.workunit.client.0.smithi144.stderr: -165> 2024-06-04T16:12:49.950+0000 7f9208b2a800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.144:3301/0 2024-06-04T16:12:50.318 INFO:tasks.workunit.client.0.smithi144.stderr: -164> 2024-06-04T16:12:49.950+0000 7f9208b2a800 10 monclient: _renew_subs 2024-06-04T16:12:50.318 INFO:tasks.workunit.client.0.smithi144.stderr: -163> 2024-06-04T16:12:49.950+0000 7f9208b2a800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.144:3301/0 2024-06-04T16:12:50.318 INFO:tasks.workunit.client.0.smithi144.stderr: -162> 2024-06-04T16:12:49.950+0000 7f9208b2a800 1 librados: init done 2024-06-04T16:12:50.318 INFO:tasks.workunit.client.0.smithi144.stderr: -161> 2024-06-04T16:12:49.950+0000 7f9208b2a800 5 asok(0x5557bfef0c60) register_command cr dump hook 0x5557c01e9558 2024-06-04T16:12:50.319 INFO:tasks.workunit.client.0.smithi144.stderr: -160> 2024-06-04T16:12:49.951+0000 7f9208b2a800 20 rados->read ofs=0 len=0 2024-06-04T16:12:50.319 INFO:tasks.workunit.client.0.smithi144.stderr: -159> 2024-06-04T16:12:49.952+0000 7f90d9ffb640 4 mgrc handle_mgr_map Got map version 5 2024-06-04T16:12:50.319 INFO:tasks.workunit.client.0.smithi144.stderr: -158> 2024-06-04T16:12:49.952+0000 7f90d9ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.177:6832/2645786330,v1:172.21.15.177:6833/2645786330] 2024-06-04T16:12:50.319 INFO:tasks.workunit.client.0.smithi144.stderr: -157> 2024-06-04T16:12:49.952+0000 7f90d9ffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.177:6832/2645786330,v1:172.21.15.177:6833/2645786330] 2024-06-04T16:12:50.319 INFO:tasks.workunit.client.0.smithi144.stderr: -156> 2024-06-04T16:12:49.952+0000 7f9203fe7640 10 monclient: get_auth_request con 0x7f90cc074cb0 auth_method 0 2024-06-04T16:12:50.319 INFO:tasks.workunit.client.0.smithi144.stderr: -155> 2024-06-04T16:12:49.952+0000 7f9204fe9640 10 monclient: get_auth_request con 0x5557c01fffb0 auth_method 0 2024-06-04T16:12:50.319 INFO:tasks.workunit.client.0.smithi144.stderr: -154> 2024-06-04T16:12:49.953+0000 7f9208b2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:12:50.319 INFO:tasks.workunit.client.0.smithi144.stderr: -153> 2024-06-04T16:12:49.953+0000 7f9208b2a800 20 realm 2024-06-04T16:12:50.319 INFO:tasks.workunit.client.0.smithi144.stderr: -152> 2024-06-04T16:12:49.953+0000 7f9208b2a800 20 rados->read ofs=0 len=0 2024-06-04T16:12:50.319 INFO:tasks.workunit.client.0.smithi144.stderr: -151> 2024-06-04T16:12:49.953+0000 7f9208b2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:12:50.319 INFO:tasks.workunit.client.0.smithi144.stderr: -150> 2024-06-04T16:12:49.953+0000 7f9208b2a800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-06-04T16:12:50.319 INFO:tasks.workunit.client.0.smithi144.stderr: -149> 2024-06-04T16:12:49.953+0000 7f9208b2a800 20 rados->read ofs=0 len=0 2024-06-04T16:12:50.319 INFO:tasks.workunit.client.0.smithi144.stderr: -148> 2024-06-04T16:12:49.953+0000 7f9208b2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:12:50.319 INFO:tasks.workunit.client.0.smithi144.stderr: -147> 2024-06-04T16:12:49.953+0000 7f9208b2a800 20 rados->read ofs=0 len=0 2024-06-04T16:12:50.319 INFO:tasks.workunit.client.0.smithi144.stderr: -146> 2024-06-04T16:12:49.953+0000 7f9203fe7640 10 monclient: get_auth_request con 0x5557c0204360 auth_method 0 2024-06-04T16:12:50.320 INFO:tasks.workunit.client.0.smithi144.stderr: -145> 2024-06-04T16:12:49.954+0000 7f9208b2a800 20 rados_obj.operate() r=0 bl.length=46 2024-06-04T16:12:50.320 INFO:tasks.workunit.client.0.smithi144.stderr: -144> 2024-06-04T16:12:49.954+0000 7f9208b2a800 20 rados->read ofs=0 len=0 2024-06-04T16:12:50.320 INFO:tasks.workunit.client.0.smithi144.stderr: -143> 2024-06-04T16:12:49.954+0000 7f9204fe9640 10 monclient: get_auth_request con 0x5557c0207ad0 auth_method 0 2024-06-04T16:12:50.320 INFO:tasks.workunit.client.0.smithi144.stderr: -142> 2024-06-04T16:12:49.954+0000 7f9208b2a800 20 rados_obj.operate() r=0 bl.length=1139 2024-06-04T16:12:50.320 INFO:tasks.workunit.client.0.smithi144.stderr: -141> 2024-06-04T16:12:49.955+0000 7f9208b2a800 20 searching for the correct realm 2024-06-04T16:12:50.320 INFO:tasks.workunit.client.0.smithi144.stderr: -140> 2024-06-04T16:12:49.955+0000 7f92047e8640 10 monclient: get_auth_request con 0x5557c020c7f0 auth_method 0 2024-06-04T16:12:50.320 INFO:tasks.workunit.client.0.smithi144.stderr: -139> 2024-06-04T16:12:49.955+0000 7f9203fe7640 10 monclient: get_auth_request con 0x7f91f4081a30 auth_method 0 2024-06-04T16:12:50.320 INFO:tasks.workunit.client.0.smithi144.stderr: -138> 2024-06-04T16:12:49.956+0000 7f9203fe7640 0 -- 172.21.15.144:0/3432075077 >> [v2:172.21.15.144:6816/2358575268,v1:172.21.15.144:6817/2358575268] conn(0x5557c0204360 msgr2=0x5557c0206750 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-06-04T16:12:50.320 INFO:tasks.workunit.client.0.smithi144.stderr: -137> 2024-06-04T16:12:49.956+0000 7f90d9ffb640 1 client.6392.objecter ms_handle_reset 0x5557c0204360 session 0x5557c02031e0 osd.1 2024-06-04T16:12:50.320 INFO:tasks.workunit.client.0.smithi144.stderr: -136> 2024-06-04T16:12:49.956+0000 7f90d9ffb640 10 monclient: _renew_subs 2024-06-04T16:12:50.320 INFO:tasks.workunit.client.0.smithi144.stderr: -135> 2024-06-04T16:12:49.956+0000 7f90d9ffb640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.144:3301/0 2024-06-04T16:12:50.320 INFO:tasks.workunit.client.0.smithi144.stderr: -134> 2024-06-04T16:12:49.956+0000 7f9204fe9640 10 monclient: get_auth_request con 0x7f91f806d420 auth_method 0 2024-06-04T16:12:50.320 INFO:tasks.workunit.client.0.smithi144.stderr: -133> 2024-06-04T16:12:49.957+0000 7f9203fe7640 10 monclient: get_auth_request con 0x7f90cc085060 auth_method 0 2024-06-04T16:12:50.320 INFO:tasks.workunit.client.0.smithi144.stderr: -132> 2024-06-04T16:12:49.957+0000 7f92047e8640 10 monclient: get_auth_request con 0x7f91f408a060 auth_method 0 2024-06-04T16:12:50.321 INFO:tasks.workunit.client.0.smithi144.stderr: -131> 2024-06-04T16:12:49.959+0000 7f9203fe7640 10 monclient: get_auth_request con 0x7f91f80824f0 auth_method 0 2024-06-04T16:12:50.321 INFO:tasks.workunit.client.0.smithi144.stderr: -130> 2024-06-04T16:12:49.959+0000 7f9203fe7640 0 -- 172.21.15.144:0/3432075077 >> [v2:172.21.15.177:6808/2618477608,v1:172.21.15.177:6809/2618477608] conn(0x7f91f80824f0 msgr2=0x7f91f8081920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-06-04T16:12:50.321 INFO:tasks.workunit.client.0.smithi144.stderr: -129> 2024-06-04T16:12:50.160+0000 7f9203fe7640 10 monclient: get_auth_request con 0x7f91f80824f0 auth_method 0 2024-06-04T16:12:50.321 INFO:tasks.workunit.client.0.smithi144.stderr: -128> 2024-06-04T16:12:50.165+0000 7f9208b2a800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-06-04T16:12:50.321 INFO:tasks.workunit.client.0.smithi144.stderr: -127> 2024-06-04T16:12:50.165+0000 7f9208b2a800 20 RGWRados::pool_iterate: got zone_info.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767 2024-06-04T16:12:50.321 INFO:tasks.workunit.client.0.smithi144.stderr: -126> 2024-06-04T16:12:50.165+0000 7f9208b2a800 20 RGWRados::pool_iterate: got default.zone. 2024-06-04T16:12:50.321 INFO:tasks.workunit.client.0.smithi144.stderr: -125> 2024-06-04T16:12:50.165+0000 7f9208b2a800 20 RGWRados::pool_iterate: got zonegroup_info.abb22408-c332-4e28-8f7a-ff254ea2fed2 2024-06-04T16:12:50.321 INFO:tasks.workunit.client.0.smithi144.stderr: -124> 2024-06-04T16:12:50.165+0000 7f9208b2a800 20 RGWRados::pool_iterate: got zone_names.default 2024-06-04T16:12:50.321 INFO:tasks.workunit.client.0.smithi144.stderr: -123> 2024-06-04T16:12:50.165+0000 7f9208b2a800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-06-04T16:12:50.321 INFO:tasks.workunit.client.0.smithi144.stderr: -122> 2024-06-04T16:12:50.165+0000 7f9208b2a800 20 rados->read ofs=0 len=0 2024-06-04T16:12:50.321 INFO:tasks.workunit.client.0.smithi144.stderr: -121> 2024-06-04T16:12:50.166+0000 7f9208b2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:12:50.321 INFO:tasks.workunit.client.0.smithi144.stderr: -120> 2024-06-04T16:12:50.166+0000 7f9208b2a800 20 rados->read ofs=0 len=0 2024-06-04T16:12:50.321 INFO:tasks.workunit.client.0.smithi144.stderr: -119> 2024-06-04T16:12:50.166+0000 7f9208b2a800 20 rados_obj.operate() r=0 bl.length=46 2024-06-04T16:12:50.321 INFO:tasks.workunit.client.0.smithi144.stderr: -118> 2024-06-04T16:12:50.166+0000 7f9208b2a800 20 rados->read ofs=0 len=0 2024-06-04T16:12:50.321 INFO:tasks.workunit.client.0.smithi144.stderr: -117> 2024-06-04T16:12:50.166+0000 7f9208b2a800 20 rados_obj.operate() r=0 bl.length=470 2024-06-04T16:12:50.322 INFO:tasks.workunit.client.0.smithi144.stderr: -116> 2024-06-04T16:12:50.167+0000 7f9208b2a800 20 zone default found 2024-06-04T16:12:50.322 INFO:tasks.workunit.client.0.smithi144.stderr: -115> 2024-06-04T16:12:50.167+0000 7f9208b2a800 4 Realm: () 2024-06-04T16:12:50.322 INFO:tasks.workunit.client.0.smithi144.stderr: -114> 2024-06-04T16:12:50.167+0000 7f9208b2a800 4 ZoneGroup: default (abb22408-c332-4e28-8f7a-ff254ea2fed2) 2024-06-04T16:12:50.322 INFO:tasks.workunit.client.0.smithi144.stderr: -113> 2024-06-04T16:12:50.167+0000 7f9208b2a800 4 Zone: default (be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767) 2024-06-04T16:12:50.322 INFO:tasks.workunit.client.0.smithi144.stderr: -112> 2024-06-04T16:12:50.167+0000 7f9208b2a800 10 cannot find current period zonegroup using local zonegroup configuration 2024-06-04T16:12:50.322 INFO:tasks.workunit.client.0.smithi144.stderr: -111> 2024-06-04T16:12:50.167+0000 7f9208b2a800 20 zonegroup default 2024-06-04T16:12:50.322 INFO:tasks.workunit.client.0.smithi144.stderr: -110> 2024-06-04T16:12:50.167+0000 7f9208b2a800 20 rados->read ofs=0 len=0 2024-06-04T16:12:50.322 INFO:tasks.workunit.client.0.smithi144.stderr: -109> 2024-06-04T16:12:50.167+0000 7f9208b2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:12:50.322 INFO:tasks.workunit.client.0.smithi144.stderr: -108> 2024-06-04T16:12:50.167+0000 7f9208b2a800 20 rados->read ofs=0 len=0 2024-06-04T16:12:50.322 INFO:tasks.workunit.client.0.smithi144.stderr: -107> 2024-06-04T16:12:50.168+0000 7f9208b2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:12:50.322 INFO:tasks.workunit.client.0.smithi144.stderr: -106> 2024-06-04T16:12:50.168+0000 7f9208b2a800 20 rados->read ofs=0 len=0 2024-06-04T16:12:50.322 INFO:tasks.workunit.client.0.smithi144.stderr: -105> 2024-06-04T16:12:50.168+0000 7f9208b2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:12:50.322 INFO:tasks.workunit.client.0.smithi144.stderr: -104> 2024-06-04T16:12:50.168+0000 7f9208b2a800 20 started sync module instance, tier type = 2024-06-04T16:12:50.323 INFO:tasks.workunit.client.0.smithi144.stderr: -103> 2024-06-04T16:12:50.168+0000 7f9208b2a800 20 started zone id=be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767 (name=default) with tier type = 2024-06-04T16:12:50.323 INFO:tasks.workunit.client.0.smithi144.stderr: -102> 2024-06-04T16:12:50.177+0000 7f9208b2a800 20 add_watcher() i=0 2024-06-04T16:12:50.323 INFO:tasks.workunit.client.0.smithi144.stderr: -101> 2024-06-04T16:12:50.177+0000 7f9208b2a800 20 add_watcher() i=1 2024-06-04T16:12:50.323 INFO:tasks.workunit.client.0.smithi144.stderr: -100> 2024-06-04T16:12:50.177+0000 7f9208b2a800 20 add_watcher() i=2 2024-06-04T16:12:50.323 INFO:tasks.workunit.client.0.smithi144.stderr: -99> 2024-06-04T16:12:50.177+0000 7f9208b2a800 20 add_watcher() i=3 2024-06-04T16:12:50.323 INFO:tasks.workunit.client.0.smithi144.stderr: -98> 2024-06-04T16:12:50.177+0000 7f9208b2a800 20 add_watcher() i=4 2024-06-04T16:12:50.323 INFO:tasks.workunit.client.0.smithi144.stderr: -97> 2024-06-04T16:12:50.177+0000 7f9208b2a800 20 add_watcher() i=5 2024-06-04T16:12:50.323 INFO:tasks.workunit.client.0.smithi144.stderr: -96> 2024-06-04T16:12:50.177+0000 7f9208b2a800 20 add_watcher() i=6 2024-06-04T16:12:50.323 INFO:tasks.workunit.client.0.smithi144.stderr: -95> 2024-06-04T16:12:50.178+0000 7f9208b2a800 20 add_watcher() i=7 2024-06-04T16:12:50.323 INFO:tasks.workunit.client.0.smithi144.stderr: -94> 2024-06-04T16:12:50.178+0000 7f9208b2a800 2 all 8 watchers are set, enabling cache 2024-06-04T16:12:50.323 INFO:tasks.workunit.client.0.smithi144.stderr: -93> 2024-06-04T16:12:50.179+0000 7f9208b2a800 5 AuthRegistry(0x7ffecc2fe580) adding auth protocol: cephx 2024-06-04T16:12:50.323 INFO:tasks.workunit.client.0.smithi144.stderr: -92> 2024-06-04T16:12:50.179+0000 7f9208b2a800 5 AuthRegistry(0x7ffecc2fe580) adding auth protocol: cephx 2024-06-04T16:12:50.323 INFO:tasks.workunit.client.0.smithi144.stderr: -91> 2024-06-04T16:12:50.179+0000 7f9208b2a800 5 AuthRegistry(0x7ffecc2fe580) adding auth protocol: cephx 2024-06-04T16:12:50.323 INFO:tasks.workunit.client.0.smithi144.stderr: -90> 2024-06-04T16:12:50.179+0000 7f9208b2a800 5 AuthRegistry(0x7ffecc2fe580) adding con mode: secure 2024-06-04T16:12:50.324 INFO:tasks.workunit.client.0.smithi144.stderr: -89> 2024-06-04T16:12:50.179+0000 7f9208b2a800 5 AuthRegistry(0x7ffecc2fe580) adding con mode: crc 2024-06-04T16:12:50.324 INFO:tasks.workunit.client.0.smithi144.stderr: -88> 2024-06-04T16:12:50.179+0000 7f9208b2a800 5 AuthRegistry(0x7ffecc2fe580) adding con mode: secure 2024-06-04T16:12:50.324 INFO:tasks.workunit.client.0.smithi144.stderr: -87> 2024-06-04T16:12:50.179+0000 7f9208b2a800 5 AuthRegistry(0x7ffecc2fe580) adding con mode: crc 2024-06-04T16:12:50.324 INFO:tasks.workunit.client.0.smithi144.stderr: -86> 2024-06-04T16:12:50.179+0000 7f9208b2a800 5 AuthRegistry(0x7ffecc2fe580) adding con mode: secure 2024-06-04T16:12:50.324 INFO:tasks.workunit.client.0.smithi144.stderr: -85> 2024-06-04T16:12:50.179+0000 7f9208b2a800 5 AuthRegistry(0x7ffecc2fe580) adding con mode: crc 2024-06-04T16:12:50.324 INFO:tasks.workunit.client.0.smithi144.stderr: -84> 2024-06-04T16:12:50.179+0000 7f9208b2a800 5 AuthRegistry(0x7ffecc2fe580) adding con mode: crc 2024-06-04T16:12:50.324 INFO:tasks.workunit.client.0.smithi144.stderr: -83> 2024-06-04T16:12:50.179+0000 7f9208b2a800 5 AuthRegistry(0x7ffecc2fe580) adding con mode: secure 2024-06-04T16:12:50.324 INFO:tasks.workunit.client.0.smithi144.stderr: -82> 2024-06-04T16:12:50.179+0000 7f90bafdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-06-04T16:12:50.324 INFO:tasks.workunit.client.0.smithi144.stderr: -81> 2024-06-04T16:12:50.179+0000 7f9208b2a800 5 AuthRegistry(0x7ffecc2fe580) adding con mode: crc 2024-06-04T16:12:50.324 INFO:tasks.workunit.client.0.smithi144.stderr: -80> 2024-06-04T16:12:50.179+0000 7f9208b2a800 5 AuthRegistry(0x7ffecc2fe580) adding con mode: secure 2024-06-04T16:12:50.324 INFO:tasks.workunit.client.0.smithi144.stderr: -79> 2024-06-04T16:12:50.179+0000 7f9208b2a800 5 AuthRegistry(0x7ffecc2fe580) adding con mode: crc 2024-06-04T16:12:50.324 INFO:tasks.workunit.client.0.smithi144.stderr: -78> 2024-06-04T16:12:50.179+0000 7f9208b2a800 5 AuthRegistry(0x7ffecc2fe580) adding con mode: secure 2024-06-04T16:12:50.324 INFO:tasks.workunit.client.0.smithi144.stderr: -77> 2024-06-04T16:12:50.179+0000 7f9208b2a800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-06-04T16:12:50.324 INFO:tasks.workunit.client.0.smithi144.stderr: -76> 2024-06-04T16:12:50.179+0000 7f9208b2a800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-06-04T16:12:50.325 INFO:tasks.workunit.client.0.smithi144.stderr: -75> 2024-06-04T16:12:50.179+0000 7f9208b2a800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-06-04T16:12:50.325 INFO:tasks.workunit.client.0.smithi144.stderr: -74> 2024-06-04T16:12:50.180+0000 7f9208b2a800 5 asok(0x5557bfef0c60) register_command cache list hook 0x5557c01e8ab0 2024-06-04T16:12:50.325 INFO:tasks.workunit.client.0.smithi144.stderr: -73> 2024-06-04T16:12:50.180+0000 7f9208b2a800 5 asok(0x5557bfef0c60) register_command cache inspect hook 0x5557c01e8ab0 2024-06-04T16:12:50.325 INFO:tasks.workunit.client.0.smithi144.stderr: -72> 2024-06-04T16:12:50.180+0000 7f9208b2a800 5 asok(0x5557bfef0c60) register_command cache erase hook 0x5557c01e8ab0 2024-06-04T16:12:50.325 INFO:tasks.workunit.client.0.smithi144.stderr: -71> 2024-06-04T16:12:50.180+0000 7f9208b2a800 5 asok(0x5557bfef0c60) register_command cache zap hook 0x5557c01e8ab0 2024-06-04T16:12:50.325 INFO:tasks.workunit.client.0.smithi144.stderr: -70> 2024-06-04T16:12:50.180+0000 7f9208b2a800 5 note: GC not initialized 2024-06-04T16:12:50.325 INFO:tasks.workunit.client.0.smithi144.stderr: -69> 2024-06-04T16:12:50.180+0000 7f90b9fdb640 20 reqs_thread_entry: start 2024-06-04T16:12:50.325 INFO:tasks.workunit.client.0.smithi144.stderr: -68> 2024-06-04T16:12:50.180+0000 7f9208b2a800 5 asok(0x5557bfef0c60) register_command sync trace show hook 0x7f91f4004740 2024-06-04T16:12:50.325 INFO:tasks.workunit.client.0.smithi144.stderr: -67> 2024-06-04T16:12:50.180+0000 7f9208b2a800 5 asok(0x5557bfef0c60) register_command sync trace history hook 0x7f91f4004740 2024-06-04T16:12:50.325 INFO:tasks.workunit.client.0.smithi144.stderr: -66> 2024-06-04T16:12:50.180+0000 7f9208b2a800 5 asok(0x5557bfef0c60) register_command sync trace active hook 0x7f91f4004740 2024-06-04T16:12:50.325 INFO:tasks.workunit.client.0.smithi144.stderr: -65> 2024-06-04T16:12:50.180+0000 7f9208b2a800 5 asok(0x5557bfef0c60) register_command sync trace active_short hook 0x7f91f4004740 2024-06-04T16:12:50.325 INFO:tasks.workunit.client.0.smithi144.stderr: -64> 2024-06-04T16:12:50.180+0000 7f9208b2a800 20 init_complete bucket index max shards: 11 2024-06-04T16:12:50.325 INFO:tasks.workunit.client.0.smithi144.stderr: -63> 2024-06-04T16:12:50.180+0000 7f9208b2a800 20 Filter name: none 2024-06-04T16:12:50.325 INFO:tasks.workunit.client.0.smithi144.stderr: -62> 2024-06-04T16:12:50.180+0000 7f902b7fe640 20 reqs_thread_entry: start 2024-06-04T16:12:50.325 INFO:tasks.workunit.client.0.smithi144.stderr: -61> 2024-06-04T16:12:50.180+0000 7f9208b2a800 10 cache get: name=default.rgw.meta+root+abort-at-commit-target-layout : miss 2024-06-04T16:12:50.326 INFO:tasks.workunit.client.0.smithi144.stderr: -60> 2024-06-04T16:12:50.180+0000 7f9208b2a800 20 rados->read ofs=0 len=0 2024-06-04T16:12:50.326 INFO:tasks.workunit.client.0.smithi144.stderr: -59> 2024-06-04T16:12:50.181+0000 7f9208b2a800 20 rados_obj.operate() r=0 bl.length=197 2024-06-04T16:12:50.326 INFO:tasks.workunit.client.0.smithi144.stderr: -58> 2024-06-04T16:12:50.181+0000 7f9208b2a800 10 cache put: name=default.rgw.meta+root+abort-at-commit-target-layout info.flags=0x11 2024-06-04T16:12:50.326 INFO:tasks.workunit.client.0.smithi144.stderr: -57> 2024-06-04T16:12:50.181+0000 7f9208b2a800 10 adding default.rgw.meta+root+abort-at-commit-target-layout to cache LRU end 2024-06-04T16:12:50.326 INFO:tasks.workunit.client.0.smithi144.stderr: -56> 2024-06-04T16:12:50.181+0000 7f9208b2a800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.26 : miss 2024-06-04T16:12:50.326 INFO:tasks.workunit.client.0.smithi144.stderr: -55> 2024-06-04T16:12:50.181+0000 7f9208b2a800 20 rados->read ofs=0 len=0 2024-06-04T16:12:50.326 INFO:tasks.workunit.client.0.smithi144.stderr: -54> 2024-06-04T16:12:50.181+0000 7f9208b2a800 20 rados_obj.operate() r=0 bl.length=411 2024-06-04T16:12:50.326 INFO:tasks.workunit.client.0.smithi144.stderr: -53> 2024-06-04T16:12:50.181+0000 7f9208b2a800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.26 info.flags=0x17 2024-06-04T16:12:50.326 INFO:tasks.workunit.client.0.smithi144.stderr: -52> 2024-06-04T16:12:50.181+0000 7f9208b2a800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.26 to cache LRU end 2024-06-04T16:12:50.326 INFO:tasks.workunit.client.0.smithi144.stderr: -51> 2024-06-04T16:12:50.181+0000 7f9208b2a800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-06-04T16:12:50.326 INFO:tasks.workunit.client.0.smithi144.stderr: -50> 2024-06-04T16:12:50.181+0000 7f9208b2a800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-06-04T16:12:50.326 INFO:tasks.workunit.client.0.smithi144.stderr: -49> 2024-06-04T16:12:50.181+0000 7f9208b2a800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.26 2024-06-04T16:12:50.326 INFO:tasks.workunit.client.0.smithi144.stderr: -48> 2024-06-04T16:12:50.186+0000 7f9208b2a800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.26 info.flags=0x17 2024-06-04T16:12:50.327 INFO:tasks.workunit.client.0.smithi144.stderr: -47> 2024-06-04T16:12:50.186+0000 7f9208b2a800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.26 to cache LRU end 2024-06-04T16:12:50.327 INFO:tasks.workunit.client.0.smithi144.stderr: -46> 2024-06-04T16:12:50.186+0000 7f9208b2a800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-06-04T16:12:50.327 INFO:tasks.workunit.client.0.smithi144.stderr: -45> 2024-06-04T16:12:50.186+0000 7f9208b2a800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.26, ofs0, ns] 2024-06-04T16:12:50.327 INFO:tasks.workunit.client.0.smithi144.stderr: -44> 2024-06-04T16:12:50.187+0000 7f90db7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1078036791413 cookie 93835373909248 notifier 6392 bl.length()=923 2024-06-04T16:12:50.327 INFO:tasks.workunit.client.0.smithi144.stderr: -43> 2024-06-04T16:12:50.187+0000 7f90db7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.26 info.flags=0x17 2024-06-04T16:12:50.327 INFO:tasks.workunit.client.0.smithi144.stderr: -42> 2024-06-04T16:12:50.187+0000 7f90db7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.26 to cache LRU end 2024-06-04T16:12:50.327 INFO:tasks.workunit.client.0.smithi144.stderr: -41> 2024-06-04T16:12:50.187+0000 7f90db7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-06-04T16:12:50.327 INFO:tasks.workunit.client.0.smithi144.stderr: -40> 2024-06-04T16:12:50.187+0000 7f9208b2a800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.26]): orig_sources= new_sources= 2024-06-04T16:12:50.327 INFO:tasks.workunit.client.0.smithi144.stderr: -39> 2024-06-04T16:12:50.187+0000 7f9208b2a800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.26]): potential sources added=[] removed=[] 2024-06-04T16:12:50.327 INFO:tasks.workunit.client.0.smithi144.stderr: -38> 2024-06-04T16:12:50.187+0000 7f9208b2a800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.26]): orig_dests= new_dests= 2024-06-04T16:12:50.327 INFO:tasks.workunit.client.0.smithi144.stderr: -37> 2024-06-04T16:12:50.187+0000 7f9208b2a800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.26]): potential dests added=[] removed=[] 2024-06-04T16:12:50.327 INFO:tasks.workunit.client.0.smithi144.stderr: -36> 2024-06-04T16:12:50.190+0000 7f9208b2a800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.26.1.0 2024-06-04T16:12:50.327 INFO:tasks.workunit.client.0.smithi144.stderr: -35> 2024-06-04T16:12:50.190+0000 7f9208b2a800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.26.1.0 2024-06-04T16:12:50.327 INFO:tasks.workunit.client.0.smithi144.stderr: -34> 2024-06-04T16:12:50.190+0000 7f9208b2a800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.26.1.1 2024-06-04T16:12:50.327 INFO:tasks.workunit.client.0.smithi144.stderr: -33> 2024-06-04T16:12:50.190+0000 7f9208b2a800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.26.1.1 2024-06-04T16:12:50.328 INFO:tasks.workunit.client.0.smithi144.stderr: -32> 2024-06-04T16:12:50.190+0000 7f9208b2a800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.26.1.2 2024-06-04T16:12:50.328 INFO:tasks.workunit.client.0.smithi144.stderr: -31> 2024-06-04T16:12:50.190+0000 7f9208b2a800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.26.1.2 2024-06-04T16:12:50.328 INFO:tasks.workunit.client.0.smithi144.stderr: -30> 2024-06-04T16:12:50.190+0000 7f9208b2a800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.26.1.3 2024-06-04T16:12:50.328 INFO:tasks.workunit.client.0.smithi144.stderr: -29> 2024-06-04T16:12:50.190+0000 7f9208b2a800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.26.1.3 2024-06-04T16:12:50.328 INFO:tasks.workunit.client.0.smithi144.stderr: -28> 2024-06-04T16:12:50.190+0000 7f9208b2a800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.26.1.4 2024-06-04T16:12:50.328 INFO:tasks.workunit.client.0.smithi144.stderr: -27> 2024-06-04T16:12:50.190+0000 7f9208b2a800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.26.1.4 2024-06-04T16:12:50.328 INFO:tasks.workunit.client.0.smithi144.stderr: -26> 2024-06-04T16:12:50.190+0000 7f9208b2a800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.26.1.5 2024-06-04T16:12:50.328 INFO:tasks.workunit.client.0.smithi144.stderr: -25> 2024-06-04T16:12:50.190+0000 7f9208b2a800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.26.1.5 2024-06-04T16:12:50.328 INFO:tasks.workunit.client.0.smithi144.stderr: -24> 2024-06-04T16:12:50.190+0000 7f9208b2a800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.26.1.6 2024-06-04T16:12:50.328 INFO:tasks.workunit.client.0.smithi144.stderr: -23> 2024-06-04T16:12:50.190+0000 7f9208b2a800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.26.1.6 2024-06-04T16:12:50.328 INFO:tasks.workunit.client.0.smithi144.stderr: -22> 2024-06-04T16:12:50.190+0000 7f9208b2a800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.26.1.7 2024-06-04T16:12:50.328 INFO:tasks.workunit.client.0.smithi144.stderr: -21> 2024-06-04T16:12:50.190+0000 7f9208b2a800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.26.1.7 2024-06-04T16:12:50.328 INFO:tasks.workunit.client.0.smithi144.stderr: -20> 2024-06-04T16:12:50.190+0000 7f9208b2a800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.26.1.8 2024-06-04T16:12:50.328 INFO:tasks.workunit.client.0.smithi144.stderr: -19> 2024-06-04T16:12:50.190+0000 7f9208b2a800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.26.1.8 2024-06-04T16:12:50.328 INFO:tasks.workunit.client.0.smithi144.stderr: -18> 2024-06-04T16:12:50.190+0000 7f9208b2a800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.26.1.9 2024-06-04T16:12:50.329 INFO:tasks.workunit.client.0.smithi144.stderr: -17> 2024-06-04T16:12:50.190+0000 7f9208b2a800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.26.1.9 2024-06-04T16:12:50.329 INFO:tasks.workunit.client.0.smithi144.stderr: -16> 2024-06-04T16:12:50.190+0000 7f9208b2a800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.26.1.10 2024-06-04T16:12:50.329 INFO:tasks.workunit.client.0.smithi144.stderr: -15> 2024-06-04T16:12:50.190+0000 7f9208b2a800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.26.1.10 2024-06-04T16:12:50.329 INFO:tasks.workunit.client.0.smithi144.stderr: -14> 2024-06-04T16:12:50.190+0000 7f9208b2a800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.26.1.11 2024-06-04T16:12:50.329 INFO:tasks.workunit.client.0.smithi144.stderr: -13> 2024-06-04T16:12:50.190+0000 7f9208b2a800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.26.1.11 2024-06-04T16:12:50.329 INFO:tasks.workunit.client.0.smithi144.stderr: -12> 2024-06-04T16:12:50.190+0000 7f9208b2a800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.26.0 2024-06-04T16:12:50.329 INFO:tasks.workunit.client.0.smithi144.stderr: -11> 2024-06-04T16:12:50.190+0000 7f9208b2a800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.26.1 2024-06-04T16:12:50.329 INFO:tasks.workunit.client.0.smithi144.stderr: -10> 2024-06-04T16:12:50.191+0000 7f9208b2a800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.26.2 2024-06-04T16:12:50.329 INFO:tasks.workunit.client.0.smithi144.stderr: -9> 2024-06-04T16:12:50.191+0000 7f9208b2a800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.26.3 2024-06-04T16:12:50.329 INFO:tasks.workunit.client.0.smithi144.stderr: -8> 2024-06-04T16:12:50.192+0000 7f9208b2a800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.26.4 2024-06-04T16:12:50.329 INFO:tasks.workunit.client.0.smithi144.stderr: -7> 2024-06-04T16:12:50.192+0000 7f9208b2a800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.26.5 2024-06-04T16:12:50.329 INFO:tasks.workunit.client.0.smithi144.stderr: -6> 2024-06-04T16:12:50.193+0000 7f9208b2a800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.26.6 2024-06-04T16:12:50.329 INFO:tasks.workunit.client.0.smithi144.stderr: -5> 2024-06-04T16:12:50.193+0000 7f9208b2a800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.26.7 2024-06-04T16:12:50.329 INFO:tasks.workunit.client.0.smithi144.stderr: -4> 2024-06-04T16:12:50.194+0000 7f9208b2a800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.26.8 2024-06-04T16:12:50.330 INFO:tasks.workunit.client.0.smithi144.stderr: -3> 2024-06-04T16:12:50.194+0000 7f9208b2a800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.26.9 2024-06-04T16:12:50.330 INFO:tasks.workunit.client.0.smithi144.stderr: -2> 2024-06-04T16:12:50.195+0000 7f9208b2a800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.26.10 2024-06-04T16:12:50.330 INFO:tasks.workunit.client.0.smithi144.stderr: -1> 2024-06-04T16:12:50.199+0000 7f9208b2a800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-4027-g65533a90/rpm/el9/BUILD/ceph-19.0.0-4027-g65533a90/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f9208b2a800 time 2024-06-04T16:12:50.199416+0000 2024-06-04T16:12:50.330 INFO:tasks.workunit.client.0.smithi144.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-4027-g65533a90/rpm/el9/BUILD/ceph-19.0.0-4027-g65533a90/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-06-04T16:12:50.330 INFO:tasks.workunit.client.0.smithi144.stderr: 2024-06-04T16:12:50.330 INFO:tasks.workunit.client.0.smithi144.stderr: ceph version 19.0.0-4027-g65533a90 (65533a907fc9add1863609703fdbbea67993c8ef) squid (dev) 2024-06-04T16:12:50.330 INFO:tasks.workunit.client.0.smithi144.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f920a181dce] 2024-06-04T16:12:50.330 INFO:tasks.workunit.client.0.smithi144.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x181f8c) [0x7f920a181f8c] 2024-06-04T16:12:50.330 INFO:tasks.workunit.client.0.smithi144.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5557be373fb1] 2024-06-04T16:12:50.330 INFO:tasks.workunit.client.0.smithi144.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x5bf) [0x5557be37f62f] 2024-06-04T16:12:50.330 INFO:tasks.workunit.client.0.smithi144.stderr: 5: main() 2024-06-04T16:12:50.330 INFO:tasks.workunit.client.0.smithi144.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7f9209029590] 2024-06-04T16:12:50.330 INFO:tasks.workunit.client.0.smithi144.stderr: 7: __libc_start_main() 2024-06-04T16:12:50.330 INFO:tasks.workunit.client.0.smithi144.stderr: 8: _start() 2024-06-04T16:12:50.331 INFO:tasks.workunit.client.0.smithi144.stderr: 2024-06-04T16:12:50.331 INFO:tasks.workunit.client.0.smithi144.stderr: 0> 2024-06-04T16:12:50.199+0000 7f9208b2a800 -1 *** Caught signal (Aborted) ** 2024-06-04T16:12:50.331 INFO:tasks.workunit.client.0.smithi144.stderr: in thread 7f9208b2a800 thread_name:radosgw-admin 2024-06-04T16:12:50.331 INFO:tasks.workunit.client.0.smithi144.stderr: 2024-06-04T16:12:50.331 INFO:tasks.workunit.client.0.smithi144.stderr: ceph version 19.0.0-4027-g65533a90 (65533a907fc9add1863609703fdbbea67993c8ef) squid (dev) 2024-06-04T16:12:50.331 INFO:tasks.workunit.client.0.smithi144.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f920903e6f0] 2024-06-04T16:12:50.331 INFO:tasks.workunit.client.0.smithi144.stderr: 2: /lib64/libc.so.6(+0x8b94c) [0x7f920908b94c] 2024-06-04T16:12:50.331 INFO:tasks.workunit.client.0.smithi144.stderr: 3: raise() 2024-06-04T16:12:50.331 INFO:tasks.workunit.client.0.smithi144.stderr: 4: abort() 2024-06-04T16:12:50.331 INFO:tasks.workunit.client.0.smithi144.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f920a181e28] 2024-06-04T16:12:50.331 INFO:tasks.workunit.client.0.smithi144.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x181f8c) [0x7f920a181f8c] 2024-06-04T16:12:50.331 INFO:tasks.workunit.client.0.smithi144.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5557be373fb1] 2024-06-04T16:12:50.331 INFO:tasks.workunit.client.0.smithi144.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x5bf) [0x5557be37f62f] 2024-06-04T16:12:50.331 INFO:tasks.workunit.client.0.smithi144.stderr: 9: main() 2024-06-04T16:12:50.332 INFO:tasks.workunit.client.0.smithi144.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7f9209029590] 2024-06-04T16:12:50.332 INFO:tasks.workunit.client.0.smithi144.stderr: 11: __libc_start_main() 2024-06-04T16:12:50.332 INFO:tasks.workunit.client.0.smithi144.stderr: 12: _start() 2024-06-04T16:12:50.332 INFO:tasks.workunit.client.0.smithi144.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-06-04T16:12:50.332 INFO:tasks.workunit.client.0.smithi144.stderr: 2024-06-04T16:12:50.332 INFO:tasks.workunit.client.0.smithi144.stderr:--- logging levels --- 2024-06-04T16:12:50.332 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 5 none 2024-06-04T16:12:50.332 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 1 lockdep 2024-06-04T16:12:50.332 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 1 context 2024-06-04T16:12:50.332 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 1 crush 2024-06-04T16:12:50.332 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 5 mds 2024-06-04T16:12:50.332 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 5 mds_balancer 2024-06-04T16:12:50.332 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 5 mds_locker 2024-06-04T16:12:50.333 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 5 mds_log 2024-06-04T16:12:50.333 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 5 mds_log_expire 2024-06-04T16:12:50.333 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 5 mds_migrator 2024-06-04T16:12:50.333 INFO:tasks.workunit.client.0.smithi144.stderr: 3/ 5 mds_quiesce 2024-06-04T16:12:50.333 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 1 buffer 2024-06-04T16:12:50.333 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 1 timer 2024-06-04T16:12:50.333 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 1 filer 2024-06-04T16:12:50.333 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 1 striper 2024-06-04T16:12:50.333 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 1 objecter 2024-06-04T16:12:50.333 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 5 rados 2024-06-04T16:12:50.333 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 5 rbd 2024-06-04T16:12:50.333 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 5 rbd_mirror 2024-06-04T16:12:50.333 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 5 rbd_replay 2024-06-04T16:12:50.333 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 5 rbd_pwl 2024-06-04T16:12:50.334 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 5 journaler 2024-06-04T16:12:50.334 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 5 objectcacher 2024-06-04T16:12:50.334 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 5 immutable_obj_cache 2024-06-04T16:12:50.334 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 5 client 2024-06-04T16:12:50.334 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 5 osd 2024-06-04T16:12:50.334 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 5 optracker 2024-06-04T16:12:50.334 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 5 objclass 2024-06-04T16:12:50.334 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 3 filestore 2024-06-04T16:12:50.334 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 3 journal 2024-06-04T16:12:50.334 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 0 ms 2024-06-04T16:12:50.334 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 5 mon 2024-06-04T16:12:50.334 INFO:tasks.workunit.client.0.smithi144.stderr: 0/10 monc 2024-06-04T16:12:50.334 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 5 paxos 2024-06-04T16:12:50.334 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 5 tp 2024-06-04T16:12:50.335 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 5 auth 2024-06-04T16:12:50.335 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 5 crypto 2024-06-04T16:12:50.335 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 1 finisher 2024-06-04T16:12:50.335 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 1 reserver 2024-06-04T16:12:50.335 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 5 heartbeatmap 2024-06-04T16:12:50.335 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 5 perfcounter 2024-06-04T16:12:50.335 INFO:tasks.workunit.client.0.smithi144.stderr: 20/20 rgw 2024-06-04T16:12:50.335 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 5 rgw_sync 2024-06-04T16:12:50.335 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 5 rgw_datacache 2024-06-04T16:12:50.335 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 5 rgw_access 2024-06-04T16:12:50.335 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 5 rgw_dbstore 2024-06-04T16:12:50.335 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 5 rgw_flight 2024-06-04T16:12:50.335 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 5 rgw_lifecycle 2024-06-04T16:12:50.335 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 5 rgw_notification 2024-06-04T16:12:50.335 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 5 javaclient 2024-06-04T16:12:50.335 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 5 asok 2024-06-04T16:12:50.336 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 1 throttle 2024-06-04T16:12:50.336 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 0 refs 2024-06-04T16:12:50.336 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 5 compressor 2024-06-04T16:12:50.336 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 5 bluestore 2024-06-04T16:12:50.336 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 5 bluefs 2024-06-04T16:12:50.336 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 3 bdev 2024-06-04T16:12:50.336 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 5 kstore 2024-06-04T16:12:50.336 INFO:tasks.workunit.client.0.smithi144.stderr: 4/ 5 rocksdb 2024-06-04T16:12:50.336 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 5 fuse 2024-06-04T16:12:50.336 INFO:tasks.workunit.client.0.smithi144.stderr: 2/ 5 mgr 2024-06-04T16:12:50.336 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 5 mgrc 2024-06-04T16:12:50.336 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 5 dpdk 2024-06-04T16:12:50.336 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 5 eventtrace 2024-06-04T16:12:50.336 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 5 prioritycache 2024-06-04T16:12:50.337 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 5 test 2024-06-04T16:12:50.337 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 5 cephfs_mirror 2024-06-04T16:12:50.337 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 5 cephsqlite 2024-06-04T16:12:50.337 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 5 crimson_interrupt 2024-06-04T16:12:50.337 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 5 seastore 2024-06-04T16:12:50.337 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 5 seastore_onode 2024-06-04T16:12:50.337 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 5 seastore_odata 2024-06-04T16:12:50.337 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 5 seastore_omap 2024-06-04T16:12:50.337 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 5 seastore_tm 2024-06-04T16:12:50.337 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 5 seastore_t 2024-06-04T16:12:50.337 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 5 seastore_cleaner 2024-06-04T16:12:50.337 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 5 seastore_epm 2024-06-04T16:12:50.337 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 5 seastore_lba 2024-06-04T16:12:50.337 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 5 seastore_fixedkv_tree 2024-06-04T16:12:50.337 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 5 seastore_cache 2024-06-04T16:12:50.338 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 5 seastore_journal 2024-06-04T16:12:50.338 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 5 seastore_device 2024-06-04T16:12:50.338 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 5 seastore_backref 2024-06-04T16:12:50.338 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 5 alienstore 2024-06-04T16:12:50.338 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 5 mclock 2024-06-04T16:12:50.338 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 5 cyanstore 2024-06-04T16:12:50.338 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 5 ceph_exporter 2024-06-04T16:12:50.338 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 5 memstore 2024-06-04T16:12:50.338 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 5 trace 2024-06-04T16:12:50.338 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 5 ceph_dedup 2024-06-04T16:12:50.338 INFO:tasks.workunit.client.0.smithi144.stderr: -2/-2 (syslog threshold) 2024-06-04T16:12:50.338 INFO:tasks.workunit.client.0.smithi144.stderr: 99/99 (stderr threshold) 2024-06-04T16:12:50.339 INFO:tasks.workunit.client.0.smithi144.stderr:--- pthread ID / name mapping for recent threads --- 2024-06-04T16:12:50.339 INFO:tasks.workunit.client.0.smithi144.stderr: 7f902b7fe640 / http_manager 2024-06-04T16:12:50.339 INFO:tasks.workunit.client.0.smithi144.stderr: 7f90b9fdb640 / http_manager 2024-06-04T16:12:50.339 INFO:tasks.workunit.client.0.smithi144.stderr: 7f90bafdd640 / rgw_dt_lg_renew 2024-06-04T16:12:50.339 INFO:tasks.workunit.client.0.smithi144.stderr: 7f90d9ffb640 / ms_dispatch 2024-06-04T16:12:50.339 INFO:tasks.workunit.client.0.smithi144.stderr: 7f90db7fe640 / io_context_pool 2024-06-04T16:12:50.339 INFO:tasks.workunit.client.0.smithi144.stderr: 7f90e9ffb640 / ms_dispatch 2024-06-04T16:12:50.339 INFO:tasks.workunit.client.0.smithi144.stderr: 7f90f0e09640 / ms_dispatch 2024-06-04T16:12:50.339 INFO:tasks.workunit.client.0.smithi144.stderr: 7f90f260c640 / io_context_pool 2024-06-04T16:12:50.339 INFO:tasks.workunit.client.0.smithi144.stderr: 7f9203fe7640 / msgr-worker-2 2024-06-04T16:12:50.339 INFO:tasks.workunit.client.0.smithi144.stderr: 7f92047e8640 / msgr-worker-1 2024-06-04T16:12:50.339 INFO:tasks.workunit.client.0.smithi144.stderr: 7f9204fe9640 / msgr-worker-0 2024-06-04T16:12:50.339 INFO:tasks.workunit.client.0.smithi144.stderr: 7f92057ea640 / io_context_pool 2024-06-04T16:12:50.340 INFO:tasks.workunit.client.0.smithi144.stderr: 7f9208b2a800 / radosgw-admin 2024-06-04T16:12:50.340 INFO:tasks.workunit.client.0.smithi144.stderr: max_recent 500 2024-06-04T16:12:50.340 INFO:tasks.workunit.client.0.smithi144.stderr: max_new 1000 2024-06-04T16:12:50.340 INFO:tasks.workunit.client.0.smithi144.stderr: log_file /var/lib/ceph/crash/2024-06-04T16:12:50.200823Z_87928e6d-3576-4419-8332-997f248d5078/log 2024-06-04T16:12:50.340 INFO:tasks.workunit.client.0.smithi144.stderr:--- end dump of recent events --- 2024-06-04T16:12:50.340 INFO:tasks.workunit.client.0.smithi144.stderr:radosgw-admin bucket stats --bucket abort-at-commit-target-layout 2024-06-04T16:12:50.341 INFO:tasks.workunit.client.0.smithi144.stderr:ignoring --setuser ceph since I am not root 2024-06-04T16:12:50.341 INFO:tasks.workunit.client.0.smithi144.stderr:ignoring --setgroup ceph since I am not root 2024-06-04T16:12:50.341 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:50.279+0000 7ff8cbe98800 20 rados->read ofs=0 len=0 2024-06-04T16:12:50.342 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:50.282+0000 7ff8cbe98800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:12:50.342 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:50.282+0000 7ff8cbe98800 20 realm 2024-06-04T16:12:50.342 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:50.282+0000 7ff8cbe98800 20 rados->read ofs=0 len=0 2024-06-04T16:12:50.342 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:50.282+0000 7ff8cbe98800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:12:50.342 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:50.282+0000 7ff8cbe98800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-06-04T16:12:50.342 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:50.282+0000 7ff8cbe98800 20 rados->read ofs=0 len=0 2024-06-04T16:12:50.342 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:50.282+0000 7ff8cbe98800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:12:50.342 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:50.282+0000 7ff8cbe98800 20 rados->read ofs=0 len=0 2024-06-04T16:12:50.342 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:50.283+0000 7ff8cbe98800 20 rados_obj.operate() r=0 bl.length=46 2024-06-04T16:12:50.342 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:50.283+0000 7ff8cbe98800 20 rados->read ofs=0 len=0 2024-06-04T16:12:50.342 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:50.283+0000 7ff8cbe98800 20 rados_obj.operate() r=0 bl.length=1139 2024-06-04T16:12:50.342 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:50.283+0000 7ff8cbe98800 20 searching for the correct realm 2024-06-04T16:12:50.343 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:50.286+0000 7ff8ca18e640 0 -- 172.21.15.144:0/1022579960 >> [v2:172.21.15.144:6800/1453747520,v1:172.21.15.144:6801/1453747520] conn(0x7ff8c0045030 msgr2=0x7ff8c009aa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-06-04T16:12:50.491 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:50.490+0000 7ff8ca18e640 0 -- 172.21.15.144:0/1022579960 >> [v2:172.21.15.144:6824/166159729,v1:172.21.15.144:6825/166159729] conn(0x55d5bd02ae50 msgr2=0x55d5bd02d240 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-06-04T16:12:50.496 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:50.495+0000 7ff8cbe98800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-06-04T16:12:50.497 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:50.495+0000 7ff8cbe98800 20 RGWRados::pool_iterate: got zone_info.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767 2024-06-04T16:12:50.497 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:50.495+0000 7ff8cbe98800 20 RGWRados::pool_iterate: got default.zone. 2024-06-04T16:12:50.497 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:50.495+0000 7ff8cbe98800 20 RGWRados::pool_iterate: got zonegroup_info.abb22408-c332-4e28-8f7a-ff254ea2fed2 2024-06-04T16:12:50.497 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:50.495+0000 7ff8cbe98800 20 RGWRados::pool_iterate: got zone_names.default 2024-06-04T16:12:50.497 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:50.495+0000 7ff8cbe98800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-06-04T16:12:50.497 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:50.495+0000 7ff8cbe98800 20 rados->read ofs=0 len=0 2024-06-04T16:12:50.497 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:50.496+0000 7ff8cbe98800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:12:50.497 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:50.496+0000 7ff8cbe98800 20 rados->read ofs=0 len=0 2024-06-04T16:12:50.497 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:50.496+0000 7ff8cbe98800 20 rados_obj.operate() r=0 bl.length=46 2024-06-04T16:12:50.497 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:50.496+0000 7ff8cbe98800 20 rados->read ofs=0 len=0 2024-06-04T16:12:50.499 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:50.496+0000 7ff8cbe98800 20 rados_obj.operate() r=0 bl.length=470 2024-06-04T16:12:50.499 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:50.496+0000 7ff8cbe98800 20 zone default found 2024-06-04T16:12:50.499 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:50.496+0000 7ff8cbe98800 4 Realm: () 2024-06-04T16:12:50.499 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:50.496+0000 7ff8cbe98800 4 ZoneGroup: default (abb22408-c332-4e28-8f7a-ff254ea2fed2) 2024-06-04T16:12:50.499 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:50.496+0000 7ff8cbe98800 4 Zone: default (be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767) 2024-06-04T16:12:50.499 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:50.496+0000 7ff8cbe98800 10 cannot find current period zonegroup using local zonegroup configuration 2024-06-04T16:12:50.499 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:50.496+0000 7ff8cbe98800 20 zonegroup default 2024-06-04T16:12:50.499 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:50.496+0000 7ff8cbe98800 20 rados->read ofs=0 len=0 2024-06-04T16:12:50.499 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:50.497+0000 7ff8cbe98800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:12:50.499 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:50.497+0000 7ff8cbe98800 20 rados->read ofs=0 len=0 2024-06-04T16:12:50.499 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:50.497+0000 7ff8cbe98800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:12:50.499 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:50.497+0000 7ff8cbe98800 20 rados->read ofs=0 len=0 2024-06-04T16:12:50.499 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:50.497+0000 7ff8cbe98800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:12:50.500 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:50.497+0000 7ff8cbe98800 20 started sync module instance, tier type = 2024-06-04T16:12:50.500 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:50.497+0000 7ff8cbe98800 20 started zone id=be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767 (name=default) with tier type = 2024-06-04T16:12:50.508 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:50.507+0000 7ff8cbe98800 20 add_watcher() i=0 2024-06-04T16:12:50.508 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:50.507+0000 7ff8cbe98800 20 add_watcher() i=1 2024-06-04T16:12:50.508 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:50.507+0000 7ff8cbe98800 20 add_watcher() i=2 2024-06-04T16:12:50.508 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:50.507+0000 7ff8cbe98800 20 add_watcher() i=3 2024-06-04T16:12:50.508 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:50.507+0000 7ff8cbe98800 20 add_watcher() i=4 2024-06-04T16:12:50.508 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:50.507+0000 7ff8cbe98800 20 add_watcher() i=5 2024-06-04T16:12:50.508 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:50.507+0000 7ff8cbe98800 20 add_watcher() i=6 2024-06-04T16:12:50.508 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:50.508+0000 7ff8cbe98800 20 add_watcher() i=7 2024-06-04T16:12:50.508 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:50.508+0000 7ff8cbe98800 2 all 8 watchers are set, enabling cache 2024-06-04T16:12:50.510 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:50.509+0000 7ff77b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-06-04T16:12:50.511 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:50.509+0000 7ff8cbe98800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-06-04T16:12:50.511 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:50.509+0000 7ff8cbe98800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-06-04T16:12:50.511 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:50.509+0000 7ff8cbe98800 5 note: GC not initialized 2024-06-04T16:12:50.511 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:50.510+0000 7ff77a7fc640 20 reqs_thread_entry: start 2024-06-04T16:12:50.512 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:50.510+0000 7ff8cbe98800 20 init_complete bucket index max shards: 11 2024-06-04T16:12:50.512 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:50.510+0000 7ff8cbe98800 20 Filter name: none 2024-06-04T16:12:50.512 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:50.510+0000 7ff6effff640 20 reqs_thread_entry: start 2024-06-04T16:12:50.512 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:50.510+0000 7ff8cbe98800 20 rados->read ofs=0 len=0 2024-06-04T16:12:50.512 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:50.510+0000 7ff8cbe98800 20 rados_obj.operate() r=0 bl.length=197 2024-06-04T16:12:50.512 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:50.510+0000 7ff8cbe98800 20 rados->read ofs=0 len=0 2024-06-04T16:12:50.513 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:50.511+0000 7ff8cbe98800 20 rados_obj.operate() r=0 bl.length=443 2024-06-04T16:12:50.513 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:50.511+0000 7ff8cbe98800 20 couldn't put binfo cache entry, might have raced with data changes 2024-06-04T16:12:50.513 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:50.511+0000 7ff8cbe98800 20 rados->read ofs=0 len=0 2024-06-04T16:12:50.513 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:50.511+0000 7ff8cbe98800 20 rados_obj.operate() r=0 bl.length=197 2024-06-04T16:12:50.513 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:50.511+0000 7ff8cbe98800 20 rados->read ofs=0 len=0 2024-06-04T16:12:50.513 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:50.512+0000 7ff8cbe98800 20 rados_obj.operate() r=0 bl.length=443 2024-06-04T16:12:50.513 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:50.512+0000 7ff8cbe98800 20 couldn't put binfo cache entry, might have raced with data changes 2024-06-04T16:12:50.514 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:50.513+0000 7ff77b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-06-04T16:12:50.516 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:50.515+0000 7ff8cbe98800 20 remove_watcher() i=0 2024-06-04T16:12:50.516 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:50.515+0000 7ff8cbe98800 2 removed watcher, disabling cache 2024-06-04T16:12:50.517 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:50.516+0000 7ff8cbe98800 20 remove_watcher() i=1 2024-06-04T16:12:50.518 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:50.517+0000 7ff8cbe98800 20 remove_watcher() i=2 2024-06-04T16:12:50.519 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:50.518+0000 7ff8cbe98800 20 remove_watcher() i=3 2024-06-04T16:12:50.520 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:50.519+0000 7ff8cbe98800 20 remove_watcher() i=4 2024-06-04T16:12:50.521 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:50.520+0000 7ff8cbe98800 20 remove_watcher() i=5 2024-06-04T16:12:50.522 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:50.521+0000 7ff8cbe98800 20 remove_watcher() i=6 2024-06-04T16:12:50.523 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:12:50.522+0000 7ff8cbe98800 20 remove_watcher() i=7 2024-06-04T16:12:50.533 INFO:tasks.workunit.client.0.smithi144.stderr: 2024-06-04T16:12:50.534 INFO:tasks.workunit.client.0.smithi144.stderr:BUCKET_STATS: 2024-06-04T16:12:50.534 INFO:tasks.workunit.client.0.smithi144.stderr:bucket: abort-at-commit-target-layout id: be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.26 num_objects: 20 size_kb: 1 num_shards: 11 2024-06-04T16:12:50.534 INFO:tasks.workunit.client.0.smithi144.stderr: 2024-06-04T16:12:50.535 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:12:50.535 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:13:20.574 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:13:20.574 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:13:20.617 INFO:tasks.workunit.client.0.smithi144.stderr:radosgw-admin bucket reshard --bucket abort-at-commit-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-06-04T16:13:20.652 INFO:tasks.workunit.client.0.smithi144.stderr:ignoring --setuser ceph since I am not root 2024-06-04T16:13:20.652 INFO:tasks.workunit.client.0.smithi144.stderr:ignoring --setgroup ceph since I am not root 2024-06-04T16:13:20.694 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:20.693+0000 7f6bb1f2f800 20 rados->read ofs=0 len=0 2024-06-04T16:13:20.696 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:20.695+0000 7f6bb1f2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:13:20.697 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:20.695+0000 7f6bb1f2f800 20 realm 2024-06-04T16:13:20.697 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:20.695+0000 7f6bb1f2f800 20 rados->read ofs=0 len=0 2024-06-04T16:13:20.697 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:20.695+0000 7f6bb1f2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:13:20.697 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:20.695+0000 7f6bb1f2f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-06-04T16:13:20.697 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:20.695+0000 7f6bb1f2f800 20 rados->read ofs=0 len=0 2024-06-04T16:13:20.697 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:20.695+0000 7f6bb1f2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:13:20.697 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:20.695+0000 7f6bb1f2f800 20 rados->read ofs=0 len=0 2024-06-04T16:13:20.698 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:20.696+0000 7f6bb1f2f800 20 rados_obj.operate() r=0 bl.length=46 2024-06-04T16:13:20.698 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:20.696+0000 7f6bb1f2f800 20 rados->read ofs=0 len=0 2024-06-04T16:13:20.698 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:20.697+0000 7f6bb1f2f800 20 rados_obj.operate() r=0 bl.length=1139 2024-06-04T16:13:20.698 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:20.697+0000 7f6bb1f2f800 20 searching for the correct realm 2024-06-04T16:13:20.700 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:20.699+0000 7f6bae4bc640 0 -- 172.21.15.144:0/490724628 >> [v2:172.21.15.144:6800/1453747520,v1:172.21.15.144:6801/1453747520] conn(0x7f6b98065070 msgr2=0x7f6b98007c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-06-04T16:13:20.905 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:20.904+0000 7f6bae4bc640 0 -- 172.21.15.144:0/490724628 >> [v2:172.21.15.144:6824/166159729,v1:172.21.15.144:6825/166159729] conn(0x556350190e40 msgr2=0x556350193230 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-06-04T16:13:20.911 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:20.910+0000 7f6bb1f2f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-06-04T16:13:20.911 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:20.910+0000 7f6bb1f2f800 20 RGWRados::pool_iterate: got zone_info.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767 2024-06-04T16:13:20.912 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:20.910+0000 7f6bb1f2f800 20 RGWRados::pool_iterate: got default.zone. 2024-06-04T16:13:20.912 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:20.910+0000 7f6bb1f2f800 20 RGWRados::pool_iterate: got zonegroup_info.abb22408-c332-4e28-8f7a-ff254ea2fed2 2024-06-04T16:13:20.912 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:20.910+0000 7f6bb1f2f800 20 RGWRados::pool_iterate: got zone_names.default 2024-06-04T16:13:20.912 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:20.910+0000 7f6bb1f2f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-06-04T16:13:20.912 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:20.910+0000 7f6bb1f2f800 20 rados->read ofs=0 len=0 2024-06-04T16:13:20.912 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:20.910+0000 7f6bb1f2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:13:20.912 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:20.910+0000 7f6bb1f2f800 20 rados->read ofs=0 len=0 2024-06-04T16:13:20.912 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:20.911+0000 7f6bb1f2f800 20 rados_obj.operate() r=0 bl.length=46 2024-06-04T16:13:20.912 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:20.911+0000 7f6bb1f2f800 20 rados->read ofs=0 len=0 2024-06-04T16:13:20.913 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:20.911+0000 7f6bb1f2f800 20 rados_obj.operate() r=0 bl.length=470 2024-06-04T16:13:20.913 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:20.911+0000 7f6bb1f2f800 20 zone default found 2024-06-04T16:13:20.913 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:20.911+0000 7f6bb1f2f800 4 Realm: () 2024-06-04T16:13:20.914 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:20.911+0000 7f6bb1f2f800 4 ZoneGroup: default (abb22408-c332-4e28-8f7a-ff254ea2fed2) 2024-06-04T16:13:20.914 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:20.911+0000 7f6bb1f2f800 4 Zone: default (be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767) 2024-06-04T16:13:20.914 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:20.911+0000 7f6bb1f2f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-06-04T16:13:20.914 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:20.911+0000 7f6bb1f2f800 20 zonegroup default 2024-06-04T16:13:20.914 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:20.911+0000 7f6bb1f2f800 20 rados->read ofs=0 len=0 2024-06-04T16:13:20.914 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:20.912+0000 7f6bb1f2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:13:20.914 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:20.912+0000 7f6bb1f2f800 20 rados->read ofs=0 len=0 2024-06-04T16:13:20.914 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:20.912+0000 7f6bb1f2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:13:20.914 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:20.912+0000 7f6bb1f2f800 20 rados->read ofs=0 len=0 2024-06-04T16:13:20.914 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:20.912+0000 7f6bb1f2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:13:20.914 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:20.912+0000 7f6bb1f2f800 20 started sync module instance, tier type = 2024-06-04T16:13:20.914 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:20.912+0000 7f6bb1f2f800 20 started zone id=be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767 (name=default) with tier type = 2024-06-04T16:13:20.923 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:20.922+0000 7f6bb1f2f800 20 add_watcher() i=0 2024-06-04T16:13:20.923 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:20.922+0000 7f6bb1f2f800 20 add_watcher() i=1 2024-06-04T16:13:20.923 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:20.922+0000 7f6bb1f2f800 20 add_watcher() i=2 2024-06-04T16:13:20.923 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:20.922+0000 7f6bb1f2f800 20 add_watcher() i=3 2024-06-04T16:13:20.923 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:20.922+0000 7f6bb1f2f800 20 add_watcher() i=4 2024-06-04T16:13:20.923 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:20.922+0000 7f6bb1f2f800 20 add_watcher() i=5 2024-06-04T16:13:20.924 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:20.922+0000 7f6bb1f2f800 20 add_watcher() i=6 2024-06-04T16:13:20.924 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:20.923+0000 7f6bb1f2f800 20 add_watcher() i=7 2024-06-04T16:13:20.924 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:20.923+0000 7f6bb1f2f800 2 all 8 watchers are set, enabling cache 2024-06-04T16:13:20.926 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:20.925+0000 7f6a5f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-06-04T16:13:20.927 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:20.925+0000 7f6bb1f2f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-06-04T16:13:20.927 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:20.925+0000 7f6bb1f2f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-06-04T16:13:20.927 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:20.926+0000 7f6bb1f2f800 5 note: GC not initialized 2024-06-04T16:13:20.927 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:20.926+0000 7f6a5e7fc640 20 reqs_thread_entry: start 2024-06-04T16:13:20.927 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:20.926+0000 7f6bb1f2f800 20 init_complete bucket index max shards: 11 2024-06-04T16:13:20.927 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:20.926+0000 7f6bb1f2f800 20 Filter name: none 2024-06-04T16:13:20.928 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:20.926+0000 7f69cffff640 20 reqs_thread_entry: start 2024-06-04T16:13:20.928 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:20.926+0000 7f6bb1f2f800 10 cache get: name=default.rgw.meta+root+abort-at-commit-target-layout : miss 2024-06-04T16:13:20.928 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:20.926+0000 7f6bb1f2f800 20 rados->read ofs=0 len=0 2024-06-04T16:13:20.928 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:20.927+0000 7f6bb1f2f800 20 rados_obj.operate() r=0 bl.length=197 2024-06-04T16:13:20.929 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:20.927+0000 7f6bb1f2f800 10 cache put: name=default.rgw.meta+root+abort-at-commit-target-layout info.flags=0x11 2024-06-04T16:13:20.929 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:20.927+0000 7f6bb1f2f800 10 adding default.rgw.meta+root+abort-at-commit-target-layout to cache LRU end 2024-06-04T16:13:20.929 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:20.927+0000 7f6bb1f2f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.26 : miss 2024-06-04T16:13:20.929 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:20.927+0000 7f6bb1f2f800 20 rados->read ofs=0 len=0 2024-06-04T16:13:20.929 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:20.927+0000 7f6bb1f2f800 20 rados_obj.operate() r=0 bl.length=411 2024-06-04T16:13:20.929 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:20.927+0000 7f6bb1f2f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.26 info.flags=0x17 2024-06-04T16:13:20.929 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:20.927+0000 7f6bb1f2f800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.26 to cache LRU end 2024-06-04T16:13:20.929 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:20.927+0000 7f6bb1f2f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-06-04T16:13:20.929 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:20.927+0000 7f6bb1f2f800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-06-04T16:13:20.929 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:20.927+0000 7f6bb1f2f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.26 2024-06-04T16:13:20.934 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:20.933+0000 7f6bb1f2f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.26 info.flags=0x17 2024-06-04T16:13:20.934 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:20.933+0000 7f6bb1f2f800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.26 to cache LRU end 2024-06-04T16:13:20.934 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:20.933+0000 7f6bb1f2f800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-06-04T16:13:20.934 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:20.933+0000 7f6bb1f2f800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.26, ofs0, ns] 2024-06-04T16:13:20.934 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:20.933+0000 7f6a90ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1078036791415 cookie 93885033987552 notifier 6789 bl.length()=923 2024-06-04T16:13:20.934 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:20.933+0000 7f6a90ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.26 info.flags=0x17 2024-06-04T16:13:20.934 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:20.933+0000 7f6a90ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.26 to cache LRU end 2024-06-04T16:13:20.935 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:20.933+0000 7f6a90ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-06-04T16:13:20.935 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:20.934+0000 7f6bb1f2f800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.26]): orig_sources= new_sources= 2024-06-04T16:13:20.935 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:20.934+0000 7f6bb1f2f800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.26]): potential sources added=[] removed=[] 2024-06-04T16:13:20.935 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:20.934+0000 7f6bb1f2f800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.26]): orig_dests= new_dests= 2024-06-04T16:13:20.935 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:20.934+0000 7f6bb1f2f800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.26]): potential dests added=[] removed=[] 2024-06-04T16:13:20.939 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:20.938+0000 7f6bb1f2f800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.26.1.0 2024-06-04T16:13:20.939 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:20.938+0000 7f6bb1f2f800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.26.1.0 2024-06-04T16:13:20.939 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:20.938+0000 7f6bb1f2f800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.26.1.1 2024-06-04T16:13:20.939 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:20.938+0000 7f6bb1f2f800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.26.1.1 2024-06-04T16:13:20.939 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:20.938+0000 7f6bb1f2f800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.26.1.2 2024-06-04T16:13:20.939 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:20.938+0000 7f6bb1f2f800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.26.1.2 2024-06-04T16:13:20.939 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:20.938+0000 7f6bb1f2f800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.26.1.3 2024-06-04T16:13:20.939 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:20.938+0000 7f6bb1f2f800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.26.1.3 2024-06-04T16:13:20.939 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:20.938+0000 7f6bb1f2f800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.26.1.4 2024-06-04T16:13:20.940 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:20.938+0000 7f6bb1f2f800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.26.1.4 2024-06-04T16:13:20.940 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:20.938+0000 7f6bb1f2f800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.26.1.5 2024-06-04T16:13:20.940 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:20.938+0000 7f6bb1f2f800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.26.1.5 2024-06-04T16:13:20.940 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:20.938+0000 7f6bb1f2f800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.26.1.6 2024-06-04T16:13:20.940 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:20.938+0000 7f6bb1f2f800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.26.1.6 2024-06-04T16:13:20.940 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:20.938+0000 7f6bb1f2f800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.26.1.7 2024-06-04T16:13:20.940 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:20.938+0000 7f6bb1f2f800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.26.1.7 2024-06-04T16:13:20.940 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:20.938+0000 7f6bb1f2f800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.26.1.8 2024-06-04T16:13:20.940 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:20.938+0000 7f6bb1f2f800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.26.1.8 2024-06-04T16:13:20.940 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:20.938+0000 7f6bb1f2f800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.26.1.9 2024-06-04T16:13:20.940 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:20.938+0000 7f6bb1f2f800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.26.1.9 2024-06-04T16:13:20.940 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:20.938+0000 7f6bb1f2f800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.26.1.10 2024-06-04T16:13:20.940 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:20.938+0000 7f6bb1f2f800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.26.1.10 2024-06-04T16:13:20.940 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:20.938+0000 7f6bb1f2f800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.26.1.11 2024-06-04T16:13:20.941 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:20.938+0000 7f6bb1f2f800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.26.1.11 2024-06-04T16:13:20.941 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:20.938+0000 7f6bb1f2f800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.26.0 2024-06-04T16:13:20.941 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:20.938+0000 7f6bb1f2f800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.26.1 2024-06-04T16:13:20.941 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:20.939+0000 7f6bb1f2f800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.26.2 2024-06-04T16:13:20.942 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:20.940+0000 7f6bb1f2f800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.26.3 2024-06-04T16:13:20.942 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:20.940+0000 7f6bb1f2f800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.26.4 2024-06-04T16:13:20.942 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:20.941+0000 7f6bb1f2f800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.26.5 2024-06-04T16:13:20.942 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:20.941+0000 7f6bb1f2f800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.26.6 2024-06-04T16:13:20.943 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:20.942+0000 7f6bb1f2f800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.26.7 2024-06-04T16:13:20.943 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:20.942+0000 7f6bb1f2f800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.26.8 2024-06-04T16:13:20.944 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:20.943+0000 7f6bb1f2f800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.26.9 2024-06-04T16:13:20.944 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:20.944+0000 7f6bb1f2f800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.26.10 2024-06-04T16:13:20.948 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:20.947+0000 7f6bb1f2f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.26 : hit (requested=0x17, cached=0x17) 2024-06-04T16:13:20.948 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:20.947+0000 7f6bb1f2f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.26 2024-06-04T16:13:20.950 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:20.949+0000 7f6bb1f2f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.26 info.flags=0x17 2024-06-04T16:13:20.950 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:20.949+0000 7f6bb1f2f800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.26 to cache LRU end 2024-06-04T16:13:20.950 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:20.949+0000 7f6bb1f2f800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-06-04T16:13:20.950 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:20.949+0000 7f6bb1f2f800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.26, ofs0, ns] 2024-06-04T16:13:20.950 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:20.949+0000 7f6a90ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1078036791416 cookie 93885033987552 notifier 6789 bl.length()=891 2024-06-04T16:13:20.950 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:20.949+0000 7f6a90ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.26 info.flags=0x17 2024-06-04T16:13:20.950 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:20.949+0000 7f6a90ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.26 to cache LRU end 2024-06-04T16:13:20.950 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:20.949+0000 7f6a90ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-06-04T16:13:20.951 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:20.949+0000 7f6bb1f2f800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.26]): orig_sources= new_sources= 2024-06-04T16:13:20.951 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:20.949+0000 7f6bb1f2f800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.26]): potential sources added=[] removed=[] 2024-06-04T16:13:20.951 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:20.949+0000 7f6bb1f2f800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.26]): orig_dests= new_dests= 2024-06-04T16:13:20.951 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:20.949+0000 7f6bb1f2f800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.26]): potential dests added=[] removed=[] 2024-06-04T16:13:20.952 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:20.952+0000 7f6bb1f2f800 1 execute INFO: reshard of bucket "abort-at-commit-target-layout" completed successfully 2024-06-04T16:13:20.954 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:20.953+0000 7f6a5f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-06-04T16:13:20.956 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:20.956+0000 7f6bb1f2f800 20 remove_watcher() i=0 2024-06-04T16:13:20.957 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:20.956+0000 7f6bb1f2f800 2 removed watcher, disabling cache 2024-06-04T16:13:20.957 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:20.957+0000 7f6bb1f2f800 20 remove_watcher() i=1 2024-06-04T16:13:20.958 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:20.958+0000 7f6bb1f2f800 20 remove_watcher() i=2 2024-06-04T16:13:20.959 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:20.959+0000 7f6bb1f2f800 20 remove_watcher() i=3 2024-06-04T16:13:20.960 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:20.960+0000 7f6bb1f2f800 20 remove_watcher() i=4 2024-06-04T16:13:20.962 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:20.961+0000 7f6bb1f2f800 20 remove_watcher() i=5 2024-06-04T16:13:20.963 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:20.962+0000 7f6bb1f2f800 20 remove_watcher() i=6 2024-06-04T16:13:20.964 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:20.963+0000 7f6bb1f2f800 20 remove_watcher() i=7 2024-06-04T16:13:20.977 INFO:tasks.workunit.client.0.smithi144.stderr:radosgw-admin bucket stats --bucket abort-at-commit-target-layout 2024-06-04T16:13:21.006 INFO:tasks.workunit.client.0.smithi144.stderr:ignoring --setuser ceph since I am not root 2024-06-04T16:13:21.006 INFO:tasks.workunit.client.0.smithi144.stderr:ignoring --setgroup ceph since I am not root 2024-06-04T16:13:21.044 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:21.043+0000 7f0173331800 20 rados->read ofs=0 len=0 2024-06-04T16:13:21.046 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:21.045+0000 7f0173331800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:13:21.046 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:21.045+0000 7f0173331800 20 realm 2024-06-04T16:13:21.046 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:21.045+0000 7f0173331800 20 rados->read ofs=0 len=0 2024-06-04T16:13:21.046 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:21.045+0000 7f0173331800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:13:21.046 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:21.045+0000 7f0173331800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-06-04T16:13:21.047 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:21.045+0000 7f0173331800 20 rados->read ofs=0 len=0 2024-06-04T16:13:21.047 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:21.045+0000 7f0173331800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:13:21.047 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:21.045+0000 7f0173331800 20 rados->read ofs=0 len=0 2024-06-04T16:13:21.047 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:21.046+0000 7f0173331800 20 rados_obj.operate() r=0 bl.length=46 2024-06-04T16:13:21.047 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:21.046+0000 7f0173331800 20 rados->read ofs=0 len=0 2024-06-04T16:13:21.048 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:21.047+0000 7f0173331800 20 rados_obj.operate() r=0 bl.length=1139 2024-06-04T16:13:21.048 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:21.047+0000 7f0173331800 20 searching for the correct realm 2024-06-04T16:13:21.048 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:21.048+0000 7f0167fff640 0 -- 172.21.15.144:0/2829589494 >> [v2:172.21.15.144:6808/86532035,v1:172.21.15.144:6809/86532035] conn(0x7f016002c030 msgr2=0x7f0160067740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-06-04T16:13:21.254 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:21.253+0000 7f016f0e8640 0 -- 172.21.15.144:0/2829589494 >> [v2:172.21.15.177:6824/800067290,v1:172.21.15.177:6825/800067290] conn(0x561f50e12ac0 msgr2=0x561f50e14f30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-06-04T16:13:21.260 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:21.259+0000 7f0173331800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-06-04T16:13:21.260 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:21.259+0000 7f0173331800 20 RGWRados::pool_iterate: got zone_info.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767 2024-06-04T16:13:21.260 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:21.259+0000 7f0173331800 20 RGWRados::pool_iterate: got default.zone. 2024-06-04T16:13:21.260 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:21.259+0000 7f0173331800 20 RGWRados::pool_iterate: got zonegroup_info.abb22408-c332-4e28-8f7a-ff254ea2fed2 2024-06-04T16:13:21.260 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:21.259+0000 7f0173331800 20 RGWRados::pool_iterate: got zone_names.default 2024-06-04T16:13:21.260 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:21.259+0000 7f0173331800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-06-04T16:13:21.260 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:21.259+0000 7f0173331800 20 rados->read ofs=0 len=0 2024-06-04T16:13:21.260 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:21.259+0000 7f0173331800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:13:21.260 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:21.259+0000 7f0173331800 20 rados->read ofs=0 len=0 2024-06-04T16:13:21.261 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:21.259+0000 7f0173331800 20 rados_obj.operate() r=0 bl.length=46 2024-06-04T16:13:21.261 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:21.259+0000 7f0173331800 20 rados->read ofs=0 len=0 2024-06-04T16:13:21.261 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:21.260+0000 7f0173331800 20 rados_obj.operate() r=0 bl.length=470 2024-06-04T16:13:21.262 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:21.260+0000 7f0173331800 20 zone default found 2024-06-04T16:13:21.262 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:21.260+0000 7f0173331800 4 Realm: () 2024-06-04T16:13:21.262 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:21.260+0000 7f0173331800 4 ZoneGroup: default (abb22408-c332-4e28-8f7a-ff254ea2fed2) 2024-06-04T16:13:21.262 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:21.260+0000 7f0173331800 4 Zone: default (be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767) 2024-06-04T16:13:21.262 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:21.260+0000 7f0173331800 10 cannot find current period zonegroup using local zonegroup configuration 2024-06-04T16:13:21.262 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:21.260+0000 7f0173331800 20 zonegroup default 2024-06-04T16:13:21.262 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:21.260+0000 7f0173331800 20 rados->read ofs=0 len=0 2024-06-04T16:13:21.262 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:21.260+0000 7f0173331800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:13:21.262 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:21.260+0000 7f0173331800 20 rados->read ofs=0 len=0 2024-06-04T16:13:21.262 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:21.261+0000 7f0173331800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:13:21.262 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:21.261+0000 7f0173331800 20 rados->read ofs=0 len=0 2024-06-04T16:13:21.263 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:21.261+0000 7f0173331800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:13:21.263 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:21.261+0000 7f0173331800 20 started sync module instance, tier type = 2024-06-04T16:13:21.263 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:21.261+0000 7f0173331800 20 started zone id=be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767 (name=default) with tier type = 2024-06-04T16:13:21.272 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:21.271+0000 7f0173331800 20 add_watcher() i=0 2024-06-04T16:13:21.272 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:21.271+0000 7f0173331800 20 add_watcher() i=1 2024-06-04T16:13:21.272 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:21.271+0000 7f0173331800 20 add_watcher() i=2 2024-06-04T16:13:21.272 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:21.271+0000 7f0173331800 20 add_watcher() i=3 2024-06-04T16:13:21.272 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:21.271+0000 7f0173331800 20 add_watcher() i=4 2024-06-04T16:13:21.272 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:21.271+0000 7f0173331800 20 add_watcher() i=5 2024-06-04T16:13:21.272 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:21.271+0000 7f0173331800 20 add_watcher() i=6 2024-06-04T16:13:21.273 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:21.272+0000 7f0173331800 20 add_watcher() i=7 2024-06-04T16:13:21.273 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:21.272+0000 7f0173331800 2 all 8 watchers are set, enabling cache 2024-06-04T16:13:21.275 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:21.275+0000 7f0021fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-06-04T16:13:21.276 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:21.275+0000 7f0173331800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-06-04T16:13:21.277 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:21.275+0000 7f0173331800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-06-04T16:13:21.277 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:21.275+0000 7f0173331800 5 note: GC not initialized 2024-06-04T16:13:21.277 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:21.275+0000 7f0020fe1640 20 reqs_thread_entry: start 2024-06-04T16:13:21.277 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:21.275+0000 7f0173331800 20 init_complete bucket index max shards: 11 2024-06-04T16:13:21.277 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:21.275+0000 7f0173331800 20 Filter name: none 2024-06-04T16:13:21.277 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:21.276+0000 7eff9a7fc640 20 reqs_thread_entry: start 2024-06-04T16:13:21.277 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:21.276+0000 7f0173331800 20 rados->read ofs=0 len=0 2024-06-04T16:13:21.278 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:21.276+0000 7f0173331800 20 rados_obj.operate() r=0 bl.length=197 2024-06-04T16:13:21.278 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:21.276+0000 7f0173331800 20 rados->read ofs=0 len=0 2024-06-04T16:13:21.278 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:21.277+0000 7f0173331800 20 rados_obj.operate() r=0 bl.length=411 2024-06-04T16:13:21.278 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:21.277+0000 7f0173331800 20 couldn't put binfo cache entry, might have raced with data changes 2024-06-04T16:13:21.278 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:21.277+0000 7f0173331800 20 rados->read ofs=0 len=0 2024-06-04T16:13:21.278 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:21.277+0000 7f0173331800 20 rados_obj.operate() r=0 bl.length=197 2024-06-04T16:13:21.278 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:21.277+0000 7f0173331800 20 rados->read ofs=0 len=0 2024-06-04T16:13:21.279 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:21.277+0000 7f0173331800 20 rados_obj.operate() r=0 bl.length=411 2024-06-04T16:13:21.279 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:21.277+0000 7f0173331800 20 couldn't put binfo cache entry, might have raced with data changes 2024-06-04T16:13:21.280 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:21.279+0000 7f0021fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-06-04T16:13:21.282 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:21.281+0000 7f0173331800 20 remove_watcher() i=0 2024-06-04T16:13:21.282 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:21.281+0000 7f0173331800 2 removed watcher, disabling cache 2024-06-04T16:13:21.283 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:21.282+0000 7f0173331800 20 remove_watcher() i=1 2024-06-04T16:13:21.284 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:21.283+0000 7f0173331800 20 remove_watcher() i=2 2024-06-04T16:13:21.285 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:21.284+0000 7f0173331800 20 remove_watcher() i=3 2024-06-04T16:13:21.286 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:21.286+0000 7f0173331800 20 remove_watcher() i=4 2024-06-04T16:13:21.287 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:21.287+0000 7f0173331800 20 remove_watcher() i=5 2024-06-04T16:13:21.289 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:21.288+0000 7f0173331800 20 remove_watcher() i=6 2024-06-04T16:13:21.290 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:21.289+0000 7f0173331800 20 remove_watcher() i=7 2024-06-04T16:13:21.300 INFO:tasks.workunit.client.0.smithi144.stderr: 2024-06-04T16:13:21.300 INFO:tasks.workunit.client.0.smithi144.stderr:BUCKET_STATS: 2024-06-04T16:13:21.300 INFO:tasks.workunit.client.0.smithi144.stderr:bucket: abort-at-commit-target-layout id: be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.26 num_objects: 19 size_kb: 1 num_shards: 12 2024-06-04T16:13:21.300 INFO:tasks.workunit.client.0.smithi144.stderr: 2024-06-04T16:13:21.302 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:13:21.302 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:13:21.306 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:13:21.306 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:13:21.349 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:13:21.349 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:13:21.377 INFO:tasks.workunit.client.0.smithi144.stderr:TEST: reshard bucket with EIO injected at do_reshard 2024-06-04T16:13:21.378 INFO:tasks.workunit.client.0.smithi144.stderr: 2024-06-04T16:13:21.379 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:13:21.379 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:13:21.389 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:13:21.390 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:13:21.433 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:13:21.433 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:13:21.440 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:13:21.440 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:13:21.446 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:13:21.446 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:13:21.453 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:13:21.453 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:13:21.459 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:13:21.459 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:13:21.467 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:13:21.467 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:13:21.473 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:13:21.473 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:13:21.480 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:13:21.480 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:13:21.486 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:13:21.486 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:13:21.493 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:13:21.493 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:13:21.499 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:13:21.499 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:13:21.505 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:13:21.505 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:13:21.512 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:13:21.512 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:13:21.519 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:13:21.519 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:13:21.525 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:13:21.525 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:13:21.532 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:13:21.532 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:13:21.538 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:13:21.538 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:13:21.544 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:13:21.545 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:13:21.552 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:13:21.552 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:13:21.559 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:13:21.559 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:13:21.566 INFO:tasks.workunit.client.0.smithi144.stderr:radosgw-admin bucket stats --bucket error-at-do-reshard 2024-06-04T16:13:21.594 INFO:tasks.workunit.client.0.smithi144.stderr:ignoring --setuser ceph since I am not root 2024-06-04T16:13:21.594 INFO:tasks.workunit.client.0.smithi144.stderr:ignoring --setgroup ceph since I am not root 2024-06-04T16:13:21.630 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:21.629+0000 7f2d00d19800 20 rados->read ofs=0 len=0 2024-06-04T16:13:21.632 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:21.631+0000 7f2d00d19800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:13:21.632 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:21.631+0000 7f2d00d19800 20 realm 2024-06-04T16:13:21.632 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:21.631+0000 7f2d00d19800 20 rados->read ofs=0 len=0 2024-06-04T16:13:21.632 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:21.631+0000 7f2d00d19800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:13:21.633 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:21.631+0000 7f2d00d19800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-06-04T16:13:21.633 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:21.631+0000 7f2d00d19800 20 rados->read ofs=0 len=0 2024-06-04T16:13:21.633 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:21.631+0000 7f2d00d19800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:13:21.633 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:21.631+0000 7f2d00d19800 20 rados->read ofs=0 len=0 2024-06-04T16:13:21.633 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:21.632+0000 7f2d00d19800 20 rados_obj.operate() r=0 bl.length=46 2024-06-04T16:13:21.633 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:21.632+0000 7f2d00d19800 20 rados->read ofs=0 len=0 2024-06-04T16:13:21.634 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:21.633+0000 7f2d00d19800 20 rados_obj.operate() r=0 bl.length=1139 2024-06-04T16:13:21.634 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:21.633+0000 7f2d00d19800 20 searching for the correct realm 2024-06-04T16:13:21.635 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:21.635+0000 7f2cfe00d640 0 -- 172.21.15.144:0/2142246698 >> [v2:172.21.15.144:6816/2358575268,v1:172.21.15.144:6817/2358575268] conn(0x563c4adae4e0 msgr2=0x563c4adb08d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-06-04T16:13:21.638 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:21.637+0000 7f2cfe00d640 0 -- 172.21.15.144:0/2142246698 >> [v2:172.21.15.177:6808/2618477608,v1:172.21.15.177:6809/2618477608] conn(0x7f2cf406e460 msgr2=0x7f2cf409a280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-06-04T16:13:21.845 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:21.844+0000 7f2d00d19800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-06-04T16:13:21.845 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:21.844+0000 7f2d00d19800 20 RGWRados::pool_iterate: got zone_info.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767 2024-06-04T16:13:21.845 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:21.844+0000 7f2d00d19800 20 RGWRados::pool_iterate: got default.zone. 2024-06-04T16:13:21.845 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:21.844+0000 7f2d00d19800 20 RGWRados::pool_iterate: got zonegroup_info.abb22408-c332-4e28-8f7a-ff254ea2fed2 2024-06-04T16:13:21.845 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:21.844+0000 7f2d00d19800 20 RGWRados::pool_iterate: got zone_names.default 2024-06-04T16:13:21.845 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:21.844+0000 7f2d00d19800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-06-04T16:13:21.845 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:21.844+0000 7f2d00d19800 20 rados->read ofs=0 len=0 2024-06-04T16:13:21.846 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:21.844+0000 7f2d00d19800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:13:21.846 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:21.844+0000 7f2d00d19800 20 rados->read ofs=0 len=0 2024-06-04T16:13:21.846 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:21.844+0000 7f2d00d19800 20 rados_obj.operate() r=0 bl.length=46 2024-06-04T16:13:21.846 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:21.844+0000 7f2d00d19800 20 rados->read ofs=0 len=0 2024-06-04T16:13:21.847 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:21.844+0000 7f2d00d19800 20 rados_obj.operate() r=0 bl.length=470 2024-06-04T16:13:21.847 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:21.844+0000 7f2d00d19800 20 zone default found 2024-06-04T16:13:21.847 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:21.844+0000 7f2d00d19800 4 Realm: () 2024-06-04T16:13:21.847 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:21.844+0000 7f2d00d19800 4 ZoneGroup: default (abb22408-c332-4e28-8f7a-ff254ea2fed2) 2024-06-04T16:13:21.847 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:21.844+0000 7f2d00d19800 4 Zone: default (be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767) 2024-06-04T16:13:21.847 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:21.844+0000 7f2d00d19800 10 cannot find current period zonegroup using local zonegroup configuration 2024-06-04T16:13:21.847 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:21.844+0000 7f2d00d19800 20 zonegroup default 2024-06-04T16:13:21.847 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:21.844+0000 7f2d00d19800 20 rados->read ofs=0 len=0 2024-06-04T16:13:21.847 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:21.845+0000 7f2d00d19800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:13:21.848 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:21.845+0000 7f2d00d19800 20 rados->read ofs=0 len=0 2024-06-04T16:13:21.848 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:21.845+0000 7f2d00d19800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:13:21.848 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:21.845+0000 7f2d00d19800 20 rados->read ofs=0 len=0 2024-06-04T16:13:21.848 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:21.845+0000 7f2d00d19800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:13:21.848 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:21.845+0000 7f2d00d19800 20 started sync module instance, tier type = 2024-06-04T16:13:21.848 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:21.845+0000 7f2d00d19800 20 started zone id=be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767 (name=default) with tier type = 2024-06-04T16:13:21.855 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:21.855+0000 7f2d00d19800 20 add_watcher() i=0 2024-06-04T16:13:21.855 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:21.855+0000 7f2d00d19800 20 add_watcher() i=1 2024-06-04T16:13:21.856 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:21.855+0000 7f2d00d19800 20 add_watcher() i=2 2024-06-04T16:13:21.856 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:21.855+0000 7f2d00d19800 20 add_watcher() i=3 2024-06-04T16:13:21.856 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:21.855+0000 7f2d00d19800 20 add_watcher() i=4 2024-06-04T16:13:21.856 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:21.855+0000 7f2d00d19800 20 add_watcher() i=5 2024-06-04T16:13:21.856 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:21.855+0000 7f2d00d19800 20 add_watcher() i=6 2024-06-04T16:13:21.856 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:21.856+0000 7f2d00d19800 20 add_watcher() i=7 2024-06-04T16:13:21.856 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:21.856+0000 7f2d00d19800 2 all 8 watchers are set, enabling cache 2024-06-04T16:13:21.859 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:21.857+0000 7f2bb57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-06-04T16:13:21.859 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:21.858+0000 7f2d00d19800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-06-04T16:13:21.859 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:21.858+0000 7f2d00d19800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-06-04T16:13:21.859 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:21.858+0000 7f2d00d19800 5 note: GC not initialized 2024-06-04T16:13:21.859 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:21.858+0000 7f2b2ffff640 20 reqs_thread_entry: start 2024-06-04T16:13:21.859 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:21.858+0000 7f2d00d19800 20 init_complete bucket index max shards: 11 2024-06-04T16:13:21.859 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:21.858+0000 7f2d00d19800 20 Filter name: none 2024-06-04T16:13:21.859 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:21.858+0000 7f2b2dffb640 20 reqs_thread_entry: start 2024-06-04T16:13:21.860 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:21.858+0000 7f2d00d19800 20 rados->read ofs=0 len=0 2024-06-04T16:13:21.860 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:21.859+0000 7f2d00d19800 20 rados_obj.operate() r=0 bl.length=187 2024-06-04T16:13:21.860 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:21.859+0000 7f2d00d19800 20 rados->read ofs=0 len=0 2024-06-04T16:13:21.860 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:21.859+0000 7f2d00d19800 20 rados_obj.operate() r=0 bl.length=401 2024-06-04T16:13:21.860 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:21.859+0000 7f2d00d19800 20 couldn't put binfo cache entry, might have raced with data changes 2024-06-04T16:13:21.860 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:21.859+0000 7f2d00d19800 20 rados->read ofs=0 len=0 2024-06-04T16:13:21.861 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:21.860+0000 7f2d00d19800 20 rados_obj.operate() r=0 bl.length=187 2024-06-04T16:13:21.861 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:21.860+0000 7f2d00d19800 20 rados->read ofs=0 len=0 2024-06-04T16:13:21.861 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:21.860+0000 7f2d00d19800 20 rados_obj.operate() r=0 bl.length=401 2024-06-04T16:13:21.861 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:21.860+0000 7f2d00d19800 20 couldn't put binfo cache entry, might have raced with data changes 2024-06-04T16:13:21.862 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:21.862+0000 7f2bb57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-06-04T16:13:21.865 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:21.864+0000 7f2d00d19800 20 remove_watcher() i=0 2024-06-04T16:13:21.865 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:21.864+0000 7f2d00d19800 2 removed watcher, disabling cache 2024-06-04T16:13:21.865 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:21.865+0000 7f2d00d19800 20 remove_watcher() i=1 2024-06-04T16:13:21.866 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:21.866+0000 7f2d00d19800 20 remove_watcher() i=2 2024-06-04T16:13:21.867 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:21.867+0000 7f2d00d19800 20 remove_watcher() i=3 2024-06-04T16:13:21.868 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:21.867+0000 7f2d00d19800 20 remove_watcher() i=4 2024-06-04T16:13:21.869 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:21.868+0000 7f2d00d19800 20 remove_watcher() i=5 2024-06-04T16:13:21.870 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:21.869+0000 7f2d00d19800 20 remove_watcher() i=6 2024-06-04T16:13:21.872 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:21.871+0000 7f2d00d19800 20 remove_watcher() i=7 2024-06-04T16:13:21.885 INFO:tasks.workunit.client.0.smithi144.stderr: 2024-06-04T16:13:21.886 INFO:tasks.workunit.client.0.smithi144.stderr:BUCKET_STATS: 2024-06-04T16:13:21.886 INFO:tasks.workunit.client.0.smithi144.stderr:bucket: error-at-do-reshard id: be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.27 num_objects: 20 size_kb: 1 num_shards: 11 2024-06-04T16:13:21.886 INFO:tasks.workunit.client.0.smithi144.stderr: 2024-06-04T16:13:21.886 INFO:tasks.workunit.client.0.smithi144.stderr:radosgw-admin bucket reshard --bucket error-at-do-reshard --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at do_reshard 2024-06-04T16:13:21.918 INFO:tasks.workunit.client.0.smithi144.stderr:ignoring --setuser ceph since I am not root 2024-06-04T16:13:21.918 INFO:tasks.workunit.client.0.smithi144.stderr:ignoring --setgroup ceph since I am not root 2024-06-04T16:13:22.156 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.155+0000 7fe26f52e800 20 rados->read ofs=0 len=0 2024-06-04T16:13:22.158 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.157+0000 7fe26f52e800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:13:22.158 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.157+0000 7fe26f52e800 20 realm 2024-06-04T16:13:22.159 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.157+0000 7fe26f52e800 20 rados->read ofs=0 len=0 2024-06-04T16:13:22.159 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.157+0000 7fe26f52e800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:13:22.159 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.157+0000 7fe26f52e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-06-04T16:13:22.159 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.157+0000 7fe26f52e800 20 rados->read ofs=0 len=0 2024-06-04T16:13:22.159 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.158+0000 7fe26f52e800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:13:22.159 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.158+0000 7fe26f52e800 20 rados->read ofs=0 len=0 2024-06-04T16:13:22.160 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.158+0000 7fe26f52e800 20 rados_obj.operate() r=0 bl.length=46 2024-06-04T16:13:22.160 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.158+0000 7fe26f52e800 20 rados->read ofs=0 len=0 2024-06-04T16:13:22.160 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.159+0000 7fe26f52e800 20 rados_obj.operate() r=0 bl.length=1139 2024-06-04T16:13:22.160 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.159+0000 7fe26f52e800 20 searching for the correct realm 2024-06-04T16:13:22.162 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.161+0000 7fe26ba5e640 0 -- 172.21.15.144:0/141597094 >> [v2:172.21.15.144:6800/1453747520,v1:172.21.15.144:6801/1453747520] conn(0x7fe26006d060 msgr2=0x7fe2600a0b90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-06-04T16:13:22.165 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.165+0000 7fe26ba5e640 0 -- 172.21.15.144:0/141597094 >> [v2:172.21.15.144:6824/166159729,v1:172.21.15.144:6825/166159729] conn(0x55d6c3c55830 msgr2=0x55d6c3c57c20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-06-04T16:13:22.171 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.169+0000 7fe26f52e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-06-04T16:13:22.171 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.169+0000 7fe26f52e800 20 RGWRados::pool_iterate: got zone_info.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767 2024-06-04T16:13:22.171 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.169+0000 7fe26f52e800 20 RGWRados::pool_iterate: got default.zone. 2024-06-04T16:13:22.171 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.169+0000 7fe26f52e800 20 RGWRados::pool_iterate: got zonegroup_info.abb22408-c332-4e28-8f7a-ff254ea2fed2 2024-06-04T16:13:22.171 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.169+0000 7fe26f52e800 20 RGWRados::pool_iterate: got zone_names.default 2024-06-04T16:13:22.171 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.169+0000 7fe26f52e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-06-04T16:13:22.171 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.169+0000 7fe26f52e800 20 rados->read ofs=0 len=0 2024-06-04T16:13:22.171 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.170+0000 7fe26f52e800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:13:22.171 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.170+0000 7fe26f52e800 20 rados->read ofs=0 len=0 2024-06-04T16:13:22.171 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.170+0000 7fe26f52e800 20 rados_obj.operate() r=0 bl.length=46 2024-06-04T16:13:22.171 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.170+0000 7fe26f52e800 20 rados->read ofs=0 len=0 2024-06-04T16:13:22.172 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.170+0000 7fe26f52e800 20 rados_obj.operate() r=0 bl.length=470 2024-06-04T16:13:22.172 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.170+0000 7fe26f52e800 20 zone default found 2024-06-04T16:13:22.173 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.170+0000 7fe26f52e800 4 Realm: () 2024-06-04T16:13:22.173 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.170+0000 7fe26f52e800 4 ZoneGroup: default (abb22408-c332-4e28-8f7a-ff254ea2fed2) 2024-06-04T16:13:22.173 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.170+0000 7fe26f52e800 4 Zone: default (be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767) 2024-06-04T16:13:22.173 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.170+0000 7fe26f52e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-06-04T16:13:22.173 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.170+0000 7fe26f52e800 20 zonegroup default 2024-06-04T16:13:22.173 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.170+0000 7fe26f52e800 20 rados->read ofs=0 len=0 2024-06-04T16:13:22.173 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.170+0000 7fe26f52e800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:13:22.173 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.170+0000 7fe26f52e800 20 rados->read ofs=0 len=0 2024-06-04T16:13:22.173 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.171+0000 7fe26f52e800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:13:22.173 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.171+0000 7fe26f52e800 20 rados->read ofs=0 len=0 2024-06-04T16:13:22.173 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.171+0000 7fe26f52e800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:13:22.173 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.171+0000 7fe26f52e800 20 started sync module instance, tier type = 2024-06-04T16:13:22.173 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.171+0000 7fe26f52e800 20 started zone id=be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767 (name=default) with tier type = 2024-06-04T16:13:22.181 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.180+0000 7fe26f52e800 20 add_watcher() i=0 2024-06-04T16:13:22.181 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.180+0000 7fe26f52e800 20 add_watcher() i=1 2024-06-04T16:13:22.181 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.180+0000 7fe26f52e800 20 add_watcher() i=2 2024-06-04T16:13:22.181 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.180+0000 7fe26f52e800 20 add_watcher() i=3 2024-06-04T16:13:22.181 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.180+0000 7fe26f52e800 20 add_watcher() i=4 2024-06-04T16:13:22.181 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.180+0000 7fe26f52e800 20 add_watcher() i=5 2024-06-04T16:13:22.181 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.180+0000 7fe26f52e800 20 add_watcher() i=6 2024-06-04T16:13:22.181 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.181+0000 7fe26f52e800 20 add_watcher() i=7 2024-06-04T16:13:22.181 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.181+0000 7fe26f52e800 2 all 8 watchers are set, enabling cache 2024-06-04T16:13:22.184 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.183+0000 7fe121fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-06-04T16:13:22.184 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.183+0000 7fe26f52e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-06-04T16:13:22.184 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.183+0000 7fe26f52e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-06-04T16:13:22.184 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.183+0000 7fe26f52e800 5 note: GC not initialized 2024-06-04T16:13:22.184 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.183+0000 7fe120fe1640 20 reqs_thread_entry: start 2024-06-04T16:13:22.185 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.183+0000 7fe26f52e800 20 init_complete bucket index max shards: 11 2024-06-04T16:13:22.185 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.183+0000 7fe26f52e800 20 Filter name: none 2024-06-04T16:13:22.185 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.183+0000 7fe09a7fc640 20 reqs_thread_entry: start 2024-06-04T16:13:22.185 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.183+0000 7fe26f52e800 10 cache get: name=default.rgw.meta+root+error-at-do-reshard : miss 2024-06-04T16:13:22.185 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.183+0000 7fe26f52e800 20 rados->read ofs=0 len=0 2024-06-04T16:13:22.185 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.184+0000 7fe26f52e800 20 rados_obj.operate() r=0 bl.length=187 2024-06-04T16:13:22.186 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.184+0000 7fe26f52e800 10 cache put: name=default.rgw.meta+root+error-at-do-reshard info.flags=0x11 2024-06-04T16:13:22.186 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.184+0000 7fe26f52e800 10 adding default.rgw.meta+root+error-at-do-reshard to cache LRU end 2024-06-04T16:13:22.186 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.184+0000 7fe26f52e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.27 : miss 2024-06-04T16:13:22.186 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.184+0000 7fe26f52e800 20 rados->read ofs=0 len=0 2024-06-04T16:13:22.186 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.184+0000 7fe26f52e800 20 rados_obj.operate() r=0 bl.length=401 2024-06-04T16:13:22.186 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.184+0000 7fe26f52e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.27 info.flags=0x17 2024-06-04T16:13:22.186 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.184+0000 7fe26f52e800 10 adding default.rgw.meta+root+.bucket.meta.error-at-do-reshard:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.27 to cache LRU end 2024-06-04T16:13:22.186 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.185+0000 7fe26f52e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-06-04T16:13:22.186 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.185+0000 7fe26f52e800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-06-04T16:13:22.186 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.185+0000 7fe26f52e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.27 2024-06-04T16:13:22.190 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.189+0000 7fe26f52e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.27 info.flags=0x17 2024-06-04T16:13:22.191 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.189+0000 7fe26f52e800 10 moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.27 to cache LRU end 2024-06-04T16:13:22.191 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.189+0000 7fe26f52e800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-06-04T16:13:22.191 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.189+0000 7fe26f52e800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-do-reshard:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.27, ofs0, ns] 2024-06-04T16:13:22.191 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.190+0000 7fe14e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1078036791420 cookie 94380895884624 notifier 6840 bl.length()=903 2024-06-04T16:13:22.191 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.190+0000 7fe14e7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.27 info.flags=0x17 2024-06-04T16:13:22.191 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.190+0000 7fe14e7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.27 to cache LRU end 2024-06-04T16:13:22.191 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.190+0000 7fe14e7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-06-04T16:13:22.191 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.190+0000 7fe26f52e800 20 handle_bi_update(): bucket=:error-at-do-reshard[be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.27]): orig_sources= new_sources= 2024-06-04T16:13:22.191 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.190+0000 7fe26f52e800 20 handle_bi_update(): bucket=:error-at-do-reshard[be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.27]): potential sources added=[] removed=[] 2024-06-04T16:13:22.192 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.190+0000 7fe26f52e800 20 handle_bi_update(): bucket=:error-at-do-reshard[be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.27]): orig_dests= new_dests= 2024-06-04T16:13:22.192 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.190+0000 7fe26f52e800 20 handle_bi_update(): bucket=:error-at-do-reshard[be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.27]): potential dests added=[] removed=[] 2024-06-04T16:13:22.194 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.193+0000 7fe26f52e800 -1 Injecting error=-5 at location=do_reshard 2024-06-04T16:13:22.198 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.197+0000 7fe26f52e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.27 : hit (requested=0x17, cached=0x17) 2024-06-04T16:13:22.198 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.197+0000 7fe26f52e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.27 2024-06-04T16:13:22.200 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.198+0000 7fe26f52e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.27 info.flags=0x17 2024-06-04T16:13:22.200 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.198+0000 7fe26f52e800 10 moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.27 to cache LRU end 2024-06-04T16:13:22.200 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.198+0000 7fe26f52e800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-06-04T16:13:22.200 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.198+0000 7fe26f52e800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-do-reshard:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.27, ofs0, ns] 2024-06-04T16:13:22.200 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.198+0000 7fe14e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1078036791421 cookie 94380895884624 notifier 6840 bl.length()=871 2024-06-04T16:13:22.201 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.199+0000 7fe14e7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.27 info.flags=0x17 2024-06-04T16:13:22.201 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.199+0000 7fe14e7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.27 to cache LRU end 2024-06-04T16:13:22.201 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.199+0000 7fe14e7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-06-04T16:13:22.201 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.199+0000 7fe26f52e800 20 handle_bi_update(): bucket=:error-at-do-reshard[be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.27]): orig_sources= new_sources= 2024-06-04T16:13:22.201 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.199+0000 7fe26f52e800 20 handle_bi_update(): bucket=:error-at-do-reshard[be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.27]): potential sources added=[] removed=[] 2024-06-04T16:13:22.201 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.199+0000 7fe26f52e800 20 handle_bi_update(): bucket=:error-at-do-reshard[be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.27]): orig_dests= new_dests= 2024-06-04T16:13:22.201 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.199+0000 7fe26f52e800 20 handle_bi_update(): bucket=:error-at-do-reshard[be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.27]): potential dests added=[] removed=[] 2024-06-04T16:13:22.201 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.199+0000 7fe26f52e800 1 execute INFO: reshard of bucket "error-at-do-reshard" canceled due to errors 2024-06-04T16:13:22.201 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.201+0000 7fe121fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-06-04T16:13:22.204 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.203+0000 7fe26f52e800 20 remove_watcher() i=0 2024-06-04T16:13:22.204 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.203+0000 7fe26f52e800 2 removed watcher, disabling cache 2024-06-04T16:13:22.205 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.205+0000 7fe26f52e800 20 remove_watcher() i=1 2024-06-04T16:13:22.206 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.206+0000 7fe26f52e800 20 remove_watcher() i=2 2024-06-04T16:13:22.207 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.207+0000 7fe26f52e800 20 remove_watcher() i=3 2024-06-04T16:13:22.209 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.208+0000 7fe26f52e800 20 remove_watcher() i=4 2024-06-04T16:13:22.210 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.209+0000 7fe26f52e800 20 remove_watcher() i=5 2024-06-04T16:13:22.211 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.210+0000 7fe26f52e800 20 remove_watcher() i=6 2024-06-04T16:13:22.212 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.211+0000 7fe26f52e800 20 remove_watcher() i=7 2024-06-04T16:13:22.224 INFO:tasks.workunit.client.0.smithi144.stderr:radosgw-admin bucket stats --bucket error-at-do-reshard 2024-06-04T16:13:22.251 INFO:tasks.workunit.client.0.smithi144.stderr:ignoring --setuser ceph since I am not root 2024-06-04T16:13:22.252 INFO:tasks.workunit.client.0.smithi144.stderr:ignoring --setgroup ceph since I am not root 2024-06-04T16:13:22.288 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.287+0000 7fc96152e800 20 rados->read ofs=0 len=0 2024-06-04T16:13:22.290 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.289+0000 7fc96152e800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:13:22.290 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.289+0000 7fc96152e800 20 realm 2024-06-04T16:13:22.290 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.289+0000 7fc96152e800 20 rados->read ofs=0 len=0 2024-06-04T16:13:22.290 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.289+0000 7fc96152e800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:13:22.290 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.289+0000 7fc96152e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-06-04T16:13:22.291 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.289+0000 7fc96152e800 20 rados->read ofs=0 len=0 2024-06-04T16:13:22.291 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.289+0000 7fc96152e800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:13:22.291 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.289+0000 7fc96152e800 20 rados->read ofs=0 len=0 2024-06-04T16:13:22.291 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.290+0000 7fc96152e800 20 rados_obj.operate() r=0 bl.length=46 2024-06-04T16:13:22.292 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.290+0000 7fc96152e800 20 rados->read ofs=0 len=0 2024-06-04T16:13:22.292 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.291+0000 7fc96152e800 20 rados_obj.operate() r=0 bl.length=1139 2024-06-04T16:13:22.292 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.291+0000 7fc96152e800 20 searching for the correct realm 2024-06-04T16:13:22.294 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.293+0000 7fc95da65640 0 -- 172.21.15.144:0/670510922 >> [v2:172.21.15.144:6800/1453747520,v1:172.21.15.144:6801/1453747520] conn(0x7fc94804d440 msgr2=0x7fc94804d8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-06-04T16:13:22.498 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.497+0000 7fc95da65640 0 -- 172.21.15.144:0/670510922 >> [v2:172.21.15.144:6824/166159729,v1:172.21.15.144:6825/166159729] conn(0x5635c4bfd4c0 msgr2=0x5635c4bff8b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-06-04T16:13:22.506 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.503+0000 7fc96152e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-06-04T16:13:22.506 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.503+0000 7fc96152e800 20 RGWRados::pool_iterate: got zone_info.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767 2024-06-04T16:13:22.506 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.503+0000 7fc96152e800 20 RGWRados::pool_iterate: got default.zone. 2024-06-04T16:13:22.506 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.503+0000 7fc96152e800 20 RGWRados::pool_iterate: got zonegroup_info.abb22408-c332-4e28-8f7a-ff254ea2fed2 2024-06-04T16:13:22.506 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.503+0000 7fc96152e800 20 RGWRados::pool_iterate: got zone_names.default 2024-06-04T16:13:22.506 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.503+0000 7fc96152e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-06-04T16:13:22.506 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.503+0000 7fc96152e800 20 rados->read ofs=0 len=0 2024-06-04T16:13:22.506 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.503+0000 7fc96152e800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:13:22.506 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.503+0000 7fc96152e800 20 rados->read ofs=0 len=0 2024-06-04T16:13:22.506 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.503+0000 7fc96152e800 20 rados_obj.operate() r=0 bl.length=46 2024-06-04T16:13:22.506 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.503+0000 7fc96152e800 20 rados->read ofs=0 len=0 2024-06-04T16:13:22.507 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.504+0000 7fc96152e800 20 rados_obj.operate() r=0 bl.length=470 2024-06-04T16:13:22.507 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.504+0000 7fc96152e800 20 zone default found 2024-06-04T16:13:22.507 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.504+0000 7fc96152e800 4 Realm: () 2024-06-04T16:13:22.507 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.504+0000 7fc96152e800 4 ZoneGroup: default (abb22408-c332-4e28-8f7a-ff254ea2fed2) 2024-06-04T16:13:22.507 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.504+0000 7fc96152e800 4 Zone: default (be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767) 2024-06-04T16:13:22.507 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.504+0000 7fc96152e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-06-04T16:13:22.507 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.504+0000 7fc96152e800 20 zonegroup default 2024-06-04T16:13:22.507 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.504+0000 7fc96152e800 20 rados->read ofs=0 len=0 2024-06-04T16:13:22.507 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.504+0000 7fc96152e800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:13:22.507 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.504+0000 7fc96152e800 20 rados->read ofs=0 len=0 2024-06-04T16:13:22.507 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.504+0000 7fc96152e800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:13:22.507 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.504+0000 7fc96152e800 20 rados->read ofs=0 len=0 2024-06-04T16:13:22.507 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.505+0000 7fc96152e800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:13:22.507 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.505+0000 7fc96152e800 20 started sync module instance, tier type = 2024-06-04T16:13:22.507 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.505+0000 7fc96152e800 20 started zone id=be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767 (name=default) with tier type = 2024-06-04T16:13:22.514 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.513+0000 7fc96152e800 20 add_watcher() i=0 2024-06-04T16:13:22.514 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.513+0000 7fc96152e800 20 add_watcher() i=1 2024-06-04T16:13:22.514 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.513+0000 7fc96152e800 20 add_watcher() i=2 2024-06-04T16:13:22.515 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.513+0000 7fc96152e800 20 add_watcher() i=3 2024-06-04T16:13:22.515 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.513+0000 7fc96152e800 20 add_watcher() i=4 2024-06-04T16:13:22.515 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.513+0000 7fc96152e800 20 add_watcher() i=5 2024-06-04T16:13:22.515 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.513+0000 7fc96152e800 20 add_watcher() i=6 2024-06-04T16:13:22.515 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.514+0000 7fc96152e800 20 add_watcher() i=7 2024-06-04T16:13:22.515 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.514+0000 7fc96152e800 2 all 8 watchers are set, enabling cache 2024-06-04T16:13:22.516 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.516+0000 7fc8137e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-06-04T16:13:22.517 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.516+0000 7fc96152e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-06-04T16:13:22.518 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.516+0000 7fc96152e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-06-04T16:13:22.518 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.516+0000 7fc96152e800 5 note: GC not initialized 2024-06-04T16:13:22.518 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.516+0000 7fc8127e4640 20 reqs_thread_entry: start 2024-06-04T16:13:22.518 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.516+0000 7fc96152e800 20 init_complete bucket index max shards: 11 2024-06-04T16:13:22.518 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.516+0000 7fc96152e800 20 Filter name: none 2024-06-04T16:13:22.518 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.517+0000 7fc783fff640 20 reqs_thread_entry: start 2024-06-04T16:13:22.518 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.517+0000 7fc96152e800 20 rados->read ofs=0 len=0 2024-06-04T16:13:22.519 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.517+0000 7fc96152e800 20 rados_obj.operate() r=0 bl.length=187 2024-06-04T16:13:22.519 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.517+0000 7fc96152e800 20 rados->read ofs=0 len=0 2024-06-04T16:13:22.519 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.518+0000 7fc96152e800 20 rados_obj.operate() r=0 bl.length=401 2024-06-04T16:13:22.520 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.518+0000 7fc96152e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-06-04T16:13:22.520 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.518+0000 7fc96152e800 20 rados->read ofs=0 len=0 2024-06-04T16:13:22.520 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.518+0000 7fc96152e800 20 rados_obj.operate() r=0 bl.length=187 2024-06-04T16:13:22.520 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.518+0000 7fc96152e800 20 rados->read ofs=0 len=0 2024-06-04T16:13:22.520 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.518+0000 7fc96152e800 20 rados_obj.operate() r=0 bl.length=401 2024-06-04T16:13:22.520 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.518+0000 7fc96152e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-06-04T16:13:22.521 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.520+0000 7fc8137e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-06-04T16:13:22.523 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.522+0000 7fc96152e800 20 remove_watcher() i=0 2024-06-04T16:13:22.523 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.522+0000 7fc96152e800 2 removed watcher, disabling cache 2024-06-04T16:13:22.523 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.523+0000 7fc96152e800 20 remove_watcher() i=1 2024-06-04T16:13:22.524 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.524+0000 7fc96152e800 20 remove_watcher() i=2 2024-06-04T16:13:22.525 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.525+0000 7fc96152e800 20 remove_watcher() i=3 2024-06-04T16:13:22.526 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.526+0000 7fc96152e800 20 remove_watcher() i=4 2024-06-04T16:13:22.527 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.527+0000 7fc96152e800 20 remove_watcher() i=5 2024-06-04T16:13:22.528 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.527+0000 7fc96152e800 20 remove_watcher() i=6 2024-06-04T16:13:22.529 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.528+0000 7fc96152e800 20 remove_watcher() i=7 2024-06-04T16:13:22.540 INFO:tasks.workunit.client.0.smithi144.stderr: 2024-06-04T16:13:22.540 INFO:tasks.workunit.client.0.smithi144.stderr:BUCKET_STATS: 2024-06-04T16:13:22.540 INFO:tasks.workunit.client.0.smithi144.stderr:bucket: error-at-do-reshard id: be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.27 num_objects: 20 size_kb: 1 num_shards: 11 2024-06-04T16:13:22.540 INFO:tasks.workunit.client.0.smithi144.stderr: 2024-06-04T16:13:22.542 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:13:22.542 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:13:22.550 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:13:22.550 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:13:22.594 INFO:tasks.workunit.client.0.smithi144.stderr:radosgw-admin bucket reshard --bucket error-at-do-reshard --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-06-04T16:13:22.624 INFO:tasks.workunit.client.0.smithi144.stderr:ignoring --setuser ceph since I am not root 2024-06-04T16:13:22.624 INFO:tasks.workunit.client.0.smithi144.stderr:ignoring --setgroup ceph since I am not root 2024-06-04T16:13:22.662 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.661+0000 7f6f2eb33800 20 rados->read ofs=0 len=0 2024-06-04T16:13:22.663 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.662+0000 7f6f2eb33800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:13:22.663 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.662+0000 7f6f2eb33800 20 realm 2024-06-04T16:13:22.664 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.662+0000 7f6f2eb33800 20 rados->read ofs=0 len=0 2024-06-04T16:13:22.664 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.662+0000 7f6f2eb33800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:13:22.664 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.662+0000 7f6f2eb33800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-06-04T16:13:22.664 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.662+0000 7f6f2eb33800 20 rados->read ofs=0 len=0 2024-06-04T16:13:22.664 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.663+0000 7f6f2eb33800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:13:22.664 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.663+0000 7f6f2eb33800 20 rados->read ofs=0 len=0 2024-06-04T16:13:22.665 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.663+0000 7f6f2eb33800 20 rados_obj.operate() r=0 bl.length=46 2024-06-04T16:13:22.665 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.663+0000 7f6f2eb33800 20 rados->read ofs=0 len=0 2024-06-04T16:13:22.665 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.664+0000 7f6f2eb33800 20 rados_obj.operate() r=0 bl.length=1139 2024-06-04T16:13:22.665 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.664+0000 7f6f2eb33800 20 searching for the correct realm 2024-06-04T16:13:22.666 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.665+0000 7f6f29fea640 0 -- 172.21.15.144:0/2837403921 >> [v2:172.21.15.144:6808/86532035,v1:172.21.15.144:6809/86532035] conn(0x7f6f1c068070 msgr2=0x7f6f1c0a00b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-06-04T16:13:22.870 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.869+0000 7f6f2a7eb640 0 -- 172.21.15.144:0/2837403921 >> [v2:172.21.15.177:6824/800067290,v1:172.21.15.177:6825/800067290] conn(0x555dabf08ee0 msgr2=0x555dabf0b380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-06-04T16:13:22.876 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.875+0000 7f6f2eb33800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-06-04T16:13:22.876 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.875+0000 7f6f2eb33800 20 RGWRados::pool_iterate: got zone_info.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767 2024-06-04T16:13:22.876 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.875+0000 7f6f2eb33800 20 RGWRados::pool_iterate: got default.zone. 2024-06-04T16:13:22.876 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.875+0000 7f6f2eb33800 20 RGWRados::pool_iterate: got zonegroup_info.abb22408-c332-4e28-8f7a-ff254ea2fed2 2024-06-04T16:13:22.876 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.875+0000 7f6f2eb33800 20 RGWRados::pool_iterate: got zone_names.default 2024-06-04T16:13:22.877 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.875+0000 7f6f2eb33800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-06-04T16:13:22.877 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.875+0000 7f6f2eb33800 20 rados->read ofs=0 len=0 2024-06-04T16:13:22.877 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.875+0000 7f6f2eb33800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:13:22.877 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.875+0000 7f6f2eb33800 20 rados->read ofs=0 len=0 2024-06-04T16:13:22.877 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.875+0000 7f6f2eb33800 20 rados_obj.operate() r=0 bl.length=46 2024-06-04T16:13:22.877 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.875+0000 7f6f2eb33800 20 rados->read ofs=0 len=0 2024-06-04T16:13:22.878 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.876+0000 7f6f2eb33800 20 rados_obj.operate() r=0 bl.length=470 2024-06-04T16:13:22.878 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.876+0000 7f6f2eb33800 20 zone default found 2024-06-04T16:13:22.878 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.876+0000 7f6f2eb33800 4 Realm: () 2024-06-04T16:13:22.878 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.876+0000 7f6f2eb33800 4 ZoneGroup: default (abb22408-c332-4e28-8f7a-ff254ea2fed2) 2024-06-04T16:13:22.878 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.876+0000 7f6f2eb33800 4 Zone: default (be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767) 2024-06-04T16:13:22.878 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.876+0000 7f6f2eb33800 10 cannot find current period zonegroup using local zonegroup configuration 2024-06-04T16:13:22.879 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.876+0000 7f6f2eb33800 20 zonegroup default 2024-06-04T16:13:22.879 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.876+0000 7f6f2eb33800 20 rados->read ofs=0 len=0 2024-06-04T16:13:22.879 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.876+0000 7f6f2eb33800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:13:22.879 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.876+0000 7f6f2eb33800 20 rados->read ofs=0 len=0 2024-06-04T16:13:22.879 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.876+0000 7f6f2eb33800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:13:22.879 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.876+0000 7f6f2eb33800 20 rados->read ofs=0 len=0 2024-06-04T16:13:22.879 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.877+0000 7f6f2eb33800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:13:22.879 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.877+0000 7f6f2eb33800 20 started sync module instance, tier type = 2024-06-04T16:13:22.879 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.877+0000 7f6f2eb33800 20 started zone id=be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767 (name=default) with tier type = 2024-06-04T16:13:22.888 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.887+0000 7f6f2eb33800 20 add_watcher() i=0 2024-06-04T16:13:22.888 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.887+0000 7f6f2eb33800 20 add_watcher() i=1 2024-06-04T16:13:22.888 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.887+0000 7f6f2eb33800 20 add_watcher() i=2 2024-06-04T16:13:22.888 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.887+0000 7f6f2eb33800 20 add_watcher() i=3 2024-06-04T16:13:22.888 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.887+0000 7f6f2eb33800 20 add_watcher() i=4 2024-06-04T16:13:22.888 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.887+0000 7f6f2eb33800 20 add_watcher() i=5 2024-06-04T16:13:22.889 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.888+0000 7f6f2eb33800 20 add_watcher() i=6 2024-06-04T16:13:22.890 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.889+0000 7f6f2eb33800 20 add_watcher() i=7 2024-06-04T16:13:22.890 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.889+0000 7f6f2eb33800 2 all 8 watchers are set, enabling cache 2024-06-04T16:13:22.891 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.891+0000 7f6de0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-06-04T16:13:22.892 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.891+0000 7f6f2eb33800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-06-04T16:13:22.892 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.891+0000 7f6f2eb33800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-06-04T16:13:22.892 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.891+0000 7f6f2eb33800 5 note: GC not initialized 2024-06-04T16:13:22.892 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.891+0000 7f6d5b7fe640 20 reqs_thread_entry: start 2024-06-04T16:13:22.893 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.891+0000 7f6f2eb33800 20 init_complete bucket index max shards: 11 2024-06-04T16:13:22.893 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.891+0000 7f6f2eb33800 20 Filter name: none 2024-06-04T16:13:22.893 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.892+0000 7f6d597fa640 20 reqs_thread_entry: start 2024-06-04T16:13:22.893 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.892+0000 7f6f2eb33800 10 cache get: name=default.rgw.meta+root+error-at-do-reshard : miss 2024-06-04T16:13:22.893 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.892+0000 7f6f2eb33800 20 rados->read ofs=0 len=0 2024-06-04T16:13:22.894 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.892+0000 7f6f2eb33800 20 rados_obj.operate() r=0 bl.length=187 2024-06-04T16:13:22.894 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.892+0000 7f6f2eb33800 10 cache put: name=default.rgw.meta+root+error-at-do-reshard info.flags=0x11 2024-06-04T16:13:22.894 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.892+0000 7f6f2eb33800 10 adding default.rgw.meta+root+error-at-do-reshard to cache LRU end 2024-06-04T16:13:22.894 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.892+0000 7f6f2eb33800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.27 : miss 2024-06-04T16:13:22.894 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.892+0000 7f6f2eb33800 20 rados->read ofs=0 len=0 2024-06-04T16:13:22.894 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.893+0000 7f6f2eb33800 20 rados_obj.operate() r=0 bl.length=401 2024-06-04T16:13:22.894 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.893+0000 7f6f2eb33800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.27 info.flags=0x17 2024-06-04T16:13:22.894 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.893+0000 7f6f2eb33800 10 adding default.rgw.meta+root+.bucket.meta.error-at-do-reshard:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.27 to cache LRU end 2024-06-04T16:13:22.894 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.893+0000 7f6f2eb33800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-06-04T16:13:22.894 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.893+0000 7f6f2eb33800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-06-04T16:13:22.894 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.893+0000 7f6f2eb33800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.27 2024-06-04T16:13:22.899 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.898+0000 7f6f2eb33800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.27 info.flags=0x17 2024-06-04T16:13:22.899 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.898+0000 7f6f2eb33800 10 moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.27 to cache LRU end 2024-06-04T16:13:22.899 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.898+0000 7f6f2eb33800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-06-04T16:13:22.899 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.898+0000 7f6f2eb33800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-do-reshard:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.27, ofs0, ns] 2024-06-04T16:13:22.899 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.898+0000 7f6e0d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1078036791422 cookie 93860805054000 notifier 6515 bl.length()=903 2024-06-04T16:13:22.899 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.898+0000 7f6e0d7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.27 info.flags=0x17 2024-06-04T16:13:22.899 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.898+0000 7f6e0d7fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.27 to cache LRU end 2024-06-04T16:13:22.899 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.898+0000 7f6e0d7fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-06-04T16:13:22.900 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.899+0000 7f6f2eb33800 20 handle_bi_update(): bucket=:error-at-do-reshard[be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.27]): orig_sources= new_sources= 2024-06-04T16:13:22.900 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.899+0000 7f6f2eb33800 20 handle_bi_update(): bucket=:error-at-do-reshard[be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.27]): potential sources added=[] removed=[] 2024-06-04T16:13:22.900 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.899+0000 7f6f2eb33800 20 handle_bi_update(): bucket=:error-at-do-reshard[be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.27]): orig_dests= new_dests= 2024-06-04T16:13:22.900 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.899+0000 7f6f2eb33800 20 handle_bi_update(): bucket=:error-at-do-reshard[be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.27]): potential dests added=[] removed=[] 2024-06-04T16:13:22.902 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.901+0000 7f6f2eb33800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.27.1.0 2024-06-04T16:13:22.902 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.901+0000 7f6f2eb33800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.27.1.0 2024-06-04T16:13:22.902 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.901+0000 7f6f2eb33800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.27.1.1 2024-06-04T16:13:22.903 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.901+0000 7f6f2eb33800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.27.1.1 2024-06-04T16:13:22.903 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.901+0000 7f6f2eb33800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.27.1.2 2024-06-04T16:13:22.903 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.901+0000 7f6f2eb33800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.27.1.2 2024-06-04T16:13:22.903 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.901+0000 7f6f2eb33800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.27.1.3 2024-06-04T16:13:22.903 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.901+0000 7f6f2eb33800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.27.1.3 2024-06-04T16:13:22.903 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.901+0000 7f6f2eb33800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.27.1.4 2024-06-04T16:13:22.903 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.901+0000 7f6f2eb33800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.27.1.4 2024-06-04T16:13:22.903 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.901+0000 7f6f2eb33800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.27.1.5 2024-06-04T16:13:22.903 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.901+0000 7f6f2eb33800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.27.1.5 2024-06-04T16:13:22.903 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.901+0000 7f6f2eb33800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.27.1.6 2024-06-04T16:13:22.903 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.901+0000 7f6f2eb33800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.27.1.6 2024-06-04T16:13:22.903 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.901+0000 7f6f2eb33800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.27.1.7 2024-06-04T16:13:22.903 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.901+0000 7f6f2eb33800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.27.1.7 2024-06-04T16:13:22.904 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.901+0000 7f6f2eb33800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.27.1.8 2024-06-04T16:13:22.904 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.901+0000 7f6f2eb33800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.27.1.8 2024-06-04T16:13:22.904 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.901+0000 7f6f2eb33800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.27.1.9 2024-06-04T16:13:22.904 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.901+0000 7f6f2eb33800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.27.1.9 2024-06-04T16:13:22.904 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.901+0000 7f6f2eb33800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.27.1.10 2024-06-04T16:13:22.904 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.901+0000 7f6f2eb33800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.27.1.10 2024-06-04T16:13:22.904 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.901+0000 7f6f2eb33800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.27.1.11 2024-06-04T16:13:22.904 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.901+0000 7f6f2eb33800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.27.1.11 2024-06-04T16:13:22.904 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.901+0000 7f6f2eb33800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.27.0 2024-06-04T16:13:22.904 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.901+0000 7f6f2eb33800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.27.1 2024-06-04T16:13:22.905 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.902+0000 7f6f2eb33800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.27.2 2024-06-04T16:13:22.905 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.902+0000 7f6f2eb33800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.27.3 2024-06-04T16:13:22.906 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.903+0000 7f6f2eb33800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.27.4 2024-06-04T16:13:22.906 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.903+0000 7f6f2eb33800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.27.5 2024-06-04T16:13:22.906 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.904+0000 7f6f2eb33800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.27.6 2024-06-04T16:13:22.906 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.904+0000 7f6f2eb33800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.27.7 2024-06-04T16:13:22.906 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.905+0000 7f6f2eb33800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.27.8 2024-06-04T16:13:22.906 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.905+0000 7f6f2eb33800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.27.9 2024-06-04T16:13:22.907 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.906+0000 7f6f2eb33800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.27.10 2024-06-04T16:13:22.911 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.911+0000 7f6f2eb33800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.27 : hit (requested=0x17, cached=0x17) 2024-06-04T16:13:22.911 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.911+0000 7f6f2eb33800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.27 2024-06-04T16:13:22.914 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.912+0000 7f6f2eb33800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.27 info.flags=0x17 2024-06-04T16:13:22.914 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.912+0000 7f6f2eb33800 10 moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.27 to cache LRU end 2024-06-04T16:13:22.914 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.912+0000 7f6f2eb33800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-06-04T16:13:22.914 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.912+0000 7f6f2eb33800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-do-reshard:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.27, ofs0, ns] 2024-06-04T16:13:22.914 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.912+0000 7f6e0d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1078036791423 cookie 93860805054000 notifier 6515 bl.length()=871 2024-06-04T16:13:22.914 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.912+0000 7f6e0d7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.27 info.flags=0x17 2024-06-04T16:13:22.914 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.912+0000 7f6e0d7fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.27 to cache LRU end 2024-06-04T16:13:22.914 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.912+0000 7f6e0d7fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-06-04T16:13:22.914 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.912+0000 7f6f2eb33800 20 handle_bi_update(): bucket=:error-at-do-reshard[be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.27]): orig_sources= new_sources= 2024-06-04T16:13:22.914 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.912+0000 7f6f2eb33800 20 handle_bi_update(): bucket=:error-at-do-reshard[be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.27]): potential sources added=[] removed=[] 2024-06-04T16:13:22.914 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.912+0000 7f6f2eb33800 20 handle_bi_update(): bucket=:error-at-do-reshard[be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.27]): orig_dests= new_dests= 2024-06-04T16:13:22.914 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.912+0000 7f6f2eb33800 20 handle_bi_update(): bucket=:error-at-do-reshard[be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.27]): potential dests added=[] removed=[] 2024-06-04T16:13:22.915 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.914+0000 7f6f2eb33800 1 execute INFO: reshard of bucket "error-at-do-reshard" completed successfully 2024-06-04T16:13:22.917 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.916+0000 7f6de0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-06-04T16:13:22.920 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.919+0000 7f6f2eb33800 20 remove_watcher() i=0 2024-06-04T16:13:22.920 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.919+0000 7f6f2eb33800 2 removed watcher, disabling cache 2024-06-04T16:13:22.921 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.920+0000 7f6f2eb33800 20 remove_watcher() i=1 2024-06-04T16:13:22.921 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.921+0000 7f6f2eb33800 20 remove_watcher() i=2 2024-06-04T16:13:22.923 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.923+0000 7f6f2eb33800 20 remove_watcher() i=3 2024-06-04T16:13:22.924 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.923+0000 7f6f2eb33800 20 remove_watcher() i=4 2024-06-04T16:13:22.925 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.924+0000 7f6f2eb33800 20 remove_watcher() i=5 2024-06-04T16:13:22.926 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.925+0000 7f6f2eb33800 20 remove_watcher() i=6 2024-06-04T16:13:22.927 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:22.926+0000 7f6f2eb33800 20 remove_watcher() i=7 2024-06-04T16:13:22.939 INFO:tasks.workunit.client.0.smithi144.stderr:radosgw-admin bucket stats --bucket error-at-do-reshard 2024-06-04T16:13:22.967 INFO:tasks.workunit.client.0.smithi144.stderr:ignoring --setuser ceph since I am not root 2024-06-04T16:13:22.967 INFO:tasks.workunit.client.0.smithi144.stderr:ignoring --setgroup ceph since I am not root 2024-06-04T16:13:23.003 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:23.003+0000 7fb483b46800 20 rados->read ofs=0 len=0 2024-06-04T16:13:23.005 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:23.004+0000 7fb483b46800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:13:23.005 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:23.004+0000 7fb483b46800 20 realm 2024-06-04T16:13:23.006 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:23.004+0000 7fb483b46800 20 rados->read ofs=0 len=0 2024-06-04T16:13:23.006 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:23.004+0000 7fb483b46800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:13:23.006 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:23.004+0000 7fb483b46800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-06-04T16:13:23.006 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:23.005+0000 7fb483b46800 20 rados->read ofs=0 len=0 2024-06-04T16:13:23.006 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:23.005+0000 7fb483b46800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:13:23.006 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:23.005+0000 7fb483b46800 20 rados->read ofs=0 len=0 2024-06-04T16:13:23.006 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:23.005+0000 7fb483b46800 20 rados_obj.operate() r=0 bl.length=46 2024-06-04T16:13:23.006 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:23.005+0000 7fb483b46800 20 rados->read ofs=0 len=0 2024-06-04T16:13:23.007 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:23.006+0000 7fb483b46800 20 rados_obj.operate() r=0 bl.length=1139 2024-06-04T16:13:23.007 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:23.006+0000 7fb483b46800 20 searching for the correct realm 2024-06-04T16:13:23.009 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:23.008+0000 7fb481e43640 0 -- 172.21.15.144:0/3101736802 >> [v2:172.21.15.144:6800/1453747520,v1:172.21.15.144:6801/1453747520] conn(0x7fb47805fc20 msgr2=0x7fb4780c2a70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-06-04T16:13:23.213 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:23.212+0000 7fb480e41640 0 -- 172.21.15.144:0/3101736802 >> [v2:172.21.15.177:6808/2618477608,v1:172.21.15.177:6809/2618477608] conn(0x7fb478057040 msgr2=0x7fb4780ac120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-06-04T16:13:23.420 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:23.418+0000 7fb483b46800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-06-04T16:13:23.420 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:23.418+0000 7fb483b46800 20 RGWRados::pool_iterate: got zone_info.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767 2024-06-04T16:13:23.420 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:23.418+0000 7fb483b46800 20 RGWRados::pool_iterate: got default.zone. 2024-06-04T16:13:23.420 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:23.418+0000 7fb483b46800 20 RGWRados::pool_iterate: got zonegroup_info.abb22408-c332-4e28-8f7a-ff254ea2fed2 2024-06-04T16:13:23.420 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:23.418+0000 7fb483b46800 20 RGWRados::pool_iterate: got zone_names.default 2024-06-04T16:13:23.420 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:23.418+0000 7fb483b46800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-06-04T16:13:23.420 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:23.418+0000 7fb483b46800 20 rados->read ofs=0 len=0 2024-06-04T16:13:23.420 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:23.419+0000 7fb483b46800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:13:23.420 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:23.419+0000 7fb483b46800 20 rados->read ofs=0 len=0 2024-06-04T16:13:23.420 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:23.419+0000 7fb483b46800 20 rados_obj.operate() r=0 bl.length=46 2024-06-04T16:13:23.420 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:23.419+0000 7fb483b46800 20 rados->read ofs=0 len=0 2024-06-04T16:13:23.421 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:23.419+0000 7fb483b46800 20 rados_obj.operate() r=0 bl.length=470 2024-06-04T16:13:23.422 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:23.419+0000 7fb483b46800 20 zone default found 2024-06-04T16:13:23.422 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:23.419+0000 7fb483b46800 4 Realm: () 2024-06-04T16:13:23.422 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:23.419+0000 7fb483b46800 4 ZoneGroup: default (abb22408-c332-4e28-8f7a-ff254ea2fed2) 2024-06-04T16:13:23.422 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:23.419+0000 7fb483b46800 4 Zone: default (be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767) 2024-06-04T16:13:23.422 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:23.419+0000 7fb483b46800 10 cannot find current period zonegroup using local zonegroup configuration 2024-06-04T16:13:23.422 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:23.419+0000 7fb483b46800 20 zonegroup default 2024-06-04T16:13:23.422 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:23.419+0000 7fb483b46800 20 rados->read ofs=0 len=0 2024-06-04T16:13:23.422 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:23.420+0000 7fb483b46800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:13:23.422 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:23.420+0000 7fb483b46800 20 rados->read ofs=0 len=0 2024-06-04T16:13:23.422 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:23.420+0000 7fb483b46800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:13:23.422 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:23.420+0000 7fb483b46800 20 rados->read ofs=0 len=0 2024-06-04T16:13:23.422 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:23.421+0000 7fb483b46800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:13:23.423 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:23.421+0000 7fb483b46800 20 started sync module instance, tier type = 2024-06-04T16:13:23.423 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:23.421+0000 7fb483b46800 20 started zone id=be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767 (name=default) with tier type = 2024-06-04T16:13:23.430 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:23.429+0000 7fb483b46800 20 add_watcher() i=0 2024-06-04T16:13:23.430 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:23.429+0000 7fb483b46800 20 add_watcher() i=1 2024-06-04T16:13:23.430 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:23.429+0000 7fb483b46800 20 add_watcher() i=2 2024-06-04T16:13:23.430 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:23.429+0000 7fb483b46800 20 add_watcher() i=3 2024-06-04T16:13:23.430 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:23.429+0000 7fb483b46800 20 add_watcher() i=4 2024-06-04T16:13:23.431 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:23.429+0000 7fb483b46800 20 add_watcher() i=5 2024-06-04T16:13:23.431 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:23.429+0000 7fb483b46800 20 add_watcher() i=6 2024-06-04T16:13:23.431 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:23.430+0000 7fb483b46800 20 add_watcher() i=7 2024-06-04T16:13:23.431 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:23.430+0000 7fb483b46800 2 all 8 watchers are set, enabling cache 2024-06-04T16:13:23.433 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:23.432+0000 7fb3377e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-06-04T16:13:23.433 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:23.432+0000 7fb483b46800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-06-04T16:13:23.434 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:23.432+0000 7fb483b46800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-06-04T16:13:23.434 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:23.432+0000 7fb483b46800 5 note: GC not initialized 2024-06-04T16:13:23.434 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:23.432+0000 7fb3367e4640 20 reqs_thread_entry: start 2024-06-04T16:13:23.434 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:23.433+0000 7fb483b46800 20 init_complete bucket index max shards: 11 2024-06-04T16:13:23.434 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:23.433+0000 7fb483b46800 20 Filter name: none 2024-06-04T16:13:23.434 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:23.433+0000 7fb2a7fff640 20 reqs_thread_entry: start 2024-06-04T16:13:23.434 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:23.433+0000 7fb483b46800 20 rados->read ofs=0 len=0 2024-06-04T16:13:23.435 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:23.433+0000 7fb483b46800 20 rados_obj.operate() r=0 bl.length=187 2024-06-04T16:13:23.435 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:23.433+0000 7fb483b46800 20 rados->read ofs=0 len=0 2024-06-04T16:13:23.435 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:23.434+0000 7fb483b46800 20 rados_obj.operate() r=0 bl.length=401 2024-06-04T16:13:23.435 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:23.434+0000 7fb483b46800 20 couldn't put binfo cache entry, might have raced with data changes 2024-06-04T16:13:23.435 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:23.434+0000 7fb483b46800 20 rados->read ofs=0 len=0 2024-06-04T16:13:23.435 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:23.434+0000 7fb483b46800 20 rados_obj.operate() r=0 bl.length=187 2024-06-04T16:13:23.436 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:23.434+0000 7fb483b46800 20 rados->read ofs=0 len=0 2024-06-04T16:13:23.436 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:23.435+0000 7fb483b46800 20 rados_obj.operate() r=0 bl.length=401 2024-06-04T16:13:23.436 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:23.435+0000 7fb483b46800 20 couldn't put binfo cache entry, might have raced with data changes 2024-06-04T16:13:23.437 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:23.436+0000 7fb3377e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-06-04T16:13:23.439 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:23.438+0000 7fb483b46800 20 remove_watcher() i=0 2024-06-04T16:13:23.439 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:23.438+0000 7fb483b46800 2 removed watcher, disabling cache 2024-06-04T16:13:23.440 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:23.439+0000 7fb483b46800 20 remove_watcher() i=1 2024-06-04T16:13:23.441 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:23.440+0000 7fb483b46800 20 remove_watcher() i=2 2024-06-04T16:13:23.442 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:23.441+0000 7fb483b46800 20 remove_watcher() i=3 2024-06-04T16:13:23.443 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:23.442+0000 7fb483b46800 20 remove_watcher() i=4 2024-06-04T16:13:23.444 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:23.443+0000 7fb483b46800 20 remove_watcher() i=5 2024-06-04T16:13:23.445 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:23.444+0000 7fb483b46800 20 remove_watcher() i=6 2024-06-04T16:13:23.446 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:23.445+0000 7fb483b46800 20 remove_watcher() i=7 2024-06-04T16:13:23.456 INFO:tasks.workunit.client.0.smithi144.stderr: 2024-06-04T16:13:23.457 INFO:tasks.workunit.client.0.smithi144.stderr:BUCKET_STATS: 2024-06-04T16:13:23.457 INFO:tasks.workunit.client.0.smithi144.stderr:bucket: error-at-do-reshard id: be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.27 num_objects: 19 size_kb: 1 num_shards: 12 2024-06-04T16:13:23.457 INFO:tasks.workunit.client.0.smithi144.stderr: 2024-06-04T16:13:23.459 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:13:23.459 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:13:23.462 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:13:23.462 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:13:23.505 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:13:23.506 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:13:23.530 INFO:tasks.workunit.client.0.smithi144.stderr:TEST: reshard bucket with abort at do_reshard 2024-06-04T16:13:23.531 INFO:tasks.workunit.client.0.smithi144.stderr: 2024-06-04T16:13:23.531 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:13:23.531 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:13:23.542 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:13:23.542 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:13:23.585 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:13:23.585 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:13:23.592 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:13:23.592 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:13:23.598 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:13:23.598 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:13:23.605 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:13:23.605 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:13:23.611 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:13:23.611 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:13:23.618 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:13:23.618 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:13:23.624 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:13:23.624 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:13:23.631 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:13:23.631 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:13:23.637 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:13:23.637 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:13:23.643 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:13:23.644 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:13:23.650 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:13:23.650 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:13:23.657 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:13:23.657 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:13:23.663 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:13:23.663 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:13:23.670 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:13:23.670 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:13:23.677 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:13:23.677 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:13:23.683 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:13:23.683 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:13:23.689 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:13:23.690 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:13:23.697 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:13:23.697 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:13:23.703 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:13:23.703 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:13:23.709 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:13:23.709 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:13:23.716 INFO:tasks.workunit.client.0.smithi144.stderr:radosgw-admin bucket stats --bucket abort-at-do-reshard 2024-06-04T16:13:23.746 INFO:tasks.workunit.client.0.smithi144.stderr:ignoring --setuser ceph since I am not root 2024-06-04T16:13:23.746 INFO:tasks.workunit.client.0.smithi144.stderr:ignoring --setgroup ceph since I am not root 2024-06-04T16:13:23.782 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:23.781+0000 7f2d61136800 20 rados->read ofs=0 len=0 2024-06-04T16:13:23.784 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:23.783+0000 7f2d61136800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:13:23.784 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:23.783+0000 7f2d61136800 20 realm 2024-06-04T16:13:23.784 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:23.783+0000 7f2d61136800 20 rados->read ofs=0 len=0 2024-06-04T16:13:23.784 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:23.783+0000 7f2d61136800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:13:23.784 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:23.783+0000 7f2d61136800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-06-04T16:13:23.785 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:23.783+0000 7f2d61136800 20 rados->read ofs=0 len=0 2024-06-04T16:13:23.785 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:23.783+0000 7f2d61136800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:13:23.785 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:23.783+0000 7f2d61136800 20 rados->read ofs=0 len=0 2024-06-04T16:13:23.785 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:23.784+0000 7f2d61136800 20 rados_obj.operate() r=0 bl.length=46 2024-06-04T16:13:23.785 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:23.784+0000 7f2d61136800 20 rados->read ofs=0 len=0 2024-06-04T16:13:23.786 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:23.785+0000 7f2d61136800 20 rados_obj.operate() r=0 bl.length=1139 2024-06-04T16:13:23.786 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:23.785+0000 7f2d61136800 20 searching for the correct realm 2024-06-04T16:13:23.788 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:23.787+0000 7f2d5c6c1640 0 -- 172.21.15.144:0/1602654559 >> [v2:172.21.15.144:6816/2358575268,v1:172.21.15.144:6817/2358575268] conn(0x561cdb0ebf20 msgr2=0x561cdb0ee310 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-06-04T16:13:23.790 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:23.789+0000 7f2d5c6c1640 0 -- 172.21.15.144:0/1602654559 >> [v2:172.21.15.177:6808/2618477608,v1:172.21.15.177:6809/2618477608] conn(0x7f2d44040070 msgr2=0x7f2d4402c120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-06-04T16:13:23.996 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:23.995+0000 7f2d61136800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-06-04T16:13:23.997 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:23.995+0000 7f2d61136800 20 RGWRados::pool_iterate: got zone_info.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767 2024-06-04T16:13:23.997 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:23.995+0000 7f2d61136800 20 RGWRados::pool_iterate: got default.zone. 2024-06-04T16:13:23.997 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:23.995+0000 7f2d61136800 20 RGWRados::pool_iterate: got zonegroup_info.abb22408-c332-4e28-8f7a-ff254ea2fed2 2024-06-04T16:13:23.997 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:23.995+0000 7f2d61136800 20 RGWRados::pool_iterate: got zone_names.default 2024-06-04T16:13:23.997 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:23.995+0000 7f2d61136800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-06-04T16:13:23.997 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:23.995+0000 7f2d61136800 20 rados->read ofs=0 len=0 2024-06-04T16:13:23.997 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:23.995+0000 7f2d61136800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:13:23.997 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:23.995+0000 7f2d61136800 20 rados->read ofs=0 len=0 2024-06-04T16:13:23.997 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:23.996+0000 7f2d61136800 20 rados_obj.operate() r=0 bl.length=46 2024-06-04T16:13:23.997 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:23.996+0000 7f2d61136800 20 rados->read ofs=0 len=0 2024-06-04T16:13:23.999 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:23.996+0000 7f2d61136800 20 rados_obj.operate() r=0 bl.length=470 2024-06-04T16:13:23.999 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:23.996+0000 7f2d61136800 20 zone default found 2024-06-04T16:13:23.999 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:23.996+0000 7f2d61136800 4 Realm: () 2024-06-04T16:13:23.999 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:23.996+0000 7f2d61136800 4 ZoneGroup: default (abb22408-c332-4e28-8f7a-ff254ea2fed2) 2024-06-04T16:13:23.999 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:23.996+0000 7f2d61136800 4 Zone: default (be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767) 2024-06-04T16:13:23.999 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:23.996+0000 7f2d61136800 10 cannot find current period zonegroup using local zonegroup configuration 2024-06-04T16:13:23.999 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:23.996+0000 7f2d61136800 20 zonegroup default 2024-06-04T16:13:23.999 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:23.996+0000 7f2d61136800 20 rados->read ofs=0 len=0 2024-06-04T16:13:23.999 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:23.996+0000 7f2d61136800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:13:23.999 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:23.997+0000 7f2d61136800 20 rados->read ofs=0 len=0 2024-06-04T16:13:23.999 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:23.997+0000 7f2d61136800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:13:23.999 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:23.997+0000 7f2d61136800 20 rados->read ofs=0 len=0 2024-06-04T16:13:24.000 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:23.997+0000 7f2d61136800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:13:24.000 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:23.997+0000 7f2d61136800 20 started sync module instance, tier type = 2024-06-04T16:13:24.000 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:23.997+0000 7f2d61136800 20 started zone id=be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767 (name=default) with tier type = 2024-06-04T16:13:24.007 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:24.006+0000 7f2d61136800 20 add_watcher() i=0 2024-06-04T16:13:24.007 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:24.006+0000 7f2d61136800 20 add_watcher() i=1 2024-06-04T16:13:24.007 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:24.006+0000 7f2d61136800 20 add_watcher() i=2 2024-06-04T16:13:24.007 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:24.006+0000 7f2d61136800 20 add_watcher() i=3 2024-06-04T16:13:24.007 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:24.006+0000 7f2d61136800 20 add_watcher() i=4 2024-06-04T16:13:24.007 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:24.006+0000 7f2d61136800 20 add_watcher() i=5 2024-06-04T16:13:24.007 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:24.006+0000 7f2d61136800 20 add_watcher() i=6 2024-06-04T16:13:24.007 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:24.006+0000 7f2d61136800 20 add_watcher() i=7 2024-06-04T16:13:24.008 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:24.006+0000 7f2d61136800 2 all 8 watchers are set, enabling cache 2024-06-04T16:13:24.010 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:24.009+0000 7f2c12fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-06-04T16:13:24.011 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:24.010+0000 7f2d61136800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-06-04T16:13:24.011 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:24.010+0000 7f2d61136800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-06-04T16:13:24.011 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:24.010+0000 7f2d61136800 5 note: GC not initialized 2024-06-04T16:13:24.011 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:24.010+0000 7f2c11fe3640 20 reqs_thread_entry: start 2024-06-04T16:13:24.011 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:24.010+0000 7f2d61136800 20 init_complete bucket index max shards: 11 2024-06-04T16:13:24.011 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:24.010+0000 7f2d61136800 20 Filter name: none 2024-06-04T16:13:24.011 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:24.010+0000 7f2b837fe640 20 reqs_thread_entry: start 2024-06-04T16:13:24.012 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:24.010+0000 7f2d61136800 20 rados->read ofs=0 len=0 2024-06-04T16:13:24.012 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:24.011+0000 7f2d61136800 20 rados_obj.operate() r=0 bl.length=187 2024-06-04T16:13:24.012 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:24.011+0000 7f2d61136800 20 rados->read ofs=0 len=0 2024-06-04T16:13:24.013 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:24.012+0000 7f2d61136800 20 rados_obj.operate() r=0 bl.length=401 2024-06-04T16:13:24.013 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:24.012+0000 7f2d61136800 20 couldn't put binfo cache entry, might have raced with data changes 2024-06-04T16:13:24.013 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:24.012+0000 7f2d61136800 20 rados->read ofs=0 len=0 2024-06-04T16:13:24.013 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:24.012+0000 7f2d61136800 20 rados_obj.operate() r=0 bl.length=187 2024-06-04T16:13:24.013 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:24.012+0000 7f2d61136800 20 rados->read ofs=0 len=0 2024-06-04T16:13:24.014 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:24.012+0000 7f2d61136800 20 rados_obj.operate() r=0 bl.length=401 2024-06-04T16:13:24.014 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:24.012+0000 7f2d61136800 20 couldn't put binfo cache entry, might have raced with data changes 2024-06-04T16:13:24.015 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:24.014+0000 7f2c12fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-06-04T16:13:24.017 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:24.016+0000 7f2d61136800 20 remove_watcher() i=0 2024-06-04T16:13:24.017 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:24.016+0000 7f2d61136800 2 removed watcher, disabling cache 2024-06-04T16:13:24.018 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:24.017+0000 7f2d61136800 20 remove_watcher() i=1 2024-06-04T16:13:24.019 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:24.018+0000 7f2d61136800 20 remove_watcher() i=2 2024-06-04T16:13:24.020 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:24.019+0000 7f2d61136800 20 remove_watcher() i=3 2024-06-04T16:13:24.021 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:24.020+0000 7f2d61136800 20 remove_watcher() i=4 2024-06-04T16:13:24.022 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:24.021+0000 7f2d61136800 20 remove_watcher() i=5 2024-06-04T16:13:24.023 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:24.022+0000 7f2d61136800 20 remove_watcher() i=6 2024-06-04T16:13:24.023 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:24.023+0000 7f2d61136800 20 remove_watcher() i=7 2024-06-04T16:13:24.034 INFO:tasks.workunit.client.0.smithi144.stderr: 2024-06-04T16:13:24.034 INFO:tasks.workunit.client.0.smithi144.stderr:BUCKET_STATS: 2024-06-04T16:13:24.034 INFO:tasks.workunit.client.0.smithi144.stderr:bucket: abort-at-do-reshard id: be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.28 num_objects: 20 size_kb: 1 num_shards: 11 2024-06-04T16:13:24.034 INFO:tasks.workunit.client.0.smithi144.stderr: 2024-06-04T16:13:24.036 INFO:tasks.workunit.client.0.smithi144.stderr:radosgw-admin bucket reshard --bucket abort-at-do-reshard --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at do_reshard 2024-06-04T16:13:24.069 INFO:tasks.workunit.client.0.smithi144.stderr:ignoring --setuser ceph since I am not root 2024-06-04T16:13:24.069 INFO:tasks.workunit.client.0.smithi144.stderr:ignoring --setgroup ceph since I am not root 2024-06-04T16:13:24.105 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:24.104+0000 7f8175a13800 20 rados->read ofs=0 len=0 2024-06-04T16:13:24.107 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:24.106+0000 7f8175a13800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:13:24.107 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:24.106+0000 7f8175a13800 20 realm 2024-06-04T16:13:24.107 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:24.106+0000 7f8175a13800 20 rados->read ofs=0 len=0 2024-06-04T16:13:24.107 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:24.106+0000 7f8175a13800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:13:24.107 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:24.106+0000 7f8175a13800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-06-04T16:13:24.107 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:24.106+0000 7f8175a13800 20 rados->read ofs=0 len=0 2024-06-04T16:13:24.107 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:24.106+0000 7f8175a13800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:13:24.107 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:24.106+0000 7f8175a13800 20 rados->read ofs=0 len=0 2024-06-04T16:13:24.108 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:24.107+0000 7f8175a13800 20 rados_obj.operate() r=0 bl.length=46 2024-06-04T16:13:24.108 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:24.107+0000 7f8175a13800 20 rados->read ofs=0 len=0 2024-06-04T16:13:24.109 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:24.108+0000 7f8175a13800 20 rados_obj.operate() r=0 bl.length=1139 2024-06-04T16:13:24.109 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:24.108+0000 7f8175a13800 20 searching for the correct realm 2024-06-04T16:13:24.110 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:24.109+0000 7f816bfff640 0 -- 172.21.15.144:0/1507413648 >> [v2:172.21.15.144:6816/2358575268,v1:172.21.15.144:6817/2358575268] conn(0x55b5cb809a80 msgr2=0x55b5cb80beb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-06-04T16:13:24.113 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:24.112+0000 7f816bfff640 0 -- 172.21.15.144:0/1507413648 >> [v2:172.21.15.177:6808/2618477608,v1:172.21.15.177:6809/2618477608] conn(0x7f815c017030 msgr2=0x7f815c05f190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-06-04T16:13:24.319 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:24.318+0000 7f8175a13800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-06-04T16:13:24.320 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:24.318+0000 7f8175a13800 20 RGWRados::pool_iterate: got zone_info.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767 2024-06-04T16:13:24.320 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:24.318+0000 7f8175a13800 20 RGWRados::pool_iterate: got default.zone. 2024-06-04T16:13:24.320 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:24.318+0000 7f8175a13800 20 RGWRados::pool_iterate: got zonegroup_info.abb22408-c332-4e28-8f7a-ff254ea2fed2 2024-06-04T16:13:24.320 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:24.318+0000 7f8175a13800 20 RGWRados::pool_iterate: got zone_names.default 2024-06-04T16:13:24.320 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:24.318+0000 7f8175a13800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-06-04T16:13:24.320 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:24.318+0000 7f8175a13800 20 rados->read ofs=0 len=0 2024-06-04T16:13:24.320 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:24.318+0000 7f8175a13800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:13:24.320 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:24.318+0000 7f8175a13800 20 rados->read ofs=0 len=0 2024-06-04T16:13:24.320 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:24.319+0000 7f8175a13800 20 rados_obj.operate() r=0 bl.length=46 2024-06-04T16:13:24.320 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:24.319+0000 7f8175a13800 20 rados->read ofs=0 len=0 2024-06-04T16:13:24.321 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:24.319+0000 7f8175a13800 20 rados_obj.operate() r=0 bl.length=470 2024-06-04T16:13:24.321 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:24.319+0000 7f8175a13800 20 zone default found 2024-06-04T16:13:24.321 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:24.319+0000 7f8175a13800 4 Realm: () 2024-06-04T16:13:24.322 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:24.319+0000 7f8175a13800 4 ZoneGroup: default (abb22408-c332-4e28-8f7a-ff254ea2fed2) 2024-06-04T16:13:24.322 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:24.319+0000 7f8175a13800 4 Zone: default (be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767) 2024-06-04T16:13:24.322 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:24.319+0000 7f8175a13800 10 cannot find current period zonegroup using local zonegroup configuration 2024-06-04T16:13:24.322 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:24.319+0000 7f8175a13800 20 zonegroup default 2024-06-04T16:13:24.322 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:24.319+0000 7f8175a13800 20 rados->read ofs=0 len=0 2024-06-04T16:13:24.322 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:24.319+0000 7f8175a13800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:13:24.322 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:24.319+0000 7f8175a13800 20 rados->read ofs=0 len=0 2024-06-04T16:13:24.322 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:24.320+0000 7f8175a13800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:13:24.322 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:24.320+0000 7f8175a13800 20 rados->read ofs=0 len=0 2024-06-04T16:13:24.322 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:24.320+0000 7f8175a13800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:13:24.322 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:24.320+0000 7f8175a13800 20 started sync module instance, tier type = 2024-06-04T16:13:24.323 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:24.320+0000 7f8175a13800 20 started zone id=be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767 (name=default) with tier type = 2024-06-04T16:13:24.329 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:24.328+0000 7f8175a13800 20 add_watcher() i=0 2024-06-04T16:13:24.329 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:24.328+0000 7f8175a13800 20 add_watcher() i=1 2024-06-04T16:13:24.329 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:24.328+0000 7f8175a13800 20 add_watcher() i=2 2024-06-04T16:13:24.330 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:24.328+0000 7f8175a13800 20 add_watcher() i=3 2024-06-04T16:13:24.330 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:24.328+0000 7f8175a13800 20 add_watcher() i=4 2024-06-04T16:13:24.330 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:24.328+0000 7f8175a13800 20 add_watcher() i=5 2024-06-04T16:13:24.330 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:24.328+0000 7f8175a13800 20 add_watcher() i=6 2024-06-04T16:13:24.330 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:24.329+0000 7f8175a13800 20 add_watcher() i=7 2024-06-04T16:13:24.330 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:24.329+0000 7f8175a13800 2 all 8 watchers are set, enabling cache 2024-06-04T16:13:24.333 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:24.331+0000 7f80277e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-06-04T16:13:24.333 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:24.332+0000 7f8175a13800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-06-04T16:13:24.334 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:24.332+0000 7f8175a13800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-06-04T16:13:24.334 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:24.332+0000 7f8175a13800 5 note: GC not initialized 2024-06-04T16:13:24.334 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:24.332+0000 7f80267e4640 20 reqs_thread_entry: start 2024-06-04T16:13:24.334 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:24.332+0000 7f8175a13800 20 init_complete bucket index max shards: 11 2024-06-04T16:13:24.334 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:24.332+0000 7f8175a13800 20 Filter name: none 2024-06-04T16:13:24.334 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:24.332+0000 7f7f97fff640 20 reqs_thread_entry: start 2024-06-04T16:13:24.334 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:24.332+0000 7f8175a13800 10 cache get: name=default.rgw.meta+root+abort-at-do-reshard : miss 2024-06-04T16:13:24.334 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:24.332+0000 7f8175a13800 20 rados->read ofs=0 len=0 2024-06-04T16:13:24.334 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:24.333+0000 7f8175a13800 20 rados_obj.operate() r=0 bl.length=187 2024-06-04T16:13:24.334 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:24.333+0000 7f8175a13800 10 cache put: name=default.rgw.meta+root+abort-at-do-reshard info.flags=0x11 2024-06-04T16:13:24.334 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:24.333+0000 7f8175a13800 10 adding default.rgw.meta+root+abort-at-do-reshard to cache LRU end 2024-06-04T16:13:24.334 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:24.333+0000 7f8175a13800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.28 : miss 2024-06-04T16:13:24.335 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:24.333+0000 7f8175a13800 20 rados->read ofs=0 len=0 2024-06-04T16:13:24.335 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:24.333+0000 7f8175a13800 20 rados_obj.operate() r=0 bl.length=401 2024-06-04T16:13:24.335 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:24.333+0000 7f8175a13800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.28 info.flags=0x17 2024-06-04T16:13:24.335 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:24.333+0000 7f8175a13800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.28 to cache LRU end 2024-06-04T16:13:24.335 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:24.333+0000 7f8175a13800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-06-04T16:13:24.335 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:24.333+0000 7f8175a13800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-06-04T16:13:24.335 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:24.333+0000 7f8175a13800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.28 2024-06-04T16:13:24.339 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:24.338+0000 7f8175a13800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.28 info.flags=0x17 2024-06-04T16:13:24.339 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:24.338+0000 7f8175a13800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.28 to cache LRU end 2024-06-04T16:13:24.340 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:24.338+0000 7f8175a13800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-06-04T16:13:24.340 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:24.338+0000 7f8175a13800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.28, ofs0, ns] 2024-06-04T16:13:24.340 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:24.339+0000 7f8054ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1078036791319 cookie 94239291652816 notifier 6566 bl.length()=903 2024-06-04T16:13:24.340 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:24.339+0000 7f8054ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.28 info.flags=0x17 2024-06-04T16:13:24.340 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:24.339+0000 7f8054ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.28 to cache LRU end 2024-06-04T16:13:24.340 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:24.339+0000 7f8054ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-06-04T16:13:24.340 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:24.339+0000 7f8175a13800 20 handle_bi_update(): bucket=:abort-at-do-reshard[be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.28]): orig_sources= new_sources= 2024-06-04T16:13:24.340 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:24.339+0000 7f8175a13800 20 handle_bi_update(): bucket=:abort-at-do-reshard[be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.28]): potential sources added=[] removed=[] 2024-06-04T16:13:24.341 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:24.339+0000 7f8175a13800 20 handle_bi_update(): bucket=:abort-at-do-reshard[be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.28]): orig_dests= new_dests= 2024-06-04T16:13:24.341 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:24.339+0000 7f8175a13800 20 handle_bi_update(): bucket=:abort-at-do-reshard[be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.28]): potential dests added=[] removed=[] 2024-06-04T16:13:24.342 INFO:tasks.workunit.client.0.smithi144.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-4027-g65533a90/rpm/el9/BUILD/ceph-19.0.0-4027-g65533a90/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f8175a13800 time 2024-06-04T16:13:24.342962+0000 2024-06-04T16:13:24.342 INFO:tasks.workunit.client.0.smithi144.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-4027-g65533a90/rpm/el9/BUILD/ceph-19.0.0-4027-g65533a90/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-06-04T16:13:24.343 INFO:tasks.workunit.client.0.smithi144.stderr: ceph version 19.0.0-4027-g65533a90 (65533a907fc9add1863609703fdbbea67993c8ef) squid (dev) 2024-06-04T16:13:24.343 INFO:tasks.workunit.client.0.smithi144.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f8176981dce] 2024-06-04T16:13:24.344 INFO:tasks.workunit.client.0.smithi144.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x181f8c) [0x7f8176981f8c] 2024-06-04T16:13:24.344 INFO:tasks.workunit.client.0.smithi144.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55b5ca966fb1] 2024-06-04T16:13:24.344 INFO:tasks.workunit.client.0.smithi144.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x32f) [0x55b5ca97239f] 2024-06-04T16:13:24.344 INFO:tasks.workunit.client.0.smithi144.stderr: 5: main() 2024-06-04T16:13:24.344 INFO:tasks.workunit.client.0.smithi144.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7f8175829590] 2024-06-04T16:13:24.344 INFO:tasks.workunit.client.0.smithi144.stderr: 7: __libc_start_main() 2024-06-04T16:13:24.344 INFO:tasks.workunit.client.0.smithi144.stderr: 8: _start() 2024-06-04T16:13:24.344 INFO:tasks.workunit.client.0.smithi144.stderr:*** Caught signal (Aborted) ** 2024-06-04T16:13:24.345 INFO:tasks.workunit.client.0.smithi144.stderr: in thread 7f8175a13800 thread_name:radosgw-admin 2024-06-04T16:13:24.345 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:24.342+0000 7f8175a13800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-4027-g65533a90/rpm/el9/BUILD/ceph-19.0.0-4027-g65533a90/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f8175a13800 time 2024-06-04T16:13:24.342962+0000 2024-06-04T16:13:24.345 INFO:tasks.workunit.client.0.smithi144.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-4027-g65533a90/rpm/el9/BUILD/ceph-19.0.0-4027-g65533a90/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-06-04T16:13:24.345 INFO:tasks.workunit.client.0.smithi144.stderr: 2024-06-04T16:13:24.345 INFO:tasks.workunit.client.0.smithi144.stderr: ceph version 19.0.0-4027-g65533a90 (65533a907fc9add1863609703fdbbea67993c8ef) squid (dev) 2024-06-04T16:13:24.345 INFO:tasks.workunit.client.0.smithi144.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f8176981dce] 2024-06-04T16:13:24.346 INFO:tasks.workunit.client.0.smithi144.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x181f8c) [0x7f8176981f8c] 2024-06-04T16:13:24.346 INFO:tasks.workunit.client.0.smithi144.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55b5ca966fb1] 2024-06-04T16:13:24.346 INFO:tasks.workunit.client.0.smithi144.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x32f) [0x55b5ca97239f] 2024-06-04T16:13:24.346 INFO:tasks.workunit.client.0.smithi144.stderr: 5: main() 2024-06-04T16:13:24.346 INFO:tasks.workunit.client.0.smithi144.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7f8175829590] 2024-06-04T16:13:24.346 INFO:tasks.workunit.client.0.smithi144.stderr: 7: __libc_start_main() 2024-06-04T16:13:24.347 INFO:tasks.workunit.client.0.smithi144.stderr: 8: _start() 2024-06-04T16:13:24.347 INFO:tasks.workunit.client.0.smithi144.stderr: 2024-06-04T16:13:24.367 INFO:tasks.workunit.client.0.smithi144.stderr: ceph version 19.0.0-4027-g65533a90 (65533a907fc9add1863609703fdbbea67993c8ef) squid (dev) 2024-06-04T16:13:24.367 INFO:tasks.workunit.client.0.smithi144.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f817583e6f0] 2024-06-04T16:13:24.367 INFO:tasks.workunit.client.0.smithi144.stderr: 2: /lib64/libc.so.6(+0x8b94c) [0x7f817588b94c] 2024-06-04T16:13:24.367 INFO:tasks.workunit.client.0.smithi144.stderr: 3: raise() 2024-06-04T16:13:24.367 INFO:tasks.workunit.client.0.smithi144.stderr: 4: abort() 2024-06-04T16:13:24.367 INFO:tasks.workunit.client.0.smithi144.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f8176981e28] 2024-06-04T16:13:24.367 INFO:tasks.workunit.client.0.smithi144.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x181f8c) [0x7f8176981f8c] 2024-06-04T16:13:24.367 INFO:tasks.workunit.client.0.smithi144.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55b5ca966fb1] 2024-06-04T16:13:24.367 INFO:tasks.workunit.client.0.smithi144.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x32f) [0x55b5ca97239f] 2024-06-04T16:13:24.367 INFO:tasks.workunit.client.0.smithi144.stderr: 9: main() 2024-06-04T16:13:24.367 INFO:tasks.workunit.client.0.smithi144.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7f8175829590] 2024-06-04T16:13:24.368 INFO:tasks.workunit.client.0.smithi144.stderr: 11: __libc_start_main() 2024-06-04T16:13:24.368 INFO:tasks.workunit.client.0.smithi144.stderr: 12: _start() 2024-06-04T16:13:24.368 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:24.343+0000 7f8175a13800 -1 *** Caught signal (Aborted) ** 2024-06-04T16:13:24.368 INFO:tasks.workunit.client.0.smithi144.stderr: in thread 7f8175a13800 thread_name:radosgw-admin 2024-06-04T16:13:24.368 INFO:tasks.workunit.client.0.smithi144.stderr: 2024-06-04T16:13:24.368 INFO:tasks.workunit.client.0.smithi144.stderr: ceph version 19.0.0-4027-g65533a90 (65533a907fc9add1863609703fdbbea67993c8ef) squid (dev) 2024-06-04T16:13:24.368 INFO:tasks.workunit.client.0.smithi144.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f817583e6f0] 2024-06-04T16:13:24.368 INFO:tasks.workunit.client.0.smithi144.stderr: 2: /lib64/libc.so.6(+0x8b94c) [0x7f817588b94c] 2024-06-04T16:13:24.369 INFO:tasks.workunit.client.0.smithi144.stderr: 3: raise() 2024-06-04T16:13:24.369 INFO:tasks.workunit.client.0.smithi144.stderr: 4: abort() 2024-06-04T16:13:24.369 INFO:tasks.workunit.client.0.smithi144.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f8176981e28] 2024-06-04T16:13:24.369 INFO:tasks.workunit.client.0.smithi144.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x181f8c) [0x7f8176981f8c] 2024-06-04T16:13:24.369 INFO:tasks.workunit.client.0.smithi144.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55b5ca966fb1] 2024-06-04T16:13:24.369 INFO:tasks.workunit.client.0.smithi144.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x32f) [0x55b5ca97239f] 2024-06-04T16:13:24.369 INFO:tasks.workunit.client.0.smithi144.stderr: 9: main() 2024-06-04T16:13:24.369 INFO:tasks.workunit.client.0.smithi144.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7f8175829590] 2024-06-04T16:13:24.369 INFO:tasks.workunit.client.0.smithi144.stderr: 11: __libc_start_main() 2024-06-04T16:13:24.369 INFO:tasks.workunit.client.0.smithi144.stderr: 12: _start() 2024-06-04T16:13:24.370 INFO:tasks.workunit.client.0.smithi144.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-06-04T16:13:24.370 INFO:tasks.workunit.client.0.smithi144.stderr: 2024-06-04T16:13:24.370 INFO:tasks.workunit.client.0.smithi144.stderr:--- begin dump of recent events --- 2024-06-04T16:13:24.370 INFO:tasks.workunit.client.0.smithi144.stderr: -499> 2024-06-04T16:13:24.088+0000 7f8175a13800 10 monclient: build_initial_monmap 2024-06-04T16:13:24.370 INFO:tasks.workunit.client.0.smithi144.stderr: -498> 2024-06-04T16:13:24.088+0000 7f8175a13800 1 build_initial for_mkfs: 0 2024-06-04T16:13:24.370 INFO:tasks.workunit.client.0.smithi144.stderr: -497> 2024-06-04T16:13:24.088+0000 7f8175a13800 10 monclient: monmap: 2024-06-04T16:13:24.370 INFO:tasks.workunit.client.0.smithi144.stderr:epoch 0 2024-06-04T16:13:24.370 INFO:tasks.workunit.client.0.smithi144.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-06-04T16:13:24.370 INFO:tasks.workunit.client.0.smithi144.stderr:last_changed 0.000000 2024-06-04T16:13:24.370 INFO:tasks.workunit.client.0.smithi144.stderr:created 0.000000 2024-06-04T16:13:24.371 INFO:tasks.workunit.client.0.smithi144.stderr:min_mon_release 0 (unknown) 2024-06-04T16:13:24.371 INFO:tasks.workunit.client.0.smithi144.stderr:election_strategy: 1 2024-06-04T16:13:24.371 INFO:tasks.workunit.client.0.smithi144.stderr:0: [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] mon.noname-a 2024-06-04T16:13:24.371 INFO:tasks.workunit.client.0.smithi144.stderr:1: [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] mon.noname-b 2024-06-04T16:13:24.371 INFO:tasks.workunit.client.0.smithi144.stderr:2: [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] mon.noname-c 2024-06-04T16:13:24.371 INFO:tasks.workunit.client.0.smithi144.stderr: 2024-06-04T16:13:24.371 INFO:tasks.workunit.client.0.smithi144.stderr: -496> 2024-06-04T16:13:24.088+0000 7f8175a13800 5 AuthRegistry(0x55b5cb71ab30) adding auth protocol: cephx 2024-06-04T16:13:24.371 INFO:tasks.workunit.client.0.smithi144.stderr: -495> 2024-06-04T16:13:24.088+0000 7f8175a13800 5 AuthRegistry(0x55b5cb71ab30) adding auth protocol: cephx 2024-06-04T16:13:24.371 INFO:tasks.workunit.client.0.smithi144.stderr: -494> 2024-06-04T16:13:24.088+0000 7f8175a13800 5 AuthRegistry(0x55b5cb71ab30) adding auth protocol: cephx 2024-06-04T16:13:24.371 INFO:tasks.workunit.client.0.smithi144.stderr: -493> 2024-06-04T16:13:24.088+0000 7f8175a13800 5 AuthRegistry(0x55b5cb71ab30) adding con mode: secure 2024-06-04T16:13:24.371 INFO:tasks.workunit.client.0.smithi144.stderr: -492> 2024-06-04T16:13:24.088+0000 7f8175a13800 5 AuthRegistry(0x55b5cb71ab30) adding con mode: crc 2024-06-04T16:13:24.371 INFO:tasks.workunit.client.0.smithi144.stderr: -491> 2024-06-04T16:13:24.088+0000 7f8175a13800 5 AuthRegistry(0x55b5cb71ab30) adding con mode: secure 2024-06-04T16:13:24.371 INFO:tasks.workunit.client.0.smithi144.stderr: -490> 2024-06-04T16:13:24.088+0000 7f8175a13800 5 AuthRegistry(0x55b5cb71ab30) adding con mode: crc 2024-06-04T16:13:24.371 INFO:tasks.workunit.client.0.smithi144.stderr: -489> 2024-06-04T16:13:24.088+0000 7f8175a13800 5 AuthRegistry(0x55b5cb71ab30) adding con mode: secure 2024-06-04T16:13:24.372 INFO:tasks.workunit.client.0.smithi144.stderr: -488> 2024-06-04T16:13:24.088+0000 7f8175a13800 5 AuthRegistry(0x55b5cb71ab30) adding con mode: crc 2024-06-04T16:13:24.372 INFO:tasks.workunit.client.0.smithi144.stderr: -487> 2024-06-04T16:13:24.088+0000 7f8175a13800 5 AuthRegistry(0x55b5cb71ab30) adding con mode: crc 2024-06-04T16:13:24.372 INFO:tasks.workunit.client.0.smithi144.stderr: -486> 2024-06-04T16:13:24.088+0000 7f8175a13800 5 AuthRegistry(0x55b5cb71ab30) adding con mode: secure 2024-06-04T16:13:24.372 INFO:tasks.workunit.client.0.smithi144.stderr: -485> 2024-06-04T16:13:24.088+0000 7f8175a13800 5 AuthRegistry(0x55b5cb71ab30) adding con mode: crc 2024-06-04T16:13:24.372 INFO:tasks.workunit.client.0.smithi144.stderr: -484> 2024-06-04T16:13:24.088+0000 7f8175a13800 5 AuthRegistry(0x55b5cb71ab30) adding con mode: secure 2024-06-04T16:13:24.372 INFO:tasks.workunit.client.0.smithi144.stderr: -483> 2024-06-04T16:13:24.088+0000 7f8175a13800 5 AuthRegistry(0x55b5cb71ab30) adding con mode: crc 2024-06-04T16:13:24.372 INFO:tasks.workunit.client.0.smithi144.stderr: -482> 2024-06-04T16:13:24.088+0000 7f8175a13800 5 AuthRegistry(0x55b5cb71ab30) adding con mode: secure 2024-06-04T16:13:24.372 INFO:tasks.workunit.client.0.smithi144.stderr: -481> 2024-06-04T16:13:24.089+0000 7f8175a13800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-06-04T16:13:24.372 INFO:tasks.workunit.client.0.smithi144.stderr: -480> 2024-06-04T16:13:24.089+0000 7f8175a13800 1 librados: starting msgr at 2024-06-04T16:13:24.372 INFO:tasks.workunit.client.0.smithi144.stderr: -479> 2024-06-04T16:13:24.089+0000 7f8175a13800 1 librados: starting objecter 2024-06-04T16:13:24.372 INFO:tasks.workunit.client.0.smithi144.stderr: -478> 2024-06-04T16:13:24.089+0000 7f8175a13800 5 asok(0x55b5cb4f7c60) register_command objecter_requests hook 0x55b5cb71cc40 2024-06-04T16:13:24.372 INFO:tasks.workunit.client.0.smithi144.stderr: -477> 2024-06-04T16:13:24.089+0000 7f8175a13800 1 librados: setting wanted keys 2024-06-04T16:13:24.372 INFO:tasks.workunit.client.0.smithi144.stderr: -476> 2024-06-04T16:13:24.089+0000 7f8175a13800 1 librados: calling monclient init 2024-06-04T16:13:24.372 INFO:tasks.workunit.client.0.smithi144.stderr: -475> 2024-06-04T16:13:24.089+0000 7f8175a13800 10 monclient: init 2024-06-04T16:13:24.373 INFO:tasks.workunit.client.0.smithi144.stderr: -474> 2024-06-04T16:13:24.089+0000 7f8175a13800 5 AuthRegistry(0x55b5cb717b30) adding auth protocol: cephx 2024-06-04T16:13:24.373 INFO:tasks.workunit.client.0.smithi144.stderr: -473> 2024-06-04T16:13:24.089+0000 7f8175a13800 5 AuthRegistry(0x55b5cb717b30) adding auth protocol: cephx 2024-06-04T16:13:24.373 INFO:tasks.workunit.client.0.smithi144.stderr: -472> 2024-06-04T16:13:24.089+0000 7f8175a13800 5 AuthRegistry(0x55b5cb717b30) adding auth protocol: cephx 2024-06-04T16:13:24.373 INFO:tasks.workunit.client.0.smithi144.stderr: -471> 2024-06-04T16:13:24.089+0000 7f8175a13800 5 AuthRegistry(0x55b5cb717b30) adding con mode: secure 2024-06-04T16:13:24.373 INFO:tasks.workunit.client.0.smithi144.stderr: -470> 2024-06-04T16:13:24.089+0000 7f8175a13800 5 AuthRegistry(0x55b5cb717b30) adding con mode: crc 2024-06-04T16:13:24.373 INFO:tasks.workunit.client.0.smithi144.stderr: -469> 2024-06-04T16:13:24.089+0000 7f8175a13800 5 AuthRegistry(0x55b5cb717b30) adding con mode: secure 2024-06-04T16:13:24.373 INFO:tasks.workunit.client.0.smithi144.stderr: -468> 2024-06-04T16:13:24.089+0000 7f8175a13800 5 AuthRegistry(0x55b5cb717b30) adding con mode: crc 2024-06-04T16:13:24.373 INFO:tasks.workunit.client.0.smithi144.stderr: -467> 2024-06-04T16:13:24.089+0000 7f8175a13800 5 AuthRegistry(0x55b5cb717b30) adding con mode: secure 2024-06-04T16:13:24.373 INFO:tasks.workunit.client.0.smithi144.stderr: -466> 2024-06-04T16:13:24.089+0000 7f8175a13800 5 AuthRegistry(0x55b5cb717b30) adding con mode: crc 2024-06-04T16:13:24.373 INFO:tasks.workunit.client.0.smithi144.stderr: -465> 2024-06-04T16:13:24.089+0000 7f8175a13800 5 AuthRegistry(0x55b5cb717b30) adding con mode: crc 2024-06-04T16:13:24.373 INFO:tasks.workunit.client.0.smithi144.stderr: -464> 2024-06-04T16:13:24.089+0000 7f8175a13800 5 AuthRegistry(0x55b5cb717b30) adding con mode: secure 2024-06-04T16:13:24.373 INFO:tasks.workunit.client.0.smithi144.stderr: -463> 2024-06-04T16:13:24.089+0000 7f8175a13800 5 AuthRegistry(0x55b5cb717b30) adding con mode: crc 2024-06-04T16:13:24.373 INFO:tasks.workunit.client.0.smithi144.stderr: -462> 2024-06-04T16:13:24.089+0000 7f8175a13800 5 AuthRegistry(0x55b5cb717b30) adding con mode: secure 2024-06-04T16:13:24.373 INFO:tasks.workunit.client.0.smithi144.stderr: -461> 2024-06-04T16:13:24.089+0000 7f8175a13800 5 AuthRegistry(0x55b5cb717b30) adding con mode: crc 2024-06-04T16:13:24.373 INFO:tasks.workunit.client.0.smithi144.stderr: -460> 2024-06-04T16:13:24.089+0000 7f8175a13800 5 AuthRegistry(0x55b5cb717b30) adding con mode: secure 2024-06-04T16:13:24.374 INFO:tasks.workunit.client.0.smithi144.stderr: -459> 2024-06-04T16:13:24.089+0000 7f8175a13800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-06-04T16:13:24.374 INFO:tasks.workunit.client.0.smithi144.stderr: -458> 2024-06-04T16:13:24.089+0000 7f8175a13800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-06-04T16:13:24.374 INFO:tasks.workunit.client.0.smithi144.stderr: -457> 2024-06-04T16:13:24.089+0000 7f8175a13800 5 asok(0x55b5cb4f7c60) register_command rotate-key hook 0x55b5cb717c78 2024-06-04T16:13:24.374 INFO:tasks.workunit.client.0.smithi144.stderr: -456> 2024-06-04T16:13:24.089+0000 7f8175a13800 10 monclient: _reopen_session rank -1 2024-06-04T16:13:24.374 INFO:tasks.workunit.client.0.smithi144.stderr: -455> 2024-06-04T16:13:24.089+0000 7f8175a13800 10 monclient: _add_conns ranks=[0,2,1] 2024-06-04T16:13:24.374 INFO:tasks.workunit.client.0.smithi144.stderr: -454> 2024-06-04T16:13:24.089+0000 7f8175a13800 10 monclient(hunting): picked mon.noname-a con 0x55b5cb5cbeb0 addr [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] 2024-06-04T16:13:24.374 INFO:tasks.workunit.client.0.smithi144.stderr: -453> 2024-06-04T16:13:24.089+0000 7f8175a13800 10 monclient(hunting): picked mon.noname-c con 0x55b5cb5ceeb0 addr [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] 2024-06-04T16:13:24.374 INFO:tasks.workunit.client.0.smithi144.stderr: -452> 2024-06-04T16:13:24.089+0000 7f8175a13800 10 monclient(hunting): picked mon.noname-b con 0x55b5cb71e360 addr [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] 2024-06-04T16:13:24.374 INFO:tasks.workunit.client.0.smithi144.stderr: -451> 2024-06-04T16:13:24.089+0000 7f8175a13800 10 monclient(hunting): start opening mon connection 2024-06-04T16:13:24.374 INFO:tasks.workunit.client.0.smithi144.stderr: -450> 2024-06-04T16:13:24.089+0000 7f8175a13800 10 monclient(hunting): start opening mon connection 2024-06-04T16:13:24.374 INFO:tasks.workunit.client.0.smithi144.stderr: -449> 2024-06-04T16:13:24.089+0000 7f8175a13800 10 monclient(hunting): start opening mon connection 2024-06-04T16:13:24.375 INFO:tasks.workunit.client.0.smithi144.stderr: -448> 2024-06-04T16:13:24.089+0000 7f8175a13800 10 monclient(hunting): _renew_subs 2024-06-04T16:13:24.375 INFO:tasks.workunit.client.0.smithi144.stderr: -447> 2024-06-04T16:13:24.089+0000 7f8175a13800 10 monclient(hunting): authenticate will time out at 2041.906035s 2024-06-04T16:13:24.375 INFO:tasks.workunit.client.0.smithi144.stderr: -446> 2024-06-04T16:13:24.090+0000 7f8171064640 10 monclient(hunting): get_auth_request con 0x55b5cb5cbeb0 auth_method 0 2024-06-04T16:13:24.375 INFO:tasks.workunit.client.0.smithi144.stderr: -445> 2024-06-04T16:13:24.090+0000 7f8171064640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-06-04T16:13:24.375 INFO:tasks.workunit.client.0.smithi144.stderr: -444> 2024-06-04T16:13:24.090+0000 7f8171064640 10 monclient(hunting): _init_auth method 2 2024-06-04T16:13:24.375 INFO:tasks.workunit.client.0.smithi144.stderr: -443> 2024-06-04T16:13:24.090+0000 7f8171064640 10 monclient(hunting): _init_auth creating new auth 2024-06-04T16:13:24.375 INFO:tasks.workunit.client.0.smithi144.stderr: -442> 2024-06-04T16:13:24.090+0000 7f816bfff640 10 monclient(hunting): get_auth_request con 0x55b5cb5ceeb0 auth_method 0 2024-06-04T16:13:24.375 INFO:tasks.workunit.client.0.smithi144.stderr: -441> 2024-06-04T16:13:24.090+0000 7f816bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-06-04T16:13:24.375 INFO:tasks.workunit.client.0.smithi144.stderr: -440> 2024-06-04T16:13:24.090+0000 7f816bfff640 10 monclient(hunting): _init_auth method 2 2024-06-04T16:13:24.375 INFO:tasks.workunit.client.0.smithi144.stderr: -439> 2024-06-04T16:13:24.090+0000 7f816bfff640 10 monclient(hunting): _init_auth creating new auth 2024-06-04T16:13:24.375 INFO:tasks.workunit.client.0.smithi144.stderr: -438> 2024-06-04T16:13:24.090+0000 7f8171865640 10 monclient(hunting): get_auth_request con 0x55b5cb71e360 auth_method 0 2024-06-04T16:13:24.375 INFO:tasks.workunit.client.0.smithi144.stderr: -437> 2024-06-04T16:13:24.090+0000 7f8171865640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-06-04T16:13:24.375 INFO:tasks.workunit.client.0.smithi144.stderr: -436> 2024-06-04T16:13:24.090+0000 7f8171865640 10 monclient(hunting): _init_auth method 2 2024-06-04T16:13:24.375 INFO:tasks.workunit.client.0.smithi144.stderr: -435> 2024-06-04T16:13:24.090+0000 7f8171865640 10 monclient(hunting): _init_auth creating new auth 2024-06-04T16:13:24.375 INFO:tasks.workunit.client.0.smithi144.stderr: -434> 2024-06-04T16:13:24.090+0000 7f8171064640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-06-04T16:13:24.376 INFO:tasks.workunit.client.0.smithi144.stderr: -433> 2024-06-04T16:13:24.090+0000 7f8171064640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-06-04T16:13:24.376 INFO:tasks.workunit.client.0.smithi144.stderr: -432> 2024-06-04T16:13:24.090+0000 7f8171064640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-06-04T16:13:24.376 INFO:tasks.workunit.client.0.smithi144.stderr: -431> 2024-06-04T16:13:24.090+0000 7f816bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-06-04T16:13:24.376 INFO:tasks.workunit.client.0.smithi144.stderr: -430> 2024-06-04T16:13:24.090+0000 7f816bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-06-04T16:13:24.376 INFO:tasks.workunit.client.0.smithi144.stderr: -429> 2024-06-04T16:13:24.090+0000 7f816bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-06-04T16:13:24.376 INFO:tasks.workunit.client.0.smithi144.stderr: -428> 2024-06-04T16:13:24.090+0000 7f8171865640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-06-04T16:13:24.376 INFO:tasks.workunit.client.0.smithi144.stderr: -427> 2024-06-04T16:13:24.090+0000 7f8171865640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-06-04T16:13:24.376 INFO:tasks.workunit.client.0.smithi144.stderr: -426> 2024-06-04T16:13:24.090+0000 7f8171865640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-06-04T16:13:24.376 INFO:tasks.workunit.client.0.smithi144.stderr: -425> 2024-06-04T16:13:24.090+0000 7f816bfff640 10 monclient(hunting): handle_auth_done global_id 6557 payload 824 2024-06-04T16:13:24.376 INFO:tasks.workunit.client.0.smithi144.stderr: -424> 2024-06-04T16:13:24.090+0000 7f816bfff640 10 monclient: _finish_hunting 0 2024-06-04T16:13:24.376 INFO:tasks.workunit.client.0.smithi144.stderr: -423> 2024-06-04T16:13:24.090+0000 7f816bfff640 1 monclient: found mon.noname-c 2024-06-04T16:13:24.376 INFO:tasks.workunit.client.0.smithi144.stderr: -422> 2024-06-04T16:13:24.090+0000 7f816bfff640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.144:3301/0 2024-06-04T16:13:24.376 INFO:tasks.workunit.client.0.smithi144.stderr: -421> 2024-06-04T16:13:24.090+0000 7f805de03640 10 monclient: handle_monmap mon_map magic: 0 2024-06-04T16:13:24.376 INFO:tasks.workunit.client.0.smithi144.stderr: -420> 2024-06-04T16:13:24.090+0000 7f805de03640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-06-04T16:13:24.377 INFO:tasks.workunit.client.0.smithi144.stderr: -419> 2024-06-04T16:13:24.090+0000 7f805de03640 10 monclient: dump: 2024-06-04T16:13:24.377 INFO:tasks.workunit.client.0.smithi144.stderr:epoch 1 2024-06-04T16:13:24.377 INFO:tasks.workunit.client.0.smithi144.stderr:fsid 15e56bb1-4856-42f3-b6db-a2c8f23c5557 2024-06-04T16:13:24.377 INFO:tasks.workunit.client.0.smithi144.stderr:last_changed 2024-06-04T15:51:29.789359+0000 2024-06-04T16:13:24.377 INFO:tasks.workunit.client.0.smithi144.stderr:created 2024-06-04T15:51:29.789359+0000 2024-06-04T16:13:24.377 INFO:tasks.workunit.client.0.smithi144.stderr:min_mon_release 19 (squid) 2024-06-04T16:13:24.377 INFO:tasks.workunit.client.0.smithi144.stderr:election_strategy: 1 2024-06-04T16:13:24.377 INFO:tasks.workunit.client.0.smithi144.stderr:0: [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] mon.a 2024-06-04T16:13:24.377 INFO:tasks.workunit.client.0.smithi144.stderr:1: [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] mon.b 2024-06-04T16:13:24.377 INFO:tasks.workunit.client.0.smithi144.stderr:2: [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] mon.c 2024-06-04T16:13:24.377 INFO:tasks.workunit.client.0.smithi144.stderr: 2024-06-04T16:13:24.378 INFO:tasks.workunit.client.0.smithi144.stderr: -418> 2024-06-04T16:13:24.090+0000 7f805de03640 10 monclient: _finish_auth 0 2024-06-04T16:13:24.378 INFO:tasks.workunit.client.0.smithi144.stderr: -417> 2024-06-04T16:13:24.090+0000 7f805de03640 10 monclient: _check_auth_tickets 2024-06-04T16:13:24.378 INFO:tasks.workunit.client.0.smithi144.stderr: -416> 2024-06-04T16:13:24.090+0000 7f805de03640 10 monclient: handle_config config(0 keys) 2024-06-04T16:13:24.378 INFO:tasks.workunit.client.0.smithi144.stderr: -415> 2024-06-04T16:13:24.090+0000 7f805de03640 10 monclient: handle_monmap mon_map magic: 0 2024-06-04T16:13:24.378 INFO:tasks.workunit.client.0.smithi144.stderr: -414> 2024-06-04T16:13:24.090+0000 7f805de03640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-06-04T16:13:24.378 INFO:tasks.workunit.client.0.smithi144.stderr: -413> 2024-06-04T16:13:24.090+0000 7f805de03640 10 monclient: dump: 2024-06-04T16:13:24.378 INFO:tasks.workunit.client.0.smithi144.stderr:epoch 1 2024-06-04T16:13:24.378 INFO:tasks.workunit.client.0.smithi144.stderr:fsid 15e56bb1-4856-42f3-b6db-a2c8f23c5557 2024-06-04T16:13:24.378 INFO:tasks.workunit.client.0.smithi144.stderr:last_changed 2024-06-04T15:51:29.789359+0000 2024-06-04T16:13:24.379 INFO:tasks.workunit.client.0.smithi144.stderr:created 2024-06-04T15:51:29.789359+0000 2024-06-04T16:13:24.379 INFO:tasks.workunit.client.0.smithi144.stderr:min_mon_release 19 (squid) 2024-06-04T16:13:24.379 INFO:tasks.workunit.client.0.smithi144.stderr:election_strategy: 1 2024-06-04T16:13:24.379 INFO:tasks.workunit.client.0.smithi144.stderr:0: [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] mon.a 2024-06-04T16:13:24.379 INFO:tasks.workunit.client.0.smithi144.stderr:1: [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] mon.b 2024-06-04T16:13:24.379 INFO:tasks.workunit.client.0.smithi144.stderr:2: [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] mon.c 2024-06-04T16:13:24.379 INFO:tasks.workunit.client.0.smithi144.stderr: 2024-06-04T16:13:24.379 INFO:tasks.workunit.client.0.smithi144.stderr: -412> 2024-06-04T16:13:24.090+0000 7f8175a13800 5 monclient: authenticate success, global_id 6557 2024-06-04T16:13:24.379 INFO:tasks.workunit.client.0.smithi144.stderr: -411> 2024-06-04T16:13:24.090+0000 7f8175a13800 10 monclient: _renew_subs 2024-06-04T16:13:24.379 INFO:tasks.workunit.client.0.smithi144.stderr: -410> 2024-06-04T16:13:24.090+0000 7f805f606640 4 set_mon_vals no callback set 2024-06-04T16:13:24.379 INFO:tasks.workunit.client.0.smithi144.stderr: -409> 2024-06-04T16:13:24.090+0000 7f8175a13800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.144:3301/0 2024-06-04T16:13:24.379 INFO:tasks.workunit.client.0.smithi144.stderr: -408> 2024-06-04T16:13:24.090+0000 7f8175a13800 10 monclient: _renew_subs 2024-06-04T16:13:24.379 INFO:tasks.workunit.client.0.smithi144.stderr: -407> 2024-06-04T16:13:24.090+0000 7f8175a13800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.144:3301/0 2024-06-04T16:13:24.380 INFO:tasks.workunit.client.0.smithi144.stderr: -406> 2024-06-04T16:13:24.090+0000 7f8175a13800 1 librados: init done 2024-06-04T16:13:24.380 INFO:tasks.workunit.client.0.smithi144.stderr: -405> 2024-06-04T16:13:24.092+0000 7f805de03640 4 mgrc handle_mgr_map Got map version 5 2024-06-04T16:13:24.380 INFO:tasks.workunit.client.0.smithi144.stderr: -404> 2024-06-04T16:13:24.092+0000 7f805de03640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.177:6832/2645786330,v1:172.21.15.177:6833/2645786330] 2024-06-04T16:13:24.380 INFO:tasks.workunit.client.0.smithi144.stderr: -403> 2024-06-04T16:13:24.092+0000 7f805de03640 4 mgrc reconnect Starting new session with [v2:172.21.15.177:6832/2645786330,v1:172.21.15.177:6833/2645786330] 2024-06-04T16:13:24.380 INFO:tasks.workunit.client.0.smithi144.stderr: -402> 2024-06-04T16:13:24.092+0000 7f8171064640 10 monclient: get_auth_request con 0x7f8058074cb0 auth_method 0 2024-06-04T16:13:24.380 INFO:tasks.workunit.client.0.smithi144.stderr: -401> 2024-06-04T16:13:24.092+0000 7f8171865640 10 monclient: get_auth_request con 0x55b5cb760690 auth_method 0 2024-06-04T16:13:24.380 INFO:tasks.workunit.client.0.smithi144.stderr: -400> 2024-06-04T16:13:24.093+0000 7f8171064640 10 monclient: get_auth_request con 0x55b5cb763870 auth_method 0 2024-06-04T16:13:24.380 INFO:tasks.workunit.client.0.smithi144.stderr: -399> 2024-06-04T16:13:24.094+0000 7f816bfff640 10 monclient: get_auth_request con 0x55b5cb767a60 auth_method 0 2024-06-04T16:13:24.380 INFO:tasks.workunit.client.0.smithi144.stderr: -398> 2024-06-04T16:13:24.095+0000 7f8171865640 10 monclient: get_auth_request con 0x55b5cb767150 auth_method 0 2024-06-04T16:13:24.380 INFO:tasks.workunit.client.0.smithi144.stderr: -397> 2024-06-04T16:13:24.095+0000 7f8175a13800 10 monclient: build_initial_monmap 2024-06-04T16:13:24.380 INFO:tasks.workunit.client.0.smithi144.stderr: -396> 2024-06-04T16:13:24.095+0000 7f8175a13800 1 build_initial for_mkfs: 0 2024-06-04T16:13:24.380 INFO:tasks.workunit.client.0.smithi144.stderr: -395> 2024-06-04T16:13:24.095+0000 7f8175a13800 10 monclient: monmap: 2024-06-04T16:13:24.380 INFO:tasks.workunit.client.0.smithi144.stderr:epoch 0 2024-06-04T16:13:24.381 INFO:tasks.workunit.client.0.smithi144.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-06-04T16:13:24.381 INFO:tasks.workunit.client.0.smithi144.stderr:last_changed 0.000000 2024-06-04T16:13:24.381 INFO:tasks.workunit.client.0.smithi144.stderr:created 0.000000 2024-06-04T16:13:24.381 INFO:tasks.workunit.client.0.smithi144.stderr:min_mon_release 0 (unknown) 2024-06-04T16:13:24.381 INFO:tasks.workunit.client.0.smithi144.stderr:election_strategy: 1 2024-06-04T16:13:24.381 INFO:tasks.workunit.client.0.smithi144.stderr:0: [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] mon.noname-a 2024-06-04T16:13:24.381 INFO:tasks.workunit.client.0.smithi144.stderr:1: [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] mon.noname-b 2024-06-04T16:13:24.381 INFO:tasks.workunit.client.0.smithi144.stderr:2: [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] mon.noname-c 2024-06-04T16:13:24.381 INFO:tasks.workunit.client.0.smithi144.stderr: 2024-06-04T16:13:24.381 INFO:tasks.workunit.client.0.smithi144.stderr: -394> 2024-06-04T16:13:24.095+0000 7f8175a13800 5 AuthRegistry(0x55b5cb76faa0) adding auth protocol: cephx 2024-06-04T16:13:24.381 INFO:tasks.workunit.client.0.smithi144.stderr: -393> 2024-06-04T16:13:24.095+0000 7f8175a13800 5 AuthRegistry(0x55b5cb76faa0) adding auth protocol: cephx 2024-06-04T16:13:24.381 INFO:tasks.workunit.client.0.smithi144.stderr: -392> 2024-06-04T16:13:24.095+0000 7f8175a13800 5 AuthRegistry(0x55b5cb76faa0) adding auth protocol: cephx 2024-06-04T16:13:24.381 INFO:tasks.workunit.client.0.smithi144.stderr: -391> 2024-06-04T16:13:24.095+0000 7f8175a13800 5 AuthRegistry(0x55b5cb76faa0) adding con mode: secure 2024-06-04T16:13:24.381 INFO:tasks.workunit.client.0.smithi144.stderr: -390> 2024-06-04T16:13:24.095+0000 7f8175a13800 5 AuthRegistry(0x55b5cb76faa0) adding con mode: crc 2024-06-04T16:13:24.382 INFO:tasks.workunit.client.0.smithi144.stderr: -389> 2024-06-04T16:13:24.095+0000 7f8175a13800 5 AuthRegistry(0x55b5cb76faa0) adding con mode: secure 2024-06-04T16:13:24.382 INFO:tasks.workunit.client.0.smithi144.stderr: -388> 2024-06-04T16:13:24.095+0000 7f8175a13800 5 AuthRegistry(0x55b5cb76faa0) adding con mode: crc 2024-06-04T16:13:24.382 INFO:tasks.workunit.client.0.smithi144.stderr: -387> 2024-06-04T16:13:24.095+0000 7f8175a13800 5 AuthRegistry(0x55b5cb76faa0) adding con mode: secure 2024-06-04T16:13:24.382 INFO:tasks.workunit.client.0.smithi144.stderr: -386> 2024-06-04T16:13:24.095+0000 7f8175a13800 5 AuthRegistry(0x55b5cb76faa0) adding con mode: crc 2024-06-04T16:13:24.382 INFO:tasks.workunit.client.0.smithi144.stderr: -385> 2024-06-04T16:13:24.095+0000 7f8175a13800 5 AuthRegistry(0x55b5cb76faa0) adding con mode: crc 2024-06-04T16:13:24.382 INFO:tasks.workunit.client.0.smithi144.stderr: -384> 2024-06-04T16:13:24.095+0000 7f8175a13800 5 AuthRegistry(0x55b5cb76faa0) adding con mode: secure 2024-06-04T16:13:24.382 INFO:tasks.workunit.client.0.smithi144.stderr: -383> 2024-06-04T16:13:24.095+0000 7f8175a13800 5 AuthRegistry(0x55b5cb76faa0) adding con mode: crc 2024-06-04T16:13:24.382 INFO:tasks.workunit.client.0.smithi144.stderr: -382> 2024-06-04T16:13:24.095+0000 7f8175a13800 5 AuthRegistry(0x55b5cb76faa0) adding con mode: secure 2024-06-04T16:13:24.382 INFO:tasks.workunit.client.0.smithi144.stderr: -381> 2024-06-04T16:13:24.095+0000 7f8175a13800 5 AuthRegistry(0x55b5cb76faa0) adding con mode: crc 2024-06-04T16:13:24.382 INFO:tasks.workunit.client.0.smithi144.stderr: -380> 2024-06-04T16:13:24.095+0000 7f8175a13800 5 AuthRegistry(0x55b5cb76faa0) adding con mode: secure 2024-06-04T16:13:24.383 INFO:tasks.workunit.client.0.smithi144.stderr: -379> 2024-06-04T16:13:24.096+0000 7f8175a13800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-06-04T16:13:24.383 INFO:tasks.workunit.client.0.smithi144.stderr: -378> 2024-06-04T16:13:24.096+0000 7f8175a13800 5 asok(0x55b5cb4f7c60) register_command objecter_requests cmddesc objecter_requests hook 0x55b5cb772f70 EEXIST 2024-06-04T16:13:24.383 INFO:tasks.workunit.client.0.smithi144.stderr: -377> 2024-06-04T16:13:24.096+0000 7f8175a13800 10 monclient: init 2024-06-04T16:13:24.383 INFO:tasks.workunit.client.0.smithi144.stderr: -376> 2024-06-04T16:13:24.096+0000 7f8175a13800 5 AuthRegistry(0x55b5cb76ea28) adding auth protocol: cephx 2024-06-04T16:13:24.383 INFO:tasks.workunit.client.0.smithi144.stderr: -375> 2024-06-04T16:13:24.096+0000 7f8175a13800 5 AuthRegistry(0x55b5cb76ea28) adding auth protocol: cephx 2024-06-04T16:13:24.383 INFO:tasks.workunit.client.0.smithi144.stderr: -374> 2024-06-04T16:13:24.096+0000 7f8175a13800 5 AuthRegistry(0x55b5cb76ea28) adding auth protocol: cephx 2024-06-04T16:13:24.383 INFO:tasks.workunit.client.0.smithi144.stderr: -373> 2024-06-04T16:13:24.096+0000 7f8175a13800 5 AuthRegistry(0x55b5cb76ea28) adding con mode: secure 2024-06-04T16:13:24.383 INFO:tasks.workunit.client.0.smithi144.stderr: -372> 2024-06-04T16:13:24.096+0000 7f8175a13800 5 AuthRegistry(0x55b5cb76ea28) adding con mode: crc 2024-06-04T16:13:24.384 INFO:tasks.workunit.client.0.smithi144.stderr: -371> 2024-06-04T16:13:24.096+0000 7f8175a13800 5 AuthRegistry(0x55b5cb76ea28) adding con mode: secure 2024-06-04T16:13:24.384 INFO:tasks.workunit.client.0.smithi144.stderr: -370> 2024-06-04T16:13:24.096+0000 7f8175a13800 5 AuthRegistry(0x55b5cb76ea28) adding con mode: crc 2024-06-04T16:13:24.384 INFO:tasks.workunit.client.0.smithi144.stderr: -369> 2024-06-04T16:13:24.096+0000 7f8175a13800 5 AuthRegistry(0x55b5cb76ea28) adding con mode: secure 2024-06-04T16:13:24.384 INFO:tasks.workunit.client.0.smithi144.stderr: -368> 2024-06-04T16:13:24.096+0000 7f8175a13800 5 AuthRegistry(0x55b5cb76ea28) adding con mode: crc 2024-06-04T16:13:24.384 INFO:tasks.workunit.client.0.smithi144.stderr: -367> 2024-06-04T16:13:24.096+0000 7f8175a13800 5 AuthRegistry(0x55b5cb76ea28) adding con mode: crc 2024-06-04T16:13:24.384 INFO:tasks.workunit.client.0.smithi144.stderr: -366> 2024-06-04T16:13:24.096+0000 7f8175a13800 5 AuthRegistry(0x55b5cb76ea28) adding con mode: secure 2024-06-04T16:13:24.384 INFO:tasks.workunit.client.0.smithi144.stderr: -365> 2024-06-04T16:13:24.096+0000 7f8175a13800 5 AuthRegistry(0x55b5cb76ea28) adding con mode: crc 2024-06-04T16:13:24.384 INFO:tasks.workunit.client.0.smithi144.stderr: -364> 2024-06-04T16:13:24.096+0000 7f8175a13800 5 AuthRegistry(0x55b5cb76ea28) adding con mode: secure 2024-06-04T16:13:24.385 INFO:tasks.workunit.client.0.smithi144.stderr: -363> 2024-06-04T16:13:24.096+0000 7f8175a13800 5 AuthRegistry(0x55b5cb76ea28) adding con mode: crc 2024-06-04T16:13:24.385 INFO:tasks.workunit.client.0.smithi144.stderr: -362> 2024-06-04T16:13:24.096+0000 7f8175a13800 5 AuthRegistry(0x55b5cb76ea28) adding con mode: secure 2024-06-04T16:13:24.385 INFO:tasks.workunit.client.0.smithi144.stderr: -361> 2024-06-04T16:13:24.096+0000 7f8175a13800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-06-04T16:13:24.385 INFO:tasks.workunit.client.0.smithi144.stderr: -360> 2024-06-04T16:13:24.096+0000 7f8175a13800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-06-04T16:13:24.385 INFO:tasks.workunit.client.0.smithi144.stderr: -359> 2024-06-04T16:13:24.096+0000 7f8175a13800 5 asok(0x55b5cb4f7c60) register_command rotate-key cmddesc rotate-key hook 0x55b5cb76eb70 EEXIST 2024-06-04T16:13:24.385 INFO:tasks.workunit.client.0.smithi144.stderr: -358> 2024-06-04T16:13:24.096+0000 7f8175a13800 10 monclient: _reopen_session rank -1 2024-06-04T16:13:24.385 INFO:tasks.workunit.client.0.smithi144.stderr: -357> 2024-06-04T16:13:24.096+0000 7f8175a13800 10 monclient: _add_conns ranks=[2,1,0] 2024-06-04T16:13:24.385 INFO:tasks.workunit.client.0.smithi144.stderr: -356> 2024-06-04T16:13:24.096+0000 7f8175a13800 10 monclient(hunting): picked mon.noname-c con 0x55b5cb77a0e0 addr [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] 2024-06-04T16:13:24.386 INFO:tasks.workunit.client.0.smithi144.stderr: -355> 2024-06-04T16:13:24.096+0000 7f8175a13800 10 monclient(hunting): picked mon.noname-b con 0x55b5cb77a4c0 addr [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] 2024-06-04T16:13:24.386 INFO:tasks.workunit.client.0.smithi144.stderr: -354> 2024-06-04T16:13:24.096+0000 7f8175a13800 10 monclient(hunting): picked mon.noname-a con 0x55b5cb79c810 addr [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] 2024-06-04T16:13:24.386 INFO:tasks.workunit.client.0.smithi144.stderr: -353> 2024-06-04T16:13:24.096+0000 7f8175a13800 10 monclient(hunting): start opening mon connection 2024-06-04T16:13:24.386 INFO:tasks.workunit.client.0.smithi144.stderr: -352> 2024-06-04T16:13:24.096+0000 7f8175a13800 10 monclient(hunting): start opening mon connection 2024-06-04T16:13:24.386 INFO:tasks.workunit.client.0.smithi144.stderr: -351> 2024-06-04T16:13:24.096+0000 7f8175a13800 10 monclient(hunting): start opening mon connection 2024-06-04T16:13:24.386 INFO:tasks.workunit.client.0.smithi144.stderr: -350> 2024-06-04T16:13:24.096+0000 7f8175a13800 10 monclient(hunting): _renew_subs 2024-06-04T16:13:24.386 INFO:tasks.workunit.client.0.smithi144.stderr: -349> 2024-06-04T16:13:24.096+0000 7f8175a13800 10 monclient(hunting): authenticate will time out at 2041.912969s 2024-06-04T16:13:24.386 INFO:tasks.workunit.client.0.smithi144.stderr: -348> 2024-06-04T16:13:24.096+0000 7f816bfff640 10 monclient(hunting): get_auth_request con 0x55b5cb77a0e0 auth_method 0 2024-06-04T16:13:24.387 INFO:tasks.workunit.client.0.smithi144.stderr: -347> 2024-06-04T16:13:24.096+0000 7f816bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-06-04T16:13:24.387 INFO:tasks.workunit.client.0.smithi144.stderr: -346> 2024-06-04T16:13:24.096+0000 7f816bfff640 10 monclient(hunting): _init_auth method 2 2024-06-04T16:13:24.387 INFO:tasks.workunit.client.0.smithi144.stderr: -345> 2024-06-04T16:13:24.096+0000 7f816bfff640 10 monclient(hunting): _init_auth creating new auth 2024-06-04T16:13:24.387 INFO:tasks.workunit.client.0.smithi144.stderr: -344> 2024-06-04T16:13:24.096+0000 7f8171064640 10 monclient(hunting): get_auth_request con 0x55b5cb79c810 auth_method 0 2024-06-04T16:13:24.387 INFO:tasks.workunit.client.0.smithi144.stderr: -343> 2024-06-04T16:13:24.096+0000 7f8171064640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-06-04T16:13:24.387 INFO:tasks.workunit.client.0.smithi144.stderr: -342> 2024-06-04T16:13:24.096+0000 7f8171064640 10 monclient(hunting): _init_auth method 2 2024-06-04T16:13:24.388 INFO:tasks.workunit.client.0.smithi144.stderr: -341> 2024-06-04T16:13:24.096+0000 7f8171064640 10 monclient(hunting): _init_auth creating new auth 2024-06-04T16:13:24.388 INFO:tasks.workunit.client.0.smithi144.stderr: -340> 2024-06-04T16:13:24.097+0000 7f8171865640 10 monclient(hunting): get_auth_request con 0x55b5cb77a4c0 auth_method 0 2024-06-04T16:13:24.388 INFO:tasks.workunit.client.0.smithi144.stderr: -339> 2024-06-04T16:13:24.097+0000 7f8171865640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-06-04T16:13:24.388 INFO:tasks.workunit.client.0.smithi144.stderr: -338> 2024-06-04T16:13:24.097+0000 7f8171865640 10 monclient(hunting): _init_auth method 2 2024-06-04T16:13:24.388 INFO:tasks.workunit.client.0.smithi144.stderr: -337> 2024-06-04T16:13:24.097+0000 7f8171865640 10 monclient(hunting): _init_auth creating new auth 2024-06-04T16:13:24.388 INFO:tasks.workunit.client.0.smithi144.stderr: -336> 2024-06-04T16:13:24.097+0000 7f816bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-06-04T16:13:24.388 INFO:tasks.workunit.client.0.smithi144.stderr: -335> 2024-06-04T16:13:24.097+0000 7f816bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-06-04T16:13:24.389 INFO:tasks.workunit.client.0.smithi144.stderr: -334> 2024-06-04T16:13:24.097+0000 7f816bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-06-04T16:13:24.389 INFO:tasks.workunit.client.0.smithi144.stderr: -333> 2024-06-04T16:13:24.097+0000 7f8171064640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-06-04T16:13:24.389 INFO:tasks.workunit.client.0.smithi144.stderr: -332> 2024-06-04T16:13:24.097+0000 7f8171064640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-06-04T16:13:24.389 INFO:tasks.workunit.client.0.smithi144.stderr: -331> 2024-06-04T16:13:24.097+0000 7f8171064640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-06-04T16:13:24.389 INFO:tasks.workunit.client.0.smithi144.stderr: -330> 2024-06-04T16:13:24.097+0000 7f8171865640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-06-04T16:13:24.389 INFO:tasks.workunit.client.0.smithi144.stderr: -329> 2024-06-04T16:13:24.097+0000 7f8171865640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-06-04T16:13:24.389 INFO:tasks.workunit.client.0.smithi144.stderr: -328> 2024-06-04T16:13:24.097+0000 7f8171865640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-06-04T16:13:24.389 INFO:tasks.workunit.client.0.smithi144.stderr: -327> 2024-06-04T16:13:24.097+0000 7f816bfff640 10 monclient(hunting): handle_auth_done global_id 6560 payload 824 2024-06-04T16:13:24.390 INFO:tasks.workunit.client.0.smithi144.stderr: -326> 2024-06-04T16:13:24.097+0000 7f816bfff640 10 monclient: _finish_hunting 0 2024-06-04T16:13:24.390 INFO:tasks.workunit.client.0.smithi144.stderr: -325> 2024-06-04T16:13:24.097+0000 7f816bfff640 1 monclient: found mon.noname-c 2024-06-04T16:13:24.390 INFO:tasks.workunit.client.0.smithi144.stderr: -324> 2024-06-04T16:13:24.097+0000 7f816bfff640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.144:3301/0 2024-06-04T16:13:24.390 INFO:tasks.workunit.client.0.smithi144.stderr: -323> 2024-06-04T16:13:24.097+0000 7f8056ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-06-04T16:13:24.390 INFO:tasks.workunit.client.0.smithi144.stderr: -322> 2024-06-04T16:13:24.097+0000 7f8056ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-06-04T16:13:24.390 INFO:tasks.workunit.client.0.smithi144.stderr: -321> 2024-06-04T16:13:24.097+0000 7f8056ffd640 10 monclient: dump: 2024-06-04T16:13:24.390 INFO:tasks.workunit.client.0.smithi144.stderr:epoch 1 2024-06-04T16:13:24.390 INFO:tasks.workunit.client.0.smithi144.stderr:fsid 15e56bb1-4856-42f3-b6db-a2c8f23c5557 2024-06-04T16:13:24.391 INFO:tasks.workunit.client.0.smithi144.stderr:last_changed 2024-06-04T15:51:29.789359+0000 2024-06-04T16:13:24.391 INFO:tasks.workunit.client.0.smithi144.stderr:created 2024-06-04T15:51:29.789359+0000 2024-06-04T16:13:24.391 INFO:tasks.workunit.client.0.smithi144.stderr:min_mon_release 19 (squid) 2024-06-04T16:13:24.391 INFO:tasks.workunit.client.0.smithi144.stderr:election_strategy: 1 2024-06-04T16:13:24.391 INFO:tasks.workunit.client.0.smithi144.stderr:0: [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] mon.a 2024-06-04T16:13:24.391 INFO:tasks.workunit.client.0.smithi144.stderr:1: [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] mon.b 2024-06-04T16:13:24.391 INFO:tasks.workunit.client.0.smithi144.stderr:2: [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] mon.c 2024-06-04T16:13:24.391 INFO:tasks.workunit.client.0.smithi144.stderr: 2024-06-04T16:13:24.392 INFO:tasks.workunit.client.0.smithi144.stderr: -320> 2024-06-04T16:13:24.097+0000 7f8056ffd640 10 monclient: _finish_auth 0 2024-06-04T16:13:24.392 INFO:tasks.workunit.client.0.smithi144.stderr: -319> 2024-06-04T16:13:24.097+0000 7f8056ffd640 10 monclient: _check_auth_tickets 2024-06-04T16:13:24.392 INFO:tasks.workunit.client.0.smithi144.stderr: -318> 2024-06-04T16:13:24.097+0000 7f8056ffd640 10 monclient: handle_config config(0 keys) 2024-06-04T16:13:24.392 INFO:tasks.workunit.client.0.smithi144.stderr: -317> 2024-06-04T16:13:24.097+0000 7f8056ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-06-04T16:13:24.392 INFO:tasks.workunit.client.0.smithi144.stderr: -316> 2024-06-04T16:13:24.097+0000 7f8056ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-06-04T16:13:24.392 INFO:tasks.workunit.client.0.smithi144.stderr: -315> 2024-06-04T16:13:24.097+0000 7f8056ffd640 10 monclient: dump: 2024-06-04T16:13:24.392 INFO:tasks.workunit.client.0.smithi144.stderr:epoch 1 2024-06-04T16:13:24.392 INFO:tasks.workunit.client.0.smithi144.stderr:fsid 15e56bb1-4856-42f3-b6db-a2c8f23c5557 2024-06-04T16:13:24.392 INFO:tasks.workunit.client.0.smithi144.stderr:last_changed 2024-06-04T15:51:29.789359+0000 2024-06-04T16:13:24.393 INFO:tasks.workunit.client.0.smithi144.stderr:created 2024-06-04T15:51:29.789359+0000 2024-06-04T16:13:24.393 INFO:tasks.workunit.client.0.smithi144.stderr:min_mon_release 19 (squid) 2024-06-04T16:13:24.393 INFO:tasks.workunit.client.0.smithi144.stderr:election_strategy: 1 2024-06-04T16:13:24.393 INFO:tasks.workunit.client.0.smithi144.stderr:0: [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] mon.a 2024-06-04T16:13:24.393 INFO:tasks.workunit.client.0.smithi144.stderr:1: [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] mon.b 2024-06-04T16:13:24.393 INFO:tasks.workunit.client.0.smithi144.stderr:2: [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] mon.c 2024-06-04T16:13:24.393 INFO:tasks.workunit.client.0.smithi144.stderr: 2024-06-04T16:13:24.394 INFO:tasks.workunit.client.0.smithi144.stderr: -314> 2024-06-04T16:13:24.097+0000 7f8175a13800 5 monclient: authenticate success, global_id 6560 2024-06-04T16:13:24.394 INFO:tasks.workunit.client.0.smithi144.stderr: -313> 2024-06-04T16:13:24.097+0000 7f8175a13800 10 monclient: _renew_subs 2024-06-04T16:13:24.394 INFO:tasks.workunit.client.0.smithi144.stderr: -312> 2024-06-04T16:13:24.097+0000 7f8175a13800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.144:3301/0 2024-06-04T16:13:24.394 INFO:tasks.workunit.client.0.smithi144.stderr: -311> 2024-06-04T16:13:24.097+0000 7f8172066640 4 set_mon_vals no callback set 2024-06-04T16:13:24.394 INFO:tasks.workunit.client.0.smithi144.stderr: -310> 2024-06-04T16:13:24.097+0000 7f8175a13800 10 monclient: _renew_subs 2024-06-04T16:13:24.394 INFO:tasks.workunit.client.0.smithi144.stderr: -309> 2024-06-04T16:13:24.097+0000 7f8175a13800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.144:3301/0 2024-06-04T16:13:24.394 INFO:tasks.workunit.client.0.smithi144.stderr: -308> 2024-06-04T16:13:24.099+0000 7f8056ffd640 4 mgrc handle_mgr_map Got map version 5 2024-06-04T16:13:24.394 INFO:tasks.workunit.client.0.smithi144.stderr: -307> 2024-06-04T16:13:24.099+0000 7f8056ffd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.177:6832/2645786330,v1:172.21.15.177:6833/2645786330] 2024-06-04T16:13:24.395 INFO:tasks.workunit.client.0.smithi144.stderr: -306> 2024-06-04T16:13:24.099+0000 7f8056ffd640 4 mgrc reconnect Starting new session with [v2:172.21.15.177:6832/2645786330,v1:172.21.15.177:6833/2645786330] 2024-06-04T16:13:24.395 INFO:tasks.workunit.client.0.smithi144.stderr: -305> 2024-06-04T16:13:24.099+0000 7f8171865640 10 monclient: get_auth_request con 0x7f804c074bc0 auth_method 0 2024-06-04T16:13:24.395 INFO:tasks.workunit.client.0.smithi144.stderr: -304> 2024-06-04T16:13:24.099+0000 7f8175a13800 10 monclient: get_monmap_and_config 2024-06-04T16:13:24.395 INFO:tasks.workunit.client.0.smithi144.stderr: -303> 2024-06-04T16:13:24.099+0000 7f8175a13800 10 monclient: build_initial_monmap 2024-06-04T16:13:24.395 INFO:tasks.workunit.client.0.smithi144.stderr: -302> 2024-06-04T16:13:24.099+0000 7f8175a13800 1 build_initial for_mkfs: 0 2024-06-04T16:13:24.395 INFO:tasks.workunit.client.0.smithi144.stderr: -301> 2024-06-04T16:13:24.099+0000 7f8175a13800 10 monclient: monmap: 2024-06-04T16:13:24.395 INFO:tasks.workunit.client.0.smithi144.stderr:epoch 0 2024-06-04T16:13:24.395 INFO:tasks.workunit.client.0.smithi144.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-06-04T16:13:24.396 INFO:tasks.workunit.client.0.smithi144.stderr:last_changed 0.000000 2024-06-04T16:13:24.396 INFO:tasks.workunit.client.0.smithi144.stderr:created 0.000000 2024-06-04T16:13:24.396 INFO:tasks.workunit.client.0.smithi144.stderr:min_mon_release 0 (unknown) 2024-06-04T16:13:24.396 INFO:tasks.workunit.client.0.smithi144.stderr:election_strategy: 1 2024-06-04T16:13:24.396 INFO:tasks.workunit.client.0.smithi144.stderr:0: [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] mon.noname-a 2024-06-04T16:13:24.396 INFO:tasks.workunit.client.0.smithi144.stderr:1: [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] mon.noname-b 2024-06-04T16:13:24.396 INFO:tasks.workunit.client.0.smithi144.stderr:2: [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] mon.noname-c 2024-06-04T16:13:24.396 INFO:tasks.workunit.client.0.smithi144.stderr: 2024-06-04T16:13:24.396 INFO:tasks.workunit.client.0.smithi144.stderr: -300> 2024-06-04T16:13:24.099+0000 7f8175a13800 5 AuthRegistry(0x55b5cb7b7130) adding auth protocol: cephx 2024-06-04T16:13:24.397 INFO:tasks.workunit.client.0.smithi144.stderr: -299> 2024-06-04T16:13:24.099+0000 7f8175a13800 5 AuthRegistry(0x55b5cb7b7130) adding auth protocol: cephx 2024-06-04T16:13:24.397 INFO:tasks.workunit.client.0.smithi144.stderr: -298> 2024-06-04T16:13:24.099+0000 7f8175a13800 5 AuthRegistry(0x55b5cb7b7130) adding auth protocol: cephx 2024-06-04T16:13:24.397 INFO:tasks.workunit.client.0.smithi144.stderr: -297> 2024-06-04T16:13:24.099+0000 7f8175a13800 5 AuthRegistry(0x55b5cb7b7130) adding con mode: secure 2024-06-04T16:13:24.397 INFO:tasks.workunit.client.0.smithi144.stderr: -296> 2024-06-04T16:13:24.099+0000 7f8175a13800 5 AuthRegistry(0x55b5cb7b7130) adding con mode: crc 2024-06-04T16:13:24.397 INFO:tasks.workunit.client.0.smithi144.stderr: -295> 2024-06-04T16:13:24.099+0000 7f8175a13800 5 AuthRegistry(0x55b5cb7b7130) adding con mode: secure 2024-06-04T16:13:24.397 INFO:tasks.workunit.client.0.smithi144.stderr: -294> 2024-06-04T16:13:24.099+0000 7f8175a13800 5 AuthRegistry(0x55b5cb7b7130) adding con mode: crc 2024-06-04T16:13:24.398 INFO:tasks.workunit.client.0.smithi144.stderr: -293> 2024-06-04T16:13:24.099+0000 7f8175a13800 5 AuthRegistry(0x55b5cb7b7130) adding con mode: secure 2024-06-04T16:13:24.398 INFO:tasks.workunit.client.0.smithi144.stderr: -292> 2024-06-04T16:13:24.099+0000 7f8175a13800 5 AuthRegistry(0x55b5cb7b7130) adding con mode: crc 2024-06-04T16:13:24.398 INFO:tasks.workunit.client.0.smithi144.stderr: -291> 2024-06-04T16:13:24.099+0000 7f8175a13800 5 AuthRegistry(0x55b5cb7b7130) adding con mode: crc 2024-06-04T16:13:24.398 INFO:tasks.workunit.client.0.smithi144.stderr: -290> 2024-06-04T16:13:24.099+0000 7f8175a13800 5 AuthRegistry(0x55b5cb7b7130) adding con mode: secure 2024-06-04T16:13:24.398 INFO:tasks.workunit.client.0.smithi144.stderr: -289> 2024-06-04T16:13:24.099+0000 7f8175a13800 5 AuthRegistry(0x55b5cb7b7130) adding con mode: crc 2024-06-04T16:13:24.399 INFO:tasks.workunit.client.0.smithi144.stderr: -288> 2024-06-04T16:13:24.099+0000 7f8175a13800 5 AuthRegistry(0x55b5cb7b7130) adding con mode: secure 2024-06-04T16:13:24.399 INFO:tasks.workunit.client.0.smithi144.stderr: -287> 2024-06-04T16:13:24.099+0000 7f8175a13800 5 AuthRegistry(0x55b5cb7b7130) adding con mode: crc 2024-06-04T16:13:24.399 INFO:tasks.workunit.client.0.smithi144.stderr: -286> 2024-06-04T16:13:24.099+0000 7f8175a13800 5 AuthRegistry(0x55b5cb7b7130) adding con mode: secure 2024-06-04T16:13:24.399 INFO:tasks.workunit.client.0.smithi144.stderr: -285> 2024-06-04T16:13:24.099+0000 7f8175a13800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-06-04T16:13:24.400 INFO:tasks.workunit.client.0.smithi144.stderr: -284> 2024-06-04T16:13:24.099+0000 7f8175a13800 10 monclient: init 2024-06-04T16:13:24.400 INFO:tasks.workunit.client.0.smithi144.stderr: -283> 2024-06-04T16:13:24.099+0000 7f8175a13800 5 AuthRegistry(0x7fff6a9d0570) adding auth protocol: cephx 2024-06-04T16:13:24.400 INFO:tasks.workunit.client.0.smithi144.stderr: -282> 2024-06-04T16:13:24.099+0000 7f8175a13800 5 AuthRegistry(0x7fff6a9d0570) adding auth protocol: cephx 2024-06-04T16:13:24.401 INFO:tasks.workunit.client.0.smithi144.stderr: -281> 2024-06-04T16:13:24.099+0000 7f8175a13800 5 AuthRegistry(0x7fff6a9d0570) adding auth protocol: cephx 2024-06-04T16:13:24.401 INFO:tasks.workunit.client.0.smithi144.stderr: -280> 2024-06-04T16:13:24.099+0000 7f8175a13800 5 AuthRegistry(0x7fff6a9d0570) adding con mode: secure 2024-06-04T16:13:24.401 INFO:tasks.workunit.client.0.smithi144.stderr: -279> 2024-06-04T16:13:24.099+0000 7f8175a13800 5 AuthRegistry(0x7fff6a9d0570) adding con mode: crc 2024-06-04T16:13:24.404 INFO:tasks.workunit.client.0.smithi144.stderr: -278> 2024-06-04T16:13:24.099+0000 7f8175a13800 5 AuthRegistry(0x7fff6a9d0570) adding con mode: secure 2024-06-04T16:13:24.404 INFO:tasks.workunit.client.0.smithi144.stderr: -277> 2024-06-04T16:13:24.099+0000 7f8175a13800 5 AuthRegistry(0x7fff6a9d0570) adding con mode: crc 2024-06-04T16:13:24.404 INFO:tasks.workunit.client.0.smithi144.stderr: -276> 2024-06-04T16:13:24.099+0000 7f8175a13800 5 AuthRegistry(0x7fff6a9d0570) adding con mode: secure 2024-06-04T16:13:24.404 INFO:tasks.workunit.client.0.smithi144.stderr: -275> 2024-06-04T16:13:24.099+0000 7f8175a13800 5 AuthRegistry(0x7fff6a9d0570) adding con mode: crc 2024-06-04T16:13:24.404 INFO:tasks.workunit.client.0.smithi144.stderr: -274> 2024-06-04T16:13:24.099+0000 7f8175a13800 5 AuthRegistry(0x7fff6a9d0570) adding con mode: crc 2024-06-04T16:13:24.404 INFO:tasks.workunit.client.0.smithi144.stderr: -273> 2024-06-04T16:13:24.099+0000 7f8175a13800 5 AuthRegistry(0x7fff6a9d0570) adding con mode: secure 2024-06-04T16:13:24.404 INFO:tasks.workunit.client.0.smithi144.stderr: -272> 2024-06-04T16:13:24.099+0000 7f8175a13800 5 AuthRegistry(0x7fff6a9d0570) adding con mode: crc 2024-06-04T16:13:24.404 INFO:tasks.workunit.client.0.smithi144.stderr: -271> 2024-06-04T16:13:24.099+0000 7f8175a13800 5 AuthRegistry(0x7fff6a9d0570) adding con mode: secure 2024-06-04T16:13:24.404 INFO:tasks.workunit.client.0.smithi144.stderr: -270> 2024-06-04T16:13:24.099+0000 7f8175a13800 5 AuthRegistry(0x7fff6a9d0570) adding con mode: crc 2024-06-04T16:13:24.404 INFO:tasks.workunit.client.0.smithi144.stderr: -269> 2024-06-04T16:13:24.099+0000 7f8175a13800 5 AuthRegistry(0x7fff6a9d0570) adding con mode: secure 2024-06-04T16:13:24.405 INFO:tasks.workunit.client.0.smithi144.stderr: -268> 2024-06-04T16:13:24.099+0000 7f8175a13800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-06-04T16:13:24.405 INFO:tasks.workunit.client.0.smithi144.stderr: -267> 2024-06-04T16:13:24.100+0000 7f8175a13800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-06-04T16:13:24.405 INFO:tasks.workunit.client.0.smithi144.stderr: -266> 2024-06-04T16:13:24.100+0000 7f8175a13800 5 asok(0x55b5cb4f7c60) register_command rotate-key cmddesc rotate-key hook 0x7fff6a9d06b8 EEXIST 2024-06-04T16:13:24.405 INFO:tasks.workunit.client.0.smithi144.stderr: -265> 2024-06-04T16:13:24.100+0000 7f8175a13800 10 monclient: _reopen_session rank -1 2024-06-04T16:13:24.405 INFO:tasks.workunit.client.0.smithi144.stderr: -264> 2024-06-04T16:13:24.100+0000 7f8175a13800 10 monclient: _add_conns ranks=[1,2,0] 2024-06-04T16:13:24.405 INFO:tasks.workunit.client.0.smithi144.stderr: -263> 2024-06-04T16:13:24.100+0000 7f8175a13800 10 monclient(hunting): picked mon.noname-b con 0x55b5cb7dcfd0 addr [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] 2024-06-04T16:13:24.405 INFO:tasks.workunit.client.0.smithi144.stderr: -262> 2024-06-04T16:13:24.100+0000 7f8175a13800 10 monclient(hunting): picked mon.noname-c con 0x55b5cb7bc7d0 addr [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] 2024-06-04T16:13:24.405 INFO:tasks.workunit.client.0.smithi144.stderr: -261> 2024-06-04T16:13:24.100+0000 7f8175a13800 10 monclient(hunting): picked mon.noname-a con 0x55b5cb7e6f50 addr [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] 2024-06-04T16:13:24.405 INFO:tasks.workunit.client.0.smithi144.stderr: -260> 2024-06-04T16:13:24.100+0000 7f8175a13800 10 monclient(hunting): start opening mon connection 2024-06-04T16:13:24.405 INFO:tasks.workunit.client.0.smithi144.stderr: -259> 2024-06-04T16:13:24.100+0000 7f8175a13800 10 monclient(hunting): start opening mon connection 2024-06-04T16:13:24.405 INFO:tasks.workunit.client.0.smithi144.stderr: -258> 2024-06-04T16:13:24.100+0000 7f8175a13800 10 monclient(hunting): start opening mon connection 2024-06-04T16:13:24.405 INFO:tasks.workunit.client.0.smithi144.stderr: -257> 2024-06-04T16:13:24.100+0000 7f8175a13800 10 monclient(hunting): _renew_subs 2024-06-04T16:13:24.406 INFO:tasks.workunit.client.0.smithi144.stderr: -256> 2024-06-04T16:13:24.100+0000 7f8175a13800 10 monclient(hunting): authenticate will time out at 2041.916367s 2024-06-04T16:13:24.406 INFO:tasks.workunit.client.0.smithi144.stderr: -255> 2024-06-04T16:13:24.100+0000 7f8171865640 10 monclient(hunting): get_auth_request con 0x55b5cb7bc7d0 auth_method 0 2024-06-04T16:13:24.406 INFO:tasks.workunit.client.0.smithi144.stderr: -254> 2024-06-04T16:13:24.100+0000 7f8171865640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-06-04T16:13:24.406 INFO:tasks.workunit.client.0.smithi144.stderr: -253> 2024-06-04T16:13:24.100+0000 7f8171865640 10 monclient(hunting): _init_auth method 2 2024-06-04T16:13:24.406 INFO:tasks.workunit.client.0.smithi144.stderr: -252> 2024-06-04T16:13:24.100+0000 7f8171865640 10 monclient(hunting): _init_auth creating new auth 2024-06-04T16:13:24.406 INFO:tasks.workunit.client.0.smithi144.stderr: -251> 2024-06-04T16:13:24.100+0000 7f8171064640 10 monclient(hunting): get_auth_request con 0x55b5cb7e6f50 auth_method 0 2024-06-04T16:13:24.406 INFO:tasks.workunit.client.0.smithi144.stderr: -250> 2024-06-04T16:13:24.100+0000 7f8171064640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-06-04T16:13:24.406 INFO:tasks.workunit.client.0.smithi144.stderr: -249> 2024-06-04T16:13:24.100+0000 7f8171064640 10 monclient(hunting): _init_auth method 2 2024-06-04T16:13:24.406 INFO:tasks.workunit.client.0.smithi144.stderr: -248> 2024-06-04T16:13:24.100+0000 7f8171064640 10 monclient(hunting): _init_auth creating new auth 2024-06-04T16:13:24.406 INFO:tasks.workunit.client.0.smithi144.stderr: -247> 2024-06-04T16:13:24.100+0000 7f8171865640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-06-04T16:13:24.406 INFO:tasks.workunit.client.0.smithi144.stderr: -246> 2024-06-04T16:13:24.100+0000 7f8171865640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-06-04T16:13:24.406 INFO:tasks.workunit.client.0.smithi144.stderr: -245> 2024-06-04T16:13:24.100+0000 7f8171865640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-06-04T16:13:24.407 INFO:tasks.workunit.client.0.smithi144.stderr: -244> 2024-06-04T16:13:24.100+0000 7f8171064640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-06-04T16:13:24.407 INFO:tasks.workunit.client.0.smithi144.stderr: -243> 2024-06-04T16:13:24.100+0000 7f8171064640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-06-04T16:13:24.407 INFO:tasks.workunit.client.0.smithi144.stderr: -242> 2024-06-04T16:13:24.100+0000 7f8171064640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-06-04T16:13:24.407 INFO:tasks.workunit.client.0.smithi144.stderr: -241> 2024-06-04T16:13:24.100+0000 7f816bfff640 10 monclient(hunting): get_auth_request con 0x55b5cb7dcfd0 auth_method 0 2024-06-04T16:13:24.407 INFO:tasks.workunit.client.0.smithi144.stderr: -240> 2024-06-04T16:13:24.100+0000 7f816bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-06-04T16:13:24.407 INFO:tasks.workunit.client.0.smithi144.stderr: -239> 2024-06-04T16:13:24.100+0000 7f816bfff640 10 monclient(hunting): _init_auth method 2 2024-06-04T16:13:24.407 INFO:tasks.workunit.client.0.smithi144.stderr: -238> 2024-06-04T16:13:24.100+0000 7f816bfff640 10 monclient(hunting): _init_auth creating new auth 2024-06-04T16:13:24.407 INFO:tasks.workunit.client.0.smithi144.stderr: -237> 2024-06-04T16:13:24.100+0000 7f8171865640 10 monclient(hunting): handle_auth_done global_id 6563 payload 274 2024-06-04T16:13:24.407 INFO:tasks.workunit.client.0.smithi144.stderr: -236> 2024-06-04T16:13:24.100+0000 7f8171865640 10 monclient: _finish_hunting 0 2024-06-04T16:13:24.407 INFO:tasks.workunit.client.0.smithi144.stderr: -235> 2024-06-04T16:13:24.100+0000 7f8171865640 1 monclient: found mon.noname-c 2024-06-04T16:13:24.407 INFO:tasks.workunit.client.0.smithi144.stderr: -234> 2024-06-04T16:13:24.100+0000 7f8171865640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.144:3301/0 2024-06-04T16:13:24.407 INFO:tasks.workunit.client.0.smithi144.stderr: -233> 2024-06-04T16:13:24.100+0000 7f8054ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-06-04T16:13:24.408 INFO:tasks.workunit.client.0.smithi144.stderr: -232> 2024-06-04T16:13:24.100+0000 7f8054ff9640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-06-04T16:13:24.408 INFO:tasks.workunit.client.0.smithi144.stderr: -231> 2024-06-04T16:13:24.100+0000 7f8054ff9640 10 monclient: dump: 2024-06-04T16:13:24.408 INFO:tasks.workunit.client.0.smithi144.stderr:epoch 1 2024-06-04T16:13:24.408 INFO:tasks.workunit.client.0.smithi144.stderr:fsid 15e56bb1-4856-42f3-b6db-a2c8f23c5557 2024-06-04T16:13:24.408 INFO:tasks.workunit.client.0.smithi144.stderr:last_changed 2024-06-04T15:51:29.789359+0000 2024-06-04T16:13:24.408 INFO:tasks.workunit.client.0.smithi144.stderr:created 2024-06-04T15:51:29.789359+0000 2024-06-04T16:13:24.408 INFO:tasks.workunit.client.0.smithi144.stderr:min_mon_release 19 (squid) 2024-06-04T16:13:24.408 INFO:tasks.workunit.client.0.smithi144.stderr:election_strategy: 1 2024-06-04T16:13:24.408 INFO:tasks.workunit.client.0.smithi144.stderr:0: [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] mon.a 2024-06-04T16:13:24.408 INFO:tasks.workunit.client.0.smithi144.stderr:1: [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] mon.b 2024-06-04T16:13:24.408 INFO:tasks.workunit.client.0.smithi144.stderr:2: [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] mon.c 2024-06-04T16:13:24.408 INFO:tasks.workunit.client.0.smithi144.stderr: 2024-06-04T16:13:24.408 INFO:tasks.workunit.client.0.smithi144.stderr: -230> 2024-06-04T16:13:24.100+0000 7f8054ff9640 10 monclient: _finish_auth 0 2024-06-04T16:13:24.409 INFO:tasks.workunit.client.0.smithi144.stderr: -229> 2024-06-04T16:13:24.100+0000 7f8054ff9640 10 monclient: _check_auth_tickets 2024-06-04T16:13:24.409 INFO:tasks.workunit.client.0.smithi144.stderr: -228> 2024-06-04T16:13:24.100+0000 7f8054ff9640 10 monclient: handle_config config(0 keys) 2024-06-04T16:13:24.409 INFO:tasks.workunit.client.0.smithi144.stderr: -227> 2024-06-04T16:13:24.100+0000 7f8054ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-06-04T16:13:24.409 INFO:tasks.workunit.client.0.smithi144.stderr: -226> 2024-06-04T16:13:24.100+0000 7f8054ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-06-04T16:13:24.409 INFO:tasks.workunit.client.0.smithi144.stderr: -225> 2024-06-04T16:13:24.100+0000 7f8054ff9640 10 monclient: dump: 2024-06-04T16:13:24.409 INFO:tasks.workunit.client.0.smithi144.stderr:epoch 1 2024-06-04T16:13:24.409 INFO:tasks.workunit.client.0.smithi144.stderr:fsid 15e56bb1-4856-42f3-b6db-a2c8f23c5557 2024-06-04T16:13:24.410 INFO:tasks.workunit.client.0.smithi144.stderr:last_changed 2024-06-04T15:51:29.789359+0000 2024-06-04T16:13:24.410 INFO:tasks.workunit.client.0.smithi144.stderr:created 2024-06-04T15:51:29.789359+0000 2024-06-04T16:13:24.410 INFO:tasks.workunit.client.0.smithi144.stderr:min_mon_release 19 (squid) 2024-06-04T16:13:24.410 INFO:tasks.workunit.client.0.smithi144.stderr:election_strategy: 1 2024-06-04T16:13:24.410 INFO:tasks.workunit.client.0.smithi144.stderr:0: [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] mon.a 2024-06-04T16:13:24.410 INFO:tasks.workunit.client.0.smithi144.stderr:1: [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] mon.b 2024-06-04T16:13:24.410 INFO:tasks.workunit.client.0.smithi144.stderr:2: [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] mon.c 2024-06-04T16:13:24.410 INFO:tasks.workunit.client.0.smithi144.stderr: 2024-06-04T16:13:24.410 INFO:tasks.workunit.client.0.smithi144.stderr: -224> 2024-06-04T16:13:24.100+0000 7f8175a13800 5 monclient: authenticate success, global_id 6563 2024-06-04T16:13:24.410 INFO:tasks.workunit.client.0.smithi144.stderr: -223> 2024-06-04T16:13:24.100+0000 7f8175a13800 10 monclient: get_monmap_and_config success 2024-06-04T16:13:24.410 INFO:tasks.workunit.client.0.smithi144.stderr: -222> 2024-06-04T16:13:24.100+0000 7f8175a13800 4 set_mon_vals no callback set 2024-06-04T16:13:24.411 INFO:tasks.workunit.client.0.smithi144.stderr: -221> 2024-06-04T16:13:24.101+0000 7f8175a13800 10 monclient: shutdown 2024-06-04T16:13:24.411 INFO:tasks.workunit.client.0.smithi144.stderr: -220> 2024-06-04T16:13:24.101+0000 7f8175a13800 10 monclient: build_initial_monmap 2024-06-04T16:13:24.411 INFO:tasks.workunit.client.0.smithi144.stderr: -219> 2024-06-04T16:13:24.101+0000 7f8175a13800 1 build_initial for_mkfs: 0 2024-06-04T16:13:24.411 INFO:tasks.workunit.client.0.smithi144.stderr: -218> 2024-06-04T16:13:24.101+0000 7f8175a13800 10 monclient: monmap: 2024-06-04T16:13:24.411 INFO:tasks.workunit.client.0.smithi144.stderr:epoch 0 2024-06-04T16:13:24.411 INFO:tasks.workunit.client.0.smithi144.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-06-04T16:13:24.411 INFO:tasks.workunit.client.0.smithi144.stderr:last_changed 0.000000 2024-06-04T16:13:24.411 INFO:tasks.workunit.client.0.smithi144.stderr:created 0.000000 2024-06-04T16:13:24.411 INFO:tasks.workunit.client.0.smithi144.stderr:min_mon_release 0 (unknown) 2024-06-04T16:13:24.411 INFO:tasks.workunit.client.0.smithi144.stderr:election_strategy: 1 2024-06-04T16:13:24.412 INFO:tasks.workunit.client.0.smithi144.stderr:0: [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] mon.noname-a 2024-06-04T16:13:24.412 INFO:tasks.workunit.client.0.smithi144.stderr:1: [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] mon.noname-b 2024-06-04T16:13:24.412 INFO:tasks.workunit.client.0.smithi144.stderr:2: [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] mon.noname-c 2024-06-04T16:13:24.412 INFO:tasks.workunit.client.0.smithi144.stderr: 2024-06-04T16:13:24.412 INFO:tasks.workunit.client.0.smithi144.stderr: -217> 2024-06-04T16:13:24.101+0000 7f8175a13800 5 AuthRegistry(0x55b5cb7b7130) adding auth protocol: cephx 2024-06-04T16:13:24.412 INFO:tasks.workunit.client.0.smithi144.stderr: -216> 2024-06-04T16:13:24.101+0000 7f8175a13800 5 AuthRegistry(0x55b5cb7b7130) adding auth protocol: cephx 2024-06-04T16:13:24.412 INFO:tasks.workunit.client.0.smithi144.stderr: -215> 2024-06-04T16:13:24.101+0000 7f8175a13800 5 AuthRegistry(0x55b5cb7b7130) adding auth protocol: cephx 2024-06-04T16:13:24.412 INFO:tasks.workunit.client.0.smithi144.stderr: -214> 2024-06-04T16:13:24.101+0000 7f8175a13800 5 AuthRegistry(0x55b5cb7b7130) adding con mode: secure 2024-06-04T16:13:24.412 INFO:tasks.workunit.client.0.smithi144.stderr: -213> 2024-06-04T16:13:24.101+0000 7f8175a13800 5 AuthRegistry(0x55b5cb7b7130) adding con mode: crc 2024-06-04T16:13:24.412 INFO:tasks.workunit.client.0.smithi144.stderr: -212> 2024-06-04T16:13:24.101+0000 7f8175a13800 5 AuthRegistry(0x55b5cb7b7130) adding con mode: secure 2024-06-04T16:13:24.412 INFO:tasks.workunit.client.0.smithi144.stderr: -211> 2024-06-04T16:13:24.101+0000 7f8175a13800 5 AuthRegistry(0x55b5cb7b7130) adding con mode: crc 2024-06-04T16:13:24.412 INFO:tasks.workunit.client.0.smithi144.stderr: -210> 2024-06-04T16:13:24.101+0000 7f8175a13800 5 AuthRegistry(0x55b5cb7b7130) adding con mode: secure 2024-06-04T16:13:24.412 INFO:tasks.workunit.client.0.smithi144.stderr: -209> 2024-06-04T16:13:24.101+0000 7f8175a13800 5 AuthRegistry(0x55b5cb7b7130) adding con mode: crc 2024-06-04T16:13:24.413 INFO:tasks.workunit.client.0.smithi144.stderr: -208> 2024-06-04T16:13:24.101+0000 7f8175a13800 5 AuthRegistry(0x55b5cb7b7130) adding con mode: crc 2024-06-04T16:13:24.413 INFO:tasks.workunit.client.0.smithi144.stderr: -207> 2024-06-04T16:13:24.101+0000 7f8175a13800 5 AuthRegistry(0x55b5cb7b7130) adding con mode: secure 2024-06-04T16:13:24.413 INFO:tasks.workunit.client.0.smithi144.stderr: -206> 2024-06-04T16:13:24.101+0000 7f8175a13800 5 AuthRegistry(0x55b5cb7b7130) adding con mode: crc 2024-06-04T16:13:24.413 INFO:tasks.workunit.client.0.smithi144.stderr: -205> 2024-06-04T16:13:24.101+0000 7f8175a13800 5 AuthRegistry(0x55b5cb7b7130) adding con mode: secure 2024-06-04T16:13:24.413 INFO:tasks.workunit.client.0.smithi144.stderr: -204> 2024-06-04T16:13:24.101+0000 7f8175a13800 5 AuthRegistry(0x55b5cb7b7130) adding con mode: crc 2024-06-04T16:13:24.413 INFO:tasks.workunit.client.0.smithi144.stderr: -203> 2024-06-04T16:13:24.101+0000 7f8175a13800 5 AuthRegistry(0x55b5cb7b7130) adding con mode: secure 2024-06-04T16:13:24.413 INFO:tasks.workunit.client.0.smithi144.stderr: -202> 2024-06-04T16:13:24.101+0000 7f8175a13800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-06-04T16:13:24.413 INFO:tasks.workunit.client.0.smithi144.stderr: -201> 2024-06-04T16:13:24.101+0000 7f8175a13800 1 librados: starting msgr at 2024-06-04T16:13:24.413 INFO:tasks.workunit.client.0.smithi144.stderr: -200> 2024-06-04T16:13:24.101+0000 7f8175a13800 1 librados: starting objecter 2024-06-04T16:13:24.413 INFO:tasks.workunit.client.0.smithi144.stderr: -199> 2024-06-04T16:13:24.101+0000 7f8175a13800 5 asok(0x55b5cb4f7c60) register_command objecter_requests cmddesc objecter_requests hook 0x55b5cb7e6290 EEXIST 2024-06-04T16:13:24.413 INFO:tasks.workunit.client.0.smithi144.stderr: -198> 2024-06-04T16:13:24.101+0000 7f8175a13800 1 librados: setting wanted keys 2024-06-04T16:13:24.413 INFO:tasks.workunit.client.0.smithi144.stderr: -197> 2024-06-04T16:13:24.101+0000 7f8175a13800 1 librados: calling monclient init 2024-06-04T16:13:24.414 INFO:tasks.workunit.client.0.smithi144.stderr: -196> 2024-06-04T16:13:24.101+0000 7f8175a13800 10 monclient: init 2024-06-04T16:13:24.414 INFO:tasks.workunit.client.0.smithi144.stderr: -195> 2024-06-04T16:13:24.101+0000 7f8175a13800 5 AuthRegistry(0x55b5cb7b6320) adding auth protocol: cephx 2024-06-04T16:13:24.414 INFO:tasks.workunit.client.0.smithi144.stderr: -194> 2024-06-04T16:13:24.101+0000 7f8175a13800 5 AuthRegistry(0x55b5cb7b6320) adding auth protocol: cephx 2024-06-04T16:13:24.414 INFO:tasks.workunit.client.0.smithi144.stderr: -193> 2024-06-04T16:13:24.101+0000 7f8175a13800 5 AuthRegistry(0x55b5cb7b6320) adding auth protocol: cephx 2024-06-04T16:13:24.414 INFO:tasks.workunit.client.0.smithi144.stderr: -192> 2024-06-04T16:13:24.101+0000 7f8175a13800 5 AuthRegistry(0x55b5cb7b6320) adding con mode: secure 2024-06-04T16:13:24.414 INFO:tasks.workunit.client.0.smithi144.stderr: -191> 2024-06-04T16:13:24.101+0000 7f8175a13800 5 AuthRegistry(0x55b5cb7b6320) adding con mode: crc 2024-06-04T16:13:24.414 INFO:tasks.workunit.client.0.smithi144.stderr: -190> 2024-06-04T16:13:24.101+0000 7f8175a13800 5 AuthRegistry(0x55b5cb7b6320) adding con mode: secure 2024-06-04T16:13:24.414 INFO:tasks.workunit.client.0.smithi144.stderr: -189> 2024-06-04T16:13:24.101+0000 7f8175a13800 5 AuthRegistry(0x55b5cb7b6320) adding con mode: crc 2024-06-04T16:13:24.414 INFO:tasks.workunit.client.0.smithi144.stderr: -188> 2024-06-04T16:13:24.101+0000 7f8175a13800 5 AuthRegistry(0x55b5cb7b6320) adding con mode: secure 2024-06-04T16:13:24.414 INFO:tasks.workunit.client.0.smithi144.stderr: -187> 2024-06-04T16:13:24.101+0000 7f8175a13800 5 AuthRegistry(0x55b5cb7b6320) adding con mode: crc 2024-06-04T16:13:24.414 INFO:tasks.workunit.client.0.smithi144.stderr: -186> 2024-06-04T16:13:24.101+0000 7f8175a13800 5 AuthRegistry(0x55b5cb7b6320) adding con mode: crc 2024-06-04T16:13:24.415 INFO:tasks.workunit.client.0.smithi144.stderr: -185> 2024-06-04T16:13:24.101+0000 7f8175a13800 5 AuthRegistry(0x55b5cb7b6320) adding con mode: secure 2024-06-04T16:13:24.415 INFO:tasks.workunit.client.0.smithi144.stderr: -184> 2024-06-04T16:13:24.101+0000 7f8175a13800 5 AuthRegistry(0x55b5cb7b6320) adding con mode: crc 2024-06-04T16:13:24.415 INFO:tasks.workunit.client.0.smithi144.stderr: -183> 2024-06-04T16:13:24.101+0000 7f8175a13800 5 AuthRegistry(0x55b5cb7b6320) adding con mode: secure 2024-06-04T16:13:24.415 INFO:tasks.workunit.client.0.smithi144.stderr: -182> 2024-06-04T16:13:24.101+0000 7f8175a13800 5 AuthRegistry(0x55b5cb7b6320) adding con mode: crc 2024-06-04T16:13:24.415 INFO:tasks.workunit.client.0.smithi144.stderr: -181> 2024-06-04T16:13:24.101+0000 7f8175a13800 5 AuthRegistry(0x55b5cb7b6320) adding con mode: secure 2024-06-04T16:13:24.415 INFO:tasks.workunit.client.0.smithi144.stderr: -180> 2024-06-04T16:13:24.102+0000 7f8175a13800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-06-04T16:13:24.415 INFO:tasks.workunit.client.0.smithi144.stderr: -179> 2024-06-04T16:13:24.102+0000 7f8175a13800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-06-04T16:13:24.415 INFO:tasks.workunit.client.0.smithi144.stderr: -178> 2024-06-04T16:13:24.102+0000 7f8175a13800 5 asok(0x55b5cb4f7c60) register_command rotate-key cmddesc rotate-key hook 0x55b5cb7b6468 EEXIST 2024-06-04T16:13:24.415 INFO:tasks.workunit.client.0.smithi144.stderr: -177> 2024-06-04T16:13:24.102+0000 7f8175a13800 10 monclient: _reopen_session rank -1 2024-06-04T16:13:24.415 INFO:tasks.workunit.client.0.smithi144.stderr: -176> 2024-06-04T16:13:24.102+0000 7f8175a13800 10 monclient: _add_conns ranks=[1,0,2] 2024-06-04T16:13:24.415 INFO:tasks.workunit.client.0.smithi144.stderr: -175> 2024-06-04T16:13:24.102+0000 7f8175a13800 10 monclient(hunting): picked mon.noname-b con 0x55b5cb7bc7d0 addr [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] 2024-06-04T16:13:24.415 INFO:tasks.workunit.client.0.smithi144.stderr: -174> 2024-06-04T16:13:24.102+0000 7f8175a13800 10 monclient(hunting): picked mon.noname-a con 0x55b5cb7dcfd0 addr [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] 2024-06-04T16:13:24.416 INFO:tasks.workunit.client.0.smithi144.stderr: -173> 2024-06-04T16:13:24.102+0000 7f8175a13800 10 monclient(hunting): picked mon.noname-c con 0x55b5cb7e6f50 addr [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] 2024-06-04T16:13:24.416 INFO:tasks.workunit.client.0.smithi144.stderr: -172> 2024-06-04T16:13:24.102+0000 7f8175a13800 10 monclient(hunting): start opening mon connection 2024-06-04T16:13:24.416 INFO:tasks.workunit.client.0.smithi144.stderr: -171> 2024-06-04T16:13:24.102+0000 7f8175a13800 10 monclient(hunting): start opening mon connection 2024-06-04T16:13:24.416 INFO:tasks.workunit.client.0.smithi144.stderr: -170> 2024-06-04T16:13:24.102+0000 7f8175a13800 10 monclient(hunting): start opening mon connection 2024-06-04T16:13:24.416 INFO:tasks.workunit.client.0.smithi144.stderr: -169> 2024-06-04T16:13:24.102+0000 7f8175a13800 10 monclient(hunting): _renew_subs 2024-06-04T16:13:24.416 INFO:tasks.workunit.client.0.smithi144.stderr: -168> 2024-06-04T16:13:24.102+0000 7f8175a13800 10 monclient(hunting): authenticate will time out at 2041.918575s 2024-06-04T16:13:24.416 INFO:tasks.workunit.client.0.smithi144.stderr: -167> 2024-06-04T16:13:24.102+0000 7f8171064640 10 monclient(hunting): get_auth_request con 0x55b5cb7e6f50 auth_method 0 2024-06-04T16:13:24.416 INFO:tasks.workunit.client.0.smithi144.stderr: -166> 2024-06-04T16:13:24.102+0000 7f8171064640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-06-04T16:13:24.416 INFO:tasks.workunit.client.0.smithi144.stderr: -165> 2024-06-04T16:13:24.102+0000 7f8171064640 10 monclient(hunting): _init_auth method 2 2024-06-04T16:13:24.416 INFO:tasks.workunit.client.0.smithi144.stderr: -164> 2024-06-04T16:13:24.102+0000 7f8171064640 10 monclient(hunting): _init_auth creating new auth 2024-06-04T16:13:24.416 INFO:tasks.workunit.client.0.smithi144.stderr: -163> 2024-06-04T16:13:24.102+0000 7f8171865640 10 monclient(hunting): get_auth_request con 0x55b5cb7dcfd0 auth_method 0 2024-06-04T16:13:24.417 INFO:tasks.workunit.client.0.smithi144.stderr: -162> 2024-06-04T16:13:24.102+0000 7f8171865640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-06-04T16:13:24.417 INFO:tasks.workunit.client.0.smithi144.stderr: -161> 2024-06-04T16:13:24.102+0000 7f8171865640 10 monclient(hunting): _init_auth method 2 2024-06-04T16:13:24.417 INFO:tasks.workunit.client.0.smithi144.stderr: -160> 2024-06-04T16:13:24.102+0000 7f8171865640 10 monclient(hunting): _init_auth creating new auth 2024-06-04T16:13:24.417 INFO:tasks.workunit.client.0.smithi144.stderr: -159> 2024-06-04T16:13:24.102+0000 7f8171064640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-06-04T16:13:24.417 INFO:tasks.workunit.client.0.smithi144.stderr: -158> 2024-06-04T16:13:24.102+0000 7f8171064640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-06-04T16:13:24.417 INFO:tasks.workunit.client.0.smithi144.stderr: -157> 2024-06-04T16:13:24.102+0000 7f8171064640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-06-04T16:13:24.417 INFO:tasks.workunit.client.0.smithi144.stderr: -156> 2024-06-04T16:13:24.102+0000 7f8171865640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-06-04T16:13:24.417 INFO:tasks.workunit.client.0.smithi144.stderr: -155> 2024-06-04T16:13:24.102+0000 7f8171865640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-06-04T16:13:24.417 INFO:tasks.workunit.client.0.smithi144.stderr: -154> 2024-06-04T16:13:24.102+0000 7f8171865640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-06-04T16:13:24.417 INFO:tasks.workunit.client.0.smithi144.stderr: -153> 2024-06-04T16:13:24.102+0000 7f816bfff640 10 monclient(hunting): get_auth_request con 0x55b5cb7bc7d0 auth_method 0 2024-06-04T16:13:24.417 INFO:tasks.workunit.client.0.smithi144.stderr: -152> 2024-06-04T16:13:24.102+0000 7f816bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-06-04T16:13:24.417 INFO:tasks.workunit.client.0.smithi144.stderr: -151> 2024-06-04T16:13:24.102+0000 7f816bfff640 10 monclient(hunting): _init_auth method 2 2024-06-04T16:13:24.417 INFO:tasks.workunit.client.0.smithi144.stderr: -150> 2024-06-04T16:13:24.102+0000 7f816bfff640 10 monclient(hunting): _init_auth creating new auth 2024-06-04T16:13:24.418 INFO:tasks.workunit.client.0.smithi144.stderr: -149> 2024-06-04T16:13:24.102+0000 7f816bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-06-04T16:13:24.418 INFO:tasks.workunit.client.0.smithi144.stderr: -148> 2024-06-04T16:13:24.102+0000 7f816bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-06-04T16:13:24.418 INFO:tasks.workunit.client.0.smithi144.stderr: -147> 2024-06-04T16:13:24.102+0000 7f816bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-06-04T16:13:24.418 INFO:tasks.workunit.client.0.smithi144.stderr: -146> 2024-06-04T16:13:24.102+0000 7f8171064640 10 monclient(hunting): handle_auth_done global_id 6566 payload 824 2024-06-04T16:13:24.418 INFO:tasks.workunit.client.0.smithi144.stderr: -145> 2024-06-04T16:13:24.102+0000 7f8171064640 10 monclient: _finish_hunting 0 2024-06-04T16:13:24.418 INFO:tasks.workunit.client.0.smithi144.stderr: -144> 2024-06-04T16:13:24.102+0000 7f8171064640 1 monclient: found mon.noname-c 2024-06-04T16:13:24.418 INFO:tasks.workunit.client.0.smithi144.stderr: -143> 2024-06-04T16:13:24.102+0000 7f8171064640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.144:3301/0 2024-06-04T16:13:24.418 INFO:tasks.workunit.client.0.smithi144.stderr: -142> 2024-06-04T16:13:24.103+0000 7f8042ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-06-04T16:13:24.418 INFO:tasks.workunit.client.0.smithi144.stderr: -141> 2024-06-04T16:13:24.103+0000 7f8042ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-06-04T16:13:24.418 INFO:tasks.workunit.client.0.smithi144.stderr: -140> 2024-06-04T16:13:24.103+0000 7f8042ffd640 10 monclient: dump: 2024-06-04T16:13:24.418 INFO:tasks.workunit.client.0.smithi144.stderr:epoch 1 2024-06-04T16:13:24.419 INFO:tasks.workunit.client.0.smithi144.stderr:fsid 15e56bb1-4856-42f3-b6db-a2c8f23c5557 2024-06-04T16:13:24.419 INFO:tasks.workunit.client.0.smithi144.stderr:last_changed 2024-06-04T15:51:29.789359+0000 2024-06-04T16:13:24.419 INFO:tasks.workunit.client.0.smithi144.stderr:created 2024-06-04T15:51:29.789359+0000 2024-06-04T16:13:24.419 INFO:tasks.workunit.client.0.smithi144.stderr:min_mon_release 19 (squid) 2024-06-04T16:13:24.419 INFO:tasks.workunit.client.0.smithi144.stderr:election_strategy: 1 2024-06-04T16:13:24.419 INFO:tasks.workunit.client.0.smithi144.stderr:0: [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] mon.a 2024-06-04T16:13:24.419 INFO:tasks.workunit.client.0.smithi144.stderr:1: [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] mon.b 2024-06-04T16:13:24.419 INFO:tasks.workunit.client.0.smithi144.stderr:2: [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] mon.c 2024-06-04T16:13:24.419 INFO:tasks.workunit.client.0.smithi144.stderr: 2024-06-04T16:13:24.419 INFO:tasks.workunit.client.0.smithi144.stderr: -139> 2024-06-04T16:13:24.103+0000 7f8042ffd640 10 monclient: _finish_auth 0 2024-06-04T16:13:24.419 INFO:tasks.workunit.client.0.smithi144.stderr: -138> 2024-06-04T16:13:24.103+0000 7f8042ffd640 10 monclient: _check_auth_tickets 2024-06-04T16:13:24.420 INFO:tasks.workunit.client.0.smithi144.stderr: -137> 2024-06-04T16:13:24.103+0000 7f8042ffd640 10 monclient: handle_config config(0 keys) 2024-06-04T16:13:24.420 INFO:tasks.workunit.client.0.smithi144.stderr: -136> 2024-06-04T16:13:24.103+0000 7f8042ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-06-04T16:13:24.420 INFO:tasks.workunit.client.0.smithi144.stderr: -135> 2024-06-04T16:13:24.103+0000 7f8042ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-06-04T16:13:24.420 INFO:tasks.workunit.client.0.smithi144.stderr: -134> 2024-06-04T16:13:24.103+0000 7f8042ffd640 10 monclient: dump: 2024-06-04T16:13:24.420 INFO:tasks.workunit.client.0.smithi144.stderr:epoch 1 2024-06-04T16:13:24.420 INFO:tasks.workunit.client.0.smithi144.stderr:fsid 15e56bb1-4856-42f3-b6db-a2c8f23c5557 2024-06-04T16:13:24.420 INFO:tasks.workunit.client.0.smithi144.stderr:last_changed 2024-06-04T15:51:29.789359+0000 2024-06-04T16:13:24.420 INFO:tasks.workunit.client.0.smithi144.stderr:created 2024-06-04T15:51:29.789359+0000 2024-06-04T16:13:24.421 INFO:tasks.workunit.client.0.smithi144.stderr:min_mon_release 19 (squid) 2024-06-04T16:13:24.421 INFO:tasks.workunit.client.0.smithi144.stderr:election_strategy: 1 2024-06-04T16:13:24.421 INFO:tasks.workunit.client.0.smithi144.stderr:0: [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] mon.a 2024-06-04T16:13:24.421 INFO:tasks.workunit.client.0.smithi144.stderr:1: [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] mon.b 2024-06-04T16:13:24.421 INFO:tasks.workunit.client.0.smithi144.stderr:2: [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] mon.c 2024-06-04T16:13:24.421 INFO:tasks.workunit.client.0.smithi144.stderr: 2024-06-04T16:13:24.421 INFO:tasks.workunit.client.0.smithi144.stderr: -133> 2024-06-04T16:13:24.103+0000 7f8175a13800 5 monclient: authenticate success, global_id 6566 2024-06-04T16:13:24.422 INFO:tasks.workunit.client.0.smithi144.stderr: -132> 2024-06-04T16:13:24.103+0000 7f8175a13800 10 monclient: _renew_subs 2024-06-04T16:13:24.422 INFO:tasks.workunit.client.0.smithi144.stderr: -131> 2024-06-04T16:13:24.103+0000 7f8054ff9640 4 set_mon_vals no callback set 2024-06-04T16:13:24.422 INFO:tasks.workunit.client.0.smithi144.stderr: -130> 2024-06-04T16:13:24.103+0000 7f8175a13800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.144:3301/0 2024-06-04T16:13:24.422 INFO:tasks.workunit.client.0.smithi144.stderr: -129> 2024-06-04T16:13:24.103+0000 7f8175a13800 10 monclient: _renew_subs 2024-06-04T16:13:24.422 INFO:tasks.workunit.client.0.smithi144.stderr: -128> 2024-06-04T16:13:24.103+0000 7f8175a13800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.144:3301/0 2024-06-04T16:13:24.422 INFO:tasks.workunit.client.0.smithi144.stderr: -127> 2024-06-04T16:13:24.103+0000 7f8175a13800 1 librados: init done 2024-06-04T16:13:24.422 INFO:tasks.workunit.client.0.smithi144.stderr: -126> 2024-06-04T16:13:24.103+0000 7f8175a13800 5 asok(0x55b5cb4f7c60) register_command cr dump hook 0x55b5cb7f0ae8 2024-06-04T16:13:24.423 INFO:tasks.workunit.client.0.smithi144.stderr: -125> 2024-06-04T16:13:24.104+0000 7f8175a13800 20 rados->read ofs=0 len=0 2024-06-04T16:13:24.423 INFO:tasks.workunit.client.0.smithi144.stderr: -124> 2024-06-04T16:13:24.105+0000 7f8042ffd640 4 mgrc handle_mgr_map Got map version 5 2024-06-04T16:13:24.423 INFO:tasks.workunit.client.0.smithi144.stderr: -123> 2024-06-04T16:13:24.105+0000 7f8042ffd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.177:6832/2645786330,v1:172.21.15.177:6833/2645786330] 2024-06-04T16:13:24.423 INFO:tasks.workunit.client.0.smithi144.stderr: -122> 2024-06-04T16:13:24.105+0000 7f8042ffd640 4 mgrc reconnect Starting new session with [v2:172.21.15.177:6832/2645786330,v1:172.21.15.177:6833/2645786330] 2024-06-04T16:13:24.423 INFO:tasks.workunit.client.0.smithi144.stderr: -121> 2024-06-04T16:13:24.105+0000 7f816bfff640 10 monclient: get_auth_request con 0x7f803c074cb0 auth_method 0 2024-06-04T16:13:24.423 INFO:tasks.workunit.client.0.smithi144.stderr: -120> 2024-06-04T16:13:24.105+0000 7f8171865640 10 monclient: get_auth_request con 0x55b5cb805860 auth_method 0 2024-06-04T16:13:24.423 INFO:tasks.workunit.client.0.smithi144.stderr: -119> 2024-06-04T16:13:24.106+0000 7f8175a13800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:13:24.423 INFO:tasks.workunit.client.0.smithi144.stderr: -118> 2024-06-04T16:13:24.106+0000 7f8175a13800 20 realm 2024-06-04T16:13:24.423 INFO:tasks.workunit.client.0.smithi144.stderr: -117> 2024-06-04T16:13:24.106+0000 7f8175a13800 20 rados->read ofs=0 len=0 2024-06-04T16:13:24.424 INFO:tasks.workunit.client.0.smithi144.stderr: -116> 2024-06-04T16:13:24.106+0000 7f8175a13800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:13:24.424 INFO:tasks.workunit.client.0.smithi144.stderr: -115> 2024-06-04T16:13:24.106+0000 7f8175a13800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-06-04T16:13:24.424 INFO:tasks.workunit.client.0.smithi144.stderr: -114> 2024-06-04T16:13:24.106+0000 7f8175a13800 20 rados->read ofs=0 len=0 2024-06-04T16:13:24.424 INFO:tasks.workunit.client.0.smithi144.stderr: -113> 2024-06-04T16:13:24.106+0000 7f8175a13800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:13:24.424 INFO:tasks.workunit.client.0.smithi144.stderr: -112> 2024-06-04T16:13:24.106+0000 7f8175a13800 20 rados->read ofs=0 len=0 2024-06-04T16:13:24.424 INFO:tasks.workunit.client.0.smithi144.stderr: -111> 2024-06-04T16:13:24.106+0000 7f816bfff640 10 monclient: get_auth_request con 0x55b5cb809a80 auth_method 0 2024-06-04T16:13:24.424 INFO:tasks.workunit.client.0.smithi144.stderr: -110> 2024-06-04T16:13:24.107+0000 7f8175a13800 20 rados_obj.operate() r=0 bl.length=46 2024-06-04T16:13:24.424 INFO:tasks.workunit.client.0.smithi144.stderr: -109> 2024-06-04T16:13:24.107+0000 7f8175a13800 20 rados->read ofs=0 len=0 2024-06-04T16:13:24.425 INFO:tasks.workunit.client.0.smithi144.stderr: -108> 2024-06-04T16:13:24.107+0000 7f8171865640 10 monclient: get_auth_request con 0x55b5cb80d2e0 auth_method 0 2024-06-04T16:13:24.425 INFO:tasks.workunit.client.0.smithi144.stderr: -107> 2024-06-04T16:13:24.108+0000 7f8175a13800 20 rados_obj.operate() r=0 bl.length=1139 2024-06-04T16:13:24.425 INFO:tasks.workunit.client.0.smithi144.stderr: -106> 2024-06-04T16:13:24.108+0000 7f8175a13800 20 searching for the correct realm 2024-06-04T16:13:24.425 INFO:tasks.workunit.client.0.smithi144.stderr: -105> 2024-06-04T16:13:24.108+0000 7f8171064640 10 monclient: get_auth_request con 0x55b5cb811fe0 auth_method 0 2024-06-04T16:13:24.425 INFO:tasks.workunit.client.0.smithi144.stderr: -104> 2024-06-04T16:13:24.108+0000 7f816bfff640 10 monclient: get_auth_request con 0x7f8164057040 auth_method 0 2024-06-04T16:13:24.426 INFO:tasks.workunit.client.0.smithi144.stderr: -103> 2024-06-04T16:13:24.109+0000 7f816bfff640 0 -- 172.21.15.144:0/1507413648 >> [v2:172.21.15.144:6816/2358575268,v1:172.21.15.144:6817/2358575268] conn(0x55b5cb809a80 msgr2=0x55b5cb80beb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-06-04T16:13:24.426 INFO:tasks.workunit.client.0.smithi144.stderr: -102> 2024-06-04T16:13:24.109+0000 7f8042ffd640 1 client.6566.objecter ms_handle_reset 0x55b5cb809a80 session 0x55b5cb809400 osd.1 2024-06-04T16:13:24.426 INFO:tasks.workunit.client.0.smithi144.stderr: -101> 2024-06-04T16:13:24.109+0000 7f8042ffd640 10 monclient: _renew_subs 2024-06-04T16:13:24.426 INFO:tasks.workunit.client.0.smithi144.stderr: -100> 2024-06-04T16:13:24.109+0000 7f8042ffd640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.144:3301/0 2024-06-04T16:13:24.426 INFO:tasks.workunit.client.0.smithi144.stderr: -99> 2024-06-04T16:13:24.109+0000 7f8171865640 10 monclient: get_auth_request con 0x7f815c047040 auth_method 0 2024-06-04T16:13:24.426 INFO:tasks.workunit.client.0.smithi144.stderr: -98> 2024-06-04T16:13:24.110+0000 7f816bfff640 10 monclient: get_auth_request con 0x7f803c085060 auth_method 0 2024-06-04T16:13:24.426 INFO:tasks.workunit.client.0.smithi144.stderr: -97> 2024-06-04T16:13:24.110+0000 7f8171064640 10 monclient: get_auth_request con 0x7f81640aa3c0 auth_method 0 2024-06-04T16:13:24.427 INFO:tasks.workunit.client.0.smithi144.stderr: -96> 2024-06-04T16:13:24.112+0000 7f816bfff640 10 monclient: get_auth_request con 0x7f815c017030 auth_method 0 2024-06-04T16:13:24.427 INFO:tasks.workunit.client.0.smithi144.stderr: -95> 2024-06-04T16:13:24.112+0000 7f816bfff640 0 -- 172.21.15.144:0/1507413648 >> [v2:172.21.15.177:6808/2618477608,v1:172.21.15.177:6809/2618477608] conn(0x7f815c017030 msgr2=0x7f815c05f190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-06-04T16:13:24.427 INFO:tasks.workunit.client.0.smithi144.stderr: -94> 2024-06-04T16:13:24.313+0000 7f816bfff640 10 monclient: get_auth_request con 0x7f815c017030 auth_method 0 2024-06-04T16:13:24.427 INFO:tasks.workunit.client.0.smithi144.stderr: -93> 2024-06-04T16:13:24.318+0000 7f8175a13800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-06-04T16:13:24.427 INFO:tasks.workunit.client.0.smithi144.stderr: -92> 2024-06-04T16:13:24.318+0000 7f8175a13800 20 RGWRados::pool_iterate: got zone_info.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767 2024-06-04T16:13:24.427 INFO:tasks.workunit.client.0.smithi144.stderr: -91> 2024-06-04T16:13:24.318+0000 7f8175a13800 20 RGWRados::pool_iterate: got default.zone. 2024-06-04T16:13:24.427 INFO:tasks.workunit.client.0.smithi144.stderr: -90> 2024-06-04T16:13:24.318+0000 7f8175a13800 20 RGWRados::pool_iterate: got zonegroup_info.abb22408-c332-4e28-8f7a-ff254ea2fed2 2024-06-04T16:13:24.427 INFO:tasks.workunit.client.0.smithi144.stderr: -89> 2024-06-04T16:13:24.318+0000 7f8175a13800 20 RGWRados::pool_iterate: got zone_names.default 2024-06-04T16:13:24.427 INFO:tasks.workunit.client.0.smithi144.stderr: -88> 2024-06-04T16:13:24.318+0000 7f8175a13800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-06-04T16:13:24.427 INFO:tasks.workunit.client.0.smithi144.stderr: -87> 2024-06-04T16:13:24.318+0000 7f8175a13800 20 rados->read ofs=0 len=0 2024-06-04T16:13:24.427 INFO:tasks.workunit.client.0.smithi144.stderr: -86> 2024-06-04T16:13:24.318+0000 7f8175a13800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:13:24.428 INFO:tasks.workunit.client.0.smithi144.stderr: -85> 2024-06-04T16:13:24.318+0000 7f8175a13800 20 rados->read ofs=0 len=0 2024-06-04T16:13:24.428 INFO:tasks.workunit.client.0.smithi144.stderr: -84> 2024-06-04T16:13:24.319+0000 7f8175a13800 20 rados_obj.operate() r=0 bl.length=46 2024-06-04T16:13:24.428 INFO:tasks.workunit.client.0.smithi144.stderr: -83> 2024-06-04T16:13:24.319+0000 7f8175a13800 20 rados->read ofs=0 len=0 2024-06-04T16:13:24.428 INFO:tasks.workunit.client.0.smithi144.stderr: -82> 2024-06-04T16:13:24.319+0000 7f8175a13800 20 rados_obj.operate() r=0 bl.length=470 2024-06-04T16:13:24.428 INFO:tasks.workunit.client.0.smithi144.stderr: -81> 2024-06-04T16:13:24.319+0000 7f8175a13800 20 zone default found 2024-06-04T16:13:24.428 INFO:tasks.workunit.client.0.smithi144.stderr: -80> 2024-06-04T16:13:24.319+0000 7f8175a13800 4 Realm: () 2024-06-04T16:13:24.428 INFO:tasks.workunit.client.0.smithi144.stderr: -79> 2024-06-04T16:13:24.319+0000 7f8175a13800 4 ZoneGroup: default (abb22408-c332-4e28-8f7a-ff254ea2fed2) 2024-06-04T16:13:24.428 INFO:tasks.workunit.client.0.smithi144.stderr: -78> 2024-06-04T16:13:24.319+0000 7f8175a13800 4 Zone: default (be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767) 2024-06-04T16:13:24.428 INFO:tasks.workunit.client.0.smithi144.stderr: -77> 2024-06-04T16:13:24.319+0000 7f8175a13800 10 cannot find current period zonegroup using local zonegroup configuration 2024-06-04T16:13:24.428 INFO:tasks.workunit.client.0.smithi144.stderr: -76> 2024-06-04T16:13:24.319+0000 7f8175a13800 20 zonegroup default 2024-06-04T16:13:24.429 INFO:tasks.workunit.client.0.smithi144.stderr: -75> 2024-06-04T16:13:24.319+0000 7f8175a13800 20 rados->read ofs=0 len=0 2024-06-04T16:13:24.429 INFO:tasks.workunit.client.0.smithi144.stderr: -74> 2024-06-04T16:13:24.319+0000 7f8175a13800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:13:24.429 INFO:tasks.workunit.client.0.smithi144.stderr: -73> 2024-06-04T16:13:24.319+0000 7f8175a13800 20 rados->read ofs=0 len=0 2024-06-04T16:13:24.429 INFO:tasks.workunit.client.0.smithi144.stderr: -72> 2024-06-04T16:13:24.320+0000 7f8175a13800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:13:24.429 INFO:tasks.workunit.client.0.smithi144.stderr: -71> 2024-06-04T16:13:24.320+0000 7f8175a13800 20 rados->read ofs=0 len=0 2024-06-04T16:13:24.429 INFO:tasks.workunit.client.0.smithi144.stderr: -70> 2024-06-04T16:13:24.320+0000 7f8175a13800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:13:24.429 INFO:tasks.workunit.client.0.smithi144.stderr: -69> 2024-06-04T16:13:24.320+0000 7f8175a13800 20 started sync module instance, tier type = 2024-06-04T16:13:24.429 INFO:tasks.workunit.client.0.smithi144.stderr: -68> 2024-06-04T16:13:24.320+0000 7f8175a13800 20 started zone id=be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767 (name=default) with tier type = 2024-06-04T16:13:24.429 INFO:tasks.workunit.client.0.smithi144.stderr: -67> 2024-06-04T16:13:24.328+0000 7f8175a13800 20 add_watcher() i=0 2024-06-04T16:13:24.429 INFO:tasks.workunit.client.0.smithi144.stderr: -66> 2024-06-04T16:13:24.328+0000 7f8175a13800 20 add_watcher() i=1 2024-06-04T16:13:24.429 INFO:tasks.workunit.client.0.smithi144.stderr: -65> 2024-06-04T16:13:24.328+0000 7f8175a13800 20 add_watcher() i=2 2024-06-04T16:13:24.430 INFO:tasks.workunit.client.0.smithi144.stderr: -64> 2024-06-04T16:13:24.328+0000 7f8175a13800 20 add_watcher() i=3 2024-06-04T16:13:24.430 INFO:tasks.workunit.client.0.smithi144.stderr: -63> 2024-06-04T16:13:24.328+0000 7f8175a13800 20 add_watcher() i=4 2024-06-04T16:13:24.430 INFO:tasks.workunit.client.0.smithi144.stderr: -62> 2024-06-04T16:13:24.328+0000 7f8175a13800 20 add_watcher() i=5 2024-06-04T16:13:24.430 INFO:tasks.workunit.client.0.smithi144.stderr: -61> 2024-06-04T16:13:24.328+0000 7f8175a13800 20 add_watcher() i=6 2024-06-04T16:13:24.430 INFO:tasks.workunit.client.0.smithi144.stderr: -60> 2024-06-04T16:13:24.329+0000 7f8175a13800 20 add_watcher() i=7 2024-06-04T16:13:24.430 INFO:tasks.workunit.client.0.smithi144.stderr: -59> 2024-06-04T16:13:24.329+0000 7f8175a13800 2 all 8 watchers are set, enabling cache 2024-06-04T16:13:24.430 INFO:tasks.workunit.client.0.smithi144.stderr: -58> 2024-06-04T16:13:24.331+0000 7f8175a13800 5 AuthRegistry(0x7fff6a9d0a50) adding auth protocol: cephx 2024-06-04T16:13:24.430 INFO:tasks.workunit.client.0.smithi144.stderr: -57> 2024-06-04T16:13:24.331+0000 7f8175a13800 5 AuthRegistry(0x7fff6a9d0a50) adding auth protocol: cephx 2024-06-04T16:13:24.430 INFO:tasks.workunit.client.0.smithi144.stderr: -56> 2024-06-04T16:13:24.331+0000 7f8175a13800 5 AuthRegistry(0x7fff6a9d0a50) adding auth protocol: cephx 2024-06-04T16:13:24.430 INFO:tasks.workunit.client.0.smithi144.stderr: -55> 2024-06-04T16:13:24.331+0000 7f8175a13800 5 AuthRegistry(0x7fff6a9d0a50) adding con mode: secure 2024-06-04T16:13:24.430 INFO:tasks.workunit.client.0.smithi144.stderr: -54> 2024-06-04T16:13:24.331+0000 7f8175a13800 5 AuthRegistry(0x7fff6a9d0a50) adding con mode: crc 2024-06-04T16:13:24.430 INFO:tasks.workunit.client.0.smithi144.stderr: -53> 2024-06-04T16:13:24.331+0000 7f8175a13800 5 AuthRegistry(0x7fff6a9d0a50) adding con mode: secure 2024-06-04T16:13:24.431 INFO:tasks.workunit.client.0.smithi144.stderr: -52> 2024-06-04T16:13:24.331+0000 7f8175a13800 5 AuthRegistry(0x7fff6a9d0a50) adding con mode: crc 2024-06-04T16:13:24.431 INFO:tasks.workunit.client.0.smithi144.stderr: -51> 2024-06-04T16:13:24.331+0000 7f8175a13800 5 AuthRegistry(0x7fff6a9d0a50) adding con mode: secure 2024-06-04T16:13:24.431 INFO:tasks.workunit.client.0.smithi144.stderr: -50> 2024-06-04T16:13:24.331+0000 7f8175a13800 5 AuthRegistry(0x7fff6a9d0a50) adding con mode: crc 2024-06-04T16:13:24.431 INFO:tasks.workunit.client.0.smithi144.stderr: -49> 2024-06-04T16:13:24.331+0000 7f8175a13800 5 AuthRegistry(0x7fff6a9d0a50) adding con mode: crc 2024-06-04T16:13:24.431 INFO:tasks.workunit.client.0.smithi144.stderr: -48> 2024-06-04T16:13:24.331+0000 7f8175a13800 5 AuthRegistry(0x7fff6a9d0a50) adding con mode: secure 2024-06-04T16:13:24.431 INFO:tasks.workunit.client.0.smithi144.stderr: -47> 2024-06-04T16:13:24.331+0000 7f8175a13800 5 AuthRegistry(0x7fff6a9d0a50) adding con mode: crc 2024-06-04T16:13:24.431 INFO:tasks.workunit.client.0.smithi144.stderr: -46> 2024-06-04T16:13:24.331+0000 7f8175a13800 5 AuthRegistry(0x7fff6a9d0a50) adding con mode: secure 2024-06-04T16:13:24.431 INFO:tasks.workunit.client.0.smithi144.stderr: -45> 2024-06-04T16:13:24.331+0000 7f8175a13800 5 AuthRegistry(0x7fff6a9d0a50) adding con mode: crc 2024-06-04T16:13:24.431 INFO:tasks.workunit.client.0.smithi144.stderr: -44> 2024-06-04T16:13:24.331+0000 7f8175a13800 5 AuthRegistry(0x7fff6a9d0a50) adding con mode: secure 2024-06-04T16:13:24.431 INFO:tasks.workunit.client.0.smithi144.stderr: -43> 2024-06-04T16:13:24.331+0000 7f80277e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-06-04T16:13:24.431 INFO:tasks.workunit.client.0.smithi144.stderr: -42> 2024-06-04T16:13:24.332+0000 7f8175a13800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-06-04T16:13:24.431 INFO:tasks.workunit.client.0.smithi144.stderr: -41> 2024-06-04T16:13:24.332+0000 7f8175a13800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-06-04T16:13:24.432 INFO:tasks.workunit.client.0.smithi144.stderr: -40> 2024-06-04T16:13:24.332+0000 7f8175a13800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-06-04T16:13:24.432 INFO:tasks.workunit.client.0.smithi144.stderr: -39> 2024-06-04T16:13:24.332+0000 7f8175a13800 5 asok(0x55b5cb4f7c60) register_command cache list hook 0x55b5cb7ddf30 2024-06-04T16:13:24.432 INFO:tasks.workunit.client.0.smithi144.stderr: -38> 2024-06-04T16:13:24.332+0000 7f8175a13800 5 asok(0x55b5cb4f7c60) register_command cache inspect hook 0x55b5cb7ddf30 2024-06-04T16:13:24.432 INFO:tasks.workunit.client.0.smithi144.stderr: -37> 2024-06-04T16:13:24.332+0000 7f8175a13800 5 asok(0x55b5cb4f7c60) register_command cache erase hook 0x55b5cb7ddf30 2024-06-04T16:13:24.432 INFO:tasks.workunit.client.0.smithi144.stderr: -36> 2024-06-04T16:13:24.332+0000 7f8175a13800 5 asok(0x55b5cb4f7c60) register_command cache zap hook 0x55b5cb7ddf30 2024-06-04T16:13:24.432 INFO:tasks.workunit.client.0.smithi144.stderr: -35> 2024-06-04T16:13:24.332+0000 7f8175a13800 5 note: GC not initialized 2024-06-04T16:13:24.432 INFO:tasks.workunit.client.0.smithi144.stderr: -34> 2024-06-04T16:13:24.332+0000 7f80267e4640 20 reqs_thread_entry: start 2024-06-04T16:13:24.432 INFO:tasks.workunit.client.0.smithi144.stderr: -33> 2024-06-04T16:13:24.332+0000 7f8175a13800 5 asok(0x55b5cb4f7c60) register_command sync trace show hook 0x7f816c015660 2024-06-04T16:13:24.432 INFO:tasks.workunit.client.0.smithi144.stderr: -32> 2024-06-04T16:13:24.332+0000 7f8175a13800 5 asok(0x55b5cb4f7c60) register_command sync trace history hook 0x7f816c015660 2024-06-04T16:13:24.432 INFO:tasks.workunit.client.0.smithi144.stderr: -31> 2024-06-04T16:13:24.332+0000 7f8175a13800 5 asok(0x55b5cb4f7c60) register_command sync trace active hook 0x7f816c015660 2024-06-04T16:13:24.432 INFO:tasks.workunit.client.0.smithi144.stderr: -30> 2024-06-04T16:13:24.332+0000 7f8175a13800 5 asok(0x55b5cb4f7c60) register_command sync trace active_short hook 0x7f816c015660 2024-06-04T16:13:24.432 INFO:tasks.workunit.client.0.smithi144.stderr: -29> 2024-06-04T16:13:24.332+0000 7f8175a13800 20 init_complete bucket index max shards: 11 2024-06-04T16:13:24.432 INFO:tasks.workunit.client.0.smithi144.stderr: -28> 2024-06-04T16:13:24.332+0000 7f8175a13800 20 Filter name: none 2024-06-04T16:13:24.433 INFO:tasks.workunit.client.0.smithi144.stderr: -27> 2024-06-04T16:13:24.332+0000 7f7f97fff640 20 reqs_thread_entry: start 2024-06-04T16:13:24.433 INFO:tasks.workunit.client.0.smithi144.stderr: -26> 2024-06-04T16:13:24.332+0000 7f8175a13800 10 cache get: name=default.rgw.meta+root+abort-at-do-reshard : miss 2024-06-04T16:13:24.433 INFO:tasks.workunit.client.0.smithi144.stderr: -25> 2024-06-04T16:13:24.332+0000 7f8175a13800 20 rados->read ofs=0 len=0 2024-06-04T16:13:24.433 INFO:tasks.workunit.client.0.smithi144.stderr: -24> 2024-06-04T16:13:24.333+0000 7f8175a13800 20 rados_obj.operate() r=0 bl.length=187 2024-06-04T16:13:24.433 INFO:tasks.workunit.client.0.smithi144.stderr: -23> 2024-06-04T16:13:24.333+0000 7f8175a13800 10 cache put: name=default.rgw.meta+root+abort-at-do-reshard info.flags=0x11 2024-06-04T16:13:24.433 INFO:tasks.workunit.client.0.smithi144.stderr: -22> 2024-06-04T16:13:24.333+0000 7f8175a13800 10 adding default.rgw.meta+root+abort-at-do-reshard to cache LRU end 2024-06-04T16:13:24.433 INFO:tasks.workunit.client.0.smithi144.stderr: -21> 2024-06-04T16:13:24.333+0000 7f8175a13800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.28 : miss 2024-06-04T16:13:24.433 INFO:tasks.workunit.client.0.smithi144.stderr: -20> 2024-06-04T16:13:24.333+0000 7f8175a13800 20 rados->read ofs=0 len=0 2024-06-04T16:13:24.433 INFO:tasks.workunit.client.0.smithi144.stderr: -19> 2024-06-04T16:13:24.333+0000 7f8175a13800 20 rados_obj.operate() r=0 bl.length=401 2024-06-04T16:13:24.433 INFO:tasks.workunit.client.0.smithi144.stderr: -18> 2024-06-04T16:13:24.333+0000 7f8175a13800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.28 info.flags=0x17 2024-06-04T16:13:24.433 INFO:tasks.workunit.client.0.smithi144.stderr: -17> 2024-06-04T16:13:24.333+0000 7f8175a13800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.28 to cache LRU end 2024-06-04T16:13:24.433 INFO:tasks.workunit.client.0.smithi144.stderr: -16> 2024-06-04T16:13:24.333+0000 7f8175a13800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-06-04T16:13:24.433 INFO:tasks.workunit.client.0.smithi144.stderr: -15> 2024-06-04T16:13:24.333+0000 7f8175a13800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-06-04T16:13:24.434 INFO:tasks.workunit.client.0.smithi144.stderr: -14> 2024-06-04T16:13:24.333+0000 7f8175a13800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.28 2024-06-04T16:13:24.434 INFO:tasks.workunit.client.0.smithi144.stderr: -13> 2024-06-04T16:13:24.338+0000 7f8175a13800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.28 info.flags=0x17 2024-06-04T16:13:24.434 INFO:tasks.workunit.client.0.smithi144.stderr: -12> 2024-06-04T16:13:24.338+0000 7f8175a13800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.28 to cache LRU end 2024-06-04T16:13:24.434 INFO:tasks.workunit.client.0.smithi144.stderr: -11> 2024-06-04T16:13:24.338+0000 7f8175a13800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-06-04T16:13:24.434 INFO:tasks.workunit.client.0.smithi144.stderr: -10> 2024-06-04T16:13:24.338+0000 7f8175a13800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.28, ofs0, ns] 2024-06-04T16:13:24.434 INFO:tasks.workunit.client.0.smithi144.stderr: -9> 2024-06-04T16:13:24.339+0000 7f8054ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1078036791319 cookie 94239291652816 notifier 6566 bl.length()=903 2024-06-04T16:13:24.434 INFO:tasks.workunit.client.0.smithi144.stderr: -8> 2024-06-04T16:13:24.339+0000 7f8054ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.28 info.flags=0x17 2024-06-04T16:13:24.434 INFO:tasks.workunit.client.0.smithi144.stderr: -7> 2024-06-04T16:13:24.339+0000 7f8054ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.28 to cache LRU end 2024-06-04T16:13:24.434 INFO:tasks.workunit.client.0.smithi144.stderr: -6> 2024-06-04T16:13:24.339+0000 7f8054ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-06-04T16:13:24.434 INFO:tasks.workunit.client.0.smithi144.stderr: -5> 2024-06-04T16:13:24.339+0000 7f8175a13800 20 handle_bi_update(): bucket=:abort-at-do-reshard[be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.28]): orig_sources= new_sources= 2024-06-04T16:13:24.434 INFO:tasks.workunit.client.0.smithi144.stderr: -4> 2024-06-04T16:13:24.339+0000 7f8175a13800 20 handle_bi_update(): bucket=:abort-at-do-reshard[be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.28]): potential sources added=[] removed=[] 2024-06-04T16:13:24.434 INFO:tasks.workunit.client.0.smithi144.stderr: -3> 2024-06-04T16:13:24.339+0000 7f8175a13800 20 handle_bi_update(): bucket=:abort-at-do-reshard[be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.28]): orig_dests= new_dests= 2024-06-04T16:13:24.434 INFO:tasks.workunit.client.0.smithi144.stderr: -2> 2024-06-04T16:13:24.339+0000 7f8175a13800 20 handle_bi_update(): bucket=:abort-at-do-reshard[be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.28]): potential dests added=[] removed=[] 2024-06-04T16:13:24.435 INFO:tasks.workunit.client.0.smithi144.stderr: -1> 2024-06-04T16:13:24.342+0000 7f8175a13800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-4027-g65533a90/rpm/el9/BUILD/ceph-19.0.0-4027-g65533a90/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f8175a13800 time 2024-06-04T16:13:24.342962+0000 2024-06-04T16:13:24.435 INFO:tasks.workunit.client.0.smithi144.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-4027-g65533a90/rpm/el9/BUILD/ceph-19.0.0-4027-g65533a90/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-06-04T16:13:24.435 INFO:tasks.workunit.client.0.smithi144.stderr: 2024-06-04T16:13:24.435 INFO:tasks.workunit.client.0.smithi144.stderr: ceph version 19.0.0-4027-g65533a90 (65533a907fc9add1863609703fdbbea67993c8ef) squid (dev) 2024-06-04T16:13:24.435 INFO:tasks.workunit.client.0.smithi144.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f8176981dce] 2024-06-04T16:13:24.435 INFO:tasks.workunit.client.0.smithi144.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x181f8c) [0x7f8176981f8c] 2024-06-04T16:13:24.435 INFO:tasks.workunit.client.0.smithi144.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55b5ca966fb1] 2024-06-04T16:13:24.435 INFO:tasks.workunit.client.0.smithi144.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x32f) [0x55b5ca97239f] 2024-06-04T16:13:24.435 INFO:tasks.workunit.client.0.smithi144.stderr: 5: main() 2024-06-04T16:13:24.435 INFO:tasks.workunit.client.0.smithi144.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7f8175829590] 2024-06-04T16:13:24.435 INFO:tasks.workunit.client.0.smithi144.stderr: 7: __libc_start_main() 2024-06-04T16:13:24.435 INFO:tasks.workunit.client.0.smithi144.stderr: 8: _start() 2024-06-04T16:13:24.435 INFO:tasks.workunit.client.0.smithi144.stderr: 2024-06-04T16:13:24.436 INFO:tasks.workunit.client.0.smithi144.stderr: 0> 2024-06-04T16:13:24.343+0000 7f8175a13800 -1 *** Caught signal (Aborted) ** 2024-06-04T16:13:24.436 INFO:tasks.workunit.client.0.smithi144.stderr: in thread 7f8175a13800 thread_name:radosgw-admin 2024-06-04T16:13:24.436 INFO:tasks.workunit.client.0.smithi144.stderr: 2024-06-04T16:13:24.436 INFO:tasks.workunit.client.0.smithi144.stderr: ceph version 19.0.0-4027-g65533a90 (65533a907fc9add1863609703fdbbea67993c8ef) squid (dev) 2024-06-04T16:13:24.436 INFO:tasks.workunit.client.0.smithi144.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f817583e6f0] 2024-06-04T16:13:24.436 INFO:tasks.workunit.client.0.smithi144.stderr: 2: /lib64/libc.so.6(+0x8b94c) [0x7f817588b94c] 2024-06-04T16:13:24.436 INFO:tasks.workunit.client.0.smithi144.stderr: 3: raise() 2024-06-04T16:13:24.436 INFO:tasks.workunit.client.0.smithi144.stderr: 4: abort() 2024-06-04T16:13:24.436 INFO:tasks.workunit.client.0.smithi144.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f8176981e28] 2024-06-04T16:13:24.436 INFO:tasks.workunit.client.0.smithi144.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x181f8c) [0x7f8176981f8c] 2024-06-04T16:13:24.436 INFO:tasks.workunit.client.0.smithi144.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55b5ca966fb1] 2024-06-04T16:13:24.436 INFO:tasks.workunit.client.0.smithi144.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x32f) [0x55b5ca97239f] 2024-06-04T16:13:24.436 INFO:tasks.workunit.client.0.smithi144.stderr: 9: main() 2024-06-04T16:13:24.436 INFO:tasks.workunit.client.0.smithi144.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7f8175829590] 2024-06-04T16:13:24.436 INFO:tasks.workunit.client.0.smithi144.stderr: 11: __libc_start_main() 2024-06-04T16:13:24.437 INFO:tasks.workunit.client.0.smithi144.stderr: 12: _start() 2024-06-04T16:13:24.437 INFO:tasks.workunit.client.0.smithi144.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-06-04T16:13:24.437 INFO:tasks.workunit.client.0.smithi144.stderr: 2024-06-04T16:13:24.437 INFO:tasks.workunit.client.0.smithi144.stderr:--- logging levels --- 2024-06-04T16:13:24.437 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 5 none 2024-06-04T16:13:24.437 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 1 lockdep 2024-06-04T16:13:24.437 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 1 context 2024-06-04T16:13:24.437 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 1 crush 2024-06-04T16:13:24.437 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 5 mds 2024-06-04T16:13:24.437 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 5 mds_balancer 2024-06-04T16:13:24.438 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 5 mds_locker 2024-06-04T16:13:24.438 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 5 mds_log 2024-06-04T16:13:24.438 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 5 mds_log_expire 2024-06-04T16:13:24.438 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 5 mds_migrator 2024-06-04T16:13:24.438 INFO:tasks.workunit.client.0.smithi144.stderr: 3/ 5 mds_quiesce 2024-06-04T16:13:24.438 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 1 buffer 2024-06-04T16:13:24.438 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 1 timer 2024-06-04T16:13:24.438 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 1 filer 2024-06-04T16:13:24.438 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 1 striper 2024-06-04T16:13:24.438 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 1 objecter 2024-06-04T16:13:24.438 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 5 rados 2024-06-04T16:13:24.438 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 5 rbd 2024-06-04T16:13:24.439 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 5 rbd_mirror 2024-06-04T16:13:24.439 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 5 rbd_replay 2024-06-04T16:13:24.439 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 5 rbd_pwl 2024-06-04T16:13:24.439 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 5 journaler 2024-06-04T16:13:24.439 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 5 objectcacher 2024-06-04T16:13:24.439 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 5 immutable_obj_cache 2024-06-04T16:13:24.439 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 5 client 2024-06-04T16:13:24.439 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 5 osd 2024-06-04T16:13:24.439 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 5 optracker 2024-06-04T16:13:24.439 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 5 objclass 2024-06-04T16:13:24.439 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 3 filestore 2024-06-04T16:13:24.439 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 3 journal 2024-06-04T16:13:24.439 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 0 ms 2024-06-04T16:13:24.440 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 5 mon 2024-06-04T16:13:24.440 INFO:tasks.workunit.client.0.smithi144.stderr: 0/10 monc 2024-06-04T16:13:24.440 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 5 paxos 2024-06-04T16:13:24.440 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 5 tp 2024-06-04T16:13:24.440 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 5 auth 2024-06-04T16:13:24.440 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 5 crypto 2024-06-04T16:13:24.440 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 1 finisher 2024-06-04T16:13:24.440 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 1 reserver 2024-06-04T16:13:24.440 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 5 heartbeatmap 2024-06-04T16:13:24.440 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 5 perfcounter 2024-06-04T16:13:24.440 INFO:tasks.workunit.client.0.smithi144.stderr: 20/20 rgw 2024-06-04T16:13:24.441 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 5 rgw_sync 2024-06-04T16:13:24.441 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 5 rgw_datacache 2024-06-04T16:13:24.441 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 5 rgw_access 2024-06-04T16:13:24.441 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 5 rgw_dbstore 2024-06-04T16:13:24.441 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 5 rgw_flight 2024-06-04T16:13:24.441 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 5 rgw_lifecycle 2024-06-04T16:13:24.441 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 5 rgw_notification 2024-06-04T16:13:24.441 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 5 javaclient 2024-06-04T16:13:24.441 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 5 asok 2024-06-04T16:13:24.441 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 1 throttle 2024-06-04T16:13:24.441 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 0 refs 2024-06-04T16:13:24.441 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 5 compressor 2024-06-04T16:13:24.441 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 5 bluestore 2024-06-04T16:13:24.442 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 5 bluefs 2024-06-04T16:13:24.442 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 3 bdev 2024-06-04T16:13:24.442 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 5 kstore 2024-06-04T16:13:24.442 INFO:tasks.workunit.client.0.smithi144.stderr: 4/ 5 rocksdb 2024-06-04T16:13:24.442 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 5 fuse 2024-06-04T16:13:24.442 INFO:tasks.workunit.client.0.smithi144.stderr: 2/ 5 mgr 2024-06-04T16:13:24.442 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 5 mgrc 2024-06-04T16:13:24.443 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 5 dpdk 2024-06-04T16:13:24.443 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 5 eventtrace 2024-06-04T16:13:24.443 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 5 prioritycache 2024-06-04T16:13:24.443 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 5 test 2024-06-04T16:13:24.443 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 5 cephfs_mirror 2024-06-04T16:13:24.443 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 5 cephsqlite 2024-06-04T16:13:24.443 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 5 crimson_interrupt 2024-06-04T16:13:24.443 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 5 seastore 2024-06-04T16:13:24.444 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 5 seastore_onode 2024-06-04T16:13:24.444 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 5 seastore_odata 2024-06-04T16:13:24.444 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 5 seastore_omap 2024-06-04T16:13:24.444 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 5 seastore_tm 2024-06-04T16:13:24.444 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 5 seastore_t 2024-06-04T16:13:24.444 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 5 seastore_cleaner 2024-06-04T16:13:24.444 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 5 seastore_epm 2024-06-04T16:13:24.444 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 5 seastore_lba 2024-06-04T16:13:24.444 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 5 seastore_fixedkv_tree 2024-06-04T16:13:24.444 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 5 seastore_cache 2024-06-04T16:13:24.445 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 5 seastore_journal 2024-06-04T16:13:24.445 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 5 seastore_device 2024-06-04T16:13:24.445 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 5 seastore_backref 2024-06-04T16:13:24.445 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 5 alienstore 2024-06-04T16:13:24.445 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 5 mclock 2024-06-04T16:13:24.445 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 5 cyanstore 2024-06-04T16:13:24.445 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 5 ceph_exporter 2024-06-04T16:13:24.445 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 5 memstore 2024-06-04T16:13:24.445 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 5 trace 2024-06-04T16:13:24.445 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 5 ceph_dedup 2024-06-04T16:13:24.445 INFO:tasks.workunit.client.0.smithi144.stderr: -2/-2 (syslog threshold) 2024-06-04T16:13:24.446 INFO:tasks.workunit.client.0.smithi144.stderr: 99/99 (stderr threshold) 2024-06-04T16:13:24.446 INFO:tasks.workunit.client.0.smithi144.stderr:--- pthread ID / name mapping for recent threads --- 2024-06-04T16:13:24.446 INFO:tasks.workunit.client.0.smithi144.stderr: 7f7f97fff640 / http_manager 2024-06-04T16:13:24.446 INFO:tasks.workunit.client.0.smithi144.stderr: 7f80267e4640 / http_manager 2024-06-04T16:13:24.446 INFO:tasks.workunit.client.0.smithi144.stderr: 7f80277e6640 / rgw_dt_lg_renew 2024-06-04T16:13:24.446 INFO:tasks.workunit.client.0.smithi144.stderr: 7f8042ffd640 / ms_dispatch 2024-06-04T16:13:24.446 INFO:tasks.workunit.client.0.smithi144.stderr: 7f8054ff9640 / io_context_pool 2024-06-04T16:13:24.446 INFO:tasks.workunit.client.0.smithi144.stderr: 7f8056ffd640 / ms_dispatch 2024-06-04T16:13:24.446 INFO:tasks.workunit.client.0.smithi144.stderr: 7f805de03640 / ms_dispatch 2024-06-04T16:13:24.446 INFO:tasks.workunit.client.0.smithi144.stderr: 7f805f606640 / io_context_pool 2024-06-04T16:13:24.446 INFO:tasks.workunit.client.0.smithi144.stderr: 7f816bfff640 / msgr-worker-2 2024-06-04T16:13:24.446 INFO:tasks.workunit.client.0.smithi144.stderr: 7f8171064640 / msgr-worker-1 2024-06-04T16:13:24.447 INFO:tasks.workunit.client.0.smithi144.stderr: 7f8171865640 / msgr-worker-0 2024-06-04T16:13:24.447 INFO:tasks.workunit.client.0.smithi144.stderr: 7f8172066640 / io_context_pool 2024-06-04T16:13:24.447 INFO:tasks.workunit.client.0.smithi144.stderr: 7f8175a13800 / radosgw-admin 2024-06-04T16:13:24.447 INFO:tasks.workunit.client.0.smithi144.stderr: max_recent 500 2024-06-04T16:13:24.447 INFO:tasks.workunit.client.0.smithi144.stderr: max_new 1000 2024-06-04T16:13:24.447 INFO:tasks.workunit.client.0.smithi144.stderr: log_file /var/log/ceph/ceph-client.admin.110390.log 2024-06-04T16:13:24.447 INFO:tasks.workunit.client.0.smithi144.stderr:--- end dump of recent events --- 2024-06-04T16:13:24.447 INFO:tasks.workunit.client.0.smithi144.stderr:--- begin dump of recent events --- 2024-06-04T16:13:24.447 INFO:tasks.workunit.client.0.smithi144.stderr: -499> 2024-06-04T16:13:24.088+0000 7f8175a13800 10 monclient: build_initial_monmap 2024-06-04T16:13:24.447 INFO:tasks.workunit.client.0.smithi144.stderr: -498> 2024-06-04T16:13:24.088+0000 7f8175a13800 1 build_initial for_mkfs: 0 2024-06-04T16:13:24.447 INFO:tasks.workunit.client.0.smithi144.stderr: -497> 2024-06-04T16:13:24.088+0000 7f8175a13800 10 monclient: monmap: 2024-06-04T16:13:24.447 INFO:tasks.workunit.client.0.smithi144.stderr:epoch 0 2024-06-04T16:13:24.448 INFO:tasks.workunit.client.0.smithi144.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-06-04T16:13:24.448 INFO:tasks.workunit.client.0.smithi144.stderr:last_changed 0.000000 2024-06-04T16:13:24.448 INFO:tasks.workunit.client.0.smithi144.stderr:created 0.000000 2024-06-04T16:13:24.448 INFO:tasks.workunit.client.0.smithi144.stderr:min_mon_release 0 (unknown) 2024-06-04T16:13:24.448 INFO:tasks.workunit.client.0.smithi144.stderr:election_strategy: 1 2024-06-04T16:13:24.448 INFO:tasks.workunit.client.0.smithi144.stderr:0: [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] mon.noname-a 2024-06-04T16:13:24.448 INFO:tasks.workunit.client.0.smithi144.stderr:1: [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] mon.noname-b 2024-06-04T16:13:24.448 INFO:tasks.workunit.client.0.smithi144.stderr:2: [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] mon.noname-c 2024-06-04T16:13:24.448 INFO:tasks.workunit.client.0.smithi144.stderr: 2024-06-04T16:13:24.448 INFO:tasks.workunit.client.0.smithi144.stderr: -496> 2024-06-04T16:13:24.088+0000 7f8175a13800 5 AuthRegistry(0x55b5cb71ab30) adding auth protocol: cephx 2024-06-04T16:13:24.449 INFO:tasks.workunit.client.0.smithi144.stderr: -495> 2024-06-04T16:13:24.088+0000 7f8175a13800 5 AuthRegistry(0x55b5cb71ab30) adding auth protocol: cephx 2024-06-04T16:13:24.449 INFO:tasks.workunit.client.0.smithi144.stderr: -494> 2024-06-04T16:13:24.088+0000 7f8175a13800 5 AuthRegistry(0x55b5cb71ab30) adding auth protocol: cephx 2024-06-04T16:13:24.449 INFO:tasks.workunit.client.0.smithi144.stderr: -493> 2024-06-04T16:13:24.088+0000 7f8175a13800 5 AuthRegistry(0x55b5cb71ab30) adding con mode: secure 2024-06-04T16:13:24.449 INFO:tasks.workunit.client.0.smithi144.stderr: -492> 2024-06-04T16:13:24.088+0000 7f8175a13800 5 AuthRegistry(0x55b5cb71ab30) adding con mode: crc 2024-06-04T16:13:24.449 INFO:tasks.workunit.client.0.smithi144.stderr: -491> 2024-06-04T16:13:24.088+0000 7f8175a13800 5 AuthRegistry(0x55b5cb71ab30) adding con mode: secure 2024-06-04T16:13:24.449 INFO:tasks.workunit.client.0.smithi144.stderr: -490> 2024-06-04T16:13:24.088+0000 7f8175a13800 5 AuthRegistry(0x55b5cb71ab30) adding con mode: crc 2024-06-04T16:13:24.449 INFO:tasks.workunit.client.0.smithi144.stderr: -489> 2024-06-04T16:13:24.088+0000 7f8175a13800 5 AuthRegistry(0x55b5cb71ab30) adding con mode: secure 2024-06-04T16:13:24.449 INFO:tasks.workunit.client.0.smithi144.stderr: -488> 2024-06-04T16:13:24.088+0000 7f8175a13800 5 AuthRegistry(0x55b5cb71ab30) adding con mode: crc 2024-06-04T16:13:24.450 INFO:tasks.workunit.client.0.smithi144.stderr: -487> 2024-06-04T16:13:24.088+0000 7f8175a13800 5 AuthRegistry(0x55b5cb71ab30) adding con mode: crc 2024-06-04T16:13:24.450 INFO:tasks.workunit.client.0.smithi144.stderr: -486> 2024-06-04T16:13:24.088+0000 7f8175a13800 5 AuthRegistry(0x55b5cb71ab30) adding con mode: secure 2024-06-04T16:13:24.450 INFO:tasks.workunit.client.0.smithi144.stderr: -485> 2024-06-04T16:13:24.088+0000 7f8175a13800 5 AuthRegistry(0x55b5cb71ab30) adding con mode: crc 2024-06-04T16:13:24.450 INFO:tasks.workunit.client.0.smithi144.stderr: -484> 2024-06-04T16:13:24.088+0000 7f8175a13800 5 AuthRegistry(0x55b5cb71ab30) adding con mode: secure 2024-06-04T16:13:24.450 INFO:tasks.workunit.client.0.smithi144.stderr: -483> 2024-06-04T16:13:24.088+0000 7f8175a13800 5 AuthRegistry(0x55b5cb71ab30) adding con mode: crc 2024-06-04T16:13:24.450 INFO:tasks.workunit.client.0.smithi144.stderr: -482> 2024-06-04T16:13:24.088+0000 7f8175a13800 5 AuthRegistry(0x55b5cb71ab30) adding con mode: secure 2024-06-04T16:13:24.450 INFO:tasks.workunit.client.0.smithi144.stderr: -481> 2024-06-04T16:13:24.089+0000 7f8175a13800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-06-04T16:13:24.450 INFO:tasks.workunit.client.0.smithi144.stderr: -480> 2024-06-04T16:13:24.089+0000 7f8175a13800 1 librados: starting msgr at 2024-06-04T16:13:24.451 INFO:tasks.workunit.client.0.smithi144.stderr: -479> 2024-06-04T16:13:24.089+0000 7f8175a13800 1 librados: starting objecter 2024-06-04T16:13:24.451 INFO:tasks.workunit.client.0.smithi144.stderr: -478> 2024-06-04T16:13:24.089+0000 7f8175a13800 5 asok(0x55b5cb4f7c60) register_command objecter_requests hook 0x55b5cb71cc40 2024-06-04T16:13:24.451 INFO:tasks.workunit.client.0.smithi144.stderr: -477> 2024-06-04T16:13:24.089+0000 7f8175a13800 1 librados: setting wanted keys 2024-06-04T16:13:24.451 INFO:tasks.workunit.client.0.smithi144.stderr: -476> 2024-06-04T16:13:24.089+0000 7f8175a13800 1 librados: calling monclient init 2024-06-04T16:13:24.451 INFO:tasks.workunit.client.0.smithi144.stderr: -475> 2024-06-04T16:13:24.089+0000 7f8175a13800 10 monclient: init 2024-06-04T16:13:24.451 INFO:tasks.workunit.client.0.smithi144.stderr: -474> 2024-06-04T16:13:24.089+0000 7f8175a13800 5 AuthRegistry(0x55b5cb717b30) adding auth protocol: cephx 2024-06-04T16:13:24.451 INFO:tasks.workunit.client.0.smithi144.stderr: -473> 2024-06-04T16:13:24.089+0000 7f8175a13800 5 AuthRegistry(0x55b5cb717b30) adding auth protocol: cephx 2024-06-04T16:13:24.452 INFO:tasks.workunit.client.0.smithi144.stderr: -472> 2024-06-04T16:13:24.089+0000 7f8175a13800 5 AuthRegistry(0x55b5cb717b30) adding auth protocol: cephx 2024-06-04T16:13:24.452 INFO:tasks.workunit.client.0.smithi144.stderr: -471> 2024-06-04T16:13:24.089+0000 7f8175a13800 5 AuthRegistry(0x55b5cb717b30) adding con mode: secure 2024-06-04T16:13:24.452 INFO:tasks.workunit.client.0.smithi144.stderr: -470> 2024-06-04T16:13:24.089+0000 7f8175a13800 5 AuthRegistry(0x55b5cb717b30) adding con mode: crc 2024-06-04T16:13:24.452 INFO:tasks.workunit.client.0.smithi144.stderr: -469> 2024-06-04T16:13:24.089+0000 7f8175a13800 5 AuthRegistry(0x55b5cb717b30) adding con mode: secure 2024-06-04T16:13:24.452 INFO:tasks.workunit.client.0.smithi144.stderr: -468> 2024-06-04T16:13:24.089+0000 7f8175a13800 5 AuthRegistry(0x55b5cb717b30) adding con mode: crc 2024-06-04T16:13:24.452 INFO:tasks.workunit.client.0.smithi144.stderr: -467> 2024-06-04T16:13:24.089+0000 7f8175a13800 5 AuthRegistry(0x55b5cb717b30) adding con mode: secure 2024-06-04T16:13:24.452 INFO:tasks.workunit.client.0.smithi144.stderr: -466> 2024-06-04T16:13:24.089+0000 7f8175a13800 5 AuthRegistry(0x55b5cb717b30) adding con mode: crc 2024-06-04T16:13:24.452 INFO:tasks.workunit.client.0.smithi144.stderr: -465> 2024-06-04T16:13:24.089+0000 7f8175a13800 5 AuthRegistry(0x55b5cb717b30) adding con mode: crc 2024-06-04T16:13:24.452 INFO:tasks.workunit.client.0.smithi144.stderr: -464> 2024-06-04T16:13:24.089+0000 7f8175a13800 5 AuthRegistry(0x55b5cb717b30) adding con mode: secure 2024-06-04T16:13:24.453 INFO:tasks.workunit.client.0.smithi144.stderr: -463> 2024-06-04T16:13:24.089+0000 7f8175a13800 5 AuthRegistry(0x55b5cb717b30) adding con mode: crc 2024-06-04T16:13:24.453 INFO:tasks.workunit.client.0.smithi144.stderr: -462> 2024-06-04T16:13:24.089+0000 7f8175a13800 5 AuthRegistry(0x55b5cb717b30) adding con mode: secure 2024-06-04T16:13:24.453 INFO:tasks.workunit.client.0.smithi144.stderr: -461> 2024-06-04T16:13:24.089+0000 7f8175a13800 5 AuthRegistry(0x55b5cb717b30) adding con mode: crc 2024-06-04T16:13:24.453 INFO:tasks.workunit.client.0.smithi144.stderr: -460> 2024-06-04T16:13:24.089+0000 7f8175a13800 5 AuthRegistry(0x55b5cb717b30) adding con mode: secure 2024-06-04T16:13:24.453 INFO:tasks.workunit.client.0.smithi144.stderr: -459> 2024-06-04T16:13:24.089+0000 7f8175a13800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-06-04T16:13:24.453 INFO:tasks.workunit.client.0.smithi144.stderr: -458> 2024-06-04T16:13:24.089+0000 7f8175a13800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-06-04T16:13:24.453 INFO:tasks.workunit.client.0.smithi144.stderr: -457> 2024-06-04T16:13:24.089+0000 7f8175a13800 5 asok(0x55b5cb4f7c60) register_command rotate-key hook 0x55b5cb717c78 2024-06-04T16:13:24.453 INFO:tasks.workunit.client.0.smithi144.stderr: -456> 2024-06-04T16:13:24.089+0000 7f8175a13800 10 monclient: _reopen_session rank -1 2024-06-04T16:13:24.453 INFO:tasks.workunit.client.0.smithi144.stderr: -455> 2024-06-04T16:13:24.089+0000 7f8175a13800 10 monclient: _add_conns ranks=[0,2,1] 2024-06-04T16:13:24.453 INFO:tasks.workunit.client.0.smithi144.stderr: -454> 2024-06-04T16:13:24.089+0000 7f8175a13800 10 monclient(hunting): picked mon.noname-a con 0x55b5cb5cbeb0 addr [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] 2024-06-04T16:13:24.453 INFO:tasks.workunit.client.0.smithi144.stderr: -453> 2024-06-04T16:13:24.089+0000 7f8175a13800 10 monclient(hunting): picked mon.noname-c con 0x55b5cb5ceeb0 addr [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] 2024-06-04T16:13:24.453 INFO:tasks.workunit.client.0.smithi144.stderr: -452> 2024-06-04T16:13:24.089+0000 7f8175a13800 10 monclient(hunting): picked mon.noname-b con 0x55b5cb71e360 addr [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] 2024-06-04T16:13:24.453 INFO:tasks.workunit.client.0.smithi144.stderr: -451> 2024-06-04T16:13:24.089+0000 7f8175a13800 10 monclient(hunting): start opening mon connection 2024-06-04T16:13:24.454 INFO:tasks.workunit.client.0.smithi144.stderr: -450> 2024-06-04T16:13:24.089+0000 7f8175a13800 10 monclient(hunting): start opening mon connection 2024-06-04T16:13:24.454 INFO:tasks.workunit.client.0.smithi144.stderr: -449> 2024-06-04T16:13:24.089+0000 7f8175a13800 10 monclient(hunting): start opening mon connection 2024-06-04T16:13:24.454 INFO:tasks.workunit.client.0.smithi144.stderr: -448> 2024-06-04T16:13:24.089+0000 7f8175a13800 10 monclient(hunting): _renew_subs 2024-06-04T16:13:24.454 INFO:tasks.workunit.client.0.smithi144.stderr: -447> 2024-06-04T16:13:24.089+0000 7f8175a13800 10 monclient(hunting): authenticate will time out at 2041.906035s 2024-06-04T16:13:24.454 INFO:tasks.workunit.client.0.smithi144.stderr: -446> 2024-06-04T16:13:24.090+0000 7f8171064640 10 monclient(hunting): get_auth_request con 0x55b5cb5cbeb0 auth_method 0 2024-06-04T16:13:24.454 INFO:tasks.workunit.client.0.smithi144.stderr: -445> 2024-06-04T16:13:24.090+0000 7f8171064640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-06-04T16:13:24.454 INFO:tasks.workunit.client.0.smithi144.stderr: -444> 2024-06-04T16:13:24.090+0000 7f8171064640 10 monclient(hunting): _init_auth method 2 2024-06-04T16:13:24.454 INFO:tasks.workunit.client.0.smithi144.stderr: -443> 2024-06-04T16:13:24.090+0000 7f8171064640 10 monclient(hunting): _init_auth creating new auth 2024-06-04T16:13:24.454 INFO:tasks.workunit.client.0.smithi144.stderr: -442> 2024-06-04T16:13:24.090+0000 7f816bfff640 10 monclient(hunting): get_auth_request con 0x55b5cb5ceeb0 auth_method 0 2024-06-04T16:13:24.454 INFO:tasks.workunit.client.0.smithi144.stderr: -441> 2024-06-04T16:13:24.090+0000 7f816bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-06-04T16:13:24.454 INFO:tasks.workunit.client.0.smithi144.stderr: -440> 2024-06-04T16:13:24.090+0000 7f816bfff640 10 monclient(hunting): _init_auth method 2 2024-06-04T16:13:24.454 INFO:tasks.workunit.client.0.smithi144.stderr: -439> 2024-06-04T16:13:24.090+0000 7f816bfff640 10 monclient(hunting): _init_auth creating new auth 2024-06-04T16:13:24.455 INFO:tasks.workunit.client.0.smithi144.stderr: -438> 2024-06-04T16:13:24.090+0000 7f8171865640 10 monclient(hunting): get_auth_request con 0x55b5cb71e360 auth_method 0 2024-06-04T16:13:24.455 INFO:tasks.workunit.client.0.smithi144.stderr: -437> 2024-06-04T16:13:24.090+0000 7f8171865640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-06-04T16:13:24.455 INFO:tasks.workunit.client.0.smithi144.stderr: -436> 2024-06-04T16:13:24.090+0000 7f8171865640 10 monclient(hunting): _init_auth method 2 2024-06-04T16:13:24.455 INFO:tasks.workunit.client.0.smithi144.stderr: -435> 2024-06-04T16:13:24.090+0000 7f8171865640 10 monclient(hunting): _init_auth creating new auth 2024-06-04T16:13:24.455 INFO:tasks.workunit.client.0.smithi144.stderr: -434> 2024-06-04T16:13:24.090+0000 7f8171064640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-06-04T16:13:24.455 INFO:tasks.workunit.client.0.smithi144.stderr: -433> 2024-06-04T16:13:24.090+0000 7f8171064640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-06-04T16:13:24.455 INFO:tasks.workunit.client.0.smithi144.stderr: -432> 2024-06-04T16:13:24.090+0000 7f8171064640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-06-04T16:13:24.455 INFO:tasks.workunit.client.0.smithi144.stderr: -431> 2024-06-04T16:13:24.090+0000 7f816bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-06-04T16:13:24.455 INFO:tasks.workunit.client.0.smithi144.stderr: -430> 2024-06-04T16:13:24.090+0000 7f816bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-06-04T16:13:24.455 INFO:tasks.workunit.client.0.smithi144.stderr: -429> 2024-06-04T16:13:24.090+0000 7f816bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-06-04T16:13:24.455 INFO:tasks.workunit.client.0.smithi144.stderr: -428> 2024-06-04T16:13:24.090+0000 7f8171865640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-06-04T16:13:24.455 INFO:tasks.workunit.client.0.smithi144.stderr: -427> 2024-06-04T16:13:24.090+0000 7f8171865640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-06-04T16:13:24.456 INFO:tasks.workunit.client.0.smithi144.stderr: -426> 2024-06-04T16:13:24.090+0000 7f8171865640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-06-04T16:13:24.456 INFO:tasks.workunit.client.0.smithi144.stderr: -425> 2024-06-04T16:13:24.090+0000 7f816bfff640 10 monclient(hunting): handle_auth_done global_id 6557 payload 824 2024-06-04T16:13:24.456 INFO:tasks.workunit.client.0.smithi144.stderr: -424> 2024-06-04T16:13:24.090+0000 7f816bfff640 10 monclient: _finish_hunting 0 2024-06-04T16:13:24.456 INFO:tasks.workunit.client.0.smithi144.stderr: -423> 2024-06-04T16:13:24.090+0000 7f816bfff640 1 monclient: found mon.noname-c 2024-06-04T16:13:24.456 INFO:tasks.workunit.client.0.smithi144.stderr: -422> 2024-06-04T16:13:24.090+0000 7f816bfff640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.144:3301/0 2024-06-04T16:13:24.456 INFO:tasks.workunit.client.0.smithi144.stderr: -421> 2024-06-04T16:13:24.090+0000 7f805de03640 10 monclient: handle_monmap mon_map magic: 0 2024-06-04T16:13:24.456 INFO:tasks.workunit.client.0.smithi144.stderr: -420> 2024-06-04T16:13:24.090+0000 7f805de03640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-06-04T16:13:24.456 INFO:tasks.workunit.client.0.smithi144.stderr: -419> 2024-06-04T16:13:24.090+0000 7f805de03640 10 monclient: dump: 2024-06-04T16:13:24.456 INFO:tasks.workunit.client.0.smithi144.stderr:epoch 1 2024-06-04T16:13:24.456 INFO:tasks.workunit.client.0.smithi144.stderr:fsid 15e56bb1-4856-42f3-b6db-a2c8f23c5557 2024-06-04T16:13:24.456 INFO:tasks.workunit.client.0.smithi144.stderr:last_changed 2024-06-04T15:51:29.789359+0000 2024-06-04T16:13:24.456 INFO:tasks.workunit.client.0.smithi144.stderr:created 2024-06-04T15:51:29.789359+0000 2024-06-04T16:13:24.456 INFO:tasks.workunit.client.0.smithi144.stderr:min_mon_release 19 (squid) 2024-06-04T16:13:24.456 INFO:tasks.workunit.client.0.smithi144.stderr:election_strategy: 1 2024-06-04T16:13:24.457 INFO:tasks.workunit.client.0.smithi144.stderr:0: [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] mon.a 2024-06-04T16:13:24.457 INFO:tasks.workunit.client.0.smithi144.stderr:1: [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] mon.b 2024-06-04T16:13:24.457 INFO:tasks.workunit.client.0.smithi144.stderr:2: [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] mon.c 2024-06-04T16:13:24.457 INFO:tasks.workunit.client.0.smithi144.stderr: 2024-06-04T16:13:24.457 INFO:tasks.workunit.client.0.smithi144.stderr: -418> 2024-06-04T16:13:24.090+0000 7f805de03640 10 monclient: _finish_auth 0 2024-06-04T16:13:24.457 INFO:tasks.workunit.client.0.smithi144.stderr: -417> 2024-06-04T16:13:24.090+0000 7f805de03640 10 monclient: _check_auth_tickets 2024-06-04T16:13:24.457 INFO:tasks.workunit.client.0.smithi144.stderr: -416> 2024-06-04T16:13:24.090+0000 7f805de03640 10 monclient: handle_config config(0 keys) 2024-06-04T16:13:24.457 INFO:tasks.workunit.client.0.smithi144.stderr: -415> 2024-06-04T16:13:24.090+0000 7f805de03640 10 monclient: handle_monmap mon_map magic: 0 2024-06-04T16:13:24.457 INFO:tasks.workunit.client.0.smithi144.stderr: -414> 2024-06-04T16:13:24.090+0000 7f805de03640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-06-04T16:13:24.457 INFO:tasks.workunit.client.0.smithi144.stderr: -413> 2024-06-04T16:13:24.090+0000 7f805de03640 10 monclient: dump: 2024-06-04T16:13:24.457 INFO:tasks.workunit.client.0.smithi144.stderr:epoch 1 2024-06-04T16:13:24.457 INFO:tasks.workunit.client.0.smithi144.stderr:fsid 15e56bb1-4856-42f3-b6db-a2c8f23c5557 2024-06-04T16:13:24.457 INFO:tasks.workunit.client.0.smithi144.stderr:last_changed 2024-06-04T15:51:29.789359+0000 2024-06-04T16:13:24.458 INFO:tasks.workunit.client.0.smithi144.stderr:created 2024-06-04T15:51:29.789359+0000 2024-06-04T16:13:24.458 INFO:tasks.workunit.client.0.smithi144.stderr:min_mon_release 19 (squid) 2024-06-04T16:13:24.458 INFO:tasks.workunit.client.0.smithi144.stderr:election_strategy: 1 2024-06-04T16:13:24.458 INFO:tasks.workunit.client.0.smithi144.stderr:0: [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] mon.a 2024-06-04T16:13:24.458 INFO:tasks.workunit.client.0.smithi144.stderr:1: [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] mon.b 2024-06-04T16:13:24.458 INFO:tasks.workunit.client.0.smithi144.stderr:2: [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] mon.c 2024-06-04T16:13:24.458 INFO:tasks.workunit.client.0.smithi144.stderr: 2024-06-04T16:13:24.458 INFO:tasks.workunit.client.0.smithi144.stderr: -412> 2024-06-04T16:13:24.090+0000 7f8175a13800 5 monclient: authenticate success, global_id 6557 2024-06-04T16:13:24.459 INFO:tasks.workunit.client.0.smithi144.stderr: -411> 2024-06-04T16:13:24.090+0000 7f8175a13800 10 monclient: _renew_subs 2024-06-04T16:13:24.459 INFO:tasks.workunit.client.0.smithi144.stderr: -410> 2024-06-04T16:13:24.090+0000 7f805f606640 4 set_mon_vals no callback set 2024-06-04T16:13:24.459 INFO:tasks.workunit.client.0.smithi144.stderr: -409> 2024-06-04T16:13:24.090+0000 7f8175a13800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.144:3301/0 2024-06-04T16:13:24.459 INFO:tasks.workunit.client.0.smithi144.stderr: -408> 2024-06-04T16:13:24.090+0000 7f8175a13800 10 monclient: _renew_subs 2024-06-04T16:13:24.459 INFO:tasks.workunit.client.0.smithi144.stderr: -407> 2024-06-04T16:13:24.090+0000 7f8175a13800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.144:3301/0 2024-06-04T16:13:24.459 INFO:tasks.workunit.client.0.smithi144.stderr: -406> 2024-06-04T16:13:24.090+0000 7f8175a13800 1 librados: init done 2024-06-04T16:13:24.459 INFO:tasks.workunit.client.0.smithi144.stderr: -405> 2024-06-04T16:13:24.092+0000 7f805de03640 4 mgrc handle_mgr_map Got map version 5 2024-06-04T16:13:24.459 INFO:tasks.workunit.client.0.smithi144.stderr: -404> 2024-06-04T16:13:24.092+0000 7f805de03640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.177:6832/2645786330,v1:172.21.15.177:6833/2645786330] 2024-06-04T16:13:24.459 INFO:tasks.workunit.client.0.smithi144.stderr: -403> 2024-06-04T16:13:24.092+0000 7f805de03640 4 mgrc reconnect Starting new session with [v2:172.21.15.177:6832/2645786330,v1:172.21.15.177:6833/2645786330] 2024-06-04T16:13:24.459 INFO:tasks.workunit.client.0.smithi144.stderr: -402> 2024-06-04T16:13:24.092+0000 7f8171064640 10 monclient: get_auth_request con 0x7f8058074cb0 auth_method 0 2024-06-04T16:13:24.459 INFO:tasks.workunit.client.0.smithi144.stderr: -401> 2024-06-04T16:13:24.092+0000 7f8171865640 10 monclient: get_auth_request con 0x55b5cb760690 auth_method 0 2024-06-04T16:13:24.459 INFO:tasks.workunit.client.0.smithi144.stderr: -400> 2024-06-04T16:13:24.093+0000 7f8171064640 10 monclient: get_auth_request con 0x55b5cb763870 auth_method 0 2024-06-04T16:13:24.459 INFO:tasks.workunit.client.0.smithi144.stderr: -399> 2024-06-04T16:13:24.094+0000 7f816bfff640 10 monclient: get_auth_request con 0x55b5cb767a60 auth_method 0 2024-06-04T16:13:24.460 INFO:tasks.workunit.client.0.smithi144.stderr: -398> 2024-06-04T16:13:24.095+0000 7f8171865640 10 monclient: get_auth_request con 0x55b5cb767150 auth_method 0 2024-06-04T16:13:24.460 INFO:tasks.workunit.client.0.smithi144.stderr: -397> 2024-06-04T16:13:24.095+0000 7f8175a13800 10 monclient: build_initial_monmap 2024-06-04T16:13:24.460 INFO:tasks.workunit.client.0.smithi144.stderr: -396> 2024-06-04T16:13:24.095+0000 7f8175a13800 1 build_initial for_mkfs: 0 2024-06-04T16:13:24.460 INFO:tasks.workunit.client.0.smithi144.stderr: -395> 2024-06-04T16:13:24.095+0000 7f8175a13800 10 monclient: monmap: 2024-06-04T16:13:24.460 INFO:tasks.workunit.client.0.smithi144.stderr:epoch 0 2024-06-04T16:13:24.460 INFO:tasks.workunit.client.0.smithi144.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-06-04T16:13:24.460 INFO:tasks.workunit.client.0.smithi144.stderr:last_changed 0.000000 2024-06-04T16:13:24.460 INFO:tasks.workunit.client.0.smithi144.stderr:created 0.000000 2024-06-04T16:13:24.460 INFO:tasks.workunit.client.0.smithi144.stderr:min_mon_release 0 (unknown) 2024-06-04T16:13:24.460 INFO:tasks.workunit.client.0.smithi144.stderr:election_strategy: 1 2024-06-04T16:13:24.460 INFO:tasks.workunit.client.0.smithi144.stderr:0: [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] mon.noname-a 2024-06-04T16:13:24.460 INFO:tasks.workunit.client.0.smithi144.stderr:1: [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] mon.noname-b 2024-06-04T16:13:24.460 INFO:tasks.workunit.client.0.smithi144.stderr:2: [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] mon.noname-c 2024-06-04T16:13:24.460 INFO:tasks.workunit.client.0.smithi144.stderr: 2024-06-04T16:13:24.461 INFO:tasks.workunit.client.0.smithi144.stderr: -394> 2024-06-04T16:13:24.095+0000 7f8175a13800 5 AuthRegistry(0x55b5cb76faa0) adding auth protocol: cephx 2024-06-04T16:13:24.461 INFO:tasks.workunit.client.0.smithi144.stderr: -393> 2024-06-04T16:13:24.095+0000 7f8175a13800 5 AuthRegistry(0x55b5cb76faa0) adding auth protocol: cephx 2024-06-04T16:13:24.461 INFO:tasks.workunit.client.0.smithi144.stderr: -392> 2024-06-04T16:13:24.095+0000 7f8175a13800 5 AuthRegistry(0x55b5cb76faa0) adding auth protocol: cephx 2024-06-04T16:13:24.461 INFO:tasks.workunit.client.0.smithi144.stderr: -391> 2024-06-04T16:13:24.095+0000 7f8175a13800 5 AuthRegistry(0x55b5cb76faa0) adding con mode: secure 2024-06-04T16:13:24.461 INFO:tasks.workunit.client.0.smithi144.stderr: -390> 2024-06-04T16:13:24.095+0000 7f8175a13800 5 AuthRegistry(0x55b5cb76faa0) adding con mode: crc 2024-06-04T16:13:24.461 INFO:tasks.workunit.client.0.smithi144.stderr: -389> 2024-06-04T16:13:24.095+0000 7f8175a13800 5 AuthRegistry(0x55b5cb76faa0) adding con mode: secure 2024-06-04T16:13:24.461 INFO:tasks.workunit.client.0.smithi144.stderr: -388> 2024-06-04T16:13:24.095+0000 7f8175a13800 5 AuthRegistry(0x55b5cb76faa0) adding con mode: crc 2024-06-04T16:13:24.461 INFO:tasks.workunit.client.0.smithi144.stderr: -387> 2024-06-04T16:13:24.095+0000 7f8175a13800 5 AuthRegistry(0x55b5cb76faa0) adding con mode: secure 2024-06-04T16:13:24.461 INFO:tasks.workunit.client.0.smithi144.stderr: -386> 2024-06-04T16:13:24.095+0000 7f8175a13800 5 AuthRegistry(0x55b5cb76faa0) adding con mode: crc 2024-06-04T16:13:24.461 INFO:tasks.workunit.client.0.smithi144.stderr: -385> 2024-06-04T16:13:24.095+0000 7f8175a13800 5 AuthRegistry(0x55b5cb76faa0) adding con mode: crc 2024-06-04T16:13:24.461 INFO:tasks.workunit.client.0.smithi144.stderr: -384> 2024-06-04T16:13:24.095+0000 7f8175a13800 5 AuthRegistry(0x55b5cb76faa0) adding con mode: secure 2024-06-04T16:13:24.461 INFO:tasks.workunit.client.0.smithi144.stderr: -383> 2024-06-04T16:13:24.095+0000 7f8175a13800 5 AuthRegistry(0x55b5cb76faa0) adding con mode: crc 2024-06-04T16:13:24.462 INFO:tasks.workunit.client.0.smithi144.stderr: -382> 2024-06-04T16:13:24.095+0000 7f8175a13800 5 AuthRegistry(0x55b5cb76faa0) adding con mode: secure 2024-06-04T16:13:24.462 INFO:tasks.workunit.client.0.smithi144.stderr: -381> 2024-06-04T16:13:24.095+0000 7f8175a13800 5 AuthRegistry(0x55b5cb76faa0) adding con mode: crc 2024-06-04T16:13:24.462 INFO:tasks.workunit.client.0.smithi144.stderr: -380> 2024-06-04T16:13:24.095+0000 7f8175a13800 5 AuthRegistry(0x55b5cb76faa0) adding con mode: secure 2024-06-04T16:13:24.462 INFO:tasks.workunit.client.0.smithi144.stderr: -379> 2024-06-04T16:13:24.096+0000 7f8175a13800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-06-04T16:13:24.462 INFO:tasks.workunit.client.0.smithi144.stderr: -378> 2024-06-04T16:13:24.096+0000 7f8175a13800 5 asok(0x55b5cb4f7c60) register_command objecter_requests cmddesc objecter_requests hook 0x55b5cb772f70 EEXIST 2024-06-04T16:13:24.462 INFO:tasks.workunit.client.0.smithi144.stderr: -377> 2024-06-04T16:13:24.096+0000 7f8175a13800 10 monclient: init 2024-06-04T16:13:24.462 INFO:tasks.workunit.client.0.smithi144.stderr: -376> 2024-06-04T16:13:24.096+0000 7f8175a13800 5 AuthRegistry(0x55b5cb76ea28) adding auth protocol: cephx 2024-06-04T16:13:24.462 INFO:tasks.workunit.client.0.smithi144.stderr: -375> 2024-06-04T16:13:24.096+0000 7f8175a13800 5 AuthRegistry(0x55b5cb76ea28) adding auth protocol: cephx 2024-06-04T16:13:24.462 INFO:tasks.workunit.client.0.smithi144.stderr: -374> 2024-06-04T16:13:24.096+0000 7f8175a13800 5 AuthRegistry(0x55b5cb76ea28) adding auth protocol: cephx 2024-06-04T16:13:24.462 INFO:tasks.workunit.client.0.smithi144.stderr: -373> 2024-06-04T16:13:24.096+0000 7f8175a13800 5 AuthRegistry(0x55b5cb76ea28) adding con mode: secure 2024-06-04T16:13:24.462 INFO:tasks.workunit.client.0.smithi144.stderr: -372> 2024-06-04T16:13:24.096+0000 7f8175a13800 5 AuthRegistry(0x55b5cb76ea28) adding con mode: crc 2024-06-04T16:13:24.462 INFO:tasks.workunit.client.0.smithi144.stderr: -371> 2024-06-04T16:13:24.096+0000 7f8175a13800 5 AuthRegistry(0x55b5cb76ea28) adding con mode: secure 2024-06-04T16:13:24.462 INFO:tasks.workunit.client.0.smithi144.stderr: -370> 2024-06-04T16:13:24.096+0000 7f8175a13800 5 AuthRegistry(0x55b5cb76ea28) adding con mode: crc 2024-06-04T16:13:24.462 INFO:tasks.workunit.client.0.smithi144.stderr: -369> 2024-06-04T16:13:24.096+0000 7f8175a13800 5 AuthRegistry(0x55b5cb76ea28) adding con mode: secure 2024-06-04T16:13:24.463 INFO:tasks.workunit.client.0.smithi144.stderr: -368> 2024-06-04T16:13:24.096+0000 7f8175a13800 5 AuthRegistry(0x55b5cb76ea28) adding con mode: crc 2024-06-04T16:13:24.463 INFO:tasks.workunit.client.0.smithi144.stderr: -367> 2024-06-04T16:13:24.096+0000 7f8175a13800 5 AuthRegistry(0x55b5cb76ea28) adding con mode: crc 2024-06-04T16:13:24.463 INFO:tasks.workunit.client.0.smithi144.stderr: -366> 2024-06-04T16:13:24.096+0000 7f8175a13800 5 AuthRegistry(0x55b5cb76ea28) adding con mode: secure 2024-06-04T16:13:24.463 INFO:tasks.workunit.client.0.smithi144.stderr: -365> 2024-06-04T16:13:24.096+0000 7f8175a13800 5 AuthRegistry(0x55b5cb76ea28) adding con mode: crc 2024-06-04T16:13:24.463 INFO:tasks.workunit.client.0.smithi144.stderr: -364> 2024-06-04T16:13:24.096+0000 7f8175a13800 5 AuthRegistry(0x55b5cb76ea28) adding con mode: secure 2024-06-04T16:13:24.463 INFO:tasks.workunit.client.0.smithi144.stderr: -363> 2024-06-04T16:13:24.096+0000 7f8175a13800 5 AuthRegistry(0x55b5cb76ea28) adding con mode: crc 2024-06-04T16:13:24.463 INFO:tasks.workunit.client.0.smithi144.stderr: -362> 2024-06-04T16:13:24.096+0000 7f8175a13800 5 AuthRegistry(0x55b5cb76ea28) adding con mode: secure 2024-06-04T16:13:24.463 INFO:tasks.workunit.client.0.smithi144.stderr: -361> 2024-06-04T16:13:24.096+0000 7f8175a13800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-06-04T16:13:24.463 INFO:tasks.workunit.client.0.smithi144.stderr: -360> 2024-06-04T16:13:24.096+0000 7f8175a13800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-06-04T16:13:24.463 INFO:tasks.workunit.client.0.smithi144.stderr: -359> 2024-06-04T16:13:24.096+0000 7f8175a13800 5 asok(0x55b5cb4f7c60) register_command rotate-key cmddesc rotate-key hook 0x55b5cb76eb70 EEXIST 2024-06-04T16:13:24.463 INFO:tasks.workunit.client.0.smithi144.stderr: -358> 2024-06-04T16:13:24.096+0000 7f8175a13800 10 monclient: _reopen_session rank -1 2024-06-04T16:13:24.463 INFO:tasks.workunit.client.0.smithi144.stderr: -357> 2024-06-04T16:13:24.096+0000 7f8175a13800 10 monclient: _add_conns ranks=[2,1,0] 2024-06-04T16:13:24.463 INFO:tasks.workunit.client.0.smithi144.stderr: -356> 2024-06-04T16:13:24.096+0000 7f8175a13800 10 monclient(hunting): picked mon.noname-c con 0x55b5cb77a0e0 addr [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] 2024-06-04T16:13:24.463 INFO:tasks.workunit.client.0.smithi144.stderr: -355> 2024-06-04T16:13:24.096+0000 7f8175a13800 10 monclient(hunting): picked mon.noname-b con 0x55b5cb77a4c0 addr [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] 2024-06-04T16:13:24.464 INFO:tasks.workunit.client.0.smithi144.stderr: -354> 2024-06-04T16:13:24.096+0000 7f8175a13800 10 monclient(hunting): picked mon.noname-a con 0x55b5cb79c810 addr [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] 2024-06-04T16:13:24.464 INFO:tasks.workunit.client.0.smithi144.stderr: -353> 2024-06-04T16:13:24.096+0000 7f8175a13800 10 monclient(hunting): start opening mon connection 2024-06-04T16:13:24.464 INFO:tasks.workunit.client.0.smithi144.stderr: -352> 2024-06-04T16:13:24.096+0000 7f8175a13800 10 monclient(hunting): start opening mon connection 2024-06-04T16:13:24.464 INFO:tasks.workunit.client.0.smithi144.stderr: -351> 2024-06-04T16:13:24.096+0000 7f8175a13800 10 monclient(hunting): start opening mon connection 2024-06-04T16:13:24.464 INFO:tasks.workunit.client.0.smithi144.stderr: -350> 2024-06-04T16:13:24.096+0000 7f8175a13800 10 monclient(hunting): _renew_subs 2024-06-04T16:13:24.464 INFO:tasks.workunit.client.0.smithi144.stderr: -349> 2024-06-04T16:13:24.096+0000 7f8175a13800 10 monclient(hunting): authenticate will time out at 2041.912969s 2024-06-04T16:13:24.464 INFO:tasks.workunit.client.0.smithi144.stderr: -348> 2024-06-04T16:13:24.096+0000 7f816bfff640 10 monclient(hunting): get_auth_request con 0x55b5cb77a0e0 auth_method 0 2024-06-04T16:13:24.464 INFO:tasks.workunit.client.0.smithi144.stderr: -347> 2024-06-04T16:13:24.096+0000 7f816bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-06-04T16:13:24.464 INFO:tasks.workunit.client.0.smithi144.stderr: -346> 2024-06-04T16:13:24.096+0000 7f816bfff640 10 monclient(hunting): _init_auth method 2 2024-06-04T16:13:24.464 INFO:tasks.workunit.client.0.smithi144.stderr: -345> 2024-06-04T16:13:24.096+0000 7f816bfff640 10 monclient(hunting): _init_auth creating new auth 2024-06-04T16:13:24.464 INFO:tasks.workunit.client.0.smithi144.stderr: -344> 2024-06-04T16:13:24.096+0000 7f8171064640 10 monclient(hunting): get_auth_request con 0x55b5cb79c810 auth_method 0 2024-06-04T16:13:24.464 INFO:tasks.workunit.client.0.smithi144.stderr: -343> 2024-06-04T16:13:24.096+0000 7f8171064640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-06-04T16:13:24.464 INFO:tasks.workunit.client.0.smithi144.stderr: -342> 2024-06-04T16:13:24.096+0000 7f8171064640 10 monclient(hunting): _init_auth method 2 2024-06-04T16:13:24.464 INFO:tasks.workunit.client.0.smithi144.stderr: -341> 2024-06-04T16:13:24.096+0000 7f8171064640 10 monclient(hunting): _init_auth creating new auth 2024-06-04T16:13:24.465 INFO:tasks.workunit.client.0.smithi144.stderr: -340> 2024-06-04T16:13:24.097+0000 7f8171865640 10 monclient(hunting): get_auth_request con 0x55b5cb77a4c0 auth_method 0 2024-06-04T16:13:24.465 INFO:tasks.workunit.client.0.smithi144.stderr: -339> 2024-06-04T16:13:24.097+0000 7f8171865640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-06-04T16:13:24.465 INFO:tasks.workunit.client.0.smithi144.stderr: -338> 2024-06-04T16:13:24.097+0000 7f8171865640 10 monclient(hunting): _init_auth method 2 2024-06-04T16:13:24.465 INFO:tasks.workunit.client.0.smithi144.stderr: -337> 2024-06-04T16:13:24.097+0000 7f8171865640 10 monclient(hunting): _init_auth creating new auth 2024-06-04T16:13:24.465 INFO:tasks.workunit.client.0.smithi144.stderr: -336> 2024-06-04T16:13:24.097+0000 7f816bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-06-04T16:13:24.465 INFO:tasks.workunit.client.0.smithi144.stderr: -335> 2024-06-04T16:13:24.097+0000 7f816bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-06-04T16:13:24.465 INFO:tasks.workunit.client.0.smithi144.stderr: -334> 2024-06-04T16:13:24.097+0000 7f816bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-06-04T16:13:24.465 INFO:tasks.workunit.client.0.smithi144.stderr: -333> 2024-06-04T16:13:24.097+0000 7f8171064640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-06-04T16:13:24.465 INFO:tasks.workunit.client.0.smithi144.stderr: -332> 2024-06-04T16:13:24.097+0000 7f8171064640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-06-04T16:13:24.465 INFO:tasks.workunit.client.0.smithi144.stderr: -331> 2024-06-04T16:13:24.097+0000 7f8171064640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-06-04T16:13:24.465 INFO:tasks.workunit.client.0.smithi144.stderr: -330> 2024-06-04T16:13:24.097+0000 7f8171865640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-06-04T16:13:24.465 INFO:tasks.workunit.client.0.smithi144.stderr: -329> 2024-06-04T16:13:24.097+0000 7f8171865640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-06-04T16:13:24.465 INFO:tasks.workunit.client.0.smithi144.stderr: -328> 2024-06-04T16:13:24.097+0000 7f8171865640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-06-04T16:13:24.465 INFO:tasks.workunit.client.0.smithi144.stderr: -327> 2024-06-04T16:13:24.097+0000 7f816bfff640 10 monclient(hunting): handle_auth_done global_id 6560 payload 824 2024-06-04T16:13:24.466 INFO:tasks.workunit.client.0.smithi144.stderr: -326> 2024-06-04T16:13:24.097+0000 7f816bfff640 10 monclient: _finish_hunting 0 2024-06-04T16:13:24.466 INFO:tasks.workunit.client.0.smithi144.stderr: -325> 2024-06-04T16:13:24.097+0000 7f816bfff640 1 monclient: found mon.noname-c 2024-06-04T16:13:24.466 INFO:tasks.workunit.client.0.smithi144.stderr: -324> 2024-06-04T16:13:24.097+0000 7f816bfff640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.144:3301/0 2024-06-04T16:13:24.466 INFO:tasks.workunit.client.0.smithi144.stderr: -323> 2024-06-04T16:13:24.097+0000 7f8056ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-06-04T16:13:24.466 INFO:tasks.workunit.client.0.smithi144.stderr: -322> 2024-06-04T16:13:24.097+0000 7f8056ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-06-04T16:13:24.466 INFO:tasks.workunit.client.0.smithi144.stderr: -321> 2024-06-04T16:13:24.097+0000 7f8056ffd640 10 monclient: dump: 2024-06-04T16:13:24.466 INFO:tasks.workunit.client.0.smithi144.stderr:epoch 1 2024-06-04T16:13:24.466 INFO:tasks.workunit.client.0.smithi144.stderr:fsid 15e56bb1-4856-42f3-b6db-a2c8f23c5557 2024-06-04T16:13:24.466 INFO:tasks.workunit.client.0.smithi144.stderr:last_changed 2024-06-04T15:51:29.789359+0000 2024-06-04T16:13:24.466 INFO:tasks.workunit.client.0.smithi144.stderr:created 2024-06-04T15:51:29.789359+0000 2024-06-04T16:13:24.466 INFO:tasks.workunit.client.0.smithi144.stderr:min_mon_release 19 (squid) 2024-06-04T16:13:24.466 INFO:tasks.workunit.client.0.smithi144.stderr:election_strategy: 1 2024-06-04T16:13:24.466 INFO:tasks.workunit.client.0.smithi144.stderr:0: [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] mon.a 2024-06-04T16:13:24.466 INFO:tasks.workunit.client.0.smithi144.stderr:1: [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] mon.b 2024-06-04T16:13:24.467 INFO:tasks.workunit.client.0.smithi144.stderr:2: [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] mon.c 2024-06-04T16:13:24.467 INFO:tasks.workunit.client.0.smithi144.stderr: 2024-06-04T16:13:24.467 INFO:tasks.workunit.client.0.smithi144.stderr: -320> 2024-06-04T16:13:24.097+0000 7f8056ffd640 10 monclient: _finish_auth 0 2024-06-04T16:13:24.467 INFO:tasks.workunit.client.0.smithi144.stderr: -319> 2024-06-04T16:13:24.097+0000 7f8056ffd640 10 monclient: _check_auth_tickets 2024-06-04T16:13:24.467 INFO:tasks.workunit.client.0.smithi144.stderr: -318> 2024-06-04T16:13:24.097+0000 7f8056ffd640 10 monclient: handle_config config(0 keys) 2024-06-04T16:13:24.467 INFO:tasks.workunit.client.0.smithi144.stderr: -317> 2024-06-04T16:13:24.097+0000 7f8056ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-06-04T16:13:24.467 INFO:tasks.workunit.client.0.smithi144.stderr: -316> 2024-06-04T16:13:24.097+0000 7f8056ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-06-04T16:13:24.467 INFO:tasks.workunit.client.0.smithi144.stderr: -315> 2024-06-04T16:13:24.097+0000 7f8056ffd640 10 monclient: dump: 2024-06-04T16:13:24.467 INFO:tasks.workunit.client.0.smithi144.stderr:epoch 1 2024-06-04T16:13:24.467 INFO:tasks.workunit.client.0.smithi144.stderr:fsid 15e56bb1-4856-42f3-b6db-a2c8f23c5557 2024-06-04T16:13:24.467 INFO:tasks.workunit.client.0.smithi144.stderr:last_changed 2024-06-04T15:51:29.789359+0000 2024-06-04T16:13:24.467 INFO:tasks.workunit.client.0.smithi144.stderr:created 2024-06-04T15:51:29.789359+0000 2024-06-04T16:13:24.467 INFO:tasks.workunit.client.0.smithi144.stderr:min_mon_release 19 (squid) 2024-06-04T16:13:24.468 INFO:tasks.workunit.client.0.smithi144.stderr:election_strategy: 1 2024-06-04T16:13:24.468 INFO:tasks.workunit.client.0.smithi144.stderr:0: [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] mon.a 2024-06-04T16:13:24.468 INFO:tasks.workunit.client.0.smithi144.stderr:1: [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] mon.b 2024-06-04T16:13:24.468 INFO:tasks.workunit.client.0.smithi144.stderr:2: [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] mon.c 2024-06-04T16:13:24.468 INFO:tasks.workunit.client.0.smithi144.stderr: 2024-06-04T16:13:24.468 INFO:tasks.workunit.client.0.smithi144.stderr: -314> 2024-06-04T16:13:24.097+0000 7f8175a13800 5 monclient: authenticate success, global_id 6560 2024-06-04T16:13:24.468 INFO:tasks.workunit.client.0.smithi144.stderr: -313> 2024-06-04T16:13:24.097+0000 7f8175a13800 10 monclient: _renew_subs 2024-06-04T16:13:24.468 INFO:tasks.workunit.client.0.smithi144.stderr: -312> 2024-06-04T16:13:24.097+0000 7f8175a13800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.144:3301/0 2024-06-04T16:13:24.468 INFO:tasks.workunit.client.0.smithi144.stderr: -311> 2024-06-04T16:13:24.097+0000 7f8172066640 4 set_mon_vals no callback set 2024-06-04T16:13:24.468 INFO:tasks.workunit.client.0.smithi144.stderr: -310> 2024-06-04T16:13:24.097+0000 7f8175a13800 10 monclient: _renew_subs 2024-06-04T16:13:24.468 INFO:tasks.workunit.client.0.smithi144.stderr: -309> 2024-06-04T16:13:24.097+0000 7f8175a13800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.144:3301/0 2024-06-04T16:13:24.468 INFO:tasks.workunit.client.0.smithi144.stderr: -308> 2024-06-04T16:13:24.099+0000 7f8056ffd640 4 mgrc handle_mgr_map Got map version 5 2024-06-04T16:13:24.468 INFO:tasks.workunit.client.0.smithi144.stderr: -307> 2024-06-04T16:13:24.099+0000 7f8056ffd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.177:6832/2645786330,v1:172.21.15.177:6833/2645786330] 2024-06-04T16:13:24.468 INFO:tasks.workunit.client.0.smithi144.stderr: -306> 2024-06-04T16:13:24.099+0000 7f8056ffd640 4 mgrc reconnect Starting new session with [v2:172.21.15.177:6832/2645786330,v1:172.21.15.177:6833/2645786330] 2024-06-04T16:13:24.468 INFO:tasks.workunit.client.0.smithi144.stderr: -305> 2024-06-04T16:13:24.099+0000 7f8171865640 10 monclient: get_auth_request con 0x7f804c074bc0 auth_method 0 2024-06-04T16:13:24.469 INFO:tasks.workunit.client.0.smithi144.stderr: -304> 2024-06-04T16:13:24.099+0000 7f8175a13800 10 monclient: get_monmap_and_config 2024-06-04T16:13:24.469 INFO:tasks.workunit.client.0.smithi144.stderr: -303> 2024-06-04T16:13:24.099+0000 7f8175a13800 10 monclient: build_initial_monmap 2024-06-04T16:13:24.469 INFO:tasks.workunit.client.0.smithi144.stderr: -302> 2024-06-04T16:13:24.099+0000 7f8175a13800 1 build_initial for_mkfs: 0 2024-06-04T16:13:24.469 INFO:tasks.workunit.client.0.smithi144.stderr: -301> 2024-06-04T16:13:24.099+0000 7f8175a13800 10 monclient: monmap: 2024-06-04T16:13:24.469 INFO:tasks.workunit.client.0.smithi144.stderr:epoch 0 2024-06-04T16:13:24.469 INFO:tasks.workunit.client.0.smithi144.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-06-04T16:13:24.469 INFO:tasks.workunit.client.0.smithi144.stderr:last_changed 0.000000 2024-06-04T16:13:24.469 INFO:tasks.workunit.client.0.smithi144.stderr:created 0.000000 2024-06-04T16:13:24.469 INFO:tasks.workunit.client.0.smithi144.stderr:min_mon_release 0 (unknown) 2024-06-04T16:13:24.469 INFO:tasks.workunit.client.0.smithi144.stderr:election_strategy: 1 2024-06-04T16:13:24.469 INFO:tasks.workunit.client.0.smithi144.stderr:0: [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] mon.noname-a 2024-06-04T16:13:24.469 INFO:tasks.workunit.client.0.smithi144.stderr:1: [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] mon.noname-b 2024-06-04T16:13:24.469 INFO:tasks.workunit.client.0.smithi144.stderr:2: [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] mon.noname-c 2024-06-04T16:13:24.470 INFO:tasks.workunit.client.0.smithi144.stderr: 2024-06-04T16:13:24.470 INFO:tasks.workunit.client.0.smithi144.stderr: -300> 2024-06-04T16:13:24.099+0000 7f8175a13800 5 AuthRegistry(0x55b5cb7b7130) adding auth protocol: cephx 2024-06-04T16:13:24.470 INFO:tasks.workunit.client.0.smithi144.stderr: -299> 2024-06-04T16:13:24.099+0000 7f8175a13800 5 AuthRegistry(0x55b5cb7b7130) adding auth protocol: cephx 2024-06-04T16:13:24.470 INFO:tasks.workunit.client.0.smithi144.stderr: -298> 2024-06-04T16:13:24.099+0000 7f8175a13800 5 AuthRegistry(0x55b5cb7b7130) adding auth protocol: cephx 2024-06-04T16:13:24.470 INFO:tasks.workunit.client.0.smithi144.stderr: -297> 2024-06-04T16:13:24.099+0000 7f8175a13800 5 AuthRegistry(0x55b5cb7b7130) adding con mode: secure 2024-06-04T16:13:24.470 INFO:tasks.workunit.client.0.smithi144.stderr: -296> 2024-06-04T16:13:24.099+0000 7f8175a13800 5 AuthRegistry(0x55b5cb7b7130) adding con mode: crc 2024-06-04T16:13:24.470 INFO:tasks.workunit.client.0.smithi144.stderr: -295> 2024-06-04T16:13:24.099+0000 7f8175a13800 5 AuthRegistry(0x55b5cb7b7130) adding con mode: secure 2024-06-04T16:13:24.470 INFO:tasks.workunit.client.0.smithi144.stderr: -294> 2024-06-04T16:13:24.099+0000 7f8175a13800 5 AuthRegistry(0x55b5cb7b7130) adding con mode: crc 2024-06-04T16:13:24.470 INFO:tasks.workunit.client.0.smithi144.stderr: -293> 2024-06-04T16:13:24.099+0000 7f8175a13800 5 AuthRegistry(0x55b5cb7b7130) adding con mode: secure 2024-06-04T16:13:24.470 INFO:tasks.workunit.client.0.smithi144.stderr: -292> 2024-06-04T16:13:24.099+0000 7f8175a13800 5 AuthRegistry(0x55b5cb7b7130) adding con mode: crc 2024-06-04T16:13:24.470 INFO:tasks.workunit.client.0.smithi144.stderr: -291> 2024-06-04T16:13:24.099+0000 7f8175a13800 5 AuthRegistry(0x55b5cb7b7130) adding con mode: crc 2024-06-04T16:13:24.470 INFO:tasks.workunit.client.0.smithi144.stderr: -290> 2024-06-04T16:13:24.099+0000 7f8175a13800 5 AuthRegistry(0x55b5cb7b7130) adding con mode: secure 2024-06-04T16:13:24.471 INFO:tasks.workunit.client.0.smithi144.stderr: -289> 2024-06-04T16:13:24.099+0000 7f8175a13800 5 AuthRegistry(0x55b5cb7b7130) adding con mode: crc 2024-06-04T16:13:24.471 INFO:tasks.workunit.client.0.smithi144.stderr: -288> 2024-06-04T16:13:24.099+0000 7f8175a13800 5 AuthRegistry(0x55b5cb7b7130) adding con mode: secure 2024-06-04T16:13:24.471 INFO:tasks.workunit.client.0.smithi144.stderr: -287> 2024-06-04T16:13:24.099+0000 7f8175a13800 5 AuthRegistry(0x55b5cb7b7130) adding con mode: crc 2024-06-04T16:13:24.471 INFO:tasks.workunit.client.0.smithi144.stderr: -286> 2024-06-04T16:13:24.099+0000 7f8175a13800 5 AuthRegistry(0x55b5cb7b7130) adding con mode: secure 2024-06-04T16:13:24.471 INFO:tasks.workunit.client.0.smithi144.stderr: -285> 2024-06-04T16:13:24.099+0000 7f8175a13800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-06-04T16:13:24.471 INFO:tasks.workunit.client.0.smithi144.stderr: -284> 2024-06-04T16:13:24.099+0000 7f8175a13800 10 monclient: init 2024-06-04T16:13:24.471 INFO:tasks.workunit.client.0.smithi144.stderr: -283> 2024-06-04T16:13:24.099+0000 7f8175a13800 5 AuthRegistry(0x7fff6a9d0570) adding auth protocol: cephx 2024-06-04T16:13:24.471 INFO:tasks.workunit.client.0.smithi144.stderr: -282> 2024-06-04T16:13:24.099+0000 7f8175a13800 5 AuthRegistry(0x7fff6a9d0570) adding auth protocol: cephx 2024-06-04T16:13:24.471 INFO:tasks.workunit.client.0.smithi144.stderr: -281> 2024-06-04T16:13:24.099+0000 7f8175a13800 5 AuthRegistry(0x7fff6a9d0570) adding auth protocol: cephx 2024-06-04T16:13:24.471 INFO:tasks.workunit.client.0.smithi144.stderr: -280> 2024-06-04T16:13:24.099+0000 7f8175a13800 5 AuthRegistry(0x7fff6a9d0570) adding con mode: secure 2024-06-04T16:13:24.471 INFO:tasks.workunit.client.0.smithi144.stderr: -279> 2024-06-04T16:13:24.099+0000 7f8175a13800 5 AuthRegistry(0x7fff6a9d0570) adding con mode: crc 2024-06-04T16:13:24.471 INFO:tasks.workunit.client.0.smithi144.stderr: -278> 2024-06-04T16:13:24.099+0000 7f8175a13800 5 AuthRegistry(0x7fff6a9d0570) adding con mode: secure 2024-06-04T16:13:24.471 INFO:tasks.workunit.client.0.smithi144.stderr: -277> 2024-06-04T16:13:24.099+0000 7f8175a13800 5 AuthRegistry(0x7fff6a9d0570) adding con mode: crc 2024-06-04T16:13:24.471 INFO:tasks.workunit.client.0.smithi144.stderr: -276> 2024-06-04T16:13:24.099+0000 7f8175a13800 5 AuthRegistry(0x7fff6a9d0570) adding con mode: secure 2024-06-04T16:13:24.472 INFO:tasks.workunit.client.0.smithi144.stderr: -275> 2024-06-04T16:13:24.099+0000 7f8175a13800 5 AuthRegistry(0x7fff6a9d0570) adding con mode: crc 2024-06-04T16:13:24.472 INFO:tasks.workunit.client.0.smithi144.stderr: -274> 2024-06-04T16:13:24.099+0000 7f8175a13800 5 AuthRegistry(0x7fff6a9d0570) adding con mode: crc 2024-06-04T16:13:24.472 INFO:tasks.workunit.client.0.smithi144.stderr: -273> 2024-06-04T16:13:24.099+0000 7f8175a13800 5 AuthRegistry(0x7fff6a9d0570) adding con mode: secure 2024-06-04T16:13:24.472 INFO:tasks.workunit.client.0.smithi144.stderr: -272> 2024-06-04T16:13:24.099+0000 7f8175a13800 5 AuthRegistry(0x7fff6a9d0570) adding con mode: crc 2024-06-04T16:13:24.472 INFO:tasks.workunit.client.0.smithi144.stderr: -271> 2024-06-04T16:13:24.099+0000 7f8175a13800 5 AuthRegistry(0x7fff6a9d0570) adding con mode: secure 2024-06-04T16:13:24.472 INFO:tasks.workunit.client.0.smithi144.stderr: -270> 2024-06-04T16:13:24.099+0000 7f8175a13800 5 AuthRegistry(0x7fff6a9d0570) adding con mode: crc 2024-06-04T16:13:24.472 INFO:tasks.workunit.client.0.smithi144.stderr: -269> 2024-06-04T16:13:24.099+0000 7f8175a13800 5 AuthRegistry(0x7fff6a9d0570) adding con mode: secure 2024-06-04T16:13:24.472 INFO:tasks.workunit.client.0.smithi144.stderr: -268> 2024-06-04T16:13:24.099+0000 7f8175a13800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-06-04T16:13:24.472 INFO:tasks.workunit.client.0.smithi144.stderr: -267> 2024-06-04T16:13:24.100+0000 7f8175a13800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-06-04T16:13:24.472 INFO:tasks.workunit.client.0.smithi144.stderr: -266> 2024-06-04T16:13:24.100+0000 7f8175a13800 5 asok(0x55b5cb4f7c60) register_command rotate-key cmddesc rotate-key hook 0x7fff6a9d06b8 EEXIST 2024-06-04T16:13:24.472 INFO:tasks.workunit.client.0.smithi144.stderr: -265> 2024-06-04T16:13:24.100+0000 7f8175a13800 10 monclient: _reopen_session rank -1 2024-06-04T16:13:24.472 INFO:tasks.workunit.client.0.smithi144.stderr: -264> 2024-06-04T16:13:24.100+0000 7f8175a13800 10 monclient: _add_conns ranks=[1,2,0] 2024-06-04T16:13:24.472 INFO:tasks.workunit.client.0.smithi144.stderr: -263> 2024-06-04T16:13:24.100+0000 7f8175a13800 10 monclient(hunting): picked mon.noname-b con 0x55b5cb7dcfd0 addr [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] 2024-06-04T16:13:24.472 INFO:tasks.workunit.client.0.smithi144.stderr: -262> 2024-06-04T16:13:24.100+0000 7f8175a13800 10 monclient(hunting): picked mon.noname-c con 0x55b5cb7bc7d0 addr [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] 2024-06-04T16:13:24.472 INFO:tasks.workunit.client.0.smithi144.stderr: -261> 2024-06-04T16:13:24.100+0000 7f8175a13800 10 monclient(hunting): picked mon.noname-a con 0x55b5cb7e6f50 addr [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] 2024-06-04T16:13:24.473 INFO:tasks.workunit.client.0.smithi144.stderr: -260> 2024-06-04T16:13:24.100+0000 7f8175a13800 10 monclient(hunting): start opening mon connection 2024-06-04T16:13:24.473 INFO:tasks.workunit.client.0.smithi144.stderr: -259> 2024-06-04T16:13:24.100+0000 7f8175a13800 10 monclient(hunting): start opening mon connection 2024-06-04T16:13:24.473 INFO:tasks.workunit.client.0.smithi144.stderr: -258> 2024-06-04T16:13:24.100+0000 7f8175a13800 10 monclient(hunting): start opening mon connection 2024-06-04T16:13:24.473 INFO:tasks.workunit.client.0.smithi144.stderr: -257> 2024-06-04T16:13:24.100+0000 7f8175a13800 10 monclient(hunting): _renew_subs 2024-06-04T16:13:24.473 INFO:tasks.workunit.client.0.smithi144.stderr: -256> 2024-06-04T16:13:24.100+0000 7f8175a13800 10 monclient(hunting): authenticate will time out at 2041.916367s 2024-06-04T16:13:24.473 INFO:tasks.workunit.client.0.smithi144.stderr: -255> 2024-06-04T16:13:24.100+0000 7f8171865640 10 monclient(hunting): get_auth_request con 0x55b5cb7bc7d0 auth_method 0 2024-06-04T16:13:24.473 INFO:tasks.workunit.client.0.smithi144.stderr: -254> 2024-06-04T16:13:24.100+0000 7f8171865640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-06-04T16:13:24.473 INFO:tasks.workunit.client.0.smithi144.stderr: -253> 2024-06-04T16:13:24.100+0000 7f8171865640 10 monclient(hunting): _init_auth method 2 2024-06-04T16:13:24.473 INFO:tasks.workunit.client.0.smithi144.stderr: -252> 2024-06-04T16:13:24.100+0000 7f8171865640 10 monclient(hunting): _init_auth creating new auth 2024-06-04T16:13:24.473 INFO:tasks.workunit.client.0.smithi144.stderr: -251> 2024-06-04T16:13:24.100+0000 7f8171064640 10 monclient(hunting): get_auth_request con 0x55b5cb7e6f50 auth_method 0 2024-06-04T16:13:24.473 INFO:tasks.workunit.client.0.smithi144.stderr: -250> 2024-06-04T16:13:24.100+0000 7f8171064640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-06-04T16:13:24.473 INFO:tasks.workunit.client.0.smithi144.stderr: -249> 2024-06-04T16:13:24.100+0000 7f8171064640 10 monclient(hunting): _init_auth method 2 2024-06-04T16:13:24.474 INFO:tasks.workunit.client.0.smithi144.stderr: -248> 2024-06-04T16:13:24.100+0000 7f8171064640 10 monclient(hunting): _init_auth creating new auth 2024-06-04T16:13:24.474 INFO:tasks.workunit.client.0.smithi144.stderr: -247> 2024-06-04T16:13:24.100+0000 7f8171865640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-06-04T16:13:24.474 INFO:tasks.workunit.client.0.smithi144.stderr: -246> 2024-06-04T16:13:24.100+0000 7f8171865640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-06-04T16:13:24.474 INFO:tasks.workunit.client.0.smithi144.stderr: -245> 2024-06-04T16:13:24.100+0000 7f8171865640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-06-04T16:13:24.474 INFO:tasks.workunit.client.0.smithi144.stderr: -244> 2024-06-04T16:13:24.100+0000 7f8171064640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-06-04T16:13:24.474 INFO:tasks.workunit.client.0.smithi144.stderr: -243> 2024-06-04T16:13:24.100+0000 7f8171064640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-06-04T16:13:24.474 INFO:tasks.workunit.client.0.smithi144.stderr: -242> 2024-06-04T16:13:24.100+0000 7f8171064640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-06-04T16:13:24.474 INFO:tasks.workunit.client.0.smithi144.stderr: -241> 2024-06-04T16:13:24.100+0000 7f816bfff640 10 monclient(hunting): get_auth_request con 0x55b5cb7dcfd0 auth_method 0 2024-06-04T16:13:24.474 INFO:tasks.workunit.client.0.smithi144.stderr: -240> 2024-06-04T16:13:24.100+0000 7f816bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-06-04T16:13:24.474 INFO:tasks.workunit.client.0.smithi144.stderr: -239> 2024-06-04T16:13:24.100+0000 7f816bfff640 10 monclient(hunting): _init_auth method 2 2024-06-04T16:13:24.474 INFO:tasks.workunit.client.0.smithi144.stderr: -238> 2024-06-04T16:13:24.100+0000 7f816bfff640 10 monclient(hunting): _init_auth creating new auth 2024-06-04T16:13:24.474 INFO:tasks.workunit.client.0.smithi144.stderr: -237> 2024-06-04T16:13:24.100+0000 7f8171865640 10 monclient(hunting): handle_auth_done global_id 6563 payload 274 2024-06-04T16:13:24.474 INFO:tasks.workunit.client.0.smithi144.stderr: -236> 2024-06-04T16:13:24.100+0000 7f8171865640 10 monclient: _finish_hunting 0 2024-06-04T16:13:24.475 INFO:tasks.workunit.client.0.smithi144.stderr: -235> 2024-06-04T16:13:24.100+0000 7f8171865640 1 monclient: found mon.noname-c 2024-06-04T16:13:24.475 INFO:tasks.workunit.client.0.smithi144.stderr: -234> 2024-06-04T16:13:24.100+0000 7f8171865640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.144:3301/0 2024-06-04T16:13:24.475 INFO:tasks.workunit.client.0.smithi144.stderr: -233> 2024-06-04T16:13:24.100+0000 7f8054ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-06-04T16:13:24.475 INFO:tasks.workunit.client.0.smithi144.stderr: -232> 2024-06-04T16:13:24.100+0000 7f8054ff9640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-06-04T16:13:24.475 INFO:tasks.workunit.client.0.smithi144.stderr: -231> 2024-06-04T16:13:24.100+0000 7f8054ff9640 10 monclient: dump: 2024-06-04T16:13:24.475 INFO:tasks.workunit.client.0.smithi144.stderr:epoch 1 2024-06-04T16:13:24.475 INFO:tasks.workunit.client.0.smithi144.stderr:fsid 15e56bb1-4856-42f3-b6db-a2c8f23c5557 2024-06-04T16:13:24.475 INFO:tasks.workunit.client.0.smithi144.stderr:last_changed 2024-06-04T15:51:29.789359+0000 2024-06-04T16:13:24.475 INFO:tasks.workunit.client.0.smithi144.stderr:created 2024-06-04T15:51:29.789359+0000 2024-06-04T16:13:24.475 INFO:tasks.workunit.client.0.smithi144.stderr:min_mon_release 19 (squid) 2024-06-04T16:13:24.475 INFO:tasks.workunit.client.0.smithi144.stderr:election_strategy: 1 2024-06-04T16:13:24.475 INFO:tasks.workunit.client.0.smithi144.stderr:0: [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] mon.a 2024-06-04T16:13:24.475 INFO:tasks.workunit.client.0.smithi144.stderr:1: [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] mon.b 2024-06-04T16:13:24.475 INFO:tasks.workunit.client.0.smithi144.stderr:2: [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] mon.c 2024-06-04T16:13:24.476 INFO:tasks.workunit.client.0.smithi144.stderr: 2024-06-04T16:13:24.476 INFO:tasks.workunit.client.0.smithi144.stderr: -230> 2024-06-04T16:13:24.100+0000 7f8054ff9640 10 monclient: _finish_auth 0 2024-06-04T16:13:24.476 INFO:tasks.workunit.client.0.smithi144.stderr: -229> 2024-06-04T16:13:24.100+0000 7f8054ff9640 10 monclient: _check_auth_tickets 2024-06-04T16:13:24.476 INFO:tasks.workunit.client.0.smithi144.stderr: -228> 2024-06-04T16:13:24.100+0000 7f8054ff9640 10 monclient: handle_config config(0 keys) 2024-06-04T16:13:24.476 INFO:tasks.workunit.client.0.smithi144.stderr: -227> 2024-06-04T16:13:24.100+0000 7f8054ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-06-04T16:13:24.476 INFO:tasks.workunit.client.0.smithi144.stderr: -226> 2024-06-04T16:13:24.100+0000 7f8054ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-06-04T16:13:24.476 INFO:tasks.workunit.client.0.smithi144.stderr: -225> 2024-06-04T16:13:24.100+0000 7f8054ff9640 10 monclient: dump: 2024-06-04T16:13:24.476 INFO:tasks.workunit.client.0.smithi144.stderr:epoch 1 2024-06-04T16:13:24.476 INFO:tasks.workunit.client.0.smithi144.stderr:fsid 15e56bb1-4856-42f3-b6db-a2c8f23c5557 2024-06-04T16:13:24.476 INFO:tasks.workunit.client.0.smithi144.stderr:last_changed 2024-06-04T15:51:29.789359+0000 2024-06-04T16:13:24.476 INFO:tasks.workunit.client.0.smithi144.stderr:created 2024-06-04T15:51:29.789359+0000 2024-06-04T16:13:24.476 INFO:tasks.workunit.client.0.smithi144.stderr:min_mon_release 19 (squid) 2024-06-04T16:13:24.476 INFO:tasks.workunit.client.0.smithi144.stderr:election_strategy: 1 2024-06-04T16:13:24.476 INFO:tasks.workunit.client.0.smithi144.stderr:0: [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] mon.a 2024-06-04T16:13:24.477 INFO:tasks.workunit.client.0.smithi144.stderr:1: [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] mon.b 2024-06-04T16:13:24.477 INFO:tasks.workunit.client.0.smithi144.stderr:2: [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] mon.c 2024-06-04T16:13:24.477 INFO:tasks.workunit.client.0.smithi144.stderr: 2024-06-04T16:13:24.477 INFO:tasks.workunit.client.0.smithi144.stderr: -224> 2024-06-04T16:13:24.100+0000 7f8175a13800 5 monclient: authenticate success, global_id 6563 2024-06-04T16:13:24.477 INFO:tasks.workunit.client.0.smithi144.stderr: -223> 2024-06-04T16:13:24.100+0000 7f8175a13800 10 monclient: get_monmap_and_config success 2024-06-04T16:13:24.477 INFO:tasks.workunit.client.0.smithi144.stderr: -222> 2024-06-04T16:13:24.100+0000 7f8175a13800 4 set_mon_vals no callback set 2024-06-04T16:13:24.477 INFO:tasks.workunit.client.0.smithi144.stderr: -221> 2024-06-04T16:13:24.101+0000 7f8175a13800 10 monclient: shutdown 2024-06-04T16:13:24.477 INFO:tasks.workunit.client.0.smithi144.stderr: -220> 2024-06-04T16:13:24.101+0000 7f8175a13800 10 monclient: build_initial_monmap 2024-06-04T16:13:24.477 INFO:tasks.workunit.client.0.smithi144.stderr: -219> 2024-06-04T16:13:24.101+0000 7f8175a13800 1 build_initial for_mkfs: 0 2024-06-04T16:13:24.477 INFO:tasks.workunit.client.0.smithi144.stderr: -218> 2024-06-04T16:13:24.101+0000 7f8175a13800 10 monclient: monmap: 2024-06-04T16:13:24.477 INFO:tasks.workunit.client.0.smithi144.stderr:epoch 0 2024-06-04T16:13:24.477 INFO:tasks.workunit.client.0.smithi144.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-06-04T16:13:24.477 INFO:tasks.workunit.client.0.smithi144.stderr:last_changed 0.000000 2024-06-04T16:13:24.477 INFO:tasks.workunit.client.0.smithi144.stderr:created 0.000000 2024-06-04T16:13:24.477 INFO:tasks.workunit.client.0.smithi144.stderr:min_mon_release 0 (unknown) 2024-06-04T16:13:24.478 INFO:tasks.workunit.client.0.smithi144.stderr:election_strategy: 1 2024-06-04T16:13:24.478 INFO:tasks.workunit.client.0.smithi144.stderr:0: [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] mon.noname-a 2024-06-04T16:13:24.478 INFO:tasks.workunit.client.0.smithi144.stderr:1: [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] mon.noname-b 2024-06-04T16:13:24.478 INFO:tasks.workunit.client.0.smithi144.stderr:2: [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] mon.noname-c 2024-06-04T16:13:24.478 INFO:tasks.workunit.client.0.smithi144.stderr: 2024-06-04T16:13:24.478 INFO:tasks.workunit.client.0.smithi144.stderr: -217> 2024-06-04T16:13:24.101+0000 7f8175a13800 5 AuthRegistry(0x55b5cb7b7130) adding auth protocol: cephx 2024-06-04T16:13:24.478 INFO:tasks.workunit.client.0.smithi144.stderr: -216> 2024-06-04T16:13:24.101+0000 7f8175a13800 5 AuthRegistry(0x55b5cb7b7130) adding auth protocol: cephx 2024-06-04T16:13:24.478 INFO:tasks.workunit.client.0.smithi144.stderr: -215> 2024-06-04T16:13:24.101+0000 7f8175a13800 5 AuthRegistry(0x55b5cb7b7130) adding auth protocol: cephx 2024-06-04T16:13:24.478 INFO:tasks.workunit.client.0.smithi144.stderr: -214> 2024-06-04T16:13:24.101+0000 7f8175a13800 5 AuthRegistry(0x55b5cb7b7130) adding con mode: secure 2024-06-04T16:13:24.478 INFO:tasks.workunit.client.0.smithi144.stderr: -213> 2024-06-04T16:13:24.101+0000 7f8175a13800 5 AuthRegistry(0x55b5cb7b7130) adding con mode: crc 2024-06-04T16:13:24.478 INFO:tasks.workunit.client.0.smithi144.stderr: -212> 2024-06-04T16:13:24.101+0000 7f8175a13800 5 AuthRegistry(0x55b5cb7b7130) adding con mode: secure 2024-06-04T16:13:24.478 INFO:tasks.workunit.client.0.smithi144.stderr: -211> 2024-06-04T16:13:24.101+0000 7f8175a13800 5 AuthRegistry(0x55b5cb7b7130) adding con mode: crc 2024-06-04T16:13:24.478 INFO:tasks.workunit.client.0.smithi144.stderr: -210> 2024-06-04T16:13:24.101+0000 7f8175a13800 5 AuthRegistry(0x55b5cb7b7130) adding con mode: secure 2024-06-04T16:13:24.478 INFO:tasks.workunit.client.0.smithi144.stderr: -209> 2024-06-04T16:13:24.101+0000 7f8175a13800 5 AuthRegistry(0x55b5cb7b7130) adding con mode: crc 2024-06-04T16:13:24.479 INFO:tasks.workunit.client.0.smithi144.stderr: -208> 2024-06-04T16:13:24.101+0000 7f8175a13800 5 AuthRegistry(0x55b5cb7b7130) adding con mode: crc 2024-06-04T16:13:24.479 INFO:tasks.workunit.client.0.smithi144.stderr: -207> 2024-06-04T16:13:24.101+0000 7f8175a13800 5 AuthRegistry(0x55b5cb7b7130) adding con mode: secure 2024-06-04T16:13:24.479 INFO:tasks.workunit.client.0.smithi144.stderr: -206> 2024-06-04T16:13:24.101+0000 7f8175a13800 5 AuthRegistry(0x55b5cb7b7130) adding con mode: crc 2024-06-04T16:13:24.479 INFO:tasks.workunit.client.0.smithi144.stderr: -205> 2024-06-04T16:13:24.101+0000 7f8175a13800 5 AuthRegistry(0x55b5cb7b7130) adding con mode: secure 2024-06-04T16:13:24.479 INFO:tasks.workunit.client.0.smithi144.stderr: -204> 2024-06-04T16:13:24.101+0000 7f8175a13800 5 AuthRegistry(0x55b5cb7b7130) adding con mode: crc 2024-06-04T16:13:24.479 INFO:tasks.workunit.client.0.smithi144.stderr: -203> 2024-06-04T16:13:24.101+0000 7f8175a13800 5 AuthRegistry(0x55b5cb7b7130) adding con mode: secure 2024-06-04T16:13:24.479 INFO:tasks.workunit.client.0.smithi144.stderr: -202> 2024-06-04T16:13:24.101+0000 7f8175a13800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-06-04T16:13:24.479 INFO:tasks.workunit.client.0.smithi144.stderr: -201> 2024-06-04T16:13:24.101+0000 7f8175a13800 1 librados: starting msgr at 2024-06-04T16:13:24.479 INFO:tasks.workunit.client.0.smithi144.stderr: -200> 2024-06-04T16:13:24.101+0000 7f8175a13800 1 librados: starting objecter 2024-06-04T16:13:24.479 INFO:tasks.workunit.client.0.smithi144.stderr: -199> 2024-06-04T16:13:24.101+0000 7f8175a13800 5 asok(0x55b5cb4f7c60) register_command objecter_requests cmddesc objecter_requests hook 0x55b5cb7e6290 EEXIST 2024-06-04T16:13:24.479 INFO:tasks.workunit.client.0.smithi144.stderr: -198> 2024-06-04T16:13:24.101+0000 7f8175a13800 1 librados: setting wanted keys 2024-06-04T16:13:24.479 INFO:tasks.workunit.client.0.smithi144.stderr: -197> 2024-06-04T16:13:24.101+0000 7f8175a13800 1 librados: calling monclient init 2024-06-04T16:13:24.479 INFO:tasks.workunit.client.0.smithi144.stderr: -196> 2024-06-04T16:13:24.101+0000 7f8175a13800 10 monclient: init 2024-06-04T16:13:24.479 INFO:tasks.workunit.client.0.smithi144.stderr: -195> 2024-06-04T16:13:24.101+0000 7f8175a13800 5 AuthRegistry(0x55b5cb7b6320) adding auth protocol: cephx 2024-06-04T16:13:24.480 INFO:tasks.workunit.client.0.smithi144.stderr: -194> 2024-06-04T16:13:24.101+0000 7f8175a13800 5 AuthRegistry(0x55b5cb7b6320) adding auth protocol: cephx 2024-06-04T16:13:24.480 INFO:tasks.workunit.client.0.smithi144.stderr: -193> 2024-06-04T16:13:24.101+0000 7f8175a13800 5 AuthRegistry(0x55b5cb7b6320) adding auth protocol: cephx 2024-06-04T16:13:24.480 INFO:tasks.workunit.client.0.smithi144.stderr: -192> 2024-06-04T16:13:24.101+0000 7f8175a13800 5 AuthRegistry(0x55b5cb7b6320) adding con mode: secure 2024-06-04T16:13:24.480 INFO:tasks.workunit.client.0.smithi144.stderr: -191> 2024-06-04T16:13:24.101+0000 7f8175a13800 5 AuthRegistry(0x55b5cb7b6320) adding con mode: crc 2024-06-04T16:13:24.480 INFO:tasks.workunit.client.0.smithi144.stderr: -190> 2024-06-04T16:13:24.101+0000 7f8175a13800 5 AuthRegistry(0x55b5cb7b6320) adding con mode: secure 2024-06-04T16:13:24.480 INFO:tasks.workunit.client.0.smithi144.stderr: -189> 2024-06-04T16:13:24.101+0000 7f8175a13800 5 AuthRegistry(0x55b5cb7b6320) adding con mode: crc 2024-06-04T16:13:24.480 INFO:tasks.workunit.client.0.smithi144.stderr: -188> 2024-06-04T16:13:24.101+0000 7f8175a13800 5 AuthRegistry(0x55b5cb7b6320) adding con mode: secure 2024-06-04T16:13:24.480 INFO:tasks.workunit.client.0.smithi144.stderr: -187> 2024-06-04T16:13:24.101+0000 7f8175a13800 5 AuthRegistry(0x55b5cb7b6320) adding con mode: crc 2024-06-04T16:13:24.480 INFO:tasks.workunit.client.0.smithi144.stderr: -186> 2024-06-04T16:13:24.101+0000 7f8175a13800 5 AuthRegistry(0x55b5cb7b6320) adding con mode: crc 2024-06-04T16:13:24.480 INFO:tasks.workunit.client.0.smithi144.stderr: -185> 2024-06-04T16:13:24.101+0000 7f8175a13800 5 AuthRegistry(0x55b5cb7b6320) adding con mode: secure 2024-06-04T16:13:24.480 INFO:tasks.workunit.client.0.smithi144.stderr: -184> 2024-06-04T16:13:24.101+0000 7f8175a13800 5 AuthRegistry(0x55b5cb7b6320) adding con mode: crc 2024-06-04T16:13:24.480 INFO:tasks.workunit.client.0.smithi144.stderr: -183> 2024-06-04T16:13:24.101+0000 7f8175a13800 5 AuthRegistry(0x55b5cb7b6320) adding con mode: secure 2024-06-04T16:13:24.480 INFO:tasks.workunit.client.0.smithi144.stderr: -182> 2024-06-04T16:13:24.101+0000 7f8175a13800 5 AuthRegistry(0x55b5cb7b6320) adding con mode: crc 2024-06-04T16:13:24.480 INFO:tasks.workunit.client.0.smithi144.stderr: -181> 2024-06-04T16:13:24.101+0000 7f8175a13800 5 AuthRegistry(0x55b5cb7b6320) adding con mode: secure 2024-06-04T16:13:24.481 INFO:tasks.workunit.client.0.smithi144.stderr: -180> 2024-06-04T16:13:24.102+0000 7f8175a13800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-06-04T16:13:24.481 INFO:tasks.workunit.client.0.smithi144.stderr: -179> 2024-06-04T16:13:24.102+0000 7f8175a13800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-06-04T16:13:24.481 INFO:tasks.workunit.client.0.smithi144.stderr: -178> 2024-06-04T16:13:24.102+0000 7f8175a13800 5 asok(0x55b5cb4f7c60) register_command rotate-key cmddesc rotate-key hook 0x55b5cb7b6468 EEXIST 2024-06-04T16:13:24.481 INFO:tasks.workunit.client.0.smithi144.stderr: -177> 2024-06-04T16:13:24.102+0000 7f8175a13800 10 monclient: _reopen_session rank -1 2024-06-04T16:13:24.481 INFO:tasks.workunit.client.0.smithi144.stderr: -176> 2024-06-04T16:13:24.102+0000 7f8175a13800 10 monclient: _add_conns ranks=[1,0,2] 2024-06-04T16:13:24.481 INFO:tasks.workunit.client.0.smithi144.stderr: -175> 2024-06-04T16:13:24.102+0000 7f8175a13800 10 monclient(hunting): picked mon.noname-b con 0x55b5cb7bc7d0 addr [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] 2024-06-04T16:13:24.481 INFO:tasks.workunit.client.0.smithi144.stderr: -174> 2024-06-04T16:13:24.102+0000 7f8175a13800 10 monclient(hunting): picked mon.noname-a con 0x55b5cb7dcfd0 addr [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] 2024-06-04T16:13:24.481 INFO:tasks.workunit.client.0.smithi144.stderr: -173> 2024-06-04T16:13:24.102+0000 7f8175a13800 10 monclient(hunting): picked mon.noname-c con 0x55b5cb7e6f50 addr [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] 2024-06-04T16:13:24.481 INFO:tasks.workunit.client.0.smithi144.stderr: -172> 2024-06-04T16:13:24.102+0000 7f8175a13800 10 monclient(hunting): start opening mon connection 2024-06-04T16:13:24.481 INFO:tasks.workunit.client.0.smithi144.stderr: -171> 2024-06-04T16:13:24.102+0000 7f8175a13800 10 monclient(hunting): start opening mon connection 2024-06-04T16:13:24.481 INFO:tasks.workunit.client.0.smithi144.stderr: -170> 2024-06-04T16:13:24.102+0000 7f8175a13800 10 monclient(hunting): start opening mon connection 2024-06-04T16:13:24.481 INFO:tasks.workunit.client.0.smithi144.stderr: -169> 2024-06-04T16:13:24.102+0000 7f8175a13800 10 monclient(hunting): _renew_subs 2024-06-04T16:13:24.481 INFO:tasks.workunit.client.0.smithi144.stderr: -168> 2024-06-04T16:13:24.102+0000 7f8175a13800 10 monclient(hunting): authenticate will time out at 2041.918575s 2024-06-04T16:13:24.481 INFO:tasks.workunit.client.0.smithi144.stderr: -167> 2024-06-04T16:13:24.102+0000 7f8171064640 10 monclient(hunting): get_auth_request con 0x55b5cb7e6f50 auth_method 0 2024-06-04T16:13:24.481 INFO:tasks.workunit.client.0.smithi144.stderr: -166> 2024-06-04T16:13:24.102+0000 7f8171064640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-06-04T16:13:24.482 INFO:tasks.workunit.client.0.smithi144.stderr: -165> 2024-06-04T16:13:24.102+0000 7f8171064640 10 monclient(hunting): _init_auth method 2 2024-06-04T16:13:24.482 INFO:tasks.workunit.client.0.smithi144.stderr: -164> 2024-06-04T16:13:24.102+0000 7f8171064640 10 monclient(hunting): _init_auth creating new auth 2024-06-04T16:13:24.482 INFO:tasks.workunit.client.0.smithi144.stderr: -163> 2024-06-04T16:13:24.102+0000 7f8171865640 10 monclient(hunting): get_auth_request con 0x55b5cb7dcfd0 auth_method 0 2024-06-04T16:13:24.482 INFO:tasks.workunit.client.0.smithi144.stderr: -162> 2024-06-04T16:13:24.102+0000 7f8171865640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-06-04T16:13:24.482 INFO:tasks.workunit.client.0.smithi144.stderr: -161> 2024-06-04T16:13:24.102+0000 7f8171865640 10 monclient(hunting): _init_auth method 2 2024-06-04T16:13:24.482 INFO:tasks.workunit.client.0.smithi144.stderr: -160> 2024-06-04T16:13:24.102+0000 7f8171865640 10 monclient(hunting): _init_auth creating new auth 2024-06-04T16:13:24.482 INFO:tasks.workunit.client.0.smithi144.stderr: -159> 2024-06-04T16:13:24.102+0000 7f8171064640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-06-04T16:13:24.482 INFO:tasks.workunit.client.0.smithi144.stderr: -158> 2024-06-04T16:13:24.102+0000 7f8171064640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-06-04T16:13:24.482 INFO:tasks.workunit.client.0.smithi144.stderr: -157> 2024-06-04T16:13:24.102+0000 7f8171064640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-06-04T16:13:24.482 INFO:tasks.workunit.client.0.smithi144.stderr: -156> 2024-06-04T16:13:24.102+0000 7f8171865640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-06-04T16:13:24.482 INFO:tasks.workunit.client.0.smithi144.stderr: -155> 2024-06-04T16:13:24.102+0000 7f8171865640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-06-04T16:13:24.483 INFO:tasks.workunit.client.0.smithi144.stderr: -154> 2024-06-04T16:13:24.102+0000 7f8171865640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-06-04T16:13:24.483 INFO:tasks.workunit.client.0.smithi144.stderr: -153> 2024-06-04T16:13:24.102+0000 7f816bfff640 10 monclient(hunting): get_auth_request con 0x55b5cb7bc7d0 auth_method 0 2024-06-04T16:13:24.483 INFO:tasks.workunit.client.0.smithi144.stderr: -152> 2024-06-04T16:13:24.102+0000 7f816bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-06-04T16:13:24.483 INFO:tasks.workunit.client.0.smithi144.stderr: -151> 2024-06-04T16:13:24.102+0000 7f816bfff640 10 monclient(hunting): _init_auth method 2 2024-06-04T16:13:24.483 INFO:tasks.workunit.client.0.smithi144.stderr: -150> 2024-06-04T16:13:24.102+0000 7f816bfff640 10 monclient(hunting): _init_auth creating new auth 2024-06-04T16:13:24.483 INFO:tasks.workunit.client.0.smithi144.stderr: -149> 2024-06-04T16:13:24.102+0000 7f816bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-06-04T16:13:24.483 INFO:tasks.workunit.client.0.smithi144.stderr: -148> 2024-06-04T16:13:24.102+0000 7f816bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-06-04T16:13:24.483 INFO:tasks.workunit.client.0.smithi144.stderr: -147> 2024-06-04T16:13:24.102+0000 7f816bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-06-04T16:13:24.483 INFO:tasks.workunit.client.0.smithi144.stderr: -146> 2024-06-04T16:13:24.102+0000 7f8171064640 10 monclient(hunting): handle_auth_done global_id 6566 payload 824 2024-06-04T16:13:24.483 INFO:tasks.workunit.client.0.smithi144.stderr: -145> 2024-06-04T16:13:24.102+0000 7f8171064640 10 monclient: _finish_hunting 0 2024-06-04T16:13:24.483 INFO:tasks.workunit.client.0.smithi144.stderr: -144> 2024-06-04T16:13:24.102+0000 7f8171064640 1 monclient: found mon.noname-c 2024-06-04T16:13:24.483 INFO:tasks.workunit.client.0.smithi144.stderr: -143> 2024-06-04T16:13:24.102+0000 7f8171064640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.144:3301/0 2024-06-04T16:13:24.483 INFO:tasks.workunit.client.0.smithi144.stderr: -142> 2024-06-04T16:13:24.103+0000 7f8042ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-06-04T16:13:24.483 INFO:tasks.workunit.client.0.smithi144.stderr: -141> 2024-06-04T16:13:24.103+0000 7f8042ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-06-04T16:13:24.484 INFO:tasks.workunit.client.0.smithi144.stderr: -140> 2024-06-04T16:13:24.103+0000 7f8042ffd640 10 monclient: dump: 2024-06-04T16:13:24.484 INFO:tasks.workunit.client.0.smithi144.stderr:epoch 1 2024-06-04T16:13:24.484 INFO:tasks.workunit.client.0.smithi144.stderr:fsid 15e56bb1-4856-42f3-b6db-a2c8f23c5557 2024-06-04T16:13:24.484 INFO:tasks.workunit.client.0.smithi144.stderr:last_changed 2024-06-04T15:51:29.789359+0000 2024-06-04T16:13:24.484 INFO:tasks.workunit.client.0.smithi144.stderr:created 2024-06-04T15:51:29.789359+0000 2024-06-04T16:13:24.484 INFO:tasks.workunit.client.0.smithi144.stderr:min_mon_release 19 (squid) 2024-06-04T16:13:24.484 INFO:tasks.workunit.client.0.smithi144.stderr:election_strategy: 1 2024-06-04T16:13:24.484 INFO:tasks.workunit.client.0.smithi144.stderr:0: [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] mon.a 2024-06-04T16:13:24.484 INFO:tasks.workunit.client.0.smithi144.stderr:1: [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] mon.b 2024-06-04T16:13:24.484 INFO:tasks.workunit.client.0.smithi144.stderr:2: [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] mon.c 2024-06-04T16:13:24.484 INFO:tasks.workunit.client.0.smithi144.stderr: 2024-06-04T16:13:24.484 INFO:tasks.workunit.client.0.smithi144.stderr: -139> 2024-06-04T16:13:24.103+0000 7f8042ffd640 10 monclient: _finish_auth 0 2024-06-04T16:13:24.484 INFO:tasks.workunit.client.0.smithi144.stderr: -138> 2024-06-04T16:13:24.103+0000 7f8042ffd640 10 monclient: _check_auth_tickets 2024-06-04T16:13:24.484 INFO:tasks.workunit.client.0.smithi144.stderr: -137> 2024-06-04T16:13:24.103+0000 7f8042ffd640 10 monclient: handle_config config(0 keys) 2024-06-04T16:13:24.484 INFO:tasks.workunit.client.0.smithi144.stderr: -136> 2024-06-04T16:13:24.103+0000 7f8042ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-06-04T16:13:24.485 INFO:tasks.workunit.client.0.smithi144.stderr: -135> 2024-06-04T16:13:24.103+0000 7f8042ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-06-04T16:13:24.485 INFO:tasks.workunit.client.0.smithi144.stderr: -134> 2024-06-04T16:13:24.103+0000 7f8042ffd640 10 monclient: dump: 2024-06-04T16:13:24.485 INFO:tasks.workunit.client.0.smithi144.stderr:epoch 1 2024-06-04T16:13:24.485 INFO:tasks.workunit.client.0.smithi144.stderr:fsid 15e56bb1-4856-42f3-b6db-a2c8f23c5557 2024-06-04T16:13:24.485 INFO:tasks.workunit.client.0.smithi144.stderr:last_changed 2024-06-04T15:51:29.789359+0000 2024-06-04T16:13:24.485 INFO:tasks.workunit.client.0.smithi144.stderr:created 2024-06-04T15:51:29.789359+0000 2024-06-04T16:13:24.485 INFO:tasks.workunit.client.0.smithi144.stderr:min_mon_release 19 (squid) 2024-06-04T16:13:24.485 INFO:tasks.workunit.client.0.smithi144.stderr:election_strategy: 1 2024-06-04T16:13:24.485 INFO:tasks.workunit.client.0.smithi144.stderr:0: [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] mon.a 2024-06-04T16:13:24.485 INFO:tasks.workunit.client.0.smithi144.stderr:1: [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] mon.b 2024-06-04T16:13:24.485 INFO:tasks.workunit.client.0.smithi144.stderr:2: [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] mon.c 2024-06-04T16:13:24.485 INFO:tasks.workunit.client.0.smithi144.stderr: 2024-06-04T16:13:24.485 INFO:tasks.workunit.client.0.smithi144.stderr: -133> 2024-06-04T16:13:24.103+0000 7f8175a13800 5 monclient: authenticate success, global_id 6566 2024-06-04T16:13:24.485 INFO:tasks.workunit.client.0.smithi144.stderr: -132> 2024-06-04T16:13:24.103+0000 7f8175a13800 10 monclient: _renew_subs 2024-06-04T16:13:24.486 INFO:tasks.workunit.client.0.smithi144.stderr: -131> 2024-06-04T16:13:24.103+0000 7f8054ff9640 4 set_mon_vals no callback set 2024-06-04T16:13:24.486 INFO:tasks.workunit.client.0.smithi144.stderr: -130> 2024-06-04T16:13:24.103+0000 7f8175a13800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.144:3301/0 2024-06-04T16:13:24.486 INFO:tasks.workunit.client.0.smithi144.stderr: -129> 2024-06-04T16:13:24.103+0000 7f8175a13800 10 monclient: _renew_subs 2024-06-04T16:13:24.486 INFO:tasks.workunit.client.0.smithi144.stderr: -128> 2024-06-04T16:13:24.103+0000 7f8175a13800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.144:3301/0 2024-06-04T16:13:24.486 INFO:tasks.workunit.client.0.smithi144.stderr: -127> 2024-06-04T16:13:24.103+0000 7f8175a13800 1 librados: init done 2024-06-04T16:13:24.486 INFO:tasks.workunit.client.0.smithi144.stderr: -126> 2024-06-04T16:13:24.103+0000 7f8175a13800 5 asok(0x55b5cb4f7c60) register_command cr dump hook 0x55b5cb7f0ae8 2024-06-04T16:13:24.486 INFO:tasks.workunit.client.0.smithi144.stderr: -125> 2024-06-04T16:13:24.104+0000 7f8175a13800 20 rados->read ofs=0 len=0 2024-06-04T16:13:24.486 INFO:tasks.workunit.client.0.smithi144.stderr: -124> 2024-06-04T16:13:24.105+0000 7f8042ffd640 4 mgrc handle_mgr_map Got map version 5 2024-06-04T16:13:24.486 INFO:tasks.workunit.client.0.smithi144.stderr: -123> 2024-06-04T16:13:24.105+0000 7f8042ffd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.177:6832/2645786330,v1:172.21.15.177:6833/2645786330] 2024-06-04T16:13:24.486 INFO:tasks.workunit.client.0.smithi144.stderr: -122> 2024-06-04T16:13:24.105+0000 7f8042ffd640 4 mgrc reconnect Starting new session with [v2:172.21.15.177:6832/2645786330,v1:172.21.15.177:6833/2645786330] 2024-06-04T16:13:24.486 INFO:tasks.workunit.client.0.smithi144.stderr: -121> 2024-06-04T16:13:24.105+0000 7f816bfff640 10 monclient: get_auth_request con 0x7f803c074cb0 auth_method 0 2024-06-04T16:13:24.486 INFO:tasks.workunit.client.0.smithi144.stderr: -120> 2024-06-04T16:13:24.105+0000 7f8171865640 10 monclient: get_auth_request con 0x55b5cb805860 auth_method 0 2024-06-04T16:13:24.486 INFO:tasks.workunit.client.0.smithi144.stderr: -119> 2024-06-04T16:13:24.106+0000 7f8175a13800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:13:24.486 INFO:tasks.workunit.client.0.smithi144.stderr: -118> 2024-06-04T16:13:24.106+0000 7f8175a13800 20 realm 2024-06-04T16:13:24.487 INFO:tasks.workunit.client.0.smithi144.stderr: -117> 2024-06-04T16:13:24.106+0000 7f8175a13800 20 rados->read ofs=0 len=0 2024-06-04T16:13:24.487 INFO:tasks.workunit.client.0.smithi144.stderr: -116> 2024-06-04T16:13:24.106+0000 7f8175a13800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:13:24.487 INFO:tasks.workunit.client.0.smithi144.stderr: -115> 2024-06-04T16:13:24.106+0000 7f8175a13800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-06-04T16:13:24.487 INFO:tasks.workunit.client.0.smithi144.stderr: -114> 2024-06-04T16:13:24.106+0000 7f8175a13800 20 rados->read ofs=0 len=0 2024-06-04T16:13:24.487 INFO:tasks.workunit.client.0.smithi144.stderr: -113> 2024-06-04T16:13:24.106+0000 7f8175a13800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:13:24.487 INFO:tasks.workunit.client.0.smithi144.stderr: -112> 2024-06-04T16:13:24.106+0000 7f8175a13800 20 rados->read ofs=0 len=0 2024-06-04T16:13:24.487 INFO:tasks.workunit.client.0.smithi144.stderr: -111> 2024-06-04T16:13:24.106+0000 7f816bfff640 10 monclient: get_auth_request con 0x55b5cb809a80 auth_method 0 2024-06-04T16:13:24.487 INFO:tasks.workunit.client.0.smithi144.stderr: -110> 2024-06-04T16:13:24.107+0000 7f8175a13800 20 rados_obj.operate() r=0 bl.length=46 2024-06-04T16:13:24.487 INFO:tasks.workunit.client.0.smithi144.stderr: -109> 2024-06-04T16:13:24.107+0000 7f8175a13800 20 rados->read ofs=0 len=0 2024-06-04T16:13:24.487 INFO:tasks.workunit.client.0.smithi144.stderr: -108> 2024-06-04T16:13:24.107+0000 7f8171865640 10 monclient: get_auth_request con 0x55b5cb80d2e0 auth_method 0 2024-06-04T16:13:24.487 INFO:tasks.workunit.client.0.smithi144.stderr: -107> 2024-06-04T16:13:24.108+0000 7f8175a13800 20 rados_obj.operate() r=0 bl.length=1139 2024-06-04T16:13:24.487 INFO:tasks.workunit.client.0.smithi144.stderr: -106> 2024-06-04T16:13:24.108+0000 7f8175a13800 20 searching for the correct realm 2024-06-04T16:13:24.487 INFO:tasks.workunit.client.0.smithi144.stderr: -105> 2024-06-04T16:13:24.108+0000 7f8171064640 10 monclient: get_auth_request con 0x55b5cb811fe0 auth_method 0 2024-06-04T16:13:24.487 INFO:tasks.workunit.client.0.smithi144.stderr: -104> 2024-06-04T16:13:24.108+0000 7f816bfff640 10 monclient: get_auth_request con 0x7f8164057040 auth_method 0 2024-06-04T16:13:24.488 INFO:tasks.workunit.client.0.smithi144.stderr: -103> 2024-06-04T16:13:24.109+0000 7f816bfff640 0 -- 172.21.15.144:0/1507413648 >> [v2:172.21.15.144:6816/2358575268,v1:172.21.15.144:6817/2358575268] conn(0x55b5cb809a80 msgr2=0x55b5cb80beb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-06-04T16:13:24.488 INFO:tasks.workunit.client.0.smithi144.stderr: -102> 2024-06-04T16:13:24.109+0000 7f8042ffd640 1 client.6566.objecter ms_handle_reset 0x55b5cb809a80 session 0x55b5cb809400 osd.1 2024-06-04T16:13:24.488 INFO:tasks.workunit.client.0.smithi144.stderr: -101> 2024-06-04T16:13:24.109+0000 7f8042ffd640 10 monclient: _renew_subs 2024-06-04T16:13:24.488 INFO:tasks.workunit.client.0.smithi144.stderr: -100> 2024-06-04T16:13:24.109+0000 7f8042ffd640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.144:3301/0 2024-06-04T16:13:24.488 INFO:tasks.workunit.client.0.smithi144.stderr: -99> 2024-06-04T16:13:24.109+0000 7f8171865640 10 monclient: get_auth_request con 0x7f815c047040 auth_method 0 2024-06-04T16:13:24.488 INFO:tasks.workunit.client.0.smithi144.stderr: -98> 2024-06-04T16:13:24.110+0000 7f816bfff640 10 monclient: get_auth_request con 0x7f803c085060 auth_method 0 2024-06-04T16:13:24.488 INFO:tasks.workunit.client.0.smithi144.stderr: -97> 2024-06-04T16:13:24.110+0000 7f8171064640 10 monclient: get_auth_request con 0x7f81640aa3c0 auth_method 0 2024-06-04T16:13:24.488 INFO:tasks.workunit.client.0.smithi144.stderr: -96> 2024-06-04T16:13:24.112+0000 7f816bfff640 10 monclient: get_auth_request con 0x7f815c017030 auth_method 0 2024-06-04T16:13:24.488 INFO:tasks.workunit.client.0.smithi144.stderr: -95> 2024-06-04T16:13:24.112+0000 7f816bfff640 0 -- 172.21.15.144:0/1507413648 >> [v2:172.21.15.177:6808/2618477608,v1:172.21.15.177:6809/2618477608] conn(0x7f815c017030 msgr2=0x7f815c05f190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-06-04T16:13:24.488 INFO:tasks.workunit.client.0.smithi144.stderr: -94> 2024-06-04T16:13:24.313+0000 7f816bfff640 10 monclient: get_auth_request con 0x7f815c017030 auth_method 0 2024-06-04T16:13:24.488 INFO:tasks.workunit.client.0.smithi144.stderr: -93> 2024-06-04T16:13:24.318+0000 7f8175a13800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-06-04T16:13:24.488 INFO:tasks.workunit.client.0.smithi144.stderr: -92> 2024-06-04T16:13:24.318+0000 7f8175a13800 20 RGWRados::pool_iterate: got zone_info.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767 2024-06-04T16:13:24.488 INFO:tasks.workunit.client.0.smithi144.stderr: -91> 2024-06-04T16:13:24.318+0000 7f8175a13800 20 RGWRados::pool_iterate: got default.zone. 2024-06-04T16:13:24.488 INFO:tasks.workunit.client.0.smithi144.stderr: -90> 2024-06-04T16:13:24.318+0000 7f8175a13800 20 RGWRados::pool_iterate: got zonegroup_info.abb22408-c332-4e28-8f7a-ff254ea2fed2 2024-06-04T16:13:24.489 INFO:tasks.workunit.client.0.smithi144.stderr: -89> 2024-06-04T16:13:24.318+0000 7f8175a13800 20 RGWRados::pool_iterate: got zone_names.default 2024-06-04T16:13:24.489 INFO:tasks.workunit.client.0.smithi144.stderr: -88> 2024-06-04T16:13:24.318+0000 7f8175a13800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-06-04T16:13:24.489 INFO:tasks.workunit.client.0.smithi144.stderr: -87> 2024-06-04T16:13:24.318+0000 7f8175a13800 20 rados->read ofs=0 len=0 2024-06-04T16:13:24.489 INFO:tasks.workunit.client.0.smithi144.stderr: -86> 2024-06-04T16:13:24.318+0000 7f8175a13800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:13:24.489 INFO:tasks.workunit.client.0.smithi144.stderr: -85> 2024-06-04T16:13:24.318+0000 7f8175a13800 20 rados->read ofs=0 len=0 2024-06-04T16:13:24.489 INFO:tasks.workunit.client.0.smithi144.stderr: -84> 2024-06-04T16:13:24.319+0000 7f8175a13800 20 rados_obj.operate() r=0 bl.length=46 2024-06-04T16:13:24.489 INFO:tasks.workunit.client.0.smithi144.stderr: -83> 2024-06-04T16:13:24.319+0000 7f8175a13800 20 rados->read ofs=0 len=0 2024-06-04T16:13:24.489 INFO:tasks.workunit.client.0.smithi144.stderr: -82> 2024-06-04T16:13:24.319+0000 7f8175a13800 20 rados_obj.operate() r=0 bl.length=470 2024-06-04T16:13:24.489 INFO:tasks.workunit.client.0.smithi144.stderr: -81> 2024-06-04T16:13:24.319+0000 7f8175a13800 20 zone default found 2024-06-04T16:13:24.489 INFO:tasks.workunit.client.0.smithi144.stderr: -80> 2024-06-04T16:13:24.319+0000 7f8175a13800 4 Realm: () 2024-06-04T16:13:24.489 INFO:tasks.workunit.client.0.smithi144.stderr: -79> 2024-06-04T16:13:24.319+0000 7f8175a13800 4 ZoneGroup: default (abb22408-c332-4e28-8f7a-ff254ea2fed2) 2024-06-04T16:13:24.489 INFO:tasks.workunit.client.0.smithi144.stderr: -78> 2024-06-04T16:13:24.319+0000 7f8175a13800 4 Zone: default (be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767) 2024-06-04T16:13:24.489 INFO:tasks.workunit.client.0.smithi144.stderr: -77> 2024-06-04T16:13:24.319+0000 7f8175a13800 10 cannot find current period zonegroup using local zonegroup configuration 2024-06-04T16:13:24.489 INFO:tasks.workunit.client.0.smithi144.stderr: -76> 2024-06-04T16:13:24.319+0000 7f8175a13800 20 zonegroup default 2024-06-04T16:13:24.489 INFO:tasks.workunit.client.0.smithi144.stderr: -75> 2024-06-04T16:13:24.319+0000 7f8175a13800 20 rados->read ofs=0 len=0 2024-06-04T16:13:24.490 INFO:tasks.workunit.client.0.smithi144.stderr: -74> 2024-06-04T16:13:24.319+0000 7f8175a13800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:13:24.490 INFO:tasks.workunit.client.0.smithi144.stderr: -73> 2024-06-04T16:13:24.319+0000 7f8175a13800 20 rados->read ofs=0 len=0 2024-06-04T16:13:24.490 INFO:tasks.workunit.client.0.smithi144.stderr: -72> 2024-06-04T16:13:24.320+0000 7f8175a13800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:13:24.490 INFO:tasks.workunit.client.0.smithi144.stderr: -71> 2024-06-04T16:13:24.320+0000 7f8175a13800 20 rados->read ofs=0 len=0 2024-06-04T16:13:24.490 INFO:tasks.workunit.client.0.smithi144.stderr: -70> 2024-06-04T16:13:24.320+0000 7f8175a13800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:13:24.490 INFO:tasks.workunit.client.0.smithi144.stderr: -69> 2024-06-04T16:13:24.320+0000 7f8175a13800 20 started sync module instance, tier type = 2024-06-04T16:13:24.490 INFO:tasks.workunit.client.0.smithi144.stderr: -68> 2024-06-04T16:13:24.320+0000 7f8175a13800 20 started zone id=be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767 (name=default) with tier type = 2024-06-04T16:13:24.490 INFO:tasks.workunit.client.0.smithi144.stderr: -67> 2024-06-04T16:13:24.328+0000 7f8175a13800 20 add_watcher() i=0 2024-06-04T16:13:24.490 INFO:tasks.workunit.client.0.smithi144.stderr: -66> 2024-06-04T16:13:24.328+0000 7f8175a13800 20 add_watcher() i=1 2024-06-04T16:13:24.490 INFO:tasks.workunit.client.0.smithi144.stderr: -65> 2024-06-04T16:13:24.328+0000 7f8175a13800 20 add_watcher() i=2 2024-06-04T16:13:24.490 INFO:tasks.workunit.client.0.smithi144.stderr: -64> 2024-06-04T16:13:24.328+0000 7f8175a13800 20 add_watcher() i=3 2024-06-04T16:13:24.490 INFO:tasks.workunit.client.0.smithi144.stderr: -63> 2024-06-04T16:13:24.328+0000 7f8175a13800 20 add_watcher() i=4 2024-06-04T16:13:24.490 INFO:tasks.workunit.client.0.smithi144.stderr: -62> 2024-06-04T16:13:24.328+0000 7f8175a13800 20 add_watcher() i=5 2024-06-04T16:13:24.490 INFO:tasks.workunit.client.0.smithi144.stderr: -61> 2024-06-04T16:13:24.328+0000 7f8175a13800 20 add_watcher() i=6 2024-06-04T16:13:24.491 INFO:tasks.workunit.client.0.smithi144.stderr: -60> 2024-06-04T16:13:24.329+0000 7f8175a13800 20 add_watcher() i=7 2024-06-04T16:13:24.491 INFO:tasks.workunit.client.0.smithi144.stderr: -59> 2024-06-04T16:13:24.329+0000 7f8175a13800 2 all 8 watchers are set, enabling cache 2024-06-04T16:13:24.491 INFO:tasks.workunit.client.0.smithi144.stderr: -58> 2024-06-04T16:13:24.331+0000 7f8175a13800 5 AuthRegistry(0x7fff6a9d0a50) adding auth protocol: cephx 2024-06-04T16:13:24.491 INFO:tasks.workunit.client.0.smithi144.stderr: -57> 2024-06-04T16:13:24.331+0000 7f8175a13800 5 AuthRegistry(0x7fff6a9d0a50) adding auth protocol: cephx 2024-06-04T16:13:24.491 INFO:tasks.workunit.client.0.smithi144.stderr: -56> 2024-06-04T16:13:24.331+0000 7f8175a13800 5 AuthRegistry(0x7fff6a9d0a50) adding auth protocol: cephx 2024-06-04T16:13:24.491 INFO:tasks.workunit.client.0.smithi144.stderr: -55> 2024-06-04T16:13:24.331+0000 7f8175a13800 5 AuthRegistry(0x7fff6a9d0a50) adding con mode: secure 2024-06-04T16:13:24.491 INFO:tasks.workunit.client.0.smithi144.stderr: -54> 2024-06-04T16:13:24.331+0000 7f8175a13800 5 AuthRegistry(0x7fff6a9d0a50) adding con mode: crc 2024-06-04T16:13:24.491 INFO:tasks.workunit.client.0.smithi144.stderr: -53> 2024-06-04T16:13:24.331+0000 7f8175a13800 5 AuthRegistry(0x7fff6a9d0a50) adding con mode: secure 2024-06-04T16:13:24.491 INFO:tasks.workunit.client.0.smithi144.stderr: -52> 2024-06-04T16:13:24.331+0000 7f8175a13800 5 AuthRegistry(0x7fff6a9d0a50) adding con mode: crc 2024-06-04T16:13:24.491 INFO:tasks.workunit.client.0.smithi144.stderr: -51> 2024-06-04T16:13:24.331+0000 7f8175a13800 5 AuthRegistry(0x7fff6a9d0a50) adding con mode: secure 2024-06-04T16:13:24.491 INFO:tasks.workunit.client.0.smithi144.stderr: -50> 2024-06-04T16:13:24.331+0000 7f8175a13800 5 AuthRegistry(0x7fff6a9d0a50) adding con mode: crc 2024-06-04T16:13:24.491 INFO:tasks.workunit.client.0.smithi144.stderr: -49> 2024-06-04T16:13:24.331+0000 7f8175a13800 5 AuthRegistry(0x7fff6a9d0a50) adding con mode: crc 2024-06-04T16:13:24.491 INFO:tasks.workunit.client.0.smithi144.stderr: -48> 2024-06-04T16:13:24.331+0000 7f8175a13800 5 AuthRegistry(0x7fff6a9d0a50) adding con mode: secure 2024-06-04T16:13:24.491 INFO:tasks.workunit.client.0.smithi144.stderr: -47> 2024-06-04T16:13:24.331+0000 7f8175a13800 5 AuthRegistry(0x7fff6a9d0a50) adding con mode: crc 2024-06-04T16:13:24.492 INFO:tasks.workunit.client.0.smithi144.stderr: -46> 2024-06-04T16:13:24.331+0000 7f8175a13800 5 AuthRegistry(0x7fff6a9d0a50) adding con mode: secure 2024-06-04T16:13:24.492 INFO:tasks.workunit.client.0.smithi144.stderr: -45> 2024-06-04T16:13:24.331+0000 7f8175a13800 5 AuthRegistry(0x7fff6a9d0a50) adding con mode: crc 2024-06-04T16:13:24.492 INFO:tasks.workunit.client.0.smithi144.stderr: -44> 2024-06-04T16:13:24.331+0000 7f8175a13800 5 AuthRegistry(0x7fff6a9d0a50) adding con mode: secure 2024-06-04T16:13:24.492 INFO:tasks.workunit.client.0.smithi144.stderr: -43> 2024-06-04T16:13:24.331+0000 7f80277e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-06-04T16:13:24.492 INFO:tasks.workunit.client.0.smithi144.stderr: -42> 2024-06-04T16:13:24.332+0000 7f8175a13800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-06-04T16:13:24.492 INFO:tasks.workunit.client.0.smithi144.stderr: -41> 2024-06-04T16:13:24.332+0000 7f8175a13800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-06-04T16:13:24.492 INFO:tasks.workunit.client.0.smithi144.stderr: -40> 2024-06-04T16:13:24.332+0000 7f8175a13800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-06-04T16:13:24.492 INFO:tasks.workunit.client.0.smithi144.stderr: -39> 2024-06-04T16:13:24.332+0000 7f8175a13800 5 asok(0x55b5cb4f7c60) register_command cache list hook 0x55b5cb7ddf30 2024-06-04T16:13:24.492 INFO:tasks.workunit.client.0.smithi144.stderr: -38> 2024-06-04T16:13:24.332+0000 7f8175a13800 5 asok(0x55b5cb4f7c60) register_command cache inspect hook 0x55b5cb7ddf30 2024-06-04T16:13:24.492 INFO:tasks.workunit.client.0.smithi144.stderr: -37> 2024-06-04T16:13:24.332+0000 7f8175a13800 5 asok(0x55b5cb4f7c60) register_command cache erase hook 0x55b5cb7ddf30 2024-06-04T16:13:24.492 INFO:tasks.workunit.client.0.smithi144.stderr: -36> 2024-06-04T16:13:24.332+0000 7f8175a13800 5 asok(0x55b5cb4f7c60) register_command cache zap hook 0x55b5cb7ddf30 2024-06-04T16:13:24.492 INFO:tasks.workunit.client.0.smithi144.stderr: -35> 2024-06-04T16:13:24.332+0000 7f8175a13800 5 note: GC not initialized 2024-06-04T16:13:24.492 INFO:tasks.workunit.client.0.smithi144.stderr: -34> 2024-06-04T16:13:24.332+0000 7f80267e4640 20 reqs_thread_entry: start 2024-06-04T16:13:24.493 INFO:tasks.workunit.client.0.smithi144.stderr: -33> 2024-06-04T16:13:24.332+0000 7f8175a13800 5 asok(0x55b5cb4f7c60) register_command sync trace show hook 0x7f816c015660 2024-06-04T16:13:24.493 INFO:tasks.workunit.client.0.smithi144.stderr: -32> 2024-06-04T16:13:24.332+0000 7f8175a13800 5 asok(0x55b5cb4f7c60) register_command sync trace history hook 0x7f816c015660 2024-06-04T16:13:24.493 INFO:tasks.workunit.client.0.smithi144.stderr: -31> 2024-06-04T16:13:24.332+0000 7f8175a13800 5 asok(0x55b5cb4f7c60) register_command sync trace active hook 0x7f816c015660 2024-06-04T16:13:24.493 INFO:tasks.workunit.client.0.smithi144.stderr: -30> 2024-06-04T16:13:24.332+0000 7f8175a13800 5 asok(0x55b5cb4f7c60) register_command sync trace active_short hook 0x7f816c015660 2024-06-04T16:13:24.493 INFO:tasks.workunit.client.0.smithi144.stderr: -29> 2024-06-04T16:13:24.332+0000 7f8175a13800 20 init_complete bucket index max shards: 11 2024-06-04T16:13:24.493 INFO:tasks.workunit.client.0.smithi144.stderr: -28> 2024-06-04T16:13:24.332+0000 7f8175a13800 20 Filter name: none 2024-06-04T16:13:24.493 INFO:tasks.workunit.client.0.smithi144.stderr: -27> 2024-06-04T16:13:24.332+0000 7f7f97fff640 20 reqs_thread_entry: start 2024-06-04T16:13:24.493 INFO:tasks.workunit.client.0.smithi144.stderr: -26> 2024-06-04T16:13:24.332+0000 7f8175a13800 10 cache get: name=default.rgw.meta+root+abort-at-do-reshard : miss 2024-06-04T16:13:24.493 INFO:tasks.workunit.client.0.smithi144.stderr: -25> 2024-06-04T16:13:24.332+0000 7f8175a13800 20 rados->read ofs=0 len=0 2024-06-04T16:13:24.493 INFO:tasks.workunit.client.0.smithi144.stderr: -24> 2024-06-04T16:13:24.333+0000 7f8175a13800 20 rados_obj.operate() r=0 bl.length=187 2024-06-04T16:13:24.493 INFO:tasks.workunit.client.0.smithi144.stderr: -23> 2024-06-04T16:13:24.333+0000 7f8175a13800 10 cache put: name=default.rgw.meta+root+abort-at-do-reshard info.flags=0x11 2024-06-04T16:13:24.493 INFO:tasks.workunit.client.0.smithi144.stderr: -22> 2024-06-04T16:13:24.333+0000 7f8175a13800 10 adding default.rgw.meta+root+abort-at-do-reshard to cache LRU end 2024-06-04T16:13:24.493 INFO:tasks.workunit.client.0.smithi144.stderr: -21> 2024-06-04T16:13:24.333+0000 7f8175a13800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.28 : miss 2024-06-04T16:13:24.493 INFO:tasks.workunit.client.0.smithi144.stderr: -20> 2024-06-04T16:13:24.333+0000 7f8175a13800 20 rados->read ofs=0 len=0 2024-06-04T16:13:24.493 INFO:tasks.workunit.client.0.smithi144.stderr: -19> 2024-06-04T16:13:24.333+0000 7f8175a13800 20 rados_obj.operate() r=0 bl.length=401 2024-06-04T16:13:24.494 INFO:tasks.workunit.client.0.smithi144.stderr: -18> 2024-06-04T16:13:24.333+0000 7f8175a13800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.28 info.flags=0x17 2024-06-04T16:13:24.494 INFO:tasks.workunit.client.0.smithi144.stderr: -17> 2024-06-04T16:13:24.333+0000 7f8175a13800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.28 to cache LRU end 2024-06-04T16:13:24.494 INFO:tasks.workunit.client.0.smithi144.stderr: -16> 2024-06-04T16:13:24.333+0000 7f8175a13800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-06-04T16:13:24.494 INFO:tasks.workunit.client.0.smithi144.stderr: -15> 2024-06-04T16:13:24.333+0000 7f8175a13800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-06-04T16:13:24.494 INFO:tasks.workunit.client.0.smithi144.stderr: -14> 2024-06-04T16:13:24.333+0000 7f8175a13800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.28 2024-06-04T16:13:24.494 INFO:tasks.workunit.client.0.smithi144.stderr: -13> 2024-06-04T16:13:24.338+0000 7f8175a13800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.28 info.flags=0x17 2024-06-04T16:13:24.494 INFO:tasks.workunit.client.0.smithi144.stderr: -12> 2024-06-04T16:13:24.338+0000 7f8175a13800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.28 to cache LRU end 2024-06-04T16:13:24.494 INFO:tasks.workunit.client.0.smithi144.stderr: -11> 2024-06-04T16:13:24.338+0000 7f8175a13800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-06-04T16:13:24.494 INFO:tasks.workunit.client.0.smithi144.stderr: -10> 2024-06-04T16:13:24.338+0000 7f8175a13800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.28, ofs0, ns] 2024-06-04T16:13:24.494 INFO:tasks.workunit.client.0.smithi144.stderr: -9> 2024-06-04T16:13:24.339+0000 7f8054ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1078036791319 cookie 94239291652816 notifier 6566 bl.length()=903 2024-06-04T16:13:24.494 INFO:tasks.workunit.client.0.smithi144.stderr: -8> 2024-06-04T16:13:24.339+0000 7f8054ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.28 info.flags=0x17 2024-06-04T16:13:24.494 INFO:tasks.workunit.client.0.smithi144.stderr: -7> 2024-06-04T16:13:24.339+0000 7f8054ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.28 to cache LRU end 2024-06-04T16:13:24.495 INFO:tasks.workunit.client.0.smithi144.stderr: -6> 2024-06-04T16:13:24.339+0000 7f8054ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-06-04T16:13:24.495 INFO:tasks.workunit.client.0.smithi144.stderr: -5> 2024-06-04T16:13:24.339+0000 7f8175a13800 20 handle_bi_update(): bucket=:abort-at-do-reshard[be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.28]): orig_sources= new_sources= 2024-06-04T16:13:24.495 INFO:tasks.workunit.client.0.smithi144.stderr: -4> 2024-06-04T16:13:24.339+0000 7f8175a13800 20 handle_bi_update(): bucket=:abort-at-do-reshard[be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.28]): potential sources added=[] removed=[] 2024-06-04T16:13:24.495 INFO:tasks.workunit.client.0.smithi144.stderr: -3> 2024-06-04T16:13:24.339+0000 7f8175a13800 20 handle_bi_update(): bucket=:abort-at-do-reshard[be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.28]): orig_dests= new_dests= 2024-06-04T16:13:24.495 INFO:tasks.workunit.client.0.smithi144.stderr: -2> 2024-06-04T16:13:24.339+0000 7f8175a13800 20 handle_bi_update(): bucket=:abort-at-do-reshard[be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.28]): potential dests added=[] removed=[] 2024-06-04T16:13:24.495 INFO:tasks.workunit.client.0.smithi144.stderr: -1> 2024-06-04T16:13:24.342+0000 7f8175a13800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-4027-g65533a90/rpm/el9/BUILD/ceph-19.0.0-4027-g65533a90/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f8175a13800 time 2024-06-04T16:13:24.342962+0000 2024-06-04T16:13:24.495 INFO:tasks.workunit.client.0.smithi144.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-4027-g65533a90/rpm/el9/BUILD/ceph-19.0.0-4027-g65533a90/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-06-04T16:13:24.495 INFO:tasks.workunit.client.0.smithi144.stderr: 2024-06-04T16:13:24.495 INFO:tasks.workunit.client.0.smithi144.stderr: ceph version 19.0.0-4027-g65533a90 (65533a907fc9add1863609703fdbbea67993c8ef) squid (dev) 2024-06-04T16:13:24.495 INFO:tasks.workunit.client.0.smithi144.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f8176981dce] 2024-06-04T16:13:24.495 INFO:tasks.workunit.client.0.smithi144.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x181f8c) [0x7f8176981f8c] 2024-06-04T16:13:24.495 INFO:tasks.workunit.client.0.smithi144.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55b5ca966fb1] 2024-06-04T16:13:24.495 INFO:tasks.workunit.client.0.smithi144.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x32f) [0x55b5ca97239f] 2024-06-04T16:13:24.496 INFO:tasks.workunit.client.0.smithi144.stderr: 5: main() 2024-06-04T16:13:24.496 INFO:tasks.workunit.client.0.smithi144.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7f8175829590] 2024-06-04T16:13:24.496 INFO:tasks.workunit.client.0.smithi144.stderr: 7: __libc_start_main() 2024-06-04T16:13:24.496 INFO:tasks.workunit.client.0.smithi144.stderr: 8: _start() 2024-06-04T16:13:24.496 INFO:tasks.workunit.client.0.smithi144.stderr: 2024-06-04T16:13:24.496 INFO:tasks.workunit.client.0.smithi144.stderr: 0> 2024-06-04T16:13:24.343+0000 7f8175a13800 -1 *** Caught signal (Aborted) ** 2024-06-04T16:13:24.496 INFO:tasks.workunit.client.0.smithi144.stderr: in thread 7f8175a13800 thread_name:radosgw-admin 2024-06-04T16:13:24.496 INFO:tasks.workunit.client.0.smithi144.stderr: 2024-06-04T16:13:24.496 INFO:tasks.workunit.client.0.smithi144.stderr: ceph version 19.0.0-4027-g65533a90 (65533a907fc9add1863609703fdbbea67993c8ef) squid (dev) 2024-06-04T16:13:24.496 INFO:tasks.workunit.client.0.smithi144.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f817583e6f0] 2024-06-04T16:13:24.496 INFO:tasks.workunit.client.0.smithi144.stderr: 2: /lib64/libc.so.6(+0x8b94c) [0x7f817588b94c] 2024-06-04T16:13:24.496 INFO:tasks.workunit.client.0.smithi144.stderr: 3: raise() 2024-06-04T16:13:24.496 INFO:tasks.workunit.client.0.smithi144.stderr: 4: abort() 2024-06-04T16:13:24.497 INFO:tasks.workunit.client.0.smithi144.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f8176981e28] 2024-06-04T16:13:24.497 INFO:tasks.workunit.client.0.smithi144.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x181f8c) [0x7f8176981f8c] 2024-06-04T16:13:24.497 INFO:tasks.workunit.client.0.smithi144.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55b5ca966fb1] 2024-06-04T16:13:24.497 INFO:tasks.workunit.client.0.smithi144.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x32f) [0x55b5ca97239f] 2024-06-04T16:13:24.497 INFO:tasks.workunit.client.0.smithi144.stderr: 9: main() 2024-06-04T16:13:24.497 INFO:tasks.workunit.client.0.smithi144.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7f8175829590] 2024-06-04T16:13:24.497 INFO:tasks.workunit.client.0.smithi144.stderr: 11: __libc_start_main() 2024-06-04T16:13:24.497 INFO:tasks.workunit.client.0.smithi144.stderr: 12: _start() 2024-06-04T16:13:24.497 INFO:tasks.workunit.client.0.smithi144.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-06-04T16:13:24.497 INFO:tasks.workunit.client.0.smithi144.stderr: 2024-06-04T16:13:24.497 INFO:tasks.workunit.client.0.smithi144.stderr:--- logging levels --- 2024-06-04T16:13:24.497 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 5 none 2024-06-04T16:13:24.497 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 1 lockdep 2024-06-04T16:13:24.497 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 1 context 2024-06-04T16:13:24.498 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 1 crush 2024-06-04T16:13:24.498 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 5 mds 2024-06-04T16:13:24.498 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 5 mds_balancer 2024-06-04T16:13:24.498 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 5 mds_locker 2024-06-04T16:13:24.498 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 5 mds_log 2024-06-04T16:13:24.498 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 5 mds_log_expire 2024-06-04T16:13:24.498 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 5 mds_migrator 2024-06-04T16:13:24.498 INFO:tasks.workunit.client.0.smithi144.stderr: 3/ 5 mds_quiesce 2024-06-04T16:13:24.498 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 1 buffer 2024-06-04T16:13:24.498 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 1 timer 2024-06-04T16:13:24.498 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 1 filer 2024-06-04T16:13:24.498 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 1 striper 2024-06-04T16:13:24.498 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 1 objecter 2024-06-04T16:13:24.499 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 5 rados 2024-06-04T16:13:24.499 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 5 rbd 2024-06-04T16:13:24.499 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 5 rbd_mirror 2024-06-04T16:13:24.499 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 5 rbd_replay 2024-06-04T16:13:24.499 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 5 rbd_pwl 2024-06-04T16:13:24.499 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 5 journaler 2024-06-04T16:13:24.499 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 5 objectcacher 2024-06-04T16:13:24.499 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 5 immutable_obj_cache 2024-06-04T16:13:24.499 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 5 client 2024-06-04T16:13:24.499 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 5 osd 2024-06-04T16:13:24.499 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 5 optracker 2024-06-04T16:13:24.499 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 5 objclass 2024-06-04T16:13:24.499 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 3 filestore 2024-06-04T16:13:24.499 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 3 journal 2024-06-04T16:13:24.499 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 0 ms 2024-06-04T16:13:24.500 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 5 mon 2024-06-04T16:13:24.500 INFO:tasks.workunit.client.0.smithi144.stderr: 0/10 monc 2024-06-04T16:13:24.500 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 5 paxos 2024-06-04T16:13:24.500 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 5 tp 2024-06-04T16:13:24.500 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 5 auth 2024-06-04T16:13:24.500 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 5 crypto 2024-06-04T16:13:24.500 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 1 finisher 2024-06-04T16:13:24.500 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 1 reserver 2024-06-04T16:13:24.500 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 5 heartbeatmap 2024-06-04T16:13:24.500 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 5 perfcounter 2024-06-04T16:13:24.500 INFO:tasks.workunit.client.0.smithi144.stderr: 20/20 rgw 2024-06-04T16:13:24.500 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 5 rgw_sync 2024-06-04T16:13:24.500 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 5 rgw_datacache 2024-06-04T16:13:24.500 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 5 rgw_access 2024-06-04T16:13:24.500 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 5 rgw_dbstore 2024-06-04T16:13:24.501 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 5 rgw_flight 2024-06-04T16:13:24.501 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 5 rgw_lifecycle 2024-06-04T16:13:24.501 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 5 rgw_notification 2024-06-04T16:13:24.501 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 5 javaclient 2024-06-04T16:13:24.501 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 5 asok 2024-06-04T16:13:24.501 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 1 throttle 2024-06-04T16:13:24.501 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 0 refs 2024-06-04T16:13:24.501 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 5 compressor 2024-06-04T16:13:24.501 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 5 bluestore 2024-06-04T16:13:24.501 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 5 bluefs 2024-06-04T16:13:24.501 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 3 bdev 2024-06-04T16:13:24.501 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 5 kstore 2024-06-04T16:13:24.501 INFO:tasks.workunit.client.0.smithi144.stderr: 4/ 5 rocksdb 2024-06-04T16:13:24.501 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 5 fuse 2024-06-04T16:13:24.502 INFO:tasks.workunit.client.0.smithi144.stderr: 2/ 5 mgr 2024-06-04T16:13:24.502 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 5 mgrc 2024-06-04T16:13:24.502 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 5 dpdk 2024-06-04T16:13:24.502 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 5 eventtrace 2024-06-04T16:13:24.502 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 5 prioritycache 2024-06-04T16:13:24.502 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 5 test 2024-06-04T16:13:24.502 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 5 cephfs_mirror 2024-06-04T16:13:24.502 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 5 cephsqlite 2024-06-04T16:13:24.502 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 5 crimson_interrupt 2024-06-04T16:13:24.502 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 5 seastore 2024-06-04T16:13:24.502 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 5 seastore_onode 2024-06-04T16:13:24.502 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 5 seastore_odata 2024-06-04T16:13:24.502 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 5 seastore_omap 2024-06-04T16:13:24.503 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 5 seastore_tm 2024-06-04T16:13:24.503 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 5 seastore_t 2024-06-04T16:13:24.503 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 5 seastore_cleaner 2024-06-04T16:13:24.503 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 5 seastore_epm 2024-06-04T16:13:24.503 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 5 seastore_lba 2024-06-04T16:13:24.503 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 5 seastore_fixedkv_tree 2024-06-04T16:13:24.503 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 5 seastore_cache 2024-06-04T16:13:24.503 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 5 seastore_journal 2024-06-04T16:13:24.503 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 5 seastore_device 2024-06-04T16:13:24.503 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 5 seastore_backref 2024-06-04T16:13:24.503 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 5 alienstore 2024-06-04T16:13:24.503 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 5 mclock 2024-06-04T16:13:24.503 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 5 cyanstore 2024-06-04T16:13:24.503 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 5 ceph_exporter 2024-06-04T16:13:24.503 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 5 memstore 2024-06-04T16:13:24.504 INFO:tasks.workunit.client.0.smithi144.stderr: 1/ 5 trace 2024-06-04T16:13:24.504 INFO:tasks.workunit.client.0.smithi144.stderr: 0/ 5 ceph_dedup 2024-06-04T16:13:24.504 INFO:tasks.workunit.client.0.smithi144.stderr: -2/-2 (syslog threshold) 2024-06-04T16:13:24.504 INFO:tasks.workunit.client.0.smithi144.stderr: 99/99 (stderr threshold) 2024-06-04T16:13:24.504 INFO:tasks.workunit.client.0.smithi144.stderr:--- pthread ID / name mapping for recent threads --- 2024-06-04T16:13:24.504 INFO:tasks.workunit.client.0.smithi144.stderr: 7f7f97fff640 / http_manager 2024-06-04T16:13:24.504 INFO:tasks.workunit.client.0.smithi144.stderr: 7f80267e4640 / http_manager 2024-06-04T16:13:24.504 INFO:tasks.workunit.client.0.smithi144.stderr: 7f80277e6640 / rgw_dt_lg_renew 2024-06-04T16:13:24.504 INFO:tasks.workunit.client.0.smithi144.stderr: 7f8042ffd640 / ms_dispatch 2024-06-04T16:13:24.504 INFO:tasks.workunit.client.0.smithi144.stderr: 7f8054ff9640 / io_context_pool 2024-06-04T16:13:24.504 INFO:tasks.workunit.client.0.smithi144.stderr: 7f8056ffd640 / ms_dispatch 2024-06-04T16:13:24.504 INFO:tasks.workunit.client.0.smithi144.stderr: 7f805de03640 / ms_dispatch 2024-06-04T16:13:24.504 INFO:tasks.workunit.client.0.smithi144.stderr: 7f805f606640 / io_context_pool 2024-06-04T16:13:24.504 INFO:tasks.workunit.client.0.smithi144.stderr: 7f816bfff640 / msgr-worker-2 2024-06-04T16:13:24.504 INFO:tasks.workunit.client.0.smithi144.stderr: 7f8171064640 / msgr-worker-1 2024-06-04T16:13:24.505 INFO:tasks.workunit.client.0.smithi144.stderr: 7f8171865640 / msgr-worker-0 2024-06-04T16:13:24.505 INFO:tasks.workunit.client.0.smithi144.stderr: 7f8172066640 / io_context_pool 2024-06-04T16:13:24.505 INFO:tasks.workunit.client.0.smithi144.stderr: 7f8175a13800 / radosgw-admin 2024-06-04T16:13:24.505 INFO:tasks.workunit.client.0.smithi144.stderr: max_recent 500 2024-06-04T16:13:24.505 INFO:tasks.workunit.client.0.smithi144.stderr: max_new 1000 2024-06-04T16:13:24.505 INFO:tasks.workunit.client.0.smithi144.stderr: log_file /var/lib/ceph/crash/2024-06-04T16:13:24.344391Z_780cbb3f-c6c3-4061-a481-f506c8f8db6d/log 2024-06-04T16:13:24.505 INFO:tasks.workunit.client.0.smithi144.stderr:--- end dump of recent events --- 2024-06-04T16:13:24.505 INFO:tasks.workunit.client.0.smithi144.stderr:radosgw-admin bucket stats --bucket abort-at-do-reshard 2024-06-04T16:13:24.510 INFO:tasks.workunit.client.0.smithi144.stderr:ignoring --setuser ceph since I am not root 2024-06-04T16:13:24.511 INFO:tasks.workunit.client.0.smithi144.stderr:ignoring --setgroup ceph since I am not root 2024-06-04T16:13:24.511 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:24.418+0000 7f30d593f800 20 rados->read ofs=0 len=0 2024-06-04T16:13:24.511 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:24.420+0000 7f30d593f800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:13:24.511 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:24.420+0000 7f30d593f800 20 realm 2024-06-04T16:13:24.511 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:24.420+0000 7f30d593f800 20 rados->read ofs=0 len=0 2024-06-04T16:13:24.511 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:24.420+0000 7f30d593f800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:13:24.511 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:24.420+0000 7f30d593f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-06-04T16:13:24.511 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:24.420+0000 7f30d593f800 20 rados->read ofs=0 len=0 2024-06-04T16:13:24.511 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:24.420+0000 7f30d593f800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:13:24.511 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:24.420+0000 7f30d593f800 20 rados->read ofs=0 len=0 2024-06-04T16:13:24.511 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:24.421+0000 7f30d593f800 20 rados_obj.operate() r=0 bl.length=46 2024-06-04T16:13:24.511 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:24.421+0000 7f30d593f800 20 rados->read ofs=0 len=0 2024-06-04T16:13:24.512 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:24.422+0000 7f30d593f800 20 rados_obj.operate() r=0 bl.length=1139 2024-06-04T16:13:24.512 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:24.422+0000 7f30d593f800 20 searching for the correct realm 2024-06-04T16:13:24.512 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:24.423+0000 7f30d1e92640 0 -- 172.21.15.144:0/526805101 >> [v2:172.21.15.177:6824/800067290,v1:172.21.15.177:6825/800067290] conn(0x55f43b280540 msgr2=0x55f43b282930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-06-04T16:13:24.512 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:24.427+0000 7f30cbfff640 0 -- 172.21.15.144:0/526805101 >> [v2:172.21.15.144:6816/2358575268,v1:172.21.15.144:6817/2358575268] conn(0x55f43b284690 msgr2=0x55f43b286a80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-06-04T16:13:24.512 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:24.432+0000 7f30d593f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-06-04T16:13:24.512 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:24.432+0000 7f30d593f800 20 RGWRados::pool_iterate: got zone_info.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767 2024-06-04T16:13:24.512 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:24.432+0000 7f30d593f800 20 RGWRados::pool_iterate: got default.zone. 2024-06-04T16:13:24.512 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:24.432+0000 7f30d593f800 20 RGWRados::pool_iterate: got zonegroup_info.abb22408-c332-4e28-8f7a-ff254ea2fed2 2024-06-04T16:13:24.512 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:24.432+0000 7f30d593f800 20 RGWRados::pool_iterate: got zone_names.default 2024-06-04T16:13:24.512 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:24.432+0000 7f30d593f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-06-04T16:13:24.512 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:24.432+0000 7f30d593f800 20 rados->read ofs=0 len=0 2024-06-04T16:13:24.512 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:24.432+0000 7f30d593f800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:13:24.512 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:24.432+0000 7f30d593f800 20 rados->read ofs=0 len=0 2024-06-04T16:13:24.513 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:24.432+0000 7f30d593f800 20 rados_obj.operate() r=0 bl.length=46 2024-06-04T16:13:24.513 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:24.432+0000 7f30d593f800 20 rados->read ofs=0 len=0 2024-06-04T16:13:24.513 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:24.433+0000 7f30d593f800 20 rados_obj.operate() r=0 bl.length=470 2024-06-04T16:13:24.513 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:24.433+0000 7f30d593f800 20 zone default found 2024-06-04T16:13:24.513 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:24.433+0000 7f30d593f800 4 Realm: () 2024-06-04T16:13:24.513 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:24.433+0000 7f30d593f800 4 ZoneGroup: default (abb22408-c332-4e28-8f7a-ff254ea2fed2) 2024-06-04T16:13:24.513 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:24.433+0000 7f30d593f800 4 Zone: default (be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767) 2024-06-04T16:13:24.513 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:24.433+0000 7f30d593f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-06-04T16:13:24.513 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:24.433+0000 7f30d593f800 20 zonegroup default 2024-06-04T16:13:24.513 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:24.433+0000 7f30d593f800 20 rados->read ofs=0 len=0 2024-06-04T16:13:24.513 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:24.433+0000 7f30d593f800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:13:24.513 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:24.433+0000 7f30d593f800 20 rados->read ofs=0 len=0 2024-06-04T16:13:24.513 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:24.433+0000 7f30d593f800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:13:24.514 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:24.433+0000 7f30d593f800 20 rados->read ofs=0 len=0 2024-06-04T16:13:24.514 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:24.433+0000 7f30d593f800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:13:24.514 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:24.433+0000 7f30d593f800 20 started sync module instance, tier type = 2024-06-04T16:13:24.514 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:24.433+0000 7f30d593f800 20 started zone id=be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767 (name=default) with tier type = 2024-06-04T16:13:24.514 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:24.442+0000 7f30d593f800 20 add_watcher() i=0 2024-06-04T16:13:24.514 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:24.442+0000 7f30d593f800 20 add_watcher() i=1 2024-06-04T16:13:24.514 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:24.442+0000 7f30d593f800 20 add_watcher() i=2 2024-06-04T16:13:24.514 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:24.442+0000 7f30d593f800 20 add_watcher() i=3 2024-06-04T16:13:24.514 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:24.442+0000 7f30d593f800 20 add_watcher() i=4 2024-06-04T16:13:24.514 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:24.442+0000 7f30d593f800 20 add_watcher() i=5 2024-06-04T16:13:24.514 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:24.442+0000 7f30d593f800 20 add_watcher() i=6 2024-06-04T16:13:24.514 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:24.442+0000 7f30d593f800 20 add_watcher() i=7 2024-06-04T16:13:24.514 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:24.442+0000 7f30d593f800 2 all 8 watchers are set, enabling cache 2024-06-04T16:13:24.514 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:24.444+0000 7f2f87fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-06-04T16:13:24.515 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:24.444+0000 7f30d593f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-06-04T16:13:24.515 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:24.444+0000 7f30d593f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-06-04T16:13:24.515 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:24.444+0000 7f30d593f800 5 note: GC not initialized 2024-06-04T16:13:24.515 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:24.444+0000 7f2f86fe5640 20 reqs_thread_entry: start 2024-06-04T16:13:24.515 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:24.445+0000 7f30d593f800 20 init_complete bucket index max shards: 11 2024-06-04T16:13:24.515 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:24.445+0000 7f30d593f800 20 Filter name: none 2024-06-04T16:13:24.515 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:24.445+0000 7f2f84fe1640 20 reqs_thread_entry: start 2024-06-04T16:13:24.515 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:24.445+0000 7f30d593f800 20 rados->read ofs=0 len=0 2024-06-04T16:13:24.515 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:24.445+0000 7f30d593f800 20 rados_obj.operate() r=0 bl.length=187 2024-06-04T16:13:24.515 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:24.445+0000 7f30d593f800 20 rados->read ofs=0 len=0 2024-06-04T16:13:24.515 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:24.446+0000 7f30d593f800 20 rados_obj.operate() r=0 bl.length=433 2024-06-04T16:13:24.515 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:24.446+0000 7f30d593f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-06-04T16:13:24.515 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:24.446+0000 7f30d593f800 20 rados->read ofs=0 len=0 2024-06-04T16:13:24.516 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:24.446+0000 7f30d593f800 20 rados_obj.operate() r=0 bl.length=187 2024-06-04T16:13:24.516 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:24.446+0000 7f30d593f800 20 rados->read ofs=0 len=0 2024-06-04T16:13:24.516 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:24.446+0000 7f30d593f800 20 rados_obj.operate() r=0 bl.length=433 2024-06-04T16:13:24.516 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:24.446+0000 7f30d593f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-06-04T16:13:24.516 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:24.448+0000 7f2f87fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-06-04T16:13:24.516 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:24.450+0000 7f30d593f800 20 remove_watcher() i=0 2024-06-04T16:13:24.516 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:24.450+0000 7f30d593f800 2 removed watcher, disabling cache 2024-06-04T16:13:24.516 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:24.451+0000 7f30d593f800 20 remove_watcher() i=1 2024-06-04T16:13:24.516 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:24.452+0000 7f30d593f800 20 remove_watcher() i=2 2024-06-04T16:13:24.516 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:24.453+0000 7f30d593f800 20 remove_watcher() i=3 2024-06-04T16:13:24.516 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:24.454+0000 7f30d593f800 20 remove_watcher() i=4 2024-06-04T16:13:24.516 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:24.455+0000 7f30d593f800 20 remove_watcher() i=5 2024-06-04T16:13:24.516 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:24.456+0000 7f30d593f800 20 remove_watcher() i=6 2024-06-04T16:13:24.516 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:24.457+0000 7f30d593f800 20 remove_watcher() i=7 2024-06-04T16:13:24.517 INFO:tasks.workunit.client.0.smithi144.stderr: 2024-06-04T16:13:24.517 INFO:tasks.workunit.client.0.smithi144.stderr:BUCKET_STATS: 2024-06-04T16:13:24.517 INFO:tasks.workunit.client.0.smithi144.stderr:bucket: abort-at-do-reshard id: be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.28 num_objects: 20 size_kb: 1 num_shards: 11 2024-06-04T16:13:24.517 INFO:tasks.workunit.client.0.smithi144.stderr: 2024-06-04T16:13:24.517 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:13:24.517 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:13:54.508 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:13:54.508 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:13:54.551 INFO:tasks.workunit.client.0.smithi144.stderr:radosgw-admin bucket reshard --bucket abort-at-do-reshard --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-06-04T16:13:54.585 INFO:tasks.workunit.client.0.smithi144.stderr:ignoring --setuser ceph since I am not root 2024-06-04T16:13:54.585 INFO:tasks.workunit.client.0.smithi144.stderr:ignoring --setgroup ceph since I am not root 2024-06-04T16:13:54.628 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:54.627+0000 7f766d92e800 20 rados->read ofs=0 len=0 2024-06-04T16:13:54.630 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:54.628+0000 7f766d92e800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:13:54.630 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:54.628+0000 7f766d92e800 20 realm 2024-06-04T16:13:54.630 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:54.629+0000 7f766d92e800 20 rados->read ofs=0 len=0 2024-06-04T16:13:54.630 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:54.629+0000 7f766d92e800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:13:54.630 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:54.629+0000 7f766d92e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-06-04T16:13:54.630 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:54.629+0000 7f766d92e800 20 rados->read ofs=0 len=0 2024-06-04T16:13:54.630 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:54.629+0000 7f766d92e800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:13:54.631 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:54.629+0000 7f766d92e800 20 rados->read ofs=0 len=0 2024-06-04T16:13:54.631 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:54.630+0000 7f766d92e800 20 rados_obj.operate() r=0 bl.length=46 2024-06-04T16:13:54.631 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:54.630+0000 7f766d92e800 20 rados->read ofs=0 len=0 2024-06-04T16:13:54.631 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:54.630+0000 7f766d92e800 20 rados_obj.operate() r=0 bl.length=1139 2024-06-04T16:13:54.631 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:54.630+0000 7f766d92e800 20 searching for the correct realm 2024-06-04T16:13:54.632 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:54.631+0000 7f7669664640 0 -- 172.21.15.144:0/2058616536 >> [v2:172.21.15.177:6816/2039473917,v1:172.21.15.177:6817/2039473917] conn(0x55d7a5d2d1c0 msgr2=0x55d7a5d2f680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-06-04T16:13:54.837 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:54.836+0000 7f7669664640 0 -- 172.21.15.144:0/2058616536 >> [v2:172.21.15.177:6800/3891611393,v1:172.21.15.177:6801/3891611393] conn(0x7f765c05f930 msgr2=0x7f765c053410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-06-04T16:13:55.048 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.046+0000 7f766d92e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-06-04T16:13:55.049 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.046+0000 7f766d92e800 20 RGWRados::pool_iterate: got zone_info.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767 2024-06-04T16:13:55.049 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.046+0000 7f766d92e800 20 RGWRados::pool_iterate: got default.zone. 2024-06-04T16:13:55.049 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.046+0000 7f766d92e800 20 RGWRados::pool_iterate: got zonegroup_info.abb22408-c332-4e28-8f7a-ff254ea2fed2 2024-06-04T16:13:55.049 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.046+0000 7f766d92e800 20 RGWRados::pool_iterate: got zone_names.default 2024-06-04T16:13:55.049 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.046+0000 7f766d92e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-06-04T16:13:55.049 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.046+0000 7f766d92e800 20 rados->read ofs=0 len=0 2024-06-04T16:13:55.049 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.046+0000 7f766d92e800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:13:55.049 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.046+0000 7f766d92e800 20 rados->read ofs=0 len=0 2024-06-04T16:13:55.049 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.047+0000 7f766d92e800 20 rados_obj.operate() r=0 bl.length=46 2024-06-04T16:13:55.049 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.047+0000 7f766d92e800 20 rados->read ofs=0 len=0 2024-06-04T16:13:55.049 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.047+0000 7f766d92e800 20 rados_obj.operate() r=0 bl.length=470 2024-06-04T16:13:55.050 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.047+0000 7f766d92e800 20 zone default found 2024-06-04T16:13:55.050 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.047+0000 7f766d92e800 4 Realm: () 2024-06-04T16:13:55.050 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.047+0000 7f766d92e800 4 ZoneGroup: default (abb22408-c332-4e28-8f7a-ff254ea2fed2) 2024-06-04T16:13:55.050 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.047+0000 7f766d92e800 4 Zone: default (be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767) 2024-06-04T16:13:55.050 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.047+0000 7f766d92e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-06-04T16:13:55.050 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.047+0000 7f766d92e800 20 zonegroup default 2024-06-04T16:13:55.050 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.047+0000 7f766d92e800 20 rados->read ofs=0 len=0 2024-06-04T16:13:55.050 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.047+0000 7f766d92e800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:13:55.050 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.048+0000 7f766d92e800 20 rados->read ofs=0 len=0 2024-06-04T16:13:55.050 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.048+0000 7f766d92e800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:13:55.050 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.048+0000 7f766d92e800 20 rados->read ofs=0 len=0 2024-06-04T16:13:55.051 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.048+0000 7f766d92e800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:13:55.051 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.048+0000 7f766d92e800 20 started sync module instance, tier type = 2024-06-04T16:13:55.051 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.048+0000 7f766d92e800 20 started zone id=be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767 (name=default) with tier type = 2024-06-04T16:13:55.059 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.058+0000 7f766d92e800 20 add_watcher() i=0 2024-06-04T16:13:55.059 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.058+0000 7f766d92e800 20 add_watcher() i=1 2024-06-04T16:13:55.059 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.058+0000 7f766d92e800 20 add_watcher() i=2 2024-06-04T16:13:55.059 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.058+0000 7f766d92e800 20 add_watcher() i=3 2024-06-04T16:13:55.059 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.058+0000 7f766d92e800 20 add_watcher() i=4 2024-06-04T16:13:55.059 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.058+0000 7f766d92e800 20 add_watcher() i=5 2024-06-04T16:13:55.059 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.058+0000 7f766d92e800 20 add_watcher() i=6 2024-06-04T16:13:55.060 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.059+0000 7f766d92e800 20 add_watcher() i=7 2024-06-04T16:13:55.060 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.059+0000 7f766d92e800 2 all 8 watchers are set, enabling cache 2024-06-04T16:13:55.062 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.062+0000 7f751ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-06-04T16:13:55.064 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.062+0000 7f766d92e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-06-04T16:13:55.064 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.062+0000 7f766d92e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-06-04T16:13:55.064 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.062+0000 7f766d92e800 5 note: GC not initialized 2024-06-04T16:13:55.064 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.062+0000 7f751efe5640 20 reqs_thread_entry: start 2024-06-04T16:13:55.064 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.062+0000 7f766d92e800 20 init_complete bucket index max shards: 11 2024-06-04T16:13:55.064 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.063+0000 7f766d92e800 20 Filter name: none 2024-06-04T16:13:55.064 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.063+0000 7f751cfe1640 20 reqs_thread_entry: start 2024-06-04T16:13:55.064 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.063+0000 7f766d92e800 10 cache get: name=default.rgw.meta+root+abort-at-do-reshard : miss 2024-06-04T16:13:55.064 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.063+0000 7f766d92e800 20 rados->read ofs=0 len=0 2024-06-04T16:13:55.065 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.063+0000 7f766d92e800 20 rados_obj.operate() r=0 bl.length=187 2024-06-04T16:13:55.065 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.063+0000 7f766d92e800 10 cache put: name=default.rgw.meta+root+abort-at-do-reshard info.flags=0x11 2024-06-04T16:13:55.065 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.063+0000 7f766d92e800 10 adding default.rgw.meta+root+abort-at-do-reshard to cache LRU end 2024-06-04T16:13:55.065 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.063+0000 7f766d92e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.28 : miss 2024-06-04T16:13:55.065 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.063+0000 7f766d92e800 20 rados->read ofs=0 len=0 2024-06-04T16:13:55.066 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.064+0000 7f766d92e800 20 rados_obj.operate() r=0 bl.length=401 2024-06-04T16:13:55.066 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.064+0000 7f766d92e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.28 info.flags=0x17 2024-06-04T16:13:55.066 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.064+0000 7f766d92e800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.28 to cache LRU end 2024-06-04T16:13:55.066 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.064+0000 7f766d92e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-06-04T16:13:55.066 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.064+0000 7f766d92e800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-06-04T16:13:55.066 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.064+0000 7f766d92e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.28 2024-06-04T16:13:55.070 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.069+0000 7f766d92e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.28 info.flags=0x17 2024-06-04T16:13:55.071 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.069+0000 7f766d92e800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.28 to cache LRU end 2024-06-04T16:13:55.071 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.069+0000 7f766d92e800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-06-04T16:13:55.071 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.069+0000 7f766d92e800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.28, ofs0, ns] 2024-06-04T16:13:55.071 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.070+0000 7f754cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1078036791321 cookie 94384688403376 notifier 6599 bl.length()=903 2024-06-04T16:13:55.071 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.070+0000 7f754cff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.28 info.flags=0x17 2024-06-04T16:13:55.071 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.070+0000 7f754cff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.28 to cache LRU end 2024-06-04T16:13:55.071 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.070+0000 7f754cff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-06-04T16:13:55.071 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.070+0000 7f766d92e800 20 handle_bi_update(): bucket=:abort-at-do-reshard[be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.28]): orig_sources= new_sources= 2024-06-04T16:13:55.071 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.070+0000 7f766d92e800 20 handle_bi_update(): bucket=:abort-at-do-reshard[be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.28]): potential sources added=[] removed=[] 2024-06-04T16:13:55.072 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.070+0000 7f766d92e800 20 handle_bi_update(): bucket=:abort-at-do-reshard[be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.28]): orig_dests= new_dests= 2024-06-04T16:13:55.072 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.070+0000 7f766d92e800 20 handle_bi_update(): bucket=:abort-at-do-reshard[be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.28]): potential dests added=[] removed=[] 2024-06-04T16:13:55.074 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.073+0000 7f766d92e800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.28.1.0 2024-06-04T16:13:55.074 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.073+0000 7f766d92e800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.28.1.0 2024-06-04T16:13:55.074 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.073+0000 7f766d92e800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.28.1.1 2024-06-04T16:13:55.074 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.073+0000 7f766d92e800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.28.1.1 2024-06-04T16:13:55.074 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.073+0000 7f766d92e800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.28.1.2 2024-06-04T16:13:55.074 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.073+0000 7f766d92e800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.28.1.2 2024-06-04T16:13:55.075 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.073+0000 7f766d92e800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.28.1.3 2024-06-04T16:13:55.075 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.073+0000 7f766d92e800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.28.1.3 2024-06-04T16:13:55.075 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.073+0000 7f766d92e800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.28.1.4 2024-06-04T16:13:55.075 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.073+0000 7f766d92e800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.28.1.4 2024-06-04T16:13:55.075 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.073+0000 7f766d92e800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.28.1.5 2024-06-04T16:13:55.075 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.073+0000 7f766d92e800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.28.1.5 2024-06-04T16:13:55.075 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.073+0000 7f766d92e800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.28.1.6 2024-06-04T16:13:55.075 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.073+0000 7f766d92e800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.28.1.6 2024-06-04T16:13:55.075 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.073+0000 7f766d92e800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.28.1.7 2024-06-04T16:13:55.075 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.073+0000 7f766d92e800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.28.1.7 2024-06-04T16:13:55.075 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.073+0000 7f766d92e800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.28.1.8 2024-06-04T16:13:55.075 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.073+0000 7f766d92e800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.28.1.8 2024-06-04T16:13:55.075 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.073+0000 7f766d92e800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.28.1.9 2024-06-04T16:13:55.076 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.073+0000 7f766d92e800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.28.1.9 2024-06-04T16:13:55.076 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.073+0000 7f766d92e800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.28.1.10 2024-06-04T16:13:55.076 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.073+0000 7f766d92e800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.28.1.10 2024-06-04T16:13:55.076 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.073+0000 7f766d92e800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.28.1.11 2024-06-04T16:13:55.076 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.073+0000 7f766d92e800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.28.1.11 2024-06-04T16:13:55.076 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.073+0000 7f766d92e800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.28.0 2024-06-04T16:13:55.076 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.073+0000 7f766d92e800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.28.1 2024-06-04T16:13:55.077 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.074+0000 7f766d92e800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.28.2 2024-06-04T16:13:55.077 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.074+0000 7f766d92e800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.28.3 2024-06-04T16:13:55.077 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.075+0000 7f766d92e800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.28.4 2024-06-04T16:13:55.077 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.075+0000 7f766d92e800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.28.5 2024-06-04T16:13:55.077 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.076+0000 7f766d92e800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.28.6 2024-06-04T16:13:55.077 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.077+0000 7f766d92e800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.28.7 2024-06-04T16:13:55.078 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.077+0000 7f766d92e800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.28.8 2024-06-04T16:13:55.078 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.078+0000 7f766d92e800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.28.9 2024-06-04T16:13:55.079 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.078+0000 7f766d92e800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.28.10 2024-06-04T16:13:55.083 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.082+0000 7f766d92e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.28 : hit (requested=0x17, cached=0x17) 2024-06-04T16:13:55.083 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.082+0000 7f766d92e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.28 2024-06-04T16:13:55.084 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.084+0000 7f766d92e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.28 info.flags=0x17 2024-06-04T16:13:55.084 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.084+0000 7f766d92e800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.28 to cache LRU end 2024-06-04T16:13:55.085 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.084+0000 7f766d92e800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-06-04T16:13:55.085 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.084+0000 7f766d92e800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.28, ofs0, ns] 2024-06-04T16:13:55.085 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.084+0000 7f754cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1078036791322 cookie 94384688403376 notifier 6599 bl.length()=871 2024-06-04T16:13:55.085 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.084+0000 7f754cff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.28 info.flags=0x17 2024-06-04T16:13:55.085 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.084+0000 7f754cff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.28 to cache LRU end 2024-06-04T16:13:55.086 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.084+0000 7f754cff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-06-04T16:13:55.086 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.084+0000 7f766d92e800 20 handle_bi_update(): bucket=:abort-at-do-reshard[be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.28]): orig_sources= new_sources= 2024-06-04T16:13:55.086 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.084+0000 7f766d92e800 20 handle_bi_update(): bucket=:abort-at-do-reshard[be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.28]): potential sources added=[] removed=[] 2024-06-04T16:13:55.086 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.084+0000 7f766d92e800 20 handle_bi_update(): bucket=:abort-at-do-reshard[be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.28]): orig_dests= new_dests= 2024-06-04T16:13:55.086 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.084+0000 7f766d92e800 20 handle_bi_update(): bucket=:abort-at-do-reshard[be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.28]): potential dests added=[] removed=[] 2024-06-04T16:13:55.088 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.087+0000 7f766d92e800 1 execute INFO: reshard of bucket "abort-at-do-reshard" completed successfully 2024-06-04T16:13:55.090 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.089+0000 7f751ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-06-04T16:13:55.092 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.092+0000 7f766d92e800 20 remove_watcher() i=0 2024-06-04T16:13:55.092 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.092+0000 7f766d92e800 2 removed watcher, disabling cache 2024-06-04T16:13:55.094 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.093+0000 7f766d92e800 20 remove_watcher() i=1 2024-06-04T16:13:55.094 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.094+0000 7f766d92e800 20 remove_watcher() i=2 2024-06-04T16:13:55.096 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.095+0000 7f766d92e800 20 remove_watcher() i=3 2024-06-04T16:13:55.096 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.096+0000 7f766d92e800 20 remove_watcher() i=4 2024-06-04T16:13:55.097 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.097+0000 7f766d92e800 20 remove_watcher() i=5 2024-06-04T16:13:55.099 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.098+0000 7f766d92e800 20 remove_watcher() i=6 2024-06-04T16:13:55.100 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.099+0000 7f766d92e800 20 remove_watcher() i=7 2024-06-04T16:13:55.113 INFO:tasks.workunit.client.0.smithi144.stderr:radosgw-admin bucket stats --bucket abort-at-do-reshard 2024-06-04T16:13:55.153 INFO:tasks.workunit.client.0.smithi144.stderr:ignoring --setuser ceph since I am not root 2024-06-04T16:13:55.153 INFO:tasks.workunit.client.0.smithi144.stderr:ignoring --setgroup ceph since I am not root 2024-06-04T16:13:55.180 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.179+0000 7f028f522800 20 rados->read ofs=0 len=0 2024-06-04T16:13:55.181 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.180+0000 7f028f522800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:13:55.182 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.180+0000 7f028f522800 20 realm 2024-06-04T16:13:55.182 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.180+0000 7f028f522800 20 rados->read ofs=0 len=0 2024-06-04T16:13:55.182 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.181+0000 7f028f522800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:13:55.182 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.181+0000 7f028f522800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-06-04T16:13:55.182 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.181+0000 7f028f522800 20 rados->read ofs=0 len=0 2024-06-04T16:13:55.182 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.181+0000 7f028f522800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:13:55.182 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.181+0000 7f028f522800 20 rados->read ofs=0 len=0 2024-06-04T16:13:55.183 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.181+0000 7f028f522800 20 rados_obj.operate() r=0 bl.length=46 2024-06-04T16:13:55.183 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.181+0000 7f028f522800 20 rados->read ofs=0 len=0 2024-06-04T16:13:55.183 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.182+0000 7f028f522800 20 rados_obj.operate() r=0 bl.length=1139 2024-06-04T16:13:55.183 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.182+0000 7f028f522800 20 searching for the correct realm 2024-06-04T16:13:55.185 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.184+0000 7f028b997640 0 -- 172.21.15.144:0/2540873512 >> [v2:172.21.15.144:6800/1453747520,v1:172.21.15.144:6801/1453747520] conn(0x7f0274018070 msgr2=0x7f0274061400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-06-04T16:13:55.390 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.389+0000 7f028b997640 0 -- 172.21.15.144:0/2540873512 >> [v2:172.21.15.144:6824/166159729,v1:172.21.15.144:6825/166159729] conn(0x5626e23cae50 msgr2=0x5626e23cd240 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-06-04T16:13:55.396 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.395+0000 7f028f522800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-06-04T16:13:55.396 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.395+0000 7f028f522800 20 RGWRados::pool_iterate: got zone_info.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767 2024-06-04T16:13:55.396 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.395+0000 7f028f522800 20 RGWRados::pool_iterate: got default.zone. 2024-06-04T16:13:55.396 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.395+0000 7f028f522800 20 RGWRados::pool_iterate: got zonegroup_info.abb22408-c332-4e28-8f7a-ff254ea2fed2 2024-06-04T16:13:55.396 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.395+0000 7f028f522800 20 RGWRados::pool_iterate: got zone_names.default 2024-06-04T16:13:55.396 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.395+0000 7f028f522800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-06-04T16:13:55.397 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.395+0000 7f028f522800 20 rados->read ofs=0 len=0 2024-06-04T16:13:55.397 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.395+0000 7f028f522800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:13:55.397 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.395+0000 7f028f522800 20 rados->read ofs=0 len=0 2024-06-04T16:13:55.397 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.395+0000 7f028f522800 20 rados_obj.operate() r=0 bl.length=46 2024-06-04T16:13:55.397 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.395+0000 7f028f522800 20 rados->read ofs=0 len=0 2024-06-04T16:13:55.398 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.396+0000 7f028f522800 20 rados_obj.operate() r=0 bl.length=470 2024-06-04T16:13:55.398 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.396+0000 7f028f522800 20 zone default found 2024-06-04T16:13:55.398 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.396+0000 7f028f522800 4 Realm: () 2024-06-04T16:13:55.398 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.396+0000 7f028f522800 4 ZoneGroup: default (abb22408-c332-4e28-8f7a-ff254ea2fed2) 2024-06-04T16:13:55.398 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.396+0000 7f028f522800 4 Zone: default (be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767) 2024-06-04T16:13:55.398 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.396+0000 7f028f522800 10 cannot find current period zonegroup using local zonegroup configuration 2024-06-04T16:13:55.398 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.396+0000 7f028f522800 20 zonegroup default 2024-06-04T16:13:55.398 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.396+0000 7f028f522800 20 rados->read ofs=0 len=0 2024-06-04T16:13:55.398 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.396+0000 7f028f522800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:13:55.398 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.396+0000 7f028f522800 20 rados->read ofs=0 len=0 2024-06-04T16:13:55.399 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.396+0000 7f028f522800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:13:55.399 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.396+0000 7f028f522800 20 rados->read ofs=0 len=0 2024-06-04T16:13:55.399 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.397+0000 7f028f522800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:13:55.399 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.397+0000 7f028f522800 20 started sync module instance, tier type = 2024-06-04T16:13:55.399 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.397+0000 7f028f522800 20 started zone id=be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767 (name=default) with tier type = 2024-06-04T16:13:55.407 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.406+0000 7f028f522800 20 add_watcher() i=0 2024-06-04T16:13:55.407 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.406+0000 7f028f522800 20 add_watcher() i=1 2024-06-04T16:13:55.407 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.406+0000 7f028f522800 20 add_watcher() i=2 2024-06-04T16:13:55.407 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.406+0000 7f028f522800 20 add_watcher() i=3 2024-06-04T16:13:55.408 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.406+0000 7f028f522800 20 add_watcher() i=4 2024-06-04T16:13:55.408 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.406+0000 7f028f522800 20 add_watcher() i=5 2024-06-04T16:13:55.408 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.406+0000 7f028f522800 20 add_watcher() i=6 2024-06-04T16:13:55.408 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.408+0000 7f028f522800 20 add_watcher() i=7 2024-06-04T16:13:55.408 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.408+0000 7f028f522800 2 all 8 watchers are set, enabling cache 2024-06-04T16:13:55.411 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.410+0000 7f0141fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-06-04T16:13:55.412 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.410+0000 7f028f522800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-06-04T16:13:55.412 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.410+0000 7f028f522800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-06-04T16:13:55.412 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.410+0000 7f028f522800 5 note: GC not initialized 2024-06-04T16:13:55.412 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.410+0000 7f0140fe1640 20 reqs_thread_entry: start 2024-06-04T16:13:55.412 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.410+0000 7f028f522800 20 init_complete bucket index max shards: 11 2024-06-04T16:13:55.412 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.410+0000 7f028f522800 20 Filter name: none 2024-06-04T16:13:55.412 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.411+0000 7f00ba7fc640 20 reqs_thread_entry: start 2024-06-04T16:13:55.412 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.411+0000 7f028f522800 20 rados->read ofs=0 len=0 2024-06-04T16:13:55.413 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.411+0000 7f028f522800 20 rados_obj.operate() r=0 bl.length=187 2024-06-04T16:13:55.413 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.411+0000 7f028f522800 20 rados->read ofs=0 len=0 2024-06-04T16:13:55.413 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.411+0000 7f028f522800 20 rados_obj.operate() r=0 bl.length=401 2024-06-04T16:13:55.413 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.411+0000 7f028f522800 20 couldn't put binfo cache entry, might have raced with data changes 2024-06-04T16:13:55.413 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.411+0000 7f028f522800 20 rados->read ofs=0 len=0 2024-06-04T16:13:55.413 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.412+0000 7f028f522800 20 rados_obj.operate() r=0 bl.length=187 2024-06-04T16:13:55.414 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.412+0000 7f028f522800 20 rados->read ofs=0 len=0 2024-06-04T16:13:55.414 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.412+0000 7f028f522800 20 rados_obj.operate() r=0 bl.length=401 2024-06-04T16:13:55.414 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.412+0000 7f028f522800 20 couldn't put binfo cache entry, might have raced with data changes 2024-06-04T16:13:55.415 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.414+0000 7f0141fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-06-04T16:13:55.417 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.416+0000 7f028f522800 20 remove_watcher() i=0 2024-06-04T16:13:55.417 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.416+0000 7f028f522800 2 removed watcher, disabling cache 2024-06-04T16:13:55.418 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.417+0000 7f028f522800 20 remove_watcher() i=1 2024-06-04T16:13:55.419 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.418+0000 7f028f522800 20 remove_watcher() i=2 2024-06-04T16:13:55.420 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.419+0000 7f028f522800 20 remove_watcher() i=3 2024-06-04T16:13:55.421 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.420+0000 7f028f522800 20 remove_watcher() i=4 2024-06-04T16:13:55.422 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.421+0000 7f028f522800 20 remove_watcher() i=5 2024-06-04T16:13:55.423 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.422+0000 7f028f522800 20 remove_watcher() i=6 2024-06-04T16:13:55.424 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.423+0000 7f028f522800 20 remove_watcher() i=7 2024-06-04T16:13:55.434 INFO:tasks.workunit.client.0.smithi144.stderr: 2024-06-04T16:13:55.434 INFO:tasks.workunit.client.0.smithi144.stderr:BUCKET_STATS: 2024-06-04T16:13:55.435 INFO:tasks.workunit.client.0.smithi144.stderr:bucket: abort-at-do-reshard id: be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.28 num_objects: 19 size_kb: 1 num_shards: 12 2024-06-04T16:13:55.435 INFO:tasks.workunit.client.0.smithi144.stderr: 2024-06-04T16:13:55.436 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:13:55.436 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:13:55.440 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:13:55.440 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:13:55.482 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:13:55.482 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:13:55.512 INFO:tasks.workunit.client.0.smithi144.stderr: test: reshard versioned bucket 2024-06-04T16:13:55.514 INFO:tasks.workunit.client.0.smithi144.stderr:radosgw-admin bucket stats --bucket myver 2024-06-04T16:13:55.542 INFO:tasks.workunit.client.0.smithi144.stderr:ignoring --setuser ceph since I am not root 2024-06-04T16:13:55.543 INFO:tasks.workunit.client.0.smithi144.stderr:ignoring --setgroup ceph since I am not root 2024-06-04T16:13:55.579 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.578+0000 7f39da735800 20 rados->read ofs=0 len=0 2024-06-04T16:13:55.581 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.580+0000 7f39da735800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:13:55.581 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.580+0000 7f39da735800 20 realm 2024-06-04T16:13:55.581 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.580+0000 7f39da735800 20 rados->read ofs=0 len=0 2024-06-04T16:13:55.581 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.580+0000 7f39da735800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:13:55.581 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.580+0000 7f39da735800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-06-04T16:13:55.581 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.580+0000 7f39da735800 20 rados->read ofs=0 len=0 2024-06-04T16:13:55.581 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.580+0000 7f39da735800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:13:55.581 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.580+0000 7f39da735800 20 rados->read ofs=0 len=0 2024-06-04T16:13:55.582 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.581+0000 7f39da735800 20 rados_obj.operate() r=0 bl.length=46 2024-06-04T16:13:55.582 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.581+0000 7f39da735800 20 rados->read ofs=0 len=0 2024-06-04T16:13:55.582 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.581+0000 7f39da735800 20 rados_obj.operate() r=0 bl.length=1139 2024-06-04T16:13:55.582 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.581+0000 7f39da735800 20 searching for the correct realm 2024-06-04T16:13:55.585 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.584+0000 7f39d6bac640 0 -- 172.21.15.144:0/3898384891 >> [v2:172.21.15.144:6800/1453747520,v1:172.21.15.144:6801/1453747520] conn(0x7f39c0015070 msgr2=0x7f39c0045920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-06-04T16:13:55.790 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.789+0000 7f39d6bac640 0 -- 172.21.15.144:0/3898384891 >> [v2:172.21.15.144:6824/166159729,v1:172.21.15.144:6825/166159729] conn(0x555667dcadb0 msgr2=0x555667dcd1a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-06-04T16:13:55.796 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.794+0000 7f39da735800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-06-04T16:13:55.796 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.794+0000 7f39da735800 20 RGWRados::pool_iterate: got zone_info.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767 2024-06-04T16:13:55.796 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.794+0000 7f39da735800 20 RGWRados::pool_iterate: got default.zone. 2024-06-04T16:13:55.796 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.794+0000 7f39da735800 20 RGWRados::pool_iterate: got zonegroup_info.abb22408-c332-4e28-8f7a-ff254ea2fed2 2024-06-04T16:13:55.796 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.794+0000 7f39da735800 20 RGWRados::pool_iterate: got zone_names.default 2024-06-04T16:13:55.796 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.794+0000 7f39da735800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-06-04T16:13:55.796 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.794+0000 7f39da735800 20 rados->read ofs=0 len=0 2024-06-04T16:13:55.796 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.795+0000 7f39da735800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:13:55.796 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.795+0000 7f39da735800 20 rados->read ofs=0 len=0 2024-06-04T16:13:55.796 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.795+0000 7f39da735800 20 rados_obj.operate() r=0 bl.length=46 2024-06-04T16:13:55.797 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.795+0000 7f39da735800 20 rados->read ofs=0 len=0 2024-06-04T16:13:55.798 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.795+0000 7f39da735800 20 rados_obj.operate() r=0 bl.length=470 2024-06-04T16:13:55.798 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.795+0000 7f39da735800 20 zone default found 2024-06-04T16:13:55.798 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.795+0000 7f39da735800 4 Realm: () 2024-06-04T16:13:55.798 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.795+0000 7f39da735800 4 ZoneGroup: default (abb22408-c332-4e28-8f7a-ff254ea2fed2) 2024-06-04T16:13:55.798 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.795+0000 7f39da735800 4 Zone: default (be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767) 2024-06-04T16:13:55.798 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.795+0000 7f39da735800 10 cannot find current period zonegroup using local zonegroup configuration 2024-06-04T16:13:55.798 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.795+0000 7f39da735800 20 zonegroup default 2024-06-04T16:13:55.798 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.795+0000 7f39da735800 20 rados->read ofs=0 len=0 2024-06-04T16:13:55.798 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.796+0000 7f39da735800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:13:55.799 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.796+0000 7f39da735800 20 rados->read ofs=0 len=0 2024-06-04T16:13:55.799 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.796+0000 7f39da735800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:13:55.799 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.796+0000 7f39da735800 20 rados->read ofs=0 len=0 2024-06-04T16:13:55.799 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.796+0000 7f39da735800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:13:55.799 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.796+0000 7f39da735800 20 started sync module instance, tier type = 2024-06-04T16:13:55.799 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.796+0000 7f39da735800 20 started zone id=be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767 (name=default) with tier type = 2024-06-04T16:13:55.807 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.806+0000 7f39da735800 20 add_watcher() i=0 2024-06-04T16:13:55.807 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.806+0000 7f39da735800 20 add_watcher() i=1 2024-06-04T16:13:55.807 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.806+0000 7f39da735800 20 add_watcher() i=2 2024-06-04T16:13:55.807 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.806+0000 7f39da735800 20 add_watcher() i=3 2024-06-04T16:13:55.807 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.806+0000 7f39da735800 20 add_watcher() i=4 2024-06-04T16:13:55.807 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.806+0000 7f39da735800 20 add_watcher() i=5 2024-06-04T16:13:55.807 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.806+0000 7f39da735800 20 add_watcher() i=6 2024-06-04T16:13:55.807 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.807+0000 7f39da735800 20 add_watcher() i=7 2024-06-04T16:13:55.808 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.807+0000 7f39da735800 2 all 8 watchers are set, enabling cache 2024-06-04T16:13:55.809 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.808+0000 7f388cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-06-04T16:13:55.810 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.809+0000 7f39da735800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-06-04T16:13:55.810 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.809+0000 7f39da735800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-06-04T16:13:55.810 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.809+0000 7f39da735800 5 note: GC not initialized 2024-06-04T16:13:55.810 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.809+0000 7f38077fe640 20 reqs_thread_entry: start 2024-06-04T16:13:55.810 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.809+0000 7f39da735800 20 init_complete bucket index max shards: 11 2024-06-04T16:13:55.810 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.809+0000 7f39da735800 20 Filter name: none 2024-06-04T16:13:55.811 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.809+0000 7f38057fa640 20 reqs_thread_entry: start 2024-06-04T16:13:55.811 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.809+0000 7f39da735800 20 rados->read ofs=0 len=0 2024-06-04T16:13:55.811 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.810+0000 7f39da735800 20 rados_obj.operate() r=0 bl.length=173 2024-06-04T16:13:55.811 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.810+0000 7f39da735800 20 rados->read ofs=0 len=0 2024-06-04T16:13:55.812 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.810+0000 7f39da735800 20 rados_obj.operate() r=0 bl.length=387 2024-06-04T16:13:55.812 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.810+0000 7f39da735800 20 couldn't put binfo cache entry, might have raced with data changes 2024-06-04T16:13:55.812 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.810+0000 7f39da735800 20 rados->read ofs=0 len=0 2024-06-04T16:13:55.812 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.811+0000 7f39da735800 20 rados_obj.operate() r=0 bl.length=173 2024-06-04T16:13:55.812 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.811+0000 7f39da735800 20 rados->read ofs=0 len=0 2024-06-04T16:13:55.812 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.811+0000 7f39da735800 20 rados_obj.operate() r=0 bl.length=387 2024-06-04T16:13:55.812 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.811+0000 7f39da735800 20 couldn't put binfo cache entry, might have raced with data changes 2024-06-04T16:13:55.814 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.813+0000 7f388cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-06-04T16:13:55.816 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.815+0000 7f39da735800 20 remove_watcher() i=0 2024-06-04T16:13:55.816 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.815+0000 7f39da735800 2 removed watcher, disabling cache 2024-06-04T16:13:55.817 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.816+0000 7f39da735800 20 remove_watcher() i=1 2024-06-04T16:13:55.818 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.817+0000 7f39da735800 20 remove_watcher() i=2 2024-06-04T16:13:55.819 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.818+0000 7f39da735800 20 remove_watcher() i=3 2024-06-04T16:13:55.820 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.819+0000 7f39da735800 20 remove_watcher() i=4 2024-06-04T16:13:55.821 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.820+0000 7f39da735800 20 remove_watcher() i=5 2024-06-04T16:13:55.822 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.821+0000 7f39da735800 20 remove_watcher() i=6 2024-06-04T16:13:55.823 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.822+0000 7f39da735800 20 remove_watcher() i=7 2024-06-04T16:13:55.833 INFO:tasks.workunit.client.0.smithi144.stderr: 2024-06-04T16:13:55.833 INFO:tasks.workunit.client.0.smithi144.stderr:BUCKET_STATS: 2024-06-04T16:13:55.833 INFO:tasks.workunit.client.0.smithi144.stderr:bucket: myver id: be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18 num_objects: 0 size_kb: 0 num_shards: 11 2024-06-04T16:13:55.833 INFO:tasks.workunit.client.0.smithi144.stderr: 2024-06-04T16:13:55.835 INFO:tasks.workunit.client.0.smithi144.stderr:radosgw-admin bucket reshard --bucket myver --num-shards 12 2024-06-04T16:13:55.865 INFO:tasks.workunit.client.0.smithi144.stderr:ignoring --setuser ceph since I am not root 2024-06-04T16:13:55.865 INFO:tasks.workunit.client.0.smithi144.stderr:ignoring --setgroup ceph since I am not root 2024-06-04T16:13:55.902 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.901+0000 7f90a883d800 20 rados->read ofs=0 len=0 2024-06-04T16:13:55.903 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.902+0000 7f90a883d800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:13:55.904 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.902+0000 7f90a883d800 20 realm 2024-06-04T16:13:55.904 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.902+0000 7f90a883d800 20 rados->read ofs=0 len=0 2024-06-04T16:13:55.904 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.903+0000 7f90a883d800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:13:55.904 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.903+0000 7f90a883d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-06-04T16:13:55.904 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.903+0000 7f90a883d800 20 rados->read ofs=0 len=0 2024-06-04T16:13:55.904 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.903+0000 7f90a883d800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:13:55.904 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.903+0000 7f90a883d800 20 rados->read ofs=0 len=0 2024-06-04T16:13:55.904 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.903+0000 7f90a883d800 20 rados_obj.operate() r=0 bl.length=46 2024-06-04T16:13:55.904 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.903+0000 7f90a883d800 20 rados->read ofs=0 len=0 2024-06-04T16:13:55.905 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.904+0000 7f90a883d800 20 rados_obj.operate() r=0 bl.length=1139 2024-06-04T16:13:55.905 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.904+0000 7f90a883d800 20 searching for the correct realm 2024-06-04T16:13:55.907 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:55.906+0000 7f90a6b33640 0 -- 172.21.15.144:0/1984641846 >> [v2:172.21.15.144:6800/1453747520,v1:172.21.15.144:6801/1453747520] conn(0x7f90900dd070 msgr2=0x7f90900cb150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-06-04T16:13:56.112 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.111+0000 7f90a6b33640 0 -- 172.21.15.144:0/1984641846 >> [v2:172.21.15.144:6824/166159729,v1:172.21.15.144:6825/166159729] conn(0x560e196e6030 msgr2=0x560e196e8420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-06-04T16:13:56.117 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.116+0000 7f90a883d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-06-04T16:13:56.117 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.116+0000 7f90a883d800 20 RGWRados::pool_iterate: got zone_info.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767 2024-06-04T16:13:56.117 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.116+0000 7f90a883d800 20 RGWRados::pool_iterate: got default.zone. 2024-06-04T16:13:56.117 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.116+0000 7f90a883d800 20 RGWRados::pool_iterate: got zonegroup_info.abb22408-c332-4e28-8f7a-ff254ea2fed2 2024-06-04T16:13:56.117 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.116+0000 7f90a883d800 20 RGWRados::pool_iterate: got zone_names.default 2024-06-04T16:13:56.117 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.116+0000 7f90a883d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-06-04T16:13:56.117 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.116+0000 7f90a883d800 20 rados->read ofs=0 len=0 2024-06-04T16:13:56.117 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.116+0000 7f90a883d800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:13:56.118 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.116+0000 7f90a883d800 20 rados->read ofs=0 len=0 2024-06-04T16:13:56.118 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.116+0000 7f90a883d800 20 rados_obj.operate() r=0 bl.length=46 2024-06-04T16:13:56.118 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.116+0000 7f90a883d800 20 rados->read ofs=0 len=0 2024-06-04T16:13:56.119 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.117+0000 7f90a883d800 20 rados_obj.operate() r=0 bl.length=470 2024-06-04T16:13:56.119 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.117+0000 7f90a883d800 20 zone default found 2024-06-04T16:13:56.119 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.117+0000 7f90a883d800 4 Realm: () 2024-06-04T16:13:56.119 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.117+0000 7f90a883d800 4 ZoneGroup: default (abb22408-c332-4e28-8f7a-ff254ea2fed2) 2024-06-04T16:13:56.119 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.117+0000 7f90a883d800 4 Zone: default (be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767) 2024-06-04T16:13:56.119 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.117+0000 7f90a883d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-06-04T16:13:56.119 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.117+0000 7f90a883d800 20 zonegroup default 2024-06-04T16:13:56.119 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.117+0000 7f90a883d800 20 rados->read ofs=0 len=0 2024-06-04T16:13:56.119 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.117+0000 7f90a883d800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:13:56.119 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.117+0000 7f90a883d800 20 rados->read ofs=0 len=0 2024-06-04T16:13:56.119 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.117+0000 7f90a883d800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:13:56.120 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.117+0000 7f90a883d800 20 rados->read ofs=0 len=0 2024-06-04T16:13:56.120 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.118+0000 7f90a883d800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:13:56.120 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.118+0000 7f90a883d800 20 started sync module instance, tier type = 2024-06-04T16:13:56.120 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.118+0000 7f90a883d800 20 started zone id=be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767 (name=default) with tier type = 2024-06-04T16:13:56.128 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.127+0000 7f90a883d800 20 add_watcher() i=0 2024-06-04T16:13:56.128 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.127+0000 7f90a883d800 20 add_watcher() i=1 2024-06-04T16:13:56.128 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.127+0000 7f90a883d800 20 add_watcher() i=2 2024-06-04T16:13:56.128 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.127+0000 7f90a883d800 20 add_watcher() i=3 2024-06-04T16:13:56.128 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.127+0000 7f90a883d800 20 add_watcher() i=4 2024-06-04T16:13:56.128 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.127+0000 7f90a883d800 20 add_watcher() i=5 2024-06-04T16:13:56.128 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.127+0000 7f90a883d800 20 add_watcher() i=6 2024-06-04T16:13:56.129 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.129+0000 7f90a883d800 20 add_watcher() i=7 2024-06-04T16:13:56.129 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.129+0000 7f90a883d800 2 all 8 watchers are set, enabling cache 2024-06-04T16:13:56.131 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.130+0000 7f8f5cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-06-04T16:13:56.131 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.130+0000 7f90a883d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-06-04T16:13:56.131 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.130+0000 7f90a883d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-06-04T16:13:56.131 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.130+0000 7f90a883d800 5 note: GC not initialized 2024-06-04T16:13:56.133 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.131+0000 7f8ed77fe640 20 reqs_thread_entry: start 2024-06-04T16:13:56.133 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.131+0000 7f90a883d800 20 init_complete bucket index max shards: 11 2024-06-04T16:13:56.133 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.131+0000 7f90a883d800 20 Filter name: none 2024-06-04T16:13:56.133 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.131+0000 7f8ed57fa640 20 reqs_thread_entry: start 2024-06-04T16:13:56.133 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.131+0000 7f90a883d800 10 cache get: name=default.rgw.meta+root+myver : miss 2024-06-04T16:13:56.133 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.131+0000 7f90a883d800 20 rados->read ofs=0 len=0 2024-06-04T16:13:56.133 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.131+0000 7f90a883d800 20 rados_obj.operate() r=0 bl.length=173 2024-06-04T16:13:56.133 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.131+0000 7f90a883d800 10 cache put: name=default.rgw.meta+root+myver info.flags=0x11 2024-06-04T16:13:56.133 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.131+0000 7f90a883d800 10 adding default.rgw.meta+root+myver to cache LRU end 2024-06-04T16:13:56.133 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.131+0000 7f90a883d800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18 : miss 2024-06-04T16:13:56.133 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.131+0000 7f90a883d800 20 rados->read ofs=0 len=0 2024-06-04T16:13:56.134 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.132+0000 7f90a883d800 20 rados_obj.operate() r=0 bl.length=387 2024-06-04T16:13:56.134 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.132+0000 7f90a883d800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18 info.flags=0x17 2024-06-04T16:13:56.134 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.132+0000 7f90a883d800 10 adding default.rgw.meta+root+.bucket.meta.myver:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18 to cache LRU end 2024-06-04T16:13:56.134 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.132+0000 7f90a883d800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-06-04T16:13:56.134 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.132+0000 7f90a883d800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-06-04T16:13:56.134 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.132+0000 7f90a883d800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18 2024-06-04T16:13:56.138 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.137+0000 7f90a883d800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18 info.flags=0x17 2024-06-04T16:13:56.138 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.137+0000 7f90a883d800 10 moving default.rgw.meta+root+.bucket.meta.myver:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18 to cache LRU end 2024-06-04T16:13:56.138 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.137+0000 7f90a883d800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-06-04T16:13:56.138 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.137+0000 7f90a883d800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18, ofs0, ns] 2024-06-04T16:13:56.138 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.137+0000 7f8f897fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1078036791390 cookie 94618556230288 notifier 7029 bl.length()=813 2024-06-04T16:13:56.138 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.137+0000 7f8f897fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18 info.flags=0x17 2024-06-04T16:13:56.138 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.137+0000 7f8f897fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18 to cache LRU end 2024-06-04T16:13:56.138 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.137+0000 7f8f897fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-06-04T16:13:56.139 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.138+0000 7f90a883d800 20 handle_bi_update(): bucket=:myver[be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18]): orig_sources= new_sources= 2024-06-04T16:13:56.139 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.138+0000 7f90a883d800 20 handle_bi_update(): bucket=:myver[be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18]): potential sources added=[] removed=[] 2024-06-04T16:13:56.139 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.138+0000 7f90a883d800 20 handle_bi_update(): bucket=:myver[be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18]): orig_dests= new_dests= 2024-06-04T16:13:56.139 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.138+0000 7f90a883d800 20 handle_bi_update(): bucket=:myver[be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18]): potential dests added=[] removed=[] 2024-06-04T16:13:56.141 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.140+0000 7f90a883d800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18.1.0 2024-06-04T16:13:56.141 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.140+0000 7f90a883d800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18.1.0 2024-06-04T16:13:56.141 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.140+0000 7f90a883d800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18.1.1 2024-06-04T16:13:56.141 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.140+0000 7f90a883d800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18.1.1 2024-06-04T16:13:56.142 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.140+0000 7f90a883d800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18.1.2 2024-06-04T16:13:56.142 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.140+0000 7f90a883d800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18.1.2 2024-06-04T16:13:56.142 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.140+0000 7f90a883d800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18.1.3 2024-06-04T16:13:56.142 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.140+0000 7f90a883d800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18.1.3 2024-06-04T16:13:56.142 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.140+0000 7f90a883d800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18.1.4 2024-06-04T16:13:56.142 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.140+0000 7f90a883d800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18.1.4 2024-06-04T16:13:56.142 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.140+0000 7f90a883d800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18.1.5 2024-06-04T16:13:56.142 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.140+0000 7f90a883d800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18.1.5 2024-06-04T16:13:56.142 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.140+0000 7f90a883d800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18.1.6 2024-06-04T16:13:56.142 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.140+0000 7f90a883d800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18.1.6 2024-06-04T16:13:56.142 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.140+0000 7f90a883d800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18.1.7 2024-06-04T16:13:56.142 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.140+0000 7f90a883d800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18.1.7 2024-06-04T16:13:56.142 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.140+0000 7f90a883d800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18.1.8 2024-06-04T16:13:56.143 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.140+0000 7f90a883d800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18.1.8 2024-06-04T16:13:56.143 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.140+0000 7f90a883d800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18.1.9 2024-06-04T16:13:56.143 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.140+0000 7f90a883d800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18.1.9 2024-06-04T16:13:56.143 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.140+0000 7f90a883d800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18.1.10 2024-06-04T16:13:56.143 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.140+0000 7f90a883d800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18.1.10 2024-06-04T16:13:56.143 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.140+0000 7f90a883d800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18.1.11 2024-06-04T16:13:56.143 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.140+0000 7f90a883d800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18.1.11 2024-06-04T16:13:56.143 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.140+0000 7f90a883d800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18.0 2024-06-04T16:13:56.143 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.140+0000 7f90a883d800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18.1 2024-06-04T16:13:56.144 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.141+0000 7f90a883d800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18.2 2024-06-04T16:13:56.144 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.141+0000 7f90a883d800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18.3 2024-06-04T16:13:56.144 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.142+0000 7f90a883d800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18.4 2024-06-04T16:13:56.144 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.142+0000 7f90a883d800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18.5 2024-06-04T16:13:56.144 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.143+0000 7f90a883d800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18.6 2024-06-04T16:13:56.144 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.143+0000 7f90a883d800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18.7 2024-06-04T16:13:56.145 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.144+0000 7f90a883d800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18.8 2024-06-04T16:13:56.145 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.144+0000 7f90a883d800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18.9 2024-06-04T16:13:56.145 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.144+0000 7f90a883d800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18.10 2024-06-04T16:13:56.145 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.145+0000 7f90a883d800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18 : hit (requested=0x17, cached=0x17) 2024-06-04T16:13:56.145 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.145+0000 7f90a883d800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18 2024-06-04T16:13:56.147 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.146+0000 7f90a883d800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18 info.flags=0x17 2024-06-04T16:13:56.147 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.146+0000 7f90a883d800 10 moving default.rgw.meta+root+.bucket.meta.myver:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18 to cache LRU end 2024-06-04T16:13:56.147 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.146+0000 7f90a883d800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-06-04T16:13:56.147 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.146+0000 7f90a883d800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18, ofs0, ns] 2024-06-04T16:13:56.148 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.146+0000 7f8f897fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1078036791391 cookie 94618556230288 notifier 7029 bl.length()=781 2024-06-04T16:13:56.148 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.146+0000 7f8f897fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18 info.flags=0x17 2024-06-04T16:13:56.148 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.146+0000 7f8f897fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18 to cache LRU end 2024-06-04T16:13:56.148 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.146+0000 7f8f897fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-06-04T16:13:56.148 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.147+0000 7f90a883d800 20 handle_bi_update(): bucket=:myver[be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18]): orig_sources= new_sources= 2024-06-04T16:13:56.148 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.147+0000 7f90a883d800 20 handle_bi_update(): bucket=:myver[be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18]): potential sources added=[] removed=[] 2024-06-04T16:13:56.148 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.147+0000 7f90a883d800 20 handle_bi_update(): bucket=:myver[be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18]): orig_dests= new_dests= 2024-06-04T16:13:56.148 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.147+0000 7f90a883d800 20 handle_bi_update(): bucket=:myver[be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18]): potential dests added=[] removed=[] 2024-06-04T16:13:56.150 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.149+0000 7f90a883d800 1 execute INFO: reshard of bucket "myver" completed successfully 2024-06-04T16:13:56.151 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.151+0000 7f8f5cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-06-04T16:13:56.154 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.153+0000 7f90a883d800 20 remove_watcher() i=0 2024-06-04T16:13:56.154 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.153+0000 7f90a883d800 2 removed watcher, disabling cache 2024-06-04T16:13:56.155 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.154+0000 7f90a883d800 20 remove_watcher() i=1 2024-06-04T16:13:56.156 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.155+0000 7f90a883d800 20 remove_watcher() i=2 2024-06-04T16:13:56.157 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.156+0000 7f90a883d800 20 remove_watcher() i=3 2024-06-04T16:13:56.158 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.157+0000 7f90a883d800 20 remove_watcher() i=4 2024-06-04T16:13:56.159 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.158+0000 7f90a883d800 20 remove_watcher() i=5 2024-06-04T16:13:56.160 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.159+0000 7f90a883d800 20 remove_watcher() i=6 2024-06-04T16:13:56.161 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.160+0000 7f90a883d800 20 remove_watcher() i=7 2024-06-04T16:13:56.173 INFO:tasks.workunit.client.0.smithi144.stderr:radosgw-admin bucket stats --bucket myver 2024-06-04T16:13:56.200 INFO:tasks.workunit.client.0.smithi144.stderr:ignoring --setuser ceph since I am not root 2024-06-04T16:13:56.200 INFO:tasks.workunit.client.0.smithi144.stderr:ignoring --setgroup ceph since I am not root 2024-06-04T16:13:56.237 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.236+0000 7f62dba11800 20 rados->read ofs=0 len=0 2024-06-04T16:13:56.239 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.238+0000 7f62dba11800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:13:56.239 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.238+0000 7f62dba11800 20 realm 2024-06-04T16:13:56.240 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.238+0000 7f62dba11800 20 rados->read ofs=0 len=0 2024-06-04T16:13:56.240 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.238+0000 7f62dba11800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:13:56.240 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.238+0000 7f62dba11800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-06-04T16:13:56.240 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.238+0000 7f62dba11800 20 rados->read ofs=0 len=0 2024-06-04T16:13:56.240 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.239+0000 7f62dba11800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:13:56.240 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.239+0000 7f62dba11800 20 rados->read ofs=0 len=0 2024-06-04T16:13:56.241 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.239+0000 7f62dba11800 20 rados_obj.operate() r=0 bl.length=46 2024-06-04T16:13:56.241 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.239+0000 7f62dba11800 20 rados->read ofs=0 len=0 2024-06-04T16:13:56.241 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.240+0000 7f62dba11800 20 rados_obj.operate() r=0 bl.length=1139 2024-06-04T16:13:56.241 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.240+0000 7f62dba11800 20 searching for the correct realm 2024-06-04T16:13:56.241 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.240+0000 7f62d7160640 0 -- 172.21.15.144:0/1604001822 >> [v2:172.21.15.177:6816/2039473917,v1:172.21.15.177:6817/2039473917] conn(0x55dc85ddb680 msgr2=0x55dc85dddb40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-06-04T16:13:56.446 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.445+0000 7f62d7160640 0 -- 172.21.15.144:0/1604001822 >> [v2:172.21.15.177:6800/3891611393,v1:172.21.15.177:6801/3891611393] conn(0x7f62c8057040 msgr2=0x7f62c806c400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-06-04T16:13:56.454 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.453+0000 7f62dba11800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-06-04T16:13:56.454 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.453+0000 7f62dba11800 20 RGWRados::pool_iterate: got zone_info.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767 2024-06-04T16:13:56.454 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.453+0000 7f62dba11800 20 RGWRados::pool_iterate: got default.zone. 2024-06-04T16:13:56.454 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.453+0000 7f62dba11800 20 RGWRados::pool_iterate: got zonegroup_info.abb22408-c332-4e28-8f7a-ff254ea2fed2 2024-06-04T16:13:56.454 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.453+0000 7f62dba11800 20 RGWRados::pool_iterate: got zone_names.default 2024-06-04T16:13:56.454 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.453+0000 7f62dba11800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-06-04T16:13:56.454 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.453+0000 7f62dba11800 20 rados->read ofs=0 len=0 2024-06-04T16:13:56.454 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.453+0000 7f62dba11800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:13:56.455 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.453+0000 7f62dba11800 20 rados->read ofs=0 len=0 2024-06-04T16:13:56.456 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.454+0000 7f62dba11800 20 rados_obj.operate() r=0 bl.length=46 2024-06-04T16:13:56.456 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.454+0000 7f62dba11800 20 rados->read ofs=0 len=0 2024-06-04T16:13:56.456 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.454+0000 7f62dba11800 20 rados_obj.operate() r=0 bl.length=470 2024-06-04T16:13:56.456 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.454+0000 7f62dba11800 20 zone default found 2024-06-04T16:13:56.456 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.454+0000 7f62dba11800 4 Realm: () 2024-06-04T16:13:56.456 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.454+0000 7f62dba11800 4 ZoneGroup: default (abb22408-c332-4e28-8f7a-ff254ea2fed2) 2024-06-04T16:13:56.456 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.454+0000 7f62dba11800 4 Zone: default (be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767) 2024-06-04T16:13:56.456 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.454+0000 7f62dba11800 10 cannot find current period zonegroup using local zonegroup configuration 2024-06-04T16:13:56.457 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.454+0000 7f62dba11800 20 zonegroup default 2024-06-04T16:13:56.457 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.454+0000 7f62dba11800 20 rados->read ofs=0 len=0 2024-06-04T16:13:56.457 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.454+0000 7f62dba11800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:13:56.457 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.454+0000 7f62dba11800 20 rados->read ofs=0 len=0 2024-06-04T16:13:56.457 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.455+0000 7f62dba11800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:13:56.457 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.455+0000 7f62dba11800 20 rados->read ofs=0 len=0 2024-06-04T16:13:56.457 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.455+0000 7f62dba11800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:13:56.457 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.455+0000 7f62dba11800 20 started sync module instance, tier type = 2024-06-04T16:13:56.457 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.455+0000 7f62dba11800 20 started zone id=be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767 (name=default) with tier type = 2024-06-04T16:13:56.465 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.464+0000 7f62dba11800 20 add_watcher() i=0 2024-06-04T16:13:56.465 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.464+0000 7f62dba11800 20 add_watcher() i=1 2024-06-04T16:13:56.465 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.464+0000 7f62dba11800 20 add_watcher() i=2 2024-06-04T16:13:56.465 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.464+0000 7f62dba11800 20 add_watcher() i=3 2024-06-04T16:13:56.465 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.464+0000 7f62dba11800 20 add_watcher() i=4 2024-06-04T16:13:56.465 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.464+0000 7f62dba11800 20 add_watcher() i=5 2024-06-04T16:13:56.465 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.464+0000 7f62dba11800 20 add_watcher() i=6 2024-06-04T16:13:56.466 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.465+0000 7f62dba11800 20 add_watcher() i=7 2024-06-04T16:13:56.466 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.465+0000 7f62dba11800 2 all 8 watchers are set, enabling cache 2024-06-04T16:13:56.467 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.467+0000 7f618dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-06-04T16:13:56.468 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.467+0000 7f62dba11800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-06-04T16:13:56.468 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.467+0000 7f62dba11800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-06-04T16:13:56.468 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.467+0000 7f62dba11800 5 note: GC not initialized 2024-06-04T16:13:56.469 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.467+0000 7f618cfe1640 20 reqs_thread_entry: start 2024-06-04T16:13:56.469 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.467+0000 7f62dba11800 20 init_complete bucket index max shards: 11 2024-06-04T16:13:56.469 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.467+0000 7f62dba11800 20 Filter name: none 2024-06-04T16:13:56.469 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.467+0000 7f61067fc640 20 reqs_thread_entry: start 2024-06-04T16:13:56.469 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.467+0000 7f62dba11800 20 rados->read ofs=0 len=0 2024-06-04T16:13:56.470 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.468+0000 7f62dba11800 20 rados_obj.operate() r=0 bl.length=173 2024-06-04T16:13:56.470 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.468+0000 7f62dba11800 20 rados->read ofs=0 len=0 2024-06-04T16:13:56.470 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.468+0000 7f62dba11800 20 rados_obj.operate() r=0 bl.length=387 2024-06-04T16:13:56.470 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.468+0000 7f62dba11800 20 couldn't put binfo cache entry, might have raced with data changes 2024-06-04T16:13:56.470 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.468+0000 7f62dba11800 20 rados->read ofs=0 len=0 2024-06-04T16:13:56.470 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.469+0000 7f62dba11800 20 rados_obj.operate() r=0 bl.length=173 2024-06-04T16:13:56.470 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.469+0000 7f62dba11800 20 rados->read ofs=0 len=0 2024-06-04T16:13:56.470 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.469+0000 7f62dba11800 20 rados_obj.operate() r=0 bl.length=387 2024-06-04T16:13:56.470 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.469+0000 7f62dba11800 20 couldn't put binfo cache entry, might have raced with data changes 2024-06-04T16:13:56.472 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.471+0000 7f618dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-06-04T16:13:56.474 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.473+0000 7f62dba11800 20 remove_watcher() i=0 2024-06-04T16:13:56.474 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.473+0000 7f62dba11800 2 removed watcher, disabling cache 2024-06-04T16:13:56.475 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.474+0000 7f62dba11800 20 remove_watcher() i=1 2024-06-04T16:13:56.476 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.475+0000 7f62dba11800 20 remove_watcher() i=2 2024-06-04T16:13:56.477 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.476+0000 7f62dba11800 20 remove_watcher() i=3 2024-06-04T16:13:56.478 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.477+0000 7f62dba11800 20 remove_watcher() i=4 2024-06-04T16:13:56.479 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.478+0000 7f62dba11800 20 remove_watcher() i=5 2024-06-04T16:13:56.480 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.479+0000 7f62dba11800 20 remove_watcher() i=6 2024-06-04T16:13:56.481 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.480+0000 7f62dba11800 20 remove_watcher() i=7 2024-06-04T16:13:56.492 INFO:tasks.workunit.client.0.smithi144.stderr: 2024-06-04T16:13:56.492 INFO:tasks.workunit.client.0.smithi144.stderr:BUCKET_STATS: 2024-06-04T16:13:56.492 INFO:tasks.workunit.client.0.smithi144.stderr:bucket: myver id: be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18 num_objects: 0 size_kb: 0 num_shards: 12 2024-06-04T16:13:56.492 INFO:tasks.workunit.client.0.smithi144.stderr: 2024-06-04T16:13:56.494 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:13:56.494 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:13:56.497 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:13:56.497 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:13:56.539 INFO:tasks.workunit.client.0.smithi144.stderr: test: reshard removes olh entries with empty name 2024-06-04T16:13:56.541 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:13:56.541 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:13:56.588 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:13:56.589 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:13:56.632 INFO:tasks.workunit.client.0.smithi144.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-06-04T16:13:56.660 INFO:tasks.workunit.client.0.smithi144.stderr:ignoring --setuser ceph since I am not root 2024-06-04T16:13:56.660 INFO:tasks.workunit.client.0.smithi144.stderr:ignoring --setgroup ceph since I am not root 2024-06-04T16:13:56.897 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.896+0000 7f517e6d9640 0 --2- 172.21.15.144:0/3381276705 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x5618e5500920 0x5618e550c180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2024-06-04T16:13:56.898 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.898+0000 7f5183123800 20 rados->read ofs=0 len=0 2024-06-04T16:13:56.900 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.900+0000 7f5183123800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:13:56.900 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.900+0000 7f5183123800 20 realm 2024-06-04T16:13:56.900 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.900+0000 7f5183123800 20 rados->read ofs=0 len=0 2024-06-04T16:13:56.901 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.900+0000 7f5183123800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:13:56.901 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.900+0000 7f5183123800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-06-04T16:13:56.901 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.900+0000 7f5183123800 20 rados->read ofs=0 len=0 2024-06-04T16:13:56.901 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.900+0000 7f5183123800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:13:56.901 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.900+0000 7f5183123800 20 rados->read ofs=0 len=0 2024-06-04T16:13:56.902 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.901+0000 7f5183123800 20 rados_obj.operate() r=0 bl.length=46 2024-06-04T16:13:56.902 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.901+0000 7f5183123800 20 rados->read ofs=0 len=0 2024-06-04T16:13:56.902 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.901+0000 7f5183123800 20 rados_obj.operate() r=0 bl.length=1139 2024-06-04T16:13:56.902 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.901+0000 7f5183123800 20 searching for the correct realm 2024-06-04T16:13:56.903 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.902+0000 7f517eeda640 0 -- 172.21.15.144:0/3381276705 >> [v2:172.21.15.177:6816/2039473917,v1:172.21.15.177:6817/2039473917] conn(0x5618e5527c00 msgr2=0x5618e552a0a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-06-04T16:13:56.906 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.905+0000 7f517eeda640 0 -- 172.21.15.144:0/3381276705 >> [v2:172.21.15.177:6800/3891611393,v1:172.21.15.177:6801/3891611393] conn(0x7f5170024070 msgr2=0x7f517008f0d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-06-04T16:13:56.913 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.912+0000 7f5183123800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-06-04T16:13:56.913 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.912+0000 7f5183123800 20 RGWRados::pool_iterate: got zone_info.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767 2024-06-04T16:13:56.913 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.912+0000 7f5183123800 20 RGWRados::pool_iterate: got default.zone. 2024-06-04T16:13:56.913 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.912+0000 7f5183123800 20 RGWRados::pool_iterate: got zonegroup_info.abb22408-c332-4e28-8f7a-ff254ea2fed2 2024-06-04T16:13:56.914 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.912+0000 7f5183123800 20 RGWRados::pool_iterate: got zone_names.default 2024-06-04T16:13:56.914 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.912+0000 7f5183123800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-06-04T16:13:56.914 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.912+0000 7f5183123800 20 rados->read ofs=0 len=0 2024-06-04T16:13:56.914 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.912+0000 7f5183123800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:13:56.914 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.912+0000 7f5183123800 20 rados->read ofs=0 len=0 2024-06-04T16:13:56.914 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.913+0000 7f5183123800 20 rados_obj.operate() r=0 bl.length=46 2024-06-04T16:13:56.914 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.913+0000 7f5183123800 20 rados->read ofs=0 len=0 2024-06-04T16:13:56.915 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.913+0000 7f5183123800 20 rados_obj.operate() r=0 bl.length=470 2024-06-04T16:13:56.915 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.913+0000 7f5183123800 20 zone default found 2024-06-04T16:13:56.915 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.913+0000 7f5183123800 4 Realm: () 2024-06-04T16:13:56.915 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.913+0000 7f5183123800 4 ZoneGroup: default (abb22408-c332-4e28-8f7a-ff254ea2fed2) 2024-06-04T16:13:56.915 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.913+0000 7f5183123800 4 Zone: default (be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767) 2024-06-04T16:13:56.915 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.913+0000 7f5183123800 10 cannot find current period zonegroup using local zonegroup configuration 2024-06-04T16:13:56.915 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.913+0000 7f5183123800 20 zonegroup default 2024-06-04T16:13:56.916 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.913+0000 7f5183123800 20 rados->read ofs=0 len=0 2024-06-04T16:13:56.916 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.913+0000 7f5183123800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:13:56.916 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.913+0000 7f5183123800 20 rados->read ofs=0 len=0 2024-06-04T16:13:56.916 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.914+0000 7f5183123800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:13:56.916 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.914+0000 7f5183123800 20 rados->read ofs=0 len=0 2024-06-04T16:13:56.916 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.914+0000 7f5183123800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:13:56.916 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.914+0000 7f5183123800 20 started sync module instance, tier type = 2024-06-04T16:13:56.916 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.914+0000 7f5183123800 20 started zone id=be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767 (name=default) with tier type = 2024-06-04T16:13:56.925 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.924+0000 7f5183123800 20 add_watcher() i=0 2024-06-04T16:13:56.925 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.924+0000 7f5183123800 20 add_watcher() i=1 2024-06-04T16:13:56.925 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.924+0000 7f5183123800 20 add_watcher() i=2 2024-06-04T16:13:56.925 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.924+0000 7f5183123800 20 add_watcher() i=3 2024-06-04T16:13:56.925 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.924+0000 7f5183123800 20 add_watcher() i=4 2024-06-04T16:13:56.925 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.924+0000 7f5183123800 20 add_watcher() i=5 2024-06-04T16:13:56.925 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.924+0000 7f5183123800 20 add_watcher() i=6 2024-06-04T16:13:56.925 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.925+0000 7f5183123800 20 add_watcher() i=7 2024-06-04T16:13:56.926 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.925+0000 7f5183123800 2 all 8 watchers are set, enabling cache 2024-06-04T16:13:56.927 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.926+0000 7f50357e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-06-04T16:13:56.928 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.927+0000 7f5183123800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-06-04T16:13:56.928 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.927+0000 7f5183123800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-06-04T16:13:56.928 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.927+0000 7f5183123800 5 note: GC not initialized 2024-06-04T16:13:56.928 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.927+0000 7f4faffff640 20 reqs_thread_entry: start 2024-06-04T16:13:56.928 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.927+0000 7f5183123800 20 init_complete bucket index max shards: 11 2024-06-04T16:13:56.928 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.927+0000 7f5183123800 20 Filter name: none 2024-06-04T16:13:56.928 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.927+0000 7f4fadffb640 20 reqs_thread_entry: start 2024-06-04T16:13:56.929 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.927+0000 7f5183123800 20 rados->read ofs=0 len=0 2024-06-04T16:13:56.929 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.928+0000 7f5183123800 20 rados_obj.operate() r=0 bl.length=176 2024-06-04T16:13:56.930 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.928+0000 7f5183123800 20 rados->read ofs=0 len=0 2024-06-04T16:13:56.930 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.928+0000 7f5183123800 20 rados_obj.operate() r=0 bl.length=390 2024-06-04T16:13:56.930 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.928+0000 7f5183123800 20 couldn't put binfo cache entry, might have raced with data changes 2024-06-04T16:13:56.930 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.928+0000 7f5183123800 20 rados->read ofs=0 len=0 2024-06-04T16:13:56.930 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.928+0000 7f5183123800 20 rados_obj.operate() r=0 bl.length=176 2024-06-04T16:13:56.930 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.928+0000 7f5183123800 20 rados->read ofs=0 len=0 2024-06-04T16:13:56.930 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.929+0000 7f5183123800 20 rados_obj.operate() r=0 bl.length=390 2024-06-04T16:13:56.930 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.929+0000 7f5183123800 20 couldn't put binfo cache entry, might have raced with data changes 2024-06-04T16:13:56.932 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.931+0000 7f50357e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-06-04T16:13:56.934 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.933+0000 7f5183123800 20 remove_watcher() i=0 2024-06-04T16:13:56.934 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.933+0000 7f5183123800 2 removed watcher, disabling cache 2024-06-04T16:13:56.935 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.934+0000 7f5183123800 20 remove_watcher() i=1 2024-06-04T16:13:56.936 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.935+0000 7f5183123800 20 remove_watcher() i=2 2024-06-04T16:13:56.937 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.936+0000 7f5183123800 20 remove_watcher() i=3 2024-06-04T16:13:56.938 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.937+0000 7f5183123800 20 remove_watcher() i=4 2024-06-04T16:13:56.939 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.938+0000 7f5183123800 20 remove_watcher() i=5 2024-06-04T16:13:56.940 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.939+0000 7f5183123800 20 remove_watcher() i=6 2024-06-04T16:13:56.941 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:56.940+0000 7f5183123800 20 remove_watcher() i=7 2024-06-04T16:13:56.951 INFO:tasks.workunit.client.0.smithi144.stderr: 2024-06-04T16:13:56.951 INFO:tasks.workunit.client.0.smithi144.stderr:BUCKET_STATS: 2024-06-04T16:13:56.951 INFO:tasks.workunit.client.0.smithi144.stderr:bucket: a-bucket id: be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.17 num_objects: 0 size_kb: 0 num_shards: 13 2024-06-04T16:13:56.951 INFO:tasks.workunit.client.0.smithi144.stderr: 2024-06-04T16:13:56.953 INFO:tasks.workunit.client.0.smithi144.stderr:radosgw-admin bucket layout --bucket a-bucket 2024-06-04T16:13:56.981 INFO:tasks.workunit.client.0.smithi144.stderr:ignoring --setuser ceph since I am not root 2024-06-04T16:13:56.981 INFO:tasks.workunit.client.0.smithi144.stderr:ignoring --setgroup ceph since I am not root 2024-06-04T16:13:57.019 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.018+0000 7f352e12c800 20 rados->read ofs=0 len=0 2024-06-04T16:13:57.021 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.020+0000 7f352e12c800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:13:57.021 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.020+0000 7f352e12c800 20 realm 2024-06-04T16:13:57.021 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.020+0000 7f352e12c800 20 rados->read ofs=0 len=0 2024-06-04T16:13:57.021 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.020+0000 7f352e12c800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:13:57.021 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.020+0000 7f352e12c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-06-04T16:13:57.022 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.020+0000 7f352e12c800 20 rados->read ofs=0 len=0 2024-06-04T16:13:57.022 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.020+0000 7f352e12c800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:13:57.022 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.020+0000 7f352e12c800 20 rados->read ofs=0 len=0 2024-06-04T16:13:57.022 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.021+0000 7f352e12c800 20 rados_obj.operate() r=0 bl.length=46 2024-06-04T16:13:57.022 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.021+0000 7f352e12c800 20 rados->read ofs=0 len=0 2024-06-04T16:13:57.023 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.022+0000 7f352e12c800 20 rados_obj.operate() r=0 bl.length=1139 2024-06-04T16:13:57.023 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.022+0000 7f352e12c800 20 searching for the correct realm 2024-06-04T16:13:57.025 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.024+0000 7f352a5e9640 0 -- 172.21.15.144:0/813747867 >> [v2:172.21.15.144:6800/1453747520,v1:172.21.15.144:6801/1453747520] conn(0x7f351401f050 msgr2=0x7f35140a2a60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-06-04T16:13:57.230 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.229+0000 7f352a5e9640 0 -- 172.21.15.144:0/813747867 >> [v2:172.21.15.144:6824/166159729,v1:172.21.15.144:6825/166159729] conn(0x55c031777380 msgr2=0x55c031779770 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-06-04T16:13:57.235 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.234+0000 7f352e12c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-06-04T16:13:57.235 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.234+0000 7f352e12c800 20 RGWRados::pool_iterate: got zone_info.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767 2024-06-04T16:13:57.235 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.234+0000 7f352e12c800 20 RGWRados::pool_iterate: got default.zone. 2024-06-04T16:13:57.235 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.234+0000 7f352e12c800 20 RGWRados::pool_iterate: got zonegroup_info.abb22408-c332-4e28-8f7a-ff254ea2fed2 2024-06-04T16:13:57.235 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.234+0000 7f352e12c800 20 RGWRados::pool_iterate: got zone_names.default 2024-06-04T16:13:57.235 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.234+0000 7f352e12c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-06-04T16:13:57.235 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.234+0000 7f352e12c800 20 rados->read ofs=0 len=0 2024-06-04T16:13:57.236 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.234+0000 7f352e12c800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:13:57.236 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.234+0000 7f352e12c800 20 rados->read ofs=0 len=0 2024-06-04T16:13:57.236 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.235+0000 7f352e12c800 20 rados_obj.operate() r=0 bl.length=46 2024-06-04T16:13:57.237 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.235+0000 7f352e12c800 20 rados->read ofs=0 len=0 2024-06-04T16:13:57.237 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.235+0000 7f352e12c800 20 rados_obj.operate() r=0 bl.length=470 2024-06-04T16:13:57.237 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.235+0000 7f352e12c800 20 zone default found 2024-06-04T16:13:57.237 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.235+0000 7f352e12c800 4 Realm: () 2024-06-04T16:13:57.237 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.235+0000 7f352e12c800 4 ZoneGroup: default (abb22408-c332-4e28-8f7a-ff254ea2fed2) 2024-06-04T16:13:57.237 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.235+0000 7f352e12c800 4 Zone: default (be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767) 2024-06-04T16:13:57.237 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.235+0000 7f352e12c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-06-04T16:13:57.237 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.235+0000 7f352e12c800 20 zonegroup default 2024-06-04T16:13:57.237 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.235+0000 7f352e12c800 20 rados->read ofs=0 len=0 2024-06-04T16:13:57.237 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.235+0000 7f352e12c800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:13:57.237 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.235+0000 7f352e12c800 20 rados->read ofs=0 len=0 2024-06-04T16:13:57.237 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.236+0000 7f352e12c800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:13:57.237 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.236+0000 7f352e12c800 20 rados->read ofs=0 len=0 2024-06-04T16:13:57.238 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.236+0000 7f352e12c800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:13:57.238 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.236+0000 7f352e12c800 20 started sync module instance, tier type = 2024-06-04T16:13:57.238 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.236+0000 7f352e12c800 20 started zone id=be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767 (name=default) with tier type = 2024-06-04T16:13:57.247 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.246+0000 7f352e12c800 20 add_watcher() i=0 2024-06-04T16:13:57.247 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.246+0000 7f352e12c800 20 add_watcher() i=1 2024-06-04T16:13:57.247 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.246+0000 7f352e12c800 20 add_watcher() i=2 2024-06-04T16:13:57.247 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.246+0000 7f352e12c800 20 add_watcher() i=3 2024-06-04T16:13:57.247 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.246+0000 7f352e12c800 20 add_watcher() i=4 2024-06-04T16:13:57.247 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.246+0000 7f352e12c800 20 add_watcher() i=5 2024-06-04T16:13:57.247 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.246+0000 7f352e12c800 20 add_watcher() i=6 2024-06-04T16:13:57.248 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.247+0000 7f352e12c800 20 add_watcher() i=7 2024-06-04T16:13:57.248 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.247+0000 7f352e12c800 2 all 8 watchers are set, enabling cache 2024-06-04T16:13:57.250 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.249+0000 7f33db7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-06-04T16:13:57.251 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.249+0000 7f352e12c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-06-04T16:13:57.251 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.249+0000 7f352e12c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-06-04T16:13:57.251 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.249+0000 7f352e12c800 5 note: GC not initialized 2024-06-04T16:13:57.251 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.250+0000 7f33da7fc640 20 reqs_thread_entry: start 2024-06-04T16:13:57.251 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.250+0000 7f352e12c800 20 init_complete bucket index max shards: 11 2024-06-04T16:13:57.251 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.250+0000 7f352e12c800 20 Filter name: none 2024-06-04T16:13:57.251 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.250+0000 7f334bfff640 20 reqs_thread_entry: start 2024-06-04T16:13:57.251 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.250+0000 7f352e12c800 20 rados->read ofs=0 len=0 2024-06-04T16:13:57.252 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.250+0000 7f352e12c800 20 rados_obj.operate() r=0 bl.length=176 2024-06-04T16:13:57.252 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.250+0000 7f352e12c800 20 rados->read ofs=0 len=0 2024-06-04T16:13:57.252 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.250+0000 7f352e12c800 20 rados_obj.operate() r=0 bl.length=390 2024-06-04T16:13:57.252 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.250+0000 7f352e12c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-06-04T16:13:57.252 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.251+0000 7f33db7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-06-04T16:13:57.254 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.254+0000 7f352e12c800 20 remove_watcher() i=0 2024-06-04T16:13:57.254 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.254+0000 7f352e12c800 2 removed watcher, disabling cache 2024-06-04T16:13:57.255 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.255+0000 7f352e12c800 20 remove_watcher() i=1 2024-06-04T16:13:57.256 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.256+0000 7f352e12c800 20 remove_watcher() i=2 2024-06-04T16:13:57.257 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.257+0000 7f352e12c800 20 remove_watcher() i=3 2024-06-04T16:13:57.258 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.258+0000 7f352e12c800 20 remove_watcher() i=4 2024-06-04T16:13:57.259 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.259+0000 7f352e12c800 20 remove_watcher() i=5 2024-06-04T16:13:57.260 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.260+0000 7f352e12c800 20 remove_watcher() i=6 2024-06-04T16:13:57.261 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.261+0000 7f352e12c800 20 remove_watcher() i=7 2024-06-04T16:13:57.273 INFO:tasks.workunit.client.0.smithi144.stderr:rados -p default.rgw.buckets.index setomapval .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.17.2.0 --omap-key-file /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/olh_noname_key < /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/olh_noname_val 2024-06-04T16:13:57.299 INFO:tasks.workunit.client.0.smithi144.stderr:ignoring --setuser ceph since I am not root 2024-06-04T16:13:57.299 INFO:tasks.workunit.client.0.smithi144.stderr:ignoring --setgroup ceph since I am not root 2024-06-04T16:13:57.315 INFO:tasks.workunit.client.0.smithi144.stderr:radosgw-admin bi list --bucket a-bucket 2024-06-04T16:13:57.343 INFO:tasks.workunit.client.0.smithi144.stderr:ignoring --setuser ceph since I am not root 2024-06-04T16:13:57.343 INFO:tasks.workunit.client.0.smithi144.stderr:ignoring --setgroup ceph since I am not root 2024-06-04T16:13:57.379 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.378+0000 7f37bb523800 20 rados->read ofs=0 len=0 2024-06-04T16:13:57.381 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.380+0000 7f37bb523800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:13:57.381 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.380+0000 7f37bb523800 20 realm 2024-06-04T16:13:57.381 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.380+0000 7f37bb523800 20 rados->read ofs=0 len=0 2024-06-04T16:13:57.382 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.380+0000 7f37bb523800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:13:57.382 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.380+0000 7f37bb523800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-06-04T16:13:57.382 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.380+0000 7f37bb523800 20 rados->read ofs=0 len=0 2024-06-04T16:13:57.382 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.381+0000 7f37bb523800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:13:57.382 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.381+0000 7f37bb523800 20 rados->read ofs=0 len=0 2024-06-04T16:13:57.383 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.381+0000 7f37bb523800 20 rados_obj.operate() r=0 bl.length=46 2024-06-04T16:13:57.383 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.381+0000 7f37bb523800 20 rados->read ofs=0 len=0 2024-06-04T16:13:57.383 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.382+0000 7f37bb523800 20 rados_obj.operate() r=0 bl.length=1139 2024-06-04T16:13:57.383 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.382+0000 7f37bb523800 20 searching for the correct realm 2024-06-04T16:13:57.385 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.384+0000 7f37b6aac640 0 -- 172.21.15.144:0/3336066022 >> [v2:172.21.15.144:6816/2358575268,v1:172.21.15.144:6817/2358575268] conn(0x55b9e5a20830 msgr2=0x55b9e5a22c20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-06-04T16:13:57.387 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.387+0000 7f37b6aac640 0 -- 172.21.15.144:0/3336066022 >> [v2:172.21.15.177:6808/2618477608,v1:172.21.15.177:6809/2618477608] conn(0x7f37a0018020 msgr2=0x7f37a008cf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-06-04T16:13:57.595 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.594+0000 7f37bb523800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-06-04T16:13:57.595 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.594+0000 7f37bb523800 20 RGWRados::pool_iterate: got zone_info.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767 2024-06-04T16:13:57.595 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.594+0000 7f37bb523800 20 RGWRados::pool_iterate: got default.zone. 2024-06-04T16:13:57.595 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.594+0000 7f37bb523800 20 RGWRados::pool_iterate: got zonegroup_info.abb22408-c332-4e28-8f7a-ff254ea2fed2 2024-06-04T16:13:57.596 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.594+0000 7f37bb523800 20 RGWRados::pool_iterate: got zone_names.default 2024-06-04T16:13:57.596 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.594+0000 7f37bb523800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-06-04T16:13:57.596 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.594+0000 7f37bb523800 20 rados->read ofs=0 len=0 2024-06-04T16:13:57.596 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.594+0000 7f37bb523800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:13:57.596 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.594+0000 7f37bb523800 20 rados->read ofs=0 len=0 2024-06-04T16:13:57.596 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.595+0000 7f37bb523800 20 rados_obj.operate() r=0 bl.length=46 2024-06-04T16:13:57.596 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.595+0000 7f37bb523800 20 rados->read ofs=0 len=0 2024-06-04T16:13:57.597 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.595+0000 7f37bb523800 20 rados_obj.operate() r=0 bl.length=470 2024-06-04T16:13:57.597 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.595+0000 7f37bb523800 20 zone default found 2024-06-04T16:13:57.597 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.595+0000 7f37bb523800 4 Realm: () 2024-06-04T16:13:57.597 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.595+0000 7f37bb523800 4 ZoneGroup: default (abb22408-c332-4e28-8f7a-ff254ea2fed2) 2024-06-04T16:13:57.597 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.595+0000 7f37bb523800 4 Zone: default (be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767) 2024-06-04T16:13:57.597 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.595+0000 7f37bb523800 10 cannot find current period zonegroup using local zonegroup configuration 2024-06-04T16:13:57.597 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.595+0000 7f37bb523800 20 zonegroup default 2024-06-04T16:13:57.597 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.595+0000 7f37bb523800 20 rados->read ofs=0 len=0 2024-06-04T16:13:57.598 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.595+0000 7f37bb523800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:13:57.598 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.595+0000 7f37bb523800 20 rados->read ofs=0 len=0 2024-06-04T16:13:57.598 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.595+0000 7f37bb523800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:13:57.598 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.595+0000 7f37bb523800 20 rados->read ofs=0 len=0 2024-06-04T16:13:57.598 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.596+0000 7f37bb523800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:13:57.598 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.596+0000 7f37bb523800 20 started sync module instance, tier type = 2024-06-04T16:13:57.598 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.596+0000 7f37bb523800 20 started zone id=be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767 (name=default) with tier type = 2024-06-04T16:13:57.606 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.606+0000 7f37bb523800 20 add_watcher() i=0 2024-06-04T16:13:57.607 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.606+0000 7f37bb523800 20 add_watcher() i=1 2024-06-04T16:13:57.607 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.606+0000 7f37bb523800 20 add_watcher() i=2 2024-06-04T16:13:57.607 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.606+0000 7f37bb523800 20 add_watcher() i=3 2024-06-04T16:13:57.607 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.606+0000 7f37bb523800 20 add_watcher() i=4 2024-06-04T16:13:57.607 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.606+0000 7f37bb523800 20 add_watcher() i=5 2024-06-04T16:13:57.607 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.606+0000 7f37bb523800 20 add_watcher() i=6 2024-06-04T16:13:57.607 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.607+0000 7f37bb523800 20 add_watcher() i=7 2024-06-04T16:13:57.608 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.607+0000 7f37bb523800 2 all 8 watchers are set, enabling cache 2024-06-04T16:13:57.611 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.609+0000 7f366dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-06-04T16:13:57.611 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.609+0000 7f37bb523800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-06-04T16:13:57.611 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.609+0000 7f37bb523800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-06-04T16:13:57.611 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.609+0000 7f37bb523800 5 note: GC not initialized 2024-06-04T16:13:57.611 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.609+0000 7f366cfe1640 20 reqs_thread_entry: start 2024-06-04T16:13:57.611 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.609+0000 7f37bb523800 20 init_complete bucket index max shards: 11 2024-06-04T16:13:57.611 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.609+0000 7f37bb523800 20 Filter name: none 2024-06-04T16:13:57.611 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.610+0000 7f35e67fc640 20 reqs_thread_entry: start 2024-06-04T16:13:57.611 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.610+0000 7f37bb523800 20 rados->read ofs=0 len=0 2024-06-04T16:13:57.611 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.610+0000 7f37bb523800 20 rados_obj.operate() r=0 bl.length=176 2024-06-04T16:13:57.612 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.610+0000 7f37bb523800 20 rados->read ofs=0 len=0 2024-06-04T16:13:57.612 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.610+0000 7f37bb523800 20 rados_obj.operate() r=0 bl.length=390 2024-06-04T16:13:57.613 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.610+0000 7f37bb523800 20 couldn't put binfo cache entry, might have raced with data changes 2024-06-04T16:13:57.613 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.610+0000 7f37bb523800 20 INFO: main: max_entries=1000, index=gen=2, max_shards=13 2024-06-04T16:13:57.613 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.610+0000 7f37bb523800 20 INFO: main: starting shard=0 2024-06-04T16:13:57.613 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.610+0000 7f37bb523800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.17.2.0 2024-06-04T16:13:57.613 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.610+0000 7f37bb523800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.17.2.0 2024-06-04T16:13:57.613 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.611+0000 7f37bb523800 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-06-04T16:13:57.613 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.611+0000 7f37bb523800 20 INFO: main: starting shard=1 2024-06-04T16:13:57.613 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.611+0000 7f37bb523800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.17.2.1 2024-06-04T16:13:57.613 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.611+0000 7f37bb523800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.17.2.1 2024-06-04T16:13:57.614 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.612+0000 7f37bb523800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-06-04T16:13:57.614 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.612+0000 7f37bb523800 20 INFO: main: starting shard=2 2024-06-04T16:13:57.614 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.612+0000 7f37bb523800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.17.2.2 2024-06-04T16:13:57.614 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.612+0000 7f37bb523800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.17.2.2 2024-06-04T16:13:57.616 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.612+0000 7f37bb523800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-06-04T16:13:57.616 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.612+0000 7f37bb523800 20 INFO: main: starting shard=3 2024-06-04T16:13:57.616 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.612+0000 7f37bb523800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.17.2.3 2024-06-04T16:13:57.616 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.612+0000 7f37bb523800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.17.2.3 2024-06-04T16:13:57.616 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.613+0000 7f37bb523800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-06-04T16:13:57.616 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.613+0000 7f37bb523800 20 INFO: main: starting shard=4 2024-06-04T16:13:57.617 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.613+0000 7f37bb523800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.17.2.4 2024-06-04T16:13:57.617 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.613+0000 7f37bb523800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.17.2.4 2024-06-04T16:13:57.617 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.613+0000 7f37bb523800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-06-04T16:13:57.617 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.613+0000 7f37bb523800 20 INFO: main: starting shard=5 2024-06-04T16:13:57.617 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.613+0000 7f37bb523800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.17.2.5 2024-06-04T16:13:57.617 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.613+0000 7f37bb523800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.17.2.5 2024-06-04T16:13:57.617 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.613+0000 7f37bb523800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-06-04T16:13:57.617 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.613+0000 7f37bb523800 20 INFO: main: starting shard=6 2024-06-04T16:13:57.617 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.613+0000 7f37bb523800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.17.2.6 2024-06-04T16:13:57.617 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.613+0000 7f37bb523800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.17.2.6 2024-06-04T16:13:57.618 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.614+0000 7f37bb523800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-06-04T16:13:57.618 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.614+0000 7f37bb523800 20 INFO: main: starting shard=7 2024-06-04T16:13:57.618 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.614+0000 7f37bb523800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.17.2.7 2024-06-04T16:13:57.618 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.614+0000 7f37bb523800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.17.2.7 2024-06-04T16:13:57.618 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.615+0000 7f37bb523800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-06-04T16:13:57.618 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.615+0000 7f37bb523800 20 INFO: main: starting shard=8 2024-06-04T16:13:57.618 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.615+0000 7f37bb523800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.17.2.8 2024-06-04T16:13:57.618 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.615+0000 7f37bb523800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.17.2.8 2024-06-04T16:13:57.618 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.615+0000 7f37bb523800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-06-04T16:13:57.618 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.615+0000 7f37bb523800 20 INFO: main: starting shard=9 2024-06-04T16:13:57.618 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.615+0000 7f37bb523800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.17.2.9 2024-06-04T16:13:57.619 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.615+0000 7f37bb523800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.17.2.9 2024-06-04T16:13:57.620 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.616+0000 7f37bb523800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-06-04T16:13:57.620 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.616+0000 7f37bb523800 20 INFO: main: starting shard=10 2024-06-04T16:13:57.620 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.616+0000 7f37bb523800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.17.2.10 2024-06-04T16:13:57.620 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.616+0000 7f37bb523800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.17.2.10 2024-06-04T16:13:57.620 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.616+0000 7f37bb523800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-06-04T16:13:57.620 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.616+0000 7f37bb523800 20 INFO: main: starting shard=11 2024-06-04T16:13:57.620 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.616+0000 7f37bb523800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.17.2.11 2024-06-04T16:13:57.620 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.616+0000 7f37bb523800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.17.2.11 2024-06-04T16:13:57.620 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.617+0000 7f37bb523800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-06-04T16:13:57.620 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.617+0000 7f37bb523800 20 INFO: main: starting shard=12 2024-06-04T16:13:57.620 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.617+0000 7f37bb523800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.17.2.12 2024-06-04T16:13:57.621 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.617+0000 7f37bb523800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.17.2.12 2024-06-04T16:13:57.621 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.617+0000 7f37bb523800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-06-04T16:13:57.621 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.617+0000 7f37bb523800 20 INFO: main: done 2024-06-04T16:13:57.621 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.618+0000 7f366dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-06-04T16:13:57.621 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.620+0000 7f37bb523800 20 remove_watcher() i=0 2024-06-04T16:13:57.622 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.620+0000 7f37bb523800 2 removed watcher, disabling cache 2024-06-04T16:13:57.622 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.621+0000 7f37bb523800 20 remove_watcher() i=1 2024-06-04T16:13:57.623 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.622+0000 7f37bb523800 20 remove_watcher() i=2 2024-06-04T16:13:57.624 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.623+0000 7f37bb523800 20 remove_watcher() i=3 2024-06-04T16:13:57.625 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.624+0000 7f37bb523800 20 remove_watcher() i=4 2024-06-04T16:13:57.626 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.625+0000 7f37bb523800 20 remove_watcher() i=5 2024-06-04T16:13:57.627 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.627+0000 7f37bb523800 20 remove_watcher() i=6 2024-06-04T16:13:57.629 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.628+0000 7f37bb523800 20 remove_watcher() i=7 2024-06-04T16:13:57.641 INFO:tasks.workunit.client.0.smithi144.stderr:radosgw-admin bucket reshard --bucket a-bucket --num-shards 1 --yes-i-really-mean-it 2024-06-04T16:13:57.672 INFO:tasks.workunit.client.0.smithi144.stderr:ignoring --setuser ceph since I am not root 2024-06-04T16:13:57.672 INFO:tasks.workunit.client.0.smithi144.stderr:ignoring --setgroup ceph since I am not root 2024-06-04T16:13:57.709 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.708+0000 7fda4e923800 20 rados->read ofs=0 len=0 2024-06-04T16:13:57.711 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.709+0000 7fda4e923800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:13:57.711 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.709+0000 7fda4e923800 20 realm 2024-06-04T16:13:57.711 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.709+0000 7fda4e923800 20 rados->read ofs=0 len=0 2024-06-04T16:13:57.711 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.710+0000 7fda4e923800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:13:57.711 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.710+0000 7fda4e923800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-06-04T16:13:57.711 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.710+0000 7fda4e923800 20 rados->read ofs=0 len=0 2024-06-04T16:13:57.711 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.710+0000 7fda4e923800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:13:57.711 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.710+0000 7fda4e923800 20 rados->read ofs=0 len=0 2024-06-04T16:13:57.712 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.710+0000 7fda4e923800 20 rados_obj.operate() r=0 bl.length=46 2024-06-04T16:13:57.712 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.710+0000 7fda4e923800 20 rados->read ofs=0 len=0 2024-06-04T16:13:57.712 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.711+0000 7fda4e923800 20 rados_obj.operate() r=0 bl.length=1139 2024-06-04T16:13:57.712 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.711+0000 7fda4e923800 20 searching for the correct realm 2024-06-04T16:13:57.714 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.713+0000 7fda4ae50640 0 -- 172.21.15.144:0/1637316152 >> [v2:172.21.15.144:6800/1453747520,v1:172.21.15.144:6801/1453747520] conn(0x7fda34044950 msgr2=0x7fda340503f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-06-04T16:13:57.919 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.918+0000 7fda4ae50640 0 -- 172.21.15.144:0/1637316152 >> [v2:172.21.15.144:6824/166159729,v1:172.21.15.144:6825/166159729] conn(0x558ef49a9dc0 msgr2=0x558ef49ac1b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-06-04T16:13:57.924 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.923+0000 7fda4e923800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-06-04T16:13:57.924 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.923+0000 7fda4e923800 20 RGWRados::pool_iterate: got zone_info.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767 2024-06-04T16:13:57.925 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.923+0000 7fda4e923800 20 RGWRados::pool_iterate: got default.zone. 2024-06-04T16:13:57.925 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.923+0000 7fda4e923800 20 RGWRados::pool_iterate: got zonegroup_info.abb22408-c332-4e28-8f7a-ff254ea2fed2 2024-06-04T16:13:57.925 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.923+0000 7fda4e923800 20 RGWRados::pool_iterate: got zone_names.default 2024-06-04T16:13:57.925 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.923+0000 7fda4e923800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-06-04T16:13:57.925 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.923+0000 7fda4e923800 20 rados->read ofs=0 len=0 2024-06-04T16:13:57.925 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.924+0000 7fda4e923800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:13:57.925 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.924+0000 7fda4e923800 20 rados->read ofs=0 len=0 2024-06-04T16:13:57.928 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.924+0000 7fda4e923800 20 rados_obj.operate() r=0 bl.length=46 2024-06-04T16:13:57.928 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.924+0000 7fda4e923800 20 rados->read ofs=0 len=0 2024-06-04T16:13:57.928 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.924+0000 7fda4e923800 20 rados_obj.operate() r=0 bl.length=470 2024-06-04T16:13:57.928 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.924+0000 7fda4e923800 20 zone default found 2024-06-04T16:13:57.928 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.924+0000 7fda4e923800 4 Realm: () 2024-06-04T16:13:57.928 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.924+0000 7fda4e923800 4 ZoneGroup: default (abb22408-c332-4e28-8f7a-ff254ea2fed2) 2024-06-04T16:13:57.928 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.924+0000 7fda4e923800 4 Zone: default (be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767) 2024-06-04T16:13:57.929 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.924+0000 7fda4e923800 10 cannot find current period zonegroup using local zonegroup configuration 2024-06-04T16:13:57.929 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.924+0000 7fda4e923800 20 zonegroup default 2024-06-04T16:13:57.929 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.924+0000 7fda4e923800 20 rados->read ofs=0 len=0 2024-06-04T16:13:57.929 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.925+0000 7fda4e923800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:13:57.929 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.925+0000 7fda4e923800 20 rados->read ofs=0 len=0 2024-06-04T16:13:57.929 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.925+0000 7fda4e923800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:13:57.929 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.925+0000 7fda4e923800 20 rados->read ofs=0 len=0 2024-06-04T16:13:57.929 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.925+0000 7fda4e923800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:13:57.929 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.925+0000 7fda4e923800 20 started sync module instance, tier type = 2024-06-04T16:13:57.929 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.925+0000 7fda4e923800 20 started zone id=be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767 (name=default) with tier type = 2024-06-04T16:13:57.936 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.935+0000 7fda4e923800 20 add_watcher() i=0 2024-06-04T16:13:57.936 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.935+0000 7fda4e923800 20 add_watcher() i=1 2024-06-04T16:13:57.936 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.935+0000 7fda4e923800 20 add_watcher() i=2 2024-06-04T16:13:57.936 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.935+0000 7fda4e923800 20 add_watcher() i=3 2024-06-04T16:13:57.936 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.935+0000 7fda4e923800 20 add_watcher() i=4 2024-06-04T16:13:57.936 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.935+0000 7fda4e923800 20 add_watcher() i=5 2024-06-04T16:13:57.936 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.935+0000 7fda4e923800 20 add_watcher() i=6 2024-06-04T16:13:57.937 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.936+0000 7fda4e923800 20 add_watcher() i=7 2024-06-04T16:13:57.937 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.936+0000 7fda4e923800 2 all 8 watchers are set, enabling cache 2024-06-04T16:13:57.939 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.938+0000 7fd900fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-06-04T16:13:57.941 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.939+0000 7fda4e923800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-06-04T16:13:57.941 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.939+0000 7fda4e923800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-06-04T16:13:57.941 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.939+0000 7fda4e923800 5 note: GC not initialized 2024-06-04T16:13:57.942 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.939+0000 7fd87b7fe640 20 reqs_thread_entry: start 2024-06-04T16:13:57.942 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.939+0000 7fda4e923800 20 init_complete bucket index max shards: 11 2024-06-04T16:13:57.942 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.939+0000 7fda4e923800 20 Filter name: none 2024-06-04T16:13:57.942 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.939+0000 7fd8797fa640 20 reqs_thread_entry: start 2024-06-04T16:13:57.942 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.939+0000 7fda4e923800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-06-04T16:13:57.942 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.939+0000 7fda4e923800 20 rados->read ofs=0 len=0 2024-06-04T16:13:57.943 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.940+0000 7fda4e923800 20 rados_obj.operate() r=0 bl.length=176 2024-06-04T16:13:57.943 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.940+0000 7fda4e923800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-06-04T16:13:57.943 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.940+0000 7fda4e923800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-06-04T16:13:57.943 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.940+0000 7fda4e923800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.17 : miss 2024-06-04T16:13:57.943 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.940+0000 7fda4e923800 20 rados->read ofs=0 len=0 2024-06-04T16:13:57.943 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.940+0000 7fda4e923800 20 rados_obj.operate() r=0 bl.length=390 2024-06-04T16:13:57.944 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.940+0000 7fda4e923800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.17 info.flags=0x17 2024-06-04T16:13:57.944 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.940+0000 7fda4e923800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.17 to cache LRU end 2024-06-04T16:13:57.944 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.940+0000 7fda4e923800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-06-04T16:13:57.944 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.940+0000 7fda4e923800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-06-04T16:13:57.944 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.940+0000 7fda4e923800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.17 2024-06-04T16:13:57.945 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.943+0000 7fda4e923800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.17 info.flags=0x17 2024-06-04T16:13:57.945 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.943+0000 7fda4e923800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.17 to cache LRU end 2024-06-04T16:13:57.945 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.943+0000 7fda4e923800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-06-04T16:13:57.945 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.943+0000 7fda4e923800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.17, ofs0, ns] 2024-06-04T16:13:57.945 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.944+0000 7fd92d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1078036791425 cookie 94072477531616 notifier 6746 bl.length()=819 2024-06-04T16:13:57.945 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.944+0000 7fd92d7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.17 info.flags=0x17 2024-06-04T16:13:57.945 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.944+0000 7fd92d7fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.17 to cache LRU end 2024-06-04T16:13:57.945 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.944+0000 7fd92d7fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-06-04T16:13:57.946 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.944+0000 7fda4e923800 20 handle_bi_update(): bucket=:a-bucket[be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.17]): orig_sources= new_sources= 2024-06-04T16:13:57.946 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.944+0000 7fda4e923800 20 handle_bi_update(): bucket=:a-bucket[be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.17]): potential sources added=[] removed=[] 2024-06-04T16:13:57.946 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.944+0000 7fda4e923800 20 handle_bi_update(): bucket=:a-bucket[be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.17]): orig_dests= new_dests= 2024-06-04T16:13:57.946 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.944+0000 7fda4e923800 20 handle_bi_update(): bucket=:a-bucket[be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.17]): potential dests added=[] removed=[] 2024-06-04T16:13:57.948 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.947+0000 7fda4e923800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.17.3.0 2024-06-04T16:13:57.948 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.947+0000 7fda4e923800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.17.3.0 2024-06-04T16:13:57.948 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.947+0000 7fda4e923800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.17.2.0 2024-06-04T16:13:57.948 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.947+0000 7fda4e923800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.17.2.0 2024-06-04T16:13:57.949 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.948+0000 7fda4e923800 10 Dropping entry with empty name, idx=�1001_04/57/0457f727ec113e418d5b16d206b200ed068c0533554883ce811df7c932a3df68/2018_12_11/2889999/3386469/metadata.gz 2024-06-04T16:13:57.949 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.948+0000 7fda4e923800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.17.2.1 2024-06-04T16:13:57.949 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.948+0000 7fda4e923800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.17.2.1 2024-06-04T16:13:57.949 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.948+0000 7fda4e923800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.17.2.2 2024-06-04T16:13:57.949 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.948+0000 7fda4e923800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.17.2.2 2024-06-04T16:13:57.950 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.949+0000 7fda4e923800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.17.2.3 2024-06-04T16:13:57.950 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.949+0000 7fda4e923800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.17.2.3 2024-06-04T16:13:57.950 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.949+0000 7fda4e923800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.17.2.4 2024-06-04T16:13:57.950 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.949+0000 7fda4e923800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.17.2.4 2024-06-04T16:13:57.951 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.950+0000 7fda4e923800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.17.2.5 2024-06-04T16:13:57.951 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.950+0000 7fda4e923800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.17.2.5 2024-06-04T16:13:57.951 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.950+0000 7fda4e923800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.17.2.6 2024-06-04T16:13:57.951 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.950+0000 7fda4e923800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.17.2.6 2024-06-04T16:13:57.951 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.951+0000 7fda4e923800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.17.2.7 2024-06-04T16:13:57.952 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.951+0000 7fda4e923800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.17.2.7 2024-06-04T16:13:57.952 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.951+0000 7fda4e923800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.17.2.8 2024-06-04T16:13:57.952 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.951+0000 7fda4e923800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.17.2.8 2024-06-04T16:13:57.952 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.951+0000 7fda4e923800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.17.2.9 2024-06-04T16:13:57.953 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.951+0000 7fda4e923800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.17.2.9 2024-06-04T16:13:57.953 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.952+0000 7fda4e923800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.17.2.10 2024-06-04T16:13:57.954 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.952+0000 7fda4e923800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.17.2.10 2024-06-04T16:13:57.954 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.953+0000 7fda4e923800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.17.2.11 2024-06-04T16:13:57.954 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.953+0000 7fda4e923800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.17.2.11 2024-06-04T16:13:57.954 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.953+0000 7fda4e923800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.17.2.12 2024-06-04T16:13:57.954 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.953+0000 7fda4e923800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.17.2.12 2024-06-04T16:13:57.955 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.954+0000 7fda4e923800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.17 : hit (requested=0x17, cached=0x17) 2024-06-04T16:13:57.955 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.954+0000 7fda4e923800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.17 2024-06-04T16:13:57.956 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.955+0000 7fda4e923800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.17 info.flags=0x17 2024-06-04T16:13:57.956 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.955+0000 7fda4e923800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.17 to cache LRU end 2024-06-04T16:13:57.956 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.955+0000 7fda4e923800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-06-04T16:13:57.956 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.955+0000 7fda4e923800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.17, ofs0, ns] 2024-06-04T16:13:57.957 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.955+0000 7fd92dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1078036791426 cookie 94072477531616 notifier 6746 bl.length()=787 2024-06-04T16:13:57.957 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.955+0000 7fd92dffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.17 info.flags=0x17 2024-06-04T16:13:57.957 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.955+0000 7fd92dffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.17 to cache LRU end 2024-06-04T16:13:57.958 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.955+0000 7fd92dffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-06-04T16:13:57.958 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.956+0000 7fda4e923800 20 handle_bi_update(): bucket=:a-bucket[be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.17]): orig_sources= new_sources= 2024-06-04T16:13:57.958 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.956+0000 7fda4e923800 20 handle_bi_update(): bucket=:a-bucket[be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.17]): potential sources added=[] removed=[] 2024-06-04T16:13:57.958 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.956+0000 7fda4e923800 20 handle_bi_update(): bucket=:a-bucket[be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.17]): orig_dests= new_dests= 2024-06-04T16:13:57.958 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.956+0000 7fda4e923800 20 handle_bi_update(): bucket=:a-bucket[be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.17]): potential dests added=[] removed=[] 2024-06-04T16:13:57.959 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.958+0000 7fda4e923800 1 execute INFO: reshard of bucket "a-bucket" completed successfully 2024-06-04T16:13:57.961 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.960+0000 7fd900fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-06-04T16:13:57.963 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.962+0000 7fda4e923800 20 remove_watcher() i=0 2024-06-04T16:13:57.963 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.962+0000 7fda4e923800 2 removed watcher, disabling cache 2024-06-04T16:13:57.964 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.963+0000 7fda4e923800 20 remove_watcher() i=1 2024-06-04T16:13:57.965 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.964+0000 7fda4e923800 20 remove_watcher() i=2 2024-06-04T16:13:57.966 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.965+0000 7fda4e923800 20 remove_watcher() i=3 2024-06-04T16:13:57.967 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.966+0000 7fda4e923800 20 remove_watcher() i=4 2024-06-04T16:13:57.968 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.967+0000 7fda4e923800 20 remove_watcher() i=5 2024-06-04T16:13:57.969 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.968+0000 7fda4e923800 20 remove_watcher() i=6 2024-06-04T16:13:57.970 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:57.969+0000 7fda4e923800 20 remove_watcher() i=7 2024-06-04T16:13:57.982 INFO:tasks.workunit.client.0.smithi144.stderr:radosgw-admin bi list --bucket a-bucket 2024-06-04T16:13:58.010 INFO:tasks.workunit.client.0.smithi144.stderr:ignoring --setuser ceph since I am not root 2024-06-04T16:13:58.010 INFO:tasks.workunit.client.0.smithi144.stderr:ignoring --setgroup ceph since I am not root 2024-06-04T16:13:58.231 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:58.230+0000 7f7bae56f640 0 --2- 172.21.15.144:0/3013883414 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x5622bf389420 0x5622bf23a0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2024-06-04T16:13:58.249 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:58.248+0000 7f7bb212d800 20 rados->read ofs=0 len=0 2024-06-04T16:13:58.251 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:58.250+0000 7f7bb212d800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:13:58.251 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:58.250+0000 7f7bb212d800 20 realm 2024-06-04T16:13:58.252 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:58.250+0000 7f7bb212d800 20 rados->read ofs=0 len=0 2024-06-04T16:13:58.252 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:58.250+0000 7f7bb212d800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:13:58.252 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:58.250+0000 7f7bb212d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-06-04T16:13:58.252 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:58.250+0000 7f7bb212d800 20 rados->read ofs=0 len=0 2024-06-04T16:13:58.252 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:58.251+0000 7f7bb212d800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:13:58.252 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:58.251+0000 7f7bb212d800 20 rados->read ofs=0 len=0 2024-06-04T16:13:58.253 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:58.251+0000 7f7bb212d800 20 rados_obj.operate() r=0 bl.length=46 2024-06-04T16:13:58.253 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:58.251+0000 7f7bb212d800 20 rados->read ofs=0 len=0 2024-06-04T16:13:58.253 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:58.252+0000 7f7bb212d800 20 rados_obj.operate() r=0 bl.length=1139 2024-06-04T16:13:58.253 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:58.252+0000 7f7bb212d800 20 searching for the correct realm 2024-06-04T16:13:58.253 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:58.252+0000 7f7badd6e640 0 -- 172.21.15.144:0/2703118572 >> [v2:172.21.15.177:6816/2039473917,v1:172.21.15.177:6817/2039473917] conn(0x5622bf47dd40 msgr2=0x5622bf480200 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-06-04T16:13:58.458 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:58.457+0000 7f7badd6e640 0 -- 172.21.15.144:0/2703118572 >> [v2:172.21.15.177:6800/3891611393,v1:172.21.15.177:6801/3891611393] conn(0x7f7ba0038930 msgr2=0x7f7ba0046410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-06-04T16:13:58.466 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:58.465+0000 7f7bb212d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-06-04T16:13:58.466 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:58.465+0000 7f7bb212d800 20 RGWRados::pool_iterate: got zone_info.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767 2024-06-04T16:13:58.466 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:58.465+0000 7f7bb212d800 20 RGWRados::pool_iterate: got default.zone. 2024-06-04T16:13:58.466 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:58.465+0000 7f7bb212d800 20 RGWRados::pool_iterate: got zonegroup_info.abb22408-c332-4e28-8f7a-ff254ea2fed2 2024-06-04T16:13:58.466 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:58.465+0000 7f7bb212d800 20 RGWRados::pool_iterate: got zone_names.default 2024-06-04T16:13:58.466 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:58.465+0000 7f7bb212d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-06-04T16:13:58.467 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:58.465+0000 7f7bb212d800 20 rados->read ofs=0 len=0 2024-06-04T16:13:58.467 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:58.465+0000 7f7bb212d800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:13:58.467 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:58.465+0000 7f7bb212d800 20 rados->read ofs=0 len=0 2024-06-04T16:13:58.468 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:58.466+0000 7f7bb212d800 20 rados_obj.operate() r=0 bl.length=46 2024-06-04T16:13:58.468 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:58.466+0000 7f7bb212d800 20 rados->read ofs=0 len=0 2024-06-04T16:13:58.468 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:58.466+0000 7f7bb212d800 20 rados_obj.operate() r=0 bl.length=470 2024-06-04T16:13:58.468 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:58.466+0000 7f7bb212d800 20 zone default found 2024-06-04T16:13:58.468 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:58.466+0000 7f7bb212d800 4 Realm: () 2024-06-04T16:13:58.468 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:58.466+0000 7f7bb212d800 4 ZoneGroup: default (abb22408-c332-4e28-8f7a-ff254ea2fed2) 2024-06-04T16:13:58.468 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:58.466+0000 7f7bb212d800 4 Zone: default (be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767) 2024-06-04T16:13:58.468 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:58.466+0000 7f7bb212d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-06-04T16:13:58.468 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:58.466+0000 7f7bb212d800 20 zonegroup default 2024-06-04T16:13:58.469 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:58.466+0000 7f7bb212d800 20 rados->read ofs=0 len=0 2024-06-04T16:13:58.469 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:58.466+0000 7f7bb212d800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:13:58.469 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:58.466+0000 7f7bb212d800 20 rados->read ofs=0 len=0 2024-06-04T16:13:58.469 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:58.467+0000 7f7bb212d800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:13:58.469 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:58.467+0000 7f7bb212d800 20 rados->read ofs=0 len=0 2024-06-04T16:13:58.469 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:58.467+0000 7f7bb212d800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:13:58.469 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:58.467+0000 7f7bb212d800 20 started sync module instance, tier type = 2024-06-04T16:13:58.469 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:58.467+0000 7f7bb212d800 20 started zone id=be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767 (name=default) with tier type = 2024-06-04T16:13:58.477 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:58.477+0000 7f7bb212d800 20 add_watcher() i=0 2024-06-04T16:13:58.477 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:58.477+0000 7f7bb212d800 20 add_watcher() i=1 2024-06-04T16:13:58.478 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:58.477+0000 7f7bb212d800 20 add_watcher() i=2 2024-06-04T16:13:58.478 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:58.477+0000 7f7bb212d800 20 add_watcher() i=3 2024-06-04T16:13:58.478 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:58.477+0000 7f7bb212d800 20 add_watcher() i=4 2024-06-04T16:13:58.478 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:58.477+0000 7f7bb212d800 20 add_watcher() i=5 2024-06-04T16:13:58.478 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:58.477+0000 7f7bb212d800 20 add_watcher() i=6 2024-06-04T16:13:58.478 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:58.478+0000 7f7bb212d800 20 add_watcher() i=7 2024-06-04T16:13:58.479 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:58.478+0000 7f7bb212d800 2 all 8 watchers are set, enabling cache 2024-06-04T16:13:58.480 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:58.479+0000 7f7a5f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-06-04T16:13:58.481 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:58.480+0000 7f7bb212d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-06-04T16:13:58.481 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:58.480+0000 7f7bb212d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-06-04T16:13:58.481 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:58.480+0000 7f7bb212d800 5 note: GC not initialized 2024-06-04T16:13:58.481 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:58.480+0000 7f7a5e7fc640 20 reqs_thread_entry: start 2024-06-04T16:13:58.481 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:58.480+0000 7f7bb212d800 20 init_complete bucket index max shards: 11 2024-06-04T16:13:58.481 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:58.480+0000 7f7bb212d800 20 Filter name: none 2024-06-04T16:13:58.482 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:58.480+0000 7f79d3fff640 20 reqs_thread_entry: start 2024-06-04T16:13:58.482 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:58.480+0000 7f7bb212d800 20 rados->read ofs=0 len=0 2024-06-04T16:13:58.482 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:58.481+0000 7f7bb212d800 20 rados_obj.operate() r=0 bl.length=176 2024-06-04T16:13:58.483 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:58.481+0000 7f7bb212d800 20 rados->read ofs=0 len=0 2024-06-04T16:13:58.483 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:58.481+0000 7f7bb212d800 20 rados_obj.operate() r=0 bl.length=390 2024-06-04T16:13:58.483 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:58.481+0000 7f7bb212d800 20 couldn't put binfo cache entry, might have raced with data changes 2024-06-04T16:13:58.483 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:58.481+0000 7f7bb212d800 20 INFO: main: max_entries=1000, index=gen=3, max_shards=1 2024-06-04T16:13:58.483 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:58.481+0000 7f7bb212d800 20 INFO: main: starting shard=0 2024-06-04T16:13:58.483 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:58.481+0000 7f7bb212d800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.17.3.0 2024-06-04T16:13:58.483 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:58.481+0000 7f7bb212d800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.17.3.0 2024-06-04T16:13:58.483 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:58.482+0000 7f7bb212d800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-06-04T16:13:58.483 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:58.482+0000 7f7bb212d800 20 INFO: main: done 2024-06-04T16:13:58.483 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:58.483+0000 7f7a5f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-06-04T16:13:58.486 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:58.485+0000 7f7bb212d800 20 remove_watcher() i=0 2024-06-04T16:13:58.486 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:58.485+0000 7f7bb212d800 2 removed watcher, disabling cache 2024-06-04T16:13:58.487 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:58.487+0000 7f7bb212d800 20 remove_watcher() i=1 2024-06-04T16:13:58.488 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:58.488+0000 7f7bb212d800 20 remove_watcher() i=2 2024-06-04T16:13:58.489 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:58.489+0000 7f7bb212d800 20 remove_watcher() i=3 2024-06-04T16:13:58.494 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:58.490+0000 7f7bb212d800 20 remove_watcher() i=4 2024-06-04T16:13:58.494 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:58.491+0000 7f7bb212d800 20 remove_watcher() i=5 2024-06-04T16:13:58.494 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:58.492+0000 7f7bb212d800 20 remove_watcher() i=6 2024-06-04T16:13:58.494 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:58.493+0000 7f7bb212d800 20 remove_watcher() i=7 2024-06-04T16:13:58.504 INFO:tasks.workunit.client.0.smithi144.stderr: test: PUT succeeds during reshard 2024-06-04T16:13:58.506 INFO:tasks.workunit.client.0.smithi144.stderr:radosgw-admin bucket stats --bucket myver 2024-06-04T16:13:58.535 INFO:tasks.workunit.client.0.smithi144.stderr:ignoring --setuser ceph since I am not root 2024-06-04T16:13:58.535 INFO:tasks.workunit.client.0.smithi144.stderr:ignoring --setgroup ceph since I am not root 2024-06-04T16:13:58.573 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:58.572+0000 7f1b81536800 20 rados->read ofs=0 len=0 2024-06-04T16:13:58.576 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:58.574+0000 7f1b81536800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:13:58.577 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:58.574+0000 7f1b81536800 20 realm 2024-06-04T16:13:58.577 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:58.574+0000 7f1b81536800 20 rados->read ofs=0 len=0 2024-06-04T16:13:58.577 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:58.574+0000 7f1b81536800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:13:58.577 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:58.574+0000 7f1b81536800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-06-04T16:13:58.577 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:58.574+0000 7f1b81536800 20 rados->read ofs=0 len=0 2024-06-04T16:13:58.577 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:58.575+0000 7f1b81536800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:13:58.578 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:58.575+0000 7f1b81536800 20 rados->read ofs=0 len=0 2024-06-04T16:13:58.578 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:58.575+0000 7f1b81536800 20 rados_obj.operate() r=0 bl.length=46 2024-06-04T16:13:58.578 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:58.575+0000 7f1b81536800 20 rados->read ofs=0 len=0 2024-06-04T16:13:58.579 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:58.576+0000 7f1b81536800 20 rados_obj.operate() r=0 bl.length=1139 2024-06-04T16:13:58.579 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:58.576+0000 7f1b81536800 20 searching for the correct realm 2024-06-04T16:13:58.580 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:58.578+0000 7f1b7dac3640 0 -- 172.21.15.144:0/2972573906 >> [v2:172.21.15.144:6800/1453747520,v1:172.21.15.144:6801/1453747520] conn(0x7f1b68091030 msgr2=0x7f1b6807d970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-06-04T16:13:58.784 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:58.783+0000 7f1b7dac3640 0 -- 172.21.15.144:0/2972573906 >> [v2:172.21.15.144:6824/166159729,v1:172.21.15.144:6825/166159729] conn(0x55dd32308d60 msgr2=0x55dd3230b150 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-06-04T16:13:58.790 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:58.789+0000 7f1b81536800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-06-04T16:13:58.791 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:58.789+0000 7f1b81536800 20 RGWRados::pool_iterate: got zone_info.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767 2024-06-04T16:13:58.791 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:58.789+0000 7f1b81536800 20 RGWRados::pool_iterate: got default.zone. 2024-06-04T16:13:58.791 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:58.789+0000 7f1b81536800 20 RGWRados::pool_iterate: got zonegroup_info.abb22408-c332-4e28-8f7a-ff254ea2fed2 2024-06-04T16:13:58.791 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:58.789+0000 7f1b81536800 20 RGWRados::pool_iterate: got zone_names.default 2024-06-04T16:13:58.791 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:58.789+0000 7f1b81536800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-06-04T16:13:58.791 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:58.789+0000 7f1b81536800 20 rados->read ofs=0 len=0 2024-06-04T16:13:58.791 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:58.789+0000 7f1b81536800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:13:58.791 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:58.789+0000 7f1b81536800 20 rados->read ofs=0 len=0 2024-06-04T16:13:58.792 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:58.790+0000 7f1b81536800 20 rados_obj.operate() r=0 bl.length=46 2024-06-04T16:13:58.792 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:58.790+0000 7f1b81536800 20 rados->read ofs=0 len=0 2024-06-04T16:13:58.793 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:58.790+0000 7f1b81536800 20 rados_obj.operate() r=0 bl.length=470 2024-06-04T16:13:58.794 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:58.790+0000 7f1b81536800 20 zone default found 2024-06-04T16:13:58.794 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:58.790+0000 7f1b81536800 4 Realm: () 2024-06-04T16:13:58.794 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:58.790+0000 7f1b81536800 4 ZoneGroup: default (abb22408-c332-4e28-8f7a-ff254ea2fed2) 2024-06-04T16:13:58.794 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:58.790+0000 7f1b81536800 4 Zone: default (be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767) 2024-06-04T16:13:58.794 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:58.790+0000 7f1b81536800 10 cannot find current period zonegroup using local zonegroup configuration 2024-06-04T16:13:58.795 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:58.790+0000 7f1b81536800 20 zonegroup default 2024-06-04T16:13:58.795 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:58.790+0000 7f1b81536800 20 rados->read ofs=0 len=0 2024-06-04T16:13:58.795 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:58.790+0000 7f1b81536800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:13:58.795 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:58.790+0000 7f1b81536800 20 rados->read ofs=0 len=0 2024-06-04T16:13:58.795 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:58.791+0000 7f1b81536800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:13:58.795 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:58.791+0000 7f1b81536800 20 rados->read ofs=0 len=0 2024-06-04T16:13:58.796 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:58.791+0000 7f1b81536800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:13:58.796 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:58.791+0000 7f1b81536800 20 started sync module instance, tier type = 2024-06-04T16:13:58.796 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:58.791+0000 7f1b81536800 20 started zone id=be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767 (name=default) with tier type = 2024-06-04T16:13:58.801 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:58.800+0000 7f1b81536800 20 add_watcher() i=0 2024-06-04T16:13:58.802 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:58.800+0000 7f1b81536800 20 add_watcher() i=1 2024-06-04T16:13:58.802 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:58.800+0000 7f1b81536800 20 add_watcher() i=2 2024-06-04T16:13:58.802 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:58.800+0000 7f1b81536800 20 add_watcher() i=3 2024-06-04T16:13:58.802 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:58.800+0000 7f1b81536800 20 add_watcher() i=4 2024-06-04T16:13:58.802 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:58.800+0000 7f1b81536800 20 add_watcher() i=5 2024-06-04T16:13:58.802 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:58.800+0000 7f1b81536800 20 add_watcher() i=6 2024-06-04T16:13:58.803 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:58.802+0000 7f1b81536800 20 add_watcher() i=7 2024-06-04T16:13:58.803 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:58.802+0000 7f1b81536800 2 all 8 watchers are set, enabling cache 2024-06-04T16:13:58.805 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:58.804+0000 7f1a337e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-06-04T16:13:58.806 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:58.804+0000 7f1b81536800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-06-04T16:13:58.806 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:58.804+0000 7f1b81536800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-06-04T16:13:58.806 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:58.804+0000 7f1b81536800 5 note: GC not initialized 2024-06-04T16:13:58.806 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:58.804+0000 7f1a327e4640 20 reqs_thread_entry: start 2024-06-04T16:13:58.806 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:58.804+0000 7f1b81536800 20 init_complete bucket index max shards: 11 2024-06-04T16:13:58.806 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:58.804+0000 7f1b81536800 20 Filter name: none 2024-06-04T16:13:58.806 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:58.804+0000 7f19a3fff640 20 reqs_thread_entry: start 2024-06-04T16:13:58.806 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:58.804+0000 7f1b81536800 20 rados->read ofs=0 len=0 2024-06-04T16:13:58.806 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:58.805+0000 7f1b81536800 20 rados_obj.operate() r=0 bl.length=173 2024-06-04T16:13:58.806 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:58.805+0000 7f1b81536800 20 rados->read ofs=0 len=0 2024-06-04T16:13:58.807 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:58.805+0000 7f1b81536800 20 rados_obj.operate() r=0 bl.length=387 2024-06-04T16:13:58.807 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:58.805+0000 7f1b81536800 20 couldn't put binfo cache entry, might have raced with data changes 2024-06-04T16:13:58.807 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:58.805+0000 7f1b81536800 20 rados->read ofs=0 len=0 2024-06-04T16:13:58.807 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:58.806+0000 7f1b81536800 20 rados_obj.operate() r=0 bl.length=173 2024-06-04T16:13:58.807 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:58.806+0000 7f1b81536800 20 rados->read ofs=0 len=0 2024-06-04T16:13:58.807 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:58.806+0000 7f1b81536800 20 rados_obj.operate() r=0 bl.length=387 2024-06-04T16:13:58.807 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:58.806+0000 7f1b81536800 20 couldn't put binfo cache entry, might have raced with data changes 2024-06-04T16:13:58.808 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:58.808+0000 7f1a337e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-06-04T16:13:58.810 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:58.810+0000 7f1b81536800 20 remove_watcher() i=0 2024-06-04T16:13:58.811 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:58.810+0000 7f1b81536800 2 removed watcher, disabling cache 2024-06-04T16:13:58.812 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:58.811+0000 7f1b81536800 20 remove_watcher() i=1 2024-06-04T16:13:58.813 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:58.812+0000 7f1b81536800 20 remove_watcher() i=2 2024-06-04T16:13:58.814 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:58.813+0000 7f1b81536800 20 remove_watcher() i=3 2024-06-04T16:13:58.815 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:58.814+0000 7f1b81536800 20 remove_watcher() i=4 2024-06-04T16:13:58.816 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:58.815+0000 7f1b81536800 20 remove_watcher() i=5 2024-06-04T16:13:58.817 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:58.816+0000 7f1b81536800 20 remove_watcher() i=6 2024-06-04T16:13:58.818 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:58.818+0000 7f1b81536800 20 remove_watcher() i=7 2024-06-04T16:13:58.829 INFO:tasks.workunit.client.0.smithi144.stderr: 2024-06-04T16:13:58.829 INFO:tasks.workunit.client.0.smithi144.stderr:BUCKET_STATS: 2024-06-04T16:13:58.829 INFO:tasks.workunit.client.0.smithi144.stderr:bucket: myver id: be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18 num_objects: 0 size_kb: 0 num_shards: 12 2024-06-04T16:13:58.829 INFO:tasks.workunit.client.0.smithi144.stderr: 2024-06-04T16:13:58.830 INFO:tasks.workunit.client.0.smithi144.stderr:radosgw-admin --inject-delay-at=do_reshard --inject-delay-ms=5000 bucket reshard --bucket myver --num-shards 13 2024-06-04T16:13:58.863 INFO:tasks.workunit.client.0.smithi144.stderr:ignoring --setuser ceph since I am not root 2024-06-04T16:13:58.863 INFO:tasks.workunit.client.0.smithi144.stderr:ignoring --setgroup ceph since I am not root 2024-06-04T16:13:58.903 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:58.899+0000 7f987bd1f800 20 rados->read ofs=0 len=0 2024-06-04T16:13:58.903 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:58.900+0000 7f987bd1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:13:58.903 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:58.900+0000 7f987bd1f800 20 realm 2024-06-04T16:13:58.903 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:58.900+0000 7f987bd1f800 20 rados->read ofs=0 len=0 2024-06-04T16:13:58.903 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:58.901+0000 7f987bd1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:13:58.903 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:58.901+0000 7f987bd1f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-06-04T16:13:58.903 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:58.901+0000 7f987bd1f800 20 rados->read ofs=0 len=0 2024-06-04T16:13:58.903 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:58.901+0000 7f987bd1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:13:58.903 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:58.901+0000 7f987bd1f800 20 rados->read ofs=0 len=0 2024-06-04T16:13:58.903 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:58.901+0000 7f987bd1f800 20 rados_obj.operate() r=0 bl.length=46 2024-06-04T16:13:58.903 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:58.901+0000 7f987bd1f800 20 rados->read ofs=0 len=0 2024-06-04T16:13:58.904 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:58.902+0000 7f987bd1f800 20 rados_obj.operate() r=0 bl.length=1139 2024-06-04T16:13:58.904 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:58.902+0000 7f987bd1f800 20 searching for the correct realm 2024-06-04T16:13:58.905 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:58.904+0000 7f98781ba640 0 -- 172.21.15.144:0/3537014995 >> [v2:172.21.15.144:6800/1453747520,v1:172.21.15.144:6801/1453747520] conn(0x7f9860029070 msgr2=0x7f9860072a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-06-04T16:13:59.110 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:59.109+0000 7f98781ba640 0 -- 172.21.15.144:0/3537014995 >> [v2:172.21.15.144:6824/166159729,v1:172.21.15.144:6825/166159729] conn(0x55d13fffc760 msgr2=0x55d13fffeb70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-06-04T16:13:59.116 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:59.114+0000 7f987bd1f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-06-04T16:13:59.116 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:59.114+0000 7f987bd1f800 20 RGWRados::pool_iterate: got zone_info.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767 2024-06-04T16:13:59.116 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:59.114+0000 7f987bd1f800 20 RGWRados::pool_iterate: got default.zone. 2024-06-04T16:13:59.116 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:59.114+0000 7f987bd1f800 20 RGWRados::pool_iterate: got zonegroup_info.abb22408-c332-4e28-8f7a-ff254ea2fed2 2024-06-04T16:13:59.116 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:59.114+0000 7f987bd1f800 20 RGWRados::pool_iterate: got zone_names.default 2024-06-04T16:13:59.116 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:59.114+0000 7f987bd1f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-06-04T16:13:59.116 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:59.114+0000 7f987bd1f800 20 rados->read ofs=0 len=0 2024-06-04T16:13:59.116 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:59.115+0000 7f987bd1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:13:59.116 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:59.115+0000 7f987bd1f800 20 rados->read ofs=0 len=0 2024-06-04T16:13:59.116 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:59.115+0000 7f987bd1f800 20 rados_obj.operate() r=0 bl.length=46 2024-06-04T16:13:59.117 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:59.115+0000 7f987bd1f800 20 rados->read ofs=0 len=0 2024-06-04T16:13:59.118 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:59.115+0000 7f987bd1f800 20 rados_obj.operate() r=0 bl.length=470 2024-06-04T16:13:59.118 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:59.115+0000 7f987bd1f800 20 zone default found 2024-06-04T16:13:59.118 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:59.115+0000 7f987bd1f800 4 Realm: () 2024-06-04T16:13:59.118 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:59.115+0000 7f987bd1f800 4 ZoneGroup: default (abb22408-c332-4e28-8f7a-ff254ea2fed2) 2024-06-04T16:13:59.118 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:59.115+0000 7f987bd1f800 4 Zone: default (be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767) 2024-06-04T16:13:59.118 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:59.115+0000 7f987bd1f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-06-04T16:13:59.118 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:59.115+0000 7f987bd1f800 20 zonegroup default 2024-06-04T16:13:59.118 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:59.115+0000 7f987bd1f800 20 rados->read ofs=0 len=0 2024-06-04T16:13:59.119 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:59.116+0000 7f987bd1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:13:59.119 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:59.116+0000 7f987bd1f800 20 rados->read ofs=0 len=0 2024-06-04T16:13:59.119 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:59.116+0000 7f987bd1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:13:59.119 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:59.116+0000 7f987bd1f800 20 rados->read ofs=0 len=0 2024-06-04T16:13:59.119 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:59.116+0000 7f987bd1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:13:59.119 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:59.116+0000 7f987bd1f800 20 started sync module instance, tier type = 2024-06-04T16:13:59.119 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:59.116+0000 7f987bd1f800 20 started zone id=be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767 (name=default) with tier type = 2024-06-04T16:13:59.126 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:59.126+0000 7f987bd1f800 20 add_watcher() i=0 2024-06-04T16:13:59.126 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:59.126+0000 7f987bd1f800 20 add_watcher() i=1 2024-06-04T16:13:59.126 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:59.126+0000 7f987bd1f800 20 add_watcher() i=2 2024-06-04T16:13:59.127 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:59.126+0000 7f987bd1f800 20 add_watcher() i=3 2024-06-04T16:13:59.127 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:59.126+0000 7f987bd1f800 20 add_watcher() i=4 2024-06-04T16:13:59.127 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:59.126+0000 7f987bd1f800 20 add_watcher() i=5 2024-06-04T16:13:59.127 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:59.126+0000 7f987bd1f800 20 add_watcher() i=6 2024-06-04T16:13:59.127 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:59.127+0000 7f987bd1f800 20 add_watcher() i=7 2024-06-04T16:13:59.127 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:59.127+0000 7f987bd1f800 2 all 8 watchers are set, enabling cache 2024-06-04T16:13:59.129 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:59.128+0000 7f972dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-06-04T16:13:59.131 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:59.129+0000 7f987bd1f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-06-04T16:13:59.131 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:59.129+0000 7f987bd1f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-06-04T16:13:59.131 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:59.129+0000 7f987bd1f800 5 note: GC not initialized 2024-06-04T16:13:59.131 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:59.129+0000 7f972cfe1640 20 reqs_thread_entry: start 2024-06-04T16:13:59.131 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:59.129+0000 7f987bd1f800 20 init_complete bucket index max shards: 11 2024-06-04T16:13:59.131 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:59.129+0000 7f987bd1f800 20 Filter name: none 2024-06-04T16:13:59.131 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:59.129+0000 7f96a67fc640 20 reqs_thread_entry: start 2024-06-04T16:13:59.131 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:59.129+0000 7f987bd1f800 10 cache get: name=default.rgw.meta+root+myver : miss 2024-06-04T16:13:59.131 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:59.129+0000 7f987bd1f800 20 rados->read ofs=0 len=0 2024-06-04T16:13:59.132 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:59.130+0000 7f987bd1f800 20 rados_obj.operate() r=0 bl.length=173 2024-06-04T16:13:59.132 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:59.130+0000 7f987bd1f800 10 cache put: name=default.rgw.meta+root+myver info.flags=0x11 2024-06-04T16:13:59.132 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:59.130+0000 7f987bd1f800 10 adding default.rgw.meta+root+myver to cache LRU end 2024-06-04T16:13:59.132 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:59.130+0000 7f987bd1f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18 : miss 2024-06-04T16:13:59.132 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:59.130+0000 7f987bd1f800 20 rados->read ofs=0 len=0 2024-06-04T16:13:59.132 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:59.130+0000 7f987bd1f800 20 rados_obj.operate() r=0 bl.length=387 2024-06-04T16:13:59.132 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:59.130+0000 7f987bd1f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18 info.flags=0x17 2024-06-04T16:13:59.132 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:59.130+0000 7f987bd1f800 10 adding default.rgw.meta+root+.bucket.meta.myver:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18 to cache LRU end 2024-06-04T16:13:59.132 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:59.130+0000 7f987bd1f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-06-04T16:13:59.132 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:59.130+0000 7f987bd1f800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-06-04T16:13:59.132 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:59.130+0000 7f987bd1f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18 2024-06-04T16:13:59.136 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:59.135+0000 7f987bd1f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18 info.flags=0x17 2024-06-04T16:13:59.136 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:59.135+0000 7f987bd1f800 10 moving default.rgw.meta+root+.bucket.meta.myver:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18 to cache LRU end 2024-06-04T16:13:59.136 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:59.135+0000 7f987bd1f800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-06-04T16:13:59.136 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:59.135+0000 7f987bd1f800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18, ofs0, ns] 2024-06-04T16:13:59.137 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:59.136+0000 7f97567fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1078036791392 cookie 94357210297776 notifier 7194 bl.length()=813 2024-06-04T16:13:59.137 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:59.136+0000 7f97567fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18 info.flags=0x17 2024-06-04T16:13:59.137 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:59.136+0000 7f97567fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18 to cache LRU end 2024-06-04T16:13:59.137 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:59.136+0000 7f97567fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-06-04T16:13:59.138 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:59.136+0000 7f987bd1f800 20 handle_bi_update(): bucket=:myver[be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18]): orig_sources= new_sources= 2024-06-04T16:13:59.138 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:59.136+0000 7f987bd1f800 20 handle_bi_update(): bucket=:myver[be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18]): potential sources added=[] removed=[] 2024-06-04T16:13:59.138 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:59.136+0000 7f987bd1f800 20 handle_bi_update(): bucket=:myver[be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18]): orig_dests= new_dests= 2024-06-04T16:13:59.138 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:59.136+0000 7f987bd1f800 20 handle_bi_update(): bucket=:myver[be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18]): potential dests added=[] removed=[] 2024-06-04T16:13:59.142 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:13:59.141+0000 7f987bd1f800 -1 Injecting delay=5.000000000s at location=do_reshard 2024-06-04T16:13:59.834 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:13:59.835 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:14:04.143 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:04.141+0000 7f987bd1f800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18.2.0 2024-06-04T16:14:04.143 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:04.141+0000 7f987bd1f800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18.2.0 2024-06-04T16:14:04.143 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:04.141+0000 7f987bd1f800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18.2.1 2024-06-04T16:14:04.143 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:04.141+0000 7f987bd1f800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18.2.1 2024-06-04T16:14:04.143 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:04.141+0000 7f987bd1f800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18.2.2 2024-06-04T16:14:04.143 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:04.141+0000 7f987bd1f800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18.2.2 2024-06-04T16:14:04.143 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:04.141+0000 7f987bd1f800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18.2.3 2024-06-04T16:14:04.143 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:04.141+0000 7f987bd1f800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18.2.3 2024-06-04T16:14:04.143 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:04.141+0000 7f987bd1f800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18.2.4 2024-06-04T16:14:04.143 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:04.141+0000 7f987bd1f800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18.2.4 2024-06-04T16:14:04.144 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:04.141+0000 7f987bd1f800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18.2.5 2024-06-04T16:14:04.144 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:04.141+0000 7f987bd1f800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18.2.5 2024-06-04T16:14:04.144 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:04.141+0000 7f987bd1f800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18.2.6 2024-06-04T16:14:04.144 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:04.141+0000 7f987bd1f800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18.2.6 2024-06-04T16:14:04.144 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:04.141+0000 7f987bd1f800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18.2.7 2024-06-04T16:14:04.144 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:04.141+0000 7f987bd1f800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18.2.7 2024-06-04T16:14:04.144 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:04.141+0000 7f987bd1f800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18.2.8 2024-06-04T16:14:04.144 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:04.141+0000 7f987bd1f800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18.2.8 2024-06-04T16:14:04.144 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:04.141+0000 7f987bd1f800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18.2.9 2024-06-04T16:14:04.144 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:04.141+0000 7f987bd1f800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18.2.9 2024-06-04T16:14:04.144 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:04.141+0000 7f987bd1f800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18.2.10 2024-06-04T16:14:04.144 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:04.141+0000 7f987bd1f800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18.2.10 2024-06-04T16:14:04.145 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:04.141+0000 7f987bd1f800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18.2.11 2024-06-04T16:14:04.145 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:04.141+0000 7f987bd1f800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18.2.11 2024-06-04T16:14:04.145 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:04.141+0000 7f987bd1f800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18.2.12 2024-06-04T16:14:04.145 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:04.141+0000 7f987bd1f800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18.2.12 2024-06-04T16:14:04.145 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:04.141+0000 7f987bd1f800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18.1.0 2024-06-04T16:14:04.145 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:04.141+0000 7f987bd1f800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18.1.0 2024-06-04T16:14:04.146 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:04.142+0000 7f987bd1f800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18.1.1 2024-06-04T16:14:04.146 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:04.142+0000 7f987bd1f800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18.1.1 2024-06-04T16:14:04.146 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:04.143+0000 7f987bd1f800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18.1.2 2024-06-04T16:14:04.146 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:04.143+0000 7f987bd1f800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18.1.2 2024-06-04T16:14:04.146 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:04.143+0000 7f987bd1f800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18.1.3 2024-06-04T16:14:04.146 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:04.143+0000 7f987bd1f800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18.1.3 2024-06-04T16:14:04.146 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:04.144+0000 7f987bd1f800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18.1.4 2024-06-04T16:14:04.146 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:04.144+0000 7f987bd1f800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18.1.4 2024-06-04T16:14:04.146 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:04.145+0000 7f987bd1f800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18.1.5 2024-06-04T16:14:04.147 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:04.145+0000 7f987bd1f800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18.1.5 2024-06-04T16:14:04.147 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:04.146+0000 7f987bd1f800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18.1.6 2024-06-04T16:14:04.147 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:04.146+0000 7f987bd1f800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18.1.6 2024-06-04T16:14:04.147 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:04.147+0000 7f987bd1f800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18.1.7 2024-06-04T16:14:04.147 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:04.147+0000 7f987bd1f800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18.1.7 2024-06-04T16:14:04.148 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:04.147+0000 7f987bd1f800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18.1.8 2024-06-04T16:14:04.148 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:04.147+0000 7f987bd1f800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18.1.8 2024-06-04T16:14:04.149 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:04.148+0000 7f987bd1f800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18.1.9 2024-06-04T16:14:04.149 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:04.148+0000 7f987bd1f800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18.1.9 2024-06-04T16:14:04.150 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:04.149+0000 7f987bd1f800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18.1.10 2024-06-04T16:14:04.150 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:04.149+0000 7f987bd1f800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18.1.10 2024-06-04T16:14:04.150 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:04.150+0000 7f987bd1f800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18.1.11 2024-06-04T16:14:04.151 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:04.150+0000 7f987bd1f800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18.1.11 2024-06-04T16:14:04.151 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:04.151+0000 7f987bd1f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18 : hit (requested=0x17, cached=0x17) 2024-06-04T16:14:04.151 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:04.151+0000 7f987bd1f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18 2024-06-04T16:14:04.153 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:04.152+0000 7f987bd1f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18 info.flags=0x17 2024-06-04T16:14:04.153 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:04.152+0000 7f987bd1f800 10 moving default.rgw.meta+root+.bucket.meta.myver:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18 to cache LRU end 2024-06-04T16:14:04.153 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:04.152+0000 7f987bd1f800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-06-04T16:14:04.153 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:04.152+0000 7f987bd1f800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18, ofs0, ns] 2024-06-04T16:14:04.154 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:04.153+0000 7f97567fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1078036791393 cookie 94357210297776 notifier 7194 bl.length()=781 2024-06-04T16:14:04.154 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:04.153+0000 7f97567fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18 info.flags=0x17 2024-06-04T16:14:04.154 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:04.153+0000 7f97567fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18 to cache LRU end 2024-06-04T16:14:04.154 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:04.153+0000 7f97567fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-06-04T16:14:04.154 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:04.154+0000 7f987bd1f800 20 handle_bi_update(): bucket=:myver[be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18]): orig_sources= new_sources= 2024-06-04T16:14:04.155 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:04.154+0000 7f987bd1f800 20 handle_bi_update(): bucket=:myver[be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18]): potential sources added=[] removed=[] 2024-06-04T16:14:04.155 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:04.154+0000 7f987bd1f800 20 handle_bi_update(): bucket=:myver[be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18]): orig_dests= new_dests= 2024-06-04T16:14:04.155 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:04.154+0000 7f987bd1f800 20 handle_bi_update(): bucket=:myver[be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18]): potential dests added=[] removed=[] 2024-06-04T16:14:04.157 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:04.156+0000 7f987bd1f800 1 execute INFO: reshard of bucket "myver" completed successfully 2024-06-04T16:14:04.160 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:04.159+0000 7f972dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-06-04T16:14:04.163 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:04.162+0000 7f987bd1f800 20 remove_watcher() i=0 2024-06-04T16:14:04.163 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:04.162+0000 7f987bd1f800 2 removed watcher, disabling cache 2024-06-04T16:14:04.164 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:04.164+0000 7f987bd1f800 20 remove_watcher() i=1 2024-06-04T16:14:04.165 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:04.165+0000 7f987bd1f800 20 remove_watcher() i=2 2024-06-04T16:14:04.167 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:04.166+0000 7f987bd1f800 20 remove_watcher() i=3 2024-06-04T16:14:04.168 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:04.168+0000 7f987bd1f800 20 remove_watcher() i=4 2024-06-04T16:14:04.170 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:04.169+0000 7f987bd1f800 20 remove_watcher() i=5 2024-06-04T16:14:04.171 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:04.170+0000 7f987bd1f800 20 remove_watcher() i=6 2024-06-04T16:14:04.172 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:04.172+0000 7f987bd1f800 20 remove_watcher() i=7 2024-06-04T16:14:04.861 INFO:tasks.workunit.client.0.smithi144.stderr:put object successful 2024-06-04T16:14:04.861 INFO:tasks.workunit.client.0.smithi144.stderr:TEST: check that bucket stats are correct after reshard with unlinked entries 2024-06-04T16:14:04.862 INFO:tasks.workunit.client.0.smithi144.stderr: 2024-06-04T16:14:04.864 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:14:04.864 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:14:04.910 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:14:04.910 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:14:04.952 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:14:04.953 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:14:04.969 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:14:04.969 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:14:04.973 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:14:04.973 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:14:04.987 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:14:04.987 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:14:04.991 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:14:04.991 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:14:05.004 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:14:05.004 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:14:05.009 INFO:tasks.workunit.client.0.smithi144.stderr:ceph config set client rgw_debug_inject_set_olh_err 2 2024-06-04T16:14:05.409 INFO:tasks.workunit.client.0.smithi144.stderr:ceph config set client rgw_debug_inject_olh_cancel_modification_err true 2024-06-04T16:14:06.814 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:14:06.815 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:14:06.866 INFO:tasks.workunit.client.0.smithi144.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-06-04T16:14:06.868 INFO:tasks.workunit.client.0.smithi144.stderr:radosgw-admin bi list --bucket myver --object x 2024-06-04T16:14:06.901 INFO:tasks.workunit.client.0.smithi144.stderr:ignoring --setuser ceph since I am not root 2024-06-04T16:14:06.901 INFO:tasks.workunit.client.0.smithi144.stderr:ignoring --setgroup ceph since I am not root 2024-06-04T16:14:06.942 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:06.941+0000 7f748dd33800 20 rados->read ofs=0 len=0 2024-06-04T16:14:06.944 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:06.943+0000 7f748dd33800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:14:06.944 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:06.943+0000 7f748dd33800 20 realm 2024-06-04T16:14:06.944 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:06.943+0000 7f748dd33800 20 rados->read ofs=0 len=0 2024-06-04T16:14:06.944 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:06.943+0000 7f748dd33800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:14:06.945 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:06.943+0000 7f748dd33800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-06-04T16:14:06.945 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:06.943+0000 7f748dd33800 20 rados->read ofs=0 len=0 2024-06-04T16:14:06.945 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:06.943+0000 7f748dd33800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:14:06.945 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:06.943+0000 7f748dd33800 20 rados->read ofs=0 len=0 2024-06-04T16:14:06.945 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:06.944+0000 7f748dd33800 20 rados_obj.operate() r=0 bl.length=46 2024-06-04T16:14:06.945 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:06.944+0000 7f748dd33800 20 rados->read ofs=0 len=0 2024-06-04T16:14:06.946 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:06.945+0000 7f748dd33800 20 rados_obj.operate() r=0 bl.length=1139 2024-06-04T16:14:06.946 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:06.945+0000 7f748dd33800 20 searching for the correct realm 2024-06-04T16:14:06.948 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:06.947+0000 7f748a1ec640 0 -- 172.21.15.144:0/1334945935 >> [v2:172.21.15.144:6800/1453747520,v1:172.21.15.144:6801/1453747520] conn(0x7f7474098b80 msgr2=0x7f7474046cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-06-04T16:14:07.153 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:07.152+0000 7f748a1ec640 0 -- 172.21.15.144:0/1334945935 >> [v2:172.21.15.144:6824/166159729,v1:172.21.15.144:6825/166159729] conn(0x561ffce22ce0 msgr2=0x561ffce250d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-06-04T16:14:07.159 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:07.158+0000 7f748dd33800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-06-04T16:14:07.159 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:07.158+0000 7f748dd33800 20 RGWRados::pool_iterate: got zone_info.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767 2024-06-04T16:14:07.159 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:07.158+0000 7f748dd33800 20 RGWRados::pool_iterate: got default.zone. 2024-06-04T16:14:07.159 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:07.158+0000 7f748dd33800 20 RGWRados::pool_iterate: got zonegroup_info.abb22408-c332-4e28-8f7a-ff254ea2fed2 2024-06-04T16:14:07.160 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:07.158+0000 7f748dd33800 20 RGWRados::pool_iterate: got zone_names.default 2024-06-04T16:14:07.160 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:07.158+0000 7f748dd33800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-06-04T16:14:07.160 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:07.158+0000 7f748dd33800 20 rados->read ofs=0 len=0 2024-06-04T16:14:07.160 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:07.158+0000 7f748dd33800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:14:07.160 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:07.158+0000 7f748dd33800 20 rados->read ofs=0 len=0 2024-06-04T16:14:07.161 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:07.159+0000 7f748dd33800 20 rados_obj.operate() r=0 bl.length=46 2024-06-04T16:14:07.161 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:07.159+0000 7f748dd33800 20 rados->read ofs=0 len=0 2024-06-04T16:14:07.161 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:07.159+0000 7f748dd33800 20 rados_obj.operate() r=0 bl.length=470 2024-06-04T16:14:07.161 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:07.159+0000 7f748dd33800 20 zone default found 2024-06-04T16:14:07.162 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:07.159+0000 7f748dd33800 4 Realm: () 2024-06-04T16:14:07.162 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:07.159+0000 7f748dd33800 4 ZoneGroup: default (abb22408-c332-4e28-8f7a-ff254ea2fed2) 2024-06-04T16:14:07.162 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:07.159+0000 7f748dd33800 4 Zone: default (be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767) 2024-06-04T16:14:07.162 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:07.159+0000 7f748dd33800 10 cannot find current period zonegroup using local zonegroup configuration 2024-06-04T16:14:07.162 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:07.159+0000 7f748dd33800 20 zonegroup default 2024-06-04T16:14:07.162 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:07.159+0000 7f748dd33800 20 rados->read ofs=0 len=0 2024-06-04T16:14:07.162 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:07.160+0000 7f748dd33800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:14:07.162 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:07.160+0000 7f748dd33800 20 rados->read ofs=0 len=0 2024-06-04T16:14:07.162 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:07.160+0000 7f748dd33800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:14:07.162 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:07.160+0000 7f748dd33800 20 rados->read ofs=0 len=0 2024-06-04T16:14:07.163 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:07.160+0000 7f748dd33800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:14:07.163 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:07.160+0000 7f748dd33800 20 started sync module instance, tier type = 2024-06-04T16:14:07.163 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:07.160+0000 7f748dd33800 20 started zone id=be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767 (name=default) with tier type = 2024-06-04T16:14:07.171 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:07.170+0000 7f748dd33800 20 add_watcher() i=0 2024-06-04T16:14:07.171 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:07.170+0000 7f748dd33800 20 add_watcher() i=1 2024-06-04T16:14:07.172 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:07.170+0000 7f748dd33800 20 add_watcher() i=2 2024-06-04T16:14:07.172 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:07.170+0000 7f748dd33800 20 add_watcher() i=3 2024-06-04T16:14:07.172 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:07.170+0000 7f748dd33800 20 add_watcher() i=4 2024-06-04T16:14:07.172 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:07.170+0000 7f748dd33800 20 add_watcher() i=5 2024-06-04T16:14:07.172 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:07.171+0000 7f748dd33800 20 add_watcher() i=6 2024-06-04T16:14:07.172 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:07.172+0000 7f748dd33800 20 add_watcher() i=7 2024-06-04T16:14:07.173 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:07.172+0000 7f748dd33800 2 all 8 watchers are set, enabling cache 2024-06-04T16:14:07.175 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:07.174+0000 7f733b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-06-04T16:14:07.176 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:07.174+0000 7f748dd33800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-06-04T16:14:07.176 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:07.174+0000 7f748dd33800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-06-04T16:14:07.176 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:07.174+0000 7f748dd33800 5 note: GC not initialized 2024-06-04T16:14:07.176 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:07.175+0000 7f733a7fc640 20 reqs_thread_entry: start 2024-06-04T16:14:07.176 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:07.175+0000 7f748dd33800 20 init_complete bucket index max shards: 11 2024-06-04T16:14:07.176 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:07.175+0000 7f748dd33800 20 Filter name: none 2024-06-04T16:14:07.176 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:07.175+0000 7f72abfff640 20 reqs_thread_entry: start 2024-06-04T16:14:07.177 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:07.175+0000 7f748dd33800 20 rados->read ofs=0 len=0 2024-06-04T16:14:07.178 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:07.176+0000 7f748dd33800 20 rados_obj.operate() r=0 bl.length=173 2024-06-04T16:14:07.178 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:07.176+0000 7f748dd33800 20 rados->read ofs=0 len=0 2024-06-04T16:14:07.178 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:07.176+0000 7f748dd33800 20 rados_obj.operate() r=0 bl.length=387 2024-06-04T16:14:07.178 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:07.176+0000 7f748dd33800 20 couldn't put binfo cache entry, might have raced with data changes 2024-06-04T16:14:07.178 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:07.176+0000 7f748dd33800 20 INFO: main: max_entries=1000, index=gen=2, max_shards=13 2024-06-04T16:14:07.178 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:07.176+0000 7f748dd33800 20 INFO: main: starting shard=0 2024-06-04T16:14:07.178 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:07.176+0000 7f748dd33800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18.2.0 2024-06-04T16:14:07.178 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:07.176+0000 7f748dd33800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18.2.0 2024-06-04T16:14:07.178 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:07.177+0000 7f748dd33800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-06-04T16:14:07.178 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:07.177+0000 7f748dd33800 20 INFO: main: starting shard=1 2024-06-04T16:14:07.179 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:07.177+0000 7f748dd33800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18.2.1 2024-06-04T16:14:07.179 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:07.177+0000 7f748dd33800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18.2.1 2024-06-04T16:14:07.180 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:07.178+0000 7f748dd33800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-06-04T16:14:07.180 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:07.178+0000 7f748dd33800 20 INFO: main: starting shard=2 2024-06-04T16:14:07.180 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:07.178+0000 7f748dd33800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18.2.2 2024-06-04T16:14:07.180 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:07.178+0000 7f748dd33800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18.2.2 2024-06-04T16:14:07.180 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:07.178+0000 7f748dd33800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-06-04T16:14:07.180 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:07.178+0000 7f748dd33800 20 INFO: main: starting shard=3 2024-06-04T16:14:07.180 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:07.178+0000 7f748dd33800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18.2.3 2024-06-04T16:14:07.180 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:07.178+0000 7f748dd33800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18.2.3 2024-06-04T16:14:07.180 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:07.179+0000 7f748dd33800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-06-04T16:14:07.180 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:07.179+0000 7f748dd33800 20 INFO: main: starting shard=4 2024-06-04T16:14:07.180 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:07.179+0000 7f748dd33800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18.2.4 2024-06-04T16:14:07.181 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:07.179+0000 7f748dd33800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18.2.4 2024-06-04T16:14:07.182 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:07.179+0000 7f748dd33800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-06-04T16:14:07.182 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:07.179+0000 7f748dd33800 20 INFO: main: starting shard=5 2024-06-04T16:14:07.182 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:07.179+0000 7f748dd33800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18.2.5 2024-06-04T16:14:07.182 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:07.179+0000 7f748dd33800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18.2.5 2024-06-04T16:14:07.182 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:07.180+0000 7f748dd33800 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-06-04T16:14:07.182 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:07.180+0000 7f748dd33800 20 INFO: main: starting shard=6 2024-06-04T16:14:07.182 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:07.180+0000 7f748dd33800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18.2.6 2024-06-04T16:14:07.182 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:07.180+0000 7f748dd33800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18.2.6 2024-06-04T16:14:07.182 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:07.180+0000 7f748dd33800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-06-04T16:14:07.182 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:07.180+0000 7f748dd33800 20 INFO: main: starting shard=7 2024-06-04T16:14:07.183 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:07.180+0000 7f748dd33800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18.2.7 2024-06-04T16:14:07.183 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:07.180+0000 7f748dd33800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18.2.7 2024-06-04T16:14:07.183 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:07.181+0000 7f748dd33800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-06-04T16:14:07.183 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:07.181+0000 7f748dd33800 20 INFO: main: starting shard=8 2024-06-04T16:14:07.183 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:07.181+0000 7f748dd33800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18.2.8 2024-06-04T16:14:07.183 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:07.181+0000 7f748dd33800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18.2.8 2024-06-04T16:14:07.184 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:07.181+0000 7f748dd33800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-06-04T16:14:07.184 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:07.181+0000 7f748dd33800 20 INFO: main: starting shard=9 2024-06-04T16:14:07.184 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:07.181+0000 7f748dd33800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18.2.9 2024-06-04T16:14:07.184 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:07.181+0000 7f748dd33800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18.2.9 2024-06-04T16:14:07.184 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:07.182+0000 7f748dd33800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-06-04T16:14:07.184 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:07.182+0000 7f748dd33800 20 INFO: main: starting shard=10 2024-06-04T16:14:07.185 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:07.182+0000 7f748dd33800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18.2.10 2024-06-04T16:14:07.185 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:07.182+0000 7f748dd33800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18.2.10 2024-06-04T16:14:07.185 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:07.182+0000 7f748dd33800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-06-04T16:14:07.185 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:07.182+0000 7f748dd33800 20 INFO: main: starting shard=11 2024-06-04T16:14:07.185 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:07.182+0000 7f748dd33800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18.2.11 2024-06-04T16:14:07.185 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:07.182+0000 7f748dd33800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18.2.11 2024-06-04T16:14:07.185 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:07.183+0000 7f748dd33800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-06-04T16:14:07.185 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:07.183+0000 7f748dd33800 20 INFO: main: starting shard=12 2024-06-04T16:14:07.185 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:07.183+0000 7f748dd33800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18.2.12 2024-06-04T16:14:07.185 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:07.183+0000 7f748dd33800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18.2.12 2024-06-04T16:14:07.186 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:07.184+0000 7f748dd33800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-06-04T16:14:07.186 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:07.184+0000 7f748dd33800 20 INFO: main: done 2024-06-04T16:14:07.186 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:07.184+0000 7f733b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-06-04T16:14:07.188 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:07.187+0000 7f748dd33800 20 remove_watcher() i=0 2024-06-04T16:14:07.188 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:07.187+0000 7f748dd33800 2 removed watcher, disabling cache 2024-06-04T16:14:07.189 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:07.188+0000 7f748dd33800 20 remove_watcher() i=1 2024-06-04T16:14:07.190 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:07.189+0000 7f748dd33800 20 remove_watcher() i=2 2024-06-04T16:14:07.191 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:07.190+0000 7f748dd33800 20 remove_watcher() i=3 2024-06-04T16:14:07.192 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:07.191+0000 7f748dd33800 20 remove_watcher() i=4 2024-06-04T16:14:07.193 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:07.192+0000 7f748dd33800 20 remove_watcher() i=5 2024-06-04T16:14:07.194 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:07.193+0000 7f748dd33800 20 remove_watcher() i=6 2024-06-04T16:14:07.195 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:07.195+0000 7f748dd33800 20 remove_watcher() i=7 2024-06-04T16:14:07.211 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:14:07.211 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:14:07.215 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:14:07.215 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:14:07.269 INFO:tasks.workunit.client.0.smithi144.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-06-04T16:14:07.271 INFO:tasks.workunit.client.0.smithi144.stderr:radosgw-admin bi list --bucket myver --object y 2024-06-04T16:14:07.301 INFO:tasks.workunit.client.0.smithi144.stderr:ignoring --setuser ceph since I am not root 2024-06-04T16:14:07.301 INFO:tasks.workunit.client.0.smithi144.stderr:ignoring --setgroup ceph since I am not root 2024-06-04T16:14:07.339 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:07.338+0000 7f5afdfaf800 20 rados->read ofs=0 len=0 2024-06-04T16:14:07.342 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:07.340+0000 7f5afdfaf800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:14:07.342 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:07.340+0000 7f5afdfaf800 20 realm 2024-06-04T16:14:07.342 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:07.340+0000 7f5afdfaf800 20 rados->read ofs=0 len=0 2024-06-04T16:14:07.342 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:07.341+0000 7f5afdfaf800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:14:07.342 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:07.341+0000 7f5afdfaf800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-06-04T16:14:07.342 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:07.341+0000 7f5afdfaf800 20 rados->read ofs=0 len=0 2024-06-04T16:14:07.342 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:07.341+0000 7f5afdfaf800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:14:07.342 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:07.341+0000 7f5afdfaf800 20 rados->read ofs=0 len=0 2024-06-04T16:14:07.343 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:07.341+0000 7f5afdfaf800 20 rados_obj.operate() r=0 bl.length=46 2024-06-04T16:14:07.343 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:07.341+0000 7f5afdfaf800 20 rados->read ofs=0 len=0 2024-06-04T16:14:07.343 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:07.342+0000 7f5afdfaf800 20 rados_obj.operate() r=0 bl.length=1139 2024-06-04T16:14:07.343 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:07.342+0000 7f5afdfaf800 20 searching for the correct realm 2024-06-04T16:14:07.345 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:07.344+0000 7f5afc2ac640 0 -- 172.21.15.144:0/3988450351 >> [v2:172.21.15.144:6800/1453747520,v1:172.21.15.144:6801/1453747520] conn(0x7f5ae4075060 msgr2=0x7f5ae4060090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-06-04T16:14:07.550 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:07.549+0000 7f5afc2ac640 0 -- 172.21.15.144:0/3988450351 >> [v2:172.21.15.144:6824/166159729,v1:172.21.15.144:6825/166159729] conn(0x55b16b9028f0 msgr2=0x55b16b904ce0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-06-04T16:14:07.556 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:07.554+0000 7f5afdfaf800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-06-04T16:14:07.556 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:07.554+0000 7f5afdfaf800 20 RGWRados::pool_iterate: got zone_info.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767 2024-06-04T16:14:07.556 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:07.554+0000 7f5afdfaf800 20 RGWRados::pool_iterate: got default.zone. 2024-06-04T16:14:07.556 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:07.554+0000 7f5afdfaf800 20 RGWRados::pool_iterate: got zonegroup_info.abb22408-c332-4e28-8f7a-ff254ea2fed2 2024-06-04T16:14:07.556 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:07.554+0000 7f5afdfaf800 20 RGWRados::pool_iterate: got zone_names.default 2024-06-04T16:14:07.556 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:07.554+0000 7f5afdfaf800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-06-04T16:14:07.556 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:07.555+0000 7f5afdfaf800 20 rados->read ofs=0 len=0 2024-06-04T16:14:07.556 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:07.555+0000 7f5afdfaf800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:14:07.556 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:07.555+0000 7f5afdfaf800 20 rados->read ofs=0 len=0 2024-06-04T16:14:07.557 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:07.555+0000 7f5afdfaf800 20 rados_obj.operate() r=0 bl.length=46 2024-06-04T16:14:07.557 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:07.555+0000 7f5afdfaf800 20 rados->read ofs=0 len=0 2024-06-04T16:14:07.558 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:07.555+0000 7f5afdfaf800 20 rados_obj.operate() r=0 bl.length=470 2024-06-04T16:14:07.558 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:07.555+0000 7f5afdfaf800 20 zone default found 2024-06-04T16:14:07.558 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:07.555+0000 7f5afdfaf800 4 Realm: () 2024-06-04T16:14:07.558 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:07.555+0000 7f5afdfaf800 4 ZoneGroup: default (abb22408-c332-4e28-8f7a-ff254ea2fed2) 2024-06-04T16:14:07.558 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:07.555+0000 7f5afdfaf800 4 Zone: default (be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767) 2024-06-04T16:14:07.558 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:07.555+0000 7f5afdfaf800 10 cannot find current period zonegroup using local zonegroup configuration 2024-06-04T16:14:07.558 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:07.555+0000 7f5afdfaf800 20 zonegroup default 2024-06-04T16:14:07.559 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:07.555+0000 7f5afdfaf800 20 rados->read ofs=0 len=0 2024-06-04T16:14:07.559 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:07.556+0000 7f5afdfaf800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:14:07.559 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:07.556+0000 7f5afdfaf800 20 rados->read ofs=0 len=0 2024-06-04T16:14:07.559 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:07.556+0000 7f5afdfaf800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:14:07.559 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:07.556+0000 7f5afdfaf800 20 rados->read ofs=0 len=0 2024-06-04T16:14:07.559 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:07.556+0000 7f5afdfaf800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:14:07.559 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:07.556+0000 7f5afdfaf800 20 started sync module instance, tier type = 2024-06-04T16:14:07.559 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:07.556+0000 7f5afdfaf800 20 started zone id=be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767 (name=default) with tier type = 2024-06-04T16:14:07.567 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:07.566+0000 7f5afdfaf800 20 add_watcher() i=0 2024-06-04T16:14:07.567 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:07.566+0000 7f5afdfaf800 20 add_watcher() i=1 2024-06-04T16:14:07.567 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:07.566+0000 7f5afdfaf800 20 add_watcher() i=2 2024-06-04T16:14:07.567 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:07.566+0000 7f5afdfaf800 20 add_watcher() i=3 2024-06-04T16:14:07.567 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:07.566+0000 7f5afdfaf800 20 add_watcher() i=4 2024-06-04T16:14:07.568 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:07.566+0000 7f5afdfaf800 20 add_watcher() i=5 2024-06-04T16:14:07.568 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:07.566+0000 7f5afdfaf800 20 add_watcher() i=6 2024-06-04T16:14:07.568 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:07.567+0000 7f5afdfaf800 20 add_watcher() i=7 2024-06-04T16:14:07.568 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:07.567+0000 7f5afdfaf800 2 all 8 watchers are set, enabling cache 2024-06-04T16:14:07.571 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:07.569+0000 7f59b1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-06-04T16:14:07.571 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:07.569+0000 7f5afdfaf800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-06-04T16:14:07.571 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:07.569+0000 7f5afdfaf800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-06-04T16:14:07.571 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:07.569+0000 7f5afdfaf800 5 note: GC not initialized 2024-06-04T16:14:07.571 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:07.570+0000 7f59b0fe1640 20 reqs_thread_entry: start 2024-06-04T16:14:07.571 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:07.570+0000 7f5afdfaf800 20 init_complete bucket index max shards: 11 2024-06-04T16:14:07.571 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:07.570+0000 7f5afdfaf800 20 Filter name: none 2024-06-04T16:14:07.571 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:07.570+0000 7f592a7fc640 20 reqs_thread_entry: start 2024-06-04T16:14:07.571 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:07.570+0000 7f5afdfaf800 20 rados->read ofs=0 len=0 2024-06-04T16:14:07.573 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:07.570+0000 7f5afdfaf800 20 rados_obj.operate() r=0 bl.length=173 2024-06-04T16:14:07.573 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:07.570+0000 7f5afdfaf800 20 rados->read ofs=0 len=0 2024-06-04T16:14:07.573 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:07.571+0000 7f5afdfaf800 20 rados_obj.operate() r=0 bl.length=387 2024-06-04T16:14:07.573 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:07.571+0000 7f5afdfaf800 20 couldn't put binfo cache entry, might have raced with data changes 2024-06-04T16:14:07.573 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:07.571+0000 7f5afdfaf800 20 INFO: main: max_entries=1000, index=gen=2, max_shards=13 2024-06-04T16:14:07.573 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:07.571+0000 7f5afdfaf800 20 INFO: main: starting shard=0 2024-06-04T16:14:07.573 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:07.571+0000 7f5afdfaf800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18.2.0 2024-06-04T16:14:07.573 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:07.571+0000 7f5afdfaf800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18.2.0 2024-06-04T16:14:07.573 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:07.571+0000 7f5afdfaf800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-06-04T16:14:07.573 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:07.571+0000 7f5afdfaf800 20 INFO: main: starting shard=1 2024-06-04T16:14:07.574 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:07.571+0000 7f5afdfaf800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18.2.1 2024-06-04T16:14:07.574 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:07.571+0000 7f5afdfaf800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18.2.1 2024-06-04T16:14:07.574 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:07.572+0000 7f5afdfaf800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-06-04T16:14:07.574 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:07.572+0000 7f5afdfaf800 20 INFO: main: starting shard=2 2024-06-04T16:14:07.574 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:07.572+0000 7f5afdfaf800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18.2.2 2024-06-04T16:14:07.574 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:07.572+0000 7f5afdfaf800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18.2.2 2024-06-04T16:14:07.575 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:07.573+0000 7f5afdfaf800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-06-04T16:14:07.575 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:07.573+0000 7f5afdfaf800 20 INFO: main: starting shard=3 2024-06-04T16:14:07.575 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:07.573+0000 7f5afdfaf800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18.2.3 2024-06-04T16:14:07.576 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:07.573+0000 7f5afdfaf800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18.2.3 2024-06-04T16:14:07.576 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:07.573+0000 7f5afdfaf800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-06-04T16:14:07.576 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:07.573+0000 7f5afdfaf800 20 INFO: main: starting shard=4 2024-06-04T16:14:07.576 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:07.573+0000 7f5afdfaf800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18.2.4 2024-06-04T16:14:07.576 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:07.573+0000 7f5afdfaf800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18.2.4 2024-06-04T16:14:07.576 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:07.574+0000 7f5afdfaf800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-06-04T16:14:07.576 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:07.574+0000 7f5afdfaf800 20 INFO: main: starting shard=5 2024-06-04T16:14:07.576 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:07.574+0000 7f5afdfaf800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18.2.5 2024-06-04T16:14:07.576 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:07.574+0000 7f5afdfaf800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18.2.5 2024-06-04T16:14:07.576 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:07.574+0000 7f5afdfaf800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-06-04T16:14:07.576 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:07.574+0000 7f5afdfaf800 20 INFO: main: starting shard=6 2024-06-04T16:14:07.577 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:07.574+0000 7f5afdfaf800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18.2.6 2024-06-04T16:14:07.577 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:07.574+0000 7f5afdfaf800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18.2.6 2024-06-04T16:14:07.577 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:07.575+0000 7f5afdfaf800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-06-04T16:14:07.577 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:07.575+0000 7f5afdfaf800 20 INFO: main: starting shard=7 2024-06-04T16:14:07.577 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:07.575+0000 7f5afdfaf800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18.2.7 2024-06-04T16:14:07.577 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:07.575+0000 7f5afdfaf800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18.2.7 2024-06-04T16:14:07.578 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:07.575+0000 7f5afdfaf800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-06-04T16:14:07.578 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:07.575+0000 7f5afdfaf800 20 INFO: main: starting shard=8 2024-06-04T16:14:07.579 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:07.575+0000 7f5afdfaf800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18.2.8 2024-06-04T16:14:07.579 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:07.575+0000 7f5afdfaf800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18.2.8 2024-06-04T16:14:07.579 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:07.576+0000 7f5afdfaf800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-06-04T16:14:07.579 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:07.576+0000 7f5afdfaf800 20 INFO: main: starting shard=9 2024-06-04T16:14:07.579 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:07.576+0000 7f5afdfaf800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18.2.9 2024-06-04T16:14:07.579 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:07.576+0000 7f5afdfaf800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18.2.9 2024-06-04T16:14:07.579 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:07.576+0000 7f5afdfaf800 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-06-04T16:14:07.579 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:07.576+0000 7f5afdfaf800 20 INFO: main: starting shard=10 2024-06-04T16:14:07.579 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:07.576+0000 7f5afdfaf800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18.2.10 2024-06-04T16:14:07.579 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:07.576+0000 7f5afdfaf800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18.2.10 2024-06-04T16:14:07.579 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:07.577+0000 7f5afdfaf800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-06-04T16:14:07.579 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:07.577+0000 7f5afdfaf800 20 INFO: main: starting shard=11 2024-06-04T16:14:07.580 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:07.577+0000 7f5afdfaf800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18.2.11 2024-06-04T16:14:07.580 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:07.577+0000 7f5afdfaf800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18.2.11 2024-06-04T16:14:07.580 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:07.577+0000 7f5afdfaf800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-06-04T16:14:07.580 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:07.577+0000 7f5afdfaf800 20 INFO: main: starting shard=12 2024-06-04T16:14:07.580 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:07.577+0000 7f5afdfaf800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18.2.12 2024-06-04T16:14:07.580 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:07.577+0000 7f5afdfaf800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18.2.12 2024-06-04T16:14:07.580 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:07.578+0000 7f5afdfaf800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-06-04T16:14:07.581 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:07.578+0000 7f5afdfaf800 20 INFO: main: done 2024-06-04T16:14:07.581 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:07.579+0000 7f59b1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-06-04T16:14:07.582 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:07.581+0000 7f5afdfaf800 20 remove_watcher() i=0 2024-06-04T16:14:07.582 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:07.581+0000 7f5afdfaf800 2 removed watcher, disabling cache 2024-06-04T16:14:07.583 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:07.582+0000 7f5afdfaf800 20 remove_watcher() i=1 2024-06-04T16:14:07.584 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:07.583+0000 7f5afdfaf800 20 remove_watcher() i=2 2024-06-04T16:14:07.586 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:07.585+0000 7f5afdfaf800 20 remove_watcher() i=3 2024-06-04T16:14:07.587 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:07.586+0000 7f5afdfaf800 20 remove_watcher() i=4 2024-06-04T16:14:07.588 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:07.587+0000 7f5afdfaf800 20 remove_watcher() i=5 2024-06-04T16:14:07.589 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:07.588+0000 7f5afdfaf800 20 remove_watcher() i=6 2024-06-04T16:14:07.590 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:07.589+0000 7f5afdfaf800 20 remove_watcher() i=7 2024-06-04T16:14:07.603 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:14:07.603 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:14:07.606 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:14:07.606 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:14:07.654 INFO:tasks.workunit.client.0.smithi144.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-06-04T16:14:07.656 INFO:tasks.workunit.client.0.smithi144.stderr:radosgw-admin bi list --bucket myver --object z 2024-06-04T16:14:07.685 INFO:tasks.workunit.client.0.smithi144.stderr:ignoring --setuser ceph since I am not root 2024-06-04T16:14:07.685 INFO:tasks.workunit.client.0.smithi144.stderr:ignoring --setgroup ceph since I am not root 2024-06-04T16:14:07.722 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:07.721+0000 7f9777b29800 20 rados->read ofs=0 len=0 2024-06-04T16:14:07.724 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:07.723+0000 7f9777b29800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:14:07.724 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:07.723+0000 7f9777b29800 20 realm 2024-06-04T16:14:07.724 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:07.723+0000 7f9777b29800 20 rados->read ofs=0 len=0 2024-06-04T16:14:07.724 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:07.723+0000 7f9777b29800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:14:07.724 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:07.723+0000 7f9777b29800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-06-04T16:14:07.725 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:07.723+0000 7f9777b29800 20 rados->read ofs=0 len=0 2024-06-04T16:14:07.725 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:07.723+0000 7f9777b29800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:14:07.725 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:07.724+0000 7f9777b29800 20 rados->read ofs=0 len=0 2024-06-04T16:14:07.725 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:07.724+0000 7f9777b29800 20 rados_obj.operate() r=0 bl.length=46 2024-06-04T16:14:07.725 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:07.724+0000 7f9777b29800 20 rados->read ofs=0 len=0 2024-06-04T16:14:07.726 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:07.725+0000 7f9777b29800 20 rados_obj.operate() r=0 bl.length=1139 2024-06-04T16:14:07.726 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:07.725+0000 7f9777b29800 20 searching for the correct realm 2024-06-04T16:14:07.728 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:07.727+0000 7f9773f45640 0 -- 172.21.15.144:0/2469326282 >> [v2:172.21.15.144:6800/1453747520,v1:172.21.15.144:6801/1453747520] conn(0x7f975c033060 msgr2=0x7f975c0658b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-06-04T16:14:08.535 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:08.534+0000 7f976bfff640 0 -- 172.21.15.144:0/2469326282 >> [v2:172.21.15.177:6808/2618477608,v1:172.21.15.177:6809/2618477608] conn(0x7f975c088050 msgr2=0x7f975c064fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-06-04T16:14:08.743 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:08.742+0000 7f9777b29800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-06-04T16:14:08.743 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:08.742+0000 7f9777b29800 20 RGWRados::pool_iterate: got zone_info.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767 2024-06-04T16:14:08.744 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:08.742+0000 7f9777b29800 20 RGWRados::pool_iterate: got default.zone. 2024-06-04T16:14:08.744 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:08.742+0000 7f9777b29800 20 RGWRados::pool_iterate: got zonegroup_info.abb22408-c332-4e28-8f7a-ff254ea2fed2 2024-06-04T16:14:08.744 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:08.742+0000 7f9777b29800 20 RGWRados::pool_iterate: got zone_names.default 2024-06-04T16:14:08.744 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:08.742+0000 7f9777b29800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-06-04T16:14:08.744 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:08.742+0000 7f9777b29800 20 rados->read ofs=0 len=0 2024-06-04T16:14:08.744 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:08.742+0000 7f9777b29800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:14:08.744 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:08.742+0000 7f9777b29800 20 rados->read ofs=0 len=0 2024-06-04T16:14:08.745 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:08.743+0000 7f9777b29800 20 rados_obj.operate() r=0 bl.length=46 2024-06-04T16:14:08.745 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:08.743+0000 7f9777b29800 20 rados->read ofs=0 len=0 2024-06-04T16:14:08.745 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:08.743+0000 7f9777b29800 20 rados_obj.operate() r=0 bl.length=470 2024-06-04T16:14:08.745 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:08.743+0000 7f9777b29800 20 zone default found 2024-06-04T16:14:08.746 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:08.743+0000 7f9777b29800 4 Realm: () 2024-06-04T16:14:08.746 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:08.743+0000 7f9777b29800 4 ZoneGroup: default (abb22408-c332-4e28-8f7a-ff254ea2fed2) 2024-06-04T16:14:08.746 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:08.743+0000 7f9777b29800 4 Zone: default (be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767) 2024-06-04T16:14:08.746 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:08.743+0000 7f9777b29800 10 cannot find current period zonegroup using local zonegroup configuration 2024-06-04T16:14:08.746 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:08.743+0000 7f9777b29800 20 zonegroup default 2024-06-04T16:14:08.746 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:08.743+0000 7f9777b29800 20 rados->read ofs=0 len=0 2024-06-04T16:14:08.746 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:08.744+0000 7f9777b29800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:14:08.746 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:08.744+0000 7f9777b29800 20 rados->read ofs=0 len=0 2024-06-04T16:14:08.746 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:08.744+0000 7f9777b29800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:14:08.746 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:08.744+0000 7f9777b29800 20 rados->read ofs=0 len=0 2024-06-04T16:14:08.746 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:08.745+0000 7f9777b29800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:14:08.746 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:08.745+0000 7f9777b29800 20 started sync module instance, tier type = 2024-06-04T16:14:08.746 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:08.745+0000 7f9777b29800 20 started zone id=be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767 (name=default) with tier type = 2024-06-04T16:14:08.756 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:08.755+0000 7f9777b29800 20 add_watcher() i=0 2024-06-04T16:14:08.756 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:08.755+0000 7f9777b29800 20 add_watcher() i=1 2024-06-04T16:14:08.756 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:08.755+0000 7f9777b29800 20 add_watcher() i=2 2024-06-04T16:14:08.756 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:08.755+0000 7f9777b29800 20 add_watcher() i=3 2024-06-04T16:14:08.757 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:08.755+0000 7f9777b29800 20 add_watcher() i=4 2024-06-04T16:14:08.757 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:08.755+0000 7f9777b29800 20 add_watcher() i=5 2024-06-04T16:14:08.757 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:08.755+0000 7f9777b29800 20 add_watcher() i=6 2024-06-04T16:14:08.757 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:08.757+0000 7f9777b29800 20 add_watcher() i=7 2024-06-04T16:14:08.757 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:08.757+0000 7f9777b29800 2 all 8 watchers are set, enabling cache 2024-06-04T16:14:08.760 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:08.759+0000 7f9629fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-06-04T16:14:08.760 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:08.759+0000 7f9777b29800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-06-04T16:14:08.760 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:08.759+0000 7f9777b29800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-06-04T16:14:08.760 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:08.759+0000 7f9777b29800 5 note: GC not initialized 2024-06-04T16:14:08.761 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:08.759+0000 7f9628fe1640 20 reqs_thread_entry: start 2024-06-04T16:14:08.761 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:08.759+0000 7f9777b29800 20 init_complete bucket index max shards: 11 2024-06-04T16:14:08.761 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:08.760+0000 7f9777b29800 20 Filter name: none 2024-06-04T16:14:08.761 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:08.760+0000 7f95a27fc640 20 reqs_thread_entry: start 2024-06-04T16:14:08.761 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:08.760+0000 7f9777b29800 20 rados->read ofs=0 len=0 2024-06-04T16:14:08.761 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:08.760+0000 7f9777b29800 20 rados_obj.operate() r=0 bl.length=173 2024-06-04T16:14:08.762 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:08.760+0000 7f9777b29800 20 rados->read ofs=0 len=0 2024-06-04T16:14:08.762 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:08.761+0000 7f9777b29800 20 rados_obj.operate() r=0 bl.length=387 2024-06-04T16:14:08.762 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:08.761+0000 7f9777b29800 20 couldn't put binfo cache entry, might have raced with data changes 2024-06-04T16:14:08.763 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:08.761+0000 7f9777b29800 20 INFO: main: max_entries=1000, index=gen=2, max_shards=13 2024-06-04T16:14:08.763 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:08.761+0000 7f9777b29800 20 INFO: main: starting shard=0 2024-06-04T16:14:08.763 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:08.761+0000 7f9777b29800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18.2.0 2024-06-04T16:14:08.763 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:08.761+0000 7f9777b29800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18.2.0 2024-06-04T16:14:08.763 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:08.761+0000 7f9777b29800 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-06-04T16:14:08.763 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:08.761+0000 7f9777b29800 20 INFO: main: starting shard=1 2024-06-04T16:14:08.763 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:08.761+0000 7f9777b29800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18.2.1 2024-06-04T16:14:08.763 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:08.761+0000 7f9777b29800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18.2.1 2024-06-04T16:14:08.763 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:08.762+0000 7f9777b29800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-06-04T16:14:08.763 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:08.762+0000 7f9777b29800 20 INFO: main: starting shard=2 2024-06-04T16:14:08.763 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:08.762+0000 7f9777b29800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18.2.2 2024-06-04T16:14:08.763 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:08.762+0000 7f9777b29800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18.2.2 2024-06-04T16:14:08.764 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:08.762+0000 7f9777b29800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-06-04T16:14:08.764 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:08.762+0000 7f9777b29800 20 INFO: main: starting shard=3 2024-06-04T16:14:08.764 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:08.762+0000 7f9777b29800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18.2.3 2024-06-04T16:14:08.764 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:08.762+0000 7f9777b29800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18.2.3 2024-06-04T16:14:08.764 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:08.763+0000 7f9777b29800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-06-04T16:14:08.764 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:08.763+0000 7f9777b29800 20 INFO: main: starting shard=4 2024-06-04T16:14:08.764 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:08.763+0000 7f9777b29800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18.2.4 2024-06-04T16:14:08.764 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:08.763+0000 7f9777b29800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18.2.4 2024-06-04T16:14:08.765 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:08.763+0000 7f9777b29800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-06-04T16:14:08.765 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:08.763+0000 7f9777b29800 20 INFO: main: starting shard=5 2024-06-04T16:14:08.765 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:08.763+0000 7f9777b29800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18.2.5 2024-06-04T16:14:08.765 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:08.763+0000 7f9777b29800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18.2.5 2024-06-04T16:14:08.765 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:08.764+0000 7f9777b29800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-06-04T16:14:08.765 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:08.764+0000 7f9777b29800 20 INFO: main: starting shard=6 2024-06-04T16:14:08.765 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:08.764+0000 7f9777b29800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18.2.6 2024-06-04T16:14:08.765 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:08.764+0000 7f9777b29800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18.2.6 2024-06-04T16:14:08.766 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:08.764+0000 7f9777b29800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-06-04T16:14:08.766 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:08.764+0000 7f9777b29800 20 INFO: main: starting shard=7 2024-06-04T16:14:08.766 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:08.764+0000 7f9777b29800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18.2.7 2024-06-04T16:14:08.766 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:08.764+0000 7f9777b29800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18.2.7 2024-06-04T16:14:08.766 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:08.765+0000 7f9777b29800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-06-04T16:14:08.766 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:08.765+0000 7f9777b29800 20 INFO: main: starting shard=8 2024-06-04T16:14:08.766 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:08.765+0000 7f9777b29800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18.2.8 2024-06-04T16:14:08.767 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:08.765+0000 7f9777b29800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18.2.8 2024-06-04T16:14:08.767 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:08.766+0000 7f9777b29800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-06-04T16:14:08.767 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:08.766+0000 7f9777b29800 20 INFO: main: starting shard=9 2024-06-04T16:14:08.767 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:08.766+0000 7f9777b29800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18.2.9 2024-06-04T16:14:08.768 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:08.766+0000 7f9777b29800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18.2.9 2024-06-04T16:14:08.768 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:08.766+0000 7f9777b29800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-06-04T16:14:08.768 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:08.766+0000 7f9777b29800 20 INFO: main: starting shard=10 2024-06-04T16:14:08.768 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:08.766+0000 7f9777b29800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18.2.10 2024-06-04T16:14:08.768 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:08.766+0000 7f9777b29800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18.2.10 2024-06-04T16:14:08.768 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:08.767+0000 7f9777b29800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-06-04T16:14:08.768 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:08.767+0000 7f9777b29800 20 INFO: main: starting shard=11 2024-06-04T16:14:08.768 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:08.767+0000 7f9777b29800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18.2.11 2024-06-04T16:14:08.768 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:08.767+0000 7f9777b29800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18.2.11 2024-06-04T16:14:08.769 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:08.767+0000 7f9777b29800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-06-04T16:14:08.769 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:08.767+0000 7f9777b29800 20 INFO: main: starting shard=12 2024-06-04T16:14:08.769 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:08.767+0000 7f9777b29800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18.2.12 2024-06-04T16:14:08.769 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:08.767+0000 7f9777b29800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18.2.12 2024-06-04T16:14:08.769 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:08.768+0000 7f9777b29800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-06-04T16:14:08.769 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:08.768+0000 7f9777b29800 20 INFO: main: done 2024-06-04T16:14:08.770 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:08.769+0000 7f9629fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-06-04T16:14:08.772 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:08.771+0000 7f9777b29800 20 remove_watcher() i=0 2024-06-04T16:14:08.772 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:08.771+0000 7f9777b29800 2 removed watcher, disabling cache 2024-06-04T16:14:08.773 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:08.772+0000 7f9777b29800 20 remove_watcher() i=1 2024-06-04T16:14:08.774 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:08.774+0000 7f9777b29800 20 remove_watcher() i=2 2024-06-04T16:14:08.775 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:08.775+0000 7f9777b29800 20 remove_watcher() i=3 2024-06-04T16:14:08.776 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:08.776+0000 7f9777b29800 20 remove_watcher() i=4 2024-06-04T16:14:08.778 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:08.777+0000 7f9777b29800 20 remove_watcher() i=5 2024-06-04T16:14:08.779 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:08.778+0000 7f9777b29800 20 remove_watcher() i=6 2024-06-04T16:14:08.780 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:08.779+0000 7f9777b29800 20 remove_watcher() i=7 2024-06-04T16:14:08.794 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:14:08.795 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:14:08.799 INFO:tasks.workunit.client.0.smithi144.stderr:ceph config rm client rgw_debug_inject_set_olh_err 2024-06-04T16:14:09.203 INFO:tasks.workunit.client.0.smithi144.stderr:ceph config rm client rgw_debug_inject_olh_cancel_modification_err 2024-06-04T16:14:09.600 INFO:tasks.workunit.client.0.smithi144.stderr:radosgw-admin bucket reshard --bucket myver --num-shards 17 --yes-i-really-mean-it 2024-06-04T16:14:09.631 INFO:tasks.workunit.client.0.smithi144.stderr:ignoring --setuser ceph since I am not root 2024-06-04T16:14:09.631 INFO:tasks.workunit.client.0.smithi144.stderr:ignoring --setgroup ceph since I am not root 2024-06-04T16:14:09.669 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:09.668+0000 7f52f8687800 20 rados->read ofs=0 len=0 2024-06-04T16:14:09.671 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:09.670+0000 7f52f8687800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:14:09.671 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:09.670+0000 7f52f8687800 20 realm 2024-06-04T16:14:09.671 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:09.670+0000 7f52f8687800 20 rados->read ofs=0 len=0 2024-06-04T16:14:09.671 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:09.670+0000 7f52f8687800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:14:09.671 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:09.670+0000 7f52f8687800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-06-04T16:14:09.671 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:09.670+0000 7f52f8687800 20 rados->read ofs=0 len=0 2024-06-04T16:14:09.671 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:09.670+0000 7f52f8687800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:14:09.671 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:09.670+0000 7f52f8687800 20 rados->read ofs=0 len=0 2024-06-04T16:14:09.672 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:09.671+0000 7f52f8687800 20 rados_obj.operate() r=0 bl.length=46 2024-06-04T16:14:09.672 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:09.671+0000 7f52f8687800 20 rados->read ofs=0 len=0 2024-06-04T16:14:09.672 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:09.671+0000 7f52f8687800 20 rados_obj.operate() r=0 bl.length=1139 2024-06-04T16:14:09.672 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:09.672+0000 7f52f8687800 20 searching for the correct realm 2024-06-04T16:14:09.674 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:09.674+0000 7f52f697d640 0 -- 172.21.15.144:0/2529977362 >> [v2:172.21.15.144:6800/1453747520,v1:172.21.15.144:6801/1453747520] conn(0x7f52e0082060 msgr2=0x7f52e005e6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-06-04T16:14:09.880 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:09.879+0000 7f52effff640 0 -- 172.21.15.144:0/2529977362 >> [v2:172.21.15.177:6808/2618477608,v1:172.21.15.177:6809/2618477608] conn(0x7f52e0071020 msgr2=0x7f52e007fa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-06-04T16:14:10.088 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.086+0000 7f52f8687800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-06-04T16:14:10.088 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.086+0000 7f52f8687800 20 RGWRados::pool_iterate: got zone_info.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767 2024-06-04T16:14:10.088 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.086+0000 7f52f8687800 20 RGWRados::pool_iterate: got default.zone. 2024-06-04T16:14:10.088 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.086+0000 7f52f8687800 20 RGWRados::pool_iterate: got zonegroup_info.abb22408-c332-4e28-8f7a-ff254ea2fed2 2024-06-04T16:14:10.088 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.086+0000 7f52f8687800 20 RGWRados::pool_iterate: got zone_names.default 2024-06-04T16:14:10.088 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.086+0000 7f52f8687800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-06-04T16:14:10.088 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.087+0000 7f52f8687800 20 rados->read ofs=0 len=0 2024-06-04T16:14:10.089 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.087+0000 7f52f8687800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:14:10.089 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.087+0000 7f52f8687800 20 rados->read ofs=0 len=0 2024-06-04T16:14:10.089 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.087+0000 7f52f8687800 20 rados_obj.operate() r=0 bl.length=46 2024-06-04T16:14:10.089 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.087+0000 7f52f8687800 20 rados->read ofs=0 len=0 2024-06-04T16:14:10.090 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.088+0000 7f52f8687800 20 rados_obj.operate() r=0 bl.length=470 2024-06-04T16:14:10.090 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.088+0000 7f52f8687800 20 zone default found 2024-06-04T16:14:10.090 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.088+0000 7f52f8687800 4 Realm: () 2024-06-04T16:14:10.090 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.088+0000 7f52f8687800 4 ZoneGroup: default (abb22408-c332-4e28-8f7a-ff254ea2fed2) 2024-06-04T16:14:10.090 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.088+0000 7f52f8687800 4 Zone: default (be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767) 2024-06-04T16:14:10.090 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.088+0000 7f52f8687800 10 cannot find current period zonegroup using local zonegroup configuration 2024-06-04T16:14:10.090 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.088+0000 7f52f8687800 20 zonegroup default 2024-06-04T16:14:10.090 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.088+0000 7f52f8687800 20 rados->read ofs=0 len=0 2024-06-04T16:14:10.090 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.088+0000 7f52f8687800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:14:10.091 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.088+0000 7f52f8687800 20 rados->read ofs=0 len=0 2024-06-04T16:14:10.091 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.088+0000 7f52f8687800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:14:10.091 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.088+0000 7f52f8687800 20 rados->read ofs=0 len=0 2024-06-04T16:14:10.091 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.089+0000 7f52f8687800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:14:10.091 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.089+0000 7f52f8687800 20 started sync module instance, tier type = 2024-06-04T16:14:10.091 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.089+0000 7f52f8687800 20 started zone id=be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767 (name=default) with tier type = 2024-06-04T16:14:10.100 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.099+0000 7f52f8687800 20 add_watcher() i=0 2024-06-04T16:14:10.100 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.099+0000 7f52f8687800 20 add_watcher() i=1 2024-06-04T16:14:10.100 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.099+0000 7f52f8687800 20 add_watcher() i=2 2024-06-04T16:14:10.100 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.099+0000 7f52f8687800 20 add_watcher() i=3 2024-06-04T16:14:10.100 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.099+0000 7f52f8687800 20 add_watcher() i=4 2024-06-04T16:14:10.100 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.099+0000 7f52f8687800 20 add_watcher() i=5 2024-06-04T16:14:10.100 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.099+0000 7f52f8687800 20 add_watcher() i=6 2024-06-04T16:14:10.101 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.100+0000 7f52f8687800 20 add_watcher() i=7 2024-06-04T16:14:10.101 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.100+0000 7f52f8687800 2 all 8 watchers are set, enabling cache 2024-06-04T16:14:10.104 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.102+0000 7f51acfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-06-04T16:14:10.104 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.102+0000 7f52f8687800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-06-04T16:14:10.104 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.102+0000 7f52f8687800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-06-04T16:14:10.104 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.102+0000 7f52f8687800 5 note: GC not initialized 2024-06-04T16:14:10.104 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.102+0000 7f51277fe640 20 reqs_thread_entry: start 2024-06-04T16:14:10.104 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.103+0000 7f52f8687800 20 init_complete bucket index max shards: 11 2024-06-04T16:14:10.104 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.103+0000 7f52f8687800 20 Filter name: none 2024-06-04T16:14:10.104 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.103+0000 7f51257fa640 20 reqs_thread_entry: start 2024-06-04T16:14:10.104 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.103+0000 7f52f8687800 10 cache get: name=default.rgw.meta+root+myver : miss 2024-06-04T16:14:10.104 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.103+0000 7f52f8687800 20 rados->read ofs=0 len=0 2024-06-04T16:14:10.105 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.103+0000 7f52f8687800 20 rados_obj.operate() r=0 bl.length=173 2024-06-04T16:14:10.105 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.103+0000 7f52f8687800 10 cache put: name=default.rgw.meta+root+myver info.flags=0x11 2024-06-04T16:14:10.105 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.103+0000 7f52f8687800 10 adding default.rgw.meta+root+myver to cache LRU end 2024-06-04T16:14:10.105 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.103+0000 7f52f8687800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18 : miss 2024-06-04T16:14:10.105 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.103+0000 7f52f8687800 20 rados->read ofs=0 len=0 2024-06-04T16:14:10.105 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.104+0000 7f52f8687800 20 rados_obj.operate() r=0 bl.length=387 2024-06-04T16:14:10.105 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.104+0000 7f52f8687800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18 info.flags=0x17 2024-06-04T16:14:10.105 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.104+0000 7f52f8687800 10 adding default.rgw.meta+root+.bucket.meta.myver:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18 to cache LRU end 2024-06-04T16:14:10.106 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.104+0000 7f52f8687800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-06-04T16:14:10.106 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.104+0000 7f52f8687800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-06-04T16:14:10.106 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.104+0000 7f52f8687800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18 2024-06-04T16:14:10.115 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.113+0000 7f52f8687800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18 info.flags=0x17 2024-06-04T16:14:10.115 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.113+0000 7f52f8687800 10 moving default.rgw.meta+root+.bucket.meta.myver:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18 to cache LRU end 2024-06-04T16:14:10.115 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.113+0000 7f52f8687800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-06-04T16:14:10.115 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.113+0000 7f52f8687800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18, ofs0, ns] 2024-06-04T16:14:10.115 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.113+0000 7f51d9ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1078036791394 cookie 94859186009408 notifier 7296 bl.length()=813 2024-06-04T16:14:10.115 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.114+0000 7f51d9ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18 info.flags=0x17 2024-06-04T16:14:10.115 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.114+0000 7f51d9ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18 to cache LRU end 2024-06-04T16:14:10.115 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.114+0000 7f51d9ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-06-04T16:14:10.115 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.114+0000 7f52f8687800 20 handle_bi_update(): bucket=:myver[be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18]): orig_sources= new_sources= 2024-06-04T16:14:10.115 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.114+0000 7f52f8687800 20 handle_bi_update(): bucket=:myver[be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18]): potential sources added=[] removed=[] 2024-06-04T16:14:10.115 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.114+0000 7f52f8687800 20 handle_bi_update(): bucket=:myver[be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18]): orig_dests= new_dests= 2024-06-04T16:14:10.115 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.114+0000 7f52f8687800 20 handle_bi_update(): bucket=:myver[be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18]): potential dests added=[] removed=[] 2024-06-04T16:14:10.120 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.118+0000 7f52f8687800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18.3.0 2024-06-04T16:14:10.120 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.118+0000 7f52f8687800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18.3.0 2024-06-04T16:14:10.120 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.118+0000 7f52f8687800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18.3.1 2024-06-04T16:14:10.120 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.118+0000 7f52f8687800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18.3.1 2024-06-04T16:14:10.120 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.118+0000 7f52f8687800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18.3.2 2024-06-04T16:14:10.120 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.118+0000 7f52f8687800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18.3.2 2024-06-04T16:14:10.120 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.118+0000 7f52f8687800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18.3.3 2024-06-04T16:14:10.120 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.118+0000 7f52f8687800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18.3.3 2024-06-04T16:14:10.120 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.118+0000 7f52f8687800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18.3.4 2024-06-04T16:14:10.120 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.118+0000 7f52f8687800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18.3.4 2024-06-04T16:14:10.120 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.118+0000 7f52f8687800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18.3.5 2024-06-04T16:14:10.120 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.118+0000 7f52f8687800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18.3.5 2024-06-04T16:14:10.121 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.118+0000 7f52f8687800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18.3.6 2024-06-04T16:14:10.121 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.118+0000 7f52f8687800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18.3.6 2024-06-04T16:14:10.121 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.118+0000 7f52f8687800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18.3.7 2024-06-04T16:14:10.121 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.118+0000 7f52f8687800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18.3.7 2024-06-04T16:14:10.121 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.118+0000 7f52f8687800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18.3.8 2024-06-04T16:14:10.121 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.118+0000 7f52f8687800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18.3.8 2024-06-04T16:14:10.121 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.118+0000 7f52f8687800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18.3.9 2024-06-04T16:14:10.121 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.118+0000 7f52f8687800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18.3.9 2024-06-04T16:14:10.121 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.118+0000 7f52f8687800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18.3.10 2024-06-04T16:14:10.121 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.118+0000 7f52f8687800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18.3.10 2024-06-04T16:14:10.121 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.118+0000 7f52f8687800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18.3.11 2024-06-04T16:14:10.121 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.118+0000 7f52f8687800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18.3.11 2024-06-04T16:14:10.121 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.118+0000 7f52f8687800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18.3.12 2024-06-04T16:14:10.122 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.118+0000 7f52f8687800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18.3.12 2024-06-04T16:14:10.122 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.118+0000 7f52f8687800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18.3.13 2024-06-04T16:14:10.122 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.118+0000 7f52f8687800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18.3.13 2024-06-04T16:14:10.122 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.118+0000 7f52f8687800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18.3.14 2024-06-04T16:14:10.122 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.118+0000 7f52f8687800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18.3.14 2024-06-04T16:14:10.122 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.118+0000 7f52f8687800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18.3.15 2024-06-04T16:14:10.122 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.118+0000 7f52f8687800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18.3.15 2024-06-04T16:14:10.122 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.118+0000 7f52f8687800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18.3.16 2024-06-04T16:14:10.122 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.118+0000 7f52f8687800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18.3.16 2024-06-04T16:14:10.122 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.118+0000 7f52f8687800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18.2.0 2024-06-04T16:14:10.122 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.118+0000 7f52f8687800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18.2.0 2024-06-04T16:14:10.122 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.119+0000 7f52f8687800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18.2.1 2024-06-04T16:14:10.122 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.119+0000 7f52f8687800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18.2.1 2024-06-04T16:14:10.123 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.120+0000 7f52f8687800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18.2.2 2024-06-04T16:14:10.124 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.120+0000 7f52f8687800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18.2.2 2024-06-04T16:14:10.124 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.120+0000 7f52f8687800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18.2.3 2024-06-04T16:14:10.124 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.120+0000 7f52f8687800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18.2.3 2024-06-04T16:14:10.124 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.121+0000 7f52f8687800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18.2.4 2024-06-04T16:14:10.124 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.121+0000 7f52f8687800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18.2.4 2024-06-04T16:14:10.124 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.121+0000 7f52f8687800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18.2.5 2024-06-04T16:14:10.124 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.121+0000 7f52f8687800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18.2.5 2024-06-04T16:14:10.124 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.122+0000 7f52f8687800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18.2.6 2024-06-04T16:14:10.124 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.122+0000 7f52f8687800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18.2.6 2024-06-04T16:14:10.125 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.122+0000 7f52f8687800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18.2.7 2024-06-04T16:14:10.125 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.122+0000 7f52f8687800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18.2.7 2024-06-04T16:14:10.125 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.123+0000 7f52f8687800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18.2.8 2024-06-04T16:14:10.125 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.123+0000 7f52f8687800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18.2.8 2024-06-04T16:14:10.126 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.123+0000 7f52f8687800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18.2.9 2024-06-04T16:14:10.126 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.123+0000 7f52f8687800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18.2.9 2024-06-04T16:14:10.126 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.124+0000 7f52f8687800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18.2.10 2024-06-04T16:14:10.126 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.124+0000 7f52f8687800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18.2.10 2024-06-04T16:14:10.126 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.124+0000 7f52f8687800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18.2.11 2024-06-04T16:14:10.126 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.124+0000 7f52f8687800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18.2.11 2024-06-04T16:14:10.126 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.125+0000 7f52f8687800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18.2.12 2024-06-04T16:14:10.126 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.125+0000 7f52f8687800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18.2.12 2024-06-04T16:14:10.128 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.128+0000 7f52f8687800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18 : hit (requested=0x17, cached=0x17) 2024-06-04T16:14:10.129 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.128+0000 7f52f8687800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18 2024-06-04T16:14:10.130 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.129+0000 7f52f8687800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18 info.flags=0x17 2024-06-04T16:14:10.130 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.129+0000 7f52f8687800 10 moving default.rgw.meta+root+.bucket.meta.myver:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18 to cache LRU end 2024-06-04T16:14:10.130 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.129+0000 7f52f8687800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-06-04T16:14:10.130 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.129+0000 7f52f8687800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18, ofs0, ns] 2024-06-04T16:14:10.131 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.129+0000 7f51d97fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1078036791395 cookie 94859186009408 notifier 7296 bl.length()=781 2024-06-04T16:14:10.131 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.129+0000 7f51d97fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18 info.flags=0x17 2024-06-04T16:14:10.131 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.129+0000 7f51d97fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18 to cache LRU end 2024-06-04T16:14:10.131 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.129+0000 7f51d97fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-06-04T16:14:10.131 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.130+0000 7f52f8687800 20 handle_bi_update(): bucket=:myver[be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18]): orig_sources= new_sources= 2024-06-04T16:14:10.131 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.130+0000 7f52f8687800 20 handle_bi_update(): bucket=:myver[be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18]): potential sources added=[] removed=[] 2024-06-04T16:14:10.131 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.130+0000 7f52f8687800 20 handle_bi_update(): bucket=:myver[be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18]): orig_dests= new_dests= 2024-06-04T16:14:10.131 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.130+0000 7f52f8687800 20 handle_bi_update(): bucket=:myver[be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18]): potential dests added=[] removed=[] 2024-06-04T16:14:10.135 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.134+0000 7f52f8687800 1 execute INFO: reshard of bucket "myver" completed successfully 2024-06-04T16:14:10.137 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.136+0000 7f51acfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-06-04T16:14:10.139 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.139+0000 7f52f8687800 20 remove_watcher() i=0 2024-06-04T16:14:10.139 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.139+0000 7f52f8687800 2 removed watcher, disabling cache 2024-06-04T16:14:10.140 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.140+0000 7f52f8687800 20 remove_watcher() i=1 2024-06-04T16:14:10.142 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.141+0000 7f52f8687800 20 remove_watcher() i=2 2024-06-04T16:14:10.143 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.142+0000 7f52f8687800 20 remove_watcher() i=3 2024-06-04T16:14:10.144 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.143+0000 7f52f8687800 20 remove_watcher() i=4 2024-06-04T16:14:10.145 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.144+0000 7f52f8687800 20 remove_watcher() i=5 2024-06-04T16:14:10.146 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.145+0000 7f52f8687800 20 remove_watcher() i=6 2024-06-04T16:14:10.147 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.146+0000 7f52f8687800 20 remove_watcher() i=7 2024-06-04T16:14:10.159 INFO:tasks.workunit.client.0.smithi144.stderr:radosgw-admin bucket check unlinked --bucket myver --fix --min-age-hours 0 --rgw-olh-pending-timeout-sec 0 --dump-keys 2024-06-04T16:14:10.193 INFO:tasks.workunit.client.0.smithi144.stderr:ignoring --setuser ceph since I am not root 2024-06-04T16:14:10.194 INFO:tasks.workunit.client.0.smithi144.stderr:ignoring --setgroup ceph since I am not root 2024-06-04T16:14:10.231 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.230+0000 7f732e462800 20 rados->read ofs=0 len=0 2024-06-04T16:14:10.233 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.231+0000 7f732e462800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:14:10.233 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.231+0000 7f732e462800 20 realm 2024-06-04T16:14:10.233 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.231+0000 7f732e462800 20 rados->read ofs=0 len=0 2024-06-04T16:14:10.233 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.232+0000 7f732e462800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:14:10.233 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.232+0000 7f732e462800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-06-04T16:14:10.233 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.232+0000 7f732e462800 20 rados->read ofs=0 len=0 2024-06-04T16:14:10.233 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.232+0000 7f732e462800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:14:10.233 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.232+0000 7f732e462800 20 rados->read ofs=0 len=0 2024-06-04T16:14:10.234 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.233+0000 7f732e462800 20 rados_obj.operate() r=0 bl.length=46 2024-06-04T16:14:10.234 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.233+0000 7f732e462800 20 rados->read ofs=0 len=0 2024-06-04T16:14:10.234 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.233+0000 7f732e462800 20 rados_obj.operate() r=0 bl.length=1139 2024-06-04T16:14:10.234 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.233+0000 7f732e462800 20 searching for the correct realm 2024-06-04T16:14:10.236 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.236+0000 7f732c758640 0 -- 172.21.15.144:0/1907396892 >> [v2:172.21.15.144:6800/1453747520,v1:172.21.15.144:6801/1453747520] conn(0x7f731408e030 msgr2=0x7f7314093b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-06-04T16:14:10.442 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.441+0000 7f732c758640 0 -- 172.21.15.144:0/1907396892 >> [v2:172.21.15.144:6824/166159729,v1:172.21.15.144:6825/166159729] conn(0x56494b6b4960 msgr2=0x56494b6b6d70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-06-04T16:14:10.447 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.446+0000 7f732e462800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-06-04T16:14:10.447 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.446+0000 7f732e462800 20 RGWRados::pool_iterate: got zone_info.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767 2024-06-04T16:14:10.447 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.446+0000 7f732e462800 20 RGWRados::pool_iterate: got default.zone. 2024-06-04T16:14:10.447 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.446+0000 7f732e462800 20 RGWRados::pool_iterate: got zonegroup_info.abb22408-c332-4e28-8f7a-ff254ea2fed2 2024-06-04T16:14:10.447 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.446+0000 7f732e462800 20 RGWRados::pool_iterate: got zone_names.default 2024-06-04T16:14:10.447 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.446+0000 7f732e462800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-06-04T16:14:10.447 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.446+0000 7f732e462800 20 rados->read ofs=0 len=0 2024-06-04T16:14:10.447 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.446+0000 7f732e462800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:14:10.448 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.446+0000 7f732e462800 20 rados->read ofs=0 len=0 2024-06-04T16:14:10.449 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.446+0000 7f732e462800 20 rados_obj.operate() r=0 bl.length=46 2024-06-04T16:14:10.449 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.446+0000 7f732e462800 20 rados->read ofs=0 len=0 2024-06-04T16:14:10.449 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.447+0000 7f732e462800 20 rados_obj.operate() r=0 bl.length=470 2024-06-04T16:14:10.449 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.447+0000 7f732e462800 20 zone default found 2024-06-04T16:14:10.449 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.447+0000 7f732e462800 4 Realm: () 2024-06-04T16:14:10.449 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.447+0000 7f732e462800 4 ZoneGroup: default (abb22408-c332-4e28-8f7a-ff254ea2fed2) 2024-06-04T16:14:10.449 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.447+0000 7f732e462800 4 Zone: default (be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767) 2024-06-04T16:14:10.449 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.447+0000 7f732e462800 10 cannot find current period zonegroup using local zonegroup configuration 2024-06-04T16:14:10.449 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.447+0000 7f732e462800 20 zonegroup default 2024-06-04T16:14:10.449 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.447+0000 7f732e462800 20 rados->read ofs=0 len=0 2024-06-04T16:14:10.449 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.447+0000 7f732e462800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:14:10.449 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.447+0000 7f732e462800 20 rados->read ofs=0 len=0 2024-06-04T16:14:10.450 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.447+0000 7f732e462800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:14:10.450 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.447+0000 7f732e462800 20 rados->read ofs=0 len=0 2024-06-04T16:14:10.450 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.448+0000 7f732e462800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:14:10.450 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.448+0000 7f732e462800 20 started sync module instance, tier type = 2024-06-04T16:14:10.450 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.448+0000 7f732e462800 20 started zone id=be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767 (name=default) with tier type = 2024-06-04T16:14:10.458 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.457+0000 7f732e462800 20 add_watcher() i=0 2024-06-04T16:14:10.458 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.457+0000 7f732e462800 20 add_watcher() i=1 2024-06-04T16:14:10.458 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.457+0000 7f732e462800 20 add_watcher() i=2 2024-06-04T16:14:10.458 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.457+0000 7f732e462800 20 add_watcher() i=3 2024-06-04T16:14:10.458 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.457+0000 7f732e462800 20 add_watcher() i=4 2024-06-04T16:14:10.458 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.457+0000 7f732e462800 20 add_watcher() i=5 2024-06-04T16:14:10.459 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.457+0000 7f732e462800 20 add_watcher() i=6 2024-06-04T16:14:10.459 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.458+0000 7f732e462800 20 add_watcher() i=7 2024-06-04T16:14:10.459 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.458+0000 7f732e462800 2 all 8 watchers are set, enabling cache 2024-06-04T16:14:10.461 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.460+0000 7f71e1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-06-04T16:14:10.462 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.460+0000 7f732e462800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-06-04T16:14:10.462 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.460+0000 7f732e462800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-06-04T16:14:10.462 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.460+0000 7f732e462800 5 note: GC not initialized 2024-06-04T16:14:10.462 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.461+0000 7f71e0fe1640 20 reqs_thread_entry: start 2024-06-04T16:14:10.462 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.461+0000 7f732e462800 20 init_complete bucket index max shards: 11 2024-06-04T16:14:10.462 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.461+0000 7f732e462800 20 Filter name: none 2024-06-04T16:14:10.462 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.461+0000 7f715a7fc640 20 reqs_thread_entry: start 2024-06-04T16:14:10.462 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.461+0000 7f732e462800 10 cache get: name=default.rgw.meta+root+myver : miss 2024-06-04T16:14:10.462 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.461+0000 7f732e462800 20 rados->read ofs=0 len=0 2024-06-04T16:14:10.463 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.462+0000 7f732e462800 20 rados_obj.operate() r=0 bl.length=173 2024-06-04T16:14:10.463 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.462+0000 7f732e462800 10 cache put: name=default.rgw.meta+root+myver info.flags=0x11 2024-06-04T16:14:10.463 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.462+0000 7f732e462800 10 adding default.rgw.meta+root+myver to cache LRU end 2024-06-04T16:14:10.464 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.462+0000 7f732e462800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18 : miss 2024-06-04T16:14:10.464 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.462+0000 7f732e462800 20 rados->read ofs=0 len=0 2024-06-04T16:14:10.464 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.462+0000 7f732e462800 20 rados_obj.operate() r=0 bl.length=387 2024-06-04T16:14:10.464 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.462+0000 7f732e462800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18 info.flags=0x17 2024-06-04T16:14:10.464 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.462+0000 7f732e462800 10 adding default.rgw.meta+root+.bucket.meta.myver:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18 to cache LRU end 2024-06-04T16:14:10.464 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.462+0000 7f732e462800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-06-04T16:14:10.464 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.462+0000 7f732e462800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-06-04T16:14:10.464 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.462+0000 7f732e462800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18 2024-06-04T16:14:10.464 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.462+0000 7f732e462800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18.3.0 2024-06-04T16:14:10.464 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.462+0000 7f732e462800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18.3.0 2024-06-04T16:14:10.465 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.463+0000 7f732e462800 1 NOTICE: finished shard 0 (0 entries removed) 2024-06-04T16:14:10.465 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.463+0000 7f732e462800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18.3.1 2024-06-04T16:14:10.465 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.463+0000 7f732e462800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18.3.1 2024-06-04T16:14:10.465 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.464+0000 7f732e462800 1 NOTICE: finished shard 1 (0 entries removed) 2024-06-04T16:14:10.465 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.464+0000 7f732e462800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18.3.2 2024-06-04T16:14:10.465 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.464+0000 7f732e462800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18.3.2 2024-06-04T16:14:10.465 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.464+0000 7f732e462800 1 NOTICE: finished shard 2 (0 entries removed) 2024-06-04T16:14:10.465 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.464+0000 7f732e462800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18.3.3 2024-06-04T16:14:10.466 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.464+0000 7f732e462800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18.3.3 2024-06-04T16:14:10.466 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.465+0000 7f732e462800 1 NOTICE: finished shard 3 (0 entries removed) 2024-06-04T16:14:10.466 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.465+0000 7f732e462800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18.3.4 2024-06-04T16:14:10.466 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.465+0000 7f732e462800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18.3.4 2024-06-04T16:14:10.466 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.465+0000 7f732e462800 1 NOTICE: finished shard 4 (0 entries removed) 2024-06-04T16:14:10.467 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.465+0000 7f732e462800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18.3.5 2024-06-04T16:14:10.467 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.465+0000 7f732e462800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18.3.5 2024-06-04T16:14:10.467 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.465+0000 7f732e462800 1 NOTICE: finished shard 5 (0 entries removed) 2024-06-04T16:14:10.467 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.465+0000 7f732e462800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18.3.6 2024-06-04T16:14:10.467 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.465+0000 7f732e462800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18.3.6 2024-06-04T16:14:10.467 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.466+0000 7f732e462800 1 NOTICE: finished shard 6 (0 entries removed) 2024-06-04T16:14:10.468 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.466+0000 7f732e462800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18.3.7 2024-06-04T16:14:10.468 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.466+0000 7f732e462800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18.3.7 2024-06-04T16:14:10.468 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.466+0000 7f732e462800 1 NOTICE: finished shard 7 (0 entries removed) 2024-06-04T16:14:10.468 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.466+0000 7f732e462800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18.3.8 2024-06-04T16:14:10.468 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.466+0000 7f732e462800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18.3.8 2024-06-04T16:14:10.468 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.467+0000 7f732e462800 1 NOTICE: finished shard 8 (0 entries removed) 2024-06-04T16:14:10.468 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.467+0000 7f732e462800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18.3.9 2024-06-04T16:14:10.468 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.467+0000 7f732e462800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18.3.9 2024-06-04T16:14:10.469 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.467+0000 7f732e462800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18.3.10 2024-06-04T16:14:10.469 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.467+0000 7f732e462800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18.3.10 2024-06-04T16:14:10.469 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.468+0000 7f732e462800 1 NOTICE: finished shard 10 (0 entries removed) 2024-06-04T16:14:10.469 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.468+0000 7f732e462800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18.3.11 2024-06-04T16:14:10.469 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.468+0000 7f732e462800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18.3.11 2024-06-04T16:14:10.469 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.468+0000 7f732e462800 1 NOTICE: finished shard 11 (0 entries removed) 2024-06-04T16:14:10.469 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.468+0000 7f732e462800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18.3.12 2024-06-04T16:14:10.469 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.468+0000 7f732e462800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18.3.12 2024-06-04T16:14:10.470 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.468+0000 7f732e462800 1 NOTICE: finished shard 12 (0 entries removed) 2024-06-04T16:14:10.470 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.468+0000 7f732e462800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18.3.13 2024-06-04T16:14:10.470 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.468+0000 7f732e462800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18.3.13 2024-06-04T16:14:10.470 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.469+0000 7f732e462800 1 NOTICE: finished shard 13 (0 entries removed) 2024-06-04T16:14:10.470 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.469+0000 7f732e462800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18.3.14 2024-06-04T16:14:10.470 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.469+0000 7f732e462800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18.3.14 2024-06-04T16:14:10.471 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.470+0000 7f732e462800 1 NOTICE: finished shard 14 (0 entries removed) 2024-06-04T16:14:10.471 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.470+0000 7f732e462800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18.3.15 2024-06-04T16:14:10.471 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.470+0000 7f732e462800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18.3.15 2024-06-04T16:14:10.471 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.470+0000 7f732e462800 1 NOTICE: finished shard 15 (0 entries removed) 2024-06-04T16:14:10.471 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.470+0000 7f732e462800 10 bucket_obj is .dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18.3.16 2024-06-04T16:14:10.471 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.470+0000 7f732e462800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18.3.16 2024-06-04T16:14:10.472 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.470+0000 7f732e462800 1 NOTICE: finished shard 16 (0 entries removed) 2024-06-04T16:14:10.472 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.471+0000 7f732e462800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18.3.9 2024-06-04T16:14:10.472 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.471+0000 7f732e462800 20 get_obj_state: octx=0x56494b41e7c0 obj=myver:x state=0x56494b6ebf78 s->prefetch_data=0 2024-06-04T16:14:10.472 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.471+0000 7f732e462800 20 get_obj_state: setting s->obj_tag to qgrchucfp74zuedk47t6mwaigje4qett 2024-06-04T16:14:10.472 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.471+0000 7f732e462800 20 get_obj_state_impl: setting s->olh_tag to uukiet0zokaock1sd262yihavgsdyskv 2024-06-04T16:14:10.472 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.471+0000 7f732e462800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=uukiet0zokaock1sd262yihavgsdyskv 2024-06-04T16:14:10.473 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.473+0000 7f732e462800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18.3.9 2024-06-04T16:14:10.475 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.474+0000 7f732e462800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18.3.9 2024-06-04T16:14:10.475 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.474+0000 7f732e462800 20 olh_log_entry: epoch=2 op=2 key=x[] 2024-06-04T16:14:10.475 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.474+0000 7f732e462800 20 olh_log_entry: epoch=2 op=3 key=x[B17Prk4v5z-LIYjJDZU2Dmvyc7SWNyh] 2024-06-04T16:14:10.475 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.474+0000 7f732e462800 20 get_obj_state: octx=0x56494b41e7c0 obj=myver:_:B17Prk4v5z-LIYjJDZU2Dmvyc7SWNyh_x state=0x56494b7299c8 s->prefetch_data=0 2024-06-04T16:14:10.476 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.475+0000 7f732e462800 10 manifest: total_size = 11 2024-06-04T16:14:10.476 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.475+0000 7f732e462800 20 get_obj_state: setting s->obj_tag to be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.4993846722882457895 2024-06-04T16:14:10.476 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.475+0000 7f732e462800 20 get_obj_state: octx=0x56494b41e7c0 obj=myver:_:B17Prk4v5z-LIYjJDZU2Dmvyc7SWNyh_x state=0x56494b7299c8 s->prefetch_data=0 2024-06-04T16:14:10.476 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.475+0000 7f732e462800 20 prepare_atomic_modification: state is not atomic. state=0x56494b7299c8 2024-06-04T16:14:10.476 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.475+0000 7f732e462800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18.3.9 2024-06-04T16:14:10.479 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.478+0000 7f732e462800 20 get_obj_state: octx=0x56494b41e7c0 obj=myver:x state=0x56494b6ebf78 s->prefetch_data=0 2024-06-04T16:14:10.479 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.478+0000 7f732e462800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=uukiet0zokaock1sd262yihavgsdyskv 2024-06-04T16:14:10.480 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.479+0000 7f720a7fc640 20 handle_completion(): completion ok for obj=x[B17Prk4v5z-LIYjJDZU2Dmvyc7SWNyh] 2024-06-04T16:14:10.482 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.481+0000 7f732e462800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18.3.9 2024-06-04T16:14:10.483 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.482+0000 7f732e462800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18.3.9 2024-06-04T16:14:10.483 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.483+0000 7f732e462800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18.3.9 2024-06-04T16:14:10.484 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.483+0000 7f732e462800 20 get_obj_state: octx=0x56494b41e7c0 obj=myver:y state=0x56494b6ebf78 s->prefetch_data=0 2024-06-04T16:14:10.484 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.483+0000 7f732e462800 20 get_obj_state: setting s->obj_tag to u9ndxhbs24dll514dkwa8lskrg2gp2ui 2024-06-04T16:14:10.484 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.483+0000 7f732e462800 20 get_obj_state_impl: setting s->olh_tag to 18km7ntft67o03dgvj50jujsvigrf3ki 2024-06-04T16:14:10.484 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.483+0000 7f732e462800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=18km7ntft67o03dgvj50jujsvigrf3ki 2024-06-04T16:14:10.485 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.485+0000 7f732e462800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18.3.9 2024-06-04T16:14:10.487 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.486+0000 7f732e462800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18.3.9 2024-06-04T16:14:10.488 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.486+0000 7f732e462800 20 olh_log_entry: epoch=2 op=2 key=y[] 2024-06-04T16:14:10.488 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.487+0000 7f732e462800 20 olh_log_entry: epoch=2 op=3 key=y[DYhksfXFBMG4V.ckcNJX4v3WP7JIZg7] 2024-06-04T16:14:10.488 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.487+0000 7f732e462800 20 get_obj_state: octx=0x56494b41e7c0 obj=myver:_:DYhksfXFBMG4V.ckcNJX4v3WP7JIZg7_y state=0x56494b72ae68 s->prefetch_data=0 2024-06-04T16:14:10.488 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.487+0000 7f732e462800 10 manifest: total_size = 22 2024-06-04T16:14:10.488 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.487+0000 7f732e462800 20 get_obj_state: setting s->obj_tag to be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.4605065302447941866 2024-06-04T16:14:10.488 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.487+0000 7f732e462800 20 get_obj_state: octx=0x56494b41e7c0 obj=myver:_:DYhksfXFBMG4V.ckcNJX4v3WP7JIZg7_y state=0x56494b72ae68 s->prefetch_data=0 2024-06-04T16:14:10.488 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.487+0000 7f732e462800 20 prepare_atomic_modification: state is not atomic. state=0x56494b72ae68 2024-06-04T16:14:10.488 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.487+0000 7f732e462800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18.3.9 2024-06-04T16:14:10.491 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.491+0000 7f720a7fc640 20 handle_completion(): completion ok for obj=y[DYhksfXFBMG4V.ckcNJX4v3WP7JIZg7] 2024-06-04T16:14:10.492 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.491+0000 7f732e462800 20 get_obj_state: octx=0x56494b41e7c0 obj=myver:y state=0x56494b6ebf78 s->prefetch_data=0 2024-06-04T16:14:10.492 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.491+0000 7f732e462800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=18km7ntft67o03dgvj50jujsvigrf3ki 2024-06-04T16:14:10.494 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.494+0000 7f732e462800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18.3.9 2024-06-04T16:14:10.496 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.495+0000 7f732e462800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18.3.9 2024-06-04T16:14:10.496 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.495+0000 7f732e462800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18.3.9 2024-06-04T16:14:10.496 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.496+0000 7f732e462800 20 get_obj_state: octx=0x56494b41e7c0 obj=myver:z state=0x56494b6ebf78 s->prefetch_data=0 2024-06-04T16:14:10.497 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.496+0000 7f732e462800 20 get_obj_state: setting s->obj_tag to nb1bfspk5u5a46i0ko3iwqm8pkrgth9j 2024-06-04T16:14:10.497 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.496+0000 7f732e462800 20 get_obj_state_impl: setting s->olh_tag to x052xtn4cnoyluhx311kz4ojhd0h6axa 2024-06-04T16:14:10.497 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.496+0000 7f732e462800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=x052xtn4cnoyluhx311kz4ojhd0h6axa 2024-06-04T16:14:10.498 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.497+0000 7f732e462800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18.3.9 2024-06-04T16:14:10.499 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.498+0000 7f732e462800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18.3.9 2024-06-04T16:14:10.500 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.499+0000 7f732e462800 20 olh_log_entry: epoch=2 op=2 key=z[] 2024-06-04T16:14:10.500 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.499+0000 7f732e462800 20 olh_log_entry: epoch=2 op=3 key=z[M-mW7U1w8AIUNpph4G5sLAJn-ZrIhzv] 2024-06-04T16:14:10.500 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.499+0000 7f732e462800 20 get_obj_state: octx=0x56494b41e7c0 obj=myver:_:M-mW7U1w8AIUNpph4G5sLAJn-ZrIhzv_z state=0x56494b72ae68 s->prefetch_data=0 2024-06-04T16:14:10.500 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.499+0000 7f732e462800 10 manifest: total_size = 12 2024-06-04T16:14:10.500 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.499+0000 7f732e462800 20 get_obj_state: setting s->obj_tag to be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.17562775351368734803 2024-06-04T16:14:10.500 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.499+0000 7f732e462800 20 get_obj_state: octx=0x56494b41e7c0 obj=myver:_:M-mW7U1w8AIUNpph4G5sLAJn-ZrIhzv_z state=0x56494b72ae68 s->prefetch_data=0 2024-06-04T16:14:10.501 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.499+0000 7f732e462800 20 prepare_atomic_modification: state is not atomic. state=0x56494b72ae68 2024-06-04T16:14:10.501 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.499+0000 7f732e462800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18.3.9 2024-06-04T16:14:10.504 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.503+0000 7f720affd640 20 handle_completion(): completion ok for obj=z[M-mW7U1w8AIUNpph4G5sLAJn-ZrIhzv] 2024-06-04T16:14:10.504 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.504+0000 7f732e462800 20 get_obj_state: octx=0x56494b41e7c0 obj=myver:z state=0x56494b6ebf78 s->prefetch_data=0 2024-06-04T16:14:10.504 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.504+0000 7f732e462800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=x052xtn4cnoyluhx311kz4ojhd0h6axa 2024-06-04T16:14:10.507 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.506+0000 7f732e462800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18.3.9 2024-06-04T16:14:10.508 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.507+0000 7f732e462800 20 bucket index object: :.dir.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.18.3.9 2024-06-04T16:14:10.508 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.507+0000 7f732e462800 1 NOTICE: finished shard 9 (3 entries removed) 2024-06-04T16:14:10.508 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.507+0000 7f732e462800 1 NOTICE: finished all shards (3 entries removed) 2024-06-04T16:14:10.509 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.508+0000 7f71e1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-06-04T16:14:10.511 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.510+0000 7f732e462800 20 remove_watcher() i=0 2024-06-04T16:14:10.511 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.510+0000 7f732e462800 2 removed watcher, disabling cache 2024-06-04T16:14:10.512 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.511+0000 7f732e462800 20 remove_watcher() i=1 2024-06-04T16:14:10.513 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.512+0000 7f732e462800 20 remove_watcher() i=2 2024-06-04T16:14:10.514 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.513+0000 7f732e462800 20 remove_watcher() i=3 2024-06-04T16:14:10.515 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.514+0000 7f732e462800 20 remove_watcher() i=4 2024-06-04T16:14:10.516 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.515+0000 7f732e462800 20 remove_watcher() i=5 2024-06-04T16:14:10.517 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.516+0000 7f732e462800 20 remove_watcher() i=6 2024-06-04T16:14:10.518 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.518+0000 7f732e462800 20 remove_watcher() i=7 2024-06-04T16:14:10.531 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:14:10.531 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:14:10.536 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:14:10.537 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:14:10.580 INFO:tasks.workunit.client.0.smithi144.stderr:radosgw-admin bucket stats --bucket myver 2024-06-04T16:14:10.607 INFO:tasks.workunit.client.0.smithi144.stderr:ignoring --setuser ceph since I am not root 2024-06-04T16:14:10.607 INFO:tasks.workunit.client.0.smithi144.stderr:ignoring --setgroup ceph since I am not root 2024-06-04T16:14:10.846 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.845+0000 7fedebc16800 20 rados->read ofs=0 len=0 2024-06-04T16:14:10.848 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.847+0000 7fedebc16800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:14:10.848 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.847+0000 7fedebc16800 20 realm 2024-06-04T16:14:10.848 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.847+0000 7fedebc16800 20 rados->read ofs=0 len=0 2024-06-04T16:14:10.848 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.847+0000 7fedebc16800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:14:10.848 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.847+0000 7fedebc16800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-06-04T16:14:10.848 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.847+0000 7fedebc16800 20 rados->read ofs=0 len=0 2024-06-04T16:14:10.849 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.847+0000 7fedebc16800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:14:10.849 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.847+0000 7fedebc16800 20 rados->read ofs=0 len=0 2024-06-04T16:14:10.849 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.848+0000 7fedebc16800 20 rados_obj.operate() r=0 bl.length=46 2024-06-04T16:14:10.849 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.848+0000 7fedebc16800 20 rados->read ofs=0 len=0 2024-06-04T16:14:10.850 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.849+0000 7fedebc16800 20 rados_obj.operate() r=0 bl.length=1139 2024-06-04T16:14:10.850 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.849+0000 7fedebc16800 20 searching for the correct realm 2024-06-04T16:14:10.851 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:10.850+0000 7feddffff640 0 -- 172.21.15.144:0/3691448295 >> [v2:172.21.15.144:6808/86532035,v1:172.21.15.144:6809/86532035] conn(0x7fedd8018950 msgr2=0x7fedd8040410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-06-04T16:14:11.055 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:11.054+0000 7fede727a640 0 -- 172.21.15.144:0/3691448295 >> [v2:172.21.15.177:6824/800067290,v1:172.21.15.177:6825/800067290] conn(0x560a5cb385f0 msgr2=0x560a5cb3aab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-06-04T16:14:11.061 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:11.060+0000 7fedebc16800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-06-04T16:14:11.062 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:11.060+0000 7fedebc16800 20 RGWRados::pool_iterate: got zone_info.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767 2024-06-04T16:14:11.062 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:11.060+0000 7fedebc16800 20 RGWRados::pool_iterate: got default.zone. 2024-06-04T16:14:11.062 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:11.060+0000 7fedebc16800 20 RGWRados::pool_iterate: got zonegroup_info.abb22408-c332-4e28-8f7a-ff254ea2fed2 2024-06-04T16:14:11.062 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:11.060+0000 7fedebc16800 20 RGWRados::pool_iterate: got zone_names.default 2024-06-04T16:14:11.062 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:11.060+0000 7fedebc16800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-06-04T16:14:11.062 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:11.060+0000 7fedebc16800 20 rados->read ofs=0 len=0 2024-06-04T16:14:11.062 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:11.061+0000 7fedebc16800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:14:11.062 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:11.061+0000 7fedebc16800 20 rados->read ofs=0 len=0 2024-06-04T16:14:11.063 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:11.061+0000 7fedebc16800 20 rados_obj.operate() r=0 bl.length=46 2024-06-04T16:14:11.063 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:11.061+0000 7fedebc16800 20 rados->read ofs=0 len=0 2024-06-04T16:14:11.063 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:11.061+0000 7fedebc16800 20 rados_obj.operate() r=0 bl.length=470 2024-06-04T16:14:11.063 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:11.061+0000 7fedebc16800 20 zone default found 2024-06-04T16:14:11.063 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:11.061+0000 7fedebc16800 4 Realm: () 2024-06-04T16:14:11.063 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:11.061+0000 7fedebc16800 4 ZoneGroup: default (abb22408-c332-4e28-8f7a-ff254ea2fed2) 2024-06-04T16:14:11.064 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:11.061+0000 7fedebc16800 4 Zone: default (be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767) 2024-06-04T16:14:11.064 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:11.061+0000 7fedebc16800 10 cannot find current period zonegroup using local zonegroup configuration 2024-06-04T16:14:11.064 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:11.061+0000 7fedebc16800 20 zonegroup default 2024-06-04T16:14:11.064 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:11.061+0000 7fedebc16800 20 rados->read ofs=0 len=0 2024-06-04T16:14:11.064 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:11.062+0000 7fedebc16800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:14:11.064 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:11.062+0000 7fedebc16800 20 rados->read ofs=0 len=0 2024-06-04T16:14:11.064 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:11.062+0000 7fedebc16800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:14:11.064 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:11.062+0000 7fedebc16800 20 rados->read ofs=0 len=0 2024-06-04T16:14:11.064 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:11.062+0000 7fedebc16800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:14:11.064 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:11.062+0000 7fedebc16800 20 started sync module instance, tier type = 2024-06-04T16:14:11.064 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:11.062+0000 7fedebc16800 20 started zone id=be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767 (name=default) with tier type = 2024-06-04T16:14:11.073 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:11.072+0000 7fedebc16800 20 add_watcher() i=0 2024-06-04T16:14:11.073 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:11.072+0000 7fedebc16800 20 add_watcher() i=1 2024-06-04T16:14:11.073 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:11.072+0000 7fedebc16800 20 add_watcher() i=2 2024-06-04T16:14:11.073 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:11.072+0000 7fedebc16800 20 add_watcher() i=3 2024-06-04T16:14:11.073 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:11.072+0000 7fedebc16800 20 add_watcher() i=4 2024-06-04T16:14:11.073 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:11.072+0000 7fedebc16800 20 add_watcher() i=5 2024-06-04T16:14:11.073 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:11.072+0000 7fedebc16800 20 add_watcher() i=6 2024-06-04T16:14:11.073 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:11.073+0000 7fedebc16800 20 add_watcher() i=7 2024-06-04T16:14:11.073 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:11.073+0000 7fedebc16800 2 all 8 watchers are set, enabling cache 2024-06-04T16:14:11.076 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:11.075+0000 7fec9dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-06-04T16:14:11.076 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:11.075+0000 7fedebc16800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-06-04T16:14:11.076 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:11.075+0000 7fedebc16800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-06-04T16:14:11.076 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:11.075+0000 7fedebc16800 5 note: GC not initialized 2024-06-04T16:14:11.077 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:11.075+0000 7fec9cfe1640 20 reqs_thread_entry: start 2024-06-04T16:14:11.077 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:11.075+0000 7fedebc16800 20 init_complete bucket index max shards: 11 2024-06-04T16:14:11.077 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:11.075+0000 7fedebc16800 20 Filter name: none 2024-06-04T16:14:11.077 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:11.075+0000 7fec167fc640 20 reqs_thread_entry: start 2024-06-04T16:14:11.077 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:11.075+0000 7fedebc16800 20 rados->read ofs=0 len=0 2024-06-04T16:14:11.078 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:11.076+0000 7fedebc16800 20 rados_obj.operate() r=0 bl.length=173 2024-06-04T16:14:11.078 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:11.076+0000 7fedebc16800 20 rados->read ofs=0 len=0 2024-06-04T16:14:11.079 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:11.076+0000 7fedebc16800 20 rados_obj.operate() r=0 bl.length=387 2024-06-04T16:14:11.079 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:11.076+0000 7fedebc16800 20 couldn't put binfo cache entry, might have raced with data changes 2024-06-04T16:14:11.079 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:11.076+0000 7fedebc16800 20 rados->read ofs=0 len=0 2024-06-04T16:14:11.079 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:11.077+0000 7fedebc16800 20 rados_obj.operate() r=0 bl.length=173 2024-06-04T16:14:11.079 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:11.077+0000 7fedebc16800 20 rados->read ofs=0 len=0 2024-06-04T16:14:11.079 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:11.077+0000 7fedebc16800 20 rados_obj.operate() r=0 bl.length=387 2024-06-04T16:14:11.079 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:11.077+0000 7fedebc16800 20 couldn't put binfo cache entry, might have raced with data changes 2024-06-04T16:14:11.080 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:11.079+0000 7fec9dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-06-04T16:14:11.082 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:11.081+0000 7fedebc16800 20 remove_watcher() i=0 2024-06-04T16:14:11.082 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:11.081+0000 7fedebc16800 2 removed watcher, disabling cache 2024-06-04T16:14:11.083 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:11.082+0000 7fedebc16800 20 remove_watcher() i=1 2024-06-04T16:14:11.084 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:11.083+0000 7fedebc16800 20 remove_watcher() i=2 2024-06-04T16:14:11.085 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:11.084+0000 7fedebc16800 20 remove_watcher() i=3 2024-06-04T16:14:11.086 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:11.086+0000 7fedebc16800 20 remove_watcher() i=4 2024-06-04T16:14:11.087 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:11.087+0000 7fedebc16800 20 remove_watcher() i=5 2024-06-04T16:14:11.088 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:11.088+0000 7fedebc16800 20 remove_watcher() i=6 2024-06-04T16:14:11.090 INFO:tasks.workunit.client.0.smithi144.stderr:2024-06-04T16:14:11.089+0000 7fedebc16800 20 remove_watcher() i=7 2024-06-04T16:14:11.101 INFO:tasks.workunit.client.0.smithi144.stderr:{'rgw.main': {'size': 0, 'size_actual': 0, 'size_utilized': 0, 'size_kb': 0, 'size_kb_actual': 0, 'size_kb_utilized': 0, 'num_objects': 0}} 2024-06-04T16:14:11.101 INFO:tasks.workunit.client.0.smithi144.stderr:Deleting bucket a-bucket 2024-06-04T16:14:11.103 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:14:11.103 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:14:11.106 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:14:11.106 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:14:11.120 INFO:tasks.workunit.client.0.smithi144.stderr:Deleting bucket myver 2024-06-04T16:14:11.121 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:14:11.121 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:14:11.165 INFO:tasks.workunit.client.0.smithi144.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-06-04T16:14:11.165 INFO:tasks.workunit.client.0.smithi144.stderr: warnings.warn( 2024-06-04T16:14:11.199 INFO:tasks.workunit.client.0.smithi144.stderr:Completed resharding tests 2024-06-04T16:14:11.200 INFO:tasks.workunit.client.0.smithi144.stdout:Could not connect to the endpoint URL: "http://localhost:80/" 2024-06-04T16:14:11.200 INFO:tasks.workunit.client.0.smithi144.stdout:Could not connect to the endpoint URL: "http://localhost:8000/" 2024-06-04T16:14:11.200 INFO:tasks.workunit.client.0.smithi144.stdout:connected to https://localhost:443 2024-06-04T16:14:11.273 INFO:tasks.workunit.client.0.smithi144.stderr:+ deactivate 2024-06-04T16:14:11.273 INFO:tasks.workunit.client.0.smithi144.stderr:+ '[' -n /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin ']' 2024-06-04T16:14:11.274 INFO:tasks.workunit.client.0.smithi144.stderr:+ PATH=/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-06-04T16:14:11.274 INFO:tasks.workunit.client.0.smithi144.stderr:+ export PATH 2024-06-04T16:14:11.274 INFO:tasks.workunit.client.0.smithi144.stderr:+ unset _OLD_VIRTUAL_PATH 2024-06-04T16:14:11.274 INFO:tasks.workunit.client.0.smithi144.stderr:+ '[' -n '' ']' 2024-06-04T16:14:11.274 INFO:tasks.workunit.client.0.smithi144.stderr:+ '[' -n /usr/bin/bash -o -n '' ']' 2024-06-04T16:14:11.274 INFO:tasks.workunit.client.0.smithi144.stderr:+ hash -r 2024-06-04T16:14:11.274 INFO:tasks.workunit.client.0.smithi144.stderr:+ '[' -n '' ']' 2024-06-04T16:14:11.274 INFO:tasks.workunit.client.0.smithi144.stderr:+ unset VIRTUAL_ENV 2024-06-04T16:14:11.274 INFO:tasks.workunit.client.0.smithi144.stderr:+ '[' '!' '' = nondestructive ']' 2024-06-04T16:14:11.274 INFO:tasks.workunit.client.0.smithi144.stderr:+ unset -f deactivate 2024-06-04T16:14:11.274 INFO:tasks.workunit.client.0.smithi144.stderr:+ echo OK. 2024-06-04T16:14:11.275 INFO:tasks.workunit.client.0.smithi144.stdout:OK. 2024-06-04T16:14:11.276 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-06-04T16:14:11.276 DEBUG:teuthology.orchestra.run.smithi144:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-06-04T16:14:11.355 INFO:tasks.workunit:Stopping ['rgw/run-reshard.sh'] on client.0... 2024-06-04T16:14:11.356 DEBUG:teuthology.orchestra.run.smithi144:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-06-04T16:14:11.737 DEBUG:teuthology.parallel:result is None 2024-06-04T16:14:11.738 DEBUG:teuthology.orchestra.run.smithi144:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-06-04T16:14:11.776 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-06-04T16:14:11.776 DEBUG:teuthology.orchestra.run.smithi144:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-06-04T16:14:11.845 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-06-04T16:14:11.845 INFO:teuthology.run_tasks:Running task s3tests-java... 2024-06-04T16:14:11.862 DEBUG:tasks.s3tests_java:S3 Tests Java: __INIT__ 2024-06-04T16:14:11.863 DEBUG:tasks.s3tests_java:S3 Tests Java: SETUP 2024-06-04T16:14:11.863 INFO:tasks.s3tests_java:S3 Tests Java: Downloading test suite... 2024-06-04T16:14:11.863 DEBUG:teuthology.orchestra.run.smithi144:> git clone -b ceph-master https://github.com/ceph/java_s3tests.git /home/ubuntu/cephtest/s3-tests-java 2024-06-04T16:14:11.914 INFO:teuthology.orchestra.run.smithi144.stderr:Cloning into '/home/ubuntu/cephtest/s3-tests-java'... 2024-06-04T16:14:16.286 INFO:tasks.s3tests_java:S3 Tests Java: Installing required packages... 2024-06-04T16:14:16.286 DEBUG:teuthology.orchestra.run.smithi144:> /home/ubuntu/cephtest/s3-tests-java/bootstrap.sh 2024-06-04T16:14:17.888 INFO:teuthology.orchestra.run.smithi144.stderr:/home/ubuntu/cephtest/s3-tests-java/bootstrap.sh: missing required RPM packages. Installing via sudo. 2024-06-04T16:14:18.461 INFO:teuthology.orchestra.run.smithi144.stdout:Last metadata expiration check: 0:24:46 ago on Tue 04 Jun 2024 03:49:32 PM UTC. 2024-06-04T16:14:18.593 INFO:teuthology.orchestra.run.smithi144.stdout:Dependencies resolved. 2024-06-04T16:14:18.594 INFO:teuthology.orchestra.run.smithi144.stdout:================================================================================ 2024-06-04T16:14:18.594 INFO:teuthology.orchestra.run.smithi144.stdout: Package Arch Version Repository Size 2024-06-04T16:14:18.594 INFO:teuthology.orchestra.run.smithi144.stdout:================================================================================ 2024-06-04T16:14:18.594 INFO:teuthology.orchestra.run.smithi144.stdout:Installing: 2024-06-04T16:14:18.594 INFO:teuthology.orchestra.run.smithi144.stdout: java-1.8.0-openjdk x86_64 1:1.8.0.362.b09-4.el9 appstream 426 k 2024-06-04T16:14:18.594 INFO:teuthology.orchestra.run.smithi144.stdout: java-1.8.0-openjdk-devel x86_64 1:1.8.0.362.b09-4.el9 appstream 9.3 M 2024-06-04T16:14:18.594 INFO:teuthology.orchestra.run.smithi144.stdout:Installing dependencies: 2024-06-04T16:14:18.594 INFO:teuthology.orchestra.run.smithi144.stdout: java-1.8.0-openjdk-headless x86_64 1:1.8.0.362.b09-4.el9 appstream 32 M 2024-06-04T16:14:18.594 INFO:teuthology.orchestra.run.smithi144.stdout:Installing weak dependencies: 2024-06-04T16:14:18.594 INFO:teuthology.orchestra.run.smithi144.stdout: gtk2 x86_64 2.24.33-8.el9 appstream 3.5 M 2024-06-04T16:14:18.595 INFO:teuthology.orchestra.run.smithi144.stdout: libcanberra-gtk2 x86_64 0.30-27.el9 appstream 26 k 2024-06-04T16:14:18.595 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:14:18.595 INFO:teuthology.orchestra.run.smithi144.stdout:Transaction Summary 2024-06-04T16:14:18.595 INFO:teuthology.orchestra.run.smithi144.stdout:================================================================================ 2024-06-04T16:14:18.595 INFO:teuthology.orchestra.run.smithi144.stdout:Install 5 Packages 2024-06-04T16:14:18.595 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:14:18.596 INFO:teuthology.orchestra.run.smithi144.stdout:Total download size: 46 M 2024-06-04T16:14:18.596 INFO:teuthology.orchestra.run.smithi144.stdout:Installed size: 166 M 2024-06-04T16:14:18.596 INFO:teuthology.orchestra.run.smithi144.stdout:Downloading Packages: 2024-06-04T16:14:18.947 INFO:teuthology.orchestra.run.smithi144.stdout:[MIRROR] gtk2-2.24.33-8.el9.x86_64.rpm: Status code: 404 for https://download-cc-rdu01.fedoraproject.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/gtk2-2.24.33-8.el9.x86_64.rpm (IP: 8.43.85.72) 2024-06-04T16:14:18.947 INFO:teuthology.orchestra.run.smithi144.stdout:[MIRROR] java-1.8.0-openjdk-1.8.0.362.b09-4.el9.x86_64.rpm: Status code: 404 for https://download-cc-rdu01.fedoraproject.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/java-1.8.0-openjdk-1.8.0.362.b09-4.el9.x86_64.rpm (IP: 8.43.85.72) 2024-06-04T16:14:18.999 INFO:teuthology.orchestra.run.smithi144.stdout:[MIRROR] java-1.8.0-openjdk-devel-1.8.0.362.b09-4.el9.x86_64.rpm: Status code: 404 for https://download-cc-rdu01.fedoraproject.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/java-1.8.0-openjdk-devel-1.8.0.362.b09-4.el9.x86_64.rpm (IP: 8.43.85.72) 2024-06-04T16:14:19.163 INFO:teuthology.orchestra.run.smithi144.stdout:(1/5): java-1.8.0-openjdk-1.8.0.362.b09-4.el9.x 1.4 MB/s | 426 kB 00:00 2024-06-04T16:14:19.246 INFO:teuthology.orchestra.run.smithi144.stdout:(2/5): gtk2-2.24.33-8.el9.x86_64.rpm 9.2 MB/s | 3.5 MB 00:00 2024-06-04T16:14:19.288 INFO:teuthology.orchestra.run.smithi144.stdout:(3/5): libcanberra-gtk2-0.30-27.el9.x86_64.rpm 622 kB/s | 26 kB 00:00 2024-06-04T16:14:19.405 INFO:teuthology.orchestra.run.smithi144.stdout:(4/5): java-1.8.0-openjdk-devel-1.8.0.362.b09-4 17 MB/s | 9.3 MB 00:00 2024-06-04T16:14:19.864 INFO:teuthology.orchestra.run.smithi144.stdout:(5/5): java-1.8.0-openjdk-headless-1.8.0.362.b0 46 MB/s | 32 MB 00:00 2024-06-04T16:14:19.866 INFO:teuthology.orchestra.run.smithi144.stdout:-------------------------------------------------------------------------------- 2024-06-04T16:14:19.866 INFO:teuthology.orchestra.run.smithi144.stdout:Total 36 MB/s | 46 MB 00:01 2024-06-04T16:14:20.287 INFO:teuthology.orchestra.run.smithi144.stdout:Running transaction check 2024-06-04T16:14:20.307 INFO:teuthology.orchestra.run.smithi144.stdout:Transaction check succeeded. 2024-06-04T16:14:20.307 INFO:teuthology.orchestra.run.smithi144.stdout:Running transaction test 2024-06-04T16:14:20.788 INFO:teuthology.orchestra.run.smithi144.stdout:Transaction test succeeded. 2024-06-04T16:14:20.789 INFO:teuthology.orchestra.run.smithi144.stdout:Running transaction 2024-06-04T16:14:21.317 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: java-1.8.0-openjdk-headless-1:1.8.0.362.b09-4.el9.x8 1/1 2024-06-04T16:14:21.460 INFO:teuthology.orchestra.run.smithi144.stdout: Preparing : 1/1 2024-06-04T16:14:21.644 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libcanberra-gtk2-0.30-27.el9.x86_64 1/5 2024-06-04T16:14:22.261 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : gtk2-2.24.33-8.el9.x86_64 2/5 2024-06-04T16:14:22.310 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : java-1.8.0-openjdk-headless-1:1.8.0.362.b09-4.el9.x8 3/5 2024-06-04T16:14:22.542 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: java-1.8.0-openjdk-headless-1:1.8.0.362.b09-4.el9.x8 3/5 2024-06-04T16:14:22.569 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : java-1.8.0-openjdk-1:1.8.0.362.b09-4.el9.x86_64 4/5 2024-06-04T16:14:22.802 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: java-1.8.0-openjdk-1:1.8.0.362.b09-4.el9.x86_64 4/5 2024-06-04T16:14:22.841 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : java-1.8.0-openjdk-devel-1:1.8.0.362.b09-4.el9.x86_6 5/5 2024-06-04T16:14:22.848 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: java-1.8.0-openjdk-devel-1:1.8.0.362.b09-4.el9.x86_6 5/5 2024-06-04T16:14:22.857 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: java-1.8.0-openjdk-headless-1:1.8.0.362.b09-4.el9.x8 5/5 2024-06-04T16:14:22.909 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: java-1.8.0-openjdk-1:1.8.0.362.b09-4.el9.x86_64 5/5 2024-06-04T16:14:25.788 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: java-1.8.0-openjdk-devel-1:1.8.0.362.b09-4.el9.x86_6 5/5 2024-06-04T16:14:25.788 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : gtk2-2.24.33-8.el9.x86_64 1/5 2024-06-04T16:14:25.788 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : java-1.8.0-openjdk-1:1.8.0.362.b09-4.el9.x86_64 2/5 2024-06-04T16:14:25.788 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : java-1.8.0-openjdk-devel-1:1.8.0.362.b09-4.el9.x86_6 3/5 2024-06-04T16:14:25.789 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : java-1.8.0-openjdk-headless-1:1.8.0.362.b09-4.el9.x8 4/5 2024-06-04T16:14:26.190 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libcanberra-gtk2-0.30-27.el9.x86_64 5/5 2024-06-04T16:14:26.190 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:14:26.190 INFO:teuthology.orchestra.run.smithi144.stdout:Installed: 2024-06-04T16:14:26.190 INFO:teuthology.orchestra.run.smithi144.stdout: gtk2-2.24.33-8.el9.x86_64 2024-06-04T16:14:26.191 INFO:teuthology.orchestra.run.smithi144.stdout: java-1.8.0-openjdk-1:1.8.0.362.b09-4.el9.x86_64 2024-06-04T16:14:26.191 INFO:teuthology.orchestra.run.smithi144.stdout: java-1.8.0-openjdk-devel-1:1.8.0.362.b09-4.el9.x86_64 2024-06-04T16:14:26.191 INFO:teuthology.orchestra.run.smithi144.stdout: java-1.8.0-openjdk-headless-1:1.8.0.362.b09-4.el9.x86_64 2024-06-04T16:14:26.191 INFO:teuthology.orchestra.run.smithi144.stdout: libcanberra-gtk2-0.30-27.el9.x86_64 2024-06-04T16:14:26.191 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:14:26.191 INFO:teuthology.orchestra.run.smithi144.stdout:Complete! 2024-06-04T16:14:26.599 INFO:teuthology.orchestra.run.smithi144.stdout: Gradle will be installed under /opt/gradle 2024-06-04T16:14:26.689 INFO:teuthology.orchestra.run.smithi144.stderr:--2024-06-04 16:14:26-- https://services.gradle.org/distributions/gradle-6.0.1-bin.zip 2024-06-04T16:14:26.916 INFO:teuthology.orchestra.run.smithi144.stderr:Resolving services.gradle.org (services.gradle.org)... 104.16.72.101, 104.16.73.101, 2606:4700::6810:4965, ... 2024-06-04T16:14:26.929 INFO:teuthology.orchestra.run.smithi144.stderr:Connecting to services.gradle.org (services.gradle.org)|104.16.72.101|:443... connected. 2024-06-04T16:14:27.039 INFO:teuthology.orchestra.run.smithi144.stderr:HTTP request sent, awaiting response... 301 Moved Permanently 2024-06-04T16:14:27.039 INFO:teuthology.orchestra.run.smithi144.stderr:Location: https://github.com/gradle/gradle-distributions/releases/download/v6.0.1/gradle-6.0.1-bin.zip [following] 2024-06-04T16:14:27.039 INFO:teuthology.orchestra.run.smithi144.stderr:--2024-06-04 16:14:27-- https://github.com/gradle/gradle-distributions/releases/download/v6.0.1/gradle-6.0.1-bin.zip 2024-06-04T16:14:27.039 INFO:teuthology.orchestra.run.smithi144.stderr:Resolving github.com (github.com)... 140.82.114.4 2024-06-04T16:14:27.050 INFO:teuthology.orchestra.run.smithi144.stderr:Connecting to github.com (github.com)|140.82.114.4|:443... connected. 2024-06-04T16:14:27.207 INFO:teuthology.orchestra.run.smithi144.stderr:HTTP request sent, awaiting response... 302 Found 2024-06-04T16:14:27.207 INFO:teuthology.orchestra.run.smithi144.stderr:Location: https://objects.githubusercontent.com/github-production-release-asset-2e65be/696192900/8f418ba1-c336-448c-95c6-5180382113cb?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=releaseassetproduction%2F20240604%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20240604T161427Z&X-Amz-Expires=300&X-Amz-Signature=d3a0607fbac461fd8d45454e7cb2794f2976eea59e81a814586731c8f0bf4c2e&X-Amz-SignedHeaders=host&actor_id=0&key_id=0&repo_id=696192900&response-content-disposition=attachment%3B%20filename%3Dgradle-6.0.1-bin.zip&response-content-type=application%2Foctet-stream [following] 2024-06-04T16:14:27.207 INFO:teuthology.orchestra.run.smithi144.stderr:--2024-06-04 16:14:27-- https://objects.githubusercontent.com/github-production-release-asset-2e65be/696192900/8f418ba1-c336-448c-95c6-5180382113cb?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=releaseassetproduction%2F20240604%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20240604T161427Z&X-Amz-Expires=300&X-Amz-Signature=d3a0607fbac461fd8d45454e7cb2794f2976eea59e81a814586731c8f0bf4c2e&X-Amz-SignedHeaders=host&actor_id=0&key_id=0&repo_id=696192900&response-content-disposition=attachment%3B%20filename%3Dgradle-6.0.1-bin.zip&response-content-type=application%2Foctet-stream 2024-06-04T16:14:27.222 INFO:teuthology.orchestra.run.smithi144.stderr:Resolving objects.githubusercontent.com (objects.githubusercontent.com)... 185.199.109.133, 185.199.110.133, 185.199.108.133, ... 2024-06-04T16:14:27.237 INFO:teuthology.orchestra.run.smithi144.stderr:Connecting to objects.githubusercontent.com (objects.githubusercontent.com)|185.199.109.133|:443... connected. 2024-06-04T16:14:27.331 INFO:teuthology.orchestra.run.smithi144.stderr:HTTP request sent, awaiting response... 200 OK 2024-06-04T16:14:27.331 INFO:teuthology.orchestra.run.smithi144.stderr:Length: 95129672 (91M) [application/octet-stream] 2024-06-04T16:14:27.331 INFO:teuthology.orchestra.run.smithi144.stderr:Saving to: ‘gradle-6.0.1-bin.zip’ 2024-06-04T16:14:27.331 INFO:teuthology.orchestra.run.smithi144.stderr: 2024-06-04T16:14:27.363 INFO:teuthology.orchestra.run.smithi144.stderr: 0K .......... .......... .......... .......... .......... 0% 1.51M 60s 2024-06-04T16:14:27.367 INFO:teuthology.orchestra.run.smithi144.stderr: 50K .......... .......... .......... .......... .......... 0% 12.1M 34s 2024-06-04T16:14:27.380 INFO:teuthology.orchestra.run.smithi144.stderr: 100K .......... .......... .......... .......... .......... 0% 3.61M 31s 2024-06-04T16:14:27.383 INFO:teuthology.orchestra.run.smithi144.stderr: 150K .......... .......... .......... .......... .......... 0% 14.5M 25s 2024-06-04T16:14:27.386 INFO:teuthology.orchestra.run.smithi144.stderr: 200K .......... .......... .......... .......... .......... 0% 17.3M 21s 2024-06-04T16:14:27.397 INFO:teuthology.orchestra.run.smithi144.stderr: 250K .......... .......... .......... .......... .......... 0% 4.81M 20s 2024-06-04T16:14:27.400 INFO:teuthology.orchestra.run.smithi144.stderr: 300K .......... .......... .......... .......... .......... 0% 15.0M 18s 2024-06-04T16:14:27.402 INFO:teuthology.orchestra.run.smithi144.stderr: 350K .......... .......... .......... .......... .......... 0% 28.9M 16s 2024-06-04T16:14:27.404 INFO:teuthology.orchestra.run.smithi144.stderr: 400K .......... .......... .......... .......... .......... 0% 31.8M 15s 2024-06-04T16:14:27.404 INFO:teuthology.orchestra.run.smithi144.stderr: 450K .......... .......... .......... .......... .......... 0% 120M 14s 2024-06-04T16:14:27.410 INFO:teuthology.orchestra.run.smithi144.stderr: 500K .......... .......... .......... .......... .......... 0% 8.14M 13s 2024-06-04T16:14:27.410 INFO:teuthology.orchestra.run.smithi144.stderr: 550K .......... .......... .......... .......... .......... 0% 137M 12s 2024-06-04T16:14:27.412 INFO:teuthology.orchestra.run.smithi144.stderr: 600K .......... .......... .......... .......... .......... 0% 27.0M 12s 2024-06-04T16:14:27.413 INFO:teuthology.orchestra.run.smithi144.stderr: 650K .......... .......... .......... .......... .......... 0% 34.4M 11s 2024-06-04T16:14:27.416 INFO:teuthology.orchestra.run.smithi144.stderr: 700K .......... .......... .......... .......... .......... 0% 24.4M 10s 2024-06-04T16:14:27.418 INFO:teuthology.orchestra.run.smithi144.stderr: 750K .......... .......... .......... .......... .......... 0% 36.2M 10s 2024-06-04T16:14:27.418 INFO:teuthology.orchestra.run.smithi144.stderr: 800K .......... .......... .......... .......... .......... 0% 57.2M 9s 2024-06-04T16:14:27.418 INFO:teuthology.orchestra.run.smithi144.stderr: 850K .......... .......... .......... .......... .......... 0% 52.2M 9s 2024-06-04T16:14:27.420 INFO:teuthology.orchestra.run.smithi144.stderr: 900K .......... .......... .......... .......... .......... 1% 35.8M 9s 2024-06-04T16:14:27.422 INFO:teuthology.orchestra.run.smithi144.stderr: 950K .......... .......... .......... .......... .......... 1% 31.6M 8s 2024-06-04T16:14:27.422 INFO:teuthology.orchestra.run.smithi144.stderr: 1000K .......... .......... .......... .......... .......... 1% 115M 8s 2024-06-04T16:14:27.423 INFO:teuthology.orchestra.run.smithi144.stderr: 1050K .......... .......... .......... .......... .......... 1% 44.8M 8s 2024-06-04T16:14:27.427 INFO:teuthology.orchestra.run.smithi144.stderr: 1100K .......... .......... .......... .......... .......... 1% 17.3M 8s 2024-06-04T16:14:27.427 INFO:teuthology.orchestra.run.smithi144.stderr: 1150K .......... .......... .......... .......... .......... 1% 50.3M 7s 2024-06-04T16:14:27.429 INFO:teuthology.orchestra.run.smithi144.stderr: 1200K .......... .......... .......... .......... .......... 1% 26.5M 7s 2024-06-04T16:14:27.429 INFO:teuthology.orchestra.run.smithi144.stderr: 1250K .......... .......... .......... .......... .......... 1% 75.1M 7s 2024-06-04T16:14:27.432 INFO:teuthology.orchestra.run.smithi144.stderr: 1300K .......... .......... .......... .......... .......... 1% 45.5M 7s 2024-06-04T16:14:27.433 INFO:teuthology.orchestra.run.smithi144.stderr: 1350K .......... .......... .......... .......... .......... 1% 54.1M 7s 2024-06-04T16:14:27.433 INFO:teuthology.orchestra.run.smithi144.stderr: 1400K .......... .......... .......... .......... .......... 1% 48.3M 6s 2024-06-04T16:14:27.433 INFO:teuthology.orchestra.run.smithi144.stderr: 1450K .......... .......... .......... .......... .......... 1% 111M 6s 2024-06-04T16:14:27.435 INFO:teuthology.orchestra.run.smithi144.stderr: 1500K .......... .......... .......... .......... .......... 1% 40.9M 6s 2024-06-04T16:14:27.435 INFO:teuthology.orchestra.run.smithi144.stderr: 1550K .......... .......... .......... .......... .......... 1% 52.5M 6s 2024-06-04T16:14:27.437 INFO:teuthology.orchestra.run.smithi144.stderr: 1600K .......... .......... .......... .......... .......... 1% 37.4M 6s 2024-06-04T16:14:27.437 INFO:teuthology.orchestra.run.smithi144.stderr: 1650K .......... .......... .......... .......... .......... 1% 60.1M 6s 2024-06-04T16:14:27.437 INFO:teuthology.orchestra.run.smithi144.stderr: 1700K .......... .......... .......... .......... .......... 1% 110M 6s 2024-06-04T16:14:27.439 INFO:teuthology.orchestra.run.smithi144.stderr: 1750K .......... .......... .......... .......... .......... 1% 43.5M 5s 2024-06-04T16:14:27.440 INFO:teuthology.orchestra.run.smithi144.stderr: 1800K .......... .......... .......... .......... .......... 1% 54.9M 5s 2024-06-04T16:14:27.443 INFO:teuthology.orchestra.run.smithi144.stderr: 1850K .......... .......... .......... .......... .......... 2% 12.8M 5s 2024-06-04T16:14:27.445 INFO:teuthology.orchestra.run.smithi144.stderr: 1900K .......... .......... .......... .......... .......... 2% 30.8M 5s 2024-06-04T16:14:27.445 INFO:teuthology.orchestra.run.smithi144.stderr: 1950K .......... .......... .......... .......... .......... 2% 128M 5s 2024-06-04T16:14:27.507 INFO:teuthology.orchestra.run.smithi144.stderr: 2000K .......... .......... .......... .......... .......... 2% 42.2M 5s 2024-06-04T16:14:27.507 INFO:teuthology.orchestra.run.smithi144.stderr: 2050K .......... .......... .......... .......... .......... 2% 62.3M 5s 2024-06-04T16:14:27.507 INFO:teuthology.orchestra.run.smithi144.stderr: 2100K .......... .......... .......... .......... .......... 2% 51.1M 5s 2024-06-04T16:14:27.507 INFO:teuthology.orchestra.run.smithi144.stderr: 2150K .......... .......... .......... .......... .......... 2% 118M 5s 2024-06-04T16:14:27.507 INFO:teuthology.orchestra.run.smithi144.stderr: 2200K .......... .......... .......... .......... .......... 2% 92.9M 5s 2024-06-04T16:14:27.507 INFO:teuthology.orchestra.run.smithi144.stderr: 2250K .......... .......... .......... .......... .......... 2% 49.6M 5s 2024-06-04T16:14:27.507 INFO:teuthology.orchestra.run.smithi144.stderr: 2300K .......... .......... .......... .......... .......... 2% 59.2M 5s 2024-06-04T16:14:27.507 INFO:teuthology.orchestra.run.smithi144.stderr: 2350K .......... .......... .......... .......... .......... 2% 89.0M 5s 2024-06-04T16:14:27.507 INFO:teuthology.orchestra.run.smithi144.stderr: 2400K .......... .......... .......... .......... .......... 2% 120M 4s 2024-06-04T16:14:27.507 INFO:teuthology.orchestra.run.smithi144.stderr: 2450K .......... .......... .......... .......... .......... 2% 89.6M 4s 2024-06-04T16:14:27.507 INFO:teuthology.orchestra.run.smithi144.stderr: 2500K .......... .......... .......... .......... .......... 2% 97.9M 4s 2024-06-04T16:14:27.508 INFO:teuthology.orchestra.run.smithi144.stderr: 2550K .......... .......... .......... .......... .......... 2% 127M 4s 2024-06-04T16:14:27.508 INFO:teuthology.orchestra.run.smithi144.stderr: 2600K .......... .......... .......... .......... .......... 2% 117M 4s 2024-06-04T16:14:27.508 INFO:teuthology.orchestra.run.smithi144.stderr: 2650K .......... .......... .......... .......... .......... 2% 110M 4s 2024-06-04T16:14:27.508 INFO:teuthology.orchestra.run.smithi144.stderr: 2700K .......... .......... .......... .......... .......... 2% 83.1M 4s 2024-06-04T16:14:27.508 INFO:teuthology.orchestra.run.smithi144.stderr: 2750K .......... .......... .......... .......... .......... 3% 136M 4s 2024-06-04T16:14:27.508 INFO:teuthology.orchestra.run.smithi144.stderr: 2800K .......... .......... .......... .......... .......... 3% 108M 4s 2024-06-04T16:14:27.508 INFO:teuthology.orchestra.run.smithi144.stderr: 2850K .......... .......... .......... .......... .......... 3% 109M 4s 2024-06-04T16:14:27.508 INFO:teuthology.orchestra.run.smithi144.stderr: 2900K .......... .......... .......... .......... .......... 3% 117M 4s 2024-06-04T16:14:27.508 INFO:teuthology.orchestra.run.smithi144.stderr: 2950K .......... .......... .......... .......... .......... 3% 110M 4s 2024-06-04T16:14:27.508 INFO:teuthology.orchestra.run.smithi144.stderr: 3000K .......... .......... .......... .......... .......... 3% 93.9M 4s 2024-06-04T16:14:27.508 INFO:teuthology.orchestra.run.smithi144.stderr: 3050K .......... .......... .......... .......... .......... 3% 128M 4s 2024-06-04T16:14:27.508 INFO:teuthology.orchestra.run.smithi144.stderr: 3100K .......... .......... .......... .......... .......... 3% 64.4M 4s 2024-06-04T16:14:27.509 INFO:teuthology.orchestra.run.smithi144.stderr: 3150K .......... .......... .......... .......... .......... 3% 126M 4s 2024-06-04T16:14:27.509 INFO:teuthology.orchestra.run.smithi144.stderr: 3200K .......... .......... .......... .......... .......... 3% 85.6M 4s 2024-06-04T16:14:27.509 INFO:teuthology.orchestra.run.smithi144.stderr: 3250K .......... .......... .......... .......... .......... 3% 55.3M 4s 2024-06-04T16:14:27.509 INFO:teuthology.orchestra.run.smithi144.stderr: 3300K .......... .......... .......... .......... .......... 3% 60.0M 3s 2024-06-04T16:14:27.509 INFO:teuthology.orchestra.run.smithi144.stderr: 3350K .......... .......... .......... .......... .......... 3% 106M 3s 2024-06-04T16:14:27.509 INFO:teuthology.orchestra.run.smithi144.stderr: 3400K .......... .......... .......... .......... .......... 3% 59.5M 3s 2024-06-04T16:14:27.509 INFO:teuthology.orchestra.run.smithi144.stderr: 3450K .......... .......... .......... .......... .......... 3% 111M 3s 2024-06-04T16:14:27.509 INFO:teuthology.orchestra.run.smithi144.stderr: 3500K .......... .......... .......... .......... .......... 3% 34.9M 3s 2024-06-04T16:14:27.509 INFO:teuthology.orchestra.run.smithi144.stderr: 3550K .......... .......... .......... .......... .......... 3% 76.6M 3s 2024-06-04T16:14:27.509 INFO:teuthology.orchestra.run.smithi144.stderr: 3600K .......... .......... .......... .......... .......... 3% 104M 3s 2024-06-04T16:14:27.509 INFO:teuthology.orchestra.run.smithi144.stderr: 3650K .......... .......... .......... .......... .......... 3% 52.8M 3s 2024-06-04T16:14:27.509 INFO:teuthology.orchestra.run.smithi144.stderr: 3700K .......... .......... .......... .......... .......... 4% 81.5M 3s 2024-06-04T16:14:27.509 INFO:teuthology.orchestra.run.smithi144.stderr: 3750K .......... .......... .......... .......... .......... 4% 19.4M 3s 2024-06-04T16:14:27.509 INFO:teuthology.orchestra.run.smithi144.stderr: 3800K .......... .......... .......... .......... .......... 4% 46.4M 3s 2024-06-04T16:14:27.510 INFO:teuthology.orchestra.run.smithi144.stderr: 3850K .......... .......... .......... .......... .......... 4% 84.0M 3s 2024-06-04T16:14:27.510 INFO:teuthology.orchestra.run.smithi144.stderr: 3900K .......... .......... .......... .......... .......... 4% 33.9M 3s 2024-06-04T16:14:27.510 INFO:teuthology.orchestra.run.smithi144.stderr: 3950K .......... .......... .......... .......... .......... 4% 75.2M 3s 2024-06-04T16:14:27.510 INFO:teuthology.orchestra.run.smithi144.stderr: 4000K .......... .......... .......... .......... .......... 4% 61.9M 3s 2024-06-04T16:14:27.510 INFO:teuthology.orchestra.run.smithi144.stderr: 4050K .......... .......... .......... .......... .......... 4% 102M 3s 2024-06-04T16:14:27.510 INFO:teuthology.orchestra.run.smithi144.stderr: 4100K .......... .......... .......... .......... .......... 4% 68.3M 3s 2024-06-04T16:14:27.510 INFO:teuthology.orchestra.run.smithi144.stderr: 4150K .......... .......... .......... .......... .......... 4% 37.3M 3s 2024-06-04T16:14:27.510 INFO:teuthology.orchestra.run.smithi144.stderr: 4200K .......... .......... .......... .......... .......... 4% 80.3M 3s 2024-06-04T16:14:27.510 INFO:teuthology.orchestra.run.smithi144.stderr: 4250K .......... .......... .......... .......... .......... 4% 99.5M 3s 2024-06-04T16:14:27.510 INFO:teuthology.orchestra.run.smithi144.stderr: 4300K .......... .......... .......... .......... .......... 4% 60.1M 3s 2024-06-04T16:14:27.510 INFO:teuthology.orchestra.run.smithi144.stderr: 4350K .......... .......... .......... .......... .......... 4% 79.4M 3s 2024-06-04T16:14:27.510 INFO:teuthology.orchestra.run.smithi144.stderr: 4400K .......... .......... .......... .......... .......... 4% 61.9M 3s 2024-06-04T16:14:27.510 INFO:teuthology.orchestra.run.smithi144.stderr: 4450K .......... .......... .......... .......... .......... 4% 137M 3s 2024-06-04T16:14:27.511 INFO:teuthology.orchestra.run.smithi144.stderr: 4500K .......... .......... .......... .......... .......... 4% 113M 3s 2024-06-04T16:14:27.511 INFO:teuthology.orchestra.run.smithi144.stderr: 4550K .......... .......... .......... .......... .......... 4% 52.1M 3s 2024-06-04T16:14:27.511 INFO:teuthology.orchestra.run.smithi144.stderr: 4600K .......... .......... .......... .......... .......... 5% 42.3M 3s 2024-06-04T16:14:27.511 INFO:teuthology.orchestra.run.smithi144.stderr: 4650K .......... .......... .......... .......... .......... 5% 76.6M 3s 2024-06-04T16:14:27.511 INFO:teuthology.orchestra.run.smithi144.stderr: 4700K .......... .......... .......... .......... .......... 5% 46.6M 3s 2024-06-04T16:14:27.511 INFO:teuthology.orchestra.run.smithi144.stderr: 4750K .......... .......... .......... .......... .......... 5% 109M 3s 2024-06-04T16:14:27.511 INFO:teuthology.orchestra.run.smithi144.stderr: 4800K .......... .......... .......... .......... .......... 5% 117M 3s 2024-06-04T16:14:27.511 INFO:teuthology.orchestra.run.smithi144.stderr: 4850K .......... .......... .......... .......... .......... 5% 53.4M 3s 2024-06-04T16:14:27.511 INFO:teuthology.orchestra.run.smithi144.stderr: 4900K .......... .......... .......... .......... .......... 5% 93.2M 3s 2024-06-04T16:14:27.511 INFO:teuthology.orchestra.run.smithi144.stderr: 4950K .......... .......... .......... .......... .......... 5% 96.4M 3s 2024-06-04T16:14:27.511 INFO:teuthology.orchestra.run.smithi144.stderr: 5000K .......... .......... .......... .......... .......... 5% 55.5M 3s 2024-06-04T16:14:27.511 INFO:teuthology.orchestra.run.smithi144.stderr: 5050K .......... .......... .......... .......... .......... 5% 50.9M 3s 2024-06-04T16:14:27.511 INFO:teuthology.orchestra.run.smithi144.stderr: 5100K .......... .......... .......... .......... .......... 5% 74.6M 3s 2024-06-04T16:14:27.511 INFO:teuthology.orchestra.run.smithi144.stderr: 5150K .......... .......... .......... .......... .......... 5% 97.9M 3s 2024-06-04T16:14:27.512 INFO:teuthology.orchestra.run.smithi144.stderr: 5200K .......... .......... .......... .......... .......... 5% 107M 3s 2024-06-04T16:14:27.512 INFO:teuthology.orchestra.run.smithi144.stderr: 5250K .......... .......... .......... .......... .......... 5% 73.9M 3s 2024-06-04T16:14:27.512 INFO:teuthology.orchestra.run.smithi144.stderr: 5300K .......... .......... .......... .......... .......... 5% 54.8M 3s 2024-06-04T16:14:27.512 INFO:teuthology.orchestra.run.smithi144.stderr: 5350K .......... .......... .......... .......... .......... 5% 111M 3s 2024-06-04T16:14:27.512 INFO:teuthology.orchestra.run.smithi144.stderr: 5400K .......... .......... .......... .......... .......... 5% 52.2M 3s 2024-06-04T16:14:27.512 INFO:teuthology.orchestra.run.smithi144.stderr: 5450K .......... .......... .......... .......... .......... 5% 112M 3s 2024-06-04T16:14:27.512 INFO:teuthology.orchestra.run.smithi144.stderr: 5500K .......... .......... .......... .......... .......... 5% 86.8M 3s 2024-06-04T16:14:27.512 INFO:teuthology.orchestra.run.smithi144.stderr: 5550K .......... .......... .......... .......... .......... 6% 91.3M 3s 2024-06-04T16:14:27.512 INFO:teuthology.orchestra.run.smithi144.stderr: 5600K .......... .......... .......... .......... .......... 6% 72.4M 3s 2024-06-04T16:14:27.512 INFO:teuthology.orchestra.run.smithi144.stderr: 5650K .......... .......... .......... .......... .......... 6% 109M 3s 2024-06-04T16:14:27.512 INFO:teuthology.orchestra.run.smithi144.stderr: 5700K .......... .......... .......... .......... .......... 6% 49.1M 3s 2024-06-04T16:14:27.512 INFO:teuthology.orchestra.run.smithi144.stderr: 5750K .......... .......... .......... .......... .......... 6% 26.5M 3s 2024-06-04T16:14:27.512 INFO:teuthology.orchestra.run.smithi144.stderr: 5800K .......... .......... .......... .......... .......... 6% 33.0M 3s 2024-06-04T16:14:27.512 INFO:teuthology.orchestra.run.smithi144.stderr: 5850K .......... .......... .......... .......... .......... 6% 31.2M 3s 2024-06-04T16:14:27.513 INFO:teuthology.orchestra.run.smithi144.stderr: 5900K .......... .......... .......... .......... .......... 6% 114M 3s 2024-06-04T16:14:27.513 INFO:teuthology.orchestra.run.smithi144.stderr: 5950K .......... .......... .......... .......... .......... 6% 49.8M 2s 2024-06-04T16:14:27.513 INFO:teuthology.orchestra.run.smithi144.stderr: 6000K .......... .......... .......... .......... .......... 6% 58.4M 2s 2024-06-04T16:14:27.513 INFO:teuthology.orchestra.run.smithi144.stderr: 6050K .......... .......... .......... .......... .......... 6% 62.7M 2s 2024-06-04T16:14:27.513 INFO:teuthology.orchestra.run.smithi144.stderr: 6100K .......... .......... .......... .......... .......... 6% 120M 2s 2024-06-04T16:14:27.513 INFO:teuthology.orchestra.run.smithi144.stderr: 6150K .......... .......... .......... .......... .......... 6% 33.5M 2s 2024-06-04T16:14:28.746 INFO:teuthology.orchestra.run.smithi144.stderr: 6200K .......... .......... .......... .......... .......... 6% 54.9M 2s 2024-06-04T16:14:28.747 INFO:teuthology.orchestra.run.smithi144.stderr: 6250K .......... .......... .......... .......... .......... 6% 74.7M 2s 2024-06-04T16:14:28.747 INFO:teuthology.orchestra.run.smithi144.stderr: 6300K .......... .......... .......... .......... .......... 6% 114M 2s 2024-06-04T16:14:28.747 INFO:teuthology.orchestra.run.smithi144.stderr: 6350K .......... .......... .......... .......... .......... 6% 105M 2s 2024-06-04T16:14:28.747 INFO:teuthology.orchestra.run.smithi144.stderr: 6400K .......... .......... .......... .......... .......... 6% 115M 2s 2024-06-04T16:14:28.747 INFO:teuthology.orchestra.run.smithi144.stderr: 6450K .......... .......... .......... .......... .......... 6% 107M 2s 2024-06-04T16:14:28.747 INFO:teuthology.orchestra.run.smithi144.stderr: 6500K .......... .......... .......... .......... .......... 7% 116M 2s 2024-06-04T16:14:28.747 INFO:teuthology.orchestra.run.smithi144.stderr: 6550K .......... .......... .......... .......... .......... 7% 111M 2s 2024-06-04T16:14:28.747 INFO:teuthology.orchestra.run.smithi144.stderr: 6600K .......... .......... .......... .......... .......... 7% 71.0M 2s 2024-06-04T16:14:28.747 INFO:teuthology.orchestra.run.smithi144.stderr: 6650K .......... .......... .......... .......... .......... 7% 114M 2s 2024-06-04T16:14:28.747 INFO:teuthology.orchestra.run.smithi144.stderr: 6700K .......... .......... .......... .......... .......... 7% 70.9M 2s 2024-06-04T16:14:28.747 INFO:teuthology.orchestra.run.smithi144.stderr: 6750K .......... .......... .......... .......... .......... 7% 57.6M 2s 2024-06-04T16:14:28.748 INFO:teuthology.orchestra.run.smithi144.stderr: 6800K .......... .......... .......... .......... .......... 7% 42.7M 2s 2024-06-04T16:14:28.748 INFO:teuthology.orchestra.run.smithi144.stderr: 6850K .......... .......... .......... .......... .......... 7% 92.0M 2s 2024-06-04T16:14:28.748 INFO:teuthology.orchestra.run.smithi144.stderr: 6900K .......... .......... .......... .......... .......... 7% 67.1M 2s 2024-06-04T16:14:28.748 INFO:teuthology.orchestra.run.smithi144.stderr: 6950K .......... .......... .......... .......... .......... 7% 108M 2s 2024-06-04T16:14:28.748 INFO:teuthology.orchestra.run.smithi144.stderr: 7000K .......... .......... .......... .......... .......... 7% 45.1M 2s 2024-06-04T16:14:28.748 INFO:teuthology.orchestra.run.smithi144.stderr: 7050K .......... .......... .......... .......... .......... 7% 74.8M 2s 2024-06-04T16:14:28.748 INFO:teuthology.orchestra.run.smithi144.stderr: 7100K .......... .......... .......... .......... .......... 7% 105M 2s 2024-06-04T16:14:28.748 INFO:teuthology.orchestra.run.smithi144.stderr: 7150K .......... .......... .......... .......... .......... 7% 39.1M 2s 2024-06-04T16:14:28.748 INFO:teuthology.orchestra.run.smithi144.stderr: 7200K .......... .......... .......... .......... .......... 7% 87.8M 2s 2024-06-04T16:14:28.748 INFO:teuthology.orchestra.run.smithi144.stderr: 7250K .......... .......... .......... .......... .......... 7% 74.7M 2s 2024-06-04T16:14:28.748 INFO:teuthology.orchestra.run.smithi144.stderr: 7300K .......... .......... .......... .......... .......... 7% 100M 2s 2024-06-04T16:14:28.748 INFO:teuthology.orchestra.run.smithi144.stderr: 7350K .......... .......... .......... .......... .......... 7% 43.6M 2s 2024-06-04T16:14:28.748 INFO:teuthology.orchestra.run.smithi144.stderr: 7400K .......... .......... .......... .......... .......... 8% 34.6M 2s 2024-06-04T16:14:28.748 INFO:teuthology.orchestra.run.smithi144.stderr: 7450K .......... .......... .......... .......... .......... 8% 40.4M 2s 2024-06-04T16:14:28.749 INFO:teuthology.orchestra.run.smithi144.stderr: 7500K .......... .......... .......... .......... .......... 8% 50.8M 2s 2024-06-04T16:14:28.749 INFO:teuthology.orchestra.run.smithi144.stderr: 7550K .......... .......... .......... .......... .......... 8% 179M 2s 2024-06-04T16:14:28.749 INFO:teuthology.orchestra.run.smithi144.stderr: 7600K .......... .......... .......... .......... .......... 8% 63.1M 2s 2024-06-04T16:14:28.749 INFO:teuthology.orchestra.run.smithi144.stderr: 7650K .......... .......... .......... .......... .......... 8% 49.0M 2s 2024-06-04T16:14:28.749 INFO:teuthology.orchestra.run.smithi144.stderr: 7700K .......... .......... .......... .......... .......... 8% 83.4M 2s 2024-06-04T16:14:28.749 INFO:teuthology.orchestra.run.smithi144.stderr: 7750K .......... .......... .......... .......... .......... 8% 102M 2s 2024-06-04T16:14:28.749 INFO:teuthology.orchestra.run.smithi144.stderr: 7800K .......... .......... .......... .......... .......... 8% 78.8M 2s 2024-06-04T16:14:28.749 INFO:teuthology.orchestra.run.smithi144.stderr: 7850K .......... .......... .......... .......... .......... 8% 58.2M 2s 2024-06-04T16:14:28.749 INFO:teuthology.orchestra.run.smithi144.stderr: 7900K .......... .......... .......... .......... .......... 8% 63.8M 2s 2024-06-04T16:14:28.749 INFO:teuthology.orchestra.run.smithi144.stderr: 7950K .......... .......... .......... .......... .......... 8% 56.3M 2s 2024-06-04T16:14:28.749 INFO:teuthology.orchestra.run.smithi144.stderr: 8000K .......... .......... .......... .......... .......... 8% 98.1M 2s 2024-06-04T16:14:28.749 INFO:teuthology.orchestra.run.smithi144.stderr: 8050K .......... .......... .......... .......... .......... 8% 57.0M 2s 2024-06-04T16:14:28.749 INFO:teuthology.orchestra.run.smithi144.stderr: 8100K .......... .......... .......... .......... .......... 8% 87.2M 2s 2024-06-04T16:14:28.750 INFO:teuthology.orchestra.run.smithi144.stderr: 8150K .......... .......... .......... .......... .......... 8% 62.2M 2s 2024-06-04T16:14:28.750 INFO:teuthology.orchestra.run.smithi144.stderr: 8200K .......... .......... .......... .......... .......... 8% 46.4M 2s 2024-06-04T16:14:28.750 INFO:teuthology.orchestra.run.smithi144.stderr: 8250K .......... .......... .......... .......... .......... 8% 120M 2s 2024-06-04T16:14:28.750 INFO:teuthology.orchestra.run.smithi144.stderr: 8300K .......... .......... .......... .......... .......... 8% 39.6M 2s 2024-06-04T16:14:28.750 INFO:teuthology.orchestra.run.smithi144.stderr: 8350K .......... .......... .......... .......... .......... 9% 46.9M 2s 2024-06-04T16:14:28.750 INFO:teuthology.orchestra.run.smithi144.stderr: 8400K .......... .......... .......... .......... .......... 9% 51.2M 2s 2024-06-04T16:14:28.750 INFO:teuthology.orchestra.run.smithi144.stderr: 8450K .......... .......... .......... .......... .......... 9% 111M 2s 2024-06-04T16:14:28.750 INFO:teuthology.orchestra.run.smithi144.stderr: 8500K .......... .......... .......... .......... .......... 9% 81.3M 2s 2024-06-04T16:14:28.750 INFO:teuthology.orchestra.run.smithi144.stderr: 8550K .......... .......... .......... .......... .......... 9% 60.7M 2s 2024-06-04T16:14:28.750 INFO:teuthology.orchestra.run.smithi144.stderr: 8600K .......... .......... .......... .......... .......... 9% 58.1M 2s 2024-06-04T16:14:28.750 INFO:teuthology.orchestra.run.smithi144.stderr: 8650K .......... .......... .......... .......... .......... 9% 44.2M 2s 2024-06-04T16:14:28.750 INFO:teuthology.orchestra.run.smithi144.stderr: 8700K .......... .......... .......... .......... .......... 9% 75.6M 2s 2024-06-04T16:14:28.751 INFO:teuthology.orchestra.run.smithi144.stderr: 8750K .......... .......... .......... .......... .......... 9% 96.6M 2s 2024-06-04T16:14:28.751 INFO:teuthology.orchestra.run.smithi144.stderr: 8800K .......... .......... .......... .......... .......... 9% 80.3M 2s 2024-06-04T16:14:28.751 INFO:teuthology.orchestra.run.smithi144.stderr: 8850K .......... .......... .......... .......... .......... 9% 72.0M 2s 2024-06-04T16:14:28.751 INFO:teuthology.orchestra.run.smithi144.stderr: 8900K .......... .......... .......... .......... .......... 9% 106M 2s 2024-06-04T16:14:28.751 INFO:teuthology.orchestra.run.smithi144.stderr: 8950K .......... .......... .......... .......... .......... 9% 116M 2s 2024-06-04T16:14:28.751 INFO:teuthology.orchestra.run.smithi144.stderr: 9000K .......... .......... .......... .......... .......... 9% 116M 2s 2024-06-04T16:14:28.751 INFO:teuthology.orchestra.run.smithi144.stderr: 9050K .......... .......... .......... .......... .......... 9% 111M 2s 2024-06-04T16:14:28.751 INFO:teuthology.orchestra.run.smithi144.stderr: 9100K .......... .......... .......... .......... .......... 9% 111M 2s 2024-06-04T16:14:28.751 INFO:teuthology.orchestra.run.smithi144.stderr: 9150K .......... .......... .......... .......... .......... 9% 115M 2s 2024-06-04T16:14:28.751 INFO:teuthology.orchestra.run.smithi144.stderr: 9200K .......... .......... .......... .......... .......... 9% 109M 2s 2024-06-04T16:14:28.751 INFO:teuthology.orchestra.run.smithi144.stderr: 9250K .......... .......... .......... .......... .......... 10% 70.8M 2s 2024-06-04T16:14:28.751 INFO:teuthology.orchestra.run.smithi144.stderr: 9300K .......... .......... .......... .......... .......... 10% 44.9M 2s 2024-06-04T16:14:28.751 INFO:teuthology.orchestra.run.smithi144.stderr: 9350K .......... .......... .......... .......... .......... 10% 55.3M 2s 2024-06-04T16:14:28.751 INFO:teuthology.orchestra.run.smithi144.stderr: 9400K .......... .......... .......... .......... .......... 10% 120M 2s 2024-06-04T16:14:28.752 INFO:teuthology.orchestra.run.smithi144.stderr: 9450K .......... .......... .......... .......... .......... 10% 61.5M 2s 2024-06-04T16:14:28.752 INFO:teuthology.orchestra.run.smithi144.stderr: 9500K .......... .......... .......... .......... .......... 10% 69.5M 2s 2024-06-04T16:14:28.752 INFO:teuthology.orchestra.run.smithi144.stderr: 9550K .......... .......... .......... .......... .......... 10% 94.0M 2s 2024-06-04T16:14:28.752 INFO:teuthology.orchestra.run.smithi144.stderr: 9600K .......... .......... .......... .......... .......... 10% 110M 2s 2024-06-04T16:14:28.752 INFO:teuthology.orchestra.run.smithi144.stderr: 9650K .......... .......... .......... .......... .......... 10% 72.3M 2s 2024-06-04T16:14:28.752 INFO:teuthology.orchestra.run.smithi144.stderr: 9700K .......... .......... .......... .......... .......... 10% 75.8M 2s 2024-06-04T16:14:28.752 INFO:teuthology.orchestra.run.smithi144.stderr: 9750K .......... .......... .......... .......... .......... 10% 79.4M 2s 2024-06-04T16:14:28.752 INFO:teuthology.orchestra.run.smithi144.stderr: 9800K .......... .......... .......... .......... .......... 10% 106M 2s 2024-06-04T16:14:28.752 INFO:teuthology.orchestra.run.smithi144.stderr: 9850K .......... .......... .......... .......... .......... 10% 106M 2s 2024-06-04T16:14:28.752 INFO:teuthology.orchestra.run.smithi144.stderr: 9900K .......... .......... .......... .......... .......... 10% 127M 2s 2024-06-04T16:14:28.752 INFO:teuthology.orchestra.run.smithi144.stderr: 9950K .......... .......... .......... .......... .......... 10% 62.7M 2s 2024-06-04T16:14:28.752 INFO:teuthology.orchestra.run.smithi144.stderr: 10000K .......... .......... .......... .......... .......... 10% 111M 2s 2024-06-04T16:14:28.752 INFO:teuthology.orchestra.run.smithi144.stderr: 10050K .......... .......... .......... .......... .......... 10% 82.8M 2s 2024-06-04T16:14:28.753 INFO:teuthology.orchestra.run.smithi144.stderr: 10100K .......... .......... .......... .......... .......... 10% 113M 2s 2024-06-04T16:14:28.753 INFO:teuthology.orchestra.run.smithi144.stderr: 10150K .......... .......... .......... .......... .......... 10% 108M 2s 2024-06-04T16:14:28.753 INFO:teuthology.orchestra.run.smithi144.stderr: 10200K .......... .......... .......... .......... .......... 11% 120M 2s 2024-06-04T16:14:28.753 INFO:teuthology.orchestra.run.smithi144.stderr: 10250K .......... .......... .......... .......... .......... 11% 112M 2s 2024-06-04T16:14:28.753 INFO:teuthology.orchestra.run.smithi144.stderr: 10300K .......... .......... .......... .......... .......... 11% 108M 2s 2024-06-04T16:14:28.753 INFO:teuthology.orchestra.run.smithi144.stderr: 10350K .......... .......... .......... .......... .......... 11% 87.7M 2s 2024-06-04T16:14:28.753 INFO:teuthology.orchestra.run.smithi144.stderr: 10400K .......... .......... .......... .......... .......... 11% 113M 2s 2024-06-04T16:14:28.753 INFO:teuthology.orchestra.run.smithi144.stderr: 10450K .......... .......... .......... .......... .......... 11% 32.2M 2s 2024-06-04T16:14:28.753 INFO:teuthology.orchestra.run.smithi144.stderr: 10500K .......... .......... .......... .......... .......... 11% 21.2M 2s 2024-06-04T16:14:28.753 INFO:teuthology.orchestra.run.smithi144.stderr: 10550K .......... .......... .......... .......... .......... 11% 80.2M 2s 2024-06-04T16:14:28.753 INFO:teuthology.orchestra.run.smithi144.stderr: 10600K .......... .......... .......... .......... .......... 11% 96.5M 2s 2024-06-04T16:14:28.753 INFO:teuthology.orchestra.run.smithi144.stderr: 10650K .......... .......... .......... .......... .......... 11% 81.6M 2s 2024-06-04T16:14:28.753 INFO:teuthology.orchestra.run.smithi144.stderr: 10700K .......... .......... .......... .......... .......... 11% 97.0M 2s 2024-06-04T16:14:28.753 INFO:teuthology.orchestra.run.smithi144.stderr: 10750K .......... .......... .......... .......... .......... 11% 67.4M 2s 2024-06-04T16:14:28.754 INFO:teuthology.orchestra.run.smithi144.stderr: 10800K .......... .......... .......... .......... .......... 11% 124M 2s 2024-06-04T16:14:28.754 INFO:teuthology.orchestra.run.smithi144.stderr: 10850K .......... .......... .......... .......... .......... 11% 56.8M 2s 2024-06-04T16:14:28.754 INFO:teuthology.orchestra.run.smithi144.stderr: 10900K .......... .......... .......... .......... .......... 11% 68.5M 2s 2024-06-04T16:14:28.754 INFO:teuthology.orchestra.run.smithi144.stderr: 10950K .......... .......... .......... .......... .......... 11% 63.6M 2s 2024-06-04T16:14:28.754 INFO:teuthology.orchestra.run.smithi144.stderr: 11000K .......... .......... .......... .......... .......... 11% 113M 2s 2024-06-04T16:14:28.754 INFO:teuthology.orchestra.run.smithi144.stderr: 11050K .......... .......... .......... .......... .......... 11% 116M 2s 2024-06-04T16:14:28.754 INFO:teuthology.orchestra.run.smithi144.stderr: 11100K .......... .......... .......... .......... .......... 12% 114M 2s 2024-06-04T16:14:28.754 INFO:teuthology.orchestra.run.smithi144.stderr: 11150K .......... .......... .......... .......... .......... 12% 117M 2s 2024-06-04T16:14:28.754 INFO:teuthology.orchestra.run.smithi144.stderr: 11200K .......... .......... .......... .......... .......... 12% 99.7M 2s 2024-06-04T16:14:28.754 INFO:teuthology.orchestra.run.smithi144.stderr: 11250K .......... .......... .......... .......... .......... 12% 94.3M 2s 2024-06-04T16:14:28.754 INFO:teuthology.orchestra.run.smithi144.stderr: 11300K .......... .......... .......... .......... .......... 12% 116M 2s 2024-06-04T16:14:28.754 INFO:teuthology.orchestra.run.smithi144.stderr: 11350K .......... .......... .......... .......... .......... 12% 109M 2s 2024-06-04T16:14:28.754 INFO:teuthology.orchestra.run.smithi144.stderr: 11400K .......... .......... .......... .......... .......... 12% 115M 2s 2024-06-04T16:14:28.755 INFO:teuthology.orchestra.run.smithi144.stderr: 11450K .......... .......... .......... .......... .......... 12% 96.7M 2s 2024-06-04T16:14:28.755 INFO:teuthology.orchestra.run.smithi144.stderr: 11500K .......... .......... .......... .......... .......... 12% 126M 2s 2024-06-04T16:14:28.755 INFO:teuthology.orchestra.run.smithi144.stderr: 11550K .......... .......... .......... .......... .......... 12% 117M 2s 2024-06-04T16:14:28.755 INFO:teuthology.orchestra.run.smithi144.stderr: 11600K .......... .......... .......... .......... .......... 12% 115M 2s 2024-06-04T16:14:28.755 INFO:teuthology.orchestra.run.smithi144.stderr: 11650K .......... .......... .......... .......... .......... 12% 84.6M 2s 2024-06-04T16:14:28.755 INFO:teuthology.orchestra.run.smithi144.stderr: 11700K .......... .......... .......... .......... .......... 12% 116M 2s 2024-06-04T16:14:28.755 INFO:teuthology.orchestra.run.smithi144.stderr: 11750K .......... .......... .......... .......... .......... 12% 97.7M 2s 2024-06-04T16:14:28.755 INFO:teuthology.orchestra.run.smithi144.stderr: 11800K .......... .......... .......... .......... .......... 12% 130M 2s 2024-06-04T16:14:28.755 INFO:teuthology.orchestra.run.smithi144.stderr: 11850K .......... .......... .......... .......... .......... 12% 111M 2s 2024-06-04T16:14:28.755 INFO:teuthology.orchestra.run.smithi144.stderr: 11900K .......... .......... .......... .......... .......... 12% 115M 2s 2024-06-04T16:14:28.755 INFO:teuthology.orchestra.run.smithi144.stderr: 11950K .......... .......... .......... .......... .......... 12% 113M 2s 2024-06-04T16:14:28.755 INFO:teuthology.orchestra.run.smithi144.stderr: 12000K .......... .......... .......... .......... .......... 12% 114M 2s 2024-06-04T16:14:28.755 INFO:teuthology.orchestra.run.smithi144.stderr: 12050K .......... .......... .......... .......... .......... 13% 86.3M 2s 2024-06-04T16:14:28.756 INFO:teuthology.orchestra.run.smithi144.stderr: 12100K .......... .......... .......... .......... .......... 13% 112M 2s 2024-06-04T16:14:28.756 INFO:teuthology.orchestra.run.smithi144.stderr: 12150K .......... .......... .......... .......... .......... 13% 117M 2s 2024-06-04T16:14:28.756 INFO:teuthology.orchestra.run.smithi144.stderr: 12200K .......... .......... .......... .......... .......... 13% 113M 2s 2024-06-04T16:14:28.756 INFO:teuthology.orchestra.run.smithi144.stderr: 12250K .......... .......... .......... .......... .......... 13% 112M 2s 2024-06-04T16:14:28.756 INFO:teuthology.orchestra.run.smithi144.stderr: 12300K .......... .......... .......... .......... .......... 13% 95.2M 2s 2024-06-04T16:14:28.756 INFO:teuthology.orchestra.run.smithi144.stderr: 12350K .......... .......... .......... .......... .......... 13% 140M 2s 2024-06-04T16:14:28.756 INFO:teuthology.orchestra.run.smithi144.stderr: 12400K .......... .......... .......... .......... .......... 13% 115M 2s 2024-06-04T16:14:28.756 INFO:teuthology.orchestra.run.smithi144.stderr: 12450K .......... .......... .......... .......... .......... 13% 90.5M 2s 2024-06-04T16:14:28.756 INFO:teuthology.orchestra.run.smithi144.stderr: 12500K .......... .......... .......... .......... .......... 13% 120M 2s 2024-06-04T16:14:28.756 INFO:teuthology.orchestra.run.smithi144.stderr: 12550K .......... .......... .......... .......... .......... 13% 111M 2s 2024-06-04T16:14:28.756 INFO:teuthology.orchestra.run.smithi144.stderr: 12600K .......... .......... .......... .......... .......... 13% 117M 2s 2024-06-04T16:14:28.756 INFO:teuthology.orchestra.run.smithi144.stderr: 12650K .......... .......... .......... .......... .......... 13% 110M 2s 2024-06-04T16:14:28.756 INFO:teuthology.orchestra.run.smithi144.stderr: 12700K .......... .......... .......... .......... .......... 13% 115M 2s 2024-06-04T16:14:28.756 INFO:teuthology.orchestra.run.smithi144.stderr: 12750K .......... .......... .......... .......... .......... 13% 112M 2s 2024-06-04T16:14:28.756 INFO:teuthology.orchestra.run.smithi144.stderr: 12800K .......... .......... .......... .......... .......... 13% 117M 2s 2024-06-04T16:14:28.757 INFO:teuthology.orchestra.run.smithi144.stderr: 12850K .......... .......... .......... .......... .......... 13% 97.1M 2s 2024-06-04T16:14:28.757 INFO:teuthology.orchestra.run.smithi144.stderr: 12900K .......... .......... .......... .......... .......... 13% 91.3M 2s 2024-06-04T16:14:28.757 INFO:teuthology.orchestra.run.smithi144.stderr: 12950K .......... .......... .......... .......... .......... 13% 134M 2s 2024-06-04T16:14:28.757 INFO:teuthology.orchestra.run.smithi144.stderr: 13000K .......... .......... .......... .......... .......... 14% 94.4M 2s 2024-06-04T16:14:28.757 INFO:teuthology.orchestra.run.smithi144.stderr: 13050K .......... .......... .......... .......... .......... 14% 113M 2s 2024-06-04T16:14:28.757 INFO:teuthology.orchestra.run.smithi144.stderr: 13100K .......... .......... .......... .......... .......... 14% 144M 2s 2024-06-04T16:14:28.757 INFO:teuthology.orchestra.run.smithi144.stderr: 13150K .......... .......... .......... .......... .......... 14% 77.4M 2s 2024-06-04T16:14:28.757 INFO:teuthology.orchestra.run.smithi144.stderr: 13200K .......... .......... .......... .......... .......... 14% 126M 2s 2024-06-04T16:14:28.757 INFO:teuthology.orchestra.run.smithi144.stderr: 13250K .......... .......... .......... .......... .......... 14% 126M 2s 2024-06-04T16:14:28.757 INFO:teuthology.orchestra.run.smithi144.stderr: 13300K .......... .......... .......... .......... .......... 14% 94.5M 2s 2024-06-04T16:14:28.757 INFO:teuthology.orchestra.run.smithi144.stderr: 13350K .......... .......... .......... .......... .......... 14% 121M 2s 2024-06-04T16:14:28.757 INFO:teuthology.orchestra.run.smithi144.stderr: 13400K .......... .......... .......... .......... .......... 14% 129M 2s 2024-06-04T16:14:28.757 INFO:teuthology.orchestra.run.smithi144.stderr: 13450K .......... .......... .......... .......... .......... 14% 114M 2s 2024-06-04T16:14:28.757 INFO:teuthology.orchestra.run.smithi144.stderr: 13500K .......... .......... .......... .......... .......... 14% 113M 2s 2024-06-04T16:14:28.757 INFO:teuthology.orchestra.run.smithi144.stderr: 13550K .......... .......... .......... .......... .......... 14% 85.8M 2s 2024-06-04T16:14:28.758 INFO:teuthology.orchestra.run.smithi144.stderr: 13600K .......... .......... .......... .......... .......... 14% 85.7M 2s 2024-06-04T16:14:28.758 INFO:teuthology.orchestra.run.smithi144.stderr: 13650K .......... .......... .......... .......... .......... 14% 185M 2s 2024-06-04T16:14:28.758 INFO:teuthology.orchestra.run.smithi144.stderr: 13700K .......... .......... .......... .......... .......... 14% 110M 2s 2024-06-04T16:14:28.758 INFO:teuthology.orchestra.run.smithi144.stderr: 13750K .......... .......... .......... .......... .......... 14% 93.3M 2s 2024-06-04T16:14:28.758 INFO:teuthology.orchestra.run.smithi144.stderr: 13800K .......... .......... .......... .......... .......... 14% 121M 2s 2024-06-04T16:14:28.758 INFO:teuthology.orchestra.run.smithi144.stderr: 13850K .......... .......... .......... .......... .......... 14% 115M 2s 2024-06-04T16:14:28.758 INFO:teuthology.orchestra.run.smithi144.stderr: 13900K .......... .......... .......... .......... .......... 15% 112M 2s 2024-06-04T16:14:28.758 INFO:teuthology.orchestra.run.smithi144.stderr: 13950K .......... .......... .......... .......... .......... 15% 89.2M 2s 2024-06-04T16:14:28.758 INFO:teuthology.orchestra.run.smithi144.stderr: 14000K .......... .......... .......... .......... .......... 15% 114M 2s 2024-06-04T16:14:28.758 INFO:teuthology.orchestra.run.smithi144.stderr: 14050K .......... .......... .......... .......... .......... 15% 99.9M 2s 2024-06-04T16:14:28.758 INFO:teuthology.orchestra.run.smithi144.stderr: 14100K .......... .......... .......... .......... .......... 15% 122M 2s 2024-06-04T16:14:28.758 INFO:teuthology.orchestra.run.smithi144.stderr: 14150K .......... .......... .......... .......... .......... 15% 82.0M 1s 2024-06-04T16:14:28.758 INFO:teuthology.orchestra.run.smithi144.stderr: 14200K .......... .......... .......... .......... .......... 15% 94.6M 1s 2024-06-04T16:14:28.759 INFO:teuthology.orchestra.run.smithi144.stderr: 14250K .......... .......... .......... .......... .......... 15% 125M 1s 2024-06-04T16:14:28.759 INFO:teuthology.orchestra.run.smithi144.stderr: 14300K .......... .......... .......... .......... .......... 15% 97.8M 1s 2024-06-04T16:14:28.759 INFO:teuthology.orchestra.run.smithi144.stderr: 14350K .......... .......... .......... .......... .......... 15% 127M 1s 2024-06-04T16:14:28.759 INFO:teuthology.orchestra.run.smithi144.stderr: 14400K .......... .......... .......... .......... .......... 15% 94.5M 1s 2024-06-04T16:14:28.759 INFO:teuthology.orchestra.run.smithi144.stderr: 14450K .......... .......... .......... .......... .......... 15% 126M 1s 2024-06-04T16:14:28.759 INFO:teuthology.orchestra.run.smithi144.stderr: 14500K .......... .......... .......... .......... .......... 15% 121M 1s 2024-06-04T16:14:28.759 INFO:teuthology.orchestra.run.smithi144.stderr: 14550K .......... .......... .......... .......... .......... 15% 94.5M 1s 2024-06-04T16:14:28.759 INFO:teuthology.orchestra.run.smithi144.stderr: 14600K .......... .......... .......... .......... .......... 15% 147M 1s 2024-06-04T16:14:28.759 INFO:teuthology.orchestra.run.smithi144.stderr: 14650K .......... .......... .......... .......... .......... 15% 112M 1s 2024-06-04T16:14:28.759 INFO:teuthology.orchestra.run.smithi144.stderr: 14700K .......... .......... .......... .......... .......... 15% 88.2M 1s 2024-06-04T16:14:28.759 INFO:teuthology.orchestra.run.smithi144.stderr: 14750K .......... .......... .......... .......... .......... 15% 121M 1s 2024-06-04T16:14:28.759 INFO:teuthology.orchestra.run.smithi144.stderr: 14800K .......... .......... .......... .......... .......... 15% 108M 1s 2024-06-04T16:14:28.759 INFO:teuthology.orchestra.run.smithi144.stderr: 14850K .......... .......... .......... .......... .......... 16% 114M 1s 2024-06-04T16:14:28.759 INFO:teuthology.orchestra.run.smithi144.stderr: 14900K .......... .......... .......... .......... .......... 16% 114M 1s 2024-06-04T16:14:28.760 INFO:teuthology.orchestra.run.smithi144.stderr: 14950K .......... .......... .......... .......... .......... 16% 110M 1s 2024-06-04T16:14:28.760 INFO:teuthology.orchestra.run.smithi144.stderr: 15000K .......... .......... .......... .......... .......... 16% 109M 1s 2024-06-04T16:14:28.760 INFO:teuthology.orchestra.run.smithi144.stderr: 15050K .......... .......... .......... .......... .......... 16% 103M 1s 2024-06-04T16:14:28.760 INFO:teuthology.orchestra.run.smithi144.stderr: 15100K .......... .......... .......... .......... .......... 16% 107M 1s 2024-06-04T16:14:28.760 INFO:teuthology.orchestra.run.smithi144.stderr: 15150K .......... .......... .......... .......... .......... 16% 122M 1s 2024-06-04T16:14:28.760 INFO:teuthology.orchestra.run.smithi144.stderr: 15200K .......... .......... .......... .......... .......... 16% 109M 1s 2024-06-04T16:14:28.760 INFO:teuthology.orchestra.run.smithi144.stderr: 15250K .......... .......... .......... .......... .......... 16% 109M 1s 2024-06-04T16:14:28.760 INFO:teuthology.orchestra.run.smithi144.stderr: 15300K .......... .......... .......... .......... .......... 16% 124M 1s 2024-06-04T16:14:28.760 INFO:teuthology.orchestra.run.smithi144.stderr: 15350K .......... .......... .......... .......... .......... 16% 115M 1s 2024-06-04T16:14:28.760 INFO:teuthology.orchestra.run.smithi144.stderr: 15400K .......... .......... .......... .......... .......... 16% 115M 1s 2024-06-04T16:14:28.760 INFO:teuthology.orchestra.run.smithi144.stderr: 15450K .......... .......... .......... .......... .......... 16% 90.0M 1s 2024-06-04T16:14:28.760 INFO:teuthology.orchestra.run.smithi144.stderr: 15500K .......... .......... .......... .......... .......... 16% 116M 1s 2024-06-04T16:14:28.760 INFO:teuthology.orchestra.run.smithi144.stderr: 15550K .......... .......... .......... .......... .......... 16% 92.0M 1s 2024-06-04T16:14:28.760 INFO:teuthology.orchestra.run.smithi144.stderr: 15600K .......... .......... .......... .......... .......... 16% 118M 1s 2024-06-04T16:14:28.761 INFO:teuthology.orchestra.run.smithi144.stderr: 15650K .......... .......... .......... .......... .......... 16% 109M 1s 2024-06-04T16:14:28.761 INFO:teuthology.orchestra.run.smithi144.stderr: 15700K .......... .......... .......... .......... .......... 16% 124M 1s 2024-06-04T16:14:28.761 INFO:teuthology.orchestra.run.smithi144.stderr: 15750K .......... .......... .......... .......... .......... 17% 103M 1s 2024-06-04T16:14:28.761 INFO:teuthology.orchestra.run.smithi144.stderr: 15800K .......... .......... .......... .......... .......... 17% 112M 1s 2024-06-04T16:14:28.761 INFO:teuthology.orchestra.run.smithi144.stderr: 15850K .......... .......... .......... .......... .......... 17% 92.6M 1s 2024-06-04T16:14:28.761 INFO:teuthology.orchestra.run.smithi144.stderr: 15900K .......... .......... .......... .......... .......... 17% 69.0M 1s 2024-06-04T16:14:28.761 INFO:teuthology.orchestra.run.smithi144.stderr: 15950K .......... .......... .......... .......... .......... 17% 120M 1s 2024-06-04T16:14:28.761 INFO:teuthology.orchestra.run.smithi144.stderr: 16000K .......... .......... .......... .......... .......... 17% 110M 1s 2024-06-04T16:14:28.761 INFO:teuthology.orchestra.run.smithi144.stderr: 16050K .......... .......... .......... .......... .......... 17% 115M 1s 2024-06-04T16:14:28.761 INFO:teuthology.orchestra.run.smithi144.stderr: 16100K .......... .......... .......... .......... .......... 17% 109M 1s 2024-06-04T16:14:28.761 INFO:teuthology.orchestra.run.smithi144.stderr: 16150K .......... .......... .......... .......... .......... 17% 120M 1s 2024-06-04T16:14:28.761 INFO:teuthology.orchestra.run.smithi144.stderr: 16200K .......... .......... .......... .......... .......... 17% 67.9M 1s 2024-06-04T16:14:28.761 INFO:teuthology.orchestra.run.smithi144.stderr: 16250K .......... .......... .......... .......... .......... 17% 18.8M 1s 2024-06-04T16:14:28.761 INFO:teuthology.orchestra.run.smithi144.stderr: 16300K .......... .......... .......... .......... .......... 17% 51.5M 1s 2024-06-04T16:14:28.762 INFO:teuthology.orchestra.run.smithi144.stderr: 16350K .......... .......... .......... .......... .......... 17% 100M 1s 2024-06-04T16:14:28.762 INFO:teuthology.orchestra.run.smithi144.stderr: 16400K .......... .......... .......... .......... .......... 17% 115M 1s 2024-06-04T16:14:28.762 INFO:teuthology.orchestra.run.smithi144.stderr: 16450K .......... .......... .......... .......... .......... 17% 94.8M 1s 2024-06-04T16:14:28.762 INFO:teuthology.orchestra.run.smithi144.stderr: 16500K .......... .......... .......... .......... .......... 17% 72.2M 1s 2024-06-04T16:14:28.762 INFO:teuthology.orchestra.run.smithi144.stderr: 16550K .......... .......... .......... .......... .......... 17% 79.5M 1s 2024-06-04T16:14:28.762 INFO:teuthology.orchestra.run.smithi144.stderr: 16600K .......... .......... .......... .......... .......... 17% 120M 1s 2024-06-04T16:14:28.762 INFO:teuthology.orchestra.run.smithi144.stderr: 16650K .......... .......... .......... .......... .......... 17% 78.9M 1s 2024-06-04T16:14:28.762 INFO:teuthology.orchestra.run.smithi144.stderr: 16700K .......... .......... .......... .......... .......... 18% 87.2M 1s 2024-06-04T16:14:28.762 INFO:teuthology.orchestra.run.smithi144.stderr: 16750K .......... .......... .......... .......... .......... 18% 44.4M 1s 2024-06-04T16:14:28.762 INFO:teuthology.orchestra.run.smithi144.stderr: 16800K .......... .......... .......... .......... .......... 18% 94.2M 1s 2024-06-04T16:14:28.762 INFO:teuthology.orchestra.run.smithi144.stderr: 16850K .......... .......... .......... .......... .......... 18% 87.0M 1s 2024-06-04T16:14:28.762 INFO:teuthology.orchestra.run.smithi144.stderr: 16900K .......... .......... .......... .......... .......... 18% 114M 1s 2024-06-04T16:14:28.762 INFO:teuthology.orchestra.run.smithi144.stderr: 16950K .......... .......... .......... .......... .......... 18% 96.1M 1s 2024-06-04T16:14:28.763 INFO:teuthology.orchestra.run.smithi144.stderr: 17000K .......... .......... .......... .......... .......... 18% 86.1M 1s 2024-06-04T16:14:28.763 INFO:teuthology.orchestra.run.smithi144.stderr: 17050K .......... .......... .......... .......... .......... 18% 73.9M 1s 2024-06-04T16:14:28.763 INFO:teuthology.orchestra.run.smithi144.stderr: 17100K .......... .......... .......... .......... .......... 18% 84.0M 1s 2024-06-04T16:14:28.763 INFO:teuthology.orchestra.run.smithi144.stderr: 17150K .......... .......... .......... .......... .......... 18% 110M 1s 2024-06-04T16:14:28.763 INFO:teuthology.orchestra.run.smithi144.stderr: 17200K .......... .......... .......... .......... .......... 18% 87.1M 1s 2024-06-04T16:14:28.763 INFO:teuthology.orchestra.run.smithi144.stderr: 17250K .......... .......... .......... .......... .......... 18% 82.8M 1s 2024-06-04T16:14:28.763 INFO:teuthology.orchestra.run.smithi144.stderr: 17300K .......... .......... .......... .......... .......... 18% 61.4M 1s 2024-06-04T16:14:28.763 INFO:teuthology.orchestra.run.smithi144.stderr: 17350K .......... .......... .......... .......... .......... 18% 108M 1s 2024-06-04T16:14:28.763 INFO:teuthology.orchestra.run.smithi144.stderr: 17400K .......... .......... .......... .......... .......... 18% 46.5M 1s 2024-06-04T16:14:28.763 INFO:teuthology.orchestra.run.smithi144.stderr: 17450K .......... .......... .......... .......... .......... 18% 162M 1s 2024-06-04T16:14:28.763 INFO:teuthology.orchestra.run.smithi144.stderr: 17500K .......... .......... .......... .......... .......... 18% 114M 1s 2024-06-04T16:14:28.763 INFO:teuthology.orchestra.run.smithi144.stderr: 17550K .......... .......... .......... .......... .......... 18% 114M 1s 2024-06-04T16:14:28.763 INFO:teuthology.orchestra.run.smithi144.stderr: 17600K .......... .......... .......... .......... .......... 18% 110M 1s 2024-06-04T16:14:28.763 INFO:teuthology.orchestra.run.smithi144.stderr: 17650K .......... .......... .......... .......... .......... 19% 116M 1s 2024-06-04T16:14:28.764 INFO:teuthology.orchestra.run.smithi144.stderr: 17700K .......... .......... .......... .......... .......... 19% 106M 1s 2024-06-04T16:14:28.764 INFO:teuthology.orchestra.run.smithi144.stderr: 17750K .......... .......... .......... .......... .......... 19% 122M 1s 2024-06-04T16:14:28.764 INFO:teuthology.orchestra.run.smithi144.stderr: 17800K .......... .......... .......... .......... .......... 19% 81.4M 1s 2024-06-04T16:14:28.764 INFO:teuthology.orchestra.run.smithi144.stderr: 17850K .......... .......... .......... .......... .......... 19% 129M 1s 2024-06-04T16:14:28.764 INFO:teuthology.orchestra.run.smithi144.stderr: 17900K .......... .......... .......... .......... .......... 19% 115M 1s 2024-06-04T16:14:28.764 INFO:teuthology.orchestra.run.smithi144.stderr: 17950K .......... .......... .......... .......... .......... 19% 112M 1s 2024-06-04T16:14:28.764 INFO:teuthology.orchestra.run.smithi144.stderr: 18000K .......... .......... .......... .......... .......... 19% 112M 1s 2024-06-04T16:14:28.764 INFO:teuthology.orchestra.run.smithi144.stderr: 18050K .......... .......... .......... .......... .......... 19% 119M 1s 2024-06-04T16:14:28.764 INFO:teuthology.orchestra.run.smithi144.stderr: 18100K .......... .......... .......... .......... .......... 19% 113M 1s 2024-06-04T16:14:28.764 INFO:teuthology.orchestra.run.smithi144.stderr: 18150K .......... .......... .......... .......... .......... 19% 113M 1s 2024-06-04T16:14:28.764 INFO:teuthology.orchestra.run.smithi144.stderr: 18200K .......... .......... .......... .......... .......... 19% 85.1M 1s 2024-06-04T16:14:28.764 INFO:teuthology.orchestra.run.smithi144.stderr: 18250K .......... .......... .......... .......... .......... 19% 119M 1s 2024-06-04T16:14:28.764 INFO:teuthology.orchestra.run.smithi144.stderr: 18300K .......... .......... .......... .......... .......... 19% 117M 1s 2024-06-04T16:14:28.764 INFO:teuthology.orchestra.run.smithi144.stderr: 18350K .......... .......... .......... .......... .......... 19% 114M 1s 2024-06-04T16:14:28.765 INFO:teuthology.orchestra.run.smithi144.stderr: 18400K .......... .......... .......... .......... .......... 19% 111M 1s 2024-06-04T16:14:28.765 INFO:teuthology.orchestra.run.smithi144.stderr: 18450K .......... .......... .......... .......... .......... 19% 120M 1s 2024-06-04T16:14:28.765 INFO:teuthology.orchestra.run.smithi144.stderr: 18500K .......... .......... .......... .......... .......... 19% 111M 1s 2024-06-04T16:14:28.765 INFO:teuthology.orchestra.run.smithi144.stderr: 18550K .......... .......... .......... .......... .......... 20% 117M 1s 2024-06-04T16:14:28.765 INFO:teuthology.orchestra.run.smithi144.stderr: 18600K .......... .......... .......... .......... .......... 20% 87.6M 1s 2024-06-04T16:14:28.765 INFO:teuthology.orchestra.run.smithi144.stderr: 18650K .......... .......... .......... .......... .......... 20% 104M 1s 2024-06-04T16:14:28.765 INFO:teuthology.orchestra.run.smithi144.stderr: 18700K .......... .......... .......... .......... .......... 20% 128M 1s 2024-06-04T16:14:28.765 INFO:teuthology.orchestra.run.smithi144.stderr: 18750K .......... .......... .......... .......... .......... 20% 111M 1s 2024-06-04T16:14:28.765 INFO:teuthology.orchestra.run.smithi144.stderr: 18800K .......... .......... .......... .......... .......... 20% 109M 1s 2024-06-04T16:14:28.765 INFO:teuthology.orchestra.run.smithi144.stderr: 18850K .......... .......... .......... .......... .......... 20% 114M 1s 2024-06-04T16:14:28.765 INFO:teuthology.orchestra.run.smithi144.stderr: 18900K .......... .......... .......... .......... .......... 20% 116M 1s 2024-06-04T16:14:28.765 INFO:teuthology.orchestra.run.smithi144.stderr: 18950K .......... .......... .......... .......... .......... 20% 114M 1s 2024-06-04T16:14:28.765 INFO:teuthology.orchestra.run.smithi144.stderr: 19000K .......... .......... .......... .......... .......... 20% 74.8M 1s 2024-06-04T16:14:28.766 INFO:teuthology.orchestra.run.smithi144.stderr: 19050K .......... .......... .......... .......... .......... 20% 124M 1s 2024-06-04T16:14:28.766 INFO:teuthology.orchestra.run.smithi144.stderr: 19100K .......... .......... .......... .......... .......... 20% 114M 1s 2024-06-04T16:14:28.766 INFO:teuthology.orchestra.run.smithi144.stderr: 19150K .......... .......... .......... .......... .......... 20% 84.9M 1s 2024-06-04T16:14:28.766 INFO:teuthology.orchestra.run.smithi144.stderr: 19200K .......... .......... .......... .......... .......... 20% 113M 1s 2024-06-04T16:14:28.766 INFO:teuthology.orchestra.run.smithi144.stderr: 19250K .......... .......... .......... .......... .......... 20% 106M 1s 2024-06-04T16:14:28.766 INFO:teuthology.orchestra.run.smithi144.stderr: 19300K .......... .......... .......... .......... .......... 20% 115M 1s 2024-06-04T16:14:28.766 INFO:teuthology.orchestra.run.smithi144.stderr: 19350K .......... .......... .......... .......... .......... 20% 116M 1s 2024-06-04T16:14:28.766 INFO:teuthology.orchestra.run.smithi144.stderr: 19400K .......... .......... .......... .......... .......... 20% 96.3M 1s 2024-06-04T16:14:28.766 INFO:teuthology.orchestra.run.smithi144.stderr: 19450K .......... .......... .......... .......... .......... 20% 118M 1s 2024-06-04T16:14:28.766 INFO:teuthology.orchestra.run.smithi144.stderr: 19500K .......... .......... .......... .......... .......... 21% 109M 1s 2024-06-04T16:14:28.766 INFO:teuthology.orchestra.run.smithi144.stderr: 19550K .......... .......... .......... .......... .......... 21% 112M 1s 2024-06-04T16:14:28.766 INFO:teuthology.orchestra.run.smithi144.stderr: 19600K .......... .......... .......... .......... .......... 21% 109M 1s 2024-06-04T16:14:28.766 INFO:teuthology.orchestra.run.smithi144.stderr: 19650K .......... .......... .......... .......... .......... 21% 112M 1s 2024-06-04T16:14:28.767 INFO:teuthology.orchestra.run.smithi144.stderr: 19700K .......... .......... .......... .......... .......... 21% 95.4M 1s 2024-06-04T16:14:28.767 INFO:teuthology.orchestra.run.smithi144.stderr: 19750K .......... .......... .......... .......... .......... 21% 111M 1s 2024-06-04T16:14:28.767 INFO:teuthology.orchestra.run.smithi144.stderr: 19800K .......... .......... .......... .......... .......... 21% 111M 1s 2024-06-04T16:14:28.767 INFO:teuthology.orchestra.run.smithi144.stderr: 19850K .......... .......... .......... .......... .......... 21% 113M 1s 2024-06-04T16:14:28.767 INFO:teuthology.orchestra.run.smithi144.stderr: 19900K .......... .......... .......... .......... .......... 21% 109M 1s 2024-06-04T16:14:28.767 INFO:teuthology.orchestra.run.smithi144.stderr: 19950K .......... .......... .......... .......... .......... 21% 116M 1s 2024-06-04T16:14:28.767 INFO:teuthology.orchestra.run.smithi144.stderr: 20000K .......... .......... .......... .......... .......... 21% 113M 1s 2024-06-04T16:14:28.767 INFO:teuthology.orchestra.run.smithi144.stderr: 20050K .......... .......... .......... .......... .......... 21% 117M 1s 2024-06-04T16:14:28.767 INFO:teuthology.orchestra.run.smithi144.stderr: 20100K .......... .......... .......... .......... .......... 21% 83.8M 1s 2024-06-04T16:14:28.767 INFO:teuthology.orchestra.run.smithi144.stderr: 20150K .......... .......... .......... .......... .......... 21% 120M 1s 2024-06-04T16:14:28.767 INFO:teuthology.orchestra.run.smithi144.stderr: 20200K .......... .......... .......... .......... .......... 21% 112M 1s 2024-06-04T16:14:28.767 INFO:teuthology.orchestra.run.smithi144.stderr: 20250K .......... .......... .......... .......... .......... 21% 113M 1s 2024-06-04T16:14:28.767 INFO:teuthology.orchestra.run.smithi144.stderr: 20300K .......... .......... .......... .......... .......... 21% 109M 1s 2024-06-04T16:14:28.768 INFO:teuthology.orchestra.run.smithi144.stderr: 20350K .......... .......... .......... .......... .......... 21% 120M 1s 2024-06-04T16:14:28.768 INFO:teuthology.orchestra.run.smithi144.stderr: 20400K .......... .......... .......... .......... .......... 22% 108M 1s 2024-06-04T16:14:28.768 INFO:teuthology.orchestra.run.smithi144.stderr: 20450K .......... .......... .......... .......... .......... 22% 74.6M 1s 2024-06-04T16:14:28.768 INFO:teuthology.orchestra.run.smithi144.stderr: 20500K .......... .......... .......... .......... .......... 22% 73.5M 1s 2024-06-04T16:14:28.768 INFO:teuthology.orchestra.run.smithi144.stderr: 20550K .......... .......... .......... .......... .......... 22% 111M 1s 2024-06-04T16:14:28.768 INFO:teuthology.orchestra.run.smithi144.stderr: 20600K .......... .......... .......... .......... .......... 22% 96.7M 1s 2024-06-04T16:14:28.768 INFO:teuthology.orchestra.run.smithi144.stderr: 20650K .......... .......... .......... .......... .......... 22% 150M 1s 2024-06-04T16:14:28.768 INFO:teuthology.orchestra.run.smithi144.stderr: 20700K .......... .......... .......... .......... .......... 22% 101M 1s 2024-06-04T16:14:28.768 INFO:teuthology.orchestra.run.smithi144.stderr: 20750K .......... .......... .......... .......... .......... 22% 114M 1s 2024-06-04T16:14:28.768 INFO:teuthology.orchestra.run.smithi144.stderr: 20800K .......... .......... .......... .......... .......... 22% 108M 1s 2024-06-04T16:14:28.768 INFO:teuthology.orchestra.run.smithi144.stderr: 20850K .......... .......... .......... .......... .......... 22% 114M 1s 2024-06-04T16:14:28.768 INFO:teuthology.orchestra.run.smithi144.stderr: 20900K .......... .......... .......... .......... .......... 22% 65.7M 1s 2024-06-04T16:14:28.768 INFO:teuthology.orchestra.run.smithi144.stderr: 20950K .......... .......... .......... .......... .......... 22% 74.8M 1s 2024-06-04T16:14:28.768 INFO:teuthology.orchestra.run.smithi144.stderr: 21000K .......... .......... .......... .......... .......... 22% 44.4M 1s 2024-06-04T16:14:28.768 INFO:teuthology.orchestra.run.smithi144.stderr: 21050K .......... .......... .......... .......... .......... 22% 40.3M 1s 2024-06-04T16:14:28.769 INFO:teuthology.orchestra.run.smithi144.stderr: 21100K .......... .......... .......... .......... .......... 22% 103M 1s 2024-06-04T16:14:28.769 INFO:teuthology.orchestra.run.smithi144.stderr: 21150K .......... .......... .......... .......... .......... 22% 71.0M 1s 2024-06-04T16:14:28.769 INFO:teuthology.orchestra.run.smithi144.stderr: 21200K .......... .......... .......... .......... .......... 22% 72.9M 1s 2024-06-04T16:14:28.769 INFO:teuthology.orchestra.run.smithi144.stderr: 21250K .......... .......... .......... .......... .......... 22% 63.8M 1s 2024-06-04T16:14:28.769 INFO:teuthology.orchestra.run.smithi144.stderr: 21300K .......... .......... .......... .......... .......... 22% 89.3M 1s 2024-06-04T16:14:28.769 INFO:teuthology.orchestra.run.smithi144.stderr: 21350K .......... .......... .......... .......... .......... 23% 92.1M 1s 2024-06-04T16:14:28.769 INFO:teuthology.orchestra.run.smithi144.stderr: 21400K .......... .......... .......... .......... .......... 23% 112M 1s 2024-06-04T16:14:28.769 INFO:teuthology.orchestra.run.smithi144.stderr: 21450K .......... .......... .......... .......... .......... 23% 90.4M 1s 2024-06-04T16:14:28.769 INFO:teuthology.orchestra.run.smithi144.stderr: 21500K .......... .......... .......... .......... .......... 23% 88.2M 1s 2024-06-04T16:14:28.769 INFO:teuthology.orchestra.run.smithi144.stderr: 21550K .......... .......... .......... .......... .......... 23% 117M 1s 2024-06-04T16:14:28.769 INFO:teuthology.orchestra.run.smithi144.stderr: 21600K .......... .......... .......... .......... .......... 23% 72.8M 1s 2024-06-04T16:14:28.769 INFO:teuthology.orchestra.run.smithi144.stderr: 21650K .......... .......... .......... .......... .......... 23% 111M 1s 2024-06-04T16:14:28.769 INFO:teuthology.orchestra.run.smithi144.stderr: 21700K .......... .......... .......... .......... .......... 23% 76.1M 1s 2024-06-04T16:14:28.769 INFO:teuthology.orchestra.run.smithi144.stderr: 21750K .......... .......... .......... .......... .......... 23% 93.9M 1s 2024-06-04T16:14:28.769 INFO:teuthology.orchestra.run.smithi144.stderr: 21800K .......... .......... .......... .......... .......... 23% 114M 1s 2024-06-04T16:14:28.769 INFO:teuthology.orchestra.run.smithi144.stderr: 21850K .......... .......... .......... .......... .......... 23% 114M 1s 2024-06-04T16:14:28.770 INFO:teuthology.orchestra.run.smithi144.stderr: 21900K .......... .......... .......... .......... .......... 23% 86.0M 1s 2024-06-04T16:14:28.770 INFO:teuthology.orchestra.run.smithi144.stderr: 21950K .......... .......... .......... .......... .......... 23% 97.4M 1s 2024-06-04T16:14:28.770 INFO:teuthology.orchestra.run.smithi144.stderr: 22000K .......... .......... .......... .......... .......... 23% 119M 1s 2024-06-04T16:14:28.770 INFO:teuthology.orchestra.run.smithi144.stderr: 22050K .......... .......... .......... .......... .......... 23% 91.1M 1s 2024-06-04T16:14:28.770 INFO:teuthology.orchestra.run.smithi144.stderr: 22100K .......... .......... .......... .......... .......... 23% 86.3M 1s 2024-06-04T16:14:28.770 INFO:teuthology.orchestra.run.smithi144.stderr: 22150K .......... .......... .......... .......... .......... 23% 103M 1s 2024-06-04T16:14:28.770 INFO:teuthology.orchestra.run.smithi144.stderr: 22200K .......... .......... .......... .......... .......... 23% 97.1M 1s 2024-06-04T16:14:28.770 INFO:teuthology.orchestra.run.smithi144.stderr: 22250K .......... .......... .......... .......... .......... 24% 116M 1s 2024-06-04T16:14:28.770 INFO:teuthology.orchestra.run.smithi144.stderr: 22300K .......... .......... .......... .......... .......... 24% 98.2M 1s 2024-06-04T16:14:28.770 INFO:teuthology.orchestra.run.smithi144.stderr: 22350K .......... .......... .......... .......... .......... 24% 79.1M 1s 2024-06-04T16:14:28.770 INFO:teuthology.orchestra.run.smithi144.stderr: 22400K .......... .......... .......... .......... .......... 24% 84.7M 1s 2024-06-04T16:14:28.770 INFO:teuthology.orchestra.run.smithi144.stderr: 22450K .......... .......... .......... .......... .......... 24% 77.1M 1s 2024-06-04T16:14:28.770 INFO:teuthology.orchestra.run.smithi144.stderr: 22500K .......... .......... .......... .......... .......... 24% 114M 1s 2024-06-04T16:14:28.771 INFO:teuthology.orchestra.run.smithi144.stderr: 22550K .......... .......... .......... .......... .......... 24% 101M 1s 2024-06-04T16:14:28.771 INFO:teuthology.orchestra.run.smithi144.stderr: 22600K .......... .......... .......... .......... .......... 24% 87.4M 1s 2024-06-04T16:14:28.771 INFO:teuthology.orchestra.run.smithi144.stderr: 22650K .......... .......... .......... .......... .......... 24% 108M 1s 2024-06-04T16:14:28.771 INFO:teuthology.orchestra.run.smithi144.stderr: 22700K .......... .......... .......... .......... .......... 24% 117M 1s 2024-06-04T16:14:28.771 INFO:teuthology.orchestra.run.smithi144.stderr: 22750K .......... .......... .......... .......... .......... 24% 117M 1s 2024-06-04T16:14:28.771 INFO:teuthology.orchestra.run.smithi144.stderr: 22800K .......... .......... .......... .......... .......... 24% 108M 1s 2024-06-04T16:14:28.771 INFO:teuthology.orchestra.run.smithi144.stderr: 22850K .......... .......... .......... .......... .......... 24% 88.4M 1s 2024-06-04T16:14:28.771 INFO:teuthology.orchestra.run.smithi144.stderr: 22900K .......... .......... .......... .......... .......... 24% 120M 1s 2024-06-04T16:14:28.771 INFO:teuthology.orchestra.run.smithi144.stderr: 22950K .......... .......... .......... .......... .......... 24% 111M 1s 2024-06-04T16:14:28.771 INFO:teuthology.orchestra.run.smithi144.stderr: 23000K .......... .......... .......... .......... .......... 24% 124M 1s 2024-06-04T16:14:28.771 INFO:teuthology.orchestra.run.smithi144.stderr: 23050K .......... .......... .......... .......... .......... 24% 108M 1s 2024-06-04T16:14:28.771 INFO:teuthology.orchestra.run.smithi144.stderr: 23100K .......... .......... .......... .......... .......... 24% 99.1M 1s 2024-06-04T16:14:28.771 INFO:teuthology.orchestra.run.smithi144.stderr: 23150K .......... .......... .......... .......... .......... 24% 110M 1s 2024-06-04T16:14:28.771 INFO:teuthology.orchestra.run.smithi144.stderr: 23200K .......... .......... .......... .......... .......... 25% 109M 1s 2024-06-04T16:14:28.772 INFO:teuthology.orchestra.run.smithi144.stderr: 23250K .......... .......... .......... .......... .......... 25% 89.4M 1s 2024-06-04T16:14:28.772 INFO:teuthology.orchestra.run.smithi144.stderr: 23300K .......... .......... .......... .......... .......... 25% 112M 1s 2024-06-04T16:14:28.772 INFO:teuthology.orchestra.run.smithi144.stderr: 23350K .......... .......... .......... .......... .......... 25% 111M 1s 2024-06-04T16:14:28.772 INFO:teuthology.orchestra.run.smithi144.stderr: 23400K .......... .......... .......... .......... .......... 25% 118M 1s 2024-06-04T16:14:28.772 INFO:teuthology.orchestra.run.smithi144.stderr: 23450K .......... .......... .......... .......... .......... 25% 116M 1s 2024-06-04T16:14:28.772 INFO:teuthology.orchestra.run.smithi144.stderr: 23500K .......... .......... .......... .......... .......... 25% 108M 1s 2024-06-04T16:14:28.772 INFO:teuthology.orchestra.run.smithi144.stderr: 23550K .......... .......... .......... .......... .......... 25% 122M 1s 2024-06-04T16:14:28.772 INFO:teuthology.orchestra.run.smithi144.stderr: 23600K .......... .......... .......... .......... .......... 25% 108M 1s 2024-06-04T16:14:28.772 INFO:teuthology.orchestra.run.smithi144.stderr: 23650K .......... .......... .......... .......... .......... 25% 89.7M 1s 2024-06-04T16:14:28.772 INFO:teuthology.orchestra.run.smithi144.stderr: 23700K .......... .......... .......... .......... .......... 25% 111M 1s 2024-06-04T16:14:28.772 INFO:teuthology.orchestra.run.smithi144.stderr: 23750K .......... .......... .......... .......... .......... 25% 119M 1s 2024-06-04T16:14:28.772 INFO:teuthology.orchestra.run.smithi144.stderr: 23800K .......... .......... .......... .......... .......... 25% 121M 1s 2024-06-04T16:14:28.772 INFO:teuthology.orchestra.run.smithi144.stderr: 23850K .......... .......... .......... .......... .......... 25% 112M 1s 2024-06-04T16:14:28.772 INFO:teuthology.orchestra.run.smithi144.stderr: 23900K .......... .......... .......... .......... .......... 25% 93.4M 1s 2024-06-04T16:14:28.773 INFO:teuthology.orchestra.run.smithi144.stderr: 23950K .......... .......... .......... .......... .......... 25% 109M 1s 2024-06-04T16:14:28.773 INFO:teuthology.orchestra.run.smithi144.stderr: 24000K .......... .......... .......... .......... .......... 25% 115M 1s 2024-06-04T16:14:28.773 INFO:teuthology.orchestra.run.smithi144.stderr: 24050K .......... .......... .......... .......... .......... 25% 109M 1s 2024-06-04T16:14:28.773 INFO:teuthology.orchestra.run.smithi144.stderr: 24100K .......... .......... .......... .......... .......... 25% 114M 1s 2024-06-04T16:14:28.773 INFO:teuthology.orchestra.run.smithi144.stderr: 24150K .......... .......... .......... .......... .......... 26% 105M 1s 2024-06-04T16:14:28.773 INFO:teuthology.orchestra.run.smithi144.stderr: 24200K .......... .......... .......... .......... .......... 26% 112M 1s 2024-06-04T16:14:28.773 INFO:teuthology.orchestra.run.smithi144.stderr: 24250K .......... .......... .......... .......... .......... 26% 107M 1s 2024-06-04T16:14:28.773 INFO:teuthology.orchestra.run.smithi144.stderr: 24300K .......... .......... .......... .......... .......... 26% 63.1M 1s 2024-06-04T16:14:28.773 INFO:teuthology.orchestra.run.smithi144.stderr: 24350K .......... .......... .......... .......... .......... 26% 114M 1s 2024-06-04T16:14:28.773 INFO:teuthology.orchestra.run.smithi144.stderr: 24400K .......... .......... .......... .......... .......... 26% 113M 1s 2024-06-04T16:14:28.773 INFO:teuthology.orchestra.run.smithi144.stderr: 24450K .......... .......... .......... .......... .......... 26% 117M 1s 2024-06-04T16:14:28.773 INFO:teuthology.orchestra.run.smithi144.stderr: 24500K .......... .......... .......... .......... .......... 26% 95.8M 1s 2024-06-04T16:14:28.773 INFO:teuthology.orchestra.run.smithi144.stderr: 24550K .......... .......... .......... .......... .......... 26% 114M 1s 2024-06-04T16:14:28.773 INFO:teuthology.orchestra.run.smithi144.stderr: 24600K .......... .......... .......... .......... .......... 26% 126M 1s 2024-06-04T16:14:28.774 INFO:teuthology.orchestra.run.smithi144.stderr: 24650K .......... .......... .......... .......... .......... 26% 111M 1s 2024-06-04T16:14:28.774 INFO:teuthology.orchestra.run.smithi144.stderr: 24700K .......... .......... .......... .......... .......... 26% 86.8M 1s 2024-06-04T16:14:28.774 INFO:teuthology.orchestra.run.smithi144.stderr: 24750K .......... .......... .......... .......... .......... 26% 116M 1s 2024-06-04T16:14:28.774 INFO:teuthology.orchestra.run.smithi144.stderr: 24800K .......... .......... .......... .......... .......... 26% 112M 1s 2024-06-04T16:14:28.774 INFO:teuthology.orchestra.run.smithi144.stderr: 24850K .......... .......... .......... .......... .......... 26% 116M 1s 2024-06-04T16:14:28.774 INFO:teuthology.orchestra.run.smithi144.stderr: 24900K .......... .......... .......... .......... .......... 26% 111M 1s 2024-06-04T16:14:28.774 INFO:teuthology.orchestra.run.smithi144.stderr: 24950K .......... .......... .......... .......... .......... 26% 115M 1s 2024-06-04T16:14:28.774 INFO:teuthology.orchestra.run.smithi144.stderr: 25000K .......... .......... .......... .......... .......... 26% 117M 1s 2024-06-04T16:14:28.774 INFO:teuthology.orchestra.run.smithi144.stderr: 25050K .......... .......... .......... .......... .......... 27% 109M 1s 2024-06-04T16:14:28.774 INFO:teuthology.orchestra.run.smithi144.stderr: 25100K .......... .......... .......... .......... .......... 27% 91.2M 1s 2024-06-04T16:14:28.774 INFO:teuthology.orchestra.run.smithi144.stderr: 25150K .......... .......... .......... .......... .......... 27% 111M 1s 2024-06-04T16:14:28.774 INFO:teuthology.orchestra.run.smithi144.stderr: 25200K .......... .......... .......... .......... .......... 27% 110M 1s 2024-06-04T16:14:28.774 INFO:teuthology.orchestra.run.smithi144.stderr: 25250K .......... .......... .......... .......... .......... 27% 114M 1s 2024-06-04T16:14:28.774 INFO:teuthology.orchestra.run.smithi144.stderr: 25300K .......... .......... .......... .......... .......... 27% 109M 1s 2024-06-04T16:14:28.775 INFO:teuthology.orchestra.run.smithi144.stderr: 25350K .......... .......... .......... .......... .......... 27% 115M 1s 2024-06-04T16:14:28.775 INFO:teuthology.orchestra.run.smithi144.stderr: 25400K .......... .......... .......... .......... .......... 27% 75.6M 1s 2024-06-04T16:14:28.775 INFO:teuthology.orchestra.run.smithi144.stderr: 25450K .......... .......... .......... .......... .......... 27% 81.6M 1s 2024-06-04T16:14:28.775 INFO:teuthology.orchestra.run.smithi144.stderr: 25500K .......... .......... .......... .......... .......... 27% 89.8M 1s 2024-06-04T16:14:28.775 INFO:teuthology.orchestra.run.smithi144.stderr: 25550K .......... .......... .......... .......... .......... 27% 118M 1s 2024-06-04T16:14:28.775 INFO:teuthology.orchestra.run.smithi144.stderr: 25600K .......... .......... .......... .......... .......... 27% 110M 1s 2024-06-04T16:14:28.775 INFO:teuthology.orchestra.run.smithi144.stderr: 25650K .......... .......... .......... .......... .......... 27% 105M 1s 2024-06-04T16:14:28.775 INFO:teuthology.orchestra.run.smithi144.stderr: 25700K .......... .......... .......... .......... .......... 27% 121M 1s 2024-06-04T16:14:28.775 INFO:teuthology.orchestra.run.smithi144.stderr: 25750K .......... .......... .......... .......... .......... 27% 105M 1s 2024-06-04T16:14:28.775 INFO:teuthology.orchestra.run.smithi144.stderr: 25800K .......... .......... .......... .......... .......... 27% 120M 1s 2024-06-04T16:14:28.775 INFO:teuthology.orchestra.run.smithi144.stderr: 25850K .......... .......... .......... .......... .......... 27% 59.3M 1s 2024-06-04T16:14:28.775 INFO:teuthology.orchestra.run.smithi144.stderr: 25900K .......... .......... .......... .......... .......... 27% 109M 1s 2024-06-04T16:14:28.775 INFO:teuthology.orchestra.run.smithi144.stderr: 25950K .......... .......... .......... .......... .......... 27% 88.9M 1s 2024-06-04T16:14:28.775 INFO:teuthology.orchestra.run.smithi144.stderr: 26000K .......... .......... .......... .......... .......... 28% 122M 1s 2024-06-04T16:14:28.775 INFO:teuthology.orchestra.run.smithi144.stderr: 26050K .......... .......... .......... .......... .......... 28% 115M 1s 2024-06-04T16:14:28.775 INFO:teuthology.orchestra.run.smithi144.stderr: 26100K .......... .......... .......... .......... .......... 28% 113M 1s 2024-06-04T16:14:28.776 INFO:teuthology.orchestra.run.smithi144.stderr: 26150K .......... .......... .......... .......... .......... 28% 107M 1s 2024-06-04T16:14:28.776 INFO:teuthology.orchestra.run.smithi144.stderr: 26200K .......... .......... .......... .......... .......... 28% 117M 1s 2024-06-04T16:14:28.776 INFO:teuthology.orchestra.run.smithi144.stderr: 26250K .......... .......... .......... .......... .......... 28% 118M 1s 2024-06-04T16:14:28.776 INFO:teuthology.orchestra.run.smithi144.stderr: 26300K .......... .......... .......... .......... .......... 28% 105M 1s 2024-06-04T16:14:28.776 INFO:teuthology.orchestra.run.smithi144.stderr: 26350K .......... .......... .......... .......... .......... 28% 81.1M 1s 2024-06-04T16:14:28.776 INFO:teuthology.orchestra.run.smithi144.stderr: 26400K .......... .......... .......... .......... .......... 28% 76.0M 1s 2024-06-04T16:14:28.776 INFO:teuthology.orchestra.run.smithi144.stderr: 26450K .......... .......... .......... .......... .......... 28% 116M 1s 2024-06-04T16:14:28.776 INFO:teuthology.orchestra.run.smithi144.stderr: 26500K .......... .......... .......... .......... .......... 28% 92.2M 1s 2024-06-04T16:14:28.776 INFO:teuthology.orchestra.run.smithi144.stderr: 26550K .......... .......... .......... .......... .......... 28% 86.6M 1s 2024-06-04T16:14:28.776 INFO:teuthology.orchestra.run.smithi144.stderr: 26600K .......... .......... .......... .......... .......... 28% 86.3M 1s 2024-06-04T16:14:28.776 INFO:teuthology.orchestra.run.smithi144.stderr: 26650K .......... .......... .......... .......... .......... 28% 101M 1s 2024-06-04T16:14:28.776 INFO:teuthology.orchestra.run.smithi144.stderr: 26700K .......... .......... .......... .......... .......... 28% 75.1M 1s 2024-06-04T16:14:28.776 INFO:teuthology.orchestra.run.smithi144.stderr: 26750K .......... .......... .......... .......... .......... 28% 77.3M 1s 2024-06-04T16:14:28.776 INFO:teuthology.orchestra.run.smithi144.stderr: 26800K .......... .......... .......... .......... .......... 28% 85.7M 1s 2024-06-04T16:14:28.776 INFO:teuthology.orchestra.run.smithi144.stderr: 26850K .......... .......... .......... .......... .......... 28% 85.2M 1s 2024-06-04T16:14:28.777 INFO:teuthology.orchestra.run.smithi144.stderr: 26900K .......... .......... .......... .......... .......... 29% 90.3M 1s 2024-06-04T16:14:28.777 INFO:teuthology.orchestra.run.smithi144.stderr: 26950K .......... .......... .......... .......... .......... 29% 98.2M 1s 2024-06-04T16:14:28.777 INFO:teuthology.orchestra.run.smithi144.stderr: 27000K .......... .......... .......... .......... .......... 29% 88.0M 1s 2024-06-04T16:14:28.777 INFO:teuthology.orchestra.run.smithi144.stderr: 27050K .......... .......... .......... .......... .......... 29% 85.9M 1s 2024-06-04T16:14:28.777 INFO:teuthology.orchestra.run.smithi144.stderr: 27100K .......... .......... .......... .......... .......... 29% 92.0M 1s 2024-06-04T16:14:28.777 INFO:teuthology.orchestra.run.smithi144.stderr: 27150K .......... .......... .......... .......... .......... 29% 72.2M 1s 2024-06-04T16:14:28.777 INFO:teuthology.orchestra.run.smithi144.stderr: 27200K .......... .......... .......... .......... .......... 29% 112M 1s 2024-06-04T16:14:28.777 INFO:teuthology.orchestra.run.smithi144.stderr: 27250K .......... .......... .......... .......... .......... 29% 97.6M 1s 2024-06-04T16:14:28.777 INFO:teuthology.orchestra.run.smithi144.stderr: 27300K .......... .......... .......... .......... .......... 29% 77.7M 1s 2024-06-04T16:14:28.777 INFO:teuthology.orchestra.run.smithi144.stderr: 27350K .......... .......... .......... .......... .......... 29% 79.8M 1s 2024-06-04T16:14:28.777 INFO:teuthology.orchestra.run.smithi144.stderr: 27400K .......... .......... .......... .......... .......... 29% 125M 1s 2024-06-04T16:14:28.777 INFO:teuthology.orchestra.run.smithi144.stderr: 27450K .......... .......... .......... .......... .......... 29% 89.3M 1s 2024-06-04T16:14:28.777 INFO:teuthology.orchestra.run.smithi144.stderr: 27500K .......... .......... .......... .......... .......... 29% 92.5M 1s 2024-06-04T16:14:28.777 INFO:teuthology.orchestra.run.smithi144.stderr: 27550K .......... .......... .......... .......... .......... 29% 60.0M 1s 2024-06-04T16:14:28.778 INFO:teuthology.orchestra.run.smithi144.stderr: 27600K .......... .......... .......... .......... .......... 29% 97.5M 1s 2024-06-04T16:14:28.778 INFO:teuthology.orchestra.run.smithi144.stderr: 27650K .......... .......... .......... .......... .......... 29% 119M 1s 2024-06-04T16:14:28.778 INFO:teuthology.orchestra.run.smithi144.stderr: 27700K .......... .......... .......... .......... .......... 29% 75.1M 1s 2024-06-04T16:14:28.778 INFO:teuthology.orchestra.run.smithi144.stderr: 27750K .......... .......... .......... .......... .......... 29% 91.8M 1s 2024-06-04T16:14:28.778 INFO:teuthology.orchestra.run.smithi144.stderr: 27800K .......... .......... .......... .......... .......... 29% 89.0M 1s 2024-06-04T16:14:28.778 INFO:teuthology.orchestra.run.smithi144.stderr: 27850K .......... .......... .......... .......... .......... 30% 116M 1s 2024-06-04T16:14:28.778 INFO:teuthology.orchestra.run.smithi144.stderr: 27900K .......... .......... .......... .......... .......... 30% 91.9M 1s 2024-06-04T16:14:28.778 INFO:teuthology.orchestra.run.smithi144.stderr: 27950K .......... .......... .......... .......... .......... 30% 57.2M 1s 2024-06-04T16:14:28.778 INFO:teuthology.orchestra.run.smithi144.stderr: 28000K .......... .......... .......... .......... .......... 30% 71.8M 1s 2024-06-04T16:14:28.778 INFO:teuthology.orchestra.run.smithi144.stderr: 28050K .......... .......... .......... .......... .......... 30% 114M 1s 2024-06-04T16:14:28.778 INFO:teuthology.orchestra.run.smithi144.stderr: 28100K .......... .......... .......... .......... .......... 30% 120M 1s 2024-06-04T16:14:28.778 INFO:teuthology.orchestra.run.smithi144.stderr: 28150K .......... .......... .......... .......... .......... 30% 86.3M 1s 2024-06-04T16:14:28.778 INFO:teuthology.orchestra.run.smithi144.stderr: 28200K .......... .......... .......... .......... .......... 30% 84.4M 1s 2024-06-04T16:14:28.779 INFO:teuthology.orchestra.run.smithi144.stderr: 28250K .......... .......... .......... .......... .......... 30% 80.1M 1s 2024-06-04T16:14:28.779 INFO:teuthology.orchestra.run.smithi144.stderr: 28300K .......... .......... .......... .......... .......... 30% 120M 1s 2024-06-04T16:14:28.779 INFO:teuthology.orchestra.run.smithi144.stderr: 28350K .......... .......... .......... .......... .......... 30% 77.3M 1s 2024-06-04T16:14:28.779 INFO:teuthology.orchestra.run.smithi144.stderr: 28400K .......... .......... .......... .......... .......... 30% 142M 1s 2024-06-04T16:14:28.779 INFO:teuthology.orchestra.run.smithi144.stderr: 28450K .......... .......... .......... .......... .......... 30% 113M 1s 2024-06-04T16:14:28.779 INFO:teuthology.orchestra.run.smithi144.stderr: 28500K .......... .......... .......... .......... .......... 30% 116M 1s 2024-06-04T16:14:28.779 INFO:teuthology.orchestra.run.smithi144.stderr: 28550K .......... .......... .......... .......... .......... 30% 112M 1s 2024-06-04T16:14:28.779 INFO:teuthology.orchestra.run.smithi144.stderr: 28600K .......... .......... .......... .......... .......... 30% 113M 1s 2024-06-04T16:14:28.779 INFO:teuthology.orchestra.run.smithi144.stderr: 28650K .......... .......... .......... .......... .......... 30% 117M 1s 2024-06-04T16:14:28.779 INFO:teuthology.orchestra.run.smithi144.stderr: 28700K .......... .......... .......... .......... .......... 30% 108M 1s 2024-06-04T16:14:28.779 INFO:teuthology.orchestra.run.smithi144.stderr: 28750K .......... .......... .......... .......... .......... 31% 80.8M 1s 2024-06-04T16:14:28.779 INFO:teuthology.orchestra.run.smithi144.stderr: 28800K .......... .......... .......... .......... .......... 31% 138M 1s 2024-06-04T16:14:28.779 INFO:teuthology.orchestra.run.smithi144.stderr: 28850K .......... .......... .......... .......... .......... 31% 86.8M 1s 2024-06-04T16:14:28.779 INFO:teuthology.orchestra.run.smithi144.stderr: 28900K .......... .......... .......... .......... .......... 31% 87.0M 1s 2024-06-04T16:14:28.779 INFO:teuthology.orchestra.run.smithi144.stderr: 28950K .......... .......... .......... .......... .......... 31% 105M 1s 2024-06-04T16:14:28.779 INFO:teuthology.orchestra.run.smithi144.stderr: 29000K .......... .......... .......... .......... .......... 31% 105M 1s 2024-06-04T16:14:28.780 INFO:teuthology.orchestra.run.smithi144.stderr: 29050K .......... .......... .......... .......... .......... 31% 117M 1s 2024-06-04T16:14:28.780 INFO:teuthology.orchestra.run.smithi144.stderr: 29100K .......... .......... .......... .......... .......... 31% 108M 1s 2024-06-04T16:14:28.780 INFO:teuthology.orchestra.run.smithi144.stderr: 29150K .......... .......... .......... .......... .......... 31% 103M 1s 2024-06-04T16:14:28.780 INFO:teuthology.orchestra.run.smithi144.stderr: 29200K .......... .......... .......... .......... .......... 31% 112M 1s 2024-06-04T16:14:28.780 INFO:teuthology.orchestra.run.smithi144.stderr: 29250K .......... .......... .......... .......... .......... 31% 122M 1s 2024-06-04T16:14:28.780 INFO:teuthology.orchestra.run.smithi144.stderr: 29300K .......... .......... .......... .......... .......... 31% 107M 1s 2024-06-04T16:14:28.780 INFO:teuthology.orchestra.run.smithi144.stderr: 29350K .......... .......... .......... .......... .......... 31% 117M 1s 2024-06-04T16:14:28.780 INFO:teuthology.orchestra.run.smithi144.stderr: 29400K .......... .......... .......... .......... .......... 31% 104M 1s 2024-06-04T16:14:28.780 INFO:teuthology.orchestra.run.smithi144.stderr: 29450K .......... .......... .......... .......... .......... 31% 86.4M 1s 2024-06-04T16:14:28.780 INFO:teuthology.orchestra.run.smithi144.stderr: 29500K .......... .......... .......... .......... .......... 31% 108M 1s 2024-06-04T16:14:28.780 INFO:teuthology.orchestra.run.smithi144.stderr: 29550K .......... .......... .......... .......... .......... 31% 129M 1s 2024-06-04T16:14:28.780 INFO:teuthology.orchestra.run.smithi144.stderr: 29600K .......... .......... .......... .......... .......... 31% 110M 1s 2024-06-04T16:14:28.780 INFO:teuthology.orchestra.run.smithi144.stderr: 29650K .......... .......... .......... .......... .......... 31% 112M 1s 2024-06-04T16:14:28.780 INFO:teuthology.orchestra.run.smithi144.stderr: 29700K .......... .......... .......... .......... .......... 32% 117M 1s 2024-06-04T16:14:28.780 INFO:teuthology.orchestra.run.smithi144.stderr: 29750K .......... .......... .......... .......... .......... 32% 117M 1s 2024-06-04T16:14:28.781 INFO:teuthology.orchestra.run.smithi144.stderr: 29800K .......... .......... .......... .......... .......... 32% 112M 1s 2024-06-04T16:14:28.781 INFO:teuthology.orchestra.run.smithi144.stderr: 29850K .......... .......... .......... .......... .......... 32% 65.9M 1s 2024-06-04T16:14:28.781 INFO:teuthology.orchestra.run.smithi144.stderr: 29900K .......... .......... .......... .......... .......... 32% 112M 1s 2024-06-04T16:14:28.781 INFO:teuthology.orchestra.run.smithi144.stderr: 29950K .......... .......... .......... .......... .......... 32% 113M 1s 2024-06-04T16:14:28.781 INFO:teuthology.orchestra.run.smithi144.stderr: 30000K .......... .......... .......... .......... .......... 32% 111M 1s 2024-06-04T16:14:28.781 INFO:teuthology.orchestra.run.smithi144.stderr: 30050K .......... .......... .......... .......... .......... 32% 116M 1s 2024-06-04T16:14:28.781 INFO:teuthology.orchestra.run.smithi144.stderr: 30100K .......... .......... .......... .......... .......... 32% 106M 1s 2024-06-04T16:14:28.781 INFO:teuthology.orchestra.run.smithi144.stderr: 30150K .......... .......... .......... .......... .......... 32% 127M 1s 2024-06-04T16:14:28.781 INFO:teuthology.orchestra.run.smithi144.stderr: 30200K .......... .......... .......... .......... .......... 32% 104M 1s 2024-06-04T16:14:28.781 INFO:teuthology.orchestra.run.smithi144.stderr: 30250K .......... .......... .......... .......... .......... 32% 85.7M 1s 2024-06-04T16:14:28.781 INFO:teuthology.orchestra.run.smithi144.stderr: 30300K .......... .......... .......... .......... .......... 32% 126M 1s 2024-06-04T16:14:28.781 INFO:teuthology.orchestra.run.smithi144.stderr: 30350K .......... .......... .......... .......... .......... 32% 114M 1s 2024-06-04T16:14:28.781 INFO:teuthology.orchestra.run.smithi144.stderr: 30400K .......... .......... .......... .......... .......... 32% 101M 1s 2024-06-04T16:14:28.781 INFO:teuthology.orchestra.run.smithi144.stderr: 30450K .......... .......... .......... .......... .......... 32% 125M 1s 2024-06-04T16:14:28.782 INFO:teuthology.orchestra.run.smithi144.stderr: 30500K .......... .......... .......... .......... .......... 32% 119M 1s 2024-06-04T16:14:28.782 INFO:teuthology.orchestra.run.smithi144.stderr: 30550K .......... .......... .......... .......... .......... 32% 11.7M 1s 2024-06-04T16:14:28.782 INFO:teuthology.orchestra.run.smithi144.stderr: 30600K .......... .......... .......... .......... .......... 32% 144M 1s 2024-06-04T16:14:28.782 INFO:teuthology.orchestra.run.smithi144.stderr: 30650K .......... .......... .......... .......... .......... 33% 268M 1s 2024-06-04T16:14:28.782 INFO:teuthology.orchestra.run.smithi144.stderr: 30700K .......... .......... .......... .......... .......... 33% 268M 1s 2024-06-04T16:14:28.782 INFO:teuthology.orchestra.run.smithi144.stderr: 30750K .......... .......... .......... .......... .......... 33% 183M 1s 2024-06-04T16:14:28.782 INFO:teuthology.orchestra.run.smithi144.stderr: 30800K .......... .......... .......... .......... .......... 33% 147M 1s 2024-06-04T16:14:28.782 INFO:teuthology.orchestra.run.smithi144.stderr: 30850K .......... .......... .......... .......... .......... 33% 244M 1s 2024-06-04T16:14:28.782 INFO:teuthology.orchestra.run.smithi144.stderr: 30900K .......... .......... .......... .......... .......... 33% 219M 1s 2024-06-04T16:14:28.782 INFO:teuthology.orchestra.run.smithi144.stderr: 30950K .......... .......... .......... .......... .......... 33% 221M 1s 2024-06-04T16:14:28.782 INFO:teuthology.orchestra.run.smithi144.stderr: 31000K .......... .......... .......... .......... .......... 33% 138M 1s 2024-06-04T16:14:28.782 INFO:teuthology.orchestra.run.smithi144.stderr: 31050K .......... .......... .......... .......... .......... 33% 142M 1s 2024-06-04T16:14:28.782 INFO:teuthology.orchestra.run.smithi144.stderr: 31100K .......... .......... .......... .......... .......... 33% 133M 1s 2024-06-04T16:14:28.783 INFO:teuthology.orchestra.run.smithi144.stderr: 31150K .......... .......... .......... .......... .......... 33% 192M 1s 2024-06-04T16:14:28.783 INFO:teuthology.orchestra.run.smithi144.stderr: 31200K .......... .......... .......... .......... .......... 33% 132M 1s 2024-06-04T16:14:28.783 INFO:teuthology.orchestra.run.smithi144.stderr: 31250K .......... .......... .......... .......... .......... 33% 124M 1s 2024-06-04T16:14:28.783 INFO:teuthology.orchestra.run.smithi144.stderr: 31300K .......... .......... .......... .......... .......... 33% 136M 1s 2024-06-04T16:14:28.783 INFO:teuthology.orchestra.run.smithi144.stderr: 31350K .......... .......... .......... .......... .......... 33% 240M 1s 2024-06-04T16:14:28.783 INFO:teuthology.orchestra.run.smithi144.stderr: 31400K .......... .......... .......... .......... .......... 33% 113M 1s 2024-06-04T16:14:28.783 INFO:teuthology.orchestra.run.smithi144.stderr: 31450K .......... .......... .......... .......... .......... 33% 227M 1s 2024-06-04T16:14:28.783 INFO:teuthology.orchestra.run.smithi144.stderr: 31500K .......... .......... .......... .......... .......... 33% 229M 1s 2024-06-04T16:14:28.783 INFO:teuthology.orchestra.run.smithi144.stderr: 31550K .......... .......... .......... .......... .......... 34% 119M 1s 2024-06-04T16:14:28.783 INFO:teuthology.orchestra.run.smithi144.stderr: 31600K .......... .......... .......... .......... .......... 34% 115M 1s 2024-06-04T16:14:28.783 INFO:teuthology.orchestra.run.smithi144.stderr: 31650K .......... .......... .......... .......... .......... 34% 88.3M 1s 2024-06-04T16:14:28.783 INFO:teuthology.orchestra.run.smithi144.stderr: 31700K .......... .......... .......... .......... .......... 34% 160M 1s 2024-06-04T16:14:28.783 INFO:teuthology.orchestra.run.smithi144.stderr: 31750K .......... .......... .......... .......... .......... 34% 101M 1s 2024-06-04T16:14:28.783 INFO:teuthology.orchestra.run.smithi144.stderr: 31800K .......... .......... .......... .......... .......... 34% 89.8M 1s 2024-06-04T16:14:28.783 INFO:teuthology.orchestra.run.smithi144.stderr: 31850K .......... .......... .......... .......... .......... 34% 118M 1s 2024-06-04T16:14:28.784 INFO:teuthology.orchestra.run.smithi144.stderr: 31900K .......... .......... .......... .......... .......... 34% 127M 1s 2024-06-04T16:14:28.784 INFO:teuthology.orchestra.run.smithi144.stderr: 31950K .......... .......... .......... .......... .......... 34% 110M 1s 2024-06-04T16:14:28.784 INFO:teuthology.orchestra.run.smithi144.stderr: 32000K .......... .......... .......... .......... .......... 34% 93.8M 1s 2024-06-04T16:14:28.784 INFO:teuthology.orchestra.run.smithi144.stderr: 32050K .......... .......... .......... .......... .......... 34% 112M 1s 2024-06-04T16:14:28.784 INFO:teuthology.orchestra.run.smithi144.stderr: 32100K .......... .......... .......... .......... .......... 34% 101M 1s 2024-06-04T16:14:28.784 INFO:teuthology.orchestra.run.smithi144.stderr: 32150K .......... .......... .......... .......... .......... 34% 91.6M 1s 2024-06-04T16:14:28.784 INFO:teuthology.orchestra.run.smithi144.stderr: 32200K .......... .......... .......... .......... .......... 34% 113M 1s 2024-06-04T16:14:28.784 INFO:teuthology.orchestra.run.smithi144.stderr: 32250K .......... .......... .......... .......... .......... 34% 119M 1s 2024-06-04T16:14:28.784 INFO:teuthology.orchestra.run.smithi144.stderr: 32300K .......... .......... .......... .......... .......... 34% 116M 1s 2024-06-04T16:14:28.784 INFO:teuthology.orchestra.run.smithi144.stderr: 32350K .......... .......... .......... .......... .......... 34% 106M 1s 2024-06-04T16:14:28.784 INFO:teuthology.orchestra.run.smithi144.stderr: 32400K .......... .......... .......... .......... .......... 34% 121M 1s 2024-06-04T16:14:28.784 INFO:teuthology.orchestra.run.smithi144.stderr: 32450K .......... .......... .......... .......... .......... 34% 44.1M 1s 2024-06-04T16:14:28.784 INFO:teuthology.orchestra.run.smithi144.stderr: 32500K .......... .......... .......... .......... .......... 35% 203M 1s 2024-06-04T16:14:28.785 INFO:teuthology.orchestra.run.smithi144.stderr: 32550K .......... .......... .......... .......... .......... 35% 168M 1s 2024-06-04T16:14:28.785 INFO:teuthology.orchestra.run.smithi144.stderr: 32600K .......... .......... .......... .......... .......... 35% 230M 1s 2024-06-04T16:14:28.785 INFO:teuthology.orchestra.run.smithi144.stderr: 32650K .......... .......... .......... .......... .......... 35% 111M 1s 2024-06-04T16:14:28.785 INFO:teuthology.orchestra.run.smithi144.stderr: 32700K .......... .......... .......... .......... .......... 35% 92.4M 1s 2024-06-04T16:14:28.785 INFO:teuthology.orchestra.run.smithi144.stderr: 32750K .......... .......... .......... .......... .......... 35% 153M 1s 2024-06-04T16:14:28.785 INFO:teuthology.orchestra.run.smithi144.stderr: 32800K .......... .......... .......... .......... .......... 35% 116M 1s 2024-06-04T16:14:28.785 INFO:teuthology.orchestra.run.smithi144.stderr: 32850K .......... .......... .......... .......... .......... 35% 117M 1s 2024-06-04T16:14:28.785 INFO:teuthology.orchestra.run.smithi144.stderr: 32900K .......... .......... .......... .......... .......... 35% 110M 1s 2024-06-04T16:14:28.785 INFO:teuthology.orchestra.run.smithi144.stderr: 32950K .......... .......... .......... .......... .......... 35% 84.0M 1s 2024-06-04T16:14:28.785 INFO:teuthology.orchestra.run.smithi144.stderr: 33000K .......... .......... .......... .......... .......... 35% 124M 1s 2024-06-04T16:14:28.785 INFO:teuthology.orchestra.run.smithi144.stderr: 33050K .......... .......... .......... .......... .......... 35% 114M 1s 2024-06-04T16:14:28.785 INFO:teuthology.orchestra.run.smithi144.stderr: 33100K .......... .......... .......... .......... .......... 35% 77.1M 1s 2024-06-04T16:14:28.785 INFO:teuthology.orchestra.run.smithi144.stderr: 33150K .......... .......... .......... .......... .......... 35% 179M 1s 2024-06-04T16:14:28.785 INFO:teuthology.orchestra.run.smithi144.stderr: 33200K .......... .......... .......... .......... .......... 35% 117M 1s 2024-06-04T16:14:28.786 INFO:teuthology.orchestra.run.smithi144.stderr: 33250K .......... .......... .......... .......... .......... 35% 117M 1s 2024-06-04T16:14:28.786 INFO:teuthology.orchestra.run.smithi144.stderr: 33300K .......... .......... .......... .......... .......... 35% 113M 1s 2024-06-04T16:14:28.786 INFO:teuthology.orchestra.run.smithi144.stderr: 33350K .......... .......... .......... .......... .......... 35% 89.9M 1s 2024-06-04T16:14:28.786 INFO:teuthology.orchestra.run.smithi144.stderr: 33400K .......... .......... .......... .......... .......... 36% 119M 1s 2024-06-04T16:14:28.786 INFO:teuthology.orchestra.run.smithi144.stderr: 33450K .......... .......... .......... .......... .......... 36% 103M 1s 2024-06-04T16:14:28.786 INFO:teuthology.orchestra.run.smithi144.stderr: 33500K .......... .......... .......... .......... .......... 36% 94.3M 1s 2024-06-04T16:14:28.786 INFO:teuthology.orchestra.run.smithi144.stderr: 33550K .......... .......... .......... .......... .......... 36% 122M 1s 2024-06-04T16:14:28.786 INFO:teuthology.orchestra.run.smithi144.stderr: 33600K .......... .......... .......... .......... .......... 36% 126M 1s 2024-06-04T16:14:28.786 INFO:teuthology.orchestra.run.smithi144.stderr: 33650K .......... .......... .......... .......... .......... 36% 121M 1s 2024-06-04T16:14:28.786 INFO:teuthology.orchestra.run.smithi144.stderr: 33700K .......... .......... .......... .......... .......... 36% 113M 1s 2024-06-04T16:14:28.786 INFO:teuthology.orchestra.run.smithi144.stderr: 33750K .......... .......... .......... .......... .......... 36% 82.6M 1s 2024-06-04T16:14:28.786 INFO:teuthology.orchestra.run.smithi144.stderr: 33800K .......... .......... .......... .......... .......... 36% 115M 1s 2024-06-04T16:14:28.787 INFO:teuthology.orchestra.run.smithi144.stderr: 33850K .......... .......... .......... .......... .......... 36% 113M 1s 2024-06-04T16:14:28.787 INFO:teuthology.orchestra.run.smithi144.stderr: 33900K .......... .......... .......... .......... .......... 36% 117M 1s 2024-06-04T16:14:28.787 INFO:teuthology.orchestra.run.smithi144.stderr: 33950K .......... .......... .......... .......... .......... 36% 110M 1s 2024-06-04T16:14:28.787 INFO:teuthology.orchestra.run.smithi144.stderr: 34000K .......... .......... .......... .......... .......... 36% 115M 1s 2024-06-04T16:14:28.787 INFO:teuthology.orchestra.run.smithi144.stderr: 34050K .......... .......... .......... .......... .......... 36% 113M 1s 2024-06-04T16:14:28.787 INFO:teuthology.orchestra.run.smithi144.stderr: 34100K .......... .......... .......... .......... .......... 36% 118M 1s 2024-06-04T16:14:28.787 INFO:teuthology.orchestra.run.smithi144.stderr: 34150K .......... .......... .......... .......... .......... 36% 84.2M 1s 2024-06-04T16:14:28.787 INFO:teuthology.orchestra.run.smithi144.stderr: 34200K .......... .......... .......... .......... .......... 36% 128M 1s 2024-06-04T16:14:28.787 INFO:teuthology.orchestra.run.smithi144.stderr: 34250K .......... .......... .......... .......... .......... 36% 84.3M 1s 2024-06-04T16:14:28.787 INFO:teuthology.orchestra.run.smithi144.stderr: 34300K .......... .......... .......... .......... .......... 36% 127M 1s 2024-06-04T16:14:28.787 INFO:teuthology.orchestra.run.smithi144.stderr: 34350K .......... .......... .......... .......... .......... 37% 17.6M 1s 2024-06-04T16:14:28.787 INFO:teuthology.orchestra.run.smithi144.stderr: 34400K .......... .......... .......... .......... .......... 37% 72.6M 1s 2024-06-04T16:14:28.787 INFO:teuthology.orchestra.run.smithi144.stderr: 34450K .......... .......... .......... .......... .......... 37% 63.9M 1s 2024-06-04T16:14:28.788 INFO:teuthology.orchestra.run.smithi144.stderr: 34500K .......... .......... .......... .......... .......... 37% 74.6M 1s 2024-06-04T16:14:28.788 INFO:teuthology.orchestra.run.smithi144.stderr: 34550K .......... .......... .......... .......... .......... 37% 74.0M 1s 2024-06-04T16:14:28.788 INFO:teuthology.orchestra.run.smithi144.stderr: 34600K .......... .......... .......... .......... .......... 37% 57.1M 1s 2024-06-04T16:14:28.788 INFO:teuthology.orchestra.run.smithi144.stderr: 34650K .......... .......... .......... .......... .......... 37% 116M 1s 2024-06-04T16:14:28.788 INFO:teuthology.orchestra.run.smithi144.stderr: 34700K .......... .......... .......... .......... .......... 37% 89.2M 1s 2024-06-04T16:14:28.788 INFO:teuthology.orchestra.run.smithi144.stderr: 34750K .......... .......... .......... .......... .......... 37% 80.6M 1s 2024-06-04T16:14:28.788 INFO:teuthology.orchestra.run.smithi144.stderr: 34800K .......... .......... .......... .......... .......... 37% 101M 1s 2024-06-04T16:14:28.788 INFO:teuthology.orchestra.run.smithi144.stderr: 34850K .......... .......... .......... .......... .......... 37% 67.8M 1s 2024-06-04T16:14:28.788 INFO:teuthology.orchestra.run.smithi144.stderr: 34900K .......... .......... .......... .......... .......... 37% 113M 1s 2024-06-04T16:14:28.788 INFO:teuthology.orchestra.run.smithi144.stderr: 34950K .......... .......... .......... .......... .......... 37% 84.4M 1s 2024-06-04T16:14:28.788 INFO:teuthology.orchestra.run.smithi144.stderr: 35000K .......... .......... .......... .......... .......... 37% 92.8M 1s 2024-06-04T16:14:28.788 INFO:teuthology.orchestra.run.smithi144.stderr: 35050K .......... .......... .......... .......... .......... 37% 90.3M 1s 2024-06-04T16:14:28.788 INFO:teuthology.orchestra.run.smithi144.stderr: 35100K .......... .......... .......... .......... .......... 37% 117M 1s 2024-06-04T16:14:28.788 INFO:teuthology.orchestra.run.smithi144.stderr: 35150K .......... .......... .......... .......... .......... 37% 74.0M 1s 2024-06-04T16:14:28.789 INFO:teuthology.orchestra.run.smithi144.stderr: 35200K .......... .......... .......... .......... .......... 37% 76.0M 1s 2024-06-04T16:14:28.789 INFO:teuthology.orchestra.run.smithi144.stderr: 35250K .......... .......... .......... .......... .......... 37% 81.2M 1s 2024-06-04T16:14:28.789 INFO:teuthology.orchestra.run.smithi144.stderr: 35300K .......... .......... .......... .......... .......... 38% 76.9M 1s 2024-06-04T16:14:28.789 INFO:teuthology.orchestra.run.smithi144.stderr: 35350K .......... .......... .......... .......... .......... 38% 124M 1s 2024-06-04T16:14:28.789 INFO:teuthology.orchestra.run.smithi144.stderr: 35400K .......... .......... .......... .......... .......... 38% 108M 1s 2024-06-04T16:14:28.789 INFO:teuthology.orchestra.run.smithi144.stderr: 35450K .......... .......... .......... .......... .......... 38% 111M 1s 2024-06-04T16:14:28.789 INFO:teuthology.orchestra.run.smithi144.stderr: 35500K .......... .......... .......... .......... .......... 38% 106M 1s 2024-06-04T16:14:28.789 INFO:teuthology.orchestra.run.smithi144.stderr: 35550K .......... .......... .......... .......... .......... 38% 109M 1s 2024-06-04T16:14:28.789 INFO:teuthology.orchestra.run.smithi144.stderr: 35600K .......... .......... .......... .......... .......... 38% 114M 1s 2024-06-04T16:14:28.789 INFO:teuthology.orchestra.run.smithi144.stderr: 35650K .......... .......... .......... .......... .......... 38% 68.7M 1s 2024-06-04T16:14:28.789 INFO:teuthology.orchestra.run.smithi144.stderr: 35700K .......... .......... .......... .......... .......... 38% 156M 1s 2024-06-04T16:14:28.789 INFO:teuthology.orchestra.run.smithi144.stderr: 35750K .......... .......... .......... .......... .......... 38% 117M 1s 2024-06-04T16:14:28.789 INFO:teuthology.orchestra.run.smithi144.stderr: 35800K .......... .......... .......... .......... .......... 38% 88.0M 1s 2024-06-04T16:14:28.789 INFO:teuthology.orchestra.run.smithi144.stderr: 35850K .......... .......... .......... .......... .......... 38% 141M 1s 2024-06-04T16:14:28.790 INFO:teuthology.orchestra.run.smithi144.stderr: 35900K .......... .......... .......... .......... .......... 38% 128M 1s 2024-06-04T16:14:28.790 INFO:teuthology.orchestra.run.smithi144.stderr: 35950K .......... .......... .......... .......... .......... 38% 115M 1s 2024-06-04T16:14:28.790 INFO:teuthology.orchestra.run.smithi144.stderr: 36000K .......... .......... .......... .......... .......... 38% 112M 1s 2024-06-04T16:14:28.790 INFO:teuthology.orchestra.run.smithi144.stderr: 36050K .......... .......... .......... .......... .......... 38% 89.4M 1s 2024-06-04T16:14:28.790 INFO:teuthology.orchestra.run.smithi144.stderr: 36100K .......... .......... .......... .......... .......... 38% 95.0M 1s 2024-06-04T16:14:28.790 INFO:teuthology.orchestra.run.smithi144.stderr: 36150K .......... .......... .......... .......... .......... 38% 147M 1s 2024-06-04T16:14:28.790 INFO:teuthology.orchestra.run.smithi144.stderr: 36200K .......... .......... .......... .......... .......... 39% 104M 1s 2024-06-04T16:14:28.790 INFO:teuthology.orchestra.run.smithi144.stderr: 36250K .......... .......... .......... .......... .......... 39% 126M 1s 2024-06-04T16:14:28.790 INFO:teuthology.orchestra.run.smithi144.stderr: 36300K .......... .......... .......... .......... .......... 39% 109M 1s 2024-06-04T16:14:28.790 INFO:teuthology.orchestra.run.smithi144.stderr: 36350K .......... .......... .......... .......... .......... 39% 119M 1s 2024-06-04T16:14:28.790 INFO:teuthology.orchestra.run.smithi144.stderr: 36400K .......... .......... .......... .......... .......... 39% 113M 1s 2024-06-04T16:14:28.790 INFO:teuthology.orchestra.run.smithi144.stderr: 36450K .......... .......... .......... .......... .......... 39% 86.6M 1s 2024-06-04T16:14:28.790 INFO:teuthology.orchestra.run.smithi144.stderr: 36500K .......... .......... .......... .......... .......... 39% 117M 1s 2024-06-04T16:14:28.790 INFO:teuthology.orchestra.run.smithi144.stderr: 36550K .......... .......... .......... .......... .......... 39% 112M 1s 2024-06-04T16:14:28.791 INFO:teuthology.orchestra.run.smithi144.stderr: 36600K .......... .......... .......... .......... .......... 39% 116M 1s 2024-06-04T16:14:28.791 INFO:teuthology.orchestra.run.smithi144.stderr: 36650K .......... .......... .......... .......... .......... 39% 107M 1s 2024-06-04T16:14:28.791 INFO:teuthology.orchestra.run.smithi144.stderr: 36700K .......... .......... .......... .......... .......... 39% 115M 1s 2024-06-04T16:14:28.791 INFO:teuthology.orchestra.run.smithi144.stderr: 36750K .......... .......... .......... .......... .......... 39% 121M 1s 2024-06-04T16:14:28.791 INFO:teuthology.orchestra.run.smithi144.stderr: 36800K .......... .......... .......... .......... .......... 39% 111M 1s 2024-06-04T16:14:28.791 INFO:teuthology.orchestra.run.smithi144.stderr: 36850K .......... .......... .......... .......... .......... 39% 90.5M 1s 2024-06-04T16:14:28.791 INFO:teuthology.orchestra.run.smithi144.stderr: 36900K .......... .......... .......... .......... .......... 39% 86.4M 1s 2024-06-04T16:14:28.791 INFO:teuthology.orchestra.run.smithi144.stderr: 36950K .......... .......... .......... .......... .......... 39% 62.7M 1s 2024-06-04T16:14:28.791 INFO:teuthology.orchestra.run.smithi144.stderr: 37000K .......... .......... .......... .......... .......... 39% 115M 1s 2024-06-04T16:14:28.791 INFO:teuthology.orchestra.run.smithi144.stderr: 37050K .......... .......... .......... .......... .......... 39% 107M 1s 2024-06-04T16:14:28.791 INFO:teuthology.orchestra.run.smithi144.stderr: 37100K .......... .......... .......... .......... .......... 39% 101M 1s 2024-06-04T16:14:28.791 INFO:teuthology.orchestra.run.smithi144.stderr: 37150K .......... .......... .......... .......... .......... 40% 107M 1s 2024-06-04T16:14:28.791 INFO:teuthology.orchestra.run.smithi144.stderr: 37200K .......... .......... .......... .......... .......... 40% 123M 1s 2024-06-04T16:14:28.791 INFO:teuthology.orchestra.run.smithi144.stderr: 37250K .......... .......... .......... .......... .......... 40% 84.0M 1s 2024-06-04T16:14:28.792 INFO:teuthology.orchestra.run.smithi144.stderr: 37300K .......... .......... .......... .......... .......... 40% 117M 1s 2024-06-04T16:14:28.792 INFO:teuthology.orchestra.run.smithi144.stderr: 37350K .......... .......... .......... .......... .......... 40% 110M 1s 2024-06-04T16:14:28.792 INFO:teuthology.orchestra.run.smithi144.stderr: 37400K .......... .......... .......... .......... .......... 40% 119M 1s 2024-06-04T16:14:28.792 INFO:teuthology.orchestra.run.smithi144.stderr: 37450K .......... .......... .......... .......... .......... 40% 105M 1s 2024-06-04T16:14:28.792 INFO:teuthology.orchestra.run.smithi144.stderr: 37500K .......... .......... .......... .......... .......... 40% 80.9M 1s 2024-06-04T16:14:28.792 INFO:teuthology.orchestra.run.smithi144.stderr: 37550K .......... .......... .......... .......... .......... 40% 105M 1s 2024-06-04T16:14:28.792 INFO:teuthology.orchestra.run.smithi144.stderr: 37600K .......... .......... .......... .......... .......... 40% 125M 1s 2024-06-04T16:14:28.792 INFO:teuthology.orchestra.run.smithi144.stderr: 37650K .......... .......... .......... .......... .......... 40% 87.0M 1s 2024-06-04T16:14:28.792 INFO:teuthology.orchestra.run.smithi144.stderr: 37700K .......... .......... .......... .......... .......... 40% 118M 1s 2024-06-04T16:14:28.792 INFO:teuthology.orchestra.run.smithi144.stderr: 37750K .......... .......... .......... .......... .......... 40% 111M 1s 2024-06-04T16:14:28.792 INFO:teuthology.orchestra.run.smithi144.stderr: 37800K .......... .......... .......... .......... .......... 40% 116M 1s 2024-06-04T16:14:28.792 INFO:teuthology.orchestra.run.smithi144.stderr: 37850K .......... .......... .......... .......... .......... 40% 72.5M 1s 2024-06-04T16:14:28.792 INFO:teuthology.orchestra.run.smithi144.stderr: 37900K .......... .......... .......... .......... .......... 40% 125M 1s 2024-06-04T16:14:28.792 INFO:teuthology.orchestra.run.smithi144.stderr: 37950K .......... .......... .......... .......... .......... 40% 94.6M 1s 2024-06-04T16:14:28.793 INFO:teuthology.orchestra.run.smithi144.stderr: 38000K .......... .......... .......... .......... .......... 40% 113M 1s 2024-06-04T16:14:28.793 INFO:teuthology.orchestra.run.smithi144.stderr: 38050K .......... .......... .......... .......... .......... 41% 89.4M 1s 2024-06-04T16:14:28.793 INFO:teuthology.orchestra.run.smithi144.stderr: 38100K .......... .......... .......... .......... .......... 41% 110M 1s 2024-06-04T16:14:28.793 INFO:teuthology.orchestra.run.smithi144.stderr: 38150K .......... .......... .......... .......... .......... 41% 107M 1s 2024-06-04T16:14:28.793 INFO:teuthology.orchestra.run.smithi144.stderr: 38200K .......... .......... .......... .......... .......... 41% 130M 1s 2024-06-04T16:14:28.793 INFO:teuthology.orchestra.run.smithi144.stderr: 38250K .......... .......... .......... .......... .......... 41% 104M 1s 2024-06-04T16:14:28.793 INFO:teuthology.orchestra.run.smithi144.stderr: 38300K .......... .......... .......... .......... .......... 41% 103M 1s 2024-06-04T16:14:28.793 INFO:teuthology.orchestra.run.smithi144.stderr: 38350K .......... .......... .......... .......... .......... 41% 120M 1s 2024-06-04T16:14:28.793 INFO:teuthology.orchestra.run.smithi144.stderr: 38400K .......... .......... .......... .......... .......... 41% 86.1M 1s 2024-06-04T16:14:28.793 INFO:teuthology.orchestra.run.smithi144.stderr: 38450K .......... .......... .......... .......... .......... 41% 98.2M 1s 2024-06-04T16:14:28.793 INFO:teuthology.orchestra.run.smithi144.stderr: 38500K .......... .......... .......... .......... .......... 41% 108M 1s 2024-06-04T16:14:28.793 INFO:teuthology.orchestra.run.smithi144.stderr: 38550K .......... .......... .......... .......... .......... 41% 126M 1s 2024-06-04T16:14:28.793 INFO:teuthology.orchestra.run.smithi144.stderr: 38600K .......... .......... .......... .......... .......... 41% 87.5M 1s 2024-06-04T16:14:28.793 INFO:teuthology.orchestra.run.smithi144.stderr: 38650K .......... .......... .......... .......... .......... 41% 130M 1s 2024-06-04T16:14:28.794 INFO:teuthology.orchestra.run.smithi144.stderr: 38700K .......... .......... .......... .......... .......... 41% 142M 1s 2024-06-04T16:14:28.794 INFO:teuthology.orchestra.run.smithi144.stderr: 38750K .......... .......... .......... .......... .......... 41% 124M 1s 2024-06-04T16:14:28.794 INFO:teuthology.orchestra.run.smithi144.stderr: 38800K .......... .......... .......... .......... .......... 41% 80.2M 1s 2024-06-04T16:14:28.794 INFO:teuthology.orchestra.run.smithi144.stderr: 38850K .......... .......... .......... .......... .......... 41% 126M 1s 2024-06-04T16:14:28.794 INFO:teuthology.orchestra.run.smithi144.stderr: 38900K .......... .......... .......... .......... .......... 41% 112M 1s 2024-06-04T16:14:28.794 INFO:teuthology.orchestra.run.smithi144.stderr: 38950K .......... .......... .......... .......... .......... 41% 88.3M 1s 2024-06-04T16:14:28.794 INFO:teuthology.orchestra.run.smithi144.stderr: 39000K .......... .......... .......... .......... .......... 42% 121M 1s 2024-06-04T16:14:28.794 INFO:teuthology.orchestra.run.smithi144.stderr: 39050K .......... .......... .......... .......... .......... 42% 135M 1s 2024-06-04T16:14:28.794 INFO:teuthology.orchestra.run.smithi144.stderr: 39100K .......... .......... .......... .......... .......... 42% 114M 1s 2024-06-04T16:14:28.794 INFO:teuthology.orchestra.run.smithi144.stderr: 39150K .......... .......... .......... .......... .......... 42% 112M 1s 2024-06-04T16:14:28.794 INFO:teuthology.orchestra.run.smithi144.stderr: 39200K .......... .......... .......... .......... .......... 42% 87.8M 1s 2024-06-04T16:14:28.794 INFO:teuthology.orchestra.run.smithi144.stderr: 39250K .......... .......... .......... .......... .......... 42% 126M 1s 2024-06-04T16:14:28.794 INFO:teuthology.orchestra.run.smithi144.stderr: 39300K .......... .......... .......... .......... .......... 42% 99.4M 1s 2024-06-04T16:14:28.795 INFO:teuthology.orchestra.run.smithi144.stderr: 39350K .......... .......... .......... .......... .......... 42% 127M 1s 2024-06-04T16:14:28.795 INFO:teuthology.orchestra.run.smithi144.stderr: 39400K .......... .......... .......... .......... .......... 42% 118M 1s 2024-06-04T16:14:28.795 INFO:teuthology.orchestra.run.smithi144.stderr: 39450K .......... .......... .......... .......... .......... 42% 108M 1s 2024-06-04T16:14:28.795 INFO:teuthology.orchestra.run.smithi144.stderr: 39500K .......... .......... .......... .......... .......... 42% 85.9M 1s 2024-06-04T16:14:28.795 INFO:teuthology.orchestra.run.smithi144.stderr: 39550K .......... .......... .......... .......... .......... 42% 121M 1s 2024-06-04T16:14:28.795 INFO:teuthology.orchestra.run.smithi144.stderr: 39600K .......... .......... .......... .......... .......... 42% 109M 1s 2024-06-04T16:14:28.795 INFO:teuthology.orchestra.run.smithi144.stderr: 39650K .......... .......... .......... .......... .......... 42% 122M 1s 2024-06-04T16:14:28.795 INFO:teuthology.orchestra.run.smithi144.stderr: 39700K .......... .......... .......... .......... .......... 42% 108M 1s 2024-06-04T16:14:28.795 INFO:teuthology.orchestra.run.smithi144.stderr: 39750K .......... .......... .......... .......... .......... 42% 120M 1s 2024-06-04T16:14:28.795 INFO:teuthology.orchestra.run.smithi144.stderr: 39800K .......... .......... .......... .......... .......... 42% 104M 1s 2024-06-04T16:14:28.795 INFO:teuthology.orchestra.run.smithi144.stderr: 39850K .......... .......... .......... .......... .......... 42% 128M 1s 2024-06-04T16:14:28.795 INFO:teuthology.orchestra.run.smithi144.stderr: 39900K .......... .......... .......... .......... .......... 43% 85.5M 1s 2024-06-04T16:14:28.795 INFO:teuthology.orchestra.run.smithi144.stderr: 39950K .......... .......... .......... .......... .......... 43% 110M 1s 2024-06-04T16:14:28.795 INFO:teuthology.orchestra.run.smithi144.stderr: 40000K .......... .......... .......... .......... .......... 43% 120M 1s 2024-06-04T16:14:28.796 INFO:teuthology.orchestra.run.smithi144.stderr: 40050K .......... .......... .......... .......... .......... 43% 99.3M 1s 2024-06-04T16:14:28.796 INFO:teuthology.orchestra.run.smithi144.stderr: 40100K .......... .......... .......... .......... .......... 43% 98.1M 1s 2024-06-04T16:14:28.796 INFO:teuthology.orchestra.run.smithi144.stderr: 40150K .......... .......... .......... .......... .......... 43% 135M 1s 2024-06-04T16:14:28.796 INFO:teuthology.orchestra.run.smithi144.stderr: 40200K .......... .......... .......... .......... .......... 43% 119M 1s 2024-06-04T16:14:28.796 INFO:teuthology.orchestra.run.smithi144.stderr: 40250K .......... .......... .......... .......... .......... 43% 115M 1s 2024-06-04T16:14:28.796 INFO:teuthology.orchestra.run.smithi144.stderr: 40300K .......... .......... .......... .......... .......... 43% 84.9M 1s 2024-06-04T16:14:28.796 INFO:teuthology.orchestra.run.smithi144.stderr: 40350K .......... .......... .......... .......... .......... 43% 117M 1s 2024-06-04T16:14:28.796 INFO:teuthology.orchestra.run.smithi144.stderr: 40400K .......... .......... .......... .......... .......... 43% 116M 1s 2024-06-04T16:14:28.796 INFO:teuthology.orchestra.run.smithi144.stderr: 40450K .......... .......... .......... .......... .......... 43% 111M 1s 2024-06-04T16:14:28.796 INFO:teuthology.orchestra.run.smithi144.stderr: 40500K .......... .......... .......... .......... .......... 43% 112M 1s 2024-06-04T16:14:28.796 INFO:teuthology.orchestra.run.smithi144.stderr: 40550K .......... .......... .......... .......... .......... 43% 124M 1s 2024-06-04T16:14:28.796 INFO:teuthology.orchestra.run.smithi144.stderr: 40600K .......... .......... .......... .......... .......... 43% 84.7M 1s 2024-06-04T16:14:28.796 INFO:teuthology.orchestra.run.smithi144.stderr: 40650K .......... .......... .......... .......... .......... 43% 115M 1s 2024-06-04T16:14:28.796 INFO:teuthology.orchestra.run.smithi144.stderr: 40700K .......... .......... .......... .......... .......... 43% 85.4M 1s 2024-06-04T16:14:28.797 INFO:teuthology.orchestra.run.smithi144.stderr: 40750K .......... .......... .......... .......... .......... 43% 92.5M 1s 2024-06-04T16:14:28.797 INFO:teuthology.orchestra.run.smithi144.stderr: 40800K .......... .......... .......... .......... .......... 43% 133M 1s 2024-06-04T16:14:28.797 INFO:teuthology.orchestra.run.smithi144.stderr: 40850K .......... .......... .......... .......... .......... 44% 119M 1s 2024-06-04T16:14:28.797 INFO:teuthology.orchestra.run.smithi144.stderr: 40900K .......... .......... .......... .......... .......... 44% 117M 1s 2024-06-04T16:14:28.797 INFO:teuthology.orchestra.run.smithi144.stderr: 40950K .......... .......... .......... .......... .......... 44% 81.3M 1s 2024-06-04T16:14:28.797 INFO:teuthology.orchestra.run.smithi144.stderr: 41000K .......... .......... .......... .......... .......... 44% 121M 1s 2024-06-04T16:14:28.797 INFO:teuthology.orchestra.run.smithi144.stderr: 41050K .......... .......... .......... .......... .......... 44% 104M 1s 2024-06-04T16:14:28.797 INFO:teuthology.orchestra.run.smithi144.stderr: 41100K .......... .......... .......... .......... .......... 44% 105M 1s 2024-06-04T16:14:28.797 INFO:teuthology.orchestra.run.smithi144.stderr: 41150K .......... .......... .......... .......... .......... 44% 104M 1s 2024-06-04T16:14:28.797 INFO:teuthology.orchestra.run.smithi144.stderr: 41200K .......... .......... .......... .......... .......... 44% 89.5M 1s 2024-06-04T16:14:28.797 INFO:teuthology.orchestra.run.smithi144.stderr: 41250K .......... .......... .......... .......... .......... 44% 122M 1s 2024-06-04T16:14:28.797 INFO:teuthology.orchestra.run.smithi144.stderr: 41300K .......... .......... .......... .......... .......... 44% 109M 1s 2024-06-04T16:14:28.797 INFO:teuthology.orchestra.run.smithi144.stderr: 41350K .......... .......... .......... .......... .......... 44% 86.3M 1s 2024-06-04T16:14:28.797 INFO:teuthology.orchestra.run.smithi144.stderr: 41400K .......... .......... .......... .......... .......... 44% 118M 1s 2024-06-04T16:14:28.798 INFO:teuthology.orchestra.run.smithi144.stderr: 41450K .......... .......... .......... .......... .......... 44% 118M 1s 2024-06-04T16:14:28.798 INFO:teuthology.orchestra.run.smithi144.stderr: 41500K .......... .......... .......... .......... .......... 44% 108M 1s 2024-06-04T16:14:28.798 INFO:teuthology.orchestra.run.smithi144.stderr: 41550K .......... .......... .......... .......... .......... 44% 116M 1s 2024-06-04T16:14:28.798 INFO:teuthology.orchestra.run.smithi144.stderr: 41600K .......... .......... .......... .......... .......... 44% 110M 1s 2024-06-04T16:14:28.798 INFO:teuthology.orchestra.run.smithi144.stderr: 41650K .......... .......... .......... .......... .......... 44% 120M 1s 2024-06-04T16:14:28.798 INFO:teuthology.orchestra.run.smithi144.stderr: 41700K .......... .......... .......... .......... .......... 44% 102M 1s 2024-06-04T16:14:28.798 INFO:teuthology.orchestra.run.smithi144.stderr: 41750K .......... .......... .......... .......... .......... 44% 83.3M 1s 2024-06-04T16:14:28.798 INFO:teuthology.orchestra.run.smithi144.stderr: 41800K .......... .......... .......... .......... .......... 45% 130M 1s 2024-06-04T16:14:28.798 INFO:teuthology.orchestra.run.smithi144.stderr: 41850K .......... .......... .......... .......... .......... 45% 108M 1s 2024-06-04T16:14:28.798 INFO:teuthology.orchestra.run.smithi144.stderr: 41900K .......... .......... .......... .......... .......... 45% 120M 1s 2024-06-04T16:14:28.798 INFO:teuthology.orchestra.run.smithi144.stderr: 41950K .......... .......... .......... .......... .......... 45% 101M 1s 2024-06-04T16:14:28.798 INFO:teuthology.orchestra.run.smithi144.stderr: 42000K .......... .......... .......... .......... .......... 45% 102M 1s 2024-06-04T16:14:28.798 INFO:teuthology.orchestra.run.smithi144.stderr: 42050K .......... .......... .......... .......... .......... 45% 150M 1s 2024-06-04T16:14:28.799 INFO:teuthology.orchestra.run.smithi144.stderr: 42100K .......... .......... .......... .......... .......... 45% 116M 1s 2024-06-04T16:14:28.799 INFO:teuthology.orchestra.run.smithi144.stderr: 42150K .......... .......... .......... .......... .......... 45% 86.4M 1s 2024-06-04T16:14:28.799 INFO:teuthology.orchestra.run.smithi144.stderr: 42200K .......... .......... .......... .......... .......... 45% 108M 1s 2024-06-04T16:14:28.799 INFO:teuthology.orchestra.run.smithi144.stderr: 42250K .......... .......... .......... .......... .......... 45% 108M 1s 2024-06-04T16:14:28.799 INFO:teuthology.orchestra.run.smithi144.stderr: 42300K .......... .......... .......... .......... .......... 45% 115M 1s 2024-06-04T16:14:28.799 INFO:teuthology.orchestra.run.smithi144.stderr: 42350K .......... .......... .......... .......... .......... 45% 113M 1s 2024-06-04T16:14:28.799 INFO:teuthology.orchestra.run.smithi144.stderr: 42400K .......... .......... .......... .......... .......... 45% 114M 1s 2024-06-04T16:14:28.799 INFO:teuthology.orchestra.run.smithi144.stderr: 42450K .......... .......... .......... .......... .......... 45% 114M 1s 2024-06-04T16:14:28.799 INFO:teuthology.orchestra.run.smithi144.stderr: 42500K .......... .......... .......... .......... .......... 45% 110M 1s 2024-06-04T16:14:28.799 INFO:teuthology.orchestra.run.smithi144.stderr: 42550K .......... .......... .......... .......... .......... 45% 84.3M 1s 2024-06-04T16:14:28.799 INFO:teuthology.orchestra.run.smithi144.stderr: 42600K .......... .......... .......... .......... .......... 45% 120M 1s 2024-06-04T16:14:28.799 INFO:teuthology.orchestra.run.smithi144.stderr: 42650K .......... .......... .......... .......... .......... 45% 115M 1s 2024-06-04T16:14:28.799 INFO:teuthology.orchestra.run.smithi144.stderr: 42700K .......... .......... .......... .......... .......... 46% 115M 1s 2024-06-04T16:14:28.799 INFO:teuthology.orchestra.run.smithi144.stderr: 42750K .......... .......... .......... .......... .......... 46% 116M 1s 2024-06-04T16:14:28.800 INFO:teuthology.orchestra.run.smithi144.stderr: 42800K .......... .......... .......... .......... .......... 46% 115M 1s 2024-06-04T16:14:28.800 INFO:teuthology.orchestra.run.smithi144.stderr: 42850K .......... .......... .......... .......... .......... 46% 68.6M 1s 2024-06-04T16:14:28.800 INFO:teuthology.orchestra.run.smithi144.stderr: 42900K .......... .......... .......... .......... .......... 46% 89.1M 1s 2024-06-04T16:14:28.800 INFO:teuthology.orchestra.run.smithi144.stderr: 42950K .......... .......... .......... .......... .......... 46% 68.8M 1s 2024-06-04T16:14:28.800 INFO:teuthology.orchestra.run.smithi144.stderr: 43000K .......... .......... .......... .......... .......... 46% 123M 1s 2024-06-04T16:14:28.800 INFO:teuthology.orchestra.run.smithi144.stderr: 43050K .......... .......... .......... .......... .......... 46% 114M 1s 2024-06-04T16:14:28.800 INFO:teuthology.orchestra.run.smithi144.stderr: 43100K .......... .......... .......... .......... .......... 46% 118M 1s 2024-06-04T16:14:28.800 INFO:teuthology.orchestra.run.smithi144.stderr: 43150K .......... .......... .......... .......... .......... 46% 122M 1s 2024-06-04T16:14:28.800 INFO:teuthology.orchestra.run.smithi144.stderr: 43200K .......... .......... .......... .......... .......... 46% 117M 1s 2024-06-04T16:14:28.800 INFO:teuthology.orchestra.run.smithi144.stderr: 43250K .......... .......... .......... .......... .......... 46% 85.9M 1s 2024-06-04T16:14:28.800 INFO:teuthology.orchestra.run.smithi144.stderr: 43300K .......... .......... .......... .......... .......... 46% 115M 1s 2024-06-04T16:14:28.800 INFO:teuthology.orchestra.run.smithi144.stderr: 43350K .......... .......... .......... .......... .......... 46% 113M 1s 2024-06-04T16:14:28.800 INFO:teuthology.orchestra.run.smithi144.stderr: 43400K .......... .......... .......... .......... .......... 46% 117M 1s 2024-06-04T16:14:28.801 INFO:teuthology.orchestra.run.smithi144.stderr: 43450K .......... .......... .......... .......... .......... 46% 105M 1s 2024-06-04T16:14:28.801 INFO:teuthology.orchestra.run.smithi144.stderr: 43500K .......... .......... .......... .......... .......... 46% 124M 1s 2024-06-04T16:14:28.801 INFO:teuthology.orchestra.run.smithi144.stderr: 43550K .......... .......... .......... .......... .......... 46% 111M 1s 2024-06-04T16:14:28.801 INFO:teuthology.orchestra.run.smithi144.stderr: 43600K .......... .......... .......... .......... .......... 46% 108M 1s 2024-06-04T16:14:28.801 INFO:teuthology.orchestra.run.smithi144.stderr: 43650K .......... .......... .......... .......... .......... 47% 20.3M 1s 2024-06-04T16:14:28.801 INFO:teuthology.orchestra.run.smithi144.stderr: 43700K .......... .......... .......... .......... .......... 47% 39.5M 1s 2024-06-04T16:14:28.801 INFO:teuthology.orchestra.run.smithi144.stderr: 43750K .......... .......... .......... .......... .......... 47% 97.0M 1s 2024-06-04T16:14:28.801 INFO:teuthology.orchestra.run.smithi144.stderr: 43800K .......... .......... .......... .......... .......... 47% 92.5M 1s 2024-06-04T16:14:28.801 INFO:teuthology.orchestra.run.smithi144.stderr: 43850K .......... .......... .......... .......... .......... 47% 75.7M 1s 2024-06-04T16:14:28.801 INFO:teuthology.orchestra.run.smithi144.stderr: 43900K .......... .......... .......... .......... .......... 47% 86.7M 1s 2024-06-04T16:14:28.801 INFO:teuthology.orchestra.run.smithi144.stderr: 43950K .......... .......... .......... .......... .......... 47% 113M 1s 2024-06-04T16:14:28.801 INFO:teuthology.orchestra.run.smithi144.stderr: 44000K .......... .......... .......... .......... .......... 47% 67.0M 1s 2024-06-04T16:14:28.801 INFO:teuthology.orchestra.run.smithi144.stderr: 44050K .......... .......... .......... .......... .......... 47% 82.5M 1s 2024-06-04T16:14:28.801 INFO:teuthology.orchestra.run.smithi144.stderr: 44100K .......... .......... .......... .......... .......... 47% 67.7M 1s 2024-06-04T16:14:28.802 INFO:teuthology.orchestra.run.smithi144.stderr: 44150K .......... .......... .......... .......... .......... 47% 100M 1s 2024-06-04T16:14:28.802 INFO:teuthology.orchestra.run.smithi144.stderr: 44200K .......... .......... .......... .......... .......... 47% 114M 1s 2024-06-04T16:14:28.802 INFO:teuthology.orchestra.run.smithi144.stderr: 44250K .......... .......... .......... .......... .......... 47% 79.4M 1s 2024-06-04T16:14:28.802 INFO:teuthology.orchestra.run.smithi144.stderr: 44300K .......... .......... .......... .......... .......... 47% 108M 1s 2024-06-04T16:14:28.802 INFO:teuthology.orchestra.run.smithi144.stderr: 44350K .......... .......... .......... .......... .......... 47% 80.3M 1s 2024-06-04T16:14:28.802 INFO:teuthology.orchestra.run.smithi144.stderr: 44400K .......... .......... .......... .......... .......... 47% 114M 1s 2024-06-04T16:14:28.802 INFO:teuthology.orchestra.run.smithi144.stderr: 44450K .......... .......... .......... .......... .......... 47% 59.6M 1s 2024-06-04T16:14:28.802 INFO:teuthology.orchestra.run.smithi144.stderr: 44500K .......... .......... .......... .......... .......... 47% 95.5M 1s 2024-06-04T16:14:28.802 INFO:teuthology.orchestra.run.smithi144.stderr: 44550K .......... .......... .......... .......... .......... 48% 111M 1s 2024-06-04T16:14:28.802 INFO:teuthology.orchestra.run.smithi144.stderr: 44600K .......... .......... .......... .......... .......... 48% 81.1M 1s 2024-06-04T16:14:28.802 INFO:teuthology.orchestra.run.smithi144.stderr: 44650K .......... .......... .......... .......... .......... 48% 110M 1s 2024-06-04T16:14:28.802 INFO:teuthology.orchestra.run.smithi144.stderr: 44700K .......... .......... .......... .......... .......... 48% 83.5M 1s 2024-06-04T16:14:28.802 INFO:teuthology.orchestra.run.smithi144.stderr: 44750K .......... .......... .......... .......... .......... 48% 155M 1s 2024-06-04T16:14:28.803 INFO:teuthology.orchestra.run.smithi144.stderr: 44800K .......... .......... .......... .......... .......... 48% 94.7M 1s 2024-06-04T16:14:28.803 INFO:teuthology.orchestra.run.smithi144.stderr: 44850K .......... .......... .......... .......... .......... 48% 111M 1s 2024-06-04T16:14:28.803 INFO:teuthology.orchestra.run.smithi144.stderr: 44900K .......... .......... .......... .......... .......... 48% 121M 1s 2024-06-04T16:14:28.803 INFO:teuthology.orchestra.run.smithi144.stderr: 44950K .......... .......... .......... .......... .......... 48% 111M 1s 2024-06-04T16:14:28.803 INFO:teuthology.orchestra.run.smithi144.stderr: 45000K .......... .......... .......... .......... .......... 48% 121M 1s 2024-06-04T16:14:28.803 INFO:teuthology.orchestra.run.smithi144.stderr: 45050K .......... .......... .......... .......... .......... 48% 111M 1s 2024-06-04T16:14:28.803 INFO:teuthology.orchestra.run.smithi144.stderr: 45100K .......... .......... .......... .......... .......... 48% 85.5M 1s 2024-06-04T16:14:28.803 INFO:teuthology.orchestra.run.smithi144.stderr: 45150K .......... .......... .......... .......... .......... 48% 122M 1s 2024-06-04T16:14:28.803 INFO:teuthology.orchestra.run.smithi144.stderr: 45200K .......... .......... .......... .......... .......... 48% 114M 1s 2024-06-04T16:14:28.803 INFO:teuthology.orchestra.run.smithi144.stderr: 45250K .......... .......... .......... .......... .......... 48% 111M 1s 2024-06-04T16:14:28.806 INFO:teuthology.orchestra.run.smithi144.stderr: 45300K .......... .......... .......... .......... .......... 48% 107M 1s 2024-06-04T16:14:28.806 INFO:teuthology.orchestra.run.smithi144.stderr: 45350K .......... .......... .......... .......... .......... 48% 124M 1s 2024-06-04T16:14:28.806 INFO:teuthology.orchestra.run.smithi144.stderr: 45400K .......... .......... .......... .......... .......... 48% 108M 1s 2024-06-04T16:14:28.806 INFO:teuthology.orchestra.run.smithi144.stderr: 45450K .......... .......... .......... .......... .......... 48% 103M 1s 2024-06-04T16:14:28.806 INFO:teuthology.orchestra.run.smithi144.stderr: 45500K .......... .......... .......... .......... .......... 49% 103M 1s 2024-06-04T16:14:28.806 INFO:teuthology.orchestra.run.smithi144.stderr: 45550K .......... .......... .......... .......... .......... 49% 109M 1s 2024-06-04T16:14:28.806 INFO:teuthology.orchestra.run.smithi144.stderr: 45600K .......... .......... .......... .......... .......... 49% 120M 1s 2024-06-04T16:14:28.806 INFO:teuthology.orchestra.run.smithi144.stderr: 45650K .......... .......... .......... .......... .......... 49% 99.0M 1s 2024-06-04T16:14:28.807 INFO:teuthology.orchestra.run.smithi144.stderr: 45700K .......... .......... .......... .......... .......... 49% 127M 1s 2024-06-04T16:14:28.807 INFO:teuthology.orchestra.run.smithi144.stderr: 45750K .......... .......... .......... .......... .......... 49% 114M 1s 2024-06-04T16:14:28.807 INFO:teuthology.orchestra.run.smithi144.stderr: 45800K .......... .......... .......... .......... .......... 49% 111M 1s 2024-06-04T16:14:28.807 INFO:teuthology.orchestra.run.smithi144.stderr: 45850K .......... .......... .......... .......... .......... 49% 99.6M 1s 2024-06-04T16:14:28.807 INFO:teuthology.orchestra.run.smithi144.stderr: 45900K .......... .......... .......... .......... .......... 49% 96.9M 1s 2024-06-04T16:14:28.807 INFO:teuthology.orchestra.run.smithi144.stderr: 45950K .......... .......... .......... .......... .......... 49% 118M 1s 2024-06-04T16:14:28.807 INFO:teuthology.orchestra.run.smithi144.stderr: 46000K .......... .......... .......... .......... .......... 49% 85.2M 1s 2024-06-04T16:14:28.807 INFO:teuthology.orchestra.run.smithi144.stderr: 46050K .......... .......... .......... .......... .......... 49% 118M 1s 2024-06-04T16:14:28.807 INFO:teuthology.orchestra.run.smithi144.stderr: 46100K .......... .......... .......... .......... .......... 49% 112M 1s 2024-06-04T16:14:28.807 INFO:teuthology.orchestra.run.smithi144.stderr: 46150K .......... .......... .......... .......... .......... 49% 116M 1s 2024-06-04T16:14:28.807 INFO:teuthology.orchestra.run.smithi144.stderr: 46200K .......... .......... .......... .......... .......... 49% 106M 1s 2024-06-04T16:14:28.807 INFO:teuthology.orchestra.run.smithi144.stderr: 46250K .......... .......... .......... .......... .......... 49% 100M 1s 2024-06-04T16:14:28.807 INFO:teuthology.orchestra.run.smithi144.stderr: 46300K .......... .......... .......... .......... .......... 49% 96.9M 1s 2024-06-04T16:14:28.807 INFO:teuthology.orchestra.run.smithi144.stderr: 46350K .......... .......... .......... .......... .......... 49% 118M 1s 2024-06-04T16:14:28.808 INFO:teuthology.orchestra.run.smithi144.stderr: 46400K .......... .......... .......... .......... .......... 49% 106M 1s 2024-06-04T16:14:28.808 INFO:teuthology.orchestra.run.smithi144.stderr: 46450K .......... .......... .......... .......... .......... 50% 117M 1s 2024-06-04T16:14:28.808 INFO:teuthology.orchestra.run.smithi144.stderr: 46500K .......... .......... .......... .......... .......... 50% 117M 1s 2024-06-04T16:14:28.808 INFO:teuthology.orchestra.run.smithi144.stderr: 46550K .......... .......... .......... .......... .......... 50% 116M 1s 2024-06-04T16:14:28.808 INFO:teuthology.orchestra.run.smithi144.stderr: 46600K .......... .......... .......... .......... .......... 50% 113M 1s 2024-06-04T16:14:28.808 INFO:teuthology.orchestra.run.smithi144.stderr: 46650K .......... .......... .......... .......... .......... 50% 114M 1s 2024-06-04T16:14:28.808 INFO:teuthology.orchestra.run.smithi144.stderr: 46700K .......... .......... .......... .......... .......... 50% 87.7M 1s 2024-06-04T16:14:28.808 INFO:teuthology.orchestra.run.smithi144.stderr: 46750K .......... .......... .......... .......... .......... 50% 120M 1s 2024-06-04T16:14:28.808 INFO:teuthology.orchestra.run.smithi144.stderr: 46800K .......... .......... .......... .......... .......... 50% 115M 1s 2024-06-04T16:14:28.808 INFO:teuthology.orchestra.run.smithi144.stderr: 46850K .......... .......... .......... .......... .......... 50% 114M 1s 2024-06-04T16:14:28.808 INFO:teuthology.orchestra.run.smithi144.stderr: 46900K .......... .......... .......... .......... .......... 50% 108M 1s 2024-06-04T16:14:28.808 INFO:teuthology.orchestra.run.smithi144.stderr: 46950K .......... .......... .......... .......... .......... 50% 115M 1s 2024-06-04T16:14:28.808 INFO:teuthology.orchestra.run.smithi144.stderr: 47000K .......... .......... .......... .......... .......... 50% 113M 1s 2024-06-04T16:14:28.808 INFO:teuthology.orchestra.run.smithi144.stderr: 47050K .......... .......... .......... .......... .......... 50% 107M 1s 2024-06-04T16:14:28.809 INFO:teuthology.orchestra.run.smithi144.stderr: 47100K .......... .......... .......... .......... .......... 50% 70.5M 1s 2024-06-04T16:14:28.809 INFO:teuthology.orchestra.run.smithi144.stderr: 47150K .......... .......... .......... .......... .......... 50% 111M 1s 2024-06-04T16:14:28.809 INFO:teuthology.orchestra.run.smithi144.stderr: 47200K .......... .......... .......... .......... .......... 50% 115M 1s 2024-06-04T16:14:28.809 INFO:teuthology.orchestra.run.smithi144.stderr: 47250K .......... .......... .......... .......... .......... 50% 121M 1s 2024-06-04T16:14:28.809 INFO:teuthology.orchestra.run.smithi144.stderr: 47300K .......... .......... .......... .......... .......... 50% 109M 1s 2024-06-04T16:14:28.809 INFO:teuthology.orchestra.run.smithi144.stderr: 47350K .......... .......... .......... .......... .......... 51% 99.3M 1s 2024-06-04T16:14:28.809 INFO:teuthology.orchestra.run.smithi144.stderr: 47400K .......... .......... .......... .......... .......... 51% 136M 1s 2024-06-04T16:14:28.809 INFO:teuthology.orchestra.run.smithi144.stderr: 47450K .......... .......... .......... .......... .......... 51% 93.7M 1s 2024-06-04T16:14:28.809 INFO:teuthology.orchestra.run.smithi144.stderr: 47500K .......... .......... .......... .......... .......... 51% 119M 1s 2024-06-04T16:14:28.809 INFO:teuthology.orchestra.run.smithi144.stderr: 47550K .......... .......... .......... .......... .......... 51% 112M 1s 2024-06-04T16:14:28.809 INFO:teuthology.orchestra.run.smithi144.stderr: 47600K .......... .......... .......... .......... .......... 51% 99.9M 1s 2024-06-04T16:14:28.809 INFO:teuthology.orchestra.run.smithi144.stderr: 47650K .......... .......... .......... .......... .......... 51% 106M 1s 2024-06-04T16:14:28.809 INFO:teuthology.orchestra.run.smithi144.stderr: 47700K .......... .......... .......... .......... .......... 51% 115M 1s 2024-06-04T16:14:28.809 INFO:teuthology.orchestra.run.smithi144.stderr: 47750K .......... .......... .......... .......... .......... 51% 110M 1s 2024-06-04T16:14:28.810 INFO:teuthology.orchestra.run.smithi144.stderr: 47800K .......... .......... .......... .......... .......... 51% 87.5M 1s 2024-06-04T16:14:28.810 INFO:teuthology.orchestra.run.smithi144.stderr: 47850K .......... .......... .......... .......... .......... 51% 116M 1s 2024-06-04T16:14:28.810 INFO:teuthology.orchestra.run.smithi144.stderr: 47900K .......... .......... .......... .......... .......... 51% 94.7M 1s 2024-06-04T16:14:28.810 INFO:teuthology.orchestra.run.smithi144.stderr: 47950K .......... .......... .......... .......... .......... 51% 139M 1s 2024-06-04T16:14:28.810 INFO:teuthology.orchestra.run.smithi144.stderr: 48000K .......... .......... .......... .......... .......... 51% 106M 1s 2024-06-04T16:14:28.810 INFO:teuthology.orchestra.run.smithi144.stderr: 48050K .......... .......... .......... .......... .......... 51% 114M 1s 2024-06-04T16:14:28.810 INFO:teuthology.orchestra.run.smithi144.stderr: 48100K .......... .......... .......... .......... .......... 51% 110M 1s 2024-06-04T16:14:28.810 INFO:teuthology.orchestra.run.smithi144.stderr: 48150K .......... .......... .......... .......... .......... 51% 97.1M 1s 2024-06-04T16:14:28.810 INFO:teuthology.orchestra.run.smithi144.stderr: 48200K .......... .......... .......... .......... .......... 51% 99.2M 1s 2024-06-04T16:14:28.810 INFO:teuthology.orchestra.run.smithi144.stderr: 48250K .......... .......... .......... .......... .......... 51% 95.2M 1s 2024-06-04T16:14:28.810 INFO:teuthology.orchestra.run.smithi144.stderr: 48300K .......... .......... .......... .......... .......... 52% 148M 1s 2024-06-04T16:14:28.810 INFO:teuthology.orchestra.run.smithi144.stderr: 48350K .......... .......... .......... .......... .......... 52% 81.9M 1s 2024-06-04T16:14:28.810 INFO:teuthology.orchestra.run.smithi144.stderr: 48400K .......... .......... .......... .......... .......... 52% 110M 1s 2024-06-04T16:14:28.810 INFO:teuthology.orchestra.run.smithi144.stderr: 48450K .......... .......... .......... .......... .......... 52% 60.5M 1s 2024-06-04T16:14:28.811 INFO:teuthology.orchestra.run.smithi144.stderr: 48500K .......... .......... .......... .......... .......... 52% 117M 1s 2024-06-04T16:14:28.811 INFO:teuthology.orchestra.run.smithi144.stderr: 48550K .......... .......... .......... .......... .......... 52% 107M 1s 2024-06-04T16:14:28.811 INFO:teuthology.orchestra.run.smithi144.stderr: 48600K .......... .......... .......... .......... .......... 52% 67.8M 1s 2024-06-04T16:14:28.811 INFO:teuthology.orchestra.run.smithi144.stderr: 48650K .......... .......... .......... .......... .......... 52% 109M 1s 2024-06-04T16:14:28.811 INFO:teuthology.orchestra.run.smithi144.stderr: 48700K .......... .......... .......... .......... .......... 52% 221M 1s 2024-06-04T16:14:28.811 INFO:teuthology.orchestra.run.smithi144.stderr: 48750K .......... .......... .......... .......... .......... 52% 117M 1s 2024-06-04T16:14:28.811 INFO:teuthology.orchestra.run.smithi144.stderr: 48800K .......... .......... .......... .......... .......... 52% 93.4M 1s 2024-06-04T16:14:28.811 INFO:teuthology.orchestra.run.smithi144.stderr: 48850K .......... .......... .......... .......... .......... 52% 124M 1s 2024-06-04T16:14:28.811 INFO:teuthology.orchestra.run.smithi144.stderr: 48900K .......... .......... .......... .......... .......... 52% 116M 1s 2024-06-04T16:14:28.811 INFO:teuthology.orchestra.run.smithi144.stderr: 48950K .......... .......... .......... .......... .......... 52% 106M 1s 2024-06-04T16:14:28.811 INFO:teuthology.orchestra.run.smithi144.stderr: 49000K .......... .......... .......... .......... .......... 52% 82.3M 1s 2024-06-04T16:14:28.811 INFO:teuthology.orchestra.run.smithi144.stderr: 49050K .......... .......... .......... .......... .......... 52% 125M 1s 2024-06-04T16:14:28.811 INFO:teuthology.orchestra.run.smithi144.stderr: 49100K .......... .......... .......... .......... .......... 52% 142M 1s 2024-06-04T16:14:28.812 INFO:teuthology.orchestra.run.smithi144.stderr: 49150K .......... .......... .......... .......... .......... 52% 104M 1s 2024-06-04T16:14:28.812 INFO:teuthology.orchestra.run.smithi144.stderr: 49200K .......... .......... .......... .......... .......... 53% 114M 1s 2024-06-04T16:14:28.812 INFO:teuthology.orchestra.run.smithi144.stderr: 49250K .......... .......... .......... .......... .......... 53% 102M 1s 2024-06-04T16:14:28.812 INFO:teuthology.orchestra.run.smithi144.stderr: 49300K .......... .......... .......... .......... .......... 53% 97.3M 1s 2024-06-04T16:14:28.812 INFO:teuthology.orchestra.run.smithi144.stderr: 49350K .......... .......... .......... .......... .......... 53% 132M 1s 2024-06-04T16:14:28.812 INFO:teuthology.orchestra.run.smithi144.stderr: 49400K .......... .......... .......... .......... .......... 53% 90.2M 1s 2024-06-04T16:14:28.812 INFO:teuthology.orchestra.run.smithi144.stderr: 49450K .......... .......... .......... .......... .......... 53% 112M 1s 2024-06-04T16:14:28.812 INFO:teuthology.orchestra.run.smithi144.stderr: 49500K .......... .......... .......... .......... .......... 53% 113M 1s 2024-06-04T16:14:28.812 INFO:teuthology.orchestra.run.smithi144.stderr: 49550K .......... .......... .......... .......... .......... 53% 107M 1s 2024-06-04T16:14:28.812 INFO:teuthology.orchestra.run.smithi144.stderr: 49600K .......... .......... .......... .......... .......... 53% 121M 1s 2024-06-04T16:14:28.812 INFO:teuthology.orchestra.run.smithi144.stderr: 49650K .......... .......... .......... .......... .......... 53% 116M 1s 2024-06-04T16:14:28.812 INFO:teuthology.orchestra.run.smithi144.stderr: 49700K .......... .......... .......... .......... .......... 53% 111M 1s 2024-06-04T16:14:28.812 INFO:teuthology.orchestra.run.smithi144.stderr: 49750K .......... .......... .......... .......... .......... 53% 120M 1s 2024-06-04T16:14:28.813 INFO:teuthology.orchestra.run.smithi144.stderr: 49800K .......... .......... .......... .......... .......... 53% 90.0M 1s 2024-06-04T16:14:28.813 INFO:teuthology.orchestra.run.smithi144.stderr: 49850K .......... .......... .......... .......... .......... 53% 109M 1s 2024-06-04T16:14:28.813 INFO:teuthology.orchestra.run.smithi144.stderr: 49900K .......... .......... .......... .......... .......... 53% 115M 1s 2024-06-04T16:14:28.813 INFO:teuthology.orchestra.run.smithi144.stderr: 49950K .......... .......... .......... .......... .......... 53% 110M 1s 2024-06-04T16:14:28.813 INFO:teuthology.orchestra.run.smithi144.stderr: 50000K .......... .......... .......... .......... .......... 53% 114M 1s 2024-06-04T16:14:28.813 INFO:teuthology.orchestra.run.smithi144.stderr: 50050K .......... .......... .......... .......... .......... 53% 85.4M 1s 2024-06-04T16:14:28.813 INFO:teuthology.orchestra.run.smithi144.stderr: 50100K .......... .......... .......... .......... .......... 53% 141M 1s 2024-06-04T16:14:28.813 INFO:teuthology.orchestra.run.smithi144.stderr: 50150K .......... .......... .......... .......... .......... 54% 64.5M 1s 2024-06-04T16:14:28.813 INFO:teuthology.orchestra.run.smithi144.stderr: 50200K .......... .......... .......... .......... .......... 54% 225M 1s 2024-06-04T16:14:28.813 INFO:teuthology.orchestra.run.smithi144.stderr: 50250K .......... .......... .......... .......... .......... 54% 119M 1s 2024-06-04T16:14:28.813 INFO:teuthology.orchestra.run.smithi144.stderr: 50300K .......... .......... .......... .......... .......... 54% 122M 1s 2024-06-04T16:14:28.813 INFO:teuthology.orchestra.run.smithi144.stderr: 50350K .......... .......... .......... .......... .......... 54% 113M 1s 2024-06-04T16:14:28.813 INFO:teuthology.orchestra.run.smithi144.stderr: 50400K .......... .......... .......... .......... .......... 54% 109M 1s 2024-06-04T16:14:28.813 INFO:teuthology.orchestra.run.smithi144.stderr: 50450K .......... .......... .......... .......... .......... 54% 114M 1s 2024-06-04T16:14:28.814 INFO:teuthology.orchestra.run.smithi144.stderr: 50500K .......... .......... .......... .......... .......... 54% 116M 1s 2024-06-04T16:14:28.814 INFO:teuthology.orchestra.run.smithi144.stderr: 50550K .......... .......... .......... .......... .......... 54% 93.7M 1s 2024-06-04T16:14:28.814 INFO:teuthology.orchestra.run.smithi144.stderr: 50600K .......... .......... .......... .......... .......... 54% 98.5M 1s 2024-06-04T16:14:28.814 INFO:teuthology.orchestra.run.smithi144.stderr: 50650K .......... .......... .......... .......... .......... 54% 110M 1s 2024-06-04T16:14:28.814 INFO:teuthology.orchestra.run.smithi144.stderr: 50700K .......... .......... .......... .......... .......... 54% 113M 1s 2024-06-04T16:14:28.814 INFO:teuthology.orchestra.run.smithi144.stderr: 50750K .......... .......... .......... .......... .......... 54% 115M 1s 2024-06-04T16:14:28.814 INFO:teuthology.orchestra.run.smithi144.stderr: 50800K .......... .......... .......... .......... .......... 54% 102M 1s 2024-06-04T16:14:28.814 INFO:teuthology.orchestra.run.smithi144.stderr: 50850K .......... .......... .......... .......... .......... 54% 120M 1s 2024-06-04T16:14:28.814 INFO:teuthology.orchestra.run.smithi144.stderr: 50900K .......... .......... .......... .......... .......... 54% 97.2M 1s 2024-06-04T16:14:28.814 INFO:teuthology.orchestra.run.smithi144.stderr: 50950K .......... .......... .......... .......... .......... 54% 114M 1s 2024-06-04T16:14:28.814 INFO:teuthology.orchestra.run.smithi144.stderr: 51000K .......... .......... .......... .......... .......... 54% 114M 1s 2024-06-04T16:14:28.814 INFO:teuthology.orchestra.run.smithi144.stderr: 51050K .......... .......... .......... .......... .......... 55% 117M 1s 2024-06-04T16:14:28.814 INFO:teuthology.orchestra.run.smithi144.stderr: 51100K .......... .......... .......... .......... .......... 55% 108M 1s 2024-06-04T16:14:28.815 INFO:teuthology.orchestra.run.smithi144.stderr: 51150K .......... .......... .......... .......... .......... 55% 115M 1s 2024-06-04T16:14:28.815 INFO:teuthology.orchestra.run.smithi144.stderr: 51200K .......... .......... .......... .......... .......... 55% 115M 1s 2024-06-04T16:14:28.815 INFO:teuthology.orchestra.run.smithi144.stderr: 51250K .......... .......... .......... .......... .......... 55% 117M 1s 2024-06-04T16:14:28.815 INFO:teuthology.orchestra.run.smithi144.stderr: 51300K .......... .......... .......... .......... .......... 55% 83.6M 1s 2024-06-04T16:14:28.815 INFO:teuthology.orchestra.run.smithi144.stderr: 51350K .......... .......... .......... .......... .......... 55% 114M 1s 2024-06-04T16:14:28.815 INFO:teuthology.orchestra.run.smithi144.stderr: 51400K .......... .......... .......... .......... .......... 55% 127M 1s 2024-06-04T16:14:28.815 INFO:teuthology.orchestra.run.smithi144.stderr: 51450K .......... .......... .......... .......... .......... 55% 93.7M 1s 2024-06-04T16:14:28.815 INFO:teuthology.orchestra.run.smithi144.stderr: 51500K .......... .......... .......... .......... .......... 55% 137M 1s 2024-06-04T16:14:28.815 INFO:teuthology.orchestra.run.smithi144.stderr: 51550K .......... .......... .......... .......... .......... 55% 103M 1s 2024-06-04T16:14:28.815 INFO:teuthology.orchestra.run.smithi144.stderr: 51600K .......... .......... .......... .......... .......... 55% 72.6M 1s 2024-06-04T16:14:28.815 INFO:teuthology.orchestra.run.smithi144.stderr: 51650K .......... .......... .......... .......... .......... 55% 84.7M 1s 2024-06-04T16:14:28.815 INFO:teuthology.orchestra.run.smithi144.stderr: 51700K .......... .......... .......... .......... .......... 55% 183M 1s 2024-06-04T16:14:28.815 INFO:teuthology.orchestra.run.smithi144.stderr: 51750K .......... .......... .......... .......... .......... 55% 140M 1s 2024-06-04T16:14:28.816 INFO:teuthology.orchestra.run.smithi144.stderr: 51800K .......... .......... .......... .......... .......... 55% 118M 1s 2024-06-04T16:14:28.816 INFO:teuthology.orchestra.run.smithi144.stderr: 51850K .......... .......... .......... .......... .......... 55% 103M 1s 2024-06-04T16:14:28.816 INFO:teuthology.orchestra.run.smithi144.stderr: 51900K .......... .......... .......... .......... .......... 55% 122M 1s 2024-06-04T16:14:28.816 INFO:teuthology.orchestra.run.smithi144.stderr: 51950K .......... .......... .......... .......... .......... 55% 80.9M 1s 2024-06-04T16:14:28.816 INFO:teuthology.orchestra.run.smithi144.stderr: 52000K .......... .......... .......... .......... .......... 56% 144M 1s 2024-06-04T16:14:28.816 INFO:teuthology.orchestra.run.smithi144.stderr: 52050K .......... .......... .......... .......... .......... 56% 141M 1s 2024-06-04T16:14:28.816 INFO:teuthology.orchestra.run.smithi144.stderr: 52100K .......... .......... .......... .......... .......... 56% 77.5M 1s 2024-06-04T16:14:28.816 INFO:teuthology.orchestra.run.smithi144.stderr: 52150K .......... .......... .......... .......... .......... 56% 124M 0s 2024-06-04T16:14:28.816 INFO:teuthology.orchestra.run.smithi144.stderr: 52200K .......... .......... .......... .......... .......... 56% 134M 0s 2024-06-04T16:14:28.816 INFO:teuthology.orchestra.run.smithi144.stderr: 52250K .......... .......... .......... .......... .......... 56% 105M 0s 2024-06-04T16:14:28.816 INFO:teuthology.orchestra.run.smithi144.stderr: 52300K .......... .......... .......... .......... .......... 56% 107M 0s 2024-06-04T16:14:28.816 INFO:teuthology.orchestra.run.smithi144.stderr: 52350K .......... .......... .......... .......... .......... 56% 102M 0s 2024-06-04T16:14:28.816 INFO:teuthology.orchestra.run.smithi144.stderr: 52400K .......... .......... .......... .......... .......... 56% 125M 0s 2024-06-04T16:14:28.816 INFO:teuthology.orchestra.run.smithi144.stderr: 52450K .......... .......... .......... .......... .......... 56% 78.2M 0s 2024-06-04T16:14:28.817 INFO:teuthology.orchestra.run.smithi144.stderr: 52500K .......... .......... .......... .......... .......... 56% 155M 0s 2024-06-04T16:14:28.817 INFO:teuthology.orchestra.run.smithi144.stderr: 52550K .......... .......... .......... .......... .......... 56% 87.2M 0s 2024-06-04T16:14:28.817 INFO:teuthology.orchestra.run.smithi144.stderr: 52600K .......... .......... .......... .......... .......... 56% 148M 0s 2024-06-04T16:14:28.817 INFO:teuthology.orchestra.run.smithi144.stderr: 52650K .......... .......... .......... .......... .......... 56% 110M 0s 2024-06-04T16:14:28.817 INFO:teuthology.orchestra.run.smithi144.stderr: 52700K .......... .......... .......... .......... .......... 56% 115M 0s 2024-06-04T16:14:28.817 INFO:teuthology.orchestra.run.smithi144.stderr: 52750K .......... .......... .......... .......... .......... 56% 109M 0s 2024-06-04T16:14:28.817 INFO:teuthology.orchestra.run.smithi144.stderr: 52800K .......... .......... .......... .......... .......... 56% 122M 0s 2024-06-04T16:14:28.817 INFO:teuthology.orchestra.run.smithi144.stderr: 52850K .......... .......... .......... .......... .......... 56% 82.7M 0s 2024-06-04T16:14:28.817 INFO:teuthology.orchestra.run.smithi144.stderr: 52900K .......... .......... .......... .......... .......... 56% 106M 0s 2024-06-04T16:14:28.817 INFO:teuthology.orchestra.run.smithi144.stderr: 52950K .......... .......... .......... .......... .......... 57% 129M 0s 2024-06-04T16:14:28.817 INFO:teuthology.orchestra.run.smithi144.stderr: 53000K .......... .......... .......... .......... .......... 57% 121M 0s 2024-06-04T16:14:28.817 INFO:teuthology.orchestra.run.smithi144.stderr: 53050K .......... .......... .......... .......... .......... 57% 115M 0s 2024-06-04T16:14:28.817 INFO:teuthology.orchestra.run.smithi144.stderr: 53100K .......... .......... .......... .......... .......... 57% 76.7M 0s 2024-06-04T16:14:28.817 INFO:teuthology.orchestra.run.smithi144.stderr: 53150K .......... .......... .......... .......... .......... 57% 115M 0s 2024-06-04T16:14:28.818 INFO:teuthology.orchestra.run.smithi144.stderr: 53200K .......... .......... .......... .......... .......... 57% 104M 0s 2024-06-04T16:14:28.818 INFO:teuthology.orchestra.run.smithi144.stderr: 53250K .......... .......... .......... .......... .......... 57% 90.6M 0s 2024-06-04T16:14:28.818 INFO:teuthology.orchestra.run.smithi144.stderr: 53300K .......... .......... .......... .......... .......... 57% 111M 0s 2024-06-04T16:14:28.818 INFO:teuthology.orchestra.run.smithi144.stderr: 53350K .......... .......... .......... .......... .......... 57% 119M 0s 2024-06-04T16:14:28.818 INFO:teuthology.orchestra.run.smithi144.stderr: 53400K .......... .......... .......... .......... .......... 57% 94.9M 0s 2024-06-04T16:14:28.818 INFO:teuthology.orchestra.run.smithi144.stderr: 53450K .......... .......... .......... .......... .......... 57% 139M 0s 2024-06-04T16:14:28.818 INFO:teuthology.orchestra.run.smithi144.stderr: 53500K .......... .......... .......... .......... .......... 57% 105M 0s 2024-06-04T16:14:28.818 INFO:teuthology.orchestra.run.smithi144.stderr: 53550K .......... .......... .......... .......... .......... 57% 122M 0s 2024-06-04T16:14:28.818 INFO:teuthology.orchestra.run.smithi144.stderr: 53600K .......... .......... .......... .......... .......... 57% 116M 0s 2024-06-04T16:14:28.818 INFO:teuthology.orchestra.run.smithi144.stderr: 53650K .......... .......... .......... .......... .......... 57% 85.1M 0s 2024-06-04T16:14:28.818 INFO:teuthology.orchestra.run.smithi144.stderr: 53700K .......... .......... .......... .......... .......... 57% 115M 0s 2024-06-04T16:14:28.818 INFO:teuthology.orchestra.run.smithi144.stderr: 53750K .......... .......... .......... .......... .......... 57% 20.4M 0s 2024-06-04T16:14:28.818 INFO:teuthology.orchestra.run.smithi144.stderr: 53800K .......... .......... .......... .......... .......... 57% 105M 0s 2024-06-04T16:14:28.818 INFO:teuthology.orchestra.run.smithi144.stderr: 53850K .......... .......... .......... .......... .......... 58% 40.8M 0s 2024-06-04T16:14:28.819 INFO:teuthology.orchestra.run.smithi144.stderr: 53900K .......... .......... .......... .......... .......... 58% 71.5M 0s 2024-06-04T16:14:28.819 INFO:teuthology.orchestra.run.smithi144.stderr: 53950K .......... .......... .......... .......... .......... 58% 82.9M 0s 2024-06-04T16:14:28.819 INFO:teuthology.orchestra.run.smithi144.stderr: 54000K .......... .......... .......... .......... .......... 58% 115M 0s 2024-06-04T16:14:28.819 INFO:teuthology.orchestra.run.smithi144.stderr: 54050K .......... .......... .......... .......... .......... 58% 90.8M 0s 2024-06-04T16:14:28.819 INFO:teuthology.orchestra.run.smithi144.stderr: 54100K .......... .......... .......... .......... .......... 58% 67.6M 0s 2024-06-04T16:14:28.819 INFO:teuthology.orchestra.run.smithi144.stderr: 54150K .......... .......... .......... .......... .......... 58% 79.9M 0s 2024-06-04T16:14:28.819 INFO:teuthology.orchestra.run.smithi144.stderr: 54200K .......... .......... .......... .......... .......... 58% 92.4M 0s 2024-06-04T16:14:28.819 INFO:teuthology.orchestra.run.smithi144.stderr: 54250K .......... .......... .......... .......... .......... 58% 115M 0s 2024-06-04T16:14:28.819 INFO:teuthology.orchestra.run.smithi144.stderr: 54300K .......... .......... .......... .......... .......... 58% 73.9M 0s 2024-06-04T16:14:28.819 INFO:teuthology.orchestra.run.smithi144.stderr: 54350K .......... .......... .......... .......... .......... 58% 87.6M 0s 2024-06-04T16:14:28.819 INFO:teuthology.orchestra.run.smithi144.stderr: 54400K .......... .......... .......... .......... .......... 58% 51.4M 0s 2024-06-04T16:14:28.819 INFO:teuthology.orchestra.run.smithi144.stderr: 54450K .......... .......... .......... .......... .......... 58% 61.2M 0s 2024-06-04T16:14:28.819 INFO:teuthology.orchestra.run.smithi144.stderr: 54500K .......... .......... .......... .......... .......... 58% 111M 0s 2024-06-04T16:14:28.819 INFO:teuthology.orchestra.run.smithi144.stderr: 54550K .......... .......... .......... .......... .......... 58% 87.8M 0s 2024-06-04T16:14:28.820 INFO:teuthology.orchestra.run.smithi144.stderr: 54600K .......... .......... .......... .......... .......... 58% 70.8M 0s 2024-06-04T16:14:28.820 INFO:teuthology.orchestra.run.smithi144.stderr: 54650K .......... .......... .......... .......... .......... 58% 86.2M 0s 2024-06-04T16:14:28.820 INFO:teuthology.orchestra.run.smithi144.stderr: 54700K .......... .......... .......... .......... .......... 58% 115M 0s 2024-06-04T16:14:28.820 INFO:teuthology.orchestra.run.smithi144.stderr: 54750K .......... .......... .......... .......... .......... 58% 79.7M 0s 2024-06-04T16:14:28.820 INFO:teuthology.orchestra.run.smithi144.stderr: 54800K .......... .......... .......... .......... .......... 59% 112M 0s 2024-06-04T16:14:28.820 INFO:teuthology.orchestra.run.smithi144.stderr: 54850K .......... .......... .......... .......... .......... 59% 125M 0s 2024-06-04T16:14:28.820 INFO:teuthology.orchestra.run.smithi144.stderr: 54900K .......... .......... .......... .......... .......... 59% 110M 0s 2024-06-04T16:14:28.820 INFO:teuthology.orchestra.run.smithi144.stderr: 54950K .......... .......... .......... .......... .......... 59% 110M 0s 2024-06-04T16:14:28.820 INFO:teuthology.orchestra.run.smithi144.stderr: 55000K .......... .......... .......... .......... .......... 59% 118M 0s 2024-06-04T16:14:28.820 INFO:teuthology.orchestra.run.smithi144.stderr: 55050K .......... .......... .......... .......... .......... 59% 115M 0s 2024-06-04T16:14:28.820 INFO:teuthology.orchestra.run.smithi144.stderr: 55100K .......... .......... .......... .......... .......... 59% 106M 0s 2024-06-04T16:14:28.820 INFO:teuthology.orchestra.run.smithi144.stderr: 55150K .......... .......... .......... .......... .......... 59% 93.8M 0s 2024-06-04T16:14:28.820 INFO:teuthology.orchestra.run.smithi144.stderr: 55200K .......... .......... .......... .......... .......... 59% 116M 0s 2024-06-04T16:14:28.821 INFO:teuthology.orchestra.run.smithi144.stderr: 55250K .......... .......... .......... .......... .......... 59% 110M 0s 2024-06-04T16:14:28.821 INFO:teuthology.orchestra.run.smithi144.stderr: 55300K .......... .......... .......... .......... .......... 59% 121M 0s 2024-06-04T16:14:28.821 INFO:teuthology.orchestra.run.smithi144.stderr: 55350K .......... .......... .......... .......... .......... 59% 93.4M 0s 2024-06-04T16:14:28.821 INFO:teuthology.orchestra.run.smithi144.stderr: 55400K .......... .......... .......... .......... .......... 59% 124M 0s 2024-06-04T16:14:28.821 INFO:teuthology.orchestra.run.smithi144.stderr: 55450K .......... .......... .......... .......... .......... 59% 110M 0s 2024-06-04T16:14:28.821 INFO:teuthology.orchestra.run.smithi144.stderr: 55500K .......... .......... .......... .......... .......... 59% 128M 0s 2024-06-04T16:14:28.821 INFO:teuthology.orchestra.run.smithi144.stderr: 55550K .......... .......... .......... .......... .......... 59% 87.6M 0s 2024-06-04T16:14:28.821 INFO:teuthology.orchestra.run.smithi144.stderr: 55600K .......... .......... .......... .......... .......... 59% 111M 0s 2024-06-04T16:14:28.821 INFO:teuthology.orchestra.run.smithi144.stderr: 55650K .......... .......... .......... .......... .......... 59% 119M 0s 2024-06-04T16:14:28.821 INFO:teuthology.orchestra.run.smithi144.stderr: 55700K .......... .......... .......... .......... .......... 60% 114M 0s 2024-06-04T16:14:28.821 INFO:teuthology.orchestra.run.smithi144.stderr: 55750K .......... .......... .......... .......... .......... 60% 105M 0s 2024-06-04T16:14:28.821 INFO:teuthology.orchestra.run.smithi144.stderr: 55800K .......... .......... .......... .......... .......... 60% 119M 0s 2024-06-04T16:14:28.821 INFO:teuthology.orchestra.run.smithi144.stderr: 55850K .......... .......... .......... .......... .......... 60% 107M 0s 2024-06-04T16:14:28.822 INFO:teuthology.orchestra.run.smithi144.stderr: 55900K .......... .......... .......... .......... .......... 60% 117M 0s 2024-06-04T16:14:28.822 INFO:teuthology.orchestra.run.smithi144.stderr: 55950K .......... .......... .......... .......... .......... 60% 94.2M 0s 2024-06-04T16:14:28.822 INFO:teuthology.orchestra.run.smithi144.stderr: 56000K .......... .......... .......... .......... .......... 60% 103M 0s 2024-06-04T16:14:28.822 INFO:teuthology.orchestra.run.smithi144.stderr: 56050K .......... .......... .......... .......... .......... 60% 101M 0s 2024-06-04T16:14:28.822 INFO:teuthology.orchestra.run.smithi144.stderr: 56100K .......... .......... .......... .......... .......... 60% 153M 0s 2024-06-04T16:14:28.822 INFO:teuthology.orchestra.run.smithi144.stderr: 56150K .......... .......... .......... .......... .......... 60% 118M 0s 2024-06-04T16:14:28.822 INFO:teuthology.orchestra.run.smithi144.stderr: 56200K .......... .......... .......... .......... .......... 60% 109M 0s 2024-06-04T16:14:28.822 INFO:teuthology.orchestra.run.smithi144.stderr: 56250K .......... .......... .......... .......... .......... 60% 101M 0s 2024-06-04T16:14:28.822 INFO:teuthology.orchestra.run.smithi144.stderr: 56300K .......... .......... .......... .......... .......... 60% 102M 0s 2024-06-04T16:14:28.822 INFO:teuthology.orchestra.run.smithi144.stderr: 56350K .......... .......... .......... .......... .......... 60% 110M 0s 2024-06-04T16:14:28.822 INFO:teuthology.orchestra.run.smithi144.stderr: 56400K .......... .......... .......... .......... .......... 60% 106M 0s 2024-06-04T16:14:28.822 INFO:teuthology.orchestra.run.smithi144.stderr: 56450K .......... .......... .......... .......... .......... 60% 124M 0s 2024-06-04T16:14:28.822 INFO:teuthology.orchestra.run.smithi144.stderr: 56500K .......... .......... .......... .......... .......... 60% 92.0M 0s 2024-06-04T16:14:28.822 INFO:teuthology.orchestra.run.smithi144.stderr: 56550K .......... .......... .......... .......... .......... 60% 126M 0s 2024-06-04T16:14:28.823 INFO:teuthology.orchestra.run.smithi144.stderr: 56600K .......... .......... .......... .......... .......... 60% 108M 0s 2024-06-04T16:14:28.823 INFO:teuthology.orchestra.run.smithi144.stderr: 56650K .......... .......... .......... .......... .......... 61% 153M 0s 2024-06-04T16:14:28.823 INFO:teuthology.orchestra.run.smithi144.stderr: 56700K .......... .......... .......... .......... .......... 61% 77.3M 0s 2024-06-04T16:14:28.823 INFO:teuthology.orchestra.run.smithi144.stderr: 56750K .......... .......... .......... .......... .......... 61% 127M 0s 2024-06-04T16:14:28.823 INFO:teuthology.orchestra.run.smithi144.stderr: 56800K .......... .......... .......... .......... .......... 61% 122M 0s 2024-06-04T16:14:28.823 INFO:teuthology.orchestra.run.smithi144.stderr: 56850K .......... .......... .......... .......... .......... 61% 91.8M 0s 2024-06-04T16:14:28.823 INFO:teuthology.orchestra.run.smithi144.stderr: 56900K .......... .......... .......... .......... .......... 61% 144M 0s 2024-06-04T16:14:28.823 INFO:teuthology.orchestra.run.smithi144.stderr: 56950K .......... .......... .......... .......... .......... 61% 111M 0s 2024-06-04T16:14:28.823 INFO:teuthology.orchestra.run.smithi144.stderr: 57000K .......... .......... .......... .......... .......... 61% 102M 0s 2024-06-04T16:14:28.823 INFO:teuthology.orchestra.run.smithi144.stderr: 57050K .......... .......... .......... .......... .......... 61% 112M 0s 2024-06-04T16:14:28.823 INFO:teuthology.orchestra.run.smithi144.stderr: 57100K .......... .......... .......... .......... .......... 61% 90.6M 0s 2024-06-04T16:14:28.823 INFO:teuthology.orchestra.run.smithi144.stderr: 57150K .......... .......... .......... .......... .......... 61% 116M 0s 2024-06-04T16:14:28.823 INFO:teuthology.orchestra.run.smithi144.stderr: 57200K .......... .......... .......... .......... .......... 61% 105M 0s 2024-06-04T16:14:28.823 INFO:teuthology.orchestra.run.smithi144.stderr: 57250K .......... .......... .......... .......... .......... 61% 111M 0s 2024-06-04T16:14:28.824 INFO:teuthology.orchestra.run.smithi144.stderr: 57300K .......... .......... .......... .......... .......... 61% 120M 0s 2024-06-04T16:14:28.824 INFO:teuthology.orchestra.run.smithi144.stderr: 57350K .......... .......... .......... .......... .......... 61% 115M 0s 2024-06-04T16:14:28.824 INFO:teuthology.orchestra.run.smithi144.stderr: 57400K .......... .......... .......... .......... .......... 61% 114M 0s 2024-06-04T16:14:28.824 INFO:teuthology.orchestra.run.smithi144.stderr: 57450K .......... .......... .......... .......... .......... 61% 116M 0s 2024-06-04T16:14:28.824 INFO:teuthology.orchestra.run.smithi144.stderr: 57500K .......... .......... .......... .......... .......... 61% 74.0M 0s 2024-06-04T16:14:28.824 INFO:teuthology.orchestra.run.smithi144.stderr: 57550K .......... .......... .......... .......... .......... 62% 152M 0s 2024-06-04T16:14:28.824 INFO:teuthology.orchestra.run.smithi144.stderr: 57600K .......... .......... .......... .......... .......... 62% 108M 0s 2024-06-04T16:14:28.824 INFO:teuthology.orchestra.run.smithi144.stderr: 57650K .......... .......... .......... .......... .......... 62% 114M 0s 2024-06-04T16:14:28.824 INFO:teuthology.orchestra.run.smithi144.stderr: 57700K .......... .......... .......... .......... .......... 62% 109M 0s 2024-06-04T16:14:28.824 INFO:teuthology.orchestra.run.smithi144.stderr: 57750K .......... .......... .......... .......... .......... 62% 75.8M 0s 2024-06-04T16:14:28.824 INFO:teuthology.orchestra.run.smithi144.stderr: 57800K .......... .......... .......... .......... .......... 62% 111M 0s 2024-06-04T16:14:28.824 INFO:teuthology.orchestra.run.smithi144.stderr: 57850K .......... .......... .......... .......... .......... 62% 164M 0s 2024-06-04T16:14:28.824 INFO:teuthology.orchestra.run.smithi144.stderr: 57900K .......... .......... .......... .......... .......... 62% 98.4M 0s 2024-06-04T16:14:28.825 INFO:teuthology.orchestra.run.smithi144.stderr: 57950K .......... .......... .......... .......... .......... 62% 122M 0s 2024-06-04T16:14:28.825 INFO:teuthology.orchestra.run.smithi144.stderr: 58000K .......... .......... .......... .......... .......... 62% 114M 0s 2024-06-04T16:14:28.825 INFO:teuthology.orchestra.run.smithi144.stderr: 58050K .......... .......... .......... .......... .......... 62% 118M 0s 2024-06-04T16:14:28.825 INFO:teuthology.orchestra.run.smithi144.stderr: 58100K .......... .......... .......... .......... .......... 62% 107M 0s 2024-06-04T16:14:28.825 INFO:teuthology.orchestra.run.smithi144.stderr: 58150K .......... .......... .......... .......... .......... 62% 111M 0s 2024-06-04T16:14:28.825 INFO:teuthology.orchestra.run.smithi144.stderr: 58200K .......... .......... .......... .......... .......... 62% 118M 0s 2024-06-04T16:14:28.825 INFO:teuthology.orchestra.run.smithi144.stderr: 58250K .......... .......... .......... .......... .......... 62% 117M 0s 2024-06-04T16:14:28.825 INFO:teuthology.orchestra.run.smithi144.stderr: 58300K .......... .......... .......... .......... .......... 62% 90.0M 0s 2024-06-04T16:14:28.825 INFO:teuthology.orchestra.run.smithi144.stderr: 58350K .......... .......... .......... .......... .......... 62% 106M 0s 2024-06-04T16:14:28.825 INFO:teuthology.orchestra.run.smithi144.stderr: 58400K .......... .......... .......... .......... .......... 62% 115M 0s 2024-06-04T16:14:28.825 INFO:teuthology.orchestra.run.smithi144.stderr: 58450K .......... .......... .......... .......... .......... 62% 104M 0s 2024-06-04T16:14:28.825 INFO:teuthology.orchestra.run.smithi144.stderr: 58500K .......... .......... .......... .......... .......... 63% 115M 0s 2024-06-04T16:14:28.825 INFO:teuthology.orchestra.run.smithi144.stderr: 58550K .......... .......... .......... .......... .......... 63% 78.2M 0s 2024-06-04T16:14:28.825 INFO:teuthology.orchestra.run.smithi144.stderr: 58600K .......... .......... .......... .......... .......... 63% 111M 0s 2024-06-04T16:14:28.826 INFO:teuthology.orchestra.run.smithi144.stderr: 58650K .......... .......... .......... .......... .......... 63% 117M 0s 2024-06-04T16:14:28.826 INFO:teuthology.orchestra.run.smithi144.stderr: 58700K .......... .......... .......... .......... .......... 63% 87.8M 0s 2024-06-04T16:14:28.826 INFO:teuthology.orchestra.run.smithi144.stderr: 58750K .......... .......... .......... .......... .......... 63% 113M 0s 2024-06-04T16:14:28.826 INFO:teuthology.orchestra.run.smithi144.stderr: 58800K .......... .......... .......... .......... .......... 63% 109M 0s 2024-06-04T16:14:28.826 INFO:teuthology.orchestra.run.smithi144.stderr: 58850K .......... .......... .......... .......... .......... 63% 107M 0s 2024-06-04T16:14:28.826 INFO:teuthology.orchestra.run.smithi144.stderr: 58900K .......... .......... .......... .......... .......... 63% 116M 0s 2024-06-04T16:14:28.826 INFO:teuthology.orchestra.run.smithi144.stderr: 58950K .......... .......... .......... .......... .......... 63% 113M 0s 2024-06-04T16:14:28.826 INFO:teuthology.orchestra.run.smithi144.stderr: 59000K .......... .......... .......... .......... .......... 63% 113M 0s 2024-06-04T16:14:28.826 INFO:teuthology.orchestra.run.smithi144.stderr: 59050K .......... .......... .......... .......... .......... 63% 64.0M 0s 2024-06-04T16:14:28.826 INFO:teuthology.orchestra.run.smithi144.stderr: 59100K .......... .......... .......... .......... .......... 63% 65.6M 0s 2024-06-04T16:14:28.826 INFO:teuthology.orchestra.run.smithi144.stderr: 59150K .......... .......... .......... .......... .......... 63% 119M 0s 2024-06-04T16:14:28.826 INFO:teuthology.orchestra.run.smithi144.stderr: 59200K .......... .......... .......... .......... .......... 63% 86.6M 0s 2024-06-04T16:14:28.826 INFO:teuthology.orchestra.run.smithi144.stderr: 59250K .......... .......... .......... .......... .......... 63% 156M 0s 2024-06-04T16:14:28.826 INFO:teuthology.orchestra.run.smithi144.stderr: 59300K .......... .......... .......... .......... .......... 63% 106M 0s 2024-06-04T16:14:28.827 INFO:teuthology.orchestra.run.smithi144.stderr: 59350K .......... .......... .......... .......... .......... 63% 116M 0s 2024-06-04T16:14:28.827 INFO:teuthology.orchestra.run.smithi144.stderr: 59400K .......... .......... .......... .......... .......... 63% 120M 0s 2024-06-04T16:14:28.827 INFO:teuthology.orchestra.run.smithi144.stderr: 59450K .......... .......... .......... .......... .......... 64% 85.0M 0s 2024-06-04T16:14:28.827 INFO:teuthology.orchestra.run.smithi144.stderr: 59500K .......... .......... .......... .......... .......... 64% 97.1M 0s 2024-06-04T16:14:28.827 INFO:teuthology.orchestra.run.smithi144.stderr: 59550K .......... .......... .......... .......... .......... 64% 103M 0s 2024-06-04T16:14:28.827 INFO:teuthology.orchestra.run.smithi144.stderr: 59600K .......... .......... .......... .......... .......... 64% 111M 0s 2024-06-04T16:14:28.827 INFO:teuthology.orchestra.run.smithi144.stderr: 59650K .......... .......... .......... .......... .......... 64% 82.1M 0s 2024-06-04T16:14:28.827 INFO:teuthology.orchestra.run.smithi144.stderr: 59700K .......... .......... .......... .......... .......... 64% 80.5M 0s 2024-06-04T16:14:28.827 INFO:teuthology.orchestra.run.smithi144.stderr: 59750K .......... .......... .......... .......... .......... 64% 99.5M 0s 2024-06-04T16:14:28.827 INFO:teuthology.orchestra.run.smithi144.stderr: 59800K .......... .......... .......... .......... .......... 64% 71.4M 0s 2024-06-04T16:14:28.827 INFO:teuthology.orchestra.run.smithi144.stderr: 59850K .......... .......... .......... .......... .......... 64% 122M 0s 2024-06-04T16:14:28.827 INFO:teuthology.orchestra.run.smithi144.stderr: 59900K .......... .......... .......... .......... .......... 64% 76.0M 0s 2024-06-04T16:14:28.827 INFO:teuthology.orchestra.run.smithi144.stderr: 59950K .......... .......... .......... .......... .......... 64% 97.0M 0s 2024-06-04T16:14:28.827 INFO:teuthology.orchestra.run.smithi144.stderr: 60000K .......... .......... .......... .......... .......... 64% 82.1M 0s 2024-06-04T16:14:28.828 INFO:teuthology.orchestra.run.smithi144.stderr: 60050K .......... .......... .......... .......... .......... 64% 120M 0s 2024-06-04T16:14:28.828 INFO:teuthology.orchestra.run.smithi144.stderr: 60100K .......... .......... .......... .......... .......... 64% 86.5M 0s 2024-06-04T16:14:28.828 INFO:teuthology.orchestra.run.smithi144.stderr: 60150K .......... .......... .......... .......... .......... 64% 80.3M 0s 2024-06-04T16:14:28.828 INFO:teuthology.orchestra.run.smithi144.stderr: 60200K .......... .......... .......... .......... .......... 64% 60.8M 0s 2024-06-04T16:14:28.828 INFO:teuthology.orchestra.run.smithi144.stderr: 60250K .......... .......... .......... .......... .......... 64% 71.9M 0s 2024-06-04T16:14:28.828 INFO:teuthology.orchestra.run.smithi144.stderr: 60300K .......... .......... .......... .......... .......... 64% 69.6M 0s 2024-06-04T16:14:28.828 INFO:teuthology.orchestra.run.smithi144.stderr: 60350K .......... .......... .......... .......... .......... 65% 111M 0s 2024-06-04T16:14:28.828 INFO:teuthology.orchestra.run.smithi144.stderr: 60400K .......... .......... .......... .......... .......... 65% 66.6M 0s 2024-06-04T16:14:28.828 INFO:teuthology.orchestra.run.smithi144.stderr: 60450K .......... .......... .......... .......... .......... 65% 90.8M 0s 2024-06-04T16:14:28.828 INFO:teuthology.orchestra.run.smithi144.stderr: 60500K .......... .......... .......... .......... .......... 65% 81.8M 0s 2024-06-04T16:14:28.828 INFO:teuthology.orchestra.run.smithi144.stderr: 60550K .......... .......... .......... .......... .......... 65% 106M 0s 2024-06-04T16:14:28.828 INFO:teuthology.orchestra.run.smithi144.stderr: 60600K .......... .......... .......... .......... .......... 65% 71.1M 0s 2024-06-04T16:14:28.828 INFO:teuthology.orchestra.run.smithi144.stderr: 60650K .......... .......... .......... .......... .......... 65% 93.6M 0s 2024-06-04T16:14:28.828 INFO:teuthology.orchestra.run.smithi144.stderr: 60700K .......... .......... .......... .......... .......... 65% 84.2M 0s 2024-06-04T16:14:28.829 INFO:teuthology.orchestra.run.smithi144.stderr: 60750K .......... .......... .......... .......... .......... 65% 92.7M 0s 2024-06-04T16:14:28.829 INFO:teuthology.orchestra.run.smithi144.stderr: 60800K .......... .......... .......... .......... .......... 65% 111M 0s 2024-06-04T16:14:28.829 INFO:teuthology.orchestra.run.smithi144.stderr: 60850K .......... .......... .......... .......... .......... 65% 78.3M 0s 2024-06-04T16:14:28.829 INFO:teuthology.orchestra.run.smithi144.stderr: 60900K .......... .......... .......... .......... .......... 65% 93.5M 0s 2024-06-04T16:14:28.829 INFO:teuthology.orchestra.run.smithi144.stderr: 60950K .......... .......... .......... .......... .......... 65% 91.4M 0s 2024-06-04T16:14:28.829 INFO:teuthology.orchestra.run.smithi144.stderr: 61000K .......... .......... .......... .......... .......... 65% 59.5M 0s 2024-06-04T16:14:28.829 INFO:teuthology.orchestra.run.smithi144.stderr: 61050K .......... .......... .......... .......... .......... 65% 119M 0s 2024-06-04T16:14:28.829 INFO:teuthology.orchestra.run.smithi144.stderr: 61100K .......... .......... .......... .......... .......... 65% 84.8M 0s 2024-06-04T16:14:28.829 INFO:teuthology.orchestra.run.smithi144.stderr: 61150K .......... .......... .......... .......... .......... 65% 92.2M 0s 2024-06-04T16:14:28.829 INFO:teuthology.orchestra.run.smithi144.stderr: 61200K .......... .......... .......... .......... .......... 65% 72.4M 0s 2024-06-04T16:14:28.829 INFO:teuthology.orchestra.run.smithi144.stderr: 61250K .......... .......... .......... .......... .......... 65% 116M 0s 2024-06-04T16:14:28.829 INFO:teuthology.orchestra.run.smithi144.stderr: 61300K .......... .......... .......... .......... .......... 66% 60.5M 0s 2024-06-04T16:14:28.829 INFO:teuthology.orchestra.run.smithi144.stderr: 61350K .......... .......... .......... .......... .......... 66% 154M 0s 2024-06-04T16:14:28.829 INFO:teuthology.orchestra.run.smithi144.stderr: 61400K .......... .......... .......... .......... .......... 66% 68.4M 0s 2024-06-04T16:14:28.830 INFO:teuthology.orchestra.run.smithi144.stderr: 61450K .......... .......... .......... .......... .......... 66% 70.2M 0s 2024-06-04T16:14:28.830 INFO:teuthology.orchestra.run.smithi144.stderr: 61500K .......... .......... .......... .......... .......... 66% 154M 0s 2024-06-04T16:14:28.830 INFO:teuthology.orchestra.run.smithi144.stderr: 61550K .......... .......... .......... .......... .......... 66% 88.5M 0s 2024-06-04T16:14:28.830 INFO:teuthology.orchestra.run.smithi144.stderr: 61600K .......... .......... .......... .......... .......... 66% 79.5M 0s 2024-06-04T16:14:28.830 INFO:teuthology.orchestra.run.smithi144.stderr: 61650K .......... .......... .......... .......... .......... 66% 92.4M 0s 2024-06-04T16:14:28.830 INFO:teuthology.orchestra.run.smithi144.stderr: 61700K .......... .......... .......... .......... .......... 66% 117M 0s 2024-06-04T16:14:28.830 INFO:teuthology.orchestra.run.smithi144.stderr: 61750K .......... .......... .......... .......... .......... 66% 116M 0s 2024-06-04T16:14:28.830 INFO:teuthology.orchestra.run.smithi144.stderr: 61800K .......... .......... .......... .......... .......... 66% 87.4M 0s 2024-06-04T16:14:28.830 INFO:teuthology.orchestra.run.smithi144.stderr: 61850K .......... .......... .......... .......... .......... 66% 102M 0s 2024-06-04T16:14:28.830 INFO:teuthology.orchestra.run.smithi144.stderr: 61900K .......... .......... .......... .......... .......... 66% 95.1M 0s 2024-06-04T16:14:28.830 INFO:teuthology.orchestra.run.smithi144.stderr: 61950K .......... .......... .......... .......... .......... 66% 126M 0s 2024-06-04T16:14:28.830 INFO:teuthology.orchestra.run.smithi144.stderr: 62000K .......... .......... .......... .......... .......... 66% 97.4M 0s 2024-06-04T16:14:28.830 INFO:teuthology.orchestra.run.smithi144.stderr: 62050K .......... .......... .......... .......... .......... 66% 107M 0s 2024-06-04T16:14:28.831 INFO:teuthology.orchestra.run.smithi144.stderr: 62100K .......... .......... .......... .......... .......... 66% 117M 0s 2024-06-04T16:14:28.831 INFO:teuthology.orchestra.run.smithi144.stderr: 62150K .......... .......... .......... .......... .......... 66% 87.5M 0s 2024-06-04T16:14:28.831 INFO:teuthology.orchestra.run.smithi144.stderr: 62200K .......... .......... .......... .......... .......... 67% 111M 0s 2024-06-04T16:14:28.831 INFO:teuthology.orchestra.run.smithi144.stderr: 62250K .......... .......... .......... .......... .......... 67% 120M 0s 2024-06-04T16:14:28.831 INFO:teuthology.orchestra.run.smithi144.stderr: 62300K .......... .......... .......... .......... .......... 67% 113M 0s 2024-06-04T16:14:28.831 INFO:teuthology.orchestra.run.smithi144.stderr: 62350K .......... .......... .......... .......... .......... 67% 103M 0s 2024-06-04T16:14:28.831 INFO:teuthology.orchestra.run.smithi144.stderr: 62400K .......... .......... .......... .......... .......... 67% 127M 0s 2024-06-04T16:14:28.831 INFO:teuthology.orchestra.run.smithi144.stderr: 62450K .......... .......... .......... .......... .......... 67% 114M 0s 2024-06-04T16:14:28.831 INFO:teuthology.orchestra.run.smithi144.stderr: 62500K .......... .......... .......... .......... .......... 67% 90.3M 0s 2024-06-04T16:14:28.831 INFO:teuthology.orchestra.run.smithi144.stderr: 62550K .......... .......... .......... .......... .......... 67% 43.9M 0s 2024-06-04T16:14:28.831 INFO:teuthology.orchestra.run.smithi144.stderr: 62600K .......... .......... .......... .......... .......... 67% 89.5M 0s 2024-06-04T16:14:28.831 INFO:teuthology.orchestra.run.smithi144.stderr: 62650K .......... .......... .......... .......... .......... 67% 114M 0s 2024-06-04T16:14:28.831 INFO:teuthology.orchestra.run.smithi144.stderr: 62700K .......... .......... .......... .......... .......... 67% 118M 0s 2024-06-04T16:14:28.831 INFO:teuthology.orchestra.run.smithi144.stderr: 62750K .......... .......... .......... .......... .......... 67% 104M 0s 2024-06-04T16:14:28.832 INFO:teuthology.orchestra.run.smithi144.stderr: 62800K .......... .......... .......... .......... .......... 67% 117M 0s 2024-06-04T16:14:28.832 INFO:teuthology.orchestra.run.smithi144.stderr: 62850K .......... .......... .......... .......... .......... 67% 124M 0s 2024-06-04T16:14:28.832 INFO:teuthology.orchestra.run.smithi144.stderr: 62900K .......... .......... .......... .......... .......... 67% 108M 0s 2024-06-04T16:14:28.832 INFO:teuthology.orchestra.run.smithi144.stderr: 62950K .......... .......... .......... .......... .......... 67% 88.3M 0s 2024-06-04T16:14:28.832 INFO:teuthology.orchestra.run.smithi144.stderr: 63000K .......... .......... .......... .......... .......... 67% 107M 0s 2024-06-04T16:14:28.832 INFO:teuthology.orchestra.run.smithi144.stderr: 63050K .......... .......... .......... .......... .......... 67% 118M 0s 2024-06-04T16:14:28.832 INFO:teuthology.orchestra.run.smithi144.stderr: 63100K .......... .......... .......... .......... .......... 67% 91.4M 0s 2024-06-04T16:14:28.832 INFO:teuthology.orchestra.run.smithi144.stderr: 63150K .......... .......... .......... .......... .......... 68% 120M 0s 2024-06-04T16:14:28.832 INFO:teuthology.orchestra.run.smithi144.stderr: 63200K .......... .......... .......... .......... .......... 68% 107M 0s 2024-06-04T16:14:28.832 INFO:teuthology.orchestra.run.smithi144.stderr: 63250K .......... .......... .......... .......... .......... 68% 113M 0s 2024-06-04T16:14:28.832 INFO:teuthology.orchestra.run.smithi144.stderr: 63300K .......... .......... .......... .......... .......... 68% 119M 0s 2024-06-04T16:14:28.832 INFO:teuthology.orchestra.run.smithi144.stderr: 63350K .......... .......... .......... .......... .......... 68% 88.6M 0s 2024-06-04T16:14:28.832 INFO:teuthology.orchestra.run.smithi144.stderr: 63400K .......... .......... .......... .......... .......... 68% 115M 0s 2024-06-04T16:14:28.832 INFO:teuthology.orchestra.run.smithi144.stderr: 63450K .......... .......... .......... .......... .......... 68% 101M 0s 2024-06-04T16:14:28.833 INFO:teuthology.orchestra.run.smithi144.stderr: 63500K .......... .......... .......... .......... .......... 68% 133M 0s 2024-06-04T16:14:28.833 INFO:teuthology.orchestra.run.smithi144.stderr: 63550K .......... .......... .......... .......... .......... 68% 108M 0s 2024-06-04T16:14:28.833 INFO:teuthology.orchestra.run.smithi144.stderr: 63600K .......... .......... .......... .......... .......... 68% 115M 0s 2024-06-04T16:14:28.833 INFO:teuthology.orchestra.run.smithi144.stderr: 63650K .......... .......... .......... .......... .......... 68% 116M 0s 2024-06-04T16:14:28.833 INFO:teuthology.orchestra.run.smithi144.stderr: 63700K .......... .......... .......... .......... .......... 68% 103M 0s 2024-06-04T16:14:28.833 INFO:teuthology.orchestra.run.smithi144.stderr: 63750K .......... .......... .......... .......... .......... 68% 80.7M 0s 2024-06-04T16:14:28.833 INFO:teuthology.orchestra.run.smithi144.stderr: 63800K .......... .......... .......... .......... .......... 68% 115M 0s 2024-06-04T16:14:28.833 INFO:teuthology.orchestra.run.smithi144.stderr: 63850K .......... .......... .......... .......... .......... 68% 107M 0s 2024-06-04T16:14:28.833 INFO:teuthology.orchestra.run.smithi144.stderr: 63900K .......... .......... .......... .......... .......... 68% 135M 0s 2024-06-04T16:14:28.833 INFO:teuthology.orchestra.run.smithi144.stderr: 63950K .......... .......... .......... .......... .......... 68% 115M 0s 2024-06-04T16:14:28.833 INFO:teuthology.orchestra.run.smithi144.stderr: 64000K .......... .......... .......... .......... .......... 68% 100M 0s 2024-06-04T16:14:28.833 INFO:teuthology.orchestra.run.smithi144.stderr: 64050K .......... .......... .......... .......... .......... 68% 129M 0s 2024-06-04T16:14:28.833 INFO:teuthology.orchestra.run.smithi144.stderr: 64100K .......... .......... .......... .......... .......... 69% 109M 0s 2024-06-04T16:14:28.833 INFO:teuthology.orchestra.run.smithi144.stderr: 64150K .......... .......... .......... .......... .......... 69% 84.4M 0s 2024-06-04T16:14:28.834 INFO:teuthology.orchestra.run.smithi144.stderr: 64200K .......... .......... .......... .......... .......... 69% 117M 0s 2024-06-04T16:14:28.834 INFO:teuthology.orchestra.run.smithi144.stderr: 64250K .......... .......... .......... .......... .......... 69% 77.4M 0s 2024-06-04T16:14:28.834 INFO:teuthology.orchestra.run.smithi144.stderr: 64300K .......... .......... .......... .......... .......... 69% 115M 0s 2024-06-04T16:14:28.834 INFO:teuthology.orchestra.run.smithi144.stderr: 64350K .......... .......... .......... .......... .......... 69% 118M 0s 2024-06-04T16:14:28.834 INFO:teuthology.orchestra.run.smithi144.stderr: 64400K .......... .......... .......... .......... .......... 69% 112M 0s 2024-06-04T16:14:28.834 INFO:teuthology.orchestra.run.smithi144.stderr: 64450K .......... .......... .......... .......... .......... 69% 114M 0s 2024-06-04T16:14:28.834 INFO:teuthology.orchestra.run.smithi144.stderr: 64500K .......... .......... .......... .......... .......... 69% 83.9M 0s 2024-06-04T16:14:28.834 INFO:teuthology.orchestra.run.smithi144.stderr: 64550K .......... .......... .......... .......... .......... 69% 121M 0s 2024-06-04T16:14:28.834 INFO:teuthology.orchestra.run.smithi144.stderr: 64600K .......... .......... .......... .......... .......... 69% 100M 0s 2024-06-04T16:14:28.834 INFO:teuthology.orchestra.run.smithi144.stderr: 64650K .......... .......... .......... .......... .......... 69% 135M 0s 2024-06-04T16:14:28.834 INFO:teuthology.orchestra.run.smithi144.stderr: 64700K .......... .......... .......... .......... .......... 69% 103M 0s 2024-06-04T16:14:28.834 INFO:teuthology.orchestra.run.smithi144.stderr: 64750K .......... .......... .......... .......... .......... 69% 120M 0s 2024-06-04T16:14:28.834 INFO:teuthology.orchestra.run.smithi144.stderr: 64800K .......... .......... .......... .......... .......... 69% 108M 0s 2024-06-04T16:14:28.834 INFO:teuthology.orchestra.run.smithi144.stderr: 64850K .......... .......... .......... .......... .......... 69% 96.5M 0s 2024-06-04T16:14:28.835 INFO:teuthology.orchestra.run.smithi144.stderr: 64900K .......... .......... .......... .......... .......... 69% 77.6M 0s 2024-06-04T16:14:28.835 INFO:teuthology.orchestra.run.smithi144.stderr: 64950K .......... .......... .......... .......... .......... 69% 126M 0s 2024-06-04T16:14:28.835 INFO:teuthology.orchestra.run.smithi144.stderr: 65000K .......... .......... .......... .......... .......... 70% 115M 0s 2024-06-04T16:14:28.835 INFO:teuthology.orchestra.run.smithi144.stderr: 65050K .......... .......... .......... .......... .......... 70% 93.3M 0s 2024-06-04T16:14:28.835 INFO:teuthology.orchestra.run.smithi144.stderr: 65100K .......... .......... .......... .......... .......... 70% 160M 0s 2024-06-04T16:14:28.835 INFO:teuthology.orchestra.run.smithi144.stderr: 65150K .......... .......... .......... .......... .......... 70% 87.2M 0s 2024-06-04T16:14:28.835 INFO:teuthology.orchestra.run.smithi144.stderr: 65200K .......... .......... .......... .......... .......... 70% 117M 0s 2024-06-04T16:14:28.835 INFO:teuthology.orchestra.run.smithi144.stderr: 65250K .......... .......... .......... .......... .......... 70% 85.8M 0s 2024-06-04T16:14:28.835 INFO:teuthology.orchestra.run.smithi144.stderr: 65300K .......... .......... .......... .......... .......... 70% 72.9M 0s 2024-06-04T16:14:28.835 INFO:teuthology.orchestra.run.smithi144.stderr: 65350K .......... .......... .......... .......... .......... 70% 87.4M 0s 2024-06-04T16:14:28.835 INFO:teuthology.orchestra.run.smithi144.stderr: 65400K .......... .......... .......... .......... .......... 70% 95.7M 0s 2024-06-04T16:14:28.835 INFO:teuthology.orchestra.run.smithi144.stderr: 65450K .......... .......... .......... .......... .......... 70% 108M 0s 2024-06-04T16:14:28.835 INFO:teuthology.orchestra.run.smithi144.stderr: 65500K .......... .......... .......... .......... .......... 70% 62.9M 0s 2024-06-04T16:14:28.835 INFO:teuthology.orchestra.run.smithi144.stderr: 65550K .......... .......... .......... .......... .......... 70% 78.0M 0s 2024-06-04T16:14:28.836 INFO:teuthology.orchestra.run.smithi144.stderr: 65600K .......... .......... .......... .......... .......... 70% 116M 0s 2024-06-04T16:14:28.836 INFO:teuthology.orchestra.run.smithi144.stderr: 65650K .......... .......... .......... .......... .......... 70% 118M 0s 2024-06-04T16:14:28.836 INFO:teuthology.orchestra.run.smithi144.stderr: 65700K .......... .......... .......... .......... .......... 70% 50.0M 0s 2024-06-04T16:14:28.836 INFO:teuthology.orchestra.run.smithi144.stderr: 65750K .......... .......... .......... .......... .......... 70% 84.0M 0s 2024-06-04T16:14:28.836 INFO:teuthology.orchestra.run.smithi144.stderr: 65800K .......... .......... .......... .......... .......... 70% 79.8M 0s 2024-06-04T16:14:28.836 INFO:teuthology.orchestra.run.smithi144.stderr: 65850K .......... .......... .......... .......... .......... 70% 82.5M 0s 2024-06-04T16:14:28.836 INFO:teuthology.orchestra.run.smithi144.stderr: 65900K .......... .......... .......... .......... .......... 70% 109M 0s 2024-06-04T16:14:28.836 INFO:teuthology.orchestra.run.smithi144.stderr: 65950K .......... .......... .......... .......... .......... 71% 41.1M 0s 2024-06-04T16:14:28.836 INFO:teuthology.orchestra.run.smithi144.stderr: 66000K .......... .......... .......... .......... .......... 71% 71.3M 0s 2024-06-04T16:14:28.836 INFO:teuthology.orchestra.run.smithi144.stderr: 66050K .......... .......... .......... .......... .......... 71% 58.6M 0s 2024-06-04T16:14:28.836 INFO:teuthology.orchestra.run.smithi144.stderr: 66100K .......... .......... .......... .......... .......... 71% 59.0M 0s 2024-06-04T16:14:28.836 INFO:teuthology.orchestra.run.smithi144.stderr: 66150K .......... .......... .......... .......... .......... 71% 111M 0s 2024-06-04T16:14:28.836 INFO:teuthology.orchestra.run.smithi144.stderr: 66200K .......... .......... .......... .......... .......... 71% 121M 0s 2024-06-04T16:14:28.836 INFO:teuthology.orchestra.run.smithi144.stderr: 66250K .......... .......... .......... .......... .......... 71% 86.3M 0s 2024-06-04T16:14:28.837 INFO:teuthology.orchestra.run.smithi144.stderr: 66300K .......... .......... .......... .......... .......... 71% 90.3M 0s 2024-06-04T16:14:28.837 INFO:teuthology.orchestra.run.smithi144.stderr: 66350K .......... .......... .......... .......... .......... 71% 122M 0s 2024-06-04T16:14:28.837 INFO:teuthology.orchestra.run.smithi144.stderr: 66400K .......... .......... .......... .......... .......... 71% 113M 0s 2024-06-04T16:14:28.837 INFO:teuthology.orchestra.run.smithi144.stderr: 66450K .......... .......... .......... .......... .......... 71% 78.9M 0s 2024-06-04T16:14:28.837 INFO:teuthology.orchestra.run.smithi144.stderr: 66500K .......... .......... .......... .......... .......... 71% 58.4M 0s 2024-06-04T16:14:28.837 INFO:teuthology.orchestra.run.smithi144.stderr: 66550K .......... .......... .......... .......... .......... 71% 120M 0s 2024-06-04T16:14:28.837 INFO:teuthology.orchestra.run.smithi144.stderr: 66600K .......... .......... .......... .......... .......... 71% 71.3M 0s 2024-06-04T16:14:28.837 INFO:teuthology.orchestra.run.smithi144.stderr: 66650K .......... .......... .......... .......... .......... 71% 127M 0s 2024-06-04T16:14:28.837 INFO:teuthology.orchestra.run.smithi144.stderr: 66700K .......... .......... .......... .......... .......... 71% 102M 0s 2024-06-04T16:14:28.837 INFO:teuthology.orchestra.run.smithi144.stderr: 66750K .......... .......... .......... .......... .......... 71% 76.0M 0s 2024-06-04T16:14:28.837 INFO:teuthology.orchestra.run.smithi144.stderr: 66800K .......... .......... .......... .......... .......... 71% 72.4M 0s 2024-06-04T16:14:28.837 INFO:teuthology.orchestra.run.smithi144.stderr: 66850K .......... .......... .......... .......... .......... 72% 115M 0s 2024-06-04T16:14:28.837 INFO:teuthology.orchestra.run.smithi144.stderr: 66900K .......... .......... .......... .......... .......... 72% 88.1M 0s 2024-06-04T16:14:28.837 INFO:teuthology.orchestra.run.smithi144.stderr: 66950K .......... .......... .......... .......... .......... 72% 72.4M 0s 2024-06-04T16:14:28.837 INFO:teuthology.orchestra.run.smithi144.stderr: 67000K .......... .......... .......... .......... .......... 72% 87.4M 0s 2024-06-04T16:14:28.838 INFO:teuthology.orchestra.run.smithi144.stderr: 67050K .......... .......... .......... .......... .......... 72% 54.9M 0s 2024-06-04T16:14:28.838 INFO:teuthology.orchestra.run.smithi144.stderr: 67100K .......... .......... .......... .......... .......... 72% 306M 0s 2024-06-04T16:14:28.838 INFO:teuthology.orchestra.run.smithi144.stderr: 67150K .......... .......... .......... .......... .......... 72% 192M 0s 2024-06-04T16:14:28.838 INFO:teuthology.orchestra.run.smithi144.stderr: 67200K .......... .......... .......... .......... .......... 72% 66.8M 0s 2024-06-04T16:14:28.838 INFO:teuthology.orchestra.run.smithi144.stderr: 67250K .......... .......... .......... .......... .......... 72% 73.2M 0s 2024-06-04T16:14:28.838 INFO:teuthology.orchestra.run.smithi144.stderr: 67300K .......... .......... .......... .......... .......... 72% 74.3M 0s 2024-06-04T16:14:28.838 INFO:teuthology.orchestra.run.smithi144.stderr: 67350K .......... .......... .......... .......... .......... 72% 117M 0s 2024-06-04T16:14:28.838 INFO:teuthology.orchestra.run.smithi144.stderr: 67400K .......... .......... .......... .......... .......... 72% 120M 0s 2024-06-04T16:14:28.838 INFO:teuthology.orchestra.run.smithi144.stderr: 67450K .......... .......... .......... .......... .......... 72% 89.6M 0s 2024-06-04T16:14:28.838 INFO:teuthology.orchestra.run.smithi144.stderr: 67500K .......... .......... .......... .......... .......... 72% 109M 0s 2024-06-04T16:14:28.838 INFO:teuthology.orchestra.run.smithi144.stderr: 67550K .......... .......... .......... .......... .......... 72% 119M 0s 2024-06-04T16:14:28.838 INFO:teuthology.orchestra.run.smithi144.stderr: 67600K .......... .......... .......... .......... .......... 72% 115M 0s 2024-06-04T16:14:28.838 INFO:teuthology.orchestra.run.smithi144.stderr: 67650K .......... .......... .......... .......... .......... 72% 117M 0s 2024-06-04T16:14:28.839 INFO:teuthology.orchestra.run.smithi144.stderr: 67700K .......... .......... .......... .......... .......... 72% 87.7M 0s 2024-06-04T16:14:28.839 INFO:teuthology.orchestra.run.smithi144.stderr: 67750K .......... .......... .......... .......... .......... 72% 110M 0s 2024-06-04T16:14:28.839 INFO:teuthology.orchestra.run.smithi144.stderr: 67800K .......... .......... .......... .......... .......... 73% 118M 0s 2024-06-04T16:14:28.839 INFO:teuthology.orchestra.run.smithi144.stderr: 67850K .......... .......... .......... .......... .......... 73% 114M 0s 2024-06-04T16:14:28.839 INFO:teuthology.orchestra.run.smithi144.stderr: 67900K .......... .......... .......... .......... .......... 73% 107M 0s 2024-06-04T16:14:28.839 INFO:teuthology.orchestra.run.smithi144.stderr: 67950K .......... .......... .......... .......... .......... 73% 114M 0s 2024-06-04T16:14:28.839 INFO:teuthology.orchestra.run.smithi144.stderr: 68000K .......... .......... .......... .......... .......... 73% 117M 0s 2024-06-04T16:14:28.839 INFO:teuthology.orchestra.run.smithi144.stderr: 68050K .......... .......... .......... .......... .......... 73% 110M 0s 2024-06-04T16:14:28.839 INFO:teuthology.orchestra.run.smithi144.stderr: 68100K .......... .......... .......... .......... .......... 73% 85.1M 0s 2024-06-04T16:14:28.839 INFO:teuthology.orchestra.run.smithi144.stderr: 68150K .......... .......... .......... .......... .......... 73% 117M 0s 2024-06-04T16:14:28.839 INFO:teuthology.orchestra.run.smithi144.stderr: 68200K .......... .......... .......... .......... .......... 73% 113M 0s 2024-06-04T16:14:28.839 INFO:teuthology.orchestra.run.smithi144.stderr: 68250K .......... .......... .......... .......... .......... 73% 134M 0s 2024-06-04T16:14:28.839 INFO:teuthology.orchestra.run.smithi144.stderr: 68300K .......... .......... .......... .......... .......... 73% 114M 0s 2024-06-04T16:14:28.839 INFO:teuthology.orchestra.run.smithi144.stderr: 68350K .......... .......... .......... .......... .......... 73% 84.7M 0s 2024-06-04T16:14:28.840 INFO:teuthology.orchestra.run.smithi144.stderr: 68400K .......... .......... .......... .......... .......... 73% 128M 0s 2024-06-04T16:14:28.840 INFO:teuthology.orchestra.run.smithi144.stderr: 68450K .......... .......... .......... .......... .......... 73% 108M 0s 2024-06-04T16:14:28.840 INFO:teuthology.orchestra.run.smithi144.stderr: 68500K .......... .......... .......... .......... .......... 73% 119M 0s 2024-06-04T16:14:28.840 INFO:teuthology.orchestra.run.smithi144.stderr: 68550K .......... .......... .......... .......... .......... 73% 116M 0s 2024-06-04T16:14:28.840 INFO:teuthology.orchestra.run.smithi144.stderr: 68600K .......... .......... .......... .......... .......... 73% 74.3M 0s 2024-06-04T16:14:28.840 INFO:teuthology.orchestra.run.smithi144.stderr: 68650K .......... .......... .......... .......... .......... 73% 111M 0s 2024-06-04T16:14:28.840 INFO:teuthology.orchestra.run.smithi144.stderr: 68700K .......... .......... .......... .......... .......... 74% 106M 0s 2024-06-04T16:14:28.840 INFO:teuthology.orchestra.run.smithi144.stderr: 68750K .......... .......... .......... .......... .......... 74% 94.9M 0s 2024-06-04T16:14:28.840 INFO:teuthology.orchestra.run.smithi144.stderr: 68800K .......... .......... .......... .......... .......... 74% 91.6M 0s 2024-06-04T16:14:28.840 INFO:teuthology.orchestra.run.smithi144.stderr: 68850K .......... .......... .......... .......... .......... 74% 102M 0s 2024-06-04T16:14:28.840 INFO:teuthology.orchestra.run.smithi144.stderr: 68900K .......... .......... .......... .......... .......... 74% 113M 0s 2024-06-04T16:14:28.840 INFO:teuthology.orchestra.run.smithi144.stderr: 68950K .......... .......... .......... .......... .......... 74% 97.0M 0s 2024-06-04T16:14:28.840 INFO:teuthology.orchestra.run.smithi144.stderr: 69000K .......... .......... .......... .......... .......... 74% 137M 0s 2024-06-04T16:14:28.840 INFO:teuthology.orchestra.run.smithi144.stderr: 69050K .......... .......... .......... .......... .......... 74% 111M 0s 2024-06-04T16:14:28.840 INFO:teuthology.orchestra.run.smithi144.stderr: 69100K .......... .......... .......... .......... .......... 74% 110M 0s 2024-06-04T16:14:28.841 INFO:teuthology.orchestra.run.smithi144.stderr: 69150K .......... .......... .......... .......... .......... 74% 80.9M 0s 2024-06-04T16:14:28.841 INFO:teuthology.orchestra.run.smithi144.stderr: 69200K .......... .......... .......... .......... .......... 74% 127M 0s 2024-06-04T16:14:28.841 INFO:teuthology.orchestra.run.smithi144.stderr: 69250K .......... .......... .......... .......... .......... 74% 120M 0s 2024-06-04T16:14:28.841 INFO:teuthology.orchestra.run.smithi144.stderr: 69300K .......... .......... .......... .......... .......... 74% 105M 0s 2024-06-04T16:14:28.841 INFO:teuthology.orchestra.run.smithi144.stderr: 69350K .......... .......... .......... .......... .......... 74% 105M 0s 2024-06-04T16:14:28.841 INFO:teuthology.orchestra.run.smithi144.stderr: 69400K .......... .......... .......... .......... .......... 74% 117M 0s 2024-06-04T16:14:28.841 INFO:teuthology.orchestra.run.smithi144.stderr: 69450K .......... .......... .......... .......... .......... 74% 62.3M 0s 2024-06-04T16:14:28.841 INFO:teuthology.orchestra.run.smithi144.stderr: 69500K .......... .......... .......... .......... .......... 74% 64.4M 0s 2024-06-04T16:14:28.841 INFO:teuthology.orchestra.run.smithi144.stderr: 69550K .......... .......... .......... .......... .......... 74% 90.0M 0s 2024-06-04T16:14:28.841 INFO:teuthology.orchestra.run.smithi144.stderr: 69600K .......... .......... .......... .......... .......... 74% 85.2M 0s 2024-06-04T16:14:28.841 INFO:teuthology.orchestra.run.smithi144.stderr: 69650K .......... .......... .......... .......... .......... 75% 117M 0s 2024-06-04T16:14:28.841 INFO:teuthology.orchestra.run.smithi144.stderr: 69700K .......... .......... .......... .......... .......... 75% 106M 0s 2024-06-04T16:14:28.841 INFO:teuthology.orchestra.run.smithi144.stderr: 69750K .......... .......... .......... .......... .......... 75% 110M 0s 2024-06-04T16:14:28.841 INFO:teuthology.orchestra.run.smithi144.stderr: 69800K .......... .......... .......... .......... .......... 75% 114M 0s 2024-06-04T16:14:28.841 INFO:teuthology.orchestra.run.smithi144.stderr: 69850K .......... .......... .......... .......... .......... 75% 117M 0s 2024-06-04T16:14:28.842 INFO:teuthology.orchestra.run.smithi144.stderr: 69900K .......... .......... .......... .......... .......... 75% 102M 0s 2024-06-04T16:14:28.842 INFO:teuthology.orchestra.run.smithi144.stderr: 69950K .......... .......... .......... .......... .......... 75% 88.7M 0s 2024-06-04T16:14:28.842 INFO:teuthology.orchestra.run.smithi144.stderr: 70000K .......... .......... .......... .......... .......... 75% 74.9M 0s 2024-06-04T16:14:28.842 INFO:teuthology.orchestra.run.smithi144.stderr: 70050K .......... .......... .......... .......... .......... 75% 112M 0s 2024-06-04T16:14:28.842 INFO:teuthology.orchestra.run.smithi144.stderr: 70100K .......... .......... .......... .......... .......... 75% 113M 0s 2024-06-04T16:14:28.842 INFO:teuthology.orchestra.run.smithi144.stderr: 70150K .......... .......... .......... .......... .......... 75% 110M 0s 2024-06-04T16:14:28.842 INFO:teuthology.orchestra.run.smithi144.stderr: 70200K .......... .......... .......... .......... .......... 75% 61.2M 0s 2024-06-04T16:14:28.842 INFO:teuthology.orchestra.run.smithi144.stderr: 70250K .......... .......... .......... .......... .......... 75% 82.1M 0s 2024-06-04T16:14:28.842 INFO:teuthology.orchestra.run.smithi144.stderr: 70300K .......... .......... .......... .......... .......... 75% 94.8M 0s 2024-06-04T16:14:28.842 INFO:teuthology.orchestra.run.smithi144.stderr: 70350K .......... .......... .......... .......... .......... 75% 94.3M 0s 2024-06-04T16:14:28.842 INFO:teuthology.orchestra.run.smithi144.stderr: 70400K .......... .......... .......... .......... .......... 75% 131M 0s 2024-06-04T16:14:28.842 INFO:teuthology.orchestra.run.smithi144.stderr: 70450K .......... .......... .......... .......... .......... 75% 108M 0s 2024-06-04T16:14:28.842 INFO:teuthology.orchestra.run.smithi144.stderr: 70500K .......... .......... .......... .......... .......... 75% 119M 0s 2024-06-04T16:14:28.842 INFO:teuthology.orchestra.run.smithi144.stderr: 70550K .......... .......... .......... .......... .......... 75% 102M 0s 2024-06-04T16:14:28.843 INFO:teuthology.orchestra.run.smithi144.stderr: 70600K .......... .......... .......... .......... .......... 76% 117M 0s 2024-06-04T16:14:28.843 INFO:teuthology.orchestra.run.smithi144.stderr: 70650K .......... .......... .......... .......... .......... 76% 106M 0s 2024-06-04T16:14:28.843 INFO:teuthology.orchestra.run.smithi144.stderr: 70700K .......... .......... .......... .......... .......... 76% 119M 0s 2024-06-04T16:14:28.843 INFO:teuthology.orchestra.run.smithi144.stderr: 70750K .......... .......... .......... .......... .......... 76% 89.6M 0s 2024-06-04T16:14:28.843 INFO:teuthology.orchestra.run.smithi144.stderr: 70800K .......... .......... .......... .......... .......... 76% 117M 0s 2024-06-04T16:14:28.843 INFO:teuthology.orchestra.run.smithi144.stderr: 70850K .......... .......... .......... .......... .......... 76% 115M 0s 2024-06-04T16:14:28.843 INFO:teuthology.orchestra.run.smithi144.stderr: 70900K .......... .......... .......... .......... .......... 76% 92.1M 0s 2024-06-04T16:14:28.843 INFO:teuthology.orchestra.run.smithi144.stderr: 70950K .......... .......... .......... .......... .......... 76% 80.0M 0s 2024-06-04T16:14:28.843 INFO:teuthology.orchestra.run.smithi144.stderr: 71000K .......... .......... .......... .......... .......... 76% 82.7M 0s 2024-06-04T16:14:28.843 INFO:teuthology.orchestra.run.smithi144.stderr: 71050K .......... .......... .......... .......... .......... 76% 102M 0s 2024-06-04T16:14:28.843 INFO:teuthology.orchestra.run.smithi144.stderr: 71100K .......... .......... .......... .......... .......... 76% 126M 0s 2024-06-04T16:14:28.843 INFO:teuthology.orchestra.run.smithi144.stderr: 71150K .......... .......... .......... .......... .......... 76% 73.5M 0s 2024-06-04T16:14:28.843 INFO:teuthology.orchestra.run.smithi144.stderr: 71200K .......... .......... .......... .......... .......... 76% 67.7M 0s 2024-06-04T16:14:28.843 INFO:teuthology.orchestra.run.smithi144.stderr: 71250K .......... .......... .......... .......... .......... 76% 115M 0s 2024-06-04T16:14:28.843 INFO:teuthology.orchestra.run.smithi144.stderr: 71300K .......... .......... .......... .......... .......... 76% 120M 0s 2024-06-04T16:14:28.844 INFO:teuthology.orchestra.run.smithi144.stderr: 71350K .......... .......... .......... .......... .......... 76% 70.3M 0s 2024-06-04T16:14:28.844 INFO:teuthology.orchestra.run.smithi144.stderr: 71400K .......... .......... .......... .......... .......... 76% 44.4M 0s 2024-06-04T16:14:28.844 INFO:teuthology.orchestra.run.smithi144.stderr: 71450K .......... .......... .......... .......... .......... 76% 119M 0s 2024-06-04T16:14:28.844 INFO:teuthology.orchestra.run.smithi144.stderr: 71500K .......... .......... .......... .......... .......... 77% 115M 0s 2024-06-04T16:14:28.844 INFO:teuthology.orchestra.run.smithi144.stderr: 71550K .......... .......... .......... .......... .......... 77% 74.9M 0s 2024-06-04T16:14:28.844 INFO:teuthology.orchestra.run.smithi144.stderr: 71600K .......... .......... .......... .......... .......... 77% 90.2M 0s 2024-06-04T16:14:28.844 INFO:teuthology.orchestra.run.smithi144.stderr: 71650K .......... .......... .......... .......... .......... 77% 76.9M 0s 2024-06-04T16:14:28.844 INFO:teuthology.orchestra.run.smithi144.stderr: 71700K .......... .......... .......... .......... .......... 77% 101M 0s 2024-06-04T16:14:28.844 INFO:teuthology.orchestra.run.smithi144.stderr: 71750K .......... .......... .......... .......... .......... 77% 110M 0s 2024-06-04T16:14:28.844 INFO:teuthology.orchestra.run.smithi144.stderr: 71800K .......... .......... .......... .......... .......... 77% 96.0M 0s 2024-06-04T16:14:28.844 INFO:teuthology.orchestra.run.smithi144.stderr: 71850K .......... .......... .......... .......... .......... 77% 92.3M 0s 2024-06-04T16:14:28.844 INFO:teuthology.orchestra.run.smithi144.stderr: 71900K .......... .......... .......... .......... .......... 77% 109M 0s 2024-06-04T16:14:28.844 INFO:teuthology.orchestra.run.smithi144.stderr: 71950K .......... .......... .......... .......... .......... 77% 62.7M 0s 2024-06-04T16:14:28.844 INFO:teuthology.orchestra.run.smithi144.stderr: 72000K .......... .......... .......... .......... .......... 77% 132M 0s 2024-06-04T16:14:28.845 INFO:teuthology.orchestra.run.smithi144.stderr: 72050K .......... .......... .......... .......... .......... 77% 114M 0s 2024-06-04T16:14:28.845 INFO:teuthology.orchestra.run.smithi144.stderr: 72100K .......... .......... .......... .......... .......... 77% 78.2M 0s 2024-06-04T16:14:28.845 INFO:teuthology.orchestra.run.smithi144.stderr: 72150K .......... .......... .......... .......... .......... 77% 105M 0s 2024-06-04T16:14:28.845 INFO:teuthology.orchestra.run.smithi144.stderr: 72200K .......... .......... .......... .......... .......... 77% 116M 0s 2024-06-04T16:14:28.845 INFO:teuthology.orchestra.run.smithi144.stderr: 72250K .......... .......... .......... .......... .......... 77% 100M 0s 2024-06-04T16:14:28.845 INFO:teuthology.orchestra.run.smithi144.stderr: 72300K .......... .......... .......... .......... .......... 77% 126M 0s 2024-06-04T16:14:28.845 INFO:teuthology.orchestra.run.smithi144.stderr: 72350K .......... .......... .......... .......... .......... 77% 75.9M 0s 2024-06-04T16:14:28.845 INFO:teuthology.orchestra.run.smithi144.stderr: 72400K .......... .......... .......... .......... .......... 77% 95.0M 0s 2024-06-04T16:14:28.845 INFO:teuthology.orchestra.run.smithi144.stderr: 72450K .......... .......... .......... .......... .......... 78% 114M 0s 2024-06-04T16:14:28.845 INFO:teuthology.orchestra.run.smithi144.stderr: 72500K .......... .......... .......... .......... .......... 78% 68.9M 0s 2024-06-04T16:14:28.845 INFO:teuthology.orchestra.run.smithi144.stderr: 72550K .......... .......... .......... .......... .......... 78% 117M 0s 2024-06-04T16:14:28.845 INFO:teuthology.orchestra.run.smithi144.stderr: 72600K .......... .......... .......... .......... .......... 78% 78.7M 0s 2024-06-04T16:14:28.845 INFO:teuthology.orchestra.run.smithi144.stderr: 72650K .......... .......... .......... .......... .......... 78% 84.5M 0s 2024-06-04T16:14:28.845 INFO:teuthology.orchestra.run.smithi144.stderr: 72700K .......... .......... .......... .......... .......... 78% 122M 0s 2024-06-04T16:14:28.846 INFO:teuthology.orchestra.run.smithi144.stderr: 72750K .......... .......... .......... .......... .......... 78% 81.4M 0s 2024-06-04T16:14:28.846 INFO:teuthology.orchestra.run.smithi144.stderr: 72800K .......... .......... .......... .......... .......... 78% 70.9M 0s 2024-06-04T16:14:28.846 INFO:teuthology.orchestra.run.smithi144.stderr: 72850K .......... .......... .......... .......... .......... 78% 98.2M 0s 2024-06-04T16:14:28.846 INFO:teuthology.orchestra.run.smithi144.stderr: 72900K .......... .......... .......... .......... .......... 78% 117M 0s 2024-06-04T16:14:28.846 INFO:teuthology.orchestra.run.smithi144.stderr: 72950K .......... .......... .......... .......... .......... 78% 114M 0s 2024-06-04T16:14:28.846 INFO:teuthology.orchestra.run.smithi144.stderr: 73000K .......... .......... .......... .......... .......... 78% 81.0M 0s 2024-06-04T16:14:28.846 INFO:teuthology.orchestra.run.smithi144.stderr: 73050K .......... .......... .......... .......... .......... 78% 59.7M 0s 2024-06-04T16:14:28.846 INFO:teuthology.orchestra.run.smithi144.stderr: 73100K .......... .......... .......... .......... .......... 78% 74.9M 0s 2024-06-04T16:14:28.846 INFO:teuthology.orchestra.run.smithi144.stderr: 73150K .......... .......... .......... .......... .......... 78% 91.3M 0s 2024-06-04T16:14:28.846 INFO:teuthology.orchestra.run.smithi144.stderr: 73200K .......... .......... .......... .......... .......... 78% 112M 0s 2024-06-04T16:14:28.846 INFO:teuthology.orchestra.run.smithi144.stderr: 73250K .......... .......... .......... .......... .......... 78% 120M 0s 2024-06-04T16:14:28.846 INFO:teuthology.orchestra.run.smithi144.stderr: 73300K .......... .......... .......... .......... .......... 78% 117M 0s 2024-06-04T16:14:28.846 INFO:teuthology.orchestra.run.smithi144.stderr: 73350K .......... .......... .......... .......... .......... 79% 107M 0s 2024-06-04T16:14:28.847 INFO:teuthology.orchestra.run.smithi144.stderr: 73400K .......... .......... .......... .......... .......... 79% 107M 0s 2024-06-04T16:14:28.847 INFO:teuthology.orchestra.run.smithi144.stderr: 73450K .......... .......... .......... .......... .......... 79% 116M 0s 2024-06-04T16:14:28.847 INFO:teuthology.orchestra.run.smithi144.stderr: 73500K .......... .......... .......... .......... .......... 79% 117M 0s 2024-06-04T16:14:28.847 INFO:teuthology.orchestra.run.smithi144.stderr: 73550K .......... .......... .......... .......... .......... 79% 86.6M 0s 2024-06-04T16:14:28.847 INFO:teuthology.orchestra.run.smithi144.stderr: 73600K .......... .......... .......... .......... .......... 79% 112M 0s 2024-06-04T16:14:28.847 INFO:teuthology.orchestra.run.smithi144.stderr: 73650K .......... .......... .......... .......... .......... 79% 115M 0s 2024-06-04T16:14:28.847 INFO:teuthology.orchestra.run.smithi144.stderr: 73700K .......... .......... .......... .......... .......... 79% 88.8M 0s 2024-06-04T16:14:28.847 INFO:teuthology.orchestra.run.smithi144.stderr: 73750K .......... .......... .......... .......... .......... 79% 133M 0s 2024-06-04T16:14:28.847 INFO:teuthology.orchestra.run.smithi144.stderr: 73800K .......... .......... .......... .......... .......... 79% 113M 0s 2024-06-04T16:14:28.847 INFO:teuthology.orchestra.run.smithi144.stderr: 73850K .......... .......... .......... .......... .......... 79% 139M 0s 2024-06-04T16:14:28.847 INFO:teuthology.orchestra.run.smithi144.stderr: 73900K .......... .......... .......... .......... .......... 79% 107M 0s 2024-06-04T16:14:28.847 INFO:teuthology.orchestra.run.smithi144.stderr: 73950K .......... .......... .......... .......... .......... 79% 61.3M 0s 2024-06-04T16:14:28.847 INFO:teuthology.orchestra.run.smithi144.stderr: 74000K .......... .......... .......... .......... .......... 79% 189M 0s 2024-06-04T16:14:28.847 INFO:teuthology.orchestra.run.smithi144.stderr: 74050K .......... .......... .......... .......... .......... 79% 129M 0s 2024-06-04T16:14:28.847 INFO:teuthology.orchestra.run.smithi144.stderr: 74100K .......... .......... .......... .......... .......... 79% 117M 0s 2024-06-04T16:14:28.848 INFO:teuthology.orchestra.run.smithi144.stderr: 74150K .......... .......... .......... .......... .......... 79% 85.9M 0s 2024-06-04T16:14:28.848 INFO:teuthology.orchestra.run.smithi144.stderr: 74200K .......... .......... .......... .......... .......... 79% 121M 0s 2024-06-04T16:14:28.848 INFO:teuthology.orchestra.run.smithi144.stderr: 74250K .......... .......... .......... .......... .......... 79% 108M 0s 2024-06-04T16:14:28.848 INFO:teuthology.orchestra.run.smithi144.stderr: 74300K .......... .......... .......... .......... .......... 80% 119M 0s 2024-06-04T16:14:28.848 INFO:teuthology.orchestra.run.smithi144.stderr: 74350K .......... .......... .......... .......... .......... 80% 88.9M 0s 2024-06-04T16:14:28.848 INFO:teuthology.orchestra.run.smithi144.stderr: 74400K .......... .......... .......... .......... .......... 80% 114M 0s 2024-06-04T16:14:28.848 INFO:teuthology.orchestra.run.smithi144.stderr: 74450K .......... .......... .......... .......... .......... 80% 113M 0s 2024-06-04T16:14:28.848 INFO:teuthology.orchestra.run.smithi144.stderr: 74500K .......... .......... .......... .......... .......... 80% 111M 0s 2024-06-04T16:14:28.848 INFO:teuthology.orchestra.run.smithi144.stderr: 74550K .......... .......... .......... .......... .......... 80% 117M 0s 2024-06-04T16:14:28.848 INFO:teuthology.orchestra.run.smithi144.stderr: 74600K .......... .......... .......... .......... .......... 80% 109M 0s 2024-06-04T16:14:28.848 INFO:teuthology.orchestra.run.smithi144.stderr: 74650K .......... .......... .......... .......... .......... 80% 119M 0s 2024-06-04T16:14:28.848 INFO:teuthology.orchestra.run.smithi144.stderr: 74700K .......... .......... .......... .......... .......... 80% 109M 0s 2024-06-04T16:14:28.848 INFO:teuthology.orchestra.run.smithi144.stderr: 74750K .......... .......... .......... .......... .......... 80% 90.9M 0s 2024-06-04T16:14:28.848 INFO:teuthology.orchestra.run.smithi144.stderr: 74800K .......... .......... .......... .......... .......... 80% 112M 0s 2024-06-04T16:14:28.849 INFO:teuthology.orchestra.run.smithi144.stderr: 74850K .......... .......... .......... .......... .......... 80% 120M 0s 2024-06-04T16:14:28.849 INFO:teuthology.orchestra.run.smithi144.stderr: 74900K .......... .......... .......... .......... .......... 80% 96.9M 0s 2024-06-04T16:14:28.849 INFO:teuthology.orchestra.run.smithi144.stderr: 74950K .......... .......... .......... .......... .......... 80% 107M 0s 2024-06-04T16:14:28.849 INFO:teuthology.orchestra.run.smithi144.stderr: 75000K .......... .......... .......... .......... .......... 80% 123M 0s 2024-06-04T16:14:28.849 INFO:teuthology.orchestra.run.smithi144.stderr: 75050K .......... .......... .......... .......... .......... 80% 113M 0s 2024-06-04T16:14:28.849 INFO:teuthology.orchestra.run.smithi144.stderr: 75100K .......... .......... .......... .......... .......... 80% 120M 0s 2024-06-04T16:14:28.849 INFO:teuthology.orchestra.run.smithi144.stderr: 75150K .......... .......... .......... .......... .......... 80% 85.6M 0s 2024-06-04T16:14:28.849 INFO:teuthology.orchestra.run.smithi144.stderr: 75200K .......... .......... .......... .......... .......... 81% 115M 0s 2024-06-04T16:14:28.849 INFO:teuthology.orchestra.run.smithi144.stderr: 75250K .......... .......... .......... .......... .......... 81% 104M 0s 2024-06-04T16:14:28.849 INFO:teuthology.orchestra.run.smithi144.stderr: 75300K .......... .......... .......... .......... .......... 81% 131M 0s 2024-06-04T16:14:28.849 INFO:teuthology.orchestra.run.smithi144.stderr: 75350K .......... .......... .......... .......... .......... 81% 108M 0s 2024-06-04T16:14:28.849 INFO:teuthology.orchestra.run.smithi144.stderr: 75400K .......... .......... .......... .......... .......... 81% 111M 0s 2024-06-04T16:14:28.849 INFO:teuthology.orchestra.run.smithi144.stderr: 75450K .......... .......... .......... .......... .......... 81% 111M 0s 2024-06-04T16:14:28.849 INFO:teuthology.orchestra.run.smithi144.stderr: 75500K .......... .......... .......... .......... .......... 81% 118M 0s 2024-06-04T16:14:28.850 INFO:teuthology.orchestra.run.smithi144.stderr: 75550K .......... .......... .......... .......... .......... 81% 89.9M 0s 2024-06-04T16:14:28.850 INFO:teuthology.orchestra.run.smithi144.stderr: 75600K .......... .......... .......... .......... .......... 81% 93.4M 0s 2024-06-04T16:14:28.850 INFO:teuthology.orchestra.run.smithi144.stderr: 75650K .......... .......... .......... .......... .......... 81% 97.4M 0s 2024-06-04T16:14:28.850 INFO:teuthology.orchestra.run.smithi144.stderr: 75700K .......... .......... .......... .......... .......... 81% 74.1M 0s 2024-06-04T16:14:28.850 INFO:teuthology.orchestra.run.smithi144.stderr: 75750K .......... .......... .......... .......... .......... 81% 108M 0s 2024-06-04T16:14:28.850 INFO:teuthology.orchestra.run.smithi144.stderr: 75800K .......... .......... .......... .......... .......... 81% 116M 0s 2024-06-04T16:14:28.850 INFO:teuthology.orchestra.run.smithi144.stderr: 75850K .......... .......... .......... .......... .......... 81% 113M 0s 2024-06-04T16:14:28.850 INFO:teuthology.orchestra.run.smithi144.stderr: 75900K .......... .......... .......... .......... .......... 81% 117M 0s 2024-06-04T16:14:28.850 INFO:teuthology.orchestra.run.smithi144.stderr: 75950K .......... .......... .......... .......... .......... 81% 85.9M 0s 2024-06-04T16:14:28.850 INFO:teuthology.orchestra.run.smithi144.stderr: 76000K .......... .......... .......... .......... .......... 81% 120M 0s 2024-06-04T16:14:28.850 INFO:teuthology.orchestra.run.smithi144.stderr: 76050K .......... .......... .......... .......... .......... 81% 23.8M 0s 2024-06-04T16:14:28.850 INFO:teuthology.orchestra.run.smithi144.stderr: 76100K .......... .......... .......... .......... .......... 81% 113M 0s 2024-06-04T16:14:28.850 INFO:teuthology.orchestra.run.smithi144.stderr: 76150K .......... .......... .......... .......... .......... 82% 111M 0s 2024-06-04T16:14:28.850 INFO:teuthology.orchestra.run.smithi144.stderr: 76200K .......... .......... .......... .......... .......... 82% 115M 0s 2024-06-04T16:14:28.851 INFO:teuthology.orchestra.run.smithi144.stderr: 76250K .......... .......... .......... .......... .......... 82% 115M 0s 2024-06-04T16:14:28.851 INFO:teuthology.orchestra.run.smithi144.stderr: 76300K .......... .......... .......... .......... .......... 82% 117M 0s 2024-06-04T16:14:28.851 INFO:teuthology.orchestra.run.smithi144.stderr: 76350K .......... .......... .......... .......... .......... 82% 71.0M 0s 2024-06-04T16:14:28.851 INFO:teuthology.orchestra.run.smithi144.stderr: 76400K .......... .......... .......... .......... .......... 82% 74.7M 0s 2024-06-04T16:14:28.851 INFO:teuthology.orchestra.run.smithi144.stderr: 76450K .......... .......... .......... .......... .......... 82% 123M 0s 2024-06-04T16:14:28.851 INFO:teuthology.orchestra.run.smithi144.stderr: 76500K .......... .......... .......... .......... .......... 82% 112M 0s 2024-06-04T16:14:28.851 INFO:teuthology.orchestra.run.smithi144.stderr: 76550K .......... .......... .......... .......... .......... 82% 109M 0s 2024-06-04T16:14:28.851 INFO:teuthology.orchestra.run.smithi144.stderr: 76600K .......... .......... .......... .......... .......... 82% 111M 0s 2024-06-04T16:14:28.851 INFO:teuthology.orchestra.run.smithi144.stderr: 76650K .......... .......... .......... .......... .......... 82% 118M 0s 2024-06-04T16:14:28.851 INFO:teuthology.orchestra.run.smithi144.stderr: 76700K .......... .......... .......... .......... .......... 82% 116M 0s 2024-06-04T16:14:28.851 INFO:teuthology.orchestra.run.smithi144.stderr: 76750K .......... .......... .......... .......... .......... 82% 86.4M 0s 2024-06-04T16:14:28.851 INFO:teuthology.orchestra.run.smithi144.stderr: 76800K .......... .......... .......... .......... .......... 82% 127M 0s 2024-06-04T16:14:28.851 INFO:teuthology.orchestra.run.smithi144.stderr: 76850K .......... .......... .......... .......... .......... 82% 110M 0s 2024-06-04T16:14:28.852 INFO:teuthology.orchestra.run.smithi144.stderr: 76900K .......... .......... .......... .......... .......... 82% 115M 0s 2024-06-04T16:14:28.852 INFO:teuthology.orchestra.run.smithi144.stderr: 76950K .......... .......... .......... .......... .......... 82% 95.4M 0s 2024-06-04T16:14:28.852 INFO:teuthology.orchestra.run.smithi144.stderr: 77000K .......... .......... .......... .......... .......... 82% 71.8M 0s 2024-06-04T16:14:28.852 INFO:teuthology.orchestra.run.smithi144.stderr: 77050K .......... .......... .......... .......... .......... 82% 40.1M 0s 2024-06-04T16:14:28.852 INFO:teuthology.orchestra.run.smithi144.stderr: 77100K .......... .......... .......... .......... .......... 83% 66.5M 0s 2024-06-04T16:14:28.852 INFO:teuthology.orchestra.run.smithi144.stderr: 77150K .......... .......... .......... .......... .......... 83% 128M 0s 2024-06-04T16:14:28.852 INFO:teuthology.orchestra.run.smithi144.stderr: 77200K .......... .......... .......... .......... .......... 83% 102M 0s 2024-06-04T16:14:28.852 INFO:teuthology.orchestra.run.smithi144.stderr: 77250K .......... .......... .......... .......... .......... 83% 73.5M 0s 2024-06-04T16:14:28.852 INFO:teuthology.orchestra.run.smithi144.stderr: 77300K .......... .......... .......... .......... .......... 83% 95.0M 0s 2024-06-04T16:14:28.852 INFO:teuthology.orchestra.run.smithi144.stderr: 77350K .......... .......... .......... .......... .......... 83% 118M 0s 2024-06-04T16:14:28.852 INFO:teuthology.orchestra.run.smithi144.stderr: 77400K .......... .......... .......... .......... .......... 83% 66.7M 0s 2024-06-04T16:14:28.852 INFO:teuthology.orchestra.run.smithi144.stderr: 77450K .......... .......... .......... .......... .......... 83% 71.1M 0s 2024-06-04T16:14:28.852 INFO:teuthology.orchestra.run.smithi144.stderr: 77500K .......... .......... .......... .......... .......... 83% 76.8M 0s 2024-06-04T16:14:28.852 INFO:teuthology.orchestra.run.smithi144.stderr: 77550K .......... .......... .......... .......... .......... 83% 102M 0s 2024-06-04T16:14:28.853 INFO:teuthology.orchestra.run.smithi144.stderr: 77600K .......... .......... .......... .......... .......... 83% 117M 0s 2024-06-04T16:14:28.853 INFO:teuthology.orchestra.run.smithi144.stderr: 77650K .......... .......... .......... .......... .......... 83% 76.1M 0s 2024-06-04T16:14:28.853 INFO:teuthology.orchestra.run.smithi144.stderr: 77700K .......... .......... .......... .......... .......... 83% 78.4M 0s 2024-06-04T16:14:28.853 INFO:teuthology.orchestra.run.smithi144.stderr: 77750K .......... .......... .......... .......... .......... 83% 49.8M 0s 2024-06-04T16:14:28.853 INFO:teuthology.orchestra.run.smithi144.stderr: 77800K .......... .......... .......... .......... .......... 83% 305M 0s 2024-06-04T16:14:28.853 INFO:teuthology.orchestra.run.smithi144.stderr: 77850K .......... .......... .......... .......... .......... 83% 109M 0s 2024-06-04T16:14:28.853 INFO:teuthology.orchestra.run.smithi144.stderr: 77900K .......... .......... .......... .......... .......... 83% 71.3M 0s 2024-06-04T16:14:28.853 INFO:teuthology.orchestra.run.smithi144.stderr: 77950K .......... .......... .......... .......... .......... 83% 113M 0s 2024-06-04T16:14:28.853 INFO:teuthology.orchestra.run.smithi144.stderr: 78000K .......... .......... .......... .......... .......... 84% 115M 0s 2024-06-04T16:14:28.853 INFO:teuthology.orchestra.run.smithi144.stderr: 78050K .......... .......... .......... .......... .......... 84% 94.2M 0s 2024-06-04T16:14:28.853 INFO:teuthology.orchestra.run.smithi144.stderr: 78100K .......... .......... .......... .......... .......... 84% 69.7M 0s 2024-06-04T16:14:28.853 INFO:teuthology.orchestra.run.smithi144.stderr: 78150K .......... .......... .......... .......... .......... 84% 112M 0s 2024-06-04T16:14:28.853 INFO:teuthology.orchestra.run.smithi144.stderr: 78200K .......... .......... .......... .......... .......... 84% 117M 0s 2024-06-04T16:14:28.853 INFO:teuthology.orchestra.run.smithi144.stderr: 78250K .......... .......... .......... .......... .......... 84% 90.6M 0s 2024-06-04T16:14:28.854 INFO:teuthology.orchestra.run.smithi144.stderr: 78300K .......... .......... .......... .......... .......... 84% 114M 0s 2024-06-04T16:14:28.854 INFO:teuthology.orchestra.run.smithi144.stderr: 78350K .......... .......... .......... .......... .......... 84% 109M 0s 2024-06-04T16:14:28.854 INFO:teuthology.orchestra.run.smithi144.stderr: 78400K .......... .......... .......... .......... .......... 84% 121M 0s 2024-06-04T16:14:28.854 INFO:teuthology.orchestra.run.smithi144.stderr: 78450K .......... .......... .......... .......... .......... 84% 87.6M 0s 2024-06-04T16:14:28.854 INFO:teuthology.orchestra.run.smithi144.stderr: 78500K .......... .......... .......... .......... .......... 84% 120M 0s 2024-06-04T16:14:28.854 INFO:teuthology.orchestra.run.smithi144.stderr: 78550K .......... .......... .......... .......... .......... 84% 110M 0s 2024-06-04T16:14:28.854 INFO:teuthology.orchestra.run.smithi144.stderr: 78600K .......... .......... .......... .......... .......... 84% 111M 0s 2024-06-04T16:14:28.854 INFO:teuthology.orchestra.run.smithi144.stderr: 78650K .......... .......... .......... .......... .......... 84% 90.7M 0s 2024-06-04T16:14:28.854 INFO:teuthology.orchestra.run.smithi144.stderr: 78700K .......... .......... .......... .......... .......... 84% 109M 0s 2024-06-04T16:14:28.854 INFO:teuthology.orchestra.run.smithi144.stderr: 78750K .......... .......... .......... .......... .......... 84% 97.4M 0s 2024-06-04T16:14:28.854 INFO:teuthology.orchestra.run.smithi144.stderr: 78800K .......... .......... .......... .......... .......... 84% 117M 0s 2024-06-04T16:14:28.854 INFO:teuthology.orchestra.run.smithi144.stderr: 78850K .......... .......... .......... .......... .......... 84% 86.5M 0s 2024-06-04T16:14:28.855 INFO:teuthology.orchestra.run.smithi144.stderr: 78900K .......... .......... .......... .......... .......... 84% 119M 0s 2024-06-04T16:14:28.855 INFO:teuthology.orchestra.run.smithi144.stderr: 78950K .......... .......... .......... .......... .......... 85% 94.8M 0s 2024-06-04T16:14:28.855 INFO:teuthology.orchestra.run.smithi144.stderr: 79000K .......... .......... .......... .......... .......... 85% 116M 0s 2024-06-04T16:14:28.855 INFO:teuthology.orchestra.run.smithi144.stderr: 79050K .......... .......... .......... .......... .......... 85% 78.1M 0s 2024-06-04T16:14:28.855 INFO:teuthology.orchestra.run.smithi144.stderr: 79100K .......... .......... .......... .......... .......... 85% 115M 0s 2024-06-04T16:14:28.855 INFO:teuthology.orchestra.run.smithi144.stderr: 79150K .......... .......... .......... .......... .......... 85% 91.6M 0s 2024-06-04T16:14:28.855 INFO:teuthology.orchestra.run.smithi144.stderr: 79200K .......... .......... .......... .......... .......... 85% 117M 0s 2024-06-04T16:14:28.855 INFO:teuthology.orchestra.run.smithi144.stderr: 79250K .......... .......... .......... .......... .......... 85% 108M 0s 2024-06-04T16:14:28.855 INFO:teuthology.orchestra.run.smithi144.stderr: 79300K .......... .......... .......... .......... .......... 85% 101M 0s 2024-06-04T16:14:28.855 INFO:teuthology.orchestra.run.smithi144.stderr: 79350K .......... .......... .......... .......... .......... 85% 63.6M 0s 2024-06-04T16:14:28.855 INFO:teuthology.orchestra.run.smithi144.stderr: 79400K .......... .......... .......... .......... .......... 85% 122M 0s 2024-06-04T16:14:28.855 INFO:teuthology.orchestra.run.smithi144.stderr: 79450K .......... .......... .......... .......... .......... 85% 111M 0s 2024-06-04T16:14:28.855 INFO:teuthology.orchestra.run.smithi144.stderr: 79500K .......... .......... .......... .......... .......... 85% 115M 0s 2024-06-04T16:14:28.855 INFO:teuthology.orchestra.run.smithi144.stderr: 79550K .......... .......... .......... .......... .......... 85% 111M 0s 2024-06-04T16:14:28.855 INFO:teuthology.orchestra.run.smithi144.stderr: 79600K .......... .......... .......... .......... .......... 85% 116M 0s 2024-06-04T16:14:28.855 INFO:teuthology.orchestra.run.smithi144.stderr: 79650K .......... .......... .......... .......... .......... 85% 107M 0s 2024-06-04T16:14:28.856 INFO:teuthology.orchestra.run.smithi144.stderr: 79700K .......... .......... .......... .......... .......... 85% 114M 0s 2024-06-04T16:14:28.856 INFO:teuthology.orchestra.run.smithi144.stderr: 79750K .......... .......... .......... .......... .......... 85% 92.0M 0s 2024-06-04T16:14:28.856 INFO:teuthology.orchestra.run.smithi144.stderr: 79800K .......... .......... .......... .......... .......... 85% 101M 0s 2024-06-04T16:14:28.856 INFO:teuthology.orchestra.run.smithi144.stderr: 79850K .......... .......... .......... .......... .......... 86% 122M 0s 2024-06-04T16:14:28.856 INFO:teuthology.orchestra.run.smithi144.stderr: 79900K .......... .......... .......... .......... .......... 86% 109M 0s 2024-06-04T16:14:28.856 INFO:teuthology.orchestra.run.smithi144.stderr: 79950K .......... .......... .......... .......... .......... 86% 109M 0s 2024-06-04T16:14:28.856 INFO:teuthology.orchestra.run.smithi144.stderr: 80000K .......... .......... .......... .......... .......... 86% 75.5M 0s 2024-06-04T16:14:28.856 INFO:teuthology.orchestra.run.smithi144.stderr: 80050K .......... .......... .......... .......... .......... 86% 114M 0s 2024-06-04T16:14:28.856 INFO:teuthology.orchestra.run.smithi144.stderr: 80100K .......... .......... .......... .......... .......... 86% 123M 0s 2024-06-04T16:14:28.856 INFO:teuthology.orchestra.run.smithi144.stderr: 80150K .......... .......... .......... .......... .......... 86% 84.5M 0s 2024-06-04T16:14:28.856 INFO:teuthology.orchestra.run.smithi144.stderr: 80200K .......... .......... .......... .......... .......... 86% 113M 0s 2024-06-04T16:14:28.856 INFO:teuthology.orchestra.run.smithi144.stderr: 80250K .......... .......... .......... .......... .......... 86% 118M 0s 2024-06-04T16:14:28.856 INFO:teuthology.orchestra.run.smithi144.stderr: 80300K .......... .......... .......... .......... .......... 86% 118M 0s 2024-06-04T16:14:28.857 INFO:teuthology.orchestra.run.smithi144.stderr: 80350K .......... .......... .......... .......... .......... 86% 103M 0s 2024-06-04T16:14:28.857 INFO:teuthology.orchestra.run.smithi144.stderr: 80400K .......... .......... .......... .......... .......... 86% 121M 0s 2024-06-04T16:14:28.857 INFO:teuthology.orchestra.run.smithi144.stderr: 80450K .......... .......... .......... .......... .......... 86% 119M 0s 2024-06-04T16:14:28.857 INFO:teuthology.orchestra.run.smithi144.stderr: 80500K .......... .......... .......... .......... .......... 86% 106M 0s 2024-06-04T16:14:28.857 INFO:teuthology.orchestra.run.smithi144.stderr: 80550K .......... .......... .......... .......... .......... 86% 91.8M 0s 2024-06-04T16:14:28.857 INFO:teuthology.orchestra.run.smithi144.stderr: 80600K .......... .......... .......... .......... .......... 86% 104M 0s 2024-06-04T16:14:28.857 INFO:teuthology.orchestra.run.smithi144.stderr: 80650K .......... .......... .......... .......... .......... 86% 116M 0s 2024-06-04T16:14:28.857 INFO:teuthology.orchestra.run.smithi144.stderr: 80700K .......... .......... .......... .......... .......... 86% 102M 0s 2024-06-04T16:14:28.857 INFO:teuthology.orchestra.run.smithi144.stderr: 80750K .......... .......... .......... .......... .......... 86% 113M 0s 2024-06-04T16:14:28.857 INFO:teuthology.orchestra.run.smithi144.stderr: 80800K .......... .......... .......... .......... .......... 87% 117M 0s 2024-06-04T16:14:28.857 INFO:teuthology.orchestra.run.smithi144.stderr: 80850K .......... .......... .......... .......... .......... 87% 86.7M 0s 2024-06-04T16:14:28.857 INFO:teuthology.orchestra.run.smithi144.stderr: 80900K .......... .......... .......... .......... .......... 87% 121M 0s 2024-06-04T16:14:28.857 INFO:teuthology.orchestra.run.smithi144.stderr: 80950K .......... .......... .......... .......... .......... 87% 101M 0s 2024-06-04T16:14:28.857 INFO:teuthology.orchestra.run.smithi144.stderr: 81000K .......... .......... .......... .......... .......... 87% 116M 0s 2024-06-04T16:14:28.857 INFO:teuthology.orchestra.run.smithi144.stderr: 81050K .......... .......... .......... .......... .......... 87% 88.3M 0s 2024-06-04T16:14:28.857 INFO:teuthology.orchestra.run.smithi144.stderr: 81100K .......... .......... .......... .......... .......... 87% 115M 0s 2024-06-04T16:14:28.858 INFO:teuthology.orchestra.run.smithi144.stderr: 81150K .......... .......... .......... .......... .......... 87% 112M 0s 2024-06-04T16:14:28.858 INFO:teuthology.orchestra.run.smithi144.stderr: 81200K .......... .......... .......... .......... .......... 87% 72.8M 0s 2024-06-04T16:14:28.858 INFO:teuthology.orchestra.run.smithi144.stderr: 81250K .......... .......... .......... .......... .......... 87% 52.5M 0s 2024-06-04T16:14:28.858 INFO:teuthology.orchestra.run.smithi144.stderr: 81300K .......... .......... .......... .......... .......... 87% 223M 0s 2024-06-04T16:14:28.858 INFO:teuthology.orchestra.run.smithi144.stderr: 81350K .......... .......... .......... .......... .......... 87% 174M 0s 2024-06-04T16:14:28.858 INFO:teuthology.orchestra.run.smithi144.stderr: 81400K .......... .......... .......... .......... .......... 87% 73.3M 0s 2024-06-04T16:14:28.858 INFO:teuthology.orchestra.run.smithi144.stderr: 81450K .......... .......... .......... .......... .......... 87% 89.0M 0s 2024-06-04T16:14:28.858 INFO:teuthology.orchestra.run.smithi144.stderr: 81500K .......... .......... .......... .......... .......... 87% 110M 0s 2024-06-04T16:14:28.858 INFO:teuthology.orchestra.run.smithi144.stderr: 81550K .......... .......... .......... .......... .......... 87% 119M 0s 2024-06-04T16:14:28.858 INFO:teuthology.orchestra.run.smithi144.stderr: 81600K .......... .......... .......... .......... .......... 87% 113M 0s 2024-06-04T16:14:28.858 INFO:teuthology.orchestra.run.smithi144.stderr: 81650K .......... .......... .......... .......... .......... 87% 86.6M 0s 2024-06-04T16:14:28.858 INFO:teuthology.orchestra.run.smithi144.stderr: 81700K .......... .......... .......... .......... .......... 87% 103M 0s 2024-06-04T16:14:28.858 INFO:teuthology.orchestra.run.smithi144.stderr: 81750K .......... .......... .......... .......... .......... 88% 59.2M 0s 2024-06-04T16:14:28.859 INFO:teuthology.orchestra.run.smithi144.stderr: 81800K .......... .......... .......... .......... .......... 88% 110M 0s 2024-06-04T16:14:28.859 INFO:teuthology.orchestra.run.smithi144.stderr: 81850K .......... .......... .......... .......... .......... 88% 51.5M 0s 2024-06-04T16:14:28.859 INFO:teuthology.orchestra.run.smithi144.stderr: 81900K .......... .......... .......... .......... .......... 88% 49.3M 0s 2024-06-04T16:14:28.859 INFO:teuthology.orchestra.run.smithi144.stderr: 81950K .......... .......... .......... .......... .......... 88% 116M 0s 2024-06-04T16:14:28.859 INFO:teuthology.orchestra.run.smithi144.stderr: 82000K .......... .......... .......... .......... .......... 88% 119M 0s 2024-06-04T16:14:28.859 INFO:teuthology.orchestra.run.smithi144.stderr: 82050K .......... .......... .......... .......... .......... 88% 63.6M 0s 2024-06-04T16:14:28.859 INFO:teuthology.orchestra.run.smithi144.stderr: 82100K .......... .......... .......... .......... .......... 88% 111M 0s 2024-06-04T16:14:28.859 INFO:teuthology.orchestra.run.smithi144.stderr: 82150K .......... .......... .......... .......... .......... 88% 114M 0s 2024-06-04T16:14:28.859 INFO:teuthology.orchestra.run.smithi144.stderr: 82200K .......... .......... .......... .......... .......... 88% 113M 0s 2024-06-04T16:14:28.859 INFO:teuthology.orchestra.run.smithi144.stderr: 82250K .......... .......... .......... .......... .......... 88% 114M 0s 2024-06-04T16:14:28.859 INFO:teuthology.orchestra.run.smithi144.stderr: 82300K .......... .......... .......... .......... .......... 88% 108M 0s 2024-06-04T16:14:28.859 INFO:teuthology.orchestra.run.smithi144.stderr: 82350K .......... .......... .......... .......... .......... 88% 116M 0s 2024-06-04T16:14:28.859 INFO:teuthology.orchestra.run.smithi144.stderr: 82400K .......... .......... .......... .......... .......... 88% 91.3M 0s 2024-06-04T16:14:28.859 INFO:teuthology.orchestra.run.smithi144.stderr: 82450K .......... .......... .......... .......... .......... 88% 110M 0s 2024-06-04T16:14:28.859 INFO:teuthology.orchestra.run.smithi144.stderr: 82500K .......... .......... .......... .......... .......... 88% 116M 0s 2024-06-04T16:14:28.860 INFO:teuthology.orchestra.run.smithi144.stderr: 82550K .......... .......... .......... .......... .......... 88% 117M 0s 2024-06-04T16:14:28.860 INFO:teuthology.orchestra.run.smithi144.stderr: 82600K .......... .......... .......... .......... .......... 88% 111M 0s 2024-06-04T16:14:28.860 INFO:teuthology.orchestra.run.smithi144.stderr: 82650K .......... .......... .......... .......... .......... 89% 111M 0s 2024-06-04T16:14:28.860 INFO:teuthology.orchestra.run.smithi144.stderr: 82700K .......... .......... .......... .......... .......... 89% 122M 0s 2024-06-04T16:14:28.860 INFO:teuthology.orchestra.run.smithi144.stderr: 82750K .......... .......... .......... .......... .......... 89% 75.6M 0s 2024-06-04T16:14:28.860 INFO:teuthology.orchestra.run.smithi144.stderr: 82800K .......... .......... .......... .......... .......... 89% 45.2M 0s 2024-06-04T16:14:28.860 INFO:teuthology.orchestra.run.smithi144.stderr: 82850K .......... .......... .......... .......... .......... 89% 101M 0s 2024-06-04T16:14:28.860 INFO:teuthology.orchestra.run.smithi144.stderr: 82900K .......... .......... .......... .......... .......... 89% 89.5M 0s 2024-06-04T16:14:28.860 INFO:teuthology.orchestra.run.smithi144.stderr: 82950K .......... .......... .......... .......... .......... 89% 81.3M 0s 2024-06-04T16:14:28.860 INFO:teuthology.orchestra.run.smithi144.stderr: 83000K .......... .......... .......... .......... .......... 89% 115M 0s 2024-06-04T16:14:28.860 INFO:teuthology.orchestra.run.smithi144.stderr: 83050K .......... .......... .......... .......... .......... 89% 76.8M 0s 2024-06-04T16:14:28.860 INFO:teuthology.orchestra.run.smithi144.stderr: 83100K .......... .......... .......... .......... .......... 89% 119M 0s 2024-06-04T16:14:28.860 INFO:teuthology.orchestra.run.smithi144.stderr: 83150K .......... .......... .......... .......... .......... 89% 65.7M 0s 2024-06-04T16:14:28.860 INFO:teuthology.orchestra.run.smithi144.stderr: 83200K .......... .......... .......... .......... .......... 89% 82.4M 0s 2024-06-04T16:14:28.860 INFO:teuthology.orchestra.run.smithi144.stderr: 83250K .......... .......... .......... .......... .......... 89% 113M 0s 2024-06-04T16:14:28.861 INFO:teuthology.orchestra.run.smithi144.stderr: 83300K .......... .......... .......... .......... .......... 89% 105M 0s 2024-06-04T16:14:28.861 INFO:teuthology.orchestra.run.smithi144.stderr: 83350K .......... .......... .......... .......... .......... 89% 67.5M 0s 2024-06-04T16:14:28.861 INFO:teuthology.orchestra.run.smithi144.stderr: 83400K .......... .......... .......... .......... .......... 89% 90.4M 0s 2024-06-04T16:14:28.861 INFO:teuthology.orchestra.run.smithi144.stderr: 83450K .......... .......... .......... .......... .......... 89% 123M 0s 2024-06-04T16:14:28.861 INFO:teuthology.orchestra.run.smithi144.stderr: 83500K .......... .......... .......... .......... .......... 89% 91.7M 0s 2024-06-04T16:14:28.861 INFO:teuthology.orchestra.run.smithi144.stderr: 83550K .......... .......... .......... .......... .......... 89% 82.8M 0s 2024-06-04T16:14:28.861 INFO:teuthology.orchestra.run.smithi144.stderr: 83600K .......... .......... .......... .......... .......... 90% 95.5M 0s 2024-06-04T16:14:28.861 INFO:teuthology.orchestra.run.smithi144.stderr: 83650K .......... .......... .......... .......... .......... 90% 76.6M 0s 2024-06-04T16:14:28.861 INFO:teuthology.orchestra.run.smithi144.stderr: 83700K .......... .......... .......... .......... .......... 90% 128M 0s 2024-06-04T16:14:28.861 INFO:teuthology.orchestra.run.smithi144.stderr: 83750K .......... .......... .......... .......... .......... 90% 82.0M 0s 2024-06-04T16:14:28.861 INFO:teuthology.orchestra.run.smithi144.stderr: 83800K .......... .......... .......... .......... .......... 90% 90.7M 0s 2024-06-04T16:14:28.861 INFO:teuthology.orchestra.run.smithi144.stderr: 83850K .......... .......... .......... .......... .......... 90% 113M 0s 2024-06-04T16:14:28.861 INFO:teuthology.orchestra.run.smithi144.stderr: 83900K .......... .......... .......... .......... .......... 90% 109M 0s 2024-06-04T16:14:28.861 INFO:teuthology.orchestra.run.smithi144.stderr: 83950K .......... .......... .......... .......... .......... 90% 72.0M 0s 2024-06-04T16:14:28.862 INFO:teuthology.orchestra.run.smithi144.stderr: 84000K .......... .......... .......... .......... .......... 90% 58.4M 0s 2024-06-04T16:14:28.862 INFO:teuthology.orchestra.run.smithi144.stderr: 84050K .......... .......... .......... .......... .......... 90% 117M 0s 2024-06-04T16:14:28.862 INFO:teuthology.orchestra.run.smithi144.stderr: 84100K .......... .......... .......... .......... .......... 90% 108M 0s 2024-06-04T16:14:28.862 INFO:teuthology.orchestra.run.smithi144.stderr: 84150K .......... .......... .......... .......... .......... 90% 115M 0s 2024-06-04T16:14:28.862 INFO:teuthology.orchestra.run.smithi144.stderr: 84200K .......... .......... .......... .......... .......... 90% 92.0M 0s 2024-06-04T16:14:28.862 INFO:teuthology.orchestra.run.smithi144.stderr: 84250K .......... .......... .......... .......... .......... 90% 110M 0s 2024-06-04T16:14:28.862 INFO:teuthology.orchestra.run.smithi144.stderr: 84300K .......... .......... .......... .......... .......... 90% 116M 0s 2024-06-04T16:14:28.862 INFO:teuthology.orchestra.run.smithi144.stderr: 84350K .......... .......... .......... .......... .......... 90% 51.8M 0s 2024-06-04T16:14:28.862 INFO:teuthology.orchestra.run.smithi144.stderr: 84400K .......... .......... .......... .......... .......... 90% 121M 0s 2024-06-04T16:14:28.862 INFO:teuthology.orchestra.run.smithi144.stderr: 84450K .......... .......... .......... .......... .......... 90% 114M 0s 2024-06-04T16:14:28.862 INFO:teuthology.orchestra.run.smithi144.stderr: 84500K .......... .......... .......... .......... .......... 91% 95.6M 0s 2024-06-04T16:14:28.862 INFO:teuthology.orchestra.run.smithi144.stderr: 84550K .......... .......... .......... .......... .......... 91% 89.8M 0s 2024-06-04T16:14:28.862 INFO:teuthology.orchestra.run.smithi144.stderr: 84600K .......... .......... .......... .......... .......... 91% 144M 0s 2024-06-04T16:14:28.862 INFO:teuthology.orchestra.run.smithi144.stderr: 84650K .......... .......... .......... .......... .......... 91% 125M 0s 2024-06-04T16:14:28.863 INFO:teuthology.orchestra.run.smithi144.stderr: 84700K .......... .......... .......... .......... .......... 91% 84.2M 0s 2024-06-04T16:14:28.863 INFO:teuthology.orchestra.run.smithi144.stderr: 84750K .......... .......... .......... .......... .......... 91% 118M 0s 2024-06-04T16:14:28.863 INFO:teuthology.orchestra.run.smithi144.stderr: 84800K .......... .......... .......... .......... .......... 91% 74.6M 0s 2024-06-04T16:14:28.863 INFO:teuthology.orchestra.run.smithi144.stderr: 84850K .......... .......... .......... .......... .......... 91% 117M 0s 2024-06-04T16:14:28.863 INFO:teuthology.orchestra.run.smithi144.stderr: 84900K .......... .......... .......... .......... .......... 91% 90.7M 0s 2024-06-04T16:14:28.863 INFO:teuthology.orchestra.run.smithi144.stderr: 84950K .......... .......... .......... .......... .......... 91% 95.6M 0s 2024-06-04T16:14:28.863 INFO:teuthology.orchestra.run.smithi144.stderr: 85000K .......... .......... .......... .......... .......... 91% 112M 0s 2024-06-04T16:14:28.863 INFO:teuthology.orchestra.run.smithi144.stderr: 85050K .......... .......... .......... .......... .......... 91% 110M 0s 2024-06-04T16:14:28.863 INFO:teuthology.orchestra.run.smithi144.stderr: 85100K .......... .......... .......... .......... .......... 91% 80.7M 0s 2024-06-04T16:14:28.863 INFO:teuthology.orchestra.run.smithi144.stderr: 85150K .......... .......... .......... .......... .......... 91% 88.7M 0s 2024-06-04T16:14:28.863 INFO:teuthology.orchestra.run.smithi144.stderr: 85200K .......... .......... .......... .......... .......... 91% 45.7M 0s 2024-06-04T16:14:28.863 INFO:teuthology.orchestra.run.smithi144.stderr: 85250K .......... .......... .......... .......... .......... 91% 116M 0s 2024-06-04T16:14:28.863 INFO:teuthology.orchestra.run.smithi144.stderr: 85300K .......... .......... .......... .......... .......... 91% 108M 0s 2024-06-04T16:14:28.863 INFO:teuthology.orchestra.run.smithi144.stderr: 85350K .......... .......... .......... .......... .......... 91% 116M 0s 2024-06-04T16:14:28.863 INFO:teuthology.orchestra.run.smithi144.stderr: 85400K .......... .......... .......... .......... .......... 91% 104M 0s 2024-06-04T16:14:28.864 INFO:teuthology.orchestra.run.smithi144.stderr: 85450K .......... .......... .......... .......... .......... 92% 84.2M 0s 2024-06-04T16:14:28.864 INFO:teuthology.orchestra.run.smithi144.stderr: 85500K .......... .......... .......... .......... .......... 92% 66.6M 0s 2024-06-04T16:14:28.864 INFO:teuthology.orchestra.run.smithi144.stderr: 85550K .......... .......... .......... .......... .......... 92% 114M 0s 2024-06-04T16:14:28.864 INFO:teuthology.orchestra.run.smithi144.stderr: 85600K .......... .......... .......... .......... .......... 92% 108M 0s 2024-06-04T16:14:28.864 INFO:teuthology.orchestra.run.smithi144.stderr: 85650K .......... .......... .......... .......... .......... 92% 92.4M 0s 2024-06-04T16:14:28.864 INFO:teuthology.orchestra.run.smithi144.stderr: 85700K .......... .......... .......... .......... .......... 92% 103M 0s 2024-06-04T16:14:28.864 INFO:teuthology.orchestra.run.smithi144.stderr: 85750K .......... .......... .......... .......... .......... 92% 117M 0s 2024-06-04T16:14:28.864 INFO:teuthology.orchestra.run.smithi144.stderr: 85800K .......... .......... .......... .......... .......... 92% 110M 0s 2024-06-04T16:14:28.864 INFO:teuthology.orchestra.run.smithi144.stderr: 85850K .......... .......... .......... .......... .......... 92% 107M 0s 2024-06-04T16:14:28.864 INFO:teuthology.orchestra.run.smithi144.stderr: 85900K .......... .......... .......... .......... .......... 92% 88.5M 0s 2024-06-04T16:14:28.864 INFO:teuthology.orchestra.run.smithi144.stderr: 85950K .......... .......... .......... .......... .......... 92% 116M 0s 2024-06-04T16:14:28.864 INFO:teuthology.orchestra.run.smithi144.stderr: 86000K .......... .......... .......... .......... .......... 92% 112M 0s 2024-06-04T16:14:28.864 INFO:teuthology.orchestra.run.smithi144.stderr: 86050K .......... .......... .......... .......... .......... 92% 116M 0s 2024-06-04T16:14:28.865 INFO:teuthology.orchestra.run.smithi144.stderr: 86100K .......... .......... .......... .......... .......... 92% 109M 0s 2024-06-04T16:14:28.865 INFO:teuthology.orchestra.run.smithi144.stderr: 86150K .......... .......... .......... .......... .......... 92% 51.6M 0s 2024-06-04T16:14:28.865 INFO:teuthology.orchestra.run.smithi144.stderr: 86200K .......... .......... .......... .......... .......... 92% 107M 0s 2024-06-04T16:14:28.865 INFO:teuthology.orchestra.run.smithi144.stderr: 86250K .......... .......... .......... .......... .......... 92% 119M 0s 2024-06-04T16:14:28.865 INFO:teuthology.orchestra.run.smithi144.stderr: 86300K .......... .......... .......... .......... .......... 92% 94.1M 0s 2024-06-04T16:14:28.865 INFO:teuthology.orchestra.run.smithi144.stderr: 86350K .......... .......... .......... .......... .......... 93% 109M 0s 2024-06-04T16:14:28.865 INFO:teuthology.orchestra.run.smithi144.stderr: 86400K .......... .......... .......... .......... .......... 93% 119M 0s 2024-06-04T16:14:28.865 INFO:teuthology.orchestra.run.smithi144.stderr: 86450K .......... .......... .......... .......... .......... 93% 104M 0s 2024-06-04T16:14:28.865 INFO:teuthology.orchestra.run.smithi144.stderr: 86500K .......... .......... .......... .......... .......... 93% 119M 0s 2024-06-04T16:14:28.865 INFO:teuthology.orchestra.run.smithi144.stderr: 86550K .......... .......... .......... .......... .......... 93% 112M 0s 2024-06-04T16:14:28.865 INFO:teuthology.orchestra.run.smithi144.stderr: 86600K .......... .......... .......... .......... .......... 93% 88.8M 0s 2024-06-04T16:14:28.865 INFO:teuthology.orchestra.run.smithi144.stderr: 86650K .......... .......... .......... .......... .......... 93% 110M 0s 2024-06-04T16:14:28.865 INFO:teuthology.orchestra.run.smithi144.stderr: 86700K .......... .......... .......... .......... .......... 93% 119M 0s 2024-06-04T16:14:28.865 INFO:teuthology.orchestra.run.smithi144.stderr: 86750K .......... .......... .......... .......... .......... 93% 102M 0s 2024-06-04T16:14:28.865 INFO:teuthology.orchestra.run.smithi144.stderr: 86800K .......... .......... .......... .......... .......... 93% 110M 0s 2024-06-04T16:14:28.866 INFO:teuthology.orchestra.run.smithi144.stderr: 86850K .......... .......... .......... .......... .......... 93% 86.1M 0s 2024-06-04T16:14:28.866 INFO:teuthology.orchestra.run.smithi144.stderr: 86900K .......... .......... .......... .......... .......... 93% 118M 0s 2024-06-04T16:14:28.866 INFO:teuthology.orchestra.run.smithi144.stderr: 86950K .......... .......... .......... .......... .......... 93% 119M 0s 2024-06-04T16:14:28.866 INFO:teuthology.orchestra.run.smithi144.stderr: 87000K .......... .......... .......... .......... .......... 93% 86.2M 0s 2024-06-04T16:14:28.866 INFO:teuthology.orchestra.run.smithi144.stderr: 87050K .......... .......... .......... .......... .......... 93% 117M 0s 2024-06-04T16:14:28.866 INFO:teuthology.orchestra.run.smithi144.stderr: 87100K .......... .......... .......... .......... .......... 93% 70.0M 0s 2024-06-04T16:14:28.866 INFO:teuthology.orchestra.run.smithi144.stderr: 87150K .......... .......... .......... .......... .......... 93% 112M 0s 2024-06-04T16:14:28.866 INFO:teuthology.orchestra.run.smithi144.stderr: 87200K .......... .......... .......... .......... .......... 93% 114M 0s 2024-06-04T16:14:28.866 INFO:teuthology.orchestra.run.smithi144.stderr: 87250K .......... .......... .......... .......... .......... 93% 111M 0s 2024-06-04T16:14:28.866 INFO:teuthology.orchestra.run.smithi144.stderr: 87300K .......... .......... .......... .......... .......... 94% 110M 0s 2024-06-04T16:14:28.866 INFO:teuthology.orchestra.run.smithi144.stderr: 87350K .......... .......... .......... .......... .......... 94% 115M 0s 2024-06-04T16:14:28.866 INFO:teuthology.orchestra.run.smithi144.stderr: 87400K .......... .......... .......... .......... .......... 94% 90.0M 0s 2024-06-04T16:14:28.866 INFO:teuthology.orchestra.run.smithi144.stderr: 87450K .......... .......... .......... .......... .......... 94% 113M 0s 2024-06-04T16:14:28.867 INFO:teuthology.orchestra.run.smithi144.stderr: 87500K .......... .......... .......... .......... .......... 94% 114M 0s 2024-06-04T16:14:28.867 INFO:teuthology.orchestra.run.smithi144.stderr: 87550K .......... .......... .......... .......... .......... 94% 108M 0s 2024-06-04T16:14:28.867 INFO:teuthology.orchestra.run.smithi144.stderr: 87600K .......... .......... .......... .......... .......... 94% 54.8M 0s 2024-06-04T16:14:28.867 INFO:teuthology.orchestra.run.smithi144.stderr: 87650K .......... .......... .......... .......... .......... 94% 135M 0s 2024-06-04T16:14:28.867 INFO:teuthology.orchestra.run.smithi144.stderr: 87700K .......... .......... .......... .......... .......... 94% 65.4M 0s 2024-06-04T16:14:28.867 INFO:teuthology.orchestra.run.smithi144.stderr: 87750K .......... .......... .......... .......... .......... 94% 58.7M 0s 2024-06-04T16:14:28.867 INFO:teuthology.orchestra.run.smithi144.stderr: 87800K .......... .......... .......... .......... .......... 94% 48.7M 0s 2024-06-04T16:14:28.867 INFO:teuthology.orchestra.run.smithi144.stderr: 87850K .......... .......... .......... .......... .......... 94% 118M 0s 2024-06-04T16:14:28.867 INFO:teuthology.orchestra.run.smithi144.stderr: 87900K .......... .......... .......... .......... .......... 94% 109M 0s 2024-06-04T16:14:28.867 INFO:teuthology.orchestra.run.smithi144.stderr: 87950K .......... .......... .......... .......... .......... 94% 96.8M 0s 2024-06-04T16:14:28.867 INFO:teuthology.orchestra.run.smithi144.stderr: 88000K .......... .......... .......... .......... .......... 94% 117M 0s 2024-06-04T16:14:28.867 INFO:teuthology.orchestra.run.smithi144.stderr: 88050K .......... .......... .......... .......... .......... 94% 109M 0s 2024-06-04T16:14:28.867 INFO:teuthology.orchestra.run.smithi144.stderr: 88100K .......... .......... .......... .......... .......... 94% 94.0M 0s 2024-06-04T16:14:28.868 INFO:teuthology.orchestra.run.smithi144.stderr: 88150K .......... .......... .......... .......... .......... 94% 114M 0s 2024-06-04T16:14:28.868 INFO:teuthology.orchestra.run.smithi144.stderr: 88200K .......... .......... .......... .......... .......... 94% 113M 0s 2024-06-04T16:14:28.868 INFO:teuthology.orchestra.run.smithi144.stderr: 88250K .......... .......... .......... .......... .......... 95% 116M 0s 2024-06-04T16:14:28.868 INFO:teuthology.orchestra.run.smithi144.stderr: 88300K .......... .......... .......... .......... .......... 95% 107M 0s 2024-06-04T16:14:28.868 INFO:teuthology.orchestra.run.smithi144.stderr: 88350K .......... .......... .......... .......... .......... 95% 113M 0s 2024-06-04T16:14:28.868 INFO:teuthology.orchestra.run.smithi144.stderr: 88400K .......... .......... .......... .......... .......... 95% 98.9M 0s 2024-06-04T16:14:28.868 INFO:teuthology.orchestra.run.smithi144.stderr: 88450K .......... .......... .......... .......... .......... 95% 59.2M 0s 2024-06-04T16:14:28.868 INFO:teuthology.orchestra.run.smithi144.stderr: 88500K .......... .......... .......... .......... .......... 95% 89.8M 0s 2024-06-04T16:14:28.868 INFO:teuthology.orchestra.run.smithi144.stderr: 88550K .......... .......... .......... .......... .......... 95% 117M 0s 2024-06-04T16:14:28.868 INFO:teuthology.orchestra.run.smithi144.stderr: 88600K .......... .......... .......... .......... .......... 95% 113M 0s 2024-06-04T16:14:28.868 INFO:teuthology.orchestra.run.smithi144.stderr: 88650K .......... .......... .......... .......... .......... 95% 110M 0s 2024-06-04T16:14:28.868 INFO:teuthology.orchestra.run.smithi144.stderr: 88700K .......... .......... .......... .......... .......... 95% 69.7M 0s 2024-06-04T16:14:28.868 INFO:teuthology.orchestra.run.smithi144.stderr: 88750K .......... .......... .......... .......... .......... 95% 92.9M 0s 2024-06-04T16:14:28.868 INFO:teuthology.orchestra.run.smithi144.stderr: 88800K .......... .......... .......... .......... .......... 95% 119M 0s 2024-06-04T16:14:28.869 INFO:teuthology.orchestra.run.smithi144.stderr: 88850K .......... .......... .......... .......... .......... 95% 75.0M 0s 2024-06-04T16:14:28.869 INFO:teuthology.orchestra.run.smithi144.stderr: 88900K .......... .......... .......... .......... .......... 95% 82.5M 0s 2024-06-04T16:14:28.869 INFO:teuthology.orchestra.run.smithi144.stderr: 88950K .......... .......... .......... .......... .......... 95% 84.5M 0s 2024-06-04T16:14:28.869 INFO:teuthology.orchestra.run.smithi144.stderr: 89000K .......... .......... .......... .......... .......... 95% 82.9M 0s 2024-06-04T16:14:28.869 INFO:teuthology.orchestra.run.smithi144.stderr: 89050K .......... .......... .......... .......... .......... 95% 121M 0s 2024-06-04T16:14:28.869 INFO:teuthology.orchestra.run.smithi144.stderr: 89100K .......... .......... .......... .......... .......... 95% 88.3M 0s 2024-06-04T16:14:28.869 INFO:teuthology.orchestra.run.smithi144.stderr: 89150K .......... .......... .......... .......... .......... 96% 79.8M 0s 2024-06-04T16:14:28.869 INFO:teuthology.orchestra.run.smithi144.stderr: 89200K .......... .......... .......... .......... .......... 96% 96.7M 0s 2024-06-04T16:14:28.869 INFO:teuthology.orchestra.run.smithi144.stderr: 89250K .......... .......... .......... .......... .......... 96% 74.5M 0s 2024-06-04T16:14:28.869 INFO:teuthology.orchestra.run.smithi144.stderr: 89300K .......... .......... .......... .......... .......... 96% 116M 0s 2024-06-04T16:14:28.869 INFO:teuthology.orchestra.run.smithi144.stderr: 89350K .......... .......... .......... .......... .......... 96% 83.8M 0s 2024-06-04T16:14:28.869 INFO:teuthology.orchestra.run.smithi144.stderr: 89400K .......... .......... .......... .......... .......... 96% 84.9M 0s 2024-06-04T16:14:28.869 INFO:teuthology.orchestra.run.smithi144.stderr: 89450K .......... .......... .......... .......... .......... 96% 99.7M 0s 2024-06-04T16:14:28.870 INFO:teuthology.orchestra.run.smithi144.stderr: 89500K .......... .......... .......... .......... .......... 96% 110M 0s 2024-06-04T16:14:28.870 INFO:teuthology.orchestra.run.smithi144.stderr: 89550K .......... .......... .......... .......... .......... 96% 113M 0s 2024-06-04T16:14:28.870 INFO:teuthology.orchestra.run.smithi144.stderr: 89600K .......... .......... .......... .......... .......... 96% 96.3M 0s 2024-06-04T16:14:28.870 INFO:teuthology.orchestra.run.smithi144.stderr: 89650K .......... .......... .......... .......... .......... 96% 70.8M 0s 2024-06-04T16:14:28.870 INFO:teuthology.orchestra.run.smithi144.stderr: 89700K .......... .......... .......... .......... .......... 96% 85.3M 0s 2024-06-04T16:14:28.870 INFO:teuthology.orchestra.run.smithi144.stderr: 89750K .......... .......... .......... .......... .......... 96% 118M 0s 2024-06-04T16:14:28.870 INFO:teuthology.orchestra.run.smithi144.stderr: 89800K .......... .......... .......... .......... .......... 96% 88.7M 0s 2024-06-04T16:14:28.870 INFO:teuthology.orchestra.run.smithi144.stderr: 89850K .......... .......... .......... .......... .......... 96% 101M 0s 2024-06-04T16:14:28.870 INFO:teuthology.orchestra.run.smithi144.stderr: 89900K .......... .......... .......... .......... .......... 96% 101M 0s 2024-06-04T16:14:28.870 INFO:teuthology.orchestra.run.smithi144.stderr: 89950K .......... .......... .......... .......... .......... 96% 117M 0s 2024-06-04T16:14:28.870 INFO:teuthology.orchestra.run.smithi144.stderr: 90000K .......... .......... .......... .......... .......... 96% 88.5M 0s 2024-06-04T16:14:28.870 INFO:teuthology.orchestra.run.smithi144.stderr: 90050K .......... .......... .......... .......... .......... 96% 62.1M 0s 2024-06-04T16:14:28.870 INFO:teuthology.orchestra.run.smithi144.stderr: 90100K .......... .......... .......... .......... .......... 97% 85.9M 0s 2024-06-04T16:14:28.870 INFO:teuthology.orchestra.run.smithi144.stderr: 90150K .......... .......... .......... .......... .......... 97% 134M 0s 2024-06-04T16:14:28.871 INFO:teuthology.orchestra.run.smithi144.stderr: 90200K .......... .......... .......... .......... .......... 97% 107M 0s 2024-06-04T16:14:28.871 INFO:teuthology.orchestra.run.smithi144.stderr: 90250K .......... .......... .......... .......... .......... 97% 43.0M 0s 2024-06-04T16:14:28.871 INFO:teuthology.orchestra.run.smithi144.stderr: 90300K .......... .......... .......... .......... .......... 97% 110M 0s 2024-06-04T16:14:28.871 INFO:teuthology.orchestra.run.smithi144.stderr: 90350K .......... .......... .......... .......... .......... 97% 119M 0s 2024-06-04T16:14:28.871 INFO:teuthology.orchestra.run.smithi144.stderr: 90400K .......... .......... .......... .......... .......... 97% 116M 0s 2024-06-04T16:14:28.871 INFO:teuthology.orchestra.run.smithi144.stderr: 90450K .......... .......... .......... .......... .......... 97% 84.2M 0s 2024-06-04T16:14:28.871 INFO:teuthology.orchestra.run.smithi144.stderr: 90500K .......... .......... .......... .......... .......... 97% 114M 0s 2024-06-04T16:14:28.871 INFO:teuthology.orchestra.run.smithi144.stderr: 90550K .......... .......... .......... .......... .......... 97% 106M 0s 2024-06-04T16:14:28.871 INFO:teuthology.orchestra.run.smithi144.stderr: 90600K .......... .......... .......... .......... .......... 97% 103M 0s 2024-06-04T16:14:28.871 INFO:teuthology.orchestra.run.smithi144.stderr: 90650K .......... .......... .......... .......... .......... 97% 133M 0s 2024-06-04T16:14:28.871 INFO:teuthology.orchestra.run.smithi144.stderr: 90700K .......... .......... .......... .......... .......... 97% 115M 0s 2024-06-04T16:14:28.871 INFO:teuthology.orchestra.run.smithi144.stderr: 90750K .......... .......... .......... .......... .......... 97% 117M 0s 2024-06-04T16:14:28.871 INFO:teuthology.orchestra.run.smithi144.stderr: 90800K .......... .......... .......... .......... .......... 97% 117M 0s 2024-06-04T16:14:28.872 INFO:teuthology.orchestra.run.smithi144.stderr: 90850K .......... .......... .......... .......... .......... 97% 78.4M 0s 2024-06-04T16:14:28.872 INFO:teuthology.orchestra.run.smithi144.stderr: 90900K .......... .......... .......... .......... .......... 97% 113M 0s 2024-06-04T16:14:28.872 INFO:teuthology.orchestra.run.smithi144.stderr: 90950K .......... .......... .......... .......... .......... 97% 113M 0s 2024-06-04T16:14:28.872 INFO:teuthology.orchestra.run.smithi144.stderr: 91000K .......... .......... .......... .......... .......... 98% 91.6M 0s 2024-06-04T16:14:28.872 INFO:teuthology.orchestra.run.smithi144.stderr: 91050K .......... .......... .......... .......... .......... 98% 81.3M 0s 2024-06-04T16:14:28.872 INFO:teuthology.orchestra.run.smithi144.stderr: 91100K .......... .......... .......... .......... .......... 98% 90.8M 0s 2024-06-04T16:14:28.872 INFO:teuthology.orchestra.run.smithi144.stderr: 91150K .......... .......... .......... .......... .......... 98% 125M 0s 2024-06-04T16:14:28.872 INFO:teuthology.orchestra.run.smithi144.stderr: 91200K .......... .......... .......... .......... .......... 98% 113M 0s 2024-06-04T16:14:28.872 INFO:teuthology.orchestra.run.smithi144.stderr: 91250K .......... .......... .......... .......... .......... 98% 84.7M 0s 2024-06-04T16:14:28.872 INFO:teuthology.orchestra.run.smithi144.stderr: 91300K .......... .......... .......... .......... .......... 98% 110M 0s 2024-06-04T16:14:28.872 INFO:teuthology.orchestra.run.smithi144.stderr: 91350K .......... .......... .......... .......... .......... 98% 116M 0s 2024-06-04T16:14:28.872 INFO:teuthology.orchestra.run.smithi144.stderr: 91400K .......... .......... .......... .......... .......... 98% 125M 0s 2024-06-04T16:14:28.872 INFO:teuthology.orchestra.run.smithi144.stderr: 91450K .......... .......... .......... .......... .......... 98% 89.5M 0s 2024-06-04T16:14:28.872 INFO:teuthology.orchestra.run.smithi144.stderr: 91500K .......... .......... .......... .......... .......... 98% 100M 0s 2024-06-04T16:14:28.872 INFO:teuthology.orchestra.run.smithi144.stderr: 91550K .......... .......... .......... .......... .......... 98% 81.3M 0s 2024-06-04T16:14:28.873 INFO:teuthology.orchestra.run.smithi144.stderr: 91600K .......... .......... .......... .......... .......... 98% 114M 0s 2024-06-04T16:14:28.873 INFO:teuthology.orchestra.run.smithi144.stderr: 91650K .......... .......... .......... .......... .......... 98% 89.1M 0s 2024-06-04T16:14:28.873 INFO:teuthology.orchestra.run.smithi144.stderr: 91700K .......... .......... .......... .......... .......... 98% 110M 0s 2024-06-04T16:14:28.873 INFO:teuthology.orchestra.run.smithi144.stderr: 91750K .......... .......... .......... .......... .......... 98% 104M 0s 2024-06-04T16:14:28.873 INFO:teuthology.orchestra.run.smithi144.stderr: 91800K .......... .......... .......... .......... .......... 98% 117M 0s 2024-06-04T16:14:28.873 INFO:teuthology.orchestra.run.smithi144.stderr: 91850K .......... .......... .......... .......... .......... 98% 115M 0s 2024-06-04T16:14:28.873 INFO:teuthology.orchestra.run.smithi144.stderr: 91900K .......... .......... .......... .......... .......... 98% 106M 0s 2024-06-04T16:14:28.873 INFO:teuthology.orchestra.run.smithi144.stderr: 91950K .......... .......... .......... .......... .......... 99% 114M 0s 2024-06-04T16:14:28.873 INFO:teuthology.orchestra.run.smithi144.stderr: 92000K .......... .......... .......... .......... .......... 99% 120M 0s 2024-06-04T16:14:28.873 INFO:teuthology.orchestra.run.smithi144.stderr: 92050K .......... .......... .......... .......... .......... 99% 85.5M 0s 2024-06-04T16:14:28.873 INFO:teuthology.orchestra.run.smithi144.stderr: 92100K .......... .......... .......... .......... .......... 99% 117M 0s 2024-06-04T16:14:28.873 INFO:teuthology.orchestra.run.smithi144.stderr: 92150K .......... .......... .......... .......... .......... 99% 109M 0s 2024-06-04T16:14:28.873 INFO:teuthology.orchestra.run.smithi144.stderr: 92200K .......... .......... .......... .......... .......... 99% 115M 0s 2024-06-04T16:14:28.873 INFO:teuthology.orchestra.run.smithi144.stderr: 92250K .......... .......... .......... .......... .......... 99% 106M 0s 2024-06-04T16:14:28.873 INFO:teuthology.orchestra.run.smithi144.stderr: 92300K .......... .......... .......... .......... .......... 99% 129M 0s 2024-06-04T16:14:28.874 INFO:teuthology.orchestra.run.smithi144.stderr: 92350K .......... .......... .......... .......... .......... 99% 93.4M 0s 2024-06-04T16:14:28.874 INFO:teuthology.orchestra.run.smithi144.stderr: 92400K .......... .......... .......... .......... .......... 99% 126M 0s 2024-06-04T16:14:28.874 INFO:teuthology.orchestra.run.smithi144.stderr: 92450K .......... .......... .......... .......... .......... 99% 94.6M 0s 2024-06-04T16:14:28.874 INFO:teuthology.orchestra.run.smithi144.stderr: 92500K .......... .......... .......... .......... .......... 99% 102M 0s 2024-06-04T16:14:28.874 INFO:teuthology.orchestra.run.smithi144.stderr: 92550K .......... .......... .......... .......... .......... 99% 115M 0s 2024-06-04T16:14:28.874 INFO:teuthology.orchestra.run.smithi144.stderr: 92600K .......... .......... .......... .......... .......... 99% 106M 0s 2024-06-04T16:14:28.874 INFO:teuthology.orchestra.run.smithi144.stderr: 92650K .......... .......... .......... .......... .......... 99% 108M 0s 2024-06-04T16:14:28.874 INFO:teuthology.orchestra.run.smithi144.stderr: 92700K .......... .......... .......... .......... .......... 99% 122M 0s 2024-06-04T16:14:28.874 INFO:teuthology.orchestra.run.smithi144.stderr: 92750K .......... .......... .......... .......... .......... 99% 125M 0s 2024-06-04T16:14:28.874 INFO:teuthology.orchestra.run.smithi144.stderr: 92800K .......... .......... .......... .......... .......... 99% 111M 0s 2024-06-04T16:14:28.874 INFO:teuthology.orchestra.run.smithi144.stderr: 92850K .......... .......... .......... .......... .......... 99% 76.8M 0s 2024-06-04T16:14:28.874 INFO:teuthology.orchestra.run.smithi144.stderr: 92900K 100% 134G=1.1s 2024-06-04T16:14:28.874 INFO:teuthology.orchestra.run.smithi144.stderr: 2024-06-04T16:14:28.875 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04 16:14:28 (86.2 MB/s) - ‘gradle-6.0.1-bin.zip’ saved [95129672/95129672] 2024-06-04T16:14:28.875 INFO:teuthology.orchestra.run.smithi144.stderr: 2024-06-04T16:14:28.896 INFO:teuthology.orchestra.run.smithi144.stdout:Archive: gradle-6.0.1-bin.zip 2024-06-04T16:14:28.897 INFO:teuthology.orchestra.run.smithi144.stdout: creating: /opt/gradle/gradle-6.0.1/ 2024-06-04T16:14:28.897 INFO:teuthology.orchestra.run.smithi144.stdout: inflating: /opt/gradle/gradle-6.0.1/getting-started.html 2024-06-04T16:14:28.897 INFO:teuthology.orchestra.run.smithi144.stdout: inflating: /opt/gradle/gradle-6.0.1/LICENSE 2024-06-04T16:14:28.897 INFO:teuthology.orchestra.run.smithi144.stdout: inflating: /opt/gradle/gradle-6.0.1/NOTICE 2024-06-04T16:14:28.897 INFO:teuthology.orchestra.run.smithi144.stdout: creating: /opt/gradle/gradle-6.0.1/init.d/ 2024-06-04T16:14:28.897 INFO:teuthology.orchestra.run.smithi144.stdout: inflating: /opt/gradle/gradle-6.0.1/init.d/readme.txt 2024-06-04T16:14:28.897 INFO:teuthology.orchestra.run.smithi144.stdout: creating: /opt/gradle/gradle-6.0.1/bin/ 2024-06-04T16:14:28.897 INFO:teuthology.orchestra.run.smithi144.stdout: inflating: /opt/gradle/gradle-6.0.1/bin/gradle 2024-06-04T16:14:28.897 INFO:teuthology.orchestra.run.smithi144.stdout: inflating: /opt/gradle/gradle-6.0.1/bin/gradle.bat 2024-06-04T16:14:28.897 INFO:teuthology.orchestra.run.smithi144.stdout: creating: /opt/gradle/gradle-6.0.1/lib/ 2024-06-04T16:14:28.897 INFO:teuthology.orchestra.run.smithi144.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-api-metadata-6.0.1.jar 2024-06-04T16:14:28.898 INFO:teuthology.orchestra.run.smithi144.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-launcher-6.0.1.jar 2024-06-04T16:14:28.898 INFO:teuthology.orchestra.run.smithi144.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-runtime-api-info-6.0.1.jar 2024-06-04T16:14:28.898 INFO:teuthology.orchestra.run.smithi144.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-kotlin-dsl-6.0.1.jar 2024-06-04T16:14:28.898 INFO:teuthology.orchestra.run.smithi144.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-tooling-api-6.0.1.jar 2024-06-04T16:14:28.898 INFO:teuthology.orchestra.run.smithi144.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-wrapper-6.0.1.jar 2024-06-04T16:14:28.898 INFO:teuthology.orchestra.run.smithi144.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-installation-beacon-6.0.1.jar 2024-06-04T16:14:28.898 INFO:teuthology.orchestra.run.smithi144.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-bootstrap-6.0.1.jar 2024-06-04T16:14:28.898 INFO:teuthology.orchestra.run.smithi144.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-core-6.0.1.jar 2024-06-04T16:14:28.898 INFO:teuthology.orchestra.run.smithi144.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-file-collections-6.0.1.jar 2024-06-04T16:14:28.898 INFO:teuthology.orchestra.run.smithi144.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-model-groovy-6.0.1.jar 2024-06-04T16:14:28.898 INFO:teuthology.orchestra.run.smithi144.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-execution-6.0.1.jar 2024-06-04T16:14:28.898 INFO:teuthology.orchestra.run.smithi144.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-model-core-6.0.1.jar 2024-06-04T16:14:28.898 INFO:teuthology.orchestra.run.smithi144.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-build-cache-packaging-6.0.1.jar 2024-06-04T16:14:28.899 INFO:teuthology.orchestra.run.smithi144.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-build-cache-6.0.1.jar 2024-06-04T16:14:28.899 INFO:teuthology.orchestra.run.smithi144.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-core-api-6.0.1.jar 2024-06-04T16:14:28.899 INFO:teuthology.orchestra.run.smithi144.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-persistent-cache-6.0.1.jar 2024-06-04T16:14:28.899 INFO:teuthology.orchestra.run.smithi144.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-worker-processes-6.0.1.jar 2024-06-04T16:14:28.899 INFO:teuthology.orchestra.run.smithi144.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-logging-6.0.1.jar 2024-06-04T16:14:28.899 INFO:teuthology.orchestra.run.smithi144.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-jvm-services-6.0.1.jar 2024-06-04T16:14:28.899 INFO:teuthology.orchestra.run.smithi144.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-process-services-6.0.1.jar 2024-06-04T16:14:28.899 INFO:teuthology.orchestra.run.smithi144.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-resources-6.0.1.jar 2024-06-04T16:14:28.899 INFO:teuthology.orchestra.run.smithi144.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-messaging-6.0.1.jar 2024-06-04T16:14:28.899 INFO:teuthology.orchestra.run.smithi144.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-native-6.0.1.jar 2024-06-04T16:14:28.899 INFO:teuthology.orchestra.run.smithi144.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-base-services-groovy-6.0.1.jar 2024-06-04T16:14:28.899 INFO:teuthology.orchestra.run.smithi144.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-base-services-6.0.1.jar 2024-06-04T16:14:28.899 INFO:teuthology.orchestra.run.smithi144.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-build-option-6.0.1.jar 2024-06-04T16:14:28.900 INFO:teuthology.orchestra.run.smithi144.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-cli-6.0.1.jar 2024-06-04T16:14:28.900 INFO:teuthology.orchestra.run.smithi144.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-snapshots-6.0.1.jar 2024-06-04T16:14:28.900 INFO:teuthology.orchestra.run.smithi144.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-files-6.0.1.jar 2024-06-04T16:14:28.900 INFO:teuthology.orchestra.run.smithi144.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-kotlin-dsl-tooling-models-6.0.1.jar 2024-06-04T16:14:28.900 INFO:teuthology.orchestra.run.smithi144.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-compiler-embeddable-1.3.50-patched-for-gradle-6.0.1.jar 2024-06-04T16:14:28.900 INFO:teuthology.orchestra.run.smithi144.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-hashing-6.0.1.jar 2024-06-04T16:14:28.900 INFO:teuthology.orchestra.run.smithi144.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-pineapple-6.0.1.jar 2024-06-04T16:14:28.900 INFO:teuthology.orchestra.run.smithi144.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-docs-6.0.1.jar 2024-06-04T16:14:28.900 INFO:teuthology.orchestra.run.smithi144.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/groovy-all-1.3-2.5.8.jar 2024-06-04T16:14:28.900 INFO:teuthology.orchestra.run.smithi144.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/jul-to-slf4j-1.7.28.jar 2024-06-04T16:14:28.900 INFO:teuthology.orchestra.run.smithi144.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/log4j-over-slf4j-1.7.28.jar 2024-06-04T16:14:28.900 INFO:teuthology.orchestra.run.smithi144.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/jcl-over-slf4j-1.7.28.jar 2024-06-04T16:14:28.900 INFO:teuthology.orchestra.run.smithi144.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/slf4j-api-1.7.28.jar 2024-06-04T16:14:28.900 INFO:teuthology.orchestra.run.smithi144.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/guava-27.1-android.jar 2024-06-04T16:14:28.901 INFO:teuthology.orchestra.run.smithi144.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/commons-io-2.6.jar 2024-06-04T16:14:28.901 INFO:teuthology.orchestra.run.smithi144.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/commons-lang-2.6.jar 2024-06-04T16:14:28.901 INFO:teuthology.orchestra.run.smithi144.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/asm-commons-7.1.jar 2024-06-04T16:14:28.901 INFO:teuthology.orchestra.run.smithi144.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/asm-analysis-7.1.jar 2024-06-04T16:14:28.901 INFO:teuthology.orchestra.run.smithi144.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/asm-tree-7.1.jar 2024-06-04T16:14:28.901 INFO:teuthology.orchestra.run.smithi144.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/asm-7.1.jar 2024-06-04T16:14:28.901 INFO:teuthology.orchestra.run.smithi144.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/ant-1.10.7.jar 2024-06-04T16:14:28.901 INFO:teuthology.orchestra.run.smithi144.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-stdlib-jdk8-1.3.50.jar 2024-06-04T16:14:28.901 INFO:teuthology.orchestra.run.smithi144.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/javax.inject-1.jar 2024-06-04T16:14:28.901 INFO:teuthology.orchestra.run.smithi144.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-common-1.3.50.jar 2024-06-04T16:14:28.901 INFO:teuthology.orchestra.run.smithi144.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-jvm-1.3.50.jar 2024-06-04T16:14:28.901 INFO:teuthology.orchestra.run.smithi144.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-jvm-host-embeddable-1.3.50.jar 2024-06-04T16:14:28.901 INFO:teuthology.orchestra.run.smithi144.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-compiler-embeddable-1.3.50.jar 2024-06-04T16:14:28.902 INFO:teuthology.orchestra.run.smithi144.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-compiler-impl-embeddable-1.3.50.jar 2024-06-04T16:14:28.902 INFO:teuthology.orchestra.run.smithi144.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-sam-with-receiver-compiler-plugin-1.3.50.jar 2024-06-04T16:14:28.902 INFO:teuthology.orchestra.run.smithi144.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlinx-metadata-jvm-0.1.0.jar 2024-06-04T16:14:28.902 INFO:teuthology.orchestra.run.smithi144.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/commons-compress-1.19.jar 2024-06-04T16:14:28.902 INFO:teuthology.orchestra.run.smithi144.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/fastutil-8.3.0-min.jar 2024-06-04T16:14:28.902 INFO:teuthology.orchestra.run.smithi144.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/jansi-1.18.jar 2024-06-04T16:14:28.902 INFO:teuthology.orchestra.run.smithi144.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/jsr305-3.0.2.jar 2024-06-04T16:14:28.902 INFO:teuthology.orchestra.run.smithi144.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kryo-2.24.0.jar 2024-06-04T16:14:28.902 INFO:teuthology.orchestra.run.smithi144.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-0.18.jar 2024-06-04T16:14:28.902 INFO:teuthology.orchestra.run.smithi144.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/objenesis-2.6.jar 2024-06-04T16:14:28.902 INFO:teuthology.orchestra.run.smithi144.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/trove4j-1.0.20181211.jar 2024-06-04T16:14:28.902 INFO:teuthology.orchestra.run.smithi144.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/xml-apis-1.4.01.jar 2024-06-04T16:14:28.902 INFO:teuthology.orchestra.run.smithi144.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-reflect-1.3.50.jar 2024-06-04T16:14:28.903 INFO:teuthology.orchestra.run.smithi144.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-stdlib-jdk7-1.3.50.jar 2024-06-04T16:14:28.903 INFO:teuthology.orchestra.run.smithi144.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-stdlib-1.3.50.jar 2024-06-04T16:14:28.903 INFO:teuthology.orchestra.run.smithi144.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/annotations-13.0.jar 2024-06-04T16:14:28.903 INFO:teuthology.orchestra.run.smithi144.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/ant-launcher-1.10.7.jar 2024-06-04T16:14:28.903 INFO:teuthology.orchestra.run.smithi144.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/minlog-1.2.jar 2024-06-04T16:14:28.903 INFO:teuthology.orchestra.run.smithi144.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-script-runtime-1.3.50.jar 2024-06-04T16:14:28.903 INFO:teuthology.orchestra.run.smithi144.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-daemon-embeddable-1.3.50.jar 2024-06-04T16:14:28.903 INFO:teuthology.orchestra.run.smithi144.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/failureaccess-1.0.1.jar 2024-06-04T16:14:28.903 INFO:teuthology.orchestra.run.smithi144.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-stdlib-common-1.3.50.jar 2024-06-04T16:14:28.903 INFO:teuthology.orchestra.run.smithi144.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-freebsd-amd64-libcpp-0.18.jar 2024-06-04T16:14:28.903 INFO:teuthology.orchestra.run.smithi144.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-freebsd-amd64-libstdcpp-0.18.jar 2024-06-04T16:14:28.903 INFO:teuthology.orchestra.run.smithi144.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-freebsd-i386-libcpp-0.18.jar 2024-06-04T16:14:28.903 INFO:teuthology.orchestra.run.smithi144.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-freebsd-i386-libstdcpp-0.18.jar 2024-06-04T16:14:28.904 INFO:teuthology.orchestra.run.smithi144.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-aarch64-0.18.jar 2024-06-04T16:14:28.904 INFO:teuthology.orchestra.run.smithi144.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-amd64-0.18.jar 2024-06-04T16:14:28.904 INFO:teuthology.orchestra.run.smithi144.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-i386-0.18.jar 2024-06-04T16:14:28.904 INFO:teuthology.orchestra.run.smithi144.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-osx-amd64-0.18.jar 2024-06-04T16:14:28.904 INFO:teuthology.orchestra.run.smithi144.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-windows-amd64-0.18.jar 2024-06-04T16:14:28.904 INFO:teuthology.orchestra.run.smithi144.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-windows-amd64-min-0.18.jar 2024-06-04T16:14:28.904 INFO:teuthology.orchestra.run.smithi144.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-windows-i386-0.18.jar 2024-06-04T16:14:28.904 INFO:teuthology.orchestra.run.smithi144.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-windows-i386-min-0.18.jar 2024-06-04T16:14:28.904 INFO:teuthology.orchestra.run.smithi144.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-aarch64-ncurses5-0.18.jar 2024-06-04T16:14:28.904 INFO:teuthology.orchestra.run.smithi144.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-amd64-ncurses5-0.18.jar 2024-06-04T16:14:28.904 INFO:teuthology.orchestra.run.smithi144.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-amd64-ncurses6-0.18.jar 2024-06-04T16:14:28.904 INFO:teuthology.orchestra.run.smithi144.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-i386-ncurses5-0.18.jar 2024-06-04T16:14:28.904 INFO:teuthology.orchestra.run.smithi144.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-i386-ncurses6-0.18.jar 2024-06-04T16:14:28.904 INFO:teuthology.orchestra.run.smithi144.stdout: creating: /opt/gradle/gradle-6.0.1/lib/plugins/ 2024-06-04T16:14:28.905 INFO:teuthology.orchestra.run.smithi144.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-antlr-6.0.1.jar 2024-06-04T16:14:28.905 INFO:teuthology.orchestra.run.smithi144.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-code-quality-6.0.1.jar 2024-06-04T16:14:28.905 INFO:teuthology.orchestra.run.smithi144.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-signing-6.0.1.jar 2024-06-04T16:14:28.905 INFO:teuthology.orchestra.run.smithi144.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-tooling-native-6.0.1.jar 2024-06-04T16:14:28.905 INFO:teuthology.orchestra.run.smithi144.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ide-native-6.0.1.jar 2024-06-04T16:14:28.905 INFO:teuthology.orchestra.run.smithi144.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-testing-native-6.0.1.jar 2024-06-04T16:14:28.905 INFO:teuthology.orchestra.run.smithi144.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-native-6.0.1.jar 2024-06-04T16:14:28.905 INFO:teuthology.orchestra.run.smithi144.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-kotlin-dsl-provider-plugins-6.0.1.jar 2024-06-04T16:14:28.905 INFO:teuthology.orchestra.run.smithi144.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-plugin-development-6.0.1.jar 2024-06-04T16:14:28.905 INFO:teuthology.orchestra.run.smithi144.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-maven-6.0.1.jar 2024-06-04T16:14:28.905 INFO:teuthology.orchestra.run.smithi144.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ide-play-6.0.1.jar 2024-06-04T16:14:28.905 INFO:teuthology.orchestra.run.smithi144.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ide-6.0.1.jar 2024-06-04T16:14:28.905 INFO:teuthology.orchestra.run.smithi144.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-scala-6.0.1.jar 2024-06-04T16:14:28.906 INFO:teuthology.orchestra.run.smithi144.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ear-6.0.1.jar 2024-06-04T16:14:28.906 INFO:teuthology.orchestra.run.smithi144.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-platform-play-6.0.1.jar 2024-06-04T16:14:28.906 INFO:teuthology.orchestra.run.smithi144.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-javascript-6.0.1.jar 2024-06-04T16:14:28.906 INFO:teuthology.orchestra.run.smithi144.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ivy-6.0.1.jar 2024-06-04T16:14:28.906 INFO:teuthology.orchestra.run.smithi144.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-jacoco-6.0.1.jar 2024-06-04T16:14:28.906 INFO:teuthology.orchestra.run.smithi144.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-build-init-6.0.1.jar 2024-06-04T16:14:28.906 INFO:teuthology.orchestra.run.smithi144.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-kotlin-dsl-tooling-builders-6.0.1.jar 2024-06-04T16:14:28.906 INFO:teuthology.orchestra.run.smithi144.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-plugins-6.0.1.jar 2024-06-04T16:14:28.906 INFO:teuthology.orchestra.run.smithi144.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-test-kit-6.0.1.jar 2024-06-04T16:14:28.906 INFO:teuthology.orchestra.run.smithi144.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-groovy-6.0.1.jar 2024-06-04T16:14:28.906 INFO:teuthology.orchestra.run.smithi144.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-scala-6.0.1.jar 2024-06-04T16:14:28.906 INFO:teuthology.orchestra.run.smithi144.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-testing-junit-platform-6.0.1.jar 2024-06-04T16:14:28.906 INFO:teuthology.orchestra.run.smithi144.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-tooling-api-builders-6.0.1.jar 2024-06-04T16:14:28.907 INFO:teuthology.orchestra.run.smithi144.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-testing-jvm-6.0.1.jar 2024-06-04T16:14:28.907 INFO:teuthology.orchestra.run.smithi144.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-java-6.0.1.jar 2024-06-04T16:14:28.907 INFO:teuthology.orchestra.run.smithi144.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-jvm-6.0.1.jar 2024-06-04T16:14:28.907 INFO:teuthology.orchestra.run.smithi144.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-platform-jvm-6.0.1.jar 2024-06-04T16:14:28.907 INFO:teuthology.orchestra.run.smithi144.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-platform-native-6.0.1.jar 2024-06-04T16:14:28.907 INFO:teuthology.orchestra.run.smithi144.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-diagnostics-6.0.1.jar 2024-06-04T16:14:28.907 INFO:teuthology.orchestra.run.smithi144.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-publish-6.0.1.jar 2024-06-04T16:14:28.907 INFO:teuthology.orchestra.run.smithi144.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-testing-base-6.0.1.jar 2024-06-04T16:14:28.908 INFO:teuthology.orchestra.run.smithi144.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-platform-base-6.0.1.jar 2024-06-04T16:14:28.908 INFO:teuthology.orchestra.run.smithi144.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-plugin-use-6.0.1.jar 2024-06-04T16:14:28.908 INFO:teuthology.orchestra.run.smithi144.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-instant-execution-6.0.1.jar 2024-06-04T16:14:28.908 INFO:teuthology.orchestra.run.smithi144.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-version-control-6.0.1.jar 2024-06-04T16:14:28.918 INFO:teuthology.orchestra.run.smithi144.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-dependency-management-6.0.1.jar 2024-06-04T16:14:28.918 INFO:teuthology.orchestra.run.smithi144.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-composite-builds-6.0.1.jar 2024-06-04T16:14:28.919 INFO:teuthology.orchestra.run.smithi144.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-reporting-6.0.1.jar 2024-06-04T16:14:28.919 INFO:teuthology.orchestra.run.smithi144.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-resources-s3-6.0.1.jar 2024-06-04T16:14:28.919 INFO:teuthology.orchestra.run.smithi144.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-resources-gcs-6.0.1.jar 2024-06-04T16:14:28.919 INFO:teuthology.orchestra.run.smithi144.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-build-cache-http-6.0.1.jar 2024-06-04T16:14:28.920 INFO:teuthology.orchestra.run.smithi144.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-resources-http-6.0.1.jar 2024-06-04T16:14:28.920 INFO:teuthology.orchestra.run.smithi144.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-resources-sftp-6.0.1.jar 2024-06-04T16:14:28.920 INFO:teuthology.orchestra.run.smithi144.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-build-profile-6.0.1.jar 2024-06-04T16:14:28.921 INFO:teuthology.orchestra.run.smithi144.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-workers-6.0.1.jar 2024-06-04T16:14:28.939 INFO:teuthology.orchestra.run.smithi144.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/org.eclipse.jgit-5.5.0.201909110433-r.jar 2024-06-04T16:14:28.939 INFO:teuthology.orchestra.run.smithi144.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/wagon-http-3.0.0.jar 2024-06-04T16:14:28.939 INFO:teuthology.orchestra.run.smithi144.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/wagon-http-shared-3.0.0.jar 2024-06-04T16:14:28.939 INFO:teuthology.orchestra.run.smithi144.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-api-services-storage-v1-rev136-1.25.0.jar 2024-06-04T16:14:28.941 INFO:teuthology.orchestra.run.smithi144.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-api-client-1.25.0.jar 2024-06-04T16:14:28.941 INFO:teuthology.orchestra.run.smithi144.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/asm-util-7.1.jar 2024-06-04T16:14:28.949 INFO:teuthology.orchestra.run.smithi144.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/ivy-2.3.0.jar 2024-06-04T16:14:28.951 INFO:teuthology.orchestra.run.smithi144.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-compat-3.0.4.jar 2024-06-04T16:14:28.955 INFO:teuthology.orchestra.run.smithi144.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-core-3.0.4.jar 2024-06-04T16:14:28.955 INFO:teuthology.orchestra.run.smithi144.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/pmaven-common-0.8-20100325.jar 2024-06-04T16:14:28.955 INFO:teuthology.orchestra.run.smithi144.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/pmaven-groovy-0.8-20100325.jar 2024-06-04T16:14:28.956 INFO:teuthology.orchestra.run.smithi144.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/wagon-file-3.0.0.jar 2024-06-04T16:14:28.957 INFO:teuthology.orchestra.run.smithi144.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-container-default-1.7.1.jar 2024-06-04T16:14:28.957 INFO:teuthology.orchestra.run.smithi144.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-connector-wagon-1.13.1.jar 2024-06-04T16:14:28.959 INFO:teuthology.orchestra.run.smithi144.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/bcpg-jdk15on-1.63.jar 2024-06-04T16:14:28.967 INFO:teuthology.orchestra.run.smithi144.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/rhino-1.7.10.jar 2024-06-04T16:14:28.969 INFO:teuthology.orchestra.run.smithi144.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gson-2.8.5.jar 2024-06-04T16:14:28.970 INFO:teuthology.orchestra.run.smithi144.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/simple-4.1.21.jar 2024-06-04T16:14:28.971 INFO:teuthology.orchestra.run.smithi144.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jatl-0.2.3.jar 2024-06-04T16:14:28.971 INFO:teuthology.orchestra.run.smithi144.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-plugin-api-3.0.4.jar 2024-06-04T16:14:28.971 INFO:teuthology.orchestra.run.smithi144.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-oauth-client-1.25.0.jar 2024-06-04T16:14:28.972 INFO:teuthology.orchestra.run.smithi144.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-http-client-jackson2-1.25.0.jar 2024-06-04T16:14:28.974 INFO:teuthology.orchestra.run.smithi144.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-http-client-1.25.0.jar 2024-06-04T16:14:28.978 INFO:teuthology.orchestra.run.smithi144.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/testng-6.3.1.jar 2024-06-04T16:14:28.982 INFO:teuthology.orchestra.run.smithi144.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/snakeyaml-1.17.jar 2024-06-04T16:14:28.982 INFO:teuthology.orchestra.run.smithi144.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/dd-plist-1.21.jar 2024-06-04T16:14:28.982 INFO:teuthology.orchestra.run.smithi144.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/junit-4.12.jar 2024-06-04T16:14:28.985 INFO:teuthology.orchestra.run.smithi144.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/bsh-2.0b6.jar 2024-06-04T16:14:28.985 INFO:teuthology.orchestra.run.smithi144.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/junit-platform-launcher-1.3.1.jar 2024-06-04T16:14:28.992 INFO:teuthology.orchestra.run.smithi144.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aws-java-sdk-s3-1.11.633.jar 2024-06-04T16:14:28.995 INFO:teuthology.orchestra.run.smithi144.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aws-java-sdk-kms-1.11.633.jar 2024-06-04T16:14:29.001 INFO:teuthology.orchestra.run.smithi144.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aws-java-sdk-core-1.11.633.jar 2024-06-04T16:14:29.006 INFO:teuthology.orchestra.run.smithi144.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/httpclient-4.5.10.jar 2024-06-04T16:14:29.008 INFO:teuthology.orchestra.run.smithi144.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jcifs-1.3.17.jar 2024-06-04T16:14:29.009 INFO:teuthology.orchestra.run.smithi144.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/nekohtml-1.9.22.jar 2024-06-04T16:14:29.018 INFO:teuthology.orchestra.run.smithi144.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/xercesImpl-2.12.0.jar 2024-06-04T16:14:29.020 INFO:teuthology.orchestra.run.smithi144.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jsch-0.1.55.jar 2024-06-04T16:14:29.027 INFO:teuthology.orchestra.run.smithi144.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jaxb-impl-2.3.2.jar 2024-06-04T16:14:29.027 INFO:teuthology.orchestra.run.smithi144.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jmespath-java-1.11.633.jar 2024-06-04T16:14:29.035 INFO:teuthology.orchestra.run.smithi144.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jackson-databind-2.9.10.jar 2024-06-04T16:14:29.037 INFO:teuthology.orchestra.run.smithi144.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jackson-core-2.9.10.jar 2024-06-04T16:14:29.038 INFO:teuthology.orchestra.run.smithi144.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jackson-annotations-2.9.10.jar 2024-06-04T16:14:29.042 INFO:teuthology.orchestra.run.smithi144.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/joda-time-2.10.4.jar 2024-06-04T16:14:29.047 INFO:teuthology.orchestra.run.smithi144.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/bcpkix-jdk15on-1.61.jar 2024-06-04T16:14:29.076 INFO:teuthology.orchestra.run.smithi144.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/bcprov-jdk15on-1.63.jar 2024-06-04T16:14:29.078 INFO:teuthology.orchestra.run.smithi144.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/commons-codec-1.13.jar 2024-06-04T16:14:29.079 INFO:teuthology.orchestra.run.smithi144.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-aether-provider-3.0.4.jar 2024-06-04T16:14:29.080 INFO:teuthology.orchestra.run.smithi144.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-impl-1.13.1.jar 2024-06-04T16:14:29.081 INFO:teuthology.orchestra.run.smithi144.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-util-1.13.1.jar 2024-06-04T16:14:29.081 INFO:teuthology.orchestra.run.smithi144.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-spi-1.13.1.jar 2024-06-04T16:14:29.081 INFO:teuthology.orchestra.run.smithi144.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-api-1.13.1.jar 2024-06-04T16:14:29.082 INFO:teuthology.orchestra.run.smithi144.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/hamcrest-core-1.3.jar 2024-06-04T16:14:29.084 INFO:teuthology.orchestra.run.smithi144.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/httpcore-4.4.12.jar 2024-06-04T16:14:29.084 INFO:teuthology.orchestra.run.smithi144.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jcommander-1.72.jar 2024-06-04T16:14:29.085 INFO:teuthology.orchestra.run.smithi144.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jzlib-1.1.3.jar 2024-06-04T16:14:29.085 INFO:teuthology.orchestra.run.smithi144.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-artifact-3.0.4.jar 2024-06-04T16:14:29.086 INFO:teuthology.orchestra.run.smithi144.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-model-builder-3.0.4.jar 2024-06-04T16:14:29.087 INFO:teuthology.orchestra.run.smithi144.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-model-3.0.4.jar 2024-06-04T16:14:29.088 INFO:teuthology.orchestra.run.smithi144.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-repository-metadata-3.0.4.jar 2024-06-04T16:14:29.089 INFO:teuthology.orchestra.run.smithi144.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-settings-builder-3.0.4.jar 2024-06-04T16:14:29.089 INFO:teuthology.orchestra.run.smithi144.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-settings-3.0.4.jar 2024-06-04T16:14:29.089 INFO:teuthology.orchestra.run.smithi144.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-sec-dispatcher-1.3.jar 2024-06-04T16:14:29.089 INFO:teuthology.orchestra.run.smithi144.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-cipher-1.7.jar 2024-06-04T16:14:29.090 INFO:teuthology.orchestra.run.smithi144.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-classworlds-2.5.1.jar 2024-06-04T16:14:29.090 INFO:teuthology.orchestra.run.smithi144.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-component-annotations-1.5.5.jar 2024-06-04T16:14:29.090 INFO:teuthology.orchestra.run.smithi144.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-interpolation-1.14.jar 2024-06-04T16:14:29.090 INFO:teuthology.orchestra.run.smithi144.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/wagon-provider-api-3.0.0.jar 2024-06-04T16:14:29.092 INFO:teuthology.orchestra.run.smithi144.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-utils-3.1.0.jar 2024-06-04T16:14:29.093 INFO:teuthology.orchestra.run.smithi144.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/xbean-reflect-3.7.jar 2024-06-04T16:14:29.096 INFO:teuthology.orchestra.run.smithi144.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/ion-java-1.0.2.jar 2024-06-04T16:14:29.097 INFO:teuthology.orchestra.run.smithi144.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/junit-platform-engine-1.3.1.jar 2024-06-04T16:14:29.098 INFO:teuthology.orchestra.run.smithi144.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/junit-platform-commons-1.3.1.jar 2024-06-04T16:14:29.098 INFO:teuthology.orchestra.run.smithi144.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/apiguardian-api-1.0.0.jar 2024-06-04T16:14:29.098 INFO:teuthology.orchestra.run.smithi144.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/opentest4j-1.1.1.jar 2024-06-04T16:14:29.132 INFO:teuthology.orchestra.run.smithi144.stdout:export PATH=/opt/gradle/gradle-6.0.1/bin:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin 2024-06-04T16:14:29.492 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:14:29.492 INFO:teuthology.orchestra.run.smithi144.stdout:Welcome to Gradle 6.0.1! 2024-06-04T16:14:29.492 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:14:29.492 INFO:teuthology.orchestra.run.smithi144.stdout:Here are the highlights of this release: 2024-06-04T16:14:29.492 INFO:teuthology.orchestra.run.smithi144.stdout: - Substantial improvements in dependency management, including 2024-06-04T16:14:29.492 INFO:teuthology.orchestra.run.smithi144.stdout: - Publishing Gradle Module Metadata in addition to pom.xml 2024-06-04T16:14:29.492 INFO:teuthology.orchestra.run.smithi144.stdout: - Advanced control of transitive versions 2024-06-04T16:14:29.492 INFO:teuthology.orchestra.run.smithi144.stdout: - Support for optional features and dependencies 2024-06-04T16:14:29.492 INFO:teuthology.orchestra.run.smithi144.stdout: - Rules to tweak published metadata 2024-06-04T16:14:29.492 INFO:teuthology.orchestra.run.smithi144.stdout: - Support for Java 13 2024-06-04T16:14:29.492 INFO:teuthology.orchestra.run.smithi144.stdout: - Faster incremental Java and Groovy compilation 2024-06-04T16:14:29.493 INFO:teuthology.orchestra.run.smithi144.stdout: - New Zinc compiler for Scala 2024-06-04T16:14:29.493 INFO:teuthology.orchestra.run.smithi144.stdout: - VS2019 support 2024-06-04T16:14:29.493 INFO:teuthology.orchestra.run.smithi144.stdout: - Support for Gradle Enterprise plugin 3.0 2024-06-04T16:14:29.493 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:14:29.493 INFO:teuthology.orchestra.run.smithi144.stdout:For more details see https://docs.gradle.org/6.0.1/release-notes.html 2024-06-04T16:14:29.493 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:14:29.493 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:14:29.493 INFO:teuthology.orchestra.run.smithi144.stdout:------------------------------------------------------------ 2024-06-04T16:14:29.493 INFO:teuthology.orchestra.run.smithi144.stdout:Gradle 6.0.1 2024-06-04T16:14:29.493 INFO:teuthology.orchestra.run.smithi144.stdout:------------------------------------------------------------ 2024-06-04T16:14:29.493 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:14:29.493 INFO:teuthology.orchestra.run.smithi144.stdout:Build time: 2019-11-18 20:25:01 UTC 2024-06-04T16:14:29.493 INFO:teuthology.orchestra.run.smithi144.stdout:Revision: fad121066a68c4701acd362daf4287a7c309a0f5 2024-06-04T16:14:29.494 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:14:29.494 INFO:teuthology.orchestra.run.smithi144.stdout:Kotlin: 1.3.50 2024-06-04T16:14:29.494 INFO:teuthology.orchestra.run.smithi144.stdout:Groovy: 2.5.8 2024-06-04T16:14:29.494 INFO:teuthology.orchestra.run.smithi144.stdout:Ant: Apache Ant(TM) version 1.10.7 compiled on September 1 2019 2024-06-04T16:14:29.494 INFO:teuthology.orchestra.run.smithi144.stdout:JVM: 11.0.20.1 (Red Hat, Inc. 11.0.20.1+1-LTS) 2024-06-04T16:14:29.494 INFO:teuthology.orchestra.run.smithi144.stdout:OS: Linux 5.14.0-452.el9.x86_64 amd64 2024-06-04T16:14:29.494 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:14:29.495 DEBUG:tasks.s3tests_java:S3 Tests Java: BEGIN 2024-06-04T16:14:29.495 DEBUG:tasks.s3tests_java:S3 Tests Java: Cluster config is: ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2024-06-04T16:14:29.495 DEBUG:tasks.s3tests_java:S3 Tests Java: Host is: ubuntu@smithi144.front.sepia.ceph.com 2024-06-04T16:14:29.495 DEBUG:tasks.s3tests_java:S3 Tests Java: Cluster config is: ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2024-06-04T16:14:29.495 DEBUG:tasks.s3tests_java:S3 Tests Java: Host is: ubuntu@smithi177.front.sepia.ceph.com 2024-06-04T16:14:29.495 INFO:tasks.s3tests_java:S3 Tests Java: Creating S3 users... 2024-06-04T16:14:29.750 DEBUG:tasks.s3tests_java:S3 Tests Java: s3tests_conf is {'bucket_prefix': 'test-', 's3main': {'access_key': None, 'access_secret': None, 'region': 'mexico', 'endpoint': None, 'port': None, 'display_name': None, 'email': None, 'is_secure': None, 'SSE': 'AES256', 's3dir': 'folder', 'dir': '../data'}} 2024-06-04T16:14:29.750 DEBUG:tasks.s3tests_java:S3 Tests Java: Creating user tester.client.0 2024-06-04T16:14:29.751 DEBUG:tasks.s3tests_java:S3 Tests Java: s3tests_conf[s3main] is {'access_key': 'YHSYUBICXXUHFYSMCSKL', 'access_secret': 'OHdK8G5vtMF+oEo8m8iLCfjmSOJryxSOp+tqsn+kPP5vhsTCp7LXSw==', 'region': 'mexico', 'endpoint': 'smithi144.front.sepia.ceph.com:443', 'port': 443, 'display_name': 'Ms. tester.client.0', 'email': 'tester.client.0_test@test.test', 'is_secure': True, 'SSE': 'AES256', 's3dir': 'folder', 'dir': '../data', 'user_id': 'tester.client.0', 'host': 'smithi144.front.sepia.ceph.com'} 2024-06-04T16:14:29.751 DEBUG:tasks.s3tests_java:S3 Tests Java: Setion, User = s3main, tester.client.0 2024-06-04T16:14:29.751 INFO:tasks.s3tests_java:['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '-n', 'client.0', 'user', 'create', '--uid', 'tester.client.0', '--display-name', 'Ms. tester.client.0', '--access-key', 'YHSYUBICXXUHFYSMCSKL', '--secret', 'OHdK8G5vtMF+oEo8m8iLCfjmSOJryxSOp+tqsn+kPP5vhsTCp7LXSw==', '--email', 'tester.client.0_test@test.test', '--cluster', 'ceph'] 2024-06-04T16:14:29.751 DEBUG:teuthology.orchestra.run.smithi144:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid tester.client.0 --display-name 'Ms. tester.client.0' --access-key YHSYUBICXXUHFYSMCSKL --secret OHdK8G5vtMF+oEo8m8iLCfjmSOJryxSOp+tqsn+kPP5vhsTCp7LXSw== --email tester.client.0_test@test.test --cluster ceph 2024-06-04T16:14:29.814 INFO:teuthology.orchestra.run.smithi144.stderr:ignoring --setuser ceph since I am not root 2024-06-04T16:14:29.814 INFO:teuthology.orchestra.run.smithi144.stderr:ignoring --setgroup ceph since I am not root 2024-06-04T16:14:29.849 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:29.848+0000 7f074a936800 20 rados->read ofs=0 len=0 2024-06-04T16:14:29.850 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:29.849+0000 7f074a936800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:14:29.850 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:29.849+0000 7f074a936800 20 realm 2024-06-04T16:14:29.850 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:29.849+0000 7f074a936800 20 rados->read ofs=0 len=0 2024-06-04T16:14:29.850 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:29.849+0000 7f074a936800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:14:29.850 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:29.849+0000 7f074a936800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-06-04T16:14:29.850 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:29.849+0000 7f074a936800 20 rados->read ofs=0 len=0 2024-06-04T16:14:29.851 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:29.849+0000 7f074a936800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:14:29.851 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:29.849+0000 7f074a936800 20 rados->read ofs=0 len=0 2024-06-04T16:14:29.851 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:29.850+0000 7f074a936800 20 rados_obj.operate() r=0 bl.length=46 2024-06-04T16:14:29.852 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:29.850+0000 7f074a936800 20 rados->read ofs=0 len=0 2024-06-04T16:14:29.852 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:29.850+0000 7f074a936800 20 rados_obj.operate() r=0 bl.length=1139 2024-06-04T16:14:29.852 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:29.850+0000 7f074a936800 20 searching for the correct realm 2024-06-04T16:14:29.854 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:29.853+0000 7f0746ec3640 0 -- 172.21.15.144:0/44646815 >> [v2:172.21.15.144:6800/1453747520,v1:172.21.15.144:6801/1453747520] conn(0x7f073c080040 msgr2=0x7f073c080960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-06-04T16:14:30.058 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.057+0000 7f0746ec3640 0 -- 172.21.15.144:0/44646815 >> [v2:172.21.15.144:6824/166159729,v1:172.21.15.144:6825/166159729] conn(0x563d1d2eca00 msgr2=0x563d1d2eee10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-06-04T16:14:30.063 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.063+0000 7f074a936800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-06-04T16:14:30.063 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.063+0000 7f074a936800 20 RGWRados::pool_iterate: got zone_info.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767 2024-06-04T16:14:30.063 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.063+0000 7f074a936800 20 RGWRados::pool_iterate: got default.zone. 2024-06-04T16:14:30.064 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.063+0000 7f074a936800 20 RGWRados::pool_iterate: got zonegroup_info.abb22408-c332-4e28-8f7a-ff254ea2fed2 2024-06-04T16:14:30.064 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.063+0000 7f074a936800 20 RGWRados::pool_iterate: got zone_names.default 2024-06-04T16:14:30.064 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.063+0000 7f074a936800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-06-04T16:14:30.064 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.063+0000 7f074a936800 20 rados->read ofs=0 len=0 2024-06-04T16:14:30.065 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.063+0000 7f074a936800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:14:30.065 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.063+0000 7f074a936800 20 rados->read ofs=0 len=0 2024-06-04T16:14:30.065 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.063+0000 7f074a936800 20 rados_obj.operate() r=0 bl.length=46 2024-06-04T16:14:30.065 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.063+0000 7f074a936800 20 rados->read ofs=0 len=0 2024-06-04T16:14:30.065 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.064+0000 7f074a936800 20 rados_obj.operate() r=0 bl.length=470 2024-06-04T16:14:30.066 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.064+0000 7f074a936800 20 zone default found 2024-06-04T16:14:30.066 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.064+0000 7f074a936800 4 Realm: () 2024-06-04T16:14:30.066 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.064+0000 7f074a936800 4 ZoneGroup: default (abb22408-c332-4e28-8f7a-ff254ea2fed2) 2024-06-04T16:14:30.066 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.064+0000 7f074a936800 4 Zone: default (be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767) 2024-06-04T16:14:30.066 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.064+0000 7f074a936800 10 cannot find current period zonegroup using local zonegroup configuration 2024-06-04T16:14:30.066 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.064+0000 7f074a936800 20 zonegroup default 2024-06-04T16:14:30.066 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.064+0000 7f074a936800 20 rados->read ofs=0 len=0 2024-06-04T16:14:30.066 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.064+0000 7f074a936800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:14:30.066 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.064+0000 7f074a936800 20 rados->read ofs=0 len=0 2024-06-04T16:14:30.066 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.064+0000 7f074a936800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:14:30.066 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.064+0000 7f074a936800 20 rados->read ofs=0 len=0 2024-06-04T16:14:30.066 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.064+0000 7f074a936800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:14:30.066 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.064+0000 7f074a936800 20 started sync module instance, tier type = 2024-06-04T16:14:30.066 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.064+0000 7f074a936800 20 started zone id=be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767 (name=default) with tier type = 2024-06-04T16:14:30.075 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.074+0000 7f074a936800 20 add_watcher() i=0 2024-06-04T16:14:30.075 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.074+0000 7f074a936800 20 add_watcher() i=1 2024-06-04T16:14:30.075 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.074+0000 7f074a936800 20 add_watcher() i=2 2024-06-04T16:14:30.075 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.074+0000 7f074a936800 20 add_watcher() i=3 2024-06-04T16:14:30.075 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.074+0000 7f074a936800 20 add_watcher() i=4 2024-06-04T16:14:30.075 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.074+0000 7f074a936800 20 add_watcher() i=5 2024-06-04T16:14:30.075 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.074+0000 7f074a936800 20 add_watcher() i=6 2024-06-04T16:14:30.076 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.075+0000 7f074a936800 20 add_watcher() i=7 2024-06-04T16:14:30.076 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.075+0000 7f074a936800 2 all 8 watchers are set, enabling cache 2024-06-04T16:14:30.078 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.077+0000 7f05fcfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-06-04T16:14:30.078 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.077+0000 7f074a936800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-06-04T16:14:30.079 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.077+0000 7f074a936800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-06-04T16:14:30.079 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.077+0000 7f074a936800 5 note: GC not initialized 2024-06-04T16:14:30.080 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.078+0000 7f05777fe640 20 reqs_thread_entry: start 2024-06-04T16:14:30.081 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.078+0000 7f074a936800 20 init_complete bucket index max shards: 11 2024-06-04T16:14:30.081 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.078+0000 7f074a936800 20 Filter name: none 2024-06-04T16:14:30.081 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.078+0000 7f05757fa640 20 reqs_thread_entry: start 2024-06-04T16:14:30.081 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.078+0000 7f074a936800 10 cache get: name=default.rgw.meta+users.uid+tester.client.0 : miss 2024-06-04T16:14:30.081 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.078+0000 7f074a936800 20 rados->read ofs=0 len=0 2024-06-04T16:14:30.081 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.078+0000 7f074a936800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:14:30.081 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.078+0000 7f074a936800 10 cache put: name=default.rgw.meta+users.uid+tester.client.0 info.flags=0x0 2024-06-04T16:14:30.081 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.078+0000 7f074a936800 10 adding default.rgw.meta+users.uid+tester.client.0 to cache LRU end 2024-06-04T16:14:30.081 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.079+0000 7f074a936800 10 cache get: name=default.rgw.meta+users.email+tester.client.0_test@test.test : miss 2024-06-04T16:14:30.081 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.079+0000 7f074a936800 20 rados->read ofs=0 len=0 2024-06-04T16:14:30.081 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.079+0000 7f074a936800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:14:30.082 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.079+0000 7f074a936800 10 cache put: name=default.rgw.meta+users.email+tester.client.0_test@test.test info.flags=0x0 2024-06-04T16:14:30.082 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.079+0000 7f074a936800 10 adding default.rgw.meta+users.email+tester.client.0_test@test.test to cache LRU end 2024-06-04T16:14:30.082 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.079+0000 7f074a936800 10 cache get: name=default.rgw.meta+users.keys+YHSYUBICXXUHFYSMCSKL : miss 2024-06-04T16:14:30.082 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.079+0000 7f074a936800 20 rados->read ofs=0 len=0 2024-06-04T16:14:30.082 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.079+0000 7f074a936800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:14:30.082 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.079+0000 7f074a936800 10 cache put: name=default.rgw.meta+users.keys+YHSYUBICXXUHFYSMCSKL info.flags=0x0 2024-06-04T16:14:30.082 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.079+0000 7f074a936800 10 adding default.rgw.meta+users.keys+YHSYUBICXXUHFYSMCSKL to cache LRU end 2024-06-04T16:14:30.082 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.079+0000 7f074a936800 10 cache get: name=default.rgw.meta+users.keys+YHSYUBICXXUHFYSMCSKL : hit (negative entry) 2024-06-04T16:14:30.082 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.079+0000 7f074a936800 10 cache get: name=default.rgw.meta+users.keys+YHSYUBICXXUHFYSMCSKL : hit (negative entry) 2024-06-04T16:14:30.083 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.080+0000 7f074a936800 10 cache put: name=default.rgw.meta+users.uid+tester.client.0 info.flags=0x17 2024-06-04T16:14:30.084 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.080+0000 7f074a936800 10 moving default.rgw.meta+users.uid+tester.client.0 to cache LRU end 2024-06-04T16:14:30.084 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.080+0000 7f074a936800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:users.uid:tester.client.0, ofs0, ns] 2024-06-04T16:14:30.084 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.081+0000 7f0629ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1078036791397 cookie 94820482649728 notifier 6923 bl.length()=670 2024-06-04T16:14:30.084 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.081+0000 7f0629ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+tester.client.0 info.flags=0x17 2024-06-04T16:14:30.084 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.081+0000 7f0629ffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+tester.client.0 to cache LRU end 2024-06-04T16:14:30.084 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.082+0000 7f074a936800 10 cache put: name=default.rgw.meta+users.email+tester.client.0_test@test.test info.flags=0x7 2024-06-04T16:14:30.084 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.082+0000 7f074a936800 10 moving default.rgw.meta+users.email+tester.client.0_test@test.test to cache LRU end 2024-06-04T16:14:30.084 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.082+0000 7f074a936800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.email:tester.client.0_test@test.test, ofs0, ns] 2024-06-04T16:14:30.084 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.083+0000 7f0629ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1078036791316 cookie 94820482639968 notifier 6923 bl.length()=200 2024-06-04T16:14:30.084 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.083+0000 7f0629ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+tester.client.0_test@test.test info.flags=0x7 2024-06-04T16:14:30.085 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.083+0000 7f0629ffb640 10 rgw watcher librados: moving default.rgw.meta+users.email+tester.client.0_test@test.test to cache LRU end 2024-06-04T16:14:30.085 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.084+0000 7f074a936800 10 cache put: name=default.rgw.meta+users.keys+YHSYUBICXXUHFYSMCSKL info.flags=0x7 2024-06-04T16:14:30.085 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.084+0000 7f074a936800 10 moving default.rgw.meta+users.keys+YHSYUBICXXUHFYSMCSKL to cache LRU end 2024-06-04T16:14:30.085 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.084+0000 7f074a936800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.keys:YHSYUBICXXUHFYSMCSKL, ofs0, ns] 2024-06-04T16:14:30.086 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.085+0000 7f0629ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1078036791398 cookie 94820482652416 notifier 6923 bl.length()=189 2024-06-04T16:14:30.086 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.085+0000 7f0629ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+YHSYUBICXXUHFYSMCSKL info.flags=0x7 2024-06-04T16:14:30.086 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.085+0000 7f0629ffb640 10 rgw watcher librados: moving default.rgw.meta+users.keys+YHSYUBICXXUHFYSMCSKL to cache LRU end 2024-06-04T16:14:30.086 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-06-04T16:14:30.086 INFO:teuthology.orchestra.run.smithi144.stdout: "user_id": "tester.client.0", 2024-06-04T16:14:30.086 INFO:teuthology.orchestra.run.smithi144.stdout: "display_name": "Ms. tester.client.0", 2024-06-04T16:14:30.086 INFO:teuthology.orchestra.run.smithi144.stdout: "email": "tester.client.0_test@test.test", 2024-06-04T16:14:30.086 INFO:teuthology.orchestra.run.smithi144.stdout: "suspended": 0, 2024-06-04T16:14:30.087 INFO:teuthology.orchestra.run.smithi144.stdout: "max_buckets": 1000, 2024-06-04T16:14:30.087 INFO:teuthology.orchestra.run.smithi144.stdout: "subusers": [], 2024-06-04T16:14:30.087 INFO:teuthology.orchestra.run.smithi144.stdout: "keys": [ 2024-06-04T16:14:30.087 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-06-04T16:14:30.087 INFO:teuthology.orchestra.run.smithi144.stdout: "user": "tester.client.0", 2024-06-04T16:14:30.087 INFO:teuthology.orchestra.run.smithi144.stdout: "access_key": "YHSYUBICXXUHFYSMCSKL", 2024-06-04T16:14:30.087 INFO:teuthology.orchestra.run.smithi144.stdout: "secret_key": "OHdK8G5vtMF+oEo8m8iLCfjmSOJryxSOp+tqsn+kPP5vhsTCp7LXSw==", 2024-06-04T16:14:30.087 INFO:teuthology.orchestra.run.smithi144.stdout: "active": true, 2024-06-04T16:14:30.087 INFO:teuthology.orchestra.run.smithi144.stdout: "create_date": "2024-06-04T16:14:30.080397Z" 2024-06-04T16:14:30.087 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-06-04T16:14:30.087 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-06-04T16:14:30.087 INFO:teuthology.orchestra.run.smithi144.stdout: "swift_keys": [], 2024-06-04T16:14:30.087 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": [], 2024-06-04T16:14:30.088 INFO:teuthology.orchestra.run.smithi144.stdout: "op_mask": "read, write, delete", 2024-06-04T16:14:30.088 INFO:teuthology.orchestra.run.smithi144.stdout: "default_placement": "", 2024-06-04T16:14:30.088 INFO:teuthology.orchestra.run.smithi144.stdout: "default_storage_class": "", 2024-06-04T16:14:30.088 INFO:teuthology.orchestra.run.smithi144.stdout: "placement_tags": [], 2024-06-04T16:14:30.088 INFO:teuthology.orchestra.run.smithi144.stdout: "bucket_quota": { 2024-06-04T16:14:30.088 INFO:teuthology.orchestra.run.smithi144.stdout: "enabled": false, 2024-06-04T16:14:30.088 INFO:teuthology.orchestra.run.smithi144.stdout: "check_on_raw": false, 2024-06-04T16:14:30.088 INFO:teuthology.orchestra.run.smithi144.stdout: "max_size": -1, 2024-06-04T16:14:30.088 INFO:teuthology.orchestra.run.smithi144.stdout: "max_size_kb": 0, 2024-06-04T16:14:30.088 INFO:teuthology.orchestra.run.smithi144.stdout: "max_objects": -1 2024-06-04T16:14:30.088 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-06-04T16:14:30.088 INFO:teuthology.orchestra.run.smithi144.stdout: "user_quota": { 2024-06-04T16:14:30.088 INFO:teuthology.orchestra.run.smithi144.stdout: "enabled": false, 2024-06-04T16:14:30.089 INFO:teuthology.orchestra.run.smithi144.stdout: "check_on_raw": false, 2024-06-04T16:14:30.089 INFO:teuthology.orchestra.run.smithi144.stdout: "max_size": -1, 2024-06-04T16:14:30.089 INFO:teuthology.orchestra.run.smithi144.stdout: "max_size_kb": 0, 2024-06-04T16:14:30.089 INFO:teuthology.orchestra.run.smithi144.stdout: "max_objects": -1 2024-06-04T16:14:30.089 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-06-04T16:14:30.089 INFO:teuthology.orchestra.run.smithi144.stdout: "temp_url_keys": [], 2024-06-04T16:14:30.089 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "rgw", 2024-06-04T16:14:30.089 INFO:teuthology.orchestra.run.smithi144.stdout: "mfa_ids": [], 2024-06-04T16:14:30.089 INFO:teuthology.orchestra.run.smithi144.stdout: "account_id": "", 2024-06-04T16:14:30.089 INFO:teuthology.orchestra.run.smithi144.stdout: "path": "/", 2024-06-04T16:14:30.089 INFO:teuthology.orchestra.run.smithi144.stdout: "create_date": "2024-06-04T16:14:30.080381Z", 2024-06-04T16:14:30.089 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-06-04T16:14:30.089 INFO:teuthology.orchestra.run.smithi144.stdout: "group_ids": [] 2024-06-04T16:14:30.089 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-06-04T16:14:30.090 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:14:30.090 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.086+0000 7f05fcfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-06-04T16:14:30.090 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.088+0000 7f074a936800 20 remove_watcher() i=0 2024-06-04T16:14:30.090 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.088+0000 7f074a936800 2 removed watcher, disabling cache 2024-06-04T16:14:30.090 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.089+0000 7f074a936800 20 remove_watcher() i=1 2024-06-04T16:14:30.091 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.090+0000 7f074a936800 20 remove_watcher() i=2 2024-06-04T16:14:30.092 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.091+0000 7f074a936800 20 remove_watcher() i=3 2024-06-04T16:14:30.093 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.092+0000 7f074a936800 20 remove_watcher() i=4 2024-06-04T16:14:30.094 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.093+0000 7f074a936800 20 remove_watcher() i=5 2024-06-04T16:14:30.095 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.095+0000 7f074a936800 20 remove_watcher() i=6 2024-06-04T16:14:30.096 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.096+0000 7f074a936800 20 remove_watcher() i=7 2024-06-04T16:14:30.108 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-06-04T16:14:30.108 DEBUG:teuthology.orchestra.run.smithi144:> dd of=/home/ubuntu/cephtest/archive/s3-tests-java.client.0.conf 2024-06-04T16:14:30.139 INFO:tasks.s3tests_java:S3 Tests Java: Running tests... 2024-06-04T16:14:30.139 DEBUG:teuthology.orchestra.run.smithi144:> cp /home/ubuntu/cephtest/archive/s3-tests-java.client.0.conf /home/ubuntu/cephtest/s3-tests-java/config.properties 2024-06-04T16:14:30.205 DEBUG:teuthology.orchestra.run.smithi144:> radosgw-admin gc process --include-all 2024-06-04T16:14:30.297 INFO:teuthology.orchestra.run.smithi144.stderr:ignoring --setuser ceph since I am not root 2024-06-04T16:14:30.297 INFO:teuthology.orchestra.run.smithi144.stderr:ignoring --setgroup ceph since I am not root 2024-06-04T16:14:30.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.333+0000 7f5b2e1dc800 20 rados->read ofs=0 len=0 2024-06-04T16:14:30.336 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.335+0000 7f5b2e1dc800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:14:30.336 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.335+0000 7f5b2e1dc800 20 realm 2024-06-04T16:14:30.336 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.335+0000 7f5b2e1dc800 20 rados->read ofs=0 len=0 2024-06-04T16:14:30.336 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.335+0000 7f5b2e1dc800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:14:30.336 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.335+0000 7f5b2e1dc800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-06-04T16:14:30.336 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.335+0000 7f5b2e1dc800 20 rados->read ofs=0 len=0 2024-06-04T16:14:30.336 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.335+0000 7f5b2e1dc800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:14:30.337 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.335+0000 7f5b2e1dc800 20 rados->read ofs=0 len=0 2024-06-04T16:14:30.337 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.336+0000 7f5b2e1dc800 20 rados_obj.operate() r=0 bl.length=46 2024-06-04T16:14:30.337 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.336+0000 7f5b2e1dc800 20 rados->read ofs=0 len=0 2024-06-04T16:14:30.338 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.337+0000 7f5b2e1dc800 20 rados_obj.operate() r=0 bl.length=1139 2024-06-04T16:14:30.338 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.337+0000 7f5b2e1dc800 20 searching for the correct realm 2024-06-04T16:14:30.340 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.339+0000 7f5b2c4d2640 0 -- 172.21.15.144:0/1855274057 >> [v2:172.21.15.144:6800/1453747520,v1:172.21.15.144:6801/1453747520] conn(0x7f5b14077070 msgr2=0x7f5b1401b940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-06-04T16:14:30.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.544+0000 7f5b2c4d2640 0 -- 172.21.15.144:0/1855274057 >> [v2:172.21.15.144:6824/166159729,v1:172.21.15.144:6825/166159729] conn(0x56106f824c50 msgr2=0x56106f827060 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-06-04T16:14:30.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.549+0000 7f5b2e1dc800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-06-04T16:14:30.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.549+0000 7f5b2e1dc800 20 RGWRados::pool_iterate: got zone_info.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767 2024-06-04T16:14:30.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.549+0000 7f5b2e1dc800 20 RGWRados::pool_iterate: got default.zone. 2024-06-04T16:14:30.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.549+0000 7f5b2e1dc800 20 RGWRados::pool_iterate: got zonegroup_info.abb22408-c332-4e28-8f7a-ff254ea2fed2 2024-06-04T16:14:30.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.549+0000 7f5b2e1dc800 20 RGWRados::pool_iterate: got zone_names.default 2024-06-04T16:14:30.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.549+0000 7f5b2e1dc800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-06-04T16:14:30.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.550+0000 7f5b2e1dc800 20 rados->read ofs=0 len=0 2024-06-04T16:14:30.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.550+0000 7f5b2e1dc800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:14:30.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.550+0000 7f5b2e1dc800 20 rados->read ofs=0 len=0 2024-06-04T16:14:30.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.550+0000 7f5b2e1dc800 20 rados_obj.operate() r=0 bl.length=46 2024-06-04T16:14:30.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.550+0000 7f5b2e1dc800 20 rados->read ofs=0 len=0 2024-06-04T16:14:30.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.551+0000 7f5b2e1dc800 20 rados_obj.operate() r=0 bl.length=470 2024-06-04T16:14:30.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.551+0000 7f5b2e1dc800 20 zone default found 2024-06-04T16:14:30.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.551+0000 7f5b2e1dc800 4 Realm: () 2024-06-04T16:14:30.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.551+0000 7f5b2e1dc800 4 ZoneGroup: default (abb22408-c332-4e28-8f7a-ff254ea2fed2) 2024-06-04T16:14:30.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.551+0000 7f5b2e1dc800 4 Zone: default (be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767) 2024-06-04T16:14:30.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.551+0000 7f5b2e1dc800 10 cannot find current period zonegroup using local zonegroup configuration 2024-06-04T16:14:30.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.551+0000 7f5b2e1dc800 20 zonegroup default 2024-06-04T16:14:30.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.551+0000 7f5b2e1dc800 20 rados->read ofs=0 len=0 2024-06-04T16:14:30.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.551+0000 7f5b2e1dc800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:14:30.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.551+0000 7f5b2e1dc800 20 rados->read ofs=0 len=0 2024-06-04T16:14:30.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.551+0000 7f5b2e1dc800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:14:30.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.551+0000 7f5b2e1dc800 20 rados->read ofs=0 len=0 2024-06-04T16:14:30.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.552+0000 7f5b2e1dc800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:14:30.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.552+0000 7f5b2e1dc800 20 started sync module instance, tier type = 2024-06-04T16:14:30.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.552+0000 7f5b2e1dc800 20 started zone id=be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767 (name=default) with tier type = 2024-06-04T16:14:30.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.561+0000 7f5b2e1dc800 20 add_watcher() i=0 2024-06-04T16:14:30.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.561+0000 7f5b2e1dc800 20 add_watcher() i=1 2024-06-04T16:14:30.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.561+0000 7f5b2e1dc800 20 add_watcher() i=2 2024-06-04T16:14:30.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.561+0000 7f5b2e1dc800 20 add_watcher() i=3 2024-06-04T16:14:30.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.561+0000 7f5b2e1dc800 20 add_watcher() i=4 2024-06-04T16:14:30.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.561+0000 7f5b2e1dc800 20 add_watcher() i=5 2024-06-04T16:14:30.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.561+0000 7f5b2e1dc800 20 add_watcher() i=6 2024-06-04T16:14:30.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.562+0000 7f5b2e1dc800 20 add_watcher() i=7 2024-06-04T16:14:30.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.562+0000 7f5b2e1dc800 2 all 8 watchers are set, enabling cache 2024-06-04T16:14:30.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.563+0000 7f59e1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-06-04T16:14:30.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.564+0000 7f5b2e1dc800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-06-04T16:14:30.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.564+0000 7f5b2e1dc800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-06-04T16:14:30.601 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.599+0000 7f59e0fe1640 20 reqs_thread_entry: start 2024-06-04T16:14:30.601 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.600+0000 7f5b2e1dc800 20 init_complete bucket index max shards: 11 2024-06-04T16:14:30.601 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.600+0000 7f5b2e1dc800 20 Filter name: none 2024-06-04T16:14:30.601 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.600+0000 7f595a7fc640 20 reqs_thread_entry: start 2024-06-04T16:14:30.601 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.600+0000 7f5b2e1dc800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-06-04T16:14:30.602 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.601+0000 7f5b2e1dc800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:14:30.602 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.602+0000 7f5b2e1dc800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:14:30.604 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.602+0000 7f5b2e1dc800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-06-04T16:14:30.604 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.602+0000 7f5b2e1dc800 20 garbage collection: RGWGC::process iterating over entry tag='be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.17955365544246902861', time=2024-06-04T18:09:36.370134+0000, chain.objs.size()=4 2024-06-04T16:14:30.604 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.602+0000 7f5b2e1dc800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.10__multipart_foo.2~Y7vtrf-Gd6m-eNBlibsSA1ksskix6cx.1 2024-06-04T16:14:30.604 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.602+0000 7f5b2e1dc800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.10__multipart_foo.2~Y7vtrf-Gd6m-eNBlibsSA1ksskix6cx.2 2024-06-04T16:14:30.604 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.602+0000 7f5b2e1dc800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.10__multipart_foo.2~Y7vtrf-Gd6m-eNBlibsSA1ksskix6cx.3 2024-06-04T16:14:30.604 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.602+0000 7f5b2e1dc800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.10__multipart_foo.2~Y7vtrf-Gd6m-eNBlibsSA1ksskix6cx.4 2024-06-04T16:14:30.604 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.602+0000 7f5b2e1dc800 20 garbage collection: RGWGC::process iterating over entry tag='be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.13852691355450577467', time=2024-06-04T18:09:36.486124+0000, chain.objs.size()=5 2024-06-04T16:14:30.604 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.602+0000 7f5b2e1dc800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.16__multipart_foo-FROZEN.2~lkaHT8quzFXpVBXAABUXtSMFtHto0EW.1 2024-06-04T16:14:30.604 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.602+0000 7f5b2e1dc800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.16__shadow_foo-FROZEN.2~lkaHT8quzFXpVBXAABUXtSMFtHto0EW.1_1 2024-06-04T16:14:30.604 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.602+0000 7f5b2e1dc800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.16__multipart_foo-FROZEN.2~lkaHT8quzFXpVBXAABUXtSMFtHto0EW.2 2024-06-04T16:14:30.604 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.602+0000 7f5b2e1dc800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.16__shadow_foo-FROZEN.2~lkaHT8quzFXpVBXAABUXtSMFtHto0EW.2_1 2024-06-04T16:14:30.604 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.602+0000 7f5b2e1dc800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.16__multipart_foo-FROZEN.2~lkaHT8quzFXpVBXAABUXtSMFtHto0EW.3 2024-06-04T16:14:30.604 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.602+0000 7f5b2e1dc800 20 garbage collection: RGWGC::process iterating over entry tag='_eklndsPP-TZvGwaiLoWxvmZcRjUgRyk', time=2024-06-04T18:09:36.489929+0000, chain.objs.size()=3 2024-06-04T16:14:30.605 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.602+0000 7f5b2e1dc800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.16__shadow_.CoeSzcmfuYeAKPprIqxhEAyC-0b8sL2_0 2024-06-04T16:14:30.605 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.602+0000 7f5b2e1dc800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.16__shadow_.CoeSzcmfuYeAKPprIqxhEAyC-0b8sL2_1 2024-06-04T16:14:30.605 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.602+0000 7f5b2e1dc800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.16__shadow_.CoeSzcmfuYeAKPprIqxhEAyC-0b8sL2_2 2024-06-04T16:14:30.607 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.607+0000 7f5b2e1dc800 5 garbage collection: RGWGC::process removing entries, marker: 2024-06-04T16:14:30.611 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.610+0000 7f5b2e1dc800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-06-04T16:14:30.612 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.612+0000 7f5b2e1dc800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:14:30.613 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.612+0000 7f5b2e1dc800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:14:30.613 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.613+0000 7f5b2e1dc800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:14:30.619 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.614+0000 7f5b2e1dc800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-06-04T16:14:30.620 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.615+0000 7f5b2e1dc800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:14:30.620 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.616+0000 7f5b2e1dc800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:14:30.620 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.616+0000 7f5b2e1dc800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-06-04T16:14:30.620 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.616+0000 7f5b2e1dc800 20 garbage collection: RGWGC::process iterating over entry tag='be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.11735943295640401781', time=2024-06-04T18:09:36.392578+0000, chain.objs.size()=4 2024-06-04T16:14:30.620 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.616+0000 7f5b2e1dc800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.9__multipart_foo.2~LZjwLUgNEeDATXkOnRRuxQuN4KeNLE5.1 2024-06-04T16:14:30.620 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.616+0000 7f5b2e1dc800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.9__multipart_foo.2~LZjwLUgNEeDATXkOnRRuxQuN4KeNLE5.2 2024-06-04T16:14:30.620 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.616+0000 7f5b2e1dc800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.9__multipart_foo.2~LZjwLUgNEeDATXkOnRRuxQuN4KeNLE5.3 2024-06-04T16:14:30.620 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.616+0000 7f5b2e1dc800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.9__multipart_foo.2~LZjwLUgNEeDATXkOnRRuxQuN4KeNLE5.4 2024-06-04T16:14:30.620 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.616+0000 7f5b2e1dc800 20 garbage collection: RGWGC::process iterating over entry tag='_Dh3wgspyuk5_IWbBR5BAXlVJx96OcVL', time=2024-06-04T18:09:36.493746+0000, chain.objs.size()=3 2024-06-04T16:14:30.620 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.616+0000 7f5b2e1dc800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.16__shadow_.EGkYrQDmcaKl7ALvDrdsm9qS7UmEoEO_0 2024-06-04T16:14:30.621 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.616+0000 7f5b2e1dc800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.16__shadow_.EGkYrQDmcaKl7ALvDrdsm9qS7UmEoEO_1 2024-06-04T16:14:30.621 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.616+0000 7f5b2e1dc800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.16__shadow_.EGkYrQDmcaKl7ALvDrdsm9qS7UmEoEO_2 2024-06-04T16:14:30.621 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.616+0000 7f5b2e1dc800 20 garbage collection: RGWGC::process iterating over entry tag='_nwuYYM1n2pEECBoGhJzDiOn3mJIC2OR', time=2024-06-04T18:09:36.502271+0000, chain.objs.size()=2 2024-06-04T16:14:30.621 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.616+0000 7f5b2e1dc800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.16__shadow_.tDJPduOPCSTlie-VMaT5asBz0UP7OhT_1 2024-06-04T16:14:30.621 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.616+0000 7f5b2e1dc800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.16__shadow_.tDJPduOPCSTlie-VMaT5asBz0UP7OhT_2 2024-06-04T16:14:30.622 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.621+0000 7f5b2e1dc800 5 garbage collection: RGWGC::process removing entries, marker: 2024-06-04T16:14:30.628 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.627+0000 7f5b2e1dc800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-06-04T16:14:30.629 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.629+0000 7f5b2e1dc800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:14:30.630 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.629+0000 7f5b2e1dc800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:14:30.630 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.630+0000 7f5b2e1dc800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:14:30.631 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.631+0000 7f5b2e1dc800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-06-04T16:14:30.633 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.632+0000 7f5b2e1dc800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:14:30.633 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.633+0000 7f5b2e1dc800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:14:30.634 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.633+0000 7f5b2e1dc800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-06-04T16:14:30.635 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.633+0000 7f5b2e1dc800 20 garbage collection: RGWGC::process iterating over entry tag='be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.16__shadow_foo-LUKEWARM.2~KDdYPCgJb6LvMg0JlPPA9rxdK00r3FF.1_1_ab96485f4a51d5cde2c6c807a4fae7e1', time=2024-06-04T18:09:36.514890+0000, chain.objs.size()=5 2024-06-04T16:14:30.635 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.633+0000 7f5b2e1dc800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.16__multipart_foo-LUKEWARM.2~KDdYPCgJb6LvMg0JlPPA9rxdK00r3FF.1 2024-06-04T16:14:30.635 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.633+0000 7f5b2e1dc800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.16__shadow_foo-LUKEWARM.2~KDdYPCgJb6LvMg0JlPPA9rxdK00r3FF.1_1 2024-06-04T16:14:30.635 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.633+0000 7f5b2e1dc800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.16__multipart_foo-LUKEWARM.2~KDdYPCgJb6LvMg0JlPPA9rxdK00r3FF.2 2024-06-04T16:14:30.635 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.633+0000 7f5b2e1dc800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.16__shadow_foo-LUKEWARM.2~KDdYPCgJb6LvMg0JlPPA9rxdK00r3FF.2_1 2024-06-04T16:14:30.635 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.633+0000 7f5b2e1dc800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.16__multipart_foo-LUKEWARM.2~KDdYPCgJb6LvMg0JlPPA9rxdK00r3FF.3 2024-06-04T16:14:30.635 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.635+0000 7f5b2e1dc800 5 garbage collection: RGWGC::process removing entries, marker: 2024-06-04T16:14:30.638 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.637+0000 7f5b2e1dc800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-06-04T16:14:30.639 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.638+0000 7f5b2e1dc800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:14:30.639 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.639+0000 7f5b2e1dc800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:14:30.640 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.639+0000 7f5b2e1dc800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:14:30.641 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.640+0000 7f5b2e1dc800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-06-04T16:14:30.642 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.641+0000 7f5b2e1dc800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:14:30.642 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.642+0000 7f5b2e1dc800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:14:30.643 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.642+0000 7f5b2e1dc800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-06-04T16:14:30.643 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.642+0000 7f5b2e1dc800 20 garbage collection: RGWGC::process iterating over entry tag='be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.14773477925080379115', time=2024-06-04T18:09:36.348198+0000, chain.objs.size()=4 2024-06-04T16:14:30.643 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.642+0000 7f5b2e1dc800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.12__multipart_foo.2~F9RQEBgw4ueHwJew9KY_l-_LJWGSSsw.1 2024-06-04T16:14:30.643 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.642+0000 7f5b2e1dc800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.12__multipart_foo.2~F9RQEBgw4ueHwJew9KY_l-_LJWGSSsw.2 2024-06-04T16:14:30.644 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.642+0000 7f5b2e1dc800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.12__multipart_foo.2~F9RQEBgw4ueHwJew9KY_l-_LJWGSSsw.3 2024-06-04T16:14:30.644 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.642+0000 7f5b2e1dc800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.12__multipart_foo.2~F9RQEBgw4ueHwJew9KY_l-_LJWGSSsw.4 2024-06-04T16:14:30.645 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.644+0000 7f5b2e1dc800 5 garbage collection: RGWGC::process removing entries, marker: 2024-06-04T16:14:30.647 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.647+0000 7f5b2e1dc800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-06-04T16:14:30.648 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.648+0000 7f5b2e1dc800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:14:30.649 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.648+0000 7f5b2e1dc800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:14:30.649 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.648+0000 7f5b2e1dc800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-06-04T16:14:30.650 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.648+0000 7f5b2e1dc800 20 garbage collection: RGWGC::process iterating over entry tag='be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.5200684822471160745', time=2024-06-04T18:09:36.550584+0000, chain.objs.size()=5 2024-06-04T16:14:30.650 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.648+0000 7f5b2e1dc800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.14__multipart_foo-LUKEWARM.2~Q0eiY4dZv2_5JlktS3pb3VRb4O7AGgO.1 2024-06-04T16:14:30.650 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.648+0000 7f5b2e1dc800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.14__shadow_foo-LUKEWARM.2~Q0eiY4dZv2_5JlktS3pb3VRb4O7AGgO.1_1 2024-06-04T16:14:30.650 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.648+0000 7f5b2e1dc800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.14__multipart_foo-LUKEWARM.2~Q0eiY4dZv2_5JlktS3pb3VRb4O7AGgO.2 2024-06-04T16:14:30.650 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.649+0000 7f5b2e1dc800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.14__shadow_foo-LUKEWARM.2~Q0eiY4dZv2_5JlktS3pb3VRb4O7AGgO.2_1 2024-06-04T16:14:30.650 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.649+0000 7f5b2e1dc800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.14__multipart_foo-LUKEWARM.2~Q0eiY4dZv2_5JlktS3pb3VRb4O7AGgO.3 2024-06-04T16:14:30.652 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.651+0000 7f5b2e1dc800 5 garbage collection: RGWGC::process removing entries, marker: 2024-06-04T16:14:30.654 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.653+0000 7f5b2e1dc800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-06-04T16:14:30.655 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.654+0000 7f5b2e1dc800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:14:30.655 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.655+0000 7f5b2e1dc800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:14:30.656 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.655+0000 7f5b2e1dc800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-06-04T16:14:30.656 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.655+0000 7f5b2e1dc800 20 garbage collection: RGWGC::process iterating over entry tag='be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.8971505154207448580', time=2024-06-04T18:09:36.441509+0000, chain.objs.size()=2 2024-06-04T16:14:30.656 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.655+0000 7f5b2e1dc800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.15__shadow_.ugOrn690nemembk4D1Z3uKpeCIh7ByF_0 2024-06-04T16:14:30.656 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.655+0000 7f5b2e1dc800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.15__shadow_.ugOrn690nemembk4D1Z3uKpeCIh7ByF_1 2024-06-04T16:14:30.657 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.656+0000 7f5b2e1dc800 5 garbage collection: RGWGC::process removing entries, marker: 2024-06-04T16:14:30.659 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.658+0000 7f5b2e1dc800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-06-04T16:14:30.660 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.659+0000 7f5b2e1dc800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:14:30.660 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.660+0000 7f5b2e1dc800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:14:30.661 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.660+0000 7f5b2e1dc800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:14:30.662 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.661+0000 7f5b2e1dc800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-06-04T16:14:30.663 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.662+0000 7f5b2e1dc800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:14:30.663 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.663+0000 7f5b2e1dc800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:14:30.664 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.663+0000 7f5b2e1dc800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-06-04T16:14:30.664 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.663+0000 7f5b2e1dc800 20 garbage collection: RGWGC::process iterating over entry tag='_lwAHcTpdp0joNkRxr72-SnS73b6ogkv', time=2024-06-04T18:09:36.416339+0000, chain.objs.size()=1 2024-06-04T16:14:30.664 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.663+0000 7f5b2e1dc800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.15__shadow_.8WmVyD0RW3A4E7Lp8Um6gV-bOjagKVW_1 2024-06-04T16:14:30.665 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.664+0000 7f5b2e1dc800 5 garbage collection: RGWGC::process removing entries, marker: 2024-06-04T16:14:30.667 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.666+0000 7f5b2e1dc800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-06-04T16:14:30.668 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.668+0000 7f5b2e1dc800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:14:30.669 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.668+0000 7f5b2e1dc800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:14:30.669 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.668+0000 7f5b2e1dc800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:14:30.670 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.669+0000 7f5b2e1dc800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-06-04T16:14:30.671 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.670+0000 7f5b2e1dc800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:14:30.671 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.671+0000 7f5b2e1dc800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:14:30.672 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.671+0000 7f5b2e1dc800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-06-04T16:14:30.673 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.671+0000 7f5b2e1dc800 20 garbage collection: RGWGC::process iterating over entry tag='be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.10522384710002003206', time=2024-06-04T18:09:36.328430+0000, chain.objs.size()=4 2024-06-04T16:14:30.673 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.671+0000 7f5b2e1dc800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.11__multipart_foo.2~FtMAjISn4-tikF0udJCpeZ_yZbFyG3g.1 2024-06-04T16:14:30.673 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.671+0000 7f5b2e1dc800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.11__multipart_foo.2~FtMAjISn4-tikF0udJCpeZ_yZbFyG3g.2 2024-06-04T16:14:30.673 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.671+0000 7f5b2e1dc800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.11__multipart_foo.2~FtMAjISn4-tikF0udJCpeZ_yZbFyG3g.3 2024-06-04T16:14:30.673 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.671+0000 7f5b2e1dc800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.11__multipart_foo.2~FtMAjISn4-tikF0udJCpeZ_yZbFyG3g.4 2024-06-04T16:14:30.673 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.671+0000 7f5b2e1dc800 20 garbage collection: RGWGC::process iterating over entry tag='be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.16__shadow_foo-FROZEN.2~lkaHT8quzFXpVBXAABUXtSMFtHto0EW.1_1_5a1f086901129bc3689d9633db6219cb', time=2024-06-04T18:09:36.523321+0000, chain.objs.size()=5 2024-06-04T16:14:30.673 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.671+0000 7f5b2e1dc800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.16__multipart_foo-FROZEN.2~lkaHT8quzFXpVBXAABUXtSMFtHto0EW.1 2024-06-04T16:14:30.673 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.671+0000 7f5b2e1dc800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.16__shadow_foo-FROZEN.2~lkaHT8quzFXpVBXAABUXtSMFtHto0EW.1_1 2024-06-04T16:14:30.673 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.671+0000 7f5b2e1dc800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.16__multipart_foo-FROZEN.2~lkaHT8quzFXpVBXAABUXtSMFtHto0EW.2 2024-06-04T16:14:30.673 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.671+0000 7f5b2e1dc800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.16__shadow_foo-FROZEN.2~lkaHT8quzFXpVBXAABUXtSMFtHto0EW.2_1 2024-06-04T16:14:30.673 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.671+0000 7f5b2e1dc800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.16__multipart_foo-FROZEN.2~lkaHT8quzFXpVBXAABUXtSMFtHto0EW.3 2024-06-04T16:14:30.674 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.673+0000 7f5b2e1dc800 5 garbage collection: RGWGC::process removing entries, marker: 2024-06-04T16:14:30.677 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.676+0000 7f5b2e1dc800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-06-04T16:14:30.678 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.677+0000 7f5b2e1dc800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:14:30.679 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.678+0000 7f5b2e1dc800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:14:30.679 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.678+0000 7f5b2e1dc800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-06-04T16:14:30.679 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.678+0000 7f5b2e1dc800 20 garbage collection: RGWGC::process iterating over entry tag='be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.226221174536118357', time=2024-06-04T18:09:36.568561+0000, chain.objs.size()=3 2024-06-04T16:14:30.679 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.678+0000 7f5b2e1dc800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.13__shadow_.p-awvWEhdhrqxKvnvlGh3R9z6Kd32sX_0 2024-06-04T16:14:30.679 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.678+0000 7f5b2e1dc800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.13__shadow_.p-awvWEhdhrqxKvnvlGh3R9z6Kd32sX_1 2024-06-04T16:14:30.679 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.678+0000 7f5b2e1dc800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.13__shadow_.p-awvWEhdhrqxKvnvlGh3R9z6Kd32sX_2 2024-06-04T16:14:30.679 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.678+0000 7f5b2e1dc800 20 garbage collection: RGWGC::process iterating over entry tag='be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.17169267022589342066', time=2024-06-04T18:09:36.575256+0000, chain.objs.size()=3 2024-06-04T16:14:30.680 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.678+0000 7f5b2e1dc800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.13__shadow_.sFTaAHkZlO2kMQKibrPcM2TYbJr3Zt2_0 2024-06-04T16:14:30.680 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.678+0000 7f5b2e1dc800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.13__shadow_.sFTaAHkZlO2kMQKibrPcM2TYbJr3Zt2_1 2024-06-04T16:14:30.680 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.678+0000 7f5b2e1dc800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.13__shadow_.sFTaAHkZlO2kMQKibrPcM2TYbJr3Zt2_2 2024-06-04T16:14:30.682 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.681+0000 7f5b2e1dc800 5 garbage collection: RGWGC::process removing entries, marker: 2024-06-04T16:14:30.684 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.683+0000 7f5b2e1dc800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-06-04T16:14:30.686 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.685+0000 7f5b2e1dc800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:14:30.687 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.686+0000 7f5b2e1dc800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:14:30.687 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.686+0000 7f5b2e1dc800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-06-04T16:14:30.687 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.686+0000 7f5b2e1dc800 20 garbage collection: RGWGC::process iterating over entry tag='_ffwaJpUq8VhiAtsPrBM1b6DlfjMZt0k', time=2024-06-04T18:09:36.426561+0000, chain.objs.size()=2 2024-06-04T16:14:30.687 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.686+0000 7f5b2e1dc800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.15__shadow_.Qs_bBAzcNdKXlCYNIgCsdRFVOn2O1AO_0 2024-06-04T16:14:30.687 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.686+0000 7f5b2e1dc800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.15__shadow_.Qs_bBAzcNdKXlCYNIgCsdRFVOn2O1AO_1 2024-06-04T16:14:30.689 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.688+0000 7f5b2e1dc800 5 garbage collection: RGWGC::process removing entries, marker: 2024-06-04T16:14:30.691 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.690+0000 7f5b2e1dc800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-06-04T16:14:30.693 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.692+0000 7f5b2e1dc800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:14:30.693 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.692+0000 7f5b2e1dc800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:14:30.693 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.692+0000 7f5b2e1dc800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-06-04T16:14:30.694 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.692+0000 7f5b2e1dc800 20 garbage collection: RGWGC::process iterating over entry tag='_sZMISx1vyJkgodbciGC-m6JMHG8D-Qw', time=2024-06-04T18:09:36.411880+0000, chain.objs.size()=1 2024-06-04T16:14:30.694 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.692+0000 7f5b2e1dc800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.15__shadow_.JxiXc2iOV7LX8X-H3WxM3yPnF43fXiU_0 2024-06-04T16:14:30.694 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.693+0000 7f5b2e1dc800 20 garbage collection: RGWGC::process iterating over entry tag='_3PGdrFw1eIdvmG76Nk0Vah1OSstBQVO', time=2024-06-04T18:09:36.437217+0000, chain.objs.size()=1 2024-06-04T16:14:30.694 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.693+0000 7f5b2e1dc800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.15__shadow_.xa3cYOWRfq3U9-lo3NIIVnedPS4AT19_1 2024-06-04T16:14:30.694 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.694+0000 7f5b2e1dc800 5 garbage collection: RGWGC::process removing entries, marker: 2024-06-04T16:14:30.697 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.696+0000 7f5b2e1dc800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-06-04T16:14:30.699 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.698+0000 7f5b2e1dc800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:14:30.700 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.699+0000 7f5b2e1dc800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:14:30.700 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.699+0000 7f5b2e1dc800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:14:30.701 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.700+0000 7f5b2e1dc800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-06-04T16:14:30.702 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.701+0000 7f5b2e1dc800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:14:30.703 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.702+0000 7f5b2e1dc800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:14:30.703 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.702+0000 7f5b2e1dc800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-06-04T16:14:30.703 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.702+0000 7f5b2e1dc800 20 garbage collection: RGWGC::process iterating over entry tag='_j5ycqr-PIvlby7TfkKv-dIwAXsPq8Fv', time=2024-06-04T18:09:36.430450+0000, chain.objs.size()=2 2024-06-04T16:14:30.703 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.702+0000 7f5b2e1dc800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.15__shadow_._hXJWKhAv-yQdau8l_CecxjWy4Nqhc2_0 2024-06-04T16:14:30.704 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.702+0000 7f5b2e1dc800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.15__shadow_._hXJWKhAv-yQdau8l_CecxjWy4Nqhc2_1 2024-06-04T16:14:30.704 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.702+0000 7f5b2e1dc800 20 garbage collection: RGWGC::process iterating over entry tag='be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.16__multipart_foo-STANDARD.2~U0JhkapXSzFfp-gru_214XqQGZHhyYX.2_78f1e93757d27fcde2fa055560824590', time=2024-06-04T18:09:36.510424+0000, chain.objs.size()=3 2024-06-04T16:14:30.704 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.702+0000 7f5b2e1dc800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.16__multipart_foo-STANDARD.2~U0JhkapXSzFfp-gru_214XqQGZHhyYX.1 2024-06-04T16:14:30.704 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.702+0000 7f5b2e1dc800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.16__multipart_foo-STANDARD.2~U0JhkapXSzFfp-gru_214XqQGZHhyYX.2 2024-06-04T16:14:30.704 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.702+0000 7f5b2e1dc800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.16__multipart_foo-STANDARD.2~U0JhkapXSzFfp-gru_214XqQGZHhyYX.3 2024-06-04T16:14:30.706 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.705+0000 7f5b2e1dc800 5 garbage collection: RGWGC::process removing entries, marker: 2024-06-04T16:14:30.708 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.707+0000 7f5b2e1dc800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-06-04T16:14:30.709 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.708+0000 7f5b2e1dc800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:14:30.710 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.709+0000 7f5b2e1dc800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:14:30.710 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.709+0000 7f5b2e1dc800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:14:30.711 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.710+0000 7f5b2e1dc800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-06-04T16:14:30.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.711+0000 7f5b2e1dc800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:14:30.713 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.712+0000 7f5b2e1dc800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:14:30.713 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.712+0000 7f5b2e1dc800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:14:30.713 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.713+0000 7f5b2e1dc800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-06-04T16:14:30.715 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.714+0000 7f5b2e1dc800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:14:30.715 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.714+0000 7f5b2e1dc800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:14:30.716 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.715+0000 7f5b2e1dc800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:14:30.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.716+0000 7f5b2e1dc800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-06-04T16:14:30.718 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.717+0000 7f5b2e1dc800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:14:30.718 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.717+0000 7f5b2e1dc800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:14:30.718 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.718+0000 7f5b2e1dc800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:14:30.719 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.718+0000 7f5b2e1dc800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-06-04T16:14:30.720 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.720+0000 7f5b2e1dc800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:14:30.721 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.720+0000 7f5b2e1dc800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:14:30.721 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.720+0000 7f5b2e1dc800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:14:30.722 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.721+0000 7f5b2e1dc800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-06-04T16:14:30.725 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.724+0000 7f5b2e1dc800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:14:30.725 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.724+0000 7f5b2e1dc800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:14:30.725 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.724+0000 7f5b2e1dc800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:14:30.726 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.726+0000 7f5b2e1dc800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-06-04T16:14:30.728 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.727+0000 7f5b2e1dc800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:14:30.728 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.728+0000 7f5b2e1dc800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:14:30.729 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.728+0000 7f5b2e1dc800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-06-04T16:14:30.729 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.728+0000 7f5b2e1dc800 20 garbage collection: RGWGC::process iterating over entry tag='be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.15__shadow_.ugOrn690nemembk4D1Z3uKpeCIh7ByF_1_11cb8b22e63584017441743a3703ccfc', time=2024-06-04T18:09:36.448119+0000, chain.objs.size()=2 2024-06-04T16:14:30.729 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.728+0000 7f5b2e1dc800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.15__shadow_.ugOrn690nemembk4D1Z3uKpeCIh7ByF_0 2024-06-04T16:14:30.730 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.728+0000 7f5b2e1dc800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.15__shadow_.ugOrn690nemembk4D1Z3uKpeCIh7ByF_1 2024-06-04T16:14:30.730 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.728+0000 7f5b2e1dc800 20 garbage collection: RGWGC::process iterating over entry tag='_2ml_If96gJo0Up14rftVX-I7yO7qoeo', time=2024-06-04T18:09:36.478395+0000, chain.objs.size()=1 2024-06-04T16:14:30.730 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.728+0000 7f5b2e1dc800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.16__shadow_.bjZI61oHYBwdOcVmM10NdpWadVpVyGt_0 2024-06-04T16:14:30.730 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.728+0000 7f5b2e1dc800 20 garbage collection: RGWGC::process iterating over entry tag='_5zk1psZrkC2Nqo73FKuQeFIblxd_758', time=2024-06-04T18:09:36.482372+0000, chain.objs.size()=2 2024-06-04T16:14:30.730 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.728+0000 7f5b2e1dc800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.16__shadow_.JKHHvWqKZTiMh3Et-hYgJYq5BWWugTO_1 2024-06-04T16:14:30.730 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.728+0000 7f5b2e1dc800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.16__shadow_.JKHHvWqKZTiMh3Et-hYgJYq5BWWugTO_2 2024-06-04T16:14:30.730 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.728+0000 7f5b2e1dc800 20 garbage collection: RGWGC::process iterating over entry tag='__KSBYwZUmphFzYGrCz8YFR0zN_r7m7V', time=2024-06-04T18:09:36.518866+0000, chain.objs.size()=1 2024-06-04T16:14:30.730 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.728+0000 7f5b2e1dc800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.16__shadow_.ZNoD6u8yGZTCTYNrGIIfZ4XIJkXJV2g_0 2024-06-04T16:14:30.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.730+0000 7f5b2e1dc800 5 garbage collection: RGWGC::process removing entries, marker: 2024-06-04T16:14:30.734 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.733+0000 7f5b2e1dc800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-06-04T16:14:30.736 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.735+0000 7f5b2e1dc800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:14:30.736 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.735+0000 7f5b2e1dc800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:14:30.736 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.736+0000 7f5b2e1dc800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:14:30.738 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.737+0000 7f5b2e1dc800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-06-04T16:14:30.739 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.738+0000 7f5b2e1dc800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:14:30.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.739+0000 7f5b2e1dc800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:14:30.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.739+0000 7f5b2e1dc800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-06-04T16:14:30.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.739+0000 7f5b2e1dc800 20 garbage collection: RGWGC::process iterating over entry tag='be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.7020005450365376393', time=2024-06-04T18:09:36.506233+0000, chain.objs.size()=5 2024-06-04T16:14:30.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.739+0000 7f5b2e1dc800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.16__multipart_foo-LUKEWARM.2~KDdYPCgJb6LvMg0JlPPA9rxdK00r3FF.1 2024-06-04T16:14:30.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.739+0000 7f5b2e1dc800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.16__shadow_foo-LUKEWARM.2~KDdYPCgJb6LvMg0JlPPA9rxdK00r3FF.1_1 2024-06-04T16:14:30.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.739+0000 7f5b2e1dc800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.16__multipart_foo-LUKEWARM.2~KDdYPCgJb6LvMg0JlPPA9rxdK00r3FF.2 2024-06-04T16:14:30.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.739+0000 7f5b2e1dc800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.16__shadow_foo-LUKEWARM.2~KDdYPCgJb6LvMg0JlPPA9rxdK00r3FF.2_1 2024-06-04T16:14:30.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.739+0000 7f5b2e1dc800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.16__multipart_foo-LUKEWARM.2~KDdYPCgJb6LvMg0JlPPA9rxdK00r3FF.3 2024-06-04T16:14:30.741 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.740+0000 7f5b2e1dc800 5 garbage collection: RGWGC::process removing entries, marker: 2024-06-04T16:14:30.743 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.742+0000 7f5b2e1dc800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-06-04T16:14:30.744 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.743+0000 7f5b2e1dc800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:14:30.747 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.744+0000 7f5b2e1dc800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:14:30.747 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.744+0000 7f5b2e1dc800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-06-04T16:14:30.747 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.744+0000 7f5b2e1dc800 20 garbage collection: RGWGC::process iterating over entry tag='_-Kf3IqGiScurijHeoUCCRmcQHXPaDkB', time=2024-06-04T18:09:36.452717+0000, chain.objs.size()=1 2024-06-04T16:14:30.747 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.744+0000 7f5b2e1dc800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.15__shadow_.SvY_id66vIshqoAkANsI6bJOEnf9HfX_0 2024-06-04T16:14:30.747 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.744+0000 7f5b2e1dc800 20 garbage collection: RGWGC::process iterating over entry tag='be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.7978906938230085934', time=2024-06-04T18:09:36.542731+0000, chain.objs.size()=5 2024-06-04T16:14:30.747 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.744+0000 7f5b2e1dc800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.14__multipart_foo-FROZEN.2~XF8mWqTh5UnxYb-JtvLnMh75R5uqAO6.1 2024-06-04T16:14:30.747 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.744+0000 7f5b2e1dc800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.14__shadow_foo-FROZEN.2~XF8mWqTh5UnxYb-JtvLnMh75R5uqAO6.1_1 2024-06-04T16:14:30.747 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.744+0000 7f5b2e1dc800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.14__multipart_foo-FROZEN.2~XF8mWqTh5UnxYb-JtvLnMh75R5uqAO6.2 2024-06-04T16:14:30.747 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.744+0000 7f5b2e1dc800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.14__shadow_foo-FROZEN.2~XF8mWqTh5UnxYb-JtvLnMh75R5uqAO6.2_1 2024-06-04T16:14:30.748 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.744+0000 7f5b2e1dc800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.14__multipart_foo-FROZEN.2~XF8mWqTh5UnxYb-JtvLnMh75R5uqAO6.3 2024-06-04T16:14:30.748 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.747+0000 7f5b2e1dc800 5 garbage collection: RGWGC::process removing entries, marker: 2024-06-04T16:14:30.750 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.749+0000 7f5b2e1dc800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-06-04T16:14:30.751 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.750+0000 7f5b2e1dc800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:14:30.751 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.750+0000 7f5b2e1dc800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:14:30.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.751+0000 7f5b2e1dc800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-06-04T16:14:30.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.751+0000 7f5b2e1dc800 20 garbage collection: RGWGC::process iterating over entry tag='be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.13380312825509217859', time=2024-06-04T18:09:36.546726+0000, chain.objs.size()=5 2024-06-04T16:14:30.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.751+0000 7f5b2e1dc800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.14__multipart_foo-STANDARD.2~E6psHHZa3SBHUZDS18nIDEywWfzPpA-.1 2024-06-04T16:14:30.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.751+0000 7f5b2e1dc800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.14__shadow_foo-STANDARD.2~E6psHHZa3SBHUZDS18nIDEywWfzPpA-.1_1 2024-06-04T16:14:30.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.751+0000 7f5b2e1dc800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.14__multipart_foo-STANDARD.2~E6psHHZa3SBHUZDS18nIDEywWfzPpA-.2 2024-06-04T16:14:30.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.751+0000 7f5b2e1dc800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.14__shadow_foo-STANDARD.2~E6psHHZa3SBHUZDS18nIDEywWfzPpA-.2_1 2024-06-04T16:14:30.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.751+0000 7f5b2e1dc800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.14__multipart_foo-STANDARD.2~E6psHHZa3SBHUZDS18nIDEywWfzPpA-.3 2024-06-04T16:14:30.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.753+0000 7f5b2e1dc800 5 garbage collection: RGWGC::process removing entries, marker: 2024-06-04T16:14:30.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.756+0000 7f5b2e1dc800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-06-04T16:14:30.758 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.757+0000 7f5b2e1dc800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:14:30.758 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.757+0000 7f5b2e1dc800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:14:30.758 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.758+0000 7f5b2e1dc800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:14:30.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.758+0000 7f5b2e1dc800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-06-04T16:14:30.760 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.760+0000 7f5b2e1dc800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:14:30.761 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.760+0000 7f5b2e1dc800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:14:30.761 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.760+0000 7f5b2e1dc800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-06-04T16:14:30.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.760+0000 7f5b2e1dc800 20 garbage collection: RGWGC::process iterating over entry tag='be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.9878319443786539676', time=2024-06-04T18:09:36.420779+0000, chain.objs.size()=2 2024-06-04T16:14:30.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.760+0000 7f5b2e1dc800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.15__shadow_.ePvfnTEwm5fPwgkwsZoNuKRGCgJNIFx_0 2024-06-04T16:14:30.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.760+0000 7f5b2e1dc800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.15__shadow_.ePvfnTEwm5fPwgkwsZoNuKRGCgJNIFx_1 2024-06-04T16:14:30.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.760+0000 7f5b2e1dc800 20 garbage collection: RGWGC::process iterating over entry tag='be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.15__shadow_.ePvfnTEwm5fPwgkwsZoNuKRGCgJNIFx_1_ceb6dab11c68b86ee3a7ee2620893bd3', time=2024-06-04T18:09:36.456610+0000, chain.objs.size()=2 2024-06-04T16:14:30.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.760+0000 7f5b2e1dc800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.15__shadow_.ePvfnTEwm5fPwgkwsZoNuKRGCgJNIFx_0 2024-06-04T16:14:30.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.760+0000 7f5b2e1dc800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.15__shadow_.ePvfnTEwm5fPwgkwsZoNuKRGCgJNIFx_1 2024-06-04T16:14:30.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.760+0000 7f5b2e1dc800 20 garbage collection: RGWGC::process iterating over entry tag='be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.17535742630697210180', time=2024-06-04T18:09:36.497967+0000, chain.objs.size()=3 2024-06-04T16:14:30.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.760+0000 7f5b2e1dc800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.16__multipart_foo-STANDARD.2~U0JhkapXSzFfp-gru_214XqQGZHhyYX.1 2024-06-04T16:14:30.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.760+0000 7f5b2e1dc800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.16__multipart_foo-STANDARD.2~U0JhkapXSzFfp-gru_214XqQGZHhyYX.2 2024-06-04T16:14:30.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.761+0000 7f5b2e1dc800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.16__multipart_foo-STANDARD.2~U0JhkapXSzFfp-gru_214XqQGZHhyYX.3 2024-06-04T16:14:30.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.762+0000 7f5b2e1dc800 5 garbage collection: RGWGC::process removing entries, marker: 2024-06-04T16:14:30.766 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.765+0000 7f5b2e1dc800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-06-04T16:14:30.767 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.767+0000 7f5b2e1dc800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:14:30.768 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.767+0000 7f5b2e1dc800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:14:30.768 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.767+0000 7f5b2e1dc800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:14:30.770 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.769+0000 7f59e1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-06-04T16:14:30.772 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.771+0000 7f5b2e1dc800 20 remove_watcher() i=0 2024-06-04T16:14:30.772 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.771+0000 7f5b2e1dc800 2 removed watcher, disabling cache 2024-06-04T16:14:30.773 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.772+0000 7f5b2e1dc800 20 remove_watcher() i=1 2024-06-04T16:14:30.774 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.773+0000 7f5b2e1dc800 20 remove_watcher() i=2 2024-06-04T16:14:30.775 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.774+0000 7f5b2e1dc800 20 remove_watcher() i=3 2024-06-04T16:14:30.776 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.775+0000 7f5b2e1dc800 20 remove_watcher() i=4 2024-06-04T16:14:30.777 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.776+0000 7f5b2e1dc800 20 remove_watcher() i=5 2024-06-04T16:14:30.778 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.777+0000 7f5b2e1dc800 20 remove_watcher() i=6 2024-06-04T16:14:30.779 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.778+0000 7f5b2e1dc800 20 remove_watcher() i=7 2024-06-04T16:14:30.790 DEBUG:teuthology.orchestra.run.smithi144:> radosgw-admin gc process --include-all 2024-06-04T16:14:30.841 INFO:teuthology.orchestra.run.smithi144.stderr:ignoring --setuser ceph since I am not root 2024-06-04T16:14:30.842 INFO:teuthology.orchestra.run.smithi144.stderr:ignoring --setgroup ceph since I am not root 2024-06-04T16:14:30.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.877+0000 7fbeee936800 20 rados->read ofs=0 len=0 2024-06-04T16:14:30.880 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.878+0000 7fbeee936800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:14:30.880 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.878+0000 7fbeee936800 20 realm 2024-06-04T16:14:30.880 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.878+0000 7fbeee936800 20 rados->read ofs=0 len=0 2024-06-04T16:14:30.880 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.879+0000 7fbeee936800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:14:30.880 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.879+0000 7fbeee936800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-06-04T16:14:30.880 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.879+0000 7fbeee936800 20 rados->read ofs=0 len=0 2024-06-04T16:14:30.880 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.879+0000 7fbeee936800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:14:30.880 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.879+0000 7fbeee936800 20 rados->read ofs=0 len=0 2024-06-04T16:14:30.881 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.880+0000 7fbeee936800 20 rados_obj.operate() r=0 bl.length=46 2024-06-04T16:14:30.881 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.880+0000 7fbeee936800 20 rados->read ofs=0 len=0 2024-06-04T16:14:30.881 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.880+0000 7fbeee936800 20 rados_obj.operate() r=0 bl.length=1139 2024-06-04T16:14:30.881 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.880+0000 7fbeee936800 20 searching for the correct realm 2024-06-04T16:14:30.883 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:30.882+0000 7fbeeaec3640 0 -- 172.21.15.144:0/1343788617 >> [v2:172.21.15.144:6800/1453747520,v1:172.21.15.144:6801/1453747520] conn(0x7fbed409a040 msgr2=0x7fbed409a420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-06-04T16:14:31.087 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:31.087+0000 7fbeeaec3640 0 -- 172.21.15.144:0/1343788617 >> [v2:172.21.15.144:6824/166159729,v1:172.21.15.144:6825/166159729] conn(0x55c1bab80810 msgr2=0x55c1bab82c40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-06-04T16:14:31.107 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:31.091+0000 7fbeee936800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-06-04T16:14:31.107 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:31.091+0000 7fbeee936800 20 RGWRados::pool_iterate: got zone_info.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767 2024-06-04T16:14:31.107 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:31.091+0000 7fbeee936800 20 RGWRados::pool_iterate: got default.zone. 2024-06-04T16:14:31.107 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:31.091+0000 7fbeee936800 20 RGWRados::pool_iterate: got zonegroup_info.abb22408-c332-4e28-8f7a-ff254ea2fed2 2024-06-04T16:14:31.107 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:31.091+0000 7fbeee936800 20 RGWRados::pool_iterate: got zone_names.default 2024-06-04T16:14:31.107 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:31.091+0000 7fbeee936800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-06-04T16:14:31.107 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:31.091+0000 7fbeee936800 20 rados->read ofs=0 len=0 2024-06-04T16:14:31.107 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:31.091+0000 7fbeee936800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:14:31.107 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:31.091+0000 7fbeee936800 20 rados->read ofs=0 len=0 2024-06-04T16:14:31.107 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:31.092+0000 7fbeee936800 20 rados_obj.operate() r=0 bl.length=46 2024-06-04T16:14:31.108 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:31.092+0000 7fbeee936800 20 rados->read ofs=0 len=0 2024-06-04T16:14:31.108 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:31.092+0000 7fbeee936800 20 rados_obj.operate() r=0 bl.length=470 2024-06-04T16:14:31.108 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:31.092+0000 7fbeee936800 20 zone default found 2024-06-04T16:14:31.108 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:31.092+0000 7fbeee936800 4 Realm: () 2024-06-04T16:14:31.108 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:31.092+0000 7fbeee936800 4 ZoneGroup: default (abb22408-c332-4e28-8f7a-ff254ea2fed2) 2024-06-04T16:14:31.108 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:31.092+0000 7fbeee936800 4 Zone: default (be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767) 2024-06-04T16:14:31.108 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:31.092+0000 7fbeee936800 10 cannot find current period zonegroup using local zonegroup configuration 2024-06-04T16:14:31.108 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:31.092+0000 7fbeee936800 20 zonegroup default 2024-06-04T16:14:31.108 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:31.092+0000 7fbeee936800 20 rados->read ofs=0 len=0 2024-06-04T16:14:31.108 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:31.092+0000 7fbeee936800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:14:31.108 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:31.092+0000 7fbeee936800 20 rados->read ofs=0 len=0 2024-06-04T16:14:31.108 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:31.092+0000 7fbeee936800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:14:31.108 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:31.092+0000 7fbeee936800 20 rados->read ofs=0 len=0 2024-06-04T16:14:31.109 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:31.093+0000 7fbeee936800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:14:31.109 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:31.093+0000 7fbeee936800 20 started sync module instance, tier type = 2024-06-04T16:14:31.109 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:31.093+0000 7fbeee936800 20 started zone id=be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767 (name=default) with tier type = 2024-06-04T16:14:31.109 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:31.101+0000 7fbeee936800 20 add_watcher() i=0 2024-06-04T16:14:31.109 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:31.101+0000 7fbeee936800 20 add_watcher() i=1 2024-06-04T16:14:31.109 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:31.101+0000 7fbeee936800 20 add_watcher() i=2 2024-06-04T16:14:31.109 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:31.101+0000 7fbeee936800 20 add_watcher() i=3 2024-06-04T16:14:31.109 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:31.101+0000 7fbeee936800 20 add_watcher() i=4 2024-06-04T16:14:31.109 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:31.101+0000 7fbeee936800 20 add_watcher() i=5 2024-06-04T16:14:31.109 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:31.101+0000 7fbeee936800 20 add_watcher() i=6 2024-06-04T16:14:31.109 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:31.102+0000 7fbeee936800 20 add_watcher() i=7 2024-06-04T16:14:31.109 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:31.102+0000 7fbeee936800 2 all 8 watchers are set, enabling cache 2024-06-04T16:14:31.109 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:31.103+0000 7fbda0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-06-04T16:14:31.110 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:31.104+0000 7fbeee936800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-06-04T16:14:31.110 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:31.104+0000 7fbeee936800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-06-04T16:14:31.139 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:31.137+0000 7fbd1b7fe640 20 reqs_thread_entry: start 2024-06-04T16:14:31.139 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:31.138+0000 7fbeee936800 20 init_complete bucket index max shards: 11 2024-06-04T16:14:31.139 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:31.138+0000 7fbeee936800 20 Filter name: none 2024-06-04T16:14:31.139 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:31.138+0000 7fbd197fa640 20 reqs_thread_entry: start 2024-06-04T16:14:31.139 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:31.138+0000 7fbeee936800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-06-04T16:14:31.140 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:31.139+0000 7fbeee936800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:14:31.140 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:31.139+0000 7fbeee936800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:14:31.140 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:31.140+0000 7fbeee936800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:14:31.141 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:31.140+0000 7fbeee936800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-06-04T16:14:31.143 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:31.142+0000 7fbeee936800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:14:31.143 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:31.142+0000 7fbeee936800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:14:31.143 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:31.143+0000 7fbeee936800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:14:31.144 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:31.144+0000 7fbeee936800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-06-04T16:14:31.146 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:31.145+0000 7fbeee936800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:14:31.146 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:31.145+0000 7fbeee936800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:14:31.146 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:31.146+0000 7fbeee936800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:14:31.147 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:31.146+0000 7fbeee936800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-06-04T16:14:31.149 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:31.148+0000 7fbeee936800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:14:31.149 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:31.148+0000 7fbeee936800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:14:31.149 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:31.149+0000 7fbeee936800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:14:31.150 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:31.149+0000 7fbeee936800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-06-04T16:14:31.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:31.151+0000 7fbeee936800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:14:31.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:31.151+0000 7fbeee936800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:14:31.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:31.151+0000 7fbeee936800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:14:31.153 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:31.152+0000 7fbeee936800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-06-04T16:14:31.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:31.154+0000 7fbeee936800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:14:31.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:31.154+0000 7fbeee936800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:14:31.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:31.154+0000 7fbeee936800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:14:31.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:31.155+0000 7fbeee936800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-06-04T16:14:31.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:31.156+0000 7fbeee936800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:14:31.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:31.157+0000 7fbeee936800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:14:31.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:31.157+0000 7fbeee936800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:14:31.159 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:31.158+0000 7fbeee936800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-06-04T16:14:31.160 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:31.159+0000 7fbeee936800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:14:31.160 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:31.160+0000 7fbeee936800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:14:31.161 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:31.160+0000 7fbeee936800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:14:31.162 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:31.161+0000 7fbeee936800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-06-04T16:14:31.163 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:31.163+0000 7fbeee936800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:14:31.164 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:31.163+0000 7fbeee936800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:14:31.164 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:31.163+0000 7fbeee936800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:14:31.165 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:31.164+0000 7fbeee936800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-06-04T16:14:31.166 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:31.165+0000 7fbeee936800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:14:31.167 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:31.166+0000 7fbeee936800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:14:31.167 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:31.166+0000 7fbeee936800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:14:31.168 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:31.167+0000 7fbeee936800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-06-04T16:14:31.169 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:31.168+0000 7fbeee936800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:14:31.170 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:31.169+0000 7fbeee936800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:14:31.170 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:31.169+0000 7fbeee936800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:14:31.171 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:31.170+0000 7fbeee936800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-06-04T16:14:31.172 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:31.172+0000 7fbeee936800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:14:31.173 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:31.172+0000 7fbeee936800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:14:31.173 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:31.172+0000 7fbeee936800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:14:31.174 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:31.173+0000 7fbeee936800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-06-04T16:14:31.175 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:31.174+0000 7fbeee936800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:14:31.176 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:31.175+0000 7fbeee936800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:14:31.176 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:31.175+0000 7fbeee936800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:14:31.177 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:31.176+0000 7fbeee936800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-06-04T16:14:31.178 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:31.177+0000 7fbeee936800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:14:31.179 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:31.178+0000 7fbeee936800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:14:31.179 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:31.178+0000 7fbeee936800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:14:31.180 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:31.179+0000 7fbeee936800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-06-04T16:14:31.181 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:31.180+0000 7fbeee936800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:14:31.182 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:31.181+0000 7fbeee936800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:14:31.182 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:31.181+0000 7fbeee936800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:14:31.183 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:31.182+0000 7fbeee936800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-06-04T16:14:31.184 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:31.183+0000 7fbeee936800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:14:31.184 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:31.183+0000 7fbeee936800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:14:31.184 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:31.184+0000 7fbeee936800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:14:31.186 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:31.185+0000 7fbeee936800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-06-04T16:14:31.186 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:31.186+0000 7fbeee936800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:14:31.187 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:31.186+0000 7fbeee936800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:14:31.187 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:31.186+0000 7fbeee936800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:14:31.188 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:31.187+0000 7fbeee936800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-06-04T16:14:31.190 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:31.189+0000 7fbeee936800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:14:31.190 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:31.189+0000 7fbeee936800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:14:31.190 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:31.189+0000 7fbeee936800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:14:31.191 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:31.190+0000 7fbeee936800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-06-04T16:14:31.193 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:31.192+0000 7fbeee936800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:14:31.193 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:31.192+0000 7fbeee936800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:14:31.193 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:31.193+0000 7fbeee936800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:14:31.194 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:31.194+0000 7fbeee936800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-06-04T16:14:31.196 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:31.195+0000 7fbeee936800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:14:31.196 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:31.195+0000 7fbeee936800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:14:31.196 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:31.196+0000 7fbeee936800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:14:31.197 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:31.197+0000 7fbeee936800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-06-04T16:14:31.198 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:31.198+0000 7fbeee936800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:14:31.199 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:31.198+0000 7fbeee936800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:14:31.199 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:31.199+0000 7fbeee936800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:14:31.200 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:31.200+0000 7fbeee936800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-06-04T16:14:31.201 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:31.201+0000 7fbeee936800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:14:31.202 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:31.201+0000 7fbeee936800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:14:31.202 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:31.201+0000 7fbeee936800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:14:31.203 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:31.202+0000 7fbeee936800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-06-04T16:14:31.204 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:31.203+0000 7fbeee936800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:14:31.205 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:31.204+0000 7fbeee936800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:14:31.205 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:31.204+0000 7fbeee936800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:14:31.206 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:31.205+0000 7fbeee936800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-06-04T16:14:31.207 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:31.206+0000 7fbeee936800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:14:31.208 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:31.207+0000 7fbeee936800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:14:31.208 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:31.207+0000 7fbeee936800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:14:31.209 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:31.208+0000 7fbeee936800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-06-04T16:14:31.210 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:31.210+0000 7fbeee936800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:14:31.212 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:31.210+0000 7fbeee936800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:14:31.212 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:31.210+0000 7fbeee936800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:14:31.212 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:31.211+0000 7fbeee936800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-06-04T16:14:31.214 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:31.213+0000 7fbeee936800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:14:31.214 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:31.214+0000 7fbeee936800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:14:31.215 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:31.214+0000 7fbeee936800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:14:31.215 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:31.215+0000 7fbeee936800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-06-04T16:14:31.217 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:31.216+0000 7fbeee936800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:14:31.217 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:31.217+0000 7fbeee936800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:14:31.218 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:31.217+0000 7fbeee936800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:14:31.219 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:31.218+0000 7fbeee936800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-06-04T16:14:31.220 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:31.219+0000 7fbeee936800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:14:31.220 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:31.220+0000 7fbeee936800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:14:31.221 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:31.220+0000 7fbeee936800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:14:31.222 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:31.221+0000 7fbeee936800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-06-04T16:14:31.223 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:31.222+0000 7fbeee936800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:14:31.224 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:31.222+0000 7fbeee936800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:14:31.224 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:31.223+0000 7fbeee936800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:14:31.224 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:31.224+0000 7fbeee936800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-06-04T16:14:31.226 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:31.225+0000 7fbeee936800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:14:31.226 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:31.225+0000 7fbeee936800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:14:31.226 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:31.226+0000 7fbeee936800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:14:31.230 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:31.227+0000 7fbeee936800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-06-04T16:14:31.230 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:31.228+0000 7fbeee936800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:14:31.230 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:31.229+0000 7fbeee936800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:14:31.230 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:31.229+0000 7fbeee936800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:14:31.230 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:31.230+0000 7fbeee936800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-06-04T16:14:31.232 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:31.231+0000 7fbeee936800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:14:31.232 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:31.232+0000 7fbeee936800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:14:31.233 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:31.232+0000 7fbeee936800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:14:31.234 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:31.234+0000 7fbda0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-06-04T16:14:31.237 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:31.236+0000 7fbeee936800 20 remove_watcher() i=0 2024-06-04T16:14:31.237 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:31.236+0000 7fbeee936800 2 removed watcher, disabling cache 2024-06-04T16:14:31.238 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:31.237+0000 7fbeee936800 20 remove_watcher() i=1 2024-06-04T16:14:31.239 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:31.238+0000 7fbeee936800 20 remove_watcher() i=2 2024-06-04T16:14:31.240 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:31.239+0000 7fbeee936800 20 remove_watcher() i=3 2024-06-04T16:14:31.241 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:31.240+0000 7fbeee936800 20 remove_watcher() i=4 2024-06-04T16:14:31.242 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:31.241+0000 7fbeee936800 20 remove_watcher() i=5 2024-06-04T16:14:31.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:31.242+0000 7fbeee936800 20 remove_watcher() i=6 2024-06-04T16:14:31.244 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:14:31.243+0000 7fbeee936800 20 remove_watcher() i=7 2024-06-04T16:14:31.254 DEBUG:teuthology.orchestra.run.smithi144:> cd /home/ubuntu/cephtest/s3-tests-java && /opt/gradle/gradle/bin/gradle clean test --rerun-tasks --no-build-cache --tests AWS4Test 2024-06-04T16:14:31.735 INFO:teuthology.orchestra.run.smithi144.stdout:Starting a Gradle Daemon (subsequent builds will be faster) 2024-06-04T16:14:35.335 INFO:teuthology.orchestra.run.smithi144.stdout:> Task :clean UP-TO-DATE 2024-06-04T16:14:54.035 INFO:teuthology.orchestra.run.smithi144.stdout:> Task :compileJava 2024-06-04T16:14:54.035 INFO:teuthology.orchestra.run.smithi144.stdout:> Task :processResources 2024-06-04T16:14:54.035 INFO:teuthology.orchestra.run.smithi144.stdout:> Task :classes 2024-06-04T16:14:54.834 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:14:54.834 INFO:teuthology.orchestra.run.smithi144.stdout:> Task :compileTestJava 2024-06-04T16:14:54.835 INFO:teuthology.orchestra.run.smithi144.stderr:Note: /home/ubuntu/cephtest/s3-tests-java/src/test/java/BucketTest.java uses or overrides a deprecated API. 2024-06-04T16:14:54.835 INFO:teuthology.orchestra.run.smithi144.stderr:Note: Recompile with -Xlint:deprecation for details. 2024-06-04T16:14:54.835 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:14:54.835 INFO:teuthology.orchestra.run.smithi144.stdout:> Task :processTestResources NO-SOURCE 2024-06-04T16:14:54.836 INFO:teuthology.orchestra.run.smithi144.stdout:> Task :testClasses 2024-06-04T16:15:00.734 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:15:00.734 INFO:teuthology.orchestra.run.smithi144.stdout:> Task :test 2024-06-04T16:15:00.735 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:15:00.735 INFO:teuthology.orchestra.run.smithi144.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadLLAPIAWS4 STARTED 2024-06-04T16:15:01.434 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:15:01.434 INFO:teuthology.orchestra.run.smithi144.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadLLAPIAWS4 PASSED 2024-06-04T16:15:01.634 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:15:01.634 INFO:teuthology.orchestra.run.smithi144.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadNotFoundLLAPIAWS4 STARTED 2024-06-04T16:15:01.733 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:15:01.734 INFO:teuthology.orchestra.run.smithi144.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadNotFoundLLAPIAWS4 PASSED 2024-06-04T16:15:01.933 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:15:01.934 INFO:teuthology.orchestra.run.smithi144.stdout:suite > AWS4 tests > AWS4Test.testDownloadHLAPIAWS4 STARTED 2024-06-04T16:15:02.434 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:15:02.434 INFO:teuthology.orchestra.run.smithi144.stdout:suite > AWS4 tests > AWS4Test.testDownloadHLAPIAWS4 PASSED 2024-06-04T16:15:02.634 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:15:02.634 INFO:teuthology.orchestra.run.smithi144.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoBucketHLAPIAWS4 STARTED 2024-06-04T16:15:02.634 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:15:02.634 INFO:teuthology.orchestra.run.smithi144.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoBucketHLAPIAWS4 PASSED 2024-06-04T16:15:02.734 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:15:02.734 INFO:teuthology.orchestra.run.smithi144.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoKeyHLAPIAWS4 STARTED 2024-06-04T16:15:02.735 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:15:02.735 INFO:teuthology.orchestra.run.smithi144.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoKeyHLAPIAWS4 PASSED 2024-06-04T16:15:02.934 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:15:02.934 INFO:teuthology.orchestra.run.smithi144.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyHLAPIAWS4 STARTED 2024-06-04T16:15:03.334 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:15:03.334 INFO:teuthology.orchestra.run.smithi144.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyHLAPIAWS4 PASSED 2024-06-04T16:15:03.634 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:15:03.634 INFO:teuthology.orchestra.run.smithi144.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyMultipleSizesLLAPIAWS4 STARTED 2024-06-04T16:15:03.834 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:15:03.834 INFO:teuthology.orchestra.run.smithi144.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyMultipleSizesLLAPIAWS4 STANDARD_OUT 2024-06-04T16:15:03.834 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04 16:15:03,770 [Test worker] WARN com.amazonaws.util.Base64 - JAXB is unavailable. Will fallback to SDK implementation which may be less performant 2024-06-04T16:15:07.534 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:15:07.534 INFO:teuthology.orchestra.run.smithi144.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyMultipleSizesLLAPIAWS4 PASSED 2024-06-04T16:15:07.833 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:15:07.834 INFO:teuthology.orchestra.run.smithi144.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCBucketHLAPIAWS4 STARTED 2024-06-04T16:15:07.933 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:15:07.934 INFO:teuthology.orchestra.run.smithi144.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCBucketHLAPIAWS4 PASSED 2024-06-04T16:15:08.134 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:15:08.134 INFO:teuthology.orchestra.run.smithi144.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCKeyHLAPIAWS4 STARTED 2024-06-04T16:15:08.134 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:15:08.134 INFO:teuthology.orchestra.run.smithi144.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCKeyHLAPIAWS4 PASSED 2024-06-04T16:15:08.433 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:15:08.434 INFO:teuthology.orchestra.run.smithi144.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadHLAPIAWS4 STARTED 2024-06-04T16:15:08.733 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:15:08.734 INFO:teuthology.orchestra.run.smithi144.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadHLAPIAWS4 PASSED 2024-06-04T16:15:09.034 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:15:09.034 INFO:teuthology.orchestra.run.smithi144.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadNoBucketHLAPIAWS4 STARTED 2024-06-04T16:15:09.034 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:15:09.034 INFO:teuthology.orchestra.run.smithi144.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadNoBucketHLAPIAWS4 PASSED 2024-06-04T16:15:09.133 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:15:09.133 INFO:teuthology.orchestra.run.smithi144.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadWithPauseHLAPIAWS4 STARTED 2024-06-04T16:15:11.434 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:15:11.434 INFO:teuthology.orchestra.run.smithi144.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadWithPauseHLAPIAWS4 PASSED 2024-06-04T16:15:11.634 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:15:11.634 INFO:teuthology.orchestra.run.smithi144.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadHLAPIAWS4 STARTED 2024-06-04T16:15:12.034 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:15:12.034 INFO:teuthology.orchestra.run.smithi144.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadHLAPIAWS4 PASSED 2024-06-04T16:15:12.333 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:15:12.334 INFO:teuthology.orchestra.run.smithi144.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadIncorrectMissingPartLLAPIAWS4 STARTED 2024-06-04T16:15:12.534 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:15:12.534 INFO:teuthology.orchestra.run.smithi144.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadIncorrectMissingPartLLAPIAWS4 PASSED 2024-06-04T16:15:12.733 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:15:12.734 INFO:teuthology.orchestra.run.smithi144.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadMultipleSizesLLAPIAWS4 STARTED 2024-06-04T16:15:16.534 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:15:16.534 INFO:teuthology.orchestra.run.smithi144.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadMultipleSizesLLAPIAWS4 PASSED 2024-06-04T16:15:16.834 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:15:16.834 INFO:teuthology.orchestra.run.smithi144.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadOverwriteExistingObjectLLAPIAWS4 STARTED 2024-06-04T16:15:17.634 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:15:17.634 INFO:teuthology.orchestra.run.smithi144.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadOverwriteExistingObjectLLAPIAWS4 PASSED 2024-06-04T16:15:17.834 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:15:17.834 INFO:teuthology.orchestra.run.smithi144.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadSmallLLAPIAWS4 STARTED 2024-06-04T16:15:18.834 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:15:18.834 INFO:teuthology.orchestra.run.smithi144.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadSmallLLAPIAWS4 PASSED 2024-06-04T16:15:19.033 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:15:19.034 INFO:teuthology.orchestra.run.smithi144.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadWithPauseAWS4 STARTED 2024-06-04T16:15:19.333 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:15:19.334 INFO:teuthology.orchestra.run.smithi144.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadWithPauseAWS4 PASSED 2024-06-04T16:15:19.634 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:15:19.634 INFO:teuthology.orchestra.run.smithi144.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateAfterToday4AWS4 STARTED 2024-06-04T16:15:19.634 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:15:19.634 INFO:teuthology.orchestra.run.smithi144.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateAfterToday4AWS4 PASSED 2024-06-04T16:15:19.833 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:15:19.834 INFO:teuthology.orchestra.run.smithi144.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateBeforeEpochAWS4 STARTED 2024-06-04T16:15:19.834 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:15:19.834 INFO:teuthology.orchestra.run.smithi144.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateBeforeEpochAWS4 PASSED 2024-06-04T16:15:20.033 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:15:20.034 INFO:teuthology.orchestra.run.smithi144.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateBeforeToday4AWS4 STARTED 2024-06-04T16:15:20.133 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:15:20.133 INFO:teuthology.orchestra.run.smithi144.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateBeforeToday4AWS4 PASSED 2024-06-04T16:15:20.334 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:15:20.334 INFO:teuthology.orchestra.run.smithi144.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateEmptyAWS4 STARTED 2024-06-04T16:15:20.334 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:15:20.334 INFO:teuthology.orchestra.run.smithi144.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateEmptyAWS4 PASSED 2024-06-04T16:15:20.534 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:15:20.534 INFO:teuthology.orchestra.run.smithi144.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateInvalidAWS4 STARTED 2024-06-04T16:15:20.534 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:15:20.534 INFO:teuthology.orchestra.run.smithi144.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateInvalidAWS4 PASSED 2024-06-04T16:15:20.734 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:15:20.734 INFO:teuthology.orchestra.run.smithi144.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateNoneAWS4 STARTED 2024-06-04T16:15:20.734 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:15:20.734 INFO:teuthology.orchestra.run.smithi144.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateNoneAWS4 PASSED 2024-06-04T16:15:20.933 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:15:20.934 INFO:teuthology.orchestra.run.smithi144.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadMd5InvalidGarbageAWS4 STARTED 2024-06-04T16:15:21.034 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:15:21.034 INFO:teuthology.orchestra.run.smithi144.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadMd5InvalidGarbageAWS4 PASSED 2024-06-04T16:15:21.233 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:15:21.234 INFO:teuthology.orchestra.run.smithi144.stdout:suite > AWS4 tests > AWS4Test.testUploadFileHLAPIBigFileAWS4 STARTED 2024-06-04T16:15:21.734 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:15:21.734 INFO:teuthology.orchestra.run.smithi144.stdout:suite > AWS4 tests > AWS4Test.testUploadFileHLAPIBigFileAWS4 PASSED 2024-06-04T16:15:21.934 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:15:21.934 INFO:teuthology.orchestra.run.smithi144.stdout:---------------------------------------------------------------------- 2024-06-04T16:15:21.934 INFO:teuthology.orchestra.run.smithi144.stdout:| Results: SUCCESS (26 tests, 26 successes, 0 failures, 0 skipped) | 2024-06-04T16:15:21.934 INFO:teuthology.orchestra.run.smithi144.stdout:---------------------------------------------------------------------- 2024-06-04T16:15:21.999 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:15:21.999 INFO:teuthology.orchestra.run.smithi144.stdout:Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. 2024-06-04T16:15:22.000 INFO:teuthology.orchestra.run.smithi144.stdout:Use '--warning-mode all' to show the individual deprecation warnings. 2024-06-04T16:15:22.000 INFO:teuthology.orchestra.run.smithi144.stdout:See https://docs.gradle.org/6.0.1/userguide/command_line_interface.html#sec:command_line_warnings 2024-06-04T16:15:22.000 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:15:22.000 INFO:teuthology.orchestra.run.smithi144.stdout:BUILD SUCCESSFUL in 50s 2024-06-04T16:15:22.000 INFO:teuthology.orchestra.run.smithi144.stdout:5 actionable tasks: 4 executed, 1 up-to-date 2024-06-04T16:15:22.318 DEBUG:teuthology.orchestra.run.smithi144:> radosgw-admin gc process --include-all 2024-06-04T16:15:22.371 INFO:teuthology.orchestra.run.smithi144.stderr:ignoring --setuser ceph since I am not root 2024-06-04T16:15:22.371 INFO:teuthology.orchestra.run.smithi144.stderr:ignoring --setgroup ceph since I am not root 2024-06-04T16:15:22.408 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.407+0000 7f205160e800 20 rados->read ofs=0 len=0 2024-06-04T16:15:22.410 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.409+0000 7f205160e800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:15:22.410 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.409+0000 7f205160e800 20 realm 2024-06-04T16:15:22.410 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.409+0000 7f205160e800 20 rados->read ofs=0 len=0 2024-06-04T16:15:22.411 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.409+0000 7f205160e800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:15:22.411 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.409+0000 7f205160e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-06-04T16:15:22.411 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.409+0000 7f205160e800 20 rados->read ofs=0 len=0 2024-06-04T16:15:22.411 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.409+0000 7f205160e800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:15:22.411 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.409+0000 7f205160e800 20 rados->read ofs=0 len=0 2024-06-04T16:15:22.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.410+0000 7f205160e800 20 rados_obj.operate() r=0 bl.length=46 2024-06-04T16:15:22.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.410+0000 7f205160e800 20 rados->read ofs=0 len=0 2024-06-04T16:15:22.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.410+0000 7f205160e800 20 rados_obj.operate() r=0 bl.length=1139 2024-06-04T16:15:22.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.410+0000 7f205160e800 20 searching for the correct realm 2024-06-04T16:15:22.413 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.412+0000 7f204e902640 0 -- 172.21.15.144:0/4011384685 >> [v2:172.21.15.144:6816/2358575268,v1:172.21.15.144:6817/2358575268] conn(0x5576015bfcc0 msgr2=0x5576015c20f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-06-04T16:15:22.416 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.416+0000 7f204e902640 0 -- 172.21.15.144:0/4011384685 >> [v2:172.21.15.177:6808/2618477608,v1:172.21.15.177:6809/2618477608] conn(0x7f20380c5000 msgr2=0x7f203804b040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-06-04T16:15:22.626 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.623+0000 7f205160e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-06-04T16:15:22.626 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.623+0000 7f205160e800 20 RGWRados::pool_iterate: got zone_info.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767 2024-06-04T16:15:22.626 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.623+0000 7f205160e800 20 RGWRados::pool_iterate: got default.zone. 2024-06-04T16:15:22.626 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.623+0000 7f205160e800 20 RGWRados::pool_iterate: got zonegroup_info.abb22408-c332-4e28-8f7a-ff254ea2fed2 2024-06-04T16:15:22.627 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.623+0000 7f205160e800 20 RGWRados::pool_iterate: got zone_names.default 2024-06-04T16:15:22.627 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.623+0000 7f205160e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-06-04T16:15:22.627 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.623+0000 7f205160e800 20 rados->read ofs=0 len=0 2024-06-04T16:15:22.627 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.624+0000 7f205160e800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:15:22.627 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.624+0000 7f205160e800 20 rados->read ofs=0 len=0 2024-06-04T16:15:22.627 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.624+0000 7f205160e800 20 rados_obj.operate() r=0 bl.length=46 2024-06-04T16:15:22.627 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.624+0000 7f205160e800 20 rados->read ofs=0 len=0 2024-06-04T16:15:22.627 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.624+0000 7f205160e800 20 rados_obj.operate() r=0 bl.length=470 2024-06-04T16:15:22.627 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.624+0000 7f205160e800 20 zone default found 2024-06-04T16:15:22.627 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.624+0000 7f205160e800 4 Realm: () 2024-06-04T16:15:22.627 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.624+0000 7f205160e800 4 ZoneGroup: default (abb22408-c332-4e28-8f7a-ff254ea2fed2) 2024-06-04T16:15:22.628 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.624+0000 7f205160e800 4 Zone: default (be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767) 2024-06-04T16:15:22.628 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.624+0000 7f205160e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-06-04T16:15:22.628 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.624+0000 7f205160e800 20 zonegroup default 2024-06-04T16:15:22.628 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.624+0000 7f205160e800 20 rados->read ofs=0 len=0 2024-06-04T16:15:22.628 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.624+0000 7f205160e800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:15:22.628 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.624+0000 7f205160e800 20 rados->read ofs=0 len=0 2024-06-04T16:15:22.628 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.625+0000 7f205160e800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:15:22.628 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.625+0000 7f205160e800 20 rados->read ofs=0 len=0 2024-06-04T16:15:22.628 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.625+0000 7f205160e800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:15:22.628 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.625+0000 7f205160e800 20 started sync module instance, tier type = 2024-06-04T16:15:22.628 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.625+0000 7f205160e800 20 started zone id=be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767 (name=default) with tier type = 2024-06-04T16:15:22.635 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.634+0000 7f205160e800 20 add_watcher() i=0 2024-06-04T16:15:22.635 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.634+0000 7f205160e800 20 add_watcher() i=1 2024-06-04T16:15:22.635 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.634+0000 7f205160e800 20 add_watcher() i=2 2024-06-04T16:15:22.636 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.634+0000 7f205160e800 20 add_watcher() i=3 2024-06-04T16:15:22.636 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.634+0000 7f205160e800 20 add_watcher() i=4 2024-06-04T16:15:22.636 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.634+0000 7f205160e800 20 add_watcher() i=5 2024-06-04T16:15:22.636 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.634+0000 7f205160e800 20 add_watcher() i=6 2024-06-04T16:15:22.636 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.636+0000 7f205160e800 20 add_watcher() i=7 2024-06-04T16:15:22.636 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.636+0000 7f205160e800 2 all 8 watchers are set, enabling cache 2024-06-04T16:15:22.639 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.638+0000 7f1f05fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-06-04T16:15:22.639 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.638+0000 7f205160e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-06-04T16:15:22.639 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.638+0000 7f205160e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-06-04T16:15:22.675 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.673+0000 7f1f04fe1640 20 reqs_thread_entry: start 2024-06-04T16:15:22.675 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.674+0000 7f205160e800 20 init_complete bucket index max shards: 11 2024-06-04T16:15:22.675 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.674+0000 7f205160e800 20 Filter name: none 2024-06-04T16:15:22.675 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.674+0000 7f1e7e7fc640 20 reqs_thread_entry: start 2024-06-04T16:15:22.675 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.674+0000 7f205160e800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-06-04T16:15:22.676 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.675+0000 7f205160e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:22.677 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.676+0000 7f205160e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:15:22.677 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.676+0000 7f205160e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:22.678 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.677+0000 7f205160e800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-06-04T16:15:22.679 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.679+0000 7f205160e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:22.680 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.679+0000 7f205160e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:15:22.680 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.679+0000 7f205160e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:22.681 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.680+0000 7f205160e800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-06-04T16:15:22.682 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.682+0000 7f205160e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:22.683 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.682+0000 7f205160e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:15:22.685 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.683+0000 7f205160e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-06-04T16:15:22.685 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.683+0000 7f205160e800 20 garbage collection: RGWGC::process iterating over entry tag='be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.33__shadow_key1.2~W_bOQFC6aMPBkV2o7jlC5_jnCQY_Y9X.1_1_85f36458d220e6e089f4b1151d1cc89b', time=2024-06-04T18:15:03.347352+0000, chain.objs.size()=9 2024-06-04T16:15:22.685 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.683+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.33__multipart_key1.2~W_bOQFC6aMPBkV2o7jlC5_jnCQY_Y9X.1 2024-06-04T16:15:22.685 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.683+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.33__shadow_key1.2~W_bOQFC6aMPBkV2o7jlC5_jnCQY_Y9X.1_1 2024-06-04T16:15:22.685 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.683+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.33__multipart_key1.2~W_bOQFC6aMPBkV2o7jlC5_jnCQY_Y9X.2 2024-06-04T16:15:22.685 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.683+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.33__shadow_key1.2~W_bOQFC6aMPBkV2o7jlC5_jnCQY_Y9X.2_1 2024-06-04T16:15:22.685 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.683+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.33__multipart_key1.2~W_bOQFC6aMPBkV2o7jlC5_jnCQY_Y9X.3 2024-06-04T16:15:22.685 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.683+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.33__shadow_key1.2~W_bOQFC6aMPBkV2o7jlC5_jnCQY_Y9X.3_1 2024-06-04T16:15:22.685 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.683+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.33__multipart_key1.2~W_bOQFC6aMPBkV2o7jlC5_jnCQY_Y9X.4 2024-06-04T16:15:22.685 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.683+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.33__shadow_key1.2~W_bOQFC6aMPBkV2o7jlC5_jnCQY_Y9X.4_1 2024-06-04T16:15:22.686 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.683+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.33__multipart_key1.2~W_bOQFC6aMPBkV2o7jlC5_jnCQY_Y9X.5 2024-06-04T16:15:22.686 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.683+0000 7f205160e800 20 garbage collection: RGWGC::process iterating over entry tag='be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.10518672454818694002', time=2024-06-04T18:15:03.473497+0000, chain.objs.size()=9 2024-06-04T16:15:22.686 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.683+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.33__multipart_key1.2~W_bOQFC6aMPBkV2o7jlC5_jnCQY_Y9X.1 2024-06-04T16:15:22.686 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.683+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.33__shadow_key1.2~W_bOQFC6aMPBkV2o7jlC5_jnCQY_Y9X.1_1 2024-06-04T16:15:22.686 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.683+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.33__multipart_key1.2~W_bOQFC6aMPBkV2o7jlC5_jnCQY_Y9X.2 2024-06-04T16:15:22.688 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.686+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.33__shadow_key1.2~W_bOQFC6aMPBkV2o7jlC5_jnCQY_Y9X.2_1 2024-06-04T16:15:22.688 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.687+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.33__multipart_key1.2~W_bOQFC6aMPBkV2o7jlC5_jnCQY_Y9X.3 2024-06-04T16:15:22.688 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.687+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.33__shadow_key1.2~W_bOQFC6aMPBkV2o7jlC5_jnCQY_Y9X.3_1 2024-06-04T16:15:22.688 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.687+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.33__multipart_key1.2~W_bOQFC6aMPBkV2o7jlC5_jnCQY_Y9X.4 2024-06-04T16:15:22.688 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.687+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.33__shadow_key1.2~W_bOQFC6aMPBkV2o7jlC5_jnCQY_Y9X.4_1 2024-06-04T16:15:22.688 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.687+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.33__multipart_key1.2~W_bOQFC6aMPBkV2o7jlC5_jnCQY_Y9X.5 2024-06-04T16:15:22.689 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.687+0000 7f205160e800 20 garbage collection: RGWGC::process iterating over entry tag='be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.8729221797277151941', time=2024-06-04T18:15:11.463703+0000, chain.objs.size()=9 2024-06-04T16:15:22.689 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.687+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.41__multipart_key1.2~t8sW8NUiqgai6q2RTynbehdkdODXYr0.1 2024-06-04T16:15:22.689 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.687+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.41__shadow_key1.2~t8sW8NUiqgai6q2RTynbehdkdODXYr0.1_1 2024-06-04T16:15:22.689 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.687+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.41__multipart_key1.2~t8sW8NUiqgai6q2RTynbehdkdODXYr0.2 2024-06-04T16:15:22.689 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.687+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.41__shadow_key1.2~t8sW8NUiqgai6q2RTynbehdkdODXYr0.2_1 2024-06-04T16:15:22.689 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.687+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.41__multipart_key1.2~t8sW8NUiqgai6q2RTynbehdkdODXYr0.3 2024-06-04T16:15:22.689 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.688+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.41__shadow_key1.2~t8sW8NUiqgai6q2RTynbehdkdODXYr0.3_1 2024-06-04T16:15:22.690 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.689+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.41__multipart_key1.2~t8sW8NUiqgai6q2RTynbehdkdODXYr0.4 2024-06-04T16:15:22.691 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.690+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.41__shadow_key1.2~t8sW8NUiqgai6q2RTynbehdkdODXYr0.4_1 2024-06-04T16:15:22.691 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.690+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.41__multipart_key1.2~t8sW8NUiqgai6q2RTynbehdkdODXYr0.5 2024-06-04T16:15:22.694 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.693+0000 7f205160e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-06-04T16:15:22.696 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.695+0000 7f205160e800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-06-04T16:15:22.698 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.697+0000 7f205160e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:22.698 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.697+0000 7f205160e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:15:22.698 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.698+0000 7f205160e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:22.699 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.699+0000 7f205160e800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-06-04T16:15:22.701 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.700+0000 7f205160e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:22.701 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.700+0000 7f205160e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:15:22.703 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.701+0000 7f205160e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-06-04T16:15:22.703 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.701+0000 7f205160e800 20 garbage collection: RGWGC::process iterating over entry tag='be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.11821518843627200577', time=2024-06-04T18:15:06.165534+0000, chain.objs.size()=9 2024-06-04T16:15:22.703 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.701+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.36__multipart_key1.2~jBBiPcqRORwxsWnwXDUu-t2GV-E4rpW.1 2024-06-04T16:15:22.703 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.701+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.36__shadow_key1.2~jBBiPcqRORwxsWnwXDUu-t2GV-E4rpW.1_1 2024-06-04T16:15:22.703 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.701+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.36__multipart_key1.2~jBBiPcqRORwxsWnwXDUu-t2GV-E4rpW.2 2024-06-04T16:15:22.703 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.701+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.36__shadow_key1.2~jBBiPcqRORwxsWnwXDUu-t2GV-E4rpW.2_1 2024-06-04T16:15:22.703 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.701+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.36__multipart_key1.2~jBBiPcqRORwxsWnwXDUu-t2GV-E4rpW.3 2024-06-04T16:15:22.703 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.701+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.36__shadow_key1.2~jBBiPcqRORwxsWnwXDUu-t2GV-E4rpW.3_1 2024-06-04T16:15:22.703 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.701+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.36__multipart_key1.2~jBBiPcqRORwxsWnwXDUu-t2GV-E4rpW.4 2024-06-04T16:15:22.703 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.701+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.36__shadow_key1.2~jBBiPcqRORwxsWnwXDUu-t2GV-E4rpW.4_1 2024-06-04T16:15:22.704 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.701+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.36__multipart_key1.2~jBBiPcqRORwxsWnwXDUu-t2GV-E4rpW.5 2024-06-04T16:15:22.704 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.701+0000 7f205160e800 20 garbage collection: RGWGC::process iterating over entry tag='be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.16723626365802311088', time=2024-06-04T18:15:08.810160+0000, chain.objs.size()=9 2024-06-04T16:15:22.704 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.701+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.40__multipart_key1.2~06wOL9wg_kJO_3Az0HmupTmksFnJLwe.1 2024-06-04T16:15:22.704 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.701+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.40__shadow_key1.2~06wOL9wg_kJO_3Az0HmupTmksFnJLwe.1_1 2024-06-04T16:15:22.704 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.701+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.40__multipart_key1.2~06wOL9wg_kJO_3Az0HmupTmksFnJLwe.2 2024-06-04T16:15:22.705 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.704+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.40__shadow_key1.2~06wOL9wg_kJO_3Az0HmupTmksFnJLwe.2_1 2024-06-04T16:15:22.707 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.706+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.40__multipart_key1.2~06wOL9wg_kJO_3Az0HmupTmksFnJLwe.3 2024-06-04T16:15:22.707 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.706+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.40__shadow_key1.2~06wOL9wg_kJO_3Az0HmupTmksFnJLwe.3_1 2024-06-04T16:15:22.707 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.706+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.40__multipart_key1.2~06wOL9wg_kJO_3Az0HmupTmksFnJLwe.4 2024-06-04T16:15:22.707 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.706+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.40__shadow_key1.2~06wOL9wg_kJO_3Az0HmupTmksFnJLwe.4_1 2024-06-04T16:15:22.708 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.706+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.40__multipart_key1.2~06wOL9wg_kJO_3Az0HmupTmksFnJLwe.5 2024-06-04T16:15:22.708 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.706+0000 7f205160e800 20 garbage collection: RGWGC::process iterating over entry tag='be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.13855667954288654761', time=2024-06-04T18:15:21.772343+0000, chain.objs.size()=21 2024-06-04T16:15:22.708 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.706+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.55__multipart_key1.2~KjjaopVE4VcReoI1Ql0H7JfLFiE0aSw.1 2024-06-04T16:15:22.708 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.706+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.55__shadow_key1.2~KjjaopVE4VcReoI1Ql0H7JfLFiE0aSw.1_1 2024-06-04T16:15:22.708 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.706+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.55__multipart_key1.2~KjjaopVE4VcReoI1Ql0H7JfLFiE0aSw.2 2024-06-04T16:15:22.708 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.706+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.55__shadow_key1.2~KjjaopVE4VcReoI1Ql0H7JfLFiE0aSw.2_1 2024-06-04T16:15:22.708 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.706+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.55__multipart_key1.2~KjjaopVE4VcReoI1Ql0H7JfLFiE0aSw.3 2024-06-04T16:15:22.709 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.708+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.55__shadow_key1.2~KjjaopVE4VcReoI1Ql0H7JfLFiE0aSw.3_1 2024-06-04T16:15:22.710 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.709+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.55__multipart_key1.2~KjjaopVE4VcReoI1Ql0H7JfLFiE0aSw.4 2024-06-04T16:15:22.711 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.710+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.55__shadow_key1.2~KjjaopVE4VcReoI1Ql0H7JfLFiE0aSw.4_1 2024-06-04T16:15:22.711 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.710+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.55__multipart_key1.2~KjjaopVE4VcReoI1Ql0H7JfLFiE0aSw.5 2024-06-04T16:15:22.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.710+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.55__shadow_key1.2~KjjaopVE4VcReoI1Ql0H7JfLFiE0aSw.5_1 2024-06-04T16:15:22.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.711+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.55__multipart_key1.2~KjjaopVE4VcReoI1Ql0H7JfLFiE0aSw.6 2024-06-04T16:15:22.713 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.712+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.55__shadow_key1.2~KjjaopVE4VcReoI1Ql0H7JfLFiE0aSw.6_1 2024-06-04T16:15:22.713 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.712+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.55__multipart_key1.2~KjjaopVE4VcReoI1Ql0H7JfLFiE0aSw.7 2024-06-04T16:15:22.713 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.712+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.55__shadow_key1.2~KjjaopVE4VcReoI1Ql0H7JfLFiE0aSw.7_1 2024-06-04T16:15:22.713 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.712+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.55__multipart_key1.2~KjjaopVE4VcReoI1Ql0H7JfLFiE0aSw.8 2024-06-04T16:15:22.716 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.715+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.55__shadow_key1.2~KjjaopVE4VcReoI1Ql0H7JfLFiE0aSw.8_1 2024-06-04T16:15:22.716 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.715+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.55__multipart_key1.2~KjjaopVE4VcReoI1Ql0H7JfLFiE0aSw.9 2024-06-04T16:15:22.716 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.715+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.55__shadow_key1.2~KjjaopVE4VcReoI1Ql0H7JfLFiE0aSw.9_1 2024-06-04T16:15:22.716 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.715+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.55__multipart_key1.2~KjjaopVE4VcReoI1Ql0H7JfLFiE0aSw.10 2024-06-04T16:15:22.718 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.718+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.55__shadow_key1.2~KjjaopVE4VcReoI1Ql0H7JfLFiE0aSw.10_1 2024-06-04T16:15:22.719 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.718+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.55__multipart_key1.2~KjjaopVE4VcReoI1Ql0H7JfLFiE0aSw.11 2024-06-04T16:15:22.723 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.722+0000 7f205160e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-06-04T16:15:22.729 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.728+0000 7f205160e800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-06-04T16:15:22.730 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.730+0000 7f205160e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:22.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.730+0000 7f205160e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:15:22.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.731+0000 7f205160e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:22.732 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.732+0000 7f205160e800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-06-04T16:15:22.734 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.733+0000 7f205160e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:22.734 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.733+0000 7f205160e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:15:22.734 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.734+0000 7f205160e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:22.735 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.735+0000 7f205160e800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-06-04T16:15:22.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.736+0000 7f205160e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:22.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.736+0000 7f205160e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:15:22.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.737+0000 7f205160e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:22.738 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.738+0000 7f205160e800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-06-04T16:15:22.739 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.739+0000 7f205160e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:22.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.739+0000 7f205160e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:15:22.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.740+0000 7f205160e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:22.741 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.740+0000 7f205160e800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-06-04T16:15:22.743 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.742+0000 7f205160e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:22.743 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.742+0000 7f205160e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:15:22.744 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.743+0000 7f205160e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-06-04T16:15:22.744 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.743+0000 7f205160e800 20 garbage collection: RGWGC::process iterating over entry tag='be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.3924728957591649785', time=2024-06-04T18:15:18.869139+0000, chain.objs.size()=9 2024-06-04T16:15:22.744 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.743+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.46__multipart_key1.2~NsxRVDaFUtuk0WepLiJYPN-F3q6X7-P.1 2024-06-04T16:15:22.744 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.743+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.46__shadow_key1.2~NsxRVDaFUtuk0WepLiJYPN-F3q6X7-P.1_1 2024-06-04T16:15:22.744 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.743+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.46__multipart_key1.2~NsxRVDaFUtuk0WepLiJYPN-F3q6X7-P.2 2024-06-04T16:15:22.744 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.743+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.46__shadow_key1.2~NsxRVDaFUtuk0WepLiJYPN-F3q6X7-P.2_1 2024-06-04T16:15:22.744 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.743+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.46__multipart_key1.2~NsxRVDaFUtuk0WepLiJYPN-F3q6X7-P.3 2024-06-04T16:15:22.744 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.743+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.46__shadow_key1.2~NsxRVDaFUtuk0WepLiJYPN-F3q6X7-P.3_1 2024-06-04T16:15:22.744 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.743+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.46__multipart_key1.2~NsxRVDaFUtuk0WepLiJYPN-F3q6X7-P.4 2024-06-04T16:15:22.744 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.743+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.46__shadow_key1.2~NsxRVDaFUtuk0WepLiJYPN-F3q6X7-P.4_1 2024-06-04T16:15:22.744 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.743+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.46__multipart_key1.2~NsxRVDaFUtuk0WepLiJYPN-F3q6X7-P.5 2024-06-04T16:15:22.750 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.749+0000 7f205160e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-06-04T16:15:22.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.755+0000 7f205160e800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-06-04T16:15:22.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.756+0000 7f205160e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:22.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.757+0000 7f205160e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:15:22.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.757+0000 7f205160e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-06-04T16:15:22.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.757+0000 7f205160e800 20 garbage collection: RGWGC::process iterating over entry tag='be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.11652797618646318303', time=2024-06-04T18:15:07.447773+0000, chain.objs.size()=7 2024-06-04T16:15:22.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.757+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.36__multipart_key1.2~Fw2zUyP4DRz-zcCapRru-LsT3sf7VPT.1 2024-06-04T16:15:22.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.757+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.36__shadow_key1.2~Fw2zUyP4DRz-zcCapRru-LsT3sf7VPT.1_1 2024-06-04T16:15:22.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.757+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.36__shadow_key1.2~Fw2zUyP4DRz-zcCapRru-LsT3sf7VPT.1_2 2024-06-04T16:15:22.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.757+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.36__multipart_key1.2~Fw2zUyP4DRz-zcCapRru-LsT3sf7VPT.2 2024-06-04T16:15:22.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.757+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.36__shadow_key1.2~Fw2zUyP4DRz-zcCapRru-LsT3sf7VPT.2_1 2024-06-04T16:15:22.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.757+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.36__shadow_key1.2~Fw2zUyP4DRz-zcCapRru-LsT3sf7VPT.2_2 2024-06-04T16:15:22.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.757+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.36__multipart_key1.2~Fw2zUyP4DRz-zcCapRru-LsT3sf7VPT.3 2024-06-04T16:15:22.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.757+0000 7f205160e800 20 garbage collection: RGWGC::process iterating over entry tag='be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.8287340604175871660', time=2024-06-04T18:15:12.097119+0000, chain.objs.size()=9 2024-06-04T16:15:22.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.757+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.42__multipart_file.mpg.2~7i5aVtaiXygMbeFUMSgwM-CfmpvEFuX.1 2024-06-04T16:15:22.760 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.757+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.42__shadow_file.mpg.2~7i5aVtaiXygMbeFUMSgwM-CfmpvEFuX.1_1 2024-06-04T16:15:22.760 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.757+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.42__multipart_file.mpg.2~7i5aVtaiXygMbeFUMSgwM-CfmpvEFuX.2 2024-06-04T16:15:22.760 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.757+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.42__shadow_file.mpg.2~7i5aVtaiXygMbeFUMSgwM-CfmpvEFuX.2_1 2024-06-04T16:15:22.760 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.757+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.42__multipart_file.mpg.2~7i5aVtaiXygMbeFUMSgwM-CfmpvEFuX.3 2024-06-04T16:15:22.761 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.760+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.42__shadow_file.mpg.2~7i5aVtaiXygMbeFUMSgwM-CfmpvEFuX.3_1 2024-06-04T16:15:22.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.760+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.42__multipart_file.mpg.2~7i5aVtaiXygMbeFUMSgwM-CfmpvEFuX.4 2024-06-04T16:15:22.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.760+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.42__shadow_file.mpg.2~7i5aVtaiXygMbeFUMSgwM-CfmpvEFuX.4_1 2024-06-04T16:15:22.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.761+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.42__multipart_file.mpg.2~7i5aVtaiXygMbeFUMSgwM-CfmpvEFuX.5 2024-06-04T16:15:22.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.761+0000 7f205160e800 20 garbage collection: RGWGC::process iterating over entry tag='be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1960066179787130558', time=2024-06-04T18:15:16.483125+0000, chain.objs.size()=16 2024-06-04T16:15:22.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.761+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.44__multipart_key1.2~pGr4mLs_Um0d_Geby3W8CZLO_d-2LxH.1 2024-06-04T16:15:22.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.762+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.44__shadow_key1.2~pGr4mLs_Um0d_Geby3W8CZLO_d-2LxH.1_1 2024-06-04T16:15:22.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.762+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.44__shadow_key1.2~pGr4mLs_Um0d_Geby3W8CZLO_d-2LxH.1_2 2024-06-04T16:15:22.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.762+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.44__multipart_key1.2~pGr4mLs_Um0d_Geby3W8CZLO_d-2LxH.2 2024-06-04T16:15:22.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.762+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.44__shadow_key1.2~pGr4mLs_Um0d_Geby3W8CZLO_d-2LxH.2_1 2024-06-04T16:15:22.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.762+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.44__shadow_key1.2~pGr4mLs_Um0d_Geby3W8CZLO_d-2LxH.2_2 2024-06-04T16:15:22.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.762+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.44__multipart_key1.2~pGr4mLs_Um0d_Geby3W8CZLO_d-2LxH.3 2024-06-04T16:15:22.768 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.767+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.44__shadow_key1.2~pGr4mLs_Um0d_Geby3W8CZLO_d-2LxH.3_1 2024-06-04T16:15:22.769 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.767+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.44__shadow_key1.2~pGr4mLs_Um0d_Geby3W8CZLO_d-2LxH.3_2 2024-06-04T16:15:22.769 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.768+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.44__multipart_key1.2~pGr4mLs_Um0d_Geby3W8CZLO_d-2LxH.4 2024-06-04T16:15:22.769 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.768+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.44__shadow_key1.2~pGr4mLs_Um0d_Geby3W8CZLO_d-2LxH.4_1 2024-06-04T16:15:22.769 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.768+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.44__shadow_key1.2~pGr4mLs_Um0d_Geby3W8CZLO_d-2LxH.4_2 2024-06-04T16:15:22.769 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.768+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.44__multipart_key1.2~pGr4mLs_Um0d_Geby3W8CZLO_d-2LxH.5 2024-06-04T16:15:22.769 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.768+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.44__shadow_key1.2~pGr4mLs_Um0d_Geby3W8CZLO_d-2LxH.5_1 2024-06-04T16:15:22.770 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.768+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.44__shadow_key1.2~pGr4mLs_Um0d_Geby3W8CZLO_d-2LxH.5_2 2024-06-04T16:15:22.771 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.770+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.44__multipart_key1.2~pGr4mLs_Um0d_Geby3W8CZLO_d-2LxH.6 2024-06-04T16:15:22.777 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.776+0000 7f205160e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-06-04T16:15:22.779 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.778+0000 7f205160e800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-06-04T16:15:22.780 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.779+0000 7f205160e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:22.780 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.780+0000 7f205160e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:15:22.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.780+0000 7f205160e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-06-04T16:15:22.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.780+0000 7f205160e800 20 garbage collection: RGWGC::process iterating over entry tag='2~yT9h7xOeJRDEsOXdqu1sQvJCNKyvGqh', time=2024-06-04T18:15:12.621049+0000, chain.objs.size()=5 2024-06-04T16:15:22.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.780+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.43__multipart_key1.2~yT9h7xOeJRDEsOXdqu1sQvJCNKyvGqh.7 2024-06-04T16:15:22.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.780+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.43__shadow_key1.2~yT9h7xOeJRDEsOXdqu1sQvJCNKyvGqh.7_1 2024-06-04T16:15:22.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.780+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.43__multipart_key1.2~yT9h7xOeJRDEsOXdqu1sQvJCNKyvGqh.10 2024-06-04T16:15:22.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.780+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.43__shadow_key1.2~yT9h7xOeJRDEsOXdqu1sQvJCNKyvGqh.10_1 2024-06-04T16:15:22.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.780+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.43__multipart_key1.2~yT9h7xOeJRDEsOXdqu1sQvJCNKyvGqh.13 2024-06-04T16:15:22.785 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.784+0000 7f205160e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-06-04T16:15:22.793 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.793+0000 7f205160e800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-06-04T16:15:22.794 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.794+0000 7f205160e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:22.795 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.794+0000 7f205160e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:15:22.795 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.794+0000 7f205160e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:22.796 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.795+0000 7f205160e800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-06-04T16:15:22.798 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.797+0000 7f205160e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:22.799 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.798+0000 7f205160e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:15:22.799 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.798+0000 7f205160e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-06-04T16:15:22.799 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.798+0000 7f205160e800 20 garbage collection: RGWGC::process iterating over entry tag='be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.10292479534946052572', time=2024-06-04T18:15:12.108040+0000, chain.objs.size()=9 2024-06-04T16:15:22.799 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.798+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.42__multipart_file2.mpg.2~oTaB0W5qYV0EBC_tCRppQgPYS0Jl52A.1 2024-06-04T16:15:22.800 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.798+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.42__shadow_file2.mpg.2~oTaB0W5qYV0EBC_tCRppQgPYS0Jl52A.1_1 2024-06-04T16:15:22.800 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.798+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.42__multipart_file2.mpg.2~oTaB0W5qYV0EBC_tCRppQgPYS0Jl52A.2 2024-06-04T16:15:22.800 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.798+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.42__shadow_file2.mpg.2~oTaB0W5qYV0EBC_tCRppQgPYS0Jl52A.2_1 2024-06-04T16:15:22.800 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.798+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.42__multipart_file2.mpg.2~oTaB0W5qYV0EBC_tCRppQgPYS0Jl52A.3 2024-06-04T16:15:22.800 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.798+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.42__shadow_file2.mpg.2~oTaB0W5qYV0EBC_tCRppQgPYS0Jl52A.3_1 2024-06-04T16:15:22.800 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.798+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.42__multipart_file2.mpg.2~oTaB0W5qYV0EBC_tCRppQgPYS0Jl52A.4 2024-06-04T16:15:22.800 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.798+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.42__shadow_file2.mpg.2~oTaB0W5qYV0EBC_tCRppQgPYS0Jl52A.4_1 2024-06-04T16:15:22.800 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.798+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.42__multipart_file2.mpg.2~oTaB0W5qYV0EBC_tCRppQgPYS0Jl52A.5 2024-06-04T16:15:22.803 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.802+0000 7f205160e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-06-04T16:15:22.811 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.810+0000 7f205160e800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-06-04T16:15:22.812 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.812+0000 7f205160e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:22.813 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.812+0000 7f205160e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:15:22.813 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.813+0000 7f205160e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:22.814 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.814+0000 7f205160e800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-06-04T16:15:22.816 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.815+0000 7f205160e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:22.816 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.815+0000 7f205160e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:15:22.817 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.816+0000 7f205160e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-06-04T16:15:22.817 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.816+0000 7f205160e800 20 garbage collection: RGWGC::process iterating over entry tag='be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.15896974900857907041', time=2024-06-04T18:15:06.586149+0000, chain.objs.size()=9 2024-06-04T16:15:22.817 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.816+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.36__multipart_key1.2~MI9u9KwyRACUqWXpFM2ne8Ijvm3ftBk.1 2024-06-04T16:15:22.817 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.816+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.36__shadow_key1.2~MI9u9KwyRACUqWXpFM2ne8Ijvm3ftBk.1_1 2024-06-04T16:15:22.817 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.816+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.36__multipart_key1.2~MI9u9KwyRACUqWXpFM2ne8Ijvm3ftBk.2 2024-06-04T16:15:22.817 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.816+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.36__shadow_key1.2~MI9u9KwyRACUqWXpFM2ne8Ijvm3ftBk.2_1 2024-06-04T16:15:22.818 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.816+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.36__multipart_key1.2~MI9u9KwyRACUqWXpFM2ne8Ijvm3ftBk.3 2024-06-04T16:15:22.818 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.816+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.36__shadow_key1.2~MI9u9KwyRACUqWXpFM2ne8Ijvm3ftBk.3_1 2024-06-04T16:15:22.818 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.816+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.36__multipart_key1.2~MI9u9KwyRACUqWXpFM2ne8Ijvm3ftBk.4 2024-06-04T16:15:22.818 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.816+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.36__shadow_key1.2~MI9u9KwyRACUqWXpFM2ne8Ijvm3ftBk.4_1 2024-06-04T16:15:22.818 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.816+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.36__multipart_key1.2~MI9u9KwyRACUqWXpFM2ne8Ijvm3ftBk.5 2024-06-04T16:15:22.821 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.820+0000 7f205160e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-06-04T16:15:22.824 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.823+0000 7f205160e800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-06-04T16:15:22.825 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.824+0000 7f205160e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:22.825 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.825+0000 7f205160e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:15:22.826 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.825+0000 7f205160e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:22.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.826+0000 7f205160e800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-06-04T16:15:22.828 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.827+0000 7f205160e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:22.829 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.828+0000 7f205160e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:15:22.830 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.828+0000 7f205160e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-06-04T16:15:22.830 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.828+0000 7f205160e800 20 garbage collection: RGWGC::process iterating over entry tag='2~8klhcs4d2qQgmVgAVgX1W28JCP27if3', time=2024-06-04T18:15:19.522398+0000, chain.objs.size()=92 2024-06-04T16:15:22.830 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.828+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.47__multipart_key1.2~8klhcs4d2qQgmVgAVgX1W28JCP27if3.1 2024-06-04T16:15:22.830 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.828+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.47__multipart_key1.2~8klhcs4d2qQgmVgAVgX1W28JCP27if3.2 2024-06-04T16:15:22.830 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.828+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.47__multipart_key1.2~8klhcs4d2qQgmVgAVgX1W28JCP27if3.3 2024-06-04T16:15:22.830 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.828+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.47__multipart_key1.2~8klhcs4d2qQgmVgAVgX1W28JCP27if3.4 2024-06-04T16:15:22.830 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.828+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.47__multipart_key1.2~8klhcs4d2qQgmVgAVgX1W28JCP27if3.5 2024-06-04T16:15:22.830 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.828+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.47__multipart_key1.2~8klhcs4d2qQgmVgAVgX1W28JCP27if3.6 2024-06-04T16:15:22.830 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.828+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.47__multipart_key1.2~8klhcs4d2qQgmVgAVgX1W28JCP27if3.7 2024-06-04T16:15:22.831 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.828+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.47__multipart_key1.2~8klhcs4d2qQgmVgAVgX1W28JCP27if3.8 2024-06-04T16:15:22.831 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.828+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.47__multipart_key1.2~8klhcs4d2qQgmVgAVgX1W28JCP27if3.9 2024-06-04T16:15:22.831 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.828+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.47__multipart_key1.2~8klhcs4d2qQgmVgAVgX1W28JCP27if3.10 2024-06-04T16:15:22.831 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.828+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.47__multipart_key1.2~8klhcs4d2qQgmVgAVgX1W28JCP27if3.11 2024-06-04T16:15:22.831 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.828+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.47__multipart_key1.2~8klhcs4d2qQgmVgAVgX1W28JCP27if3.12 2024-06-04T16:15:22.831 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.831+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.47__multipart_key1.2~8klhcs4d2qQgmVgAVgX1W28JCP27if3.13 2024-06-04T16:15:22.833 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.831+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.47__multipart_key1.2~8klhcs4d2qQgmVgAVgX1W28JCP27if3.14 2024-06-04T16:15:22.833 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.832+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.47__multipart_key1.2~8klhcs4d2qQgmVgAVgX1W28JCP27if3.15 2024-06-04T16:15:22.833 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.832+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.47__multipart_key1.2~8klhcs4d2qQgmVgAVgX1W28JCP27if3.16 2024-06-04T16:15:22.833 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.832+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.47__multipart_key1.2~8klhcs4d2qQgmVgAVgX1W28JCP27if3.17 2024-06-04T16:15:22.834 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.833+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.47__multipart_key1.2~8klhcs4d2qQgmVgAVgX1W28JCP27if3.18 2024-06-04T16:15:22.834 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.833+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.47__multipart_key1.2~8klhcs4d2qQgmVgAVgX1W28JCP27if3.19 2024-06-04T16:15:22.834 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.833+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.47__multipart_key1.2~8klhcs4d2qQgmVgAVgX1W28JCP27if3.20 2024-06-04T16:15:22.834 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.833+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.47__multipart_key1.2~8klhcs4d2qQgmVgAVgX1W28JCP27if3.21 2024-06-04T16:15:22.834 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.833+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.47__multipart_key1.2~8klhcs4d2qQgmVgAVgX1W28JCP27if3.22 2024-06-04T16:15:22.834 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.833+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.47__multipart_key1.2~8klhcs4d2qQgmVgAVgX1W28JCP27if3.23 2024-06-04T16:15:22.835 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.834+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.47__multipart_key1.2~8klhcs4d2qQgmVgAVgX1W28JCP27if3.24 2024-06-04T16:15:22.836 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.835+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.47__multipart_key1.2~8klhcs4d2qQgmVgAVgX1W28JCP27if3.25 2024-06-04T16:15:22.836 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.835+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.47__multipart_key1.2~8klhcs4d2qQgmVgAVgX1W28JCP27if3.26 2024-06-04T16:15:22.836 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.835+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.47__multipart_key1.2~8klhcs4d2qQgmVgAVgX1W28JCP27if3.27 2024-06-04T16:15:22.836 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.835+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.47__multipart_key1.2~8klhcs4d2qQgmVgAVgX1W28JCP27if3.28 2024-06-04T16:15:22.837 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.836+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.47__multipart_key1.2~8klhcs4d2qQgmVgAVgX1W28JCP27if3.29 2024-06-04T16:15:22.837 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.836+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.47__multipart_key1.2~8klhcs4d2qQgmVgAVgX1W28JCP27if3.30 2024-06-04T16:15:22.840 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.839+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.47__multipart_key1.2~8klhcs4d2qQgmVgAVgX1W28JCP27if3.31 2024-06-04T16:15:22.840 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.839+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.47__multipart_key1.2~8klhcs4d2qQgmVgAVgX1W28JCP27if3.32 2024-06-04T16:15:22.841 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.839+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.47__multipart_key1.2~8klhcs4d2qQgmVgAVgX1W28JCP27if3.33 2024-06-04T16:15:22.841 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.839+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.47__multipart_key1.2~8klhcs4d2qQgmVgAVgX1W28JCP27if3.34 2024-06-04T16:15:22.841 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.839+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.47__multipart_key1.2~8klhcs4d2qQgmVgAVgX1W28JCP27if3.35 2024-06-04T16:15:22.841 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.839+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.47__multipart_key1.2~8klhcs4d2qQgmVgAVgX1W28JCP27if3.36 2024-06-04T16:15:22.841 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.839+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.47__multipart_key1.2~8klhcs4d2qQgmVgAVgX1W28JCP27if3.37 2024-06-04T16:15:22.841 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.839+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.47__multipart_key1.2~8klhcs4d2qQgmVgAVgX1W28JCP27if3.38 2024-06-04T16:15:22.841 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.839+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.47__multipart_key1.2~8klhcs4d2qQgmVgAVgX1W28JCP27if3.39 2024-06-04T16:15:22.841 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.839+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.47__multipart_key1.2~8klhcs4d2qQgmVgAVgX1W28JCP27if3.40 2024-06-04T16:15:22.841 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.839+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.47__multipart_key1.2~8klhcs4d2qQgmVgAVgX1W28JCP27if3.41 2024-06-04T16:15:22.843 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.842+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.47__multipart_key1.2~8klhcs4d2qQgmVgAVgX1W28JCP27if3.42 2024-06-04T16:15:22.843 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.842+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.47__multipart_key1.2~8klhcs4d2qQgmVgAVgX1W28JCP27if3.43 2024-06-04T16:15:22.844 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.842+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.47__multipart_key1.2~8klhcs4d2qQgmVgAVgX1W28JCP27if3.44 2024-06-04T16:15:22.844 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.843+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.47__multipart_key1.2~8klhcs4d2qQgmVgAVgX1W28JCP27if3.45 2024-06-04T16:15:22.845 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.843+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.47__multipart_key1.2~8klhcs4d2qQgmVgAVgX1W28JCP27if3.46 2024-06-04T16:15:22.845 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.843+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.47__multipart_key1.2~8klhcs4d2qQgmVgAVgX1W28JCP27if3.47 2024-06-04T16:15:22.845 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.843+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.47__multipart_key1.2~8klhcs4d2qQgmVgAVgX1W28JCP27if3.48 2024-06-04T16:15:22.845 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.843+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.47__multipart_key1.2~8klhcs4d2qQgmVgAVgX1W28JCP27if3.49 2024-06-04T16:15:22.846 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.845+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.47__multipart_key1.2~8klhcs4d2qQgmVgAVgX1W28JCP27if3.50 2024-06-04T16:15:22.846 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.845+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.47__multipart_key1.2~8klhcs4d2qQgmVgAVgX1W28JCP27if3.51 2024-06-04T16:15:22.846 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.845+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.47__multipart_key1.2~8klhcs4d2qQgmVgAVgX1W28JCP27if3.52 2024-06-04T16:15:22.847 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.847+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.47__multipart_key1.2~8klhcs4d2qQgmVgAVgX1W28JCP27if3.53 2024-06-04T16:15:22.848 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.847+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.47__multipart_key1.2~8klhcs4d2qQgmVgAVgX1W28JCP27if3.54 2024-06-04T16:15:22.848 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.847+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.47__multipart_key1.2~8klhcs4d2qQgmVgAVgX1W28JCP27if3.55 2024-06-04T16:15:22.848 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.847+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.47__multipart_key1.2~8klhcs4d2qQgmVgAVgX1W28JCP27if3.56 2024-06-04T16:15:22.848 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.847+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.47__multipart_key1.2~8klhcs4d2qQgmVgAVgX1W28JCP27if3.57 2024-06-04T16:15:22.848 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.847+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.47__multipart_key1.2~8klhcs4d2qQgmVgAVgX1W28JCP27if3.58 2024-06-04T16:15:22.851 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.850+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.47__multipart_key1.2~8klhcs4d2qQgmVgAVgX1W28JCP27if3.59 2024-06-04T16:15:22.851 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.850+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.47__multipart_key1.2~8klhcs4d2qQgmVgAVgX1W28JCP27if3.60 2024-06-04T16:15:22.851 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.850+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.47__multipart_key1.2~8klhcs4d2qQgmVgAVgX1W28JCP27if3.61 2024-06-04T16:15:22.851 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.850+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.47__multipart_key1.2~8klhcs4d2qQgmVgAVgX1W28JCP27if3.62 2024-06-04T16:15:22.851 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.850+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.47__multipart_key1.2~8klhcs4d2qQgmVgAVgX1W28JCP27if3.63 2024-06-04T16:15:22.851 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.850+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.47__multipart_key1.2~8klhcs4d2qQgmVgAVgX1W28JCP27if3.64 2024-06-04T16:15:22.851 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.850+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.47__multipart_key1.2~8klhcs4d2qQgmVgAVgX1W28JCP27if3.65 2024-06-04T16:15:22.852 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.850+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.47__multipart_key1.2~8klhcs4d2qQgmVgAVgX1W28JCP27if3.66 2024-06-04T16:15:22.852 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.850+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.47__multipart_key1.2~8klhcs4d2qQgmVgAVgX1W28JCP27if3.67 2024-06-04T16:15:22.852 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.850+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.47__multipart_key1.2~8klhcs4d2qQgmVgAVgX1W28JCP27if3.68 2024-06-04T16:15:22.852 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.850+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.47__multipart_key1.2~8klhcs4d2qQgmVgAVgX1W28JCP27if3.69 2024-06-04T16:15:22.854 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.853+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.47__multipart_key1.2~8klhcs4d2qQgmVgAVgX1W28JCP27if3.70 2024-06-04T16:15:22.854 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.853+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.47__multipart_key1.2~8klhcs4d2qQgmVgAVgX1W28JCP27if3.71 2024-06-04T16:15:22.854 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.853+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.47__multipart_key1.2~8klhcs4d2qQgmVgAVgX1W28JCP27if3.72 2024-06-04T16:15:22.858 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.857+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.47__multipart_key1.2~8klhcs4d2qQgmVgAVgX1W28JCP27if3.73 2024-06-04T16:15:22.859 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.857+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.47__multipart_key1.2~8klhcs4d2qQgmVgAVgX1W28JCP27if3.74 2024-06-04T16:15:22.859 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.857+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.47__multipart_key1.2~8klhcs4d2qQgmVgAVgX1W28JCP27if3.75 2024-06-04T16:15:22.859 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.857+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.47__multipart_key1.2~8klhcs4d2qQgmVgAVgX1W28JCP27if3.76 2024-06-04T16:15:22.859 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.858+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.47__multipart_key1.2~8klhcs4d2qQgmVgAVgX1W28JCP27if3.77 2024-06-04T16:15:22.859 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.858+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.47__multipart_key1.2~8klhcs4d2qQgmVgAVgX1W28JCP27if3.78 2024-06-04T16:15:22.859 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.858+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.47__multipart_key1.2~8klhcs4d2qQgmVgAVgX1W28JCP27if3.79 2024-06-04T16:15:22.859 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.858+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.47__multipart_key1.2~8klhcs4d2qQgmVgAVgX1W28JCP27if3.80 2024-06-04T16:15:22.859 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.858+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.47__multipart_key1.2~8klhcs4d2qQgmVgAVgX1W28JCP27if3.81 2024-06-04T16:15:22.859 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.858+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.47__multipart_key1.2~8klhcs4d2qQgmVgAVgX1W28JCP27if3.82 2024-06-04T16:15:22.859 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.858+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.47__multipart_key1.2~8klhcs4d2qQgmVgAVgX1W28JCP27if3.83 2024-06-04T16:15:22.861 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.860+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.47__multipart_key1.2~8klhcs4d2qQgmVgAVgX1W28JCP27if3.84 2024-06-04T16:15:22.861 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.860+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.47__multipart_key1.2~8klhcs4d2qQgmVgAVgX1W28JCP27if3.85 2024-06-04T16:15:22.862 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.861+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.47__multipart_key1.2~8klhcs4d2qQgmVgAVgX1W28JCP27if3.86 2024-06-04T16:15:22.864 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.863+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.47__multipart_key1.2~8klhcs4d2qQgmVgAVgX1W28JCP27if3.87 2024-06-04T16:15:22.864 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.863+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.47__multipart_key1.2~8klhcs4d2qQgmVgAVgX1W28JCP27if3.88 2024-06-04T16:15:22.864 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.863+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.47__multipart_key1.2~8klhcs4d2qQgmVgAVgX1W28JCP27if3.89 2024-06-04T16:15:22.864 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.863+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.47__multipart_key1.2~8klhcs4d2qQgmVgAVgX1W28JCP27if3.90 2024-06-04T16:15:22.864 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.863+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.47__multipart_key1.2~8klhcs4d2qQgmVgAVgX1W28JCP27if3.91 2024-06-04T16:15:22.864 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.863+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.47__multipart_key1.2~8klhcs4d2qQgmVgAVgX1W28JCP27if3.92 2024-06-04T16:15:22.869 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.868+0000 7f205160e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-06-04T16:15:22.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.872+0000 7f205160e800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-06-04T16:15:22.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.873+0000 7f205160e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:22.875 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.874+0000 7f205160e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:15:22.875 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.874+0000 7f205160e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-06-04T16:15:22.875 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.874+0000 7f205160e800 20 garbage collection: RGWGC::process iterating over entry tag='2~XB_mIhVBNGHXzCFUoBSklWV_ZrBZYsN', time=2024-06-04T18:15:01.371067+0000, chain.objs.size()=9 2024-06-04T16:15:22.876 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.874+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.29__multipart_key1.2~XB_mIhVBNGHXzCFUoBSklWV_ZrBZYsN.1 2024-06-04T16:15:22.876 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.874+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.29__shadow_key1.2~XB_mIhVBNGHXzCFUoBSklWV_ZrBZYsN.1_1 2024-06-04T16:15:22.876 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.874+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.29__multipart_key1.2~XB_mIhVBNGHXzCFUoBSklWV_ZrBZYsN.2 2024-06-04T16:15:22.876 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.874+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.29__shadow_key1.2~XB_mIhVBNGHXzCFUoBSklWV_ZrBZYsN.2_1 2024-06-04T16:15:22.876 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.874+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.29__multipart_key1.2~XB_mIhVBNGHXzCFUoBSklWV_ZrBZYsN.3 2024-06-04T16:15:22.876 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.874+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.29__shadow_key1.2~XB_mIhVBNGHXzCFUoBSklWV_ZrBZYsN.3_1 2024-06-04T16:15:22.876 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.874+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.29__multipart_key1.2~XB_mIhVBNGHXzCFUoBSklWV_ZrBZYsN.4 2024-06-04T16:15:22.876 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.874+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.29__shadow_key1.2~XB_mIhVBNGHXzCFUoBSklWV_ZrBZYsN.4_1 2024-06-04T16:15:22.876 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.874+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.29__multipart_key1.2~XB_mIhVBNGHXzCFUoBSklWV_ZrBZYsN.5 2024-06-04T16:15:22.876 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.874+0000 7f205160e800 20 garbage collection: RGWGC::process iterating over entry tag='be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.3810542735665384278', time=2024-06-04T18:15:16.623024+0000, chain.objs.size()=16 2024-06-04T16:15:22.876 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.874+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.44__multipart_key1.2~Rg3aETL7ND4wHQv6jc2cd6NdZUr43hR.1 2024-06-04T16:15:22.876 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.874+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.44__shadow_key1.2~Rg3aETL7ND4wHQv6jc2cd6NdZUr43hR.1_1 2024-06-04T16:15:22.876 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.874+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.44__shadow_key1.2~Rg3aETL7ND4wHQv6jc2cd6NdZUr43hR.1_2 2024-06-04T16:15:22.879 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.878+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.44__multipart_key1.2~Rg3aETL7ND4wHQv6jc2cd6NdZUr43hR.2 2024-06-04T16:15:22.879 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.878+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.44__shadow_key1.2~Rg3aETL7ND4wHQv6jc2cd6NdZUr43hR.2_1 2024-06-04T16:15:22.880 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.879+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.44__shadow_key1.2~Rg3aETL7ND4wHQv6jc2cd6NdZUr43hR.2_2 2024-06-04T16:15:22.880 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.879+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.44__multipart_key1.2~Rg3aETL7ND4wHQv6jc2cd6NdZUr43hR.3 2024-06-04T16:15:22.880 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.879+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.44__shadow_key1.2~Rg3aETL7ND4wHQv6jc2cd6NdZUr43hR.3_1 2024-06-04T16:15:22.880 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.879+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.44__shadow_key1.2~Rg3aETL7ND4wHQv6jc2cd6NdZUr43hR.3_2 2024-06-04T16:15:22.880 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.879+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.44__multipart_key1.2~Rg3aETL7ND4wHQv6jc2cd6NdZUr43hR.4 2024-06-04T16:15:22.880 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.879+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.44__shadow_key1.2~Rg3aETL7ND4wHQv6jc2cd6NdZUr43hR.4_1 2024-06-04T16:15:22.880 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.879+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.44__shadow_key1.2~Rg3aETL7ND4wHQv6jc2cd6NdZUr43hR.4_2 2024-06-04T16:15:22.880 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.879+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.44__multipart_key1.2~Rg3aETL7ND4wHQv6jc2cd6NdZUr43hR.5 2024-06-04T16:15:22.881 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.879+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.44__shadow_key1.2~Rg3aETL7ND4wHQv6jc2cd6NdZUr43hR.5_1 2024-06-04T16:15:22.883 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.882+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.44__shadow_key1.2~Rg3aETL7ND4wHQv6jc2cd6NdZUr43hR.5_2 2024-06-04T16:15:22.883 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.882+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.44__multipart_key1.2~Rg3aETL7ND4wHQv6jc2cd6NdZUr43hR.6 2024-06-04T16:15:22.883 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.882+0000 7f205160e800 20 garbage collection: RGWGC::process iterating over entry tag='be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.11747343767803456434', time=2024-06-04T18:15:17.705944+0000, chain.objs.size()=9 2024-06-04T16:15:22.883 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.882+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.45__multipart_key1.2~H2lBXhefATl9qMNUKKdZmRQDNSIfc5m.1 2024-06-04T16:15:22.885 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.884+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.45__shadow_key1.2~H2lBXhefATl9qMNUKKdZmRQDNSIfc5m.1_1 2024-06-04T16:15:22.885 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.884+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.45__multipart_key1.2~H2lBXhefATl9qMNUKKdZmRQDNSIfc5m.2 2024-06-04T16:15:22.885 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.884+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.45__shadow_key1.2~H2lBXhefATl9qMNUKKdZmRQDNSIfc5m.2_1 2024-06-04T16:15:22.885 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.884+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.45__multipart_key1.2~H2lBXhefATl9qMNUKKdZmRQDNSIfc5m.3 2024-06-04T16:15:22.885 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.884+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.45__shadow_key1.2~H2lBXhefATl9qMNUKKdZmRQDNSIfc5m.3_1 2024-06-04T16:15:22.886 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.884+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.45__multipart_key1.2~H2lBXhefATl9qMNUKKdZmRQDNSIfc5m.4 2024-06-04T16:15:22.886 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.884+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.45__shadow_key1.2~H2lBXhefATl9qMNUKKdZmRQDNSIfc5m.4_1 2024-06-04T16:15:22.886 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.884+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.45__multipart_key1.2~H2lBXhefATl9qMNUKKdZmRQDNSIfc5m.5 2024-06-04T16:15:22.893 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.892+0000 7f205160e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-06-04T16:15:22.895 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.894+0000 7f205160e800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-06-04T16:15:22.896 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.895+0000 7f205160e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:22.896 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.896+0000 7f205160e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:15:22.897 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.896+0000 7f205160e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-06-04T16:15:22.898 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.896+0000 7f205160e800 20 garbage collection: RGWGC::process iterating over entry tag='be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.8105743372355597121', time=2024-06-04T18:15:14.871826+0000, chain.objs.size()=21 2024-06-04T16:15:22.898 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.896+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.44__multipart_key1.2~zWniysQyOk71MX9hmm1UQdWsEGctR63.1 2024-06-04T16:15:22.898 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.896+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.44__shadow_key1.2~zWniysQyOk71MX9hmm1UQdWsEGctR63.1_1 2024-06-04T16:15:22.898 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.896+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.44__multipart_key1.2~zWniysQyOk71MX9hmm1UQdWsEGctR63.2 2024-06-04T16:15:22.898 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.896+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.44__shadow_key1.2~zWniysQyOk71MX9hmm1UQdWsEGctR63.2_1 2024-06-04T16:15:22.898 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.896+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.44__multipart_key1.2~zWniysQyOk71MX9hmm1UQdWsEGctR63.3 2024-06-04T16:15:22.898 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.896+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.44__shadow_key1.2~zWniysQyOk71MX9hmm1UQdWsEGctR63.3_1 2024-06-04T16:15:22.898 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.896+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.44__multipart_key1.2~zWniysQyOk71MX9hmm1UQdWsEGctR63.4 2024-06-04T16:15:22.898 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.896+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.44__shadow_key1.2~zWniysQyOk71MX9hmm1UQdWsEGctR63.4_1 2024-06-04T16:15:22.898 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.896+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.44__multipart_key1.2~zWniysQyOk71MX9hmm1UQdWsEGctR63.5 2024-06-04T16:15:22.898 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.896+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.44__shadow_key1.2~zWniysQyOk71MX9hmm1UQdWsEGctR63.5_1 2024-06-04T16:15:22.898 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.896+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.44__multipart_key1.2~zWniysQyOk71MX9hmm1UQdWsEGctR63.6 2024-06-04T16:15:22.899 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.896+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.44__shadow_key1.2~zWniysQyOk71MX9hmm1UQdWsEGctR63.6_1 2024-06-04T16:15:22.900 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.899+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.44__multipart_key1.2~zWniysQyOk71MX9hmm1UQdWsEGctR63.7 2024-06-04T16:15:22.900 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.899+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.44__shadow_key1.2~zWniysQyOk71MX9hmm1UQdWsEGctR63.7_1 2024-06-04T16:15:22.900 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.899+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.44__multipart_key1.2~zWniysQyOk71MX9hmm1UQdWsEGctR63.8 2024-06-04T16:15:22.900 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.899+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.44__shadow_key1.2~zWniysQyOk71MX9hmm1UQdWsEGctR63.8_1 2024-06-04T16:15:22.900 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.899+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.44__multipart_key1.2~zWniysQyOk71MX9hmm1UQdWsEGctR63.9 2024-06-04T16:15:22.900 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.899+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.44__shadow_key1.2~zWniysQyOk71MX9hmm1UQdWsEGctR63.9_1 2024-06-04T16:15:22.900 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.899+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.44__multipart_key1.2~zWniysQyOk71MX9hmm1UQdWsEGctR63.10 2024-06-04T16:15:22.902 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.901+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.44__shadow_key1.2~zWniysQyOk71MX9hmm1UQdWsEGctR63.10_1 2024-06-04T16:15:22.902 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.901+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.44__multipart_key1.2~zWniysQyOk71MX9hmm1UQdWsEGctR63.11 2024-06-04T16:15:22.902 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.901+0000 7f205160e800 20 garbage collection: RGWGC::process iterating over entry tag='be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.15607351270838624690', time=2024-06-04T18:15:15.944583+0000, chain.objs.size()=16 2024-06-04T16:15:22.902 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.901+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.44__multipart_key1.2~wXkOjMS_J6kHzEKkNJa3RlrRcHX7SGG.1 2024-06-04T16:15:22.903 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.901+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.44__shadow_key1.2~wXkOjMS_J6kHzEKkNJa3RlrRcHX7SGG.1_1 2024-06-04T16:15:22.905 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.904+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.44__shadow_key1.2~wXkOjMS_J6kHzEKkNJa3RlrRcHX7SGG.1_2 2024-06-04T16:15:22.905 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.904+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.44__multipart_key1.2~wXkOjMS_J6kHzEKkNJa3RlrRcHX7SGG.2 2024-06-04T16:15:22.905 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.904+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.44__shadow_key1.2~wXkOjMS_J6kHzEKkNJa3RlrRcHX7SGG.2_1 2024-06-04T16:15:22.905 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.904+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.44__shadow_key1.2~wXkOjMS_J6kHzEKkNJa3RlrRcHX7SGG.2_2 2024-06-04T16:15:22.905 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.904+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.44__multipart_key1.2~wXkOjMS_J6kHzEKkNJa3RlrRcHX7SGG.3 2024-06-04T16:15:22.907 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.905+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.44__shadow_key1.2~wXkOjMS_J6kHzEKkNJa3RlrRcHX7SGG.3_1 2024-06-04T16:15:22.907 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.905+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.44__shadow_key1.2~wXkOjMS_J6kHzEKkNJa3RlrRcHX7SGG.3_2 2024-06-04T16:15:22.907 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.906+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.44__multipart_key1.2~wXkOjMS_J6kHzEKkNJa3RlrRcHX7SGG.4 2024-06-04T16:15:22.907 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.906+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.44__shadow_key1.2~wXkOjMS_J6kHzEKkNJa3RlrRcHX7SGG.4_1 2024-06-04T16:15:22.907 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.906+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.44__shadow_key1.2~wXkOjMS_J6kHzEKkNJa3RlrRcHX7SGG.4_2 2024-06-04T16:15:22.907 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.906+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.44__multipart_key1.2~wXkOjMS_J6kHzEKkNJa3RlrRcHX7SGG.5 2024-06-04T16:15:22.910 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.909+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.44__shadow_key1.2~wXkOjMS_J6kHzEKkNJa3RlrRcHX7SGG.5_1 2024-06-04T16:15:22.910 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.909+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.44__shadow_key1.2~wXkOjMS_J6kHzEKkNJa3RlrRcHX7SGG.5_2 2024-06-04T16:15:22.910 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.909+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.44__multipart_key1.2~wXkOjMS_J6kHzEKkNJa3RlrRcHX7SGG.6 2024-06-04T16:15:22.914 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.913+0000 7f205160e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-06-04T16:15:22.916 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.916+0000 7f205160e800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-06-04T16:15:22.917 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.917+0000 7f205160e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:22.918 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.917+0000 7f205160e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:15:22.918 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.917+0000 7f205160e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:22.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.918+0000 7f205160e800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-06-04T16:15:22.921 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.920+0000 7f205160e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:22.922 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.921+0000 7f205160e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:15:22.923 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.921+0000 7f205160e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-06-04T16:15:22.923 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.921+0000 7f205160e800 20 garbage collection: RGWGC::process iterating over entry tag='be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.5137303421082421157', time=2024-06-04T18:15:07.706555+0000, chain.objs.size()=7 2024-06-04T16:15:22.923 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.921+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.36__multipart_key1.2~NJbDLOMUa-52Br5IU0nEiMmifz4Ebzz.1 2024-06-04T16:15:22.923 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.921+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.36__shadow_key1.2~NJbDLOMUa-52Br5IU0nEiMmifz4Ebzz.1_1 2024-06-04T16:15:22.923 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.921+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.36__shadow_key1.2~NJbDLOMUa-52Br5IU0nEiMmifz4Ebzz.1_2 2024-06-04T16:15:22.923 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.921+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.36__multipart_key1.2~NJbDLOMUa-52Br5IU0nEiMmifz4Ebzz.2 2024-06-04T16:15:22.923 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.922+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.36__shadow_key1.2~NJbDLOMUa-52Br5IU0nEiMmifz4Ebzz.2_1 2024-06-04T16:15:22.923 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.922+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.36__shadow_key1.2~NJbDLOMUa-52Br5IU0nEiMmifz4Ebzz.2_2 2024-06-04T16:15:22.923 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.922+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.36__multipart_key1.2~NJbDLOMUa-52Br5IU0nEiMmifz4Ebzz.3 2024-06-04T16:15:22.923 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.922+0000 7f205160e800 20 garbage collection: RGWGC::process iterating over entry tag='be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.2117550344504445567', time=2024-06-04T18:15:14.212744+0000, chain.objs.size()=21 2024-06-04T16:15:22.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.922+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.44__multipart_key1.2~7XVLbtg0XeK0InjNygemHr5Ii1TautJ.1 2024-06-04T16:15:22.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.922+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.44__shadow_key1.2~7XVLbtg0XeK0InjNygemHr5Ii1TautJ.1_1 2024-06-04T16:15:22.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.922+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.44__multipart_key1.2~7XVLbtg0XeK0InjNygemHr5Ii1TautJ.2 2024-06-04T16:15:22.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.922+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.44__shadow_key1.2~7XVLbtg0XeK0InjNygemHr5Ii1TautJ.2_1 2024-06-04T16:15:22.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.922+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.44__multipart_key1.2~7XVLbtg0XeK0InjNygemHr5Ii1TautJ.3 2024-06-04T16:15:22.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.924+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.44__shadow_key1.2~7XVLbtg0XeK0InjNygemHr5Ii1TautJ.3_1 2024-06-04T16:15:22.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.925+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.44__multipart_key1.2~7XVLbtg0XeK0InjNygemHr5Ii1TautJ.4 2024-06-04T16:15:22.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.925+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.44__shadow_key1.2~7XVLbtg0XeK0InjNygemHr5Ii1TautJ.4_1 2024-06-04T16:15:22.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.926+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.44__multipart_key1.2~7XVLbtg0XeK0InjNygemHr5Ii1TautJ.5 2024-06-04T16:15:22.927 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.926+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.44__shadow_key1.2~7XVLbtg0XeK0InjNygemHr5Ii1TautJ.5_1 2024-06-04T16:15:22.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.928+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.44__multipart_key1.2~7XVLbtg0XeK0InjNygemHr5Ii1TautJ.6 2024-06-04T16:15:22.930 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.928+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.44__shadow_key1.2~7XVLbtg0XeK0InjNygemHr5Ii1TautJ.6_1 2024-06-04T16:15:22.930 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.928+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.44__multipart_key1.2~7XVLbtg0XeK0InjNygemHr5Ii1TautJ.7 2024-06-04T16:15:22.930 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.928+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.44__shadow_key1.2~7XVLbtg0XeK0InjNygemHr5Ii1TautJ.7_1 2024-06-04T16:15:22.930 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.929+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.44__multipart_key1.2~7XVLbtg0XeK0InjNygemHr5Ii1TautJ.8 2024-06-04T16:15:22.930 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.929+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.44__shadow_key1.2~7XVLbtg0XeK0InjNygemHr5Ii1TautJ.8_1 2024-06-04T16:15:22.930 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.929+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.44__multipart_key1.2~7XVLbtg0XeK0InjNygemHr5Ii1TautJ.9 2024-06-04T16:15:22.930 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.929+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.44__shadow_key1.2~7XVLbtg0XeK0InjNygemHr5Ii1TautJ.9_1 2024-06-04T16:15:22.931 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.930+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.44__multipart_key1.2~7XVLbtg0XeK0InjNygemHr5Ii1TautJ.10 2024-06-04T16:15:22.931 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.931+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.44__shadow_key1.2~7XVLbtg0XeK0InjNygemHr5Ii1TautJ.10_1 2024-06-04T16:15:22.931 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.931+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.44__multipart_key1.2~7XVLbtg0XeK0InjNygemHr5Ii1TautJ.11 2024-06-04T16:15:22.940 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.939+0000 7f205160e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-06-04T16:15:22.946 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.945+0000 7f205160e800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-06-04T16:15:22.949 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.948+0000 7f205160e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:22.949 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.948+0000 7f205160e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:15:22.950 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.949+0000 7f205160e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-06-04T16:15:22.950 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.949+0000 7f205160e800 20 garbage collection: RGWGC::process iterating over entry tag='be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.5470658387401707911', time=2024-06-04T18:15:15.408778+0000, chain.objs.size()=19 2024-06-04T16:15:22.950 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.949+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.44__multipart_key1.2~NYVEwVk7fbiYFltpjHPgPPqmzAedQa6.1 2024-06-04T16:15:22.950 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.949+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.44__shadow_key1.2~NYVEwVk7fbiYFltpjHPgPPqmzAedQa6.1_1 2024-06-04T16:15:22.950 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.949+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.44__multipart_key1.2~NYVEwVk7fbiYFltpjHPgPPqmzAedQa6.2 2024-06-04T16:15:22.950 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.949+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.44__shadow_key1.2~NYVEwVk7fbiYFltpjHPgPPqmzAedQa6.2_1 2024-06-04T16:15:22.950 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.949+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.44__multipart_key1.2~NYVEwVk7fbiYFltpjHPgPPqmzAedQa6.3 2024-06-04T16:15:22.951 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.949+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.44__shadow_key1.2~NYVEwVk7fbiYFltpjHPgPPqmzAedQa6.3_1 2024-06-04T16:15:22.951 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.949+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.44__multipart_key1.2~NYVEwVk7fbiYFltpjHPgPPqmzAedQa6.4 2024-06-04T16:15:22.951 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.949+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.44__shadow_key1.2~NYVEwVk7fbiYFltpjHPgPPqmzAedQa6.4_1 2024-06-04T16:15:22.951 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.949+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.44__multipart_key1.2~NYVEwVk7fbiYFltpjHPgPPqmzAedQa6.5 2024-06-04T16:15:22.951 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.949+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.44__shadow_key1.2~NYVEwVk7fbiYFltpjHPgPPqmzAedQa6.5_1 2024-06-04T16:15:22.951 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.949+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.44__multipart_key1.2~NYVEwVk7fbiYFltpjHPgPPqmzAedQa6.6 2024-06-04T16:15:22.951 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.949+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.44__shadow_key1.2~NYVEwVk7fbiYFltpjHPgPPqmzAedQa6.6_1 2024-06-04T16:15:22.953 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.952+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.44__multipart_key1.2~NYVEwVk7fbiYFltpjHPgPPqmzAedQa6.7 2024-06-04T16:15:22.953 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.952+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.44__shadow_key1.2~NYVEwVk7fbiYFltpjHPgPPqmzAedQa6.7_1 2024-06-04T16:15:22.953 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.952+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.44__multipart_key1.2~NYVEwVk7fbiYFltpjHPgPPqmzAedQa6.8 2024-06-04T16:15:22.955 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.954+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.44__shadow_key1.2~NYVEwVk7fbiYFltpjHPgPPqmzAedQa6.8_1 2024-06-04T16:15:22.956 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.955+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.44__multipart_key1.2~NYVEwVk7fbiYFltpjHPgPPqmzAedQa6.9 2024-06-04T16:15:22.956 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.955+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.44__shadow_key1.2~NYVEwVk7fbiYFltpjHPgPPqmzAedQa6.9_1 2024-06-04T16:15:22.956 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.955+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.44__multipart_key1.2~NYVEwVk7fbiYFltpjHPgPPqmzAedQa6.10 2024-06-04T16:15:22.959 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.959+0000 7f205160e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-06-04T16:15:22.965 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.964+0000 7f205160e800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-06-04T16:15:22.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.965+0000 7f205160e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:22.967 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.966+0000 7f205160e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:15:22.967 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.966+0000 7f205160e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:22.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.967+0000 7f205160e800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-06-04T16:15:22.969 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.968+0000 7f205160e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:22.969 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.969+0000 7f205160e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:15:22.970 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.969+0000 7f205160e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-06-04T16:15:22.971 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.969+0000 7f205160e800 20 garbage collection: RGWGC::process iterating over entry tag='be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.3727907581806525649', time=2024-06-04T18:15:02.434716+0000, chain.objs.size()=9 2024-06-04T16:15:22.971 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.969+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.31__multipart_key1.2~kBVTb8_8oxuwAQSRhFrkBuJVlUwOHXc.1 2024-06-04T16:15:22.971 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.969+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.31__shadow_key1.2~kBVTb8_8oxuwAQSRhFrkBuJVlUwOHXc.1_1 2024-06-04T16:15:22.971 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.969+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.31__multipart_key1.2~kBVTb8_8oxuwAQSRhFrkBuJVlUwOHXc.2 2024-06-04T16:15:22.971 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.969+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.31__shadow_key1.2~kBVTb8_8oxuwAQSRhFrkBuJVlUwOHXc.2_1 2024-06-04T16:15:22.971 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.969+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.31__multipart_key1.2~kBVTb8_8oxuwAQSRhFrkBuJVlUwOHXc.3 2024-06-04T16:15:22.971 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.969+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.31__shadow_key1.2~kBVTb8_8oxuwAQSRhFrkBuJVlUwOHXc.3_1 2024-06-04T16:15:22.971 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.969+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.31__multipart_key1.2~kBVTb8_8oxuwAQSRhFrkBuJVlUwOHXc.4 2024-06-04T16:15:22.971 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.969+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.31__shadow_key1.2~kBVTb8_8oxuwAQSRhFrkBuJVlUwOHXc.4_1 2024-06-04T16:15:22.971 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.969+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.31__multipart_key1.2~kBVTb8_8oxuwAQSRhFrkBuJVlUwOHXc.5 2024-06-04T16:15:22.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.974+0000 7f205160e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-06-04T16:15:22.978 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.978+0000 7f205160e800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-06-04T16:15:22.980 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.979+0000 7f205160e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:22.980 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.979+0000 7f205160e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:15:22.981 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.980+0000 7f205160e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-06-04T16:15:22.981 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.980+0000 7f205160e800 20 garbage collection: RGWGC::process iterating over entry tag='be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.4621668453091300791', time=2024-06-04T18:15:07.026878+0000, chain.objs.size()=7 2024-06-04T16:15:22.981 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.980+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.36__multipart_key1.2~4yGx6HxgL7cIeuB2NGpKxm5PlEzhM9o.1 2024-06-04T16:15:22.981 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.980+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.36__shadow_key1.2~4yGx6HxgL7cIeuB2NGpKxm5PlEzhM9o.1_1 2024-06-04T16:15:22.981 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.980+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.36__shadow_key1.2~4yGx6HxgL7cIeuB2NGpKxm5PlEzhM9o.1_2 2024-06-04T16:15:22.981 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.980+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.36__multipart_key1.2~4yGx6HxgL7cIeuB2NGpKxm5PlEzhM9o.2 2024-06-04T16:15:22.981 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.980+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.36__shadow_key1.2~4yGx6HxgL7cIeuB2NGpKxm5PlEzhM9o.2_1 2024-06-04T16:15:22.981 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.980+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.36__shadow_key1.2~4yGx6HxgL7cIeuB2NGpKxm5PlEzhM9o.2_2 2024-06-04T16:15:22.981 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.980+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.36__multipart_key1.2~4yGx6HxgL7cIeuB2NGpKxm5PlEzhM9o.3 2024-06-04T16:15:22.984 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.983+0000 7f205160e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-06-04T16:15:22.987 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.986+0000 7f205160e800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-06-04T16:15:22.988 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.988+0000 7f205160e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:22.989 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.988+0000 7f205160e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:15:22.989 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.988+0000 7f205160e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:22.990 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.989+0000 7f205160e800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-06-04T16:15:22.992 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.991+0000 7f205160e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:22.992 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.992+0000 7f205160e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:15:22.993 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.992+0000 7f205160e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:22.994 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.993+0000 7f205160e800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-06-04T16:15:22.995 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.994+0000 7f205160e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:22.995 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.994+0000 7f205160e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:15:22.995 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.995+0000 7f205160e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:22.996 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.996+0000 7f205160e800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-06-04T16:15:22.997 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.997+0000 7f205160e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:22.998 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.997+0000 7f205160e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:15:22.999 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.998+0000 7f205160e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-06-04T16:15:22.999 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.998+0000 7f205160e800 20 garbage collection: RGWGC::process iterating over entry tag='be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.12387054055572482425', time=2024-06-04T18:15:05.593102+0000, chain.objs.size()=9 2024-06-04T16:15:22.999 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.998+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.36__multipart_key1.2~xRCM_5dtOX5OA0rQkqm6gOhbEVqH7CC.1 2024-06-04T16:15:22.999 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.998+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.36__shadow_key1.2~xRCM_5dtOX5OA0rQkqm6gOhbEVqH7CC.1_1 2024-06-04T16:15:22.999 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.998+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.36__multipart_key1.2~xRCM_5dtOX5OA0rQkqm6gOhbEVqH7CC.2 2024-06-04T16:15:22.999 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.998+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.36__shadow_key1.2~xRCM_5dtOX5OA0rQkqm6gOhbEVqH7CC.2_1 2024-06-04T16:15:22.999 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.998+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.36__multipart_key1.2~xRCM_5dtOX5OA0rQkqm6gOhbEVqH7CC.3 2024-06-04T16:15:22.999 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.998+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.36__shadow_key1.2~xRCM_5dtOX5OA0rQkqm6gOhbEVqH7CC.3_1 2024-06-04T16:15:22.999 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.998+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.36__multipart_key1.2~xRCM_5dtOX5OA0rQkqm6gOhbEVqH7CC.4 2024-06-04T16:15:22.999 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.998+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.36__shadow_key1.2~xRCM_5dtOX5OA0rQkqm6gOhbEVqH7CC.4_1 2024-06-04T16:15:22.999 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:22.998+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.36__multipart_key1.2~xRCM_5dtOX5OA0rQkqm6gOhbEVqH7CC.5 2024-06-04T16:15:23.003 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.002+0000 7f205160e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-06-04T16:15:23.005 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.005+0000 7f205160e800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-06-04T16:15:23.006 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.006+0000 7f205160e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:23.007 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.006+0000 7f205160e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:15:23.007 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.006+0000 7f205160e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:23.008 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.007+0000 7f205160e800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-06-04T16:15:23.009 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.009+0000 7f205160e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:23.010 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.009+0000 7f205160e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:15:23.010 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.009+0000 7f205160e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-06-04T16:15:23.010 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.009+0000 7f205160e800 20 garbage collection: RGWGC::process iterating over entry tag='be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.17525010514362690870', time=2024-06-04T18:15:07.587006+0000, chain.objs.size()=5 2024-06-04T16:15:23.011 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.009+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.35__shadow_.IRWosYKAKI_Z9UZlbqENijRcrZD0fyn_1 2024-06-04T16:15:23.011 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.009+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.35__shadow_.IRWosYKAKI_Z9UZlbqENijRcrZD0fyn_2 2024-06-04T16:15:23.011 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.009+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.35__shadow_.IRWosYKAKI_Z9UZlbqENijRcrZD0fyn_3 2024-06-04T16:15:23.011 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.009+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.35__shadow_.IRWosYKAKI_Z9UZlbqENijRcrZD0fyn_4 2024-06-04T16:15:23.011 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.009+0000 7f205160e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.35__shadow_.IRWosYKAKI_Z9UZlbqENijRcrZD0fyn_5 2024-06-04T16:15:23.013 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.012+0000 7f205160e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-06-04T16:15:23.016 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.015+0000 7f1f05fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-06-04T16:15:23.018 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.017+0000 7f205160e800 20 remove_watcher() i=0 2024-06-04T16:15:23.018 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.017+0000 7f205160e800 2 removed watcher, disabling cache 2024-06-04T16:15:23.019 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.018+0000 7f205160e800 20 remove_watcher() i=1 2024-06-04T16:15:23.020 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.020+0000 7f205160e800 20 remove_watcher() i=2 2024-06-04T16:15:23.021 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.021+0000 7f205160e800 20 remove_watcher() i=3 2024-06-04T16:15:23.022 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.021+0000 7f205160e800 20 remove_watcher() i=4 2024-06-04T16:15:23.023 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.022+0000 7f205160e800 20 remove_watcher() i=5 2024-06-04T16:15:23.024 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.023+0000 7f205160e800 20 remove_watcher() i=6 2024-06-04T16:15:23.025 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.025+0000 7f205160e800 20 remove_watcher() i=7 2024-06-04T16:15:23.036 DEBUG:teuthology.orchestra.run.smithi144:> radosgw-admin gc process --include-all 2024-06-04T16:15:23.088 INFO:teuthology.orchestra.run.smithi144.stderr:ignoring --setuser ceph since I am not root 2024-06-04T16:15:23.088 INFO:teuthology.orchestra.run.smithi144.stderr:ignoring --setgroup ceph since I am not root 2024-06-04T16:15:23.125 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.124+0000 7f541973f800 20 rados->read ofs=0 len=0 2024-06-04T16:15:23.126 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.125+0000 7f541973f800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:15:23.126 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.125+0000 7f541973f800 20 realm 2024-06-04T16:15:23.126 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.125+0000 7f541973f800 20 rados->read ofs=0 len=0 2024-06-04T16:15:23.127 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.125+0000 7f541973f800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:15:23.127 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.125+0000 7f541973f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-06-04T16:15:23.127 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.125+0000 7f541973f800 20 rados->read ofs=0 len=0 2024-06-04T16:15:23.127 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.126+0000 7f541973f800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:15:23.127 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.126+0000 7f541973f800 20 rados->read ofs=0 len=0 2024-06-04T16:15:23.128 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.126+0000 7f541973f800 20 rados_obj.operate() r=0 bl.length=46 2024-06-04T16:15:23.128 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.126+0000 7f541973f800 20 rados->read ofs=0 len=0 2024-06-04T16:15:23.128 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.127+0000 7f541973f800 20 rados_obj.operate() r=0 bl.length=1139 2024-06-04T16:15:23.128 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.127+0000 7f541973f800 20 searching for the correct realm 2024-06-04T16:15:23.129 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.129+0000 7f540ffff640 0 -- 172.21.15.144:0/922446048 >> [v2:172.21.15.144:6808/86532035,v1:172.21.15.144:6809/86532035] conn(0x7f54080c0040 msgr2=0x7f54080a08e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-06-04T16:15:23.133 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.132+0000 7f540ffff640 0 -- 172.21.15.144:0/922446048 >> [v2:172.21.15.144:6816/2358575268,v1:172.21.15.144:6817/2358575268] conn(0x55f5435f3d10 msgr2=0x55f5435f6100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-06-04T16:15:23.138 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.137+0000 7f541973f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-06-04T16:15:23.139 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.137+0000 7f541973f800 20 RGWRados::pool_iterate: got zone_info.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767 2024-06-04T16:15:23.139 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.137+0000 7f541973f800 20 RGWRados::pool_iterate: got default.zone. 2024-06-04T16:15:23.139 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.137+0000 7f541973f800 20 RGWRados::pool_iterate: got zonegroup_info.abb22408-c332-4e28-8f7a-ff254ea2fed2 2024-06-04T16:15:23.139 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.137+0000 7f541973f800 20 RGWRados::pool_iterate: got zone_names.default 2024-06-04T16:15:23.139 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.137+0000 7f541973f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-06-04T16:15:23.139 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.137+0000 7f541973f800 20 rados->read ofs=0 len=0 2024-06-04T16:15:23.139 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.138+0000 7f541973f800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:15:23.139 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.138+0000 7f541973f800 20 rados->read ofs=0 len=0 2024-06-04T16:15:23.139 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.138+0000 7f541973f800 20 rados_obj.operate() r=0 bl.length=46 2024-06-04T16:15:23.139 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.138+0000 7f541973f800 20 rados->read ofs=0 len=0 2024-06-04T16:15:23.140 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.138+0000 7f541973f800 20 rados_obj.operate() r=0 bl.length=470 2024-06-04T16:15:23.140 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.138+0000 7f541973f800 20 zone default found 2024-06-04T16:15:23.141 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.138+0000 7f541973f800 4 Realm: () 2024-06-04T16:15:23.141 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.138+0000 7f541973f800 4 ZoneGroup: default (abb22408-c332-4e28-8f7a-ff254ea2fed2) 2024-06-04T16:15:23.141 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.138+0000 7f541973f800 4 Zone: default (be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767) 2024-06-04T16:15:23.141 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.138+0000 7f541973f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-06-04T16:15:23.141 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.138+0000 7f541973f800 20 zonegroup default 2024-06-04T16:15:23.141 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.138+0000 7f541973f800 20 rados->read ofs=0 len=0 2024-06-04T16:15:23.141 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.138+0000 7f541973f800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:15:23.141 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.138+0000 7f541973f800 20 rados->read ofs=0 len=0 2024-06-04T16:15:23.141 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.139+0000 7f541973f800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:15:23.141 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.139+0000 7f541973f800 20 rados->read ofs=0 len=0 2024-06-04T16:15:23.141 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.139+0000 7f541973f800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:15:23.141 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.139+0000 7f541973f800 20 started sync module instance, tier type = 2024-06-04T16:15:23.141 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.139+0000 7f541973f800 20 started zone id=be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767 (name=default) with tier type = 2024-06-04T16:15:23.148 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.148+0000 7f541973f800 20 add_watcher() i=0 2024-06-04T16:15:23.148 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.148+0000 7f541973f800 20 add_watcher() i=1 2024-06-04T16:15:23.149 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.148+0000 7f541973f800 20 add_watcher() i=2 2024-06-04T16:15:23.149 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.148+0000 7f541973f800 20 add_watcher() i=3 2024-06-04T16:15:23.149 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.148+0000 7f541973f800 20 add_watcher() i=4 2024-06-04T16:15:23.149 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.148+0000 7f541973f800 20 add_watcher() i=5 2024-06-04T16:15:23.149 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.148+0000 7f541973f800 20 add_watcher() i=6 2024-06-04T16:15:23.149 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.149+0000 7f541973f800 20 add_watcher() i=7 2024-06-04T16:15:23.150 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.149+0000 7f541973f800 2 all 8 watchers are set, enabling cache 2024-06-04T16:15:23.151 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.151+0000 7f52cb7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-06-04T16:15:23.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.151+0000 7f541973f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-06-04T16:15:23.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.151+0000 7f541973f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-06-04T16:15:23.187 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.186+0000 7f52ca7e4640 20 reqs_thread_entry: start 2024-06-04T16:15:23.187 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.186+0000 7f541973f800 20 init_complete bucket index max shards: 11 2024-06-04T16:15:23.187 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.186+0000 7f541973f800 20 Filter name: none 2024-06-04T16:15:23.188 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.186+0000 7f523bfff640 20 reqs_thread_entry: start 2024-06-04T16:15:23.188 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.186+0000 7f541973f800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-06-04T16:15:23.188 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.188+0000 7f541973f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:23.189 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.188+0000 7f541973f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:15:23.189 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.188+0000 7f541973f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:23.190 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.189+0000 7f541973f800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-06-04T16:15:23.191 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.190+0000 7f541973f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:23.191 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.191+0000 7f541973f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:15:23.192 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.191+0000 7f541973f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:23.193 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.192+0000 7f541973f800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-06-04T16:15:23.194 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.193+0000 7f541973f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:23.194 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.194+0000 7f541973f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:15:23.195 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.194+0000 7f541973f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:23.196 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.195+0000 7f541973f800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-06-04T16:15:23.197 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.196+0000 7f541973f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:23.197 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.197+0000 7f541973f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:15:23.198 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.197+0000 7f541973f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:23.199 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.198+0000 7f541973f800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-06-04T16:15:23.200 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.199+0000 7f541973f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:23.200 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.200+0000 7f541973f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:15:23.200 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.200+0000 7f541973f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:23.201 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.201+0000 7f541973f800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-06-04T16:15:23.203 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.202+0000 7f541973f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:23.203 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.202+0000 7f541973f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:15:23.203 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.203+0000 7f541973f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:23.205 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.204+0000 7f541973f800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-06-04T16:15:23.206 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.205+0000 7f541973f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:23.206 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.206+0000 7f541973f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:15:23.207 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.206+0000 7f541973f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:23.207 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.207+0000 7f541973f800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-06-04T16:15:23.209 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.208+0000 7f541973f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:23.209 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.208+0000 7f541973f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:15:23.209 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.208+0000 7f541973f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:23.210 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.209+0000 7f541973f800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-06-04T16:15:23.211 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.211+0000 7f541973f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:23.212 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.211+0000 7f541973f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:15:23.212 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.211+0000 7f541973f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:23.213 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.212+0000 7f541973f800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-06-04T16:15:23.214 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.214+0000 7f541973f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:23.215 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.214+0000 7f541973f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:15:23.215 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.214+0000 7f541973f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:23.216 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.215+0000 7f541973f800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-06-04T16:15:23.217 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.216+0000 7f541973f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:23.218 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.217+0000 7f541973f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:15:23.218 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.217+0000 7f541973f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:23.219 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.218+0000 7f541973f800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-06-04T16:15:23.220 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.220+0000 7f541973f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:23.221 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.220+0000 7f541973f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:15:23.221 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.220+0000 7f541973f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:23.222 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.221+0000 7f541973f800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-06-04T16:15:23.224 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.223+0000 7f541973f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:23.224 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.223+0000 7f541973f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:15:23.224 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.223+0000 7f541973f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:23.225 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.224+0000 7f541973f800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-06-04T16:15:23.226 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.226+0000 7f541973f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:23.227 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.226+0000 7f541973f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:15:23.227 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.226+0000 7f541973f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:23.228 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.227+0000 7f541973f800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-06-04T16:15:23.229 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.228+0000 7f541973f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:23.230 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.229+0000 7f541973f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:15:23.230 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.229+0000 7f541973f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:23.231 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.230+0000 7f541973f800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-06-04T16:15:23.234 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.232+0000 7f541973f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:23.235 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.232+0000 7f541973f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:15:23.235 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.232+0000 7f541973f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:23.235 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.233+0000 7f541973f800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-06-04T16:15:23.236 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.235+0000 7f541973f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:23.236 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.235+0000 7f541973f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:15:23.236 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.236+0000 7f541973f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:23.237 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.237+0000 7f541973f800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-06-04T16:15:23.238 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.238+0000 7f541973f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:23.239 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.238+0000 7f541973f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:15:23.239 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.238+0000 7f541973f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:23.240 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.239+0000 7f541973f800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-06-04T16:15:23.241 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.241+0000 7f541973f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:23.242 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.241+0000 7f541973f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:15:23.242 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.241+0000 7f541973f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:23.244 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.243+0000 7f541973f800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-06-04T16:15:23.246 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.245+0000 7f541973f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:23.246 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.245+0000 7f541973f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:15:23.246 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.245+0000 7f541973f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:23.247 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.246+0000 7f541973f800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-06-04T16:15:23.248 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.248+0000 7f541973f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:23.249 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.248+0000 7f541973f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:15:23.249 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.248+0000 7f541973f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:23.250 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.250+0000 7f541973f800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-06-04T16:15:23.252 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.251+0000 7f541973f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:23.253 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.252+0000 7f541973f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:15:23.253 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.252+0000 7f541973f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:23.254 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.253+0000 7f541973f800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-06-04T16:15:23.255 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.254+0000 7f541973f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:23.256 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.255+0000 7f541973f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:15:23.256 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.255+0000 7f541973f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:23.257 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.256+0000 7f541973f800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-06-04T16:15:23.258 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.258+0000 7f541973f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:23.259 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.258+0000 7f541973f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:15:23.259 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.258+0000 7f541973f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:23.260 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.259+0000 7f541973f800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-06-04T16:15:23.261 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.260+0000 7f541973f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:23.262 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.261+0000 7f541973f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:15:23.262 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.261+0000 7f541973f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:23.263 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.262+0000 7f541973f800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-06-04T16:15:23.264 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.264+0000 7f541973f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:23.265 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.264+0000 7f541973f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:15:23.265 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.264+0000 7f541973f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:23.266 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.265+0000 7f541973f800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-06-04T16:15:23.267 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.267+0000 7f541973f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:23.268 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.267+0000 7f541973f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:15:23.268 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.267+0000 7f541973f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:23.269 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.268+0000 7f541973f800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-06-04T16:15:23.270 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.269+0000 7f541973f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:23.271 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.270+0000 7f541973f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:15:23.271 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.270+0000 7f541973f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:23.272 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.271+0000 7f541973f800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-06-04T16:15:23.274 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.273+0000 7f541973f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:23.274 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.273+0000 7f541973f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:15:23.274 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.274+0000 7f541973f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:23.275 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.275+0000 7f541973f800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-06-04T16:15:23.277 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.276+0000 7f541973f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:23.277 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.276+0000 7f541973f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:15:23.277 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.276+0000 7f541973f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:23.278 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.277+0000 7f541973f800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-06-04T16:15:23.280 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.279+0000 7f541973f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:23.280 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.279+0000 7f541973f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:15:23.280 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.279+0000 7f541973f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:23.281 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.280+0000 7f541973f800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-06-04T16:15:23.283 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.282+0000 7f541973f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:23.283 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.282+0000 7f541973f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:15:23.283 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.283+0000 7f541973f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:23.285 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.284+0000 7f52cb7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-06-04T16:15:23.287 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.286+0000 7f541973f800 20 remove_watcher() i=0 2024-06-04T16:15:23.287 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.286+0000 7f541973f800 2 removed watcher, disabling cache 2024-06-04T16:15:23.288 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.287+0000 7f541973f800 20 remove_watcher() i=1 2024-06-04T16:15:23.289 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.289+0000 7f541973f800 20 remove_watcher() i=2 2024-06-04T16:15:23.290 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.289+0000 7f541973f800 20 remove_watcher() i=3 2024-06-04T16:15:23.291 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.290+0000 7f541973f800 20 remove_watcher() i=4 2024-06-04T16:15:23.292 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.291+0000 7f541973f800 20 remove_watcher() i=5 2024-06-04T16:15:23.293 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.292+0000 7f541973f800 20 remove_watcher() i=6 2024-06-04T16:15:23.294 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.293+0000 7f541973f800 20 remove_watcher() i=7 2024-06-04T16:15:23.305 DEBUG:teuthology.orchestra.run.smithi144:> radosgw-admin gc process --include-all 2024-06-04T16:15:23.357 INFO:teuthology.orchestra.run.smithi144.stderr:ignoring --setuser ceph since I am not root 2024-06-04T16:15:23.357 INFO:teuthology.orchestra.run.smithi144.stderr:ignoring --setgroup ceph since I am not root 2024-06-04T16:15:23.394 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.393+0000 7fb0885af800 20 rados->read ofs=0 len=0 2024-06-04T16:15:23.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.394+0000 7fb0885af800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:15:23.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.394+0000 7fb0885af800 20 realm 2024-06-04T16:15:23.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.394+0000 7fb0885af800 20 rados->read ofs=0 len=0 2024-06-04T16:15:23.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.395+0000 7fb0885af800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:15:23.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.395+0000 7fb0885af800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-06-04T16:15:23.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.395+0000 7fb0885af800 20 rados->read ofs=0 len=0 2024-06-04T16:15:23.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.395+0000 7fb0885af800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:15:23.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.395+0000 7fb0885af800 20 rados->read ofs=0 len=0 2024-06-04T16:15:23.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.395+0000 7fb0885af800 20 rados_obj.operate() r=0 bl.length=46 2024-06-04T16:15:23.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.395+0000 7fb0885af800 20 rados->read ofs=0 len=0 2024-06-04T16:15:23.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.396+0000 7fb0885af800 20 rados_obj.operate() r=0 bl.length=1139 2024-06-04T16:15:23.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.396+0000 7fb0885af800 20 searching for the correct realm 2024-06-04T16:15:23.398 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.398+0000 7fb0860ab640 0 -- 172.21.15.144:0/560354149 >> [v2:172.21.15.177:6824/800067290,v1:172.21.15.177:6825/800067290] conn(0x55a16a15b030 msgr2=0x55a16a15d4b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-06-04T16:15:23.402 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.401+0000 7fb07ffff640 0 -- 172.21.15.144:0/560354149 >> [v2:172.21.15.177:6808/2618477608,v1:172.21.15.177:6809/2618477608] conn(0x7fb07003e070 msgr2=0x7fb0700a4970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-06-04T16:15:23.610 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.608+0000 7fb0885af800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-06-04T16:15:23.610 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.608+0000 7fb0885af800 20 RGWRados::pool_iterate: got zone_info.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767 2024-06-04T16:15:23.610 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.608+0000 7fb0885af800 20 RGWRados::pool_iterate: got default.zone. 2024-06-04T16:15:23.610 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.608+0000 7fb0885af800 20 RGWRados::pool_iterate: got zonegroup_info.abb22408-c332-4e28-8f7a-ff254ea2fed2 2024-06-04T16:15:23.610 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.608+0000 7fb0885af800 20 RGWRados::pool_iterate: got zone_names.default 2024-06-04T16:15:23.610 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.608+0000 7fb0885af800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-06-04T16:15:23.610 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.608+0000 7fb0885af800 20 rados->read ofs=0 len=0 2024-06-04T16:15:23.610 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.608+0000 7fb0885af800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:15:23.611 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.608+0000 7fb0885af800 20 rados->read ofs=0 len=0 2024-06-04T16:15:23.611 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.608+0000 7fb0885af800 20 rados_obj.operate() r=0 bl.length=46 2024-06-04T16:15:23.611 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.608+0000 7fb0885af800 20 rados->read ofs=0 len=0 2024-06-04T16:15:23.611 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.609+0000 7fb0885af800 20 rados_obj.operate() r=0 bl.length=470 2024-06-04T16:15:23.611 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.609+0000 7fb0885af800 20 zone default found 2024-06-04T16:15:23.611 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.609+0000 7fb0885af800 4 Realm: () 2024-06-04T16:15:23.611 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.609+0000 7fb0885af800 4 ZoneGroup: default (abb22408-c332-4e28-8f7a-ff254ea2fed2) 2024-06-04T16:15:23.611 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.609+0000 7fb0885af800 4 Zone: default (be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767) 2024-06-04T16:15:23.611 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.609+0000 7fb0885af800 10 cannot find current period zonegroup using local zonegroup configuration 2024-06-04T16:15:23.611 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.609+0000 7fb0885af800 20 zonegroup default 2024-06-04T16:15:23.611 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.609+0000 7fb0885af800 20 rados->read ofs=0 len=0 2024-06-04T16:15:23.611 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.609+0000 7fb0885af800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:15:23.611 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.609+0000 7fb0885af800 20 rados->read ofs=0 len=0 2024-06-04T16:15:23.612 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.609+0000 7fb0885af800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:15:23.612 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.609+0000 7fb0885af800 20 rados->read ofs=0 len=0 2024-06-04T16:15:23.612 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.610+0000 7fb0885af800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:15:23.612 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.610+0000 7fb0885af800 20 started sync module instance, tier type = 2024-06-04T16:15:23.612 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.610+0000 7fb0885af800 20 started zone id=be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767 (name=default) with tier type = 2024-06-04T16:15:23.620 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.619+0000 7fb0885af800 20 add_watcher() i=0 2024-06-04T16:15:23.620 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.619+0000 7fb0885af800 20 add_watcher() i=1 2024-06-04T16:15:23.620 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.619+0000 7fb0885af800 20 add_watcher() i=2 2024-06-04T16:15:23.620 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.619+0000 7fb0885af800 20 add_watcher() i=3 2024-06-04T16:15:23.620 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.619+0000 7fb0885af800 20 add_watcher() i=4 2024-06-04T16:15:23.620 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.619+0000 7fb0885af800 20 add_watcher() i=5 2024-06-04T16:15:23.620 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.619+0000 7fb0885af800 20 add_watcher() i=6 2024-06-04T16:15:23.621 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.620+0000 7fb0885af800 20 add_watcher() i=7 2024-06-04T16:15:23.621 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.620+0000 7fb0885af800 2 all 8 watchers are set, enabling cache 2024-06-04T16:15:23.622 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.621+0000 7faf3cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-06-04T16:15:23.623 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.622+0000 7fb0885af800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-06-04T16:15:23.623 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.622+0000 7fb0885af800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-06-04T16:15:23.659 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.658+0000 7faeb77fe640 20 reqs_thread_entry: start 2024-06-04T16:15:23.660 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.658+0000 7fb0885af800 20 init_complete bucket index max shards: 11 2024-06-04T16:15:23.660 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.658+0000 7fb0885af800 20 Filter name: none 2024-06-04T16:15:23.660 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.659+0000 7faeb57fa640 20 reqs_thread_entry: start 2024-06-04T16:15:23.660 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.659+0000 7fb0885af800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-06-04T16:15:23.660 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.660+0000 7fb0885af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:23.661 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.660+0000 7fb0885af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:15:23.661 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.660+0000 7fb0885af800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:23.662 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.661+0000 7fb0885af800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-06-04T16:15:23.663 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.663+0000 7fb0885af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:23.664 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.663+0000 7fb0885af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:15:23.664 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.663+0000 7fb0885af800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:23.665 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.664+0000 7fb0885af800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-06-04T16:15:23.667 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.666+0000 7fb0885af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:23.667 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.666+0000 7fb0885af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:15:23.667 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.666+0000 7fb0885af800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:23.668 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.667+0000 7fb0885af800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-06-04T16:15:23.669 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.669+0000 7fb0885af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:23.670 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.669+0000 7fb0885af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:15:23.670 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.670+0000 7fb0885af800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:23.671 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.670+0000 7fb0885af800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-06-04T16:15:23.672 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.672+0000 7fb0885af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:23.673 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.672+0000 7fb0885af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:15:23.673 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.673+0000 7fb0885af800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:23.674 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.674+0000 7fb0885af800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-06-04T16:15:23.676 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.675+0000 7fb0885af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:23.676 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.676+0000 7fb0885af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:15:23.677 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.676+0000 7fb0885af800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:23.678 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.677+0000 7fb0885af800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-06-04T16:15:23.679 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.678+0000 7fb0885af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:23.679 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.679+0000 7fb0885af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:15:23.680 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.679+0000 7fb0885af800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:23.681 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.680+0000 7fb0885af800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-06-04T16:15:23.682 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.681+0000 7fb0885af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:23.682 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.682+0000 7fb0885af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:15:23.683 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.682+0000 7fb0885af800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:23.683 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.683+0000 7fb0885af800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-06-04T16:15:23.685 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.684+0000 7fb0885af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:23.685 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.685+0000 7fb0885af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:15:23.686 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.685+0000 7fb0885af800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:23.687 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.686+0000 7fb0885af800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-06-04T16:15:23.688 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.687+0000 7fb0885af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:23.688 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.688+0000 7fb0885af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:15:23.689 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.688+0000 7fb0885af800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:23.689 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.689+0000 7fb0885af800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-06-04T16:15:23.690 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.690+0000 7fb0885af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:23.691 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.690+0000 7fb0885af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:15:23.691 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.690+0000 7fb0885af800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:23.692 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.691+0000 7fb0885af800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-06-04T16:15:23.693 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.693+0000 7fb0885af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:23.694 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.693+0000 7fb0885af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:15:23.695 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.693+0000 7fb0885af800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:23.695 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.695+0000 7fb0885af800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-06-04T16:15:23.696 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.696+0000 7fb0885af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:23.697 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.696+0000 7fb0885af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:15:23.697 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.696+0000 7fb0885af800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:23.698 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.697+0000 7fb0885af800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-06-04T16:15:23.699 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.699+0000 7fb0885af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:23.700 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.699+0000 7fb0885af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:15:23.700 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.699+0000 7fb0885af800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:23.701 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.700+0000 7fb0885af800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-06-04T16:15:23.702 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.701+0000 7fb0885af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:23.703 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.702+0000 7fb0885af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:15:23.703 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.702+0000 7fb0885af800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:23.704 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.703+0000 7fb0885af800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-06-04T16:15:23.705 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.704+0000 7fb0885af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:23.706 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.705+0000 7fb0885af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:15:23.706 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.705+0000 7fb0885af800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:23.707 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.706+0000 7fb0885af800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-06-04T16:15:23.708 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.708+0000 7fb0885af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:23.709 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.708+0000 7fb0885af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:15:23.709 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.708+0000 7fb0885af800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:23.710 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.709+0000 7fb0885af800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-06-04T16:15:23.711 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.710+0000 7fb0885af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:23.711 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.711+0000 7fb0885af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:15:23.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.711+0000 7fb0885af800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:23.713 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.712+0000 7fb0885af800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-06-04T16:15:23.714 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.713+0000 7fb0885af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:23.714 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.714+0000 7fb0885af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:15:23.715 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.714+0000 7fb0885af800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:23.716 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.715+0000 7fb0885af800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-06-04T16:15:23.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.716+0000 7fb0885af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:23.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.717+0000 7fb0885af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:15:23.718 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.717+0000 7fb0885af800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:23.719 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.718+0000 7fb0885af800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-06-04T16:15:23.720 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.719+0000 7fb0885af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:23.720 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.720+0000 7fb0885af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:15:23.721 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.720+0000 7fb0885af800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:23.722 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.721+0000 7fb0885af800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-06-04T16:15:23.723 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.723+0000 7fb0885af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:23.724 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.723+0000 7fb0885af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:15:23.724 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.724+0000 7fb0885af800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:23.725 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.725+0000 7fb0885af800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-06-04T16:15:23.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.726+0000 7fb0885af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:23.728 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.727+0000 7fb0885af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:15:23.728 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.728+0000 7fb0885af800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:23.729 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.729+0000 7fb0885af800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-06-04T16:15:23.730 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.730+0000 7fb0885af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:23.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.730+0000 7fb0885af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:15:23.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.730+0000 7fb0885af800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:23.732 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.731+0000 7fb0885af800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-06-04T16:15:23.733 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.733+0000 7fb0885af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:23.734 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.733+0000 7fb0885af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:15:23.734 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.734+0000 7fb0885af800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:23.735 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.734+0000 7fb0885af800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-06-04T16:15:23.736 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.736+0000 7fb0885af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:23.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.736+0000 7fb0885af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:15:23.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.737+0000 7fb0885af800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:23.739 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.738+0000 7fb0885af800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-06-04T16:15:23.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.740+0000 7fb0885af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:23.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.740+0000 7fb0885af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:15:23.741 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.740+0000 7fb0885af800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:23.742 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.741+0000 7fb0885af800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-06-04T16:15:23.743 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.742+0000 7fb0885af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:23.743 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.743+0000 7fb0885af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:15:23.743 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.743+0000 7fb0885af800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:23.744 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.744+0000 7fb0885af800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-06-04T16:15:23.746 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.745+0000 7fb0885af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:23.746 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.746+0000 7fb0885af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:15:23.747 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.746+0000 7fb0885af800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:23.748 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.747+0000 7fb0885af800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-06-04T16:15:23.749 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.748+0000 7fb0885af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:23.749 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.749+0000 7fb0885af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:15:23.749 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.749+0000 7fb0885af800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:23.750 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.750+0000 7fb0885af800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-06-04T16:15:23.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.751+0000 7fb0885af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:23.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.751+0000 7fb0885af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:15:23.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.752+0000 7fb0885af800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:23.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.752+0000 7fb0885af800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-06-04T16:15:23.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.754+0000 7fb0885af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:23.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.754+0000 7fb0885af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:15:23.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.754+0000 7fb0885af800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:23.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.756+0000 7faf3cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-06-04T16:15:23.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.758+0000 7fb0885af800 20 remove_watcher() i=0 2024-06-04T16:15:23.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.758+0000 7fb0885af800 2 removed watcher, disabling cache 2024-06-04T16:15:23.760 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.759+0000 7fb0885af800 20 remove_watcher() i=1 2024-06-04T16:15:23.761 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.760+0000 7fb0885af800 20 remove_watcher() i=2 2024-06-04T16:15:23.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.761+0000 7fb0885af800 20 remove_watcher() i=3 2024-06-04T16:15:23.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.762+0000 7fb0885af800 20 remove_watcher() i=4 2024-06-04T16:15:23.764 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.763+0000 7fb0885af800 20 remove_watcher() i=5 2024-06-04T16:15:23.765 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.764+0000 7fb0885af800 20 remove_watcher() i=6 2024-06-04T16:15:23.766 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.765+0000 7fb0885af800 20 remove_watcher() i=7 2024-06-04T16:15:23.776 DEBUG:teuthology.orchestra.run.smithi144:> radosgw-admin gc process --include-all 2024-06-04T16:15:23.827 INFO:teuthology.orchestra.run.smithi144.stderr:ignoring --setuser ceph since I am not root 2024-06-04T16:15:23.827 INFO:teuthology.orchestra.run.smithi144.stderr:ignoring --setgroup ceph since I am not root 2024-06-04T16:15:23.864 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.863+0000 7f57e2f51800 20 rados->read ofs=0 len=0 2024-06-04T16:15:23.866 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.865+0000 7f57e2f51800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:15:23.866 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.865+0000 7f57e2f51800 20 realm 2024-06-04T16:15:23.866 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.865+0000 7f57e2f51800 20 rados->read ofs=0 len=0 2024-06-04T16:15:23.866 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.865+0000 7f57e2f51800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:15:23.866 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.865+0000 7f57e2f51800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-06-04T16:15:23.866 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.865+0000 7f57e2f51800 20 rados->read ofs=0 len=0 2024-06-04T16:15:23.866 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.865+0000 7f57e2f51800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:15:23.866 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.865+0000 7f57e2f51800 20 rados->read ofs=0 len=0 2024-06-04T16:15:23.867 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.866+0000 7f57e2f51800 20 rados_obj.operate() r=0 bl.length=46 2024-06-04T16:15:23.867 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.866+0000 7f57e2f51800 20 rados->read ofs=0 len=0 2024-06-04T16:15:23.867 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.866+0000 7f57e2f51800 20 rados_obj.operate() r=0 bl.length=1139 2024-06-04T16:15:23.867 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.866+0000 7f57e2f51800 20 searching for the correct realm 2024-06-04T16:15:23.869 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.868+0000 7f57dbfff640 0 -- 172.21.15.144:0/44691517 >> [v2:172.21.15.144:6816/2358575268,v1:172.21.15.144:6817/2358575268] conn(0x556821487670 msgr2=0x556821489a60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-06-04T16:15:23.872 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:23.871+0000 7f57dbfff640 0 -- 172.21.15.144:0/44691517 >> [v2:172.21.15.177:6808/2618477608,v1:172.21.15.177:6809/2618477608] conn(0x7f57cc035030 msgr2=0x7f57cc05a410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-06-04T16:15:24.079 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:24.078+0000 7f57e2f51800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-06-04T16:15:24.079 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:24.078+0000 7f57e2f51800 20 RGWRados::pool_iterate: got zone_info.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767 2024-06-04T16:15:24.079 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:24.078+0000 7f57e2f51800 20 RGWRados::pool_iterate: got default.zone. 2024-06-04T16:15:24.079 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:24.078+0000 7f57e2f51800 20 RGWRados::pool_iterate: got zonegroup_info.abb22408-c332-4e28-8f7a-ff254ea2fed2 2024-06-04T16:15:24.079 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:24.078+0000 7f57e2f51800 20 RGWRados::pool_iterate: got zone_names.default 2024-06-04T16:15:24.079 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:24.078+0000 7f57e2f51800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-06-04T16:15:24.079 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:24.078+0000 7f57e2f51800 20 rados->read ofs=0 len=0 2024-06-04T16:15:24.079 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:24.078+0000 7f57e2f51800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:15:24.079 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:24.078+0000 7f57e2f51800 20 rados->read ofs=0 len=0 2024-06-04T16:15:24.081 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:24.078+0000 7f57e2f51800 20 rados_obj.operate() r=0 bl.length=46 2024-06-04T16:15:24.081 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:24.078+0000 7f57e2f51800 20 rados->read ofs=0 len=0 2024-06-04T16:15:24.081 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:24.079+0000 7f57e2f51800 20 rados_obj.operate() r=0 bl.length=470 2024-06-04T16:15:24.081 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:24.079+0000 7f57e2f51800 20 zone default found 2024-06-04T16:15:24.081 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:24.079+0000 7f57e2f51800 4 Realm: () 2024-06-04T16:15:24.081 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:24.079+0000 7f57e2f51800 4 ZoneGroup: default (abb22408-c332-4e28-8f7a-ff254ea2fed2) 2024-06-04T16:15:24.081 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:24.079+0000 7f57e2f51800 4 Zone: default (be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767) 2024-06-04T16:15:24.081 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:24.079+0000 7f57e2f51800 10 cannot find current period zonegroup using local zonegroup configuration 2024-06-04T16:15:24.081 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:24.079+0000 7f57e2f51800 20 zonegroup default 2024-06-04T16:15:24.081 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:24.079+0000 7f57e2f51800 20 rados->read ofs=0 len=0 2024-06-04T16:15:24.081 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:24.079+0000 7f57e2f51800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:15:24.081 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:24.079+0000 7f57e2f51800 20 rados->read ofs=0 len=0 2024-06-04T16:15:24.081 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:24.080+0000 7f57e2f51800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:15:24.081 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:24.080+0000 7f57e2f51800 20 rados->read ofs=0 len=0 2024-06-04T16:15:24.082 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:24.080+0000 7f57e2f51800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:15:24.082 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:24.080+0000 7f57e2f51800 20 started sync module instance, tier type = 2024-06-04T16:15:24.082 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:24.080+0000 7f57e2f51800 20 started zone id=be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767 (name=default) with tier type = 2024-06-04T16:15:24.089 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:24.089+0000 7f57e2f51800 20 add_watcher() i=0 2024-06-04T16:15:24.089 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:24.089+0000 7f57e2f51800 20 add_watcher() i=1 2024-06-04T16:15:24.089 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:24.089+0000 7f57e2f51800 20 add_watcher() i=2 2024-06-04T16:15:24.089 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:24.089+0000 7f57e2f51800 20 add_watcher() i=3 2024-06-04T16:15:24.090 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:24.089+0000 7f57e2f51800 20 add_watcher() i=4 2024-06-04T16:15:24.090 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:24.089+0000 7f57e2f51800 20 add_watcher() i=5 2024-06-04T16:15:24.090 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:24.089+0000 7f57e2f51800 20 add_watcher() i=6 2024-06-04T16:15:24.090 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:24.089+0000 7f57e2f51800 20 add_watcher() i=7 2024-06-04T16:15:24.090 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:24.089+0000 7f57e2f51800 2 all 8 watchers are set, enabling cache 2024-06-04T16:15:24.092 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:24.091+0000 7f5696fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-06-04T16:15:24.092 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:24.092+0000 7f57e2f51800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-06-04T16:15:24.093 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:24.092+0000 7f57e2f51800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-06-04T16:15:24.126 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:24.125+0000 7f5695fe3640 20 reqs_thread_entry: start 2024-06-04T16:15:24.126 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:24.125+0000 7f57e2f51800 20 init_complete bucket index max shards: 11 2024-06-04T16:15:24.127 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:24.125+0000 7f57e2f51800 20 Filter name: none 2024-06-04T16:15:24.127 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:24.125+0000 7f56077fe640 20 reqs_thread_entry: start 2024-06-04T16:15:24.127 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:24.125+0000 7f57e2f51800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-06-04T16:15:24.127 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:24.126+0000 7f57e2f51800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:24.128 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:24.127+0000 7f57e2f51800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:15:24.128 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:24.127+0000 7f57e2f51800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:24.128 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:24.128+0000 7f57e2f51800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-06-04T16:15:24.130 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:24.129+0000 7f57e2f51800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:24.130 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:24.130+0000 7f57e2f51800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:15:24.130 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:24.130+0000 7f57e2f51800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:24.131 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:24.131+0000 7f57e2f51800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-06-04T16:15:24.132 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:24.132+0000 7f57e2f51800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:24.133 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:24.132+0000 7f57e2f51800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:15:24.133 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:24.132+0000 7f57e2f51800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:24.134 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:24.133+0000 7f57e2f51800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-06-04T16:15:24.135 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:24.135+0000 7f57e2f51800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:24.136 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:24.135+0000 7f57e2f51800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:15:24.136 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:24.135+0000 7f57e2f51800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:24.137 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:24.136+0000 7f57e2f51800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-06-04T16:15:24.138 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:24.137+0000 7f57e2f51800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:24.139 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:24.138+0000 7f57e2f51800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:15:24.139 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:24.138+0000 7f57e2f51800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:24.140 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:24.139+0000 7f57e2f51800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-06-04T16:15:24.141 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:24.140+0000 7f57e2f51800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:24.141 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:24.140+0000 7f57e2f51800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:15:24.141 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:24.141+0000 7f57e2f51800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:24.143 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:24.142+0000 7f57e2f51800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-06-04T16:15:24.144 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:24.143+0000 7f57e2f51800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:24.144 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:24.144+0000 7f57e2f51800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:15:24.145 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:24.144+0000 7f57e2f51800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:24.145 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:24.145+0000 7f57e2f51800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-06-04T16:15:24.147 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:24.146+0000 7f57e2f51800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:24.147 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:24.146+0000 7f57e2f51800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:15:24.147 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:24.147+0000 7f57e2f51800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:24.148 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:24.148+0000 7f57e2f51800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-06-04T16:15:24.150 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:24.149+0000 7f57e2f51800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:24.150 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:24.149+0000 7f57e2f51800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:15:24.150 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:24.149+0000 7f57e2f51800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:24.151 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:24.151+0000 7f57e2f51800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-06-04T16:15:24.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:24.152+0000 7f57e2f51800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:24.153 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:24.152+0000 7f57e2f51800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:15:24.153 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:24.152+0000 7f57e2f51800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:24.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:24.153+0000 7f57e2f51800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-06-04T16:15:24.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:24.155+0000 7f57e2f51800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:24.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:24.155+0000 7f57e2f51800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:15:24.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:24.155+0000 7f57e2f51800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:24.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:24.156+0000 7f57e2f51800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-06-04T16:15:24.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:24.158+0000 7f57e2f51800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:24.159 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:24.158+0000 7f57e2f51800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:15:24.159 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:24.158+0000 7f57e2f51800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:24.160 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:24.160+0000 7f57e2f51800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-06-04T16:15:24.162 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:24.161+0000 7f57e2f51800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:24.162 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:24.161+0000 7f57e2f51800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:15:24.162 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:24.162+0000 7f57e2f51800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:24.163 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:24.162+0000 7f57e2f51800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-06-04T16:15:24.164 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:24.164+0000 7f57e2f51800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:24.165 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:24.164+0000 7f57e2f51800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:15:24.165 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:24.164+0000 7f57e2f51800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:24.166 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:24.165+0000 7f57e2f51800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-06-04T16:15:24.168 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:24.167+0000 7f57e2f51800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:24.169 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:24.168+0000 7f57e2f51800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:15:24.169 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:24.168+0000 7f57e2f51800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:24.170 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:24.169+0000 7f57e2f51800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-06-04T16:15:24.171 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:24.171+0000 7f57e2f51800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:24.172 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:24.171+0000 7f57e2f51800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:15:24.172 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:24.171+0000 7f57e2f51800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:24.173 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:24.172+0000 7f57e2f51800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-06-04T16:15:24.174 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:24.173+0000 7f57e2f51800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:24.175 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:24.174+0000 7f57e2f51800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:15:24.175 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:24.174+0000 7f57e2f51800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:24.176 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:24.175+0000 7f57e2f51800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-06-04T16:15:24.177 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:24.176+0000 7f57e2f51800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:24.177 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:24.177+0000 7f57e2f51800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:15:24.178 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:24.177+0000 7f57e2f51800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:24.178 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:24.178+0000 7f57e2f51800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-06-04T16:15:24.180 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:24.179+0000 7f57e2f51800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:24.180 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:24.180+0000 7f57e2f51800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:15:24.181 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:24.180+0000 7f57e2f51800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:24.181 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:24.181+0000 7f57e2f51800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-06-04T16:15:24.183 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:24.182+0000 7f57e2f51800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:24.183 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:24.182+0000 7f57e2f51800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:15:24.183 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:24.183+0000 7f57e2f51800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:24.184 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:24.183+0000 7f57e2f51800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-06-04T16:15:24.185 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:24.185+0000 7f57e2f51800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:24.186 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:24.185+0000 7f57e2f51800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:15:24.186 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:24.185+0000 7f57e2f51800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:24.187 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:24.186+0000 7f57e2f51800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-06-04T16:15:24.188 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:24.187+0000 7f57e2f51800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:24.188 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:24.188+0000 7f57e2f51800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:15:24.189 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:24.188+0000 7f57e2f51800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:24.189 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:24.189+0000 7f57e2f51800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-06-04T16:15:24.191 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:24.190+0000 7f57e2f51800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:24.191 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:24.191+0000 7f57e2f51800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:15:24.192 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:24.191+0000 7f57e2f51800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:24.192 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:24.192+0000 7f57e2f51800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-06-04T16:15:24.193 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:24.193+0000 7f57e2f51800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:24.194 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:24.193+0000 7f57e2f51800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:15:24.194 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:24.193+0000 7f57e2f51800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:24.195 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:24.194+0000 7f57e2f51800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-06-04T16:15:24.196 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:24.195+0000 7f57e2f51800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:24.197 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:24.196+0000 7f57e2f51800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:15:24.197 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:24.196+0000 7f57e2f51800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:24.198 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:24.197+0000 7f57e2f51800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-06-04T16:15:24.199 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:24.198+0000 7f57e2f51800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:24.201 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:24.199+0000 7f57e2f51800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:15:24.201 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:24.199+0000 7f57e2f51800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:24.201 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:24.201+0000 7f57e2f51800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-06-04T16:15:24.202 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:24.202+0000 7f57e2f51800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:24.203 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:24.202+0000 7f57e2f51800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:15:24.203 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:24.203+0000 7f57e2f51800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:24.204 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:24.204+0000 7f57e2f51800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-06-04T16:15:24.205 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:24.205+0000 7f57e2f51800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:24.206 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:24.205+0000 7f57e2f51800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:15:24.206 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:24.205+0000 7f57e2f51800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:24.207 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:24.206+0000 7f57e2f51800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-06-04T16:15:24.208 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:24.208+0000 7f57e2f51800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:24.209 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:24.208+0000 7f57e2f51800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:15:24.209 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:24.209+0000 7f57e2f51800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:24.210 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:24.210+0000 7f57e2f51800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-06-04T16:15:24.213 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:24.212+0000 7f57e2f51800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:24.213 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:24.212+0000 7f57e2f51800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:15:24.213 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:24.213+0000 7f57e2f51800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:24.215 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:24.214+0000 7f57e2f51800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-06-04T16:15:24.216 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:24.215+0000 7f57e2f51800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:24.216 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:24.216+0000 7f57e2f51800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:15:24.217 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:24.216+0000 7f57e2f51800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:24.218 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:24.217+0000 7f57e2f51800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-06-04T16:15:24.219 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:24.218+0000 7f57e2f51800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:24.219 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:24.219+0000 7f57e2f51800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:15:24.220 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:24.219+0000 7f57e2f51800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:24.221 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:24.221+0000 7f5696fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-06-04T16:15:24.223 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:24.223+0000 7f57e2f51800 20 remove_watcher() i=0 2024-06-04T16:15:24.223 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:24.223+0000 7f57e2f51800 2 removed watcher, disabling cache 2024-06-04T16:15:24.224 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:24.224+0000 7f57e2f51800 20 remove_watcher() i=1 2024-06-04T16:15:24.225 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:24.225+0000 7f57e2f51800 20 remove_watcher() i=2 2024-06-04T16:15:24.226 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:24.226+0000 7f57e2f51800 20 remove_watcher() i=3 2024-06-04T16:15:24.227 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:24.227+0000 7f57e2f51800 20 remove_watcher() i=4 2024-06-04T16:15:24.228 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:24.228+0000 7f57e2f51800 20 remove_watcher() i=5 2024-06-04T16:15:24.229 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:24.229+0000 7f57e2f51800 20 remove_watcher() i=6 2024-06-04T16:15:24.230 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:24.229+0000 7f57e2f51800 20 remove_watcher() i=7 2024-06-04T16:15:24.241 DEBUG:teuthology.orchestra.run.smithi144:> cd /home/ubuntu/cephtest/s3-tests-java && /opt/gradle/gradle/bin/gradle clean test --rerun-tasks --no-build-cache --tests BucketTest 2024-06-04T16:15:24.727 INFO:teuthology.orchestra.run.smithi144.stdout:> Task :clean 2024-06-04T16:15:25.622 INFO:teuthology.orchestra.run.smithi144.stdout:> Task :compileJava 2024-06-04T16:15:25.622 INFO:teuthology.orchestra.run.smithi144.stdout:> Task :processResources 2024-06-04T16:15:25.622 INFO:teuthology.orchestra.run.smithi144.stdout:> Task :classes 2024-06-04T16:15:26.222 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:15:26.222 INFO:teuthology.orchestra.run.smithi144.stdout:> Task :compileTestJava 2024-06-04T16:15:26.223 INFO:teuthology.orchestra.run.smithi144.stderr:Note: /home/ubuntu/cephtest/s3-tests-java/src/test/java/BucketTest.java uses or overrides a deprecated API. 2024-06-04T16:15:26.223 INFO:teuthology.orchestra.run.smithi144.stderr:Note: Recompile with -Xlint:deprecation for details. 2024-06-04T16:15:26.224 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:15:26.224 INFO:teuthology.orchestra.run.smithi144.stdout:> Task :processTestResources NO-SOURCE 2024-06-04T16:15:26.224 INFO:teuthology.orchestra.run.smithi144.stdout:> Task :testClasses 2024-06-04T16:15:28.224 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:15:28.224 INFO:teuthology.orchestra.run.smithi144.stdout:> Task :test 2024-06-04T16:15:28.225 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:15:28.225 INFO:teuthology.orchestra.run.smithi144.stdout:suite > Bucket tests STANDARD_OUT 2024-06-04T16:15:28.225 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04 16:15:27,480 [Test worker] WARN com.amazonaws.util.Base64 - JAXB is unavailable. Will fallback to SDK implementation which may be less performant 2024-06-04T16:15:28.225 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:15:28.225 INFO:teuthology.orchestra.run.smithi144.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectEmpty STARTED 2024-06-04T16:15:28.225 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:15:28.225 INFO:teuthology.orchestra.run.smithi144.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectEmpty PASSED 2024-06-04T16:15:28.225 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:15:28.225 INFO:teuthology.orchestra.run.smithi144.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectMismatch STARTED 2024-06-04T16:15:28.225 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:15:28.225 INFO:teuthology.orchestra.run.smithi144.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectMismatch PASSED 2024-06-04T16:15:28.225 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:15:28.225 INFO:teuthology.orchestra.run.smithi144.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectUnreadable STARTED 2024-06-04T16:15:28.226 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:15:28.226 INFO:teuthology.orchestra.run.smithi144.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectUnreadable PASSED 2024-06-04T16:15:28.422 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:15:28.422 INFO:teuthology.orchestra.run.smithi144.stdout:suite > Bucket tests > BucketTest.testBucketCreateReadDelete STARTED 2024-06-04T16:15:28.522 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:15:28.522 INFO:teuthology.orchestra.run.smithi144.stdout:suite > Bucket tests > BucketTest.testBucketCreateReadDelete PASSED 2024-06-04T16:15:28.623 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:15:28.623 INFO:teuthology.orchestra.run.smithi144.stdout:suite > Bucket tests > BucketTest.testBucketDeleteNonEmpty STARTED 2024-06-04T16:15:28.623 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:15:28.623 INFO:teuthology.orchestra.run.smithi144.stdout:suite > Bucket tests > BucketTest.testBucketDeleteNonEmpty PASSED 2024-06-04T16:15:28.822 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:15:28.822 INFO:teuthology.orchestra.run.smithi144.stdout:suite > Bucket tests > BucketTest.testBucketDeleteNotExist STARTED 2024-06-04T16:15:28.922 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:15:28.922 INFO:teuthology.orchestra.run.smithi144.stdout:suite > Bucket tests > BucketTest.testBucketDeleteNotExist PASSED 2024-06-04T16:15:29.022 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:15:29.022 INFO:teuthology.orchestra.run.smithi144.stdout:suite > Bucket tests > BucketTest.testBucketListDistinct STARTED 2024-06-04T16:15:29.022 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:15:29.022 INFO:teuthology.orchestra.run.smithi144.stdout:suite > Bucket tests > BucketTest.testBucketListDistinct PASSED 2024-06-04T16:15:29.422 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:15:29.423 INFO:teuthology.orchestra.run.smithi144.stdout:suite > Bucket tests > BucketTest.testBucketListEmpty STARTED 2024-06-04T16:15:29.423 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:15:29.423 INFO:teuthology.orchestra.run.smithi144.stdout:suite > Bucket tests > BucketTest.testBucketListEmpty PASSED 2024-06-04T16:15:29.622 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:15:29.622 INFO:teuthology.orchestra.run.smithi144.stdout:suite > Bucket tests > BucketTest.testBucketNotExist STARTED 2024-06-04T16:15:29.722 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:15:29.722 INFO:teuthology.orchestra.run.smithi144.stdout:suite > Bucket tests > BucketTest.testBucketNotExist PASSED 2024-06-04T16:15:29.802 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:15:29.802 INFO:teuthology.orchestra.run.smithi144.stdout:-------------------------------------------------------------------- 2024-06-04T16:15:29.802 INFO:teuthology.orchestra.run.smithi144.stdout:| Results: SUCCESS (9 tests, 9 successes, 0 failures, 0 skipped) | 2024-06-04T16:15:29.802 INFO:teuthology.orchestra.run.smithi144.stdout:-------------------------------------------------------------------- 2024-06-04T16:15:29.802 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:15:29.802 INFO:teuthology.orchestra.run.smithi144.stdout:Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. 2024-06-04T16:15:29.802 INFO:teuthology.orchestra.run.smithi144.stdout:Use '--warning-mode all' to show the individual deprecation warnings. 2024-06-04T16:15:29.802 INFO:teuthology.orchestra.run.smithi144.stdout:See https://docs.gradle.org/6.0.1/userguide/command_line_interface.html#sec:command_line_warnings 2024-06-04T16:15:29.802 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:15:29.802 INFO:teuthology.orchestra.run.smithi144.stdout:BUILD SUCCESSFUL in 5s 2024-06-04T16:15:29.802 INFO:teuthology.orchestra.run.smithi144.stdout:5 actionable tasks: 5 executed 2024-06-04T16:15:29.805 DEBUG:teuthology.orchestra.run.smithi144:> radosgw-admin gc process --include-all 2024-06-04T16:15:29.857 INFO:teuthology.orchestra.run.smithi144.stderr:ignoring --setuser ceph since I am not root 2024-06-04T16:15:29.857 INFO:teuthology.orchestra.run.smithi144.stderr:ignoring --setgroup ceph since I am not root 2024-06-04T16:15:29.895 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:29.894+0000 7f671ec3d800 20 rados->read ofs=0 len=0 2024-06-04T16:15:29.897 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:29.896+0000 7f671ec3d800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:15:29.897 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:29.896+0000 7f671ec3d800 20 realm 2024-06-04T16:15:29.897 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:29.896+0000 7f671ec3d800 20 rados->read ofs=0 len=0 2024-06-04T16:15:29.897 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:29.896+0000 7f671ec3d800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:15:29.897 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:29.896+0000 7f671ec3d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-06-04T16:15:29.897 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:29.896+0000 7f671ec3d800 20 rados->read ofs=0 len=0 2024-06-04T16:15:29.897 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:29.896+0000 7f671ec3d800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:15:29.897 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:29.896+0000 7f671ec3d800 20 rados->read ofs=0 len=0 2024-06-04T16:15:29.898 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:29.897+0000 7f671ec3d800 20 rados_obj.operate() r=0 bl.length=46 2024-06-04T16:15:29.898 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:29.897+0000 7f671ec3d800 20 rados->read ofs=0 len=0 2024-06-04T16:15:29.898 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:29.897+0000 7f671ec3d800 20 rados_obj.operate() r=0 bl.length=1139 2024-06-04T16:15:29.898 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:29.897+0000 7f671ec3d800 20 searching for the correct realm 2024-06-04T16:15:29.899 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:29.898+0000 7f671c732640 0 -- 172.21.15.144:0/3401548854 >> [v2:172.21.15.177:6816/2039473917,v1:172.21.15.177:6817/2039473917] conn(0x559676626630 msgr2=0x559676628af0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-06-04T16:15:30.103 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.102+0000 7f671c732640 0 -- 172.21.15.144:0/3401548854 >> [v2:172.21.15.177:6800/3891611393,v1:172.21.15.177:6801/3891611393] conn(0x7f670c06a040 msgr2=0x7f670c009250 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-06-04T16:15:30.312 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.311+0000 7f671ec3d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-06-04T16:15:30.312 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.311+0000 7f671ec3d800 20 RGWRados::pool_iterate: got zone_info.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767 2024-06-04T16:15:30.313 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.311+0000 7f671ec3d800 20 RGWRados::pool_iterate: got default.zone. 2024-06-04T16:15:30.313 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.311+0000 7f671ec3d800 20 RGWRados::pool_iterate: got zonegroup_info.abb22408-c332-4e28-8f7a-ff254ea2fed2 2024-06-04T16:15:30.313 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.311+0000 7f671ec3d800 20 RGWRados::pool_iterate: got zone_names.default 2024-06-04T16:15:30.313 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.311+0000 7f671ec3d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-06-04T16:15:30.313 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.311+0000 7f671ec3d800 20 rados->read ofs=0 len=0 2024-06-04T16:15:30.313 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.312+0000 7f671ec3d800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:15:30.313 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.312+0000 7f671ec3d800 20 rados->read ofs=0 len=0 2024-06-04T16:15:30.314 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.312+0000 7f671ec3d800 20 rados_obj.operate() r=0 bl.length=46 2024-06-04T16:15:30.314 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.312+0000 7f671ec3d800 20 rados->read ofs=0 len=0 2024-06-04T16:15:30.314 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.312+0000 7f671ec3d800 20 rados_obj.operate() r=0 bl.length=470 2024-06-04T16:15:30.314 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.312+0000 7f671ec3d800 20 zone default found 2024-06-04T16:15:30.314 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.312+0000 7f671ec3d800 4 Realm: () 2024-06-04T16:15:30.314 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.312+0000 7f671ec3d800 4 ZoneGroup: default (abb22408-c332-4e28-8f7a-ff254ea2fed2) 2024-06-04T16:15:30.314 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.312+0000 7f671ec3d800 4 Zone: default (be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767) 2024-06-04T16:15:30.315 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.312+0000 7f671ec3d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-06-04T16:15:30.315 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.312+0000 7f671ec3d800 20 zonegroup default 2024-06-04T16:15:30.315 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.312+0000 7f671ec3d800 20 rados->read ofs=0 len=0 2024-06-04T16:15:30.315 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.313+0000 7f671ec3d800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:15:30.315 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.313+0000 7f671ec3d800 20 rados->read ofs=0 len=0 2024-06-04T16:15:30.315 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.313+0000 7f671ec3d800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:15:30.315 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.313+0000 7f671ec3d800 20 rados->read ofs=0 len=0 2024-06-04T16:15:30.315 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.313+0000 7f671ec3d800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:15:30.315 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.313+0000 7f671ec3d800 20 started sync module instance, tier type = 2024-06-04T16:15:30.315 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.313+0000 7f671ec3d800 20 started zone id=be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767 (name=default) with tier type = 2024-06-04T16:15:30.324 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.323+0000 7f671ec3d800 20 add_watcher() i=0 2024-06-04T16:15:30.324 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.323+0000 7f671ec3d800 20 add_watcher() i=1 2024-06-04T16:15:30.324 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.323+0000 7f671ec3d800 20 add_watcher() i=2 2024-06-04T16:15:30.325 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.323+0000 7f671ec3d800 20 add_watcher() i=3 2024-06-04T16:15:30.325 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.323+0000 7f671ec3d800 20 add_watcher() i=4 2024-06-04T16:15:30.325 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.323+0000 7f671ec3d800 20 add_watcher() i=5 2024-06-04T16:15:30.325 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.323+0000 7f671ec3d800 20 add_watcher() i=6 2024-06-04T16:15:30.325 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.324+0000 7f671ec3d800 20 add_watcher() i=7 2024-06-04T16:15:30.325 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.324+0000 7f671ec3d800 2 all 8 watchers are set, enabling cache 2024-06-04T16:15:30.327 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.326+0000 7f65d2fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-06-04T16:15:30.327 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.326+0000 7f671ec3d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-06-04T16:15:30.327 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.326+0000 7f671ec3d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-06-04T16:15:30.408 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.407+0000 7f65d1fdb640 20 reqs_thread_entry: start 2024-06-04T16:15:30.409 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.407+0000 7f671ec3d800 20 init_complete bucket index max shards: 11 2024-06-04T16:15:30.409 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.407+0000 7f671ec3d800 20 Filter name: none 2024-06-04T16:15:30.409 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.407+0000 7f65437fe640 20 reqs_thread_entry: start 2024-06-04T16:15:30.409 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.407+0000 7f671ec3d800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-06-04T16:15:30.409 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.409+0000 7f671ec3d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:30.410 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.409+0000 7f671ec3d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:15:30.410 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.409+0000 7f671ec3d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:30.411 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.410+0000 7f671ec3d800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-06-04T16:15:30.413 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.412+0000 7f671ec3d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:30.414 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.413+0000 7f671ec3d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:15:30.414 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.413+0000 7f671ec3d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:30.415 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.415+0000 7f671ec3d800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-06-04T16:15:30.417 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.416+0000 7f671ec3d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:30.417 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.416+0000 7f671ec3d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:15:30.417 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.417+0000 7f671ec3d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:30.419 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.418+0000 7f671ec3d800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-06-04T16:15:30.420 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.419+0000 7f671ec3d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:30.420 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.420+0000 7f671ec3d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:15:30.421 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.420+0000 7f671ec3d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:30.422 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.421+0000 7f671ec3d800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-06-04T16:15:30.424 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.423+0000 7f671ec3d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:30.424 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.423+0000 7f671ec3d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:15:30.424 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.424+0000 7f671ec3d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:30.426 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.425+0000 7f671ec3d800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-06-04T16:15:30.427 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.426+0000 7f671ec3d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:30.427 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.427+0000 7f671ec3d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:15:30.427 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.427+0000 7f671ec3d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:30.428 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.428+0000 7f671ec3d800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-06-04T16:15:30.430 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.429+0000 7f671ec3d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:30.430 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.429+0000 7f671ec3d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:15:30.430 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.430+0000 7f671ec3d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:30.432 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.431+0000 7f671ec3d800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-06-04T16:15:30.434 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.433+0000 7f671ec3d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:30.434 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.433+0000 7f671ec3d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:15:30.434 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.434+0000 7f671ec3d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:30.436 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.435+0000 7f671ec3d800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-06-04T16:15:30.437 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.436+0000 7f671ec3d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:30.437 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.437+0000 7f671ec3d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:15:30.438 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.437+0000 7f671ec3d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:30.438 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.438+0000 7f671ec3d800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-06-04T16:15:30.440 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.440+0000 7f671ec3d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:30.441 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.440+0000 7f671ec3d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:15:30.441 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.440+0000 7f671ec3d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:30.442 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.441+0000 7f671ec3d800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-06-04T16:15:30.443 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.443+0000 7f671ec3d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:30.444 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.443+0000 7f671ec3d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:15:30.444 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.443+0000 7f671ec3d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:30.445 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.444+0000 7f671ec3d800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-06-04T16:15:30.446 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.445+0000 7f671ec3d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:30.447 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.446+0000 7f671ec3d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:15:30.447 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.446+0000 7f671ec3d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:30.448 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.447+0000 7f671ec3d800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-06-04T16:15:30.449 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.448+0000 7f671ec3d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:30.449 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.449+0000 7f671ec3d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:15:30.450 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.449+0000 7f671ec3d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:30.451 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.450+0000 7f671ec3d800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-06-04T16:15:30.453 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.452+0000 7f671ec3d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:30.453 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.453+0000 7f671ec3d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:15:30.454 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.453+0000 7f671ec3d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:30.455 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.454+0000 7f671ec3d800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-06-04T16:15:30.456 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.455+0000 7f671ec3d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:30.456 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.456+0000 7f671ec3d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:15:30.457 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.456+0000 7f671ec3d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:30.458 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.457+0000 7f671ec3d800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-06-04T16:15:30.459 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.458+0000 7f671ec3d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:30.460 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.459+0000 7f671ec3d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:15:30.460 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.459+0000 7f671ec3d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:30.461 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.460+0000 7f671ec3d800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-06-04T16:15:30.462 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.461+0000 7f671ec3d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:30.463 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.462+0000 7f671ec3d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:15:30.463 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.462+0000 7f671ec3d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:30.464 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.463+0000 7f671ec3d800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-06-04T16:15:30.465 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.464+0000 7f671ec3d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:30.466 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.465+0000 7f671ec3d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:15:30.466 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.465+0000 7f671ec3d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:30.467 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.466+0000 7f671ec3d800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-06-04T16:15:30.468 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.467+0000 7f671ec3d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:30.468 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.468+0000 7f671ec3d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:15:30.469 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.468+0000 7f671ec3d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:30.470 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.469+0000 7f671ec3d800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-06-04T16:15:30.471 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.470+0000 7f671ec3d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:30.472 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.471+0000 7f671ec3d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:15:30.472 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.471+0000 7f671ec3d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:30.473 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.472+0000 7f671ec3d800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-06-04T16:15:30.474 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.473+0000 7f671ec3d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:30.474 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.474+0000 7f671ec3d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:15:30.475 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.474+0000 7f671ec3d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:30.475 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.475+0000 7f671ec3d800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-06-04T16:15:30.477 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.476+0000 7f671ec3d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:30.477 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.477+0000 7f671ec3d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:15:30.478 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.477+0000 7f671ec3d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:30.479 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.478+0000 7f671ec3d800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-06-04T16:15:30.481 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.479+0000 7f671ec3d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:30.481 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.481+0000 7f671ec3d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:15:30.482 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.481+0000 7f671ec3d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:30.483 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.482+0000 7f671ec3d800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-06-04T16:15:30.484 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.483+0000 7f671ec3d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:30.484 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.484+0000 7f671ec3d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:15:30.484 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.484+0000 7f671ec3d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:30.485 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.485+0000 7f671ec3d800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-06-04T16:15:30.487 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.486+0000 7f671ec3d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:30.488 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.487+0000 7f671ec3d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:15:30.488 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.487+0000 7f671ec3d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:30.489 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.488+0000 7f671ec3d800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-06-04T16:15:30.490 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.490+0000 7f671ec3d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:30.491 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.490+0000 7f671ec3d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:15:30.491 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.490+0000 7f671ec3d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:30.492 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.491+0000 7f671ec3d800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-06-04T16:15:30.494 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.493+0000 7f671ec3d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:30.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.534+0000 7f671ec3d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:15:30.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.535+0000 7f671ec3d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:30.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.536+0000 7f671ec3d800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-06-04T16:15:30.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.538+0000 7f671ec3d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:30.539 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.538+0000 7f671ec3d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:15:30.539 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.538+0000 7f671ec3d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:30.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.540+0000 7f671ec3d800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-06-04T16:15:30.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.541+0000 7f671ec3d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:30.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.541+0000 7f671ec3d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:15:30.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.541+0000 7f671ec3d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:30.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.542+0000 7f671ec3d800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-06-04T16:15:30.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.544+0000 7f671ec3d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:30.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.545+0000 7f671ec3d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:15:30.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.545+0000 7f671ec3d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:30.547 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.547+0000 7f671ec3d800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-06-04T16:15:30.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.548+0000 7f671ec3d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:30.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.549+0000 7f671ec3d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:15:30.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.549+0000 7f671ec3d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:30.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.550+0000 7f671ec3d800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-06-04T16:15:30.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.552+0000 7f671ec3d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:30.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.552+0000 7f671ec3d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:15:30.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.552+0000 7f671ec3d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:30.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.554+0000 7f65d2fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-06-04T16:15:30.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.556+0000 7f671ec3d800 20 remove_watcher() i=0 2024-06-04T16:15:30.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.556+0000 7f671ec3d800 2 removed watcher, disabling cache 2024-06-04T16:15:30.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.557+0000 7f671ec3d800 20 remove_watcher() i=1 2024-06-04T16:15:30.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.558+0000 7f671ec3d800 20 remove_watcher() i=2 2024-06-04T16:15:30.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.559+0000 7f671ec3d800 20 remove_watcher() i=3 2024-06-04T16:15:30.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.560+0000 7f671ec3d800 20 remove_watcher() i=4 2024-06-04T16:15:30.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.561+0000 7f671ec3d800 20 remove_watcher() i=5 2024-06-04T16:15:30.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.562+0000 7f671ec3d800 20 remove_watcher() i=6 2024-06-04T16:15:30.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.563+0000 7f671ec3d800 20 remove_watcher() i=7 2024-06-04T16:15:30.575 DEBUG:teuthology.orchestra.run.smithi144:> radosgw-admin gc process --include-all 2024-06-04T16:15:30.626 INFO:teuthology.orchestra.run.smithi144.stderr:ignoring --setuser ceph since I am not root 2024-06-04T16:15:30.627 INFO:teuthology.orchestra.run.smithi144.stderr:ignoring --setgroup ceph since I am not root 2024-06-04T16:15:30.663 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.663+0000 7f97e4e0f800 20 rados->read ofs=0 len=0 2024-06-04T16:15:30.666 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.664+0000 7f97e4e0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:15:30.666 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.664+0000 7f97e4e0f800 20 realm 2024-06-04T16:15:30.666 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.664+0000 7f97e4e0f800 20 rados->read ofs=0 len=0 2024-06-04T16:15:30.666 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.664+0000 7f97e4e0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:15:30.666 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.664+0000 7f97e4e0f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-06-04T16:15:30.666 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.664+0000 7f97e4e0f800 20 rados->read ofs=0 len=0 2024-06-04T16:15:30.666 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.665+0000 7f97e4e0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:15:30.666 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.665+0000 7f97e4e0f800 20 rados->read ofs=0 len=0 2024-06-04T16:15:30.667 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.665+0000 7f97e4e0f800 20 rados_obj.operate() r=0 bl.length=46 2024-06-04T16:15:30.667 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.665+0000 7f97e4e0f800 20 rados->read ofs=0 len=0 2024-06-04T16:15:30.667 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.666+0000 7f97e4e0f800 20 rados_obj.operate() r=0 bl.length=1139 2024-06-04T16:15:30.667 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.666+0000 7f97e4e0f800 20 searching for the correct realm 2024-06-04T16:15:30.668 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.667+0000 7f97d7d3c640 0 -- 172.21.15.144:0/514083961 >> [v2:172.21.15.144:6808/86532035,v1:172.21.15.144:6809/86532035] conn(0x7f97d00824b0 msgr2=0x7f97d005e4d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-06-04T16:15:30.671 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.671+0000 7f97d7d3c640 0 -- 172.21.15.144:0/514083961 >> [v2:172.21.15.144:6816/2358575268,v1:172.21.15.144:6817/2358575268] conn(0x5626ff640cd0 msgr2=0x5626ff643100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-06-04T16:15:30.677 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.676+0000 7f97e4e0f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-06-04T16:15:30.677 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.676+0000 7f97e4e0f800 20 RGWRados::pool_iterate: got zone_info.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767 2024-06-04T16:15:30.677 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.676+0000 7f97e4e0f800 20 RGWRados::pool_iterate: got default.zone. 2024-06-04T16:15:30.678 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.676+0000 7f97e4e0f800 20 RGWRados::pool_iterate: got zonegroup_info.abb22408-c332-4e28-8f7a-ff254ea2fed2 2024-06-04T16:15:30.678 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.676+0000 7f97e4e0f800 20 RGWRados::pool_iterate: got zone_names.default 2024-06-04T16:15:30.678 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.676+0000 7f97e4e0f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-06-04T16:15:30.678 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.676+0000 7f97e4e0f800 20 rados->read ofs=0 len=0 2024-06-04T16:15:30.678 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.676+0000 7f97e4e0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:15:30.678 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.676+0000 7f97e4e0f800 20 rados->read ofs=0 len=0 2024-06-04T16:15:30.678 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.677+0000 7f97e4e0f800 20 rados_obj.operate() r=0 bl.length=46 2024-06-04T16:15:30.678 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.677+0000 7f97e4e0f800 20 rados->read ofs=0 len=0 2024-06-04T16:15:30.679 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.677+0000 7f97e4e0f800 20 rados_obj.operate() r=0 bl.length=470 2024-06-04T16:15:30.679 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.677+0000 7f97e4e0f800 20 zone default found 2024-06-04T16:15:30.679 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.677+0000 7f97e4e0f800 4 Realm: () 2024-06-04T16:15:30.679 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.677+0000 7f97e4e0f800 4 ZoneGroup: default (abb22408-c332-4e28-8f7a-ff254ea2fed2) 2024-06-04T16:15:30.679 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.677+0000 7f97e4e0f800 4 Zone: default (be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767) 2024-06-04T16:15:30.679 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.677+0000 7f97e4e0f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-06-04T16:15:30.680 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.677+0000 7f97e4e0f800 20 zonegroup default 2024-06-04T16:15:30.680 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.677+0000 7f97e4e0f800 20 rados->read ofs=0 len=0 2024-06-04T16:15:30.680 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.677+0000 7f97e4e0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:15:30.680 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.677+0000 7f97e4e0f800 20 rados->read ofs=0 len=0 2024-06-04T16:15:30.680 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.678+0000 7f97e4e0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:15:30.680 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.678+0000 7f97e4e0f800 20 rados->read ofs=0 len=0 2024-06-04T16:15:30.680 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.678+0000 7f97e4e0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:15:30.680 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.678+0000 7f97e4e0f800 20 started sync module instance, tier type = 2024-06-04T16:15:30.680 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.678+0000 7f97e4e0f800 20 started zone id=be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767 (name=default) with tier type = 2024-06-04T16:15:30.689 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.688+0000 7f97e4e0f800 20 add_watcher() i=0 2024-06-04T16:15:30.689 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.688+0000 7f97e4e0f800 20 add_watcher() i=1 2024-06-04T16:15:30.689 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.688+0000 7f97e4e0f800 20 add_watcher() i=2 2024-06-04T16:15:30.689 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.688+0000 7f97e4e0f800 20 add_watcher() i=3 2024-06-04T16:15:30.689 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.688+0000 7f97e4e0f800 20 add_watcher() i=4 2024-06-04T16:15:30.690 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.688+0000 7f97e4e0f800 20 add_watcher() i=5 2024-06-04T16:15:30.690 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.688+0000 7f97e4e0f800 20 add_watcher() i=6 2024-06-04T16:15:30.690 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.689+0000 7f97e4e0f800 20 add_watcher() i=7 2024-06-04T16:15:30.690 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.689+0000 7f97e4e0f800 2 all 8 watchers are set, enabling cache 2024-06-04T16:15:30.692 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.691+0000 7f9696fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-06-04T16:15:30.692 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.691+0000 7f97e4e0f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-06-04T16:15:30.692 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.691+0000 7f97e4e0f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-06-04T16:15:30.728 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.726+0000 7f9695fdb640 20 reqs_thread_entry: start 2024-06-04T16:15:30.728 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.727+0000 7f97e4e0f800 20 init_complete bucket index max shards: 11 2024-06-04T16:15:30.728 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.727+0000 7f97e4e0f800 20 Filter name: none 2024-06-04T16:15:30.728 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.727+0000 7f96077fe640 20 reqs_thread_entry: start 2024-06-04T16:15:30.728 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.727+0000 7f97e4e0f800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-06-04T16:15:30.729 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.728+0000 7f97e4e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:30.729 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.728+0000 7f97e4e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:15:30.729 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.729+0000 7f97e4e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:30.730 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.730+0000 7f97e4e0f800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-06-04T16:15:30.732 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.731+0000 7f97e4e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:30.732 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.732+0000 7f97e4e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:15:30.733 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.732+0000 7f97e4e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:30.733 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.733+0000 7f97e4e0f800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-06-04T16:15:30.735 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.734+0000 7f97e4e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:30.735 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.734+0000 7f97e4e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:15:30.735 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.735+0000 7f97e4e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:30.736 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.735+0000 7f97e4e0f800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-06-04T16:15:30.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.737+0000 7f97e4e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:30.738 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.737+0000 7f97e4e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:15:30.738 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.737+0000 7f97e4e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:30.739 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.738+0000 7f97e4e0f800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-06-04T16:15:30.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.739+0000 7f97e4e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:30.741 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.740+0000 7f97e4e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:15:30.741 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.741+0000 7f97e4e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:30.742 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.742+0000 7f97e4e0f800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-06-04T16:15:30.743 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.743+0000 7f97e4e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:30.744 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.743+0000 7f97e4e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:15:30.744 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.743+0000 7f97e4e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:30.745 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.744+0000 7f97e4e0f800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-06-04T16:15:30.746 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.745+0000 7f97e4e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:30.746 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.746+0000 7f97e4e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:15:30.747 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.746+0000 7f97e4e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:30.747 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.747+0000 7f97e4e0f800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-06-04T16:15:30.749 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.748+0000 7f97e4e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:30.749 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.749+0000 7f97e4e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:15:30.750 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.749+0000 7f97e4e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:30.751 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.750+0000 7f97e4e0f800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-06-04T16:15:30.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.751+0000 7f97e4e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:30.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.752+0000 7f97e4e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:15:30.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.752+0000 7f97e4e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:30.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.753+0000 7f97e4e0f800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-06-04T16:15:30.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.754+0000 7f97e4e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:30.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.755+0000 7f97e4e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:15:30.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.755+0000 7f97e4e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:30.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.756+0000 7f97e4e0f800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-06-04T16:15:30.758 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.758+0000 7f97e4e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:30.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.758+0000 7f97e4e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:15:30.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.758+0000 7f97e4e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:30.760 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.760+0000 7f97e4e0f800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-06-04T16:15:30.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.761+0000 7f97e4e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:30.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.761+0000 7f97e4e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:15:30.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.762+0000 7f97e4e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:30.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.762+0000 7f97e4e0f800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-06-04T16:15:30.764 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.764+0000 7f97e4e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:30.765 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.764+0000 7f97e4e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:15:30.765 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.764+0000 7f97e4e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:30.766 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.765+0000 7f97e4e0f800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-06-04T16:15:30.767 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.767+0000 7f97e4e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:30.768 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.767+0000 7f97e4e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:15:30.768 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.767+0000 7f97e4e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:30.769 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.768+0000 7f97e4e0f800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-06-04T16:15:30.770 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.770+0000 7f97e4e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:30.771 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.770+0000 7f97e4e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:15:30.771 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.770+0000 7f97e4e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:30.772 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.771+0000 7f97e4e0f800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-06-04T16:15:30.773 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.772+0000 7f97e4e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:30.773 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.773+0000 7f97e4e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:15:30.774 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.773+0000 7f97e4e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:30.775 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.774+0000 7f97e4e0f800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-06-04T16:15:30.776 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.775+0000 7f97e4e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:30.776 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.776+0000 7f97e4e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:15:30.777 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.776+0000 7f97e4e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:30.777 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.777+0000 7f97e4e0f800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-06-04T16:15:30.779 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.778+0000 7f97e4e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:30.779 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.778+0000 7f97e4e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:15:30.779 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.779+0000 7f97e4e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:30.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.780+0000 7f97e4e0f800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-06-04T16:15:30.783 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.782+0000 7f97e4e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:30.784 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.783+0000 7f97e4e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:15:30.784 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.783+0000 7f97e4e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:30.785 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.784+0000 7f97e4e0f800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-06-04T16:15:30.786 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.785+0000 7f97e4e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:30.787 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.786+0000 7f97e4e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:15:30.787 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.786+0000 7f97e4e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:30.788 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.787+0000 7f97e4e0f800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-06-04T16:15:30.789 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.788+0000 7f97e4e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:30.789 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.788+0000 7f97e4e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:15:30.789 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.789+0000 7f97e4e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:30.790 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.789+0000 7f97e4e0f800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-06-04T16:15:30.792 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.791+0000 7f97e4e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:30.792 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.792+0000 7f97e4e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:15:30.793 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.792+0000 7f97e4e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:30.793 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.793+0000 7f97e4e0f800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-06-04T16:15:30.795 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.794+0000 7f97e4e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:30.795 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.795+0000 7f97e4e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:15:30.796 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.795+0000 7f97e4e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:30.797 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.796+0000 7f97e4e0f800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-06-04T16:15:30.798 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.797+0000 7f97e4e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:30.798 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.798+0000 7f97e4e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:15:30.799 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.798+0000 7f97e4e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:30.800 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.799+0000 7f97e4e0f800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-06-04T16:15:30.801 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.801+0000 7f97e4e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:30.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.801+0000 7f97e4e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:15:30.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.801+0000 7f97e4e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:30.803 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.802+0000 7f97e4e0f800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-06-04T16:15:30.804 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.803+0000 7f97e4e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:30.805 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.804+0000 7f97e4e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:15:30.805 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.804+0000 7f97e4e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:30.806 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.805+0000 7f97e4e0f800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-06-04T16:15:30.807 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.806+0000 7f97e4e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:30.808 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.807+0000 7f97e4e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:15:30.808 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.807+0000 7f97e4e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:30.809 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.808+0000 7f97e4e0f800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-06-04T16:15:30.810 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.809+0000 7f97e4e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:30.811 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.810+0000 7f97e4e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:15:30.811 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.810+0000 7f97e4e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:30.812 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.811+0000 7f97e4e0f800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-06-04T16:15:30.813 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.812+0000 7f97e4e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:30.814 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.813+0000 7f97e4e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:15:30.814 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.814+0000 7f97e4e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:30.816 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.815+0000 7f97e4e0f800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-06-04T16:15:30.817 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.816+0000 7f97e4e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:30.817 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.817+0000 7f97e4e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:15:30.818 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.817+0000 7f97e4e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:30.819 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.818+0000 7f97e4e0f800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-06-04T16:15:30.820 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.819+0000 7f97e4e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:30.820 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.820+0000 7f97e4e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:15:30.821 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.820+0000 7f97e4e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:30.822 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.821+0000 7f97e4e0f800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-06-04T16:15:30.823 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.822+0000 7f97e4e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:30.824 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.823+0000 7f97e4e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:15:30.824 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.823+0000 7f97e4e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:30.825 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.825+0000 7f9696fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-06-04T16:15:30.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.827+0000 7f97e4e0f800 20 remove_watcher() i=0 2024-06-04T16:15:30.828 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.827+0000 7f97e4e0f800 2 removed watcher, disabling cache 2024-06-04T16:15:30.828 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.828+0000 7f97e4e0f800 20 remove_watcher() i=1 2024-06-04T16:15:30.829 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.829+0000 7f97e4e0f800 20 remove_watcher() i=2 2024-06-04T16:15:30.830 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.830+0000 7f97e4e0f800 20 remove_watcher() i=3 2024-06-04T16:15:30.831 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.830+0000 7f97e4e0f800 20 remove_watcher() i=4 2024-06-04T16:15:30.832 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.831+0000 7f97e4e0f800 20 remove_watcher() i=5 2024-06-04T16:15:30.834 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.833+0000 7f97e4e0f800 20 remove_watcher() i=6 2024-06-04T16:15:30.836 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.835+0000 7f97e4e0f800 20 remove_watcher() i=7 2024-06-04T16:15:30.847 DEBUG:teuthology.orchestra.run.smithi144:> radosgw-admin gc process --include-all 2024-06-04T16:15:30.899 INFO:teuthology.orchestra.run.smithi144.stderr:ignoring --setuser ceph since I am not root 2024-06-04T16:15:30.899 INFO:teuthology.orchestra.run.smithi144.stderr:ignoring --setgroup ceph since I am not root 2024-06-04T16:15:30.936 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.936+0000 7f7280a3f800 20 rados->read ofs=0 len=0 2024-06-04T16:15:30.938 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.937+0000 7f7280a3f800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:15:30.938 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.937+0000 7f7280a3f800 20 realm 2024-06-04T16:15:30.939 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.937+0000 7f7280a3f800 20 rados->read ofs=0 len=0 2024-06-04T16:15:30.939 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.937+0000 7f7280a3f800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:15:30.939 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.937+0000 7f7280a3f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-06-04T16:15:30.939 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.937+0000 7f7280a3f800 20 rados->read ofs=0 len=0 2024-06-04T16:15:30.939 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.938+0000 7f7280a3f800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:15:30.939 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.938+0000 7f7280a3f800 20 rados->read ofs=0 len=0 2024-06-04T16:15:30.940 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.938+0000 7f7280a3f800 20 rados_obj.operate() r=0 bl.length=46 2024-06-04T16:15:30.940 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.938+0000 7f7280a3f800 20 rados->read ofs=0 len=0 2024-06-04T16:15:30.940 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.939+0000 7f7280a3f800 20 rados_obj.operate() r=0 bl.length=1139 2024-06-04T16:15:30.940 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.939+0000 7f7280a3f800 20 searching for the correct realm 2024-06-04T16:15:30.941 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.940+0000 7f727e534640 0 -- 172.21.15.144:0/3331874505 >> [v2:172.21.15.177:6824/800067290,v1:172.21.15.177:6825/800067290] conn(0x56489037dc90 msgr2=0x564890380130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-06-04T16:15:30.944 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:30.943+0000 7f7277fff640 0 -- 172.21.15.144:0/3331874505 >> [v2:172.21.15.177:6808/2618477608,v1:172.21.15.177:6809/2618477608] conn(0x7f726808f030 msgr2=0x7f726806e980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-06-04T16:15:31.151 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.150+0000 7f7280a3f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-06-04T16:15:31.151 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.150+0000 7f7280a3f800 20 RGWRados::pool_iterate: got zone_info.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767 2024-06-04T16:15:31.151 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.150+0000 7f7280a3f800 20 RGWRados::pool_iterate: got default.zone. 2024-06-04T16:15:31.151 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.150+0000 7f7280a3f800 20 RGWRados::pool_iterate: got zonegroup_info.abb22408-c332-4e28-8f7a-ff254ea2fed2 2024-06-04T16:15:31.151 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.150+0000 7f7280a3f800 20 RGWRados::pool_iterate: got zone_names.default 2024-06-04T16:15:31.151 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.150+0000 7f7280a3f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-06-04T16:15:31.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.150+0000 7f7280a3f800 20 rados->read ofs=0 len=0 2024-06-04T16:15:31.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.150+0000 7f7280a3f800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:15:31.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.150+0000 7f7280a3f800 20 rados->read ofs=0 len=0 2024-06-04T16:15:31.153 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.150+0000 7f7280a3f800 20 rados_obj.operate() r=0 bl.length=46 2024-06-04T16:15:31.153 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.150+0000 7f7280a3f800 20 rados->read ofs=0 len=0 2024-06-04T16:15:31.153 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.151+0000 7f7280a3f800 20 rados_obj.operate() r=0 bl.length=470 2024-06-04T16:15:31.153 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.151+0000 7f7280a3f800 20 zone default found 2024-06-04T16:15:31.153 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.151+0000 7f7280a3f800 4 Realm: () 2024-06-04T16:15:31.153 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.151+0000 7f7280a3f800 4 ZoneGroup: default (abb22408-c332-4e28-8f7a-ff254ea2fed2) 2024-06-04T16:15:31.153 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.151+0000 7f7280a3f800 4 Zone: default (be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767) 2024-06-04T16:15:31.153 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.151+0000 7f7280a3f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-06-04T16:15:31.153 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.151+0000 7f7280a3f800 20 zonegroup default 2024-06-04T16:15:31.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.151+0000 7f7280a3f800 20 rados->read ofs=0 len=0 2024-06-04T16:15:31.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.151+0000 7f7280a3f800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:15:31.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.151+0000 7f7280a3f800 20 rados->read ofs=0 len=0 2024-06-04T16:15:31.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.151+0000 7f7280a3f800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:15:31.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.151+0000 7f7280a3f800 20 rados->read ofs=0 len=0 2024-06-04T16:15:31.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.152+0000 7f7280a3f800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:15:31.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.152+0000 7f7280a3f800 20 started sync module instance, tier type = 2024-06-04T16:15:31.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.152+0000 7f7280a3f800 20 started zone id=be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767 (name=default) with tier type = 2024-06-04T16:15:31.161 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.160+0000 7f7280a3f800 20 add_watcher() i=0 2024-06-04T16:15:31.161 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.160+0000 7f7280a3f800 20 add_watcher() i=1 2024-06-04T16:15:31.161 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.160+0000 7f7280a3f800 20 add_watcher() i=2 2024-06-04T16:15:31.161 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.160+0000 7f7280a3f800 20 add_watcher() i=3 2024-06-04T16:15:31.161 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.160+0000 7f7280a3f800 20 add_watcher() i=4 2024-06-04T16:15:31.161 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.160+0000 7f7280a3f800 20 add_watcher() i=5 2024-06-04T16:15:31.161 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.160+0000 7f7280a3f800 20 add_watcher() i=6 2024-06-04T16:15:31.162 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.161+0000 7f7280a3f800 20 add_watcher() i=7 2024-06-04T16:15:31.162 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.161+0000 7f7280a3f800 2 all 8 watchers are set, enabling cache 2024-06-04T16:15:31.163 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.163+0000 7f7134fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-06-04T16:15:31.165 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.163+0000 7f7280a3f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-06-04T16:15:31.165 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.163+0000 7f7280a3f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-06-04T16:15:31.199 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.197+0000 7f70af7fe640 20 reqs_thread_entry: start 2024-06-04T16:15:31.199 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.197+0000 7f7280a3f800 20 init_complete bucket index max shards: 11 2024-06-04T16:15:31.199 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.198+0000 7f7280a3f800 20 Filter name: none 2024-06-04T16:15:31.199 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.198+0000 7f70ad7fa640 20 reqs_thread_entry: start 2024-06-04T16:15:31.199 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.198+0000 7f7280a3f800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-06-04T16:15:31.200 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.199+0000 7f7280a3f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:31.200 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.200+0000 7f7280a3f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:15:31.201 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.200+0000 7f7280a3f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:31.202 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.201+0000 7f7280a3f800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-06-04T16:15:31.203 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.202+0000 7f7280a3f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:31.203 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.203+0000 7f7280a3f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:15:31.204 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.203+0000 7f7280a3f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:31.205 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.204+0000 7f7280a3f800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-06-04T16:15:31.206 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.205+0000 7f7280a3f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:31.207 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.206+0000 7f7280a3f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:15:31.207 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.206+0000 7f7280a3f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:31.208 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.207+0000 7f7280a3f800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-06-04T16:15:31.209 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.209+0000 7f7280a3f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:31.210 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.209+0000 7f7280a3f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:15:31.210 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.209+0000 7f7280a3f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:31.211 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.210+0000 7f7280a3f800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-06-04T16:15:31.212 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.212+0000 7f7280a3f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:31.213 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.212+0000 7f7280a3f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:15:31.213 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.212+0000 7f7280a3f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:31.214 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.213+0000 7f7280a3f800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-06-04T16:15:31.215 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.215+0000 7f7280a3f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:31.216 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.215+0000 7f7280a3f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:15:31.216 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.215+0000 7f7280a3f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:31.217 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.216+0000 7f7280a3f800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-06-04T16:15:31.218 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.217+0000 7f7280a3f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:31.219 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.218+0000 7f7280a3f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:15:31.219 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.218+0000 7f7280a3f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:31.219 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.219+0000 7f7280a3f800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-06-04T16:15:31.220 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.220+0000 7f7280a3f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:31.221 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.220+0000 7f7280a3f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:15:31.221 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.221+0000 7f7280a3f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:31.222 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.221+0000 7f7280a3f800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-06-04T16:15:31.223 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.223+0000 7f7280a3f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:31.224 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.223+0000 7f7280a3f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:15:31.224 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.223+0000 7f7280a3f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:31.225 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.224+0000 7f7280a3f800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-06-04T16:15:31.226 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.225+0000 7f7280a3f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:31.227 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.226+0000 7f7280a3f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:15:31.227 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.226+0000 7f7280a3f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:31.228 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.227+0000 7f7280a3f800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-06-04T16:15:31.229 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.229+0000 7f7280a3f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:31.230 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.229+0000 7f7280a3f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:15:31.230 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.229+0000 7f7280a3f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:31.231 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.230+0000 7f7280a3f800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-06-04T16:15:31.232 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.231+0000 7f7280a3f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:31.232 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.232+0000 7f7280a3f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:15:31.232 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.232+0000 7f7280a3f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:31.233 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.233+0000 7f7280a3f800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-06-04T16:15:31.235 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.234+0000 7f7280a3f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:31.235 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.234+0000 7f7280a3f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:15:31.235 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.234+0000 7f7280a3f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:31.236 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.236+0000 7f7280a3f800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-06-04T16:15:31.238 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.237+0000 7f7280a3f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:31.238 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.237+0000 7f7280a3f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:15:31.238 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.237+0000 7f7280a3f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:31.239 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.238+0000 7f7280a3f800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-06-04T16:15:31.240 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.240+0000 7f7280a3f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:31.241 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.240+0000 7f7280a3f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:15:31.241 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.240+0000 7f7280a3f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:31.242 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.241+0000 7f7280a3f800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-06-04T16:15:31.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.242+0000 7f7280a3f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:31.244 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.243+0000 7f7280a3f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:15:31.244 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.243+0000 7f7280a3f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:31.245 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.244+0000 7f7280a3f800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-06-04T16:15:31.246 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.245+0000 7f7280a3f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:31.246 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.246+0000 7f7280a3f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:15:31.247 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.246+0000 7f7280a3f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:31.248 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.247+0000 7f7280a3f800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-06-04T16:15:31.249 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.248+0000 7f7280a3f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:31.249 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.248+0000 7f7280a3f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:15:31.249 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.249+0000 7f7280a3f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:31.250 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.249+0000 7f7280a3f800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-06-04T16:15:31.252 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.251+0000 7f7280a3f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:31.253 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.252+0000 7f7280a3f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:15:31.253 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.252+0000 7f7280a3f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:31.254 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.253+0000 7f7280a3f800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-06-04T16:15:31.255 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.255+0000 7f7280a3f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:31.256 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.255+0000 7f7280a3f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:15:31.256 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.255+0000 7f7280a3f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:31.257 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.256+0000 7f7280a3f800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-06-04T16:15:31.258 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.257+0000 7f7280a3f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:31.258 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.258+0000 7f7280a3f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:15:31.259 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.258+0000 7f7280a3f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:31.260 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.259+0000 7f7280a3f800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-06-04T16:15:31.261 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.260+0000 7f7280a3f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:31.262 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.261+0000 7f7280a3f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:15:31.262 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.261+0000 7f7280a3f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:31.263 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.262+0000 7f7280a3f800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-06-04T16:15:31.264 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.264+0000 7f7280a3f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:31.265 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.264+0000 7f7280a3f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:15:31.265 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.264+0000 7f7280a3f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:31.266 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.265+0000 7f7280a3f800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-06-04T16:15:31.267 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.267+0000 7f7280a3f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:31.268 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.267+0000 7f7280a3f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:15:31.268 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.267+0000 7f7280a3f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:31.269 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.268+0000 7f7280a3f800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-06-04T16:15:31.271 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.270+0000 7f7280a3f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:31.271 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.270+0000 7f7280a3f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:15:31.271 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.270+0000 7f7280a3f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:31.272 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.272+0000 7f7280a3f800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-06-04T16:15:31.274 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.273+0000 7f7280a3f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:31.274 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.273+0000 7f7280a3f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:15:31.274 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.274+0000 7f7280a3f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:31.275 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.275+0000 7f7280a3f800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-06-04T16:15:31.277 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.276+0000 7f7280a3f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:31.277 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.276+0000 7f7280a3f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:15:31.278 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.277+0000 7f7280a3f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:31.279 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.278+0000 7f7280a3f800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-06-04T16:15:31.280 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.279+0000 7f7280a3f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:31.280 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.280+0000 7f7280a3f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:15:31.281 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.280+0000 7f7280a3f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:31.281 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.281+0000 7f7280a3f800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-06-04T16:15:31.283 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.282+0000 7f7280a3f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:31.283 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.282+0000 7f7280a3f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:15:31.283 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.283+0000 7f7280a3f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:31.284 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.284+0000 7f7280a3f800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-06-04T16:15:31.286 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.285+0000 7f7280a3f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:31.286 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.285+0000 7f7280a3f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:15:31.286 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.286+0000 7f7280a3f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:31.287 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.287+0000 7f7280a3f800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-06-04T16:15:31.288 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.288+0000 7f7280a3f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:31.289 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.288+0000 7f7280a3f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:15:31.289 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.288+0000 7f7280a3f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:31.290 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.289+0000 7f7280a3f800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-06-04T16:15:31.291 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.291+0000 7f7280a3f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:31.292 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.291+0000 7f7280a3f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:15:31.292 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.291+0000 7f7280a3f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:31.294 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.293+0000 7f7134fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-06-04T16:15:31.297 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.296+0000 7f7280a3f800 20 remove_watcher() i=0 2024-06-04T16:15:31.297 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.296+0000 7f7280a3f800 2 removed watcher, disabling cache 2024-06-04T16:15:31.297 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.297+0000 7f7280a3f800 20 remove_watcher() i=1 2024-06-04T16:15:31.298 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.298+0000 7f7280a3f800 20 remove_watcher() i=2 2024-06-04T16:15:31.299 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.299+0000 7f7280a3f800 20 remove_watcher() i=3 2024-06-04T16:15:31.300 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.299+0000 7f7280a3f800 20 remove_watcher() i=4 2024-06-04T16:15:31.301 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.300+0000 7f7280a3f800 20 remove_watcher() i=5 2024-06-04T16:15:31.302 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.301+0000 7f7280a3f800 20 remove_watcher() i=6 2024-06-04T16:15:31.303 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.302+0000 7f7280a3f800 20 remove_watcher() i=7 2024-06-04T16:15:31.315 DEBUG:teuthology.orchestra.run.smithi144:> radosgw-admin gc process --include-all 2024-06-04T16:15:31.366 INFO:teuthology.orchestra.run.smithi144.stderr:ignoring --setuser ceph since I am not root 2024-06-04T16:15:31.366 INFO:teuthology.orchestra.run.smithi144.stderr:ignoring --setgroup ceph since I am not root 2024-06-04T16:15:31.402 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.402+0000 7f2a2212c800 20 rados->read ofs=0 len=0 2024-06-04T16:15:31.404 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.403+0000 7f2a2212c800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:15:31.405 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.403+0000 7f2a2212c800 20 realm 2024-06-04T16:15:31.405 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.403+0000 7f2a2212c800 20 rados->read ofs=0 len=0 2024-06-04T16:15:31.405 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.403+0000 7f2a2212c800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:15:31.405 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.403+0000 7f2a2212c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-06-04T16:15:31.405 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.403+0000 7f2a2212c800 20 rados->read ofs=0 len=0 2024-06-04T16:15:31.405 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.404+0000 7f2a2212c800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:15:31.405 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.404+0000 7f2a2212c800 20 rados->read ofs=0 len=0 2024-06-04T16:15:31.406 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.404+0000 7f2a2212c800 20 rados_obj.operate() r=0 bl.length=46 2024-06-04T16:15:31.406 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.404+0000 7f2a2212c800 20 rados->read ofs=0 len=0 2024-06-04T16:15:31.406 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.405+0000 7f2a2212c800 20 rados_obj.operate() r=0 bl.length=1139 2024-06-04T16:15:31.406 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.405+0000 7f2a2212c800 20 searching for the correct realm 2024-06-04T16:15:31.408 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.407+0000 7f2a1e65b640 0 -- 172.21.15.144:0/4258436692 >> [v2:172.21.15.144:6800/1453747520,v1:172.21.15.144:6801/1453747520] conn(0x7f2a08029070 msgr2=0x7f2a08029960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-06-04T16:15:31.612 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.612+0000 7f2a1e65b640 0 -- 172.21.15.144:0/4258436692 >> [v2:172.21.15.144:6824/166159729,v1:172.21.15.144:6825/166159729] conn(0x557d0bfd7700 msgr2=0x557d0bfd9af0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-06-04T16:15:31.618 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.617+0000 7f2a2212c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-06-04T16:15:31.618 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.617+0000 7f2a2212c800 20 RGWRados::pool_iterate: got zone_info.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767 2024-06-04T16:15:31.618 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.617+0000 7f2a2212c800 20 RGWRados::pool_iterate: got default.zone. 2024-06-04T16:15:31.618 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.617+0000 7f2a2212c800 20 RGWRados::pool_iterate: got zonegroup_info.abb22408-c332-4e28-8f7a-ff254ea2fed2 2024-06-04T16:15:31.618 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.617+0000 7f2a2212c800 20 RGWRados::pool_iterate: got zone_names.default 2024-06-04T16:15:31.618 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.617+0000 7f2a2212c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-06-04T16:15:31.619 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.617+0000 7f2a2212c800 20 rados->read ofs=0 len=0 2024-06-04T16:15:31.619 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.617+0000 7f2a2212c800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:15:31.619 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.617+0000 7f2a2212c800 20 rados->read ofs=0 len=0 2024-06-04T16:15:31.619 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.617+0000 7f2a2212c800 20 rados_obj.operate() r=0 bl.length=46 2024-06-04T16:15:31.619 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.617+0000 7f2a2212c800 20 rados->read ofs=0 len=0 2024-06-04T16:15:31.620 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.618+0000 7f2a2212c800 20 rados_obj.operate() r=0 bl.length=470 2024-06-04T16:15:31.620 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.618+0000 7f2a2212c800 20 zone default found 2024-06-04T16:15:31.620 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.618+0000 7f2a2212c800 4 Realm: () 2024-06-04T16:15:31.620 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.618+0000 7f2a2212c800 4 ZoneGroup: default (abb22408-c332-4e28-8f7a-ff254ea2fed2) 2024-06-04T16:15:31.620 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.618+0000 7f2a2212c800 4 Zone: default (be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767) 2024-06-04T16:15:31.621 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.618+0000 7f2a2212c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-06-04T16:15:31.621 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.618+0000 7f2a2212c800 20 zonegroup default 2024-06-04T16:15:31.621 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.618+0000 7f2a2212c800 20 rados->read ofs=0 len=0 2024-06-04T16:15:31.621 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.618+0000 7f2a2212c800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:15:31.621 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.618+0000 7f2a2212c800 20 rados->read ofs=0 len=0 2024-06-04T16:15:31.621 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.618+0000 7f2a2212c800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:15:31.621 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.618+0000 7f2a2212c800 20 rados->read ofs=0 len=0 2024-06-04T16:15:31.621 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.619+0000 7f2a2212c800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:15:31.621 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.619+0000 7f2a2212c800 20 started sync module instance, tier type = 2024-06-04T16:15:31.621 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.619+0000 7f2a2212c800 20 started zone id=be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767 (name=default) with tier type = 2024-06-04T16:15:31.628 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.627+0000 7f2a2212c800 20 add_watcher() i=0 2024-06-04T16:15:31.628 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.627+0000 7f2a2212c800 20 add_watcher() i=1 2024-06-04T16:15:31.628 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.627+0000 7f2a2212c800 20 add_watcher() i=2 2024-06-04T16:15:31.628 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.627+0000 7f2a2212c800 20 add_watcher() i=3 2024-06-04T16:15:31.628 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.627+0000 7f2a2212c800 20 add_watcher() i=4 2024-06-04T16:15:31.628 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.627+0000 7f2a2212c800 20 add_watcher() i=5 2024-06-04T16:15:31.628 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.627+0000 7f2a2212c800 20 add_watcher() i=6 2024-06-04T16:15:31.628 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.628+0000 7f2a2212c800 20 add_watcher() i=7 2024-06-04T16:15:31.629 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.628+0000 7f2a2212c800 2 all 8 watchers are set, enabling cache 2024-06-04T16:15:31.630 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.629+0000 7f28cf7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-06-04T16:15:31.630 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.630+0000 7f2a2212c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-06-04T16:15:31.630 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.630+0000 7f2a2212c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-06-04T16:15:31.668 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.667+0000 7f28ce7fc640 20 reqs_thread_entry: start 2024-06-04T16:15:31.668 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.667+0000 7f2a2212c800 20 init_complete bucket index max shards: 11 2024-06-04T16:15:31.668 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.667+0000 7f2a2212c800 20 Filter name: none 2024-06-04T16:15:31.668 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.667+0000 7f283ffff640 20 reqs_thread_entry: start 2024-06-04T16:15:31.669 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.667+0000 7f2a2212c800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-06-04T16:15:31.669 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.669+0000 7f2a2212c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:31.670 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.669+0000 7f2a2212c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:15:31.670 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.669+0000 7f2a2212c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:31.671 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.670+0000 7f2a2212c800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-06-04T16:15:31.672 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.671+0000 7f2a2212c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:31.672 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.672+0000 7f2a2212c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:15:31.673 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.672+0000 7f2a2212c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:31.673 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.673+0000 7f2a2212c800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-06-04T16:15:31.675 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.674+0000 7f2a2212c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:31.675 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.674+0000 7f2a2212c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:15:31.675 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.675+0000 7f2a2212c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:31.676 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.676+0000 7f2a2212c800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-06-04T16:15:31.678 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.677+0000 7f2a2212c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:31.678 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.677+0000 7f2a2212c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:15:31.678 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.678+0000 7f2a2212c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:31.679 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.679+0000 7f2a2212c800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-06-04T16:15:31.680 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.680+0000 7f2a2212c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:31.681 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.680+0000 7f2a2212c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:15:31.681 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.680+0000 7f2a2212c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:31.682 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.681+0000 7f2a2212c800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-06-04T16:15:31.683 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.683+0000 7f2a2212c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:31.684 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.683+0000 7f2a2212c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:15:31.684 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.684+0000 7f2a2212c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:31.685 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.685+0000 7f2a2212c800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-06-04T16:15:31.687 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.686+0000 7f2a2212c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:31.687 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.686+0000 7f2a2212c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:15:31.687 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.686+0000 7f2a2212c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:31.688 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.688+0000 7f2a2212c800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-06-04T16:15:31.690 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.689+0000 7f2a2212c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:31.690 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.689+0000 7f2a2212c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:15:31.690 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.690+0000 7f2a2212c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:31.691 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.691+0000 7f2a2212c800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-06-04T16:15:31.693 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.692+0000 7f2a2212c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:31.693 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.692+0000 7f2a2212c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:15:31.693 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.693+0000 7f2a2212c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:31.694 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.694+0000 7f2a2212c800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-06-04T16:15:31.696 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.695+0000 7f2a2212c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:31.696 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.695+0000 7f2a2212c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:15:31.696 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.696+0000 7f2a2212c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:31.697 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.697+0000 7f2a2212c800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-06-04T16:15:31.699 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.698+0000 7f2a2212c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:31.699 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.698+0000 7f2a2212c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:15:31.699 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.699+0000 7f2a2212c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:31.700 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.700+0000 7f2a2212c800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-06-04T16:15:31.702 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.701+0000 7f2a2212c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:31.702 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.702+0000 7f2a2212c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:15:31.703 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.702+0000 7f2a2212c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:31.704 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.703+0000 7f2a2212c800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-06-04T16:15:31.705 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.704+0000 7f2a2212c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:31.705 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.704+0000 7f2a2212c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:15:31.705 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.705+0000 7f2a2212c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:31.706 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.705+0000 7f2a2212c800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-06-04T16:15:31.707 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.707+0000 7f2a2212c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:31.708 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.707+0000 7f2a2212c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:15:31.708 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.707+0000 7f2a2212c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:31.709 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.708+0000 7f2a2212c800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-06-04T16:15:31.710 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.710+0000 7f2a2212c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:31.711 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.710+0000 7f2a2212c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:15:31.711 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.710+0000 7f2a2212c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:31.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.711+0000 7f2a2212c800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-06-04T16:15:31.713 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.713+0000 7f2a2212c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:31.714 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.713+0000 7f2a2212c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:15:31.715 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.714+0000 7f2a2212c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:31.716 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.715+0000 7f2a2212c800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-06-04T16:15:31.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.716+0000 7f2a2212c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:31.718 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.717+0000 7f2a2212c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:15:31.718 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.717+0000 7f2a2212c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:31.719 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.718+0000 7f2a2212c800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-06-04T16:15:31.720 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.720+0000 7f2a2212c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:31.721 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.720+0000 7f2a2212c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:15:31.721 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.720+0000 7f2a2212c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:31.722 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.721+0000 7f2a2212c800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-06-04T16:15:31.723 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.722+0000 7f2a2212c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:31.723 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.723+0000 7f2a2212c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:15:31.724 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.723+0000 7f2a2212c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:31.724 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.724+0000 7f2a2212c800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-06-04T16:15:31.726 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.725+0000 7f2a2212c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:31.726 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.725+0000 7f2a2212c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:15:31.726 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.726+0000 7f2a2212c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:31.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.726+0000 7f2a2212c800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-06-04T16:15:31.729 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.728+0000 7f2a2212c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:31.729 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.728+0000 7f2a2212c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:15:31.729 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.729+0000 7f2a2212c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:31.730 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.730+0000 7f2a2212c800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-06-04T16:15:31.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.731+0000 7f2a2212c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:31.732 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.731+0000 7f2a2212c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:15:31.732 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.731+0000 7f2a2212c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:31.733 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.732+0000 7f2a2212c800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-06-04T16:15:31.734 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.733+0000 7f2a2212c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:31.735 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.734+0000 7f2a2212c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:15:31.735 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.734+0000 7f2a2212c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:31.736 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.735+0000 7f2a2212c800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-06-04T16:15:31.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.737+0000 7f2a2212c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:31.738 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.737+0000 7f2a2212c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:15:31.738 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.737+0000 7f2a2212c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:31.739 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.738+0000 7f2a2212c800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-06-04T16:15:31.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.740+0000 7f2a2212c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:31.741 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.740+0000 7f2a2212c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:15:31.741 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.740+0000 7f2a2212c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:31.742 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.741+0000 7f2a2212c800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-06-04T16:15:31.743 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.742+0000 7f2a2212c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:31.744 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.743+0000 7f2a2212c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:15:31.744 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.743+0000 7f2a2212c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:31.745 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.744+0000 7f2a2212c800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-06-04T16:15:31.746 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.745+0000 7f2a2212c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:31.747 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.746+0000 7f2a2212c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:15:31.747 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.746+0000 7f2a2212c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:31.748 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.747+0000 7f2a2212c800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-06-04T16:15:31.749 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.748+0000 7f2a2212c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:31.750 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.749+0000 7f2a2212c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:15:31.750 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.749+0000 7f2a2212c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:31.751 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.750+0000 7f2a2212c800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-06-04T16:15:31.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.752+0000 7f2a2212c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:31.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.752+0000 7f2a2212c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:15:31.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.753+0000 7f2a2212c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:31.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.754+0000 7f2a2212c800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-06-04T16:15:31.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.755+0000 7f2a2212c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:31.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.756+0000 7f2a2212c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:15:31.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.756+0000 7f2a2212c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:31.758 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.757+0000 7f2a2212c800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-06-04T16:15:31.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.759+0000 7f2a2212c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:31.760 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.759+0000 7f2a2212c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:15:31.760 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.759+0000 7f2a2212c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:31.761 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.760+0000 7f2a2212c800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-06-04T16:15:31.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.762+0000 7f2a2212c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:31.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.762+0000 7f2a2212c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:15:31.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.762+0000 7f2a2212c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:15:31.765 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.764+0000 7f28cf7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-06-04T16:15:31.767 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.766+0000 7f2a2212c800 20 remove_watcher() i=0 2024-06-04T16:15:31.767 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.766+0000 7f2a2212c800 2 removed watcher, disabling cache 2024-06-04T16:15:31.768 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.767+0000 7f2a2212c800 20 remove_watcher() i=1 2024-06-04T16:15:31.768 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.768+0000 7f2a2212c800 20 remove_watcher() i=2 2024-06-04T16:15:31.769 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.769+0000 7f2a2212c800 20 remove_watcher() i=3 2024-06-04T16:15:31.770 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.770+0000 7f2a2212c800 20 remove_watcher() i=4 2024-06-04T16:15:31.771 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.771+0000 7f2a2212c800 20 remove_watcher() i=5 2024-06-04T16:15:31.772 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.772+0000 7f2a2212c800 20 remove_watcher() i=6 2024-06-04T16:15:31.773 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:15:31.773+0000 7f2a2212c800 20 remove_watcher() i=7 2024-06-04T16:15:31.784 DEBUG:teuthology.orchestra.run.smithi144:> cd /home/ubuntu/cephtest/s3-tests-java && /opt/gradle/gradle/bin/gradle clean test --rerun-tasks --no-build-cache --tests ObjectTest 2024-06-04T16:15:32.289 INFO:teuthology.orchestra.run.smithi144.stdout:> Task :clean 2024-06-04T16:15:32.986 INFO:teuthology.orchestra.run.smithi144.stdout:> Task :compileJava 2024-06-04T16:15:32.986 INFO:teuthology.orchestra.run.smithi144.stdout:> Task :processResources 2024-06-04T16:15:32.986 INFO:teuthology.orchestra.run.smithi144.stdout:> Task :classes 2024-06-04T16:15:33.486 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:15:33.486 INFO:teuthology.orchestra.run.smithi144.stdout:> Task :compileTestJava 2024-06-04T16:15:33.487 INFO:teuthology.orchestra.run.smithi144.stderr:Note: /home/ubuntu/cephtest/s3-tests-java/src/test/java/BucketTest.java uses or overrides a deprecated API. 2024-06-04T16:15:33.487 INFO:teuthology.orchestra.run.smithi144.stderr:Note: Recompile with -Xlint:deprecation for details. 2024-06-04T16:15:33.488 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:15:33.488 INFO:teuthology.orchestra.run.smithi144.stdout:> Task :processTestResources NO-SOURCE 2024-06-04T16:15:33.488 INFO:teuthology.orchestra.run.smithi144.stdout:> Task :testClasses 2024-06-04T16:15:35.487 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:15:35.488 INFO:teuthology.orchestra.run.smithi144.stdout:> Task :test 2024-06-04T16:15:35.488 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:15:35.488 INFO:teuthology.orchestra.run.smithi144.stdout:suite > Object tests STANDARD_OUT 2024-06-04T16:15:35.488 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04 16:15:34,787 [Test worker] WARN com.amazonaws.util.Base64 - JAXB is unavailable. Will fallback to SDK implementation which may be less performant 2024-06-04T16:15:35.488 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:15:35.488 INFO:teuthology.orchestra.run.smithi144.stdout:suite > Object tests > ObjectTest.TestObjectCopyKeyNotFound STARTED 2024-06-04T16:15:35.488 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:15:35.488 INFO:teuthology.orchestra.run.smithi144.stdout:suite > Object tests > ObjectTest.TestObjectCopyKeyNotFound PASSED 2024-06-04T16:15:35.488 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:15:35.488 INFO:teuthology.orchestra.run.smithi144.stdout:suite > Object tests > ObjectTest.TestObjectCreateBadExpectNone STARTED 2024-06-04T16:15:35.488 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:15:35.488 INFO:teuthology.orchestra.run.smithi144.stdout:suite > Object tests > ObjectTest.TestObjectCreateBadExpectNone PASSED 2024-06-04T16:15:35.686 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:15:35.686 INFO:teuthology.orchestra.run.smithi144.stdout:suite > Object tests > ObjectTest.TestObjectCreateBadMd5Empty STARTED 2024-06-04T16:15:35.686 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:15:35.686 INFO:teuthology.orchestra.run.smithi144.stdout:suite > Object tests > ObjectTest.TestObjectCreateBadMd5Empty PASSED 2024-06-04T16:15:35.985 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:15:35.986 INFO:teuthology.orchestra.run.smithi144.stdout:suite > Object tests > ObjectTest.testAbortMultipartUploadLLAPI STARTED 2024-06-04T16:15:36.585 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:15:36.586 INFO:teuthology.orchestra.run.smithi144.stdout:suite > Object tests > ObjectTest.testAbortMultipartUploadLLAPI PASSED 2024-06-04T16:15:36.786 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:15:36.786 INFO:teuthology.orchestra.run.smithi144.stdout:suite > Object tests > ObjectTest.testAbortMultipartUploadNotFoundLLAPI STARTED 2024-06-04T16:15:36.786 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:15:36.786 INFO:teuthology.orchestra.run.smithi144.stdout:suite > Object tests > ObjectTest.testAbortMultipartUploadNotFoundLLAPI PASSED 2024-06-04T16:15:36.985 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:15:36.986 INFO:teuthology.orchestra.run.smithi144.stdout:suite > Object tests > ObjectTest.testDownloadHLAPI STARTED 2024-06-04T16:15:37.085 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:15:37.086 INFO:teuthology.orchestra.run.smithi144.stdout:suite > Object tests > ObjectTest.testDownloadHLAPI PASSED 2024-06-04T16:15:37.286 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:15:37.286 INFO:teuthology.orchestra.run.smithi144.stdout:suite > Object tests > ObjectTest.testDownloadNoBucketHLAPI STARTED 2024-06-04T16:15:37.286 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:15:37.286 INFO:teuthology.orchestra.run.smithi144.stdout:suite > Object tests > ObjectTest.testDownloadNoBucketHLAPI PASSED 2024-06-04T16:15:37.386 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:15:37.386 INFO:teuthology.orchestra.run.smithi144.stdout:suite > Object tests > ObjectTest.testDownloadNoKeyHLAPI STARTED 2024-06-04T16:15:37.387 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:15:37.387 INFO:teuthology.orchestra.run.smithi144.stdout:suite > Object tests > ObjectTest.testDownloadNoKeyHLAPI PASSED 2024-06-04T16:15:37.586 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:15:37.586 INFO:teuthology.orchestra.run.smithi144.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1MB STARTED 2024-06-04T16:15:37.886 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:15:37.886 INFO:teuthology.orchestra.run.smithi144.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1MB PASSED 2024-06-04T16:15:38.086 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:15:38.086 INFO:teuthology.orchestra.run.smithi144.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1b STARTED 2024-06-04T16:15:38.086 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:15:38.086 INFO:teuthology.orchestra.run.smithi144.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1b PASSED 2024-06-04T16:15:38.285 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:15:38.286 INFO:teuthology.orchestra.run.smithi144.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1kb STARTED 2024-06-04T16:15:38.386 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:15:38.386 INFO:teuthology.orchestra.run.smithi144.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1kb PASSED 2024-06-04T16:15:38.585 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:15:38.586 INFO:teuthology.orchestra.run.smithi144.stdout:suite > Object tests > ObjectTest.testEncryptionKeyNoSSEC STARTED 2024-06-04T16:15:38.686 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:15:38.686 INFO:teuthology.orchestra.run.smithi144.stdout:suite > Object tests > ObjectTest.testEncryptionKeyNoSSEC PASSED 2024-06-04T16:15:38.886 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:15:38.886 INFO:teuthology.orchestra.run.smithi144.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECInvalidMd5 STARTED 2024-06-04T16:15:38.886 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:15:38.886 INFO:teuthology.orchestra.run.smithi144.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECInvalidMd5 PASSED 2024-06-04T16:15:39.085 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:15:39.086 INFO:teuthology.orchestra.run.smithi144.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECNoKey STARTED 2024-06-04T16:15:39.186 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:15:39.186 INFO:teuthology.orchestra.run.smithi144.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECNoKey PASSED 2024-06-04T16:15:39.386 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:15:39.386 INFO:teuthology.orchestra.run.smithi144.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECNoMd5 STARTED 2024-06-04T16:15:39.386 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:15:39.386 INFO:teuthology.orchestra.run.smithi144.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECNoMd5 PASSED 2024-06-04T16:15:39.585 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:15:39.586 INFO:teuthology.orchestra.run.smithi144.stdout:suite > Object tests > ObjectTest.testMultiObjectDelete STARTED 2024-06-04T16:15:39.686 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:15:39.686 INFO:teuthology.orchestra.run.smithi144.stdout:suite > Object tests > ObjectTest.testMultiObjectDelete PASSED 2024-06-04T16:15:39.886 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:15:39.886 INFO:teuthology.orchestra.run.smithi144.stdout:suite > Object tests > ObjectTest.testMultipartCopyHLAPIA STARTED 2024-06-04T16:15:40.386 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:15:40.386 INFO:teuthology.orchestra.run.smithi144.stdout:suite > Object tests > ObjectTest.testMultipartCopyHLAPIA PASSED 2024-06-04T16:15:40.685 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:15:40.685 INFO:teuthology.orchestra.run.smithi144.stdout:suite > Object tests > ObjectTest.testMultipartCopyMultipleSizesLLAPI STARTED 2024-06-04T16:15:43.986 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:15:43.986 INFO:teuthology.orchestra.run.smithi144.stdout:suite > Object tests > ObjectTest.testMultipartCopyMultipleSizesLLAPI PASSED 2024-06-04T16:15:44.287 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:15:44.287 INFO:teuthology.orchestra.run.smithi144.stdout:suite > Object tests > ObjectTest.testMultipartCopyNoSRCBucketHLAPI STARTED 2024-06-04T16:15:44.287 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:15:44.287 INFO:teuthology.orchestra.run.smithi144.stdout:suite > Object tests > ObjectTest.testMultipartCopyNoSRCBucketHLAPI PASSED 2024-06-04T16:15:44.486 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:15:44.486 INFO:teuthology.orchestra.run.smithi144.stdout:suite > Object tests > ObjectTest.testMultipartCopyNoSRCKeyHLAPI STARTED 2024-06-04T16:15:44.586 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:15:44.586 INFO:teuthology.orchestra.run.smithi144.stdout:suite > Object tests > ObjectTest.testMultipartCopyNoSRCKeyHLAPI PASSED 2024-06-04T16:15:44.885 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:15:44.886 INFO:teuthology.orchestra.run.smithi144.stdout:suite > Object tests > ObjectTest.testMultipartDownloadHLAPI STARTED 2024-06-04T16:15:45.185 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:15:45.186 INFO:teuthology.orchestra.run.smithi144.stdout:suite > Object tests > ObjectTest.testMultipartDownloadHLAPI PASSED 2024-06-04T16:15:45.386 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:15:45.386 INFO:teuthology.orchestra.run.smithi144.stdout:suite > Object tests > ObjectTest.testMultipartDownloadNoBucketHLAPI STARTED 2024-06-04T16:15:45.486 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:15:45.486 INFO:teuthology.orchestra.run.smithi144.stdout:suite > Object tests > ObjectTest.testMultipartDownloadNoBucketHLAPI PASSED 2024-06-04T16:15:45.585 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:15:45.586 INFO:teuthology.orchestra.run.smithi144.stdout:suite > Object tests > ObjectTest.testMultipartDownloadWithPauseHLAPI STARTED 2024-06-04T16:15:46.285 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:15:46.286 INFO:teuthology.orchestra.run.smithi144.stdout:suite > Object tests > ObjectTest.testMultipartDownloadWithPauseHLAPI PASSED 2024-06-04T16:15:46.386 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:15:46.386 INFO:teuthology.orchestra.run.smithi144.stdout:suite > Object tests > ObjectTest.testMultipartUploadHLAPIAWS4 STARTED 2024-06-04T16:15:46.786 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:15:46.786 INFO:teuthology.orchestra.run.smithi144.stdout:suite > Object tests > ObjectTest.testMultipartUploadHLAPIAWS4 PASSED 2024-06-04T16:15:46.985 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:15:46.986 INFO:teuthology.orchestra.run.smithi144.stdout:suite > Object tests > ObjectTest.testMultipartUploadIncorrectMissingPartLLAPI STARTED 2024-06-04T16:15:47.385 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:15:47.386 INFO:teuthology.orchestra.run.smithi144.stdout:suite > Object tests > ObjectTest.testMultipartUploadIncorrectMissingPartLLAPI PASSED 2024-06-04T16:15:47.585 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:15:47.586 INFO:teuthology.orchestra.run.smithi144.stdout:suite > Object tests > ObjectTest.testMultipartUploadMultipleSizesLLAPI STARTED 2024-06-04T16:15:50.785 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:15:50.786 INFO:teuthology.orchestra.run.smithi144.stdout:suite > Object tests > ObjectTest.testMultipartUploadMultipleSizesLLAPI PASSED 2024-06-04T16:15:50.986 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:15:50.986 INFO:teuthology.orchestra.run.smithi144.stdout:suite > Object tests > ObjectTest.testMultipartUploadOverwriteExistingObjectLLAPI STARTED 2024-06-04T16:15:51.885 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:15:51.886 INFO:teuthology.orchestra.run.smithi144.stdout:suite > Object tests > ObjectTest.testMultipartUploadOverwriteExistingObjectLLAPI PASSED 2024-06-04T16:15:52.085 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:15:52.086 INFO:teuthology.orchestra.run.smithi144.stdout:suite > Object tests > ObjectTest.testMultipartUploadSmallLLAPI STARTED 2024-06-04T16:15:52.486 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:15:52.486 INFO:teuthology.orchestra.run.smithi144.stdout:suite > Object tests > ObjectTest.testMultipartUploadSmallLLAPI PASSED 2024-06-04T16:15:52.686 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:15:52.686 INFO:teuthology.orchestra.run.smithi144.stdout:suite > Object tests > ObjectTest.testMultipartUploadWithPause STARTED 2024-06-04T16:15:53.185 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:15:53.186 INFO:teuthology.orchestra.run.smithi144.stdout:suite > Object tests > ObjectTest.testMultipartUploadWithPause PASSED 2024-06-04T16:15:53.586 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:15:53.586 INFO:teuthology.orchestra.run.smithi144.stdout:suite > Object tests > ObjectTest.testObjectCopyBucketNotFound STARTED 2024-06-04T16:15:53.586 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:15:53.586 INFO:teuthology.orchestra.run.smithi144.stdout:suite > Object tests > ObjectTest.testObjectCopyBucketNotFound PASSED 2024-06-04T16:15:53.686 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:15:53.686 INFO:teuthology.orchestra.run.smithi144.stdout:suite > Object tests > ObjectTest.testObjectCreateBadExpectMismatch STARTED 2024-06-04T16:15:53.686 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:15:53.686 INFO:teuthology.orchestra.run.smithi144.stdout:suite > Object tests > ObjectTest.testObjectCreateBadExpectMismatch PASSED 2024-06-04T16:15:53.885 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:15:53.886 INFO:teuthology.orchestra.run.smithi144.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5InvalidShort STARTED 2024-06-04T16:15:53.985 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:15:53.985 INFO:teuthology.orchestra.run.smithi144.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5InvalidShort PASSED 2024-06-04T16:15:54.186 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:15:54.186 INFO:teuthology.orchestra.run.smithi144.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5Ivalid STARTED 2024-06-04T16:15:54.186 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:15:54.186 INFO:teuthology.orchestra.run.smithi144.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5Ivalid PASSED 2024-06-04T16:15:54.386 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:15:54.386 INFO:teuthology.orchestra.run.smithi144.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5None STARTED 2024-06-04T16:15:54.485 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:15:54.486 INFO:teuthology.orchestra.run.smithi144.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5None PASSED 2024-06-04T16:15:54.685 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:15:54.686 INFO:teuthology.orchestra.run.smithi144.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5Unreadable STARTED 2024-06-04T16:15:54.686 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:15:54.686 INFO:teuthology.orchestra.run.smithi144.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5Unreadable PASSED 2024-06-04T16:15:54.886 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:15:54.886 INFO:teuthology.orchestra.run.smithi144.stdout:suite > Object tests > ObjectTest.testObjectHeadZeroBytes STARTED 2024-06-04T16:15:54.886 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:15:54.886 INFO:teuthology.orchestra.run.smithi144.stdout:suite > Object tests > ObjectTest.testObjectHeadZeroBytes PASSED 2024-06-04T16:15:55.086 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:15:55.087 INFO:teuthology.orchestra.run.smithi144.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterDot STARTED 2024-06-04T16:15:55.186 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:15:55.186 INFO:teuthology.orchestra.run.smithi144.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterDot PASSED 2024-06-04T16:15:55.385 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:15:55.386 INFO:teuthology.orchestra.run.smithi144.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterNotExist STARTED 2024-06-04T16:15:55.485 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:15:55.486 INFO:teuthology.orchestra.run.smithi144.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterNotExist PASSED 2024-06-04T16:15:55.685 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:15:55.686 INFO:teuthology.orchestra.run.smithi144.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterPercentage STARTED 2024-06-04T16:15:55.785 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:15:55.786 INFO:teuthology.orchestra.run.smithi144.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterPercentage PASSED 2024-06-04T16:15:55.985 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:15:55.986 INFO:teuthology.orchestra.run.smithi144.stdout:suite > Object tests > ObjectTest.testObjectListMarkerAfterList STARTED 2024-06-04T16:15:56.085 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:15:56.086 INFO:teuthology.orchestra.run.smithi144.stdout:suite > Object tests > ObjectTest.testObjectListMarkerAfterList PASSED 2024-06-04T16:15:56.286 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:15:56.286 INFO:teuthology.orchestra.run.smithi144.stdout:suite > Object tests > ObjectTest.testObjectListMarkerBeforeList STARTED 2024-06-04T16:15:56.286 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:15:56.286 INFO:teuthology.orchestra.run.smithi144.stdout:suite > Object tests > ObjectTest.testObjectListMarkerBeforeList PASSED 2024-06-04T16:15:56.586 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:15:56.586 INFO:teuthology.orchestra.run.smithi144.stdout:suite > Object tests > ObjectTest.testObjectListMarkerNotInList STARTED 2024-06-04T16:15:56.586 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:15:56.586 INFO:teuthology.orchestra.run.smithi144.stdout:suite > Object tests > ObjectTest.testObjectListMarkerNotInList PASSED 2024-06-04T16:15:56.785 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:15:56.785 INFO:teuthology.orchestra.run.smithi144.stdout:suite > Object tests > ObjectTest.testObjectListMarkerUnreadable STARTED 2024-06-04T16:15:56.885 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:15:56.885 INFO:teuthology.orchestra.run.smithi144.stdout:suite > Object tests > ObjectTest.testObjectListMarkerUnreadable PASSED 2024-06-04T16:15:57.085 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:15:57.086 INFO:teuthology.orchestra.run.smithi144.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysNegative STARTED 2024-06-04T16:15:57.185 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:15:57.186 INFO:teuthology.orchestra.run.smithi144.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysNegative PASSED 2024-06-04T16:15:57.386 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:15:57.386 INFO:teuthology.orchestra.run.smithi144.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysNone STARTED 2024-06-04T16:15:57.485 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:15:57.486 INFO:teuthology.orchestra.run.smithi144.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysNone PASSED 2024-06-04T16:15:57.685 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:15:57.686 INFO:teuthology.orchestra.run.smithi144.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysOne STARTED 2024-06-04T16:15:57.785 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:15:57.786 INFO:teuthology.orchestra.run.smithi144.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysOne PASSED 2024-06-04T16:15:57.986 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:15:58.057 INFO:teuthology.orchestra.run.smithi144.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysZero STARTED 2024-06-04T16:15:58.057 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:15:58.057 INFO:teuthology.orchestra.run.smithi144.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysZero PASSED 2024-06-04T16:15:58.185 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:15:58.186 INFO:teuthology.orchestra.run.smithi144.stdout:suite > Object tests > ObjectTest.testObjectListPrefixAlt STARTED 2024-06-04T16:15:58.286 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:15:58.286 INFO:teuthology.orchestra.run.smithi144.stdout:suite > Object tests > ObjectTest.testObjectListPrefixAlt PASSED 2024-06-04T16:15:58.486 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:15:58.486 INFO:teuthology.orchestra.run.smithi144.stdout:suite > Object tests > ObjectTest.testObjectListPrefixBasic STARTED 2024-06-04T16:15:58.585 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:15:58.586 INFO:teuthology.orchestra.run.smithi144.stdout:suite > Object tests > ObjectTest.testObjectListPrefixBasic PASSED 2024-06-04T16:15:58.785 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:15:58.786 INFO:teuthology.orchestra.run.smithi144.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterAlt STARTED 2024-06-04T16:15:58.885 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:15:58.886 INFO:teuthology.orchestra.run.smithi144.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterAlt PASSED 2024-06-04T16:15:59.085 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:15:59.086 INFO:teuthology.orchestra.run.smithi144.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterBasic STARTED 2024-06-04T16:15:59.186 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:15:59.186 INFO:teuthology.orchestra.run.smithi144.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterBasic PASSED 2024-06-04T16:15:59.386 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:15:59.386 INFO:teuthology.orchestra.run.smithi144.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterDelimiterNotExist STARTED 2024-06-04T16:15:59.386 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:15:59.386 INFO:teuthology.orchestra.run.smithi144.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterDelimiterNotExist PASSED 2024-06-04T16:15:59.585 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:15:59.586 INFO:teuthology.orchestra.run.smithi144.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterPrefixDelimiterNotExist STARTED 2024-06-04T16:15:59.685 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:15:59.686 INFO:teuthology.orchestra.run.smithi144.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterPrefixDelimiterNotExist PASSED 2024-06-04T16:15:59.885 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:15:59.885 INFO:teuthology.orchestra.run.smithi144.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterPrefixNotExist STARTED 2024-06-04T16:15:59.986 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:15:59.986 INFO:teuthology.orchestra.run.smithi144.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterPrefixNotExist PASSED 2024-06-04T16:16:00.185 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:16:00.186 INFO:teuthology.orchestra.run.smithi144.stdout:suite > Object tests > ObjectTest.testObjectListPrefixEmpty STARTED 2024-06-04T16:16:00.285 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:16:00.286 INFO:teuthology.orchestra.run.smithi144.stdout:suite > Object tests > ObjectTest.testObjectListPrefixEmpty PASSED 2024-06-04T16:16:00.485 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:16:00.486 INFO:teuthology.orchestra.run.smithi144.stdout:suite > Object tests > ObjectTest.testObjectListPrefixNone STARTED 2024-06-04T16:16:00.585 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:16:00.586 INFO:teuthology.orchestra.run.smithi144.stdout:suite > Object tests > ObjectTest.testObjectListPrefixNone PASSED 2024-06-04T16:16:00.786 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:16:00.786 INFO:teuthology.orchestra.run.smithi144.stdout:suite > Object tests > ObjectTest.testObjectListPrefixNotExist STARTED 2024-06-04T16:16:00.786 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:16:00.786 INFO:teuthology.orchestra.run.smithi144.stdout:suite > Object tests > ObjectTest.testObjectListPrefixNotExist PASSED 2024-06-04T16:16:00.985 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:16:00.985 INFO:teuthology.orchestra.run.smithi144.stdout:suite > Object tests > ObjectTest.testObjectListPrefixUnreadable STARTED 2024-06-04T16:16:01.086 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:16:01.086 INFO:teuthology.orchestra.run.smithi144.stdout:suite > Object tests > ObjectTest.testObjectListPrefixUnreadable PASSED 2024-06-04T16:16:01.285 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:16:01.285 INFO:teuthology.orchestra.run.smithi144.stdout:suite > Object tests > ObjectTest.testObjectReadFromNonExistantBucket STARTED 2024-06-04T16:16:01.385 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:16:01.385 INFO:teuthology.orchestra.run.smithi144.stdout:suite > Object tests > ObjectTest.testObjectReadFromNonExistantBucket PASSED 2024-06-04T16:16:01.586 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:16:01.586 INFO:teuthology.orchestra.run.smithi144.stdout:suite > Object tests > ObjectTest.testObjectReadNotExist STARTED 2024-06-04T16:16:01.586 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:16:01.586 INFO:teuthology.orchestra.run.smithi144.stdout:suite > Object tests > ObjectTest.testObjectReadNotExist PASSED 2024-06-04T16:16:01.786 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:16:01.786 INFO:teuthology.orchestra.run.smithi144.stdout:suite > Object tests > ObjectTest.testObjectWriteCacheControl STARTED 2024-06-04T16:16:01.885 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:16:01.886 INFO:teuthology.orchestra.run.smithi144.stdout:suite > Object tests > ObjectTest.testObjectWriteCacheControl PASSED 2024-06-04T16:16:02.086 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:16:02.086 INFO:teuthology.orchestra.run.smithi144.stdout:suite > Object tests > ObjectTest.testObjectWriteCheckEtag STARTED 2024-06-04T16:16:02.086 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:16:02.086 INFO:teuthology.orchestra.run.smithi144.stdout:suite > Object tests > ObjectTest.testObjectWriteCheckEtag PASSED 2024-06-04T16:16:02.386 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:16:02.386 INFO:teuthology.orchestra.run.smithi144.stdout:suite > Object tests > ObjectTest.testObjectWriteReadUpdateReadDelete STARTED 2024-06-04T16:16:02.486 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:16:02.486 INFO:teuthology.orchestra.run.smithi144.stdout:suite > Object tests > ObjectTest.testObjectWriteReadUpdateReadDelete PASSED 2024-06-04T16:16:02.686 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:16:02.686 INFO:teuthology.orchestra.run.smithi144.stdout:suite > Object tests > ObjectTest.testObjectWriteToNonExistantBucket STARTED 2024-06-04T16:16:02.686 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:16:02.686 INFO:teuthology.orchestra.run.smithi144.stdout:suite > Object tests > ObjectTest.testObjectWriteToNonExistantBucket PASSED 2024-06-04T16:16:02.785 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:16:02.786 INFO:teuthology.orchestra.run.smithi144.stdout:suite > Object tests > ObjectTest.testRangedSkipLeadingBytesResponseCode STARTED 2024-06-04T16:16:02.886 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:16:02.886 INFO:teuthology.orchestra.run.smithi144.stdout:suite > Object tests > ObjectTest.testRangedSkipLeadingBytesResponseCode PASSED 2024-06-04T16:16:03.086 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:16:03.086 INFO:teuthology.orchestra.run.smithi144.stdout:suite > Object tests > ObjectTest.testRangedrequestResponseCode STARTED 2024-06-04T16:16:03.186 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:16:03.186 INFO:teuthology.orchestra.run.smithi144.stdout:suite > Object tests > ObjectTest.testRangedrequestResponseCode PASSED 2024-06-04T16:16:03.385 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:16:03.386 INFO:teuthology.orchestra.run.smithi144.stdout:suite > Object tests > ObjectTest.testSSEKMSNoKey STARTED 2024-06-04T16:16:03.485 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:16:03.486 INFO:teuthology.orchestra.run.smithi144.stdout:suite > Object tests > ObjectTest.testSSEKMSNoKey PASSED 2024-06-04T16:16:03.686 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:16:03.686 INFO:teuthology.orchestra.run.smithi144.stdout:suite > Object tests > ObjectTest.testSSEKMSNotDeclared STARTED 2024-06-04T16:16:03.686 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:16:03.686 INFO:teuthology.orchestra.run.smithi144.stdout:suite > Object tests > ObjectTest.testSSEKMSNotDeclared PASSED 2024-06-04T16:16:03.885 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:16:03.886 INFO:teuthology.orchestra.run.smithi144.stdout:suite > Object tests > ObjectTest.testUploadFileHLAPIBigFile STARTED 2024-06-04T16:16:04.186 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:16:04.186 INFO:teuthology.orchestra.run.smithi144.stdout:suite > Object tests > ObjectTest.testUploadFileHLAPIBigFile PASSED 2024-06-04T16:16:04.386 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:16:04.386 INFO:teuthology.orchestra.run.smithi144.stdout:suite > Object tests > ObjectTest.testUploadFileList STARTED 2024-06-04T16:16:04.786 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:16:04.786 INFO:teuthology.orchestra.run.smithi144.stdout:suite > Object tests > ObjectTest.testUploadFileList PASSED 2024-06-04T16:16:04.952 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:16:04.952 INFO:teuthology.orchestra.run.smithi144.stdout:---------------------------------------------------------------------- 2024-06-04T16:16:04.952 INFO:teuthology.orchestra.run.smithi144.stdout:| Results: SUCCESS (70 tests, 70 successes, 0 failures, 0 skipped) | 2024-06-04T16:16:04.953 INFO:teuthology.orchestra.run.smithi144.stdout:---------------------------------------------------------------------- 2024-06-04T16:16:04.953 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:16:04.953 INFO:teuthology.orchestra.run.smithi144.stdout:Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. 2024-06-04T16:16:04.953 INFO:teuthology.orchestra.run.smithi144.stdout:Use '--warning-mode all' to show the individual deprecation warnings. 2024-06-04T16:16:04.953 INFO:teuthology.orchestra.run.smithi144.stdout:See https://docs.gradle.org/6.0.1/userguide/command_line_interface.html#sec:command_line_warnings 2024-06-04T16:16:04.953 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:16:04.954 INFO:teuthology.orchestra.run.smithi144.stdout:BUILD SUCCESSFUL in 33s 2024-06-04T16:16:04.954 INFO:teuthology.orchestra.run.smithi144.stdout:5 actionable tasks: 5 executed 2024-06-04T16:16:04.965 DEBUG:teuthology.orchestra.run.smithi144:> radosgw-admin gc process --include-all 2024-06-04T16:16:05.017 INFO:teuthology.orchestra.run.smithi144.stderr:ignoring --setuser ceph since I am not root 2024-06-04T16:16:05.018 INFO:teuthology.orchestra.run.smithi144.stderr:ignoring --setgroup ceph since I am not root 2024-06-04T16:16:05.054 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.053+0000 7fa614733800 20 rados->read ofs=0 len=0 2024-06-04T16:16:05.056 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.054+0000 7fa614733800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:16:05.056 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.054+0000 7fa614733800 20 realm 2024-06-04T16:16:05.056 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.055+0000 7fa614733800 20 rados->read ofs=0 len=0 2024-06-04T16:16:05.056 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.055+0000 7fa614733800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:16:05.056 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.055+0000 7fa614733800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-06-04T16:16:05.056 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.055+0000 7fa614733800 20 rados->read ofs=0 len=0 2024-06-04T16:16:05.056 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.055+0000 7fa614733800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:16:05.056 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.055+0000 7fa614733800 20 rados->read ofs=0 len=0 2024-06-04T16:16:05.057 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.056+0000 7fa614733800 20 rados_obj.operate() r=0 bl.length=46 2024-06-04T16:16:05.057 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.056+0000 7fa614733800 20 rados->read ofs=0 len=0 2024-06-04T16:16:05.057 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.056+0000 7fa614733800 20 rados_obj.operate() r=0 bl.length=1139 2024-06-04T16:16:05.057 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.056+0000 7fa614733800 20 searching for the correct realm 2024-06-04T16:16:05.059 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.058+0000 7fa607fff640 0 -- 172.21.15.144:0/3782509069 >> [v2:172.21.15.144:6816/2358575268,v1:172.21.15.144:6817/2358575268] conn(0x558ef0fa3390 msgr2=0x558ef0fa57c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-06-04T16:16:05.062 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.061+0000 7fa610bc8640 0 -- 172.21.15.144:0/3782509069 >> [v2:172.21.15.144:6800/1453747520,v1:172.21.15.144:6801/1453747520] conn(0x558ef0fa3390 msgr2=0x7fa4d808a240 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-06-04T16:16:05.068 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.067+0000 7fa614733800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-06-04T16:16:05.068 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.067+0000 7fa614733800 20 RGWRados::pool_iterate: got zone_info.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767 2024-06-04T16:16:05.068 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.067+0000 7fa614733800 20 RGWRados::pool_iterate: got default.zone. 2024-06-04T16:16:05.068 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.067+0000 7fa614733800 20 RGWRados::pool_iterate: got zonegroup_info.abb22408-c332-4e28-8f7a-ff254ea2fed2 2024-06-04T16:16:05.068 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.067+0000 7fa614733800 20 RGWRados::pool_iterate: got zone_names.default 2024-06-04T16:16:05.068 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.067+0000 7fa614733800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-06-04T16:16:05.069 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.067+0000 7fa614733800 20 rados->read ofs=0 len=0 2024-06-04T16:16:05.069 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.067+0000 7fa614733800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:16:05.069 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.067+0000 7fa614733800 20 rados->read ofs=0 len=0 2024-06-04T16:16:05.069 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.067+0000 7fa614733800 20 rados_obj.operate() r=0 bl.length=46 2024-06-04T16:16:05.069 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.067+0000 7fa614733800 20 rados->read ofs=0 len=0 2024-06-04T16:16:05.070 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.068+0000 7fa614733800 20 rados_obj.operate() r=0 bl.length=470 2024-06-04T16:16:05.070 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.068+0000 7fa614733800 20 zone default found 2024-06-04T16:16:05.070 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.068+0000 7fa614733800 4 Realm: () 2024-06-04T16:16:05.070 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.068+0000 7fa614733800 4 ZoneGroup: default (abb22408-c332-4e28-8f7a-ff254ea2fed2) 2024-06-04T16:16:05.070 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.068+0000 7fa614733800 4 Zone: default (be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767) 2024-06-04T16:16:05.070 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.068+0000 7fa614733800 10 cannot find current period zonegroup using local zonegroup configuration 2024-06-04T16:16:05.070 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.068+0000 7fa614733800 20 zonegroup default 2024-06-04T16:16:05.071 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.068+0000 7fa614733800 20 rados->read ofs=0 len=0 2024-06-04T16:16:05.071 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.068+0000 7fa614733800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:16:05.071 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.068+0000 7fa614733800 20 rados->read ofs=0 len=0 2024-06-04T16:16:05.071 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.068+0000 7fa614733800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:16:05.071 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.068+0000 7fa614733800 20 rados->read ofs=0 len=0 2024-06-04T16:16:05.071 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.068+0000 7fa614733800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:16:05.071 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.068+0000 7fa614733800 20 started sync module instance, tier type = 2024-06-04T16:16:05.071 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.068+0000 7fa614733800 20 started zone id=be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767 (name=default) with tier type = 2024-06-04T16:16:05.078 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.077+0000 7fa614733800 20 add_watcher() i=0 2024-06-04T16:16:05.078 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.077+0000 7fa614733800 20 add_watcher() i=1 2024-06-04T16:16:05.078 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.077+0000 7fa614733800 20 add_watcher() i=2 2024-06-04T16:16:05.078 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.077+0000 7fa614733800 20 add_watcher() i=3 2024-06-04T16:16:05.078 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.077+0000 7fa614733800 20 add_watcher() i=4 2024-06-04T16:16:05.078 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.077+0000 7fa614733800 20 add_watcher() i=5 2024-06-04T16:16:05.078 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.077+0000 7fa614733800 20 add_watcher() i=6 2024-06-04T16:16:05.079 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.078+0000 7fa614733800 20 add_watcher() i=7 2024-06-04T16:16:05.079 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.078+0000 7fa614733800 2 all 8 watchers are set, enabling cache 2024-06-04T16:16:05.080 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.079+0000 7fa4c6fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-06-04T16:16:05.080 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.080+0000 7fa614733800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-06-04T16:16:05.080 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.080+0000 7fa614733800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-06-04T16:16:05.115 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.114+0000 7fa4c5fdb640 20 reqs_thread_entry: start 2024-06-04T16:16:05.116 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.114+0000 7fa614733800 20 init_complete bucket index max shards: 11 2024-06-04T16:16:05.116 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.114+0000 7fa614733800 20 Filter name: none 2024-06-04T16:16:05.116 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.114+0000 7fa4377fe640 20 reqs_thread_entry: start 2024-06-04T16:16:05.116 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.115+0000 7fa614733800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-06-04T16:16:05.117 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.116+0000 7fa614733800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:16:05.117 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.116+0000 7fa614733800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:16:05.118 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.117+0000 7fa614733800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-06-04T16:16:05.118 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.117+0000 7fa614733800 20 garbage collection: RGWGC::process iterating over entry tag='be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.15380570739006980264', time=2024-06-04T18:15:46.839930+0000, chain.objs.size()=9 2024-06-04T16:16:05.118 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.117+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.89__multipart_file2.mpg.2~vGOqlaTemlnzKLrUyejqC7xAWZRfobG.1 2024-06-04T16:16:05.119 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.117+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.89__shadow_file2.mpg.2~vGOqlaTemlnzKLrUyejqC7xAWZRfobG.1_1 2024-06-04T16:16:05.119 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.117+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.89__multipart_file2.mpg.2~vGOqlaTemlnzKLrUyejqC7xAWZRfobG.2 2024-06-04T16:16:05.119 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.117+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.89__shadow_file2.mpg.2~vGOqlaTemlnzKLrUyejqC7xAWZRfobG.2_1 2024-06-04T16:16:05.119 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.117+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.89__multipart_file2.mpg.2~vGOqlaTemlnzKLrUyejqC7xAWZRfobG.3 2024-06-04T16:16:05.119 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.117+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.89__shadow_file2.mpg.2~vGOqlaTemlnzKLrUyejqC7xAWZRfobG.3_1 2024-06-04T16:16:05.119 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.117+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.89__multipart_file2.mpg.2~vGOqlaTemlnzKLrUyejqC7xAWZRfobG.4 2024-06-04T16:16:05.119 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.117+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.89__shadow_file2.mpg.2~vGOqlaTemlnzKLrUyejqC7xAWZRfobG.4_1 2024-06-04T16:16:05.119 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.117+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.89__multipart_file2.mpg.2~vGOqlaTemlnzKLrUyejqC7xAWZRfobG.5 2024-06-04T16:16:05.122 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.121+0000 7fa614733800 5 garbage collection: RGWGC::process removing entries, marker: 2024-06-04T16:16:05.124 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.123+0000 7fa614733800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-06-04T16:16:05.125 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.125+0000 7fa614733800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:16:05.126 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.125+0000 7fa614733800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:16:05.127 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.126+0000 7fa614733800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-06-04T16:16:05.127 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.126+0000 7fa614733800 20 garbage collection: RGWGC::process iterating over entry tag='be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.8894718803732706497', time=2024-06-04T18:15:46.830606+0000, chain.objs.size()=9 2024-06-04T16:16:05.127 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.126+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.89__multipart_file.mpg.2~PmkKFQf2vYK1_q5gVoFixOXj2EyWRyB.1 2024-06-04T16:16:05.127 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.126+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.89__shadow_file.mpg.2~PmkKFQf2vYK1_q5gVoFixOXj2EyWRyB.1_1 2024-06-04T16:16:05.128 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.126+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.89__multipart_file.mpg.2~PmkKFQf2vYK1_q5gVoFixOXj2EyWRyB.2 2024-06-04T16:16:05.128 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.126+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.89__shadow_file.mpg.2~PmkKFQf2vYK1_q5gVoFixOXj2EyWRyB.2_1 2024-06-04T16:16:05.128 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.126+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.89__multipart_file.mpg.2~PmkKFQf2vYK1_q5gVoFixOXj2EyWRyB.3 2024-06-04T16:16:05.128 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.126+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.89__shadow_file.mpg.2~PmkKFQf2vYK1_q5gVoFixOXj2EyWRyB.3_1 2024-06-04T16:16:05.129 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.126+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.89__multipart_file.mpg.2~PmkKFQf2vYK1_q5gVoFixOXj2EyWRyB.4 2024-06-04T16:16:05.129 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.126+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.89__shadow_file.mpg.2~PmkKFQf2vYK1_q5gVoFixOXj2EyWRyB.4_1 2024-06-04T16:16:05.129 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.126+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.89__multipart_file.mpg.2~PmkKFQf2vYK1_q5gVoFixOXj2EyWRyB.5 2024-06-04T16:16:05.130 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.126+0000 7fa614733800 20 garbage collection: RGWGC::process iterating over entry tag='be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1325644665939053255', time=2024-06-04T18:16:04.774655+0000, chain.objs.size()=9 2024-06-04T16:16:05.130 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.126+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.133__multipart_key1/data/file.mpg.2~xOX6Kv9RKqZYcBKA_YA9NbnnyyxYkfn.1 2024-06-04T16:16:05.130 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.126+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.133__shadow_key1/data/file.mpg.2~xOX6Kv9RKqZYcBKA_YA9NbnnyyxYkfn.1_1 2024-06-04T16:16:05.130 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.126+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.133__multipart_key1/data/file.mpg.2~xOX6Kv9RKqZYcBKA_YA9NbnnyyxYkfn.2 2024-06-04T16:16:05.132 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.130+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.133__shadow_key1/data/file.mpg.2~xOX6Kv9RKqZYcBKA_YA9NbnnyyxYkfn.2_1 2024-06-04T16:16:05.132 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.130+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.133__multipart_key1/data/file.mpg.2~xOX6Kv9RKqZYcBKA_YA9NbnnyyxYkfn.3 2024-06-04T16:16:05.132 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.131+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.133__shadow_key1/data/file.mpg.2~xOX6Kv9RKqZYcBKA_YA9NbnnyyxYkfn.3_1 2024-06-04T16:16:05.132 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.131+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.133__multipart_key1/data/file.mpg.2~xOX6Kv9RKqZYcBKA_YA9NbnnyyxYkfn.4 2024-06-04T16:16:05.132 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.131+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.133__shadow_key1/data/file.mpg.2~xOX6Kv9RKqZYcBKA_YA9NbnnyyxYkfn.4_1 2024-06-04T16:16:05.132 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.131+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.133__multipart_key1/data/file.mpg.2~xOX6Kv9RKqZYcBKA_YA9NbnnyyxYkfn.5 2024-06-04T16:16:05.135 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.134+0000 7fa614733800 5 garbage collection: RGWGC::process removing entries, marker: 2024-06-04T16:16:05.138 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.137+0000 7fa614733800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-06-04T16:16:05.139 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.138+0000 7fa614733800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:16:05.139 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.139+0000 7fa614733800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:16:05.141 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.139+0000 7fa614733800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-06-04T16:16:05.141 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.139+0000 7fa614733800 20 garbage collection: RGWGC::process iterating over entry tag='be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.14546321765354481841', time=2024-06-04T18:15:52.551396+0000, chain.objs.size()=9 2024-06-04T16:16:05.141 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.139+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.93__multipart_key1.2~yJOOw4Vmu6v6-Kft9Sq1QUub1uIpSsD.1 2024-06-04T16:16:05.141 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.139+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.93__shadow_key1.2~yJOOw4Vmu6v6-Kft9Sq1QUub1uIpSsD.1_1 2024-06-04T16:16:05.141 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.139+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.93__multipart_key1.2~yJOOw4Vmu6v6-Kft9Sq1QUub1uIpSsD.2 2024-06-04T16:16:05.141 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.139+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.93__shadow_key1.2~yJOOw4Vmu6v6-Kft9Sq1QUub1uIpSsD.2_1 2024-06-04T16:16:05.141 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.139+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.93__multipart_key1.2~yJOOw4Vmu6v6-Kft9Sq1QUub1uIpSsD.3 2024-06-04T16:16:05.141 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.139+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.93__shadow_key1.2~yJOOw4Vmu6v6-Kft9Sq1QUub1uIpSsD.3_1 2024-06-04T16:16:05.141 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.139+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.93__multipart_key1.2~yJOOw4Vmu6v6-Kft9Sq1QUub1uIpSsD.4 2024-06-04T16:16:05.141 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.139+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.93__shadow_key1.2~yJOOw4Vmu6v6-Kft9Sq1QUub1uIpSsD.4_1 2024-06-04T16:16:05.141 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.139+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.93__multipart_key1.2~yJOOw4Vmu6v6-Kft9Sq1QUub1uIpSsD.5 2024-06-04T16:16:05.142 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.139+0000 7fa614733800 20 garbage collection: RGWGC::process iterating over entry tag='be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.15785176385900462650', time=2024-06-04T18:16:04.239474+0000, chain.objs.size()=9 2024-06-04T16:16:05.142 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.139+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.132__multipart_key1.2~RbAsPjblpMGV0mDwHlTMG-3oiABUMNw.1 2024-06-04T16:16:05.142 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.139+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.132__shadow_key1.2~RbAsPjblpMGV0mDwHlTMG-3oiABUMNw.1_1 2024-06-04T16:16:05.142 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.139+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.132__multipart_key1.2~RbAsPjblpMGV0mDwHlTMG-3oiABUMNw.2 2024-06-04T16:16:05.145 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.144+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.132__shadow_key1.2~RbAsPjblpMGV0mDwHlTMG-3oiABUMNw.2_1 2024-06-04T16:16:05.145 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.144+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.132__multipart_key1.2~RbAsPjblpMGV0mDwHlTMG-3oiABUMNw.3 2024-06-04T16:16:05.145 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.144+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.132__shadow_key1.2~RbAsPjblpMGV0mDwHlTMG-3oiABUMNw.3_1 2024-06-04T16:16:05.145 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.144+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.132__multipart_key1.2~RbAsPjblpMGV0mDwHlTMG-3oiABUMNw.4 2024-06-04T16:16:05.145 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.144+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.132__shadow_key1.2~RbAsPjblpMGV0mDwHlTMG-3oiABUMNw.4_1 2024-06-04T16:16:05.145 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.144+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.132__multipart_key1.2~RbAsPjblpMGV0mDwHlTMG-3oiABUMNw.5 2024-06-04T16:16:05.148 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.147+0000 7fa614733800 5 garbage collection: RGWGC::process removing entries, marker: 2024-06-04T16:16:05.150 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.150+0000 7fa614733800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-06-04T16:16:05.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.151+0000 7fa614733800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:16:05.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.151+0000 7fa614733800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:16:05.153 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.152+0000 7fa614733800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-06-04T16:16:05.153 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.152+0000 7fa614733800 20 garbage collection: RGWGC::process iterating over entry tag='be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.80__shadow_key1.2~iPDJxRv5N-wQypS3UYxs4ArO2bzJOaz.1_1_2409ebbb2d1b6b2d1993fbe450f75fd9', time=2024-06-04T18:15:40.512858+0000, chain.objs.size()=9 2024-06-04T16:16:05.153 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.152+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.80__multipart_key1.2~iPDJxRv5N-wQypS3UYxs4ArO2bzJOaz.1 2024-06-04T16:16:05.153 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.152+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.80__shadow_key1.2~iPDJxRv5N-wQypS3UYxs4ArO2bzJOaz.1_1 2024-06-04T16:16:05.153 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.152+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.80__multipart_key1.2~iPDJxRv5N-wQypS3UYxs4ArO2bzJOaz.2 2024-06-04T16:16:05.153 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.152+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.80__shadow_key1.2~iPDJxRv5N-wQypS3UYxs4ArO2bzJOaz.2_1 2024-06-04T16:16:05.153 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.152+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.80__multipart_key1.2~iPDJxRv5N-wQypS3UYxs4ArO2bzJOaz.3 2024-06-04T16:16:05.153 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.152+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.80__shadow_key1.2~iPDJxRv5N-wQypS3UYxs4ArO2bzJOaz.3_1 2024-06-04T16:16:05.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.152+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.80__multipart_key1.2~iPDJxRv5N-wQypS3UYxs4ArO2bzJOaz.4 2024-06-04T16:16:05.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.152+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.80__shadow_key1.2~iPDJxRv5N-wQypS3UYxs4ArO2bzJOaz.4_1 2024-06-04T16:16:05.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.152+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.80__multipart_key1.2~iPDJxRv5N-wQypS3UYxs4ArO2bzJOaz.5 2024-06-04T16:16:05.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.156+0000 7fa614733800 5 garbage collection: RGWGC::process removing entries, marker: 2024-06-04T16:16:05.159 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.159+0000 7fa614733800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-06-04T16:16:05.161 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.160+0000 7fa614733800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:16:05.161 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.160+0000 7fa614733800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:16:05.161 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.161+0000 7fa614733800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:16:05.162 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.161+0000 7fa614733800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-06-04T16:16:05.163 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.163+0000 7fa614733800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:16:05.164 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.163+0000 7fa614733800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:16:05.164 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.163+0000 7fa614733800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:16:05.165 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.164+0000 7fa614733800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-06-04T16:16:05.166 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.166+0000 7fa614733800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:16:05.168 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.166+0000 7fa614733800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:16:05.168 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.166+0000 7fa614733800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-06-04T16:16:05.168 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.166+0000 7fa614733800 20 garbage collection: RGWGC::process iterating over entry tag='be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.3138617145053785373', time=2024-06-04T18:15:49.182292+0000, chain.objs.size()=9 2024-06-04T16:16:05.168 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.166+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.91__multipart_key1.2~pK_Jxd02Y6LZO62fDScu2ViW-c_L1dO.1 2024-06-04T16:16:05.168 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.166+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.91__shadow_key1.2~pK_Jxd02Y6LZO62fDScu2ViW-c_L1dO.1_1 2024-06-04T16:16:05.168 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.166+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.91__multipart_key1.2~pK_Jxd02Y6LZO62fDScu2ViW-c_L1dO.2 2024-06-04T16:16:05.168 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.166+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.91__shadow_key1.2~pK_Jxd02Y6LZO62fDScu2ViW-c_L1dO.2_1 2024-06-04T16:16:05.168 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.166+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.91__multipart_key1.2~pK_Jxd02Y6LZO62fDScu2ViW-c_L1dO.3 2024-06-04T16:16:05.168 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.166+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.91__shadow_key1.2~pK_Jxd02Y6LZO62fDScu2ViW-c_L1dO.3_1 2024-06-04T16:16:05.168 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.166+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.91__multipart_key1.2~pK_Jxd02Y6LZO62fDScu2ViW-c_L1dO.4 2024-06-04T16:16:05.169 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.166+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.91__shadow_key1.2~pK_Jxd02Y6LZO62fDScu2ViW-c_L1dO.4_1 2024-06-04T16:16:05.169 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.166+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.91__multipart_key1.2~pK_Jxd02Y6LZO62fDScu2ViW-c_L1dO.5 2024-06-04T16:16:05.171 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.170+0000 7fa614733800 5 garbage collection: RGWGC::process removing entries, marker: 2024-06-04T16:16:05.173 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.172+0000 7fa614733800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-06-04T16:16:05.174 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.174+0000 7fa614733800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:16:05.175 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.174+0000 7fa614733800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:16:05.175 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.175+0000 7fa614733800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:16:05.176 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.175+0000 7fa614733800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-06-04T16:16:05.177 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.177+0000 7fa614733800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:16:05.178 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.177+0000 7fa614733800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:16:05.179 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.177+0000 7fa614733800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-06-04T16:16:05.179 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.177+0000 7fa614733800 20 garbage collection: RGWGC::process iterating over entry tag='be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.17936143508210974177', time=2024-06-04T18:15:43.022861+0000, chain.objs.size()=9 2024-06-04T16:16:05.179 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.178+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.83__multipart_key1.2~mJEXOMTB5v6GBCL-mYcVunxvl8sI3JJ.1 2024-06-04T16:16:05.179 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.178+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.83__shadow_key1.2~mJEXOMTB5v6GBCL-mYcVunxvl8sI3JJ.1_1 2024-06-04T16:16:05.180 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.178+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.83__multipart_key1.2~mJEXOMTB5v6GBCL-mYcVunxvl8sI3JJ.2 2024-06-04T16:16:05.180 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.178+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.83__shadow_key1.2~mJEXOMTB5v6GBCL-mYcVunxvl8sI3JJ.2_1 2024-06-04T16:16:05.180 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.178+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.83__multipart_key1.2~mJEXOMTB5v6GBCL-mYcVunxvl8sI3JJ.3 2024-06-04T16:16:05.180 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.178+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.83__shadow_key1.2~mJEXOMTB5v6GBCL-mYcVunxvl8sI3JJ.3_1 2024-06-04T16:16:05.180 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.178+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.83__multipart_key1.2~mJEXOMTB5v6GBCL-mYcVunxvl8sI3JJ.4 2024-06-04T16:16:05.180 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.178+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.83__shadow_key1.2~mJEXOMTB5v6GBCL-mYcVunxvl8sI3JJ.4_1 2024-06-04T16:16:05.180 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.178+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.83__multipart_key1.2~mJEXOMTB5v6GBCL-mYcVunxvl8sI3JJ.5 2024-06-04T16:16:05.180 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.178+0000 7fa614733800 20 garbage collection: RGWGC::process iterating over entry tag='be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.15409067011302314759', time=2024-06-04T18:15:45.250576+0000, chain.objs.size()=9 2024-06-04T16:16:05.180 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.178+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.87__multipart_key1.2~JNkmfIWF4o59pSY3y5D1oeg7Fv-q_k1.1 2024-06-04T16:16:05.180 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.178+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.87__shadow_key1.2~JNkmfIWF4o59pSY3y5D1oeg7Fv-q_k1.1_1 2024-06-04T16:16:05.180 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.178+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.87__multipart_key1.2~JNkmfIWF4o59pSY3y5D1oeg7Fv-q_k1.2 2024-06-04T16:16:05.182 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.181+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.87__shadow_key1.2~JNkmfIWF4o59pSY3y5D1oeg7Fv-q_k1.2_1 2024-06-04T16:16:05.182 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.181+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.87__multipart_key1.2~JNkmfIWF4o59pSY3y5D1oeg7Fv-q_k1.3 2024-06-04T16:16:05.183 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.182+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.87__shadow_key1.2~JNkmfIWF4o59pSY3y5D1oeg7Fv-q_k1.3_1 2024-06-04T16:16:05.183 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.182+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.87__multipart_key1.2~JNkmfIWF4o59pSY3y5D1oeg7Fv-q_k1.4 2024-06-04T16:16:05.183 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.182+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.87__shadow_key1.2~JNkmfIWF4o59pSY3y5D1oeg7Fv-q_k1.4_1 2024-06-04T16:16:05.184 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.182+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.87__multipart_key1.2~JNkmfIWF4o59pSY3y5D1oeg7Fv-q_k1.5 2024-06-04T16:16:05.184 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.182+0000 7fa614733800 20 garbage collection: RGWGC::process iterating over entry tag='be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.17335851581256875277', time=2024-06-04T18:15:50.840868+0000, chain.objs.size()=7 2024-06-04T16:16:05.184 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.182+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.91__multipart_key1.2~CSK-N7S3yW2muIj8Ia5m52nq3bY9P6l.1 2024-06-04T16:16:05.184 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.183+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.91__shadow_key1.2~CSK-N7S3yW2muIj8Ia5m52nq3bY9P6l.1_1 2024-06-04T16:16:05.184 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.183+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.91__shadow_key1.2~CSK-N7S3yW2muIj8Ia5m52nq3bY9P6l.1_2 2024-06-04T16:16:05.185 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.184+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.91__multipart_key1.2~CSK-N7S3yW2muIj8Ia5m52nq3bY9P6l.2 2024-06-04T16:16:05.185 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.184+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.91__shadow_key1.2~CSK-N7S3yW2muIj8Ia5m52nq3bY9P6l.2_1 2024-06-04T16:16:05.186 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.185+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.91__shadow_key1.2~CSK-N7S3yW2muIj8Ia5m52nq3bY9P6l.2_2 2024-06-04T16:16:05.188 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.188+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.91__multipart_key1.2~CSK-N7S3yW2muIj8Ia5m52nq3bY9P6l.3 2024-06-04T16:16:05.191 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.190+0000 7fa614733800 5 garbage collection: RGWGC::process removing entries, marker: 2024-06-04T16:16:05.193 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.192+0000 7fa614733800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-06-04T16:16:05.194 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.194+0000 7fa614733800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:16:05.195 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.194+0000 7fa614733800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:16:05.195 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.194+0000 7fa614733800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:16:05.196 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.195+0000 7fa614733800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-06-04T16:16:05.197 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.197+0000 7fa614733800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:16:05.198 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.197+0000 7fa614733800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:16:05.199 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.197+0000 7fa614733800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-06-04T16:16:05.199 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.197+0000 7fa614733800 20 garbage collection: RGWGC::process iterating over entry tag='2~nXX_hyk-fzWe1kefLRM3X1PXvQ-f7Tf', time=2024-06-04T18:15:47.499418+0000, chain.objs.size()=9 2024-06-04T16:16:05.199 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.197+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.90__multipart_key1.2~nXX_hyk-fzWe1kefLRM3X1PXvQ-f7Tf.7 2024-06-04T16:16:05.199 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.197+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.90__shadow_key1.2~nXX_hyk-fzWe1kefLRM3X1PXvQ-f7Tf.7_1 2024-06-04T16:16:05.199 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.197+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.90__multipart_key1.2~nXX_hyk-fzWe1kefLRM3X1PXvQ-f7Tf.8 2024-06-04T16:16:05.199 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.197+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.90__shadow_key1.2~nXX_hyk-fzWe1kefLRM3X1PXvQ-f7Tf.8_1 2024-06-04T16:16:05.199 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.197+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.90__multipart_key1.2~nXX_hyk-fzWe1kefLRM3X1PXvQ-f7Tf.9 2024-06-04T16:16:05.199 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.197+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.90__shadow_key1.2~nXX_hyk-fzWe1kefLRM3X1PXvQ-f7Tf.9_1 2024-06-04T16:16:05.199 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.197+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.90__multipart_key1.2~nXX_hyk-fzWe1kefLRM3X1PXvQ-f7Tf.10 2024-06-04T16:16:05.200 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.197+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.90__shadow_key1.2~nXX_hyk-fzWe1kefLRM3X1PXvQ-f7Tf.10_1 2024-06-04T16:16:05.200 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.197+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.90__multipart_key1.2~nXX_hyk-fzWe1kefLRM3X1PXvQ-f7Tf.11 2024-06-04T16:16:05.204 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.202+0000 7fa614733800 5 garbage collection: RGWGC::process removing entries, marker: 2024-06-04T16:16:05.205 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.204+0000 7fa614733800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-06-04T16:16:05.206 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.206+0000 7fa614733800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:16:05.207 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.206+0000 7fa614733800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:16:05.208 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.206+0000 7fa614733800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-06-04T16:16:05.208 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.206+0000 7fa614733800 20 garbage collection: RGWGC::process iterating over entry tag='be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.14674962327495661882', time=2024-06-04T18:15:51.924290+0000, chain.objs.size()=9 2024-06-04T16:16:05.208 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.206+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.92__multipart_key1.2~ghaguE1PcATfgWJ4qNd-1V-aSqVftv_.1 2024-06-04T16:16:05.208 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.206+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.92__shadow_key1.2~ghaguE1PcATfgWJ4qNd-1V-aSqVftv_.1_1 2024-06-04T16:16:05.208 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.206+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.92__multipart_key1.2~ghaguE1PcATfgWJ4qNd-1V-aSqVftv_.2 2024-06-04T16:16:05.208 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.206+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.92__shadow_key1.2~ghaguE1PcATfgWJ4qNd-1V-aSqVftv_.2_1 2024-06-04T16:16:05.209 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.206+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.92__multipart_key1.2~ghaguE1PcATfgWJ4qNd-1V-aSqVftv_.3 2024-06-04T16:16:05.209 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.206+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.92__shadow_key1.2~ghaguE1PcATfgWJ4qNd-1V-aSqVftv_.3_1 2024-06-04T16:16:05.209 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.206+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.92__multipart_key1.2~ghaguE1PcATfgWJ4qNd-1V-aSqVftv_.4 2024-06-04T16:16:05.209 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.206+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.92__shadow_key1.2~ghaguE1PcATfgWJ4qNd-1V-aSqVftv_.4_1 2024-06-04T16:16:05.209 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.206+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.92__multipart_key1.2~ghaguE1PcATfgWJ4qNd-1V-aSqVftv_.5 2024-06-04T16:16:05.212 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.211+0000 7fa614733800 5 garbage collection: RGWGC::process removing entries, marker: 2024-06-04T16:16:05.214 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.213+0000 7fa614733800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-06-04T16:16:05.215 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.214+0000 7fa614733800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:16:05.216 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.215+0000 7fa614733800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:16:05.216 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.215+0000 7fa614733800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-06-04T16:16:05.217 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.215+0000 7fa614733800 20 garbage collection: RGWGC::process iterating over entry tag='be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.14668479674320305603', time=2024-06-04T18:15:48.299756+0000, chain.objs.size()=9 2024-06-04T16:16:05.217 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.215+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.91__multipart_key1.2~tTzxtFGKBLVl0x6VEdF4gl1R6a4BP_Q.1 2024-06-04T16:16:05.217 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.215+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.91__shadow_key1.2~tTzxtFGKBLVl0x6VEdF4gl1R6a4BP_Q.1_1 2024-06-04T16:16:05.217 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.215+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.91__multipart_key1.2~tTzxtFGKBLVl0x6VEdF4gl1R6a4BP_Q.2 2024-06-04T16:16:05.217 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.215+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.91__shadow_key1.2~tTzxtFGKBLVl0x6VEdF4gl1R6a4BP_Q.2_1 2024-06-04T16:16:05.217 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.215+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.91__multipart_key1.2~tTzxtFGKBLVl0x6VEdF4gl1R6a4BP_Q.3 2024-06-04T16:16:05.217 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.215+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.91__shadow_key1.2~tTzxtFGKBLVl0x6VEdF4gl1R6a4BP_Q.3_1 2024-06-04T16:16:05.217 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.215+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.91__multipart_key1.2~tTzxtFGKBLVl0x6VEdF4gl1R6a4BP_Q.4 2024-06-04T16:16:05.217 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.215+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.91__shadow_key1.2~tTzxtFGKBLVl0x6VEdF4gl1R6a4BP_Q.4_1 2024-06-04T16:16:05.217 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.215+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.91__multipart_key1.2~tTzxtFGKBLVl0x6VEdF4gl1R6a4BP_Q.5 2024-06-04T16:16:05.220 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.219+0000 7fa614733800 5 garbage collection: RGWGC::process removing entries, marker: 2024-06-04T16:16:05.222 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.222+0000 7fa614733800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-06-04T16:16:05.224 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.223+0000 7fa614733800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:16:05.224 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.223+0000 7fa614733800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:16:05.225 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.224+0000 7fa614733800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-06-04T16:16:05.225 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.224+0000 7fa614733800 20 garbage collection: RGWGC::process iterating over entry tag='be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.8762557081736027457', time=2024-06-04T18:15:42.592755+0000, chain.objs.size()=9 2024-06-04T16:16:05.225 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.224+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.83__multipart_key1.2~WWM44XUN91JaL2M4e6gGlWNDIRo83Yw.1 2024-06-04T16:16:05.225 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.224+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.83__shadow_key1.2~WWM44XUN91JaL2M4e6gGlWNDIRo83Yw.1_1 2024-06-04T16:16:05.225 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.224+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.83__multipart_key1.2~WWM44XUN91JaL2M4e6gGlWNDIRo83Yw.2 2024-06-04T16:16:05.225 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.224+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.83__shadow_key1.2~WWM44XUN91JaL2M4e6gGlWNDIRo83Yw.2_1 2024-06-04T16:16:05.226 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.224+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.83__multipart_key1.2~WWM44XUN91JaL2M4e6gGlWNDIRo83Yw.3 2024-06-04T16:16:05.226 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.224+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.83__shadow_key1.2~WWM44XUN91JaL2M4e6gGlWNDIRo83Yw.3_1 2024-06-04T16:16:05.226 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.224+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.83__multipart_key1.2~WWM44XUN91JaL2M4e6gGlWNDIRo83Yw.4 2024-06-04T16:16:05.226 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.224+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.83__shadow_key1.2~WWM44XUN91JaL2M4e6gGlWNDIRo83Yw.4_1 2024-06-04T16:16:05.226 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.224+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.83__multipart_key1.2~WWM44XUN91JaL2M4e6gGlWNDIRo83Yw.5 2024-06-04T16:16:05.228 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.227+0000 7fa614733800 5 garbage collection: RGWGC::process removing entries, marker: 2024-06-04T16:16:05.230 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.230+0000 7fa614733800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-06-04T16:16:05.232 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.231+0000 7fa614733800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:16:05.233 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.231+0000 7fa614733800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:16:05.233 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.232+0000 7fa614733800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-06-04T16:16:05.233 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.232+0000 7fa614733800 20 garbage collection: RGWGC::process iterating over entry tag='2~OM7FdJez_quMbrTMWctHYJ5LipnuuCY', time=2024-06-04T18:15:36.482076+0000, chain.objs.size()=9 2024-06-04T16:16:05.233 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.232+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.68__multipart_key1.2~OM7FdJez_quMbrTMWctHYJ5LipnuuCY.1 2024-06-04T16:16:05.233 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.232+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.68__shadow_key1.2~OM7FdJez_quMbrTMWctHYJ5LipnuuCY.1_1 2024-06-04T16:16:05.233 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.232+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.68__multipart_key1.2~OM7FdJez_quMbrTMWctHYJ5LipnuuCY.2 2024-06-04T16:16:05.233 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.232+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.68__shadow_key1.2~OM7FdJez_quMbrTMWctHYJ5LipnuuCY.2_1 2024-06-04T16:16:05.233 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.232+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.68__multipart_key1.2~OM7FdJez_quMbrTMWctHYJ5LipnuuCY.3 2024-06-04T16:16:05.233 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.232+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.68__shadow_key1.2~OM7FdJez_quMbrTMWctHYJ5LipnuuCY.3_1 2024-06-04T16:16:05.234 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.232+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.68__multipart_key1.2~OM7FdJez_quMbrTMWctHYJ5LipnuuCY.4 2024-06-04T16:16:05.234 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.232+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.68__shadow_key1.2~OM7FdJez_quMbrTMWctHYJ5LipnuuCY.4_1 2024-06-04T16:16:05.234 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.232+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.68__multipart_key1.2~OM7FdJez_quMbrTMWctHYJ5LipnuuCY.5 2024-06-04T16:16:05.236 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.235+0000 7fa614733800 5 garbage collection: RGWGC::process removing entries, marker: 2024-06-04T16:16:05.238 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.238+0000 7fa614733800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-06-04T16:16:05.240 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.239+0000 7fa614733800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:16:05.240 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.239+0000 7fa614733800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:16:05.240 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.239+0000 7fa614733800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:16:05.241 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.240+0000 7fa614733800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-06-04T16:16:05.242 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.242+0000 7fa614733800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:16:05.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.242+0000 7fa614733800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:16:05.244 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.242+0000 7fa614733800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-06-04T16:16:05.244 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.242+0000 7fa614733800 20 garbage collection: RGWGC::process iterating over entry tag='be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.3872176282140308618', time=2024-06-04T18:15:50.409224+0000, chain.objs.size()=7 2024-06-04T16:16:05.244 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.242+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.91__multipart_key1.2~HpgQdNiu6p3qGOPTz0zBTA7s5VrrZ39.1 2024-06-04T16:16:05.244 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.242+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.91__shadow_key1.2~HpgQdNiu6p3qGOPTz0zBTA7s5VrrZ39.1_1 2024-06-04T16:16:05.244 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.243+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.91__shadow_key1.2~HpgQdNiu6p3qGOPTz0zBTA7s5VrrZ39.1_2 2024-06-04T16:16:05.244 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.243+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.91__multipart_key1.2~HpgQdNiu6p3qGOPTz0zBTA7s5VrrZ39.2 2024-06-04T16:16:05.244 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.243+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.91__shadow_key1.2~HpgQdNiu6p3qGOPTz0zBTA7s5VrrZ39.2_1 2024-06-04T16:16:05.245 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.243+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.91__shadow_key1.2~HpgQdNiu6p3qGOPTz0zBTA7s5VrrZ39.2_2 2024-06-04T16:16:05.245 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.243+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.91__multipart_key1.2~HpgQdNiu6p3qGOPTz0zBTA7s5VrrZ39.3 2024-06-04T16:16:05.247 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.247+0000 7fa614733800 5 garbage collection: RGWGC::process removing entries, marker: 2024-06-04T16:16:05.250 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.249+0000 7fa614733800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-06-04T16:16:05.251 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.250+0000 7fa614733800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:16:05.251 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.250+0000 7fa614733800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:16:05.252 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.251+0000 7fa614733800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-06-04T16:16:05.253 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.251+0000 7fa614733800 20 garbage collection: RGWGC::process iterating over entry tag='be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.3053969753205341760', time=2024-06-04T18:15:37.881321+0000, chain.objs.size()=2 2024-06-04T16:16:05.253 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.251+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.72__shadow_.np1WMZ9r2CjVvbshdi1AW8qMvWw-aHT_1 2024-06-04T16:16:05.253 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.251+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.72__shadow_.np1WMZ9r2CjVvbshdi1AW8qMvWw-aHT_2 2024-06-04T16:16:05.253 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.251+0000 7fa614733800 20 garbage collection: RGWGC::process iterating over entry tag='be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1545628803369109496', time=2024-06-04T18:15:42.033733+0000, chain.objs.size()=9 2024-06-04T16:16:05.253 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.251+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.83__multipart_key1.2~C7ytdrF-01jp8CsZn4T3Q0MWd9emf8Q.1 2024-06-04T16:16:05.253 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.251+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.83__shadow_key1.2~C7ytdrF-01jp8CsZn4T3Q0MWd9emf8Q.1_1 2024-06-04T16:16:05.253 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.251+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.83__multipart_key1.2~C7ytdrF-01jp8CsZn4T3Q0MWd9emf8Q.2 2024-06-04T16:16:05.253 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.251+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.83__shadow_key1.2~C7ytdrF-01jp8CsZn4T3Q0MWd9emf8Q.2_1 2024-06-04T16:16:05.253 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.251+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.83__multipart_key1.2~C7ytdrF-01jp8CsZn4T3Q0MWd9emf8Q.3 2024-06-04T16:16:05.253 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.251+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.83__shadow_key1.2~C7ytdrF-01jp8CsZn4T3Q0MWd9emf8Q.3_1 2024-06-04T16:16:05.254 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.251+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.83__multipart_key1.2~C7ytdrF-01jp8CsZn4T3Q0MWd9emf8Q.4 2024-06-04T16:16:05.254 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.251+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.83__shadow_key1.2~C7ytdrF-01jp8CsZn4T3Q0MWd9emf8Q.4_1 2024-06-04T16:16:05.254 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.251+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.83__multipart_key1.2~C7ytdrF-01jp8CsZn4T3Q0MWd9emf8Q.5 2024-06-04T16:16:05.256 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.255+0000 7fa614733800 5 garbage collection: RGWGC::process removing entries, marker: 2024-06-04T16:16:05.258 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.258+0000 7fa614733800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-06-04T16:16:05.260 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.259+0000 7fa614733800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:16:05.260 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.259+0000 7fa614733800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:16:05.261 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.260+0000 7fa614733800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:16:05.261 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.261+0000 7fa614733800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-06-04T16:16:05.263 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.262+0000 7fa614733800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:16:05.263 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.262+0000 7fa614733800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:16:05.263 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.263+0000 7fa614733800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:16:05.264 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.264+0000 7fa614733800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-06-04T16:16:05.266 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.265+0000 7fa614733800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:16:05.266 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.265+0000 7fa614733800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:16:05.267 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.266+0000 7fa614733800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-06-04T16:16:05.267 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.266+0000 7fa614733800 20 garbage collection: RGWGC::process iterating over entry tag='be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.7142598017717921873', time=2024-06-04T18:15:44.131580+0000, chain.objs.size()=7 2024-06-04T16:16:05.268 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.266+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.83__multipart_key1.2~JvEl2_PDzKWieVzY0t3VbKrKWmkzms7.1 2024-06-04T16:16:05.268 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.266+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.83__shadow_key1.2~JvEl2_PDzKWieVzY0t3VbKrKWmkzms7.1_1 2024-06-04T16:16:05.268 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.266+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.83__shadow_key1.2~JvEl2_PDzKWieVzY0t3VbKrKWmkzms7.1_2 2024-06-04T16:16:05.268 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.266+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.83__multipart_key1.2~JvEl2_PDzKWieVzY0t3VbKrKWmkzms7.2 2024-06-04T16:16:05.268 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.266+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.83__shadow_key1.2~JvEl2_PDzKWieVzY0t3VbKrKWmkzms7.2_1 2024-06-04T16:16:05.268 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.266+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.83__shadow_key1.2~JvEl2_PDzKWieVzY0t3VbKrKWmkzms7.2_2 2024-06-04T16:16:05.268 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.266+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.83__multipart_key1.2~JvEl2_PDzKWieVzY0t3VbKrKWmkzms7.3 2024-06-04T16:16:05.268 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.266+0000 7fa614733800 20 garbage collection: RGWGC::process iterating over entry tag='2~B-S9V1TIC4Ssh_T4KfTDcb6lhVnXgGV', time=2024-06-04T18:15:53.366661+0000, chain.objs.size()=106 2024-06-04T16:16:05.268 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.266+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.94__multipart_key1.2~B-S9V1TIC4Ssh_T4KfTDcb6lhVnXgGV.1 2024-06-04T16:16:05.268 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.266+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.94__multipart_key1.2~B-S9V1TIC4Ssh_T4KfTDcb6lhVnXgGV.2 2024-06-04T16:16:05.268 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.266+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.94__multipart_key1.2~B-S9V1TIC4Ssh_T4KfTDcb6lhVnXgGV.3 2024-06-04T16:16:05.269 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.266+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.94__multipart_key1.2~B-S9V1TIC4Ssh_T4KfTDcb6lhVnXgGV.4 2024-06-04T16:16:05.269 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.266+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.94__multipart_key1.2~B-S9V1TIC4Ssh_T4KfTDcb6lhVnXgGV.5 2024-06-04T16:16:05.270 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.269+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.94__multipart_key1.2~B-S9V1TIC4Ssh_T4KfTDcb6lhVnXgGV.6 2024-06-04T16:16:05.272 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.271+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.94__multipart_key1.2~B-S9V1TIC4Ssh_T4KfTDcb6lhVnXgGV.7 2024-06-04T16:16:05.272 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.271+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.94__multipart_key1.2~B-S9V1TIC4Ssh_T4KfTDcb6lhVnXgGV.8 2024-06-04T16:16:05.272 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.271+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.94__multipart_key1.2~B-S9V1TIC4Ssh_T4KfTDcb6lhVnXgGV.9 2024-06-04T16:16:05.272 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.271+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.94__multipart_key1.2~B-S9V1TIC4Ssh_T4KfTDcb6lhVnXgGV.10 2024-06-04T16:16:05.272 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.271+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.94__multipart_key1.2~B-S9V1TIC4Ssh_T4KfTDcb6lhVnXgGV.11 2024-06-04T16:16:05.272 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.271+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.94__multipart_key1.2~B-S9V1TIC4Ssh_T4KfTDcb6lhVnXgGV.12 2024-06-04T16:16:05.273 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.271+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.94__multipart_key1.2~B-S9V1TIC4Ssh_T4KfTDcb6lhVnXgGV.13 2024-06-04T16:16:05.273 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.271+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.94__multipart_key1.2~B-S9V1TIC4Ssh_T4KfTDcb6lhVnXgGV.14 2024-06-04T16:16:05.273 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.271+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.94__multipart_key1.2~B-S9V1TIC4Ssh_T4KfTDcb6lhVnXgGV.15 2024-06-04T16:16:05.273 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.271+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.94__multipart_key1.2~B-S9V1TIC4Ssh_T4KfTDcb6lhVnXgGV.16 2024-06-04T16:16:05.273 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.273+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.94__multipart_key1.2~B-S9V1TIC4Ssh_T4KfTDcb6lhVnXgGV.17 2024-06-04T16:16:05.275 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.274+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.94__multipart_key1.2~B-S9V1TIC4Ssh_T4KfTDcb6lhVnXgGV.18 2024-06-04T16:16:05.275 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.274+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.94__multipart_key1.2~B-S9V1TIC4Ssh_T4KfTDcb6lhVnXgGV.19 2024-06-04T16:16:05.275 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.274+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.94__multipart_key1.2~B-S9V1TIC4Ssh_T4KfTDcb6lhVnXgGV.20 2024-06-04T16:16:05.276 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.274+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.94__multipart_key1.2~B-S9V1TIC4Ssh_T4KfTDcb6lhVnXgGV.21 2024-06-04T16:16:05.277 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.275+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.94__multipart_key1.2~B-S9V1TIC4Ssh_T4KfTDcb6lhVnXgGV.22 2024-06-04T16:16:05.277 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.275+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.94__multipart_key1.2~B-S9V1TIC4Ssh_T4KfTDcb6lhVnXgGV.23 2024-06-04T16:16:05.277 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.275+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.94__multipart_key1.2~B-S9V1TIC4Ssh_T4KfTDcb6lhVnXgGV.24 2024-06-04T16:16:05.277 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.276+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.94__multipart_key1.2~B-S9V1TIC4Ssh_T4KfTDcb6lhVnXgGV.25 2024-06-04T16:16:05.277 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.276+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.94__multipart_key1.2~B-S9V1TIC4Ssh_T4KfTDcb6lhVnXgGV.26 2024-06-04T16:16:05.277 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.276+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.94__multipart_key1.2~B-S9V1TIC4Ssh_T4KfTDcb6lhVnXgGV.27 2024-06-04T16:16:05.277 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.276+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.94__multipart_key1.2~B-S9V1TIC4Ssh_T4KfTDcb6lhVnXgGV.28 2024-06-04T16:16:05.279 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.278+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.94__multipart_key1.2~B-S9V1TIC4Ssh_T4KfTDcb6lhVnXgGV.29 2024-06-04T16:16:05.279 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.278+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.94__multipart_key1.2~B-S9V1TIC4Ssh_T4KfTDcb6lhVnXgGV.30 2024-06-04T16:16:05.279 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.278+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.94__multipart_key1.2~B-S9V1TIC4Ssh_T4KfTDcb6lhVnXgGV.31 2024-06-04T16:16:05.279 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.279+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.94__multipart_key1.2~B-S9V1TIC4Ssh_T4KfTDcb6lhVnXgGV.32 2024-06-04T16:16:05.281 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.280+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.94__multipart_key1.2~B-S9V1TIC4Ssh_T4KfTDcb6lhVnXgGV.33 2024-06-04T16:16:05.281 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.280+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.94__multipart_key1.2~B-S9V1TIC4Ssh_T4KfTDcb6lhVnXgGV.34 2024-06-04T16:16:05.282 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.280+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.94__multipart_key1.2~B-S9V1TIC4Ssh_T4KfTDcb6lhVnXgGV.35 2024-06-04T16:16:05.282 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.280+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.94__multipart_key1.2~B-S9V1TIC4Ssh_T4KfTDcb6lhVnXgGV.36 2024-06-04T16:16:05.282 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.280+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.94__multipart_key1.2~B-S9V1TIC4Ssh_T4KfTDcb6lhVnXgGV.37 2024-06-04T16:16:05.282 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.280+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.94__multipart_key1.2~B-S9V1TIC4Ssh_T4KfTDcb6lhVnXgGV.38 2024-06-04T16:16:05.282 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.280+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.94__multipart_key1.2~B-S9V1TIC4Ssh_T4KfTDcb6lhVnXgGV.39 2024-06-04T16:16:05.282 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.281+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.94__multipart_key1.2~B-S9V1TIC4Ssh_T4KfTDcb6lhVnXgGV.40 2024-06-04T16:16:05.283 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.281+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.94__multipart_key1.2~B-S9V1TIC4Ssh_T4KfTDcb6lhVnXgGV.41 2024-06-04T16:16:05.283 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.281+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.94__multipart_key1.2~B-S9V1TIC4Ssh_T4KfTDcb6lhVnXgGV.42 2024-06-04T16:16:05.286 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.285+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.94__multipart_key1.2~B-S9V1TIC4Ssh_T4KfTDcb6lhVnXgGV.43 2024-06-04T16:16:05.286 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.285+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.94__multipart_key1.2~B-S9V1TIC4Ssh_T4KfTDcb6lhVnXgGV.44 2024-06-04T16:16:05.286 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.285+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.94__multipart_key1.2~B-S9V1TIC4Ssh_T4KfTDcb6lhVnXgGV.45 2024-06-04T16:16:05.286 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.285+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.94__multipart_key1.2~B-S9V1TIC4Ssh_T4KfTDcb6lhVnXgGV.46 2024-06-04T16:16:05.287 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.285+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.94__multipart_key1.2~B-S9V1TIC4Ssh_T4KfTDcb6lhVnXgGV.47 2024-06-04T16:16:05.287 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.286+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.94__multipart_key1.2~B-S9V1TIC4Ssh_T4KfTDcb6lhVnXgGV.48 2024-06-04T16:16:05.288 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.286+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.94__multipart_key1.2~B-S9V1TIC4Ssh_T4KfTDcb6lhVnXgGV.49 2024-06-04T16:16:05.288 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.286+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.94__multipart_key1.2~B-S9V1TIC4Ssh_T4KfTDcb6lhVnXgGV.50 2024-06-04T16:16:05.288 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.286+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.94__multipart_key1.2~B-S9V1TIC4Ssh_T4KfTDcb6lhVnXgGV.51 2024-06-04T16:16:05.288 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.286+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.94__multipart_key1.2~B-S9V1TIC4Ssh_T4KfTDcb6lhVnXgGV.52 2024-06-04T16:16:05.288 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.286+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.94__multipart_key1.2~B-S9V1TIC4Ssh_T4KfTDcb6lhVnXgGV.53 2024-06-04T16:16:05.289 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.288+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.94__multipart_key1.2~B-S9V1TIC4Ssh_T4KfTDcb6lhVnXgGV.54 2024-06-04T16:16:05.291 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.289+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.94__multipart_key1.2~B-S9V1TIC4Ssh_T4KfTDcb6lhVnXgGV.55 2024-06-04T16:16:05.291 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.289+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.94__multipart_key1.2~B-S9V1TIC4Ssh_T4KfTDcb6lhVnXgGV.56 2024-06-04T16:16:05.291 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.289+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.94__multipart_key1.2~B-S9V1TIC4Ssh_T4KfTDcb6lhVnXgGV.57 2024-06-04T16:16:05.291 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.289+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.94__multipart_key1.2~B-S9V1TIC4Ssh_T4KfTDcb6lhVnXgGV.58 2024-06-04T16:16:05.291 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.289+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.94__multipart_key1.2~B-S9V1TIC4Ssh_T4KfTDcb6lhVnXgGV.59 2024-06-04T16:16:05.291 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.290+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.94__multipart_key1.2~B-S9V1TIC4Ssh_T4KfTDcb6lhVnXgGV.60 2024-06-04T16:16:05.291 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.290+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.94__multipart_key1.2~B-S9V1TIC4Ssh_T4KfTDcb6lhVnXgGV.61 2024-06-04T16:16:05.291 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.290+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.94__multipart_key1.2~B-S9V1TIC4Ssh_T4KfTDcb6lhVnXgGV.62 2024-06-04T16:16:05.291 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.290+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.94__multipart_key1.2~B-S9V1TIC4Ssh_T4KfTDcb6lhVnXgGV.63 2024-06-04T16:16:05.291 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.290+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.94__multipart_key1.2~B-S9V1TIC4Ssh_T4KfTDcb6lhVnXgGV.64 2024-06-04T16:16:05.294 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.293+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.94__multipart_key1.2~B-S9V1TIC4Ssh_T4KfTDcb6lhVnXgGV.65 2024-06-04T16:16:05.294 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.293+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.94__multipart_key1.2~B-S9V1TIC4Ssh_T4KfTDcb6lhVnXgGV.66 2024-06-04T16:16:05.294 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.293+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.94__multipart_key1.2~B-S9V1TIC4Ssh_T4KfTDcb6lhVnXgGV.67 2024-06-04T16:16:05.294 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.293+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.94__multipart_key1.2~B-S9V1TIC4Ssh_T4KfTDcb6lhVnXgGV.68 2024-06-04T16:16:05.295 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.294+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.94__multipart_key1.2~B-S9V1TIC4Ssh_T4KfTDcb6lhVnXgGV.69 2024-06-04T16:16:05.295 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.294+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.94__multipart_key1.2~B-S9V1TIC4Ssh_T4KfTDcb6lhVnXgGV.70 2024-06-04T16:16:05.295 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.294+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.94__multipart_key1.2~B-S9V1TIC4Ssh_T4KfTDcb6lhVnXgGV.71 2024-06-04T16:16:05.295 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.294+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.94__multipart_key1.2~B-S9V1TIC4Ssh_T4KfTDcb6lhVnXgGV.72 2024-06-04T16:16:05.295 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.294+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.94__multipart_key1.2~B-S9V1TIC4Ssh_T4KfTDcb6lhVnXgGV.73 2024-06-04T16:16:05.295 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.294+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.94__multipart_key1.2~B-S9V1TIC4Ssh_T4KfTDcb6lhVnXgGV.74 2024-06-04T16:16:05.295 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.294+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.94__multipart_key1.2~B-S9V1TIC4Ssh_T4KfTDcb6lhVnXgGV.75 2024-06-04T16:16:05.299 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.297+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.94__multipart_key1.2~B-S9V1TIC4Ssh_T4KfTDcb6lhVnXgGV.76 2024-06-04T16:16:05.299 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.297+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.94__multipart_key1.2~B-S9V1TIC4Ssh_T4KfTDcb6lhVnXgGV.77 2024-06-04T16:16:05.299 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.297+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.94__multipart_key1.2~B-S9V1TIC4Ssh_T4KfTDcb6lhVnXgGV.78 2024-06-04T16:16:05.299 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.297+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.94__multipart_key1.2~B-S9V1TIC4Ssh_T4KfTDcb6lhVnXgGV.79 2024-06-04T16:16:05.299 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.297+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.94__multipart_key1.2~B-S9V1TIC4Ssh_T4KfTDcb6lhVnXgGV.80 2024-06-04T16:16:05.299 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.297+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.94__multipart_key1.2~B-S9V1TIC4Ssh_T4KfTDcb6lhVnXgGV.81 2024-06-04T16:16:05.299 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.297+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.94__multipart_key1.2~B-S9V1TIC4Ssh_T4KfTDcb6lhVnXgGV.82 2024-06-04T16:16:05.299 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.297+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.94__multipart_key1.2~B-S9V1TIC4Ssh_T4KfTDcb6lhVnXgGV.83 2024-06-04T16:16:05.299 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.297+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.94__multipart_key1.2~B-S9V1TIC4Ssh_T4KfTDcb6lhVnXgGV.84 2024-06-04T16:16:05.299 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.298+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.94__multipart_key1.2~B-S9V1TIC4Ssh_T4KfTDcb6lhVnXgGV.85 2024-06-04T16:16:05.299 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.298+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.94__multipart_key1.2~B-S9V1TIC4Ssh_T4KfTDcb6lhVnXgGV.86 2024-06-04T16:16:05.303 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.302+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.94__multipart_key1.2~B-S9V1TIC4Ssh_T4KfTDcb6lhVnXgGV.87 2024-06-04T16:16:05.303 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.302+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.94__multipart_key1.2~B-S9V1TIC4Ssh_T4KfTDcb6lhVnXgGV.88 2024-06-04T16:16:05.304 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.303+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.94__multipart_key1.2~B-S9V1TIC4Ssh_T4KfTDcb6lhVnXgGV.89 2024-06-04T16:16:05.304 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.303+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.94__multipart_key1.2~B-S9V1TIC4Ssh_T4KfTDcb6lhVnXgGV.90 2024-06-04T16:16:05.304 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.303+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.94__multipart_key1.2~B-S9V1TIC4Ssh_T4KfTDcb6lhVnXgGV.91 2024-06-04T16:16:05.304 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.303+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.94__multipart_key1.2~B-S9V1TIC4Ssh_T4KfTDcb6lhVnXgGV.92 2024-06-04T16:16:05.304 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.303+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.94__multipart_key1.2~B-S9V1TIC4Ssh_T4KfTDcb6lhVnXgGV.93 2024-06-04T16:16:05.304 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.303+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.94__multipart_key1.2~B-S9V1TIC4Ssh_T4KfTDcb6lhVnXgGV.94 2024-06-04T16:16:05.304 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.303+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.94__multipart_key1.2~B-S9V1TIC4Ssh_T4KfTDcb6lhVnXgGV.95 2024-06-04T16:16:05.304 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.303+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.94__multipart_key1.2~B-S9V1TIC4Ssh_T4KfTDcb6lhVnXgGV.96 2024-06-04T16:16:05.305 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.303+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.94__multipart_key1.2~B-S9V1TIC4Ssh_T4KfTDcb6lhVnXgGV.97 2024-06-04T16:16:05.305 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.304+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.94__multipart_key1.2~B-S9V1TIC4Ssh_T4KfTDcb6lhVnXgGV.98 2024-06-04T16:16:05.306 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.306+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.94__multipart_key1.2~B-S9V1TIC4Ssh_T4KfTDcb6lhVnXgGV.99 2024-06-04T16:16:05.309 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.308+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.94__multipart_key1.2~B-S9V1TIC4Ssh_T4KfTDcb6lhVnXgGV.100 2024-06-04T16:16:05.309 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.308+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.94__multipart_key1.2~B-S9V1TIC4Ssh_T4KfTDcb6lhVnXgGV.101 2024-06-04T16:16:05.309 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.308+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.94__multipart_key1.2~B-S9V1TIC4Ssh_T4KfTDcb6lhVnXgGV.102 2024-06-04T16:16:05.309 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.308+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.94__multipart_key1.2~B-S9V1TIC4Ssh_T4KfTDcb6lhVnXgGV.103 2024-06-04T16:16:05.309 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.308+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.94__multipart_key1.2~B-S9V1TIC4Ssh_T4KfTDcb6lhVnXgGV.104 2024-06-04T16:16:05.309 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.308+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.94__multipart_key1.2~B-S9V1TIC4Ssh_T4KfTDcb6lhVnXgGV.105 2024-06-04T16:16:05.310 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.308+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.94__multipart_key1.2~B-S9V1TIC4Ssh_T4KfTDcb6lhVnXgGV.106 2024-06-04T16:16:05.313 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.312+0000 7fa614733800 5 garbage collection: RGWGC::process removing entries, marker: 2024-06-04T16:16:05.315 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.315+0000 7fa614733800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-06-04T16:16:05.316 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.316+0000 7fa614733800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:16:05.317 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.316+0000 7fa614733800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:16:05.318 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.316+0000 7fa614733800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-06-04T16:16:05.318 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.316+0000 7fa614733800 20 garbage collection: RGWGC::process iterating over entry tag='be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.9729252570305313581', time=2024-06-04T18:15:40.389548+0000, chain.objs.size()=9 2024-06-04T16:16:05.318 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.317+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.80__multipart_key1.2~iPDJxRv5N-wQypS3UYxs4ArO2bzJOaz.1 2024-06-04T16:16:05.318 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.317+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.80__shadow_key1.2~iPDJxRv5N-wQypS3UYxs4ArO2bzJOaz.1_1 2024-06-04T16:16:05.318 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.317+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.80__multipart_key1.2~iPDJxRv5N-wQypS3UYxs4ArO2bzJOaz.2 2024-06-04T16:16:05.318 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.317+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.80__shadow_key1.2~iPDJxRv5N-wQypS3UYxs4ArO2bzJOaz.2_1 2024-06-04T16:16:05.318 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.317+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.80__multipart_key1.2~iPDJxRv5N-wQypS3UYxs4ArO2bzJOaz.3 2024-06-04T16:16:05.318 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.317+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.80__shadow_key1.2~iPDJxRv5N-wQypS3UYxs4ArO2bzJOaz.3_1 2024-06-04T16:16:05.318 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.317+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.80__multipart_key1.2~iPDJxRv5N-wQypS3UYxs4ArO2bzJOaz.4 2024-06-04T16:16:05.319 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.317+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.80__shadow_key1.2~iPDJxRv5N-wQypS3UYxs4ArO2bzJOaz.4_1 2024-06-04T16:16:05.319 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.317+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.80__multipart_key1.2~iPDJxRv5N-wQypS3UYxs4ArO2bzJOaz.5 2024-06-04T16:16:05.319 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.319+0000 7fa614733800 5 garbage collection: RGWGC::process removing entries, marker: 2024-06-04T16:16:05.321 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.321+0000 7fa614733800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-06-04T16:16:05.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.322+0000 7fa614733800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:16:05.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.322+0000 7fa614733800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:16:05.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.323+0000 7fa614733800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:16:05.324 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.323+0000 7fa614733800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-06-04T16:16:05.325 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.325+0000 7fa614733800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:16:05.326 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.325+0000 7fa614733800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:16:05.326 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.326+0000 7fa614733800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:16:05.327 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.326+0000 7fa614733800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-06-04T16:16:05.328 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.328+0000 7fa614733800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:16:05.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.328+0000 7fa614733800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:16:05.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.328+0000 7fa614733800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:16:05.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.329+0000 7fa614733800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-06-04T16:16:05.331 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.330+0000 7fa614733800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:16:05.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.331+0000 7fa614733800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:16:05.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.331+0000 7fa614733800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:16:05.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.332+0000 7fa614733800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-06-04T16:16:05.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.333+0000 7fa614733800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:16:05.335 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.333+0000 7fa614733800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:16:05.335 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.334+0000 7fa614733800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:16:05.335 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.335+0000 7fa614733800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-06-04T16:16:05.337 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.336+0000 7fa614733800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:16:05.338 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.337+0000 7fa614733800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:16:05.338 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.337+0000 7fa614733800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-06-04T16:16:05.338 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.337+0000 7fa614733800 20 garbage collection: RGWGC::process iterating over entry tag='be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.766867352302205502', time=2024-06-04T18:15:43.872676+0000, chain.objs.size()=7 2024-06-04T16:16:05.339 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.337+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.83__multipart_key1.2~1SVLTJN6pfbRQYVHuYMHeSz2pDAeC-Y.1 2024-06-04T16:16:05.339 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.337+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.83__shadow_key1.2~1SVLTJN6pfbRQYVHuYMHeSz2pDAeC-Y.1_1 2024-06-04T16:16:05.339 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.337+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.83__shadow_key1.2~1SVLTJN6pfbRQYVHuYMHeSz2pDAeC-Y.1_2 2024-06-04T16:16:05.339 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.337+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.83__multipart_key1.2~1SVLTJN6pfbRQYVHuYMHeSz2pDAeC-Y.2 2024-06-04T16:16:05.339 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.337+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.83__shadow_key1.2~1SVLTJN6pfbRQYVHuYMHeSz2pDAeC-Y.2_1 2024-06-04T16:16:05.339 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.337+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.83__shadow_key1.2~1SVLTJN6pfbRQYVHuYMHeSz2pDAeC-Y.2_2 2024-06-04T16:16:05.339 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.337+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.83__multipart_key1.2~1SVLTJN6pfbRQYVHuYMHeSz2pDAeC-Y.3 2024-06-04T16:16:05.341 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.340+0000 7fa614733800 5 garbage collection: RGWGC::process removing entries, marker: 2024-06-04T16:16:05.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.343+0000 7fa614733800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-06-04T16:16:05.344 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.344+0000 7fa614733800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:16:05.345 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.344+0000 7fa614733800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:16:05.346 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.345+0000 7fa614733800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-06-04T16:16:05.346 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.345+0000 7fa614733800 20 garbage collection: RGWGC::process iterating over entry tag='be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.6092530069664214113', time=2024-06-04T18:15:44.010518+0000, chain.objs.size()=5 2024-06-04T16:16:05.346 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.345+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.82__shadow_.WWnu3PuwnDJlen13G6bh4Xrm4EmtxrU_1 2024-06-04T16:16:05.346 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.345+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.82__shadow_.WWnu3PuwnDJlen13G6bh4Xrm4EmtxrU_2 2024-06-04T16:16:05.346 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.345+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.82__shadow_.WWnu3PuwnDJlen13G6bh4Xrm4EmtxrU_3 2024-06-04T16:16:05.347 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.345+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.82__shadow_.WWnu3PuwnDJlen13G6bh4Xrm4EmtxrU_4 2024-06-04T16:16:05.347 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.345+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.82__shadow_.WWnu3PuwnDJlen13G6bh4Xrm4EmtxrU_5 2024-06-04T16:16:05.347 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.345+0000 7fa614733800 20 garbage collection: RGWGC::process iterating over entry tag='be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1585302242140377086', time=2024-06-04T18:15:46.237915+0000, chain.objs.size()=9 2024-06-04T16:16:05.347 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.345+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.88__multipart_key1.2~qCaUUN1ag3jrDls5txmhnT1WsfQ545p.1 2024-06-04T16:16:05.347 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.345+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.88__shadow_key1.2~qCaUUN1ag3jrDls5txmhnT1WsfQ545p.1_1 2024-06-04T16:16:05.347 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.345+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.88__multipart_key1.2~qCaUUN1ag3jrDls5txmhnT1WsfQ545p.2 2024-06-04T16:16:05.347 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.345+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.88__shadow_key1.2~qCaUUN1ag3jrDls5txmhnT1WsfQ545p.2_1 2024-06-04T16:16:05.347 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.345+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.88__multipart_key1.2~qCaUUN1ag3jrDls5txmhnT1WsfQ545p.3 2024-06-04T16:16:05.347 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.345+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.88__shadow_key1.2~qCaUUN1ag3jrDls5txmhnT1WsfQ545p.3_1 2024-06-04T16:16:05.347 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.345+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.88__multipart_key1.2~qCaUUN1ag3jrDls5txmhnT1WsfQ545p.4 2024-06-04T16:16:05.348 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.347+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.88__shadow_key1.2~qCaUUN1ag3jrDls5txmhnT1WsfQ545p.4_1 2024-06-04T16:16:05.348 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.347+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.88__multipart_key1.2~qCaUUN1ag3jrDls5txmhnT1WsfQ545p.5 2024-06-04T16:16:05.350 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.349+0000 7fa614733800 20 garbage collection: RGWGC::process iterating over entry tag='be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.1421398165620940646', time=2024-06-04T18:15:49.481123+0000, chain.objs.size()=9 2024-06-04T16:16:05.350 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.349+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.91__multipart_key1.2~WarJZ8mQNqKtKGb8JpJ_Xn0uCvc26C2.1 2024-06-04T16:16:05.350 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.349+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.91__shadow_key1.2~WarJZ8mQNqKtKGb8JpJ_Xn0uCvc26C2.1_1 2024-06-04T16:16:05.350 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.349+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.91__multipart_key1.2~WarJZ8mQNqKtKGb8JpJ_Xn0uCvc26C2.2 2024-06-04T16:16:05.352 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.351+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.91__shadow_key1.2~WarJZ8mQNqKtKGb8JpJ_Xn0uCvc26C2.2_1 2024-06-04T16:16:05.352 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.351+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.91__multipart_key1.2~WarJZ8mQNqKtKGb8JpJ_Xn0uCvc26C2.3 2024-06-04T16:16:05.352 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.351+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.91__shadow_key1.2~WarJZ8mQNqKtKGb8JpJ_Xn0uCvc26C2.3_1 2024-06-04T16:16:05.352 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.351+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.91__multipart_key1.2~WarJZ8mQNqKtKGb8JpJ_Xn0uCvc26C2.4 2024-06-04T16:16:05.352 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.351+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.91__shadow_key1.2~WarJZ8mQNqKtKGb8JpJ_Xn0uCvc26C2.4_1 2024-06-04T16:16:05.352 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.351+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.91__multipart_key1.2~WarJZ8mQNqKtKGb8JpJ_Xn0uCvc26C2.5 2024-06-04T16:16:05.357 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.356+0000 7fa614733800 5 garbage collection: RGWGC::process removing entries, marker: 2024-06-04T16:16:05.359 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.358+0000 7fa614733800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-06-04T16:16:05.360 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.359+0000 7fa614733800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:16:05.360 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.360+0000 7fa614733800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:16:05.361 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.360+0000 7fa614733800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:16:05.362 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.361+0000 7fa614733800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-06-04T16:16:05.363 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.362+0000 7fa614733800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:16:05.365 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.363+0000 7fa614733800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:16:05.365 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.363+0000 7fa614733800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-06-04T16:16:05.365 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.363+0000 7fa614733800 20 garbage collection: RGWGC::process iterating over entry tag='be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.16954461737122030449', time=2024-06-04T18:15:50.702830+0000, chain.objs.size()=7 2024-06-04T16:16:05.365 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.363+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.91__multipart_key1.2~klwn486kmIcWFBUuIE1vSzpMD7p1lM1.1 2024-06-04T16:16:05.366 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.363+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.91__shadow_key1.2~klwn486kmIcWFBUuIE1vSzpMD7p1lM1.1_1 2024-06-04T16:16:05.366 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.363+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.91__shadow_key1.2~klwn486kmIcWFBUuIE1vSzpMD7p1lM1.1_2 2024-06-04T16:16:05.366 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.363+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.91__multipart_key1.2~klwn486kmIcWFBUuIE1vSzpMD7p1lM1.2 2024-06-04T16:16:05.366 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.363+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.91__shadow_key1.2~klwn486kmIcWFBUuIE1vSzpMD7p1lM1.2_1 2024-06-04T16:16:05.366 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.363+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.91__shadow_key1.2~klwn486kmIcWFBUuIE1vSzpMD7p1lM1.2_2 2024-06-04T16:16:05.366 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.363+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.91__multipart_key1.2~klwn486kmIcWFBUuIE1vSzpMD7p1lM1.3 2024-06-04T16:16:05.367 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.367+0000 7fa614733800 5 garbage collection: RGWGC::process removing entries, marker: 2024-06-04T16:16:05.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.369+0000 7fa614733800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-06-04T16:16:05.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.370+0000 7fa614733800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:16:05.373 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.371+0000 7fa614733800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:16:05.373 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.371+0000 7fa614733800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-06-04T16:16:05.373 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.371+0000 7fa614733800 20 garbage collection: RGWGC::process iterating over entry tag='be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.15835064588819567355', time=2024-06-04T18:15:43.443697+0000, chain.objs.size()=7 2024-06-04T16:16:05.373 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.371+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.83__multipart_key1.2~hWUhTN-_00D89pJaA6Bpx6gqUu2W08Z.1 2024-06-04T16:16:05.374 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.371+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.83__shadow_key1.2~hWUhTN-_00D89pJaA6Bpx6gqUu2W08Z.1_1 2024-06-04T16:16:05.374 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.371+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.83__shadow_key1.2~hWUhTN-_00D89pJaA6Bpx6gqUu2W08Z.1_2 2024-06-04T16:16:05.374 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.371+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.83__multipart_key1.2~hWUhTN-_00D89pJaA6Bpx6gqUu2W08Z.2 2024-06-04T16:16:05.374 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.371+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.83__shadow_key1.2~hWUhTN-_00D89pJaA6Bpx6gqUu2W08Z.2_1 2024-06-04T16:16:05.374 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.371+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.83__shadow_key1.2~hWUhTN-_00D89pJaA6Bpx6gqUu2W08Z.2_2 2024-06-04T16:16:05.375 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.371+0000 7fa614733800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.83__multipart_key1.2~hWUhTN-_00D89pJaA6Bpx6gqUu2W08Z.3 2024-06-04T16:16:05.376 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.375+0000 7fa614733800 5 garbage collection: RGWGC::process removing entries, marker: 2024-06-04T16:16:05.379 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.378+0000 7fa4c6fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-06-04T16:16:05.381 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.380+0000 7fa614733800 20 remove_watcher() i=0 2024-06-04T16:16:05.381 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.380+0000 7fa614733800 2 removed watcher, disabling cache 2024-06-04T16:16:05.382 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.381+0000 7fa614733800 20 remove_watcher() i=1 2024-06-04T16:16:05.383 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.382+0000 7fa614733800 20 remove_watcher() i=2 2024-06-04T16:16:05.384 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.383+0000 7fa614733800 20 remove_watcher() i=3 2024-06-04T16:16:05.384 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.384+0000 7fa614733800 20 remove_watcher() i=4 2024-06-04T16:16:05.385 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.385+0000 7fa614733800 20 remove_watcher() i=5 2024-06-04T16:16:05.386 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.386+0000 7fa614733800 20 remove_watcher() i=6 2024-06-04T16:16:05.387 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.387+0000 7fa614733800 20 remove_watcher() i=7 2024-06-04T16:16:05.399 DEBUG:teuthology.orchestra.run.smithi144:> radosgw-admin gc process --include-all 2024-06-04T16:16:05.451 INFO:teuthology.orchestra.run.smithi144.stderr:ignoring --setuser ceph since I am not root 2024-06-04T16:16:05.452 INFO:teuthology.orchestra.run.smithi144.stderr:ignoring --setgroup ceph since I am not root 2024-06-04T16:16:05.488 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.487+0000 7f1b5fb21800 20 rados->read ofs=0 len=0 2024-06-04T16:16:05.490 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.489+0000 7f1b5fb21800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:16:05.490 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.489+0000 7f1b5fb21800 20 realm 2024-06-04T16:16:05.491 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.489+0000 7f1b5fb21800 20 rados->read ofs=0 len=0 2024-06-04T16:16:05.491 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.489+0000 7f1b5fb21800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:16:05.491 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.489+0000 7f1b5fb21800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-06-04T16:16:05.491 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.489+0000 7f1b5fb21800 20 rados->read ofs=0 len=0 2024-06-04T16:16:05.491 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.490+0000 7f1b5fb21800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:16:05.491 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.490+0000 7f1b5fb21800 20 rados->read ofs=0 len=0 2024-06-04T16:16:05.491 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.490+0000 7f1b5fb21800 20 rados_obj.operate() r=0 bl.length=46 2024-06-04T16:16:05.492 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.490+0000 7f1b5fb21800 20 rados->read ofs=0 len=0 2024-06-04T16:16:05.492 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.491+0000 7f1b5fb21800 20 rados_obj.operate() r=0 bl.length=1139 2024-06-04T16:16:05.492 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.491+0000 7f1b5fb21800 20 searching for the correct realm 2024-06-04T16:16:05.493 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.493+0000 7f1b5b04e640 0 -- 172.21.15.144:0/3083945949 >> [v2:172.21.15.144:6816/2358575268,v1:172.21.15.144:6817/2358575268] conn(0x55f0a5a54110 msgr2=0x55f0a5a56540 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-06-04T16:16:05.496 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.496+0000 7f1b5b04e640 0 -- 172.21.15.144:0/3083945949 >> [v2:172.21.15.177:6808/2618477608,v1:172.21.15.177:6809/2618477608] conn(0x7f1b5006a070 msgr2=0x7f1b50074040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-06-04T16:16:05.704 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.703+0000 7f1b5fb21800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-06-04T16:16:05.704 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.703+0000 7f1b5fb21800 20 RGWRados::pool_iterate: got zone_info.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767 2024-06-04T16:16:05.704 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.703+0000 7f1b5fb21800 20 RGWRados::pool_iterate: got default.zone. 2024-06-04T16:16:05.704 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.703+0000 7f1b5fb21800 20 RGWRados::pool_iterate: got zonegroup_info.abb22408-c332-4e28-8f7a-ff254ea2fed2 2024-06-04T16:16:05.704 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.703+0000 7f1b5fb21800 20 RGWRados::pool_iterate: got zone_names.default 2024-06-04T16:16:05.704 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.703+0000 7f1b5fb21800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-06-04T16:16:05.704 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.703+0000 7f1b5fb21800 20 rados->read ofs=0 len=0 2024-06-04T16:16:05.705 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.703+0000 7f1b5fb21800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:16:05.705 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.703+0000 7f1b5fb21800 20 rados->read ofs=0 len=0 2024-06-04T16:16:05.705 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.704+0000 7f1b5fb21800 20 rados_obj.operate() r=0 bl.length=46 2024-06-04T16:16:05.705 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.704+0000 7f1b5fb21800 20 rados->read ofs=0 len=0 2024-06-04T16:16:05.705 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.704+0000 7f1b5fb21800 20 rados_obj.operate() r=0 bl.length=470 2024-06-04T16:16:05.705 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.704+0000 7f1b5fb21800 20 zone default found 2024-06-04T16:16:05.705 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.704+0000 7f1b5fb21800 4 Realm: () 2024-06-04T16:16:05.705 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.704+0000 7f1b5fb21800 4 ZoneGroup: default (abb22408-c332-4e28-8f7a-ff254ea2fed2) 2024-06-04T16:16:05.706 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.704+0000 7f1b5fb21800 4 Zone: default (be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767) 2024-06-04T16:16:05.706 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.704+0000 7f1b5fb21800 10 cannot find current period zonegroup using local zonegroup configuration 2024-06-04T16:16:05.706 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.704+0000 7f1b5fb21800 20 zonegroup default 2024-06-04T16:16:05.706 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.704+0000 7f1b5fb21800 20 rados->read ofs=0 len=0 2024-06-04T16:16:05.706 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.704+0000 7f1b5fb21800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:16:05.706 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.704+0000 7f1b5fb21800 20 rados->read ofs=0 len=0 2024-06-04T16:16:05.707 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.705+0000 7f1b5fb21800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:16:05.707 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.705+0000 7f1b5fb21800 20 rados->read ofs=0 len=0 2024-06-04T16:16:05.707 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.705+0000 7f1b5fb21800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:16:05.707 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.705+0000 7f1b5fb21800 20 started sync module instance, tier type = 2024-06-04T16:16:05.707 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.705+0000 7f1b5fb21800 20 started zone id=be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767 (name=default) with tier type = 2024-06-04T16:16:05.714 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.713+0000 7f1b5fb21800 20 add_watcher() i=0 2024-06-04T16:16:05.714 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.713+0000 7f1b5fb21800 20 add_watcher() i=1 2024-06-04T16:16:05.714 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.713+0000 7f1b5fb21800 20 add_watcher() i=2 2024-06-04T16:16:05.714 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.713+0000 7f1b5fb21800 20 add_watcher() i=3 2024-06-04T16:16:05.714 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.713+0000 7f1b5fb21800 20 add_watcher() i=4 2024-06-04T16:16:05.715 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.713+0000 7f1b5fb21800 20 add_watcher() i=5 2024-06-04T16:16:05.715 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.713+0000 7f1b5fb21800 20 add_watcher() i=6 2024-06-04T16:16:05.715 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.714+0000 7f1b5fb21800 20 add_watcher() i=7 2024-06-04T16:16:05.715 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.714+0000 7f1b5fb21800 2 all 8 watchers are set, enabling cache 2024-06-04T16:16:05.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.716+0000 7f1a11fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-06-04T16:16:05.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.717+0000 7f1b5fb21800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-06-04T16:16:05.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.717+0000 7f1b5fb21800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-06-04T16:16:05.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.750+0000 7f1a10fe1640 20 reqs_thread_entry: start 2024-06-04T16:16:05.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.751+0000 7f1b5fb21800 20 init_complete bucket index max shards: 11 2024-06-04T16:16:05.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.751+0000 7f1b5fb21800 20 Filter name: none 2024-06-04T16:16:05.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.751+0000 7f198a7fc640 20 reqs_thread_entry: start 2024-06-04T16:16:05.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.751+0000 7f1b5fb21800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-06-04T16:16:05.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.752+0000 7f1b5fb21800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:16:05.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.753+0000 7f1b5fb21800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:16:05.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.753+0000 7f1b5fb21800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:16:05.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.754+0000 7f1b5fb21800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-06-04T16:16:05.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.755+0000 7f1b5fb21800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:16:05.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.756+0000 7f1b5fb21800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:16:05.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.756+0000 7f1b5fb21800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:16:05.758 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.757+0000 7f1b5fb21800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-06-04T16:16:05.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.758+0000 7f1b5fb21800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:16:05.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.759+0000 7f1b5fb21800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:16:05.760 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.759+0000 7f1b5fb21800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:16:05.760 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.760+0000 7f1b5fb21800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-06-04T16:16:05.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.761+0000 7f1b5fb21800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:16:05.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.761+0000 7f1b5fb21800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:16:05.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.762+0000 7f1b5fb21800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:16:05.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.762+0000 7f1b5fb21800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-06-04T16:16:05.764 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.764+0000 7f1b5fb21800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:16:05.765 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.764+0000 7f1b5fb21800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:16:05.765 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.764+0000 7f1b5fb21800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:16:05.766 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.766+0000 7f1b5fb21800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-06-04T16:16:05.768 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.767+0000 7f1b5fb21800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:16:05.768 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.767+0000 7f1b5fb21800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:16:05.768 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.767+0000 7f1b5fb21800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:16:05.769 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.768+0000 7f1b5fb21800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-06-04T16:16:05.771 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.770+0000 7f1b5fb21800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:16:05.771 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.771+0000 7f1b5fb21800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:16:05.772 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.771+0000 7f1b5fb21800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:16:05.773 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.772+0000 7f1b5fb21800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-06-04T16:16:05.774 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.773+0000 7f1b5fb21800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:16:05.774 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.773+0000 7f1b5fb21800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:16:05.774 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.774+0000 7f1b5fb21800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:16:05.775 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.774+0000 7f1b5fb21800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-06-04T16:16:05.777 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.776+0000 7f1b5fb21800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:16:05.777 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.776+0000 7f1b5fb21800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:16:05.777 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.777+0000 7f1b5fb21800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:16:05.778 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.778+0000 7f1b5fb21800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-06-04T16:16:05.780 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.779+0000 7f1b5fb21800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:16:05.780 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.780+0000 7f1b5fb21800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:16:05.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.780+0000 7f1b5fb21800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:16:05.782 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.781+0000 7f1b5fb21800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-06-04T16:16:05.783 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.782+0000 7f1b5fb21800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:16:05.784 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.783+0000 7f1b5fb21800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:16:05.784 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.783+0000 7f1b5fb21800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:16:05.785 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.784+0000 7f1b5fb21800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-06-04T16:16:05.786 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.786+0000 7f1b5fb21800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:16:05.787 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.786+0000 7f1b5fb21800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:16:05.787 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.786+0000 7f1b5fb21800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:16:05.788 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.787+0000 7f1b5fb21800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-06-04T16:16:05.789 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.788+0000 7f1b5fb21800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:16:05.790 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.789+0000 7f1b5fb21800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:16:05.790 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.789+0000 7f1b5fb21800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:16:05.791 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.790+0000 7f1b5fb21800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-06-04T16:16:05.792 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.792+0000 7f1b5fb21800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:16:05.793 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.792+0000 7f1b5fb21800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:16:05.793 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.792+0000 7f1b5fb21800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:16:05.794 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.794+0000 7f1b5fb21800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-06-04T16:16:05.795 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.795+0000 7f1b5fb21800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:16:05.796 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.795+0000 7f1b5fb21800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:16:05.796 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.795+0000 7f1b5fb21800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:16:05.797 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.796+0000 7f1b5fb21800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-06-04T16:16:05.798 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.797+0000 7f1b5fb21800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:16:05.799 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.798+0000 7f1b5fb21800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:16:05.799 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.798+0000 7f1b5fb21800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:16:05.800 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.799+0000 7f1b5fb21800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-06-04T16:16:05.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.801+0000 7f1b5fb21800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:16:05.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.801+0000 7f1b5fb21800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:16:05.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.801+0000 7f1b5fb21800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:16:05.803 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.803+0000 7f1b5fb21800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-06-04T16:16:05.804 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.804+0000 7f1b5fb21800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:16:05.805 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.804+0000 7f1b5fb21800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:16:05.805 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.805+0000 7f1b5fb21800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:16:05.806 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.806+0000 7f1b5fb21800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-06-04T16:16:05.807 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.807+0000 7f1b5fb21800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:16:05.808 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.807+0000 7f1b5fb21800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:16:05.808 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.807+0000 7f1b5fb21800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:16:05.809 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.809+0000 7f1b5fb21800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-06-04T16:16:05.810 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.810+0000 7f1b5fb21800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:16:05.811 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.810+0000 7f1b5fb21800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:16:05.811 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.810+0000 7f1b5fb21800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:16:05.812 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.811+0000 7f1b5fb21800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-06-04T16:16:05.814 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.813+0000 7f1b5fb21800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:16:05.814 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.813+0000 7f1b5fb21800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:16:05.814 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.813+0000 7f1b5fb21800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:16:05.815 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.814+0000 7f1b5fb21800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-06-04T16:16:05.816 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.816+0000 7f1b5fb21800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:16:05.817 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.816+0000 7f1b5fb21800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:16:05.817 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.816+0000 7f1b5fb21800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:16:05.818 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.817+0000 7f1b5fb21800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-06-04T16:16:05.819 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.819+0000 7f1b5fb21800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:16:05.820 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.819+0000 7f1b5fb21800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:16:05.820 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.819+0000 7f1b5fb21800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:16:05.821 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.820+0000 7f1b5fb21800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-06-04T16:16:05.823 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.822+0000 7f1b5fb21800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:16:05.823 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.822+0000 7f1b5fb21800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:16:05.823 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.823+0000 7f1b5fb21800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:16:05.824 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.824+0000 7f1b5fb21800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-06-04T16:16:05.826 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.825+0000 7f1b5fb21800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:16:05.826 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.825+0000 7f1b5fb21800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:16:05.826 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.826+0000 7f1b5fb21800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:16:05.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.826+0000 7f1b5fb21800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-06-04T16:16:05.828 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.828+0000 7f1b5fb21800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:16:05.829 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.828+0000 7f1b5fb21800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:16:05.829 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.828+0000 7f1b5fb21800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:16:05.830 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.829+0000 7f1b5fb21800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-06-04T16:16:05.831 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.830+0000 7f1b5fb21800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:16:05.831 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.831+0000 7f1b5fb21800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:16:05.832 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.831+0000 7f1b5fb21800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:16:05.833 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.832+0000 7f1b5fb21800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-06-04T16:16:05.834 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.833+0000 7f1b5fb21800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:16:05.834 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.834+0000 7f1b5fb21800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:16:05.835 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.834+0000 7f1b5fb21800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:16:05.835 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.835+0000 7f1b5fb21800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-06-04T16:16:05.836 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.836+0000 7f1b5fb21800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:16:05.837 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.836+0000 7f1b5fb21800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:16:05.837 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.836+0000 7f1b5fb21800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:16:05.838 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.837+0000 7f1b5fb21800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-06-04T16:16:05.840 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.839+0000 7f1b5fb21800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:16:05.840 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.839+0000 7f1b5fb21800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:16:05.840 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.839+0000 7f1b5fb21800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:16:05.841 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.840+0000 7f1b5fb21800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-06-04T16:16:05.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.841+0000 7f1b5fb21800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:16:05.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.842+0000 7f1b5fb21800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:16:05.843 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.842+0000 7f1b5fb21800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:16:05.843 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.843+0000 7f1b5fb21800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-06-04T16:16:05.845 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.844+0000 7f1b5fb21800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:16:05.845 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.844+0000 7f1b5fb21800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:16:05.845 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.845+0000 7f1b5fb21800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:16:05.847 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.846+0000 7f1a11fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-06-04T16:16:05.849 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.848+0000 7f1b5fb21800 20 remove_watcher() i=0 2024-06-04T16:16:05.849 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.848+0000 7f1b5fb21800 2 removed watcher, disabling cache 2024-06-04T16:16:05.850 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.849+0000 7f1b5fb21800 20 remove_watcher() i=1 2024-06-04T16:16:05.851 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.850+0000 7f1b5fb21800 20 remove_watcher() i=2 2024-06-04T16:16:05.852 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.851+0000 7f1b5fb21800 20 remove_watcher() i=3 2024-06-04T16:16:05.853 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.852+0000 7f1b5fb21800 20 remove_watcher() i=4 2024-06-04T16:16:05.854 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.853+0000 7f1b5fb21800 20 remove_watcher() i=5 2024-06-04T16:16:05.855 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.854+0000 7f1b5fb21800 20 remove_watcher() i=6 2024-06-04T16:16:05.856 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:05.855+0000 7f1b5fb21800 20 remove_watcher() i=7 2024-06-04T16:16:05.867 INFO:teuthology.run_tasks:Running task s3tests... 2024-06-04T16:16:05.884 DEBUG:tasks.s3tests:s3tests config is {'client.0': {'rgw_server': 'client.0', 'force-branch': 'ceph-master', 'slow_backend': True, 'storage classes': 'LUKEWARM, FROZEN'}} 2024-06-04T16:16:05.884 INFO:tasks.s3tests:Downloading s3-tests... 2024-06-04T16:16:05.884 INFO:tasks.s3tests:Using branch 'ceph-master' for s3tests 2024-06-04T16:16:05.884 DEBUG:teuthology.orchestra.run.smithi144:> git clone -b ceph-master https://git.ceph.com/s3-tests.git /home/ubuntu/cephtest/s3-tests-client.0 2024-06-04T16:16:05.913 INFO:teuthology.orchestra.run.smithi144.stderr:Cloning into '/home/ubuntu/cephtest/s3-tests-client.0'... 2024-06-04T16:16:06.738 INFO:tasks.s3tests:Creating rgw users... 2024-06-04T16:16:06.739 DEBUG:tasks.s3tests:Creating user foo.client.0 on client.0 2024-06-04T16:16:06.739 DEBUG:teuthology.orchestra.run.smithi144:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid foo.client.0 --display-name 'Mr. foo.client.0' --email foo.client.0+test@test.test --caps 'user-policy=*' --access-key KUBRPFAIRGMIHIXSVCZS --secret /TdSQmOZkj3eaWefl2myUwVeSHBJezVPTtT8pq4KPN2hEoHYsVTm4Q== --cluster ceph 2024-06-04T16:16:06.845 INFO:teuthology.orchestra.run.smithi144.stderr:ignoring --setuser ceph since I am not root 2024-06-04T16:16:06.845 INFO:teuthology.orchestra.run.smithi144.stderr:ignoring --setgroup ceph since I am not root 2024-06-04T16:16:06.879 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:06.878+0000 7f4f07a8f800 20 rados->read ofs=0 len=0 2024-06-04T16:16:06.881 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:06.880+0000 7f4f07a8f800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:16:06.881 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:06.880+0000 7f4f07a8f800 20 realm 2024-06-04T16:16:06.881 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:06.880+0000 7f4f07a8f800 20 rados->read ofs=0 len=0 2024-06-04T16:16:06.881 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:06.880+0000 7f4f07a8f800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:16:06.881 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:06.880+0000 7f4f07a8f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-06-04T16:16:06.881 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:06.880+0000 7f4f07a8f800 20 rados->read ofs=0 len=0 2024-06-04T16:16:06.881 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:06.880+0000 7f4f07a8f800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:16:06.881 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:06.880+0000 7f4f07a8f800 20 rados->read ofs=0 len=0 2024-06-04T16:16:06.882 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:06.881+0000 7f4f07a8f800 20 rados_obj.operate() r=0 bl.length=46 2024-06-04T16:16:06.882 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:06.881+0000 7f4f07a8f800 20 rados->read ofs=0 len=0 2024-06-04T16:16:06.882 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:06.881+0000 7f4f07a8f800 20 rados_obj.operate() r=0 bl.length=1139 2024-06-04T16:16:06.882 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:06.881+0000 7f4f07a8f800 20 searching for the correct realm 2024-06-04T16:16:06.885 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:06.884+0000 7f4f05d85640 0 -- 172.21.15.144:0/63956526 >> [v2:172.21.15.144:6800/1453747520,v1:172.21.15.144:6801/1453747520] conn(0x7f4ef0072440 msgr2=0x7f4ef0081ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-06-04T16:16:07.090 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:07.089+0000 7f4f05d85640 0 -- 172.21.15.144:0/63956526 >> [v2:172.21.15.144:6824/166159729,v1:172.21.15.144:6825/166159729] conn(0x5652d5567160 msgr2=0x5652d5569570 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-06-04T16:16:07.095 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:07.094+0000 7f4f07a8f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-06-04T16:16:07.096 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:07.094+0000 7f4f07a8f800 20 RGWRados::pool_iterate: got zone_info.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767 2024-06-04T16:16:07.096 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:07.094+0000 7f4f07a8f800 20 RGWRados::pool_iterate: got default.zone. 2024-06-04T16:16:07.096 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:07.094+0000 7f4f07a8f800 20 RGWRados::pool_iterate: got zonegroup_info.abb22408-c332-4e28-8f7a-ff254ea2fed2 2024-06-04T16:16:07.096 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:07.094+0000 7f4f07a8f800 20 RGWRados::pool_iterate: got zone_names.default 2024-06-04T16:16:07.096 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:07.094+0000 7f4f07a8f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-06-04T16:16:07.096 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:07.094+0000 7f4f07a8f800 20 rados->read ofs=0 len=0 2024-06-04T16:16:07.096 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:07.095+0000 7f4f07a8f800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:16:07.096 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:07.095+0000 7f4f07a8f800 20 rados->read ofs=0 len=0 2024-06-04T16:16:07.097 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:07.095+0000 7f4f07a8f800 20 rados_obj.operate() r=0 bl.length=46 2024-06-04T16:16:07.097 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:07.095+0000 7f4f07a8f800 20 rados->read ofs=0 len=0 2024-06-04T16:16:07.097 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:07.095+0000 7f4f07a8f800 20 rados_obj.operate() r=0 bl.length=470 2024-06-04T16:16:07.097 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:07.095+0000 7f4f07a8f800 20 zone default found 2024-06-04T16:16:07.098 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:07.095+0000 7f4f07a8f800 4 Realm: () 2024-06-04T16:16:07.098 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:07.095+0000 7f4f07a8f800 4 ZoneGroup: default (abb22408-c332-4e28-8f7a-ff254ea2fed2) 2024-06-04T16:16:07.098 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:07.095+0000 7f4f07a8f800 4 Zone: default (be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767) 2024-06-04T16:16:07.098 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:07.095+0000 7f4f07a8f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-06-04T16:16:07.098 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:07.095+0000 7f4f07a8f800 20 zonegroup default 2024-06-04T16:16:07.098 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:07.095+0000 7f4f07a8f800 20 rados->read ofs=0 len=0 2024-06-04T16:16:07.098 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:07.096+0000 7f4f07a8f800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:16:07.098 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:07.096+0000 7f4f07a8f800 20 rados->read ofs=0 len=0 2024-06-04T16:16:07.098 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:07.096+0000 7f4f07a8f800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:16:07.098 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:07.096+0000 7f4f07a8f800 20 rados->read ofs=0 len=0 2024-06-04T16:16:07.098 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:07.096+0000 7f4f07a8f800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:16:07.098 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:07.096+0000 7f4f07a8f800 20 started sync module instance, tier type = 2024-06-04T16:16:07.099 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:07.096+0000 7f4f07a8f800 20 started zone id=be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767 (name=default) with tier type = 2024-06-04T16:16:07.107 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:07.106+0000 7f4f07a8f800 20 add_watcher() i=0 2024-06-04T16:16:07.107 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:07.106+0000 7f4f07a8f800 20 add_watcher() i=1 2024-06-04T16:16:07.107 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:07.106+0000 7f4f07a8f800 20 add_watcher() i=2 2024-06-04T16:16:07.107 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:07.106+0000 7f4f07a8f800 20 add_watcher() i=3 2024-06-04T16:16:07.107 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:07.106+0000 7f4f07a8f800 20 add_watcher() i=4 2024-06-04T16:16:07.107 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:07.106+0000 7f4f07a8f800 20 add_watcher() i=5 2024-06-04T16:16:07.107 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:07.106+0000 7f4f07a8f800 20 add_watcher() i=6 2024-06-04T16:16:07.108 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:07.107+0000 7f4f07a8f800 20 add_watcher() i=7 2024-06-04T16:16:07.108 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:07.107+0000 7f4f07a8f800 2 all 8 watchers are set, enabling cache 2024-06-04T16:16:07.112 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:07.110+0000 7f4dbbfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-06-04T16:16:07.112 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:07.110+0000 7f4f07a8f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-06-04T16:16:07.112 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:07.110+0000 7f4f07a8f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-06-04T16:16:07.112 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:07.110+0000 7f4f07a8f800 5 note: GC not initialized 2024-06-04T16:16:07.112 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:07.110+0000 7f4dbafe5640 20 reqs_thread_entry: start 2024-06-04T16:16:07.112 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:07.110+0000 7f4f07a8f800 20 init_complete bucket index max shards: 11 2024-06-04T16:16:07.112 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:07.111+0000 7f4f07a8f800 20 Filter name: none 2024-06-04T16:16:07.112 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:07.111+0000 7f4db8fe1640 20 reqs_thread_entry: start 2024-06-04T16:16:07.112 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:07.111+0000 7f4f07a8f800 10 cache get: name=default.rgw.meta+users.uid+foo.client.0 : miss 2024-06-04T16:16:07.112 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:07.111+0000 7f4f07a8f800 20 rados->read ofs=0 len=0 2024-06-04T16:16:07.112 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:07.111+0000 7f4f07a8f800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:16:07.112 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:07.111+0000 7f4f07a8f800 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x0 2024-06-04T16:16:07.113 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:07.111+0000 7f4f07a8f800 10 adding default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-06-04T16:16:07.113 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:07.111+0000 7f4f07a8f800 10 cache get: name=default.rgw.meta+users.email+foo.client.0+test@test.test : miss 2024-06-04T16:16:07.113 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:07.111+0000 7f4f07a8f800 20 rados->read ofs=0 len=0 2024-06-04T16:16:07.114 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:07.111+0000 7f4f07a8f800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:16:07.114 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:07.111+0000 7f4f07a8f800 10 cache put: name=default.rgw.meta+users.email+foo.client.0+test@test.test info.flags=0x0 2024-06-04T16:16:07.114 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:07.111+0000 7f4f07a8f800 10 adding default.rgw.meta+users.email+foo.client.0+test@test.test to cache LRU end 2024-06-04T16:16:07.114 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:07.111+0000 7f4f07a8f800 10 cache get: name=default.rgw.meta+users.keys+KUBRPFAIRGMIHIXSVCZS : miss 2024-06-04T16:16:07.114 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:07.111+0000 7f4f07a8f800 20 rados->read ofs=0 len=0 2024-06-04T16:16:07.114 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:07.111+0000 7f4f07a8f800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:16:07.114 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:07.111+0000 7f4f07a8f800 10 cache put: name=default.rgw.meta+users.keys+KUBRPFAIRGMIHIXSVCZS info.flags=0x0 2024-06-04T16:16:07.114 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:07.111+0000 7f4f07a8f800 10 adding default.rgw.meta+users.keys+KUBRPFAIRGMIHIXSVCZS to cache LRU end 2024-06-04T16:16:07.114 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:07.111+0000 7f4f07a8f800 10 cache get: name=default.rgw.meta+users.keys+KUBRPFAIRGMIHIXSVCZS : hit (negative entry) 2024-06-04T16:16:07.114 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:07.111+0000 7f4f07a8f800 10 cache get: name=default.rgw.meta+users.keys+KUBRPFAIRGMIHIXSVCZS : hit (negative entry) 2024-06-04T16:16:07.114 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:07.113+0000 7f4f07a8f800 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2024-06-04T16:16:07.115 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:07.113+0000 7f4f07a8f800 10 moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-06-04T16:16:07.115 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:07.113+0000 7f4f07a8f800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.uid:foo.client.0, ofs0, ns] 2024-06-04T16:16:07.115 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:07.113+0000 7f4de8ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1078036791380 cookie 94913766524848 notifier 7593 bl.length()=674 2024-06-04T16:16:07.115 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:07.113+0000 7f4de8ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2024-06-04T16:16:07.115 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:07.113+0000 7f4de8ff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-06-04T16:16:07.115 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:07.114+0000 7f4f07a8f800 10 cache put: name=default.rgw.meta+users.email+foo.client.0+test@test.test info.flags=0x7 2024-06-04T16:16:07.116 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:07.114+0000 7f4f07a8f800 10 moving default.rgw.meta+users.email+foo.client.0+test@test.test to cache LRU end 2024-06-04T16:16:07.116 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:07.114+0000 7f4f07a8f800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:users.email:foo.client.0+test@test.test, ofs0, ns] 2024-06-04T16:16:07.116 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:07.115+0000 7f4de8ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1078036791558 cookie 94913766564288 notifier 7593 bl.length()=194 2024-06-04T16:16:07.116 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:07.115+0000 7f4de8ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+foo.client.0+test@test.test info.flags=0x7 2024-06-04T16:16:07.116 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:07.115+0000 7f4de8ff9640 10 rgw watcher librados: moving default.rgw.meta+users.email+foo.client.0+test@test.test to cache LRU end 2024-06-04T16:16:07.117 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:07.116+0000 7f4f07a8f800 10 cache put: name=default.rgw.meta+users.keys+KUBRPFAIRGMIHIXSVCZS info.flags=0x7 2024-06-04T16:16:07.117 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:07.116+0000 7f4f07a8f800 10 moving default.rgw.meta+users.keys+KUBRPFAIRGMIHIXSVCZS to cache LRU end 2024-06-04T16:16:07.117 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:07.116+0000 7f4f07a8f800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:users.keys:KUBRPFAIRGMIHIXSVCZS, ofs0, ns] 2024-06-04T16:16:07.118 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:07.117+0000 7f4dd7fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1078036791559 cookie 94913766564288 notifier 7593 bl.length()=186 2024-06-04T16:16:07.118 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:07.117+0000 7f4dd7fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+KUBRPFAIRGMIHIXSVCZS info.flags=0x7 2024-06-04T16:16:07.118 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:07.117+0000 7f4dd7fff640 10 rgw watcher librados: moving default.rgw.meta+users.keys+KUBRPFAIRGMIHIXSVCZS to cache LRU end 2024-06-04T16:16:07.118 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-06-04T16:16:07.118 INFO:teuthology.orchestra.run.smithi144.stdout: "user_id": "foo.client.0", 2024-06-04T16:16:07.118 INFO:teuthology.orchestra.run.smithi144.stdout: "display_name": "Mr. foo.client.0", 2024-06-04T16:16:07.118 INFO:teuthology.orchestra.run.smithi144.stdout: "email": "foo.client.0+test@test.test", 2024-06-04T16:16:07.118 INFO:teuthology.orchestra.run.smithi144.stdout: "suspended": 0, 2024-06-04T16:16:07.119 INFO:teuthology.orchestra.run.smithi144.stdout: "max_buckets": 1000, 2024-06-04T16:16:07.119 INFO:teuthology.orchestra.run.smithi144.stdout: "subusers": [], 2024-06-04T16:16:07.119 INFO:teuthology.orchestra.run.smithi144.stdout: "keys": [ 2024-06-04T16:16:07.119 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-06-04T16:16:07.119 INFO:teuthology.orchestra.run.smithi144.stdout: "user": "foo.client.0", 2024-06-04T16:16:07.119 INFO:teuthology.orchestra.run.smithi144.stdout: "access_key": "KUBRPFAIRGMIHIXSVCZS", 2024-06-04T16:16:07.119 INFO:teuthology.orchestra.run.smithi144.stdout: "secret_key": "/TdSQmOZkj3eaWefl2myUwVeSHBJezVPTtT8pq4KPN2hEoHYsVTm4Q==", 2024-06-04T16:16:07.119 INFO:teuthology.orchestra.run.smithi144.stdout: "active": true, 2024-06-04T16:16:07.119 INFO:teuthology.orchestra.run.smithi144.stdout: "create_date": "2024-06-04T16:16:07.112788Z" 2024-06-04T16:16:07.119 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-06-04T16:16:07.119 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-06-04T16:16:07.119 INFO:teuthology.orchestra.run.smithi144.stdout: "swift_keys": [], 2024-06-04T16:16:07.120 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": [ 2024-06-04T16:16:07.120 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-06-04T16:16:07.120 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "user-policy", 2024-06-04T16:16:07.120 INFO:teuthology.orchestra.run.smithi144.stdout: "perm": "*" 2024-06-04T16:16:07.120 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-06-04T16:16:07.120 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-06-04T16:16:07.120 INFO:teuthology.orchestra.run.smithi144.stdout: "op_mask": "read, write, delete", 2024-06-04T16:16:07.120 INFO:teuthology.orchestra.run.smithi144.stdout: "default_placement": "", 2024-06-04T16:16:07.120 INFO:teuthology.orchestra.run.smithi144.stdout: "default_storage_class": "", 2024-06-04T16:16:07.120 INFO:teuthology.orchestra.run.smithi144.stdout: "placement_tags": [], 2024-06-04T16:16:07.120 INFO:teuthology.orchestra.run.smithi144.stdout: "bucket_quota": { 2024-06-04T16:16:07.120 INFO:teuthology.orchestra.run.smithi144.stdout: "enabled": false, 2024-06-04T16:16:07.120 INFO:teuthology.orchestra.run.smithi144.stdout: "check_on_raw": false, 2024-06-04T16:16:07.120 INFO:teuthology.orchestra.run.smithi144.stdout: "max_size": -1, 2024-06-04T16:16:07.120 INFO:teuthology.orchestra.run.smithi144.stdout: "max_size_kb": 0, 2024-06-04T16:16:07.121 INFO:teuthology.orchestra.run.smithi144.stdout: "max_objects": -1 2024-06-04T16:16:07.121 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-06-04T16:16:07.121 INFO:teuthology.orchestra.run.smithi144.stdout: "user_quota": { 2024-06-04T16:16:07.121 INFO:teuthology.orchestra.run.smithi144.stdout: "enabled": false, 2024-06-04T16:16:07.121 INFO:teuthology.orchestra.run.smithi144.stdout: "check_on_raw": false, 2024-06-04T16:16:07.121 INFO:teuthology.orchestra.run.smithi144.stdout: "max_size": -1, 2024-06-04T16:16:07.121 INFO:teuthology.orchestra.run.smithi144.stdout: "max_size_kb": 0, 2024-06-04T16:16:07.121 INFO:teuthology.orchestra.run.smithi144.stdout: "max_objects": -1 2024-06-04T16:16:07.121 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-06-04T16:16:07.121 INFO:teuthology.orchestra.run.smithi144.stdout: "temp_url_keys": [], 2024-06-04T16:16:07.121 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "rgw", 2024-06-04T16:16:07.121 INFO:teuthology.orchestra.run.smithi144.stdout: "mfa_ids": [], 2024-06-04T16:16:07.121 INFO:teuthology.orchestra.run.smithi144.stdout: "account_id": "", 2024-06-04T16:16:07.121 INFO:teuthology.orchestra.run.smithi144.stdout: "path": "/", 2024-06-04T16:16:07.122 INFO:teuthology.orchestra.run.smithi144.stdout: "create_date": "2024-06-04T16:16:07.112779Z", 2024-06-04T16:16:07.122 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-06-04T16:16:07.122 INFO:teuthology.orchestra.run.smithi144.stdout: "group_ids": [] 2024-06-04T16:16:07.122 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-06-04T16:16:07.122 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:16:07.123 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:07.118+0000 7f4dbbfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-06-04T16:16:07.123 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:07.120+0000 7f4f07a8f800 20 remove_watcher() i=0 2024-06-04T16:16:07.123 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:07.120+0000 7f4f07a8f800 2 removed watcher, disabling cache 2024-06-04T16:16:07.123 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:07.121+0000 7f4f07a8f800 20 remove_watcher() i=1 2024-06-04T16:16:07.123 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:07.122+0000 7f4f07a8f800 20 remove_watcher() i=2 2024-06-04T16:16:07.124 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:07.123+0000 7f4f07a8f800 20 remove_watcher() i=3 2024-06-04T16:16:07.125 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:07.124+0000 7f4f07a8f800 20 remove_watcher() i=4 2024-06-04T16:16:07.126 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:07.125+0000 7f4f07a8f800 20 remove_watcher() i=5 2024-06-04T16:16:07.127 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:07.127+0000 7f4f07a8f800 20 remove_watcher() i=6 2024-06-04T16:16:07.128 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:07.128+0000 7f4f07a8f800 20 remove_watcher() i=7 2024-06-04T16:16:07.139 DEBUG:teuthology.orchestra.run.smithi144:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid foo.client.0 --totp-serial 4675920726 --totp-seed UADVECQS72TLXR22FDRWZCRWLL52WUUCQEQXID4PFOFCOKRJ57W526WAOCVMJI4E --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-06-04T16:16:07.204 INFO:teuthology.orchestra.run.smithi144.stderr:ignoring --setuser ceph since I am not root 2024-06-04T16:16:07.205 INFO:teuthology.orchestra.run.smithi144.stderr:ignoring --setgroup ceph since I am not root 2024-06-04T16:16:07.238 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:07.237+0000 7faf4f031800 20 rados->read ofs=0 len=0 2024-06-04T16:16:07.240 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:07.238+0000 7faf4f031800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:16:07.240 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:07.238+0000 7faf4f031800 20 realm 2024-06-04T16:16:07.240 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:07.238+0000 7faf4f031800 20 rados->read ofs=0 len=0 2024-06-04T16:16:07.240 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:07.239+0000 7faf4f031800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:16:07.240 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:07.239+0000 7faf4f031800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-06-04T16:16:07.240 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:07.239+0000 7faf4f031800 20 rados->read ofs=0 len=0 2024-06-04T16:16:07.240 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:07.239+0000 7faf4f031800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:16:07.240 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:07.239+0000 7faf4f031800 20 rados->read ofs=0 len=0 2024-06-04T16:16:07.241 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:07.240+0000 7faf4f031800 20 rados_obj.operate() r=0 bl.length=46 2024-06-04T16:16:07.241 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:07.240+0000 7faf4f031800 20 rados->read ofs=0 len=0 2024-06-04T16:16:07.241 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:07.240+0000 7faf4f031800 20 rados_obj.operate() r=0 bl.length=1139 2024-06-04T16:16:07.241 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:07.240+0000 7faf4f031800 20 searching for the correct realm 2024-06-04T16:16:07.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:07.242+0000 7faf4a9c1640 0 -- 172.21.15.144:0/378125021 >> [v2:172.21.15.144:6800/1453747520,v1:172.21.15.144:6801/1453747520] conn(0x7faf40029070 msgr2=0x7faf400695e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-06-04T16:16:07.449 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:07.448+0000 7faf4a9c1640 0 -- 172.21.15.144:0/378125021 >> [v2:172.21.15.144:6824/166159729,v1:172.21.15.144:6825/166159729] conn(0x5650d3e0d960 msgr2=0x5650d3e0fd50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-06-04T16:16:07.455 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:07.454+0000 7faf4f031800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-06-04T16:16:07.455 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:07.454+0000 7faf4f031800 20 RGWRados::pool_iterate: got zone_info.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767 2024-06-04T16:16:07.455 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:07.454+0000 7faf4f031800 20 RGWRados::pool_iterate: got default.zone. 2024-06-04T16:16:07.455 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:07.454+0000 7faf4f031800 20 RGWRados::pool_iterate: got zonegroup_info.abb22408-c332-4e28-8f7a-ff254ea2fed2 2024-06-04T16:16:07.455 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:07.454+0000 7faf4f031800 20 RGWRados::pool_iterate: got zone_names.default 2024-06-04T16:16:07.455 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:07.454+0000 7faf4f031800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-06-04T16:16:07.455 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:07.454+0000 7faf4f031800 20 rados->read ofs=0 len=0 2024-06-04T16:16:07.455 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:07.454+0000 7faf4f031800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:16:07.456 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:07.454+0000 7faf4f031800 20 rados->read ofs=0 len=0 2024-06-04T16:16:07.456 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:07.454+0000 7faf4f031800 20 rados_obj.operate() r=0 bl.length=46 2024-06-04T16:16:07.456 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:07.454+0000 7faf4f031800 20 rados->read ofs=0 len=0 2024-06-04T16:16:07.456 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:07.455+0000 7faf4f031800 20 rados_obj.operate() r=0 bl.length=470 2024-06-04T16:16:07.457 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:07.455+0000 7faf4f031800 20 zone default found 2024-06-04T16:16:07.457 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:07.455+0000 7faf4f031800 4 Realm: () 2024-06-04T16:16:07.457 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:07.455+0000 7faf4f031800 4 ZoneGroup: default (abb22408-c332-4e28-8f7a-ff254ea2fed2) 2024-06-04T16:16:07.457 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:07.455+0000 7faf4f031800 4 Zone: default (be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767) 2024-06-04T16:16:07.457 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:07.455+0000 7faf4f031800 10 cannot find current period zonegroup using local zonegroup configuration 2024-06-04T16:16:07.457 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:07.455+0000 7faf4f031800 20 zonegroup default 2024-06-04T16:16:07.457 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:07.455+0000 7faf4f031800 20 rados->read ofs=0 len=0 2024-06-04T16:16:07.457 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:07.455+0000 7faf4f031800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:16:07.457 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:07.455+0000 7faf4f031800 20 rados->read ofs=0 len=0 2024-06-04T16:16:07.457 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:07.455+0000 7faf4f031800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:16:07.457 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:07.455+0000 7faf4f031800 20 rados->read ofs=0 len=0 2024-06-04T16:16:07.458 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:07.456+0000 7faf4f031800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:16:07.458 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:07.456+0000 7faf4f031800 20 started sync module instance, tier type = 2024-06-04T16:16:07.458 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:07.456+0000 7faf4f031800 20 started zone id=be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767 (name=default) with tier type = 2024-06-04T16:16:07.466 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:07.466+0000 7faf4f031800 20 add_watcher() i=0 2024-06-04T16:16:07.466 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:07.466+0000 7faf4f031800 20 add_watcher() i=1 2024-06-04T16:16:07.467 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:07.466+0000 7faf4f031800 20 add_watcher() i=2 2024-06-04T16:16:07.467 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:07.466+0000 7faf4f031800 20 add_watcher() i=3 2024-06-04T16:16:07.467 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:07.466+0000 7faf4f031800 20 add_watcher() i=4 2024-06-04T16:16:07.467 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:07.466+0000 7faf4f031800 20 add_watcher() i=5 2024-06-04T16:16:07.467 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:07.466+0000 7faf4f031800 20 add_watcher() i=6 2024-06-04T16:16:07.467 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:07.467+0000 7faf4f031800 20 add_watcher() i=7 2024-06-04T16:16:07.468 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:07.467+0000 7faf4f031800 2 all 8 watchers are set, enabling cache 2024-06-04T16:16:07.470 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:07.469+0000 7fae00fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-06-04T16:16:07.470 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:07.469+0000 7faf4f031800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-06-04T16:16:07.470 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:07.469+0000 7faf4f031800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-06-04T16:16:07.470 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:07.469+0000 7faf4f031800 5 note: GC not initialized 2024-06-04T16:16:07.471 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:07.469+0000 7fad7b7fe640 20 reqs_thread_entry: start 2024-06-04T16:16:07.471 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:07.469+0000 7faf4f031800 20 init_complete bucket index max shards: 11 2024-06-04T16:16:07.471 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:07.469+0000 7faf4f031800 20 Filter name: none 2024-06-04T16:16:07.471 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:07.469+0000 7fad797fa640 20 reqs_thread_entry: start 2024-06-04T16:16:07.471 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:07.469+0000 7faf4f031800 10 cache get: name=default.rgw.meta+users.uid+foo.client.0 : miss 2024-06-04T16:16:07.471 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:07.469+0000 7faf4f031800 20 rados->read ofs=0 len=0 2024-06-04T16:16:07.471 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:07.470+0000 7faf4f031800 20 rados_obj.operate() r=0 bl.length=489 2024-06-04T16:16:07.471 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:07.470+0000 7faf4f031800 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x13 2024-06-04T16:16:07.471 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:07.470+0000 7faf4f031800 10 adding default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-06-04T16:16:07.472 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:07.470+0000 7faf4f031800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-06-04T16:16:08.667 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:08.666+0000 7faf4f031800 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2024-06-04T16:16:08.667 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:08.666+0000 7faf4f031800 10 moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-06-04T16:16:08.667 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:08.666+0000 7faf4f031800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.uid:foo.client.0, ofs0, ns] 2024-06-04T16:16:08.667 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:08.666+0000 7fae2d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1086626725973 cookie 94905152106224 notifier 7166 bl.length()=688 2024-06-04T16:16:08.667 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:08.666+0000 7fae2d7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2024-06-04T16:16:08.667 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:08.666+0000 7fae2d7fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-06-04T16:16:08.668 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:08.667+0000 7fae00fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-06-04T16:16:08.671 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:08.670+0000 7faf4f031800 20 remove_watcher() i=0 2024-06-04T16:16:08.671 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:08.670+0000 7faf4f031800 2 removed watcher, disabling cache 2024-06-04T16:16:08.672 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:08.671+0000 7faf4f031800 20 remove_watcher() i=1 2024-06-04T16:16:08.673 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:08.672+0000 7faf4f031800 20 remove_watcher() i=2 2024-06-04T16:16:08.674 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:08.673+0000 7faf4f031800 20 remove_watcher() i=3 2024-06-04T16:16:08.675 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:08.674+0000 7faf4f031800 20 remove_watcher() i=4 2024-06-04T16:16:08.676 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:08.676+0000 7faf4f031800 20 remove_watcher() i=5 2024-06-04T16:16:08.678 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:08.677+0000 7faf4f031800 20 remove_watcher() i=6 2024-06-04T16:16:08.679 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:08.678+0000 7faf4f031800 20 remove_watcher() i=7 2024-06-04T16:16:08.691 DEBUG:tasks.s3tests:Creating user bar.client.0 on client.0 2024-06-04T16:16:08.691 DEBUG:teuthology.orchestra.run.smithi144:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid bar.client.0 --display-name 'Mr. bar.client.0' --email bar.client.0+test@test.test --caps 'user-policy=*' --access-key ZLRHBZWMCPRZDXPQAVMN --secret WS/lxm0ABz7aZHb/AE6FX7WOqQE/j32o1iRtBxO94hPXERaMMo/Lwg== --cluster ceph 2024-06-04T16:16:08.761 INFO:teuthology.orchestra.run.smithi144.stderr:ignoring --setuser ceph since I am not root 2024-06-04T16:16:08.761 INFO:teuthology.orchestra.run.smithi144.stderr:ignoring --setgroup ceph since I am not root 2024-06-04T16:16:08.795 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:08.794+0000 7f837de30800 20 rados->read ofs=0 len=0 2024-06-04T16:16:08.797 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:08.796+0000 7f837de30800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:16:08.797 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:08.796+0000 7f837de30800 20 realm 2024-06-04T16:16:08.797 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:08.796+0000 7f837de30800 20 rados->read ofs=0 len=0 2024-06-04T16:16:08.797 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:08.796+0000 7f837de30800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:16:08.797 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:08.796+0000 7f837de30800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-06-04T16:16:08.797 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:08.796+0000 7f837de30800 20 rados->read ofs=0 len=0 2024-06-04T16:16:08.798 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:08.797+0000 7f837de30800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:16:08.798 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:08.797+0000 7f837de30800 20 rados->read ofs=0 len=0 2024-06-04T16:16:08.798 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:08.797+0000 7f837de30800 20 rados_obj.operate() r=0 bl.length=46 2024-06-04T16:16:08.798 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:08.797+0000 7f837de30800 20 rados->read ofs=0 len=0 2024-06-04T16:16:08.799 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:08.798+0000 7f837de30800 20 rados_obj.operate() r=0 bl.length=1139 2024-06-04T16:16:08.799 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:08.798+0000 7f837de30800 20 searching for the correct realm 2024-06-04T16:16:08.799 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:08.799+0000 7f8379081640 0 -- 172.21.15.144:0/2622644477 >> [v2:172.21.15.177:6816/2039473917,v1:172.21.15.177:6817/2039473917] conn(0x555bc54c9180 msgr2=0x555bc54cb5f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-06-04T16:16:08.803 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:08.802+0000 7f8379081640 0 -- 172.21.15.144:0/2622644477 >> [v2:172.21.15.177:6800/3891611393,v1:172.21.15.177:6801/3891611393] conn(0x7f836c08e500 msgr2=0x7f836c08c670 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-06-04T16:16:09.012 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.011+0000 7f837de30800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-06-04T16:16:09.013 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.011+0000 7f837de30800 20 RGWRados::pool_iterate: got zone_info.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767 2024-06-04T16:16:09.013 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.011+0000 7f837de30800 20 RGWRados::pool_iterate: got default.zone. 2024-06-04T16:16:09.013 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.011+0000 7f837de30800 20 RGWRados::pool_iterate: got zonegroup_info.abb22408-c332-4e28-8f7a-ff254ea2fed2 2024-06-04T16:16:09.013 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.011+0000 7f837de30800 20 RGWRados::pool_iterate: got zone_names.default 2024-06-04T16:16:09.013 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.011+0000 7f837de30800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-06-04T16:16:09.013 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.011+0000 7f837de30800 20 rados->read ofs=0 len=0 2024-06-04T16:16:09.013 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.011+0000 7f837de30800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:16:09.013 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.011+0000 7f837de30800 20 rados->read ofs=0 len=0 2024-06-04T16:16:09.013 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.012+0000 7f837de30800 20 rados_obj.operate() r=0 bl.length=46 2024-06-04T16:16:09.013 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.012+0000 7f837de30800 20 rados->read ofs=0 len=0 2024-06-04T16:16:09.014 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.012+0000 7f837de30800 20 rados_obj.operate() r=0 bl.length=470 2024-06-04T16:16:09.014 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.012+0000 7f837de30800 20 zone default found 2024-06-04T16:16:09.014 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.012+0000 7f837de30800 4 Realm: () 2024-06-04T16:16:09.015 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.012+0000 7f837de30800 4 ZoneGroup: default (abb22408-c332-4e28-8f7a-ff254ea2fed2) 2024-06-04T16:16:09.015 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.012+0000 7f837de30800 4 Zone: default (be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767) 2024-06-04T16:16:09.015 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.012+0000 7f837de30800 10 cannot find current period zonegroup using local zonegroup configuration 2024-06-04T16:16:09.015 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.012+0000 7f837de30800 20 zonegroup default 2024-06-04T16:16:09.015 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.012+0000 7f837de30800 20 rados->read ofs=0 len=0 2024-06-04T16:16:09.015 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.012+0000 7f837de30800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:16:09.015 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.012+0000 7f837de30800 20 rados->read ofs=0 len=0 2024-06-04T16:16:09.015 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.013+0000 7f837de30800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:16:09.015 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.013+0000 7f837de30800 20 rados->read ofs=0 len=0 2024-06-04T16:16:09.015 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.013+0000 7f837de30800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:16:09.015 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.013+0000 7f837de30800 20 started sync module instance, tier type = 2024-06-04T16:16:09.015 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.013+0000 7f837de30800 20 started zone id=be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767 (name=default) with tier type = 2024-06-04T16:16:09.023 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.023+0000 7f837de30800 20 add_watcher() i=0 2024-06-04T16:16:09.023 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.023+0000 7f837de30800 20 add_watcher() i=1 2024-06-04T16:16:09.023 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.023+0000 7f837de30800 20 add_watcher() i=2 2024-06-04T16:16:09.023 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.023+0000 7f837de30800 20 add_watcher() i=3 2024-06-04T16:16:09.024 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.023+0000 7f837de30800 20 add_watcher() i=4 2024-06-04T16:16:09.024 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.023+0000 7f837de30800 20 add_watcher() i=5 2024-06-04T16:16:09.024 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.023+0000 7f837de30800 20 add_watcher() i=6 2024-06-04T16:16:09.025 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.024+0000 7f837de30800 20 add_watcher() i=7 2024-06-04T16:16:09.025 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.024+0000 7f837de30800 2 all 8 watchers are set, enabling cache 2024-06-04T16:16:09.028 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.026+0000 7f822ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-06-04T16:16:09.028 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.026+0000 7f837de30800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-06-04T16:16:09.028 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.026+0000 7f837de30800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-06-04T16:16:09.028 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.026+0000 7f837de30800 5 note: GC not initialized 2024-06-04T16:16:09.028 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.026+0000 7f822efe5640 20 reqs_thread_entry: start 2024-06-04T16:16:09.028 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.026+0000 7f837de30800 20 init_complete bucket index max shards: 11 2024-06-04T16:16:09.028 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.026+0000 7f837de30800 20 Filter name: none 2024-06-04T16:16:09.028 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.026+0000 7f822cfe1640 20 reqs_thread_entry: start 2024-06-04T16:16:09.028 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.027+0000 7f837de30800 10 cache get: name=default.rgw.meta+users.uid+bar.client.0 : miss 2024-06-04T16:16:09.028 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.027+0000 7f837de30800 20 rados->read ofs=0 len=0 2024-06-04T16:16:09.029 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.027+0000 7f837de30800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:16:09.029 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.027+0000 7f837de30800 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x0 2024-06-04T16:16:09.029 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.027+0000 7f837de30800 10 adding default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-06-04T16:16:09.029 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.027+0000 7f837de30800 10 cache get: name=default.rgw.meta+users.email+bar.client.0+test@test.test : miss 2024-06-04T16:16:09.029 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.027+0000 7f837de30800 20 rados->read ofs=0 len=0 2024-06-04T16:16:09.029 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.027+0000 7f837de30800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:16:09.029 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.027+0000 7f837de30800 10 cache put: name=default.rgw.meta+users.email+bar.client.0+test@test.test info.flags=0x0 2024-06-04T16:16:09.029 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.027+0000 7f837de30800 10 adding default.rgw.meta+users.email+bar.client.0+test@test.test to cache LRU end 2024-06-04T16:16:09.029 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.027+0000 7f837de30800 10 cache get: name=default.rgw.meta+users.keys+ZLRHBZWMCPRZDXPQAVMN : miss 2024-06-04T16:16:09.029 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.027+0000 7f837de30800 20 rados->read ofs=0 len=0 2024-06-04T16:16:09.031 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.028+0000 7f837de30800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:16:09.031 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.028+0000 7f837de30800 10 cache put: name=default.rgw.meta+users.keys+ZLRHBZWMCPRZDXPQAVMN info.flags=0x0 2024-06-04T16:16:09.031 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.028+0000 7f837de30800 10 adding default.rgw.meta+users.keys+ZLRHBZWMCPRZDXPQAVMN to cache LRU end 2024-06-04T16:16:09.031 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.028+0000 7f837de30800 10 cache get: name=default.rgw.meta+users.keys+ZLRHBZWMCPRZDXPQAVMN : hit (negative entry) 2024-06-04T16:16:09.031 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.028+0000 7f837de30800 10 cache get: name=default.rgw.meta+users.keys+ZLRHBZWMCPRZDXPQAVMN : hit (negative entry) 2024-06-04T16:16:09.031 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.029+0000 7f837de30800 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2024-06-04T16:16:09.031 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.029+0000 7f837de30800 10 moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-06-04T16:16:09.031 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.029+0000 7f837de30800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:bar.client.0, ofs0, ns] 2024-06-04T16:16:09.031 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.029+0000 7f825cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1086626726133 cookie 93852640520448 notifier 7632 bl.length()=674 2024-06-04T16:16:09.031 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.029+0000 7f825cff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2024-06-04T16:16:09.031 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.029+0000 7f825cff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-06-04T16:16:09.032 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.030+0000 7f837de30800 10 cache put: name=default.rgw.meta+users.email+bar.client.0+test@test.test info.flags=0x7 2024-06-04T16:16:09.032 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.030+0000 7f837de30800 10 moving default.rgw.meta+users.email+bar.client.0+test@test.test to cache LRU end 2024-06-04T16:16:09.032 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.030+0000 7f837de30800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.email:bar.client.0+test@test.test, ofs0, ns] 2024-06-04T16:16:09.032 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.031+0000 7f825cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1086626726134 cookie 93852640520448 notifier 7632 bl.length()=194 2024-06-04T16:16:09.032 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.031+0000 7f825cff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+bar.client.0+test@test.test info.flags=0x7 2024-06-04T16:16:09.032 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.031+0000 7f825cff9640 10 rgw watcher librados: moving default.rgw.meta+users.email+bar.client.0+test@test.test to cache LRU end 2024-06-04T16:16:09.033 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.032+0000 7f837de30800 10 cache put: name=default.rgw.meta+users.keys+ZLRHBZWMCPRZDXPQAVMN info.flags=0x7 2024-06-04T16:16:09.033 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.032+0000 7f837de30800 10 moving default.rgw.meta+users.keys+ZLRHBZWMCPRZDXPQAVMN to cache LRU end 2024-06-04T16:16:09.033 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.032+0000 7f837de30800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.keys:ZLRHBZWMCPRZDXPQAVMN, ofs0, ns] 2024-06-04T16:16:09.034 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.033+0000 7f824bfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1086626726135 cookie 93852640539664 notifier 7632 bl.length()=186 2024-06-04T16:16:09.034 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.033+0000 7f824bfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+ZLRHBZWMCPRZDXPQAVMN info.flags=0x7 2024-06-04T16:16:09.034 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.033+0000 7f824bfff640 10 rgw watcher librados: moving default.rgw.meta+users.keys+ZLRHBZWMCPRZDXPQAVMN to cache LRU end 2024-06-04T16:16:09.034 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-06-04T16:16:09.034 INFO:teuthology.orchestra.run.smithi144.stdout: "user_id": "bar.client.0", 2024-06-04T16:16:09.034 INFO:teuthology.orchestra.run.smithi144.stdout: "display_name": "Mr. bar.client.0", 2024-06-04T16:16:09.034 INFO:teuthology.orchestra.run.smithi144.stdout: "email": "bar.client.0+test@test.test", 2024-06-04T16:16:09.034 INFO:teuthology.orchestra.run.smithi144.stdout: "suspended": 0, 2024-06-04T16:16:09.035 INFO:teuthology.orchestra.run.smithi144.stdout: "max_buckets": 1000, 2024-06-04T16:16:09.035 INFO:teuthology.orchestra.run.smithi144.stdout: "subusers": [], 2024-06-04T16:16:09.035 INFO:teuthology.orchestra.run.smithi144.stdout: "keys": [ 2024-06-04T16:16:09.035 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-06-04T16:16:09.035 INFO:teuthology.orchestra.run.smithi144.stdout: "user": "bar.client.0", 2024-06-04T16:16:09.035 INFO:teuthology.orchestra.run.smithi144.stdout: "access_key": "ZLRHBZWMCPRZDXPQAVMN", 2024-06-04T16:16:09.035 INFO:teuthology.orchestra.run.smithi144.stdout: "secret_key": "WS/lxm0ABz7aZHb/AE6FX7WOqQE/j32o1iRtBxO94hPXERaMMo/Lwg==", 2024-06-04T16:16:09.035 INFO:teuthology.orchestra.run.smithi144.stdout: "active": true, 2024-06-04T16:16:09.035 INFO:teuthology.orchestra.run.smithi144.stdout: "create_date": "2024-06-04T16:16:09.028916Z" 2024-06-04T16:16:09.035 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-06-04T16:16:09.035 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-06-04T16:16:09.035 INFO:teuthology.orchestra.run.smithi144.stdout: "swift_keys": [], 2024-06-04T16:16:09.035 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": [ 2024-06-04T16:16:09.035 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-06-04T16:16:09.035 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "user-policy", 2024-06-04T16:16:09.035 INFO:teuthology.orchestra.run.smithi144.stdout: "perm": "*" 2024-06-04T16:16:09.036 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-06-04T16:16:09.036 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-06-04T16:16:09.036 INFO:teuthology.orchestra.run.smithi144.stdout: "op_mask": "read, write, delete", 2024-06-04T16:16:09.036 INFO:teuthology.orchestra.run.smithi144.stdout: "default_placement": "", 2024-06-04T16:16:09.036 INFO:teuthology.orchestra.run.smithi144.stdout: "default_storage_class": "", 2024-06-04T16:16:09.036 INFO:teuthology.orchestra.run.smithi144.stdout: "placement_tags": [], 2024-06-04T16:16:09.036 INFO:teuthology.orchestra.run.smithi144.stdout: "bucket_quota": { 2024-06-04T16:16:09.036 INFO:teuthology.orchestra.run.smithi144.stdout: "enabled": false, 2024-06-04T16:16:09.036 INFO:teuthology.orchestra.run.smithi144.stdout: "check_on_raw": false, 2024-06-04T16:16:09.036 INFO:teuthology.orchestra.run.smithi144.stdout: "max_size": -1, 2024-06-04T16:16:09.036 INFO:teuthology.orchestra.run.smithi144.stdout: "max_size_kb": 0, 2024-06-04T16:16:09.036 INFO:teuthology.orchestra.run.smithi144.stdout: "max_objects": -1 2024-06-04T16:16:09.036 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-06-04T16:16:09.036 INFO:teuthology.orchestra.run.smithi144.stdout: "user_quota": { 2024-06-04T16:16:09.036 INFO:teuthology.orchestra.run.smithi144.stdout: "enabled": false, 2024-06-04T16:16:09.037 INFO:teuthology.orchestra.run.smithi144.stdout: "check_on_raw": false, 2024-06-04T16:16:09.037 INFO:teuthology.orchestra.run.smithi144.stdout: "max_size": -1, 2024-06-04T16:16:09.037 INFO:teuthology.orchestra.run.smithi144.stdout: "max_size_kb": 0, 2024-06-04T16:16:09.037 INFO:teuthology.orchestra.run.smithi144.stdout: "max_objects": -1 2024-06-04T16:16:09.037 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-06-04T16:16:09.037 INFO:teuthology.orchestra.run.smithi144.stdout: "temp_url_keys": [], 2024-06-04T16:16:09.037 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "rgw", 2024-06-04T16:16:09.037 INFO:teuthology.orchestra.run.smithi144.stdout: "mfa_ids": [], 2024-06-04T16:16:09.037 INFO:teuthology.orchestra.run.smithi144.stdout: "account_id": "", 2024-06-04T16:16:09.037 INFO:teuthology.orchestra.run.smithi144.stdout: "path": "/", 2024-06-04T16:16:09.037 INFO:teuthology.orchestra.run.smithi144.stdout: "create_date": "2024-06-04T16:16:09.028902Z", 2024-06-04T16:16:09.037 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-06-04T16:16:09.037 INFO:teuthology.orchestra.run.smithi144.stdout: "group_ids": [] 2024-06-04T16:16:09.037 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-06-04T16:16:09.037 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:16:09.038 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.034+0000 7f822ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-06-04T16:16:09.038 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.036+0000 7f837de30800 20 remove_watcher() i=0 2024-06-04T16:16:09.038 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.036+0000 7f837de30800 2 removed watcher, disabling cache 2024-06-04T16:16:09.038 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.037+0000 7f837de30800 20 remove_watcher() i=1 2024-06-04T16:16:09.039 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.038+0000 7f837de30800 20 remove_watcher() i=2 2024-06-04T16:16:09.040 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.039+0000 7f837de30800 20 remove_watcher() i=3 2024-06-04T16:16:09.041 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.040+0000 7f837de30800 20 remove_watcher() i=4 2024-06-04T16:16:09.042 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.041+0000 7f837de30800 20 remove_watcher() i=5 2024-06-04T16:16:09.043 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.042+0000 7f837de30800 20 remove_watcher() i=6 2024-06-04T16:16:09.044 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.044+0000 7f837de30800 20 remove_watcher() i=7 2024-06-04T16:16:09.055 DEBUG:teuthology.orchestra.run.smithi144:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid bar.client.0 --totp-serial 6659076205 --totp-seed GKRZTDT5DDCVYQZC6A2ZZ2NAMJ4YVTMCM3DSIITWIKJCIONUMR7E7VCJFDFBMVLN --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-06-04T16:16:09.120 INFO:teuthology.orchestra.run.smithi144.stderr:ignoring --setuser ceph since I am not root 2024-06-04T16:16:09.120 INFO:teuthology.orchestra.run.smithi144.stderr:ignoring --setgroup ceph since I am not root 2024-06-04T16:16:09.153 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.152+0000 7f1345287800 20 rados->read ofs=0 len=0 2024-06-04T16:16:09.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.154+0000 7f1345287800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:16:09.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.154+0000 7f1345287800 20 realm 2024-06-04T16:16:09.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.154+0000 7f1345287800 20 rados->read ofs=0 len=0 2024-06-04T16:16:09.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.154+0000 7f1345287800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:16:09.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.154+0000 7f1345287800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-06-04T16:16:09.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.154+0000 7f1345287800 20 rados->read ofs=0 len=0 2024-06-04T16:16:09.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.154+0000 7f1345287800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:16:09.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.154+0000 7f1345287800 20 rados->read ofs=0 len=0 2024-06-04T16:16:09.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.155+0000 7f1345287800 20 rados_obj.operate() r=0 bl.length=46 2024-06-04T16:16:09.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.155+0000 7f1345287800 20 rados->read ofs=0 len=0 2024-06-04T16:16:09.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.155+0000 7f1345287800 20 rados_obj.operate() r=0 bl.length=1139 2024-06-04T16:16:09.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.155+0000 7f1345287800 20 searching for the correct realm 2024-06-04T16:16:09.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.157+0000 7f133a57b640 0 -- 172.21.15.144:0/3823393263 >> [v2:172.21.15.144:6816/2358575268,v1:172.21.15.144:6817/2358575268] conn(0x55cf9ee42450 msgr2=0x55cf9ee44880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-06-04T16:16:09.161 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.161+0000 7f133a57b640 0 -- 172.21.15.144:0/3823393263 >> [v2:172.21.15.177:6808/2618477608,v1:172.21.15.177:6809/2618477608] conn(0x7f132c04f720 msgr2=0x7f132c04e450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-06-04T16:16:09.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.368+0000 7f1345287800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-06-04T16:16:09.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.368+0000 7f1345287800 20 RGWRados::pool_iterate: got zone_info.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767 2024-06-04T16:16:09.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.368+0000 7f1345287800 20 RGWRados::pool_iterate: got default.zone. 2024-06-04T16:16:09.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.368+0000 7f1345287800 20 RGWRados::pool_iterate: got zonegroup_info.abb22408-c332-4e28-8f7a-ff254ea2fed2 2024-06-04T16:16:09.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.368+0000 7f1345287800 20 RGWRados::pool_iterate: got zone_names.default 2024-06-04T16:16:09.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.368+0000 7f1345287800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-06-04T16:16:09.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.368+0000 7f1345287800 20 rados->read ofs=0 len=0 2024-06-04T16:16:09.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.369+0000 7f1345287800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:16:09.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.369+0000 7f1345287800 20 rados->read ofs=0 len=0 2024-06-04T16:16:09.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.369+0000 7f1345287800 20 rados_obj.operate() r=0 bl.length=46 2024-06-04T16:16:09.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.369+0000 7f1345287800 20 rados->read ofs=0 len=0 2024-06-04T16:16:09.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.369+0000 7f1345287800 20 rados_obj.operate() r=0 bl.length=470 2024-06-04T16:16:09.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.369+0000 7f1345287800 20 zone default found 2024-06-04T16:16:09.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.369+0000 7f1345287800 4 Realm: () 2024-06-04T16:16:09.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.369+0000 7f1345287800 4 ZoneGroup: default (abb22408-c332-4e28-8f7a-ff254ea2fed2) 2024-06-04T16:16:09.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.369+0000 7f1345287800 4 Zone: default (be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767) 2024-06-04T16:16:09.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.369+0000 7f1345287800 10 cannot find current period zonegroup using local zonegroup configuration 2024-06-04T16:16:09.373 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.369+0000 7f1345287800 20 zonegroup default 2024-06-04T16:16:09.373 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.369+0000 7f1345287800 20 rados->read ofs=0 len=0 2024-06-04T16:16:09.373 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.370+0000 7f1345287800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:16:09.373 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.370+0000 7f1345287800 20 rados->read ofs=0 len=0 2024-06-04T16:16:09.373 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.370+0000 7f1345287800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:16:09.373 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.370+0000 7f1345287800 20 rados->read ofs=0 len=0 2024-06-04T16:16:09.373 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.370+0000 7f1345287800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:16:09.373 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.370+0000 7f1345287800 20 started sync module instance, tier type = 2024-06-04T16:16:09.373 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.370+0000 7f1345287800 20 started zone id=be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767 (name=default) with tier type = 2024-06-04T16:16:09.381 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.380+0000 7f1345287800 20 add_watcher() i=0 2024-06-04T16:16:09.381 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.380+0000 7f1345287800 20 add_watcher() i=1 2024-06-04T16:16:09.381 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.380+0000 7f1345287800 20 add_watcher() i=2 2024-06-04T16:16:09.381 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.380+0000 7f1345287800 20 add_watcher() i=3 2024-06-04T16:16:09.381 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.380+0000 7f1345287800 20 add_watcher() i=4 2024-06-04T16:16:09.382 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.380+0000 7f1345287800 20 add_watcher() i=5 2024-06-04T16:16:09.382 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.380+0000 7f1345287800 20 add_watcher() i=6 2024-06-04T16:16:09.382 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.381+0000 7f1345287800 20 add_watcher() i=7 2024-06-04T16:16:09.382 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.381+0000 7f1345287800 2 all 8 watchers are set, enabling cache 2024-06-04T16:16:09.384 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.383+0000 7f11f97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-06-04T16:16:09.385 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.383+0000 7f1345287800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-06-04T16:16:09.385 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.383+0000 7f1345287800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-06-04T16:16:09.385 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.383+0000 7f1345287800 5 note: GC not initialized 2024-06-04T16:16:09.385 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.383+0000 7f1173fff640 20 reqs_thread_entry: start 2024-06-04T16:16:09.385 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.383+0000 7f1345287800 20 init_complete bucket index max shards: 11 2024-06-04T16:16:09.385 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.384+0000 7f1345287800 20 Filter name: none 2024-06-04T16:16:09.385 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.384+0000 7f1171ffb640 20 reqs_thread_entry: start 2024-06-04T16:16:09.385 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.384+0000 7f1345287800 10 cache get: name=default.rgw.meta+users.uid+bar.client.0 : miss 2024-06-04T16:16:09.385 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.384+0000 7f1345287800 20 rados->read ofs=0 len=0 2024-06-04T16:16:09.386 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.384+0000 7f1345287800 20 rados_obj.operate() r=0 bl.length=489 2024-06-04T16:16:09.386 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.384+0000 7f1345287800 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x13 2024-06-04T16:16:09.386 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.384+0000 7f1345287800 10 adding default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-06-04T16:16:09.386 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.384+0000 7f1345287800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-06-04T16:16:09.388 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.387+0000 7f1345287800 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2024-06-04T16:16:09.388 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.387+0000 7f1345287800 10 moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-06-04T16:16:09.388 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.387+0000 7f1345287800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:bar.client.0, ofs0, ns] 2024-06-04T16:16:09.388 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.388+0000 7f12267fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1086626726136 cookie 94350212390928 notifier 7199 bl.length()=688 2024-06-04T16:16:09.389 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.388+0000 7f12267fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2024-06-04T16:16:09.389 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.388+0000 7f12267fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-06-04T16:16:09.390 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.389+0000 7f11f97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-06-04T16:16:09.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.391+0000 7f1345287800 20 remove_watcher() i=0 2024-06-04T16:16:09.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.391+0000 7f1345287800 2 removed watcher, disabling cache 2024-06-04T16:16:09.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.392+0000 7f1345287800 20 remove_watcher() i=1 2024-06-04T16:16:09.394 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.393+0000 7f1345287800 20 remove_watcher() i=2 2024-06-04T16:16:09.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.395+0000 7f1345287800 20 remove_watcher() i=3 2024-06-04T16:16:09.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.396+0000 7f1345287800 20 remove_watcher() i=4 2024-06-04T16:16:09.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.397+0000 7f1345287800 20 remove_watcher() i=5 2024-06-04T16:16:09.398 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.398+0000 7f1345287800 20 remove_watcher() i=6 2024-06-04T16:16:09.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.399+0000 7f1345287800 20 remove_watcher() i=7 2024-06-04T16:16:09.411 DEBUG:tasks.s3tests:Creating user testx$tenanteduser.client.0 on client.0 2024-06-04T16:16:09.412 DEBUG:teuthology.orchestra.run.smithi144:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid 'testx$tenanteduser.client.0' --display-name 'Mr. testx$tenanteduser.client.0' --email 'testx$tenanteduser.client.0+test@test.test' --caps 'user-policy=*' --access-key LLEPYPJHMUUXOUSLKCKG --secret HBJ4BqSKsv+7UxQtNBWa7J/WBlKcLJsQM8LCnp2/xiw8zDugR9MHKg== --cluster ceph 2024-06-04T16:16:09.478 INFO:teuthology.orchestra.run.smithi144.stderr:ignoring --setuser ceph since I am not root 2024-06-04T16:16:09.478 INFO:teuthology.orchestra.run.smithi144.stderr:ignoring --setgroup ceph since I am not root 2024-06-04T16:16:09.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.716+0000 7fdbdac98800 20 rados->read ofs=0 len=0 2024-06-04T16:16:09.722 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.721+0000 7fdbdac98800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:16:09.722 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.721+0000 7fdbdac98800 20 realm 2024-06-04T16:16:09.722 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.721+0000 7fdbdac98800 20 rados->read ofs=0 len=0 2024-06-04T16:16:09.723 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.721+0000 7fdbdac98800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:16:09.723 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.721+0000 7fdbdac98800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-06-04T16:16:09.723 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.722+0000 7fdbdac98800 20 rados->read ofs=0 len=0 2024-06-04T16:16:09.723 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.722+0000 7fdbdac98800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:16:09.723 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.722+0000 7fdbdac98800 20 rados->read ofs=0 len=0 2024-06-04T16:16:09.723 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.723+0000 7fdbdac98800 20 rados_obj.operate() r=0 bl.length=46 2024-06-04T16:16:09.724 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.723+0000 7fdbdac98800 20 rados->read ofs=0 len=0 2024-06-04T16:16:09.724 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.723+0000 7fdbdac98800 20 rados_obj.operate() r=0 bl.length=1139 2024-06-04T16:16:09.724 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.723+0000 7fdbdac98800 20 searching for the correct realm 2024-06-04T16:16:09.728 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.728+0000 7fdbcff8c640 0 -- 172.21.15.144:0/4204722645 >> [v2:172.21.15.144:6808/86532035,v1:172.21.15.144:6809/86532035] conn(0x7fdbc80d3040 msgr2=0x7fdbc80aa040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-06-04T16:16:09.735 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.734+0000 7fdbd878d640 0 -- 172.21.15.144:0/4204722645 >> [v2:172.21.15.177:6824/800067290,v1:172.21.15.177:6825/800067290] conn(0x55c06977a780 msgr2=0x55c06977cbd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-06-04T16:16:09.745 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.744+0000 7fdbdac98800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-06-04T16:16:09.745 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.744+0000 7fdbdac98800 20 RGWRados::pool_iterate: got zone_info.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767 2024-06-04T16:16:09.745 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.744+0000 7fdbdac98800 20 RGWRados::pool_iterate: got default.zone. 2024-06-04T16:16:09.745 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.744+0000 7fdbdac98800 20 RGWRados::pool_iterate: got zonegroup_info.abb22408-c332-4e28-8f7a-ff254ea2fed2 2024-06-04T16:16:09.745 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.744+0000 7fdbdac98800 20 RGWRados::pool_iterate: got zone_names.default 2024-06-04T16:16:09.745 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.744+0000 7fdbdac98800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-06-04T16:16:09.745 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.744+0000 7fdbdac98800 20 rados->read ofs=0 len=0 2024-06-04T16:16:09.745 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.744+0000 7fdbdac98800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:16:09.746 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.744+0000 7fdbdac98800 20 rados->read ofs=0 len=0 2024-06-04T16:16:09.747 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.744+0000 7fdbdac98800 20 rados_obj.operate() r=0 bl.length=46 2024-06-04T16:16:09.747 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.745+0000 7fdbdac98800 20 rados->read ofs=0 len=0 2024-06-04T16:16:09.747 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.745+0000 7fdbdac98800 20 rados_obj.operate() r=0 bl.length=470 2024-06-04T16:16:09.747 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.745+0000 7fdbdac98800 20 zone default found 2024-06-04T16:16:09.747 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.745+0000 7fdbdac98800 4 Realm: () 2024-06-04T16:16:09.747 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.745+0000 7fdbdac98800 4 ZoneGroup: default (abb22408-c332-4e28-8f7a-ff254ea2fed2) 2024-06-04T16:16:09.747 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.745+0000 7fdbdac98800 4 Zone: default (be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767) 2024-06-04T16:16:09.747 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.745+0000 7fdbdac98800 10 cannot find current period zonegroup using local zonegroup configuration 2024-06-04T16:16:09.748 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.745+0000 7fdbdac98800 20 zonegroup default 2024-06-04T16:16:09.748 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.745+0000 7fdbdac98800 20 rados->read ofs=0 len=0 2024-06-04T16:16:09.748 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.745+0000 7fdbdac98800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:16:09.748 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.745+0000 7fdbdac98800 20 rados->read ofs=0 len=0 2024-06-04T16:16:09.748 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.745+0000 7fdbdac98800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:16:09.748 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.745+0000 7fdbdac98800 20 rados->read ofs=0 len=0 2024-06-04T16:16:09.748 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.746+0000 7fdbdac98800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:16:09.748 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.746+0000 7fdbdac98800 20 started sync module instance, tier type = 2024-06-04T16:16:09.748 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.746+0000 7fdbdac98800 20 started zone id=be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767 (name=default) with tier type = 2024-06-04T16:16:09.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.755+0000 7fdbdac98800 20 add_watcher() i=0 2024-06-04T16:16:09.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.755+0000 7fdbdac98800 20 add_watcher() i=1 2024-06-04T16:16:09.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.755+0000 7fdbdac98800 20 add_watcher() i=2 2024-06-04T16:16:09.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.755+0000 7fdbdac98800 20 add_watcher() i=3 2024-06-04T16:16:09.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.755+0000 7fdbdac98800 20 add_watcher() i=4 2024-06-04T16:16:09.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.755+0000 7fdbdac98800 20 add_watcher() i=5 2024-06-04T16:16:09.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.755+0000 7fdbdac98800 20 add_watcher() i=6 2024-06-04T16:16:09.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.756+0000 7fdbdac98800 20 add_watcher() i=7 2024-06-04T16:16:09.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.756+0000 7fdbdac98800 2 all 8 watchers are set, enabling cache 2024-06-04T16:16:09.760 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.758+0000 7fda8efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-06-04T16:16:09.761 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.758+0000 7fdbdac98800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-06-04T16:16:09.761 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.758+0000 7fdbdac98800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-06-04T16:16:09.761 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.758+0000 7fdbdac98800 5 note: GC not initialized 2024-06-04T16:16:09.761 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.758+0000 7fda8dfdb640 20 reqs_thread_entry: start 2024-06-04T16:16:09.761 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.758+0000 7fdbdac98800 20 init_complete bucket index max shards: 11 2024-06-04T16:16:09.761 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.758+0000 7fdbdac98800 20 Filter name: none 2024-06-04T16:16:09.761 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.759+0000 7fd9ff7fe640 20 reqs_thread_entry: start 2024-06-04T16:16:09.761 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.759+0000 7fdbdac98800 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 : miss 2024-06-04T16:16:09.761 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.759+0000 7fdbdac98800 20 rados->read ofs=0 len=0 2024-06-04T16:16:09.761 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.759+0000 7fdbdac98800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:16:09.761 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.759+0000 7fdbdac98800 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x0 2024-06-04T16:16:09.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.759+0000 7fdbdac98800 10 adding default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-06-04T16:16:09.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.759+0000 7fdbdac98800 10 cache get: name=default.rgw.meta+users.email+testx$tenanteduser.client.0+test@test.test : miss 2024-06-04T16:16:09.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.759+0000 7fdbdac98800 20 rados->read ofs=0 len=0 2024-06-04T16:16:09.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.759+0000 7fdbdac98800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:16:09.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.759+0000 7fdbdac98800 10 cache put: name=default.rgw.meta+users.email+testx$tenanteduser.client.0+test@test.test info.flags=0x0 2024-06-04T16:16:09.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.759+0000 7fdbdac98800 10 adding default.rgw.meta+users.email+testx$tenanteduser.client.0+test@test.test to cache LRU end 2024-06-04T16:16:09.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.759+0000 7fdbdac98800 10 cache get: name=default.rgw.meta+users.keys+LLEPYPJHMUUXOUSLKCKG : miss 2024-06-04T16:16:09.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.759+0000 7fdbdac98800 20 rados->read ofs=0 len=0 2024-06-04T16:16:09.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.760+0000 7fdbdac98800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:16:09.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.760+0000 7fdbdac98800 10 cache put: name=default.rgw.meta+users.keys+LLEPYPJHMUUXOUSLKCKG info.flags=0x0 2024-06-04T16:16:09.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.760+0000 7fdbdac98800 10 adding default.rgw.meta+users.keys+LLEPYPJHMUUXOUSLKCKG to cache LRU end 2024-06-04T16:16:09.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.760+0000 7fdbdac98800 10 cache get: name=default.rgw.meta+users.keys+LLEPYPJHMUUXOUSLKCKG : hit (negative entry) 2024-06-04T16:16:09.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.760+0000 7fdbdac98800 10 cache get: name=default.rgw.meta+users.keys+LLEPYPJHMUUXOUSLKCKG : hit (negative entry) 2024-06-04T16:16:09.764 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.761+0000 7fdbdac98800 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x17 2024-06-04T16:16:09.764 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.761+0000 7fdbdac98800 10 moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-06-04T16:16:09.764 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.761+0000 7fdbdac98800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:testx$tenanteduser.client.0, ofs0, ns] 2024-06-04T16:16:09.764 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.761+0000 7fdaaf7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1090921693448 cookie 94284891604288 notifier 7668 bl.length()=748 2024-06-04T16:16:09.764 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.761+0000 7fdaaf7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x17 2024-06-04T16:16:09.764 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.761+0000 7fdaaf7fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-06-04T16:16:09.764 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.763+0000 7fdbdac98800 10 cache put: name=default.rgw.meta+users.email+testx$tenanteduser.client.0+test@test.test info.flags=0x7 2024-06-04T16:16:09.764 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.763+0000 7fdbdac98800 10 moving default.rgw.meta+users.email+testx$tenanteduser.client.0+test@test.test to cache LRU end 2024-06-04T16:16:09.764 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.763+0000 7fdbdac98800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.email:testx$tenanteduser.client.0+test@test.test, ofs0, ns] 2024-06-04T16:16:09.764 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.763+0000 7fdaaeffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1090921693449 cookie 94284891614848 notifier 7668 bl.length()=224 2024-06-04T16:16:09.765 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.763+0000 7fdaaeffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+testx$tenanteduser.client.0+test@test.test info.flags=0x7 2024-06-04T16:16:09.765 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.763+0000 7fdaaeffd640 10 rgw watcher librados: moving default.rgw.meta+users.email+testx$tenanteduser.client.0+test@test.test to cache LRU end 2024-06-04T16:16:09.765 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.765+0000 7fdbdac98800 10 cache put: name=default.rgw.meta+users.keys+LLEPYPJHMUUXOUSLKCKG info.flags=0x7 2024-06-04T16:16:09.766 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.765+0000 7fdbdac98800 10 moving default.rgw.meta+users.keys+LLEPYPJHMUUXOUSLKCKG to cache LRU end 2024-06-04T16:16:09.766 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.765+0000 7fdbdac98800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.keys:LLEPYPJHMUUXOUSLKCKG, ofs0, ns] 2024-06-04T16:16:09.766 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.765+0000 7fdaaf7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1090921693450 cookie 94284891614848 notifier 7668 bl.length()=201 2024-06-04T16:16:09.766 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.765+0000 7fdaaf7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+LLEPYPJHMUUXOUSLKCKG info.flags=0x7 2024-06-04T16:16:09.766 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.765+0000 7fdaaf7fe640 10 rgw watcher librados: moving default.rgw.meta+users.keys+LLEPYPJHMUUXOUSLKCKG to cache LRU end 2024-06-04T16:16:09.767 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-06-04T16:16:09.767 INFO:teuthology.orchestra.run.smithi144.stdout: "user_id": "testx$tenanteduser.client.0", 2024-06-04T16:16:09.767 INFO:teuthology.orchestra.run.smithi144.stdout: "display_name": "Mr. testx$tenanteduser.client.0", 2024-06-04T16:16:09.767 INFO:teuthology.orchestra.run.smithi144.stdout: "email": "testx$tenanteduser.client.0+test@test.test", 2024-06-04T16:16:09.767 INFO:teuthology.orchestra.run.smithi144.stdout: "suspended": 0, 2024-06-04T16:16:09.767 INFO:teuthology.orchestra.run.smithi144.stdout: "max_buckets": 1000, 2024-06-04T16:16:09.767 INFO:teuthology.orchestra.run.smithi144.stdout: "subusers": [], 2024-06-04T16:16:09.767 INFO:teuthology.orchestra.run.smithi144.stdout: "keys": [ 2024-06-04T16:16:09.767 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-06-04T16:16:09.767 INFO:teuthology.orchestra.run.smithi144.stdout: "user": "testx$tenanteduser.client.0", 2024-06-04T16:16:09.768 INFO:teuthology.orchestra.run.smithi144.stdout: "access_key": "LLEPYPJHMUUXOUSLKCKG", 2024-06-04T16:16:09.768 INFO:teuthology.orchestra.run.smithi144.stdout: "secret_key": "HBJ4BqSKsv+7UxQtNBWa7J/WBlKcLJsQM8LCnp2/xiw8zDugR9MHKg==", 2024-06-04T16:16:09.768 INFO:teuthology.orchestra.run.smithi144.stdout: "active": true, 2024-06-04T16:16:09.768 INFO:teuthology.orchestra.run.smithi144.stdout: "create_date": "2024-06-04T16:16:09.760887Z" 2024-06-04T16:16:09.768 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-06-04T16:16:09.768 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-06-04T16:16:09.768 INFO:teuthology.orchestra.run.smithi144.stdout: "swift_keys": [], 2024-06-04T16:16:09.768 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": [ 2024-06-04T16:16:09.768 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-06-04T16:16:09.768 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "user-policy", 2024-06-04T16:16:09.768 INFO:teuthology.orchestra.run.smithi144.stdout: "perm": "*" 2024-06-04T16:16:09.769 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-06-04T16:16:09.769 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-06-04T16:16:09.769 INFO:teuthology.orchestra.run.smithi144.stdout: "op_mask": "read, write, delete", 2024-06-04T16:16:09.769 INFO:teuthology.orchestra.run.smithi144.stdout: "default_placement": "", 2024-06-04T16:16:09.769 INFO:teuthology.orchestra.run.smithi144.stdout: "default_storage_class": "", 2024-06-04T16:16:09.769 INFO:teuthology.orchestra.run.smithi144.stdout: "placement_tags": [], 2024-06-04T16:16:09.769 INFO:teuthology.orchestra.run.smithi144.stdout: "bucket_quota": { 2024-06-04T16:16:09.769 INFO:teuthology.orchestra.run.smithi144.stdout: "enabled": false, 2024-06-04T16:16:09.769 INFO:teuthology.orchestra.run.smithi144.stdout: "check_on_raw": false, 2024-06-04T16:16:09.769 INFO:teuthology.orchestra.run.smithi144.stdout: "max_size": -1, 2024-06-04T16:16:09.769 INFO:teuthology.orchestra.run.smithi144.stdout: "max_size_kb": 0, 2024-06-04T16:16:09.769 INFO:teuthology.orchestra.run.smithi144.stdout: "max_objects": -1 2024-06-04T16:16:09.770 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-06-04T16:16:09.770 INFO:teuthology.orchestra.run.smithi144.stdout: "user_quota": { 2024-06-04T16:16:09.770 INFO:teuthology.orchestra.run.smithi144.stdout: "enabled": false, 2024-06-04T16:16:09.770 INFO:teuthology.orchestra.run.smithi144.stdout: "check_on_raw": false, 2024-06-04T16:16:09.770 INFO:teuthology.orchestra.run.smithi144.stdout: "max_size": -1, 2024-06-04T16:16:09.770 INFO:teuthology.orchestra.run.smithi144.stdout: "max_size_kb": 0, 2024-06-04T16:16:09.770 INFO:teuthology.orchestra.run.smithi144.stdout: "max_objects": -1 2024-06-04T16:16:09.770 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-06-04T16:16:09.770 INFO:teuthology.orchestra.run.smithi144.stdout: "temp_url_keys": [], 2024-06-04T16:16:09.771 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "rgw", 2024-06-04T16:16:09.771 INFO:teuthology.orchestra.run.smithi144.stdout: "mfa_ids": [], 2024-06-04T16:16:09.771 INFO:teuthology.orchestra.run.smithi144.stdout: "account_id": "", 2024-06-04T16:16:09.771 INFO:teuthology.orchestra.run.smithi144.stdout: "path": "/", 2024-06-04T16:16:09.771 INFO:teuthology.orchestra.run.smithi144.stdout: "create_date": "2024-06-04T16:16:09.760872Z", 2024-06-04T16:16:09.771 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-06-04T16:16:09.771 INFO:teuthology.orchestra.run.smithi144.stdout: "group_ids": [] 2024-06-04T16:16:09.771 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-06-04T16:16:09.771 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:16:09.772 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.766+0000 7fda8efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-06-04T16:16:09.772 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.768+0000 7fdbdac98800 20 remove_watcher() i=0 2024-06-04T16:16:09.772 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.768+0000 7fdbdac98800 2 removed watcher, disabling cache 2024-06-04T16:16:09.772 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.769+0000 7fdbdac98800 20 remove_watcher() i=1 2024-06-04T16:16:09.772 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.770+0000 7fdbdac98800 20 remove_watcher() i=2 2024-06-04T16:16:09.773 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.771+0000 7fdbdac98800 20 remove_watcher() i=3 2024-06-04T16:16:09.773 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.772+0000 7fdbdac98800 20 remove_watcher() i=4 2024-06-04T16:16:09.774 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.773+0000 7fdbdac98800 20 remove_watcher() i=5 2024-06-04T16:16:09.775 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.774+0000 7fdbdac98800 20 remove_watcher() i=6 2024-06-04T16:16:09.776 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.775+0000 7fdbdac98800 20 remove_watcher() i=7 2024-06-04T16:16:09.787 DEBUG:teuthology.orchestra.run.smithi144:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid 'testx$tenanteduser.client.0' --totp-serial 5855949715 --totp-seed QPK4RX7NN6S4SNPHLSPZ5IJSSF573CDRVYXZNFQQ6PZVI72L7O6EINN5CLIWKHTD --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-06-04T16:16:09.853 INFO:teuthology.orchestra.run.smithi144.stderr:ignoring --setuser ceph since I am not root 2024-06-04T16:16:09.853 INFO:teuthology.orchestra.run.smithi144.stderr:ignoring --setgroup ceph since I am not root 2024-06-04T16:16:09.887 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.886+0000 7ff46f151800 20 rados->read ofs=0 len=0 2024-06-04T16:16:09.889 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.888+0000 7ff46f151800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:16:09.889 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.888+0000 7ff46f151800 20 realm 2024-06-04T16:16:09.889 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.888+0000 7ff46f151800 20 rados->read ofs=0 len=0 2024-06-04T16:16:09.889 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.888+0000 7ff46f151800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:16:09.889 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.888+0000 7ff46f151800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-06-04T16:16:09.889 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.888+0000 7ff46f151800 20 rados->read ofs=0 len=0 2024-06-04T16:16:09.889 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.888+0000 7ff46f151800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:16:09.889 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.888+0000 7ff46f151800 20 rados->read ofs=0 len=0 2024-06-04T16:16:09.890 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.889+0000 7ff46f151800 20 rados_obj.operate() r=0 bl.length=46 2024-06-04T16:16:09.890 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.889+0000 7ff46f151800 20 rados->read ofs=0 len=0 2024-06-04T16:16:09.890 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.889+0000 7ff46f151800 20 rados_obj.operate() r=0 bl.length=1139 2024-06-04T16:16:09.890 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.889+0000 7ff46f151800 20 searching for the correct realm 2024-06-04T16:16:09.892 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.891+0000 7ff46d44e640 0 -- 172.21.15.144:0/745604943 >> [v2:172.21.15.177:6824/800067290,v1:172.21.15.177:6825/800067290] conn(0x561776194760 msgr2=0x561776196bf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-06-04T16:16:09.895 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:09.894+0000 7ff467fff640 0 -- 172.21.15.144:0/745604943 >> [v2:172.21.15.177:6808/2618477608,v1:172.21.15.177:6809/2618477608] conn(0x7ff458066070 msgr2=0x7ff4580d0440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-06-04T16:16:10.103 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:10.102+0000 7ff46f151800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-06-04T16:16:10.103 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:10.102+0000 7ff46f151800 20 RGWRados::pool_iterate: got zone_info.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767 2024-06-04T16:16:10.104 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:10.102+0000 7ff46f151800 20 RGWRados::pool_iterate: got default.zone. 2024-06-04T16:16:10.104 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:10.102+0000 7ff46f151800 20 RGWRados::pool_iterate: got zonegroup_info.abb22408-c332-4e28-8f7a-ff254ea2fed2 2024-06-04T16:16:10.104 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:10.102+0000 7ff46f151800 20 RGWRados::pool_iterate: got zone_names.default 2024-06-04T16:16:10.104 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:10.102+0000 7ff46f151800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-06-04T16:16:10.104 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:10.102+0000 7ff46f151800 20 rados->read ofs=0 len=0 2024-06-04T16:16:10.104 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:10.102+0000 7ff46f151800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:16:10.104 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:10.102+0000 7ff46f151800 20 rados->read ofs=0 len=0 2024-06-04T16:16:10.104 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:10.102+0000 7ff46f151800 20 rados_obj.operate() r=0 bl.length=46 2024-06-04T16:16:10.104 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:10.102+0000 7ff46f151800 20 rados->read ofs=0 len=0 2024-06-04T16:16:10.105 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:10.103+0000 7ff46f151800 20 rados_obj.operate() r=0 bl.length=470 2024-06-04T16:16:10.105 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:10.103+0000 7ff46f151800 20 zone default found 2024-06-04T16:16:10.105 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:10.103+0000 7ff46f151800 4 Realm: () 2024-06-04T16:16:10.105 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:10.103+0000 7ff46f151800 4 ZoneGroup: default (abb22408-c332-4e28-8f7a-ff254ea2fed2) 2024-06-04T16:16:10.105 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:10.103+0000 7ff46f151800 4 Zone: default (be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767) 2024-06-04T16:16:10.105 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:10.103+0000 7ff46f151800 10 cannot find current period zonegroup using local zonegroup configuration 2024-06-04T16:16:10.106 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:10.103+0000 7ff46f151800 20 zonegroup default 2024-06-04T16:16:10.106 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:10.103+0000 7ff46f151800 20 rados->read ofs=0 len=0 2024-06-04T16:16:10.106 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:10.103+0000 7ff46f151800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:16:10.106 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:10.103+0000 7ff46f151800 20 rados->read ofs=0 len=0 2024-06-04T16:16:10.106 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:10.104+0000 7ff46f151800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:16:10.106 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:10.104+0000 7ff46f151800 20 rados->read ofs=0 len=0 2024-06-04T16:16:10.106 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:10.104+0000 7ff46f151800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:16:10.106 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:10.104+0000 7ff46f151800 20 started sync module instance, tier type = 2024-06-04T16:16:10.106 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:10.104+0000 7ff46f151800 20 started zone id=be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767 (name=default) with tier type = 2024-06-04T16:16:10.114 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:10.113+0000 7ff46f151800 20 add_watcher() i=0 2024-06-04T16:16:10.114 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:10.113+0000 7ff46f151800 20 add_watcher() i=1 2024-06-04T16:16:10.114 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:10.113+0000 7ff46f151800 20 add_watcher() i=2 2024-06-04T16:16:10.114 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:10.113+0000 7ff46f151800 20 add_watcher() i=3 2024-06-04T16:16:10.114 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:10.113+0000 7ff46f151800 20 add_watcher() i=4 2024-06-04T16:16:10.114 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:10.113+0000 7ff46f151800 20 add_watcher() i=5 2024-06-04T16:16:10.114 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:10.113+0000 7ff46f151800 20 add_watcher() i=6 2024-06-04T16:16:10.115 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:10.114+0000 7ff46f151800 20 add_watcher() i=7 2024-06-04T16:16:10.115 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:10.114+0000 7ff46f151800 2 all 8 watchers are set, enabling cache 2024-06-04T16:16:10.117 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:10.116+0000 7ff322fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-06-04T16:16:10.117 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:10.116+0000 7ff46f151800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-06-04T16:16:10.117 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:10.116+0000 7ff46f151800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-06-04T16:16:10.117 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:10.116+0000 7ff46f151800 5 note: GC not initialized 2024-06-04T16:16:10.117 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:10.116+0000 7ff321fe3640 20 reqs_thread_entry: start 2024-06-04T16:16:10.117 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:10.116+0000 7ff46f151800 20 init_complete bucket index max shards: 11 2024-06-04T16:16:10.117 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:10.116+0000 7ff46f151800 20 Filter name: none 2024-06-04T16:16:10.118 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:10.116+0000 7ff2937fe640 20 reqs_thread_entry: start 2024-06-04T16:16:10.118 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:10.116+0000 7ff46f151800 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 : miss 2024-06-04T16:16:10.118 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:10.116+0000 7ff46f151800 20 rados->read ofs=0 len=0 2024-06-04T16:16:10.118 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:10.117+0000 7ff46f151800 20 rados_obj.operate() r=0 bl.length=548 2024-06-04T16:16:10.118 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:10.117+0000 7ff46f151800 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x13 2024-06-04T16:16:10.118 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:10.117+0000 7ff46f151800 10 adding default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-06-04T16:16:10.118 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:10.117+0000 7ff46f151800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-06-04T16:16:10.121 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:10.120+0000 7ff46f151800 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x17 2024-06-04T16:16:10.121 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:10.120+0000 7ff46f151800 10 moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-06-04T16:16:10.121 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:10.120+0000 7ff46f151800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:testx$tenanteduser.client.0, ofs0, ns] 2024-06-04T16:16:10.121 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:10.120+0000 7ff343fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1090921693451 cookie 94658765677568 notifier 7235 bl.length()=762 2024-06-04T16:16:10.122 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:10.120+0000 7ff343fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x17 2024-06-04T16:16:10.122 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:10.120+0000 7ff343fff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-06-04T16:16:10.122 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:10.122+0000 7ff322fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-06-04T16:16:10.124 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:10.124+0000 7ff46f151800 20 remove_watcher() i=0 2024-06-04T16:16:10.125 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:10.124+0000 7ff46f151800 2 removed watcher, disabling cache 2024-06-04T16:16:10.126 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:10.125+0000 7ff46f151800 20 remove_watcher() i=1 2024-06-04T16:16:10.126 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:10.126+0000 7ff46f151800 20 remove_watcher() i=2 2024-06-04T16:16:10.127 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:10.127+0000 7ff46f151800 20 remove_watcher() i=3 2024-06-04T16:16:10.128 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:10.128+0000 7ff46f151800 20 remove_watcher() i=4 2024-06-04T16:16:10.129 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:10.129+0000 7ff46f151800 20 remove_watcher() i=5 2024-06-04T16:16:10.130 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:10.130+0000 7ff46f151800 20 remove_watcher() i=6 2024-06-04T16:16:10.131 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:10.130+0000 7ff46f151800 20 remove_watcher() i=7 2024-06-04T16:16:10.142 DEBUG:tasks.s3tests:Creating user foobar.client.0 on client.0 2024-06-04T16:16:10.143 DEBUG:teuthology.orchestra.run.smithi144:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid foobar.client.0 --display-name 'Mr. foobar.client.0' --email foobar.client.0+test@test.test --caps 'user-policy=*' --access-key GDOLSYZEWWILAWORBVLR --secret ry1IHLIuh2hSX025PJ7vpBjlrp7gIkPvhqwRXDfDwkS3qlRd/v0mdw== --cluster ceph 2024-06-04T16:16:10.207 INFO:teuthology.orchestra.run.smithi144.stderr:ignoring --setuser ceph since I am not root 2024-06-04T16:16:10.207 INFO:teuthology.orchestra.run.smithi144.stderr:ignoring --setgroup ceph since I am not root 2024-06-04T16:16:10.242 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:10.241+0000 7ff700c13800 20 rados->read ofs=0 len=0 2024-06-04T16:16:10.244 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:10.242+0000 7ff700c13800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:16:10.244 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:10.242+0000 7ff700c13800 20 realm 2024-06-04T16:16:10.244 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:10.242+0000 7ff700c13800 20 rados->read ofs=0 len=0 2024-06-04T16:16:10.244 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:10.243+0000 7ff700c13800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:16:10.244 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:10.243+0000 7ff700c13800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-06-04T16:16:10.244 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:10.243+0000 7ff700c13800 20 rados->read ofs=0 len=0 2024-06-04T16:16:10.244 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:10.243+0000 7ff700c13800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:16:10.245 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:10.243+0000 7ff700c13800 20 rados->read ofs=0 len=0 2024-06-04T16:16:10.246 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:10.244+0000 7ff700c13800 20 rados_obj.operate() r=0 bl.length=46 2024-06-04T16:16:10.246 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:10.244+0000 7ff700c13800 20 rados->read ofs=0 len=0 2024-06-04T16:16:10.246 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:10.244+0000 7ff700c13800 20 rados_obj.operate() r=0 bl.length=1139 2024-06-04T16:16:10.246 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:10.244+0000 7ff700c13800 20 searching for the correct realm 2024-06-04T16:16:10.247 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:10.245+0000 7ff6fc217640 0 -- 172.21.15.144:0/958764162 >> [v2:172.21.15.177:6816/2039473917,v1:172.21.15.177:6817/2039473917] conn(0x564f83339b70 msgr2=0x564f8333c030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-06-04T16:16:10.450 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:10.449+0000 7ff6fc217640 0 -- 172.21.15.144:0/958764162 >> [v2:172.21.15.177:6800/3891611393,v1:172.21.15.177:6801/3891611393] conn(0x7ff6ec0198f0 msgr2=0x7ff6ec039410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-06-04T16:16:10.659 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:10.658+0000 7ff700c13800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-06-04T16:16:10.660 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:10.658+0000 7ff700c13800 20 RGWRados::pool_iterate: got zone_info.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767 2024-06-04T16:16:10.660 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:10.658+0000 7ff700c13800 20 RGWRados::pool_iterate: got default.zone. 2024-06-04T16:16:10.660 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:10.658+0000 7ff700c13800 20 RGWRados::pool_iterate: got zonegroup_info.abb22408-c332-4e28-8f7a-ff254ea2fed2 2024-06-04T16:16:10.660 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:10.658+0000 7ff700c13800 20 RGWRados::pool_iterate: got zone_names.default 2024-06-04T16:16:10.660 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:10.658+0000 7ff700c13800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-06-04T16:16:10.660 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:10.658+0000 7ff700c13800 20 rados->read ofs=0 len=0 2024-06-04T16:16:10.660 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:10.658+0000 7ff700c13800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:16:10.660 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:10.658+0000 7ff700c13800 20 rados->read ofs=0 len=0 2024-06-04T16:16:10.660 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:10.659+0000 7ff700c13800 20 rados_obj.operate() r=0 bl.length=46 2024-06-04T16:16:10.660 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:10.659+0000 7ff700c13800 20 rados->read ofs=0 len=0 2024-06-04T16:16:10.661 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:10.659+0000 7ff700c13800 20 rados_obj.operate() r=0 bl.length=470 2024-06-04T16:16:10.661 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:10.659+0000 7ff700c13800 20 zone default found 2024-06-04T16:16:10.661 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:10.659+0000 7ff700c13800 4 Realm: () 2024-06-04T16:16:10.661 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:10.659+0000 7ff700c13800 4 ZoneGroup: default (abb22408-c332-4e28-8f7a-ff254ea2fed2) 2024-06-04T16:16:10.662 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:10.659+0000 7ff700c13800 4 Zone: default (be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767) 2024-06-04T16:16:10.662 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:10.659+0000 7ff700c13800 10 cannot find current period zonegroup using local zonegroup configuration 2024-06-04T16:16:10.662 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:10.659+0000 7ff700c13800 20 zonegroup default 2024-06-04T16:16:10.662 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:10.659+0000 7ff700c13800 20 rados->read ofs=0 len=0 2024-06-04T16:16:10.662 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:10.659+0000 7ff700c13800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:16:10.662 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:10.659+0000 7ff700c13800 20 rados->read ofs=0 len=0 2024-06-04T16:16:10.662 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:10.660+0000 7ff700c13800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:16:10.662 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:10.660+0000 7ff700c13800 20 rados->read ofs=0 len=0 2024-06-04T16:16:10.662 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:10.660+0000 7ff700c13800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:16:10.662 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:10.660+0000 7ff700c13800 20 started sync module instance, tier type = 2024-06-04T16:16:10.662 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:10.660+0000 7ff700c13800 20 started zone id=be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767 (name=default) with tier type = 2024-06-04T16:16:10.670 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:10.670+0000 7ff700c13800 20 add_watcher() i=0 2024-06-04T16:16:10.670 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:10.670+0000 7ff700c13800 20 add_watcher() i=1 2024-06-04T16:16:10.670 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:10.670+0000 7ff700c13800 20 add_watcher() i=2 2024-06-04T16:16:10.671 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:10.670+0000 7ff700c13800 20 add_watcher() i=3 2024-06-04T16:16:10.671 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:10.670+0000 7ff700c13800 20 add_watcher() i=4 2024-06-04T16:16:10.671 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:10.670+0000 7ff700c13800 20 add_watcher() i=5 2024-06-04T16:16:10.671 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:10.670+0000 7ff700c13800 20 add_watcher() i=6 2024-06-04T16:16:10.671 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:10.671+0000 7ff700c13800 20 add_watcher() i=7 2024-06-04T16:16:10.671 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:10.671+0000 7ff700c13800 2 all 8 watchers are set, enabling cache 2024-06-04T16:16:10.674 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:10.672+0000 7ff5b2fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-06-04T16:16:10.674 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:10.672+0000 7ff700c13800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-06-04T16:16:10.674 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:10.672+0000 7ff700c13800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-06-04T16:16:10.674 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:10.672+0000 7ff700c13800 5 note: GC not initialized 2024-06-04T16:16:10.674 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:10.673+0000 7ff5b1fdb640 20 reqs_thread_entry: start 2024-06-04T16:16:10.674 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:10.673+0000 7ff700c13800 20 init_complete bucket index max shards: 11 2024-06-04T16:16:10.675 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:10.673+0000 7ff700c13800 20 Filter name: none 2024-06-04T16:16:10.675 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:10.673+0000 7ff5237fe640 20 reqs_thread_entry: start 2024-06-04T16:16:10.675 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:10.673+0000 7ff700c13800 10 cache get: name=default.rgw.meta+users.uid+foobar.client.0 : miss 2024-06-04T16:16:10.675 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:10.673+0000 7ff700c13800 20 rados->read ofs=0 len=0 2024-06-04T16:16:10.675 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:10.673+0000 7ff700c13800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:16:10.675 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:10.673+0000 7ff700c13800 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x0 2024-06-04T16:16:10.675 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:10.673+0000 7ff700c13800 10 adding default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-06-04T16:16:10.675 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:10.673+0000 7ff700c13800 10 cache get: name=default.rgw.meta+users.email+foobar.client.0+test@test.test : miss 2024-06-04T16:16:10.675 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:10.673+0000 7ff700c13800 20 rados->read ofs=0 len=0 2024-06-04T16:16:10.676 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:10.674+0000 7ff700c13800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:16:10.676 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:10.674+0000 7ff700c13800 10 cache put: name=default.rgw.meta+users.email+foobar.client.0+test@test.test info.flags=0x0 2024-06-04T16:16:10.676 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:10.674+0000 7ff700c13800 10 adding default.rgw.meta+users.email+foobar.client.0+test@test.test to cache LRU end 2024-06-04T16:16:10.676 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:10.674+0000 7ff700c13800 10 cache get: name=default.rgw.meta+users.keys+GDOLSYZEWWILAWORBVLR : miss 2024-06-04T16:16:10.676 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:10.674+0000 7ff700c13800 20 rados->read ofs=0 len=0 2024-06-04T16:16:10.676 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:10.674+0000 7ff700c13800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:16:10.676 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:10.674+0000 7ff700c13800 10 cache put: name=default.rgw.meta+users.keys+GDOLSYZEWWILAWORBVLR info.flags=0x0 2024-06-04T16:16:10.676 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:10.674+0000 7ff700c13800 10 adding default.rgw.meta+users.keys+GDOLSYZEWWILAWORBVLR to cache LRU end 2024-06-04T16:16:10.677 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:10.674+0000 7ff700c13800 10 cache get: name=default.rgw.meta+users.keys+GDOLSYZEWWILAWORBVLR : hit (negative entry) 2024-06-04T16:16:10.677 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:10.674+0000 7ff700c13800 10 cache get: name=default.rgw.meta+users.keys+GDOLSYZEWWILAWORBVLR : hit (negative entry) 2024-06-04T16:16:10.677 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:10.675+0000 7ff700c13800 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-06-04T16:16:10.677 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:10.675+0000 7ff700c13800 10 moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-06-04T16:16:10.677 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:10.675+0000 7ff700c13800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:foobar.client.0, ofs0, ns] 2024-06-04T16:16:10.677 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:10.676+0000 7ff5d37fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1090921693452 cookie 94899503644400 notifier 7704 bl.length()=689 2024-06-04T16:16:10.677 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:10.676+0000 7ff5d37fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-06-04T16:16:10.677 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:10.676+0000 7ff5d37fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-06-04T16:16:10.678 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:10.677+0000 7ff700c13800 10 cache put: name=default.rgw.meta+users.email+foobar.client.0+test@test.test info.flags=0x7 2024-06-04T16:16:10.678 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:10.677+0000 7ff700c13800 10 moving default.rgw.meta+users.email+foobar.client.0+test@test.test to cache LRU end 2024-06-04T16:16:10.678 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:10.677+0000 7ff700c13800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.email:foobar.client.0+test@test.test, ofs0, ns] 2024-06-04T16:16:10.678 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:10.678+0000 7ff5d37fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1090921693453 cookie 94899503641520 notifier 7704 bl.length()=200 2024-06-04T16:16:10.679 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:10.678+0000 7ff5d37fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+foobar.client.0+test@test.test info.flags=0x7 2024-06-04T16:16:10.679 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:10.678+0000 7ff5d37fe640 10 rgw watcher librados: moving default.rgw.meta+users.email+foobar.client.0+test@test.test to cache LRU end 2024-06-04T16:16:10.680 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:10.679+0000 7ff700c13800 10 cache put: name=default.rgw.meta+users.keys+GDOLSYZEWWILAWORBVLR info.flags=0x7 2024-06-04T16:16:10.680 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:10.679+0000 7ff700c13800 10 moving default.rgw.meta+users.keys+GDOLSYZEWWILAWORBVLR to cache LRU end 2024-06-04T16:16:10.680 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:10.679+0000 7ff700c13800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:GDOLSYZEWWILAWORBVLR, ofs0, ns] 2024-06-04T16:16:10.680 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:10.679+0000 7ff5d37fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1090921693260 cookie 94899503628096 notifier 7704 bl.length()=189 2024-06-04T16:16:10.680 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:10.679+0000 7ff5d37fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+GDOLSYZEWWILAWORBVLR info.flags=0x7 2024-06-04T16:16:10.680 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:10.679+0000 7ff5d37fe640 10 rgw watcher librados: moving default.rgw.meta+users.keys+GDOLSYZEWWILAWORBVLR to cache LRU end 2024-06-04T16:16:10.681 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-06-04T16:16:10.681 INFO:teuthology.orchestra.run.smithi144.stdout: "user_id": "foobar.client.0", 2024-06-04T16:16:10.681 INFO:teuthology.orchestra.run.smithi144.stdout: "display_name": "Mr. foobar.client.0", 2024-06-04T16:16:10.681 INFO:teuthology.orchestra.run.smithi144.stdout: "email": "foobar.client.0+test@test.test", 2024-06-04T16:16:10.681 INFO:teuthology.orchestra.run.smithi144.stdout: "suspended": 0, 2024-06-04T16:16:10.681 INFO:teuthology.orchestra.run.smithi144.stdout: "max_buckets": 1000, 2024-06-04T16:16:10.681 INFO:teuthology.orchestra.run.smithi144.stdout: "subusers": [], 2024-06-04T16:16:10.681 INFO:teuthology.orchestra.run.smithi144.stdout: "keys": [ 2024-06-04T16:16:10.681 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-06-04T16:16:10.681 INFO:teuthology.orchestra.run.smithi144.stdout: "user": "foobar.client.0", 2024-06-04T16:16:10.681 INFO:teuthology.orchestra.run.smithi144.stdout: "access_key": "GDOLSYZEWWILAWORBVLR", 2024-06-04T16:16:10.682 INFO:teuthology.orchestra.run.smithi144.stdout: "secret_key": "ry1IHLIuh2hSX025PJ7vpBjlrp7gIkPvhqwRXDfDwkS3qlRd/v0mdw==", 2024-06-04T16:16:10.682 INFO:teuthology.orchestra.run.smithi144.stdout: "active": true, 2024-06-04T16:16:10.682 INFO:teuthology.orchestra.run.smithi144.stdout: "create_date": "2024-06-04T16:16:10.675273Z" 2024-06-04T16:16:10.682 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-06-04T16:16:10.682 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-06-04T16:16:10.682 INFO:teuthology.orchestra.run.smithi144.stdout: "swift_keys": [], 2024-06-04T16:16:10.682 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": [ 2024-06-04T16:16:10.682 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-06-04T16:16:10.682 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "user-policy", 2024-06-04T16:16:10.682 INFO:teuthology.orchestra.run.smithi144.stdout: "perm": "*" 2024-06-04T16:16:10.682 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-06-04T16:16:10.682 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-06-04T16:16:10.682 INFO:teuthology.orchestra.run.smithi144.stdout: "op_mask": "read, write, delete", 2024-06-04T16:16:10.682 INFO:teuthology.orchestra.run.smithi144.stdout: "default_placement": "", 2024-06-04T16:16:10.683 INFO:teuthology.orchestra.run.smithi144.stdout: "default_storage_class": "", 2024-06-04T16:16:10.683 INFO:teuthology.orchestra.run.smithi144.stdout: "placement_tags": [], 2024-06-04T16:16:10.683 INFO:teuthology.orchestra.run.smithi144.stdout: "bucket_quota": { 2024-06-04T16:16:10.683 INFO:teuthology.orchestra.run.smithi144.stdout: "enabled": false, 2024-06-04T16:16:10.683 INFO:teuthology.orchestra.run.smithi144.stdout: "check_on_raw": false, 2024-06-04T16:16:10.683 INFO:teuthology.orchestra.run.smithi144.stdout: "max_size": -1, 2024-06-04T16:16:10.683 INFO:teuthology.orchestra.run.smithi144.stdout: "max_size_kb": 0, 2024-06-04T16:16:10.683 INFO:teuthology.orchestra.run.smithi144.stdout: "max_objects": -1 2024-06-04T16:16:10.683 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-06-04T16:16:10.683 INFO:teuthology.orchestra.run.smithi144.stdout: "user_quota": { 2024-06-04T16:16:10.683 INFO:teuthology.orchestra.run.smithi144.stdout: "enabled": false, 2024-06-04T16:16:10.683 INFO:teuthology.orchestra.run.smithi144.stdout: "check_on_raw": false, 2024-06-04T16:16:10.683 INFO:teuthology.orchestra.run.smithi144.stdout: "max_size": -1, 2024-06-04T16:16:10.683 INFO:teuthology.orchestra.run.smithi144.stdout: "max_size_kb": 0, 2024-06-04T16:16:10.683 INFO:teuthology.orchestra.run.smithi144.stdout: "max_objects": -1 2024-06-04T16:16:10.683 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-06-04T16:16:10.684 INFO:teuthology.orchestra.run.smithi144.stdout: "temp_url_keys": [], 2024-06-04T16:16:10.684 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "rgw", 2024-06-04T16:16:10.684 INFO:teuthology.orchestra.run.smithi144.stdout: "mfa_ids": [], 2024-06-04T16:16:10.684 INFO:teuthology.orchestra.run.smithi144.stdout: "account_id": "", 2024-06-04T16:16:10.684 INFO:teuthology.orchestra.run.smithi144.stdout: "path": "/", 2024-06-04T16:16:10.684 INFO:teuthology.orchestra.run.smithi144.stdout: "create_date": "2024-06-04T16:16:10.675261Z", 2024-06-04T16:16:10.684 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-06-04T16:16:10.684 INFO:teuthology.orchestra.run.smithi144.stdout: "group_ids": [] 2024-06-04T16:16:10.684 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-06-04T16:16:10.684 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:16:10.685 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:10.681+0000 7ff5b2fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-06-04T16:16:10.685 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:10.683+0000 7ff700c13800 20 remove_watcher() i=0 2024-06-04T16:16:10.685 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:10.683+0000 7ff700c13800 2 removed watcher, disabling cache 2024-06-04T16:16:10.685 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:10.684+0000 7ff700c13800 20 remove_watcher() i=1 2024-06-04T16:16:10.686 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:10.685+0000 7ff700c13800 20 remove_watcher() i=2 2024-06-04T16:16:10.687 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:10.686+0000 7ff700c13800 20 remove_watcher() i=3 2024-06-04T16:16:10.688 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:10.687+0000 7ff700c13800 20 remove_watcher() i=4 2024-06-04T16:16:10.689 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:10.688+0000 7ff700c13800 20 remove_watcher() i=5 2024-06-04T16:16:10.690 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:10.689+0000 7ff700c13800 20 remove_watcher() i=6 2024-06-04T16:16:10.691 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:10.691+0000 7ff700c13800 20 remove_watcher() i=7 2024-06-04T16:16:10.703 DEBUG:teuthology.orchestra.run.smithi144:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid foobar.client.0 --totp-serial 9267878036 --totp-seed REOBD7HAGTAGOWDQFDV2ISSKPAGS2AR6HA27EU6TWMYKUXSGHTLY2OBCJGKSS66T --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-06-04T16:16:10.768 INFO:teuthology.orchestra.run.smithi144.stderr:ignoring --setuser ceph since I am not root 2024-06-04T16:16:10.768 INFO:teuthology.orchestra.run.smithi144.stderr:ignoring --setgroup ceph since I am not root 2024-06-04T16:16:10.801 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:10.800+0000 7fc678c38800 20 rados->read ofs=0 len=0 2024-06-04T16:16:10.803 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:10.802+0000 7fc678c38800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:16:10.803 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:10.802+0000 7fc678c38800 20 realm 2024-06-04T16:16:10.803 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:10.802+0000 7fc678c38800 20 rados->read ofs=0 len=0 2024-06-04T16:16:10.803 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:10.802+0000 7fc678c38800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:16:10.803 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:10.802+0000 7fc678c38800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-06-04T16:16:10.803 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:10.802+0000 7fc678c38800 20 rados->read ofs=0 len=0 2024-06-04T16:16:10.804 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:10.802+0000 7fc678c38800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:16:10.804 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:10.802+0000 7fc678c38800 20 rados->read ofs=0 len=0 2024-06-04T16:16:10.804 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:10.803+0000 7fc678c38800 20 rados_obj.operate() r=0 bl.length=46 2024-06-04T16:16:10.804 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:10.803+0000 7fc678c38800 20 rados->read ofs=0 len=0 2024-06-04T16:16:10.804 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:10.804+0000 7fc678c38800 20 rados_obj.operate() r=0 bl.length=1139 2024-06-04T16:16:10.805 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:10.804+0000 7fc678c38800 20 searching for the correct realm 2024-06-04T16:16:10.806 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:10.806+0000 7fc675f2c640 0 -- 172.21.15.144:0/1637085977 >> [v2:172.21.15.144:6816/2358575268,v1:172.21.15.144:6817/2358575268] conn(0x5638f5610ca0 msgr2=0x5638f56130f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-06-04T16:16:10.810 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:10.809+0000 7fc675f2c640 0 -- 172.21.15.144:0/1637085977 >> [v2:172.21.15.177:6808/2618477608,v1:172.21.15.177:6809/2618477608] conn(0x7fc660084910 msgr2=0x7fc660057420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-06-04T16:16:11.018 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:11.017+0000 7fc678c38800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-06-04T16:16:11.018 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:11.017+0000 7fc678c38800 20 RGWRados::pool_iterate: got zone_info.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767 2024-06-04T16:16:11.019 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:11.017+0000 7fc678c38800 20 RGWRados::pool_iterate: got default.zone. 2024-06-04T16:16:11.019 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:11.017+0000 7fc678c38800 20 RGWRados::pool_iterate: got zonegroup_info.abb22408-c332-4e28-8f7a-ff254ea2fed2 2024-06-04T16:16:11.019 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:11.017+0000 7fc678c38800 20 RGWRados::pool_iterate: got zone_names.default 2024-06-04T16:16:11.019 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:11.017+0000 7fc678c38800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-06-04T16:16:11.019 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:11.017+0000 7fc678c38800 20 rados->read ofs=0 len=0 2024-06-04T16:16:11.019 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:11.017+0000 7fc678c38800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:16:11.019 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:11.017+0000 7fc678c38800 20 rados->read ofs=0 len=0 2024-06-04T16:16:11.019 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:11.017+0000 7fc678c38800 20 rados_obj.operate() r=0 bl.length=46 2024-06-04T16:16:11.019 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:11.017+0000 7fc678c38800 20 rados->read ofs=0 len=0 2024-06-04T16:16:11.020 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:11.018+0000 7fc678c38800 20 rados_obj.operate() r=0 bl.length=470 2024-06-04T16:16:11.021 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:11.018+0000 7fc678c38800 20 zone default found 2024-06-04T16:16:11.021 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:11.018+0000 7fc678c38800 4 Realm: () 2024-06-04T16:16:11.021 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:11.018+0000 7fc678c38800 4 ZoneGroup: default (abb22408-c332-4e28-8f7a-ff254ea2fed2) 2024-06-04T16:16:11.021 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:11.018+0000 7fc678c38800 4 Zone: default (be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767) 2024-06-04T16:16:11.021 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:11.018+0000 7fc678c38800 10 cannot find current period zonegroup using local zonegroup configuration 2024-06-04T16:16:11.021 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:11.018+0000 7fc678c38800 20 zonegroup default 2024-06-04T16:16:11.021 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:11.018+0000 7fc678c38800 20 rados->read ofs=0 len=0 2024-06-04T16:16:11.021 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:11.018+0000 7fc678c38800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:16:11.021 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:11.018+0000 7fc678c38800 20 rados->read ofs=0 len=0 2024-06-04T16:16:11.021 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:11.019+0000 7fc678c38800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:16:11.021 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:11.019+0000 7fc678c38800 20 rados->read ofs=0 len=0 2024-06-04T16:16:11.021 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:11.019+0000 7fc678c38800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:16:11.021 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:11.019+0000 7fc678c38800 20 started sync module instance, tier type = 2024-06-04T16:16:11.022 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:11.019+0000 7fc678c38800 20 started zone id=be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767 (name=default) with tier type = 2024-06-04T16:16:11.029 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:11.028+0000 7fc678c38800 20 add_watcher() i=0 2024-06-04T16:16:11.029 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:11.028+0000 7fc678c38800 20 add_watcher() i=1 2024-06-04T16:16:11.029 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:11.028+0000 7fc678c38800 20 add_watcher() i=2 2024-06-04T16:16:11.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:11.028+0000 7fc678c38800 20 add_watcher() i=3 2024-06-04T16:16:11.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:11.028+0000 7fc678c38800 20 add_watcher() i=4 2024-06-04T16:16:11.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:11.028+0000 7fc678c38800 20 add_watcher() i=5 2024-06-04T16:16:11.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:11.028+0000 7fc678c38800 20 add_watcher() i=6 2024-06-04T16:16:11.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:11.029+0000 7fc678c38800 20 add_watcher() i=7 2024-06-04T16:16:11.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:11.029+0000 7fc678c38800 2 all 8 watchers are set, enabling cache 2024-06-04T16:16:11.033 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:11.031+0000 7fc52cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-06-04T16:16:11.033 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:11.031+0000 7fc678c38800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-06-04T16:16:11.033 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:11.031+0000 7fc678c38800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-06-04T16:16:11.033 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:11.031+0000 7fc678c38800 5 note: GC not initialized 2024-06-04T16:16:11.033 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:11.032+0000 7fc4a77fe640 20 reqs_thread_entry: start 2024-06-04T16:16:11.033 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:11.032+0000 7fc678c38800 20 init_complete bucket index max shards: 11 2024-06-04T16:16:11.033 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:11.032+0000 7fc678c38800 20 Filter name: none 2024-06-04T16:16:11.033 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:11.032+0000 7fc4a57fa640 20 reqs_thread_entry: start 2024-06-04T16:16:11.033 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:11.032+0000 7fc678c38800 10 cache get: name=default.rgw.meta+users.uid+foobar.client.0 : miss 2024-06-04T16:16:11.034 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:11.032+0000 7fc678c38800 20 rados->read ofs=0 len=0 2024-06-04T16:16:11.034 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:11.033+0000 7fc678c38800 20 rados_obj.operate() r=0 bl.length=501 2024-06-04T16:16:11.034 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:11.033+0000 7fc678c38800 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x13 2024-06-04T16:16:11.034 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:11.033+0000 7fc678c38800 10 adding default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-06-04T16:16:11.034 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:11.033+0000 7fc678c38800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-06-04T16:16:11.036 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:11.035+0000 7fc678c38800 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-06-04T16:16:11.036 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:11.035+0000 7fc678c38800 10 moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-06-04T16:16:11.036 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:11.035+0000 7fc678c38800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:foobar.client.0, ofs0, ns] 2024-06-04T16:16:11.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:11.036+0000 7fc559ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1090921693454 cookie 94802635001104 notifier 7265 bl.length()=703 2024-06-04T16:16:11.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:11.036+0000 7fc559ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-06-04T16:16:11.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:11.036+0000 7fc559ffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-06-04T16:16:11.038 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:11.037+0000 7fc52cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-06-04T16:16:11.040 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:11.039+0000 7fc678c38800 20 remove_watcher() i=0 2024-06-04T16:16:11.040 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:11.039+0000 7fc678c38800 2 removed watcher, disabling cache 2024-06-04T16:16:11.041 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:11.040+0000 7fc678c38800 20 remove_watcher() i=1 2024-06-04T16:16:11.042 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:11.042+0000 7fc678c38800 20 remove_watcher() i=2 2024-06-04T16:16:11.043 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:11.043+0000 7fc678c38800 20 remove_watcher() i=3 2024-06-04T16:16:11.044 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:11.044+0000 7fc678c38800 20 remove_watcher() i=4 2024-06-04T16:16:11.046 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:11.045+0000 7fc678c38800 20 remove_watcher() i=5 2024-06-04T16:16:11.046 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:11.046+0000 7fc678c38800 20 remove_watcher() i=6 2024-06-04T16:16:11.047 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:11.047+0000 7fc678c38800 20 remove_watcher() i=7 2024-06-04T16:16:11.059 DEBUG:teuthology.orchestra.run.smithi144:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 caps add --uid foobar.client.0 --caps 'roles=*' --cluster ceph 2024-06-04T16:16:11.116 INFO:teuthology.orchestra.run.smithi144.stderr:ignoring --setuser ceph since I am not root 2024-06-04T16:16:11.116 INFO:teuthology.orchestra.run.smithi144.stderr:ignoring --setgroup ceph since I am not root 2024-06-04T16:16:11.150 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:11.149+0000 7f7ad4e32800 20 rados->read ofs=0 len=0 2024-06-04T16:16:11.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:11.151+0000 7f7ad4e32800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:16:11.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:11.151+0000 7f7ad4e32800 20 realm 2024-06-04T16:16:11.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:11.151+0000 7f7ad4e32800 20 rados->read ofs=0 len=0 2024-06-04T16:16:11.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:11.151+0000 7f7ad4e32800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:16:11.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:11.151+0000 7f7ad4e32800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-06-04T16:16:11.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:11.151+0000 7f7ad4e32800 20 rados->read ofs=0 len=0 2024-06-04T16:16:11.153 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:11.151+0000 7f7ad4e32800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:16:11.153 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:11.151+0000 7f7ad4e32800 20 rados->read ofs=0 len=0 2024-06-04T16:16:11.153 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:11.152+0000 7f7ad4e32800 20 rados_obj.operate() r=0 bl.length=46 2024-06-04T16:16:11.153 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:11.152+0000 7f7ad4e32800 20 rados->read ofs=0 len=0 2024-06-04T16:16:11.153 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:11.152+0000 7f7ad4e32800 20 rados_obj.operate() r=0 bl.length=1139 2024-06-04T16:16:11.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:11.152+0000 7f7ad4e32800 20 searching for the correct realm 2024-06-04T16:16:11.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:11.154+0000 7f7ac786e640 0 -- 172.21.15.144:0/703944077 >> [v2:172.21.15.144:6808/86532035,v1:172.21.15.144:6809/86532035] conn(0x7f7ac005b040 msgr2=0x7f7ac0065920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-06-04T16:16:11.360 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:11.359+0000 7f7ad006f640 0 -- 172.21.15.144:0/703944077 >> [v2:172.21.15.177:6824/800067290,v1:172.21.15.177:6825/800067290] conn(0x55dc3beff1c0 msgr2=0x55dc3bf01680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-06-04T16:16:11.366 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:11.365+0000 7f7ad4e32800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-06-04T16:16:11.366 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:11.365+0000 7f7ad4e32800 20 RGWRados::pool_iterate: got zone_info.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767 2024-06-04T16:16:11.366 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:11.365+0000 7f7ad4e32800 20 RGWRados::pool_iterate: got default.zone. 2024-06-04T16:16:11.366 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:11.365+0000 7f7ad4e32800 20 RGWRados::pool_iterate: got zonegroup_info.abb22408-c332-4e28-8f7a-ff254ea2fed2 2024-06-04T16:16:11.366 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:11.365+0000 7f7ad4e32800 20 RGWRados::pool_iterate: got zone_names.default 2024-06-04T16:16:11.366 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:11.365+0000 7f7ad4e32800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-06-04T16:16:11.366 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:11.365+0000 7f7ad4e32800 20 rados->read ofs=0 len=0 2024-06-04T16:16:11.366 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:11.365+0000 7f7ad4e32800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:16:11.366 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:11.365+0000 7f7ad4e32800 20 rados->read ofs=0 len=0 2024-06-04T16:16:11.367 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:11.365+0000 7f7ad4e32800 20 rados_obj.operate() r=0 bl.length=46 2024-06-04T16:16:11.367 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:11.365+0000 7f7ad4e32800 20 rados->read ofs=0 len=0 2024-06-04T16:16:11.367 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:11.365+0000 7f7ad4e32800 20 rados_obj.operate() r=0 bl.length=470 2024-06-04T16:16:11.367 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:11.365+0000 7f7ad4e32800 20 zone default found 2024-06-04T16:16:11.368 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:11.365+0000 7f7ad4e32800 4 Realm: () 2024-06-04T16:16:11.368 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:11.365+0000 7f7ad4e32800 4 ZoneGroup: default (abb22408-c332-4e28-8f7a-ff254ea2fed2) 2024-06-04T16:16:11.368 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:11.365+0000 7f7ad4e32800 4 Zone: default (be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767) 2024-06-04T16:16:11.368 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:11.365+0000 7f7ad4e32800 10 cannot find current period zonegroup using local zonegroup configuration 2024-06-04T16:16:11.368 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:11.365+0000 7f7ad4e32800 20 zonegroup default 2024-06-04T16:16:11.368 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:11.365+0000 7f7ad4e32800 20 rados->read ofs=0 len=0 2024-06-04T16:16:11.368 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:11.366+0000 7f7ad4e32800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:16:11.368 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:11.366+0000 7f7ad4e32800 20 rados->read ofs=0 len=0 2024-06-04T16:16:11.368 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:11.366+0000 7f7ad4e32800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:16:11.368 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:11.366+0000 7f7ad4e32800 20 rados->read ofs=0 len=0 2024-06-04T16:16:11.368 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:11.366+0000 7f7ad4e32800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:16:11.368 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:11.366+0000 7f7ad4e32800 20 started sync module instance, tier type = 2024-06-04T16:16:11.368 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:11.366+0000 7f7ad4e32800 20 started zone id=be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767 (name=default) with tier type = 2024-06-04T16:16:11.376 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:11.375+0000 7f7ad4e32800 20 add_watcher() i=0 2024-06-04T16:16:11.376 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:11.375+0000 7f7ad4e32800 20 add_watcher() i=1 2024-06-04T16:16:11.376 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:11.375+0000 7f7ad4e32800 20 add_watcher() i=2 2024-06-04T16:16:11.377 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:11.375+0000 7f7ad4e32800 20 add_watcher() i=3 2024-06-04T16:16:11.377 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:11.375+0000 7f7ad4e32800 20 add_watcher() i=4 2024-06-04T16:16:11.377 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:11.375+0000 7f7ad4e32800 20 add_watcher() i=5 2024-06-04T16:16:11.377 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:11.375+0000 7f7ad4e32800 20 add_watcher() i=6 2024-06-04T16:16:11.377 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:11.376+0000 7f7ad4e32800 20 add_watcher() i=7 2024-06-04T16:16:11.377 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:11.376+0000 7f7ad4e32800 2 all 8 watchers are set, enabling cache 2024-06-04T16:16:11.380 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:11.378+0000 7f79867e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-06-04T16:16:11.380 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:11.378+0000 7f7ad4e32800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-06-04T16:16:11.380 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:11.378+0000 7f7ad4e32800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-06-04T16:16:11.380 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:11.378+0000 7f7ad4e32800 5 note: GC not initialized 2024-06-04T16:16:11.380 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:11.379+0000 7f79857e2640 20 reqs_thread_entry: start 2024-06-04T16:16:11.380 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:11.379+0000 7f7ad4e32800 20 init_complete bucket index max shards: 11 2024-06-04T16:16:11.380 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:11.379+0000 7f7ad4e32800 20 Filter name: none 2024-06-04T16:16:11.380 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:11.379+0000 7f78f6ffd640 20 reqs_thread_entry: start 2024-06-04T16:16:11.380 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:11.379+0000 7f7ad4e32800 10 cache get: name=default.rgw.meta+users.uid+foobar.client.0 : miss 2024-06-04T16:16:11.380 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:11.379+0000 7f7ad4e32800 20 rados->read ofs=0 len=0 2024-06-04T16:16:11.381 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:11.380+0000 7f7ad4e32800 20 rados_obj.operate() r=0 bl.length=515 2024-06-04T16:16:11.381 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:11.380+0000 7f7ad4e32800 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x13 2024-06-04T16:16:11.381 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:11.380+0000 7f7ad4e32800 10 adding default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-06-04T16:16:11.381 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:11.380+0000 7f7ad4e32800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-06-04T16:16:11.382 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:11.381+0000 7f7ad4e32800 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-06-04T16:16:11.382 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:11.381+0000 7f7ad4e32800 10 moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-06-04T16:16:11.382 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:11.381+0000 7f7ad4e32800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:foobar.client.0, ofs0, ns] 2024-06-04T16:16:11.382 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:11.381+0000 7f79af7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1090921693455 cookie 94404386829872 notifier 7740 bl.length()=716 2024-06-04T16:16:11.382 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:11.381+0000 7f79af7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-06-04T16:16:11.383 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:11.381+0000 7f79af7fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-06-04T16:16:11.383 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-06-04T16:16:11.383 INFO:teuthology.orchestra.run.smithi144.stdout: "user_id": "foobar.client.0", 2024-06-04T16:16:11.383 INFO:teuthology.orchestra.run.smithi144.stdout: "display_name": "Mr. foobar.client.0", 2024-06-04T16:16:11.383 INFO:teuthology.orchestra.run.smithi144.stdout: "email": "foobar.client.0+test@test.test", 2024-06-04T16:16:11.383 INFO:teuthology.orchestra.run.smithi144.stdout: "suspended": 0, 2024-06-04T16:16:11.383 INFO:teuthology.orchestra.run.smithi144.stdout: "max_buckets": 1000, 2024-06-04T16:16:11.383 INFO:teuthology.orchestra.run.smithi144.stdout: "subusers": [], 2024-06-04T16:16:11.383 INFO:teuthology.orchestra.run.smithi144.stdout: "keys": [ 2024-06-04T16:16:11.384 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-06-04T16:16:11.384 INFO:teuthology.orchestra.run.smithi144.stdout: "user": "foobar.client.0", 2024-06-04T16:16:11.384 INFO:teuthology.orchestra.run.smithi144.stdout: "access_key": "GDOLSYZEWWILAWORBVLR", 2024-06-04T16:16:11.384 INFO:teuthology.orchestra.run.smithi144.stdout: "secret_key": "ry1IHLIuh2hSX025PJ7vpBjlrp7gIkPvhqwRXDfDwkS3qlRd/v0mdw==", 2024-06-04T16:16:11.384 INFO:teuthology.orchestra.run.smithi144.stdout: "active": true, 2024-06-04T16:16:11.384 INFO:teuthology.orchestra.run.smithi144.stdout: "create_date": "2024-06-04T16:16:10.675273Z" 2024-06-04T16:16:11.384 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-06-04T16:16:11.384 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-06-04T16:16:11.384 INFO:teuthology.orchestra.run.smithi144.stdout: "swift_keys": [], 2024-06-04T16:16:11.384 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": [ 2024-06-04T16:16:11.384 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-06-04T16:16:11.385 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "roles", 2024-06-04T16:16:11.385 INFO:teuthology.orchestra.run.smithi144.stdout: "perm": "*" 2024-06-04T16:16:11.385 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-06-04T16:16:11.385 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-06-04T16:16:11.385 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "user-policy", 2024-06-04T16:16:11.385 INFO:teuthology.orchestra.run.smithi144.stdout: "perm": "*" 2024-06-04T16:16:11.385 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-06-04T16:16:11.385 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-06-04T16:16:11.385 INFO:teuthology.orchestra.run.smithi144.stdout: "op_mask": "read, write, delete", 2024-06-04T16:16:11.385 INFO:teuthology.orchestra.run.smithi144.stdout: "default_placement": "", 2024-06-04T16:16:11.385 INFO:teuthology.orchestra.run.smithi144.stdout: "default_storage_class": "", 2024-06-04T16:16:11.385 INFO:teuthology.orchestra.run.smithi144.stdout: "placement_tags": [], 2024-06-04T16:16:11.385 INFO:teuthology.orchestra.run.smithi144.stdout: "bucket_quota": { 2024-06-04T16:16:11.385 INFO:teuthology.orchestra.run.smithi144.stdout: "enabled": false, 2024-06-04T16:16:11.386 INFO:teuthology.orchestra.run.smithi144.stdout: "check_on_raw": false, 2024-06-04T16:16:11.386 INFO:teuthology.orchestra.run.smithi144.stdout: "max_size": -1, 2024-06-04T16:16:11.386 INFO:teuthology.orchestra.run.smithi144.stdout: "max_size_kb": 0, 2024-06-04T16:16:11.386 INFO:teuthology.orchestra.run.smithi144.stdout: "max_objects": -1 2024-06-04T16:16:11.386 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-06-04T16:16:11.386 INFO:teuthology.orchestra.run.smithi144.stdout: "user_quota": { 2024-06-04T16:16:11.386 INFO:teuthology.orchestra.run.smithi144.stdout: "enabled": false, 2024-06-04T16:16:11.386 INFO:teuthology.orchestra.run.smithi144.stdout: "check_on_raw": false, 2024-06-04T16:16:11.386 INFO:teuthology.orchestra.run.smithi144.stdout: "max_size": -1, 2024-06-04T16:16:11.386 INFO:teuthology.orchestra.run.smithi144.stdout: "max_size_kb": 0, 2024-06-04T16:16:11.386 INFO:teuthology.orchestra.run.smithi144.stdout: "max_objects": -1 2024-06-04T16:16:11.386 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-06-04T16:16:11.386 INFO:teuthology.orchestra.run.smithi144.stdout: "temp_url_keys": [], 2024-06-04T16:16:11.386 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "rgw", 2024-06-04T16:16:11.387 INFO:teuthology.orchestra.run.smithi144.stdout: "mfa_ids": [ 2024-06-04T16:16:11.387 INFO:teuthology.orchestra.run.smithi144.stdout: "9267878036" 2024-06-04T16:16:11.387 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-06-04T16:16:11.387 INFO:teuthology.orchestra.run.smithi144.stdout: "account_id": "", 2024-06-04T16:16:11.387 INFO:teuthology.orchestra.run.smithi144.stdout: "path": "/", 2024-06-04T16:16:11.387 INFO:teuthology.orchestra.run.smithi144.stdout: "create_date": "2024-06-04T16:16:10.675261Z", 2024-06-04T16:16:11.387 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-06-04T16:16:11.387 INFO:teuthology.orchestra.run.smithi144.stdout: "group_ids": [] 2024-06-04T16:16:11.387 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-06-04T16:16:11.387 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:16:11.388 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:11.383+0000 7f79867e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-06-04T16:16:11.388 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:11.385+0000 7f7ad4e32800 20 remove_watcher() i=0 2024-06-04T16:16:11.388 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:11.385+0000 7f7ad4e32800 2 removed watcher, disabling cache 2024-06-04T16:16:11.388 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:11.386+0000 7f7ad4e32800 20 remove_watcher() i=1 2024-06-04T16:16:11.388 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:11.387+0000 7f7ad4e32800 20 remove_watcher() i=2 2024-06-04T16:16:11.389 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:11.388+0000 7f7ad4e32800 20 remove_watcher() i=3 2024-06-04T16:16:11.390 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:11.389+0000 7f7ad4e32800 20 remove_watcher() i=4 2024-06-04T16:16:11.391 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:11.390+0000 7f7ad4e32800 20 remove_watcher() i=5 2024-06-04T16:16:11.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:11.391+0000 7f7ad4e32800 20 remove_watcher() i=6 2024-06-04T16:16:11.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:11.392+0000 7f7ad4e32800 20 remove_watcher() i=7 2024-06-04T16:16:11.404 DEBUG:teuthology.orchestra.run.smithi144:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 caps add --uid foobar.client.0 --caps 'oidc-provider=*' --cluster ceph 2024-06-04T16:16:11.461 INFO:teuthology.orchestra.run.smithi144.stderr:ignoring --setuser ceph since I am not root 2024-06-04T16:16:11.461 INFO:teuthology.orchestra.run.smithi144.stderr:ignoring --setgroup ceph since I am not root 2024-06-04T16:16:11.495 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:11.494+0000 7fb16c322800 20 rados->read ofs=0 len=0 2024-06-04T16:16:11.497 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:11.496+0000 7fb16c322800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:16:11.497 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:11.496+0000 7fb16c322800 20 realm 2024-06-04T16:16:11.497 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:11.496+0000 7fb16c322800 20 rados->read ofs=0 len=0 2024-06-04T16:16:11.497 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:11.496+0000 7fb16c322800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:16:11.497 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:11.496+0000 7fb16c322800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-06-04T16:16:11.497 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:11.496+0000 7fb16c322800 20 rados->read ofs=0 len=0 2024-06-04T16:16:11.497 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:11.496+0000 7fb16c322800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:16:11.497 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:11.496+0000 7fb16c322800 20 rados->read ofs=0 len=0 2024-06-04T16:16:11.498 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:11.497+0000 7fb16c322800 20 rados_obj.operate() r=0 bl.length=46 2024-06-04T16:16:11.498 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:11.497+0000 7fb16c322800 20 rados->read ofs=0 len=0 2024-06-04T16:16:11.499 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:11.498+0000 7fb16c322800 20 rados_obj.operate() r=0 bl.length=1139 2024-06-04T16:16:11.499 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:11.498+0000 7fb16c322800 20 searching for the correct realm 2024-06-04T16:16:11.501 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:11.500+0000 7fb167795640 0 -- 172.21.15.144:0/2227754348 >> [v2:172.21.15.144:6816/2358575268,v1:172.21.15.144:6817/2358575268] conn(0x55e8a8f21f40 msgr2=0x55e8a8f24390 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-06-04T16:16:11.504 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:11.503+0000 7fb167795640 0 -- 172.21.15.144:0/2227754348 >> [v2:172.21.15.177:6808/2618477608,v1:172.21.15.177:6809/2618477608] conn(0x7fb15005f140 msgr2=0x7fb15002c730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-06-04T16:16:11.711 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:11.710+0000 7fb16c322800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-06-04T16:16:11.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:11.710+0000 7fb16c322800 20 RGWRados::pool_iterate: got zone_info.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767 2024-06-04T16:16:11.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:11.710+0000 7fb16c322800 20 RGWRados::pool_iterate: got default.zone. 2024-06-04T16:16:11.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:11.710+0000 7fb16c322800 20 RGWRados::pool_iterate: got zonegroup_info.abb22408-c332-4e28-8f7a-ff254ea2fed2 2024-06-04T16:16:11.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:11.710+0000 7fb16c322800 20 RGWRados::pool_iterate: got zone_names.default 2024-06-04T16:16:11.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:11.710+0000 7fb16c322800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-06-04T16:16:11.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:11.710+0000 7fb16c322800 20 rados->read ofs=0 len=0 2024-06-04T16:16:11.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:11.711+0000 7fb16c322800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:16:11.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:11.711+0000 7fb16c322800 20 rados->read ofs=0 len=0 2024-06-04T16:16:11.713 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:11.711+0000 7fb16c322800 20 rados_obj.operate() r=0 bl.length=46 2024-06-04T16:16:11.713 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:11.711+0000 7fb16c322800 20 rados->read ofs=0 len=0 2024-06-04T16:16:11.713 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:11.711+0000 7fb16c322800 20 rados_obj.operate() r=0 bl.length=470 2024-06-04T16:16:11.713 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:11.711+0000 7fb16c322800 20 zone default found 2024-06-04T16:16:11.714 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:11.711+0000 7fb16c322800 4 Realm: () 2024-06-04T16:16:11.714 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:11.711+0000 7fb16c322800 4 ZoneGroup: default (abb22408-c332-4e28-8f7a-ff254ea2fed2) 2024-06-04T16:16:11.714 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:11.711+0000 7fb16c322800 4 Zone: default (be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767) 2024-06-04T16:16:11.714 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:11.711+0000 7fb16c322800 10 cannot find current period zonegroup using local zonegroup configuration 2024-06-04T16:16:11.714 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:11.711+0000 7fb16c322800 20 zonegroup default 2024-06-04T16:16:11.714 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:11.711+0000 7fb16c322800 20 rados->read ofs=0 len=0 2024-06-04T16:16:11.714 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:11.712+0000 7fb16c322800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:16:11.714 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:11.712+0000 7fb16c322800 20 rados->read ofs=0 len=0 2024-06-04T16:16:11.714 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:11.712+0000 7fb16c322800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:16:11.714 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:11.712+0000 7fb16c322800 20 rados->read ofs=0 len=0 2024-06-04T16:16:11.714 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:11.712+0000 7fb16c322800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:16:11.714 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:11.712+0000 7fb16c322800 20 started sync module instance, tier type = 2024-06-04T16:16:11.714 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:11.712+0000 7fb16c322800 20 started zone id=be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767 (name=default) with tier type = 2024-06-04T16:16:11.723 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:11.722+0000 7fb16c322800 20 add_watcher() i=0 2024-06-04T16:16:11.723 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:11.722+0000 7fb16c322800 20 add_watcher() i=1 2024-06-04T16:16:11.723 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:11.722+0000 7fb16c322800 20 add_watcher() i=2 2024-06-04T16:16:11.723 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:11.722+0000 7fb16c322800 20 add_watcher() i=3 2024-06-04T16:16:11.723 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:11.722+0000 7fb16c322800 20 add_watcher() i=4 2024-06-04T16:16:11.723 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:11.722+0000 7fb16c322800 20 add_watcher() i=5 2024-06-04T16:16:11.723 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:11.722+0000 7fb16c322800 20 add_watcher() i=6 2024-06-04T16:16:11.724 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:11.723+0000 7fb16c322800 20 add_watcher() i=7 2024-06-04T16:16:11.724 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:11.723+0000 7fb16c322800 2 all 8 watchers are set, enabling cache 2024-06-04T16:16:11.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:11.725+0000 7fb01dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-06-04T16:16:11.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:11.725+0000 7fb16c322800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-06-04T16:16:11.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:11.726+0000 7fb16c322800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-06-04T16:16:11.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:11.726+0000 7fb16c322800 5 note: GC not initialized 2024-06-04T16:16:11.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:11.726+0000 7fb01cfe1640 20 reqs_thread_entry: start 2024-06-04T16:16:11.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:11.726+0000 7fb16c322800 20 init_complete bucket index max shards: 11 2024-06-04T16:16:11.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:11.726+0000 7fb16c322800 20 Filter name: none 2024-06-04T16:16:11.728 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:11.726+0000 7faf967fc640 20 reqs_thread_entry: start 2024-06-04T16:16:11.728 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:11.726+0000 7fb16c322800 10 cache get: name=default.rgw.meta+users.uid+foobar.client.0 : miss 2024-06-04T16:16:11.728 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:11.726+0000 7fb16c322800 20 rados->read ofs=0 len=0 2024-06-04T16:16:11.728 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:11.727+0000 7fb16c322800 20 rados_obj.operate() r=0 bl.length=528 2024-06-04T16:16:11.728 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:11.727+0000 7fb16c322800 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x13 2024-06-04T16:16:11.728 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:11.727+0000 7fb16c322800 10 adding default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-06-04T16:16:11.728 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:11.727+0000 7fb16c322800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-06-04T16:16:11.729 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:11.728+0000 7fb16c322800 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-06-04T16:16:11.729 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:11.728+0000 7fb16c322800 10 moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-06-04T16:16:11.729 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:11.728+0000 7fb16c322800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:foobar.client.0, ofs0, ns] 2024-06-04T16:16:11.730 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:11.729+0000 7fb046ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1090921693456 cookie 94457755278304 notifier 7298 bl.length()=737 2024-06-04T16:16:11.730 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:11.729+0000 7fb046ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-06-04T16:16:11.730 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:11.729+0000 7fb046ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-06-04T16:16:11.730 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-06-04T16:16:11.730 INFO:teuthology.orchestra.run.smithi144.stdout: "user_id": "foobar.client.0", 2024-06-04T16:16:11.730 INFO:teuthology.orchestra.run.smithi144.stdout: "display_name": "Mr. foobar.client.0", 2024-06-04T16:16:11.730 INFO:teuthology.orchestra.run.smithi144.stdout: "email": "foobar.client.0+test@test.test", 2024-06-04T16:16:11.730 INFO:teuthology.orchestra.run.smithi144.stdout: "suspended": 0, 2024-06-04T16:16:11.730 INFO:teuthology.orchestra.run.smithi144.stdout: "max_buckets": 1000, 2024-06-04T16:16:11.731 INFO:teuthology.orchestra.run.smithi144.stdout: "subusers": [], 2024-06-04T16:16:11.731 INFO:teuthology.orchestra.run.smithi144.stdout: "keys": [ 2024-06-04T16:16:11.731 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-06-04T16:16:11.731 INFO:teuthology.orchestra.run.smithi144.stdout: "user": "foobar.client.0", 2024-06-04T16:16:11.731 INFO:teuthology.orchestra.run.smithi144.stdout: "access_key": "GDOLSYZEWWILAWORBVLR", 2024-06-04T16:16:11.731 INFO:teuthology.orchestra.run.smithi144.stdout: "secret_key": "ry1IHLIuh2hSX025PJ7vpBjlrp7gIkPvhqwRXDfDwkS3qlRd/v0mdw==", 2024-06-04T16:16:11.731 INFO:teuthology.orchestra.run.smithi144.stdout: "active": true, 2024-06-04T16:16:11.731 INFO:teuthology.orchestra.run.smithi144.stdout: "create_date": "2024-06-04T16:16:10.675273Z" 2024-06-04T16:16:11.731 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-06-04T16:16:11.731 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-06-04T16:16:11.731 INFO:teuthology.orchestra.run.smithi144.stdout: "swift_keys": [], 2024-06-04T16:16:11.731 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": [ 2024-06-04T16:16:11.731 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-06-04T16:16:11.732 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "oidc-provider", 2024-06-04T16:16:11.732 INFO:teuthology.orchestra.run.smithi144.stdout: "perm": "*" 2024-06-04T16:16:11.732 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-06-04T16:16:11.732 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-06-04T16:16:11.732 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "roles", 2024-06-04T16:16:11.732 INFO:teuthology.orchestra.run.smithi144.stdout: "perm": "*" 2024-06-04T16:16:11.732 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-06-04T16:16:11.732 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-06-04T16:16:11.732 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "user-policy", 2024-06-04T16:16:11.732 INFO:teuthology.orchestra.run.smithi144.stdout: "perm": "*" 2024-06-04T16:16:11.732 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-06-04T16:16:11.732 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-06-04T16:16:11.732 INFO:teuthology.orchestra.run.smithi144.stdout: "op_mask": "read, write, delete", 2024-06-04T16:16:11.732 INFO:teuthology.orchestra.run.smithi144.stdout: "default_placement": "", 2024-06-04T16:16:11.732 INFO:teuthology.orchestra.run.smithi144.stdout: "default_storage_class": "", 2024-06-04T16:16:11.733 INFO:teuthology.orchestra.run.smithi144.stdout: "placement_tags": [], 2024-06-04T16:16:11.733 INFO:teuthology.orchestra.run.smithi144.stdout: "bucket_quota": { 2024-06-04T16:16:11.733 INFO:teuthology.orchestra.run.smithi144.stdout: "enabled": false, 2024-06-04T16:16:11.733 INFO:teuthology.orchestra.run.smithi144.stdout: "check_on_raw": false, 2024-06-04T16:16:11.733 INFO:teuthology.orchestra.run.smithi144.stdout: "max_size": -1, 2024-06-04T16:16:11.733 INFO:teuthology.orchestra.run.smithi144.stdout: "max_size_kb": 0, 2024-06-04T16:16:11.733 INFO:teuthology.orchestra.run.smithi144.stdout: "max_objects": -1 2024-06-04T16:16:11.733 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-06-04T16:16:11.733 INFO:teuthology.orchestra.run.smithi144.stdout: "user_quota": { 2024-06-04T16:16:11.733 INFO:teuthology.orchestra.run.smithi144.stdout: "enabled": false, 2024-06-04T16:16:11.733 INFO:teuthology.orchestra.run.smithi144.stdout: "check_on_raw": false, 2024-06-04T16:16:11.733 INFO:teuthology.orchestra.run.smithi144.stdout: "max_size": -1, 2024-06-04T16:16:11.733 INFO:teuthology.orchestra.run.smithi144.stdout: "max_size_kb": 0, 2024-06-04T16:16:11.733 INFO:teuthology.orchestra.run.smithi144.stdout: "max_objects": -1 2024-06-04T16:16:11.733 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-06-04T16:16:11.734 INFO:teuthology.orchestra.run.smithi144.stdout: "temp_url_keys": [], 2024-06-04T16:16:11.734 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "rgw", 2024-06-04T16:16:11.734 INFO:teuthology.orchestra.run.smithi144.stdout: "mfa_ids": [ 2024-06-04T16:16:11.734 INFO:teuthology.orchestra.run.smithi144.stdout: "9267878036" 2024-06-04T16:16:11.734 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-06-04T16:16:11.734 INFO:teuthology.orchestra.run.smithi144.stdout: "account_id": "", 2024-06-04T16:16:11.734 INFO:teuthology.orchestra.run.smithi144.stdout: "path": "/", 2024-06-04T16:16:11.734 INFO:teuthology.orchestra.run.smithi144.stdout: "create_date": "2024-06-04T16:16:10.675261Z", 2024-06-04T16:16:11.734 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-06-04T16:16:11.734 INFO:teuthology.orchestra.run.smithi144.stdout: "group_ids": [] 2024-06-04T16:16:11.734 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-06-04T16:16:11.734 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:16:11.735 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:11.730+0000 7fb01dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-06-04T16:16:11.735 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:11.732+0000 7fb16c322800 20 remove_watcher() i=0 2024-06-04T16:16:11.735 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:11.732+0000 7fb16c322800 2 removed watcher, disabling cache 2024-06-04T16:16:11.735 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:11.734+0000 7fb16c322800 20 remove_watcher() i=1 2024-06-04T16:16:11.736 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:11.735+0000 7fb16c322800 20 remove_watcher() i=2 2024-06-04T16:16:11.736 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:11.736+0000 7fb16c322800 20 remove_watcher() i=3 2024-06-04T16:16:11.738 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:11.737+0000 7fb16c322800 20 remove_watcher() i=4 2024-06-04T16:16:11.739 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:11.738+0000 7fb16c322800 20 remove_watcher() i=5 2024-06-04T16:16:11.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:11.739+0000 7fb16c322800 20 remove_watcher() i=6 2024-06-04T16:16:11.741 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:16:11.740+0000 7fb16c322800 20 remove_watcher() i=7 2024-06-04T16:16:11.752 INFO:tasks.s3tests:Configuring s3-tests... 2024-06-04T16:16:11.753 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-06-04T16:16:11.753 DEBUG:teuthology.orchestra.run.smithi144:> dd of=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf 2024-06-04T16:16:11.782 INFO:tasks.s3tests:Configuring boto... 2024-06-04T16:16:11.782 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-06-04T16:16:11.783 DEBUG:teuthology.orchestra.run.smithi144:> dd of=/home/ubuntu/cephtest/boto-client.0.cfg 2024-06-04T16:16:11.852 DEBUG:teuthology.orchestra.run.smithi144:s3 tests against rgw> source /home/ubuntu/cephtest/tox-venv/bin/activate && cd /home/ubuntu/cephtest/s3-tests-client.0 && S3TEST_CONF=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf BOTO_CONFIG=/home/ubuntu/cephtest/boto-client.0.cfg REQUESTS_CA_BUNDLE=/etc/pki/tls/certs/ca-bundle.crt tox -- -v -m 'not fails_on_rgw and not lifecycle_expiration and not lifecycle_transition and not cloud_transition and not test_of_sts and not webidentity_test and not fails_with_subdomain and not sse_s3' 2024-06-04T16:16:12.020 INFO:teuthology.orchestra.run.smithi144.stdout:GLOB sdist-make: /home/ubuntu/cephtest/s3-tests-client.0/setup.py 2024-06-04T16:16:12.198 INFO:teuthology.orchestra.run.smithi144.stdout:py create: /home/ubuntu/cephtest/s3-tests-client.0/.tox/py 2024-06-04T16:16:12.434 INFO:teuthology.orchestra.run.smithi144.stdout:py installdeps: -rrequirements.txt 2024-06-04T16:18:06.816 INFO:teuthology.orchestra.run.smithi144.stdout:py inst: /home/ubuntu/cephtest/s3-tests-client.0/.tox/.tmp/package/1/s3tests-0.0.1.zip 2024-06-04T16:18:08.546 INFO:teuthology.orchestra.run.smithi144.stdout:py installed: boto==2.49.0,boto3==1.24.96,botocore==1.27.96,cachetools==5.3.3,certifi==2024.6.2,chardet==5.2.0,charset-normalizer==3.3.2,colorama==0.4.6,distlib==0.3.8,exceptiongroup==1.2.1,filelock==3.14.0,gevent==24.2.1,greenlet==3.0.3,httplib2==0.22.0,idna==3.7,iniconfig==2.0.0,isodate==0.6.1,jmespath==1.0.1,lxml==5.2.2,munch==4.0.0,packaging==24.0,platformdirs==4.2.2,pluggy==1.5.0,pyparsing==3.1.2,pyproject-api==1.6.1,pytest==8.2.2,python-dateutil==2.9.0.post0,pytz==2024.1,PyYAML==6.0.1,requests==2.32.3,s3tests @ file:///home/ubuntu/cephtest/s3-tests-client.0/.tox/.tmp/package/1/s3tests-0.0.1.zip#sha256=020bea2fa52b790f7ac7e0fcc76b46034c55f179eae588be34ef6ec32f6281f0,s3transfer==0.6.2,six==1.16.0,tomli==2.0.1,tox==4.15.0,urllib3==1.26.18,virtualenv==20.26.2,zope.event==5.0,zope.interface==6.4.post2 2024-06-04T16:18:08.547 INFO:teuthology.orchestra.run.smithi144.stdout:py run-test-pre: PYTHONHASHSEED='2137231555' 2024-06-04T16:18:08.547 INFO:teuthology.orchestra.run.smithi144.stdout:py run-test: commands[0] | pytest -v -m 'not fails_on_rgw and not lifecycle_expiration and not lifecycle_transition and not cloud_transition and not test_of_sts and not webidentity_test and not fails_with_subdomain and not sse_s3' 2024-06-04T16:18:08.691 INFO:teuthology.orchestra.run.smithi144.stdout:============================= test session starts ============================== 2024-06-04T16:18:08.691 INFO:teuthology.orchestra.run.smithi144.stdout:platform linux -- Python 3.9.18, pytest-8.2.2, pluggy-1.5.0 -- /home/ubuntu/cephtest/s3-tests-client.0/.tox/py/bin/python 2024-06-04T16:18:08.691 INFO:teuthology.orchestra.run.smithi144.stdout:cachedir: .tox/py/.pytest_cache 2024-06-04T16:18:08.691 INFO:teuthology.orchestra.run.smithi144.stdout:rootdir: /home/ubuntu/cephtest/s3-tests-client.0 2024-06-04T16:18:08.692 INFO:teuthology.orchestra.run.smithi144.stdout:configfile: pytest.ini 2024-06-04T16:18:10.504 INFO:teuthology.orchestra.run.smithi144.stdout:collecting ... collected 859 items / 127 deselected / 732 selected 2024-06-04T16:18:10.504 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:18:10.921 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests/functional/test_headers.py::test_object_create_bad_contentlength_none PASSED [ 0%] 2024-06-04T16:18:11.113 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_empty PASSED [ 0%] 2024-06-04T16:18:11.287 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests/functional/test_headers.py::test_object_create_date_and_amz_date PASSED [ 0%] 2024-06-04T16:18:11.462 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests/functional/test_headers.py::test_object_create_amz_date_and_no_date PASSED [ 0%] 2024-06-04T16:18:11.652 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_none PASSED [ 0%] 2024-06-04T16:18:11.776 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests/functional/test_headers.py::test_bucket_create_contentlength_none PASSED [ 0%] 2024-06-04T16:18:11.956 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests/functional/test_headers.py::test_object_acl_create_contentlength_none PASSED [ 0%] 2024-06-04T16:18:12.079 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_contentlength_none PASSED [ 1%] 2024-06-04T16:18:12.165 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_authorization_empty PASSED [ 1%] 2024-06-04T16:18:12.251 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_authorization_none PASSED [ 1%] 2024-06-04T16:18:12.448 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests/functional/test_headers.py::test_object_create_bad_contentlength_mismatch_below_aws2 PASSED [ 1%] 2024-06-04T16:18:12.646 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_incorrect_aws2 PASSED [ 1%] 2024-06-04T16:18:12.844 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_invalid_aws2 PASSED [ 1%] 2024-06-04T16:18:13.039 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_none_aws2 PASSED [ 1%] 2024-06-04T16:18:13.125 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_authorization_invalid_aws2 PASSED [ 2%] 2024-06-04T16:18:13.211 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_none_aws2 PASSED [ 2%] 2024-06-04T16:18:13.256 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests/functional/test_headers.py::test_object_create_bad_md5_invalid_garbage_aws4 SKIPPED [ 2%] 2024-06-04T16:18:13.304 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests/functional/test_headers.py::test_object_create_bad_contentlength_mismatch_below_aws4 SKIPPED [ 2%] 2024-06-04T16:18:13.349 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_incorrect_aws4 SKIPPED [ 2%] 2024-06-04T16:18:13.393 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_invalid_aws4 SKIPPED [ 2%] 2024-06-04T16:18:13.438 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests/functional/test_headers.py::test_object_create_bad_ua_empty_aws4 SKIPPED [ 2%] 2024-06-04T16:18:13.483 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests/functional/test_headers.py::test_object_create_bad_ua_none_aws4 SKIPPED [ 3%] 2024-06-04T16:18:13.529 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_invalid_aws4 SKIPPED [ 3%] 2024-06-04T16:18:13.575 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_invalid_aws4 SKIPPED [ 3%] 2024-06-04T16:18:13.619 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_empty_aws4 SKIPPED [ 3%] 2024-06-04T16:18:13.664 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_empty_aws4 SKIPPED [ 3%] 2024-06-04T16:18:13.710 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_none_aws4 SKIPPED [ 3%] 2024-06-04T16:18:13.754 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_none_aws4 SKIPPED [ 3%] 2024-06-04T16:18:13.799 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_before_today_aws4 SKIPPED [ 3%] 2024-06-04T16:18:13.844 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_before_today_aws4 SKIPPED [ 4%] 2024-06-04T16:18:13.889 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_after_today_aws4 SKIPPED [ 4%] 2024-06-04T16:18:13.934 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_after_today_aws4 SKIPPED [ 4%] 2024-06-04T16:18:13.980 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_before_epoch_aws4 SKIPPED [ 4%] 2024-06-04T16:18:14.025 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_before_epoch_aws4 SKIPPED [ 4%] 2024-06-04T16:18:14.072 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_after_end_aws4 SKIPPED [ 4%] 2024-06-04T16:18:14.117 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_after_end_aws4 SKIPPED [ 4%] 2024-06-04T16:18:14.163 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests/functional/test_headers.py::test_object_create_missing_signed_custom_header_aws4 SKIPPED [ 5%] 2024-06-04T16:18:14.209 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests/functional/test_headers.py::test_object_create_missing_signed_header_aws4 SKIPPED [ 5%] 2024-06-04T16:18:14.255 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_authorization_invalid_aws4 SKIPPED [ 5%] 2024-06-04T16:18:14.301 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_ua_empty_aws4 SKIPPED [ 5%] 2024-06-04T16:18:14.347 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_ua_none_aws4 SKIPPED [ 5%] 2024-06-04T16:18:14.394 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_invalid_aws4 SKIPPED [ 5%] 2024-06-04T16:18:14.440 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_invalid_aws4 SKIPPED [ 5%] 2024-06-04T16:18:14.486 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_empty_aws4 SKIPPED [ 6%] 2024-06-04T16:18:14.533 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_empty_aws4 SKIPPED [ 6%] 2024-06-04T16:18:14.580 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_none_aws4 SKIPPED [ 6%] 2024-06-04T16:18:14.626 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_none_aws4 SKIPPED [ 6%] 2024-06-04T16:18:14.672 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_before_today_aws4 SKIPPED [ 6%] 2024-06-04T16:18:14.718 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_before_today_aws4 SKIPPED [ 6%] 2024-06-04T16:18:14.764 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_after_today_aws4 SKIPPED [ 6%] 2024-06-04T16:18:14.810 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_after_today_aws4 SKIPPED [ 6%] 2024-06-04T16:18:14.856 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_before_epoch_aws4 SKIPPED [ 7%] 2024-06-04T16:18:14.903 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_before_epoch_aws4 SKIPPED [ 7%] 2024-06-04T16:18:15.382 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests/functional/test_s3.py::test_versioning_obj_read_not_exist_null PASSED [ 7%] 2024-06-04T16:18:15.949 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests/functional/test_s3.py::test_object_storage_class PASSED [ 7%] 2024-06-04T16:18:17.009 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests/functional/test_s3.py::test_object_storage_class_multipart PASSED [ 7%] 2024-06-04T16:18:18.103 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests/functional/test_s3.py::test_object_modify_storage_class PASSED [ 7%] 2024-06-04T16:18:19.934 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests/functional/test_s3.py::test_object_modify_storage_class_multipart PASSED [ 7%] 2024-06-04T16:18:20.569 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests/functional/test_s3.py::test_object_storage_class_copy PASSED [ 8%] 2024-06-04T16:18:21.432 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests/functional/test_s3.py::test_object_storage_class_copy_multipart PASSED [ 8%] 2024-06-04T16:18:21.709 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests/functional/test_s3.py::test_atomic_dual_conditional_write_1mb PASSED [ 8%] 2024-06-04T16:18:21.863 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests/functional/test_s3.py::test_atomic_write_bucket_gone PASSED [ 8%] 2024-06-04T16:18:22.099 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests/functional/test_s3.py::test_encryption_sse_c_multipart_invalid_chunks_1 PASSED [ 8%] 2024-06-04T16:18:22.332 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests/functional/test_s3.py::test_encryption_sse_c_multipart_invalid_chunks_2 PASSED [ 8%] 2024-06-04T16:18:22.740 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests/functional/test_s3.py::test_bucket_policy_set_condition_operator_end_with_IfExists PASSED [ 8%] 2024-06-04T16:18:22.966 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests/functional/test_s3.py::test_bucket_policy_put_obj_request_obj_tag PASSED [ 9%] 2024-06-04T16:18:23.269 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests/functional/test_s3_website.py::test_website_nonexistant_bucket_rgw SKIPPED [ 9%] 2024-06-04T16:18:23.269 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_public_index SKIPPED [ 9%] 2024-06-04T16:18:23.270 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_public_index SKIPPED [ 9%] 2024-06-04T16:18:23.271 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_empty SKIPPED [ 9%] 2024-06-04T16:18:23.272 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_empty SKIPPED [ 9%] 2024-06-04T16:18:23.273 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_private_index SKIPPED [ 9%] 2024-06-04T16:18:23.273 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_private_index SKIPPED [ 9%] 2024-06-04T16:18:23.274 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_empty_missingerrordoc SKIPPED [ 10%] 2024-06-04T16:18:23.275 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_empty_missingerrordoc SKIPPED [ 10%] 2024-06-04T16:18:23.276 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_private_index_missingerrordoc SKIPPED [ 10%] 2024-06-04T16:18:23.277 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_private_index_missingerrordoc SKIPPED [ 10%] 2024-06-04T16:18:23.278 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_empty_blockederrordoc SKIPPED [ 10%] 2024-06-04T16:18:23.279 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_pubilc_errordoc SKIPPED [ 10%] 2024-06-04T16:18:23.279 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_empty_blockederrordoc SKIPPED [ 10%] 2024-06-04T16:18:23.280 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_private_index_blockederrordoc SKIPPED [ 11%] 2024-06-04T16:18:23.281 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_private_index_blockederrordoc SKIPPED [ 11%] 2024-06-04T16:18:23.282 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_empty_gooderrordoc SKIPPED [ 11%] 2024-06-04T16:18:23.283 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_empty_gooderrordoc SKIPPED [ 11%] 2024-06-04T16:18:23.284 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_private_index_gooderrordoc SKIPPED [ 11%] 2024-06-04T16:18:23.285 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_private_index_gooderrordoc SKIPPED [ 11%] 2024-06-04T16:18:23.286 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests/functional/test_s3_website.py::test_website_bucket_private_redirectall_base SKIPPED [ 11%] 2024-06-04T16:18:23.288 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests/functional/test_s3_website.py::test_website_bucket_private_redirectall_path SKIPPED [ 12%] 2024-06-04T16:18:23.288 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests/functional/test_s3_website.py::test_website_bucket_private_redirectall_path_upgrade SKIPPED [ 12%] 2024-06-04T16:18:23.289 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_nonwebsite SKIPPED [ 12%] 2024-06-04T16:18:23.290 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_public_relative SKIPPED [ 12%] 2024-06-04T16:18:23.291 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_public_abs SKIPPED [ 12%] 2024-06-04T16:18:23.292 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_private_relative SKIPPED [ 12%] 2024-06-04T16:18:23.293 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_private_abs SKIPPED [ 12%] 2024-06-04T16:18:23.383 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests/functional/test_s3_website.py::test_routing_generator XFAIL [ 12%] 2024-06-04T16:18:23.395 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests/functional/test_utils.py::test_generate PASSED [ 13%] 2024-06-04T16:18:23.436 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_invalid_short ERROR [ 13%] 2024-06-04T16:18:23.474 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_bad ERROR [ 13%] 2024-06-04T16:18:23.542 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_empty ERROR [ 13%] 2024-06-04T16:18:23.584 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_none ERROR [ 13%] 2024-06-04T16:18:23.626 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_expect_mismatch ERROR [ 13%] 2024-06-04T16:18:23.671 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_expect_empty ERROR [ 13%] 2024-06-04T16:18:23.718 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_expect_none ERROR [ 14%] 2024-06-04T16:18:23.766 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_contentlength_negative ERROR [ 14%] 2024-06-04T16:18:23.839 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_contenttype_invalid ERROR [ 14%] 2024-06-04T16:18:23.890 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_contenttype_empty ERROR [ 14%] 2024-06-04T16:18:23.945 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_contenttype_none ERROR [ 14%] 2024-06-04T16:18:24.001 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_put_bad_canned_acl ERROR [ 14%] 2024-06-04T16:18:24.059 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_expect_mismatch ERROR [ 14%] 2024-06-04T16:18:24.118 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_expect_empty ERROR [ 15%] 2024-06-04T16:18:24.201 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_contentlength_negative ERROR [ 15%] 2024-06-04T16:18:24.263 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_invalid_garbage_aws2 ERROR [ 15%] 2024-06-04T16:18:24.326 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_ua_empty_aws2 ERROR [ 15%] 2024-06-04T16:18:24.392 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_ua_none_aws2 ERROR [ 15%] 2024-06-04T16:18:24.462 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_invalid_aws2 ERROR [ 15%] 2024-06-04T16:18:24.560 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_empty_aws2 ERROR [ 15%] 2024-06-04T16:18:24.632 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_before_today_aws2 ERROR [ 15%] 2024-06-04T16:18:24.708 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_before_epoch_aws2 ERROR [ 16%] 2024-06-04T16:18:24.783 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_after_end_aws2 ERROR [ 16%] 2024-06-04T16:18:24.860 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_ua_empty_aws2 ERROR [ 16%] 2024-06-04T16:18:24.938 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_ua_none_aws2 ERROR [ 16%] 2024-06-04T16:18:25.045 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_invalid_aws2 ERROR [ 16%] 2024-06-04T16:18:25.129 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_empty_aws2 ERROR [ 16%] 2024-06-04T16:18:25.213 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_before_today_aws2 ERROR [ 16%] 2024-06-04T16:18:25.298 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_after_today_aws2 ERROR [ 17%] 2024-06-04T16:18:25.385 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_before_epoch_aws2 ERROR [ 17%] 2024-06-04T16:18:25.449 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_iam.py::test_put_user_policy ERROR [ 17%] 2024-06-04T16:18:25.487 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_iam.py::test_put_user_policy_invalid_user ERROR [ 17%] 2024-06-04T16:18:25.529 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_iam.py::test_put_user_policy_parameter_limit ERROR [ 17%] 2024-06-04T16:18:25.571 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_iam.py::test_put_existing_user_policy ERROR [ 17%] 2024-06-04T16:18:25.614 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_iam.py::test_list_user_policy ERROR [ 17%] 2024-06-04T16:18:25.658 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_iam.py::test_list_user_policy_invalid_user ERROR [ 18%] 2024-06-04T16:18:25.731 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_iam.py::test_get_user_policy ERROR [ 18%] 2024-06-04T16:18:25.779 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_iam.py::test_get_user_policy_invalid_user ERROR [ 18%] 2024-06-04T16:18:25.829 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_iam.py::test_get_user_policy_from_multiple_policies ERROR [ 18%] 2024-06-04T16:18:25.881 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_iam.py::test_delete_user_policy ERROR [ 18%] 2024-06-04T16:18:25.935 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_iam.py::test_delete_user_policy_invalid_user ERROR [ 18%] 2024-06-04T16:18:25.989 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_iam.py::test_delete_user_policy_invalid_policy_name ERROR [ 18%] 2024-06-04T16:18:26.072 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_iam.py::test_delete_user_policy_from_multiple_policies ERROR [ 18%] 2024-06-04T16:18:26.132 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_iam.py::test_allow_bucket_actions_in_user_policy ERROR [ 19%] 2024-06-04T16:18:26.192 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_iam.py::test_deny_bucket_actions_in_user_policy ERROR [ 19%] 2024-06-04T16:18:26.255 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_iam.py::test_allow_object_actions_in_user_policy ERROR [ 19%] 2024-06-04T16:18:26.319 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_iam.py::test_deny_object_actions_in_user_policy ERROR [ 19%] 2024-06-04T16:18:26.385 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_iam.py::test_allow_multipart_actions_in_user_policy ERROR [ 19%] 2024-06-04T16:18:26.479 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_iam.py::test_deny_multipart_actions_in_user_policy ERROR [ 19%] 2024-06-04T16:18:26.551 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_iam.py::test_allow_tagging_actions_in_user_policy ERROR [ 19%] 2024-06-04T16:18:26.623 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_iam.py::test_deny_tagging_actions_in_user_policy ERROR [ 20%] 2024-06-04T16:18:26.696 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_iam.py::test_verify_conflicting_user_policy_statements ERROR [ 20%] 2024-06-04T16:18:26.771 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_iam.py::test_verify_conflicting_user_policies ERROR [ 20%] 2024-06-04T16:18:26.876 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_iam.py::test_verify_allow_iam_actions ERROR [ 20%] 2024-06-04T16:18:26.955 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_create ERROR [ 20%] 2024-06-04T16:18:27.035 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_case_insensitive_name ERROR [ 20%] 2024-06-04T16:18:27.116 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_delete ERROR [ 20%] 2024-06-04T16:18:27.198 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_list ERROR [ 21%] 2024-06-04T16:18:27.282 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_list_path_prefix ERROR [ 21%] 2024-06-04T16:18:27.397 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_update_name ERROR [ 21%] 2024-06-04T16:18:27.487 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_update_path ERROR [ 21%] 2024-06-04T16:18:27.579 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_access_key_create ERROR [ 21%] 2024-06-04T16:18:27.674 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_iam.py::test_account_current_user_access_key_create ERROR [ 21%] 2024-06-04T16:18:27.771 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_access_key_update ERROR [ 21%] 2024-06-04T16:18:27.901 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_iam.py::test_account_current_user_access_key_update ERROR [ 21%] 2024-06-04T16:18:28.002 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_access_key_delete ERROR [ 22%] 2024-06-04T16:18:28.104 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_iam.py::test_account_current_user_access_key_delete ERROR [ 22%] 2024-06-04T16:18:28.205 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_access_key_list ERROR [ 22%] 2024-06-04T16:18:28.309 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_bucket_policy_allow ERROR [ 22%] 2024-06-04T16:18:28.413 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_policy ERROR [ 22%] 2024-06-04T16:18:28.553 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_policy_managed ERROR [ 22%] 2024-06-04T16:18:28.663 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_policy_allow ERROR [ 22%] 2024-06-04T16:18:28.774 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_iam.py::test_account_group_create ERROR [ 23%] 2024-06-04T16:18:28.886 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_iam.py::test_account_group_case_insensitive_name ERROR [ 23%] 2024-06-04T16:18:28.999 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_iam.py::test_account_group_list ERROR [ 23%] 2024-06-04T16:18:29.147 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_iam.py::test_account_group_update ERROR [ 23%] 2024-06-04T16:18:29.265 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_iam.py::test_account_inline_group_policy ERROR [ 23%] 2024-06-04T16:18:29.384 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_iam.py::test_account_managed_group_policy ERROR [ 23%] 2024-06-04T16:18:29.508 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_iam.py::test_account_inline_group_policy_allow ERROR [ 23%] 2024-06-04T16:18:29.633 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_iam.py::test_account_managed_group_policy_allow ERROR [ 24%] 2024-06-04T16:18:29.758 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_create ERROR [ 24%] 2024-06-04T16:18:29.916 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_case_insensitive_name ERROR [ 24%] 2024-06-04T16:18:30.045 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_delete ERROR [ 24%] 2024-06-04T16:18:30.177 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_list ERROR [ 24%] 2024-06-04T16:18:30.308 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_list_path_prefix ERROR [ 24%] 2024-06-04T16:18:30.441 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_update ERROR [ 24%] 2024-06-04T16:18:30.614 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_policy ERROR [ 25%] 2024-06-04T16:18:30.754 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_policy_managed ERROR [ 25%] 2024-06-04T16:18:30.894 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_policy_allow ERROR [ 25%] 2024-06-04T16:18:31.037 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_iam.py::test_same_account_role_policy_allow ERROR [ 25%] 2024-06-04T16:18:31.179 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_role_policy_allow ERROR [ 25%] 2024-06-04T16:18:31.357 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_policy_allow_create_bucket ERROR [ 25%] 2024-06-04T16:18:31.504 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_policy_allow_get_role ERROR [ 25%] 2024-06-04T16:18:31.651 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_iam.py::test_account_oidc_provider ERROR [ 25%] 2024-06-04T16:18:31.800 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_user_policy_allow_user_arn ERROR [ 26%] 2024-06-04T16:18:31.950 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_bucket_policy_allow_user_arn ERROR [ 26%] 2024-06-04T16:18:32.102 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_bucket_policy_allow_account_arn ERROR [ 26%] 2024-06-04T16:18:32.291 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_user_policy_allow_account_arn ERROR [ 26%] 2024-06-04T16:18:32.450 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_bucket_policy_allow_account_id ERROR [ 26%] 2024-06-04T16:18:32.610 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_user_policy_allow_account_id ERROR [ 26%] 2024-06-04T16:18:32.772 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_acl_user_policy_grant_user_id ERROR [ 26%] 2024-06-04T16:18:32.932 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_policy_bucket_acl_grant_user_id ERROR [ 27%] 2024-06-04T16:18:33.135 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_acl_user_policy_grant_canonical_id ERROR [ 27%] 2024-06-04T16:18:33.301 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_policy_bucket_acl_grant_canonical_id ERROR [ 27%] 2024-06-04T16:18:33.472 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_acl_user_policy_grant_account_email ERROR [ 27%] 2024-06-04T16:18:33.643 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_policy_bucket_acl_grant_account_email ERROR [ 27%] 2024-06-04T16:18:33.815 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_root_bucket_policy_allow_account_arn ERROR [ 27%] 2024-06-04T16:18:34.028 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_root_bucket_policy_allow_account_id ERROR [ 27%] 2024-06-04T16:18:34.203 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_root_bucket_acl_grant_canonical_id ERROR [ 28%] 2024-06-04T16:18:34.378 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_root_bucket_acl_grant_account_email ERROR [ 28%] 2024-06-04T16:18:34.415 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_empty ERROR [ 28%] 2024-06-04T16:18:34.453 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_distinct ERROR [ 28%] 2024-06-04T16:18:34.535 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_many ERROR [ 28%] 2024-06-04T16:18:34.579 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_many ERROR [ 28%] 2024-06-04T16:18:34.622 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_basic_key_count ERROR [ 28%] 2024-06-04T16:18:34.667 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_basic ERROR [ 28%] 2024-06-04T16:18:34.713 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_basic ERROR [ 29%] 2024-06-04T16:18:34.762 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_encoding_basic ERROR [ 29%] 2024-06-04T16:18:34.853 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_encoding_basic ERROR [ 29%] 2024-06-04T16:18:34.905 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_prefix ERROR [ 29%] 2024-06-04T16:18:34.959 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_prefix ERROR [ 29%] 2024-06-04T16:18:35.016 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_prefix_ends_with_delimiter ERROR [ 29%] 2024-06-04T16:18:35.074 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_prefix_ends_with_delimiter ERROR [ 29%] 2024-06-04T16:18:35.133 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_alt ERROR [ 30%] 2024-06-04T16:18:35.235 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_alt ERROR [ 30%] 2024-06-04T16:18:35.298 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_prefix_underscore ERROR [ 30%] 2024-06-04T16:18:35.362 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_prefix_underscore ERROR [ 30%] 2024-06-04T16:18:35.429 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_percentage ERROR [ 30%] 2024-06-04T16:18:35.497 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_percentage ERROR [ 30%] 2024-06-04T16:18:35.568 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_whitespace ERROR [ 30%] 2024-06-04T16:18:35.680 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_whitespace ERROR [ 31%] 2024-06-04T16:18:35.753 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_dot ERROR [ 31%] 2024-06-04T16:18:35.828 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_dot ERROR [ 31%] 2024-06-04T16:18:35.903 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_unreadable ERROR [ 31%] 2024-06-04T16:18:35.984 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_unreadable ERROR [ 31%] 2024-06-04T16:18:36.106 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_empty ERROR [ 31%] 2024-06-04T16:18:36.189 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_empty ERROR [ 31%] 2024-06-04T16:18:36.273 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_none ERROR [ 31%] 2024-06-04T16:18:36.357 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_none ERROR [ 32%] 2024-06-04T16:18:36.444 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_fetchowner_notempty ERROR [ 32%] 2024-06-04T16:18:36.532 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_fetchowner_defaultempty ERROR [ 32%] 2024-06-04T16:18:36.668 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_fetchowner_empty ERROR [ 32%] 2024-06-04T16:18:36.760 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_not_exist ERROR [ 32%] 2024-06-04T16:18:36.855 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_not_exist ERROR [ 32%] 2024-06-04T16:18:36.950 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_not_skip_special ERROR [ 32%] 2024-06-04T16:18:37.048 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_basic ERROR [ 33%] 2024-06-04T16:18:37.190 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_basic ERROR [ 33%] 2024-06-04T16:18:37.291 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_alt ERROR [ 33%] 2024-06-04T16:18:37.396 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_alt ERROR [ 33%] 2024-06-04T16:18:37.502 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_empty ERROR [ 33%] 2024-06-04T16:18:37.611 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_empty ERROR [ 33%] 2024-06-04T16:18:37.718 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_none ERROR [ 33%] 2024-06-04T16:18:37.872 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_none ERROR [ 34%] 2024-06-04T16:18:37.984 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_not_exist ERROR [ 34%] 2024-06-04T16:18:38.097 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_not_exist ERROR [ 34%] 2024-06-04T16:18:38.212 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_unreadable ERROR [ 34%] 2024-06-04T16:18:38.329 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_unreadable ERROR [ 34%] 2024-06-04T16:18:38.494 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_basic ERROR [ 34%] 2024-06-04T16:18:38.620 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_basic ERROR [ 34%] 2024-06-04T16:18:38.744 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_alt ERROR [ 34%] 2024-06-04T16:18:38.868 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_alt ERROR [ 35%] 2024-06-04T16:18:38.997 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_prefix_not_exist ERROR [ 35%] 2024-06-04T16:18:39.129 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_prefix_not_exist ERROR [ 35%] 2024-06-04T16:18:39.310 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_delimiter_not_exist ERROR [ 35%] 2024-06-04T16:18:39.446 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_delimiter_not_exist ERROR [ 35%] 2024-06-04T16:18:39.581 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_prefix_delimiter_not_exist ERROR [ 35%] 2024-06-04T16:18:39.716 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_prefix_delimiter_not_exist ERROR [ 35%] 2024-06-04T16:18:39.855 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_maxkeys_one ERROR [ 36%] 2024-06-04T16:18:40.042 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_maxkeys_one ERROR [ 36%] 2024-06-04T16:18:40.183 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_maxkeys_zero ERROR [ 36%] 2024-06-04T16:18:40.326 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_maxkeys_zero ERROR [ 36%] 2024-06-04T16:18:40.471 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_maxkeys_none ERROR [ 36%] 2024-06-04T16:18:40.617 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_maxkeys_none ERROR [ 36%] 2024-06-04T16:18:40.766 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_account_usage ERROR [ 36%] 2024-06-04T16:18:40.963 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_head_bucket_usage ERROR [ 37%] 2024-06-04T16:18:41.115 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_unordered ERROR [ 37%] 2024-06-04T16:18:41.265 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_unordered ERROR [ 37%] 2024-06-04T16:18:41.420 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_maxkeys_invalid ERROR [ 37%] 2024-06-04T16:18:41.579 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_none ERROR [ 37%] 2024-06-04T16:18:41.789 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_empty ERROR [ 37%] 2024-06-04T16:18:41.950 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_continuationtoken_empty ERROR [ 37%] 2024-06-04T16:18:42.112 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_continuationtoken ERROR [ 37%] 2024-06-04T16:18:42.277 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_both_continuationtoken_startafter ERROR [ 38%] 2024-06-04T16:18:42.444 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_unreadable ERROR [ 38%] 2024-06-04T16:18:42.613 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_startafter_unreadable ERROR [ 38%] 2024-06-04T16:18:42.830 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_not_in_list ERROR [ 38%] 2024-06-04T16:18:43.000 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_startafter_not_in_list ERROR [ 38%] 2024-06-04T16:18:43.170 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_after_list ERROR [ 38%] 2024-06-04T16:18:43.347 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_startafter_after_list ERROR [ 38%] 2024-06-04T16:18:43.528 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_return_data ERROR [ 39%] 2024-06-04T16:18:43.760 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_return_data_versioning ERROR [ 39%] 2024-06-04T16:18:43.940 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_objects_anonymous ERROR [ 39%] 2024-06-04T16:18:44.121 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_objects_anonymous ERROR [ 39%] 2024-06-04T16:18:44.302 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_objects_anonymous_fail ERROR [ 39%] 2024-06-04T16:18:44.488 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_objects_anonymous_fail ERROR [ 39%] 2024-06-04T16:18:44.734 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_notexist ERROR [ 39%] 2024-06-04T16:18:44.922 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_bucketv2_notexist ERROR [ 40%] 2024-06-04T16:18:45.114 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_delete_notexist ERROR [ 40%] 2024-06-04T16:18:45.304 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_delete_nonempty ERROR [ 40%] 2024-06-04T16:18:45.500 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_concurrent_set_canned_acl ERROR [ 40%] 2024-06-04T16:18:45.699 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_to_nonexist_bucket ERROR [ 40%] 2024-06-04T16:18:45.954 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_with_chunked_transfer_encoding ERROR [ 40%] 2024-06-04T16:18:46.155 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_delete ERROR [ 40%] 2024-06-04T16:18:46.355 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_object_read_not_exist ERROR [ 40%] 2024-06-04T16:18:46.561 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_object_requestid_matches_header_on_error ERROR [ 41%] 2024-06-04T16:18:46.771 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_concurrent_multi_object_delete ERROR [ 41%] 2024-06-04T16:18:46.977 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_multi_object_delete ERROR [ 41%] 2024-06-04T16:18:47.242 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_multi_objectv2_delete ERROR [ 41%] 2024-06-04T16:18:47.454 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_multi_object_delete_key_limit ERROR [ 41%] 2024-06-04T16:18:47.666 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_multi_objectv2_delete_key_limit ERROR [ 41%] 2024-06-04T16:18:47.879 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_object_head_zero_bytes ERROR [ 41%] 2024-06-04T16:18:48.092 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_check_etag ERROR [ 42%] 2024-06-04T16:18:48.312 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_cache_control ERROR [ 42%] 2024-06-04T16:18:48.593 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_expires ERROR [ 42%] 2024-06-04T16:18:48.816 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_read_update_read_delete ERROR [ 42%] 2024-06-04T16:18:49.038 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_object_set_get_metadata_none_to_good ERROR [ 42%] 2024-06-04T16:18:49.261 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_object_set_get_metadata_none_to_empty ERROR [ 42%] 2024-06-04T16:18:49.488 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_object_set_get_metadata_overwrite_to_empty ERROR [ 42%] 2024-06-04T16:18:49.718 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_object_metadata_replaced_on_put ERROR [ 43%] 2024-06-04T16:18:49.947 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_file ERROR [ 43%] 2024-06-04T16:18:50.238 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_anonymous_request ERROR [ 43%] 2024-06-04T16:18:50.473 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_authenticated_request ERROR [ 43%] 2024-06-04T16:18:50.708 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_authenticated_no_content_type ERROR [ 43%] 2024-06-04T16:18:50.945 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_authenticated_request_bad_access_key ERROR [ 43%] 2024-06-04T16:18:51.183 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_set_success_code ERROR [ 43%] 2024-06-04T16:18:51.422 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_set_invalid_success_code ERROR [ 43%] 2024-06-04T16:18:51.733 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_upload_larger_than_chunk ERROR [ 44%] 2024-06-04T16:18:51.976 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_set_key_from_filename ERROR [ 44%] 2024-06-04T16:18:52.222 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_ignored_header ERROR [ 44%] 2024-06-04T16:18:52.468 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_case_insensitive_condition_fields ERROR [ 44%] 2024-06-04T16:18:52.724 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_escaped_field_values ERROR [ 44%] 2024-06-04T16:18:52.976 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_success_redirect_action ERROR [ 44%] 2024-06-04T16:18:53.228 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_signature ERROR [ 44%] 2024-06-04T16:18:53.551 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_access_key ERROR [ 45%] 2024-06-04T16:18:53.807 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_date_format ERROR [ 45%] 2024-06-04T16:18:54.063 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_no_key_specified ERROR [ 45%] 2024-06-04T16:18:54.322 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_signature ERROR [ 45%] 2024-06-04T16:18:54.588 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_policy_condition ERROR [ 45%] 2024-06-04T16:18:54.855 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_user_specified_header ERROR [ 45%] 2024-06-04T16:18:55.121 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_request_missing_policy_specified_field ERROR [ 45%] 2024-06-04T16:18:55.390 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_condition_is_case_sensitive ERROR [ 46%] 2024-06-04T16:18:55.726 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_expires_is_case_sensitive ERROR [ 46%] 2024-06-04T16:18:55.998 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_expired_policy ERROR [ 46%] 2024-06-04T16:18:56.270 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_wrong_bucket ERROR [ 46%] 2024-06-04T16:18:56.541 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_request_field_value ERROR [ 46%] 2024-06-04T16:18:56.822 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_expires_condition ERROR [ 46%] 2024-06-04T16:18:57.098 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_conditions_list ERROR [ 46%] 2024-06-04T16:18:57.377 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_upload_size_limit_exceeded ERROR [ 46%] 2024-06-04T16:18:57.734 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_content_length_argument ERROR [ 47%] 2024-06-04T16:18:58.019 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_content_length_argument ERROR [ 47%] 2024-06-04T16:18:58.302 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_upload_size_below_minimum ERROR [ 47%] 2024-06-04T16:18:58.591 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_upload_size_rgw_chunk_size_bug ERROR [ 47%] 2024-06-04T16:18:58.879 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_empty_conditions ERROR [ 47%] 2024-06-04T16:18:59.171 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifmatch_good ERROR [ 47%] 2024-06-04T16:18:59.461 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifmatch_failed ERROR [ 47%] 2024-06-04T16:18:59.757 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifnonematch_good ERROR [ 48%] 2024-06-04T16:19:00.130 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifnonematch_failed ERROR [ 48%] 2024-06-04T16:19:00.425 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifmodifiedsince_good ERROR [ 48%] 2024-06-04T16:19:00.734 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifmodifiedsince_failed ERROR [ 48%] 2024-06-04T16:19:01.036 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifunmodifiedsince_good ERROR [ 48%] 2024-06-04T16:19:01.335 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifunmodifiedsince_failed ERROR [ 48%] 2024-06-04T16:19:01.640 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifmatch_good ERROR [ 48%] 2024-06-04T16:19:01.945 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifmatch_failed ERROR [ 49%] 2024-06-04T16:19:02.252 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifmatch_overwrite_existed_good ERROR [ 49%] 2024-06-04T16:19:02.643 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifmatch_nonexisted_failed ERROR [ 49%] 2024-06-04T16:19:02.958 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifnonmatch_good ERROR [ 49%] 2024-06-04T16:19:03.268 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifnonmatch_failed ERROR [ 49%] 2024-06-04T16:19:03.584 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifnonmatch_nonexisted_good ERROR [ 49%] 2024-06-04T16:19:03.902 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifnonmatch_overwrite_existed_failed ERROR [ 49%] 2024-06-04T16:19:04.219 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get ERROR [ 50%] 2024-06-04T16:19:04.538 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_bucket_gone ERROR [ 50%] 2024-06-04T16:19:04.866 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_object_delete_key_bucket_gone ERROR [ 50%] 2024-06-04T16:19:05.193 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_object_gone ERROR [ 50%] 2024-06-04T16:19:05.597 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_head ERROR [ 50%] 2024-06-04T16:19:05.926 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_head_notexist ERROR [ 50%] 2024-06-04T16:19:06.253 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_head_extended ERROR [ 50%] 2024-06-04T16:19:06.582 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_bucket_acl ERROR [ 50%] 2024-06-04T16:19:06.917 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_object_acl ERROR [ 51%] 2024-06-04T16:19:07.248 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_object_put_acl_mtime ERROR [ 51%] 2024-06-04T16:19:07.584 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated ERROR [ 51%] 2024-06-04T16:19:07.924 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_response_headers ERROR [ 51%] 2024-06-04T16:19:08.350 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated_bucket_acl ERROR [ 51%] 2024-06-04T16:19:08.698 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated_object_acl ERROR [ 51%] 2024-06-04T16:19:09.043 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated_bucket_gone ERROR [ 51%] 2024-06-04T16:19:09.390 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated_object_gone ERROR [ 52%] 2024-06-04T16:19:09.736 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_not_expired ERROR [ 52%] 2024-06-04T16:19:10.087 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_not_expired_tenant ERROR [ 52%] 2024-06-04T16:19:10.437 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_out_range_zero ERROR [ 52%] 2024-06-04T16:19:10.795 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_out_max_range ERROR [ 52%] 2024-06-04T16:19:11.154 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_out_positive_range ERROR [ 52%] 2024-06-04T16:19:11.511 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_object_anon_put ERROR [ 52%] 2024-06-04T16:19:11.957 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_object_anon_put_write_access ERROR [ 53%] 2024-06-04T16:19:12.313 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_object_put_authenticated ERROR [ 53%] 2024-06-04T16:19:12.680 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_object_presigned_put_object_with_acl ERROR [ 53%] 2024-06-04T16:19:13.043 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_object_presigned_put_object_with_acl_tenant ERROR [ 53%] 2024-06-04T16:19:13.411 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_put_authenticated_expired ERROR [ 53%] 2024-06-04T16:19:13.778 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_bad_starts_nonalpha ERROR [ 53%] 2024-06-04T16:19:14.143 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_bad_short_one ERROR [ 53%] 2024-06-04T16:19:14.512 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_bad_short_two ERROR [ 53%] 2024-06-04T16:19:14.887 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_long_60 ERROR [ 54%] 2024-06-04T16:19:15.266 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_long_61 ERROR [ 54%] 2024-06-04T16:19:15.743 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_long_62 ERROR [ 54%] 2024-06-04T16:19:16.122 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_long_63 ERROR [ 54%] 2024-06-04T16:19:16.498 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_long_name ERROR [ 54%] 2024-06-04T16:19:16.885 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_bad_ip ERROR [ 54%] 2024-06-04T16:19:17.266 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_underscore ERROR [ 54%] 2024-06-04T16:19:17.655 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_long ERROR [ 55%] 2024-06-04T16:19:18.039 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_dash_at_end ERROR [ 55%] 2024-06-04T16:19:18.423 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_dot_dot ERROR [ 55%] 2024-06-04T16:19:18.819 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_dot_dash ERROR [ 55%] 2024-06-04T16:19:19.212 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_dash_dot ERROR [ 55%] 2024-06-04T16:19:19.708 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_exists ERROR [ 55%] 2024-06-04T16:19:20.105 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_get_location ERROR [ 55%] 2024-06-04T16:19:20.499 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_exists_nonowner ERROR [ 56%] 2024-06-04T16:19:20.898 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_recreate_overwrite_acl ERROR [ 56%] 2024-06-04T16:19:21.298 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_recreate_new_acl ERROR [ 56%] 2024-06-04T16:19:21.704 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_default ERROR [ 56%] 2024-06-04T16:19:22.107 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned_during_create ERROR [ 56%] 2024-06-04T16:19:22.514 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned ERROR [ 56%] 2024-06-04T16:19:22.923 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned_publicreadwrite ERROR [ 56%] 2024-06-04T16:19:23.332 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned_authenticatedread ERROR [ 56%] 2024-06-04T16:19:23.746 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_default ERROR [ 57%] 2024-06-04T16:19:24.257 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_during_create ERROR [ 57%] 2024-06-04T16:19:24.675 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned ERROR [ 57%] 2024-06-04T16:19:25.095 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_publicreadwrite ERROR [ 57%] 2024-06-04T16:19:25.514 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_authenticatedread ERROR [ 57%] 2024-06-04T16:19:25.931 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_bucketownerread ERROR [ 57%] 2024-06-04T16:19:26.354 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_bucketownerfullcontrol ERROR [ 57%] 2024-06-04T16:19:26.782 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_full_control_verify_owner ERROR [ 58%] 2024-06-04T16:19:27.207 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_full_control_verify_attributes ERROR [ 58%] 2024-06-04T16:19:27.633 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned_private_to_private ERROR [ 58%] 2024-06-04T16:19:28.058 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl ERROR [ 58%] 2024-06-04T16:19:28.486 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_write ERROR [ 58%] 2024-06-04T16:19:29.033 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_writeacp ERROR [ 58%] 2024-06-04T16:19:29.469 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_read ERROR [ 58%] 2024-06-04T16:19:29.905 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_readacp ERROR [ 59%] 2024-06-04T16:19:30.346 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_fullcontrol ERROR [ 59%] 2024-06-04T16:19:30.784 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_read ERROR [ 59%] 2024-06-04T16:19:31.229 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_readacp ERROR [ 59%] 2024-06-04T16:19:31.684 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_write ERROR [ 59%] 2024-06-04T16:19:32.147 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_writeacp ERROR [ 59%] 2024-06-04T16:19:32.614 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_nonexist_user ERROR [ 59%] 2024-06-04T16:19:33.068 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_object_header_acl_grants ERROR [ 59%] 2024-06-04T16:19:33.523 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_header_acl_grants ERROR [ 60%] 2024-06-04T16:19:33.977 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_email ERROR [ 60%] 2024-06-04T16:19:34.547 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_email_not_exist ERROR [ 60%] 2024-06-04T16:19:35.007 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_revoke_all ERROR [ 60%] 2024-06-04T16:19:35.464 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_object_private ERROR [ 60%] 2024-06-04T16:19:35.926 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_objectv2_private ERROR [ 60%] 2024-06-04T16:19:36.387 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_object_publicread ERROR [ 60%] 2024-06-04T16:19:36.856 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_objectv2_publicread ERROR [ 61%] 2024-06-04T16:19:37.320 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_object_publicreadwrite ERROR [ 61%] 2024-06-04T16:19:37.789 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_objectv2_publicreadwrite ERROR [ 61%] 2024-06-04T16:19:38.248 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicread_object_private ERROR [ 61%] 2024-06-04T16:19:38.717 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicread_object_publicread ERROR [ 61%] 2024-06-04T16:19:39.187 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicread_object_publicreadwrite ERROR [ 61%] 2024-06-04T16:19:39.667 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicreadwrite_object_private ERROR [ 61%] 2024-06-04T16:19:40.139 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicreadwrite_object_publicread ERROR [ 62%] 2024-06-04T16:19:40.622 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicreadwrite_object_publicreadwrite ERROR [ 62%] 2024-06-04T16:19:41.216 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_buckets_create_then_list ERROR [ 62%] 2024-06-04T16:19:41.694 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_buckets_list_ctime ERROR [ 62%] 2024-06-04T16:19:42.177 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_list_buckets_anonymous ERROR [ 62%] 2024-06-04T16:19:42.665 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_list_buckets_invalid_auth ERROR [ 62%] 2024-06-04T16:19:43.152 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_list_buckets_bad_auth ERROR [ 62%] 2024-06-04T16:19:43.638 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_starts_alpha ERROR [ 62%] 2024-06-04T16:19:44.123 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_starts_digit ERROR [ 63%] 2024-06-04T16:19:44.614 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_contains_period ERROR [ 63%] 2024-06-04T16:19:45.106 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_contains_hyphen ERROR [ 63%] 2024-06-04T16:19:45.601 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_recreate_not_overriding ERROR [ 63%] 2024-06-04T16:19:46.098 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_special_key_names ERROR [ 63%] 2024-06-04T16:19:46.593 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_special_prefix ERROR [ 63%] 2024-06-04T16:19:47.097 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_zero_size ERROR [ 63%] 2024-06-04T16:19:47.594 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_16m ERROR [ 64%] 2024-06-04T16:19:48.231 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_same_bucket ERROR [ 64%] 2024-06-04T16:19:48.738 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_verify_contenttype ERROR [ 64%] 2024-06-04T16:19:49.244 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_to_itself ERROR [ 64%] 2024-06-04T16:19:49.753 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_to_itself_with_metadata ERROR [ 64%] 2024-06-04T16:19:50.260 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_diff_bucket ERROR [ 64%] 2024-06-04T16:19:50.773 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_not_owned_bucket ERROR [ 64%] 2024-06-04T16:19:51.283 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_not_owned_object_bucket ERROR [ 65%] 2024-06-04T16:19:51.798 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_canned_acl ERROR [ 65%] 2024-06-04T16:19:52.317 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_retaining_metadata ERROR [ 65%] 2024-06-04T16:19:52.836 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_replacing_metadata ERROR [ 65%] 2024-06-04T16:19:53.355 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_bucket_not_found ERROR [ 65%] 2024-06-04T16:19:53.881 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_key_not_found ERROR [ 65%] 2024-06-04T16:19:54.408 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_versioned_bucket ERROR [ 65%] 2024-06-04T16:19:54.948 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_versioned_url_encoding ERROR [ 65%] 2024-06-04T16:19:55.479 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_versioning_multipart_upload ERROR [ 66%] 2024-06-04T16:19:56.014 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_empty ERROR [ 66%] 2024-06-04T16:19:56.689 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_small ERROR [ 66%] 2024-06-04T16:19:57.216 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_small ERROR [ 66%] 2024-06-04T16:19:57.753 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_invalid_range ERROR [ 66%] 2024-06-04T16:19:58.293 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_without_range ERROR [ 66%] 2024-06-04T16:19:58.838 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_special_names ERROR [ 66%] 2024-06-04T16:19:59.378 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload ERROR [ 67%] 2024-06-04T16:19:59.926 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_versioned ERROR [ 67%] 2024-06-04T16:20:00.472 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_resend_part ERROR [ 67%] 2024-06-04T16:20:01.028 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_multiple_sizes ERROR [ 67%] 2024-06-04T16:20:01.580 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_multiple_sizes ERROR [ 67%] 2024-06-04T16:20:02.132 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_size_too_small ERROR [ 67%] 2024-06-04T16:20:02.685 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_contents ERROR [ 67%] 2024-06-04T16:20:03.234 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_overwrite_existing_object ERROR [ 68%] 2024-06-04T16:20:03.796 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_abort_multipart_upload ERROR [ 68%] 2024-06-04T16:20:04.349 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_abort_multipart_upload_not_found ERROR [ 68%] 2024-06-04T16:20:04.908 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_list_multipart_upload ERROR [ 68%] 2024-06-04T16:20:05.630 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_list_multipart_upload_owner ERROR [ 68%] 2024-06-04T16:20:06.196 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_missing_part ERROR [ 68%] 2024-06-04T16:20:06.764 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_incorrect_etag ERROR [ 68%] 2024-06-04T16:20:07.325 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_get_part ERROR [ 68%] 2024-06-04T16:20:07.900 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_non_multipart_get_part ERROR [ 69%] 2024-06-04T16:20:08.459 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_100_continue ERROR [ 69%] 2024-06-04T16:20:09.036 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_set_cors ERROR [ 69%] 2024-06-04T16:20:09.611 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_cors_origin_response ERROR [ 69%] 2024-06-04T16:20:10.190 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_cors_origin_wildcard ERROR [ 69%] 2024-06-04T16:20:10.773 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_cors_header_option ERROR [ 69%] 2024-06-04T16:20:11.342 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_get_object ERROR [ 69%] 2024-06-04T16:20:11.930 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_get_object_tenant ERROR [ 70%] 2024-06-04T16:20:12.505 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_put_object ERROR [ 70%] 2024-06-04T16:20:13.095 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_put_object_with_acl ERROR [ 70%] 2024-06-04T16:20:13.685 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_put_object_tenant ERROR [ 70%] 2024-06-04T16:20:14.273 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_put_object_tenant_with_acl ERROR [ 70%] 2024-06-04T16:20:14.869 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_set_bucket_tagging ERROR [ 70%] 2024-06-04T16:20:15.464 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_read_1mb ERROR [ 70%] 2024-06-04T16:20:16.219 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_read_4mb ERROR [ 71%] 2024-06-04T16:20:16.821 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_read_8mb ERROR [ 71%] 2024-06-04T16:20:17.417 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_write_1mb ERROR [ 71%] 2024-06-04T16:20:18.010 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_write_4mb ERROR [ 71%] 2024-06-04T16:20:18.611 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_write_8mb ERROR [ 71%] 2024-06-04T16:20:19.215 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_dual_write_1mb ERROR [ 71%] 2024-06-04T16:20:19.823 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_dual_write_4mb ERROR [ 71%] 2024-06-04T16:20:20.429 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_dual_write_8mb ERROR [ 71%] 2024-06-04T16:20:21.044 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_conditional_write_1mb ERROR [ 72%] 2024-06-04T16:20:21.654 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_multipart_upload_write ERROR [ 72%] 2024-06-04T16:20:22.260 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_resend_first_finishes_last ERROR [ 72%] 2024-06-04T16:20:22.878 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_response_code ERROR [ 72%] 2024-06-04T16:20:23.488 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_big_request_response_code ERROR [ 72%] 2024-06-04T16:20:24.106 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_skip_leading_bytes_response_code ERROR [ 72%] 2024-06-04T16:20:24.731 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_return_trailing_bytes_response_code ERROR [ 72%] 2024-06-04T16:20:25.353 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_invalid_range ERROR [ 73%] 2024-06-04T16:20:25.981 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_empty_object ERROR [ 73%] 2024-06-04T16:20:26.603 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_bucket_create_suspend ERROR [ 73%] 2024-06-04T16:20:27.229 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_read_remove ERROR [ 73%] 2024-06-04T16:20:28.041 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_read_remove_head ERROR [ 73%] 2024-06-04T16:20:28.673 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_plain_null_version_removal ERROR [ 73%] 2024-06-04T16:20:29.299 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_plain_null_version_overwrite ERROR [ 73%] 2024-06-04T16:20:29.934 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_plain_null_version_overwrite_suspended ERROR [ 74%] 2024-06-04T16:20:30.572 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_suspend_versions ERROR [ 74%] 2024-06-04T16:20:31.209 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_suspended_copy ERROR [ 74%] 2024-06-04T16:20:31.851 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_versions_remove_all ERROR [ 74%] 2024-06-04T16:20:32.484 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_versions_remove_special_names ERROR [ 74%] 2024-06-04T16:20:33.124 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_overwrite_multipart ERROR [ 74%] 2024-06-04T16:20:33.764 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_list_marker ERROR [ 74%] 2024-06-04T16:20:34.413 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_copy_obj_version ERROR [ 75%] 2024-06-04T16:20:35.059 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_multi_object_delete ERROR [ 75%] 2024-06-04T16:20:35.717 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_multi_object_delete_with_marker ERROR [ 75%] 2024-06-04T16:20:36.367 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_multi_object_delete_with_marker_create ERROR [ 75%] 2024-06-04T16:20:37.026 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_versioned_object_acl ERROR [ 75%] 2024-06-04T16:20:37.679 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_versioned_object_acl_no_version_specified ERROR [ 75%] 2024-06-04T16:20:38.342 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_versioned_concurrent_object_create_and_remove ERROR [ 75%] 2024-06-04T16:20:39.002 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set ERROR [ 75%] 2024-06-04T16:20:39.661 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_get ERROR [ 76%] 2024-06-04T16:20:40.323 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_get_no_id ERROR [ 76%] 2024-06-04T16:20:41.191 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_id_too_long ERROR [ 76%] 2024-06-04T16:20:41.854 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_same_id ERROR [ 76%] 2024-06-04T16:20:42.521 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_invalid_status ERROR [ 76%] 2024-06-04T16:20:43.188 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_date ERROR [ 76%] 2024-06-04T16:20:43.865 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_invalid_date ERROR [ 76%] 2024-06-04T16:20:44.538 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_noncurrent ERROR [ 77%] 2024-06-04T16:20:45.215 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_deletemarker ERROR [ 77%] 2024-06-04T16:20:45.903 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_filter ERROR [ 77%] 2024-06-04T16:20:46.585 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_empty_filter ERROR [ 77%] 2024-06-04T16:20:47.275 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_multipart ERROR [ 77%] 2024-06-04T16:20:47.956 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_transition_set_invalid_date ERROR [ 77%] 2024-06-04T16:20:48.643 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_1b ERROR [ 77%] 2024-06-04T16:20:49.323 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_1kb ERROR [ 78%] 2024-06-04T16:20:50.011 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_1MB ERROR [ 78%] 2024-06-04T16:20:50.698 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_13b ERROR [ 78%] 2024-06-04T16:20:51.385 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_method_head ERROR [ 78%] 2024-06-04T16:20:52.079 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_present ERROR [ 78%] 2024-06-04T16:20:52.778 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_other_key ERROR [ 78%] 2024-06-04T16:20:53.474 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_invalid_md5 ERROR [ 78%] 2024-06-04T16:20:54.170 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_no_md5 ERROR [ 78%] 2024-06-04T16:20:54.878 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_no_key ERROR [ 79%] 2024-06-04T16:20:55.585 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_key_no_sse_c ERROR [ 79%] 2024-06-04T16:20:56.294 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_multipart_upload ERROR [ 79%] 2024-06-04T16:20:57.003 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_unaligned_multipart_upload ERROR [ 79%] 2024-06-04T16:20:57.930 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_multipart_bad_download ERROR [ 79%] 2024-06-04T16:20:58.634 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_post_object_authenticated_request ERROR [ 79%] 2024-06-04T16:20:59.345 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_method_head ERROR [ 79%] 2024-06-04T16:21:00.058 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_present ERROR [ 80%] 2024-06-04T16:21:00.773 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_no_key ERROR [ 80%] 2024-06-04T16:21:01.483 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_not_declared ERROR [ 80%] 2024-06-04T16:21:02.197 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_multipart_upload ERROR [ 80%] 2024-06-04T16:21:02.915 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_multipart_invalid_chunks_1 ERROR [ 80%] 2024-06-04T16:21:03.628 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_multipart_invalid_chunks_2 ERROR [ 80%] 2024-06-04T16:21:04.343 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_post_object_authenticated_request ERROR [ 80%] 2024-06-04T16:21:05.070 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_1b ERROR [ 81%] 2024-06-04T16:21:05.796 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_1kb ERROR [ 81%] 2024-06-04T16:21:06.522 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_1MB ERROR [ 81%] 2024-06-04T16:21:07.248 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_13b ERROR [ 81%] 2024-06-04T16:21:07.980 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_read_declare ERROR [ 81%] 2024-06-04T16:21:08.717 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy ERROR [ 81%] 2024-06-04T16:21:09.445 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_bucketv2_policy ERROR [ 81%] 2024-06-04T16:21:10.184 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_acl ERROR [ 81%] 2024-06-04T16:21:10.922 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_bucketv2_policy_acl ERROR [ 82%] 2024-06-04T16:21:11.654 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_another_bucket ERROR [ 82%] 2024-06-04T16:21:12.394 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_bucketv2_policy_another_bucket ERROR [ 82%] 2024-06-04T16:21:13.130 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_get_obj_tagging ERROR [ 82%] 2024-06-04T16:21:13.883 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_get_obj_head_tagging ERROR [ 82%] 2024-06-04T16:21:14.625 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_put_max_tags ERROR [ 82%] 2024-06-04T16:21:15.612 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_put_excess_tags ERROR [ 82%] 2024-06-04T16:21:16.366 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_put_max_kvsize_tags ERROR [ 83%] 2024-06-04T16:21:17.118 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_put_excess_key_tags ERROR [ 83%] 2024-06-04T16:21:17.868 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_put_excess_val_tags ERROR [ 83%] 2024-06-04T16:21:18.623 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_put_modify_tags ERROR [ 83%] 2024-06-04T16:21:19.379 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_put_delete_tags ERROR [ 83%] 2024-06-04T16:21:20.137 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_tags_anonymous_request ERROR [ 83%] 2024-06-04T16:21:20.900 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_tags_authenticated_request ERROR [ 83%] 2024-06-04T16:21:21.658 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_with_tags ERROR [ 84%] 2024-06-04T16:21:22.421 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_get_tags_acl_public ERROR [ 84%] 2024-06-04T16:21:23.189 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_put_tags_acl_public ERROR [ 84%] 2024-06-04T16:21:23.957 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_delete_tags_obj_public ERROR [ 84%] 2024-06-04T16:21:24.723 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_bucket_atomic_upload_return_version_id ERROR [ 84%] 2024-06-04T16:21:25.498 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_bucket_multipart_upload_return_version_id ERROR [ 84%] 2024-06-04T16:21:26.263 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_get_obj_existing_tag ERROR [ 84%] 2024-06-04T16:21:27.037 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_get_obj_tagging_existing_tag ERROR [ 84%] 2024-06-04T16:21:27.804 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_tagging_existing_tag ERROR [ 85%] 2024-06-04T16:21:28.578 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_copy_source ERROR [ 85%] 2024-06-04T16:21:29.364 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_copy_source_meta ERROR [ 85%] 2024-06-04T16:21:30.148 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_acl ERROR [ 85%] 2024-06-04T16:21:30.934 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_grant ERROR [ 85%] 2024-06-04T16:21:31.713 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_c_s3 ERROR [ 85%] 2024-06-04T16:21:32.498 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_c_kms ERROR [ 85%] 2024-06-04T16:21:33.294 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_s3_kms ERROR [ 86%] 2024-06-04T16:21:34.092 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_bad_enc_kms ERROR [ 86%] 2024-06-04T16:21:34.888 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_kms_noenc ERROR [ 86%] 2024-06-04T16:21:35.680 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_kms_s3 ERROR [ 86%] 2024-06-04T16:21:36.746 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_get_obj_acl_existing_tag ERROR [ 86%] 2024-06-04T16:21:37.539 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock ERROR [ 86%] 2024-06-04T16:21:38.346 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_bucket ERROR [ 86%] 2024-06-04T16:21:39.145 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_with_days_and_years ERROR [ 87%] 2024-06-04T16:21:39.954 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_days ERROR [ 87%] 2024-06-04T16:21:40.765 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_years ERROR [ 87%] 2024-06-04T16:21:41.574 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_mode ERROR [ 87%] 2024-06-04T16:21:42.385 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_status ERROR [ 87%] 2024-06-04T16:21:43.201 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_suspend_versioning ERROR [ 87%] 2024-06-04T16:21:44.012 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_lock ERROR [ 87%] 2024-06-04T16:21:44.824 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_lock_invalid_bucket ERROR [ 87%] 2024-06-04T16:21:45.634 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention ERROR [ 88%] 2024-06-04T16:21:46.451 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_invalid_bucket ERROR [ 88%] 2024-06-04T16:21:47.267 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_invalid_mode ERROR [ 88%] 2024-06-04T16:21:48.091 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_retention ERROR [ 88%] 2024-06-04T16:21:48.919 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_retention_iso8601 ERROR [ 88%] 2024-06-04T16:21:49.753 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_retention_invalid_bucket ERROR [ 88%] 2024-06-04T16:21:50.580 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_versionid ERROR [ 88%] 2024-06-04T16:21:51.413 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_override_default_retention ERROR [ 89%] 2024-06-04T16:21:52.245 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_increase_period ERROR [ 89%] 2024-06-04T16:21:53.077 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_shorten_period ERROR [ 89%] 2024-06-04T16:21:53.897 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_shorten_period_bypass ERROR [ 89%] 2024-06-04T16:21:54.727 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_retention ERROR [ 89%] 2024-06-04T16:21:55.572 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_multipart_object_with_retention ERROR [ 89%] 2024-06-04T16:21:56.408 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_retention_and_marker ERROR [ 89%] 2024-06-04T16:21:57.250 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_multi_delete_object_with_retention ERROR [ 90%] 2024-06-04T16:21:58.090 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_legal_hold ERROR [ 90%] 2024-06-04T16:21:58.938 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_legal_hold_invalid_bucket ERROR [ 90%] 2024-06-04T16:22:00.078 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_legal_hold_invalid_status ERROR [ 90%] 2024-06-04T16:22:00.930 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_legal_hold ERROR [ 90%] 2024-06-04T16:22:01.766 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_legal_hold_invalid_bucket ERROR [ 90%] 2024-06-04T16:22:02.615 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_legal_hold_on ERROR [ 90%] 2024-06-04T16:22:03.469 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_multipart_object_with_legal_hold_on ERROR [ 90%] 2024-06-04T16:22:04.322 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_legal_hold_off ERROR [ 91%] 2024-06-04T16:22:05.182 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_metadata ERROR [ 91%] 2024-06-04T16:22:06.037 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_uploading_obj ERROR [ 91%] 2024-06-04T16:22:06.906 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_changing_mode_from_governance_with_bypass ERROR [ 91%] 2024-06-04T16:22:07.755 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_changing_mode_from_governance_without_bypass ERROR [ 91%] 2024-06-04T16:22:08.619 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_changing_mode_from_compliance ERROR [ 91%] 2024-06-04T16:22:09.494 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_copy_object_ifmatch_good ERROR [ 91%] 2024-06-04T16:22:10.356 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_copy_object_ifnonematch_failed ERROR [ 92%] 2024-06-04T16:22:11.220 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_get_bucket_policy_status ERROR [ 92%] 2024-06-04T16:22:12.096 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_get_public_acl_bucket_policy_status ERROR [ 92%] 2024-06-04T16:22:12.985 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_get_authpublic_acl_bucket_policy_status ERROR [ 92%] 2024-06-04T16:22:13.863 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_get_publicpolicy_acl_bucket_policy_status ERROR [ 92%] 2024-06-04T16:22:14.739 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_get_nonpublicpolicy_acl_bucket_policy_status ERROR [ 92%] 2024-06-04T16:22:15.616 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_get_nonpublicpolicy_deny_bucket_policy_status ERROR [ 92%] 2024-06-04T16:22:16.486 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_get_undefined_public_block ERROR [ 93%] 2024-06-04T16:22:17.368 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_get_public_block_deny_bucket_policy ERROR [ 93%] 2024-06-04T16:22:18.248 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_put_public_block ERROR [ 93%] 2024-06-04T16:22:19.134 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_block_public_put_bucket_acls ERROR [ 93%] 2024-06-04T16:22:20.016 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_block_public_object_canned_acls ERROR [ 93%] 2024-06-04T16:22:20.913 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_block_public_policy ERROR [ 93%] 2024-06-04T16:22:21.793 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_ignore_public_acls ERROR [ 93%] 2024-06-04T16:22:22.692 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_on_a_bucket_with_policy ERROR [ 93%] 2024-06-04T16:22:23.585 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_put_bucket_encryption_kms ERROR [ 94%] 2024-06-04T16:22:24.476 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_get_bucket_encryption_kms ERROR [ 94%] 2024-06-04T16:22:25.378 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_delete_bucket_encryption_kms ERROR [ 94%] 2024-06-04T16:22:26.610 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_default_post_object_authenticated_request ERROR [ 94%] 2024-06-04T16:22:27.504 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_torrent ERROR [ 94%] 2024-06-04T16:22:27.540 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3select.py::test_generate_where_clause ERROR [ 94%] 2024-06-04T16:22:27.578 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3select.py::test_generate_projection ERROR [ 94%] 2024-06-04T16:22:27.617 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3select.py::test_count_operation ERROR [ 95%] 2024-06-04T16:22:27.659 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3select.py::test_count_json_operation ERROR [ 95%] 2024-06-04T16:22:27.701 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3select.py::test_json_column_sum_min_max ERROR [ 95%] 2024-06-04T16:22:27.746 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3select.py::test_json_nullif_expressions ERROR [ 95%] 2024-06-04T16:22:27.792 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3select.py::test_column_sum_min_max ERROR [ 95%] 2024-06-04T16:22:27.841 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3select.py::test_nullif_expressions ERROR [ 95%] 2024-06-04T16:22:27.891 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3select.py::test_nulliftrue_expressions ERROR [ 95%] 2024-06-04T16:22:27.941 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3select.py::test_is_not_null_expressions ERROR [ 96%] 2024-06-04T16:22:27.995 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3select.py::test_lowerupper_expressions ERROR [ 96%] 2024-06-04T16:22:28.050 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3select.py::test_in_expressions ERROR [ 96%] 2024-06-04T16:22:28.106 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3select.py::test_true_false_in_expressions ERROR [ 96%] 2024-06-04T16:22:28.165 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3select.py::test_like_expressions ERROR [ 96%] 2024-06-04T16:22:28.226 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3select.py::test_truefalselike_expressions ERROR [ 96%] 2024-06-04T16:22:28.287 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3select.py::test_complex_expressions ERROR [ 96%] 2024-06-04T16:22:28.351 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3select.py::test_alias ERROR [ 96%] 2024-06-04T16:22:28.416 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3select.py::test_alias_cyclic_refernce ERROR [ 97%] 2024-06-04T16:22:28.483 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3select.py::test_datetime ERROR [ 97%] 2024-06-04T16:22:28.556 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3select.py::test_true_false_datetime ERROR [ 97%] 2024-06-04T16:22:28.630 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3select.py::test_csv_parser ERROR [ 97%] 2024-06-04T16:22:28.702 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3select.py::test_csv_definition ERROR [ 97%] 2024-06-04T16:22:28.775 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3select.py::test_schema_definition ERROR [ 97%] 2024-06-04T16:22:28.853 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3select.py::test_when_then_else_expressions ERROR [ 97%] 2024-06-04T16:22:28.931 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3select.py::test_coalesce_expressions ERROR [ 98%] 2024-06-04T16:22:29.010 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3select.py::test_cast_expressions ERROR [ 98%] 2024-06-04T16:22:29.092 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3select.py::test_version ERROR [ 98%] 2024-06-04T16:22:29.174 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3select.py::test_trim_expressions ERROR [ 98%] 2024-06-04T16:22:29.260 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3select.py::test_truefalse_trim_expressions ERROR [ 98%] 2024-06-04T16:22:29.347 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3select.py::test_escape_expressions ERROR [ 98%] 2024-06-04T16:22:29.436 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3select.py::test_case_value_expressions ERROR [ 98%] 2024-06-04T16:22:29.526 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3select.py::test_bool_cast_expressions ERROR [ 99%] 2024-06-04T16:22:29.620 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3select.py::test_progress_expressions ERROR [ 99%] 2024-06-04T16:22:29.715 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3select.py::test_output_serial_expressions ERROR [ 99%] 2024-06-04T16:22:29.751 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_sns.py::test_account_topic ERROR [ 99%] 2024-06-04T16:22:29.788 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_sns.py::test_cross_account_topic ERROR [ 99%] 2024-06-04T16:22:29.829 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_sns.py::test_account_topic_publish ERROR [ 99%] 2024-06-04T16:22:29.870 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_sns.py::test_cross_account_topic_publish ERROR [ 99%] 2024-06-04T16:22:29.884 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_utils.py::test_generate PASSED [100%] 2024-06-04T16:22:29.884 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.884 INFO:teuthology.orchestra.run.smithi144.stdout:==================================== ERRORS ==================================== 2024-06-04T16:22:29.884 INFO:teuthology.orchestra.run.smithi144.stdout:__________ ERROR at setup of test_object_create_bad_md5_invalid_short __________ 2024-06-04T16:22:29.885 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.885 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:29.885 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:29.885 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:29.885 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.885 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:29.885 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:29.885 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:29.885 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:29.885 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:29.885 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:29.885 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:29.886 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.886 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:29.886 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:29.886 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.886 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:29.886 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:29.886 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:29.886 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.886 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:29.886 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:29.886 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:29.886 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:29.887 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:29.887 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:29.887 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:29.887 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:29.887 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.887 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:29.887 INFO:teuthology.orchestra.run.smithi144.stdout:_______________ ERROR at setup of test_object_create_bad_md5_bad _______________ 2024-06-04T16:22:29.887 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.887 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:29.887 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:29.887 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:29.887 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.887 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:29.888 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:29.888 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:29.888 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:29.888 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:29.888 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:29.888 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:29.888 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.888 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:29.888 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:29.888 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.888 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:29.888 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:29.889 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:29.889 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.889 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:29.889 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:29.889 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:29.889 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:29.889 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:29.889 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:29.889 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:29.889 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:29.889 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.889 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:29.889 INFO:teuthology.orchestra.run.smithi144.stdout:______________ ERROR at setup of test_object_create_bad_md5_empty ______________ 2024-06-04T16:22:29.890 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.890 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:29.890 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:29.890 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:29.890 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.890 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:29.890 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:29.890 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:29.890 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:29.890 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:29.890 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:29.890 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:29.890 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.891 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:29.891 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:29.891 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.891 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:29.891 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:29.891 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:29.891 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.891 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:29.891 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:29.891 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:29.891 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:29.891 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:29.892 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:29.892 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:29.892 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:29.892 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.892 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:29.892 INFO:teuthology.orchestra.run.smithi144.stdout:______________ ERROR at setup of test_object_create_bad_md5_none _______________ 2024-06-04T16:22:29.892 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.892 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:29.892 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:29.892 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:29.892 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.892 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:29.892 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:29.892 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:29.892 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:29.893 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:29.893 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:29.893 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:29.893 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.893 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:29.893 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:29.893 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.893 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:29.893 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:29.893 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:29.893 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.893 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:29.893 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:29.893 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:29.894 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:29.894 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:29.894 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:29.894 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:29.894 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:29.894 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.894 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:29.894 INFO:teuthology.orchestra.run.smithi144.stdout:___________ ERROR at setup of test_object_create_bad_expect_mismatch ___________ 2024-06-04T16:22:29.894 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.894 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:29.894 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:29.894 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:29.894 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.895 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:29.895 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:29.895 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:29.895 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:29.895 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:29.895 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:29.895 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:29.895 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.895 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:29.895 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:29.895 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.895 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:29.895 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:29.895 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:29.896 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.896 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:29.896 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:29.896 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:29.896 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:29.896 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:29.896 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:29.896 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:29.896 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:29.896 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.896 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:29.896 INFO:teuthology.orchestra.run.smithi144.stdout:____________ ERROR at setup of test_object_create_bad_expect_empty _____________ 2024-06-04T16:22:29.897 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.897 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:29.897 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:29.897 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:29.897 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.897 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:29.897 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:29.897 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:29.897 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:29.897 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:29.897 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:29.897 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:29.897 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.897 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:29.897 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:29.898 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.898 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:29.898 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:29.898 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:29.898 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.898 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:29.898 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:29.898 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:29.898 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:29.898 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:29.898 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:29.898 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:29.898 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:29.899 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.899 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:29.899 INFO:teuthology.orchestra.run.smithi144.stdout:_____________ ERROR at setup of test_object_create_bad_expect_none _____________ 2024-06-04T16:22:29.899 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.899 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:29.899 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:29.899 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:29.899 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.899 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:29.899 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:29.899 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:29.899 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:29.899 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:29.900 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:29.900 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:29.900 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.900 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:29.900 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:29.900 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.900 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:29.900 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:29.903 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:29.903 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.903 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:29.903 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:29.904 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:29.904 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:29.904 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:29.904 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:29.904 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:29.904 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:29.904 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.904 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:29.904 INFO:teuthology.orchestra.run.smithi144.stdout:_______ ERROR at setup of test_object_create_bad_contentlength_negative ________ 2024-06-04T16:22:29.904 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.904 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:29.904 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:29.905 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:29.905 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.905 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:29.905 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:29.905 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:29.905 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:29.905 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:29.905 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:29.905 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:29.905 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.905 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:29.905 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:29.905 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.905 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:29.905 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:29.906 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:29.906 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.906 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:29.906 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:29.906 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:29.906 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:29.906 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:29.906 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:29.906 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:29.906 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:29.906 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.906 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:29.907 INFO:teuthology.orchestra.run.smithi144.stdout:_________ ERROR at setup of test_object_create_bad_contenttype_invalid _________ 2024-06-04T16:22:29.907 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.907 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:29.907 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:29.907 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:29.907 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.907 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:29.907 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:29.907 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:29.907 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:29.907 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:29.907 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:29.907 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:29.907 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.907 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:29.907 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:29.908 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.908 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:29.908 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:29.908 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:29.908 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.908 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:29.908 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:29.908 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:29.908 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:29.908 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:29.908 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:29.908 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:29.909 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:29.909 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.909 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:29.909 INFO:teuthology.orchestra.run.smithi144.stdout:__________ ERROR at setup of test_object_create_bad_contenttype_empty __________ 2024-06-04T16:22:29.909 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.909 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:29.909 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:29.909 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:29.909 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.909 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:29.909 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:29.909 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:29.909 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:29.909 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:29.910 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:29.910 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:29.910 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.910 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:29.910 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:29.910 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.910 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:29.910 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:29.910 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:29.910 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.910 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:29.910 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:29.910 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:29.911 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:29.911 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:29.911 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:29.911 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:29.911 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:29.911 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.911 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:29.911 INFO:teuthology.orchestra.run.smithi144.stdout:__________ ERROR at setup of test_object_create_bad_contenttype_none ___________ 2024-06-04T16:22:29.911 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.911 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:29.911 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:29.911 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:29.911 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.911 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:29.912 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:29.912 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:29.912 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:29.912 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:29.912 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:29.912 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:29.912 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.912 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:29.912 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:29.912 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.912 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:29.912 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:29.912 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:29.913 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.913 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:29.913 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:29.913 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:29.913 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:29.913 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:29.913 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:29.913 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:29.913 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:29.913 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.913 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:29.913 INFO:teuthology.orchestra.run.smithi144.stdout:_______________ ERROR at setup of test_bucket_put_bad_canned_acl _______________ 2024-06-04T16:22:29.913 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.913 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:29.913 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:29.914 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:29.914 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.914 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:29.914 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:29.914 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:29.914 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:29.914 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:29.914 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:29.914 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:29.914 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.914 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:29.914 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:29.914 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.915 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:29.915 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:29.915 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:29.915 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.915 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:29.915 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:29.915 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:29.915 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:29.915 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:29.915 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:29.915 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:29.915 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:29.915 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.915 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:29.915 INFO:teuthology.orchestra.run.smithi144.stdout:___________ ERROR at setup of test_bucket_create_bad_expect_mismatch ___________ 2024-06-04T16:22:29.916 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.916 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:29.916 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:29.916 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:29.916 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.916 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:29.916 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:29.916 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:29.916 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:29.916 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:29.916 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:29.916 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:29.916 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.916 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:29.917 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:29.917 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.917 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:29.917 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:29.917 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:29.917 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.917 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:29.917 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:29.917 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:29.917 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:29.917 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:29.917 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:29.918 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:29.918 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:29.918 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.918 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:29.918 INFO:teuthology.orchestra.run.smithi144.stdout:____________ ERROR at setup of test_bucket_create_bad_expect_empty _____________ 2024-06-04T16:22:29.918 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.918 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:29.918 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:29.918 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:29.918 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.918 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:29.918 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:29.918 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:29.919 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:29.919 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:29.919 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:29.919 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:29.919 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.919 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:29.919 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:29.919 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.919 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:29.919 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:29.919 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:29.919 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.919 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:29.920 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:29.920 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:29.920 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:29.920 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:29.920 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:29.920 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:29.920 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:29.920 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.920 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:29.920 INFO:teuthology.orchestra.run.smithi144.stdout:_______ ERROR at setup of test_bucket_create_bad_contentlength_negative ________ 2024-06-04T16:22:29.920 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.920 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:29.920 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:29.920 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:29.921 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.921 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:29.921 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:29.921 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:29.921 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:29.921 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:29.921 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:29.921 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:29.921 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.921 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:29.921 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:29.921 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.922 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:29.922 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:29.922 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:29.922 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.922 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:29.922 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:29.922 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:29.922 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:29.922 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:29.922 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:29.922 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:29.922 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:29.922 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.923 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:29.923 INFO:teuthology.orchestra.run.smithi144.stdout:______ ERROR at setup of test_object_create_bad_md5_invalid_garbage_aws2 _______ 2024-06-04T16:22:29.923 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.923 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:29.923 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:29.923 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:29.923 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.923 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:29.923 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:29.923 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:29.923 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:29.923 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:29.923 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:29.924 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:29.924 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.924 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:29.924 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:29.924 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.924 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:29.924 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:29.924 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:29.924 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.924 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:29.924 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:29.924 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:29.924 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:29.925 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:29.925 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:29.925 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:29.925 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:29.925 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.925 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:29.925 INFO:teuthology.orchestra.run.smithi144.stdout:____________ ERROR at setup of test_object_create_bad_ua_empty_aws2 ____________ 2024-06-04T16:22:29.925 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.925 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:29.925 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:29.925 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:29.925 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.925 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:29.925 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:29.926 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:29.926 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:29.926 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:29.926 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:29.926 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:29.926 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.926 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:29.926 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:29.926 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.926 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:29.926 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:29.926 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:29.926 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.927 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:29.927 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:29.927 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:29.927 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:29.927 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:29.927 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:29.927 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:29.927 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:29.927 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.927 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:29.927 INFO:teuthology.orchestra.run.smithi144.stdout:____________ ERROR at setup of test_object_create_bad_ua_none_aws2 _____________ 2024-06-04T16:22:29.927 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.928 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:29.928 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:29.928 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:29.928 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.928 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:29.928 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:29.928 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:29.928 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:29.928 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:29.928 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:29.928 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:29.928 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.928 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:29.929 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:29.929 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.929 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:29.929 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:29.929 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:29.929 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.929 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:29.929 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:29.929 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:29.929 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:29.929 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:29.929 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:29.929 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:29.929 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:29.929 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.930 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:29.930 INFO:teuthology.orchestra.run.smithi144.stdout:__________ ERROR at setup of test_object_create_bad_date_invalid_aws2 __________ 2024-06-04T16:22:29.930 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.930 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:29.930 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:29.930 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:29.930 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.930 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:29.930 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:29.930 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:29.930 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:29.930 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:29.930 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:29.931 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:29.931 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.931 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:29.931 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:29.931 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.931 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:29.931 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:29.931 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:29.931 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.931 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:29.931 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:29.931 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:29.931 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:29.931 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:29.931 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:29.932 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:29.932 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:29.932 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.932 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:29.932 INFO:teuthology.orchestra.run.smithi144.stdout:___________ ERROR at setup of test_object_create_bad_date_empty_aws2 ___________ 2024-06-04T16:22:29.932 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.932 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:29.932 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:29.932 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:29.932 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.932 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:29.932 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:29.932 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:29.933 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:29.933 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:29.933 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:29.933 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:29.933 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.933 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:29.933 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:29.933 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.933 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:29.933 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:29.933 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:29.933 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.933 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:29.933 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:29.934 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:29.934 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:29.934 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:29.934 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:29.934 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:29.934 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:29.934 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.934 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:29.934 INFO:teuthology.orchestra.run.smithi144.stdout:_______ ERROR at setup of test_object_create_bad_date_before_today_aws2 ________ 2024-06-04T16:22:29.934 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.934 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:29.934 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:29.934 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:29.935 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.935 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:29.935 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:29.935 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:29.935 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:29.935 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:29.935 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:29.935 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:29.935 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.935 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:29.935 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:29.935 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.935 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:29.935 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:29.936 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:29.936 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.936 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:29.936 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:29.936 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:29.936 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:29.936 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:29.936 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:29.936 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:29.936 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:29.936 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.936 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:29.937 INFO:teuthology.orchestra.run.smithi144.stdout:_______ ERROR at setup of test_object_create_bad_date_before_epoch_aws2 ________ 2024-06-04T16:22:29.937 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.937 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:29.937 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:29.937 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:29.937 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.937 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:29.937 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:29.937 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:29.937 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:29.937 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:29.937 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:29.938 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:29.938 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.938 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:29.938 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:29.938 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.938 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:29.938 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:29.938 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:29.938 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.938 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:29.938 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:29.938 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:29.938 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:29.939 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:29.939 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:29.939 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:29.939 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:29.939 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.939 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:29.939 INFO:teuthology.orchestra.run.smithi144.stdout:_________ ERROR at setup of test_object_create_bad_date_after_end_aws2 _________ 2024-06-04T16:22:29.939 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.939 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:29.939 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:29.939 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:29.939 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.939 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:29.939 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:29.940 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:29.940 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:29.940 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:29.940 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:29.940 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:29.940 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.940 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:29.940 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:29.940 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.940 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:29.940 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:29.940 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:29.940 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.941 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:29.941 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:29.941 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:29.941 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:29.941 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:29.941 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:29.941 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:29.941 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:29.941 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.941 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:29.941 INFO:teuthology.orchestra.run.smithi144.stdout:____________ ERROR at setup of test_bucket_create_bad_ua_empty_aws2 ____________ 2024-06-04T16:22:29.941 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.941 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:29.941 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:29.942 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:29.942 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.942 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:29.942 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:29.942 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:29.942 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:29.942 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:29.942 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:29.942 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:29.942 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.942 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:29.942 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:29.942 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.942 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:29.943 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:29.943 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:29.943 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.943 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:29.943 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:29.943 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:29.943 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:29.943 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:29.943 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:29.943 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:29.943 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:29.943 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.943 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:29.943 INFO:teuthology.orchestra.run.smithi144.stdout:____________ ERROR at setup of test_bucket_create_bad_ua_none_aws2 _____________ 2024-06-04T16:22:29.944 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.944 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:29.944 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:29.944 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:29.944 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.944 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:29.944 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:29.944 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:29.944 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:29.944 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:29.944 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:29.944 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:29.944 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.944 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:29.945 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:29.945 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.945 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:29.945 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:29.945 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:29.945 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.945 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:29.945 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:29.945 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:29.945 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:29.945 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:29.945 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:29.945 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:29.945 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:29.946 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.946 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:29.946 INFO:teuthology.orchestra.run.smithi144.stdout:__________ ERROR at setup of test_bucket_create_bad_date_invalid_aws2 __________ 2024-06-04T16:22:29.946 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.946 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:29.946 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:29.946 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:29.946 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.946 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:29.946 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:29.946 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:29.946 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:29.946 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:29.946 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:29.947 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:29.947 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.947 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:29.947 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:29.947 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.947 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:29.947 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:29.947 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:29.947 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.947 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:29.947 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:29.947 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:29.947 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:29.948 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:29.948 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:29.948 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:29.948 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:29.948 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.948 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:29.948 INFO:teuthology.orchestra.run.smithi144.stdout:___________ ERROR at setup of test_bucket_create_bad_date_empty_aws2 ___________ 2024-06-04T16:22:29.948 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.948 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:29.948 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:29.948 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:29.948 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.948 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:29.948 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:29.949 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:29.949 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:29.949 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:29.949 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:29.949 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:29.949 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.949 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:29.949 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:29.949 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.949 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:29.949 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:29.949 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:29.949 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.950 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:29.950 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:29.950 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:29.950 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:29.950 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:29.950 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:29.950 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:29.950 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:29.950 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.950 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:29.950 INFO:teuthology.orchestra.run.smithi144.stdout:_______ ERROR at setup of test_bucket_create_bad_date_before_today_aws2 ________ 2024-06-04T16:22:29.950 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.950 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:29.951 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:29.951 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:29.951 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.951 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:29.951 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:29.951 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:29.951 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:29.951 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:29.951 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:29.951 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:29.951 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.951 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:29.951 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:29.952 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.952 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:29.952 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:29.952 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:29.952 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.952 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:29.952 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:29.952 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:29.952 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:29.952 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:29.952 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:29.952 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:29.953 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:29.953 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.953 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:29.953 INFO:teuthology.orchestra.run.smithi144.stdout:________ ERROR at setup of test_bucket_create_bad_date_after_today_aws2 ________ 2024-06-04T16:22:29.953 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.953 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:29.953 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:29.953 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:29.953 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.953 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:29.953 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:29.953 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:29.953 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:29.953 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:29.954 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:29.954 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:29.954 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.954 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:29.954 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:29.954 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.954 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:29.954 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:29.954 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:29.954 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.954 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:29.954 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:29.954 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:29.955 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:29.955 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:29.955 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:29.955 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:29.955 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:29.955 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.955 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:29.955 INFO:teuthology.orchestra.run.smithi144.stdout:_______ ERROR at setup of test_bucket_create_bad_date_before_epoch_aws2 ________ 2024-06-04T16:22:29.955 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.955 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:29.955 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:29.955 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:29.955 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.956 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:29.956 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:29.956 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:29.956 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:29.956 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:29.956 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:29.956 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:29.956 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.956 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:29.956 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:29.956 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.956 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:29.956 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:29.956 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:29.957 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.957 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:29.957 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:29.957 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:29.957 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:29.957 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:29.957 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:29.957 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:29.957 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:29.957 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.957 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:29.957 INFO:teuthology.orchestra.run.smithi144.stdout:____________________ ERROR at setup of test_put_user_policy ____________________ 2024-06-04T16:22:29.957 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.957 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:29.957 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:29.958 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:29.958 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.958 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:29.958 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:29.958 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:29.958 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:29.958 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:29.958 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:29.958 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:29.958 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.958 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:29.958 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:29.958 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.959 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:29.959 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:29.959 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:29.959 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.959 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:29.959 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:29.959 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:29.959 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:29.959 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:29.959 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:29.959 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:29.959 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:29.959 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.959 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:29.959 INFO:teuthology.orchestra.run.smithi144.stdout:_____________ ERROR at setup of test_put_user_policy_invalid_user ______________ 2024-06-04T16:22:29.960 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.960 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:29.960 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:29.960 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:29.960 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.960 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:29.960 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:29.960 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:29.960 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:29.960 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:29.960 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:29.960 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:29.960 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.960 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:29.961 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:29.961 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.961 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:29.961 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:29.961 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:29.961 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.961 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:29.961 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:29.961 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:29.961 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:29.961 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:29.961 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:29.962 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:29.962 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:29.962 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.962 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:29.962 INFO:teuthology.orchestra.run.smithi144.stdout:____________ ERROR at setup of test_put_user_policy_parameter_limit ____________ 2024-06-04T16:22:29.962 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.962 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:29.962 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:29.962 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:29.962 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.962 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:29.962 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:29.963 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:29.963 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:29.963 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:29.963 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:29.963 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:29.963 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.963 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:29.963 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:29.963 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.963 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:29.963 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:29.963 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:29.963 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.963 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:29.964 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:29.964 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:29.964 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:29.964 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:29.964 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:29.964 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:29.964 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:29.964 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.964 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:29.964 INFO:teuthology.orchestra.run.smithi144.stdout:_______________ ERROR at setup of test_put_existing_user_policy ________________ 2024-06-04T16:22:29.964 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.964 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:29.965 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:29.965 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:29.965 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.965 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:29.965 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:29.965 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:29.965 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:29.965 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:29.965 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:29.965 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:29.965 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.965 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:29.965 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:29.965 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.966 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:29.966 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:29.966 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:29.966 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.966 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:29.966 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:29.966 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:29.966 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:29.966 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:29.966 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:29.966 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:29.966 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:29.966 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.967 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:29.967 INFO:teuthology.orchestra.run.smithi144.stdout:___________________ ERROR at setup of test_list_user_policy ____________________ 2024-06-04T16:22:29.967 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.967 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:29.967 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:29.967 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:29.967 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.967 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:29.967 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:29.967 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:29.967 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:29.967 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:29.967 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:29.968 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:29.968 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.968 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:29.968 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:29.968 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.968 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:29.968 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:29.968 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:29.968 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.968 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:29.968 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:29.968 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:29.968 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:29.968 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:29.969 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:29.969 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:29.969 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:29.969 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.969 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:29.969 INFO:teuthology.orchestra.run.smithi144.stdout:_____________ ERROR at setup of test_list_user_policy_invalid_user _____________ 2024-06-04T16:22:29.969 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.969 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:29.969 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:29.969 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:29.969 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.969 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:29.969 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:29.970 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:29.970 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:29.970 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:29.970 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:29.970 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:29.970 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.970 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:29.970 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:29.970 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.970 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:29.970 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:29.970 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:29.971 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.971 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:29.971 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:29.971 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:29.971 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:29.971 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:29.971 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:29.971 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:29.971 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:29.971 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.971 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:29.971 INFO:teuthology.orchestra.run.smithi144.stdout:____________________ ERROR at setup of test_get_user_policy ____________________ 2024-06-04T16:22:29.971 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.972 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:29.972 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:29.972 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:29.972 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.972 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:29.972 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:29.972 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:29.972 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:29.972 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:29.972 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:29.972 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:29.972 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.972 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:29.972 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:29.973 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.973 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:29.973 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:29.973 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:29.973 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.973 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:29.973 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:29.973 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:29.973 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:29.973 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:29.973 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:29.973 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:29.973 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:29.973 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.974 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:29.974 INFO:teuthology.orchestra.run.smithi144.stdout:_____________ ERROR at setup of test_get_user_policy_invalid_user ______________ 2024-06-04T16:22:29.974 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.974 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:29.974 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:29.974 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:29.974 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.974 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:29.974 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:29.974 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:29.974 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:29.974 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:29.974 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:29.974 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:29.975 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.975 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:29.975 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:29.975 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.975 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:29.975 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:29.975 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:29.975 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.975 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:29.975 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:29.975 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:29.975 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:29.975 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:29.976 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:29.976 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:29.976 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:29.976 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.976 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:29.976 INFO:teuthology.orchestra.run.smithi144.stdout:________ ERROR at setup of test_get_user_policy_from_multiple_policies _________ 2024-06-04T16:22:29.976 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.976 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:29.976 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:29.976 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:29.976 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.976 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:29.976 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:29.976 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:29.977 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:29.977 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:29.977 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:29.977 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:29.977 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.977 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:29.977 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:29.977 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.977 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:29.977 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:29.977 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:29.977 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.977 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:29.978 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:29.978 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:29.978 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:29.978 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:29.978 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:29.978 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:29.978 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:29.978 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.978 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:29.978 INFO:teuthology.orchestra.run.smithi144.stdout:__________________ ERROR at setup of test_delete_user_policy ___________________ 2024-06-04T16:22:29.978 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.978 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:29.979 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:29.979 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:29.979 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.979 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:29.979 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:29.979 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:29.979 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:29.979 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:29.979 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:29.979 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:29.979 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.979 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:29.979 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:29.979 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.979 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:29.980 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:29.980 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:29.980 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.980 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:29.980 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:29.980 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:29.980 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:29.980 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:29.980 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:29.980 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:29.980 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:29.980 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.980 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:29.980 INFO:teuthology.orchestra.run.smithi144.stdout:____________ ERROR at setup of test_delete_user_policy_invalid_user ____________ 2024-06-04T16:22:29.981 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.981 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:29.981 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:29.981 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:29.981 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.981 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:29.981 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:29.981 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:29.981 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:29.981 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:29.981 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:29.981 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:29.981 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.982 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:29.982 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:29.982 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.982 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:29.982 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:29.982 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:29.982 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.982 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:29.982 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:29.982 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:29.982 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:29.982 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:29.982 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:29.983 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:29.983 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:29.983 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.983 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:29.983 INFO:teuthology.orchestra.run.smithi144.stdout:________ ERROR at setup of test_delete_user_policy_invalid_policy_name _________ 2024-06-04T16:22:29.983 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.983 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:29.983 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:29.983 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:29.983 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.983 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:29.983 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:29.983 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:29.983 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:29.984 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:29.984 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:29.984 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:29.984 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.984 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:29.984 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:29.984 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.984 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:29.984 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:29.984 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:29.984 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.984 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:29.984 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:29.984 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:29.985 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:29.985 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:29.985 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:29.985 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:29.985 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:29.985 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.985 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:29.985 INFO:teuthology.orchestra.run.smithi144.stdout:_______ ERROR at setup of test_delete_user_policy_from_multiple_policies _______ 2024-06-04T16:22:29.985 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.985 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:29.985 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:29.985 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:29.985 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.985 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:29.985 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:29.986 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:29.986 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:29.986 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:29.986 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:29.986 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:29.986 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.986 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:29.986 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:29.986 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.986 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:29.986 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:29.986 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:29.986 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.986 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:29.987 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:29.987 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:29.987 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:29.987 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:29.987 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:29.987 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:29.987 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:29.987 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.987 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:29.987 INFO:teuthology.orchestra.run.smithi144.stdout:__________ ERROR at setup of test_allow_bucket_actions_in_user_policy __________ 2024-06-04T16:22:29.987 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.987 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:29.987 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:29.987 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:29.987 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.988 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:29.988 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:29.988 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:29.988 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:29.988 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:29.988 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:29.988 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:29.988 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.988 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:29.988 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:29.988 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.988 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:29.988 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:29.988 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:29.989 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.989 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:29.989 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:29.989 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:29.989 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:29.989 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:29.989 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:29.989 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:29.989 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:29.989 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.989 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:29.989 INFO:teuthology.orchestra.run.smithi144.stdout:__________ ERROR at setup of test_deny_bucket_actions_in_user_policy ___________ 2024-06-04T16:22:29.989 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.989 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:29.989 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:29.990 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:29.990 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.990 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:29.990 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:29.990 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:29.990 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:29.990 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:29.990 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:29.990 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:29.990 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.990 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:29.990 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:29.990 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.991 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:29.991 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:29.991 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:29.991 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.991 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:29.991 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:29.991 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:29.991 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:29.991 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:29.991 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:29.991 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:29.991 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:29.991 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.991 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:29.991 INFO:teuthology.orchestra.run.smithi144.stdout:__________ ERROR at setup of test_allow_object_actions_in_user_policy __________ 2024-06-04T16:22:29.992 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.992 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:29.992 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:29.992 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:29.992 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.992 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:29.992 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:29.992 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:29.992 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:29.992 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:29.992 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:29.992 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:29.992 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.993 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:29.993 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:29.993 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.993 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:29.993 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:29.993 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:29.993 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.993 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:29.993 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:29.993 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:29.993 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:29.993 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:29.993 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:29.994 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:29.994 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:29.994 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.994 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:29.994 INFO:teuthology.orchestra.run.smithi144.stdout:__________ ERROR at setup of test_deny_object_actions_in_user_policy ___________ 2024-06-04T16:22:29.994 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.994 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:29.994 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:29.994 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:29.994 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.994 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:29.994 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:29.994 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:29.994 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:29.995 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:29.995 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:29.995 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:29.995 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.995 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:29.995 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:29.995 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.995 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:29.995 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:29.995 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:29.995 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.995 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:29.995 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:29.995 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:29.996 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:29.996 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:29.996 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:29.996 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:29.996 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:29.996 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.996 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:29.996 INFO:teuthology.orchestra.run.smithi144.stdout:________ ERROR at setup of test_allow_multipart_actions_in_user_policy _________ 2024-06-04T16:22:29.996 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.996 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:29.996 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:29.996 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:29.996 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.997 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:29.997 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:29.997 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:29.997 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:29.997 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:29.997 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:29.997 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:29.997 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.997 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:29.997 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:29.997 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.997 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:29.997 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:29.998 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:29.998 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.998 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:29.998 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:29.998 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:29.998 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:29.998 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:29.998 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:29.998 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:29.998 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:29.998 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.998 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:29.998 INFO:teuthology.orchestra.run.smithi144.stdout:_________ ERROR at setup of test_deny_multipart_actions_in_user_policy _________ 2024-06-04T16:22:29.999 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.999 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:29.999 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:29.999 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:29.999 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:29.999 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:29.999 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:29.999 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:29.999 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:29.999 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:29.999 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:29.999 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:29.999 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.000 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.000 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.000 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.000 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.000 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.000 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.000 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.000 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.000 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.000 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.000 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.000 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.000 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.000 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.000 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.001 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.001 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.001 INFO:teuthology.orchestra.run.smithi144.stdout:_________ ERROR at setup of test_allow_tagging_actions_in_user_policy __________ 2024-06-04T16:22:30.001 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.001 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.001 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.001 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.001 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.001 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.001 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.001 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.001 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.001 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.001 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.002 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.002 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.002 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.002 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.002 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.002 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.002 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.002 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.002 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.002 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.002 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.002 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.002 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.002 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.003 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.003 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.003 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.003 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.003 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.003 INFO:teuthology.orchestra.run.smithi144.stdout:__________ ERROR at setup of test_deny_tagging_actions_in_user_policy __________ 2024-06-04T16:22:30.003 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.003 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.003 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.003 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.003 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.003 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.003 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.003 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.003 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.004 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.004 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.004 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.004 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.004 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.004 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.004 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.004 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.004 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.004 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.004 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.004 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.004 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.005 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.005 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.005 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.005 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.005 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.005 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.005 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.005 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.005 INFO:teuthology.orchestra.run.smithi144.stdout:_______ ERROR at setup of test_verify_conflicting_user_policy_statements _______ 2024-06-04T16:22:30.005 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.005 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.005 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.005 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.005 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.006 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.006 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.006 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.006 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.006 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.006 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.006 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.006 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.006 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.006 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.006 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.009 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.009 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.009 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.009 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.009 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.010 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.010 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.010 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.010 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.010 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.010 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.010 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.010 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.010 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.010 INFO:teuthology.orchestra.run.smithi144.stdout:___________ ERROR at setup of test_verify_conflicting_user_policies ____________ 2024-06-04T16:22:30.010 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.010 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.010 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.011 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.011 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.011 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.011 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.011 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.011 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.011 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.011 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.011 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.011 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.011 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.011 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.011 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.012 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.012 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.012 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.012 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.012 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.012 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.012 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.012 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.012 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.012 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.012 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.012 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.012 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.013 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.013 INFO:teuthology.orchestra.run.smithi144.stdout:_______________ ERROR at setup of test_verify_allow_iam_actions ________________ 2024-06-04T16:22:30.013 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.013 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.013 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.013 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.013 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.013 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.013 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.013 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.013 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.013 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.014 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.014 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.014 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.014 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.014 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.014 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.014 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.014 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.014 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.014 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.014 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.014 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.014 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.015 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.015 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.015 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.015 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.015 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.015 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.015 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.015 INFO:teuthology.orchestra.run.smithi144.stdout:__________________ ERROR at setup of test_account_user_create __________________ 2024-06-04T16:22:30.015 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.015 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.015 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.015 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.015 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.016 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.016 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.016 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.016 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.016 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.016 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.016 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.016 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.016 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.016 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.016 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.016 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.016 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.017 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.017 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.017 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.017 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.017 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.017 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.017 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.017 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.017 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.017 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.017 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.017 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.017 INFO:teuthology.orchestra.run.smithi144.stdout:__________ ERROR at setup of test_account_user_case_insensitive_name ___________ 2024-06-04T16:22:30.018 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.018 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.018 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.018 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.018 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.018 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.018 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.018 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.018 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.018 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.018 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.018 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.018 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.019 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.019 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.019 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.019 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.019 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.019 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.019 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.019 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.019 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.019 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.019 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.019 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.019 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.020 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.020 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.020 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.020 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.020 INFO:teuthology.orchestra.run.smithi144.stdout:__________________ ERROR at setup of test_account_user_delete __________________ 2024-06-04T16:22:30.020 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.020 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.020 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.020 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.020 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.020 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.020 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.020 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.020 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.021 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.021 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.021 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.021 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.021 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.021 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.021 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.021 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.021 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.021 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.021 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.021 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.021 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.022 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.022 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.022 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.022 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.022 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.022 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.022 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.022 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.022 INFO:teuthology.orchestra.run.smithi144.stdout:___________________ ERROR at setup of test_account_user_list ___________________ 2024-06-04T16:22:30.022 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.022 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.022 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.022 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.023 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.023 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.023 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.023 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.023 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.023 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.023 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.023 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.023 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.023 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.023 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.023 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.023 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.024 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.024 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.024 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.024 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.024 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.024 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.024 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.024 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.024 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.024 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.024 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.024 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.024 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.024 INFO:teuthology.orchestra.run.smithi144.stdout:_____________ ERROR at setup of test_account_user_list_path_prefix _____________ 2024-06-04T16:22:30.025 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.025 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.025 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.025 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.025 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.025 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.025 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.025 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.025 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.025 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.025 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.025 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.025 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.025 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.026 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.026 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.026 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.026 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.026 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.026 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.026 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.026 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.026 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.026 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.026 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.026 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.026 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.027 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.027 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.027 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.027 INFO:teuthology.orchestra.run.smithi144.stdout:_______________ ERROR at setup of test_account_user_update_name ________________ 2024-06-04T16:22:30.027 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.027 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.027 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.027 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.027 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.027 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.027 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.027 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.027 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.027 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.028 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.028 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.028 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.028 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.028 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.028 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.028 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.028 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.028 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.028 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.028 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.028 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.028 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.029 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.029 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.029 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.029 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.029 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.029 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.029 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.029 INFO:teuthology.orchestra.run.smithi144.stdout:_______________ ERROR at setup of test_account_user_update_path ________________ 2024-06-04T16:22:30.029 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.029 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.029 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.029 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.029 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.030 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.030 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.030 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.030 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.030 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.030 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.030 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.030 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.030 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.030 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.030 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.030 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.030 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.031 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.031 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.031 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.031 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.031 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.031 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.031 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.031 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.031 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.031 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.031 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.031 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.031 INFO:teuthology.orchestra.run.smithi144.stdout:____________ ERROR at setup of test_account_user_access_key_create _____________ 2024-06-04T16:22:30.032 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.032 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.032 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.032 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.032 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.032 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.032 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.032 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.032 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.032 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.032 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.032 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.032 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.032 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.033 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.033 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.033 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.033 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.033 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.033 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.033 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.033 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.033 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.033 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.033 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.033 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.034 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.034 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.034 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.034 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.034 INFO:teuthology.orchestra.run.smithi144.stdout:________ ERROR at setup of test_account_current_user_access_key_create _________ 2024-06-04T16:22:30.034 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.034 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.034 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.034 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.034 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.034 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.034 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.034 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.035 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.035 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.035 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.035 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.035 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.035 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.035 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.035 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.035 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.035 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.035 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.035 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.035 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.036 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.036 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.036 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.036 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.036 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.036 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.036 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.036 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.036 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.036 INFO:teuthology.orchestra.run.smithi144.stdout:____________ ERROR at setup of test_account_user_access_key_update _____________ 2024-06-04T16:22:30.036 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.036 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.036 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.037 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.037 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.037 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.037 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.037 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.037 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.037 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.037 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.037 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.037 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.037 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.037 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.037 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.037 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.037 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.037 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.038 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.038 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.038 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.038 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.038 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.038 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.038 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.038 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.038 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.038 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.038 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.038 INFO:teuthology.orchestra.run.smithi144.stdout:________ ERROR at setup of test_account_current_user_access_key_update _________ 2024-06-04T16:22:30.038 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.039 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.039 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.039 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.039 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.039 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.039 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.039 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.039 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.039 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.039 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.039 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.039 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.039 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.040 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.040 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.040 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.040 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.040 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.040 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.040 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.040 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.040 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.040 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.040 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.040 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.040 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.041 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.041 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.041 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.041 INFO:teuthology.orchestra.run.smithi144.stdout:____________ ERROR at setup of test_account_user_access_key_delete _____________ 2024-06-04T16:22:30.041 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.041 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.041 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.041 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.041 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.041 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.041 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.041 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.041 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.042 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.042 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.042 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.042 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.042 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.042 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.042 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.042 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.042 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.042 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.042 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.042 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.042 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.042 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.043 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.043 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.043 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.043 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.043 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.043 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.043 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.043 INFO:teuthology.orchestra.run.smithi144.stdout:________ ERROR at setup of test_account_current_user_access_key_delete _________ 2024-06-04T16:22:30.043 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.043 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.043 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.043 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.043 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.043 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.043 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.044 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.044 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.044 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.044 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.044 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.044 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.044 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.044 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.044 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.044 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.044 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.044 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.044 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.044 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.044 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.045 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.045 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.045 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.045 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.045 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.045 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.045 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.045 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.045 INFO:teuthology.orchestra.run.smithi144.stdout:_____________ ERROR at setup of test_account_user_access_key_list ______________ 2024-06-04T16:22:30.045 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.045 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.045 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.045 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.046 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.046 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.046 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.046 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.046 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.046 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.046 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.046 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.046 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.046 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.046 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.046 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.046 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.047 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.047 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.047 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.047 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.047 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.047 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.047 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.047 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.047 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.047 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.047 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.047 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.047 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.047 INFO:teuthology.orchestra.run.smithi144.stdout:___________ ERROR at setup of test_account_user_bucket_policy_allow ____________ 2024-06-04T16:22:30.047 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.048 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.048 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.048 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.048 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.048 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.048 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.048 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.048 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.048 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.048 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.048 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.048 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.048 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.048 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.048 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.048 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.049 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.049 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.049 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.049 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.049 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.049 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.049 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.049 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.049 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.049 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.049 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.049 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.049 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.049 INFO:teuthology.orchestra.run.smithi144.stdout:__________________ ERROR at setup of test_account_user_policy __________________ 2024-06-04T16:22:30.049 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.050 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.050 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.050 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.050 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.050 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.050 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.050 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.050 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.050 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.050 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.050 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.050 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.050 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.050 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.051 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.051 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.051 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.051 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.051 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.051 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.051 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.051 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.051 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.051 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.051 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.051 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.052 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.052 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.052 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.052 INFO:teuthology.orchestra.run.smithi144.stdout:______________ ERROR at setup of test_account_user_policy_managed ______________ 2024-06-04T16:22:30.052 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.052 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.052 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.052 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.052 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.052 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.052 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.052 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.052 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.052 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.053 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.053 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.053 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.053 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.053 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.053 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.053 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.053 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.053 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.053 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.053 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.053 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.053 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.053 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.054 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.054 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.054 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.054 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.054 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.054 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.054 INFO:teuthology.orchestra.run.smithi144.stdout:_______________ ERROR at setup of test_account_user_policy_allow _______________ 2024-06-04T16:22:30.054 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.054 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.054 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.054 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.054 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.054 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.055 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.055 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.055 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.055 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.055 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.055 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.055 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.055 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.055 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.055 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.055 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.055 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.055 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.056 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.056 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.056 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.056 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.056 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.056 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.056 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.056 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.056 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.056 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.056 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.056 INFO:teuthology.orchestra.run.smithi144.stdout:_________________ ERROR at setup of test_account_group_create __________________ 2024-06-04T16:22:30.056 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.056 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.057 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.057 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.057 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.057 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.057 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.057 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.057 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.057 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.057 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.057 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.057 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.057 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.057 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.057 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.057 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.057 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.058 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.058 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.058 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.058 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.058 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.058 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.058 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.058 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.058 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.058 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.058 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.058 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.058 INFO:teuthology.orchestra.run.smithi144.stdout:__________ ERROR at setup of test_account_group_case_insensitive_name __________ 2024-06-04T16:22:30.059 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.059 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.059 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.059 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.059 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.059 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.059 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.059 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.059 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.059 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.059 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.059 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.059 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.059 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.059 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.060 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.060 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.060 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.060 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.060 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.060 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.060 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.060 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.060 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.060 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.060 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.060 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.060 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.060 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.060 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.061 INFO:teuthology.orchestra.run.smithi144.stdout:__________________ ERROR at setup of test_account_group_list ___________________ 2024-06-04T16:22:30.061 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.061 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.061 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.061 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.061 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.061 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.061 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.061 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.061 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.061 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.061 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.061 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.062 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.062 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.062 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.062 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.062 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.062 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.062 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.062 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.062 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.062 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.062 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.062 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.062 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.063 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.063 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.063 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.063 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.063 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.063 INFO:teuthology.orchestra.run.smithi144.stdout:_________________ ERROR at setup of test_account_group_update __________________ 2024-06-04T16:22:30.063 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.063 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.063 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.063 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.063 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.063 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.063 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.064 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.064 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.064 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.064 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.064 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.064 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.064 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.064 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.064 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.064 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.064 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.064 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.064 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.064 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.064 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.065 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.065 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.065 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.065 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.065 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.065 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.065 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.065 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.065 INFO:teuthology.orchestra.run.smithi144.stdout:______________ ERROR at setup of test_account_inline_group_policy ______________ 2024-06-04T16:22:30.065 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.065 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.065 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.065 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.065 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.065 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.066 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.066 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.066 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.066 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.066 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.066 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.066 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.066 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.066 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.066 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.066 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.066 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.066 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.066 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.067 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.067 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.067 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.067 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.067 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.067 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.067 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.067 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.067 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.067 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.067 INFO:teuthology.orchestra.run.smithi144.stdout:_____________ ERROR at setup of test_account_managed_group_policy ______________ 2024-06-04T16:22:30.067 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.068 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.068 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.068 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.068 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.068 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.068 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.068 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.068 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.068 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.068 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.068 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.068 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.068 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.068 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.068 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.069 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.069 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.069 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.069 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.069 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.069 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.069 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.069 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.069 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.069 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.069 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.069 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.069 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.069 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.070 INFO:teuthology.orchestra.run.smithi144.stdout:___________ ERROR at setup of test_account_inline_group_policy_allow ___________ 2024-06-04T16:22:30.070 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.070 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.070 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.070 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.070 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.070 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.070 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.070 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.070 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.070 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.070 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.070 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.070 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.071 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.071 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.071 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.071 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.071 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.071 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.071 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.071 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.071 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.071 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.071 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.071 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.071 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.072 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.072 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.072 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.072 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.072 INFO:teuthology.orchestra.run.smithi144.stdout:__________ ERROR at setup of test_account_managed_group_policy_allow ___________ 2024-06-04T16:22:30.072 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.072 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.072 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.072 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.072 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.072 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.072 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.072 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.072 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.073 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.073 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.073 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.073 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.073 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.073 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.073 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.073 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.073 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.073 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.073 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.073 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.073 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.073 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.073 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.074 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.074 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.074 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.074 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.074 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.074 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.074 INFO:teuthology.orchestra.run.smithi144.stdout:__________________ ERROR at setup of test_account_role_create __________________ 2024-06-04T16:22:30.074 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.074 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.074 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.074 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.074 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.074 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.074 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.075 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.075 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.075 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.075 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.075 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.075 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.075 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.075 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.075 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.075 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.075 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.075 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.075 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.076 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.076 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.076 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.076 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.076 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.076 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.076 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.076 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.076 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.076 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.076 INFO:teuthology.orchestra.run.smithi144.stdout:__________ ERROR at setup of test_account_role_case_insensitive_name ___________ 2024-06-04T16:22:30.076 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.076 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.076 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.077 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.077 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.077 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.077 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.077 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.077 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.077 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.077 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.077 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.077 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.077 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.077 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.077 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.077 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.078 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.078 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.078 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.078 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.078 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.078 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.078 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.078 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.078 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.078 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.078 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.079 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.079 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.079 INFO:teuthology.orchestra.run.smithi144.stdout:__________________ ERROR at setup of test_account_role_delete __________________ 2024-06-04T16:22:30.079 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.079 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.079 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.079 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.079 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.079 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.079 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.079 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.079 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.079 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.079 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.080 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.080 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.080 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.080 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.080 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.080 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.080 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.080 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.080 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.080 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.080 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.080 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.080 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.080 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.080 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.081 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.081 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.081 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.081 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.081 INFO:teuthology.orchestra.run.smithi144.stdout:___________________ ERROR at setup of test_account_role_list ___________________ 2024-06-04T16:22:30.081 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.081 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.081 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.081 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.081 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.081 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.081 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.081 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.081 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.082 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.082 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.082 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.082 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.082 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.082 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.082 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.082 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.082 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.082 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.082 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.082 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.082 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.083 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.083 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.083 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.083 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.083 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.083 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.083 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.083 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.083 INFO:teuthology.orchestra.run.smithi144.stdout:_____________ ERROR at setup of test_account_role_list_path_prefix _____________ 2024-06-04T16:22:30.083 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.083 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.083 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.083 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.084 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.084 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.084 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.084 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.084 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.084 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.084 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.084 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.084 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.084 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.084 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.084 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.084 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.084 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.085 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.085 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.085 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.085 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.085 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.085 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.085 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.085 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.085 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.085 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.085 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.085 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.085 INFO:teuthology.orchestra.run.smithi144.stdout:__________________ ERROR at setup of test_account_role_update __________________ 2024-06-04T16:22:30.086 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.086 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.086 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.086 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.086 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.086 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.086 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.086 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.086 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.086 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.086 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.086 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.086 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.086 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.087 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.087 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.087 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.087 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.087 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.087 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.087 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.087 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.087 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.087 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.087 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.087 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.088 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.088 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.088 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.088 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.088 INFO:teuthology.orchestra.run.smithi144.stdout:__________________ ERROR at setup of test_account_role_policy __________________ 2024-06-04T16:22:30.088 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.088 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.088 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.088 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.088 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.088 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.088 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.088 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.089 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.089 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.089 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.089 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.089 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.089 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.089 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.089 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.089 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.089 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.089 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.089 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.089 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.090 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.090 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.090 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.090 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.090 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.090 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.090 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.090 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.090 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.090 INFO:teuthology.orchestra.run.smithi144.stdout:______________ ERROR at setup of test_account_role_policy_managed ______________ 2024-06-04T16:22:30.090 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.090 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.090 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.091 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.091 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.091 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.091 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.091 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.091 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.091 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.091 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.091 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.091 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.091 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.091 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.091 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.092 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.092 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.092 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.092 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.092 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.092 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.092 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.092 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.092 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.092 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.092 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.092 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.092 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.093 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.093 INFO:teuthology.orchestra.run.smithi144.stdout:_______________ ERROR at setup of test_account_role_policy_allow _______________ 2024-06-04T16:22:30.093 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.093 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.093 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.093 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.093 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.093 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.093 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.093 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.093 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.093 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.093 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.094 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.094 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.094 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.094 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.094 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.094 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.094 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.094 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.094 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.094 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.094 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.094 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.094 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.095 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.095 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.095 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.095 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.095 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.095 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.095 INFO:teuthology.orchestra.run.smithi144.stdout:____________ ERROR at setup of test_same_account_role_policy_allow _____________ 2024-06-04T16:22:30.095 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.095 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.095 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.095 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.095 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.095 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.095 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.096 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.096 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.096 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.096 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.096 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.096 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.096 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.096 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.096 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.096 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.096 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.096 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.096 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.097 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.097 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.097 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.097 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.097 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.097 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.097 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.097 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.097 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.097 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.097 INFO:teuthology.orchestra.run.smithi144.stdout:____________ ERROR at setup of test_cross_account_role_policy_allow ____________ 2024-06-04T16:22:30.097 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.097 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.098 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.098 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.098 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.098 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.098 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.098 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.098 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.098 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.098 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.098 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.098 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.098 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.099 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.099 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.099 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.099 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.099 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.099 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.099 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.099 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.099 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.099 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.099 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.099 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.099 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.100 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.100 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.100 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.100 INFO:teuthology.orchestra.run.smithi144.stdout:________ ERROR at setup of test_account_role_policy_allow_create_bucket ________ 2024-06-04T16:22:30.100 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.100 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.100 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.100 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.100 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.100 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.100 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.100 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.100 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.100 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.101 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.101 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.101 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.101 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.101 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.101 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.101 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.101 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.101 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.101 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.101 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.101 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.101 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.101 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.102 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.102 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.102 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.102 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.102 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.102 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.102 INFO:teuthology.orchestra.run.smithi144.stdout:__________ ERROR at setup of test_account_role_policy_allow_get_role ___________ 2024-06-04T16:22:30.102 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.102 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.102 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.102 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.102 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.102 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.103 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.103 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.103 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.103 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.103 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.103 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.103 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.103 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.103 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.103 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.103 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.103 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.103 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.103 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.104 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.104 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.104 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.104 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.104 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.104 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.104 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.104 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.104 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.104 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.104 INFO:teuthology.orchestra.run.smithi144.stdout:_________________ ERROR at setup of test_account_oidc_provider _________________ 2024-06-04T16:22:30.104 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.104 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.105 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.105 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.105 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.105 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.105 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.105 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.105 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.105 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.105 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.105 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.105 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.105 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.105 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.105 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.106 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.106 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.106 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.106 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.106 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.106 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.106 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.106 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.106 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.106 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.106 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.106 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.106 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.107 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.107 INFO:teuthology.orchestra.run.smithi144.stdout:____ ERROR at setup of test_cross_account_bucket_user_policy_allow_user_arn ____ 2024-06-04T16:22:30.107 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.107 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.107 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.107 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.107 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.107 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.107 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.107 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.107 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.107 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.107 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.108 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.108 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.108 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.108 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.108 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.108 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.108 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.108 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.108 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.108 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.108 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.108 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.108 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.108 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.109 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.109 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.109 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.109 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.109 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.109 INFO:teuthology.orchestra.run.smithi144.stdout:____ ERROR at setup of test_cross_account_user_bucket_policy_allow_user_arn ____ 2024-06-04T16:22:30.109 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.109 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.109 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.109 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.109 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.109 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.109 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.109 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.109 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.110 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.110 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.110 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.110 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.110 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.110 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.110 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.110 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.110 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.110 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.110 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.110 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.110 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.111 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.111 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.111 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.111 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.111 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.111 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.111 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.111 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.111 INFO:teuthology.orchestra.run.smithi144.stdout:__ ERROR at setup of test_cross_account_user_bucket_policy_allow_account_arn ___ 2024-06-04T16:22:30.111 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.111 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.111 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.111 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.112 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.112 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.112 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.112 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.112 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.112 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.112 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.112 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.112 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.112 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.112 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.112 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.112 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.113 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.113 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.113 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.113 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.113 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.113 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.113 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.113 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.113 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.113 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.113 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.113 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.113 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.113 INFO:teuthology.orchestra.run.smithi144.stdout:__ ERROR at setup of test_cross_account_bucket_user_policy_allow_account_arn ___ 2024-06-04T16:22:30.114 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.114 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.114 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.114 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.114 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.114 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.114 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.114 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.114 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.114 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.114 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.114 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.114 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.115 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.115 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.115 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.115 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.115 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.115 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.115 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.115 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.115 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.115 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.115 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.115 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.115 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.116 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.116 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.116 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.116 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.116 INFO:teuthology.orchestra.run.smithi144.stdout:___ ERROR at setup of test_cross_account_user_bucket_policy_allow_account_id ___ 2024-06-04T16:22:30.116 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.116 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.116 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.116 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.116 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.116 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.116 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.116 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.117 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.117 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.117 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.117 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.117 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.117 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.117 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.117 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.117 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.117 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.117 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.117 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.117 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.117 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.118 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.118 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.118 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.118 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.118 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.118 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.118 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.118 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.118 INFO:teuthology.orchestra.run.smithi144.stdout:___ ERROR at setup of test_cross_account_bucket_user_policy_allow_account_id ___ 2024-06-04T16:22:30.118 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.118 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.118 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.118 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.119 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.119 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.119 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.119 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.119 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.119 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.119 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.119 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.119 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.119 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.119 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.119 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.119 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.119 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.119 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.120 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.120 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.120 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.120 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.120 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.120 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.120 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.120 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.120 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.120 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.120 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.120 INFO:teuthology.orchestra.run.smithi144.stdout:__ ERROR at setup of test_cross_account_bucket_acl_user_policy_grant_user_id ___ 2024-06-04T16:22:30.120 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.121 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.121 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.121 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.121 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.121 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.121 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.121 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.121 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.121 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.121 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.121 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.121 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.121 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.121 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.122 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.122 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.122 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.122 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.122 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.122 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.122 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.122 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.122 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.122 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.122 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.122 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.122 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.122 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.123 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.123 INFO:teuthology.orchestra.run.smithi144.stdout:__ ERROR at setup of test_cross_account_user_policy_bucket_acl_grant_user_id ___ 2024-06-04T16:22:30.123 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.123 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.123 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.123 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.123 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.123 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.123 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.123 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.123 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.123 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.123 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.124 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.124 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.124 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.124 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.124 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.124 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.124 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.124 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.124 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.124 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.124 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.124 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.124 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.124 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.125 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.125 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.125 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.125 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.125 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.125 INFO:teuthology.orchestra.run.smithi144.stdout:_ ERROR at setup of test_cross_account_bucket_acl_user_policy_grant_canonical_id _ 2024-06-04T16:22:30.125 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.125 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.125 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.125 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.125 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.125 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.125 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.125 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.126 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.126 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.126 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.126 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.126 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.126 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.126 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.126 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.126 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.126 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.126 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.126 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.126 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.127 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.127 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.127 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.127 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.127 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.127 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.127 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.127 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.127 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.127 INFO:teuthology.orchestra.run.smithi144.stdout:_ ERROR at setup of test_cross_account_user_policy_bucket_acl_grant_canonical_id _ 2024-06-04T16:22:30.127 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.127 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.127 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.127 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.128 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.128 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.128 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.128 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.128 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.128 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.128 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.128 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.128 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.128 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.128 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.128 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.128 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.129 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.129 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.129 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.129 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.129 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.129 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.129 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.129 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.129 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.129 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.129 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.129 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.129 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.129 INFO:teuthology.orchestra.run.smithi144.stdout:_ ERROR at setup of test_cross_account_bucket_acl_user_policy_grant_account_email _ 2024-06-04T16:22:30.130 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.130 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.130 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.130 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.130 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.130 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.130 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.130 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.130 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.130 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.130 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.130 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.130 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.131 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.131 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.131 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.131 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.131 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.131 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.131 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.131 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.131 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.131 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.131 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.131 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.131 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.131 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.132 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.132 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.132 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.132 INFO:teuthology.orchestra.run.smithi144.stdout:_ ERROR at setup of test_cross_account_user_policy_bucket_acl_grant_account_email _ 2024-06-04T16:22:30.132 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.132 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.132 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.132 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.132 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.132 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.132 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.132 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.132 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.132 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.132 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.133 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.133 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.133 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.133 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.133 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.133 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.133 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.133 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.133 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.133 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.133 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.133 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.133 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.133 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.134 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.134 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.134 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.134 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.134 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.134 INFO:teuthology.orchestra.run.smithi144.stdout:__ ERROR at setup of test_cross_account_root_bucket_policy_allow_account_arn ___ 2024-06-04T16:22:30.134 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.134 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.134 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.134 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.134 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.134 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.134 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.135 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.135 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.135 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.135 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.135 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.135 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.135 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.135 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.135 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.135 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.135 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.135 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.135 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.135 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.136 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.136 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.136 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.136 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.136 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.136 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.136 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.136 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.136 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.136 INFO:teuthology.orchestra.run.smithi144.stdout:___ ERROR at setup of test_cross_account_root_bucket_policy_allow_account_id ___ 2024-06-04T16:22:30.136 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.136 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.136 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.137 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.137 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.137 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.137 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.137 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.137 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.137 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.137 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.137 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.137 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.137 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.137 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.137 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.137 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.137 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.138 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.138 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.138 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.138 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.138 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.138 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.138 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.138 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.138 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.138 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.138 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.138 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.138 INFO:teuthology.orchestra.run.smithi144.stdout:___ ERROR at setup of test_cross_account_root_bucket_acl_grant_canonical_id ____ 2024-06-04T16:22:30.139 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.139 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.139 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.139 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.139 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.139 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.139 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.139 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.139 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.139 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.139 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.139 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.139 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.139 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.140 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.140 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.140 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.140 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.140 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.140 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.140 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.140 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.140 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.140 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.140 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.140 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.140 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.140 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.141 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.141 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.141 INFO:teuthology.orchestra.run.smithi144.stdout:___ ERROR at setup of test_cross_account_root_bucket_acl_grant_account_email ___ 2024-06-04T16:22:30.141 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.141 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.141 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.141 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.141 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.141 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.141 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.141 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.141 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.141 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.141 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.142 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.142 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.142 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.142 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.142 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.142 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.142 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.142 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.142 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.142 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.142 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.142 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.142 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.143 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.143 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.143 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.143 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.143 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.143 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.143 INFO:teuthology.orchestra.run.smithi144.stdout:___________________ ERROR at setup of test_bucket_list_empty ___________________ 2024-06-04T16:22:30.143 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.143 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.143 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.143 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.143 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.143 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.143 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.144 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.144 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.144 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.144 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.144 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.144 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.144 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.144 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.144 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.144 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.144 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.144 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.144 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.144 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.145 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.145 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.145 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.145 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.145 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.145 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.145 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.145 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.145 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.145 INFO:teuthology.orchestra.run.smithi144.stdout:_________________ ERROR at setup of test_bucket_list_distinct __________________ 2024-06-04T16:22:30.145 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.145 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.145 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.145 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.146 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.146 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.146 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.146 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.146 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.146 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.146 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.146 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.146 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.146 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.146 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.146 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.146 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.147 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.147 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.147 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.147 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.147 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.147 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.147 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.147 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.147 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.147 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.147 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.147 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.147 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.147 INFO:teuthology.orchestra.run.smithi144.stdout:___________________ ERROR at setup of test_bucket_list_many ____________________ 2024-06-04T16:22:30.148 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.148 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.148 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.148 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.148 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.148 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.148 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.148 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.148 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.148 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.148 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.148 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.148 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.149 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.149 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.149 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.149 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.149 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.149 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.149 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.149 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.149 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.149 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.149 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.149 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.149 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.149 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.150 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.150 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.150 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.150 INFO:teuthology.orchestra.run.smithi144.stdout:__________________ ERROR at setup of test_bucket_listv2_many ___________________ 2024-06-04T16:22:30.150 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.150 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.150 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.150 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.150 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.150 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.150 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.150 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.150 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.150 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.151 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.151 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.151 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.151 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.151 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.151 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.151 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.151 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.151 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.151 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.151 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.151 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.151 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.151 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.152 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.152 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.152 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.152 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.152 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.152 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.152 INFO:teuthology.orchestra.run.smithi144.stdout:____________________ ERROR at setup of test_basic_key_count ____________________ 2024-06-04T16:22:30.152 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.152 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.152 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.152 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.152 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.152 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.153 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.153 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.153 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.153 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.153 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.153 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.153 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.153 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.153 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.153 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.153 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.153 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.154 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.154 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.154 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.154 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.154 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.154 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.154 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.154 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.154 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.155 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.155 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.155 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.155 INFO:teuthology.orchestra.run.smithi144.stdout:______________ ERROR at setup of test_bucket_list_delimiter_basic ______________ 2024-06-04T16:22:30.155 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.155 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.155 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.155 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.155 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.155 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.155 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.155 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.155 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.156 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.156 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.156 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.156 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.156 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.156 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.156 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.156 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.156 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.156 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.156 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.156 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.156 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.156 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.157 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.157 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.157 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.157 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.157 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.157 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.157 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.157 INFO:teuthology.orchestra.run.smithi144.stdout:_____________ ERROR at setup of test_bucket_listv2_delimiter_basic _____________ 2024-06-04T16:22:30.157 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.157 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.157 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.157 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.157 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.157 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.157 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.157 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.158 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.158 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.158 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.158 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.158 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.158 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.158 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.158 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.158 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.158 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.158 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.158 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.158 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.158 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.159 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.159 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.159 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.159 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.159 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.159 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.159 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.159 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.159 INFO:teuthology.orchestra.run.smithi144.stdout:_____________ ERROR at setup of test_bucket_listv2_encoding_basic ______________ 2024-06-04T16:22:30.159 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.159 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.159 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.159 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.159 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.159 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.159 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.160 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.160 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.160 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.160 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.160 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.160 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.160 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.160 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.160 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.160 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.160 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.160 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.160 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.160 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.161 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.161 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.161 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.161 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.161 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.161 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.161 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.161 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.161 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.161 INFO:teuthology.orchestra.run.smithi144.stdout:______________ ERROR at setup of test_bucket_list_encoding_basic _______________ 2024-06-04T16:22:30.161 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.161 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.161 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.161 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.162 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.162 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.162 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.162 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.162 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.162 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.162 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.162 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.162 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.162 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.162 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.162 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.162 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.163 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.163 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.163 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.163 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.163 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.163 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.163 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.163 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.163 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.163 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.163 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.163 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.163 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.163 INFO:teuthology.orchestra.run.smithi144.stdout:_____________ ERROR at setup of test_bucket_list_delimiter_prefix ______________ 2024-06-04T16:22:30.164 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.164 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.164 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.164 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.164 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.164 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.164 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.164 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.164 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.164 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.164 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.164 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.164 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.165 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.165 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.165 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.165 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.165 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.165 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.165 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.165 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.165 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.165 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.165 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.165 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.165 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.165 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.166 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.166 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.166 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.166 INFO:teuthology.orchestra.run.smithi144.stdout:____________ ERROR at setup of test_bucket_listv2_delimiter_prefix _____________ 2024-06-04T16:22:30.166 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.166 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.166 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.166 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.166 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.166 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.166 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.166 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.166 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.166 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.167 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.167 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.167 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.167 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.167 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.167 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.167 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.167 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.167 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.167 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.167 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.167 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.167 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.167 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.168 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.168 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.168 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.168 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.168 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.168 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.168 INFO:teuthology.orchestra.run.smithi144.stdout:__ ERROR at setup of test_bucket_listv2_delimiter_prefix_ends_with_delimiter ___ 2024-06-04T16:22:30.168 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.168 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.168 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.168 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.168 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.168 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.168 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.168 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.169 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.169 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.169 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.169 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.169 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.169 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.169 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.169 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.169 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.169 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.169 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.169 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.170 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.170 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.170 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.170 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.170 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.170 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.170 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.170 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.170 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.170 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.170 INFO:teuthology.orchestra.run.smithi144.stdout:___ ERROR at setup of test_bucket_list_delimiter_prefix_ends_with_delimiter ____ 2024-06-04T16:22:30.170 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.170 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.171 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.171 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.171 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.171 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.171 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.171 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.171 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.171 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.171 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.171 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.171 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.171 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.171 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.172 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.172 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.172 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.172 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.172 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.172 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.172 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.172 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.172 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.172 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.172 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.172 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.172 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.172 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.173 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.173 INFO:teuthology.orchestra.run.smithi144.stdout:_______________ ERROR at setup of test_bucket_list_delimiter_alt _______________ 2024-06-04T16:22:30.173 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.173 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.173 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.173 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.173 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.173 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.173 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.173 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.173 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.173 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.173 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.173 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.174 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.174 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.174 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.174 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.174 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.175 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.175 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.176 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.176 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.176 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.176 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.176 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.176 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.176 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.176 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.176 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.176 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.176 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.176 INFO:teuthology.orchestra.run.smithi144.stdout:______________ ERROR at setup of test_bucket_listv2_delimiter_alt ______________ 2024-06-04T16:22:30.177 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.177 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.177 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.177 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.177 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.177 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.177 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.177 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.177 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.177 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.177 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.177 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.177 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.178 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.178 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.178 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.178 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.178 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.178 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.178 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.178 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.178 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.178 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.178 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.178 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.179 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.179 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.179 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.179 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.179 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.179 INFO:teuthology.orchestra.run.smithi144.stdout:________ ERROR at setup of test_bucket_list_delimiter_prefix_underscore ________ 2024-06-04T16:22:30.179 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.179 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.179 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.179 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.180 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.180 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.180 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.180 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.180 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.180 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.180 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.180 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.180 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.180 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.180 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.180 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.180 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.181 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.181 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.181 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.181 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.181 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.181 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.181 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.181 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.181 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.181 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.181 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.181 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.181 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.182 INFO:teuthology.orchestra.run.smithi144.stdout:_______ ERROR at setup of test_bucket_listv2_delimiter_prefix_underscore _______ 2024-06-04T16:22:30.182 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.182 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.182 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.182 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.182 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.182 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.182 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.182 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.182 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.182 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.183 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.183 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.183 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.183 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.183 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.183 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.183 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.183 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.183 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.183 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.183 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.183 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.183 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.184 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.184 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.184 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.184 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.184 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.184 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.184 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.184 INFO:teuthology.orchestra.run.smithi144.stdout:___________ ERROR at setup of test_bucket_list_delimiter_percentage ____________ 2024-06-04T16:22:30.184 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.184 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.184 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.184 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.184 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.184 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.185 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.185 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.185 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.185 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.185 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.185 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.185 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.185 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.185 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.186 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.186 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.186 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.186 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.186 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.186 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.186 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.186 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.186 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.186 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.186 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.187 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.187 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.187 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.187 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.187 INFO:teuthology.orchestra.run.smithi144.stdout:__________ ERROR at setup of test_bucket_listv2_delimiter_percentage ___________ 2024-06-04T16:22:30.187 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.187 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.187 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.187 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.187 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.187 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.187 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.188 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.188 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.188 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.188 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.188 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.188 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.188 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.188 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.188 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.188 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.188 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.188 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.188 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.188 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.189 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.189 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.189 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.189 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.189 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.189 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.189 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.189 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.189 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.189 INFO:teuthology.orchestra.run.smithi144.stdout:___________ ERROR at setup of test_bucket_list_delimiter_whitespace ____________ 2024-06-04T16:22:30.189 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.189 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.189 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.189 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.190 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.190 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.190 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.190 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.190 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.190 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.190 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.190 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.190 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.190 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.190 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.190 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.191 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.191 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.191 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.191 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.191 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.191 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.191 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.191 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.191 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.191 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.191 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.191 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.192 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.192 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.192 INFO:teuthology.orchestra.run.smithi144.stdout:__________ ERROR at setup of test_bucket_listv2_delimiter_whitespace ___________ 2024-06-04T16:22:30.192 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.192 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.192 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.192 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.192 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.192 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.192 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.192 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.192 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.192 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.193 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.193 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.193 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.193 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.193 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.193 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.193 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.193 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.193 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.193 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.193 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.194 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.194 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.194 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.194 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.194 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.194 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.194 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.194 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.194 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.194 INFO:teuthology.orchestra.run.smithi144.stdout:_______________ ERROR at setup of test_bucket_list_delimiter_dot _______________ 2024-06-04T16:22:30.194 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.195 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.195 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.195 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.195 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.195 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.195 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.195 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.195 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.195 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.196 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.196 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.196 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.196 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.196 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.196 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.196 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.196 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.196 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.196 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.197 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.197 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.197 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.197 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.197 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.197 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.197 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.197 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.197 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.197 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.197 INFO:teuthology.orchestra.run.smithi144.stdout:______________ ERROR at setup of test_bucket_listv2_delimiter_dot ______________ 2024-06-04T16:22:30.197 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.197 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.198 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.198 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.198 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.198 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.198 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.198 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.198 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.198 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.198 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.198 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.198 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.198 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.198 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.199 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.199 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.199 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.199 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.199 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.199 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.199 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.199 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.199 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.199 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.199 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.199 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.199 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.200 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.200 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.200 INFO:teuthology.orchestra.run.smithi144.stdout:___________ ERROR at setup of test_bucket_list_delimiter_unreadable ____________ 2024-06-04T16:22:30.200 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.200 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.200 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.200 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.200 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.200 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.200 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.200 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.200 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.200 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.201 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.201 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.201 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.201 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.201 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.201 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.201 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.201 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.201 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.201 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.201 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.201 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.201 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.201 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.202 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.202 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.202 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.202 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.202 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.202 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.202 INFO:teuthology.orchestra.run.smithi144.stdout:__________ ERROR at setup of test_bucket_listv2_delimiter_unreadable ___________ 2024-06-04T16:22:30.202 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.202 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.202 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.202 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.202 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.203 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.203 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.203 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.203 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.203 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.203 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.203 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.203 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.203 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.203 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.203 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.203 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.203 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.203 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.203 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.204 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.204 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.204 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.204 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.204 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.204 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.204 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.204 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.204 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.204 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.204 INFO:teuthology.orchestra.run.smithi144.stdout:______________ ERROR at setup of test_bucket_list_delimiter_empty ______________ 2024-06-04T16:22:30.204 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.204 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.204 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.205 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.205 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.205 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.205 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.205 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.205 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.205 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.205 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.205 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.205 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.205 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.205 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.206 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.206 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.206 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.206 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.206 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.206 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.206 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.206 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.206 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.207 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.207 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.207 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.207 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.207 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.207 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.207 INFO:teuthology.orchestra.run.smithi144.stdout:_____________ ERROR at setup of test_bucket_listv2_delimiter_empty _____________ 2024-06-04T16:22:30.207 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.207 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.207 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.207 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.207 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.207 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.207 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.208 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.208 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.208 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.208 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.208 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.208 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.208 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.208 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.208 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.208 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.208 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.208 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.208 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.208 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.209 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.209 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.209 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.209 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.209 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.209 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.209 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.209 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.209 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.209 INFO:teuthology.orchestra.run.smithi144.stdout:______________ ERROR at setup of test_bucket_list_delimiter_none _______________ 2024-06-04T16:22:30.209 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.209 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.209 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.209 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.209 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.210 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.210 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.210 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.210 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.210 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.210 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.210 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.213 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.214 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.214 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.214 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.214 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.214 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.214 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.214 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.214 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.214 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.215 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.215 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.215 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.215 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.215 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.215 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.215 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.215 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.215 INFO:teuthology.orchestra.run.smithi144.stdout:_____________ ERROR at setup of test_bucket_listv2_delimiter_none ______________ 2024-06-04T16:22:30.215 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.215 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.215 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.215 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.215 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.215 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.216 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.216 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.216 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.216 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.216 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.216 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.216 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.216 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.216 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.216 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.217 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.217 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.217 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.217 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.217 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.217 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.217 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.217 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.217 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.217 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.217 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.217 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.218 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.218 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.218 INFO:teuthology.orchestra.run.smithi144.stdout:___________ ERROR at setup of test_bucket_listv2_fetchowner_notempty ___________ 2024-06-04T16:22:30.218 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.218 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.218 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.218 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.218 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.218 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.218 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.218 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.218 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.219 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.219 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.219 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.219 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.219 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.219 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.219 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.219 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.219 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.219 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.219 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.219 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.220 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.220 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.220 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.220 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.220 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.220 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.220 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.220 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.220 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.220 INFO:teuthology.orchestra.run.smithi144.stdout:_________ ERROR at setup of test_bucket_listv2_fetchowner_defaultempty _________ 2024-06-04T16:22:30.220 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.221 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.221 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.221 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.221 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.221 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.221 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.221 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.221 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.221 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.221 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.221 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.221 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.221 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.221 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.221 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.222 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.222 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.222 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.222 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.222 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.222 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.222 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.222 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.222 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.222 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.222 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.222 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.223 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.223 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.223 INFO:teuthology.orchestra.run.smithi144.stdout:____________ ERROR at setup of test_bucket_listv2_fetchowner_empty _____________ 2024-06-04T16:22:30.223 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.223 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.223 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.223 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.223 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.223 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.223 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.223 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.234 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.234 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.234 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.234 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.235 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.235 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.235 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.235 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.235 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.235 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.235 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.235 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.235 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.235 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.235 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.235 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.235 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.235 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.235 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.236 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.236 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.236 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.236 INFO:teuthology.orchestra.run.smithi144.stdout:____________ ERROR at setup of test_bucket_list_delimiter_not_exist ____________ 2024-06-04T16:22:30.236 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.236 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.236 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.236 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.236 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.236 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.236 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.236 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.236 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.237 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.237 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.237 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.237 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.237 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.237 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.237 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.237 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.237 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.237 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.237 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.237 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.237 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.237 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.238 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.238 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.238 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.238 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.238 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.238 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.238 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.238 INFO:teuthology.orchestra.run.smithi144.stdout:___________ ERROR at setup of test_bucket_listv2_delimiter_not_exist ___________ 2024-06-04T16:22:30.238 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.238 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.238 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.238 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.239 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.239 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.239 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.239 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.239 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.239 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.239 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.239 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.239 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.239 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.239 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.239 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.239 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.240 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.240 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.240 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.240 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.240 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.240 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.240 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.240 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.240 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.240 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.240 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.240 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.240 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.240 INFO:teuthology.orchestra.run.smithi144.stdout:________ ERROR at setup of test_bucket_list_delimiter_not_skip_special _________ 2024-06-04T16:22:30.241 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.241 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.241 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.241 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.241 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.241 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.241 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.241 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.241 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.241 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.241 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.241 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.241 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.241 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.241 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.242 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.242 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.242 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.242 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.242 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.242 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.242 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.242 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.242 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.242 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.242 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.242 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.242 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.243 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.243 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.243 INFO:teuthology.orchestra.run.smithi144.stdout:_______________ ERROR at setup of test_bucket_list_prefix_basic ________________ 2024-06-04T16:22:30.243 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.243 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.243 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.243 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.243 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.243 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.243 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.243 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.243 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.243 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.244 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.244 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.244 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.244 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.244 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.244 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.244 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.244 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.244 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.244 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.244 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.244 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.244 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.244 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.245 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.245 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.245 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.245 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.245 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.245 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.245 INFO:teuthology.orchestra.run.smithi144.stdout:______________ ERROR at setup of test_bucket_listv2_prefix_basic _______________ 2024-06-04T16:22:30.245 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.245 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.245 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.245 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.245 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.245 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.245 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.245 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.246 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.246 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.246 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.246 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.246 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.246 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.246 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.246 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.246 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.246 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.246 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.246 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.246 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.247 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.247 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.247 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.247 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.247 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.247 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.247 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.247 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.247 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.247 INFO:teuthology.orchestra.run.smithi144.stdout:________________ ERROR at setup of test_bucket_list_prefix_alt _________________ 2024-06-04T16:22:30.247 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.247 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.247 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.248 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.248 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.248 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.248 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.248 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.248 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.248 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.248 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.248 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.248 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.248 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.248 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.248 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.248 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.249 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.249 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.249 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.249 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.249 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.249 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.249 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.249 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.249 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.249 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.249 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.249 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.249 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.250 INFO:teuthology.orchestra.run.smithi144.stdout:_______________ ERROR at setup of test_bucket_listv2_prefix_alt ________________ 2024-06-04T16:22:30.250 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.250 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.250 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.250 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.250 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.250 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.250 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.250 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.250 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.250 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.251 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.251 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.251 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.251 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.251 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.251 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.251 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.251 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.251 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.251 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.251 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.251 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.251 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.251 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.252 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.252 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.252 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.252 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.252 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.252 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.252 INFO:teuthology.orchestra.run.smithi144.stdout:_______________ ERROR at setup of test_bucket_list_prefix_empty ________________ 2024-06-04T16:22:30.252 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.252 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.252 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.252 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.252 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.252 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.252 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.252 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.253 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.253 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.253 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.253 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.253 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.253 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.253 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.253 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.253 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.253 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.253 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.253 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.253 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.253 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.253 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.254 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.254 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.254 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.254 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.254 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.254 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.254 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.254 INFO:teuthology.orchestra.run.smithi144.stdout:______________ ERROR at setup of test_bucket_listv2_prefix_empty _______________ 2024-06-04T16:22:30.254 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.254 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.254 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.254 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.254 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.254 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.255 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.255 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.255 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.255 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.255 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.255 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.255 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.255 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.255 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.255 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.255 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.255 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.255 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.255 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.255 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.256 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.256 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.256 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.256 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.256 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.256 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.256 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.256 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.256 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.256 INFO:teuthology.orchestra.run.smithi144.stdout:________________ ERROR at setup of test_bucket_list_prefix_none ________________ 2024-06-04T16:22:30.256 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.256 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.256 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.257 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.257 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.257 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.257 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.257 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.257 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.257 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.257 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.257 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.257 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.257 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.257 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.257 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.257 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.257 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.258 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.258 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.258 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.258 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.258 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.258 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.258 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.258 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.258 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.258 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.258 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.258 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.258 INFO:teuthology.orchestra.run.smithi144.stdout:_______________ ERROR at setup of test_bucket_listv2_prefix_none _______________ 2024-06-04T16:22:30.259 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.259 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.259 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.259 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.259 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.259 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.259 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.259 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.259 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.259 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.259 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.259 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.259 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.260 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.260 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.260 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.260 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.260 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.260 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.260 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.260 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.260 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.260 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.260 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.260 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.260 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.261 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.261 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.261 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.261 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.261 INFO:teuthology.orchestra.run.smithi144.stdout:_____________ ERROR at setup of test_bucket_list_prefix_not_exist ______________ 2024-06-04T16:22:30.261 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.261 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.261 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.261 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.261 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.261 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.261 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.261 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.261 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.262 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.262 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.262 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.262 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.262 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.262 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.262 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.262 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.262 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.262 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.262 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.262 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.262 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.263 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.263 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.263 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.263 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.263 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.263 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.263 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.263 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.263 INFO:teuthology.orchestra.run.smithi144.stdout:____________ ERROR at setup of test_bucket_listv2_prefix_not_exist _____________ 2024-06-04T16:22:30.263 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.263 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.263 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.263 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.263 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.264 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.264 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.264 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.264 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.264 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.264 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.264 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.264 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.264 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.264 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.264 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.264 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.264 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.264 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.265 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.265 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.265 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.265 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.265 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.265 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.265 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.265 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.265 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.265 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.265 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.265 INFO:teuthology.orchestra.run.smithi144.stdout:_____________ ERROR at setup of test_bucket_list_prefix_unreadable _____________ 2024-06-04T16:22:30.265 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.265 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.266 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.266 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.266 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.266 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.266 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.266 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.266 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.266 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.266 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.266 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.266 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.266 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.266 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.266 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.267 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.267 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.267 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.267 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.267 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.267 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.267 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.267 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.267 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.267 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.267 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.267 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.267 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.268 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.268 INFO:teuthology.orchestra.run.smithi144.stdout:____________ ERROR at setup of test_bucket_listv2_prefix_unreadable ____________ 2024-06-04T16:22:30.268 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.268 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.268 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.268 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.268 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.268 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.268 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.268 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.268 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.268 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.268 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.268 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.269 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.269 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.269 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.269 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.269 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.269 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.269 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.269 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.269 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.269 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.269 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.269 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.269 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.269 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.270 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.270 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.270 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.270 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.270 INFO:teuthology.orchestra.run.smithi144.stdout:__________ ERROR at setup of test_bucket_list_prefix_delimiter_basic ___________ 2024-06-04T16:22:30.270 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.270 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.270 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.270 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.270 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.270 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.270 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.271 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.271 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.271 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.271 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.271 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.271 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.271 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.271 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.271 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.271 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.271 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.271 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.271 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.271 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.272 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.272 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.272 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.272 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.272 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.272 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.272 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.272 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.272 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.272 INFO:teuthology.orchestra.run.smithi144.stdout:_________ ERROR at setup of test_bucket_listv2_prefix_delimiter_basic __________ 2024-06-04T16:22:30.272 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.272 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.273 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.273 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.273 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.273 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.273 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.273 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.273 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.273 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.273 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.273 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.273 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.273 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.273 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.273 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.274 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.274 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.274 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.274 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.274 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.274 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.274 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.274 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.274 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.274 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.274 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.274 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.275 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.275 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.275 INFO:teuthology.orchestra.run.smithi144.stdout:___________ ERROR at setup of test_bucket_list_prefix_delimiter_alt ____________ 2024-06-04T16:22:30.275 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.275 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.275 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.275 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.275 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.275 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.275 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.275 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.275 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.275 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.275 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.275 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.276 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.276 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.276 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.276 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.276 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.276 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.276 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.276 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.276 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.276 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.276 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.276 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.276 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.276 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.277 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.277 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.277 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.277 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.277 INFO:teuthology.orchestra.run.smithi144.stdout:__________ ERROR at setup of test_bucket_listv2_prefix_delimiter_alt ___________ 2024-06-04T16:22:30.277 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.277 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.277 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.277 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.277 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.277 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.277 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.277 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.277 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.278 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.278 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.278 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.278 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.278 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.278 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.278 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.278 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.278 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.278 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.278 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.278 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.278 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.279 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.279 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.279 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.279 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.279 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.279 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.279 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.279 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.279 INFO:teuthology.orchestra.run.smithi144.stdout:_____ ERROR at setup of test_bucket_list_prefix_delimiter_prefix_not_exist _____ 2024-06-04T16:22:30.279 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.279 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.279 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.279 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.279 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.280 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.280 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.280 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.280 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.280 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.280 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.280 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.280 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.280 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.280 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.280 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.280 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.281 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.281 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.281 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.281 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.281 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.281 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.281 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.281 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.281 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.281 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.281 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.281 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.281 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.281 INFO:teuthology.orchestra.run.smithi144.stdout:____ ERROR at setup of test_bucket_listv2_prefix_delimiter_prefix_not_exist ____ 2024-06-04T16:22:30.281 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.282 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.282 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.282 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.282 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.282 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.282 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.282 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.282 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.282 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.282 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.282 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.282 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.283 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.283 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.283 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.283 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.283 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.283 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.283 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.283 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.283 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.283 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.283 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.283 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.283 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.283 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.283 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.284 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.284 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.284 INFO:teuthology.orchestra.run.smithi144.stdout:___ ERROR at setup of test_bucket_list_prefix_delimiter_delimiter_not_exist ____ 2024-06-04T16:22:30.284 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.284 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.284 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.284 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.284 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.284 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.284 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.284 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.284 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.284 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.284 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.285 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.285 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.285 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.285 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.285 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.285 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.285 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.285 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.285 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.285 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.285 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.285 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.285 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.285 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.286 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.286 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.286 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.286 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.286 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.286 INFO:teuthology.orchestra.run.smithi144.stdout:__ ERROR at setup of test_bucket_listv2_prefix_delimiter_delimiter_not_exist ___ 2024-06-04T16:22:30.286 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.286 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.286 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.286 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.286 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.286 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.286 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.286 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.287 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.287 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.287 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.287 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.287 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.287 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.287 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.287 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.287 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.287 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.287 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.288 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.288 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.288 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.288 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.288 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.288 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.288 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.288 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.288 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.288 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.288 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.288 INFO:teuthology.orchestra.run.smithi144.stdout:_ ERROR at setup of test_bucket_list_prefix_delimiter_prefix_delimiter_not_exist _ 2024-06-04T16:22:30.289 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.289 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.289 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.289 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.289 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.289 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.289 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.289 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.289 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.289 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.289 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.289 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.289 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.289 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.289 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.290 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.290 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.290 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.290 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.290 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.290 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.290 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.290 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.290 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.290 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.290 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.291 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.291 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.291 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.291 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.291 INFO:teuthology.orchestra.run.smithi144.stdout:_ ERROR at setup of test_bucket_listv2_prefix_delimiter_prefix_delimiter_not_exist _ 2024-06-04T16:22:30.291 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.291 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.291 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.291 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.291 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.291 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.292 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.292 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.292 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.292 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.292 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.292 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.292 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.292 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.292 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.292 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.292 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.292 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.292 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.292 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.293 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.293 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.293 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.293 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.293 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.293 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.293 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.293 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.293 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.293 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.293 INFO:teuthology.orchestra.run.smithi144.stdout:________________ ERROR at setup of test_bucket_list_maxkeys_one ________________ 2024-06-04T16:22:30.293 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.294 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.294 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.294 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.294 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.294 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.294 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.294 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.294 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.294 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.294 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.294 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.294 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.294 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.295 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.295 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.295 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.295 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.295 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.295 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.295 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.295 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.295 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.295 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.295 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.295 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.295 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.295 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.295 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.296 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.296 INFO:teuthology.orchestra.run.smithi144.stdout:_______________ ERROR at setup of test_bucket_listv2_maxkeys_one _______________ 2024-06-04T16:22:30.296 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.296 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.296 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.296 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.296 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.296 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.296 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.296 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.296 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.296 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.296 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.297 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.297 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.297 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.297 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.297 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.297 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.297 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.297 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.297 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.297 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.297 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.297 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.297 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.297 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.298 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.298 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.298 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.298 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.298 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.298 INFO:teuthology.orchestra.run.smithi144.stdout:_______________ ERROR at setup of test_bucket_list_maxkeys_zero ________________ 2024-06-04T16:22:30.298 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.298 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.298 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.298 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.298 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.298 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.298 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.299 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.299 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.299 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.299 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.299 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.299 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.299 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.299 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.299 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.299 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.299 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.299 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.299 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.299 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.299 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.300 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.300 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.300 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.300 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.300 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.300 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.300 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.300 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.300 INFO:teuthology.orchestra.run.smithi144.stdout:______________ ERROR at setup of test_bucket_listv2_maxkeys_zero _______________ 2024-06-04T16:22:30.300 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.300 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.300 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.300 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.300 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.301 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.301 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.301 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.301 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.301 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.301 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.301 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.301 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.301 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.301 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.301 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.301 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.301 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.301 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.301 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.302 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.302 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.302 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.302 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.302 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.302 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.302 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.302 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.302 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.302 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.302 INFO:teuthology.orchestra.run.smithi144.stdout:_______________ ERROR at setup of test_bucket_list_maxkeys_none ________________ 2024-06-04T16:22:30.302 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.302 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.303 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.303 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.303 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.303 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.303 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.303 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.303 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.303 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.303 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.303 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.303 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.303 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.303 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.303 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.304 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.304 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.304 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.304 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.304 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.304 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.304 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.304 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.304 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.304 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.304 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.304 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.304 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.304 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.304 INFO:teuthology.orchestra.run.smithi144.stdout:______________ ERROR at setup of test_bucket_listv2_maxkeys_none _______________ 2024-06-04T16:22:30.305 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.305 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.305 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.305 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.305 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.305 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.305 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.305 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.305 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.305 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.305 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.305 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.305 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.305 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.306 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.306 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.306 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.306 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.306 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.306 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.306 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.306 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.306 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.306 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.306 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.306 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.306 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.306 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.307 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.307 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.307 INFO:teuthology.orchestra.run.smithi144.stdout:_____________________ ERROR at setup of test_account_usage _____________________ 2024-06-04T16:22:30.307 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.307 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.307 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.307 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.307 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.307 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.307 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.307 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.307 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.307 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.307 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.307 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.308 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.308 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.308 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.308 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.308 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.308 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.308 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.308 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.308 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.308 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.308 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.308 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.308 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.308 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.309 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.309 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.309 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.309 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.309 INFO:teuthology.orchestra.run.smithi144.stdout:___________________ ERROR at setup of test_head_bucket_usage ___________________ 2024-06-04T16:22:30.309 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.309 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.309 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.309 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.309 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.309 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.309 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.309 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.309 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.309 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.310 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.310 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.310 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.310 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.310 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.310 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.310 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.310 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.310 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.310 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.310 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.310 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.310 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.311 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.311 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.311 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.311 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.311 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.311 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.311 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.311 INFO:teuthology.orchestra.run.smithi144.stdout:_________________ ERROR at setup of test_bucket_list_unordered _________________ 2024-06-04T16:22:30.311 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.311 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.311 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.311 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.311 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.311 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.312 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.312 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.312 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.312 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.312 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.312 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.312 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.312 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.312 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.312 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.312 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.312 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.312 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.312 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.313 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.313 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.313 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.313 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.313 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.313 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.313 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.313 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.313 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.313 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.313 INFO:teuthology.orchestra.run.smithi144.stdout:________________ ERROR at setup of test_bucket_listv2_unordered ________________ 2024-06-04T16:22:30.313 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.313 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.313 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.314 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.314 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.314 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.314 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.314 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.314 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.314 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.314 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.314 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.314 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.314 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.314 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.314 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.314 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.315 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.315 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.315 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.315 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.315 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.315 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.315 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.315 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.315 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.315 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.315 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.315 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.315 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.315 INFO:teuthology.orchestra.run.smithi144.stdout:______________ ERROR at setup of test_bucket_list_maxkeys_invalid ______________ 2024-06-04T16:22:30.316 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.316 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.316 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.316 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.316 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.316 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.316 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.316 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.316 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.316 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.316 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.316 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.316 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.317 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.317 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.317 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.317 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.317 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.317 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.317 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.317 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.317 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.317 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.317 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.318 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.318 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.318 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.318 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.318 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.318 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.318 INFO:teuthology.orchestra.run.smithi144.stdout:________________ ERROR at setup of test_bucket_list_marker_none ________________ 2024-06-04T16:22:30.318 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.318 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.318 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.318 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.318 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.319 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.319 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.319 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.319 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.319 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.319 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.319 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.319 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.320 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.320 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.320 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.320 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.320 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.320 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.320 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.320 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.320 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.320 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.320 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.321 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.321 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.321 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.321 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.321 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.321 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.321 INFO:teuthology.orchestra.run.smithi144.stdout:_______________ ERROR at setup of test_bucket_list_marker_empty ________________ 2024-06-04T16:22:30.321 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.321 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.321 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.321 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.321 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.322 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.322 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.322 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.322 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.322 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.322 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.322 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.322 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.322 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.322 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.322 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.323 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.323 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.323 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.323 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.323 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.323 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.323 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.323 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.323 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.323 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.323 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.323 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.324 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.324 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.324 INFO:teuthology.orchestra.run.smithi144.stdout:_________ ERROR at setup of test_bucket_listv2_continuationtoken_empty _________ 2024-06-04T16:22:30.324 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.324 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.324 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.324 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.324 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.324 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.324 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.324 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.324 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.325 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.325 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.325 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.325 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.325 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.325 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.325 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.325 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.325 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.325 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.325 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.326 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.326 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.326 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.326 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.326 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.326 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.326 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.326 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.326 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.326 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.326 INFO:teuthology.orchestra.run.smithi144.stdout:____________ ERROR at setup of test_bucket_listv2_continuationtoken ____________ 2024-06-04T16:22:30.326 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.326 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.327 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.327 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.327 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.327 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.327 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.327 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.327 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.327 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.327 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.327 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.327 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.327 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.327 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.328 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.328 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.328 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.328 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.328 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.328 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.328 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.328 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.328 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.328 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.328 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.328 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.328 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.329 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.329 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.329 INFO:teuthology.orchestra.run.smithi144.stdout:____ ERROR at setup of test_bucket_listv2_both_continuationtoken_startafter ____ 2024-06-04T16:22:30.329 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.329 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.329 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.329 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.329 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.329 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.329 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.329 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.329 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.329 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.330 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.330 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.330 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.330 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.330 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.330 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.330 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.330 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.330 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.330 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.330 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.330 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.330 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.331 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.331 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.331 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.331 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.331 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.331 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.331 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.331 INFO:teuthology.orchestra.run.smithi144.stdout:_____________ ERROR at setup of test_bucket_list_marker_unreadable _____________ 2024-06-04T16:22:30.331 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.331 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.331 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.331 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.331 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.331 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.331 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.332 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.332 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.332 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.332 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.332 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.332 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.332 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.332 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.332 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.332 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.332 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.333 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.333 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.333 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.333 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.333 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.333 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.333 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.333 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.333 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.333 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.333 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.333 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.333 INFO:teuthology.orchestra.run.smithi144.stdout:__________ ERROR at setup of test_bucket_listv2_startafter_unreadable __________ 2024-06-04T16:22:30.333 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.333 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.334 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.334 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.334 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.334 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.334 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.334 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.334 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.334 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.334 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.334 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.334 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.334 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.334 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.335 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.335 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.335 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.335 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.335 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.335 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.335 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.335 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.335 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.335 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.335 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.335 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.335 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.335 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.335 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.336 INFO:teuthology.orchestra.run.smithi144.stdout:____________ ERROR at setup of test_bucket_list_marker_not_in_list _____________ 2024-06-04T16:22:30.336 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.336 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.336 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.336 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.336 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.336 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.336 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.336 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.336 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.336 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.336 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.336 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.336 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.336 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.337 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.337 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.337 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.337 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.337 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.337 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.337 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.337 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.337 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.337 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.337 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.337 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.337 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.337 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.337 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.338 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.338 INFO:teuthology.orchestra.run.smithi144.stdout:_________ ERROR at setup of test_bucket_listv2_startafter_not_in_list __________ 2024-06-04T16:22:30.338 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.338 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.338 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.338 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.338 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.338 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.338 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.338 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.338 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.338 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.338 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.339 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.339 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.339 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.339 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.339 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.339 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.339 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.339 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.339 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.339 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.339 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.339 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.339 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.339 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.340 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.340 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.340 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.340 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.340 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.340 INFO:teuthology.orchestra.run.smithi144.stdout:_____________ ERROR at setup of test_bucket_list_marker_after_list _____________ 2024-06-04T16:22:30.340 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.340 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.340 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.340 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.340 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.340 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.340 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.340 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.340 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.341 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.341 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.341 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.341 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.341 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.341 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.341 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.341 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.341 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.341 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.341 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.341 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.341 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.341 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.341 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.342 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.342 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.342 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.342 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.342 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.342 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.342 INFO:teuthology.orchestra.run.smithi144.stdout:__________ ERROR at setup of test_bucket_listv2_startafter_after_list __________ 2024-06-04T16:22:30.342 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.342 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.342 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.342 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.342 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.342 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.343 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.343 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.343 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.343 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.343 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.343 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.343 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.343 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.343 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.343 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.343 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.343 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.343 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.343 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.344 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.344 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.344 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.344 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.344 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.344 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.344 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.344 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.344 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.344 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.344 INFO:teuthology.orchestra.run.smithi144.stdout:________________ ERROR at setup of test_bucket_list_return_data ________________ 2024-06-04T16:22:30.344 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.345 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.345 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.345 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.345 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.345 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.345 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.345 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.345 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.345 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.345 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.345 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.346 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.346 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.346 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.346 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.346 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.346 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.346 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.346 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.346 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.346 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.346 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.347 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.347 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.347 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.347 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.347 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.347 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.347 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.347 INFO:teuthology.orchestra.run.smithi144.stdout:__________ ERROR at setup of test_bucket_list_return_data_versioning ___________ 2024-06-04T16:22:30.347 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.347 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.347 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.347 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.348 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.348 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.348 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.348 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.348 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.348 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.348 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.348 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.348 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.348 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.348 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.348 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.349 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.349 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.349 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.349 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.349 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.349 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.349 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.349 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.349 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.349 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.349 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.349 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.350 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.350 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.350 INFO:teuthology.orchestra.run.smithi144.stdout:_____________ ERROR at setup of test_bucket_list_objects_anonymous _____________ 2024-06-04T16:22:30.350 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.350 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.350 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.350 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.350 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.350 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.350 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.350 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.350 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.351 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.351 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.351 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.351 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.351 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.351 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.351 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.351 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.351 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.351 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.351 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.351 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.352 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.352 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.352 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.352 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.352 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.352 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.352 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.352 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.352 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.352 INFO:teuthology.orchestra.run.smithi144.stdout:____________ ERROR at setup of test_bucket_listv2_objects_anonymous ____________ 2024-06-04T16:22:30.352 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.352 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.352 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.353 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.353 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.353 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.353 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.353 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.353 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.353 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.353 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.353 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.353 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.353 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.354 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.354 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.354 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.354 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.354 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.354 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.354 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.354 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.354 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.354 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.354 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.354 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.354 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.355 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.355 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.355 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.355 INFO:teuthology.orchestra.run.smithi144.stdout:__________ ERROR at setup of test_bucket_list_objects_anonymous_fail ___________ 2024-06-04T16:22:30.355 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.355 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.355 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.355 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.355 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.355 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.355 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.355 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.355 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.355 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.355 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.356 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.356 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.356 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.356 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.356 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.356 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.356 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.356 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.356 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.356 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.356 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.356 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.356 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.356 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.357 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.357 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.357 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.357 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.357 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.357 INFO:teuthology.orchestra.run.smithi144.stdout:_________ ERROR at setup of test_bucket_listv2_objects_anonymous_fail __________ 2024-06-04T16:22:30.357 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.357 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.357 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.357 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.357 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.357 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.357 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.357 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.358 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.358 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.358 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.358 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.358 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.358 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.358 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.358 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.358 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.358 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.358 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.358 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.358 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.358 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.359 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.359 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.359 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.359 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.359 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.359 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.359 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.359 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.359 INFO:teuthology.orchestra.run.smithi144.stdout:____________________ ERROR at setup of test_bucket_notexist ____________________ 2024-06-04T16:22:30.359 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.359 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.359 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.359 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.359 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.359 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.360 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.360 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.360 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.360 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.360 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.360 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.360 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.360 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.360 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.360 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.360 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.361 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.361 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.361 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.361 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.361 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.361 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.361 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.361 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.361 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.361 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.361 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.361 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.361 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.361 INFO:teuthology.orchestra.run.smithi144.stdout:___________________ ERROR at setup of test_bucketv2_notexist ___________________ 2024-06-04T16:22:30.362 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.362 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.362 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.362 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.362 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.362 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.362 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.362 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.362 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.362 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.362 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.362 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.363 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.363 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.363 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.363 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.363 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.363 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.363 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.363 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.363 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.363 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.363 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.363 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.363 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.363 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.363 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.364 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.364 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.364 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.364 INFO:teuthology.orchestra.run.smithi144.stdout:________________ ERROR at setup of test_bucket_delete_notexist _________________ 2024-06-04T16:22:30.364 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.364 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.364 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.364 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.364 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.364 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.364 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.364 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.364 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.364 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.364 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.365 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.365 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.365 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.365 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.365 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.365 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.365 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.365 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.365 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.365 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.365 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.365 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.365 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.365 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.365 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.366 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.366 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.366 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.366 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.366 INFO:teuthology.orchestra.run.smithi144.stdout:________________ ERROR at setup of test_bucket_delete_nonempty _________________ 2024-06-04T16:22:30.366 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.366 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.366 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.366 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.366 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.366 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.366 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.366 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.367 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.367 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.367 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.367 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.367 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.367 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.367 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.367 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.367 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.367 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.367 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.367 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.367 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.368 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.368 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.368 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.368 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.368 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.368 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.368 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.368 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.368 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.368 INFO:teuthology.orchestra.run.smithi144.stdout:___________ ERROR at setup of test_bucket_concurrent_set_canned_acl ____________ 2024-06-04T16:22:30.368 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.368 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.368 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.368 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.369 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.369 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.369 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.369 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.369 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.369 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.369 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.369 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.369 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.369 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.369 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.369 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.369 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.369 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.369 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.370 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.370 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.370 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.370 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.370 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.370 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.370 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.370 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.370 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.370 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.370 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.370 INFO:teuthology.orchestra.run.smithi144.stdout:____________ ERROR at setup of test_object_write_to_nonexist_bucket ____________ 2024-06-04T16:22:30.370 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.371 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.371 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.371 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.371 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.371 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.371 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.371 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.371 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.371 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.371 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.371 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.371 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.371 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.372 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.372 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.372 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.372 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.372 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.372 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.372 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.372 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.372 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.372 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.372 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.372 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.372 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.373 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.373 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.373 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.373 INFO:teuthology.orchestra.run.smithi144.stdout:______ ERROR at setup of test_object_write_with_chunked_transfer_encoding ______ 2024-06-04T16:22:30.373 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.373 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.373 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.373 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.373 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.373 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.373 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.373 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.373 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.373 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.374 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.374 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.374 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.374 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.374 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.374 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.374 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.374 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.374 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.374 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.374 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.374 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.374 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.375 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.375 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.375 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.375 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.375 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.375 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.375 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.375 INFO:teuthology.orchestra.run.smithi144.stdout:_________________ ERROR at setup of test_bucket_create_delete __________________ 2024-06-04T16:22:30.375 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.375 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.375 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.375 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.376 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.376 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.376 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.376 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.376 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.376 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.376 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.376 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.376 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.376 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.376 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.376 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.376 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.376 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.377 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.377 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.377 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.377 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.377 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.377 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.377 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.377 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.377 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.377 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.377 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.377 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.378 INFO:teuthology.orchestra.run.smithi144.stdout:_________________ ERROR at setup of test_object_read_not_exist _________________ 2024-06-04T16:22:30.378 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.378 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.378 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.378 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.378 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.378 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.378 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.378 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.378 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.378 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.378 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.378 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.379 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.379 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.379 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.379 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.379 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.379 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.379 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.379 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.379 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.379 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.379 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.379 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.380 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.380 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.380 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.380 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.380 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.380 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.380 INFO:teuthology.orchestra.run.smithi144.stdout:_______ ERROR at setup of test_object_requestid_matches_header_on_error ________ 2024-06-04T16:22:30.380 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.380 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.380 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.380 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.381 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.381 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.381 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.381 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.381 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.381 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.381 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.381 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.381 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.381 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.381 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.382 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.382 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.382 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.382 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.382 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.382 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.382 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.382 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.382 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.383 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.383 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.383 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.383 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.383 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.383 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.383 INFO:teuthology.orchestra.run.smithi144.stdout:_______ ERROR at setup of test_versioning_concurrent_multi_object_delete _______ 2024-06-04T16:22:30.383 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.383 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.383 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.383 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.383 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.383 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.384 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.384 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.384 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.384 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.384 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.384 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.384 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.384 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.384 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.384 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.384 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.384 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.384 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.384 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.385 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.385 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.385 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.385 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.385 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.385 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.385 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.385 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.385 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.385 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.385 INFO:teuthology.orchestra.run.smithi144.stdout:__________________ ERROR at setup of test_multi_object_delete __________________ 2024-06-04T16:22:30.385 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.386 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.386 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.386 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.386 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.386 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.386 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.386 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.386 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.386 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.386 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.386 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.386 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.387 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.387 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.387 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.387 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.387 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.387 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.387 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.387 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.387 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.387 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.387 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.387 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.387 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.388 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.388 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.388 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.388 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.388 INFO:teuthology.orchestra.run.smithi144.stdout:_________________ ERROR at setup of test_multi_objectv2_delete _________________ 2024-06-04T16:22:30.388 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.388 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.388 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.388 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.388 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.388 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.388 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.389 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.389 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.389 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.389 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.389 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.389 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.389 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.389 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.389 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.389 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.389 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.389 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.389 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.390 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.390 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.390 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.390 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.390 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.390 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.390 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.390 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.390 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.390 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.390 INFO:teuthology.orchestra.run.smithi144.stdout:_____________ ERROR at setup of test_multi_object_delete_key_limit _____________ 2024-06-04T16:22:30.390 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.390 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.391 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.391 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.391 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.391 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.391 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.391 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.391 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.391 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.391 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.391 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.391 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.391 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.391 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.392 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.392 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.392 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.392 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.392 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.392 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.392 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.392 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.392 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.392 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.392 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.392 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.393 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.393 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.393 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.393 INFO:teuthology.orchestra.run.smithi144.stdout:____________ ERROR at setup of test_multi_objectv2_delete_key_limit ____________ 2024-06-04T16:22:30.393 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.393 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.393 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.393 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.393 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.393 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.393 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.393 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.393 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.394 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.394 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.394 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.394 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.394 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.394 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.394 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.394 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.394 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.394 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.394 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.394 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.395 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.395 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.395 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.395 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.395 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.395 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.395 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.395 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.395 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.395 INFO:teuthology.orchestra.run.smithi144.stdout:________________ ERROR at setup of test_object_head_zero_bytes _________________ 2024-06-04T16:22:30.395 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.395 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.395 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.395 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.396 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.396 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.396 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.396 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.396 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.396 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.396 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.396 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.396 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.396 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.396 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.396 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.396 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.396 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.397 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.397 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.397 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.397 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.397 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.397 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.397 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.397 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.397 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.397 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.397 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.397 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.397 INFO:teuthology.orchestra.run.smithi144.stdout:________________ ERROR at setup of test_object_write_check_etag ________________ 2024-06-04T16:22:30.397 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.398 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.398 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.398 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.398 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.398 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.398 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.398 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.398 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.398 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.398 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.398 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.398 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.398 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.399 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.399 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.399 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.399 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.399 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.399 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.399 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.399 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.399 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.399 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.399 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.399 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.399 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.400 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.400 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.400 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.400 INFO:teuthology.orchestra.run.smithi144.stdout:______________ ERROR at setup of test_object_write_cache_control _______________ 2024-06-04T16:22:30.400 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.400 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.400 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.400 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.400 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.400 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.400 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.400 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.400 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.401 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.401 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.401 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.401 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.401 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.401 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.401 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.401 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.401 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.401 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.401 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.401 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.401 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.401 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.402 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.402 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.402 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.402 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.402 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.402 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.402 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.402 INFO:teuthology.orchestra.run.smithi144.stdout:_________________ ERROR at setup of test_object_write_expires __________________ 2024-06-04T16:22:30.402 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.402 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.402 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.403 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.403 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.403 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.403 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.403 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.403 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.403 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.403 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.403 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.403 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.403 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.403 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.403 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.404 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.404 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.404 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.404 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.404 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.404 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.404 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.404 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.404 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.404 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.404 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.404 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.404 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.404 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.404 INFO:teuthology.orchestra.run.smithi144.stdout:_________ ERROR at setup of test_object_write_read_update_read_delete __________ 2024-06-04T16:22:30.404 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.405 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.405 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.405 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.405 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.405 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.405 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.405 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.405 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.405 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.405 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.405 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.405 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.405 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.405 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.406 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.406 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.406 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.406 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.406 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.406 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.406 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.406 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.406 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.406 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.406 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.406 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.406 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.407 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.407 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.407 INFO:teuthology.orchestra.run.smithi144.stdout:_________ ERROR at setup of test_object_set_get_metadata_none_to_good __________ 2024-06-04T16:22:30.407 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.407 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.407 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.407 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.407 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.407 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.407 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.407 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.407 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.408 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.408 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.408 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.408 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.408 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.408 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.408 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.408 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.408 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.408 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.408 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.408 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.409 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.409 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.409 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.409 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.409 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.409 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.409 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.409 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.409 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.409 INFO:teuthology.orchestra.run.smithi144.stdout:_________ ERROR at setup of test_object_set_get_metadata_none_to_empty _________ 2024-06-04T16:22:30.409 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.409 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.409 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.409 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.410 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.410 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.410 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.410 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.410 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.410 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.410 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.410 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.410 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.410 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.410 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.410 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.411 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.411 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.411 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.411 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.411 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.411 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.411 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.411 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.411 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.411 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.411 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.411 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.412 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.412 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.412 INFO:teuthology.orchestra.run.smithi144.stdout:______ ERROR at setup of test_object_set_get_metadata_overwrite_to_empty _______ 2024-06-04T16:22:30.412 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.412 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.412 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.412 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.412 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.412 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.412 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.412 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.412 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.412 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.413 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.413 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.413 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.413 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.413 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.413 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.413 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.413 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.413 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.413 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.413 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.413 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.413 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.413 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.414 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.414 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.414 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.414 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.414 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.414 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.414 INFO:teuthology.orchestra.run.smithi144.stdout:____________ ERROR at setup of test_object_metadata_replaced_on_put ____________ 2024-06-04T16:22:30.414 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.414 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.414 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.414 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.414 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.415 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.415 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.415 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.415 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.415 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.415 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.415 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.415 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.415 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.415 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.415 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.415 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.415 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.415 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.416 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.416 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.416 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.417 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.417 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.417 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.418 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.418 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.418 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.418 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.418 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.418 INFO:teuthology.orchestra.run.smithi144.stdout:___________________ ERROR at setup of test_object_write_file ___________________ 2024-06-04T16:22:30.418 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.418 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.418 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.418 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.418 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.418 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.419 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.419 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.419 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.419 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.419 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.419 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.419 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.419 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.419 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.419 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.419 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.419 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.419 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.419 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.419 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.420 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.420 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.420 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.420 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.420 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.420 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.420 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.420 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.420 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.420 INFO:teuthology.orchestra.run.smithi144.stdout:_____________ ERROR at setup of test_post_object_anonymous_request _____________ 2024-06-04T16:22:30.420 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.420 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.420 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.421 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.421 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.421 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.421 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.421 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.421 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.421 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.421 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.421 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.421 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.421 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.421 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.421 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.422 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.422 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.422 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.422 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.422 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.422 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.422 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.422 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.422 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.422 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.422 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.422 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.423 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.423 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.423 INFO:teuthology.orchestra.run.smithi144.stdout:___________ ERROR at setup of test_post_object_authenticated_request ___________ 2024-06-04T16:22:30.423 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.423 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.423 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.423 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.423 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.423 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.423 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.423 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.423 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.423 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.423 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.424 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.424 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.424 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.424 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.424 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.424 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.424 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.424 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.424 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.424 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.424 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.424 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.424 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.424 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.424 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.425 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.425 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.425 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.425 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.425 INFO:teuthology.orchestra.run.smithi144.stdout:_______ ERROR at setup of test_post_object_authenticated_no_content_type _______ 2024-06-04T16:22:30.425 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.425 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.425 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.425 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.425 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.425 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.425 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.425 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.426 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.426 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.426 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.426 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.426 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.426 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.426 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.426 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.426 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.426 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.426 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.426 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.427 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.427 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.427 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.427 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.427 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.427 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.427 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.427 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.427 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.427 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.427 INFO:teuthology.orchestra.run.smithi144.stdout:___ ERROR at setup of test_post_object_authenticated_request_bad_access_key ____ 2024-06-04T16:22:30.427 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.427 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.427 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.428 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.428 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.428 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.428 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.428 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.428 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.428 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.428 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.428 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.428 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.428 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.428 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.428 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.428 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.428 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.429 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.429 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.429 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.429 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.429 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.429 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.429 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.429 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.429 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.429 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.429 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.429 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.429 INFO:teuthology.orchestra.run.smithi144.stdout:_____________ ERROR at setup of test_post_object_set_success_code ______________ 2024-06-04T16:22:30.429 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.429 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.430 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.430 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.430 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.430 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.430 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.430 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.430 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.430 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.430 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.430 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.430 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.431 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.431 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.431 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.431 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.431 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.431 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.431 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.431 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.431 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.431 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.431 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.431 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.431 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.432 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.432 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.432 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.432 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.432 INFO:teuthology.orchestra.run.smithi144.stdout:_________ ERROR at setup of test_post_object_set_invalid_success_code __________ 2024-06-04T16:22:30.432 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.432 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.432 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.432 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.432 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.432 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.432 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.432 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.433 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.433 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.433 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.433 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.433 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.433 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.433 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.433 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.433 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.433 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.433 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.433 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.433 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.434 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.434 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.434 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.434 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.434 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.434 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.434 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.434 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.434 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.434 INFO:teuthology.orchestra.run.smithi144.stdout:_________ ERROR at setup of test_post_object_upload_larger_than_chunk __________ 2024-06-04T16:22:30.434 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.434 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.434 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.435 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.435 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.435 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.435 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.435 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.435 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.435 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.435 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.435 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.435 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.435 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.435 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.436 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.436 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.436 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.436 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.436 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.436 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.436 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.436 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.436 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.436 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.436 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.436 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.436 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.437 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.437 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.437 INFO:teuthology.orchestra.run.smithi144.stdout:___________ ERROR at setup of test_post_object_set_key_from_filename ___________ 2024-06-04T16:22:30.437 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.437 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.437 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.437 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.437 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.437 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.437 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.437 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.437 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.437 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.438 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.438 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.438 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.438 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.438 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.438 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.438 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.438 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.438 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.438 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.438 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.439 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.439 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.439 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.439 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.439 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.439 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.439 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.439 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.439 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.439 INFO:teuthology.orchestra.run.smithi144.stdout:______________ ERROR at setup of test_post_object_ignored_header _______________ 2024-06-04T16:22:30.439 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.439 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.439 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.440 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.440 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.440 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.440 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.440 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.440 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.440 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.440 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.440 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.440 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.440 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.440 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.440 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.440 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.440 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.441 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.441 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.441 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.441 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.441 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.441 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.441 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.441 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.441 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.441 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.441 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.441 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.442 INFO:teuthology.orchestra.run.smithi144.stdout:_____ ERROR at setup of test_post_object_case_insensitive_condition_fields _____ 2024-06-04T16:22:30.442 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.442 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.442 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.442 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.442 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.442 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.442 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.442 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.442 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.442 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.442 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.442 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.443 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.443 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.443 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.443 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.443 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.443 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.443 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.443 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.443 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.443 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.443 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.443 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.443 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.444 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.444 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.444 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.444 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.444 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.444 INFO:teuthology.orchestra.run.smithi144.stdout:___________ ERROR at setup of test_post_object_escaped_field_values ____________ 2024-06-04T16:22:30.444 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.444 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.444 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.444 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.444 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.444 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.444 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.444 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.444 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.445 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.445 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.445 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.445 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.445 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.445 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.445 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.445 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.445 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.445 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.445 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.445 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.445 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.445 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.446 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.446 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.446 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.446 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.446 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.446 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.446 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.446 INFO:teuthology.orchestra.run.smithi144.stdout:__________ ERROR at setup of test_post_object_success_redirect_action __________ 2024-06-04T16:22:30.446 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.446 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.446 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.446 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.446 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.446 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.447 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.447 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.447 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.447 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.447 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.447 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.447 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.447 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.447 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.447 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.447 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.447 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.447 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.447 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.447 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.448 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.448 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.448 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.448 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.448 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.448 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.448 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.448 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.448 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.448 INFO:teuthology.orchestra.run.smithi144.stdout:_____________ ERROR at setup of test_post_object_invalid_signature _____________ 2024-06-04T16:22:30.448 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.448 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.448 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.448 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.449 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.449 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.449 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.449 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.449 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.449 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.449 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.449 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.449 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.449 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.449 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.449 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.449 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.449 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.450 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.450 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.450 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.450 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.450 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.450 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.450 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.450 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.450 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.450 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.450 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.450 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.451 INFO:teuthology.orchestra.run.smithi144.stdout:____________ ERROR at setup of test_post_object_invalid_access_key _____________ 2024-06-04T16:22:30.451 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.451 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.451 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.451 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.451 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.451 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.451 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.451 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.451 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.451 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.451 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.451 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.451 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.451 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.452 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.452 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.452 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.452 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.452 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.452 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.452 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.452 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.452 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.452 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.452 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.452 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.452 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.452 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.453 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.453 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.453 INFO:teuthology.orchestra.run.smithi144.stdout:____________ ERROR at setup of test_post_object_invalid_date_format ____________ 2024-06-04T16:22:30.453 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.453 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.453 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.453 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.453 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.453 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.453 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.453 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.453 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.453 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.453 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.454 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.454 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.454 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.454 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.454 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.454 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.454 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.454 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.454 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.454 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.454 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.455 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.455 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.455 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.455 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.455 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.455 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.455 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.455 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.455 INFO:teuthology.orchestra.run.smithi144.stdout:_____________ ERROR at setup of test_post_object_no_key_specified ______________ 2024-06-04T16:22:30.455 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.455 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.455 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.455 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.455 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.456 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.456 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.456 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.456 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.456 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.456 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.456 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.456 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.456 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.456 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.456 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.456 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.456 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.457 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.457 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.457 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.457 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.457 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.457 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.457 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.457 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.457 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.457 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.457 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.457 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.457 INFO:teuthology.orchestra.run.smithi144.stdout:_____________ ERROR at setup of test_post_object_missing_signature _____________ 2024-06-04T16:22:30.458 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.458 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.458 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.458 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.458 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.458 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.458 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.458 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.458 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.458 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.458 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.458 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.459 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.459 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.459 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.459 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.459 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.459 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.459 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.459 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.459 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.459 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.459 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.459 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.460 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.460 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.460 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.460 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.460 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.460 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.460 INFO:teuthology.orchestra.run.smithi144.stdout:_________ ERROR at setup of test_post_object_missing_policy_condition __________ 2024-06-04T16:22:30.460 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.460 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.460 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.460 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.461 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.461 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.461 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.461 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.461 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.461 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.461 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.461 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.461 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.461 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.462 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.462 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.462 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.462 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.462 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.462 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.462 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.462 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.462 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.462 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.463 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.463 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.463 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.463 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.463 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.463 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.463 INFO:teuthology.orchestra.run.smithi144.stdout:___________ ERROR at setup of test_post_object_user_specified_header ___________ 2024-06-04T16:22:30.463 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.463 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.463 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.463 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.464 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.464 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.464 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.464 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.464 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.464 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.464 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.464 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.464 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.464 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.465 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.465 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.465 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.465 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.465 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.465 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.465 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.465 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.465 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.465 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.465 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.465 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.465 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.466 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.466 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.466 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.466 INFO:teuthology.orchestra.run.smithi144.stdout:__ ERROR at setup of test_post_object_request_missing_policy_specified_field ___ 2024-06-04T16:22:30.466 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.466 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.466 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.466 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.466 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.467 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.467 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.467 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.467 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.467 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.467 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.467 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.467 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.467 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.467 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.467 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.467 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.468 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.468 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.468 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.468 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.468 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.468 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.468 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.468 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.468 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.468 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.468 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.469 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.469 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.469 INFO:teuthology.orchestra.run.smithi144.stdout:________ ERROR at setup of test_post_object_condition_is_case_sensitive ________ 2024-06-04T16:22:30.469 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.469 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.469 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.469 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.469 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.469 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.469 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.469 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.469 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.469 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.469 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.469 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.470 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.470 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.470 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.470 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.470 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.470 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.470 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.470 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.470 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.470 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.470 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.470 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.471 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.471 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.471 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.471 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.471 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.471 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.471 INFO:teuthology.orchestra.run.smithi144.stdout:_________ ERROR at setup of test_post_object_expires_is_case_sensitive _________ 2024-06-04T16:22:30.471 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.471 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.471 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.471 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.471 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.471 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.471 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.471 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.472 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.472 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.472 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.472 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.472 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.472 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.472 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.472 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.472 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.472 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.472 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.472 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.472 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.473 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.473 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.473 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.473 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.473 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.473 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.473 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.473 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.473 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.473 INFO:teuthology.orchestra.run.smithi144.stdout:______________ ERROR at setup of test_post_object_expired_policy _______________ 2024-06-04T16:22:30.473 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.473 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.473 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.473 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.473 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.474 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.474 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.474 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.474 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.474 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.474 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.474 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.474 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.474 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.474 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.474 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.474 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.475 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.475 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.475 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.475 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.475 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.475 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.475 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.475 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.475 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.475 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.475 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.475 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.475 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.475 INFO:teuthology.orchestra.run.smithi144.stdout:_______________ ERROR at setup of test_post_object_wrong_bucket ________________ 2024-06-04T16:22:30.476 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.476 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.476 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.476 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.476 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.476 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.476 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.476 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.476 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.476 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.476 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.476 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.476 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.476 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.477 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.477 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.477 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.477 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.477 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.477 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.477 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.477 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.477 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.477 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.477 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.477 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.477 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.477 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.477 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.478 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.478 INFO:teuthology.orchestra.run.smithi144.stdout:________ ERROR at setup of test_post_object_invalid_request_field_value ________ 2024-06-04T16:22:30.478 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.478 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.478 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.478 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.478 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.478 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.478 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.478 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.478 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.478 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.478 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.478 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.479 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.479 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.479 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.479 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.479 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.479 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.479 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.479 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.479 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.479 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.479 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.479 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.479 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.479 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.480 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.480 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.480 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.480 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.480 INFO:teuthology.orchestra.run.smithi144.stdout:_________ ERROR at setup of test_post_object_missing_expires_condition _________ 2024-06-04T16:22:30.480 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.480 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.480 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.480 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.480 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.480 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.480 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.480 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.480 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.480 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.481 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.481 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.481 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.481 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.481 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.481 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.481 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.481 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.481 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.481 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.481 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.481 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.481 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.481 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.482 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.482 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.482 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.482 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.482 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.482 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.482 INFO:teuthology.orchestra.run.smithi144.stdout:__________ ERROR at setup of test_post_object_missing_conditions_list __________ 2024-06-04T16:22:30.482 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.482 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.482 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.482 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.482 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.483 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.483 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.483 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.483 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.483 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.483 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.483 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.483 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.483 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.483 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.483 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.483 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.483 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.483 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.483 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.483 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.484 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.484 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.484 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.484 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.484 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.484 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.484 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.484 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.484 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.484 INFO:teuthology.orchestra.run.smithi144.stdout:________ ERROR at setup of test_post_object_upload_size_limit_exceeded _________ 2024-06-04T16:22:30.484 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.484 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.485 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.485 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.485 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.485 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.485 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.485 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.485 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.485 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.485 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.485 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.485 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.485 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.486 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.486 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.486 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.486 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.486 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.486 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.486 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.486 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.486 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.486 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.486 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.486 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.486 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.487 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.487 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.487 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.487 INFO:teuthology.orchestra.run.smithi144.stdout:______ ERROR at setup of test_post_object_missing_content_length_argument ______ 2024-06-04T16:22:30.487 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.487 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.487 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.487 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.487 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.487 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.487 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.487 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.488 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.488 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.488 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.488 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.488 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.488 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.488 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.488 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.488 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.488 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.488 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.488 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.488 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.489 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.489 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.489 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.489 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.489 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.489 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.489 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.489 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.489 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.489 INFO:teuthology.orchestra.run.smithi144.stdout:______ ERROR at setup of test_post_object_invalid_content_length_argument ______ 2024-06-04T16:22:30.489 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.489 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.489 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.489 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.490 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.490 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.490 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.490 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.490 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.490 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.490 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.490 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.490 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.490 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.490 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.490 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.491 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.491 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.491 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.491 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.491 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.491 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.491 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.491 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.491 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.491 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.491 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.491 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.491 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.492 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.492 INFO:teuthology.orchestra.run.smithi144.stdout:_________ ERROR at setup of test_post_object_upload_size_below_minimum _________ 2024-06-04T16:22:30.492 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.492 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.492 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.492 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.492 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.492 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.492 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.492 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.493 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.493 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.493 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.493 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.493 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.493 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.493 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.493 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.493 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.493 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.493 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.493 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.494 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.494 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.494 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.494 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.494 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.494 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.494 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.494 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.494 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.494 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.494 INFO:teuthology.orchestra.run.smithi144.stdout:______ ERROR at setup of test_post_object_upload_size_rgw_chunk_size_bug _______ 2024-06-04T16:22:30.494 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.494 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.494 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.495 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.495 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.495 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.495 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.495 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.495 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.495 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.495 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.495 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.495 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.495 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.495 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.495 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.495 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.496 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.496 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.496 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.496 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.496 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.496 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.496 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.496 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.496 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.496 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.496 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.496 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.496 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.497 INFO:teuthology.orchestra.run.smithi144.stdout:_____________ ERROR at setup of test_post_object_empty_conditions ______________ 2024-06-04T16:22:30.497 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.497 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.497 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.497 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.497 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.497 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.497 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.497 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.497 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.497 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.497 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.497 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.498 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.498 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.498 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.498 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.498 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.498 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.498 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.498 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.498 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.498 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.498 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.499 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.499 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.499 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.499 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.499 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.499 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.499 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.499 INFO:teuthology.orchestra.run.smithi144.stdout:________________ ERROR at setup of test_get_object_ifmatch_good ________________ 2024-06-04T16:22:30.499 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.499 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.499 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.499 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.499 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.499 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.500 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.500 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.500 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.500 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.500 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.500 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.500 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.500 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.500 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.500 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.500 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.500 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.500 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.500 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.501 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.501 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.501 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.501 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.501 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.501 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.501 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.501 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.501 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.501 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.501 INFO:teuthology.orchestra.run.smithi144.stdout:_______________ ERROR at setup of test_get_object_ifmatch_failed _______________ 2024-06-04T16:22:30.501 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.501 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.502 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.502 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.502 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.502 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.502 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.502 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.502 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.502 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.502 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.502 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.503 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.503 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.503 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.503 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.503 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.503 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.503 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.503 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.503 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.503 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.503 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.503 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.503 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.504 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.504 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.504 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.504 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.504 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.504 INFO:teuthology.orchestra.run.smithi144.stdout:______________ ERROR at setup of test_get_object_ifnonematch_good ______________ 2024-06-04T16:22:30.504 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.504 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.504 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.504 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.504 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.504 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.504 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.505 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.505 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.505 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.505 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.505 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.505 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.505 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.505 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.505 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.505 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.505 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.505 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.505 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.505 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.506 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.506 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.506 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.506 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.506 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.506 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.506 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.506 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.506 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.506 INFO:teuthology.orchestra.run.smithi144.stdout:_____________ ERROR at setup of test_get_object_ifnonematch_failed _____________ 2024-06-04T16:22:30.506 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.506 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.506 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.507 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.507 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.507 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.507 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.507 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.507 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.507 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.507 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.507 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.507 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.507 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.507 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.507 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.507 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.507 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.508 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.508 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.508 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.508 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.508 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.508 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.508 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.508 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.508 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.508 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.508 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.508 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.508 INFO:teuthology.orchestra.run.smithi144.stdout:____________ ERROR at setup of test_get_object_ifmodifiedsince_good ____________ 2024-06-04T16:22:30.508 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.509 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.509 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.509 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.509 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.509 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.509 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.509 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.509 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.509 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.509 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.509 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.509 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.509 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.509 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.509 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.510 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.510 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.510 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.510 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.510 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.510 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.510 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.510 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.510 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.510 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.510 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.510 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.510 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.511 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.511 INFO:teuthology.orchestra.run.smithi144.stdout:___________ ERROR at setup of test_get_object_ifmodifiedsince_failed ___________ 2024-06-04T16:22:30.511 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.511 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.511 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.511 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.511 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.511 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.511 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.511 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.511 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.511 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.511 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.511 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.512 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.512 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.512 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.512 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.512 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.512 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.512 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.512 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.512 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.512 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.512 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.512 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.512 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.512 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.513 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.513 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.513 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.513 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.513 INFO:teuthology.orchestra.run.smithi144.stdout:___________ ERROR at setup of test_get_object_ifunmodifiedsince_good ___________ 2024-06-04T16:22:30.513 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.513 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.513 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.513 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.513 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.513 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.513 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.513 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.513 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.514 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.514 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.514 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.514 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.514 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.514 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.514 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.514 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.514 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.514 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.514 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.514 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.514 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.514 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.515 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.515 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.515 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.515 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.515 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.515 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.515 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.515 INFO:teuthology.orchestra.run.smithi144.stdout:__________ ERROR at setup of test_get_object_ifunmodifiedsince_failed __________ 2024-06-04T16:22:30.515 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.515 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.515 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.515 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.515 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.516 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.516 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.516 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.516 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.516 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.516 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.516 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.516 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.516 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.516 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.516 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.516 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.516 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.516 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.517 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.517 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.517 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.517 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.517 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.517 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.517 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.517 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.517 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.517 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.517 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.517 INFO:teuthology.orchestra.run.smithi144.stdout:________________ ERROR at setup of test_put_object_ifmatch_good ________________ 2024-06-04T16:22:30.517 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.518 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.518 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.518 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.518 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.518 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.518 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.518 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.518 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.518 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.518 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.518 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.518 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.519 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.519 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.519 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.519 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.519 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.519 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.519 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.519 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.519 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.519 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.519 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.519 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.519 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.520 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.520 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.520 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.520 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.520 INFO:teuthology.orchestra.run.smithi144.stdout:_______________ ERROR at setup of test_put_object_ifmatch_failed _______________ 2024-06-04T16:22:30.520 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.520 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.520 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.520 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.520 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.520 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.520 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.520 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.521 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.521 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.521 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.521 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.521 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.521 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.521 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.521 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.521 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.521 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.521 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.521 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.521 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.522 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.522 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.522 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.522 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.522 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.522 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.522 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.522 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.522 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.522 INFO:teuthology.orchestra.run.smithi144.stdout:_______ ERROR at setup of test_put_object_ifmatch_overwrite_existed_good _______ 2024-06-04T16:22:30.522 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.523 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.523 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.523 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.523 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.523 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.523 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.523 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.523 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.523 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.523 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.523 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.523 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.523 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.523 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.524 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.524 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.524 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.524 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.524 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.524 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.524 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.524 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.524 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.524 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.524 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.524 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.524 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.524 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.525 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.525 INFO:teuthology.orchestra.run.smithi144.stdout:_________ ERROR at setup of test_put_object_ifmatch_nonexisted_failed __________ 2024-06-04T16:22:30.525 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.525 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.525 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.525 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.525 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.525 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.525 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.525 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.525 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.525 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.525 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.525 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.526 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.526 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.526 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.526 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.526 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.526 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.526 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.526 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.526 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.526 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.526 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.526 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.527 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.527 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.527 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.527 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.527 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.527 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.527 INFO:teuthology.orchestra.run.smithi144.stdout:______________ ERROR at setup of test_put_object_ifnonmatch_good _______________ 2024-06-04T16:22:30.527 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.527 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.527 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.528 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.528 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.528 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.528 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.528 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.528 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.528 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.528 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.528 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.528 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.528 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.528 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.528 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.528 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.529 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.529 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.529 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.529 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.529 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.529 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.529 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.529 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.529 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.529 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.529 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.529 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.529 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.529 INFO:teuthology.orchestra.run.smithi144.stdout:_____________ ERROR at setup of test_put_object_ifnonmatch_failed ______________ 2024-06-04T16:22:30.530 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.530 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.530 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.530 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.530 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.530 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.530 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.530 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.530 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.530 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.530 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.530 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.531 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.531 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.531 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.531 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.531 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.531 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.531 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.531 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.531 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.531 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.531 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.531 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.531 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.531 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.532 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.532 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.532 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.532 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.532 INFO:teuthology.orchestra.run.smithi144.stdout:_________ ERROR at setup of test_put_object_ifnonmatch_nonexisted_good _________ 2024-06-04T16:22:30.532 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.532 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.532 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.532 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.532 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.532 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.532 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.532 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.533 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.533 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.533 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.533 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.533 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.533 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.533 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.533 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.533 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.533 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.533 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.533 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.533 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.533 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.534 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.534 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.534 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.534 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.534 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.534 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.534 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.534 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.534 INFO:teuthology.orchestra.run.smithi144.stdout:____ ERROR at setup of test_put_object_ifnonmatch_overwrite_existed_failed _____ 2024-06-04T16:22:30.534 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.534 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.534 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.534 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.535 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.535 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.535 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.535 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.535 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.535 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.535 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.535 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.535 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.535 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.535 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.535 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.535 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.535 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.536 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.536 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.536 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.536 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.536 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.536 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.536 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.536 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.536 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.536 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.536 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.536 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.536 INFO:teuthology.orchestra.run.smithi144.stdout:____________________ ERROR at setup of test_object_raw_get _____________________ 2024-06-04T16:22:30.536 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.537 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.537 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.537 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.537 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.537 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.537 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.537 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.537 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.537 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.537 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.537 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.537 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.537 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.537 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.538 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.538 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.538 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.538 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.538 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.538 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.538 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.538 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.538 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.538 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.538 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.538 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.539 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.539 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.539 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.539 INFO:teuthology.orchestra.run.smithi144.stdout:______________ ERROR at setup of test_object_raw_get_bucket_gone _______________ 2024-06-04T16:22:30.539 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.539 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.539 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.539 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.539 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.539 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.539 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.539 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.540 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.540 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.540 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.540 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.540 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.540 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.540 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.540 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.540 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.540 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.540 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.540 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.540 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.540 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.540 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.541 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.541 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.541 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.541 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.541 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.541 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.541 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.541 INFO:teuthology.orchestra.run.smithi144.stdout:_____________ ERROR at setup of test_object_delete_key_bucket_gone _____________ 2024-06-04T16:22:30.541 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.541 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.541 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.541 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.541 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.542 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.542 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.542 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.542 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.542 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.542 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.542 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.542 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.542 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.542 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.542 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.542 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.543 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.543 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.543 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.543 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.543 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.543 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.543 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.543 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.543 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.543 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.543 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.543 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.543 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.543 INFO:teuthology.orchestra.run.smithi144.stdout:______________ ERROR at setup of test_object_raw_get_object_gone _______________ 2024-06-04T16:22:30.544 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.544 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.544 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.544 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.544 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.544 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.544 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.544 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.544 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.544 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.544 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.544 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.544 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.544 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.545 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.545 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.545 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.545 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.545 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.545 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.545 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.545 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.545 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.545 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.545 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.545 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.545 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.546 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.546 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.546 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.546 INFO:teuthology.orchestra.run.smithi144.stdout:______________________ ERROR at setup of test_bucket_head ______________________ 2024-06-04T16:22:30.546 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.546 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.546 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.546 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.546 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.546 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.546 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.546 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.547 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.547 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.547 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.547 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.547 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.547 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.547 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.547 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.547 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.547 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.547 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.547 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.547 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.547 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.547 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.548 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.548 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.548 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.548 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.548 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.548 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.548 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.548 INFO:teuthology.orchestra.run.smithi144.stdout:_________________ ERROR at setup of test_bucket_head_notexist __________________ 2024-06-04T16:22:30.548 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.548 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.548 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.548 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.548 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.549 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.549 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.549 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.549 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.549 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.549 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.549 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.549 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.549 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.549 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.549 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.549 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.549 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.549 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.550 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.550 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.550 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.550 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.550 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.550 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.550 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.550 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.550 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.550 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.550 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.550 INFO:teuthology.orchestra.run.smithi144.stdout:_________________ ERROR at setup of test_bucket_head_extended __________________ 2024-06-04T16:22:30.551 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.551 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.551 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.551 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.551 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.551 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.551 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.551 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.551 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.551 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.551 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.551 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.551 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.551 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.551 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.552 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.552 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.552 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.552 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.552 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.552 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.552 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.552 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.552 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.552 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.552 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.552 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.552 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.552 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.552 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.553 INFO:teuthology.orchestra.run.smithi144.stdout:_______________ ERROR at setup of test_object_raw_get_bucket_acl _______________ 2024-06-04T16:22:30.553 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.553 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.553 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.553 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.553 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.553 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.553 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.553 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.553 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.553 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.553 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.553 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.553 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.554 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.554 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.554 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.554 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.554 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.554 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.554 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.554 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.554 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.554 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.554 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.554 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.554 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.554 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.555 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.555 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.555 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.555 INFO:teuthology.orchestra.run.smithi144.stdout:_______________ ERROR at setup of test_object_raw_get_object_acl _______________ 2024-06-04T16:22:30.555 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.555 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.555 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.555 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.555 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.555 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.555 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.555 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.555 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.555 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.556 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.556 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.556 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.556 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.556 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.556 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.556 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.556 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.556 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.556 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.556 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.556 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.556 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.557 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.557 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.557 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.557 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.557 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.557 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.557 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.557 INFO:teuthology.orchestra.run.smithi144.stdout:_________________ ERROR at setup of test_object_put_acl_mtime __________________ 2024-06-04T16:22:30.557 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.557 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.557 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.557 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.557 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.558 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.558 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.558 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.558 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.558 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.558 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.558 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.558 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.558 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.558 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.558 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.558 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.559 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.559 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.559 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.559 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.559 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.559 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.559 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.559 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.559 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.559 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.559 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.559 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.559 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.559 INFO:teuthology.orchestra.run.smithi144.stdout:_______________ ERROR at setup of test_object_raw_authenticated ________________ 2024-06-04T16:22:30.559 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.560 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.560 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.560 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.560 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.560 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.560 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.560 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.560 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.560 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.560 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.560 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.560 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.561 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.561 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.561 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.561 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.561 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.561 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.561 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.561 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.561 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.561 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.561 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.561 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.561 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.562 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.562 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.562 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.562 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.562 INFO:teuthology.orchestra.run.smithi144.stdout:______________ ERROR at setup of test_object_raw_response_headers ______________ 2024-06-04T16:22:30.562 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.562 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.562 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.562 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.562 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.562 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.562 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.562 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.563 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.563 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.563 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.563 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.563 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.563 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.563 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.563 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.563 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.563 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.563 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.563 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.563 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.563 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.564 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.564 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.564 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.564 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.564 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.564 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.564 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.564 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.564 INFO:teuthology.orchestra.run.smithi144.stdout:__________ ERROR at setup of test_object_raw_authenticated_bucket_acl __________ 2024-06-04T16:22:30.564 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.564 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.564 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.564 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.565 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.565 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.565 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.565 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.565 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.565 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.565 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.565 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.565 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.565 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.565 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.565 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.565 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.565 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.566 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.566 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.566 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.566 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.566 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.566 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.566 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.566 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.566 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.566 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.566 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.567 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.567 INFO:teuthology.orchestra.run.smithi144.stdout:__________ ERROR at setup of test_object_raw_authenticated_object_acl __________ 2024-06-04T16:22:30.567 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.567 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.567 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.567 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.567 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.567 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.567 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.567 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.567 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.567 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.567 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.568 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.568 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.568 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.568 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.568 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.568 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.568 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.568 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.568 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.568 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.568 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.568 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.568 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.568 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.569 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.569 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.569 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.569 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.569 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.569 INFO:teuthology.orchestra.run.smithi144.stdout:_________ ERROR at setup of test_object_raw_authenticated_bucket_gone __________ 2024-06-04T16:22:30.569 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.569 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.569 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.569 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.569 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.569 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.569 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.570 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.570 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.570 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.570 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.570 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.570 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.570 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.570 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.570 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.570 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.570 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.570 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.570 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.571 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.571 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.571 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.571 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.571 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.571 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.571 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.571 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.571 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.571 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.571 INFO:teuthology.orchestra.run.smithi144.stdout:_________ ERROR at setup of test_object_raw_authenticated_object_gone __________ 2024-06-04T16:22:30.571 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.572 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.572 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.572 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.572 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.572 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.572 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.572 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.572 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.572 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.572 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.572 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.572 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.572 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.573 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.573 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.573 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.573 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.573 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.573 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.573 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.573 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.573 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.573 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.573 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.573 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.573 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.574 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.574 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.574 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.574 INFO:teuthology.orchestra.run.smithi144.stdout:_______ ERROR at setup of test_object_raw_get_x_amz_expires_not_expired ________ 2024-06-04T16:22:30.574 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.574 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.574 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.574 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.574 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.574 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.574 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.574 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.574 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.575 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.575 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.575 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.575 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.575 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.575 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.575 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.575 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.575 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.575 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.575 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.575 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.575 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.576 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.576 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.576 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.576 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.576 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.576 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.576 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.576 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.576 INFO:teuthology.orchestra.run.smithi144.stdout:____ ERROR at setup of test_object_raw_get_x_amz_expires_not_expired_tenant ____ 2024-06-04T16:22:30.576 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.576 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.576 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.576 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.577 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.577 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.577 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.577 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.577 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.577 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.577 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.577 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.577 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.577 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.577 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.577 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.577 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.578 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.578 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.578 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.578 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.578 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.578 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.578 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.578 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.578 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.578 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.578 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.578 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.578 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.579 INFO:teuthology.orchestra.run.smithi144.stdout:______ ERROR at setup of test_object_raw_get_x_amz_expires_out_range_zero ______ 2024-06-04T16:22:30.579 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.579 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.579 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.579 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.579 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.579 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.579 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.579 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.579 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.579 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.579 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.579 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.580 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.580 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.580 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.580 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.580 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.580 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.580 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.580 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.580 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.580 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.580 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.580 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.580 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.580 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.580 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.581 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.581 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.581 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.581 INFO:teuthology.orchestra.run.smithi144.stdout:______ ERROR at setup of test_object_raw_get_x_amz_expires_out_max_range _______ 2024-06-04T16:22:30.581 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.581 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.581 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.581 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.581 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.581 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.581 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.581 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.582 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.582 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.582 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.582 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.582 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.582 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.582 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.582 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.582 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.582 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.582 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.582 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.583 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.583 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.583 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.583 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.583 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.583 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.583 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.583 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.583 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.583 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.583 INFO:teuthology.orchestra.run.smithi144.stdout:____ ERROR at setup of test_object_raw_get_x_amz_expires_out_positive_range ____ 2024-06-04T16:22:30.584 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.584 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.584 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.584 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.584 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.584 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.584 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.584 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.584 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.584 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.585 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.585 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.585 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.585 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.585 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.585 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.585 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.585 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.585 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.585 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.585 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.585 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.586 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.586 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.586 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.586 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.586 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.586 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.586 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.586 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.586 INFO:teuthology.orchestra.run.smithi144.stdout:____________________ ERROR at setup of test_object_anon_put ____________________ 2024-06-04T16:22:30.587 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.587 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.587 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.587 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.587 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.587 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.587 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.587 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.587 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.587 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.587 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.588 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.588 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.588 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.588 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.588 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.588 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.588 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.588 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.588 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.588 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.588 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.589 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.589 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.589 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.589 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.589 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.589 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.589 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.589 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.589 INFO:teuthology.orchestra.run.smithi144.stdout:_____________ ERROR at setup of test_object_anon_put_write_access ______________ 2024-06-04T16:22:30.589 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.589 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.589 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.589 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.590 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.590 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.590 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.590 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.590 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.590 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.590 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.590 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.590 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.590 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.590 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.591 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.591 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.591 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.591 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.591 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.591 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.591 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.591 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.591 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.591 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.591 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.591 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.591 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.592 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.592 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.592 INFO:teuthology.orchestra.run.smithi144.stdout:_______________ ERROR at setup of test_object_put_authenticated ________________ 2024-06-04T16:22:30.592 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.592 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.592 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.592 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.592 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.592 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.592 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.592 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.592 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.593 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.593 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.593 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.593 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.593 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.593 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.593 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.593 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.593 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.593 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.593 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.593 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.593 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.594 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.594 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.594 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.594 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.594 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.594 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.594 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.594 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.594 INFO:teuthology.orchestra.run.smithi144.stdout:_________ ERROR at setup of test_object_presigned_put_object_with_acl __________ 2024-06-04T16:22:30.594 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.594 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.594 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.595 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.595 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.595 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.595 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.595 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.595 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.595 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.595 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.595 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.595 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.595 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.595 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.595 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.595 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.596 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.596 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.596 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.596 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.596 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.596 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.596 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.596 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.596 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.596 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.596 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.596 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.596 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.597 INFO:teuthology.orchestra.run.smithi144.stdout:______ ERROR at setup of test_object_presigned_put_object_with_acl_tenant ______ 2024-06-04T16:22:30.597 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.597 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.597 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.597 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.597 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.597 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.597 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.597 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.597 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.597 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.597 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.598 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.598 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.598 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.598 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.598 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.598 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.598 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.598 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.598 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.598 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.598 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.598 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.598 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.599 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.599 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.599 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.599 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.599 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.599 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.599 INFO:teuthology.orchestra.run.smithi144.stdout:_________ ERROR at setup of test_object_raw_put_authenticated_expired __________ 2024-06-04T16:22:30.599 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.599 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.599 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.599 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.599 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.599 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.599 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.600 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.600 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.600 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.600 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.600 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.600 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.600 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.600 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.600 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.600 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.600 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.601 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.601 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.601 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.601 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.601 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.601 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.601 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.601 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.601 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.601 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.601 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.601 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.602 INFO:teuthology.orchestra.run.smithi144.stdout:_______ ERROR at setup of test_bucket_create_naming_bad_starts_nonalpha ________ 2024-06-04T16:22:30.602 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.602 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.602 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.602 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.602 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.602 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.602 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.602 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.602 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.602 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.603 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.603 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.603 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.603 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.603 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.603 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.603 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.603 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.603 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.603 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.603 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.603 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.603 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.604 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.604 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.604 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.604 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.604 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.604 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.604 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.604 INFO:teuthology.orchestra.run.smithi144.stdout:__________ ERROR at setup of test_bucket_create_naming_bad_short_one ___________ 2024-06-04T16:22:30.604 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.604 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.604 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.604 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.604 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.604 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.605 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.605 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.605 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.605 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.605 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.605 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.605 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.605 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.605 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.605 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.605 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.605 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.605 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.606 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.606 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.606 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.606 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.606 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.606 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.606 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.606 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.606 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.606 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.606 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.606 INFO:teuthology.orchestra.run.smithi144.stdout:__________ ERROR at setup of test_bucket_create_naming_bad_short_two ___________ 2024-06-04T16:22:30.606 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.607 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.607 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.607 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.607 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.607 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.607 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.607 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.607 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.607 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.607 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.607 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.607 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.607 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.608 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.608 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.608 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.608 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.608 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.608 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.608 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.608 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.608 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.608 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.608 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.608 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.608 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.608 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.608 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.609 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.609 INFO:teuthology.orchestra.run.smithi144.stdout:___________ ERROR at setup of test_bucket_create_naming_good_long_60 ___________ 2024-06-04T16:22:30.609 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.609 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.609 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.609 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.609 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.609 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.609 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.609 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.609 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.609 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.609 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.609 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.609 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.610 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.610 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.610 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.610 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.610 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.610 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.610 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.610 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.610 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.610 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.610 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.610 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.610 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.611 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.611 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.611 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.611 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.611 INFO:teuthology.orchestra.run.smithi144.stdout:___________ ERROR at setup of test_bucket_create_naming_good_long_61 ___________ 2024-06-04T16:22:30.611 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.611 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.611 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.611 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.611 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.611 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.611 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.611 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.612 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.612 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.612 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.612 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.612 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.612 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.612 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.612 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.612 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.612 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.612 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.612 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.612 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.612 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.613 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.613 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.613 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.613 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.613 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.613 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.613 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.613 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.613 INFO:teuthology.orchestra.run.smithi144.stdout:___________ ERROR at setup of test_bucket_create_naming_good_long_62 ___________ 2024-06-04T16:22:30.613 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.613 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.613 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.613 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.613 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.614 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.614 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.614 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.614 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.614 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.614 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.614 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.614 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.614 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.614 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.614 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.614 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.614 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.614 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.615 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.615 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.615 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.615 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.615 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.615 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.615 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.615 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.615 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.615 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.615 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.615 INFO:teuthology.orchestra.run.smithi144.stdout:___________ ERROR at setup of test_bucket_create_naming_good_long_63 ___________ 2024-06-04T16:22:30.615 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.615 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.615 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.616 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.616 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.616 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.616 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.616 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.616 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.616 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.616 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.616 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.616 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.616 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.616 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.616 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.616 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.616 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.617 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.617 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.617 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.617 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.617 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.617 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.617 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.617 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.617 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.617 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.617 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.617 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.617 INFO:teuthology.orchestra.run.smithi144.stdout:_________________ ERROR at setup of test_bucket_list_long_name _________________ 2024-06-04T16:22:30.617 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.617 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.617 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.618 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.618 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.618 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.618 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.618 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.618 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.618 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.618 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.618 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.618 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.618 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.618 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.619 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.622 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.622 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.622 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.623 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.623 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.623 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.623 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.623 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.623 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.623 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.623 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.623 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.623 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.623 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.623 INFO:teuthology.orchestra.run.smithi144.stdout:______________ ERROR at setup of test_bucket_create_naming_bad_ip ______________ 2024-06-04T16:22:30.624 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.624 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.624 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.624 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.624 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.624 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.624 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.624 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.624 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.624 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.624 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.624 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.624 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.625 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.625 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.625 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.625 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.625 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.625 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.625 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.625 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.625 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.625 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.625 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.625 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.625 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.625 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.626 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.626 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.626 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.626 INFO:teuthology.orchestra.run.smithi144.stdout:__________ ERROR at setup of test_bucket_create_naming_dns_underscore __________ 2024-06-04T16:22:30.626 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.626 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.626 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.626 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.626 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.626 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.626 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.626 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.626 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.627 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.627 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.627 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.627 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.627 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.627 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.627 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.627 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.627 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.627 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.627 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.627 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.627 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.627 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.627 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.628 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.628 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.628 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.628 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.628 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.628 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.628 INFO:teuthology.orchestra.run.smithi144.stdout:_____________ ERROR at setup of test_bucket_create_naming_dns_long _____________ 2024-06-04T16:22:30.628 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.628 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.628 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.628 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.628 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.628 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.629 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.629 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.629 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.629 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.629 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.629 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.629 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.629 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.629 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.629 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.629 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.629 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.629 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.630 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.630 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.630 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.630 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.630 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.630 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.630 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.630 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.630 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.630 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.630 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.630 INFO:teuthology.orchestra.run.smithi144.stdout:_________ ERROR at setup of test_bucket_create_naming_dns_dash_at_end __________ 2024-06-04T16:22:30.630 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.630 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.631 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.631 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.631 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.631 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.631 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.631 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.631 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.631 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.631 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.631 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.631 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.631 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.631 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.631 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.632 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.632 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.632 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.632 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.632 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.632 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.632 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.632 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.632 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.632 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.632 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.632 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.632 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.632 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.633 INFO:teuthology.orchestra.run.smithi144.stdout:___________ ERROR at setup of test_bucket_create_naming_dns_dot_dot ____________ 2024-06-04T16:22:30.633 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.633 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.633 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.633 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.633 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.633 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.633 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.633 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.633 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.633 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.633 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.633 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.633 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.633 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.634 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.634 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.634 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.634 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.634 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.634 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.634 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.634 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.634 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.634 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.634 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.634 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.634 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.635 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.635 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.635 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.635 INFO:teuthology.orchestra.run.smithi144.stdout:___________ ERROR at setup of test_bucket_create_naming_dns_dot_dash ___________ 2024-06-04T16:22:30.635 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.635 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.635 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.635 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.635 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.635 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.635 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.635 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.635 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.635 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.635 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.636 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.636 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.636 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.636 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.636 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.636 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.636 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.636 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.636 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.636 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.636 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.636 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.636 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.636 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.636 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.637 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.637 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.637 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.637 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.637 INFO:teuthology.orchestra.run.smithi144.stdout:___________ ERROR at setup of test_bucket_create_naming_dns_dash_dot ___________ 2024-06-04T16:22:30.637 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.637 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.637 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.637 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.637 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.637 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.637 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.637 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.637 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.638 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.638 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.638 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.638 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.638 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.638 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.638 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.638 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.638 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.638 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.638 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.638 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.639 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.639 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.639 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.639 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.639 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.639 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.639 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.639 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.639 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.639 INFO:teuthology.orchestra.run.smithi144.stdout:_________________ ERROR at setup of test_bucket_create_exists __________________ 2024-06-04T16:22:30.639 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.639 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.639 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.639 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.640 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.640 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.640 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.640 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.640 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.640 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.640 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.640 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.640 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.640 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.640 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.640 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.640 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.641 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.641 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.641 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.641 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.641 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.641 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.641 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.641 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.641 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.641 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.641 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.641 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.642 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.642 INFO:teuthology.orchestra.run.smithi144.stdout:__________________ ERROR at setup of test_bucket_get_location __________________ 2024-06-04T16:22:30.642 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.642 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.642 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.642 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.642 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.642 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.642 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.642 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.642 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.643 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.643 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.643 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.643 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.643 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.643 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.643 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.643 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.643 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.643 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.643 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.643 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.643 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.643 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.643 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.644 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.644 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.644 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.644 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.644 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.644 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.644 INFO:teuthology.orchestra.run.smithi144.stdout:_____________ ERROR at setup of test_bucket_create_exists_nonowner _____________ 2024-06-04T16:22:30.644 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.644 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.644 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.644 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.644 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.645 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.645 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.645 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.645 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.645 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.645 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.645 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.645 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.645 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.645 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.645 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.645 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.645 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.645 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.645 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.646 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.646 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.646 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.646 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.646 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.646 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.646 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.646 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.646 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.646 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.646 INFO:teuthology.orchestra.run.smithi144.stdout:_____________ ERROR at setup of test_bucket_recreate_overwrite_acl _____________ 2024-06-04T16:22:30.647 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.647 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.647 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.647 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.647 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.647 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.647 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.647 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.647 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.647 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.647 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.647 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.648 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.648 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.648 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.648 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.648 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.648 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.648 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.648 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.648 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.648 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.648 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.648 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.649 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.649 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.649 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.649 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.649 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.649 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.649 INFO:teuthology.orchestra.run.smithi144.stdout:________________ ERROR at setup of test_bucket_recreate_new_acl ________________ 2024-06-04T16:22:30.649 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.649 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.649 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.649 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.649 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.649 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.650 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.650 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.650 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.650 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.650 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.650 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.650 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.650 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.650 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.650 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.650 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.650 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.650 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.651 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.651 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.651 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.651 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.651 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.651 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.651 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.651 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.651 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.651 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.651 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.651 INFO:teuthology.orchestra.run.smithi144.stdout:__________________ ERROR at setup of test_bucket_acl_default ___________________ 2024-06-04T16:22:30.651 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.651 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.651 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.652 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.652 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.652 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.652 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.652 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.652 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.652 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.652 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.652 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.652 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.652 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.652 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.652 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.652 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.653 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.653 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.653 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.653 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.653 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.653 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.653 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.653 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.653 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.653 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.653 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.653 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.653 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.653 INFO:teuthology.orchestra.run.smithi144.stdout:____________ ERROR at setup of test_bucket_acl_canned_during_create ____________ 2024-06-04T16:22:30.654 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.654 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.654 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.654 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.654 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.654 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.654 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.654 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.654 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.654 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.654 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.654 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.654 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.655 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.655 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.655 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.655 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.655 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.655 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.655 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.655 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.655 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.655 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.655 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.655 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.655 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.655 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.656 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.656 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.656 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.656 INFO:teuthology.orchestra.run.smithi144.stdout:___________________ ERROR at setup of test_bucket_acl_canned ___________________ 2024-06-04T16:22:30.656 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.656 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.656 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.656 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.656 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.656 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.656 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.656 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.656 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.657 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.657 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.657 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.657 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.657 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.657 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.657 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.657 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.657 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.657 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.657 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.657 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.657 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.658 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.658 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.658 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.658 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.658 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.658 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.658 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.658 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.658 INFO:teuthology.orchestra.run.smithi144.stdout:___________ ERROR at setup of test_bucket_acl_canned_publicreadwrite ___________ 2024-06-04T16:22:30.658 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.658 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.658 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.658 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.659 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.659 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.659 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.659 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.659 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.659 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.659 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.659 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.659 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.659 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.659 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.659 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.659 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.660 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.660 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.660 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.660 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.660 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.660 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.660 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.660 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.660 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.660 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.660 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.660 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.660 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.661 INFO:teuthology.orchestra.run.smithi144.stdout:__________ ERROR at setup of test_bucket_acl_canned_authenticatedread __________ 2024-06-04T16:22:30.661 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.661 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.661 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.661 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.661 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.661 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.661 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.661 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.661 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.661 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.661 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.662 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.662 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.662 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.662 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.662 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.662 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.662 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.662 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.662 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.662 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.663 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.663 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.663 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.663 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.663 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.663 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.663 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.663 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.663 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.663 INFO:teuthology.orchestra.run.smithi144.stdout:__________________ ERROR at setup of test_object_acl_default ___________________ 2024-06-04T16:22:30.663 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.663 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.663 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.663 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.664 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.664 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.664 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.664 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.664 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.664 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.664 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.664 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.664 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.664 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.664 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.664 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.664 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.664 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.664 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.665 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.665 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.665 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.665 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.665 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.665 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.665 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.665 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.665 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.665 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.665 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.665 INFO:teuthology.orchestra.run.smithi144.stdout:____________ ERROR at setup of test_object_acl_canned_during_create ____________ 2024-06-04T16:22:30.665 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.665 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.666 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.666 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.666 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.666 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.666 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.666 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.666 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.666 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.666 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.666 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.666 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.667 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.667 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.667 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.667 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.667 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.667 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.667 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.667 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.667 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.667 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.667 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.667 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.667 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.667 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.668 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.668 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.668 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.668 INFO:teuthology.orchestra.run.smithi144.stdout:___________________ ERROR at setup of test_object_acl_canned ___________________ 2024-06-04T16:22:30.668 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.668 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.668 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.668 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.668 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.668 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.668 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.668 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.668 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.668 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.668 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.668 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.669 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.669 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.669 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.669 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.669 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.669 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.669 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.669 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.669 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.669 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.669 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.669 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.669 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.670 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.670 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.670 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.670 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.670 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.670 INFO:teuthology.orchestra.run.smithi144.stdout:___________ ERROR at setup of test_object_acl_canned_publicreadwrite ___________ 2024-06-04T16:22:30.670 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.670 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.670 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.670 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.670 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.670 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.671 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.671 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.671 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.671 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.671 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.671 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.671 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.671 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.671 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.671 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.671 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.671 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.672 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.672 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.672 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.672 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.672 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.672 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.672 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.672 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.672 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.672 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.672 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.672 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.673 INFO:teuthology.orchestra.run.smithi144.stdout:__________ ERROR at setup of test_object_acl_canned_authenticatedread __________ 2024-06-04T16:22:30.673 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.673 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.673 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.673 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.673 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.673 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.673 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.673 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.673 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.673 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.673 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.673 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.674 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.674 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.674 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.674 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.674 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.674 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.674 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.674 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.674 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.674 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.674 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.674 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.675 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.675 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.675 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.675 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.675 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.675 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.675 INFO:teuthology.orchestra.run.smithi144.stdout:___________ ERROR at setup of test_object_acl_canned_bucketownerread ___________ 2024-06-04T16:22:30.675 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.675 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.675 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.675 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.675 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.675 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.676 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.676 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.676 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.676 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.676 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.676 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.676 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.676 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.676 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.676 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.676 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.676 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.676 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.677 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.677 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.677 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.677 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.677 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.677 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.677 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.677 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.677 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.677 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.677 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.677 INFO:teuthology.orchestra.run.smithi144.stdout:_______ ERROR at setup of test_object_acl_canned_bucketownerfullcontrol ________ 2024-06-04T16:22:30.677 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.678 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.678 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.678 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.678 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.678 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.678 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.678 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.678 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.678 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.678 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.678 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.678 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.678 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.679 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.679 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.679 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.679 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.679 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.679 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.679 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.679 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.679 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.679 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.679 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.680 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.680 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.680 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.680 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.680 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.680 INFO:teuthology.orchestra.run.smithi144.stdout:_________ ERROR at setup of test_object_acl_full_control_verify_owner __________ 2024-06-04T16:22:30.680 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.680 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.680 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.680 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.681 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.681 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.681 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.681 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.681 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.681 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.681 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.681 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.681 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.681 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.681 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.682 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.682 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.682 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.682 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.682 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.682 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.682 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.682 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.682 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.682 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.682 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.682 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.683 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.683 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.683 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.683 INFO:teuthology.orchestra.run.smithi144.stdout:_______ ERROR at setup of test_object_acl_full_control_verify_attributes _______ 2024-06-04T16:22:30.683 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.683 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.683 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.683 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.683 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.683 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.683 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.683 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.684 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.684 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.684 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.684 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.684 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.684 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.684 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.684 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.684 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.684 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.684 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.684 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.684 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.685 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.685 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.685 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.685 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.685 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.685 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.685 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.685 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.685 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.685 INFO:teuthology.orchestra.run.smithi144.stdout:_________ ERROR at setup of test_bucket_acl_canned_private_to_private __________ 2024-06-04T16:22:30.685 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.685 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.686 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.686 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.686 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.686 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.686 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.686 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.686 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.686 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.686 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.686 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.686 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.686 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.687 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.687 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.687 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.687 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.687 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.687 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.687 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.687 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.687 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.687 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.687 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.687 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.688 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.688 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.688 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.688 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.688 INFO:teuthology.orchestra.run.smithi144.stdout:______________________ ERROR at setup of test_object_acl _______________________ 2024-06-04T16:22:30.688 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.688 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.688 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.688 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.688 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.688 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.688 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.688 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.689 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.689 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.689 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.689 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.689 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.689 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.689 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.689 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.689 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.689 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.689 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.689 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.689 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.690 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.690 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.690 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.690 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.690 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.690 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.690 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.690 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.690 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.690 INFO:teuthology.orchestra.run.smithi144.stdout:___________________ ERROR at setup of test_object_acl_write ____________________ 2024-06-04T16:22:30.690 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.691 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.691 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.691 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.691 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.691 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.691 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.691 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.691 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.691 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.691 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.691 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.691 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.692 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.692 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.692 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.692 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.692 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.692 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.692 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.692 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.692 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.692 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.692 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.693 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.693 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.693 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.693 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.693 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.693 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.693 INFO:teuthology.orchestra.run.smithi144.stdout:__________________ ERROR at setup of test_object_acl_writeacp __________________ 2024-06-04T16:22:30.693 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.693 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.693 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.693 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.693 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.693 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.694 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.694 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.694 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.694 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.694 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.694 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.694 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.694 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.694 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.694 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.694 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.694 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.694 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.695 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.695 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.695 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.695 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.695 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.695 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.695 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.695 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.695 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.695 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.695 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.695 INFO:teuthology.orchestra.run.smithi144.stdout:____________________ ERROR at setup of test_object_acl_read ____________________ 2024-06-04T16:22:30.695 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.696 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.696 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.696 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.696 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.696 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.696 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.696 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.696 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.696 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.696 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.696 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.696 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.696 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.696 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.696 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.697 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.697 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.697 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.697 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.697 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.697 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.697 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.697 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.697 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.697 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.697 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.697 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.697 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.697 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.698 INFO:teuthology.orchestra.run.smithi144.stdout:__________________ ERROR at setup of test_object_acl_readacp ___________________ 2024-06-04T16:22:30.698 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.698 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.698 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.698 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.698 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.698 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.698 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.698 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.698 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.698 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.698 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.699 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.699 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.699 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.699 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.699 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.699 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.699 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.699 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.699 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.699 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.699 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.699 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.699 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.700 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.700 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.700 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.700 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.700 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.700 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.700 INFO:teuthology.orchestra.run.smithi144.stdout:__________ ERROR at setup of test_bucket_acl_grant_userid_fullcontrol __________ 2024-06-04T16:22:30.700 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.700 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.700 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.700 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.700 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.700 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.701 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.701 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.701 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.701 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.701 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.701 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.701 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.701 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.701 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.701 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.701 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.701 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.701 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.701 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.701 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.702 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.702 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.702 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.702 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.702 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.702 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.702 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.702 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.702 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.702 INFO:teuthology.orchestra.run.smithi144.stdout:_____________ ERROR at setup of test_bucket_acl_grant_userid_read ______________ 2024-06-04T16:22:30.702 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.702 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.703 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.703 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.703 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.703 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.703 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.703 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.703 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.703 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.703 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.703 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.703 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.703 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.703 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.704 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.704 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.704 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.704 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.704 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.704 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.704 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.704 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.704 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.704 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.704 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.704 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.704 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.704 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.704 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.705 INFO:teuthology.orchestra.run.smithi144.stdout:____________ ERROR at setup of test_bucket_acl_grant_userid_readacp ____________ 2024-06-04T16:22:30.705 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.705 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.705 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.705 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.705 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.705 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.705 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.705 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.705 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.705 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.705 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.705 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.705 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.706 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.706 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.706 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.706 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.706 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.706 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.706 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.706 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.706 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.706 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.706 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.706 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.706 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.706 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.707 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.707 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.707 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.707 INFO:teuthology.orchestra.run.smithi144.stdout:_____________ ERROR at setup of test_bucket_acl_grant_userid_write _____________ 2024-06-04T16:22:30.707 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.707 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.707 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.707 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.707 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.707 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.707 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.707 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.708 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.708 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.708 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.708 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.708 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.708 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.708 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.708 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.708 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.708 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.708 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.708 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.709 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.709 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.709 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.709 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.709 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.709 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.709 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.709 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.709 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.709 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.709 INFO:teuthology.orchestra.run.smithi144.stdout:___________ ERROR at setup of test_bucket_acl_grant_userid_writeacp ____________ 2024-06-04T16:22:30.709 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.709 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.710 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.710 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.710 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.710 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.710 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.710 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.710 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.710 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.710 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.710 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.710 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.711 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.711 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.711 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.711 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.711 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.711 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.711 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.711 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.711 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.711 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.711 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.712 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.712 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.712 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.712 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.712 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.712 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.712 INFO:teuthology.orchestra.run.smithi144.stdout:____________ ERROR at setup of test_bucket_acl_grant_nonexist_user _____________ 2024-06-04T16:22:30.712 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.712 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.712 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.712 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.712 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.713 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.713 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.713 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.713 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.713 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.713 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.713 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.713 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.713 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.713 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.714 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.714 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.714 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.714 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.714 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.714 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.714 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.714 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.714 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.714 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.714 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.714 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.714 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.714 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.715 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.715 INFO:teuthology.orchestra.run.smithi144.stdout:_______________ ERROR at setup of test_object_header_acl_grants ________________ 2024-06-04T16:22:30.715 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.715 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.715 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.715 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.715 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.715 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.715 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.715 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.715 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.715 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.715 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.715 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.716 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.716 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.716 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.716 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.716 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.716 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.716 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.716 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.716 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.716 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.716 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.716 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.716 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.717 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.717 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.717 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.717 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.717 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.717 INFO:teuthology.orchestra.run.smithi144.stdout:_______________ ERROR at setup of test_bucket_header_acl_grants ________________ 2024-06-04T16:22:30.717 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.717 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.717 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.717 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.717 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.717 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.717 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.718 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.718 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.718 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.718 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.718 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.718 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.718 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.718 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.718 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.718 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.718 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.718 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.718 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.719 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.719 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.719 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.719 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.719 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.719 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.719 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.719 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.719 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.719 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.719 INFO:teuthology.orchestra.run.smithi144.stdout:________________ ERROR at setup of test_bucket_acl_grant_email _________________ 2024-06-04T16:22:30.719 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.719 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.720 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.720 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.720 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.720 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.720 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.720 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.720 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.720 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.720 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.720 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.720 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.720 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.721 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.721 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.721 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.721 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.721 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.721 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.721 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.721 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.721 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.721 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.721 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.721 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.721 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.722 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.722 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.722 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.722 INFO:teuthology.orchestra.run.smithi144.stdout:___________ ERROR at setup of test_bucket_acl_grant_email_not_exist ____________ 2024-06-04T16:22:30.722 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.722 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.722 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.722 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.722 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.722 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.722 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.722 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.723 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.723 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.723 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.723 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.723 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.723 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.723 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.723 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.723 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.723 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.723 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.723 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.724 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.724 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.724 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.724 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.724 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.724 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.724 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.724 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.724 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.724 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.724 INFO:teuthology.orchestra.run.smithi144.stdout:_________________ ERROR at setup of test_bucket_acl_revoke_all _________________ 2024-06-04T16:22:30.724 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.724 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.725 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.725 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.725 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.725 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.725 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.725 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.725 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.725 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.725 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.725 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.725 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.725 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.725 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.725 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.726 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.726 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.726 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.726 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.726 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.726 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.726 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.726 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.726 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.726 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.726 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.726 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.726 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.727 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.727 INFO:teuthology.orchestra.run.smithi144.stdout:_________ ERROR at setup of test_access_bucket_private_object_private __________ 2024-06-04T16:22:30.727 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.727 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.727 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.727 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.727 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.727 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.727 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.727 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.727 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.727 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.728 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.728 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.728 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.728 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.728 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.728 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.728 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.728 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.728 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.728 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.728 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.728 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.729 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.729 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.729 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.729 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.729 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.729 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.729 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.729 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.729 INFO:teuthology.orchestra.run.smithi144.stdout:________ ERROR at setup of test_access_bucket_private_objectv2_private _________ 2024-06-04T16:22:30.729 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.729 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.729 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.729 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.730 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.730 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.730 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.730 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.730 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.730 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.730 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.730 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.730 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.730 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.730 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.731 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.731 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.731 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.731 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.731 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.731 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.731 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.731 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.731 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.731 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.731 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.731 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.732 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.732 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.732 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.732 INFO:teuthology.orchestra.run.smithi144.stdout:________ ERROR at setup of test_access_bucket_private_object_publicread ________ 2024-06-04T16:22:30.732 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.732 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.732 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.732 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.732 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.732 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.732 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.732 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.732 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.732 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.733 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.733 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.733 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.733 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.733 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.733 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.733 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.733 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.733 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.733 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.733 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.733 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.733 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.733 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.734 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.734 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.734 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.734 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.734 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.734 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.734 INFO:teuthology.orchestra.run.smithi144.stdout:_______ ERROR at setup of test_access_bucket_private_objectv2_publicread _______ 2024-06-04T16:22:30.734 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.734 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.734 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.734 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.734 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.734 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.734 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.735 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.735 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.735 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.735 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.735 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.735 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.735 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.735 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.735 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.735 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.735 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.735 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.736 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.736 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.736 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.736 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.736 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.736 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.736 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.736 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.736 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.736 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.736 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.736 INFO:teuthology.orchestra.run.smithi144.stdout:_____ ERROR at setup of test_access_bucket_private_object_publicreadwrite ______ 2024-06-04T16:22:30.736 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.736 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.737 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.737 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.737 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.737 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.737 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.737 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.737 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.737 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.737 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.737 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.737 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.737 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.737 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.737 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.738 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.738 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.738 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.738 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.738 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.738 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.738 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.738 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.738 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.738 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.738 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.738 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.738 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.738 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.739 INFO:teuthology.orchestra.run.smithi144.stdout:____ ERROR at setup of test_access_bucket_private_objectv2_publicreadwrite _____ 2024-06-04T16:22:30.739 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.739 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.739 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.739 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.739 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.739 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.739 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.739 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.739 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.739 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.739 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.739 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.739 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.739 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.740 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.740 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.740 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.740 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.740 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.740 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.740 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.740 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.740 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.740 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.740 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.740 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.740 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.740 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.741 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.741 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.741 INFO:teuthology.orchestra.run.smithi144.stdout:________ ERROR at setup of test_access_bucket_publicread_object_private ________ 2024-06-04T16:22:30.741 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.741 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.741 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.741 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.741 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.741 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.741 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.741 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.741 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.741 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.742 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.742 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.742 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.742 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.742 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.742 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.742 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.742 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.742 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.742 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.742 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.742 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.742 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.742 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.743 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.743 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.743 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.743 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.743 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.743 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.743 INFO:teuthology.orchestra.run.smithi144.stdout:______ ERROR at setup of test_access_bucket_publicread_object_publicread _______ 2024-06-04T16:22:30.743 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.743 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.743 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.743 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.743 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.743 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.743 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.744 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.744 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.744 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.744 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.744 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.744 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.744 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.744 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.744 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.744 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.744 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.744 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.744 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.744 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.744 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.745 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.745 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.745 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.745 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.745 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.745 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.745 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.745 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.745 INFO:teuthology.orchestra.run.smithi144.stdout:____ ERROR at setup of test_access_bucket_publicread_object_publicreadwrite ____ 2024-06-04T16:22:30.745 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.745 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.745 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.745 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.745 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.745 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.745 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.746 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.746 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.746 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.746 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.746 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.746 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.746 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.746 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.746 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.746 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.746 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.746 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.746 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.746 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.747 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.747 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.747 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.747 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.747 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.747 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.747 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.747 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.747 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.747 INFO:teuthology.orchestra.run.smithi144.stdout:_____ ERROR at setup of test_access_bucket_publicreadwrite_object_private ______ 2024-06-04T16:22:30.747 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.747 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.747 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.747 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.748 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.748 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.748 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.748 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.748 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.748 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.748 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.748 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.748 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.748 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.748 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.748 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.748 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.748 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.749 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.749 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.749 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.749 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.749 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.749 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.749 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.749 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.749 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.749 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.749 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.749 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.749 INFO:teuthology.orchestra.run.smithi144.stdout:____ ERROR at setup of test_access_bucket_publicreadwrite_object_publicread ____ 2024-06-04T16:22:30.749 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.749 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.750 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.750 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.750 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.750 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.750 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.750 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.750 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.750 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.750 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.750 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.750 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.750 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.750 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.751 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.751 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.751 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.751 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.751 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.751 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.751 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.751 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.751 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.751 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.751 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.751 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.751 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.751 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.752 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.752 INFO:teuthology.orchestra.run.smithi144.stdout:_ ERROR at setup of test_access_bucket_publicreadwrite_object_publicreadwrite __ 2024-06-04T16:22:30.752 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.752 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.752 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.752 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.752 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.752 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.752 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.752 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.752 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.752 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.752 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.752 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.753 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.753 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.753 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.753 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.753 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.753 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.753 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.753 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.753 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.753 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.753 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.753 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.753 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.753 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.754 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.754 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.754 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.754 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.754 INFO:teuthology.orchestra.run.smithi144.stdout:_______________ ERROR at setup of test_buckets_create_then_list ________________ 2024-06-04T16:22:30.754 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.754 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.754 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.754 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.754 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.754 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.754 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.754 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.754 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.755 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.755 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.755 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.755 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.755 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.755 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.755 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.755 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.755 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.755 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.755 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.755 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.755 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.755 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.755 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.756 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.756 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.756 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.756 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.756 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.756 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.756 INFO:teuthology.orchestra.run.smithi144.stdout:__________________ ERROR at setup of test_buckets_list_ctime ___________________ 2024-06-04T16:22:30.756 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.756 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.756 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.756 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.756 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.756 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.756 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.756 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.757 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.757 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.757 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.757 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.757 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.757 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.757 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.757 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.757 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.757 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.757 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.757 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.757 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.757 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.758 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.758 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.758 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.758 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.758 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.758 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.758 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.758 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.758 INFO:teuthology.orchestra.run.smithi144.stdout:________________ ERROR at setup of test_list_buckets_anonymous _________________ 2024-06-04T16:22:30.758 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.758 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.758 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.758 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.758 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.759 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.759 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.759 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.759 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.759 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.759 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.759 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.759 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.759 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.759 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.759 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.759 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.759 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.759 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.759 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.760 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.760 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.760 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.760 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.760 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.760 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.760 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.760 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.760 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.760 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.760 INFO:teuthology.orchestra.run.smithi144.stdout:_______________ ERROR at setup of test_list_buckets_invalid_auth _______________ 2024-06-04T16:22:30.760 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.760 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.760 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.760 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.761 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.761 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.761 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.761 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.761 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.761 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.761 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.761 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.761 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.761 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.761 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.761 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.761 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.761 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.762 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.762 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.762 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.762 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.762 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.762 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.762 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.762 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.762 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.762 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.762 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.762 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.762 INFO:teuthology.orchestra.run.smithi144.stdout:_________________ ERROR at setup of test_list_buckets_bad_auth _________________ 2024-06-04T16:22:30.763 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.763 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.763 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.763 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.763 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.763 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.763 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.763 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.763 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.763 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.763 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.763 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.763 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.763 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.763 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.764 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.764 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.764 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.764 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.764 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.764 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.764 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.764 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.764 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.764 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.764 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.764 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.764 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.764 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.764 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.765 INFO:teuthology.orchestra.run.smithi144.stdout:________ ERROR at setup of test_bucket_create_naming_good_starts_alpha _________ 2024-06-04T16:22:30.765 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.765 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.765 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.765 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.765 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.765 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.765 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.765 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.765 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.765 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.765 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.765 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.765 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.766 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.766 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.766 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.766 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.766 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.766 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.766 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.766 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.766 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.766 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.766 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.766 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.766 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.767 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.767 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.767 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.767 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.767 INFO:teuthology.orchestra.run.smithi144.stdout:________ ERROR at setup of test_bucket_create_naming_good_starts_digit _________ 2024-06-04T16:22:30.767 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.767 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.767 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.767 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.767 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.767 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.767 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.767 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.768 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.768 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.768 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.768 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.768 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.768 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.768 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.768 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.768 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.768 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.768 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.769 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.769 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.769 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.769 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.769 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.769 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.769 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.769 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.769 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.769 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.769 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.769 INFO:teuthology.orchestra.run.smithi144.stdout:_______ ERROR at setup of test_bucket_create_naming_good_contains_period _______ 2024-06-04T16:22:30.770 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.770 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.770 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.770 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.770 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.770 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.770 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.770 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.770 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.770 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.770 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.770 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.771 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.771 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.771 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.771 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.771 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.771 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.771 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.771 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.771 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.771 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.771 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.771 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.771 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.771 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.771 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.772 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.772 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.772 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.772 INFO:teuthology.orchestra.run.smithi144.stdout:_______ ERROR at setup of test_bucket_create_naming_good_contains_hyphen _______ 2024-06-04T16:22:30.772 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.772 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.772 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.772 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.772 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.772 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.772 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.772 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.772 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.772 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.773 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.773 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.773 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.773 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.773 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.773 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.773 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.773 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.773 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.773 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.773 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.773 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.773 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.773 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.774 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.774 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.774 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.774 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.774 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.774 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.774 INFO:teuthology.orchestra.run.smithi144.stdout:____________ ERROR at setup of test_bucket_recreate_not_overriding _____________ 2024-06-04T16:22:30.774 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.774 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.774 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.774 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.774 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.775 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.775 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.775 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.775 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.775 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.775 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.775 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.775 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.775 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.775 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.775 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.775 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.775 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.775 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.776 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.776 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.776 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.776 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.776 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.776 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.776 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.776 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.776 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.776 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.776 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.776 INFO:teuthology.orchestra.run.smithi144.stdout:____________ ERROR at setup of test_bucket_create_special_key_names ____________ 2024-06-04T16:22:30.776 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.777 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.777 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.777 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.777 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.777 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.777 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.777 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.777 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.777 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.777 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.777 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.777 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.777 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.777 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.778 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.778 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.778 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.778 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.778 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.778 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.778 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.778 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.778 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.778 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.778 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.778 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.778 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.779 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.779 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.779 INFO:teuthology.orchestra.run.smithi144.stdout:______________ ERROR at setup of test_bucket_list_special_prefix _______________ 2024-06-04T16:22:30.779 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.779 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.779 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.779 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.779 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.779 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.779 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.779 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.779 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.779 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.779 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.779 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.780 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.780 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.780 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.780 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.780 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.780 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.780 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.780 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.780 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.780 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.780 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.780 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.780 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.780 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.781 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.781 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.781 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.781 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.781 INFO:teuthology.orchestra.run.smithi144.stdout:_________________ ERROR at setup of test_object_copy_zero_size _________________ 2024-06-04T16:22:30.781 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.781 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.781 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.781 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.781 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.781 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.781 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.781 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.781 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.782 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.782 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.782 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.782 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.782 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.782 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.782 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.782 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.782 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.782 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.782 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.782 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.782 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.783 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.783 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.783 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.783 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.783 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.783 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.783 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.783 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.783 INFO:teuthology.orchestra.run.smithi144.stdout:____________________ ERROR at setup of test_object_copy_16m ____________________ 2024-06-04T16:22:30.783 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.783 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.783 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.783 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.783 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.783 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.784 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.784 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.784 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.784 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.784 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.784 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.784 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.784 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.784 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.784 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.784 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.784 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.784 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.784 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.785 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.785 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.785 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.785 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.785 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.785 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.785 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.785 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.785 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.785 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.785 INFO:teuthology.orchestra.run.smithi144.stdout:________________ ERROR at setup of test_object_copy_same_bucket ________________ 2024-06-04T16:22:30.785 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.785 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.785 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.785 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.786 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.786 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.786 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.786 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.786 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.786 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.786 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.786 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.786 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.786 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.786 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.786 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.786 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.787 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.787 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.787 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.787 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.787 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.787 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.787 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.787 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.787 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.787 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.787 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.787 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.787 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.787 INFO:teuthology.orchestra.run.smithi144.stdout:____________ ERROR at setup of test_object_copy_verify_contenttype _____________ 2024-06-04T16:22:30.787 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.788 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.788 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.788 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.788 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.788 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.788 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.788 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.788 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.788 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.788 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.788 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.788 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.788 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.788 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.789 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.789 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.789 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.789 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.789 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.789 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.789 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.789 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.789 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.789 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.789 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.789 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.789 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.789 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.789 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.790 INFO:teuthology.orchestra.run.smithi144.stdout:_________________ ERROR at setup of test_object_copy_to_itself _________________ 2024-06-04T16:22:30.790 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.790 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.790 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.790 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.790 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.790 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.790 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.790 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.790 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.790 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.790 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.790 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.791 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.791 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.791 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.791 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.791 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.791 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.791 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.791 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.791 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.791 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.791 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.791 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.791 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.791 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.792 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.792 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.792 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.792 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.792 INFO:teuthology.orchestra.run.smithi144.stdout:__________ ERROR at setup of test_object_copy_to_itself_with_metadata __________ 2024-06-04T16:22:30.792 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.792 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.792 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.792 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.792 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.792 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.792 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.793 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.793 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.793 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.793 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.793 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.793 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.793 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.793 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.793 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.793 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.793 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.793 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.794 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.794 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.794 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.794 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.794 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.794 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.794 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.794 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.794 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.794 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.794 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.794 INFO:teuthology.orchestra.run.smithi144.stdout:________________ ERROR at setup of test_object_copy_diff_bucket ________________ 2024-06-04T16:22:30.795 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.795 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.795 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.795 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.795 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.795 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.795 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.795 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.795 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.795 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.795 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.795 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.795 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.796 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.796 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.796 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.796 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.796 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.796 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.796 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.796 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.796 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.796 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.796 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.796 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.797 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.797 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.797 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.797 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.797 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.797 INFO:teuthology.orchestra.run.smithi144.stdout:_____________ ERROR at setup of test_object_copy_not_owned_bucket ______________ 2024-06-04T16:22:30.797 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.797 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.797 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.797 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.797 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.797 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.798 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.798 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.798 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.798 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.798 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.798 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.798 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.798 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.798 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.798 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.798 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.798 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.798 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.799 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.799 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.799 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.799 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.799 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.799 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.799 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.799 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.799 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.799 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.799 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.799 INFO:teuthology.orchestra.run.smithi144.stdout:__________ ERROR at setup of test_object_copy_not_owned_object_bucket __________ 2024-06-04T16:22:30.799 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.800 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.800 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.800 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.800 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.800 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.800 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.800 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.800 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.800 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.800 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.800 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.800 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.800 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.801 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.801 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.801 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.801 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.801 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.801 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.801 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.801 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.801 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.801 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.801 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.801 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.801 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.802 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.802 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.802 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.802 INFO:teuthology.orchestra.run.smithi144.stdout:________________ ERROR at setup of test_object_copy_canned_acl _________________ 2024-06-04T16:22:30.802 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.802 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.802 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.802 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.802 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.802 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.802 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.802 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.803 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.803 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.803 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.803 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.803 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.803 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.803 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.803 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.803 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.803 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.803 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.803 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.803 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.803 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.803 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.804 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.804 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.804 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.804 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.804 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.804 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.804 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.804 INFO:teuthology.orchestra.run.smithi144.stdout:____________ ERROR at setup of test_object_copy_retaining_metadata _____________ 2024-06-04T16:22:30.804 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.804 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.804 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.804 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.804 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.804 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.804 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.805 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.805 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.805 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.805 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.805 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.805 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.805 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.805 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.805 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.805 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.805 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.805 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.805 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.805 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.805 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.806 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.806 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.806 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.806 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.806 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.806 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.806 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.806 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.806 INFO:teuthology.orchestra.run.smithi144.stdout:____________ ERROR at setup of test_object_copy_replacing_metadata _____________ 2024-06-04T16:22:30.806 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.806 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.806 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.806 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.806 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.807 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.807 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.807 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.807 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.807 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.807 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.807 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.807 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.807 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.807 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.807 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.807 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.807 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.807 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.807 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.808 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.808 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.808 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.808 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.808 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.808 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.808 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.808 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.808 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.808 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.808 INFO:teuthology.orchestra.run.smithi144.stdout:_____________ ERROR at setup of test_object_copy_bucket_not_found ______________ 2024-06-04T16:22:30.808 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.808 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.808 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.808 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.808 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.809 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.809 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.809 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.809 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.809 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.809 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.809 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.809 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.809 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.809 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.809 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.809 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.809 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.809 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.810 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.810 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.810 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.810 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.810 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.810 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.810 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.810 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.810 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.810 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.810 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.810 INFO:teuthology.orchestra.run.smithi144.stdout:_______________ ERROR at setup of test_object_copy_key_not_found _______________ 2024-06-04T16:22:30.810 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.810 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.811 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.811 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.811 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.811 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.811 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.811 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.811 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.811 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.811 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.811 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.811 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.811 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.811 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.811 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.811 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.812 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.812 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.812 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.812 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.812 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.812 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.812 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.812 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.812 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.812 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.812 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.812 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.812 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.812 INFO:teuthology.orchestra.run.smithi144.stdout:_____________ ERROR at setup of test_object_copy_versioned_bucket ______________ 2024-06-04T16:22:30.812 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.813 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.813 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.813 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.813 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.813 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.813 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.813 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.813 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.813 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.813 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.813 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.813 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.813 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.813 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.814 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.814 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.814 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.814 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.814 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.814 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.814 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.814 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.814 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.814 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.814 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.814 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.814 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.814 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.815 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.815 INFO:teuthology.orchestra.run.smithi144.stdout:__________ ERROR at setup of test_object_copy_versioned_url_encoding ___________ 2024-06-04T16:22:30.815 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.815 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.815 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.815 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.815 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.815 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.815 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.815 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.815 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.815 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.815 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.815 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.816 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.816 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.816 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.816 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.816 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.816 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.816 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.816 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.816 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.816 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.816 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.816 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.816 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.816 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.816 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.817 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.817 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.817 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.817 INFO:teuthology.orchestra.run.smithi144.stdout:________ ERROR at setup of test_object_copy_versioning_multipart_upload ________ 2024-06-04T16:22:30.817 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.817 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.817 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.817 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.817 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.817 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.817 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.817 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.817 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.817 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.817 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.818 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.818 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.818 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.818 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.818 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.818 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.818 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.818 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.818 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.818 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.818 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.818 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.818 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.818 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.819 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.819 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.819 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.819 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.819 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.819 INFO:teuthology.orchestra.run.smithi144.stdout:________________ ERROR at setup of test_multipart_upload_empty _________________ 2024-06-04T16:22:30.819 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.819 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.819 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.819 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.819 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.819 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.819 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.820 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.820 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.820 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.820 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.820 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.820 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.820 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.820 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.820 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.820 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.820 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.820 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.820 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.820 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.821 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.821 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.821 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.821 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.821 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.821 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.821 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.821 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.821 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.821 INFO:teuthology.orchestra.run.smithi144.stdout:________________ ERROR at setup of test_multipart_upload_small _________________ 2024-06-04T16:22:30.821 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.821 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.821 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.821 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.821 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.822 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.822 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.822 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.822 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.822 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.822 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.822 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.822 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.822 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.822 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.822 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.822 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.822 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.822 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.823 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.823 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.823 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.823 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.823 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.823 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.823 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.823 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.823 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.823 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.823 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.823 INFO:teuthology.orchestra.run.smithi144.stdout:_________________ ERROR at setup of test_multipart_copy_small __________________ 2024-06-04T16:22:30.823 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.824 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.824 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.824 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.824 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.824 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.824 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.824 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.824 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.824 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.824 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.824 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.824 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.825 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.825 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.825 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.825 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.825 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.825 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.825 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.825 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.825 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.825 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.825 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.825 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.825 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.825 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.826 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.826 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.826 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.826 INFO:teuthology.orchestra.run.smithi144.stdout:_____________ ERROR at setup of test_multipart_copy_invalid_range ______________ 2024-06-04T16:22:30.826 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.826 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.826 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.826 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.826 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.826 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.826 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.826 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.827 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.827 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.827 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.827 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.827 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.827 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.827 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.827 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.827 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.827 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.827 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.827 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.827 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.827 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.827 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.828 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.828 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.828 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.828 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.828 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.828 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.828 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.828 INFO:teuthology.orchestra.run.smithi144.stdout:_____________ ERROR at setup of test_multipart_copy_without_range ______________ 2024-06-04T16:22:30.828 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.828 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.828 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.828 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.828 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.828 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.828 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.829 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.829 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.829 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.829 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.829 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.829 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.829 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.829 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.829 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.829 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.829 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.829 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.829 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.829 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.829 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.830 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.830 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.830 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.830 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.830 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.830 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.830 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.830 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.830 INFO:teuthology.orchestra.run.smithi144.stdout:_____________ ERROR at setup of test_multipart_copy_special_names ______________ 2024-06-04T16:22:30.830 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.830 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.830 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.830 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.830 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.831 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.831 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.831 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.831 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.831 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.831 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.831 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.831 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.831 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.831 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.831 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.831 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.831 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.831 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.831 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.832 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.832 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.832 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.832 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.832 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.832 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.832 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.832 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.832 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.832 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.832 INFO:teuthology.orchestra.run.smithi144.stdout:___________________ ERROR at setup of test_multipart_upload ____________________ 2024-06-04T16:22:30.832 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.832 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.833 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.833 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.833 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.833 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.833 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.833 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.833 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.833 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.833 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.833 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.833 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.833 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.833 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.833 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.833 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.834 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.834 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.834 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.834 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.834 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.834 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.834 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.834 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.834 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.834 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.834 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.834 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.834 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.835 INFO:teuthology.orchestra.run.smithi144.stdout:_______________ ERROR at setup of test_multipart_copy_versioned ________________ 2024-06-04T16:22:30.835 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.835 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.835 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.835 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.835 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.835 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.835 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.835 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.835 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.835 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.835 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.835 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.835 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.836 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.836 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.836 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.836 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.836 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.836 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.836 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.836 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.836 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.836 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.836 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.836 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.836 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.836 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.837 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.837 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.837 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.837 INFO:teuthology.orchestra.run.smithi144.stdout:_____________ ERROR at setup of test_multipart_upload_resend_part ______________ 2024-06-04T16:22:30.837 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.837 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.837 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.837 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.837 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.837 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.837 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.837 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.837 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.837 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.838 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.838 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.838 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.838 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.838 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.838 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.838 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.838 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.838 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.838 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.838 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.838 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.838 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.838 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.838 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.839 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.839 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.839 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.839 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.839 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.839 INFO:teuthology.orchestra.run.smithi144.stdout:____________ ERROR at setup of test_multipart_upload_multiple_sizes ____________ 2024-06-04T16:22:30.839 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.839 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.839 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.839 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.839 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.839 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.839 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.839 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.839 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.840 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.840 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.840 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.840 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.840 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.840 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.840 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.840 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.840 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.840 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.840 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.840 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.840 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.840 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.840 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.841 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.841 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.841 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.841 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.841 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.841 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.841 INFO:teuthology.orchestra.run.smithi144.stdout:_____________ ERROR at setup of test_multipart_copy_multiple_sizes _____________ 2024-06-04T16:22:30.841 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.841 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.841 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.841 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.841 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.841 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.842 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.842 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.842 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.842 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.842 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.842 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.842 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.842 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.842 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.842 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.842 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.842 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.843 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.843 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.843 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.843 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.843 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.843 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.843 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.843 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.843 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.843 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.843 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.843 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.843 INFO:teuthology.orchestra.run.smithi144.stdout:____________ ERROR at setup of test_multipart_upload_size_too_small ____________ 2024-06-04T16:22:30.844 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.844 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.844 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.844 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.844 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.844 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.844 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.844 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.844 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.844 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.844 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.844 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.844 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.845 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.845 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.845 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.845 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.845 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.845 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.845 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.845 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.845 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.845 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.845 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.845 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.845 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.845 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.846 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.846 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.846 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.846 INFO:teuthology.orchestra.run.smithi144.stdout:_______________ ERROR at setup of test_multipart_upload_contents _______________ 2024-06-04T16:22:30.846 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.846 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.846 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.846 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.846 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.846 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.846 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.846 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.847 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.847 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.847 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.847 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.847 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.847 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.847 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.847 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.847 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.847 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.847 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.847 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.847 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.847 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.847 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.848 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.848 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.848 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.848 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.848 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.848 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.848 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.848 INFO:teuthology.orchestra.run.smithi144.stdout:______ ERROR at setup of test_multipart_upload_overwrite_existing_object _______ 2024-06-04T16:22:30.848 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.848 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.848 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.848 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.848 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.848 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.848 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.849 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.849 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.849 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.849 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.849 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.849 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.849 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.849 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.849 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.849 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.849 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.849 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.849 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.849 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.850 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.850 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.850 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.850 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.850 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.850 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.850 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.850 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.850 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.850 INFO:teuthology.orchestra.run.smithi144.stdout:________________ ERROR at setup of test_abort_multipart_upload _________________ 2024-06-04T16:22:30.850 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.850 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.850 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.851 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.851 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.851 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.851 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.851 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.851 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.851 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.851 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.851 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.851 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.851 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.851 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.851 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.851 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.851 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.852 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.852 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.852 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.852 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.852 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.852 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.852 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.852 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.852 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.852 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.852 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.852 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.853 INFO:teuthology.orchestra.run.smithi144.stdout:___________ ERROR at setup of test_abort_multipart_upload_not_found ____________ 2024-06-04T16:22:30.853 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.853 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.853 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.853 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.853 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.853 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.853 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.853 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.853 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.853 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.853 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.854 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.854 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.854 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.854 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.854 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.854 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.854 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.854 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.854 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.854 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.854 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.854 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.854 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.855 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.855 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.855 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.855 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.855 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.855 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.855 INFO:teuthology.orchestra.run.smithi144.stdout:_________________ ERROR at setup of test_list_multipart_upload _________________ 2024-06-04T16:22:30.855 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.855 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.855 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.855 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.855 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.855 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.855 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.855 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.856 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.856 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.856 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.856 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.856 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.856 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.856 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.856 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.856 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.856 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.856 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.856 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.856 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.856 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.857 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.857 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.857 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.857 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.857 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.857 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.857 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.857 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.857 INFO:teuthology.orchestra.run.smithi144.stdout:______________ ERROR at setup of test_list_multipart_upload_owner ______________ 2024-06-04T16:22:30.857 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.857 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.857 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.857 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.857 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.857 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.858 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.858 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.858 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.858 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.858 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.858 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.858 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.858 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.858 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.858 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.858 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.858 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.858 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.858 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.859 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.859 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.859 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.859 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.859 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.859 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.859 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.859 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.859 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.859 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.859 INFO:teuthology.orchestra.run.smithi144.stdout:_____________ ERROR at setup of test_multipart_upload_missing_part _____________ 2024-06-04T16:22:30.859 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.859 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.859 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.859 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.860 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.860 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.860 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.860 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.860 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.860 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.860 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.860 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.860 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.860 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.860 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.860 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.860 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.860 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.860 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.861 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.861 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.861 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.861 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.861 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.861 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.861 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.861 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.861 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.861 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.861 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.861 INFO:teuthology.orchestra.run.smithi144.stdout:____________ ERROR at setup of test_multipart_upload_incorrect_etag ____________ 2024-06-04T16:22:30.861 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.861 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.862 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.862 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.862 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.862 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.862 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.862 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.862 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.862 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.862 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.862 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.862 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.862 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.862 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.863 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.863 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.863 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.863 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.863 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.863 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.863 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.863 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.863 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.863 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.863 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.863 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.863 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.863 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.864 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.864 INFO:teuthology.orchestra.run.smithi144.stdout:__________________ ERROR at setup of test_multipart_get_part ___________________ 2024-06-04T16:22:30.864 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.864 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.864 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.864 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.864 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.864 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.864 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.864 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.864 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.864 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.864 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.864 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.864 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.865 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.865 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.865 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.865 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.865 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.865 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.865 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.865 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.865 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.865 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.865 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.865 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.865 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.865 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.866 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.866 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.866 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.866 INFO:teuthology.orchestra.run.smithi144.stdout:________________ ERROR at setup of test_non_multipart_get_part _________________ 2024-06-04T16:22:30.866 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.866 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.866 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.866 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.866 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.866 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.866 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.866 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.866 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.867 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.867 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.867 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.867 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.867 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.867 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.867 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.867 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.867 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.867 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.867 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.867 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.867 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.867 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.867 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.868 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.868 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.868 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.868 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.868 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.868 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.868 INFO:teuthology.orchestra.run.smithi144.stdout:_____________________ ERROR at setup of test_100_continue ______________________ 2024-06-04T16:22:30.868 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.868 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.868 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.868 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.868 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.868 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.868 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.869 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.869 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.869 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.869 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.869 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.869 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.869 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.869 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.869 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.869 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.869 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.869 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.869 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.869 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.869 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.869 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.870 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.870 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.870 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.870 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.870 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.870 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.870 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.870 INFO:teuthology.orchestra.run.smithi144.stdout:_______________________ ERROR at setup of test_set_cors ________________________ 2024-06-04T16:22:30.870 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.870 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.870 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.871 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.871 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.871 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.871 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.871 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.871 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.871 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.871 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.871 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.871 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.871 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.871 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.872 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.872 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.872 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.872 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.872 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.872 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.872 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.872 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.872 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.872 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.872 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.872 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.873 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.873 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.873 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.873 INFO:teuthology.orchestra.run.smithi144.stdout:_________________ ERROR at setup of test_cors_origin_response __________________ 2024-06-04T16:22:30.873 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.873 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.873 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.873 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.873 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.873 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.873 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.873 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.874 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.874 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.874 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.874 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.874 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.874 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.874 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.874 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.874 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.874 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.874 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.875 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.875 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.875 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.875 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.875 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.875 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.875 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.875 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.875 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.875 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.875 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.876 INFO:teuthology.orchestra.run.smithi144.stdout:_________________ ERROR at setup of test_cors_origin_wildcard __________________ 2024-06-04T16:22:30.876 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.876 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.876 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.876 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.876 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.876 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.876 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.876 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.876 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.876 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.877 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.877 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.877 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.877 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.877 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.877 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.877 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.877 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.877 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.877 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.877 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.877 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.878 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.878 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.878 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.878 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.878 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.878 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.878 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.878 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.878 INFO:teuthology.orchestra.run.smithi144.stdout:__________________ ERROR at setup of test_cors_header_option ___________________ 2024-06-04T16:22:30.878 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.878 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.878 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.879 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.879 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.879 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.879 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.879 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.879 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.879 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.879 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.879 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.879 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.879 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.879 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.879 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.880 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.880 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.880 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.880 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.880 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.880 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.880 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.880 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.880 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.880 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.880 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.881 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.881 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.881 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.881 INFO:teuthology.orchestra.run.smithi144.stdout:_______________ ERROR at setup of test_cors_presigned_get_object _______________ 2024-06-04T16:22:30.881 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.881 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.881 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.881 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.881 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.881 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.881 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.881 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.881 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.882 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.882 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.882 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.882 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.882 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.882 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.882 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.882 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.882 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.882 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.882 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.882 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.883 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.883 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.883 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.883 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.883 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.883 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.883 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.883 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.883 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.883 INFO:teuthology.orchestra.run.smithi144.stdout:___________ ERROR at setup of test_cors_presigned_get_object_tenant ____________ 2024-06-04T16:22:30.883 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.883 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.884 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.884 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.884 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.884 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.884 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.884 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.884 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.884 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.884 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.884 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.884 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.884 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.885 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.885 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.885 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.885 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.885 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.885 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.885 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.885 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.885 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.885 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.885 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.885 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.886 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.886 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.886 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.886 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.886 INFO:teuthology.orchestra.run.smithi144.stdout:_______________ ERROR at setup of test_cors_presigned_put_object _______________ 2024-06-04T16:22:30.886 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.886 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.886 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.886 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.886 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.886 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.886 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.886 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.887 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.887 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.887 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.887 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.887 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.887 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.887 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.887 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.887 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.887 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.887 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.887 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.887 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.887 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.888 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.888 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.888 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.888 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.888 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.888 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.888 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.888 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.888 INFO:teuthology.orchestra.run.smithi144.stdout:__________ ERROR at setup of test_cors_presigned_put_object_with_acl ___________ 2024-06-04T16:22:30.888 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.888 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.888 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.888 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.888 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.889 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.889 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.889 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.889 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.889 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.889 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.889 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.889 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.889 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.889 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.889 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.889 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.889 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.890 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.890 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.890 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.890 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.890 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.890 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.890 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.890 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.890 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.890 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.890 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.890 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.891 INFO:teuthology.orchestra.run.smithi144.stdout:___________ ERROR at setup of test_cors_presigned_put_object_tenant ____________ 2024-06-04T16:22:30.891 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.891 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.891 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.891 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.891 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.891 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.891 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.891 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.891 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.891 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.891 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.891 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.891 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.892 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.892 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.892 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.892 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.892 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.892 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.892 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.892 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.892 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.892 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.892 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.892 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.892 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.893 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.893 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.893 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.893 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.893 INFO:teuthology.orchestra.run.smithi144.stdout:_______ ERROR at setup of test_cors_presigned_put_object_tenant_with_acl _______ 2024-06-04T16:22:30.893 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.893 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.893 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.893 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.893 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.893 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.893 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.893 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.893 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.894 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.894 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.894 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.894 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.894 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.894 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.894 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.894 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.894 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.894 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.894 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.894 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.894 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.895 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.895 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.895 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.895 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.895 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.895 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.895 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.895 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.895 INFO:teuthology.orchestra.run.smithi144.stdout:__________________ ERROR at setup of test_set_bucket_tagging ___________________ 2024-06-04T16:22:30.895 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.895 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.895 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.895 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.896 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.896 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.896 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.896 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.896 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.896 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.896 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.896 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.896 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.896 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.896 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.896 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.896 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.896 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.897 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.897 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.897 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.897 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.897 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.897 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.897 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.897 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.897 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.897 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.897 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.897 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.897 INFO:teuthology.orchestra.run.smithi144.stdout:____________________ ERROR at setup of test_atomic_read_1mb ____________________ 2024-06-04T16:22:30.897 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.897 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.898 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.898 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.898 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.898 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.898 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.898 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.898 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.898 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.898 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.898 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.898 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.898 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.898 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.898 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.899 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.899 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.899 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.899 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.899 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.899 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.899 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.899 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.899 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.899 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.899 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.899 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.899 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.899 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.899 INFO:teuthology.orchestra.run.smithi144.stdout:____________________ ERROR at setup of test_atomic_read_4mb ____________________ 2024-06-04T16:22:30.900 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.900 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.900 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.900 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.900 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.900 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.900 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.900 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.900 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.900 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.900 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.900 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.900 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.900 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.900 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.901 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.901 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.901 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.901 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.901 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.901 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.901 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.901 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.901 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.901 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.901 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.901 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.901 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.901 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.901 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.902 INFO:teuthology.orchestra.run.smithi144.stdout:____________________ ERROR at setup of test_atomic_read_8mb ____________________ 2024-06-04T16:22:30.902 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.902 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.902 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.902 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.902 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.902 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.902 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.902 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.902 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.902 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.902 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.902 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.903 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.903 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.903 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.903 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.903 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.903 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.903 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.903 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.903 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.903 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.903 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.903 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.903 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.903 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.903 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.904 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.904 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.904 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.904 INFO:teuthology.orchestra.run.smithi144.stdout:___________________ ERROR at setup of test_atomic_write_1mb ____________________ 2024-06-04T16:22:30.904 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.904 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.904 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.904 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.904 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.904 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.904 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.904 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.904 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.904 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.905 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.905 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.905 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.905 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.905 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.905 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.905 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.905 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.905 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.905 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.905 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.905 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.905 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.905 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.905 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.906 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.906 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.906 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.906 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.906 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.906 INFO:teuthology.orchestra.run.smithi144.stdout:___________________ ERROR at setup of test_atomic_write_4mb ____________________ 2024-06-04T16:22:30.906 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.906 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.906 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.906 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.906 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.906 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.907 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.907 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.907 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.907 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.907 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.907 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.907 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.907 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.907 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.907 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.907 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.907 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.907 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.907 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.908 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.908 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.908 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.908 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.908 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.908 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.908 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.908 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.908 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.908 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.908 INFO:teuthology.orchestra.run.smithi144.stdout:___________________ ERROR at setup of test_atomic_write_8mb ____________________ 2024-06-04T16:22:30.908 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.908 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.908 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.908 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.909 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.909 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.909 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.909 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.909 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.909 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.909 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.909 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.909 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.909 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.909 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.909 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.909 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.909 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.910 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.910 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.910 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.910 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.910 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.910 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.910 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.910 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.910 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.910 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.910 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.910 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.910 INFO:teuthology.orchestra.run.smithi144.stdout:_________________ ERROR at setup of test_atomic_dual_write_1mb _________________ 2024-06-04T16:22:30.911 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.911 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.911 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.911 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.911 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.911 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.911 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.911 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.911 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.911 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.911 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.911 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.911 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.911 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.912 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.912 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.912 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.912 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.912 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.912 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.912 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.912 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.912 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.912 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.912 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.912 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.912 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.913 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.913 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.913 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.913 INFO:teuthology.orchestra.run.smithi144.stdout:_________________ ERROR at setup of test_atomic_dual_write_4mb _________________ 2024-06-04T16:22:30.913 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.913 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.913 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.913 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.913 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.913 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.913 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.913 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.913 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.913 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.914 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.914 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.914 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.914 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.914 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.914 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.914 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.914 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.914 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.914 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.914 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.914 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.915 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.915 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.915 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.915 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.915 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.915 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.915 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.915 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.915 INFO:teuthology.orchestra.run.smithi144.stdout:_________________ ERROR at setup of test_atomic_dual_write_8mb _________________ 2024-06-04T16:22:30.915 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.915 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.915 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.915 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.916 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.916 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.916 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.916 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.916 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.916 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.916 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.916 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.916 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.916 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.916 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.916 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.917 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.917 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.917 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.917 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.917 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.917 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.917 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.917 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.917 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.917 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.917 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.917 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.917 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.917 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.918 INFO:teuthology.orchestra.run.smithi144.stdout:_____________ ERROR at setup of test_atomic_conditional_write_1mb ______________ 2024-06-04T16:22:30.918 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.918 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.918 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.918 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.918 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.918 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.918 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.918 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.918 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.918 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.918 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.919 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.919 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.919 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.919 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.919 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.919 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.919 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.919 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.919 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.919 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.919 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.919 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.919 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.920 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.920 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.920 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.920 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.920 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.920 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.920 INFO:teuthology.orchestra.run.smithi144.stdout:_____________ ERROR at setup of test_atomic_multipart_upload_write _____________ 2024-06-04T16:22:30.920 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.920 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.920 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.920 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.920 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.920 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.920 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.921 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.921 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.921 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.921 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.921 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.921 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.921 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.921 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.921 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.921 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.921 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.921 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.921 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.921 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.922 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.922 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.922 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.922 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.922 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.922 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.922 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.922 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.922 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.922 INFO:teuthology.orchestra.run.smithi144.stdout:_________ ERROR at setup of test_multipart_resend_first_finishes_last __________ 2024-06-04T16:22:30.922 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.922 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.923 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.923 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.923 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.923 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.923 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.923 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.923 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.923 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.923 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.923 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.923 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.923 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.923 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.924 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.924 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.924 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.924 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.924 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.924 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.924 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.924 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.924 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.924 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.924 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.924 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.924 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.925 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.925 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.925 INFO:teuthology.orchestra.run.smithi144.stdout:_____________ ERROR at setup of test_ranged_request_response_code ______________ 2024-06-04T16:22:30.925 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.925 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.925 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.925 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.925 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.925 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.925 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.925 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.925 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.925 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.926 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.926 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.926 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.926 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.926 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.926 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.926 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.926 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.926 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.926 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.926 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.926 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.926 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.927 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.927 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.927 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.927 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.927 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.927 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.927 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.927 INFO:teuthology.orchestra.run.smithi144.stdout:___________ ERROR at setup of test_ranged_big_request_response_code ____________ 2024-06-04T16:22:30.927 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.927 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.927 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.927 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.927 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.927 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.928 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.928 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.928 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.928 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.928 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.928 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.928 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.928 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.928 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.928 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.928 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.928 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.928 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.929 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.929 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.929 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.929 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.929 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.929 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.929 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.929 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.929 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.929 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.929 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.929 INFO:teuthology.orchestra.run.smithi144.stdout:____ ERROR at setup of test_ranged_request_skip_leading_bytes_response_code ____ 2024-06-04T16:22:30.929 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.930 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.930 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.930 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.930 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.930 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.930 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.930 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.930 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.930 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.930 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.930 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.930 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.930 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.931 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.931 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.931 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.931 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.931 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.931 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.931 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.931 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.931 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.931 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.931 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.931 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.931 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.932 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.932 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.932 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.932 INFO:teuthology.orchestra.run.smithi144.stdout:__ ERROR at setup of test_ranged_request_return_trailing_bytes_response_code ___ 2024-06-04T16:22:30.932 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.932 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.932 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.932 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.932 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.932 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.932 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.932 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.932 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.933 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.933 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.933 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.933 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.933 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.933 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.933 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.933 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.933 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.933 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.933 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.933 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.933 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.933 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.934 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.934 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.934 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.934 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.934 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.934 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.934 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.934 INFO:teuthology.orchestra.run.smithi144.stdout:_____________ ERROR at setup of test_ranged_request_invalid_range ______________ 2024-06-04T16:22:30.934 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.934 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.934 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.934 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.934 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.935 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.935 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.935 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.935 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.935 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.935 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.935 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.935 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.935 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.935 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.935 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.935 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.935 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.935 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.936 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.936 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.936 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.936 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.936 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.936 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.936 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.936 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.936 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.936 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.936 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.936 INFO:teuthology.orchestra.run.smithi144.stdout:______________ ERROR at setup of test_ranged_request_empty_object ______________ 2024-06-04T16:22:30.936 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.936 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.937 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.937 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.937 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.937 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.937 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.937 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.937 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.937 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.937 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.937 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.937 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.937 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.937 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.937 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.937 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.938 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.938 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.938 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.938 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.938 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.938 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.938 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.938 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.938 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.938 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.938 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.938 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.938 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.938 INFO:teuthology.orchestra.run.smithi144.stdout:___________ ERROR at setup of test_versioning_bucket_create_suspend ____________ 2024-06-04T16:22:30.939 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.939 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.939 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.939 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.939 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.939 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.939 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.939 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.939 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.939 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.939 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.939 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.939 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.939 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.939 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.940 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.940 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.940 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.940 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.940 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.940 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.940 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.940 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.940 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.940 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.940 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.940 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.940 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.940 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.941 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.941 INFO:teuthology.orchestra.run.smithi144.stdout:___________ ERROR at setup of test_versioning_obj_create_read_remove ___________ 2024-06-04T16:22:30.941 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.941 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.941 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.941 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.941 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.941 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.941 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.941 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.941 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.941 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.941 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.941 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.942 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.942 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.942 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.942 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.942 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.942 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.942 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.942 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.942 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.942 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.943 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.943 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.943 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.943 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.943 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.943 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.943 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.943 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.943 INFO:teuthology.orchestra.run.smithi144.stdout:________ ERROR at setup of test_versioning_obj_create_read_remove_head _________ 2024-06-04T16:22:30.943 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.943 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.943 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.943 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.943 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.943 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.944 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.944 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.944 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.944 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.944 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.944 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.944 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.944 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.944 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.944 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.944 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.944 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.945 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.945 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.945 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.945 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.945 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.945 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.945 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.945 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.945 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.945 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.945 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.945 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.945 INFO:teuthology.orchestra.run.smithi144.stdout:_______ ERROR at setup of test_versioning_obj_plain_null_version_removal _______ 2024-06-04T16:22:30.945 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.946 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.946 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.946 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.946 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.946 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.946 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.946 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.946 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.946 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.946 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.946 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.946 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.947 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.947 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.947 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.947 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.947 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.947 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.947 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.947 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.947 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.947 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.947 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.947 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.947 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.947 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.948 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.948 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.948 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.948 INFO:teuthology.orchestra.run.smithi144.stdout:______ ERROR at setup of test_versioning_obj_plain_null_version_overwrite ______ 2024-06-04T16:22:30.948 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.948 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.948 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.948 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.948 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.948 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.948 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.948 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.948 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.948 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.949 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.949 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.949 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.949 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.949 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.949 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.949 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.949 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.949 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.949 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.949 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.949 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.949 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.949 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.949 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.950 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.950 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.950 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.950 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.950 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.950 INFO:teuthology.orchestra.run.smithi144.stdout:_ ERROR at setup of test_versioning_obj_plain_null_version_overwrite_suspended _ 2024-06-04T16:22:30.950 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.950 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.950 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.950 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.950 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.950 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.950 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.951 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.951 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.951 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.951 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.951 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.951 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.951 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.951 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.951 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.951 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.951 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.951 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.951 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.951 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.951 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.952 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.952 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.952 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.952 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.952 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.952 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.952 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.952 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.952 INFO:teuthology.orchestra.run.smithi144.stdout:____________ ERROR at setup of test_versioning_obj_suspend_versions ____________ 2024-06-04T16:22:30.952 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.952 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.952 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.952 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.953 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.953 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.953 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.953 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.953 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.953 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.953 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.953 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.953 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.953 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.953 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.953 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.954 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.954 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.954 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.954 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.954 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.954 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.954 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.954 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.954 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.954 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.954 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.954 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.954 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.954 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.955 INFO:teuthology.orchestra.run.smithi144.stdout:_____________ ERROR at setup of test_versioning_obj_suspended_copy _____________ 2024-06-04T16:22:30.955 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.955 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.955 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.955 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.955 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.955 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.955 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.955 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.955 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.955 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.955 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.955 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.956 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.956 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.956 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.956 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.956 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.956 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.956 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.956 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.956 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.956 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.956 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.956 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.956 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.956 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.957 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.957 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.957 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.957 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.957 INFO:teuthology.orchestra.run.smithi144.stdout:_______ ERROR at setup of test_versioning_obj_create_versions_remove_all _______ 2024-06-04T16:22:30.957 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.957 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.957 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.957 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.957 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.957 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.957 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.957 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.958 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.958 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.958 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.958 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.958 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.958 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.958 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.958 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.958 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.958 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.958 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.958 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.958 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.959 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.959 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.959 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.959 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.959 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.959 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.959 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.959 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.959 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.959 INFO:teuthology.orchestra.run.smithi144.stdout:__ ERROR at setup of test_versioning_obj_create_versions_remove_special_names __ 2024-06-04T16:22:30.959 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.959 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.959 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.959 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.960 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.960 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.960 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.960 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.960 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.960 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.960 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.960 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.960 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.960 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.960 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.960 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.960 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.960 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.960 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.961 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.961 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.961 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.961 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.961 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.961 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.961 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.961 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.961 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.961 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.961 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.961 INFO:teuthology.orchestra.run.smithi144.stdout:_______ ERROR at setup of test_versioning_obj_create_overwrite_multipart _______ 2024-06-04T16:22:30.961 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.961 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.962 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.962 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.962 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.962 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.962 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.962 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.962 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.962 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.962 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.962 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.962 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.962 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.962 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.963 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.963 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.963 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.963 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.963 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.963 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.963 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.963 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.963 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.963 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.963 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.963 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.963 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.963 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.964 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.964 INFO:teuthology.orchestra.run.smithi144.stdout:______________ ERROR at setup of test_versioning_obj_list_marker _______________ 2024-06-04T16:22:30.964 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.964 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.964 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.964 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.964 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.964 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.964 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.964 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.964 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.964 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.964 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.964 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.965 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.965 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.965 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.965 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.965 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.965 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.965 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.965 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.965 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.965 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.965 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.965 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.965 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.965 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.965 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.966 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.966 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.966 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.966 INFO:teuthology.orchestra.run.smithi144.stdout:______________ ERROR at setup of test_versioning_copy_obj_version ______________ 2024-06-04T16:22:30.966 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.966 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.966 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.966 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.966 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.966 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.966 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.966 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.966 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.966 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.967 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.967 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.967 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.967 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.967 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.967 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.967 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.967 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.967 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.967 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.967 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.967 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.967 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.968 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.968 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.968 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.968 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.968 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.968 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.968 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.968 INFO:teuthology.orchestra.run.smithi144.stdout:____________ ERROR at setup of test_versioning_multi_object_delete _____________ 2024-06-04T16:22:30.968 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.968 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.968 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.968 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.968 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.968 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.969 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.969 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.969 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.969 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.969 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.969 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.969 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.969 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.969 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.969 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.969 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.969 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.969 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.969 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.970 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.970 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.970 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.970 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.970 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.970 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.970 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.970 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.970 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.970 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.970 INFO:teuthology.orchestra.run.smithi144.stdout:______ ERROR at setup of test_versioning_multi_object_delete_with_marker _______ 2024-06-04T16:22:30.970 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.970 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.971 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.971 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.971 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.971 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.971 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.971 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.971 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.971 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.971 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.971 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.971 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.971 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.971 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.972 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.972 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.972 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.972 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.972 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.972 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.972 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.972 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.972 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.972 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.972 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.972 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.973 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.973 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.973 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.973 INFO:teuthology.orchestra.run.smithi144.stdout:___ ERROR at setup of test_versioning_multi_object_delete_with_marker_create ___ 2024-06-04T16:22:30.973 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.973 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.973 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.973 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.973 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.973 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.973 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.973 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.974 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.974 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.974 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.974 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.974 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.974 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.974 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.974 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.974 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.974 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.974 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.974 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.974 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.974 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.975 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.975 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.975 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.975 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.975 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.975 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.975 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.975 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.975 INFO:teuthology.orchestra.run.smithi144.stdout:_________________ ERROR at setup of test_versioned_object_acl __________________ 2024-06-04T16:22:30.975 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.975 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.975 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.975 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.975 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.976 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.976 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.976 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.976 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.976 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.976 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.976 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.976 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.976 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.976 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.976 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.976 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.976 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.976 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.976 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.977 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.977 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.977 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.977 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.977 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.977 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.977 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.977 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.977 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.977 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.977 INFO:teuthology.orchestra.run.smithi144.stdout:_______ ERROR at setup of test_versioned_object_acl_no_version_specified _______ 2024-06-04T16:22:30.977 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.978 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.978 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.978 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.978 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.978 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.978 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.978 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.978 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.978 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.978 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.979 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.979 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.979 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.979 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.979 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.979 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.979 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.979 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.979 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.979 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.979 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.979 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.980 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.980 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.980 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.980 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.980 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.980 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.980 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.980 INFO:teuthology.orchestra.run.smithi144.stdout:_____ ERROR at setup of test_versioned_concurrent_object_create_and_remove _____ 2024-06-04T16:22:30.980 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.980 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.980 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.980 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.980 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.980 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.981 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.981 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.981 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.981 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.981 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.981 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.981 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.981 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.981 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.981 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.981 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.981 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.981 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.981 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.981 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.982 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.982 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.982 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.982 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.982 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.982 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.982 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.982 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.982 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.982 INFO:teuthology.orchestra.run.smithi144.stdout:_____________________ ERROR at setup of test_lifecycle_set _____________________ 2024-06-04T16:22:30.982 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.982 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.982 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.983 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.983 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.983 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.983 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.983 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.983 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.983 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.983 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.983 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.983 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.984 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.984 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.984 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.984 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.984 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.984 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.984 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.984 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.984 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.984 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.984 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.985 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.985 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.985 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.985 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.985 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.985 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.985 INFO:teuthology.orchestra.run.smithi144.stdout:_____________________ ERROR at setup of test_lifecycle_get _____________________ 2024-06-04T16:22:30.985 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.985 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.985 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.985 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.985 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.985 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.985 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.986 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.986 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.986 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.986 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.986 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.986 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.986 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.986 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.986 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.986 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.986 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.986 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.986 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.987 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.987 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.987 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.987 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.987 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.987 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.987 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.987 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.987 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.987 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.987 INFO:teuthology.orchestra.run.smithi144.stdout:__________________ ERROR at setup of test_lifecycle_get_no_id __________________ 2024-06-04T16:22:30.987 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.987 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.987 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.987 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.988 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.988 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.988 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.988 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.988 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.988 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.988 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.988 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.988 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.988 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.988 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.988 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.988 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.988 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.988 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.989 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.989 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.989 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.989 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.989 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.989 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.989 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.989 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.989 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.989 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.989 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.989 INFO:teuthology.orchestra.run.smithi144.stdout:_________________ ERROR at setup of test_lifecycle_id_too_long _________________ 2024-06-04T16:22:30.989 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.989 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.990 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.990 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.990 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.990 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.990 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.990 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.990 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.990 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.990 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.990 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.990 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.990 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.990 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.990 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.991 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.991 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.991 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.991 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.991 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.991 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.991 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.991 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.991 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.991 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.991 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.991 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.991 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.991 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.992 INFO:teuthology.orchestra.run.smithi144.stdout:___________________ ERROR at setup of test_lifecycle_same_id ___________________ 2024-06-04T16:22:30.992 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.992 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.992 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.992 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.992 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.992 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.992 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.992 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.992 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.992 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.992 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.992 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.992 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.993 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.993 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.993 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.993 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.993 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.993 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.993 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.993 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.993 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.993 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.993 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.993 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.993 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.993 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.993 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.993 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.994 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.994 INFO:teuthology.orchestra.run.smithi144.stdout:_______________ ERROR at setup of test_lifecycle_invalid_status ________________ 2024-06-04T16:22:30.994 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.994 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.994 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.994 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.994 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.994 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.994 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.994 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.994 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.994 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.994 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.995 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.995 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.995 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.995 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.995 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.995 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.995 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.995 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.995 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.995 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.995 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.995 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.995 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.995 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.995 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.995 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.996 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.996 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.996 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.996 INFO:teuthology.orchestra.run.smithi144.stdout:__________________ ERROR at setup of test_lifecycle_set_date ___________________ 2024-06-04T16:22:30.996 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.996 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.996 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.996 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.996 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.996 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.996 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.996 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.996 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.996 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.996 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.997 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.997 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.997 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.997 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.997 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.997 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.997 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:30.997 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:30.997 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.997 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:30.998 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:30.998 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:30.998 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:30.998 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:30.998 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:30.998 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:30.998 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:30.998 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.998 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:30.998 INFO:teuthology.orchestra.run.smithi144.stdout:______________ ERROR at setup of test_lifecycle_set_invalid_date _______________ 2024-06-04T16:22:30.998 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.998 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:30.998 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:30.998 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:30.999 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.999 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:30.999 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.999 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:30.999 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:30.999 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:30.999 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:30.999 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:30.999 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.999 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:30.999 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:30.999 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:30.999 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:30.999 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:31.000 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:31.000 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.000 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:31.000 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:31.000 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:31.000 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:31.000 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:31.000 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:31.000 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:31.000 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:31.000 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.000 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:31.000 INFO:teuthology.orchestra.run.smithi144.stdout:_______________ ERROR at setup of test_lifecycle_set_noncurrent ________________ 2024-06-04T16:22:31.000 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.001 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:31.001 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:31.001 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:31.001 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.001 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:31.001 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.001 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:31.001 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:31.001 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:31.001 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:31.001 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.001 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.002 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:31.002 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:31.002 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.002 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:31.002 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:31.002 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:31.002 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.002 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:31.002 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:31.002 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:31.002 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:31.003 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:31.003 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:31.003 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:31.003 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:31.003 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.003 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:31.003 INFO:teuthology.orchestra.run.smithi144.stdout:______________ ERROR at setup of test_lifecycle_set_deletemarker _______________ 2024-06-04T16:22:31.003 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.003 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:31.003 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:31.003 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:31.003 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.004 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:31.004 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.004 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:31.004 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:31.004 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:31.004 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:31.004 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.004 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.004 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:31.004 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:31.004 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.004 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:31.005 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:31.005 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:31.005 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.005 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:31.005 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:31.005 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:31.005 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:31.005 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:31.005 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:31.005 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:31.005 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:31.005 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.005 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:31.006 INFO:teuthology.orchestra.run.smithi144.stdout:_________________ ERROR at setup of test_lifecycle_set_filter __________________ 2024-06-04T16:22:31.006 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.006 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:31.006 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:31.006 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:31.006 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.006 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:31.006 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.006 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:31.006 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:31.007 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:31.007 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:31.007 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.007 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.007 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:31.007 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:31.007 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.007 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:31.007 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:31.007 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:31.007 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.007 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:31.007 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:31.008 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:31.008 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:31.008 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:31.008 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:31.008 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:31.008 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:31.008 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.008 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:31.008 INFO:teuthology.orchestra.run.smithi144.stdout:______________ ERROR at setup of test_lifecycle_set_empty_filter _______________ 2024-06-04T16:22:31.008 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.008 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:31.008 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:31.008 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:31.009 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.009 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:31.009 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.009 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:31.009 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:31.009 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:31.009 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:31.009 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.009 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.009 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:31.009 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:31.009 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.009 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:31.009 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:31.010 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:31.010 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.010 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:31.010 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:31.010 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:31.010 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:31.010 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:31.010 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:31.010 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:31.010 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:31.010 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.010 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:31.011 INFO:teuthology.orchestra.run.smithi144.stdout:________________ ERROR at setup of test_lifecycle_set_multipart ________________ 2024-06-04T16:22:31.011 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.011 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:31.011 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:31.011 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:31.011 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.011 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:31.011 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.011 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:31.011 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:31.011 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:31.011 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:31.011 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.012 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.012 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:31.012 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:31.012 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.012 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:31.012 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:31.012 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:31.012 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.012 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:31.012 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:31.012 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:31.012 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:31.013 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:31.013 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:31.013 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:31.013 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:31.013 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.013 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:31.013 INFO:teuthology.orchestra.run.smithi144.stdout:_________ ERROR at setup of test_lifecycle_transition_set_invalid_date _________ 2024-06-04T16:22:31.013 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.013 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:31.013 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:31.013 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:31.013 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.013 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:31.014 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.014 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:31.014 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:31.014 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:31.014 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:31.014 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.014 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.014 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:31.014 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:31.014 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.014 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:31.014 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:31.015 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:31.015 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.015 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:31.015 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:31.015 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:31.015 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:31.015 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:31.015 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:31.015 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:31.015 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:31.015 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.015 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:31.015 INFO:teuthology.orchestra.run.smithi144.stdout:_________________ ERROR at setup of test_encrypted_transfer_1b _________________ 2024-06-04T16:22:31.015 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.016 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:31.016 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:31.016 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:31.016 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.016 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:31.016 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.016 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:31.016 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:31.016 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:31.016 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:31.016 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.016 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.016 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:31.016 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:31.017 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.017 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:31.017 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:31.017 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:31.017 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.017 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:31.017 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:31.017 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:31.017 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:31.017 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:31.017 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:31.017 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:31.017 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:31.018 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.018 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:31.018 INFO:teuthology.orchestra.run.smithi144.stdout:________________ ERROR at setup of test_encrypted_transfer_1kb _________________ 2024-06-04T16:22:31.018 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.018 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:31.018 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:31.018 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:31.018 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.018 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:31.018 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.018 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:31.018 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:31.018 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:31.019 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:31.019 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.019 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.019 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:31.019 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:31.019 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.019 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:31.019 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:31.019 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:31.019 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.019 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:31.019 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:31.019 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:31.020 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:31.020 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:31.020 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:31.020 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:31.020 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:31.020 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.020 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:31.020 INFO:teuthology.orchestra.run.smithi144.stdout:________________ ERROR at setup of test_encrypted_transfer_1MB _________________ 2024-06-04T16:22:31.020 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.020 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:31.020 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:31.020 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:31.020 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.021 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:31.021 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.021 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:31.021 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:31.021 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:31.021 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:31.021 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.021 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.021 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:31.021 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:31.021 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.021 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:31.022 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:31.022 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:31.022 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.022 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:31.022 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:31.022 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:31.022 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:31.022 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:31.022 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:31.022 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:31.022 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:31.022 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.023 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:31.023 INFO:teuthology.orchestra.run.smithi144.stdout:________________ ERROR at setup of test_encrypted_transfer_13b _________________ 2024-06-04T16:22:31.023 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.023 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:31.023 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:31.023 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:31.023 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.023 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:31.023 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.023 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:31.023 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:31.023 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:31.023 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:31.024 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.024 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.024 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:31.024 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:31.024 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.024 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:31.024 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:31.024 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:31.024 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.024 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:31.024 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:31.024 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:31.024 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:31.024 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:31.025 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:31.025 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:31.025 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:31.025 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.025 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:31.025 INFO:teuthology.orchestra.run.smithi144.stdout:_____________ ERROR at setup of test_encryption_sse_c_method_head ______________ 2024-06-04T16:22:31.025 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.025 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:31.025 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:31.025 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:31.025 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.025 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:31.025 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.026 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:31.026 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:31.026 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:31.026 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:31.026 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.026 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.026 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:31.026 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:31.026 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.026 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:31.026 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:31.026 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:31.026 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.027 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:31.027 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:31.027 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:31.027 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:31.027 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:31.027 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:31.027 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:31.027 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:31.027 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.027 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:31.027 INFO:teuthology.orchestra.run.smithi144.stdout:_______________ ERROR at setup of test_encryption_sse_c_present ________________ 2024-06-04T16:22:31.027 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.027 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:31.028 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:31.028 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:31.028 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.028 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:31.028 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.028 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:31.028 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:31.028 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:31.028 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:31.028 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.028 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.028 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:31.028 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:31.028 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.029 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:31.029 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:31.029 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:31.029 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.029 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:31.029 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:31.029 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:31.029 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:31.029 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:31.029 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:31.029 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:31.029 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:31.029 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.030 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:31.030 INFO:teuthology.orchestra.run.smithi144.stdout:______________ ERROR at setup of test_encryption_sse_c_other_key _______________ 2024-06-04T16:22:31.030 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.030 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:31.030 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:31.030 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:31.030 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.030 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:31.030 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.030 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:31.030 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:31.030 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:31.030 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:31.031 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.031 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.031 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:31.031 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:31.031 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.031 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:31.031 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:31.031 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:31.031 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.031 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:31.031 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:31.031 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:31.032 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:31.032 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:31.032 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:31.032 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:31.032 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:31.032 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.032 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:31.032 INFO:teuthology.orchestra.run.smithi144.stdout:_____________ ERROR at setup of test_encryption_sse_c_invalid_md5 ______________ 2024-06-04T16:22:31.032 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.032 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:31.032 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:31.032 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:31.032 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.032 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:31.033 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.033 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:31.033 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:31.033 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:31.033 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:31.033 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.033 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.033 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:31.033 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:31.033 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.033 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:31.033 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:31.033 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:31.034 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.034 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:31.034 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:31.034 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:31.034 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:31.034 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:31.034 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:31.034 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:31.034 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:31.034 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.034 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:31.034 INFO:teuthology.orchestra.run.smithi144.stdout:________________ ERROR at setup of test_encryption_sse_c_no_md5 ________________ 2024-06-04T16:22:31.034 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.035 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:31.035 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:31.035 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:31.035 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.035 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:31.035 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.035 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:31.035 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:31.035 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:31.035 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:31.035 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.035 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.035 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:31.035 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:31.036 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.036 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:31.036 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:31.036 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:31.036 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.036 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:31.036 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:31.036 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:31.036 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:31.036 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:31.036 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:31.036 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:31.036 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:31.036 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.036 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:31.037 INFO:teuthology.orchestra.run.smithi144.stdout:________________ ERROR at setup of test_encryption_sse_c_no_key ________________ 2024-06-04T16:22:31.037 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.037 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:31.037 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:31.037 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:31.037 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.037 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:31.037 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.037 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:31.037 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:31.037 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:31.037 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:31.037 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.037 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.037 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:31.038 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:31.038 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.038 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:31.038 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:31.038 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:31.038 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.038 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:31.038 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:31.038 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:31.038 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:31.038 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:31.038 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:31.038 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:31.039 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:31.039 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.039 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:31.039 INFO:teuthology.orchestra.run.smithi144.stdout:________________ ERROR at setup of test_encryption_key_no_sse_c ________________ 2024-06-04T16:22:31.039 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.039 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:31.039 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:31.039 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:31.039 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.039 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:31.039 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.039 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:31.039 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:31.039 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:31.040 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:31.040 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.040 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.040 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:31.040 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:31.040 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.040 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:31.040 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:31.040 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:31.040 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.040 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:31.040 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:31.041 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:31.041 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:31.041 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:31.041 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:31.041 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:31.041 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:31.041 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.041 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:31.041 INFO:teuthology.orchestra.run.smithi144.stdout:___________ ERROR at setup of test_encryption_sse_c_multipart_upload ___________ 2024-06-04T16:22:31.041 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.041 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:31.041 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:31.041 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:31.041 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.042 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:31.042 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.042 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:31.042 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:31.042 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:31.042 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:31.042 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.042 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.042 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:31.042 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:31.042 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.042 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:31.042 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:31.042 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:31.043 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.043 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:31.043 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:31.043 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:31.043 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:31.043 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:31.043 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:31.043 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:31.043 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:31.043 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.043 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:31.043 INFO:teuthology.orchestra.run.smithi144.stdout:______ ERROR at setup of test_encryption_sse_c_unaligned_multipart_upload ______ 2024-06-04T16:22:31.043 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.043 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:31.044 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:31.044 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:31.044 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.044 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:31.044 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.044 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:31.044 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:31.044 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:31.044 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:31.044 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.044 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.044 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:31.044 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:31.044 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.044 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:31.045 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:31.045 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:31.045 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.045 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:31.045 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:31.045 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:31.045 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:31.045 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:31.045 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:31.045 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:31.045 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:31.045 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.045 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:31.046 INFO:teuthology.orchestra.run.smithi144.stdout:________ ERROR at setup of test_encryption_sse_c_multipart_bad_download ________ 2024-06-04T16:22:31.046 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.046 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:31.046 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:31.046 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:31.046 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.046 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:31.046 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.046 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:31.046 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:31.046 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:31.046 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:31.046 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.046 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.047 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:31.047 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:31.047 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.047 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:31.047 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:31.047 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:31.047 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.047 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:31.047 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:31.047 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:31.047 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:31.047 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:31.047 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:31.047 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:31.047 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:31.048 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.048 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:31.048 INFO:teuthology.orchestra.run.smithi144.stdout:__ ERROR at setup of test_encryption_sse_c_post_object_authenticated_request ___ 2024-06-04T16:22:31.048 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.048 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:31.048 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:31.048 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:31.048 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.048 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:31.048 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.048 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:31.048 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:31.048 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:31.048 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:31.048 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.049 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.049 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:31.049 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:31.049 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.049 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:31.049 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:31.049 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:31.049 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.049 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:31.049 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:31.049 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:31.049 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:31.049 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:31.049 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:31.050 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:31.050 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:31.050 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.050 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:31.050 INFO:teuthology.orchestra.run.smithi144.stdout:__________________ ERROR at setup of test_sse_kms_method_head __________________ 2024-06-04T16:22:31.050 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.050 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:31.050 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:31.050 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:31.050 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.050 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:31.050 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.050 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:31.050 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:31.050 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:31.051 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:31.051 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.051 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.051 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:31.051 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:31.051 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.051 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:31.051 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:31.051 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:31.051 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.051 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:31.051 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:31.051 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:31.051 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:31.052 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:31.052 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:31.052 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:31.052 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:31.052 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.052 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:31.052 INFO:teuthology.orchestra.run.smithi144.stdout:____________________ ERROR at setup of test_sse_kms_present ____________________ 2024-06-04T16:22:31.052 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.052 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:31.052 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:31.052 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:31.052 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.052 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:31.052 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.052 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:31.053 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:31.053 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:31.053 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:31.053 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.053 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.053 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:31.053 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:31.053 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.053 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:31.053 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:31.053 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:31.053 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.053 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:31.053 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:31.054 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:31.054 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:31.054 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:31.054 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:31.054 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:31.054 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:31.054 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.054 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:31.054 INFO:teuthology.orchestra.run.smithi144.stdout:____________________ ERROR at setup of test_sse_kms_no_key _____________________ 2024-06-04T16:22:31.054 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.054 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:31.054 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:31.054 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:31.054 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.055 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:31.055 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.055 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:31.055 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:31.055 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:31.055 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:31.055 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.055 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.055 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:31.055 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:31.055 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.055 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:31.055 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:31.055 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:31.056 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.056 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:31.056 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:31.056 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:31.056 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:31.056 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:31.056 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:31.056 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:31.056 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:31.056 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.056 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:31.056 INFO:teuthology.orchestra.run.smithi144.stdout:_________________ ERROR at setup of test_sse_kms_not_declared __________________ 2024-06-04T16:22:31.056 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.057 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:31.057 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:31.057 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:31.057 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.057 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:31.057 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.057 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:31.057 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:31.057 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:31.057 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:31.057 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.057 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.057 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:31.058 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:31.058 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.058 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:31.058 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:31.058 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:31.058 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.058 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:31.058 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:31.058 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:31.058 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:31.058 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:31.058 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:31.058 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:31.059 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:31.059 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.059 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:31.059 INFO:teuthology.orchestra.run.smithi144.stdout:_______________ ERROR at setup of test_sse_kms_multipart_upload ________________ 2024-06-04T16:22:31.059 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.059 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:31.059 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:31.059 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:31.059 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.059 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:31.059 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.059 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:31.059 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:31.059 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:31.059 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:31.060 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.060 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.060 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:31.060 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:31.060 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.060 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:31.060 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:31.060 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:31.060 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.060 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:31.060 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:31.061 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:31.061 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:31.061 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:31.061 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:31.061 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:31.061 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:31.061 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.061 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:31.061 INFO:teuthology.orchestra.run.smithi144.stdout:__________ ERROR at setup of test_sse_kms_multipart_invalid_chunks_1 ___________ 2024-06-04T16:22:31.061 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.061 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:31.061 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:31.061 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:31.062 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.062 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:31.062 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.062 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:31.062 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:31.062 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:31.062 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:31.062 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.062 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.062 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:31.062 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:31.062 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.062 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:31.063 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:31.063 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:31.063 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.063 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:31.063 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:31.063 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:31.063 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:31.063 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:31.063 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:31.063 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:31.063 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:31.063 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.063 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:31.063 INFO:teuthology.orchestra.run.smithi144.stdout:__________ ERROR at setup of test_sse_kms_multipart_invalid_chunks_2 ___________ 2024-06-04T16:22:31.064 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.064 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:31.064 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:31.064 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:31.064 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.064 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:31.064 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.064 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:31.064 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:31.064 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:31.064 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:31.064 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.064 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.064 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:31.064 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:31.065 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.065 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:31.065 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:31.065 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:31.065 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.065 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:31.065 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:31.065 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:31.065 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:31.065 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:31.065 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:31.065 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:31.065 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:31.065 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.065 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:31.066 INFO:teuthology.orchestra.run.smithi144.stdout:_______ ERROR at setup of test_sse_kms_post_object_authenticated_request _______ 2024-06-04T16:22:31.066 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.066 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:31.066 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:31.066 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:31.066 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.066 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:31.066 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.066 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:31.066 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:31.066 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:31.066 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:31.066 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.066 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.067 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:31.067 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:31.067 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.067 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:31.067 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:31.067 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:31.067 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.067 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:31.067 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:31.067 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:31.067 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:31.067 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:31.067 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:31.067 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:31.068 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:31.068 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.068 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:31.068 INFO:teuthology.orchestra.run.smithi144.stdout:__________________ ERROR at setup of test_sse_kms_transfer_1b __________________ 2024-06-04T16:22:31.068 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.068 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:31.068 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:31.068 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:31.068 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.068 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:31.068 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.068 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:31.068 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:31.068 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:31.069 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:31.069 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.069 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.069 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:31.069 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:31.069 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.069 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:31.069 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:31.069 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:31.069 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.069 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:31.069 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:31.070 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:31.070 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:31.070 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:31.070 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:31.070 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:31.070 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:31.070 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.070 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:31.070 INFO:teuthology.orchestra.run.smithi144.stdout:_________________ ERROR at setup of test_sse_kms_transfer_1kb __________________ 2024-06-04T16:22:31.070 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.070 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:31.070 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:31.071 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:31.071 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.071 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:31.071 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.071 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:31.071 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:31.071 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:31.071 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:31.071 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.071 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.071 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:31.071 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:31.071 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.071 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:31.071 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:31.072 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:31.072 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.072 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:31.072 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:31.072 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:31.072 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:31.072 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:31.072 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:31.072 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:31.072 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:31.072 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.073 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:31.073 INFO:teuthology.orchestra.run.smithi144.stdout:_________________ ERROR at setup of test_sse_kms_transfer_1MB __________________ 2024-06-04T16:22:31.073 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.073 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:31.073 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:31.073 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:31.073 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.073 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:31.073 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.073 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:31.073 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:31.073 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:31.073 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:31.074 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.074 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.074 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:31.074 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:31.074 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.074 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:31.074 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:31.074 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:31.074 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.074 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:31.074 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:31.074 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:31.075 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:31.075 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:31.075 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:31.075 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:31.075 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:31.075 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.075 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:31.075 INFO:teuthology.orchestra.run.smithi144.stdout:_________________ ERROR at setup of test_sse_kms_transfer_13b __________________ 2024-06-04T16:22:31.075 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.075 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:31.075 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:31.075 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:31.075 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.075 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:31.076 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.076 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:31.076 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:31.076 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:31.076 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:31.076 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.076 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.076 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:31.076 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:31.076 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.076 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:31.076 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:31.076 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:31.076 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.077 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:31.077 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:31.077 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:31.077 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:31.077 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:31.077 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:31.077 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:31.077 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:31.077 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.077 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:31.077 INFO:teuthology.orchestra.run.smithi144.stdout:_________________ ERROR at setup of test_sse_kms_read_declare __________________ 2024-06-04T16:22:31.077 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.077 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:31.077 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:31.078 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:31.078 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.078 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:31.078 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.078 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:31.078 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:31.078 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:31.078 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:31.078 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.078 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.078 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:31.078 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:31.079 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.079 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:31.079 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:31.079 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:31.079 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.079 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:31.079 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:31.079 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:31.079 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:31.079 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:31.079 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:31.079 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:31.079 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:31.079 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.080 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:31.080 INFO:teuthology.orchestra.run.smithi144.stdout:_____________________ ERROR at setup of test_bucket_policy _____________________ 2024-06-04T16:22:31.080 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.080 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:31.080 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:31.080 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:31.080 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.080 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:31.080 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.080 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:31.080 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:31.080 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:31.080 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:31.081 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.081 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.081 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:31.081 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:31.081 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.081 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:31.081 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:31.081 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:31.081 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.081 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:31.081 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:31.081 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:31.081 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:31.081 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:31.081 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:31.082 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:31.082 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:31.082 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.082 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:31.082 INFO:teuthology.orchestra.run.smithi144.stdout:____________________ ERROR at setup of test_bucketv2_policy ____________________ 2024-06-04T16:22:31.082 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.082 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:31.082 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:31.082 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:31.082 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.082 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:31.082 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.082 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:31.083 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:31.083 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:31.083 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:31.083 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.083 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.083 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:31.083 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:31.083 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.083 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:31.083 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:31.083 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:31.083 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.083 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:31.084 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:31.084 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:31.084 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:31.084 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:31.084 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:31.084 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:31.084 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:31.084 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.084 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:31.084 INFO:teuthology.orchestra.run.smithi144.stdout:___________________ ERROR at setup of test_bucket_policy_acl ___________________ 2024-06-04T16:22:31.084 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.084 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:31.084 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:31.085 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:31.085 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.085 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:31.085 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.085 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:31.085 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:31.085 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:31.085 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:31.085 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.085 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.085 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:31.085 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:31.086 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.086 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:31.086 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:31.086 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:31.086 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.086 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:31.086 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:31.086 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:31.086 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:31.086 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:31.086 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:31.087 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:31.087 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:31.087 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.087 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:31.087 INFO:teuthology.orchestra.run.smithi144.stdout:__________________ ERROR at setup of test_bucketv2_policy_acl __________________ 2024-06-04T16:22:31.087 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.087 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:31.087 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:31.087 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:31.087 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.087 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:31.087 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.087 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:31.088 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:31.088 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:31.088 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:31.088 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.088 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.088 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:31.088 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:31.088 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.088 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:31.088 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:31.088 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:31.088 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.088 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:31.089 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:31.089 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:31.089 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:31.089 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:31.089 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:31.089 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:31.089 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:31.089 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.089 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:31.089 INFO:teuthology.orchestra.run.smithi144.stdout:_____________ ERROR at setup of test_bucket_policy_another_bucket ______________ 2024-06-04T16:22:31.089 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.089 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:31.090 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:31.090 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:31.090 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.090 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:31.090 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.090 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:31.090 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:31.090 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:31.090 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:31.090 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.090 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.091 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:31.091 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:31.091 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.091 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:31.091 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:31.091 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:31.091 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.091 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:31.091 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:31.091 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:31.091 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:31.092 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:31.092 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:31.092 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:31.092 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:31.092 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.092 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:31.092 INFO:teuthology.orchestra.run.smithi144.stdout:____________ ERROR at setup of test_bucketv2_policy_another_bucket _____________ 2024-06-04T16:22:31.092 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.092 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:31.092 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:31.092 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:31.093 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.093 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:31.093 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.093 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:31.093 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:31.093 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:31.093 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:31.093 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.093 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.093 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:31.093 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:31.093 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.093 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:31.094 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:31.094 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:31.094 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.094 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:31.094 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:31.094 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:31.094 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:31.094 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:31.094 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:31.094 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:31.094 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:31.094 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.095 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:31.095 INFO:teuthology.orchestra.run.smithi144.stdout:____________________ ERROR at setup of test_get_obj_tagging ____________________ 2024-06-04T16:22:31.095 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.095 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:31.095 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:31.095 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:31.095 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.095 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:31.095 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.095 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:31.095 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:31.095 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:31.095 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:31.095 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.096 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.096 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:31.096 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:31.096 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.096 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:31.096 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:31.096 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:31.096 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.096 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:31.096 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:31.096 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:31.096 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:31.096 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:31.096 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:31.097 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:31.097 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:31.097 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.097 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:31.097 INFO:teuthology.orchestra.run.smithi144.stdout:_________________ ERROR at setup of test_get_obj_head_tagging __________________ 2024-06-04T16:22:31.097 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.097 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:31.097 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:31.097 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:31.097 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.097 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:31.097 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.097 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:31.097 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:31.097 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:31.098 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:31.098 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.098 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.098 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:31.098 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:31.098 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.098 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:31.098 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:31.098 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:31.098 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.098 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:31.098 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:31.098 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:31.099 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:31.099 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:31.099 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:31.099 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:31.099 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:31.099 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.099 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:31.099 INFO:teuthology.orchestra.run.smithi144.stdout:_____________________ ERROR at setup of test_put_max_tags ______________________ 2024-06-04T16:22:31.099 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.099 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:31.099 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:31.099 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:31.099 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.099 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:31.099 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.100 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:31.100 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:31.100 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:31.100 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:31.100 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.100 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.100 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:31.100 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:31.100 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.100 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:31.100 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:31.100 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:31.100 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.100 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:31.101 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:31.101 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:31.101 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:31.101 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:31.101 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:31.101 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:31.101 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:31.101 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.101 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:31.101 INFO:teuthology.orchestra.run.smithi144.stdout:____________________ ERROR at setup of test_put_excess_tags ____________________ 2024-06-04T16:22:31.101 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.101 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:31.101 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:31.101 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:31.102 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.102 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:31.102 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.102 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:31.102 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:31.102 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:31.102 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:31.102 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.102 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.102 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:31.102 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:31.102 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.102 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:31.103 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:31.103 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:31.103 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.103 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:31.103 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:31.103 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:31.103 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:31.103 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:31.103 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:31.103 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:31.103 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:31.103 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.103 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:31.103 INFO:teuthology.orchestra.run.smithi144.stdout:__________________ ERROR at setup of test_put_max_kvsize_tags __________________ 2024-06-04T16:22:31.103 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.103 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:31.104 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:31.104 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:31.104 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.104 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:31.104 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.104 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:31.104 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:31.104 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:31.104 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:31.104 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.104 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.104 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:31.104 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:31.104 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.104 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:31.105 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:31.105 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:31.105 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.105 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:31.105 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:31.105 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:31.105 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:31.105 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:31.105 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:31.105 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:31.105 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:31.105 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.105 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:31.105 INFO:teuthology.orchestra.run.smithi144.stdout:__________________ ERROR at setup of test_put_excess_key_tags __________________ 2024-06-04T16:22:31.105 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.106 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:31.106 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:31.106 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:31.106 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.106 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:31.106 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.106 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:31.106 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:31.106 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:31.106 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:31.106 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.106 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.106 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:31.106 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:31.107 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.107 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:31.107 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:31.107 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:31.107 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.107 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:31.107 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:31.107 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:31.107 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:31.107 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:31.107 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:31.107 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:31.107 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:31.107 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.108 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:31.108 INFO:teuthology.orchestra.run.smithi144.stdout:__________________ ERROR at setup of test_put_excess_val_tags __________________ 2024-06-04T16:22:31.108 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.108 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:31.108 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:31.108 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:31.108 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.108 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:31.108 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.108 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:31.108 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:31.109 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:31.109 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:31.109 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.109 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.109 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:31.109 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:31.109 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.109 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:31.109 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:31.109 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:31.109 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.109 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:31.109 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:31.110 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:31.110 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:31.110 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:31.110 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:31.110 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:31.110 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:31.110 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.110 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:31.110 INFO:teuthology.orchestra.run.smithi144.stdout:____________________ ERROR at setup of test_put_modify_tags ____________________ 2024-06-04T16:22:31.110 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.110 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:31.110 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:31.110 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:31.111 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.111 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:31.111 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.111 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:31.111 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:31.111 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:31.111 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:31.111 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.111 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.111 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:31.111 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:31.111 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.112 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:31.112 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:31.112 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:31.112 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.112 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:31.112 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:31.112 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:31.112 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:31.112 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:31.112 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:31.112 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:31.113 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:31.113 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.113 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:31.113 INFO:teuthology.orchestra.run.smithi144.stdout:____________________ ERROR at setup of test_put_delete_tags ____________________ 2024-06-04T16:22:31.113 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.113 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:31.113 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:31.113 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:31.113 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.113 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:31.113 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.113 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:31.113 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:31.113 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:31.114 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:31.114 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.114 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.114 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:31.114 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:31.114 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.114 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:31.114 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:31.114 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:31.114 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.114 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:31.114 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:31.115 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:31.115 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:31.115 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:31.115 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:31.115 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:31.115 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:31.115 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.115 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:31.115 INFO:teuthology.orchestra.run.smithi144.stdout:__________ ERROR at setup of test_post_object_tags_anonymous_request ___________ 2024-06-04T16:22:31.115 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.115 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:31.115 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:31.116 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:31.116 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.116 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:31.116 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.116 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:31.116 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:31.116 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:31.116 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:31.116 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.116 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.116 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:31.116 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:31.116 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.117 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:31.117 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:31.117 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:31.117 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.117 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:31.117 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:31.117 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:31.117 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:31.117 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:31.117 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:31.117 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:31.117 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:31.118 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.118 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:31.118 INFO:teuthology.orchestra.run.smithi144.stdout:________ ERROR at setup of test_post_object_tags_authenticated_request _________ 2024-06-04T16:22:31.118 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.118 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:31.118 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:31.118 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:31.118 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.118 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:31.119 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.119 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:31.119 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:31.119 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:31.119 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:31.119 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.119 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.119 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:31.119 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:31.119 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.119 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:31.119 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:31.119 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:31.120 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.120 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:31.120 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:31.120 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:31.120 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:31.120 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:31.120 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:31.120 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:31.120 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:31.120 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.120 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:31.120 INFO:teuthology.orchestra.run.smithi144.stdout:___________________ ERROR at setup of test_put_obj_with_tags ___________________ 2024-06-04T16:22:31.120 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.120 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:31.121 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:31.121 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:31.121 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.121 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:31.121 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.121 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:31.121 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:31.121 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:31.121 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:31.121 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.121 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.121 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:31.121 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:31.121 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.122 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:31.122 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:31.122 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:31.122 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.122 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:31.122 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:31.122 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:31.122 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:31.122 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:31.122 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:31.122 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:31.122 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:31.122 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.123 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:31.123 INFO:teuthology.orchestra.run.smithi144.stdout:__________________ ERROR at setup of test_get_tags_acl_public __________________ 2024-06-04T16:22:31.123 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.123 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:31.123 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:31.123 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:31.123 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.123 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:31.123 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.123 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:31.123 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:31.123 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:31.123 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:31.123 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.124 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.124 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:31.124 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:31.124 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.124 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:31.124 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:31.124 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:31.124 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.124 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:31.124 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:31.124 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:31.124 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:31.124 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:31.125 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:31.125 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:31.125 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:31.125 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.125 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:31.125 INFO:teuthology.orchestra.run.smithi144.stdout:__________________ ERROR at setup of test_put_tags_acl_public __________________ 2024-06-04T16:22:31.125 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.125 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:31.125 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:31.125 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:31.125 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.125 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:31.126 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.126 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:31.126 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:31.126 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:31.126 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:31.126 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.126 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.126 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:31.126 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:31.126 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.126 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:31.126 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:31.126 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:31.127 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.127 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:31.127 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:31.127 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:31.127 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:31.127 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:31.127 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:31.127 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:31.127 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:31.127 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.127 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:31.127 INFO:teuthology.orchestra.run.smithi144.stdout:________________ ERROR at setup of test_delete_tags_obj_public _________________ 2024-06-04T16:22:31.127 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.127 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:31.127 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:31.128 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:31.128 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.128 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:31.128 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.128 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:31.128 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:31.128 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:31.128 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:31.128 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.128 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.128 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:31.128 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:31.128 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.129 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:31.129 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:31.129 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:31.129 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.129 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:31.129 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:31.129 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:31.129 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:31.129 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:31.129 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:31.129 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:31.129 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:31.129 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.129 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:31.129 INFO:teuthology.orchestra.run.smithi144.stdout:___ ERROR at setup of test_versioning_bucket_atomic_upload_return_version_id ___ 2024-06-04T16:22:31.130 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.130 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:31.130 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:31.130 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:31.130 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.130 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:31.130 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.130 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:31.130 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:31.130 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:31.130 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:31.130 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.130 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.131 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:31.131 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:31.131 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.131 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:31.131 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:31.131 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:31.131 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.131 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:31.131 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:31.131 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:31.131 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:31.131 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:31.131 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:31.131 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:31.132 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:31.132 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.132 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:31.132 INFO:teuthology.orchestra.run.smithi144.stdout:_ ERROR at setup of test_versioning_bucket_multipart_upload_return_version_id __ 2024-06-04T16:22:31.132 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.132 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:31.132 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:31.132 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:31.132 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.132 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:31.132 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.132 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:31.132 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:31.132 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:31.133 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:31.133 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.133 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.133 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:31.133 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:31.133 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.133 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:31.133 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:31.133 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:31.133 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.133 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:31.133 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:31.133 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:31.133 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:31.133 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:31.134 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:31.134 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:31.134 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:31.134 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.134 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:31.134 INFO:teuthology.orchestra.run.smithi144.stdout:__________ ERROR at setup of test_bucket_policy_get_obj_existing_tag ___________ 2024-06-04T16:22:31.134 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.134 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:31.134 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:31.134 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:31.134 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.134 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:31.134 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.135 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:31.135 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:31.135 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:31.135 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:31.135 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.135 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.135 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:31.135 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:31.135 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.135 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:31.135 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:31.135 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:31.135 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.135 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:31.136 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:31.136 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:31.136 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:31.136 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:31.136 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:31.136 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:31.136 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:31.136 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.136 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:31.136 INFO:teuthology.orchestra.run.smithi144.stdout:______ ERROR at setup of test_bucket_policy_get_obj_tagging_existing_tag _______ 2024-06-04T16:22:31.136 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.136 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:31.136 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:31.136 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:31.136 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.137 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:31.137 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.137 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:31.137 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:31.137 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:31.137 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:31.137 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.137 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.137 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:31.137 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:31.137 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.137 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:31.137 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:31.137 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:31.137 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.138 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:31.138 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:31.138 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:31.138 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:31.138 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:31.138 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:31.138 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:31.138 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:31.138 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.138 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:31.138 INFO:teuthology.orchestra.run.smithi144.stdout:______ ERROR at setup of test_bucket_policy_put_obj_tagging_existing_tag _______ 2024-06-04T16:22:31.138 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.138 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:31.138 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:31.138 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:31.139 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.139 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:31.139 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.139 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:31.139 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:31.139 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:31.139 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:31.139 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.139 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.139 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:31.139 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:31.139 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.139 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:31.139 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:31.139 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:31.140 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.140 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:31.140 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:31.140 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:31.140 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:31.140 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:31.140 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:31.140 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:31.140 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:31.140 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.140 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:31.140 INFO:teuthology.orchestra.run.smithi144.stdout:___________ ERROR at setup of test_bucket_policy_put_obj_copy_source ___________ 2024-06-04T16:22:31.140 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.140 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:31.141 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:31.141 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:31.141 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.141 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:31.141 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.141 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:31.141 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:31.141 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:31.141 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:31.141 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.141 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.141 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:31.141 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:31.141 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.141 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:31.142 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:31.142 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:31.142 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.142 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:31.142 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:31.142 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:31.142 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:31.142 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:31.142 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:31.142 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:31.142 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:31.142 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.142 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:31.143 INFO:teuthology.orchestra.run.smithi144.stdout:________ ERROR at setup of test_bucket_policy_put_obj_copy_source_meta _________ 2024-06-04T16:22:31.143 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.143 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:31.143 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:31.143 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:31.143 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.143 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:31.143 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.143 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:31.143 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:31.143 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:31.143 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:31.143 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.143 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.143 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:31.144 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:31.144 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.144 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:31.144 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:31.144 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:31.144 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.144 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:31.144 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:31.144 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:31.144 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:31.144 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:31.144 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:31.144 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:31.144 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:31.144 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.145 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:31.145 INFO:teuthology.orchestra.run.smithi144.stdout:_______________ ERROR at setup of test_bucket_policy_put_obj_acl _______________ 2024-06-04T16:22:31.145 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.145 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:31.145 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:31.145 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:31.145 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.145 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:31.145 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.145 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:31.145 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:31.145 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:31.145 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:31.145 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.146 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.146 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:31.146 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:31.146 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.146 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:31.146 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:31.146 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:31.146 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.146 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:31.146 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:31.146 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:31.146 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:31.146 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:31.146 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:31.147 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:31.147 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:31.147 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.147 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:31.147 INFO:teuthology.orchestra.run.smithi144.stdout:______________ ERROR at setup of test_bucket_policy_put_obj_grant ______________ 2024-06-04T16:22:31.147 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.147 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:31.147 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:31.147 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:31.147 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.147 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:31.147 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.147 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:31.147 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:31.147 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:31.148 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:31.148 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.148 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.148 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:31.148 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:31.148 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.148 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:31.148 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:31.148 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:31.148 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.148 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:31.148 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:31.148 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:31.148 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:31.148 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:31.149 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:31.149 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:31.149 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:31.149 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.149 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:31.149 INFO:teuthology.orchestra.run.smithi144.stdout:_______________ ERROR at setup of test_put_obj_enc_conflict_c_s3 _______________ 2024-06-04T16:22:31.149 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.149 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:31.149 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:31.149 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:31.149 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.149 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:31.149 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.149 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:31.149 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:31.150 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:31.150 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:31.150 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.150 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.150 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:31.150 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:31.150 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.150 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:31.150 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:31.150 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:31.150 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.150 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:31.150 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:31.150 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:31.151 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:31.151 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:31.151 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:31.151 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:31.151 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:31.151 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.151 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:31.151 INFO:teuthology.orchestra.run.smithi144.stdout:______________ ERROR at setup of test_put_obj_enc_conflict_c_kms _______________ 2024-06-04T16:22:31.151 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.151 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:31.151 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:31.151 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:31.151 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.151 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:31.151 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.152 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:31.152 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:31.152 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:31.152 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:31.152 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.152 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.152 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:31.152 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:31.152 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.152 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:31.152 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:31.152 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:31.152 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.153 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:31.153 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:31.153 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:31.153 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:31.153 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:31.153 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:31.153 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:31.153 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:31.153 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.153 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:31.153 INFO:teuthology.orchestra.run.smithi144.stdout:______________ ERROR at setup of test_put_obj_enc_conflict_s3_kms ______________ 2024-06-04T16:22:31.153 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.153 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:31.153 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:31.154 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:31.154 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.154 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:31.154 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.154 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:31.154 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:31.154 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:31.154 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:31.154 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.154 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.154 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:31.154 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:31.155 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.155 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:31.155 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:31.155 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:31.155 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.155 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:31.155 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:31.155 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:31.155 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:31.155 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:31.155 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:31.155 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:31.155 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:31.155 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.156 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:31.156 INFO:teuthology.orchestra.run.smithi144.stdout:___________ ERROR at setup of test_put_obj_enc_conflict_bad_enc_kms ____________ 2024-06-04T16:22:31.156 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.156 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:31.156 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:31.156 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:31.156 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.156 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:31.156 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.156 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:31.156 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:31.156 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:31.156 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:31.156 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.156 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.157 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:31.157 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:31.157 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.157 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:31.157 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:31.157 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:31.157 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.157 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:31.157 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:31.157 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:31.157 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:31.157 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:31.157 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:31.157 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:31.158 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:31.158 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.158 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:31.158 INFO:teuthology.orchestra.run.smithi144.stdout:____________ ERROR at setup of test_bucket_policy_put_obj_kms_noenc ____________ 2024-06-04T16:22:31.158 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.158 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:31.158 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:31.158 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:31.158 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.158 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:31.158 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.158 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:31.158 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:31.159 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:31.159 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:31.159 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.159 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.159 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:31.159 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:31.159 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.159 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:31.159 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:31.159 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:31.159 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.159 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:31.159 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:31.159 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:31.160 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:31.160 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:31.160 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:31.160 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:31.160 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:31.160 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.160 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:31.160 INFO:teuthology.orchestra.run.smithi144.stdout:_____________ ERROR at setup of test_bucket_policy_put_obj_kms_s3 ______________ 2024-06-04T16:22:31.160 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.160 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:31.160 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:31.160 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:31.160 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.160 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:31.160 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.161 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:31.161 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:31.161 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:31.161 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:31.161 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.161 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.161 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:31.161 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:31.161 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.161 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:31.161 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:31.161 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:31.161 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.161 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:31.161 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:31.162 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:31.162 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:31.162 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:31.162 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:31.162 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:31.162 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:31.162 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.162 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:31.162 INFO:teuthology.orchestra.run.smithi144.stdout:________ ERROR at setup of test_bucket_policy_get_obj_acl_existing_tag _________ 2024-06-04T16:22:31.162 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.162 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:31.162 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:31.162 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:31.163 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.163 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:31.163 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.163 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:31.163 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:31.163 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:31.163 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:31.163 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.163 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.163 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:31.163 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:31.163 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.163 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:31.163 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:31.163 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:31.164 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.164 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:31.164 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:31.164 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:31.164 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:31.164 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:31.164 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:31.164 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:31.164 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:31.164 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.164 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:31.164 INFO:teuthology.orchestra.run.smithi144.stdout:_______________ ERROR at setup of test_object_lock_put_obj_lock ________________ 2024-06-04T16:22:31.164 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.164 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:31.165 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:31.165 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:31.165 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.165 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:31.165 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.165 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:31.165 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:31.165 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:31.165 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:31.165 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.165 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.165 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:31.165 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:31.166 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.166 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:31.166 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:31.166 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:31.166 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.166 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:31.166 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:31.166 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:31.166 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:31.166 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:31.166 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:31.166 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:31.166 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:31.166 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.167 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:31.167 INFO:teuthology.orchestra.run.smithi144.stdout:________ ERROR at setup of test_object_lock_put_obj_lock_invalid_bucket ________ 2024-06-04T16:22:31.167 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.167 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:31.167 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:31.167 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:31.167 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.167 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:31.167 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.167 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:31.167 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:31.167 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:31.167 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:31.167 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.168 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.168 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:31.168 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:31.168 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.168 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:31.168 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:31.168 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:31.168 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.168 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:31.168 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:31.168 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:31.168 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:31.168 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:31.168 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:31.169 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:31.169 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:31.169 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.169 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:31.169 INFO:teuthology.orchestra.run.smithi144.stdout:_____ ERROR at setup of test_object_lock_put_obj_lock_with_days_and_years ______ 2024-06-04T16:22:31.169 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.169 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:31.169 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:31.169 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:31.169 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.169 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:31.169 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.169 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:31.169 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:31.169 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:31.170 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:31.170 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.170 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.170 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:31.170 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:31.170 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.170 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:31.170 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:31.170 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:31.170 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.170 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:31.170 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:31.171 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:31.171 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:31.171 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:31.171 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:31.171 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:31.171 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:31.171 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.171 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:31.171 INFO:teuthology.orchestra.run.smithi144.stdout:_________ ERROR at setup of test_object_lock_put_obj_lock_invalid_days _________ 2024-06-04T16:22:31.171 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.171 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:31.172 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:31.172 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:31.172 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.172 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:31.172 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.172 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:31.172 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:31.172 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:31.172 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:31.172 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.172 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.173 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:31.173 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:31.173 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.173 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:31.173 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:31.173 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:31.173 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.173 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:31.173 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:31.173 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:31.173 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:31.173 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:31.174 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:31.174 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:31.174 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:31.174 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.174 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:31.174 INFO:teuthology.orchestra.run.smithi144.stdout:________ ERROR at setup of test_object_lock_put_obj_lock_invalid_years _________ 2024-06-04T16:22:31.174 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.174 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:31.174 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:31.174 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:31.174 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.174 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:31.174 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.175 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:31.175 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:31.175 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:31.175 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:31.175 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.175 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.175 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:31.175 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:31.175 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.175 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:31.175 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:31.175 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:31.175 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.175 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:31.175 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:31.176 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:31.176 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:31.176 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:31.176 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:31.176 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:31.176 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:31.176 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.176 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:31.176 INFO:teuthology.orchestra.run.smithi144.stdout:_________ ERROR at setup of test_object_lock_put_obj_lock_invalid_mode _________ 2024-06-04T16:22:31.176 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.176 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:31.176 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:31.176 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:31.176 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.176 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:31.177 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.177 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:31.177 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:31.177 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:31.177 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:31.177 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.177 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.177 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:31.177 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:31.177 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.177 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:31.177 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:31.177 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:31.177 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.178 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:31.178 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:31.178 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:31.178 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:31.178 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:31.178 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:31.178 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:31.178 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:31.178 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.178 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:31.178 INFO:teuthology.orchestra.run.smithi144.stdout:________ ERROR at setup of test_object_lock_put_obj_lock_invalid_status ________ 2024-06-04T16:22:31.178 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.179 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:31.179 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:31.179 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:31.179 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.179 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:31.179 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.179 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:31.179 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:31.179 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:31.179 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:31.179 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.179 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.179 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:31.179 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:31.180 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.180 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:31.180 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:31.180 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:31.180 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.180 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:31.180 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:31.180 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:31.180 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:31.180 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:31.180 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:31.180 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:31.180 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:31.180 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.180 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:31.181 INFO:teuthology.orchestra.run.smithi144.stdout:____________ ERROR at setup of test_object_lock_suspend_versioning _____________ 2024-06-04T16:22:31.181 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.181 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:31.181 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:31.181 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:31.181 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.181 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:31.181 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.181 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:31.181 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:31.181 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:31.181 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:31.181 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.181 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.182 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:31.182 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:31.182 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.182 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:31.182 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:31.182 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:31.182 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.182 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:31.182 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:31.182 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:31.182 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:31.182 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:31.183 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:31.183 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:31.183 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:31.183 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.183 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:31.183 INFO:teuthology.orchestra.run.smithi144.stdout:_______________ ERROR at setup of test_object_lock_get_obj_lock ________________ 2024-06-04T16:22:31.183 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.183 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:31.183 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:31.183 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:31.183 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.183 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:31.183 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.184 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:31.184 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:31.184 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:31.184 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:31.184 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.184 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.184 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:31.184 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:31.184 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.184 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:31.184 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:31.184 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:31.184 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.184 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:31.185 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:31.185 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:31.185 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:31.185 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:31.185 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:31.185 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:31.185 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:31.185 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.185 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:31.185 INFO:teuthology.orchestra.run.smithi144.stdout:________ ERROR at setup of test_object_lock_get_obj_lock_invalid_bucket ________ 2024-06-04T16:22:31.185 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.185 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:31.185 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:31.185 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:31.186 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.186 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:31.186 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.186 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:31.186 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:31.186 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:31.186 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:31.186 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.186 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.186 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:31.186 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:31.186 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.187 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:31.187 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:31.187 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:31.187 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.187 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:31.187 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:31.187 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:31.187 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:31.187 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:31.187 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:31.187 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:31.187 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:31.187 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.188 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:31.188 INFO:teuthology.orchestra.run.smithi144.stdout:_____________ ERROR at setup of test_object_lock_put_obj_retention _____________ 2024-06-04T16:22:31.188 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.188 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:31.188 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:31.188 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:31.188 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.188 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:31.188 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.188 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:31.188 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:31.188 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:31.188 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:31.188 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.189 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.189 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:31.189 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:31.189 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.189 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:31.189 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:31.189 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:31.189 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.189 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:31.189 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:31.189 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:31.189 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:31.189 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:31.189 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:31.189 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:31.190 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:31.190 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.190 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:31.190 INFO:teuthology.orchestra.run.smithi144.stdout:_____ ERROR at setup of test_object_lock_put_obj_retention_invalid_bucket ______ 2024-06-04T16:22:31.190 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.190 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:31.190 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:31.190 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:31.190 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.190 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:31.190 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.190 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:31.190 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:31.191 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:31.191 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:31.191 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.191 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.191 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:31.191 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:31.191 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.191 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:31.191 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:31.191 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:31.191 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.191 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:31.191 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:31.191 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:31.191 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:31.192 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:31.192 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:31.192 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:31.192 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:31.192 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.192 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:31.192 INFO:teuthology.orchestra.run.smithi144.stdout:______ ERROR at setup of test_object_lock_put_obj_retention_invalid_mode _______ 2024-06-04T16:22:31.192 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.192 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:31.192 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:31.192 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:31.192 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.192 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:31.193 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.193 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:31.193 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:31.193 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:31.193 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:31.193 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.193 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.193 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:31.193 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:31.193 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.193 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:31.193 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:31.193 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:31.193 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.194 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:31.194 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:31.194 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:31.194 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:31.194 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:31.194 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:31.194 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:31.194 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:31.194 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.194 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:31.194 INFO:teuthology.orchestra.run.smithi144.stdout:_____________ ERROR at setup of test_object_lock_get_obj_retention _____________ 2024-06-04T16:22:31.194 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.195 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:31.195 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:31.195 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:31.195 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.195 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:31.195 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.195 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:31.195 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:31.195 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:31.195 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:31.195 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.195 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.195 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:31.195 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:31.195 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.196 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:31.196 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:31.196 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:31.196 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.196 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:31.196 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:31.196 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:31.196 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:31.196 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:31.196 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:31.196 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:31.196 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:31.196 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.196 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:31.196 INFO:teuthology.orchestra.run.smithi144.stdout:_________ ERROR at setup of test_object_lock_get_obj_retention_iso8601 _________ 2024-06-04T16:22:31.197 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.197 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:31.197 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:31.197 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:31.197 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.197 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:31.197 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.197 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:31.197 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:31.197 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:31.197 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:31.197 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.197 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.197 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:31.198 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:31.198 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.198 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:31.198 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:31.198 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:31.198 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.198 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:31.198 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:31.198 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:31.198 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:31.198 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:31.198 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:31.198 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:31.199 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:31.199 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.199 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:31.199 INFO:teuthology.orchestra.run.smithi144.stdout:_____ ERROR at setup of test_object_lock_get_obj_retention_invalid_bucket ______ 2024-06-04T16:22:31.199 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.199 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:31.199 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:31.199 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:31.199 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.199 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:31.199 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.199 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:31.199 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:31.199 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:31.200 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:31.200 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.200 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.200 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:31.200 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:31.200 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.200 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:31.200 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:31.200 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:31.200 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.200 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:31.200 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:31.200 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:31.200 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:31.200 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:31.201 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:31.201 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:31.201 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:31.201 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.201 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:31.201 INFO:teuthology.orchestra.run.smithi144.stdout:________ ERROR at setup of test_object_lock_put_obj_retention_versionid ________ 2024-06-04T16:22:31.201 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.201 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:31.201 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:31.201 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:31.201 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.201 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:31.201 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.201 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:31.202 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:31.202 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:31.202 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:31.202 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.202 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.202 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:31.202 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:31.202 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.202 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:31.202 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:31.202 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:31.202 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.202 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:31.203 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:31.203 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:31.203 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:31.203 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:31.203 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:31.203 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:31.203 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:31.203 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.203 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:31.203 INFO:teuthology.orchestra.run.smithi144.stdout:_ ERROR at setup of test_object_lock_put_obj_retention_override_default_retention _ 2024-06-04T16:22:31.203 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.203 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:31.203 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:31.204 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:31.204 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.204 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:31.204 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.204 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:31.204 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:31.204 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:31.204 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:31.204 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.204 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.204 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:31.204 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:31.204 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.205 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:31.205 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:31.205 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:31.205 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.205 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:31.205 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:31.205 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:31.205 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:31.205 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:31.205 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:31.205 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:31.205 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:31.205 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.205 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:31.206 INFO:teuthology.orchestra.run.smithi144.stdout:_____ ERROR at setup of test_object_lock_put_obj_retention_increase_period _____ 2024-06-04T16:22:31.206 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.206 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:31.206 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:31.206 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:31.206 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.206 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:31.206 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.206 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:31.206 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:31.206 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:31.206 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:31.206 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.206 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.207 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:31.207 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:31.207 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.207 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:31.207 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:31.207 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:31.207 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.207 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:31.207 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:31.207 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:31.207 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:31.207 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:31.208 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:31.208 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:31.208 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:31.208 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.208 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:31.208 INFO:teuthology.orchestra.run.smithi144.stdout:_____ ERROR at setup of test_object_lock_put_obj_retention_shorten_period ______ 2024-06-04T16:22:31.208 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.208 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:31.208 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:31.208 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:31.208 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.208 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:31.208 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.208 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:31.209 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:31.209 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:31.209 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:31.209 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.209 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.209 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:31.209 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:31.209 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.209 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:31.209 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:31.209 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:31.209 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.209 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:31.209 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:31.210 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:31.210 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:31.210 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:31.210 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:31.210 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:31.210 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:31.210 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.210 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:31.210 INFO:teuthology.orchestra.run.smithi144.stdout:__ ERROR at setup of test_object_lock_put_obj_retention_shorten_period_bypass __ 2024-06-04T16:22:31.210 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.210 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:31.210 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:31.211 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:31.211 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.211 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:31.211 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.211 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:31.211 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:31.211 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:31.211 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:31.211 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.211 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.211 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:31.211 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:31.211 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.211 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:31.212 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:31.212 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:31.212 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.212 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:31.212 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:31.212 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:31.212 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:31.212 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:31.212 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:31.212 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:31.212 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:31.212 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.212 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:31.213 INFO:teuthology.orchestra.run.smithi144.stdout:_______ ERROR at setup of test_object_lock_delete_object_with_retention ________ 2024-06-04T16:22:31.213 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.213 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:31.213 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:31.213 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:31.213 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.213 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:31.213 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.213 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:31.213 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:31.213 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:31.213 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:31.213 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.214 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.214 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:31.214 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:31.214 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.214 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:31.214 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:31.214 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:31.214 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.214 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:31.214 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:31.214 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:31.214 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:31.214 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:31.215 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:31.215 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:31.215 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:31.215 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.215 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:31.215 INFO:teuthology.orchestra.run.smithi144.stdout:__ ERROR at setup of test_object_lock_delete_multipart_object_with_retention ___ 2024-06-04T16:22:31.215 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.215 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:31.215 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:31.215 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:31.215 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.215 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:31.215 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.216 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:31.216 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:31.216 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:31.216 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:31.216 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.216 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.216 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:31.216 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:31.216 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.216 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:31.216 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:31.216 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:31.217 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.217 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:31.217 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:31.217 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:31.217 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:31.217 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:31.217 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:31.217 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:31.217 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:31.217 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.217 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:31.217 INFO:teuthology.orchestra.run.smithi144.stdout:__ ERROR at setup of test_object_lock_delete_object_with_retention_and_marker __ 2024-06-04T16:22:31.217 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.218 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:31.218 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:31.218 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:31.218 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.218 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:31.218 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.218 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:31.218 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:31.218 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:31.218 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:31.218 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.218 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.219 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:31.219 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:31.219 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.219 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:31.219 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:31.219 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:31.219 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.219 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:31.219 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:31.219 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:31.219 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:31.219 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:31.220 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:31.220 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:31.220 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:31.220 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.220 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:31.220 INFO:teuthology.orchestra.run.smithi144.stdout:____ ERROR at setup of test_object_lock_multi_delete_object_with_retention _____ 2024-06-04T16:22:31.220 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.220 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:31.220 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:31.220 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:31.220 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.220 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:31.220 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.220 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:31.221 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:31.221 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:31.221 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:31.221 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.221 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.221 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:31.221 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:31.221 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.221 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:31.221 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:31.221 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:31.221 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.221 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:31.221 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:31.222 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:31.222 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:31.222 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:31.222 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:31.222 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:31.222 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:31.222 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.222 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:31.222 INFO:teuthology.orchestra.run.smithi144.stdout:______________ ERROR at setup of test_object_lock_put_legal_hold _______________ 2024-06-04T16:22:31.222 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.222 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:31.222 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:31.223 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:31.223 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.223 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:31.223 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.223 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:31.223 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:31.223 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:31.223 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:31.223 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.223 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.223 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:31.223 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:31.223 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.224 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:31.224 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:31.224 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:31.224 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.224 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:31.224 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:31.224 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:31.224 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:31.224 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:31.224 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:31.224 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:31.224 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:31.225 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.225 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:31.225 INFO:teuthology.orchestra.run.smithi144.stdout:_______ ERROR at setup of test_object_lock_put_legal_hold_invalid_bucket _______ 2024-06-04T16:22:31.225 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.225 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:31.225 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:31.225 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:31.225 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.225 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:31.225 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.225 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:31.225 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:31.225 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:31.226 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:31.226 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.226 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.226 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:31.226 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:31.226 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.226 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:31.226 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:31.226 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:31.226 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.226 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:31.226 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:31.226 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:31.226 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:31.227 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:31.227 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:31.227 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:31.227 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:31.227 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.227 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:31.227 INFO:teuthology.orchestra.run.smithi144.stdout:_______ ERROR at setup of test_object_lock_put_legal_hold_invalid_status _______ 2024-06-04T16:22:31.227 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.227 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:31.227 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:31.227 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:31.227 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.227 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:31.228 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.228 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:31.228 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:31.228 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:31.228 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:31.228 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.228 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.228 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:31.228 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:31.228 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.228 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:31.228 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:31.228 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:31.229 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.229 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:31.229 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:31.229 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:31.229 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:31.229 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:31.229 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:31.229 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:31.229 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:31.229 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.229 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:31.229 INFO:teuthology.orchestra.run.smithi144.stdout:______________ ERROR at setup of test_object_lock_get_legal_hold _______________ 2024-06-04T16:22:31.230 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.230 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:31.230 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:31.230 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:31.230 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.230 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:31.230 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.230 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:31.230 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:31.230 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:31.230 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:31.230 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.230 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.231 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:31.235 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:31.235 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.235 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:31.235 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:31.235 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:31.235 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.235 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:31.235 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:31.236 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:31.236 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:31.236 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:31.236 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:31.236 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:31.236 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:31.236 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.236 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:31.236 INFO:teuthology.orchestra.run.smithi144.stdout:_______ ERROR at setup of test_object_lock_get_legal_hold_invalid_bucket _______ 2024-06-04T16:22:31.236 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.236 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:31.236 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:31.236 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:31.237 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.237 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:31.237 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.237 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:31.237 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:31.237 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:31.237 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:31.237 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.237 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.237 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:31.237 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:31.237 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.237 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:31.238 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:31.238 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:31.238 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.238 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:31.238 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:31.238 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:31.238 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:31.238 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:31.238 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:31.238 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:31.238 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:31.238 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.238 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:31.239 INFO:teuthology.orchestra.run.smithi144.stdout:_____ ERROR at setup of test_object_lock_delete_object_with_legal_hold_on ______ 2024-06-04T16:22:31.239 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.239 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:31.239 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:31.239 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:31.239 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.239 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:31.239 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.239 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:31.239 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:31.239 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:31.239 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:31.239 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.239 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.240 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:31.240 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:31.240 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.240 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:31.240 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:31.240 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:31.240 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.240 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:31.240 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:31.240 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:31.240 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:31.240 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:31.240 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:31.241 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:31.241 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:31.241 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.241 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:31.241 INFO:teuthology.orchestra.run.smithi144.stdout:_ ERROR at setup of test_object_lock_delete_multipart_object_with_legal_hold_on _ 2024-06-04T16:22:31.241 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.241 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:31.241 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:31.241 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:31.241 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.241 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:31.241 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.241 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:31.242 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:31.242 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:31.242 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:31.242 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.242 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.242 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:31.242 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:31.242 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.242 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:31.242 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:31.242 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:31.242 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.243 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:31.243 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:31.243 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:31.243 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:31.243 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:31.243 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:31.243 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:31.243 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:31.243 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.243 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:31.243 INFO:teuthology.orchestra.run.smithi144.stdout:_____ ERROR at setup of test_object_lock_delete_object_with_legal_hold_off _____ 2024-06-04T16:22:31.243 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.243 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:31.243 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:31.244 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:31.244 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.244 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:31.244 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.244 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:31.244 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:31.244 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:31.244 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:31.244 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.244 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.244 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:31.244 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:31.244 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.244 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:31.245 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:31.245 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:31.245 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.245 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:31.245 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:31.245 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:31.245 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:31.245 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:31.245 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:31.245 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:31.245 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:31.245 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.245 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:31.245 INFO:teuthology.orchestra.run.smithi144.stdout:_____________ ERROR at setup of test_object_lock_get_obj_metadata ______________ 2024-06-04T16:22:31.245 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.246 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:31.246 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:31.246 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:31.246 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.246 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:31.246 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.246 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:31.246 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:31.246 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:31.246 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:31.246 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.246 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.247 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:31.247 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:31.247 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.247 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:31.247 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:31.247 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:31.247 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.247 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:31.247 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:31.247 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:31.247 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:31.247 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:31.247 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:31.248 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:31.248 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:31.248 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.248 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:31.248 INFO:teuthology.orchestra.run.smithi144.stdout:_______________ ERROR at setup of test_object_lock_uploading_obj _______________ 2024-06-04T16:22:31.248 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.248 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:31.248 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:31.248 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:31.248 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.248 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:31.249 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.249 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:31.249 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:31.249 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:31.249 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:31.249 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.249 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.249 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:31.249 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:31.249 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.249 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:31.249 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:31.249 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:31.249 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.250 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:31.250 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:31.250 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:31.250 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:31.250 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:31.250 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:31.250 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:31.250 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:31.250 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.250 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:31.250 INFO:teuthology.orchestra.run.smithi144.stdout:_ ERROR at setup of test_object_lock_changing_mode_from_governance_with_bypass _ 2024-06-04T16:22:31.250 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.250 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:31.251 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:31.251 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:31.251 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.251 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:31.251 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.251 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:31.251 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:31.251 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:31.251 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:31.251 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.251 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.251 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:31.251 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:31.252 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.252 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:31.252 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:31.252 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:31.252 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.252 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:31.252 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:31.252 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:31.252 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:31.252 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:31.252 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:31.252 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:31.252 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:31.253 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.253 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:31.253 INFO:teuthology.orchestra.run.smithi144.stdout:_ ERROR at setup of test_object_lock_changing_mode_from_governance_without_bypass _ 2024-06-04T16:22:31.253 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.253 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:31.253 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:31.253 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:31.253 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.253 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:31.253 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.253 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:31.253 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:31.253 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:31.253 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:31.254 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.254 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.254 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:31.254 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:31.254 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.254 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:31.254 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:31.254 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:31.254 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.254 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:31.254 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:31.254 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:31.254 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:31.255 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:31.255 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:31.255 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:31.255 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:31.255 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.255 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:31.255 INFO:teuthology.orchestra.run.smithi144.stdout:_______ ERROR at setup of test_object_lock_changing_mode_from_compliance _______ 2024-06-04T16:22:31.255 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.255 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:31.255 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:31.255 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:31.255 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.255 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:31.255 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.256 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:31.256 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:31.256 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:31.256 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:31.256 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.256 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.256 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:31.256 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:31.256 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.256 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:31.256 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:31.256 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:31.256 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.256 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:31.257 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:31.257 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:31.257 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:31.257 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:31.257 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:31.257 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:31.257 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:31.257 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.257 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:31.257 INFO:teuthology.orchestra.run.smithi144.stdout:_______________ ERROR at setup of test_copy_object_ifmatch_good ________________ 2024-06-04T16:22:31.257 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.257 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:31.257 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:31.257 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:31.258 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.258 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:31.258 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.258 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:31.258 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:31.258 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:31.258 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:31.258 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.258 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.258 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:31.258 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:31.258 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.258 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:31.259 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:31.259 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:31.259 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.259 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:31.259 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:31.259 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:31.259 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:31.259 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:31.259 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:31.259 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:31.259 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:31.259 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.259 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:31.259 INFO:teuthology.orchestra.run.smithi144.stdout:____________ ERROR at setup of test_copy_object_ifnonematch_failed _____________ 2024-06-04T16:22:31.259 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.260 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:31.260 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:31.260 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:31.260 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.260 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:31.260 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.260 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:31.260 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:31.260 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:31.260 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:31.260 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.260 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.260 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:31.260 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:31.261 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.261 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:31.261 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:31.261 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:31.261 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.261 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:31.261 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:31.261 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:31.261 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:31.261 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:31.261 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:31.261 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:31.262 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:31.262 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.262 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:31.262 INFO:teuthology.orchestra.run.smithi144.stdout:_______________ ERROR at setup of test_get_bucket_policy_status ________________ 2024-06-04T16:22:31.262 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.262 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:31.262 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:31.262 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:31.262 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.262 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:31.262 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.262 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:31.262 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:31.263 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:31.263 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:31.263 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.263 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.263 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:31.263 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:31.263 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.263 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:31.263 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:31.263 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:31.263 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.263 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:31.264 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:31.264 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:31.264 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:31.264 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:31.264 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:31.264 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:31.264 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:31.264 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.264 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:31.264 INFO:teuthology.orchestra.run.smithi144.stdout:__________ ERROR at setup of test_get_public_acl_bucket_policy_status __________ 2024-06-04T16:22:31.264 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.264 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:31.265 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:31.265 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:31.265 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.265 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:31.265 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.265 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:31.265 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:31.265 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:31.265 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:31.265 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.265 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.265 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:31.266 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:31.266 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.266 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:31.266 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:31.266 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:31.266 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.266 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:31.266 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:31.266 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:31.266 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:31.266 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:31.266 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:31.266 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:31.267 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:31.267 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.267 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:31.267 INFO:teuthology.orchestra.run.smithi144.stdout:________ ERROR at setup of test_get_authpublic_acl_bucket_policy_status ________ 2024-06-04T16:22:31.267 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.267 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:31.267 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:31.267 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:31.267 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.267 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:31.267 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.267 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:31.267 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:31.268 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:31.268 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:31.268 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.268 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.268 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:31.268 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:31.268 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.268 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:31.268 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:31.268 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:31.268 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.268 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:31.268 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:31.268 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:31.269 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:31.269 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:31.269 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:31.269 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:31.269 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:31.269 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.269 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:31.269 INFO:teuthology.orchestra.run.smithi144.stdout:_______ ERROR at setup of test_get_publicpolicy_acl_bucket_policy_status _______ 2024-06-04T16:22:31.269 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.269 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:31.269 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:31.269 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:31.270 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.270 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:31.270 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.270 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:31.270 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:31.270 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:31.270 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:31.270 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.270 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.270 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:31.270 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:31.271 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.271 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:31.271 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:31.271 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:31.271 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.271 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:31.271 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:31.271 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:31.271 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:31.271 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:31.271 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:31.271 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:31.272 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:31.272 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.272 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:31.272 INFO:teuthology.orchestra.run.smithi144.stdout:_____ ERROR at setup of test_get_nonpublicpolicy_acl_bucket_policy_status ______ 2024-06-04T16:22:31.272 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.272 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:31.272 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:31.272 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:31.272 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.272 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:31.272 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.272 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:31.272 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:31.273 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:31.273 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:31.273 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.273 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.273 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:31.273 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:31.273 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.273 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:31.273 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:31.273 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:31.273 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.273 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:31.273 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:31.274 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:31.274 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:31.274 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:31.274 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:31.274 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:31.274 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:31.274 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.274 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:31.274 INFO:teuthology.orchestra.run.smithi144.stdout:_____ ERROR at setup of test_get_nonpublicpolicy_deny_bucket_policy_status _____ 2024-06-04T16:22:31.274 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.274 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:31.274 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:31.274 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:31.275 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.275 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:31.275 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.275 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:31.275 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:31.275 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:31.275 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:31.275 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.275 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.275 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:31.275 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:31.275 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.275 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:31.276 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:31.276 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:31.276 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.276 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:31.276 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:31.276 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:31.276 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:31.276 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:31.276 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:31.276 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:31.276 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:31.276 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.276 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:31.277 INFO:teuthology.orchestra.run.smithi144.stdout:______________ ERROR at setup of test_get_undefined_public_block _______________ 2024-06-04T16:22:31.277 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.277 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:31.277 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:31.277 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:31.277 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.277 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:31.277 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.277 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:31.277 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:31.277 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:31.277 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:31.277 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.277 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.278 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:31.278 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:31.278 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.278 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:31.278 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:31.278 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:31.278 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.278 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:31.278 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:31.278 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:31.278 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:31.278 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:31.279 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:31.279 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:31.279 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:31.279 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.279 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:31.279 INFO:teuthology.orchestra.run.smithi144.stdout:__________ ERROR at setup of test_get_public_block_deny_bucket_policy __________ 2024-06-04T16:22:31.279 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.279 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:31.279 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:31.279 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:31.279 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.279 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:31.279 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.279 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:31.280 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:31.280 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:31.280 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:31.280 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.280 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.280 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:31.280 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:31.280 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.280 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:31.280 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:31.280 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:31.280 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.280 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:31.280 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:31.281 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:31.281 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:31.281 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:31.281 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:31.281 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:31.281 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:31.281 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.281 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:31.281 INFO:teuthology.orchestra.run.smithi144.stdout:___________________ ERROR at setup of test_put_public_block ____________________ 2024-06-04T16:22:31.281 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.281 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:31.281 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:31.281 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:31.281 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.282 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:31.282 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.282 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:31.282 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:31.282 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:31.282 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:31.282 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.282 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.282 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:31.282 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:31.282 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.283 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:31.283 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:31.283 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:31.283 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.283 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:31.283 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:31.283 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:31.283 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:31.284 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:31.284 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:31.284 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:31.284 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:31.284 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.284 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:31.284 INFO:teuthology.orchestra.run.smithi144.stdout:_____________ ERROR at setup of test_block_public_put_bucket_acls ______________ 2024-06-04T16:22:31.284 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.284 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:31.284 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:31.285 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:31.285 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.285 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:31.285 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.285 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:31.285 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:31.285 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:31.285 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:31.285 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.285 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.285 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:31.285 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:31.286 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.286 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:31.286 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:31.286 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:31.286 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.286 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:31.286 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:31.286 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:31.286 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:31.286 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:31.286 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:31.286 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:31.287 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:31.287 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.287 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:31.287 INFO:teuthology.orchestra.run.smithi144.stdout:____________ ERROR at setup of test_block_public_object_canned_acls ____________ 2024-06-04T16:22:31.287 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.287 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:31.287 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:31.287 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:31.287 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.287 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:31.287 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.287 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:31.287 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:31.288 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:31.288 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:31.288 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.288 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.288 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:31.288 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:31.288 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.288 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:31.288 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:31.288 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:31.288 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.288 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:31.288 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:31.288 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:31.289 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:31.289 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:31.289 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:31.289 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:31.289 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:31.289 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.289 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:31.289 INFO:teuthology.orchestra.run.smithi144.stdout:__________________ ERROR at setup of test_block_public_policy __________________ 2024-06-04T16:22:31.289 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.289 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:31.289 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:31.289 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:31.289 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.289 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:31.290 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.290 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:31.290 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:31.290 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:31.290 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:31.290 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.290 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.290 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:31.290 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:31.290 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.291 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:31.291 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:31.291 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:31.291 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.291 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:31.291 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:31.292 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:31.292 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:31.292 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:31.292 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:31.292 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:31.292 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:31.293 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.293 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:31.293 INFO:teuthology.orchestra.run.smithi144.stdout:__________________ ERROR at setup of test_ignore_public_acls ___________________ 2024-06-04T16:22:31.293 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.293 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:31.294 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:31.294 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:31.294 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.294 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:31.294 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.294 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:31.294 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:31.294 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:31.295 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:31.295 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.295 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.295 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:31.295 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:31.295 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.295 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:31.295 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:31.295 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:31.295 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.295 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:31.296 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:31.296 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:31.296 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:31.296 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:31.296 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:31.296 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:31.296 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:31.296 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.296 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:31.296 INFO:teuthology.orchestra.run.smithi144.stdout:_______ ERROR at setup of test_multipart_upload_on_a_bucket_with_policy ________ 2024-06-04T16:22:31.296 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.296 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:31.297 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:31.297 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:31.297 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.297 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:31.297 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.297 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:31.297 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:31.297 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:31.297 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:31.297 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.297 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.297 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:31.298 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:31.298 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.298 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:31.298 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:31.298 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:31.298 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.298 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:31.298 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:31.298 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:31.298 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:31.298 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:31.298 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:31.299 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:31.299 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:31.299 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.299 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:31.299 INFO:teuthology.orchestra.run.smithi144.stdout:_______________ ERROR at setup of test_put_bucket_encryption_kms _______________ 2024-06-04T16:22:31.299 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.299 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:31.299 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:31.299 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:31.299 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.299 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:31.300 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.300 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:31.300 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:31.300 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:31.300 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:31.300 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.300 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.300 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:31.300 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:31.300 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.300 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:31.301 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:31.301 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:31.301 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.301 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:31.301 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:31.301 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:31.301 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:31.301 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:31.301 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:31.301 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:31.301 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:31.301 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.302 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:31.302 INFO:teuthology.orchestra.run.smithi144.stdout:_______________ ERROR at setup of test_get_bucket_encryption_kms _______________ 2024-06-04T16:22:31.302 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.302 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:31.302 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:31.302 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:31.302 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.302 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:31.302 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.302 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:31.302 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:31.303 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:31.303 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:31.303 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.303 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.303 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:31.303 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:31.303 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.303 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:31.303 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:31.303 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:31.303 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.303 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:31.303 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:31.303 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:31.304 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:31.304 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:31.304 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:31.304 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:31.304 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:31.304 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.304 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:31.304 INFO:teuthology.orchestra.run.smithi144.stdout:_____________ ERROR at setup of test_delete_bucket_encryption_kms ______________ 2024-06-04T16:22:31.304 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.304 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:31.304 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:31.304 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:31.304 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.304 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:31.305 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.305 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:31.305 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:31.305 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:31.305 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:31.305 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.305 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.305 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:31.305 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:31.305 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.305 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:31.305 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:31.305 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:31.305 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.306 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:31.306 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:31.306 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:31.306 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:31.306 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:31.306 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:31.306 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:31.306 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:31.306 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.306 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:31.306 INFO:teuthology.orchestra.run.smithi144.stdout:___ ERROR at setup of test_sse_kms_default_post_object_authenticated_request ___ 2024-06-04T16:22:31.306 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.306 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:31.307 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:31.307 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:31.307 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.307 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:31.307 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.307 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:31.307 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:31.307 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:31.307 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:31.307 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.307 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.307 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:31.308 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:31.308 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.308 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:31.308 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:31.308 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:31.308 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.308 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:31.308 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:31.308 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:31.308 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:31.308 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:31.308 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:31.308 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:31.308 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:31.309 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.309 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:31.309 INFO:teuthology.orchestra.run.smithi144.stdout:__________________ ERROR at setup of test_get_object_torrent ___________________ 2024-06-04T16:22:31.309 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.309 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:31.309 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:31.309 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:31.309 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.309 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:31.309 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.309 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:31.309 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:31.309 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:31.310 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:31.310 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.310 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.310 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:31.310 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:31.310 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.310 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:31.310 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:31.310 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:31.310 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.310 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:31.310 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:31.310 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:31.311 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:31.311 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:31.311 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:31.311 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:31.311 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:31.311 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.311 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:31.311 INFO:teuthology.orchestra.run.smithi144.stdout:_________________ ERROR at setup of test_generate_where_clause _________________ 2024-06-04T16:22:31.311 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.311 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:31.311 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:31.312 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:31.312 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.312 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:31.312 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.312 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:31.312 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:31.312 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:31.312 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:31.312 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.312 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.312 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:31.312 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:31.312 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.312 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:31.313 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:31.313 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:31.313 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.313 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:31.313 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:31.313 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:31.313 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:31.313 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:31.313 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:31.313 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:31.313 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:31.313 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.314 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:31.314 INFO:teuthology.orchestra.run.smithi144.stdout:__________________ ERROR at setup of test_generate_projection __________________ 2024-06-04T16:22:31.314 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.314 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:31.314 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:31.314 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:31.314 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.314 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:31.314 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.314 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:31.314 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:31.314 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:31.314 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:31.315 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.315 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.315 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:31.315 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:31.315 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.315 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:31.315 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:31.315 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:31.315 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.315 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:31.315 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:31.315 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:31.315 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:31.316 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:31.316 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:31.316 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:31.316 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:31.316 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.316 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:31.316 INFO:teuthology.orchestra.run.smithi144.stdout:____________________ ERROR at setup of test_count_operation ____________________ 2024-06-04T16:22:31.316 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.316 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:31.316 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:31.316 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:31.316 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.316 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:31.317 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.317 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:31.317 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:31.317 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:31.317 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:31.317 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.317 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.317 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:31.317 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:31.317 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.317 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:31.317 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:31.317 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:31.318 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.318 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:31.318 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:31.318 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:31.318 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:31.318 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:31.318 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:31.318 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:31.318 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:31.318 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.318 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:31.318 INFO:teuthology.orchestra.run.smithi144.stdout:_________________ ERROR at setup of test_count_json_operation __________________ 2024-06-04T16:22:31.318 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.319 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:31.319 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:31.319 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:31.319 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.319 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:31.319 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.319 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:31.319 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:31.319 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:31.319 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:31.319 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.319 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.319 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:31.320 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:31.320 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.320 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:31.320 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:31.320 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:31.320 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.320 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:31.320 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:31.320 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:31.320 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:31.320 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:31.320 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:31.320 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:31.320 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:31.321 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.321 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:31.321 INFO:teuthology.orchestra.run.smithi144.stdout:________________ ERROR at setup of test_json_column_sum_min_max ________________ 2024-06-04T16:22:31.321 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.321 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:31.321 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:31.321 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:31.321 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.321 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:31.321 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.321 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:31.321 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:31.321 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:31.322 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:31.322 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.322 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.322 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:31.322 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:31.322 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.322 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:31.322 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:31.322 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:31.322 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.322 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:31.322 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:31.322 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:31.323 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:31.323 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:31.323 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:31.323 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:31.323 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:31.323 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.323 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:31.323 INFO:teuthology.orchestra.run.smithi144.stdout:________________ ERROR at setup of test_json_nullif_expressions ________________ 2024-06-04T16:22:31.323 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.323 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:31.323 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:31.323 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:31.323 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.324 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:31.324 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.324 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:31.324 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:31.324 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:31.324 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:31.324 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.324 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.324 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:31.324 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:31.324 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.324 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:31.324 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:31.325 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:31.325 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.325 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:31.325 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:31.325 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:31.325 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:31.325 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:31.325 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:31.325 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:31.325 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:31.325 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.325 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:31.325 INFO:teuthology.orchestra.run.smithi144.stdout:__________________ ERROR at setup of test_column_sum_min_max ___________________ 2024-06-04T16:22:31.326 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.326 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:31.326 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:31.326 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:31.326 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.326 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:31.326 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.326 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:31.326 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:31.326 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:31.326 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:31.326 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.326 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.327 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:31.327 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:31.327 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.327 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:31.327 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:31.327 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:31.327 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.327 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:31.327 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:31.327 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:31.327 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:31.327 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:31.327 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:31.328 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:31.328 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:31.328 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.328 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:31.328 INFO:teuthology.orchestra.run.smithi144.stdout:__________________ ERROR at setup of test_nullif_expressions ___________________ 2024-06-04T16:22:31.328 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.328 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:31.328 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:31.328 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:31.328 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.328 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:31.328 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.328 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:31.329 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:31.329 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:31.329 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:31.329 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.329 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.329 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:31.329 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:31.329 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.329 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:31.329 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:31.329 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:31.329 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.329 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:31.329 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:31.330 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:31.330 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:31.330 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:31.330 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:31.330 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:31.330 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:31.330 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.330 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:31.330 INFO:teuthology.orchestra.run.smithi144.stdout:________________ ERROR at setup of test_nulliftrue_expressions _________________ 2024-06-04T16:22:31.330 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.330 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:31.330 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:31.330 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:31.331 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.331 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:31.331 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.331 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:31.331 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:31.331 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:31.331 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:31.331 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.331 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.331 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:31.331 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:31.331 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.331 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:31.332 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:31.332 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:31.332 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.332 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:31.332 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:31.332 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:31.332 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:31.332 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:31.332 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:31.332 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:31.332 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:31.332 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.332 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:31.333 INFO:teuthology.orchestra.run.smithi144.stdout:________________ ERROR at setup of test_is_not_null_expressions ________________ 2024-06-04T16:22:31.333 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.333 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:31.333 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:31.333 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:31.333 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.333 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:31.333 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.333 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:31.333 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:31.333 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:31.333 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:31.333 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.334 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.334 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:31.334 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:31.334 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.334 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:31.334 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:31.334 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:31.334 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.334 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:31.334 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:31.334 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:31.334 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:31.334 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:31.335 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:31.335 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:31.335 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:31.335 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.335 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:31.335 INFO:teuthology.orchestra.run.smithi144.stdout:________________ ERROR at setup of test_lowerupper_expressions _________________ 2024-06-04T16:22:31.335 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.335 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:31.335 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:31.335 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:31.335 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.335 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:31.335 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.336 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:31.336 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:31.336 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:31.336 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:31.336 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.336 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.336 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:31.336 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:31.336 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.336 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:31.336 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:31.336 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:31.336 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.336 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:31.336 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:31.337 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:31.337 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:31.337 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:31.337 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:31.337 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:31.337 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:31.337 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.337 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:31.337 INFO:teuthology.orchestra.run.smithi144.stdout:____________________ ERROR at setup of test_in_expressions _____________________ 2024-06-04T16:22:31.337 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.337 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:31.337 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:31.337 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:31.338 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.338 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:31.338 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.338 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:31.338 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:31.338 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:31.338 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:31.338 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.338 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.338 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:31.338 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:31.338 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.338 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:31.339 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:31.339 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:31.339 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.339 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:31.339 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:31.339 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:31.339 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:31.339 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:31.339 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:31.339 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:31.339 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:31.339 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.339 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:31.340 INFO:teuthology.orchestra.run.smithi144.stdout:_______________ ERROR at setup of test_true_false_in_expressions _______________ 2024-06-04T16:22:31.340 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.340 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:31.340 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:31.340 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:31.340 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.340 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:31.340 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.340 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:31.340 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:31.340 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:31.340 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:31.340 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.341 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.341 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:31.341 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:31.341 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.341 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:31.341 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:31.341 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:31.341 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.341 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:31.341 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:31.341 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:31.342 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:31.342 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:31.342 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:31.342 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:31.342 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:31.342 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.342 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:31.342 INFO:teuthology.orchestra.run.smithi144.stdout:___________________ ERROR at setup of test_like_expressions ____________________ 2024-06-04T16:22:31.342 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.342 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:31.342 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:31.342 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:31.343 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.343 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:31.343 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.343 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:31.343 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:31.343 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:31.343 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:31.343 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.343 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.343 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:31.343 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:31.343 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.343 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:31.343 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:31.344 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:31.344 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.344 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:31.344 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:31.344 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:31.344 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:31.344 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:31.344 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:31.344 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:31.344 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:31.344 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.344 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:31.344 INFO:teuthology.orchestra.run.smithi144.stdout:_______________ ERROR at setup of test_truefalselike_expressions _______________ 2024-06-04T16:22:31.344 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.345 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:31.345 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:31.345 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:31.345 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.345 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:31.345 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.345 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:31.345 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:31.345 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:31.345 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:31.345 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.345 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.345 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:31.345 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:31.346 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.346 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:31.346 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:31.346 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:31.346 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.346 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:31.346 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:31.346 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:31.346 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:31.346 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:31.346 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:31.346 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:31.346 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:31.347 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.347 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:31.347 INFO:teuthology.orchestra.run.smithi144.stdout:__________________ ERROR at setup of test_complex_expressions __________________ 2024-06-04T16:22:31.347 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.347 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:31.347 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:31.347 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:31.347 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.347 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:31.347 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.347 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:31.347 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:31.347 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:31.347 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:31.348 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.348 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.348 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:31.348 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:31.348 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.348 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:31.348 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:31.348 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:31.348 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.348 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:31.348 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:31.348 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:31.349 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:31.349 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:31.349 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:31.349 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:31.349 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:31.349 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.349 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:31.349 INFO:teuthology.orchestra.run.smithi144.stdout:_________________________ ERROR at setup of test_alias _________________________ 2024-06-04T16:22:31.349 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.349 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:31.349 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:31.349 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:31.349 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.349 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:31.350 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.350 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:31.350 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:31.350 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:31.350 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:31.350 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.350 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.350 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:31.350 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:31.350 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.350 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:31.350 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:31.350 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:31.350 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.351 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:31.351 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:31.351 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:31.351 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:31.351 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:31.351 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:31.351 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:31.351 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:31.351 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.351 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:31.351 INFO:teuthology.orchestra.run.smithi144.stdout:_________________ ERROR at setup of test_alias_cyclic_refernce _________________ 2024-06-04T16:22:31.351 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.351 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:31.352 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:31.352 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:31.352 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.352 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:31.352 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.352 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:31.352 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:31.352 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:31.352 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:31.352 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.352 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.352 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:31.353 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:31.353 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.353 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:31.353 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:31.353 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:31.353 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.353 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:31.353 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:31.353 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:31.353 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:31.353 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:31.353 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:31.353 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:31.353 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:31.354 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.354 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:31.354 INFO:teuthology.orchestra.run.smithi144.stdout:_______________________ ERROR at setup of test_datetime ________________________ 2024-06-04T16:22:31.354 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.354 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:31.354 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:31.354 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:31.354 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.354 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:31.354 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.354 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:31.354 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:31.355 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:31.355 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:31.355 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.355 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.355 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:31.355 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:31.355 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.355 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:31.355 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:31.355 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:31.355 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.355 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:31.355 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:31.355 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:31.355 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:31.356 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:31.356 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:31.356 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:31.356 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:31.356 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.356 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:31.356 INFO:teuthology.orchestra.run.smithi144.stdout:__________________ ERROR at setup of test_true_false_datetime __________________ 2024-06-04T16:22:31.356 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.356 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:31.356 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:31.356 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:31.356 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.356 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:31.357 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.357 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:31.357 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:31.357 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:31.357 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:31.357 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.357 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.357 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:31.357 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:31.357 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.357 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:31.357 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:31.357 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:31.357 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.358 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:31.358 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:31.358 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:31.358 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:31.358 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:31.358 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:31.358 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:31.358 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:31.358 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.358 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:31.358 INFO:teuthology.orchestra.run.smithi144.stdout:______________________ ERROR at setup of test_csv_parser _______________________ 2024-06-04T16:22:31.358 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.359 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:31.359 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:31.359 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:31.359 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.359 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:31.359 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.359 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:31.359 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:31.359 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:31.359 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:31.359 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.359 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.359 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:31.360 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:31.360 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.360 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:31.360 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:31.360 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:31.360 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.360 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:31.360 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:31.360 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:31.360 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:31.360 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:31.360 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:31.360 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:31.361 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:31.361 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.361 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:31.361 INFO:teuthology.orchestra.run.smithi144.stdout:____________________ ERROR at setup of test_csv_definition _____________________ 2024-06-04T16:22:31.361 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.361 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:31.361 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:31.361 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:31.361 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.361 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:31.361 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.361 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:31.361 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:31.362 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:31.362 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:31.362 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.362 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.362 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:31.362 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:31.362 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.362 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:31.362 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:31.362 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:31.362 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.362 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:31.362 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:31.363 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:31.363 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:31.363 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:31.363 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:31.363 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:31.363 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:31.363 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.363 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:31.363 INFO:teuthology.orchestra.run.smithi144.stdout:___________________ ERROR at setup of test_schema_definition ___________________ 2024-06-04T16:22:31.363 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.363 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:31.363 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:31.363 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:31.363 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.364 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:31.364 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.364 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:31.364 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:31.364 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:31.364 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:31.364 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.364 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.364 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:31.364 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:31.364 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.364 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:31.364 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:31.364 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:31.365 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.365 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:31.365 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:31.365 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:31.365 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:31.365 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:31.365 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:31.365 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:31.365 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:31.365 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.365 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:31.365 INFO:teuthology.orchestra.run.smithi144.stdout:______________ ERROR at setup of test_when_then_else_expressions _______________ 2024-06-04T16:22:31.365 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.366 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:31.366 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:31.366 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:31.366 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.366 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:31.366 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.366 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:31.366 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:31.366 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:31.366 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:31.366 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.366 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.366 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:31.366 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:31.366 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.367 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:31.367 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:31.367 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:31.367 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.367 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:31.367 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:31.367 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:31.367 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:31.367 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:31.367 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:31.367 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:31.367 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:31.367 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.367 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:31.368 INFO:teuthology.orchestra.run.smithi144.stdout:_________________ ERROR at setup of test_coalesce_expressions __________________ 2024-06-04T16:22:31.368 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.368 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:31.368 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:31.368 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:31.368 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.368 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:31.368 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.368 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:31.368 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:31.368 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:31.368 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:31.368 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.368 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.368 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:31.369 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:31.369 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.369 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:31.369 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:31.369 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:31.369 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.369 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:31.369 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:31.369 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:31.369 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:31.369 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:31.369 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:31.369 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:31.369 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:31.370 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.370 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:31.370 INFO:teuthology.orchestra.run.smithi144.stdout:___________________ ERROR at setup of test_cast_expressions ____________________ 2024-06-04T16:22:31.370 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.370 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:31.370 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:31.370 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:31.370 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.370 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:31.370 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.370 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:31.370 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:31.370 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:31.371 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:31.371 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.371 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.371 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:31.371 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:31.371 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.371 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:31.371 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:31.371 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:31.371 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.371 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:31.371 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:31.371 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:31.371 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:31.371 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:31.372 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:31.372 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:31.372 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:31.372 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.372 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:31.372 INFO:teuthology.orchestra.run.smithi144.stdout:________________________ ERROR at setup of test_version ________________________ 2024-06-04T16:22:31.372 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.372 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:31.372 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:31.372 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:31.372 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.372 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:31.372 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.373 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:31.373 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:31.373 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:31.373 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:31.373 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.373 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.373 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:31.373 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:31.373 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.373 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:31.373 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:31.373 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:31.373 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.373 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:31.374 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:31.374 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:31.374 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:31.374 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:31.374 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:31.374 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:31.374 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:31.374 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.374 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:31.374 INFO:teuthology.orchestra.run.smithi144.stdout:___________________ ERROR at setup of test_trim_expressions ____________________ 2024-06-04T16:22:31.374 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.374 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:31.374 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:31.375 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:31.375 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.375 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:31.375 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.375 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:31.375 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:31.375 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:31.375 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:31.375 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.375 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.375 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:31.375 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:31.375 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.376 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:31.376 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:31.376 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:31.376 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.376 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:31.376 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:31.376 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:31.376 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:31.376 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:31.376 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:31.376 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:31.376 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:31.376 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.377 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:31.377 INFO:teuthology.orchestra.run.smithi144.stdout:______________ ERROR at setup of test_truefalse_trim_expressions _______________ 2024-06-04T16:22:31.377 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.377 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:31.377 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:31.377 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:31.377 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.377 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:31.377 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.377 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:31.377 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:31.377 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:31.377 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:31.378 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.378 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.378 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:31.378 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:31.378 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.378 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:31.378 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:31.378 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:31.378 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.378 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:31.378 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:31.378 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:31.378 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:31.378 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:31.379 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:31.379 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:31.379 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:31.379 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.379 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:31.379 INFO:teuthology.orchestra.run.smithi144.stdout:__________________ ERROR at setup of test_escape_expressions ___________________ 2024-06-04T16:22:31.379 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.379 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:31.379 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:31.379 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:31.379 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.379 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:31.379 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.379 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:31.380 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:31.380 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:31.380 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:31.380 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.380 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.380 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:31.380 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:31.380 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.380 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:31.380 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:31.380 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:31.380 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.380 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:31.380 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:31.380 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:31.381 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:31.381 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:31.381 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:31.381 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:31.381 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:31.381 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.381 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:31.381 INFO:teuthology.orchestra.run.smithi144.stdout:________________ ERROR at setup of test_case_value_expressions _________________ 2024-06-04T16:22:31.381 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.381 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:31.381 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:31.381 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:31.381 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.381 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:31.381 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.382 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:31.382 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:31.382 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:31.382 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:31.382 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.382 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.382 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:31.382 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:31.382 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.382 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:31.382 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:31.382 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:31.382 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.383 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:31.383 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:31.383 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:31.383 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:31.383 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:31.383 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:31.383 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:31.383 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:31.383 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.383 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:31.383 INFO:teuthology.orchestra.run.smithi144.stdout:_________________ ERROR at setup of test_bool_cast_expressions _________________ 2024-06-04T16:22:31.383 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.383 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:31.383 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:31.383 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:31.384 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.384 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:31.384 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.384 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:31.384 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:31.384 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:31.384 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:31.384 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.384 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.384 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:31.384 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:31.384 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.384 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:31.384 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:31.385 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:31.385 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.385 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:31.385 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:31.385 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:31.385 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:31.385 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:31.385 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:31.385 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:31.385 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:31.385 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.385 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:31.386 INFO:teuthology.orchestra.run.smithi144.stdout:_________________ ERROR at setup of test_progress_expressions __________________ 2024-06-04T16:22:31.386 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.386 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:31.386 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:31.386 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:31.386 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.386 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:31.386 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.386 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:31.386 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:31.386 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:31.386 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:31.386 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.387 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.387 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:31.387 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:31.387 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.387 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:31.387 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:31.387 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:31.387 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.387 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:31.387 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:31.387 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:31.387 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:31.387 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:31.388 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:31.388 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:31.388 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:31.388 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.388 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:31.388 INFO:teuthology.orchestra.run.smithi144.stdout:_______________ ERROR at setup of test_output_serial_expressions _______________ 2024-06-04T16:22:31.388 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.388 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:31.388 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:31.388 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:31.388 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.388 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:31.388 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.389 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:31.389 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:31.389 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:31.389 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:31.389 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.389 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.389 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:31.389 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:31.389 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.389 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:31.389 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:31.389 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:31.389 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.390 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:31.390 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:31.390 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:31.390 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:31.390 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:31.390 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:31.390 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:31.390 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:31.390 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.390 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:31.390 INFO:teuthology.orchestra.run.smithi144.stdout:_____________________ ERROR at setup of test_account_topic _____________________ 2024-06-04T16:22:31.391 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.391 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:31.391 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:31.391 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:31.391 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.391 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:31.391 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.391 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:31.391 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:31.391 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:31.391 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:31.391 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.391 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.392 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:31.392 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:31.392 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.392 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:31.392 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:31.392 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:31.392 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.392 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:31.392 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:31.392 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:31.392 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:31.392 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:31.393 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:31.393 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:31.393 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:31.393 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.393 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:31.393 INFO:teuthology.orchestra.run.smithi144.stdout:__________________ ERROR at setup of test_cross_account_topic __________________ 2024-06-04T16:22:31.393 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.393 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:31.393 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:31.393 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:31.393 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.393 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:31.394 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.394 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:31.394 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:31.394 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:31.394 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:31.394 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.394 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.394 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:31.394 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:31.394 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.394 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:31.394 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:31.395 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:31.395 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.395 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:31.395 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:31.395 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:31.395 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:31.395 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:31.395 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:31.395 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:31.395 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:31.395 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.395 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:31.395 INFO:teuthology.orchestra.run.smithi144.stdout:_________________ ERROR at setup of test_account_topic_publish _________________ 2024-06-04T16:22:31.395 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.396 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:31.396 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:31.396 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:31.396 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.396 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:31.396 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.396 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:31.396 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:31.396 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:31.396 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:31.396 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.396 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.396 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:31.397 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:31.397 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.397 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:31.397 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:31.397 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:31.397 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.397 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:31.397 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:31.397 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:31.397 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:31.397 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:31.397 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:31.397 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:31.397 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:31.398 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.398 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:31.398 INFO:teuthology.orchestra.run.smithi144.stdout:______________ ERROR at setup of test_cross_account_topic_publish ______________ 2024-06-04T16:22:31.398 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.398 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.fixture(scope="package") 2024-06-04T16:22:31.398 INFO:teuthology.orchestra.run.smithi144.stdout: def configfile(): 2024-06-04T16:22:31.398 INFO:teuthology.orchestra.run.smithi144.stdout:> setup() 2024-06-04T16:22:31.398 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.398 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:326: 2024-06-04T16:22:31.398 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.398 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/__init__.py:269: in setup 2024-06-04T16:22:31.398 INFO:teuthology.orchestra.run.smithi144.stdout: config.iam_root_access_key = cfg.get('iam root',"access_key") 2024-06-04T16:22:31.398 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:781: in get 2024-06-04T16:22:31.399 INFO:teuthology.orchestra.run.smithi144.stdout: d = self._unify_values(section, vars) 2024-06-04T16:22:31.399 INFO:teuthology.orchestra.run.smithi144.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-06-04T16:22:31.399 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.399 INFO:teuthology.orchestra.run.smithi144.stdout:self = 2024-06-04T16:22:31.399 INFO:teuthology.orchestra.run.smithi144.stdout:section = 'iam root', vars = None 2024-06-04T16:22:31.399 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.399 INFO:teuthology.orchestra.run.smithi144.stdout: def _unify_values(self, section, vars): 2024-06-04T16:22:31.399 INFO:teuthology.orchestra.run.smithi144.stdout: """Create a sequence of lookups with 'vars' taking priority over 2024-06-04T16:22:31.399 INFO:teuthology.orchestra.run.smithi144.stdout: the 'section' which takes priority over the DEFAULTSECT. 2024-06-04T16:22:31.399 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.399 INFO:teuthology.orchestra.run.smithi144.stdout: """ 2024-06-04T16:22:31.399 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = {} 2024-06-04T16:22:31.399 INFO:teuthology.orchestra.run.smithi144.stdout: try: 2024-06-04T16:22:31.399 INFO:teuthology.orchestra.run.smithi144.stdout: sectiondict = self._sections[section] 2024-06-04T16:22:31.400 INFO:teuthology.orchestra.run.smithi144.stdout: except KeyError: 2024-06-04T16:22:31.400 INFO:teuthology.orchestra.run.smithi144.stdout: if section != self.default_section: 2024-06-04T16:22:31.400 INFO:teuthology.orchestra.run.smithi144.stdout:> raise NoSectionError(section) from None 2024-06-04T16:22:31.400 INFO:teuthology.orchestra.run.smithi144.stdout:E configparser.NoSectionError: No section: 'iam root' 2024-06-04T16:22:31.400 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.400 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib64/python3.9/configparser.py:1152: NoSectionError 2024-06-04T16:22:31.400 INFO:teuthology.orchestra.run.smithi144.stdout:=============================== warnings summary =============================== 2024-06-04T16:22:31.400 INFO:teuthology.orchestra.run.smithi144.stdout:.tox/py/lib/python3.9/site-packages/boto/plugin.py:40 2024-06-04T16:22:31.400 INFO:teuthology.orchestra.run.smithi144.stdout: /home/ubuntu/cephtest/s3-tests-client.0/.tox/py/lib/python3.9/site-packages/boto/plugin.py:40: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses 2024-06-04T16:22:31.400 INFO:teuthology.orchestra.run.smithi144.stdout: import imp 2024-06-04T16:22:31.400 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.400 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests/functional/test_headers.py:120 2024-06-04T16:22:31.400 INFO:teuthology.orchestra.run.smithi144.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_headers.py:120: SyntaxWarning: "is" with a literal. Did you mean "=="? 2024-06-04T16:22:31.401 INFO:teuthology.orchestra.run.smithi144.stdout: if boto_type is 'S3Connection': 2024-06-04T16:22:31.401 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.401 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests/functional/test_headers.py:124 2024-06-04T16:22:31.401 INFO:teuthology.orchestra.run.smithi144.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_headers.py:124: SyntaxWarning: "is" with a literal. Did you mean "=="? 2024-06-04T16:22:31.401 INFO:teuthology.orchestra.run.smithi144.stdout: elif boto_type is 'HTTPRequest': 2024-06-04T16:22:31.401 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.401 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests/functional/test_s3.py:359 2024-06-04T16:22:31.401 INFO:teuthology.orchestra.run.smithi144.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_s3.py:359: DeprecationWarning: invalid escape sequence \W 2024-06-04T16:22:31.401 INFO:teuthology.orchestra.run.smithi144.stdout: extra_sc = re.split('\W+', config['main']['storage_classes']) 2024-06-04T16:22:31.401 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.401 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests/functional/test_s3_website.py:176 2024-06-04T16:22:31.401 INFO:teuthology.orchestra.run.smithi144.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_s3_website.py:176: SyntaxWarning: "is" with a literal. Did you mean "=="? 2024-06-04T16:22:31.402 INFO:teuthology.orchestra.run.smithi144.stdout: if k is 'BucketName': 2024-06-04T16:22:31.402 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.402 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests/functional/test_s3_website.py:253 2024-06-04T16:22:31.402 INFO:teuthology.orchestra.run.smithi144.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_s3_website.py:253: PytestUnknownMarkWarning: Unknown pytest.mark.timeout - is this a typo? You can register custom marks to avoid this warning - for details, see https://docs.pytest.org/en/stable/how-to/mark.html 2024-06-04T16:22:31.402 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.mark.timeout(10) 2024-06-04T16:22:31.402 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.402 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests/functional/test_s3_website.py:1077 2024-06-04T16:22:31.402 INFO:teuthology.orchestra.run.smithi144.stdout: s3tests/functional/test_s3_website.py:1077: PytestCollectionWarning: yield tests were removed in pytest 4.0 - test_routing_generator will be ignored 2024-06-04T16:22:31.402 INFO:teuthology.orchestra.run.smithi144.stdout: @pytest.mark.s3website_routing_rules 2024-06-04T16:22:31.402 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.402 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py:2213 2024-06-04T16:22:31.402 INFO:teuthology.orchestra.run.smithi144.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2213: DeprecationWarning: invalid escape sequence \$ 2024-06-04T16:22:31.402 INFO:teuthology.orchestra.run.smithi144.stdout: ["starts-with", "$key", "\$foo"],\ 2024-06-04T16:22:31.403 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.403 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py:2228 2024-06-04T16:22:31.403 INFO:teuthology.orchestra.run.smithi144.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2228: DeprecationWarning: invalid escape sequence \$ 2024-06-04T16:22:31.403 INFO:teuthology.orchestra.run.smithi144.stdout: payload = OrderedDict([ ("key" , "\$foo.txt"),("AWSAccessKeyId" , aws_access_key_id),\ 2024-06-04T16:22:31.403 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.403 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py:2234 2024-06-04T16:22:31.403 INFO:teuthology.orchestra.run.smithi144.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2234: DeprecationWarning: invalid escape sequence \$ 2024-06-04T16:22:31.403 INFO:teuthology.orchestra.run.smithi144.stdout: response = client.get_object(Bucket=bucket_name, Key='\$foo.txt') 2024-06-04T16:22:31.403 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.403 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py:2291 2024-06-04T16:22:31.403 INFO:teuthology.orchestra.run.smithi144.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2291: DeprecationWarning: invalid escape sequence \$ 2024-06-04T16:22:31.403 INFO:teuthology.orchestra.run.smithi144.stdout: ["starts-with", "$key", "\$foo"],\ 2024-06-04T16:22:31.403 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.403 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py:2306 2024-06-04T16:22:31.403 INFO:teuthology.orchestra.run.smithi144.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2306: DeprecationWarning: invalid escape sequence \$ 2024-06-04T16:22:31.404 INFO:teuthology.orchestra.run.smithi144.stdout: payload = OrderedDict([ ("key" , "\$foo.txt"),("AWSAccessKeyId" , aws_access_key_id),\ 2024-06-04T16:22:31.404 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.404 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py:2324 2024-06-04T16:22:31.404 INFO:teuthology.orchestra.run.smithi144.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2324: DeprecationWarning: invalid escape sequence \$ 2024-06-04T16:22:31.404 INFO:teuthology.orchestra.run.smithi144.stdout: ["starts-with", "$key", "\$foo"],\ 2024-06-04T16:22:31.404 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.404 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py:2339 2024-06-04T16:22:31.404 INFO:teuthology.orchestra.run.smithi144.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2339: DeprecationWarning: invalid escape sequence \$ 2024-06-04T16:22:31.404 INFO:teuthology.orchestra.run.smithi144.stdout: payload = OrderedDict([ ("key" , "\$foo.txt"),("AWSAccessKeyId" , aws_access_key_id[::-1]),\ 2024-06-04T16:22:31.404 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.404 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py:2357 2024-06-04T16:22:31.404 INFO:teuthology.orchestra.run.smithi144.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2357: DeprecationWarning: invalid escape sequence \$ 2024-06-04T16:22:31.404 INFO:teuthology.orchestra.run.smithi144.stdout: ["starts-with", "$key", "\$foo"],\ 2024-06-04T16:22:31.404 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.404 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py:2372 2024-06-04T16:22:31.405 INFO:teuthology.orchestra.run.smithi144.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2372: DeprecationWarning: invalid escape sequence \$ 2024-06-04T16:22:31.405 INFO:teuthology.orchestra.run.smithi144.stdout: payload = OrderedDict([ ("key" , "\$foo.txt"),("AWSAccessKeyId" , aws_access_key_id),\ 2024-06-04T16:22:31.405 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.405 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py:2422 2024-06-04T16:22:31.405 INFO:teuthology.orchestra.run.smithi144.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2422: DeprecationWarning: invalid escape sequence \$ 2024-06-04T16:22:31.405 INFO:teuthology.orchestra.run.smithi144.stdout: ["starts-with", "$key", "\$foo"],\ 2024-06-04T16:22:31.405 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.405 INFO:teuthology.orchestra.run.smithi144.stdout:s3tests_boto3/functional/test_s3.py:2454 2024-06-04T16:22:31.405 INFO:teuthology.orchestra.run.smithi144.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2454: DeprecationWarning: invalid escape sequence \$ 2024-06-04T16:22:31.405 INFO:teuthology.orchestra.run.smithi144.stdout: ["starts-with", "$key", "\$foo"],\ 2024-06-04T16:22:31.405 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:31.405 INFO:teuthology.orchestra.run.smithi144.stdout:-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html 2024-06-04T16:22:31.405 INFO:teuthology.orchestra.run.smithi144.stdout:=========================== short test summary info ============================ 2024-06-04T16:22:31.405 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_invalid_short 2024-06-04T16:22:31.405 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_bad 2024-06-04T16:22:31.406 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_empty 2024-06-04T16:22:31.406 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_none 2024-06-04T16:22:31.406 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_headers.py::test_object_create_bad_expect_mismatch 2024-06-04T16:22:31.406 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_headers.py::test_object_create_bad_expect_empty 2024-06-04T16:22:31.406 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_headers.py::test_object_create_bad_expect_none 2024-06-04T16:22:31.406 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_headers.py::test_object_create_bad_contentlength_negative 2024-06-04T16:22:31.406 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_headers.py::test_object_create_bad_contenttype_invalid 2024-06-04T16:22:31.406 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_headers.py::test_object_create_bad_contenttype_empty 2024-06-04T16:22:31.406 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_headers.py::test_object_create_bad_contenttype_none 2024-06-04T16:22:31.406 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_headers.py::test_bucket_put_bad_canned_acl 2024-06-04T16:22:31.406 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_expect_mismatch 2024-06-04T16:22:31.406 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_expect_empty 2024-06-04T16:22:31.406 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_contentlength_negative 2024-06-04T16:22:31.407 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_invalid_garbage_aws2 2024-06-04T16:22:31.407 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_headers.py::test_object_create_bad_ua_empty_aws2 2024-06-04T16:22:31.407 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_headers.py::test_object_create_bad_ua_none_aws2 2024-06-04T16:22:31.407 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_invalid_aws2 2024-06-04T16:22:31.407 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_empty_aws2 2024-06-04T16:22:31.407 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_before_today_aws2 2024-06-04T16:22:31.407 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_before_epoch_aws2 2024-06-04T16:22:31.407 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_after_end_aws2 2024-06-04T16:22:31.407 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_ua_empty_aws2 2024-06-04T16:22:31.407 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_ua_none_aws2 2024-06-04T16:22:31.407 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_invalid_aws2 2024-06-04T16:22:31.407 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_empty_aws2 2024-06-04T16:22:31.407 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_before_today_aws2 2024-06-04T16:22:31.408 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_after_today_aws2 2024-06-04T16:22:31.408 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_before_epoch_aws2 2024-06-04T16:22:31.408 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_iam.py::test_put_user_policy - configpars... 2024-06-04T16:22:31.408 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_iam.py::test_put_user_policy_invalid_user 2024-06-04T16:22:31.408 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_iam.py::test_put_user_policy_parameter_limit 2024-06-04T16:22:31.408 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_iam.py::test_put_existing_user_policy - c... 2024-06-04T16:22:31.408 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_iam.py::test_list_user_policy - configpar... 2024-06-04T16:22:31.408 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_iam.py::test_list_user_policy_invalid_user 2024-06-04T16:22:31.409 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_iam.py::test_get_user_policy - configpars... 2024-06-04T16:22:31.409 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_iam.py::test_get_user_policy_invalid_user 2024-06-04T16:22:31.409 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_iam.py::test_get_user_policy_from_multiple_policies 2024-06-04T16:22:31.409 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_iam.py::test_delete_user_policy - configp... 2024-06-04T16:22:31.409 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_iam.py::test_delete_user_policy_invalid_user 2024-06-04T16:22:31.409 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_iam.py::test_delete_user_policy_invalid_policy_name 2024-06-04T16:22:31.409 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_iam.py::test_delete_user_policy_from_multiple_policies 2024-06-04T16:22:31.409 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_iam.py::test_allow_bucket_actions_in_user_policy 2024-06-04T16:22:31.409 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_iam.py::test_deny_bucket_actions_in_user_policy 2024-06-04T16:22:31.409 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_iam.py::test_allow_object_actions_in_user_policy 2024-06-04T16:22:31.409 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_iam.py::test_deny_object_actions_in_user_policy 2024-06-04T16:22:31.409 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_iam.py::test_allow_multipart_actions_in_user_policy 2024-06-04T16:22:31.409 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_iam.py::test_deny_multipart_actions_in_user_policy 2024-06-04T16:22:31.409 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_iam.py::test_allow_tagging_actions_in_user_policy 2024-06-04T16:22:31.410 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_iam.py::test_deny_tagging_actions_in_user_policy 2024-06-04T16:22:31.410 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_iam.py::test_verify_conflicting_user_policy_statements 2024-06-04T16:22:31.410 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_iam.py::test_verify_conflicting_user_policies 2024-06-04T16:22:31.410 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_iam.py::test_verify_allow_iam_actions - c... 2024-06-04T16:22:31.410 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_iam.py::test_account_user_create - config... 2024-06-04T16:22:31.410 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_iam.py::test_account_user_case_insensitive_name 2024-06-04T16:22:31.410 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_iam.py::test_account_user_delete - config... 2024-06-04T16:22:31.410 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_iam.py::test_account_user_list - configpa... 2024-06-04T16:22:31.410 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_iam.py::test_account_user_list_path_prefix 2024-06-04T16:22:31.410 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_iam.py::test_account_user_update_name - c... 2024-06-04T16:22:31.410 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_iam.py::test_account_user_update_path - c... 2024-06-04T16:22:31.410 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_iam.py::test_account_user_access_key_create 2024-06-04T16:22:31.410 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_iam.py::test_account_current_user_access_key_create 2024-06-04T16:22:31.411 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_iam.py::test_account_user_access_key_update 2024-06-04T16:22:31.411 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_iam.py::test_account_current_user_access_key_update 2024-06-04T16:22:31.411 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_iam.py::test_account_user_access_key_delete 2024-06-04T16:22:31.411 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_iam.py::test_account_current_user_access_key_delete 2024-06-04T16:22:31.411 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_iam.py::test_account_user_access_key_list 2024-06-04T16:22:31.411 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_iam.py::test_account_user_bucket_policy_allow 2024-06-04T16:22:31.411 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_iam.py::test_account_user_policy - config... 2024-06-04T16:22:31.411 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_iam.py::test_account_user_policy_managed 2024-06-04T16:22:31.411 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_iam.py::test_account_user_policy_allow - ... 2024-06-04T16:22:31.411 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_iam.py::test_account_group_create - confi... 2024-06-04T16:22:31.411 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_iam.py::test_account_group_case_insensitive_name 2024-06-04T16:22:31.411 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_iam.py::test_account_group_list - configp... 2024-06-04T16:22:31.411 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_iam.py::test_account_group_update - confi... 2024-06-04T16:22:31.411 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_iam.py::test_account_inline_group_policy 2024-06-04T16:22:31.412 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_iam.py::test_account_managed_group_policy 2024-06-04T16:22:31.412 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_iam.py::test_account_inline_group_policy_allow 2024-06-04T16:22:31.412 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_iam.py::test_account_managed_group_policy_allow 2024-06-04T16:22:31.412 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_iam.py::test_account_role_create - config... 2024-06-04T16:22:31.412 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_iam.py::test_account_role_case_insensitive_name 2024-06-04T16:22:31.412 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_iam.py::test_account_role_delete - config... 2024-06-04T16:22:31.412 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_iam.py::test_account_role_list - configpa... 2024-06-04T16:22:31.412 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_iam.py::test_account_role_list_path_prefix 2024-06-04T16:22:31.412 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_iam.py::test_account_role_update - config... 2024-06-04T16:22:31.412 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_iam.py::test_account_role_policy - config... 2024-06-04T16:22:31.412 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_iam.py::test_account_role_policy_managed 2024-06-04T16:22:31.412 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_iam.py::test_account_role_policy_allow - ... 2024-06-04T16:22:31.412 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_iam.py::test_same_account_role_policy_allow 2024-06-04T16:22:31.413 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_iam.py::test_cross_account_role_policy_allow 2024-06-04T16:22:31.413 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_iam.py::test_account_role_policy_allow_create_bucket 2024-06-04T16:22:31.413 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_iam.py::test_account_role_policy_allow_get_role 2024-06-04T16:22:31.413 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_iam.py::test_account_oidc_provider - conf... 2024-06-04T16:22:31.413 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_user_policy_allow_user_arn 2024-06-04T16:22:31.413 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_iam.py::test_cross_account_user_bucket_policy_allow_user_arn 2024-06-04T16:22:31.413 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_iam.py::test_cross_account_user_bucket_policy_allow_account_arn 2024-06-04T16:22:31.413 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_user_policy_allow_account_arn 2024-06-04T16:22:31.413 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_iam.py::test_cross_account_user_bucket_policy_allow_account_id 2024-06-04T16:22:31.413 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_user_policy_allow_account_id 2024-06-04T16:22:31.413 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_acl_user_policy_grant_user_id 2024-06-04T16:22:31.413 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_iam.py::test_cross_account_user_policy_bucket_acl_grant_user_id 2024-06-04T16:22:31.413 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_acl_user_policy_grant_canonical_id 2024-06-04T16:22:31.413 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_iam.py::test_cross_account_user_policy_bucket_acl_grant_canonical_id 2024-06-04T16:22:31.414 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_acl_user_policy_grant_account_email 2024-06-04T16:22:31.414 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_iam.py::test_cross_account_user_policy_bucket_acl_grant_account_email 2024-06-04T16:22:31.414 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_iam.py::test_cross_account_root_bucket_policy_allow_account_arn 2024-06-04T16:22:31.414 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_iam.py::test_cross_account_root_bucket_policy_allow_account_id 2024-06-04T16:22:31.414 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_iam.py::test_cross_account_root_bucket_acl_grant_canonical_id 2024-06-04T16:22:31.414 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_iam.py::test_cross_account_root_bucket_acl_grant_account_email 2024-06-04T16:22:31.414 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_bucket_list_empty - configpar... 2024-06-04T16:22:31.414 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_bucket_list_distinct - config... 2024-06-04T16:22:31.414 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_bucket_list_many - configpars... 2024-06-04T16:22:31.414 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_bucket_listv2_many - configpa... 2024-06-04T16:22:31.414 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_basic_key_count - configparse... 2024-06-04T16:22:31.414 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_basic 2024-06-04T16:22:31.414 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_basic 2024-06-04T16:22:31.415 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_bucket_listv2_encoding_basic 2024-06-04T16:22:31.415 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_bucket_list_encoding_basic - ... 2024-06-04T16:22:31.415 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_prefix 2024-06-04T16:22:31.415 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_prefix 2024-06-04T16:22:31.415 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_prefix_ends_with_delimiter 2024-06-04T16:22:31.415 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_prefix_ends_with_delimiter 2024-06-04T16:22:31.415 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_alt - c... 2024-06-04T16:22:31.415 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_alt 2024-06-04T16:22:31.415 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_prefix_underscore 2024-06-04T16:22:31.415 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_prefix_underscore 2024-06-04T16:22:31.415 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_percentage 2024-06-04T16:22:31.415 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_percentage 2024-06-04T16:22:31.415 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_whitespace 2024-06-04T16:22:31.415 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_whitespace 2024-06-04T16:22:31.416 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_dot - c... 2024-06-04T16:22:31.416 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_dot 2024-06-04T16:22:31.416 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_unreadable 2024-06-04T16:22:31.416 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_unreadable 2024-06-04T16:22:31.416 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_empty 2024-06-04T16:22:31.416 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_empty 2024-06-04T16:22:31.416 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_none - ... 2024-06-04T16:22:31.416 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_none 2024-06-04T16:22:31.416 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_bucket_listv2_fetchowner_notempty 2024-06-04T16:22:31.416 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_bucket_listv2_fetchowner_defaultempty 2024-06-04T16:22:31.416 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_bucket_listv2_fetchowner_empty 2024-06-04T16:22:31.416 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_not_exist 2024-06-04T16:22:31.416 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_not_exist 2024-06-04T16:22:31.416 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_not_skip_special 2024-06-04T16:22:31.416 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_basic - co... 2024-06-04T16:22:31.416 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_basic - ... 2024-06-04T16:22:31.417 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_alt - conf... 2024-06-04T16:22:31.417 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_alt - co... 2024-06-04T16:22:31.417 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_empty - co... 2024-06-04T16:22:31.417 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_empty - ... 2024-06-04T16:22:31.417 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_none - con... 2024-06-04T16:22:31.417 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_none - c... 2024-06-04T16:22:31.417 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_not_exist 2024-06-04T16:22:31.417 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_not_exist 2024-06-04T16:22:31.417 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_unreadable 2024-06-04T16:22:31.417 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_unreadable 2024-06-04T16:22:31.417 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_basic 2024-06-04T16:22:31.417 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_basic 2024-06-04T16:22:31.417 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_alt 2024-06-04T16:22:31.417 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_alt 2024-06-04T16:22:31.418 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_prefix_not_exist 2024-06-04T16:22:31.418 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_prefix_not_exist 2024-06-04T16:22:31.418 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_delimiter_not_exist 2024-06-04T16:22:31.418 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_delimiter_not_exist 2024-06-04T16:22:31.418 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_prefix_delimiter_not_exist 2024-06-04T16:22:31.418 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_prefix_delimiter_not_exist 2024-06-04T16:22:31.418 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_bucket_list_maxkeys_one - con... 2024-06-04T16:22:31.418 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_bucket_listv2_maxkeys_one - c... 2024-06-04T16:22:31.418 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_bucket_list_maxkeys_zero - co... 2024-06-04T16:22:31.418 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_bucket_listv2_maxkeys_zero - ... 2024-06-04T16:22:31.418 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_bucket_list_maxkeys_none - co... 2024-06-04T16:22:31.418 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_bucket_listv2_maxkeys_none - ... 2024-06-04T16:22:31.418 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_account_usage - configparser.... 2024-06-04T16:22:31.418 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_head_bucket_usage - configpar... 2024-06-04T16:22:31.419 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_bucket_list_unordered - confi... 2024-06-04T16:22:31.419 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_bucket_listv2_unordered - con... 2024-06-04T16:22:31.419 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_bucket_list_maxkeys_invalid 2024-06-04T16:22:31.419 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_none - con... 2024-06-04T16:22:31.419 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_empty - co... 2024-06-04T16:22:31.419 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_bucket_listv2_continuationtoken_empty 2024-06-04T16:22:31.419 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_bucket_listv2_continuationtoken 2024-06-04T16:22:31.419 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_bucket_listv2_both_continuationtoken_startafter 2024-06-04T16:22:31.419 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_unreadable 2024-06-04T16:22:31.419 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_bucket_listv2_startafter_unreadable 2024-06-04T16:22:31.419 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_not_in_list 2024-06-04T16:22:31.419 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_bucket_listv2_startafter_not_in_list 2024-06-04T16:22:31.419 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_after_list 2024-06-04T16:22:31.419 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_bucket_listv2_startafter_after_list 2024-06-04T16:22:31.419 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_bucket_list_return_data - con... 2024-06-04T16:22:31.420 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_bucket_list_return_data_versioning 2024-06-04T16:22:31.420 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_bucket_list_objects_anonymous 2024-06-04T16:22:31.420 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_bucket_listv2_objects_anonymous 2024-06-04T16:22:31.420 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_bucket_list_objects_anonymous_fail 2024-06-04T16:22:31.420 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_bucket_listv2_objects_anonymous_fail 2024-06-04T16:22:31.420 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_bucket_notexist - configparse... 2024-06-04T16:22:31.420 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_bucketv2_notexist - configpar... 2024-06-04T16:22:31.420 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_bucket_delete_notexist - conf... 2024-06-04T16:22:31.420 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_bucket_delete_nonempty - conf... 2024-06-04T16:22:31.420 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_bucket_concurrent_set_canned_acl 2024-06-04T16:22:31.420 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_write_to_nonexist_bucket 2024-06-04T16:22:31.420 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_write_with_chunked_transfer_encoding 2024-06-04T16:22:31.420 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_bucket_create_delete - config... 2024-06-04T16:22:31.421 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_read_not_exist - confi... 2024-06-04T16:22:31.421 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_requestid_matches_header_on_error 2024-06-04T16:22:31.421 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_versioning_concurrent_multi_object_delete 2024-06-04T16:22:31.421 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_multi_object_delete - configp... 2024-06-04T16:22:31.421 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_multi_objectv2_delete - confi... 2024-06-04T16:22:31.421 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_multi_object_delete_key_limit 2024-06-04T16:22:31.421 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_multi_objectv2_delete_key_limit 2024-06-04T16:22:31.421 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_head_zero_bytes - conf... 2024-06-04T16:22:31.421 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_write_check_etag - con... 2024-06-04T16:22:31.421 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_write_cache_control - ... 2024-06-04T16:22:31.421 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_write_expires - config... 2024-06-04T16:22:31.421 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_write_read_update_read_delete 2024-06-04T16:22:31.421 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_set_get_metadata_none_to_good 2024-06-04T16:22:31.422 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_set_get_metadata_none_to_empty 2024-06-04T16:22:31.422 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_set_get_metadata_overwrite_to_empty 2024-06-04T16:22:31.422 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_metadata_replaced_on_put 2024-06-04T16:22:31.422 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_write_file - configpar... 2024-06-04T16:22:31.422 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_post_object_anonymous_request 2024-06-04T16:22:31.422 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_post_object_authenticated_request 2024-06-04T16:22:31.422 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_post_object_authenticated_no_content_type 2024-06-04T16:22:31.422 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_post_object_authenticated_request_bad_access_key 2024-06-04T16:22:31.422 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_post_object_set_success_code 2024-06-04T16:22:31.422 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_post_object_set_invalid_success_code 2024-06-04T16:22:31.422 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_post_object_upload_larger_than_chunk 2024-06-04T16:22:31.422 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_post_object_set_key_from_filename 2024-06-04T16:22:31.423 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_post_object_ignored_header - ... 2024-06-04T16:22:31.423 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_post_object_case_insensitive_condition_fields 2024-06-04T16:22:31.423 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_post_object_escaped_field_values 2024-06-04T16:22:31.423 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_post_object_success_redirect_action 2024-06-04T16:22:31.423 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_post_object_invalid_signature 2024-06-04T16:22:31.423 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_post_object_invalid_access_key 2024-06-04T16:22:31.423 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_post_object_invalid_date_format 2024-06-04T16:22:31.423 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_post_object_no_key_specified 2024-06-04T16:22:31.423 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_post_object_missing_signature 2024-06-04T16:22:31.423 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_post_object_missing_policy_condition 2024-06-04T16:22:31.423 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_post_object_user_specified_header 2024-06-04T16:22:31.423 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_post_object_request_missing_policy_specified_field 2024-06-04T16:22:31.423 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_post_object_condition_is_case_sensitive 2024-06-04T16:22:31.423 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_post_object_expires_is_case_sensitive 2024-06-04T16:22:31.424 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_post_object_expired_policy - ... 2024-06-04T16:22:31.424 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_post_object_wrong_bucket - co... 2024-06-04T16:22:31.424 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_post_object_invalid_request_field_value 2024-06-04T16:22:31.424 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_post_object_missing_expires_condition 2024-06-04T16:22:31.424 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_post_object_missing_conditions_list 2024-06-04T16:22:31.424 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_post_object_upload_size_limit_exceeded 2024-06-04T16:22:31.424 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_post_object_missing_content_length_argument 2024-06-04T16:22:31.424 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_post_object_invalid_content_length_argument 2024-06-04T16:22:31.424 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_post_object_upload_size_below_minimum 2024-06-04T16:22:31.424 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_post_object_upload_size_rgw_chunk_size_bug 2024-06-04T16:22:31.424 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_post_object_empty_conditions 2024-06-04T16:22:31.424 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_get_object_ifmatch_good - con... 2024-06-04T16:22:31.424 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_get_object_ifmatch_failed - c... 2024-06-04T16:22:31.425 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_get_object_ifnonematch_good 2024-06-04T16:22:31.425 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_get_object_ifnonematch_failed 2024-06-04T16:22:31.425 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_get_object_ifmodifiedsince_good 2024-06-04T16:22:31.425 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_get_object_ifmodifiedsince_failed 2024-06-04T16:22:31.425 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_get_object_ifunmodifiedsince_good 2024-06-04T16:22:31.425 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_get_object_ifunmodifiedsince_failed 2024-06-04T16:22:31.425 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_put_object_ifmatch_good - con... 2024-06-04T16:22:31.425 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_put_object_ifmatch_failed - c... 2024-06-04T16:22:31.425 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_put_object_ifmatch_overwrite_existed_good 2024-06-04T16:22:31.425 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_put_object_ifmatch_nonexisted_failed 2024-06-04T16:22:31.425 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_put_object_ifnonmatch_good - ... 2024-06-04T16:22:31.425 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_put_object_ifnonmatch_failed 2024-06-04T16:22:31.425 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_put_object_ifnonmatch_nonexisted_good 2024-06-04T16:22:31.425 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_put_object_ifnonmatch_overwrite_existed_failed 2024-06-04T16:22:31.426 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_raw_get - configparser... 2024-06-04T16:22:31.426 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_raw_get_bucket_gone - ... 2024-06-04T16:22:31.426 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_delete_key_bucket_gone 2024-06-04T16:22:31.426 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_raw_get_object_gone - ... 2024-06-04T16:22:31.426 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_bucket_head - configparser.No... 2024-06-04T16:22:31.426 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_bucket_head_notexist - config... 2024-06-04T16:22:31.426 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_bucket_head_extended - config... 2024-06-04T16:22:31.426 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_raw_get_bucket_acl - c... 2024-06-04T16:22:31.426 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_raw_get_object_acl - c... 2024-06-04T16:22:31.426 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_put_acl_mtime - config... 2024-06-04T16:22:31.426 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated - co... 2024-06-04T16:22:31.426 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_raw_response_headers 2024-06-04T16:22:31.426 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated_bucket_acl 2024-06-04T16:22:31.427 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated_object_acl 2024-06-04T16:22:31.427 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated_bucket_gone 2024-06-04T16:22:31.427 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated_object_gone 2024-06-04T16:22:31.427 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_not_expired 2024-06-04T16:22:31.427 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_not_expired_tenant 2024-06-04T16:22:31.427 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_out_range_zero 2024-06-04T16:22:31.427 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_out_max_range 2024-06-04T16:22:31.427 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_out_positive_range 2024-06-04T16:22:31.427 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_anon_put - configparse... 2024-06-04T16:22:31.427 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_anon_put_write_access 2024-06-04T16:22:31.427 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_put_authenticated - co... 2024-06-04T16:22:31.427 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_presigned_put_object_with_acl 2024-06-04T16:22:31.427 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_presigned_put_object_with_acl_tenant 2024-06-04T16:22:31.428 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_raw_put_authenticated_expired 2024-06-04T16:22:31.428 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_bad_starts_nonalpha 2024-06-04T16:22:31.428 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_bad_short_one 2024-06-04T16:22:31.428 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_bad_short_two 2024-06-04T16:22:31.428 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_long_60 2024-06-04T16:22:31.428 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_long_61 2024-06-04T16:22:31.428 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_long_62 2024-06-04T16:22:31.428 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_long_63 2024-06-04T16:22:31.428 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_bucket_list_long_name - confi... 2024-06-04T16:22:31.428 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_bad_ip 2024-06-04T16:22:31.428 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_underscore 2024-06-04T16:22:31.428 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_long 2024-06-04T16:22:31.428 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_dash_at_end 2024-06-04T16:22:31.428 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_dot_dot 2024-06-04T16:22:31.429 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_dot_dash 2024-06-04T16:22:31.429 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_dash_dot 2024-06-04T16:22:31.429 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_bucket_create_exists - config... 2024-06-04T16:22:31.429 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_bucket_get_location - configp... 2024-06-04T16:22:31.429 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_bucket_create_exists_nonowner 2024-06-04T16:22:31.429 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_bucket_recreate_overwrite_acl 2024-06-04T16:22:31.429 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_bucket_recreate_new_acl - con... 2024-06-04T16:22:31.429 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_bucket_acl_default - configpa... 2024-06-04T16:22:31.429 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned_during_create 2024-06-04T16:22:31.429 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned - configpar... 2024-06-04T16:22:31.429 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned_publicreadwrite 2024-06-04T16:22:31.429 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned_authenticatedread 2024-06-04T16:22:31.429 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_acl_default - configpa... 2024-06-04T16:22:31.430 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_acl_canned_during_create 2024-06-04T16:22:31.430 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_acl_canned - configpar... 2024-06-04T16:22:31.430 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_acl_canned_publicreadwrite 2024-06-04T16:22:31.430 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_acl_canned_authenticatedread 2024-06-04T16:22:31.430 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_acl_canned_bucketownerread 2024-06-04T16:22:31.430 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_acl_canned_bucketownerfullcontrol 2024-06-04T16:22:31.430 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_acl_full_control_verify_owner 2024-06-04T16:22:31.430 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_acl_full_control_verify_attributes 2024-06-04T16:22:31.430 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned_private_to_private 2024-06-04T16:22:31.430 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_acl - configparser.NoS... 2024-06-04T16:22:31.430 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_acl_write - configpars... 2024-06-04T16:22:31.430 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_acl_writeacp - configp... 2024-06-04T16:22:31.430 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_acl_read - configparse... 2024-06-04T16:22:31.431 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_acl_readacp - configpa... 2024-06-04T16:22:31.431 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_fullcontrol 2024-06-04T16:22:31.431 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_read 2024-06-04T16:22:31.431 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_readacp 2024-06-04T16:22:31.431 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_write 2024-06-04T16:22:31.431 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_writeacp 2024-06-04T16:22:31.431 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_nonexist_user 2024-06-04T16:22:31.431 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_header_acl_grants - co... 2024-06-04T16:22:31.431 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_bucket_header_acl_grants - co... 2024-06-04T16:22:31.431 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_email - conf... 2024-06-04T16:22:31.431 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_email_not_exist 2024-06-04T16:22:31.431 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_bucket_acl_revoke_all - confi... 2024-06-04T16:22:31.431 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_access_bucket_private_object_private 2024-06-04T16:22:31.431 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_access_bucket_private_objectv2_private 2024-06-04T16:22:31.431 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_access_bucket_private_object_publicread 2024-06-04T16:22:31.432 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_access_bucket_private_objectv2_publicread 2024-06-04T16:22:31.432 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_access_bucket_private_object_publicreadwrite 2024-06-04T16:22:31.432 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_access_bucket_private_objectv2_publicreadwrite 2024-06-04T16:22:31.432 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_access_bucket_publicread_object_private 2024-06-04T16:22:31.432 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_access_bucket_publicread_object_publicread 2024-06-04T16:22:31.432 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_access_bucket_publicread_object_publicreadwrite 2024-06-04T16:22:31.432 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_access_bucket_publicreadwrite_object_private 2024-06-04T16:22:31.432 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_access_bucket_publicreadwrite_object_publicread 2024-06-04T16:22:31.432 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_access_bucket_publicreadwrite_object_publicreadwrite 2024-06-04T16:22:31.432 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_buckets_create_then_list - co... 2024-06-04T16:22:31.432 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_buckets_list_ctime - configpa... 2024-06-04T16:22:31.432 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_list_buckets_anonymous - conf... 2024-06-04T16:22:31.432 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_list_buckets_invalid_auth - c... 2024-06-04T16:22:31.432 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_list_buckets_bad_auth - confi... 2024-06-04T16:22:31.433 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_starts_alpha 2024-06-04T16:22:31.433 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_starts_digit 2024-06-04T16:22:31.433 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_contains_period 2024-06-04T16:22:31.433 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_contains_hyphen 2024-06-04T16:22:31.433 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_bucket_recreate_not_overriding 2024-06-04T16:22:31.433 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_bucket_create_special_key_names 2024-06-04T16:22:31.433 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_bucket_list_special_prefix - ... 2024-06-04T16:22:31.433 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_copy_zero_size - confi... 2024-06-04T16:22:31.433 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_copy_16m - configparse... 2024-06-04T16:22:31.433 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_copy_same_bucket - con... 2024-06-04T16:22:31.433 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_copy_verify_contenttype 2024-06-04T16:22:31.433 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_copy_to_itself - confi... 2024-06-04T16:22:31.433 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_copy_to_itself_with_metadata 2024-06-04T16:22:31.433 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_copy_diff_bucket - con... 2024-06-04T16:22:31.434 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_copy_not_owned_bucket 2024-06-04T16:22:31.434 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_copy_not_owned_object_bucket 2024-06-04T16:22:31.434 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_copy_canned_acl - conf... 2024-06-04T16:22:31.434 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_copy_retaining_metadata 2024-06-04T16:22:31.434 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_copy_replacing_metadata 2024-06-04T16:22:31.434 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_copy_bucket_not_found 2024-06-04T16:22:31.434 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_copy_key_not_found - c... 2024-06-04T16:22:31.434 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_copy_versioned_bucket 2024-06-04T16:22:31.434 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_copy_versioned_url_encoding 2024-06-04T16:22:31.434 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_copy_versioning_multipart_upload 2024-06-04T16:22:31.434 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_multipart_upload_empty - conf... 2024-06-04T16:22:31.434 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_multipart_upload_small - conf... 2024-06-04T16:22:31.434 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_multipart_copy_small - config... 2024-06-04T16:22:31.435 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_multipart_copy_invalid_range 2024-06-04T16:22:31.435 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_multipart_copy_without_range 2024-06-04T16:22:31.435 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_multipart_copy_special_names 2024-06-04T16:22:31.435 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_multipart_upload - configpars... 2024-06-04T16:22:31.435 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_multipart_copy_versioned - co... 2024-06-04T16:22:31.435 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_multipart_upload_resend_part 2024-06-04T16:22:31.435 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_multipart_upload_multiple_sizes 2024-06-04T16:22:31.435 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_multipart_copy_multiple_sizes 2024-06-04T16:22:31.435 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_multipart_upload_size_too_small 2024-06-04T16:22:31.435 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_multipart_upload_contents - c... 2024-06-04T16:22:31.435 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_multipart_upload_overwrite_existing_object 2024-06-04T16:22:31.435 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_abort_multipart_upload - conf... 2024-06-04T16:22:31.435 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_abort_multipart_upload_not_found 2024-06-04T16:22:31.435 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_list_multipart_upload - confi... 2024-06-04T16:22:31.436 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_list_multipart_upload_owner 2024-06-04T16:22:31.436 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_multipart_upload_missing_part 2024-06-04T16:22:31.436 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_multipart_upload_incorrect_etag 2024-06-04T16:22:31.436 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_multipart_get_part - configpa... 2024-06-04T16:22:31.436 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_non_multipart_get_part - conf... 2024-06-04T16:22:31.436 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_100_continue - configparser.N... 2024-06-04T16:22:31.436 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_set_cors - configparser.NoSec... 2024-06-04T16:22:31.436 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_cors_origin_response - config... 2024-06-04T16:22:31.436 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_cors_origin_wildcard - config... 2024-06-04T16:22:31.436 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_cors_header_option - configpa... 2024-06-04T16:22:31.436 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_cors_presigned_get_object - c... 2024-06-04T16:22:31.436 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_cors_presigned_get_object_tenant 2024-06-04T16:22:31.436 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_cors_presigned_put_object - c... 2024-06-04T16:22:31.436 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_cors_presigned_put_object_with_acl 2024-06-04T16:22:31.436 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_cors_presigned_put_object_tenant 2024-06-04T16:22:31.437 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_cors_presigned_put_object_tenant_with_acl 2024-06-04T16:22:31.437 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_set_bucket_tagging - configpa... 2024-06-04T16:22:31.437 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_atomic_read_1mb - configparse... 2024-06-04T16:22:31.437 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_atomic_read_4mb - configparse... 2024-06-04T16:22:31.437 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_atomic_read_8mb - configparse... 2024-06-04T16:22:31.437 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_atomic_write_1mb - configpars... 2024-06-04T16:22:31.437 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_atomic_write_4mb - configpars... 2024-06-04T16:22:31.437 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_atomic_write_8mb - configpars... 2024-06-04T16:22:31.437 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_atomic_dual_write_1mb - confi... 2024-06-04T16:22:31.437 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_atomic_dual_write_4mb - confi... 2024-06-04T16:22:31.437 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_atomic_dual_write_8mb - confi... 2024-06-04T16:22:31.437 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_atomic_conditional_write_1mb 2024-06-04T16:22:31.437 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_atomic_multipart_upload_write 2024-06-04T16:22:31.437 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_multipart_resend_first_finishes_last 2024-06-04T16:22:31.437 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_ranged_request_response_code 2024-06-04T16:22:31.438 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_ranged_big_request_response_code 2024-06-04T16:22:31.438 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_ranged_request_skip_leading_bytes_response_code 2024-06-04T16:22:31.438 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_ranged_request_return_trailing_bytes_response_code 2024-06-04T16:22:31.438 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_ranged_request_invalid_range 2024-06-04T16:22:31.438 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_ranged_request_empty_object 2024-06-04T16:22:31.438 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_versioning_bucket_create_suspend 2024-06-04T16:22:31.438 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_read_remove 2024-06-04T16:22:31.438 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_read_remove_head 2024-06-04T16:22:31.438 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_versioning_obj_plain_null_version_removal 2024-06-04T16:22:31.438 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_versioning_obj_plain_null_version_overwrite 2024-06-04T16:22:31.438 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_versioning_obj_plain_null_version_overwrite_suspended 2024-06-04T16:22:31.438 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_versioning_obj_suspend_versions 2024-06-04T16:22:31.438 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_versioning_obj_suspended_copy 2024-06-04T16:22:31.438 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_versions_remove_all 2024-06-04T16:22:31.439 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_versions_remove_special_names 2024-06-04T16:22:31.439 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_overwrite_multipart 2024-06-04T16:22:31.439 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_versioning_obj_list_marker - ... 2024-06-04T16:22:31.439 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_versioning_copy_obj_version 2024-06-04T16:22:31.439 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_versioning_multi_object_delete 2024-06-04T16:22:31.439 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_versioning_multi_object_delete_with_marker 2024-06-04T16:22:31.439 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_versioning_multi_object_delete_with_marker_create 2024-06-04T16:22:31.439 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_versioned_object_acl - config... 2024-06-04T16:22:31.439 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_versioned_object_acl_no_version_specified 2024-06-04T16:22:31.439 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_versioned_concurrent_object_create_and_remove 2024-06-04T16:22:31.439 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_lifecycle_set - configparser.... 2024-06-04T16:22:31.439 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_lifecycle_get - configparser.... 2024-06-04T16:22:31.439 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_lifecycle_get_no_id - configp... 2024-06-04T16:22:31.439 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_lifecycle_id_too_long - confi... 2024-06-04T16:22:31.439 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_lifecycle_same_id - configpar... 2024-06-04T16:22:31.440 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_lifecycle_invalid_status - co... 2024-06-04T16:22:31.440 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_lifecycle_set_date - configpa... 2024-06-04T16:22:31.440 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_lifecycle_set_invalid_date - ... 2024-06-04T16:22:31.440 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_lifecycle_set_noncurrent - co... 2024-06-04T16:22:31.440 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_lifecycle_set_deletemarker - ... 2024-06-04T16:22:31.440 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_lifecycle_set_filter - config... 2024-06-04T16:22:31.440 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_lifecycle_set_empty_filter - ... 2024-06-04T16:22:31.440 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_lifecycle_set_multipart - con... 2024-06-04T16:22:31.440 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_lifecycle_transition_set_invalid_date 2024-06-04T16:22:31.440 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_1b - confi... 2024-06-04T16:22:31.440 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_1kb - conf... 2024-06-04T16:22:31.440 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_1MB - conf... 2024-06-04T16:22:31.440 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_13b - conf... 2024-06-04T16:22:31.440 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_method_head 2024-06-04T16:22:31.441 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_present - co... 2024-06-04T16:22:31.441 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_other_key - ... 2024-06-04T16:22:31.441 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_invalid_md5 2024-06-04T16:22:31.441 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_no_md5 - con... 2024-06-04T16:22:31.441 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_no_key - con... 2024-06-04T16:22:31.441 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_encryption_key_no_sse_c - con... 2024-06-04T16:22:31.441 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_multipart_upload 2024-06-04T16:22:31.441 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_unaligned_multipart_upload 2024-06-04T16:22:31.441 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_multipart_bad_download 2024-06-04T16:22:31.441 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_post_object_authenticated_request 2024-06-04T16:22:31.441 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_sse_kms_method_head - configp... 2024-06-04T16:22:31.441 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_sse_kms_present - configparse... 2024-06-04T16:22:31.441 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_sse_kms_no_key - configparser... 2024-06-04T16:22:31.441 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_sse_kms_not_declared - config... 2024-06-04T16:22:31.442 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_sse_kms_multipart_upload - co... 2024-06-04T16:22:31.442 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_sse_kms_multipart_invalid_chunks_1 2024-06-04T16:22:31.442 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_sse_kms_multipart_invalid_chunks_2 2024-06-04T16:22:31.442 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_sse_kms_post_object_authenticated_request 2024-06-04T16:22:31.442 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_1b - configp... 2024-06-04T16:22:31.442 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_1kb - config... 2024-06-04T16:22:31.442 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_1MB - config... 2024-06-04T16:22:31.442 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_13b - config... 2024-06-04T16:22:31.442 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_sse_kms_read_declare - config... 2024-06-04T16:22:31.442 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_bucket_policy - configparser.... 2024-06-04T16:22:31.442 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_bucketv2_policy - configparse... 2024-06-04T16:22:31.442 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_bucket_policy_acl - configpar... 2024-06-04T16:22:31.443 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_bucketv2_policy_acl - configp... 2024-06-04T16:22:31.443 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_bucket_policy_another_bucket 2024-06-04T16:22:31.443 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_bucketv2_policy_another_bucket 2024-06-04T16:22:31.443 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_get_obj_tagging - configparse... 2024-06-04T16:22:31.443 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_get_obj_head_tagging - config... 2024-06-04T16:22:31.443 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_put_max_tags - configparser.N... 2024-06-04T16:22:31.443 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_put_excess_tags - configparse... 2024-06-04T16:22:31.443 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_put_max_kvsize_tags - configp... 2024-06-04T16:22:31.443 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_put_excess_key_tags - configp... 2024-06-04T16:22:31.443 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_put_excess_val_tags - configp... 2024-06-04T16:22:31.443 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_put_modify_tags - configparse... 2024-06-04T16:22:31.443 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_put_delete_tags - configparse... 2024-06-04T16:22:31.443 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_post_object_tags_anonymous_request 2024-06-04T16:22:31.443 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_post_object_tags_authenticated_request 2024-06-04T16:22:31.443 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_put_obj_with_tags - configpar... 2024-06-04T16:22:31.444 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_get_tags_acl_public - configp... 2024-06-04T16:22:31.444 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_put_tags_acl_public - configp... 2024-06-04T16:22:31.444 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_delete_tags_obj_public - conf... 2024-06-04T16:22:31.444 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_versioning_bucket_atomic_upload_return_version_id 2024-06-04T16:22:31.444 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_versioning_bucket_multipart_upload_return_version_id 2024-06-04T16:22:31.444 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_bucket_policy_get_obj_existing_tag 2024-06-04T16:22:31.444 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_bucket_policy_get_obj_tagging_existing_tag 2024-06-04T16:22:31.444 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_tagging_existing_tag 2024-06-04T16:22:31.444 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_copy_source 2024-06-04T16:22:31.444 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_copy_source_meta 2024-06-04T16:22:31.444 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_acl - c... 2024-06-04T16:22:31.444 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_grant 2024-06-04T16:22:31.444 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_c_s3 - c... 2024-06-04T16:22:31.445 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_c_kms - ... 2024-06-04T16:22:31.445 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_s3_kms 2024-06-04T16:22:31.445 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_bad_enc_kms 2024-06-04T16:22:31.445 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_kms_noenc 2024-06-04T16:22:31.445 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_kms_s3 2024-06-04T16:22:31.445 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_bucket_policy_get_obj_acl_existing_tag 2024-06-04T16:22:31.445 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock - co... 2024-06-04T16:22:31.445 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_bucket 2024-06-04T16:22:31.445 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_with_days_and_years 2024-06-04T16:22:31.445 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_days 2024-06-04T16:22:31.445 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_years 2024-06-04T16:22:31.445 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_mode 2024-06-04T16:22:31.445 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_status 2024-06-04T16:22:31.445 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_lock_suspend_versioning 2024-06-04T16:22:31.446 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_lock - co... 2024-06-04T16:22:31.446 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_lock_invalid_bucket 2024-06-04T16:22:31.446 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention 2024-06-04T16:22:31.446 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_invalid_bucket 2024-06-04T16:22:31.446 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_invalid_mode 2024-06-04T16:22:31.446 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_retention 2024-06-04T16:22:31.446 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_retention_iso8601 2024-06-04T16:22:31.446 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_retention_invalid_bucket 2024-06-04T16:22:31.446 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_versionid 2024-06-04T16:22:31.446 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_override_default_retention 2024-06-04T16:22:31.446 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_increase_period 2024-06-04T16:22:31.447 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_shorten_period 2024-06-04T16:22:31.447 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_shorten_period_bypass 2024-06-04T16:22:31.447 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_retention 2024-06-04T16:22:31.447 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_lock_delete_multipart_object_with_retention 2024-06-04T16:22:31.447 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_retention_and_marker 2024-06-04T16:22:31.447 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_lock_multi_delete_object_with_retention 2024-06-04T16:22:31.447 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_lock_put_legal_hold - ... 2024-06-04T16:22:31.447 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_lock_put_legal_hold_invalid_bucket 2024-06-04T16:22:31.447 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_lock_put_legal_hold_invalid_status 2024-06-04T16:22:31.447 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_lock_get_legal_hold - ... 2024-06-04T16:22:31.447 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_lock_get_legal_hold_invalid_bucket 2024-06-04T16:22:31.447 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_legal_hold_on 2024-06-04T16:22:31.447 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_lock_delete_multipart_object_with_legal_hold_on 2024-06-04T16:22:31.447 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_legal_hold_off 2024-06-04T16:22:31.448 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_metadata 2024-06-04T16:22:31.448 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_lock_uploading_obj - c... 2024-06-04T16:22:31.448 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_lock_changing_mode_from_governance_with_bypass 2024-06-04T16:22:31.448 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_lock_changing_mode_from_governance_without_bypass 2024-06-04T16:22:31.448 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_lock_changing_mode_from_compliance 2024-06-04T16:22:31.448 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_copy_object_ifmatch_good - co... 2024-06-04T16:22:31.448 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_copy_object_ifnonematch_failed 2024-06-04T16:22:31.448 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_get_bucket_policy_status - co... 2024-06-04T16:22:31.448 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_get_public_acl_bucket_policy_status 2024-06-04T16:22:31.448 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_get_authpublic_acl_bucket_policy_status 2024-06-04T16:22:31.448 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_get_publicpolicy_acl_bucket_policy_status 2024-06-04T16:22:31.448 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_get_nonpublicpolicy_acl_bucket_policy_status 2024-06-04T16:22:31.448 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_get_nonpublicpolicy_deny_bucket_policy_status 2024-06-04T16:22:31.448 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_get_undefined_public_block - ... 2024-06-04T16:22:31.449 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_get_public_block_deny_bucket_policy 2024-06-04T16:22:31.449 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_put_public_block - configpars... 2024-06-04T16:22:31.449 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_block_public_put_bucket_acls 2024-06-04T16:22:31.449 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_block_public_object_canned_acls 2024-06-04T16:22:31.449 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_block_public_policy - configp... 2024-06-04T16:22:31.449 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_ignore_public_acls - configpa... 2024-06-04T16:22:31.449 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_multipart_upload_on_a_bucket_with_policy 2024-06-04T16:22:31.449 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_put_bucket_encryption_kms - c... 2024-06-04T16:22:31.449 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_get_bucket_encryption_kms - c... 2024-06-04T16:22:31.449 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_delete_bucket_encryption_kms 2024-06-04T16:22:31.449 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_sse_kms_default_post_object_authenticated_request 2024-06-04T16:22:31.449 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_get_object_torrent - configpa... 2024-06-04T16:22:31.449 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3select.py::test_generate_where_clause 2024-06-04T16:22:31.449 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3select.py::test_generate_projection - c... 2024-06-04T16:22:31.450 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3select.py::test_count_operation - confi... 2024-06-04T16:22:31.450 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3select.py::test_count_json_operation - ... 2024-06-04T16:22:31.450 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3select.py::test_json_column_sum_min_max 2024-06-04T16:22:31.450 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3select.py::test_json_nullif_expressions 2024-06-04T16:22:31.450 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3select.py::test_column_sum_min_max - co... 2024-06-04T16:22:31.450 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3select.py::test_nullif_expressions - co... 2024-06-04T16:22:31.450 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3select.py::test_nulliftrue_expressions 2024-06-04T16:22:31.450 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3select.py::test_is_not_null_expressions 2024-06-04T16:22:31.450 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3select.py::test_lowerupper_expressions 2024-06-04T16:22:31.450 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3select.py::test_in_expressions - config... 2024-06-04T16:22:31.450 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3select.py::test_true_false_in_expressions 2024-06-04T16:22:31.451 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3select.py::test_like_expressions - conf... 2024-06-04T16:22:31.451 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3select.py::test_truefalselike_expressions 2024-06-04T16:22:31.451 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3select.py::test_complex_expressions - c... 2024-06-04T16:22:31.451 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3select.py::test_alias - configparser.No... 2024-06-04T16:22:31.451 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3select.py::test_alias_cyclic_refernce 2024-06-04T16:22:31.451 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3select.py::test_datetime - configparser... 2024-06-04T16:22:31.451 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3select.py::test_true_false_datetime - c... 2024-06-04T16:22:31.451 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3select.py::test_csv_parser - configpars... 2024-06-04T16:22:31.451 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3select.py::test_csv_definition - config... 2024-06-04T16:22:31.451 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3select.py::test_schema_definition - con... 2024-06-04T16:22:31.451 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3select.py::test_when_then_else_expressions 2024-06-04T16:22:31.451 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3select.py::test_coalesce_expressions - ... 2024-06-04T16:22:31.451 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3select.py::test_cast_expressions - conf... 2024-06-04T16:22:31.451 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3select.py::test_version - configparser.... 2024-06-04T16:22:31.452 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3select.py::test_trim_expressions - conf... 2024-06-04T16:22:31.452 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3select.py::test_truefalse_trim_expressions 2024-06-04T16:22:31.452 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3select.py::test_escape_expressions - co... 2024-06-04T16:22:31.452 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3select.py::test_case_value_expressions 2024-06-04T16:22:31.452 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3select.py::test_bool_cast_expressions 2024-06-04T16:22:31.452 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3select.py::test_progress_expressions - ... 2024-06-04T16:22:31.452 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_s3select.py::test_output_serial_expressions 2024-06-04T16:22:31.452 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_sns.py::test_account_topic - configparser... 2024-06-04T16:22:31.452 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_sns.py::test_cross_account_topic - config... 2024-06-04T16:22:31.452 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_sns.py::test_account_topic_publish - conf... 2024-06-04T16:22:31.452 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR s3tests_boto3/functional/test_sns.py::test_cross_account_topic_publish 2024-06-04T16:22:31.452 INFO:teuthology.orchestra.run.smithi144.stdout:= 31 passed, 65 skipped, 127 deselected, 1 xfailed, 18 warnings, 635 errors in 261.30s (0:04:21) = 2024-06-04T16:22:31.454 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-06-04T16:22:31.454 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: InvocationError for command /home/ubuntu/cephtest/s3-tests-client.0/.tox/py/bin/pytest -v -m 'not fails_on_rgw and not lifecycle_expiration and not lifecycle_transition and not cloud_transition and not test_of_sts and not webidentity_test and not fails_with_subdomain and not sse_s3' (exited with code 1) 2024-06-04T16:22:31.454 INFO:teuthology.orchestra.run.smithi144.stdout:___________________________________ summary ____________________________________ 2024-06-04T16:22:31.454 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: py: commands failed 2024-06-04T16:22:31.455 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_861a8dcf7aa816a26e13f039336f7ed0a9aec0fa/teuthology/contextutil.py", line 30, in nested vars.append(enter()) File "/usr/lib/python3.10/contextlib.py", line 135, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_1fb5d10608dccee73edd6ef8a2c7b804a097c324/qa/tasks/s3tests.py", line 437, in run_tests toxvenv_sh(ctx, remote, args, label="s3 tests against rgw") File "/home/teuthworker/src/git.ceph.com_ceph-c_1fb5d10608dccee73edd6ef8a2c7b804a097c324/qa/tasks/s3tests.py", line 380, in toxvenv_sh return remote.sh(['source', activate, run.Raw('&&')] + args, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_861a8dcf7aa816a26e13f039336f7ed0a9aec0fa/teuthology/orchestra/remote.py", line 97, in sh proc = self.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_861a8dcf7aa816a26e13f039336f7ed0a9aec0fa/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_861a8dcf7aa816a26e13f039336f7ed0a9aec0fa/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_861a8dcf7aa816a26e13f039336f7ed0a9aec0fa/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_861a8dcf7aa816a26e13f039336f7ed0a9aec0fa/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed (s3 tests against rgw) on smithi144 with status 1: "source /home/ubuntu/cephtest/tox-venv/bin/activate && cd /home/ubuntu/cephtest/s3-tests-client.0 && S3TEST_CONF=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf BOTO_CONFIG=/home/ubuntu/cephtest/boto-client.0.cfg REQUESTS_CA_BUNDLE=/etc/pki/tls/certs/ca-bundle.crt tox -- -v -m 'not fails_on_rgw and not lifecycle_expiration and not lifecycle_transition and not cloud_transition and not test_of_sts and not webidentity_test and not fails_with_subdomain and not sse_s3'" 2024-06-04T16:22:31.456 INFO:tasks.s3tests:Cleaning up boto... 2024-06-04T16:22:31.457 DEBUG:teuthology.orchestra.run.smithi144:> rm /home/ubuntu/cephtest/boto-client.0.cfg 2024-06-04T16:22:31.493 INFO:tasks.s3tests:Removing s3-tests... 2024-06-04T16:22:31.493 DEBUG:teuthology.orchestra.run.smithi144:> rm -rf /home/ubuntu/cephtest/s3-tests-client.0 2024-06-04T16:22:31.690 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_861a8dcf7aa816a26e13f039336f7ed0a9aec0fa/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.10/contextlib.py", line 135, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_1fb5d10608dccee73edd6ef8a2c7b804a097c324/qa/tasks/s3tests.py", line 703, in task with contextutil.nested( File "/usr/lib/python3.10/contextlib.py", line 135, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_teuthology_861a8dcf7aa816a26e13f039336f7ed0a9aec0fa/teuthology/contextutil.py", line 54, in nested raise exc[1] File "/usr/lib/python3.10/contextlib.py", line 153, in __exit__ self.gen.throw(typ, value, traceback) File "/home/teuthworker/src/git.ceph.com_ceph-c_1fb5d10608dccee73edd6ef8a2c7b804a097c324/qa/tasks/s3tests.py", line 61, in download yield File "/home/teuthworker/src/git.ceph.com_teuthology_861a8dcf7aa816a26e13f039336f7ed0a9aec0fa/teuthology/contextutil.py", line 30, in nested vars.append(enter()) File "/usr/lib/python3.10/contextlib.py", line 135, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_1fb5d10608dccee73edd6ef8a2c7b804a097c324/qa/tasks/s3tests.py", line 437, in run_tests toxvenv_sh(ctx, remote, args, label="s3 tests against rgw") File "/home/teuthworker/src/git.ceph.com_ceph-c_1fb5d10608dccee73edd6ef8a2c7b804a097c324/qa/tasks/s3tests.py", line 380, in toxvenv_sh return remote.sh(['source', activate, run.Raw('&&')] + args, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_861a8dcf7aa816a26e13f039336f7ed0a9aec0fa/teuthology/orchestra/remote.py", line 97, in sh proc = self.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_861a8dcf7aa816a26e13f039336f7ed0a9aec0fa/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_861a8dcf7aa816a26e13f039336f7ed0a9aec0fa/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_861a8dcf7aa816a26e13f039336f7ed0a9aec0fa/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_861a8dcf7aa816a26e13f039336f7ed0a9aec0fa/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed (s3 tests against rgw) on smithi144 with status 1: "source /home/ubuntu/cephtest/tox-venv/bin/activate && cd /home/ubuntu/cephtest/s3-tests-client.0 && S3TEST_CONF=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf BOTO_CONFIG=/home/ubuntu/cephtest/boto-client.0.cfg REQUESTS_CA_BUNDLE=/etc/pki/tls/certs/ca-bundle.crt tox -- -v -m 'not fails_on_rgw and not lifecycle_expiration and not lifecycle_transition and not cloud_transition and not test_of_sts and not webidentity_test and not fails_with_subdomain and not sse_s3'" 2024-06-04T16:22:31.923 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=17520e1378824833b1622d18488e794d Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_861a8dcf7aa816a26e13f039336f7ed0a9aec0fa/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.10/contextlib.py", line 135, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_1fb5d10608dccee73edd6ef8a2c7b804a097c324/qa/tasks/s3tests.py", line 703, in task with contextutil.nested( File "/usr/lib/python3.10/contextlib.py", line 135, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_teuthology_861a8dcf7aa816a26e13f039336f7ed0a9aec0fa/teuthology/contextutil.py", line 54, in nested raise exc[1] File "/usr/lib/python3.10/contextlib.py", line 153, in __exit__ self.gen.throw(typ, value, traceback) File "/home/teuthworker/src/git.ceph.com_ceph-c_1fb5d10608dccee73edd6ef8a2c7b804a097c324/qa/tasks/s3tests.py", line 61, in download yield File "/home/teuthworker/src/git.ceph.com_teuthology_861a8dcf7aa816a26e13f039336f7ed0a9aec0fa/teuthology/contextutil.py", line 30, in nested vars.append(enter()) File "/usr/lib/python3.10/contextlib.py", line 135, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_1fb5d10608dccee73edd6ef8a2c7b804a097c324/qa/tasks/s3tests.py", line 437, in run_tests toxvenv_sh(ctx, remote, args, label="s3 tests against rgw") File "/home/teuthworker/src/git.ceph.com_ceph-c_1fb5d10608dccee73edd6ef8a2c7b804a097c324/qa/tasks/s3tests.py", line 380, in toxvenv_sh return remote.sh(['source', activate, run.Raw('&&')] + args, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_861a8dcf7aa816a26e13f039336f7ed0a9aec0fa/teuthology/orchestra/remote.py", line 97, in sh proc = self.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_861a8dcf7aa816a26e13f039336f7ed0a9aec0fa/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_861a8dcf7aa816a26e13f039336f7ed0a9aec0fa/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_861a8dcf7aa816a26e13f039336f7ed0a9aec0fa/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_861a8dcf7aa816a26e13f039336f7ed0a9aec0fa/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed (s3 tests against rgw) on smithi144 with status 1: "source /home/ubuntu/cephtest/tox-venv/bin/activate && cd /home/ubuntu/cephtest/s3-tests-client.0 && S3TEST_CONF=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf BOTO_CONFIG=/home/ubuntu/cephtest/boto-client.0.cfg REQUESTS_CA_BUNDLE=/etc/pki/tls/certs/ca-bundle.crt tox -- -v -m 'not fails_on_rgw and not lifecycle_expiration and not lifecycle_transition and not cloud_transition and not test_of_sts and not webidentity_test and not fails_with_subdomain and not sse_s3'" 2024-06-04T16:22:31.927 DEBUG:teuthology.run_tasks:Unwinding manager s3tests 2024-06-04T16:22:31.937 DEBUG:teuthology.run_tasks:Unwinding manager s3tests-java 2024-06-04T16:22:31.970 DEBUG:tasks.s3tests_java:S3 Tests Java: END 2024-06-04T16:22:31.970 INFO:tasks.s3tests_java:S3 Tests Java: Cleaning up s3-tests-java... 2024-06-04T16:22:31.970 DEBUG:teuthology.orchestra.run.smithi144:> rm -rf /home/ubuntu/cephtest/s3-tests-java 2024-06-04T16:22:32.037 INFO:tasks.s3tests_java:S3 Tests Java: Deleting S3 users... 2024-06-04T16:22:32.038 DEBUG:teuthology.orchestra.run.smithi144:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid tester.client.0 --purge-data --cluster ceph 2024-06-04T16:22:32.094 INFO:teuthology.orchestra.run.smithi144.stderr:ignoring --setuser ceph since I am not root 2024-06-04T16:22:32.094 INFO:teuthology.orchestra.run.smithi144.stderr:ignoring --setgroup ceph since I am not root 2024-06-04T16:22:32.128 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:32.127+0000 7f150ad31800 20 rados->read ofs=0 len=0 2024-06-04T16:22:32.130 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:32.128+0000 7f150ad31800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:22:32.130 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:32.128+0000 7f150ad31800 20 realm 2024-06-04T16:22:32.131 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:32.128+0000 7f150ad31800 20 rados->read ofs=0 len=0 2024-06-04T16:22:32.131 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:32.129+0000 7f150ad31800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:22:32.131 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:32.129+0000 7f150ad31800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-06-04T16:22:32.131 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:32.129+0000 7f150ad31800 20 rados->read ofs=0 len=0 2024-06-04T16:22:32.131 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:32.129+0000 7f150ad31800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:22:32.131 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:32.129+0000 7f150ad31800 20 rados->read ofs=0 len=0 2024-06-04T16:22:32.132 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:32.130+0000 7f150ad31800 20 rados_obj.operate() r=0 bl.length=46 2024-06-04T16:22:32.132 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:32.130+0000 7f150ad31800 20 rados->read ofs=0 len=0 2024-06-04T16:22:32.132 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:32.130+0000 7f150ad31800 20 rados_obj.operate() r=0 bl.length=1139 2024-06-04T16:22:32.132 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:32.130+0000 7f150ad31800 20 searching for the correct realm 2024-06-04T16:22:32.134 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:32.133+0000 7f15071ec640 0 -- 172.21.15.144:0/1383121583 >> [v2:172.21.15.144:6800/1453747520,v1:172.21.15.144:6801/1453747520] conn(0x7f14fc086030 msgr2=0x7f14fc086920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-06-04T16:22:32.339 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:32.338+0000 7f15071ec640 0 -- 172.21.15.144:0/1383121583 >> [v2:172.21.15.144:6824/166159729,v1:172.21.15.144:6825/166159729] conn(0x55d46ffab380 msgr2=0x55d46ffad770 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-06-04T16:22:32.345 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:32.344+0000 7f150ad31800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-06-04T16:22:32.345 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:32.344+0000 7f150ad31800 20 RGWRados::pool_iterate: got zone_info.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767 2024-06-04T16:22:32.345 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:32.344+0000 7f150ad31800 20 RGWRados::pool_iterate: got default.zone. 2024-06-04T16:22:32.345 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:32.344+0000 7f150ad31800 20 RGWRados::pool_iterate: got zonegroup_info.abb22408-c332-4e28-8f7a-ff254ea2fed2 2024-06-04T16:22:32.345 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:32.344+0000 7f150ad31800 20 RGWRados::pool_iterate: got zone_names.default 2024-06-04T16:22:32.345 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:32.344+0000 7f150ad31800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-06-04T16:22:32.346 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:32.344+0000 7f150ad31800 20 rados->read ofs=0 len=0 2024-06-04T16:22:32.346 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:32.344+0000 7f150ad31800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:22:32.346 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:32.344+0000 7f150ad31800 20 rados->read ofs=0 len=0 2024-06-04T16:22:32.347 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:32.344+0000 7f150ad31800 20 rados_obj.operate() r=0 bl.length=46 2024-06-04T16:22:32.347 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:32.344+0000 7f150ad31800 20 rados->read ofs=0 len=0 2024-06-04T16:22:32.347 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:32.345+0000 7f150ad31800 20 rados_obj.operate() r=0 bl.length=470 2024-06-04T16:22:32.347 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:32.345+0000 7f150ad31800 20 zone default found 2024-06-04T16:22:32.348 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:32.345+0000 7f150ad31800 4 Realm: () 2024-06-04T16:22:32.348 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:32.345+0000 7f150ad31800 4 ZoneGroup: default (abb22408-c332-4e28-8f7a-ff254ea2fed2) 2024-06-04T16:22:32.348 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:32.345+0000 7f150ad31800 4 Zone: default (be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767) 2024-06-04T16:22:32.348 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:32.345+0000 7f150ad31800 10 cannot find current period zonegroup using local zonegroup configuration 2024-06-04T16:22:32.348 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:32.345+0000 7f150ad31800 20 zonegroup default 2024-06-04T16:22:32.348 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:32.345+0000 7f150ad31800 20 rados->read ofs=0 len=0 2024-06-04T16:22:32.348 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:32.345+0000 7f150ad31800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:22:32.348 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:32.345+0000 7f150ad31800 20 rados->read ofs=0 len=0 2024-06-04T16:22:32.349 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:32.345+0000 7f150ad31800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:22:32.349 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:32.345+0000 7f150ad31800 20 rados->read ofs=0 len=0 2024-06-04T16:22:32.349 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:32.346+0000 7f150ad31800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:22:32.349 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:32.346+0000 7f150ad31800 20 started sync module instance, tier type = 2024-06-04T16:22:32.349 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:32.346+0000 7f150ad31800 20 started zone id=be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767 (name=default) with tier type = 2024-06-04T16:22:32.357 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:32.356+0000 7f150ad31800 20 add_watcher() i=0 2024-06-04T16:22:32.357 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:32.356+0000 7f150ad31800 20 add_watcher() i=1 2024-06-04T16:22:32.357 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:32.356+0000 7f150ad31800 20 add_watcher() i=2 2024-06-04T16:22:32.357 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:32.356+0000 7f150ad31800 20 add_watcher() i=3 2024-06-04T16:22:32.357 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:32.356+0000 7f150ad31800 20 add_watcher() i=4 2024-06-04T16:22:32.358 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:32.356+0000 7f150ad31800 20 add_watcher() i=5 2024-06-04T16:22:32.358 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:32.356+0000 7f150ad31800 20 add_watcher() i=6 2024-06-04T16:22:32.358 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:32.357+0000 7f150ad31800 20 add_watcher() i=7 2024-06-04T16:22:32.358 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:32.357+0000 7f150ad31800 2 all 8 watchers are set, enabling cache 2024-06-04T16:22:32.360 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:32.359+0000 7f13bd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-06-04T16:22:32.360 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:32.359+0000 7f150ad31800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-06-04T16:22:32.360 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:32.359+0000 7f150ad31800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-06-04T16:22:32.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:32.395+0000 7f1337fff640 20 reqs_thread_entry: start 2024-06-04T16:22:32.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:32.396+0000 7f150ad31800 20 init_complete bucket index max shards: 11 2024-06-04T16:22:32.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:32.396+0000 7f150ad31800 20 Filter name: none 2024-06-04T16:22:32.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:32.396+0000 7f1335ffb640 20 reqs_thread_entry: start 2024-06-04T16:22:32.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:32.396+0000 7f150ad31800 10 cache get: name=default.rgw.meta+users.uid+tester.client.0 : miss 2024-06-04T16:22:32.398 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:32.396+0000 7f150ad31800 20 rados->read ofs=0 len=0 2024-06-04T16:22:32.398 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:32.396+0000 7f150ad31800 20 rados_obj.operate() r=0 bl.length=482 2024-06-04T16:22:32.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:32.396+0000 7f150ad31800 10 cache put: name=default.rgw.meta+users.uid+tester.client.0 info.flags=0x13 2024-06-04T16:22:32.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:32.396+0000 7f150ad31800 10 adding default.rgw.meta+users.uid+tester.client.0 to cache LRU end 2024-06-04T16:22:32.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:32.396+0000 7f150ad31800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-06-04T16:22:32.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:32.397+0000 7f150ad31800 10 removing key index: YHSYUBICXXUHFYSMCSKL 2024-06-04T16:22:32.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:32.398+0000 7f150ad31800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 1, obj: default.rgw.meta:users.keys:YHSYUBICXXUHFYSMCSKL, ofs0, ns] 2024-06-04T16:22:32.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:32.398+0000 7f13ea7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1090921693514 cookie 94370900180848 notifier 7776 bl.length()=170 2024-06-04T16:22:32.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:32.399+0000 7f150ad31800 10 removing email index: tester.client.0_test@test.test 2024-06-04T16:22:32.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:32.400+0000 7f150ad31800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:users.email:tester.client.0_test@test.test, ofs0, ns] 2024-06-04T16:22:32.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:32.400+0000 7f13e9ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1090921693255 cookie 94370900162400 notifier 7776 bl.length()=181 2024-06-04T16:22:32.402 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:32.400+0000 7f150ad31800 10 removing user buckets index 2024-06-04T16:22:32.402 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:32.401+0000 7f150ad31800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 1, obj: default.rgw.meta:users.uid:tester.client.0.buckets, ofs0, ns] 2024-06-04T16:22:32.403 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:32.402+0000 7f13e9ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1090921693515 cookie 94370900180848 notifier 7776 bl.length()=172 2024-06-04T16:22:32.403 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:32.402+0000 7f150ad31800 10 removing user index: tester.client.0 2024-06-04T16:22:32.404 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:32.403+0000 7f150ad31800 10 removing default.rgw.meta+users.uid+tester.client.0 from cache 2024-06-04T16:22:32.404 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:32.403+0000 7f150ad31800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:users.uid:tester.client.0, ofs0, ns] 2024-06-04T16:22:32.404 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:32.403+0000 7f13ea7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1090921693516 cookie 94370900178144 notifier 7776 bl.length()=164 2024-06-04T16:22:32.405 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:32.404+0000 7f13bd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-06-04T16:22:32.407 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:32.406+0000 7f150ad31800 20 remove_watcher() i=0 2024-06-04T16:22:32.407 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:32.406+0000 7f150ad31800 2 removed watcher, disabling cache 2024-06-04T16:22:32.408 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:32.407+0000 7f150ad31800 20 remove_watcher() i=1 2024-06-04T16:22:32.409 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:32.409+0000 7f150ad31800 20 remove_watcher() i=2 2024-06-04T16:22:32.410 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:32.410+0000 7f150ad31800 20 remove_watcher() i=3 2024-06-04T16:22:32.411 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:32.411+0000 7f150ad31800 20 remove_watcher() i=4 2024-06-04T16:22:32.413 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:32.412+0000 7f150ad31800 20 remove_watcher() i=5 2024-06-04T16:22:32.413 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:32.413+0000 7f150ad31800 20 remove_watcher() i=6 2024-06-04T16:22:32.414 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:32.414+0000 7f150ad31800 20 remove_watcher() i=7 2024-06-04T16:22:32.426 DEBUG:teuthology.run_tasks:Unwinding manager ragweed 2024-06-04T16:22:32.436 DEBUG:teuthology.run_tasks:Unwinding manager tox 2024-06-04T16:22:32.470 DEBUG:teuthology.orchestra.run.smithi144:> rm -rf /home/ubuntu/cephtest/tox-venv 2024-06-04T16:22:32.525 DEBUG:teuthology.run_tasks:Unwinding manager rgw 2024-06-04T16:22:32.536 DEBUG:tasks.rgw.client.0:waiting for process to exit 2024-06-04T16:22:32.536 INFO:teuthology.orchestra.run:waiting for 300 2024-06-04T16:22:32.536 INFO:tasks.rgw.client.0.smithi144.stdout:2024-06-04T16:22:32.535+0000 7fce892ea640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term radosgw --rgw-frontends beast ssl_certificate=/home/ubuntu/cephtest/ca/rgw.client.0.crt ssl_port=443 -n client.0 --cluster ceph -k /etc/ceph/ceph.client.0.keyring --log-file /var/log/ceph/rgw.ceph.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock --foreground (PID: 45695) UID: 0 2024-06-04T16:22:32.537 INFO:tasks.rgw.client.0.smithi144.stdout:2024-06-04T16:22:32.535+0000 7fce8f432880 -1 shutting down 2024-06-04T16:22:38.638 INFO:tasks.rgw.client.0:Stopped 2024-06-04T16:22:38.638 DEBUG:teuthology.orchestra.run.smithi144:> rm -f /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock 2024-06-04T16:22:38.674 DEBUG:teuthology.orchestra.run.smithi144:> sudo rm -f /etc/ceph/vault-root-token 2024-06-04T16:22:38.760 DEBUG:teuthology.orchestra.run.smithi144:> sudo rm -f /home/ubuntu/cephtest/url_file 2024-06-04T16:22:38.800 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'process', '--include-all'] 2024-06-04T16:22:38.801 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'process', '--include-all'] 2024-06-04T16:22:38.801 DEBUG:teuthology.orchestra.run.smithi144:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc process --include-all 2024-06-04T16:22:38.898 INFO:teuthology.orchestra.run.smithi144.stderr:ignoring --setuser ceph since I am not root 2024-06-04T16:22:38.899 INFO:teuthology.orchestra.run.smithi144.stderr:ignoring --setgroup ceph since I am not root 2024-06-04T16:22:38.934 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:38.932+0000 7f75d8016800 20 rados->read ofs=0 len=0 2024-06-04T16:22:38.936 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:38.934+0000 7f75d8016800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:22:38.936 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:38.934+0000 7f75d8016800 20 realm 2024-06-04T16:22:38.936 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:38.934+0000 7f75d8016800 20 rados->read ofs=0 len=0 2024-06-04T16:22:38.937 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:38.934+0000 7f75d8016800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:22:38.937 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:38.934+0000 7f75d8016800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-06-04T16:22:38.937 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:38.934+0000 7f75d8016800 20 rados->read ofs=0 len=0 2024-06-04T16:22:38.937 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:38.935+0000 7f75d8016800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:22:38.937 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:38.935+0000 7f75d8016800 20 rados->read ofs=0 len=0 2024-06-04T16:22:38.939 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:38.935+0000 7f75d8016800 20 rados_obj.operate() r=0 bl.length=46 2024-06-04T16:22:38.939 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:38.935+0000 7f75d8016800 20 rados->read ofs=0 len=0 2024-06-04T16:22:38.939 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:38.936+0000 7f75d8016800 20 rados_obj.operate() r=0 bl.length=1139 2024-06-04T16:22:38.940 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:38.936+0000 7f75d8016800 20 searching for the correct realm 2024-06-04T16:22:38.940 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:38.937+0000 7f75d367a640 0 -- 172.21.15.144:0/1727820594 >> [v2:172.21.15.177:6816/2039473917,v1:172.21.15.177:6817/2039473917] conn(0x556d25ed1460 msgr2=0x556d25ed3920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-06-04T16:22:39.142 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.141+0000 7f75d367a640 0 -- 172.21.15.144:0/1727820594 >> [v2:172.21.15.177:6800/3891611393,v1:172.21.15.177:6801/3891611393] conn(0x7f75c4018070 msgr2=0x7f75c4069040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-06-04T16:22:39.352 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.351+0000 7f75d8016800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-06-04T16:22:39.352 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.351+0000 7f75d8016800 20 RGWRados::pool_iterate: got zone_info.be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767 2024-06-04T16:22:39.352 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.351+0000 7f75d8016800 20 RGWRados::pool_iterate: got default.zone. 2024-06-04T16:22:39.353 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.351+0000 7f75d8016800 20 RGWRados::pool_iterate: got zonegroup_info.abb22408-c332-4e28-8f7a-ff254ea2fed2 2024-06-04T16:22:39.353 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.351+0000 7f75d8016800 20 RGWRados::pool_iterate: got zone_names.default 2024-06-04T16:22:39.353 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.351+0000 7f75d8016800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-06-04T16:22:39.353 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.351+0000 7f75d8016800 20 rados->read ofs=0 len=0 2024-06-04T16:22:39.353 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.351+0000 7f75d8016800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:22:39.353 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.351+0000 7f75d8016800 20 rados->read ofs=0 len=0 2024-06-04T16:22:39.355 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.351+0000 7f75d8016800 20 rados_obj.operate() r=0 bl.length=46 2024-06-04T16:22:39.355 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.351+0000 7f75d8016800 20 rados->read ofs=0 len=0 2024-06-04T16:22:39.355 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.352+0000 7f75d8016800 20 rados_obj.operate() r=0 bl.length=470 2024-06-04T16:22:39.355 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.352+0000 7f75d8016800 20 zone default found 2024-06-04T16:22:39.355 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.352+0000 7f75d8016800 4 Realm: () 2024-06-04T16:22:39.355 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.352+0000 7f75d8016800 4 ZoneGroup: default (abb22408-c332-4e28-8f7a-ff254ea2fed2) 2024-06-04T16:22:39.356 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.352+0000 7f75d8016800 4 Zone: default (be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767) 2024-06-04T16:22:39.356 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.352+0000 7f75d8016800 10 cannot find current period zonegroup using local zonegroup configuration 2024-06-04T16:22:39.356 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.352+0000 7f75d8016800 20 zonegroup default 2024-06-04T16:22:39.356 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.352+0000 7f75d8016800 20 rados->read ofs=0 len=0 2024-06-04T16:22:39.356 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.352+0000 7f75d8016800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:22:39.356 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.352+0000 7f75d8016800 20 rados->read ofs=0 len=0 2024-06-04T16:22:39.356 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.352+0000 7f75d8016800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:22:39.356 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.352+0000 7f75d8016800 20 rados->read ofs=0 len=0 2024-06-04T16:22:39.357 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.353+0000 7f75d8016800 20 rados_obj.operate() r=-2 bl.length=0 2024-06-04T16:22:39.357 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.353+0000 7f75d8016800 20 started sync module instance, tier type = 2024-06-04T16:22:39.357 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.353+0000 7f75d8016800 20 started zone id=be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767 (name=default) with tier type = 2024-06-04T16:22:39.364 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.362+0000 7f75d8016800 20 add_watcher() i=0 2024-06-04T16:22:39.364 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.362+0000 7f75d8016800 20 add_watcher() i=1 2024-06-04T16:22:39.364 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.362+0000 7f75d8016800 20 add_watcher() i=2 2024-06-04T16:22:39.364 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.362+0000 7f75d8016800 20 add_watcher() i=3 2024-06-04T16:22:39.364 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.362+0000 7f75d8016800 20 add_watcher() i=4 2024-06-04T16:22:39.364 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.362+0000 7f75d8016800 20 add_watcher() i=5 2024-06-04T16:22:39.365 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.362+0000 7f75d8016800 20 add_watcher() i=6 2024-06-04T16:22:39.365 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.364+0000 7f75d8016800 20 add_watcher() i=7 2024-06-04T16:22:39.365 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.364+0000 7f75d8016800 2 all 8 watchers are set, enabling cache 2024-06-04T16:22:39.367 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.366+0000 7f7489fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-06-04T16:22:39.367 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.366+0000 7f75d8016800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-06-04T16:22:39.367 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.366+0000 7f75d8016800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-06-04T16:22:39.405 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.403+0000 7f7488fe1640 20 reqs_thread_entry: start 2024-06-04T16:22:39.405 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.403+0000 7f75d8016800 20 init_complete bucket index max shards: 11 2024-06-04T16:22:39.405 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.403+0000 7f75d8016800 20 Filter name: none 2024-06-04T16:22:39.405 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.403+0000 7f74027fc640 20 reqs_thread_entry: start 2024-06-04T16:22:39.405 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.403+0000 7f75d8016800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-06-04T16:22:39.406 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.405+0000 7f75d8016800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:22:39.406 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.406+0000 7f75d8016800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:22:39.408 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.406+0000 7f75d8016800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-06-04T16:22:39.408 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.406+0000 7f75d8016800 20 garbage collection: RGWGC::process iterating over entry tag='be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.6766853889996853834', time=2024-06-04T18:18:16.976047+0000, chain.objs.size()=5 2024-06-04T16:22:39.408 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.406+0000 7f75d8016800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.148__multipart_mymultipart-LUKEWARM.2~8w7_GvQOSVhpKFW8xChgviQnM6Y8vYC.1 2024-06-04T16:22:39.408 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.406+0000 7f75d8016800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.148__shadow_mymultipart-LUKEWARM.2~8w7_GvQOSVhpKFW8xChgviQnM6Y8vYC.1_1 2024-06-04T16:22:39.408 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.406+0000 7f75d8016800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.148__multipart_mymultipart-LUKEWARM.2~8w7_GvQOSVhpKFW8xChgviQnM6Y8vYC.2 2024-06-04T16:22:39.408 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.406+0000 7f75d8016800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.148__shadow_mymultipart-LUKEWARM.2~8w7_GvQOSVhpKFW8xChgviQnM6Y8vYC.2_1 2024-06-04T16:22:39.409 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.406+0000 7f75d8016800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.148__multipart_mymultipart-LUKEWARM.2~8w7_GvQOSVhpKFW8xChgviQnM6Y8vYC.3 2024-06-04T16:22:39.409 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.406+0000 7f75d8016800 20 garbage collection: RGWGC::process iterating over entry tag='be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.11062955347292155623', time=2024-06-04T18:18:17.448554+0000, chain.objs.size()=3 2024-06-04T16:22:39.409 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.406+0000 7f75d8016800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.149__shadow_.OyCA_2tuUGtiaX60qsz3Xh0r-cp15fx_0 2024-06-04T16:22:39.409 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.406+0000 7f75d8016800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.149__shadow_.OyCA_2tuUGtiaX60qsz3Xh0r-cp15fx_1 2024-06-04T16:22:39.409 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.406+0000 7f75d8016800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.149__shadow_.OyCA_2tuUGtiaX60qsz3Xh0r-cp15fx_2 2024-06-04T16:22:39.409 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.406+0000 7f75d8016800 20 garbage collection: RGWGC::process iterating over entry tag='be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.16399738524233118605', time=2024-06-04T18:18:17.796149+0000, chain.objs.size()=3 2024-06-04T16:22:39.409 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.406+0000 7f75d8016800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.149__shadow_.3AsnxtQvKaZaI5YK0MMkgkHJQp-967U_0 2024-06-04T16:22:39.410 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.406+0000 7f75d8016800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.149__shadow_.3AsnxtQvKaZaI5YK0MMkgkHJQp-967U_1 2024-06-04T16:22:39.410 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.407+0000 7f75d8016800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.149__shadow_.3AsnxtQvKaZaI5YK0MMkgkHJQp-967U_2 2024-06-04T16:22:39.411 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.410+0000 7f75d8016800 5 garbage collection: RGWGC::process removing entries, marker: 2024-06-04T16:22:39.414 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.413+0000 7f75d8016800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-06-04T16:22:39.415 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.414+0000 7f75d8016800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:22:39.416 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.415+0000 7f75d8016800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:22:39.416 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.415+0000 7f75d8016800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-06-04T16:22:39.416 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.415+0000 7f75d8016800 20 garbage collection: RGWGC::process iterating over entry tag='_2t80kY2i56DhAZRnWc5FXODjHxElm36', time=2024-06-04T18:18:18.075468+0000, chain.objs.size()=1 2024-06-04T16:22:39.417 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.415+0000 7f75d8016800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.149__shadow_.TFe-AMjzBGoihFVbfpJdNEYYeMnbXGt_0 2024-06-04T16:22:39.417 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.416+0000 7f75d8016800 5 garbage collection: RGWGC::process removing entries, marker: 2024-06-04T16:22:39.420 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.419+0000 7f75d8016800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-06-04T16:22:39.422 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.421+0000 7f75d8016800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:22:39.422 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.422+0000 7f75d8016800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:22:39.424 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.422+0000 7f75d8016800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-06-04T16:22:39.424 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.422+0000 7f75d8016800 20 garbage collection: RGWGC::process iterating over entry tag='be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.16138995242670205699', time=2024-06-04T18:18:15.914769+0000, chain.objs.size()=3 2024-06-04T16:22:39.424 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.422+0000 7f75d8016800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.147__shadow_.xkOJiGd4eqaxE8sMAjCsaM8RELP1R4e_0 2024-06-04T16:22:39.424 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.422+0000 7f75d8016800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.147__shadow_.xkOJiGd4eqaxE8sMAjCsaM8RELP1R4e_1 2024-06-04T16:22:39.424 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.422+0000 7f75d8016800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.147__shadow_.xkOJiGd4eqaxE8sMAjCsaM8RELP1R4e_2 2024-06-04T16:22:39.424 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.422+0000 7f75d8016800 20 garbage collection: RGWGC::process iterating over entry tag='_oMxYrI739FBo1MZpdKLqzZM5n7_zPVC', time=2024-06-04T18:18:18.064519+0000, chain.objs.size()=3 2024-06-04T16:22:39.424 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.422+0000 7f75d8016800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.149__shadow_.xCNNC3wFzlylkgj2BuHjGuW18UXKP-r_0 2024-06-04T16:22:39.425 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.422+0000 7f75d8016800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.149__shadow_.xCNNC3wFzlylkgj2BuHjGuW18UXKP-r_1 2024-06-04T16:22:39.425 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.422+0000 7f75d8016800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.149__shadow_.xCNNC3wFzlylkgj2BuHjGuW18UXKP-r_2 2024-06-04T16:22:39.425 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.422+0000 7f75d8016800 20 garbage collection: RGWGC::process iterating over entry tag='_mQqs7GnnEQiXVVc6xdKl833zrpf5lvG', time=2024-06-04T18:18:20.541984+0000, chain.objs.size()=1 2024-06-04T16:22:39.425 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.422+0000 7f75d8016800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.152__shadow_.WTiA_2wYYiGxhzMAB6neuM1670lUCLn_0 2024-06-04T16:22:39.426 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.425+0000 7f75d8016800 5 garbage collection: RGWGC::process removing entries, marker: 2024-06-04T16:22:39.429 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.428+0000 7f75d8016800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-06-04T16:22:39.430 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.429+0000 7f75d8016800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:22:39.431 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.430+0000 7f75d8016800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:22:39.431 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.430+0000 7f75d8016800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:22:39.432 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.431+0000 7f75d8016800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-06-04T16:22:39.433 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.432+0000 7f75d8016800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:22:39.434 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.433+0000 7f75d8016800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:22:39.434 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.433+0000 7f75d8016800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-06-04T16:22:39.434 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.433+0000 7f75d8016800 20 garbage collection: RGWGC::process iterating over entry tag='_rkinSXIIDJCObSByow-fdLEaAseP9HP', time=2024-06-04T18:18:18.554467+0000, chain.objs.size()=1 2024-06-04T16:22:39.435 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.433+0000 7f75d8016800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.150__shadow_.sQk8fVYDiMPT051chG42KUEzX7QK8c4_0 2024-06-04T16:22:39.435 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.435+0000 7f75d8016800 5 garbage collection: RGWGC::process removing entries, marker: 2024-06-04T16:22:39.438 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.437+0000 7f75d8016800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-06-04T16:22:39.439 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.438+0000 7f75d8016800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:22:39.440 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.439+0000 7f75d8016800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:22:39.441 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.439+0000 7f75d8016800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-06-04T16:22:39.441 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.439+0000 7f75d8016800 20 garbage collection: RGWGC::process iterating over entry tag='_8px2xcO2MdDAAnMtccHLqNHnQb40oSh', time=2024-06-04T18:18:19.900369+0000, chain.objs.size()=3 2024-06-04T16:22:39.441 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.439+0000 7f75d8016800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.150__shadow_.7NXwJ1FXbfP3UX0c-2UtjDH-UGPvjzn_0 2024-06-04T16:22:39.441 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.439+0000 7f75d8016800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.150__shadow_.7NXwJ1FXbfP3UX0c-2UtjDH-UGPvjzn_1 2024-06-04T16:22:39.441 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.439+0000 7f75d8016800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.150__shadow_.7NXwJ1FXbfP3UX0c-2UtjDH-UGPvjzn_2 2024-06-04T16:22:39.441 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.439+0000 7f75d8016800 20 garbage collection: RGWGC::process iterating over entry tag='be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.6346955458581542612', time=2024-06-04T18:18:21.323724+0000, chain.objs.size()=3 2024-06-04T16:22:39.441 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.439+0000 7f75d8016800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.153__multipart_foo.2~LEUKqr_HnLnHvveHgR1mmLDenz4BFKm.1 2024-06-04T16:22:39.442 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.440+0000 7f75d8016800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.153__shadow_foo.2~LEUKqr_HnLnHvveHgR1mmLDenz4BFKm.1_1 2024-06-04T16:22:39.442 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.440+0000 7f75d8016800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.153__multipart_foo.2~LEUKqr_HnLnHvveHgR1mmLDenz4BFKm.2 2024-06-04T16:22:39.444 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.443+0000 7f75d8016800 5 garbage collection: RGWGC::process removing entries, marker: 2024-06-04T16:22:39.446 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.445+0000 7f75d8016800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-06-04T16:22:39.447 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.446+0000 7f75d8016800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:22:39.448 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.447+0000 7f75d8016800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:22:39.448 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.447+0000 7f75d8016800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-06-04T16:22:39.448 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.447+0000 7f75d8016800 20 garbage collection: RGWGC::process iterating over entry tag='_Scxr7GKftgAA-A1coikeb5SQpK76wVb', time=2024-06-04T18:18:17.555657+0000, chain.objs.size()=2 2024-06-04T16:22:39.449 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.447+0000 7f75d8016800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.149__shadow_.hjfFZkp5t0aIc9vBwAzSf_De8HhnOMO_1 2024-06-04T16:22:39.449 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.447+0000 7f75d8016800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.149__shadow_.hjfFZkp5t0aIc9vBwAzSf_De8HhnOMO_2 2024-06-04T16:22:39.450 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.449+0000 7f75d8016800 5 garbage collection: RGWGC::process removing entries, marker: 2024-06-04T16:22:39.452 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.451+0000 7f75d8016800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-06-04T16:22:39.453 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.452+0000 7f75d8016800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:22:39.454 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.453+0000 7f75d8016800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:22:39.454 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.453+0000 7f75d8016800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-06-04T16:22:39.455 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.453+0000 7f75d8016800 20 garbage collection: RGWGC::process iterating over entry tag='be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.12382428242958914338', time=2024-06-04T18:18:15.919982+0000, chain.objs.size()=2 2024-06-04T16:22:39.455 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.453+0000 7f75d8016800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.147__shadow_.FPwYuq5_t-JE4LY8r7x-4bnedgm18_9_1 2024-06-04T16:22:39.455 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.453+0000 7f75d8016800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.147__shadow_.FPwYuq5_t-JE4LY8r7x-4bnedgm18_9_2 2024-06-04T16:22:39.455 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.453+0000 7f75d8016800 20 garbage collection: RGWGC::process iterating over entry tag='_f4BNmKFGB1XATE2-KvLLMsM-WljMaPa', time=2024-06-04T18:18:19.895329+0000, chain.objs.size()=3 2024-06-04T16:22:39.455 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.453+0000 7f75d8016800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.150__shadow_.WelCmZC0leWctLbIsKGlKhfRRGp3alE_0 2024-06-04T16:22:39.455 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.453+0000 7f75d8016800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.150__shadow_.WelCmZC0leWctLbIsKGlKhfRRGp3alE_1 2024-06-04T16:22:39.455 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.453+0000 7f75d8016800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.150__shadow_.WelCmZC0leWctLbIsKGlKhfRRGp3alE_2 2024-06-04T16:22:39.457 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.456+0000 7f75d8016800 5 garbage collection: RGWGC::process removing entries, marker: 2024-06-04T16:22:39.459 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.458+0000 7f75d8016800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-06-04T16:22:39.460 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.460+0000 7f75d8016800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:22:39.461 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.460+0000 7f75d8016800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:22:39.461 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.460+0000 7f75d8016800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:22:39.462 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.462+0000 7f75d8016800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-06-04T16:22:39.464 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.463+0000 7f75d8016800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:22:39.464 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.463+0000 7f75d8016800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:22:39.464 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.463+0000 7f75d8016800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:22:39.465 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.464+0000 7f75d8016800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-06-04T16:22:39.466 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.466+0000 7f75d8016800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:22:39.467 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.466+0000 7f75d8016800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:22:39.467 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.466+0000 7f75d8016800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:22:39.468 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.467+0000 7f75d8016800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-06-04T16:22:39.470 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.469+0000 7f75d8016800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:22:39.470 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.469+0000 7f75d8016800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:22:39.471 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.470+0000 7f75d8016800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-06-04T16:22:39.471 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.470+0000 7f75d8016800 20 garbage collection: RGWGC::process iterating over entry tag='be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.2291297532300821583', time=2024-06-04T18:18:15.908552+0000, chain.objs.size()=3 2024-06-04T16:22:39.471 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.470+0000 7f75d8016800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.147__shadow_.jc4rW5ZkONKvUXmd8PZ8NgbNDm1mnVh_0 2024-06-04T16:22:39.471 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.470+0000 7f75d8016800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.147__shadow_.jc4rW5ZkONKvUXmd8PZ8NgbNDm1mnVh_1 2024-06-04T16:22:39.472 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.470+0000 7f75d8016800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.147__shadow_.jc4rW5ZkONKvUXmd8PZ8NgbNDm1mnVh_2 2024-06-04T16:22:39.473 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.472+0000 7f75d8016800 5 garbage collection: RGWGC::process removing entries, marker: 2024-06-04T16:22:39.475 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.474+0000 7f75d8016800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-06-04T16:22:39.476 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.475+0000 7f75d8016800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:22:39.477 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.476+0000 7f75d8016800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:22:39.477 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.476+0000 7f75d8016800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-06-04T16:22:39.477 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.476+0000 7f75d8016800 20 garbage collection: RGWGC::process iterating over entry tag='_eDG8mwEKYd2mK-TV9D61WFIbUVUFbZ_', time=2024-06-04T18:18:19.905568+0000, chain.objs.size()=1 2024-06-04T16:22:39.477 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.476+0000 7f75d8016800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.150__shadow_.jGnO78jX_1VSY-5rirZi7p8HPduTgJh_0 2024-06-04T16:22:39.478 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.478+0000 7f75d8016800 5 garbage collection: RGWGC::process removing entries, marker: 2024-06-04T16:22:39.481 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.480+0000 7f75d8016800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-06-04T16:22:39.482 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.481+0000 7f75d8016800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:22:39.483 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.482+0000 7f75d8016800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:22:39.483 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.482+0000 7f75d8016800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:22:39.484 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.483+0000 7f75d8016800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-06-04T16:22:39.485 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.484+0000 7f75d8016800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:22:39.486 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.485+0000 7f75d8016800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:22:39.486 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.485+0000 7f75d8016800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-06-04T16:22:39.487 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.485+0000 7f75d8016800 20 garbage collection: RGWGC::process iterating over entry tag='be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.5063180261082128289', time=2024-06-04T18:18:16.981292+0000, chain.objs.size()=5 2024-06-04T16:22:39.487 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.485+0000 7f75d8016800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.148__multipart_mymultipart-STANDARD.2~K7-TArjFPdftPJj5tvam9HEitO_QnGq.1 2024-06-04T16:22:39.487 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.485+0000 7f75d8016800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.148__shadow_mymultipart-STANDARD.2~K7-TArjFPdftPJj5tvam9HEitO_QnGq.1_1 2024-06-04T16:22:39.487 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.485+0000 7f75d8016800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.148__multipart_mymultipart-STANDARD.2~K7-TArjFPdftPJj5tvam9HEitO_QnGq.2 2024-06-04T16:22:39.487 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.485+0000 7f75d8016800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.148__shadow_mymultipart-STANDARD.2~K7-TArjFPdftPJj5tvam9HEitO_QnGq.2_1 2024-06-04T16:22:39.487 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.485+0000 7f75d8016800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.148__multipart_mymultipart-STANDARD.2~K7-TArjFPdftPJj5tvam9HEitO_QnGq.3 2024-06-04T16:22:39.487 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.485+0000 7f75d8016800 20 garbage collection: RGWGC::process iterating over entry tag='_OQmbrJceAUPuoJ4cMgBSKwPywvPbHOT', time=2024-06-04T18:18:19.722277+0000, chain.objs.size()=2 2024-06-04T16:22:39.487 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.485+0000 7f75d8016800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.150__shadow_.bsaBwZyt-9i8CktFwqaod7A0PA8D_y5_1 2024-06-04T16:22:39.488 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.485+0000 7f75d8016800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.150__shadow_.bsaBwZyt-9i8CktFwqaod7A0PA8D_y5_2 2024-06-04T16:22:39.490 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.488+0000 7f75d8016800 5 garbage collection: RGWGC::process removing entries, marker: 2024-06-04T16:22:39.492 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.491+0000 7f75d8016800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-06-04T16:22:39.493 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.492+0000 7f75d8016800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:22:39.494 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.493+0000 7f75d8016800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:22:39.494 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.493+0000 7f75d8016800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-06-04T16:22:39.495 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.493+0000 7f75d8016800 20 garbage collection: RGWGC::process iterating over entry tag='_G8bxO9XNf9DPAiC5IWGoBPtN4qkiYGZ', time=2024-06-04T18:18:18.069710+0000, chain.objs.size()=3 2024-06-04T16:22:39.495 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.493+0000 7f75d8016800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.149__shadow_.nUPZyYcroQREIzdLgjuOwTcMdxek3Gn_0 2024-06-04T16:22:39.495 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.493+0000 7f75d8016800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.149__shadow_.nUPZyYcroQREIzdLgjuOwTcMdxek3Gn_1 2024-06-04T16:22:39.495 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.493+0000 7f75d8016800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.149__shadow_.nUPZyYcroQREIzdLgjuOwTcMdxek3Gn_2 2024-06-04T16:22:39.495 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.493+0000 7f75d8016800 20 garbage collection: RGWGC::process iterating over entry tag='be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.12099932465446138910', time=2024-06-04T18:18:18.471169+0000, chain.objs.size()=3 2024-06-04T16:22:39.495 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.493+0000 7f75d8016800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.150__multipart_foo-STANDARD.2~nsUbwkki4c7ETOxN4tQTl11x7cpHYv2.1 2024-06-04T16:22:39.495 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.493+0000 7f75d8016800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.150__multipart_foo-STANDARD.2~nsUbwkki4c7ETOxN4tQTl11x7cpHYv2.2 2024-06-04T16:22:39.496 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.493+0000 7f75d8016800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.150__multipart_foo-STANDARD.2~nsUbwkki4c7ETOxN4tQTl11x7cpHYv2.3 2024-06-04T16:22:39.497 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.496+0000 7f75d8016800 5 garbage collection: RGWGC::process removing entries, marker: 2024-06-04T16:22:39.499 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.498+0000 7f75d8016800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-06-04T16:22:39.500 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.499+0000 7f75d8016800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:22:39.501 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.500+0000 7f75d8016800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:22:39.501 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.500+0000 7f75d8016800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:22:39.502 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.501+0000 7f75d8016800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-06-04T16:22:39.503 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.502+0000 7f75d8016800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:22:39.504 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.503+0000 7f75d8016800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:22:39.504 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.503+0000 7f75d8016800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:22:39.505 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.504+0000 7f75d8016800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-06-04T16:22:39.506 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.505+0000 7f75d8016800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:22:39.506 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.506+0000 7f75d8016800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:22:39.507 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.506+0000 7f75d8016800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-06-04T16:22:39.507 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.506+0000 7f75d8016800 20 garbage collection: RGWGC::process iterating over entry tag='_Q_bF3DfmLQd_2Rj4GoyqA9STk4KB1jM', time=2024-06-04T18:18:20.534559+0000, chain.objs.size()=1 2024-06-04T16:22:39.507 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.506+0000 7f75d8016800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.152__shadow_.1RFjcFcvUcX8XO5NRIV9mpbLTahL0-B_0 2024-06-04T16:22:39.508 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.507+0000 7f75d8016800 5 garbage collection: RGWGC::process removing entries, marker: 2024-06-04T16:22:39.511 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.510+0000 7f75d8016800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-06-04T16:22:39.512 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.511+0000 7f75d8016800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:22:39.512 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.511+0000 7f75d8016800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:22:39.513 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.512+0000 7f75d8016800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:22:39.513 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.513+0000 7f75d8016800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-06-04T16:22:39.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.514+0000 7f75d8016800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:22:39.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.514+0000 7f75d8016800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:22:39.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.514+0000 7f75d8016800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:22:39.516 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.515+0000 7f75d8016800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-06-04T16:22:39.517 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.516+0000 7f75d8016800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:22:39.518 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.517+0000 7f75d8016800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:22:39.518 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.517+0000 7f75d8016800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:22:39.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.518+0000 7f75d8016800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-06-04T16:22:39.520 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.519+0000 7f75d8016800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:22:39.521 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.520+0000 7f75d8016800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:22:39.521 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.520+0000 7f75d8016800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:22:39.522 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.521+0000 7f75d8016800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-06-04T16:22:39.524 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.523+0000 7f75d8016800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:22:39.525 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.523+0000 7f75d8016800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:22:39.525 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.523+0000 7f75d8016800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-06-04T16:22:39.525 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.523+0000 7f75d8016800 20 garbage collection: RGWGC::process iterating over entry tag='_zCVntnKbQSoN-dqO7ivIqdX0F0K7hVI', time=2024-06-04T18:18:21.403891+0000, chain.objs.size()=3 2024-06-04T16:22:39.525 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.523+0000 7f75d8016800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.154__shadow_.s9crxjg-NH_JrgMONJSMGF_cVnKjzxg_0 2024-06-04T16:22:39.525 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.523+0000 7f75d8016800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.154__shadow_.s9crxjg-NH_JrgMONJSMGF_cVnKjzxg_1 2024-06-04T16:22:39.525 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.523+0000 7f75d8016800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.154__shadow_.s9crxjg-NH_JrgMONJSMGF_cVnKjzxg_2 2024-06-04T16:22:39.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.526+0000 7f75d8016800 5 garbage collection: RGWGC::process removing entries, marker: 2024-06-04T16:22:39.529 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.528+0000 7f75d8016800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-06-04T16:22:39.530 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.529+0000 7f75d8016800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:22:39.531 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.529+0000 7f75d8016800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:22:39.531 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.530+0000 7f75d8016800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-06-04T16:22:39.531 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.530+0000 7f75d8016800 20 garbage collection: RGWGC::process iterating over entry tag='be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.28150741619930442', time=2024-06-04T18:18:19.592168+0000, chain.objs.size()=5 2024-06-04T16:22:39.531 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.530+0000 7f75d8016800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.150__multipart_foo-FROZEN.2~_tAML7FgC226aHVFRFQg4VcOdYclHeK.1 2024-06-04T16:22:39.531 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.530+0000 7f75d8016800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.150__shadow_foo-FROZEN.2~_tAML7FgC226aHVFRFQg4VcOdYclHeK.1_1 2024-06-04T16:22:39.532 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.530+0000 7f75d8016800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.150__multipart_foo-FROZEN.2~_tAML7FgC226aHVFRFQg4VcOdYclHeK.2 2024-06-04T16:22:39.532 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.530+0000 7f75d8016800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.150__shadow_foo-FROZEN.2~_tAML7FgC226aHVFRFQg4VcOdYclHeK.2_1 2024-06-04T16:22:39.532 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.530+0000 7f75d8016800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.150__multipart_foo-FROZEN.2~_tAML7FgC226aHVFRFQg4VcOdYclHeK.3 2024-06-04T16:22:39.533 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.532+0000 7f75d8016800 5 garbage collection: RGWGC::process removing entries, marker: 2024-06-04T16:22:39.535 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.534+0000 7f75d8016800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-06-04T16:22:39.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.535+0000 7f75d8016800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:22:39.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.536+0000 7f75d8016800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:22:39.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.536+0000 7f75d8016800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-06-04T16:22:39.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.536+0000 7f75d8016800 20 garbage collection: RGWGC::process iterating over entry tag='_jjv01VoT1lcYwgMPH5xKDBdlczsL1R_', time=2024-06-04T18:18:17.903587+0000, chain.objs.size()=2 2024-06-04T16:22:39.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.536+0000 7f75d8016800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.149__shadow_.3LvjZti0-9GLeadVDVSm3B7N_G-Ybol_1 2024-06-04T16:22:39.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.536+0000 7f75d8016800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.149__shadow_.3LvjZti0-9GLeadVDVSm3B7N_G-Ybol_2 2024-06-04T16:22:39.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.536+0000 7f75d8016800 20 garbage collection: RGWGC::process iterating over entry tag='_RqT_QXef4qtAU4NimC5hj8fUxtrQ4oB', time=2024-06-04T18:18:21.398662+0000, chain.objs.size()=3 2024-06-04T16:22:39.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.536+0000 7f75d8016800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.154__shadow_.CPspFQ1inVToRXCWdfdEx-xo97h_DjJ_0 2024-06-04T16:22:39.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.536+0000 7f75d8016800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.154__shadow_.CPspFQ1inVToRXCWdfdEx-xo97h_DjJ_1 2024-06-04T16:22:39.539 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.536+0000 7f75d8016800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.154__shadow_.CPspFQ1inVToRXCWdfdEx-xo97h_DjJ_2 2024-06-04T16:22:39.539 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.539+0000 7f75d8016800 5 garbage collection: RGWGC::process removing entries, marker: 2024-06-04T16:22:39.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.541+0000 7f75d8016800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-06-04T16:22:39.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.542+0000 7f75d8016800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:22:39.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.542+0000 7f75d8016800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:22:39.544 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.543+0000 7f75d8016800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-06-04T16:22:39.544 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.543+0000 7f75d8016800 20 garbage collection: RGWGC::process iterating over entry tag='_p-Ky9DE7VMCJOwQyt4rJ2Oy3sZ1k7wZ', time=2024-06-04T18:18:17.208040+0000, chain.objs.size()=1 2024-06-04T16:22:39.544 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.543+0000 7f75d8016800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.149__shadow_.C_-Yt5cxd05nEu1jJm-6B8-MDrbZbVP_0 2024-06-04T16:22:39.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.543+0000 7f75d8016800 5 garbage collection: RGWGC::process removing entries, marker: 2024-06-04T16:22:39.547 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.545+0000 7f75d8016800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-06-04T16:22:39.548 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.547+0000 7f75d8016800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:22:39.548 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.547+0000 7f75d8016800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:22:39.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.548+0000 7f75d8016800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:22:39.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.549+0000 7f75d8016800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-06-04T16:22:39.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.550+0000 7f75d8016800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:22:39.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.551+0000 7f75d8016800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:22:39.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.551+0000 7f75d8016800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-06-04T16:22:39.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.551+0000 7f75d8016800 20 garbage collection: RGWGC::process iterating over entry tag='be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.12761851406178784124', time=2024-06-04T18:18:19.007627+0000, chain.objs.size()=5 2024-06-04T16:22:39.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.551+0000 7f75d8016800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.150__multipart_foo-LUKEWARM.2~Vn7SEk_QUqX_HdHW34bRUJ-xqDU14mI.1 2024-06-04T16:22:39.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.551+0000 7f75d8016800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.150__shadow_foo-LUKEWARM.2~Vn7SEk_QUqX_HdHW34bRUJ-xqDU14mI.1_1 2024-06-04T16:22:39.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.551+0000 7f75d8016800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.150__multipart_foo-LUKEWARM.2~Vn7SEk_QUqX_HdHW34bRUJ-xqDU14mI.2 2024-06-04T16:22:39.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.551+0000 7f75d8016800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.150__shadow_foo-LUKEWARM.2~Vn7SEk_QUqX_HdHW34bRUJ-xqDU14mI.2_1 2024-06-04T16:22:39.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.551+0000 7f75d8016800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.150__multipart_foo-LUKEWARM.2~Vn7SEk_QUqX_HdHW34bRUJ-xqDU14mI.3 2024-06-04T16:22:39.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.551+0000 7f75d8016800 20 garbage collection: RGWGC::process iterating over entry tag='_sVIvpEfDw6oz-XtF-tQ0BofQS_fGGdH', time=2024-06-04T18:18:19.122427+0000, chain.objs.size()=2 2024-06-04T16:22:39.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.551+0000 7f75d8016800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.150__shadow_.MOemyWXfy2dT740XDUSHvMuX-Lc_Lx__1 2024-06-04T16:22:39.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.551+0000 7f75d8016800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.150__shadow_.MOemyWXfy2dT740XDUSHvMuX-Lc_Lx__2 2024-06-04T16:22:39.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.554+0000 7f75d8016800 5 garbage collection: RGWGC::process removing entries, marker: 2024-06-04T16:22:39.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.556+0000 7f75d8016800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-06-04T16:22:39.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.558+0000 7f75d8016800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:22:39.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.558+0000 7f75d8016800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:22:39.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.559+0000 7f75d8016800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:22:39.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.560+0000 7f75d8016800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-06-04T16:22:39.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.561+0000 7f75d8016800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:22:39.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.561+0000 7f75d8016800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:22:39.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.562+0000 7f75d8016800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:22:39.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.563+0000 7f75d8016800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-06-04T16:22:39.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.564+0000 7f75d8016800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-06-04T16:22:39.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.565+0000 7f75d8016800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-06-04T16:22:39.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.565+0000 7f75d8016800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-06-04T16:22:39.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.565+0000 7f75d8016800 20 garbage collection: RGWGC::process iterating over entry tag='be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.9350465473097167830', time=2024-06-04T18:18:16.970744+0000, chain.objs.size()=5 2024-06-04T16:22:39.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.565+0000 7f75d8016800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.148__multipart_mymultipart-FROZEN.2~kJXYfSgRNnT70er75GD-o-tYRu8-BWu.1 2024-06-04T16:22:39.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.565+0000 7f75d8016800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.148__shadow_mymultipart-FROZEN.2~kJXYfSgRNnT70er75GD-o-tYRu8-BWu.1_1 2024-06-04T16:22:39.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.565+0000 7f75d8016800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.148__multipart_mymultipart-FROZEN.2~kJXYfSgRNnT70er75GD-o-tYRu8-BWu.2 2024-06-04T16:22:39.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.565+0000 7f75d8016800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.148__shadow_mymultipart-FROZEN.2~kJXYfSgRNnT70er75GD-o-tYRu8-BWu.2_1 2024-06-04T16:22:39.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.565+0000 7f75d8016800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:be5c8c5f-c9f6-4b8b-8fac-0c89bfbd9767.4596.148__multipart_mymultipart-FROZEN.2~kJXYfSgRNnT70er75GD-o-tYRu8-BWu.3 2024-06-04T16:22:39.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.568+0000 7f75d8016800 5 garbage collection: RGWGC::process removing entries, marker: 2024-06-04T16:22:39.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.570+0000 7f7489fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-06-04T16:22:39.573 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.572+0000 7f75d8016800 20 remove_watcher() i=0 2024-06-04T16:22:39.574 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.572+0000 7f75d8016800 2 removed watcher, disabling cache 2024-06-04T16:22:39.574 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.573+0000 7f75d8016800 20 remove_watcher() i=1 2024-06-04T16:22:39.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.574+0000 7f75d8016800 20 remove_watcher() i=2 2024-06-04T16:22:39.576 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.575+0000 7f75d8016800 20 remove_watcher() i=3 2024-06-04T16:22:39.577 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.576+0000 7f75d8016800 20 remove_watcher() i=4 2024-06-04T16:22:39.578 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.577+0000 7f75d8016800 20 remove_watcher() i=5 2024-06-04T16:22:39.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.578+0000 7f75d8016800 20 remove_watcher() i=6 2024-06-04T16:22:39.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-06-04T16:22:39.579+0000 7f75d8016800 20 remove_watcher() i=7 2024-06-04T16:22:39.592 DEBUG:teuthology.run_tasks:Unwinding manager openssl_keys 2024-06-04T16:22:39.604 DEBUG:teuthology.orchestra.run.smithi144:> rm -f /home/ubuntu/cephtest/ca/root.crt /home/ubuntu/cephtest/ca/root.key 2024-06-04T16:22:39.633 DEBUG:teuthology.orchestra.run.smithi144:> rmdir --ignore-fail-on-non-empty /home/ubuntu/cephtest/ca 2024-06-04T16:22:39.702 DEBUG:teuthology.orchestra.run.smithi144:> rm -f /home/ubuntu/cephtest/ca/rgw.client.0.crt /home/ubuntu/cephtest/ca/rgw.client.0.key 2024-06-04T16:22:39.770 DEBUG:teuthology.orchestra.run.smithi144:> rmdir --ignore-fail-on-non-empty /home/ubuntu/cephtest/ca 2024-06-04T16:22:39.839 DEBUG:teuthology.orchestra.run.smithi144:> sudo rm /usr/share/pki/ca-trust-source/anchors/root.crt 2024-06-04T16:22:39.917 DEBUG:teuthology.orchestra.run.smithi144:> sudo update-ca-trust 2024-06-04T16:22:40.732 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-06-04T16:22:40.743 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-06-04T16:22:40.743 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-06-04T16:22:41.074 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:41.086 INFO:teuthology.orchestra.run.smithi144.stderr:dumped all 2024-06-04T16:22:41.089 INFO:teuthology.orchestra.run.smithi144.stdout:{"pg_ready":true,"pg_map":{"version":1157,"stamp":"2024-06-04T16:22:39.553288+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":318386363,"num_objects":622,"num_object_clones":0,"num_object_copies":1465,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":622,"num_whiteouts":0,"num_read":69712,"num_read_kb":1447162,"num_write":34353,"num_write_kb":1951187,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":99,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11725,"ondisk_log_size":11725,"up":850,"acting":850,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":850,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1644716,"kb_used_data":587436,"kb_used_omap":12,"kb_used_meta":1057203,"kb_avail":753330004,"statfs":{"total":773094113280,"available":771409924096,"internally_reserved":0,"allocated":601534464,"data_stored":586321450,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":1082576433},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-520,"num_objects":-4,"num_object_clones":0,"num_object_copies":-8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-4,"num_whiteouts":0,"num_read":18,"num_read_kb":20,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004862"},"pg_stats":[{"pgid":"67.1c","version":"0'0","reported_seq":14,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:40.004173+0000","last_change":"2024-06-04T16:16:08.658494+0000","last_active":"2024-06-04T16:18:40.004173+0000","last_peered":"2024-06-04T16:18:40.004173+0000","last_clean":"2024-06-04T16:18:40.004173+0000","last_became_active":"2024-06-04T16:16:08.658205+0000","last_became_peered":"2024-06-04T16:16:08.658205+0000","last_unstale":"2024-06-04T16:18:40.004173+0000","last_undegraded":"2024-06-04T16:18:40.004173+0000","last_fullsized":"2024-06-04T16:18:40.004173+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_clean_scrub_stamp":"2024-06-04T16:16:07.631263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T00:52:26.843651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1d","version":"251'2","reported_seq":27,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:30.016313+0000","last_change":"2024-06-04T16:09:26.627968+0000","last_active":"2024-06-04T16:19:30.016313+0000","last_peered":"2024-06-04T16:19:30.016313+0000","last_clean":"2024-06-04T16:19:30.016313+0000","last_became_active":"2024-06-04T16:09:26.627678+0000","last_became_peered":"2024-06-04T16:09:26.627678+0000","last_unstale":"2024-06-04T16:19:30.016313+0000","last_undegraded":"2024-06-04T16:19:30.016313+0000","last_fullsized":"2024-06-04T16:19:30.016313+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_clean_scrub_stamp":"2024-06-04T16:09:25.601105+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T01:24:09.747341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1e","version":"254'1","reported_seq":32,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:25.015222+0000","last_change":"2024-06-04T16:09:23.610282+0000","last_active":"2024-06-04T16:19:25.015222+0000","last_peered":"2024-06-04T16:19:25.015222+0000","last_clean":"2024-06-04T16:19:25.015222+0000","last_became_active":"2024-06-04T16:09:23.610020+0000","last_became_peered":"2024-06-04T16:09:23.610020+0000","last_unstale":"2024-06-04T16:19:25.015222+0000","last_undegraded":"2024-06-04T16:19:25.015222+0000","last_fullsized":"2024-06-04T16:19:25.015222+0000","mapping_epoch":246,"log_start":"0'0","ondisk_log_start":"0'0","created":246,"last_epoch_clean":247,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_clean_scrub_stamp":"2024-06-04T16:09:22.572686+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T20:33:48.503494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"64.1f","version":"251'21","reported_seq":94,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:40.017799+0000","last_change":"2024-06-04T16:07:09.402335+0000","last_active":"2024-06-04T16:19:40.017799+0000","last_peered":"2024-06-04T16:19:40.017799+0000","last_clean":"2024-06-04T16:19:40.017799+0000","last_became_active":"2024-06-04T16:07:09.402073+0000","last_became_peered":"2024-06-04T16:07:09.402073+0000","last_unstale":"2024-06-04T16:19:40.017799+0000","last_undegraded":"2024-06-04T16:19:40.017799+0000","last_fullsized":"2024-06-04T16:19:40.017799+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":243,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:07:08.374534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:07:08.374534+0000","last_clean_scrub_stamp":"2024-06-04T16:07:08.374534+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T00:13:07.984077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":108,"num_read_kb":75,"num_write":41,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1d","version":"0'0","reported_seq":14,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:40.113877+0000","last_change":"2024-06-04T16:16:08.656686+0000","last_active":"2024-06-04T16:18:40.113877+0000","last_peered":"2024-06-04T16:18:40.113877+0000","last_clean":"2024-06-04T16:18:40.113877+0000","last_became_active":"2024-06-04T16:16:08.656388+0000","last_became_peered":"2024-06-04T16:16:08.656388+0000","last_unstale":"2024-06-04T16:18:40.113877+0000","last_undegraded":"2024-06-04T16:18:40.113877+0000","last_fullsized":"2024-06-04T16:18:40.113877+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_clean_scrub_stamp":"2024-06-04T16:16:07.631263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T18:52:52.325700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.1c","version":"254'1","reported_seq":25,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:30.128582+0000","last_change":"2024-06-04T16:09:26.627239+0000","last_active":"2024-06-04T16:19:30.128582+0000","last_peered":"2024-06-04T16:19:30.128582+0000","last_clean":"2024-06-04T16:19:30.128582+0000","last_became_active":"2024-06-04T16:09:26.626964+0000","last_became_peered":"2024-06-04T16:09:26.626964+0000","last_unstale":"2024-06-04T16:19:30.128582+0000","last_undegraded":"2024-06-04T16:19:30.128582+0000","last_fullsized":"2024-06-04T16:19:30.128582+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_clean_scrub_stamp":"2024-06-04T16:09:25.601105+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T22:22:45.616852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":3072,"num_write":1,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1f","version":"254'3","reported_seq":36,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:50.018652+0000","last_change":"2024-06-04T16:09:23.608520+0000","last_active":"2024-06-04T16:19:50.018652+0000","last_peered":"2024-06-04T16:19:50.018652+0000","last_clean":"2024-06-04T16:19:50.018652+0000","last_became_active":"2024-06-04T16:09:23.608251+0000","last_became_peered":"2024-06-04T16:09:23.608251+0000","last_unstale":"2024-06-04T16:19:50.018652+0000","last_undegraded":"2024-06-04T16:19:50.018652+0000","last_fullsized":"2024-06-04T16:19:50.018652+0000","mapping_epoch":246,"log_start":"0'0","ondisk_log_start":"0'0","created":246,"last_epoch_clean":247,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_clean_scrub_stamp":"2024-06-04T16:09:22.572686+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T01:41:52.047423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":8192,"num_write":3,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"64.1e","version":"251'15","reported_seq":79,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:10.125894+0000","last_change":"2024-06-04T16:07:09.511589+0000","last_active":"2024-06-04T16:19:10.125894+0000","last_peered":"2024-06-04T16:19:10.125894+0000","last_clean":"2024-06-04T16:19:10.125894+0000","last_became_active":"2024-06-04T16:07:09.511253+0000","last_became_peered":"2024-06-04T16:07:09.511253+0000","last_unstale":"2024-06-04T16:19:10.125894+0000","last_undegraded":"2024-06-04T16:19:10.125894+0000","last_fullsized":"2024-06-04T16:19:10.125894+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":243,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:07:08.374534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:07:08.374534+0000","last_clean_scrub_stamp":"2024-06-04T16:07:08.374534+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T02:12:46.993038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":58,"num_write":26,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1e","version":"0'0","reported_seq":15,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:20:10.022107+0000","last_change":"2024-06-04T16:16:08.660980+0000","last_active":"2024-06-04T16:20:10.022107+0000","last_peered":"2024-06-04T16:20:10.022107+0000","last_clean":"2024-06-04T16:20:10.022107+0000","last_became_active":"2024-06-04T16:16:08.660635+0000","last_became_peered":"2024-06-04T16:16:08.660635+0000","last_unstale":"2024-06-04T16:20:10.022107+0000","last_undegraded":"2024-06-04T16:20:10.022107+0000","last_fullsized":"2024-06-04T16:20:10.022107+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_clean_scrub_stamp":"2024-06-04T16:16:07.631263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T01:54:33.642831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1f","version":"0'0","reported_seq":24,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:55.121976+0000","last_change":"2024-06-04T16:09:26.624893+0000","last_active":"2024-06-04T16:19:55.121976+0000","last_peered":"2024-06-04T16:19:55.121976+0000","last_clean":"2024-06-04T16:19:55.121976+0000","last_became_active":"2024-06-04T16:09:26.624510+0000","last_became_peered":"2024-06-04T16:09:26.624510+0000","last_unstale":"2024-06-04T16:19:55.121976+0000","last_undegraded":"2024-06-04T16:19:55.121976+0000","last_fullsized":"2024-06-04T16:19:55.121976+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_clean_scrub_stamp":"2024-06-04T16:09:25.601105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T00:28:18.386660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1c","version":"0'0","reported_seq":29,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:25.014688+0000","last_change":"2024-06-04T16:09:23.612578+0000","last_active":"2024-06-04T16:19:25.014688+0000","last_peered":"2024-06-04T16:19:25.014688+0000","last_clean":"2024-06-04T16:19:25.014688+0000","last_became_active":"2024-06-04T16:09:23.612278+0000","last_became_peered":"2024-06-04T16:09:23.612278+0000","last_unstale":"2024-06-04T16:19:25.014688+0000","last_undegraded":"2024-06-04T16:19:25.014688+0000","last_fullsized":"2024-06-04T16:19:25.014688+0000","mapping_epoch":246,"log_start":"0'0","ondisk_log_start":"0'0","created":246,"last_epoch_clean":247,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_clean_scrub_stamp":"2024-06-04T16:09:22.572686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T04:01:33.465233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"64.1d","version":"251'28","reported_seq":114,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:40.120403+0000","last_change":"2024-06-04T16:07:09.511447+0000","last_active":"2024-06-04T16:19:40.120403+0000","last_peered":"2024-06-04T16:19:40.120403+0000","last_clean":"2024-06-04T16:19:40.120403+0000","last_became_active":"2024-06-04T16:07:09.511154+0000","last_became_peered":"2024-06-04T16:07:09.511154+0000","last_unstale":"2024-06-04T16:19:40.120403+0000","last_undegraded":"2024-06-04T16:19:40.120403+0000","last_fullsized":"2024-06-04T16:19:40.120403+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":243,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:07:08.374534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:07:08.374534+0000","last_clean_scrub_stamp":"2024-06-04T16:07:08.374534+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T03:39:17.866776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":150,"num_read_kb":106,"num_write":50,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.1f","version":"0'0","reported_seq":15,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:20:20.023704+0000","last_change":"2024-06-04T16:16:08.661162+0000","last_active":"2024-06-04T16:20:20.023704+0000","last_peered":"2024-06-04T16:20:20.023704+0000","last_clean":"2024-06-04T16:20:20.023704+0000","last_became_active":"2024-06-04T16:16:08.660669+0000","last_became_peered":"2024-06-04T16:16:08.660669+0000","last_unstale":"2024-06-04T16:20:20.023704+0000","last_undegraded":"2024-06-04T16:20:20.023704+0000","last_fullsized":"2024-06-04T16:20:20.023704+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_clean_scrub_stamp":"2024-06-04T16:16:07.631263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T16:45:04.637111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1e","version":"254'1","reported_seq":26,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:30.128637+0000","last_change":"2024-06-04T16:09:26.622613+0000","last_active":"2024-06-04T16:19:30.128637+0000","last_peered":"2024-06-04T16:19:30.128637+0000","last_clean":"2024-06-04T16:19:30.128637+0000","last_became_active":"2024-06-04T16:09:26.621326+0000","last_became_peered":"2024-06-04T16:09:26.621326+0000","last_unstale":"2024-06-04T16:19:30.128637+0000","last_undegraded":"2024-06-04T16:19:30.128637+0000","last_fullsized":"2024-06-04T16:19:30.128637+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_clean_scrub_stamp":"2024-06-04T16:09:25.601105+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T01:20:44.676294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1d","version":"254'4","reported_seq":36,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:25.014713+0000","last_change":"2024-06-04T16:09:23.607186+0000","last_active":"2024-06-04T16:19:25.014713+0000","last_peered":"2024-06-04T16:19:25.014713+0000","last_clean":"2024-06-04T16:19:25.014713+0000","last_became_active":"2024-06-04T16:09:23.606918+0000","last_became_peered":"2024-06-04T16:09:23.606918+0000","last_unstale":"2024-06-04T16:19:25.014713+0000","last_undegraded":"2024-06-04T16:19:25.014713+0000","last_fullsized":"2024-06-04T16:19:25.014713+0000","mapping_epoch":246,"log_start":"0'0","ondisk_log_start":"0'0","created":246,"last_epoch_clean":247,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_clean_scrub_stamp":"2024-06-04T16:09:22.572686+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T17:11:19.839027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48422,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4144,"num_write":9,"num_write_kb":4144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"64.1c","version":"251'37","reported_seq":142,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:40.017695+0000","last_change":"2024-06-04T16:07:09.509991+0000","last_active":"2024-06-04T16:19:40.017695+0000","last_peered":"2024-06-04T16:19:40.017695+0000","last_clean":"2024-06-04T16:19:40.017695+0000","last_became_active":"2024-06-04T16:07:09.509671+0000","last_became_peered":"2024-06-04T16:07:09.509671+0000","last_unstale":"2024-06-04T16:19:40.017695+0000","last_undegraded":"2024-06-04T16:19:40.017695+0000","last_fullsized":"2024-06-04T16:19:40.017695+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":243,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:07:08.374534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:07:08.374534+0000","last_clean_scrub_stamp":"2024-06-04T16:07:08.374534+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T18:48:21.024789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":197,"num_read_kb":141,"num_write":70,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.18","version":"0'0","reported_seq":14,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:35.007117+0000","last_change":"2024-06-04T16:16:08.664509+0000","last_active":"2024-06-04T16:18:35.007117+0000","last_peered":"2024-06-04T16:18:35.007117+0000","last_clean":"2024-06-04T16:18:35.007117+0000","last_became_active":"2024-06-04T16:16:08.664252+0000","last_became_peered":"2024-06-04T16:16:08.664252+0000","last_unstale":"2024-06-04T16:18:35.007117+0000","last_undegraded":"2024-06-04T16:18:35.007117+0000","last_fullsized":"2024-06-04T16:18:35.007117+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_clean_scrub_stamp":"2024-06-04T16:16:07.631263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T01:56:56.151412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.19","version":"254'6","reported_seq":34,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:15.011678+0000","last_change":"2024-06-04T16:09:26.625104+0000","last_active":"2024-06-04T16:19:15.011678+0000","last_peered":"2024-06-04T16:19:15.011678+0000","last_clean":"2024-06-04T16:19:15.011678+0000","last_became_active":"2024-06-04T16:09:26.624681+0000","last_became_peered":"2024-06-04T16:09:26.624681+0000","last_unstale":"2024-06-04T16:19:15.011678+0000","last_undegraded":"2024-06-04T16:19:15.011678+0000","last_fullsized":"2024-06-04T16:19:15.011678+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_clean_scrub_stamp":"2024-06-04T16:09:25.601105+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T16:38:40.132989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7,"num_read_kb":9216,"num_write":11,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1a","version":"251'3","reported_seq":34,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:25.008703+0000","last_change":"2024-06-04T16:09:23.609384+0000","last_active":"2024-06-04T16:19:25.008703+0000","last_peered":"2024-06-04T16:19:25.008703+0000","last_clean":"2024-06-04T16:19:25.008703+0000","last_became_active":"2024-06-04T16:09:23.609102+0000","last_became_peered":"2024-06-04T16:09:23.609102+0000","last_unstale":"2024-06-04T16:19:25.008703+0000","last_undegraded":"2024-06-04T16:19:25.008703+0000","last_fullsized":"2024-06-04T16:19:25.008703+0000","mapping_epoch":246,"log_start":"0'0","ondisk_log_start":"0'0","created":246,"last_epoch_clean":247,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_clean_scrub_stamp":"2024-06-04T16:09:22.572686+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T19:32:58.624496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"64.1b","version":"251'96","reported_seq":333,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:40.017150+0000","last_change":"2024-06-04T16:07:09.404530+0000","last_active":"2024-06-04T16:19:40.017150+0000","last_peered":"2024-06-04T16:19:40.017150+0000","last_clean":"2024-06-04T16:19:40.017150+0000","last_became_active":"2024-06-04T16:07:09.404202+0000","last_became_peered":"2024-06-04T16:07:09.404202+0000","last_unstale":"2024-06-04T16:19:40.017150+0000","last_undegraded":"2024-06-04T16:19:40.017150+0000","last_fullsized":"2024-06-04T16:19:40.017150+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":243,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:07:08.374534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:07:08.374534+0000","last_clean_scrub_stamp":"2024-06-04T16:07:08.374534+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T20:38:56.584375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":591,"num_read_kb":533,"num_write":104,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.19","version":"0'0","reported_seq":14,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:35.003192+0000","last_change":"2024-06-04T16:16:08.659135+0000","last_active":"2024-06-04T16:18:35.003192+0000","last_peered":"2024-06-04T16:18:35.003192+0000","last_clean":"2024-06-04T16:18:35.003192+0000","last_became_active":"2024-06-04T16:16:08.658696+0000","last_became_peered":"2024-06-04T16:16:08.658696+0000","last_unstale":"2024-06-04T16:18:35.003192+0000","last_undegraded":"2024-06-04T16:18:35.003192+0000","last_fullsized":"2024-06-04T16:18:35.003192+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_clean_scrub_stamp":"2024-06-04T16:16:07.631263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T04:10:28.111016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.18","version":"254'6","reported_seq":33,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:10.013706+0000","last_change":"2024-06-04T16:09:26.624594+0000","last_active":"2024-06-04T16:19:10.013706+0000","last_peered":"2024-06-04T16:19:10.013706+0000","last_clean":"2024-06-04T16:19:10.013706+0000","last_became_active":"2024-06-04T16:09:26.624322+0000","last_became_peered":"2024-06-04T16:09:26.624322+0000","last_unstale":"2024-06-04T16:19:10.013706+0000","last_undegraded":"2024-06-04T16:19:10.013706+0000","last_fullsized":"2024-06-04T16:19:10.013706+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_clean_scrub_stamp":"2024-06-04T16:09:25.601105+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T03:22:38.550890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":8192,"num_write":11,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1b","version":"254'11","reported_seq":58,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:25.014649+0000","last_change":"2024-06-04T16:09:23.613387+0000","last_active":"2024-06-04T16:19:25.014649+0000","last_peered":"2024-06-04T16:19:25.014649+0000","last_clean":"2024-06-04T16:19:25.014649+0000","last_became_active":"2024-06-04T16:09:23.613109+0000","last_became_peered":"2024-06-04T16:09:23.613109+0000","last_unstale":"2024-06-04T16:19:25.014649+0000","last_undegraded":"2024-06-04T16:19:25.014649+0000","last_fullsized":"2024-06-04T16:19:25.014649+0000","mapping_epoch":246,"log_start":"0'0","ondisk_log_start":"0'0","created":246,"last_epoch_clean":247,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_clean_scrub_stamp":"2024-06-04T16:09:22.572686+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T18:31:33.463795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7340032,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":24,"num_read_kb":29700,"num_write":14,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"64.1a","version":"251'15","reported_seq":75,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:40.120356+0000","last_change":"2024-06-04T16:07:09.407260+0000","last_active":"2024-06-04T16:19:40.120356+0000","last_peered":"2024-06-04T16:19:40.120356+0000","last_clean":"2024-06-04T16:19:40.120356+0000","last_became_active":"2024-06-04T16:07:09.406976+0000","last_became_peered":"2024-06-04T16:07:09.406976+0000","last_unstale":"2024-06-04T16:19:40.120356+0000","last_undegraded":"2024-06-04T16:19:40.120356+0000","last_fullsized":"2024-06-04T16:19:40.120356+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":243,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:07:08.374534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:07:08.374534+0000","last_clean_scrub_stamp":"2024-06-04T16:07:08.374534+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T22:44:48.654459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":52,"num_write":29,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.1a","version":"0'0","reported_seq":14,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:40.121419+0000","last_change":"2024-06-04T16:16:08.664491+0000","last_active":"2024-06-04T16:18:40.121419+0000","last_peered":"2024-06-04T16:18:40.121419+0000","last_clean":"2024-06-04T16:18:40.121419+0000","last_became_active":"2024-06-04T16:16:08.664200+0000","last_became_peered":"2024-06-04T16:16:08.664200+0000","last_unstale":"2024-06-04T16:18:40.121419+0000","last_undegraded":"2024-06-04T16:18:40.121419+0000","last_fullsized":"2024-06-04T16:18:40.121419+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_clean_scrub_stamp":"2024-06-04T16:16:07.631263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T01:16:08.795243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.1b","version":"254'2","reported_seq":27,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:30.015296+0000","last_change":"2024-06-04T16:09:26.626809+0000","last_active":"2024-06-04T16:19:30.015296+0000","last_peered":"2024-06-04T16:19:30.015296+0000","last_clean":"2024-06-04T16:19:30.015296+0000","last_became_active":"2024-06-04T16:09:26.626528+0000","last_became_peered":"2024-06-04T16:09:26.626528+0000","last_unstale":"2024-06-04T16:19:30.015296+0000","last_undegraded":"2024-06-04T16:19:30.015296+0000","last_fullsized":"2024-06-04T16:19:30.015296+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_clean_scrub_stamp":"2024-06-04T16:09:25.601105+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T03:55:00.731424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":7,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.18","version":"254'3","reported_seq":35,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:05.011849+0000","last_change":"2024-06-04T16:09:23.610295+0000","last_active":"2024-06-04T16:19:05.011849+0000","last_peered":"2024-06-04T16:19:05.011849+0000","last_clean":"2024-06-04T16:19:05.011849+0000","last_became_active":"2024-06-04T16:09:23.609952+0000","last_became_peered":"2024-06-04T16:09:23.609952+0000","last_unstale":"2024-06-04T16:19:05.011849+0000","last_undegraded":"2024-06-04T16:19:05.011849+0000","last_fullsized":"2024-06-04T16:19:05.011849+0000","mapping_epoch":246,"log_start":"0'0","ondisk_log_start":"0'0","created":246,"last_epoch_clean":247,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_clean_scrub_stamp":"2024-06-04T16:09:22.572686+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T20:30:38.429992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"64.19","version":"251'22","reported_seq":96,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:20.015056+0000","last_change":"2024-06-04T16:07:09.402552+0000","last_active":"2024-06-04T16:19:20.015056+0000","last_peered":"2024-06-04T16:19:20.015056+0000","last_clean":"2024-06-04T16:19:20.015056+0000","last_became_active":"2024-06-04T16:07:09.402316+0000","last_became_peered":"2024-06-04T16:07:09.402316+0000","last_unstale":"2024-06-04T16:19:20.015056+0000","last_undegraded":"2024-06-04T16:19:20.015056+0000","last_fullsized":"2024-06-04T16:19:20.015056+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":243,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:07:08.374534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:07:08.374534+0000","last_clean_scrub_stamp":"2024-06-04T16:07:08.374534+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T21:44:10.282159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":114,"num_read_kb":79,"num_write":44,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1b","version":"0'0","reported_seq":14,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:40.004153+0000","last_change":"2024-06-04T16:16:08.654196+0000","last_active":"2024-06-04T16:18:40.004153+0000","last_peered":"2024-06-04T16:18:40.004153+0000","last_clean":"2024-06-04T16:18:40.004153+0000","last_became_active":"2024-06-04T16:16:08.653931+0000","last_became_peered":"2024-06-04T16:16:08.653931+0000","last_unstale":"2024-06-04T16:18:40.004153+0000","last_undegraded":"2024-06-04T16:18:40.004153+0000","last_fullsized":"2024-06-04T16:18:40.004153+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_clean_scrub_stamp":"2024-06-04T16:16:07.631263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T18:57:31.093469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1a","version":"254'7","reported_seq":39,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:30.008616+0000","last_change":"2024-06-04T16:09:26.623784+0000","last_active":"2024-06-04T16:19:30.008616+0000","last_peered":"2024-06-04T16:19:30.008616+0000","last_clean":"2024-06-04T16:19:30.008616+0000","last_became_active":"2024-06-04T16:09:26.623459+0000","last_became_peered":"2024-06-04T16:09:26.623459+0000","last_unstale":"2024-06-04T16:19:30.008616+0000","last_undegraded":"2024-06-04T16:19:30.008616+0000","last_fullsized":"2024-06-04T16:19:30.008616+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_clean_scrub_stamp":"2024-06-04T16:09:25.601105+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T00:27:16.479995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2097152,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":13,"num_read_kb":9218,"num_write":6,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.19","version":"254'5","reported_seq":41,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:05.124976+0000","last_change":"2024-06-04T16:09:23.607280+0000","last_active":"2024-06-04T16:19:05.124976+0000","last_peered":"2024-06-04T16:19:05.124976+0000","last_clean":"2024-06-04T16:19:05.124976+0000","last_became_active":"2024-06-04T16:09:23.606966+0000","last_became_peered":"2024-06-04T16:09:23.606966+0000","last_unstale":"2024-06-04T16:19:05.124976+0000","last_undegraded":"2024-06-04T16:19:05.124976+0000","last_fullsized":"2024-06-04T16:19:05.124976+0000","mapping_epoch":246,"log_start":"0'0","ondisk_log_start":"0'0","created":246,"last_epoch_clean":247,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_clean_scrub_stamp":"2024-06-04T16:09:22.572686+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T00:52:40.922210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":10,"num_read_kb":8194,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"64.18","version":"251'39","reported_seq":144,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:15.117833+0000","last_change":"2024-06-04T16:07:09.404324+0000","last_active":"2024-06-04T16:19:15.117833+0000","last_peered":"2024-06-04T16:19:15.117833+0000","last_clean":"2024-06-04T16:19:15.117833+0000","last_became_active":"2024-06-04T16:07:09.404055+0000","last_became_peered":"2024-06-04T16:07:09.404055+0000","last_unstale":"2024-06-04T16:19:15.117833+0000","last_undegraded":"2024-06-04T16:19:15.117833+0000","last_fullsized":"2024-06-04T16:19:15.117833+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":243,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:07:08.374534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:07:08.374534+0000","last_clean_scrub_stamp":"2024-06-04T16:07:08.374534+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T02:35:29.659798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":206,"num_read_kb":146,"num_write":71,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.14","version":"253'1","reported_seq":15,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:30.008340+0000","last_change":"2024-06-04T16:16:08.662285+0000","last_active":"2024-06-04T16:18:30.008340+0000","last_peered":"2024-06-04T16:18:30.008340+0000","last_clean":"2024-06-04T16:18:30.008340+0000","last_became_active":"2024-06-04T16:16:08.661995+0000","last_became_peered":"2024-06-04T16:16:08.661995+0000","last_unstale":"2024-06-04T16:18:30.008340+0000","last_undegraded":"2024-06-04T16:18:30.008340+0000","last_fullsized":"2024-06-04T16:18:30.008340+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_clean_scrub_stamp":"2024-06-04T16:16:07.631263+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T04:00:42.209306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.15","version":"254'3","reported_seq":28,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:10.006683+0000","last_change":"2024-06-04T16:09:26.623775+0000","last_active":"2024-06-04T16:19:10.006683+0000","last_peered":"2024-06-04T16:19:10.006683+0000","last_clean":"2024-06-04T16:19:10.006683+0000","last_became_active":"2024-06-04T16:09:26.623442+0000","last_became_peered":"2024-06-04T16:09:26.623442+0000","last_unstale":"2024-06-04T16:19:10.006683+0000","last_undegraded":"2024-06-04T16:19:10.006683+0000","last_fullsized":"2024-06-04T16:19:10.006683+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_clean_scrub_stamp":"2024-06-04T16:09:25.601105+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T00:42:02.876938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4913649,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":1406,"num_write":8,"num_write_kb":4799,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.16","version":"251'2","reported_seq":33,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:05.012569+0000","last_change":"2024-06-04T16:09:23.609558+0000","last_active":"2024-06-04T16:19:05.012569+0000","last_peered":"2024-06-04T16:19:05.012569+0000","last_clean":"2024-06-04T16:19:05.012569+0000","last_became_active":"2024-06-04T16:09:23.609180+0000","last_became_peered":"2024-06-04T16:09:23.609180+0000","last_unstale":"2024-06-04T16:19:05.012569+0000","last_undegraded":"2024-06-04T16:19:05.012569+0000","last_fullsized":"2024-06-04T16:19:05.012569+0000","mapping_epoch":246,"log_start":"0'0","ondisk_log_start":"0'0","created":246,"last_epoch_clean":247,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_clean_scrub_stamp":"2024-06-04T16:09:22.572686+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T17:27:35.142187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":45,"num_write":2,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"64.17","version":"0'0","reported_seq":36,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:15.011780+0000","last_change":"2024-06-04T16:07:09.512132+0000","last_active":"2024-06-04T16:19:15.011780+0000","last_peered":"2024-06-04T16:19:15.011780+0000","last_clean":"2024-06-04T16:19:15.011780+0000","last_became_active":"2024-06-04T16:07:09.511806+0000","last_became_peered":"2024-06-04T16:07:09.511806+0000","last_unstale":"2024-06-04T16:19:15.011780+0000","last_undegraded":"2024-06-04T16:19:15.011780+0000","last_fullsized":"2024-06-04T16:19:15.011780+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":243,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:07:08.374534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:07:08.374534+0000","last_clean_scrub_stamp":"2024-06-04T16:07:08.374534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T21:23:49.362770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.15","version":"0'0","reported_seq":14,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:35.120607+0000","last_change":"2024-06-04T16:16:08.664995+0000","last_active":"2024-06-04T16:18:35.120607+0000","last_peered":"2024-06-04T16:18:35.120607+0000","last_clean":"2024-06-04T16:18:35.120607+0000","last_became_active":"2024-06-04T16:16:08.664680+0000","last_became_peered":"2024-06-04T16:16:08.664680+0000","last_unstale":"2024-06-04T16:18:35.120607+0000","last_undegraded":"2024-06-04T16:18:35.120607+0000","last_fullsized":"2024-06-04T16:18:35.120607+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_clean_scrub_stamp":"2024-06-04T16:16:07.631263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T19:24:50.177579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.14","version":"254'2","reported_seq":25,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:55.009567+0000","last_change":"2024-06-04T16:09:26.624246+0000","last_active":"2024-06-04T16:18:55.009567+0000","last_peered":"2024-06-04T16:18:55.009567+0000","last_clean":"2024-06-04T16:18:55.009567+0000","last_became_active":"2024-06-04T16:09:26.623991+0000","last_became_peered":"2024-06-04T16:09:26.623991+0000","last_unstale":"2024-06-04T16:18:55.009567+0000","last_undegraded":"2024-06-04T16:18:55.009567+0000","last_fullsized":"2024-06-04T16:18:55.009567+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_clean_scrub_stamp":"2024-06-04T16:09:25.601105+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T21:29:18.235375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.17","version":"254'1","reported_seq":31,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:05.012597+0000","last_change":"2024-06-04T16:09:23.595639+0000","last_active":"2024-06-04T16:19:05.012597+0000","last_peered":"2024-06-04T16:19:05.012597+0000","last_clean":"2024-06-04T16:19:05.012597+0000","last_became_active":"2024-06-04T16:09:23.595355+0000","last_became_peered":"2024-06-04T16:09:23.595355+0000","last_unstale":"2024-06-04T16:19:05.012597+0000","last_undegraded":"2024-06-04T16:19:05.012597+0000","last_fullsized":"2024-06-04T16:19:05.012597+0000","mapping_epoch":246,"log_start":"0'0","ondisk_log_start":"0'0","created":246,"last_epoch_clean":247,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_clean_scrub_stamp":"2024-06-04T16:09:22.572686+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T19:14:50.608068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"64.16","version":"251'16","reported_seq":80,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:15.126620+0000","last_change":"2024-06-04T16:07:09.405399+0000","last_active":"2024-06-04T16:19:15.126620+0000","last_peered":"2024-06-04T16:19:15.126620+0000","last_clean":"2024-06-04T16:19:15.126620+0000","last_became_active":"2024-06-04T16:07:09.405088+0000","last_became_peered":"2024-06-04T16:07:09.405088+0000","last_unstale":"2024-06-04T16:19:15.126620+0000","last_undegraded":"2024-06-04T16:19:15.126620+0000","last_fullsized":"2024-06-04T16:19:15.126620+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":243,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:07:08.374534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:07:08.374534+0000","last_clean_scrub_stamp":"2024-06-04T16:07:08.374534+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T21:34:43.810719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":63,"num_write":30,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.16","version":"0'0","reported_seq":14,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:35.003270+0000","last_change":"2024-06-04T16:16:08.656459+0000","last_active":"2024-06-04T16:18:35.003270+0000","last_peered":"2024-06-04T16:18:35.003270+0000","last_clean":"2024-06-04T16:18:35.003270+0000","last_became_active":"2024-06-04T16:16:08.655571+0000","last_became_peered":"2024-06-04T16:16:08.655571+0000","last_unstale":"2024-06-04T16:18:35.003270+0000","last_undegraded":"2024-06-04T16:18:35.003270+0000","last_fullsized":"2024-06-04T16:18:35.003270+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_clean_scrub_stamp":"2024-06-04T16:16:07.631263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T16:18:55.793739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.17","version":"0'0","reported_seq":23,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:10.013842+0000","last_change":"2024-06-04T16:09:26.626934+0000","last_active":"2024-06-04T16:19:10.013842+0000","last_peered":"2024-06-04T16:19:10.013842+0000","last_clean":"2024-06-04T16:19:10.013842+0000","last_became_active":"2024-06-04T16:09:26.626605+0000","last_became_peered":"2024-06-04T16:09:26.626605+0000","last_unstale":"2024-06-04T16:19:10.013842+0000","last_undegraded":"2024-06-04T16:19:10.013842+0000","last_fullsized":"2024-06-04T16:19:10.013842+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_clean_scrub_stamp":"2024-06-04T16:09:25.601105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T00:15:31.709245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.14","version":"254'1","reported_seq":31,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:50.009019+0000","last_change":"2024-06-04T16:09:23.608188+0000","last_active":"2024-06-04T16:18:50.009019+0000","last_peered":"2024-06-04T16:18:50.009019+0000","last_clean":"2024-06-04T16:18:50.009019+0000","last_became_active":"2024-06-04T16:09:23.607906+0000","last_became_peered":"2024-06-04T16:09:23.607906+0000","last_unstale":"2024-06-04T16:18:50.009019+0000","last_undegraded":"2024-06-04T16:18:50.009019+0000","last_fullsized":"2024-06-04T16:18:50.009019+0000","mapping_epoch":246,"log_start":"0'0","ondisk_log_start":"0'0","created":246,"last_epoch_clean":247,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_clean_scrub_stamp":"2024-06-04T16:09:22.572686+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T17:08:32.670089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"64.15","version":"0'0","reported_seq":36,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:15.014464+0000","last_change":"2024-06-04T16:07:09.401959+0000","last_active":"2024-06-04T16:19:15.014464+0000","last_peered":"2024-06-04T16:19:15.014464+0000","last_clean":"2024-06-04T16:19:15.014464+0000","last_became_active":"2024-06-04T16:07:09.401608+0000","last_became_peered":"2024-06-04T16:07:09.401608+0000","last_unstale":"2024-06-04T16:19:15.014464+0000","last_undegraded":"2024-06-04T16:19:15.014464+0000","last_fullsized":"2024-06-04T16:19:15.014464+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":243,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:07:08.374534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:07:08.374534+0000","last_clean_scrub_stamp":"2024-06-04T16:07:08.374534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T23:24:21.547866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.17","version":"0'0","reported_seq":14,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:35.120672+0000","last_change":"2024-06-04T16:16:08.657806+0000","last_active":"2024-06-04T16:18:35.120672+0000","last_peered":"2024-06-04T16:18:35.120672+0000","last_clean":"2024-06-04T16:18:35.120672+0000","last_became_active":"2024-06-04T16:16:08.657535+0000","last_became_peered":"2024-06-04T16:16:08.657535+0000","last_unstale":"2024-06-04T16:18:35.120672+0000","last_undegraded":"2024-06-04T16:18:35.120672+0000","last_fullsized":"2024-06-04T16:18:35.120672+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_clean_scrub_stamp":"2024-06-04T16:16:07.631263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T02:31:34.399203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.16","version":"254'10","reported_seq":45,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:10.125878+0000","last_change":"2024-06-04T16:09:26.628516+0000","last_active":"2024-06-04T16:19:10.125878+0000","last_peered":"2024-06-04T16:19:10.125878+0000","last_clean":"2024-06-04T16:19:10.125878+0000","last_became_active":"2024-06-04T16:09:26.628237+0000","last_became_peered":"2024-06-04T16:09:26.628237+0000","last_unstale":"2024-06-04T16:19:10.125878+0000","last_undegraded":"2024-06-04T16:19:10.125878+0000","last_fullsized":"2024-06-04T16:19:10.125878+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_clean_scrub_stamp":"2024-06-04T16:09:25.601105+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T22:06:09.423503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5291302,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":17,"num_read_kb":9311,"num_write":9,"num_write_kb":6237,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.15","version":"0'0","reported_seq":29,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:05.125028+0000","last_change":"2024-06-04T16:09:23.609111+0000","last_active":"2024-06-04T16:19:05.125028+0000","last_peered":"2024-06-04T16:19:05.125028+0000","last_clean":"2024-06-04T16:19:05.125028+0000","last_became_active":"2024-06-04T16:09:23.608801+0000","last_became_peered":"2024-06-04T16:09:23.608801+0000","last_unstale":"2024-06-04T16:19:05.125028+0000","last_undegraded":"2024-06-04T16:19:05.125028+0000","last_fullsized":"2024-06-04T16:19:05.125028+0000","mapping_epoch":246,"log_start":"0'0","ondisk_log_start":"0'0","created":246,"last_epoch_clean":247,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_clean_scrub_stamp":"2024-06-04T16:09:22.572686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T17:09:00.310675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"64.14","version":"251'30","reported_seq":117,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:55.011246+0000","last_change":"2024-06-04T16:07:09.404259+0000","last_active":"2024-06-04T16:18:55.011246+0000","last_peered":"2024-06-04T16:18:55.011246+0000","last_clean":"2024-06-04T16:18:55.011246+0000","last_became_active":"2024-06-04T16:07:09.403925+0000","last_became_peered":"2024-06-04T16:07:09.403925+0000","last_unstale":"2024-06-04T16:18:55.011246+0000","last_undegraded":"2024-06-04T16:18:55.011246+0000","last_fullsized":"2024-06-04T16:18:55.011246+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":243,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:07:08.374534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:07:08.374534+0000","last_clean_scrub_stamp":"2024-06-04T16:07:08.374534+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T23:42:39.058269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":154,"num_read_kb":107,"num_write":60,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.10","version":"0'0","reported_seq":14,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:30.008209+0000","last_change":"2024-06-04T16:16:08.656330+0000","last_active":"2024-06-04T16:18:30.008209+0000","last_peered":"2024-06-04T16:18:30.008209+0000","last_clean":"2024-06-04T16:18:30.008209+0000","last_became_active":"2024-06-04T16:16:08.656048+0000","last_became_peered":"2024-06-04T16:16:08.656048+0000","last_unstale":"2024-06-04T16:18:30.008209+0000","last_undegraded":"2024-06-04T16:18:30.008209+0000","last_fullsized":"2024-06-04T16:18:30.008209+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_clean_scrub_stamp":"2024-06-04T16:16:07.631263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T21:21:52.265223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.11","version":"251'8","reported_seq":39,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:50.011048+0000","last_change":"2024-06-04T16:09:26.626519+0000","last_active":"2024-06-04T16:18:50.011048+0000","last_peered":"2024-06-04T16:18:50.011048+0000","last_clean":"2024-06-04T16:18:50.011048+0000","last_became_active":"2024-06-04T16:09:26.624122+0000","last_became_peered":"2024-06-04T16:09:26.624122+0000","last_unstale":"2024-06-04T16:18:50.011048+0000","last_undegraded":"2024-06-04T16:18:50.011048+0000","last_fullsized":"2024-06-04T16:18:50.011048+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_clean_scrub_stamp":"2024-06-04T16:09:25.601105+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T21:22:14.386034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":17410,"num_write":17,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.12","version":"254'2","reported_seq":32,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:45.122305+0000","last_change":"2024-06-04T16:09:23.613003+0000","last_active":"2024-06-04T16:18:45.122305+0000","last_peered":"2024-06-04T16:18:45.122305+0000","last_clean":"2024-06-04T16:18:45.122305+0000","last_became_active":"2024-06-04T16:09:23.612699+0000","last_became_peered":"2024-06-04T16:09:23.612699+0000","last_unstale":"2024-06-04T16:18:45.122305+0000","last_undegraded":"2024-06-04T16:18:45.122305+0000","last_fullsized":"2024-06-04T16:18:45.122305+0000","mapping_epoch":246,"log_start":"0'0","ondisk_log_start":"0'0","created":246,"last_epoch_clean":247,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_clean_scrub_stamp":"2024-06-04T16:09:22.572686+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T22:44:45.643881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1051792,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":4,"num_write":2,"num_write_kb":1028,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"64.13","version":"254'35","reported_seq":138,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:50.010572+0000","last_change":"2024-06-04T16:07:09.511921+0000","last_active":"2024-06-04T16:18:50.010572+0000","last_peered":"2024-06-04T16:18:50.010572+0000","last_clean":"2024-06-04T16:18:50.010572+0000","last_became_active":"2024-06-04T16:07:09.511607+0000","last_became_peered":"2024-06-04T16:07:09.511607+0000","last_unstale":"2024-06-04T16:18:50.010572+0000","last_undegraded":"2024-06-04T16:18:50.010572+0000","last_fullsized":"2024-06-04T16:18:50.010572+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":243,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:07:08.374534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:07:08.374534+0000","last_clean_scrub_stamp":"2024-06-04T16:07:08.374534+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T21:14:21.163538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":198,"num_read_kb":144,"num_write":54,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.11","version":"0'0","reported_seq":14,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:30.008255+0000","last_change":"2024-06-04T16:16:08.649192+0000","last_active":"2024-06-04T16:18:30.008255+0000","last_peered":"2024-06-04T16:18:30.008255+0000","last_clean":"2024-06-04T16:18:30.008255+0000","last_became_active":"2024-06-04T16:16:08.648899+0000","last_became_peered":"2024-06-04T16:16:08.648899+0000","last_unstale":"2024-06-04T16:18:30.008255+0000","last_undegraded":"2024-06-04T16:18:30.008255+0000","last_fullsized":"2024-06-04T16:18:30.008255+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_clean_scrub_stamp":"2024-06-04T16:16:07.631263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T23:23:27.649414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.10","version":"254'1","reported_seq":25,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:50.115100+0000","last_change":"2024-06-04T16:09:26.628742+0000","last_active":"2024-06-04T16:18:50.115100+0000","last_peered":"2024-06-04T16:18:50.115100+0000","last_clean":"2024-06-04T16:18:50.115100+0000","last_became_active":"2024-06-04T16:09:26.628442+0000","last_became_peered":"2024-06-04T16:09:26.628442+0000","last_unstale":"2024-06-04T16:18:50.115100+0000","last_undegraded":"2024-06-04T16:18:50.115100+0000","last_fullsized":"2024-06-04T16:18:50.115100+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_clean_scrub_stamp":"2024-06-04T16:09:25.601105+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T00:52:10.655737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.13","version":"254'1","reported_seq":31,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:45.008399+0000","last_change":"2024-06-04T16:09:23.609979+0000","last_active":"2024-06-04T16:18:45.008399+0000","last_peered":"2024-06-04T16:18:45.008399+0000","last_clean":"2024-06-04T16:18:45.008399+0000","last_became_active":"2024-06-04T16:09:23.609536+0000","last_became_peered":"2024-06-04T16:09:23.609536+0000","last_unstale":"2024-06-04T16:18:45.008399+0000","last_undegraded":"2024-06-04T16:18:45.008399+0000","last_fullsized":"2024-06-04T16:18:45.008399+0000","mapping_epoch":246,"log_start":"0'0","ondisk_log_start":"0'0","created":246,"last_epoch_clean":247,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_clean_scrub_stamp":"2024-06-04T16:09:22.572686+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T16:56:59.952240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"64.12","version":"254'6","reported_seq":54,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:50.008991+0000","last_change":"2024-06-04T16:07:09.403628+0000","last_active":"2024-06-04T16:18:50.008991+0000","last_peered":"2024-06-04T16:18:50.008991+0000","last_clean":"2024-06-04T16:18:50.008991+0000","last_became_active":"2024-06-04T16:07:09.403352+0000","last_became_peered":"2024-06-04T16:07:09.403352+0000","last_unstale":"2024-06-04T16:18:50.008991+0000","last_undegraded":"2024-06-04T16:18:50.008991+0000","last_fullsized":"2024-06-04T16:18:50.008991+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":243,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:07:08.374534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:07:08.374534+0000","last_clean_scrub_stamp":"2024-06-04T16:07:08.374534+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T21:48:39.709806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":24,"num_write":11,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.12","version":"0'0","reported_seq":14,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:30.006539+0000","last_change":"2024-06-04T16:16:08.654940+0000","last_active":"2024-06-04T16:18:30.006539+0000","last_peered":"2024-06-04T16:18:30.006539+0000","last_clean":"2024-06-04T16:18:30.006539+0000","last_became_active":"2024-06-04T16:16:08.654624+0000","last_became_peered":"2024-06-04T16:16:08.654624+0000","last_unstale":"2024-06-04T16:18:30.006539+0000","last_undegraded":"2024-06-04T16:18:30.006539+0000","last_fullsized":"2024-06-04T16:18:30.006539+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_clean_scrub_stamp":"2024-06-04T16:16:07.631263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T02:28:30.956243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.13","version":"254'11","reported_seq":48,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:50.115216+0000","last_change":"2024-06-04T16:09:26.621968+0000","last_active":"2024-06-04T16:18:50.115216+0000","last_peered":"2024-06-04T16:18:50.115216+0000","last_clean":"2024-06-04T16:18:50.115216+0000","last_became_active":"2024-06-04T16:09:26.621494+0000","last_became_peered":"2024-06-04T16:09:26.621494+0000","last_unstale":"2024-06-04T16:18:50.115216+0000","last_undegraded":"2024-06-04T16:18:50.115216+0000","last_fullsized":"2024-06-04T16:18:50.115216+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_clean_scrub_stamp":"2024-06-04T16:09:25.601105+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T21:28:40.451250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":20,"num_read_kb":22532,"num_write":19,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.10","version":"254'6","reported_seq":42,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:45.122253+0000","last_change":"2024-06-04T16:09:23.606894+0000","last_active":"2024-06-04T16:18:45.122253+0000","last_peered":"2024-06-04T16:18:45.122253+0000","last_clean":"2024-06-04T16:18:45.122253+0000","last_became_active":"2024-06-04T16:09:23.606050+0000","last_became_peered":"2024-06-04T16:09:23.606050+0000","last_unstale":"2024-06-04T16:18:45.122253+0000","last_undegraded":"2024-06-04T16:18:45.122253+0000","last_fullsized":"2024-06-04T16:18:45.122253+0000","mapping_epoch":246,"log_start":"0'0","ondisk_log_start":"0'0","created":246,"last_epoch_clean":247,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_clean_scrub_stamp":"2024-06-04T16:09:22.572686+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T19:53:24.462326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":10,"num_read_kb":20482,"num_write":10,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"64.11","version":"251'138","reported_seq":475,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:50.008957+0000","last_change":"2024-06-04T16:07:09.511375+0000","last_active":"2024-06-04T16:18:50.008957+0000","last_peered":"2024-06-04T16:18:50.008957+0000","last_clean":"2024-06-04T16:18:50.008957+0000","last_became_active":"2024-06-04T16:07:09.511098+0000","last_became_peered":"2024-06-04T16:07:09.511098+0000","last_unstale":"2024-06-04T16:18:50.008957+0000","last_undegraded":"2024-06-04T16:18:50.008957+0000","last_fullsized":"2024-06-04T16:18:50.008957+0000","mapping_epoch":243,"log_start":"251'100","ondisk_log_start":"251'100","created":243,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:07:08.374534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:07:08.374534+0000","last_clean_scrub_stamp":"2024-06-04T16:07:08.374534+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T17:37:17.042544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":871,"num_read_kb":642,"num_write":155,"num_write_kb":133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.13","version":"254'1","reported_seq":15,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:30.119909+0000","last_change":"2024-06-04T16:16:08.657706+0000","last_active":"2024-06-04T16:18:30.119909+0000","last_peered":"2024-06-04T16:18:30.119909+0000","last_clean":"2024-06-04T16:18:30.119909+0000","last_became_active":"2024-06-04T16:16:08.657428+0000","last_became_peered":"2024-06-04T16:16:08.657428+0000","last_unstale":"2024-06-04T16:18:30.119909+0000","last_undegraded":"2024-06-04T16:18:30.119909+0000","last_fullsized":"2024-06-04T16:18:30.119909+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_clean_scrub_stamp":"2024-06-04T16:16:07.631263+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T19:11:05.041077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.12","version":"254'5","reported_seq":36,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:50.115184+0000","last_change":"2024-06-04T16:09:26.623554+0000","last_active":"2024-06-04T16:18:50.115184+0000","last_peered":"2024-06-04T16:18:50.115184+0000","last_clean":"2024-06-04T16:18:50.115184+0000","last_became_active":"2024-06-04T16:09:26.623285+0000","last_became_peered":"2024-06-04T16:09:26.623285+0000","last_unstale":"2024-06-04T16:18:50.115184+0000","last_undegraded":"2024-06-04T16:18:50.115184+0000","last_fullsized":"2024-06-04T16:18:50.115184+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_clean_scrub_stamp":"2024-06-04T16:09:25.601105+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T22:52:24.224426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":18434,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.11","version":"254'1","reported_seq":32,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:45.004661+0000","last_change":"2024-06-04T16:09:23.607360+0000","last_active":"2024-06-04T16:18:45.004661+0000","last_peered":"2024-06-04T16:18:45.004661+0000","last_clean":"2024-06-04T16:18:45.004661+0000","last_became_active":"2024-06-04T16:09:23.607048+0000","last_became_peered":"2024-06-04T16:09:23.607048+0000","last_unstale":"2024-06-04T16:18:45.004661+0000","last_undegraded":"2024-06-04T16:18:45.004661+0000","last_fullsized":"2024-06-04T16:18:45.004661+0000","mapping_epoch":246,"log_start":"0'0","ondisk_log_start":"0'0","created":246,"last_epoch_clean":247,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_clean_scrub_stamp":"2024-06-04T16:09:22.572686+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T03:05:27.726738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"64.10","version":"251'6","reported_seq":54,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:50.122936+0000","last_change":"2024-06-04T16:07:09.401888+0000","last_active":"2024-06-04T16:18:50.122936+0000","last_peered":"2024-06-04T16:18:50.122936+0000","last_clean":"2024-06-04T16:18:50.122936+0000","last_became_active":"2024-06-04T16:07:09.401445+0000","last_became_peered":"2024-06-04T16:07:09.401445+0000","last_unstale":"2024-06-04T16:18:50.122936+0000","last_undegraded":"2024-06-04T16:18:50.122936+0000","last_fullsized":"2024-06-04T16:18:50.122936+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":243,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:07:08.374534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:07:08.374534+0000","last_clean_scrub_stamp":"2024-06-04T16:07:08.374534+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T02:48:14.306445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":24,"num_write":11,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.c","version":"254'1","reported_seq":15,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:25.119153+0000","last_change":"2024-06-04T16:16:08.664755+0000","last_active":"2024-06-04T16:18:25.119153+0000","last_peered":"2024-06-04T16:18:25.119153+0000","last_clean":"2024-06-04T16:18:25.119153+0000","last_became_active":"2024-06-04T16:16:08.664436+0000","last_became_peered":"2024-06-04T16:16:08.664436+0000","last_unstale":"2024-06-04T16:18:25.119153+0000","last_undegraded":"2024-06-04T16:18:25.119153+0000","last_fullsized":"2024-06-04T16:18:25.119153+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_clean_scrub_stamp":"2024-06-04T16:16:07.631263+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T23:11:08.299853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.d","version":"251'2","reported_seq":27,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:30.007548+0000","last_change":"2024-06-04T16:09:26.624040+0000","last_active":"2024-06-04T16:18:30.007548+0000","last_peered":"2024-06-04T16:18:30.007548+0000","last_clean":"2024-06-04T16:18:30.007548+0000","last_became_active":"2024-06-04T16:09:26.622747+0000","last_became_peered":"2024-06-04T16:09:26.622747+0000","last_unstale":"2024-06-04T16:18:30.007548+0000","last_undegraded":"2024-06-04T16:18:30.007548+0000","last_fullsized":"2024-06-04T16:18:30.007548+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_clean_scrub_stamp":"2024-06-04T16:09:25.601105+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T19:09:01.319407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.e","version":"254'9","reported_seq":46,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:25.005981+0000","last_change":"2024-06-04T16:09:23.609139+0000","last_active":"2024-06-04T16:18:25.005981+0000","last_peered":"2024-06-04T16:18:25.005981+0000","last_clean":"2024-06-04T16:18:25.005981+0000","last_became_active":"2024-06-04T16:09:23.608866+0000","last_became_peered":"2024-06-04T16:09:23.608866+0000","last_unstale":"2024-06-04T16:18:25.005981+0000","last_undegraded":"2024-06-04T16:18:25.005981+0000","last_fullsized":"2024-06-04T16:18:25.005981+0000","mapping_epoch":246,"log_start":"0'0","ondisk_log_start":"0'0","created":246,"last_epoch_clean":247,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_clean_scrub_stamp":"2024-06-04T16:09:22.572686+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T21:04:44.000874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":12,"num_read_kb":5122,"num_write":18,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"64.f","version":"251'6","reported_seq":51,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:25.112386+0000","last_change":"2024-06-04T16:07:09.401084+0000","last_active":"2024-06-04T16:18:25.112386+0000","last_peered":"2024-06-04T16:18:25.112386+0000","last_clean":"2024-06-04T16:18:25.112386+0000","last_became_active":"2024-06-04T16:07:09.400807+0000","last_became_peered":"2024-06-04T16:07:09.400807+0000","last_unstale":"2024-06-04T16:18:25.112386+0000","last_undegraded":"2024-06-04T16:18:25.112386+0000","last_fullsized":"2024-06-04T16:18:25.112386+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":243,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:07:08.374534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:07:08.374534+0000","last_clean_scrub_stamp":"2024-06-04T16:07:08.374534+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T19:24:05.530820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":19,"num_write":12,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.d","version":"0'0","reported_seq":14,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:25.119174+0000","last_change":"2024-06-04T16:16:08.657069+0000","last_active":"2024-06-04T16:18:25.119174+0000","last_peered":"2024-06-04T16:18:25.119174+0000","last_clean":"2024-06-04T16:18:25.119174+0000","last_became_active":"2024-06-04T16:16:08.656726+0000","last_became_peered":"2024-06-04T16:16:08.656726+0000","last_unstale":"2024-06-04T16:18:25.119174+0000","last_undegraded":"2024-06-04T16:18:25.119174+0000","last_fullsized":"2024-06-04T16:18:25.119174+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_clean_scrub_stamp":"2024-06-04T16:16:07.631263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T18:03:32.263500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.c","version":"254'2","reported_seq":27,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:30.003009+0000","last_change":"2024-06-04T16:09:26.628320+0000","last_active":"2024-06-04T16:18:30.003009+0000","last_peered":"2024-06-04T16:18:30.003009+0000","last_clean":"2024-06-04T16:18:30.003009+0000","last_became_active":"2024-06-04T16:09:26.627994+0000","last_became_peered":"2024-06-04T16:09:26.627994+0000","last_unstale":"2024-06-04T16:18:30.003009+0000","last_undegraded":"2024-06-04T16:18:30.003009+0000","last_fullsized":"2024-06-04T16:18:30.003009+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_clean_scrub_stamp":"2024-06-04T16:09:25.601105+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T00:37:41.828886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":7,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.f","version":"254'1","reported_seq":32,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:25.119238+0000","last_change":"2024-06-04T16:09:23.609586+0000","last_active":"2024-06-04T16:18:25.119238+0000","last_peered":"2024-06-04T16:18:25.119238+0000","last_clean":"2024-06-04T16:18:25.119238+0000","last_became_active":"2024-06-04T16:09:23.609283+0000","last_became_peered":"2024-06-04T16:09:23.609283+0000","last_unstale":"2024-06-04T16:18:25.119238+0000","last_undegraded":"2024-06-04T16:18:25.119238+0000","last_fullsized":"2024-06-04T16:18:25.119238+0000","mapping_epoch":246,"log_start":"0'0","ondisk_log_start":"0'0","created":246,"last_epoch_clean":247,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_clean_scrub_stamp":"2024-06-04T16:09:22.572686+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T19:30:03.495311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2048,"num_write":1,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"64.e","version":"254'20","reported_seq":93,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:25.005990+0000","last_change":"2024-06-04T16:07:09.401774+0000","last_active":"2024-06-04T16:18:25.005990+0000","last_peered":"2024-06-04T16:18:25.005990+0000","last_clean":"2024-06-04T16:18:25.005990+0000","last_became_active":"2024-06-04T16:07:09.401515+0000","last_became_peered":"2024-06-04T16:07:09.401515+0000","last_unstale":"2024-06-04T16:18:25.005990+0000","last_undegraded":"2024-06-04T16:18:25.005990+0000","last_fullsized":"2024-06-04T16:18:25.005990+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":243,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:07:08.374534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:07:08.374534+0000","last_clean_scrub_stamp":"2024-06-04T16:07:08.374534+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T00:16:43.451325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":108,"num_read_kb":75,"num_write":37,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.e","version":"0'0","reported_seq":14,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:25.007601+0000","last_change":"2024-06-04T16:16:08.657545+0000","last_active":"2024-06-04T16:18:25.007601+0000","last_peered":"2024-06-04T16:18:25.007601+0000","last_clean":"2024-06-04T16:18:25.007601+0000","last_became_active":"2024-06-04T16:16:08.657279+0000","last_became_peered":"2024-06-04T16:16:08.657279+0000","last_unstale":"2024-06-04T16:18:25.007601+0000","last_undegraded":"2024-06-04T16:18:25.007601+0000","last_fullsized":"2024-06-04T16:18:25.007601+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_clean_scrub_stamp":"2024-06-04T16:16:07.631263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T23:08:35.507441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.f","version":"254'8","reported_seq":42,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:30.119984+0000","last_change":"2024-06-04T16:09:26.623833+0000","last_active":"2024-06-04T16:18:30.119984+0000","last_peered":"2024-06-04T16:18:30.119984+0000","last_clean":"2024-06-04T16:18:30.119984+0000","last_became_active":"2024-06-04T16:09:26.623307+0000","last_became_peered":"2024-06-04T16:09:26.623307+0000","last_unstale":"2024-06-04T16:18:30.119984+0000","last_undegraded":"2024-06-04T16:18:30.119984+0000","last_fullsized":"2024-06-04T16:18:30.119984+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_clean_scrub_stamp":"2024-06-04T16:09:25.601105+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T23:15:04.575909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2097152,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":15,"num_read_kb":8194,"num_write":12,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.c","version":"254'4","reported_seq":35,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:25.006838+0000","last_change":"2024-06-04T16:09:23.612714+0000","last_active":"2024-06-04T16:18:25.006838+0000","last_peered":"2024-06-04T16:18:25.006838+0000","last_clean":"2024-06-04T16:18:25.006838+0000","last_became_active":"2024-06-04T16:09:23.612445+0000","last_became_peered":"2024-06-04T16:09:23.612445+0000","last_unstale":"2024-06-04T16:18:25.006838+0000","last_undegraded":"2024-06-04T16:18:25.006838+0000","last_fullsized":"2024-06-04T16:18:25.006838+0000","mapping_epoch":246,"log_start":"0'0","ondisk_log_start":"0'0","created":246,"last_epoch_clean":247,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_clean_scrub_stamp":"2024-06-04T16:09:22.572686+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T19:29:18.909595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":9,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"64.d","version":"251'24","reported_seq":105,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:25.005958+0000","last_change":"2024-06-04T16:07:09.511802+0000","last_active":"2024-06-04T16:18:25.005958+0000","last_peered":"2024-06-04T16:18:25.005958+0000","last_clean":"2024-06-04T16:18:25.005958+0000","last_became_active":"2024-06-04T16:07:09.511172+0000","last_became_peered":"2024-06-04T16:07:09.511172+0000","last_unstale":"2024-06-04T16:18:25.005958+0000","last_undegraded":"2024-06-04T16:18:25.005958+0000","last_fullsized":"2024-06-04T16:18:25.005958+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":243,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:07:08.374534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:07:08.374534+0000","last_clean_scrub_stamp":"2024-06-04T16:07:08.374534+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T20:08:28.763067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":134,"num_read_kb":91,"num_write":39,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.f","version":"0'0","reported_seq":14,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:25.119219+0000","last_change":"2024-06-04T16:16:08.662500+0000","last_active":"2024-06-04T16:18:25.119219+0000","last_peered":"2024-06-04T16:18:25.119219+0000","last_clean":"2024-06-04T16:18:25.119219+0000","last_became_active":"2024-06-04T16:16:08.662182+0000","last_became_peered":"2024-06-04T16:16:08.662182+0000","last_unstale":"2024-06-04T16:18:25.119219+0000","last_undegraded":"2024-06-04T16:18:25.119219+0000","last_fullsized":"2024-06-04T16:18:25.119219+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_clean_scrub_stamp":"2024-06-04T16:16:07.631263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T00:09:54.410059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.e","version":"0'0","reported_seq":23,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:30.119962+0000","last_change":"2024-06-04T16:09:26.629323+0000","last_active":"2024-06-04T16:18:30.119962+0000","last_peered":"2024-06-04T16:18:30.119962+0000","last_clean":"2024-06-04T16:18:30.119962+0000","last_became_active":"2024-06-04T16:09:26.629039+0000","last_became_peered":"2024-06-04T16:09:26.629039+0000","last_unstale":"2024-06-04T16:18:30.119962+0000","last_undegraded":"2024-06-04T16:18:30.119962+0000","last_fullsized":"2024-06-04T16:18:30.119962+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_clean_scrub_stamp":"2024-06-04T16:09:25.601105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T17:17:10.026858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.d","version":"254'5","reported_seq":40,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:25.112362+0000","last_change":"2024-06-04T16:09:23.607472+0000","last_active":"2024-06-04T16:18:25.112362+0000","last_peered":"2024-06-04T16:18:25.112362+0000","last_clean":"2024-06-04T16:18:25.112362+0000","last_became_active":"2024-06-04T16:09:23.606695+0000","last_became_peered":"2024-06-04T16:09:23.606695+0000","last_unstale":"2024-06-04T16:18:25.112362+0000","last_undegraded":"2024-06-04T16:18:25.112362+0000","last_fullsized":"2024-06-04T16:18:25.112362+0000","mapping_epoch":246,"log_start":"0'0","ondisk_log_start":"0'0","created":246,"last_epoch_clean":247,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_clean_scrub_stamp":"2024-06-04T16:09:22.572686+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T03:00:34.921184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":20480,"num_write":10,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"64.c","version":"251'31","reported_seq":123,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:25.002486+0000","last_change":"2024-06-04T16:07:09.511067+0000","last_active":"2024-06-04T16:18:25.002486+0000","last_peered":"2024-06-04T16:18:25.002486+0000","last_clean":"2024-06-04T16:18:25.002486+0000","last_became_active":"2024-06-04T16:07:09.510728+0000","last_became_peered":"2024-06-04T16:07:09.510728+0000","last_unstale":"2024-06-04T16:18:25.002486+0000","last_undegraded":"2024-06-04T16:18:25.002486+0000","last_fullsized":"2024-06-04T16:18:25.002486+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":243,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:07:08.374534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:07:08.374534+0000","last_clean_scrub_stamp":"2024-06-04T16:07:08.374534+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T19:07:33.768205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":168,"num_read_kb":120,"num_write":55,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.8","version":"0'0","reported_seq":14,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:20.001791+0000","last_change":"2024-06-04T16:16:08.664471+0000","last_active":"2024-06-04T16:18:20.001791+0000","last_peered":"2024-06-04T16:18:20.001791+0000","last_clean":"2024-06-04T16:18:20.001791+0000","last_became_active":"2024-06-04T16:16:08.664198+0000","last_became_peered":"2024-06-04T16:16:08.664198+0000","last_unstale":"2024-06-04T16:18:20.001791+0000","last_undegraded":"2024-06-04T16:18:20.001791+0000","last_fullsized":"2024-06-04T16:18:20.001791+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_clean_scrub_stamp":"2024-06-04T16:16:07.631263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T22:21:33.139848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.9","version":"254'4","reported_seq":33,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:20:20.023588+0000","last_change":"2024-06-04T16:09:26.626757+0000","last_active":"2024-06-04T16:20:20.023588+0000","last_peered":"2024-06-04T16:20:20.023588+0000","last_clean":"2024-06-04T16:20:20.023588+0000","last_became_active":"2024-06-04T16:09:26.625999+0000","last_became_peered":"2024-06-04T16:09:26.625999+0000","last_unstale":"2024-06-04T16:20:20.023588+0000","last_undegraded":"2024-06-04T16:20:20.023588+0000","last_fullsized":"2024-06-04T16:20:20.023588+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_clean_scrub_stamp":"2024-06-04T16:09:25.601105+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T19:40:29.538335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":9216,"num_write":4,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.a","version":"254'2","reported_seq":32,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:20:15.013716+0000","last_change":"2024-06-04T16:09:23.601101+0000","last_active":"2024-06-04T16:20:15.013716+0000","last_peered":"2024-06-04T16:20:15.013716+0000","last_clean":"2024-06-04T16:20:15.013716+0000","last_became_active":"2024-06-04T16:09:23.600752+0000","last_became_peered":"2024-06-04T16:09:23.600752+0000","last_unstale":"2024-06-04T16:20:15.013716+0000","last_undegraded":"2024-06-04T16:20:15.013716+0000","last_fullsized":"2024-06-04T16:20:15.013716+0000","mapping_epoch":246,"log_start":"0'0","ondisk_log_start":"0'0","created":246,"last_epoch_clean":247,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_clean_scrub_stamp":"2024-06-04T16:09:22.572686+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T17:03:48.692088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"64.b","version":"251'21","reported_seq":96,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:25.119108+0000","last_change":"2024-06-04T16:07:09.513384+0000","last_active":"2024-06-04T16:18:25.119108+0000","last_peered":"2024-06-04T16:18:25.119108+0000","last_clean":"2024-06-04T16:18:25.119108+0000","last_became_active":"2024-06-04T16:07:09.513020+0000","last_became_peered":"2024-06-04T16:07:09.513020+0000","last_unstale":"2024-06-04T16:18:25.119108+0000","last_undegraded":"2024-06-04T16:18:25.119108+0000","last_fullsized":"2024-06-04T16:18:25.119108+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":243,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:07:08.374534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:07:08.374534+0000","last_clean_scrub_stamp":"2024-06-04T16:07:08.374534+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T17:46:59.707579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":114,"num_read_kb":81,"num_write":38,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.9","version":"0'0","reported_seq":14,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:20.005249+0000","last_change":"2024-06-04T16:16:08.658344+0000","last_active":"2024-06-04T16:18:20.005249+0000","last_peered":"2024-06-04T16:18:20.005249+0000","last_clean":"2024-06-04T16:18:20.005249+0000","last_became_active":"2024-06-04T16:16:08.658076+0000","last_became_peered":"2024-06-04T16:16:08.658076+0000","last_unstale":"2024-06-04T16:18:20.005249+0000","last_undegraded":"2024-06-04T16:18:20.005249+0000","last_fullsized":"2024-06-04T16:18:20.005249+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_clean_scrub_stamp":"2024-06-04T16:16:07.631263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T17:29:18.849209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.8","version":"254'4","reported_seq":29,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:20:20.135632+0000","last_change":"2024-06-04T16:09:26.624229+0000","last_active":"2024-06-04T16:20:20.135632+0000","last_peered":"2024-06-04T16:20:20.135632+0000","last_clean":"2024-06-04T16:20:20.135632+0000","last_became_active":"2024-06-04T16:09:26.623966+0000","last_became_peered":"2024-06-04T16:09:26.623966+0000","last_unstale":"2024-06-04T16:20:20.135632+0000","last_undegraded":"2024-06-04T16:20:20.135632+0000","last_fullsized":"2024-06-04T16:20:20.135632+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_clean_scrub_stamp":"2024-06-04T16:09:25.601105+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T21:11:02.568495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":9,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.b","version":"254'2","reported_seq":33,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:25.006805+0000","last_change":"2024-06-04T16:09:23.613436+0000","last_active":"2024-06-04T16:18:25.006805+0000","last_peered":"2024-06-04T16:18:25.006805+0000","last_clean":"2024-06-04T16:18:25.006805+0000","last_became_active":"2024-06-04T16:09:23.613130+0000","last_became_peered":"2024-06-04T16:09:23.613130+0000","last_unstale":"2024-06-04T16:18:25.006805+0000","last_undegraded":"2024-06-04T16:18:25.006805+0000","last_fullsized":"2024-06-04T16:18:25.006805+0000","mapping_epoch":246,"log_start":"0'0","ondisk_log_start":"0'0","created":246,"last_epoch_clean":247,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_clean_scrub_stamp":"2024-06-04T16:09:22.572686+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T19:22:58.043042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3865073,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":3775,"num_write":2,"num_write_kb":3775,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"64.a","version":"251'22","reported_seq":100,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:20:15.022440+0000","last_change":"2024-06-04T16:07:09.404274+0000","last_active":"2024-06-04T16:20:15.022440+0000","last_peered":"2024-06-04T16:20:15.022440+0000","last_clean":"2024-06-04T16:20:15.022440+0000","last_became_active":"2024-06-04T16:07:09.403980+0000","last_became_peered":"2024-06-04T16:07:09.403980+0000","last_unstale":"2024-06-04T16:20:15.022440+0000","last_undegraded":"2024-06-04T16:20:15.022440+0000","last_fullsized":"2024-06-04T16:20:15.022440+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":243,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:07:08.374534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:07:08.374534+0000","last_clean_scrub_stamp":"2024-06-04T16:07:08.374534+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T01:30:42.556639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":122,"num_read_kb":87,"num_write":38,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.a","version":"0'0","reported_seq":14,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:20.001694+0000","last_change":"2024-06-04T16:16:08.661712+0000","last_active":"2024-06-04T16:18:20.001694+0000","last_peered":"2024-06-04T16:18:20.001694+0000","last_clean":"2024-06-04T16:18:20.001694+0000","last_became_active":"2024-06-04T16:16:08.661413+0000","last_became_peered":"2024-06-04T16:16:08.661413+0000","last_unstale":"2024-06-04T16:18:20.001694+0000","last_undegraded":"2024-06-04T16:18:20.001694+0000","last_fullsized":"2024-06-04T16:18:20.001694+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_clean_scrub_stamp":"2024-06-04T16:16:07.631263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T20:52:36.472473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.b","version":"254'3","reported_seq":30,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:30.006581+0000","last_change":"2024-06-04T16:09:26.622990+0000","last_active":"2024-06-04T16:18:30.006581+0000","last_peered":"2024-06-04T16:18:30.006581+0000","last_clean":"2024-06-04T16:18:30.006581+0000","last_became_active":"2024-06-04T16:09:26.622600+0000","last_became_peered":"2024-06-04T16:09:26.622600+0000","last_unstale":"2024-06-04T16:18:30.006581+0000","last_undegraded":"2024-06-04T16:18:30.006581+0000","last_fullsized":"2024-06-04T16:18:30.006581+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_clean_scrub_stamp":"2024-06-04T16:09:25.601105+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T17:25:05.424763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3216,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":1032,"num_write":3,"num_write_kb":1028,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.8","version":"251'2","reported_seq":34,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:20:15.013108+0000","last_change":"2024-06-04T16:09:23.610808+0000","last_active":"2024-06-04T16:20:15.013108+0000","last_peered":"2024-06-04T16:20:15.013108+0000","last_clean":"2024-06-04T16:20:15.013108+0000","last_became_active":"2024-06-04T16:09:23.610525+0000","last_became_peered":"2024-06-04T16:09:23.610525+0000","last_unstale":"2024-06-04T16:20:15.013108+0000","last_undegraded":"2024-06-04T16:20:15.013108+0000","last_fullsized":"2024-06-04T16:20:15.013108+0000","mapping_epoch":246,"log_start":"0'0","ondisk_log_start":"0'0","created":246,"last_epoch_clean":247,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_clean_scrub_stamp":"2024-06-04T16:09:22.572686+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T16:29:28.622251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"64.9","version":"251'14","reported_seq":79,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:20:10.022040+0000","last_change":"2024-06-04T16:07:09.403769+0000","last_active":"2024-06-04T16:20:10.022040+0000","last_peered":"2024-06-04T16:20:10.022040+0000","last_clean":"2024-06-04T16:20:10.022040+0000","last_became_active":"2024-06-04T16:07:09.403227+0000","last_became_peered":"2024-06-04T16:07:09.403227+0000","last_unstale":"2024-06-04T16:20:10.022040+0000","last_undegraded":"2024-06-04T16:20:10.022040+0000","last_fullsized":"2024-06-04T16:20:10.022040+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":243,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:07:08.374534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:07:08.374534+0000","last_clean_scrub_stamp":"2024-06-04T16:07:08.374534+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T18:26:06.974591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":56,"num_write":27,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.b","version":"0'0","reported_seq":14,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:25.006788+0000","last_change":"2024-06-04T16:16:08.660998+0000","last_active":"2024-06-04T16:18:25.006788+0000","last_peered":"2024-06-04T16:18:25.006788+0000","last_clean":"2024-06-04T16:18:25.006788+0000","last_became_active":"2024-06-04T16:16:08.660717+0000","last_became_peered":"2024-06-04T16:16:08.660717+0000","last_unstale":"2024-06-04T16:18:25.006788+0000","last_undegraded":"2024-06-04T16:18:25.006788+0000","last_fullsized":"2024-06-04T16:18:25.006788+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_clean_scrub_stamp":"2024-06-04T16:16:07.631263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T03:13:46.348557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.a","version":"254'1","reported_seq":27,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:20:20.135674+0000","last_change":"2024-06-04T16:09:26.620380+0000","last_active":"2024-06-04T16:20:20.135674+0000","last_peered":"2024-06-04T16:20:20.135674+0000","last_clean":"2024-06-04T16:20:20.135674+0000","last_became_active":"2024-06-04T16:09:26.620119+0000","last_became_peered":"2024-06-04T16:09:26.620119+0000","last_unstale":"2024-06-04T16:20:20.135674+0000","last_undegraded":"2024-06-04T16:20:20.135674+0000","last_fullsized":"2024-06-04T16:20:20.135674+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_clean_scrub_stamp":"2024-06-04T16:09:25.601105+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T18:51:09.607155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.9","version":"251'5","reported_seq":41,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:20:15.022798+0000","last_change":"2024-06-04T16:09:23.607975+0000","last_active":"2024-06-04T16:20:15.022798+0000","last_peered":"2024-06-04T16:20:15.022798+0000","last_clean":"2024-06-04T16:20:15.022798+0000","last_became_active":"2024-06-04T16:09:23.607666+0000","last_became_peered":"2024-06-04T16:09:23.607666+0000","last_unstale":"2024-06-04T16:20:15.022798+0000","last_undegraded":"2024-06-04T16:20:15.022798+0000","last_fullsized":"2024-06-04T16:20:15.022798+0000","mapping_epoch":246,"log_start":"0'0","ondisk_log_start":"0'0","created":246,"last_epoch_clean":247,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_clean_scrub_stamp":"2024-06-04T16:09:22.572686+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T16:30:58.550630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":16386,"num_write":9,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"64.8","version":"251'8","reported_seq":61,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:20:10.017783+0000","last_change":"2024-06-04T16:07:09.405213+0000","last_active":"2024-06-04T16:20:10.017783+0000","last_peered":"2024-06-04T16:20:10.017783+0000","last_clean":"2024-06-04T16:20:10.017783+0000","last_became_active":"2024-06-04T16:07:09.404928+0000","last_became_peered":"2024-06-04T16:07:09.404928+0000","last_unstale":"2024-06-04T16:20:10.017783+0000","last_undegraded":"2024-06-04T16:20:10.017783+0000","last_fullsized":"2024-06-04T16:20:10.017783+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":243,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:07:08.374534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:07:08.374534+0000","last_clean_scrub_stamp":"2024-06-04T16:07:08.374534+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T19:53:15.255308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":32,"num_write":14,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.4","version":"0'0","reported_seq":15,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:20:20.023650+0000","last_change":"2024-06-04T16:16:08.663046+0000","last_active":"2024-06-04T16:20:20.023650+0000","last_peered":"2024-06-04T16:20:20.023650+0000","last_clean":"2024-06-04T16:20:20.023650+0000","last_became_active":"2024-06-04T16:16:08.662732+0000","last_became_peered":"2024-06-04T16:16:08.662732+0000","last_unstale":"2024-06-04T16:20:20.023650+0000","last_undegraded":"2024-06-04T16:20:20.023650+0000","last_fullsized":"2024-06-04T16:20:20.023650+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_clean_scrub_stamp":"2024-06-04T16:16:07.631263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T19:10:09.410318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.5","version":"254'1","reported_seq":26,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:55.019474+0000","last_change":"2024-06-04T16:09:26.624497+0000","last_active":"2024-06-04T16:19:55.019474+0000","last_peered":"2024-06-04T16:19:55.019474+0000","last_clean":"2024-06-04T16:19:55.019474+0000","last_became_active":"2024-06-04T16:09:26.624142+0000","last_became_peered":"2024-06-04T16:09:26.624142+0000","last_unstale":"2024-06-04T16:19:55.019474+0000","last_undegraded":"2024-06-04T16:19:55.019474+0000","last_fullsized":"2024-06-04T16:19:55.019474+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_clean_scrub_stamp":"2024-06-04T16:09:25.601105+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T18:17:49.470708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.6","version":"254'2","reported_seq":34,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:20:15.018492+0000","last_change":"2024-06-04T16:09:23.608725+0000","last_active":"2024-06-04T16:20:15.018492+0000","last_peered":"2024-06-04T16:20:15.018492+0000","last_clean":"2024-06-04T16:20:15.018492+0000","last_became_active":"2024-06-04T16:09:23.608300+0000","last_became_peered":"2024-06-04T16:09:23.608300+0000","last_unstale":"2024-06-04T16:20:15.018492+0000","last_undegraded":"2024-06-04T16:20:15.018492+0000","last_fullsized":"2024-06-04T16:20:15.018492+0000","mapping_epoch":246,"log_start":"0'0","ondisk_log_start":"0'0","created":246,"last_epoch_clean":247,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_clean_scrub_stamp":"2024-06-04T16:09:22.572686+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T23:47:46.805128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":7,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"64.7","version":"251'16","reported_seq":79,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:20:10.022130+0000","last_change":"2024-06-04T16:07:09.511741+0000","last_active":"2024-06-04T16:20:10.022130+0000","last_peered":"2024-06-04T16:20:10.022130+0000","last_clean":"2024-06-04T16:20:10.022130+0000","last_became_active":"2024-06-04T16:07:09.511421+0000","last_became_peered":"2024-06-04T16:07:09.511421+0000","last_unstale":"2024-06-04T16:20:10.022130+0000","last_undegraded":"2024-06-04T16:20:10.022130+0000","last_fullsized":"2024-06-04T16:20:10.022130+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":243,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:07:08.374534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:07:08.374534+0000","last_clean_scrub_stamp":"2024-06-04T16:07:08.374534+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T20:29:49.254010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":56,"num_write":28,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.5","version":"0'0","reported_seq":15,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:20:20.023672+0000","last_change":"2024-06-04T16:16:08.656242+0000","last_active":"2024-06-04T16:20:20.023672+0000","last_peered":"2024-06-04T16:20:20.023672+0000","last_clean":"2024-06-04T16:20:20.023672+0000","last_became_active":"2024-06-04T16:16:08.655913+0000","last_became_peered":"2024-06-04T16:16:08.655913+0000","last_unstale":"2024-06-04T16:20:20.023672+0000","last_undegraded":"2024-06-04T16:20:20.023672+0000","last_fullsized":"2024-06-04T16:20:20.023672+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_clean_scrub_stamp":"2024-06-04T16:16:07.631263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T02:48:49.714670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.4","version":"254'1","reported_seq":26,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:55.016222+0000","last_change":"2024-06-04T16:09:26.628240+0000","last_active":"2024-06-04T16:19:55.016222+0000","last_peered":"2024-06-04T16:19:55.016222+0000","last_clean":"2024-06-04T16:19:55.016222+0000","last_became_active":"2024-06-04T16:09:26.627915+0000","last_became_peered":"2024-06-04T16:09:26.627915+0000","last_unstale":"2024-06-04T16:19:55.016222+0000","last_undegraded":"2024-06-04T16:19:55.016222+0000","last_fullsized":"2024-06-04T16:19:55.016222+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_clean_scrub_stamp":"2024-06-04T16:09:25.601105+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T18:57:07.829231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1024,"num_write":1,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.7","version":"251'3","reported_seq":35,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:20:15.022566+0000","last_change":"2024-06-04T16:09:23.607332+0000","last_active":"2024-06-04T16:20:15.022566+0000","last_peered":"2024-06-04T16:20:15.022566+0000","last_clean":"2024-06-04T16:20:15.022566+0000","last_became_active":"2024-06-04T16:09:23.605516+0000","last_became_peered":"2024-06-04T16:09:23.605516+0000","last_unstale":"2024-06-04T16:20:15.022566+0000","last_undegraded":"2024-06-04T16:20:15.022566+0000","last_fullsized":"2024-06-04T16:20:15.022566+0000","mapping_epoch":246,"log_start":"0'0","ondisk_log_start":"0'0","created":246,"last_epoch_clean":247,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_clean_scrub_stamp":"2024-06-04T16:09:22.572686+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T18:35:30.226341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"64.6","version":"251'12","reported_seq":67,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:20:10.012671+0000","last_change":"2024-06-04T16:07:09.398080+0000","last_active":"2024-06-04T16:20:10.012671+0000","last_peered":"2024-06-04T16:20:10.012671+0000","last_clean":"2024-06-04T16:20:10.012671+0000","last_became_active":"2024-06-04T16:07:09.397805+0000","last_became_peered":"2024-06-04T16:07:09.397805+0000","last_unstale":"2024-06-04T16:20:10.012671+0000","last_undegraded":"2024-06-04T16:20:10.012671+0000","last_fullsized":"2024-06-04T16:20:10.012671+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":243,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:07:08.374534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:07:08.374534+0000","last_clean_scrub_stamp":"2024-06-04T16:07:08.374534+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T23:55:55.603697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":38,"num_write":27,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.6","version":"253'1","reported_seq":15,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:20.005356+0000","last_change":"2024-06-04T16:16:08.656516+0000","last_active":"2024-06-04T16:18:20.005356+0000","last_peered":"2024-06-04T16:18:20.005356+0000","last_clean":"2024-06-04T16:18:20.005356+0000","last_became_active":"2024-06-04T16:16:08.656182+0000","last_became_peered":"2024-06-04T16:16:08.656182+0000","last_unstale":"2024-06-04T16:18:20.005356+0000","last_undegraded":"2024-06-04T16:18:20.005356+0000","last_fullsized":"2024-06-04T16:18:20.005356+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_clean_scrub_stamp":"2024-06-04T16:16:07.631263+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T22:01:48.464700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.7","version":"0'0","reported_seq":24,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:20:20.019052+0000","last_change":"2024-06-04T16:09:26.626653+0000","last_active":"2024-06-04T16:20:20.019052+0000","last_peered":"2024-06-04T16:20:20.019052+0000","last_clean":"2024-06-04T16:20:20.019052+0000","last_became_active":"2024-06-04T16:09:26.625833+0000","last_became_peered":"2024-06-04T16:09:26.625833+0000","last_unstale":"2024-06-04T16:20:20.019052+0000","last_undegraded":"2024-06-04T16:20:20.019052+0000","last_fullsized":"2024-06-04T16:20:20.019052+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_clean_scrub_stamp":"2024-06-04T16:09:25.601105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T21:55:58.166045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.4","version":"0'0","reported_seq":30,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:50.131381+0000","last_change":"2024-06-04T16:09:23.607166+0000","last_active":"2024-06-04T16:19:50.131381+0000","last_peered":"2024-06-04T16:19:50.131381+0000","last_clean":"2024-06-04T16:19:50.131381+0000","last_became_active":"2024-06-04T16:09:23.606669+0000","last_became_peered":"2024-06-04T16:09:23.606669+0000","last_unstale":"2024-06-04T16:19:50.131381+0000","last_undegraded":"2024-06-04T16:19:50.131381+0000","last_fullsized":"2024-06-04T16:19:50.131381+0000","mapping_epoch":246,"log_start":"0'0","ondisk_log_start":"0'0","created":246,"last_epoch_clean":247,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_clean_scrub_stamp":"2024-06-04T16:09:22.572686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T03:58:28.100517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"64.5","version":"254'31","reported_seq":127,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:40.120414+0000","last_change":"2024-06-04T16:07:09.404140+0000","last_active":"2024-06-04T16:19:40.120414+0000","last_peered":"2024-06-04T16:19:40.120414+0000","last_clean":"2024-06-04T16:19:40.120414+0000","last_became_active":"2024-06-04T16:07:09.403868+0000","last_became_peered":"2024-06-04T16:07:09.403868+0000","last_unstale":"2024-06-04T16:19:40.120414+0000","last_undegraded":"2024-06-04T16:19:40.120414+0000","last_fullsized":"2024-06-04T16:19:40.120414+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":243,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:07:08.374534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:07:08.374534+0000","last_clean_scrub_stamp":"2024-06-04T16:07:08.374534+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T19:30:33.830947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":170,"num_read_kb":120,"num_write":66,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.7","version":"0'0","reported_seq":14,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:20.001746+0000","last_change":"2024-06-04T16:16:08.661700+0000","last_active":"2024-06-04T16:18:20.001746+0000","last_peered":"2024-06-04T16:18:20.001746+0000","last_clean":"2024-06-04T16:18:20.001746+0000","last_became_active":"2024-06-04T16:16:08.661379+0000","last_became_peered":"2024-06-04T16:16:08.661379+0000","last_unstale":"2024-06-04T16:18:20.001746+0000","last_undegraded":"2024-06-04T16:18:20.001746+0000","last_fullsized":"2024-06-04T16:18:20.001746+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_clean_scrub_stamp":"2024-06-04T16:16:07.631263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T18:30:12.285218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.6","version":"0'0","reported_seq":24,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:20:20.014285+0000","last_change":"2024-06-04T16:09:26.624438+0000","last_active":"2024-06-04T16:20:20.014285+0000","last_peered":"2024-06-04T16:20:20.014285+0000","last_clean":"2024-06-04T16:20:20.014285+0000","last_became_active":"2024-06-04T16:09:26.624074+0000","last_became_peered":"2024-06-04T16:09:26.624074+0000","last_unstale":"2024-06-04T16:20:20.014285+0000","last_undegraded":"2024-06-04T16:20:20.014285+0000","last_fullsized":"2024-06-04T16:20:20.014285+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_clean_scrub_stamp":"2024-06-04T16:09:25.601105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T21:01:18.041771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.5","version":"254'3","reported_seq":35,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:50.011288+0000","last_change":"2024-06-04T16:09:23.604554+0000","last_active":"2024-06-04T16:19:50.011288+0000","last_peered":"2024-06-04T16:19:50.011288+0000","last_clean":"2024-06-04T16:19:50.011288+0000","last_became_active":"2024-06-04T16:09:23.604255+0000","last_became_peered":"2024-06-04T16:09:23.604255+0000","last_unstale":"2024-06-04T16:19:50.011288+0000","last_undegraded":"2024-06-04T16:19:50.011288+0000","last_fullsized":"2024-06-04T16:19:50.011288+0000","mapping_epoch":246,"log_start":"0'0","ondisk_log_start":"0'0","created":246,"last_epoch_clean":247,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_clean_scrub_stamp":"2024-06-04T16:09:22.572686+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T19:47:14.640534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":3,"num_write_kb":1026,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"64.4","version":"254'14","reported_seq":76,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:40.009620+0000","last_change":"2024-06-04T16:07:09.397501+0000","last_active":"2024-06-04T16:19:40.009620+0000","last_peered":"2024-06-04T16:19:40.009620+0000","last_clean":"2024-06-04T16:19:40.009620+0000","last_became_active":"2024-06-04T16:07:09.396484+0000","last_became_peered":"2024-06-04T16:07:09.396484+0000","last_unstale":"2024-06-04T16:19:40.009620+0000","last_undegraded":"2024-06-04T16:19:40.009620+0000","last_fullsized":"2024-06-04T16:19:40.009620+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":243,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:07:08.374534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:07:08.374534+0000","last_clean_scrub_stamp":"2024-06-04T16:07:08.374534+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T16:59:32.871360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":52,"num_write":27,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.0","version":"0'0","reported_seq":15,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:20:10.017765+0000","last_change":"2024-06-04T16:16:08.661272+0000","last_active":"2024-06-04T16:20:10.017765+0000","last_peered":"2024-06-04T16:20:10.017765+0000","last_clean":"2024-06-04T16:20:10.017765+0000","last_became_active":"2024-06-04T16:16:08.660893+0000","last_became_peered":"2024-06-04T16:16:08.660893+0000","last_unstale":"2024-06-04T16:20:10.017765+0000","last_undegraded":"2024-06-04T16:20:10.017765+0000","last_fullsized":"2024-06-04T16:20:10.017765+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_clean_scrub_stamp":"2024-06-04T16:16:07.631263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T00:49:39.967328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1","version":"251'2","reported_seq":28,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:55.016165+0000","last_change":"2024-06-04T16:09:26.623485+0000","last_active":"2024-06-04T16:19:55.016165+0000","last_peered":"2024-06-04T16:19:55.016165+0000","last_clean":"2024-06-04T16:19:55.016165+0000","last_became_active":"2024-06-04T16:09:26.623190+0000","last_became_peered":"2024-06-04T16:09:26.623190+0000","last_unstale":"2024-06-04T16:19:55.016165+0000","last_undegraded":"2024-06-04T16:19:55.016165+0000","last_fullsized":"2024-06-04T16:19:55.016165+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_clean_scrub_stamp":"2024-06-04T16:09:25.601105+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T18:13:31.934728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.2","version":"254'4","reported_seq":39,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:50.015625+0000","last_change":"2024-06-04T16:09:23.610740+0000","last_active":"2024-06-04T16:19:50.015625+0000","last_peered":"2024-06-04T16:19:50.015625+0000","last_clean":"2024-06-04T16:19:50.015625+0000","last_became_active":"2024-06-04T16:09:23.610479+0000","last_became_peered":"2024-06-04T16:09:23.610479+0000","last_unstale":"2024-06-04T16:19:50.015625+0000","last_undegraded":"2024-06-04T16:19:50.015625+0000","last_fullsized":"2024-06-04T16:19:50.015625+0000","mapping_epoch":246,"log_start":"0'0","ondisk_log_start":"0'0","created":246,"last_epoch_clean":247,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_clean_scrub_stamp":"2024-06-04T16:09:22.572686+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T20:36:24.481405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2097152,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":5120,"num_write":4,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"64.3","version":"251'23","reported_seq":98,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:40.017634+0000","last_change":"2024-06-04T16:07:09.513369+0000","last_active":"2024-06-04T16:19:40.017634+0000","last_peered":"2024-06-04T16:19:40.017634+0000","last_clean":"2024-06-04T16:19:40.017634+0000","last_became_active":"2024-06-04T16:07:09.512996+0000","last_became_peered":"2024-06-04T16:07:09.512996+0000","last_unstale":"2024-06-04T16:19:40.017634+0000","last_undegraded":"2024-06-04T16:19:40.017634+0000","last_fullsized":"2024-06-04T16:19:40.017634+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":243,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:07:08.374534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:07:08.374534+0000","last_clean_scrub_stamp":"2024-06-04T16:07:08.374534+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T18:42:34.541675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":113,"num_read_kb":81,"num_write":51,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1","version":"0'0","reported_seq":15,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:20:20.023189+0000","last_change":"2024-06-04T16:16:08.660525+0000","last_active":"2024-06-04T16:20:20.023189+0000","last_peered":"2024-06-04T16:20:20.023189+0000","last_clean":"2024-06-04T16:20:20.023189+0000","last_became_active":"2024-06-04T16:16:08.660177+0000","last_became_peered":"2024-06-04T16:16:08.660177+0000","last_unstale":"2024-06-04T16:20:20.023189+0000","last_undegraded":"2024-06-04T16:20:20.023189+0000","last_fullsized":"2024-06-04T16:20:20.023189+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_clean_scrub_stamp":"2024-06-04T16:16:07.631263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T19:57:47.986547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.0","version":"254'1","reported_seq":26,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:30.009167+0000","last_change":"2024-06-04T16:09:26.626867+0000","last_active":"2024-06-04T16:19:30.009167+0000","last_peered":"2024-06-04T16:19:30.009167+0000","last_clean":"2024-06-04T16:19:30.009167+0000","last_became_active":"2024-06-04T16:09:26.626576+0000","last_became_peered":"2024-06-04T16:09:26.626576+0000","last_unstale":"2024-06-04T16:19:30.009167+0000","last_undegraded":"2024-06-04T16:19:30.009167+0000","last_fullsized":"2024-06-04T16:19:30.009167+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_clean_scrub_stamp":"2024-06-04T16:09:25.601105+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T03:40:55.878734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.3","version":"254'1","reported_seq":32,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:50.011231+0000","last_change":"2024-06-04T16:09:23.604809+0000","last_active":"2024-06-04T16:19:50.011231+0000","last_peered":"2024-06-04T16:19:50.011231+0000","last_clean":"2024-06-04T16:19:50.011231+0000","last_became_active":"2024-06-04T16:09:23.604413+0000","last_became_peered":"2024-06-04T16:09:23.604413+0000","last_unstale":"2024-06-04T16:19:50.011231+0000","last_undegraded":"2024-06-04T16:19:50.011231+0000","last_fullsized":"2024-06-04T16:19:50.011231+0000","mapping_epoch":246,"log_start":"0'0","ondisk_log_start":"0'0","created":246,"last_epoch_clean":247,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_clean_scrub_stamp":"2024-06-04T16:09:22.572686+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T19:25:08.922699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"64.2","version":"254'2","reported_seq":43,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:40.009587+0000","last_change":"2024-06-04T16:07:09.402095+0000","last_active":"2024-06-04T16:19:40.009587+0000","last_peered":"2024-06-04T16:19:40.009587+0000","last_clean":"2024-06-04T16:19:40.009587+0000","last_became_active":"2024-06-04T16:07:09.401796+0000","last_became_peered":"2024-06-04T16:07:09.401796+0000","last_unstale":"2024-06-04T16:19:40.009587+0000","last_undegraded":"2024-06-04T16:19:40.009587+0000","last_fullsized":"2024-06-04T16:19:40.009587+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":243,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:07:08.374534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:07:08.374534+0000","last_clean_scrub_stamp":"2024-06-04T16:07:08.374534+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T02:34:43.812974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":7,"num_write":11,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.2","version":"0'0","reported_seq":15,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:20:20.014209+0000","last_change":"2024-06-04T16:16:08.656504+0000","last_active":"2024-06-04T16:20:20.014209+0000","last_peered":"2024-06-04T16:20:20.014209+0000","last_clean":"2024-06-04T16:20:20.014209+0000","last_became_active":"2024-06-04T16:16:08.656245+0000","last_became_peered":"2024-06-04T16:16:08.656245+0000","last_unstale":"2024-06-04T16:20:20.014209+0000","last_undegraded":"2024-06-04T16:20:20.014209+0000","last_fullsized":"2024-06-04T16:20:20.014209+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_clean_scrub_stamp":"2024-06-04T16:16:07.631263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T22:30:53.169701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.3","version":"254'3","reported_seq":30,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:55.121916+0000","last_change":"2024-06-04T16:09:26.627525+0000","last_active":"2024-06-04T16:19:55.121916+0000","last_peered":"2024-06-04T16:19:55.121916+0000","last_clean":"2024-06-04T16:19:55.121916+0000","last_became_active":"2024-06-04T16:09:26.627193+0000","last_became_peered":"2024-06-04T16:09:26.627193+0000","last_unstale":"2024-06-04T16:19:55.121916+0000","last_undegraded":"2024-06-04T16:19:55.121916+0000","last_fullsized":"2024-06-04T16:19:55.121916+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_clean_scrub_stamp":"2024-06-04T16:09:25.601105+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T04:04:57.004292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.0","version":"254'1","reported_seq":32,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:25.008667+0000","last_change":"2024-06-04T16:09:23.606568+0000","last_active":"2024-06-04T16:19:25.008667+0000","last_peered":"2024-06-04T16:19:25.008667+0000","last_clean":"2024-06-04T16:19:25.008667+0000","last_became_active":"2024-06-04T16:09:23.605145+0000","last_became_peered":"2024-06-04T16:09:23.605145+0000","last_unstale":"2024-06-04T16:19:25.008667+0000","last_undegraded":"2024-06-04T16:19:25.008667+0000","last_fullsized":"2024-06-04T16:19:25.008667+0000","mapping_epoch":246,"log_start":"0'0","ondisk_log_start":"0'0","created":246,"last_epoch_clean":247,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_clean_scrub_stamp":"2024-06-04T16:09:22.572686+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T16:32:02.394319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1024,"num_write":1,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"64.1","version":"245'23","reported_seq":103,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:40.120328+0000","last_change":"2024-06-04T16:07:09.405357+0000","last_active":"2024-06-04T16:19:40.120328+0000","last_peered":"2024-06-04T16:19:40.120328+0000","last_clean":"2024-06-04T16:19:40.120328+0000","last_became_active":"2024-06-04T16:07:09.405086+0000","last_became_peered":"2024-06-04T16:07:09.405086+0000","last_unstale":"2024-06-04T16:19:40.120328+0000","last_undegraded":"2024-06-04T16:19:40.120328+0000","last_fullsized":"2024-06-04T16:19:40.120328+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":243,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:07:08.374534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:07:08.374534+0000","last_clean_scrub_stamp":"2024-06-04T16:07:08.374534+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T20:08:13.021269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":130,"num_read_kb":96,"num_write":31,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.3","version":"0'0","reported_seq":15,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:20:20.014237+0000","last_change":"2024-06-04T16:16:08.661478+0000","last_active":"2024-06-04T16:20:20.014237+0000","last_peered":"2024-06-04T16:20:20.014237+0000","last_clean":"2024-06-04T16:20:20.014237+0000","last_became_active":"2024-06-04T16:16:08.661111+0000","last_became_peered":"2024-06-04T16:16:08.661111+0000","last_unstale":"2024-06-04T16:20:20.014237+0000","last_undegraded":"2024-06-04T16:20:20.014237+0000","last_fullsized":"2024-06-04T16:20:20.014237+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_clean_scrub_stamp":"2024-06-04T16:16:07.631263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T01:29:29.432723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.2","version":"254'1","reported_seq":27,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:55.019333+0000","last_change":"2024-06-04T16:09:26.625154+0000","last_active":"2024-06-04T16:19:55.019333+0000","last_peered":"2024-06-04T16:19:55.019333+0000","last_clean":"2024-06-04T16:19:55.019333+0000","last_became_active":"2024-06-04T16:09:26.624890+0000","last_became_peered":"2024-06-04T16:09:26.624890+0000","last_unstale":"2024-06-04T16:19:55.019333+0000","last_undegraded":"2024-06-04T16:19:55.019333+0000","last_fullsized":"2024-06-04T16:19:55.019333+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_clean_scrub_stamp":"2024-06-04T16:09:25.601105+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T20:52:50.931929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.1","version":"251'10","reported_seq":52,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:50.015591+0000","last_change":"2024-06-04T16:09:23.609351+0000","last_active":"2024-06-04T16:19:50.015591+0000","last_peered":"2024-06-04T16:19:50.015591+0000","last_clean":"2024-06-04T16:19:50.015591+0000","last_became_active":"2024-06-04T16:09:23.609072+0000","last_became_peered":"2024-06-04T16:09:23.609072+0000","last_unstale":"2024-06-04T16:19:50.015591+0000","last_undegraded":"2024-06-04T16:19:50.015591+0000","last_fullsized":"2024-06-04T16:19:50.015591+0000","mapping_epoch":246,"log_start":"0'0","ondisk_log_start":"0'0","created":246,"last_epoch_clean":247,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_clean_scrub_stamp":"2024-06-04T16:09:22.572686+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T01:04:48.825987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":15362,"num_write":9,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"64.0","version":"254'11","reported_seq":67,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:10.125764+0000","last_change":"2024-06-04T16:07:09.405417+0000","last_active":"2024-06-04T16:19:10.125764+0000","last_peered":"2024-06-04T16:19:10.125764+0000","last_clean":"2024-06-04T16:19:10.125764+0000","last_became_active":"2024-06-04T16:07:09.405109+0000","last_became_peered":"2024-06-04T16:07:09.405109+0000","last_unstale":"2024-06-04T16:19:10.125764+0000","last_undegraded":"2024-06-04T16:19:10.125764+0000","last_fullsized":"2024-06-04T16:19:10.125764+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":243,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:07:08.374534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:07:08.374534+0000","last_clean_scrub_stamp":"2024-06-04T16:07:08.374534+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T02:10:45.525441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":37,"num_write":22,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"251'58","reported_seq":567,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:45.010179+0000","last_change":"2024-06-04T15:52:36.496655+0000","last_active":"2024-06-04T16:19:45.010179+0000","last_peered":"2024-06-04T16:19:45.010179+0000","last_clean":"2024-06-04T16:19:45.010179+0000","last_became_active":"2024-06-04T15:52:36.496345+0000","last_became_peered":"2024-06-04T15:52:36.496345+0000","last_unstale":"2024-06-04T16:19:45.010179+0000","last_undegraded":"2024-06-04T16:19:45.010179+0000","last_fullsized":"2024-06-04T16:19:45.010179+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T19:41:39.532361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":73,"num_read_kb":10950,"num_write":187,"num_write_kb":28882,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"254'155","reported_seq":885,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:11.646551+0000","last_change":"2024-06-04T15:52:38.485748+0000","last_active":"2024-06-04T16:18:11.646551+0000","last_peered":"2024-06-04T16:18:11.646551+0000","last_clean":"2024-06-04T16:18:11.646551+0000","last_became_active":"2024-06-04T15:52:38.485491+0000","last_became_peered":"2024-06-04T15:52:38.485491+0000","last_unstale":"2024-06-04T16:18:11.646551+0000","last_undegraded":"2024-06-04T16:18:11.646551+0000","last_fullsized":"2024-06-04T16:18:11.646551+0000","mapping_epoch":23,"log_start":"251'100","ondisk_log_start":"251'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":100,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T03:05:20.005510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":710,"num_read_kb":632,"num_write":201,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"251'45","reported_seq":565,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:45.018501+0000","last_change":"2024-06-04T15:52:36.484644+0000","last_active":"2024-06-04T16:19:45.018501+0000","last_peered":"2024-06-04T16:19:45.018501+0000","last_clean":"2024-06-04T16:19:45.018501+0000","last_became_active":"2024-06-04T15:52:36.484223+0000","last_became_peered":"2024-06-04T15:52:36.484223+0000","last_unstale":"2024-06-04T16:19:45.018501+0000","last_undegraded":"2024-06-04T16:19:45.018501+0000","last_fullsized":"2024-06-04T16:19:45.018501+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T03:34:20.970333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1311028,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":90,"num_read_kb":9967,"num_write":210,"num_write_kb":17365,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,0],"acting":[5,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.39","version":"254'108","reported_seq":856,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:20.564331+0000","last_change":"2024-06-04T15:52:38.482297+0000","last_active":"2024-06-04T16:18:20.564331+0000","last_peered":"2024-06-04T16:18:20.564331+0000","last_clean":"2024-06-04T16:18:20.564331+0000","last_became_active":"2024-06-04T15:52:38.482000+0000","last_became_peered":"2024-06-04T15:52:38.482000+0000","last_unstale":"2024-06-04T16:18:20.564331+0000","last_undegraded":"2024-06-04T16:18:20.564331+0000","last_fullsized":"2024-06-04T16:18:20.564331+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T19:21:51.740016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":584,"num_read_kb":552,"num_write":123,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"254'42","reported_seq":538,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:45.018486+0000","last_change":"2024-06-04T15:52:36.480336+0000","last_active":"2024-06-04T16:19:45.018486+0000","last_peered":"2024-06-04T16:19:45.018486+0000","last_clean":"2024-06-04T16:19:45.018486+0000","last_became_active":"2024-06-04T15:52:36.479881+0000","last_became_peered":"2024-06-04T15:52:36.479881+0000","last_unstale":"2024-06-04T16:19:45.018486+0000","last_undegraded":"2024-06-04T16:19:45.018486+0000","last_fullsized":"2024-06-04T16:19:45.018486+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T22:45:30.429987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":40,"num_read_kb":31,"num_write":168,"num_write_kb":16512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3a","version":"254'106","reported_seq":815,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:21.743290+0000","last_change":"2024-06-04T15:52:38.483661+0000","last_active":"2024-06-04T16:18:21.743290+0000","last_peered":"2024-06-04T16:18:21.743290+0000","last_clean":"2024-06-04T16:18:21.743290+0000","last_became_active":"2024-06-04T15:52:38.483240+0000","last_became_peered":"2024-06-04T15:52:38.483240+0000","last_unstale":"2024-06-04T16:18:21.743290+0000","last_undegraded":"2024-06-04T16:18:21.743290+0000","last_fullsized":"2024-06-04T16:18:21.743290+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T19:59:20.609915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":515,"num_read_kb":482,"num_write":131,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"254'78","reported_seq":580,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:45.004714+0000","last_change":"2024-06-04T15:52:36.478336+0000","last_active":"2024-06-04T16:18:45.004714+0000","last_peered":"2024-06-04T16:18:45.004714+0000","last_clean":"2024-06-04T16:18:45.004714+0000","last_became_active":"2024-06-04T15:52:36.476981+0000","last_became_peered":"2024-06-04T15:52:36.476981+0000","last_unstale":"2024-06-04T16:18:45.004714+0000","last_undegraded":"2024-06-04T16:18:45.004714+0000","last_fullsized":"2024-06-04T16:18:45.004714+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T03:49:16.011063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":3145,"num_write":255,"num_write_kb":33835,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"254'148","reported_seq":1034,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:13.033398+0000","last_change":"2024-06-04T15:52:38.481259+0000","last_active":"2024-06-04T16:18:13.033398+0000","last_peered":"2024-06-04T16:18:13.033398+0000","last_clean":"2024-06-04T16:18:13.033398+0000","last_became_active":"2024-06-04T15:52:38.480986+0000","last_became_peered":"2024-06-04T15:52:38.480986+0000","last_unstale":"2024-06-04T16:18:13.033398+0000","last_undegraded":"2024-06-04T16:18:13.033398+0000","last_fullsized":"2024-06-04T16:18:13.033398+0000","mapping_epoch":23,"log_start":"251'100","ondisk_log_start":"251'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":100,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T20:30:59.524702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1072,"num_read_kb":1014,"num_write":195,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"251'46","reported_seq":555,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:17:39.997274+0000","last_change":"2024-06-04T15:52:36.495855+0000","last_active":"2024-06-04T16:17:39.997274+0000","last_peered":"2024-06-04T16:17:39.997274+0000","last_clean":"2024-06-04T16:17:39.997274+0000","last_became_active":"2024-06-04T15:52:36.495401+0000","last_became_peered":"2024-06-04T15:52:36.495401+0000","last_unstale":"2024-06-04T16:17:39.997274+0000","last_undegraded":"2024-06-04T16:17:39.997274+0000","last_fullsized":"2024-06-04T16:17:39.997274+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T01:05:31.416932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":89,"num_read_kb":6218,"num_write":199,"num_write_kb":11815,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"254'157","reported_seq":1084,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:45.004252+0000","last_change":"2024-06-04T15:52:38.485154+0000","last_active":"2024-06-04T16:18:45.004252+0000","last_peered":"2024-06-04T16:18:45.004252+0000","last_clean":"2024-06-04T16:18:45.004252+0000","last_became_active":"2024-06-04T15:52:38.484828+0000","last_became_peered":"2024-06-04T15:52:38.484828+0000","last_unstale":"2024-06-04T16:18:45.004252+0000","last_undegraded":"2024-06-04T16:18:45.004252+0000","last_fullsized":"2024-06-04T16:18:45.004252+0000","mapping_epoch":23,"log_start":"251'100","ondisk_log_start":"251'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":100,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T01:49:03.366763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1071,"num_read_kb":1008,"num_write":198,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"254'59","reported_seq":567,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:16.067282+0000","last_change":"2024-06-04T15:52:36.478124+0000","last_active":"2024-06-04T16:18:16.067282+0000","last_peered":"2024-06-04T16:18:16.067282+0000","last_clean":"2024-06-04T16:18:16.067282+0000","last_became_active":"2024-06-04T15:52:36.476167+0000","last_became_peered":"2024-06-04T15:52:36.476167+0000","last_unstale":"2024-06-04T16:18:16.067282+0000","last_undegraded":"2024-06-04T16:18:16.067282+0000","last_fullsized":"2024-06-04T16:18:16.067282+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T02:56:27.227183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242893,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":85,"num_read_kb":1095,"num_write":234,"num_write_kb":40818,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,7],"acting":[2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"254'99","reported_seq":811,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:45.010161+0000","last_change":"2024-06-04T15:52:38.483365+0000","last_active":"2024-06-04T16:19:45.010161+0000","last_peered":"2024-06-04T16:19:45.010161+0000","last_clean":"2024-06-04T16:19:45.010161+0000","last_became_active":"2024-06-04T15:52:38.482025+0000","last_became_peered":"2024-06-04T15:52:38.482025+0000","last_unstale":"2024-06-04T16:19:45.010161+0000","last_undegraded":"2024-06-04T16:19:45.010161+0000","last_fullsized":"2024-06-04T16:19:45.010161+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T01:15:41.149861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":511,"num_read_kb":478,"num_write":121,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.39","version":"251'54","reported_seq":548,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:17:39.997184+0000","last_change":"2024-06-04T15:52:36.493350+0000","last_active":"2024-06-04T16:17:39.997184+0000","last_peered":"2024-06-04T16:17:39.997184+0000","last_clean":"2024-06-04T16:17:39.997184+0000","last_became_active":"2024-06-04T15:52:36.493029+0000","last_became_peered":"2024-06-04T15:52:36.493029+0000","last_unstale":"2024-06-04T16:17:39.997184+0000","last_undegraded":"2024-06-04T16:17:39.997184+0000","last_fullsized":"2024-06-04T16:17:39.997184+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T23:35:25.665201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194343,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":48,"num_read_kb":7228,"num_write":201,"num_write_kb":32271,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,1],"acting":[0,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"254'135","reported_seq":1097,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:45.010727+0000","last_change":"2024-06-04T15:52:38.481762+0000","last_active":"2024-06-04T16:19:45.010727+0000","last_peered":"2024-06-04T16:19:45.010727+0000","last_clean":"2024-06-04T16:19:45.010727+0000","last_became_active":"2024-06-04T15:52:38.481269+0000","last_became_peered":"2024-06-04T15:52:38.481269+0000","last_unstale":"2024-06-04T16:19:45.010727+0000","last_undegraded":"2024-06-04T16:19:45.010727+0000","last_fullsized":"2024-06-04T16:19:45.010727+0000","mapping_epoch":23,"log_start":"251'100","ondisk_log_start":"251'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":100,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T19:02:25.732077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":974,"num_read_kb":946,"num_write":155,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"254'71","reported_seq":657,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:21.398271+0000","last_change":"2024-06-04T15:52:36.494149+0000","last_active":"2024-06-04T16:18:21.398271+0000","last_peered":"2024-06-04T16:18:21.398271+0000","last_clean":"2024-06-04T16:18:21.398271+0000","last_became_active":"2024-06-04T15:52:36.493867+0000","last_became_peered":"2024-06-04T15:52:36.493867+0000","last_unstale":"2024-06-04T16:18:21.398271+0000","last_undegraded":"2024-06-04T16:18:21.398271+0000","last_fullsized":"2024-06-04T16:18:21.398271+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T01:19:36.101046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194320,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":320,"num_read_kb":135435,"num_write":258,"num_write_kb":39309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3],"acting":[5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3f","version":"254'142","reported_seq":980,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:45.018547+0000","last_change":"2024-06-04T15:52:38.487423+0000","last_active":"2024-06-04T16:19:45.018547+0000","last_peered":"2024-06-04T16:19:45.018547+0000","last_clean":"2024-06-04T16:19:45.018547+0000","last_became_active":"2024-06-04T15:52:38.486625+0000","last_became_peered":"2024-06-04T15:52:38.486625+0000","last_unstale":"2024-06-04T16:19:45.018547+0000","last_undegraded":"2024-06-04T16:19:45.018547+0000","last_fullsized":"2024-06-04T16:19:45.018547+0000","mapping_epoch":23,"log_start":"251'100","ondisk_log_start":"251'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T20:53:48.231763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":899,"num_read_kb":839,"num_write":184,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.30","version":"254'110","reported_seq":836,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:21.348186+0000","last_change":"2024-06-04T15:52:38.479433+0000","last_active":"2024-06-04T16:18:21.348186+0000","last_peered":"2024-06-04T16:18:21.348186+0000","last_clean":"2024-06-04T16:18:21.348186+0000","last_became_active":"2024-06-04T15:52:38.479148+0000","last_became_peered":"2024-06-04T15:52:38.479148+0000","last_unstale":"2024-06-04T16:18:21.348186+0000","last_undegraded":"2024-06-04T16:18:21.348186+0000","last_fullsized":"2024-06-04T16:18:21.348186+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T00:01:16.709017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":546,"num_read_kb":515,"num_write":127,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"251'65","reported_seq":589,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:15.117942+0000","last_change":"2024-06-04T15:52:36.493388+0000","last_active":"2024-06-04T16:19:15.117942+0000","last_peered":"2024-06-04T16:19:15.117942+0000","last_clean":"2024-06-04T16:19:15.117942+0000","last_became_active":"2024-06-04T15:52:36.493062+0000","last_became_peered":"2024-06-04T15:52:36.493062+0000","last_unstale":"2024-06-04T16:19:15.117942+0000","last_undegraded":"2024-06-04T16:19:15.117942+0000","last_fullsized":"2024-06-04T16:19:15.117942+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T00:24:36.348212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194345,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":95,"num_read_kb":64250,"num_write":262,"num_write_kb":45332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,5],"acting":[1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"254'69","reported_seq":736,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:22.735079+0000","last_change":"2024-06-04T15:52:38.486683+0000","last_active":"2024-06-04T16:18:22.735079+0000","last_peered":"2024-06-04T16:18:22.735079+0000","last_clean":"2024-06-04T16:18:22.735079+0000","last_became_active":"2024-06-04T15:52:38.486413+0000","last_became_peered":"2024-06-04T15:52:38.486413+0000","last_unstale":"2024-06-04T16:18:22.735079+0000","last_undegraded":"2024-06-04T16:18:22.735079+0000","last_fullsized":"2024-06-04T16:18:22.735079+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T18:14:24.428815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":395,"num_read_kb":379,"num_write":76,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"251'60","reported_seq":570,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:15.007208+0000","last_change":"2024-06-04T15:52:36.494165+0000","last_active":"2024-06-04T16:19:15.007208+0000","last_peered":"2024-06-04T16:19:15.007208+0000","last_clean":"2024-06-04T16:19:15.007208+0000","last_became_active":"2024-06-04T15:52:36.493235+0000","last_became_peered":"2024-06-04T15:52:36.493235+0000","last_unstale":"2024-06-04T16:19:15.007208+0000","last_undegraded":"2024-06-04T16:19:15.007208+0000","last_fullsized":"2024-06-04T16:19:15.007208+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T19:10:07.674104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5327983,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":73,"num_read_kb":3706,"num_write":207,"num_write_kb":43313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"254'95","reported_seq":809,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:20.111811+0000","last_change":"2024-06-04T15:52:38.482371+0000","last_active":"2024-06-04T16:18:20.111811+0000","last_peered":"2024-06-04T16:18:20.111811+0000","last_clean":"2024-06-04T16:18:20.111811+0000","last_became_active":"2024-06-04T15:52:38.482120+0000","last_became_peered":"2024-06-04T15:52:38.482120+0000","last_unstale":"2024-06-04T16:18:20.111811+0000","last_undegraded":"2024-06-04T16:18:20.111811+0000","last_fullsized":"2024-06-04T16:18:20.111811+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T22:42:27.529034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":518,"num_read_kb":488,"num_write":107,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"251'41","reported_seq":556,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:15.007194+0000","last_change":"2024-06-04T15:53:14.839799+0000","last_active":"2024-06-04T16:19:15.007194+0000","last_peered":"2024-06-04T16:19:15.007194+0000","last_clean":"2024-06-04T16:19:15.007194+0000","last_became_active":"2024-06-04T15:53:14.839433+0000","last_became_peered":"2024-06-04T15:53:14.839433+0000","last_unstale":"2024-06-04T16:19:15.007194+0000","last_undegraded":"2024-06-04T16:19:15.007194+0000","last_fullsized":"2024-06-04T16:19:15.007194+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T18:08:08.559997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3420297,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":73,"num_read_kb":2132,"num_write":160,"num_write_kb":20015,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"254'143","reported_seq":931,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:15.013248+0000","last_change":"2024-06-04T15:52:38.482165+0000","last_active":"2024-06-04T16:19:15.013248+0000","last_peered":"2024-06-04T16:19:15.013248+0000","last_clean":"2024-06-04T16:19:15.013248+0000","last_became_active":"2024-06-04T15:52:38.480996+0000","last_became_peered":"2024-06-04T15:52:38.480996+0000","last_unstale":"2024-06-04T16:19:15.013248+0000","last_undegraded":"2024-06-04T16:19:15.013248+0000","last_fullsized":"2024-06-04T16:19:15.013248+0000","mapping_epoch":23,"log_start":"251'100","ondisk_log_start":"251'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":100,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T21:42:09.132143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":760,"num_read_kb":703,"num_write":184,"num_write_kb":47,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"251'68","reported_seq":578,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:15.007156+0000","last_change":"2024-06-04T15:52:36.488619+0000","last_active":"2024-06-04T16:19:15.007156+0000","last_peered":"2024-06-04T16:19:15.007156+0000","last_clean":"2024-06-04T16:19:15.007156+0000","last_became_active":"2024-06-04T15:52:36.486264+0000","last_became_peered":"2024-06-04T15:52:36.486264+0000","last_unstale":"2024-06-04T16:19:15.007156+0000","last_undegraded":"2024-06-04T16:19:15.007156+0000","last_fullsized":"2024-06-04T16:19:15.007156+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T23:40:03.292201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5328001,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":104,"num_read_kb":2209,"num_write":245,"num_write_kb":31585,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,7],"acting":[0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"254'109","reported_seq":990,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:15.014440+0000","last_change":"2024-06-04T15:52:38.488655+0000","last_active":"2024-06-04T16:19:15.014440+0000","last_peered":"2024-06-04T16:19:15.014440+0000","last_clean":"2024-06-04T16:19:15.014440+0000","last_became_active":"2024-06-04T15:52:38.488389+0000","last_became_peered":"2024-06-04T15:52:38.488389+0000","last_unstale":"2024-06-04T16:19:15.014440+0000","last_undegraded":"2024-06-04T16:19:15.014440+0000","last_fullsized":"2024-06-04T16:19:15.014440+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T00:42:51.636081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":949,"num_read_kb":919,"num_write":126,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.33","version":"254'49","reported_seq":550,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:15.013215+0000","last_change":"2024-06-04T15:52:36.498842+0000","last_active":"2024-06-04T16:19:15.013215+0000","last_peered":"2024-06-04T16:19:15.013215+0000","last_clean":"2024-06-04T16:19:15.013215+0000","last_became_active":"2024-06-04T15:52:36.498488+0000","last_became_peered":"2024-06-04T15:52:36.498488+0000","last_unstale":"2024-06-04T16:19:15.013215+0000","last_undegraded":"2024-06-04T16:19:15.013215+0000","last_fullsized":"2024-06-04T16:19:15.013215+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T21:29:00.145911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10655914,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":70,"num_read_kb":20343,"num_write":206,"num_write_kb":26780,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,4],"acting":[6,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.35","version":"254'139","reported_seq":926,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:15.117908+0000","last_change":"2024-06-04T15:52:38.486364+0000","last_active":"2024-06-04T16:19:15.117908+0000","last_peered":"2024-06-04T16:19:15.117908+0000","last_clean":"2024-06-04T16:19:15.117908+0000","last_became_active":"2024-06-04T15:52:38.486108+0000","last_became_peered":"2024-06-04T15:52:38.486108+0000","last_unstale":"2024-06-04T16:19:15.117908+0000","last_undegraded":"2024-06-04T16:19:15.117908+0000","last_fullsized":"2024-06-04T16:19:15.117908+0000","mapping_epoch":23,"log_start":"251'100","ondisk_log_start":"251'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":100,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T03:22:09.822966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":692,"num_read_kb":648,"num_write":164,"num_write_kb":35,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"254'35","reported_seq":525,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:25.006760+0000","last_change":"2024-06-04T15:52:36.481363+0000","last_active":"2024-06-04T16:18:25.006760+0000","last_peered":"2024-06-04T16:18:25.006760+0000","last_clean":"2024-06-04T16:18:25.006760+0000","last_became_active":"2024-06-04T15:52:36.481047+0000","last_became_peered":"2024-06-04T15:52:36.481047+0000","last_unstale":"2024-06-04T16:18:25.006760+0000","last_undegraded":"2024-06-04T16:18:25.006760+0000","last_fullsized":"2024-06-04T16:18:25.006760+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T21:52:41.102618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048602,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":41,"num_read_kb":41,"num_write":148,"num_write_kb":21263,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4],"acting":[6,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.18","version":"254'36","reported_seq":518,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:25.008099+0000","last_change":"2024-06-04T15:52:46.537761+0000","last_active":"2024-06-04T16:19:25.008099+0000","last_peered":"2024-06-04T16:19:25.008099+0000","last_clean":"2024-06-04T16:19:25.008099+0000","last_became_active":"2024-06-04T15:52:46.536608+0000","last_became_peered":"2024-06-04T15:52:46.536608+0000","last_unstale":"2024-06-04T16:19:25.008099+0000","last_undegraded":"2024-06-04T16:19:25.008099+0000","last_fullsized":"2024-06-04T16:19:25.008099+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:45.513877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:45.513877+0000","last_clean_scrub_stamp":"2024-06-04T15:52:45.513877+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T02:19:23.902475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":81,"num_read_kb":72,"num_write":87,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"254'110","reported_seq":831,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:25.006864+0000","last_change":"2024-06-04T15:52:38.477338+0000","last_active":"2024-06-04T16:18:25.006864+0000","last_peered":"2024-06-04T16:18:25.006864+0000","last_clean":"2024-06-04T16:18:25.006864+0000","last_became_active":"2024-06-04T15:52:38.477052+0000","last_became_peered":"2024-06-04T15:52:38.477052+0000","last_unstale":"2024-06-04T16:18:25.006864+0000","last_undegraded":"2024-06-04T16:18:25.006864+0000","last_fullsized":"2024-06-04T16:18:25.006864+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T20:39:40.247365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":560,"num_read_kb":523,"num_write":129,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.13","version":"254'52","reported_seq":553,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:21.323198+0000","last_change":"2024-06-04T15:52:36.499588+0000","last_active":"2024-06-04T16:18:21.323198+0000","last_peered":"2024-06-04T16:18:21.323198+0000","last_clean":"2024-06-04T16:18:21.323198+0000","last_became_active":"2024-06-04T15:52:36.499305+0000","last_became_peered":"2024-06-04T15:52:36.499305+0000","last_unstale":"2024-06-04T16:18:21.323198+0000","last_undegraded":"2024-06-04T16:18:21.323198+0000","last_fullsized":"2024-06-04T16:18:21.323198+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T20:07:01.696465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194320,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":75,"num_read_kb":3024,"num_write":196,"num_write_kb":28071,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":473,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:15.011753+0000","last_change":"2024-06-04T15:52:40.477030+0000","last_active":"2024-06-04T16:19:15.011753+0000","last_peered":"2024-06-04T16:19:15.011753+0000","last_clean":"2024-06-04T16:19:15.011753+0000","last_became_active":"2024-06-04T15:52:40.476730+0000","last_became_peered":"2024-06-04T15:52:40.476730+0000","last_unstale":"2024-06-04T16:19:15.011753+0000","last_undegraded":"2024-06-04T16:19:15.011753+0000","last_fullsized":"2024-06-04T16:19:15.011753+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_clean_scrub_stamp":"2024-06-04T15:52:39.463103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T00:40:38.064778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"254'140","reported_seq":707,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:21:45.035704+0000","last_change":"2024-06-04T15:52:42.504168+0000","last_active":"2024-06-04T16:21:45.035704+0000","last_peered":"2024-06-04T16:21:45.035704+0000","last_clean":"2024-06-04T16:21:45.035704+0000","last_became_active":"2024-06-04T15:52:42.503184+0000","last_became_peered":"2024-06-04T15:52:42.503184+0000","last_unstale":"2024-06-04T16:21:45.035704+0000","last_undegraded":"2024-06-04T16:21:45.035704+0000","last_fullsized":"2024-06-04T16:21:45.035704+0000","mapping_epoch":27,"log_start":"251'100","ondisk_log_start":"251'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_clean_scrub_stamp":"2024-06-04T15:52:41.476734+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":100,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T01:21:16.208347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4406,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":201,"num_read_kb":195,"num_write":108,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":468,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:20.118447+0000","last_change":"2024-06-04T15:52:44.513719+0000","last_active":"2024-06-04T16:19:20.118447+0000","last_peered":"2024-06-04T16:19:20.118447+0000","last_clean":"2024-06-04T16:19:20.118447+0000","last_became_active":"2024-06-04T15:52:44.513442+0000","last_became_peered":"2024-06-04T15:52:44.513442+0000","last_unstale":"2024-06-04T16:19:20.118447+0000","last_undegraded":"2024-06-04T16:19:20.118447+0000","last_fullsized":"2024-06-04T16:19:20.118447+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_clean_scrub_stamp":"2024-06-04T15:52:43.492872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T02:42:56.959694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"254'145","reported_seq":705,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:21:50.133713+0000","last_change":"2024-06-04T15:52:46.540252+0000","last_active":"2024-06-04T16:21:50.133713+0000","last_peered":"2024-06-04T16:21:50.133713+0000","last_clean":"2024-06-04T16:21:50.133713+0000","last_became_active":"2024-06-04T15:52:46.539957+0000","last_became_peered":"2024-06-04T15:52:46.539957+0000","last_unstale":"2024-06-04T16:21:50.133713+0000","last_undegraded":"2024-06-04T16:21:50.133713+0000","last_fullsized":"2024-06-04T16:21:50.133713+0000","mapping_epoch":31,"log_start":"254'100","ondisk_log_start":"254'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:45.513877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:45.513877+0000","last_clean_scrub_stamp":"2024-06-04T15:52:45.513877+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":100,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T02:03:12.091974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":399,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":346,"num_read_kb":345,"num_write":304,"num_write_kb":102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"254'154","reported_seq":837,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:15.011739+0000","last_change":"2024-06-04T15:52:38.483869+0000","last_active":"2024-06-04T16:19:15.011739+0000","last_peered":"2024-06-04T16:19:15.011739+0000","last_clean":"2024-06-04T16:19:15.011739+0000","last_became_active":"2024-06-04T15:52:38.483516+0000","last_became_peered":"2024-06-04T15:52:38.483516+0000","last_unstale":"2024-06-04T16:19:15.011739+0000","last_undegraded":"2024-06-04T16:19:15.011739+0000","last_fullsized":"2024-06-04T16:19:15.011739+0000","mapping_epoch":23,"log_start":"251'100","ondisk_log_start":"251'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":100,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T00:51:21.910421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":841,"num_read_kb":740,"num_write":235,"num_write_kb":95,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"254'66","reported_seq":578,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:22.713104+0000","last_change":"2024-06-04T15:52:36.481412+0000","last_active":"2024-06-04T16:18:22.713104+0000","last_peered":"2024-06-04T16:18:22.713104+0000","last_clean":"2024-06-04T16:18:22.713104+0000","last_became_active":"2024-06-04T15:52:36.481099+0000","last_became_peered":"2024-06-04T15:52:36.481099+0000","last_unstale":"2024-06-04T16:18:22.713104+0000","last_undegraded":"2024-06-04T16:18:22.713104+0000","last_fullsized":"2024-06-04T16:18:22.713104+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T21:45:28.619709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133687,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":119,"num_read_kb":2903,"num_write":273,"num_write_kb":32792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,7],"acting":[6,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":474,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:25.007271+0000","last_change":"2024-06-04T15:52:40.479746+0000","last_active":"2024-06-04T16:18:25.007271+0000","last_peered":"2024-06-04T16:18:25.007271+0000","last_clean":"2024-06-04T16:18:25.007271+0000","last_became_active":"2024-06-04T15:52:40.479483+0000","last_became_peered":"2024-06-04T15:52:40.479483+0000","last_unstale":"2024-06-04T16:18:25.007271+0000","last_undegraded":"2024-06-04T16:18:25.007271+0000","last_fullsized":"2024-06-04T16:18:25.007271+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_clean_scrub_stamp":"2024-06-04T15:52:39.463103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T23:55:25.989646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"254'51","reported_seq":547,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:20.118437+0000","last_change":"2024-06-04T15:52:42.503739+0000","last_active":"2024-06-04T16:19:20.118437+0000","last_peered":"2024-06-04T16:19:20.118437+0000","last_clean":"2024-06-04T16:19:20.118437+0000","last_became_active":"2024-06-04T15:52:42.503451+0000","last_became_peered":"2024-06-04T15:52:42.503451+0000","last_unstale":"2024-06-04T16:19:20.118437+0000","last_undegraded":"2024-06-04T16:19:20.118437+0000","last_fullsized":"2024-06-04T16:19:20.118437+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_clean_scrub_stamp":"2024-06-04T15:52:41.476734+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T02:51:35.526591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":72,"num_read_kb":67,"num_write":48,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":468,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:20.118406+0000","last_change":"2024-06-04T15:52:44.518997+0000","last_active":"2024-06-04T16:19:20.118406+0000","last_peered":"2024-06-04T16:19:20.118406+0000","last_clean":"2024-06-04T16:19:20.118406+0000","last_became_active":"2024-06-04T15:52:44.517614+0000","last_became_peered":"2024-06-04T15:52:44.517614+0000","last_unstale":"2024-06-04T16:19:20.118406+0000","last_undegraded":"2024-06-04T16:19:20.118406+0000","last_fullsized":"2024-06-04T16:19:20.118406+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_clean_scrub_stamp":"2024-06-04T15:52:43.492872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T00:18:35.417836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"254'22","reported_seq":496,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:15.940519+0000","last_change":"2024-06-04T15:52:46.535843+0000","last_active":"2024-06-04T16:18:15.940519+0000","last_peered":"2024-06-04T16:18:15.940519+0000","last_clean":"2024-06-04T16:18:15.940519+0000","last_became_active":"2024-06-04T15:52:46.535498+0000","last_became_peered":"2024-06-04T15:52:46.535498+0000","last_unstale":"2024-06-04T16:18:15.940519+0000","last_undegraded":"2024-06-04T16:18:15.940519+0000","last_fullsized":"2024-06-04T16:18:15.940519+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:45.513877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:45.513877+0000","last_clean_scrub_stamp":"2024-06-04T15:52:45.513877+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T19:56:52.936990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":432,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":50,"num_read_kb":48,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"254'95","reported_seq":835,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:15.014486+0000","last_change":"2024-06-04T15:52:38.486919+0000","last_active":"2024-06-04T16:19:15.014486+0000","last_peered":"2024-06-04T16:19:15.014486+0000","last_clean":"2024-06-04T16:19:15.014486+0000","last_became_active":"2024-06-04T15:52:38.486612+0000","last_became_peered":"2024-06-04T15:52:38.486612+0000","last_unstale":"2024-06-04T16:19:15.014486+0000","last_undegraded":"2024-06-04T16:19:15.014486+0000","last_fullsized":"2024-06-04T16:19:15.014486+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T17:15:27.232127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":567,"num_read_kb":536,"num_write":113,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"254'35","reported_seq":523,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:20.005264+0000","last_change":"2024-06-04T15:52:36.487317+0000","last_active":"2024-06-04T16:18:20.005264+0000","last_peered":"2024-06-04T16:18:20.005264+0000","last_clean":"2024-06-04T16:18:20.005264+0000","last_became_active":"2024-06-04T15:52:36.486999+0000","last_became_peered":"2024-06-04T15:52:36.486999+0000","last_unstale":"2024-06-04T16:18:20.005264+0000","last_undegraded":"2024-06-04T16:18:20.005264+0000","last_fullsized":"2024-06-04T16:18:20.005264+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T20:36:12.625291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7340071,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":6159,"num_write":132,"num_write_kb":22820,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":474,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:15.013835+0000","last_change":"2024-06-04T15:52:40.485408+0000","last_active":"2024-06-04T16:19:15.013835+0000","last_peered":"2024-06-04T16:19:15.013835+0000","last_clean":"2024-06-04T16:19:15.013835+0000","last_became_active":"2024-06-04T15:52:40.484711+0000","last_became_peered":"2024-06-04T15:52:40.484711+0000","last_unstale":"2024-06-04T16:19:15.013835+0000","last_undegraded":"2024-06-04T16:19:15.013835+0000","last_fullsized":"2024-06-04T16:19:15.013835+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_clean_scrub_stamp":"2024-06-04T15:52:39.463103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T18:42:17.207481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"251'65","reported_seq":565,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:30.007950+0000","last_change":"2024-06-04T15:52:42.501609+0000","last_active":"2024-06-04T16:18:30.007950+0000","last_peered":"2024-06-04T16:18:30.007950+0000","last_clean":"2024-06-04T16:18:30.007950+0000","last_became_active":"2024-06-04T15:52:42.501248+0000","last_became_peered":"2024-06-04T15:52:42.501248+0000","last_unstale":"2024-06-04T16:18:30.007950+0000","last_undegraded":"2024-06-04T16:18:30.007950+0000","last_fullsized":"2024-06-04T16:18:30.007950+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_clean_scrub_stamp":"2024-06-04T15:52:41.476734+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T02:21:04.282188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":90,"num_read_kb":83,"num_write":60,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.15","version":"254'462","reported_seq":1496,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:32.409857+0000","last_change":"2024-06-04T15:52:44.523497+0000","last_active":"2024-06-04T16:22:32.409857+0000","last_peered":"2024-06-04T16:22:32.409857+0000","last_clean":"2024-06-04T16:22:32.409857+0000","last_became_active":"2024-06-04T15:52:44.523138+0000","last_became_peered":"2024-06-04T15:52:44.523138+0000","last_unstale":"2024-06-04T16:22:32.409857+0000","last_undegraded":"2024-06-04T16:22:32.409857+0000","last_fullsized":"2024-06-04T16:22:32.409857+0000","mapping_epoch":29,"log_start":"251'400","ondisk_log_start":"251'400","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_clean_scrub_stamp":"2024-06-04T15:52:43.492872+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":400,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T16:19:32.818463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"254'37","reported_seq":504,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:21.699674+0000","last_change":"2024-06-04T15:52:46.532424+0000","last_active":"2024-06-04T16:18:21.699674+0000","last_peered":"2024-06-04T16:18:21.699674+0000","last_clean":"2024-06-04T16:18:21.699674+0000","last_became_active":"2024-06-04T15:52:46.532141+0000","last_became_peered":"2024-06-04T15:52:46.532141+0000","last_unstale":"2024-06-04T16:18:21.699674+0000","last_undegraded":"2024-06-04T16:18:21.699674+0000","last_fullsized":"2024-06-04T16:18:21.699674+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:45.513877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:45.513877+0000","last_clean_scrub_stamp":"2024-06-04T15:52:45.513877+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T17:04:53.931942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":56,"num_read_kb":50,"num_write":85,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"254'146","reported_seq":978,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:15.014528+0000","last_change":"2024-06-04T15:52:38.490123+0000","last_active":"2024-06-04T16:19:15.014528+0000","last_peered":"2024-06-04T16:19:15.014528+0000","last_clean":"2024-06-04T16:19:15.014528+0000","last_became_active":"2024-06-04T15:52:38.489719+0000","last_became_peered":"2024-06-04T15:52:38.489719+0000","last_unstale":"2024-06-04T16:19:15.014528+0000","last_undegraded":"2024-06-04T16:19:15.014528+0000","last_fullsized":"2024-06-04T16:19:15.014528+0000","mapping_epoch":23,"log_start":"251'100","ondisk_log_start":"251'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":100,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T20:50:26.159996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":798,"num_read_kb":751,"num_write":172,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"254'47","reported_seq":555,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:20.111775+0000","last_change":"2024-06-04T15:52:36.483313+0000","last_active":"2024-06-04T16:18:20.111775+0000","last_peered":"2024-06-04T16:18:20.111775+0000","last_clean":"2024-06-04T16:18:20.111775+0000","last_became_active":"2024-06-04T15:52:36.482920+0000","last_became_peered":"2024-06-04T15:52:36.482920+0000","last_unstale":"2024-06-04T16:18:20.111775+0000","last_undegraded":"2024-06-04T16:18:20.111775+0000","last_fullsized":"2024-06-04T16:18:20.111775+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T17:11:29.371432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1069231,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":86,"num_read_kb":13402,"num_write":212,"num_write_kb":21907,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3],"acting":[1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":473,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:15.011771+0000","last_change":"2024-06-04T15:52:40.482578+0000","last_active":"2024-06-04T16:19:15.011771+0000","last_peered":"2024-06-04T16:19:15.011771+0000","last_clean":"2024-06-04T16:19:15.011771+0000","last_became_active":"2024-06-04T15:52:40.482288+0000","last_became_peered":"2024-06-04T15:52:40.482288+0000","last_unstale":"2024-06-04T16:19:15.011771+0000","last_undegraded":"2024-06-04T16:19:15.011771+0000","last_fullsized":"2024-06-04T16:19:15.011771+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_clean_scrub_stamp":"2024-06-04T15:52:39.463103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T01:57:16.365165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"254'85","reported_seq":618,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:21:45.024430+0000","last_change":"2024-06-04T15:52:42.503565+0000","last_active":"2024-06-04T16:21:45.024430+0000","last_peered":"2024-06-04T16:21:45.024430+0000","last_clean":"2024-06-04T16:21:45.024430+0000","last_became_active":"2024-06-04T15:52:42.503282+0000","last_became_peered":"2024-06-04T15:52:42.503282+0000","last_unstale":"2024-06-04T16:21:45.024430+0000","last_undegraded":"2024-06-04T16:21:45.024430+0000","last_fullsized":"2024-06-04T16:21:45.024430+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_clean_scrub_stamp":"2024-06-04T15:52:41.476734+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T16:54:37.102368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6020,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":130,"num_read_kb":184,"num_write":62,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"254'475","reported_seq":1571,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:32.413980+0000","last_change":"2024-06-04T15:52:44.520464+0000","last_active":"2024-06-04T16:22:32.413980+0000","last_peered":"2024-06-04T16:22:32.413980+0000","last_clean":"2024-06-04T16:22:32.413980+0000","last_became_active":"2024-06-04T15:52:44.518724+0000","last_became_peered":"2024-06-04T15:52:44.518724+0000","last_unstale":"2024-06-04T16:22:32.413980+0000","last_undegraded":"2024-06-04T16:22:32.413980+0000","last_fullsized":"2024-06-04T16:22:32.413980+0000","mapping_epoch":29,"log_start":"251'400","ondisk_log_start":"251'400","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_clean_scrub_stamp":"2024-06-04T15:52:43.492872+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":400,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T21:27:12.445604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"254'113","reported_seq":799,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:40.007714+0000","last_change":"2024-06-04T15:52:38.479210+0000","last_active":"2024-06-04T16:18:40.007714+0000","last_peered":"2024-06-04T16:18:40.007714+0000","last_clean":"2024-06-04T16:18:40.007714+0000","last_became_active":"2024-06-04T15:52:38.478886+0000","last_became_peered":"2024-06-04T15:52:38.478886+0000","last_unstale":"2024-06-04T16:18:40.007714+0000","last_undegraded":"2024-06-04T16:18:40.007714+0000","last_fullsized":"2024-06-04T16:18:40.007714+0000","mapping_epoch":23,"log_start":"251'100","ondisk_log_start":"251'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":100,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T02:04:11.671915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":534,"num_read_kb":483,"num_write":137,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"251'58","reported_seq":536,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:20:20.023086+0000","last_change":"2024-06-04T15:53:14.838688+0000","last_active":"2024-06-04T16:20:20.023086+0000","last_peered":"2024-06-04T16:20:20.023086+0000","last_clean":"2024-06-04T16:20:20.023086+0000","last_became_active":"2024-06-04T15:53:14.838259+0000","last_became_peered":"2024-06-04T15:53:14.838259+0000","last_unstale":"2024-06-04T16:20:20.023086+0000","last_undegraded":"2024-06-04T16:20:20.023086+0000","last_fullsized":"2024-06-04T16:20:20.023086+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T21:50:47.794603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":105,"num_read_kb":3164,"num_write":221,"num_write_kb":9993,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,4],"acting":[6,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":477,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:40.113833+0000","last_change":"2024-06-04T15:52:40.484123+0000","last_active":"2024-06-04T16:18:40.113833+0000","last_peered":"2024-06-04T16:18:40.113833+0000","last_clean":"2024-06-04T16:18:40.113833+0000","last_became_active":"2024-06-04T15:52:40.483832+0000","last_became_peered":"2024-06-04T15:52:40.483832+0000","last_unstale":"2024-06-04T16:18:40.113833+0000","last_undegraded":"2024-06-04T16:18:40.113833+0000","last_fullsized":"2024-06-04T16:18:40.113833+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_clean_scrub_stamp":"2024-06-04T15:52:39.463103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T17:49:38.147326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"254'137","reported_seq":705,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:21:00.017591+0000","last_change":"2024-06-04T15:52:42.504594+0000","last_active":"2024-06-04T16:21:00.017591+0000","last_peered":"2024-06-04T16:21:00.017591+0000","last_clean":"2024-06-04T16:21:00.017591+0000","last_became_active":"2024-06-04T15:52:42.504217+0000","last_became_peered":"2024-06-04T15:52:42.504217+0000","last_unstale":"2024-06-04T16:21:00.017591+0000","last_undegraded":"2024-06-04T16:21:00.017591+0000","last_fullsized":"2024-06-04T16:21:00.017591+0000","mapping_epoch":27,"log_start":"251'100","ondisk_log_start":"251'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_clean_scrub_stamp":"2024-06-04T15:52:41.476734+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":100,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T15:59:45.129536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":210,"num_read_kb":249,"num_write":114,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":463,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:45.017624+0000","last_change":"2024-06-04T15:52:44.520621+0000","last_active":"2024-06-04T16:19:45.017624+0000","last_peered":"2024-06-04T16:19:45.017624+0000","last_clean":"2024-06-04T16:19:45.017624+0000","last_became_active":"2024-06-04T15:52:44.520358+0000","last_became_peered":"2024-06-04T15:52:44.520358+0000","last_unstale":"2024-06-04T16:19:45.017624+0000","last_undegraded":"2024-06-04T16:19:45.017624+0000","last_fullsized":"2024-06-04T16:19:45.017624+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_clean_scrub_stamp":"2024-06-04T15:52:43.492872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T18:58:46.869583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"254'455","reported_seq":1238,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:32.397946+0000","last_change":"2024-06-04T15:52:46.536753+0000","last_active":"2024-06-04T16:22:32.397946+0000","last_peered":"2024-06-04T16:22:32.397946+0000","last_clean":"2024-06-04T16:22:32.397946+0000","last_became_active":"2024-06-04T15:52:46.536442+0000","last_became_peered":"2024-06-04T15:52:46.536442+0000","last_unstale":"2024-06-04T16:22:32.397946+0000","last_undegraded":"2024-06-04T16:22:32.397946+0000","last_fullsized":"2024-06-04T16:22:32.397946+0000","mapping_epoch":31,"log_start":"251'400","ondisk_log_start":"251'400","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:45.513877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:45.513877+0000","last_clean_scrub_stamp":"2024-06-04T15:52:45.513877+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":400,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T18:31:26.520436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":418,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1197,"num_read_kb":1195,"num_write":937,"num_write_kb":336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"254'122","reported_seq":923,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:40.113848+0000","last_change":"2024-06-04T15:52:38.483443+0000","last_active":"2024-06-04T16:18:40.113848+0000","last_peered":"2024-06-04T16:18:40.113848+0000","last_clean":"2024-06-04T16:18:40.113848+0000","last_became_active":"2024-06-04T15:52:38.483194+0000","last_became_peered":"2024-06-04T15:52:38.483194+0000","last_unstale":"2024-06-04T16:18:40.113848+0000","last_undegraded":"2024-06-04T16:18:40.113848+0000","last_fullsized":"2024-06-04T16:18:40.113848+0000","mapping_epoch":23,"log_start":"251'100","ondisk_log_start":"251'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":100,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T17:17:39.302543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":683,"num_read_kb":649,"num_write":140,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"254'59","reported_seq":590,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:40.010202+0000","last_change":"2024-06-04T15:52:36.486364+0000","last_active":"2024-06-04T16:19:40.010202+0000","last_peered":"2024-06-04T16:19:40.010202+0000","last_clean":"2024-06-04T16:19:40.010202+0000","last_became_active":"2024-06-04T15:52:36.485995+0000","last_became_peered":"2024-06-04T15:52:36.485995+0000","last_unstale":"2024-06-04T16:19:40.010202+0000","last_undegraded":"2024-06-04T16:19:40.010202+0000","last_fullsized":"2024-06-04T16:19:40.010202+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T01:18:14.040577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048681,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":97,"num_read_kb":68665,"num_write":248,"num_write_kb":35943,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":471,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:40.008747+0000","last_change":"2024-06-04T15:52:40.481019+0000","last_active":"2024-06-04T16:18:40.008747+0000","last_peered":"2024-06-04T16:18:40.008747+0000","last_clean":"2024-06-04T16:18:40.008747+0000","last_became_active":"2024-06-04T15:52:40.480714+0000","last_became_peered":"2024-06-04T15:52:40.480714+0000","last_unstale":"2024-06-04T16:18:40.008747+0000","last_undegraded":"2024-06-04T16:18:40.008747+0000","last_fullsized":"2024-06-04T16:18:40.008747+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_clean_scrub_stamp":"2024-06-04T15:52:39.463103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T22:44:29.436328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.b","version":"254'90","reported_seq":626,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:00.037695+0000","last_change":"2024-06-04T15:52:42.505667+0000","last_active":"2024-06-04T16:22:00.037695+0000","last_peered":"2024-06-04T16:22:00.037695+0000","last_clean":"2024-06-04T16:22:00.037695+0000","last_became_active":"2024-06-04T15:52:42.505269+0000","last_became_peered":"2024-06-04T15:52:42.505269+0000","last_unstale":"2024-06-04T16:22:00.037695+0000","last_undegraded":"2024-06-04T16:22:00.037695+0000","last_fullsized":"2024-06-04T16:22:00.037695+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_clean_scrub_stamp":"2024-06-04T15:52:41.476734+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T19:58:57.937812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":121,"num_read_kb":111,"num_write":56,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":467,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:50.010546+0000","last_change":"2024-06-04T15:52:44.522421+0000","last_active":"2024-06-04T16:18:50.010546+0000","last_peered":"2024-06-04T16:18:50.010546+0000","last_clean":"2024-06-04T16:18:50.010546+0000","last_became_active":"2024-06-04T15:52:44.522149+0000","last_became_peered":"2024-06-04T15:52:44.522149+0000","last_unstale":"2024-06-04T16:18:50.010546+0000","last_undegraded":"2024-06-04T16:18:50.010546+0000","last_fullsized":"2024-06-04T16:18:50.010546+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_clean_scrub_stamp":"2024-06-04T15:52:43.492872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T16:56:50.665549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.5","version":"254'29","reported_seq":505,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:55.121954+0000","last_change":"2024-06-04T15:52:46.540795+0000","last_active":"2024-06-04T16:19:55.121954+0000","last_peered":"2024-06-04T16:19:55.121954+0000","last_clean":"2024-06-04T16:19:55.121954+0000","last_became_active":"2024-06-04T15:52:46.540510+0000","last_became_peered":"2024-06-04T15:52:46.540510+0000","last_unstale":"2024-06-04T16:19:55.121954+0000","last_undegraded":"2024-06-04T16:19:55.121954+0000","last_fullsized":"2024-06-04T16:19:55.121954+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:45.513877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:45.513877+0000","last_clean_scrub_stamp":"2024-06-04T15:52:45.513877+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T23:41:51.500895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":51,"num_write":73,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"254'110","reported_seq":875,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:45.004684+0000","last_change":"2024-06-04T15:52:38.480623+0000","last_active":"2024-06-04T16:18:45.004684+0000","last_peered":"2024-06-04T16:18:45.004684+0000","last_clean":"2024-06-04T16:18:45.004684+0000","last_became_active":"2024-06-04T15:52:38.480112+0000","last_became_peered":"2024-06-04T15:52:38.480112+0000","last_unstale":"2024-06-04T16:18:45.004684+0000","last_undegraded":"2024-06-04T16:18:45.004684+0000","last_fullsized":"2024-06-04T16:18:45.004684+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T00:34:50.827504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":725,"num_read_kb":689,"num_write":131,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"251'79","reported_seq":547,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:20:15.022274+0000","last_change":"2024-06-04T15:53:14.838653+0000","last_active":"2024-06-04T16:20:15.022274+0000","last_peered":"2024-06-04T16:20:15.022274+0000","last_clean":"2024-06-04T16:20:15.022274+0000","last_became_active":"2024-06-04T15:53:14.838251+0000","last_became_peered":"2024-06-04T15:53:14.838251+0000","last_unstale":"2024-06-04T16:20:15.022274+0000","last_undegraded":"2024-06-04T16:20:15.022274+0000","last_fullsized":"2024-06-04T16:20:15.022274+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T16:02:03.538866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5263509,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":74,"num_read_kb":65,"num_write":320,"num_write_kb":43304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.b","version":"33'3","reported_seq":782,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:32.120722+0000","last_change":"2024-06-04T15:52:40.482441+0000","last_active":"2024-06-04T16:22:32.120722+0000","last_peered":"2024-06-04T16:22:32.120722+0000","last_clean":"2024-06-04T16:22:32.120722+0000","last_became_active":"2024-06-04T15:52:40.482173+0000","last_became_peered":"2024-06-04T15:52:40.482173+0000","last_unstale":"2024-06-04T16:22:32.120722+0000","last_undegraded":"2024-06-04T16:22:32.120722+0000","last_fullsized":"2024-06-04T16:22:32.120722+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_clean_scrub_stamp":"2024-06-04T15:52:39.463103+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T16:39:49.059223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":461,"num_read_kb":459,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"254'105","reported_seq":649,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:20:55.022993+0000","last_change":"2024-06-04T15:52:42.498254+0000","last_active":"2024-06-04T16:20:55.022993+0000","last_peered":"2024-06-04T16:20:55.022993+0000","last_clean":"2024-06-04T16:20:55.022993+0000","last_became_active":"2024-06-04T15:52:42.497393+0000","last_became_peered":"2024-06-04T15:52:42.497393+0000","last_unstale":"2024-06-04T16:20:55.022993+0000","last_undegraded":"2024-06-04T16:20:55.022993+0000","last_fullsized":"2024-06-04T16:20:55.022993+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_clean_scrub_stamp":"2024-06-04T15:52:41.476734+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T20:36:45.216523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14741,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":162,"num_read_kb":230,"num_write":84,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"254'475","reported_seq":1632,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:32.414971+0000","last_change":"2024-06-04T15:52:44.519059+0000","last_active":"2024-06-04T16:22:32.414971+0000","last_peered":"2024-06-04T16:22:32.414971+0000","last_clean":"2024-06-04T16:22:32.414971+0000","last_became_active":"2024-06-04T15:52:44.518765+0000","last_became_peered":"2024-06-04T15:52:44.518765+0000","last_unstale":"2024-06-04T16:22:32.414971+0000","last_undegraded":"2024-06-04T16:22:32.414971+0000","last_fullsized":"2024-06-04T16:22:32.414971+0000","mapping_epoch":29,"log_start":"251'400","ondisk_log_start":"251'400","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_clean_scrub_stamp":"2024-06-04T15:52:43.492872+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":400,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T20:20:06.797230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"251'21","reported_seq":488,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:50.010030+0000","last_change":"2024-06-04T15:52:46.537947+0000","last_active":"2024-06-04T16:18:50.010030+0000","last_peered":"2024-06-04T16:18:50.010030+0000","last_clean":"2024-06-04T16:18:50.010030+0000","last_became_active":"2024-06-04T15:52:46.537679+0000","last_became_peered":"2024-06-04T15:52:46.537679+0000","last_unstale":"2024-06-04T16:18:50.010030+0000","last_undegraded":"2024-06-04T16:18:50.010030+0000","last_fullsized":"2024-06-04T16:18:50.010030+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:45.513877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:45.513877+0000","last_clean_scrub_stamp":"2024-06-04T15:52:45.513877+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T18:28:47.547893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":390,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":49,"num_read_kb":41,"num_write":55,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"254'141","reported_seq":899,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:40.017652+0000","last_change":"2024-06-04T15:52:38.489274+0000","last_active":"2024-06-04T16:19:40.017652+0000","last_peered":"2024-06-04T16:19:40.017652+0000","last_clean":"2024-06-04T16:19:40.017652+0000","last_became_active":"2024-06-04T15:52:38.488997+0000","last_became_peered":"2024-06-04T15:52:38.488997+0000","last_unstale":"2024-06-04T16:19:40.017652+0000","last_undegraded":"2024-06-04T16:19:40.017652+0000","last_fullsized":"2024-06-04T16:19:40.017652+0000","mapping_epoch":23,"log_start":"251'100","ondisk_log_start":"251'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":100,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T00:28:22.807058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":688,"num_read_kb":631,"num_write":173,"num_write_kb":46,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"254'57","reported_seq":566,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:40.009630+0000","last_change":"2024-06-04T15:52:36.495931+0000","last_active":"2024-06-04T16:19:40.009630+0000","last_peered":"2024-06-04T16:19:40.009630+0000","last_clean":"2024-06-04T16:19:40.009630+0000","last_became_active":"2024-06-04T15:52:36.495601+0000","last_became_peered":"2024-06-04T15:52:36.495601+0000","last_unstale":"2024-06-04T16:19:40.009630+0000","last_undegraded":"2024-06-04T16:19:40.009630+0000","last_fullsized":"2024-06-04T16:19:40.009630+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T23:22:39.942337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048614,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":73,"num_read_kb":575,"num_write":256,"num_write_kb":23683,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":471,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:45.009389+0000","last_change":"2024-06-04T15:52:40.485064+0000","last_active":"2024-06-04T16:18:45.009389+0000","last_peered":"2024-06-04T16:18:45.009389+0000","last_clean":"2024-06-04T16:18:45.009389+0000","last_became_active":"2024-06-04T15:52:40.484785+0000","last_became_peered":"2024-06-04T15:52:40.484785+0000","last_unstale":"2024-06-04T16:18:45.009389+0000","last_undegraded":"2024-06-04T16:18:45.009389+0000","last_fullsized":"2024-06-04T16:18:45.009389+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_clean_scrub_stamp":"2024-06-04T15:52:39.463103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T18:35:53.675262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.9","version":"254'150","reported_seq":743,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:32.367642+0000","last_change":"2024-06-04T15:52:42.504865+0000","last_active":"2024-06-04T16:22:32.367642+0000","last_peered":"2024-06-04T16:22:32.367642+0000","last_clean":"2024-06-04T16:22:32.367642+0000","last_became_active":"2024-06-04T15:52:42.504622+0000","last_became_peered":"2024-06-04T15:52:42.504622+0000","last_unstale":"2024-06-04T16:22:32.367642+0000","last_undegraded":"2024-06-04T16:22:32.367642+0000","last_fullsized":"2024-06-04T16:22:32.367642+0000","mapping_epoch":27,"log_start":"251'100","ondisk_log_start":"251'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_clean_scrub_stamp":"2024-06-04T15:52:41.476734+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":100,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T01:00:09.245514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26249,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":238,"num_read_kb":374,"num_write":110,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":469,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:45.010347+0000","last_change":"2024-06-04T15:52:44.518616+0000","last_active":"2024-06-04T16:18:45.010347+0000","last_peered":"2024-06-04T16:18:45.010347+0000","last_clean":"2024-06-04T16:18:45.010347+0000","last_became_active":"2024-06-04T15:52:44.518340+0000","last_became_peered":"2024-06-04T15:52:44.518340+0000","last_unstale":"2024-06-04T16:18:45.010347+0000","last_undegraded":"2024-06-04T16:18:45.010347+0000","last_fullsized":"2024-06-04T16:18:45.010347+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_clean_scrub_stamp":"2024-06-04T15:52:43.492872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T20:18:04.722535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"254'22","reported_seq":501,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:50.123049+0000","last_change":"2024-06-04T15:52:46.540890+0000","last_active":"2024-06-04T16:18:50.123049+0000","last_peered":"2024-06-04T16:18:50.123049+0000","last_clean":"2024-06-04T16:18:50.123049+0000","last_became_active":"2024-06-04T15:52:46.540542+0000","last_became_peered":"2024-06-04T15:52:46.540542+0000","last_unstale":"2024-06-04T16:18:50.123049+0000","last_undegraded":"2024-06-04T16:18:50.123049+0000","last_fullsized":"2024-06-04T16:18:50.123049+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:45.513877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:45.513877+0000","last_clean_scrub_stamp":"2024-06-04T15:52:45.513877+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T00:28:19.284809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":503,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":51,"num_read_kb":51,"num_write":59,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"254'116","reported_seq":912,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:40.009649+0000","last_change":"2024-06-04T15:52:38.488878+0000","last_active":"2024-06-04T16:19:40.009649+0000","last_peered":"2024-06-04T16:19:40.009649+0000","last_clean":"2024-06-04T16:19:40.009649+0000","last_became_active":"2024-06-04T15:52:38.488576+0000","last_became_peered":"2024-06-04T15:52:38.488576+0000","last_unstale":"2024-06-04T16:19:40.009649+0000","last_undegraded":"2024-06-04T16:19:40.009649+0000","last_fullsized":"2024-06-04T16:19:40.009649+0000","mapping_epoch":23,"log_start":"251'100","ondisk_log_start":"251'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":100,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T01:10:33.008463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":804,"num_read_kb":763,"num_write":143,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"254'82","reported_seq":602,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:40.129947+0000","last_change":"2024-06-04T15:52:36.499047+0000","last_active":"2024-06-04T16:19:40.129947+0000","last_peered":"2024-06-04T16:19:40.129947+0000","last_clean":"2024-06-04T16:19:40.129947+0000","last_became_active":"2024-06-04T15:52:36.498706+0000","last_became_peered":"2024-06-04T15:52:36.498706+0000","last_unstale":"2024-06-04T16:19:40.129947+0000","last_undegraded":"2024-06-04T16:19:40.129947+0000","last_fullsized":"2024-06-04T16:19:40.129947+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T20:01:28.183971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1310773,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":124,"num_read_kb":7280,"num_write":368,"num_write_kb":33149,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":475,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:40.129985+0000","last_change":"2024-06-04T15:52:40.485318+0000","last_active":"2024-06-04T16:19:40.129985+0000","last_peered":"2024-06-04T16:19:40.129985+0000","last_clean":"2024-06-04T16:19:40.129985+0000","last_became_active":"2024-06-04T15:52:40.484285+0000","last_became_peered":"2024-06-04T15:52:40.484285+0000","last_unstale":"2024-06-04T16:19:40.129985+0000","last_undegraded":"2024-06-04T16:19:40.129985+0000","last_fullsized":"2024-06-04T16:19:40.129985+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_clean_scrub_stamp":"2024-06-04T15:52:39.463103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T23:36:57.821083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.e","version":"254'117","reported_seq":658,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:00.134781+0000","last_change":"2024-06-04T15:52:42.501168+0000","last_active":"2024-06-04T16:22:00.134781+0000","last_peered":"2024-06-04T16:22:00.134781+0000","last_clean":"2024-06-04T16:22:00.134781+0000","last_became_active":"2024-06-04T15:52:42.500865+0000","last_became_peered":"2024-06-04T15:52:42.500865+0000","last_unstale":"2024-06-04T16:22:00.134781+0000","last_undegraded":"2024-06-04T16:22:00.134781+0000","last_fullsized":"2024-06-04T16:22:00.134781+0000","mapping_epoch":27,"log_start":"251'100","ondisk_log_start":"251'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_clean_scrub_stamp":"2024-06-04T15:52:41.476734+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T22:23:11.038518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5455,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":165,"num_read_kb":159,"num_write":132,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":467,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:45.130828+0000","last_change":"2024-06-04T15:52:44.520519+0000","last_active":"2024-06-04T16:19:45.130828+0000","last_peered":"2024-06-04T16:19:45.130828+0000","last_clean":"2024-06-04T16:19:45.130828+0000","last_became_active":"2024-06-04T15:52:44.519542+0000","last_became_peered":"2024-06-04T15:52:44.519542+0000","last_unstale":"2024-06-04T16:19:45.130828+0000","last_undegraded":"2024-06-04T16:19:45.130828+0000","last_fullsized":"2024-06-04T16:19:45.130828+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_clean_scrub_stamp":"2024-06-04T15:52:43.492872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T22:23:21.493696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.0","version":"254'16","reported_seq":482,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:55.011781+0000","last_change":"2024-06-04T15:52:46.540191+0000","last_active":"2024-06-04T16:18:55.011781+0000","last_peered":"2024-06-04T16:18:55.011781+0000","last_clean":"2024-06-04T16:18:55.011781+0000","last_became_active":"2024-06-04T15:52:46.539906+0000","last_became_peered":"2024-06-04T15:52:46.539906+0000","last_unstale":"2024-06-04T16:18:55.011781+0000","last_undegraded":"2024-06-04T16:18:55.011781+0000","last_fullsized":"2024-06-04T16:18:55.011781+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:45.513877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:45.513877+0000","last_clean_scrub_stamp":"2024-06-04T15:52:45.513877+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T16:35:48.692745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":31,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"254'140","reported_seq":897,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:40.014533+0000","last_change":"2024-06-04T15:52:38.479098+0000","last_active":"2024-06-04T16:19:40.014533+0000","last_peered":"2024-06-04T16:19:40.014533+0000","last_clean":"2024-06-04T16:19:40.014533+0000","last_became_active":"2024-06-04T15:52:38.478691+0000","last_became_peered":"2024-06-04T15:52:38.478691+0000","last_unstale":"2024-06-04T16:19:40.014533+0000","last_undegraded":"2024-06-04T16:19:40.014533+0000","last_fullsized":"2024-06-04T16:19:40.014533+0000","mapping_epoch":23,"log_start":"251'100","ondisk_log_start":"251'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":100,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T20:41:58.834443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":683,"num_read_kb":634,"num_write":182,"num_write_kb":49,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"254'80","reported_seq":587,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:45.008382+0000","last_change":"2024-06-04T15:52:36.489783+0000","last_active":"2024-06-04T16:18:45.008382+0000","last_peered":"2024-06-04T16:18:45.008382+0000","last_clean":"2024-06-04T16:18:45.008382+0000","last_became_active":"2024-06-04T15:52:36.489437+0000","last_became_peered":"2024-06-04T15:52:36.489437+0000","last_unstale":"2024-06-04T16:18:45.008382+0000","last_undegraded":"2024-06-04T16:18:45.008382+0000","last_fullsized":"2024-06-04T16:18:45.008382+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T23:09:59.205888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133669,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":97,"num_read_kb":3905,"num_write":348,"num_write_kb":24180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":477,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:40.017716+0000","last_change":"2024-06-04T15:52:40.480878+0000","last_active":"2024-06-04T16:19:40.017716+0000","last_peered":"2024-06-04T16:19:40.017716+0000","last_clean":"2024-06-04T16:19:40.017716+0000","last_became_active":"2024-06-04T15:52:40.480568+0000","last_became_peered":"2024-06-04T15:52:40.480568+0000","last_unstale":"2024-06-04T16:19:40.017716+0000","last_undegraded":"2024-06-04T16:19:40.017716+0000","last_fullsized":"2024-06-04T16:19:40.017716+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_clean_scrub_stamp":"2024-06-04T15:52:39.463103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T22:05:18.609127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.f","version":"254'107","reported_seq":654,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:05.038886+0000","last_change":"2024-06-04T15:52:42.499311+0000","last_active":"2024-06-04T16:22:05.038886+0000","last_peered":"2024-06-04T16:22:05.038886+0000","last_clean":"2024-06-04T16:22:05.038886+0000","last_became_active":"2024-06-04T15:52:42.499014+0000","last_became_peered":"2024-06-04T15:52:42.499014+0000","last_unstale":"2024-06-04T16:22:05.038886+0000","last_undegraded":"2024-06-04T16:22:05.038886+0000","last_fullsized":"2024-06-04T16:22:05.038886+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_clean_scrub_stamp":"2024-06-04T15:52:41.476734+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T17:38:48.045987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10041,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":160,"num_read_kb":218,"num_write":84,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.e","version":"254'460","reported_seq":1440,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:32.410967+0000","last_change":"2024-06-04T15:52:44.520284+0000","last_active":"2024-06-04T16:22:32.410967+0000","last_peered":"2024-06-04T16:22:32.410967+0000","last_clean":"2024-06-04T16:22:32.410967+0000","last_became_active":"2024-06-04T15:52:44.520016+0000","last_became_peered":"2024-06-04T15:52:44.520016+0000","last_unstale":"2024-06-04T16:22:32.410967+0000","last_undegraded":"2024-06-04T16:22:32.410967+0000","last_fullsized":"2024-06-04T16:22:32.410967+0000","mapping_epoch":29,"log_start":"251'400","ondisk_log_start":"251'400","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_clean_scrub_stamp":"2024-06-04T15:52:43.492872+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":400,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T21:36:43.965699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1","version":"254'28","reported_seq":499,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:55.019299+0000","last_change":"2024-06-04T15:52:46.532842+0000","last_active":"2024-06-04T16:19:55.019299+0000","last_peered":"2024-06-04T16:19:55.019299+0000","last_clean":"2024-06-04T16:19:55.019299+0000","last_became_active":"2024-06-04T15:52:46.532554+0000","last_became_peered":"2024-06-04T15:52:46.532554+0000","last_unstale":"2024-06-04T16:19:55.019299+0000","last_undegraded":"2024-06-04T16:19:55.019299+0000","last_fullsized":"2024-06-04T16:19:55.019299+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:45.513877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:45.513877+0000","last_clean_scrub_stamp":"2024-06-04T15:52:45.513877+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T18:11:38.661962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":764,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":64,"num_read_kb":55,"num_write":77,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.e","version":"254'75","reported_seq":757,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:40.010221+0000","last_change":"2024-06-04T15:52:38.481543+0000","last_active":"2024-06-04T16:19:40.010221+0000","last_peered":"2024-06-04T16:19:40.010221+0000","last_clean":"2024-06-04T16:19:40.010221+0000","last_became_active":"2024-06-04T15:52:38.480961+0000","last_became_peered":"2024-06-04T15:52:38.480961+0000","last_unstale":"2024-06-04T16:19:40.010221+0000","last_undegraded":"2024-06-04T16:19:40.010221+0000","last_fullsized":"2024-06-04T16:19:40.010221+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T23:30:27.048500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":420,"num_read_kb":402,"num_write":82,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"254'43","reported_seq":541,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:40.007753+0000","last_change":"2024-06-04T15:52:36.485951+0000","last_active":"2024-06-04T16:18:40.007753+0000","last_peered":"2024-06-04T16:18:40.007753+0000","last_clean":"2024-06-04T16:18:40.007753+0000","last_became_active":"2024-06-04T15:52:36.485571+0000","last_became_peered":"2024-06-04T15:52:36.485571+0000","last_unstale":"2024-06-04T16:18:40.007753+0000","last_undegraded":"2024-06-04T16:18:40.007753+0000","last_fullsized":"2024-06-04T16:18:40.007753+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T01:39:00.786783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":66,"num_read_kb":9943,"num_write":198,"num_write_kb":32171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"26'2","reported_seq":1081,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:32.131043+0000","last_change":"2024-06-04T15:52:40.477976+0000","last_active":"2024-06-04T16:22:32.131043+0000","last_peered":"2024-06-04T16:22:32.131043+0000","last_clean":"2024-06-04T16:22:32.131043+0000","last_became_active":"2024-06-04T15:52:40.477693+0000","last_became_peered":"2024-06-04T15:52:40.477693+0000","last_unstale":"2024-06-04T16:22:32.131043+0000","last_undegraded":"2024-06-04T16:22:32.131043+0000","last_fullsized":"2024-06-04T16:22:32.131043+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_clean_scrub_stamp":"2024-06-04T15:52:39.463103+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T15:57:27.865623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":602,"num_read_kb":602,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"251'35","reported_seq":517,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:45.017668+0000","last_change":"2024-06-04T15:52:42.503779+0000","last_active":"2024-06-04T16:19:45.017668+0000","last_peered":"2024-06-04T16:19:45.017668+0000","last_clean":"2024-06-04T16:19:45.017668+0000","last_became_active":"2024-06-04T15:52:42.503184+0000","last_became_peered":"2024-06-04T15:52:42.503184+0000","last_unstale":"2024-06-04T16:19:45.017668+0000","last_undegraded":"2024-06-04T16:19:45.017668+0000","last_fullsized":"2024-06-04T16:19:45.017668+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_clean_scrub_stamp":"2024-06-04T15:52:41.476734+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T01:25:31.440819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":45,"num_read_kb":40,"num_write":30,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.d","version":"254'467","reported_seq":1620,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:32.411887+0000","last_change":"2024-06-04T15:52:44.518741+0000","last_active":"2024-06-04T16:22:32.411887+0000","last_peered":"2024-06-04T16:22:32.411887+0000","last_clean":"2024-06-04T16:22:32.411887+0000","last_became_active":"2024-06-04T15:52:44.518522+0000","last_became_peered":"2024-06-04T15:52:44.518522+0000","last_unstale":"2024-06-04T16:22:32.411887+0000","last_undegraded":"2024-06-04T16:22:32.411887+0000","last_fullsized":"2024-06-04T16:22:32.411887+0000","mapping_epoch":29,"log_start":"251'400","ondisk_log_start":"251'400","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_clean_scrub_stamp":"2024-06-04T15:52:43.492872+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":400,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T17:21:25.625424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"254'25","reported_seq":493,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:55.011771+0000","last_change":"2024-06-04T15:52:46.529500+0000","last_active":"2024-06-04T16:19:55.011771+0000","last_peered":"2024-06-04T16:19:55.011771+0000","last_clean":"2024-06-04T16:19:55.011771+0000","last_became_active":"2024-06-04T15:52:46.529183+0000","last_became_peered":"2024-06-04T15:52:46.529183+0000","last_unstale":"2024-06-04T16:19:55.011771+0000","last_undegraded":"2024-06-04T16:19:55.011771+0000","last_fullsized":"2024-06-04T16:19:55.011771+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:45.513877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:45.513877+0000","last_clean_scrub_stamp":"2024-06-04T15:52:45.513877+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T02:50:02.857177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":33,"num_read_kb":31,"num_write":52,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"254'102","reported_seq":866,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:40.130050+0000","last_change":"2024-06-04T15:52:38.485496+0000","last_active":"2024-06-04T16:19:40.130050+0000","last_peered":"2024-06-04T16:19:40.130050+0000","last_clean":"2024-06-04T16:19:40.130050+0000","last_became_active":"2024-06-04T15:52:38.485146+0000","last_became_peered":"2024-06-04T15:52:38.485146+0000","last_unstale":"2024-06-04T16:19:40.130050+0000","last_undegraded":"2024-06-04T16:19:40.130050+0000","last_fullsized":"2024-06-04T16:19:40.130050+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T21:02:08.479603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":573,"num_read_kb":549,"num_write":116,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"251'24","reported_seq":516,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:40.009093+0000","last_change":"2024-06-04T15:52:36.475660+0000","last_active":"2024-06-04T16:18:40.009093+0000","last_peered":"2024-06-04T16:18:40.009093+0000","last_clean":"2024-06-04T16:18:40.009093+0000","last_became_active":"2024-06-04T15:52:36.475290+0000","last_became_peered":"2024-06-04T15:52:36.475290+0000","last_unstale":"2024-06-04T16:18:40.009093+0000","last_undegraded":"2024-06-04T16:18:40.009093+0000","last_fullsized":"2024-06-04T16:18:40.009093+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T20:08:50.243935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":22,"num_read_kb":15371,"num_write":75,"num_write_kb":21019,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,2],"acting":[4,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":474,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:40.014557+0000","last_change":"2024-06-04T15:52:40.482222+0000","last_active":"2024-06-04T16:19:40.014557+0000","last_peered":"2024-06-04T16:19:40.014557+0000","last_clean":"2024-06-04T16:19:40.014557+0000","last_became_active":"2024-06-04T15:52:40.481856+0000","last_became_peered":"2024-06-04T15:52:40.481856+0000","last_unstale":"2024-06-04T16:19:40.014557+0000","last_undegraded":"2024-06-04T16:19:40.014557+0000","last_fullsized":"2024-06-04T16:19:40.014557+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_clean_scrub_stamp":"2024-06-04T15:52:39.463103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T21:21:46.829568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"254'137","reported_seq":702,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:00.134761+0000","last_change":"2024-06-04T15:52:42.503483+0000","last_active":"2024-06-04T16:22:00.134761+0000","last_peered":"2024-06-04T16:22:00.134761+0000","last_clean":"2024-06-04T16:22:00.134761+0000","last_became_active":"2024-06-04T15:52:42.503214+0000","last_became_peered":"2024-06-04T15:52:42.503214+0000","last_unstale":"2024-06-04T16:22:00.134761+0000","last_undegraded":"2024-06-04T16:22:00.134761+0000","last_fullsized":"2024-06-04T16:22:00.134761+0000","mapping_epoch":27,"log_start":"251'100","ondisk_log_start":"251'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_clean_scrub_stamp":"2024-06-04T15:52:41.476734+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":100,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T18:55:21.822380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27149,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":232,"num_read_kb":309,"num_write":170,"num_write_kb":95,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":465,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:45.010700+0000","last_change":"2024-06-04T15:52:44.514586+0000","last_active":"2024-06-04T16:19:45.010700+0000","last_peered":"2024-06-04T16:19:45.010700+0000","last_clean":"2024-06-04T16:19:45.010700+0000","last_became_active":"2024-06-04T15:52:44.514269+0000","last_became_peered":"2024-06-04T15:52:44.514269+0000","last_unstale":"2024-06-04T16:19:45.010700+0000","last_undegraded":"2024-06-04T16:19:45.010700+0000","last_fullsized":"2024-06-04T16:19:45.010700+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_clean_scrub_stamp":"2024-06-04T15:52:43.492872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T22:14:52.172379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"254'31","reported_seq":503,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:55.132073+0000","last_change":"2024-06-04T15:52:46.532569+0000","last_active":"2024-06-04T16:19:55.132073+0000","last_peered":"2024-06-04T16:19:55.132073+0000","last_clean":"2024-06-04T16:19:55.132073+0000","last_became_active":"2024-06-04T15:52:46.531977+0000","last_became_peered":"2024-06-04T15:52:46.531977+0000","last_unstale":"2024-06-04T16:19:55.132073+0000","last_undegraded":"2024-06-04T16:19:55.132073+0000","last_fullsized":"2024-06-04T16:19:55.132073+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:45.513877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:45.513877+0000","last_clean_scrub_stamp":"2024-06-04T15:52:45.513877+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T23:12:23.178842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":49,"num_write":79,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"254'144","reported_seq":952,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:50.015669+0000","last_change":"2024-06-04T15:52:38.478958+0000","last_active":"2024-06-04T16:19:50.015669+0000","last_peered":"2024-06-04T16:19:50.015669+0000","last_clean":"2024-06-04T16:19:50.015669+0000","last_became_active":"2024-06-04T15:52:38.478362+0000","last_became_peered":"2024-06-04T15:52:38.478362+0000","last_unstale":"2024-06-04T16:19:50.015669+0000","last_undegraded":"2024-06-04T16:19:50.015669+0000","last_fullsized":"2024-06-04T16:19:50.015669+0000","mapping_epoch":23,"log_start":"251'100","ondisk_log_start":"251'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T22:47:09.266351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":807,"num_read_kb":748,"num_write":182,"num_write_kb":49,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":496,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:20:25.125218+0000","last_change":"2024-06-04T15:52:22.417765+0000","last_active":"2024-06-04T16:20:25.125218+0000","last_peered":"2024-06-04T16:20:25.125218+0000","last_clean":"2024-06-04T16:20:25.125218+0000","last_became_active":"2024-06-04T15:52:22.417462+0000","last_became_peered":"2024-06-04T15:52:22.417462+0000","last_unstale":"2024-06-04T16:20:25.125218+0000","last_undegraded":"2024-06-04T16:20:25.125218+0000","last_fullsized":"2024-06-04T16:20:25.125218+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:21.400880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:21.400880+0000","last_clean_scrub_stamp":"2024-06-04T15:52:21.400880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T01:56:18.510923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"251'43","reported_seq":534,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:45.017794+0000","last_change":"2024-06-04T15:52:36.498057+0000","last_active":"2024-06-04T16:19:45.017794+0000","last_peered":"2024-06-04T16:19:45.017794+0000","last_clean":"2024-06-04T16:19:45.017794+0000","last_became_active":"2024-06-04T15:52:36.497603+0000","last_became_peered":"2024-06-04T15:52:36.497603+0000","last_unstale":"2024-06-04T16:19:45.017794+0000","last_undegraded":"2024-06-04T16:19:45.017794+0000","last_fullsized":"2024-06-04T16:19:45.017794+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T21:06:13.700958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1069190,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":32,"num_read_kb":263,"num_write":148,"num_write_kb":16917,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,0],"acting":[4,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":478,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:45.010145+0000","last_change":"2024-06-04T15:52:40.483375+0000","last_active":"2024-06-04T16:19:45.010145+0000","last_peered":"2024-06-04T16:19:45.010145+0000","last_clean":"2024-06-04T16:19:45.010145+0000","last_became_active":"2024-06-04T15:52:40.482529+0000","last_became_peered":"2024-06-04T15:52:40.482529+0000","last_unstale":"2024-06-04T16:19:45.010145+0000","last_undegraded":"2024-06-04T16:19:45.010145+0000","last_fullsized":"2024-06-04T16:19:45.010145+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_clean_scrub_stamp":"2024-06-04T15:52:39.463103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T19:54:15.030371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"254'232","reported_seq":891,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:32.383974+0000","last_change":"2024-06-04T15:52:42.497154+0000","last_active":"2024-06-04T16:22:32.383974+0000","last_peered":"2024-06-04T16:22:32.383974+0000","last_clean":"2024-06-04T16:22:32.383974+0000","last_became_active":"2024-06-04T15:52:42.496878+0000","last_became_peered":"2024-06-04T15:52:42.496878+0000","last_unstale":"2024-06-04T16:22:32.383974+0000","last_undegraded":"2024-06-04T16:22:32.383974+0000","last_fullsized":"2024-06-04T16:22:32.383974+0000","mapping_epoch":27,"log_start":"251'200","ondisk_log_start":"251'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_clean_scrub_stamp":"2024-06-04T15:52:41.476734+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":200,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T19:44:50.163372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30577,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":471,"num_read_kb":664,"num_write":388,"num_write_kb":281,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":469,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:45.010474+0000","last_change":"2024-06-04T15:52:44.514011+0000","last_active":"2024-06-04T16:18:45.010474+0000","last_peered":"2024-06-04T16:18:45.010474+0000","last_clean":"2024-06-04T16:18:45.010474+0000","last_became_active":"2024-06-04T15:52:44.513726+0000","last_became_peered":"2024-06-04T15:52:44.513726+0000","last_unstale":"2024-06-04T16:18:45.010474+0000","last_undegraded":"2024-06-04T16:18:45.010474+0000","last_fullsized":"2024-06-04T16:18:45.010474+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_clean_scrub_stamp":"2024-06-04T15:52:43.492872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T19:48:02.146293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"254'34","reported_seq":516,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:50.004737+0000","last_change":"2024-06-04T15:52:46.536565+0000","last_active":"2024-06-04T16:18:50.004737+0000","last_peered":"2024-06-04T16:18:50.004737+0000","last_clean":"2024-06-04T16:18:50.004737+0000","last_became_active":"2024-06-04T15:52:46.536184+0000","last_became_peered":"2024-06-04T15:52:46.536184+0000","last_unstale":"2024-06-04T16:18:50.004737+0000","last_undegraded":"2024-06-04T16:18:50.004737+0000","last_fullsized":"2024-06-04T16:18:50.004737+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:45.513877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:45.513877+0000","last_clean_scrub_stamp":"2024-06-04T15:52:45.513877+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T22:45:30.543372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":408,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":64,"num_read_kb":61,"num_write":79,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"254'172","reported_seq":973,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:45.017681+0000","last_change":"2024-06-04T15:52:38.474997+0000","last_active":"2024-06-04T16:19:45.017681+0000","last_peered":"2024-06-04T16:19:45.017681+0000","last_clean":"2024-06-04T16:19:45.017681+0000","last_became_active":"2024-06-04T15:52:38.474646+0000","last_became_peered":"2024-06-04T15:52:38.474646+0000","last_unstale":"2024-06-04T16:19:45.017681+0000","last_undegraded":"2024-06-04T16:19:45.017681+0000","last_fullsized":"2024-06-04T16:19:45.017681+0000","mapping_epoch":23,"log_start":"251'100","ondisk_log_start":"251'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":100,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T03:13:37.646203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":944,"num_read_kb":866,"num_write":217,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":493,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:25.012795+0000","last_change":"2024-06-04T15:52:22.777198+0000","last_active":"2024-06-04T16:19:25.012795+0000","last_peered":"2024-06-04T16:19:25.012795+0000","last_clean":"2024-06-04T16:19:25.012795+0000","last_became_active":"2024-06-04T15:52:22.776779+0000","last_became_peered":"2024-06-04T15:52:22.776779+0000","last_unstale":"2024-06-04T16:19:25.012795+0000","last_undegraded":"2024-06-04T16:19:25.012795+0000","last_fullsized":"2024-06-04T16:19:25.012795+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:21.400880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:21.400880+0000","last_clean_scrub_stamp":"2024-06-04T15:52:21.400880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T02:49:10.441919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"251'43","reported_seq":539,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:45.010124+0000","last_change":"2024-06-04T15:52:36.495013+0000","last_active":"2024-06-04T16:19:45.010124+0000","last_peered":"2024-06-04T16:19:45.010124+0000","last_clean":"2024-06-04T16:19:45.010124+0000","last_became_active":"2024-06-04T15:52:36.494711+0000","last_became_peered":"2024-06-04T15:52:36.494711+0000","last_unstale":"2024-06-04T16:19:45.010124+0000","last_undegraded":"2024-06-04T16:19:45.010124+0000","last_fullsized":"2024-06-04T16:19:45.010124+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T22:50:20.789950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20644,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":32,"num_read_kb":101,"num_write":157,"num_write_kb":20554,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,4],"acting":[0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":476,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:45.130774+0000","last_change":"2024-06-04T15:52:40.485086+0000","last_active":"2024-06-04T16:19:45.130774+0000","last_peered":"2024-06-04T16:19:45.130774+0000","last_clean":"2024-06-04T16:19:45.130774+0000","last_became_active":"2024-06-04T15:52:40.484698+0000","last_became_peered":"2024-06-04T15:52:40.484698+0000","last_unstale":"2024-06-04T16:19:45.130774+0000","last_undegraded":"2024-06-04T16:19:45.130774+0000","last_fullsized":"2024-06-04T16:19:45.130774+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_clean_scrub_stamp":"2024-06-04T15:52:39.463103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T18:54:22.275767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"251'83","reported_seq":589,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:45.010464+0000","last_change":"2024-06-04T15:52:42.500941+0000","last_active":"2024-06-04T16:18:45.010464+0000","last_peered":"2024-06-04T16:18:45.010464+0000","last_clean":"2024-06-04T16:18:45.010464+0000","last_became_active":"2024-06-04T15:52:42.500646+0000","last_became_peered":"2024-06-04T15:52:42.500646+0000","last_unstale":"2024-06-04T16:18:45.010464+0000","last_undegraded":"2024-06-04T16:18:45.010464+0000","last_fullsized":"2024-06-04T16:18:45.010464+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_clean_scrub_stamp":"2024-06-04T15:52:41.476734+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T22:44:47.011875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":102,"num_read_kb":94,"num_write":72,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":466,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:45.008452+0000","last_change":"2024-06-04T15:52:44.521167+0000","last_active":"2024-06-04T16:18:45.008452+0000","last_peered":"2024-06-04T16:18:45.008452+0000","last_clean":"2024-06-04T16:18:45.008452+0000","last_became_active":"2024-06-04T15:52:44.520841+0000","last_became_peered":"2024-06-04T15:52:44.520841+0000","last_unstale":"2024-06-04T16:18:45.008452+0000","last_undegraded":"2024-06-04T16:18:45.008452+0000","last_fullsized":"2024-06-04T16:18:45.008452+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_clean_scrub_stamp":"2024-06-04T15:52:43.492872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T01:14:42.414240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"251'34","reported_seq":534,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:50.115154+0000","last_change":"2024-06-04T15:52:46.540297+0000","last_active":"2024-06-04T16:18:50.115154+0000","last_peered":"2024-06-04T16:18:50.115154+0000","last_clean":"2024-06-04T16:18:50.115154+0000","last_became_active":"2024-06-04T15:52:46.539931+0000","last_became_peered":"2024-06-04T15:52:46.539931+0000","last_unstale":"2024-06-04T16:18:50.115154+0000","last_undegraded":"2024-06-04T16:18:50.115154+0000","last_fullsized":"2024-06-04T16:18:50.115154+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:45.513877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:45.513877+0000","last_clean_scrub_stamp":"2024-06-04T15:52:45.513877+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T01:12:43.841169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":127,"num_read_kb":111,"num_write":92,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"254'119","reported_seq":1028,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:40.008889+0000","last_change":"2024-06-04T15:52:38.486040+0000","last_active":"2024-06-04T16:18:40.008889+0000","last_peered":"2024-06-04T16:18:40.008889+0000","last_clean":"2024-06-04T16:18:40.008889+0000","last_became_active":"2024-06-04T15:52:38.485755+0000","last_became_peered":"2024-06-04T15:52:38.485755+0000","last_unstale":"2024-06-04T16:18:40.008889+0000","last_undegraded":"2024-06-04T16:18:40.008889+0000","last_fullsized":"2024-06-04T16:18:40.008889+0000","mapping_epoch":23,"log_start":"254'100","ondisk_log_start":"254'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":100,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T16:25:57.227817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":989,"num_read_kb":963,"num_write":137,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":495,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:30.008638+0000","last_change":"2024-06-04T15:52:22.423235+0000","last_active":"2024-06-04T16:19:30.008638+0000","last_peered":"2024-06-04T16:19:30.008638+0000","last_clean":"2024-06-04T16:19:30.008638+0000","last_became_active":"2024-06-04T15:52:22.422971+0000","last_became_peered":"2024-06-04T15:52:22.422971+0000","last_unstale":"2024-06-04T16:19:30.008638+0000","last_undegraded":"2024-06-04T16:19:30.008638+0000","last_fullsized":"2024-06-04T16:19:30.008638+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:21.400880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:21.400880+0000","last_clean_scrub_stamp":"2024-06-04T15:52:21.400880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T16:30:17.573588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"254'70","reported_seq":609,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:45.010321+0000","last_change":"2024-06-04T15:52:36.485796+0000","last_active":"2024-06-04T16:18:45.010321+0000","last_peered":"2024-06-04T16:18:45.010321+0000","last_clean":"2024-06-04T16:18:45.010321+0000","last_became_active":"2024-06-04T15:52:36.485475+0000","last_became_peered":"2024-06-04T15:52:36.485475+0000","last_unstale":"2024-06-04T16:18:45.010321+0000","last_undegraded":"2024-06-04T16:18:45.010321+0000","last_fullsized":"2024-06-04T16:18:45.010321+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T22:10:16.220150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3475557,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":107,"num_read_kb":62832,"num_write":267,"num_write_kb":45136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,2],"acting":[5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"26'1","reported_seq":476,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:40.121529+0000","last_change":"2024-06-04T15:52:40.486597+0000","last_active":"2024-06-04T16:18:40.121529+0000","last_peered":"2024-06-04T16:18:40.121529+0000","last_clean":"2024-06-04T16:18:40.121529+0000","last_became_active":"2024-06-04T15:52:40.486003+0000","last_became_peered":"2024-06-04T15:52:40.486003+0000","last_unstale":"2024-06-04T16:18:40.121529+0000","last_undegraded":"2024-06-04T16:18:40.121529+0000","last_fullsized":"2024-06-04T16:18:40.121529+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_clean_scrub_stamp":"2024-06-04T15:52:39.463103+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T00:11:15.750860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"254'117","reported_seq":991,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:29.585274+0000","last_change":"2024-06-04T15:52:42.505519+0000","last_active":"2024-06-04T16:22:29.585274+0000","last_peered":"2024-06-04T16:22:29.585274+0000","last_clean":"2024-06-04T16:22:29.585274+0000","last_became_active":"2024-06-04T15:52:42.505250+0000","last_became_peered":"2024-06-04T15:52:42.505250+0000","last_unstale":"2024-06-04T16:22:29.585274+0000","last_undegraded":"2024-06-04T16:22:29.585274+0000","last_fullsized":"2024-06-04T16:22:29.585274+0000","mapping_epoch":27,"log_start":"251'100","ondisk_log_start":"251'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_clean_scrub_stamp":"2024-06-04T15:52:41.476734+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T23:03:14.546926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":113,"num_read_kb":103,"num_write":67,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":468,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:50.018609+0000","last_change":"2024-06-04T15:52:44.522460+0000","last_active":"2024-06-04T16:19:50.018609+0000","last_peered":"2024-06-04T16:19:50.018609+0000","last_clean":"2024-06-04T16:19:50.018609+0000","last_became_active":"2024-06-04T15:52:44.522168+0000","last_became_peered":"2024-06-04T15:52:44.522168+0000","last_unstale":"2024-06-04T16:19:50.018609+0000","last_undegraded":"2024-06-04T16:19:50.018609+0000","last_fullsized":"2024-06-04T16:19:50.018609+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_clean_scrub_stamp":"2024-06-04T15:52:43.492872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T20:17:24.091454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.b","version":"254'111","reported_seq":601,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:50.018584+0000","last_change":"2024-06-04T15:52:46.537611+0000","last_active":"2024-06-04T16:19:50.018584+0000","last_peered":"2024-06-04T16:19:50.018584+0000","last_clean":"2024-06-04T16:19:50.018584+0000","last_became_active":"2024-06-04T15:52:46.537377+0000","last_became_peered":"2024-06-04T15:52:46.537377+0000","last_unstale":"2024-06-04T16:19:50.018584+0000","last_undegraded":"2024-06-04T16:19:50.018584+0000","last_fullsized":"2024-06-04T16:19:50.018584+0000","mapping_epoch":31,"log_start":"251'100","ondisk_log_start":"251'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:45.513877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:45.513877+0000","last_clean_scrub_stamp":"2024-06-04T15:52:45.513877+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":100,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T22:06:04.608286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":232,"num_read_kb":256,"num_write":227,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.6","version":"254'74","reported_seq":765,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:40.009736+0000","last_change":"2024-06-04T15:52:38.487720+0000","last_active":"2024-06-04T16:18:40.009736+0000","last_peered":"2024-06-04T16:18:40.009736+0000","last_clean":"2024-06-04T16:18:40.009736+0000","last_became_active":"2024-06-04T15:52:38.487359+0000","last_became_peered":"2024-06-04T15:52:38.487359+0000","last_unstale":"2024-06-04T16:18:40.009736+0000","last_undegraded":"2024-06-04T16:18:40.009736+0000","last_fullsized":"2024-06-04T16:18:40.009736+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T16:18:23.773829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":431,"num_read_kb":414,"num_write":84,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":494,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:30.015833+0000","last_change":"2024-06-04T15:52:22.423963+0000","last_active":"2024-06-04T16:19:30.015833+0000","last_peered":"2024-06-04T16:19:30.015833+0000","last_clean":"2024-06-04T16:19:30.015833+0000","last_became_active":"2024-06-04T15:52:22.423712+0000","last_became_peered":"2024-06-04T15:52:22.423712+0000","last_unstale":"2024-06-04T16:19:30.015833+0000","last_undegraded":"2024-06-04T16:19:30.015833+0000","last_fullsized":"2024-06-04T16:19:30.015833+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:21.400880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:21.400880+0000","last_clean_scrub_stamp":"2024-06-04T15:52:21.400880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T02:49:57.732530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"17'72","reported_seq":584,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:20:30.020067+0000","last_change":"2024-06-04T15:52:22.429522+0000","last_active":"2024-06-04T16:20:30.020067+0000","last_peered":"2024-06-04T16:20:30.020067+0000","last_clean":"2024-06-04T16:20:30.020067+0000","last_became_active":"2024-06-04T15:52:22.428356+0000","last_became_peered":"2024-06-04T15:52:22.428356+0000","last_unstale":"2024-06-04T16:20:30.020067+0000","last_undegraded":"2024-06-04T16:20:30.020067+0000","last_fullsized":"2024-06-04T16:20:30.020067+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:21.400880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:21.400880+0000","last_clean_scrub_stamp":"2024-06-04T15:52:21.400880+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T18:42:36.118905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"254'72","reported_seq":580,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:45.017581+0000","last_change":"2024-06-04T15:52:36.488969+0000","last_active":"2024-06-04T16:19:45.017581+0000","last_peered":"2024-06-04T16:19:45.017581+0000","last_clean":"2024-06-04T16:19:45.017581+0000","last_became_active":"2024-06-04T15:52:36.488567+0000","last_became_peered":"2024-06-04T15:52:36.488567+0000","last_unstale":"2024-06-04T16:19:45.017581+0000","last_undegraded":"2024-06-04T16:19:45.017581+0000","last_fullsized":"2024-06-04T16:19:45.017581+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T22:39:10.146956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133705,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":100,"num_read_kb":15171,"num_write":323,"num_write_kb":30782,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,4],"acting":[6,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":474,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:40.007854+0000","last_change":"2024-06-04T15:52:40.479422+0000","last_active":"2024-06-04T16:18:40.007854+0000","last_peered":"2024-06-04T16:18:40.007854+0000","last_clean":"2024-06-04T16:18:40.007854+0000","last_became_active":"2024-06-04T15:52:40.479168+0000","last_became_peered":"2024-06-04T15:52:40.479168+0000","last_unstale":"2024-06-04T16:18:40.007854+0000","last_undegraded":"2024-06-04T16:18:40.007854+0000","last_fullsized":"2024-06-04T16:18:40.007854+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_clean_scrub_stamp":"2024-06-04T15:52:39.463103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T20:31:07.436900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"254'547","reported_seq":1711,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:32.406922+0000","last_change":"2024-06-04T15:52:42.503507+0000","last_active":"2024-06-04T16:22:32.406922+0000","last_peered":"2024-06-04T16:22:32.406922+0000","last_clean":"2024-06-04T16:22:32.406922+0000","last_became_active":"2024-06-04T15:52:42.503178+0000","last_became_peered":"2024-06-04T15:52:42.503178+0000","last_unstale":"2024-06-04T16:22:32.406922+0000","last_undegraded":"2024-06-04T16:22:32.406922+0000","last_fullsized":"2024-06-04T16:22:32.406922+0000","mapping_epoch":27,"log_start":"251'500","ondisk_log_start":"251'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_clean_scrub_stamp":"2024-06-04T15:52:41.476734+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":500,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T20:05:37.750208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31661,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":811,"num_read_kb":1005,"num_write":178,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":467,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:55.016249+0000","last_change":"2024-06-04T15:52:44.523212+0000","last_active":"2024-06-04T16:19:55.016249+0000","last_peered":"2024-06-04T16:19:55.016249+0000","last_clean":"2024-06-04T16:19:55.016249+0000","last_became_active":"2024-06-04T15:52:44.522475+0000","last_became_peered":"2024-06-04T15:52:44.522475+0000","last_unstale":"2024-06-04T16:19:55.016249+0000","last_undegraded":"2024-06-04T16:19:55.016249+0000","last_fullsized":"2024-06-04T16:19:55.016249+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_clean_scrub_stamp":"2024-06-04T15:52:43.492872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T23:00:33.107705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"254'71","reported_seq":556,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:55.011834+0000","last_change":"2024-06-04T15:52:46.542179+0000","last_active":"2024-06-04T16:18:55.011834+0000","last_peered":"2024-06-04T16:18:55.011834+0000","last_clean":"2024-06-04T16:18:55.011834+0000","last_became_active":"2024-06-04T15:52:46.541851+0000","last_became_peered":"2024-06-04T15:52:46.541851+0000","last_unstale":"2024-06-04T16:18:55.011834+0000","last_undegraded":"2024-06-04T16:18:55.011834+0000","last_fullsized":"2024-06-04T16:18:55.011834+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:45.513877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:45.513877+0000","last_clean_scrub_stamp":"2024-06-04T15:52:45.513877+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T00:45:41.120418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":147,"num_read_kb":147,"num_write":159,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1","version":"254'115","reported_seq":812,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:45.010653+0000","last_change":"2024-06-04T15:52:38.485610+0000","last_active":"2024-06-04T16:19:45.010653+0000","last_peered":"2024-06-04T16:19:45.010653+0000","last_clean":"2024-06-04T16:19:45.010653+0000","last_became_active":"2024-06-04T15:52:38.485314+0000","last_became_peered":"2024-06-04T15:52:38.485314+0000","last_unstale":"2024-06-04T16:19:45.010653+0000","last_undegraded":"2024-06-04T16:19:45.010653+0000","last_fullsized":"2024-06-04T16:19:45.010653+0000","mapping_epoch":23,"log_start":"251'100","ondisk_log_start":"251'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":100,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T18:49:42.990690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":554,"num_read_kb":505,"num_write":149,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"251'78","reported_seq":587,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:40.009180+0000","last_change":"2024-06-04T15:52:36.479114+0000","last_active":"2024-06-04T16:18:40.009180+0000","last_peered":"2024-06-04T16:18:40.009180+0000","last_clean":"2024-06-04T16:18:40.009180+0000","last_became_active":"2024-06-04T15:52:36.478729+0000","last_became_peered":"2024-06-04T15:52:36.478729+0000","last_unstale":"2024-06-04T16:18:40.009180+0000","last_undegraded":"2024-06-04T16:18:40.009180+0000","last_fullsized":"2024-06-04T16:18:40.009180+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T01:31:26.285385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6659325,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":108,"num_read_kb":2222,"num_write":295,"num_write_kb":32111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,1],"acting":[4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":494,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:30.128608+0000","last_change":"2024-06-04T15:52:22.429208+0000","last_active":"2024-06-04T16:19:30.128608+0000","last_peered":"2024-06-04T16:19:30.128608+0000","last_clean":"2024-06-04T16:19:30.128608+0000","last_became_active":"2024-06-04T15:52:22.428894+0000","last_became_peered":"2024-06-04T15:52:22.428894+0000","last_unstale":"2024-06-04T16:19:30.128608+0000","last_undegraded":"2024-06-04T16:19:30.128608+0000","last_fullsized":"2024-06-04T16:19:30.128608+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:21.400880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:21.400880+0000","last_clean_scrub_stamp":"2024-06-04T15:52:21.400880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T18:26:12.779439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":476,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:45.009808+0000","last_change":"2024-06-04T15:52:40.479253+0000","last_active":"2024-06-04T16:18:45.009808+0000","last_peered":"2024-06-04T16:18:45.009808+0000","last_clean":"2024-06-04T16:18:45.009808+0000","last_became_active":"2024-06-04T15:52:40.478970+0000","last_became_peered":"2024-06-04T15:52:40.478970+0000","last_unstale":"2024-06-04T16:18:45.009808+0000","last_undegraded":"2024-06-04T16:18:45.009808+0000","last_fullsized":"2024-06-04T16:18:45.009808+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_clean_scrub_stamp":"2024-06-04T15:52:39.463103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T00:22:45.981375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"254'244","reported_seq":916,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:32.373366+0000","last_change":"2024-06-04T15:52:42.505691+0000","last_active":"2024-06-04T16:22:32.373366+0000","last_peered":"2024-06-04T16:22:32.373366+0000","last_clean":"2024-06-04T16:22:32.373366+0000","last_became_active":"2024-06-04T15:52:42.504735+0000","last_became_peered":"2024-06-04T15:52:42.504735+0000","last_unstale":"2024-06-04T16:22:32.373366+0000","last_undegraded":"2024-06-04T16:22:32.373366+0000","last_fullsized":"2024-06-04T16:22:32.373366+0000","mapping_epoch":27,"log_start":"251'200","ondisk_log_start":"251'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_clean_scrub_stamp":"2024-06-04T15:52:41.476734+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":200,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T23:26:21.492914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22990,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":382,"num_read_kb":526,"num_write":178,"num_write_kb":35,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":468,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:50.018529+0000","last_change":"2024-06-04T15:52:44.523070+0000","last_active":"2024-06-04T16:19:50.018529+0000","last_peered":"2024-06-04T16:19:50.018529+0000","last_clean":"2024-06-04T16:19:50.018529+0000","last_became_active":"2024-06-04T15:52:44.522746+0000","last_became_peered":"2024-06-04T15:52:44.522746+0000","last_unstale":"2024-06-04T16:19:50.018529+0000","last_undegraded":"2024-06-04T16:19:50.018529+0000","last_fullsized":"2024-06-04T16:19:50.018529+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_clean_scrub_stamp":"2024-06-04T15:52:43.492872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T02:29:17.973008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.d","version":"254'26","reported_seq":498,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:50.011272+0000","last_change":"2024-06-04T15:52:46.530753+0000","last_active":"2024-06-04T16:19:50.011272+0000","last_peered":"2024-06-04T16:19:50.011272+0000","last_clean":"2024-06-04T16:19:50.011272+0000","last_became_active":"2024-06-04T15:52:46.530480+0000","last_became_peered":"2024-06-04T15:52:46.530480+0000","last_unstale":"2024-06-04T16:19:50.011272+0000","last_undegraded":"2024-06-04T16:19:50.011272+0000","last_fullsized":"2024-06-04T16:19:50.011272+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:45.513877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:45.513877+0000","last_clean_scrub_stamp":"2024-06-04T15:52:45.513877+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T21:20:10.067602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":260,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":42,"num_read_kb":31,"num_write":58,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"254'173","reported_seq":1002,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:45.009776+0000","last_change":"2024-06-04T15:52:38.485046+0000","last_active":"2024-06-04T16:18:45.009776+0000","last_peered":"2024-06-04T16:18:45.009776+0000","last_clean":"2024-06-04T16:18:45.009776+0000","last_became_active":"2024-06-04T15:52:38.484384+0000","last_became_peered":"2024-06-04T15:52:38.484384+0000","last_unstale":"2024-06-04T16:18:45.009776+0000","last_undegraded":"2024-06-04T16:18:45.009776+0000","last_fullsized":"2024-06-04T16:18:45.009776+0000","mapping_epoch":23,"log_start":"251'100","ondisk_log_start":"251'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":100,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T21:07:28.223775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":881,"num_read_kb":808,"num_write":233,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"251'46","reported_seq":543,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:40.009204+0000","last_change":"2024-06-04T15:52:36.478112+0000","last_active":"2024-06-04T16:18:40.009204+0000","last_peered":"2024-06-04T16:18:40.009204+0000","last_clean":"2024-06-04T16:18:40.009204+0000","last_became_active":"2024-06-04T15:52:36.477622+0000","last_became_peered":"2024-06-04T15:52:36.477622+0000","last_unstale":"2024-06-04T16:18:40.009204+0000","last_undegraded":"2024-06-04T16:18:40.009204+0000","last_fullsized":"2024-06-04T16:18:40.009204+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T20:13:45.546860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":45,"num_write":152,"num_write_kb":28742,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":492,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:35.009750+0000","last_change":"2024-06-04T15:52:22.777104+0000","last_active":"2024-06-04T16:19:35.009750+0000","last_peered":"2024-06-04T16:19:35.009750+0000","last_clean":"2024-06-04T16:19:35.009750+0000","last_became_active":"2024-06-04T15:52:22.776744+0000","last_became_peered":"2024-06-04T15:52:22.776744+0000","last_unstale":"2024-06-04T16:19:35.009750+0000","last_undegraded":"2024-06-04T16:19:35.009750+0000","last_fullsized":"2024-06-04T16:19:35.009750+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:21.400880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:21.400880+0000","last_clean_scrub_stamp":"2024-06-04T15:52:21.400880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T17:51:56.775723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":475,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:45.015027+0000","last_change":"2024-06-04T15:52:40.479829+0000","last_active":"2024-06-04T16:19:45.015027+0000","last_peered":"2024-06-04T16:19:45.015027+0000","last_clean":"2024-06-04T16:19:45.015027+0000","last_became_active":"2024-06-04T15:52:40.479319+0000","last_became_peered":"2024-06-04T15:52:40.479319+0000","last_unstale":"2024-06-04T16:19:45.015027+0000","last_undegraded":"2024-06-04T16:19:45.015027+0000","last_fullsized":"2024-06-04T16:19:45.015027+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_clean_scrub_stamp":"2024-06-04T15:52:39.463103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T19:40:34.615992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"251'66","reported_seq":567,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:50.015638+0000","last_change":"2024-06-04T15:52:42.500455+0000","last_active":"2024-06-04T16:19:50.015638+0000","last_peered":"2024-06-04T16:19:50.015638+0000","last_clean":"2024-06-04T16:19:50.015638+0000","last_became_active":"2024-06-04T15:52:42.500141+0000","last_became_peered":"2024-06-04T15:52:42.500141+0000","last_unstale":"2024-06-04T16:19:50.015638+0000","last_undegraded":"2024-06-04T16:19:50.015638+0000","last_fullsized":"2024-06-04T16:19:50.015638+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_clean_scrub_stamp":"2024-06-04T15:52:41.476734+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T19:52:33.859931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":90,"num_read_kb":83,"num_write":60,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"254'476","reported_seq":1471,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:32.412965+0000","last_change":"2024-06-04T15:52:44.517489+0000","last_active":"2024-06-04T16:22:32.412965+0000","last_peered":"2024-06-04T16:22:32.412965+0000","last_clean":"2024-06-04T16:22:32.412965+0000","last_became_active":"2024-06-04T15:52:44.517202+0000","last_became_peered":"2024-06-04T15:52:44.517202+0000","last_unstale":"2024-06-04T16:22:32.412965+0000","last_undegraded":"2024-06-04T16:22:32.412965+0000","last_fullsized":"2024-06-04T16:22:32.412965+0000","mapping_epoch":29,"log_start":"251'400","ondisk_log_start":"251'400","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_clean_scrub_stamp":"2024-06-04T15:52:43.492872+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":400,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T18:33:54.152070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.c","version":"254'27","reported_seq":495,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:50.019201+0000","last_change":"2024-06-04T15:52:46.539323+0000","last_active":"2024-06-04T16:19:50.019201+0000","last_peered":"2024-06-04T16:19:50.019201+0000","last_clean":"2024-06-04T16:19:50.019201+0000","last_became_active":"2024-06-04T15:52:46.538975+0000","last_became_peered":"2024-06-04T15:52:46.538975+0000","last_unstale":"2024-06-04T16:19:50.019201+0000","last_undegraded":"2024-06-04T16:19:50.019201+0000","last_fullsized":"2024-06-04T16:19:50.019201+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:45.513877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:45.513877+0000","last_clean_scrub_stamp":"2024-06-04T15:52:45.513877+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T19:08:40.491462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":27,"num_write":64,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3","version":"254'179","reported_seq":1065,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:45.017635+0000","last_change":"2024-06-04T15:52:38.483119+0000","last_active":"2024-06-04T16:19:45.017635+0000","last_peered":"2024-06-04T16:19:45.017635+0000","last_clean":"2024-06-04T16:19:45.017635+0000","last_became_active":"2024-06-04T15:52:38.482240+0000","last_became_peered":"2024-06-04T15:52:38.482240+0000","last_unstale":"2024-06-04T16:19:45.017635+0000","last_undegraded":"2024-06-04T16:19:45.017635+0000","last_fullsized":"2024-06-04T16:19:45.017635+0000","mapping_epoch":23,"log_start":"251'100","ondisk_log_start":"251'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":100,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T17:54:39.066445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1045,"num_read_kb":968,"num_write":230,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"251'34","reported_seq":524,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:45.017653+0000","last_change":"2024-06-04T15:52:36.478791+0000","last_active":"2024-06-04T16:19:45.017653+0000","last_peered":"2024-06-04T16:19:45.017653+0000","last_clean":"2024-06-04T16:19:45.017653+0000","last_became_active":"2024-06-04T15:52:36.478441+0000","last_became_peered":"2024-06-04T15:52:36.478441+0000","last_unstale":"2024-06-04T16:19:45.017653+0000","last_undegraded":"2024-06-04T16:19:45.017653+0000","last_fullsized":"2024-06-04T16:19:45.017653+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T20:43:41.486063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":32,"num_read_kb":7500,"num_write":131,"num_write_kb":23723,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,4],"acting":[6,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":492,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:20.005348+0000","last_change":"2024-06-04T15:52:22.777126+0000","last_active":"2024-06-04T16:18:20.005348+0000","last_peered":"2024-06-04T16:18:20.005348+0000","last_clean":"2024-06-04T16:18:20.005348+0000","last_became_active":"2024-06-04T15:52:22.776729+0000","last_became_peered":"2024-06-04T15:52:22.776729+0000","last_unstale":"2024-06-04T16:18:20.005348+0000","last_undegraded":"2024-06-04T16:18:20.005348+0000","last_fullsized":"2024-06-04T16:18:20.005348+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:21.400880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:21.400880+0000","last_clean_scrub_stamp":"2024-06-04T15:52:21.400880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T03:08:22.360737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":478,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:45.010094+0000","last_change":"2024-06-04T15:52:40.482239+0000","last_active":"2024-06-04T16:19:45.010094+0000","last_peered":"2024-06-04T16:19:45.010094+0000","last_clean":"2024-06-04T16:19:45.010094+0000","last_became_active":"2024-06-04T15:52:40.481870+0000","last_became_peered":"2024-06-04T15:52:40.481870+0000","last_unstale":"2024-06-04T16:19:45.010094+0000","last_undegraded":"2024-06-04T16:19:45.010094+0000","last_fullsized":"2024-06-04T16:19:45.010094+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_clean_scrub_stamp":"2024-06-04T15:52:39.463103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T22:10:27.168145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"254'99","reported_seq":618,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:50.018377+0000","last_change":"2024-06-04T15:52:42.502041+0000","last_active":"2024-06-04T16:19:50.018377+0000","last_peered":"2024-06-04T16:19:50.018377+0000","last_clean":"2024-06-04T16:19:50.018377+0000","last_became_active":"2024-06-04T15:52:42.501708+0000","last_became_peered":"2024-06-04T15:52:42.501708+0000","last_unstale":"2024-06-04T16:19:50.018377+0000","last_undegraded":"2024-06-04T16:19:50.018377+0000","last_fullsized":"2024-06-04T16:19:50.018377+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_clean_scrub_stamp":"2024-06-04T15:52:41.476734+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T18:42:19.221112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":147,"num_read_kb":140,"num_write":98,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.0","version":"254'467","reported_seq":1645,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:32.408757+0000","last_change":"2024-06-04T15:52:44.517953+0000","last_active":"2024-06-04T16:22:32.408757+0000","last_peered":"2024-06-04T16:22:32.408757+0000","last_clean":"2024-06-04T16:22:32.408757+0000","last_became_active":"2024-06-04T15:52:44.517066+0000","last_became_peered":"2024-06-04T15:52:44.517066+0000","last_unstale":"2024-06-04T16:22:32.408757+0000","last_undegraded":"2024-06-04T16:22:32.408757+0000","last_fullsized":"2024-06-04T16:22:32.408757+0000","mapping_epoch":29,"log_start":"251'400","ondisk_log_start":"251'400","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_clean_scrub_stamp":"2024-06-04T15:52:43.492872+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":400,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T19:11:31.141097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"254'27","reported_seq":493,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:05.151518+0000","last_change":"2024-06-04T15:52:46.532254+0000","last_active":"2024-06-04T16:22:05.151518+0000","last_peered":"2024-06-04T16:22:05.151518+0000","last_clean":"2024-06-04T16:22:05.151518+0000","last_became_active":"2024-06-04T15:52:46.531967+0000","last_became_peered":"2024-06-04T15:52:46.531967+0000","last_unstale":"2024-06-04T16:22:05.151518+0000","last_undegraded":"2024-06-04T16:22:05.151518+0000","last_fullsized":"2024-06-04T16:22:05.151518+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:45.513877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:45.513877+0000","last_clean_scrub_stamp":"2024-06-04T15:52:45.513877+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T21:57:32.068478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":905,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":28,"num_read_kb":26,"num_write":64,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2","version":"254'131","reported_seq":930,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:45.017599+0000","last_change":"2024-06-04T15:52:38.481406+0000","last_active":"2024-06-04T16:19:45.017599+0000","last_peered":"2024-06-04T16:19:45.017599+0000","last_clean":"2024-06-04T16:19:45.017599+0000","last_became_active":"2024-06-04T15:52:38.480942+0000","last_became_peered":"2024-06-04T15:52:38.480942+0000","last_unstale":"2024-06-04T16:19:45.017599+0000","last_undegraded":"2024-06-04T16:19:45.017599+0000","last_fullsized":"2024-06-04T16:19:45.017599+0000","mapping_epoch":23,"log_start":"251'100","ondisk_log_start":"251'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T20:49:38.683287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":705,"num_read_kb":672,"num_write":147,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"251'54","reported_seq":559,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:50.011302+0000","last_change":"2024-06-04T15:52:36.484356+0000","last_active":"2024-06-04T16:19:50.011302+0000","last_peered":"2024-06-04T16:19:50.011302+0000","last_clean":"2024-06-04T16:19:50.011302+0000","last_became_active":"2024-06-04T15:52:36.480469+0000","last_became_peered":"2024-06-04T15:52:36.480469+0000","last_unstale":"2024-06-04T16:19:50.011302+0000","last_undegraded":"2024-06-04T16:19:50.011302+0000","last_fullsized":"2024-06-04T16:19:50.011302+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T23:54:02.222955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":69,"num_read_kb":32811,"num_write":225,"num_write_kb":30438,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,4],"acting":[2,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":494,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:25.112378+0000","last_change":"2024-06-04T15:52:22.777053+0000","last_active":"2024-06-04T16:18:25.112378+0000","last_peered":"2024-06-04T16:18:25.112378+0000","last_clean":"2024-06-04T16:18:25.112378+0000","last_became_active":"2024-06-04T15:52:22.776723+0000","last_became_peered":"2024-06-04T15:52:22.776723+0000","last_unstale":"2024-06-04T16:18:25.112378+0000","last_undegraded":"2024-06-04T16:18:25.112378+0000","last_fullsized":"2024-06-04T16:18:25.112378+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:21.400880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:21.400880+0000","last_clean_scrub_stamp":"2024-06-04T15:52:21.400880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T02:40:05.098206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":476,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:45.017841+0000","last_change":"2024-06-04T15:52:40.484565+0000","last_active":"2024-06-04T16:19:45.017841+0000","last_peered":"2024-06-04T16:19:45.017841+0000","last_clean":"2024-06-04T16:19:45.017841+0000","last_became_active":"2024-06-04T15:52:40.483802+0000","last_became_peered":"2024-06-04T15:52:40.483802+0000","last_unstale":"2024-06-04T16:19:45.017841+0000","last_undegraded":"2024-06-04T16:19:45.017841+0000","last_fullsized":"2024-06-04T16:19:45.017841+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_clean_scrub_stamp":"2024-06-04T15:52:39.463103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T18:37:27.476845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"254'193","reported_seq":810,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:32.376834+0000","last_change":"2024-06-04T15:52:42.499319+0000","last_active":"2024-06-04T16:22:32.376834+0000","last_peered":"2024-06-04T16:22:32.376834+0000","last_clean":"2024-06-04T16:22:32.376834+0000","last_became_active":"2024-06-04T15:52:42.499002+0000","last_became_peered":"2024-06-04T15:52:42.499002+0000","last_unstale":"2024-06-04T16:22:32.376834+0000","last_undegraded":"2024-06-04T16:22:32.376834+0000","last_fullsized":"2024-06-04T16:22:32.376834+0000","mapping_epoch":27,"log_start":"251'100","ondisk_log_start":"251'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_clean_scrub_stamp":"2024-06-04T15:52:41.476734+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":100,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T03:36:55.807593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24431,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":293,"num_read_kb":371,"num_write":146,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":466,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:50.011194+0000","last_change":"2024-06-04T15:52:44.520800+0000","last_active":"2024-06-04T16:19:50.011194+0000","last_peered":"2024-06-04T16:19:50.011194+0000","last_clean":"2024-06-04T16:19:50.011194+0000","last_became_active":"2024-06-04T15:52:44.520499+0000","last_became_peered":"2024-06-04T15:52:44.520499+0000","last_unstale":"2024-06-04T16:19:50.011194+0000","last_undegraded":"2024-06-04T16:19:50.011194+0000","last_fullsized":"2024-06-04T16:19:50.011194+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_clean_scrub_stamp":"2024-06-04T15:52:43.492872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T01:16:43.243739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"254'25","reported_seq":498,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:50.019241+0000","last_change":"2024-06-04T15:52:46.542360+0000","last_active":"2024-06-04T16:19:50.019241+0000","last_peered":"2024-06-04T16:19:50.019241+0000","last_clean":"2024-06-04T16:19:50.019241+0000","last_became_active":"2024-06-04T15:52:46.541768+0000","last_became_peered":"2024-06-04T15:52:46.541768+0000","last_unstale":"2024-06-04T16:19:50.019241+0000","last_undegraded":"2024-06-04T16:19:50.019241+0000","last_fullsized":"2024-06-04T16:19:50.019241+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:45.513877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:45.513877+0000","last_clean_scrub_stamp":"2024-06-04T15:52:45.513877+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T20:45:40.593310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":34,"num_write":60,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"254'24","reported_seq":489,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:55.019539+0000","last_change":"2024-06-04T15:52:46.541003+0000","last_active":"2024-06-04T16:19:55.019539+0000","last_peered":"2024-06-04T16:19:55.019539+0000","last_clean":"2024-06-04T16:19:55.019539+0000","last_became_active":"2024-06-04T15:52:46.540733+0000","last_became_peered":"2024-06-04T15:52:46.540733+0000","last_unstale":"2024-06-04T16:19:55.019539+0000","last_undegraded":"2024-06-04T16:19:55.019539+0000","last_fullsized":"2024-06-04T16:19:55.019539+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:45.513877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:45.513877+0000","last_clean_scrub_stamp":"2024-06-04T15:52:45.513877+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T23:13:36.615780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":53,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"254'151","reported_seq":916,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:22.092985+0000","last_change":"2024-06-04T15:52:38.480198+0000","last_active":"2024-06-04T16:18:22.092985+0000","last_peered":"2024-06-04T16:18:22.092985+0000","last_clean":"2024-06-04T16:18:22.092985+0000","last_became_active":"2024-06-04T15:52:38.479929+0000","last_became_peered":"2024-06-04T15:52:38.479929+0000","last_unstale":"2024-06-04T16:18:22.092985+0000","last_undegraded":"2024-06-04T16:18:22.092985+0000","last_fullsized":"2024-06-04T16:18:22.092985+0000","mapping_epoch":23,"log_start":"251'100","ondisk_log_start":"251'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":100,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T18:53:28.230708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":770,"num_read_kb":699,"num_write":204,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"251'34","reported_seq":545,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:25.005933+0000","last_change":"2024-06-04T15:52:36.497838+0000","last_active":"2024-06-04T16:18:25.005933+0000","last_peered":"2024-06-04T16:18:25.005933+0000","last_clean":"2024-06-04T16:18:25.005933+0000","last_became_active":"2024-06-04T15:52:36.497532+0000","last_became_peered":"2024-06-04T15:52:36.497532+0000","last_unstale":"2024-06-04T16:18:25.005933+0000","last_undegraded":"2024-06-04T16:18:25.005933+0000","last_fullsized":"2024-06-04T16:18:25.005933+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T16:03:02.229193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":54,"num_read_kb":42110,"num_write":160,"num_write_kb":16147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":470,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:20.006124+0000","last_change":"2024-06-04T15:52:40.484157+0000","last_active":"2024-06-04T16:18:20.006124+0000","last_peered":"2024-06-04T16:18:20.006124+0000","last_clean":"2024-06-04T16:18:20.006124+0000","last_became_active":"2024-06-04T15:52:40.483882+0000","last_became_peered":"2024-06-04T15:52:40.483882+0000","last_unstale":"2024-06-04T16:18:20.006124+0000","last_undegraded":"2024-06-04T16:18:20.006124+0000","last_fullsized":"2024-06-04T16:18:20.006124+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_clean_scrub_stamp":"2024-06-04T15:52:39.463103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T16:24:11.194485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.11","version":"254'92","reported_seq":626,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:20:45.026804+0000","last_change":"2024-06-04T15:52:42.504482+0000","last_active":"2024-06-04T16:20:45.026804+0000","last_peered":"2024-06-04T16:20:45.026804+0000","last_clean":"2024-06-04T16:20:45.026804+0000","last_became_active":"2024-06-04T15:52:42.504144+0000","last_became_peered":"2024-06-04T15:52:42.504144+0000","last_unstale":"2024-06-04T16:20:45.026804+0000","last_undegraded":"2024-06-04T16:20:45.026804+0000","last_fullsized":"2024-06-04T16:20:45.026804+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_clean_scrub_stamp":"2024-06-04T15:52:41.476734+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T18:40:42.712100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14313,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":136,"num_read_kb":190,"num_write":66,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":466,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:25.119072+0000","last_change":"2024-06-04T15:52:44.517996+0000","last_active":"2024-06-04T16:18:25.119072+0000","last_peered":"2024-06-04T16:18:25.119072+0000","last_clean":"2024-06-04T16:18:25.119072+0000","last_became_active":"2024-06-04T15:52:44.517718+0000","last_became_peered":"2024-06-04T15:52:44.517718+0000","last_unstale":"2024-06-04T16:18:25.119072+0000","last_undegraded":"2024-06-04T16:18:25.119072+0000","last_fullsized":"2024-06-04T16:18:25.119072+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_clean_scrub_stamp":"2024-06-04T15:52:43.492872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T16:20:37.573553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1e","version":"254'42","reported_seq":511,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:50.123024+0000","last_change":"2024-06-04T15:52:46.537867+0000","last_active":"2024-06-04T16:18:50.123024+0000","last_peered":"2024-06-04T16:18:50.123024+0000","last_clean":"2024-06-04T16:18:50.123024+0000","last_became_active":"2024-06-04T15:52:46.536917+0000","last_became_peered":"2024-06-04T15:52:46.536917+0000","last_unstale":"2024-06-04T16:18:50.123024+0000","last_undegraded":"2024-06-04T16:18:50.123024+0000","last_fullsized":"2024-06-04T16:18:50.123024+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:45.513877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:45.513877+0000","last_clean_scrub_stamp":"2024-06-04T15:52:45.513877+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T01:16:32.378412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":42,"num_write":101,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"254'151","reported_seq":983,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:22.327242+0000","last_change":"2024-06-04T15:52:38.488440+0000","last_active":"2024-06-04T16:18:22.327242+0000","last_peered":"2024-06-04T16:18:22.327242+0000","last_clean":"2024-06-04T16:18:22.327242+0000","last_became_active":"2024-06-04T15:52:38.488159+0000","last_became_peered":"2024-06-04T15:52:38.488159+0000","last_unstale":"2024-06-04T16:18:22.327242+0000","last_undegraded":"2024-06-04T16:18:22.327242+0000","last_fullsized":"2024-06-04T16:18:22.327242+0000","mapping_epoch":23,"log_start":"251'100","ondisk_log_start":"251'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":100,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T21:49:36.508131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":952,"num_read_kb":891,"num_write":194,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.15","version":"251'69","reported_seq":603,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:15.007185+0000","last_change":"2024-06-04T15:52:36.492824+0000","last_active":"2024-06-04T16:19:15.007185+0000","last_peered":"2024-06-04T16:19:15.007185+0000","last_clean":"2024-06-04T16:19:15.007185+0000","last_became_active":"2024-06-04T15:52:36.492503+0000","last_became_peered":"2024-06-04T15:52:36.492503+0000","last_unstale":"2024-06-04T16:19:15.007185+0000","last_undegraded":"2024-06-04T16:19:15.007185+0000","last_fullsized":"2024-06-04T16:19:15.007185+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T02:41:20.493195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":528536,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":128,"num_read_kb":6583,"num_write":319,"num_write_kb":16503,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,3],"acting":[0,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":474,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:20.006632+0000","last_change":"2024-06-04T15:52:40.484769+0000","last_active":"2024-06-04T16:18:20.006632+0000","last_peered":"2024-06-04T16:18:20.006632+0000","last_clean":"2024-06-04T16:18:20.006632+0000","last_became_active":"2024-06-04T15:52:40.484480+0000","last_became_peered":"2024-06-04T15:52:40.484480+0000","last_unstale":"2024-06-04T16:18:20.006632+0000","last_undegraded":"2024-06-04T16:18:20.006632+0000","last_fullsized":"2024-06-04T16:18:20.006632+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_clean_scrub_stamp":"2024-06-04T15:52:39.463103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T22:51:50.840432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"251'18","reported_seq":494,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:25.007177+0000","last_change":"2024-06-04T15:52:42.499940+0000","last_active":"2024-06-04T16:18:25.007177+0000","last_peered":"2024-06-04T16:18:25.007177+0000","last_clean":"2024-06-04T16:18:25.007177+0000","last_became_active":"2024-06-04T15:52:42.499592+0000","last_became_peered":"2024-06-04T15:52:42.499592+0000","last_unstale":"2024-06-04T16:18:25.007177+0000","last_undegraded":"2024-06-04T16:18:25.007177+0000","last_fullsized":"2024-06-04T16:18:25.007177+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_clean_scrub_stamp":"2024-06-04T15:52:41.476734+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T18:27:38.404606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":19,"num_read_kb":17,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":464,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:25.002431+0000","last_change":"2024-06-04T15:52:44.519396+0000","last_active":"2024-06-04T16:18:25.002431+0000","last_peered":"2024-06-04T16:18:25.002431+0000","last_clean":"2024-06-04T16:18:25.002431+0000","last_became_active":"2024-06-04T15:52:44.519102+0000","last_became_peered":"2024-06-04T15:52:44.519102+0000","last_unstale":"2024-06-04T16:18:25.002431+0000","last_undegraded":"2024-06-04T16:18:25.002431+0000","last_fullsized":"2024-06-04T16:18:25.002431+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_clean_scrub_stamp":"2024-06-04T15:52:43.492872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T23:01:48.911900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"254'24","reported_seq":490,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:21.701306+0000","last_change":"2024-06-04T15:52:46.534720+0000","last_active":"2024-06-04T16:18:21.701306+0000","last_peered":"2024-06-04T16:18:21.701306+0000","last_clean":"2024-06-04T16:18:21.701306+0000","last_became_active":"2024-06-04T15:52:46.534277+0000","last_became_peered":"2024-06-04T15:52:46.534277+0000","last_unstale":"2024-06-04T16:18:21.701306+0000","last_undegraded":"2024-06-04T16:18:21.701306+0000","last_fullsized":"2024-06-04T16:18:21.701306+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:45.513877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:45.513877+0000","last_clean_scrub_stamp":"2024-06-04T15:52:45.513877+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T19:20:11.363716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":38,"num_write":55,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"254'221","reported_seq":1035,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:22.093247+0000","last_change":"2024-06-04T15:52:38.482192+0000","last_active":"2024-06-04T16:18:22.093247+0000","last_peered":"2024-06-04T16:18:22.093247+0000","last_clean":"2024-06-04T16:18:22.093247+0000","last_became_active":"2024-06-04T15:52:38.481934+0000","last_became_peered":"2024-06-04T15:52:38.481934+0000","last_unstale":"2024-06-04T16:18:22.093247+0000","last_undegraded":"2024-06-04T16:18:22.093247+0000","last_fullsized":"2024-06-04T16:18:22.093247+0000","mapping_epoch":23,"log_start":"251'200","ondisk_log_start":"251'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":200,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T22:42:27.546656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1128,"num_read_kb":983,"num_write":320,"num_write_kb":131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.16","version":"251'39","reported_seq":528,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:15.007814+0000","last_change":"2024-06-04T15:52:36.481215+0000","last_active":"2024-06-04T16:19:15.007814+0000","last_peered":"2024-06-04T16:19:15.007814+0000","last_clean":"2024-06-04T16:19:15.007814+0000","last_became_active":"2024-06-04T15:52:36.480284+0000","last_became_peered":"2024-06-04T15:52:36.480284+0000","last_unstale":"2024-06-04T16:19:15.007814+0000","last_undegraded":"2024-06-04T16:19:15.007814+0000","last_fullsized":"2024-06-04T16:19:15.007814+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T02:23:34.817120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":37,"num_read_kb":1062,"num_write":155,"num_write_kb":20099,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4],"acting":[2,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":472,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:20.001825+0000","last_change":"2024-06-04T15:52:40.477894+0000","last_active":"2024-06-04T16:18:20.001825+0000","last_peered":"2024-06-04T16:18:20.001825+0000","last_clean":"2024-06-04T16:18:20.001825+0000","last_became_active":"2024-06-04T15:52:40.477609+0000","last_became_peered":"2024-06-04T15:52:40.477609+0000","last_unstale":"2024-06-04T16:18:20.001825+0000","last_undegraded":"2024-06-04T16:18:20.001825+0000","last_fullsized":"2024-06-04T16:18:20.001825+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_clean_scrub_stamp":"2024-06-04T15:52:39.463103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T03:11:16.123786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"254'129","reported_seq":682,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:20:45.139347+0000","last_change":"2024-06-04T15:52:42.496760+0000","last_active":"2024-06-04T16:20:45.139347+0000","last_peered":"2024-06-04T16:20:45.139347+0000","last_clean":"2024-06-04T16:20:45.139347+0000","last_became_active":"2024-06-04T15:52:42.496416+0000","last_became_peered":"2024-06-04T15:52:42.496416+0000","last_unstale":"2024-06-04T16:20:45.139347+0000","last_undegraded":"2024-06-04T16:20:45.139347+0000","last_fullsized":"2024-06-04T16:20:45.139347+0000","mapping_epoch":27,"log_start":"251'100","ondisk_log_start":"251'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_clean_scrub_stamp":"2024-06-04T15:52:41.476734+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T00:10:25.421866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15057,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":187,"num_read_kb":257,"num_write":102,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":468,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:25.112334+0000","last_change":"2024-06-04T15:52:44.520101+0000","last_active":"2024-06-04T16:18:25.112334+0000","last_peered":"2024-06-04T16:18:25.112334+0000","last_clean":"2024-06-04T16:18:25.112334+0000","last_became_active":"2024-06-04T15:52:44.519837+0000","last_became_peered":"2024-06-04T15:52:44.519837+0000","last_unstale":"2024-06-04T16:18:25.112334+0000","last_undegraded":"2024-06-04T16:18:25.112334+0000","last_fullsized":"2024-06-04T16:18:25.112334+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_clean_scrub_stamp":"2024-06-04T15:52:43.492872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T23:02:15.347544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"254'18","reported_seq":479,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:11.644322+0000","last_change":"2024-06-04T15:52:46.529613+0000","last_active":"2024-06-04T16:18:11.644322+0000","last_peered":"2024-06-04T16:18:11.644322+0000","last_clean":"2024-06-04T16:18:11.644322+0000","last_became_active":"2024-06-04T15:52:46.529366+0000","last_became_peered":"2024-06-04T15:52:46.529366+0000","last_unstale":"2024-06-04T16:18:11.644322+0000","last_undegraded":"2024-06-04T16:18:11.644322+0000","last_fullsized":"2024-06-04T16:18:11.644322+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:45.513877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:45.513877+0000","last_clean_scrub_stamp":"2024-06-04T15:52:45.513877+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T19:51:30.893394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":52,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"254'127","reported_seq":829,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:23.264264+0000","last_change":"2024-06-04T15:52:38.488922+0000","last_active":"2024-06-04T16:18:23.264264+0000","last_peered":"2024-06-04T16:18:23.264264+0000","last_clean":"2024-06-04T16:18:23.264264+0000","last_became_active":"2024-06-04T15:52:38.488622+0000","last_became_peered":"2024-06-04T15:52:38.488622+0000","last_unstale":"2024-06-04T16:18:23.264264+0000","last_undegraded":"2024-06-04T16:18:23.264264+0000","last_fullsized":"2024-06-04T16:18:23.264264+0000","mapping_epoch":23,"log_start":"251'100","ondisk_log_start":"251'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":100,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T19:55:57.502005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":585,"num_read_kb":532,"num_write":156,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"254'49","reported_seq":560,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:15.014513+0000","last_change":"2024-06-04T15:52:36.483764+0000","last_active":"2024-06-04T16:19:15.014513+0000","last_peered":"2024-06-04T16:19:15.014513+0000","last_clean":"2024-06-04T16:19:15.014513+0000","last_became_active":"2024-06-04T15:52:36.482733+0000","last_became_peered":"2024-06-04T15:52:36.482733+0000","last_unstale":"2024-06-04T16:19:15.014513+0000","last_undegraded":"2024-06-04T16:19:15.014513+0000","last_fullsized":"2024-06-04T16:19:15.014513+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T18:40:07.443876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5328009,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":81,"num_read_kb":13463,"num_write":226,"num_write_kb":36279,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1],"acting":[5,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.11","version":"33'4","reported_seq":777,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:32.119414+0000","last_change":"2024-06-04T15:52:40.479576+0000","last_active":"2024-06-04T16:22:32.119414+0000","last_peered":"2024-06-04T16:22:32.119414+0000","last_clean":"2024-06-04T16:22:32.119414+0000","last_became_active":"2024-06-04T15:52:40.479002+0000","last_became_peered":"2024-06-04T15:52:40.479002+0000","last_unstale":"2024-06-04T16:22:32.119414+0000","last_undegraded":"2024-06-04T16:22:32.119414+0000","last_fullsized":"2024-06-04T16:22:32.119414+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_clean_scrub_stamp":"2024-06-04T15:52:39.463103+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T19:07:30.419008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":460,"num_read_kb":752,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"254'83","reported_seq":620,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:20:45.016085+0000","last_change":"2024-06-04T15:52:42.506197+0000","last_active":"2024-06-04T16:20:45.016085+0000","last_peered":"2024-06-04T16:20:45.016085+0000","last_clean":"2024-06-04T16:20:45.016085+0000","last_became_active":"2024-06-04T15:52:42.505955+0000","last_became_peered":"2024-06-04T15:52:42.505955+0000","last_unstale":"2024-06-04T16:20:45.016085+0000","last_undegraded":"2024-06-04T16:20:45.016085+0000","last_fullsized":"2024-06-04T16:20:45.016085+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_clean_scrub_stamp":"2024-06-04T15:52:41.476734+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T22:41:05.443654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":122,"num_read_kb":141,"num_write":56,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":466,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:25.119122+0000","last_change":"2024-06-04T15:52:44.520920+0000","last_active":"2024-06-04T16:18:25.119122+0000","last_peered":"2024-06-04T16:18:25.119122+0000","last_clean":"2024-06-04T16:18:25.119122+0000","last_became_active":"2024-06-04T15:52:44.519975+0000","last_became_peered":"2024-06-04T15:52:44.519975+0000","last_unstale":"2024-06-04T16:18:25.119122+0000","last_undegraded":"2024-06-04T16:18:25.119122+0000","last_fullsized":"2024-06-04T16:18:25.119122+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_clean_scrub_stamp":"2024-06-04T15:52:43.492872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T18:00:51.312734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1f","version":"254'93","reported_seq":773,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:45.015161+0000","last_change":"2024-06-04T15:52:38.485442+0000","last_active":"2024-06-04T16:19:45.015161+0000","last_peered":"2024-06-04T16:19:45.015161+0000","last_clean":"2024-06-04T16:19:45.015161+0000","last_became_active":"2024-06-04T15:52:38.485163+0000","last_became_peered":"2024-06-04T15:52:38.485163+0000","last_unstale":"2024-06-04T16:19:45.015161+0000","last_undegraded":"2024-06-04T16:19:45.015161+0000","last_fullsized":"2024-06-04T16:19:45.015161+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T23:56:24.126758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":477,"num_read_kb":443,"num_write":114,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"254'34","reported_seq":536,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:15.014360+0000","last_change":"2024-06-04T15:52:36.490918+0000","last_active":"2024-06-04T16:19:15.014360+0000","last_peered":"2024-06-04T16:19:15.014360+0000","last_clean":"2024-06-04T16:19:15.014360+0000","last_became_active":"2024-06-04T15:52:36.490297+0000","last_became_peered":"2024-06-04T15:52:36.490297+0000","last_unstale":"2024-06-04T16:19:15.014360+0000","last_undegraded":"2024-06-04T16:19:15.014360+0000","last_fullsized":"2024-06-04T16:19:15.014360+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T23:35:40.012317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2117740,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":52,"num_read_kb":1061,"num_write":120,"num_write_kb":15390,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,3],"acting":[5,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":472,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:45.009473+0000","last_change":"2024-06-04T15:52:40.483258+0000","last_active":"2024-06-04T16:18:45.009473+0000","last_peered":"2024-06-04T16:18:45.009473+0000","last_clean":"2024-06-04T16:18:45.009473+0000","last_became_active":"2024-06-04T15:52:40.482962+0000","last_became_peered":"2024-06-04T15:52:40.482962+0000","last_unstale":"2024-06-04T16:18:45.009473+0000","last_undegraded":"2024-06-04T16:18:45.009473+0000","last_fullsized":"2024-06-04T16:18:45.009473+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_clean_scrub_stamp":"2024-06-04T15:52:39.463103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T17:22:55.939902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"254'144","reported_seq":730,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:32.370258+0000","last_change":"2024-06-04T15:52:42.504117+0000","last_active":"2024-06-04T16:22:32.370258+0000","last_peered":"2024-06-04T16:22:32.370258+0000","last_clean":"2024-06-04T16:22:32.370258+0000","last_became_active":"2024-06-04T15:52:42.503246+0000","last_became_peered":"2024-06-04T15:52:42.503246+0000","last_unstale":"2024-06-04T16:22:32.370258+0000","last_undegraded":"2024-06-04T16:22:32.370258+0000","last_fullsized":"2024-06-04T16:22:32.370258+0000","mapping_epoch":27,"log_start":"251'100","ondisk_log_start":"251'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_clean_scrub_stamp":"2024-06-04T15:52:41.476734+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T17:52:54.231259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8493,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":218,"num_read_kb":265,"num_write":94,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":463,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:17:44.997914+0000","last_change":"2024-06-04T15:52:44.518052+0000","last_active":"2024-06-04T16:17:44.997914+0000","last_peered":"2024-06-04T16:17:44.997914+0000","last_clean":"2024-06-04T16:17:44.997914+0000","last_became_active":"2024-06-04T15:52:44.517715+0000","last_became_peered":"2024-06-04T15:52:44.517715+0000","last_unstale":"2024-06-04T16:17:44.997914+0000","last_undegraded":"2024-06-04T16:17:44.997914+0000","last_fullsized":"2024-06-04T16:17:44.997914+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_clean_scrub_stamp":"2024-06-04T15:52:43.492872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T02:22:55.140000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"254'71","reported_seq":549,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:30.008312+0000","last_change":"2024-06-04T15:52:46.538655+0000","last_active":"2024-06-04T16:18:30.008312+0000","last_peered":"2024-06-04T16:18:30.008312+0000","last_clean":"2024-06-04T16:18:30.008312+0000","last_became_active":"2024-06-04T15:52:46.538338+0000","last_became_peered":"2024-06-04T15:52:46.538338+0000","last_unstale":"2024-06-04T16:18:30.008312+0000","last_undegraded":"2024-06-04T16:18:30.008312+0000","last_fullsized":"2024-06-04T16:18:30.008312+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:45.513877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:45.513877+0000","last_clean_scrub_stamp":"2024-06-04T15:52:45.513877+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T01:20:53.919158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1061,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":107,"num_read_kb":120,"num_write":148,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1e","version":"254'145","reported_seq":914,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:45.009948+0000","last_change":"2024-06-04T15:52:38.484537+0000","last_active":"2024-06-04T16:18:45.009948+0000","last_peered":"2024-06-04T16:18:45.009948+0000","last_clean":"2024-06-04T16:18:45.009948+0000","last_became_active":"2024-06-04T15:52:38.484087+0000","last_became_peered":"2024-06-04T15:52:38.484087+0000","last_unstale":"2024-06-04T16:18:45.009948+0000","last_undegraded":"2024-06-04T16:18:45.009948+0000","last_fullsized":"2024-06-04T16:18:45.009948+0000","mapping_epoch":23,"log_start":"251'100","ondisk_log_start":"251'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":100,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T00:25:14.013091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":710,"num_read_kb":650,"num_write":181,"num_write_kb":49,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"251'48","reported_seq":551,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:20.014446+0000","last_change":"2024-06-04T15:52:36.479337+0000","last_active":"2024-06-04T16:19:20.014446+0000","last_peered":"2024-06-04T16:19:20.014446+0000","last_clean":"2024-06-04T16:19:20.014446+0000","last_became_active":"2024-06-04T15:52:36.477626+0000","last_became_peered":"2024-06-04T15:52:36.477626+0000","last_unstale":"2024-06-04T16:19:20.014446+0000","last_undegraded":"2024-06-04T16:19:20.014446+0000","last_fullsized":"2024-06-04T16:19:20.014446+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T17:38:59.206841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20628,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":58,"num_read_kb":9358,"num_write":184,"num_write_kb":22886,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,1],"acting":[4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":474,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:45.010737+0000","last_change":"2024-06-04T15:52:40.484749+0000","last_active":"2024-06-04T16:19:45.010737+0000","last_peered":"2024-06-04T16:19:45.010737+0000","last_clean":"2024-06-04T16:19:45.010737+0000","last_became_active":"2024-06-04T15:52:40.484444+0000","last_became_peered":"2024-06-04T15:52:40.484444+0000","last_unstale":"2024-06-04T16:19:45.010737+0000","last_undegraded":"2024-06-04T16:19:45.010737+0000","last_fullsized":"2024-06-04T16:19:45.010737+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_clean_scrub_stamp":"2024-06-04T15:52:39.463103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T00:27:18.866376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"254'102","reported_seq":644,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:20:15.018458+0000","last_change":"2024-06-04T15:52:42.498603+0000","last_active":"2024-06-04T16:20:15.018458+0000","last_peered":"2024-06-04T16:20:15.018458+0000","last_clean":"2024-06-04T16:20:15.018458+0000","last_became_active":"2024-06-04T15:52:42.498329+0000","last_became_peered":"2024-06-04T15:52:42.498329+0000","last_unstale":"2024-06-04T16:20:15.018458+0000","last_undegraded":"2024-06-04T16:20:15.018458+0000","last_fullsized":"2024-06-04T16:20:15.018458+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_clean_scrub_stamp":"2024-06-04T15:52:41.476734+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T22:43:07.581595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":161,"num_read_kb":198,"num_write":100,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":467,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:17:45.002004+0000","last_change":"2024-06-04T15:52:44.523780+0000","last_active":"2024-06-04T16:17:45.002004+0000","last_peered":"2024-06-04T16:17:45.002004+0000","last_clean":"2024-06-04T16:17:45.002004+0000","last_became_active":"2024-06-04T15:52:44.523527+0000","last_became_peered":"2024-06-04T15:52:44.523527+0000","last_unstale":"2024-06-04T16:17:45.002004+0000","last_undegraded":"2024-06-04T16:17:45.002004+0000","last_fullsized":"2024-06-04T16:17:45.002004+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_clean_scrub_stamp":"2024-06-04T15:52:43.492872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T03:49:44.080770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.12","version":"254'29","reported_seq":505,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:30.006566+0000","last_change":"2024-06-04T15:52:46.538179+0000","last_active":"2024-06-04T16:18:30.006566+0000","last_peered":"2024-06-04T16:18:30.006566+0000","last_clean":"2024-06-04T16:18:30.006566+0000","last_became_active":"2024-06-04T15:52:46.537899+0000","last_became_peered":"2024-06-04T15:52:46.537899+0000","last_unstale":"2024-06-04T16:18:30.006566+0000","last_undegraded":"2024-06-04T16:18:30.006566+0000","last_fullsized":"2024-06-04T16:18:30.006566+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:45.513877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:45.513877+0000","last_clean_scrub_stamp":"2024-06-04T15:52:45.513877+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T03:08:17.268541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1228,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":67,"num_read_kb":65,"num_write":80,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"254'108","reported_seq":882,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:22.735049+0000","last_change":"2024-06-04T15:52:38.481130+0000","last_active":"2024-06-04T16:18:22.735049+0000","last_peered":"2024-06-04T16:18:22.735049+0000","last_clean":"2024-06-04T16:18:22.735049+0000","last_became_active":"2024-06-04T15:52:38.480458+0000","last_became_peered":"2024-06-04T15:52:38.480458+0000","last_unstale":"2024-06-04T16:18:22.735049+0000","last_undegraded":"2024-06-04T16:18:22.735049+0000","last_fullsized":"2024-06-04T16:18:22.735049+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T00:04:51.320929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":731,"num_read_kb":703,"num_write":125,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1a","version":"254'72","reported_seq":584,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:18.463271+0000","last_change":"2024-06-04T15:52:36.478450+0000","last_active":"2024-06-04T16:18:18.463271+0000","last_peered":"2024-06-04T16:18:18.463271+0000","last_clean":"2024-06-04T16:18:18.463271+0000","last_became_active":"2024-06-04T15:52:36.477885+0000","last_became_peered":"2024-06-04T15:52:36.477885+0000","last_unstale":"2024-06-04T16:18:18.463271+0000","last_undegraded":"2024-06-04T16:18:18.463271+0000","last_fullsized":"2024-06-04T16:18:18.463271+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T20:17:02.464903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1720489,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":87,"num_read_kb":3881,"num_write":288,"num_write_kb":29330,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":471,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:17:39.997325+0000","last_change":"2024-06-04T15:52:40.478223+0000","last_active":"2024-06-04T16:17:39.997325+0000","last_peered":"2024-06-04T16:17:39.997325+0000","last_clean":"2024-06-04T16:17:39.997325+0000","last_became_active":"2024-06-04T15:52:40.477924+0000","last_became_peered":"2024-06-04T15:52:40.477924+0000","last_unstale":"2024-06-04T16:17:39.997325+0000","last_undegraded":"2024-06-04T16:17:39.997325+0000","last_fullsized":"2024-06-04T16:17:39.997325+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_clean_scrub_stamp":"2024-06-04T15:52:39.463103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T00:32:19.586149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"254'90","reported_seq":627,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:21:55.036582+0000","last_change":"2024-06-04T15:52:42.503942+0000","last_active":"2024-06-04T16:21:55.036582+0000","last_peered":"2024-06-04T16:21:55.036582+0000","last_clean":"2024-06-04T16:21:55.036582+0000","last_became_active":"2024-06-04T15:52:42.503579+0000","last_became_peered":"2024-06-04T15:52:42.503579+0000","last_unstale":"2024-06-04T16:21:55.036582+0000","last_undegraded":"2024-06-04T16:21:55.036582+0000","last_fullsized":"2024-06-04T16:21:55.036582+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_clean_scrub_stamp":"2024-06-04T15:52:41.476734+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T18:07:30.315906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5924,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":133,"num_read_kb":171,"num_write":62,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":468,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:45.122366+0000","last_change":"2024-06-04T15:52:44.520226+0000","last_active":"2024-06-04T16:18:45.122366+0000","last_peered":"2024-06-04T16:18:45.122366+0000","last_clean":"2024-06-04T16:18:45.122366+0000","last_became_active":"2024-06-04T15:52:44.519570+0000","last_became_peered":"2024-06-04T15:52:44.519570+0000","last_unstale":"2024-06-04T16:18:45.122366+0000","last_undegraded":"2024-06-04T16:18:45.122366+0000","last_fullsized":"2024-06-04T16:18:45.122366+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_clean_scrub_stamp":"2024-06-04T15:52:43.492872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T00:47:00.033153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.11","version":"254'24","reported_seq":487,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:32.397487+0000","last_change":"2024-06-04T15:52:46.543080+0000","last_active":"2024-06-04T16:22:32.397487+0000","last_peered":"2024-06-04T16:22:32.397487+0000","last_clean":"2024-06-04T16:22:32.397487+0000","last_became_active":"2024-06-04T15:52:46.542820+0000","last_became_peered":"2024-06-04T15:52:46.542820+0000","last_unstale":"2024-06-04T16:22:32.397487+0000","last_undegraded":"2024-06-04T16:22:32.397487+0000","last_fullsized":"2024-06-04T16:22:32.397487+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:45.513877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:45.513877+0000","last_clean_scrub_stamp":"2024-06-04T15:52:45.513877+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T19:52:44.228120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":616,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":20,"num_read_kb":19,"num_write":60,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"254'121","reported_seq":814,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:20.564152+0000","last_change":"2024-06-04T15:52:38.478104+0000","last_active":"2024-06-04T16:18:20.564152+0000","last_peered":"2024-06-04T16:18:20.564152+0000","last_clean":"2024-06-04T16:18:20.564152+0000","last_became_active":"2024-06-04T15:52:38.477059+0000","last_became_peered":"2024-06-04T15:52:38.477059+0000","last_unstale":"2024-06-04T16:18:20.564152+0000","last_undegraded":"2024-06-04T16:18:20.564152+0000","last_fullsized":"2024-06-04T16:18:20.564152+0000","mapping_epoch":23,"log_start":"251'100","ondisk_log_start":"251'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":100,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T03:05:57.769457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":614,"num_read_kb":552,"num_write":164,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"254'62","reported_seq":569,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:20.541573+0000","last_change":"2024-06-04T15:52:36.498271+0000","last_active":"2024-06-04T16:18:20.541573+0000","last_peered":"2024-06-04T16:18:20.541573+0000","last_clean":"2024-06-04T16:18:20.541573+0000","last_became_active":"2024-06-04T15:52:36.497812+0000","last_became_peered":"2024-06-04T15:52:36.497812+0000","last_unstale":"2024-06-04T16:18:20.541573+0000","last_undegraded":"2024-06-04T16:18:20.541573+0000","last_fullsized":"2024-06-04T16:18:20.541573+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T17:50:50.956572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6461638,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":81,"num_read_kb":14576,"num_write":292,"num_write_kb":31387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3],"acting":[4,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":473,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:17:40.001228+0000","last_change":"2024-06-04T15:52:40.482009+0000","last_active":"2024-06-04T16:17:40.001228+0000","last_peered":"2024-06-04T16:17:40.001228+0000","last_clean":"2024-06-04T16:17:40.001228+0000","last_became_active":"2024-06-04T15:52:40.481621+0000","last_became_peered":"2024-06-04T15:52:40.481621+0000","last_unstale":"2024-06-04T16:17:40.001228+0000","last_undegraded":"2024-06-04T16:17:40.001228+0000","last_fullsized":"2024-06-04T16:17:40.001228+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_clean_scrub_stamp":"2024-06-04T15:52:39.463103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T19:33:44.607654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1e","version":"251'44","reported_seq":530,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:50.009057+0000","last_change":"2024-06-04T15:52:42.499792+0000","last_active":"2024-06-04T16:18:50.009057+0000","last_peered":"2024-06-04T16:18:50.009057+0000","last_clean":"2024-06-04T16:18:50.009057+0000","last_became_active":"2024-06-04T15:52:42.499488+0000","last_became_peered":"2024-06-04T15:52:42.499488+0000","last_unstale":"2024-06-04T16:18:50.009057+0000","last_undegraded":"2024-06-04T16:18:50.009057+0000","last_fullsized":"2024-06-04T16:18:50.009057+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_clean_scrub_stamp":"2024-06-04T15:52:41.476734+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T19:43:32.543414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":67,"num_read_kb":62,"num_write":74,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"254'458","reported_seq":1477,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:32.407715+0000","last_change":"2024-06-04T15:52:44.516769+0000","last_active":"2024-06-04T16:22:32.407715+0000","last_peered":"2024-06-04T16:22:32.407715+0000","last_clean":"2024-06-04T16:22:32.407715+0000","last_became_active":"2024-06-04T15:52:44.516460+0000","last_became_peered":"2024-06-04T15:52:44.516460+0000","last_unstale":"2024-06-04T16:22:32.407715+0000","last_undegraded":"2024-06-04T16:22:32.407715+0000","last_fullsized":"2024-06-04T16:22:32.407715+0000","mapping_epoch":29,"log_start":"251'400","ondisk_log_start":"251'400","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_clean_scrub_stamp":"2024-06-04T15:52:43.492872+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":400,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T02:33:02.102892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.10","version":"253'20","reported_seq":490,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:30.006488+0000","last_change":"2024-06-04T15:52:46.538482+0000","last_active":"2024-06-04T16:18:30.006488+0000","last_peered":"2024-06-04T16:18:30.006488+0000","last_clean":"2024-06-04T16:18:30.006488+0000","last_became_active":"2024-06-04T15:52:46.538179+0000","last_became_peered":"2024-06-04T15:52:46.538179+0000","last_unstale":"2024-06-04T16:18:30.006488+0000","last_undegraded":"2024-06-04T16:18:30.006488+0000","last_fullsized":"2024-06-04T16:18:30.006488+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:45.513877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:45.513877+0000","last_clean_scrub_stamp":"2024-06-04T15:52:45.513877+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T16:31:53.780883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":34,"num_read_kb":33,"num_write":53,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"254'122","reported_seq":865,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:22.734965+0000","last_change":"2024-06-04T15:52:38.486563+0000","last_active":"2024-06-04T16:18:22.734965+0000","last_peered":"2024-06-04T16:18:22.734965+0000","last_clean":"2024-06-04T16:18:22.734965+0000","last_became_active":"2024-06-04T15:52:38.485379+0000","last_became_peered":"2024-06-04T15:52:38.485379+0000","last_unstale":"2024-06-04T16:18:22.734965+0000","last_undegraded":"2024-06-04T16:18:22.734965+0000","last_fullsized":"2024-06-04T16:18:22.734965+0000","mapping_epoch":23,"log_start":"254'100","ondisk_log_start":"254'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":100,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T01:24:18.890606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":679,"num_read_kb":622,"num_write":158,"num_write_kb":49,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"251'30","reported_seq":520,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:17:40.107381+0000","last_change":"2024-06-04T15:52:36.486793+0000","last_active":"2024-06-04T16:17:40.107381+0000","last_peered":"2024-06-04T16:17:40.107381+0000","last_clean":"2024-06-04T16:17:40.107381+0000","last_became_active":"2024-06-04T15:52:36.486465+0000","last_became_peered":"2024-06-04T15:52:36.486465+0000","last_unstale":"2024-06-04T16:17:40.107381+0000","last_undegraded":"2024-06-04T16:17:40.107381+0000","last_fullsized":"2024-06-04T16:17:40.107381+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T21:12:11.586706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":30,"num_read_kb":1715,"num_write":122,"num_write_kb":16993,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,5],"acting":[1,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":475,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:17:40.107365+0000","last_change":"2024-06-04T15:52:40.481127+0000","last_active":"2024-06-04T16:17:40.107365+0000","last_peered":"2024-06-04T16:17:40.107365+0000","last_clean":"2024-06-04T16:17:40.107365+0000","last_became_active":"2024-06-04T15:52:40.480832+0000","last_became_peered":"2024-06-04T15:52:40.480832+0000","last_unstale":"2024-06-04T16:17:40.107365+0000","last_undegraded":"2024-06-04T16:17:40.107365+0000","last_fullsized":"2024-06-04T16:17:40.107365+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_clean_scrub_stamp":"2024-06-04T15:52:39.463103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T03:43:52.022773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"254'107","reported_seq":653,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:21:50.022430+0000","last_change":"2024-06-04T15:52:42.502990+0000","last_active":"2024-06-04T16:21:50.022430+0000","last_peered":"2024-06-04T16:21:50.022430+0000","last_clean":"2024-06-04T16:21:50.022430+0000","last_became_active":"2024-06-04T15:52:42.502601+0000","last_became_peered":"2024-06-04T15:52:42.502601+0000","last_unstale":"2024-06-04T16:21:50.022430+0000","last_undegraded":"2024-06-04T16:21:50.022430+0000","last_fullsized":"2024-06-04T16:21:50.022430+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_clean_scrub_stamp":"2024-06-04T15:52:41.476734+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T23:06:11.514444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35064,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":159,"num_read_kb":266,"num_write":82,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":466,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:20.014431+0000","last_change":"2024-06-04T15:52:44.523309+0000","last_active":"2024-06-04T16:19:20.014431+0000","last_peered":"2024-06-04T16:19:20.014431+0000","last_clean":"2024-06-04T16:19:20.014431+0000","last_became_active":"2024-06-04T15:52:44.522992+0000","last_became_peered":"2024-06-04T15:52:44.522992+0000","last_unstale":"2024-06-04T16:19:20.014431+0000","last_undegraded":"2024-06-04T16:19:20.014431+0000","last_fullsized":"2024-06-04T16:19:20.014431+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_clean_scrub_stamp":"2024-06-04T15:52:43.492872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T02:51:54.078930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"251'15","reported_seq":487,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:25.118965+0000","last_change":"2024-06-04T15:52:46.540313+0000","last_active":"2024-06-04T16:19:25.118965+0000","last_peered":"2024-06-04T16:19:25.118965+0000","last_clean":"2024-06-04T16:19:25.118965+0000","last_became_active":"2024-06-04T15:52:46.539985+0000","last_became_peered":"2024-06-04T15:52:46.539985+0000","last_unstale":"2024-06-04T16:19:25.118965+0000","last_undegraded":"2024-06-04T16:19:25.118965+0000","last_fullsized":"2024-06-04T16:19:25.118965+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:45.513877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:45.513877+0000","last_clean_scrub_stamp":"2024-06-04T15:52:45.513877+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T22:40:19.386258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":31,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"254'419","reported_seq":1235,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:20.564110+0000","last_change":"2024-06-04T15:52:38.475289+0000","last_active":"2024-06-04T16:18:20.564110+0000","last_peered":"2024-06-04T16:18:20.564110+0000","last_clean":"2024-06-04T16:18:20.564110+0000","last_became_active":"2024-06-04T15:52:38.474960+0000","last_became_peered":"2024-06-04T15:52:38.474960+0000","last_unstale":"2024-06-04T16:18:20.564110+0000","last_undegraded":"2024-06-04T16:18:20.564110+0000","last_fullsized":"2024-06-04T16:18:20.564110+0000","mapping_epoch":23,"log_start":"251'400","ondisk_log_start":"251'400","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":400,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T01:50:53.656026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2017,"num_read_kb":1794,"num_write":716,"num_write_kb":341,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"254'98","reported_seq":725,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:18.465429+0000","last_change":"2024-06-04T15:52:36.499152+0000","last_active":"2024-06-04T16:18:18.465429+0000","last_peered":"2024-06-04T16:18:18.465429+0000","last_clean":"2024-06-04T16:18:18.465429+0000","last_became_active":"2024-06-04T15:52:36.498806+0000","last_became_peered":"2024-06-04T15:52:36.498806+0000","last_unstale":"2024-06-04T16:18:18.465429+0000","last_undegraded":"2024-06-04T16:18:18.465429+0000","last_fullsized":"2024-06-04T16:18:18.465429+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T16:05:54.071633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64946,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":489,"num_read_kb":127523,"num_write":606,"num_write_kb":22490,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":471,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:17:39.997312+0000","last_change":"2024-06-04T15:52:40.478700+0000","last_active":"2024-06-04T16:17:39.997312+0000","last_peered":"2024-06-04T16:17:39.997312+0000","last_clean":"2024-06-04T16:17:39.997312+0000","last_became_active":"2024-06-04T15:52:40.478417+0000","last_became_peered":"2024-06-04T15:52:40.478417+0000","last_unstale":"2024-06-04T16:17:39.997312+0000","last_undegraded":"2024-06-04T16:17:39.997312+0000","last_fullsized":"2024-06-04T16:17:39.997312+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_clean_scrub_stamp":"2024-06-04T15:52:39.463103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T01:59:06.360123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"254'84","reported_seq":619,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:21:45.035587+0000","last_change":"2024-06-04T15:52:42.496557+0000","last_active":"2024-06-04T16:21:45.035587+0000","last_peered":"2024-06-04T16:21:45.035587+0000","last_clean":"2024-06-04T16:21:45.035587+0000","last_became_active":"2024-06-04T15:52:42.496263+0000","last_became_peered":"2024-06-04T15:52:42.496263+0000","last_unstale":"2024-06-04T16:21:45.035587+0000","last_undegraded":"2024-06-04T16:21:45.035587+0000","last_fullsized":"2024-06-04T16:21:45.035587+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_clean_scrub_stamp":"2024-06-04T15:52:41.476734+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T01:39:37.497606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9886,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":129,"num_read_kb":183,"num_write":62,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":465,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:25.012820+0000","last_change":"2024-06-04T15:52:44.520347+0000","last_active":"2024-06-04T16:19:25.012820+0000","last_peered":"2024-06-04T16:19:25.012820+0000","last_clean":"2024-06-04T16:19:25.012820+0000","last_became_active":"2024-06-04T15:52:44.520051+0000","last_became_peered":"2024-06-04T15:52:44.520051+0000","last_unstale":"2024-06-04T16:19:25.012820+0000","last_undegraded":"2024-06-04T16:19:25.012820+0000","last_fullsized":"2024-06-04T16:19:25.012820+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_clean_scrub_stamp":"2024-06-04T15:52:43.492872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T21:08:39.164476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"254'39","reported_seq":547,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:25.015736+0000","last_change":"2024-06-04T15:52:46.542209+0000","last_active":"2024-06-04T16:19:25.015736+0000","last_peered":"2024-06-04T16:19:25.015736+0000","last_clean":"2024-06-04T16:19:25.015736+0000","last_became_active":"2024-06-04T15:52:46.541897+0000","last_became_peered":"2024-06-04T15:52:46.541897+0000","last_unstale":"2024-06-04T16:19:25.015736+0000","last_undegraded":"2024-06-04T16:19:25.015736+0000","last_fullsized":"2024-06-04T16:19:25.015736+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:45.513877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:45.513877+0000","last_clean_scrub_stamp":"2024-06-04T15:52:45.513877+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T01:21:18.754972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":549,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":152,"num_read_kb":137,"num_write":99,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"254'122","reported_seq":849,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:15.126530+0000","last_change":"2024-06-04T15:52:38.482687+0000","last_active":"2024-06-04T16:19:15.126530+0000","last_peered":"2024-06-04T16:19:15.126530+0000","last_clean":"2024-06-04T16:19:15.126530+0000","last_became_active":"2024-06-04T15:52:38.482388+0000","last_became_peered":"2024-06-04T15:52:38.482388+0000","last_unstale":"2024-06-04T16:19:15.126530+0000","last_undegraded":"2024-06-04T16:19:15.126530+0000","last_fullsized":"2024-06-04T16:19:15.126530+0000","mapping_epoch":23,"log_start":"251'100","ondisk_log_start":"251'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":100,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T19:55:37.296059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":625,"num_read_kb":571,"num_write":157,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1e","version":"251'81","reported_seq":611,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:45.010443+0000","last_change":"2024-06-04T15:52:36.485805+0000","last_active":"2024-06-04T16:18:45.010443+0000","last_peered":"2024-06-04T16:18:45.010443+0000","last_clean":"2024-06-04T16:18:45.010443+0000","last_became_active":"2024-06-04T15:52:36.485401+0000","last_became_peered":"2024-06-04T15:52:36.485401+0000","last_unstale":"2024-06-04T16:18:45.010443+0000","last_undegraded":"2024-06-04T16:18:45.010443+0000","last_fullsized":"2024-06-04T16:18:45.010443+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T21:08:15.786697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133679,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":131,"num_read_kb":40112,"num_write":294,"num_write_kb":27266,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,3],"acting":[5,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":476,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:15.117868+0000","last_change":"2024-06-04T15:52:40.483568+0000","last_active":"2024-06-04T16:19:15.117868+0000","last_peered":"2024-06-04T16:19:15.117868+0000","last_clean":"2024-06-04T16:19:15.117868+0000","last_became_active":"2024-06-04T15:52:40.483272+0000","last_became_peered":"2024-06-04T15:52:40.483272+0000","last_unstale":"2024-06-04T16:19:15.117868+0000","last_undegraded":"2024-06-04T16:19:15.117868+0000","last_fullsized":"2024-06-04T16:19:15.117868+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_clean_scrub_stamp":"2024-06-04T15:52:39.463103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T18:29:36.613477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"254'78","reported_seq":602,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:20:15.022198+0000","last_change":"2024-06-04T15:52:42.497288+0000","last_active":"2024-06-04T16:20:15.022198+0000","last_peered":"2024-06-04T16:20:15.022198+0000","last_clean":"2024-06-04T16:20:15.022198+0000","last_became_active":"2024-06-04T15:52:42.496934+0000","last_became_peered":"2024-06-04T15:52:42.496934+0000","last_unstale":"2024-06-04T16:20:15.022198+0000","last_undegraded":"2024-06-04T16:20:15.022198+0000","last_fullsized":"2024-06-04T16:20:15.022198+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_clean_scrub_stamp":"2024-06-04T15:52:41.476734+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T17:14:55.894511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9483,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":111,"num_read_kb":167,"num_write":50,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":464,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:17:45.001177+0000","last_change":"2024-06-04T15:52:44.519077+0000","last_active":"2024-06-04T16:17:45.001177+0000","last_peered":"2024-06-04T16:17:45.001177+0000","last_clean":"2024-06-04T16:17:45.001177+0000","last_became_active":"2024-06-04T15:52:44.518782+0000","last_became_peered":"2024-06-04T15:52:44.518782+0000","last_unstale":"2024-06-04T16:17:45.001177+0000","last_undegraded":"2024-06-04T16:17:45.001177+0000","last_fullsized":"2024-06-04T16:17:45.001177+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_clean_scrub_stamp":"2024-06-04T15:52:43.492872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T16:06:38.344510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"254'41","reported_seq":528,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:25.012872+0000","last_change":"2024-06-04T15:52:46.532088+0000","last_active":"2024-06-04T16:19:25.012872+0000","last_peered":"2024-06-04T16:19:25.012872+0000","last_clean":"2024-06-04T16:19:25.012872+0000","last_became_active":"2024-06-04T15:52:46.531795+0000","last_became_peered":"2024-06-04T15:52:46.531795+0000","last_unstale":"2024-06-04T16:19:25.012872+0000","last_undegraded":"2024-06-04T16:19:25.012872+0000","last_fullsized":"2024-06-04T16:19:25.012872+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:45.513877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:45.513877+0000","last_clean_scrub_stamp":"2024-06-04T15:52:45.513877+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T00:05:55.568943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":429,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":136,"num_read_kb":110,"num_write":109,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"254'356","reported_seq":1091,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:15.007748+0000","last_change":"2024-06-04T15:52:38.478558+0000","last_active":"2024-06-04T16:19:15.007748+0000","last_peered":"2024-06-04T16:19:15.007748+0000","last_clean":"2024-06-04T16:19:15.007748+0000","last_became_active":"2024-06-04T15:52:38.478204+0000","last_became_peered":"2024-06-04T15:52:38.478204+0000","last_unstale":"2024-06-04T16:19:15.007748+0000","last_undegraded":"2024-06-04T16:19:15.007748+0000","last_fullsized":"2024-06-04T16:19:15.007748+0000","mapping_epoch":23,"log_start":"251'300","ondisk_log_start":"251'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":300,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T17:34:50.324391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1642,"num_read_kb":1482,"num_write":614,"num_write_kb":292,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"251'22","reported_seq":513,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:45.018530+0000","last_change":"2024-06-04T15:52:36.478256+0000","last_active":"2024-06-04T16:19:45.018530+0000","last_peered":"2024-06-04T16:19:45.018530+0000","last_clean":"2024-06-04T16:19:45.018530+0000","last_became_active":"2024-06-04T15:52:36.477895+0000","last_became_peered":"2024-06-04T15:52:36.477895+0000","last_unstale":"2024-06-04T16:19:45.018530+0000","last_undegraded":"2024-06-04T16:19:45.018530+0000","last_fullsized":"2024-06-04T16:19:45.018530+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T22:33:16.679149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":78,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":120,"num_write_kb":13440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.19","version":"26'1","reported_seq":475,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:20.014466+0000","last_change":"2024-06-04T15:52:40.483405+0000","last_active":"2024-06-04T16:19:20.014466+0000","last_peered":"2024-06-04T16:19:20.014466+0000","last_clean":"2024-06-04T16:19:20.014466+0000","last_became_active":"2024-06-04T15:52:40.483131+0000","last_became_peered":"2024-06-04T15:52:40.483131+0000","last_unstale":"2024-06-04T16:19:20.014466+0000","last_undegraded":"2024-06-04T16:19:20.014466+0000","last_fullsized":"2024-06-04T16:19:20.014466+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_clean_scrub_stamp":"2024-06-04T15:52:39.463103+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T20:46:09.924823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1a","version":"254'116","reported_seq":664,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:20:15.018422+0000","last_change":"2024-06-04T15:52:42.503809+0000","last_active":"2024-06-04T16:20:15.018422+0000","last_peered":"2024-06-04T16:20:15.018422+0000","last_clean":"2024-06-04T16:20:15.018422+0000","last_became_active":"2024-06-04T15:52:42.503538+0000","last_became_peered":"2024-06-04T15:52:42.503538+0000","last_unstale":"2024-06-04T16:20:15.018422+0000","last_undegraded":"2024-06-04T16:20:15.018422+0000","last_fullsized":"2024-06-04T16:20:15.018422+0000","mapping_epoch":27,"log_start":"251'100","ondisk_log_start":"251'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_clean_scrub_stamp":"2024-06-04T15:52:41.476734+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":100,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T23:22:34.954352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8203,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":173,"num_read_kb":219,"num_write":92,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":465,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:17:45.001893+0000","last_change":"2024-06-04T15:52:44.520133+0000","last_active":"2024-06-04T16:17:45.001893+0000","last_peered":"2024-06-04T16:17:45.001893+0000","last_clean":"2024-06-04T16:17:45.001893+0000","last_became_active":"2024-06-04T15:52:44.519867+0000","last_became_peered":"2024-06-04T15:52:44.519867+0000","last_unstale":"2024-06-04T16:17:45.001893+0000","last_undegraded":"2024-06-04T16:17:45.001893+0000","last_fullsized":"2024-06-04T16:17:45.001893+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_clean_scrub_stamp":"2024-06-04T15:52:43.492872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T23:38:01.226210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.14","version":"254'30","reported_seq":529,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:35.003247+0000","last_change":"2024-06-04T15:52:46.538083+0000","last_active":"2024-06-04T16:18:35.003247+0000","last_peered":"2024-06-04T16:18:35.003247+0000","last_clean":"2024-06-04T16:18:35.003247+0000","last_became_active":"2024-06-04T15:52:46.537792+0000","last_became_peered":"2024-06-04T15:52:46.537792+0000","last_unstale":"2024-06-04T16:18:35.003247+0000","last_undegraded":"2024-06-04T16:18:35.003247+0000","last_fullsized":"2024-06-04T16:18:35.003247+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:45.513877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:45.513877+0000","last_clean_scrub_stamp":"2024-06-04T15:52:45.513877+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T19:51:33.137699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":433,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":163,"num_read_kb":128,"num_write":83,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"254'156","reported_seq":946,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:40.009213+0000","last_change":"2024-06-04T15:52:38.486670+0000","last_active":"2024-06-04T16:18:40.009213+0000","last_peered":"2024-06-04T16:18:40.009213+0000","last_clean":"2024-06-04T16:18:40.009213+0000","last_became_active":"2024-06-04T15:52:38.486335+0000","last_became_peered":"2024-06-04T15:52:38.486335+0000","last_unstale":"2024-06-04T16:18:40.009213+0000","last_undegraded":"2024-06-04T16:18:40.009213+0000","last_fullsized":"2024-06-04T16:18:40.009213+0000","mapping_epoch":23,"log_start":"251'100","ondisk_log_start":"251'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":100,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T02:25:00.264822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":839,"num_read_kb":763,"num_write":210,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.20","version":"254'53","reported_seq":567,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:45.010633+0000","last_change":"2024-06-04T15:53:14.002874+0000","last_active":"2024-06-04T16:19:45.010633+0000","last_peered":"2024-06-04T16:19:45.010633+0000","last_clean":"2024-06-04T16:19:45.010633+0000","last_became_active":"2024-06-04T15:53:14.002428+0000","last_became_peered":"2024-06-04T15:53:14.002428+0000","last_unstale":"2024-06-04T16:19:45.010633+0000","last_undegraded":"2024-06-04T16:19:45.010633+0000","last_fullsized":"2024-06-04T16:19:45.010633+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T00:01:17.187786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194330,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":80,"num_read_kb":15429,"num_write":205,"num_write_kb":34585,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5],"acting":[2,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"254'241","reported_seq":911,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:40.121513+0000","last_change":"2024-06-04T15:52:38.481773+0000","last_active":"2024-06-04T16:18:40.121513+0000","last_peered":"2024-06-04T16:18:40.121513+0000","last_clean":"2024-06-04T16:18:40.121513+0000","last_became_active":"2024-06-04T15:52:38.481490+0000","last_became_peered":"2024-06-04T15:52:38.481490+0000","last_unstale":"2024-06-04T16:18:40.121513+0000","last_undegraded":"2024-06-04T16:18:40.121513+0000","last_fullsized":"2024-06-04T16:18:40.121513+0000","mapping_epoch":23,"log_start":"251'200","ondisk_log_start":"251'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":200,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T21:24:52.955365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1011,"num_read_kb":836,"num_write":379,"num_write_kb":158,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.21","version":"254'53","reported_seq":554,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:45.130715+0000","last_change":"2024-06-04T15:52:36.495330+0000","last_active":"2024-06-04T16:19:45.130715+0000","last_peered":"2024-06-04T16:19:45.130715+0000","last_clean":"2024-06-04T16:19:45.130715+0000","last_became_active":"2024-06-04T15:52:36.495008+0000","last_became_peered":"2024-06-04T15:52:36.495008+0000","last_unstale":"2024-06-04T16:19:45.130715+0000","last_undegraded":"2024-06-04T16:19:45.130715+0000","last_fullsized":"2024-06-04T16:19:45.130715+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T01:04:03.095444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":62,"num_read_kb":12338,"num_write":218,"num_write_kb":31559,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.25","version":"254'138","reported_seq":973,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:40.007807+0000","last_change":"2024-06-04T15:52:38.482192+0000","last_active":"2024-06-04T16:18:40.007807+0000","last_peered":"2024-06-04T16:18:40.007807+0000","last_clean":"2024-06-04T16:18:40.007807+0000","last_became_active":"2024-06-04T15:52:38.481916+0000","last_became_peered":"2024-06-04T15:52:38.481916+0000","last_unstale":"2024-06-04T16:18:40.007807+0000","last_undegraded":"2024-06-04T16:18:40.007807+0000","last_fullsized":"2024-06-04T16:18:40.007807+0000","mapping_epoch":23,"log_start":"251'100","ondisk_log_start":"251'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T16:53:51.388099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":911,"num_read_kb":859,"num_write":180,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"254'57","reported_seq":584,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:45.015057+0000","last_change":"2024-06-04T15:52:36.482905+0000","last_active":"2024-06-04T16:19:45.015057+0000","last_peered":"2024-06-04T16:19:45.015057+0000","last_clean":"2024-06-04T16:19:45.015057+0000","last_became_active":"2024-06-04T15:52:36.482589+0000","last_became_peered":"2024-06-04T15:52:36.482589+0000","last_unstale":"2024-06-04T16:19:45.015057+0000","last_undegraded":"2024-06-04T16:19:45.015057+0000","last_fullsized":"2024-06-04T16:19:45.015057+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T01:08:39.575276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":133,"num_read_kb":8380,"num_write":297,"num_write_kb":18008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7],"acting":[3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"254'104","reported_seq":811,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:40.009685+0000","last_change":"2024-06-04T15:52:38.486331+0000","last_active":"2024-06-04T16:18:40.009685+0000","last_peered":"2024-06-04T16:18:40.009685+0000","last_clean":"2024-06-04T16:18:40.009685+0000","last_became_active":"2024-06-04T15:52:38.486018+0000","last_became_peered":"2024-06-04T15:52:38.486018+0000","last_unstale":"2024-06-04T16:18:40.009685+0000","last_undegraded":"2024-06-04T16:18:40.009685+0000","last_fullsized":"2024-06-04T16:18:40.009685+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T01:56:20.478655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":549,"num_read_kb":515,"num_write":118,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"251'48","reported_seq":559,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:50.019151+0000","last_change":"2024-06-04T15:52:36.496569+0000","last_active":"2024-06-04T16:19:50.019151+0000","last_peered":"2024-06-04T16:19:50.019151+0000","last_clean":"2024-06-04T16:19:50.019151+0000","last_became_active":"2024-06-04T15:52:36.496125+0000","last_became_peered":"2024-06-04T15:52:36.496125+0000","last_unstale":"2024-06-04T16:19:50.019151+0000","last_undegraded":"2024-06-04T16:19:50.019151+0000","last_fullsized":"2024-06-04T16:19:50.019151+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T19:29:40.820287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":98,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":59,"num_read_kb":26302,"num_write":204,"num_write_kb":24798,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,0],"acting":[5,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.23","version":"254'93","reported_seq":807,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:50.019175+0000","last_change":"2024-06-04T15:52:38.485339+0000","last_active":"2024-06-04T16:19:50.019175+0000","last_peered":"2024-06-04T16:19:50.019175+0000","last_clean":"2024-06-04T16:19:50.019175+0000","last_became_active":"2024-06-04T15:52:38.484927+0000","last_became_peered":"2024-06-04T15:52:38.484927+0000","last_unstale":"2024-06-04T16:19:50.019175+0000","last_undegraded":"2024-06-04T16:19:50.019175+0000","last_fullsized":"2024-06-04T16:19:50.019175+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T21:19:16.498288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":509,"num_read_kb":485,"num_write":106,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"254'52","reported_seq":554,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:40.008829+0000","last_change":"2024-06-04T15:53:14.183689+0000","last_active":"2024-06-04T16:18:40.008829+0000","last_peered":"2024-06-04T16:18:40.008829+0000","last_clean":"2024-06-04T16:18:40.008829+0000","last_became_active":"2024-06-04T15:53:14.183279+0000","last_became_peered":"2024-06-04T15:53:14.183279+0000","last_unstale":"2024-06-04T16:18:40.008829+0000","last_undegraded":"2024-06-04T16:18:40.008829+0000","last_fullsized":"2024-06-04T16:18:40.008829+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T23:59:10.245827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1395816,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":52,"num_read_kb":1141,"num_write":191,"num_write_kb":22936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.22","version":"254'208","reported_seq":1101,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:45.010113+0000","last_change":"2024-06-04T15:52:38.489058+0000","last_active":"2024-06-04T16:19:45.010113+0000","last_peered":"2024-06-04T16:19:45.010113+0000","last_clean":"2024-06-04T16:19:45.010113+0000","last_became_active":"2024-06-04T15:52:38.488762+0000","last_became_peered":"2024-06-04T15:52:38.488762+0000","last_unstale":"2024-06-04T16:19:45.010113+0000","last_undegraded":"2024-06-04T16:19:45.010113+0000","last_fullsized":"2024-06-04T16:19:45.010113+0000","mapping_epoch":23,"log_start":"251'100","ondisk_log_start":"251'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":100,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T02:35:48.920769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1221,"num_read_kb":1130,"num_write":279,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.25","version":"254'51","reported_seq":550,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:40.008870+0000","last_change":"2024-06-04T15:52:36.489331+0000","last_active":"2024-06-04T16:18:40.008870+0000","last_peered":"2024-06-04T16:18:40.008870+0000","last_clean":"2024-06-04T16:18:40.008870+0000","last_became_active":"2024-06-04T15:52:36.488611+0000","last_became_peered":"2024-06-04T15:52:36.488611+0000","last_unstale":"2024-06-04T16:18:40.008870+0000","last_undegraded":"2024-06-04T16:18:40.008870+0000","last_fullsized":"2024-06-04T16:18:40.008870+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T19:29:35.729548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":75,"num_read_kb":4172,"num_write":239,"num_write_kb":26328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"254'157","reported_seq":913,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:45.017560+0000","last_change":"2024-06-04T15:52:38.482854+0000","last_active":"2024-06-04T16:19:45.017560+0000","last_peered":"2024-06-04T16:19:45.017560+0000","last_clean":"2024-06-04T16:19:45.017560+0000","last_became_active":"2024-06-04T15:52:38.482566+0000","last_became_peered":"2024-06-04T15:52:38.482566+0000","last_unstale":"2024-06-04T16:19:45.017560+0000","last_undegraded":"2024-06-04T16:19:45.017560+0000","last_fullsized":"2024-06-04T16:19:45.017560+0000","mapping_epoch":23,"log_start":"251'100","ondisk_log_start":"251'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":100,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T03:29:54.648609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":759,"num_read_kb":686,"num_write":203,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"254'59","reported_seq":559,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:40.004208+0000","last_change":"2024-06-04T15:52:36.487513+0000","last_active":"2024-06-04T16:18:40.004208+0000","last_peered":"2024-06-04T16:18:40.004208+0000","last_clean":"2024-06-04T16:18:40.004208+0000","last_became_active":"2024-06-04T15:52:36.487213+0000","last_became_peered":"2024-06-04T15:52:36.487213+0000","last_unstale":"2024-06-04T16:18:40.004208+0000","last_undegraded":"2024-06-04T16:18:40.004208+0000","last_fullsized":"2024-06-04T16:18:40.004208+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T23:57:12.412972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3860915,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":58,"num_read_kb":7398,"num_write":258,"num_write_kb":28567,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"254'120","reported_seq":861,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:45.120878+0000","last_change":"2024-06-04T15:52:38.477288+0000","last_active":"2024-06-04T16:19:45.120878+0000","last_peered":"2024-06-04T16:19:45.120878+0000","last_clean":"2024-06-04T16:19:45.120878+0000","last_became_active":"2024-06-04T15:52:38.477036+0000","last_became_peered":"2024-06-04T15:52:38.477036+0000","last_unstale":"2024-06-04T16:19:45.120878+0000","last_undegraded":"2024-06-04T16:19:45.120878+0000","last_fullsized":"2024-06-04T16:19:45.120878+0000","mapping_epoch":23,"log_start":"251'100","ondisk_log_start":"251'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":100,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T23:17:01.386746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":627,"num_read_kb":578,"num_write":156,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"254'48","reported_seq":562,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:40.009774+0000","last_change":"2024-06-04T15:52:36.482150+0000","last_active":"2024-06-04T16:18:40.009774+0000","last_peered":"2024-06-04T16:18:40.009774+0000","last_clean":"2024-06-04T16:18:40.009774+0000","last_became_active":"2024-06-04T15:52:36.479810+0000","last_became_peered":"2024-06-04T15:52:36.479810+0000","last_unstale":"2024-06-04T16:18:40.009774+0000","last_undegraded":"2024-06-04T16:18:40.009774+0000","last_fullsized":"2024-06-04T16:18:40.009774+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T21:50:19.054304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048839,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":103,"num_read_kb":5904,"num_write":252,"num_write_kb":17938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2f","version":"254'58","reported_seq":706,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:23.264257+0000","last_change":"2024-06-04T15:52:38.482098+0000","last_active":"2024-06-04T16:18:23.264257+0000","last_peered":"2024-06-04T16:18:23.264257+0000","last_clean":"2024-06-04T16:18:23.264257+0000","last_became_active":"2024-06-04T15:52:38.481789+0000","last_became_peered":"2024-06-04T15:52:38.481789+0000","last_unstale":"2024-06-04T16:18:23.264257+0000","last_undegraded":"2024-06-04T16:18:23.264257+0000","last_fullsized":"2024-06-04T16:18:23.264257+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T21:41:15.834685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":316,"num_read_kb":309,"num_write":62,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.28","version":"254'57","reported_seq":591,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:45.008317+0000","last_change":"2024-06-04T15:52:36.491357+0000","last_active":"2024-06-04T16:18:45.008317+0000","last_peered":"2024-06-04T16:18:45.008317+0000","last_clean":"2024-06-04T16:18:45.008317+0000","last_became_active":"2024-06-04T15:52:36.490119+0000","last_became_peered":"2024-06-04T15:52:36.490119+0000","last_unstale":"2024-06-04T16:18:45.008317+0000","last_undegraded":"2024-06-04T16:18:45.008317+0000","last_fullsized":"2024-06-04T16:18:45.008317+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T02:06:04.469487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262178,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":124,"num_read_kb":46547,"num_write":231,"num_write_kb":19872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7],"acting":[3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"254'93","reported_seq":777,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:20.001732+0000","last_change":"2024-06-04T15:52:38.489137+0000","last_active":"2024-06-04T16:18:20.001732+0000","last_peered":"2024-06-04T16:18:20.001732+0000","last_clean":"2024-06-04T16:18:20.001732+0000","last_became_active":"2024-06-04T15:52:38.488839+0000","last_became_peered":"2024-06-04T15:52:38.488839+0000","last_unstale":"2024-06-04T16:18:20.001732+0000","last_undegraded":"2024-06-04T16:18:20.001732+0000","last_fullsized":"2024-06-04T16:18:20.001732+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T16:24:19.359126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":464,"num_read_kb":434,"num_write":108,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.29","version":"254'42","reported_seq":546,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:40.017602+0000","last_change":"2024-06-04T15:52:36.496347+0000","last_active":"2024-06-04T16:19:40.017602+0000","last_peered":"2024-06-04T16:19:40.017602+0000","last_clean":"2024-06-04T16:19:40.017602+0000","last_became_active":"2024-06-04T15:52:36.495936+0000","last_became_peered":"2024-06-04T15:52:36.495936+0000","last_unstale":"2024-06-04T16:19:40.017602+0000","last_undegraded":"2024-06-04T16:19:40.017602+0000","last_fullsized":"2024-06-04T16:19:40.017602+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T19:20:27.592911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133666,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":74,"num_read_kb":10396,"num_write":213,"num_write_kb":18947,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,0],"acting":[5,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2d","version":"254'115","reported_seq":798,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:45.018461+0000","last_change":"2024-06-04T15:52:38.488600+0000","last_active":"2024-06-04T16:19:45.018461+0000","last_peered":"2024-06-04T16:19:45.018461+0000","last_clean":"2024-06-04T16:19:45.018461+0000","last_became_active":"2024-06-04T15:52:38.488289+0000","last_became_peered":"2024-06-04T15:52:38.488289+0000","last_unstale":"2024-06-04T16:19:45.018461+0000","last_undegraded":"2024-06-04T16:19:45.018461+0000","last_fullsized":"2024-06-04T16:19:45.018461+0000","mapping_epoch":23,"log_start":"251'100","ondisk_log_start":"251'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":100,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T02:23:18.956319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":534,"num_read_kb":481,"num_write":150,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"254'65","reported_seq":573,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:40.120365+0000","last_change":"2024-06-04T15:52:36.495691+0000","last_active":"2024-06-04T16:19:40.120365+0000","last_peered":"2024-06-04T16:19:40.120365+0000","last_clean":"2024-06-04T16:19:40.120365+0000","last_became_active":"2024-06-04T15:52:36.495386+0000","last_became_peered":"2024-06-04T15:52:36.495386+0000","last_unstale":"2024-06-04T16:19:40.120365+0000","last_undegraded":"2024-06-04T16:19:40.120365+0000","last_fullsized":"2024-06-04T16:19:40.120365+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T17:58:34.573671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8748224,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":68,"num_read_kb":17530,"num_write":237,"num_write_kb":31151,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"254'90","reported_seq":828,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:40.120391+0000","last_change":"2024-06-04T15:52:38.477573+0000","last_active":"2024-06-04T16:19:40.120391+0000","last_peered":"2024-06-04T16:19:40.120391+0000","last_clean":"2024-06-04T16:19:40.120391+0000","last_became_active":"2024-06-04T15:52:38.477333+0000","last_became_peered":"2024-06-04T15:52:38.477333+0000","last_unstale":"2024-06-04T16:19:40.120391+0000","last_undegraded":"2024-06-04T16:19:40.120391+0000","last_fullsized":"2024-06-04T16:19:40.120391+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T22:56:07.200710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":521,"num_read_kb":500,"num_write":102,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"251'47","reported_seq":558,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:40.017162+0000","last_change":"2024-06-04T15:52:36.483514+0000","last_active":"2024-06-04T16:19:40.017162+0000","last_peered":"2024-06-04T16:19:40.017162+0000","last_clean":"2024-06-04T16:19:40.017162+0000","last_became_active":"2024-06-04T15:52:36.482036+0000","last_became_peered":"2024-06-04T15:52:36.482036+0000","last_unstale":"2024-06-04T16:19:40.017162+0000","last_undegraded":"2024-06-04T16:19:40.017162+0000","last_fullsized":"2024-06-04T16:19:40.017162+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T17:16:27.012465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1069194,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":76,"num_read_kb":25646,"num_write":152,"num_write_kb":18921,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,6],"acting":[4,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"254'150","reported_seq":903,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:40.120383+0000","last_change":"2024-06-04T15:52:38.481261+0000","last_active":"2024-06-04T16:19:40.120383+0000","last_peered":"2024-06-04T16:19:40.120383+0000","last_clean":"2024-06-04T16:19:40.120383+0000","last_became_active":"2024-06-04T15:52:38.480432+0000","last_became_peered":"2024-06-04T15:52:38.480432+0000","last_unstale":"2024-06-04T16:19:40.120383+0000","last_undegraded":"2024-06-04T16:19:40.120383+0000","last_fullsized":"2024-06-04T16:19:40.120383+0000","mapping_epoch":23,"log_start":"251'100","ondisk_log_start":"251'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":100,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T19:12:13.612916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":703,"num_read_kb":638,"num_write":178,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"254'54","reported_seq":554,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:40.009639+0000","last_change":"2024-06-04T15:52:36.492604+0000","last_active":"2024-06-04T16:19:40.009639+0000","last_peered":"2024-06-04T16:19:40.009639+0000","last_clean":"2024-06-04T16:19:40.009639+0000","last_became_active":"2024-06-04T15:52:36.488813+0000","last_became_peered":"2024-06-04T15:52:36.488813+0000","last_unstale":"2024-06-04T16:19:40.009639+0000","last_undegraded":"2024-06-04T16:19:40.009639+0000","last_fullsized":"2024-06-04T16:19:40.009639+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T17:27:44.315490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":75,"num_read_kb":5170,"num_write":190,"num_write_kb":17954,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6],"acting":[0,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"254'97","reported_seq":791,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:40.129909+0000","last_change":"2024-06-04T15:52:38.479843+0000","last_active":"2024-06-04T16:19:40.129909+0000","last_peered":"2024-06-04T16:19:40.129909+0000","last_clean":"2024-06-04T16:19:40.129909+0000","last_became_active":"2024-06-04T15:52:38.479542+0000","last_became_peered":"2024-06-04T15:52:38.479542+0000","last_unstale":"2024-06-04T16:19:40.129909+0000","last_undegraded":"2024-06-04T16:19:40.129909+0000","last_fullsized":"2024-06-04T16:19:40.129909+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T22:41:21.159508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":493,"num_read_kb":461,"num_write":115,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"251'65","reported_seq":574,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:45.015100+0000","last_change":"2024-06-04T15:52:36.488268+0000","last_active":"2024-06-04T16:19:45.015100+0000","last_peered":"2024-06-04T16:19:45.015100+0000","last_clean":"2024-06-04T16:19:45.015100+0000","last_became_active":"2024-06-04T15:52:36.487971+0000","last_became_peered":"2024-06-04T15:52:36.487971+0000","last_unstale":"2024-06-04T16:19:45.015100+0000","last_undegraded":"2024-06-04T16:19:45.015100+0000","last_fullsized":"2024-06-04T16:19:45.015100+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T21:45:32.006937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262163,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":94,"num_read_kb":7564,"num_write":255,"num_write_kb":36740,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"254'136","reported_seq":911,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:40.017107+0000","last_change":"2024-06-04T15:52:38.484562+0000","last_active":"2024-06-04T16:19:40.017107+0000","last_peered":"2024-06-04T16:19:40.017107+0000","last_clean":"2024-06-04T16:19:40.017107+0000","last_became_active":"2024-06-04T15:52:38.484225+0000","last_became_peered":"2024-06-04T15:52:38.484225+0000","last_unstale":"2024-06-04T16:19:40.017107+0000","last_undegraded":"2024-06-04T16:19:40.017107+0000","last_fullsized":"2024-06-04T16:19:40.017107+0000","mapping_epoch":23,"log_start":"251'100","ondisk_log_start":"251'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":100,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T02:17:33.313293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":727,"num_read_kb":670,"num_write":170,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2e","version":"254'54","reported_seq":565,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:20.118439+0000","last_change":"2024-06-04T15:52:36.488496+0000","last_active":"2024-06-04T16:18:20.118439+0000","last_peered":"2024-06-04T16:18:20.118439+0000","last_clean":"2024-06-04T16:18:20.118439+0000","last_became_active":"2024-06-04T15:52:36.488139+0000","last_became_peered":"2024-06-04T15:52:36.488139+0000","last_unstale":"2024-06-04T16:18:20.118439+0000","last_undegraded":"2024-06-04T16:18:20.118439+0000","last_fullsized":"2024-06-04T16:18:20.118439+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T23:07:58.153939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048641,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":102,"num_read_kb":14422,"num_write":267,"num_write_kb":32685,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,3],"acting":[7,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.28","version":"254'289","reported_seq":1123,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:40.113801+0000","last_change":"2024-06-04T15:52:38.480910+0000","last_active":"2024-06-04T16:18:40.113801+0000","last_peered":"2024-06-04T16:18:40.113801+0000","last_clean":"2024-06-04T16:18:40.113801+0000","last_became_active":"2024-06-04T15:52:38.480613+0000","last_became_peered":"2024-06-04T15:52:38.480613+0000","last_unstale":"2024-06-04T16:18:40.113801+0000","last_undegraded":"2024-06-04T16:18:40.113801+0000","last_fullsized":"2024-06-04T16:18:40.113801+0000","mapping_epoch":23,"log_start":"251'200","ondisk_log_start":"251'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":200,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T20:28:05.010058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1456,"num_read_kb":1243,"num_write":452,"num_write_kb":208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"254'57","reported_seq":557,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:20.005372+0000","last_change":"2024-06-04T15:52:36.498902+0000","last_active":"2024-06-04T16:18:20.005372+0000","last_peered":"2024-06-04T16:18:20.005372+0000","last_clean":"2024-06-04T16:18:20.005372+0000","last_became_active":"2024-06-04T15:52:36.498564+0000","last_became_peered":"2024-06-04T15:52:36.498564+0000","last_unstale":"2024-06-04T16:18:20.005372+0000","last_undegraded":"2024-06-04T16:18:20.005372+0000","last_fullsized":"2024-06-04T16:18:20.005372+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T03:32:39.163905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1395816,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":73,"num_read_kb":11423,"num_write":228,"num_write_kb":34926,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"251'38","reported_seq":548,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:20.005214+0000","last_change":"2024-06-04T15:52:36.490119+0000","last_active":"2024-06-04T16:18:20.005214+0000","last_peered":"2024-06-04T16:18:20.005214+0000","last_clean":"2024-06-04T16:18:20.005214+0000","last_became_active":"2024-06-04T15:52:36.489681+0000","last_became_peered":"2024-06-04T15:52:36.489681+0000","last_unstale":"2024-06-04T16:18:20.005214+0000","last_undegraded":"2024-06-04T16:18:20.005214+0000","last_fullsized":"2024-06-04T16:18:20.005214+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T23:00:19.953809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1395831,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":78,"num_read_kb":4250,"num_write":172,"num_write_kb":18293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,6],"acting":[3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"254'119","reported_seq":1022,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:20.014594+0000","last_change":"2024-06-04T15:52:38.489275+0000","last_active":"2024-06-04T16:19:20.014594+0000","last_peered":"2024-06-04T16:19:20.014594+0000","last_clean":"2024-06-04T16:19:20.014594+0000","last_became_active":"2024-06-04T15:52:38.488941+0000","last_became_peered":"2024-06-04T15:52:38.488941+0000","last_unstale":"2024-06-04T16:19:20.014594+0000","last_undegraded":"2024-06-04T16:19:20.014594+0000","last_fullsized":"2024-06-04T16:19:20.014594+0000","mapping_epoch":23,"log_start":"251'100","ondisk_log_start":"251'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":100,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T02:49:46.129022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1004,"num_read_kb":976,"num_write":157,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"251'45","reported_seq":542,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:20.006817+0000","last_change":"2024-06-04T15:52:36.496468+0000","last_active":"2024-06-04T16:18:20.006817+0000","last_peered":"2024-06-04T16:18:20.006817+0000","last_clean":"2024-06-04T16:18:20.006817+0000","last_became_active":"2024-06-04T15:52:36.496046+0000","last_became_peered":"2024-06-04T15:52:36.496046+0000","last_unstale":"2024-06-04T16:18:20.006817+0000","last_undegraded":"2024-06-04T16:18:20.006817+0000","last_fullsized":"2024-06-04T16:18:20.006817+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T17:39:51.740231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1069179,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":46,"num_read_kb":3657,"num_write":159,"num_write_kb":22961,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3],"acting":[5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.36","version":"254'112","reported_seq":818,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:15.117929+0000","last_change":"2024-06-04T15:52:38.474859+0000","last_active":"2024-06-04T16:19:15.117929+0000","last_peered":"2024-06-04T16:19:15.117929+0000","last_clean":"2024-06-04T16:19:15.117929+0000","last_became_active":"2024-06-04T15:52:38.474574+0000","last_became_peered":"2024-06-04T15:52:38.474574+0000","last_unstale":"2024-06-04T16:19:15.117929+0000","last_undegraded":"2024-06-04T16:19:15.117929+0000","last_fullsized":"2024-06-04T16:19:15.117929+0000","mapping_epoch":23,"log_start":"254'100","ondisk_log_start":"254'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":100,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T00:26:50.523752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":563,"num_read_kb":518,"num_write":138,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":89899943,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":141,"num_read_kb":189232,"num_write":151,"num_write_kb":125730,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":179806208,"data_stored":179799886,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":98,"ondisk_log_size":98,"up":64,"acting":64,"num_store_stats":8},{"poolid":64,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4378,"num_read_kb":3242,"num_write":1279,"num_write_kb":637,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":682,"ondisk_log_size":682,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":8922,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":3579,"num_read_kb":3443,"num_write":3611,"num_write_kb":1042,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":319488,"data_stored":17844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":999,"ondisk_log_size":999,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":540,"ondisk_log_size":540,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":322695,"num_objects":188,"num_object_clones":0,"num_object_copies":376,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":188,"num_whiteouts":0,"num_read":5850,"num_read_kb":7341,"num_write":3099,"num_write_kb":955,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":466944,"data_stored":51064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1987,"ondisk_log_size":1987,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1523,"num_read_kb":1813,"num_write":20,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11,"ondisk_log_size":11,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":77,"num_object_clones":0,"num_object_copies":154,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":77,"num_whiteouts":0,"num_read":48565,"num_read_kb":44901,"num_write":11590,"num_write_kb":3535,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":77,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3758,"ondisk_log_size":3758,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":137662699,"num_objects":221,"num_object_clones":0,"num_object_copies":663,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":221,"num_whiteouts":0,"num_read":5460,"num_read_kb":1011284,"num_write":14339,"num_write_kb":1691909,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":208244736,"data_stored":208244736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3476,"ondisk_log_size":3476,"up":192,"acting":192,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":12,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4,"ondisk_log_size":4,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":89899943,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":142,"num_read_kb":185843,"num_write":151,"num_write_kb":125730,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":179806208,"data_stored":179799886,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":98,"ondisk_log_size":98,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542512,"num_pgs":96,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":247592,"kb_used_data":76256,"kb_used_omap":1,"kb_used_meta":171326,"kb_avail":94124248,"statfs":{"total":96636764160,"available":96383229952,"internally_reserved":0,"allocated":78086144,"data_stored":76191346,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":175438282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542512,"num_pgs":108,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":121188,"kb_used_data":76124,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94250652,"statfs":{"total":96636764160,"available":96512667648,"internally_reserved":0,"allocated":77950976,"data_stored":76057701,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":46135751},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542511,"num_pgs":115,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":262524,"kb_used_data":60596,"kb_used_omap":1,"kb_used_meta":201918,"kb_avail":94109316,"statfs":{"total":96636764160,"available":96367939584,"internally_reserved":0,"allocated":62050304,"data_stored":60152093,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":206764485},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542509,"num_pgs":122,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":199188,"kb_used_data":81996,"kb_used_omap":1,"kb_used_meta":117182,"kb_avail":94172652,"statfs":{"total":96636764160,"available":96432795648,"internally_reserved":0,"allocated":83963904,"data_stored":82057842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":119994821},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542512,"num_pgs":119,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":256976,"kb_used_data":81416,"kb_used_omap":1,"kb_used_meta":175550,"kb_avail":94114864,"statfs":{"total":96636764160,"available":96373620736,"internally_reserved":0,"allocated":83369984,"data_stored":81465877,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":179763655},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542512,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":143988,"kb_used_data":68396,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94227852,"statfs":{"total":96636764160,"available":96489320448,"internally_reserved":0,"allocated":70037504,"data_stored":68148471,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":77396421},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542511,"num_pgs":98,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302136,"kb_used_data":76592,"kb_used_omap":1,"kb_used_meta":225534,"kb_avail":94069704,"statfs":{"total":96636764160,"available":96327376896,"internally_reserved":0,"allocated":78430208,"data_stored":76518037,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":230947269},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542512,"num_pgs":93,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":111124,"kb_used_data":66060,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94260716,"statfs":{"total":96636764160,"available":96522973184,"internally_reserved":0,"allocated":67645440,"data_stored":65730083,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":35586048,"data_stored":35586048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":32743424,"data_stored":32743424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":28192768,"data_stored":28192768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":29757440,"data_stored":29757440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":26411008,"data_stored":26411008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":19648512,"data_stored":19648512,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16453632,"data_stored":16453632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":19451904,"data_stored":19451904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":1139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":6128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":6701,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1653,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":4106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":10832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":8870,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":6105,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":6669,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2484,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1047,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":2789,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":2757,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2173,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2491,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1703,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":64,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":64,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":64,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":64,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":64,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":64,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":64,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":64,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":14680064,"data_stored":14680064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":13631488,"data_stored":13631488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":19972096,"data_stored":19971366,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":37421056,"data_stored":37419505,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":32505856,"data_stored":32505856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":14680064,"data_stored":14680064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":26988544,"data_stored":26985383,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":19927040,"data_stored":19926160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":13303808,"data_stored":13302257,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":27983872,"data_stored":27982321,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":17825792,"data_stored":17825792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":11538432,"data_stored":11537552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20975616,"data_stored":20974736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":23068672,"data_stored":23068672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":30457856,"data_stored":30457126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":34652160,"data_stored":34651430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-06-04T16:22:41.106 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-06-04T16:22:41.446 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:41.458 INFO:teuthology.orchestra.run.smithi144.stderr:dumped all 2024-06-04T16:22:41.463 INFO:teuthology.orchestra.run.smithi144.stdout:{"pg_ready":true,"pg_map":{"version":1157,"stamp":"2024-06-04T16:22:39.553288+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":318386363,"num_objects":622,"num_object_clones":0,"num_object_copies":1465,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":622,"num_whiteouts":0,"num_read":69712,"num_read_kb":1447162,"num_write":34353,"num_write_kb":1951187,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":99,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11725,"ondisk_log_size":11725,"up":850,"acting":850,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":850,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1644716,"kb_used_data":587436,"kb_used_omap":12,"kb_used_meta":1057203,"kb_avail":753330004,"statfs":{"total":773094113280,"available":771409924096,"internally_reserved":0,"allocated":601534464,"data_stored":586321450,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":1082576433},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-520,"num_objects":-4,"num_object_clones":0,"num_object_copies":-8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-4,"num_whiteouts":0,"num_read":18,"num_read_kb":20,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004862"},"pg_stats":[{"pgid":"67.1c","version":"0'0","reported_seq":14,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:40.004173+0000","last_change":"2024-06-04T16:16:08.658494+0000","last_active":"2024-06-04T16:18:40.004173+0000","last_peered":"2024-06-04T16:18:40.004173+0000","last_clean":"2024-06-04T16:18:40.004173+0000","last_became_active":"2024-06-04T16:16:08.658205+0000","last_became_peered":"2024-06-04T16:16:08.658205+0000","last_unstale":"2024-06-04T16:18:40.004173+0000","last_undegraded":"2024-06-04T16:18:40.004173+0000","last_fullsized":"2024-06-04T16:18:40.004173+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_clean_scrub_stamp":"2024-06-04T16:16:07.631263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T00:52:26.843651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1d","version":"251'2","reported_seq":27,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:30.016313+0000","last_change":"2024-06-04T16:09:26.627968+0000","last_active":"2024-06-04T16:19:30.016313+0000","last_peered":"2024-06-04T16:19:30.016313+0000","last_clean":"2024-06-04T16:19:30.016313+0000","last_became_active":"2024-06-04T16:09:26.627678+0000","last_became_peered":"2024-06-04T16:09:26.627678+0000","last_unstale":"2024-06-04T16:19:30.016313+0000","last_undegraded":"2024-06-04T16:19:30.016313+0000","last_fullsized":"2024-06-04T16:19:30.016313+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_clean_scrub_stamp":"2024-06-04T16:09:25.601105+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T01:24:09.747341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1e","version":"254'1","reported_seq":32,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:25.015222+0000","last_change":"2024-06-04T16:09:23.610282+0000","last_active":"2024-06-04T16:19:25.015222+0000","last_peered":"2024-06-04T16:19:25.015222+0000","last_clean":"2024-06-04T16:19:25.015222+0000","last_became_active":"2024-06-04T16:09:23.610020+0000","last_became_peered":"2024-06-04T16:09:23.610020+0000","last_unstale":"2024-06-04T16:19:25.015222+0000","last_undegraded":"2024-06-04T16:19:25.015222+0000","last_fullsized":"2024-06-04T16:19:25.015222+0000","mapping_epoch":246,"log_start":"0'0","ondisk_log_start":"0'0","created":246,"last_epoch_clean":247,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_clean_scrub_stamp":"2024-06-04T16:09:22.572686+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T20:33:48.503494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"64.1f","version":"251'21","reported_seq":94,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:40.017799+0000","last_change":"2024-06-04T16:07:09.402335+0000","last_active":"2024-06-04T16:19:40.017799+0000","last_peered":"2024-06-04T16:19:40.017799+0000","last_clean":"2024-06-04T16:19:40.017799+0000","last_became_active":"2024-06-04T16:07:09.402073+0000","last_became_peered":"2024-06-04T16:07:09.402073+0000","last_unstale":"2024-06-04T16:19:40.017799+0000","last_undegraded":"2024-06-04T16:19:40.017799+0000","last_fullsized":"2024-06-04T16:19:40.017799+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":243,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:07:08.374534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:07:08.374534+0000","last_clean_scrub_stamp":"2024-06-04T16:07:08.374534+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T00:13:07.984077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":108,"num_read_kb":75,"num_write":41,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1d","version":"0'0","reported_seq":14,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:40.113877+0000","last_change":"2024-06-04T16:16:08.656686+0000","last_active":"2024-06-04T16:18:40.113877+0000","last_peered":"2024-06-04T16:18:40.113877+0000","last_clean":"2024-06-04T16:18:40.113877+0000","last_became_active":"2024-06-04T16:16:08.656388+0000","last_became_peered":"2024-06-04T16:16:08.656388+0000","last_unstale":"2024-06-04T16:18:40.113877+0000","last_undegraded":"2024-06-04T16:18:40.113877+0000","last_fullsized":"2024-06-04T16:18:40.113877+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_clean_scrub_stamp":"2024-06-04T16:16:07.631263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T18:52:52.325700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.1c","version":"254'1","reported_seq":25,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:30.128582+0000","last_change":"2024-06-04T16:09:26.627239+0000","last_active":"2024-06-04T16:19:30.128582+0000","last_peered":"2024-06-04T16:19:30.128582+0000","last_clean":"2024-06-04T16:19:30.128582+0000","last_became_active":"2024-06-04T16:09:26.626964+0000","last_became_peered":"2024-06-04T16:09:26.626964+0000","last_unstale":"2024-06-04T16:19:30.128582+0000","last_undegraded":"2024-06-04T16:19:30.128582+0000","last_fullsized":"2024-06-04T16:19:30.128582+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_clean_scrub_stamp":"2024-06-04T16:09:25.601105+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T22:22:45.616852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":3072,"num_write":1,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1f","version":"254'3","reported_seq":36,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:50.018652+0000","last_change":"2024-06-04T16:09:23.608520+0000","last_active":"2024-06-04T16:19:50.018652+0000","last_peered":"2024-06-04T16:19:50.018652+0000","last_clean":"2024-06-04T16:19:50.018652+0000","last_became_active":"2024-06-04T16:09:23.608251+0000","last_became_peered":"2024-06-04T16:09:23.608251+0000","last_unstale":"2024-06-04T16:19:50.018652+0000","last_undegraded":"2024-06-04T16:19:50.018652+0000","last_fullsized":"2024-06-04T16:19:50.018652+0000","mapping_epoch":246,"log_start":"0'0","ondisk_log_start":"0'0","created":246,"last_epoch_clean":247,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_clean_scrub_stamp":"2024-06-04T16:09:22.572686+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T01:41:52.047423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":8192,"num_write":3,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"64.1e","version":"251'15","reported_seq":79,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:10.125894+0000","last_change":"2024-06-04T16:07:09.511589+0000","last_active":"2024-06-04T16:19:10.125894+0000","last_peered":"2024-06-04T16:19:10.125894+0000","last_clean":"2024-06-04T16:19:10.125894+0000","last_became_active":"2024-06-04T16:07:09.511253+0000","last_became_peered":"2024-06-04T16:07:09.511253+0000","last_unstale":"2024-06-04T16:19:10.125894+0000","last_undegraded":"2024-06-04T16:19:10.125894+0000","last_fullsized":"2024-06-04T16:19:10.125894+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":243,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:07:08.374534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:07:08.374534+0000","last_clean_scrub_stamp":"2024-06-04T16:07:08.374534+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T02:12:46.993038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":58,"num_write":26,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1e","version":"0'0","reported_seq":15,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:20:10.022107+0000","last_change":"2024-06-04T16:16:08.660980+0000","last_active":"2024-06-04T16:20:10.022107+0000","last_peered":"2024-06-04T16:20:10.022107+0000","last_clean":"2024-06-04T16:20:10.022107+0000","last_became_active":"2024-06-04T16:16:08.660635+0000","last_became_peered":"2024-06-04T16:16:08.660635+0000","last_unstale":"2024-06-04T16:20:10.022107+0000","last_undegraded":"2024-06-04T16:20:10.022107+0000","last_fullsized":"2024-06-04T16:20:10.022107+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_clean_scrub_stamp":"2024-06-04T16:16:07.631263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T01:54:33.642831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1f","version":"0'0","reported_seq":24,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:55.121976+0000","last_change":"2024-06-04T16:09:26.624893+0000","last_active":"2024-06-04T16:19:55.121976+0000","last_peered":"2024-06-04T16:19:55.121976+0000","last_clean":"2024-06-04T16:19:55.121976+0000","last_became_active":"2024-06-04T16:09:26.624510+0000","last_became_peered":"2024-06-04T16:09:26.624510+0000","last_unstale":"2024-06-04T16:19:55.121976+0000","last_undegraded":"2024-06-04T16:19:55.121976+0000","last_fullsized":"2024-06-04T16:19:55.121976+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_clean_scrub_stamp":"2024-06-04T16:09:25.601105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T00:28:18.386660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1c","version":"0'0","reported_seq":29,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:25.014688+0000","last_change":"2024-06-04T16:09:23.612578+0000","last_active":"2024-06-04T16:19:25.014688+0000","last_peered":"2024-06-04T16:19:25.014688+0000","last_clean":"2024-06-04T16:19:25.014688+0000","last_became_active":"2024-06-04T16:09:23.612278+0000","last_became_peered":"2024-06-04T16:09:23.612278+0000","last_unstale":"2024-06-04T16:19:25.014688+0000","last_undegraded":"2024-06-04T16:19:25.014688+0000","last_fullsized":"2024-06-04T16:19:25.014688+0000","mapping_epoch":246,"log_start":"0'0","ondisk_log_start":"0'0","created":246,"last_epoch_clean":247,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_clean_scrub_stamp":"2024-06-04T16:09:22.572686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T04:01:33.465233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"64.1d","version":"251'28","reported_seq":114,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:40.120403+0000","last_change":"2024-06-04T16:07:09.511447+0000","last_active":"2024-06-04T16:19:40.120403+0000","last_peered":"2024-06-04T16:19:40.120403+0000","last_clean":"2024-06-04T16:19:40.120403+0000","last_became_active":"2024-06-04T16:07:09.511154+0000","last_became_peered":"2024-06-04T16:07:09.511154+0000","last_unstale":"2024-06-04T16:19:40.120403+0000","last_undegraded":"2024-06-04T16:19:40.120403+0000","last_fullsized":"2024-06-04T16:19:40.120403+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":243,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:07:08.374534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:07:08.374534+0000","last_clean_scrub_stamp":"2024-06-04T16:07:08.374534+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T03:39:17.866776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":150,"num_read_kb":106,"num_write":50,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.1f","version":"0'0","reported_seq":15,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:20:20.023704+0000","last_change":"2024-06-04T16:16:08.661162+0000","last_active":"2024-06-04T16:20:20.023704+0000","last_peered":"2024-06-04T16:20:20.023704+0000","last_clean":"2024-06-04T16:20:20.023704+0000","last_became_active":"2024-06-04T16:16:08.660669+0000","last_became_peered":"2024-06-04T16:16:08.660669+0000","last_unstale":"2024-06-04T16:20:20.023704+0000","last_undegraded":"2024-06-04T16:20:20.023704+0000","last_fullsized":"2024-06-04T16:20:20.023704+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_clean_scrub_stamp":"2024-06-04T16:16:07.631263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T16:45:04.637111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1e","version":"254'1","reported_seq":26,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:30.128637+0000","last_change":"2024-06-04T16:09:26.622613+0000","last_active":"2024-06-04T16:19:30.128637+0000","last_peered":"2024-06-04T16:19:30.128637+0000","last_clean":"2024-06-04T16:19:30.128637+0000","last_became_active":"2024-06-04T16:09:26.621326+0000","last_became_peered":"2024-06-04T16:09:26.621326+0000","last_unstale":"2024-06-04T16:19:30.128637+0000","last_undegraded":"2024-06-04T16:19:30.128637+0000","last_fullsized":"2024-06-04T16:19:30.128637+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_clean_scrub_stamp":"2024-06-04T16:09:25.601105+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T01:20:44.676294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1d","version":"254'4","reported_seq":36,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:25.014713+0000","last_change":"2024-06-04T16:09:23.607186+0000","last_active":"2024-06-04T16:19:25.014713+0000","last_peered":"2024-06-04T16:19:25.014713+0000","last_clean":"2024-06-04T16:19:25.014713+0000","last_became_active":"2024-06-04T16:09:23.606918+0000","last_became_peered":"2024-06-04T16:09:23.606918+0000","last_unstale":"2024-06-04T16:19:25.014713+0000","last_undegraded":"2024-06-04T16:19:25.014713+0000","last_fullsized":"2024-06-04T16:19:25.014713+0000","mapping_epoch":246,"log_start":"0'0","ondisk_log_start":"0'0","created":246,"last_epoch_clean":247,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_clean_scrub_stamp":"2024-06-04T16:09:22.572686+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T17:11:19.839027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48422,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4144,"num_write":9,"num_write_kb":4144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"64.1c","version":"251'37","reported_seq":142,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:40.017695+0000","last_change":"2024-06-04T16:07:09.509991+0000","last_active":"2024-06-04T16:19:40.017695+0000","last_peered":"2024-06-04T16:19:40.017695+0000","last_clean":"2024-06-04T16:19:40.017695+0000","last_became_active":"2024-06-04T16:07:09.509671+0000","last_became_peered":"2024-06-04T16:07:09.509671+0000","last_unstale":"2024-06-04T16:19:40.017695+0000","last_undegraded":"2024-06-04T16:19:40.017695+0000","last_fullsized":"2024-06-04T16:19:40.017695+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":243,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:07:08.374534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:07:08.374534+0000","last_clean_scrub_stamp":"2024-06-04T16:07:08.374534+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T18:48:21.024789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":197,"num_read_kb":141,"num_write":70,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.18","version":"0'0","reported_seq":14,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:35.007117+0000","last_change":"2024-06-04T16:16:08.664509+0000","last_active":"2024-06-04T16:18:35.007117+0000","last_peered":"2024-06-04T16:18:35.007117+0000","last_clean":"2024-06-04T16:18:35.007117+0000","last_became_active":"2024-06-04T16:16:08.664252+0000","last_became_peered":"2024-06-04T16:16:08.664252+0000","last_unstale":"2024-06-04T16:18:35.007117+0000","last_undegraded":"2024-06-04T16:18:35.007117+0000","last_fullsized":"2024-06-04T16:18:35.007117+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_clean_scrub_stamp":"2024-06-04T16:16:07.631263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T01:56:56.151412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.19","version":"254'6","reported_seq":34,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:15.011678+0000","last_change":"2024-06-04T16:09:26.625104+0000","last_active":"2024-06-04T16:19:15.011678+0000","last_peered":"2024-06-04T16:19:15.011678+0000","last_clean":"2024-06-04T16:19:15.011678+0000","last_became_active":"2024-06-04T16:09:26.624681+0000","last_became_peered":"2024-06-04T16:09:26.624681+0000","last_unstale":"2024-06-04T16:19:15.011678+0000","last_undegraded":"2024-06-04T16:19:15.011678+0000","last_fullsized":"2024-06-04T16:19:15.011678+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_clean_scrub_stamp":"2024-06-04T16:09:25.601105+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T16:38:40.132989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7,"num_read_kb":9216,"num_write":11,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1a","version":"251'3","reported_seq":34,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:25.008703+0000","last_change":"2024-06-04T16:09:23.609384+0000","last_active":"2024-06-04T16:19:25.008703+0000","last_peered":"2024-06-04T16:19:25.008703+0000","last_clean":"2024-06-04T16:19:25.008703+0000","last_became_active":"2024-06-04T16:09:23.609102+0000","last_became_peered":"2024-06-04T16:09:23.609102+0000","last_unstale":"2024-06-04T16:19:25.008703+0000","last_undegraded":"2024-06-04T16:19:25.008703+0000","last_fullsized":"2024-06-04T16:19:25.008703+0000","mapping_epoch":246,"log_start":"0'0","ondisk_log_start":"0'0","created":246,"last_epoch_clean":247,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_clean_scrub_stamp":"2024-06-04T16:09:22.572686+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T19:32:58.624496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"64.1b","version":"251'96","reported_seq":333,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:40.017150+0000","last_change":"2024-06-04T16:07:09.404530+0000","last_active":"2024-06-04T16:19:40.017150+0000","last_peered":"2024-06-04T16:19:40.017150+0000","last_clean":"2024-06-04T16:19:40.017150+0000","last_became_active":"2024-06-04T16:07:09.404202+0000","last_became_peered":"2024-06-04T16:07:09.404202+0000","last_unstale":"2024-06-04T16:19:40.017150+0000","last_undegraded":"2024-06-04T16:19:40.017150+0000","last_fullsized":"2024-06-04T16:19:40.017150+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":243,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:07:08.374534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:07:08.374534+0000","last_clean_scrub_stamp":"2024-06-04T16:07:08.374534+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T20:38:56.584375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":591,"num_read_kb":533,"num_write":104,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.19","version":"0'0","reported_seq":14,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:35.003192+0000","last_change":"2024-06-04T16:16:08.659135+0000","last_active":"2024-06-04T16:18:35.003192+0000","last_peered":"2024-06-04T16:18:35.003192+0000","last_clean":"2024-06-04T16:18:35.003192+0000","last_became_active":"2024-06-04T16:16:08.658696+0000","last_became_peered":"2024-06-04T16:16:08.658696+0000","last_unstale":"2024-06-04T16:18:35.003192+0000","last_undegraded":"2024-06-04T16:18:35.003192+0000","last_fullsized":"2024-06-04T16:18:35.003192+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_clean_scrub_stamp":"2024-06-04T16:16:07.631263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T04:10:28.111016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.18","version":"254'6","reported_seq":33,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:10.013706+0000","last_change":"2024-06-04T16:09:26.624594+0000","last_active":"2024-06-04T16:19:10.013706+0000","last_peered":"2024-06-04T16:19:10.013706+0000","last_clean":"2024-06-04T16:19:10.013706+0000","last_became_active":"2024-06-04T16:09:26.624322+0000","last_became_peered":"2024-06-04T16:09:26.624322+0000","last_unstale":"2024-06-04T16:19:10.013706+0000","last_undegraded":"2024-06-04T16:19:10.013706+0000","last_fullsized":"2024-06-04T16:19:10.013706+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_clean_scrub_stamp":"2024-06-04T16:09:25.601105+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T03:22:38.550890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":8192,"num_write":11,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1b","version":"254'11","reported_seq":58,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:25.014649+0000","last_change":"2024-06-04T16:09:23.613387+0000","last_active":"2024-06-04T16:19:25.014649+0000","last_peered":"2024-06-04T16:19:25.014649+0000","last_clean":"2024-06-04T16:19:25.014649+0000","last_became_active":"2024-06-04T16:09:23.613109+0000","last_became_peered":"2024-06-04T16:09:23.613109+0000","last_unstale":"2024-06-04T16:19:25.014649+0000","last_undegraded":"2024-06-04T16:19:25.014649+0000","last_fullsized":"2024-06-04T16:19:25.014649+0000","mapping_epoch":246,"log_start":"0'0","ondisk_log_start":"0'0","created":246,"last_epoch_clean":247,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_clean_scrub_stamp":"2024-06-04T16:09:22.572686+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T18:31:33.463795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7340032,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":24,"num_read_kb":29700,"num_write":14,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"64.1a","version":"251'15","reported_seq":75,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:40.120356+0000","last_change":"2024-06-04T16:07:09.407260+0000","last_active":"2024-06-04T16:19:40.120356+0000","last_peered":"2024-06-04T16:19:40.120356+0000","last_clean":"2024-06-04T16:19:40.120356+0000","last_became_active":"2024-06-04T16:07:09.406976+0000","last_became_peered":"2024-06-04T16:07:09.406976+0000","last_unstale":"2024-06-04T16:19:40.120356+0000","last_undegraded":"2024-06-04T16:19:40.120356+0000","last_fullsized":"2024-06-04T16:19:40.120356+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":243,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:07:08.374534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:07:08.374534+0000","last_clean_scrub_stamp":"2024-06-04T16:07:08.374534+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T22:44:48.654459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":52,"num_write":29,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.1a","version":"0'0","reported_seq":14,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:40.121419+0000","last_change":"2024-06-04T16:16:08.664491+0000","last_active":"2024-06-04T16:18:40.121419+0000","last_peered":"2024-06-04T16:18:40.121419+0000","last_clean":"2024-06-04T16:18:40.121419+0000","last_became_active":"2024-06-04T16:16:08.664200+0000","last_became_peered":"2024-06-04T16:16:08.664200+0000","last_unstale":"2024-06-04T16:18:40.121419+0000","last_undegraded":"2024-06-04T16:18:40.121419+0000","last_fullsized":"2024-06-04T16:18:40.121419+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_clean_scrub_stamp":"2024-06-04T16:16:07.631263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T01:16:08.795243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.1b","version":"254'2","reported_seq":27,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:30.015296+0000","last_change":"2024-06-04T16:09:26.626809+0000","last_active":"2024-06-04T16:19:30.015296+0000","last_peered":"2024-06-04T16:19:30.015296+0000","last_clean":"2024-06-04T16:19:30.015296+0000","last_became_active":"2024-06-04T16:09:26.626528+0000","last_became_peered":"2024-06-04T16:09:26.626528+0000","last_unstale":"2024-06-04T16:19:30.015296+0000","last_undegraded":"2024-06-04T16:19:30.015296+0000","last_fullsized":"2024-06-04T16:19:30.015296+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_clean_scrub_stamp":"2024-06-04T16:09:25.601105+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T03:55:00.731424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":7,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.18","version":"254'3","reported_seq":35,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:05.011849+0000","last_change":"2024-06-04T16:09:23.610295+0000","last_active":"2024-06-04T16:19:05.011849+0000","last_peered":"2024-06-04T16:19:05.011849+0000","last_clean":"2024-06-04T16:19:05.011849+0000","last_became_active":"2024-06-04T16:09:23.609952+0000","last_became_peered":"2024-06-04T16:09:23.609952+0000","last_unstale":"2024-06-04T16:19:05.011849+0000","last_undegraded":"2024-06-04T16:19:05.011849+0000","last_fullsized":"2024-06-04T16:19:05.011849+0000","mapping_epoch":246,"log_start":"0'0","ondisk_log_start":"0'0","created":246,"last_epoch_clean":247,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_clean_scrub_stamp":"2024-06-04T16:09:22.572686+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T20:30:38.429992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"64.19","version":"251'22","reported_seq":96,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:20.015056+0000","last_change":"2024-06-04T16:07:09.402552+0000","last_active":"2024-06-04T16:19:20.015056+0000","last_peered":"2024-06-04T16:19:20.015056+0000","last_clean":"2024-06-04T16:19:20.015056+0000","last_became_active":"2024-06-04T16:07:09.402316+0000","last_became_peered":"2024-06-04T16:07:09.402316+0000","last_unstale":"2024-06-04T16:19:20.015056+0000","last_undegraded":"2024-06-04T16:19:20.015056+0000","last_fullsized":"2024-06-04T16:19:20.015056+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":243,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:07:08.374534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:07:08.374534+0000","last_clean_scrub_stamp":"2024-06-04T16:07:08.374534+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T21:44:10.282159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":114,"num_read_kb":79,"num_write":44,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1b","version":"0'0","reported_seq":14,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:40.004153+0000","last_change":"2024-06-04T16:16:08.654196+0000","last_active":"2024-06-04T16:18:40.004153+0000","last_peered":"2024-06-04T16:18:40.004153+0000","last_clean":"2024-06-04T16:18:40.004153+0000","last_became_active":"2024-06-04T16:16:08.653931+0000","last_became_peered":"2024-06-04T16:16:08.653931+0000","last_unstale":"2024-06-04T16:18:40.004153+0000","last_undegraded":"2024-06-04T16:18:40.004153+0000","last_fullsized":"2024-06-04T16:18:40.004153+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_clean_scrub_stamp":"2024-06-04T16:16:07.631263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T18:57:31.093469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1a","version":"254'7","reported_seq":39,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:30.008616+0000","last_change":"2024-06-04T16:09:26.623784+0000","last_active":"2024-06-04T16:19:30.008616+0000","last_peered":"2024-06-04T16:19:30.008616+0000","last_clean":"2024-06-04T16:19:30.008616+0000","last_became_active":"2024-06-04T16:09:26.623459+0000","last_became_peered":"2024-06-04T16:09:26.623459+0000","last_unstale":"2024-06-04T16:19:30.008616+0000","last_undegraded":"2024-06-04T16:19:30.008616+0000","last_fullsized":"2024-06-04T16:19:30.008616+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_clean_scrub_stamp":"2024-06-04T16:09:25.601105+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T00:27:16.479995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2097152,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":13,"num_read_kb":9218,"num_write":6,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.19","version":"254'5","reported_seq":41,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:05.124976+0000","last_change":"2024-06-04T16:09:23.607280+0000","last_active":"2024-06-04T16:19:05.124976+0000","last_peered":"2024-06-04T16:19:05.124976+0000","last_clean":"2024-06-04T16:19:05.124976+0000","last_became_active":"2024-06-04T16:09:23.606966+0000","last_became_peered":"2024-06-04T16:09:23.606966+0000","last_unstale":"2024-06-04T16:19:05.124976+0000","last_undegraded":"2024-06-04T16:19:05.124976+0000","last_fullsized":"2024-06-04T16:19:05.124976+0000","mapping_epoch":246,"log_start":"0'0","ondisk_log_start":"0'0","created":246,"last_epoch_clean":247,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_clean_scrub_stamp":"2024-06-04T16:09:22.572686+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T00:52:40.922210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":10,"num_read_kb":8194,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"64.18","version":"251'39","reported_seq":144,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:15.117833+0000","last_change":"2024-06-04T16:07:09.404324+0000","last_active":"2024-06-04T16:19:15.117833+0000","last_peered":"2024-06-04T16:19:15.117833+0000","last_clean":"2024-06-04T16:19:15.117833+0000","last_became_active":"2024-06-04T16:07:09.404055+0000","last_became_peered":"2024-06-04T16:07:09.404055+0000","last_unstale":"2024-06-04T16:19:15.117833+0000","last_undegraded":"2024-06-04T16:19:15.117833+0000","last_fullsized":"2024-06-04T16:19:15.117833+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":243,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:07:08.374534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:07:08.374534+0000","last_clean_scrub_stamp":"2024-06-04T16:07:08.374534+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T02:35:29.659798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":206,"num_read_kb":146,"num_write":71,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.14","version":"253'1","reported_seq":15,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:30.008340+0000","last_change":"2024-06-04T16:16:08.662285+0000","last_active":"2024-06-04T16:18:30.008340+0000","last_peered":"2024-06-04T16:18:30.008340+0000","last_clean":"2024-06-04T16:18:30.008340+0000","last_became_active":"2024-06-04T16:16:08.661995+0000","last_became_peered":"2024-06-04T16:16:08.661995+0000","last_unstale":"2024-06-04T16:18:30.008340+0000","last_undegraded":"2024-06-04T16:18:30.008340+0000","last_fullsized":"2024-06-04T16:18:30.008340+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_clean_scrub_stamp":"2024-06-04T16:16:07.631263+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T04:00:42.209306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.15","version":"254'3","reported_seq":28,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:10.006683+0000","last_change":"2024-06-04T16:09:26.623775+0000","last_active":"2024-06-04T16:19:10.006683+0000","last_peered":"2024-06-04T16:19:10.006683+0000","last_clean":"2024-06-04T16:19:10.006683+0000","last_became_active":"2024-06-04T16:09:26.623442+0000","last_became_peered":"2024-06-04T16:09:26.623442+0000","last_unstale":"2024-06-04T16:19:10.006683+0000","last_undegraded":"2024-06-04T16:19:10.006683+0000","last_fullsized":"2024-06-04T16:19:10.006683+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_clean_scrub_stamp":"2024-06-04T16:09:25.601105+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T00:42:02.876938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4913649,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":1406,"num_write":8,"num_write_kb":4799,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.16","version":"251'2","reported_seq":33,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:05.012569+0000","last_change":"2024-06-04T16:09:23.609558+0000","last_active":"2024-06-04T16:19:05.012569+0000","last_peered":"2024-06-04T16:19:05.012569+0000","last_clean":"2024-06-04T16:19:05.012569+0000","last_became_active":"2024-06-04T16:09:23.609180+0000","last_became_peered":"2024-06-04T16:09:23.609180+0000","last_unstale":"2024-06-04T16:19:05.012569+0000","last_undegraded":"2024-06-04T16:19:05.012569+0000","last_fullsized":"2024-06-04T16:19:05.012569+0000","mapping_epoch":246,"log_start":"0'0","ondisk_log_start":"0'0","created":246,"last_epoch_clean":247,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_clean_scrub_stamp":"2024-06-04T16:09:22.572686+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T17:27:35.142187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":45,"num_write":2,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"64.17","version":"0'0","reported_seq":36,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:15.011780+0000","last_change":"2024-06-04T16:07:09.512132+0000","last_active":"2024-06-04T16:19:15.011780+0000","last_peered":"2024-06-04T16:19:15.011780+0000","last_clean":"2024-06-04T16:19:15.011780+0000","last_became_active":"2024-06-04T16:07:09.511806+0000","last_became_peered":"2024-06-04T16:07:09.511806+0000","last_unstale":"2024-06-04T16:19:15.011780+0000","last_undegraded":"2024-06-04T16:19:15.011780+0000","last_fullsized":"2024-06-04T16:19:15.011780+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":243,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:07:08.374534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:07:08.374534+0000","last_clean_scrub_stamp":"2024-06-04T16:07:08.374534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T21:23:49.362770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.15","version":"0'0","reported_seq":14,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:35.120607+0000","last_change":"2024-06-04T16:16:08.664995+0000","last_active":"2024-06-04T16:18:35.120607+0000","last_peered":"2024-06-04T16:18:35.120607+0000","last_clean":"2024-06-04T16:18:35.120607+0000","last_became_active":"2024-06-04T16:16:08.664680+0000","last_became_peered":"2024-06-04T16:16:08.664680+0000","last_unstale":"2024-06-04T16:18:35.120607+0000","last_undegraded":"2024-06-04T16:18:35.120607+0000","last_fullsized":"2024-06-04T16:18:35.120607+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_clean_scrub_stamp":"2024-06-04T16:16:07.631263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T19:24:50.177579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.14","version":"254'2","reported_seq":25,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:55.009567+0000","last_change":"2024-06-04T16:09:26.624246+0000","last_active":"2024-06-04T16:18:55.009567+0000","last_peered":"2024-06-04T16:18:55.009567+0000","last_clean":"2024-06-04T16:18:55.009567+0000","last_became_active":"2024-06-04T16:09:26.623991+0000","last_became_peered":"2024-06-04T16:09:26.623991+0000","last_unstale":"2024-06-04T16:18:55.009567+0000","last_undegraded":"2024-06-04T16:18:55.009567+0000","last_fullsized":"2024-06-04T16:18:55.009567+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_clean_scrub_stamp":"2024-06-04T16:09:25.601105+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T21:29:18.235375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.17","version":"254'1","reported_seq":31,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:05.012597+0000","last_change":"2024-06-04T16:09:23.595639+0000","last_active":"2024-06-04T16:19:05.012597+0000","last_peered":"2024-06-04T16:19:05.012597+0000","last_clean":"2024-06-04T16:19:05.012597+0000","last_became_active":"2024-06-04T16:09:23.595355+0000","last_became_peered":"2024-06-04T16:09:23.595355+0000","last_unstale":"2024-06-04T16:19:05.012597+0000","last_undegraded":"2024-06-04T16:19:05.012597+0000","last_fullsized":"2024-06-04T16:19:05.012597+0000","mapping_epoch":246,"log_start":"0'0","ondisk_log_start":"0'0","created":246,"last_epoch_clean":247,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_clean_scrub_stamp":"2024-06-04T16:09:22.572686+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T19:14:50.608068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"64.16","version":"251'16","reported_seq":80,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:15.126620+0000","last_change":"2024-06-04T16:07:09.405399+0000","last_active":"2024-06-04T16:19:15.126620+0000","last_peered":"2024-06-04T16:19:15.126620+0000","last_clean":"2024-06-04T16:19:15.126620+0000","last_became_active":"2024-06-04T16:07:09.405088+0000","last_became_peered":"2024-06-04T16:07:09.405088+0000","last_unstale":"2024-06-04T16:19:15.126620+0000","last_undegraded":"2024-06-04T16:19:15.126620+0000","last_fullsized":"2024-06-04T16:19:15.126620+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":243,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:07:08.374534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:07:08.374534+0000","last_clean_scrub_stamp":"2024-06-04T16:07:08.374534+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T21:34:43.810719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":63,"num_write":30,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.16","version":"0'0","reported_seq":14,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:35.003270+0000","last_change":"2024-06-04T16:16:08.656459+0000","last_active":"2024-06-04T16:18:35.003270+0000","last_peered":"2024-06-04T16:18:35.003270+0000","last_clean":"2024-06-04T16:18:35.003270+0000","last_became_active":"2024-06-04T16:16:08.655571+0000","last_became_peered":"2024-06-04T16:16:08.655571+0000","last_unstale":"2024-06-04T16:18:35.003270+0000","last_undegraded":"2024-06-04T16:18:35.003270+0000","last_fullsized":"2024-06-04T16:18:35.003270+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_clean_scrub_stamp":"2024-06-04T16:16:07.631263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T16:18:55.793739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.17","version":"0'0","reported_seq":23,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:10.013842+0000","last_change":"2024-06-04T16:09:26.626934+0000","last_active":"2024-06-04T16:19:10.013842+0000","last_peered":"2024-06-04T16:19:10.013842+0000","last_clean":"2024-06-04T16:19:10.013842+0000","last_became_active":"2024-06-04T16:09:26.626605+0000","last_became_peered":"2024-06-04T16:09:26.626605+0000","last_unstale":"2024-06-04T16:19:10.013842+0000","last_undegraded":"2024-06-04T16:19:10.013842+0000","last_fullsized":"2024-06-04T16:19:10.013842+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_clean_scrub_stamp":"2024-06-04T16:09:25.601105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T00:15:31.709245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.14","version":"254'1","reported_seq":31,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:50.009019+0000","last_change":"2024-06-04T16:09:23.608188+0000","last_active":"2024-06-04T16:18:50.009019+0000","last_peered":"2024-06-04T16:18:50.009019+0000","last_clean":"2024-06-04T16:18:50.009019+0000","last_became_active":"2024-06-04T16:09:23.607906+0000","last_became_peered":"2024-06-04T16:09:23.607906+0000","last_unstale":"2024-06-04T16:18:50.009019+0000","last_undegraded":"2024-06-04T16:18:50.009019+0000","last_fullsized":"2024-06-04T16:18:50.009019+0000","mapping_epoch":246,"log_start":"0'0","ondisk_log_start":"0'0","created":246,"last_epoch_clean":247,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_clean_scrub_stamp":"2024-06-04T16:09:22.572686+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T17:08:32.670089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"64.15","version":"0'0","reported_seq":36,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:15.014464+0000","last_change":"2024-06-04T16:07:09.401959+0000","last_active":"2024-06-04T16:19:15.014464+0000","last_peered":"2024-06-04T16:19:15.014464+0000","last_clean":"2024-06-04T16:19:15.014464+0000","last_became_active":"2024-06-04T16:07:09.401608+0000","last_became_peered":"2024-06-04T16:07:09.401608+0000","last_unstale":"2024-06-04T16:19:15.014464+0000","last_undegraded":"2024-06-04T16:19:15.014464+0000","last_fullsized":"2024-06-04T16:19:15.014464+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":243,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:07:08.374534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:07:08.374534+0000","last_clean_scrub_stamp":"2024-06-04T16:07:08.374534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T23:24:21.547866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.17","version":"0'0","reported_seq":14,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:35.120672+0000","last_change":"2024-06-04T16:16:08.657806+0000","last_active":"2024-06-04T16:18:35.120672+0000","last_peered":"2024-06-04T16:18:35.120672+0000","last_clean":"2024-06-04T16:18:35.120672+0000","last_became_active":"2024-06-04T16:16:08.657535+0000","last_became_peered":"2024-06-04T16:16:08.657535+0000","last_unstale":"2024-06-04T16:18:35.120672+0000","last_undegraded":"2024-06-04T16:18:35.120672+0000","last_fullsized":"2024-06-04T16:18:35.120672+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_clean_scrub_stamp":"2024-06-04T16:16:07.631263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T02:31:34.399203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.16","version":"254'10","reported_seq":45,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:10.125878+0000","last_change":"2024-06-04T16:09:26.628516+0000","last_active":"2024-06-04T16:19:10.125878+0000","last_peered":"2024-06-04T16:19:10.125878+0000","last_clean":"2024-06-04T16:19:10.125878+0000","last_became_active":"2024-06-04T16:09:26.628237+0000","last_became_peered":"2024-06-04T16:09:26.628237+0000","last_unstale":"2024-06-04T16:19:10.125878+0000","last_undegraded":"2024-06-04T16:19:10.125878+0000","last_fullsized":"2024-06-04T16:19:10.125878+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_clean_scrub_stamp":"2024-06-04T16:09:25.601105+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T22:06:09.423503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5291302,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":17,"num_read_kb":9311,"num_write":9,"num_write_kb":6237,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.15","version":"0'0","reported_seq":29,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:05.125028+0000","last_change":"2024-06-04T16:09:23.609111+0000","last_active":"2024-06-04T16:19:05.125028+0000","last_peered":"2024-06-04T16:19:05.125028+0000","last_clean":"2024-06-04T16:19:05.125028+0000","last_became_active":"2024-06-04T16:09:23.608801+0000","last_became_peered":"2024-06-04T16:09:23.608801+0000","last_unstale":"2024-06-04T16:19:05.125028+0000","last_undegraded":"2024-06-04T16:19:05.125028+0000","last_fullsized":"2024-06-04T16:19:05.125028+0000","mapping_epoch":246,"log_start":"0'0","ondisk_log_start":"0'0","created":246,"last_epoch_clean":247,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_clean_scrub_stamp":"2024-06-04T16:09:22.572686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T17:09:00.310675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"64.14","version":"251'30","reported_seq":117,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:55.011246+0000","last_change":"2024-06-04T16:07:09.404259+0000","last_active":"2024-06-04T16:18:55.011246+0000","last_peered":"2024-06-04T16:18:55.011246+0000","last_clean":"2024-06-04T16:18:55.011246+0000","last_became_active":"2024-06-04T16:07:09.403925+0000","last_became_peered":"2024-06-04T16:07:09.403925+0000","last_unstale":"2024-06-04T16:18:55.011246+0000","last_undegraded":"2024-06-04T16:18:55.011246+0000","last_fullsized":"2024-06-04T16:18:55.011246+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":243,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:07:08.374534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:07:08.374534+0000","last_clean_scrub_stamp":"2024-06-04T16:07:08.374534+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T23:42:39.058269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":154,"num_read_kb":107,"num_write":60,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.10","version":"0'0","reported_seq":14,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:30.008209+0000","last_change":"2024-06-04T16:16:08.656330+0000","last_active":"2024-06-04T16:18:30.008209+0000","last_peered":"2024-06-04T16:18:30.008209+0000","last_clean":"2024-06-04T16:18:30.008209+0000","last_became_active":"2024-06-04T16:16:08.656048+0000","last_became_peered":"2024-06-04T16:16:08.656048+0000","last_unstale":"2024-06-04T16:18:30.008209+0000","last_undegraded":"2024-06-04T16:18:30.008209+0000","last_fullsized":"2024-06-04T16:18:30.008209+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_clean_scrub_stamp":"2024-06-04T16:16:07.631263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T21:21:52.265223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.11","version":"251'8","reported_seq":39,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:50.011048+0000","last_change":"2024-06-04T16:09:26.626519+0000","last_active":"2024-06-04T16:18:50.011048+0000","last_peered":"2024-06-04T16:18:50.011048+0000","last_clean":"2024-06-04T16:18:50.011048+0000","last_became_active":"2024-06-04T16:09:26.624122+0000","last_became_peered":"2024-06-04T16:09:26.624122+0000","last_unstale":"2024-06-04T16:18:50.011048+0000","last_undegraded":"2024-06-04T16:18:50.011048+0000","last_fullsized":"2024-06-04T16:18:50.011048+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_clean_scrub_stamp":"2024-06-04T16:09:25.601105+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T21:22:14.386034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":17410,"num_write":17,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.12","version":"254'2","reported_seq":32,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:45.122305+0000","last_change":"2024-06-04T16:09:23.613003+0000","last_active":"2024-06-04T16:18:45.122305+0000","last_peered":"2024-06-04T16:18:45.122305+0000","last_clean":"2024-06-04T16:18:45.122305+0000","last_became_active":"2024-06-04T16:09:23.612699+0000","last_became_peered":"2024-06-04T16:09:23.612699+0000","last_unstale":"2024-06-04T16:18:45.122305+0000","last_undegraded":"2024-06-04T16:18:45.122305+0000","last_fullsized":"2024-06-04T16:18:45.122305+0000","mapping_epoch":246,"log_start":"0'0","ondisk_log_start":"0'0","created":246,"last_epoch_clean":247,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_clean_scrub_stamp":"2024-06-04T16:09:22.572686+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T22:44:45.643881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1051792,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":4,"num_write":2,"num_write_kb":1028,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"64.13","version":"254'35","reported_seq":138,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:50.010572+0000","last_change":"2024-06-04T16:07:09.511921+0000","last_active":"2024-06-04T16:18:50.010572+0000","last_peered":"2024-06-04T16:18:50.010572+0000","last_clean":"2024-06-04T16:18:50.010572+0000","last_became_active":"2024-06-04T16:07:09.511607+0000","last_became_peered":"2024-06-04T16:07:09.511607+0000","last_unstale":"2024-06-04T16:18:50.010572+0000","last_undegraded":"2024-06-04T16:18:50.010572+0000","last_fullsized":"2024-06-04T16:18:50.010572+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":243,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:07:08.374534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:07:08.374534+0000","last_clean_scrub_stamp":"2024-06-04T16:07:08.374534+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T21:14:21.163538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":198,"num_read_kb":144,"num_write":54,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.11","version":"0'0","reported_seq":14,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:30.008255+0000","last_change":"2024-06-04T16:16:08.649192+0000","last_active":"2024-06-04T16:18:30.008255+0000","last_peered":"2024-06-04T16:18:30.008255+0000","last_clean":"2024-06-04T16:18:30.008255+0000","last_became_active":"2024-06-04T16:16:08.648899+0000","last_became_peered":"2024-06-04T16:16:08.648899+0000","last_unstale":"2024-06-04T16:18:30.008255+0000","last_undegraded":"2024-06-04T16:18:30.008255+0000","last_fullsized":"2024-06-04T16:18:30.008255+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_clean_scrub_stamp":"2024-06-04T16:16:07.631263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T23:23:27.649414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.10","version":"254'1","reported_seq":25,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:50.115100+0000","last_change":"2024-06-04T16:09:26.628742+0000","last_active":"2024-06-04T16:18:50.115100+0000","last_peered":"2024-06-04T16:18:50.115100+0000","last_clean":"2024-06-04T16:18:50.115100+0000","last_became_active":"2024-06-04T16:09:26.628442+0000","last_became_peered":"2024-06-04T16:09:26.628442+0000","last_unstale":"2024-06-04T16:18:50.115100+0000","last_undegraded":"2024-06-04T16:18:50.115100+0000","last_fullsized":"2024-06-04T16:18:50.115100+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_clean_scrub_stamp":"2024-06-04T16:09:25.601105+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T00:52:10.655737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.13","version":"254'1","reported_seq":31,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:45.008399+0000","last_change":"2024-06-04T16:09:23.609979+0000","last_active":"2024-06-04T16:18:45.008399+0000","last_peered":"2024-06-04T16:18:45.008399+0000","last_clean":"2024-06-04T16:18:45.008399+0000","last_became_active":"2024-06-04T16:09:23.609536+0000","last_became_peered":"2024-06-04T16:09:23.609536+0000","last_unstale":"2024-06-04T16:18:45.008399+0000","last_undegraded":"2024-06-04T16:18:45.008399+0000","last_fullsized":"2024-06-04T16:18:45.008399+0000","mapping_epoch":246,"log_start":"0'0","ondisk_log_start":"0'0","created":246,"last_epoch_clean":247,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_clean_scrub_stamp":"2024-06-04T16:09:22.572686+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T16:56:59.952240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"64.12","version":"254'6","reported_seq":54,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:50.008991+0000","last_change":"2024-06-04T16:07:09.403628+0000","last_active":"2024-06-04T16:18:50.008991+0000","last_peered":"2024-06-04T16:18:50.008991+0000","last_clean":"2024-06-04T16:18:50.008991+0000","last_became_active":"2024-06-04T16:07:09.403352+0000","last_became_peered":"2024-06-04T16:07:09.403352+0000","last_unstale":"2024-06-04T16:18:50.008991+0000","last_undegraded":"2024-06-04T16:18:50.008991+0000","last_fullsized":"2024-06-04T16:18:50.008991+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":243,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:07:08.374534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:07:08.374534+0000","last_clean_scrub_stamp":"2024-06-04T16:07:08.374534+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T21:48:39.709806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":24,"num_write":11,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.12","version":"0'0","reported_seq":14,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:30.006539+0000","last_change":"2024-06-04T16:16:08.654940+0000","last_active":"2024-06-04T16:18:30.006539+0000","last_peered":"2024-06-04T16:18:30.006539+0000","last_clean":"2024-06-04T16:18:30.006539+0000","last_became_active":"2024-06-04T16:16:08.654624+0000","last_became_peered":"2024-06-04T16:16:08.654624+0000","last_unstale":"2024-06-04T16:18:30.006539+0000","last_undegraded":"2024-06-04T16:18:30.006539+0000","last_fullsized":"2024-06-04T16:18:30.006539+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_clean_scrub_stamp":"2024-06-04T16:16:07.631263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T02:28:30.956243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.13","version":"254'11","reported_seq":48,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:50.115216+0000","last_change":"2024-06-04T16:09:26.621968+0000","last_active":"2024-06-04T16:18:50.115216+0000","last_peered":"2024-06-04T16:18:50.115216+0000","last_clean":"2024-06-04T16:18:50.115216+0000","last_became_active":"2024-06-04T16:09:26.621494+0000","last_became_peered":"2024-06-04T16:09:26.621494+0000","last_unstale":"2024-06-04T16:18:50.115216+0000","last_undegraded":"2024-06-04T16:18:50.115216+0000","last_fullsized":"2024-06-04T16:18:50.115216+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_clean_scrub_stamp":"2024-06-04T16:09:25.601105+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T21:28:40.451250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":20,"num_read_kb":22532,"num_write":19,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.10","version":"254'6","reported_seq":42,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:45.122253+0000","last_change":"2024-06-04T16:09:23.606894+0000","last_active":"2024-06-04T16:18:45.122253+0000","last_peered":"2024-06-04T16:18:45.122253+0000","last_clean":"2024-06-04T16:18:45.122253+0000","last_became_active":"2024-06-04T16:09:23.606050+0000","last_became_peered":"2024-06-04T16:09:23.606050+0000","last_unstale":"2024-06-04T16:18:45.122253+0000","last_undegraded":"2024-06-04T16:18:45.122253+0000","last_fullsized":"2024-06-04T16:18:45.122253+0000","mapping_epoch":246,"log_start":"0'0","ondisk_log_start":"0'0","created":246,"last_epoch_clean":247,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_clean_scrub_stamp":"2024-06-04T16:09:22.572686+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T19:53:24.462326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":10,"num_read_kb":20482,"num_write":10,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"64.11","version":"251'138","reported_seq":475,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:50.008957+0000","last_change":"2024-06-04T16:07:09.511375+0000","last_active":"2024-06-04T16:18:50.008957+0000","last_peered":"2024-06-04T16:18:50.008957+0000","last_clean":"2024-06-04T16:18:50.008957+0000","last_became_active":"2024-06-04T16:07:09.511098+0000","last_became_peered":"2024-06-04T16:07:09.511098+0000","last_unstale":"2024-06-04T16:18:50.008957+0000","last_undegraded":"2024-06-04T16:18:50.008957+0000","last_fullsized":"2024-06-04T16:18:50.008957+0000","mapping_epoch":243,"log_start":"251'100","ondisk_log_start":"251'100","created":243,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:07:08.374534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:07:08.374534+0000","last_clean_scrub_stamp":"2024-06-04T16:07:08.374534+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T17:37:17.042544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":871,"num_read_kb":642,"num_write":155,"num_write_kb":133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.13","version":"254'1","reported_seq":15,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:30.119909+0000","last_change":"2024-06-04T16:16:08.657706+0000","last_active":"2024-06-04T16:18:30.119909+0000","last_peered":"2024-06-04T16:18:30.119909+0000","last_clean":"2024-06-04T16:18:30.119909+0000","last_became_active":"2024-06-04T16:16:08.657428+0000","last_became_peered":"2024-06-04T16:16:08.657428+0000","last_unstale":"2024-06-04T16:18:30.119909+0000","last_undegraded":"2024-06-04T16:18:30.119909+0000","last_fullsized":"2024-06-04T16:18:30.119909+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_clean_scrub_stamp":"2024-06-04T16:16:07.631263+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T19:11:05.041077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.12","version":"254'5","reported_seq":36,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:50.115184+0000","last_change":"2024-06-04T16:09:26.623554+0000","last_active":"2024-06-04T16:18:50.115184+0000","last_peered":"2024-06-04T16:18:50.115184+0000","last_clean":"2024-06-04T16:18:50.115184+0000","last_became_active":"2024-06-04T16:09:26.623285+0000","last_became_peered":"2024-06-04T16:09:26.623285+0000","last_unstale":"2024-06-04T16:18:50.115184+0000","last_undegraded":"2024-06-04T16:18:50.115184+0000","last_fullsized":"2024-06-04T16:18:50.115184+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_clean_scrub_stamp":"2024-06-04T16:09:25.601105+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T22:52:24.224426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":18434,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.11","version":"254'1","reported_seq":32,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:45.004661+0000","last_change":"2024-06-04T16:09:23.607360+0000","last_active":"2024-06-04T16:18:45.004661+0000","last_peered":"2024-06-04T16:18:45.004661+0000","last_clean":"2024-06-04T16:18:45.004661+0000","last_became_active":"2024-06-04T16:09:23.607048+0000","last_became_peered":"2024-06-04T16:09:23.607048+0000","last_unstale":"2024-06-04T16:18:45.004661+0000","last_undegraded":"2024-06-04T16:18:45.004661+0000","last_fullsized":"2024-06-04T16:18:45.004661+0000","mapping_epoch":246,"log_start":"0'0","ondisk_log_start":"0'0","created":246,"last_epoch_clean":247,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_clean_scrub_stamp":"2024-06-04T16:09:22.572686+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T03:05:27.726738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"64.10","version":"251'6","reported_seq":54,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:50.122936+0000","last_change":"2024-06-04T16:07:09.401888+0000","last_active":"2024-06-04T16:18:50.122936+0000","last_peered":"2024-06-04T16:18:50.122936+0000","last_clean":"2024-06-04T16:18:50.122936+0000","last_became_active":"2024-06-04T16:07:09.401445+0000","last_became_peered":"2024-06-04T16:07:09.401445+0000","last_unstale":"2024-06-04T16:18:50.122936+0000","last_undegraded":"2024-06-04T16:18:50.122936+0000","last_fullsized":"2024-06-04T16:18:50.122936+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":243,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:07:08.374534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:07:08.374534+0000","last_clean_scrub_stamp":"2024-06-04T16:07:08.374534+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T02:48:14.306445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":24,"num_write":11,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.c","version":"254'1","reported_seq":15,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:25.119153+0000","last_change":"2024-06-04T16:16:08.664755+0000","last_active":"2024-06-04T16:18:25.119153+0000","last_peered":"2024-06-04T16:18:25.119153+0000","last_clean":"2024-06-04T16:18:25.119153+0000","last_became_active":"2024-06-04T16:16:08.664436+0000","last_became_peered":"2024-06-04T16:16:08.664436+0000","last_unstale":"2024-06-04T16:18:25.119153+0000","last_undegraded":"2024-06-04T16:18:25.119153+0000","last_fullsized":"2024-06-04T16:18:25.119153+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_clean_scrub_stamp":"2024-06-04T16:16:07.631263+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T23:11:08.299853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.d","version":"251'2","reported_seq":27,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:30.007548+0000","last_change":"2024-06-04T16:09:26.624040+0000","last_active":"2024-06-04T16:18:30.007548+0000","last_peered":"2024-06-04T16:18:30.007548+0000","last_clean":"2024-06-04T16:18:30.007548+0000","last_became_active":"2024-06-04T16:09:26.622747+0000","last_became_peered":"2024-06-04T16:09:26.622747+0000","last_unstale":"2024-06-04T16:18:30.007548+0000","last_undegraded":"2024-06-04T16:18:30.007548+0000","last_fullsized":"2024-06-04T16:18:30.007548+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_clean_scrub_stamp":"2024-06-04T16:09:25.601105+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T19:09:01.319407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.e","version":"254'9","reported_seq":46,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:25.005981+0000","last_change":"2024-06-04T16:09:23.609139+0000","last_active":"2024-06-04T16:18:25.005981+0000","last_peered":"2024-06-04T16:18:25.005981+0000","last_clean":"2024-06-04T16:18:25.005981+0000","last_became_active":"2024-06-04T16:09:23.608866+0000","last_became_peered":"2024-06-04T16:09:23.608866+0000","last_unstale":"2024-06-04T16:18:25.005981+0000","last_undegraded":"2024-06-04T16:18:25.005981+0000","last_fullsized":"2024-06-04T16:18:25.005981+0000","mapping_epoch":246,"log_start":"0'0","ondisk_log_start":"0'0","created":246,"last_epoch_clean":247,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_clean_scrub_stamp":"2024-06-04T16:09:22.572686+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T21:04:44.000874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":12,"num_read_kb":5122,"num_write":18,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"64.f","version":"251'6","reported_seq":51,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:25.112386+0000","last_change":"2024-06-04T16:07:09.401084+0000","last_active":"2024-06-04T16:18:25.112386+0000","last_peered":"2024-06-04T16:18:25.112386+0000","last_clean":"2024-06-04T16:18:25.112386+0000","last_became_active":"2024-06-04T16:07:09.400807+0000","last_became_peered":"2024-06-04T16:07:09.400807+0000","last_unstale":"2024-06-04T16:18:25.112386+0000","last_undegraded":"2024-06-04T16:18:25.112386+0000","last_fullsized":"2024-06-04T16:18:25.112386+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":243,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:07:08.374534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:07:08.374534+0000","last_clean_scrub_stamp":"2024-06-04T16:07:08.374534+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T19:24:05.530820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":19,"num_write":12,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.d","version":"0'0","reported_seq":14,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:25.119174+0000","last_change":"2024-06-04T16:16:08.657069+0000","last_active":"2024-06-04T16:18:25.119174+0000","last_peered":"2024-06-04T16:18:25.119174+0000","last_clean":"2024-06-04T16:18:25.119174+0000","last_became_active":"2024-06-04T16:16:08.656726+0000","last_became_peered":"2024-06-04T16:16:08.656726+0000","last_unstale":"2024-06-04T16:18:25.119174+0000","last_undegraded":"2024-06-04T16:18:25.119174+0000","last_fullsized":"2024-06-04T16:18:25.119174+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_clean_scrub_stamp":"2024-06-04T16:16:07.631263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T18:03:32.263500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.c","version":"254'2","reported_seq":27,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:30.003009+0000","last_change":"2024-06-04T16:09:26.628320+0000","last_active":"2024-06-04T16:18:30.003009+0000","last_peered":"2024-06-04T16:18:30.003009+0000","last_clean":"2024-06-04T16:18:30.003009+0000","last_became_active":"2024-06-04T16:09:26.627994+0000","last_became_peered":"2024-06-04T16:09:26.627994+0000","last_unstale":"2024-06-04T16:18:30.003009+0000","last_undegraded":"2024-06-04T16:18:30.003009+0000","last_fullsized":"2024-06-04T16:18:30.003009+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_clean_scrub_stamp":"2024-06-04T16:09:25.601105+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T00:37:41.828886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":7,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.f","version":"254'1","reported_seq":32,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:25.119238+0000","last_change":"2024-06-04T16:09:23.609586+0000","last_active":"2024-06-04T16:18:25.119238+0000","last_peered":"2024-06-04T16:18:25.119238+0000","last_clean":"2024-06-04T16:18:25.119238+0000","last_became_active":"2024-06-04T16:09:23.609283+0000","last_became_peered":"2024-06-04T16:09:23.609283+0000","last_unstale":"2024-06-04T16:18:25.119238+0000","last_undegraded":"2024-06-04T16:18:25.119238+0000","last_fullsized":"2024-06-04T16:18:25.119238+0000","mapping_epoch":246,"log_start":"0'0","ondisk_log_start":"0'0","created":246,"last_epoch_clean":247,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_clean_scrub_stamp":"2024-06-04T16:09:22.572686+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T19:30:03.495311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2048,"num_write":1,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"64.e","version":"254'20","reported_seq":93,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:25.005990+0000","last_change":"2024-06-04T16:07:09.401774+0000","last_active":"2024-06-04T16:18:25.005990+0000","last_peered":"2024-06-04T16:18:25.005990+0000","last_clean":"2024-06-04T16:18:25.005990+0000","last_became_active":"2024-06-04T16:07:09.401515+0000","last_became_peered":"2024-06-04T16:07:09.401515+0000","last_unstale":"2024-06-04T16:18:25.005990+0000","last_undegraded":"2024-06-04T16:18:25.005990+0000","last_fullsized":"2024-06-04T16:18:25.005990+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":243,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:07:08.374534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:07:08.374534+0000","last_clean_scrub_stamp":"2024-06-04T16:07:08.374534+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T00:16:43.451325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":108,"num_read_kb":75,"num_write":37,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.e","version":"0'0","reported_seq":14,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:25.007601+0000","last_change":"2024-06-04T16:16:08.657545+0000","last_active":"2024-06-04T16:18:25.007601+0000","last_peered":"2024-06-04T16:18:25.007601+0000","last_clean":"2024-06-04T16:18:25.007601+0000","last_became_active":"2024-06-04T16:16:08.657279+0000","last_became_peered":"2024-06-04T16:16:08.657279+0000","last_unstale":"2024-06-04T16:18:25.007601+0000","last_undegraded":"2024-06-04T16:18:25.007601+0000","last_fullsized":"2024-06-04T16:18:25.007601+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_clean_scrub_stamp":"2024-06-04T16:16:07.631263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T23:08:35.507441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.f","version":"254'8","reported_seq":42,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:30.119984+0000","last_change":"2024-06-04T16:09:26.623833+0000","last_active":"2024-06-04T16:18:30.119984+0000","last_peered":"2024-06-04T16:18:30.119984+0000","last_clean":"2024-06-04T16:18:30.119984+0000","last_became_active":"2024-06-04T16:09:26.623307+0000","last_became_peered":"2024-06-04T16:09:26.623307+0000","last_unstale":"2024-06-04T16:18:30.119984+0000","last_undegraded":"2024-06-04T16:18:30.119984+0000","last_fullsized":"2024-06-04T16:18:30.119984+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_clean_scrub_stamp":"2024-06-04T16:09:25.601105+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T23:15:04.575909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2097152,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":15,"num_read_kb":8194,"num_write":12,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.c","version":"254'4","reported_seq":35,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:25.006838+0000","last_change":"2024-06-04T16:09:23.612714+0000","last_active":"2024-06-04T16:18:25.006838+0000","last_peered":"2024-06-04T16:18:25.006838+0000","last_clean":"2024-06-04T16:18:25.006838+0000","last_became_active":"2024-06-04T16:09:23.612445+0000","last_became_peered":"2024-06-04T16:09:23.612445+0000","last_unstale":"2024-06-04T16:18:25.006838+0000","last_undegraded":"2024-06-04T16:18:25.006838+0000","last_fullsized":"2024-06-04T16:18:25.006838+0000","mapping_epoch":246,"log_start":"0'0","ondisk_log_start":"0'0","created":246,"last_epoch_clean":247,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_clean_scrub_stamp":"2024-06-04T16:09:22.572686+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T19:29:18.909595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":9,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"64.d","version":"251'24","reported_seq":105,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:25.005958+0000","last_change":"2024-06-04T16:07:09.511802+0000","last_active":"2024-06-04T16:18:25.005958+0000","last_peered":"2024-06-04T16:18:25.005958+0000","last_clean":"2024-06-04T16:18:25.005958+0000","last_became_active":"2024-06-04T16:07:09.511172+0000","last_became_peered":"2024-06-04T16:07:09.511172+0000","last_unstale":"2024-06-04T16:18:25.005958+0000","last_undegraded":"2024-06-04T16:18:25.005958+0000","last_fullsized":"2024-06-04T16:18:25.005958+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":243,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:07:08.374534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:07:08.374534+0000","last_clean_scrub_stamp":"2024-06-04T16:07:08.374534+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T20:08:28.763067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":134,"num_read_kb":91,"num_write":39,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.f","version":"0'0","reported_seq":14,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:25.119219+0000","last_change":"2024-06-04T16:16:08.662500+0000","last_active":"2024-06-04T16:18:25.119219+0000","last_peered":"2024-06-04T16:18:25.119219+0000","last_clean":"2024-06-04T16:18:25.119219+0000","last_became_active":"2024-06-04T16:16:08.662182+0000","last_became_peered":"2024-06-04T16:16:08.662182+0000","last_unstale":"2024-06-04T16:18:25.119219+0000","last_undegraded":"2024-06-04T16:18:25.119219+0000","last_fullsized":"2024-06-04T16:18:25.119219+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_clean_scrub_stamp":"2024-06-04T16:16:07.631263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T00:09:54.410059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.e","version":"0'0","reported_seq":23,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:30.119962+0000","last_change":"2024-06-04T16:09:26.629323+0000","last_active":"2024-06-04T16:18:30.119962+0000","last_peered":"2024-06-04T16:18:30.119962+0000","last_clean":"2024-06-04T16:18:30.119962+0000","last_became_active":"2024-06-04T16:09:26.629039+0000","last_became_peered":"2024-06-04T16:09:26.629039+0000","last_unstale":"2024-06-04T16:18:30.119962+0000","last_undegraded":"2024-06-04T16:18:30.119962+0000","last_fullsized":"2024-06-04T16:18:30.119962+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_clean_scrub_stamp":"2024-06-04T16:09:25.601105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T17:17:10.026858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.d","version":"254'5","reported_seq":40,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:25.112362+0000","last_change":"2024-06-04T16:09:23.607472+0000","last_active":"2024-06-04T16:18:25.112362+0000","last_peered":"2024-06-04T16:18:25.112362+0000","last_clean":"2024-06-04T16:18:25.112362+0000","last_became_active":"2024-06-04T16:09:23.606695+0000","last_became_peered":"2024-06-04T16:09:23.606695+0000","last_unstale":"2024-06-04T16:18:25.112362+0000","last_undegraded":"2024-06-04T16:18:25.112362+0000","last_fullsized":"2024-06-04T16:18:25.112362+0000","mapping_epoch":246,"log_start":"0'0","ondisk_log_start":"0'0","created":246,"last_epoch_clean":247,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_clean_scrub_stamp":"2024-06-04T16:09:22.572686+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T03:00:34.921184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":20480,"num_write":10,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"64.c","version":"251'31","reported_seq":123,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:25.002486+0000","last_change":"2024-06-04T16:07:09.511067+0000","last_active":"2024-06-04T16:18:25.002486+0000","last_peered":"2024-06-04T16:18:25.002486+0000","last_clean":"2024-06-04T16:18:25.002486+0000","last_became_active":"2024-06-04T16:07:09.510728+0000","last_became_peered":"2024-06-04T16:07:09.510728+0000","last_unstale":"2024-06-04T16:18:25.002486+0000","last_undegraded":"2024-06-04T16:18:25.002486+0000","last_fullsized":"2024-06-04T16:18:25.002486+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":243,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:07:08.374534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:07:08.374534+0000","last_clean_scrub_stamp":"2024-06-04T16:07:08.374534+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T19:07:33.768205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":168,"num_read_kb":120,"num_write":55,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.8","version":"0'0","reported_seq":14,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:20.001791+0000","last_change":"2024-06-04T16:16:08.664471+0000","last_active":"2024-06-04T16:18:20.001791+0000","last_peered":"2024-06-04T16:18:20.001791+0000","last_clean":"2024-06-04T16:18:20.001791+0000","last_became_active":"2024-06-04T16:16:08.664198+0000","last_became_peered":"2024-06-04T16:16:08.664198+0000","last_unstale":"2024-06-04T16:18:20.001791+0000","last_undegraded":"2024-06-04T16:18:20.001791+0000","last_fullsized":"2024-06-04T16:18:20.001791+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_clean_scrub_stamp":"2024-06-04T16:16:07.631263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T22:21:33.139848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.9","version":"254'4","reported_seq":33,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:20:20.023588+0000","last_change":"2024-06-04T16:09:26.626757+0000","last_active":"2024-06-04T16:20:20.023588+0000","last_peered":"2024-06-04T16:20:20.023588+0000","last_clean":"2024-06-04T16:20:20.023588+0000","last_became_active":"2024-06-04T16:09:26.625999+0000","last_became_peered":"2024-06-04T16:09:26.625999+0000","last_unstale":"2024-06-04T16:20:20.023588+0000","last_undegraded":"2024-06-04T16:20:20.023588+0000","last_fullsized":"2024-06-04T16:20:20.023588+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_clean_scrub_stamp":"2024-06-04T16:09:25.601105+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T19:40:29.538335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":9216,"num_write":4,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.a","version":"254'2","reported_seq":32,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:20:15.013716+0000","last_change":"2024-06-04T16:09:23.601101+0000","last_active":"2024-06-04T16:20:15.013716+0000","last_peered":"2024-06-04T16:20:15.013716+0000","last_clean":"2024-06-04T16:20:15.013716+0000","last_became_active":"2024-06-04T16:09:23.600752+0000","last_became_peered":"2024-06-04T16:09:23.600752+0000","last_unstale":"2024-06-04T16:20:15.013716+0000","last_undegraded":"2024-06-04T16:20:15.013716+0000","last_fullsized":"2024-06-04T16:20:15.013716+0000","mapping_epoch":246,"log_start":"0'0","ondisk_log_start":"0'0","created":246,"last_epoch_clean":247,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_clean_scrub_stamp":"2024-06-04T16:09:22.572686+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T17:03:48.692088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"64.b","version":"251'21","reported_seq":96,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:25.119108+0000","last_change":"2024-06-04T16:07:09.513384+0000","last_active":"2024-06-04T16:18:25.119108+0000","last_peered":"2024-06-04T16:18:25.119108+0000","last_clean":"2024-06-04T16:18:25.119108+0000","last_became_active":"2024-06-04T16:07:09.513020+0000","last_became_peered":"2024-06-04T16:07:09.513020+0000","last_unstale":"2024-06-04T16:18:25.119108+0000","last_undegraded":"2024-06-04T16:18:25.119108+0000","last_fullsized":"2024-06-04T16:18:25.119108+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":243,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:07:08.374534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:07:08.374534+0000","last_clean_scrub_stamp":"2024-06-04T16:07:08.374534+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T17:46:59.707579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":114,"num_read_kb":81,"num_write":38,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.9","version":"0'0","reported_seq":14,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:20.005249+0000","last_change":"2024-06-04T16:16:08.658344+0000","last_active":"2024-06-04T16:18:20.005249+0000","last_peered":"2024-06-04T16:18:20.005249+0000","last_clean":"2024-06-04T16:18:20.005249+0000","last_became_active":"2024-06-04T16:16:08.658076+0000","last_became_peered":"2024-06-04T16:16:08.658076+0000","last_unstale":"2024-06-04T16:18:20.005249+0000","last_undegraded":"2024-06-04T16:18:20.005249+0000","last_fullsized":"2024-06-04T16:18:20.005249+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_clean_scrub_stamp":"2024-06-04T16:16:07.631263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T17:29:18.849209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.8","version":"254'4","reported_seq":29,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:20:20.135632+0000","last_change":"2024-06-04T16:09:26.624229+0000","last_active":"2024-06-04T16:20:20.135632+0000","last_peered":"2024-06-04T16:20:20.135632+0000","last_clean":"2024-06-04T16:20:20.135632+0000","last_became_active":"2024-06-04T16:09:26.623966+0000","last_became_peered":"2024-06-04T16:09:26.623966+0000","last_unstale":"2024-06-04T16:20:20.135632+0000","last_undegraded":"2024-06-04T16:20:20.135632+0000","last_fullsized":"2024-06-04T16:20:20.135632+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_clean_scrub_stamp":"2024-06-04T16:09:25.601105+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T21:11:02.568495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":9,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.b","version":"254'2","reported_seq":33,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:25.006805+0000","last_change":"2024-06-04T16:09:23.613436+0000","last_active":"2024-06-04T16:18:25.006805+0000","last_peered":"2024-06-04T16:18:25.006805+0000","last_clean":"2024-06-04T16:18:25.006805+0000","last_became_active":"2024-06-04T16:09:23.613130+0000","last_became_peered":"2024-06-04T16:09:23.613130+0000","last_unstale":"2024-06-04T16:18:25.006805+0000","last_undegraded":"2024-06-04T16:18:25.006805+0000","last_fullsized":"2024-06-04T16:18:25.006805+0000","mapping_epoch":246,"log_start":"0'0","ondisk_log_start":"0'0","created":246,"last_epoch_clean":247,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_clean_scrub_stamp":"2024-06-04T16:09:22.572686+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T19:22:58.043042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3865073,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":3775,"num_write":2,"num_write_kb":3775,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"64.a","version":"251'22","reported_seq":100,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:20:15.022440+0000","last_change":"2024-06-04T16:07:09.404274+0000","last_active":"2024-06-04T16:20:15.022440+0000","last_peered":"2024-06-04T16:20:15.022440+0000","last_clean":"2024-06-04T16:20:15.022440+0000","last_became_active":"2024-06-04T16:07:09.403980+0000","last_became_peered":"2024-06-04T16:07:09.403980+0000","last_unstale":"2024-06-04T16:20:15.022440+0000","last_undegraded":"2024-06-04T16:20:15.022440+0000","last_fullsized":"2024-06-04T16:20:15.022440+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":243,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:07:08.374534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:07:08.374534+0000","last_clean_scrub_stamp":"2024-06-04T16:07:08.374534+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T01:30:42.556639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":122,"num_read_kb":87,"num_write":38,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.a","version":"0'0","reported_seq":14,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:20.001694+0000","last_change":"2024-06-04T16:16:08.661712+0000","last_active":"2024-06-04T16:18:20.001694+0000","last_peered":"2024-06-04T16:18:20.001694+0000","last_clean":"2024-06-04T16:18:20.001694+0000","last_became_active":"2024-06-04T16:16:08.661413+0000","last_became_peered":"2024-06-04T16:16:08.661413+0000","last_unstale":"2024-06-04T16:18:20.001694+0000","last_undegraded":"2024-06-04T16:18:20.001694+0000","last_fullsized":"2024-06-04T16:18:20.001694+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_clean_scrub_stamp":"2024-06-04T16:16:07.631263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T20:52:36.472473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.b","version":"254'3","reported_seq":30,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:30.006581+0000","last_change":"2024-06-04T16:09:26.622990+0000","last_active":"2024-06-04T16:18:30.006581+0000","last_peered":"2024-06-04T16:18:30.006581+0000","last_clean":"2024-06-04T16:18:30.006581+0000","last_became_active":"2024-06-04T16:09:26.622600+0000","last_became_peered":"2024-06-04T16:09:26.622600+0000","last_unstale":"2024-06-04T16:18:30.006581+0000","last_undegraded":"2024-06-04T16:18:30.006581+0000","last_fullsized":"2024-06-04T16:18:30.006581+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_clean_scrub_stamp":"2024-06-04T16:09:25.601105+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T17:25:05.424763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3216,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":1032,"num_write":3,"num_write_kb":1028,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.8","version":"251'2","reported_seq":34,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:20:15.013108+0000","last_change":"2024-06-04T16:09:23.610808+0000","last_active":"2024-06-04T16:20:15.013108+0000","last_peered":"2024-06-04T16:20:15.013108+0000","last_clean":"2024-06-04T16:20:15.013108+0000","last_became_active":"2024-06-04T16:09:23.610525+0000","last_became_peered":"2024-06-04T16:09:23.610525+0000","last_unstale":"2024-06-04T16:20:15.013108+0000","last_undegraded":"2024-06-04T16:20:15.013108+0000","last_fullsized":"2024-06-04T16:20:15.013108+0000","mapping_epoch":246,"log_start":"0'0","ondisk_log_start":"0'0","created":246,"last_epoch_clean":247,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_clean_scrub_stamp":"2024-06-04T16:09:22.572686+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T16:29:28.622251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"64.9","version":"251'14","reported_seq":79,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:20:10.022040+0000","last_change":"2024-06-04T16:07:09.403769+0000","last_active":"2024-06-04T16:20:10.022040+0000","last_peered":"2024-06-04T16:20:10.022040+0000","last_clean":"2024-06-04T16:20:10.022040+0000","last_became_active":"2024-06-04T16:07:09.403227+0000","last_became_peered":"2024-06-04T16:07:09.403227+0000","last_unstale":"2024-06-04T16:20:10.022040+0000","last_undegraded":"2024-06-04T16:20:10.022040+0000","last_fullsized":"2024-06-04T16:20:10.022040+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":243,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:07:08.374534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:07:08.374534+0000","last_clean_scrub_stamp":"2024-06-04T16:07:08.374534+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T18:26:06.974591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":56,"num_write":27,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.b","version":"0'0","reported_seq":14,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:25.006788+0000","last_change":"2024-06-04T16:16:08.660998+0000","last_active":"2024-06-04T16:18:25.006788+0000","last_peered":"2024-06-04T16:18:25.006788+0000","last_clean":"2024-06-04T16:18:25.006788+0000","last_became_active":"2024-06-04T16:16:08.660717+0000","last_became_peered":"2024-06-04T16:16:08.660717+0000","last_unstale":"2024-06-04T16:18:25.006788+0000","last_undegraded":"2024-06-04T16:18:25.006788+0000","last_fullsized":"2024-06-04T16:18:25.006788+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_clean_scrub_stamp":"2024-06-04T16:16:07.631263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T03:13:46.348557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.a","version":"254'1","reported_seq":27,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:20:20.135674+0000","last_change":"2024-06-04T16:09:26.620380+0000","last_active":"2024-06-04T16:20:20.135674+0000","last_peered":"2024-06-04T16:20:20.135674+0000","last_clean":"2024-06-04T16:20:20.135674+0000","last_became_active":"2024-06-04T16:09:26.620119+0000","last_became_peered":"2024-06-04T16:09:26.620119+0000","last_unstale":"2024-06-04T16:20:20.135674+0000","last_undegraded":"2024-06-04T16:20:20.135674+0000","last_fullsized":"2024-06-04T16:20:20.135674+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_clean_scrub_stamp":"2024-06-04T16:09:25.601105+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T18:51:09.607155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.9","version":"251'5","reported_seq":41,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:20:15.022798+0000","last_change":"2024-06-04T16:09:23.607975+0000","last_active":"2024-06-04T16:20:15.022798+0000","last_peered":"2024-06-04T16:20:15.022798+0000","last_clean":"2024-06-04T16:20:15.022798+0000","last_became_active":"2024-06-04T16:09:23.607666+0000","last_became_peered":"2024-06-04T16:09:23.607666+0000","last_unstale":"2024-06-04T16:20:15.022798+0000","last_undegraded":"2024-06-04T16:20:15.022798+0000","last_fullsized":"2024-06-04T16:20:15.022798+0000","mapping_epoch":246,"log_start":"0'0","ondisk_log_start":"0'0","created":246,"last_epoch_clean":247,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_clean_scrub_stamp":"2024-06-04T16:09:22.572686+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T16:30:58.550630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":16386,"num_write":9,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"64.8","version":"251'8","reported_seq":61,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:20:10.017783+0000","last_change":"2024-06-04T16:07:09.405213+0000","last_active":"2024-06-04T16:20:10.017783+0000","last_peered":"2024-06-04T16:20:10.017783+0000","last_clean":"2024-06-04T16:20:10.017783+0000","last_became_active":"2024-06-04T16:07:09.404928+0000","last_became_peered":"2024-06-04T16:07:09.404928+0000","last_unstale":"2024-06-04T16:20:10.017783+0000","last_undegraded":"2024-06-04T16:20:10.017783+0000","last_fullsized":"2024-06-04T16:20:10.017783+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":243,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:07:08.374534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:07:08.374534+0000","last_clean_scrub_stamp":"2024-06-04T16:07:08.374534+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T19:53:15.255308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":32,"num_write":14,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.4","version":"0'0","reported_seq":15,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:20:20.023650+0000","last_change":"2024-06-04T16:16:08.663046+0000","last_active":"2024-06-04T16:20:20.023650+0000","last_peered":"2024-06-04T16:20:20.023650+0000","last_clean":"2024-06-04T16:20:20.023650+0000","last_became_active":"2024-06-04T16:16:08.662732+0000","last_became_peered":"2024-06-04T16:16:08.662732+0000","last_unstale":"2024-06-04T16:20:20.023650+0000","last_undegraded":"2024-06-04T16:20:20.023650+0000","last_fullsized":"2024-06-04T16:20:20.023650+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_clean_scrub_stamp":"2024-06-04T16:16:07.631263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T19:10:09.410318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.5","version":"254'1","reported_seq":26,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:55.019474+0000","last_change":"2024-06-04T16:09:26.624497+0000","last_active":"2024-06-04T16:19:55.019474+0000","last_peered":"2024-06-04T16:19:55.019474+0000","last_clean":"2024-06-04T16:19:55.019474+0000","last_became_active":"2024-06-04T16:09:26.624142+0000","last_became_peered":"2024-06-04T16:09:26.624142+0000","last_unstale":"2024-06-04T16:19:55.019474+0000","last_undegraded":"2024-06-04T16:19:55.019474+0000","last_fullsized":"2024-06-04T16:19:55.019474+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_clean_scrub_stamp":"2024-06-04T16:09:25.601105+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T18:17:49.470708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.6","version":"254'2","reported_seq":34,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:20:15.018492+0000","last_change":"2024-06-04T16:09:23.608725+0000","last_active":"2024-06-04T16:20:15.018492+0000","last_peered":"2024-06-04T16:20:15.018492+0000","last_clean":"2024-06-04T16:20:15.018492+0000","last_became_active":"2024-06-04T16:09:23.608300+0000","last_became_peered":"2024-06-04T16:09:23.608300+0000","last_unstale":"2024-06-04T16:20:15.018492+0000","last_undegraded":"2024-06-04T16:20:15.018492+0000","last_fullsized":"2024-06-04T16:20:15.018492+0000","mapping_epoch":246,"log_start":"0'0","ondisk_log_start":"0'0","created":246,"last_epoch_clean":247,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_clean_scrub_stamp":"2024-06-04T16:09:22.572686+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T23:47:46.805128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":7,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"64.7","version":"251'16","reported_seq":79,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:20:10.022130+0000","last_change":"2024-06-04T16:07:09.511741+0000","last_active":"2024-06-04T16:20:10.022130+0000","last_peered":"2024-06-04T16:20:10.022130+0000","last_clean":"2024-06-04T16:20:10.022130+0000","last_became_active":"2024-06-04T16:07:09.511421+0000","last_became_peered":"2024-06-04T16:07:09.511421+0000","last_unstale":"2024-06-04T16:20:10.022130+0000","last_undegraded":"2024-06-04T16:20:10.022130+0000","last_fullsized":"2024-06-04T16:20:10.022130+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":243,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:07:08.374534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:07:08.374534+0000","last_clean_scrub_stamp":"2024-06-04T16:07:08.374534+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T20:29:49.254010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":56,"num_write":28,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.5","version":"0'0","reported_seq":15,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:20:20.023672+0000","last_change":"2024-06-04T16:16:08.656242+0000","last_active":"2024-06-04T16:20:20.023672+0000","last_peered":"2024-06-04T16:20:20.023672+0000","last_clean":"2024-06-04T16:20:20.023672+0000","last_became_active":"2024-06-04T16:16:08.655913+0000","last_became_peered":"2024-06-04T16:16:08.655913+0000","last_unstale":"2024-06-04T16:20:20.023672+0000","last_undegraded":"2024-06-04T16:20:20.023672+0000","last_fullsized":"2024-06-04T16:20:20.023672+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_clean_scrub_stamp":"2024-06-04T16:16:07.631263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T02:48:49.714670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.4","version":"254'1","reported_seq":26,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:55.016222+0000","last_change":"2024-06-04T16:09:26.628240+0000","last_active":"2024-06-04T16:19:55.016222+0000","last_peered":"2024-06-04T16:19:55.016222+0000","last_clean":"2024-06-04T16:19:55.016222+0000","last_became_active":"2024-06-04T16:09:26.627915+0000","last_became_peered":"2024-06-04T16:09:26.627915+0000","last_unstale":"2024-06-04T16:19:55.016222+0000","last_undegraded":"2024-06-04T16:19:55.016222+0000","last_fullsized":"2024-06-04T16:19:55.016222+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_clean_scrub_stamp":"2024-06-04T16:09:25.601105+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T18:57:07.829231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1024,"num_write":1,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.7","version":"251'3","reported_seq":35,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:20:15.022566+0000","last_change":"2024-06-04T16:09:23.607332+0000","last_active":"2024-06-04T16:20:15.022566+0000","last_peered":"2024-06-04T16:20:15.022566+0000","last_clean":"2024-06-04T16:20:15.022566+0000","last_became_active":"2024-06-04T16:09:23.605516+0000","last_became_peered":"2024-06-04T16:09:23.605516+0000","last_unstale":"2024-06-04T16:20:15.022566+0000","last_undegraded":"2024-06-04T16:20:15.022566+0000","last_fullsized":"2024-06-04T16:20:15.022566+0000","mapping_epoch":246,"log_start":"0'0","ondisk_log_start":"0'0","created":246,"last_epoch_clean":247,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_clean_scrub_stamp":"2024-06-04T16:09:22.572686+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T18:35:30.226341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"64.6","version":"251'12","reported_seq":67,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:20:10.012671+0000","last_change":"2024-06-04T16:07:09.398080+0000","last_active":"2024-06-04T16:20:10.012671+0000","last_peered":"2024-06-04T16:20:10.012671+0000","last_clean":"2024-06-04T16:20:10.012671+0000","last_became_active":"2024-06-04T16:07:09.397805+0000","last_became_peered":"2024-06-04T16:07:09.397805+0000","last_unstale":"2024-06-04T16:20:10.012671+0000","last_undegraded":"2024-06-04T16:20:10.012671+0000","last_fullsized":"2024-06-04T16:20:10.012671+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":243,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:07:08.374534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:07:08.374534+0000","last_clean_scrub_stamp":"2024-06-04T16:07:08.374534+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T23:55:55.603697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":38,"num_write":27,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.6","version":"253'1","reported_seq":15,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:20.005356+0000","last_change":"2024-06-04T16:16:08.656516+0000","last_active":"2024-06-04T16:18:20.005356+0000","last_peered":"2024-06-04T16:18:20.005356+0000","last_clean":"2024-06-04T16:18:20.005356+0000","last_became_active":"2024-06-04T16:16:08.656182+0000","last_became_peered":"2024-06-04T16:16:08.656182+0000","last_unstale":"2024-06-04T16:18:20.005356+0000","last_undegraded":"2024-06-04T16:18:20.005356+0000","last_fullsized":"2024-06-04T16:18:20.005356+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_clean_scrub_stamp":"2024-06-04T16:16:07.631263+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T22:01:48.464700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.7","version":"0'0","reported_seq":24,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:20:20.019052+0000","last_change":"2024-06-04T16:09:26.626653+0000","last_active":"2024-06-04T16:20:20.019052+0000","last_peered":"2024-06-04T16:20:20.019052+0000","last_clean":"2024-06-04T16:20:20.019052+0000","last_became_active":"2024-06-04T16:09:26.625833+0000","last_became_peered":"2024-06-04T16:09:26.625833+0000","last_unstale":"2024-06-04T16:20:20.019052+0000","last_undegraded":"2024-06-04T16:20:20.019052+0000","last_fullsized":"2024-06-04T16:20:20.019052+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_clean_scrub_stamp":"2024-06-04T16:09:25.601105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T21:55:58.166045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.4","version":"0'0","reported_seq":30,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:50.131381+0000","last_change":"2024-06-04T16:09:23.607166+0000","last_active":"2024-06-04T16:19:50.131381+0000","last_peered":"2024-06-04T16:19:50.131381+0000","last_clean":"2024-06-04T16:19:50.131381+0000","last_became_active":"2024-06-04T16:09:23.606669+0000","last_became_peered":"2024-06-04T16:09:23.606669+0000","last_unstale":"2024-06-04T16:19:50.131381+0000","last_undegraded":"2024-06-04T16:19:50.131381+0000","last_fullsized":"2024-06-04T16:19:50.131381+0000","mapping_epoch":246,"log_start":"0'0","ondisk_log_start":"0'0","created":246,"last_epoch_clean":247,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_clean_scrub_stamp":"2024-06-04T16:09:22.572686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T03:58:28.100517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"64.5","version":"254'31","reported_seq":127,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:40.120414+0000","last_change":"2024-06-04T16:07:09.404140+0000","last_active":"2024-06-04T16:19:40.120414+0000","last_peered":"2024-06-04T16:19:40.120414+0000","last_clean":"2024-06-04T16:19:40.120414+0000","last_became_active":"2024-06-04T16:07:09.403868+0000","last_became_peered":"2024-06-04T16:07:09.403868+0000","last_unstale":"2024-06-04T16:19:40.120414+0000","last_undegraded":"2024-06-04T16:19:40.120414+0000","last_fullsized":"2024-06-04T16:19:40.120414+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":243,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:07:08.374534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:07:08.374534+0000","last_clean_scrub_stamp":"2024-06-04T16:07:08.374534+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T19:30:33.830947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":170,"num_read_kb":120,"num_write":66,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.7","version":"0'0","reported_seq":14,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:20.001746+0000","last_change":"2024-06-04T16:16:08.661700+0000","last_active":"2024-06-04T16:18:20.001746+0000","last_peered":"2024-06-04T16:18:20.001746+0000","last_clean":"2024-06-04T16:18:20.001746+0000","last_became_active":"2024-06-04T16:16:08.661379+0000","last_became_peered":"2024-06-04T16:16:08.661379+0000","last_unstale":"2024-06-04T16:18:20.001746+0000","last_undegraded":"2024-06-04T16:18:20.001746+0000","last_fullsized":"2024-06-04T16:18:20.001746+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_clean_scrub_stamp":"2024-06-04T16:16:07.631263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T18:30:12.285218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.6","version":"0'0","reported_seq":24,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:20:20.014285+0000","last_change":"2024-06-04T16:09:26.624438+0000","last_active":"2024-06-04T16:20:20.014285+0000","last_peered":"2024-06-04T16:20:20.014285+0000","last_clean":"2024-06-04T16:20:20.014285+0000","last_became_active":"2024-06-04T16:09:26.624074+0000","last_became_peered":"2024-06-04T16:09:26.624074+0000","last_unstale":"2024-06-04T16:20:20.014285+0000","last_undegraded":"2024-06-04T16:20:20.014285+0000","last_fullsized":"2024-06-04T16:20:20.014285+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_clean_scrub_stamp":"2024-06-04T16:09:25.601105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T21:01:18.041771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.5","version":"254'3","reported_seq":35,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:50.011288+0000","last_change":"2024-06-04T16:09:23.604554+0000","last_active":"2024-06-04T16:19:50.011288+0000","last_peered":"2024-06-04T16:19:50.011288+0000","last_clean":"2024-06-04T16:19:50.011288+0000","last_became_active":"2024-06-04T16:09:23.604255+0000","last_became_peered":"2024-06-04T16:09:23.604255+0000","last_unstale":"2024-06-04T16:19:50.011288+0000","last_undegraded":"2024-06-04T16:19:50.011288+0000","last_fullsized":"2024-06-04T16:19:50.011288+0000","mapping_epoch":246,"log_start":"0'0","ondisk_log_start":"0'0","created":246,"last_epoch_clean":247,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_clean_scrub_stamp":"2024-06-04T16:09:22.572686+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T19:47:14.640534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":3,"num_write_kb":1026,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"64.4","version":"254'14","reported_seq":76,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:40.009620+0000","last_change":"2024-06-04T16:07:09.397501+0000","last_active":"2024-06-04T16:19:40.009620+0000","last_peered":"2024-06-04T16:19:40.009620+0000","last_clean":"2024-06-04T16:19:40.009620+0000","last_became_active":"2024-06-04T16:07:09.396484+0000","last_became_peered":"2024-06-04T16:07:09.396484+0000","last_unstale":"2024-06-04T16:19:40.009620+0000","last_undegraded":"2024-06-04T16:19:40.009620+0000","last_fullsized":"2024-06-04T16:19:40.009620+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":243,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:07:08.374534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:07:08.374534+0000","last_clean_scrub_stamp":"2024-06-04T16:07:08.374534+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T16:59:32.871360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":52,"num_write":27,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.0","version":"0'0","reported_seq":15,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:20:10.017765+0000","last_change":"2024-06-04T16:16:08.661272+0000","last_active":"2024-06-04T16:20:10.017765+0000","last_peered":"2024-06-04T16:20:10.017765+0000","last_clean":"2024-06-04T16:20:10.017765+0000","last_became_active":"2024-06-04T16:16:08.660893+0000","last_became_peered":"2024-06-04T16:16:08.660893+0000","last_unstale":"2024-06-04T16:20:10.017765+0000","last_undegraded":"2024-06-04T16:20:10.017765+0000","last_fullsized":"2024-06-04T16:20:10.017765+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_clean_scrub_stamp":"2024-06-04T16:16:07.631263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T00:49:39.967328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1","version":"251'2","reported_seq":28,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:55.016165+0000","last_change":"2024-06-04T16:09:26.623485+0000","last_active":"2024-06-04T16:19:55.016165+0000","last_peered":"2024-06-04T16:19:55.016165+0000","last_clean":"2024-06-04T16:19:55.016165+0000","last_became_active":"2024-06-04T16:09:26.623190+0000","last_became_peered":"2024-06-04T16:09:26.623190+0000","last_unstale":"2024-06-04T16:19:55.016165+0000","last_undegraded":"2024-06-04T16:19:55.016165+0000","last_fullsized":"2024-06-04T16:19:55.016165+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_clean_scrub_stamp":"2024-06-04T16:09:25.601105+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T18:13:31.934728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.2","version":"254'4","reported_seq":39,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:50.015625+0000","last_change":"2024-06-04T16:09:23.610740+0000","last_active":"2024-06-04T16:19:50.015625+0000","last_peered":"2024-06-04T16:19:50.015625+0000","last_clean":"2024-06-04T16:19:50.015625+0000","last_became_active":"2024-06-04T16:09:23.610479+0000","last_became_peered":"2024-06-04T16:09:23.610479+0000","last_unstale":"2024-06-04T16:19:50.015625+0000","last_undegraded":"2024-06-04T16:19:50.015625+0000","last_fullsized":"2024-06-04T16:19:50.015625+0000","mapping_epoch":246,"log_start":"0'0","ondisk_log_start":"0'0","created":246,"last_epoch_clean":247,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_clean_scrub_stamp":"2024-06-04T16:09:22.572686+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T20:36:24.481405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2097152,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":5120,"num_write":4,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"64.3","version":"251'23","reported_seq":98,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:40.017634+0000","last_change":"2024-06-04T16:07:09.513369+0000","last_active":"2024-06-04T16:19:40.017634+0000","last_peered":"2024-06-04T16:19:40.017634+0000","last_clean":"2024-06-04T16:19:40.017634+0000","last_became_active":"2024-06-04T16:07:09.512996+0000","last_became_peered":"2024-06-04T16:07:09.512996+0000","last_unstale":"2024-06-04T16:19:40.017634+0000","last_undegraded":"2024-06-04T16:19:40.017634+0000","last_fullsized":"2024-06-04T16:19:40.017634+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":243,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:07:08.374534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:07:08.374534+0000","last_clean_scrub_stamp":"2024-06-04T16:07:08.374534+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T18:42:34.541675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":113,"num_read_kb":81,"num_write":51,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1","version":"0'0","reported_seq":15,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:20:20.023189+0000","last_change":"2024-06-04T16:16:08.660525+0000","last_active":"2024-06-04T16:20:20.023189+0000","last_peered":"2024-06-04T16:20:20.023189+0000","last_clean":"2024-06-04T16:20:20.023189+0000","last_became_active":"2024-06-04T16:16:08.660177+0000","last_became_peered":"2024-06-04T16:16:08.660177+0000","last_unstale":"2024-06-04T16:20:20.023189+0000","last_undegraded":"2024-06-04T16:20:20.023189+0000","last_fullsized":"2024-06-04T16:20:20.023189+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_clean_scrub_stamp":"2024-06-04T16:16:07.631263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T19:57:47.986547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.0","version":"254'1","reported_seq":26,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:30.009167+0000","last_change":"2024-06-04T16:09:26.626867+0000","last_active":"2024-06-04T16:19:30.009167+0000","last_peered":"2024-06-04T16:19:30.009167+0000","last_clean":"2024-06-04T16:19:30.009167+0000","last_became_active":"2024-06-04T16:09:26.626576+0000","last_became_peered":"2024-06-04T16:09:26.626576+0000","last_unstale":"2024-06-04T16:19:30.009167+0000","last_undegraded":"2024-06-04T16:19:30.009167+0000","last_fullsized":"2024-06-04T16:19:30.009167+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_clean_scrub_stamp":"2024-06-04T16:09:25.601105+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T03:40:55.878734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.3","version":"254'1","reported_seq":32,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:50.011231+0000","last_change":"2024-06-04T16:09:23.604809+0000","last_active":"2024-06-04T16:19:50.011231+0000","last_peered":"2024-06-04T16:19:50.011231+0000","last_clean":"2024-06-04T16:19:50.011231+0000","last_became_active":"2024-06-04T16:09:23.604413+0000","last_became_peered":"2024-06-04T16:09:23.604413+0000","last_unstale":"2024-06-04T16:19:50.011231+0000","last_undegraded":"2024-06-04T16:19:50.011231+0000","last_fullsized":"2024-06-04T16:19:50.011231+0000","mapping_epoch":246,"log_start":"0'0","ondisk_log_start":"0'0","created":246,"last_epoch_clean":247,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_clean_scrub_stamp":"2024-06-04T16:09:22.572686+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T19:25:08.922699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"64.2","version":"254'2","reported_seq":43,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:40.009587+0000","last_change":"2024-06-04T16:07:09.402095+0000","last_active":"2024-06-04T16:19:40.009587+0000","last_peered":"2024-06-04T16:19:40.009587+0000","last_clean":"2024-06-04T16:19:40.009587+0000","last_became_active":"2024-06-04T16:07:09.401796+0000","last_became_peered":"2024-06-04T16:07:09.401796+0000","last_unstale":"2024-06-04T16:19:40.009587+0000","last_undegraded":"2024-06-04T16:19:40.009587+0000","last_fullsized":"2024-06-04T16:19:40.009587+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":243,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:07:08.374534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:07:08.374534+0000","last_clean_scrub_stamp":"2024-06-04T16:07:08.374534+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T02:34:43.812974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":7,"num_write":11,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.2","version":"0'0","reported_seq":15,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:20:20.014209+0000","last_change":"2024-06-04T16:16:08.656504+0000","last_active":"2024-06-04T16:20:20.014209+0000","last_peered":"2024-06-04T16:20:20.014209+0000","last_clean":"2024-06-04T16:20:20.014209+0000","last_became_active":"2024-06-04T16:16:08.656245+0000","last_became_peered":"2024-06-04T16:16:08.656245+0000","last_unstale":"2024-06-04T16:20:20.014209+0000","last_undegraded":"2024-06-04T16:20:20.014209+0000","last_fullsized":"2024-06-04T16:20:20.014209+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_clean_scrub_stamp":"2024-06-04T16:16:07.631263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T22:30:53.169701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.3","version":"254'3","reported_seq":30,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:55.121916+0000","last_change":"2024-06-04T16:09:26.627525+0000","last_active":"2024-06-04T16:19:55.121916+0000","last_peered":"2024-06-04T16:19:55.121916+0000","last_clean":"2024-06-04T16:19:55.121916+0000","last_became_active":"2024-06-04T16:09:26.627193+0000","last_became_peered":"2024-06-04T16:09:26.627193+0000","last_unstale":"2024-06-04T16:19:55.121916+0000","last_undegraded":"2024-06-04T16:19:55.121916+0000","last_fullsized":"2024-06-04T16:19:55.121916+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_clean_scrub_stamp":"2024-06-04T16:09:25.601105+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T04:04:57.004292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.0","version":"254'1","reported_seq":32,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:25.008667+0000","last_change":"2024-06-04T16:09:23.606568+0000","last_active":"2024-06-04T16:19:25.008667+0000","last_peered":"2024-06-04T16:19:25.008667+0000","last_clean":"2024-06-04T16:19:25.008667+0000","last_became_active":"2024-06-04T16:09:23.605145+0000","last_became_peered":"2024-06-04T16:09:23.605145+0000","last_unstale":"2024-06-04T16:19:25.008667+0000","last_undegraded":"2024-06-04T16:19:25.008667+0000","last_fullsized":"2024-06-04T16:19:25.008667+0000","mapping_epoch":246,"log_start":"0'0","ondisk_log_start":"0'0","created":246,"last_epoch_clean":247,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_clean_scrub_stamp":"2024-06-04T16:09:22.572686+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T16:32:02.394319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1024,"num_write":1,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"64.1","version":"245'23","reported_seq":103,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:40.120328+0000","last_change":"2024-06-04T16:07:09.405357+0000","last_active":"2024-06-04T16:19:40.120328+0000","last_peered":"2024-06-04T16:19:40.120328+0000","last_clean":"2024-06-04T16:19:40.120328+0000","last_became_active":"2024-06-04T16:07:09.405086+0000","last_became_peered":"2024-06-04T16:07:09.405086+0000","last_unstale":"2024-06-04T16:19:40.120328+0000","last_undegraded":"2024-06-04T16:19:40.120328+0000","last_fullsized":"2024-06-04T16:19:40.120328+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":243,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:07:08.374534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:07:08.374534+0000","last_clean_scrub_stamp":"2024-06-04T16:07:08.374534+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T20:08:13.021269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":130,"num_read_kb":96,"num_write":31,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.3","version":"0'0","reported_seq":15,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:20:20.014237+0000","last_change":"2024-06-04T16:16:08.661478+0000","last_active":"2024-06-04T16:20:20.014237+0000","last_peered":"2024-06-04T16:20:20.014237+0000","last_clean":"2024-06-04T16:20:20.014237+0000","last_became_active":"2024-06-04T16:16:08.661111+0000","last_became_peered":"2024-06-04T16:16:08.661111+0000","last_unstale":"2024-06-04T16:20:20.014237+0000","last_undegraded":"2024-06-04T16:20:20.014237+0000","last_fullsized":"2024-06-04T16:20:20.014237+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_clean_scrub_stamp":"2024-06-04T16:16:07.631263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T01:29:29.432723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.2","version":"254'1","reported_seq":27,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:55.019333+0000","last_change":"2024-06-04T16:09:26.625154+0000","last_active":"2024-06-04T16:19:55.019333+0000","last_peered":"2024-06-04T16:19:55.019333+0000","last_clean":"2024-06-04T16:19:55.019333+0000","last_became_active":"2024-06-04T16:09:26.624890+0000","last_became_peered":"2024-06-04T16:09:26.624890+0000","last_unstale":"2024-06-04T16:19:55.019333+0000","last_undegraded":"2024-06-04T16:19:55.019333+0000","last_fullsized":"2024-06-04T16:19:55.019333+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_clean_scrub_stamp":"2024-06-04T16:09:25.601105+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T20:52:50.931929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.1","version":"251'10","reported_seq":52,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:50.015591+0000","last_change":"2024-06-04T16:09:23.609351+0000","last_active":"2024-06-04T16:19:50.015591+0000","last_peered":"2024-06-04T16:19:50.015591+0000","last_clean":"2024-06-04T16:19:50.015591+0000","last_became_active":"2024-06-04T16:09:23.609072+0000","last_became_peered":"2024-06-04T16:09:23.609072+0000","last_unstale":"2024-06-04T16:19:50.015591+0000","last_undegraded":"2024-06-04T16:19:50.015591+0000","last_fullsized":"2024-06-04T16:19:50.015591+0000","mapping_epoch":246,"log_start":"0'0","ondisk_log_start":"0'0","created":246,"last_epoch_clean":247,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_clean_scrub_stamp":"2024-06-04T16:09:22.572686+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T01:04:48.825987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":15362,"num_write":9,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"64.0","version":"254'11","reported_seq":67,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:10.125764+0000","last_change":"2024-06-04T16:07:09.405417+0000","last_active":"2024-06-04T16:19:10.125764+0000","last_peered":"2024-06-04T16:19:10.125764+0000","last_clean":"2024-06-04T16:19:10.125764+0000","last_became_active":"2024-06-04T16:07:09.405109+0000","last_became_peered":"2024-06-04T16:07:09.405109+0000","last_unstale":"2024-06-04T16:19:10.125764+0000","last_undegraded":"2024-06-04T16:19:10.125764+0000","last_fullsized":"2024-06-04T16:19:10.125764+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":243,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:07:08.374534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:07:08.374534+0000","last_clean_scrub_stamp":"2024-06-04T16:07:08.374534+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T02:10:45.525441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":37,"num_write":22,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"251'58","reported_seq":567,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:45.010179+0000","last_change":"2024-06-04T15:52:36.496655+0000","last_active":"2024-06-04T16:19:45.010179+0000","last_peered":"2024-06-04T16:19:45.010179+0000","last_clean":"2024-06-04T16:19:45.010179+0000","last_became_active":"2024-06-04T15:52:36.496345+0000","last_became_peered":"2024-06-04T15:52:36.496345+0000","last_unstale":"2024-06-04T16:19:45.010179+0000","last_undegraded":"2024-06-04T16:19:45.010179+0000","last_fullsized":"2024-06-04T16:19:45.010179+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T19:41:39.532361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":73,"num_read_kb":10950,"num_write":187,"num_write_kb":28882,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"254'155","reported_seq":885,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:11.646551+0000","last_change":"2024-06-04T15:52:38.485748+0000","last_active":"2024-06-04T16:18:11.646551+0000","last_peered":"2024-06-04T16:18:11.646551+0000","last_clean":"2024-06-04T16:18:11.646551+0000","last_became_active":"2024-06-04T15:52:38.485491+0000","last_became_peered":"2024-06-04T15:52:38.485491+0000","last_unstale":"2024-06-04T16:18:11.646551+0000","last_undegraded":"2024-06-04T16:18:11.646551+0000","last_fullsized":"2024-06-04T16:18:11.646551+0000","mapping_epoch":23,"log_start":"251'100","ondisk_log_start":"251'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":100,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T03:05:20.005510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":710,"num_read_kb":632,"num_write":201,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"251'45","reported_seq":565,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:45.018501+0000","last_change":"2024-06-04T15:52:36.484644+0000","last_active":"2024-06-04T16:19:45.018501+0000","last_peered":"2024-06-04T16:19:45.018501+0000","last_clean":"2024-06-04T16:19:45.018501+0000","last_became_active":"2024-06-04T15:52:36.484223+0000","last_became_peered":"2024-06-04T15:52:36.484223+0000","last_unstale":"2024-06-04T16:19:45.018501+0000","last_undegraded":"2024-06-04T16:19:45.018501+0000","last_fullsized":"2024-06-04T16:19:45.018501+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T03:34:20.970333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1311028,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":90,"num_read_kb":9967,"num_write":210,"num_write_kb":17365,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,0],"acting":[5,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.39","version":"254'108","reported_seq":856,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:20.564331+0000","last_change":"2024-06-04T15:52:38.482297+0000","last_active":"2024-06-04T16:18:20.564331+0000","last_peered":"2024-06-04T16:18:20.564331+0000","last_clean":"2024-06-04T16:18:20.564331+0000","last_became_active":"2024-06-04T15:52:38.482000+0000","last_became_peered":"2024-06-04T15:52:38.482000+0000","last_unstale":"2024-06-04T16:18:20.564331+0000","last_undegraded":"2024-06-04T16:18:20.564331+0000","last_fullsized":"2024-06-04T16:18:20.564331+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T19:21:51.740016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":584,"num_read_kb":552,"num_write":123,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"254'42","reported_seq":538,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:45.018486+0000","last_change":"2024-06-04T15:52:36.480336+0000","last_active":"2024-06-04T16:19:45.018486+0000","last_peered":"2024-06-04T16:19:45.018486+0000","last_clean":"2024-06-04T16:19:45.018486+0000","last_became_active":"2024-06-04T15:52:36.479881+0000","last_became_peered":"2024-06-04T15:52:36.479881+0000","last_unstale":"2024-06-04T16:19:45.018486+0000","last_undegraded":"2024-06-04T16:19:45.018486+0000","last_fullsized":"2024-06-04T16:19:45.018486+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T22:45:30.429987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":40,"num_read_kb":31,"num_write":168,"num_write_kb":16512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3a","version":"254'106","reported_seq":815,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:21.743290+0000","last_change":"2024-06-04T15:52:38.483661+0000","last_active":"2024-06-04T16:18:21.743290+0000","last_peered":"2024-06-04T16:18:21.743290+0000","last_clean":"2024-06-04T16:18:21.743290+0000","last_became_active":"2024-06-04T15:52:38.483240+0000","last_became_peered":"2024-06-04T15:52:38.483240+0000","last_unstale":"2024-06-04T16:18:21.743290+0000","last_undegraded":"2024-06-04T16:18:21.743290+0000","last_fullsized":"2024-06-04T16:18:21.743290+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T19:59:20.609915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":515,"num_read_kb":482,"num_write":131,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"254'78","reported_seq":580,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:45.004714+0000","last_change":"2024-06-04T15:52:36.478336+0000","last_active":"2024-06-04T16:18:45.004714+0000","last_peered":"2024-06-04T16:18:45.004714+0000","last_clean":"2024-06-04T16:18:45.004714+0000","last_became_active":"2024-06-04T15:52:36.476981+0000","last_became_peered":"2024-06-04T15:52:36.476981+0000","last_unstale":"2024-06-04T16:18:45.004714+0000","last_undegraded":"2024-06-04T16:18:45.004714+0000","last_fullsized":"2024-06-04T16:18:45.004714+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T03:49:16.011063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":3145,"num_write":255,"num_write_kb":33835,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"254'148","reported_seq":1034,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:13.033398+0000","last_change":"2024-06-04T15:52:38.481259+0000","last_active":"2024-06-04T16:18:13.033398+0000","last_peered":"2024-06-04T16:18:13.033398+0000","last_clean":"2024-06-04T16:18:13.033398+0000","last_became_active":"2024-06-04T15:52:38.480986+0000","last_became_peered":"2024-06-04T15:52:38.480986+0000","last_unstale":"2024-06-04T16:18:13.033398+0000","last_undegraded":"2024-06-04T16:18:13.033398+0000","last_fullsized":"2024-06-04T16:18:13.033398+0000","mapping_epoch":23,"log_start":"251'100","ondisk_log_start":"251'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":100,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T20:30:59.524702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1072,"num_read_kb":1014,"num_write":195,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"251'46","reported_seq":555,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:17:39.997274+0000","last_change":"2024-06-04T15:52:36.495855+0000","last_active":"2024-06-04T16:17:39.997274+0000","last_peered":"2024-06-04T16:17:39.997274+0000","last_clean":"2024-06-04T16:17:39.997274+0000","last_became_active":"2024-06-04T15:52:36.495401+0000","last_became_peered":"2024-06-04T15:52:36.495401+0000","last_unstale":"2024-06-04T16:17:39.997274+0000","last_undegraded":"2024-06-04T16:17:39.997274+0000","last_fullsized":"2024-06-04T16:17:39.997274+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T01:05:31.416932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":89,"num_read_kb":6218,"num_write":199,"num_write_kb":11815,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"254'157","reported_seq":1084,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:45.004252+0000","last_change":"2024-06-04T15:52:38.485154+0000","last_active":"2024-06-04T16:18:45.004252+0000","last_peered":"2024-06-04T16:18:45.004252+0000","last_clean":"2024-06-04T16:18:45.004252+0000","last_became_active":"2024-06-04T15:52:38.484828+0000","last_became_peered":"2024-06-04T15:52:38.484828+0000","last_unstale":"2024-06-04T16:18:45.004252+0000","last_undegraded":"2024-06-04T16:18:45.004252+0000","last_fullsized":"2024-06-04T16:18:45.004252+0000","mapping_epoch":23,"log_start":"251'100","ondisk_log_start":"251'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":100,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T01:49:03.366763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1071,"num_read_kb":1008,"num_write":198,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"254'59","reported_seq":567,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:16.067282+0000","last_change":"2024-06-04T15:52:36.478124+0000","last_active":"2024-06-04T16:18:16.067282+0000","last_peered":"2024-06-04T16:18:16.067282+0000","last_clean":"2024-06-04T16:18:16.067282+0000","last_became_active":"2024-06-04T15:52:36.476167+0000","last_became_peered":"2024-06-04T15:52:36.476167+0000","last_unstale":"2024-06-04T16:18:16.067282+0000","last_undegraded":"2024-06-04T16:18:16.067282+0000","last_fullsized":"2024-06-04T16:18:16.067282+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T02:56:27.227183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242893,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":85,"num_read_kb":1095,"num_write":234,"num_write_kb":40818,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,7],"acting":[2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"254'99","reported_seq":811,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:45.010161+0000","last_change":"2024-06-04T15:52:38.483365+0000","last_active":"2024-06-04T16:19:45.010161+0000","last_peered":"2024-06-04T16:19:45.010161+0000","last_clean":"2024-06-04T16:19:45.010161+0000","last_became_active":"2024-06-04T15:52:38.482025+0000","last_became_peered":"2024-06-04T15:52:38.482025+0000","last_unstale":"2024-06-04T16:19:45.010161+0000","last_undegraded":"2024-06-04T16:19:45.010161+0000","last_fullsized":"2024-06-04T16:19:45.010161+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T01:15:41.149861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":511,"num_read_kb":478,"num_write":121,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.39","version":"251'54","reported_seq":548,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:17:39.997184+0000","last_change":"2024-06-04T15:52:36.493350+0000","last_active":"2024-06-04T16:17:39.997184+0000","last_peered":"2024-06-04T16:17:39.997184+0000","last_clean":"2024-06-04T16:17:39.997184+0000","last_became_active":"2024-06-04T15:52:36.493029+0000","last_became_peered":"2024-06-04T15:52:36.493029+0000","last_unstale":"2024-06-04T16:17:39.997184+0000","last_undegraded":"2024-06-04T16:17:39.997184+0000","last_fullsized":"2024-06-04T16:17:39.997184+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T23:35:25.665201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194343,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":48,"num_read_kb":7228,"num_write":201,"num_write_kb":32271,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,1],"acting":[0,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"254'135","reported_seq":1097,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:45.010727+0000","last_change":"2024-06-04T15:52:38.481762+0000","last_active":"2024-06-04T16:19:45.010727+0000","last_peered":"2024-06-04T16:19:45.010727+0000","last_clean":"2024-06-04T16:19:45.010727+0000","last_became_active":"2024-06-04T15:52:38.481269+0000","last_became_peered":"2024-06-04T15:52:38.481269+0000","last_unstale":"2024-06-04T16:19:45.010727+0000","last_undegraded":"2024-06-04T16:19:45.010727+0000","last_fullsized":"2024-06-04T16:19:45.010727+0000","mapping_epoch":23,"log_start":"251'100","ondisk_log_start":"251'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":100,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T19:02:25.732077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":974,"num_read_kb":946,"num_write":155,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"254'71","reported_seq":657,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:21.398271+0000","last_change":"2024-06-04T15:52:36.494149+0000","last_active":"2024-06-04T16:18:21.398271+0000","last_peered":"2024-06-04T16:18:21.398271+0000","last_clean":"2024-06-04T16:18:21.398271+0000","last_became_active":"2024-06-04T15:52:36.493867+0000","last_became_peered":"2024-06-04T15:52:36.493867+0000","last_unstale":"2024-06-04T16:18:21.398271+0000","last_undegraded":"2024-06-04T16:18:21.398271+0000","last_fullsized":"2024-06-04T16:18:21.398271+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T01:19:36.101046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194320,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":320,"num_read_kb":135435,"num_write":258,"num_write_kb":39309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3],"acting":[5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3f","version":"254'142","reported_seq":980,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:45.018547+0000","last_change":"2024-06-04T15:52:38.487423+0000","last_active":"2024-06-04T16:19:45.018547+0000","last_peered":"2024-06-04T16:19:45.018547+0000","last_clean":"2024-06-04T16:19:45.018547+0000","last_became_active":"2024-06-04T15:52:38.486625+0000","last_became_peered":"2024-06-04T15:52:38.486625+0000","last_unstale":"2024-06-04T16:19:45.018547+0000","last_undegraded":"2024-06-04T16:19:45.018547+0000","last_fullsized":"2024-06-04T16:19:45.018547+0000","mapping_epoch":23,"log_start":"251'100","ondisk_log_start":"251'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T20:53:48.231763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":899,"num_read_kb":839,"num_write":184,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.30","version":"254'110","reported_seq":836,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:21.348186+0000","last_change":"2024-06-04T15:52:38.479433+0000","last_active":"2024-06-04T16:18:21.348186+0000","last_peered":"2024-06-04T16:18:21.348186+0000","last_clean":"2024-06-04T16:18:21.348186+0000","last_became_active":"2024-06-04T15:52:38.479148+0000","last_became_peered":"2024-06-04T15:52:38.479148+0000","last_unstale":"2024-06-04T16:18:21.348186+0000","last_undegraded":"2024-06-04T16:18:21.348186+0000","last_fullsized":"2024-06-04T16:18:21.348186+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T00:01:16.709017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":546,"num_read_kb":515,"num_write":127,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"251'65","reported_seq":589,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:15.117942+0000","last_change":"2024-06-04T15:52:36.493388+0000","last_active":"2024-06-04T16:19:15.117942+0000","last_peered":"2024-06-04T16:19:15.117942+0000","last_clean":"2024-06-04T16:19:15.117942+0000","last_became_active":"2024-06-04T15:52:36.493062+0000","last_became_peered":"2024-06-04T15:52:36.493062+0000","last_unstale":"2024-06-04T16:19:15.117942+0000","last_undegraded":"2024-06-04T16:19:15.117942+0000","last_fullsized":"2024-06-04T16:19:15.117942+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T00:24:36.348212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194345,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":95,"num_read_kb":64250,"num_write":262,"num_write_kb":45332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,5],"acting":[1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"254'69","reported_seq":736,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:22.735079+0000","last_change":"2024-06-04T15:52:38.486683+0000","last_active":"2024-06-04T16:18:22.735079+0000","last_peered":"2024-06-04T16:18:22.735079+0000","last_clean":"2024-06-04T16:18:22.735079+0000","last_became_active":"2024-06-04T15:52:38.486413+0000","last_became_peered":"2024-06-04T15:52:38.486413+0000","last_unstale":"2024-06-04T16:18:22.735079+0000","last_undegraded":"2024-06-04T16:18:22.735079+0000","last_fullsized":"2024-06-04T16:18:22.735079+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T18:14:24.428815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":395,"num_read_kb":379,"num_write":76,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"251'60","reported_seq":570,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:15.007208+0000","last_change":"2024-06-04T15:52:36.494165+0000","last_active":"2024-06-04T16:19:15.007208+0000","last_peered":"2024-06-04T16:19:15.007208+0000","last_clean":"2024-06-04T16:19:15.007208+0000","last_became_active":"2024-06-04T15:52:36.493235+0000","last_became_peered":"2024-06-04T15:52:36.493235+0000","last_unstale":"2024-06-04T16:19:15.007208+0000","last_undegraded":"2024-06-04T16:19:15.007208+0000","last_fullsized":"2024-06-04T16:19:15.007208+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T19:10:07.674104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5327983,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":73,"num_read_kb":3706,"num_write":207,"num_write_kb":43313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"254'95","reported_seq":809,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:20.111811+0000","last_change":"2024-06-04T15:52:38.482371+0000","last_active":"2024-06-04T16:18:20.111811+0000","last_peered":"2024-06-04T16:18:20.111811+0000","last_clean":"2024-06-04T16:18:20.111811+0000","last_became_active":"2024-06-04T15:52:38.482120+0000","last_became_peered":"2024-06-04T15:52:38.482120+0000","last_unstale":"2024-06-04T16:18:20.111811+0000","last_undegraded":"2024-06-04T16:18:20.111811+0000","last_fullsized":"2024-06-04T16:18:20.111811+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T22:42:27.529034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":518,"num_read_kb":488,"num_write":107,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"251'41","reported_seq":556,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:15.007194+0000","last_change":"2024-06-04T15:53:14.839799+0000","last_active":"2024-06-04T16:19:15.007194+0000","last_peered":"2024-06-04T16:19:15.007194+0000","last_clean":"2024-06-04T16:19:15.007194+0000","last_became_active":"2024-06-04T15:53:14.839433+0000","last_became_peered":"2024-06-04T15:53:14.839433+0000","last_unstale":"2024-06-04T16:19:15.007194+0000","last_undegraded":"2024-06-04T16:19:15.007194+0000","last_fullsized":"2024-06-04T16:19:15.007194+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T18:08:08.559997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3420297,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":73,"num_read_kb":2132,"num_write":160,"num_write_kb":20015,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"254'143","reported_seq":931,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:15.013248+0000","last_change":"2024-06-04T15:52:38.482165+0000","last_active":"2024-06-04T16:19:15.013248+0000","last_peered":"2024-06-04T16:19:15.013248+0000","last_clean":"2024-06-04T16:19:15.013248+0000","last_became_active":"2024-06-04T15:52:38.480996+0000","last_became_peered":"2024-06-04T15:52:38.480996+0000","last_unstale":"2024-06-04T16:19:15.013248+0000","last_undegraded":"2024-06-04T16:19:15.013248+0000","last_fullsized":"2024-06-04T16:19:15.013248+0000","mapping_epoch":23,"log_start":"251'100","ondisk_log_start":"251'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":100,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T21:42:09.132143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":760,"num_read_kb":703,"num_write":184,"num_write_kb":47,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"251'68","reported_seq":578,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:15.007156+0000","last_change":"2024-06-04T15:52:36.488619+0000","last_active":"2024-06-04T16:19:15.007156+0000","last_peered":"2024-06-04T16:19:15.007156+0000","last_clean":"2024-06-04T16:19:15.007156+0000","last_became_active":"2024-06-04T15:52:36.486264+0000","last_became_peered":"2024-06-04T15:52:36.486264+0000","last_unstale":"2024-06-04T16:19:15.007156+0000","last_undegraded":"2024-06-04T16:19:15.007156+0000","last_fullsized":"2024-06-04T16:19:15.007156+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T23:40:03.292201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5328001,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":104,"num_read_kb":2209,"num_write":245,"num_write_kb":31585,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,7],"acting":[0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"254'109","reported_seq":990,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:15.014440+0000","last_change":"2024-06-04T15:52:38.488655+0000","last_active":"2024-06-04T16:19:15.014440+0000","last_peered":"2024-06-04T16:19:15.014440+0000","last_clean":"2024-06-04T16:19:15.014440+0000","last_became_active":"2024-06-04T15:52:38.488389+0000","last_became_peered":"2024-06-04T15:52:38.488389+0000","last_unstale":"2024-06-04T16:19:15.014440+0000","last_undegraded":"2024-06-04T16:19:15.014440+0000","last_fullsized":"2024-06-04T16:19:15.014440+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T00:42:51.636081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":949,"num_read_kb":919,"num_write":126,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.33","version":"254'49","reported_seq":550,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:15.013215+0000","last_change":"2024-06-04T15:52:36.498842+0000","last_active":"2024-06-04T16:19:15.013215+0000","last_peered":"2024-06-04T16:19:15.013215+0000","last_clean":"2024-06-04T16:19:15.013215+0000","last_became_active":"2024-06-04T15:52:36.498488+0000","last_became_peered":"2024-06-04T15:52:36.498488+0000","last_unstale":"2024-06-04T16:19:15.013215+0000","last_undegraded":"2024-06-04T16:19:15.013215+0000","last_fullsized":"2024-06-04T16:19:15.013215+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T21:29:00.145911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10655914,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":70,"num_read_kb":20343,"num_write":206,"num_write_kb":26780,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,4],"acting":[6,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.35","version":"254'139","reported_seq":926,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:15.117908+0000","last_change":"2024-06-04T15:52:38.486364+0000","last_active":"2024-06-04T16:19:15.117908+0000","last_peered":"2024-06-04T16:19:15.117908+0000","last_clean":"2024-06-04T16:19:15.117908+0000","last_became_active":"2024-06-04T15:52:38.486108+0000","last_became_peered":"2024-06-04T15:52:38.486108+0000","last_unstale":"2024-06-04T16:19:15.117908+0000","last_undegraded":"2024-06-04T16:19:15.117908+0000","last_fullsized":"2024-06-04T16:19:15.117908+0000","mapping_epoch":23,"log_start":"251'100","ondisk_log_start":"251'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":100,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T03:22:09.822966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":692,"num_read_kb":648,"num_write":164,"num_write_kb":35,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"254'35","reported_seq":525,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:25.006760+0000","last_change":"2024-06-04T15:52:36.481363+0000","last_active":"2024-06-04T16:18:25.006760+0000","last_peered":"2024-06-04T16:18:25.006760+0000","last_clean":"2024-06-04T16:18:25.006760+0000","last_became_active":"2024-06-04T15:52:36.481047+0000","last_became_peered":"2024-06-04T15:52:36.481047+0000","last_unstale":"2024-06-04T16:18:25.006760+0000","last_undegraded":"2024-06-04T16:18:25.006760+0000","last_fullsized":"2024-06-04T16:18:25.006760+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T21:52:41.102618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048602,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":41,"num_read_kb":41,"num_write":148,"num_write_kb":21263,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4],"acting":[6,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.18","version":"254'36","reported_seq":518,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:25.008099+0000","last_change":"2024-06-04T15:52:46.537761+0000","last_active":"2024-06-04T16:19:25.008099+0000","last_peered":"2024-06-04T16:19:25.008099+0000","last_clean":"2024-06-04T16:19:25.008099+0000","last_became_active":"2024-06-04T15:52:46.536608+0000","last_became_peered":"2024-06-04T15:52:46.536608+0000","last_unstale":"2024-06-04T16:19:25.008099+0000","last_undegraded":"2024-06-04T16:19:25.008099+0000","last_fullsized":"2024-06-04T16:19:25.008099+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:45.513877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:45.513877+0000","last_clean_scrub_stamp":"2024-06-04T15:52:45.513877+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T02:19:23.902475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":81,"num_read_kb":72,"num_write":87,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"254'110","reported_seq":831,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:25.006864+0000","last_change":"2024-06-04T15:52:38.477338+0000","last_active":"2024-06-04T16:18:25.006864+0000","last_peered":"2024-06-04T16:18:25.006864+0000","last_clean":"2024-06-04T16:18:25.006864+0000","last_became_active":"2024-06-04T15:52:38.477052+0000","last_became_peered":"2024-06-04T15:52:38.477052+0000","last_unstale":"2024-06-04T16:18:25.006864+0000","last_undegraded":"2024-06-04T16:18:25.006864+0000","last_fullsized":"2024-06-04T16:18:25.006864+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T20:39:40.247365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":560,"num_read_kb":523,"num_write":129,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.13","version":"254'52","reported_seq":553,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:21.323198+0000","last_change":"2024-06-04T15:52:36.499588+0000","last_active":"2024-06-04T16:18:21.323198+0000","last_peered":"2024-06-04T16:18:21.323198+0000","last_clean":"2024-06-04T16:18:21.323198+0000","last_became_active":"2024-06-04T15:52:36.499305+0000","last_became_peered":"2024-06-04T15:52:36.499305+0000","last_unstale":"2024-06-04T16:18:21.323198+0000","last_undegraded":"2024-06-04T16:18:21.323198+0000","last_fullsized":"2024-06-04T16:18:21.323198+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T20:07:01.696465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194320,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":75,"num_read_kb":3024,"num_write":196,"num_write_kb":28071,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":473,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:15.011753+0000","last_change":"2024-06-04T15:52:40.477030+0000","last_active":"2024-06-04T16:19:15.011753+0000","last_peered":"2024-06-04T16:19:15.011753+0000","last_clean":"2024-06-04T16:19:15.011753+0000","last_became_active":"2024-06-04T15:52:40.476730+0000","last_became_peered":"2024-06-04T15:52:40.476730+0000","last_unstale":"2024-06-04T16:19:15.011753+0000","last_undegraded":"2024-06-04T16:19:15.011753+0000","last_fullsized":"2024-06-04T16:19:15.011753+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_clean_scrub_stamp":"2024-06-04T15:52:39.463103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T00:40:38.064778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"254'140","reported_seq":707,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:21:45.035704+0000","last_change":"2024-06-04T15:52:42.504168+0000","last_active":"2024-06-04T16:21:45.035704+0000","last_peered":"2024-06-04T16:21:45.035704+0000","last_clean":"2024-06-04T16:21:45.035704+0000","last_became_active":"2024-06-04T15:52:42.503184+0000","last_became_peered":"2024-06-04T15:52:42.503184+0000","last_unstale":"2024-06-04T16:21:45.035704+0000","last_undegraded":"2024-06-04T16:21:45.035704+0000","last_fullsized":"2024-06-04T16:21:45.035704+0000","mapping_epoch":27,"log_start":"251'100","ondisk_log_start":"251'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_clean_scrub_stamp":"2024-06-04T15:52:41.476734+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":100,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T01:21:16.208347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4406,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":201,"num_read_kb":195,"num_write":108,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":468,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:20.118447+0000","last_change":"2024-06-04T15:52:44.513719+0000","last_active":"2024-06-04T16:19:20.118447+0000","last_peered":"2024-06-04T16:19:20.118447+0000","last_clean":"2024-06-04T16:19:20.118447+0000","last_became_active":"2024-06-04T15:52:44.513442+0000","last_became_peered":"2024-06-04T15:52:44.513442+0000","last_unstale":"2024-06-04T16:19:20.118447+0000","last_undegraded":"2024-06-04T16:19:20.118447+0000","last_fullsized":"2024-06-04T16:19:20.118447+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_clean_scrub_stamp":"2024-06-04T15:52:43.492872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T02:42:56.959694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"254'145","reported_seq":705,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:21:50.133713+0000","last_change":"2024-06-04T15:52:46.540252+0000","last_active":"2024-06-04T16:21:50.133713+0000","last_peered":"2024-06-04T16:21:50.133713+0000","last_clean":"2024-06-04T16:21:50.133713+0000","last_became_active":"2024-06-04T15:52:46.539957+0000","last_became_peered":"2024-06-04T15:52:46.539957+0000","last_unstale":"2024-06-04T16:21:50.133713+0000","last_undegraded":"2024-06-04T16:21:50.133713+0000","last_fullsized":"2024-06-04T16:21:50.133713+0000","mapping_epoch":31,"log_start":"254'100","ondisk_log_start":"254'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:45.513877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:45.513877+0000","last_clean_scrub_stamp":"2024-06-04T15:52:45.513877+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":100,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T02:03:12.091974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":399,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":346,"num_read_kb":345,"num_write":304,"num_write_kb":102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"254'154","reported_seq":837,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:15.011739+0000","last_change":"2024-06-04T15:52:38.483869+0000","last_active":"2024-06-04T16:19:15.011739+0000","last_peered":"2024-06-04T16:19:15.011739+0000","last_clean":"2024-06-04T16:19:15.011739+0000","last_became_active":"2024-06-04T15:52:38.483516+0000","last_became_peered":"2024-06-04T15:52:38.483516+0000","last_unstale":"2024-06-04T16:19:15.011739+0000","last_undegraded":"2024-06-04T16:19:15.011739+0000","last_fullsized":"2024-06-04T16:19:15.011739+0000","mapping_epoch":23,"log_start":"251'100","ondisk_log_start":"251'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":100,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T00:51:21.910421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":841,"num_read_kb":740,"num_write":235,"num_write_kb":95,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"254'66","reported_seq":578,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:22.713104+0000","last_change":"2024-06-04T15:52:36.481412+0000","last_active":"2024-06-04T16:18:22.713104+0000","last_peered":"2024-06-04T16:18:22.713104+0000","last_clean":"2024-06-04T16:18:22.713104+0000","last_became_active":"2024-06-04T15:52:36.481099+0000","last_became_peered":"2024-06-04T15:52:36.481099+0000","last_unstale":"2024-06-04T16:18:22.713104+0000","last_undegraded":"2024-06-04T16:18:22.713104+0000","last_fullsized":"2024-06-04T16:18:22.713104+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T21:45:28.619709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133687,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":119,"num_read_kb":2903,"num_write":273,"num_write_kb":32792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,7],"acting":[6,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":474,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:25.007271+0000","last_change":"2024-06-04T15:52:40.479746+0000","last_active":"2024-06-04T16:18:25.007271+0000","last_peered":"2024-06-04T16:18:25.007271+0000","last_clean":"2024-06-04T16:18:25.007271+0000","last_became_active":"2024-06-04T15:52:40.479483+0000","last_became_peered":"2024-06-04T15:52:40.479483+0000","last_unstale":"2024-06-04T16:18:25.007271+0000","last_undegraded":"2024-06-04T16:18:25.007271+0000","last_fullsized":"2024-06-04T16:18:25.007271+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_clean_scrub_stamp":"2024-06-04T15:52:39.463103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T23:55:25.989646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"254'51","reported_seq":547,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:20.118437+0000","last_change":"2024-06-04T15:52:42.503739+0000","last_active":"2024-06-04T16:19:20.118437+0000","last_peered":"2024-06-04T16:19:20.118437+0000","last_clean":"2024-06-04T16:19:20.118437+0000","last_became_active":"2024-06-04T15:52:42.503451+0000","last_became_peered":"2024-06-04T15:52:42.503451+0000","last_unstale":"2024-06-04T16:19:20.118437+0000","last_undegraded":"2024-06-04T16:19:20.118437+0000","last_fullsized":"2024-06-04T16:19:20.118437+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_clean_scrub_stamp":"2024-06-04T15:52:41.476734+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T02:51:35.526591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":72,"num_read_kb":67,"num_write":48,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":468,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:20.118406+0000","last_change":"2024-06-04T15:52:44.518997+0000","last_active":"2024-06-04T16:19:20.118406+0000","last_peered":"2024-06-04T16:19:20.118406+0000","last_clean":"2024-06-04T16:19:20.118406+0000","last_became_active":"2024-06-04T15:52:44.517614+0000","last_became_peered":"2024-06-04T15:52:44.517614+0000","last_unstale":"2024-06-04T16:19:20.118406+0000","last_undegraded":"2024-06-04T16:19:20.118406+0000","last_fullsized":"2024-06-04T16:19:20.118406+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_clean_scrub_stamp":"2024-06-04T15:52:43.492872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T00:18:35.417836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"254'22","reported_seq":496,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:15.940519+0000","last_change":"2024-06-04T15:52:46.535843+0000","last_active":"2024-06-04T16:18:15.940519+0000","last_peered":"2024-06-04T16:18:15.940519+0000","last_clean":"2024-06-04T16:18:15.940519+0000","last_became_active":"2024-06-04T15:52:46.535498+0000","last_became_peered":"2024-06-04T15:52:46.535498+0000","last_unstale":"2024-06-04T16:18:15.940519+0000","last_undegraded":"2024-06-04T16:18:15.940519+0000","last_fullsized":"2024-06-04T16:18:15.940519+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:45.513877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:45.513877+0000","last_clean_scrub_stamp":"2024-06-04T15:52:45.513877+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T19:56:52.936990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":432,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":50,"num_read_kb":48,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"254'95","reported_seq":835,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:15.014486+0000","last_change":"2024-06-04T15:52:38.486919+0000","last_active":"2024-06-04T16:19:15.014486+0000","last_peered":"2024-06-04T16:19:15.014486+0000","last_clean":"2024-06-04T16:19:15.014486+0000","last_became_active":"2024-06-04T15:52:38.486612+0000","last_became_peered":"2024-06-04T15:52:38.486612+0000","last_unstale":"2024-06-04T16:19:15.014486+0000","last_undegraded":"2024-06-04T16:19:15.014486+0000","last_fullsized":"2024-06-04T16:19:15.014486+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T17:15:27.232127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":567,"num_read_kb":536,"num_write":113,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"254'35","reported_seq":523,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:20.005264+0000","last_change":"2024-06-04T15:52:36.487317+0000","last_active":"2024-06-04T16:18:20.005264+0000","last_peered":"2024-06-04T16:18:20.005264+0000","last_clean":"2024-06-04T16:18:20.005264+0000","last_became_active":"2024-06-04T15:52:36.486999+0000","last_became_peered":"2024-06-04T15:52:36.486999+0000","last_unstale":"2024-06-04T16:18:20.005264+0000","last_undegraded":"2024-06-04T16:18:20.005264+0000","last_fullsized":"2024-06-04T16:18:20.005264+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T20:36:12.625291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7340071,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":6159,"num_write":132,"num_write_kb":22820,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":474,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:15.013835+0000","last_change":"2024-06-04T15:52:40.485408+0000","last_active":"2024-06-04T16:19:15.013835+0000","last_peered":"2024-06-04T16:19:15.013835+0000","last_clean":"2024-06-04T16:19:15.013835+0000","last_became_active":"2024-06-04T15:52:40.484711+0000","last_became_peered":"2024-06-04T15:52:40.484711+0000","last_unstale":"2024-06-04T16:19:15.013835+0000","last_undegraded":"2024-06-04T16:19:15.013835+0000","last_fullsized":"2024-06-04T16:19:15.013835+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_clean_scrub_stamp":"2024-06-04T15:52:39.463103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T18:42:17.207481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"251'65","reported_seq":565,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:30.007950+0000","last_change":"2024-06-04T15:52:42.501609+0000","last_active":"2024-06-04T16:18:30.007950+0000","last_peered":"2024-06-04T16:18:30.007950+0000","last_clean":"2024-06-04T16:18:30.007950+0000","last_became_active":"2024-06-04T15:52:42.501248+0000","last_became_peered":"2024-06-04T15:52:42.501248+0000","last_unstale":"2024-06-04T16:18:30.007950+0000","last_undegraded":"2024-06-04T16:18:30.007950+0000","last_fullsized":"2024-06-04T16:18:30.007950+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_clean_scrub_stamp":"2024-06-04T15:52:41.476734+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T02:21:04.282188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":90,"num_read_kb":83,"num_write":60,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.15","version":"254'462","reported_seq":1496,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:32.409857+0000","last_change":"2024-06-04T15:52:44.523497+0000","last_active":"2024-06-04T16:22:32.409857+0000","last_peered":"2024-06-04T16:22:32.409857+0000","last_clean":"2024-06-04T16:22:32.409857+0000","last_became_active":"2024-06-04T15:52:44.523138+0000","last_became_peered":"2024-06-04T15:52:44.523138+0000","last_unstale":"2024-06-04T16:22:32.409857+0000","last_undegraded":"2024-06-04T16:22:32.409857+0000","last_fullsized":"2024-06-04T16:22:32.409857+0000","mapping_epoch":29,"log_start":"251'400","ondisk_log_start":"251'400","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_clean_scrub_stamp":"2024-06-04T15:52:43.492872+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":400,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T16:19:32.818463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"254'37","reported_seq":504,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:21.699674+0000","last_change":"2024-06-04T15:52:46.532424+0000","last_active":"2024-06-04T16:18:21.699674+0000","last_peered":"2024-06-04T16:18:21.699674+0000","last_clean":"2024-06-04T16:18:21.699674+0000","last_became_active":"2024-06-04T15:52:46.532141+0000","last_became_peered":"2024-06-04T15:52:46.532141+0000","last_unstale":"2024-06-04T16:18:21.699674+0000","last_undegraded":"2024-06-04T16:18:21.699674+0000","last_fullsized":"2024-06-04T16:18:21.699674+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:45.513877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:45.513877+0000","last_clean_scrub_stamp":"2024-06-04T15:52:45.513877+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T17:04:53.931942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":56,"num_read_kb":50,"num_write":85,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"254'146","reported_seq":978,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:15.014528+0000","last_change":"2024-06-04T15:52:38.490123+0000","last_active":"2024-06-04T16:19:15.014528+0000","last_peered":"2024-06-04T16:19:15.014528+0000","last_clean":"2024-06-04T16:19:15.014528+0000","last_became_active":"2024-06-04T15:52:38.489719+0000","last_became_peered":"2024-06-04T15:52:38.489719+0000","last_unstale":"2024-06-04T16:19:15.014528+0000","last_undegraded":"2024-06-04T16:19:15.014528+0000","last_fullsized":"2024-06-04T16:19:15.014528+0000","mapping_epoch":23,"log_start":"251'100","ondisk_log_start":"251'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":100,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T20:50:26.159996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":798,"num_read_kb":751,"num_write":172,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"254'47","reported_seq":555,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:20.111775+0000","last_change":"2024-06-04T15:52:36.483313+0000","last_active":"2024-06-04T16:18:20.111775+0000","last_peered":"2024-06-04T16:18:20.111775+0000","last_clean":"2024-06-04T16:18:20.111775+0000","last_became_active":"2024-06-04T15:52:36.482920+0000","last_became_peered":"2024-06-04T15:52:36.482920+0000","last_unstale":"2024-06-04T16:18:20.111775+0000","last_undegraded":"2024-06-04T16:18:20.111775+0000","last_fullsized":"2024-06-04T16:18:20.111775+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T17:11:29.371432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1069231,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":86,"num_read_kb":13402,"num_write":212,"num_write_kb":21907,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3],"acting":[1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":473,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:15.011771+0000","last_change":"2024-06-04T15:52:40.482578+0000","last_active":"2024-06-04T16:19:15.011771+0000","last_peered":"2024-06-04T16:19:15.011771+0000","last_clean":"2024-06-04T16:19:15.011771+0000","last_became_active":"2024-06-04T15:52:40.482288+0000","last_became_peered":"2024-06-04T15:52:40.482288+0000","last_unstale":"2024-06-04T16:19:15.011771+0000","last_undegraded":"2024-06-04T16:19:15.011771+0000","last_fullsized":"2024-06-04T16:19:15.011771+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_clean_scrub_stamp":"2024-06-04T15:52:39.463103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T01:57:16.365165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"254'85","reported_seq":618,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:21:45.024430+0000","last_change":"2024-06-04T15:52:42.503565+0000","last_active":"2024-06-04T16:21:45.024430+0000","last_peered":"2024-06-04T16:21:45.024430+0000","last_clean":"2024-06-04T16:21:45.024430+0000","last_became_active":"2024-06-04T15:52:42.503282+0000","last_became_peered":"2024-06-04T15:52:42.503282+0000","last_unstale":"2024-06-04T16:21:45.024430+0000","last_undegraded":"2024-06-04T16:21:45.024430+0000","last_fullsized":"2024-06-04T16:21:45.024430+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_clean_scrub_stamp":"2024-06-04T15:52:41.476734+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T16:54:37.102368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6020,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":130,"num_read_kb":184,"num_write":62,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"254'475","reported_seq":1571,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:32.413980+0000","last_change":"2024-06-04T15:52:44.520464+0000","last_active":"2024-06-04T16:22:32.413980+0000","last_peered":"2024-06-04T16:22:32.413980+0000","last_clean":"2024-06-04T16:22:32.413980+0000","last_became_active":"2024-06-04T15:52:44.518724+0000","last_became_peered":"2024-06-04T15:52:44.518724+0000","last_unstale":"2024-06-04T16:22:32.413980+0000","last_undegraded":"2024-06-04T16:22:32.413980+0000","last_fullsized":"2024-06-04T16:22:32.413980+0000","mapping_epoch":29,"log_start":"251'400","ondisk_log_start":"251'400","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_clean_scrub_stamp":"2024-06-04T15:52:43.492872+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":400,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T21:27:12.445604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"254'113","reported_seq":799,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:40.007714+0000","last_change":"2024-06-04T15:52:38.479210+0000","last_active":"2024-06-04T16:18:40.007714+0000","last_peered":"2024-06-04T16:18:40.007714+0000","last_clean":"2024-06-04T16:18:40.007714+0000","last_became_active":"2024-06-04T15:52:38.478886+0000","last_became_peered":"2024-06-04T15:52:38.478886+0000","last_unstale":"2024-06-04T16:18:40.007714+0000","last_undegraded":"2024-06-04T16:18:40.007714+0000","last_fullsized":"2024-06-04T16:18:40.007714+0000","mapping_epoch":23,"log_start":"251'100","ondisk_log_start":"251'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":100,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T02:04:11.671915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":534,"num_read_kb":483,"num_write":137,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"251'58","reported_seq":536,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:20:20.023086+0000","last_change":"2024-06-04T15:53:14.838688+0000","last_active":"2024-06-04T16:20:20.023086+0000","last_peered":"2024-06-04T16:20:20.023086+0000","last_clean":"2024-06-04T16:20:20.023086+0000","last_became_active":"2024-06-04T15:53:14.838259+0000","last_became_peered":"2024-06-04T15:53:14.838259+0000","last_unstale":"2024-06-04T16:20:20.023086+0000","last_undegraded":"2024-06-04T16:20:20.023086+0000","last_fullsized":"2024-06-04T16:20:20.023086+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T21:50:47.794603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":105,"num_read_kb":3164,"num_write":221,"num_write_kb":9993,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,4],"acting":[6,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":477,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:40.113833+0000","last_change":"2024-06-04T15:52:40.484123+0000","last_active":"2024-06-04T16:18:40.113833+0000","last_peered":"2024-06-04T16:18:40.113833+0000","last_clean":"2024-06-04T16:18:40.113833+0000","last_became_active":"2024-06-04T15:52:40.483832+0000","last_became_peered":"2024-06-04T15:52:40.483832+0000","last_unstale":"2024-06-04T16:18:40.113833+0000","last_undegraded":"2024-06-04T16:18:40.113833+0000","last_fullsized":"2024-06-04T16:18:40.113833+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_clean_scrub_stamp":"2024-06-04T15:52:39.463103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T17:49:38.147326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"254'137","reported_seq":705,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:21:00.017591+0000","last_change":"2024-06-04T15:52:42.504594+0000","last_active":"2024-06-04T16:21:00.017591+0000","last_peered":"2024-06-04T16:21:00.017591+0000","last_clean":"2024-06-04T16:21:00.017591+0000","last_became_active":"2024-06-04T15:52:42.504217+0000","last_became_peered":"2024-06-04T15:52:42.504217+0000","last_unstale":"2024-06-04T16:21:00.017591+0000","last_undegraded":"2024-06-04T16:21:00.017591+0000","last_fullsized":"2024-06-04T16:21:00.017591+0000","mapping_epoch":27,"log_start":"251'100","ondisk_log_start":"251'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_clean_scrub_stamp":"2024-06-04T15:52:41.476734+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":100,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T15:59:45.129536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":210,"num_read_kb":249,"num_write":114,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":463,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:45.017624+0000","last_change":"2024-06-04T15:52:44.520621+0000","last_active":"2024-06-04T16:19:45.017624+0000","last_peered":"2024-06-04T16:19:45.017624+0000","last_clean":"2024-06-04T16:19:45.017624+0000","last_became_active":"2024-06-04T15:52:44.520358+0000","last_became_peered":"2024-06-04T15:52:44.520358+0000","last_unstale":"2024-06-04T16:19:45.017624+0000","last_undegraded":"2024-06-04T16:19:45.017624+0000","last_fullsized":"2024-06-04T16:19:45.017624+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_clean_scrub_stamp":"2024-06-04T15:52:43.492872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T18:58:46.869583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"254'455","reported_seq":1238,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:32.397946+0000","last_change":"2024-06-04T15:52:46.536753+0000","last_active":"2024-06-04T16:22:32.397946+0000","last_peered":"2024-06-04T16:22:32.397946+0000","last_clean":"2024-06-04T16:22:32.397946+0000","last_became_active":"2024-06-04T15:52:46.536442+0000","last_became_peered":"2024-06-04T15:52:46.536442+0000","last_unstale":"2024-06-04T16:22:32.397946+0000","last_undegraded":"2024-06-04T16:22:32.397946+0000","last_fullsized":"2024-06-04T16:22:32.397946+0000","mapping_epoch":31,"log_start":"251'400","ondisk_log_start":"251'400","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:45.513877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:45.513877+0000","last_clean_scrub_stamp":"2024-06-04T15:52:45.513877+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":400,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T18:31:26.520436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":418,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1197,"num_read_kb":1195,"num_write":937,"num_write_kb":336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"254'122","reported_seq":923,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:40.113848+0000","last_change":"2024-06-04T15:52:38.483443+0000","last_active":"2024-06-04T16:18:40.113848+0000","last_peered":"2024-06-04T16:18:40.113848+0000","last_clean":"2024-06-04T16:18:40.113848+0000","last_became_active":"2024-06-04T15:52:38.483194+0000","last_became_peered":"2024-06-04T15:52:38.483194+0000","last_unstale":"2024-06-04T16:18:40.113848+0000","last_undegraded":"2024-06-04T16:18:40.113848+0000","last_fullsized":"2024-06-04T16:18:40.113848+0000","mapping_epoch":23,"log_start":"251'100","ondisk_log_start":"251'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":100,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T17:17:39.302543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":683,"num_read_kb":649,"num_write":140,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"254'59","reported_seq":590,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:40.010202+0000","last_change":"2024-06-04T15:52:36.486364+0000","last_active":"2024-06-04T16:19:40.010202+0000","last_peered":"2024-06-04T16:19:40.010202+0000","last_clean":"2024-06-04T16:19:40.010202+0000","last_became_active":"2024-06-04T15:52:36.485995+0000","last_became_peered":"2024-06-04T15:52:36.485995+0000","last_unstale":"2024-06-04T16:19:40.010202+0000","last_undegraded":"2024-06-04T16:19:40.010202+0000","last_fullsized":"2024-06-04T16:19:40.010202+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T01:18:14.040577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048681,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":97,"num_read_kb":68665,"num_write":248,"num_write_kb":35943,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":471,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:40.008747+0000","last_change":"2024-06-04T15:52:40.481019+0000","last_active":"2024-06-04T16:18:40.008747+0000","last_peered":"2024-06-04T16:18:40.008747+0000","last_clean":"2024-06-04T16:18:40.008747+0000","last_became_active":"2024-06-04T15:52:40.480714+0000","last_became_peered":"2024-06-04T15:52:40.480714+0000","last_unstale":"2024-06-04T16:18:40.008747+0000","last_undegraded":"2024-06-04T16:18:40.008747+0000","last_fullsized":"2024-06-04T16:18:40.008747+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_clean_scrub_stamp":"2024-06-04T15:52:39.463103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T22:44:29.436328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.b","version":"254'90","reported_seq":626,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:00.037695+0000","last_change":"2024-06-04T15:52:42.505667+0000","last_active":"2024-06-04T16:22:00.037695+0000","last_peered":"2024-06-04T16:22:00.037695+0000","last_clean":"2024-06-04T16:22:00.037695+0000","last_became_active":"2024-06-04T15:52:42.505269+0000","last_became_peered":"2024-06-04T15:52:42.505269+0000","last_unstale":"2024-06-04T16:22:00.037695+0000","last_undegraded":"2024-06-04T16:22:00.037695+0000","last_fullsized":"2024-06-04T16:22:00.037695+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_clean_scrub_stamp":"2024-06-04T15:52:41.476734+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T19:58:57.937812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":121,"num_read_kb":111,"num_write":56,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":467,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:50.010546+0000","last_change":"2024-06-04T15:52:44.522421+0000","last_active":"2024-06-04T16:18:50.010546+0000","last_peered":"2024-06-04T16:18:50.010546+0000","last_clean":"2024-06-04T16:18:50.010546+0000","last_became_active":"2024-06-04T15:52:44.522149+0000","last_became_peered":"2024-06-04T15:52:44.522149+0000","last_unstale":"2024-06-04T16:18:50.010546+0000","last_undegraded":"2024-06-04T16:18:50.010546+0000","last_fullsized":"2024-06-04T16:18:50.010546+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_clean_scrub_stamp":"2024-06-04T15:52:43.492872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T16:56:50.665549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.5","version":"254'29","reported_seq":505,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:55.121954+0000","last_change":"2024-06-04T15:52:46.540795+0000","last_active":"2024-06-04T16:19:55.121954+0000","last_peered":"2024-06-04T16:19:55.121954+0000","last_clean":"2024-06-04T16:19:55.121954+0000","last_became_active":"2024-06-04T15:52:46.540510+0000","last_became_peered":"2024-06-04T15:52:46.540510+0000","last_unstale":"2024-06-04T16:19:55.121954+0000","last_undegraded":"2024-06-04T16:19:55.121954+0000","last_fullsized":"2024-06-04T16:19:55.121954+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:45.513877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:45.513877+0000","last_clean_scrub_stamp":"2024-06-04T15:52:45.513877+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T23:41:51.500895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":51,"num_write":73,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"254'110","reported_seq":875,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:45.004684+0000","last_change":"2024-06-04T15:52:38.480623+0000","last_active":"2024-06-04T16:18:45.004684+0000","last_peered":"2024-06-04T16:18:45.004684+0000","last_clean":"2024-06-04T16:18:45.004684+0000","last_became_active":"2024-06-04T15:52:38.480112+0000","last_became_peered":"2024-06-04T15:52:38.480112+0000","last_unstale":"2024-06-04T16:18:45.004684+0000","last_undegraded":"2024-06-04T16:18:45.004684+0000","last_fullsized":"2024-06-04T16:18:45.004684+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T00:34:50.827504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":725,"num_read_kb":689,"num_write":131,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"251'79","reported_seq":547,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:20:15.022274+0000","last_change":"2024-06-04T15:53:14.838653+0000","last_active":"2024-06-04T16:20:15.022274+0000","last_peered":"2024-06-04T16:20:15.022274+0000","last_clean":"2024-06-04T16:20:15.022274+0000","last_became_active":"2024-06-04T15:53:14.838251+0000","last_became_peered":"2024-06-04T15:53:14.838251+0000","last_unstale":"2024-06-04T16:20:15.022274+0000","last_undegraded":"2024-06-04T16:20:15.022274+0000","last_fullsized":"2024-06-04T16:20:15.022274+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T16:02:03.538866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5263509,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":74,"num_read_kb":65,"num_write":320,"num_write_kb":43304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.b","version":"33'3","reported_seq":782,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:32.120722+0000","last_change":"2024-06-04T15:52:40.482441+0000","last_active":"2024-06-04T16:22:32.120722+0000","last_peered":"2024-06-04T16:22:32.120722+0000","last_clean":"2024-06-04T16:22:32.120722+0000","last_became_active":"2024-06-04T15:52:40.482173+0000","last_became_peered":"2024-06-04T15:52:40.482173+0000","last_unstale":"2024-06-04T16:22:32.120722+0000","last_undegraded":"2024-06-04T16:22:32.120722+0000","last_fullsized":"2024-06-04T16:22:32.120722+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_clean_scrub_stamp":"2024-06-04T15:52:39.463103+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T16:39:49.059223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":461,"num_read_kb":459,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"254'105","reported_seq":649,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:20:55.022993+0000","last_change":"2024-06-04T15:52:42.498254+0000","last_active":"2024-06-04T16:20:55.022993+0000","last_peered":"2024-06-04T16:20:55.022993+0000","last_clean":"2024-06-04T16:20:55.022993+0000","last_became_active":"2024-06-04T15:52:42.497393+0000","last_became_peered":"2024-06-04T15:52:42.497393+0000","last_unstale":"2024-06-04T16:20:55.022993+0000","last_undegraded":"2024-06-04T16:20:55.022993+0000","last_fullsized":"2024-06-04T16:20:55.022993+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_clean_scrub_stamp":"2024-06-04T15:52:41.476734+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T20:36:45.216523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14741,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":162,"num_read_kb":230,"num_write":84,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"254'475","reported_seq":1632,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:32.414971+0000","last_change":"2024-06-04T15:52:44.519059+0000","last_active":"2024-06-04T16:22:32.414971+0000","last_peered":"2024-06-04T16:22:32.414971+0000","last_clean":"2024-06-04T16:22:32.414971+0000","last_became_active":"2024-06-04T15:52:44.518765+0000","last_became_peered":"2024-06-04T15:52:44.518765+0000","last_unstale":"2024-06-04T16:22:32.414971+0000","last_undegraded":"2024-06-04T16:22:32.414971+0000","last_fullsized":"2024-06-04T16:22:32.414971+0000","mapping_epoch":29,"log_start":"251'400","ondisk_log_start":"251'400","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_clean_scrub_stamp":"2024-06-04T15:52:43.492872+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":400,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T20:20:06.797230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"251'21","reported_seq":488,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:50.010030+0000","last_change":"2024-06-04T15:52:46.537947+0000","last_active":"2024-06-04T16:18:50.010030+0000","last_peered":"2024-06-04T16:18:50.010030+0000","last_clean":"2024-06-04T16:18:50.010030+0000","last_became_active":"2024-06-04T15:52:46.537679+0000","last_became_peered":"2024-06-04T15:52:46.537679+0000","last_unstale":"2024-06-04T16:18:50.010030+0000","last_undegraded":"2024-06-04T16:18:50.010030+0000","last_fullsized":"2024-06-04T16:18:50.010030+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:45.513877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:45.513877+0000","last_clean_scrub_stamp":"2024-06-04T15:52:45.513877+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T18:28:47.547893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":390,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":49,"num_read_kb":41,"num_write":55,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"254'141","reported_seq":899,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:40.017652+0000","last_change":"2024-06-04T15:52:38.489274+0000","last_active":"2024-06-04T16:19:40.017652+0000","last_peered":"2024-06-04T16:19:40.017652+0000","last_clean":"2024-06-04T16:19:40.017652+0000","last_became_active":"2024-06-04T15:52:38.488997+0000","last_became_peered":"2024-06-04T15:52:38.488997+0000","last_unstale":"2024-06-04T16:19:40.017652+0000","last_undegraded":"2024-06-04T16:19:40.017652+0000","last_fullsized":"2024-06-04T16:19:40.017652+0000","mapping_epoch":23,"log_start":"251'100","ondisk_log_start":"251'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":100,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T00:28:22.807058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":688,"num_read_kb":631,"num_write":173,"num_write_kb":46,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"254'57","reported_seq":566,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:40.009630+0000","last_change":"2024-06-04T15:52:36.495931+0000","last_active":"2024-06-04T16:19:40.009630+0000","last_peered":"2024-06-04T16:19:40.009630+0000","last_clean":"2024-06-04T16:19:40.009630+0000","last_became_active":"2024-06-04T15:52:36.495601+0000","last_became_peered":"2024-06-04T15:52:36.495601+0000","last_unstale":"2024-06-04T16:19:40.009630+0000","last_undegraded":"2024-06-04T16:19:40.009630+0000","last_fullsized":"2024-06-04T16:19:40.009630+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T23:22:39.942337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048614,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":73,"num_read_kb":575,"num_write":256,"num_write_kb":23683,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":471,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:45.009389+0000","last_change":"2024-06-04T15:52:40.485064+0000","last_active":"2024-06-04T16:18:45.009389+0000","last_peered":"2024-06-04T16:18:45.009389+0000","last_clean":"2024-06-04T16:18:45.009389+0000","last_became_active":"2024-06-04T15:52:40.484785+0000","last_became_peered":"2024-06-04T15:52:40.484785+0000","last_unstale":"2024-06-04T16:18:45.009389+0000","last_undegraded":"2024-06-04T16:18:45.009389+0000","last_fullsized":"2024-06-04T16:18:45.009389+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_clean_scrub_stamp":"2024-06-04T15:52:39.463103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T18:35:53.675262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.9","version":"254'150","reported_seq":743,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:32.367642+0000","last_change":"2024-06-04T15:52:42.504865+0000","last_active":"2024-06-04T16:22:32.367642+0000","last_peered":"2024-06-04T16:22:32.367642+0000","last_clean":"2024-06-04T16:22:32.367642+0000","last_became_active":"2024-06-04T15:52:42.504622+0000","last_became_peered":"2024-06-04T15:52:42.504622+0000","last_unstale":"2024-06-04T16:22:32.367642+0000","last_undegraded":"2024-06-04T16:22:32.367642+0000","last_fullsized":"2024-06-04T16:22:32.367642+0000","mapping_epoch":27,"log_start":"251'100","ondisk_log_start":"251'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_clean_scrub_stamp":"2024-06-04T15:52:41.476734+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":100,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T01:00:09.245514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26249,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":238,"num_read_kb":374,"num_write":110,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":469,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:45.010347+0000","last_change":"2024-06-04T15:52:44.518616+0000","last_active":"2024-06-04T16:18:45.010347+0000","last_peered":"2024-06-04T16:18:45.010347+0000","last_clean":"2024-06-04T16:18:45.010347+0000","last_became_active":"2024-06-04T15:52:44.518340+0000","last_became_peered":"2024-06-04T15:52:44.518340+0000","last_unstale":"2024-06-04T16:18:45.010347+0000","last_undegraded":"2024-06-04T16:18:45.010347+0000","last_fullsized":"2024-06-04T16:18:45.010347+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_clean_scrub_stamp":"2024-06-04T15:52:43.492872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T20:18:04.722535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"254'22","reported_seq":501,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:50.123049+0000","last_change":"2024-06-04T15:52:46.540890+0000","last_active":"2024-06-04T16:18:50.123049+0000","last_peered":"2024-06-04T16:18:50.123049+0000","last_clean":"2024-06-04T16:18:50.123049+0000","last_became_active":"2024-06-04T15:52:46.540542+0000","last_became_peered":"2024-06-04T15:52:46.540542+0000","last_unstale":"2024-06-04T16:18:50.123049+0000","last_undegraded":"2024-06-04T16:18:50.123049+0000","last_fullsized":"2024-06-04T16:18:50.123049+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:45.513877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:45.513877+0000","last_clean_scrub_stamp":"2024-06-04T15:52:45.513877+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T00:28:19.284809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":503,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":51,"num_read_kb":51,"num_write":59,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"254'116","reported_seq":912,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:40.009649+0000","last_change":"2024-06-04T15:52:38.488878+0000","last_active":"2024-06-04T16:19:40.009649+0000","last_peered":"2024-06-04T16:19:40.009649+0000","last_clean":"2024-06-04T16:19:40.009649+0000","last_became_active":"2024-06-04T15:52:38.488576+0000","last_became_peered":"2024-06-04T15:52:38.488576+0000","last_unstale":"2024-06-04T16:19:40.009649+0000","last_undegraded":"2024-06-04T16:19:40.009649+0000","last_fullsized":"2024-06-04T16:19:40.009649+0000","mapping_epoch":23,"log_start":"251'100","ondisk_log_start":"251'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":100,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T01:10:33.008463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":804,"num_read_kb":763,"num_write":143,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"254'82","reported_seq":602,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:40.129947+0000","last_change":"2024-06-04T15:52:36.499047+0000","last_active":"2024-06-04T16:19:40.129947+0000","last_peered":"2024-06-04T16:19:40.129947+0000","last_clean":"2024-06-04T16:19:40.129947+0000","last_became_active":"2024-06-04T15:52:36.498706+0000","last_became_peered":"2024-06-04T15:52:36.498706+0000","last_unstale":"2024-06-04T16:19:40.129947+0000","last_undegraded":"2024-06-04T16:19:40.129947+0000","last_fullsized":"2024-06-04T16:19:40.129947+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T20:01:28.183971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1310773,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":124,"num_read_kb":7280,"num_write":368,"num_write_kb":33149,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":475,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:40.129985+0000","last_change":"2024-06-04T15:52:40.485318+0000","last_active":"2024-06-04T16:19:40.129985+0000","last_peered":"2024-06-04T16:19:40.129985+0000","last_clean":"2024-06-04T16:19:40.129985+0000","last_became_active":"2024-06-04T15:52:40.484285+0000","last_became_peered":"2024-06-04T15:52:40.484285+0000","last_unstale":"2024-06-04T16:19:40.129985+0000","last_undegraded":"2024-06-04T16:19:40.129985+0000","last_fullsized":"2024-06-04T16:19:40.129985+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_clean_scrub_stamp":"2024-06-04T15:52:39.463103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T23:36:57.821083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.e","version":"254'117","reported_seq":658,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:00.134781+0000","last_change":"2024-06-04T15:52:42.501168+0000","last_active":"2024-06-04T16:22:00.134781+0000","last_peered":"2024-06-04T16:22:00.134781+0000","last_clean":"2024-06-04T16:22:00.134781+0000","last_became_active":"2024-06-04T15:52:42.500865+0000","last_became_peered":"2024-06-04T15:52:42.500865+0000","last_unstale":"2024-06-04T16:22:00.134781+0000","last_undegraded":"2024-06-04T16:22:00.134781+0000","last_fullsized":"2024-06-04T16:22:00.134781+0000","mapping_epoch":27,"log_start":"251'100","ondisk_log_start":"251'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_clean_scrub_stamp":"2024-06-04T15:52:41.476734+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T22:23:11.038518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5455,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":165,"num_read_kb":159,"num_write":132,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":467,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:45.130828+0000","last_change":"2024-06-04T15:52:44.520519+0000","last_active":"2024-06-04T16:19:45.130828+0000","last_peered":"2024-06-04T16:19:45.130828+0000","last_clean":"2024-06-04T16:19:45.130828+0000","last_became_active":"2024-06-04T15:52:44.519542+0000","last_became_peered":"2024-06-04T15:52:44.519542+0000","last_unstale":"2024-06-04T16:19:45.130828+0000","last_undegraded":"2024-06-04T16:19:45.130828+0000","last_fullsized":"2024-06-04T16:19:45.130828+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_clean_scrub_stamp":"2024-06-04T15:52:43.492872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T22:23:21.493696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.0","version":"254'16","reported_seq":482,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:55.011781+0000","last_change":"2024-06-04T15:52:46.540191+0000","last_active":"2024-06-04T16:18:55.011781+0000","last_peered":"2024-06-04T16:18:55.011781+0000","last_clean":"2024-06-04T16:18:55.011781+0000","last_became_active":"2024-06-04T15:52:46.539906+0000","last_became_peered":"2024-06-04T15:52:46.539906+0000","last_unstale":"2024-06-04T16:18:55.011781+0000","last_undegraded":"2024-06-04T16:18:55.011781+0000","last_fullsized":"2024-06-04T16:18:55.011781+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:45.513877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:45.513877+0000","last_clean_scrub_stamp":"2024-06-04T15:52:45.513877+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T16:35:48.692745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":31,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"254'140","reported_seq":897,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:40.014533+0000","last_change":"2024-06-04T15:52:38.479098+0000","last_active":"2024-06-04T16:19:40.014533+0000","last_peered":"2024-06-04T16:19:40.014533+0000","last_clean":"2024-06-04T16:19:40.014533+0000","last_became_active":"2024-06-04T15:52:38.478691+0000","last_became_peered":"2024-06-04T15:52:38.478691+0000","last_unstale":"2024-06-04T16:19:40.014533+0000","last_undegraded":"2024-06-04T16:19:40.014533+0000","last_fullsized":"2024-06-04T16:19:40.014533+0000","mapping_epoch":23,"log_start":"251'100","ondisk_log_start":"251'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":100,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T20:41:58.834443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":683,"num_read_kb":634,"num_write":182,"num_write_kb":49,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"254'80","reported_seq":587,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:45.008382+0000","last_change":"2024-06-04T15:52:36.489783+0000","last_active":"2024-06-04T16:18:45.008382+0000","last_peered":"2024-06-04T16:18:45.008382+0000","last_clean":"2024-06-04T16:18:45.008382+0000","last_became_active":"2024-06-04T15:52:36.489437+0000","last_became_peered":"2024-06-04T15:52:36.489437+0000","last_unstale":"2024-06-04T16:18:45.008382+0000","last_undegraded":"2024-06-04T16:18:45.008382+0000","last_fullsized":"2024-06-04T16:18:45.008382+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T23:09:59.205888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133669,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":97,"num_read_kb":3905,"num_write":348,"num_write_kb":24180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":477,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:40.017716+0000","last_change":"2024-06-04T15:52:40.480878+0000","last_active":"2024-06-04T16:19:40.017716+0000","last_peered":"2024-06-04T16:19:40.017716+0000","last_clean":"2024-06-04T16:19:40.017716+0000","last_became_active":"2024-06-04T15:52:40.480568+0000","last_became_peered":"2024-06-04T15:52:40.480568+0000","last_unstale":"2024-06-04T16:19:40.017716+0000","last_undegraded":"2024-06-04T16:19:40.017716+0000","last_fullsized":"2024-06-04T16:19:40.017716+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_clean_scrub_stamp":"2024-06-04T15:52:39.463103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T22:05:18.609127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.f","version":"254'107","reported_seq":654,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:05.038886+0000","last_change":"2024-06-04T15:52:42.499311+0000","last_active":"2024-06-04T16:22:05.038886+0000","last_peered":"2024-06-04T16:22:05.038886+0000","last_clean":"2024-06-04T16:22:05.038886+0000","last_became_active":"2024-06-04T15:52:42.499014+0000","last_became_peered":"2024-06-04T15:52:42.499014+0000","last_unstale":"2024-06-04T16:22:05.038886+0000","last_undegraded":"2024-06-04T16:22:05.038886+0000","last_fullsized":"2024-06-04T16:22:05.038886+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_clean_scrub_stamp":"2024-06-04T15:52:41.476734+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T17:38:48.045987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10041,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":160,"num_read_kb":218,"num_write":84,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.e","version":"254'460","reported_seq":1440,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:32.410967+0000","last_change":"2024-06-04T15:52:44.520284+0000","last_active":"2024-06-04T16:22:32.410967+0000","last_peered":"2024-06-04T16:22:32.410967+0000","last_clean":"2024-06-04T16:22:32.410967+0000","last_became_active":"2024-06-04T15:52:44.520016+0000","last_became_peered":"2024-06-04T15:52:44.520016+0000","last_unstale":"2024-06-04T16:22:32.410967+0000","last_undegraded":"2024-06-04T16:22:32.410967+0000","last_fullsized":"2024-06-04T16:22:32.410967+0000","mapping_epoch":29,"log_start":"251'400","ondisk_log_start":"251'400","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_clean_scrub_stamp":"2024-06-04T15:52:43.492872+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":400,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T21:36:43.965699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1","version":"254'28","reported_seq":499,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:55.019299+0000","last_change":"2024-06-04T15:52:46.532842+0000","last_active":"2024-06-04T16:19:55.019299+0000","last_peered":"2024-06-04T16:19:55.019299+0000","last_clean":"2024-06-04T16:19:55.019299+0000","last_became_active":"2024-06-04T15:52:46.532554+0000","last_became_peered":"2024-06-04T15:52:46.532554+0000","last_unstale":"2024-06-04T16:19:55.019299+0000","last_undegraded":"2024-06-04T16:19:55.019299+0000","last_fullsized":"2024-06-04T16:19:55.019299+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:45.513877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:45.513877+0000","last_clean_scrub_stamp":"2024-06-04T15:52:45.513877+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T18:11:38.661962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":764,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":64,"num_read_kb":55,"num_write":77,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.e","version":"254'75","reported_seq":757,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:40.010221+0000","last_change":"2024-06-04T15:52:38.481543+0000","last_active":"2024-06-04T16:19:40.010221+0000","last_peered":"2024-06-04T16:19:40.010221+0000","last_clean":"2024-06-04T16:19:40.010221+0000","last_became_active":"2024-06-04T15:52:38.480961+0000","last_became_peered":"2024-06-04T15:52:38.480961+0000","last_unstale":"2024-06-04T16:19:40.010221+0000","last_undegraded":"2024-06-04T16:19:40.010221+0000","last_fullsized":"2024-06-04T16:19:40.010221+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T23:30:27.048500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":420,"num_read_kb":402,"num_write":82,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"254'43","reported_seq":541,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:40.007753+0000","last_change":"2024-06-04T15:52:36.485951+0000","last_active":"2024-06-04T16:18:40.007753+0000","last_peered":"2024-06-04T16:18:40.007753+0000","last_clean":"2024-06-04T16:18:40.007753+0000","last_became_active":"2024-06-04T15:52:36.485571+0000","last_became_peered":"2024-06-04T15:52:36.485571+0000","last_unstale":"2024-06-04T16:18:40.007753+0000","last_undegraded":"2024-06-04T16:18:40.007753+0000","last_fullsized":"2024-06-04T16:18:40.007753+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T01:39:00.786783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":66,"num_read_kb":9943,"num_write":198,"num_write_kb":32171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"26'2","reported_seq":1081,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:32.131043+0000","last_change":"2024-06-04T15:52:40.477976+0000","last_active":"2024-06-04T16:22:32.131043+0000","last_peered":"2024-06-04T16:22:32.131043+0000","last_clean":"2024-06-04T16:22:32.131043+0000","last_became_active":"2024-06-04T15:52:40.477693+0000","last_became_peered":"2024-06-04T15:52:40.477693+0000","last_unstale":"2024-06-04T16:22:32.131043+0000","last_undegraded":"2024-06-04T16:22:32.131043+0000","last_fullsized":"2024-06-04T16:22:32.131043+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_clean_scrub_stamp":"2024-06-04T15:52:39.463103+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T15:57:27.865623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":602,"num_read_kb":602,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"251'35","reported_seq":517,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:45.017668+0000","last_change":"2024-06-04T15:52:42.503779+0000","last_active":"2024-06-04T16:19:45.017668+0000","last_peered":"2024-06-04T16:19:45.017668+0000","last_clean":"2024-06-04T16:19:45.017668+0000","last_became_active":"2024-06-04T15:52:42.503184+0000","last_became_peered":"2024-06-04T15:52:42.503184+0000","last_unstale":"2024-06-04T16:19:45.017668+0000","last_undegraded":"2024-06-04T16:19:45.017668+0000","last_fullsized":"2024-06-04T16:19:45.017668+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_clean_scrub_stamp":"2024-06-04T15:52:41.476734+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T01:25:31.440819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":45,"num_read_kb":40,"num_write":30,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.d","version":"254'467","reported_seq":1620,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:32.411887+0000","last_change":"2024-06-04T15:52:44.518741+0000","last_active":"2024-06-04T16:22:32.411887+0000","last_peered":"2024-06-04T16:22:32.411887+0000","last_clean":"2024-06-04T16:22:32.411887+0000","last_became_active":"2024-06-04T15:52:44.518522+0000","last_became_peered":"2024-06-04T15:52:44.518522+0000","last_unstale":"2024-06-04T16:22:32.411887+0000","last_undegraded":"2024-06-04T16:22:32.411887+0000","last_fullsized":"2024-06-04T16:22:32.411887+0000","mapping_epoch":29,"log_start":"251'400","ondisk_log_start":"251'400","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_clean_scrub_stamp":"2024-06-04T15:52:43.492872+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":400,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T17:21:25.625424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"254'25","reported_seq":493,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:55.011771+0000","last_change":"2024-06-04T15:52:46.529500+0000","last_active":"2024-06-04T16:19:55.011771+0000","last_peered":"2024-06-04T16:19:55.011771+0000","last_clean":"2024-06-04T16:19:55.011771+0000","last_became_active":"2024-06-04T15:52:46.529183+0000","last_became_peered":"2024-06-04T15:52:46.529183+0000","last_unstale":"2024-06-04T16:19:55.011771+0000","last_undegraded":"2024-06-04T16:19:55.011771+0000","last_fullsized":"2024-06-04T16:19:55.011771+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:45.513877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:45.513877+0000","last_clean_scrub_stamp":"2024-06-04T15:52:45.513877+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T02:50:02.857177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":33,"num_read_kb":31,"num_write":52,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"254'102","reported_seq":866,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:40.130050+0000","last_change":"2024-06-04T15:52:38.485496+0000","last_active":"2024-06-04T16:19:40.130050+0000","last_peered":"2024-06-04T16:19:40.130050+0000","last_clean":"2024-06-04T16:19:40.130050+0000","last_became_active":"2024-06-04T15:52:38.485146+0000","last_became_peered":"2024-06-04T15:52:38.485146+0000","last_unstale":"2024-06-04T16:19:40.130050+0000","last_undegraded":"2024-06-04T16:19:40.130050+0000","last_fullsized":"2024-06-04T16:19:40.130050+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T21:02:08.479603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":573,"num_read_kb":549,"num_write":116,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"251'24","reported_seq":516,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:40.009093+0000","last_change":"2024-06-04T15:52:36.475660+0000","last_active":"2024-06-04T16:18:40.009093+0000","last_peered":"2024-06-04T16:18:40.009093+0000","last_clean":"2024-06-04T16:18:40.009093+0000","last_became_active":"2024-06-04T15:52:36.475290+0000","last_became_peered":"2024-06-04T15:52:36.475290+0000","last_unstale":"2024-06-04T16:18:40.009093+0000","last_undegraded":"2024-06-04T16:18:40.009093+0000","last_fullsized":"2024-06-04T16:18:40.009093+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T20:08:50.243935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":22,"num_read_kb":15371,"num_write":75,"num_write_kb":21019,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,2],"acting":[4,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":474,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:40.014557+0000","last_change":"2024-06-04T15:52:40.482222+0000","last_active":"2024-06-04T16:19:40.014557+0000","last_peered":"2024-06-04T16:19:40.014557+0000","last_clean":"2024-06-04T16:19:40.014557+0000","last_became_active":"2024-06-04T15:52:40.481856+0000","last_became_peered":"2024-06-04T15:52:40.481856+0000","last_unstale":"2024-06-04T16:19:40.014557+0000","last_undegraded":"2024-06-04T16:19:40.014557+0000","last_fullsized":"2024-06-04T16:19:40.014557+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_clean_scrub_stamp":"2024-06-04T15:52:39.463103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T21:21:46.829568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"254'137","reported_seq":702,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:00.134761+0000","last_change":"2024-06-04T15:52:42.503483+0000","last_active":"2024-06-04T16:22:00.134761+0000","last_peered":"2024-06-04T16:22:00.134761+0000","last_clean":"2024-06-04T16:22:00.134761+0000","last_became_active":"2024-06-04T15:52:42.503214+0000","last_became_peered":"2024-06-04T15:52:42.503214+0000","last_unstale":"2024-06-04T16:22:00.134761+0000","last_undegraded":"2024-06-04T16:22:00.134761+0000","last_fullsized":"2024-06-04T16:22:00.134761+0000","mapping_epoch":27,"log_start":"251'100","ondisk_log_start":"251'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_clean_scrub_stamp":"2024-06-04T15:52:41.476734+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":100,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T18:55:21.822380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27149,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":232,"num_read_kb":309,"num_write":170,"num_write_kb":95,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":465,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:45.010700+0000","last_change":"2024-06-04T15:52:44.514586+0000","last_active":"2024-06-04T16:19:45.010700+0000","last_peered":"2024-06-04T16:19:45.010700+0000","last_clean":"2024-06-04T16:19:45.010700+0000","last_became_active":"2024-06-04T15:52:44.514269+0000","last_became_peered":"2024-06-04T15:52:44.514269+0000","last_unstale":"2024-06-04T16:19:45.010700+0000","last_undegraded":"2024-06-04T16:19:45.010700+0000","last_fullsized":"2024-06-04T16:19:45.010700+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_clean_scrub_stamp":"2024-06-04T15:52:43.492872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T22:14:52.172379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"254'31","reported_seq":503,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:55.132073+0000","last_change":"2024-06-04T15:52:46.532569+0000","last_active":"2024-06-04T16:19:55.132073+0000","last_peered":"2024-06-04T16:19:55.132073+0000","last_clean":"2024-06-04T16:19:55.132073+0000","last_became_active":"2024-06-04T15:52:46.531977+0000","last_became_peered":"2024-06-04T15:52:46.531977+0000","last_unstale":"2024-06-04T16:19:55.132073+0000","last_undegraded":"2024-06-04T16:19:55.132073+0000","last_fullsized":"2024-06-04T16:19:55.132073+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:45.513877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:45.513877+0000","last_clean_scrub_stamp":"2024-06-04T15:52:45.513877+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T23:12:23.178842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":49,"num_write":79,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"254'144","reported_seq":952,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:50.015669+0000","last_change":"2024-06-04T15:52:38.478958+0000","last_active":"2024-06-04T16:19:50.015669+0000","last_peered":"2024-06-04T16:19:50.015669+0000","last_clean":"2024-06-04T16:19:50.015669+0000","last_became_active":"2024-06-04T15:52:38.478362+0000","last_became_peered":"2024-06-04T15:52:38.478362+0000","last_unstale":"2024-06-04T16:19:50.015669+0000","last_undegraded":"2024-06-04T16:19:50.015669+0000","last_fullsized":"2024-06-04T16:19:50.015669+0000","mapping_epoch":23,"log_start":"251'100","ondisk_log_start":"251'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T22:47:09.266351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":807,"num_read_kb":748,"num_write":182,"num_write_kb":49,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":496,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:20:25.125218+0000","last_change":"2024-06-04T15:52:22.417765+0000","last_active":"2024-06-04T16:20:25.125218+0000","last_peered":"2024-06-04T16:20:25.125218+0000","last_clean":"2024-06-04T16:20:25.125218+0000","last_became_active":"2024-06-04T15:52:22.417462+0000","last_became_peered":"2024-06-04T15:52:22.417462+0000","last_unstale":"2024-06-04T16:20:25.125218+0000","last_undegraded":"2024-06-04T16:20:25.125218+0000","last_fullsized":"2024-06-04T16:20:25.125218+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:21.400880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:21.400880+0000","last_clean_scrub_stamp":"2024-06-04T15:52:21.400880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T01:56:18.510923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"251'43","reported_seq":534,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:45.017794+0000","last_change":"2024-06-04T15:52:36.498057+0000","last_active":"2024-06-04T16:19:45.017794+0000","last_peered":"2024-06-04T16:19:45.017794+0000","last_clean":"2024-06-04T16:19:45.017794+0000","last_became_active":"2024-06-04T15:52:36.497603+0000","last_became_peered":"2024-06-04T15:52:36.497603+0000","last_unstale":"2024-06-04T16:19:45.017794+0000","last_undegraded":"2024-06-04T16:19:45.017794+0000","last_fullsized":"2024-06-04T16:19:45.017794+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T21:06:13.700958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1069190,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":32,"num_read_kb":263,"num_write":148,"num_write_kb":16917,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,0],"acting":[4,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":478,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:45.010145+0000","last_change":"2024-06-04T15:52:40.483375+0000","last_active":"2024-06-04T16:19:45.010145+0000","last_peered":"2024-06-04T16:19:45.010145+0000","last_clean":"2024-06-04T16:19:45.010145+0000","last_became_active":"2024-06-04T15:52:40.482529+0000","last_became_peered":"2024-06-04T15:52:40.482529+0000","last_unstale":"2024-06-04T16:19:45.010145+0000","last_undegraded":"2024-06-04T16:19:45.010145+0000","last_fullsized":"2024-06-04T16:19:45.010145+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_clean_scrub_stamp":"2024-06-04T15:52:39.463103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T19:54:15.030371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"254'232","reported_seq":891,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:32.383974+0000","last_change":"2024-06-04T15:52:42.497154+0000","last_active":"2024-06-04T16:22:32.383974+0000","last_peered":"2024-06-04T16:22:32.383974+0000","last_clean":"2024-06-04T16:22:32.383974+0000","last_became_active":"2024-06-04T15:52:42.496878+0000","last_became_peered":"2024-06-04T15:52:42.496878+0000","last_unstale":"2024-06-04T16:22:32.383974+0000","last_undegraded":"2024-06-04T16:22:32.383974+0000","last_fullsized":"2024-06-04T16:22:32.383974+0000","mapping_epoch":27,"log_start":"251'200","ondisk_log_start":"251'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_clean_scrub_stamp":"2024-06-04T15:52:41.476734+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":200,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T19:44:50.163372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30577,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":471,"num_read_kb":664,"num_write":388,"num_write_kb":281,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":469,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:45.010474+0000","last_change":"2024-06-04T15:52:44.514011+0000","last_active":"2024-06-04T16:18:45.010474+0000","last_peered":"2024-06-04T16:18:45.010474+0000","last_clean":"2024-06-04T16:18:45.010474+0000","last_became_active":"2024-06-04T15:52:44.513726+0000","last_became_peered":"2024-06-04T15:52:44.513726+0000","last_unstale":"2024-06-04T16:18:45.010474+0000","last_undegraded":"2024-06-04T16:18:45.010474+0000","last_fullsized":"2024-06-04T16:18:45.010474+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_clean_scrub_stamp":"2024-06-04T15:52:43.492872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T19:48:02.146293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"254'34","reported_seq":516,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:50.004737+0000","last_change":"2024-06-04T15:52:46.536565+0000","last_active":"2024-06-04T16:18:50.004737+0000","last_peered":"2024-06-04T16:18:50.004737+0000","last_clean":"2024-06-04T16:18:50.004737+0000","last_became_active":"2024-06-04T15:52:46.536184+0000","last_became_peered":"2024-06-04T15:52:46.536184+0000","last_unstale":"2024-06-04T16:18:50.004737+0000","last_undegraded":"2024-06-04T16:18:50.004737+0000","last_fullsized":"2024-06-04T16:18:50.004737+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:45.513877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:45.513877+0000","last_clean_scrub_stamp":"2024-06-04T15:52:45.513877+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T22:45:30.543372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":408,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":64,"num_read_kb":61,"num_write":79,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"254'172","reported_seq":973,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:45.017681+0000","last_change":"2024-06-04T15:52:38.474997+0000","last_active":"2024-06-04T16:19:45.017681+0000","last_peered":"2024-06-04T16:19:45.017681+0000","last_clean":"2024-06-04T16:19:45.017681+0000","last_became_active":"2024-06-04T15:52:38.474646+0000","last_became_peered":"2024-06-04T15:52:38.474646+0000","last_unstale":"2024-06-04T16:19:45.017681+0000","last_undegraded":"2024-06-04T16:19:45.017681+0000","last_fullsized":"2024-06-04T16:19:45.017681+0000","mapping_epoch":23,"log_start":"251'100","ondisk_log_start":"251'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":100,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T03:13:37.646203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":944,"num_read_kb":866,"num_write":217,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":493,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:25.012795+0000","last_change":"2024-06-04T15:52:22.777198+0000","last_active":"2024-06-04T16:19:25.012795+0000","last_peered":"2024-06-04T16:19:25.012795+0000","last_clean":"2024-06-04T16:19:25.012795+0000","last_became_active":"2024-06-04T15:52:22.776779+0000","last_became_peered":"2024-06-04T15:52:22.776779+0000","last_unstale":"2024-06-04T16:19:25.012795+0000","last_undegraded":"2024-06-04T16:19:25.012795+0000","last_fullsized":"2024-06-04T16:19:25.012795+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:21.400880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:21.400880+0000","last_clean_scrub_stamp":"2024-06-04T15:52:21.400880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T02:49:10.441919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"251'43","reported_seq":539,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:45.010124+0000","last_change":"2024-06-04T15:52:36.495013+0000","last_active":"2024-06-04T16:19:45.010124+0000","last_peered":"2024-06-04T16:19:45.010124+0000","last_clean":"2024-06-04T16:19:45.010124+0000","last_became_active":"2024-06-04T15:52:36.494711+0000","last_became_peered":"2024-06-04T15:52:36.494711+0000","last_unstale":"2024-06-04T16:19:45.010124+0000","last_undegraded":"2024-06-04T16:19:45.010124+0000","last_fullsized":"2024-06-04T16:19:45.010124+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T22:50:20.789950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20644,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":32,"num_read_kb":101,"num_write":157,"num_write_kb":20554,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,4],"acting":[0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":476,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:45.130774+0000","last_change":"2024-06-04T15:52:40.485086+0000","last_active":"2024-06-04T16:19:45.130774+0000","last_peered":"2024-06-04T16:19:45.130774+0000","last_clean":"2024-06-04T16:19:45.130774+0000","last_became_active":"2024-06-04T15:52:40.484698+0000","last_became_peered":"2024-06-04T15:52:40.484698+0000","last_unstale":"2024-06-04T16:19:45.130774+0000","last_undegraded":"2024-06-04T16:19:45.130774+0000","last_fullsized":"2024-06-04T16:19:45.130774+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_clean_scrub_stamp":"2024-06-04T15:52:39.463103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T18:54:22.275767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"251'83","reported_seq":589,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:45.010464+0000","last_change":"2024-06-04T15:52:42.500941+0000","last_active":"2024-06-04T16:18:45.010464+0000","last_peered":"2024-06-04T16:18:45.010464+0000","last_clean":"2024-06-04T16:18:45.010464+0000","last_became_active":"2024-06-04T15:52:42.500646+0000","last_became_peered":"2024-06-04T15:52:42.500646+0000","last_unstale":"2024-06-04T16:18:45.010464+0000","last_undegraded":"2024-06-04T16:18:45.010464+0000","last_fullsized":"2024-06-04T16:18:45.010464+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_clean_scrub_stamp":"2024-06-04T15:52:41.476734+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T22:44:47.011875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":102,"num_read_kb":94,"num_write":72,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":466,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:45.008452+0000","last_change":"2024-06-04T15:52:44.521167+0000","last_active":"2024-06-04T16:18:45.008452+0000","last_peered":"2024-06-04T16:18:45.008452+0000","last_clean":"2024-06-04T16:18:45.008452+0000","last_became_active":"2024-06-04T15:52:44.520841+0000","last_became_peered":"2024-06-04T15:52:44.520841+0000","last_unstale":"2024-06-04T16:18:45.008452+0000","last_undegraded":"2024-06-04T16:18:45.008452+0000","last_fullsized":"2024-06-04T16:18:45.008452+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_clean_scrub_stamp":"2024-06-04T15:52:43.492872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T01:14:42.414240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"251'34","reported_seq":534,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:50.115154+0000","last_change":"2024-06-04T15:52:46.540297+0000","last_active":"2024-06-04T16:18:50.115154+0000","last_peered":"2024-06-04T16:18:50.115154+0000","last_clean":"2024-06-04T16:18:50.115154+0000","last_became_active":"2024-06-04T15:52:46.539931+0000","last_became_peered":"2024-06-04T15:52:46.539931+0000","last_unstale":"2024-06-04T16:18:50.115154+0000","last_undegraded":"2024-06-04T16:18:50.115154+0000","last_fullsized":"2024-06-04T16:18:50.115154+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:45.513877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:45.513877+0000","last_clean_scrub_stamp":"2024-06-04T15:52:45.513877+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T01:12:43.841169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":127,"num_read_kb":111,"num_write":92,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"254'119","reported_seq":1028,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:40.008889+0000","last_change":"2024-06-04T15:52:38.486040+0000","last_active":"2024-06-04T16:18:40.008889+0000","last_peered":"2024-06-04T16:18:40.008889+0000","last_clean":"2024-06-04T16:18:40.008889+0000","last_became_active":"2024-06-04T15:52:38.485755+0000","last_became_peered":"2024-06-04T15:52:38.485755+0000","last_unstale":"2024-06-04T16:18:40.008889+0000","last_undegraded":"2024-06-04T16:18:40.008889+0000","last_fullsized":"2024-06-04T16:18:40.008889+0000","mapping_epoch":23,"log_start":"254'100","ondisk_log_start":"254'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":100,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T16:25:57.227817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":989,"num_read_kb":963,"num_write":137,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":495,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:30.008638+0000","last_change":"2024-06-04T15:52:22.423235+0000","last_active":"2024-06-04T16:19:30.008638+0000","last_peered":"2024-06-04T16:19:30.008638+0000","last_clean":"2024-06-04T16:19:30.008638+0000","last_became_active":"2024-06-04T15:52:22.422971+0000","last_became_peered":"2024-06-04T15:52:22.422971+0000","last_unstale":"2024-06-04T16:19:30.008638+0000","last_undegraded":"2024-06-04T16:19:30.008638+0000","last_fullsized":"2024-06-04T16:19:30.008638+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:21.400880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:21.400880+0000","last_clean_scrub_stamp":"2024-06-04T15:52:21.400880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T16:30:17.573588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"254'70","reported_seq":609,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:45.010321+0000","last_change":"2024-06-04T15:52:36.485796+0000","last_active":"2024-06-04T16:18:45.010321+0000","last_peered":"2024-06-04T16:18:45.010321+0000","last_clean":"2024-06-04T16:18:45.010321+0000","last_became_active":"2024-06-04T15:52:36.485475+0000","last_became_peered":"2024-06-04T15:52:36.485475+0000","last_unstale":"2024-06-04T16:18:45.010321+0000","last_undegraded":"2024-06-04T16:18:45.010321+0000","last_fullsized":"2024-06-04T16:18:45.010321+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T22:10:16.220150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3475557,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":107,"num_read_kb":62832,"num_write":267,"num_write_kb":45136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,2],"acting":[5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"26'1","reported_seq":476,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:40.121529+0000","last_change":"2024-06-04T15:52:40.486597+0000","last_active":"2024-06-04T16:18:40.121529+0000","last_peered":"2024-06-04T16:18:40.121529+0000","last_clean":"2024-06-04T16:18:40.121529+0000","last_became_active":"2024-06-04T15:52:40.486003+0000","last_became_peered":"2024-06-04T15:52:40.486003+0000","last_unstale":"2024-06-04T16:18:40.121529+0000","last_undegraded":"2024-06-04T16:18:40.121529+0000","last_fullsized":"2024-06-04T16:18:40.121529+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_clean_scrub_stamp":"2024-06-04T15:52:39.463103+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T00:11:15.750860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"254'117","reported_seq":991,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:29.585274+0000","last_change":"2024-06-04T15:52:42.505519+0000","last_active":"2024-06-04T16:22:29.585274+0000","last_peered":"2024-06-04T16:22:29.585274+0000","last_clean":"2024-06-04T16:22:29.585274+0000","last_became_active":"2024-06-04T15:52:42.505250+0000","last_became_peered":"2024-06-04T15:52:42.505250+0000","last_unstale":"2024-06-04T16:22:29.585274+0000","last_undegraded":"2024-06-04T16:22:29.585274+0000","last_fullsized":"2024-06-04T16:22:29.585274+0000","mapping_epoch":27,"log_start":"251'100","ondisk_log_start":"251'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_clean_scrub_stamp":"2024-06-04T15:52:41.476734+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T23:03:14.546926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":113,"num_read_kb":103,"num_write":67,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":468,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:50.018609+0000","last_change":"2024-06-04T15:52:44.522460+0000","last_active":"2024-06-04T16:19:50.018609+0000","last_peered":"2024-06-04T16:19:50.018609+0000","last_clean":"2024-06-04T16:19:50.018609+0000","last_became_active":"2024-06-04T15:52:44.522168+0000","last_became_peered":"2024-06-04T15:52:44.522168+0000","last_unstale":"2024-06-04T16:19:50.018609+0000","last_undegraded":"2024-06-04T16:19:50.018609+0000","last_fullsized":"2024-06-04T16:19:50.018609+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_clean_scrub_stamp":"2024-06-04T15:52:43.492872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T20:17:24.091454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.b","version":"254'111","reported_seq":601,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:50.018584+0000","last_change":"2024-06-04T15:52:46.537611+0000","last_active":"2024-06-04T16:19:50.018584+0000","last_peered":"2024-06-04T16:19:50.018584+0000","last_clean":"2024-06-04T16:19:50.018584+0000","last_became_active":"2024-06-04T15:52:46.537377+0000","last_became_peered":"2024-06-04T15:52:46.537377+0000","last_unstale":"2024-06-04T16:19:50.018584+0000","last_undegraded":"2024-06-04T16:19:50.018584+0000","last_fullsized":"2024-06-04T16:19:50.018584+0000","mapping_epoch":31,"log_start":"251'100","ondisk_log_start":"251'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:45.513877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:45.513877+0000","last_clean_scrub_stamp":"2024-06-04T15:52:45.513877+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":100,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T22:06:04.608286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":232,"num_read_kb":256,"num_write":227,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.6","version":"254'74","reported_seq":765,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:40.009736+0000","last_change":"2024-06-04T15:52:38.487720+0000","last_active":"2024-06-04T16:18:40.009736+0000","last_peered":"2024-06-04T16:18:40.009736+0000","last_clean":"2024-06-04T16:18:40.009736+0000","last_became_active":"2024-06-04T15:52:38.487359+0000","last_became_peered":"2024-06-04T15:52:38.487359+0000","last_unstale":"2024-06-04T16:18:40.009736+0000","last_undegraded":"2024-06-04T16:18:40.009736+0000","last_fullsized":"2024-06-04T16:18:40.009736+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T16:18:23.773829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":431,"num_read_kb":414,"num_write":84,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":494,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:30.015833+0000","last_change":"2024-06-04T15:52:22.423963+0000","last_active":"2024-06-04T16:19:30.015833+0000","last_peered":"2024-06-04T16:19:30.015833+0000","last_clean":"2024-06-04T16:19:30.015833+0000","last_became_active":"2024-06-04T15:52:22.423712+0000","last_became_peered":"2024-06-04T15:52:22.423712+0000","last_unstale":"2024-06-04T16:19:30.015833+0000","last_undegraded":"2024-06-04T16:19:30.015833+0000","last_fullsized":"2024-06-04T16:19:30.015833+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:21.400880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:21.400880+0000","last_clean_scrub_stamp":"2024-06-04T15:52:21.400880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T02:49:57.732530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"17'72","reported_seq":584,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:20:30.020067+0000","last_change":"2024-06-04T15:52:22.429522+0000","last_active":"2024-06-04T16:20:30.020067+0000","last_peered":"2024-06-04T16:20:30.020067+0000","last_clean":"2024-06-04T16:20:30.020067+0000","last_became_active":"2024-06-04T15:52:22.428356+0000","last_became_peered":"2024-06-04T15:52:22.428356+0000","last_unstale":"2024-06-04T16:20:30.020067+0000","last_undegraded":"2024-06-04T16:20:30.020067+0000","last_fullsized":"2024-06-04T16:20:30.020067+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:21.400880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:21.400880+0000","last_clean_scrub_stamp":"2024-06-04T15:52:21.400880+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T18:42:36.118905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"254'72","reported_seq":580,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:45.017581+0000","last_change":"2024-06-04T15:52:36.488969+0000","last_active":"2024-06-04T16:19:45.017581+0000","last_peered":"2024-06-04T16:19:45.017581+0000","last_clean":"2024-06-04T16:19:45.017581+0000","last_became_active":"2024-06-04T15:52:36.488567+0000","last_became_peered":"2024-06-04T15:52:36.488567+0000","last_unstale":"2024-06-04T16:19:45.017581+0000","last_undegraded":"2024-06-04T16:19:45.017581+0000","last_fullsized":"2024-06-04T16:19:45.017581+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T22:39:10.146956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133705,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":100,"num_read_kb":15171,"num_write":323,"num_write_kb":30782,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,4],"acting":[6,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":474,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:40.007854+0000","last_change":"2024-06-04T15:52:40.479422+0000","last_active":"2024-06-04T16:18:40.007854+0000","last_peered":"2024-06-04T16:18:40.007854+0000","last_clean":"2024-06-04T16:18:40.007854+0000","last_became_active":"2024-06-04T15:52:40.479168+0000","last_became_peered":"2024-06-04T15:52:40.479168+0000","last_unstale":"2024-06-04T16:18:40.007854+0000","last_undegraded":"2024-06-04T16:18:40.007854+0000","last_fullsized":"2024-06-04T16:18:40.007854+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_clean_scrub_stamp":"2024-06-04T15:52:39.463103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T20:31:07.436900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"254'547","reported_seq":1711,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:32.406922+0000","last_change":"2024-06-04T15:52:42.503507+0000","last_active":"2024-06-04T16:22:32.406922+0000","last_peered":"2024-06-04T16:22:32.406922+0000","last_clean":"2024-06-04T16:22:32.406922+0000","last_became_active":"2024-06-04T15:52:42.503178+0000","last_became_peered":"2024-06-04T15:52:42.503178+0000","last_unstale":"2024-06-04T16:22:32.406922+0000","last_undegraded":"2024-06-04T16:22:32.406922+0000","last_fullsized":"2024-06-04T16:22:32.406922+0000","mapping_epoch":27,"log_start":"251'500","ondisk_log_start":"251'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_clean_scrub_stamp":"2024-06-04T15:52:41.476734+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":500,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T20:05:37.750208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31661,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":811,"num_read_kb":1005,"num_write":178,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":467,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:55.016249+0000","last_change":"2024-06-04T15:52:44.523212+0000","last_active":"2024-06-04T16:19:55.016249+0000","last_peered":"2024-06-04T16:19:55.016249+0000","last_clean":"2024-06-04T16:19:55.016249+0000","last_became_active":"2024-06-04T15:52:44.522475+0000","last_became_peered":"2024-06-04T15:52:44.522475+0000","last_unstale":"2024-06-04T16:19:55.016249+0000","last_undegraded":"2024-06-04T16:19:55.016249+0000","last_fullsized":"2024-06-04T16:19:55.016249+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_clean_scrub_stamp":"2024-06-04T15:52:43.492872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T23:00:33.107705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"254'71","reported_seq":556,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:55.011834+0000","last_change":"2024-06-04T15:52:46.542179+0000","last_active":"2024-06-04T16:18:55.011834+0000","last_peered":"2024-06-04T16:18:55.011834+0000","last_clean":"2024-06-04T16:18:55.011834+0000","last_became_active":"2024-06-04T15:52:46.541851+0000","last_became_peered":"2024-06-04T15:52:46.541851+0000","last_unstale":"2024-06-04T16:18:55.011834+0000","last_undegraded":"2024-06-04T16:18:55.011834+0000","last_fullsized":"2024-06-04T16:18:55.011834+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:45.513877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:45.513877+0000","last_clean_scrub_stamp":"2024-06-04T15:52:45.513877+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T00:45:41.120418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":147,"num_read_kb":147,"num_write":159,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1","version":"254'115","reported_seq":812,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:45.010653+0000","last_change":"2024-06-04T15:52:38.485610+0000","last_active":"2024-06-04T16:19:45.010653+0000","last_peered":"2024-06-04T16:19:45.010653+0000","last_clean":"2024-06-04T16:19:45.010653+0000","last_became_active":"2024-06-04T15:52:38.485314+0000","last_became_peered":"2024-06-04T15:52:38.485314+0000","last_unstale":"2024-06-04T16:19:45.010653+0000","last_undegraded":"2024-06-04T16:19:45.010653+0000","last_fullsized":"2024-06-04T16:19:45.010653+0000","mapping_epoch":23,"log_start":"251'100","ondisk_log_start":"251'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":100,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T18:49:42.990690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":554,"num_read_kb":505,"num_write":149,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"251'78","reported_seq":587,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:40.009180+0000","last_change":"2024-06-04T15:52:36.479114+0000","last_active":"2024-06-04T16:18:40.009180+0000","last_peered":"2024-06-04T16:18:40.009180+0000","last_clean":"2024-06-04T16:18:40.009180+0000","last_became_active":"2024-06-04T15:52:36.478729+0000","last_became_peered":"2024-06-04T15:52:36.478729+0000","last_unstale":"2024-06-04T16:18:40.009180+0000","last_undegraded":"2024-06-04T16:18:40.009180+0000","last_fullsized":"2024-06-04T16:18:40.009180+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T01:31:26.285385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6659325,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":108,"num_read_kb":2222,"num_write":295,"num_write_kb":32111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,1],"acting":[4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":494,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:30.128608+0000","last_change":"2024-06-04T15:52:22.429208+0000","last_active":"2024-06-04T16:19:30.128608+0000","last_peered":"2024-06-04T16:19:30.128608+0000","last_clean":"2024-06-04T16:19:30.128608+0000","last_became_active":"2024-06-04T15:52:22.428894+0000","last_became_peered":"2024-06-04T15:52:22.428894+0000","last_unstale":"2024-06-04T16:19:30.128608+0000","last_undegraded":"2024-06-04T16:19:30.128608+0000","last_fullsized":"2024-06-04T16:19:30.128608+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:21.400880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:21.400880+0000","last_clean_scrub_stamp":"2024-06-04T15:52:21.400880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T18:26:12.779439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":476,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:45.009808+0000","last_change":"2024-06-04T15:52:40.479253+0000","last_active":"2024-06-04T16:18:45.009808+0000","last_peered":"2024-06-04T16:18:45.009808+0000","last_clean":"2024-06-04T16:18:45.009808+0000","last_became_active":"2024-06-04T15:52:40.478970+0000","last_became_peered":"2024-06-04T15:52:40.478970+0000","last_unstale":"2024-06-04T16:18:45.009808+0000","last_undegraded":"2024-06-04T16:18:45.009808+0000","last_fullsized":"2024-06-04T16:18:45.009808+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_clean_scrub_stamp":"2024-06-04T15:52:39.463103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T00:22:45.981375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"254'244","reported_seq":916,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:32.373366+0000","last_change":"2024-06-04T15:52:42.505691+0000","last_active":"2024-06-04T16:22:32.373366+0000","last_peered":"2024-06-04T16:22:32.373366+0000","last_clean":"2024-06-04T16:22:32.373366+0000","last_became_active":"2024-06-04T15:52:42.504735+0000","last_became_peered":"2024-06-04T15:52:42.504735+0000","last_unstale":"2024-06-04T16:22:32.373366+0000","last_undegraded":"2024-06-04T16:22:32.373366+0000","last_fullsized":"2024-06-04T16:22:32.373366+0000","mapping_epoch":27,"log_start":"251'200","ondisk_log_start":"251'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_clean_scrub_stamp":"2024-06-04T15:52:41.476734+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":200,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T23:26:21.492914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22990,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":382,"num_read_kb":526,"num_write":178,"num_write_kb":35,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":468,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:50.018529+0000","last_change":"2024-06-04T15:52:44.523070+0000","last_active":"2024-06-04T16:19:50.018529+0000","last_peered":"2024-06-04T16:19:50.018529+0000","last_clean":"2024-06-04T16:19:50.018529+0000","last_became_active":"2024-06-04T15:52:44.522746+0000","last_became_peered":"2024-06-04T15:52:44.522746+0000","last_unstale":"2024-06-04T16:19:50.018529+0000","last_undegraded":"2024-06-04T16:19:50.018529+0000","last_fullsized":"2024-06-04T16:19:50.018529+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_clean_scrub_stamp":"2024-06-04T15:52:43.492872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T02:29:17.973008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.d","version":"254'26","reported_seq":498,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:50.011272+0000","last_change":"2024-06-04T15:52:46.530753+0000","last_active":"2024-06-04T16:19:50.011272+0000","last_peered":"2024-06-04T16:19:50.011272+0000","last_clean":"2024-06-04T16:19:50.011272+0000","last_became_active":"2024-06-04T15:52:46.530480+0000","last_became_peered":"2024-06-04T15:52:46.530480+0000","last_unstale":"2024-06-04T16:19:50.011272+0000","last_undegraded":"2024-06-04T16:19:50.011272+0000","last_fullsized":"2024-06-04T16:19:50.011272+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:45.513877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:45.513877+0000","last_clean_scrub_stamp":"2024-06-04T15:52:45.513877+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T21:20:10.067602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":260,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":42,"num_read_kb":31,"num_write":58,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"254'173","reported_seq":1002,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:45.009776+0000","last_change":"2024-06-04T15:52:38.485046+0000","last_active":"2024-06-04T16:18:45.009776+0000","last_peered":"2024-06-04T16:18:45.009776+0000","last_clean":"2024-06-04T16:18:45.009776+0000","last_became_active":"2024-06-04T15:52:38.484384+0000","last_became_peered":"2024-06-04T15:52:38.484384+0000","last_unstale":"2024-06-04T16:18:45.009776+0000","last_undegraded":"2024-06-04T16:18:45.009776+0000","last_fullsized":"2024-06-04T16:18:45.009776+0000","mapping_epoch":23,"log_start":"251'100","ondisk_log_start":"251'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":100,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T21:07:28.223775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":881,"num_read_kb":808,"num_write":233,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"251'46","reported_seq":543,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:40.009204+0000","last_change":"2024-06-04T15:52:36.478112+0000","last_active":"2024-06-04T16:18:40.009204+0000","last_peered":"2024-06-04T16:18:40.009204+0000","last_clean":"2024-06-04T16:18:40.009204+0000","last_became_active":"2024-06-04T15:52:36.477622+0000","last_became_peered":"2024-06-04T15:52:36.477622+0000","last_unstale":"2024-06-04T16:18:40.009204+0000","last_undegraded":"2024-06-04T16:18:40.009204+0000","last_fullsized":"2024-06-04T16:18:40.009204+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T20:13:45.546860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":45,"num_write":152,"num_write_kb":28742,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":492,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:35.009750+0000","last_change":"2024-06-04T15:52:22.777104+0000","last_active":"2024-06-04T16:19:35.009750+0000","last_peered":"2024-06-04T16:19:35.009750+0000","last_clean":"2024-06-04T16:19:35.009750+0000","last_became_active":"2024-06-04T15:52:22.776744+0000","last_became_peered":"2024-06-04T15:52:22.776744+0000","last_unstale":"2024-06-04T16:19:35.009750+0000","last_undegraded":"2024-06-04T16:19:35.009750+0000","last_fullsized":"2024-06-04T16:19:35.009750+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:21.400880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:21.400880+0000","last_clean_scrub_stamp":"2024-06-04T15:52:21.400880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T17:51:56.775723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":475,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:45.015027+0000","last_change":"2024-06-04T15:52:40.479829+0000","last_active":"2024-06-04T16:19:45.015027+0000","last_peered":"2024-06-04T16:19:45.015027+0000","last_clean":"2024-06-04T16:19:45.015027+0000","last_became_active":"2024-06-04T15:52:40.479319+0000","last_became_peered":"2024-06-04T15:52:40.479319+0000","last_unstale":"2024-06-04T16:19:45.015027+0000","last_undegraded":"2024-06-04T16:19:45.015027+0000","last_fullsized":"2024-06-04T16:19:45.015027+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_clean_scrub_stamp":"2024-06-04T15:52:39.463103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T19:40:34.615992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"251'66","reported_seq":567,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:50.015638+0000","last_change":"2024-06-04T15:52:42.500455+0000","last_active":"2024-06-04T16:19:50.015638+0000","last_peered":"2024-06-04T16:19:50.015638+0000","last_clean":"2024-06-04T16:19:50.015638+0000","last_became_active":"2024-06-04T15:52:42.500141+0000","last_became_peered":"2024-06-04T15:52:42.500141+0000","last_unstale":"2024-06-04T16:19:50.015638+0000","last_undegraded":"2024-06-04T16:19:50.015638+0000","last_fullsized":"2024-06-04T16:19:50.015638+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_clean_scrub_stamp":"2024-06-04T15:52:41.476734+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T19:52:33.859931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":90,"num_read_kb":83,"num_write":60,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"254'476","reported_seq":1471,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:32.412965+0000","last_change":"2024-06-04T15:52:44.517489+0000","last_active":"2024-06-04T16:22:32.412965+0000","last_peered":"2024-06-04T16:22:32.412965+0000","last_clean":"2024-06-04T16:22:32.412965+0000","last_became_active":"2024-06-04T15:52:44.517202+0000","last_became_peered":"2024-06-04T15:52:44.517202+0000","last_unstale":"2024-06-04T16:22:32.412965+0000","last_undegraded":"2024-06-04T16:22:32.412965+0000","last_fullsized":"2024-06-04T16:22:32.412965+0000","mapping_epoch":29,"log_start":"251'400","ondisk_log_start":"251'400","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_clean_scrub_stamp":"2024-06-04T15:52:43.492872+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":400,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T18:33:54.152070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.c","version":"254'27","reported_seq":495,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:50.019201+0000","last_change":"2024-06-04T15:52:46.539323+0000","last_active":"2024-06-04T16:19:50.019201+0000","last_peered":"2024-06-04T16:19:50.019201+0000","last_clean":"2024-06-04T16:19:50.019201+0000","last_became_active":"2024-06-04T15:52:46.538975+0000","last_became_peered":"2024-06-04T15:52:46.538975+0000","last_unstale":"2024-06-04T16:19:50.019201+0000","last_undegraded":"2024-06-04T16:19:50.019201+0000","last_fullsized":"2024-06-04T16:19:50.019201+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:45.513877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:45.513877+0000","last_clean_scrub_stamp":"2024-06-04T15:52:45.513877+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T19:08:40.491462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":27,"num_write":64,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3","version":"254'179","reported_seq":1065,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:45.017635+0000","last_change":"2024-06-04T15:52:38.483119+0000","last_active":"2024-06-04T16:19:45.017635+0000","last_peered":"2024-06-04T16:19:45.017635+0000","last_clean":"2024-06-04T16:19:45.017635+0000","last_became_active":"2024-06-04T15:52:38.482240+0000","last_became_peered":"2024-06-04T15:52:38.482240+0000","last_unstale":"2024-06-04T16:19:45.017635+0000","last_undegraded":"2024-06-04T16:19:45.017635+0000","last_fullsized":"2024-06-04T16:19:45.017635+0000","mapping_epoch":23,"log_start":"251'100","ondisk_log_start":"251'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":100,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T17:54:39.066445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1045,"num_read_kb":968,"num_write":230,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"251'34","reported_seq":524,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:45.017653+0000","last_change":"2024-06-04T15:52:36.478791+0000","last_active":"2024-06-04T16:19:45.017653+0000","last_peered":"2024-06-04T16:19:45.017653+0000","last_clean":"2024-06-04T16:19:45.017653+0000","last_became_active":"2024-06-04T15:52:36.478441+0000","last_became_peered":"2024-06-04T15:52:36.478441+0000","last_unstale":"2024-06-04T16:19:45.017653+0000","last_undegraded":"2024-06-04T16:19:45.017653+0000","last_fullsized":"2024-06-04T16:19:45.017653+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T20:43:41.486063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":32,"num_read_kb":7500,"num_write":131,"num_write_kb":23723,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,4],"acting":[6,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":492,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:20.005348+0000","last_change":"2024-06-04T15:52:22.777126+0000","last_active":"2024-06-04T16:18:20.005348+0000","last_peered":"2024-06-04T16:18:20.005348+0000","last_clean":"2024-06-04T16:18:20.005348+0000","last_became_active":"2024-06-04T15:52:22.776729+0000","last_became_peered":"2024-06-04T15:52:22.776729+0000","last_unstale":"2024-06-04T16:18:20.005348+0000","last_undegraded":"2024-06-04T16:18:20.005348+0000","last_fullsized":"2024-06-04T16:18:20.005348+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:21.400880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:21.400880+0000","last_clean_scrub_stamp":"2024-06-04T15:52:21.400880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T03:08:22.360737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":478,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:45.010094+0000","last_change":"2024-06-04T15:52:40.482239+0000","last_active":"2024-06-04T16:19:45.010094+0000","last_peered":"2024-06-04T16:19:45.010094+0000","last_clean":"2024-06-04T16:19:45.010094+0000","last_became_active":"2024-06-04T15:52:40.481870+0000","last_became_peered":"2024-06-04T15:52:40.481870+0000","last_unstale":"2024-06-04T16:19:45.010094+0000","last_undegraded":"2024-06-04T16:19:45.010094+0000","last_fullsized":"2024-06-04T16:19:45.010094+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_clean_scrub_stamp":"2024-06-04T15:52:39.463103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T22:10:27.168145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"254'99","reported_seq":618,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:50.018377+0000","last_change":"2024-06-04T15:52:42.502041+0000","last_active":"2024-06-04T16:19:50.018377+0000","last_peered":"2024-06-04T16:19:50.018377+0000","last_clean":"2024-06-04T16:19:50.018377+0000","last_became_active":"2024-06-04T15:52:42.501708+0000","last_became_peered":"2024-06-04T15:52:42.501708+0000","last_unstale":"2024-06-04T16:19:50.018377+0000","last_undegraded":"2024-06-04T16:19:50.018377+0000","last_fullsized":"2024-06-04T16:19:50.018377+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_clean_scrub_stamp":"2024-06-04T15:52:41.476734+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T18:42:19.221112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":147,"num_read_kb":140,"num_write":98,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.0","version":"254'467","reported_seq":1645,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:32.408757+0000","last_change":"2024-06-04T15:52:44.517953+0000","last_active":"2024-06-04T16:22:32.408757+0000","last_peered":"2024-06-04T16:22:32.408757+0000","last_clean":"2024-06-04T16:22:32.408757+0000","last_became_active":"2024-06-04T15:52:44.517066+0000","last_became_peered":"2024-06-04T15:52:44.517066+0000","last_unstale":"2024-06-04T16:22:32.408757+0000","last_undegraded":"2024-06-04T16:22:32.408757+0000","last_fullsized":"2024-06-04T16:22:32.408757+0000","mapping_epoch":29,"log_start":"251'400","ondisk_log_start":"251'400","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_clean_scrub_stamp":"2024-06-04T15:52:43.492872+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":400,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T19:11:31.141097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"254'27","reported_seq":493,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:05.151518+0000","last_change":"2024-06-04T15:52:46.532254+0000","last_active":"2024-06-04T16:22:05.151518+0000","last_peered":"2024-06-04T16:22:05.151518+0000","last_clean":"2024-06-04T16:22:05.151518+0000","last_became_active":"2024-06-04T15:52:46.531967+0000","last_became_peered":"2024-06-04T15:52:46.531967+0000","last_unstale":"2024-06-04T16:22:05.151518+0000","last_undegraded":"2024-06-04T16:22:05.151518+0000","last_fullsized":"2024-06-04T16:22:05.151518+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:45.513877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:45.513877+0000","last_clean_scrub_stamp":"2024-06-04T15:52:45.513877+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T21:57:32.068478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":905,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":28,"num_read_kb":26,"num_write":64,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2","version":"254'131","reported_seq":930,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:45.017599+0000","last_change":"2024-06-04T15:52:38.481406+0000","last_active":"2024-06-04T16:19:45.017599+0000","last_peered":"2024-06-04T16:19:45.017599+0000","last_clean":"2024-06-04T16:19:45.017599+0000","last_became_active":"2024-06-04T15:52:38.480942+0000","last_became_peered":"2024-06-04T15:52:38.480942+0000","last_unstale":"2024-06-04T16:19:45.017599+0000","last_undegraded":"2024-06-04T16:19:45.017599+0000","last_fullsized":"2024-06-04T16:19:45.017599+0000","mapping_epoch":23,"log_start":"251'100","ondisk_log_start":"251'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T20:49:38.683287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":705,"num_read_kb":672,"num_write":147,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"251'54","reported_seq":559,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:50.011302+0000","last_change":"2024-06-04T15:52:36.484356+0000","last_active":"2024-06-04T16:19:50.011302+0000","last_peered":"2024-06-04T16:19:50.011302+0000","last_clean":"2024-06-04T16:19:50.011302+0000","last_became_active":"2024-06-04T15:52:36.480469+0000","last_became_peered":"2024-06-04T15:52:36.480469+0000","last_unstale":"2024-06-04T16:19:50.011302+0000","last_undegraded":"2024-06-04T16:19:50.011302+0000","last_fullsized":"2024-06-04T16:19:50.011302+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T23:54:02.222955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":69,"num_read_kb":32811,"num_write":225,"num_write_kb":30438,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,4],"acting":[2,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":494,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:25.112378+0000","last_change":"2024-06-04T15:52:22.777053+0000","last_active":"2024-06-04T16:18:25.112378+0000","last_peered":"2024-06-04T16:18:25.112378+0000","last_clean":"2024-06-04T16:18:25.112378+0000","last_became_active":"2024-06-04T15:52:22.776723+0000","last_became_peered":"2024-06-04T15:52:22.776723+0000","last_unstale":"2024-06-04T16:18:25.112378+0000","last_undegraded":"2024-06-04T16:18:25.112378+0000","last_fullsized":"2024-06-04T16:18:25.112378+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:21.400880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:21.400880+0000","last_clean_scrub_stamp":"2024-06-04T15:52:21.400880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T02:40:05.098206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":476,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:45.017841+0000","last_change":"2024-06-04T15:52:40.484565+0000","last_active":"2024-06-04T16:19:45.017841+0000","last_peered":"2024-06-04T16:19:45.017841+0000","last_clean":"2024-06-04T16:19:45.017841+0000","last_became_active":"2024-06-04T15:52:40.483802+0000","last_became_peered":"2024-06-04T15:52:40.483802+0000","last_unstale":"2024-06-04T16:19:45.017841+0000","last_undegraded":"2024-06-04T16:19:45.017841+0000","last_fullsized":"2024-06-04T16:19:45.017841+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_clean_scrub_stamp":"2024-06-04T15:52:39.463103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T18:37:27.476845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"254'193","reported_seq":810,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:32.376834+0000","last_change":"2024-06-04T15:52:42.499319+0000","last_active":"2024-06-04T16:22:32.376834+0000","last_peered":"2024-06-04T16:22:32.376834+0000","last_clean":"2024-06-04T16:22:32.376834+0000","last_became_active":"2024-06-04T15:52:42.499002+0000","last_became_peered":"2024-06-04T15:52:42.499002+0000","last_unstale":"2024-06-04T16:22:32.376834+0000","last_undegraded":"2024-06-04T16:22:32.376834+0000","last_fullsized":"2024-06-04T16:22:32.376834+0000","mapping_epoch":27,"log_start":"251'100","ondisk_log_start":"251'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_clean_scrub_stamp":"2024-06-04T15:52:41.476734+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":100,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T03:36:55.807593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24431,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":293,"num_read_kb":371,"num_write":146,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":466,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:50.011194+0000","last_change":"2024-06-04T15:52:44.520800+0000","last_active":"2024-06-04T16:19:50.011194+0000","last_peered":"2024-06-04T16:19:50.011194+0000","last_clean":"2024-06-04T16:19:50.011194+0000","last_became_active":"2024-06-04T15:52:44.520499+0000","last_became_peered":"2024-06-04T15:52:44.520499+0000","last_unstale":"2024-06-04T16:19:50.011194+0000","last_undegraded":"2024-06-04T16:19:50.011194+0000","last_fullsized":"2024-06-04T16:19:50.011194+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_clean_scrub_stamp":"2024-06-04T15:52:43.492872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T01:16:43.243739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"254'25","reported_seq":498,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:50.019241+0000","last_change":"2024-06-04T15:52:46.542360+0000","last_active":"2024-06-04T16:19:50.019241+0000","last_peered":"2024-06-04T16:19:50.019241+0000","last_clean":"2024-06-04T16:19:50.019241+0000","last_became_active":"2024-06-04T15:52:46.541768+0000","last_became_peered":"2024-06-04T15:52:46.541768+0000","last_unstale":"2024-06-04T16:19:50.019241+0000","last_undegraded":"2024-06-04T16:19:50.019241+0000","last_fullsized":"2024-06-04T16:19:50.019241+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:45.513877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:45.513877+0000","last_clean_scrub_stamp":"2024-06-04T15:52:45.513877+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T20:45:40.593310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":34,"num_write":60,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"254'24","reported_seq":489,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:55.019539+0000","last_change":"2024-06-04T15:52:46.541003+0000","last_active":"2024-06-04T16:19:55.019539+0000","last_peered":"2024-06-04T16:19:55.019539+0000","last_clean":"2024-06-04T16:19:55.019539+0000","last_became_active":"2024-06-04T15:52:46.540733+0000","last_became_peered":"2024-06-04T15:52:46.540733+0000","last_unstale":"2024-06-04T16:19:55.019539+0000","last_undegraded":"2024-06-04T16:19:55.019539+0000","last_fullsized":"2024-06-04T16:19:55.019539+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:45.513877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:45.513877+0000","last_clean_scrub_stamp":"2024-06-04T15:52:45.513877+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T23:13:36.615780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":53,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"254'151","reported_seq":916,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:22.092985+0000","last_change":"2024-06-04T15:52:38.480198+0000","last_active":"2024-06-04T16:18:22.092985+0000","last_peered":"2024-06-04T16:18:22.092985+0000","last_clean":"2024-06-04T16:18:22.092985+0000","last_became_active":"2024-06-04T15:52:38.479929+0000","last_became_peered":"2024-06-04T15:52:38.479929+0000","last_unstale":"2024-06-04T16:18:22.092985+0000","last_undegraded":"2024-06-04T16:18:22.092985+0000","last_fullsized":"2024-06-04T16:18:22.092985+0000","mapping_epoch":23,"log_start":"251'100","ondisk_log_start":"251'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":100,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T18:53:28.230708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":770,"num_read_kb":699,"num_write":204,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"251'34","reported_seq":545,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:25.005933+0000","last_change":"2024-06-04T15:52:36.497838+0000","last_active":"2024-06-04T16:18:25.005933+0000","last_peered":"2024-06-04T16:18:25.005933+0000","last_clean":"2024-06-04T16:18:25.005933+0000","last_became_active":"2024-06-04T15:52:36.497532+0000","last_became_peered":"2024-06-04T15:52:36.497532+0000","last_unstale":"2024-06-04T16:18:25.005933+0000","last_undegraded":"2024-06-04T16:18:25.005933+0000","last_fullsized":"2024-06-04T16:18:25.005933+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T16:03:02.229193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":54,"num_read_kb":42110,"num_write":160,"num_write_kb":16147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":470,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:20.006124+0000","last_change":"2024-06-04T15:52:40.484157+0000","last_active":"2024-06-04T16:18:20.006124+0000","last_peered":"2024-06-04T16:18:20.006124+0000","last_clean":"2024-06-04T16:18:20.006124+0000","last_became_active":"2024-06-04T15:52:40.483882+0000","last_became_peered":"2024-06-04T15:52:40.483882+0000","last_unstale":"2024-06-04T16:18:20.006124+0000","last_undegraded":"2024-06-04T16:18:20.006124+0000","last_fullsized":"2024-06-04T16:18:20.006124+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_clean_scrub_stamp":"2024-06-04T15:52:39.463103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T16:24:11.194485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.11","version":"254'92","reported_seq":626,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:20:45.026804+0000","last_change":"2024-06-04T15:52:42.504482+0000","last_active":"2024-06-04T16:20:45.026804+0000","last_peered":"2024-06-04T16:20:45.026804+0000","last_clean":"2024-06-04T16:20:45.026804+0000","last_became_active":"2024-06-04T15:52:42.504144+0000","last_became_peered":"2024-06-04T15:52:42.504144+0000","last_unstale":"2024-06-04T16:20:45.026804+0000","last_undegraded":"2024-06-04T16:20:45.026804+0000","last_fullsized":"2024-06-04T16:20:45.026804+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_clean_scrub_stamp":"2024-06-04T15:52:41.476734+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T18:40:42.712100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14313,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":136,"num_read_kb":190,"num_write":66,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":466,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:25.119072+0000","last_change":"2024-06-04T15:52:44.517996+0000","last_active":"2024-06-04T16:18:25.119072+0000","last_peered":"2024-06-04T16:18:25.119072+0000","last_clean":"2024-06-04T16:18:25.119072+0000","last_became_active":"2024-06-04T15:52:44.517718+0000","last_became_peered":"2024-06-04T15:52:44.517718+0000","last_unstale":"2024-06-04T16:18:25.119072+0000","last_undegraded":"2024-06-04T16:18:25.119072+0000","last_fullsized":"2024-06-04T16:18:25.119072+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_clean_scrub_stamp":"2024-06-04T15:52:43.492872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T16:20:37.573553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1e","version":"254'42","reported_seq":511,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:50.123024+0000","last_change":"2024-06-04T15:52:46.537867+0000","last_active":"2024-06-04T16:18:50.123024+0000","last_peered":"2024-06-04T16:18:50.123024+0000","last_clean":"2024-06-04T16:18:50.123024+0000","last_became_active":"2024-06-04T15:52:46.536917+0000","last_became_peered":"2024-06-04T15:52:46.536917+0000","last_unstale":"2024-06-04T16:18:50.123024+0000","last_undegraded":"2024-06-04T16:18:50.123024+0000","last_fullsized":"2024-06-04T16:18:50.123024+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:45.513877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:45.513877+0000","last_clean_scrub_stamp":"2024-06-04T15:52:45.513877+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T01:16:32.378412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":42,"num_write":101,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"254'151","reported_seq":983,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:22.327242+0000","last_change":"2024-06-04T15:52:38.488440+0000","last_active":"2024-06-04T16:18:22.327242+0000","last_peered":"2024-06-04T16:18:22.327242+0000","last_clean":"2024-06-04T16:18:22.327242+0000","last_became_active":"2024-06-04T15:52:38.488159+0000","last_became_peered":"2024-06-04T15:52:38.488159+0000","last_unstale":"2024-06-04T16:18:22.327242+0000","last_undegraded":"2024-06-04T16:18:22.327242+0000","last_fullsized":"2024-06-04T16:18:22.327242+0000","mapping_epoch":23,"log_start":"251'100","ondisk_log_start":"251'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":100,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T21:49:36.508131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":952,"num_read_kb":891,"num_write":194,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.15","version":"251'69","reported_seq":603,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:15.007185+0000","last_change":"2024-06-04T15:52:36.492824+0000","last_active":"2024-06-04T16:19:15.007185+0000","last_peered":"2024-06-04T16:19:15.007185+0000","last_clean":"2024-06-04T16:19:15.007185+0000","last_became_active":"2024-06-04T15:52:36.492503+0000","last_became_peered":"2024-06-04T15:52:36.492503+0000","last_unstale":"2024-06-04T16:19:15.007185+0000","last_undegraded":"2024-06-04T16:19:15.007185+0000","last_fullsized":"2024-06-04T16:19:15.007185+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T02:41:20.493195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":528536,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":128,"num_read_kb":6583,"num_write":319,"num_write_kb":16503,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,3],"acting":[0,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":474,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:20.006632+0000","last_change":"2024-06-04T15:52:40.484769+0000","last_active":"2024-06-04T16:18:20.006632+0000","last_peered":"2024-06-04T16:18:20.006632+0000","last_clean":"2024-06-04T16:18:20.006632+0000","last_became_active":"2024-06-04T15:52:40.484480+0000","last_became_peered":"2024-06-04T15:52:40.484480+0000","last_unstale":"2024-06-04T16:18:20.006632+0000","last_undegraded":"2024-06-04T16:18:20.006632+0000","last_fullsized":"2024-06-04T16:18:20.006632+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_clean_scrub_stamp":"2024-06-04T15:52:39.463103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T22:51:50.840432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"251'18","reported_seq":494,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:25.007177+0000","last_change":"2024-06-04T15:52:42.499940+0000","last_active":"2024-06-04T16:18:25.007177+0000","last_peered":"2024-06-04T16:18:25.007177+0000","last_clean":"2024-06-04T16:18:25.007177+0000","last_became_active":"2024-06-04T15:52:42.499592+0000","last_became_peered":"2024-06-04T15:52:42.499592+0000","last_unstale":"2024-06-04T16:18:25.007177+0000","last_undegraded":"2024-06-04T16:18:25.007177+0000","last_fullsized":"2024-06-04T16:18:25.007177+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_clean_scrub_stamp":"2024-06-04T15:52:41.476734+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T18:27:38.404606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":19,"num_read_kb":17,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":464,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:25.002431+0000","last_change":"2024-06-04T15:52:44.519396+0000","last_active":"2024-06-04T16:18:25.002431+0000","last_peered":"2024-06-04T16:18:25.002431+0000","last_clean":"2024-06-04T16:18:25.002431+0000","last_became_active":"2024-06-04T15:52:44.519102+0000","last_became_peered":"2024-06-04T15:52:44.519102+0000","last_unstale":"2024-06-04T16:18:25.002431+0000","last_undegraded":"2024-06-04T16:18:25.002431+0000","last_fullsized":"2024-06-04T16:18:25.002431+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_clean_scrub_stamp":"2024-06-04T15:52:43.492872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T23:01:48.911900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"254'24","reported_seq":490,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:21.701306+0000","last_change":"2024-06-04T15:52:46.534720+0000","last_active":"2024-06-04T16:18:21.701306+0000","last_peered":"2024-06-04T16:18:21.701306+0000","last_clean":"2024-06-04T16:18:21.701306+0000","last_became_active":"2024-06-04T15:52:46.534277+0000","last_became_peered":"2024-06-04T15:52:46.534277+0000","last_unstale":"2024-06-04T16:18:21.701306+0000","last_undegraded":"2024-06-04T16:18:21.701306+0000","last_fullsized":"2024-06-04T16:18:21.701306+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:45.513877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:45.513877+0000","last_clean_scrub_stamp":"2024-06-04T15:52:45.513877+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T19:20:11.363716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":38,"num_write":55,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"254'221","reported_seq":1035,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:22.093247+0000","last_change":"2024-06-04T15:52:38.482192+0000","last_active":"2024-06-04T16:18:22.093247+0000","last_peered":"2024-06-04T16:18:22.093247+0000","last_clean":"2024-06-04T16:18:22.093247+0000","last_became_active":"2024-06-04T15:52:38.481934+0000","last_became_peered":"2024-06-04T15:52:38.481934+0000","last_unstale":"2024-06-04T16:18:22.093247+0000","last_undegraded":"2024-06-04T16:18:22.093247+0000","last_fullsized":"2024-06-04T16:18:22.093247+0000","mapping_epoch":23,"log_start":"251'200","ondisk_log_start":"251'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":200,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T22:42:27.546656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1128,"num_read_kb":983,"num_write":320,"num_write_kb":131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.16","version":"251'39","reported_seq":528,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:15.007814+0000","last_change":"2024-06-04T15:52:36.481215+0000","last_active":"2024-06-04T16:19:15.007814+0000","last_peered":"2024-06-04T16:19:15.007814+0000","last_clean":"2024-06-04T16:19:15.007814+0000","last_became_active":"2024-06-04T15:52:36.480284+0000","last_became_peered":"2024-06-04T15:52:36.480284+0000","last_unstale":"2024-06-04T16:19:15.007814+0000","last_undegraded":"2024-06-04T16:19:15.007814+0000","last_fullsized":"2024-06-04T16:19:15.007814+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T02:23:34.817120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":37,"num_read_kb":1062,"num_write":155,"num_write_kb":20099,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4],"acting":[2,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":472,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:20.001825+0000","last_change":"2024-06-04T15:52:40.477894+0000","last_active":"2024-06-04T16:18:20.001825+0000","last_peered":"2024-06-04T16:18:20.001825+0000","last_clean":"2024-06-04T16:18:20.001825+0000","last_became_active":"2024-06-04T15:52:40.477609+0000","last_became_peered":"2024-06-04T15:52:40.477609+0000","last_unstale":"2024-06-04T16:18:20.001825+0000","last_undegraded":"2024-06-04T16:18:20.001825+0000","last_fullsized":"2024-06-04T16:18:20.001825+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_clean_scrub_stamp":"2024-06-04T15:52:39.463103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T03:11:16.123786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"254'129","reported_seq":682,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:20:45.139347+0000","last_change":"2024-06-04T15:52:42.496760+0000","last_active":"2024-06-04T16:20:45.139347+0000","last_peered":"2024-06-04T16:20:45.139347+0000","last_clean":"2024-06-04T16:20:45.139347+0000","last_became_active":"2024-06-04T15:52:42.496416+0000","last_became_peered":"2024-06-04T15:52:42.496416+0000","last_unstale":"2024-06-04T16:20:45.139347+0000","last_undegraded":"2024-06-04T16:20:45.139347+0000","last_fullsized":"2024-06-04T16:20:45.139347+0000","mapping_epoch":27,"log_start":"251'100","ondisk_log_start":"251'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_clean_scrub_stamp":"2024-06-04T15:52:41.476734+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T00:10:25.421866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15057,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":187,"num_read_kb":257,"num_write":102,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":468,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:25.112334+0000","last_change":"2024-06-04T15:52:44.520101+0000","last_active":"2024-06-04T16:18:25.112334+0000","last_peered":"2024-06-04T16:18:25.112334+0000","last_clean":"2024-06-04T16:18:25.112334+0000","last_became_active":"2024-06-04T15:52:44.519837+0000","last_became_peered":"2024-06-04T15:52:44.519837+0000","last_unstale":"2024-06-04T16:18:25.112334+0000","last_undegraded":"2024-06-04T16:18:25.112334+0000","last_fullsized":"2024-06-04T16:18:25.112334+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_clean_scrub_stamp":"2024-06-04T15:52:43.492872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T23:02:15.347544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"254'18","reported_seq":479,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:11.644322+0000","last_change":"2024-06-04T15:52:46.529613+0000","last_active":"2024-06-04T16:18:11.644322+0000","last_peered":"2024-06-04T16:18:11.644322+0000","last_clean":"2024-06-04T16:18:11.644322+0000","last_became_active":"2024-06-04T15:52:46.529366+0000","last_became_peered":"2024-06-04T15:52:46.529366+0000","last_unstale":"2024-06-04T16:18:11.644322+0000","last_undegraded":"2024-06-04T16:18:11.644322+0000","last_fullsized":"2024-06-04T16:18:11.644322+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:45.513877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:45.513877+0000","last_clean_scrub_stamp":"2024-06-04T15:52:45.513877+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T19:51:30.893394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":52,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"254'127","reported_seq":829,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:23.264264+0000","last_change":"2024-06-04T15:52:38.488922+0000","last_active":"2024-06-04T16:18:23.264264+0000","last_peered":"2024-06-04T16:18:23.264264+0000","last_clean":"2024-06-04T16:18:23.264264+0000","last_became_active":"2024-06-04T15:52:38.488622+0000","last_became_peered":"2024-06-04T15:52:38.488622+0000","last_unstale":"2024-06-04T16:18:23.264264+0000","last_undegraded":"2024-06-04T16:18:23.264264+0000","last_fullsized":"2024-06-04T16:18:23.264264+0000","mapping_epoch":23,"log_start":"251'100","ondisk_log_start":"251'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":100,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T19:55:57.502005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":585,"num_read_kb":532,"num_write":156,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"254'49","reported_seq":560,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:15.014513+0000","last_change":"2024-06-04T15:52:36.483764+0000","last_active":"2024-06-04T16:19:15.014513+0000","last_peered":"2024-06-04T16:19:15.014513+0000","last_clean":"2024-06-04T16:19:15.014513+0000","last_became_active":"2024-06-04T15:52:36.482733+0000","last_became_peered":"2024-06-04T15:52:36.482733+0000","last_unstale":"2024-06-04T16:19:15.014513+0000","last_undegraded":"2024-06-04T16:19:15.014513+0000","last_fullsized":"2024-06-04T16:19:15.014513+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T18:40:07.443876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5328009,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":81,"num_read_kb":13463,"num_write":226,"num_write_kb":36279,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1],"acting":[5,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.11","version":"33'4","reported_seq":777,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:32.119414+0000","last_change":"2024-06-04T15:52:40.479576+0000","last_active":"2024-06-04T16:22:32.119414+0000","last_peered":"2024-06-04T16:22:32.119414+0000","last_clean":"2024-06-04T16:22:32.119414+0000","last_became_active":"2024-06-04T15:52:40.479002+0000","last_became_peered":"2024-06-04T15:52:40.479002+0000","last_unstale":"2024-06-04T16:22:32.119414+0000","last_undegraded":"2024-06-04T16:22:32.119414+0000","last_fullsized":"2024-06-04T16:22:32.119414+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_clean_scrub_stamp":"2024-06-04T15:52:39.463103+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T19:07:30.419008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":460,"num_read_kb":752,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"254'83","reported_seq":620,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:20:45.016085+0000","last_change":"2024-06-04T15:52:42.506197+0000","last_active":"2024-06-04T16:20:45.016085+0000","last_peered":"2024-06-04T16:20:45.016085+0000","last_clean":"2024-06-04T16:20:45.016085+0000","last_became_active":"2024-06-04T15:52:42.505955+0000","last_became_peered":"2024-06-04T15:52:42.505955+0000","last_unstale":"2024-06-04T16:20:45.016085+0000","last_undegraded":"2024-06-04T16:20:45.016085+0000","last_fullsized":"2024-06-04T16:20:45.016085+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_clean_scrub_stamp":"2024-06-04T15:52:41.476734+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T22:41:05.443654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":122,"num_read_kb":141,"num_write":56,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":466,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:25.119122+0000","last_change":"2024-06-04T15:52:44.520920+0000","last_active":"2024-06-04T16:18:25.119122+0000","last_peered":"2024-06-04T16:18:25.119122+0000","last_clean":"2024-06-04T16:18:25.119122+0000","last_became_active":"2024-06-04T15:52:44.519975+0000","last_became_peered":"2024-06-04T15:52:44.519975+0000","last_unstale":"2024-06-04T16:18:25.119122+0000","last_undegraded":"2024-06-04T16:18:25.119122+0000","last_fullsized":"2024-06-04T16:18:25.119122+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_clean_scrub_stamp":"2024-06-04T15:52:43.492872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T18:00:51.312734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1f","version":"254'93","reported_seq":773,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:45.015161+0000","last_change":"2024-06-04T15:52:38.485442+0000","last_active":"2024-06-04T16:19:45.015161+0000","last_peered":"2024-06-04T16:19:45.015161+0000","last_clean":"2024-06-04T16:19:45.015161+0000","last_became_active":"2024-06-04T15:52:38.485163+0000","last_became_peered":"2024-06-04T15:52:38.485163+0000","last_unstale":"2024-06-04T16:19:45.015161+0000","last_undegraded":"2024-06-04T16:19:45.015161+0000","last_fullsized":"2024-06-04T16:19:45.015161+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T23:56:24.126758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":477,"num_read_kb":443,"num_write":114,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"254'34","reported_seq":536,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:15.014360+0000","last_change":"2024-06-04T15:52:36.490918+0000","last_active":"2024-06-04T16:19:15.014360+0000","last_peered":"2024-06-04T16:19:15.014360+0000","last_clean":"2024-06-04T16:19:15.014360+0000","last_became_active":"2024-06-04T15:52:36.490297+0000","last_became_peered":"2024-06-04T15:52:36.490297+0000","last_unstale":"2024-06-04T16:19:15.014360+0000","last_undegraded":"2024-06-04T16:19:15.014360+0000","last_fullsized":"2024-06-04T16:19:15.014360+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T23:35:40.012317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2117740,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":52,"num_read_kb":1061,"num_write":120,"num_write_kb":15390,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,3],"acting":[5,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":472,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:45.009473+0000","last_change":"2024-06-04T15:52:40.483258+0000","last_active":"2024-06-04T16:18:45.009473+0000","last_peered":"2024-06-04T16:18:45.009473+0000","last_clean":"2024-06-04T16:18:45.009473+0000","last_became_active":"2024-06-04T15:52:40.482962+0000","last_became_peered":"2024-06-04T15:52:40.482962+0000","last_unstale":"2024-06-04T16:18:45.009473+0000","last_undegraded":"2024-06-04T16:18:45.009473+0000","last_fullsized":"2024-06-04T16:18:45.009473+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_clean_scrub_stamp":"2024-06-04T15:52:39.463103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T17:22:55.939902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"254'144","reported_seq":730,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:32.370258+0000","last_change":"2024-06-04T15:52:42.504117+0000","last_active":"2024-06-04T16:22:32.370258+0000","last_peered":"2024-06-04T16:22:32.370258+0000","last_clean":"2024-06-04T16:22:32.370258+0000","last_became_active":"2024-06-04T15:52:42.503246+0000","last_became_peered":"2024-06-04T15:52:42.503246+0000","last_unstale":"2024-06-04T16:22:32.370258+0000","last_undegraded":"2024-06-04T16:22:32.370258+0000","last_fullsized":"2024-06-04T16:22:32.370258+0000","mapping_epoch":27,"log_start":"251'100","ondisk_log_start":"251'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_clean_scrub_stamp":"2024-06-04T15:52:41.476734+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T17:52:54.231259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8493,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":218,"num_read_kb":265,"num_write":94,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":463,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:17:44.997914+0000","last_change":"2024-06-04T15:52:44.518052+0000","last_active":"2024-06-04T16:17:44.997914+0000","last_peered":"2024-06-04T16:17:44.997914+0000","last_clean":"2024-06-04T16:17:44.997914+0000","last_became_active":"2024-06-04T15:52:44.517715+0000","last_became_peered":"2024-06-04T15:52:44.517715+0000","last_unstale":"2024-06-04T16:17:44.997914+0000","last_undegraded":"2024-06-04T16:17:44.997914+0000","last_fullsized":"2024-06-04T16:17:44.997914+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_clean_scrub_stamp":"2024-06-04T15:52:43.492872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T02:22:55.140000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"254'71","reported_seq":549,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:30.008312+0000","last_change":"2024-06-04T15:52:46.538655+0000","last_active":"2024-06-04T16:18:30.008312+0000","last_peered":"2024-06-04T16:18:30.008312+0000","last_clean":"2024-06-04T16:18:30.008312+0000","last_became_active":"2024-06-04T15:52:46.538338+0000","last_became_peered":"2024-06-04T15:52:46.538338+0000","last_unstale":"2024-06-04T16:18:30.008312+0000","last_undegraded":"2024-06-04T16:18:30.008312+0000","last_fullsized":"2024-06-04T16:18:30.008312+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:45.513877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:45.513877+0000","last_clean_scrub_stamp":"2024-06-04T15:52:45.513877+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T01:20:53.919158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1061,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":107,"num_read_kb":120,"num_write":148,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1e","version":"254'145","reported_seq":914,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:45.009948+0000","last_change":"2024-06-04T15:52:38.484537+0000","last_active":"2024-06-04T16:18:45.009948+0000","last_peered":"2024-06-04T16:18:45.009948+0000","last_clean":"2024-06-04T16:18:45.009948+0000","last_became_active":"2024-06-04T15:52:38.484087+0000","last_became_peered":"2024-06-04T15:52:38.484087+0000","last_unstale":"2024-06-04T16:18:45.009948+0000","last_undegraded":"2024-06-04T16:18:45.009948+0000","last_fullsized":"2024-06-04T16:18:45.009948+0000","mapping_epoch":23,"log_start":"251'100","ondisk_log_start":"251'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":100,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T00:25:14.013091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":710,"num_read_kb":650,"num_write":181,"num_write_kb":49,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"251'48","reported_seq":551,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:20.014446+0000","last_change":"2024-06-04T15:52:36.479337+0000","last_active":"2024-06-04T16:19:20.014446+0000","last_peered":"2024-06-04T16:19:20.014446+0000","last_clean":"2024-06-04T16:19:20.014446+0000","last_became_active":"2024-06-04T15:52:36.477626+0000","last_became_peered":"2024-06-04T15:52:36.477626+0000","last_unstale":"2024-06-04T16:19:20.014446+0000","last_undegraded":"2024-06-04T16:19:20.014446+0000","last_fullsized":"2024-06-04T16:19:20.014446+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T17:38:59.206841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20628,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":58,"num_read_kb":9358,"num_write":184,"num_write_kb":22886,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,1],"acting":[4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":474,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:45.010737+0000","last_change":"2024-06-04T15:52:40.484749+0000","last_active":"2024-06-04T16:19:45.010737+0000","last_peered":"2024-06-04T16:19:45.010737+0000","last_clean":"2024-06-04T16:19:45.010737+0000","last_became_active":"2024-06-04T15:52:40.484444+0000","last_became_peered":"2024-06-04T15:52:40.484444+0000","last_unstale":"2024-06-04T16:19:45.010737+0000","last_undegraded":"2024-06-04T16:19:45.010737+0000","last_fullsized":"2024-06-04T16:19:45.010737+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_clean_scrub_stamp":"2024-06-04T15:52:39.463103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T00:27:18.866376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"254'102","reported_seq":644,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:20:15.018458+0000","last_change":"2024-06-04T15:52:42.498603+0000","last_active":"2024-06-04T16:20:15.018458+0000","last_peered":"2024-06-04T16:20:15.018458+0000","last_clean":"2024-06-04T16:20:15.018458+0000","last_became_active":"2024-06-04T15:52:42.498329+0000","last_became_peered":"2024-06-04T15:52:42.498329+0000","last_unstale":"2024-06-04T16:20:15.018458+0000","last_undegraded":"2024-06-04T16:20:15.018458+0000","last_fullsized":"2024-06-04T16:20:15.018458+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_clean_scrub_stamp":"2024-06-04T15:52:41.476734+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T22:43:07.581595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":161,"num_read_kb":198,"num_write":100,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":467,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:17:45.002004+0000","last_change":"2024-06-04T15:52:44.523780+0000","last_active":"2024-06-04T16:17:45.002004+0000","last_peered":"2024-06-04T16:17:45.002004+0000","last_clean":"2024-06-04T16:17:45.002004+0000","last_became_active":"2024-06-04T15:52:44.523527+0000","last_became_peered":"2024-06-04T15:52:44.523527+0000","last_unstale":"2024-06-04T16:17:45.002004+0000","last_undegraded":"2024-06-04T16:17:45.002004+0000","last_fullsized":"2024-06-04T16:17:45.002004+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_clean_scrub_stamp":"2024-06-04T15:52:43.492872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T03:49:44.080770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.12","version":"254'29","reported_seq":505,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:30.006566+0000","last_change":"2024-06-04T15:52:46.538179+0000","last_active":"2024-06-04T16:18:30.006566+0000","last_peered":"2024-06-04T16:18:30.006566+0000","last_clean":"2024-06-04T16:18:30.006566+0000","last_became_active":"2024-06-04T15:52:46.537899+0000","last_became_peered":"2024-06-04T15:52:46.537899+0000","last_unstale":"2024-06-04T16:18:30.006566+0000","last_undegraded":"2024-06-04T16:18:30.006566+0000","last_fullsized":"2024-06-04T16:18:30.006566+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:45.513877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:45.513877+0000","last_clean_scrub_stamp":"2024-06-04T15:52:45.513877+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T03:08:17.268541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1228,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":67,"num_read_kb":65,"num_write":80,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"254'108","reported_seq":882,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:22.735049+0000","last_change":"2024-06-04T15:52:38.481130+0000","last_active":"2024-06-04T16:18:22.735049+0000","last_peered":"2024-06-04T16:18:22.735049+0000","last_clean":"2024-06-04T16:18:22.735049+0000","last_became_active":"2024-06-04T15:52:38.480458+0000","last_became_peered":"2024-06-04T15:52:38.480458+0000","last_unstale":"2024-06-04T16:18:22.735049+0000","last_undegraded":"2024-06-04T16:18:22.735049+0000","last_fullsized":"2024-06-04T16:18:22.735049+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T00:04:51.320929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":731,"num_read_kb":703,"num_write":125,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1a","version":"254'72","reported_seq":584,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:18.463271+0000","last_change":"2024-06-04T15:52:36.478450+0000","last_active":"2024-06-04T16:18:18.463271+0000","last_peered":"2024-06-04T16:18:18.463271+0000","last_clean":"2024-06-04T16:18:18.463271+0000","last_became_active":"2024-06-04T15:52:36.477885+0000","last_became_peered":"2024-06-04T15:52:36.477885+0000","last_unstale":"2024-06-04T16:18:18.463271+0000","last_undegraded":"2024-06-04T16:18:18.463271+0000","last_fullsized":"2024-06-04T16:18:18.463271+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T20:17:02.464903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1720489,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":87,"num_read_kb":3881,"num_write":288,"num_write_kb":29330,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":471,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:17:39.997325+0000","last_change":"2024-06-04T15:52:40.478223+0000","last_active":"2024-06-04T16:17:39.997325+0000","last_peered":"2024-06-04T16:17:39.997325+0000","last_clean":"2024-06-04T16:17:39.997325+0000","last_became_active":"2024-06-04T15:52:40.477924+0000","last_became_peered":"2024-06-04T15:52:40.477924+0000","last_unstale":"2024-06-04T16:17:39.997325+0000","last_undegraded":"2024-06-04T16:17:39.997325+0000","last_fullsized":"2024-06-04T16:17:39.997325+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_clean_scrub_stamp":"2024-06-04T15:52:39.463103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T00:32:19.586149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"254'90","reported_seq":627,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:21:55.036582+0000","last_change":"2024-06-04T15:52:42.503942+0000","last_active":"2024-06-04T16:21:55.036582+0000","last_peered":"2024-06-04T16:21:55.036582+0000","last_clean":"2024-06-04T16:21:55.036582+0000","last_became_active":"2024-06-04T15:52:42.503579+0000","last_became_peered":"2024-06-04T15:52:42.503579+0000","last_unstale":"2024-06-04T16:21:55.036582+0000","last_undegraded":"2024-06-04T16:21:55.036582+0000","last_fullsized":"2024-06-04T16:21:55.036582+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_clean_scrub_stamp":"2024-06-04T15:52:41.476734+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T18:07:30.315906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5924,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":133,"num_read_kb":171,"num_write":62,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":468,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:45.122366+0000","last_change":"2024-06-04T15:52:44.520226+0000","last_active":"2024-06-04T16:18:45.122366+0000","last_peered":"2024-06-04T16:18:45.122366+0000","last_clean":"2024-06-04T16:18:45.122366+0000","last_became_active":"2024-06-04T15:52:44.519570+0000","last_became_peered":"2024-06-04T15:52:44.519570+0000","last_unstale":"2024-06-04T16:18:45.122366+0000","last_undegraded":"2024-06-04T16:18:45.122366+0000","last_fullsized":"2024-06-04T16:18:45.122366+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_clean_scrub_stamp":"2024-06-04T15:52:43.492872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T00:47:00.033153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.11","version":"254'24","reported_seq":487,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:32.397487+0000","last_change":"2024-06-04T15:52:46.543080+0000","last_active":"2024-06-04T16:22:32.397487+0000","last_peered":"2024-06-04T16:22:32.397487+0000","last_clean":"2024-06-04T16:22:32.397487+0000","last_became_active":"2024-06-04T15:52:46.542820+0000","last_became_peered":"2024-06-04T15:52:46.542820+0000","last_unstale":"2024-06-04T16:22:32.397487+0000","last_undegraded":"2024-06-04T16:22:32.397487+0000","last_fullsized":"2024-06-04T16:22:32.397487+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:45.513877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:45.513877+0000","last_clean_scrub_stamp":"2024-06-04T15:52:45.513877+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T19:52:44.228120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":616,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":20,"num_read_kb":19,"num_write":60,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"254'121","reported_seq":814,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:20.564152+0000","last_change":"2024-06-04T15:52:38.478104+0000","last_active":"2024-06-04T16:18:20.564152+0000","last_peered":"2024-06-04T16:18:20.564152+0000","last_clean":"2024-06-04T16:18:20.564152+0000","last_became_active":"2024-06-04T15:52:38.477059+0000","last_became_peered":"2024-06-04T15:52:38.477059+0000","last_unstale":"2024-06-04T16:18:20.564152+0000","last_undegraded":"2024-06-04T16:18:20.564152+0000","last_fullsized":"2024-06-04T16:18:20.564152+0000","mapping_epoch":23,"log_start":"251'100","ondisk_log_start":"251'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":100,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T03:05:57.769457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":614,"num_read_kb":552,"num_write":164,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"254'62","reported_seq":569,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:20.541573+0000","last_change":"2024-06-04T15:52:36.498271+0000","last_active":"2024-06-04T16:18:20.541573+0000","last_peered":"2024-06-04T16:18:20.541573+0000","last_clean":"2024-06-04T16:18:20.541573+0000","last_became_active":"2024-06-04T15:52:36.497812+0000","last_became_peered":"2024-06-04T15:52:36.497812+0000","last_unstale":"2024-06-04T16:18:20.541573+0000","last_undegraded":"2024-06-04T16:18:20.541573+0000","last_fullsized":"2024-06-04T16:18:20.541573+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T17:50:50.956572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6461638,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":81,"num_read_kb":14576,"num_write":292,"num_write_kb":31387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3],"acting":[4,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":473,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:17:40.001228+0000","last_change":"2024-06-04T15:52:40.482009+0000","last_active":"2024-06-04T16:17:40.001228+0000","last_peered":"2024-06-04T16:17:40.001228+0000","last_clean":"2024-06-04T16:17:40.001228+0000","last_became_active":"2024-06-04T15:52:40.481621+0000","last_became_peered":"2024-06-04T15:52:40.481621+0000","last_unstale":"2024-06-04T16:17:40.001228+0000","last_undegraded":"2024-06-04T16:17:40.001228+0000","last_fullsized":"2024-06-04T16:17:40.001228+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_clean_scrub_stamp":"2024-06-04T15:52:39.463103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T19:33:44.607654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1e","version":"251'44","reported_seq":530,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:50.009057+0000","last_change":"2024-06-04T15:52:42.499792+0000","last_active":"2024-06-04T16:18:50.009057+0000","last_peered":"2024-06-04T16:18:50.009057+0000","last_clean":"2024-06-04T16:18:50.009057+0000","last_became_active":"2024-06-04T15:52:42.499488+0000","last_became_peered":"2024-06-04T15:52:42.499488+0000","last_unstale":"2024-06-04T16:18:50.009057+0000","last_undegraded":"2024-06-04T16:18:50.009057+0000","last_fullsized":"2024-06-04T16:18:50.009057+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_clean_scrub_stamp":"2024-06-04T15:52:41.476734+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T19:43:32.543414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":67,"num_read_kb":62,"num_write":74,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"254'458","reported_seq":1477,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:32.407715+0000","last_change":"2024-06-04T15:52:44.516769+0000","last_active":"2024-06-04T16:22:32.407715+0000","last_peered":"2024-06-04T16:22:32.407715+0000","last_clean":"2024-06-04T16:22:32.407715+0000","last_became_active":"2024-06-04T15:52:44.516460+0000","last_became_peered":"2024-06-04T15:52:44.516460+0000","last_unstale":"2024-06-04T16:22:32.407715+0000","last_undegraded":"2024-06-04T16:22:32.407715+0000","last_fullsized":"2024-06-04T16:22:32.407715+0000","mapping_epoch":29,"log_start":"251'400","ondisk_log_start":"251'400","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_clean_scrub_stamp":"2024-06-04T15:52:43.492872+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":400,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T02:33:02.102892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.10","version":"253'20","reported_seq":490,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:30.006488+0000","last_change":"2024-06-04T15:52:46.538482+0000","last_active":"2024-06-04T16:18:30.006488+0000","last_peered":"2024-06-04T16:18:30.006488+0000","last_clean":"2024-06-04T16:18:30.006488+0000","last_became_active":"2024-06-04T15:52:46.538179+0000","last_became_peered":"2024-06-04T15:52:46.538179+0000","last_unstale":"2024-06-04T16:18:30.006488+0000","last_undegraded":"2024-06-04T16:18:30.006488+0000","last_fullsized":"2024-06-04T16:18:30.006488+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:45.513877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:45.513877+0000","last_clean_scrub_stamp":"2024-06-04T15:52:45.513877+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T16:31:53.780883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":34,"num_read_kb":33,"num_write":53,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"254'122","reported_seq":865,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:22.734965+0000","last_change":"2024-06-04T15:52:38.486563+0000","last_active":"2024-06-04T16:18:22.734965+0000","last_peered":"2024-06-04T16:18:22.734965+0000","last_clean":"2024-06-04T16:18:22.734965+0000","last_became_active":"2024-06-04T15:52:38.485379+0000","last_became_peered":"2024-06-04T15:52:38.485379+0000","last_unstale":"2024-06-04T16:18:22.734965+0000","last_undegraded":"2024-06-04T16:18:22.734965+0000","last_fullsized":"2024-06-04T16:18:22.734965+0000","mapping_epoch":23,"log_start":"254'100","ondisk_log_start":"254'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":100,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T01:24:18.890606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":679,"num_read_kb":622,"num_write":158,"num_write_kb":49,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"251'30","reported_seq":520,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:17:40.107381+0000","last_change":"2024-06-04T15:52:36.486793+0000","last_active":"2024-06-04T16:17:40.107381+0000","last_peered":"2024-06-04T16:17:40.107381+0000","last_clean":"2024-06-04T16:17:40.107381+0000","last_became_active":"2024-06-04T15:52:36.486465+0000","last_became_peered":"2024-06-04T15:52:36.486465+0000","last_unstale":"2024-06-04T16:17:40.107381+0000","last_undegraded":"2024-06-04T16:17:40.107381+0000","last_fullsized":"2024-06-04T16:17:40.107381+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T21:12:11.586706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":30,"num_read_kb":1715,"num_write":122,"num_write_kb":16993,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,5],"acting":[1,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":475,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:17:40.107365+0000","last_change":"2024-06-04T15:52:40.481127+0000","last_active":"2024-06-04T16:17:40.107365+0000","last_peered":"2024-06-04T16:17:40.107365+0000","last_clean":"2024-06-04T16:17:40.107365+0000","last_became_active":"2024-06-04T15:52:40.480832+0000","last_became_peered":"2024-06-04T15:52:40.480832+0000","last_unstale":"2024-06-04T16:17:40.107365+0000","last_undegraded":"2024-06-04T16:17:40.107365+0000","last_fullsized":"2024-06-04T16:17:40.107365+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_clean_scrub_stamp":"2024-06-04T15:52:39.463103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T03:43:52.022773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"254'107","reported_seq":653,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:21:50.022430+0000","last_change":"2024-06-04T15:52:42.502990+0000","last_active":"2024-06-04T16:21:50.022430+0000","last_peered":"2024-06-04T16:21:50.022430+0000","last_clean":"2024-06-04T16:21:50.022430+0000","last_became_active":"2024-06-04T15:52:42.502601+0000","last_became_peered":"2024-06-04T15:52:42.502601+0000","last_unstale":"2024-06-04T16:21:50.022430+0000","last_undegraded":"2024-06-04T16:21:50.022430+0000","last_fullsized":"2024-06-04T16:21:50.022430+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_clean_scrub_stamp":"2024-06-04T15:52:41.476734+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T23:06:11.514444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35064,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":159,"num_read_kb":266,"num_write":82,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":466,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:20.014431+0000","last_change":"2024-06-04T15:52:44.523309+0000","last_active":"2024-06-04T16:19:20.014431+0000","last_peered":"2024-06-04T16:19:20.014431+0000","last_clean":"2024-06-04T16:19:20.014431+0000","last_became_active":"2024-06-04T15:52:44.522992+0000","last_became_peered":"2024-06-04T15:52:44.522992+0000","last_unstale":"2024-06-04T16:19:20.014431+0000","last_undegraded":"2024-06-04T16:19:20.014431+0000","last_fullsized":"2024-06-04T16:19:20.014431+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_clean_scrub_stamp":"2024-06-04T15:52:43.492872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T02:51:54.078930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"251'15","reported_seq":487,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:25.118965+0000","last_change":"2024-06-04T15:52:46.540313+0000","last_active":"2024-06-04T16:19:25.118965+0000","last_peered":"2024-06-04T16:19:25.118965+0000","last_clean":"2024-06-04T16:19:25.118965+0000","last_became_active":"2024-06-04T15:52:46.539985+0000","last_became_peered":"2024-06-04T15:52:46.539985+0000","last_unstale":"2024-06-04T16:19:25.118965+0000","last_undegraded":"2024-06-04T16:19:25.118965+0000","last_fullsized":"2024-06-04T16:19:25.118965+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:45.513877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:45.513877+0000","last_clean_scrub_stamp":"2024-06-04T15:52:45.513877+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T22:40:19.386258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":31,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"254'419","reported_seq":1235,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:20.564110+0000","last_change":"2024-06-04T15:52:38.475289+0000","last_active":"2024-06-04T16:18:20.564110+0000","last_peered":"2024-06-04T16:18:20.564110+0000","last_clean":"2024-06-04T16:18:20.564110+0000","last_became_active":"2024-06-04T15:52:38.474960+0000","last_became_peered":"2024-06-04T15:52:38.474960+0000","last_unstale":"2024-06-04T16:18:20.564110+0000","last_undegraded":"2024-06-04T16:18:20.564110+0000","last_fullsized":"2024-06-04T16:18:20.564110+0000","mapping_epoch":23,"log_start":"251'400","ondisk_log_start":"251'400","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":400,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T01:50:53.656026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2017,"num_read_kb":1794,"num_write":716,"num_write_kb":341,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"254'98","reported_seq":725,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:18.465429+0000","last_change":"2024-06-04T15:52:36.499152+0000","last_active":"2024-06-04T16:18:18.465429+0000","last_peered":"2024-06-04T16:18:18.465429+0000","last_clean":"2024-06-04T16:18:18.465429+0000","last_became_active":"2024-06-04T15:52:36.498806+0000","last_became_peered":"2024-06-04T15:52:36.498806+0000","last_unstale":"2024-06-04T16:18:18.465429+0000","last_undegraded":"2024-06-04T16:18:18.465429+0000","last_fullsized":"2024-06-04T16:18:18.465429+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T16:05:54.071633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64946,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":489,"num_read_kb":127523,"num_write":606,"num_write_kb":22490,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":471,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:17:39.997312+0000","last_change":"2024-06-04T15:52:40.478700+0000","last_active":"2024-06-04T16:17:39.997312+0000","last_peered":"2024-06-04T16:17:39.997312+0000","last_clean":"2024-06-04T16:17:39.997312+0000","last_became_active":"2024-06-04T15:52:40.478417+0000","last_became_peered":"2024-06-04T15:52:40.478417+0000","last_unstale":"2024-06-04T16:17:39.997312+0000","last_undegraded":"2024-06-04T16:17:39.997312+0000","last_fullsized":"2024-06-04T16:17:39.997312+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_clean_scrub_stamp":"2024-06-04T15:52:39.463103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T01:59:06.360123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"254'84","reported_seq":619,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:21:45.035587+0000","last_change":"2024-06-04T15:52:42.496557+0000","last_active":"2024-06-04T16:21:45.035587+0000","last_peered":"2024-06-04T16:21:45.035587+0000","last_clean":"2024-06-04T16:21:45.035587+0000","last_became_active":"2024-06-04T15:52:42.496263+0000","last_became_peered":"2024-06-04T15:52:42.496263+0000","last_unstale":"2024-06-04T16:21:45.035587+0000","last_undegraded":"2024-06-04T16:21:45.035587+0000","last_fullsized":"2024-06-04T16:21:45.035587+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_clean_scrub_stamp":"2024-06-04T15:52:41.476734+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T01:39:37.497606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9886,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":129,"num_read_kb":183,"num_write":62,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":465,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:25.012820+0000","last_change":"2024-06-04T15:52:44.520347+0000","last_active":"2024-06-04T16:19:25.012820+0000","last_peered":"2024-06-04T16:19:25.012820+0000","last_clean":"2024-06-04T16:19:25.012820+0000","last_became_active":"2024-06-04T15:52:44.520051+0000","last_became_peered":"2024-06-04T15:52:44.520051+0000","last_unstale":"2024-06-04T16:19:25.012820+0000","last_undegraded":"2024-06-04T16:19:25.012820+0000","last_fullsized":"2024-06-04T16:19:25.012820+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_clean_scrub_stamp":"2024-06-04T15:52:43.492872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T21:08:39.164476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"254'39","reported_seq":547,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:25.015736+0000","last_change":"2024-06-04T15:52:46.542209+0000","last_active":"2024-06-04T16:19:25.015736+0000","last_peered":"2024-06-04T16:19:25.015736+0000","last_clean":"2024-06-04T16:19:25.015736+0000","last_became_active":"2024-06-04T15:52:46.541897+0000","last_became_peered":"2024-06-04T15:52:46.541897+0000","last_unstale":"2024-06-04T16:19:25.015736+0000","last_undegraded":"2024-06-04T16:19:25.015736+0000","last_fullsized":"2024-06-04T16:19:25.015736+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:45.513877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:45.513877+0000","last_clean_scrub_stamp":"2024-06-04T15:52:45.513877+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T01:21:18.754972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":549,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":152,"num_read_kb":137,"num_write":99,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"254'122","reported_seq":849,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:15.126530+0000","last_change":"2024-06-04T15:52:38.482687+0000","last_active":"2024-06-04T16:19:15.126530+0000","last_peered":"2024-06-04T16:19:15.126530+0000","last_clean":"2024-06-04T16:19:15.126530+0000","last_became_active":"2024-06-04T15:52:38.482388+0000","last_became_peered":"2024-06-04T15:52:38.482388+0000","last_unstale":"2024-06-04T16:19:15.126530+0000","last_undegraded":"2024-06-04T16:19:15.126530+0000","last_fullsized":"2024-06-04T16:19:15.126530+0000","mapping_epoch":23,"log_start":"251'100","ondisk_log_start":"251'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":100,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T19:55:37.296059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":625,"num_read_kb":571,"num_write":157,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1e","version":"251'81","reported_seq":611,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:45.010443+0000","last_change":"2024-06-04T15:52:36.485805+0000","last_active":"2024-06-04T16:18:45.010443+0000","last_peered":"2024-06-04T16:18:45.010443+0000","last_clean":"2024-06-04T16:18:45.010443+0000","last_became_active":"2024-06-04T15:52:36.485401+0000","last_became_peered":"2024-06-04T15:52:36.485401+0000","last_unstale":"2024-06-04T16:18:45.010443+0000","last_undegraded":"2024-06-04T16:18:45.010443+0000","last_fullsized":"2024-06-04T16:18:45.010443+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T21:08:15.786697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133679,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":131,"num_read_kb":40112,"num_write":294,"num_write_kb":27266,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,3],"acting":[5,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":476,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:15.117868+0000","last_change":"2024-06-04T15:52:40.483568+0000","last_active":"2024-06-04T16:19:15.117868+0000","last_peered":"2024-06-04T16:19:15.117868+0000","last_clean":"2024-06-04T16:19:15.117868+0000","last_became_active":"2024-06-04T15:52:40.483272+0000","last_became_peered":"2024-06-04T15:52:40.483272+0000","last_unstale":"2024-06-04T16:19:15.117868+0000","last_undegraded":"2024-06-04T16:19:15.117868+0000","last_fullsized":"2024-06-04T16:19:15.117868+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_clean_scrub_stamp":"2024-06-04T15:52:39.463103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T18:29:36.613477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"254'78","reported_seq":602,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:20:15.022198+0000","last_change":"2024-06-04T15:52:42.497288+0000","last_active":"2024-06-04T16:20:15.022198+0000","last_peered":"2024-06-04T16:20:15.022198+0000","last_clean":"2024-06-04T16:20:15.022198+0000","last_became_active":"2024-06-04T15:52:42.496934+0000","last_became_peered":"2024-06-04T15:52:42.496934+0000","last_unstale":"2024-06-04T16:20:15.022198+0000","last_undegraded":"2024-06-04T16:20:15.022198+0000","last_fullsized":"2024-06-04T16:20:15.022198+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_clean_scrub_stamp":"2024-06-04T15:52:41.476734+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T17:14:55.894511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9483,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":111,"num_read_kb":167,"num_write":50,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":464,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:17:45.001177+0000","last_change":"2024-06-04T15:52:44.519077+0000","last_active":"2024-06-04T16:17:45.001177+0000","last_peered":"2024-06-04T16:17:45.001177+0000","last_clean":"2024-06-04T16:17:45.001177+0000","last_became_active":"2024-06-04T15:52:44.518782+0000","last_became_peered":"2024-06-04T15:52:44.518782+0000","last_unstale":"2024-06-04T16:17:45.001177+0000","last_undegraded":"2024-06-04T16:17:45.001177+0000","last_fullsized":"2024-06-04T16:17:45.001177+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_clean_scrub_stamp":"2024-06-04T15:52:43.492872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T16:06:38.344510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"254'41","reported_seq":528,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:25.012872+0000","last_change":"2024-06-04T15:52:46.532088+0000","last_active":"2024-06-04T16:19:25.012872+0000","last_peered":"2024-06-04T16:19:25.012872+0000","last_clean":"2024-06-04T16:19:25.012872+0000","last_became_active":"2024-06-04T15:52:46.531795+0000","last_became_peered":"2024-06-04T15:52:46.531795+0000","last_unstale":"2024-06-04T16:19:25.012872+0000","last_undegraded":"2024-06-04T16:19:25.012872+0000","last_fullsized":"2024-06-04T16:19:25.012872+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:45.513877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:45.513877+0000","last_clean_scrub_stamp":"2024-06-04T15:52:45.513877+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T00:05:55.568943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":429,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":136,"num_read_kb":110,"num_write":109,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"254'356","reported_seq":1091,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:15.007748+0000","last_change":"2024-06-04T15:52:38.478558+0000","last_active":"2024-06-04T16:19:15.007748+0000","last_peered":"2024-06-04T16:19:15.007748+0000","last_clean":"2024-06-04T16:19:15.007748+0000","last_became_active":"2024-06-04T15:52:38.478204+0000","last_became_peered":"2024-06-04T15:52:38.478204+0000","last_unstale":"2024-06-04T16:19:15.007748+0000","last_undegraded":"2024-06-04T16:19:15.007748+0000","last_fullsized":"2024-06-04T16:19:15.007748+0000","mapping_epoch":23,"log_start":"251'300","ondisk_log_start":"251'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":300,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T17:34:50.324391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1642,"num_read_kb":1482,"num_write":614,"num_write_kb":292,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"251'22","reported_seq":513,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:45.018530+0000","last_change":"2024-06-04T15:52:36.478256+0000","last_active":"2024-06-04T16:19:45.018530+0000","last_peered":"2024-06-04T16:19:45.018530+0000","last_clean":"2024-06-04T16:19:45.018530+0000","last_became_active":"2024-06-04T15:52:36.477895+0000","last_became_peered":"2024-06-04T15:52:36.477895+0000","last_unstale":"2024-06-04T16:19:45.018530+0000","last_undegraded":"2024-06-04T16:19:45.018530+0000","last_fullsized":"2024-06-04T16:19:45.018530+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T22:33:16.679149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":78,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":120,"num_write_kb":13440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.19","version":"26'1","reported_seq":475,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:20.014466+0000","last_change":"2024-06-04T15:52:40.483405+0000","last_active":"2024-06-04T16:19:20.014466+0000","last_peered":"2024-06-04T16:19:20.014466+0000","last_clean":"2024-06-04T16:19:20.014466+0000","last_became_active":"2024-06-04T15:52:40.483131+0000","last_became_peered":"2024-06-04T15:52:40.483131+0000","last_unstale":"2024-06-04T16:19:20.014466+0000","last_undegraded":"2024-06-04T16:19:20.014466+0000","last_fullsized":"2024-06-04T16:19:20.014466+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_clean_scrub_stamp":"2024-06-04T15:52:39.463103+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T20:46:09.924823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1a","version":"254'116","reported_seq":664,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:20:15.018422+0000","last_change":"2024-06-04T15:52:42.503809+0000","last_active":"2024-06-04T16:20:15.018422+0000","last_peered":"2024-06-04T16:20:15.018422+0000","last_clean":"2024-06-04T16:20:15.018422+0000","last_became_active":"2024-06-04T15:52:42.503538+0000","last_became_peered":"2024-06-04T15:52:42.503538+0000","last_unstale":"2024-06-04T16:20:15.018422+0000","last_undegraded":"2024-06-04T16:20:15.018422+0000","last_fullsized":"2024-06-04T16:20:15.018422+0000","mapping_epoch":27,"log_start":"251'100","ondisk_log_start":"251'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_clean_scrub_stamp":"2024-06-04T15:52:41.476734+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":100,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T23:22:34.954352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8203,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":173,"num_read_kb":219,"num_write":92,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":465,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:17:45.001893+0000","last_change":"2024-06-04T15:52:44.520133+0000","last_active":"2024-06-04T16:17:45.001893+0000","last_peered":"2024-06-04T16:17:45.001893+0000","last_clean":"2024-06-04T16:17:45.001893+0000","last_became_active":"2024-06-04T15:52:44.519867+0000","last_became_peered":"2024-06-04T15:52:44.519867+0000","last_unstale":"2024-06-04T16:17:45.001893+0000","last_undegraded":"2024-06-04T16:17:45.001893+0000","last_fullsized":"2024-06-04T16:17:45.001893+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_clean_scrub_stamp":"2024-06-04T15:52:43.492872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T23:38:01.226210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.14","version":"254'30","reported_seq":529,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:35.003247+0000","last_change":"2024-06-04T15:52:46.538083+0000","last_active":"2024-06-04T16:18:35.003247+0000","last_peered":"2024-06-04T16:18:35.003247+0000","last_clean":"2024-06-04T16:18:35.003247+0000","last_became_active":"2024-06-04T15:52:46.537792+0000","last_became_peered":"2024-06-04T15:52:46.537792+0000","last_unstale":"2024-06-04T16:18:35.003247+0000","last_undegraded":"2024-06-04T16:18:35.003247+0000","last_fullsized":"2024-06-04T16:18:35.003247+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:45.513877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:45.513877+0000","last_clean_scrub_stamp":"2024-06-04T15:52:45.513877+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T19:51:33.137699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":433,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":163,"num_read_kb":128,"num_write":83,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"254'156","reported_seq":946,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:40.009213+0000","last_change":"2024-06-04T15:52:38.486670+0000","last_active":"2024-06-04T16:18:40.009213+0000","last_peered":"2024-06-04T16:18:40.009213+0000","last_clean":"2024-06-04T16:18:40.009213+0000","last_became_active":"2024-06-04T15:52:38.486335+0000","last_became_peered":"2024-06-04T15:52:38.486335+0000","last_unstale":"2024-06-04T16:18:40.009213+0000","last_undegraded":"2024-06-04T16:18:40.009213+0000","last_fullsized":"2024-06-04T16:18:40.009213+0000","mapping_epoch":23,"log_start":"251'100","ondisk_log_start":"251'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":100,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T02:25:00.264822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":839,"num_read_kb":763,"num_write":210,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.20","version":"254'53","reported_seq":567,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:45.010633+0000","last_change":"2024-06-04T15:53:14.002874+0000","last_active":"2024-06-04T16:19:45.010633+0000","last_peered":"2024-06-04T16:19:45.010633+0000","last_clean":"2024-06-04T16:19:45.010633+0000","last_became_active":"2024-06-04T15:53:14.002428+0000","last_became_peered":"2024-06-04T15:53:14.002428+0000","last_unstale":"2024-06-04T16:19:45.010633+0000","last_undegraded":"2024-06-04T16:19:45.010633+0000","last_fullsized":"2024-06-04T16:19:45.010633+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T00:01:17.187786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194330,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":80,"num_read_kb":15429,"num_write":205,"num_write_kb":34585,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5],"acting":[2,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"254'241","reported_seq":911,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:40.121513+0000","last_change":"2024-06-04T15:52:38.481773+0000","last_active":"2024-06-04T16:18:40.121513+0000","last_peered":"2024-06-04T16:18:40.121513+0000","last_clean":"2024-06-04T16:18:40.121513+0000","last_became_active":"2024-06-04T15:52:38.481490+0000","last_became_peered":"2024-06-04T15:52:38.481490+0000","last_unstale":"2024-06-04T16:18:40.121513+0000","last_undegraded":"2024-06-04T16:18:40.121513+0000","last_fullsized":"2024-06-04T16:18:40.121513+0000","mapping_epoch":23,"log_start":"251'200","ondisk_log_start":"251'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":200,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T21:24:52.955365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1011,"num_read_kb":836,"num_write":379,"num_write_kb":158,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.21","version":"254'53","reported_seq":554,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:45.130715+0000","last_change":"2024-06-04T15:52:36.495330+0000","last_active":"2024-06-04T16:19:45.130715+0000","last_peered":"2024-06-04T16:19:45.130715+0000","last_clean":"2024-06-04T16:19:45.130715+0000","last_became_active":"2024-06-04T15:52:36.495008+0000","last_became_peered":"2024-06-04T15:52:36.495008+0000","last_unstale":"2024-06-04T16:19:45.130715+0000","last_undegraded":"2024-06-04T16:19:45.130715+0000","last_fullsized":"2024-06-04T16:19:45.130715+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T01:04:03.095444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":62,"num_read_kb":12338,"num_write":218,"num_write_kb":31559,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.25","version":"254'138","reported_seq":973,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:40.007807+0000","last_change":"2024-06-04T15:52:38.482192+0000","last_active":"2024-06-04T16:18:40.007807+0000","last_peered":"2024-06-04T16:18:40.007807+0000","last_clean":"2024-06-04T16:18:40.007807+0000","last_became_active":"2024-06-04T15:52:38.481916+0000","last_became_peered":"2024-06-04T15:52:38.481916+0000","last_unstale":"2024-06-04T16:18:40.007807+0000","last_undegraded":"2024-06-04T16:18:40.007807+0000","last_fullsized":"2024-06-04T16:18:40.007807+0000","mapping_epoch":23,"log_start":"251'100","ondisk_log_start":"251'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T16:53:51.388099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":911,"num_read_kb":859,"num_write":180,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"254'57","reported_seq":584,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:45.015057+0000","last_change":"2024-06-04T15:52:36.482905+0000","last_active":"2024-06-04T16:19:45.015057+0000","last_peered":"2024-06-04T16:19:45.015057+0000","last_clean":"2024-06-04T16:19:45.015057+0000","last_became_active":"2024-06-04T15:52:36.482589+0000","last_became_peered":"2024-06-04T15:52:36.482589+0000","last_unstale":"2024-06-04T16:19:45.015057+0000","last_undegraded":"2024-06-04T16:19:45.015057+0000","last_fullsized":"2024-06-04T16:19:45.015057+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T01:08:39.575276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":133,"num_read_kb":8380,"num_write":297,"num_write_kb":18008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7],"acting":[3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"254'104","reported_seq":811,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:40.009685+0000","last_change":"2024-06-04T15:52:38.486331+0000","last_active":"2024-06-04T16:18:40.009685+0000","last_peered":"2024-06-04T16:18:40.009685+0000","last_clean":"2024-06-04T16:18:40.009685+0000","last_became_active":"2024-06-04T15:52:38.486018+0000","last_became_peered":"2024-06-04T15:52:38.486018+0000","last_unstale":"2024-06-04T16:18:40.009685+0000","last_undegraded":"2024-06-04T16:18:40.009685+0000","last_fullsized":"2024-06-04T16:18:40.009685+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T01:56:20.478655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":549,"num_read_kb":515,"num_write":118,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"251'48","reported_seq":559,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:50.019151+0000","last_change":"2024-06-04T15:52:36.496569+0000","last_active":"2024-06-04T16:19:50.019151+0000","last_peered":"2024-06-04T16:19:50.019151+0000","last_clean":"2024-06-04T16:19:50.019151+0000","last_became_active":"2024-06-04T15:52:36.496125+0000","last_became_peered":"2024-06-04T15:52:36.496125+0000","last_unstale":"2024-06-04T16:19:50.019151+0000","last_undegraded":"2024-06-04T16:19:50.019151+0000","last_fullsized":"2024-06-04T16:19:50.019151+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T19:29:40.820287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":98,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":59,"num_read_kb":26302,"num_write":204,"num_write_kb":24798,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,0],"acting":[5,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.23","version":"254'93","reported_seq":807,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:50.019175+0000","last_change":"2024-06-04T15:52:38.485339+0000","last_active":"2024-06-04T16:19:50.019175+0000","last_peered":"2024-06-04T16:19:50.019175+0000","last_clean":"2024-06-04T16:19:50.019175+0000","last_became_active":"2024-06-04T15:52:38.484927+0000","last_became_peered":"2024-06-04T15:52:38.484927+0000","last_unstale":"2024-06-04T16:19:50.019175+0000","last_undegraded":"2024-06-04T16:19:50.019175+0000","last_fullsized":"2024-06-04T16:19:50.019175+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T21:19:16.498288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":509,"num_read_kb":485,"num_write":106,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"254'52","reported_seq":554,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:40.008829+0000","last_change":"2024-06-04T15:53:14.183689+0000","last_active":"2024-06-04T16:18:40.008829+0000","last_peered":"2024-06-04T16:18:40.008829+0000","last_clean":"2024-06-04T16:18:40.008829+0000","last_became_active":"2024-06-04T15:53:14.183279+0000","last_became_peered":"2024-06-04T15:53:14.183279+0000","last_unstale":"2024-06-04T16:18:40.008829+0000","last_undegraded":"2024-06-04T16:18:40.008829+0000","last_fullsized":"2024-06-04T16:18:40.008829+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T23:59:10.245827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1395816,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":52,"num_read_kb":1141,"num_write":191,"num_write_kb":22936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.22","version":"254'208","reported_seq":1101,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:45.010113+0000","last_change":"2024-06-04T15:52:38.489058+0000","last_active":"2024-06-04T16:19:45.010113+0000","last_peered":"2024-06-04T16:19:45.010113+0000","last_clean":"2024-06-04T16:19:45.010113+0000","last_became_active":"2024-06-04T15:52:38.488762+0000","last_became_peered":"2024-06-04T15:52:38.488762+0000","last_unstale":"2024-06-04T16:19:45.010113+0000","last_undegraded":"2024-06-04T16:19:45.010113+0000","last_fullsized":"2024-06-04T16:19:45.010113+0000","mapping_epoch":23,"log_start":"251'100","ondisk_log_start":"251'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":100,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T02:35:48.920769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1221,"num_read_kb":1130,"num_write":279,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.25","version":"254'51","reported_seq":550,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:40.008870+0000","last_change":"2024-06-04T15:52:36.489331+0000","last_active":"2024-06-04T16:18:40.008870+0000","last_peered":"2024-06-04T16:18:40.008870+0000","last_clean":"2024-06-04T16:18:40.008870+0000","last_became_active":"2024-06-04T15:52:36.488611+0000","last_became_peered":"2024-06-04T15:52:36.488611+0000","last_unstale":"2024-06-04T16:18:40.008870+0000","last_undegraded":"2024-06-04T16:18:40.008870+0000","last_fullsized":"2024-06-04T16:18:40.008870+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T19:29:35.729548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":75,"num_read_kb":4172,"num_write":239,"num_write_kb":26328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"254'157","reported_seq":913,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:45.017560+0000","last_change":"2024-06-04T15:52:38.482854+0000","last_active":"2024-06-04T16:19:45.017560+0000","last_peered":"2024-06-04T16:19:45.017560+0000","last_clean":"2024-06-04T16:19:45.017560+0000","last_became_active":"2024-06-04T15:52:38.482566+0000","last_became_peered":"2024-06-04T15:52:38.482566+0000","last_unstale":"2024-06-04T16:19:45.017560+0000","last_undegraded":"2024-06-04T16:19:45.017560+0000","last_fullsized":"2024-06-04T16:19:45.017560+0000","mapping_epoch":23,"log_start":"251'100","ondisk_log_start":"251'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":100,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T03:29:54.648609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":759,"num_read_kb":686,"num_write":203,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"254'59","reported_seq":559,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:40.004208+0000","last_change":"2024-06-04T15:52:36.487513+0000","last_active":"2024-06-04T16:18:40.004208+0000","last_peered":"2024-06-04T16:18:40.004208+0000","last_clean":"2024-06-04T16:18:40.004208+0000","last_became_active":"2024-06-04T15:52:36.487213+0000","last_became_peered":"2024-06-04T15:52:36.487213+0000","last_unstale":"2024-06-04T16:18:40.004208+0000","last_undegraded":"2024-06-04T16:18:40.004208+0000","last_fullsized":"2024-06-04T16:18:40.004208+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T23:57:12.412972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3860915,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":58,"num_read_kb":7398,"num_write":258,"num_write_kb":28567,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"254'120","reported_seq":861,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:45.120878+0000","last_change":"2024-06-04T15:52:38.477288+0000","last_active":"2024-06-04T16:19:45.120878+0000","last_peered":"2024-06-04T16:19:45.120878+0000","last_clean":"2024-06-04T16:19:45.120878+0000","last_became_active":"2024-06-04T15:52:38.477036+0000","last_became_peered":"2024-06-04T15:52:38.477036+0000","last_unstale":"2024-06-04T16:19:45.120878+0000","last_undegraded":"2024-06-04T16:19:45.120878+0000","last_fullsized":"2024-06-04T16:19:45.120878+0000","mapping_epoch":23,"log_start":"251'100","ondisk_log_start":"251'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":100,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T23:17:01.386746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":627,"num_read_kb":578,"num_write":156,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"254'48","reported_seq":562,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:40.009774+0000","last_change":"2024-06-04T15:52:36.482150+0000","last_active":"2024-06-04T16:18:40.009774+0000","last_peered":"2024-06-04T16:18:40.009774+0000","last_clean":"2024-06-04T16:18:40.009774+0000","last_became_active":"2024-06-04T15:52:36.479810+0000","last_became_peered":"2024-06-04T15:52:36.479810+0000","last_unstale":"2024-06-04T16:18:40.009774+0000","last_undegraded":"2024-06-04T16:18:40.009774+0000","last_fullsized":"2024-06-04T16:18:40.009774+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T21:50:19.054304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048839,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":103,"num_read_kb":5904,"num_write":252,"num_write_kb":17938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2f","version":"254'58","reported_seq":706,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:23.264257+0000","last_change":"2024-06-04T15:52:38.482098+0000","last_active":"2024-06-04T16:18:23.264257+0000","last_peered":"2024-06-04T16:18:23.264257+0000","last_clean":"2024-06-04T16:18:23.264257+0000","last_became_active":"2024-06-04T15:52:38.481789+0000","last_became_peered":"2024-06-04T15:52:38.481789+0000","last_unstale":"2024-06-04T16:18:23.264257+0000","last_undegraded":"2024-06-04T16:18:23.264257+0000","last_fullsized":"2024-06-04T16:18:23.264257+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T21:41:15.834685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":316,"num_read_kb":309,"num_write":62,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.28","version":"254'57","reported_seq":591,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:45.008317+0000","last_change":"2024-06-04T15:52:36.491357+0000","last_active":"2024-06-04T16:18:45.008317+0000","last_peered":"2024-06-04T16:18:45.008317+0000","last_clean":"2024-06-04T16:18:45.008317+0000","last_became_active":"2024-06-04T15:52:36.490119+0000","last_became_peered":"2024-06-04T15:52:36.490119+0000","last_unstale":"2024-06-04T16:18:45.008317+0000","last_undegraded":"2024-06-04T16:18:45.008317+0000","last_fullsized":"2024-06-04T16:18:45.008317+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T02:06:04.469487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262178,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":124,"num_read_kb":46547,"num_write":231,"num_write_kb":19872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7],"acting":[3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"254'93","reported_seq":777,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:20.001732+0000","last_change":"2024-06-04T15:52:38.489137+0000","last_active":"2024-06-04T16:18:20.001732+0000","last_peered":"2024-06-04T16:18:20.001732+0000","last_clean":"2024-06-04T16:18:20.001732+0000","last_became_active":"2024-06-04T15:52:38.488839+0000","last_became_peered":"2024-06-04T15:52:38.488839+0000","last_unstale":"2024-06-04T16:18:20.001732+0000","last_undegraded":"2024-06-04T16:18:20.001732+0000","last_fullsized":"2024-06-04T16:18:20.001732+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T16:24:19.359126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":464,"num_read_kb":434,"num_write":108,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.29","version":"254'42","reported_seq":546,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:40.017602+0000","last_change":"2024-06-04T15:52:36.496347+0000","last_active":"2024-06-04T16:19:40.017602+0000","last_peered":"2024-06-04T16:19:40.017602+0000","last_clean":"2024-06-04T16:19:40.017602+0000","last_became_active":"2024-06-04T15:52:36.495936+0000","last_became_peered":"2024-06-04T15:52:36.495936+0000","last_unstale":"2024-06-04T16:19:40.017602+0000","last_undegraded":"2024-06-04T16:19:40.017602+0000","last_fullsized":"2024-06-04T16:19:40.017602+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T19:20:27.592911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133666,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":74,"num_read_kb":10396,"num_write":213,"num_write_kb":18947,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,0],"acting":[5,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2d","version":"254'115","reported_seq":798,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:45.018461+0000","last_change":"2024-06-04T15:52:38.488600+0000","last_active":"2024-06-04T16:19:45.018461+0000","last_peered":"2024-06-04T16:19:45.018461+0000","last_clean":"2024-06-04T16:19:45.018461+0000","last_became_active":"2024-06-04T15:52:38.488289+0000","last_became_peered":"2024-06-04T15:52:38.488289+0000","last_unstale":"2024-06-04T16:19:45.018461+0000","last_undegraded":"2024-06-04T16:19:45.018461+0000","last_fullsized":"2024-06-04T16:19:45.018461+0000","mapping_epoch":23,"log_start":"251'100","ondisk_log_start":"251'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":100,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T02:23:18.956319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":534,"num_read_kb":481,"num_write":150,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"254'65","reported_seq":573,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:40.120365+0000","last_change":"2024-06-04T15:52:36.495691+0000","last_active":"2024-06-04T16:19:40.120365+0000","last_peered":"2024-06-04T16:19:40.120365+0000","last_clean":"2024-06-04T16:19:40.120365+0000","last_became_active":"2024-06-04T15:52:36.495386+0000","last_became_peered":"2024-06-04T15:52:36.495386+0000","last_unstale":"2024-06-04T16:19:40.120365+0000","last_undegraded":"2024-06-04T16:19:40.120365+0000","last_fullsized":"2024-06-04T16:19:40.120365+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T17:58:34.573671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8748224,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":68,"num_read_kb":17530,"num_write":237,"num_write_kb":31151,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"254'90","reported_seq":828,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:40.120391+0000","last_change":"2024-06-04T15:52:38.477573+0000","last_active":"2024-06-04T16:19:40.120391+0000","last_peered":"2024-06-04T16:19:40.120391+0000","last_clean":"2024-06-04T16:19:40.120391+0000","last_became_active":"2024-06-04T15:52:38.477333+0000","last_became_peered":"2024-06-04T15:52:38.477333+0000","last_unstale":"2024-06-04T16:19:40.120391+0000","last_undegraded":"2024-06-04T16:19:40.120391+0000","last_fullsized":"2024-06-04T16:19:40.120391+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T22:56:07.200710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":521,"num_read_kb":500,"num_write":102,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"251'47","reported_seq":558,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:40.017162+0000","last_change":"2024-06-04T15:52:36.483514+0000","last_active":"2024-06-04T16:19:40.017162+0000","last_peered":"2024-06-04T16:19:40.017162+0000","last_clean":"2024-06-04T16:19:40.017162+0000","last_became_active":"2024-06-04T15:52:36.482036+0000","last_became_peered":"2024-06-04T15:52:36.482036+0000","last_unstale":"2024-06-04T16:19:40.017162+0000","last_undegraded":"2024-06-04T16:19:40.017162+0000","last_fullsized":"2024-06-04T16:19:40.017162+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T17:16:27.012465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1069194,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":76,"num_read_kb":25646,"num_write":152,"num_write_kb":18921,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,6],"acting":[4,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"254'150","reported_seq":903,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:40.120383+0000","last_change":"2024-06-04T15:52:38.481261+0000","last_active":"2024-06-04T16:19:40.120383+0000","last_peered":"2024-06-04T16:19:40.120383+0000","last_clean":"2024-06-04T16:19:40.120383+0000","last_became_active":"2024-06-04T15:52:38.480432+0000","last_became_peered":"2024-06-04T15:52:38.480432+0000","last_unstale":"2024-06-04T16:19:40.120383+0000","last_undegraded":"2024-06-04T16:19:40.120383+0000","last_fullsized":"2024-06-04T16:19:40.120383+0000","mapping_epoch":23,"log_start":"251'100","ondisk_log_start":"251'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":100,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T19:12:13.612916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":703,"num_read_kb":638,"num_write":178,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"254'54","reported_seq":554,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:40.009639+0000","last_change":"2024-06-04T15:52:36.492604+0000","last_active":"2024-06-04T16:19:40.009639+0000","last_peered":"2024-06-04T16:19:40.009639+0000","last_clean":"2024-06-04T16:19:40.009639+0000","last_became_active":"2024-06-04T15:52:36.488813+0000","last_became_peered":"2024-06-04T15:52:36.488813+0000","last_unstale":"2024-06-04T16:19:40.009639+0000","last_undegraded":"2024-06-04T16:19:40.009639+0000","last_fullsized":"2024-06-04T16:19:40.009639+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T17:27:44.315490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":75,"num_read_kb":5170,"num_write":190,"num_write_kb":17954,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6],"acting":[0,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"254'97","reported_seq":791,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:40.129909+0000","last_change":"2024-06-04T15:52:38.479843+0000","last_active":"2024-06-04T16:19:40.129909+0000","last_peered":"2024-06-04T16:19:40.129909+0000","last_clean":"2024-06-04T16:19:40.129909+0000","last_became_active":"2024-06-04T15:52:38.479542+0000","last_became_peered":"2024-06-04T15:52:38.479542+0000","last_unstale":"2024-06-04T16:19:40.129909+0000","last_undegraded":"2024-06-04T16:19:40.129909+0000","last_fullsized":"2024-06-04T16:19:40.129909+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T22:41:21.159508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":493,"num_read_kb":461,"num_write":115,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"251'65","reported_seq":574,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:45.015100+0000","last_change":"2024-06-04T15:52:36.488268+0000","last_active":"2024-06-04T16:19:45.015100+0000","last_peered":"2024-06-04T16:19:45.015100+0000","last_clean":"2024-06-04T16:19:45.015100+0000","last_became_active":"2024-06-04T15:52:36.487971+0000","last_became_peered":"2024-06-04T15:52:36.487971+0000","last_unstale":"2024-06-04T16:19:45.015100+0000","last_undegraded":"2024-06-04T16:19:45.015100+0000","last_fullsized":"2024-06-04T16:19:45.015100+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T21:45:32.006937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262163,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":94,"num_read_kb":7564,"num_write":255,"num_write_kb":36740,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"254'136","reported_seq":911,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:40.017107+0000","last_change":"2024-06-04T15:52:38.484562+0000","last_active":"2024-06-04T16:19:40.017107+0000","last_peered":"2024-06-04T16:19:40.017107+0000","last_clean":"2024-06-04T16:19:40.017107+0000","last_became_active":"2024-06-04T15:52:38.484225+0000","last_became_peered":"2024-06-04T15:52:38.484225+0000","last_unstale":"2024-06-04T16:19:40.017107+0000","last_undegraded":"2024-06-04T16:19:40.017107+0000","last_fullsized":"2024-06-04T16:19:40.017107+0000","mapping_epoch":23,"log_start":"251'100","ondisk_log_start":"251'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":100,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T02:17:33.313293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":727,"num_read_kb":670,"num_write":170,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2e","version":"254'54","reported_seq":565,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:20.118439+0000","last_change":"2024-06-04T15:52:36.488496+0000","last_active":"2024-06-04T16:18:20.118439+0000","last_peered":"2024-06-04T16:18:20.118439+0000","last_clean":"2024-06-04T16:18:20.118439+0000","last_became_active":"2024-06-04T15:52:36.488139+0000","last_became_peered":"2024-06-04T15:52:36.488139+0000","last_unstale":"2024-06-04T16:18:20.118439+0000","last_undegraded":"2024-06-04T16:18:20.118439+0000","last_fullsized":"2024-06-04T16:18:20.118439+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T23:07:58.153939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048641,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":102,"num_read_kb":14422,"num_write":267,"num_write_kb":32685,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,3],"acting":[7,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.28","version":"254'289","reported_seq":1123,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:40.113801+0000","last_change":"2024-06-04T15:52:38.480910+0000","last_active":"2024-06-04T16:18:40.113801+0000","last_peered":"2024-06-04T16:18:40.113801+0000","last_clean":"2024-06-04T16:18:40.113801+0000","last_became_active":"2024-06-04T15:52:38.480613+0000","last_became_peered":"2024-06-04T15:52:38.480613+0000","last_unstale":"2024-06-04T16:18:40.113801+0000","last_undegraded":"2024-06-04T16:18:40.113801+0000","last_fullsized":"2024-06-04T16:18:40.113801+0000","mapping_epoch":23,"log_start":"251'200","ondisk_log_start":"251'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":200,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T20:28:05.010058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1456,"num_read_kb":1243,"num_write":452,"num_write_kb":208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"254'57","reported_seq":557,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:20.005372+0000","last_change":"2024-06-04T15:52:36.498902+0000","last_active":"2024-06-04T16:18:20.005372+0000","last_peered":"2024-06-04T16:18:20.005372+0000","last_clean":"2024-06-04T16:18:20.005372+0000","last_became_active":"2024-06-04T15:52:36.498564+0000","last_became_peered":"2024-06-04T15:52:36.498564+0000","last_unstale":"2024-06-04T16:18:20.005372+0000","last_undegraded":"2024-06-04T16:18:20.005372+0000","last_fullsized":"2024-06-04T16:18:20.005372+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T03:32:39.163905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1395816,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":73,"num_read_kb":11423,"num_write":228,"num_write_kb":34926,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"251'38","reported_seq":548,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:20.005214+0000","last_change":"2024-06-04T15:52:36.490119+0000","last_active":"2024-06-04T16:18:20.005214+0000","last_peered":"2024-06-04T16:18:20.005214+0000","last_clean":"2024-06-04T16:18:20.005214+0000","last_became_active":"2024-06-04T15:52:36.489681+0000","last_became_peered":"2024-06-04T15:52:36.489681+0000","last_unstale":"2024-06-04T16:18:20.005214+0000","last_undegraded":"2024-06-04T16:18:20.005214+0000","last_fullsized":"2024-06-04T16:18:20.005214+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T23:00:19.953809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1395831,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":78,"num_read_kb":4250,"num_write":172,"num_write_kb":18293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,6],"acting":[3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"254'119","reported_seq":1022,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:20.014594+0000","last_change":"2024-06-04T15:52:38.489275+0000","last_active":"2024-06-04T16:19:20.014594+0000","last_peered":"2024-06-04T16:19:20.014594+0000","last_clean":"2024-06-04T16:19:20.014594+0000","last_became_active":"2024-06-04T15:52:38.488941+0000","last_became_peered":"2024-06-04T15:52:38.488941+0000","last_unstale":"2024-06-04T16:19:20.014594+0000","last_undegraded":"2024-06-04T16:19:20.014594+0000","last_fullsized":"2024-06-04T16:19:20.014594+0000","mapping_epoch":23,"log_start":"251'100","ondisk_log_start":"251'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":100,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T02:49:46.129022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1004,"num_read_kb":976,"num_write":157,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"251'45","reported_seq":542,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:20.006817+0000","last_change":"2024-06-04T15:52:36.496468+0000","last_active":"2024-06-04T16:18:20.006817+0000","last_peered":"2024-06-04T16:18:20.006817+0000","last_clean":"2024-06-04T16:18:20.006817+0000","last_became_active":"2024-06-04T15:52:36.496046+0000","last_became_peered":"2024-06-04T15:52:36.496046+0000","last_unstale":"2024-06-04T16:18:20.006817+0000","last_undegraded":"2024-06-04T16:18:20.006817+0000","last_fullsized":"2024-06-04T16:18:20.006817+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T17:39:51.740231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1069179,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":46,"num_read_kb":3657,"num_write":159,"num_write_kb":22961,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3],"acting":[5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.36","version":"254'112","reported_seq":818,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:15.117929+0000","last_change":"2024-06-04T15:52:38.474859+0000","last_active":"2024-06-04T16:19:15.117929+0000","last_peered":"2024-06-04T16:19:15.117929+0000","last_clean":"2024-06-04T16:19:15.117929+0000","last_became_active":"2024-06-04T15:52:38.474574+0000","last_became_peered":"2024-06-04T15:52:38.474574+0000","last_unstale":"2024-06-04T16:19:15.117929+0000","last_undegraded":"2024-06-04T16:19:15.117929+0000","last_fullsized":"2024-06-04T16:19:15.117929+0000","mapping_epoch":23,"log_start":"254'100","ondisk_log_start":"254'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":100,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T00:26:50.523752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":563,"num_read_kb":518,"num_write":138,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":89899943,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":141,"num_read_kb":189232,"num_write":151,"num_write_kb":125730,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":179806208,"data_stored":179799886,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":98,"ondisk_log_size":98,"up":64,"acting":64,"num_store_stats":8},{"poolid":64,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4378,"num_read_kb":3242,"num_write":1279,"num_write_kb":637,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":682,"ondisk_log_size":682,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":8922,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":3579,"num_read_kb":3443,"num_write":3611,"num_write_kb":1042,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":319488,"data_stored":17844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":999,"ondisk_log_size":999,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":540,"ondisk_log_size":540,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":322695,"num_objects":188,"num_object_clones":0,"num_object_copies":376,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":188,"num_whiteouts":0,"num_read":5850,"num_read_kb":7341,"num_write":3099,"num_write_kb":955,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":466944,"data_stored":51064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1987,"ondisk_log_size":1987,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1523,"num_read_kb":1813,"num_write":20,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11,"ondisk_log_size":11,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":77,"num_object_clones":0,"num_object_copies":154,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":77,"num_whiteouts":0,"num_read":48565,"num_read_kb":44901,"num_write":11590,"num_write_kb":3535,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":77,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3758,"ondisk_log_size":3758,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":137662699,"num_objects":221,"num_object_clones":0,"num_object_copies":663,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":221,"num_whiteouts":0,"num_read":5460,"num_read_kb":1011284,"num_write":14339,"num_write_kb":1691909,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":208244736,"data_stored":208244736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3476,"ondisk_log_size":3476,"up":192,"acting":192,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":12,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4,"ondisk_log_size":4,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":89899943,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":142,"num_read_kb":185843,"num_write":151,"num_write_kb":125730,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":179806208,"data_stored":179799886,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":98,"ondisk_log_size":98,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542512,"num_pgs":96,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":247592,"kb_used_data":76256,"kb_used_omap":1,"kb_used_meta":171326,"kb_avail":94124248,"statfs":{"total":96636764160,"available":96383229952,"internally_reserved":0,"allocated":78086144,"data_stored":76191346,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":175438282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542512,"num_pgs":108,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":121188,"kb_used_data":76124,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94250652,"statfs":{"total":96636764160,"available":96512667648,"internally_reserved":0,"allocated":77950976,"data_stored":76057701,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":46135751},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542511,"num_pgs":115,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":262524,"kb_used_data":60596,"kb_used_omap":1,"kb_used_meta":201918,"kb_avail":94109316,"statfs":{"total":96636764160,"available":96367939584,"internally_reserved":0,"allocated":62050304,"data_stored":60152093,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":206764485},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542509,"num_pgs":122,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":199188,"kb_used_data":81996,"kb_used_omap":1,"kb_used_meta":117182,"kb_avail":94172652,"statfs":{"total":96636764160,"available":96432795648,"internally_reserved":0,"allocated":83963904,"data_stored":82057842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":119994821},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542512,"num_pgs":119,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":256976,"kb_used_data":81416,"kb_used_omap":1,"kb_used_meta":175550,"kb_avail":94114864,"statfs":{"total":96636764160,"available":96373620736,"internally_reserved":0,"allocated":83369984,"data_stored":81465877,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":179763655},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542512,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":143988,"kb_used_data":68396,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94227852,"statfs":{"total":96636764160,"available":96489320448,"internally_reserved":0,"allocated":70037504,"data_stored":68148471,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":77396421},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542511,"num_pgs":98,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302136,"kb_used_data":76592,"kb_used_omap":1,"kb_used_meta":225534,"kb_avail":94069704,"statfs":{"total":96636764160,"available":96327376896,"internally_reserved":0,"allocated":78430208,"data_stored":76518037,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":230947269},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542512,"num_pgs":93,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":111124,"kb_used_data":66060,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94260716,"statfs":{"total":96636764160,"available":96522973184,"internally_reserved":0,"allocated":67645440,"data_stored":65730083,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":35586048,"data_stored":35586048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":32743424,"data_stored":32743424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":28192768,"data_stored":28192768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":29757440,"data_stored":29757440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":26411008,"data_stored":26411008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":19648512,"data_stored":19648512,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16453632,"data_stored":16453632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":19451904,"data_stored":19451904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":1139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":6128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":6701,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1653,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":4106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":10832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":8870,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":6105,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":6669,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2484,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1047,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":2789,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":2757,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2173,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2491,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1703,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":64,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":64,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":64,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":64,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":64,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":64,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":64,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":64,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":14680064,"data_stored":14680064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":13631488,"data_stored":13631488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":19972096,"data_stored":19971366,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":37421056,"data_stored":37419505,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":32505856,"data_stored":32505856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":14680064,"data_stored":14680064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":26988544,"data_stored":26985383,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":19927040,"data_stored":19926160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":13303808,"data_stored":13302257,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":27983872,"data_stored":27982321,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":17825792,"data_stored":17825792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":11538432,"data_stored":11537552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20975616,"data_stored":20974736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":23068672,"data_stored":23068672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":30457856,"data_stored":30457126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":34652160,"data_stored":34651430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-06-04T16:22:41.477 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-06-04T16:22:41.477 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-06-04T16:22:41.818 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:41.830 INFO:teuthology.orchestra.run.smithi144.stderr:dumped all 2024-06-04T16:22:41.832 INFO:teuthology.orchestra.run.smithi144.stdout:{"pg_ready":true,"pg_map":{"version":1158,"stamp":"2024-06-04T16:22:41.553833+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":120019510,"num_objects":545,"num_object_clones":0,"num_object_copies":1290,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":545,"num_whiteouts":0,"num_read":70048,"num_read_kb":1447594,"num_write":34530,"num_write_kb":1951205,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":99,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11742,"ondisk_log_size":11742,"up":850,"acting":850,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":850,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1548012,"kb_used_data":490696,"kb_used_omap":12,"kb_used_meta":1057203,"kb_avail":753426708,"statfs":{"total":773094113280,"available":771508948992,"internally_reserved":0,"allocated":502472704,"data_stored":487297272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":1082576433},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-198367373,"num_objects":-81,"num_object_clones":0,"num_object_copies":-183,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-81,"num_whiteouts":0,"num_read":354,"num_read_kb":452,"num_write":182,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004957"},"pg_stats":[{"pgid":"67.1c","version":"0'0","reported_seq":14,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:40.004173+0000","last_change":"2024-06-04T16:16:08.658494+0000","last_active":"2024-06-04T16:18:40.004173+0000","last_peered":"2024-06-04T16:18:40.004173+0000","last_clean":"2024-06-04T16:18:40.004173+0000","last_became_active":"2024-06-04T16:16:08.658205+0000","last_became_peered":"2024-06-04T16:16:08.658205+0000","last_unstale":"2024-06-04T16:18:40.004173+0000","last_undegraded":"2024-06-04T16:18:40.004173+0000","last_fullsized":"2024-06-04T16:18:40.004173+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_clean_scrub_stamp":"2024-06-04T16:16:07.631263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T00:52:26.843651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1d","version":"251'2","reported_seq":27,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:30.016313+0000","last_change":"2024-06-04T16:09:26.627968+0000","last_active":"2024-06-04T16:19:30.016313+0000","last_peered":"2024-06-04T16:19:30.016313+0000","last_clean":"2024-06-04T16:19:30.016313+0000","last_became_active":"2024-06-04T16:09:26.627678+0000","last_became_peered":"2024-06-04T16:09:26.627678+0000","last_unstale":"2024-06-04T16:19:30.016313+0000","last_undegraded":"2024-06-04T16:19:30.016313+0000","last_fullsized":"2024-06-04T16:19:30.016313+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_clean_scrub_stamp":"2024-06-04T16:09:25.601105+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T01:24:09.747341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1e","version":"254'2","reported_seq":33,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:21:25.032961+0000","last_change":"2024-06-04T16:09:23.610282+0000","last_active":"2024-06-04T16:21:25.032961+0000","last_peered":"2024-06-04T16:21:25.032961+0000","last_clean":"2024-06-04T16:21:25.032961+0000","last_became_active":"2024-06-04T16:09:23.610020+0000","last_became_peered":"2024-06-04T16:09:23.610020+0000","last_unstale":"2024-06-04T16:21:25.032961+0000","last_undegraded":"2024-06-04T16:21:25.032961+0000","last_fullsized":"2024-06-04T16:21:25.032961+0000","mapping_epoch":246,"log_start":"0'0","ondisk_log_start":"0'0","created":246,"last_epoch_clean":247,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_clean_scrub_stamp":"2024-06-04T16:09:22.572686+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T20:33:48.503494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"64.1f","version":"251'21","reported_seq":94,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:40.017799+0000","last_change":"2024-06-04T16:07:09.402335+0000","last_active":"2024-06-04T16:19:40.017799+0000","last_peered":"2024-06-04T16:19:40.017799+0000","last_clean":"2024-06-04T16:19:40.017799+0000","last_became_active":"2024-06-04T16:07:09.402073+0000","last_became_peered":"2024-06-04T16:07:09.402073+0000","last_unstale":"2024-06-04T16:19:40.017799+0000","last_undegraded":"2024-06-04T16:19:40.017799+0000","last_fullsized":"2024-06-04T16:19:40.017799+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":243,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:07:08.374534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:07:08.374534+0000","last_clean_scrub_stamp":"2024-06-04T16:07:08.374534+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T00:13:07.984077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":108,"num_read_kb":75,"num_write":41,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1d","version":"0'0","reported_seq":14,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:40.113877+0000","last_change":"2024-06-04T16:16:08.656686+0000","last_active":"2024-06-04T16:18:40.113877+0000","last_peered":"2024-06-04T16:18:40.113877+0000","last_clean":"2024-06-04T16:18:40.113877+0000","last_became_active":"2024-06-04T16:16:08.656388+0000","last_became_peered":"2024-06-04T16:16:08.656388+0000","last_unstale":"2024-06-04T16:18:40.113877+0000","last_undegraded":"2024-06-04T16:18:40.113877+0000","last_fullsized":"2024-06-04T16:18:40.113877+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_clean_scrub_stamp":"2024-06-04T16:16:07.631263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T18:52:52.325700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.1c","version":"254'2","reported_seq":26,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:00.150620+0000","last_change":"2024-06-04T16:09:26.627239+0000","last_active":"2024-06-04T16:22:00.150620+0000","last_peered":"2024-06-04T16:22:00.150620+0000","last_clean":"2024-06-04T16:22:00.150620+0000","last_became_active":"2024-06-04T16:09:26.626964+0000","last_became_peered":"2024-06-04T16:09:26.626964+0000","last_unstale":"2024-06-04T16:22:00.150620+0000","last_undegraded":"2024-06-04T16:22:00.150620+0000","last_fullsized":"2024-06-04T16:22:00.150620+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_clean_scrub_stamp":"2024-06-04T16:09:25.601105+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T22:22:45.616852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1f","version":"254'4","reported_seq":37,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:21:55.037101+0000","last_change":"2024-06-04T16:09:23.608520+0000","last_active":"2024-06-04T16:21:55.037101+0000","last_peered":"2024-06-04T16:21:55.037101+0000","last_clean":"2024-06-04T16:21:55.037101+0000","last_became_active":"2024-06-04T16:09:23.608251+0000","last_became_peered":"2024-06-04T16:09:23.608251+0000","last_unstale":"2024-06-04T16:21:55.037101+0000","last_undegraded":"2024-06-04T16:21:55.037101+0000","last_fullsized":"2024-06-04T16:21:55.037101+0000","mapping_epoch":246,"log_start":"0'0","ondisk_log_start":"0'0","created":246,"last_epoch_clean":247,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_clean_scrub_stamp":"2024-06-04T16:09:22.572686+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T01:41:52.047423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":8192,"num_write":4,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"64.1e","version":"251'15","reported_seq":79,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:10.125894+0000","last_change":"2024-06-04T16:07:09.511589+0000","last_active":"2024-06-04T16:19:10.125894+0000","last_peered":"2024-06-04T16:19:10.125894+0000","last_clean":"2024-06-04T16:19:10.125894+0000","last_became_active":"2024-06-04T16:07:09.511253+0000","last_became_peered":"2024-06-04T16:07:09.511253+0000","last_unstale":"2024-06-04T16:19:10.125894+0000","last_undegraded":"2024-06-04T16:19:10.125894+0000","last_fullsized":"2024-06-04T16:19:10.125894+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":243,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:07:08.374534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:07:08.374534+0000","last_clean_scrub_stamp":"2024-06-04T16:07:08.374534+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T02:12:46.993038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":58,"num_write":26,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1e","version":"0'0","reported_seq":15,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:20:10.022107+0000","last_change":"2024-06-04T16:16:08.660980+0000","last_active":"2024-06-04T16:20:10.022107+0000","last_peered":"2024-06-04T16:20:10.022107+0000","last_clean":"2024-06-04T16:20:10.022107+0000","last_became_active":"2024-06-04T16:16:08.660635+0000","last_became_peered":"2024-06-04T16:16:08.660635+0000","last_unstale":"2024-06-04T16:20:10.022107+0000","last_undegraded":"2024-06-04T16:20:10.022107+0000","last_fullsized":"2024-06-04T16:20:10.022107+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_clean_scrub_stamp":"2024-06-04T16:16:07.631263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T01:54:33.642831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1f","version":"0'0","reported_seq":24,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:55.121976+0000","last_change":"2024-06-04T16:09:26.624893+0000","last_active":"2024-06-04T16:19:55.121976+0000","last_peered":"2024-06-04T16:19:55.121976+0000","last_clean":"2024-06-04T16:19:55.121976+0000","last_became_active":"2024-06-04T16:09:26.624510+0000","last_became_peered":"2024-06-04T16:09:26.624510+0000","last_unstale":"2024-06-04T16:19:55.121976+0000","last_undegraded":"2024-06-04T16:19:55.121976+0000","last_fullsized":"2024-06-04T16:19:55.121976+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_clean_scrub_stamp":"2024-06-04T16:09:25.601105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T00:28:18.386660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1c","version":"0'0","reported_seq":29,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:25.014688+0000","last_change":"2024-06-04T16:09:23.612578+0000","last_active":"2024-06-04T16:19:25.014688+0000","last_peered":"2024-06-04T16:19:25.014688+0000","last_clean":"2024-06-04T16:19:25.014688+0000","last_became_active":"2024-06-04T16:09:23.612278+0000","last_became_peered":"2024-06-04T16:09:23.612278+0000","last_unstale":"2024-06-04T16:19:25.014688+0000","last_undegraded":"2024-06-04T16:19:25.014688+0000","last_fullsized":"2024-06-04T16:19:25.014688+0000","mapping_epoch":246,"log_start":"0'0","ondisk_log_start":"0'0","created":246,"last_epoch_clean":247,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_clean_scrub_stamp":"2024-06-04T16:09:22.572686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T04:01:33.465233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"64.1d","version":"251'28","reported_seq":114,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:40.120403+0000","last_change":"2024-06-04T16:07:09.511447+0000","last_active":"2024-06-04T16:19:40.120403+0000","last_peered":"2024-06-04T16:19:40.120403+0000","last_clean":"2024-06-04T16:19:40.120403+0000","last_became_active":"2024-06-04T16:07:09.511154+0000","last_became_peered":"2024-06-04T16:07:09.511154+0000","last_unstale":"2024-06-04T16:19:40.120403+0000","last_undegraded":"2024-06-04T16:19:40.120403+0000","last_fullsized":"2024-06-04T16:19:40.120403+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":243,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:07:08.374534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:07:08.374534+0000","last_clean_scrub_stamp":"2024-06-04T16:07:08.374534+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T03:39:17.866776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":150,"num_read_kb":106,"num_write":50,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.1f","version":"0'0","reported_seq":15,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:20:20.023704+0000","last_change":"2024-06-04T16:16:08.661162+0000","last_active":"2024-06-04T16:20:20.023704+0000","last_peered":"2024-06-04T16:20:20.023704+0000","last_clean":"2024-06-04T16:20:20.023704+0000","last_became_active":"2024-06-04T16:16:08.660669+0000","last_became_peered":"2024-06-04T16:16:08.660669+0000","last_unstale":"2024-06-04T16:20:20.023704+0000","last_undegraded":"2024-06-04T16:20:20.023704+0000","last_fullsized":"2024-06-04T16:20:20.023704+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_clean_scrub_stamp":"2024-06-04T16:16:07.631263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T16:45:04.637111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1e","version":"254'2","reported_seq":27,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:21:30.146307+0000","last_change":"2024-06-04T16:09:26.622613+0000","last_active":"2024-06-04T16:21:30.146307+0000","last_peered":"2024-06-04T16:21:30.146307+0000","last_clean":"2024-06-04T16:21:30.146307+0000","last_became_active":"2024-06-04T16:09:26.621326+0000","last_became_peered":"2024-06-04T16:09:26.621326+0000","last_unstale":"2024-06-04T16:21:30.146307+0000","last_undegraded":"2024-06-04T16:21:30.146307+0000","last_fullsized":"2024-06-04T16:21:30.146307+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_clean_scrub_stamp":"2024-06-04T16:09:25.601105+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T01:20:44.676294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1d","version":"254'5","reported_seq":37,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:21:55.036560+0000","last_change":"2024-06-04T16:09:23.607186+0000","last_active":"2024-06-04T16:21:55.036560+0000","last_peered":"2024-06-04T16:21:55.036560+0000","last_clean":"2024-06-04T16:21:55.036560+0000","last_became_active":"2024-06-04T16:09:23.606918+0000","last_became_peered":"2024-06-04T16:09:23.606918+0000","last_unstale":"2024-06-04T16:21:55.036560+0000","last_undegraded":"2024-06-04T16:21:55.036560+0000","last_fullsized":"2024-06-04T16:21:55.036560+0000","mapping_epoch":246,"log_start":"0'0","ondisk_log_start":"0'0","created":246,"last_epoch_clean":247,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_clean_scrub_stamp":"2024-06-04T16:09:22.572686+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T17:11:19.839027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":4144,"num_write":10,"num_write_kb":4144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"64.1c","version":"251'37","reported_seq":142,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:40.017695+0000","last_change":"2024-06-04T16:07:09.509991+0000","last_active":"2024-06-04T16:19:40.017695+0000","last_peered":"2024-06-04T16:19:40.017695+0000","last_clean":"2024-06-04T16:19:40.017695+0000","last_became_active":"2024-06-04T16:07:09.509671+0000","last_became_peered":"2024-06-04T16:07:09.509671+0000","last_unstale":"2024-06-04T16:19:40.017695+0000","last_undegraded":"2024-06-04T16:19:40.017695+0000","last_fullsized":"2024-06-04T16:19:40.017695+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":243,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:07:08.374534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:07:08.374534+0000","last_clean_scrub_stamp":"2024-06-04T16:07:08.374534+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T18:48:21.024789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":197,"num_read_kb":141,"num_write":70,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.18","version":"0'0","reported_seq":14,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:35.007117+0000","last_change":"2024-06-04T16:16:08.664509+0000","last_active":"2024-06-04T16:18:35.007117+0000","last_peered":"2024-06-04T16:18:35.007117+0000","last_clean":"2024-06-04T16:18:35.007117+0000","last_became_active":"2024-06-04T16:16:08.664252+0000","last_became_peered":"2024-06-04T16:16:08.664252+0000","last_unstale":"2024-06-04T16:18:35.007117+0000","last_undegraded":"2024-06-04T16:18:35.007117+0000","last_fullsized":"2024-06-04T16:18:35.007117+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_clean_scrub_stamp":"2024-06-04T16:16:07.631263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T01:56:56.151412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.19","version":"254'7","reported_seq":35,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:21:40.027861+0000","last_change":"2024-06-04T16:09:26.625104+0000","last_active":"2024-06-04T16:21:40.027861+0000","last_peered":"2024-06-04T16:21:40.027861+0000","last_clean":"2024-06-04T16:21:40.027861+0000","last_became_active":"2024-06-04T16:09:26.624681+0000","last_became_peered":"2024-06-04T16:09:26.624681+0000","last_unstale":"2024-06-04T16:21:40.027861+0000","last_undegraded":"2024-06-04T16:21:40.027861+0000","last_fullsized":"2024-06-04T16:21:40.027861+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_clean_scrub_stamp":"2024-06-04T16:09:25.601105+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T16:38:40.132989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":9216,"num_write":12,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1a","version":"251'3","reported_seq":34,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:25.008703+0000","last_change":"2024-06-04T16:09:23.609384+0000","last_active":"2024-06-04T16:19:25.008703+0000","last_peered":"2024-06-04T16:19:25.008703+0000","last_clean":"2024-06-04T16:19:25.008703+0000","last_became_active":"2024-06-04T16:09:23.609102+0000","last_became_peered":"2024-06-04T16:09:23.609102+0000","last_unstale":"2024-06-04T16:19:25.008703+0000","last_undegraded":"2024-06-04T16:19:25.008703+0000","last_fullsized":"2024-06-04T16:19:25.008703+0000","mapping_epoch":246,"log_start":"0'0","ondisk_log_start":"0'0","created":246,"last_epoch_clean":247,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_clean_scrub_stamp":"2024-06-04T16:09:22.572686+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T19:32:58.624496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"64.1b","version":"251'96","reported_seq":333,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:40.017150+0000","last_change":"2024-06-04T16:07:09.404530+0000","last_active":"2024-06-04T16:19:40.017150+0000","last_peered":"2024-06-04T16:19:40.017150+0000","last_clean":"2024-06-04T16:19:40.017150+0000","last_became_active":"2024-06-04T16:07:09.404202+0000","last_became_peered":"2024-06-04T16:07:09.404202+0000","last_unstale":"2024-06-04T16:19:40.017150+0000","last_undegraded":"2024-06-04T16:19:40.017150+0000","last_fullsized":"2024-06-04T16:19:40.017150+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":243,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:07:08.374534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:07:08.374534+0000","last_clean_scrub_stamp":"2024-06-04T16:07:08.374534+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T20:38:56.584375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":591,"num_read_kb":533,"num_write":104,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.19","version":"0'0","reported_seq":14,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:35.003192+0000","last_change":"2024-06-04T16:16:08.659135+0000","last_active":"2024-06-04T16:18:35.003192+0000","last_peered":"2024-06-04T16:18:35.003192+0000","last_clean":"2024-06-04T16:18:35.003192+0000","last_became_active":"2024-06-04T16:16:08.658696+0000","last_became_peered":"2024-06-04T16:16:08.658696+0000","last_unstale":"2024-06-04T16:18:35.003192+0000","last_undegraded":"2024-06-04T16:18:35.003192+0000","last_fullsized":"2024-06-04T16:18:35.003192+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_clean_scrub_stamp":"2024-06-04T16:16:07.631263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T04:10:28.111016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.18","version":"254'7","reported_seq":34,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:21:35.034527+0000","last_change":"2024-06-04T16:09:26.624594+0000","last_active":"2024-06-04T16:21:35.034527+0000","last_peered":"2024-06-04T16:21:35.034527+0000","last_clean":"2024-06-04T16:21:35.034527+0000","last_became_active":"2024-06-04T16:09:26.624322+0000","last_became_peered":"2024-06-04T16:09:26.624322+0000","last_unstale":"2024-06-04T16:21:35.034527+0000","last_undegraded":"2024-06-04T16:21:35.034527+0000","last_fullsized":"2024-06-04T16:21:35.034527+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_clean_scrub_stamp":"2024-06-04T16:09:25.601105+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T03:22:38.550890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":8192,"num_write":12,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1b","version":"254'13","reported_seq":60,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:39.532961+0000","last_change":"2024-06-04T16:09:23.613387+0000","last_active":"2024-06-04T16:22:39.532961+0000","last_peered":"2024-06-04T16:22:39.532961+0000","last_clean":"2024-06-04T16:22:39.532961+0000","last_became_active":"2024-06-04T16:09:23.613109+0000","last_became_peered":"2024-06-04T16:09:23.613109+0000","last_unstale":"2024-06-04T16:22:39.532961+0000","last_undegraded":"2024-06-04T16:22:39.532961+0000","last_fullsized":"2024-06-04T16:22:39.532961+0000","mapping_epoch":246,"log_start":"0'0","ondisk_log_start":"0'0","created":246,"last_epoch_clean":247,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_clean_scrub_stamp":"2024-06-04T16:09:22.572686+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T18:31:33.463795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":26,"num_read_kb":29700,"num_write":16,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"64.1a","version":"251'15","reported_seq":75,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:40.120356+0000","last_change":"2024-06-04T16:07:09.407260+0000","last_active":"2024-06-04T16:19:40.120356+0000","last_peered":"2024-06-04T16:19:40.120356+0000","last_clean":"2024-06-04T16:19:40.120356+0000","last_became_active":"2024-06-04T16:07:09.406976+0000","last_became_peered":"2024-06-04T16:07:09.406976+0000","last_unstale":"2024-06-04T16:19:40.120356+0000","last_undegraded":"2024-06-04T16:19:40.120356+0000","last_fullsized":"2024-06-04T16:19:40.120356+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":243,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:07:08.374534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:07:08.374534+0000","last_clean_scrub_stamp":"2024-06-04T16:07:08.374534+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T22:44:48.654459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":52,"num_write":29,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.1a","version":"0'0","reported_seq":14,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:40.121419+0000","last_change":"2024-06-04T16:16:08.664491+0000","last_active":"2024-06-04T16:18:40.121419+0000","last_peered":"2024-06-04T16:18:40.121419+0000","last_clean":"2024-06-04T16:18:40.121419+0000","last_became_active":"2024-06-04T16:16:08.664200+0000","last_became_peered":"2024-06-04T16:16:08.664200+0000","last_unstale":"2024-06-04T16:18:40.121419+0000","last_undegraded":"2024-06-04T16:18:40.121419+0000","last_fullsized":"2024-06-04T16:18:40.121419+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_clean_scrub_stamp":"2024-06-04T16:16:07.631263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T01:16:08.795243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.1b","version":"254'3","reported_seq":28,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:00.037236+0000","last_change":"2024-06-04T16:09:26.626809+0000","last_active":"2024-06-04T16:22:00.037236+0000","last_peered":"2024-06-04T16:22:00.037236+0000","last_clean":"2024-06-04T16:22:00.037236+0000","last_became_active":"2024-06-04T16:09:26.626528+0000","last_became_peered":"2024-06-04T16:09:26.626528+0000","last_unstale":"2024-06-04T16:22:00.037236+0000","last_undegraded":"2024-06-04T16:22:00.037236+0000","last_fullsized":"2024-06-04T16:22:00.037236+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_clean_scrub_stamp":"2024-06-04T16:09:25.601105+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T03:55:00.731424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8192,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.18","version":"254'4","reported_seq":36,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:21:30.033184+0000","last_change":"2024-06-04T16:09:23.610295+0000","last_active":"2024-06-04T16:21:30.033184+0000","last_peered":"2024-06-04T16:21:30.033184+0000","last_clean":"2024-06-04T16:21:30.033184+0000","last_became_active":"2024-06-04T16:09:23.609952+0000","last_became_peered":"2024-06-04T16:09:23.609952+0000","last_unstale":"2024-06-04T16:21:30.033184+0000","last_undegraded":"2024-06-04T16:21:30.033184+0000","last_fullsized":"2024-06-04T16:21:30.033184+0000","mapping_epoch":246,"log_start":"0'0","ondisk_log_start":"0'0","created":246,"last_epoch_clean":247,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_clean_scrub_stamp":"2024-06-04T16:09:22.572686+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T20:30:38.429992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5120,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"64.19","version":"251'22","reported_seq":96,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:20.015056+0000","last_change":"2024-06-04T16:07:09.402552+0000","last_active":"2024-06-04T16:19:20.015056+0000","last_peered":"2024-06-04T16:19:20.015056+0000","last_clean":"2024-06-04T16:19:20.015056+0000","last_became_active":"2024-06-04T16:07:09.402316+0000","last_became_peered":"2024-06-04T16:07:09.402316+0000","last_unstale":"2024-06-04T16:19:20.015056+0000","last_undegraded":"2024-06-04T16:19:20.015056+0000","last_fullsized":"2024-06-04T16:19:20.015056+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":243,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:07:08.374534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:07:08.374534+0000","last_clean_scrub_stamp":"2024-06-04T16:07:08.374534+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T21:44:10.282159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":114,"num_read_kb":79,"num_write":44,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1b","version":"0'0","reported_seq":14,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:40.004153+0000","last_change":"2024-06-04T16:16:08.654196+0000","last_active":"2024-06-04T16:18:40.004153+0000","last_peered":"2024-06-04T16:18:40.004153+0000","last_clean":"2024-06-04T16:18:40.004153+0000","last_became_active":"2024-06-04T16:16:08.653931+0000","last_became_peered":"2024-06-04T16:16:08.653931+0000","last_unstale":"2024-06-04T16:18:40.004153+0000","last_undegraded":"2024-06-04T16:18:40.004153+0000","last_fullsized":"2024-06-04T16:18:40.004153+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_clean_scrub_stamp":"2024-06-04T16:16:07.631263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T18:57:31.093469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1a","version":"254'8","reported_seq":40,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:00.023442+0000","last_change":"2024-06-04T16:09:26.623784+0000","last_active":"2024-06-04T16:22:00.023442+0000","last_peered":"2024-06-04T16:22:00.023442+0000","last_clean":"2024-06-04T16:22:00.023442+0000","last_became_active":"2024-06-04T16:09:26.623459+0000","last_became_peered":"2024-06-04T16:09:26.623459+0000","last_unstale":"2024-06-04T16:22:00.023442+0000","last_undegraded":"2024-06-04T16:22:00.023442+0000","last_fullsized":"2024-06-04T16:22:00.023442+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_clean_scrub_stamp":"2024-06-04T16:09:25.601105+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T00:27:16.479995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":9218,"num_write":7,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.19","version":"254'6","reported_seq":42,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:21:30.146210+0000","last_change":"2024-06-04T16:09:23.607280+0000","last_active":"2024-06-04T16:21:30.146210+0000","last_peered":"2024-06-04T16:21:30.146210+0000","last_clean":"2024-06-04T16:21:30.146210+0000","last_became_active":"2024-06-04T16:09:23.606966+0000","last_became_peered":"2024-06-04T16:09:23.606966+0000","last_unstale":"2024-06-04T16:21:30.146210+0000","last_undegraded":"2024-06-04T16:21:30.146210+0000","last_fullsized":"2024-06-04T16:21:30.146210+0000","mapping_epoch":246,"log_start":"0'0","ondisk_log_start":"0'0","created":246,"last_epoch_clean":247,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_clean_scrub_stamp":"2024-06-04T16:09:22.572686+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T00:52:40.922210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":11,"num_read_kb":8194,"num_write":5,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"64.18","version":"251'39","reported_seq":144,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:15.117833+0000","last_change":"2024-06-04T16:07:09.404324+0000","last_active":"2024-06-04T16:19:15.117833+0000","last_peered":"2024-06-04T16:19:15.117833+0000","last_clean":"2024-06-04T16:19:15.117833+0000","last_became_active":"2024-06-04T16:07:09.404055+0000","last_became_peered":"2024-06-04T16:07:09.404055+0000","last_unstale":"2024-06-04T16:19:15.117833+0000","last_undegraded":"2024-06-04T16:19:15.117833+0000","last_fullsized":"2024-06-04T16:19:15.117833+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":243,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:07:08.374534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:07:08.374534+0000","last_clean_scrub_stamp":"2024-06-04T16:07:08.374534+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T02:35:29.659798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":206,"num_read_kb":146,"num_write":71,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.14","version":"253'1","reported_seq":15,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:30.008340+0000","last_change":"2024-06-04T16:16:08.662285+0000","last_active":"2024-06-04T16:18:30.008340+0000","last_peered":"2024-06-04T16:18:30.008340+0000","last_clean":"2024-06-04T16:18:30.008340+0000","last_became_active":"2024-06-04T16:16:08.661995+0000","last_became_peered":"2024-06-04T16:16:08.661995+0000","last_unstale":"2024-06-04T16:18:30.008340+0000","last_undegraded":"2024-06-04T16:18:30.008340+0000","last_fullsized":"2024-06-04T16:18:30.008340+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_clean_scrub_stamp":"2024-06-04T16:16:07.631263+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T04:00:42.209306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.15","version":"254'5","reported_seq":30,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:39.409993+0000","last_change":"2024-06-04T16:09:26.623775+0000","last_active":"2024-06-04T16:22:39.409993+0000","last_peered":"2024-06-04T16:22:39.409993+0000","last_clean":"2024-06-04T16:22:39.409993+0000","last_became_active":"2024-06-04T16:09:26.623442+0000","last_became_peered":"2024-06-04T16:09:26.623442+0000","last_unstale":"2024-06-04T16:22:39.409993+0000","last_undegraded":"2024-06-04T16:22:39.409993+0000","last_fullsized":"2024-06-04T16:22:39.409993+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_clean_scrub_stamp":"2024-06-04T16:09:25.601105+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T00:42:02.876938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":1406,"num_write":10,"num_write_kb":4799,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.16","version":"251'2","reported_seq":33,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:05.012569+0000","last_change":"2024-06-04T16:09:23.609558+0000","last_active":"2024-06-04T16:19:05.012569+0000","last_peered":"2024-06-04T16:19:05.012569+0000","last_clean":"2024-06-04T16:19:05.012569+0000","last_became_active":"2024-06-04T16:09:23.609180+0000","last_became_peered":"2024-06-04T16:09:23.609180+0000","last_unstale":"2024-06-04T16:19:05.012569+0000","last_undegraded":"2024-06-04T16:19:05.012569+0000","last_fullsized":"2024-06-04T16:19:05.012569+0000","mapping_epoch":246,"log_start":"0'0","ondisk_log_start":"0'0","created":246,"last_epoch_clean":247,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_clean_scrub_stamp":"2024-06-04T16:09:22.572686+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T17:27:35.142187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":45,"num_write":2,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"64.17","version":"0'0","reported_seq":36,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:15.011780+0000","last_change":"2024-06-04T16:07:09.512132+0000","last_active":"2024-06-04T16:19:15.011780+0000","last_peered":"2024-06-04T16:19:15.011780+0000","last_clean":"2024-06-04T16:19:15.011780+0000","last_became_active":"2024-06-04T16:07:09.511806+0000","last_became_peered":"2024-06-04T16:07:09.511806+0000","last_unstale":"2024-06-04T16:19:15.011780+0000","last_undegraded":"2024-06-04T16:19:15.011780+0000","last_fullsized":"2024-06-04T16:19:15.011780+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":243,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:07:08.374534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:07:08.374534+0000","last_clean_scrub_stamp":"2024-06-04T16:07:08.374534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T21:23:49.362770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.15","version":"0'0","reported_seq":14,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:35.120607+0000","last_change":"2024-06-04T16:16:08.664995+0000","last_active":"2024-06-04T16:18:35.120607+0000","last_peered":"2024-06-04T16:18:35.120607+0000","last_clean":"2024-06-04T16:18:35.120607+0000","last_became_active":"2024-06-04T16:16:08.664680+0000","last_became_peered":"2024-06-04T16:16:08.664680+0000","last_unstale":"2024-06-04T16:18:35.120607+0000","last_undegraded":"2024-06-04T16:18:35.120607+0000","last_fullsized":"2024-06-04T16:18:35.120607+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_clean_scrub_stamp":"2024-06-04T16:16:07.631263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T19:24:50.177579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.14","version":"254'3","reported_seq":26,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:21:15.025223+0000","last_change":"2024-06-04T16:09:26.624246+0000","last_active":"2024-06-04T16:21:15.025223+0000","last_peered":"2024-06-04T16:21:15.025223+0000","last_clean":"2024-06-04T16:21:15.025223+0000","last_became_active":"2024-06-04T16:09:26.623991+0000","last_became_peered":"2024-06-04T16:09:26.623991+0000","last_unstale":"2024-06-04T16:21:15.025223+0000","last_undegraded":"2024-06-04T16:21:15.025223+0000","last_fullsized":"2024-06-04T16:21:15.025223+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_clean_scrub_stamp":"2024-06-04T16:09:25.601105+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T21:29:18.235375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.17","version":"254'2","reported_seq":32,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:21:30.033744+0000","last_change":"2024-06-04T16:09:23.595639+0000","last_active":"2024-06-04T16:21:30.033744+0000","last_peered":"2024-06-04T16:21:30.033744+0000","last_clean":"2024-06-04T16:21:30.033744+0000","last_became_active":"2024-06-04T16:09:23.595355+0000","last_became_peered":"2024-06-04T16:09:23.595355+0000","last_unstale":"2024-06-04T16:21:30.033744+0000","last_undegraded":"2024-06-04T16:21:30.033744+0000","last_fullsized":"2024-06-04T16:21:30.033744+0000","mapping_epoch":246,"log_start":"0'0","ondisk_log_start":"0'0","created":246,"last_epoch_clean":247,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_clean_scrub_stamp":"2024-06-04T16:09:22.572686+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T19:14:50.608068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"64.16","version":"251'16","reported_seq":80,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:15.126620+0000","last_change":"2024-06-04T16:07:09.405399+0000","last_active":"2024-06-04T16:19:15.126620+0000","last_peered":"2024-06-04T16:19:15.126620+0000","last_clean":"2024-06-04T16:19:15.126620+0000","last_became_active":"2024-06-04T16:07:09.405088+0000","last_became_peered":"2024-06-04T16:07:09.405088+0000","last_unstale":"2024-06-04T16:19:15.126620+0000","last_undegraded":"2024-06-04T16:19:15.126620+0000","last_fullsized":"2024-06-04T16:19:15.126620+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":243,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:07:08.374534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:07:08.374534+0000","last_clean_scrub_stamp":"2024-06-04T16:07:08.374534+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T21:34:43.810719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":63,"num_write":30,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.16","version":"0'0","reported_seq":14,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:35.003270+0000","last_change":"2024-06-04T16:16:08.656459+0000","last_active":"2024-06-04T16:18:35.003270+0000","last_peered":"2024-06-04T16:18:35.003270+0000","last_clean":"2024-06-04T16:18:35.003270+0000","last_became_active":"2024-06-04T16:16:08.655571+0000","last_became_peered":"2024-06-04T16:16:08.655571+0000","last_unstale":"2024-06-04T16:18:35.003270+0000","last_undegraded":"2024-06-04T16:18:35.003270+0000","last_fullsized":"2024-06-04T16:18:35.003270+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_clean_scrub_stamp":"2024-06-04T16:16:07.631263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T16:18:55.793739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.17","version":"0'0","reported_seq":23,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:10.013842+0000","last_change":"2024-06-04T16:09:26.626934+0000","last_active":"2024-06-04T16:19:10.013842+0000","last_peered":"2024-06-04T16:19:10.013842+0000","last_clean":"2024-06-04T16:19:10.013842+0000","last_became_active":"2024-06-04T16:09:26.626605+0000","last_became_peered":"2024-06-04T16:09:26.626605+0000","last_unstale":"2024-06-04T16:19:10.013842+0000","last_undegraded":"2024-06-04T16:19:10.013842+0000","last_fullsized":"2024-06-04T16:19:10.013842+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_clean_scrub_stamp":"2024-06-04T16:09:25.601105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T00:15:31.709245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.14","version":"254'2","reported_seq":32,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:21:10.024719+0000","last_change":"2024-06-04T16:09:23.608188+0000","last_active":"2024-06-04T16:21:10.024719+0000","last_peered":"2024-06-04T16:21:10.024719+0000","last_clean":"2024-06-04T16:21:10.024719+0000","last_became_active":"2024-06-04T16:09:23.607906+0000","last_became_peered":"2024-06-04T16:09:23.607906+0000","last_unstale":"2024-06-04T16:21:10.024719+0000","last_undegraded":"2024-06-04T16:21:10.024719+0000","last_fullsized":"2024-06-04T16:21:10.024719+0000","mapping_epoch":246,"log_start":"0'0","ondisk_log_start":"0'0","created":246,"last_epoch_clean":247,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_clean_scrub_stamp":"2024-06-04T16:09:22.572686+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T17:08:32.670089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"64.15","version":"0'0","reported_seq":36,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:15.014464+0000","last_change":"2024-06-04T16:07:09.401959+0000","last_active":"2024-06-04T16:19:15.014464+0000","last_peered":"2024-06-04T16:19:15.014464+0000","last_clean":"2024-06-04T16:19:15.014464+0000","last_became_active":"2024-06-04T16:07:09.401608+0000","last_became_peered":"2024-06-04T16:07:09.401608+0000","last_unstale":"2024-06-04T16:19:15.014464+0000","last_undegraded":"2024-06-04T16:19:15.014464+0000","last_fullsized":"2024-06-04T16:19:15.014464+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":243,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:07:08.374534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:07:08.374534+0000","last_clean_scrub_stamp":"2024-06-04T16:07:08.374534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T23:24:21.547866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.17","version":"0'0","reported_seq":14,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:35.120672+0000","last_change":"2024-06-04T16:16:08.657806+0000","last_active":"2024-06-04T16:18:35.120672+0000","last_peered":"2024-06-04T16:18:35.120672+0000","last_clean":"2024-06-04T16:18:35.120672+0000","last_became_active":"2024-06-04T16:16:08.657535+0000","last_became_peered":"2024-06-04T16:16:08.657535+0000","last_unstale":"2024-06-04T16:18:35.120672+0000","last_undegraded":"2024-06-04T16:18:35.120672+0000","last_fullsized":"2024-06-04T16:18:35.120672+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_clean_scrub_stamp":"2024-06-04T16:16:07.631263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T02:31:34.399203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.16","version":"254'12","reported_seq":47,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:39.425811+0000","last_change":"2024-06-04T16:09:26.628516+0000","last_active":"2024-06-04T16:22:39.425811+0000","last_peered":"2024-06-04T16:22:39.425811+0000","last_clean":"2024-06-04T16:22:39.425811+0000","last_became_active":"2024-06-04T16:09:26.628237+0000","last_became_peered":"2024-06-04T16:09:26.628237+0000","last_unstale":"2024-06-04T16:22:39.425811+0000","last_undegraded":"2024-06-04T16:22:39.425811+0000","last_fullsized":"2024-06-04T16:22:39.425811+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_clean_scrub_stamp":"2024-06-04T16:09:25.601105+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T22:06:09.423503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":19,"num_read_kb":9311,"num_write":11,"num_write_kb":6237,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.15","version":"0'0","reported_seq":29,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:05.125028+0000","last_change":"2024-06-04T16:09:23.609111+0000","last_active":"2024-06-04T16:19:05.125028+0000","last_peered":"2024-06-04T16:19:05.125028+0000","last_clean":"2024-06-04T16:19:05.125028+0000","last_became_active":"2024-06-04T16:09:23.608801+0000","last_became_peered":"2024-06-04T16:09:23.608801+0000","last_unstale":"2024-06-04T16:19:05.125028+0000","last_undegraded":"2024-06-04T16:19:05.125028+0000","last_fullsized":"2024-06-04T16:19:05.125028+0000","mapping_epoch":246,"log_start":"0'0","ondisk_log_start":"0'0","created":246,"last_epoch_clean":247,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_clean_scrub_stamp":"2024-06-04T16:09:22.572686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T17:09:00.310675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"64.14","version":"251'30","reported_seq":117,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:55.011246+0000","last_change":"2024-06-04T16:07:09.404259+0000","last_active":"2024-06-04T16:18:55.011246+0000","last_peered":"2024-06-04T16:18:55.011246+0000","last_clean":"2024-06-04T16:18:55.011246+0000","last_became_active":"2024-06-04T16:07:09.403925+0000","last_became_peered":"2024-06-04T16:07:09.403925+0000","last_unstale":"2024-06-04T16:18:55.011246+0000","last_undegraded":"2024-06-04T16:18:55.011246+0000","last_fullsized":"2024-06-04T16:18:55.011246+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":243,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:07:08.374534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:07:08.374534+0000","last_clean_scrub_stamp":"2024-06-04T16:07:08.374534+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T23:42:39.058269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":154,"num_read_kb":107,"num_write":60,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.10","version":"0'0","reported_seq":14,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:30.008209+0000","last_change":"2024-06-04T16:16:08.656330+0000","last_active":"2024-06-04T16:18:30.008209+0000","last_peered":"2024-06-04T16:18:30.008209+0000","last_clean":"2024-06-04T16:18:30.008209+0000","last_became_active":"2024-06-04T16:16:08.656048+0000","last_became_peered":"2024-06-04T16:16:08.656048+0000","last_unstale":"2024-06-04T16:18:30.008209+0000","last_undegraded":"2024-06-04T16:18:30.008209+0000","last_fullsized":"2024-06-04T16:18:30.008209+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_clean_scrub_stamp":"2024-06-04T16:16:07.631263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T21:21:52.265223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.11","version":"251'8","reported_seq":39,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:50.011048+0000","last_change":"2024-06-04T16:09:26.626519+0000","last_active":"2024-06-04T16:18:50.011048+0000","last_peered":"2024-06-04T16:18:50.011048+0000","last_clean":"2024-06-04T16:18:50.011048+0000","last_became_active":"2024-06-04T16:09:26.624122+0000","last_became_peered":"2024-06-04T16:09:26.624122+0000","last_unstale":"2024-06-04T16:18:50.011048+0000","last_undegraded":"2024-06-04T16:18:50.011048+0000","last_fullsized":"2024-06-04T16:18:50.011048+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_clean_scrub_stamp":"2024-06-04T16:09:25.601105+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T21:22:14.386034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":17410,"num_write":17,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.12","version":"254'4","reported_seq":34,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:39.417842+0000","last_change":"2024-06-04T16:09:23.613003+0000","last_active":"2024-06-04T16:22:39.417842+0000","last_peered":"2024-06-04T16:22:39.417842+0000","last_clean":"2024-06-04T16:22:39.417842+0000","last_became_active":"2024-06-04T16:09:23.612699+0000","last_became_peered":"2024-06-04T16:09:23.612699+0000","last_unstale":"2024-06-04T16:22:39.417842+0000","last_undegraded":"2024-06-04T16:22:39.417842+0000","last_fullsized":"2024-06-04T16:22:39.417842+0000","mapping_epoch":246,"log_start":"0'0","ondisk_log_start":"0'0","created":246,"last_epoch_clean":247,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_clean_scrub_stamp":"2024-06-04T16:09:22.572686+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T22:44:45.643881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4,"num_write":4,"num_write_kb":1028,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"64.13","version":"254'35","reported_seq":138,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:50.010572+0000","last_change":"2024-06-04T16:07:09.511921+0000","last_active":"2024-06-04T16:18:50.010572+0000","last_peered":"2024-06-04T16:18:50.010572+0000","last_clean":"2024-06-04T16:18:50.010572+0000","last_became_active":"2024-06-04T16:07:09.511607+0000","last_became_peered":"2024-06-04T16:07:09.511607+0000","last_unstale":"2024-06-04T16:18:50.010572+0000","last_undegraded":"2024-06-04T16:18:50.010572+0000","last_fullsized":"2024-06-04T16:18:50.010572+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":243,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:07:08.374534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:07:08.374534+0000","last_clean_scrub_stamp":"2024-06-04T16:07:08.374534+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T21:14:21.163538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":198,"num_read_kb":144,"num_write":54,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.11","version":"0'0","reported_seq":14,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:30.008255+0000","last_change":"2024-06-04T16:16:08.649192+0000","last_active":"2024-06-04T16:18:30.008255+0000","last_peered":"2024-06-04T16:18:30.008255+0000","last_clean":"2024-06-04T16:18:30.008255+0000","last_became_active":"2024-06-04T16:16:08.648899+0000","last_became_peered":"2024-06-04T16:16:08.648899+0000","last_unstale":"2024-06-04T16:18:30.008255+0000","last_undegraded":"2024-06-04T16:18:30.008255+0000","last_fullsized":"2024-06-04T16:18:30.008255+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_clean_scrub_stamp":"2024-06-04T16:16:07.631263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T23:23:27.649414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.10","version":"254'2","reported_seq":26,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:21:10.129757+0000","last_change":"2024-06-04T16:09:26.628742+0000","last_active":"2024-06-04T16:21:10.129757+0000","last_peered":"2024-06-04T16:21:10.129757+0000","last_clean":"2024-06-04T16:21:10.129757+0000","last_became_active":"2024-06-04T16:09:26.628442+0000","last_became_peered":"2024-06-04T16:09:26.628442+0000","last_unstale":"2024-06-04T16:21:10.129757+0000","last_undegraded":"2024-06-04T16:21:10.129757+0000","last_fullsized":"2024-06-04T16:21:10.129757+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_clean_scrub_stamp":"2024-06-04T16:09:25.601105+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T00:52:10.655737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.13","version":"254'2","reported_seq":32,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:21:05.024153+0000","last_change":"2024-06-04T16:09:23.609979+0000","last_active":"2024-06-04T16:21:05.024153+0000","last_peered":"2024-06-04T16:21:05.024153+0000","last_clean":"2024-06-04T16:21:05.024153+0000","last_became_active":"2024-06-04T16:09:23.609536+0000","last_became_peered":"2024-06-04T16:09:23.609536+0000","last_unstale":"2024-06-04T16:21:05.024153+0000","last_undegraded":"2024-06-04T16:21:05.024153+0000","last_fullsized":"2024-06-04T16:21:05.024153+0000","mapping_epoch":246,"log_start":"0'0","ondisk_log_start":"0'0","created":246,"last_epoch_clean":247,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_clean_scrub_stamp":"2024-06-04T16:09:22.572686+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T16:56:59.952240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"64.12","version":"254'6","reported_seq":54,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:50.008991+0000","last_change":"2024-06-04T16:07:09.403628+0000","last_active":"2024-06-04T16:18:50.008991+0000","last_peered":"2024-06-04T16:18:50.008991+0000","last_clean":"2024-06-04T16:18:50.008991+0000","last_became_active":"2024-06-04T16:07:09.403352+0000","last_became_peered":"2024-06-04T16:07:09.403352+0000","last_unstale":"2024-06-04T16:18:50.008991+0000","last_undegraded":"2024-06-04T16:18:50.008991+0000","last_fullsized":"2024-06-04T16:18:50.008991+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":243,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:07:08.374534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:07:08.374534+0000","last_clean_scrub_stamp":"2024-06-04T16:07:08.374534+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T21:48:39.709806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":24,"num_write":11,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.12","version":"0'0","reported_seq":14,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:30.006539+0000","last_change":"2024-06-04T16:16:08.654940+0000","last_active":"2024-06-04T16:18:30.006539+0000","last_peered":"2024-06-04T16:18:30.006539+0000","last_clean":"2024-06-04T16:18:30.006539+0000","last_became_active":"2024-06-04T16:16:08.654624+0000","last_became_peered":"2024-06-04T16:16:08.654624+0000","last_unstale":"2024-06-04T16:18:30.006539+0000","last_undegraded":"2024-06-04T16:18:30.006539+0000","last_fullsized":"2024-06-04T16:18:30.006539+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_clean_scrub_stamp":"2024-06-04T16:16:07.631263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T02:28:30.956243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.13","version":"254'12","reported_seq":49,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:21:10.129817+0000","last_change":"2024-06-04T16:09:26.621968+0000","last_active":"2024-06-04T16:21:10.129817+0000","last_peered":"2024-06-04T16:21:10.129817+0000","last_clean":"2024-06-04T16:21:10.129817+0000","last_became_active":"2024-06-04T16:09:26.621494+0000","last_became_peered":"2024-06-04T16:09:26.621494+0000","last_unstale":"2024-06-04T16:21:10.129817+0000","last_undegraded":"2024-06-04T16:21:10.129817+0000","last_fullsized":"2024-06-04T16:21:10.129817+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_clean_scrub_stamp":"2024-06-04T16:09:25.601105+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T21:28:40.451250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":21,"num_read_kb":22532,"num_write":20,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.10","version":"254'7","reported_seq":43,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:21:05.142247+0000","last_change":"2024-06-04T16:09:23.606894+0000","last_active":"2024-06-04T16:21:05.142247+0000","last_peered":"2024-06-04T16:21:05.142247+0000","last_clean":"2024-06-04T16:21:05.142247+0000","last_became_active":"2024-06-04T16:09:23.606050+0000","last_became_peered":"2024-06-04T16:09:23.606050+0000","last_unstale":"2024-06-04T16:21:05.142247+0000","last_undegraded":"2024-06-04T16:21:05.142247+0000","last_fullsized":"2024-06-04T16:21:05.142247+0000","mapping_epoch":246,"log_start":"0'0","ondisk_log_start":"0'0","created":246,"last_epoch_clean":247,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_clean_scrub_stamp":"2024-06-04T16:09:22.572686+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T19:53:24.462326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":11,"num_read_kb":20482,"num_write":11,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"64.11","version":"251'138","reported_seq":475,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:50.008957+0000","last_change":"2024-06-04T16:07:09.511375+0000","last_active":"2024-06-04T16:18:50.008957+0000","last_peered":"2024-06-04T16:18:50.008957+0000","last_clean":"2024-06-04T16:18:50.008957+0000","last_became_active":"2024-06-04T16:07:09.511098+0000","last_became_peered":"2024-06-04T16:07:09.511098+0000","last_unstale":"2024-06-04T16:18:50.008957+0000","last_undegraded":"2024-06-04T16:18:50.008957+0000","last_fullsized":"2024-06-04T16:18:50.008957+0000","mapping_epoch":243,"log_start":"251'100","ondisk_log_start":"251'100","created":243,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:07:08.374534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:07:08.374534+0000","last_clean_scrub_stamp":"2024-06-04T16:07:08.374534+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T17:37:17.042544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":871,"num_read_kb":642,"num_write":155,"num_write_kb":133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.13","version":"254'1","reported_seq":15,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:30.119909+0000","last_change":"2024-06-04T16:16:08.657706+0000","last_active":"2024-06-04T16:18:30.119909+0000","last_peered":"2024-06-04T16:18:30.119909+0000","last_clean":"2024-06-04T16:18:30.119909+0000","last_became_active":"2024-06-04T16:16:08.657428+0000","last_became_peered":"2024-06-04T16:16:08.657428+0000","last_unstale":"2024-06-04T16:18:30.119909+0000","last_undegraded":"2024-06-04T16:18:30.119909+0000","last_fullsized":"2024-06-04T16:18:30.119909+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_clean_scrub_stamp":"2024-06-04T16:16:07.631263+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T19:11:05.041077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.12","version":"254'6","reported_seq":37,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:21:10.129797+0000","last_change":"2024-06-04T16:09:26.623554+0000","last_active":"2024-06-04T16:21:10.129797+0000","last_peered":"2024-06-04T16:21:10.129797+0000","last_clean":"2024-06-04T16:21:10.129797+0000","last_became_active":"2024-06-04T16:09:26.623285+0000","last_became_peered":"2024-06-04T16:09:26.623285+0000","last_unstale":"2024-06-04T16:21:10.129797+0000","last_undegraded":"2024-06-04T16:21:10.129797+0000","last_fullsized":"2024-06-04T16:21:10.129797+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_clean_scrub_stamp":"2024-06-04T16:09:25.601105+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T22:52:24.224426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":18434,"num_write":5,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.11","version":"254'2","reported_seq":33,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:21:05.019162+0000","last_change":"2024-06-04T16:09:23.607360+0000","last_active":"2024-06-04T16:21:05.019162+0000","last_peered":"2024-06-04T16:21:05.019162+0000","last_clean":"2024-06-04T16:21:05.019162+0000","last_became_active":"2024-06-04T16:09:23.607048+0000","last_became_peered":"2024-06-04T16:09:23.607048+0000","last_unstale":"2024-06-04T16:21:05.019162+0000","last_undegraded":"2024-06-04T16:21:05.019162+0000","last_fullsized":"2024-06-04T16:21:05.019162+0000","mapping_epoch":246,"log_start":"0'0","ondisk_log_start":"0'0","created":246,"last_epoch_clean":247,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_clean_scrub_stamp":"2024-06-04T16:09:22.572686+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T03:05:27.726738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8192,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"64.10","version":"251'6","reported_seq":54,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:50.122936+0000","last_change":"2024-06-04T16:07:09.401888+0000","last_active":"2024-06-04T16:18:50.122936+0000","last_peered":"2024-06-04T16:18:50.122936+0000","last_clean":"2024-06-04T16:18:50.122936+0000","last_became_active":"2024-06-04T16:07:09.401445+0000","last_became_peered":"2024-06-04T16:07:09.401445+0000","last_unstale":"2024-06-04T16:18:50.122936+0000","last_undegraded":"2024-06-04T16:18:50.122936+0000","last_fullsized":"2024-06-04T16:18:50.122936+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":243,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:07:08.374534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:07:08.374534+0000","last_clean_scrub_stamp":"2024-06-04T16:07:08.374534+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T02:48:14.306445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":24,"num_write":11,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.c","version":"254'1","reported_seq":15,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:25.119153+0000","last_change":"2024-06-04T16:16:08.664755+0000","last_active":"2024-06-04T16:18:25.119153+0000","last_peered":"2024-06-04T16:18:25.119153+0000","last_clean":"2024-06-04T16:18:25.119153+0000","last_became_active":"2024-06-04T16:16:08.664436+0000","last_became_peered":"2024-06-04T16:16:08.664436+0000","last_unstale":"2024-06-04T16:18:25.119153+0000","last_undegraded":"2024-06-04T16:18:25.119153+0000","last_fullsized":"2024-06-04T16:18:25.119153+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_clean_scrub_stamp":"2024-06-04T16:16:07.631263+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T23:11:08.299853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.d","version":"251'2","reported_seq":27,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:30.007548+0000","last_change":"2024-06-04T16:09:26.624040+0000","last_active":"2024-06-04T16:18:30.007548+0000","last_peered":"2024-06-04T16:18:30.007548+0000","last_clean":"2024-06-04T16:18:30.007548+0000","last_became_active":"2024-06-04T16:09:26.622747+0000","last_became_peered":"2024-06-04T16:09:26.622747+0000","last_unstale":"2024-06-04T16:18:30.007548+0000","last_undegraded":"2024-06-04T16:18:30.007548+0000","last_fullsized":"2024-06-04T16:18:30.007548+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_clean_scrub_stamp":"2024-06-04T16:09:25.601105+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T19:09:01.319407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.e","version":"254'10","reported_seq":47,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:20:40.021289+0000","last_change":"2024-06-04T16:09:23.609139+0000","last_active":"2024-06-04T16:20:40.021289+0000","last_peered":"2024-06-04T16:20:40.021289+0000","last_clean":"2024-06-04T16:20:40.021289+0000","last_became_active":"2024-06-04T16:09:23.608866+0000","last_became_peered":"2024-06-04T16:09:23.608866+0000","last_unstale":"2024-06-04T16:20:40.021289+0000","last_undegraded":"2024-06-04T16:20:40.021289+0000","last_fullsized":"2024-06-04T16:20:40.021289+0000","mapping_epoch":246,"log_start":"0'0","ondisk_log_start":"0'0","created":246,"last_epoch_clean":247,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_clean_scrub_stamp":"2024-06-04T16:09:22.572686+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T21:04:44.000874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":13,"num_read_kb":5122,"num_write":19,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"64.f","version":"251'6","reported_seq":51,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:25.112386+0000","last_change":"2024-06-04T16:07:09.401084+0000","last_active":"2024-06-04T16:18:25.112386+0000","last_peered":"2024-06-04T16:18:25.112386+0000","last_clean":"2024-06-04T16:18:25.112386+0000","last_became_active":"2024-06-04T16:07:09.400807+0000","last_became_peered":"2024-06-04T16:07:09.400807+0000","last_unstale":"2024-06-04T16:18:25.112386+0000","last_undegraded":"2024-06-04T16:18:25.112386+0000","last_fullsized":"2024-06-04T16:18:25.112386+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":243,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:07:08.374534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:07:08.374534+0000","last_clean_scrub_stamp":"2024-06-04T16:07:08.374534+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T19:24:05.530820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":19,"num_write":12,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.d","version":"0'0","reported_seq":14,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:25.119174+0000","last_change":"2024-06-04T16:16:08.657069+0000","last_active":"2024-06-04T16:18:25.119174+0000","last_peered":"2024-06-04T16:18:25.119174+0000","last_clean":"2024-06-04T16:18:25.119174+0000","last_became_active":"2024-06-04T16:16:08.656726+0000","last_became_peered":"2024-06-04T16:16:08.656726+0000","last_unstale":"2024-06-04T16:18:25.119174+0000","last_undegraded":"2024-06-04T16:18:25.119174+0000","last_fullsized":"2024-06-04T16:18:25.119174+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_clean_scrub_stamp":"2024-06-04T16:16:07.631263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T18:03:32.263500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.c","version":"254'3","reported_seq":28,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:20:45.016597+0000","last_change":"2024-06-04T16:09:26.628320+0000","last_active":"2024-06-04T16:20:45.016597+0000","last_peered":"2024-06-04T16:20:45.016597+0000","last_clean":"2024-06-04T16:20:45.016597+0000","last_became_active":"2024-06-04T16:09:26.627994+0000","last_became_peered":"2024-06-04T16:09:26.627994+0000","last_unstale":"2024-06-04T16:20:45.016597+0000","last_undegraded":"2024-06-04T16:20:45.016597+0000","last_fullsized":"2024-06-04T16:20:45.016597+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_clean_scrub_stamp":"2024-06-04T16:09:25.601105+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T00:37:41.828886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8192,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.f","version":"254'2","reported_seq":33,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:20:40.138740+0000","last_change":"2024-06-04T16:09:23.609586+0000","last_active":"2024-06-04T16:20:40.138740+0000","last_peered":"2024-06-04T16:20:40.138740+0000","last_clean":"2024-06-04T16:20:40.138740+0000","last_became_active":"2024-06-04T16:09:23.609283+0000","last_became_peered":"2024-06-04T16:09:23.609283+0000","last_unstale":"2024-06-04T16:20:40.138740+0000","last_undegraded":"2024-06-04T16:20:40.138740+0000","last_fullsized":"2024-06-04T16:20:40.138740+0000","mapping_epoch":246,"log_start":"0'0","ondisk_log_start":"0'0","created":246,"last_epoch_clean":247,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_clean_scrub_stamp":"2024-06-04T16:09:22.572686+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T19:30:03.495311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"64.e","version":"254'20","reported_seq":93,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:25.005990+0000","last_change":"2024-06-04T16:07:09.401774+0000","last_active":"2024-06-04T16:18:25.005990+0000","last_peered":"2024-06-04T16:18:25.005990+0000","last_clean":"2024-06-04T16:18:25.005990+0000","last_became_active":"2024-06-04T16:07:09.401515+0000","last_became_peered":"2024-06-04T16:07:09.401515+0000","last_unstale":"2024-06-04T16:18:25.005990+0000","last_undegraded":"2024-06-04T16:18:25.005990+0000","last_fullsized":"2024-06-04T16:18:25.005990+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":243,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:07:08.374534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:07:08.374534+0000","last_clean_scrub_stamp":"2024-06-04T16:07:08.374534+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T00:16:43.451325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":108,"num_read_kb":75,"num_write":37,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.e","version":"0'0","reported_seq":14,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:25.007601+0000","last_change":"2024-06-04T16:16:08.657545+0000","last_active":"2024-06-04T16:18:25.007601+0000","last_peered":"2024-06-04T16:18:25.007601+0000","last_clean":"2024-06-04T16:18:25.007601+0000","last_became_active":"2024-06-04T16:16:08.657279+0000","last_became_peered":"2024-06-04T16:16:08.657279+0000","last_unstale":"2024-06-04T16:18:25.007601+0000","last_undegraded":"2024-06-04T16:18:25.007601+0000","last_fullsized":"2024-06-04T16:18:25.007601+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_clean_scrub_stamp":"2024-06-04T16:16:07.631263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T23:08:35.507441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.f","version":"254'9","reported_seq":43,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:20:45.139442+0000","last_change":"2024-06-04T16:09:26.623833+0000","last_active":"2024-06-04T16:20:45.139442+0000","last_peered":"2024-06-04T16:20:45.139442+0000","last_clean":"2024-06-04T16:20:45.139442+0000","last_became_active":"2024-06-04T16:09:26.623307+0000","last_became_peered":"2024-06-04T16:09:26.623307+0000","last_unstale":"2024-06-04T16:20:45.139442+0000","last_undegraded":"2024-06-04T16:20:45.139442+0000","last_fullsized":"2024-06-04T16:20:45.139442+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_clean_scrub_stamp":"2024-06-04T16:09:25.601105+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T23:15:04.575909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":8194,"num_write":13,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.c","version":"254'5","reported_seq":36,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:20:40.026079+0000","last_change":"2024-06-04T16:09:23.612714+0000","last_active":"2024-06-04T16:20:40.026079+0000","last_peered":"2024-06-04T16:20:40.026079+0000","last_clean":"2024-06-04T16:20:40.026079+0000","last_became_active":"2024-06-04T16:09:23.612445+0000","last_became_peered":"2024-06-04T16:09:23.612445+0000","last_unstale":"2024-06-04T16:20:40.026079+0000","last_undegraded":"2024-06-04T16:20:40.026079+0000","last_fullsized":"2024-06-04T16:20:40.026079+0000","mapping_epoch":246,"log_start":"0'0","ondisk_log_start":"0'0","created":246,"last_epoch_clean":247,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_clean_scrub_stamp":"2024-06-04T16:09:22.572686+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T19:29:18.909595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":1024,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"64.d","version":"251'24","reported_seq":105,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:25.005958+0000","last_change":"2024-06-04T16:07:09.511802+0000","last_active":"2024-06-04T16:18:25.005958+0000","last_peered":"2024-06-04T16:18:25.005958+0000","last_clean":"2024-06-04T16:18:25.005958+0000","last_became_active":"2024-06-04T16:07:09.511172+0000","last_became_peered":"2024-06-04T16:07:09.511172+0000","last_unstale":"2024-06-04T16:18:25.005958+0000","last_undegraded":"2024-06-04T16:18:25.005958+0000","last_fullsized":"2024-06-04T16:18:25.005958+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":243,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:07:08.374534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:07:08.374534+0000","last_clean_scrub_stamp":"2024-06-04T16:07:08.374534+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T20:08:28.763067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":134,"num_read_kb":91,"num_write":39,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.f","version":"0'0","reported_seq":14,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:25.119219+0000","last_change":"2024-06-04T16:16:08.662500+0000","last_active":"2024-06-04T16:18:25.119219+0000","last_peered":"2024-06-04T16:18:25.119219+0000","last_clean":"2024-06-04T16:18:25.119219+0000","last_became_active":"2024-06-04T16:16:08.662182+0000","last_became_peered":"2024-06-04T16:16:08.662182+0000","last_unstale":"2024-06-04T16:18:25.119219+0000","last_undegraded":"2024-06-04T16:18:25.119219+0000","last_fullsized":"2024-06-04T16:18:25.119219+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_clean_scrub_stamp":"2024-06-04T16:16:07.631263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T00:09:54.410059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.e","version":"0'0","reported_seq":23,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:30.119962+0000","last_change":"2024-06-04T16:09:26.629323+0000","last_active":"2024-06-04T16:18:30.119962+0000","last_peered":"2024-06-04T16:18:30.119962+0000","last_clean":"2024-06-04T16:18:30.119962+0000","last_became_active":"2024-06-04T16:09:26.629039+0000","last_became_peered":"2024-06-04T16:09:26.629039+0000","last_unstale":"2024-06-04T16:18:30.119962+0000","last_undegraded":"2024-06-04T16:18:30.119962+0000","last_fullsized":"2024-06-04T16:18:30.119962+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_clean_scrub_stamp":"2024-06-04T16:09:25.601105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T17:17:10.026858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.d","version":"254'7","reported_seq":42,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:39.411239+0000","last_change":"2024-06-04T16:09:23.607472+0000","last_active":"2024-06-04T16:22:39.411239+0000","last_peered":"2024-06-04T16:22:39.411239+0000","last_clean":"2024-06-04T16:22:39.411239+0000","last_became_active":"2024-06-04T16:09:23.606695+0000","last_became_peered":"2024-06-04T16:09:23.606695+0000","last_unstale":"2024-06-04T16:22:39.411239+0000","last_undegraded":"2024-06-04T16:22:39.411239+0000","last_fullsized":"2024-06-04T16:22:39.411239+0000","mapping_epoch":246,"log_start":"0'0","ondisk_log_start":"0'0","created":246,"last_epoch_clean":247,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_clean_scrub_stamp":"2024-06-04T16:09:22.572686+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T03:00:34.921184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":20480,"num_write":12,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"64.c","version":"251'31","reported_seq":123,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:25.002486+0000","last_change":"2024-06-04T16:07:09.511067+0000","last_active":"2024-06-04T16:18:25.002486+0000","last_peered":"2024-06-04T16:18:25.002486+0000","last_clean":"2024-06-04T16:18:25.002486+0000","last_became_active":"2024-06-04T16:07:09.510728+0000","last_became_peered":"2024-06-04T16:07:09.510728+0000","last_unstale":"2024-06-04T16:18:25.002486+0000","last_undegraded":"2024-06-04T16:18:25.002486+0000","last_fullsized":"2024-06-04T16:18:25.002486+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":243,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:07:08.374534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:07:08.374534+0000","last_clean_scrub_stamp":"2024-06-04T16:07:08.374534+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T19:07:33.768205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":168,"num_read_kb":120,"num_write":55,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.8","version":"0'0","reported_seq":15,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:20:30.015103+0000","last_change":"2024-06-04T16:16:08.664471+0000","last_active":"2024-06-04T16:20:30.015103+0000","last_peered":"2024-06-04T16:20:30.015103+0000","last_clean":"2024-06-04T16:20:30.015103+0000","last_became_active":"2024-06-04T16:16:08.664198+0000","last_became_peered":"2024-06-04T16:16:08.664198+0000","last_unstale":"2024-06-04T16:20:30.015103+0000","last_undegraded":"2024-06-04T16:20:30.015103+0000","last_fullsized":"2024-06-04T16:20:30.015103+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_clean_scrub_stamp":"2024-06-04T16:16:07.631263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T22:21:33.139848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.9","version":"254'6","reported_seq":35,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:39.426195+0000","last_change":"2024-06-04T16:09:26.626757+0000","last_active":"2024-06-04T16:22:39.426195+0000","last_peered":"2024-06-04T16:22:39.426195+0000","last_clean":"2024-06-04T16:22:39.426195+0000","last_became_active":"2024-06-04T16:09:26.625999+0000","last_became_peered":"2024-06-04T16:09:26.625999+0000","last_unstale":"2024-06-04T16:22:39.426195+0000","last_undegraded":"2024-06-04T16:22:39.426195+0000","last_fullsized":"2024-06-04T16:22:39.426195+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_clean_scrub_stamp":"2024-06-04T16:09:25.601105+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T19:40:29.538335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":9216,"num_write":6,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.a","version":"254'3","reported_seq":33,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:25.028345+0000","last_change":"2024-06-04T16:09:23.601101+0000","last_active":"2024-06-04T16:22:25.028345+0000","last_peered":"2024-06-04T16:22:25.028345+0000","last_clean":"2024-06-04T16:22:25.028345+0000","last_became_active":"2024-06-04T16:09:23.600752+0000","last_became_peered":"2024-06-04T16:09:23.600752+0000","last_unstale":"2024-06-04T16:22:25.028345+0000","last_undegraded":"2024-06-04T16:22:25.028345+0000","last_fullsized":"2024-06-04T16:22:25.028345+0000","mapping_epoch":246,"log_start":"0'0","ondisk_log_start":"0'0","created":246,"last_epoch_clean":247,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_clean_scrub_stamp":"2024-06-04T16:09:22.572686+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T17:03:48.692088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"64.b","version":"251'21","reported_seq":96,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:25.119108+0000","last_change":"2024-06-04T16:07:09.513384+0000","last_active":"2024-06-04T16:18:25.119108+0000","last_peered":"2024-06-04T16:18:25.119108+0000","last_clean":"2024-06-04T16:18:25.119108+0000","last_became_active":"2024-06-04T16:07:09.513020+0000","last_became_peered":"2024-06-04T16:07:09.513020+0000","last_unstale":"2024-06-04T16:18:25.119108+0000","last_undegraded":"2024-06-04T16:18:25.119108+0000","last_fullsized":"2024-06-04T16:18:25.119108+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":243,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:07:08.374534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:07:08.374534+0000","last_clean_scrub_stamp":"2024-06-04T16:07:08.374534+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T17:46:59.707579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":114,"num_read_kb":81,"num_write":38,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.9","version":"0'0","reported_seq":15,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:20:30.020087+0000","last_change":"2024-06-04T16:16:08.658344+0000","last_active":"2024-06-04T16:20:30.020087+0000","last_peered":"2024-06-04T16:20:30.020087+0000","last_clean":"2024-06-04T16:20:30.020087+0000","last_became_active":"2024-06-04T16:16:08.658076+0000","last_became_peered":"2024-06-04T16:16:08.658076+0000","last_unstale":"2024-06-04T16:20:30.020087+0000","last_undegraded":"2024-06-04T16:20:30.020087+0000","last_fullsized":"2024-06-04T16:20:30.020087+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_clean_scrub_stamp":"2024-06-04T16:16:07.631263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T17:29:18.849209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.8","version":"254'7","reported_seq":32,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:39.410471+0000","last_change":"2024-06-04T16:09:26.624229+0000","last_active":"2024-06-04T16:22:39.410471+0000","last_peered":"2024-06-04T16:22:39.410471+0000","last_clean":"2024-06-04T16:22:39.410471+0000","last_became_active":"2024-06-04T16:09:26.623966+0000","last_became_peered":"2024-06-04T16:09:26.623966+0000","last_unstale":"2024-06-04T16:22:39.410471+0000","last_undegraded":"2024-06-04T16:22:39.410471+0000","last_fullsized":"2024-06-04T16:22:39.410471+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_clean_scrub_stamp":"2024-06-04T16:09:25.601105+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T21:11:02.568495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4096,"num_write":12,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.b","version":"254'4","reported_seq":35,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:39.444080+0000","last_change":"2024-06-04T16:09:23.613436+0000","last_active":"2024-06-04T16:22:39.444080+0000","last_peered":"2024-06-04T16:22:39.444080+0000","last_clean":"2024-06-04T16:22:39.444080+0000","last_became_active":"2024-06-04T16:09:23.613130+0000","last_became_peered":"2024-06-04T16:09:23.613130+0000","last_unstale":"2024-06-04T16:22:39.444080+0000","last_undegraded":"2024-06-04T16:22:39.444080+0000","last_fullsized":"2024-06-04T16:22:39.444080+0000","mapping_epoch":246,"log_start":"0'0","ondisk_log_start":"0'0","created":246,"last_epoch_clean":247,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_clean_scrub_stamp":"2024-06-04T16:09:22.572686+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T19:22:58.043042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3775,"num_write":4,"num_write_kb":3775,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"64.a","version":"251'22","reported_seq":100,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:20:15.022440+0000","last_change":"2024-06-04T16:07:09.404274+0000","last_active":"2024-06-04T16:20:15.022440+0000","last_peered":"2024-06-04T16:20:15.022440+0000","last_clean":"2024-06-04T16:20:15.022440+0000","last_became_active":"2024-06-04T16:07:09.403980+0000","last_became_peered":"2024-06-04T16:07:09.403980+0000","last_unstale":"2024-06-04T16:20:15.022440+0000","last_undegraded":"2024-06-04T16:20:15.022440+0000","last_fullsized":"2024-06-04T16:20:15.022440+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":243,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:07:08.374534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:07:08.374534+0000","last_clean_scrub_stamp":"2024-06-04T16:07:08.374534+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T01:30:42.556639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":122,"num_read_kb":87,"num_write":38,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.a","version":"0'0","reported_seq":15,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:20:30.014610+0000","last_change":"2024-06-04T16:16:08.661712+0000","last_active":"2024-06-04T16:20:30.014610+0000","last_peered":"2024-06-04T16:20:30.014610+0000","last_clean":"2024-06-04T16:20:30.014610+0000","last_became_active":"2024-06-04T16:16:08.661413+0000","last_became_peered":"2024-06-04T16:16:08.661413+0000","last_unstale":"2024-06-04T16:20:30.014610+0000","last_undegraded":"2024-06-04T16:20:30.014610+0000","last_fullsized":"2024-06-04T16:20:30.014610+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_clean_scrub_stamp":"2024-06-04T16:16:07.631263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T20:52:36.472473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.b","version":"254'4","reported_seq":31,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:20:45.021805+0000","last_change":"2024-06-04T16:09:26.622990+0000","last_active":"2024-06-04T16:20:45.021805+0000","last_peered":"2024-06-04T16:20:45.021805+0000","last_clean":"2024-06-04T16:20:45.021805+0000","last_became_active":"2024-06-04T16:09:26.622600+0000","last_became_peered":"2024-06-04T16:09:26.622600+0000","last_unstale":"2024-06-04T16:20:45.021805+0000","last_undegraded":"2024-06-04T16:20:45.021805+0000","last_fullsized":"2024-06-04T16:20:45.021805+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_clean_scrub_stamp":"2024-06-04T16:09:25.601105+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T17:25:05.424763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":1032,"num_write":4,"num_write_kb":1028,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.8","version":"251'2","reported_seq":34,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:20:15.013108+0000","last_change":"2024-06-04T16:09:23.610808+0000","last_active":"2024-06-04T16:20:15.013108+0000","last_peered":"2024-06-04T16:20:15.013108+0000","last_clean":"2024-06-04T16:20:15.013108+0000","last_became_active":"2024-06-04T16:09:23.610525+0000","last_became_peered":"2024-06-04T16:09:23.610525+0000","last_unstale":"2024-06-04T16:20:15.013108+0000","last_undegraded":"2024-06-04T16:20:15.013108+0000","last_fullsized":"2024-06-04T16:20:15.013108+0000","mapping_epoch":246,"log_start":"0'0","ondisk_log_start":"0'0","created":246,"last_epoch_clean":247,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_clean_scrub_stamp":"2024-06-04T16:09:22.572686+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T16:29:28.622251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"64.9","version":"251'14","reported_seq":79,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:20:10.022040+0000","last_change":"2024-06-04T16:07:09.403769+0000","last_active":"2024-06-04T16:20:10.022040+0000","last_peered":"2024-06-04T16:20:10.022040+0000","last_clean":"2024-06-04T16:20:10.022040+0000","last_became_active":"2024-06-04T16:07:09.403227+0000","last_became_peered":"2024-06-04T16:07:09.403227+0000","last_unstale":"2024-06-04T16:20:10.022040+0000","last_undegraded":"2024-06-04T16:20:10.022040+0000","last_fullsized":"2024-06-04T16:20:10.022040+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":243,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:07:08.374534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:07:08.374534+0000","last_clean_scrub_stamp":"2024-06-04T16:07:08.374534+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T18:26:06.974591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":56,"num_write":27,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.b","version":"0'0","reported_seq":14,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:25.006788+0000","last_change":"2024-06-04T16:16:08.660998+0000","last_active":"2024-06-04T16:18:25.006788+0000","last_peered":"2024-06-04T16:18:25.006788+0000","last_clean":"2024-06-04T16:18:25.006788+0000","last_became_active":"2024-06-04T16:16:08.660717+0000","last_became_peered":"2024-06-04T16:16:08.660717+0000","last_unstale":"2024-06-04T16:18:25.006788+0000","last_undegraded":"2024-06-04T16:18:25.006788+0000","last_fullsized":"2024-06-04T16:18:25.006788+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_clean_scrub_stamp":"2024-06-04T16:16:07.631263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T03:13:46.348557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.a","version":"254'2","reported_seq":28,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:30.154965+0000","last_change":"2024-06-04T16:09:26.620380+0000","last_active":"2024-06-04T16:22:30.154965+0000","last_peered":"2024-06-04T16:22:30.154965+0000","last_clean":"2024-06-04T16:22:30.154965+0000","last_became_active":"2024-06-04T16:09:26.620119+0000","last_became_peered":"2024-06-04T16:09:26.620119+0000","last_unstale":"2024-06-04T16:22:30.154965+0000","last_undegraded":"2024-06-04T16:22:30.154965+0000","last_fullsized":"2024-06-04T16:22:30.154965+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_clean_scrub_stamp":"2024-06-04T16:09:25.601105+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T18:51:09.607155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8192,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.9","version":"251'5","reported_seq":41,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:20:15.022798+0000","last_change":"2024-06-04T16:09:23.607975+0000","last_active":"2024-06-04T16:20:15.022798+0000","last_peered":"2024-06-04T16:20:15.022798+0000","last_clean":"2024-06-04T16:20:15.022798+0000","last_became_active":"2024-06-04T16:09:23.607666+0000","last_became_peered":"2024-06-04T16:09:23.607666+0000","last_unstale":"2024-06-04T16:20:15.022798+0000","last_undegraded":"2024-06-04T16:20:15.022798+0000","last_fullsized":"2024-06-04T16:20:15.022798+0000","mapping_epoch":246,"log_start":"0'0","ondisk_log_start":"0'0","created":246,"last_epoch_clean":247,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_clean_scrub_stamp":"2024-06-04T16:09:22.572686+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T16:30:58.550630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":16386,"num_write":9,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"64.8","version":"251'8","reported_seq":61,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:20:10.017783+0000","last_change":"2024-06-04T16:07:09.405213+0000","last_active":"2024-06-04T16:20:10.017783+0000","last_peered":"2024-06-04T16:20:10.017783+0000","last_clean":"2024-06-04T16:20:10.017783+0000","last_became_active":"2024-06-04T16:07:09.404928+0000","last_became_peered":"2024-06-04T16:07:09.404928+0000","last_unstale":"2024-06-04T16:20:10.017783+0000","last_undegraded":"2024-06-04T16:20:10.017783+0000","last_fullsized":"2024-06-04T16:20:10.017783+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":243,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:07:08.374534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:07:08.374534+0000","last_clean_scrub_stamp":"2024-06-04T16:07:08.374534+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T19:53:15.255308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":32,"num_write":14,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.4","version":"0'0","reported_seq":15,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:20:20.023650+0000","last_change":"2024-06-04T16:16:08.663046+0000","last_active":"2024-06-04T16:20:20.023650+0000","last_peered":"2024-06-04T16:20:20.023650+0000","last_clean":"2024-06-04T16:20:20.023650+0000","last_became_active":"2024-06-04T16:16:08.662732+0000","last_became_peered":"2024-06-04T16:16:08.662732+0000","last_unstale":"2024-06-04T16:20:20.023650+0000","last_undegraded":"2024-06-04T16:20:20.023650+0000","last_fullsized":"2024-06-04T16:20:20.023650+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_clean_scrub_stamp":"2024-06-04T16:16:07.631263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T19:10:09.410318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.5","version":"254'2","reported_seq":27,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:00.037728+0000","last_change":"2024-06-04T16:09:26.624497+0000","last_active":"2024-06-04T16:22:00.037728+0000","last_peered":"2024-06-04T16:22:00.037728+0000","last_clean":"2024-06-04T16:22:00.037728+0000","last_became_active":"2024-06-04T16:09:26.624142+0000","last_became_peered":"2024-06-04T16:09:26.624142+0000","last_unstale":"2024-06-04T16:22:00.037728+0000","last_undegraded":"2024-06-04T16:22:00.037728+0000","last_fullsized":"2024-06-04T16:22:00.037728+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_clean_scrub_stamp":"2024-06-04T16:09:25.601105+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T18:17:49.470708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.6","version":"254'3","reported_seq":35,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:25.033070+0000","last_change":"2024-06-04T16:09:23.608725+0000","last_active":"2024-06-04T16:22:25.033070+0000","last_peered":"2024-06-04T16:22:25.033070+0000","last_clean":"2024-06-04T16:22:25.033070+0000","last_became_active":"2024-06-04T16:09:23.608300+0000","last_became_peered":"2024-06-04T16:09:23.608300+0000","last_unstale":"2024-06-04T16:22:25.033070+0000","last_undegraded":"2024-06-04T16:22:25.033070+0000","last_fullsized":"2024-06-04T16:22:25.033070+0000","mapping_epoch":246,"log_start":"0'0","ondisk_log_start":"0'0","created":246,"last_epoch_clean":247,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_clean_scrub_stamp":"2024-06-04T16:09:22.572686+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T23:47:46.805128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8192,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"64.7","version":"251'16","reported_seq":79,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:20:10.022130+0000","last_change":"2024-06-04T16:07:09.511741+0000","last_active":"2024-06-04T16:20:10.022130+0000","last_peered":"2024-06-04T16:20:10.022130+0000","last_clean":"2024-06-04T16:20:10.022130+0000","last_became_active":"2024-06-04T16:07:09.511421+0000","last_became_peered":"2024-06-04T16:07:09.511421+0000","last_unstale":"2024-06-04T16:20:10.022130+0000","last_undegraded":"2024-06-04T16:20:10.022130+0000","last_fullsized":"2024-06-04T16:20:10.022130+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":243,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:07:08.374534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:07:08.374534+0000","last_clean_scrub_stamp":"2024-06-04T16:07:08.374534+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T20:29:49.254010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":56,"num_write":28,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.5","version":"0'0","reported_seq":15,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:20:20.023672+0000","last_change":"2024-06-04T16:16:08.656242+0000","last_active":"2024-06-04T16:20:20.023672+0000","last_peered":"2024-06-04T16:20:20.023672+0000","last_clean":"2024-06-04T16:20:20.023672+0000","last_became_active":"2024-06-04T16:16:08.655913+0000","last_became_peered":"2024-06-04T16:16:08.655913+0000","last_unstale":"2024-06-04T16:20:20.023672+0000","last_undegraded":"2024-06-04T16:20:20.023672+0000","last_fullsized":"2024-06-04T16:20:20.023672+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_clean_scrub_stamp":"2024-06-04T16:16:07.631263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T02:48:49.714670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.4","version":"254'2","reported_seq":27,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:00.030250+0000","last_change":"2024-06-04T16:09:26.628240+0000","last_active":"2024-06-04T16:22:00.030250+0000","last_peered":"2024-06-04T16:22:00.030250+0000","last_clean":"2024-06-04T16:22:00.030250+0000","last_became_active":"2024-06-04T16:09:26.627915+0000","last_became_peered":"2024-06-04T16:09:26.627915+0000","last_unstale":"2024-06-04T16:22:00.030250+0000","last_undegraded":"2024-06-04T16:22:00.030250+0000","last_fullsized":"2024-06-04T16:22:00.030250+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_clean_scrub_stamp":"2024-06-04T16:09:25.601105+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T18:57:07.829231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.7","version":"251'3","reported_seq":35,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:20:15.022566+0000","last_change":"2024-06-04T16:09:23.607332+0000","last_active":"2024-06-04T16:20:15.022566+0000","last_peered":"2024-06-04T16:20:15.022566+0000","last_clean":"2024-06-04T16:20:15.022566+0000","last_became_active":"2024-06-04T16:09:23.605516+0000","last_became_peered":"2024-06-04T16:09:23.605516+0000","last_unstale":"2024-06-04T16:20:15.022566+0000","last_undegraded":"2024-06-04T16:20:15.022566+0000","last_fullsized":"2024-06-04T16:20:15.022566+0000","mapping_epoch":246,"log_start":"0'0","ondisk_log_start":"0'0","created":246,"last_epoch_clean":247,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_clean_scrub_stamp":"2024-06-04T16:09:22.572686+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T18:35:30.226341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"64.6","version":"251'12","reported_seq":67,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:20:10.012671+0000","last_change":"2024-06-04T16:07:09.398080+0000","last_active":"2024-06-04T16:20:10.012671+0000","last_peered":"2024-06-04T16:20:10.012671+0000","last_clean":"2024-06-04T16:20:10.012671+0000","last_became_active":"2024-06-04T16:07:09.397805+0000","last_became_peered":"2024-06-04T16:07:09.397805+0000","last_unstale":"2024-06-04T16:20:10.012671+0000","last_undegraded":"2024-06-04T16:20:10.012671+0000","last_fullsized":"2024-06-04T16:20:10.012671+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":243,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:07:08.374534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:07:08.374534+0000","last_clean_scrub_stamp":"2024-06-04T16:07:08.374534+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T23:55:55.603697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":38,"num_write":27,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.6","version":"253'1","reported_seq":16,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:20:30.020177+0000","last_change":"2024-06-04T16:16:08.656516+0000","last_active":"2024-06-04T16:20:30.020177+0000","last_peered":"2024-06-04T16:20:30.020177+0000","last_clean":"2024-06-04T16:20:30.020177+0000","last_became_active":"2024-06-04T16:16:08.656182+0000","last_became_peered":"2024-06-04T16:16:08.656182+0000","last_unstale":"2024-06-04T16:20:30.020177+0000","last_undegraded":"2024-06-04T16:20:30.020177+0000","last_fullsized":"2024-06-04T16:20:30.020177+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_clean_scrub_stamp":"2024-06-04T16:16:07.631263+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T22:01:48.464700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.7","version":"0'0","reported_seq":24,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:20:20.019052+0000","last_change":"2024-06-04T16:09:26.626653+0000","last_active":"2024-06-04T16:20:20.019052+0000","last_peered":"2024-06-04T16:20:20.019052+0000","last_clean":"2024-06-04T16:20:20.019052+0000","last_became_active":"2024-06-04T16:09:26.625833+0000","last_became_peered":"2024-06-04T16:09:26.625833+0000","last_unstale":"2024-06-04T16:20:20.019052+0000","last_undegraded":"2024-06-04T16:20:20.019052+0000","last_fullsized":"2024-06-04T16:20:20.019052+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_clean_scrub_stamp":"2024-06-04T16:09:25.601105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T21:55:58.166045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.4","version":"0'0","reported_seq":30,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:50.131381+0000","last_change":"2024-06-04T16:09:23.607166+0000","last_active":"2024-06-04T16:19:50.131381+0000","last_peered":"2024-06-04T16:19:50.131381+0000","last_clean":"2024-06-04T16:19:50.131381+0000","last_became_active":"2024-06-04T16:09:23.606669+0000","last_became_peered":"2024-06-04T16:09:23.606669+0000","last_unstale":"2024-06-04T16:19:50.131381+0000","last_undegraded":"2024-06-04T16:19:50.131381+0000","last_fullsized":"2024-06-04T16:19:50.131381+0000","mapping_epoch":246,"log_start":"0'0","ondisk_log_start":"0'0","created":246,"last_epoch_clean":247,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_clean_scrub_stamp":"2024-06-04T16:09:22.572686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T03:58:28.100517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"64.5","version":"254'31","reported_seq":127,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:40.120414+0000","last_change":"2024-06-04T16:07:09.404140+0000","last_active":"2024-06-04T16:19:40.120414+0000","last_peered":"2024-06-04T16:19:40.120414+0000","last_clean":"2024-06-04T16:19:40.120414+0000","last_became_active":"2024-06-04T16:07:09.403868+0000","last_became_peered":"2024-06-04T16:07:09.403868+0000","last_unstale":"2024-06-04T16:19:40.120414+0000","last_undegraded":"2024-06-04T16:19:40.120414+0000","last_fullsized":"2024-06-04T16:19:40.120414+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":243,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:07:08.374534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:07:08.374534+0000","last_clean_scrub_stamp":"2024-06-04T16:07:08.374534+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T19:30:33.830947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":170,"num_read_kb":120,"num_write":66,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.7","version":"0'0","reported_seq":15,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:20:30.014663+0000","last_change":"2024-06-04T16:16:08.661700+0000","last_active":"2024-06-04T16:20:30.014663+0000","last_peered":"2024-06-04T16:20:30.014663+0000","last_clean":"2024-06-04T16:20:30.014663+0000","last_became_active":"2024-06-04T16:16:08.661379+0000","last_became_peered":"2024-06-04T16:16:08.661379+0000","last_unstale":"2024-06-04T16:20:30.014663+0000","last_undegraded":"2024-06-04T16:20:30.014663+0000","last_fullsized":"2024-06-04T16:20:30.014663+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_clean_scrub_stamp":"2024-06-04T16:16:07.631263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T18:30:12.285218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.6","version":"0'0","reported_seq":24,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:20:20.014285+0000","last_change":"2024-06-04T16:09:26.624438+0000","last_active":"2024-06-04T16:20:20.014285+0000","last_peered":"2024-06-04T16:20:20.014285+0000","last_clean":"2024-06-04T16:20:20.014285+0000","last_became_active":"2024-06-04T16:09:26.624074+0000","last_became_peered":"2024-06-04T16:09:26.624074+0000","last_unstale":"2024-06-04T16:20:20.014285+0000","last_undegraded":"2024-06-04T16:20:20.014285+0000","last_fullsized":"2024-06-04T16:20:20.014285+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_clean_scrub_stamp":"2024-06-04T16:09:25.601105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T21:01:18.041771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.5","version":"254'4","reported_seq":36,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:21:55.025485+0000","last_change":"2024-06-04T16:09:23.604554+0000","last_active":"2024-06-04T16:21:55.025485+0000","last_peered":"2024-06-04T16:21:55.025485+0000","last_clean":"2024-06-04T16:21:55.025485+0000","last_became_active":"2024-06-04T16:09:23.604255+0000","last_became_peered":"2024-06-04T16:09:23.604255+0000","last_unstale":"2024-06-04T16:21:55.025485+0000","last_undegraded":"2024-06-04T16:21:55.025485+0000","last_fullsized":"2024-06-04T16:21:55.025485+0000","mapping_epoch":246,"log_start":"0'0","ondisk_log_start":"0'0","created":246,"last_epoch_clean":247,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_clean_scrub_stamp":"2024-06-04T16:09:22.572686+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T19:47:14.640534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":4,"num_write_kb":1026,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"64.4","version":"254'14","reported_seq":76,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:40.009620+0000","last_change":"2024-06-04T16:07:09.397501+0000","last_active":"2024-06-04T16:19:40.009620+0000","last_peered":"2024-06-04T16:19:40.009620+0000","last_clean":"2024-06-04T16:19:40.009620+0000","last_became_active":"2024-06-04T16:07:09.396484+0000","last_became_peered":"2024-06-04T16:07:09.396484+0000","last_unstale":"2024-06-04T16:19:40.009620+0000","last_undegraded":"2024-06-04T16:19:40.009620+0000","last_fullsized":"2024-06-04T16:19:40.009620+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":243,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:07:08.374534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:07:08.374534+0000","last_clean_scrub_stamp":"2024-06-04T16:07:08.374534+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T16:59:32.871360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":52,"num_write":27,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.0","version":"0'0","reported_seq":15,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:20:10.017765+0000","last_change":"2024-06-04T16:16:08.661272+0000","last_active":"2024-06-04T16:20:10.017765+0000","last_peered":"2024-06-04T16:20:10.017765+0000","last_clean":"2024-06-04T16:20:10.017765+0000","last_became_active":"2024-06-04T16:16:08.660893+0000","last_became_peered":"2024-06-04T16:16:08.660893+0000","last_unstale":"2024-06-04T16:20:10.017765+0000","last_undegraded":"2024-06-04T16:20:10.017765+0000","last_fullsized":"2024-06-04T16:20:10.017765+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_clean_scrub_stamp":"2024-06-04T16:16:07.631263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T00:49:39.967328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1","version":"251'2","reported_seq":28,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:55.016165+0000","last_change":"2024-06-04T16:09:26.623485+0000","last_active":"2024-06-04T16:19:55.016165+0000","last_peered":"2024-06-04T16:19:55.016165+0000","last_clean":"2024-06-04T16:19:55.016165+0000","last_became_active":"2024-06-04T16:09:26.623190+0000","last_became_peered":"2024-06-04T16:09:26.623190+0000","last_unstale":"2024-06-04T16:19:55.016165+0000","last_undegraded":"2024-06-04T16:19:55.016165+0000","last_fullsized":"2024-06-04T16:19:55.016165+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_clean_scrub_stamp":"2024-06-04T16:09:25.601105+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T18:13:31.934728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.2","version":"254'6","reported_seq":41,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:39.410736+0000","last_change":"2024-06-04T16:09:23.610740+0000","last_active":"2024-06-04T16:22:39.410736+0000","last_peered":"2024-06-04T16:22:39.410736+0000","last_clean":"2024-06-04T16:22:39.410736+0000","last_became_active":"2024-06-04T16:09:23.610479+0000","last_became_peered":"2024-06-04T16:09:23.610479+0000","last_unstale":"2024-06-04T16:22:39.410736+0000","last_undegraded":"2024-06-04T16:22:39.410736+0000","last_fullsized":"2024-06-04T16:22:39.410736+0000","mapping_epoch":246,"log_start":"0'0","ondisk_log_start":"0'0","created":246,"last_epoch_clean":247,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_clean_scrub_stamp":"2024-06-04T16:09:22.572686+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T20:36:24.481405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5120,"num_write":6,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"64.3","version":"251'23","reported_seq":98,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:40.017634+0000","last_change":"2024-06-04T16:07:09.513369+0000","last_active":"2024-06-04T16:19:40.017634+0000","last_peered":"2024-06-04T16:19:40.017634+0000","last_clean":"2024-06-04T16:19:40.017634+0000","last_became_active":"2024-06-04T16:07:09.512996+0000","last_became_peered":"2024-06-04T16:07:09.512996+0000","last_unstale":"2024-06-04T16:19:40.017634+0000","last_undegraded":"2024-06-04T16:19:40.017634+0000","last_fullsized":"2024-06-04T16:19:40.017634+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":243,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:07:08.374534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:07:08.374534+0000","last_clean_scrub_stamp":"2024-06-04T16:07:08.374534+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T18:42:34.541675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":113,"num_read_kb":81,"num_write":51,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1","version":"0'0","reported_seq":15,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:20:20.023189+0000","last_change":"2024-06-04T16:16:08.660525+0000","last_active":"2024-06-04T16:20:20.023189+0000","last_peered":"2024-06-04T16:20:20.023189+0000","last_clean":"2024-06-04T16:20:20.023189+0000","last_became_active":"2024-06-04T16:16:08.660177+0000","last_became_peered":"2024-06-04T16:16:08.660177+0000","last_unstale":"2024-06-04T16:20:20.023189+0000","last_undegraded":"2024-06-04T16:20:20.023189+0000","last_fullsized":"2024-06-04T16:20:20.023189+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_clean_scrub_stamp":"2024-06-04T16:16:07.631263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T19:57:47.986547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.0","version":"254'2","reported_seq":27,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:21:30.022446+0000","last_change":"2024-06-04T16:09:26.626867+0000","last_active":"2024-06-04T16:21:30.022446+0000","last_peered":"2024-06-04T16:21:30.022446+0000","last_clean":"2024-06-04T16:21:30.022446+0000","last_became_active":"2024-06-04T16:09:26.626576+0000","last_became_peered":"2024-06-04T16:09:26.626576+0000","last_unstale":"2024-06-04T16:21:30.022446+0000","last_undegraded":"2024-06-04T16:21:30.022446+0000","last_fullsized":"2024-06-04T16:21:30.022446+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_clean_scrub_stamp":"2024-06-04T16:09:25.601105+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T03:40:55.878734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.3","version":"254'2","reported_seq":33,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:21:55.025453+0000","last_change":"2024-06-04T16:09:23.604809+0000","last_active":"2024-06-04T16:21:55.025453+0000","last_peered":"2024-06-04T16:21:55.025453+0000","last_clean":"2024-06-04T16:21:55.025453+0000","last_became_active":"2024-06-04T16:09:23.604413+0000","last_became_peered":"2024-06-04T16:09:23.604413+0000","last_unstale":"2024-06-04T16:21:55.025453+0000","last_undegraded":"2024-06-04T16:21:55.025453+0000","last_fullsized":"2024-06-04T16:21:55.025453+0000","mapping_epoch":246,"log_start":"0'0","ondisk_log_start":"0'0","created":246,"last_epoch_clean":247,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_clean_scrub_stamp":"2024-06-04T16:09:22.572686+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T19:25:08.922699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"64.2","version":"254'2","reported_seq":43,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:40.009587+0000","last_change":"2024-06-04T16:07:09.402095+0000","last_active":"2024-06-04T16:19:40.009587+0000","last_peered":"2024-06-04T16:19:40.009587+0000","last_clean":"2024-06-04T16:19:40.009587+0000","last_became_active":"2024-06-04T16:07:09.401796+0000","last_became_peered":"2024-06-04T16:07:09.401796+0000","last_unstale":"2024-06-04T16:19:40.009587+0000","last_undegraded":"2024-06-04T16:19:40.009587+0000","last_fullsized":"2024-06-04T16:19:40.009587+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":243,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:07:08.374534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:07:08.374534+0000","last_clean_scrub_stamp":"2024-06-04T16:07:08.374534+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T02:34:43.812974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":7,"num_write":11,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.2","version":"0'0","reported_seq":15,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:20:20.014209+0000","last_change":"2024-06-04T16:16:08.656504+0000","last_active":"2024-06-04T16:20:20.014209+0000","last_peered":"2024-06-04T16:20:20.014209+0000","last_clean":"2024-06-04T16:20:20.014209+0000","last_became_active":"2024-06-04T16:16:08.656245+0000","last_became_peered":"2024-06-04T16:16:08.656245+0000","last_unstale":"2024-06-04T16:20:20.014209+0000","last_undegraded":"2024-06-04T16:20:20.014209+0000","last_fullsized":"2024-06-04T16:20:20.014209+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_clean_scrub_stamp":"2024-06-04T16:16:07.631263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T22:30:53.169701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.3","version":"254'4","reported_seq":31,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:00.134720+0000","last_change":"2024-06-04T16:09:26.627525+0000","last_active":"2024-06-04T16:22:00.134720+0000","last_peered":"2024-06-04T16:22:00.134720+0000","last_clean":"2024-06-04T16:22:00.134720+0000","last_became_active":"2024-06-04T16:09:26.627193+0000","last_became_peered":"2024-06-04T16:09:26.627193+0000","last_unstale":"2024-06-04T16:22:00.134720+0000","last_undegraded":"2024-06-04T16:22:00.134720+0000","last_fullsized":"2024-06-04T16:22:00.134720+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_clean_scrub_stamp":"2024-06-04T16:09:25.601105+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T04:04:57.004292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":6144,"num_write":4,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.0","version":"254'2","reported_seq":33,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:21:25.021773+0000","last_change":"2024-06-04T16:09:23.606568+0000","last_active":"2024-06-04T16:21:25.021773+0000","last_peered":"2024-06-04T16:21:25.021773+0000","last_clean":"2024-06-04T16:21:25.021773+0000","last_became_active":"2024-06-04T16:09:23.605145+0000","last_became_peered":"2024-06-04T16:09:23.605145+0000","last_unstale":"2024-06-04T16:21:25.021773+0000","last_undegraded":"2024-06-04T16:21:25.021773+0000","last_fullsized":"2024-06-04T16:21:25.021773+0000","mapping_epoch":246,"log_start":"0'0","ondisk_log_start":"0'0","created":246,"last_epoch_clean":247,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_clean_scrub_stamp":"2024-06-04T16:09:22.572686+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T16:32:02.394319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"64.1","version":"245'23","reported_seq":103,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:40.120328+0000","last_change":"2024-06-04T16:07:09.405357+0000","last_active":"2024-06-04T16:19:40.120328+0000","last_peered":"2024-06-04T16:19:40.120328+0000","last_clean":"2024-06-04T16:19:40.120328+0000","last_became_active":"2024-06-04T16:07:09.405086+0000","last_became_peered":"2024-06-04T16:07:09.405086+0000","last_unstale":"2024-06-04T16:19:40.120328+0000","last_undegraded":"2024-06-04T16:19:40.120328+0000","last_fullsized":"2024-06-04T16:19:40.120328+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":243,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:07:08.374534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:07:08.374534+0000","last_clean_scrub_stamp":"2024-06-04T16:07:08.374534+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T20:08:13.021269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":130,"num_read_kb":96,"num_write":31,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.3","version":"0'0","reported_seq":15,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:20:20.014237+0000","last_change":"2024-06-04T16:16:08.661478+0000","last_active":"2024-06-04T16:20:20.014237+0000","last_peered":"2024-06-04T16:20:20.014237+0000","last_clean":"2024-06-04T16:20:20.014237+0000","last_became_active":"2024-06-04T16:16:08.661111+0000","last_became_peered":"2024-06-04T16:16:08.661111+0000","last_unstale":"2024-06-04T16:20:20.014237+0000","last_undegraded":"2024-06-04T16:20:20.014237+0000","last_fullsized":"2024-06-04T16:20:20.014237+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_clean_scrub_stamp":"2024-06-04T16:16:07.631263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T01:29:29.432723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.2","version":"254'2","reported_seq":28,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:00.037198+0000","last_change":"2024-06-04T16:09:26.625154+0000","last_active":"2024-06-04T16:22:00.037198+0000","last_peered":"2024-06-04T16:22:00.037198+0000","last_clean":"2024-06-04T16:22:00.037198+0000","last_became_active":"2024-06-04T16:09:26.624890+0000","last_became_peered":"2024-06-04T16:09:26.624890+0000","last_unstale":"2024-06-04T16:22:00.037198+0000","last_undegraded":"2024-06-04T16:22:00.037198+0000","last_fullsized":"2024-06-04T16:22:00.037198+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_clean_scrub_stamp":"2024-06-04T16:09:25.601105+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T20:52:50.931929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8192,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.1","version":"251'10","reported_seq":52,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:50.015591+0000","last_change":"2024-06-04T16:09:23.609351+0000","last_active":"2024-06-04T16:19:50.015591+0000","last_peered":"2024-06-04T16:19:50.015591+0000","last_clean":"2024-06-04T16:19:50.015591+0000","last_became_active":"2024-06-04T16:09:23.609072+0000","last_became_peered":"2024-06-04T16:09:23.609072+0000","last_unstale":"2024-06-04T16:19:50.015591+0000","last_undegraded":"2024-06-04T16:19:50.015591+0000","last_fullsized":"2024-06-04T16:19:50.015591+0000","mapping_epoch":246,"log_start":"0'0","ondisk_log_start":"0'0","created":246,"last_epoch_clean":247,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_clean_scrub_stamp":"2024-06-04T16:09:22.572686+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T01:04:48.825987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":15362,"num_write":9,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"64.0","version":"254'11","reported_seq":67,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:10.125764+0000","last_change":"2024-06-04T16:07:09.405417+0000","last_active":"2024-06-04T16:19:10.125764+0000","last_peered":"2024-06-04T16:19:10.125764+0000","last_clean":"2024-06-04T16:19:10.125764+0000","last_became_active":"2024-06-04T16:07:09.405109+0000","last_became_peered":"2024-06-04T16:07:09.405109+0000","last_unstale":"2024-06-04T16:19:10.125764+0000","last_undegraded":"2024-06-04T16:19:10.125764+0000","last_fullsized":"2024-06-04T16:19:10.125764+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":243,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:07:08.374534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:07:08.374534+0000","last_clean_scrub_stamp":"2024-06-04T16:07:08.374534+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T02:10:45.525441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":37,"num_write":22,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"251'58","reported_seq":567,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:45.010179+0000","last_change":"2024-06-04T15:52:36.496655+0000","last_active":"2024-06-04T16:19:45.010179+0000","last_peered":"2024-06-04T16:19:45.010179+0000","last_clean":"2024-06-04T16:19:45.010179+0000","last_became_active":"2024-06-04T15:52:36.496345+0000","last_became_peered":"2024-06-04T15:52:36.496345+0000","last_unstale":"2024-06-04T16:19:45.010179+0000","last_undegraded":"2024-06-04T16:19:45.010179+0000","last_fullsized":"2024-06-04T16:19:45.010179+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T19:41:39.532361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":73,"num_read_kb":10950,"num_write":187,"num_write_kb":28882,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"254'155","reported_seq":886,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:20:10.123359+0000","last_change":"2024-06-04T15:52:38.485748+0000","last_active":"2024-06-04T16:20:10.123359+0000","last_peered":"2024-06-04T16:20:10.123359+0000","last_clean":"2024-06-04T16:20:10.123359+0000","last_became_active":"2024-06-04T15:52:38.485491+0000","last_became_peered":"2024-06-04T15:52:38.485491+0000","last_unstale":"2024-06-04T16:20:10.123359+0000","last_undegraded":"2024-06-04T16:20:10.123359+0000","last_fullsized":"2024-06-04T16:20:10.123359+0000","mapping_epoch":23,"log_start":"251'100","ondisk_log_start":"251'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":100,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T03:05:20.005510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":710,"num_read_kb":632,"num_write":201,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"251'45","reported_seq":565,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:45.018501+0000","last_change":"2024-06-04T15:52:36.484644+0000","last_active":"2024-06-04T16:19:45.018501+0000","last_peered":"2024-06-04T16:19:45.018501+0000","last_clean":"2024-06-04T16:19:45.018501+0000","last_became_active":"2024-06-04T15:52:36.484223+0000","last_became_peered":"2024-06-04T15:52:36.484223+0000","last_unstale":"2024-06-04T16:19:45.018501+0000","last_undegraded":"2024-06-04T16:19:45.018501+0000","last_fullsized":"2024-06-04T16:19:45.018501+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T03:34:20.970333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1311028,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":90,"num_read_kb":9967,"num_write":210,"num_write_kb":17365,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,0],"acting":[5,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.39","version":"254'108","reported_seq":857,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:20:10.017813+0000","last_change":"2024-06-04T15:52:38.482297+0000","last_active":"2024-06-04T16:20:10.017813+0000","last_peered":"2024-06-04T16:20:10.017813+0000","last_clean":"2024-06-04T16:20:10.017813+0000","last_became_active":"2024-06-04T15:52:38.482000+0000","last_became_peered":"2024-06-04T15:52:38.482000+0000","last_unstale":"2024-06-04T16:20:10.017813+0000","last_undegraded":"2024-06-04T16:20:10.017813+0000","last_fullsized":"2024-06-04T16:20:10.017813+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T19:21:51.740016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":584,"num_read_kb":552,"num_write":123,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"254'42","reported_seq":538,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:45.018486+0000","last_change":"2024-06-04T15:52:36.480336+0000","last_active":"2024-06-04T16:19:45.018486+0000","last_peered":"2024-06-04T16:19:45.018486+0000","last_clean":"2024-06-04T16:19:45.018486+0000","last_became_active":"2024-06-04T15:52:36.479881+0000","last_became_peered":"2024-06-04T15:52:36.479881+0000","last_unstale":"2024-06-04T16:19:45.018486+0000","last_undegraded":"2024-06-04T16:19:45.018486+0000","last_fullsized":"2024-06-04T16:19:45.018486+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T22:45:30.429987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":40,"num_read_kb":31,"num_write":168,"num_write_kb":16512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3a","version":"254'106","reported_seq":816,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:20:10.017838+0000","last_change":"2024-06-04T15:52:38.483661+0000","last_active":"2024-06-04T16:20:10.017838+0000","last_peered":"2024-06-04T16:20:10.017838+0000","last_clean":"2024-06-04T16:20:10.017838+0000","last_became_active":"2024-06-04T15:52:38.483240+0000","last_became_peered":"2024-06-04T15:52:38.483240+0000","last_unstale":"2024-06-04T16:20:10.017838+0000","last_undegraded":"2024-06-04T16:20:10.017838+0000","last_fullsized":"2024-06-04T16:20:10.017838+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T19:59:20.609915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":515,"num_read_kb":482,"num_write":131,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"254'78","reported_seq":580,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:45.004714+0000","last_change":"2024-06-04T15:52:36.478336+0000","last_active":"2024-06-04T16:18:45.004714+0000","last_peered":"2024-06-04T16:18:45.004714+0000","last_clean":"2024-06-04T16:18:45.004714+0000","last_became_active":"2024-06-04T15:52:36.476981+0000","last_became_peered":"2024-06-04T15:52:36.476981+0000","last_unstale":"2024-06-04T16:18:45.004714+0000","last_undegraded":"2024-06-04T16:18:45.004714+0000","last_fullsized":"2024-06-04T16:18:45.004714+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T03:49:16.011063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":3145,"num_write":255,"num_write_kb":33835,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"254'148","reported_seq":1035,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:20:10.021715+0000","last_change":"2024-06-04T15:52:38.481259+0000","last_active":"2024-06-04T16:20:10.021715+0000","last_peered":"2024-06-04T16:20:10.021715+0000","last_clean":"2024-06-04T16:20:10.021715+0000","last_became_active":"2024-06-04T15:52:38.480986+0000","last_became_peered":"2024-06-04T15:52:38.480986+0000","last_unstale":"2024-06-04T16:20:10.021715+0000","last_undegraded":"2024-06-04T16:20:10.021715+0000","last_fullsized":"2024-06-04T16:20:10.021715+0000","mapping_epoch":23,"log_start":"251'100","ondisk_log_start":"251'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":100,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T20:30:59.524702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1072,"num_read_kb":1014,"num_write":195,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"251'46","reported_seq":556,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:20:10.012639+0000","last_change":"2024-06-04T15:52:36.495855+0000","last_active":"2024-06-04T16:20:10.012639+0000","last_peered":"2024-06-04T16:20:10.012639+0000","last_clean":"2024-06-04T16:20:10.012639+0000","last_became_active":"2024-06-04T15:52:36.495401+0000","last_became_peered":"2024-06-04T15:52:36.495401+0000","last_unstale":"2024-06-04T16:20:10.012639+0000","last_undegraded":"2024-06-04T16:20:10.012639+0000","last_fullsized":"2024-06-04T16:20:10.012639+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T01:05:31.416932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":89,"num_read_kb":6218,"num_write":199,"num_write_kb":11815,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"254'157","reported_seq":1084,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:45.004252+0000","last_change":"2024-06-04T15:52:38.485154+0000","last_active":"2024-06-04T16:18:45.004252+0000","last_peered":"2024-06-04T16:18:45.004252+0000","last_clean":"2024-06-04T16:18:45.004252+0000","last_became_active":"2024-06-04T15:52:38.484828+0000","last_became_peered":"2024-06-04T15:52:38.484828+0000","last_unstale":"2024-06-04T16:18:45.004252+0000","last_undegraded":"2024-06-04T16:18:45.004252+0000","last_fullsized":"2024-06-04T16:18:45.004252+0000","mapping_epoch":23,"log_start":"251'100","ondisk_log_start":"251'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":100,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T01:49:03.366763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1071,"num_read_kb":1008,"num_write":198,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"254'61","reported_seq":570,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:39.489151+0000","last_change":"2024-06-04T15:52:36.478124+0000","last_active":"2024-06-04T16:22:39.489151+0000","last_peered":"2024-06-04T16:22:39.489151+0000","last_clean":"2024-06-04T16:22:39.489151+0000","last_became_active":"2024-06-04T15:52:36.476167+0000","last_became_peered":"2024-06-04T15:52:36.476167+0000","last_unstale":"2024-06-04T16:22:39.489151+0000","last_undegraded":"2024-06-04T16:22:39.489151+0000","last_fullsized":"2024-06-04T16:22:39.489151+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T02:56:27.227183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":87,"num_read_kb":1095,"num_write":236,"num_write_kb":40818,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,7],"acting":[2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"254'99","reported_seq":811,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:45.010161+0000","last_change":"2024-06-04T15:52:38.483365+0000","last_active":"2024-06-04T16:19:45.010161+0000","last_peered":"2024-06-04T16:19:45.010161+0000","last_clean":"2024-06-04T16:19:45.010161+0000","last_became_active":"2024-06-04T15:52:38.482025+0000","last_became_peered":"2024-06-04T15:52:38.482025+0000","last_unstale":"2024-06-04T16:19:45.010161+0000","last_undegraded":"2024-06-04T16:19:45.010161+0000","last_fullsized":"2024-06-04T16:19:45.010161+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T01:15:41.149861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":511,"num_read_kb":478,"num_write":121,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.39","version":"251'54","reported_seq":549,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:20:10.012598+0000","last_change":"2024-06-04T15:52:36.493350+0000","last_active":"2024-06-04T16:20:10.012598+0000","last_peered":"2024-06-04T16:20:10.012598+0000","last_clean":"2024-06-04T16:20:10.012598+0000","last_became_active":"2024-06-04T15:52:36.493029+0000","last_became_peered":"2024-06-04T15:52:36.493029+0000","last_unstale":"2024-06-04T16:20:10.012598+0000","last_undegraded":"2024-06-04T16:20:10.012598+0000","last_fullsized":"2024-06-04T16:20:10.012598+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T23:35:25.665201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194343,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":48,"num_read_kb":7228,"num_write":201,"num_write_kb":32271,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,1],"acting":[0,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"254'135","reported_seq":1097,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:45.010727+0000","last_change":"2024-06-04T15:52:38.481762+0000","last_active":"2024-06-04T16:19:45.010727+0000","last_peered":"2024-06-04T16:19:45.010727+0000","last_clean":"2024-06-04T16:19:45.010727+0000","last_became_active":"2024-06-04T15:52:38.481269+0000","last_became_peered":"2024-06-04T15:52:38.481269+0000","last_unstale":"2024-06-04T16:19:45.010727+0000","last_undegraded":"2024-06-04T16:19:45.010727+0000","last_fullsized":"2024-06-04T16:19:45.010727+0000","mapping_epoch":23,"log_start":"251'100","ondisk_log_start":"251'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":100,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T19:02:25.732077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":974,"num_read_kb":946,"num_write":155,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"254'71","reported_seq":658,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:20:10.021986+0000","last_change":"2024-06-04T15:52:36.494149+0000","last_active":"2024-06-04T16:20:10.021986+0000","last_peered":"2024-06-04T16:20:10.021986+0000","last_clean":"2024-06-04T16:20:10.021986+0000","last_became_active":"2024-06-04T15:52:36.493867+0000","last_became_peered":"2024-06-04T15:52:36.493867+0000","last_unstale":"2024-06-04T16:20:10.021986+0000","last_undegraded":"2024-06-04T16:20:10.021986+0000","last_fullsized":"2024-06-04T16:20:10.021986+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T01:19:36.101046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194320,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":320,"num_read_kb":135435,"num_write":258,"num_write_kb":39309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3],"acting":[5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3f","version":"254'142","reported_seq":980,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:45.018547+0000","last_change":"2024-06-04T15:52:38.487423+0000","last_active":"2024-06-04T16:19:45.018547+0000","last_peered":"2024-06-04T16:19:45.018547+0000","last_clean":"2024-06-04T16:19:45.018547+0000","last_became_active":"2024-06-04T15:52:38.486625+0000","last_became_peered":"2024-06-04T15:52:38.486625+0000","last_unstale":"2024-06-04T16:19:45.018547+0000","last_undegraded":"2024-06-04T16:19:45.018547+0000","last_fullsized":"2024-06-04T16:19:45.018547+0000","mapping_epoch":23,"log_start":"251'100","ondisk_log_start":"251'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T20:53:48.231763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":899,"num_read_kb":839,"num_write":184,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.30","version":"254'110","reported_seq":836,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:21.348186+0000","last_change":"2024-06-04T15:52:38.479433+0000","last_active":"2024-06-04T16:18:21.348186+0000","last_peered":"2024-06-04T16:18:21.348186+0000","last_clean":"2024-06-04T16:18:21.348186+0000","last_became_active":"2024-06-04T15:52:38.479148+0000","last_became_peered":"2024-06-04T15:52:38.479148+0000","last_unstale":"2024-06-04T16:18:21.348186+0000","last_undegraded":"2024-06-04T16:18:21.348186+0000","last_fullsized":"2024-06-04T16:18:21.348186+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T00:01:16.709017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":546,"num_read_kb":515,"num_write":127,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"251'65","reported_seq":589,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:15.117942+0000","last_change":"2024-06-04T15:52:36.493388+0000","last_active":"2024-06-04T16:19:15.117942+0000","last_peered":"2024-06-04T16:19:15.117942+0000","last_clean":"2024-06-04T16:19:15.117942+0000","last_became_active":"2024-06-04T15:52:36.493062+0000","last_became_peered":"2024-06-04T15:52:36.493062+0000","last_unstale":"2024-06-04T16:19:15.117942+0000","last_undegraded":"2024-06-04T16:19:15.117942+0000","last_fullsized":"2024-06-04T16:19:15.117942+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T00:24:36.348212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194345,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":95,"num_read_kb":64250,"num_write":262,"num_write_kb":45332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,5],"acting":[1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"254'69","reported_seq":736,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:22.735079+0000","last_change":"2024-06-04T15:52:38.486683+0000","last_active":"2024-06-04T16:18:22.735079+0000","last_peered":"2024-06-04T16:18:22.735079+0000","last_clean":"2024-06-04T16:18:22.735079+0000","last_became_active":"2024-06-04T15:52:38.486413+0000","last_became_peered":"2024-06-04T15:52:38.486413+0000","last_unstale":"2024-06-04T16:18:22.735079+0000","last_undegraded":"2024-06-04T16:18:22.735079+0000","last_fullsized":"2024-06-04T16:18:22.735079+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T18:14:24.428815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":395,"num_read_kb":379,"num_write":76,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"251'60","reported_seq":570,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:15.007208+0000","last_change":"2024-06-04T15:52:36.494165+0000","last_active":"2024-06-04T16:19:15.007208+0000","last_peered":"2024-06-04T16:19:15.007208+0000","last_clean":"2024-06-04T16:19:15.007208+0000","last_became_active":"2024-06-04T15:52:36.493235+0000","last_became_peered":"2024-06-04T15:52:36.493235+0000","last_unstale":"2024-06-04T16:19:15.007208+0000","last_undegraded":"2024-06-04T16:19:15.007208+0000","last_fullsized":"2024-06-04T16:19:15.007208+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T19:10:07.674104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5327983,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":73,"num_read_kb":3706,"num_write":207,"num_write_kb":43313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"254'95","reported_seq":809,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:20.111811+0000","last_change":"2024-06-04T15:52:38.482371+0000","last_active":"2024-06-04T16:18:20.111811+0000","last_peered":"2024-06-04T16:18:20.111811+0000","last_clean":"2024-06-04T16:18:20.111811+0000","last_became_active":"2024-06-04T15:52:38.482120+0000","last_became_peered":"2024-06-04T15:52:38.482120+0000","last_unstale":"2024-06-04T16:18:20.111811+0000","last_undegraded":"2024-06-04T16:18:20.111811+0000","last_fullsized":"2024-06-04T16:18:20.111811+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T22:42:27.529034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":518,"num_read_kb":488,"num_write":107,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"251'41","reported_seq":556,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:15.007194+0000","last_change":"2024-06-04T15:53:14.839799+0000","last_active":"2024-06-04T16:19:15.007194+0000","last_peered":"2024-06-04T16:19:15.007194+0000","last_clean":"2024-06-04T16:19:15.007194+0000","last_became_active":"2024-06-04T15:53:14.839433+0000","last_became_peered":"2024-06-04T15:53:14.839433+0000","last_unstale":"2024-06-04T16:19:15.007194+0000","last_undegraded":"2024-06-04T16:19:15.007194+0000","last_fullsized":"2024-06-04T16:19:15.007194+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T18:08:08.559997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3420297,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":73,"num_read_kb":2132,"num_write":160,"num_write_kb":20015,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"254'143","reported_seq":931,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:15.013248+0000","last_change":"2024-06-04T15:52:38.482165+0000","last_active":"2024-06-04T16:19:15.013248+0000","last_peered":"2024-06-04T16:19:15.013248+0000","last_clean":"2024-06-04T16:19:15.013248+0000","last_became_active":"2024-06-04T15:52:38.480996+0000","last_became_peered":"2024-06-04T15:52:38.480996+0000","last_unstale":"2024-06-04T16:19:15.013248+0000","last_undegraded":"2024-06-04T16:19:15.013248+0000","last_fullsized":"2024-06-04T16:19:15.013248+0000","mapping_epoch":23,"log_start":"251'100","ondisk_log_start":"251'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":100,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T21:42:09.132143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":760,"num_read_kb":703,"num_write":184,"num_write_kb":47,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"251'68","reported_seq":578,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:15.007156+0000","last_change":"2024-06-04T15:52:36.488619+0000","last_active":"2024-06-04T16:19:15.007156+0000","last_peered":"2024-06-04T16:19:15.007156+0000","last_clean":"2024-06-04T16:19:15.007156+0000","last_became_active":"2024-06-04T15:52:36.486264+0000","last_became_peered":"2024-06-04T15:52:36.486264+0000","last_unstale":"2024-06-04T16:19:15.007156+0000","last_undegraded":"2024-06-04T16:19:15.007156+0000","last_fullsized":"2024-06-04T16:19:15.007156+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T23:40:03.292201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5328001,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":104,"num_read_kb":2209,"num_write":245,"num_write_kb":31585,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,7],"acting":[0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"254'109","reported_seq":990,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:15.014440+0000","last_change":"2024-06-04T15:52:38.488655+0000","last_active":"2024-06-04T16:19:15.014440+0000","last_peered":"2024-06-04T16:19:15.014440+0000","last_clean":"2024-06-04T16:19:15.014440+0000","last_became_active":"2024-06-04T15:52:38.488389+0000","last_became_peered":"2024-06-04T15:52:38.488389+0000","last_unstale":"2024-06-04T16:19:15.014440+0000","last_undegraded":"2024-06-04T16:19:15.014440+0000","last_fullsized":"2024-06-04T16:19:15.014440+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T00:42:51.636081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":949,"num_read_kb":919,"num_write":126,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.33","version":"254'50","reported_seq":551,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:21:40.034480+0000","last_change":"2024-06-04T15:52:36.498842+0000","last_active":"2024-06-04T16:21:40.034480+0000","last_peered":"2024-06-04T16:21:40.034480+0000","last_clean":"2024-06-04T16:21:40.034480+0000","last_became_active":"2024-06-04T15:52:36.498488+0000","last_became_peered":"2024-06-04T15:52:36.498488+0000","last_unstale":"2024-06-04T16:21:40.034480+0000","last_undegraded":"2024-06-04T16:21:40.034480+0000","last_fullsized":"2024-06-04T16:21:40.034480+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T21:29:00.145911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6461610,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":71,"num_read_kb":20343,"num_write":207,"num_write_kb":26780,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,4],"acting":[6,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.35","version":"254'139","reported_seq":926,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:15.117908+0000","last_change":"2024-06-04T15:52:38.486364+0000","last_active":"2024-06-04T16:19:15.117908+0000","last_peered":"2024-06-04T16:19:15.117908+0000","last_clean":"2024-06-04T16:19:15.117908+0000","last_became_active":"2024-06-04T15:52:38.486108+0000","last_became_peered":"2024-06-04T15:52:38.486108+0000","last_unstale":"2024-06-04T16:19:15.117908+0000","last_undegraded":"2024-06-04T16:19:15.117908+0000","last_fullsized":"2024-06-04T16:19:15.117908+0000","mapping_epoch":23,"log_start":"251'100","ondisk_log_start":"251'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":100,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T03:22:09.822966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":692,"num_read_kb":648,"num_write":164,"num_write_kb":35,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"254'36","reported_seq":526,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:20:45.026835+0000","last_change":"2024-06-04T15:52:36.481363+0000","last_active":"2024-06-04T16:20:45.026835+0000","last_peered":"2024-06-04T16:20:45.026835+0000","last_clean":"2024-06-04T16:20:45.026835+0000","last_became_active":"2024-06-04T15:52:36.481047+0000","last_became_peered":"2024-06-04T15:52:36.481047+0000","last_unstale":"2024-06-04T16:20:45.026835+0000","last_undegraded":"2024-06-04T16:20:45.026835+0000","last_fullsized":"2024-06-04T16:20:45.026835+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T21:52:41.102618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":42,"num_read_kb":41,"num_write":149,"num_write_kb":21263,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4],"acting":[6,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.18","version":"254'36","reported_seq":518,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:25.008099+0000","last_change":"2024-06-04T15:52:46.537761+0000","last_active":"2024-06-04T16:19:25.008099+0000","last_peered":"2024-06-04T16:19:25.008099+0000","last_clean":"2024-06-04T16:19:25.008099+0000","last_became_active":"2024-06-04T15:52:46.536608+0000","last_became_peered":"2024-06-04T15:52:46.536608+0000","last_unstale":"2024-06-04T16:19:25.008099+0000","last_undegraded":"2024-06-04T16:19:25.008099+0000","last_fullsized":"2024-06-04T16:19:25.008099+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:45.513877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:45.513877+0000","last_clean_scrub_stamp":"2024-06-04T15:52:45.513877+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T02:19:23.902475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":81,"num_read_kb":72,"num_write":87,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"254'110","reported_seq":831,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:25.006864+0000","last_change":"2024-06-04T15:52:38.477338+0000","last_active":"2024-06-04T16:18:25.006864+0000","last_peered":"2024-06-04T16:18:25.006864+0000","last_clean":"2024-06-04T16:18:25.006864+0000","last_became_active":"2024-06-04T15:52:38.477052+0000","last_became_peered":"2024-06-04T15:52:38.477052+0000","last_unstale":"2024-06-04T16:18:25.006864+0000","last_undegraded":"2024-06-04T16:18:25.006864+0000","last_fullsized":"2024-06-04T16:18:25.006864+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T20:39:40.247365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":560,"num_read_kb":523,"num_write":129,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.13","version":"254'52","reported_seq":553,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:21.323198+0000","last_change":"2024-06-04T15:52:36.499588+0000","last_active":"2024-06-04T16:18:21.323198+0000","last_peered":"2024-06-04T16:18:21.323198+0000","last_clean":"2024-06-04T16:18:21.323198+0000","last_became_active":"2024-06-04T15:52:36.499305+0000","last_became_peered":"2024-06-04T15:52:36.499305+0000","last_unstale":"2024-06-04T16:18:21.323198+0000","last_undegraded":"2024-06-04T16:18:21.323198+0000","last_fullsized":"2024-06-04T16:18:21.323198+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T20:07:01.696465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194320,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":75,"num_read_kb":3024,"num_write":196,"num_write_kb":28071,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":473,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:15.011753+0000","last_change":"2024-06-04T15:52:40.477030+0000","last_active":"2024-06-04T16:19:15.011753+0000","last_peered":"2024-06-04T16:19:15.011753+0000","last_clean":"2024-06-04T16:19:15.011753+0000","last_became_active":"2024-06-04T15:52:40.476730+0000","last_became_peered":"2024-06-04T15:52:40.476730+0000","last_unstale":"2024-06-04T16:19:15.011753+0000","last_undegraded":"2024-06-04T16:19:15.011753+0000","last_fullsized":"2024-06-04T16:19:15.011753+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_clean_scrub_stamp":"2024-06-04T15:52:39.463103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T00:40:38.064778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"254'144","reported_seq":715,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:39.510104+0000","last_change":"2024-06-04T15:52:42.504168+0000","last_active":"2024-06-04T16:22:39.510104+0000","last_peered":"2024-06-04T16:22:39.510104+0000","last_clean":"2024-06-04T16:22:39.510104+0000","last_became_active":"2024-06-04T15:52:42.503184+0000","last_became_peered":"2024-06-04T15:52:42.503184+0000","last_unstale":"2024-06-04T16:22:39.510104+0000","last_undegraded":"2024-06-04T16:22:39.510104+0000","last_fullsized":"2024-06-04T16:22:39.510104+0000","mapping_epoch":27,"log_start":"251'100","ondisk_log_start":"251'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_clean_scrub_stamp":"2024-06-04T15:52:41.476734+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T01:21:16.208347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":210,"num_read_kb":210,"num_write":112,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":468,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:20.118447+0000","last_change":"2024-06-04T15:52:44.513719+0000","last_active":"2024-06-04T16:19:20.118447+0000","last_peered":"2024-06-04T16:19:20.118447+0000","last_clean":"2024-06-04T16:19:20.118447+0000","last_became_active":"2024-06-04T15:52:44.513442+0000","last_became_peered":"2024-06-04T15:52:44.513442+0000","last_unstale":"2024-06-04T16:19:20.118447+0000","last_undegraded":"2024-06-04T16:19:20.118447+0000","last_fullsized":"2024-06-04T16:19:20.118447+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_clean_scrub_stamp":"2024-06-04T15:52:43.492872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T02:42:56.959694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"254'145","reported_seq":705,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:21:50.133713+0000","last_change":"2024-06-04T15:52:46.540252+0000","last_active":"2024-06-04T16:21:50.133713+0000","last_peered":"2024-06-04T16:21:50.133713+0000","last_clean":"2024-06-04T16:21:50.133713+0000","last_became_active":"2024-06-04T15:52:46.539957+0000","last_became_peered":"2024-06-04T15:52:46.539957+0000","last_unstale":"2024-06-04T16:21:50.133713+0000","last_undegraded":"2024-06-04T16:21:50.133713+0000","last_fullsized":"2024-06-04T16:21:50.133713+0000","mapping_epoch":31,"log_start":"254'100","ondisk_log_start":"254'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:45.513877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:45.513877+0000","last_clean_scrub_stamp":"2024-06-04T15:52:45.513877+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":100,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T02:03:12.091974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":399,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":346,"num_read_kb":345,"num_write":304,"num_write_kb":102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"254'154","reported_seq":837,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:15.011739+0000","last_change":"2024-06-04T15:52:38.483869+0000","last_active":"2024-06-04T16:19:15.011739+0000","last_peered":"2024-06-04T16:19:15.011739+0000","last_clean":"2024-06-04T16:19:15.011739+0000","last_became_active":"2024-06-04T15:52:38.483516+0000","last_became_peered":"2024-06-04T15:52:38.483516+0000","last_unstale":"2024-06-04T16:19:15.011739+0000","last_undegraded":"2024-06-04T16:19:15.011739+0000","last_fullsized":"2024-06-04T16:19:15.011739+0000","mapping_epoch":23,"log_start":"251'100","ondisk_log_start":"251'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":100,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T00:51:21.910421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":841,"num_read_kb":740,"num_write":235,"num_write_kb":95,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"254'66","reported_seq":578,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:22.713104+0000","last_change":"2024-06-04T15:52:36.481412+0000","last_active":"2024-06-04T16:18:22.713104+0000","last_peered":"2024-06-04T16:18:22.713104+0000","last_clean":"2024-06-04T16:18:22.713104+0000","last_became_active":"2024-06-04T15:52:36.481099+0000","last_became_peered":"2024-06-04T15:52:36.481099+0000","last_unstale":"2024-06-04T16:18:22.713104+0000","last_undegraded":"2024-06-04T16:18:22.713104+0000","last_fullsized":"2024-06-04T16:18:22.713104+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T21:45:28.619709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133687,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":119,"num_read_kb":2903,"num_write":273,"num_write_kb":32792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,7],"acting":[6,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":474,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:25.007271+0000","last_change":"2024-06-04T15:52:40.479746+0000","last_active":"2024-06-04T16:18:25.007271+0000","last_peered":"2024-06-04T16:18:25.007271+0000","last_clean":"2024-06-04T16:18:25.007271+0000","last_became_active":"2024-06-04T15:52:40.479483+0000","last_became_peered":"2024-06-04T15:52:40.479483+0000","last_unstale":"2024-06-04T16:18:25.007271+0000","last_undegraded":"2024-06-04T16:18:25.007271+0000","last_fullsized":"2024-06-04T16:18:25.007271+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_clean_scrub_stamp":"2024-06-04T15:52:39.463103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T23:55:25.989646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"254'51","reported_seq":547,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:20.118437+0000","last_change":"2024-06-04T15:52:42.503739+0000","last_active":"2024-06-04T16:19:20.118437+0000","last_peered":"2024-06-04T16:19:20.118437+0000","last_clean":"2024-06-04T16:19:20.118437+0000","last_became_active":"2024-06-04T15:52:42.503451+0000","last_became_peered":"2024-06-04T15:52:42.503451+0000","last_unstale":"2024-06-04T16:19:20.118437+0000","last_undegraded":"2024-06-04T16:19:20.118437+0000","last_fullsized":"2024-06-04T16:19:20.118437+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_clean_scrub_stamp":"2024-06-04T15:52:41.476734+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T02:51:35.526591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":72,"num_read_kb":67,"num_write":48,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":468,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:20.118406+0000","last_change":"2024-06-04T15:52:44.518997+0000","last_active":"2024-06-04T16:19:20.118406+0000","last_peered":"2024-06-04T16:19:20.118406+0000","last_clean":"2024-06-04T16:19:20.118406+0000","last_became_active":"2024-06-04T15:52:44.517614+0000","last_became_peered":"2024-06-04T15:52:44.517614+0000","last_unstale":"2024-06-04T16:19:20.118406+0000","last_undegraded":"2024-06-04T16:19:20.118406+0000","last_fullsized":"2024-06-04T16:19:20.118406+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_clean_scrub_stamp":"2024-06-04T15:52:43.492872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T00:18:35.417836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"254'22","reported_seq":496,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:15.940519+0000","last_change":"2024-06-04T15:52:46.535843+0000","last_active":"2024-06-04T16:18:15.940519+0000","last_peered":"2024-06-04T16:18:15.940519+0000","last_clean":"2024-06-04T16:18:15.940519+0000","last_became_active":"2024-06-04T15:52:46.535498+0000","last_became_peered":"2024-06-04T15:52:46.535498+0000","last_unstale":"2024-06-04T16:18:15.940519+0000","last_undegraded":"2024-06-04T16:18:15.940519+0000","last_fullsized":"2024-06-04T16:18:15.940519+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:45.513877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:45.513877+0000","last_clean_scrub_stamp":"2024-06-04T15:52:45.513877+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T19:56:52.936990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":432,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":50,"num_read_kb":48,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"254'95","reported_seq":835,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:15.014486+0000","last_change":"2024-06-04T15:52:38.486919+0000","last_active":"2024-06-04T16:19:15.014486+0000","last_peered":"2024-06-04T16:19:15.014486+0000","last_clean":"2024-06-04T16:19:15.014486+0000","last_became_active":"2024-06-04T15:52:38.486612+0000","last_became_peered":"2024-06-04T15:52:38.486612+0000","last_unstale":"2024-06-04T16:19:15.014486+0000","last_undegraded":"2024-06-04T16:19:15.014486+0000","last_fullsized":"2024-06-04T16:19:15.014486+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T17:15:27.232127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":567,"num_read_kb":536,"num_write":113,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"254'37","reported_seq":525,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:39.488997+0000","last_change":"2024-06-04T15:52:36.487317+0000","last_active":"2024-06-04T16:22:39.488997+0000","last_peered":"2024-06-04T16:22:39.488997+0000","last_clean":"2024-06-04T16:22:39.488997+0000","last_became_active":"2024-06-04T15:52:36.486999+0000","last_became_peered":"2024-06-04T15:52:36.486999+0000","last_unstale":"2024-06-04T16:22:39.488997+0000","last_undegraded":"2024-06-04T16:22:39.488997+0000","last_fullsized":"2024-06-04T16:22:39.488997+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T20:36:12.625291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":26,"num_read_kb":6159,"num_write":134,"num_write_kb":22820,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":474,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:15.013835+0000","last_change":"2024-06-04T15:52:40.485408+0000","last_active":"2024-06-04T16:19:15.013835+0000","last_peered":"2024-06-04T16:19:15.013835+0000","last_clean":"2024-06-04T16:19:15.013835+0000","last_became_active":"2024-06-04T15:52:40.484711+0000","last_became_peered":"2024-06-04T15:52:40.484711+0000","last_unstale":"2024-06-04T16:19:15.013835+0000","last_undegraded":"2024-06-04T16:19:15.013835+0000","last_fullsized":"2024-06-04T16:19:15.013835+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_clean_scrub_stamp":"2024-06-04T15:52:39.463103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T18:42:17.207481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"251'65","reported_seq":565,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:30.007950+0000","last_change":"2024-06-04T15:52:42.501609+0000","last_active":"2024-06-04T16:18:30.007950+0000","last_peered":"2024-06-04T16:18:30.007950+0000","last_clean":"2024-06-04T16:18:30.007950+0000","last_became_active":"2024-06-04T15:52:42.501248+0000","last_became_peered":"2024-06-04T15:52:42.501248+0000","last_unstale":"2024-06-04T16:18:30.007950+0000","last_undegraded":"2024-06-04T16:18:30.007950+0000","last_fullsized":"2024-06-04T16:18:30.007950+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_clean_scrub_stamp":"2024-06-04T15:52:41.476734+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T02:21:04.282188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":90,"num_read_kb":83,"num_write":60,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.15","version":"254'465","reported_seq":1499,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:39.358887+0000","last_change":"2024-06-04T15:52:44.523497+0000","last_active":"2024-06-04T16:22:39.358887+0000","last_peered":"2024-06-04T16:22:39.358887+0000","last_clean":"2024-06-04T16:22:39.358887+0000","last_became_active":"2024-06-04T15:52:44.523138+0000","last_became_peered":"2024-06-04T15:52:44.523138+0000","last_unstale":"2024-06-04T16:22:39.358887+0000","last_undegraded":"2024-06-04T16:22:39.358887+0000","last_fullsized":"2024-06-04T16:22:39.358887+0000","mapping_epoch":29,"log_start":"251'400","ondisk_log_start":"251'400","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_clean_scrub_stamp":"2024-06-04T15:52:43.492872+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":400,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T16:19:32.818463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"254'37","reported_seq":504,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:21.699674+0000","last_change":"2024-06-04T15:52:46.532424+0000","last_active":"2024-06-04T16:18:21.699674+0000","last_peered":"2024-06-04T16:18:21.699674+0000","last_clean":"2024-06-04T16:18:21.699674+0000","last_became_active":"2024-06-04T15:52:46.532141+0000","last_became_peered":"2024-06-04T15:52:46.532141+0000","last_unstale":"2024-06-04T16:18:21.699674+0000","last_undegraded":"2024-06-04T16:18:21.699674+0000","last_fullsized":"2024-06-04T16:18:21.699674+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:45.513877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:45.513877+0000","last_clean_scrub_stamp":"2024-06-04T15:52:45.513877+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T17:04:53.931942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":56,"num_read_kb":50,"num_write":85,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"254'146","reported_seq":978,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:15.014528+0000","last_change":"2024-06-04T15:52:38.490123+0000","last_active":"2024-06-04T16:19:15.014528+0000","last_peered":"2024-06-04T16:19:15.014528+0000","last_clean":"2024-06-04T16:19:15.014528+0000","last_became_active":"2024-06-04T15:52:38.489719+0000","last_became_peered":"2024-06-04T15:52:38.489719+0000","last_unstale":"2024-06-04T16:19:15.014528+0000","last_undegraded":"2024-06-04T16:19:15.014528+0000","last_fullsized":"2024-06-04T16:19:15.014528+0000","mapping_epoch":23,"log_start":"251'100","ondisk_log_start":"251'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":100,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T20:50:26.159996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":798,"num_read_kb":751,"num_write":172,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"254'47","reported_seq":555,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:20.111775+0000","last_change":"2024-06-04T15:52:36.483313+0000","last_active":"2024-06-04T16:18:20.111775+0000","last_peered":"2024-06-04T16:18:20.111775+0000","last_clean":"2024-06-04T16:18:20.111775+0000","last_became_active":"2024-06-04T15:52:36.482920+0000","last_became_peered":"2024-06-04T15:52:36.482920+0000","last_unstale":"2024-06-04T16:18:20.111775+0000","last_undegraded":"2024-06-04T16:18:20.111775+0000","last_fullsized":"2024-06-04T16:18:20.111775+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T17:11:29.371432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1069231,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":86,"num_read_kb":13402,"num_write":212,"num_write_kb":21907,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3],"acting":[1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":473,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:15.011771+0000","last_change":"2024-06-04T15:52:40.482578+0000","last_active":"2024-06-04T16:19:15.011771+0000","last_peered":"2024-06-04T16:19:15.011771+0000","last_clean":"2024-06-04T16:19:15.011771+0000","last_became_active":"2024-06-04T15:52:40.482288+0000","last_became_peered":"2024-06-04T15:52:40.482288+0000","last_unstale":"2024-06-04T16:19:15.011771+0000","last_undegraded":"2024-06-04T16:19:15.011771+0000","last_fullsized":"2024-06-04T16:19:15.011771+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_clean_scrub_stamp":"2024-06-04T15:52:39.463103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T01:57:16.365165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"254'88","reported_seq":625,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:39.483296+0000","last_change":"2024-06-04T15:52:42.503565+0000","last_active":"2024-06-04T16:22:39.483296+0000","last_peered":"2024-06-04T16:22:39.483296+0000","last_clean":"2024-06-04T16:22:39.483296+0000","last_became_active":"2024-06-04T15:52:42.503282+0000","last_became_peered":"2024-06-04T15:52:42.503282+0000","last_unstale":"2024-06-04T16:22:39.483296+0000","last_undegraded":"2024-06-04T16:22:39.483296+0000","last_fullsized":"2024-06-04T16:22:39.483296+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_clean_scrub_stamp":"2024-06-04T15:52:41.476734+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T16:54:37.102368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6020,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":136,"num_read_kb":193,"num_write":64,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"254'478","reported_seq":1574,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:39.363848+0000","last_change":"2024-06-04T15:52:44.520464+0000","last_active":"2024-06-04T16:22:39.363848+0000","last_peered":"2024-06-04T16:22:39.363848+0000","last_clean":"2024-06-04T16:22:39.363848+0000","last_became_active":"2024-06-04T15:52:44.518724+0000","last_became_peered":"2024-06-04T15:52:44.518724+0000","last_unstale":"2024-06-04T16:22:39.363848+0000","last_undegraded":"2024-06-04T16:22:39.363848+0000","last_fullsized":"2024-06-04T16:22:39.363848+0000","mapping_epoch":29,"log_start":"251'400","ondisk_log_start":"251'400","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_clean_scrub_stamp":"2024-06-04T15:52:43.492872+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":400,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T21:27:12.445604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"254'113","reported_seq":799,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:40.007714+0000","last_change":"2024-06-04T15:52:38.479210+0000","last_active":"2024-06-04T16:18:40.007714+0000","last_peered":"2024-06-04T16:18:40.007714+0000","last_clean":"2024-06-04T16:18:40.007714+0000","last_became_active":"2024-06-04T15:52:38.478886+0000","last_became_peered":"2024-06-04T15:52:38.478886+0000","last_unstale":"2024-06-04T16:18:40.007714+0000","last_undegraded":"2024-06-04T16:18:40.007714+0000","last_fullsized":"2024-06-04T16:18:40.007714+0000","mapping_epoch":23,"log_start":"251'100","ondisk_log_start":"251'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":100,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T02:04:11.671915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":534,"num_read_kb":483,"num_write":137,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"251'58","reported_seq":536,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:20:20.023086+0000","last_change":"2024-06-04T15:53:14.838688+0000","last_active":"2024-06-04T16:20:20.023086+0000","last_peered":"2024-06-04T16:20:20.023086+0000","last_clean":"2024-06-04T16:20:20.023086+0000","last_became_active":"2024-06-04T15:53:14.838259+0000","last_became_peered":"2024-06-04T15:53:14.838259+0000","last_unstale":"2024-06-04T16:20:20.023086+0000","last_undegraded":"2024-06-04T16:20:20.023086+0000","last_fullsized":"2024-06-04T16:20:20.023086+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T21:50:47.794603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":105,"num_read_kb":3164,"num_write":221,"num_write_kb":9993,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,4],"acting":[6,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":477,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:40.113833+0000","last_change":"2024-06-04T15:52:40.484123+0000","last_active":"2024-06-04T16:18:40.113833+0000","last_peered":"2024-06-04T16:18:40.113833+0000","last_clean":"2024-06-04T16:18:40.113833+0000","last_became_active":"2024-06-04T15:52:40.483832+0000","last_became_peered":"2024-06-04T15:52:40.483832+0000","last_unstale":"2024-06-04T16:18:40.113833+0000","last_undegraded":"2024-06-04T16:18:40.113833+0000","last_fullsized":"2024-06-04T16:18:40.113833+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_clean_scrub_stamp":"2024-06-04T15:52:39.463103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T17:49:38.147326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"254'140","reported_seq":712,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:39.521313+0000","last_change":"2024-06-04T15:52:42.504594+0000","last_active":"2024-06-04T16:22:39.521313+0000","last_peered":"2024-06-04T16:22:39.521313+0000","last_clean":"2024-06-04T16:22:39.521313+0000","last_became_active":"2024-06-04T15:52:42.504217+0000","last_became_peered":"2024-06-04T15:52:42.504217+0000","last_unstale":"2024-06-04T16:22:39.521313+0000","last_undegraded":"2024-06-04T16:22:39.521313+0000","last_fullsized":"2024-06-04T16:22:39.521313+0000","mapping_epoch":27,"log_start":"251'100","ondisk_log_start":"251'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_clean_scrub_stamp":"2024-06-04T15:52:41.476734+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":100,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T15:59:45.129536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":216,"num_read_kb":258,"num_write":116,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":463,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:45.017624+0000","last_change":"2024-06-04T15:52:44.520621+0000","last_active":"2024-06-04T16:19:45.017624+0000","last_peered":"2024-06-04T16:19:45.017624+0000","last_clean":"2024-06-04T16:19:45.017624+0000","last_became_active":"2024-06-04T15:52:44.520358+0000","last_became_peered":"2024-06-04T15:52:44.520358+0000","last_unstale":"2024-06-04T16:19:45.017624+0000","last_undegraded":"2024-06-04T16:19:45.017624+0000","last_fullsized":"2024-06-04T16:19:45.017624+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_clean_scrub_stamp":"2024-06-04T15:52:43.492872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T18:58:46.869583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"254'455","reported_seq":1238,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:32.397946+0000","last_change":"2024-06-04T15:52:46.536753+0000","last_active":"2024-06-04T16:22:32.397946+0000","last_peered":"2024-06-04T16:22:32.397946+0000","last_clean":"2024-06-04T16:22:32.397946+0000","last_became_active":"2024-06-04T15:52:46.536442+0000","last_became_peered":"2024-06-04T15:52:46.536442+0000","last_unstale":"2024-06-04T16:22:32.397946+0000","last_undegraded":"2024-06-04T16:22:32.397946+0000","last_fullsized":"2024-06-04T16:22:32.397946+0000","mapping_epoch":31,"log_start":"251'400","ondisk_log_start":"251'400","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:45.513877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:45.513877+0000","last_clean_scrub_stamp":"2024-06-04T15:52:45.513877+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":400,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T18:31:26.520436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":418,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1197,"num_read_kb":1195,"num_write":937,"num_write_kb":336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"254'122","reported_seq":923,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:40.113848+0000","last_change":"2024-06-04T15:52:38.483443+0000","last_active":"2024-06-04T16:18:40.113848+0000","last_peered":"2024-06-04T16:18:40.113848+0000","last_clean":"2024-06-04T16:18:40.113848+0000","last_became_active":"2024-06-04T15:52:38.483194+0000","last_became_peered":"2024-06-04T15:52:38.483194+0000","last_unstale":"2024-06-04T16:18:40.113848+0000","last_undegraded":"2024-06-04T16:18:40.113848+0000","last_fullsized":"2024-06-04T16:18:40.113848+0000","mapping_epoch":23,"log_start":"251'100","ondisk_log_start":"251'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":100,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T17:17:39.302543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":683,"num_read_kb":649,"num_write":140,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"254'60","reported_seq":591,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:21:55.025505+0000","last_change":"2024-06-04T15:52:36.486364+0000","last_active":"2024-06-04T16:21:55.025505+0000","last_peered":"2024-06-04T16:21:55.025505+0000","last_clean":"2024-06-04T16:21:55.025505+0000","last_became_active":"2024-06-04T15:52:36.485995+0000","last_became_peered":"2024-06-04T15:52:36.485995+0000","last_unstale":"2024-06-04T16:21:55.025505+0000","last_undegraded":"2024-06-04T16:21:55.025505+0000","last_fullsized":"2024-06-04T16:21:55.025505+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T01:18:14.040577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":105,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":98,"num_read_kb":68665,"num_write":249,"num_write_kb":35943,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":471,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:40.008747+0000","last_change":"2024-06-04T15:52:40.481019+0000","last_active":"2024-06-04T16:18:40.008747+0000","last_peered":"2024-06-04T16:18:40.008747+0000","last_clean":"2024-06-04T16:18:40.008747+0000","last_became_active":"2024-06-04T15:52:40.480714+0000","last_became_peered":"2024-06-04T15:52:40.480714+0000","last_unstale":"2024-06-04T16:18:40.008747+0000","last_undegraded":"2024-06-04T16:18:40.008747+0000","last_fullsized":"2024-06-04T16:18:40.008747+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_clean_scrub_stamp":"2024-06-04T15:52:39.463103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T22:44:29.436328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.b","version":"254'93","reported_seq":633,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:39.431203+0000","last_change":"2024-06-04T15:52:42.505667+0000","last_active":"2024-06-04T16:22:39.431203+0000","last_peered":"2024-06-04T16:22:39.431203+0000","last_clean":"2024-06-04T16:22:39.431203+0000","last_became_active":"2024-06-04T15:52:42.505269+0000","last_became_peered":"2024-06-04T15:52:42.505269+0000","last_unstale":"2024-06-04T16:22:39.431203+0000","last_undegraded":"2024-06-04T16:22:39.431203+0000","last_fullsized":"2024-06-04T16:22:39.431203+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_clean_scrub_stamp":"2024-06-04T15:52:41.476734+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T19:58:57.937812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":127,"num_read_kb":117,"num_write":58,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":467,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:50.010546+0000","last_change":"2024-06-04T15:52:44.522421+0000","last_active":"2024-06-04T16:18:50.010546+0000","last_peered":"2024-06-04T16:18:50.010546+0000","last_clean":"2024-06-04T16:18:50.010546+0000","last_became_active":"2024-06-04T15:52:44.522149+0000","last_became_peered":"2024-06-04T15:52:44.522149+0000","last_unstale":"2024-06-04T16:18:50.010546+0000","last_undegraded":"2024-06-04T16:18:50.010546+0000","last_fullsized":"2024-06-04T16:18:50.010546+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_clean_scrub_stamp":"2024-06-04T15:52:43.492872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T16:56:50.665549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.5","version":"254'29","reported_seq":505,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:55.121954+0000","last_change":"2024-06-04T15:52:46.540795+0000","last_active":"2024-06-04T16:19:55.121954+0000","last_peered":"2024-06-04T16:19:55.121954+0000","last_clean":"2024-06-04T16:19:55.121954+0000","last_became_active":"2024-06-04T15:52:46.540510+0000","last_became_peered":"2024-06-04T15:52:46.540510+0000","last_unstale":"2024-06-04T16:19:55.121954+0000","last_undegraded":"2024-06-04T16:19:55.121954+0000","last_fullsized":"2024-06-04T16:19:55.121954+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:45.513877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:45.513877+0000","last_clean_scrub_stamp":"2024-06-04T15:52:45.513877+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T23:41:51.500895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":51,"num_write":73,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"254'110","reported_seq":875,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:45.004684+0000","last_change":"2024-06-04T15:52:38.480623+0000","last_active":"2024-06-04T16:18:45.004684+0000","last_peered":"2024-06-04T16:18:45.004684+0000","last_clean":"2024-06-04T16:18:45.004684+0000","last_became_active":"2024-06-04T15:52:38.480112+0000","last_became_peered":"2024-06-04T15:52:38.480112+0000","last_unstale":"2024-06-04T16:18:45.004684+0000","last_undegraded":"2024-06-04T16:18:45.004684+0000","last_fullsized":"2024-06-04T16:18:45.004684+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T00:34:50.827504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":725,"num_read_kb":689,"num_write":131,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"251'79","reported_seq":547,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:20:15.022274+0000","last_change":"2024-06-04T15:53:14.838653+0000","last_active":"2024-06-04T16:20:15.022274+0000","last_peered":"2024-06-04T16:20:15.022274+0000","last_clean":"2024-06-04T16:20:15.022274+0000","last_became_active":"2024-06-04T15:53:14.838251+0000","last_became_peered":"2024-06-04T15:53:14.838251+0000","last_unstale":"2024-06-04T16:20:15.022274+0000","last_undegraded":"2024-06-04T16:20:15.022274+0000","last_fullsized":"2024-06-04T16:20:15.022274+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T16:02:03.538866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5263509,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":74,"num_read_kb":65,"num_write":320,"num_write_kb":43304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.b","version":"33'3","reported_seq":784,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:38.925969+0000","last_change":"2024-06-04T15:52:40.482441+0000","last_active":"2024-06-04T16:22:38.925969+0000","last_peered":"2024-06-04T16:22:38.925969+0000","last_clean":"2024-06-04T16:22:38.925969+0000","last_became_active":"2024-06-04T15:52:40.482173+0000","last_became_peered":"2024-06-04T15:52:40.482173+0000","last_unstale":"2024-06-04T16:22:38.925969+0000","last_undegraded":"2024-06-04T16:22:38.925969+0000","last_fullsized":"2024-06-04T16:22:38.925969+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_clean_scrub_stamp":"2024-06-04T15:52:39.463103+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T16:39:49.059223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":464,"num_read_kb":462,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"254'109","reported_seq":657,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:39.534656+0000","last_change":"2024-06-04T15:52:42.498254+0000","last_active":"2024-06-04T16:22:39.534656+0000","last_peered":"2024-06-04T16:22:39.534656+0000","last_clean":"2024-06-04T16:22:39.534656+0000","last_became_active":"2024-06-04T15:52:42.497393+0000","last_became_peered":"2024-06-04T15:52:42.497393+0000","last_unstale":"2024-06-04T16:22:39.534656+0000","last_undegraded":"2024-06-04T16:22:39.534656+0000","last_fullsized":"2024-06-04T16:22:39.534656+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_clean_scrub_stamp":"2024-06-04T15:52:41.476734+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T20:36:45.216523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13302,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":171,"num_read_kb":247,"num_write":88,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"254'478","reported_seq":1635,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:39.364935+0000","last_change":"2024-06-04T15:52:44.519059+0000","last_active":"2024-06-04T16:22:39.364935+0000","last_peered":"2024-06-04T16:22:39.364935+0000","last_clean":"2024-06-04T16:22:39.364935+0000","last_became_active":"2024-06-04T15:52:44.518765+0000","last_became_peered":"2024-06-04T15:52:44.518765+0000","last_unstale":"2024-06-04T16:22:39.364935+0000","last_undegraded":"2024-06-04T16:22:39.364935+0000","last_fullsized":"2024-06-04T16:22:39.364935+0000","mapping_epoch":29,"log_start":"251'400","ondisk_log_start":"251'400","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_clean_scrub_stamp":"2024-06-04T15:52:43.492872+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":400,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T20:20:06.797230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"251'21","reported_seq":488,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:50.010030+0000","last_change":"2024-06-04T15:52:46.537947+0000","last_active":"2024-06-04T16:18:50.010030+0000","last_peered":"2024-06-04T16:18:50.010030+0000","last_clean":"2024-06-04T16:18:50.010030+0000","last_became_active":"2024-06-04T15:52:46.537679+0000","last_became_peered":"2024-06-04T15:52:46.537679+0000","last_unstale":"2024-06-04T16:18:50.010030+0000","last_undegraded":"2024-06-04T16:18:50.010030+0000","last_fullsized":"2024-06-04T16:18:50.010030+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:45.513877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:45.513877+0000","last_clean_scrub_stamp":"2024-06-04T15:52:45.513877+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T18:28:47.547893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":390,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":49,"num_read_kb":41,"num_write":55,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"254'141","reported_seq":899,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:40.017652+0000","last_change":"2024-06-04T15:52:38.489274+0000","last_active":"2024-06-04T16:19:40.017652+0000","last_peered":"2024-06-04T16:19:40.017652+0000","last_clean":"2024-06-04T16:19:40.017652+0000","last_became_active":"2024-06-04T15:52:38.488997+0000","last_became_peered":"2024-06-04T15:52:38.488997+0000","last_unstale":"2024-06-04T16:19:40.017652+0000","last_undegraded":"2024-06-04T16:19:40.017652+0000","last_fullsized":"2024-06-04T16:19:40.017652+0000","mapping_epoch":23,"log_start":"251'100","ondisk_log_start":"251'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":100,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T00:28:22.807058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":688,"num_read_kb":631,"num_write":173,"num_write_kb":46,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"254'58","reported_seq":567,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:21:55.023003+0000","last_change":"2024-06-04T15:52:36.495931+0000","last_active":"2024-06-04T16:21:55.023003+0000","last_peered":"2024-06-04T16:21:55.023003+0000","last_clean":"2024-06-04T16:21:55.023003+0000","last_became_active":"2024-06-04T15:52:36.495601+0000","last_became_peered":"2024-06-04T15:52:36.495601+0000","last_unstale":"2024-06-04T16:21:55.023003+0000","last_undegraded":"2024-06-04T16:21:55.023003+0000","last_fullsized":"2024-06-04T16:21:55.023003+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T23:22:39.942337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":74,"num_read_kb":575,"num_write":257,"num_write_kb":23683,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":471,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:45.009389+0000","last_change":"2024-06-04T15:52:40.485064+0000","last_active":"2024-06-04T16:18:45.009389+0000","last_peered":"2024-06-04T16:18:45.009389+0000","last_clean":"2024-06-04T16:18:45.009389+0000","last_became_active":"2024-06-04T15:52:40.484785+0000","last_became_peered":"2024-06-04T15:52:40.484785+0000","last_unstale":"2024-06-04T16:18:45.009389+0000","last_undegraded":"2024-06-04T16:18:45.009389+0000","last_fullsized":"2024-06-04T16:18:45.009389+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_clean_scrub_stamp":"2024-06-04T15:52:39.463103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T18:35:53.675262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.9","version":"254'158","reported_seq":759,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:39.545951+0000","last_change":"2024-06-04T15:52:42.504865+0000","last_active":"2024-06-04T16:22:39.545951+0000","last_peered":"2024-06-04T16:22:39.545951+0000","last_clean":"2024-06-04T16:22:39.545951+0000","last_became_active":"2024-06-04T15:52:42.504622+0000","last_became_peered":"2024-06-04T15:52:42.504622+0000","last_unstale":"2024-06-04T16:22:39.545951+0000","last_undegraded":"2024-06-04T16:22:39.545951+0000","last_fullsized":"2024-06-04T16:22:39.545951+0000","mapping_epoch":27,"log_start":"251'100","ondisk_log_start":"251'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_clean_scrub_stamp":"2024-06-04T15:52:41.476734+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":100,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T01:00:09.245514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25402,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":256,"num_read_kb":404,"num_write":118,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":469,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:45.010347+0000","last_change":"2024-06-04T15:52:44.518616+0000","last_active":"2024-06-04T16:18:45.010347+0000","last_peered":"2024-06-04T16:18:45.010347+0000","last_clean":"2024-06-04T16:18:45.010347+0000","last_became_active":"2024-06-04T15:52:44.518340+0000","last_became_peered":"2024-06-04T15:52:44.518340+0000","last_unstale":"2024-06-04T16:18:45.010347+0000","last_undegraded":"2024-06-04T16:18:45.010347+0000","last_fullsized":"2024-06-04T16:18:45.010347+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_clean_scrub_stamp":"2024-06-04T15:52:43.492872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T20:18:04.722535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"254'22","reported_seq":501,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:50.123049+0000","last_change":"2024-06-04T15:52:46.540890+0000","last_active":"2024-06-04T16:18:50.123049+0000","last_peered":"2024-06-04T16:18:50.123049+0000","last_clean":"2024-06-04T16:18:50.123049+0000","last_became_active":"2024-06-04T15:52:46.540542+0000","last_became_peered":"2024-06-04T15:52:46.540542+0000","last_unstale":"2024-06-04T16:18:50.123049+0000","last_undegraded":"2024-06-04T16:18:50.123049+0000","last_fullsized":"2024-06-04T16:18:50.123049+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:45.513877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:45.513877+0000","last_clean_scrub_stamp":"2024-06-04T15:52:45.513877+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T00:28:19.284809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":503,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":51,"num_read_kb":51,"num_write":59,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"254'116","reported_seq":912,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:40.009649+0000","last_change":"2024-06-04T15:52:38.488878+0000","last_active":"2024-06-04T16:19:40.009649+0000","last_peered":"2024-06-04T16:19:40.009649+0000","last_clean":"2024-06-04T16:19:40.009649+0000","last_became_active":"2024-06-04T15:52:38.488576+0000","last_became_peered":"2024-06-04T15:52:38.488576+0000","last_unstale":"2024-06-04T16:19:40.009649+0000","last_undegraded":"2024-06-04T16:19:40.009649+0000","last_fullsized":"2024-06-04T16:19:40.009649+0000","mapping_epoch":23,"log_start":"251'100","ondisk_log_start":"251'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":100,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T01:10:33.008463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":804,"num_read_kb":763,"num_write":143,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"254'83","reported_seq":603,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:21:55.149892+0000","last_change":"2024-06-04T15:52:36.499047+0000","last_active":"2024-06-04T16:21:55.149892+0000","last_peered":"2024-06-04T16:21:55.149892+0000","last_clean":"2024-06-04T16:21:55.149892+0000","last_became_active":"2024-06-04T15:52:36.498706+0000","last_became_peered":"2024-06-04T15:52:36.498706+0000","last_unstale":"2024-06-04T16:21:55.149892+0000","last_undegraded":"2024-06-04T16:21:55.149892+0000","last_fullsized":"2024-06-04T16:21:55.149892+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T20:01:28.183971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262197,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":125,"num_read_kb":7280,"num_write":369,"num_write_kb":33149,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":475,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:40.129985+0000","last_change":"2024-06-04T15:52:40.485318+0000","last_active":"2024-06-04T16:19:40.129985+0000","last_peered":"2024-06-04T16:19:40.129985+0000","last_clean":"2024-06-04T16:19:40.129985+0000","last_became_active":"2024-06-04T15:52:40.484285+0000","last_became_peered":"2024-06-04T15:52:40.484285+0000","last_unstale":"2024-06-04T16:19:40.129985+0000","last_undegraded":"2024-06-04T16:19:40.129985+0000","last_fullsized":"2024-06-04T16:19:40.129985+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_clean_scrub_stamp":"2024-06-04T15:52:39.463103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T23:36:57.821083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.e","version":"254'121","reported_seq":666,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:39.458502+0000","last_change":"2024-06-04T15:52:42.501168+0000","last_active":"2024-06-04T16:22:39.458502+0000","last_peered":"2024-06-04T16:22:39.458502+0000","last_clean":"2024-06-04T16:22:39.458502+0000","last_became_active":"2024-06-04T15:52:42.500865+0000","last_became_peered":"2024-06-04T15:52:42.500865+0000","last_unstale":"2024-06-04T16:22:39.458502+0000","last_undegraded":"2024-06-04T16:22:39.458502+0000","last_fullsized":"2024-06-04T16:22:39.458502+0000","mapping_epoch":27,"log_start":"251'100","ondisk_log_start":"251'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_clean_scrub_stamp":"2024-06-04T15:52:41.476734+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":100,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T22:23:11.038518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":174,"num_read_kb":176,"num_write":136,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":467,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:45.130828+0000","last_change":"2024-06-04T15:52:44.520519+0000","last_active":"2024-06-04T16:19:45.130828+0000","last_peered":"2024-06-04T16:19:45.130828+0000","last_clean":"2024-06-04T16:19:45.130828+0000","last_became_active":"2024-06-04T15:52:44.519542+0000","last_became_peered":"2024-06-04T15:52:44.519542+0000","last_unstale":"2024-06-04T16:19:45.130828+0000","last_undegraded":"2024-06-04T16:19:45.130828+0000","last_fullsized":"2024-06-04T16:19:45.130828+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_clean_scrub_stamp":"2024-06-04T15:52:43.492872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T22:23:21.493696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.0","version":"254'16","reported_seq":482,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:55.011781+0000","last_change":"2024-06-04T15:52:46.540191+0000","last_active":"2024-06-04T16:18:55.011781+0000","last_peered":"2024-06-04T16:18:55.011781+0000","last_clean":"2024-06-04T16:18:55.011781+0000","last_became_active":"2024-06-04T15:52:46.539906+0000","last_became_peered":"2024-06-04T15:52:46.539906+0000","last_unstale":"2024-06-04T16:18:55.011781+0000","last_undegraded":"2024-06-04T16:18:55.011781+0000","last_fullsized":"2024-06-04T16:18:55.011781+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:45.513877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:45.513877+0000","last_clean_scrub_stamp":"2024-06-04T15:52:45.513877+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T16:35:48.692745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":31,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"254'140","reported_seq":897,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:40.014533+0000","last_change":"2024-06-04T15:52:38.479098+0000","last_active":"2024-06-04T16:19:40.014533+0000","last_peered":"2024-06-04T16:19:40.014533+0000","last_clean":"2024-06-04T16:19:40.014533+0000","last_became_active":"2024-06-04T15:52:38.478691+0000","last_became_peered":"2024-06-04T15:52:38.478691+0000","last_unstale":"2024-06-04T16:19:40.014533+0000","last_undegraded":"2024-06-04T16:19:40.014533+0000","last_fullsized":"2024-06-04T16:19:40.014533+0000","mapping_epoch":23,"log_start":"251'100","ondisk_log_start":"251'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":100,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T20:41:58.834443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":683,"num_read_kb":634,"num_write":182,"num_write_kb":49,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"254'80","reported_seq":587,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:45.008382+0000","last_change":"2024-06-04T15:52:36.489783+0000","last_active":"2024-06-04T16:18:45.008382+0000","last_peered":"2024-06-04T16:18:45.008382+0000","last_clean":"2024-06-04T16:18:45.008382+0000","last_became_active":"2024-06-04T15:52:36.489437+0000","last_became_peered":"2024-06-04T15:52:36.489437+0000","last_unstale":"2024-06-04T16:18:45.008382+0000","last_undegraded":"2024-06-04T16:18:45.008382+0000","last_fullsized":"2024-06-04T16:18:45.008382+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T23:09:59.205888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133669,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":97,"num_read_kb":3905,"num_write":348,"num_write_kb":24180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":477,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:40.017716+0000","last_change":"2024-06-04T15:52:40.480878+0000","last_active":"2024-06-04T16:19:40.017716+0000","last_peered":"2024-06-04T16:19:40.017716+0000","last_clean":"2024-06-04T16:19:40.017716+0000","last_became_active":"2024-06-04T15:52:40.480568+0000","last_became_peered":"2024-06-04T15:52:40.480568+0000","last_unstale":"2024-06-04T16:19:40.017716+0000","last_undegraded":"2024-06-04T16:19:40.017716+0000","last_fullsized":"2024-06-04T16:19:40.017716+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_clean_scrub_stamp":"2024-06-04T15:52:39.463103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T22:05:18.609127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.f","version":"254'111","reported_seq":662,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:39.412599+0000","last_change":"2024-06-04T15:52:42.499311+0000","last_active":"2024-06-04T16:22:39.412599+0000","last_peered":"2024-06-04T16:22:39.412599+0000","last_clean":"2024-06-04T16:22:39.412599+0000","last_became_active":"2024-06-04T15:52:42.499014+0000","last_became_peered":"2024-06-04T15:52:42.499014+0000","last_unstale":"2024-06-04T16:22:39.412599+0000","last_undegraded":"2024-06-04T16:22:39.412599+0000","last_fullsized":"2024-06-04T16:22:39.412599+0000","mapping_epoch":27,"log_start":"251'100","ondisk_log_start":"251'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_clean_scrub_stamp":"2024-06-04T15:52:41.476734+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":100,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T17:38:48.045987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6848,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":169,"num_read_kb":239,"num_write":88,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.e","version":"254'463","reported_seq":1443,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:39.360099+0000","last_change":"2024-06-04T15:52:44.520284+0000","last_active":"2024-06-04T16:22:39.360099+0000","last_peered":"2024-06-04T16:22:39.360099+0000","last_clean":"2024-06-04T16:22:39.360099+0000","last_became_active":"2024-06-04T15:52:44.520016+0000","last_became_peered":"2024-06-04T15:52:44.520016+0000","last_unstale":"2024-06-04T16:22:39.360099+0000","last_undegraded":"2024-06-04T16:22:39.360099+0000","last_fullsized":"2024-06-04T16:22:39.360099+0000","mapping_epoch":29,"log_start":"251'400","ondisk_log_start":"251'400","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_clean_scrub_stamp":"2024-06-04T15:52:43.492872+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":400,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T21:36:43.965699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1","version":"254'28","reported_seq":499,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:55.019299+0000","last_change":"2024-06-04T15:52:46.532842+0000","last_active":"2024-06-04T16:19:55.019299+0000","last_peered":"2024-06-04T16:19:55.019299+0000","last_clean":"2024-06-04T16:19:55.019299+0000","last_became_active":"2024-06-04T15:52:46.532554+0000","last_became_peered":"2024-06-04T15:52:46.532554+0000","last_unstale":"2024-06-04T16:19:55.019299+0000","last_undegraded":"2024-06-04T16:19:55.019299+0000","last_fullsized":"2024-06-04T16:19:55.019299+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:45.513877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:45.513877+0000","last_clean_scrub_stamp":"2024-06-04T15:52:45.513877+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T18:11:38.661962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":764,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":64,"num_read_kb":55,"num_write":77,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.e","version":"254'75","reported_seq":757,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:40.010221+0000","last_change":"2024-06-04T15:52:38.481543+0000","last_active":"2024-06-04T16:19:40.010221+0000","last_peered":"2024-06-04T16:19:40.010221+0000","last_clean":"2024-06-04T16:19:40.010221+0000","last_became_active":"2024-06-04T15:52:38.480961+0000","last_became_peered":"2024-06-04T15:52:38.480961+0000","last_unstale":"2024-06-04T16:19:40.010221+0000","last_undegraded":"2024-06-04T16:19:40.010221+0000","last_fullsized":"2024-06-04T16:19:40.010221+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T23:30:27.048500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":420,"num_read_kb":402,"num_write":82,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"254'43","reported_seq":541,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:40.007753+0000","last_change":"2024-06-04T15:52:36.485951+0000","last_active":"2024-06-04T16:18:40.007753+0000","last_peered":"2024-06-04T16:18:40.007753+0000","last_clean":"2024-06-04T16:18:40.007753+0000","last_became_active":"2024-06-04T15:52:36.485571+0000","last_became_peered":"2024-06-04T15:52:36.485571+0000","last_unstale":"2024-06-04T16:18:40.007753+0000","last_undegraded":"2024-06-04T16:18:40.007753+0000","last_fullsized":"2024-06-04T16:18:40.007753+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T01:39:00.786783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":66,"num_read_kb":9943,"num_write":198,"num_write_kb":32171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"26'2","reported_seq":1085,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:38.936585+0000","last_change":"2024-06-04T15:52:40.477976+0000","last_active":"2024-06-04T16:22:38.936585+0000","last_peered":"2024-06-04T16:22:38.936585+0000","last_clean":"2024-06-04T16:22:38.936585+0000","last_became_active":"2024-06-04T15:52:40.477693+0000","last_became_peered":"2024-06-04T15:52:40.477693+0000","last_unstale":"2024-06-04T16:22:38.936585+0000","last_undegraded":"2024-06-04T16:22:38.936585+0000","last_fullsized":"2024-06-04T16:22:38.936585+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_clean_scrub_stamp":"2024-06-04T15:52:39.463103+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T15:57:27.865623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":606,"num_read_kb":606,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"251'35","reported_seq":517,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:45.017668+0000","last_change":"2024-06-04T15:52:42.503779+0000","last_active":"2024-06-04T16:19:45.017668+0000","last_peered":"2024-06-04T16:19:45.017668+0000","last_clean":"2024-06-04T16:19:45.017668+0000","last_became_active":"2024-06-04T15:52:42.503184+0000","last_became_peered":"2024-06-04T15:52:42.503184+0000","last_unstale":"2024-06-04T16:19:45.017668+0000","last_undegraded":"2024-06-04T16:19:45.017668+0000","last_fullsized":"2024-06-04T16:19:45.017668+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_clean_scrub_stamp":"2024-06-04T15:52:41.476734+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T01:25:31.440819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":45,"num_read_kb":40,"num_write":30,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.d","version":"254'470","reported_seq":1623,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:39.361088+0000","last_change":"2024-06-04T15:52:44.518741+0000","last_active":"2024-06-04T16:22:39.361088+0000","last_peered":"2024-06-04T16:22:39.361088+0000","last_clean":"2024-06-04T16:22:39.361088+0000","last_became_active":"2024-06-04T15:52:44.518522+0000","last_became_peered":"2024-06-04T15:52:44.518522+0000","last_unstale":"2024-06-04T16:22:39.361088+0000","last_undegraded":"2024-06-04T16:22:39.361088+0000","last_fullsized":"2024-06-04T16:22:39.361088+0000","mapping_epoch":29,"log_start":"251'400","ondisk_log_start":"251'400","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_clean_scrub_stamp":"2024-06-04T15:52:43.492872+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":400,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T17:21:25.625424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"254'25","reported_seq":493,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:55.011771+0000","last_change":"2024-06-04T15:52:46.529500+0000","last_active":"2024-06-04T16:19:55.011771+0000","last_peered":"2024-06-04T16:19:55.011771+0000","last_clean":"2024-06-04T16:19:55.011771+0000","last_became_active":"2024-06-04T15:52:46.529183+0000","last_became_peered":"2024-06-04T15:52:46.529183+0000","last_unstale":"2024-06-04T16:19:55.011771+0000","last_undegraded":"2024-06-04T16:19:55.011771+0000","last_fullsized":"2024-06-04T16:19:55.011771+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:45.513877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:45.513877+0000","last_clean_scrub_stamp":"2024-06-04T15:52:45.513877+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T02:50:02.857177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":33,"num_read_kb":31,"num_write":52,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"254'102","reported_seq":866,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:40.130050+0000","last_change":"2024-06-04T15:52:38.485496+0000","last_active":"2024-06-04T16:19:40.130050+0000","last_peered":"2024-06-04T16:19:40.130050+0000","last_clean":"2024-06-04T16:19:40.130050+0000","last_became_active":"2024-06-04T15:52:38.485146+0000","last_became_peered":"2024-06-04T15:52:38.485146+0000","last_unstale":"2024-06-04T16:19:40.130050+0000","last_undegraded":"2024-06-04T16:19:40.130050+0000","last_fullsized":"2024-06-04T16:19:40.130050+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T21:02:08.479603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":573,"num_read_kb":549,"num_write":116,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"251'24","reported_seq":516,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:40.009093+0000","last_change":"2024-06-04T15:52:36.475660+0000","last_active":"2024-06-04T16:18:40.009093+0000","last_peered":"2024-06-04T16:18:40.009093+0000","last_clean":"2024-06-04T16:18:40.009093+0000","last_became_active":"2024-06-04T15:52:36.475290+0000","last_became_peered":"2024-06-04T15:52:36.475290+0000","last_unstale":"2024-06-04T16:18:40.009093+0000","last_undegraded":"2024-06-04T16:18:40.009093+0000","last_fullsized":"2024-06-04T16:18:40.009093+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T20:08:50.243935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":22,"num_read_kb":15371,"num_write":75,"num_write_kb":21019,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,2],"acting":[4,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":474,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:40.014557+0000","last_change":"2024-06-04T15:52:40.482222+0000","last_active":"2024-06-04T16:19:40.014557+0000","last_peered":"2024-06-04T16:19:40.014557+0000","last_clean":"2024-06-04T16:19:40.014557+0000","last_became_active":"2024-06-04T15:52:40.481856+0000","last_became_peered":"2024-06-04T15:52:40.481856+0000","last_unstale":"2024-06-04T16:19:40.014557+0000","last_undegraded":"2024-06-04T16:19:40.014557+0000","last_fullsized":"2024-06-04T16:19:40.014557+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_clean_scrub_stamp":"2024-06-04T15:52:39.463103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T21:21:46.829568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"254'140","reported_seq":709,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:39.513007+0000","last_change":"2024-06-04T15:52:42.503483+0000","last_active":"2024-06-04T16:22:39.513007+0000","last_peered":"2024-06-04T16:22:39.513007+0000","last_clean":"2024-06-04T16:22:39.513007+0000","last_became_active":"2024-06-04T15:52:42.503214+0000","last_became_peered":"2024-06-04T15:52:42.503214+0000","last_unstale":"2024-06-04T16:22:39.513007+0000","last_undegraded":"2024-06-04T16:22:39.513007+0000","last_fullsized":"2024-06-04T16:22:39.513007+0000","mapping_epoch":27,"log_start":"251'100","ondisk_log_start":"251'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_clean_scrub_stamp":"2024-06-04T15:52:41.476734+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":100,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T18:55:21.822380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27149,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":238,"num_read_kb":318,"num_write":172,"num_write_kb":95,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":465,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:45.010700+0000","last_change":"2024-06-04T15:52:44.514586+0000","last_active":"2024-06-04T16:19:45.010700+0000","last_peered":"2024-06-04T16:19:45.010700+0000","last_clean":"2024-06-04T16:19:45.010700+0000","last_became_active":"2024-06-04T15:52:44.514269+0000","last_became_peered":"2024-06-04T15:52:44.514269+0000","last_unstale":"2024-06-04T16:19:45.010700+0000","last_undegraded":"2024-06-04T16:19:45.010700+0000","last_fullsized":"2024-06-04T16:19:45.010700+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_clean_scrub_stamp":"2024-06-04T15:52:43.492872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T22:14:52.172379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"254'31","reported_seq":503,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:55.132073+0000","last_change":"2024-06-04T15:52:46.532569+0000","last_active":"2024-06-04T16:19:55.132073+0000","last_peered":"2024-06-04T16:19:55.132073+0000","last_clean":"2024-06-04T16:19:55.132073+0000","last_became_active":"2024-06-04T15:52:46.531977+0000","last_became_peered":"2024-06-04T15:52:46.531977+0000","last_unstale":"2024-06-04T16:19:55.132073+0000","last_undegraded":"2024-06-04T16:19:55.132073+0000","last_fullsized":"2024-06-04T16:19:55.132073+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:45.513877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:45.513877+0000","last_clean_scrub_stamp":"2024-06-04T15:52:45.513877+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T23:12:23.178842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":49,"num_write":79,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"254'144","reported_seq":952,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:50.015669+0000","last_change":"2024-06-04T15:52:38.478958+0000","last_active":"2024-06-04T16:19:50.015669+0000","last_peered":"2024-06-04T16:19:50.015669+0000","last_clean":"2024-06-04T16:19:50.015669+0000","last_became_active":"2024-06-04T15:52:38.478362+0000","last_became_peered":"2024-06-04T15:52:38.478362+0000","last_unstale":"2024-06-04T16:19:50.015669+0000","last_undegraded":"2024-06-04T16:19:50.015669+0000","last_fullsized":"2024-06-04T16:19:50.015669+0000","mapping_epoch":23,"log_start":"251'100","ondisk_log_start":"251'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T22:47:09.266351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":807,"num_read_kb":748,"num_write":182,"num_write_kb":49,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":496,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:20:25.125218+0000","last_change":"2024-06-04T15:52:22.417765+0000","last_active":"2024-06-04T16:20:25.125218+0000","last_peered":"2024-06-04T16:20:25.125218+0000","last_clean":"2024-06-04T16:20:25.125218+0000","last_became_active":"2024-06-04T15:52:22.417462+0000","last_became_peered":"2024-06-04T15:52:22.417462+0000","last_unstale":"2024-06-04T16:20:25.125218+0000","last_undegraded":"2024-06-04T16:20:25.125218+0000","last_fullsized":"2024-06-04T16:20:25.125218+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:21.400880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:21.400880+0000","last_clean_scrub_stamp":"2024-06-04T15:52:21.400880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T01:56:18.510923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"251'43","reported_seq":534,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:45.017794+0000","last_change":"2024-06-04T15:52:36.498057+0000","last_active":"2024-06-04T16:19:45.017794+0000","last_peered":"2024-06-04T16:19:45.017794+0000","last_clean":"2024-06-04T16:19:45.017794+0000","last_became_active":"2024-06-04T15:52:36.497603+0000","last_became_peered":"2024-06-04T15:52:36.497603+0000","last_unstale":"2024-06-04T16:19:45.017794+0000","last_undegraded":"2024-06-04T16:19:45.017794+0000","last_fullsized":"2024-06-04T16:19:45.017794+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T21:06:13.700958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1069190,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":32,"num_read_kb":263,"num_write":148,"num_write_kb":16917,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,0],"acting":[4,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":478,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:45.010145+0000","last_change":"2024-06-04T15:52:40.483375+0000","last_active":"2024-06-04T16:19:45.010145+0000","last_peered":"2024-06-04T16:19:45.010145+0000","last_clean":"2024-06-04T16:19:45.010145+0000","last_became_active":"2024-06-04T15:52:40.482529+0000","last_became_peered":"2024-06-04T15:52:40.482529+0000","last_unstale":"2024-06-04T16:19:45.010145+0000","last_undegraded":"2024-06-04T16:19:45.010145+0000","last_fullsized":"2024-06-04T16:19:45.010145+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_clean_scrub_stamp":"2024-06-04T15:52:39.463103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T19:54:15.030371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"254'241","reported_seq":912,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:39.562885+0000","last_change":"2024-06-04T15:52:42.497154+0000","last_active":"2024-06-04T16:22:39.562885+0000","last_peered":"2024-06-04T16:22:39.562885+0000","last_clean":"2024-06-04T16:22:39.562885+0000","last_became_active":"2024-06-04T15:52:42.496878+0000","last_became_peered":"2024-06-04T15:52:42.496878+0000","last_unstale":"2024-06-04T16:22:39.562885+0000","last_undegraded":"2024-06-04T16:22:39.562885+0000","last_fullsized":"2024-06-04T16:22:39.562885+0000","mapping_epoch":27,"log_start":"251'200","ondisk_log_start":"251'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_clean_scrub_stamp":"2024-06-04T15:52:41.476734+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":200,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T19:44:50.163372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30577,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":489,"num_read_kb":691,"num_write":394,"num_write_kb":281,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":469,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:45.010474+0000","last_change":"2024-06-04T15:52:44.514011+0000","last_active":"2024-06-04T16:18:45.010474+0000","last_peered":"2024-06-04T16:18:45.010474+0000","last_clean":"2024-06-04T16:18:45.010474+0000","last_became_active":"2024-06-04T15:52:44.513726+0000","last_became_peered":"2024-06-04T15:52:44.513726+0000","last_unstale":"2024-06-04T16:18:45.010474+0000","last_undegraded":"2024-06-04T16:18:45.010474+0000","last_fullsized":"2024-06-04T16:18:45.010474+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_clean_scrub_stamp":"2024-06-04T15:52:43.492872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T19:48:02.146293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"254'34","reported_seq":516,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:50.004737+0000","last_change":"2024-06-04T15:52:46.536565+0000","last_active":"2024-06-04T16:18:50.004737+0000","last_peered":"2024-06-04T16:18:50.004737+0000","last_clean":"2024-06-04T16:18:50.004737+0000","last_became_active":"2024-06-04T15:52:46.536184+0000","last_became_peered":"2024-06-04T15:52:46.536184+0000","last_unstale":"2024-06-04T16:18:50.004737+0000","last_undegraded":"2024-06-04T16:18:50.004737+0000","last_fullsized":"2024-06-04T16:18:50.004737+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:45.513877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:45.513877+0000","last_clean_scrub_stamp":"2024-06-04T15:52:45.513877+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T22:45:30.543372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":408,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":64,"num_read_kb":61,"num_write":79,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"254'172","reported_seq":973,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:45.017681+0000","last_change":"2024-06-04T15:52:38.474997+0000","last_active":"2024-06-04T16:19:45.017681+0000","last_peered":"2024-06-04T16:19:45.017681+0000","last_clean":"2024-06-04T16:19:45.017681+0000","last_became_active":"2024-06-04T15:52:38.474646+0000","last_became_peered":"2024-06-04T15:52:38.474646+0000","last_unstale":"2024-06-04T16:19:45.017681+0000","last_undegraded":"2024-06-04T16:19:45.017681+0000","last_fullsized":"2024-06-04T16:19:45.017681+0000","mapping_epoch":23,"log_start":"251'100","ondisk_log_start":"251'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":100,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T03:13:37.646203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":944,"num_read_kb":866,"num_write":217,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":493,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:25.012795+0000","last_change":"2024-06-04T15:52:22.777198+0000","last_active":"2024-06-04T16:19:25.012795+0000","last_peered":"2024-06-04T16:19:25.012795+0000","last_clean":"2024-06-04T16:19:25.012795+0000","last_became_active":"2024-06-04T15:52:22.776779+0000","last_became_peered":"2024-06-04T15:52:22.776779+0000","last_unstale":"2024-06-04T16:19:25.012795+0000","last_undegraded":"2024-06-04T16:19:25.012795+0000","last_fullsized":"2024-06-04T16:19:25.012795+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:21.400880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:21.400880+0000","last_clean_scrub_stamp":"2024-06-04T15:52:21.400880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T02:49:10.441919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"251'43","reported_seq":539,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:45.010124+0000","last_change":"2024-06-04T15:52:36.495013+0000","last_active":"2024-06-04T16:19:45.010124+0000","last_peered":"2024-06-04T16:19:45.010124+0000","last_clean":"2024-06-04T16:19:45.010124+0000","last_became_active":"2024-06-04T15:52:36.494711+0000","last_became_peered":"2024-06-04T15:52:36.494711+0000","last_unstale":"2024-06-04T16:19:45.010124+0000","last_undegraded":"2024-06-04T16:19:45.010124+0000","last_fullsized":"2024-06-04T16:19:45.010124+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T22:50:20.789950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20644,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":32,"num_read_kb":101,"num_write":157,"num_write_kb":20554,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,4],"acting":[0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":476,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:45.130774+0000","last_change":"2024-06-04T15:52:40.485086+0000","last_active":"2024-06-04T16:19:45.130774+0000","last_peered":"2024-06-04T16:19:45.130774+0000","last_clean":"2024-06-04T16:19:45.130774+0000","last_became_active":"2024-06-04T15:52:40.484698+0000","last_became_peered":"2024-06-04T15:52:40.484698+0000","last_unstale":"2024-06-04T16:19:45.130774+0000","last_undegraded":"2024-06-04T16:19:45.130774+0000","last_fullsized":"2024-06-04T16:19:45.130774+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_clean_scrub_stamp":"2024-06-04T15:52:39.463103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T18:54:22.275767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"251'83","reported_seq":589,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:45.010464+0000","last_change":"2024-06-04T15:52:42.500941+0000","last_active":"2024-06-04T16:18:45.010464+0000","last_peered":"2024-06-04T16:18:45.010464+0000","last_clean":"2024-06-04T16:18:45.010464+0000","last_became_active":"2024-06-04T15:52:42.500646+0000","last_became_peered":"2024-06-04T15:52:42.500646+0000","last_unstale":"2024-06-04T16:18:45.010464+0000","last_undegraded":"2024-06-04T16:18:45.010464+0000","last_fullsized":"2024-06-04T16:18:45.010464+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_clean_scrub_stamp":"2024-06-04T15:52:41.476734+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T22:44:47.011875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":102,"num_read_kb":94,"num_write":72,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":466,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:45.008452+0000","last_change":"2024-06-04T15:52:44.521167+0000","last_active":"2024-06-04T16:18:45.008452+0000","last_peered":"2024-06-04T16:18:45.008452+0000","last_clean":"2024-06-04T16:18:45.008452+0000","last_became_active":"2024-06-04T15:52:44.520841+0000","last_became_peered":"2024-06-04T15:52:44.520841+0000","last_unstale":"2024-06-04T16:18:45.008452+0000","last_undegraded":"2024-06-04T16:18:45.008452+0000","last_fullsized":"2024-06-04T16:18:45.008452+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_clean_scrub_stamp":"2024-06-04T15:52:43.492872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T01:14:42.414240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"251'34","reported_seq":534,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:50.115154+0000","last_change":"2024-06-04T15:52:46.540297+0000","last_active":"2024-06-04T16:18:50.115154+0000","last_peered":"2024-06-04T16:18:50.115154+0000","last_clean":"2024-06-04T16:18:50.115154+0000","last_became_active":"2024-06-04T15:52:46.539931+0000","last_became_peered":"2024-06-04T15:52:46.539931+0000","last_unstale":"2024-06-04T16:18:50.115154+0000","last_undegraded":"2024-06-04T16:18:50.115154+0000","last_fullsized":"2024-06-04T16:18:50.115154+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:45.513877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:45.513877+0000","last_clean_scrub_stamp":"2024-06-04T15:52:45.513877+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T01:12:43.841169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":127,"num_read_kb":111,"num_write":92,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"254'119","reported_seq":1028,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:40.008889+0000","last_change":"2024-06-04T15:52:38.486040+0000","last_active":"2024-06-04T16:18:40.008889+0000","last_peered":"2024-06-04T16:18:40.008889+0000","last_clean":"2024-06-04T16:18:40.008889+0000","last_became_active":"2024-06-04T15:52:38.485755+0000","last_became_peered":"2024-06-04T15:52:38.485755+0000","last_unstale":"2024-06-04T16:18:40.008889+0000","last_undegraded":"2024-06-04T16:18:40.008889+0000","last_fullsized":"2024-06-04T16:18:40.008889+0000","mapping_epoch":23,"log_start":"254'100","ondisk_log_start":"254'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":100,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T16:25:57.227817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":989,"num_read_kb":963,"num_write":137,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":495,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:30.008638+0000","last_change":"2024-06-04T15:52:22.423235+0000","last_active":"2024-06-04T16:19:30.008638+0000","last_peered":"2024-06-04T16:19:30.008638+0000","last_clean":"2024-06-04T16:19:30.008638+0000","last_became_active":"2024-06-04T15:52:22.422971+0000","last_became_peered":"2024-06-04T15:52:22.422971+0000","last_unstale":"2024-06-04T16:19:30.008638+0000","last_undegraded":"2024-06-04T16:19:30.008638+0000","last_fullsized":"2024-06-04T16:19:30.008638+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:21.400880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:21.400880+0000","last_clean_scrub_stamp":"2024-06-04T15:52:21.400880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T16:30:17.573588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"254'72","reported_seq":611,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:39.489286+0000","last_change":"2024-06-04T15:52:36.485796+0000","last_active":"2024-06-04T16:22:39.489286+0000","last_peered":"2024-06-04T16:22:39.489286+0000","last_clean":"2024-06-04T16:22:39.489286+0000","last_became_active":"2024-06-04T15:52:36.485475+0000","last_became_peered":"2024-06-04T15:52:36.485475+0000","last_unstale":"2024-06-04T16:22:39.489286+0000","last_undegraded":"2024-06-04T16:22:39.489286+0000","last_fullsized":"2024-06-04T16:22:39.489286+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T22:10:16.220150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":109,"num_read_kb":62832,"num_write":269,"num_write_kb":45136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,2],"acting":[5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"26'1","reported_seq":476,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:40.121529+0000","last_change":"2024-06-04T15:52:40.486597+0000","last_active":"2024-06-04T16:18:40.121529+0000","last_peered":"2024-06-04T16:18:40.121529+0000","last_clean":"2024-06-04T16:18:40.121529+0000","last_became_active":"2024-06-04T15:52:40.486003+0000","last_became_peered":"2024-06-04T15:52:40.486003+0000","last_unstale":"2024-06-04T16:18:40.121529+0000","last_undegraded":"2024-06-04T16:18:40.121529+0000","last_fullsized":"2024-06-04T16:18:40.121529+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_clean_scrub_stamp":"2024-06-04T15:52:39.463103+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T00:11:15.750860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"254'117","reported_seq":991,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:29.585274+0000","last_change":"2024-06-04T15:52:42.505519+0000","last_active":"2024-06-04T16:22:29.585274+0000","last_peered":"2024-06-04T16:22:29.585274+0000","last_clean":"2024-06-04T16:22:29.585274+0000","last_became_active":"2024-06-04T15:52:42.505250+0000","last_became_peered":"2024-06-04T15:52:42.505250+0000","last_unstale":"2024-06-04T16:22:29.585274+0000","last_undegraded":"2024-06-04T16:22:29.585274+0000","last_fullsized":"2024-06-04T16:22:29.585274+0000","mapping_epoch":27,"log_start":"251'100","ondisk_log_start":"251'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_clean_scrub_stamp":"2024-06-04T15:52:41.476734+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T23:03:14.546926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":113,"num_read_kb":103,"num_write":67,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":468,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:50.018609+0000","last_change":"2024-06-04T15:52:44.522460+0000","last_active":"2024-06-04T16:19:50.018609+0000","last_peered":"2024-06-04T16:19:50.018609+0000","last_clean":"2024-06-04T16:19:50.018609+0000","last_became_active":"2024-06-04T15:52:44.522168+0000","last_became_peered":"2024-06-04T15:52:44.522168+0000","last_unstale":"2024-06-04T16:19:50.018609+0000","last_undegraded":"2024-06-04T16:19:50.018609+0000","last_fullsized":"2024-06-04T16:19:50.018609+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_clean_scrub_stamp":"2024-06-04T15:52:43.492872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T20:17:24.091454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.b","version":"254'111","reported_seq":601,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:50.018584+0000","last_change":"2024-06-04T15:52:46.537611+0000","last_active":"2024-06-04T16:19:50.018584+0000","last_peered":"2024-06-04T16:19:50.018584+0000","last_clean":"2024-06-04T16:19:50.018584+0000","last_became_active":"2024-06-04T15:52:46.537377+0000","last_became_peered":"2024-06-04T15:52:46.537377+0000","last_unstale":"2024-06-04T16:19:50.018584+0000","last_undegraded":"2024-06-04T16:19:50.018584+0000","last_fullsized":"2024-06-04T16:19:50.018584+0000","mapping_epoch":31,"log_start":"251'100","ondisk_log_start":"251'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:45.513877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:45.513877+0000","last_clean_scrub_stamp":"2024-06-04T15:52:45.513877+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":100,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T22:06:04.608286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":232,"num_read_kb":256,"num_write":227,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.6","version":"254'74","reported_seq":765,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:40.009736+0000","last_change":"2024-06-04T15:52:38.487720+0000","last_active":"2024-06-04T16:18:40.009736+0000","last_peered":"2024-06-04T16:18:40.009736+0000","last_clean":"2024-06-04T16:18:40.009736+0000","last_became_active":"2024-06-04T15:52:38.487359+0000","last_became_peered":"2024-06-04T15:52:38.487359+0000","last_unstale":"2024-06-04T16:18:40.009736+0000","last_undegraded":"2024-06-04T16:18:40.009736+0000","last_fullsized":"2024-06-04T16:18:40.009736+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T16:18:23.773829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":431,"num_read_kb":414,"num_write":84,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":494,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:30.015833+0000","last_change":"2024-06-04T15:52:22.423963+0000","last_active":"2024-06-04T16:19:30.015833+0000","last_peered":"2024-06-04T16:19:30.015833+0000","last_clean":"2024-06-04T16:19:30.015833+0000","last_became_active":"2024-06-04T15:52:22.423712+0000","last_became_peered":"2024-06-04T15:52:22.423712+0000","last_unstale":"2024-06-04T16:19:30.015833+0000","last_undegraded":"2024-06-04T16:19:30.015833+0000","last_fullsized":"2024-06-04T16:19:30.015833+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:21.400880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:21.400880+0000","last_clean_scrub_stamp":"2024-06-04T15:52:21.400880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T02:49:57.732530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"17'72","reported_seq":584,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:20:30.020067+0000","last_change":"2024-06-04T15:52:22.429522+0000","last_active":"2024-06-04T16:20:30.020067+0000","last_peered":"2024-06-04T16:20:30.020067+0000","last_clean":"2024-06-04T16:20:30.020067+0000","last_became_active":"2024-06-04T15:52:22.428356+0000","last_became_peered":"2024-06-04T15:52:22.428356+0000","last_unstale":"2024-06-04T16:20:30.020067+0000","last_undegraded":"2024-06-04T16:20:30.020067+0000","last_fullsized":"2024-06-04T16:20:30.020067+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:21.400880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:21.400880+0000","last_clean_scrub_stamp":"2024-06-04T15:52:21.400880+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T18:42:36.118905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"254'72","reported_seq":580,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:45.017581+0000","last_change":"2024-06-04T15:52:36.488969+0000","last_active":"2024-06-04T16:19:45.017581+0000","last_peered":"2024-06-04T16:19:45.017581+0000","last_clean":"2024-06-04T16:19:45.017581+0000","last_became_active":"2024-06-04T15:52:36.488567+0000","last_became_peered":"2024-06-04T15:52:36.488567+0000","last_unstale":"2024-06-04T16:19:45.017581+0000","last_undegraded":"2024-06-04T16:19:45.017581+0000","last_fullsized":"2024-06-04T16:19:45.017581+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T22:39:10.146956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133705,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":100,"num_read_kb":15171,"num_write":323,"num_write_kb":30782,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,4],"acting":[6,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":474,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:40.007854+0000","last_change":"2024-06-04T15:52:40.479422+0000","last_active":"2024-06-04T16:18:40.007854+0000","last_peered":"2024-06-04T16:18:40.007854+0000","last_clean":"2024-06-04T16:18:40.007854+0000","last_became_active":"2024-06-04T15:52:40.479168+0000","last_became_peered":"2024-06-04T15:52:40.479168+0000","last_unstale":"2024-06-04T16:18:40.007854+0000","last_undegraded":"2024-06-04T16:18:40.007854+0000","last_fullsized":"2024-06-04T16:18:40.007854+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_clean_scrub_stamp":"2024-06-04T15:52:39.463103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T20:31:07.436900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"254'560","reported_seq":1737,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:39.516609+0000","last_change":"2024-06-04T15:52:42.503507+0000","last_active":"2024-06-04T16:22:39.516609+0000","last_peered":"2024-06-04T16:22:39.516609+0000","last_clean":"2024-06-04T16:22:39.516609+0000","last_became_active":"2024-06-04T15:52:42.503178+0000","last_became_peered":"2024-06-04T15:52:42.503178+0000","last_unstale":"2024-06-04T16:22:39.516609+0000","last_undegraded":"2024-06-04T16:22:39.516609+0000","last_fullsized":"2024-06-04T16:22:39.516609+0000","mapping_epoch":27,"log_start":"251'500","ondisk_log_start":"251'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_clean_scrub_stamp":"2024-06-04T15:52:41.476734+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":500,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T20:05:37.750208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29662,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":838,"num_read_kb":1049,"num_write":188,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":467,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:55.016249+0000","last_change":"2024-06-04T15:52:44.523212+0000","last_active":"2024-06-04T16:19:55.016249+0000","last_peered":"2024-06-04T16:19:55.016249+0000","last_clean":"2024-06-04T16:19:55.016249+0000","last_became_active":"2024-06-04T15:52:44.522475+0000","last_became_peered":"2024-06-04T15:52:44.522475+0000","last_unstale":"2024-06-04T16:19:55.016249+0000","last_undegraded":"2024-06-04T16:19:55.016249+0000","last_fullsized":"2024-06-04T16:19:55.016249+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_clean_scrub_stamp":"2024-06-04T15:52:43.492872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T23:00:33.107705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"254'71","reported_seq":556,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:55.011834+0000","last_change":"2024-06-04T15:52:46.542179+0000","last_active":"2024-06-04T16:18:55.011834+0000","last_peered":"2024-06-04T16:18:55.011834+0000","last_clean":"2024-06-04T16:18:55.011834+0000","last_became_active":"2024-06-04T15:52:46.541851+0000","last_became_peered":"2024-06-04T15:52:46.541851+0000","last_unstale":"2024-06-04T16:18:55.011834+0000","last_undegraded":"2024-06-04T16:18:55.011834+0000","last_fullsized":"2024-06-04T16:18:55.011834+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:45.513877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:45.513877+0000","last_clean_scrub_stamp":"2024-06-04T15:52:45.513877+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T00:45:41.120418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":147,"num_read_kb":147,"num_write":159,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1","version":"254'115","reported_seq":812,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:45.010653+0000","last_change":"2024-06-04T15:52:38.485610+0000","last_active":"2024-06-04T16:19:45.010653+0000","last_peered":"2024-06-04T16:19:45.010653+0000","last_clean":"2024-06-04T16:19:45.010653+0000","last_became_active":"2024-06-04T15:52:38.485314+0000","last_became_peered":"2024-06-04T15:52:38.485314+0000","last_unstale":"2024-06-04T16:19:45.010653+0000","last_undegraded":"2024-06-04T16:19:45.010653+0000","last_fullsized":"2024-06-04T16:19:45.010653+0000","mapping_epoch":23,"log_start":"251'100","ondisk_log_start":"251'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":100,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T18:49:42.990690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":554,"num_read_kb":505,"num_write":149,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"251'78","reported_seq":587,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:40.009180+0000","last_change":"2024-06-04T15:52:36.479114+0000","last_active":"2024-06-04T16:18:40.009180+0000","last_peered":"2024-06-04T16:18:40.009180+0000","last_clean":"2024-06-04T16:18:40.009180+0000","last_became_active":"2024-06-04T15:52:36.478729+0000","last_became_peered":"2024-06-04T15:52:36.478729+0000","last_unstale":"2024-06-04T16:18:40.009180+0000","last_undegraded":"2024-06-04T16:18:40.009180+0000","last_fullsized":"2024-06-04T16:18:40.009180+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T01:31:26.285385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6659325,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":108,"num_read_kb":2222,"num_write":295,"num_write_kb":32111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,1],"acting":[4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":494,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:30.128608+0000","last_change":"2024-06-04T15:52:22.429208+0000","last_active":"2024-06-04T16:19:30.128608+0000","last_peered":"2024-06-04T16:19:30.128608+0000","last_clean":"2024-06-04T16:19:30.128608+0000","last_became_active":"2024-06-04T15:52:22.428894+0000","last_became_peered":"2024-06-04T15:52:22.428894+0000","last_unstale":"2024-06-04T16:19:30.128608+0000","last_undegraded":"2024-06-04T16:19:30.128608+0000","last_fullsized":"2024-06-04T16:19:30.128608+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:21.400880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:21.400880+0000","last_clean_scrub_stamp":"2024-06-04T15:52:21.400880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T18:26:12.779439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":476,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:45.009808+0000","last_change":"2024-06-04T15:52:40.479253+0000","last_active":"2024-06-04T16:18:45.009808+0000","last_peered":"2024-06-04T16:18:45.009808+0000","last_clean":"2024-06-04T16:18:45.009808+0000","last_became_active":"2024-06-04T15:52:40.478970+0000","last_became_peered":"2024-06-04T15:52:40.478970+0000","last_unstale":"2024-06-04T16:18:45.009808+0000","last_undegraded":"2024-06-04T16:18:45.009808+0000","last_fullsized":"2024-06-04T16:18:45.009808+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_clean_scrub_stamp":"2024-06-04T15:52:39.463103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T00:22:45.981375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"254'255","reported_seq":939,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:39.504167+0000","last_change":"2024-06-04T15:52:42.505691+0000","last_active":"2024-06-04T16:22:39.504167+0000","last_peered":"2024-06-04T16:22:39.504167+0000","last_clean":"2024-06-04T16:22:39.504167+0000","last_became_active":"2024-06-04T15:52:42.504735+0000","last_became_peered":"2024-06-04T15:52:42.504735+0000","last_unstale":"2024-06-04T16:22:39.504167+0000","last_undegraded":"2024-06-04T16:22:39.504167+0000","last_fullsized":"2024-06-04T16:22:39.504167+0000","mapping_epoch":27,"log_start":"251'200","ondisk_log_start":"251'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_clean_scrub_stamp":"2024-06-04T15:52:41.476734+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":200,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T23:26:21.492914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20543,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":406,"num_read_kb":567,"num_write":188,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":468,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:50.018529+0000","last_change":"2024-06-04T15:52:44.523070+0000","last_active":"2024-06-04T16:19:50.018529+0000","last_peered":"2024-06-04T16:19:50.018529+0000","last_clean":"2024-06-04T16:19:50.018529+0000","last_became_active":"2024-06-04T15:52:44.522746+0000","last_became_peered":"2024-06-04T15:52:44.522746+0000","last_unstale":"2024-06-04T16:19:50.018529+0000","last_undegraded":"2024-06-04T16:19:50.018529+0000","last_fullsized":"2024-06-04T16:19:50.018529+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_clean_scrub_stamp":"2024-06-04T15:52:43.492872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T02:29:17.973008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.d","version":"254'26","reported_seq":498,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:50.011272+0000","last_change":"2024-06-04T15:52:46.530753+0000","last_active":"2024-06-04T16:19:50.011272+0000","last_peered":"2024-06-04T16:19:50.011272+0000","last_clean":"2024-06-04T16:19:50.011272+0000","last_became_active":"2024-06-04T15:52:46.530480+0000","last_became_peered":"2024-06-04T15:52:46.530480+0000","last_unstale":"2024-06-04T16:19:50.011272+0000","last_undegraded":"2024-06-04T16:19:50.011272+0000","last_fullsized":"2024-06-04T16:19:50.011272+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:45.513877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:45.513877+0000","last_clean_scrub_stamp":"2024-06-04T15:52:45.513877+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T21:20:10.067602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":260,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":42,"num_read_kb":31,"num_write":58,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"254'173","reported_seq":1002,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:45.009776+0000","last_change":"2024-06-04T15:52:38.485046+0000","last_active":"2024-06-04T16:18:45.009776+0000","last_peered":"2024-06-04T16:18:45.009776+0000","last_clean":"2024-06-04T16:18:45.009776+0000","last_became_active":"2024-06-04T15:52:38.484384+0000","last_became_peered":"2024-06-04T15:52:38.484384+0000","last_unstale":"2024-06-04T16:18:45.009776+0000","last_undegraded":"2024-06-04T16:18:45.009776+0000","last_fullsized":"2024-06-04T16:18:45.009776+0000","mapping_epoch":23,"log_start":"251'100","ondisk_log_start":"251'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":100,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T21:07:28.223775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":881,"num_read_kb":808,"num_write":233,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"251'46","reported_seq":543,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:40.009204+0000","last_change":"2024-06-04T15:52:36.478112+0000","last_active":"2024-06-04T16:18:40.009204+0000","last_peered":"2024-06-04T16:18:40.009204+0000","last_clean":"2024-06-04T16:18:40.009204+0000","last_became_active":"2024-06-04T15:52:36.477622+0000","last_became_peered":"2024-06-04T15:52:36.477622+0000","last_unstale":"2024-06-04T16:18:40.009204+0000","last_undegraded":"2024-06-04T16:18:40.009204+0000","last_fullsized":"2024-06-04T16:18:40.009204+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T20:13:45.546860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":45,"num_write":152,"num_write_kb":28742,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":492,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:35.009750+0000","last_change":"2024-06-04T15:52:22.777104+0000","last_active":"2024-06-04T16:19:35.009750+0000","last_peered":"2024-06-04T16:19:35.009750+0000","last_clean":"2024-06-04T16:19:35.009750+0000","last_became_active":"2024-06-04T15:52:22.776744+0000","last_became_peered":"2024-06-04T15:52:22.776744+0000","last_unstale":"2024-06-04T16:19:35.009750+0000","last_undegraded":"2024-06-04T16:19:35.009750+0000","last_fullsized":"2024-06-04T16:19:35.009750+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:21.400880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:21.400880+0000","last_clean_scrub_stamp":"2024-06-04T15:52:21.400880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T17:51:56.775723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":475,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:45.015027+0000","last_change":"2024-06-04T15:52:40.479829+0000","last_active":"2024-06-04T16:19:45.015027+0000","last_peered":"2024-06-04T16:19:45.015027+0000","last_clean":"2024-06-04T16:19:45.015027+0000","last_became_active":"2024-06-04T15:52:40.479319+0000","last_became_peered":"2024-06-04T15:52:40.479319+0000","last_unstale":"2024-06-04T16:19:45.015027+0000","last_undegraded":"2024-06-04T16:19:45.015027+0000","last_fullsized":"2024-06-04T16:19:45.015027+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_clean_scrub_stamp":"2024-06-04T15:52:39.463103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T19:40:34.615992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"251'66","reported_seq":567,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:50.015638+0000","last_change":"2024-06-04T15:52:42.500455+0000","last_active":"2024-06-04T16:19:50.015638+0000","last_peered":"2024-06-04T16:19:50.015638+0000","last_clean":"2024-06-04T16:19:50.015638+0000","last_became_active":"2024-06-04T15:52:42.500141+0000","last_became_peered":"2024-06-04T15:52:42.500141+0000","last_unstale":"2024-06-04T16:19:50.015638+0000","last_undegraded":"2024-06-04T16:19:50.015638+0000","last_fullsized":"2024-06-04T16:19:50.015638+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_clean_scrub_stamp":"2024-06-04T15:52:41.476734+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T19:52:33.859931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":90,"num_read_kb":83,"num_write":60,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"254'479","reported_seq":1474,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:39.362413+0000","last_change":"2024-06-04T15:52:44.517489+0000","last_active":"2024-06-04T16:22:39.362413+0000","last_peered":"2024-06-04T16:22:39.362413+0000","last_clean":"2024-06-04T16:22:39.362413+0000","last_became_active":"2024-06-04T15:52:44.517202+0000","last_became_peered":"2024-06-04T15:52:44.517202+0000","last_unstale":"2024-06-04T16:22:39.362413+0000","last_undegraded":"2024-06-04T16:22:39.362413+0000","last_fullsized":"2024-06-04T16:22:39.362413+0000","mapping_epoch":29,"log_start":"251'400","ondisk_log_start":"251'400","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_clean_scrub_stamp":"2024-06-04T15:52:43.492872+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":400,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T18:33:54.152070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.c","version":"254'27","reported_seq":495,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:50.019201+0000","last_change":"2024-06-04T15:52:46.539323+0000","last_active":"2024-06-04T16:19:50.019201+0000","last_peered":"2024-06-04T16:19:50.019201+0000","last_clean":"2024-06-04T16:19:50.019201+0000","last_became_active":"2024-06-04T15:52:46.538975+0000","last_became_peered":"2024-06-04T15:52:46.538975+0000","last_unstale":"2024-06-04T16:19:50.019201+0000","last_undegraded":"2024-06-04T16:19:50.019201+0000","last_fullsized":"2024-06-04T16:19:50.019201+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:45.513877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:45.513877+0000","last_clean_scrub_stamp":"2024-06-04T15:52:45.513877+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T19:08:40.491462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":27,"num_write":64,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3","version":"254'179","reported_seq":1065,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:45.017635+0000","last_change":"2024-06-04T15:52:38.483119+0000","last_active":"2024-06-04T16:19:45.017635+0000","last_peered":"2024-06-04T16:19:45.017635+0000","last_clean":"2024-06-04T16:19:45.017635+0000","last_became_active":"2024-06-04T15:52:38.482240+0000","last_became_peered":"2024-06-04T15:52:38.482240+0000","last_unstale":"2024-06-04T16:19:45.017635+0000","last_undegraded":"2024-06-04T16:19:45.017635+0000","last_fullsized":"2024-06-04T16:19:45.017635+0000","mapping_epoch":23,"log_start":"251'100","ondisk_log_start":"251'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":100,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T17:54:39.066445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1045,"num_read_kb":968,"num_write":230,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"251'34","reported_seq":524,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:45.017653+0000","last_change":"2024-06-04T15:52:36.478791+0000","last_active":"2024-06-04T16:19:45.017653+0000","last_peered":"2024-06-04T16:19:45.017653+0000","last_clean":"2024-06-04T16:19:45.017653+0000","last_became_active":"2024-06-04T15:52:36.478441+0000","last_became_peered":"2024-06-04T15:52:36.478441+0000","last_unstale":"2024-06-04T16:19:45.017653+0000","last_undegraded":"2024-06-04T16:19:45.017653+0000","last_fullsized":"2024-06-04T16:19:45.017653+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T20:43:41.486063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":32,"num_read_kb":7500,"num_write":131,"num_write_kb":23723,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,4],"acting":[6,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":493,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:20:30.020164+0000","last_change":"2024-06-04T15:52:22.777126+0000","last_active":"2024-06-04T16:20:30.020164+0000","last_peered":"2024-06-04T16:20:30.020164+0000","last_clean":"2024-06-04T16:20:30.020164+0000","last_became_active":"2024-06-04T15:52:22.776729+0000","last_became_peered":"2024-06-04T15:52:22.776729+0000","last_unstale":"2024-06-04T16:20:30.020164+0000","last_undegraded":"2024-06-04T16:20:30.020164+0000","last_fullsized":"2024-06-04T16:20:30.020164+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:21.400880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:21.400880+0000","last_clean_scrub_stamp":"2024-06-04T15:52:21.400880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T03:08:22.360737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":478,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:45.010094+0000","last_change":"2024-06-04T15:52:40.482239+0000","last_active":"2024-06-04T16:19:45.010094+0000","last_peered":"2024-06-04T16:19:45.010094+0000","last_clean":"2024-06-04T16:19:45.010094+0000","last_became_active":"2024-06-04T15:52:40.481870+0000","last_became_peered":"2024-06-04T15:52:40.481870+0000","last_unstale":"2024-06-04T16:19:45.010094+0000","last_undegraded":"2024-06-04T16:19:45.010094+0000","last_fullsized":"2024-06-04T16:19:45.010094+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_clean_scrub_stamp":"2024-06-04T15:52:39.463103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T22:10:27.168145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"254'99","reported_seq":618,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:50.018377+0000","last_change":"2024-06-04T15:52:42.502041+0000","last_active":"2024-06-04T16:19:50.018377+0000","last_peered":"2024-06-04T16:19:50.018377+0000","last_clean":"2024-06-04T16:19:50.018377+0000","last_became_active":"2024-06-04T15:52:42.501708+0000","last_became_peered":"2024-06-04T15:52:42.501708+0000","last_unstale":"2024-06-04T16:19:50.018377+0000","last_undegraded":"2024-06-04T16:19:50.018377+0000","last_fullsized":"2024-06-04T16:19:50.018377+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_clean_scrub_stamp":"2024-06-04T15:52:41.476734+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T18:42:19.221112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":147,"num_read_kb":140,"num_write":98,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.0","version":"254'470","reported_seq":1648,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:39.357754+0000","last_change":"2024-06-04T15:52:44.517953+0000","last_active":"2024-06-04T16:22:39.357754+0000","last_peered":"2024-06-04T16:22:39.357754+0000","last_clean":"2024-06-04T16:22:39.357754+0000","last_became_active":"2024-06-04T15:52:44.517066+0000","last_became_peered":"2024-06-04T15:52:44.517066+0000","last_unstale":"2024-06-04T16:22:39.357754+0000","last_undegraded":"2024-06-04T16:22:39.357754+0000","last_fullsized":"2024-06-04T16:22:39.357754+0000","mapping_epoch":29,"log_start":"251'400","ondisk_log_start":"251'400","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_clean_scrub_stamp":"2024-06-04T15:52:43.492872+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":400,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T19:11:31.141097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"254'27","reported_seq":493,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:05.151518+0000","last_change":"2024-06-04T15:52:46.532254+0000","last_active":"2024-06-04T16:22:05.151518+0000","last_peered":"2024-06-04T16:22:05.151518+0000","last_clean":"2024-06-04T16:22:05.151518+0000","last_became_active":"2024-06-04T15:52:46.531967+0000","last_became_peered":"2024-06-04T15:52:46.531967+0000","last_unstale":"2024-06-04T16:22:05.151518+0000","last_undegraded":"2024-06-04T16:22:05.151518+0000","last_fullsized":"2024-06-04T16:22:05.151518+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:45.513877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:45.513877+0000","last_clean_scrub_stamp":"2024-06-04T15:52:45.513877+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T21:57:32.068478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":905,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":28,"num_read_kb":26,"num_write":64,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2","version":"254'131","reported_seq":930,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:45.017599+0000","last_change":"2024-06-04T15:52:38.481406+0000","last_active":"2024-06-04T16:19:45.017599+0000","last_peered":"2024-06-04T16:19:45.017599+0000","last_clean":"2024-06-04T16:19:45.017599+0000","last_became_active":"2024-06-04T15:52:38.480942+0000","last_became_peered":"2024-06-04T15:52:38.480942+0000","last_unstale":"2024-06-04T16:19:45.017599+0000","last_undegraded":"2024-06-04T16:19:45.017599+0000","last_fullsized":"2024-06-04T16:19:45.017599+0000","mapping_epoch":23,"log_start":"251'100","ondisk_log_start":"251'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T20:49:38.683287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":705,"num_read_kb":672,"num_write":147,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"251'54","reported_seq":559,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:50.011302+0000","last_change":"2024-06-04T15:52:36.484356+0000","last_active":"2024-06-04T16:19:50.011302+0000","last_peered":"2024-06-04T16:19:50.011302+0000","last_clean":"2024-06-04T16:19:50.011302+0000","last_became_active":"2024-06-04T15:52:36.480469+0000","last_became_peered":"2024-06-04T15:52:36.480469+0000","last_unstale":"2024-06-04T16:19:50.011302+0000","last_undegraded":"2024-06-04T16:19:50.011302+0000","last_fullsized":"2024-06-04T16:19:50.011302+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T23:54:02.222955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":69,"num_read_kb":32811,"num_write":225,"num_write_kb":30438,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,4],"acting":[2,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":494,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:25.112378+0000","last_change":"2024-06-04T15:52:22.777053+0000","last_active":"2024-06-04T16:18:25.112378+0000","last_peered":"2024-06-04T16:18:25.112378+0000","last_clean":"2024-06-04T16:18:25.112378+0000","last_became_active":"2024-06-04T15:52:22.776723+0000","last_became_peered":"2024-06-04T15:52:22.776723+0000","last_unstale":"2024-06-04T16:18:25.112378+0000","last_undegraded":"2024-06-04T16:18:25.112378+0000","last_fullsized":"2024-06-04T16:18:25.112378+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:21.400880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:21.400880+0000","last_clean_scrub_stamp":"2024-06-04T15:52:21.400880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T02:40:05.098206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":476,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:45.017841+0000","last_change":"2024-06-04T15:52:40.484565+0000","last_active":"2024-06-04T16:19:45.017841+0000","last_peered":"2024-06-04T16:19:45.017841+0000","last_clean":"2024-06-04T16:19:45.017841+0000","last_became_active":"2024-06-04T15:52:40.483802+0000","last_became_peered":"2024-06-04T15:52:40.483802+0000","last_unstale":"2024-06-04T16:19:45.017841+0000","last_undegraded":"2024-06-04T16:19:45.017841+0000","last_fullsized":"2024-06-04T16:19:45.017841+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_clean_scrub_stamp":"2024-06-04T15:52:39.463103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T18:37:27.476845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"254'201","reported_seq":826,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:39.570115+0000","last_change":"2024-06-04T15:52:42.499319+0000","last_active":"2024-06-04T16:22:39.570115+0000","last_peered":"2024-06-04T16:22:39.570115+0000","last_clean":"2024-06-04T16:22:39.570115+0000","last_became_active":"2024-06-04T15:52:42.499002+0000","last_became_peered":"2024-06-04T15:52:42.499002+0000","last_unstale":"2024-06-04T16:22:39.570115+0000","last_undegraded":"2024-06-04T16:22:39.570115+0000","last_fullsized":"2024-06-04T16:22:39.570115+0000","mapping_epoch":27,"log_start":"251'100","ondisk_log_start":"251'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_clean_scrub_stamp":"2024-06-04T15:52:41.476734+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":100,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T03:36:55.807593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20869,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":311,"num_read_kb":405,"num_write":154,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":466,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:50.011194+0000","last_change":"2024-06-04T15:52:44.520800+0000","last_active":"2024-06-04T16:19:50.011194+0000","last_peered":"2024-06-04T16:19:50.011194+0000","last_clean":"2024-06-04T16:19:50.011194+0000","last_became_active":"2024-06-04T15:52:44.520499+0000","last_became_peered":"2024-06-04T15:52:44.520499+0000","last_unstale":"2024-06-04T16:19:50.011194+0000","last_undegraded":"2024-06-04T16:19:50.011194+0000","last_fullsized":"2024-06-04T16:19:50.011194+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_clean_scrub_stamp":"2024-06-04T15:52:43.492872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T01:16:43.243739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"254'25","reported_seq":498,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:50.019241+0000","last_change":"2024-06-04T15:52:46.542360+0000","last_active":"2024-06-04T16:19:50.019241+0000","last_peered":"2024-06-04T16:19:50.019241+0000","last_clean":"2024-06-04T16:19:50.019241+0000","last_became_active":"2024-06-04T15:52:46.541768+0000","last_became_peered":"2024-06-04T15:52:46.541768+0000","last_unstale":"2024-06-04T16:19:50.019241+0000","last_undegraded":"2024-06-04T16:19:50.019241+0000","last_fullsized":"2024-06-04T16:19:50.019241+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:45.513877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:45.513877+0000","last_clean_scrub_stamp":"2024-06-04T15:52:45.513877+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T20:45:40.593310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":34,"num_write":60,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"254'24","reported_seq":489,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:55.019539+0000","last_change":"2024-06-04T15:52:46.541003+0000","last_active":"2024-06-04T16:19:55.019539+0000","last_peered":"2024-06-04T16:19:55.019539+0000","last_clean":"2024-06-04T16:19:55.019539+0000","last_became_active":"2024-06-04T15:52:46.540733+0000","last_became_peered":"2024-06-04T15:52:46.540733+0000","last_unstale":"2024-06-04T16:19:55.019539+0000","last_undegraded":"2024-06-04T16:19:55.019539+0000","last_fullsized":"2024-06-04T16:19:55.019539+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:45.513877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:45.513877+0000","last_clean_scrub_stamp":"2024-06-04T15:52:45.513877+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T23:13:36.615780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":53,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"254'151","reported_seq":916,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:22.092985+0000","last_change":"2024-06-04T15:52:38.480198+0000","last_active":"2024-06-04T16:18:22.092985+0000","last_peered":"2024-06-04T16:18:22.092985+0000","last_clean":"2024-06-04T16:18:22.092985+0000","last_became_active":"2024-06-04T15:52:38.479929+0000","last_became_peered":"2024-06-04T15:52:38.479929+0000","last_unstale":"2024-06-04T16:18:22.092985+0000","last_undegraded":"2024-06-04T16:18:22.092985+0000","last_fullsized":"2024-06-04T16:18:22.092985+0000","mapping_epoch":23,"log_start":"251'100","ondisk_log_start":"251'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":100,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T18:53:28.230708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":770,"num_read_kb":699,"num_write":204,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"251'34","reported_seq":545,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:25.005933+0000","last_change":"2024-06-04T15:52:36.497838+0000","last_active":"2024-06-04T16:18:25.005933+0000","last_peered":"2024-06-04T16:18:25.005933+0000","last_clean":"2024-06-04T16:18:25.005933+0000","last_became_active":"2024-06-04T15:52:36.497532+0000","last_became_peered":"2024-06-04T15:52:36.497532+0000","last_unstale":"2024-06-04T16:18:25.005933+0000","last_undegraded":"2024-06-04T16:18:25.005933+0000","last_fullsized":"2024-06-04T16:18:25.005933+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T16:03:02.229193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":54,"num_read_kb":42110,"num_write":160,"num_write_kb":16147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":470,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:20.006124+0000","last_change":"2024-06-04T15:52:40.484157+0000","last_active":"2024-06-04T16:18:20.006124+0000","last_peered":"2024-06-04T16:18:20.006124+0000","last_clean":"2024-06-04T16:18:20.006124+0000","last_became_active":"2024-06-04T15:52:40.483882+0000","last_became_peered":"2024-06-04T15:52:40.483882+0000","last_unstale":"2024-06-04T16:18:20.006124+0000","last_undegraded":"2024-06-04T16:18:20.006124+0000","last_fullsized":"2024-06-04T16:18:20.006124+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_clean_scrub_stamp":"2024-06-04T15:52:39.463103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T16:24:11.194485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.11","version":"254'96","reported_seq":634,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:39.528247+0000","last_change":"2024-06-04T15:52:42.504482+0000","last_active":"2024-06-04T16:22:39.528247+0000","last_peered":"2024-06-04T16:22:39.528247+0000","last_clean":"2024-06-04T16:22:39.528247+0000","last_became_active":"2024-06-04T15:52:42.504144+0000","last_became_peered":"2024-06-04T15:52:42.504144+0000","last_unstale":"2024-06-04T16:22:39.528247+0000","last_undegraded":"2024-06-04T16:22:39.528247+0000","last_fullsized":"2024-06-04T16:22:39.528247+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_clean_scrub_stamp":"2024-06-04T15:52:41.476734+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T18:40:42.712100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13519,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":145,"num_read_kb":205,"num_write":70,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":466,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:25.119072+0000","last_change":"2024-06-04T15:52:44.517996+0000","last_active":"2024-06-04T16:18:25.119072+0000","last_peered":"2024-06-04T16:18:25.119072+0000","last_clean":"2024-06-04T16:18:25.119072+0000","last_became_active":"2024-06-04T15:52:44.517718+0000","last_became_peered":"2024-06-04T15:52:44.517718+0000","last_unstale":"2024-06-04T16:18:25.119072+0000","last_undegraded":"2024-06-04T16:18:25.119072+0000","last_fullsized":"2024-06-04T16:18:25.119072+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_clean_scrub_stamp":"2024-06-04T15:52:43.492872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T16:20:37.573553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1e","version":"254'42","reported_seq":511,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:50.123024+0000","last_change":"2024-06-04T15:52:46.537867+0000","last_active":"2024-06-04T16:18:50.123024+0000","last_peered":"2024-06-04T16:18:50.123024+0000","last_clean":"2024-06-04T16:18:50.123024+0000","last_became_active":"2024-06-04T15:52:46.536917+0000","last_became_peered":"2024-06-04T15:52:46.536917+0000","last_unstale":"2024-06-04T16:18:50.123024+0000","last_undegraded":"2024-06-04T16:18:50.123024+0000","last_fullsized":"2024-06-04T16:18:50.123024+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:45.513877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:45.513877+0000","last_clean_scrub_stamp":"2024-06-04T15:52:45.513877+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T01:16:32.378412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":42,"num_write":101,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"254'151","reported_seq":983,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:22.327242+0000","last_change":"2024-06-04T15:52:38.488440+0000","last_active":"2024-06-04T16:18:22.327242+0000","last_peered":"2024-06-04T16:18:22.327242+0000","last_clean":"2024-06-04T16:18:22.327242+0000","last_became_active":"2024-06-04T15:52:38.488159+0000","last_became_peered":"2024-06-04T15:52:38.488159+0000","last_unstale":"2024-06-04T16:18:22.327242+0000","last_undegraded":"2024-06-04T16:18:22.327242+0000","last_fullsized":"2024-06-04T16:18:22.327242+0000","mapping_epoch":23,"log_start":"251'100","ondisk_log_start":"251'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":100,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T21:49:36.508131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":952,"num_read_kb":891,"num_write":194,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.15","version":"251'69","reported_seq":603,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:15.007185+0000","last_change":"2024-06-04T15:52:36.492824+0000","last_active":"2024-06-04T16:19:15.007185+0000","last_peered":"2024-06-04T16:19:15.007185+0000","last_clean":"2024-06-04T16:19:15.007185+0000","last_became_active":"2024-06-04T15:52:36.492503+0000","last_became_peered":"2024-06-04T15:52:36.492503+0000","last_unstale":"2024-06-04T16:19:15.007185+0000","last_undegraded":"2024-06-04T16:19:15.007185+0000","last_fullsized":"2024-06-04T16:19:15.007185+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T02:41:20.493195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":528536,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":128,"num_read_kb":6583,"num_write":319,"num_write_kb":16503,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,3],"acting":[0,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":474,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:20.006632+0000","last_change":"2024-06-04T15:52:40.484769+0000","last_active":"2024-06-04T16:18:20.006632+0000","last_peered":"2024-06-04T16:18:20.006632+0000","last_clean":"2024-06-04T16:18:20.006632+0000","last_became_active":"2024-06-04T15:52:40.484480+0000","last_became_peered":"2024-06-04T15:52:40.484480+0000","last_unstale":"2024-06-04T16:18:20.006632+0000","last_undegraded":"2024-06-04T16:18:20.006632+0000","last_fullsized":"2024-06-04T16:18:20.006632+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_clean_scrub_stamp":"2024-06-04T15:52:39.463103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T22:51:50.840432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"251'18","reported_seq":494,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:25.007177+0000","last_change":"2024-06-04T15:52:42.499940+0000","last_active":"2024-06-04T16:18:25.007177+0000","last_peered":"2024-06-04T16:18:25.007177+0000","last_clean":"2024-06-04T16:18:25.007177+0000","last_became_active":"2024-06-04T15:52:42.499592+0000","last_became_peered":"2024-06-04T15:52:42.499592+0000","last_unstale":"2024-06-04T16:18:25.007177+0000","last_undegraded":"2024-06-04T16:18:25.007177+0000","last_fullsized":"2024-06-04T16:18:25.007177+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_clean_scrub_stamp":"2024-06-04T15:52:41.476734+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T18:27:38.404606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":19,"num_read_kb":17,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":464,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:25.002431+0000","last_change":"2024-06-04T15:52:44.519396+0000","last_active":"2024-06-04T16:18:25.002431+0000","last_peered":"2024-06-04T16:18:25.002431+0000","last_clean":"2024-06-04T16:18:25.002431+0000","last_became_active":"2024-06-04T15:52:44.519102+0000","last_became_peered":"2024-06-04T15:52:44.519102+0000","last_unstale":"2024-06-04T16:18:25.002431+0000","last_undegraded":"2024-06-04T16:18:25.002431+0000","last_fullsized":"2024-06-04T16:18:25.002431+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_clean_scrub_stamp":"2024-06-04T15:52:43.492872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T23:01:48.911900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"254'24","reported_seq":490,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:21.701306+0000","last_change":"2024-06-04T15:52:46.534720+0000","last_active":"2024-06-04T16:18:21.701306+0000","last_peered":"2024-06-04T16:18:21.701306+0000","last_clean":"2024-06-04T16:18:21.701306+0000","last_became_active":"2024-06-04T15:52:46.534277+0000","last_became_peered":"2024-06-04T15:52:46.534277+0000","last_unstale":"2024-06-04T16:18:21.701306+0000","last_undegraded":"2024-06-04T16:18:21.701306+0000","last_fullsized":"2024-06-04T16:18:21.701306+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:45.513877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:45.513877+0000","last_clean_scrub_stamp":"2024-06-04T15:52:45.513877+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T19:20:11.363716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":38,"num_write":55,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"254'221","reported_seq":1035,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:22.093247+0000","last_change":"2024-06-04T15:52:38.482192+0000","last_active":"2024-06-04T16:18:22.093247+0000","last_peered":"2024-06-04T16:18:22.093247+0000","last_clean":"2024-06-04T16:18:22.093247+0000","last_became_active":"2024-06-04T15:52:38.481934+0000","last_became_peered":"2024-06-04T15:52:38.481934+0000","last_unstale":"2024-06-04T16:18:22.093247+0000","last_undegraded":"2024-06-04T16:18:22.093247+0000","last_fullsized":"2024-06-04T16:18:22.093247+0000","mapping_epoch":23,"log_start":"251'200","ondisk_log_start":"251'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":200,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T22:42:27.546656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1128,"num_read_kb":983,"num_write":320,"num_write_kb":131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.16","version":"251'39","reported_seq":528,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:15.007814+0000","last_change":"2024-06-04T15:52:36.481215+0000","last_active":"2024-06-04T16:19:15.007814+0000","last_peered":"2024-06-04T16:19:15.007814+0000","last_clean":"2024-06-04T16:19:15.007814+0000","last_became_active":"2024-06-04T15:52:36.480284+0000","last_became_peered":"2024-06-04T15:52:36.480284+0000","last_unstale":"2024-06-04T16:19:15.007814+0000","last_undegraded":"2024-06-04T16:19:15.007814+0000","last_fullsized":"2024-06-04T16:19:15.007814+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T02:23:34.817120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":37,"num_read_kb":1062,"num_write":155,"num_write_kb":20099,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4],"acting":[2,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":472,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:20.001825+0000","last_change":"2024-06-04T15:52:40.477894+0000","last_active":"2024-06-04T16:18:20.001825+0000","last_peered":"2024-06-04T16:18:20.001825+0000","last_clean":"2024-06-04T16:18:20.001825+0000","last_became_active":"2024-06-04T15:52:40.477609+0000","last_became_peered":"2024-06-04T15:52:40.477609+0000","last_unstale":"2024-06-04T16:18:20.001825+0000","last_undegraded":"2024-06-04T16:18:20.001825+0000","last_fullsized":"2024-06-04T16:18:20.001825+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_clean_scrub_stamp":"2024-06-04T15:52:39.463103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T03:11:16.123786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"254'133","reported_seq":690,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:39.480142+0000","last_change":"2024-06-04T15:52:42.496760+0000","last_active":"2024-06-04T16:22:39.480142+0000","last_peered":"2024-06-04T16:22:39.480142+0000","last_clean":"2024-06-04T16:22:39.480142+0000","last_became_active":"2024-06-04T15:52:42.496416+0000","last_became_peered":"2024-06-04T15:52:42.496416+0000","last_unstale":"2024-06-04T16:22:39.480142+0000","last_undegraded":"2024-06-04T16:22:39.480142+0000","last_fullsized":"2024-06-04T16:22:39.480142+0000","mapping_epoch":27,"log_start":"251'100","ondisk_log_start":"251'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_clean_scrub_stamp":"2024-06-04T15:52:41.476734+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":100,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T00:10:25.421866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14747,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":196,"num_read_kb":272,"num_write":106,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":468,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:25.112334+0000","last_change":"2024-06-04T15:52:44.520101+0000","last_active":"2024-06-04T16:18:25.112334+0000","last_peered":"2024-06-04T16:18:25.112334+0000","last_clean":"2024-06-04T16:18:25.112334+0000","last_became_active":"2024-06-04T15:52:44.519837+0000","last_became_peered":"2024-06-04T15:52:44.519837+0000","last_unstale":"2024-06-04T16:18:25.112334+0000","last_undegraded":"2024-06-04T16:18:25.112334+0000","last_fullsized":"2024-06-04T16:18:25.112334+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_clean_scrub_stamp":"2024-06-04T15:52:43.492872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T23:02:15.347544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"254'18","reported_seq":479,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:11.644322+0000","last_change":"2024-06-04T15:52:46.529613+0000","last_active":"2024-06-04T16:18:11.644322+0000","last_peered":"2024-06-04T16:18:11.644322+0000","last_clean":"2024-06-04T16:18:11.644322+0000","last_became_active":"2024-06-04T15:52:46.529366+0000","last_became_peered":"2024-06-04T15:52:46.529366+0000","last_unstale":"2024-06-04T16:18:11.644322+0000","last_undegraded":"2024-06-04T16:18:11.644322+0000","last_fullsized":"2024-06-04T16:18:11.644322+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:45.513877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:45.513877+0000","last_clean_scrub_stamp":"2024-06-04T15:52:45.513877+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T19:51:30.893394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":52,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"254'127","reported_seq":829,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:23.264264+0000","last_change":"2024-06-04T15:52:38.488922+0000","last_active":"2024-06-04T16:18:23.264264+0000","last_peered":"2024-06-04T16:18:23.264264+0000","last_clean":"2024-06-04T16:18:23.264264+0000","last_became_active":"2024-06-04T15:52:38.488622+0000","last_became_peered":"2024-06-04T15:52:38.488622+0000","last_unstale":"2024-06-04T16:18:23.264264+0000","last_undegraded":"2024-06-04T16:18:23.264264+0000","last_fullsized":"2024-06-04T16:18:23.264264+0000","mapping_epoch":23,"log_start":"251'100","ondisk_log_start":"251'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":100,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T19:55:57.502005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":585,"num_read_kb":532,"num_write":156,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"254'50","reported_seq":561,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:21:40.035480+0000","last_change":"2024-06-04T15:52:36.483764+0000","last_active":"2024-06-04T16:21:40.035480+0000","last_peered":"2024-06-04T16:21:40.035480+0000","last_clean":"2024-06-04T16:21:40.035480+0000","last_became_active":"2024-06-04T15:52:36.482733+0000","last_became_peered":"2024-06-04T15:52:36.482733+0000","last_unstale":"2024-06-04T16:21:40.035480+0000","last_undegraded":"2024-06-04T16:21:40.035480+0000","last_fullsized":"2024-06-04T16:21:40.035480+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T18:40:07.443876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133705,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":82,"num_read_kb":13463,"num_write":227,"num_write_kb":36279,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1],"acting":[5,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.11","version":"33'4","reported_seq":779,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:38.924270+0000","last_change":"2024-06-04T15:52:40.479576+0000","last_active":"2024-06-04T16:22:38.924270+0000","last_peered":"2024-06-04T16:22:38.924270+0000","last_clean":"2024-06-04T16:22:38.924270+0000","last_became_active":"2024-06-04T15:52:40.479002+0000","last_became_peered":"2024-06-04T15:52:40.479002+0000","last_unstale":"2024-06-04T16:22:38.924270+0000","last_undegraded":"2024-06-04T16:22:38.924270+0000","last_fullsized":"2024-06-04T16:22:38.924270+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_clean_scrub_stamp":"2024-06-04T15:52:39.463103+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T19:07:30.419008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":463,"num_read_kb":757,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"254'86","reported_seq":627,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:39.464723+0000","last_change":"2024-06-04T15:52:42.506197+0000","last_active":"2024-06-04T16:22:39.464723+0000","last_peered":"2024-06-04T16:22:39.464723+0000","last_clean":"2024-06-04T16:22:39.464723+0000","last_became_active":"2024-06-04T15:52:42.505955+0000","last_became_peered":"2024-06-04T15:52:42.505955+0000","last_unstale":"2024-06-04T16:22:39.464723+0000","last_undegraded":"2024-06-04T16:22:39.464723+0000","last_fullsized":"2024-06-04T16:22:39.464723+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_clean_scrub_stamp":"2024-06-04T15:52:41.476734+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T22:41:05.443654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":128,"num_read_kb":150,"num_write":58,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":466,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:25.119122+0000","last_change":"2024-06-04T15:52:44.520920+0000","last_active":"2024-06-04T16:18:25.119122+0000","last_peered":"2024-06-04T16:18:25.119122+0000","last_clean":"2024-06-04T16:18:25.119122+0000","last_became_active":"2024-06-04T15:52:44.519975+0000","last_became_peered":"2024-06-04T15:52:44.519975+0000","last_unstale":"2024-06-04T16:18:25.119122+0000","last_undegraded":"2024-06-04T16:18:25.119122+0000","last_fullsized":"2024-06-04T16:18:25.119122+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_clean_scrub_stamp":"2024-06-04T15:52:43.492872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T18:00:51.312734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1f","version":"254'93","reported_seq":773,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:45.015161+0000","last_change":"2024-06-04T15:52:38.485442+0000","last_active":"2024-06-04T16:19:45.015161+0000","last_peered":"2024-06-04T16:19:45.015161+0000","last_clean":"2024-06-04T16:19:45.015161+0000","last_became_active":"2024-06-04T15:52:38.485163+0000","last_became_peered":"2024-06-04T15:52:38.485163+0000","last_unstale":"2024-06-04T16:19:45.015161+0000","last_undegraded":"2024-06-04T16:19:45.015161+0000","last_fullsized":"2024-06-04T16:19:45.015161+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T23:56:24.126758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":477,"num_read_kb":443,"num_write":114,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"254'35","reported_seq":537,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:21:40.035318+0000","last_change":"2024-06-04T15:52:36.490918+0000","last_active":"2024-06-04T16:21:40.035318+0000","last_peered":"2024-06-04T16:21:40.035318+0000","last_clean":"2024-06-04T16:21:40.035318+0000","last_became_active":"2024-06-04T15:52:36.490297+0000","last_became_peered":"2024-06-04T15:52:36.490297+0000","last_unstale":"2024-06-04T16:21:40.035318+0000","last_undegraded":"2024-06-04T16:21:40.035318+0000","last_fullsized":"2024-06-04T16:21:40.035318+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T23:35:40.012317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1069164,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":53,"num_read_kb":1061,"num_write":121,"num_write_kb":15390,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,3],"acting":[5,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":472,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:45.009473+0000","last_change":"2024-06-04T15:52:40.483258+0000","last_active":"2024-06-04T16:18:45.009473+0000","last_peered":"2024-06-04T16:18:45.009473+0000","last_clean":"2024-06-04T16:18:45.009473+0000","last_became_active":"2024-06-04T15:52:40.482962+0000","last_became_peered":"2024-06-04T15:52:40.482962+0000","last_unstale":"2024-06-04T16:18:45.009473+0000","last_undegraded":"2024-06-04T16:18:45.009473+0000","last_fullsized":"2024-06-04T16:18:45.009473+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_clean_scrub_stamp":"2024-06-04T15:52:39.463103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T17:22:55.939902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"254'150","reported_seq":744,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:39.560085+0000","last_change":"2024-06-04T15:52:42.504117+0000","last_active":"2024-06-04T16:22:39.560085+0000","last_peered":"2024-06-04T16:22:39.560085+0000","last_clean":"2024-06-04T16:22:39.560085+0000","last_became_active":"2024-06-04T15:52:42.503246+0000","last_became_peered":"2024-06-04T15:52:42.503246+0000","last_unstale":"2024-06-04T16:22:39.560085+0000","last_undegraded":"2024-06-04T16:22:39.560085+0000","last_fullsized":"2024-06-04T16:22:39.560085+0000","mapping_epoch":27,"log_start":"251'100","ondisk_log_start":"251'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_clean_scrub_stamp":"2024-06-04T15:52:41.476734+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":100,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T17:52:54.231259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8493,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":230,"num_read_kb":283,"num_write":98,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":463,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:17:44.997914+0000","last_change":"2024-06-04T15:52:44.518052+0000","last_active":"2024-06-04T16:17:44.997914+0000","last_peered":"2024-06-04T16:17:44.997914+0000","last_clean":"2024-06-04T16:17:44.997914+0000","last_became_active":"2024-06-04T15:52:44.517715+0000","last_became_peered":"2024-06-04T15:52:44.517715+0000","last_unstale":"2024-06-04T16:17:44.997914+0000","last_undegraded":"2024-06-04T16:17:44.997914+0000","last_fullsized":"2024-06-04T16:17:44.997914+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_clean_scrub_stamp":"2024-06-04T15:52:43.492872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T02:22:55.140000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"254'71","reported_seq":549,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:30.008312+0000","last_change":"2024-06-04T15:52:46.538655+0000","last_active":"2024-06-04T16:18:30.008312+0000","last_peered":"2024-06-04T16:18:30.008312+0000","last_clean":"2024-06-04T16:18:30.008312+0000","last_became_active":"2024-06-04T15:52:46.538338+0000","last_became_peered":"2024-06-04T15:52:46.538338+0000","last_unstale":"2024-06-04T16:18:30.008312+0000","last_undegraded":"2024-06-04T16:18:30.008312+0000","last_fullsized":"2024-06-04T16:18:30.008312+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:45.513877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:45.513877+0000","last_clean_scrub_stamp":"2024-06-04T15:52:45.513877+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T01:20:53.919158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1061,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":107,"num_read_kb":120,"num_write":148,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1e","version":"254'145","reported_seq":914,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:45.009948+0000","last_change":"2024-06-04T15:52:38.484537+0000","last_active":"2024-06-04T16:18:45.009948+0000","last_peered":"2024-06-04T16:18:45.009948+0000","last_clean":"2024-06-04T16:18:45.009948+0000","last_became_active":"2024-06-04T15:52:38.484087+0000","last_became_peered":"2024-06-04T15:52:38.484087+0000","last_unstale":"2024-06-04T16:18:45.009948+0000","last_undegraded":"2024-06-04T16:18:45.009948+0000","last_fullsized":"2024-06-04T16:18:45.009948+0000","mapping_epoch":23,"log_start":"251'100","ondisk_log_start":"251'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":100,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T00:25:14.013091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":710,"num_read_kb":650,"num_write":181,"num_write_kb":49,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"251'48","reported_seq":551,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:20.014446+0000","last_change":"2024-06-04T15:52:36.479337+0000","last_active":"2024-06-04T16:19:20.014446+0000","last_peered":"2024-06-04T16:19:20.014446+0000","last_clean":"2024-06-04T16:19:20.014446+0000","last_became_active":"2024-06-04T15:52:36.477626+0000","last_became_peered":"2024-06-04T15:52:36.477626+0000","last_unstale":"2024-06-04T16:19:20.014446+0000","last_undegraded":"2024-06-04T16:19:20.014446+0000","last_fullsized":"2024-06-04T16:19:20.014446+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T17:38:59.206841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20628,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":58,"num_read_kb":9358,"num_write":184,"num_write_kb":22886,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,1],"acting":[4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":474,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:45.010737+0000","last_change":"2024-06-04T15:52:40.484749+0000","last_active":"2024-06-04T16:19:45.010737+0000","last_peered":"2024-06-04T16:19:45.010737+0000","last_clean":"2024-06-04T16:19:45.010737+0000","last_became_active":"2024-06-04T15:52:40.484444+0000","last_became_peered":"2024-06-04T15:52:40.484444+0000","last_unstale":"2024-06-04T16:19:45.010737+0000","last_undegraded":"2024-06-04T16:19:45.010737+0000","last_fullsized":"2024-06-04T16:19:45.010737+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_clean_scrub_stamp":"2024-06-04T15:52:39.463103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T00:27:18.866376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"254'105","reported_seq":651,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:39.467609+0000","last_change":"2024-06-04T15:52:42.498603+0000","last_active":"2024-06-04T16:22:39.467609+0000","last_peered":"2024-06-04T16:22:39.467609+0000","last_clean":"2024-06-04T16:22:39.467609+0000","last_became_active":"2024-06-04T15:52:42.498329+0000","last_became_peered":"2024-06-04T15:52:42.498329+0000","last_unstale":"2024-06-04T16:22:39.467609+0000","last_undegraded":"2024-06-04T16:22:39.467609+0000","last_fullsized":"2024-06-04T16:22:39.467609+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_clean_scrub_stamp":"2024-06-04T15:52:41.476734+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T22:43:07.581595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":167,"num_read_kb":207,"num_write":102,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":467,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:17:45.002004+0000","last_change":"2024-06-04T15:52:44.523780+0000","last_active":"2024-06-04T16:17:45.002004+0000","last_peered":"2024-06-04T16:17:45.002004+0000","last_clean":"2024-06-04T16:17:45.002004+0000","last_became_active":"2024-06-04T15:52:44.523527+0000","last_became_peered":"2024-06-04T15:52:44.523527+0000","last_unstale":"2024-06-04T16:17:45.002004+0000","last_undegraded":"2024-06-04T16:17:45.002004+0000","last_fullsized":"2024-06-04T16:17:45.002004+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_clean_scrub_stamp":"2024-06-04T15:52:43.492872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T03:49:44.080770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.12","version":"254'29","reported_seq":505,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:30.006566+0000","last_change":"2024-06-04T15:52:46.538179+0000","last_active":"2024-06-04T16:18:30.006566+0000","last_peered":"2024-06-04T16:18:30.006566+0000","last_clean":"2024-06-04T16:18:30.006566+0000","last_became_active":"2024-06-04T15:52:46.537899+0000","last_became_peered":"2024-06-04T15:52:46.537899+0000","last_unstale":"2024-06-04T16:18:30.006566+0000","last_undegraded":"2024-06-04T16:18:30.006566+0000","last_fullsized":"2024-06-04T16:18:30.006566+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:45.513877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:45.513877+0000","last_clean_scrub_stamp":"2024-06-04T15:52:45.513877+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T03:08:17.268541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1228,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":67,"num_read_kb":65,"num_write":80,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"254'108","reported_seq":883,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:20:10.134391+0000","last_change":"2024-06-04T15:52:38.481130+0000","last_active":"2024-06-04T16:20:10.134391+0000","last_peered":"2024-06-04T16:20:10.134391+0000","last_clean":"2024-06-04T16:20:10.134391+0000","last_became_active":"2024-06-04T15:52:38.480458+0000","last_became_peered":"2024-06-04T15:52:38.480458+0000","last_unstale":"2024-06-04T16:20:10.134391+0000","last_undegraded":"2024-06-04T16:20:10.134391+0000","last_fullsized":"2024-06-04T16:20:10.134391+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T00:04:51.320929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":731,"num_read_kb":703,"num_write":125,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1a","version":"254'73","reported_seq":586,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:39.497014+0000","last_change":"2024-06-04T15:52:36.478450+0000","last_active":"2024-06-04T16:22:39.497014+0000","last_peered":"2024-06-04T16:22:39.497014+0000","last_clean":"2024-06-04T16:22:39.497014+0000","last_became_active":"2024-06-04T15:52:36.477885+0000","last_became_peered":"2024-06-04T15:52:36.477885+0000","last_unstale":"2024-06-04T16:22:39.497014+0000","last_undegraded":"2024-06-04T16:22:39.497014+0000","last_fullsized":"2024-06-04T16:22:39.497014+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T20:17:02.464903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1395842,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":88,"num_read_kb":3881,"num_write":289,"num_write_kb":29330,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":472,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:20:10.013258+0000","last_change":"2024-06-04T15:52:40.478223+0000","last_active":"2024-06-04T16:20:10.013258+0000","last_peered":"2024-06-04T16:20:10.013258+0000","last_clean":"2024-06-04T16:20:10.013258+0000","last_became_active":"2024-06-04T15:52:40.477924+0000","last_became_peered":"2024-06-04T15:52:40.477924+0000","last_unstale":"2024-06-04T16:20:10.013258+0000","last_undegraded":"2024-06-04T16:20:10.013258+0000","last_fullsized":"2024-06-04T16:20:10.013258+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_clean_scrub_stamp":"2024-06-04T15:52:39.463103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T00:32:19.586149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"254'93","reported_seq":634,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:39.549089+0000","last_change":"2024-06-04T15:52:42.503942+0000","last_active":"2024-06-04T16:22:39.549089+0000","last_peered":"2024-06-04T16:22:39.549089+0000","last_clean":"2024-06-04T16:22:39.549089+0000","last_became_active":"2024-06-04T15:52:42.503579+0000","last_became_peered":"2024-06-04T15:52:42.503579+0000","last_unstale":"2024-06-04T16:22:39.549089+0000","last_undegraded":"2024-06-04T16:22:39.549089+0000","last_fullsized":"2024-06-04T16:22:39.549089+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_clean_scrub_stamp":"2024-06-04T15:52:41.476734+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T18:07:30.315906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5924,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":139,"num_read_kb":180,"num_write":64,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":468,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:45.122366+0000","last_change":"2024-06-04T15:52:44.520226+0000","last_active":"2024-06-04T16:18:45.122366+0000","last_peered":"2024-06-04T16:18:45.122366+0000","last_clean":"2024-06-04T16:18:45.122366+0000","last_became_active":"2024-06-04T15:52:44.519570+0000","last_became_peered":"2024-06-04T15:52:44.519570+0000","last_unstale":"2024-06-04T16:18:45.122366+0000","last_undegraded":"2024-06-04T16:18:45.122366+0000","last_fullsized":"2024-06-04T16:18:45.122366+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_clean_scrub_stamp":"2024-06-04T15:52:43.492872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T00:47:00.033153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.11","version":"254'24","reported_seq":487,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:32.397487+0000","last_change":"2024-06-04T15:52:46.543080+0000","last_active":"2024-06-04T16:22:32.397487+0000","last_peered":"2024-06-04T16:22:32.397487+0000","last_clean":"2024-06-04T16:22:32.397487+0000","last_became_active":"2024-06-04T15:52:46.542820+0000","last_became_peered":"2024-06-04T15:52:46.542820+0000","last_unstale":"2024-06-04T16:22:32.397487+0000","last_undegraded":"2024-06-04T16:22:32.397487+0000","last_fullsized":"2024-06-04T16:22:32.397487+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:45.513877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:45.513877+0000","last_clean_scrub_stamp":"2024-06-04T15:52:45.513877+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T19:52:44.228120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":616,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":20,"num_read_kb":19,"num_write":60,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"254'121","reported_seq":815,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:20:10.021744+0000","last_change":"2024-06-04T15:52:38.478104+0000","last_active":"2024-06-04T16:20:10.021744+0000","last_peered":"2024-06-04T16:20:10.021744+0000","last_clean":"2024-06-04T16:20:10.021744+0000","last_became_active":"2024-06-04T15:52:38.477059+0000","last_became_peered":"2024-06-04T15:52:38.477059+0000","last_unstale":"2024-06-04T16:20:10.021744+0000","last_undegraded":"2024-06-04T16:20:10.021744+0000","last_fullsized":"2024-06-04T16:20:10.021744+0000","mapping_epoch":23,"log_start":"251'100","ondisk_log_start":"251'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":100,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T03:05:57.769457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":614,"num_read_kb":552,"num_write":164,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"254'63","reported_seq":571,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:39.450047+0000","last_change":"2024-06-04T15:52:36.498271+0000","last_active":"2024-06-04T16:22:39.450047+0000","last_peered":"2024-06-04T16:22:39.450047+0000","last_clean":"2024-06-04T16:22:39.450047+0000","last_became_active":"2024-06-04T15:52:36.497812+0000","last_became_peered":"2024-06-04T15:52:36.497812+0000","last_unstale":"2024-06-04T16:22:39.450047+0000","last_undegraded":"2024-06-04T16:22:39.450047+0000","last_fullsized":"2024-06-04T16:22:39.450047+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T17:50:50.956572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2267334,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":82,"num_read_kb":14576,"num_write":293,"num_write_kb":31387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3],"acting":[4,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":474,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:20:10.021773+0000","last_change":"2024-06-04T15:52:40.482009+0000","last_active":"2024-06-04T16:20:10.021773+0000","last_peered":"2024-06-04T16:20:10.021773+0000","last_clean":"2024-06-04T16:20:10.021773+0000","last_became_active":"2024-06-04T15:52:40.481621+0000","last_became_peered":"2024-06-04T15:52:40.481621+0000","last_unstale":"2024-06-04T16:20:10.021773+0000","last_undegraded":"2024-06-04T16:20:10.021773+0000","last_fullsized":"2024-06-04T16:20:10.021773+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_clean_scrub_stamp":"2024-06-04T15:52:39.463103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T19:33:44.607654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1e","version":"251'44","reported_seq":530,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:50.009057+0000","last_change":"2024-06-04T15:52:42.499792+0000","last_active":"2024-06-04T16:18:50.009057+0000","last_peered":"2024-06-04T16:18:50.009057+0000","last_clean":"2024-06-04T16:18:50.009057+0000","last_became_active":"2024-06-04T15:52:42.499488+0000","last_became_peered":"2024-06-04T15:52:42.499488+0000","last_unstale":"2024-06-04T16:18:50.009057+0000","last_undegraded":"2024-06-04T16:18:50.009057+0000","last_fullsized":"2024-06-04T16:18:50.009057+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_clean_scrub_stamp":"2024-06-04T15:52:41.476734+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T19:43:32.543414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":67,"num_read_kb":62,"num_write":74,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"254'461","reported_seq":1480,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:39.356472+0000","last_change":"2024-06-04T15:52:44.516769+0000","last_active":"2024-06-04T16:22:39.356472+0000","last_peered":"2024-06-04T16:22:39.356472+0000","last_clean":"2024-06-04T16:22:39.356472+0000","last_became_active":"2024-06-04T15:52:44.516460+0000","last_became_peered":"2024-06-04T15:52:44.516460+0000","last_unstale":"2024-06-04T16:22:39.356472+0000","last_undegraded":"2024-06-04T16:22:39.356472+0000","last_fullsized":"2024-06-04T16:22:39.356472+0000","mapping_epoch":29,"log_start":"251'400","ondisk_log_start":"251'400","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_clean_scrub_stamp":"2024-06-04T15:52:43.492872+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":400,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T02:33:02.102892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.10","version":"253'20","reported_seq":490,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:30.006488+0000","last_change":"2024-06-04T15:52:46.538482+0000","last_active":"2024-06-04T16:18:30.006488+0000","last_peered":"2024-06-04T16:18:30.006488+0000","last_clean":"2024-06-04T16:18:30.006488+0000","last_became_active":"2024-06-04T15:52:46.538179+0000","last_became_peered":"2024-06-04T15:52:46.538179+0000","last_unstale":"2024-06-04T16:18:30.006488+0000","last_undegraded":"2024-06-04T16:18:30.006488+0000","last_fullsized":"2024-06-04T16:18:30.006488+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:45.513877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:45.513877+0000","last_clean_scrub_stamp":"2024-06-04T15:52:45.513877+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T16:31:53.780883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":34,"num_read_kb":33,"num_write":53,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"254'122","reported_seq":866,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:20:10.013236+0000","last_change":"2024-06-04T15:52:38.486563+0000","last_active":"2024-06-04T16:20:10.013236+0000","last_peered":"2024-06-04T16:20:10.013236+0000","last_clean":"2024-06-04T16:20:10.013236+0000","last_became_active":"2024-06-04T15:52:38.485379+0000","last_became_peered":"2024-06-04T15:52:38.485379+0000","last_unstale":"2024-06-04T16:20:10.013236+0000","last_undegraded":"2024-06-04T16:20:10.013236+0000","last_fullsized":"2024-06-04T16:20:10.013236+0000","mapping_epoch":23,"log_start":"254'100","ondisk_log_start":"254'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":100,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T01:24:18.890606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":679,"num_read_kb":622,"num_write":158,"num_write_kb":49,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"251'30","reported_seq":521,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:20:10.123445+0000","last_change":"2024-06-04T15:52:36.486793+0000","last_active":"2024-06-04T16:20:10.123445+0000","last_peered":"2024-06-04T16:20:10.123445+0000","last_clean":"2024-06-04T16:20:10.123445+0000","last_became_active":"2024-06-04T15:52:36.486465+0000","last_became_peered":"2024-06-04T15:52:36.486465+0000","last_unstale":"2024-06-04T16:20:10.123445+0000","last_undegraded":"2024-06-04T16:20:10.123445+0000","last_fullsized":"2024-06-04T16:20:10.123445+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T21:12:11.586706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":30,"num_read_kb":1715,"num_write":122,"num_write_kb":16993,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,5],"acting":[1,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":476,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:20:10.123423+0000","last_change":"2024-06-04T15:52:40.481127+0000","last_active":"2024-06-04T16:20:10.123423+0000","last_peered":"2024-06-04T16:20:10.123423+0000","last_clean":"2024-06-04T16:20:10.123423+0000","last_became_active":"2024-06-04T15:52:40.480832+0000","last_became_peered":"2024-06-04T15:52:40.480832+0000","last_unstale":"2024-06-04T16:20:10.123423+0000","last_undegraded":"2024-06-04T16:20:10.123423+0000","last_fullsized":"2024-06-04T16:20:10.123423+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_clean_scrub_stamp":"2024-06-04T15:52:39.463103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T03:43:52.022773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"254'111","reported_seq":661,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:39.418971+0000","last_change":"2024-06-04T15:52:42.502990+0000","last_active":"2024-06-04T16:22:39.418971+0000","last_peered":"2024-06-04T16:22:39.418971+0000","last_clean":"2024-06-04T16:22:39.418971+0000","last_became_active":"2024-06-04T15:52:42.502601+0000","last_became_peered":"2024-06-04T15:52:42.502601+0000","last_unstale":"2024-06-04T16:22:39.418971+0000","last_undegraded":"2024-06-04T16:22:39.418971+0000","last_fullsized":"2024-06-04T16:22:39.418971+0000","mapping_epoch":27,"log_start":"251'100","ondisk_log_start":"251'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_clean_scrub_stamp":"2024-06-04T15:52:41.476734+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":100,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T23:06:11.514444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34754,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":168,"num_read_kb":281,"num_write":86,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":466,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:20.014431+0000","last_change":"2024-06-04T15:52:44.523309+0000","last_active":"2024-06-04T16:19:20.014431+0000","last_peered":"2024-06-04T16:19:20.014431+0000","last_clean":"2024-06-04T16:19:20.014431+0000","last_became_active":"2024-06-04T15:52:44.522992+0000","last_became_peered":"2024-06-04T15:52:44.522992+0000","last_unstale":"2024-06-04T16:19:20.014431+0000","last_undegraded":"2024-06-04T16:19:20.014431+0000","last_fullsized":"2024-06-04T16:19:20.014431+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_clean_scrub_stamp":"2024-06-04T15:52:43.492872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T02:51:54.078930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"251'15","reported_seq":487,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:25.118965+0000","last_change":"2024-06-04T15:52:46.540313+0000","last_active":"2024-06-04T16:19:25.118965+0000","last_peered":"2024-06-04T16:19:25.118965+0000","last_clean":"2024-06-04T16:19:25.118965+0000","last_became_active":"2024-06-04T15:52:46.539985+0000","last_became_peered":"2024-06-04T15:52:46.539985+0000","last_unstale":"2024-06-04T16:19:25.118965+0000","last_undegraded":"2024-06-04T16:19:25.118965+0000","last_fullsized":"2024-06-04T16:19:25.118965+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:45.513877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:45.513877+0000","last_clean_scrub_stamp":"2024-06-04T15:52:45.513877+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T22:40:19.386258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":31,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"254'419","reported_seq":1236,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:20:10.013215+0000","last_change":"2024-06-04T15:52:38.475289+0000","last_active":"2024-06-04T16:20:10.013215+0000","last_peered":"2024-06-04T16:20:10.013215+0000","last_clean":"2024-06-04T16:20:10.013215+0000","last_became_active":"2024-06-04T15:52:38.474960+0000","last_became_peered":"2024-06-04T15:52:38.474960+0000","last_unstale":"2024-06-04T16:20:10.013215+0000","last_undegraded":"2024-06-04T16:20:10.013215+0000","last_fullsized":"2024-06-04T16:20:10.013215+0000","mapping_epoch":23,"log_start":"251'400","ondisk_log_start":"251'400","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":400,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T01:50:53.656026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2017,"num_read_kb":1794,"num_write":716,"num_write_kb":341,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"254'99","reported_seq":727,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:39.496174+0000","last_change":"2024-06-04T15:52:36.499152+0000","last_active":"2024-06-04T16:22:39.496174+0000","last_peered":"2024-06-04T16:22:39.496174+0000","last_clean":"2024-06-04T16:22:39.496174+0000","last_became_active":"2024-06-04T15:52:36.498806+0000","last_became_peered":"2024-06-04T15:52:36.498806+0000","last_unstale":"2024-06-04T16:22:39.496174+0000","last_undegraded":"2024-06-04T16:22:39.496174+0000","last_fullsized":"2024-06-04T16:22:39.496174+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T16:05:54.071633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":490,"num_read_kb":127523,"num_write":607,"num_write_kb":22490,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":472,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:20:10.013246+0000","last_change":"2024-06-04T15:52:40.478700+0000","last_active":"2024-06-04T16:20:10.013246+0000","last_peered":"2024-06-04T16:20:10.013246+0000","last_clean":"2024-06-04T16:20:10.013246+0000","last_became_active":"2024-06-04T15:52:40.478417+0000","last_became_peered":"2024-06-04T15:52:40.478417+0000","last_unstale":"2024-06-04T16:20:10.013246+0000","last_undegraded":"2024-06-04T16:20:10.013246+0000","last_fullsized":"2024-06-04T16:20:10.013246+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_clean_scrub_stamp":"2024-06-04T15:52:39.463103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T01:59:06.360123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"254'88","reported_seq":627,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:39.427775+0000","last_change":"2024-06-04T15:52:42.496557+0000","last_active":"2024-06-04T16:22:39.427775+0000","last_peered":"2024-06-04T16:22:39.427775+0000","last_clean":"2024-06-04T16:22:39.427775+0000","last_became_active":"2024-06-04T15:52:42.496263+0000","last_became_peered":"2024-06-04T15:52:42.496263+0000","last_unstale":"2024-06-04T16:22:39.427775+0000","last_undegraded":"2024-06-04T16:22:39.427775+0000","last_fullsized":"2024-06-04T16:22:39.427775+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_clean_scrub_stamp":"2024-06-04T15:52:41.476734+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T01:39:37.497606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7956,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":138,"num_read_kb":200,"num_write":66,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":465,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:25.012820+0000","last_change":"2024-06-04T15:52:44.520347+0000","last_active":"2024-06-04T16:19:25.012820+0000","last_peered":"2024-06-04T16:19:25.012820+0000","last_clean":"2024-06-04T16:19:25.012820+0000","last_became_active":"2024-06-04T15:52:44.520051+0000","last_became_peered":"2024-06-04T15:52:44.520051+0000","last_unstale":"2024-06-04T16:19:25.012820+0000","last_undegraded":"2024-06-04T16:19:25.012820+0000","last_fullsized":"2024-06-04T16:19:25.012820+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_clean_scrub_stamp":"2024-06-04T15:52:43.492872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T21:08:39.164476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"254'39","reported_seq":547,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:25.015736+0000","last_change":"2024-06-04T15:52:46.542209+0000","last_active":"2024-06-04T16:19:25.015736+0000","last_peered":"2024-06-04T16:19:25.015736+0000","last_clean":"2024-06-04T16:19:25.015736+0000","last_became_active":"2024-06-04T15:52:46.541897+0000","last_became_peered":"2024-06-04T15:52:46.541897+0000","last_unstale":"2024-06-04T16:19:25.015736+0000","last_undegraded":"2024-06-04T16:19:25.015736+0000","last_fullsized":"2024-06-04T16:19:25.015736+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:45.513877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:45.513877+0000","last_clean_scrub_stamp":"2024-06-04T15:52:45.513877+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T01:21:18.754972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":549,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":152,"num_read_kb":137,"num_write":99,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"254'122","reported_seq":849,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:15.126530+0000","last_change":"2024-06-04T15:52:38.482687+0000","last_active":"2024-06-04T16:19:15.126530+0000","last_peered":"2024-06-04T16:19:15.126530+0000","last_clean":"2024-06-04T16:19:15.126530+0000","last_became_active":"2024-06-04T15:52:38.482388+0000","last_became_peered":"2024-06-04T15:52:38.482388+0000","last_unstale":"2024-06-04T16:19:15.126530+0000","last_undegraded":"2024-06-04T16:19:15.126530+0000","last_fullsized":"2024-06-04T16:19:15.126530+0000","mapping_epoch":23,"log_start":"251'100","ondisk_log_start":"251'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":100,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T19:55:37.296059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":625,"num_read_kb":571,"num_write":157,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1e","version":"251'81","reported_seq":611,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:45.010443+0000","last_change":"2024-06-04T15:52:36.485805+0000","last_active":"2024-06-04T16:18:45.010443+0000","last_peered":"2024-06-04T16:18:45.010443+0000","last_clean":"2024-06-04T16:18:45.010443+0000","last_became_active":"2024-06-04T15:52:36.485401+0000","last_became_peered":"2024-06-04T15:52:36.485401+0000","last_unstale":"2024-06-04T16:18:45.010443+0000","last_undegraded":"2024-06-04T16:18:45.010443+0000","last_fullsized":"2024-06-04T16:18:45.010443+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T21:08:15.786697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133679,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":131,"num_read_kb":40112,"num_write":294,"num_write_kb":27266,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,3],"acting":[5,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":476,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:15.117868+0000","last_change":"2024-06-04T15:52:40.483568+0000","last_active":"2024-06-04T16:19:15.117868+0000","last_peered":"2024-06-04T16:19:15.117868+0000","last_clean":"2024-06-04T16:19:15.117868+0000","last_became_active":"2024-06-04T15:52:40.483272+0000","last_became_peered":"2024-06-04T15:52:40.483272+0000","last_unstale":"2024-06-04T16:19:15.117868+0000","last_undegraded":"2024-06-04T16:19:15.117868+0000","last_fullsized":"2024-06-04T16:19:15.117868+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_clean_scrub_stamp":"2024-06-04T15:52:39.463103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T18:29:36.613477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"254'82","reported_seq":610,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:39.541295+0000","last_change":"2024-06-04T15:52:42.497288+0000","last_active":"2024-06-04T16:22:39.541295+0000","last_peered":"2024-06-04T16:22:39.541295+0000","last_clean":"2024-06-04T16:22:39.541295+0000","last_became_active":"2024-06-04T15:52:42.496934+0000","last_became_peered":"2024-06-04T15:52:42.496934+0000","last_unstale":"2024-06-04T16:22:39.541295+0000","last_undegraded":"2024-06-04T16:22:39.541295+0000","last_fullsized":"2024-06-04T16:22:39.541295+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_clean_scrub_stamp":"2024-06-04T15:52:41.476734+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T17:14:55.894511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8160,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":120,"num_read_kb":184,"num_write":54,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":464,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:17:45.001177+0000","last_change":"2024-06-04T15:52:44.519077+0000","last_active":"2024-06-04T16:17:45.001177+0000","last_peered":"2024-06-04T16:17:45.001177+0000","last_clean":"2024-06-04T16:17:45.001177+0000","last_became_active":"2024-06-04T15:52:44.518782+0000","last_became_peered":"2024-06-04T15:52:44.518782+0000","last_unstale":"2024-06-04T16:17:45.001177+0000","last_undegraded":"2024-06-04T16:17:45.001177+0000","last_fullsized":"2024-06-04T16:17:45.001177+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_clean_scrub_stamp":"2024-06-04T15:52:43.492872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T16:06:38.344510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"254'41","reported_seq":528,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:25.012872+0000","last_change":"2024-06-04T15:52:46.532088+0000","last_active":"2024-06-04T16:19:25.012872+0000","last_peered":"2024-06-04T16:19:25.012872+0000","last_clean":"2024-06-04T16:19:25.012872+0000","last_became_active":"2024-06-04T15:52:46.531795+0000","last_became_peered":"2024-06-04T15:52:46.531795+0000","last_unstale":"2024-06-04T16:19:25.012872+0000","last_undegraded":"2024-06-04T16:19:25.012872+0000","last_fullsized":"2024-06-04T16:19:25.012872+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:45.513877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:45.513877+0000","last_clean_scrub_stamp":"2024-06-04T15:52:45.513877+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T00:05:55.568943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":429,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":136,"num_read_kb":110,"num_write":109,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"254'356","reported_seq":1091,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:15.007748+0000","last_change":"2024-06-04T15:52:38.478558+0000","last_active":"2024-06-04T16:19:15.007748+0000","last_peered":"2024-06-04T16:19:15.007748+0000","last_clean":"2024-06-04T16:19:15.007748+0000","last_became_active":"2024-06-04T15:52:38.478204+0000","last_became_peered":"2024-06-04T15:52:38.478204+0000","last_unstale":"2024-06-04T16:19:15.007748+0000","last_undegraded":"2024-06-04T16:19:15.007748+0000","last_fullsized":"2024-06-04T16:19:15.007748+0000","mapping_epoch":23,"log_start":"251'300","ondisk_log_start":"251'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":300,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T17:34:50.324391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1642,"num_read_kb":1482,"num_write":614,"num_write_kb":292,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"251'22","reported_seq":513,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:45.018530+0000","last_change":"2024-06-04T15:52:36.478256+0000","last_active":"2024-06-04T16:19:45.018530+0000","last_peered":"2024-06-04T16:19:45.018530+0000","last_clean":"2024-06-04T16:19:45.018530+0000","last_became_active":"2024-06-04T15:52:36.477895+0000","last_became_peered":"2024-06-04T15:52:36.477895+0000","last_unstale":"2024-06-04T16:19:45.018530+0000","last_undegraded":"2024-06-04T16:19:45.018530+0000","last_fullsized":"2024-06-04T16:19:45.018530+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T22:33:16.679149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":78,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":120,"num_write_kb":13440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.19","version":"26'1","reported_seq":475,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:20.014466+0000","last_change":"2024-06-04T15:52:40.483405+0000","last_active":"2024-06-04T16:19:20.014466+0000","last_peered":"2024-06-04T16:19:20.014466+0000","last_clean":"2024-06-04T16:19:20.014466+0000","last_became_active":"2024-06-04T15:52:40.483131+0000","last_became_peered":"2024-06-04T15:52:40.483131+0000","last_unstale":"2024-06-04T16:19:20.014466+0000","last_undegraded":"2024-06-04T16:19:20.014466+0000","last_fullsized":"2024-06-04T16:19:20.014466+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_clean_scrub_stamp":"2024-06-04T15:52:39.463103+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T20:46:09.924823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1a","version":"254'120","reported_seq":672,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:39.556801+0000","last_change":"2024-06-04T15:52:42.503809+0000","last_active":"2024-06-04T16:22:39.556801+0000","last_peered":"2024-06-04T16:22:39.556801+0000","last_clean":"2024-06-04T16:22:39.556801+0000","last_became_active":"2024-06-04T15:52:42.503538+0000","last_became_peered":"2024-06-04T15:52:42.503538+0000","last_unstale":"2024-06-04T16:22:39.556801+0000","last_undegraded":"2024-06-04T16:22:39.556801+0000","last_fullsized":"2024-06-04T16:22:39.556801+0000","mapping_epoch":27,"log_start":"251'100","ondisk_log_start":"251'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_clean_scrub_stamp":"2024-06-04T15:52:41.476734+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":100,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T23:22:34.954352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6196,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":182,"num_read_kb":236,"num_write":96,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":465,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:17:45.001893+0000","last_change":"2024-06-04T15:52:44.520133+0000","last_active":"2024-06-04T16:17:45.001893+0000","last_peered":"2024-06-04T16:17:45.001893+0000","last_clean":"2024-06-04T16:17:45.001893+0000","last_became_active":"2024-06-04T15:52:44.519867+0000","last_became_peered":"2024-06-04T15:52:44.519867+0000","last_unstale":"2024-06-04T16:17:45.001893+0000","last_undegraded":"2024-06-04T16:17:45.001893+0000","last_fullsized":"2024-06-04T16:17:45.001893+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_clean_scrub_stamp":"2024-06-04T15:52:43.492872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T23:38:01.226210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.14","version":"254'30","reported_seq":529,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:35.003247+0000","last_change":"2024-06-04T15:52:46.538083+0000","last_active":"2024-06-04T16:18:35.003247+0000","last_peered":"2024-06-04T16:18:35.003247+0000","last_clean":"2024-06-04T16:18:35.003247+0000","last_became_active":"2024-06-04T15:52:46.537792+0000","last_became_peered":"2024-06-04T15:52:46.537792+0000","last_unstale":"2024-06-04T16:18:35.003247+0000","last_undegraded":"2024-06-04T16:18:35.003247+0000","last_fullsized":"2024-06-04T16:18:35.003247+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:45.513877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:45.513877+0000","last_clean_scrub_stamp":"2024-06-04T15:52:45.513877+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T19:51:33.137699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":433,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":163,"num_read_kb":128,"num_write":83,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"254'156","reported_seq":946,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:40.009213+0000","last_change":"2024-06-04T15:52:38.486670+0000","last_active":"2024-06-04T16:18:40.009213+0000","last_peered":"2024-06-04T16:18:40.009213+0000","last_clean":"2024-06-04T16:18:40.009213+0000","last_became_active":"2024-06-04T15:52:38.486335+0000","last_became_peered":"2024-06-04T15:52:38.486335+0000","last_unstale":"2024-06-04T16:18:40.009213+0000","last_undegraded":"2024-06-04T16:18:40.009213+0000","last_fullsized":"2024-06-04T16:18:40.009213+0000","mapping_epoch":23,"log_start":"251'100","ondisk_log_start":"251'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":100,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T02:25:00.264822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":839,"num_read_kb":763,"num_write":210,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.20","version":"254'54","reported_seq":568,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:21:50.024876+0000","last_change":"2024-06-04T15:53:14.002874+0000","last_active":"2024-06-04T16:21:50.024876+0000","last_peered":"2024-06-04T16:21:50.024876+0000","last_clean":"2024-06-04T16:21:50.024876+0000","last_became_active":"2024-06-04T15:53:14.002428+0000","last_became_peered":"2024-06-04T15:53:14.002428+0000","last_unstale":"2024-06-04T16:21:50.024876+0000","last_undegraded":"2024-06-04T16:21:50.024876+0000","last_fullsized":"2024-06-04T16:21:50.024876+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T00:01:17.187786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":15429,"num_write":206,"num_write_kb":34585,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5],"acting":[2,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"254'241","reported_seq":911,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:40.121513+0000","last_change":"2024-06-04T15:52:38.481773+0000","last_active":"2024-06-04T16:18:40.121513+0000","last_peered":"2024-06-04T16:18:40.121513+0000","last_clean":"2024-06-04T16:18:40.121513+0000","last_became_active":"2024-06-04T15:52:38.481490+0000","last_became_peered":"2024-06-04T15:52:38.481490+0000","last_unstale":"2024-06-04T16:18:40.121513+0000","last_undegraded":"2024-06-04T16:18:40.121513+0000","last_fullsized":"2024-06-04T16:18:40.121513+0000","mapping_epoch":23,"log_start":"251'200","ondisk_log_start":"251'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":200,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T21:24:52.955365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1011,"num_read_kb":836,"num_write":379,"num_write_kb":158,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.21","version":"254'54","reported_seq":555,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:21:50.149207+0000","last_change":"2024-06-04T15:52:36.495330+0000","last_active":"2024-06-04T16:21:50.149207+0000","last_peered":"2024-06-04T16:21:50.149207+0000","last_clean":"2024-06-04T16:21:50.149207+0000","last_became_active":"2024-06-04T15:52:36.495008+0000","last_became_peered":"2024-06-04T15:52:36.495008+0000","last_unstale":"2024-06-04T16:21:50.149207+0000","last_undegraded":"2024-06-04T16:21:50.149207+0000","last_fullsized":"2024-06-04T16:21:50.149207+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T01:04:03.095444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":63,"num_read_kb":12338,"num_write":219,"num_write_kb":31559,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.25","version":"254'138","reported_seq":973,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:40.007807+0000","last_change":"2024-06-04T15:52:38.482192+0000","last_active":"2024-06-04T16:18:40.007807+0000","last_peered":"2024-06-04T16:18:40.007807+0000","last_clean":"2024-06-04T16:18:40.007807+0000","last_became_active":"2024-06-04T15:52:38.481916+0000","last_became_peered":"2024-06-04T15:52:38.481916+0000","last_unstale":"2024-06-04T16:18:40.007807+0000","last_undegraded":"2024-06-04T16:18:40.007807+0000","last_fullsized":"2024-06-04T16:18:40.007807+0000","mapping_epoch":23,"log_start":"251'100","ondisk_log_start":"251'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T16:53:51.388099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":911,"num_read_kb":859,"num_write":180,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"254'58","reported_seq":585,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:21:50.029038+0000","last_change":"2024-06-04T15:52:36.482905+0000","last_active":"2024-06-04T16:21:50.029038+0000","last_peered":"2024-06-04T16:21:50.029038+0000","last_clean":"2024-06-04T16:21:50.029038+0000","last_became_active":"2024-06-04T15:52:36.482589+0000","last_became_peered":"2024-06-04T15:52:36.482589+0000","last_unstale":"2024-06-04T16:21:50.029038+0000","last_undegraded":"2024-06-04T16:21:50.029038+0000","last_fullsized":"2024-06-04T16:21:50.029038+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T01:08:39.575276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":134,"num_read_kb":8380,"num_write":298,"num_write_kb":18008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7],"acting":[3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"254'104","reported_seq":811,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:40.009685+0000","last_change":"2024-06-04T15:52:38.486331+0000","last_active":"2024-06-04T16:18:40.009685+0000","last_peered":"2024-06-04T16:18:40.009685+0000","last_clean":"2024-06-04T16:18:40.009685+0000","last_became_active":"2024-06-04T15:52:38.486018+0000","last_became_peered":"2024-06-04T15:52:38.486018+0000","last_unstale":"2024-06-04T16:18:40.009685+0000","last_undegraded":"2024-06-04T16:18:40.009685+0000","last_fullsized":"2024-06-04T16:18:40.009685+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T01:56:20.478655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":549,"num_read_kb":515,"num_write":118,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"251'48","reported_seq":559,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:50.019151+0000","last_change":"2024-06-04T15:52:36.496569+0000","last_active":"2024-06-04T16:19:50.019151+0000","last_peered":"2024-06-04T16:19:50.019151+0000","last_clean":"2024-06-04T16:19:50.019151+0000","last_became_active":"2024-06-04T15:52:36.496125+0000","last_became_peered":"2024-06-04T15:52:36.496125+0000","last_unstale":"2024-06-04T16:19:50.019151+0000","last_undegraded":"2024-06-04T16:19:50.019151+0000","last_fullsized":"2024-06-04T16:19:50.019151+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T19:29:40.820287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":98,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":59,"num_read_kb":26302,"num_write":204,"num_write_kb":24798,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,0],"acting":[5,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.23","version":"254'93","reported_seq":807,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:50.019175+0000","last_change":"2024-06-04T15:52:38.485339+0000","last_active":"2024-06-04T16:19:50.019175+0000","last_peered":"2024-06-04T16:19:50.019175+0000","last_clean":"2024-06-04T16:19:50.019175+0000","last_became_active":"2024-06-04T15:52:38.484927+0000","last_became_peered":"2024-06-04T15:52:38.484927+0000","last_unstale":"2024-06-04T16:19:50.019175+0000","last_undegraded":"2024-06-04T16:19:50.019175+0000","last_fullsized":"2024-06-04T16:19:50.019175+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T21:19:16.498288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":509,"num_read_kb":485,"num_write":106,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"254'52","reported_seq":554,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:40.008829+0000","last_change":"2024-06-04T15:53:14.183689+0000","last_active":"2024-06-04T16:18:40.008829+0000","last_peered":"2024-06-04T16:18:40.008829+0000","last_clean":"2024-06-04T16:18:40.008829+0000","last_became_active":"2024-06-04T15:53:14.183279+0000","last_became_peered":"2024-06-04T15:53:14.183279+0000","last_unstale":"2024-06-04T16:18:40.008829+0000","last_undegraded":"2024-06-04T16:18:40.008829+0000","last_fullsized":"2024-06-04T16:18:40.008829+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T23:59:10.245827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1395816,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":52,"num_read_kb":1141,"num_write":191,"num_write_kb":22936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.22","version":"254'208","reported_seq":1101,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:45.010113+0000","last_change":"2024-06-04T15:52:38.489058+0000","last_active":"2024-06-04T16:19:45.010113+0000","last_peered":"2024-06-04T16:19:45.010113+0000","last_clean":"2024-06-04T16:19:45.010113+0000","last_became_active":"2024-06-04T15:52:38.488762+0000","last_became_peered":"2024-06-04T15:52:38.488762+0000","last_unstale":"2024-06-04T16:19:45.010113+0000","last_undegraded":"2024-06-04T16:19:45.010113+0000","last_fullsized":"2024-06-04T16:19:45.010113+0000","mapping_epoch":23,"log_start":"251'100","ondisk_log_start":"251'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":100,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T02:35:48.920769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1221,"num_read_kb":1130,"num_write":279,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.25","version":"254'51","reported_seq":550,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:40.008870+0000","last_change":"2024-06-04T15:52:36.489331+0000","last_active":"2024-06-04T16:18:40.008870+0000","last_peered":"2024-06-04T16:18:40.008870+0000","last_clean":"2024-06-04T16:18:40.008870+0000","last_became_active":"2024-06-04T15:52:36.488611+0000","last_became_peered":"2024-06-04T15:52:36.488611+0000","last_unstale":"2024-06-04T16:18:40.008870+0000","last_undegraded":"2024-06-04T16:18:40.008870+0000","last_fullsized":"2024-06-04T16:18:40.008870+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T19:29:35.729548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":75,"num_read_kb":4172,"num_write":239,"num_write_kb":26328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"254'157","reported_seq":913,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:45.017560+0000","last_change":"2024-06-04T15:52:38.482854+0000","last_active":"2024-06-04T16:19:45.017560+0000","last_peered":"2024-06-04T16:19:45.017560+0000","last_clean":"2024-06-04T16:19:45.017560+0000","last_became_active":"2024-06-04T15:52:38.482566+0000","last_became_peered":"2024-06-04T15:52:38.482566+0000","last_unstale":"2024-06-04T16:19:45.017560+0000","last_undegraded":"2024-06-04T16:19:45.017560+0000","last_fullsized":"2024-06-04T16:19:45.017560+0000","mapping_epoch":23,"log_start":"251'100","ondisk_log_start":"251'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":100,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T03:29:54.648609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":759,"num_read_kb":686,"num_write":203,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"254'59","reported_seq":559,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:40.004208+0000","last_change":"2024-06-04T15:52:36.487513+0000","last_active":"2024-06-04T16:18:40.004208+0000","last_peered":"2024-06-04T16:18:40.004208+0000","last_clean":"2024-06-04T16:18:40.004208+0000","last_became_active":"2024-06-04T15:52:36.487213+0000","last_became_peered":"2024-06-04T15:52:36.487213+0000","last_unstale":"2024-06-04T16:18:40.004208+0000","last_undegraded":"2024-06-04T16:18:40.004208+0000","last_fullsized":"2024-06-04T16:18:40.004208+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T23:57:12.412972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3860915,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":58,"num_read_kb":7398,"num_write":258,"num_write_kb":28567,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"254'120","reported_seq":861,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:45.120878+0000","last_change":"2024-06-04T15:52:38.477288+0000","last_active":"2024-06-04T16:19:45.120878+0000","last_peered":"2024-06-04T16:19:45.120878+0000","last_clean":"2024-06-04T16:19:45.120878+0000","last_became_active":"2024-06-04T15:52:38.477036+0000","last_became_peered":"2024-06-04T15:52:38.477036+0000","last_unstale":"2024-06-04T16:19:45.120878+0000","last_undegraded":"2024-06-04T16:19:45.120878+0000","last_fullsized":"2024-06-04T16:19:45.120878+0000","mapping_epoch":23,"log_start":"251'100","ondisk_log_start":"251'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":100,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T23:17:01.386746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":627,"num_read_kb":578,"num_write":156,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"254'48","reported_seq":562,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:40.009774+0000","last_change":"2024-06-04T15:52:36.482150+0000","last_active":"2024-06-04T16:18:40.009774+0000","last_peered":"2024-06-04T16:18:40.009774+0000","last_clean":"2024-06-04T16:18:40.009774+0000","last_became_active":"2024-06-04T15:52:36.479810+0000","last_became_peered":"2024-06-04T15:52:36.479810+0000","last_unstale":"2024-06-04T16:18:40.009774+0000","last_undegraded":"2024-06-04T16:18:40.009774+0000","last_fullsized":"2024-06-04T16:18:40.009774+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T21:50:19.054304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048839,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":103,"num_read_kb":5904,"num_write":252,"num_write_kb":17938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2f","version":"254'58","reported_seq":706,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:23.264257+0000","last_change":"2024-06-04T15:52:38.482098+0000","last_active":"2024-06-04T16:18:23.264257+0000","last_peered":"2024-06-04T16:18:23.264257+0000","last_clean":"2024-06-04T16:18:23.264257+0000","last_became_active":"2024-06-04T15:52:38.481789+0000","last_became_peered":"2024-06-04T15:52:38.481789+0000","last_unstale":"2024-06-04T16:18:23.264257+0000","last_undegraded":"2024-06-04T16:18:23.264257+0000","last_fullsized":"2024-06-04T16:18:23.264257+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T21:41:15.834685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":316,"num_read_kb":309,"num_write":62,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.28","version":"254'57","reported_seq":591,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:45.008317+0000","last_change":"2024-06-04T15:52:36.491357+0000","last_active":"2024-06-04T16:18:45.008317+0000","last_peered":"2024-06-04T16:18:45.008317+0000","last_clean":"2024-06-04T16:18:45.008317+0000","last_became_active":"2024-06-04T15:52:36.490119+0000","last_became_peered":"2024-06-04T15:52:36.490119+0000","last_unstale":"2024-06-04T16:18:45.008317+0000","last_undegraded":"2024-06-04T16:18:45.008317+0000","last_fullsized":"2024-06-04T16:18:45.008317+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T02:06:04.469487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262178,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":124,"num_read_kb":46547,"num_write":231,"num_write_kb":19872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7],"acting":[3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"254'93","reported_seq":777,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:20.001732+0000","last_change":"2024-06-04T15:52:38.489137+0000","last_active":"2024-06-04T16:18:20.001732+0000","last_peered":"2024-06-04T16:18:20.001732+0000","last_clean":"2024-06-04T16:18:20.001732+0000","last_became_active":"2024-06-04T15:52:38.488839+0000","last_became_peered":"2024-06-04T15:52:38.488839+0000","last_unstale":"2024-06-04T16:18:20.001732+0000","last_undegraded":"2024-06-04T16:18:20.001732+0000","last_fullsized":"2024-06-04T16:18:20.001732+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T16:24:19.359126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":464,"num_read_kb":434,"num_write":108,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.29","version":"254'42","reported_seq":546,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:40.017602+0000","last_change":"2024-06-04T15:52:36.496347+0000","last_active":"2024-06-04T16:19:40.017602+0000","last_peered":"2024-06-04T16:19:40.017602+0000","last_clean":"2024-06-04T16:19:40.017602+0000","last_became_active":"2024-06-04T15:52:36.495936+0000","last_became_peered":"2024-06-04T15:52:36.495936+0000","last_unstale":"2024-06-04T16:19:40.017602+0000","last_undegraded":"2024-06-04T16:19:40.017602+0000","last_fullsized":"2024-06-04T16:19:40.017602+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T19:20:27.592911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133666,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":74,"num_read_kb":10396,"num_write":213,"num_write_kb":18947,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,0],"acting":[5,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2d","version":"254'115","reported_seq":798,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:45.018461+0000","last_change":"2024-06-04T15:52:38.488600+0000","last_active":"2024-06-04T16:19:45.018461+0000","last_peered":"2024-06-04T16:19:45.018461+0000","last_clean":"2024-06-04T16:19:45.018461+0000","last_became_active":"2024-06-04T15:52:38.488289+0000","last_became_peered":"2024-06-04T15:52:38.488289+0000","last_unstale":"2024-06-04T16:19:45.018461+0000","last_undegraded":"2024-06-04T16:19:45.018461+0000","last_fullsized":"2024-06-04T16:19:45.018461+0000","mapping_epoch":23,"log_start":"251'100","ondisk_log_start":"251'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":100,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T02:23:18.956319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":534,"num_read_kb":481,"num_write":150,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"254'66","reported_seq":574,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:21:55.134186+0000","last_change":"2024-06-04T15:52:36.495691+0000","last_active":"2024-06-04T16:21:55.134186+0000","last_peered":"2024-06-04T16:21:55.134186+0000","last_clean":"2024-06-04T16:21:55.134186+0000","last_became_active":"2024-06-04T15:52:36.495386+0000","last_became_peered":"2024-06-04T15:52:36.495386+0000","last_unstale":"2024-06-04T16:21:55.134186+0000","last_undegraded":"2024-06-04T16:21:55.134186+0000","last_fullsized":"2024-06-04T16:21:55.134186+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T17:58:34.573671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4553920,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":69,"num_read_kb":17530,"num_write":238,"num_write_kb":31151,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"254'90","reported_seq":828,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:40.120391+0000","last_change":"2024-06-04T15:52:38.477573+0000","last_active":"2024-06-04T16:19:40.120391+0000","last_peered":"2024-06-04T16:19:40.120391+0000","last_clean":"2024-06-04T16:19:40.120391+0000","last_became_active":"2024-06-04T15:52:38.477333+0000","last_became_peered":"2024-06-04T15:52:38.477333+0000","last_unstale":"2024-06-04T16:19:40.120391+0000","last_undegraded":"2024-06-04T16:19:40.120391+0000","last_fullsized":"2024-06-04T16:19:40.120391+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T22:56:07.200710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":521,"num_read_kb":500,"num_write":102,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"251'47","reported_seq":558,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:40.017162+0000","last_change":"2024-06-04T15:52:36.483514+0000","last_active":"2024-06-04T16:19:40.017162+0000","last_peered":"2024-06-04T16:19:40.017162+0000","last_clean":"2024-06-04T16:19:40.017162+0000","last_became_active":"2024-06-04T15:52:36.482036+0000","last_became_peered":"2024-06-04T15:52:36.482036+0000","last_unstale":"2024-06-04T16:19:40.017162+0000","last_undegraded":"2024-06-04T16:19:40.017162+0000","last_fullsized":"2024-06-04T16:19:40.017162+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T17:16:27.012465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1069194,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":76,"num_read_kb":25646,"num_write":152,"num_write_kb":18921,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,6],"acting":[4,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"254'150","reported_seq":903,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:40.120383+0000","last_change":"2024-06-04T15:52:38.481261+0000","last_active":"2024-06-04T16:19:40.120383+0000","last_peered":"2024-06-04T16:19:40.120383+0000","last_clean":"2024-06-04T16:19:40.120383+0000","last_became_active":"2024-06-04T15:52:38.480432+0000","last_became_peered":"2024-06-04T15:52:38.480432+0000","last_unstale":"2024-06-04T16:19:40.120383+0000","last_undegraded":"2024-06-04T16:19:40.120383+0000","last_fullsized":"2024-06-04T16:19:40.120383+0000","mapping_epoch":23,"log_start":"251'100","ondisk_log_start":"251'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":100,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T19:12:13.612916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":703,"num_read_kb":638,"num_write":178,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"254'54","reported_seq":554,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:40.009639+0000","last_change":"2024-06-04T15:52:36.492604+0000","last_active":"2024-06-04T16:19:40.009639+0000","last_peered":"2024-06-04T16:19:40.009639+0000","last_clean":"2024-06-04T16:19:40.009639+0000","last_became_active":"2024-06-04T15:52:36.488813+0000","last_became_peered":"2024-06-04T15:52:36.488813+0000","last_unstale":"2024-06-04T16:19:40.009639+0000","last_undegraded":"2024-06-04T16:19:40.009639+0000","last_fullsized":"2024-06-04T16:19:40.009639+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T17:27:44.315490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":75,"num_read_kb":5170,"num_write":190,"num_write_kb":17954,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6],"acting":[0,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"254'97","reported_seq":791,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:40.129909+0000","last_change":"2024-06-04T15:52:38.479843+0000","last_active":"2024-06-04T16:19:40.129909+0000","last_peered":"2024-06-04T16:19:40.129909+0000","last_clean":"2024-06-04T16:19:40.129909+0000","last_became_active":"2024-06-04T15:52:38.479542+0000","last_became_peered":"2024-06-04T15:52:38.479542+0000","last_unstale":"2024-06-04T16:19:40.129909+0000","last_undegraded":"2024-06-04T16:19:40.129909+0000","last_fullsized":"2024-06-04T16:19:40.129909+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T22:41:21.159508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":493,"num_read_kb":461,"num_write":115,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"251'65","reported_seq":574,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:45.015100+0000","last_change":"2024-06-04T15:52:36.488268+0000","last_active":"2024-06-04T16:19:45.015100+0000","last_peered":"2024-06-04T16:19:45.015100+0000","last_clean":"2024-06-04T16:19:45.015100+0000","last_became_active":"2024-06-04T15:52:36.487971+0000","last_became_peered":"2024-06-04T15:52:36.487971+0000","last_unstale":"2024-06-04T16:19:45.015100+0000","last_undegraded":"2024-06-04T16:19:45.015100+0000","last_fullsized":"2024-06-04T16:19:45.015100+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T21:45:32.006937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262163,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":94,"num_read_kb":7564,"num_write":255,"num_write_kb":36740,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"254'136","reported_seq":911,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:40.017107+0000","last_change":"2024-06-04T15:52:38.484562+0000","last_active":"2024-06-04T16:19:40.017107+0000","last_peered":"2024-06-04T16:19:40.017107+0000","last_clean":"2024-06-04T16:19:40.017107+0000","last_became_active":"2024-06-04T15:52:38.484225+0000","last_became_peered":"2024-06-04T15:52:38.484225+0000","last_unstale":"2024-06-04T16:19:40.017107+0000","last_undegraded":"2024-06-04T16:19:40.017107+0000","last_fullsized":"2024-06-04T16:19:40.017107+0000","mapping_epoch":23,"log_start":"251'100","ondisk_log_start":"251'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":100,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T02:17:33.313293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":727,"num_read_kb":670,"num_write":170,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2e","version":"254'55","reported_seq":566,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:20:40.138705+0000","last_change":"2024-06-04T15:52:36.488496+0000","last_active":"2024-06-04T16:20:40.138705+0000","last_peered":"2024-06-04T16:20:40.138705+0000","last_clean":"2024-06-04T16:20:40.138705+0000","last_became_active":"2024-06-04T15:52:36.488139+0000","last_became_peered":"2024-06-04T15:52:36.488139+0000","last_unstale":"2024-06-04T16:20:40.138705+0000","last_undegraded":"2024-06-04T16:20:40.138705+0000","last_fullsized":"2024-06-04T16:20:40.138705+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T23:07:58.153939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":103,"num_read_kb":14422,"num_write":268,"num_write_kb":32685,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,3],"acting":[7,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.28","version":"254'289","reported_seq":1123,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:40.113801+0000","last_change":"2024-06-04T15:52:38.480910+0000","last_active":"2024-06-04T16:18:40.113801+0000","last_peered":"2024-06-04T16:18:40.113801+0000","last_clean":"2024-06-04T16:18:40.113801+0000","last_became_active":"2024-06-04T15:52:38.480613+0000","last_became_peered":"2024-06-04T15:52:38.480613+0000","last_unstale":"2024-06-04T16:18:40.113801+0000","last_undegraded":"2024-06-04T16:18:40.113801+0000","last_fullsized":"2024-06-04T16:18:40.113801+0000","mapping_epoch":23,"log_start":"251'200","ondisk_log_start":"251'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":200,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T20:28:05.010058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1456,"num_read_kb":1243,"num_write":452,"num_write_kb":208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"254'57","reported_seq":557,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:20.005372+0000","last_change":"2024-06-04T15:52:36.498902+0000","last_active":"2024-06-04T16:18:20.005372+0000","last_peered":"2024-06-04T16:18:20.005372+0000","last_clean":"2024-06-04T16:18:20.005372+0000","last_became_active":"2024-06-04T15:52:36.498564+0000","last_became_peered":"2024-06-04T15:52:36.498564+0000","last_unstale":"2024-06-04T16:18:20.005372+0000","last_undegraded":"2024-06-04T16:18:20.005372+0000","last_fullsized":"2024-06-04T16:18:20.005372+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T03:32:39.163905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1395816,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":73,"num_read_kb":11423,"num_write":228,"num_write_kb":34926,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"251'38","reported_seq":548,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:20.005214+0000","last_change":"2024-06-04T15:52:36.490119+0000","last_active":"2024-06-04T16:18:20.005214+0000","last_peered":"2024-06-04T16:18:20.005214+0000","last_clean":"2024-06-04T16:18:20.005214+0000","last_became_active":"2024-06-04T15:52:36.489681+0000","last_became_peered":"2024-06-04T15:52:36.489681+0000","last_unstale":"2024-06-04T16:18:20.005214+0000","last_undegraded":"2024-06-04T16:18:20.005214+0000","last_fullsized":"2024-06-04T16:18:20.005214+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T23:00:19.953809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1395831,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":78,"num_read_kb":4250,"num_write":172,"num_write_kb":18293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,6],"acting":[3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"254'119","reported_seq":1022,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:20.014594+0000","last_change":"2024-06-04T15:52:38.489275+0000","last_active":"2024-06-04T16:19:20.014594+0000","last_peered":"2024-06-04T16:19:20.014594+0000","last_clean":"2024-06-04T16:19:20.014594+0000","last_became_active":"2024-06-04T15:52:38.488941+0000","last_became_peered":"2024-06-04T15:52:38.488941+0000","last_unstale":"2024-06-04T16:19:20.014594+0000","last_undegraded":"2024-06-04T16:19:20.014594+0000","last_fullsized":"2024-06-04T16:19:20.014594+0000","mapping_epoch":23,"log_start":"251'100","ondisk_log_start":"251'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":100,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T02:49:46.129022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1004,"num_read_kb":976,"num_write":157,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"251'45","reported_seq":542,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:20.006817+0000","last_change":"2024-06-04T15:52:36.496468+0000","last_active":"2024-06-04T16:18:20.006817+0000","last_peered":"2024-06-04T16:18:20.006817+0000","last_clean":"2024-06-04T16:18:20.006817+0000","last_became_active":"2024-06-04T15:52:36.496046+0000","last_became_peered":"2024-06-04T15:52:36.496046+0000","last_unstale":"2024-06-04T16:18:20.006817+0000","last_undegraded":"2024-06-04T16:18:20.006817+0000","last_fullsized":"2024-06-04T16:18:20.006817+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T17:39:51.740231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1069179,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":46,"num_read_kb":3657,"num_write":159,"num_write_kb":22961,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3],"acting":[5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.36","version":"254'112","reported_seq":818,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:15.117929+0000","last_change":"2024-06-04T15:52:38.474859+0000","last_active":"2024-06-04T16:19:15.117929+0000","last_peered":"2024-06-04T16:19:15.117929+0000","last_clean":"2024-06-04T16:19:15.117929+0000","last_became_active":"2024-06-04T15:52:38.474574+0000","last_became_peered":"2024-06-04T15:52:38.474574+0000","last_unstale":"2024-06-04T16:19:15.117929+0000","last_undegraded":"2024-06-04T16:19:15.117929+0000","last_fullsized":"2024-06-04T16:19:15.117929+0000","mapping_epoch":23,"log_start":"254'100","ondisk_log_start":"254'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":100,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T00:26:50.523752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":563,"num_read_kb":518,"num_write":138,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":16777216,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":169,"num_read_kb":189232,"num_write":179,"num_write_kb":125730,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":33554432,"data_stored":33554432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":126,"ondisk_log_size":126,"up":64,"acting":64,"num_store_stats":8},{"poolid":64,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4378,"num_read_kb":3242,"num_write":1279,"num_write_kb":637,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":682,"ondisk_log_size":682,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":8922,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":3579,"num_read_kb":3443,"num_write":3611,"num_write_kb":1042,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":319488,"data_stored":17844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":999,"ondisk_log_size":999,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":564,"ondisk_log_size":564,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":300865,"num_objects":188,"num_object_clones":0,"num_object_copies":376,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":188,"num_whiteouts":0,"num_read":6099,"num_read_kb":7761,"num_write":3199,"num_write_kb":973,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1903,"ondisk_log_size":1903,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1533,"num_read_kb":1825,"num_write":20,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11,"ondisk_log_size":11,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":77,"num_object_clones":0,"num_object_copies":154,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":77,"num_whiteouts":0,"num_read":48565,"num_read_kb":44901,"num_write":11590,"num_write_kb":3535,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":77,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3758,"ondisk_log_size":3758,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":85563130,"num_objects":200,"num_object_clones":0,"num_object_copies":600,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":200,"num_whiteouts":0,"num_read":5481,"num_read_kb":1011284,"num_write":14360,"num_write_kb":1691909,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":130080768,"data_stored":130080768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3497,"ondisk_log_size":3497,"up":192,"acting":192,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":12,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4,"ondisk_log_size":4,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":16777216,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":170,"num_read_kb":185843,"num_write":179,"num_write_kb":125730,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":33554432,"data_stored":33554432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":126,"ondisk_log_size":126,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542513,"num_pgs":96,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":195152,"kb_used_data":23792,"kb_used_omap":1,"kb_used_meta":171326,"kb_avail":94176688,"statfs":{"total":96636764160,"available":96436928512,"internally_reserved":0,"allocated":24363008,"data_stored":22488525,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":175438282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542513,"num_pgs":108,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":121188,"kb_used_data":76124,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94250652,"statfs":{"total":96636764160,"available":96512667648,"internally_reserved":0,"allocated":77950976,"data_stored":76057701,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":46135751},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542512,"num_pgs":115,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":262524,"kb_used_data":60596,"kb_used_omap":1,"kb_used_meta":201918,"kb_avail":94109316,"statfs":{"total":96636764160,"available":96367939584,"internally_reserved":0,"allocated":62050304,"data_stored":60152093,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":206764485},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542510,"num_pgs":122,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":199188,"kb_used_data":81996,"kb_used_omap":1,"kb_used_meta":117182,"kb_avail":94172652,"statfs":{"total":96636764160,"available":96432795648,"internally_reserved":0,"allocated":83963904,"data_stored":82057842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":119994821},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542513,"num_pgs":119,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":256976,"kb_used_data":81416,"kb_used_omap":1,"kb_used_meta":175550,"kb_avail":94114864,"statfs":{"total":96636764160,"available":96373620736,"internally_reserved":0,"allocated":83369984,"data_stored":81465877,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":179763655},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542513,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":134772,"kb_used_data":59180,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94237068,"statfs":{"total":96636764160,"available":96498757632,"internally_reserved":0,"allocated":60600320,"data_stored":58711287,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":77396421},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542512,"num_pgs":98,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302136,"kb_used_data":76592,"kb_used_omap":1,"kb_used_meta":225534,"kb_avail":94069704,"statfs":{"total":96636764160,"available":96327376896,"internally_reserved":0,"allocated":78430208,"data_stored":76518037,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":230947269},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542513,"num_pgs":93,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":76076,"kb_used_data":31000,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94295764,"statfs":{"total":96636764160,"available":96558862336,"internally_reserved":0,"allocated":31744000,"data_stored":29845910,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":25591808,"data_stored":25591808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":22585344,"data_stored":22585344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":14917632,"data_stored":14917632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":18190336,"data_stored":18190336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":18907136,"data_stored":18907136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":10403840,"data_stored":10403840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":10686464,"data_stored":10686464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8798208,"data_stored":8798208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":1139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":1364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2484,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1047,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":2789,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":2757,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2173,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2491,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1703,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":64,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":64,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":64,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":64,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":64,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":64,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":64,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":64,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":1048576,"data_stored":1048576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":1048576,"data_stored":1048576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":7340032,"data_stored":7340032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":5242880,"data_stored":5242880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4194304,"data_stored":4194304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":9437184,"data_stored":9437184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":5242880,"data_stored":5242880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":1048576,"data_stored":1048576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":10485760,"data_stored":10485760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4194304,"data_stored":4194304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":6291456,"data_stored":6291456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4194304,"data_stored":4194304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":1048576,"data_stored":1048576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":6291456,"data_stored":6291456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-06-04T16:22:41.846 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-06-04T16:22:42.176 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:42.177 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":254,"fsid":"15e56bb1-4856-42f3-b6db-a2c8f23c5557","created":"2024-06-04T15:52:08.498471+0000","modified":"2024-06-04T16:16:09.647275+0000","last_up_change":"2024-06-04T15:52:19.398091+0000","last_in_change":"2024-06-04T15:52:11.751110+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":16,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":67,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2024-06-04T15:52:20.443906+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2024-06-04T15:52:20.915083+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"default.rgw.buckets.data","create_time":"2024-06-04T15:52:34.462325+0000","flags":1,"flags_names":"hashpspool","type":3,"size":3,"min_size":2,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"client.0","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":4,"pool_name":"default.rgw.buckets.index","create_time":"2024-06-04T15:52:36.806216+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":".rgw.root","create_time":"2024-06-04T15:52:38.637519+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"default.rgw.log","create_time":"2024-06-04T15:52:40.745454+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"default.rgw.control","create_time":"2024-06-04T15:52:42.510052+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"default.rgw.meta","create_time":"2024-06-04T15:52:44.586260+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":64,"pool_name":"default.rgw.buckets.non-ec","create_time":"2024-06-04T16:07:07.425122+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"245","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":65,"pool_name":"default.rgw.buckets.data.frozen","create_time":"2024-06-04T16:09:22.472486+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"248","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":66,"pool_name":"default.rgw.buckets.data.lukewarm","create_time":"2024-06-04T16:09:24.678728+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"251","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":67,"pool_name":"default.rgw.otp","create_time":"2024-06-04T16:16:07.476189+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"254","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"865b3e53-9572-4d2e-a552-93aeba5a878e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":252,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":1453747520},{"type":"v1","addr":"172.21.15.144:6801","nonce":1453747520}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":1453747520},{"type":"v1","addr":"172.21.15.144:6803","nonce":1453747520}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":1453747520},{"type":"v1","addr":"172.21.15.144:6807","nonce":1453747520}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":1453747520},{"type":"v1","addr":"172.21.15.144:6805","nonce":1453747520}]},"public_addr":"172.21.15.144:6801/1453747520","cluster_addr":"172.21.15.144:6803/1453747520","heartbeat_back_addr":"172.21.15.144:6807/1453747520","heartbeat_front_addr":"172.21.15.144:6805/1453747520","state":["exists","up"]},{"osd":1,"uuid":"530d160d-4c96-482b-b9ca-017c52d6971b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":252,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":2358575268},{"type":"v1","addr":"172.21.15.144:6817","nonce":2358575268}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":2358575268},{"type":"v1","addr":"172.21.15.144:6819","nonce":2358575268}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":2358575268},{"type":"v1","addr":"172.21.15.144:6823","nonce":2358575268}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":2358575268},{"type":"v1","addr":"172.21.15.144:6821","nonce":2358575268}]},"public_addr":"172.21.15.144:6817/2358575268","cluster_addr":"172.21.15.144:6819/2358575268","heartbeat_back_addr":"172.21.15.144:6823/2358575268","heartbeat_front_addr":"172.21.15.144:6821/2358575268","state":["exists","up"]},{"osd":2,"uuid":"ef99cc9a-405c-41d4-b504-396b1cc3ab62","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":252,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":86532035},{"type":"v1","addr":"172.21.15.144:6809","nonce":86532035}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":86532035},{"type":"v1","addr":"172.21.15.144:6811","nonce":86532035}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":86532035},{"type":"v1","addr":"172.21.15.144:6815","nonce":86532035}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":86532035},{"type":"v1","addr":"172.21.15.144:6813","nonce":86532035}]},"public_addr":"172.21.15.144:6809/86532035","cluster_addr":"172.21.15.144:6811/86532035","heartbeat_back_addr":"172.21.15.144:6815/86532035","heartbeat_front_addr":"172.21.15.144:6813/86532035","state":["exists","up"]},{"osd":3,"uuid":"bbc2f08d-579a-4c02-bf75-8be9e630d34c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":252,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":166159729},{"type":"v1","addr":"172.21.15.144:6825","nonce":166159729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":166159729},{"type":"v1","addr":"172.21.15.144:6827","nonce":166159729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":166159729},{"type":"v1","addr":"172.21.15.144:6831","nonce":166159729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":166159729},{"type":"v1","addr":"172.21.15.144:6829","nonce":166159729}]},"public_addr":"172.21.15.144:6825/166159729","cluster_addr":"172.21.15.144:6827/166159729","heartbeat_back_addr":"172.21.15.144:6831/166159729","heartbeat_front_addr":"172.21.15.144:6829/166159729","state":["exists","up"]},{"osd":4,"uuid":"64a1a82a-e45e-4750-9101-499c6fe49b5f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":252,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":2039473917},{"type":"v1","addr":"172.21.15.177:6817","nonce":2039473917}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":2039473917},{"type":"v1","addr":"172.21.15.177:6819","nonce":2039473917}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":2039473917},{"type":"v1","addr":"172.21.15.177:6823","nonce":2039473917}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":2039473917},{"type":"v1","addr":"172.21.15.177:6821","nonce":2039473917}]},"public_addr":"172.21.15.177:6817/2039473917","cluster_addr":"172.21.15.177:6819/2039473917","heartbeat_back_addr":"172.21.15.177:6823/2039473917","heartbeat_front_addr":"172.21.15.177:6821/2039473917","state":["exists","up"]},{"osd":5,"uuid":"4391ac8e-1bdf-4e68-aa72-c78e1bdca71e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":252,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3891611393},{"type":"v1","addr":"172.21.15.177:6801","nonce":3891611393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3891611393},{"type":"v1","addr":"172.21.15.177:6803","nonce":3891611393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3891611393},{"type":"v1","addr":"172.21.15.177:6807","nonce":3891611393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3891611393},{"type":"v1","addr":"172.21.15.177:6805","nonce":3891611393}]},"public_addr":"172.21.15.177:6801/3891611393","cluster_addr":"172.21.15.177:6803/3891611393","heartbeat_back_addr":"172.21.15.177:6807/3891611393","heartbeat_front_addr":"172.21.15.177:6805/3891611393","state":["exists","up"]},{"osd":6,"uuid":"89c685a4-0158-49d1-a3a4-7a794cd8cdc4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":252,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":800067290},{"type":"v1","addr":"172.21.15.177:6825","nonce":800067290}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":800067290},{"type":"v1","addr":"172.21.15.177:6827","nonce":800067290}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":800067290},{"type":"v1","addr":"172.21.15.177:6831","nonce":800067290}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":800067290},{"type":"v1","addr":"172.21.15.177:6829","nonce":800067290}]},"public_addr":"172.21.15.177:6825/800067290","cluster_addr":"172.21.15.177:6827/800067290","heartbeat_back_addr":"172.21.15.177:6831/800067290","heartbeat_front_addr":"172.21.15.177:6829/800067290","state":["exists","up"]},{"osd":7,"uuid":"08fae03a-7ac7-40f4-a0fe-f754dcfd8c8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":252,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":2618477608},{"type":"v1","addr":"172.21.15.177:6809","nonce":2618477608}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":2618477608},{"type":"v1","addr":"172.21.15.177:6811","nonce":2618477608}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":2618477608},{"type":"v1","addr":"172.21.15.177:6815","nonce":2618477608}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":2618477608},{"type":"v1","addr":"172.21.15.177:6813","nonce":2618477608}]},"public_addr":"172.21.15.177:6809/2618477608","cluster_addr":"172.21.15.177:6811/2618477608","heartbeat_back_addr":"172.21.15.177:6815/2618477608","heartbeat_front_addr":"172.21.15.177:6813/2618477608","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-04T15:52:16.796198+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-04T15:52:16.944288+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-04T15:52:16.890626+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-04T15:52:16.976961+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-04T15:52:16.916053+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-04T15:52:16.816952+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-04T15:52:16.913393+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-04T15:52:16.833768+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.d","mappings":[{"from":3,"to":6}]},{"pgid":"3.f","mappings":[{"from":0,"to":6}]},{"pgid":"3.20","mappings":[{"from":3,"to":5}]},{"pgid":"3.24","mappings":[{"from":0,"to":7}]},{"pgid":"3.35","mappings":[{"from":3,"to":1}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"client.0":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":26,"snaps":[{"begin":1,"length":2}]},{"pool":31,"snaps":[{"begin":1,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-04T16:22:43.190 INFO:tasks.ceph:Scrubbing osd.0 2024-06-04T16:22:43.191 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-06-04T16:22:43.343 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-06-04T16:22:43.343 INFO:teuthology.orchestra.run.smithi144.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-06-04T16:22:43.343 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-06-04T16:22:43.354 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-06-04T16:22:43.663 INFO:teuthology.orchestra.run.smithi144.stderr:instructed osd(s) 0 to deep-scrub 2024-06-04T16:22:43.677 INFO:tasks.ceph:Scrubbing osd.1 2024-06-04T16:22:43.677 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-06-04T16:22:43.815 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-06-04T16:22:43.815 INFO:teuthology.orchestra.run.smithi144.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-06-04T16:22:43.815 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-06-04T16:22:43.826 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-06-04T16:22:44.133 INFO:teuthology.orchestra.run.smithi144.stderr:instructed osd(s) 1 to deep-scrub 2024-06-04T16:22:44.147 INFO:tasks.ceph:Scrubbing osd.2 2024-06-04T16:22:44.147 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-06-04T16:22:44.284 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-06-04T16:22:44.285 INFO:teuthology.orchestra.run.smithi144.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-06-04T16:22:44.285 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-06-04T16:22:44.295 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-06-04T16:22:44.606 INFO:teuthology.orchestra.run.smithi144.stderr:instructed osd(s) 2 to deep-scrub 2024-06-04T16:22:44.619 INFO:tasks.ceph:Scrubbing osd.3 2024-06-04T16:22:44.620 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-06-04T16:22:44.757 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-06-04T16:22:44.757 INFO:teuthology.orchestra.run.smithi144.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-06-04T16:22:44.757 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-06-04T16:22:44.768 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-06-04T16:22:45.076 INFO:teuthology.orchestra.run.smithi144.stderr:instructed osd(s) 3 to deep-scrub 2024-06-04T16:22:45.091 INFO:tasks.ceph:Scrubbing osd.4 2024-06-04T16:22:45.091 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-06-04T16:22:45.231 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-06-04T16:22:45.231 INFO:teuthology.orchestra.run.smithi144.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-06-04T16:22:45.231 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-06-04T16:22:45.242 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-06-04T16:22:45.551 INFO:teuthology.orchestra.run.smithi144.stderr:instructed osd(s) 4 to deep-scrub 2024-06-04T16:22:45.564 INFO:tasks.ceph:Scrubbing osd.5 2024-06-04T16:22:45.565 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-06-04T16:22:45.704 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-06-04T16:22:45.704 INFO:teuthology.orchestra.run.smithi144.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-06-04T16:22:45.704 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-06-04T16:22:45.715 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-06-04T16:22:46.023 INFO:teuthology.orchestra.run.smithi144.stderr:instructed osd(s) 5 to deep-scrub 2024-06-04T16:22:46.037 INFO:tasks.ceph:Scrubbing osd.6 2024-06-04T16:22:46.037 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-06-04T16:22:46.177 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-06-04T16:22:46.178 INFO:teuthology.orchestra.run.smithi144.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-06-04T16:22:46.178 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-06-04T16:22:46.188 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-06-04T16:22:46.496 INFO:teuthology.orchestra.run.smithi144.stderr:instructed osd(s) 6 to deep-scrub 2024-06-04T16:22:46.510 INFO:tasks.ceph:Scrubbing osd.7 2024-06-04T16:22:46.511 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-06-04T16:22:46.654 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-06-04T16:22:46.654 INFO:teuthology.orchestra.run.smithi144.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-06-04T16:22:46.654 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-06-04T16:22:46.665 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-06-04T16:22:46.972 INFO:teuthology.orchestra.run.smithi144.stderr:instructed osd(s) 7 to deep-scrub 2024-06-04T16:22:46.985 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-06-04T16:22:47.315 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:22:47.326 INFO:teuthology.orchestra.run.smithi144.stderr:dumped all 2024-06-04T16:22:47.328 INFO:teuthology.orchestra.run.smithi144.stdout:{"pg_ready":true,"pg_map":{"version":1160,"stamp":"2024-06-04T16:22:45.555818+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":120019510,"num_objects":545,"num_object_clones":0,"num_object_copies":1290,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":545,"num_whiteouts":0,"num_read":70048,"num_read_kb":1447594,"num_write":34530,"num_write_kb":1951205,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":99,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11742,"ondisk_log_size":11742,"up":850,"acting":850,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":850,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1282716,"kb_used_data":225272,"kb_used_omap":12,"kb_used_meta":1057203,"kb_avail":753692004,"statfs":{"total":773094113280,"available":771780612096,"internally_reserved":0,"allocated":230678528,"data_stored":215622914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":1082576433},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-198367373,"num_objects":-81,"num_object_clones":0,"num_object_copies":-183,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-81,"num_whiteouts":0,"num_read":354,"num_read_kb":452,"num_write":182,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004854"},"pg_stats":[{"pgid":"67.1c","version":"0'0","reported_seq":15,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:21:10.019894+0000","last_change":"2024-06-04T16:16:08.658494+0000","last_active":"2024-06-04T16:21:10.019894+0000","last_peered":"2024-06-04T16:21:10.019894+0000","last_clean":"2024-06-04T16:21:10.019894+0000","last_became_active":"2024-06-04T16:16:08.658205+0000","last_became_peered":"2024-06-04T16:16:08.658205+0000","last_unstale":"2024-06-04T16:21:10.019894+0000","last_undegraded":"2024-06-04T16:21:10.019894+0000","last_fullsized":"2024-06-04T16:21:10.019894+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_clean_scrub_stamp":"2024-06-04T16:16:07.631263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1d","version":"251'2","reported_seq":27,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:30.016313+0000","last_change":"2024-06-04T16:09:26.627968+0000","last_active":"2024-06-04T16:19:30.016313+0000","last_peered":"2024-06-04T16:19:30.016313+0000","last_clean":"2024-06-04T16:19:30.016313+0000","last_became_active":"2024-06-04T16:09:26.627678+0000","last_became_peered":"2024-06-04T16:09:26.627678+0000","last_unstale":"2024-06-04T16:19:30.016313+0000","last_undegraded":"2024-06-04T16:19:30.016313+0000","last_fullsized":"2024-06-04T16:19:30.016313+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_clean_scrub_stamp":"2024-06-04T16:09:25.601105+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T01:24:09.747341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1e","version":"254'2","reported_seq":33,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:21:25.032961+0000","last_change":"2024-06-04T16:09:23.610282+0000","last_active":"2024-06-04T16:21:25.032961+0000","last_peered":"2024-06-04T16:21:25.032961+0000","last_clean":"2024-06-04T16:21:25.032961+0000","last_became_active":"2024-06-04T16:09:23.610020+0000","last_became_peered":"2024-06-04T16:09:23.610020+0000","last_unstale":"2024-06-04T16:21:25.032961+0000","last_undegraded":"2024-06-04T16:21:25.032961+0000","last_fullsized":"2024-06-04T16:21:25.032961+0000","mapping_epoch":246,"log_start":"0'0","ondisk_log_start":"0'0","created":246,"last_epoch_clean":247,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_clean_scrub_stamp":"2024-06-04T16:09:22.572686+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T20:33:48.503494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"64.1f","version":"251'21","reported_seq":94,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:40.017799+0000","last_change":"2024-06-04T16:07:09.402335+0000","last_active":"2024-06-04T16:19:40.017799+0000","last_peered":"2024-06-04T16:19:40.017799+0000","last_clean":"2024-06-04T16:19:40.017799+0000","last_became_active":"2024-06-04T16:07:09.402073+0000","last_became_peered":"2024-06-04T16:07:09.402073+0000","last_unstale":"2024-06-04T16:19:40.017799+0000","last_undegraded":"2024-06-04T16:19:40.017799+0000","last_fullsized":"2024-06-04T16:19:40.017799+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":243,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:07:08.374534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:07:08.374534+0000","last_clean_scrub_stamp":"2024-06-04T16:07:08.374534+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T00:13:07.984077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":108,"num_read_kb":75,"num_write":41,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1d","version":"0'0","reported_seq":15,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:21:10.129832+0000","last_change":"2024-06-04T16:16:08.656686+0000","last_active":"2024-06-04T16:21:10.129832+0000","last_peered":"2024-06-04T16:21:10.129832+0000","last_clean":"2024-06-04T16:21:10.129832+0000","last_became_active":"2024-06-04T16:16:08.656388+0000","last_became_peered":"2024-06-04T16:16:08.656388+0000","last_unstale":"2024-06-04T16:21:10.129832+0000","last_undegraded":"2024-06-04T16:21:10.129832+0000","last_fullsized":"2024-06-04T16:21:10.129832+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_clean_scrub_stamp":"2024-06-04T16:16:07.631263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.1c","version":"254'2","reported_seq":26,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:00.150620+0000","last_change":"2024-06-04T16:09:26.627239+0000","last_active":"2024-06-04T16:22:00.150620+0000","last_peered":"2024-06-04T16:22:00.150620+0000","last_clean":"2024-06-04T16:22:00.150620+0000","last_became_active":"2024-06-04T16:09:26.626964+0000","last_became_peered":"2024-06-04T16:09:26.626964+0000","last_unstale":"2024-06-04T16:22:00.150620+0000","last_undegraded":"2024-06-04T16:22:00.150620+0000","last_fullsized":"2024-06-04T16:22:00.150620+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_clean_scrub_stamp":"2024-06-04T16:09:25.601105+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T22:22:45.616852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1f","version":"254'4","reported_seq":37,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:21:55.037101+0000","last_change":"2024-06-04T16:09:23.608520+0000","last_active":"2024-06-04T16:21:55.037101+0000","last_peered":"2024-06-04T16:21:55.037101+0000","last_clean":"2024-06-04T16:21:55.037101+0000","last_became_active":"2024-06-04T16:09:23.608251+0000","last_became_peered":"2024-06-04T16:09:23.608251+0000","last_unstale":"2024-06-04T16:21:55.037101+0000","last_undegraded":"2024-06-04T16:21:55.037101+0000","last_fullsized":"2024-06-04T16:21:55.037101+0000","mapping_epoch":246,"log_start":"0'0","ondisk_log_start":"0'0","created":246,"last_epoch_clean":247,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_clean_scrub_stamp":"2024-06-04T16:09:22.572686+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T01:41:52.047423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":8192,"num_write":4,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"64.1e","version":"251'15","reported_seq":79,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:10.125894+0000","last_change":"2024-06-04T16:07:09.511589+0000","last_active":"2024-06-04T16:19:10.125894+0000","last_peered":"2024-06-04T16:19:10.125894+0000","last_clean":"2024-06-04T16:19:10.125894+0000","last_became_active":"2024-06-04T16:07:09.511253+0000","last_became_peered":"2024-06-04T16:07:09.511253+0000","last_unstale":"2024-06-04T16:19:10.125894+0000","last_undegraded":"2024-06-04T16:19:10.125894+0000","last_fullsized":"2024-06-04T16:19:10.125894+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":243,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:07:08.374534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:07:08.374534+0000","last_clean_scrub_stamp":"2024-06-04T16:07:08.374534+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T02:12:46.993038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":58,"num_write":26,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1e","version":"0'0","reported_seq":15,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:20:10.022107+0000","last_change":"2024-06-04T16:16:08.660980+0000","last_active":"2024-06-04T16:20:10.022107+0000","last_peered":"2024-06-04T16:20:10.022107+0000","last_clean":"2024-06-04T16:20:10.022107+0000","last_became_active":"2024-06-04T16:16:08.660635+0000","last_became_peered":"2024-06-04T16:16:08.660635+0000","last_unstale":"2024-06-04T16:20:10.022107+0000","last_undegraded":"2024-06-04T16:20:10.022107+0000","last_fullsized":"2024-06-04T16:20:10.022107+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_clean_scrub_stamp":"2024-06-04T16:16:07.631263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T01:54:33.642831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1f","version":"0'0","reported_seq":25,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:00.134790+0000","last_change":"2024-06-04T16:09:26.624893+0000","last_active":"2024-06-04T16:22:00.134790+0000","last_peered":"2024-06-04T16:22:00.134790+0000","last_clean":"2024-06-04T16:22:00.134790+0000","last_became_active":"2024-06-04T16:09:26.624510+0000","last_became_peered":"2024-06-04T16:09:26.624510+0000","last_unstale":"2024-06-04T16:22:00.134790+0000","last_undegraded":"2024-06-04T16:22:00.134790+0000","last_fullsized":"2024-06-04T16:22:00.134790+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_clean_scrub_stamp":"2024-06-04T16:09:25.601105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1c","version":"0'0","reported_seq":29,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:25.014688+0000","last_change":"2024-06-04T16:09:23.612578+0000","last_active":"2024-06-04T16:19:25.014688+0000","last_peered":"2024-06-04T16:19:25.014688+0000","last_clean":"2024-06-04T16:19:25.014688+0000","last_became_active":"2024-06-04T16:09:23.612278+0000","last_became_peered":"2024-06-04T16:09:23.612278+0000","last_unstale":"2024-06-04T16:19:25.014688+0000","last_undegraded":"2024-06-04T16:19:25.014688+0000","last_fullsized":"2024-06-04T16:19:25.014688+0000","mapping_epoch":246,"log_start":"0'0","ondisk_log_start":"0'0","created":246,"last_epoch_clean":247,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_clean_scrub_stamp":"2024-06-04T16:09:22.572686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T04:01:33.465233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"64.1d","version":"251'28","reported_seq":115,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:10.135757+0000","last_change":"2024-06-04T16:07:09.511447+0000","last_active":"2024-06-04T16:22:10.135757+0000","last_peered":"2024-06-04T16:22:10.135757+0000","last_clean":"2024-06-04T16:22:10.135757+0000","last_became_active":"2024-06-04T16:07:09.511154+0000","last_became_peered":"2024-06-04T16:07:09.511154+0000","last_unstale":"2024-06-04T16:22:10.135757+0000","last_undegraded":"2024-06-04T16:22:10.135757+0000","last_fullsized":"2024-06-04T16:22:10.135757+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":243,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:07:08.374534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:07:08.374534+0000","last_clean_scrub_stamp":"2024-06-04T16:07:08.374534+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":150,"num_read_kb":106,"num_write":50,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.1f","version":"0'0","reported_seq":15,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:20:20.023704+0000","last_change":"2024-06-04T16:16:08.661162+0000","last_active":"2024-06-04T16:20:20.023704+0000","last_peered":"2024-06-04T16:20:20.023704+0000","last_clean":"2024-06-04T16:20:20.023704+0000","last_became_active":"2024-06-04T16:16:08.660669+0000","last_became_peered":"2024-06-04T16:16:08.660669+0000","last_unstale":"2024-06-04T16:20:20.023704+0000","last_undegraded":"2024-06-04T16:20:20.023704+0000","last_fullsized":"2024-06-04T16:20:20.023704+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_clean_scrub_stamp":"2024-06-04T16:16:07.631263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T16:45:04.637111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1e","version":"254'2","reported_seq":27,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:21:30.146307+0000","last_change":"2024-06-04T16:09:26.622613+0000","last_active":"2024-06-04T16:21:30.146307+0000","last_peered":"2024-06-04T16:21:30.146307+0000","last_clean":"2024-06-04T16:21:30.146307+0000","last_became_active":"2024-06-04T16:09:26.621326+0000","last_became_peered":"2024-06-04T16:09:26.621326+0000","last_unstale":"2024-06-04T16:21:30.146307+0000","last_undegraded":"2024-06-04T16:21:30.146307+0000","last_fullsized":"2024-06-04T16:21:30.146307+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_clean_scrub_stamp":"2024-06-04T16:09:25.601105+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T01:20:44.676294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1d","version":"254'5","reported_seq":37,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:21:55.036560+0000","last_change":"2024-06-04T16:09:23.607186+0000","last_active":"2024-06-04T16:21:55.036560+0000","last_peered":"2024-06-04T16:21:55.036560+0000","last_clean":"2024-06-04T16:21:55.036560+0000","last_became_active":"2024-06-04T16:09:23.606918+0000","last_became_peered":"2024-06-04T16:09:23.606918+0000","last_unstale":"2024-06-04T16:21:55.036560+0000","last_undegraded":"2024-06-04T16:21:55.036560+0000","last_fullsized":"2024-06-04T16:21:55.036560+0000","mapping_epoch":246,"log_start":"0'0","ondisk_log_start":"0'0","created":246,"last_epoch_clean":247,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_clean_scrub_stamp":"2024-06-04T16:09:22.572686+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T17:11:19.839027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":4144,"num_write":10,"num_write_kb":4144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"64.1c","version":"251'37","reported_seq":142,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:40.017695+0000","last_change":"2024-06-04T16:07:09.509991+0000","last_active":"2024-06-04T16:19:40.017695+0000","last_peered":"2024-06-04T16:19:40.017695+0000","last_clean":"2024-06-04T16:19:40.017695+0000","last_became_active":"2024-06-04T16:07:09.509671+0000","last_became_peered":"2024-06-04T16:07:09.509671+0000","last_unstale":"2024-06-04T16:19:40.017695+0000","last_undegraded":"2024-06-04T16:19:40.017695+0000","last_fullsized":"2024-06-04T16:19:40.017695+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":243,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:07:08.374534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:07:08.374534+0000","last_clean_scrub_stamp":"2024-06-04T16:07:08.374534+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T18:48:21.024789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":197,"num_read_kb":141,"num_write":70,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.18","version":"0'0","reported_seq":14,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:35.007117+0000","last_change":"2024-06-04T16:16:08.664509+0000","last_active":"2024-06-04T16:18:35.007117+0000","last_peered":"2024-06-04T16:18:35.007117+0000","last_clean":"2024-06-04T16:18:35.007117+0000","last_became_active":"2024-06-04T16:16:08.664252+0000","last_became_peered":"2024-06-04T16:16:08.664252+0000","last_unstale":"2024-06-04T16:18:35.007117+0000","last_undegraded":"2024-06-04T16:18:35.007117+0000","last_fullsized":"2024-06-04T16:18:35.007117+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_clean_scrub_stamp":"2024-06-04T16:16:07.631263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T01:56:56.151412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.19","version":"254'7","reported_seq":35,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:21:40.027861+0000","last_change":"2024-06-04T16:09:26.625104+0000","last_active":"2024-06-04T16:21:40.027861+0000","last_peered":"2024-06-04T16:21:40.027861+0000","last_clean":"2024-06-04T16:21:40.027861+0000","last_became_active":"2024-06-04T16:09:26.624681+0000","last_became_peered":"2024-06-04T16:09:26.624681+0000","last_unstale":"2024-06-04T16:21:40.027861+0000","last_undegraded":"2024-06-04T16:21:40.027861+0000","last_fullsized":"2024-06-04T16:21:40.027861+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_clean_scrub_stamp":"2024-06-04T16:09:25.601105+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T16:38:40.132989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":9216,"num_write":12,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1a","version":"251'3","reported_seq":35,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:21:55.025438+0000","last_change":"2024-06-04T16:09:23.609384+0000","last_active":"2024-06-04T16:21:55.025438+0000","last_peered":"2024-06-04T16:21:55.025438+0000","last_clean":"2024-06-04T16:21:55.025438+0000","last_became_active":"2024-06-04T16:09:23.609102+0000","last_became_peered":"2024-06-04T16:09:23.609102+0000","last_unstale":"2024-06-04T16:21:55.025438+0000","last_undegraded":"2024-06-04T16:21:55.025438+0000","last_fullsized":"2024-06-04T16:21:55.025438+0000","mapping_epoch":246,"log_start":"0'0","ondisk_log_start":"0'0","created":246,"last_epoch_clean":247,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_clean_scrub_stamp":"2024-06-04T16:09:22.572686+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"64.1b","version":"251'96","reported_seq":333,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:40.017150+0000","last_change":"2024-06-04T16:07:09.404530+0000","last_active":"2024-06-04T16:19:40.017150+0000","last_peered":"2024-06-04T16:19:40.017150+0000","last_clean":"2024-06-04T16:19:40.017150+0000","last_became_active":"2024-06-04T16:07:09.404202+0000","last_became_peered":"2024-06-04T16:07:09.404202+0000","last_unstale":"2024-06-04T16:19:40.017150+0000","last_undegraded":"2024-06-04T16:19:40.017150+0000","last_fullsized":"2024-06-04T16:19:40.017150+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":243,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:07:08.374534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:07:08.374534+0000","last_clean_scrub_stamp":"2024-06-04T16:07:08.374534+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T20:38:56.584375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":591,"num_read_kb":533,"num_write":104,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.19","version":"0'0","reported_seq":15,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:21:00.017549+0000","last_change":"2024-06-04T16:16:08.659135+0000","last_active":"2024-06-04T16:21:00.017549+0000","last_peered":"2024-06-04T16:21:00.017549+0000","last_clean":"2024-06-04T16:21:00.017549+0000","last_became_active":"2024-06-04T16:16:08.658696+0000","last_became_peered":"2024-06-04T16:16:08.658696+0000","last_unstale":"2024-06-04T16:21:00.017549+0000","last_undegraded":"2024-06-04T16:21:00.017549+0000","last_fullsized":"2024-06-04T16:21:00.017549+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_clean_scrub_stamp":"2024-06-04T16:16:07.631263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.18","version":"254'7","reported_seq":34,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:21:35.034527+0000","last_change":"2024-06-04T16:09:26.624594+0000","last_active":"2024-06-04T16:21:35.034527+0000","last_peered":"2024-06-04T16:21:35.034527+0000","last_clean":"2024-06-04T16:21:35.034527+0000","last_became_active":"2024-06-04T16:09:26.624322+0000","last_became_peered":"2024-06-04T16:09:26.624322+0000","last_unstale":"2024-06-04T16:21:35.034527+0000","last_undegraded":"2024-06-04T16:21:35.034527+0000","last_fullsized":"2024-06-04T16:21:35.034527+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_clean_scrub_stamp":"2024-06-04T16:09:25.601105+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T03:22:38.550890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":8192,"num_write":12,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1b","version":"254'13","reported_seq":60,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:39.532961+0000","last_change":"2024-06-04T16:09:23.613387+0000","last_active":"2024-06-04T16:22:39.532961+0000","last_peered":"2024-06-04T16:22:39.532961+0000","last_clean":"2024-06-04T16:22:39.532961+0000","last_became_active":"2024-06-04T16:09:23.613109+0000","last_became_peered":"2024-06-04T16:09:23.613109+0000","last_unstale":"2024-06-04T16:22:39.532961+0000","last_undegraded":"2024-06-04T16:22:39.532961+0000","last_fullsized":"2024-06-04T16:22:39.532961+0000","mapping_epoch":246,"log_start":"0'0","ondisk_log_start":"0'0","created":246,"last_epoch_clean":247,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_clean_scrub_stamp":"2024-06-04T16:09:22.572686+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T18:31:33.463795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":26,"num_read_kb":29700,"num_write":16,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"64.1a","version":"251'15","reported_seq":76,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:10.135724+0000","last_change":"2024-06-04T16:07:09.407260+0000","last_active":"2024-06-04T16:22:10.135724+0000","last_peered":"2024-06-04T16:22:10.135724+0000","last_clean":"2024-06-04T16:22:10.135724+0000","last_became_active":"2024-06-04T16:07:09.406976+0000","last_became_peered":"2024-06-04T16:07:09.406976+0000","last_unstale":"2024-06-04T16:22:10.135724+0000","last_undegraded":"2024-06-04T16:22:10.135724+0000","last_fullsized":"2024-06-04T16:22:10.135724+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":243,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:07:08.374534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:07:08.374534+0000","last_clean_scrub_stamp":"2024-06-04T16:07:08.374534+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":52,"num_write":29,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.1a","version":"0'0","reported_seq":14,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:40.121419+0000","last_change":"2024-06-04T16:16:08.664491+0000","last_active":"2024-06-04T16:18:40.121419+0000","last_peered":"2024-06-04T16:18:40.121419+0000","last_clean":"2024-06-04T16:18:40.121419+0000","last_became_active":"2024-06-04T16:16:08.664200+0000","last_became_peered":"2024-06-04T16:16:08.664200+0000","last_unstale":"2024-06-04T16:18:40.121419+0000","last_undegraded":"2024-06-04T16:18:40.121419+0000","last_fullsized":"2024-06-04T16:18:40.121419+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_clean_scrub_stamp":"2024-06-04T16:16:07.631263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T01:16:08.795243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.1b","version":"254'3","reported_seq":28,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:00.037236+0000","last_change":"2024-06-04T16:09:26.626809+0000","last_active":"2024-06-04T16:22:00.037236+0000","last_peered":"2024-06-04T16:22:00.037236+0000","last_clean":"2024-06-04T16:22:00.037236+0000","last_became_active":"2024-06-04T16:09:26.626528+0000","last_became_peered":"2024-06-04T16:09:26.626528+0000","last_unstale":"2024-06-04T16:22:00.037236+0000","last_undegraded":"2024-06-04T16:22:00.037236+0000","last_fullsized":"2024-06-04T16:22:00.037236+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_clean_scrub_stamp":"2024-06-04T16:09:25.601105+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T03:55:00.731424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8192,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.18","version":"254'4","reported_seq":36,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:21:30.033184+0000","last_change":"2024-06-04T16:09:23.610295+0000","last_active":"2024-06-04T16:21:30.033184+0000","last_peered":"2024-06-04T16:21:30.033184+0000","last_clean":"2024-06-04T16:21:30.033184+0000","last_became_active":"2024-06-04T16:09:23.609952+0000","last_became_peered":"2024-06-04T16:09:23.609952+0000","last_unstale":"2024-06-04T16:21:30.033184+0000","last_undegraded":"2024-06-04T16:21:30.033184+0000","last_fullsized":"2024-06-04T16:21:30.033184+0000","mapping_epoch":246,"log_start":"0'0","ondisk_log_start":"0'0","created":246,"last_epoch_clean":247,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_clean_scrub_stamp":"2024-06-04T16:09:22.572686+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T20:30:38.429992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5120,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"64.19","version":"251'22","reported_seq":96,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:20.015056+0000","last_change":"2024-06-04T16:07:09.402552+0000","last_active":"2024-06-04T16:19:20.015056+0000","last_peered":"2024-06-04T16:19:20.015056+0000","last_clean":"2024-06-04T16:19:20.015056+0000","last_became_active":"2024-06-04T16:07:09.402316+0000","last_became_peered":"2024-06-04T16:07:09.402316+0000","last_unstale":"2024-06-04T16:19:20.015056+0000","last_undegraded":"2024-06-04T16:19:20.015056+0000","last_fullsized":"2024-06-04T16:19:20.015056+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":243,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:07:08.374534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:07:08.374534+0000","last_clean_scrub_stamp":"2024-06-04T16:07:08.374534+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T21:44:10.282159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":114,"num_read_kb":79,"num_write":44,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1b","version":"0'0","reported_seq":15,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:21:10.019864+0000","last_change":"2024-06-04T16:16:08.654196+0000","last_active":"2024-06-04T16:21:10.019864+0000","last_peered":"2024-06-04T16:21:10.019864+0000","last_clean":"2024-06-04T16:21:10.019864+0000","last_became_active":"2024-06-04T16:16:08.653931+0000","last_became_peered":"2024-06-04T16:16:08.653931+0000","last_unstale":"2024-06-04T16:21:10.019864+0000","last_undegraded":"2024-06-04T16:21:10.019864+0000","last_fullsized":"2024-06-04T16:21:10.019864+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_clean_scrub_stamp":"2024-06-04T16:16:07.631263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1a","version":"254'8","reported_seq":41,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:39.526411+0000","last_change":"2024-06-04T16:09:26.623784+0000","last_active":"2024-06-04T16:22:39.526411+0000","last_peered":"2024-06-04T16:22:39.526411+0000","last_clean":"2024-06-04T16:22:39.526411+0000","last_became_active":"2024-06-04T16:09:26.623459+0000","last_became_peered":"2024-06-04T16:09:26.623459+0000","last_unstale":"2024-06-04T16:22:39.526411+0000","last_undegraded":"2024-06-04T16:22:39.526411+0000","last_fullsized":"2024-06-04T16:22:39.526411+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_clean_scrub_stamp":"2024-06-04T16:09:25.601105+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":9218,"num_write":7,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.19","version":"254'6","reported_seq":42,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:21:30.146210+0000","last_change":"2024-06-04T16:09:23.607280+0000","last_active":"2024-06-04T16:21:30.146210+0000","last_peered":"2024-06-04T16:21:30.146210+0000","last_clean":"2024-06-04T16:21:30.146210+0000","last_became_active":"2024-06-04T16:09:23.606966+0000","last_became_peered":"2024-06-04T16:09:23.606966+0000","last_unstale":"2024-06-04T16:21:30.146210+0000","last_undegraded":"2024-06-04T16:21:30.146210+0000","last_fullsized":"2024-06-04T16:21:30.146210+0000","mapping_epoch":246,"log_start":"0'0","ondisk_log_start":"0'0","created":246,"last_epoch_clean":247,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_clean_scrub_stamp":"2024-06-04T16:09:22.572686+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T00:52:40.922210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":11,"num_read_kb":8194,"num_write":5,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"64.18","version":"251'39","reported_seq":145,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:21:40.132652+0000","last_change":"2024-06-04T16:07:09.404324+0000","last_active":"2024-06-04T16:21:40.132652+0000","last_peered":"2024-06-04T16:21:40.132652+0000","last_clean":"2024-06-04T16:21:40.132652+0000","last_became_active":"2024-06-04T16:07:09.404055+0000","last_became_peered":"2024-06-04T16:07:09.404055+0000","last_unstale":"2024-06-04T16:21:40.132652+0000","last_undegraded":"2024-06-04T16:21:40.132652+0000","last_fullsized":"2024-06-04T16:21:40.132652+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":243,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:07:08.374534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:07:08.374534+0000","last_clean_scrub_stamp":"2024-06-04T16:07:08.374534+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":206,"num_read_kb":146,"num_write":71,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.14","version":"253'1","reported_seq":15,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:30.008340+0000","last_change":"2024-06-04T16:16:08.662285+0000","last_active":"2024-06-04T16:18:30.008340+0000","last_peered":"2024-06-04T16:18:30.008340+0000","last_clean":"2024-06-04T16:18:30.008340+0000","last_became_active":"2024-06-04T16:16:08.661995+0000","last_became_peered":"2024-06-04T16:16:08.661995+0000","last_unstale":"2024-06-04T16:18:30.008340+0000","last_undegraded":"2024-06-04T16:18:30.008340+0000","last_fullsized":"2024-06-04T16:18:30.008340+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_clean_scrub_stamp":"2024-06-04T16:16:07.631263+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T04:00:42.209306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.15","version":"254'5","reported_seq":31,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:39.435875+0000","last_change":"2024-06-04T16:09:26.623775+0000","last_active":"2024-06-04T16:22:39.435875+0000","last_peered":"2024-06-04T16:22:39.435875+0000","last_clean":"2024-06-04T16:22:39.435875+0000","last_became_active":"2024-06-04T16:09:26.623442+0000","last_became_peered":"2024-06-04T16:09:26.623442+0000","last_unstale":"2024-06-04T16:22:39.435875+0000","last_undegraded":"2024-06-04T16:22:39.435875+0000","last_fullsized":"2024-06-04T16:22:39.435875+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_clean_scrub_stamp":"2024-06-04T16:09:25.601105+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":1406,"num_write":10,"num_write_kb":4799,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.16","version":"251'2","reported_seq":33,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:05.012569+0000","last_change":"2024-06-04T16:09:23.609558+0000","last_active":"2024-06-04T16:19:05.012569+0000","last_peered":"2024-06-04T16:19:05.012569+0000","last_clean":"2024-06-04T16:19:05.012569+0000","last_became_active":"2024-06-04T16:09:23.609180+0000","last_became_peered":"2024-06-04T16:09:23.609180+0000","last_unstale":"2024-06-04T16:19:05.012569+0000","last_undegraded":"2024-06-04T16:19:05.012569+0000","last_fullsized":"2024-06-04T16:19:05.012569+0000","mapping_epoch":246,"log_start":"0'0","ondisk_log_start":"0'0","created":246,"last_epoch_clean":247,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_clean_scrub_stamp":"2024-06-04T16:09:22.572686+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T17:27:35.142187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":45,"num_write":2,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"64.17","version":"0'0","reported_seq":36,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:15.011780+0000","last_change":"2024-06-04T16:07:09.512132+0000","last_active":"2024-06-04T16:19:15.011780+0000","last_peered":"2024-06-04T16:19:15.011780+0000","last_clean":"2024-06-04T16:19:15.011780+0000","last_became_active":"2024-06-04T16:07:09.511806+0000","last_became_peered":"2024-06-04T16:07:09.511806+0000","last_unstale":"2024-06-04T16:19:15.011780+0000","last_undegraded":"2024-06-04T16:19:15.011780+0000","last_fullsized":"2024-06-04T16:19:15.011780+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":243,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:07:08.374534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:07:08.374534+0000","last_clean_scrub_stamp":"2024-06-04T16:07:08.374534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T21:23:49.362770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.15","version":"0'0","reported_seq":14,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:35.120607+0000","last_change":"2024-06-04T16:16:08.664995+0000","last_active":"2024-06-04T16:18:35.120607+0000","last_peered":"2024-06-04T16:18:35.120607+0000","last_clean":"2024-06-04T16:18:35.120607+0000","last_became_active":"2024-06-04T16:16:08.664680+0000","last_became_peered":"2024-06-04T16:16:08.664680+0000","last_unstale":"2024-06-04T16:18:35.120607+0000","last_undegraded":"2024-06-04T16:18:35.120607+0000","last_fullsized":"2024-06-04T16:18:35.120607+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_clean_scrub_stamp":"2024-06-04T16:16:07.631263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T19:24:50.177579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.14","version":"254'3","reported_seq":26,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:21:15.025223+0000","last_change":"2024-06-04T16:09:26.624246+0000","last_active":"2024-06-04T16:21:15.025223+0000","last_peered":"2024-06-04T16:21:15.025223+0000","last_clean":"2024-06-04T16:21:15.025223+0000","last_became_active":"2024-06-04T16:09:26.623991+0000","last_became_peered":"2024-06-04T16:09:26.623991+0000","last_unstale":"2024-06-04T16:21:15.025223+0000","last_undegraded":"2024-06-04T16:21:15.025223+0000","last_fullsized":"2024-06-04T16:21:15.025223+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_clean_scrub_stamp":"2024-06-04T16:09:25.601105+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T21:29:18.235375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.17","version":"254'2","reported_seq":32,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:21:30.033744+0000","last_change":"2024-06-04T16:09:23.595639+0000","last_active":"2024-06-04T16:21:30.033744+0000","last_peered":"2024-06-04T16:21:30.033744+0000","last_clean":"2024-06-04T16:21:30.033744+0000","last_became_active":"2024-06-04T16:09:23.595355+0000","last_became_peered":"2024-06-04T16:09:23.595355+0000","last_unstale":"2024-06-04T16:21:30.033744+0000","last_undegraded":"2024-06-04T16:21:30.033744+0000","last_fullsized":"2024-06-04T16:21:30.033744+0000","mapping_epoch":246,"log_start":"0'0","ondisk_log_start":"0'0","created":246,"last_epoch_clean":247,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_clean_scrub_stamp":"2024-06-04T16:09:22.572686+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T19:14:50.608068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"64.16","version":"251'16","reported_seq":80,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:15.126620+0000","last_change":"2024-06-04T16:07:09.405399+0000","last_active":"2024-06-04T16:19:15.126620+0000","last_peered":"2024-06-04T16:19:15.126620+0000","last_clean":"2024-06-04T16:19:15.126620+0000","last_became_active":"2024-06-04T16:07:09.405088+0000","last_became_peered":"2024-06-04T16:07:09.405088+0000","last_unstale":"2024-06-04T16:19:15.126620+0000","last_undegraded":"2024-06-04T16:19:15.126620+0000","last_fullsized":"2024-06-04T16:19:15.126620+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":243,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:07:08.374534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:07:08.374534+0000","last_clean_scrub_stamp":"2024-06-04T16:07:08.374534+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T21:34:43.810719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":63,"num_write":30,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.16","version":"0'0","reported_seq":15,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:21:00.017633+0000","last_change":"2024-06-04T16:16:08.656459+0000","last_active":"2024-06-04T16:21:00.017633+0000","last_peered":"2024-06-04T16:21:00.017633+0000","last_clean":"2024-06-04T16:21:00.017633+0000","last_became_active":"2024-06-04T16:16:08.655571+0000","last_became_peered":"2024-06-04T16:16:08.655571+0000","last_unstale":"2024-06-04T16:21:00.017633+0000","last_undegraded":"2024-06-04T16:21:00.017633+0000","last_fullsized":"2024-06-04T16:21:00.017633+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_clean_scrub_stamp":"2024-06-04T16:16:07.631263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.17","version":"0'0","reported_seq":23,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:10.013842+0000","last_change":"2024-06-04T16:09:26.626934+0000","last_active":"2024-06-04T16:19:10.013842+0000","last_peered":"2024-06-04T16:19:10.013842+0000","last_clean":"2024-06-04T16:19:10.013842+0000","last_became_active":"2024-06-04T16:09:26.626605+0000","last_became_peered":"2024-06-04T16:09:26.626605+0000","last_unstale":"2024-06-04T16:19:10.013842+0000","last_undegraded":"2024-06-04T16:19:10.013842+0000","last_fullsized":"2024-06-04T16:19:10.013842+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_clean_scrub_stamp":"2024-06-04T16:09:25.601105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T00:15:31.709245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.14","version":"254'2","reported_seq":32,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:21:10.024719+0000","last_change":"2024-06-04T16:09:23.608188+0000","last_active":"2024-06-04T16:21:10.024719+0000","last_peered":"2024-06-04T16:21:10.024719+0000","last_clean":"2024-06-04T16:21:10.024719+0000","last_became_active":"2024-06-04T16:09:23.607906+0000","last_became_peered":"2024-06-04T16:09:23.607906+0000","last_unstale":"2024-06-04T16:21:10.024719+0000","last_undegraded":"2024-06-04T16:21:10.024719+0000","last_fullsized":"2024-06-04T16:21:10.024719+0000","mapping_epoch":246,"log_start":"0'0","ondisk_log_start":"0'0","created":246,"last_epoch_clean":247,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_clean_scrub_stamp":"2024-06-04T16:09:22.572686+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T17:08:32.670089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"64.15","version":"0'0","reported_seq":36,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:15.014464+0000","last_change":"2024-06-04T16:07:09.401959+0000","last_active":"2024-06-04T16:19:15.014464+0000","last_peered":"2024-06-04T16:19:15.014464+0000","last_clean":"2024-06-04T16:19:15.014464+0000","last_became_active":"2024-06-04T16:07:09.401608+0000","last_became_peered":"2024-06-04T16:07:09.401608+0000","last_unstale":"2024-06-04T16:19:15.014464+0000","last_undegraded":"2024-06-04T16:19:15.014464+0000","last_fullsized":"2024-06-04T16:19:15.014464+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":243,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:07:08.374534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:07:08.374534+0000","last_clean_scrub_stamp":"2024-06-04T16:07:08.374534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T23:24:21.547866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.17","version":"0'0","reported_seq":14,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:35.120672+0000","last_change":"2024-06-04T16:16:08.657806+0000","last_active":"2024-06-04T16:18:35.120672+0000","last_peered":"2024-06-04T16:18:35.120672+0000","last_clean":"2024-06-04T16:18:35.120672+0000","last_became_active":"2024-06-04T16:16:08.657535+0000","last_became_peered":"2024-06-04T16:16:08.657535+0000","last_unstale":"2024-06-04T16:18:35.120672+0000","last_undegraded":"2024-06-04T16:18:35.120672+0000","last_fullsized":"2024-06-04T16:18:35.120672+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_clean_scrub_stamp":"2024-06-04T16:16:07.631263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T02:31:34.399203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.16","version":"254'12","reported_seq":47,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:39.425811+0000","last_change":"2024-06-04T16:09:26.628516+0000","last_active":"2024-06-04T16:22:39.425811+0000","last_peered":"2024-06-04T16:22:39.425811+0000","last_clean":"2024-06-04T16:22:39.425811+0000","last_became_active":"2024-06-04T16:09:26.628237+0000","last_became_peered":"2024-06-04T16:09:26.628237+0000","last_unstale":"2024-06-04T16:22:39.425811+0000","last_undegraded":"2024-06-04T16:22:39.425811+0000","last_fullsized":"2024-06-04T16:22:39.425811+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_clean_scrub_stamp":"2024-06-04T16:09:25.601105+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T22:06:09.423503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":19,"num_read_kb":9311,"num_write":11,"num_write_kb":6237,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.15","version":"0'0","reported_seq":29,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:05.125028+0000","last_change":"2024-06-04T16:09:23.609111+0000","last_active":"2024-06-04T16:19:05.125028+0000","last_peered":"2024-06-04T16:19:05.125028+0000","last_clean":"2024-06-04T16:19:05.125028+0000","last_became_active":"2024-06-04T16:09:23.608801+0000","last_became_peered":"2024-06-04T16:09:23.608801+0000","last_unstale":"2024-06-04T16:19:05.125028+0000","last_undegraded":"2024-06-04T16:19:05.125028+0000","last_fullsized":"2024-06-04T16:19:05.125028+0000","mapping_epoch":246,"log_start":"0'0","ondisk_log_start":"0'0","created":246,"last_epoch_clean":247,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_clean_scrub_stamp":"2024-06-04T16:09:22.572686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T17:09:00.310675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"64.14","version":"251'30","reported_seq":117,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:55.011246+0000","last_change":"2024-06-04T16:07:09.404259+0000","last_active":"2024-06-04T16:18:55.011246+0000","last_peered":"2024-06-04T16:18:55.011246+0000","last_clean":"2024-06-04T16:18:55.011246+0000","last_became_active":"2024-06-04T16:07:09.403925+0000","last_became_peered":"2024-06-04T16:07:09.403925+0000","last_unstale":"2024-06-04T16:18:55.011246+0000","last_undegraded":"2024-06-04T16:18:55.011246+0000","last_fullsized":"2024-06-04T16:18:55.011246+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":243,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:07:08.374534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:07:08.374534+0000","last_clean_scrub_stamp":"2024-06-04T16:07:08.374534+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T23:42:39.058269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":154,"num_read_kb":107,"num_write":60,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.10","version":"0'0","reported_seq":14,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:30.008209+0000","last_change":"2024-06-04T16:16:08.656330+0000","last_active":"2024-06-04T16:18:30.008209+0000","last_peered":"2024-06-04T16:18:30.008209+0000","last_clean":"2024-06-04T16:18:30.008209+0000","last_became_active":"2024-06-04T16:16:08.656048+0000","last_became_peered":"2024-06-04T16:16:08.656048+0000","last_unstale":"2024-06-04T16:18:30.008209+0000","last_undegraded":"2024-06-04T16:18:30.008209+0000","last_fullsized":"2024-06-04T16:18:30.008209+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_clean_scrub_stamp":"2024-06-04T16:16:07.631263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T21:21:52.265223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.11","version":"251'8","reported_seq":39,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:50.011048+0000","last_change":"2024-06-04T16:09:26.626519+0000","last_active":"2024-06-04T16:18:50.011048+0000","last_peered":"2024-06-04T16:18:50.011048+0000","last_clean":"2024-06-04T16:18:50.011048+0000","last_became_active":"2024-06-04T16:09:26.624122+0000","last_became_peered":"2024-06-04T16:09:26.624122+0000","last_unstale":"2024-06-04T16:18:50.011048+0000","last_undegraded":"2024-06-04T16:18:50.011048+0000","last_fullsized":"2024-06-04T16:18:50.011048+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_clean_scrub_stamp":"2024-06-04T16:09:25.601105+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T21:22:14.386034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":17410,"num_write":17,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.12","version":"254'4","reported_seq":34,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:39.417842+0000","last_change":"2024-06-04T16:09:23.613003+0000","last_active":"2024-06-04T16:22:39.417842+0000","last_peered":"2024-06-04T16:22:39.417842+0000","last_clean":"2024-06-04T16:22:39.417842+0000","last_became_active":"2024-06-04T16:09:23.612699+0000","last_became_peered":"2024-06-04T16:09:23.612699+0000","last_unstale":"2024-06-04T16:22:39.417842+0000","last_undegraded":"2024-06-04T16:22:39.417842+0000","last_fullsized":"2024-06-04T16:22:39.417842+0000","mapping_epoch":246,"log_start":"0'0","ondisk_log_start":"0'0","created":246,"last_epoch_clean":247,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_clean_scrub_stamp":"2024-06-04T16:09:22.572686+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T22:44:45.643881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4,"num_write":4,"num_write_kb":1028,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"64.13","version":"254'35","reported_seq":138,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:50.010572+0000","last_change":"2024-06-04T16:07:09.511921+0000","last_active":"2024-06-04T16:18:50.010572+0000","last_peered":"2024-06-04T16:18:50.010572+0000","last_clean":"2024-06-04T16:18:50.010572+0000","last_became_active":"2024-06-04T16:07:09.511607+0000","last_became_peered":"2024-06-04T16:07:09.511607+0000","last_unstale":"2024-06-04T16:18:50.010572+0000","last_undegraded":"2024-06-04T16:18:50.010572+0000","last_fullsized":"2024-06-04T16:18:50.010572+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":243,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:07:08.374534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:07:08.374534+0000","last_clean_scrub_stamp":"2024-06-04T16:07:08.374534+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T21:14:21.163538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":198,"num_read_kb":144,"num_write":54,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.11","version":"0'0","reported_seq":14,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:30.008255+0000","last_change":"2024-06-04T16:16:08.649192+0000","last_active":"2024-06-04T16:18:30.008255+0000","last_peered":"2024-06-04T16:18:30.008255+0000","last_clean":"2024-06-04T16:18:30.008255+0000","last_became_active":"2024-06-04T16:16:08.648899+0000","last_became_peered":"2024-06-04T16:16:08.648899+0000","last_unstale":"2024-06-04T16:18:30.008255+0000","last_undegraded":"2024-06-04T16:18:30.008255+0000","last_fullsized":"2024-06-04T16:18:30.008255+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_clean_scrub_stamp":"2024-06-04T16:16:07.631263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T23:23:27.649414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.10","version":"254'2","reported_seq":27,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:39.426038+0000","last_change":"2024-06-04T16:09:26.628742+0000","last_active":"2024-06-04T16:22:39.426038+0000","last_peered":"2024-06-04T16:22:39.426038+0000","last_clean":"2024-06-04T16:22:39.426038+0000","last_became_active":"2024-06-04T16:09:26.628442+0000","last_became_peered":"2024-06-04T16:09:26.628442+0000","last_unstale":"2024-06-04T16:22:39.426038+0000","last_undegraded":"2024-06-04T16:22:39.426038+0000","last_fullsized":"2024-06-04T16:22:39.426038+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_clean_scrub_stamp":"2024-06-04T16:09:25.601105+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.13","version":"254'2","reported_seq":32,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:21:05.024153+0000","last_change":"2024-06-04T16:09:23.609979+0000","last_active":"2024-06-04T16:21:05.024153+0000","last_peered":"2024-06-04T16:21:05.024153+0000","last_clean":"2024-06-04T16:21:05.024153+0000","last_became_active":"2024-06-04T16:09:23.609536+0000","last_became_peered":"2024-06-04T16:09:23.609536+0000","last_unstale":"2024-06-04T16:21:05.024153+0000","last_undegraded":"2024-06-04T16:21:05.024153+0000","last_fullsized":"2024-06-04T16:21:05.024153+0000","mapping_epoch":246,"log_start":"0'0","ondisk_log_start":"0'0","created":246,"last_epoch_clean":247,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_clean_scrub_stamp":"2024-06-04T16:09:22.572686+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T16:56:59.952240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"64.12","version":"254'6","reported_seq":54,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:50.008991+0000","last_change":"2024-06-04T16:07:09.403628+0000","last_active":"2024-06-04T16:18:50.008991+0000","last_peered":"2024-06-04T16:18:50.008991+0000","last_clean":"2024-06-04T16:18:50.008991+0000","last_became_active":"2024-06-04T16:07:09.403352+0000","last_became_peered":"2024-06-04T16:07:09.403352+0000","last_unstale":"2024-06-04T16:18:50.008991+0000","last_undegraded":"2024-06-04T16:18:50.008991+0000","last_fullsized":"2024-06-04T16:18:50.008991+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":243,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:07:08.374534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:07:08.374534+0000","last_clean_scrub_stamp":"2024-06-04T16:07:08.374534+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T21:48:39.709806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":24,"num_write":11,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.12","version":"0'0","reported_seq":14,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:30.006539+0000","last_change":"2024-06-04T16:16:08.654940+0000","last_active":"2024-06-04T16:18:30.006539+0000","last_peered":"2024-06-04T16:18:30.006539+0000","last_clean":"2024-06-04T16:18:30.006539+0000","last_became_active":"2024-06-04T16:16:08.654624+0000","last_became_peered":"2024-06-04T16:16:08.654624+0000","last_unstale":"2024-06-04T16:18:30.006539+0000","last_undegraded":"2024-06-04T16:18:30.006539+0000","last_fullsized":"2024-06-04T16:18:30.006539+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_clean_scrub_stamp":"2024-06-04T16:16:07.631263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T02:28:30.956243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.13","version":"254'12","reported_seq":50,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:39.554127+0000","last_change":"2024-06-04T16:09:26.621968+0000","last_active":"2024-06-04T16:22:39.554127+0000","last_peered":"2024-06-04T16:22:39.554127+0000","last_clean":"2024-06-04T16:22:39.554127+0000","last_became_active":"2024-06-04T16:09:26.621494+0000","last_became_peered":"2024-06-04T16:09:26.621494+0000","last_unstale":"2024-06-04T16:22:39.554127+0000","last_undegraded":"2024-06-04T16:22:39.554127+0000","last_fullsized":"2024-06-04T16:22:39.554127+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_clean_scrub_stamp":"2024-06-04T16:09:25.601105+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":21,"num_read_kb":22532,"num_write":20,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.10","version":"254'7","reported_seq":43,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:21:05.142247+0000","last_change":"2024-06-04T16:09:23.606894+0000","last_active":"2024-06-04T16:21:05.142247+0000","last_peered":"2024-06-04T16:21:05.142247+0000","last_clean":"2024-06-04T16:21:05.142247+0000","last_became_active":"2024-06-04T16:09:23.606050+0000","last_became_peered":"2024-06-04T16:09:23.606050+0000","last_unstale":"2024-06-04T16:21:05.142247+0000","last_undegraded":"2024-06-04T16:21:05.142247+0000","last_fullsized":"2024-06-04T16:21:05.142247+0000","mapping_epoch":246,"log_start":"0'0","ondisk_log_start":"0'0","created":246,"last_epoch_clean":247,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_clean_scrub_stamp":"2024-06-04T16:09:22.572686+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T19:53:24.462326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":11,"num_read_kb":20482,"num_write":11,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"64.11","version":"251'138","reported_seq":475,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:50.008957+0000","last_change":"2024-06-04T16:07:09.511375+0000","last_active":"2024-06-04T16:18:50.008957+0000","last_peered":"2024-06-04T16:18:50.008957+0000","last_clean":"2024-06-04T16:18:50.008957+0000","last_became_active":"2024-06-04T16:07:09.511098+0000","last_became_peered":"2024-06-04T16:07:09.511098+0000","last_unstale":"2024-06-04T16:18:50.008957+0000","last_undegraded":"2024-06-04T16:18:50.008957+0000","last_fullsized":"2024-06-04T16:18:50.008957+0000","mapping_epoch":243,"log_start":"251'100","ondisk_log_start":"251'100","created":243,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:07:08.374534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:07:08.374534+0000","last_clean_scrub_stamp":"2024-06-04T16:07:08.374534+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T17:37:17.042544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":871,"num_read_kb":642,"num_write":155,"num_write_kb":133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.13","version":"254'1","reported_seq":15,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:30.119909+0000","last_change":"2024-06-04T16:16:08.657706+0000","last_active":"2024-06-04T16:18:30.119909+0000","last_peered":"2024-06-04T16:18:30.119909+0000","last_clean":"2024-06-04T16:18:30.119909+0000","last_became_active":"2024-06-04T16:16:08.657428+0000","last_became_peered":"2024-06-04T16:16:08.657428+0000","last_unstale":"2024-06-04T16:18:30.119909+0000","last_undegraded":"2024-06-04T16:18:30.119909+0000","last_fullsized":"2024-06-04T16:18:30.119909+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_clean_scrub_stamp":"2024-06-04T16:16:07.631263+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T19:11:05.041077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.12","version":"254'6","reported_seq":38,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:39.409568+0000","last_change":"2024-06-04T16:09:26.623554+0000","last_active":"2024-06-04T16:22:39.409568+0000","last_peered":"2024-06-04T16:22:39.409568+0000","last_clean":"2024-06-04T16:22:39.409568+0000","last_became_active":"2024-06-04T16:09:26.623285+0000","last_became_peered":"2024-06-04T16:09:26.623285+0000","last_unstale":"2024-06-04T16:22:39.409568+0000","last_undegraded":"2024-06-04T16:22:39.409568+0000","last_fullsized":"2024-06-04T16:22:39.409568+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_clean_scrub_stamp":"2024-06-04T16:09:25.601105+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":18434,"num_write":5,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.11","version":"254'2","reported_seq":34,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:39.410365+0000","last_change":"2024-06-04T16:09:23.607360+0000","last_active":"2024-06-04T16:22:39.410365+0000","last_peered":"2024-06-04T16:22:39.410365+0000","last_clean":"2024-06-04T16:22:39.410365+0000","last_became_active":"2024-06-04T16:09:23.607048+0000","last_became_peered":"2024-06-04T16:09:23.607048+0000","last_unstale":"2024-06-04T16:22:39.410365+0000","last_undegraded":"2024-06-04T16:22:39.410365+0000","last_fullsized":"2024-06-04T16:22:39.410365+0000","mapping_epoch":246,"log_start":"0'0","ondisk_log_start":"0'0","created":246,"last_epoch_clean":247,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_clean_scrub_stamp":"2024-06-04T16:09:22.572686+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8192,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"64.10","version":"251'6","reported_seq":54,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:50.122936+0000","last_change":"2024-06-04T16:07:09.401888+0000","last_active":"2024-06-04T16:18:50.122936+0000","last_peered":"2024-06-04T16:18:50.122936+0000","last_clean":"2024-06-04T16:18:50.122936+0000","last_became_active":"2024-06-04T16:07:09.401445+0000","last_became_peered":"2024-06-04T16:07:09.401445+0000","last_unstale":"2024-06-04T16:18:50.122936+0000","last_undegraded":"2024-06-04T16:18:50.122936+0000","last_fullsized":"2024-06-04T16:18:50.122936+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":243,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:07:08.374534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:07:08.374534+0000","last_clean_scrub_stamp":"2024-06-04T16:07:08.374534+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T02:48:14.306445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":24,"num_write":11,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.c","version":"254'1","reported_seq":15,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:25.119153+0000","last_change":"2024-06-04T16:16:08.664755+0000","last_active":"2024-06-04T16:18:25.119153+0000","last_peered":"2024-06-04T16:18:25.119153+0000","last_clean":"2024-06-04T16:18:25.119153+0000","last_became_active":"2024-06-04T16:16:08.664436+0000","last_became_peered":"2024-06-04T16:16:08.664436+0000","last_unstale":"2024-06-04T16:18:25.119153+0000","last_undegraded":"2024-06-04T16:18:25.119153+0000","last_fullsized":"2024-06-04T16:18:25.119153+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_clean_scrub_stamp":"2024-06-04T16:16:07.631263+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T23:11:08.299853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.d","version":"251'2","reported_seq":27,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:30.007548+0000","last_change":"2024-06-04T16:09:26.624040+0000","last_active":"2024-06-04T16:18:30.007548+0000","last_peered":"2024-06-04T16:18:30.007548+0000","last_clean":"2024-06-04T16:18:30.007548+0000","last_became_active":"2024-06-04T16:09:26.622747+0000","last_became_peered":"2024-06-04T16:09:26.622747+0000","last_unstale":"2024-06-04T16:18:30.007548+0000","last_undegraded":"2024-06-04T16:18:30.007548+0000","last_fullsized":"2024-06-04T16:18:30.007548+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_clean_scrub_stamp":"2024-06-04T16:09:25.601105+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T19:09:01.319407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.e","version":"254'10","reported_seq":47,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:20:40.021289+0000","last_change":"2024-06-04T16:09:23.609139+0000","last_active":"2024-06-04T16:20:40.021289+0000","last_peered":"2024-06-04T16:20:40.021289+0000","last_clean":"2024-06-04T16:20:40.021289+0000","last_became_active":"2024-06-04T16:09:23.608866+0000","last_became_peered":"2024-06-04T16:09:23.608866+0000","last_unstale":"2024-06-04T16:20:40.021289+0000","last_undegraded":"2024-06-04T16:20:40.021289+0000","last_fullsized":"2024-06-04T16:20:40.021289+0000","mapping_epoch":246,"log_start":"0'0","ondisk_log_start":"0'0","created":246,"last_epoch_clean":247,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_clean_scrub_stamp":"2024-06-04T16:09:22.572686+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T21:04:44.000874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":13,"num_read_kb":5122,"num_write":19,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"64.f","version":"251'6","reported_seq":52,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:20:40.126916+0000","last_change":"2024-06-04T16:07:09.401084+0000","last_active":"2024-06-04T16:20:40.126916+0000","last_peered":"2024-06-04T16:20:40.126916+0000","last_clean":"2024-06-04T16:20:40.126916+0000","last_became_active":"2024-06-04T16:07:09.400807+0000","last_became_peered":"2024-06-04T16:07:09.400807+0000","last_unstale":"2024-06-04T16:20:40.126916+0000","last_undegraded":"2024-06-04T16:20:40.126916+0000","last_fullsized":"2024-06-04T16:20:40.126916+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":243,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:07:08.374534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:07:08.374534+0000","last_clean_scrub_stamp":"2024-06-04T16:07:08.374534+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":19,"num_write":12,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.d","version":"0'0","reported_seq":14,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:25.119174+0000","last_change":"2024-06-04T16:16:08.657069+0000","last_active":"2024-06-04T16:18:25.119174+0000","last_peered":"2024-06-04T16:18:25.119174+0000","last_clean":"2024-06-04T16:18:25.119174+0000","last_became_active":"2024-06-04T16:16:08.656726+0000","last_became_peered":"2024-06-04T16:16:08.656726+0000","last_unstale":"2024-06-04T16:18:25.119174+0000","last_undegraded":"2024-06-04T16:18:25.119174+0000","last_fullsized":"2024-06-04T16:18:25.119174+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_clean_scrub_stamp":"2024-06-04T16:16:07.631263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T18:03:32.263500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.c","version":"254'3","reported_seq":29,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:39.555232+0000","last_change":"2024-06-04T16:09:26.628320+0000","last_active":"2024-06-04T16:22:39.555232+0000","last_peered":"2024-06-04T16:22:39.555232+0000","last_clean":"2024-06-04T16:22:39.555232+0000","last_became_active":"2024-06-04T16:09:26.627994+0000","last_became_peered":"2024-06-04T16:09:26.627994+0000","last_unstale":"2024-06-04T16:22:39.555232+0000","last_undegraded":"2024-06-04T16:22:39.555232+0000","last_fullsized":"2024-06-04T16:22:39.555232+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_clean_scrub_stamp":"2024-06-04T16:09:25.601105+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8192,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.f","version":"254'2","reported_seq":33,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:20:40.138740+0000","last_change":"2024-06-04T16:09:23.609586+0000","last_active":"2024-06-04T16:20:40.138740+0000","last_peered":"2024-06-04T16:20:40.138740+0000","last_clean":"2024-06-04T16:20:40.138740+0000","last_became_active":"2024-06-04T16:09:23.609283+0000","last_became_peered":"2024-06-04T16:09:23.609283+0000","last_unstale":"2024-06-04T16:20:40.138740+0000","last_undegraded":"2024-06-04T16:20:40.138740+0000","last_fullsized":"2024-06-04T16:20:40.138740+0000","mapping_epoch":246,"log_start":"0'0","ondisk_log_start":"0'0","created":246,"last_epoch_clean":247,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_clean_scrub_stamp":"2024-06-04T16:09:22.572686+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T19:30:03.495311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"64.e","version":"254'20","reported_seq":93,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:25.005990+0000","last_change":"2024-06-04T16:07:09.401774+0000","last_active":"2024-06-04T16:18:25.005990+0000","last_peered":"2024-06-04T16:18:25.005990+0000","last_clean":"2024-06-04T16:18:25.005990+0000","last_became_active":"2024-06-04T16:07:09.401515+0000","last_became_peered":"2024-06-04T16:07:09.401515+0000","last_unstale":"2024-06-04T16:18:25.005990+0000","last_undegraded":"2024-06-04T16:18:25.005990+0000","last_fullsized":"2024-06-04T16:18:25.005990+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":243,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:07:08.374534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:07:08.374534+0000","last_clean_scrub_stamp":"2024-06-04T16:07:08.374534+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T00:16:43.451325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":108,"num_read_kb":75,"num_write":37,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.e","version":"0'0","reported_seq":14,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:25.007601+0000","last_change":"2024-06-04T16:16:08.657545+0000","last_active":"2024-06-04T16:18:25.007601+0000","last_peered":"2024-06-04T16:18:25.007601+0000","last_clean":"2024-06-04T16:18:25.007601+0000","last_became_active":"2024-06-04T16:16:08.657279+0000","last_became_peered":"2024-06-04T16:16:08.657279+0000","last_unstale":"2024-06-04T16:18:25.007601+0000","last_undegraded":"2024-06-04T16:18:25.007601+0000","last_fullsized":"2024-06-04T16:18:25.007601+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_clean_scrub_stamp":"2024-06-04T16:16:07.631263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T23:08:35.507441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.f","version":"254'9","reported_seq":43,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:20:45.139442+0000","last_change":"2024-06-04T16:09:26.623833+0000","last_active":"2024-06-04T16:20:45.139442+0000","last_peered":"2024-06-04T16:20:45.139442+0000","last_clean":"2024-06-04T16:20:45.139442+0000","last_became_active":"2024-06-04T16:09:26.623307+0000","last_became_peered":"2024-06-04T16:09:26.623307+0000","last_unstale":"2024-06-04T16:20:45.139442+0000","last_undegraded":"2024-06-04T16:20:45.139442+0000","last_fullsized":"2024-06-04T16:20:45.139442+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_clean_scrub_stamp":"2024-06-04T16:09:25.601105+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T23:15:04.575909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":8194,"num_write":13,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.c","version":"254'5","reported_seq":36,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:20:40.026079+0000","last_change":"2024-06-04T16:09:23.612714+0000","last_active":"2024-06-04T16:20:40.026079+0000","last_peered":"2024-06-04T16:20:40.026079+0000","last_clean":"2024-06-04T16:20:40.026079+0000","last_became_active":"2024-06-04T16:09:23.612445+0000","last_became_peered":"2024-06-04T16:09:23.612445+0000","last_unstale":"2024-06-04T16:20:40.026079+0000","last_undegraded":"2024-06-04T16:20:40.026079+0000","last_fullsized":"2024-06-04T16:20:40.026079+0000","mapping_epoch":246,"log_start":"0'0","ondisk_log_start":"0'0","created":246,"last_epoch_clean":247,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_clean_scrub_stamp":"2024-06-04T16:09:22.572686+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T19:29:18.909595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":1024,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"64.d","version":"251'24","reported_seq":105,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:25.005958+0000","last_change":"2024-06-04T16:07:09.511802+0000","last_active":"2024-06-04T16:18:25.005958+0000","last_peered":"2024-06-04T16:18:25.005958+0000","last_clean":"2024-06-04T16:18:25.005958+0000","last_became_active":"2024-06-04T16:07:09.511172+0000","last_became_peered":"2024-06-04T16:07:09.511172+0000","last_unstale":"2024-06-04T16:18:25.005958+0000","last_undegraded":"2024-06-04T16:18:25.005958+0000","last_fullsized":"2024-06-04T16:18:25.005958+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":243,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:07:08.374534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:07:08.374534+0000","last_clean_scrub_stamp":"2024-06-04T16:07:08.374534+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T20:08:28.763067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":134,"num_read_kb":91,"num_write":39,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.f","version":"0'0","reported_seq":14,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:25.119219+0000","last_change":"2024-06-04T16:16:08.662500+0000","last_active":"2024-06-04T16:18:25.119219+0000","last_peered":"2024-06-04T16:18:25.119219+0000","last_clean":"2024-06-04T16:18:25.119219+0000","last_became_active":"2024-06-04T16:16:08.662182+0000","last_became_peered":"2024-06-04T16:16:08.662182+0000","last_unstale":"2024-06-04T16:18:25.119219+0000","last_undegraded":"2024-06-04T16:18:25.119219+0000","last_fullsized":"2024-06-04T16:18:25.119219+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_clean_scrub_stamp":"2024-06-04T16:16:07.631263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T00:09:54.410059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.e","version":"0'0","reported_seq":23,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:30.119962+0000","last_change":"2024-06-04T16:09:26.629323+0000","last_active":"2024-06-04T16:18:30.119962+0000","last_peered":"2024-06-04T16:18:30.119962+0000","last_clean":"2024-06-04T16:18:30.119962+0000","last_became_active":"2024-06-04T16:09:26.629039+0000","last_became_peered":"2024-06-04T16:09:26.629039+0000","last_unstale":"2024-06-04T16:18:30.119962+0000","last_undegraded":"2024-06-04T16:18:30.119962+0000","last_fullsized":"2024-06-04T16:18:30.119962+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_clean_scrub_stamp":"2024-06-04T16:09:25.601105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T17:17:10.026858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.d","version":"254'7","reported_seq":43,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:39.533393+0000","last_change":"2024-06-04T16:09:23.607472+0000","last_active":"2024-06-04T16:22:39.533393+0000","last_peered":"2024-06-04T16:22:39.533393+0000","last_clean":"2024-06-04T16:22:39.533393+0000","last_became_active":"2024-06-04T16:09:23.606695+0000","last_became_peered":"2024-06-04T16:09:23.606695+0000","last_unstale":"2024-06-04T16:22:39.533393+0000","last_undegraded":"2024-06-04T16:22:39.533393+0000","last_fullsized":"2024-06-04T16:22:39.533393+0000","mapping_epoch":246,"log_start":"0'0","ondisk_log_start":"0'0","created":246,"last_epoch_clean":247,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_clean_scrub_stamp":"2024-06-04T16:09:22.572686+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":20480,"num_write":12,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"64.c","version":"251'31","reported_seq":124,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:20:40.016116+0000","last_change":"2024-06-04T16:07:09.511067+0000","last_active":"2024-06-04T16:20:40.016116+0000","last_peered":"2024-06-04T16:20:40.016116+0000","last_clean":"2024-06-04T16:20:40.016116+0000","last_became_active":"2024-06-04T16:07:09.510728+0000","last_became_peered":"2024-06-04T16:07:09.510728+0000","last_unstale":"2024-06-04T16:20:40.016116+0000","last_undegraded":"2024-06-04T16:20:40.016116+0000","last_fullsized":"2024-06-04T16:20:40.016116+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":243,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:07:08.374534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:07:08.374534+0000","last_clean_scrub_stamp":"2024-06-04T16:07:08.374534+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":168,"num_read_kb":120,"num_write":55,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.8","version":"0'0","reported_seq":16,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:40.030148+0000","last_change":"2024-06-04T16:16:08.664471+0000","last_active":"2024-06-04T16:22:40.030148+0000","last_peered":"2024-06-04T16:22:40.030148+0000","last_clean":"2024-06-04T16:22:40.030148+0000","last_became_active":"2024-06-04T16:16:08.664198+0000","last_became_peered":"2024-06-04T16:16:08.664198+0000","last_unstale":"2024-06-04T16:22:40.030148+0000","last_undegraded":"2024-06-04T16:22:40.030148+0000","last_fullsized":"2024-06-04T16:22:40.030148+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_clean_scrub_stamp":"2024-06-04T16:16:07.631263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.9","version":"254'6","reported_seq":35,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:39.426195+0000","last_change":"2024-06-04T16:09:26.626757+0000","last_active":"2024-06-04T16:22:39.426195+0000","last_peered":"2024-06-04T16:22:39.426195+0000","last_clean":"2024-06-04T16:22:39.426195+0000","last_became_active":"2024-06-04T16:09:26.625999+0000","last_became_peered":"2024-06-04T16:09:26.625999+0000","last_unstale":"2024-06-04T16:22:39.426195+0000","last_undegraded":"2024-06-04T16:22:39.426195+0000","last_fullsized":"2024-06-04T16:22:39.426195+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_clean_scrub_stamp":"2024-06-04T16:09:25.601105+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T19:40:29.538335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":9216,"num_write":6,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.a","version":"254'3","reported_seq":34,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:39.567931+0000","last_change":"2024-06-04T16:09:23.601101+0000","last_active":"2024-06-04T16:22:39.567931+0000","last_peered":"2024-06-04T16:22:39.567931+0000","last_clean":"2024-06-04T16:22:39.567931+0000","last_became_active":"2024-06-04T16:09:23.600752+0000","last_became_peered":"2024-06-04T16:09:23.600752+0000","last_unstale":"2024-06-04T16:22:39.567931+0000","last_undegraded":"2024-06-04T16:22:39.567931+0000","last_fullsized":"2024-06-04T16:22:39.567931+0000","mapping_epoch":246,"log_start":"0'0","ondisk_log_start":"0'0","created":246,"last_epoch_clean":247,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_clean_scrub_stamp":"2024-06-04T16:09:22.572686+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"64.b","version":"251'21","reported_seq":96,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:25.119108+0000","last_change":"2024-06-04T16:07:09.513384+0000","last_active":"2024-06-04T16:18:25.119108+0000","last_peered":"2024-06-04T16:18:25.119108+0000","last_clean":"2024-06-04T16:18:25.119108+0000","last_became_active":"2024-06-04T16:07:09.513020+0000","last_became_peered":"2024-06-04T16:07:09.513020+0000","last_unstale":"2024-06-04T16:18:25.119108+0000","last_undegraded":"2024-06-04T16:18:25.119108+0000","last_fullsized":"2024-06-04T16:18:25.119108+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":243,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:07:08.374534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:07:08.374534+0000","last_clean_scrub_stamp":"2024-06-04T16:07:08.374534+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T17:46:59.707579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":114,"num_read_kb":81,"num_write":38,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.9","version":"0'0","reported_seq":15,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:20:30.020087+0000","last_change":"2024-06-04T16:16:08.658344+0000","last_active":"2024-06-04T16:20:30.020087+0000","last_peered":"2024-06-04T16:20:30.020087+0000","last_clean":"2024-06-04T16:20:30.020087+0000","last_became_active":"2024-06-04T16:16:08.658076+0000","last_became_peered":"2024-06-04T16:16:08.658076+0000","last_unstale":"2024-06-04T16:20:30.020087+0000","last_undegraded":"2024-06-04T16:20:30.020087+0000","last_fullsized":"2024-06-04T16:20:30.020087+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_clean_scrub_stamp":"2024-06-04T16:16:07.631263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T17:29:18.849209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.8","version":"254'7","reported_seq":32,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:39.410471+0000","last_change":"2024-06-04T16:09:26.624229+0000","last_active":"2024-06-04T16:22:39.410471+0000","last_peered":"2024-06-04T16:22:39.410471+0000","last_clean":"2024-06-04T16:22:39.410471+0000","last_became_active":"2024-06-04T16:09:26.623966+0000","last_became_peered":"2024-06-04T16:09:26.623966+0000","last_unstale":"2024-06-04T16:22:39.410471+0000","last_undegraded":"2024-06-04T16:22:39.410471+0000","last_fullsized":"2024-06-04T16:22:39.410471+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_clean_scrub_stamp":"2024-06-04T16:09:25.601105+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T21:11:02.568495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4096,"num_write":12,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.b","version":"254'4","reported_seq":35,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:39.444080+0000","last_change":"2024-06-04T16:09:23.613436+0000","last_active":"2024-06-04T16:22:39.444080+0000","last_peered":"2024-06-04T16:22:39.444080+0000","last_clean":"2024-06-04T16:22:39.444080+0000","last_became_active":"2024-06-04T16:09:23.613130+0000","last_became_peered":"2024-06-04T16:09:23.613130+0000","last_unstale":"2024-06-04T16:22:39.444080+0000","last_undegraded":"2024-06-04T16:22:39.444080+0000","last_fullsized":"2024-06-04T16:22:39.444080+0000","mapping_epoch":246,"log_start":"0'0","ondisk_log_start":"0'0","created":246,"last_epoch_clean":247,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_clean_scrub_stamp":"2024-06-04T16:09:22.572686+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T19:22:58.043042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3775,"num_write":4,"num_write_kb":3775,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"64.a","version":"251'22","reported_seq":100,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:20:15.022440+0000","last_change":"2024-06-04T16:07:09.404274+0000","last_active":"2024-06-04T16:20:15.022440+0000","last_peered":"2024-06-04T16:20:15.022440+0000","last_clean":"2024-06-04T16:20:15.022440+0000","last_became_active":"2024-06-04T16:07:09.403980+0000","last_became_peered":"2024-06-04T16:07:09.403980+0000","last_unstale":"2024-06-04T16:20:15.022440+0000","last_undegraded":"2024-06-04T16:20:15.022440+0000","last_fullsized":"2024-06-04T16:20:15.022440+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":243,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:07:08.374534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:07:08.374534+0000","last_clean_scrub_stamp":"2024-06-04T16:07:08.374534+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T01:30:42.556639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":122,"num_read_kb":87,"num_write":38,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.a","version":"0'0","reported_seq":16,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:40.027547+0000","last_change":"2024-06-04T16:16:08.661712+0000","last_active":"2024-06-04T16:22:40.027547+0000","last_peered":"2024-06-04T16:22:40.027547+0000","last_clean":"2024-06-04T16:22:40.027547+0000","last_became_active":"2024-06-04T16:16:08.661413+0000","last_became_peered":"2024-06-04T16:16:08.661413+0000","last_unstale":"2024-06-04T16:22:40.027547+0000","last_undegraded":"2024-06-04T16:22:40.027547+0000","last_fullsized":"2024-06-04T16:22:40.027547+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_clean_scrub_stamp":"2024-06-04T16:16:07.631263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.b","version":"254'4","reported_seq":31,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:20:45.021805+0000","last_change":"2024-06-04T16:09:26.622990+0000","last_active":"2024-06-04T16:20:45.021805+0000","last_peered":"2024-06-04T16:20:45.021805+0000","last_clean":"2024-06-04T16:20:45.021805+0000","last_became_active":"2024-06-04T16:09:26.622600+0000","last_became_peered":"2024-06-04T16:09:26.622600+0000","last_unstale":"2024-06-04T16:20:45.021805+0000","last_undegraded":"2024-06-04T16:20:45.021805+0000","last_fullsized":"2024-06-04T16:20:45.021805+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_clean_scrub_stamp":"2024-06-04T16:09:25.601105+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T17:25:05.424763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":1032,"num_write":4,"num_write_kb":1028,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.8","version":"251'2","reported_seq":35,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:25.025887+0000","last_change":"2024-06-04T16:09:23.610808+0000","last_active":"2024-06-04T16:22:25.025887+0000","last_peered":"2024-06-04T16:22:25.025887+0000","last_clean":"2024-06-04T16:22:25.025887+0000","last_became_active":"2024-06-04T16:09:23.610525+0000","last_became_peered":"2024-06-04T16:09:23.610525+0000","last_unstale":"2024-06-04T16:22:25.025887+0000","last_undegraded":"2024-06-04T16:22:25.025887+0000","last_fullsized":"2024-06-04T16:22:25.025887+0000","mapping_epoch":246,"log_start":"0'0","ondisk_log_start":"0'0","created":246,"last_epoch_clean":247,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_clean_scrub_stamp":"2024-06-04T16:09:22.572686+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"64.9","version":"251'14","reported_seq":79,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:20:10.022040+0000","last_change":"2024-06-04T16:07:09.403769+0000","last_active":"2024-06-04T16:20:10.022040+0000","last_peered":"2024-06-04T16:20:10.022040+0000","last_clean":"2024-06-04T16:20:10.022040+0000","last_became_active":"2024-06-04T16:07:09.403227+0000","last_became_peered":"2024-06-04T16:07:09.403227+0000","last_unstale":"2024-06-04T16:20:10.022040+0000","last_undegraded":"2024-06-04T16:20:10.022040+0000","last_fullsized":"2024-06-04T16:20:10.022040+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":243,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:07:08.374534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:07:08.374534+0000","last_clean_scrub_stamp":"2024-06-04T16:07:08.374534+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T18:26:06.974591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":56,"num_write":27,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.b","version":"0'0","reported_seq":14,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:25.006788+0000","last_change":"2024-06-04T16:16:08.660998+0000","last_active":"2024-06-04T16:18:25.006788+0000","last_peered":"2024-06-04T16:18:25.006788+0000","last_clean":"2024-06-04T16:18:25.006788+0000","last_became_active":"2024-06-04T16:16:08.660717+0000","last_became_peered":"2024-06-04T16:16:08.660717+0000","last_unstale":"2024-06-04T16:18:25.006788+0000","last_undegraded":"2024-06-04T16:18:25.006788+0000","last_fullsized":"2024-06-04T16:18:25.006788+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_clean_scrub_stamp":"2024-06-04T16:16:07.631263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T03:13:46.348557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.a","version":"254'2","reported_seq":28,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:30.154965+0000","last_change":"2024-06-04T16:09:26.620380+0000","last_active":"2024-06-04T16:22:30.154965+0000","last_peered":"2024-06-04T16:22:30.154965+0000","last_clean":"2024-06-04T16:22:30.154965+0000","last_became_active":"2024-06-04T16:09:26.620119+0000","last_became_peered":"2024-06-04T16:09:26.620119+0000","last_unstale":"2024-06-04T16:22:30.154965+0000","last_undegraded":"2024-06-04T16:22:30.154965+0000","last_fullsized":"2024-06-04T16:22:30.154965+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_clean_scrub_stamp":"2024-06-04T16:09:25.601105+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T18:51:09.607155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8192,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.9","version":"251'5","reported_seq":41,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:20:15.022798+0000","last_change":"2024-06-04T16:09:23.607975+0000","last_active":"2024-06-04T16:20:15.022798+0000","last_peered":"2024-06-04T16:20:15.022798+0000","last_clean":"2024-06-04T16:20:15.022798+0000","last_became_active":"2024-06-04T16:09:23.607666+0000","last_became_peered":"2024-06-04T16:09:23.607666+0000","last_unstale":"2024-06-04T16:20:15.022798+0000","last_undegraded":"2024-06-04T16:20:15.022798+0000","last_fullsized":"2024-06-04T16:20:15.022798+0000","mapping_epoch":246,"log_start":"0'0","ondisk_log_start":"0'0","created":246,"last_epoch_clean":247,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_clean_scrub_stamp":"2024-06-04T16:09:22.572686+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T16:30:58.550630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":16386,"num_write":9,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"64.8","version":"251'8","reported_seq":61,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:20:10.017783+0000","last_change":"2024-06-04T16:07:09.405213+0000","last_active":"2024-06-04T16:20:10.017783+0000","last_peered":"2024-06-04T16:20:10.017783+0000","last_clean":"2024-06-04T16:20:10.017783+0000","last_became_active":"2024-06-04T16:07:09.404928+0000","last_became_peered":"2024-06-04T16:07:09.404928+0000","last_unstale":"2024-06-04T16:20:10.017783+0000","last_undegraded":"2024-06-04T16:20:10.017783+0000","last_fullsized":"2024-06-04T16:20:10.017783+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":243,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:07:08.374534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:07:08.374534+0000","last_clean_scrub_stamp":"2024-06-04T16:07:08.374534+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T19:53:15.255308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":32,"num_write":14,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.4","version":"0'0","reported_seq":15,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:20:20.023650+0000","last_change":"2024-06-04T16:16:08.663046+0000","last_active":"2024-06-04T16:20:20.023650+0000","last_peered":"2024-06-04T16:20:20.023650+0000","last_clean":"2024-06-04T16:20:20.023650+0000","last_became_active":"2024-06-04T16:16:08.662732+0000","last_became_peered":"2024-06-04T16:16:08.662732+0000","last_unstale":"2024-06-04T16:20:20.023650+0000","last_undegraded":"2024-06-04T16:20:20.023650+0000","last_fullsized":"2024-06-04T16:20:20.023650+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_clean_scrub_stamp":"2024-06-04T16:16:07.631263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T19:10:09.410318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.5","version":"254'2","reported_seq":27,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:00.037728+0000","last_change":"2024-06-04T16:09:26.624497+0000","last_active":"2024-06-04T16:22:00.037728+0000","last_peered":"2024-06-04T16:22:00.037728+0000","last_clean":"2024-06-04T16:22:00.037728+0000","last_became_active":"2024-06-04T16:09:26.624142+0000","last_became_peered":"2024-06-04T16:09:26.624142+0000","last_unstale":"2024-06-04T16:22:00.037728+0000","last_undegraded":"2024-06-04T16:22:00.037728+0000","last_fullsized":"2024-06-04T16:22:00.037728+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_clean_scrub_stamp":"2024-06-04T16:09:25.601105+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T18:17:49.470708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.6","version":"254'3","reported_seq":35,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:25.033070+0000","last_change":"2024-06-04T16:09:23.608725+0000","last_active":"2024-06-04T16:22:25.033070+0000","last_peered":"2024-06-04T16:22:25.033070+0000","last_clean":"2024-06-04T16:22:25.033070+0000","last_became_active":"2024-06-04T16:09:23.608300+0000","last_became_peered":"2024-06-04T16:09:23.608300+0000","last_unstale":"2024-06-04T16:22:25.033070+0000","last_undegraded":"2024-06-04T16:22:25.033070+0000","last_fullsized":"2024-06-04T16:22:25.033070+0000","mapping_epoch":246,"log_start":"0'0","ondisk_log_start":"0'0","created":246,"last_epoch_clean":247,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_clean_scrub_stamp":"2024-06-04T16:09:22.572686+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T23:47:46.805128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8192,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"64.7","version":"251'16","reported_seq":79,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:20:10.022130+0000","last_change":"2024-06-04T16:07:09.511741+0000","last_active":"2024-06-04T16:20:10.022130+0000","last_peered":"2024-06-04T16:20:10.022130+0000","last_clean":"2024-06-04T16:20:10.022130+0000","last_became_active":"2024-06-04T16:07:09.511421+0000","last_became_peered":"2024-06-04T16:07:09.511421+0000","last_unstale":"2024-06-04T16:20:10.022130+0000","last_undegraded":"2024-06-04T16:20:10.022130+0000","last_fullsized":"2024-06-04T16:20:10.022130+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":243,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:07:08.374534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:07:08.374534+0000","last_clean_scrub_stamp":"2024-06-04T16:07:08.374534+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T20:29:49.254010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":56,"num_write":28,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.5","version":"0'0","reported_seq":15,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:20:20.023672+0000","last_change":"2024-06-04T16:16:08.656242+0000","last_active":"2024-06-04T16:20:20.023672+0000","last_peered":"2024-06-04T16:20:20.023672+0000","last_clean":"2024-06-04T16:20:20.023672+0000","last_became_active":"2024-06-04T16:16:08.655913+0000","last_became_peered":"2024-06-04T16:16:08.655913+0000","last_unstale":"2024-06-04T16:20:20.023672+0000","last_undegraded":"2024-06-04T16:20:20.023672+0000","last_fullsized":"2024-06-04T16:20:20.023672+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_clean_scrub_stamp":"2024-06-04T16:16:07.631263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T02:48:49.714670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.4","version":"254'2","reported_seq":27,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:00.030250+0000","last_change":"2024-06-04T16:09:26.628240+0000","last_active":"2024-06-04T16:22:00.030250+0000","last_peered":"2024-06-04T16:22:00.030250+0000","last_clean":"2024-06-04T16:22:00.030250+0000","last_became_active":"2024-06-04T16:09:26.627915+0000","last_became_peered":"2024-06-04T16:09:26.627915+0000","last_unstale":"2024-06-04T16:22:00.030250+0000","last_undegraded":"2024-06-04T16:22:00.030250+0000","last_fullsized":"2024-06-04T16:22:00.030250+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_clean_scrub_stamp":"2024-06-04T16:09:25.601105+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T18:57:07.829231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.7","version":"251'3","reported_seq":35,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:20:15.022566+0000","last_change":"2024-06-04T16:09:23.607332+0000","last_active":"2024-06-04T16:20:15.022566+0000","last_peered":"2024-06-04T16:20:15.022566+0000","last_clean":"2024-06-04T16:20:15.022566+0000","last_became_active":"2024-06-04T16:09:23.605516+0000","last_became_peered":"2024-06-04T16:09:23.605516+0000","last_unstale":"2024-06-04T16:20:15.022566+0000","last_undegraded":"2024-06-04T16:20:15.022566+0000","last_fullsized":"2024-06-04T16:20:15.022566+0000","mapping_epoch":246,"log_start":"0'0","ondisk_log_start":"0'0","created":246,"last_epoch_clean":247,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_clean_scrub_stamp":"2024-06-04T16:09:22.572686+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T18:35:30.226341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"64.6","version":"251'12","reported_seq":76,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:43.846902+0000","last_change":"2024-06-04T16:22:43.846928+0000","last_active":"2024-06-04T16:22:43.846902+0000","last_peered":"2024-06-04T16:22:43.846902+0000","last_clean":"2024-06-04T16:22:43.846902+0000","last_became_active":"2024-06-04T16:07:09.397805+0000","last_became_peered":"2024-06-04T16:07:09.397805+0000","last_unstale":"2024-06-04T16:22:43.846902+0000","last_undegraded":"2024-06-04T16:22:43.846902+0000","last_fullsized":"2024-06-04T16:22:43.846902+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":243,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"251'12","last_scrub_stamp":"2024-06-04T16:22:43.846809+0000","last_deep_scrub":"251'12","last_deep_scrub_stamp":"2024-06-04T16:22:43.846809+0000","last_clean_scrub_stamp":"2024-06-04T16:22:43.846809+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T03:24:27.327994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":38,"num_write":27,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.6","version":"253'1","reported_seq":16,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:20:30.020177+0000","last_change":"2024-06-04T16:16:08.656516+0000","last_active":"2024-06-04T16:20:30.020177+0000","last_peered":"2024-06-04T16:20:30.020177+0000","last_clean":"2024-06-04T16:20:30.020177+0000","last_became_active":"2024-06-04T16:16:08.656182+0000","last_became_peered":"2024-06-04T16:16:08.656182+0000","last_unstale":"2024-06-04T16:20:30.020177+0000","last_undegraded":"2024-06-04T16:20:30.020177+0000","last_fullsized":"2024-06-04T16:20:30.020177+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_clean_scrub_stamp":"2024-06-04T16:16:07.631263+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T22:01:48.464700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.7","version":"0'0","reported_seq":24,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:20:20.019052+0000","last_change":"2024-06-04T16:09:26.626653+0000","last_active":"2024-06-04T16:20:20.019052+0000","last_peered":"2024-06-04T16:20:20.019052+0000","last_clean":"2024-06-04T16:20:20.019052+0000","last_became_active":"2024-06-04T16:09:26.625833+0000","last_became_peered":"2024-06-04T16:09:26.625833+0000","last_unstale":"2024-06-04T16:20:20.019052+0000","last_undegraded":"2024-06-04T16:20:20.019052+0000","last_fullsized":"2024-06-04T16:20:20.019052+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_clean_scrub_stamp":"2024-06-04T16:09:25.601105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T21:55:58.166045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.4","version":"0'0","reported_seq":30,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:50.131381+0000","last_change":"2024-06-04T16:09:23.607166+0000","last_active":"2024-06-04T16:19:50.131381+0000","last_peered":"2024-06-04T16:19:50.131381+0000","last_clean":"2024-06-04T16:19:50.131381+0000","last_became_active":"2024-06-04T16:09:23.606669+0000","last_became_peered":"2024-06-04T16:09:23.606669+0000","last_unstale":"2024-06-04T16:19:50.131381+0000","last_undegraded":"2024-06-04T16:19:50.131381+0000","last_fullsized":"2024-06-04T16:19:50.131381+0000","mapping_epoch":246,"log_start":"0'0","ondisk_log_start":"0'0","created":246,"last_epoch_clean":247,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_clean_scrub_stamp":"2024-06-04T16:09:22.572686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T03:58:28.100517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"64.5","version":"254'31","reported_seq":128,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:21:45.133234+0000","last_change":"2024-06-04T16:07:09.404140+0000","last_active":"2024-06-04T16:21:45.133234+0000","last_peered":"2024-06-04T16:21:45.133234+0000","last_clean":"2024-06-04T16:21:45.133234+0000","last_became_active":"2024-06-04T16:07:09.403868+0000","last_became_peered":"2024-06-04T16:07:09.403868+0000","last_unstale":"2024-06-04T16:21:45.133234+0000","last_undegraded":"2024-06-04T16:21:45.133234+0000","last_fullsized":"2024-06-04T16:21:45.133234+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":243,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:07:08.374534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:07:08.374534+0000","last_clean_scrub_stamp":"2024-06-04T16:07:08.374534+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":170,"num_read_kb":120,"num_write":66,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.7","version":"0'0","reported_seq":16,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:40.027608+0000","last_change":"2024-06-04T16:16:08.661700+0000","last_active":"2024-06-04T16:22:40.027608+0000","last_peered":"2024-06-04T16:22:40.027608+0000","last_clean":"2024-06-04T16:22:40.027608+0000","last_became_active":"2024-06-04T16:16:08.661379+0000","last_became_peered":"2024-06-04T16:16:08.661379+0000","last_unstale":"2024-06-04T16:22:40.027608+0000","last_undegraded":"2024-06-04T16:22:40.027608+0000","last_fullsized":"2024-06-04T16:22:40.027608+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_clean_scrub_stamp":"2024-06-04T16:16:07.631263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.6","version":"0'0","reported_seq":25,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:30.028907+0000","last_change":"2024-06-04T16:09:26.624438+0000","last_active":"2024-06-04T16:22:30.028907+0000","last_peered":"2024-06-04T16:22:30.028907+0000","last_clean":"2024-06-04T16:22:30.028907+0000","last_became_active":"2024-06-04T16:09:26.624074+0000","last_became_peered":"2024-06-04T16:09:26.624074+0000","last_unstale":"2024-06-04T16:22:30.028907+0000","last_undegraded":"2024-06-04T16:22:30.028907+0000","last_fullsized":"2024-06-04T16:22:30.028907+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_clean_scrub_stamp":"2024-06-04T16:09:25.601105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.5","version":"254'4","reported_seq":37,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:39.567993+0000","last_change":"2024-06-04T16:09:23.604554+0000","last_active":"2024-06-04T16:22:39.567993+0000","last_peered":"2024-06-04T16:22:39.567993+0000","last_clean":"2024-06-04T16:22:39.567993+0000","last_became_active":"2024-06-04T16:09:23.604255+0000","last_became_peered":"2024-06-04T16:09:23.604255+0000","last_unstale":"2024-06-04T16:22:39.567993+0000","last_undegraded":"2024-06-04T16:22:39.567993+0000","last_fullsized":"2024-06-04T16:22:39.567993+0000","mapping_epoch":246,"log_start":"0'0","ondisk_log_start":"0'0","created":246,"last_epoch_clean":247,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_clean_scrub_stamp":"2024-06-04T16:09:22.572686+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":4,"num_write_kb":1026,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"64.4","version":"254'14","reported_seq":85,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:44.859762+0000","last_change":"2024-06-04T16:22:44.859785+0000","last_active":"2024-06-04T16:22:44.859762+0000","last_peered":"2024-06-04T16:22:44.859762+0000","last_clean":"2024-06-04T16:22:44.859762+0000","last_became_active":"2024-06-04T16:07:09.396484+0000","last_became_peered":"2024-06-04T16:07:09.396484+0000","last_unstale":"2024-06-04T16:22:44.859762+0000","last_undegraded":"2024-06-04T16:22:44.859762+0000","last_fullsized":"2024-06-04T16:22:44.859762+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":243,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'14","last_scrub_stamp":"2024-06-04T16:22:44.859685+0000","last_deep_scrub":"254'14","last_deep_scrub_stamp":"2024-06-04T16:22:44.859685+0000","last_clean_scrub_stamp":"2024-06-04T16:22:44.859685+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T22:48:04.782391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":52,"num_write":27,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.0","version":"0'0","reported_seq":15,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:20:10.017765+0000","last_change":"2024-06-04T16:16:08.661272+0000","last_active":"2024-06-04T16:20:10.017765+0000","last_peered":"2024-06-04T16:20:10.017765+0000","last_clean":"2024-06-04T16:20:10.017765+0000","last_became_active":"2024-06-04T16:16:08.660893+0000","last_became_peered":"2024-06-04T16:16:08.660893+0000","last_unstale":"2024-06-04T16:20:10.017765+0000","last_undegraded":"2024-06-04T16:20:10.017765+0000","last_fullsized":"2024-06-04T16:20:10.017765+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_clean_scrub_stamp":"2024-06-04T16:16:07.631263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T00:49:39.967328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1","version":"251'2","reported_seq":28,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:55.016165+0000","last_change":"2024-06-04T16:09:26.623485+0000","last_active":"2024-06-04T16:19:55.016165+0000","last_peered":"2024-06-04T16:19:55.016165+0000","last_clean":"2024-06-04T16:19:55.016165+0000","last_became_active":"2024-06-04T16:09:26.623190+0000","last_became_peered":"2024-06-04T16:09:26.623190+0000","last_unstale":"2024-06-04T16:19:55.016165+0000","last_undegraded":"2024-06-04T16:19:55.016165+0000","last_fullsized":"2024-06-04T16:19:55.016165+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_clean_scrub_stamp":"2024-06-04T16:09:25.601105+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T18:13:31.934728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.2","version":"254'6","reported_seq":41,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:39.410736+0000","last_change":"2024-06-04T16:09:23.610740+0000","last_active":"2024-06-04T16:22:39.410736+0000","last_peered":"2024-06-04T16:22:39.410736+0000","last_clean":"2024-06-04T16:22:39.410736+0000","last_became_active":"2024-06-04T16:09:23.610479+0000","last_became_peered":"2024-06-04T16:09:23.610479+0000","last_unstale":"2024-06-04T16:22:39.410736+0000","last_undegraded":"2024-06-04T16:22:39.410736+0000","last_fullsized":"2024-06-04T16:22:39.410736+0000","mapping_epoch":246,"log_start":"0'0","ondisk_log_start":"0'0","created":246,"last_epoch_clean":247,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_clean_scrub_stamp":"2024-06-04T16:09:22.572686+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T20:36:24.481405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5120,"num_write":6,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"64.3","version":"251'23","reported_seq":98,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:40.017634+0000","last_change":"2024-06-04T16:07:09.513369+0000","last_active":"2024-06-04T16:19:40.017634+0000","last_peered":"2024-06-04T16:19:40.017634+0000","last_clean":"2024-06-04T16:19:40.017634+0000","last_became_active":"2024-06-04T16:07:09.512996+0000","last_became_peered":"2024-06-04T16:07:09.512996+0000","last_unstale":"2024-06-04T16:19:40.017634+0000","last_undegraded":"2024-06-04T16:19:40.017634+0000","last_fullsized":"2024-06-04T16:19:40.017634+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":243,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:07:08.374534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:07:08.374534+0000","last_clean_scrub_stamp":"2024-06-04T16:07:08.374534+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T18:42:34.541675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":113,"num_read_kb":81,"num_write":51,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1","version":"0'0","reported_seq":15,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:20:20.023189+0000","last_change":"2024-06-04T16:16:08.660525+0000","last_active":"2024-06-04T16:20:20.023189+0000","last_peered":"2024-06-04T16:20:20.023189+0000","last_clean":"2024-06-04T16:20:20.023189+0000","last_became_active":"2024-06-04T16:16:08.660177+0000","last_became_peered":"2024-06-04T16:16:08.660177+0000","last_unstale":"2024-06-04T16:20:20.023189+0000","last_undegraded":"2024-06-04T16:20:20.023189+0000","last_fullsized":"2024-06-04T16:20:20.023189+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_clean_scrub_stamp":"2024-06-04T16:16:07.631263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T19:57:47.986547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.0","version":"254'2","reported_seq":28,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:39.526943+0000","last_change":"2024-06-04T16:09:26.626867+0000","last_active":"2024-06-04T16:22:39.526943+0000","last_peered":"2024-06-04T16:22:39.526943+0000","last_clean":"2024-06-04T16:22:39.526943+0000","last_became_active":"2024-06-04T16:09:26.626576+0000","last_became_peered":"2024-06-04T16:09:26.626576+0000","last_unstale":"2024-06-04T16:22:39.526943+0000","last_undegraded":"2024-06-04T16:22:39.526943+0000","last_fullsized":"2024-06-04T16:22:39.526943+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_clean_scrub_stamp":"2024-06-04T16:09:25.601105+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.3","version":"254'2","reported_seq":34,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:39.497245+0000","last_change":"2024-06-04T16:09:23.604809+0000","last_active":"2024-06-04T16:22:39.497245+0000","last_peered":"2024-06-04T16:22:39.497245+0000","last_clean":"2024-06-04T16:22:39.497245+0000","last_became_active":"2024-06-04T16:09:23.604413+0000","last_became_peered":"2024-06-04T16:09:23.604413+0000","last_unstale":"2024-06-04T16:22:39.497245+0000","last_undegraded":"2024-06-04T16:22:39.497245+0000","last_fullsized":"2024-06-04T16:22:39.497245+0000","mapping_epoch":246,"log_start":"0'0","ondisk_log_start":"0'0","created":246,"last_epoch_clean":247,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_clean_scrub_stamp":"2024-06-04T16:09:22.572686+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"64.2","version":"254'2","reported_seq":44,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:21:45.021931+0000","last_change":"2024-06-04T16:07:09.402095+0000","last_active":"2024-06-04T16:21:45.021931+0000","last_peered":"2024-06-04T16:21:45.021931+0000","last_clean":"2024-06-04T16:21:45.021931+0000","last_became_active":"2024-06-04T16:07:09.401796+0000","last_became_peered":"2024-06-04T16:07:09.401796+0000","last_unstale":"2024-06-04T16:21:45.021931+0000","last_undegraded":"2024-06-04T16:21:45.021931+0000","last_fullsized":"2024-06-04T16:21:45.021931+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":243,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:07:08.374534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:07:08.374534+0000","last_clean_scrub_stamp":"2024-06-04T16:07:08.374534+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":7,"num_write":11,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.2","version":"0'0","reported_seq":16,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:25.028323+0000","last_change":"2024-06-04T16:16:08.656504+0000","last_active":"2024-06-04T16:22:25.028323+0000","last_peered":"2024-06-04T16:22:25.028323+0000","last_clean":"2024-06-04T16:22:25.028323+0000","last_became_active":"2024-06-04T16:16:08.656245+0000","last_became_peered":"2024-06-04T16:16:08.656245+0000","last_unstale":"2024-06-04T16:22:25.028323+0000","last_undegraded":"2024-06-04T16:22:25.028323+0000","last_fullsized":"2024-06-04T16:22:25.028323+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_clean_scrub_stamp":"2024-06-04T16:16:07.631263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.3","version":"254'4","reported_seq":32,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:39.426329+0000","last_change":"2024-06-04T16:09:26.627525+0000","last_active":"2024-06-04T16:22:39.426329+0000","last_peered":"2024-06-04T16:22:39.426329+0000","last_clean":"2024-06-04T16:22:39.426329+0000","last_became_active":"2024-06-04T16:09:26.627193+0000","last_became_peered":"2024-06-04T16:09:26.627193+0000","last_unstale":"2024-06-04T16:22:39.426329+0000","last_undegraded":"2024-06-04T16:22:39.426329+0000","last_fullsized":"2024-06-04T16:22:39.426329+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_clean_scrub_stamp":"2024-06-04T16:09:25.601105+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":6144,"num_write":4,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.0","version":"254'2","reported_seq":34,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:39.472259+0000","last_change":"2024-06-04T16:09:23.606568+0000","last_active":"2024-06-04T16:22:39.472259+0000","last_peered":"2024-06-04T16:22:39.472259+0000","last_clean":"2024-06-04T16:22:39.472259+0000","last_became_active":"2024-06-04T16:09:23.605145+0000","last_became_peered":"2024-06-04T16:09:23.605145+0000","last_unstale":"2024-06-04T16:22:39.472259+0000","last_undegraded":"2024-06-04T16:22:39.472259+0000","last_fullsized":"2024-06-04T16:22:39.472259+0000","mapping_epoch":246,"log_start":"0'0","ondisk_log_start":"0'0","created":246,"last_epoch_clean":247,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_clean_scrub_stamp":"2024-06-04T16:09:22.572686+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"64.1","version":"245'23","reported_seq":104,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:21:45.133183+0000","last_change":"2024-06-04T16:07:09.405357+0000","last_active":"2024-06-04T16:21:45.133183+0000","last_peered":"2024-06-04T16:21:45.133183+0000","last_clean":"2024-06-04T16:21:45.133183+0000","last_became_active":"2024-06-04T16:07:09.405086+0000","last_became_peered":"2024-06-04T16:07:09.405086+0000","last_unstale":"2024-06-04T16:21:45.133183+0000","last_undegraded":"2024-06-04T16:21:45.133183+0000","last_fullsized":"2024-06-04T16:21:45.133183+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":243,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:07:08.374534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:07:08.374534+0000","last_clean_scrub_stamp":"2024-06-04T16:07:08.374534+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":130,"num_read_kb":96,"num_write":31,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.3","version":"0'0","reported_seq":16,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:25.028356+0000","last_change":"2024-06-04T16:16:08.661478+0000","last_active":"2024-06-04T16:22:25.028356+0000","last_peered":"2024-06-04T16:22:25.028356+0000","last_clean":"2024-06-04T16:22:25.028356+0000","last_became_active":"2024-06-04T16:16:08.661111+0000","last_became_peered":"2024-06-04T16:16:08.661111+0000","last_unstale":"2024-06-04T16:22:25.028356+0000","last_undegraded":"2024-06-04T16:22:25.028356+0000","last_fullsized":"2024-06-04T16:22:25.028356+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_clean_scrub_stamp":"2024-06-04T16:16:07.631263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.2","version":"254'2","reported_seq":28,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:00.037198+0000","last_change":"2024-06-04T16:09:26.625154+0000","last_active":"2024-06-04T16:22:00.037198+0000","last_peered":"2024-06-04T16:22:00.037198+0000","last_clean":"2024-06-04T16:22:00.037198+0000","last_became_active":"2024-06-04T16:09:26.624890+0000","last_became_peered":"2024-06-04T16:09:26.624890+0000","last_unstale":"2024-06-04T16:22:00.037198+0000","last_undegraded":"2024-06-04T16:22:00.037198+0000","last_fullsized":"2024-06-04T16:22:00.037198+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_clean_scrub_stamp":"2024-06-04T16:09:25.601105+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T20:52:50.931929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8192,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.1","version":"251'10","reported_seq":52,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:50.015591+0000","last_change":"2024-06-04T16:09:23.609351+0000","last_active":"2024-06-04T16:19:50.015591+0000","last_peered":"2024-06-04T16:19:50.015591+0000","last_clean":"2024-06-04T16:19:50.015591+0000","last_became_active":"2024-06-04T16:09:23.609072+0000","last_became_peered":"2024-06-04T16:09:23.609072+0000","last_unstale":"2024-06-04T16:19:50.015591+0000","last_undegraded":"2024-06-04T16:19:50.015591+0000","last_fullsized":"2024-06-04T16:19:50.015591+0000","mapping_epoch":246,"log_start":"0'0","ondisk_log_start":"0'0","created":246,"last_epoch_clean":247,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_clean_scrub_stamp":"2024-06-04T16:09:22.572686+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T01:04:48.825987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":15362,"num_write":9,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"64.0","version":"254'11","reported_seq":67,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:10.125764+0000","last_change":"2024-06-04T16:07:09.405417+0000","last_active":"2024-06-04T16:19:10.125764+0000","last_peered":"2024-06-04T16:19:10.125764+0000","last_clean":"2024-06-04T16:19:10.125764+0000","last_became_active":"2024-06-04T16:07:09.405109+0000","last_became_peered":"2024-06-04T16:07:09.405109+0000","last_unstale":"2024-06-04T16:19:10.125764+0000","last_undegraded":"2024-06-04T16:19:10.125764+0000","last_fullsized":"2024-06-04T16:19:10.125764+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":243,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:07:08.374534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:07:08.374534+0000","last_clean_scrub_stamp":"2024-06-04T16:07:08.374534+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T02:10:45.525441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":37,"num_write":22,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"251'58","reported_seq":568,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:21:50.022523+0000","last_change":"2024-06-04T15:52:36.496655+0000","last_active":"2024-06-04T16:21:50.022523+0000","last_peered":"2024-06-04T16:21:50.022523+0000","last_clean":"2024-06-04T16:21:50.022523+0000","last_became_active":"2024-06-04T15:52:36.496345+0000","last_became_peered":"2024-06-04T15:52:36.496345+0000","last_unstale":"2024-06-04T16:21:50.022523+0000","last_undegraded":"2024-06-04T16:21:50.022523+0000","last_fullsized":"2024-06-04T16:21:50.022523+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":73,"num_read_kb":10950,"num_write":187,"num_write_kb":28882,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"254'155","reported_seq":887,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:39.920624+0000","last_change":"2024-06-04T15:52:38.485748+0000","last_active":"2024-06-04T16:22:39.920624+0000","last_peered":"2024-06-04T16:22:39.920624+0000","last_clean":"2024-06-04T16:22:39.920624+0000","last_became_active":"2024-06-04T15:52:38.485491+0000","last_became_peered":"2024-06-04T15:52:38.485491+0000","last_unstale":"2024-06-04T16:22:39.920624+0000","last_undegraded":"2024-06-04T16:22:39.920624+0000","last_fullsized":"2024-06-04T16:22:39.920624+0000","mapping_epoch":23,"log_start":"251'100","ondisk_log_start":"251'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":100,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":710,"num_read_kb":632,"num_write":201,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"251'45","reported_seq":565,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:45.018501+0000","last_change":"2024-06-04T15:52:36.484644+0000","last_active":"2024-06-04T16:19:45.018501+0000","last_peered":"2024-06-04T16:19:45.018501+0000","last_clean":"2024-06-04T16:19:45.018501+0000","last_became_active":"2024-06-04T15:52:36.484223+0000","last_became_peered":"2024-06-04T15:52:36.484223+0000","last_unstale":"2024-06-04T16:19:45.018501+0000","last_undegraded":"2024-06-04T16:19:45.018501+0000","last_fullsized":"2024-06-04T16:19:45.018501+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T03:34:20.970333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1311028,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":90,"num_read_kb":9967,"num_write":210,"num_write_kb":17365,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,0],"acting":[5,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.39","version":"254'108","reported_seq":857,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:20:10.017813+0000","last_change":"2024-06-04T15:52:38.482297+0000","last_active":"2024-06-04T16:20:10.017813+0000","last_peered":"2024-06-04T16:20:10.017813+0000","last_clean":"2024-06-04T16:20:10.017813+0000","last_became_active":"2024-06-04T15:52:38.482000+0000","last_became_peered":"2024-06-04T15:52:38.482000+0000","last_unstale":"2024-06-04T16:20:10.017813+0000","last_undegraded":"2024-06-04T16:20:10.017813+0000","last_fullsized":"2024-06-04T16:20:10.017813+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T19:21:51.740016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":584,"num_read_kb":552,"num_write":123,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"254'42","reported_seq":538,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:45.018486+0000","last_change":"2024-06-04T15:52:36.480336+0000","last_active":"2024-06-04T16:19:45.018486+0000","last_peered":"2024-06-04T16:19:45.018486+0000","last_clean":"2024-06-04T16:19:45.018486+0000","last_became_active":"2024-06-04T15:52:36.479881+0000","last_became_peered":"2024-06-04T15:52:36.479881+0000","last_unstale":"2024-06-04T16:19:45.018486+0000","last_undegraded":"2024-06-04T16:19:45.018486+0000","last_fullsized":"2024-06-04T16:19:45.018486+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T22:45:30.429987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":40,"num_read_kb":31,"num_write":168,"num_write_kb":16512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3a","version":"254'106","reported_seq":816,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:20:10.017838+0000","last_change":"2024-06-04T15:52:38.483661+0000","last_active":"2024-06-04T16:20:10.017838+0000","last_peered":"2024-06-04T16:20:10.017838+0000","last_clean":"2024-06-04T16:20:10.017838+0000","last_became_active":"2024-06-04T15:52:38.483240+0000","last_became_peered":"2024-06-04T15:52:38.483240+0000","last_unstale":"2024-06-04T16:20:10.017838+0000","last_undegraded":"2024-06-04T16:20:10.017838+0000","last_fullsized":"2024-06-04T16:20:10.017838+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T19:59:20.609915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":515,"num_read_kb":482,"num_write":131,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"254'78","reported_seq":582,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:44.606300+0000","last_change":"2024-06-04T15:52:36.478336+0000","last_active":"2024-06-04T16:22:44.606300+0000","last_peered":"2024-06-04T16:22:44.606300+0000","last_clean":"2024-06-04T16:22:44.606300+0000","last_became_active":"2024-06-04T15:52:36.476981+0000","last_became_peered":"2024-06-04T15:52:36.476981+0000","last_unstale":"2024-06-04T16:22:44.606300+0000","last_undegraded":"2024-06-04T16:22:44.606300+0000","last_fullsized":"2024-06-04T16:22:44.606300+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":3145,"num_write":255,"num_write_kb":33835,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"254'148","reported_seq":1035,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:20:10.021715+0000","last_change":"2024-06-04T15:52:38.481259+0000","last_active":"2024-06-04T16:20:10.021715+0000","last_peered":"2024-06-04T16:20:10.021715+0000","last_clean":"2024-06-04T16:20:10.021715+0000","last_became_active":"2024-06-04T15:52:38.480986+0000","last_became_peered":"2024-06-04T15:52:38.480986+0000","last_unstale":"2024-06-04T16:20:10.021715+0000","last_undegraded":"2024-06-04T16:20:10.021715+0000","last_fullsized":"2024-06-04T16:20:10.021715+0000","mapping_epoch":23,"log_start":"251'100","ondisk_log_start":"251'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":100,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T20:30:59.524702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1072,"num_read_kb":1014,"num_write":195,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"251'46","reported_seq":557,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:40.027562+0000","last_change":"2024-06-04T15:52:36.495855+0000","last_active":"2024-06-04T16:22:40.027562+0000","last_peered":"2024-06-04T16:22:40.027562+0000","last_clean":"2024-06-04T16:22:40.027562+0000","last_became_active":"2024-06-04T15:52:36.495401+0000","last_became_peered":"2024-06-04T15:52:36.495401+0000","last_unstale":"2024-06-04T16:22:40.027562+0000","last_undegraded":"2024-06-04T16:22:40.027562+0000","last_fullsized":"2024-06-04T16:22:40.027562+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":89,"num_read_kb":6218,"num_write":199,"num_write_kb":11815,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"254'157","reported_seq":1086,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:43.663572+0000","last_change":"2024-06-04T15:52:38.485154+0000","last_active":"2024-06-04T16:22:43.663572+0000","last_peered":"2024-06-04T16:22:43.663572+0000","last_clean":"2024-06-04T16:22:43.663572+0000","last_became_active":"2024-06-04T15:52:38.484828+0000","last_became_peered":"2024-06-04T15:52:38.484828+0000","last_unstale":"2024-06-04T16:22:43.663572+0000","last_undegraded":"2024-06-04T16:22:43.663572+0000","last_fullsized":"2024-06-04T16:22:43.663572+0000","mapping_epoch":23,"log_start":"251'100","ondisk_log_start":"251'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":100,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1071,"num_read_kb":1008,"num_write":198,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"254'61","reported_seq":571,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:40.030194+0000","last_change":"2024-06-04T15:52:36.478124+0000","last_active":"2024-06-04T16:22:40.030194+0000","last_peered":"2024-06-04T16:22:40.030194+0000","last_clean":"2024-06-04T16:22:40.030194+0000","last_became_active":"2024-06-04T15:52:36.476167+0000","last_became_peered":"2024-06-04T15:52:36.476167+0000","last_unstale":"2024-06-04T16:22:40.030194+0000","last_undegraded":"2024-06-04T16:22:40.030194+0000","last_fullsized":"2024-06-04T16:22:40.030194+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":87,"num_read_kb":1095,"num_write":236,"num_write_kb":40818,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,7],"acting":[2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"254'99","reported_seq":812,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:21:50.022506+0000","last_change":"2024-06-04T15:52:38.483365+0000","last_active":"2024-06-04T16:21:50.022506+0000","last_peered":"2024-06-04T16:21:50.022506+0000","last_clean":"2024-06-04T16:21:50.022506+0000","last_became_active":"2024-06-04T15:52:38.482025+0000","last_became_peered":"2024-06-04T15:52:38.482025+0000","last_unstale":"2024-06-04T16:21:50.022506+0000","last_undegraded":"2024-06-04T16:21:50.022506+0000","last_fullsized":"2024-06-04T16:21:50.022506+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":511,"num_read_kb":478,"num_write":121,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.39","version":"251'54","reported_seq":550,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:40.027498+0000","last_change":"2024-06-04T15:52:36.493350+0000","last_active":"2024-06-04T16:22:40.027498+0000","last_peered":"2024-06-04T16:22:40.027498+0000","last_clean":"2024-06-04T16:22:40.027498+0000","last_became_active":"2024-06-04T15:52:36.493029+0000","last_became_peered":"2024-06-04T15:52:36.493029+0000","last_unstale":"2024-06-04T16:22:40.027498+0000","last_undegraded":"2024-06-04T16:22:40.027498+0000","last_fullsized":"2024-06-04T16:22:40.027498+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194343,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":48,"num_read_kb":7228,"num_write":201,"num_write_kb":32271,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,1],"acting":[0,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"254'135","reported_seq":1098,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:21:50.024958+0000","last_change":"2024-06-04T15:52:38.481762+0000","last_active":"2024-06-04T16:21:50.024958+0000","last_peered":"2024-06-04T16:21:50.024958+0000","last_clean":"2024-06-04T16:21:50.024958+0000","last_became_active":"2024-06-04T15:52:38.481269+0000","last_became_peered":"2024-06-04T15:52:38.481269+0000","last_unstale":"2024-06-04T16:21:50.024958+0000","last_undegraded":"2024-06-04T16:21:50.024958+0000","last_fullsized":"2024-06-04T16:21:50.024958+0000","mapping_epoch":23,"log_start":"251'100","ondisk_log_start":"251'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":100,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":974,"num_read_kb":946,"num_write":155,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"254'71","reported_seq":658,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:20:10.021986+0000","last_change":"2024-06-04T15:52:36.494149+0000","last_active":"2024-06-04T16:20:10.021986+0000","last_peered":"2024-06-04T16:20:10.021986+0000","last_clean":"2024-06-04T16:20:10.021986+0000","last_became_active":"2024-06-04T15:52:36.493867+0000","last_became_peered":"2024-06-04T15:52:36.493867+0000","last_unstale":"2024-06-04T16:20:10.021986+0000","last_undegraded":"2024-06-04T16:20:10.021986+0000","last_fullsized":"2024-06-04T16:20:10.021986+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T01:19:36.101046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194320,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":320,"num_read_kb":135435,"num_write":258,"num_write_kb":39309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3],"acting":[5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3f","version":"254'142","reported_seq":980,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:45.018547+0000","last_change":"2024-06-04T15:52:38.487423+0000","last_active":"2024-06-04T16:19:45.018547+0000","last_peered":"2024-06-04T16:19:45.018547+0000","last_clean":"2024-06-04T16:19:45.018547+0000","last_became_active":"2024-06-04T15:52:38.486625+0000","last_became_peered":"2024-06-04T15:52:38.486625+0000","last_unstale":"2024-06-04T16:19:45.018547+0000","last_undegraded":"2024-06-04T16:19:45.018547+0000","last_fullsized":"2024-06-04T16:19:45.018547+0000","mapping_epoch":23,"log_start":"251'100","ondisk_log_start":"251'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T20:53:48.231763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":899,"num_read_kb":839,"num_write":184,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.30","version":"254'110","reported_seq":836,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:21.348186+0000","last_change":"2024-06-04T15:52:38.479433+0000","last_active":"2024-06-04T16:18:21.348186+0000","last_peered":"2024-06-04T16:18:21.348186+0000","last_clean":"2024-06-04T16:18:21.348186+0000","last_became_active":"2024-06-04T15:52:38.479148+0000","last_became_peered":"2024-06-04T15:52:38.479148+0000","last_unstale":"2024-06-04T16:18:21.348186+0000","last_undegraded":"2024-06-04T16:18:21.348186+0000","last_fullsized":"2024-06-04T16:18:21.348186+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T00:01:16.709017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":546,"num_read_kb":515,"num_write":127,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"251'65","reported_seq":590,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:21:40.132752+0000","last_change":"2024-06-04T15:52:36.493388+0000","last_active":"2024-06-04T16:21:40.132752+0000","last_peered":"2024-06-04T16:21:40.132752+0000","last_clean":"2024-06-04T16:21:40.132752+0000","last_became_active":"2024-06-04T15:52:36.493062+0000","last_became_peered":"2024-06-04T15:52:36.493062+0000","last_unstale":"2024-06-04T16:21:40.132752+0000","last_undegraded":"2024-06-04T16:21:40.132752+0000","last_fullsized":"2024-06-04T16:21:40.132752+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194345,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":95,"num_read_kb":64250,"num_write":262,"num_write_kb":45332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,5],"acting":[1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"254'69","reported_seq":737,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:20:40.015569+0000","last_change":"2024-06-04T15:52:38.486683+0000","last_active":"2024-06-04T16:20:40.015569+0000","last_peered":"2024-06-04T16:20:40.015569+0000","last_clean":"2024-06-04T16:20:40.015569+0000","last_became_active":"2024-06-04T15:52:38.486413+0000","last_became_peered":"2024-06-04T15:52:38.486413+0000","last_unstale":"2024-06-04T16:20:40.015569+0000","last_undegraded":"2024-06-04T16:20:40.015569+0000","last_fullsized":"2024-06-04T16:20:40.015569+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":395,"num_read_kb":379,"num_write":76,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"251'60","reported_seq":571,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:21:40.021487+0000","last_change":"2024-06-04T15:52:36.494165+0000","last_active":"2024-06-04T16:21:40.021487+0000","last_peered":"2024-06-04T16:21:40.021487+0000","last_clean":"2024-06-04T16:21:40.021487+0000","last_became_active":"2024-06-04T15:52:36.493235+0000","last_became_peered":"2024-06-04T15:52:36.493235+0000","last_unstale":"2024-06-04T16:21:40.021487+0000","last_undegraded":"2024-06-04T16:21:40.021487+0000","last_fullsized":"2024-06-04T16:21:40.021487+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5327983,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":73,"num_read_kb":3706,"num_write":207,"num_write_kb":43313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"254'95","reported_seq":810,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:20:40.126868+0000","last_change":"2024-06-04T15:52:38.482371+0000","last_active":"2024-06-04T16:20:40.126868+0000","last_peered":"2024-06-04T16:20:40.126868+0000","last_clean":"2024-06-04T16:20:40.126868+0000","last_became_active":"2024-06-04T15:52:38.482120+0000","last_became_peered":"2024-06-04T15:52:38.482120+0000","last_unstale":"2024-06-04T16:20:40.126868+0000","last_undegraded":"2024-06-04T16:20:40.126868+0000","last_fullsized":"2024-06-04T16:20:40.126868+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":518,"num_read_kb":488,"num_write":107,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"251'41","reported_seq":557,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:21:40.021470+0000","last_change":"2024-06-04T15:53:14.839799+0000","last_active":"2024-06-04T16:21:40.021470+0000","last_peered":"2024-06-04T16:21:40.021470+0000","last_clean":"2024-06-04T16:21:40.021470+0000","last_became_active":"2024-06-04T15:53:14.839433+0000","last_became_peered":"2024-06-04T15:53:14.839433+0000","last_unstale":"2024-06-04T16:21:40.021470+0000","last_undegraded":"2024-06-04T16:21:40.021470+0000","last_fullsized":"2024-06-04T16:21:40.021470+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3420297,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":73,"num_read_kb":2132,"num_write":160,"num_write_kb":20015,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"254'143","reported_seq":931,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:15.013248+0000","last_change":"2024-06-04T15:52:38.482165+0000","last_active":"2024-06-04T16:19:15.013248+0000","last_peered":"2024-06-04T16:19:15.013248+0000","last_clean":"2024-06-04T16:19:15.013248+0000","last_became_active":"2024-06-04T15:52:38.480996+0000","last_became_peered":"2024-06-04T15:52:38.480996+0000","last_unstale":"2024-06-04T16:19:15.013248+0000","last_undegraded":"2024-06-04T16:19:15.013248+0000","last_fullsized":"2024-06-04T16:19:15.013248+0000","mapping_epoch":23,"log_start":"251'100","ondisk_log_start":"251'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":100,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T21:42:09.132143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":760,"num_read_kb":703,"num_write":184,"num_write_kb":47,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"251'68","reported_seq":579,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:21:40.021428+0000","last_change":"2024-06-04T15:52:36.488619+0000","last_active":"2024-06-04T16:21:40.021428+0000","last_peered":"2024-06-04T16:21:40.021428+0000","last_clean":"2024-06-04T16:21:40.021428+0000","last_became_active":"2024-06-04T15:52:36.486264+0000","last_became_peered":"2024-06-04T15:52:36.486264+0000","last_unstale":"2024-06-04T16:21:40.021428+0000","last_undegraded":"2024-06-04T16:21:40.021428+0000","last_fullsized":"2024-06-04T16:21:40.021428+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5328001,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":104,"num_read_kb":2209,"num_write":245,"num_write_kb":31585,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,7],"acting":[0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"254'109","reported_seq":990,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:15.014440+0000","last_change":"2024-06-04T15:52:38.488655+0000","last_active":"2024-06-04T16:19:15.014440+0000","last_peered":"2024-06-04T16:19:15.014440+0000","last_clean":"2024-06-04T16:19:15.014440+0000","last_became_active":"2024-06-04T15:52:38.488389+0000","last_became_peered":"2024-06-04T15:52:38.488389+0000","last_unstale":"2024-06-04T16:19:15.014440+0000","last_undegraded":"2024-06-04T16:19:15.014440+0000","last_fullsized":"2024-06-04T16:19:15.014440+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T00:42:51.636081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":949,"num_read_kb":919,"num_write":126,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.33","version":"254'50","reported_seq":551,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:21:40.034480+0000","last_change":"2024-06-04T15:52:36.498842+0000","last_active":"2024-06-04T16:21:40.034480+0000","last_peered":"2024-06-04T16:21:40.034480+0000","last_clean":"2024-06-04T16:21:40.034480+0000","last_became_active":"2024-06-04T15:52:36.498488+0000","last_became_peered":"2024-06-04T15:52:36.498488+0000","last_unstale":"2024-06-04T16:21:40.034480+0000","last_undegraded":"2024-06-04T16:21:40.034480+0000","last_fullsized":"2024-06-04T16:21:40.034480+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T21:29:00.145911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6461610,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":71,"num_read_kb":20343,"num_write":207,"num_write_kb":26780,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,4],"acting":[6,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.35","version":"254'139","reported_seq":927,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:21:40.132719+0000","last_change":"2024-06-04T15:52:38.486364+0000","last_active":"2024-06-04T16:21:40.132719+0000","last_peered":"2024-06-04T16:21:40.132719+0000","last_clean":"2024-06-04T16:21:40.132719+0000","last_became_active":"2024-06-04T15:52:38.486108+0000","last_became_peered":"2024-06-04T15:52:38.486108+0000","last_unstale":"2024-06-04T16:21:40.132719+0000","last_undegraded":"2024-06-04T16:21:40.132719+0000","last_fullsized":"2024-06-04T16:21:40.132719+0000","mapping_epoch":23,"log_start":"251'100","ondisk_log_start":"251'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":100,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":692,"num_read_kb":648,"num_write":164,"num_write_kb":35,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"254'36","reported_seq":526,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:20:45.026835+0000","last_change":"2024-06-04T15:52:36.481363+0000","last_active":"2024-06-04T16:20:45.026835+0000","last_peered":"2024-06-04T16:20:45.026835+0000","last_clean":"2024-06-04T16:20:45.026835+0000","last_became_active":"2024-06-04T15:52:36.481047+0000","last_became_peered":"2024-06-04T15:52:36.481047+0000","last_unstale":"2024-06-04T16:20:45.026835+0000","last_undegraded":"2024-06-04T16:20:45.026835+0000","last_fullsized":"2024-06-04T16:20:45.026835+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T21:52:41.102618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":42,"num_read_kb":41,"num_write":149,"num_write_kb":21263,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4],"acting":[6,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.18","version":"254'36","reported_seq":519,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:21:50.022401+0000","last_change":"2024-06-04T15:52:46.537761+0000","last_active":"2024-06-04T16:21:50.022401+0000","last_peered":"2024-06-04T16:21:50.022401+0000","last_clean":"2024-06-04T16:21:50.022401+0000","last_became_active":"2024-06-04T15:52:46.536608+0000","last_became_peered":"2024-06-04T15:52:46.536608+0000","last_unstale":"2024-06-04T16:21:50.022401+0000","last_undegraded":"2024-06-04T16:21:50.022401+0000","last_fullsized":"2024-06-04T16:21:50.022401+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:45.513877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:45.513877+0000","last_clean_scrub_stamp":"2024-06-04T15:52:45.513877+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":81,"num_read_kb":72,"num_write":87,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"254'110","reported_seq":831,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:25.006864+0000","last_change":"2024-06-04T15:52:38.477338+0000","last_active":"2024-06-04T16:18:25.006864+0000","last_peered":"2024-06-04T16:18:25.006864+0000","last_clean":"2024-06-04T16:18:25.006864+0000","last_became_active":"2024-06-04T15:52:38.477052+0000","last_became_peered":"2024-06-04T15:52:38.477052+0000","last_unstale":"2024-06-04T16:18:25.006864+0000","last_undegraded":"2024-06-04T16:18:25.006864+0000","last_fullsized":"2024-06-04T16:18:25.006864+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T20:39:40.247365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":560,"num_read_kb":523,"num_write":129,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.13","version":"254'52","reported_seq":553,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:21.323198+0000","last_change":"2024-06-04T15:52:36.499588+0000","last_active":"2024-06-04T16:18:21.323198+0000","last_peered":"2024-06-04T16:18:21.323198+0000","last_clean":"2024-06-04T16:18:21.323198+0000","last_became_active":"2024-06-04T15:52:36.499305+0000","last_became_peered":"2024-06-04T15:52:36.499305+0000","last_unstale":"2024-06-04T16:18:21.323198+0000","last_undegraded":"2024-06-04T16:18:21.323198+0000","last_fullsized":"2024-06-04T16:18:21.323198+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T20:07:01.696465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194320,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":75,"num_read_kb":3024,"num_write":196,"num_write_kb":28071,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":473,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:15.011753+0000","last_change":"2024-06-04T15:52:40.477030+0000","last_active":"2024-06-04T16:19:15.011753+0000","last_peered":"2024-06-04T16:19:15.011753+0000","last_clean":"2024-06-04T16:19:15.011753+0000","last_became_active":"2024-06-04T15:52:40.476730+0000","last_became_peered":"2024-06-04T15:52:40.476730+0000","last_unstale":"2024-06-04T16:19:15.011753+0000","last_undegraded":"2024-06-04T16:19:15.011753+0000","last_fullsized":"2024-06-04T16:19:15.011753+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_clean_scrub_stamp":"2024-06-04T15:52:39.463103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T00:40:38.064778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"254'144","reported_seq":715,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:39.510104+0000","last_change":"2024-06-04T15:52:42.504168+0000","last_active":"2024-06-04T16:22:39.510104+0000","last_peered":"2024-06-04T16:22:39.510104+0000","last_clean":"2024-06-04T16:22:39.510104+0000","last_became_active":"2024-06-04T15:52:42.503184+0000","last_became_peered":"2024-06-04T15:52:42.503184+0000","last_unstale":"2024-06-04T16:22:39.510104+0000","last_undegraded":"2024-06-04T16:22:39.510104+0000","last_fullsized":"2024-06-04T16:22:39.510104+0000","mapping_epoch":27,"log_start":"251'100","ondisk_log_start":"251'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_clean_scrub_stamp":"2024-06-04T15:52:41.476734+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T01:21:16.208347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":210,"num_read_kb":210,"num_write":112,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":469,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:21:45.133278+0000","last_change":"2024-06-04T15:52:44.513719+0000","last_active":"2024-06-04T16:21:45.133278+0000","last_peered":"2024-06-04T16:21:45.133278+0000","last_clean":"2024-06-04T16:21:45.133278+0000","last_became_active":"2024-06-04T15:52:44.513442+0000","last_became_peered":"2024-06-04T15:52:44.513442+0000","last_unstale":"2024-06-04T16:21:45.133278+0000","last_undegraded":"2024-06-04T16:21:45.133278+0000","last_fullsized":"2024-06-04T16:21:45.133278+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_clean_scrub_stamp":"2024-06-04T15:52:43.492872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"254'145","reported_seq":706,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:32.398879+0000","last_change":"2024-06-04T15:52:46.540252+0000","last_active":"2024-06-04T16:22:32.398879+0000","last_peered":"2024-06-04T16:22:32.398879+0000","last_clean":"2024-06-04T16:22:32.398879+0000","last_became_active":"2024-06-04T15:52:46.539957+0000","last_became_peered":"2024-06-04T15:52:46.539957+0000","last_unstale":"2024-06-04T16:22:32.398879+0000","last_undegraded":"2024-06-04T16:22:32.398879+0000","last_fullsized":"2024-06-04T16:22:32.398879+0000","mapping_epoch":31,"log_start":"254'100","ondisk_log_start":"254'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:45.513877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:45.513877+0000","last_clean_scrub_stamp":"2024-06-04T15:52:45.513877+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":100,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":399,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":346,"num_read_kb":345,"num_write":304,"num_write_kb":102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"254'154","reported_seq":837,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:15.011739+0000","last_change":"2024-06-04T15:52:38.483869+0000","last_active":"2024-06-04T16:19:15.011739+0000","last_peered":"2024-06-04T16:19:15.011739+0000","last_clean":"2024-06-04T16:19:15.011739+0000","last_became_active":"2024-06-04T15:52:38.483516+0000","last_became_peered":"2024-06-04T15:52:38.483516+0000","last_unstale":"2024-06-04T16:19:15.011739+0000","last_undegraded":"2024-06-04T16:19:15.011739+0000","last_fullsized":"2024-06-04T16:19:15.011739+0000","mapping_epoch":23,"log_start":"251'100","ondisk_log_start":"251'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":100,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T00:51:21.910421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":841,"num_read_kb":740,"num_write":235,"num_write_kb":95,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"254'66","reported_seq":578,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:22.713104+0000","last_change":"2024-06-04T15:52:36.481412+0000","last_active":"2024-06-04T16:18:22.713104+0000","last_peered":"2024-06-04T16:18:22.713104+0000","last_clean":"2024-06-04T16:18:22.713104+0000","last_became_active":"2024-06-04T15:52:36.481099+0000","last_became_peered":"2024-06-04T15:52:36.481099+0000","last_unstale":"2024-06-04T16:18:22.713104+0000","last_undegraded":"2024-06-04T16:18:22.713104+0000","last_fullsized":"2024-06-04T16:18:22.713104+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T21:45:28.619709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133687,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":119,"num_read_kb":2903,"num_write":273,"num_write_kb":32792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,7],"acting":[6,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":474,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:25.007271+0000","last_change":"2024-06-04T15:52:40.479746+0000","last_active":"2024-06-04T16:18:25.007271+0000","last_peered":"2024-06-04T16:18:25.007271+0000","last_clean":"2024-06-04T16:18:25.007271+0000","last_became_active":"2024-06-04T15:52:40.479483+0000","last_became_peered":"2024-06-04T15:52:40.479483+0000","last_unstale":"2024-06-04T16:18:25.007271+0000","last_undegraded":"2024-06-04T16:18:25.007271+0000","last_fullsized":"2024-06-04T16:18:25.007271+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_clean_scrub_stamp":"2024-06-04T15:52:39.463103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T23:55:25.989646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"254'51","reported_seq":548,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:21:45.133269+0000","last_change":"2024-06-04T15:52:42.503739+0000","last_active":"2024-06-04T16:21:45.133269+0000","last_peered":"2024-06-04T16:21:45.133269+0000","last_clean":"2024-06-04T16:21:45.133269+0000","last_became_active":"2024-06-04T15:52:42.503451+0000","last_became_peered":"2024-06-04T15:52:42.503451+0000","last_unstale":"2024-06-04T16:21:45.133269+0000","last_undegraded":"2024-06-04T16:21:45.133269+0000","last_fullsized":"2024-06-04T16:21:45.133269+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_clean_scrub_stamp":"2024-06-04T15:52:41.476734+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":72,"num_read_kb":67,"num_write":48,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":469,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:21:45.133248+0000","last_change":"2024-06-04T15:52:44.518997+0000","last_active":"2024-06-04T16:21:45.133248+0000","last_peered":"2024-06-04T16:21:45.133248+0000","last_clean":"2024-06-04T16:21:45.133248+0000","last_became_active":"2024-06-04T15:52:44.517614+0000","last_became_peered":"2024-06-04T15:52:44.517614+0000","last_unstale":"2024-06-04T16:21:45.133248+0000","last_undegraded":"2024-06-04T16:21:45.133248+0000","last_fullsized":"2024-06-04T16:21:45.133248+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_clean_scrub_stamp":"2024-06-04T15:52:43.492872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"254'22","reported_seq":496,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:15.940519+0000","last_change":"2024-06-04T15:52:46.535843+0000","last_active":"2024-06-04T16:18:15.940519+0000","last_peered":"2024-06-04T16:18:15.940519+0000","last_clean":"2024-06-04T16:18:15.940519+0000","last_became_active":"2024-06-04T15:52:46.535498+0000","last_became_peered":"2024-06-04T15:52:46.535498+0000","last_unstale":"2024-06-04T16:18:15.940519+0000","last_undegraded":"2024-06-04T16:18:15.940519+0000","last_fullsized":"2024-06-04T16:18:15.940519+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:45.513877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:45.513877+0000","last_clean_scrub_stamp":"2024-06-04T15:52:45.513877+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T19:56:52.936990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":432,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":50,"num_read_kb":48,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"254'95","reported_seq":835,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:15.014486+0000","last_change":"2024-06-04T15:52:38.486919+0000","last_active":"2024-06-04T16:19:15.014486+0000","last_peered":"2024-06-04T16:19:15.014486+0000","last_clean":"2024-06-04T16:19:15.014486+0000","last_became_active":"2024-06-04T15:52:38.486612+0000","last_became_peered":"2024-06-04T15:52:38.486612+0000","last_unstale":"2024-06-04T16:19:15.014486+0000","last_undegraded":"2024-06-04T16:19:15.014486+0000","last_fullsized":"2024-06-04T16:19:15.014486+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T17:15:27.232127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":567,"num_read_kb":536,"num_write":113,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"254'37","reported_seq":525,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:39.488997+0000","last_change":"2024-06-04T15:52:36.487317+0000","last_active":"2024-06-04T16:22:39.488997+0000","last_peered":"2024-06-04T16:22:39.488997+0000","last_clean":"2024-06-04T16:22:39.488997+0000","last_became_active":"2024-06-04T15:52:36.486999+0000","last_became_peered":"2024-06-04T15:52:36.486999+0000","last_unstale":"2024-06-04T16:22:39.488997+0000","last_undegraded":"2024-06-04T16:22:39.488997+0000","last_fullsized":"2024-06-04T16:22:39.488997+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T20:36:12.625291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":26,"num_read_kb":6159,"num_write":134,"num_write_kb":22820,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":474,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:15.013835+0000","last_change":"2024-06-04T15:52:40.485408+0000","last_active":"2024-06-04T16:19:15.013835+0000","last_peered":"2024-06-04T16:19:15.013835+0000","last_clean":"2024-06-04T16:19:15.013835+0000","last_became_active":"2024-06-04T15:52:40.484711+0000","last_became_peered":"2024-06-04T15:52:40.484711+0000","last_unstale":"2024-06-04T16:19:15.013835+0000","last_undegraded":"2024-06-04T16:19:15.013835+0000","last_fullsized":"2024-06-04T16:19:15.013835+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_clean_scrub_stamp":"2024-06-04T15:52:39.463103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T18:42:17.207481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"251'65","reported_seq":565,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:30.007950+0000","last_change":"2024-06-04T15:52:42.501609+0000","last_active":"2024-06-04T16:18:30.007950+0000","last_peered":"2024-06-04T16:18:30.007950+0000","last_clean":"2024-06-04T16:18:30.007950+0000","last_became_active":"2024-06-04T15:52:42.501248+0000","last_became_peered":"2024-06-04T15:52:42.501248+0000","last_unstale":"2024-06-04T16:18:30.007950+0000","last_undegraded":"2024-06-04T16:18:30.007950+0000","last_fullsized":"2024-06-04T16:18:30.007950+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_clean_scrub_stamp":"2024-06-04T15:52:41.476734+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T02:21:04.282188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":90,"num_read_kb":83,"num_write":60,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.15","version":"254'465","reported_seq":1499,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:39.358887+0000","last_change":"2024-06-04T15:52:44.523497+0000","last_active":"2024-06-04T16:22:39.358887+0000","last_peered":"2024-06-04T16:22:39.358887+0000","last_clean":"2024-06-04T16:22:39.358887+0000","last_became_active":"2024-06-04T15:52:44.523138+0000","last_became_peered":"2024-06-04T15:52:44.523138+0000","last_unstale":"2024-06-04T16:22:39.358887+0000","last_undegraded":"2024-06-04T16:22:39.358887+0000","last_fullsized":"2024-06-04T16:22:39.358887+0000","mapping_epoch":29,"log_start":"251'400","ondisk_log_start":"251'400","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_clean_scrub_stamp":"2024-06-04T15:52:43.492872+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":400,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T16:19:32.818463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"254'37","reported_seq":505,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:20:20.014247+0000","last_change":"2024-06-04T15:52:46.532424+0000","last_active":"2024-06-04T16:20:20.014247+0000","last_peered":"2024-06-04T16:20:20.014247+0000","last_clean":"2024-06-04T16:20:20.014247+0000","last_became_active":"2024-06-04T15:52:46.532141+0000","last_became_peered":"2024-06-04T15:52:46.532141+0000","last_unstale":"2024-06-04T16:20:20.014247+0000","last_undegraded":"2024-06-04T16:20:20.014247+0000","last_fullsized":"2024-06-04T16:20:20.014247+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:45.513877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:45.513877+0000","last_clean_scrub_stamp":"2024-06-04T15:52:45.513877+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":56,"num_read_kb":50,"num_write":85,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"254'146","reported_seq":978,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:15.014528+0000","last_change":"2024-06-04T15:52:38.490123+0000","last_active":"2024-06-04T16:19:15.014528+0000","last_peered":"2024-06-04T16:19:15.014528+0000","last_clean":"2024-06-04T16:19:15.014528+0000","last_became_active":"2024-06-04T15:52:38.489719+0000","last_became_peered":"2024-06-04T15:52:38.489719+0000","last_unstale":"2024-06-04T16:19:15.014528+0000","last_undegraded":"2024-06-04T16:19:15.014528+0000","last_fullsized":"2024-06-04T16:19:15.014528+0000","mapping_epoch":23,"log_start":"251'100","ondisk_log_start":"251'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":100,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T20:50:26.159996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":798,"num_read_kb":751,"num_write":172,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"254'47","reported_seq":556,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:20:40.126825+0000","last_change":"2024-06-04T15:52:36.483313+0000","last_active":"2024-06-04T16:20:40.126825+0000","last_peered":"2024-06-04T16:20:40.126825+0000","last_clean":"2024-06-04T16:20:40.126825+0000","last_became_active":"2024-06-04T15:52:36.482920+0000","last_became_peered":"2024-06-04T15:52:36.482920+0000","last_unstale":"2024-06-04T16:20:40.126825+0000","last_undegraded":"2024-06-04T16:20:40.126825+0000","last_fullsized":"2024-06-04T16:20:40.126825+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1069231,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":86,"num_read_kb":13402,"num_write":212,"num_write_kb":21907,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3],"acting":[1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":473,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:15.011771+0000","last_change":"2024-06-04T15:52:40.482578+0000","last_active":"2024-06-04T16:19:15.011771+0000","last_peered":"2024-06-04T16:19:15.011771+0000","last_clean":"2024-06-04T16:19:15.011771+0000","last_became_active":"2024-06-04T15:52:40.482288+0000","last_became_peered":"2024-06-04T15:52:40.482288+0000","last_unstale":"2024-06-04T16:19:15.011771+0000","last_undegraded":"2024-06-04T16:19:15.011771+0000","last_fullsized":"2024-06-04T16:19:15.011771+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_clean_scrub_stamp":"2024-06-04T15:52:39.463103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T01:57:16.365165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"254'88","reported_seq":626,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:39.484199+0000","last_change":"2024-06-04T15:52:42.503565+0000","last_active":"2024-06-04T16:22:39.484199+0000","last_peered":"2024-06-04T16:22:39.484199+0000","last_clean":"2024-06-04T16:22:39.484199+0000","last_became_active":"2024-06-04T15:52:42.503282+0000","last_became_peered":"2024-06-04T15:52:42.503282+0000","last_unstale":"2024-06-04T16:22:39.484199+0000","last_undegraded":"2024-06-04T16:22:39.484199+0000","last_fullsized":"2024-06-04T16:22:39.484199+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_clean_scrub_stamp":"2024-06-04T15:52:41.476734+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6020,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":136,"num_read_kb":193,"num_write":64,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"254'478","reported_seq":1574,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:39.363848+0000","last_change":"2024-06-04T15:52:44.520464+0000","last_active":"2024-06-04T16:22:39.363848+0000","last_peered":"2024-06-04T16:22:39.363848+0000","last_clean":"2024-06-04T16:22:39.363848+0000","last_became_active":"2024-06-04T15:52:44.518724+0000","last_became_peered":"2024-06-04T15:52:44.518724+0000","last_unstale":"2024-06-04T16:22:39.363848+0000","last_undegraded":"2024-06-04T16:22:39.363848+0000","last_fullsized":"2024-06-04T16:22:39.363848+0000","mapping_epoch":29,"log_start":"251'400","ondisk_log_start":"251'400","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_clean_scrub_stamp":"2024-06-04T15:52:43.492872+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":400,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T21:27:12.445604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"254'113","reported_seq":799,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:40.007714+0000","last_change":"2024-06-04T15:52:38.479210+0000","last_active":"2024-06-04T16:18:40.007714+0000","last_peered":"2024-06-04T16:18:40.007714+0000","last_clean":"2024-06-04T16:18:40.007714+0000","last_became_active":"2024-06-04T15:52:38.478886+0000","last_became_peered":"2024-06-04T15:52:38.478886+0000","last_unstale":"2024-06-04T16:18:40.007714+0000","last_undegraded":"2024-06-04T16:18:40.007714+0000","last_fullsized":"2024-06-04T16:18:40.007714+0000","mapping_epoch":23,"log_start":"251'100","ondisk_log_start":"251'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":100,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T02:04:11.671915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":534,"num_read_kb":483,"num_write":137,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"251'58","reported_seq":536,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:20:20.023086+0000","last_change":"2024-06-04T15:53:14.838688+0000","last_active":"2024-06-04T16:20:20.023086+0000","last_peered":"2024-06-04T16:20:20.023086+0000","last_clean":"2024-06-04T16:20:20.023086+0000","last_became_active":"2024-06-04T15:53:14.838259+0000","last_became_peered":"2024-06-04T15:53:14.838259+0000","last_unstale":"2024-06-04T16:20:20.023086+0000","last_undegraded":"2024-06-04T16:20:20.023086+0000","last_fullsized":"2024-06-04T16:20:20.023086+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T21:50:47.794603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":105,"num_read_kb":3164,"num_write":221,"num_write_kb":9993,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,4],"acting":[6,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":478,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:20:50.127873+0000","last_change":"2024-06-04T15:52:40.484123+0000","last_active":"2024-06-04T16:20:50.127873+0000","last_peered":"2024-06-04T16:20:50.127873+0000","last_clean":"2024-06-04T16:20:50.127873+0000","last_became_active":"2024-06-04T15:52:40.483832+0000","last_became_peered":"2024-06-04T15:52:40.483832+0000","last_unstale":"2024-06-04T16:20:50.127873+0000","last_undegraded":"2024-06-04T16:20:50.127873+0000","last_fullsized":"2024-06-04T16:20:50.127873+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_clean_scrub_stamp":"2024-06-04T15:52:39.463103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"254'140","reported_seq":713,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:39.522204+0000","last_change":"2024-06-04T15:52:42.504594+0000","last_active":"2024-06-04T16:22:39.522204+0000","last_peered":"2024-06-04T16:22:39.522204+0000","last_clean":"2024-06-04T16:22:39.522204+0000","last_became_active":"2024-06-04T15:52:42.504217+0000","last_became_peered":"2024-06-04T15:52:42.504217+0000","last_unstale":"2024-06-04T16:22:39.522204+0000","last_undegraded":"2024-06-04T16:22:39.522204+0000","last_fullsized":"2024-06-04T16:22:39.522204+0000","mapping_epoch":27,"log_start":"251'100","ondisk_log_start":"251'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_clean_scrub_stamp":"2024-06-04T15:52:41.476734+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":100,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":216,"num_read_kb":258,"num_write":116,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":463,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:45.017624+0000","last_change":"2024-06-04T15:52:44.520621+0000","last_active":"2024-06-04T16:19:45.017624+0000","last_peered":"2024-06-04T16:19:45.017624+0000","last_clean":"2024-06-04T16:19:45.017624+0000","last_became_active":"2024-06-04T15:52:44.520358+0000","last_became_peered":"2024-06-04T15:52:44.520358+0000","last_unstale":"2024-06-04T16:19:45.017624+0000","last_undegraded":"2024-06-04T16:19:45.017624+0000","last_fullsized":"2024-06-04T16:19:45.017624+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_clean_scrub_stamp":"2024-06-04T15:52:43.492872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T18:58:46.869583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"254'455","reported_seq":1239,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:32.402774+0000","last_change":"2024-06-04T15:52:46.536753+0000","last_active":"2024-06-04T16:22:32.402774+0000","last_peered":"2024-06-04T16:22:32.402774+0000","last_clean":"2024-06-04T16:22:32.402774+0000","last_became_active":"2024-06-04T15:52:46.536442+0000","last_became_peered":"2024-06-04T15:52:46.536442+0000","last_unstale":"2024-06-04T16:22:32.402774+0000","last_undegraded":"2024-06-04T16:22:32.402774+0000","last_fullsized":"2024-06-04T16:22:32.402774+0000","mapping_epoch":31,"log_start":"251'400","ondisk_log_start":"251'400","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:45.513877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:45.513877+0000","last_clean_scrub_stamp":"2024-06-04T15:52:45.513877+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":400,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":418,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1197,"num_read_kb":1195,"num_write":937,"num_write_kb":336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"254'122","reported_seq":924,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:20:50.127882+0000","last_change":"2024-06-04T15:52:38.483443+0000","last_active":"2024-06-04T16:20:50.127882+0000","last_peered":"2024-06-04T16:20:50.127882+0000","last_clean":"2024-06-04T16:20:50.127882+0000","last_became_active":"2024-06-04T15:52:38.483194+0000","last_became_peered":"2024-06-04T15:52:38.483194+0000","last_unstale":"2024-06-04T16:20:50.127882+0000","last_undegraded":"2024-06-04T16:20:50.127882+0000","last_fullsized":"2024-06-04T16:20:50.127882+0000","mapping_epoch":23,"log_start":"251'100","ondisk_log_start":"251'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":100,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":683,"num_read_kb":649,"num_write":140,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"254'60","reported_seq":592,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:39.442636+0000","last_change":"2024-06-04T15:52:36.486364+0000","last_active":"2024-06-04T16:22:39.442636+0000","last_peered":"2024-06-04T16:22:39.442636+0000","last_clean":"2024-06-04T16:22:39.442636+0000","last_became_active":"2024-06-04T15:52:36.485995+0000","last_became_peered":"2024-06-04T15:52:36.485995+0000","last_unstale":"2024-06-04T16:22:39.442636+0000","last_undegraded":"2024-06-04T16:22:39.442636+0000","last_fullsized":"2024-06-04T16:22:39.442636+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":105,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":98,"num_read_kb":68665,"num_write":249,"num_write_kb":35943,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":471,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:40.008747+0000","last_change":"2024-06-04T15:52:40.481019+0000","last_active":"2024-06-04T16:18:40.008747+0000","last_peered":"2024-06-04T16:18:40.008747+0000","last_clean":"2024-06-04T16:18:40.008747+0000","last_became_active":"2024-06-04T15:52:40.480714+0000","last_became_peered":"2024-06-04T15:52:40.480714+0000","last_unstale":"2024-06-04T16:18:40.008747+0000","last_undegraded":"2024-06-04T16:18:40.008747+0000","last_fullsized":"2024-06-04T16:18:40.008747+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_clean_scrub_stamp":"2024-06-04T15:52:39.463103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T22:44:29.436328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.b","version":"254'93","reported_seq":633,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:39.431203+0000","last_change":"2024-06-04T15:52:42.505667+0000","last_active":"2024-06-04T16:22:39.431203+0000","last_peered":"2024-06-04T16:22:39.431203+0000","last_clean":"2024-06-04T16:22:39.431203+0000","last_became_active":"2024-06-04T15:52:42.505269+0000","last_became_peered":"2024-06-04T15:52:42.505269+0000","last_unstale":"2024-06-04T16:22:39.431203+0000","last_undegraded":"2024-06-04T16:22:39.431203+0000","last_fullsized":"2024-06-04T16:22:39.431203+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_clean_scrub_stamp":"2024-06-04T15:52:41.476734+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T19:58:57.937812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":127,"num_read_kb":117,"num_write":58,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":467,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:50.010546+0000","last_change":"2024-06-04T15:52:44.522421+0000","last_active":"2024-06-04T16:18:50.010546+0000","last_peered":"2024-06-04T16:18:50.010546+0000","last_clean":"2024-06-04T16:18:50.010546+0000","last_became_active":"2024-06-04T15:52:44.522149+0000","last_became_peered":"2024-06-04T15:52:44.522149+0000","last_unstale":"2024-06-04T16:18:50.010546+0000","last_undegraded":"2024-06-04T16:18:50.010546+0000","last_fullsized":"2024-06-04T16:18:50.010546+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_clean_scrub_stamp":"2024-06-04T15:52:43.492872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T16:56:50.665549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.5","version":"254'29","reported_seq":506,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:00.134769+0000","last_change":"2024-06-04T15:52:46.540795+0000","last_active":"2024-06-04T16:22:00.134769+0000","last_peered":"2024-06-04T16:22:00.134769+0000","last_clean":"2024-06-04T16:22:00.134769+0000","last_became_active":"2024-06-04T15:52:46.540510+0000","last_became_peered":"2024-06-04T15:52:46.540510+0000","last_unstale":"2024-06-04T16:22:00.134769+0000","last_undegraded":"2024-06-04T16:22:00.134769+0000","last_fullsized":"2024-06-04T16:22:00.134769+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:45.513877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:45.513877+0000","last_clean_scrub_stamp":"2024-06-04T15:52:45.513877+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":51,"num_write":73,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"254'110","reported_seq":876,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:20:55.017898+0000","last_change":"2024-06-04T15:52:38.480623+0000","last_active":"2024-06-04T16:20:55.017898+0000","last_peered":"2024-06-04T16:20:55.017898+0000","last_clean":"2024-06-04T16:20:55.017898+0000","last_became_active":"2024-06-04T15:52:38.480112+0000","last_became_peered":"2024-06-04T15:52:38.480112+0000","last_unstale":"2024-06-04T16:20:55.017898+0000","last_undegraded":"2024-06-04T16:20:55.017898+0000","last_fullsized":"2024-06-04T16:20:55.017898+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":725,"num_read_kb":689,"num_write":131,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"251'79","reported_seq":547,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:20:15.022274+0000","last_change":"2024-06-04T15:53:14.838653+0000","last_active":"2024-06-04T16:20:15.022274+0000","last_peered":"2024-06-04T16:20:15.022274+0000","last_clean":"2024-06-04T16:20:15.022274+0000","last_became_active":"2024-06-04T15:53:14.838251+0000","last_became_peered":"2024-06-04T15:53:14.838251+0000","last_unstale":"2024-06-04T16:20:15.022274+0000","last_undegraded":"2024-06-04T16:20:15.022274+0000","last_fullsized":"2024-06-04T16:20:15.022274+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T16:02:03.538866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5263509,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":74,"num_read_kb":65,"num_write":320,"num_write_kb":43304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.b","version":"33'3","reported_seq":784,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:38.925969+0000","last_change":"2024-06-04T15:52:40.482441+0000","last_active":"2024-06-04T16:22:38.925969+0000","last_peered":"2024-06-04T16:22:38.925969+0000","last_clean":"2024-06-04T16:22:38.925969+0000","last_became_active":"2024-06-04T15:52:40.482173+0000","last_became_peered":"2024-06-04T15:52:40.482173+0000","last_unstale":"2024-06-04T16:22:38.925969+0000","last_undegraded":"2024-06-04T16:22:38.925969+0000","last_fullsized":"2024-06-04T16:22:38.925969+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_clean_scrub_stamp":"2024-06-04T15:52:39.463103+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T16:39:49.059223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":464,"num_read_kb":462,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"254'109","reported_seq":657,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:39.534656+0000","last_change":"2024-06-04T15:52:42.498254+0000","last_active":"2024-06-04T16:22:39.534656+0000","last_peered":"2024-06-04T16:22:39.534656+0000","last_clean":"2024-06-04T16:22:39.534656+0000","last_became_active":"2024-06-04T15:52:42.497393+0000","last_became_peered":"2024-06-04T15:52:42.497393+0000","last_unstale":"2024-06-04T16:22:39.534656+0000","last_undegraded":"2024-06-04T16:22:39.534656+0000","last_fullsized":"2024-06-04T16:22:39.534656+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_clean_scrub_stamp":"2024-06-04T15:52:41.476734+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T20:36:45.216523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13302,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":171,"num_read_kb":247,"num_write":88,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"254'478","reported_seq":1635,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:39.364935+0000","last_change":"2024-06-04T15:52:44.519059+0000","last_active":"2024-06-04T16:22:39.364935+0000","last_peered":"2024-06-04T16:22:39.364935+0000","last_clean":"2024-06-04T16:22:39.364935+0000","last_became_active":"2024-06-04T15:52:44.518765+0000","last_became_peered":"2024-06-04T15:52:44.518765+0000","last_unstale":"2024-06-04T16:22:39.364935+0000","last_undegraded":"2024-06-04T16:22:39.364935+0000","last_fullsized":"2024-06-04T16:22:39.364935+0000","mapping_epoch":29,"log_start":"251'400","ondisk_log_start":"251'400","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_clean_scrub_stamp":"2024-06-04T15:52:43.492872+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":400,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T20:20:06.797230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"251'21","reported_seq":488,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:50.010030+0000","last_change":"2024-06-04T15:52:46.537947+0000","last_active":"2024-06-04T16:18:50.010030+0000","last_peered":"2024-06-04T16:18:50.010030+0000","last_clean":"2024-06-04T16:18:50.010030+0000","last_became_active":"2024-06-04T15:52:46.537679+0000","last_became_peered":"2024-06-04T15:52:46.537679+0000","last_unstale":"2024-06-04T16:18:50.010030+0000","last_undegraded":"2024-06-04T16:18:50.010030+0000","last_fullsized":"2024-06-04T16:18:50.010030+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:45.513877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:45.513877+0000","last_clean_scrub_stamp":"2024-06-04T15:52:45.513877+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T18:28:47.547893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":390,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":49,"num_read_kb":41,"num_write":55,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"254'141","reported_seq":899,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:40.017652+0000","last_change":"2024-06-04T15:52:38.489274+0000","last_active":"2024-06-04T16:19:40.017652+0000","last_peered":"2024-06-04T16:19:40.017652+0000","last_clean":"2024-06-04T16:19:40.017652+0000","last_became_active":"2024-06-04T15:52:38.488997+0000","last_became_peered":"2024-06-04T15:52:38.488997+0000","last_unstale":"2024-06-04T16:19:40.017652+0000","last_undegraded":"2024-06-04T16:19:40.017652+0000","last_fullsized":"2024-06-04T16:19:40.017652+0000","mapping_epoch":23,"log_start":"251'100","ondisk_log_start":"251'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":100,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T00:28:22.807058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":688,"num_read_kb":631,"num_write":173,"num_write_kb":46,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"254'58","reported_seq":568,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:39.488568+0000","last_change":"2024-06-04T15:52:36.495931+0000","last_active":"2024-06-04T16:22:39.488568+0000","last_peered":"2024-06-04T16:22:39.488568+0000","last_clean":"2024-06-04T16:22:39.488568+0000","last_became_active":"2024-06-04T15:52:36.495601+0000","last_became_peered":"2024-06-04T15:52:36.495601+0000","last_unstale":"2024-06-04T16:22:39.488568+0000","last_undegraded":"2024-06-04T16:22:39.488568+0000","last_fullsized":"2024-06-04T16:22:39.488568+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":74,"num_read_kb":575,"num_write":257,"num_write_kb":23683,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":471,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:45.009389+0000","last_change":"2024-06-04T15:52:40.485064+0000","last_active":"2024-06-04T16:18:45.009389+0000","last_peered":"2024-06-04T16:18:45.009389+0000","last_clean":"2024-06-04T16:18:45.009389+0000","last_became_active":"2024-06-04T15:52:40.484785+0000","last_became_peered":"2024-06-04T15:52:40.484785+0000","last_unstale":"2024-06-04T16:18:45.009389+0000","last_undegraded":"2024-06-04T16:18:45.009389+0000","last_fullsized":"2024-06-04T16:18:45.009389+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_clean_scrub_stamp":"2024-06-04T15:52:39.463103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T18:35:53.675262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.9","version":"254'158","reported_seq":759,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:39.545951+0000","last_change":"2024-06-04T15:52:42.504865+0000","last_active":"2024-06-04T16:22:39.545951+0000","last_peered":"2024-06-04T16:22:39.545951+0000","last_clean":"2024-06-04T16:22:39.545951+0000","last_became_active":"2024-06-04T15:52:42.504622+0000","last_became_peered":"2024-06-04T15:52:42.504622+0000","last_unstale":"2024-06-04T16:22:39.545951+0000","last_undegraded":"2024-06-04T16:22:39.545951+0000","last_fullsized":"2024-06-04T16:22:39.545951+0000","mapping_epoch":27,"log_start":"251'100","ondisk_log_start":"251'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_clean_scrub_stamp":"2024-06-04T15:52:41.476734+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":100,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T01:00:09.245514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25402,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":256,"num_read_kb":404,"num_write":118,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":469,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:45.010347+0000","last_change":"2024-06-04T15:52:44.518616+0000","last_active":"2024-06-04T16:18:45.010347+0000","last_peered":"2024-06-04T16:18:45.010347+0000","last_clean":"2024-06-04T16:18:45.010347+0000","last_became_active":"2024-06-04T15:52:44.518340+0000","last_became_peered":"2024-06-04T15:52:44.518340+0000","last_unstale":"2024-06-04T16:18:45.010347+0000","last_undegraded":"2024-06-04T16:18:45.010347+0000","last_fullsized":"2024-06-04T16:18:45.010347+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_clean_scrub_stamp":"2024-06-04T15:52:43.492872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T20:18:04.722535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"254'22","reported_seq":501,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:50.123049+0000","last_change":"2024-06-04T15:52:46.540890+0000","last_active":"2024-06-04T16:18:50.123049+0000","last_peered":"2024-06-04T16:18:50.123049+0000","last_clean":"2024-06-04T16:18:50.123049+0000","last_became_active":"2024-06-04T15:52:46.540542+0000","last_became_peered":"2024-06-04T15:52:46.540542+0000","last_unstale":"2024-06-04T16:18:50.123049+0000","last_undegraded":"2024-06-04T16:18:50.123049+0000","last_fullsized":"2024-06-04T16:18:50.123049+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:45.513877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:45.513877+0000","last_clean_scrub_stamp":"2024-06-04T15:52:45.513877+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T00:28:19.284809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":503,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":51,"num_read_kb":51,"num_write":59,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"254'116","reported_seq":913,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:21:55.023024+0000","last_change":"2024-06-04T15:52:38.488878+0000","last_active":"2024-06-04T16:21:55.023024+0000","last_peered":"2024-06-04T16:21:55.023024+0000","last_clean":"2024-06-04T16:21:55.023024+0000","last_became_active":"2024-06-04T15:52:38.488576+0000","last_became_peered":"2024-06-04T15:52:38.488576+0000","last_unstale":"2024-06-04T16:21:55.023024+0000","last_undegraded":"2024-06-04T16:21:55.023024+0000","last_fullsized":"2024-06-04T16:21:55.023024+0000","mapping_epoch":23,"log_start":"251'100","ondisk_log_start":"251'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":100,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":804,"num_read_kb":763,"num_write":143,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"254'83","reported_seq":603,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:21:55.149892+0000","last_change":"2024-06-04T15:52:36.499047+0000","last_active":"2024-06-04T16:21:55.149892+0000","last_peered":"2024-06-04T16:21:55.149892+0000","last_clean":"2024-06-04T16:21:55.149892+0000","last_became_active":"2024-06-04T15:52:36.498706+0000","last_became_peered":"2024-06-04T15:52:36.498706+0000","last_unstale":"2024-06-04T16:21:55.149892+0000","last_undegraded":"2024-06-04T16:21:55.149892+0000","last_fullsized":"2024-06-04T16:21:55.149892+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T20:01:28.183971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262197,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":125,"num_read_kb":7280,"num_write":369,"num_write_kb":33149,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":475,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:40.129985+0000","last_change":"2024-06-04T15:52:40.485318+0000","last_active":"2024-06-04T16:19:40.129985+0000","last_peered":"2024-06-04T16:19:40.129985+0000","last_clean":"2024-06-04T16:19:40.129985+0000","last_became_active":"2024-06-04T15:52:40.484285+0000","last_became_peered":"2024-06-04T15:52:40.484285+0000","last_unstale":"2024-06-04T16:19:40.129985+0000","last_undegraded":"2024-06-04T16:19:40.129985+0000","last_fullsized":"2024-06-04T16:19:40.129985+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_clean_scrub_stamp":"2024-06-04T15:52:39.463103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T23:36:57.821083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.e","version":"254'121","reported_seq":667,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:39.459446+0000","last_change":"2024-06-04T15:52:42.501168+0000","last_active":"2024-06-04T16:22:39.459446+0000","last_peered":"2024-06-04T16:22:39.459446+0000","last_clean":"2024-06-04T16:22:39.459446+0000","last_became_active":"2024-06-04T15:52:42.500865+0000","last_became_peered":"2024-06-04T15:52:42.500865+0000","last_unstale":"2024-06-04T16:22:39.459446+0000","last_undegraded":"2024-06-04T16:22:39.459446+0000","last_fullsized":"2024-06-04T16:22:39.459446+0000","mapping_epoch":27,"log_start":"251'100","ondisk_log_start":"251'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_clean_scrub_stamp":"2024-06-04T15:52:41.476734+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":100,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":174,"num_read_kb":176,"num_write":136,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":467,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:45.130828+0000","last_change":"2024-06-04T15:52:44.520519+0000","last_active":"2024-06-04T16:19:45.130828+0000","last_peered":"2024-06-04T16:19:45.130828+0000","last_clean":"2024-06-04T16:19:45.130828+0000","last_became_active":"2024-06-04T15:52:44.519542+0000","last_became_peered":"2024-06-04T15:52:44.519542+0000","last_unstale":"2024-06-04T16:19:45.130828+0000","last_undegraded":"2024-06-04T16:19:45.130828+0000","last_fullsized":"2024-06-04T16:19:45.130828+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_clean_scrub_stamp":"2024-06-04T15:52:43.492872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T22:23:21.493696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.0","version":"254'16","reported_seq":482,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:55.011781+0000","last_change":"2024-06-04T15:52:46.540191+0000","last_active":"2024-06-04T16:18:55.011781+0000","last_peered":"2024-06-04T16:18:55.011781+0000","last_clean":"2024-06-04T16:18:55.011781+0000","last_became_active":"2024-06-04T15:52:46.539906+0000","last_became_peered":"2024-06-04T15:52:46.539906+0000","last_unstale":"2024-06-04T16:18:55.011781+0000","last_undegraded":"2024-06-04T16:18:55.011781+0000","last_fullsized":"2024-06-04T16:18:55.011781+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:45.513877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:45.513877+0000","last_clean_scrub_stamp":"2024-06-04T15:52:45.513877+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T16:35:48.692745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":31,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"254'140","reported_seq":897,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:40.014533+0000","last_change":"2024-06-04T15:52:38.479098+0000","last_active":"2024-06-04T16:19:40.014533+0000","last_peered":"2024-06-04T16:19:40.014533+0000","last_clean":"2024-06-04T16:19:40.014533+0000","last_became_active":"2024-06-04T15:52:38.478691+0000","last_became_peered":"2024-06-04T15:52:38.478691+0000","last_unstale":"2024-06-04T16:19:40.014533+0000","last_undegraded":"2024-06-04T16:19:40.014533+0000","last_fullsized":"2024-06-04T16:19:40.014533+0000","mapping_epoch":23,"log_start":"251'100","ondisk_log_start":"251'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":100,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T20:41:58.834443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":683,"num_read_kb":634,"num_write":182,"num_write_kb":49,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"254'80","reported_seq":587,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:45.008382+0000","last_change":"2024-06-04T15:52:36.489783+0000","last_active":"2024-06-04T16:18:45.008382+0000","last_peered":"2024-06-04T16:18:45.008382+0000","last_clean":"2024-06-04T16:18:45.008382+0000","last_became_active":"2024-06-04T15:52:36.489437+0000","last_became_peered":"2024-06-04T15:52:36.489437+0000","last_unstale":"2024-06-04T16:18:45.008382+0000","last_undegraded":"2024-06-04T16:18:45.008382+0000","last_fullsized":"2024-06-04T16:18:45.008382+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T23:09:59.205888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133669,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":97,"num_read_kb":3905,"num_write":348,"num_write_kb":24180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":477,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:40.017716+0000","last_change":"2024-06-04T15:52:40.480878+0000","last_active":"2024-06-04T16:19:40.017716+0000","last_peered":"2024-06-04T16:19:40.017716+0000","last_clean":"2024-06-04T16:19:40.017716+0000","last_became_active":"2024-06-04T15:52:40.480568+0000","last_became_peered":"2024-06-04T15:52:40.480568+0000","last_unstale":"2024-06-04T16:19:40.017716+0000","last_undegraded":"2024-06-04T16:19:40.017716+0000","last_fullsized":"2024-06-04T16:19:40.017716+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_clean_scrub_stamp":"2024-06-04T15:52:39.463103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T22:05:18.609127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.f","version":"254'111","reported_seq":662,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:39.412599+0000","last_change":"2024-06-04T15:52:42.499311+0000","last_active":"2024-06-04T16:22:39.412599+0000","last_peered":"2024-06-04T16:22:39.412599+0000","last_clean":"2024-06-04T16:22:39.412599+0000","last_became_active":"2024-06-04T15:52:42.499014+0000","last_became_peered":"2024-06-04T15:52:42.499014+0000","last_unstale":"2024-06-04T16:22:39.412599+0000","last_undegraded":"2024-06-04T16:22:39.412599+0000","last_fullsized":"2024-06-04T16:22:39.412599+0000","mapping_epoch":27,"log_start":"251'100","ondisk_log_start":"251'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_clean_scrub_stamp":"2024-06-04T15:52:41.476734+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":100,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T17:38:48.045987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6848,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":169,"num_read_kb":239,"num_write":88,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.e","version":"254'463","reported_seq":1443,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:39.360099+0000","last_change":"2024-06-04T15:52:44.520284+0000","last_active":"2024-06-04T16:22:39.360099+0000","last_peered":"2024-06-04T16:22:39.360099+0000","last_clean":"2024-06-04T16:22:39.360099+0000","last_became_active":"2024-06-04T15:52:44.520016+0000","last_became_peered":"2024-06-04T15:52:44.520016+0000","last_unstale":"2024-06-04T16:22:39.360099+0000","last_undegraded":"2024-06-04T16:22:39.360099+0000","last_fullsized":"2024-06-04T16:22:39.360099+0000","mapping_epoch":29,"log_start":"251'400","ondisk_log_start":"251'400","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_clean_scrub_stamp":"2024-06-04T15:52:43.492872+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":400,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T21:36:43.965699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1","version":"254'28","reported_seq":499,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:55.019299+0000","last_change":"2024-06-04T15:52:46.532842+0000","last_active":"2024-06-04T16:19:55.019299+0000","last_peered":"2024-06-04T16:19:55.019299+0000","last_clean":"2024-06-04T16:19:55.019299+0000","last_became_active":"2024-06-04T15:52:46.532554+0000","last_became_peered":"2024-06-04T15:52:46.532554+0000","last_unstale":"2024-06-04T16:19:55.019299+0000","last_undegraded":"2024-06-04T16:19:55.019299+0000","last_fullsized":"2024-06-04T16:19:55.019299+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:45.513877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:45.513877+0000","last_clean_scrub_stamp":"2024-06-04T15:52:45.513877+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T18:11:38.661962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":764,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":64,"num_read_kb":55,"num_write":77,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.e","version":"254'75","reported_seq":758,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:21:55.025516+0000","last_change":"2024-06-04T15:52:38.481543+0000","last_active":"2024-06-04T16:21:55.025516+0000","last_peered":"2024-06-04T16:21:55.025516+0000","last_clean":"2024-06-04T16:21:55.025516+0000","last_became_active":"2024-06-04T15:52:38.480961+0000","last_became_peered":"2024-06-04T15:52:38.480961+0000","last_unstale":"2024-06-04T16:21:55.025516+0000","last_undegraded":"2024-06-04T16:21:55.025516+0000","last_fullsized":"2024-06-04T16:21:55.025516+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":420,"num_read_kb":402,"num_write":82,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"254'43","reported_seq":541,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:40.007753+0000","last_change":"2024-06-04T15:52:36.485951+0000","last_active":"2024-06-04T16:18:40.007753+0000","last_peered":"2024-06-04T16:18:40.007753+0000","last_clean":"2024-06-04T16:18:40.007753+0000","last_became_active":"2024-06-04T15:52:36.485571+0000","last_became_peered":"2024-06-04T15:52:36.485571+0000","last_unstale":"2024-06-04T16:18:40.007753+0000","last_undegraded":"2024-06-04T16:18:40.007753+0000","last_fullsized":"2024-06-04T16:18:40.007753+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T01:39:00.786783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":66,"num_read_kb":9943,"num_write":198,"num_write_kb":32171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"26'2","reported_seq":1086,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:39.352627+0000","last_change":"2024-06-04T15:52:40.477976+0000","last_active":"2024-06-04T16:22:39.352627+0000","last_peered":"2024-06-04T16:22:39.352627+0000","last_clean":"2024-06-04T16:22:39.352627+0000","last_became_active":"2024-06-04T15:52:40.477693+0000","last_became_peered":"2024-06-04T15:52:40.477693+0000","last_unstale":"2024-06-04T16:22:39.352627+0000","last_undegraded":"2024-06-04T16:22:39.352627+0000","last_fullsized":"2024-06-04T16:22:39.352627+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_clean_scrub_stamp":"2024-06-04T15:52:39.463103+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":606,"num_read_kb":606,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"251'35","reported_seq":517,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:45.017668+0000","last_change":"2024-06-04T15:52:42.503779+0000","last_active":"2024-06-04T16:19:45.017668+0000","last_peered":"2024-06-04T16:19:45.017668+0000","last_clean":"2024-06-04T16:19:45.017668+0000","last_became_active":"2024-06-04T15:52:42.503184+0000","last_became_peered":"2024-06-04T15:52:42.503184+0000","last_unstale":"2024-06-04T16:19:45.017668+0000","last_undegraded":"2024-06-04T16:19:45.017668+0000","last_fullsized":"2024-06-04T16:19:45.017668+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_clean_scrub_stamp":"2024-06-04T15:52:41.476734+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T01:25:31.440819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":45,"num_read_kb":40,"num_write":30,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.d","version":"254'470","reported_seq":1624,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:39.577605+0000","last_change":"2024-06-04T15:52:44.518741+0000","last_active":"2024-06-04T16:22:39.577605+0000","last_peered":"2024-06-04T16:22:39.577605+0000","last_clean":"2024-06-04T16:22:39.577605+0000","last_became_active":"2024-06-04T15:52:44.518522+0000","last_became_peered":"2024-06-04T15:52:44.518522+0000","last_unstale":"2024-06-04T16:22:39.577605+0000","last_undegraded":"2024-06-04T16:22:39.577605+0000","last_fullsized":"2024-06-04T16:22:39.577605+0000","mapping_epoch":29,"log_start":"251'400","ondisk_log_start":"251'400","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_clean_scrub_stamp":"2024-06-04T15:52:43.492872+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":400,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"254'25","reported_seq":494,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:00.025966+0000","last_change":"2024-06-04T15:52:46.529500+0000","last_active":"2024-06-04T16:22:00.025966+0000","last_peered":"2024-06-04T16:22:00.025966+0000","last_clean":"2024-06-04T16:22:00.025966+0000","last_became_active":"2024-06-04T15:52:46.529183+0000","last_became_peered":"2024-06-04T15:52:46.529183+0000","last_unstale":"2024-06-04T16:22:00.025966+0000","last_undegraded":"2024-06-04T16:22:00.025966+0000","last_fullsized":"2024-06-04T16:22:00.025966+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:45.513877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:45.513877+0000","last_clean_scrub_stamp":"2024-06-04T15:52:45.513877+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":33,"num_read_kb":31,"num_write":52,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"254'102","reported_seq":866,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:40.130050+0000","last_change":"2024-06-04T15:52:38.485496+0000","last_active":"2024-06-04T16:19:40.130050+0000","last_peered":"2024-06-04T16:19:40.130050+0000","last_clean":"2024-06-04T16:19:40.130050+0000","last_became_active":"2024-06-04T15:52:38.485146+0000","last_became_peered":"2024-06-04T15:52:38.485146+0000","last_unstale":"2024-06-04T16:19:40.130050+0000","last_undegraded":"2024-06-04T16:19:40.130050+0000","last_fullsized":"2024-06-04T16:19:40.130050+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T21:02:08.479603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":573,"num_read_kb":549,"num_write":116,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"251'24","reported_seq":516,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:40.009093+0000","last_change":"2024-06-04T15:52:36.475660+0000","last_active":"2024-06-04T16:18:40.009093+0000","last_peered":"2024-06-04T16:18:40.009093+0000","last_clean":"2024-06-04T16:18:40.009093+0000","last_became_active":"2024-06-04T15:52:36.475290+0000","last_became_peered":"2024-06-04T15:52:36.475290+0000","last_unstale":"2024-06-04T16:18:40.009093+0000","last_undegraded":"2024-06-04T16:18:40.009093+0000","last_fullsized":"2024-06-04T16:18:40.009093+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T20:08:50.243935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":22,"num_read_kb":15371,"num_write":75,"num_write_kb":21019,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,2],"acting":[4,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":474,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:40.014557+0000","last_change":"2024-06-04T15:52:40.482222+0000","last_active":"2024-06-04T16:19:40.014557+0000","last_peered":"2024-06-04T16:19:40.014557+0000","last_clean":"2024-06-04T16:19:40.014557+0000","last_became_active":"2024-06-04T15:52:40.481856+0000","last_became_peered":"2024-06-04T15:52:40.481856+0000","last_unstale":"2024-06-04T16:19:40.014557+0000","last_undegraded":"2024-06-04T16:19:40.014557+0000","last_fullsized":"2024-06-04T16:19:40.014557+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_clean_scrub_stamp":"2024-06-04T15:52:39.463103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T21:21:46.829568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"254'140","reported_seq":710,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:39.513928+0000","last_change":"2024-06-04T15:52:42.503483+0000","last_active":"2024-06-04T16:22:39.513928+0000","last_peered":"2024-06-04T16:22:39.513928+0000","last_clean":"2024-06-04T16:22:39.513928+0000","last_became_active":"2024-06-04T15:52:42.503214+0000","last_became_peered":"2024-06-04T15:52:42.503214+0000","last_unstale":"2024-06-04T16:22:39.513928+0000","last_undegraded":"2024-06-04T16:22:39.513928+0000","last_fullsized":"2024-06-04T16:22:39.513928+0000","mapping_epoch":27,"log_start":"251'100","ondisk_log_start":"251'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_clean_scrub_stamp":"2024-06-04T15:52:41.476734+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":100,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27149,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":238,"num_read_kb":318,"num_write":172,"num_write_kb":95,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":466,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:00.026012+0000","last_change":"2024-06-04T15:52:44.514586+0000","last_active":"2024-06-04T16:22:00.026012+0000","last_peered":"2024-06-04T16:22:00.026012+0000","last_clean":"2024-06-04T16:22:00.026012+0000","last_became_active":"2024-06-04T15:52:44.514269+0000","last_became_peered":"2024-06-04T15:52:44.514269+0000","last_unstale":"2024-06-04T16:22:00.026012+0000","last_undegraded":"2024-06-04T16:22:00.026012+0000","last_fullsized":"2024-06-04T16:22:00.026012+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_clean_scrub_stamp":"2024-06-04T15:52:43.492872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"254'31","reported_seq":503,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:55.132073+0000","last_change":"2024-06-04T15:52:46.532569+0000","last_active":"2024-06-04T16:19:55.132073+0000","last_peered":"2024-06-04T16:19:55.132073+0000","last_clean":"2024-06-04T16:19:55.132073+0000","last_became_active":"2024-06-04T15:52:46.531977+0000","last_became_peered":"2024-06-04T15:52:46.531977+0000","last_unstale":"2024-06-04T16:19:55.132073+0000","last_undegraded":"2024-06-04T16:19:55.132073+0000","last_fullsized":"2024-06-04T16:19:55.132073+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:45.513877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:45.513877+0000","last_clean_scrub_stamp":"2024-06-04T15:52:45.513877+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T23:12:23.178842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":49,"num_write":79,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"254'144","reported_seq":952,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:50.015669+0000","last_change":"2024-06-04T15:52:38.478958+0000","last_active":"2024-06-04T16:19:50.015669+0000","last_peered":"2024-06-04T16:19:50.015669+0000","last_clean":"2024-06-04T16:19:50.015669+0000","last_became_active":"2024-06-04T15:52:38.478362+0000","last_became_peered":"2024-06-04T15:52:38.478362+0000","last_unstale":"2024-06-04T16:19:50.015669+0000","last_undegraded":"2024-06-04T16:19:50.015669+0000","last_fullsized":"2024-06-04T16:19:50.015669+0000","mapping_epoch":23,"log_start":"251'100","ondisk_log_start":"251'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T22:47:09.266351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":807,"num_read_kb":748,"num_write":182,"num_write_kb":49,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":497,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:29.919383+0000","last_change":"2024-06-04T15:52:22.417765+0000","last_active":"2024-06-04T16:22:29.919383+0000","last_peered":"2024-06-04T16:22:29.919383+0000","last_clean":"2024-06-04T16:22:29.919383+0000","last_became_active":"2024-06-04T15:52:22.417462+0000","last_became_peered":"2024-06-04T15:52:22.417462+0000","last_unstale":"2024-06-04T16:22:29.919383+0000","last_undegraded":"2024-06-04T16:22:29.919383+0000","last_fullsized":"2024-06-04T16:22:29.919383+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:21.400880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:21.400880+0000","last_clean_scrub_stamp":"2024-06-04T15:52:21.400880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"251'43","reported_seq":534,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:45.017794+0000","last_change":"2024-06-04T15:52:36.498057+0000","last_active":"2024-06-04T16:19:45.017794+0000","last_peered":"2024-06-04T16:19:45.017794+0000","last_clean":"2024-06-04T16:19:45.017794+0000","last_became_active":"2024-06-04T15:52:36.497603+0000","last_became_peered":"2024-06-04T15:52:36.497603+0000","last_unstale":"2024-06-04T16:19:45.017794+0000","last_undegraded":"2024-06-04T16:19:45.017794+0000","last_fullsized":"2024-06-04T16:19:45.017794+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T21:06:13.700958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1069190,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":32,"num_read_kb":263,"num_write":148,"num_write_kb":16917,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,0],"acting":[4,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":479,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:21:50.022490+0000","last_change":"2024-06-04T15:52:40.483375+0000","last_active":"2024-06-04T16:21:50.022490+0000","last_peered":"2024-06-04T16:21:50.022490+0000","last_clean":"2024-06-04T16:21:50.022490+0000","last_became_active":"2024-06-04T15:52:40.482529+0000","last_became_peered":"2024-06-04T15:52:40.482529+0000","last_unstale":"2024-06-04T16:21:50.022490+0000","last_undegraded":"2024-06-04T16:21:50.022490+0000","last_fullsized":"2024-06-04T16:21:50.022490+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_clean_scrub_stamp":"2024-06-04T15:52:39.463103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"254'241","reported_seq":912,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:39.562885+0000","last_change":"2024-06-04T15:52:42.497154+0000","last_active":"2024-06-04T16:22:39.562885+0000","last_peered":"2024-06-04T16:22:39.562885+0000","last_clean":"2024-06-04T16:22:39.562885+0000","last_became_active":"2024-06-04T15:52:42.496878+0000","last_became_peered":"2024-06-04T15:52:42.496878+0000","last_unstale":"2024-06-04T16:22:39.562885+0000","last_undegraded":"2024-06-04T16:22:39.562885+0000","last_fullsized":"2024-06-04T16:22:39.562885+0000","mapping_epoch":27,"log_start":"251'200","ondisk_log_start":"251'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_clean_scrub_stamp":"2024-06-04T15:52:41.476734+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":200,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T19:44:50.163372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30577,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":489,"num_read_kb":691,"num_write":394,"num_write_kb":281,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":469,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:45.010474+0000","last_change":"2024-06-04T15:52:44.514011+0000","last_active":"2024-06-04T16:18:45.010474+0000","last_peered":"2024-06-04T16:18:45.010474+0000","last_clean":"2024-06-04T16:18:45.010474+0000","last_became_active":"2024-06-04T15:52:44.513726+0000","last_became_peered":"2024-06-04T15:52:44.513726+0000","last_unstale":"2024-06-04T16:18:45.010474+0000","last_undegraded":"2024-06-04T16:18:45.010474+0000","last_fullsized":"2024-06-04T16:18:45.010474+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_clean_scrub_stamp":"2024-06-04T15:52:43.492872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T19:48:02.146293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"254'34","reported_seq":517,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:21:00.017570+0000","last_change":"2024-06-04T15:52:46.536565+0000","last_active":"2024-06-04T16:21:00.017570+0000","last_peered":"2024-06-04T16:21:00.017570+0000","last_clean":"2024-06-04T16:21:00.017570+0000","last_became_active":"2024-06-04T15:52:46.536184+0000","last_became_peered":"2024-06-04T15:52:46.536184+0000","last_unstale":"2024-06-04T16:21:00.017570+0000","last_undegraded":"2024-06-04T16:21:00.017570+0000","last_fullsized":"2024-06-04T16:21:00.017570+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:45.513877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:45.513877+0000","last_clean_scrub_stamp":"2024-06-04T15:52:45.513877+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":408,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":64,"num_read_kb":61,"num_write":79,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"254'172","reported_seq":973,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:45.017681+0000","last_change":"2024-06-04T15:52:38.474997+0000","last_active":"2024-06-04T16:19:45.017681+0000","last_peered":"2024-06-04T16:19:45.017681+0000","last_clean":"2024-06-04T16:19:45.017681+0000","last_became_active":"2024-06-04T15:52:38.474646+0000","last_became_peered":"2024-06-04T15:52:38.474646+0000","last_unstale":"2024-06-04T16:19:45.017681+0000","last_undegraded":"2024-06-04T16:19:45.017681+0000","last_fullsized":"2024-06-04T16:19:45.017681+0000","mapping_epoch":23,"log_start":"251'100","ondisk_log_start":"251'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":100,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T03:13:37.646203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":944,"num_read_kb":866,"num_write":217,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":493,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:25.012795+0000","last_change":"2024-06-04T15:52:22.777198+0000","last_active":"2024-06-04T16:19:25.012795+0000","last_peered":"2024-06-04T16:19:25.012795+0000","last_clean":"2024-06-04T16:19:25.012795+0000","last_became_active":"2024-06-04T15:52:22.776779+0000","last_became_peered":"2024-06-04T15:52:22.776779+0000","last_unstale":"2024-06-04T16:19:25.012795+0000","last_undegraded":"2024-06-04T16:19:25.012795+0000","last_fullsized":"2024-06-04T16:19:25.012795+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:21.400880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:21.400880+0000","last_clean_scrub_stamp":"2024-06-04T15:52:21.400880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T02:49:10.441919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"251'43","reported_seq":540,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:21:50.022470+0000","last_change":"2024-06-04T15:52:36.495013+0000","last_active":"2024-06-04T16:21:50.022470+0000","last_peered":"2024-06-04T16:21:50.022470+0000","last_clean":"2024-06-04T16:21:50.022470+0000","last_became_active":"2024-06-04T15:52:36.494711+0000","last_became_peered":"2024-06-04T15:52:36.494711+0000","last_unstale":"2024-06-04T16:21:50.022470+0000","last_undegraded":"2024-06-04T16:21:50.022470+0000","last_fullsized":"2024-06-04T16:21:50.022470+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20644,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":32,"num_read_kb":101,"num_write":157,"num_write_kb":20554,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,4],"acting":[0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":476,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:45.130774+0000","last_change":"2024-06-04T15:52:40.485086+0000","last_active":"2024-06-04T16:19:45.130774+0000","last_peered":"2024-06-04T16:19:45.130774+0000","last_clean":"2024-06-04T16:19:45.130774+0000","last_became_active":"2024-06-04T15:52:40.484698+0000","last_became_peered":"2024-06-04T15:52:40.484698+0000","last_unstale":"2024-06-04T16:19:45.130774+0000","last_undegraded":"2024-06-04T16:19:45.130774+0000","last_fullsized":"2024-06-04T16:19:45.130774+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_clean_scrub_stamp":"2024-06-04T15:52:39.463103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T18:54:22.275767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"251'83","reported_seq":589,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:45.010464+0000","last_change":"2024-06-04T15:52:42.500941+0000","last_active":"2024-06-04T16:18:45.010464+0000","last_peered":"2024-06-04T16:18:45.010464+0000","last_clean":"2024-06-04T16:18:45.010464+0000","last_became_active":"2024-06-04T15:52:42.500646+0000","last_became_peered":"2024-06-04T15:52:42.500646+0000","last_unstale":"2024-06-04T16:18:45.010464+0000","last_undegraded":"2024-06-04T16:18:45.010464+0000","last_fullsized":"2024-06-04T16:18:45.010464+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_clean_scrub_stamp":"2024-06-04T15:52:41.476734+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T22:44:47.011875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":102,"num_read_kb":94,"num_write":72,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":466,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:45.008452+0000","last_change":"2024-06-04T15:52:44.521167+0000","last_active":"2024-06-04T16:18:45.008452+0000","last_peered":"2024-06-04T16:18:45.008452+0000","last_clean":"2024-06-04T16:18:45.008452+0000","last_became_active":"2024-06-04T15:52:44.520841+0000","last_became_peered":"2024-06-04T15:52:44.520841+0000","last_unstale":"2024-06-04T16:18:45.008452+0000","last_undegraded":"2024-06-04T16:18:45.008452+0000","last_fullsized":"2024-06-04T16:18:45.008452+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_clean_scrub_stamp":"2024-06-04T15:52:43.492872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T01:14:42.414240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"251'34","reported_seq":535,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:21:00.128815+0000","last_change":"2024-06-04T15:52:46.540297+0000","last_active":"2024-06-04T16:21:00.128815+0000","last_peered":"2024-06-04T16:21:00.128815+0000","last_clean":"2024-06-04T16:21:00.128815+0000","last_became_active":"2024-06-04T15:52:46.539931+0000","last_became_peered":"2024-06-04T15:52:46.539931+0000","last_unstale":"2024-06-04T16:21:00.128815+0000","last_undegraded":"2024-06-04T16:21:00.128815+0000","last_fullsized":"2024-06-04T16:21:00.128815+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:45.513877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:45.513877+0000","last_clean_scrub_stamp":"2024-06-04T15:52:45.513877+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":127,"num_read_kb":111,"num_write":92,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"254'119","reported_seq":1028,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:40.008889+0000","last_change":"2024-06-04T15:52:38.486040+0000","last_active":"2024-06-04T16:18:40.008889+0000","last_peered":"2024-06-04T16:18:40.008889+0000","last_clean":"2024-06-04T16:18:40.008889+0000","last_became_active":"2024-06-04T15:52:38.485755+0000","last_became_peered":"2024-06-04T15:52:38.485755+0000","last_unstale":"2024-06-04T16:18:40.008889+0000","last_undegraded":"2024-06-04T16:18:40.008889+0000","last_fullsized":"2024-06-04T16:18:40.008889+0000","mapping_epoch":23,"log_start":"254'100","ondisk_log_start":"254'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":100,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T16:25:57.227817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":989,"num_read_kb":963,"num_write":137,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":496,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:21:35.020936+0000","last_change":"2024-06-04T15:52:22.423235+0000","last_active":"2024-06-04T16:21:35.020936+0000","last_peered":"2024-06-04T16:21:35.020936+0000","last_clean":"2024-06-04T16:21:35.020936+0000","last_became_active":"2024-06-04T15:52:22.422971+0000","last_became_peered":"2024-06-04T15:52:22.422971+0000","last_unstale":"2024-06-04T16:21:35.020936+0000","last_undegraded":"2024-06-04T16:21:35.020936+0000","last_fullsized":"2024-06-04T16:21:35.020936+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:21.400880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:21.400880+0000","last_clean_scrub_stamp":"2024-06-04T15:52:21.400880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"254'72","reported_seq":612,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:39.496813+0000","last_change":"2024-06-04T15:52:36.485796+0000","last_active":"2024-06-04T16:22:39.496813+0000","last_peered":"2024-06-04T16:22:39.496813+0000","last_clean":"2024-06-04T16:22:39.496813+0000","last_became_active":"2024-06-04T15:52:36.485475+0000","last_became_peered":"2024-06-04T15:52:36.485475+0000","last_unstale":"2024-06-04T16:22:39.496813+0000","last_undegraded":"2024-06-04T16:22:39.496813+0000","last_fullsized":"2024-06-04T16:22:39.496813+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T22:10:16.220150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":109,"num_read_kb":62832,"num_write":269,"num_write_kb":45136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,2],"acting":[5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"26'1","reported_seq":476,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:40.121529+0000","last_change":"2024-06-04T15:52:40.486597+0000","last_active":"2024-06-04T16:18:40.121529+0000","last_peered":"2024-06-04T16:18:40.121529+0000","last_clean":"2024-06-04T16:18:40.121529+0000","last_became_active":"2024-06-04T15:52:40.486003+0000","last_became_peered":"2024-06-04T15:52:40.486003+0000","last_unstale":"2024-06-04T16:18:40.121529+0000","last_undegraded":"2024-06-04T16:18:40.121529+0000","last_fullsized":"2024-06-04T16:18:40.121529+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_clean_scrub_stamp":"2024-06-04T15:52:39.463103+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T00:11:15.750860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"254'117","reported_seq":992,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:32.537773+0000","last_change":"2024-06-04T15:52:42.505519+0000","last_active":"2024-06-04T16:22:32.537773+0000","last_peered":"2024-06-04T16:22:32.537773+0000","last_clean":"2024-06-04T16:22:32.537773+0000","last_became_active":"2024-06-04T15:52:42.505250+0000","last_became_peered":"2024-06-04T15:52:42.505250+0000","last_unstale":"2024-06-04T16:22:32.537773+0000","last_undegraded":"2024-06-04T16:22:32.537773+0000","last_fullsized":"2024-06-04T16:22:32.537773+0000","mapping_epoch":27,"log_start":"251'100","ondisk_log_start":"251'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_clean_scrub_stamp":"2024-06-04T15:52:41.476734+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":113,"num_read_kb":103,"num_write":67,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":468,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:50.018609+0000","last_change":"2024-06-04T15:52:44.522460+0000","last_active":"2024-06-04T16:19:50.018609+0000","last_peered":"2024-06-04T16:19:50.018609+0000","last_clean":"2024-06-04T16:19:50.018609+0000","last_became_active":"2024-06-04T15:52:44.522168+0000","last_became_peered":"2024-06-04T15:52:44.522168+0000","last_unstale":"2024-06-04T16:19:50.018609+0000","last_undegraded":"2024-06-04T16:19:50.018609+0000","last_fullsized":"2024-06-04T16:19:50.018609+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_clean_scrub_stamp":"2024-06-04T15:52:43.492872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T20:17:24.091454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.b","version":"254'111","reported_seq":601,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:50.018584+0000","last_change":"2024-06-04T15:52:46.537611+0000","last_active":"2024-06-04T16:19:50.018584+0000","last_peered":"2024-06-04T16:19:50.018584+0000","last_clean":"2024-06-04T16:19:50.018584+0000","last_became_active":"2024-06-04T15:52:46.537377+0000","last_became_peered":"2024-06-04T15:52:46.537377+0000","last_unstale":"2024-06-04T16:19:50.018584+0000","last_undegraded":"2024-06-04T16:19:50.018584+0000","last_fullsized":"2024-06-04T16:19:50.018584+0000","mapping_epoch":31,"log_start":"251'100","ondisk_log_start":"251'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:45.513877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:45.513877+0000","last_clean_scrub_stamp":"2024-06-04T15:52:45.513877+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":100,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T22:06:04.608286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":232,"num_read_kb":256,"num_write":227,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.6","version":"254'74","reported_seq":765,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:40.009736+0000","last_change":"2024-06-04T15:52:38.487720+0000","last_active":"2024-06-04T16:18:40.009736+0000","last_peered":"2024-06-04T16:18:40.009736+0000","last_clean":"2024-06-04T16:18:40.009736+0000","last_became_active":"2024-06-04T15:52:38.487359+0000","last_became_peered":"2024-06-04T15:52:38.487359+0000","last_unstale":"2024-06-04T16:18:40.009736+0000","last_undegraded":"2024-06-04T16:18:40.009736+0000","last_fullsized":"2024-06-04T16:18:40.009736+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T16:18:23.773829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":431,"num_read_kb":414,"num_write":84,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":494,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:30.015833+0000","last_change":"2024-06-04T15:52:22.423963+0000","last_active":"2024-06-04T16:19:30.015833+0000","last_peered":"2024-06-04T16:19:30.015833+0000","last_clean":"2024-06-04T16:19:30.015833+0000","last_became_active":"2024-06-04T15:52:22.423712+0000","last_became_peered":"2024-06-04T15:52:22.423712+0000","last_unstale":"2024-06-04T16:19:30.015833+0000","last_undegraded":"2024-06-04T16:19:30.015833+0000","last_fullsized":"2024-06-04T16:19:30.015833+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:21.400880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:21.400880+0000","last_clean_scrub_stamp":"2024-06-04T15:52:21.400880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T02:49:57.732530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"17'72","reported_seq":584,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:20:30.020067+0000","last_change":"2024-06-04T15:52:22.429522+0000","last_active":"2024-06-04T16:20:30.020067+0000","last_peered":"2024-06-04T16:20:30.020067+0000","last_clean":"2024-06-04T16:20:30.020067+0000","last_became_active":"2024-06-04T15:52:22.428356+0000","last_became_peered":"2024-06-04T15:52:22.428356+0000","last_unstale":"2024-06-04T16:20:30.020067+0000","last_undegraded":"2024-06-04T16:20:30.020067+0000","last_fullsized":"2024-06-04T16:20:30.020067+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:21.400880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:21.400880+0000","last_clean_scrub_stamp":"2024-06-04T15:52:21.400880+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T18:42:36.118905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"254'72","reported_seq":580,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:45.017581+0000","last_change":"2024-06-04T15:52:36.488969+0000","last_active":"2024-06-04T16:19:45.017581+0000","last_peered":"2024-06-04T16:19:45.017581+0000","last_clean":"2024-06-04T16:19:45.017581+0000","last_became_active":"2024-06-04T15:52:36.488567+0000","last_became_peered":"2024-06-04T15:52:36.488567+0000","last_unstale":"2024-06-04T16:19:45.017581+0000","last_undegraded":"2024-06-04T16:19:45.017581+0000","last_fullsized":"2024-06-04T16:19:45.017581+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T22:39:10.146956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133705,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":100,"num_read_kb":15171,"num_write":323,"num_write_kb":30782,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,4],"acting":[6,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":474,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:40.007854+0000","last_change":"2024-06-04T15:52:40.479422+0000","last_active":"2024-06-04T16:18:40.007854+0000","last_peered":"2024-06-04T16:18:40.007854+0000","last_clean":"2024-06-04T16:18:40.007854+0000","last_became_active":"2024-06-04T15:52:40.479168+0000","last_became_peered":"2024-06-04T15:52:40.479168+0000","last_unstale":"2024-06-04T16:18:40.007854+0000","last_undegraded":"2024-06-04T16:18:40.007854+0000","last_fullsized":"2024-06-04T16:18:40.007854+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_clean_scrub_stamp":"2024-06-04T15:52:39.463103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T20:31:07.436900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"254'560","reported_seq":1737,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:39.516609+0000","last_change":"2024-06-04T15:52:42.503507+0000","last_active":"2024-06-04T16:22:39.516609+0000","last_peered":"2024-06-04T16:22:39.516609+0000","last_clean":"2024-06-04T16:22:39.516609+0000","last_became_active":"2024-06-04T15:52:42.503178+0000","last_became_peered":"2024-06-04T15:52:42.503178+0000","last_unstale":"2024-06-04T16:22:39.516609+0000","last_undegraded":"2024-06-04T16:22:39.516609+0000","last_fullsized":"2024-06-04T16:22:39.516609+0000","mapping_epoch":27,"log_start":"251'500","ondisk_log_start":"251'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_clean_scrub_stamp":"2024-06-04T15:52:41.476734+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":500,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T20:05:37.750208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29662,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":838,"num_read_kb":1049,"num_write":188,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":467,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:55.016249+0000","last_change":"2024-06-04T15:52:44.523212+0000","last_active":"2024-06-04T16:19:55.016249+0000","last_peered":"2024-06-04T16:19:55.016249+0000","last_clean":"2024-06-04T16:19:55.016249+0000","last_became_active":"2024-06-04T15:52:44.522475+0000","last_became_peered":"2024-06-04T15:52:44.522475+0000","last_unstale":"2024-06-04T16:19:55.016249+0000","last_undegraded":"2024-06-04T16:19:55.016249+0000","last_fullsized":"2024-06-04T16:19:55.016249+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_clean_scrub_stamp":"2024-06-04T15:52:43.492872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T23:00:33.107705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"254'71","reported_seq":556,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:55.011834+0000","last_change":"2024-06-04T15:52:46.542179+0000","last_active":"2024-06-04T16:18:55.011834+0000","last_peered":"2024-06-04T16:18:55.011834+0000","last_clean":"2024-06-04T16:18:55.011834+0000","last_became_active":"2024-06-04T15:52:46.541851+0000","last_became_peered":"2024-06-04T15:52:46.541851+0000","last_unstale":"2024-06-04T16:18:55.011834+0000","last_undegraded":"2024-06-04T16:18:55.011834+0000","last_fullsized":"2024-06-04T16:18:55.011834+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:45.513877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:45.513877+0000","last_clean_scrub_stamp":"2024-06-04T15:52:45.513877+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T00:45:41.120418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":147,"num_read_kb":147,"num_write":159,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1","version":"254'115","reported_seq":813,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:21:50.024896+0000","last_change":"2024-06-04T15:52:38.485610+0000","last_active":"2024-06-04T16:21:50.024896+0000","last_peered":"2024-06-04T16:21:50.024896+0000","last_clean":"2024-06-04T16:21:50.024896+0000","last_became_active":"2024-06-04T15:52:38.485314+0000","last_became_peered":"2024-06-04T15:52:38.485314+0000","last_unstale":"2024-06-04T16:21:50.024896+0000","last_undegraded":"2024-06-04T16:21:50.024896+0000","last_fullsized":"2024-06-04T16:21:50.024896+0000","mapping_epoch":23,"log_start":"251'100","ondisk_log_start":"251'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":100,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":554,"num_read_kb":505,"num_write":149,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"251'78","reported_seq":587,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:40.009180+0000","last_change":"2024-06-04T15:52:36.479114+0000","last_active":"2024-06-04T16:18:40.009180+0000","last_peered":"2024-06-04T16:18:40.009180+0000","last_clean":"2024-06-04T16:18:40.009180+0000","last_became_active":"2024-06-04T15:52:36.478729+0000","last_became_peered":"2024-06-04T15:52:36.478729+0000","last_unstale":"2024-06-04T16:18:40.009180+0000","last_undegraded":"2024-06-04T16:18:40.009180+0000","last_fullsized":"2024-06-04T16:18:40.009180+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T01:31:26.285385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6659325,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":108,"num_read_kb":2222,"num_write":295,"num_write_kb":32111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,1],"acting":[4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":494,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:30.128608+0000","last_change":"2024-06-04T15:52:22.429208+0000","last_active":"2024-06-04T16:19:30.128608+0000","last_peered":"2024-06-04T16:19:30.128608+0000","last_clean":"2024-06-04T16:19:30.128608+0000","last_became_active":"2024-06-04T15:52:22.428894+0000","last_became_peered":"2024-06-04T15:52:22.428894+0000","last_unstale":"2024-06-04T16:19:30.128608+0000","last_undegraded":"2024-06-04T16:19:30.128608+0000","last_fullsized":"2024-06-04T16:19:30.128608+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:21.400880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:21.400880+0000","last_clean_scrub_stamp":"2024-06-04T15:52:21.400880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T18:26:12.779439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":476,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:45.009808+0000","last_change":"2024-06-04T15:52:40.479253+0000","last_active":"2024-06-04T16:18:45.009808+0000","last_peered":"2024-06-04T16:18:45.009808+0000","last_clean":"2024-06-04T16:18:45.009808+0000","last_became_active":"2024-06-04T15:52:40.478970+0000","last_became_peered":"2024-06-04T15:52:40.478970+0000","last_unstale":"2024-06-04T16:18:45.009808+0000","last_undegraded":"2024-06-04T16:18:45.009808+0000","last_fullsized":"2024-06-04T16:18:45.009808+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_clean_scrub_stamp":"2024-06-04T15:52:39.463103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T00:22:45.981375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"254'255","reported_seq":940,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:39.505244+0000","last_change":"2024-06-04T15:52:42.505691+0000","last_active":"2024-06-04T16:22:39.505244+0000","last_peered":"2024-06-04T16:22:39.505244+0000","last_clean":"2024-06-04T16:22:39.505244+0000","last_became_active":"2024-06-04T15:52:42.504735+0000","last_became_peered":"2024-06-04T15:52:42.504735+0000","last_unstale":"2024-06-04T16:22:39.505244+0000","last_undegraded":"2024-06-04T16:22:39.505244+0000","last_fullsized":"2024-06-04T16:22:39.505244+0000","mapping_epoch":27,"log_start":"251'200","ondisk_log_start":"251'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_clean_scrub_stamp":"2024-06-04T15:52:41.476734+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":200,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20543,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":406,"num_read_kb":567,"num_write":188,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":468,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:50.018529+0000","last_change":"2024-06-04T15:52:44.523070+0000","last_active":"2024-06-04T16:19:50.018529+0000","last_peered":"2024-06-04T16:19:50.018529+0000","last_clean":"2024-06-04T16:19:50.018529+0000","last_became_active":"2024-06-04T15:52:44.522746+0000","last_became_peered":"2024-06-04T15:52:44.522746+0000","last_unstale":"2024-06-04T16:19:50.018529+0000","last_undegraded":"2024-06-04T16:19:50.018529+0000","last_fullsized":"2024-06-04T16:19:50.018529+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_clean_scrub_stamp":"2024-06-04T15:52:43.492872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T02:29:17.973008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.d","version":"254'26","reported_seq":499,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:05.026474+0000","last_change":"2024-06-04T15:52:46.530753+0000","last_active":"2024-06-04T16:22:05.026474+0000","last_peered":"2024-06-04T16:22:05.026474+0000","last_clean":"2024-06-04T16:22:05.026474+0000","last_became_active":"2024-06-04T15:52:46.530480+0000","last_became_peered":"2024-06-04T15:52:46.530480+0000","last_unstale":"2024-06-04T16:22:05.026474+0000","last_undegraded":"2024-06-04T16:22:05.026474+0000","last_fullsized":"2024-06-04T16:22:05.026474+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:45.513877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:45.513877+0000","last_clean_scrub_stamp":"2024-06-04T15:52:45.513877+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":260,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":42,"num_read_kb":31,"num_write":58,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"254'173","reported_seq":1002,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:45.009776+0000","last_change":"2024-06-04T15:52:38.485046+0000","last_active":"2024-06-04T16:18:45.009776+0000","last_peered":"2024-06-04T16:18:45.009776+0000","last_clean":"2024-06-04T16:18:45.009776+0000","last_became_active":"2024-06-04T15:52:38.484384+0000","last_became_peered":"2024-06-04T15:52:38.484384+0000","last_unstale":"2024-06-04T16:18:45.009776+0000","last_undegraded":"2024-06-04T16:18:45.009776+0000","last_fullsized":"2024-06-04T16:18:45.009776+0000","mapping_epoch":23,"log_start":"251'100","ondisk_log_start":"251'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":100,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T21:07:28.223775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":881,"num_read_kb":808,"num_write":233,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"251'46","reported_seq":543,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:40.009204+0000","last_change":"2024-06-04T15:52:36.478112+0000","last_active":"2024-06-04T16:18:40.009204+0000","last_peered":"2024-06-04T16:18:40.009204+0000","last_clean":"2024-06-04T16:18:40.009204+0000","last_became_active":"2024-06-04T15:52:36.477622+0000","last_became_peered":"2024-06-04T15:52:36.477622+0000","last_unstale":"2024-06-04T16:18:40.009204+0000","last_undegraded":"2024-06-04T16:18:40.009204+0000","last_fullsized":"2024-06-04T16:18:40.009204+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T20:13:45.546860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":45,"num_write":152,"num_write_kb":28742,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":493,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:21:40.023905+0000","last_change":"2024-06-04T15:52:22.777104+0000","last_active":"2024-06-04T16:21:40.023905+0000","last_peered":"2024-06-04T16:21:40.023905+0000","last_clean":"2024-06-04T16:21:40.023905+0000","last_became_active":"2024-06-04T15:52:22.776744+0000","last_became_peered":"2024-06-04T15:52:22.776744+0000","last_unstale":"2024-06-04T16:21:40.023905+0000","last_undegraded":"2024-06-04T16:21:40.023905+0000","last_fullsized":"2024-06-04T16:21:40.023905+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:21.400880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:21.400880+0000","last_clean_scrub_stamp":"2024-06-04T15:52:21.400880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":475,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:45.015027+0000","last_change":"2024-06-04T15:52:40.479829+0000","last_active":"2024-06-04T16:19:45.015027+0000","last_peered":"2024-06-04T16:19:45.015027+0000","last_clean":"2024-06-04T16:19:45.015027+0000","last_became_active":"2024-06-04T15:52:40.479319+0000","last_became_peered":"2024-06-04T15:52:40.479319+0000","last_unstale":"2024-06-04T16:19:45.015027+0000","last_undegraded":"2024-06-04T16:19:45.015027+0000","last_fullsized":"2024-06-04T16:19:45.015027+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_clean_scrub_stamp":"2024-06-04T15:52:39.463103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T19:40:34.615992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"251'66","reported_seq":567,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:50.015638+0000","last_change":"2024-06-04T15:52:42.500455+0000","last_active":"2024-06-04T16:19:50.015638+0000","last_peered":"2024-06-04T16:19:50.015638+0000","last_clean":"2024-06-04T16:19:50.015638+0000","last_became_active":"2024-06-04T15:52:42.500141+0000","last_became_peered":"2024-06-04T15:52:42.500141+0000","last_unstale":"2024-06-04T16:19:50.015638+0000","last_undegraded":"2024-06-04T16:19:50.015638+0000","last_fullsized":"2024-06-04T16:19:50.015638+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_clean_scrub_stamp":"2024-06-04T15:52:41.476734+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T19:52:33.859931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":90,"num_read_kb":83,"num_write":60,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"254'479","reported_seq":1474,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:39.362413+0000","last_change":"2024-06-04T15:52:44.517489+0000","last_active":"2024-06-04T16:22:39.362413+0000","last_peered":"2024-06-04T16:22:39.362413+0000","last_clean":"2024-06-04T16:22:39.362413+0000","last_became_active":"2024-06-04T15:52:44.517202+0000","last_became_peered":"2024-06-04T15:52:44.517202+0000","last_unstale":"2024-06-04T16:22:39.362413+0000","last_undegraded":"2024-06-04T16:22:39.362413+0000","last_fullsized":"2024-06-04T16:22:39.362413+0000","mapping_epoch":29,"log_start":"251'400","ondisk_log_start":"251'400","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_clean_scrub_stamp":"2024-06-04T15:52:43.492872+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":400,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T18:33:54.152070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.c","version":"254'27","reported_seq":495,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:50.019201+0000","last_change":"2024-06-04T15:52:46.539323+0000","last_active":"2024-06-04T16:19:50.019201+0000","last_peered":"2024-06-04T16:19:50.019201+0000","last_clean":"2024-06-04T16:19:50.019201+0000","last_became_active":"2024-06-04T15:52:46.538975+0000","last_became_peered":"2024-06-04T15:52:46.538975+0000","last_unstale":"2024-06-04T16:19:50.019201+0000","last_undegraded":"2024-06-04T16:19:50.019201+0000","last_fullsized":"2024-06-04T16:19:50.019201+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:45.513877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:45.513877+0000","last_clean_scrub_stamp":"2024-06-04T15:52:45.513877+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T19:08:40.491462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":27,"num_write":64,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3","version":"254'179","reported_seq":1065,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:45.017635+0000","last_change":"2024-06-04T15:52:38.483119+0000","last_active":"2024-06-04T16:19:45.017635+0000","last_peered":"2024-06-04T16:19:45.017635+0000","last_clean":"2024-06-04T16:19:45.017635+0000","last_became_active":"2024-06-04T15:52:38.482240+0000","last_became_peered":"2024-06-04T15:52:38.482240+0000","last_unstale":"2024-06-04T16:19:45.017635+0000","last_undegraded":"2024-06-04T16:19:45.017635+0000","last_fullsized":"2024-06-04T16:19:45.017635+0000","mapping_epoch":23,"log_start":"251'100","ondisk_log_start":"251'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":100,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T17:54:39.066445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1045,"num_read_kb":968,"num_write":230,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"251'34","reported_seq":524,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:45.017653+0000","last_change":"2024-06-04T15:52:36.478791+0000","last_active":"2024-06-04T16:19:45.017653+0000","last_peered":"2024-06-04T16:19:45.017653+0000","last_clean":"2024-06-04T16:19:45.017653+0000","last_became_active":"2024-06-04T15:52:36.478441+0000","last_became_peered":"2024-06-04T15:52:36.478441+0000","last_unstale":"2024-06-04T16:19:45.017653+0000","last_undegraded":"2024-06-04T16:19:45.017653+0000","last_fullsized":"2024-06-04T16:19:45.017653+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T20:43:41.486063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":32,"num_read_kb":7500,"num_write":131,"num_write_kb":23723,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,4],"acting":[6,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":493,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:20:30.020164+0000","last_change":"2024-06-04T15:52:22.777126+0000","last_active":"2024-06-04T16:20:30.020164+0000","last_peered":"2024-06-04T16:20:30.020164+0000","last_clean":"2024-06-04T16:20:30.020164+0000","last_became_active":"2024-06-04T15:52:22.776729+0000","last_became_peered":"2024-06-04T15:52:22.776729+0000","last_unstale":"2024-06-04T16:20:30.020164+0000","last_undegraded":"2024-06-04T16:20:30.020164+0000","last_fullsized":"2024-06-04T16:20:30.020164+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:21.400880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:21.400880+0000","last_clean_scrub_stamp":"2024-06-04T15:52:21.400880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T03:08:22.360737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":479,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:21:50.022445+0000","last_change":"2024-06-04T15:52:40.482239+0000","last_active":"2024-06-04T16:21:50.022445+0000","last_peered":"2024-06-04T16:21:50.022445+0000","last_clean":"2024-06-04T16:21:50.022445+0000","last_became_active":"2024-06-04T15:52:40.481870+0000","last_became_peered":"2024-06-04T15:52:40.481870+0000","last_unstale":"2024-06-04T16:21:50.022445+0000","last_undegraded":"2024-06-04T16:21:50.022445+0000","last_fullsized":"2024-06-04T16:21:50.022445+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_clean_scrub_stamp":"2024-06-04T15:52:39.463103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"254'99","reported_seq":618,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:50.018377+0000","last_change":"2024-06-04T15:52:42.502041+0000","last_active":"2024-06-04T16:19:50.018377+0000","last_peered":"2024-06-04T16:19:50.018377+0000","last_clean":"2024-06-04T16:19:50.018377+0000","last_became_active":"2024-06-04T15:52:42.501708+0000","last_became_peered":"2024-06-04T15:52:42.501708+0000","last_unstale":"2024-06-04T16:19:50.018377+0000","last_undegraded":"2024-06-04T16:19:50.018377+0000","last_fullsized":"2024-06-04T16:19:50.018377+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_clean_scrub_stamp":"2024-06-04T15:52:41.476734+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T18:42:19.221112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":147,"num_read_kb":140,"num_write":98,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.0","version":"254'470","reported_seq":1649,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:39.574684+0000","last_change":"2024-06-04T15:52:44.517953+0000","last_active":"2024-06-04T16:22:39.574684+0000","last_peered":"2024-06-04T16:22:39.574684+0000","last_clean":"2024-06-04T16:22:39.574684+0000","last_became_active":"2024-06-04T15:52:44.517066+0000","last_became_peered":"2024-06-04T15:52:44.517066+0000","last_unstale":"2024-06-04T16:22:39.574684+0000","last_undegraded":"2024-06-04T16:22:39.574684+0000","last_fullsized":"2024-06-04T16:22:39.574684+0000","mapping_epoch":29,"log_start":"251'400","ondisk_log_start":"251'400","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_clean_scrub_stamp":"2024-06-04T15:52:43.492872+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":400,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"254'27","reported_seq":493,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:05.151518+0000","last_change":"2024-06-04T15:52:46.532254+0000","last_active":"2024-06-04T16:22:05.151518+0000","last_peered":"2024-06-04T16:22:05.151518+0000","last_clean":"2024-06-04T16:22:05.151518+0000","last_became_active":"2024-06-04T15:52:46.531967+0000","last_became_peered":"2024-06-04T15:52:46.531967+0000","last_unstale":"2024-06-04T16:22:05.151518+0000","last_undegraded":"2024-06-04T16:22:05.151518+0000","last_fullsized":"2024-06-04T16:22:05.151518+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:45.513877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:45.513877+0000","last_clean_scrub_stamp":"2024-06-04T15:52:45.513877+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T21:57:32.068478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":905,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":28,"num_read_kb":26,"num_write":64,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2","version":"254'131","reported_seq":930,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:45.017599+0000","last_change":"2024-06-04T15:52:38.481406+0000","last_active":"2024-06-04T16:19:45.017599+0000","last_peered":"2024-06-04T16:19:45.017599+0000","last_clean":"2024-06-04T16:19:45.017599+0000","last_became_active":"2024-06-04T15:52:38.480942+0000","last_became_peered":"2024-06-04T15:52:38.480942+0000","last_unstale":"2024-06-04T16:19:45.017599+0000","last_undegraded":"2024-06-04T16:19:45.017599+0000","last_fullsized":"2024-06-04T16:19:45.017599+0000","mapping_epoch":23,"log_start":"251'100","ondisk_log_start":"251'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T20:49:38.683287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":705,"num_read_kb":672,"num_write":147,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"251'54","reported_seq":560,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:21:55.025493+0000","last_change":"2024-06-04T15:52:36.484356+0000","last_active":"2024-06-04T16:21:55.025493+0000","last_peered":"2024-06-04T16:21:55.025493+0000","last_clean":"2024-06-04T16:21:55.025493+0000","last_became_active":"2024-06-04T15:52:36.480469+0000","last_became_peered":"2024-06-04T15:52:36.480469+0000","last_unstale":"2024-06-04T16:21:55.025493+0000","last_undegraded":"2024-06-04T16:21:55.025493+0000","last_fullsized":"2024-06-04T16:21:55.025493+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":69,"num_read_kb":32811,"num_write":225,"num_write_kb":30438,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,4],"acting":[2,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":496,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:44.133053+0000","last_change":"2024-06-04T15:52:22.777053+0000","last_active":"2024-06-04T16:22:44.133053+0000","last_peered":"2024-06-04T16:22:44.133053+0000","last_clean":"2024-06-04T16:22:44.133053+0000","last_became_active":"2024-06-04T15:52:22.776723+0000","last_became_peered":"2024-06-04T15:52:22.776723+0000","last_unstale":"2024-06-04T16:22:44.133053+0000","last_undegraded":"2024-06-04T16:22:44.133053+0000","last_fullsized":"2024-06-04T16:22:44.133053+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:21.400880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:21.400880+0000","last_clean_scrub_stamp":"2024-06-04T15:52:21.400880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":476,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:45.017841+0000","last_change":"2024-06-04T15:52:40.484565+0000","last_active":"2024-06-04T16:19:45.017841+0000","last_peered":"2024-06-04T16:19:45.017841+0000","last_clean":"2024-06-04T16:19:45.017841+0000","last_became_active":"2024-06-04T15:52:40.483802+0000","last_became_peered":"2024-06-04T15:52:40.483802+0000","last_unstale":"2024-06-04T16:19:45.017841+0000","last_undegraded":"2024-06-04T16:19:45.017841+0000","last_fullsized":"2024-06-04T16:19:45.017841+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_clean_scrub_stamp":"2024-06-04T15:52:39.463103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T18:37:27.476845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"254'201","reported_seq":827,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:39.571028+0000","last_change":"2024-06-04T15:52:42.499319+0000","last_active":"2024-06-04T16:22:39.571028+0000","last_peered":"2024-06-04T16:22:39.571028+0000","last_clean":"2024-06-04T16:22:39.571028+0000","last_became_active":"2024-06-04T15:52:42.499002+0000","last_became_peered":"2024-06-04T15:52:42.499002+0000","last_unstale":"2024-06-04T16:22:39.571028+0000","last_undegraded":"2024-06-04T16:22:39.571028+0000","last_fullsized":"2024-06-04T16:22:39.571028+0000","mapping_epoch":27,"log_start":"251'100","ondisk_log_start":"251'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_clean_scrub_stamp":"2024-06-04T15:52:41.476734+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":100,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T03:36:55.807593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20869,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":311,"num_read_kb":405,"num_write":154,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":467,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:21:55.025411+0000","last_change":"2024-06-04T15:52:44.520800+0000","last_active":"2024-06-04T16:21:55.025411+0000","last_peered":"2024-06-04T16:21:55.025411+0000","last_clean":"2024-06-04T16:21:55.025411+0000","last_became_active":"2024-06-04T15:52:44.520499+0000","last_became_peered":"2024-06-04T15:52:44.520499+0000","last_unstale":"2024-06-04T16:21:55.025411+0000","last_undegraded":"2024-06-04T16:21:55.025411+0000","last_fullsized":"2024-06-04T16:21:55.025411+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_clean_scrub_stamp":"2024-06-04T15:52:43.492872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"254'25","reported_seq":498,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:50.019241+0000","last_change":"2024-06-04T15:52:46.542360+0000","last_active":"2024-06-04T16:19:50.019241+0000","last_peered":"2024-06-04T16:19:50.019241+0000","last_clean":"2024-06-04T16:19:50.019241+0000","last_became_active":"2024-06-04T15:52:46.541768+0000","last_became_peered":"2024-06-04T15:52:46.541768+0000","last_unstale":"2024-06-04T16:19:50.019241+0000","last_undegraded":"2024-06-04T16:19:50.019241+0000","last_fullsized":"2024-06-04T16:19:50.019241+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:45.513877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:45.513877+0000","last_clean_scrub_stamp":"2024-06-04T15:52:45.513877+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T20:45:40.593310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":34,"num_write":60,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"254'24","reported_seq":489,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:55.019539+0000","last_change":"2024-06-04T15:52:46.541003+0000","last_active":"2024-06-04T16:19:55.019539+0000","last_peered":"2024-06-04T16:19:55.019539+0000","last_clean":"2024-06-04T16:19:55.019539+0000","last_became_active":"2024-06-04T15:52:46.540733+0000","last_became_peered":"2024-06-04T15:52:46.540733+0000","last_unstale":"2024-06-04T16:19:55.019539+0000","last_undegraded":"2024-06-04T16:19:55.019539+0000","last_fullsized":"2024-06-04T16:19:55.019539+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:45.513877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:45.513877+0000","last_clean_scrub_stamp":"2024-06-04T15:52:45.513877+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T23:13:36.615780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":53,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"254'151","reported_seq":917,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:20:40.016099+0000","last_change":"2024-06-04T15:52:38.480198+0000","last_active":"2024-06-04T16:20:40.016099+0000","last_peered":"2024-06-04T16:20:40.016099+0000","last_clean":"2024-06-04T16:20:40.016099+0000","last_became_active":"2024-06-04T15:52:38.479929+0000","last_became_peered":"2024-06-04T15:52:38.479929+0000","last_unstale":"2024-06-04T16:20:40.016099+0000","last_undegraded":"2024-06-04T16:20:40.016099+0000","last_fullsized":"2024-06-04T16:20:40.016099+0000","mapping_epoch":23,"log_start":"251'100","ondisk_log_start":"251'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":100,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":770,"num_read_kb":699,"num_write":204,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"251'34","reported_seq":545,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:25.005933+0000","last_change":"2024-06-04T15:52:36.497838+0000","last_active":"2024-06-04T16:18:25.005933+0000","last_peered":"2024-06-04T16:18:25.005933+0000","last_clean":"2024-06-04T16:18:25.005933+0000","last_became_active":"2024-06-04T15:52:36.497532+0000","last_became_peered":"2024-06-04T15:52:36.497532+0000","last_unstale":"2024-06-04T16:18:25.005933+0000","last_undegraded":"2024-06-04T16:18:25.005933+0000","last_fullsized":"2024-06-04T16:18:25.005933+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T16:03:02.229193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":54,"num_read_kb":42110,"num_write":160,"num_write_kb":16147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":470,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:20.006124+0000","last_change":"2024-06-04T15:52:40.484157+0000","last_active":"2024-06-04T16:18:20.006124+0000","last_peered":"2024-06-04T16:18:20.006124+0000","last_clean":"2024-06-04T16:18:20.006124+0000","last_became_active":"2024-06-04T15:52:40.483882+0000","last_became_peered":"2024-06-04T15:52:40.483882+0000","last_unstale":"2024-06-04T16:18:20.006124+0000","last_undegraded":"2024-06-04T16:18:20.006124+0000","last_fullsized":"2024-06-04T16:18:20.006124+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_clean_scrub_stamp":"2024-06-04T15:52:39.463103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T16:24:11.194485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.11","version":"254'96","reported_seq":634,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:39.528247+0000","last_change":"2024-06-04T15:52:42.504482+0000","last_active":"2024-06-04T16:22:39.528247+0000","last_peered":"2024-06-04T16:22:39.528247+0000","last_clean":"2024-06-04T16:22:39.528247+0000","last_became_active":"2024-06-04T15:52:42.504144+0000","last_became_peered":"2024-06-04T15:52:42.504144+0000","last_unstale":"2024-06-04T16:22:39.528247+0000","last_undegraded":"2024-06-04T16:22:39.528247+0000","last_fullsized":"2024-06-04T16:22:39.528247+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_clean_scrub_stamp":"2024-06-04T15:52:41.476734+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T18:40:42.712100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13519,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":145,"num_read_kb":205,"num_write":70,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":466,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:25.119072+0000","last_change":"2024-06-04T15:52:44.517996+0000","last_active":"2024-06-04T16:18:25.119072+0000","last_peered":"2024-06-04T16:18:25.119072+0000","last_clean":"2024-06-04T16:18:25.119072+0000","last_became_active":"2024-06-04T15:52:44.517718+0000","last_became_peered":"2024-06-04T15:52:44.517718+0000","last_unstale":"2024-06-04T16:18:25.119072+0000","last_undegraded":"2024-06-04T16:18:25.119072+0000","last_fullsized":"2024-06-04T16:18:25.119072+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_clean_scrub_stamp":"2024-06-04T15:52:43.492872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T16:20:37.573553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1e","version":"254'42","reported_seq":511,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:50.123024+0000","last_change":"2024-06-04T15:52:46.537867+0000","last_active":"2024-06-04T16:18:50.123024+0000","last_peered":"2024-06-04T16:18:50.123024+0000","last_clean":"2024-06-04T16:18:50.123024+0000","last_became_active":"2024-06-04T15:52:46.536917+0000","last_became_peered":"2024-06-04T15:52:46.536917+0000","last_unstale":"2024-06-04T16:18:50.123024+0000","last_undegraded":"2024-06-04T16:18:50.123024+0000","last_fullsized":"2024-06-04T16:18:50.123024+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:45.513877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:45.513877+0000","last_clean_scrub_stamp":"2024-06-04T15:52:45.513877+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T01:16:32.378412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":42,"num_write":101,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"254'151","reported_seq":983,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:22.327242+0000","last_change":"2024-06-04T15:52:38.488440+0000","last_active":"2024-06-04T16:18:22.327242+0000","last_peered":"2024-06-04T16:18:22.327242+0000","last_clean":"2024-06-04T16:18:22.327242+0000","last_became_active":"2024-06-04T15:52:38.488159+0000","last_became_peered":"2024-06-04T15:52:38.488159+0000","last_unstale":"2024-06-04T16:18:22.327242+0000","last_undegraded":"2024-06-04T16:18:22.327242+0000","last_fullsized":"2024-06-04T16:18:22.327242+0000","mapping_epoch":23,"log_start":"251'100","ondisk_log_start":"251'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":100,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T21:49:36.508131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":952,"num_read_kb":891,"num_write":194,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.15","version":"251'69","reported_seq":604,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:21:40.021461+0000","last_change":"2024-06-04T15:52:36.492824+0000","last_active":"2024-06-04T16:21:40.021461+0000","last_peered":"2024-06-04T16:21:40.021461+0000","last_clean":"2024-06-04T16:21:40.021461+0000","last_became_active":"2024-06-04T15:52:36.492503+0000","last_became_peered":"2024-06-04T15:52:36.492503+0000","last_unstale":"2024-06-04T16:21:40.021461+0000","last_undegraded":"2024-06-04T16:21:40.021461+0000","last_fullsized":"2024-06-04T16:21:40.021461+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":528536,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":128,"num_read_kb":6583,"num_write":319,"num_write_kb":16503,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,3],"acting":[0,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":474,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:20.006632+0000","last_change":"2024-06-04T15:52:40.484769+0000","last_active":"2024-06-04T16:18:20.006632+0000","last_peered":"2024-06-04T16:18:20.006632+0000","last_clean":"2024-06-04T16:18:20.006632+0000","last_became_active":"2024-06-04T15:52:40.484480+0000","last_became_peered":"2024-06-04T15:52:40.484480+0000","last_unstale":"2024-06-04T16:18:20.006632+0000","last_undegraded":"2024-06-04T16:18:20.006632+0000","last_fullsized":"2024-06-04T16:18:20.006632+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_clean_scrub_stamp":"2024-06-04T15:52:39.463103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T22:51:50.840432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"251'18","reported_seq":494,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:25.007177+0000","last_change":"2024-06-04T15:52:42.499940+0000","last_active":"2024-06-04T16:18:25.007177+0000","last_peered":"2024-06-04T16:18:25.007177+0000","last_clean":"2024-06-04T16:18:25.007177+0000","last_became_active":"2024-06-04T15:52:42.499592+0000","last_became_peered":"2024-06-04T15:52:42.499592+0000","last_unstale":"2024-06-04T16:18:25.007177+0000","last_undegraded":"2024-06-04T16:18:25.007177+0000","last_fullsized":"2024-06-04T16:18:25.007177+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_clean_scrub_stamp":"2024-06-04T15:52:41.476734+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T18:27:38.404606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":19,"num_read_kb":17,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":465,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:20:45.016541+0000","last_change":"2024-06-04T15:52:44.519396+0000","last_active":"2024-06-04T16:20:45.016541+0000","last_peered":"2024-06-04T16:20:45.016541+0000","last_clean":"2024-06-04T16:20:45.016541+0000","last_became_active":"2024-06-04T15:52:44.519102+0000","last_became_peered":"2024-06-04T15:52:44.519102+0000","last_unstale":"2024-06-04T16:20:45.016541+0000","last_undegraded":"2024-06-04T16:20:45.016541+0000","last_fullsized":"2024-06-04T16:20:45.016541+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_clean_scrub_stamp":"2024-06-04T15:52:43.492872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"254'24","reported_seq":490,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:21.701306+0000","last_change":"2024-06-04T15:52:46.534720+0000","last_active":"2024-06-04T16:18:21.701306+0000","last_peered":"2024-06-04T16:18:21.701306+0000","last_clean":"2024-06-04T16:18:21.701306+0000","last_became_active":"2024-06-04T15:52:46.534277+0000","last_became_peered":"2024-06-04T15:52:46.534277+0000","last_unstale":"2024-06-04T16:18:21.701306+0000","last_undegraded":"2024-06-04T16:18:21.701306+0000","last_fullsized":"2024-06-04T16:18:21.701306+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:45.513877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:45.513877+0000","last_clean_scrub_stamp":"2024-06-04T15:52:45.513877+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T19:20:11.363716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":38,"num_write":55,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"254'221","reported_seq":1035,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:22.093247+0000","last_change":"2024-06-04T15:52:38.482192+0000","last_active":"2024-06-04T16:18:22.093247+0000","last_peered":"2024-06-04T16:18:22.093247+0000","last_clean":"2024-06-04T16:18:22.093247+0000","last_became_active":"2024-06-04T15:52:38.481934+0000","last_became_peered":"2024-06-04T15:52:38.481934+0000","last_unstale":"2024-06-04T16:18:22.093247+0000","last_undegraded":"2024-06-04T16:18:22.093247+0000","last_fullsized":"2024-06-04T16:18:22.093247+0000","mapping_epoch":23,"log_start":"251'200","ondisk_log_start":"251'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":200,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T22:42:27.546656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1128,"num_read_kb":983,"num_write":320,"num_write_kb":131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.16","version":"251'39","reported_seq":529,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:21:40.023926+0000","last_change":"2024-06-04T15:52:36.481215+0000","last_active":"2024-06-04T16:21:40.023926+0000","last_peered":"2024-06-04T16:21:40.023926+0000","last_clean":"2024-06-04T16:21:40.023926+0000","last_became_active":"2024-06-04T15:52:36.480284+0000","last_became_peered":"2024-06-04T15:52:36.480284+0000","last_unstale":"2024-06-04T16:21:40.023926+0000","last_undegraded":"2024-06-04T16:21:40.023926+0000","last_fullsized":"2024-06-04T16:21:40.023926+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":37,"num_read_kb":1062,"num_write":155,"num_write_kb":20099,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4],"acting":[2,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":473,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:20:40.016062+0000","last_change":"2024-06-04T15:52:40.477894+0000","last_active":"2024-06-04T16:20:40.016062+0000","last_peered":"2024-06-04T16:20:40.016062+0000","last_clean":"2024-06-04T16:20:40.016062+0000","last_became_active":"2024-06-04T15:52:40.477609+0000","last_became_peered":"2024-06-04T15:52:40.477609+0000","last_unstale":"2024-06-04T16:20:40.016062+0000","last_undegraded":"2024-06-04T16:20:40.016062+0000","last_fullsized":"2024-06-04T16:20:40.016062+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_clean_scrub_stamp":"2024-06-04T15:52:39.463103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"254'133","reported_seq":690,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:39.480142+0000","last_change":"2024-06-04T15:52:42.496760+0000","last_active":"2024-06-04T16:22:39.480142+0000","last_peered":"2024-06-04T16:22:39.480142+0000","last_clean":"2024-06-04T16:22:39.480142+0000","last_became_active":"2024-06-04T15:52:42.496416+0000","last_became_peered":"2024-06-04T15:52:42.496416+0000","last_unstale":"2024-06-04T16:22:39.480142+0000","last_undegraded":"2024-06-04T16:22:39.480142+0000","last_fullsized":"2024-06-04T16:22:39.480142+0000","mapping_epoch":27,"log_start":"251'100","ondisk_log_start":"251'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_clean_scrub_stamp":"2024-06-04T15:52:41.476734+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":100,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T00:10:25.421866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14747,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":196,"num_read_kb":272,"num_write":106,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":469,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:20:45.127380+0000","last_change":"2024-06-04T15:52:44.520101+0000","last_active":"2024-06-04T16:20:45.127380+0000","last_peered":"2024-06-04T16:20:45.127380+0000","last_clean":"2024-06-04T16:20:45.127380+0000","last_became_active":"2024-06-04T15:52:44.519837+0000","last_became_peered":"2024-06-04T15:52:44.519837+0000","last_unstale":"2024-06-04T16:20:45.127380+0000","last_undegraded":"2024-06-04T16:20:45.127380+0000","last_fullsized":"2024-06-04T16:20:45.127380+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_clean_scrub_stamp":"2024-06-04T15:52:43.492872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"254'18","reported_seq":479,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:11.644322+0000","last_change":"2024-06-04T15:52:46.529613+0000","last_active":"2024-06-04T16:18:11.644322+0000","last_peered":"2024-06-04T16:18:11.644322+0000","last_clean":"2024-06-04T16:18:11.644322+0000","last_became_active":"2024-06-04T15:52:46.529366+0000","last_became_peered":"2024-06-04T15:52:46.529366+0000","last_unstale":"2024-06-04T16:18:11.644322+0000","last_undegraded":"2024-06-04T16:18:11.644322+0000","last_fullsized":"2024-06-04T16:18:11.644322+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:45.513877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:45.513877+0000","last_clean_scrub_stamp":"2024-06-04T15:52:45.513877+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T19:51:30.893394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":52,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"254'127","reported_seq":829,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:23.264264+0000","last_change":"2024-06-04T15:52:38.488922+0000","last_active":"2024-06-04T16:18:23.264264+0000","last_peered":"2024-06-04T16:18:23.264264+0000","last_clean":"2024-06-04T16:18:23.264264+0000","last_became_active":"2024-06-04T15:52:38.488622+0000","last_became_peered":"2024-06-04T15:52:38.488622+0000","last_unstale":"2024-06-04T16:18:23.264264+0000","last_undegraded":"2024-06-04T16:18:23.264264+0000","last_fullsized":"2024-06-04T16:18:23.264264+0000","mapping_epoch":23,"log_start":"251'100","ondisk_log_start":"251'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":100,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T19:55:57.502005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":585,"num_read_kb":532,"num_write":156,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"254'50","reported_seq":561,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:21:40.035480+0000","last_change":"2024-06-04T15:52:36.483764+0000","last_active":"2024-06-04T16:21:40.035480+0000","last_peered":"2024-06-04T16:21:40.035480+0000","last_clean":"2024-06-04T16:21:40.035480+0000","last_became_active":"2024-06-04T15:52:36.482733+0000","last_became_peered":"2024-06-04T15:52:36.482733+0000","last_unstale":"2024-06-04T16:21:40.035480+0000","last_undegraded":"2024-06-04T16:21:40.035480+0000","last_fullsized":"2024-06-04T16:21:40.035480+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T18:40:07.443876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133705,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":82,"num_read_kb":13463,"num_write":227,"num_write_kb":36279,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1],"acting":[5,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.11","version":"33'4","reported_seq":779,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:38.924270+0000","last_change":"2024-06-04T15:52:40.479576+0000","last_active":"2024-06-04T16:22:38.924270+0000","last_peered":"2024-06-04T16:22:38.924270+0000","last_clean":"2024-06-04T16:22:38.924270+0000","last_became_active":"2024-06-04T15:52:40.479002+0000","last_became_peered":"2024-06-04T15:52:40.479002+0000","last_unstale":"2024-06-04T16:22:38.924270+0000","last_undegraded":"2024-06-04T16:22:38.924270+0000","last_fullsized":"2024-06-04T16:22:38.924270+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_clean_scrub_stamp":"2024-06-04T15:52:39.463103+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T19:07:30.419008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":463,"num_read_kb":757,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"254'86","reported_seq":628,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:39.465636+0000","last_change":"2024-06-04T15:52:42.506197+0000","last_active":"2024-06-04T16:22:39.465636+0000","last_peered":"2024-06-04T16:22:39.465636+0000","last_clean":"2024-06-04T16:22:39.465636+0000","last_became_active":"2024-06-04T15:52:42.505955+0000","last_became_peered":"2024-06-04T15:52:42.505955+0000","last_unstale":"2024-06-04T16:22:39.465636+0000","last_undegraded":"2024-06-04T16:22:39.465636+0000","last_fullsized":"2024-06-04T16:22:39.465636+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_clean_scrub_stamp":"2024-06-04T15:52:41.476734+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":128,"num_read_kb":150,"num_write":58,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":466,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:25.119122+0000","last_change":"2024-06-04T15:52:44.520920+0000","last_active":"2024-06-04T16:18:25.119122+0000","last_peered":"2024-06-04T16:18:25.119122+0000","last_clean":"2024-06-04T16:18:25.119122+0000","last_became_active":"2024-06-04T15:52:44.519975+0000","last_became_peered":"2024-06-04T15:52:44.519975+0000","last_unstale":"2024-06-04T16:18:25.119122+0000","last_undegraded":"2024-06-04T16:18:25.119122+0000","last_fullsized":"2024-06-04T16:18:25.119122+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_clean_scrub_stamp":"2024-06-04T15:52:43.492872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T18:00:51.312734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1f","version":"254'93","reported_seq":773,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:45.015161+0000","last_change":"2024-06-04T15:52:38.485442+0000","last_active":"2024-06-04T16:19:45.015161+0000","last_peered":"2024-06-04T16:19:45.015161+0000","last_clean":"2024-06-04T16:19:45.015161+0000","last_became_active":"2024-06-04T15:52:38.485163+0000","last_became_peered":"2024-06-04T15:52:38.485163+0000","last_unstale":"2024-06-04T16:19:45.015161+0000","last_undegraded":"2024-06-04T16:19:45.015161+0000","last_fullsized":"2024-06-04T16:19:45.015161+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T23:56:24.126758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":477,"num_read_kb":443,"num_write":114,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"254'35","reported_seq":537,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:21:40.035318+0000","last_change":"2024-06-04T15:52:36.490918+0000","last_active":"2024-06-04T16:21:40.035318+0000","last_peered":"2024-06-04T16:21:40.035318+0000","last_clean":"2024-06-04T16:21:40.035318+0000","last_became_active":"2024-06-04T15:52:36.490297+0000","last_became_peered":"2024-06-04T15:52:36.490297+0000","last_unstale":"2024-06-04T16:21:40.035318+0000","last_undegraded":"2024-06-04T16:21:40.035318+0000","last_fullsized":"2024-06-04T16:21:40.035318+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T23:35:40.012317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1069164,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":53,"num_read_kb":1061,"num_write":121,"num_write_kb":15390,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,3],"acting":[5,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":473,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:20:45.026939+0000","last_change":"2024-06-04T15:52:40.483258+0000","last_active":"2024-06-04T16:20:45.026939+0000","last_peered":"2024-06-04T16:20:45.026939+0000","last_clean":"2024-06-04T16:20:45.026939+0000","last_became_active":"2024-06-04T15:52:40.482962+0000","last_became_peered":"2024-06-04T15:52:40.482962+0000","last_unstale":"2024-06-04T16:20:45.026939+0000","last_undegraded":"2024-06-04T16:20:45.026939+0000","last_fullsized":"2024-06-04T16:20:45.026939+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_clean_scrub_stamp":"2024-06-04T15:52:39.463103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T17:22:55.939902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"254'150","reported_seq":745,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:39.561237+0000","last_change":"2024-06-04T15:52:42.504117+0000","last_active":"2024-06-04T16:22:39.561237+0000","last_peered":"2024-06-04T16:22:39.561237+0000","last_clean":"2024-06-04T16:22:39.561237+0000","last_became_active":"2024-06-04T15:52:42.503246+0000","last_became_peered":"2024-06-04T15:52:42.503246+0000","last_unstale":"2024-06-04T16:22:39.561237+0000","last_undegraded":"2024-06-04T16:22:39.561237+0000","last_fullsized":"2024-06-04T16:22:39.561237+0000","mapping_epoch":27,"log_start":"251'100","ondisk_log_start":"251'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_clean_scrub_stamp":"2024-06-04T15:52:41.476734+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":100,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T17:52:54.231259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8493,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":230,"num_read_kb":283,"num_write":98,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":465,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:44.606507+0000","last_change":"2024-06-04T15:52:44.518052+0000","last_active":"2024-06-04T16:22:44.606507+0000","last_peered":"2024-06-04T16:22:44.606507+0000","last_clean":"2024-06-04T16:22:44.606507+0000","last_became_active":"2024-06-04T15:52:44.517715+0000","last_became_peered":"2024-06-04T15:52:44.517715+0000","last_unstale":"2024-06-04T16:22:44.606507+0000","last_undegraded":"2024-06-04T16:22:44.606507+0000","last_fullsized":"2024-06-04T16:22:44.606507+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_clean_scrub_stamp":"2024-06-04T15:52:43.492872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"254'71","reported_seq":549,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:30.008312+0000","last_change":"2024-06-04T15:52:46.538655+0000","last_active":"2024-06-04T16:18:30.008312+0000","last_peered":"2024-06-04T16:18:30.008312+0000","last_clean":"2024-06-04T16:18:30.008312+0000","last_became_active":"2024-06-04T15:52:46.538338+0000","last_became_peered":"2024-06-04T15:52:46.538338+0000","last_unstale":"2024-06-04T16:18:30.008312+0000","last_undegraded":"2024-06-04T16:18:30.008312+0000","last_fullsized":"2024-06-04T16:18:30.008312+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:45.513877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:45.513877+0000","last_clean_scrub_stamp":"2024-06-04T15:52:45.513877+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T01:20:53.919158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1061,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":107,"num_read_kb":120,"num_write":148,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1e","version":"254'145","reported_seq":914,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:45.009948+0000","last_change":"2024-06-04T15:52:38.484537+0000","last_active":"2024-06-04T16:18:45.009948+0000","last_peered":"2024-06-04T16:18:45.009948+0000","last_clean":"2024-06-04T16:18:45.009948+0000","last_became_active":"2024-06-04T15:52:38.484087+0000","last_became_peered":"2024-06-04T15:52:38.484087+0000","last_unstale":"2024-06-04T16:18:45.009948+0000","last_undegraded":"2024-06-04T16:18:45.009948+0000","last_fullsized":"2024-06-04T16:18:45.009948+0000","mapping_epoch":23,"log_start":"251'100","ondisk_log_start":"251'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":100,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T00:25:14.013091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":710,"num_read_kb":650,"num_write":181,"num_write_kb":49,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"251'48","reported_seq":551,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:20.014446+0000","last_change":"2024-06-04T15:52:36.479337+0000","last_active":"2024-06-04T16:19:20.014446+0000","last_peered":"2024-06-04T16:19:20.014446+0000","last_clean":"2024-06-04T16:19:20.014446+0000","last_became_active":"2024-06-04T15:52:36.477626+0000","last_became_peered":"2024-06-04T15:52:36.477626+0000","last_unstale":"2024-06-04T16:19:20.014446+0000","last_undegraded":"2024-06-04T16:19:20.014446+0000","last_fullsized":"2024-06-04T16:19:20.014446+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T17:38:59.206841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20628,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":58,"num_read_kb":9358,"num_write":184,"num_write_kb":22886,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,1],"acting":[4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":475,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:21:50.024968+0000","last_change":"2024-06-04T15:52:40.484749+0000","last_active":"2024-06-04T16:21:50.024968+0000","last_peered":"2024-06-04T16:21:50.024968+0000","last_clean":"2024-06-04T16:21:50.024968+0000","last_became_active":"2024-06-04T15:52:40.484444+0000","last_became_peered":"2024-06-04T15:52:40.484444+0000","last_unstale":"2024-06-04T16:21:50.024968+0000","last_undegraded":"2024-06-04T16:21:50.024968+0000","last_fullsized":"2024-06-04T16:21:50.024968+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_clean_scrub_stamp":"2024-06-04T15:52:39.463103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"254'105","reported_seq":652,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:39.468620+0000","last_change":"2024-06-04T15:52:42.498603+0000","last_active":"2024-06-04T16:22:39.468620+0000","last_peered":"2024-06-04T16:22:39.468620+0000","last_clean":"2024-06-04T16:22:39.468620+0000","last_became_active":"2024-06-04T15:52:42.498329+0000","last_became_peered":"2024-06-04T15:52:42.498329+0000","last_unstale":"2024-06-04T16:22:39.468620+0000","last_undegraded":"2024-06-04T16:22:39.468620+0000","last_fullsized":"2024-06-04T16:22:39.468620+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_clean_scrub_stamp":"2024-06-04T15:52:41.476734+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T22:43:07.581595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":167,"num_read_kb":207,"num_write":102,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":468,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:20:15.022873+0000","last_change":"2024-06-04T15:52:44.523780+0000","last_active":"2024-06-04T16:20:15.022873+0000","last_peered":"2024-06-04T16:20:15.022873+0000","last_clean":"2024-06-04T16:20:15.022873+0000","last_became_active":"2024-06-04T15:52:44.523527+0000","last_became_peered":"2024-06-04T15:52:44.523527+0000","last_unstale":"2024-06-04T16:20:15.022873+0000","last_undegraded":"2024-06-04T16:20:15.022873+0000","last_fullsized":"2024-06-04T16:20:15.022873+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_clean_scrub_stamp":"2024-06-04T15:52:43.492872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T03:49:44.080770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.12","version":"254'29","reported_seq":505,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:30.006566+0000","last_change":"2024-06-04T15:52:46.538179+0000","last_active":"2024-06-04T16:18:30.006566+0000","last_peered":"2024-06-04T16:18:30.006566+0000","last_clean":"2024-06-04T16:18:30.006566+0000","last_became_active":"2024-06-04T15:52:46.537899+0000","last_became_peered":"2024-06-04T15:52:46.537899+0000","last_unstale":"2024-06-04T16:18:30.006566+0000","last_undegraded":"2024-06-04T16:18:30.006566+0000","last_fullsized":"2024-06-04T16:18:30.006566+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:45.513877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:45.513877+0000","last_clean_scrub_stamp":"2024-06-04T15:52:45.513877+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T03:08:17.268541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1228,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":67,"num_read_kb":65,"num_write":80,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"254'108","reported_seq":883,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:20:10.134391+0000","last_change":"2024-06-04T15:52:38.481130+0000","last_active":"2024-06-04T16:20:10.134391+0000","last_peered":"2024-06-04T16:20:10.134391+0000","last_clean":"2024-06-04T16:20:10.134391+0000","last_became_active":"2024-06-04T15:52:38.480458+0000","last_became_peered":"2024-06-04T15:52:38.480458+0000","last_unstale":"2024-06-04T16:20:10.134391+0000","last_undegraded":"2024-06-04T16:20:10.134391+0000","last_fullsized":"2024-06-04T16:20:10.134391+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T00:04:51.320929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":731,"num_read_kb":703,"num_write":125,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1a","version":"254'73","reported_seq":587,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:39.920665+0000","last_change":"2024-06-04T15:52:36.478450+0000","last_active":"2024-06-04T16:22:39.920665+0000","last_peered":"2024-06-04T16:22:39.920665+0000","last_clean":"2024-06-04T16:22:39.920665+0000","last_became_active":"2024-06-04T15:52:36.477885+0000","last_became_peered":"2024-06-04T15:52:36.477885+0000","last_unstale":"2024-06-04T16:22:39.920665+0000","last_undegraded":"2024-06-04T16:22:39.920665+0000","last_fullsized":"2024-06-04T16:22:39.920665+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1395842,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":88,"num_read_kb":3881,"num_write":289,"num_write_kb":29330,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":473,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:40.030252+0000","last_change":"2024-06-04T15:52:40.478223+0000","last_active":"2024-06-04T16:22:40.030252+0000","last_peered":"2024-06-04T16:22:40.030252+0000","last_clean":"2024-06-04T16:22:40.030252+0000","last_became_active":"2024-06-04T15:52:40.477924+0000","last_became_peered":"2024-06-04T15:52:40.477924+0000","last_unstale":"2024-06-04T16:22:40.030252+0000","last_undegraded":"2024-06-04T16:22:40.030252+0000","last_fullsized":"2024-06-04T16:22:40.030252+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_clean_scrub_stamp":"2024-06-04T15:52:39.463103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"254'93","reported_seq":634,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:39.549089+0000","last_change":"2024-06-04T15:52:42.503942+0000","last_active":"2024-06-04T16:22:39.549089+0000","last_peered":"2024-06-04T16:22:39.549089+0000","last_clean":"2024-06-04T16:22:39.549089+0000","last_became_active":"2024-06-04T15:52:42.503579+0000","last_became_peered":"2024-06-04T15:52:42.503579+0000","last_unstale":"2024-06-04T16:22:39.549089+0000","last_undegraded":"2024-06-04T16:22:39.549089+0000","last_fullsized":"2024-06-04T16:22:39.549089+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_clean_scrub_stamp":"2024-06-04T15:52:41.476734+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T18:07:30.315906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5924,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":139,"num_read_kb":180,"num_write":64,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":469,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:20:45.139423+0000","last_change":"2024-06-04T15:52:44.520226+0000","last_active":"2024-06-04T16:20:45.139423+0000","last_peered":"2024-06-04T16:20:45.139423+0000","last_clean":"2024-06-04T16:20:45.139423+0000","last_became_active":"2024-06-04T15:52:44.519570+0000","last_became_peered":"2024-06-04T15:52:44.519570+0000","last_unstale":"2024-06-04T16:20:45.139423+0000","last_undegraded":"2024-06-04T16:20:45.139423+0000","last_fullsized":"2024-06-04T16:20:45.139423+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_clean_scrub_stamp":"2024-06-04T15:52:43.492872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T00:47:00.033153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.11","version":"254'24","reported_seq":487,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:32.397487+0000","last_change":"2024-06-04T15:52:46.543080+0000","last_active":"2024-06-04T16:22:32.397487+0000","last_peered":"2024-06-04T16:22:32.397487+0000","last_clean":"2024-06-04T16:22:32.397487+0000","last_became_active":"2024-06-04T15:52:46.542820+0000","last_became_peered":"2024-06-04T15:52:46.542820+0000","last_unstale":"2024-06-04T16:22:32.397487+0000","last_undegraded":"2024-06-04T16:22:32.397487+0000","last_fullsized":"2024-06-04T16:22:32.397487+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:45.513877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:45.513877+0000","last_clean_scrub_stamp":"2024-06-04T15:52:45.513877+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T19:52:44.228120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":616,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":20,"num_read_kb":19,"num_write":60,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"254'121","reported_seq":815,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:20:10.021744+0000","last_change":"2024-06-04T15:52:38.478104+0000","last_active":"2024-06-04T16:20:10.021744+0000","last_peered":"2024-06-04T16:20:10.021744+0000","last_clean":"2024-06-04T16:20:10.021744+0000","last_became_active":"2024-06-04T15:52:38.477059+0000","last_became_peered":"2024-06-04T15:52:38.477059+0000","last_unstale":"2024-06-04T16:20:10.021744+0000","last_undegraded":"2024-06-04T16:20:10.021744+0000","last_fullsized":"2024-06-04T16:20:10.021744+0000","mapping_epoch":23,"log_start":"251'100","ondisk_log_start":"251'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":100,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T03:05:57.769457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":614,"num_read_kb":552,"num_write":164,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"254'63","reported_seq":571,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:39.450047+0000","last_change":"2024-06-04T15:52:36.498271+0000","last_active":"2024-06-04T16:22:39.450047+0000","last_peered":"2024-06-04T16:22:39.450047+0000","last_clean":"2024-06-04T16:22:39.450047+0000","last_became_active":"2024-06-04T15:52:36.497812+0000","last_became_peered":"2024-06-04T15:52:36.497812+0000","last_unstale":"2024-06-04T16:22:39.450047+0000","last_undegraded":"2024-06-04T16:22:39.450047+0000","last_fullsized":"2024-06-04T16:22:39.450047+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T17:50:50.956572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2267334,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":82,"num_read_kb":14576,"num_write":293,"num_write_kb":31387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3],"acting":[4,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":474,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:20:10.021773+0000","last_change":"2024-06-04T15:52:40.482009+0000","last_active":"2024-06-04T16:20:10.021773+0000","last_peered":"2024-06-04T16:20:10.021773+0000","last_clean":"2024-06-04T16:20:10.021773+0000","last_became_active":"2024-06-04T15:52:40.481621+0000","last_became_peered":"2024-06-04T15:52:40.481621+0000","last_unstale":"2024-06-04T16:20:10.021773+0000","last_undegraded":"2024-06-04T16:20:10.021773+0000","last_fullsized":"2024-06-04T16:20:10.021773+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_clean_scrub_stamp":"2024-06-04T15:52:39.463103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T19:33:44.607654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1e","version":"251'44","reported_seq":530,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:50.009057+0000","last_change":"2024-06-04T15:52:42.499792+0000","last_active":"2024-06-04T16:18:50.009057+0000","last_peered":"2024-06-04T16:18:50.009057+0000","last_clean":"2024-06-04T16:18:50.009057+0000","last_became_active":"2024-06-04T15:52:42.499488+0000","last_became_peered":"2024-06-04T15:52:42.499488+0000","last_unstale":"2024-06-04T16:18:50.009057+0000","last_undegraded":"2024-06-04T16:18:50.009057+0000","last_fullsized":"2024-06-04T16:18:50.009057+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_clean_scrub_stamp":"2024-06-04T15:52:41.476734+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T19:43:32.543414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":67,"num_read_kb":62,"num_write":74,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"254'461","reported_seq":1481,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:39.573673+0000","last_change":"2024-06-04T15:52:44.516769+0000","last_active":"2024-06-04T16:22:39.573673+0000","last_peered":"2024-06-04T16:22:39.573673+0000","last_clean":"2024-06-04T16:22:39.573673+0000","last_became_active":"2024-06-04T15:52:44.516460+0000","last_became_peered":"2024-06-04T15:52:44.516460+0000","last_unstale":"2024-06-04T16:22:39.573673+0000","last_undegraded":"2024-06-04T16:22:39.573673+0000","last_fullsized":"2024-06-04T16:22:39.573673+0000","mapping_epoch":29,"log_start":"251'400","ondisk_log_start":"251'400","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_clean_scrub_stamp":"2024-06-04T15:52:43.492872+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":400,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.10","version":"253'20","reported_seq":490,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:30.006488+0000","last_change":"2024-06-04T15:52:46.538482+0000","last_active":"2024-06-04T16:18:30.006488+0000","last_peered":"2024-06-04T16:18:30.006488+0000","last_clean":"2024-06-04T16:18:30.006488+0000","last_became_active":"2024-06-04T15:52:46.538179+0000","last_became_peered":"2024-06-04T15:52:46.538179+0000","last_unstale":"2024-06-04T16:18:30.006488+0000","last_undegraded":"2024-06-04T16:18:30.006488+0000","last_fullsized":"2024-06-04T16:18:30.006488+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:45.513877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:45.513877+0000","last_clean_scrub_stamp":"2024-06-04T15:52:45.513877+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T16:31:53.780883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":34,"num_read_kb":33,"num_write":53,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"254'122","reported_seq":867,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:40.030229+0000","last_change":"2024-06-04T15:52:38.486563+0000","last_active":"2024-06-04T16:22:40.030229+0000","last_peered":"2024-06-04T16:22:40.030229+0000","last_clean":"2024-06-04T16:22:40.030229+0000","last_became_active":"2024-06-04T15:52:38.485379+0000","last_became_peered":"2024-06-04T15:52:38.485379+0000","last_unstale":"2024-06-04T16:22:40.030229+0000","last_undegraded":"2024-06-04T16:22:40.030229+0000","last_fullsized":"2024-06-04T16:22:40.030229+0000","mapping_epoch":23,"log_start":"254'100","ondisk_log_start":"254'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":100,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":679,"num_read_kb":622,"num_write":158,"num_write_kb":49,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"251'30","reported_seq":522,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:39.920697+0000","last_change":"2024-06-04T15:52:36.486793+0000","last_active":"2024-06-04T16:22:39.920697+0000","last_peered":"2024-06-04T16:22:39.920697+0000","last_clean":"2024-06-04T16:22:39.920697+0000","last_became_active":"2024-06-04T15:52:36.486465+0000","last_became_peered":"2024-06-04T15:52:36.486465+0000","last_unstale":"2024-06-04T16:22:39.920697+0000","last_undegraded":"2024-06-04T16:22:39.920697+0000","last_fullsized":"2024-06-04T16:22:39.920697+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":30,"num_read_kb":1715,"num_write":122,"num_write_kb":16993,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,5],"acting":[1,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":477,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:39.920681+0000","last_change":"2024-06-04T15:52:40.481127+0000","last_active":"2024-06-04T16:22:39.920681+0000","last_peered":"2024-06-04T16:22:39.920681+0000","last_clean":"2024-06-04T16:22:39.920681+0000","last_became_active":"2024-06-04T15:52:40.480832+0000","last_became_peered":"2024-06-04T15:52:40.480832+0000","last_unstale":"2024-06-04T16:22:39.920681+0000","last_undegraded":"2024-06-04T16:22:39.920681+0000","last_fullsized":"2024-06-04T16:22:39.920681+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_clean_scrub_stamp":"2024-06-04T15:52:39.463103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"254'111","reported_seq":662,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:39.420717+0000","last_change":"2024-06-04T15:52:42.502990+0000","last_active":"2024-06-04T16:22:39.420717+0000","last_peered":"2024-06-04T16:22:39.420717+0000","last_clean":"2024-06-04T16:22:39.420717+0000","last_became_active":"2024-06-04T15:52:42.502601+0000","last_became_peered":"2024-06-04T15:52:42.502601+0000","last_unstale":"2024-06-04T16:22:39.420717+0000","last_undegraded":"2024-06-04T16:22:39.420717+0000","last_fullsized":"2024-06-04T16:22:39.420717+0000","mapping_epoch":27,"log_start":"251'100","ondisk_log_start":"251'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_clean_scrub_stamp":"2024-06-04T15:52:41.476734+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":100,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34754,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":168,"num_read_kb":281,"num_write":86,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":466,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:20.014431+0000","last_change":"2024-06-04T15:52:44.523309+0000","last_active":"2024-06-04T16:19:20.014431+0000","last_peered":"2024-06-04T16:19:20.014431+0000","last_clean":"2024-06-04T16:19:20.014431+0000","last_became_active":"2024-06-04T15:52:44.522992+0000","last_became_peered":"2024-06-04T15:52:44.522992+0000","last_unstale":"2024-06-04T16:19:20.014431+0000","last_undegraded":"2024-06-04T16:19:20.014431+0000","last_fullsized":"2024-06-04T16:19:20.014431+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_clean_scrub_stamp":"2024-06-04T15:52:43.492872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T02:51:54.078930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"251'15","reported_seq":488,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:21:50.133773+0000","last_change":"2024-06-04T15:52:46.540313+0000","last_active":"2024-06-04T16:21:50.133773+0000","last_peered":"2024-06-04T16:21:50.133773+0000","last_clean":"2024-06-04T16:21:50.133773+0000","last_became_active":"2024-06-04T15:52:46.539985+0000","last_became_peered":"2024-06-04T15:52:46.539985+0000","last_unstale":"2024-06-04T16:21:50.133773+0000","last_undegraded":"2024-06-04T16:21:50.133773+0000","last_fullsized":"2024-06-04T16:21:50.133773+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:45.513877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:45.513877+0000","last_clean_scrub_stamp":"2024-06-04T15:52:45.513877+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":31,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"254'419","reported_seq":1237,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:40.030206+0000","last_change":"2024-06-04T15:52:38.475289+0000","last_active":"2024-06-04T16:22:40.030206+0000","last_peered":"2024-06-04T16:22:40.030206+0000","last_clean":"2024-06-04T16:22:40.030206+0000","last_became_active":"2024-06-04T15:52:38.474960+0000","last_became_peered":"2024-06-04T15:52:38.474960+0000","last_unstale":"2024-06-04T16:22:40.030206+0000","last_undegraded":"2024-06-04T16:22:40.030206+0000","last_fullsized":"2024-06-04T16:22:40.030206+0000","mapping_epoch":23,"log_start":"251'400","ondisk_log_start":"251'400","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":400,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2017,"num_read_kb":1794,"num_write":716,"num_write_kb":341,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"254'99","reported_seq":727,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:39.496174+0000","last_change":"2024-06-04T15:52:36.499152+0000","last_active":"2024-06-04T16:22:39.496174+0000","last_peered":"2024-06-04T16:22:39.496174+0000","last_clean":"2024-06-04T16:22:39.496174+0000","last_became_active":"2024-06-04T15:52:36.498806+0000","last_became_peered":"2024-06-04T15:52:36.498806+0000","last_unstale":"2024-06-04T16:22:39.496174+0000","last_undegraded":"2024-06-04T16:22:39.496174+0000","last_fullsized":"2024-06-04T16:22:39.496174+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T16:05:54.071633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":490,"num_read_kb":127523,"num_write":607,"num_write_kb":22490,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":473,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:40.030239+0000","last_change":"2024-06-04T15:52:40.478700+0000","last_active":"2024-06-04T16:22:40.030239+0000","last_peered":"2024-06-04T16:22:40.030239+0000","last_clean":"2024-06-04T16:22:40.030239+0000","last_became_active":"2024-06-04T15:52:40.478417+0000","last_became_peered":"2024-06-04T15:52:40.478417+0000","last_unstale":"2024-06-04T16:22:40.030239+0000","last_undegraded":"2024-06-04T16:22:40.030239+0000","last_fullsized":"2024-06-04T16:22:40.030239+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_clean_scrub_stamp":"2024-06-04T15:52:39.463103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"254'88","reported_seq":627,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:39.427775+0000","last_change":"2024-06-04T15:52:42.496557+0000","last_active":"2024-06-04T16:22:39.427775+0000","last_peered":"2024-06-04T16:22:39.427775+0000","last_clean":"2024-06-04T16:22:39.427775+0000","last_became_active":"2024-06-04T15:52:42.496263+0000","last_became_peered":"2024-06-04T15:52:42.496263+0000","last_unstale":"2024-06-04T16:22:39.427775+0000","last_undegraded":"2024-06-04T16:22:39.427775+0000","last_fullsized":"2024-06-04T16:22:39.427775+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_clean_scrub_stamp":"2024-06-04T15:52:41.476734+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T01:39:37.497606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7956,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":138,"num_read_kb":200,"num_write":66,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":465,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:25.012820+0000","last_change":"2024-06-04T15:52:44.520347+0000","last_active":"2024-06-04T16:19:25.012820+0000","last_peered":"2024-06-04T16:19:25.012820+0000","last_clean":"2024-06-04T16:19:25.012820+0000","last_became_active":"2024-06-04T15:52:44.520051+0000","last_became_peered":"2024-06-04T15:52:44.520051+0000","last_unstale":"2024-06-04T16:19:25.012820+0000","last_undegraded":"2024-06-04T16:19:25.012820+0000","last_fullsized":"2024-06-04T16:19:25.012820+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_clean_scrub_stamp":"2024-06-04T15:52:43.492872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T21:08:39.164476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"254'39","reported_seq":547,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:25.015736+0000","last_change":"2024-06-04T15:52:46.542209+0000","last_active":"2024-06-04T16:19:25.015736+0000","last_peered":"2024-06-04T16:19:25.015736+0000","last_clean":"2024-06-04T16:19:25.015736+0000","last_became_active":"2024-06-04T15:52:46.541897+0000","last_became_peered":"2024-06-04T15:52:46.541897+0000","last_unstale":"2024-06-04T16:19:25.015736+0000","last_undegraded":"2024-06-04T16:19:25.015736+0000","last_fullsized":"2024-06-04T16:19:25.015736+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:45.513877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:45.513877+0000","last_clean_scrub_stamp":"2024-06-04T15:52:45.513877+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T01:21:18.754972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":549,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":152,"num_read_kb":137,"num_write":99,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"254'122","reported_seq":849,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:15.126530+0000","last_change":"2024-06-04T15:52:38.482687+0000","last_active":"2024-06-04T16:19:15.126530+0000","last_peered":"2024-06-04T16:19:15.126530+0000","last_clean":"2024-06-04T16:19:15.126530+0000","last_became_active":"2024-06-04T15:52:38.482388+0000","last_became_peered":"2024-06-04T15:52:38.482388+0000","last_unstale":"2024-06-04T16:19:15.126530+0000","last_undegraded":"2024-06-04T16:19:15.126530+0000","last_fullsized":"2024-06-04T16:19:15.126530+0000","mapping_epoch":23,"log_start":"251'100","ondisk_log_start":"251'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":100,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T19:55:37.296059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":625,"num_read_kb":571,"num_write":157,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1e","version":"251'81","reported_seq":612,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:20:45.027427+0000","last_change":"2024-06-04T15:52:36.485805+0000","last_active":"2024-06-04T16:20:45.027427+0000","last_peered":"2024-06-04T16:20:45.027427+0000","last_clean":"2024-06-04T16:20:45.027427+0000","last_became_active":"2024-06-04T15:52:36.485401+0000","last_became_peered":"2024-06-04T15:52:36.485401+0000","last_unstale":"2024-06-04T16:20:45.027427+0000","last_undegraded":"2024-06-04T16:20:45.027427+0000","last_fullsized":"2024-06-04T16:20:45.027427+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T21:08:15.786697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133679,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":131,"num_read_kb":40112,"num_write":294,"num_write_kb":27266,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,3],"acting":[5,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":477,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:21:40.132679+0000","last_change":"2024-06-04T15:52:40.483568+0000","last_active":"2024-06-04T16:21:40.132679+0000","last_peered":"2024-06-04T16:21:40.132679+0000","last_clean":"2024-06-04T16:21:40.132679+0000","last_became_active":"2024-06-04T15:52:40.483272+0000","last_became_peered":"2024-06-04T15:52:40.483272+0000","last_unstale":"2024-06-04T16:21:40.132679+0000","last_undegraded":"2024-06-04T16:21:40.132679+0000","last_fullsized":"2024-06-04T16:21:40.132679+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_clean_scrub_stamp":"2024-06-04T15:52:39.463103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"254'82","reported_seq":611,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:39.542153+0000","last_change":"2024-06-04T15:52:42.497288+0000","last_active":"2024-06-04T16:22:39.542153+0000","last_peered":"2024-06-04T16:22:39.542153+0000","last_clean":"2024-06-04T16:22:39.542153+0000","last_became_active":"2024-06-04T15:52:42.496934+0000","last_became_peered":"2024-06-04T15:52:42.496934+0000","last_unstale":"2024-06-04T16:22:39.542153+0000","last_undegraded":"2024-06-04T16:22:39.542153+0000","last_fullsized":"2024-06-04T16:22:39.542153+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_clean_scrub_stamp":"2024-06-04T15:52:41.476734+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T17:14:55.894511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8160,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":120,"num_read_kb":184,"num_write":54,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":465,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:20:15.018438+0000","last_change":"2024-06-04T15:52:44.519077+0000","last_active":"2024-06-04T16:20:15.018438+0000","last_peered":"2024-06-04T16:20:15.018438+0000","last_clean":"2024-06-04T16:20:15.018438+0000","last_became_active":"2024-06-04T15:52:44.518782+0000","last_became_peered":"2024-06-04T15:52:44.518782+0000","last_unstale":"2024-06-04T16:20:15.018438+0000","last_undegraded":"2024-06-04T16:20:15.018438+0000","last_fullsized":"2024-06-04T16:20:15.018438+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_clean_scrub_stamp":"2024-06-04T15:52:43.492872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T16:06:38.344510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"254'41","reported_seq":528,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:25.012872+0000","last_change":"2024-06-04T15:52:46.532088+0000","last_active":"2024-06-04T16:19:25.012872+0000","last_peered":"2024-06-04T16:19:25.012872+0000","last_clean":"2024-06-04T16:19:25.012872+0000","last_became_active":"2024-06-04T15:52:46.531795+0000","last_became_peered":"2024-06-04T15:52:46.531795+0000","last_unstale":"2024-06-04T16:19:25.012872+0000","last_undegraded":"2024-06-04T16:19:25.012872+0000","last_fullsized":"2024-06-04T16:19:25.012872+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:45.513877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:45.513877+0000","last_clean_scrub_stamp":"2024-06-04T15:52:45.513877+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T00:05:55.568943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":429,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":136,"num_read_kb":110,"num_write":109,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"254'356","reported_seq":1092,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:21:40.023766+0000","last_change":"2024-06-04T15:52:38.478558+0000","last_active":"2024-06-04T16:21:40.023766+0000","last_peered":"2024-06-04T16:21:40.023766+0000","last_clean":"2024-06-04T16:21:40.023766+0000","last_became_active":"2024-06-04T15:52:38.478204+0000","last_became_peered":"2024-06-04T15:52:38.478204+0000","last_unstale":"2024-06-04T16:21:40.023766+0000","last_undegraded":"2024-06-04T16:21:40.023766+0000","last_fullsized":"2024-06-04T16:21:40.023766+0000","mapping_epoch":23,"log_start":"251'300","ondisk_log_start":"251'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":300,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1642,"num_read_kb":1482,"num_write":614,"num_write_kb":292,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"251'22","reported_seq":513,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:45.018530+0000","last_change":"2024-06-04T15:52:36.478256+0000","last_active":"2024-06-04T16:19:45.018530+0000","last_peered":"2024-06-04T16:19:45.018530+0000","last_clean":"2024-06-04T16:19:45.018530+0000","last_became_active":"2024-06-04T15:52:36.477895+0000","last_became_peered":"2024-06-04T15:52:36.477895+0000","last_unstale":"2024-06-04T16:19:45.018530+0000","last_undegraded":"2024-06-04T16:19:45.018530+0000","last_fullsized":"2024-06-04T16:19:45.018530+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T22:33:16.679149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":78,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":120,"num_write_kb":13440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.19","version":"26'1","reported_seq":475,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:20.014466+0000","last_change":"2024-06-04T15:52:40.483405+0000","last_active":"2024-06-04T16:19:20.014466+0000","last_peered":"2024-06-04T16:19:20.014466+0000","last_clean":"2024-06-04T16:19:20.014466+0000","last_became_active":"2024-06-04T15:52:40.483131+0000","last_became_peered":"2024-06-04T15:52:40.483131+0000","last_unstale":"2024-06-04T16:19:20.014466+0000","last_undegraded":"2024-06-04T16:19:20.014466+0000","last_fullsized":"2024-06-04T16:19:20.014466+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_clean_scrub_stamp":"2024-06-04T15:52:39.463103+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T20:46:09.924823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1a","version":"254'120","reported_seq":673,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:39.557732+0000","last_change":"2024-06-04T15:52:42.503809+0000","last_active":"2024-06-04T16:22:39.557732+0000","last_peered":"2024-06-04T16:22:39.557732+0000","last_clean":"2024-06-04T16:22:39.557732+0000","last_became_active":"2024-06-04T15:52:42.503538+0000","last_became_peered":"2024-06-04T15:52:42.503538+0000","last_unstale":"2024-06-04T16:22:39.557732+0000","last_undegraded":"2024-06-04T16:22:39.557732+0000","last_fullsized":"2024-06-04T16:22:39.557732+0000","mapping_epoch":27,"log_start":"251'100","ondisk_log_start":"251'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_clean_scrub_stamp":"2024-06-04T15:52:41.476734+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":100,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T23:22:34.954352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6196,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":182,"num_read_kb":236,"num_write":96,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":466,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:20:15.022487+0000","last_change":"2024-06-04T15:52:44.520133+0000","last_active":"2024-06-04T16:20:15.022487+0000","last_peered":"2024-06-04T16:20:15.022487+0000","last_clean":"2024-06-04T16:20:15.022487+0000","last_became_active":"2024-06-04T15:52:44.519867+0000","last_became_peered":"2024-06-04T15:52:44.519867+0000","last_unstale":"2024-06-04T16:20:15.022487+0000","last_undegraded":"2024-06-04T16:20:15.022487+0000","last_fullsized":"2024-06-04T16:20:15.022487+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_clean_scrub_stamp":"2024-06-04T15:52:43.492872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T23:38:01.226210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.14","version":"254'30","reported_seq":530,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:20:55.017109+0000","last_change":"2024-06-04T15:52:46.538083+0000","last_active":"2024-06-04T16:20:55.017109+0000","last_peered":"2024-06-04T16:20:55.017109+0000","last_clean":"2024-06-04T16:20:55.017109+0000","last_became_active":"2024-06-04T15:52:46.537792+0000","last_became_peered":"2024-06-04T15:52:46.537792+0000","last_unstale":"2024-06-04T16:20:55.017109+0000","last_undegraded":"2024-06-04T16:20:55.017109+0000","last_fullsized":"2024-06-04T16:20:55.017109+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:45.513877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:45.513877+0000","last_clean_scrub_stamp":"2024-06-04T15:52:45.513877+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":433,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":163,"num_read_kb":128,"num_write":83,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"254'156","reported_seq":946,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:40.009213+0000","last_change":"2024-06-04T15:52:38.486670+0000","last_active":"2024-06-04T16:18:40.009213+0000","last_peered":"2024-06-04T16:18:40.009213+0000","last_clean":"2024-06-04T16:18:40.009213+0000","last_became_active":"2024-06-04T15:52:38.486335+0000","last_became_peered":"2024-06-04T15:52:38.486335+0000","last_unstale":"2024-06-04T16:18:40.009213+0000","last_undegraded":"2024-06-04T16:18:40.009213+0000","last_fullsized":"2024-06-04T16:18:40.009213+0000","mapping_epoch":23,"log_start":"251'100","ondisk_log_start":"251'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":100,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T02:25:00.264822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":839,"num_read_kb":763,"num_write":210,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.20","version":"254'54","reported_seq":569,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:39.456727+0000","last_change":"2024-06-04T15:53:14.002874+0000","last_active":"2024-06-04T16:22:39.456727+0000","last_peered":"2024-06-04T16:22:39.456727+0000","last_clean":"2024-06-04T16:22:39.456727+0000","last_became_active":"2024-06-04T15:53:14.002428+0000","last_became_peered":"2024-06-04T15:53:14.002428+0000","last_unstale":"2024-06-04T16:22:39.456727+0000","last_undegraded":"2024-06-04T16:22:39.456727+0000","last_fullsized":"2024-06-04T16:22:39.456727+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":15429,"num_write":206,"num_write_kb":34585,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5],"acting":[2,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"254'241","reported_seq":911,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:40.121513+0000","last_change":"2024-06-04T15:52:38.481773+0000","last_active":"2024-06-04T16:18:40.121513+0000","last_peered":"2024-06-04T16:18:40.121513+0000","last_clean":"2024-06-04T16:18:40.121513+0000","last_became_active":"2024-06-04T15:52:38.481490+0000","last_became_peered":"2024-06-04T15:52:38.481490+0000","last_unstale":"2024-06-04T16:18:40.121513+0000","last_undegraded":"2024-06-04T16:18:40.121513+0000","last_fullsized":"2024-06-04T16:18:40.121513+0000","mapping_epoch":23,"log_start":"251'200","ondisk_log_start":"251'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":200,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T21:24:52.955365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1011,"num_read_kb":836,"num_write":379,"num_write_kb":158,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.21","version":"254'54","reported_seq":555,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:21:50.149207+0000","last_change":"2024-06-04T15:52:36.495330+0000","last_active":"2024-06-04T16:21:50.149207+0000","last_peered":"2024-06-04T16:21:50.149207+0000","last_clean":"2024-06-04T16:21:50.149207+0000","last_became_active":"2024-06-04T15:52:36.495008+0000","last_became_peered":"2024-06-04T15:52:36.495008+0000","last_unstale":"2024-06-04T16:21:50.149207+0000","last_undegraded":"2024-06-04T16:21:50.149207+0000","last_fullsized":"2024-06-04T16:21:50.149207+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T01:04:03.095444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":63,"num_read_kb":12338,"num_write":219,"num_write_kb":31559,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.25","version":"254'138","reported_seq":973,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:40.007807+0000","last_change":"2024-06-04T15:52:38.482192+0000","last_active":"2024-06-04T16:18:40.007807+0000","last_peered":"2024-06-04T16:18:40.007807+0000","last_clean":"2024-06-04T16:18:40.007807+0000","last_became_active":"2024-06-04T15:52:38.481916+0000","last_became_peered":"2024-06-04T15:52:38.481916+0000","last_unstale":"2024-06-04T16:18:40.007807+0000","last_undegraded":"2024-06-04T16:18:40.007807+0000","last_fullsized":"2024-06-04T16:18:40.007807+0000","mapping_epoch":23,"log_start":"251'100","ondisk_log_start":"251'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T16:53:51.388099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":911,"num_read_kb":859,"num_write":180,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"254'58","reported_seq":585,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:21:50.029038+0000","last_change":"2024-06-04T15:52:36.482905+0000","last_active":"2024-06-04T16:21:50.029038+0000","last_peered":"2024-06-04T16:21:50.029038+0000","last_clean":"2024-06-04T16:21:50.029038+0000","last_became_active":"2024-06-04T15:52:36.482589+0000","last_became_peered":"2024-06-04T15:52:36.482589+0000","last_unstale":"2024-06-04T16:21:50.029038+0000","last_undegraded":"2024-06-04T16:21:50.029038+0000","last_fullsized":"2024-06-04T16:21:50.029038+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T01:08:39.575276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":134,"num_read_kb":8380,"num_write":298,"num_write_kb":18008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7],"acting":[3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"254'104","reported_seq":811,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:40.009685+0000","last_change":"2024-06-04T15:52:38.486331+0000","last_active":"2024-06-04T16:18:40.009685+0000","last_peered":"2024-06-04T16:18:40.009685+0000","last_clean":"2024-06-04T16:18:40.009685+0000","last_became_active":"2024-06-04T15:52:38.486018+0000","last_became_peered":"2024-06-04T15:52:38.486018+0000","last_unstale":"2024-06-04T16:18:40.009685+0000","last_undegraded":"2024-06-04T16:18:40.009685+0000","last_fullsized":"2024-06-04T16:18:40.009685+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T01:56:20.478655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":549,"num_read_kb":515,"num_write":118,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"251'48","reported_seq":559,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:50.019151+0000","last_change":"2024-06-04T15:52:36.496569+0000","last_active":"2024-06-04T16:19:50.019151+0000","last_peered":"2024-06-04T16:19:50.019151+0000","last_clean":"2024-06-04T16:19:50.019151+0000","last_became_active":"2024-06-04T15:52:36.496125+0000","last_became_peered":"2024-06-04T15:52:36.496125+0000","last_unstale":"2024-06-04T16:19:50.019151+0000","last_undegraded":"2024-06-04T16:19:50.019151+0000","last_fullsized":"2024-06-04T16:19:50.019151+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T19:29:40.820287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":98,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":59,"num_read_kb":26302,"num_write":204,"num_write_kb":24798,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,0],"acting":[5,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.23","version":"254'93","reported_seq":807,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:50.019175+0000","last_change":"2024-06-04T15:52:38.485339+0000","last_active":"2024-06-04T16:19:50.019175+0000","last_peered":"2024-06-04T16:19:50.019175+0000","last_clean":"2024-06-04T16:19:50.019175+0000","last_became_active":"2024-06-04T15:52:38.484927+0000","last_became_peered":"2024-06-04T15:52:38.484927+0000","last_unstale":"2024-06-04T16:19:50.019175+0000","last_undegraded":"2024-06-04T16:19:50.019175+0000","last_fullsized":"2024-06-04T16:19:50.019175+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T21:19:16.498288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":509,"num_read_kb":485,"num_write":106,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"254'52","reported_seq":554,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:40.008829+0000","last_change":"2024-06-04T15:53:14.183689+0000","last_active":"2024-06-04T16:18:40.008829+0000","last_peered":"2024-06-04T16:18:40.008829+0000","last_clean":"2024-06-04T16:18:40.008829+0000","last_became_active":"2024-06-04T15:53:14.183279+0000","last_became_peered":"2024-06-04T15:53:14.183279+0000","last_unstale":"2024-06-04T16:18:40.008829+0000","last_undegraded":"2024-06-04T16:18:40.008829+0000","last_fullsized":"2024-06-04T16:18:40.008829+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T23:59:10.245827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1395816,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":52,"num_read_kb":1141,"num_write":191,"num_write_kb":22936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.22","version":"254'208","reported_seq":1102,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:21:50.022459+0000","last_change":"2024-06-04T15:52:38.489058+0000","last_active":"2024-06-04T16:21:50.022459+0000","last_peered":"2024-06-04T16:21:50.022459+0000","last_clean":"2024-06-04T16:21:50.022459+0000","last_became_active":"2024-06-04T15:52:38.488762+0000","last_became_peered":"2024-06-04T15:52:38.488762+0000","last_unstale":"2024-06-04T16:21:50.022459+0000","last_undegraded":"2024-06-04T16:21:50.022459+0000","last_fullsized":"2024-06-04T16:21:50.022459+0000","mapping_epoch":23,"log_start":"251'100","ondisk_log_start":"251'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":100,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1221,"num_read_kb":1130,"num_write":279,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.25","version":"254'51","reported_seq":550,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:40.008870+0000","last_change":"2024-06-04T15:52:36.489331+0000","last_active":"2024-06-04T16:18:40.008870+0000","last_peered":"2024-06-04T16:18:40.008870+0000","last_clean":"2024-06-04T16:18:40.008870+0000","last_became_active":"2024-06-04T15:52:36.488611+0000","last_became_peered":"2024-06-04T15:52:36.488611+0000","last_unstale":"2024-06-04T16:18:40.008870+0000","last_undegraded":"2024-06-04T16:18:40.008870+0000","last_fullsized":"2024-06-04T16:18:40.008870+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T19:29:35.729548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":75,"num_read_kb":4172,"num_write":239,"num_write_kb":26328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"254'157","reported_seq":913,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:45.017560+0000","last_change":"2024-06-04T15:52:38.482854+0000","last_active":"2024-06-04T16:19:45.017560+0000","last_peered":"2024-06-04T16:19:45.017560+0000","last_clean":"2024-06-04T16:19:45.017560+0000","last_became_active":"2024-06-04T15:52:38.482566+0000","last_became_peered":"2024-06-04T15:52:38.482566+0000","last_unstale":"2024-06-04T16:19:45.017560+0000","last_undegraded":"2024-06-04T16:19:45.017560+0000","last_fullsized":"2024-06-04T16:19:45.017560+0000","mapping_epoch":23,"log_start":"251'100","ondisk_log_start":"251'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":100,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T03:29:54.648609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":759,"num_read_kb":686,"num_write":203,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"254'59","reported_seq":560,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:20:50.017285+0000","last_change":"2024-06-04T15:52:36.487513+0000","last_active":"2024-06-04T16:20:50.017285+0000","last_peered":"2024-06-04T16:20:50.017285+0000","last_clean":"2024-06-04T16:20:50.017285+0000","last_became_active":"2024-06-04T15:52:36.487213+0000","last_became_peered":"2024-06-04T15:52:36.487213+0000","last_unstale":"2024-06-04T16:20:50.017285+0000","last_undegraded":"2024-06-04T16:20:50.017285+0000","last_fullsized":"2024-06-04T16:20:50.017285+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3860915,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":58,"num_read_kb":7398,"num_write":258,"num_write_kb":28567,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"254'120","reported_seq":862,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:21:50.133684+0000","last_change":"2024-06-04T15:52:38.477288+0000","last_active":"2024-06-04T16:21:50.133684+0000","last_peered":"2024-06-04T16:21:50.133684+0000","last_clean":"2024-06-04T16:21:50.133684+0000","last_became_active":"2024-06-04T15:52:38.477036+0000","last_became_peered":"2024-06-04T15:52:38.477036+0000","last_unstale":"2024-06-04T16:21:50.133684+0000","last_undegraded":"2024-06-04T16:21:50.133684+0000","last_fullsized":"2024-06-04T16:21:50.133684+0000","mapping_epoch":23,"log_start":"251'100","ondisk_log_start":"251'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":100,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":627,"num_read_kb":578,"num_write":156,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"254'48","reported_seq":562,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:40.009774+0000","last_change":"2024-06-04T15:52:36.482150+0000","last_active":"2024-06-04T16:18:40.009774+0000","last_peered":"2024-06-04T16:18:40.009774+0000","last_clean":"2024-06-04T16:18:40.009774+0000","last_became_active":"2024-06-04T15:52:36.479810+0000","last_became_peered":"2024-06-04T15:52:36.479810+0000","last_unstale":"2024-06-04T16:18:40.009774+0000","last_undegraded":"2024-06-04T16:18:40.009774+0000","last_fullsized":"2024-06-04T16:18:40.009774+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T21:50:19.054304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048839,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":103,"num_read_kb":5904,"num_write":252,"num_write_kb":17938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2f","version":"254'58","reported_seq":706,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:23.264257+0000","last_change":"2024-06-04T15:52:38.482098+0000","last_active":"2024-06-04T16:18:23.264257+0000","last_peered":"2024-06-04T16:18:23.264257+0000","last_clean":"2024-06-04T16:18:23.264257+0000","last_became_active":"2024-06-04T15:52:38.481789+0000","last_became_peered":"2024-06-04T15:52:38.481789+0000","last_unstale":"2024-06-04T16:18:23.264257+0000","last_undegraded":"2024-06-04T16:18:23.264257+0000","last_fullsized":"2024-06-04T16:18:23.264257+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T21:41:15.834685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":316,"num_read_kb":309,"num_write":62,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.28","version":"254'57","reported_seq":591,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:45.008317+0000","last_change":"2024-06-04T15:52:36.491357+0000","last_active":"2024-06-04T16:18:45.008317+0000","last_peered":"2024-06-04T16:18:45.008317+0000","last_clean":"2024-06-04T16:18:45.008317+0000","last_became_active":"2024-06-04T15:52:36.490119+0000","last_became_peered":"2024-06-04T15:52:36.490119+0000","last_unstale":"2024-06-04T16:18:45.008317+0000","last_undegraded":"2024-06-04T16:18:45.008317+0000","last_fullsized":"2024-06-04T16:18:45.008317+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T02:06:04.469487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262178,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":124,"num_read_kb":46547,"num_write":231,"num_write_kb":19872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7],"acting":[3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"254'93","reported_seq":778,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:20:40.015633+0000","last_change":"2024-06-04T15:52:38.489137+0000","last_active":"2024-06-04T16:20:40.015633+0000","last_peered":"2024-06-04T16:20:40.015633+0000","last_clean":"2024-06-04T16:20:40.015633+0000","last_became_active":"2024-06-04T15:52:38.488839+0000","last_became_peered":"2024-06-04T15:52:38.488839+0000","last_unstale":"2024-06-04T16:20:40.015633+0000","last_undegraded":"2024-06-04T16:20:40.015633+0000","last_fullsized":"2024-06-04T16:20:40.015633+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":464,"num_read_kb":434,"num_write":108,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.29","version":"254'42","reported_seq":546,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:40.017602+0000","last_change":"2024-06-04T15:52:36.496347+0000","last_active":"2024-06-04T16:19:40.017602+0000","last_peered":"2024-06-04T16:19:40.017602+0000","last_clean":"2024-06-04T16:19:40.017602+0000","last_became_active":"2024-06-04T15:52:36.495936+0000","last_became_peered":"2024-06-04T15:52:36.495936+0000","last_unstale":"2024-06-04T16:19:40.017602+0000","last_undegraded":"2024-06-04T16:19:40.017602+0000","last_fullsized":"2024-06-04T16:19:40.017602+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T19:20:27.592911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133666,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":74,"num_read_kb":10396,"num_write":213,"num_write_kb":18947,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,0],"acting":[5,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2d","version":"254'115","reported_seq":798,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:45.018461+0000","last_change":"2024-06-04T15:52:38.488600+0000","last_active":"2024-06-04T16:19:45.018461+0000","last_peered":"2024-06-04T16:19:45.018461+0000","last_clean":"2024-06-04T16:19:45.018461+0000","last_became_active":"2024-06-04T15:52:38.488289+0000","last_became_peered":"2024-06-04T15:52:38.488289+0000","last_unstale":"2024-06-04T16:19:45.018461+0000","last_undegraded":"2024-06-04T16:19:45.018461+0000","last_fullsized":"2024-06-04T16:19:45.018461+0000","mapping_epoch":23,"log_start":"251'100","ondisk_log_start":"251'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":100,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T02:23:18.956319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":534,"num_read_kb":481,"num_write":150,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"254'66","reported_seq":575,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:39.443162+0000","last_change":"2024-06-04T15:52:36.495691+0000","last_active":"2024-06-04T16:22:39.443162+0000","last_peered":"2024-06-04T16:22:39.443162+0000","last_clean":"2024-06-04T16:22:39.443162+0000","last_became_active":"2024-06-04T15:52:36.495386+0000","last_became_peered":"2024-06-04T15:52:36.495386+0000","last_unstale":"2024-06-04T16:22:39.443162+0000","last_undegraded":"2024-06-04T16:22:39.443162+0000","last_fullsized":"2024-06-04T16:22:39.443162+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4553920,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":69,"num_read_kb":17530,"num_write":238,"num_write_kb":31151,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"254'90","reported_seq":829,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:21:55.134221+0000","last_change":"2024-06-04T15:52:38.477573+0000","last_active":"2024-06-04T16:21:55.134221+0000","last_peered":"2024-06-04T16:21:55.134221+0000","last_clean":"2024-06-04T16:21:55.134221+0000","last_became_active":"2024-06-04T15:52:38.477333+0000","last_became_peered":"2024-06-04T15:52:38.477333+0000","last_unstale":"2024-06-04T16:21:55.134221+0000","last_undegraded":"2024-06-04T16:21:55.134221+0000","last_fullsized":"2024-06-04T16:21:55.134221+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":521,"num_read_kb":500,"num_write":102,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"251'47","reported_seq":558,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:40.017162+0000","last_change":"2024-06-04T15:52:36.483514+0000","last_active":"2024-06-04T16:19:40.017162+0000","last_peered":"2024-06-04T16:19:40.017162+0000","last_clean":"2024-06-04T16:19:40.017162+0000","last_became_active":"2024-06-04T15:52:36.482036+0000","last_became_peered":"2024-06-04T15:52:36.482036+0000","last_unstale":"2024-06-04T16:19:40.017162+0000","last_undegraded":"2024-06-04T16:19:40.017162+0000","last_fullsized":"2024-06-04T16:19:40.017162+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T17:16:27.012465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1069194,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":76,"num_read_kb":25646,"num_write":152,"num_write_kb":18921,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,6],"acting":[4,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"254'150","reported_seq":904,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:21:55.134212+0000","last_change":"2024-06-04T15:52:38.481261+0000","last_active":"2024-06-04T16:21:55.134212+0000","last_peered":"2024-06-04T16:21:55.134212+0000","last_clean":"2024-06-04T16:21:55.134212+0000","last_became_active":"2024-06-04T15:52:38.480432+0000","last_became_peered":"2024-06-04T15:52:38.480432+0000","last_unstale":"2024-06-04T16:21:55.134212+0000","last_undegraded":"2024-06-04T16:21:55.134212+0000","last_fullsized":"2024-06-04T16:21:55.134212+0000","mapping_epoch":23,"log_start":"251'100","ondisk_log_start":"251'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":100,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":703,"num_read_kb":638,"num_write":178,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"254'54","reported_seq":555,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:21:55.023014+0000","last_change":"2024-06-04T15:52:36.492604+0000","last_active":"2024-06-04T16:21:55.023014+0000","last_peered":"2024-06-04T16:21:55.023014+0000","last_clean":"2024-06-04T16:21:55.023014+0000","last_became_active":"2024-06-04T15:52:36.488813+0000","last_became_peered":"2024-06-04T15:52:36.488813+0000","last_unstale":"2024-06-04T16:21:55.023014+0000","last_undegraded":"2024-06-04T16:21:55.023014+0000","last_fullsized":"2024-06-04T16:21:55.023014+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":75,"num_read_kb":5170,"num_write":190,"num_write_kb":17954,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6],"acting":[0,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"254'97","reported_seq":791,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:40.129909+0000","last_change":"2024-06-04T15:52:38.479843+0000","last_active":"2024-06-04T16:19:40.129909+0000","last_peered":"2024-06-04T16:19:40.129909+0000","last_clean":"2024-06-04T16:19:40.129909+0000","last_became_active":"2024-06-04T15:52:38.479542+0000","last_became_peered":"2024-06-04T15:52:38.479542+0000","last_unstale":"2024-06-04T16:19:40.129909+0000","last_undegraded":"2024-06-04T16:19:40.129909+0000","last_fullsized":"2024-06-04T16:19:40.129909+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T22:41:21.159508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":493,"num_read_kb":461,"num_write":115,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"251'65","reported_seq":574,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:45.015100+0000","last_change":"2024-06-04T15:52:36.488268+0000","last_active":"2024-06-04T16:19:45.015100+0000","last_peered":"2024-06-04T16:19:45.015100+0000","last_clean":"2024-06-04T16:19:45.015100+0000","last_became_active":"2024-06-04T15:52:36.487971+0000","last_became_peered":"2024-06-04T15:52:36.487971+0000","last_unstale":"2024-06-04T16:19:45.015100+0000","last_undegraded":"2024-06-04T16:19:45.015100+0000","last_fullsized":"2024-06-04T16:19:45.015100+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T21:45:32.006937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262163,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":94,"num_read_kb":7564,"num_write":255,"num_write_kb":36740,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"254'136","reported_seq":911,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:40.017107+0000","last_change":"2024-06-04T15:52:38.484562+0000","last_active":"2024-06-04T16:19:40.017107+0000","last_peered":"2024-06-04T16:19:40.017107+0000","last_clean":"2024-06-04T16:19:40.017107+0000","last_became_active":"2024-06-04T15:52:38.484225+0000","last_became_peered":"2024-06-04T15:52:38.484225+0000","last_unstale":"2024-06-04T16:19:40.017107+0000","last_undegraded":"2024-06-04T16:19:40.017107+0000","last_fullsized":"2024-06-04T16:19:40.017107+0000","mapping_epoch":23,"log_start":"251'100","ondisk_log_start":"251'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":100,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T02:17:33.313293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":727,"num_read_kb":670,"num_write":170,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2e","version":"254'55","reported_seq":566,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:20:40.138705+0000","last_change":"2024-06-04T15:52:36.488496+0000","last_active":"2024-06-04T16:20:40.138705+0000","last_peered":"2024-06-04T16:20:40.138705+0000","last_clean":"2024-06-04T16:20:40.138705+0000","last_became_active":"2024-06-04T15:52:36.488139+0000","last_became_peered":"2024-06-04T15:52:36.488139+0000","last_unstale":"2024-06-04T16:20:40.138705+0000","last_undegraded":"2024-06-04T16:20:40.138705+0000","last_fullsized":"2024-06-04T16:20:40.138705+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T23:07:58.153939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":103,"num_read_kb":14422,"num_write":268,"num_write_kb":32685,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,3],"acting":[7,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.28","version":"254'289","reported_seq":1124,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:20:50.127834+0000","last_change":"2024-06-04T15:52:38.480910+0000","last_active":"2024-06-04T16:20:50.127834+0000","last_peered":"2024-06-04T16:20:50.127834+0000","last_clean":"2024-06-04T16:20:50.127834+0000","last_became_active":"2024-06-04T15:52:38.480613+0000","last_became_peered":"2024-06-04T15:52:38.480613+0000","last_unstale":"2024-06-04T16:20:50.127834+0000","last_undegraded":"2024-06-04T16:20:50.127834+0000","last_fullsized":"2024-06-04T16:20:50.127834+0000","mapping_epoch":23,"log_start":"251'200","ondisk_log_start":"251'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":200,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1456,"num_read_kb":1243,"num_write":452,"num_write_kb":208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"254'57","reported_seq":557,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:20.005372+0000","last_change":"2024-06-04T15:52:36.498902+0000","last_active":"2024-06-04T16:18:20.005372+0000","last_peered":"2024-06-04T16:18:20.005372+0000","last_clean":"2024-06-04T16:18:20.005372+0000","last_became_active":"2024-06-04T15:52:36.498564+0000","last_became_peered":"2024-06-04T15:52:36.498564+0000","last_unstale":"2024-06-04T16:18:20.005372+0000","last_undegraded":"2024-06-04T16:18:20.005372+0000","last_fullsized":"2024-06-04T16:18:20.005372+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T03:32:39.163905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1395816,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":73,"num_read_kb":11423,"num_write":228,"num_write_kb":34926,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"251'38","reported_seq":548,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:20.005214+0000","last_change":"2024-06-04T15:52:36.490119+0000","last_active":"2024-06-04T16:18:20.005214+0000","last_peered":"2024-06-04T16:18:20.005214+0000","last_clean":"2024-06-04T16:18:20.005214+0000","last_became_active":"2024-06-04T15:52:36.489681+0000","last_became_peered":"2024-06-04T15:52:36.489681+0000","last_unstale":"2024-06-04T16:18:20.005214+0000","last_undegraded":"2024-06-04T16:18:20.005214+0000","last_fullsized":"2024-06-04T16:18:20.005214+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T23:00:19.953809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1395831,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":78,"num_read_kb":4250,"num_write":172,"num_write_kb":18293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,6],"acting":[3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"254'119","reported_seq":1022,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:19:20.014594+0000","last_change":"2024-06-04T15:52:38.489275+0000","last_active":"2024-06-04T16:19:20.014594+0000","last_peered":"2024-06-04T16:19:20.014594+0000","last_clean":"2024-06-04T16:19:20.014594+0000","last_became_active":"2024-06-04T15:52:38.488941+0000","last_became_peered":"2024-06-04T15:52:38.488941+0000","last_unstale":"2024-06-04T16:19:20.014594+0000","last_undegraded":"2024-06-04T16:19:20.014594+0000","last_fullsized":"2024-06-04T16:19:20.014594+0000","mapping_epoch":23,"log_start":"251'100","ondisk_log_start":"251'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":100,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T02:49:46.129022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1004,"num_read_kb":976,"num_write":157,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"251'45","reported_seq":542,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:18:20.006817+0000","last_change":"2024-06-04T15:52:36.496468+0000","last_active":"2024-06-04T16:18:20.006817+0000","last_peered":"2024-06-04T16:18:20.006817+0000","last_clean":"2024-06-04T16:18:20.006817+0000","last_became_active":"2024-06-04T15:52:36.496046+0000","last_became_peered":"2024-06-04T15:52:36.496046+0000","last_unstale":"2024-06-04T16:18:20.006817+0000","last_undegraded":"2024-06-04T16:18:20.006817+0000","last_fullsized":"2024-06-04T16:18:20.006817+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T17:39:51.740231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1069179,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":46,"num_read_kb":3657,"num_write":159,"num_write_kb":22961,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3],"acting":[5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.36","version":"254'112","reported_seq":819,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:21:40.132739+0000","last_change":"2024-06-04T15:52:38.474859+0000","last_active":"2024-06-04T16:21:40.132739+0000","last_peered":"2024-06-04T16:21:40.132739+0000","last_clean":"2024-06-04T16:21:40.132739+0000","last_became_active":"2024-06-04T15:52:38.474574+0000","last_became_peered":"2024-06-04T15:52:38.474574+0000","last_unstale":"2024-06-04T16:21:40.132739+0000","last_undegraded":"2024-06-04T16:21:40.132739+0000","last_fullsized":"2024-06-04T16:21:40.132739+0000","mapping_epoch":23,"log_start":"254'100","ondisk_log_start":"254'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":100,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":563,"num_read_kb":518,"num_write":138,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":16777216,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":169,"num_read_kb":189232,"num_write":179,"num_write_kb":125730,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":33554432,"data_stored":33554432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":126,"ondisk_log_size":126,"up":64,"acting":64,"num_store_stats":8},{"poolid":64,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4378,"num_read_kb":3242,"num_write":1279,"num_write_kb":637,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":682,"ondisk_log_size":682,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":8922,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":3579,"num_read_kb":3443,"num_write":3611,"num_write_kb":1042,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":319488,"data_stored":17844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":999,"ondisk_log_size":999,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":564,"ondisk_log_size":564,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":300865,"num_objects":188,"num_object_clones":0,"num_object_copies":376,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":188,"num_whiteouts":0,"num_read":6099,"num_read_kb":7761,"num_write":3199,"num_write_kb":973,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1903,"ondisk_log_size":1903,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1533,"num_read_kb":1825,"num_write":20,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11,"ondisk_log_size":11,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":77,"num_object_clones":0,"num_object_copies":154,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":77,"num_whiteouts":0,"num_read":48565,"num_read_kb":44901,"num_write":11590,"num_write_kb":3535,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":77,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3758,"ondisk_log_size":3758,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":85563130,"num_objects":200,"num_object_clones":0,"num_object_copies":600,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":200,"num_whiteouts":0,"num_read":5481,"num_read_kb":1011284,"num_write":14360,"num_write_kb":1691909,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":130080768,"data_stored":130080768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3497,"ondisk_log_size":3497,"up":192,"acting":192,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":12,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4,"ondisk_log_size":4,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":16777216,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":170,"num_read_kb":185843,"num_write":179,"num_write_kb":125730,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":33554432,"data_stored":33554432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":126,"ondisk_log_size":126,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542514,"num_pgs":96,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":195152,"kb_used_data":23792,"kb_used_omap":1,"kb_used_meta":171326,"kb_avail":94176688,"statfs":{"total":96636764160,"available":96436928512,"internally_reserved":0,"allocated":24363008,"data_stored":22488525,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":175438282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542514,"num_pgs":108,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":69696,"kb_used_data":24608,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94302144,"statfs":{"total":96636764160,"available":96565395456,"internally_reserved":0,"allocated":25198592,"data_stored":23328559,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":46135751},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542513,"num_pgs":115,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":224824,"kb_used_data":22868,"kb_used_omap":1,"kb_used_meta":201918,"kb_avail":94147016,"statfs":{"total":96636764160,"available":96406544384,"internally_reserved":0,"allocated":23416832,"data_stored":21539413,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":206764485},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542511,"num_pgs":122,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":150896,"kb_used_data":33664,"kb_used_omap":1,"kb_used_meta":117182,"kb_avail":94220944,"statfs":{"total":96636764160,"available":96482246656,"internally_reserved":0,"allocated":34471936,"data_stored":32597872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":119994821},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542514,"num_pgs":119,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":205036,"kb_used_data":29464,"kb_used_omap":1,"kb_used_meta":175550,"kb_avail":94166804,"statfs":{"total":96636764160,"available":96426807296,"internally_reserved":0,"allocated":30171136,"data_stored":28278302,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":179763655},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542514,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":98208,"kb_used_data":22608,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94273632,"statfs":{"total":96636764160,"available":96536199168,"internally_reserved":0,"allocated":23150592,"data_stored":21269158,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":77396421},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542513,"num_pgs":98,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":262840,"kb_used_data":37268,"kb_used_omap":1,"kb_used_meta":225534,"kb_avail":94109000,"statfs":{"total":96636764160,"available":96367616000,"internally_reserved":0,"allocated":38162432,"data_stored":36275175,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":230947269},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542514,"num_pgs":93,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":76064,"kb_used_data":31000,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94295776,"statfs":{"total":96636764160,"available":96558874624,"internally_reserved":0,"allocated":31744000,"data_stored":29845910,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":25591808,"data_stored":25591808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":22585344,"data_stored":22585344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":14917632,"data_stored":14917632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":18190336,"data_stored":18190336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":18907136,"data_stored":18907136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":10403840,"data_stored":10403840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":10686464,"data_stored":10686464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8798208,"data_stored":8798208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":1139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":1364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2484,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1047,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":2789,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":2757,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2173,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2491,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1703,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":64,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":64,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":64,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":64,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":64,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":64,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":64,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":64,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":1048576,"data_stored":1048576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":1048576,"data_stored":1048576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":7340032,"data_stored":7340032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":5242880,"data_stored":5242880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4194304,"data_stored":4194304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":9437184,"data_stored":9437184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":5242880,"data_stored":5242880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":1048576,"data_stored":1048576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":10485760,"data_stored":10485760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4194304,"data_stored":4194304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":6291456,"data_stored":6291456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4194304,"data_stored":4194304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":1048576,"data_stored":1048576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":6291456,"data_stored":6291456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-06-04T16:22:47.344 INFO:tasks.ceph:pgid 67.1c last_scrub_stamp 2024-06-04T16:16:07.631263+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=16, tm_sec=7, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.344 INFO:tasks.ceph:pgid 66.1d last_scrub_stamp 2024-06-04T16:09:25.601105+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=9, tm_sec=25, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.344 INFO:tasks.ceph:pgid 65.1e last_scrub_stamp 2024-06-04T16:09:22.572686+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=9, tm_sec=22, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.344 INFO:tasks.ceph:pgid 64.1f last_scrub_stamp 2024-06-04T16:07:08.374534+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=7, tm_sec=8, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.344 INFO:tasks.ceph:pgid 67.1d last_scrub_stamp 2024-06-04T16:16:07.631263+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=16, tm_sec=7, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.344 INFO:tasks.ceph:pgid 66.1c last_scrub_stamp 2024-06-04T16:09:25.601105+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=9, tm_sec=25, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.345 INFO:tasks.ceph:pgid 65.1f last_scrub_stamp 2024-06-04T16:09:22.572686+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=9, tm_sec=22, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.345 INFO:tasks.ceph:pgid 64.1e last_scrub_stamp 2024-06-04T16:07:08.374534+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=7, tm_sec=8, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.345 INFO:tasks.ceph:pgid 67.1e last_scrub_stamp 2024-06-04T16:16:07.631263+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=16, tm_sec=7, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.345 INFO:tasks.ceph:pgid 66.1f last_scrub_stamp 2024-06-04T16:09:25.601105+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=9, tm_sec=25, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.345 INFO:tasks.ceph:pgid 65.1c last_scrub_stamp 2024-06-04T16:09:22.572686+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=9, tm_sec=22, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.345 INFO:tasks.ceph:pgid 64.1d last_scrub_stamp 2024-06-04T16:07:08.374534+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=7, tm_sec=8, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.346 INFO:tasks.ceph:pgid 67.1f last_scrub_stamp 2024-06-04T16:16:07.631263+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=16, tm_sec=7, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.346 INFO:tasks.ceph:pgid 66.1e last_scrub_stamp 2024-06-04T16:09:25.601105+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=9, tm_sec=25, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.346 INFO:tasks.ceph:pgid 65.1d last_scrub_stamp 2024-06-04T16:09:22.572686+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=9, tm_sec=22, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.346 INFO:tasks.ceph:pgid 64.1c last_scrub_stamp 2024-06-04T16:07:08.374534+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=7, tm_sec=8, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.346 INFO:tasks.ceph:pgid 67.18 last_scrub_stamp 2024-06-04T16:16:07.631263+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=16, tm_sec=7, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.346 INFO:tasks.ceph:pgid 66.19 last_scrub_stamp 2024-06-04T16:09:25.601105+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=9, tm_sec=25, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.347 INFO:tasks.ceph:pgid 65.1a last_scrub_stamp 2024-06-04T16:09:22.572686+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=9, tm_sec=22, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.347 INFO:tasks.ceph:pgid 64.1b last_scrub_stamp 2024-06-04T16:07:08.374534+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=7, tm_sec=8, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.347 INFO:tasks.ceph:pgid 67.19 last_scrub_stamp 2024-06-04T16:16:07.631263+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=16, tm_sec=7, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.347 INFO:tasks.ceph:pgid 66.18 last_scrub_stamp 2024-06-04T16:09:25.601105+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=9, tm_sec=25, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.347 INFO:tasks.ceph:pgid 65.1b last_scrub_stamp 2024-06-04T16:09:22.572686+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=9, tm_sec=22, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.347 INFO:tasks.ceph:pgid 64.1a last_scrub_stamp 2024-06-04T16:07:08.374534+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=7, tm_sec=8, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.348 INFO:tasks.ceph:pgid 67.1a last_scrub_stamp 2024-06-04T16:16:07.631263+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=16, tm_sec=7, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.348 INFO:tasks.ceph:pgid 66.1b last_scrub_stamp 2024-06-04T16:09:25.601105+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=9, tm_sec=25, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.348 INFO:tasks.ceph:pgid 65.18 last_scrub_stamp 2024-06-04T16:09:22.572686+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=9, tm_sec=22, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.348 INFO:tasks.ceph:pgid 64.19 last_scrub_stamp 2024-06-04T16:07:08.374534+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=7, tm_sec=8, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.348 INFO:tasks.ceph:pgid 67.1b last_scrub_stamp 2024-06-04T16:16:07.631263+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=16, tm_sec=7, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.348 INFO:tasks.ceph:pgid 66.1a last_scrub_stamp 2024-06-04T16:09:25.601105+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=9, tm_sec=25, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.348 INFO:tasks.ceph:pgid 65.19 last_scrub_stamp 2024-06-04T16:09:22.572686+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=9, tm_sec=22, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.349 INFO:tasks.ceph:pgid 64.18 last_scrub_stamp 2024-06-04T16:07:08.374534+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=7, tm_sec=8, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.349 INFO:tasks.ceph:pgid 67.14 last_scrub_stamp 2024-06-04T16:16:07.631263+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=16, tm_sec=7, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.349 INFO:tasks.ceph:pgid 66.15 last_scrub_stamp 2024-06-04T16:09:25.601105+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=9, tm_sec=25, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.349 INFO:tasks.ceph:pgid 65.16 last_scrub_stamp 2024-06-04T16:09:22.572686+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=9, tm_sec=22, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.349 INFO:tasks.ceph:pgid 64.17 last_scrub_stamp 2024-06-04T16:07:08.374534+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=7, tm_sec=8, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.349 INFO:tasks.ceph:pgid 67.15 last_scrub_stamp 2024-06-04T16:16:07.631263+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=16, tm_sec=7, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.350 INFO:tasks.ceph:pgid 66.14 last_scrub_stamp 2024-06-04T16:09:25.601105+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=9, tm_sec=25, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.350 INFO:tasks.ceph:pgid 65.17 last_scrub_stamp 2024-06-04T16:09:22.572686+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=9, tm_sec=22, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.350 INFO:tasks.ceph:pgid 64.16 last_scrub_stamp 2024-06-04T16:07:08.374534+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=7, tm_sec=8, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.350 INFO:tasks.ceph:pgid 67.16 last_scrub_stamp 2024-06-04T16:16:07.631263+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=16, tm_sec=7, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.350 INFO:tasks.ceph:pgid 66.17 last_scrub_stamp 2024-06-04T16:09:25.601105+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=9, tm_sec=25, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.350 INFO:tasks.ceph:pgid 65.14 last_scrub_stamp 2024-06-04T16:09:22.572686+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=9, tm_sec=22, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.351 INFO:tasks.ceph:pgid 64.15 last_scrub_stamp 2024-06-04T16:07:08.374534+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=7, tm_sec=8, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.351 INFO:tasks.ceph:pgid 67.17 last_scrub_stamp 2024-06-04T16:16:07.631263+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=16, tm_sec=7, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.351 INFO:tasks.ceph:pgid 66.16 last_scrub_stamp 2024-06-04T16:09:25.601105+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=9, tm_sec=25, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.351 INFO:tasks.ceph:pgid 65.15 last_scrub_stamp 2024-06-04T16:09:22.572686+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=9, tm_sec=22, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.351 INFO:tasks.ceph:pgid 64.14 last_scrub_stamp 2024-06-04T16:07:08.374534+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=7, tm_sec=8, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.351 INFO:tasks.ceph:pgid 67.10 last_scrub_stamp 2024-06-04T16:16:07.631263+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=16, tm_sec=7, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.352 INFO:tasks.ceph:pgid 66.11 last_scrub_stamp 2024-06-04T16:09:25.601105+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=9, tm_sec=25, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.352 INFO:tasks.ceph:pgid 65.12 last_scrub_stamp 2024-06-04T16:09:22.572686+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=9, tm_sec=22, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.352 INFO:tasks.ceph:pgid 64.13 last_scrub_stamp 2024-06-04T16:07:08.374534+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=7, tm_sec=8, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.352 INFO:tasks.ceph:pgid 67.11 last_scrub_stamp 2024-06-04T16:16:07.631263+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=16, tm_sec=7, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.352 INFO:tasks.ceph:pgid 66.10 last_scrub_stamp 2024-06-04T16:09:25.601105+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=9, tm_sec=25, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.352 INFO:tasks.ceph:pgid 65.13 last_scrub_stamp 2024-06-04T16:09:22.572686+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=9, tm_sec=22, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.353 INFO:tasks.ceph:pgid 64.12 last_scrub_stamp 2024-06-04T16:07:08.374534+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=7, tm_sec=8, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.353 INFO:tasks.ceph:pgid 67.12 last_scrub_stamp 2024-06-04T16:16:07.631263+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=16, tm_sec=7, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.353 INFO:tasks.ceph:pgid 66.13 last_scrub_stamp 2024-06-04T16:09:25.601105+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=9, tm_sec=25, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.353 INFO:tasks.ceph:pgid 65.10 last_scrub_stamp 2024-06-04T16:09:22.572686+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=9, tm_sec=22, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.353 INFO:tasks.ceph:pgid 64.11 last_scrub_stamp 2024-06-04T16:07:08.374534+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=7, tm_sec=8, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.353 INFO:tasks.ceph:pgid 67.13 last_scrub_stamp 2024-06-04T16:16:07.631263+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=16, tm_sec=7, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.353 INFO:tasks.ceph:pgid 66.12 last_scrub_stamp 2024-06-04T16:09:25.601105+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=9, tm_sec=25, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.354 INFO:tasks.ceph:pgid 65.11 last_scrub_stamp 2024-06-04T16:09:22.572686+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=9, tm_sec=22, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.354 INFO:tasks.ceph:pgid 64.10 last_scrub_stamp 2024-06-04T16:07:08.374534+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=7, tm_sec=8, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.354 INFO:tasks.ceph:pgid 67.c last_scrub_stamp 2024-06-04T16:16:07.631263+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=16, tm_sec=7, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.354 INFO:tasks.ceph:pgid 66.d last_scrub_stamp 2024-06-04T16:09:25.601105+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=9, tm_sec=25, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.354 INFO:tasks.ceph:pgid 65.e last_scrub_stamp 2024-06-04T16:09:22.572686+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=9, tm_sec=22, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.354 INFO:tasks.ceph:pgid 64.f last_scrub_stamp 2024-06-04T16:07:08.374534+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=7, tm_sec=8, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.355 INFO:tasks.ceph:pgid 67.d last_scrub_stamp 2024-06-04T16:16:07.631263+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=16, tm_sec=7, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.355 INFO:tasks.ceph:pgid 66.c last_scrub_stamp 2024-06-04T16:09:25.601105+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=9, tm_sec=25, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.355 INFO:tasks.ceph:pgid 65.f last_scrub_stamp 2024-06-04T16:09:22.572686+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=9, tm_sec=22, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.355 INFO:tasks.ceph:pgid 64.e last_scrub_stamp 2024-06-04T16:07:08.374534+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=7, tm_sec=8, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.355 INFO:tasks.ceph:pgid 67.e last_scrub_stamp 2024-06-04T16:16:07.631263+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=16, tm_sec=7, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.355 INFO:tasks.ceph:pgid 66.f last_scrub_stamp 2024-06-04T16:09:25.601105+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=9, tm_sec=25, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.356 INFO:tasks.ceph:pgid 65.c last_scrub_stamp 2024-06-04T16:09:22.572686+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=9, tm_sec=22, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.356 INFO:tasks.ceph:pgid 64.d last_scrub_stamp 2024-06-04T16:07:08.374534+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=7, tm_sec=8, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.356 INFO:tasks.ceph:pgid 67.f last_scrub_stamp 2024-06-04T16:16:07.631263+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=16, tm_sec=7, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.356 INFO:tasks.ceph:pgid 66.e last_scrub_stamp 2024-06-04T16:09:25.601105+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=9, tm_sec=25, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.356 INFO:tasks.ceph:pgid 65.d last_scrub_stamp 2024-06-04T16:09:22.572686+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=9, tm_sec=22, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.356 INFO:tasks.ceph:pgid 64.c last_scrub_stamp 2024-06-04T16:07:08.374534+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=7, tm_sec=8, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.356 INFO:tasks.ceph:pgid 67.8 last_scrub_stamp 2024-06-04T16:16:07.631263+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=16, tm_sec=7, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.357 INFO:tasks.ceph:pgid 66.9 last_scrub_stamp 2024-06-04T16:09:25.601105+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=9, tm_sec=25, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.357 INFO:tasks.ceph:pgid 65.a last_scrub_stamp 2024-06-04T16:09:22.572686+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=9, tm_sec=22, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.357 INFO:tasks.ceph:pgid 64.b last_scrub_stamp 2024-06-04T16:07:08.374534+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=7, tm_sec=8, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.357 INFO:tasks.ceph:pgid 67.9 last_scrub_stamp 2024-06-04T16:16:07.631263+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=16, tm_sec=7, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.357 INFO:tasks.ceph:pgid 66.8 last_scrub_stamp 2024-06-04T16:09:25.601105+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=9, tm_sec=25, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.357 INFO:tasks.ceph:pgid 65.b last_scrub_stamp 2024-06-04T16:09:22.572686+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=9, tm_sec=22, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.358 INFO:tasks.ceph:pgid 64.a last_scrub_stamp 2024-06-04T16:07:08.374534+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=7, tm_sec=8, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.358 INFO:tasks.ceph:pgid 67.a last_scrub_stamp 2024-06-04T16:16:07.631263+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=16, tm_sec=7, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.358 INFO:tasks.ceph:pgid 66.b last_scrub_stamp 2024-06-04T16:09:25.601105+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=9, tm_sec=25, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.358 INFO:tasks.ceph:pgid 65.8 last_scrub_stamp 2024-06-04T16:09:22.572686+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=9, tm_sec=22, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.358 INFO:tasks.ceph:pgid 64.9 last_scrub_stamp 2024-06-04T16:07:08.374534+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=7, tm_sec=8, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.358 INFO:tasks.ceph:pgid 67.b last_scrub_stamp 2024-06-04T16:16:07.631263+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=16, tm_sec=7, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.358 INFO:tasks.ceph:pgid 66.a last_scrub_stamp 2024-06-04T16:09:25.601105+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=9, tm_sec=25, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.359 INFO:tasks.ceph:pgid 65.9 last_scrub_stamp 2024-06-04T16:09:22.572686+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=9, tm_sec=22, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.359 INFO:tasks.ceph:pgid 64.8 last_scrub_stamp 2024-06-04T16:07:08.374534+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=7, tm_sec=8, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.359 INFO:tasks.ceph:pgid 67.4 last_scrub_stamp 2024-06-04T16:16:07.631263+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=16, tm_sec=7, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.359 INFO:tasks.ceph:pgid 66.5 last_scrub_stamp 2024-06-04T16:09:25.601105+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=9, tm_sec=25, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.359 INFO:tasks.ceph:pgid 65.6 last_scrub_stamp 2024-06-04T16:09:22.572686+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=9, tm_sec=22, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.359 INFO:tasks.ceph:pgid 64.7 last_scrub_stamp 2024-06-04T16:07:08.374534+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=7, tm_sec=8, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.360 INFO:tasks.ceph:pgid 67.5 last_scrub_stamp 2024-06-04T16:16:07.631263+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=16, tm_sec=7, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.360 INFO:tasks.ceph:pgid 66.4 last_scrub_stamp 2024-06-04T16:09:25.601105+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=9, tm_sec=25, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.360 INFO:tasks.ceph:pgid 65.7 last_scrub_stamp 2024-06-04T16:09:22.572686+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=9, tm_sec=22, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.360 INFO:tasks.ceph:pgid 67.6 last_scrub_stamp 2024-06-04T16:16:07.631263+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=16, tm_sec=7, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.360 INFO:tasks.ceph:pgid 66.7 last_scrub_stamp 2024-06-04T16:09:25.601105+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=9, tm_sec=25, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.360 INFO:tasks.ceph:pgid 65.4 last_scrub_stamp 2024-06-04T16:09:22.572686+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=9, tm_sec=22, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.360 INFO:tasks.ceph:pgid 64.5 last_scrub_stamp 2024-06-04T16:07:08.374534+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=7, tm_sec=8, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.361 INFO:tasks.ceph:pgid 67.7 last_scrub_stamp 2024-06-04T16:16:07.631263+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=16, tm_sec=7, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.361 INFO:tasks.ceph:pgid 66.6 last_scrub_stamp 2024-06-04T16:09:25.601105+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=9, tm_sec=25, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.361 INFO:tasks.ceph:pgid 65.5 last_scrub_stamp 2024-06-04T16:09:22.572686+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=9, tm_sec=22, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.361 INFO:tasks.ceph:pgid 67.0 last_scrub_stamp 2024-06-04T16:16:07.631263+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=16, tm_sec=7, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.361 INFO:tasks.ceph:pgid 66.1 last_scrub_stamp 2024-06-04T16:09:25.601105+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=9, tm_sec=25, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.361 INFO:tasks.ceph:pgid 65.2 last_scrub_stamp 2024-06-04T16:09:22.572686+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=9, tm_sec=22, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.362 INFO:tasks.ceph:pgid 64.3 last_scrub_stamp 2024-06-04T16:07:08.374534+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=7, tm_sec=8, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.362 INFO:tasks.ceph:pgid 67.1 last_scrub_stamp 2024-06-04T16:16:07.631263+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=16, tm_sec=7, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.362 INFO:tasks.ceph:pgid 66.0 last_scrub_stamp 2024-06-04T16:09:25.601105+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=9, tm_sec=25, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.362 INFO:tasks.ceph:pgid 65.3 last_scrub_stamp 2024-06-04T16:09:22.572686+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=9, tm_sec=22, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.362 INFO:tasks.ceph:pgid 64.2 last_scrub_stamp 2024-06-04T16:07:08.374534+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=7, tm_sec=8, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.362 INFO:tasks.ceph:pgid 67.2 last_scrub_stamp 2024-06-04T16:16:07.631263+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=16, tm_sec=7, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.363 INFO:tasks.ceph:pgid 66.3 last_scrub_stamp 2024-06-04T16:09:25.601105+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=9, tm_sec=25, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.363 INFO:tasks.ceph:pgid 65.0 last_scrub_stamp 2024-06-04T16:09:22.572686+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=9, tm_sec=22, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.363 INFO:tasks.ceph:pgid 64.1 last_scrub_stamp 2024-06-04T16:07:08.374534+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=7, tm_sec=8, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.363 INFO:tasks.ceph:pgid 67.3 last_scrub_stamp 2024-06-04T16:16:07.631263+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=16, tm_sec=7, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.363 INFO:tasks.ceph:pgid 66.2 last_scrub_stamp 2024-06-04T16:09:25.601105+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=9, tm_sec=25, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.363 INFO:tasks.ceph:pgid 65.1 last_scrub_stamp 2024-06-04T16:09:22.572686+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=9, tm_sec=22, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.364 INFO:tasks.ceph:pgid 64.0 last_scrub_stamp 2024-06-04T16:07:08.374534+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=7, tm_sec=8, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.364 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-06-04T15:52:35.455324+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=35, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.364 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-06-04T15:52:37.459483+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=37, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.364 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-06-04T15:52:35.455324+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=35, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.364 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-06-04T15:52:37.459483+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=37, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.364 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-06-04T15:52:35.455324+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=35, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.364 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-06-04T15:52:37.459483+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=37, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.365 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-06-04T15:52:35.455324+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=35, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.365 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-06-04T15:52:37.459483+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=37, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.365 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-06-04T15:52:35.455324+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=35, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.365 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-06-04T15:52:37.459483+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=37, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.365 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-06-04T15:52:35.455324+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=35, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.365 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-06-04T15:52:37.459483+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=37, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.366 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-06-04T15:52:35.455324+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=35, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.366 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-06-04T15:52:37.459483+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=37, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.366 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-06-04T15:52:35.455324+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=35, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.366 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-06-04T15:52:37.459483+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=37, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.366 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-06-04T15:52:37.459483+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=37, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.366 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-06-04T15:52:35.455324+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=35, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.367 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-06-04T15:52:37.459483+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=37, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.367 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-06-04T15:52:35.455324+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=35, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.367 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-06-04T15:52:37.459483+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=37, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.367 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-06-04T15:52:35.455324+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=35, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.367 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-06-04T15:52:37.459483+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=37, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.367 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-06-04T15:52:35.455324+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=35, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.368 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-06-04T15:52:37.459483+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=37, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.368 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-06-04T15:52:35.455324+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=35, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.368 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-06-04T15:52:37.459483+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=37, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.368 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-06-04T15:52:35.455324+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=35, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.368 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-06-04T15:52:45.513877+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=45, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.368 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-06-04T15:52:37.459483+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=37, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.369 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-06-04T15:52:35.455324+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=35, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.369 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2024-06-04T15:52:39.463103+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=39, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.369 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2024-06-04T15:52:41.476734+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=41, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.369 INFO:tasks.ceph:pgid 7.17 last_scrub_stamp 2024-06-04T15:52:43.492872+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=43, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.369 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-06-04T15:52:45.513877+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=45, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.369 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-06-04T15:52:37.459483+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=37, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.370 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-06-04T15:52:35.455324+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=35, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.370 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-06-04T15:52:39.463103+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=39, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.370 INFO:tasks.ceph:pgid 6.17 last_scrub_stamp 2024-06-04T15:52:41.476734+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=41, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.370 INFO:tasks.ceph:pgid 7.16 last_scrub_stamp 2024-06-04T15:52:43.492872+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=43, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.370 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-06-04T15:52:45.513877+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=45, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.370 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-06-04T15:52:37.459483+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=37, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.371 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-06-04T15:52:35.455324+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=35, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.371 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2024-06-04T15:52:39.463103+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=39, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.371 INFO:tasks.ceph:pgid 6.14 last_scrub_stamp 2024-06-04T15:52:41.476734+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=41, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.371 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-06-04T15:52:43.492872+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=43, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.371 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2024-06-04T15:52:45.513877+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=45, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.371 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-06-04T15:52:37.459483+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=37, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.372 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-06-04T15:52:35.455324+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=35, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.372 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2024-06-04T15:52:39.463103+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=39, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.372 INFO:tasks.ceph:pgid 6.15 last_scrub_stamp 2024-06-04T15:52:41.476734+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=41, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.372 INFO:tasks.ceph:pgid 7.14 last_scrub_stamp 2024-06-04T15:52:43.492872+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=43, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.372 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-06-04T15:52:37.459483+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=37, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.372 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-06-04T15:52:35.455324+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=35, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.373 INFO:tasks.ceph:pgid 5.9 last_scrub_stamp 2024-06-04T15:52:39.463103+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=39, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.373 INFO:tasks.ceph:pgid 6.a last_scrub_stamp 2024-06-04T15:52:41.476734+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=41, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.373 INFO:tasks.ceph:pgid 7.b last_scrub_stamp 2024-06-04T15:52:43.492872+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=43, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.373 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2024-06-04T15:52:45.513877+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=45, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.373 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-06-04T15:52:37.459483+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=37, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.373 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-06-04T15:52:35.455324+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=35, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.374 INFO:tasks.ceph:pgid 5.8 last_scrub_stamp 2024-06-04T15:52:39.463103+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=39, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.374 INFO:tasks.ceph:pgid 6.b last_scrub_stamp 2024-06-04T15:52:41.476734+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=41, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.374 INFO:tasks.ceph:pgid 7.a last_scrub_stamp 2024-06-04T15:52:43.492872+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=43, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.374 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-06-04T15:52:45.513877+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=45, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.374 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-06-04T15:52:37.459483+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=37, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.375 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-06-04T15:52:35.455324+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=35, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.375 INFO:tasks.ceph:pgid 5.b last_scrub_stamp 2024-06-04T15:52:39.463103+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=39, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.375 INFO:tasks.ceph:pgid 6.8 last_scrub_stamp 2024-06-04T15:52:41.476734+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=41, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.375 INFO:tasks.ceph:pgid 7.9 last_scrub_stamp 2024-06-04T15:52:43.492872+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=43, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.375 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-06-04T15:52:45.513877+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=45, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.375 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-06-04T15:52:37.459483+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=37, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.376 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-06-04T15:52:35.455324+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=35, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.376 INFO:tasks.ceph:pgid 5.a last_scrub_stamp 2024-06-04T15:52:39.463103+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=39, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.376 INFO:tasks.ceph:pgid 6.9 last_scrub_stamp 2024-06-04T15:52:41.476734+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=41, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.376 INFO:tasks.ceph:pgid 7.8 last_scrub_stamp 2024-06-04T15:52:43.492872+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=43, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.376 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-06-04T15:52:45.513877+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=45, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.376 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-06-04T15:52:37.459483+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=37, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.377 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-06-04T15:52:35.455324+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=35, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.377 INFO:tasks.ceph:pgid 5.d last_scrub_stamp 2024-06-04T15:52:39.463103+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=39, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.377 INFO:tasks.ceph:pgid 6.e last_scrub_stamp 2024-06-04T15:52:41.476734+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=41, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.377 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2024-06-04T15:52:43.492872+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=43, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.377 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-06-04T15:52:45.513877+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=45, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.377 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-06-04T15:52:37.459483+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=37, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.378 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-06-04T15:52:35.455324+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=35, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.378 INFO:tasks.ceph:pgid 5.c last_scrub_stamp 2024-06-04T15:52:39.463103+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=39, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.378 INFO:tasks.ceph:pgid 6.f last_scrub_stamp 2024-06-04T15:52:41.476734+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=41, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.378 INFO:tasks.ceph:pgid 7.e last_scrub_stamp 2024-06-04T15:52:43.492872+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=43, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.378 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-06-04T15:52:45.513877+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=45, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.378 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-06-04T15:52:37.459483+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=37, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.379 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-06-04T15:52:35.455324+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=35, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.379 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2024-06-04T15:52:39.463103+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=39, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.379 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2024-06-04T15:52:41.476734+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=41, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.379 INFO:tasks.ceph:pgid 7.d last_scrub_stamp 2024-06-04T15:52:43.492872+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=43, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.379 INFO:tasks.ceph:pgid 8.2 last_scrub_stamp 2024-06-04T15:52:45.513877+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=45, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.379 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-06-04T15:52:37.459483+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=37, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.379 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-06-04T15:52:35.455324+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=35, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.380 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2024-06-04T15:52:39.463103+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=39, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.380 INFO:tasks.ceph:pgid 6.d last_scrub_stamp 2024-06-04T15:52:41.476734+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=41, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.380 INFO:tasks.ceph:pgid 7.c last_scrub_stamp 2024-06-04T15:52:43.492872+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=43, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.380 INFO:tasks.ceph:pgid 8.3 last_scrub_stamp 2024-06-04T15:52:45.513877+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=45, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.380 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-06-04T15:52:37.459483+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=37, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.380 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-06-04T15:52:21.400880+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=21, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.380 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-06-04T15:52:35.455324+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=35, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.381 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2024-06-04T15:52:39.463103+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=39, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.381 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2024-06-04T15:52:41.476734+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=41, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.381 INFO:tasks.ceph:pgid 7.6 last_scrub_stamp 2024-06-04T15:52:43.492872+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=43, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.381 INFO:tasks.ceph:pgid 8.9 last_scrub_stamp 2024-06-04T15:52:45.513877+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=45, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.381 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-06-04T15:52:37.459483+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=37, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.381 INFO:tasks.ceph:pgid 1.1 last_scrub_stamp 2024-06-04T15:52:21.400880+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=21, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.382 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-06-04T15:52:35.455324+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=35, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.382 INFO:tasks.ceph:pgid 5.5 last_scrub_stamp 2024-06-04T15:52:39.463103+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=39, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.382 INFO:tasks.ceph:pgid 6.6 last_scrub_stamp 2024-06-04T15:52:41.476734+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=41, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.382 INFO:tasks.ceph:pgid 7.7 last_scrub_stamp 2024-06-04T15:52:43.492872+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=43, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.382 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-06-04T15:52:45.513877+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=45, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.382 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-06-04T15:52:37.459483+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=37, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.383 INFO:tasks.ceph:pgid 1.2 last_scrub_stamp 2024-06-04T15:52:21.400880+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=21, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.383 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-06-04T15:52:35.455324+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=35, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.383 INFO:tasks.ceph:pgid 5.6 last_scrub_stamp 2024-06-04T15:52:39.463103+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=39, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.383 INFO:tasks.ceph:pgid 6.5 last_scrub_stamp 2024-06-04T15:52:41.476734+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=41, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.383 INFO:tasks.ceph:pgid 7.4 last_scrub_stamp 2024-06-04T15:52:43.492872+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=43, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.383 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-06-04T15:52:45.513877+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=45, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.383 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-06-04T15:52:37.459483+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=37, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.384 INFO:tasks.ceph:pgid 1.3 last_scrub_stamp 2024-06-04T15:52:21.400880+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=21, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.384 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-06-04T15:52:21.400880+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=21, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.384 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-06-04T15:52:35.455324+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=35, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.384 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2024-06-04T15:52:39.463103+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=39, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.384 INFO:tasks.ceph:pgid 6.4 last_scrub_stamp 2024-06-04T15:52:41.476734+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=41, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.384 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2024-06-04T15:52:43.492872+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=43, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.385 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-06-04T15:52:45.513877+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=45, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.385 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-06-04T15:52:37.459483+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=37, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.385 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-06-04T15:52:35.455324+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=35, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.385 INFO:tasks.ceph:pgid 1.4 last_scrub_stamp 2024-06-04T15:52:21.400880+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=21, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.385 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2024-06-04T15:52:39.463103+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=39, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.385 INFO:tasks.ceph:pgid 6.3 last_scrub_stamp 2024-06-04T15:52:41.476734+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=41, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.385 INFO:tasks.ceph:pgid 7.2 last_scrub_stamp 2024-06-04T15:52:43.492872+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=43, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.386 INFO:tasks.ceph:pgid 8.d last_scrub_stamp 2024-06-04T15:52:45.513877+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=45, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.386 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-06-04T15:52:37.459483+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=37, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.386 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-06-04T15:52:35.455324+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=35, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.386 INFO:tasks.ceph:pgid 1.5 last_scrub_stamp 2024-06-04T15:52:21.400880+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=21, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.386 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2024-06-04T15:52:39.463103+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=39, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.386 INFO:tasks.ceph:pgid 6.2 last_scrub_stamp 2024-06-04T15:52:41.476734+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=41, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.387 INFO:tasks.ceph:pgid 7.3 last_scrub_stamp 2024-06-04T15:52:43.492872+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=43, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.387 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-06-04T15:52:45.513877+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=45, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.387 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-06-04T15:52:37.459483+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=37, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.387 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-06-04T15:52:35.455324+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=35, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.387 INFO:tasks.ceph:pgid 1.6 last_scrub_stamp 2024-06-04T15:52:21.400880+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=21, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.387 INFO:tasks.ceph:pgid 5.2 last_scrub_stamp 2024-06-04T15:52:39.463103+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=39, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.387 INFO:tasks.ceph:pgid 6.1 last_scrub_stamp 2024-06-04T15:52:41.476734+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=41, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.388 INFO:tasks.ceph:pgid 7.0 last_scrub_stamp 2024-06-04T15:52:43.492872+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=43, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.388 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-06-04T15:52:45.513877+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=45, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.388 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-06-04T15:52:37.459483+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=37, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.388 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-06-04T15:52:35.455324+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=35, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.388 INFO:tasks.ceph:pgid 1.7 last_scrub_stamp 2024-06-04T15:52:21.400880+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=21, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.388 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2024-06-04T15:52:39.463103+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=39, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.388 INFO:tasks.ceph:pgid 6.0 last_scrub_stamp 2024-06-04T15:52:41.476734+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=41, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.389 INFO:tasks.ceph:pgid 7.1 last_scrub_stamp 2024-06-04T15:52:43.492872+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=43, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.389 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-06-04T15:52:45.513877+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=45, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.389 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2024-06-04T15:52:45.513877+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=45, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.389 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-06-04T15:52:37.459483+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=37, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.389 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-06-04T15:52:35.455324+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=35, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.389 INFO:tasks.ceph:pgid 5.12 last_scrub_stamp 2024-06-04T15:52:39.463103+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=39, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.389 INFO:tasks.ceph:pgid 6.11 last_scrub_stamp 2024-06-04T15:52:41.476734+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=41, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.390 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2024-06-04T15:52:43.492872+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=43, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.390 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-06-04T15:52:45.513877+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=45, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.390 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-06-04T15:52:37.459483+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=37, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.390 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-06-04T15:52:35.455324+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=35, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.390 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2024-06-04T15:52:39.463103+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=39, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.390 INFO:tasks.ceph:pgid 6.10 last_scrub_stamp 2024-06-04T15:52:41.476734+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=41, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.391 INFO:tasks.ceph:pgid 7.11 last_scrub_stamp 2024-06-04T15:52:43.492872+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=43, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.391 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-06-04T15:52:45.513877+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=45, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.391 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-06-04T15:52:37.459483+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=37, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.391 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-06-04T15:52:35.455324+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=35, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.391 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2024-06-04T15:52:39.463103+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=39, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.391 INFO:tasks.ceph:pgid 6.13 last_scrub_stamp 2024-06-04T15:52:41.476734+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=41, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.391 INFO:tasks.ceph:pgid 7.12 last_scrub_stamp 2024-06-04T15:52:43.492872+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=43, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.392 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-06-04T15:52:45.513877+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=45, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.392 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-06-04T15:52:37.459483+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=37, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.392 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-06-04T15:52:35.455324+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=35, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.392 INFO:tasks.ceph:pgid 5.11 last_scrub_stamp 2024-06-04T15:52:39.463103+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=39, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.392 INFO:tasks.ceph:pgid 6.12 last_scrub_stamp 2024-06-04T15:52:41.476734+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=41, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.392 INFO:tasks.ceph:pgid 7.13 last_scrub_stamp 2024-06-04T15:52:43.492872+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=43, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.392 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-06-04T15:52:37.459483+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=37, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.393 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-06-04T15:52:35.455324+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=35, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.393 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2024-06-04T15:52:39.463103+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=39, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.393 INFO:tasks.ceph:pgid 6.1d last_scrub_stamp 2024-06-04T15:52:41.476734+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=41, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.393 INFO:tasks.ceph:pgid 7.1c last_scrub_stamp 2024-06-04T15:52:43.492872+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=43, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.393 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-06-04T15:52:45.513877+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=45, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.393 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-06-04T15:52:37.459483+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=37, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.394 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-06-04T15:52:35.455324+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=35, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.394 INFO:tasks.ceph:pgid 5.1f last_scrub_stamp 2024-06-04T15:52:39.463103+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=39, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.394 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2024-06-04T15:52:41.476734+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=41, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.394 INFO:tasks.ceph:pgid 7.1d last_scrub_stamp 2024-06-04T15:52:43.492872+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=43, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.394 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-06-04T15:52:45.513877+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=45, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.394 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-06-04T15:52:37.459483+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=37, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.395 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-06-04T15:52:35.455324+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=35, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.395 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2024-06-04T15:52:39.463103+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=39, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.395 INFO:tasks.ceph:pgid 6.1f last_scrub_stamp 2024-06-04T15:52:41.476734+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=41, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.395 INFO:tasks.ceph:pgid 7.1e last_scrub_stamp 2024-06-04T15:52:43.492872+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=43, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.395 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-06-04T15:52:45.513877+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=45, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.395 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-06-04T15:52:37.459483+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=37, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.395 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-06-04T15:52:35.455324+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=35, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.396 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2024-06-04T15:52:39.463103+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=39, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.396 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2024-06-04T15:52:41.476734+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=41, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.396 INFO:tasks.ceph:pgid 7.1f last_scrub_stamp 2024-06-04T15:52:43.492872+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=43, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.396 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-06-04T15:52:45.513877+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=45, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.396 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-06-04T15:52:37.459483+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=37, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.396 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-06-04T15:52:35.455324+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=35, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.397 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2024-06-04T15:52:39.463103+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=39, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.397 INFO:tasks.ceph:pgid 6.19 last_scrub_stamp 2024-06-04T15:52:41.476734+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=41, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.397 INFO:tasks.ceph:pgid 7.18 last_scrub_stamp 2024-06-04T15:52:43.492872+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=43, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.397 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-06-04T15:52:45.513877+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=45, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.397 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-06-04T15:52:37.459483+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=37, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.397 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-06-04T15:52:35.455324+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=35, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.397 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2024-06-04T15:52:39.463103+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=39, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.398 INFO:tasks.ceph:pgid 6.18 last_scrub_stamp 2024-06-04T15:52:41.476734+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=41, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.398 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2024-06-04T15:52:43.492872+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=43, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.398 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-06-04T15:52:45.513877+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=45, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.398 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-06-04T15:52:37.459483+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=37, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.398 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-06-04T15:52:35.455324+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=35, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.398 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2024-06-04T15:52:39.463103+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=39, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.399 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2024-06-04T15:52:41.476734+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=41, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.399 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-06-04T15:52:43.492872+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=43, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.399 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-06-04T15:52:45.513877+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=45, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.399 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-06-04T15:52:37.459483+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=37, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.399 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-06-04T15:52:35.455324+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=35, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.399 INFO:tasks.ceph:pgid 5.19 last_scrub_stamp 2024-06-04T15:52:39.463103+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=39, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.399 INFO:tasks.ceph:pgid 6.1a last_scrub_stamp 2024-06-04T15:52:41.476734+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=41, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.400 INFO:tasks.ceph:pgid 7.1b last_scrub_stamp 2024-06-04T15:52:43.492872+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=43, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.400 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-06-04T15:52:45.513877+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=45, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.400 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-06-04T15:52:37.459483+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=37, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.400 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-06-04T15:52:35.455324+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=35, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.400 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-06-04T15:52:37.459483+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=37, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.400 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-06-04T15:52:35.455324+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=35, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.400 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-06-04T15:52:37.459483+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=37, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.401 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-06-04T15:52:35.455324+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=35, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.401 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-06-04T15:52:37.459483+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=37, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.401 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-06-04T15:52:35.455324+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=35, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.401 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-06-04T15:52:37.459483+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=37, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.401 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-06-04T15:52:35.455324+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=35, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.401 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-06-04T15:52:37.459483+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=37, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.402 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-06-04T15:52:35.455324+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=35, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.402 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-06-04T15:52:37.459483+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=37, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.402 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-06-04T15:52:35.455324+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=35, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.402 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-06-04T15:52:37.459483+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=37, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.402 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-06-04T15:52:35.455324+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=35, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.402 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-06-04T15:52:37.459483+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=37, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.403 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-06-04T15:52:35.455324+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=35, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.403 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-06-04T15:52:37.459483+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=37, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.403 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-06-04T15:52:35.455324+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=35, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.403 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-06-04T15:52:37.459483+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=37, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.403 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-06-04T15:52:35.455324+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=35, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.403 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-06-04T15:52:37.459483+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=37, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.404 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-06-04T15:52:35.455324+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=35, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.404 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-06-04T15:52:37.459483+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=37, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.404 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-06-04T15:52:35.455324+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=35, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.404 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-06-04T15:52:37.459483+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=37, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.404 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-06-04T15:52:35.455324+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=35, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.404 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-06-04T15:52:37.459483+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=37, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.404 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-06-04T15:52:35.455324+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=35, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.405 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-06-04T15:52:37.459483+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=37, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.405 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-06-04T15:52:35.455324+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=35, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.405 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-06-04T15:52:35.455324+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=35, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.405 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-06-04T15:52:37.459483+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=37, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.405 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-06-04T15:52:35.455324+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=35, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.405 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-06-04T15:52:37.459483+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=37, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:22:47.405 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-06-04T16:23:07.407 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-06-04T16:23:07.754 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:23:07.765 INFO:teuthology.orchestra.run.smithi144.stderr:dumped all 2024-06-04T16:23:07.767 INFO:teuthology.orchestra.run.smithi144.stdout:{"pg_ready":true,"pg_map":{"version":1171,"stamp":"2024-06-04T16:23:07.565616+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":120019510,"num_objects":545,"num_object_clones":0,"num_object_copies":1290,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":545,"num_whiteouts":0,"num_read":70048,"num_read_kb":1447594,"num_write":34530,"num_write_kb":1951205,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":99,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":18737,"num_omap_keys":70,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11876,"ondisk_log_size":11876,"up":850,"acting":850,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":850,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1295032,"kb_used_data":225272,"kb_used_omap":12,"kb_used_meta":1069683,"kb_avail":753679688,"statfs":{"total":773094113280,"available":771768000512,"internally_reserved":0,"allocated":230678528,"data_stored":215622914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":1095355953},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":12358,"num_omap_keys":51,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005345"},"pg_stats":[{"pgid":"67.1c","version":"0'0","reported_seq":15,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:21:10.019894+0000","last_change":"2024-06-04T16:16:08.658494+0000","last_active":"2024-06-04T16:21:10.019894+0000","last_peered":"2024-06-04T16:21:10.019894+0000","last_clean":"2024-06-04T16:21:10.019894+0000","last_became_active":"2024-06-04T16:16:08.658205+0000","last_became_peered":"2024-06-04T16:16:08.658205+0000","last_unstale":"2024-06-04T16:21:10.019894+0000","last_undegraded":"2024-06-04T16:21:10.019894+0000","last_fullsized":"2024-06-04T16:21:10.019894+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_clean_scrub_stamp":"2024-06-04T16:16:07.631263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1d","version":"251'2","reported_seq":28,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:00.038160+0000","last_change":"2024-06-04T16:09:26.627968+0000","last_active":"2024-06-04T16:22:00.038160+0000","last_peered":"2024-06-04T16:22:00.038160+0000","last_clean":"2024-06-04T16:22:00.038160+0000","last_became_active":"2024-06-04T16:09:26.627678+0000","last_became_peered":"2024-06-04T16:09:26.627678+0000","last_unstale":"2024-06-04T16:22:00.038160+0000","last_undegraded":"2024-06-04T16:22:00.038160+0000","last_fullsized":"2024-06-04T16:22:00.038160+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_clean_scrub_stamp":"2024-06-04T16:09:25.601105+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1e","version":"254'2","reported_seq":34,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:39.497204+0000","last_change":"2024-06-04T16:09:23.610282+0000","last_active":"2024-06-04T16:22:39.497204+0000","last_peered":"2024-06-04T16:22:39.497204+0000","last_clean":"2024-06-04T16:22:39.497204+0000","last_became_active":"2024-06-04T16:09:23.610020+0000","last_became_peered":"2024-06-04T16:09:23.610020+0000","last_unstale":"2024-06-04T16:22:39.497204+0000","last_undegraded":"2024-06-04T16:22:39.497204+0000","last_fullsized":"2024-06-04T16:22:39.497204+0000","mapping_epoch":246,"log_start":"0'0","ondisk_log_start":"0'0","created":246,"last_epoch_clean":247,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_clean_scrub_stamp":"2024-06-04T16:09:22.572686+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"64.1f","version":"251'21","reported_seq":103,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:53.425228+0000","last_change":"2024-06-04T16:22:53.425264+0000","last_active":"2024-06-04T16:22:53.425228+0000","last_peered":"2024-06-04T16:22:53.425228+0000","last_clean":"2024-06-04T16:22:53.425228+0000","last_became_active":"2024-06-04T16:07:09.402073+0000","last_became_peered":"2024-06-04T16:07:09.402073+0000","last_unstale":"2024-06-04T16:22:53.425228+0000","last_undegraded":"2024-06-04T16:22:53.425228+0000","last_fullsized":"2024-06-04T16:22:53.425228+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":243,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"251'21","last_scrub_stamp":"2024-06-04T16:22:53.425132+0000","last_deep_scrub":"251'21","last_deep_scrub_stamp":"2024-06-04T16:22:53.425132+0000","last_clean_scrub_stamp":"2024-06-04T16:22:53.425132+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T16:33:19.953015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":108,"num_read_kb":75,"num_write":41,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1d","version":"0'0","reported_seq":15,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:21:10.129832+0000","last_change":"2024-06-04T16:16:08.656686+0000","last_active":"2024-06-04T16:21:10.129832+0000","last_peered":"2024-06-04T16:21:10.129832+0000","last_clean":"2024-06-04T16:21:10.129832+0000","last_became_active":"2024-06-04T16:16:08.656388+0000","last_became_peered":"2024-06-04T16:16:08.656388+0000","last_unstale":"2024-06-04T16:21:10.129832+0000","last_undegraded":"2024-06-04T16:21:10.129832+0000","last_fullsized":"2024-06-04T16:21:10.129832+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_clean_scrub_stamp":"2024-06-04T16:16:07.631263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.1c","version":"254'2","reported_seq":35,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:56.032254+0000","last_change":"2024-06-04T16:22:56.032296+0000","last_active":"2024-06-04T16:22:56.032254+0000","last_peered":"2024-06-04T16:22:56.032254+0000","last_clean":"2024-06-04T16:22:56.032254+0000","last_became_active":"2024-06-04T16:09:26.626964+0000","last_became_peered":"2024-06-04T16:09:26.626964+0000","last_unstale":"2024-06-04T16:22:56.032254+0000","last_undegraded":"2024-06-04T16:22:56.032254+0000","last_fullsized":"2024-06-04T16:22:56.032254+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'2","last_scrub_stamp":"2024-06-04T16:22:56.032145+0000","last_deep_scrub":"254'2","last_deep_scrub_stamp":"2024-06-04T16:22:56.032145+0000","last_clean_scrub_stamp":"2024-06-04T16:22:56.032145+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T17:55:10.954470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1f","version":"254'4","reported_seq":38,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:39.473376+0000","last_change":"2024-06-04T16:09:23.608520+0000","last_active":"2024-06-04T16:22:39.473376+0000","last_peered":"2024-06-04T16:22:39.473376+0000","last_clean":"2024-06-04T16:22:39.473376+0000","last_became_active":"2024-06-04T16:09:23.608251+0000","last_became_peered":"2024-06-04T16:09:23.608251+0000","last_unstale":"2024-06-04T16:22:39.473376+0000","last_undegraded":"2024-06-04T16:22:39.473376+0000","last_fullsized":"2024-06-04T16:22:39.473376+0000","mapping_epoch":246,"log_start":"0'0","ondisk_log_start":"0'0","created":246,"last_epoch_clean":247,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_clean_scrub_stamp":"2024-06-04T16:09:22.572686+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":8192,"num_write":4,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"64.1e","version":"251'15","reported_seq":88,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:59.041448+0000","last_change":"2024-06-04T16:22:59.041515+0000","last_active":"2024-06-04T16:22:59.041448+0000","last_peered":"2024-06-04T16:22:59.041448+0000","last_clean":"2024-06-04T16:22:59.041448+0000","last_became_active":"2024-06-04T16:07:09.511253+0000","last_became_peered":"2024-06-04T16:07:09.511253+0000","last_unstale":"2024-06-04T16:22:59.041448+0000","last_undegraded":"2024-06-04T16:22:59.041448+0000","last_fullsized":"2024-06-04T16:22:59.041448+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":243,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"251'15","last_scrub_stamp":"2024-06-04T16:22:59.041341+0000","last_deep_scrub":"251'15","last_deep_scrub_stamp":"2024-06-04T16:22:59.041341+0000","last_clean_scrub_stamp":"2024-06-04T16:22:59.041341+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T18:09:07.672420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":58,"num_write":26,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1e","version":"0'0","reported_seq":16,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:10.039525+0000","last_change":"2024-06-04T16:16:08.660980+0000","last_active":"2024-06-04T16:22:10.039525+0000","last_peered":"2024-06-04T16:22:10.039525+0000","last_clean":"2024-06-04T16:22:10.039525+0000","last_became_active":"2024-06-04T16:16:08.660635+0000","last_became_peered":"2024-06-04T16:16:08.660635+0000","last_unstale":"2024-06-04T16:22:10.039525+0000","last_undegraded":"2024-06-04T16:22:10.039525+0000","last_fullsized":"2024-06-04T16:22:10.039525+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_clean_scrub_stamp":"2024-06-04T16:16:07.631263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1f","version":"0'0","reported_seq":25,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:00.134790+0000","last_change":"2024-06-04T16:09:26.624893+0000","last_active":"2024-06-04T16:22:00.134790+0000","last_peered":"2024-06-04T16:22:00.134790+0000","last_clean":"2024-06-04T16:22:00.134790+0000","last_became_active":"2024-06-04T16:09:26.624510+0000","last_became_peered":"2024-06-04T16:09:26.624510+0000","last_unstale":"2024-06-04T16:22:00.134790+0000","last_undegraded":"2024-06-04T16:22:00.134790+0000","last_fullsized":"2024-06-04T16:22:00.134790+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_clean_scrub_stamp":"2024-06-04T16:09:25.601105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1c","version":"0'0","reported_seq":38,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:54.138875+0000","last_change":"2024-06-04T16:22:54.138938+0000","last_active":"2024-06-04T16:22:54.138875+0000","last_peered":"2024-06-04T16:22:54.138875+0000","last_clean":"2024-06-04T16:22:54.138875+0000","last_became_active":"2024-06-04T16:09:23.612278+0000","last_became_peered":"2024-06-04T16:09:23.612278+0000","last_unstale":"2024-06-04T16:22:54.138875+0000","last_undegraded":"2024-06-04T16:22:54.138875+0000","last_fullsized":"2024-06-04T16:22:54.138875+0000","mapping_epoch":246,"log_start":"0'0","ondisk_log_start":"0'0","created":246,"last_epoch_clean":247,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:22:54.138763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:22:54.138763+0000","last_clean_scrub_stamp":"2024-06-04T16:22:54.138763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T18:25:29.872798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"64.1d","version":"251'28","reported_seq":123,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:56.120753+0000","last_change":"2024-06-04T16:22:56.120781+0000","last_active":"2024-06-04T16:22:56.120753+0000","last_peered":"2024-06-04T16:22:56.120753+0000","last_clean":"2024-06-04T16:22:56.120753+0000","last_became_active":"2024-06-04T16:07:09.511154+0000","last_became_peered":"2024-06-04T16:07:09.511154+0000","last_unstale":"2024-06-04T16:22:56.120753+0000","last_undegraded":"2024-06-04T16:22:56.120753+0000","last_fullsized":"2024-06-04T16:22:56.120753+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":243,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"251'28","last_scrub_stamp":"2024-06-04T16:22:56.120659+0000","last_deep_scrub":"251'28","last_deep_scrub_stamp":"2024-06-04T16:22:56.120659+0000","last_clean_scrub_stamp":"2024-06-04T16:22:56.120659+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T00:05:26.471359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":150,"num_read_kb":106,"num_write":50,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.1f","version":"0'0","reported_seq":16,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:25.041519+0000","last_change":"2024-06-04T16:16:08.661162+0000","last_active":"2024-06-04T16:22:25.041519+0000","last_peered":"2024-06-04T16:22:25.041519+0000","last_clean":"2024-06-04T16:22:25.041519+0000","last_became_active":"2024-06-04T16:16:08.660669+0000","last_became_peered":"2024-06-04T16:16:08.660669+0000","last_unstale":"2024-06-04T16:22:25.041519+0000","last_undegraded":"2024-06-04T16:22:25.041519+0000","last_fullsized":"2024-06-04T16:22:25.041519+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_clean_scrub_stamp":"2024-06-04T16:16:07.631263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1e","version":"254'2","reported_seq":36,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:47.038109+0000","last_change":"2024-06-04T16:22:47.038152+0000","last_active":"2024-06-04T16:22:47.038109+0000","last_peered":"2024-06-04T16:22:47.038109+0000","last_clean":"2024-06-04T16:22:47.038109+0000","last_became_active":"2024-06-04T16:09:26.621326+0000","last_became_peered":"2024-06-04T16:09:26.621326+0000","last_unstale":"2024-06-04T16:22:47.038109+0000","last_undegraded":"2024-06-04T16:22:47.038109+0000","last_fullsized":"2024-06-04T16:22:47.038109+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'2","last_scrub_stamp":"2024-06-04T16:22:47.037993+0000","last_deep_scrub":"254'2","last_deep_scrub_stamp":"2024-06-04T16:22:47.037993+0000","last_clean_scrub_stamp":"2024-06-04T16:22:47.037993+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T21:14:40.434297+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1d","version":"254'5","reported_seq":46,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:47.213650+0000","last_change":"2024-06-04T16:22:47.213678+0000","last_active":"2024-06-04T16:22:47.213650+0000","last_peered":"2024-06-04T16:22:47.213650+0000","last_clean":"2024-06-04T16:22:47.213650+0000","last_became_active":"2024-06-04T16:09:23.606918+0000","last_became_peered":"2024-06-04T16:09:23.606918+0000","last_unstale":"2024-06-04T16:22:47.213650+0000","last_undegraded":"2024-06-04T16:22:47.213650+0000","last_fullsized":"2024-06-04T16:22:47.213650+0000","mapping_epoch":246,"log_start":"0'0","ondisk_log_start":"0'0","created":246,"last_epoch_clean":247,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'5","last_scrub_stamp":"2024-06-04T16:22:47.213558+0000","last_deep_scrub":"254'5","last_deep_scrub_stamp":"2024-06-04T16:22:47.213558+0000","last_clean_scrub_stamp":"2024-06-04T16:22:47.213558+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T21:54:10.067561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":4144,"num_write":10,"num_write_kb":4144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"64.1c","version":"251'37","reported_seq":151,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:49.285431+0000","last_change":"2024-06-04T16:22:49.285460+0000","last_active":"2024-06-04T16:22:49.285431+0000","last_peered":"2024-06-04T16:22:49.285431+0000","last_clean":"2024-06-04T16:22:49.285431+0000","last_became_active":"2024-06-04T16:07:09.509671+0000","last_became_peered":"2024-06-04T16:07:09.509671+0000","last_unstale":"2024-06-04T16:22:49.285431+0000","last_undegraded":"2024-06-04T16:22:49.285431+0000","last_fullsized":"2024-06-04T16:22:49.285431+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":243,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"251'37","last_scrub_stamp":"2024-06-04T16:22:49.285327+0000","last_deep_scrub":"251'37","last_deep_scrub_stamp":"2024-06-04T16:22:49.285327+0000","last_clean_scrub_stamp":"2024-06-04T16:22:49.285327+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T20:32:45.523245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":197,"num_read_kb":141,"num_write":70,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.18","version":"0'0","reported_seq":15,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:21:00.023550+0000","last_change":"2024-06-04T16:16:08.664509+0000","last_active":"2024-06-04T16:21:00.023550+0000","last_peered":"2024-06-04T16:21:00.023550+0000","last_clean":"2024-06-04T16:21:00.023550+0000","last_became_active":"2024-06-04T16:16:08.664252+0000","last_became_peered":"2024-06-04T16:16:08.664252+0000","last_unstale":"2024-06-04T16:21:00.023550+0000","last_undegraded":"2024-06-04T16:21:00.023550+0000","last_fullsized":"2024-06-04T16:21:00.023550+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_clean_scrub_stamp":"2024-06-04T16:16:07.631263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.19","version":"254'7","reported_seq":36,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:39.425130+0000","last_change":"2024-06-04T16:09:26.625104+0000","last_active":"2024-06-04T16:22:39.425130+0000","last_peered":"2024-06-04T16:22:39.425130+0000","last_clean":"2024-06-04T16:22:39.425130+0000","last_became_active":"2024-06-04T16:09:26.624681+0000","last_became_peered":"2024-06-04T16:09:26.624681+0000","last_unstale":"2024-06-04T16:22:39.425130+0000","last_undegraded":"2024-06-04T16:22:39.425130+0000","last_fullsized":"2024-06-04T16:22:39.425130+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_clean_scrub_stamp":"2024-06-04T16:09:25.601105+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":9216,"num_write":12,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1a","version":"251'3","reported_seq":43,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:51.476092+0000","last_change":"2024-06-04T16:22:51.476119+0000","last_active":"2024-06-04T16:22:51.476092+0000","last_peered":"2024-06-04T16:22:51.476092+0000","last_clean":"2024-06-04T16:22:51.476092+0000","last_became_active":"2024-06-04T16:09:23.609102+0000","last_became_peered":"2024-06-04T16:09:23.609102+0000","last_unstale":"2024-06-04T16:22:51.476092+0000","last_undegraded":"2024-06-04T16:22:51.476092+0000","last_fullsized":"2024-06-04T16:22:51.476092+0000","mapping_epoch":246,"log_start":"0'0","ondisk_log_start":"0'0","created":246,"last_epoch_clean":247,"parent":"0.0","parent_split_bits":0,"last_scrub":"251'3","last_scrub_stamp":"2024-06-04T16:22:51.475999+0000","last_deep_scrub":"251'3","last_deep_scrub_stamp":"2024-06-04T16:22:51.475999+0000","last_clean_scrub_stamp":"2024-06-04T16:22:51.475999+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T00:37:04.803162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"64.1b","version":"251'96","reported_seq":342,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:56.001961+0000","last_change":"2024-06-04T16:22:56.001988+0000","last_active":"2024-06-04T16:22:56.001961+0000","last_peered":"2024-06-04T16:22:56.001961+0000","last_clean":"2024-06-04T16:22:56.001961+0000","last_became_active":"2024-06-04T16:07:09.404202+0000","last_became_peered":"2024-06-04T16:07:09.404202+0000","last_unstale":"2024-06-04T16:22:56.001961+0000","last_undegraded":"2024-06-04T16:22:56.001961+0000","last_fullsized":"2024-06-04T16:22:56.001961+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":243,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"251'96","last_scrub_stamp":"2024-06-04T16:22:56.001853+0000","last_deep_scrub":"251'96","last_deep_scrub_stamp":"2024-06-04T16:22:56.001853+0000","last_clean_scrub_stamp":"2024-06-04T16:22:56.001853+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T03:12:58.679536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":591,"num_read_kb":533,"num_write":104,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.19","version":"0'0","reported_seq":15,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:21:00.017549+0000","last_change":"2024-06-04T16:16:08.659135+0000","last_active":"2024-06-04T16:21:00.017549+0000","last_peered":"2024-06-04T16:21:00.017549+0000","last_clean":"2024-06-04T16:21:00.017549+0000","last_became_active":"2024-06-04T16:16:08.658696+0000","last_became_peered":"2024-06-04T16:16:08.658696+0000","last_unstale":"2024-06-04T16:21:00.017549+0000","last_undegraded":"2024-06-04T16:21:00.017549+0000","last_fullsized":"2024-06-04T16:21:00.017549+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_clean_scrub_stamp":"2024-06-04T16:16:07.631263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.18","version":"254'7","reported_seq":43,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:50.332112+0000","last_change":"2024-06-04T16:22:50.332142+0000","last_active":"2024-06-04T16:22:50.332112+0000","last_peered":"2024-06-04T16:22:50.332112+0000","last_clean":"2024-06-04T16:22:50.332112+0000","last_became_active":"2024-06-04T16:09:26.624322+0000","last_became_peered":"2024-06-04T16:09:26.624322+0000","last_unstale":"2024-06-04T16:22:50.332112+0000","last_undegraded":"2024-06-04T16:22:50.332112+0000","last_fullsized":"2024-06-04T16:22:50.332112+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'7","last_scrub_stamp":"2024-06-04T16:22:50.332010+0000","last_deep_scrub":"254'7","last_deep_scrub_stamp":"2024-06-04T16:22:50.332010+0000","last_clean_scrub_stamp":"2024-06-04T16:22:50.332010+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T03:36:03.301991+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":8192,"num_write":12,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1b","version":"254'13","reported_seq":61,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:39.533711+0000","last_change":"2024-06-04T16:09:23.613387+0000","last_active":"2024-06-04T16:22:39.533711+0000","last_peered":"2024-06-04T16:22:39.533711+0000","last_clean":"2024-06-04T16:22:39.533711+0000","last_became_active":"2024-06-04T16:09:23.613109+0000","last_became_peered":"2024-06-04T16:09:23.613109+0000","last_unstale":"2024-06-04T16:22:39.533711+0000","last_undegraded":"2024-06-04T16:22:39.533711+0000","last_fullsized":"2024-06-04T16:22:39.533711+0000","mapping_epoch":246,"log_start":"0'0","ondisk_log_start":"0'0","created":246,"last_epoch_clean":247,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_clean_scrub_stamp":"2024-06-04T16:09:22.572686+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":26,"num_read_kb":29700,"num_write":16,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"64.1a","version":"251'15","reported_seq":84,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:52.099476+0000","last_change":"2024-06-04T16:22:52.099503+0000","last_active":"2024-06-04T16:22:52.099476+0000","last_peered":"2024-06-04T16:22:52.099476+0000","last_clean":"2024-06-04T16:22:52.099476+0000","last_became_active":"2024-06-04T16:07:09.406976+0000","last_became_peered":"2024-06-04T16:07:09.406976+0000","last_unstale":"2024-06-04T16:22:52.099476+0000","last_undegraded":"2024-06-04T16:22:52.099476+0000","last_fullsized":"2024-06-04T16:22:52.099476+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":243,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"251'15","last_scrub_stamp":"2024-06-04T16:22:52.099378+0000","last_deep_scrub":"251'15","last_deep_scrub_stamp":"2024-06-04T16:22:52.099378+0000","last_clean_scrub_stamp":"2024-06-04T16:22:52.099378+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T02:39:01.268878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":52,"num_write":29,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.1a","version":"0'0","reported_seq":15,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:21:10.142991+0000","last_change":"2024-06-04T16:16:08.664491+0000","last_active":"2024-06-04T16:21:10.142991+0000","last_peered":"2024-06-04T16:21:10.142991+0000","last_clean":"2024-06-04T16:21:10.142991+0000","last_became_active":"2024-06-04T16:16:08.664200+0000","last_became_peered":"2024-06-04T16:16:08.664200+0000","last_unstale":"2024-06-04T16:21:10.142991+0000","last_undegraded":"2024-06-04T16:21:10.142991+0000","last_fullsized":"2024-06-04T16:21:10.142991+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_clean_scrub_stamp":"2024-06-04T16:16:07.631263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.1b","version":"254'3","reported_seq":29,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:39.555540+0000","last_change":"2024-06-04T16:09:26.626809+0000","last_active":"2024-06-04T16:22:39.555540+0000","last_peered":"2024-06-04T16:22:39.555540+0000","last_clean":"2024-06-04T16:22:39.555540+0000","last_became_active":"2024-06-04T16:09:26.626528+0000","last_became_peered":"2024-06-04T16:09:26.626528+0000","last_unstale":"2024-06-04T16:22:39.555540+0000","last_undegraded":"2024-06-04T16:22:39.555540+0000","last_fullsized":"2024-06-04T16:22:39.555540+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_clean_scrub_stamp":"2024-06-04T16:09:25.601105+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8192,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.18","version":"254'4","reported_seq":45,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:50.225354+0000","last_change":"2024-06-04T16:22:50.225379+0000","last_active":"2024-06-04T16:22:50.225354+0000","last_peered":"2024-06-04T16:22:50.225354+0000","last_clean":"2024-06-04T16:22:50.225354+0000","last_became_active":"2024-06-04T16:09:23.609952+0000","last_became_peered":"2024-06-04T16:09:23.609952+0000","last_unstale":"2024-06-04T16:22:50.225354+0000","last_undegraded":"2024-06-04T16:22:50.225354+0000","last_fullsized":"2024-06-04T16:22:50.225354+0000","mapping_epoch":246,"log_start":"0'0","ondisk_log_start":"0'0","created":246,"last_epoch_clean":247,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'4","last_scrub_stamp":"2024-06-04T16:22:50.225242+0000","last_deep_scrub":"254'4","last_deep_scrub_stamp":"2024-06-04T16:22:50.225242+0000","last_clean_scrub_stamp":"2024-06-04T16:22:50.225242+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T19:11:13.044639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5120,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"64.19","version":"251'22","reported_seq":105,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:52.389508+0000","last_change":"2024-06-04T16:22:52.389536+0000","last_active":"2024-06-04T16:22:52.389508+0000","last_peered":"2024-06-04T16:22:52.389508+0000","last_clean":"2024-06-04T16:22:52.389508+0000","last_became_active":"2024-06-04T16:07:09.402316+0000","last_became_peered":"2024-06-04T16:07:09.402316+0000","last_unstale":"2024-06-04T16:22:52.389508+0000","last_undegraded":"2024-06-04T16:22:52.389508+0000","last_fullsized":"2024-06-04T16:22:52.389508+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":243,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"251'22","last_scrub_stamp":"2024-06-04T16:22:52.389413+0000","last_deep_scrub":"251'22","last_deep_scrub_stamp":"2024-06-04T16:22:52.389413+0000","last_clean_scrub_stamp":"2024-06-04T16:22:52.389413+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T17:48:23.344607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":114,"num_read_kb":79,"num_write":44,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1b","version":"0'0","reported_seq":15,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:21:10.019864+0000","last_change":"2024-06-04T16:16:08.654196+0000","last_active":"2024-06-04T16:21:10.019864+0000","last_peered":"2024-06-04T16:21:10.019864+0000","last_clean":"2024-06-04T16:21:10.019864+0000","last_became_active":"2024-06-04T16:16:08.653931+0000","last_became_peered":"2024-06-04T16:16:08.653931+0000","last_unstale":"2024-06-04T16:21:10.019864+0000","last_undegraded":"2024-06-04T16:21:10.019864+0000","last_fullsized":"2024-06-04T16:21:10.019864+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_clean_scrub_stamp":"2024-06-04T16:16:07.631263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1a","version":"254'8","reported_seq":41,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:39.526411+0000","last_change":"2024-06-04T16:09:26.623784+0000","last_active":"2024-06-04T16:22:39.526411+0000","last_peered":"2024-06-04T16:22:39.526411+0000","last_clean":"2024-06-04T16:22:39.526411+0000","last_became_active":"2024-06-04T16:09:26.623459+0000","last_became_peered":"2024-06-04T16:09:26.623459+0000","last_unstale":"2024-06-04T16:22:39.526411+0000","last_undegraded":"2024-06-04T16:22:39.526411+0000","last_fullsized":"2024-06-04T16:22:39.526411+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_clean_scrub_stamp":"2024-06-04T16:09:25.601105+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":9218,"num_write":7,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.19","version":"254'7","reported_seq":52,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:54.037549+0000","last_change":"2024-06-04T16:22:54.037579+0000","last_active":"2024-06-04T16:22:54.037549+0000","last_peered":"2024-06-04T16:22:54.037549+0000","last_clean":"2024-06-04T16:22:54.037549+0000","last_became_active":"2024-06-04T16:09:23.606966+0000","last_became_peered":"2024-06-04T16:09:23.606966+0000","last_unstale":"2024-06-04T16:22:54.037549+0000","last_undegraded":"2024-06-04T16:22:54.037549+0000","last_fullsized":"2024-06-04T16:22:54.037549+0000","mapping_epoch":246,"log_start":"0'0","ondisk_log_start":"0'0","created":246,"last_epoch_clean":247,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'7","last_scrub_stamp":"2024-06-04T16:22:54.037448+0000","last_deep_scrub":"254'7","last_deep_scrub_stamp":"2024-06-04T16:22:54.037448+0000","last_clean_scrub_stamp":"2024-06-04T16:22:54.037448+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T17:00:32.140550+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":11,"num_read_kb":8194,"num_write":5,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"64.18","version":"251'39","reported_seq":153,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:45.120633+0000","last_change":"2024-06-04T16:22:45.120654+0000","last_active":"2024-06-04T16:22:45.120633+0000","last_peered":"2024-06-04T16:22:45.120633+0000","last_clean":"2024-06-04T16:22:45.120633+0000","last_became_active":"2024-06-04T16:07:09.404055+0000","last_became_peered":"2024-06-04T16:07:09.404055+0000","last_unstale":"2024-06-04T16:22:45.120633+0000","last_undegraded":"2024-06-04T16:22:45.120633+0000","last_fullsized":"2024-06-04T16:22:45.120633+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":243,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"251'39","last_scrub_stamp":"2024-06-04T16:22:45.120553+0000","last_deep_scrub":"251'39","last_deep_scrub_stamp":"2024-06-04T16:22:45.120553+0000","last_clean_scrub_stamp":"2024-06-04T16:22:45.120553+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T19:34:39.593186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":206,"num_read_kb":146,"num_write":71,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.14","version":"253'1","reported_seq":16,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:20:50.028159+0000","last_change":"2024-06-04T16:16:08.662285+0000","last_active":"2024-06-04T16:20:50.028159+0000","last_peered":"2024-06-04T16:20:50.028159+0000","last_clean":"2024-06-04T16:20:50.028159+0000","last_became_active":"2024-06-04T16:16:08.661995+0000","last_became_peered":"2024-06-04T16:16:08.661995+0000","last_unstale":"2024-06-04T16:20:50.028159+0000","last_undegraded":"2024-06-04T16:20:50.028159+0000","last_fullsized":"2024-06-04T16:20:50.028159+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_clean_scrub_stamp":"2024-06-04T16:16:07.631263+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.15","version":"254'5","reported_seq":31,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:39.435875+0000","last_change":"2024-06-04T16:09:26.623775+0000","last_active":"2024-06-04T16:22:39.435875+0000","last_peered":"2024-06-04T16:22:39.435875+0000","last_clean":"2024-06-04T16:22:39.435875+0000","last_became_active":"2024-06-04T16:09:26.623442+0000","last_became_peered":"2024-06-04T16:09:26.623442+0000","last_unstale":"2024-06-04T16:22:39.435875+0000","last_undegraded":"2024-06-04T16:22:39.435875+0000","last_fullsized":"2024-06-04T16:22:39.435875+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_clean_scrub_stamp":"2024-06-04T16:09:25.601105+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":1406,"num_write":10,"num_write_kb":4799,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.16","version":"251'2","reported_seq":34,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:21:30.033718+0000","last_change":"2024-06-04T16:09:23.609558+0000","last_active":"2024-06-04T16:21:30.033718+0000","last_peered":"2024-06-04T16:21:30.033718+0000","last_clean":"2024-06-04T16:21:30.033718+0000","last_became_active":"2024-06-04T16:09:23.609180+0000","last_became_peered":"2024-06-04T16:09:23.609180+0000","last_unstale":"2024-06-04T16:21:30.033718+0000","last_undegraded":"2024-06-04T16:21:30.033718+0000","last_fullsized":"2024-06-04T16:21:30.033718+0000","mapping_epoch":246,"log_start":"0'0","ondisk_log_start":"0'0","created":246,"last_epoch_clean":247,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_clean_scrub_stamp":"2024-06-04T16:09:22.572686+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":45,"num_write":2,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"64.17","version":"0'0","reported_seq":45,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:51.964414+0000","last_change":"2024-06-04T16:22:51.964441+0000","last_active":"2024-06-04T16:22:51.964414+0000","last_peered":"2024-06-04T16:22:51.964414+0000","last_clean":"2024-06-04T16:22:51.964414+0000","last_became_active":"2024-06-04T16:07:09.511806+0000","last_became_peered":"2024-06-04T16:07:09.511806+0000","last_unstale":"2024-06-04T16:22:51.964414+0000","last_undegraded":"2024-06-04T16:22:51.964414+0000","last_fullsized":"2024-06-04T16:22:51.964414+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":243,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:22:51.964320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:22:51.964320+0000","last_clean_scrub_stamp":"2024-06-04T16:22:51.964320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T17:12:29.022223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.15","version":"0'0","reported_seq":15,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:21:00.141482+0000","last_change":"2024-06-04T16:16:08.664995+0000","last_active":"2024-06-04T16:21:00.141482+0000","last_peered":"2024-06-04T16:21:00.141482+0000","last_clean":"2024-06-04T16:21:00.141482+0000","last_became_active":"2024-06-04T16:16:08.664680+0000","last_became_peered":"2024-06-04T16:16:08.664680+0000","last_unstale":"2024-06-04T16:21:00.141482+0000","last_undegraded":"2024-06-04T16:21:00.141482+0000","last_fullsized":"2024-06-04T16:21:00.141482+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_clean_scrub_stamp":"2024-06-04T16:16:07.631263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.14","version":"254'3","reported_seq":27,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:39.410131+0000","last_change":"2024-06-04T16:09:26.624246+0000","last_active":"2024-06-04T16:22:39.410131+0000","last_peered":"2024-06-04T16:22:39.410131+0000","last_clean":"2024-06-04T16:22:39.410131+0000","last_became_active":"2024-06-04T16:09:26.623991+0000","last_became_peered":"2024-06-04T16:09:26.623991+0000","last_unstale":"2024-06-04T16:22:39.410131+0000","last_undegraded":"2024-06-04T16:22:39.410131+0000","last_fullsized":"2024-06-04T16:22:39.410131+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_clean_scrub_stamp":"2024-06-04T16:09:25.601105+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.17","version":"254'2","reported_seq":33,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:39.539941+0000","last_change":"2024-06-04T16:09:23.595639+0000","last_active":"2024-06-04T16:22:39.539941+0000","last_peered":"2024-06-04T16:22:39.539941+0000","last_clean":"2024-06-04T16:22:39.539941+0000","last_became_active":"2024-06-04T16:09:23.595355+0000","last_became_peered":"2024-06-04T16:09:23.595355+0000","last_unstale":"2024-06-04T16:22:39.539941+0000","last_undegraded":"2024-06-04T16:22:39.539941+0000","last_fullsized":"2024-06-04T16:22:39.539941+0000","mapping_epoch":246,"log_start":"0'0","ondisk_log_start":"0'0","created":246,"last_epoch_clean":247,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_clean_scrub_stamp":"2024-06-04T16:09:22.572686+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"64.16","version":"251'16","reported_seq":89,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:02.010675+0000","last_change":"2024-06-04T16:23:02.010721+0000","last_active":"2024-06-04T16:23:02.010675+0000","last_peered":"2024-06-04T16:23:02.010675+0000","last_clean":"2024-06-04T16:23:02.010675+0000","last_became_active":"2024-06-04T16:07:09.405088+0000","last_became_peered":"2024-06-04T16:07:09.405088+0000","last_unstale":"2024-06-04T16:23:02.010675+0000","last_undegraded":"2024-06-04T16:23:02.010675+0000","last_fullsized":"2024-06-04T16:23:02.010675+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":243,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"251'16","last_scrub_stamp":"2024-06-04T16:23:02.010570+0000","last_deep_scrub":"251'16","last_deep_scrub_stamp":"2024-06-04T16:23:02.010570+0000","last_clean_scrub_stamp":"2024-06-04T16:23:02.010570+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T22:57:25.415865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":63,"num_write":30,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.16","version":"0'0","reported_seq":15,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:21:00.017633+0000","last_change":"2024-06-04T16:16:08.656459+0000","last_active":"2024-06-04T16:21:00.017633+0000","last_peered":"2024-06-04T16:21:00.017633+0000","last_clean":"2024-06-04T16:21:00.017633+0000","last_became_active":"2024-06-04T16:16:08.655571+0000","last_became_peered":"2024-06-04T16:16:08.655571+0000","last_unstale":"2024-06-04T16:21:00.017633+0000","last_undegraded":"2024-06-04T16:21:00.017633+0000","last_fullsized":"2024-06-04T16:21:00.017633+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_clean_scrub_stamp":"2024-06-04T16:16:07.631263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.17","version":"0'0","reported_seq":32,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:02.458256+0000","last_change":"2024-06-04T16:23:02.458281+0000","last_active":"2024-06-04T16:23:02.458256+0000","last_peered":"2024-06-04T16:23:02.458256+0000","last_clean":"2024-06-04T16:23:02.458256+0000","last_became_active":"2024-06-04T16:09:26.626605+0000","last_became_peered":"2024-06-04T16:09:26.626605+0000","last_unstale":"2024-06-04T16:23:02.458256+0000","last_undegraded":"2024-06-04T16:23:02.458256+0000","last_fullsized":"2024-06-04T16:23:02.458256+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:23:02.458129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:23:02.458129+0000","last_clean_scrub_stamp":"2024-06-04T16:23:02.458129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T19:52:01.192176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.14","version":"254'2","reported_seq":41,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:49.960905+0000","last_change":"2024-06-04T16:22:49.960934+0000","last_active":"2024-06-04T16:22:49.960905+0000","last_peered":"2024-06-04T16:22:49.960905+0000","last_clean":"2024-06-04T16:22:49.960905+0000","last_became_active":"2024-06-04T16:09:23.607906+0000","last_became_peered":"2024-06-04T16:09:23.607906+0000","last_unstale":"2024-06-04T16:22:49.960905+0000","last_undegraded":"2024-06-04T16:22:49.960905+0000","last_fullsized":"2024-06-04T16:22:49.960905+0000","mapping_epoch":246,"log_start":"0'0","ondisk_log_start":"0'0","created":246,"last_epoch_clean":247,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'2","last_scrub_stamp":"2024-06-04T16:22:49.960799+0000","last_deep_scrub":"254'2","last_deep_scrub_stamp":"2024-06-04T16:22:49.960799+0000","last_clean_scrub_stamp":"2024-06-04T16:22:49.960799+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T03:11:47.194479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"64.15","version":"0'0","reported_seq":45,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:55.504294+0000","last_change":"2024-06-04T16:22:55.504318+0000","last_active":"2024-06-04T16:22:55.504294+0000","last_peered":"2024-06-04T16:22:55.504294+0000","last_clean":"2024-06-04T16:22:55.504294+0000","last_became_active":"2024-06-04T16:07:09.401608+0000","last_became_peered":"2024-06-04T16:07:09.401608+0000","last_unstale":"2024-06-04T16:22:55.504294+0000","last_undegraded":"2024-06-04T16:22:55.504294+0000","last_fullsized":"2024-06-04T16:22:55.504294+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":243,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:22:55.504205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:22:55.504205+0000","last_clean_scrub_stamp":"2024-06-04T16:22:55.504205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T16:56:39.431832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.17","version":"0'0","reported_seq":15,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:21:00.141529+0000","last_change":"2024-06-04T16:16:08.657806+0000","last_active":"2024-06-04T16:21:00.141529+0000","last_peered":"2024-06-04T16:21:00.141529+0000","last_clean":"2024-06-04T16:21:00.141529+0000","last_became_active":"2024-06-04T16:16:08.657535+0000","last_became_peered":"2024-06-04T16:16:08.657535+0000","last_unstale":"2024-06-04T16:21:00.141529+0000","last_undegraded":"2024-06-04T16:21:00.141529+0000","last_fullsized":"2024-06-04T16:21:00.141529+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_clean_scrub_stamp":"2024-06-04T16:16:07.631263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.16","version":"254'13","reported_seq":57,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:00.022118+0000","last_change":"2024-06-04T16:23:00.022163+0000","last_active":"2024-06-04T16:23:00.022118+0000","last_peered":"2024-06-04T16:23:00.022118+0000","last_clean":"2024-06-04T16:23:00.022118+0000","last_became_active":"2024-06-04T16:09:26.628237+0000","last_became_peered":"2024-06-04T16:09:26.628237+0000","last_unstale":"2024-06-04T16:23:00.022118+0000","last_undegraded":"2024-06-04T16:23:00.022118+0000","last_fullsized":"2024-06-04T16:23:00.022118+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'13","last_scrub_stamp":"2024-06-04T16:23:00.022012+0000","last_deep_scrub":"254'13","last_deep_scrub_stamp":"2024-06-04T16:23:00.022012+0000","last_clean_scrub_stamp":"2024-06-04T16:23:00.022012+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T03:53:06.448598+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":19,"num_read_kb":9311,"num_write":11,"num_write_kb":6237,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.15","version":"0'0","reported_seq":38,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:53.025951+0000","last_change":"2024-06-04T16:22:53.025992+0000","last_active":"2024-06-04T16:22:53.025951+0000","last_peered":"2024-06-04T16:22:53.025951+0000","last_clean":"2024-06-04T16:22:53.025951+0000","last_became_active":"2024-06-04T16:09:23.608801+0000","last_became_peered":"2024-06-04T16:09:23.608801+0000","last_unstale":"2024-06-04T16:22:53.025951+0000","last_undegraded":"2024-06-04T16:22:53.025951+0000","last_fullsized":"2024-06-04T16:22:53.025951+0000","mapping_epoch":246,"log_start":"0'0","ondisk_log_start":"0'0","created":246,"last_epoch_clean":247,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:22:53.025834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:22:53.025834+0000","last_clean_scrub_stamp":"2024-06-04T16:22:53.025834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T18:36:02.347621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"64.14","version":"251'30","reported_seq":126,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:48.038079+0000","last_change":"2024-06-04T16:22:48.038108+0000","last_active":"2024-06-04T16:22:48.038079+0000","last_peered":"2024-06-04T16:22:48.038079+0000","last_clean":"2024-06-04T16:22:48.038079+0000","last_became_active":"2024-06-04T16:07:09.403925+0000","last_became_peered":"2024-06-04T16:07:09.403925+0000","last_unstale":"2024-06-04T16:22:48.038079+0000","last_undegraded":"2024-06-04T16:22:48.038079+0000","last_fullsized":"2024-06-04T16:22:48.038079+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":243,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"251'30","last_scrub_stamp":"2024-06-04T16:22:48.037984+0000","last_deep_scrub":"251'30","last_deep_scrub_stamp":"2024-06-04T16:22:48.037984+0000","last_clean_scrub_stamp":"2024-06-04T16:22:48.037984+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T16:58:19.728132+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":154,"num_read_kb":107,"num_write":60,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.10","version":"0'0","reported_seq":15,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:20:50.028066+0000","last_change":"2024-06-04T16:16:08.656330+0000","last_active":"2024-06-04T16:20:50.028066+0000","last_peered":"2024-06-04T16:20:50.028066+0000","last_clean":"2024-06-04T16:20:50.028066+0000","last_became_active":"2024-06-04T16:16:08.656048+0000","last_became_peered":"2024-06-04T16:16:08.656048+0000","last_unstale":"2024-06-04T16:20:50.028066+0000","last_undegraded":"2024-06-04T16:20:50.028066+0000","last_fullsized":"2024-06-04T16:20:50.028066+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_clean_scrub_stamp":"2024-06-04T16:16:07.631263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.11","version":"254'9","reported_seq":49,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:54.471634+0000","last_change":"2024-06-04T16:22:54.471674+0000","last_active":"2024-06-04T16:22:54.471634+0000","last_peered":"2024-06-04T16:22:54.471634+0000","last_clean":"2024-06-04T16:22:54.471634+0000","last_became_active":"2024-06-04T16:09:26.624122+0000","last_became_peered":"2024-06-04T16:09:26.624122+0000","last_unstale":"2024-06-04T16:22:54.471634+0000","last_undegraded":"2024-06-04T16:22:54.471634+0000","last_fullsized":"2024-06-04T16:22:54.471634+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'9","last_scrub_stamp":"2024-06-04T16:22:54.471546+0000","last_deep_scrub":"254'9","last_deep_scrub_stamp":"2024-06-04T16:22:54.471546+0000","last_clean_scrub_stamp":"2024-06-04T16:22:54.471546+0000","objects_scrubbed":1,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T19:44:26.280196+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":17410,"num_write":17,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.12","version":"254'4","reported_seq":43,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:50.065649+0000","last_change":"2024-06-04T16:22:50.065702+0000","last_active":"2024-06-04T16:22:50.065649+0000","last_peered":"2024-06-04T16:22:50.065649+0000","last_clean":"2024-06-04T16:22:50.065649+0000","last_became_active":"2024-06-04T16:09:23.612699+0000","last_became_peered":"2024-06-04T16:09:23.612699+0000","last_unstale":"2024-06-04T16:22:50.065649+0000","last_undegraded":"2024-06-04T16:22:50.065649+0000","last_fullsized":"2024-06-04T16:22:50.065649+0000","mapping_epoch":246,"log_start":"0'0","ondisk_log_start":"0'0","created":246,"last_epoch_clean":247,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'4","last_scrub_stamp":"2024-06-04T16:22:50.065529+0000","last_deep_scrub":"254'4","last_deep_scrub_stamp":"2024-06-04T16:22:50.065529+0000","last_clean_scrub_stamp":"2024-06-04T16:22:50.065529+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T19:24:18.911703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4,"num_write":4,"num_write_kb":1028,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"64.13","version":"254'35","reported_seq":147,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:00.004256+0000","last_change":"2024-06-04T16:23:00.004308+0000","last_active":"2024-06-04T16:23:00.004256+0000","last_peered":"2024-06-04T16:23:00.004256+0000","last_clean":"2024-06-04T16:23:00.004256+0000","last_became_active":"2024-06-04T16:07:09.511607+0000","last_became_peered":"2024-06-04T16:07:09.511607+0000","last_unstale":"2024-06-04T16:23:00.004256+0000","last_undegraded":"2024-06-04T16:23:00.004256+0000","last_fullsized":"2024-06-04T16:23:00.004256+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":243,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'35","last_scrub_stamp":"2024-06-04T16:23:00.004144+0000","last_deep_scrub":"254'35","last_deep_scrub_stamp":"2024-06-04T16:23:00.004144+0000","last_clean_scrub_stamp":"2024-06-04T16:23:00.004144+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T18:57:09.754963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":198,"num_read_kb":144,"num_write":54,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.11","version":"0'0","reported_seq":15,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:20:50.028100+0000","last_change":"2024-06-04T16:16:08.649192+0000","last_active":"2024-06-04T16:20:50.028100+0000","last_peered":"2024-06-04T16:20:50.028100+0000","last_clean":"2024-06-04T16:20:50.028100+0000","last_became_active":"2024-06-04T16:16:08.648899+0000","last_became_peered":"2024-06-04T16:16:08.648899+0000","last_unstale":"2024-06-04T16:20:50.028100+0000","last_undegraded":"2024-06-04T16:20:50.028100+0000","last_fullsized":"2024-06-04T16:20:50.028100+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_clean_scrub_stamp":"2024-06-04T16:16:07.631263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.10","version":"254'2","reported_seq":27,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:39.426038+0000","last_change":"2024-06-04T16:09:26.628742+0000","last_active":"2024-06-04T16:22:39.426038+0000","last_peered":"2024-06-04T16:22:39.426038+0000","last_clean":"2024-06-04T16:22:39.426038+0000","last_became_active":"2024-06-04T16:09:26.628442+0000","last_became_peered":"2024-06-04T16:09:26.628442+0000","last_unstale":"2024-06-04T16:22:39.426038+0000","last_undegraded":"2024-06-04T16:22:39.426038+0000","last_fullsized":"2024-06-04T16:22:39.426038+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_clean_scrub_stamp":"2024-06-04T16:09:25.601105+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.13","version":"254'2","reported_seq":41,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:58.847058+0000","last_change":"2024-06-04T16:22:58.847088+0000","last_active":"2024-06-04T16:22:58.847058+0000","last_peered":"2024-06-04T16:22:58.847058+0000","last_clean":"2024-06-04T16:22:58.847058+0000","last_became_active":"2024-06-04T16:09:23.609536+0000","last_became_peered":"2024-06-04T16:09:23.609536+0000","last_unstale":"2024-06-04T16:22:58.847058+0000","last_undegraded":"2024-06-04T16:22:58.847058+0000","last_fullsized":"2024-06-04T16:22:58.847058+0000","mapping_epoch":246,"log_start":"0'0","ondisk_log_start":"0'0","created":246,"last_epoch_clean":247,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'2","last_scrub_stamp":"2024-06-04T16:22:58.846960+0000","last_deep_scrub":"254'2","last_deep_scrub_stamp":"2024-06-04T16:22:58.846960+0000","last_clean_scrub_stamp":"2024-06-04T16:22:58.846960+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T22:30:42.199456+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"64.12","version":"254'6","reported_seq":63,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:56.874223+0000","last_change":"2024-06-04T16:22:56.874251+0000","last_active":"2024-06-04T16:22:56.874223+0000","last_peered":"2024-06-04T16:22:56.874223+0000","last_clean":"2024-06-04T16:22:56.874223+0000","last_became_active":"2024-06-04T16:07:09.403352+0000","last_became_peered":"2024-06-04T16:07:09.403352+0000","last_unstale":"2024-06-04T16:22:56.874223+0000","last_undegraded":"2024-06-04T16:22:56.874223+0000","last_fullsized":"2024-06-04T16:22:56.874223+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":243,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'6","last_scrub_stamp":"2024-06-04T16:22:56.874133+0000","last_deep_scrub":"254'6","last_deep_scrub_stamp":"2024-06-04T16:22:56.874133+0000","last_clean_scrub_stamp":"2024-06-04T16:22:56.874133+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T01:49:34.273350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":24,"num_write":11,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.12","version":"0'0","reported_seq":15,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:20:50.022428+0000","last_change":"2024-06-04T16:16:08.654940+0000","last_active":"2024-06-04T16:20:50.022428+0000","last_peered":"2024-06-04T16:20:50.022428+0000","last_clean":"2024-06-04T16:20:50.022428+0000","last_became_active":"2024-06-04T16:16:08.654624+0000","last_became_peered":"2024-06-04T16:16:08.654624+0000","last_unstale":"2024-06-04T16:20:50.022428+0000","last_undegraded":"2024-06-04T16:20:50.022428+0000","last_fullsized":"2024-06-04T16:20:50.022428+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_clean_scrub_stamp":"2024-06-04T16:16:07.631263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.13","version":"254'12","reported_seq":50,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:39.554127+0000","last_change":"2024-06-04T16:09:26.621968+0000","last_active":"2024-06-04T16:22:39.554127+0000","last_peered":"2024-06-04T16:22:39.554127+0000","last_clean":"2024-06-04T16:22:39.554127+0000","last_became_active":"2024-06-04T16:09:26.621494+0000","last_became_peered":"2024-06-04T16:09:26.621494+0000","last_unstale":"2024-06-04T16:22:39.554127+0000","last_undegraded":"2024-06-04T16:22:39.554127+0000","last_fullsized":"2024-06-04T16:22:39.554127+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_clean_scrub_stamp":"2024-06-04T16:09:25.601105+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":21,"num_read_kb":22532,"num_write":20,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.10","version":"254'8","reported_seq":53,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:57.044681+0000","last_change":"2024-06-04T16:22:57.044720+0000","last_active":"2024-06-04T16:22:57.044681+0000","last_peered":"2024-06-04T16:22:57.044681+0000","last_clean":"2024-06-04T16:22:57.044681+0000","last_became_active":"2024-06-04T16:09:23.606050+0000","last_became_peered":"2024-06-04T16:09:23.606050+0000","last_unstale":"2024-06-04T16:22:57.044681+0000","last_undegraded":"2024-06-04T16:22:57.044681+0000","last_fullsized":"2024-06-04T16:22:57.044681+0000","mapping_epoch":246,"log_start":"0'0","ondisk_log_start":"0'0","created":246,"last_epoch_clean":247,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'8","last_scrub_stamp":"2024-06-04T16:22:57.044585+0000","last_deep_scrub":"254'8","last_deep_scrub_stamp":"2024-06-04T16:22:57.044585+0000","last_clean_scrub_stamp":"2024-06-04T16:22:57.044585+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T20:44:54.184609+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":11,"num_read_kb":20482,"num_write":11,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"64.11","version":"254'139","reported_seq":485,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:53.899095+0000","last_change":"2024-06-04T16:22:53.899126+0000","last_active":"2024-06-04T16:22:53.899095+0000","last_peered":"2024-06-04T16:22:53.899095+0000","last_clean":"2024-06-04T16:22:53.899095+0000","last_became_active":"2024-06-04T16:07:09.511098+0000","last_became_peered":"2024-06-04T16:07:09.511098+0000","last_unstale":"2024-06-04T16:22:53.899095+0000","last_undegraded":"2024-06-04T16:22:53.899095+0000","last_fullsized":"2024-06-04T16:22:53.899095+0000","mapping_epoch":243,"log_start":"251'100","ondisk_log_start":"251'100","created":243,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'139","last_scrub_stamp":"2024-06-04T16:22:53.899006+0000","last_deep_scrub":"254'139","last_deep_scrub_stamp":"2024-06-04T16:22:53.899006+0000","last_clean_scrub_stamp":"2024-06-04T16:22:53.899006+0000","objects_scrubbed":1,"log_size":39,"log_dups_size":100,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T22:35:53.282639+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":871,"num_read_kb":642,"num_write":155,"num_write_kb":133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4455,"num_omap_keys":9,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.13","version":"254'1","reported_seq":16,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:20:50.140051+0000","last_change":"2024-06-04T16:16:08.657706+0000","last_active":"2024-06-04T16:20:50.140051+0000","last_peered":"2024-06-04T16:20:50.140051+0000","last_clean":"2024-06-04T16:20:50.140051+0000","last_became_active":"2024-06-04T16:16:08.657428+0000","last_became_peered":"2024-06-04T16:16:08.657428+0000","last_unstale":"2024-06-04T16:20:50.140051+0000","last_undegraded":"2024-06-04T16:20:50.140051+0000","last_fullsized":"2024-06-04T16:20:50.140051+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_clean_scrub_stamp":"2024-06-04T16:16:07.631263+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.12","version":"254'6","reported_seq":38,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:39.409568+0000","last_change":"2024-06-04T16:09:26.623554+0000","last_active":"2024-06-04T16:22:39.409568+0000","last_peered":"2024-06-04T16:22:39.409568+0000","last_clean":"2024-06-04T16:22:39.409568+0000","last_became_active":"2024-06-04T16:09:26.623285+0000","last_became_peered":"2024-06-04T16:09:26.623285+0000","last_unstale":"2024-06-04T16:22:39.409568+0000","last_undegraded":"2024-06-04T16:22:39.409568+0000","last_fullsized":"2024-06-04T16:22:39.409568+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_clean_scrub_stamp":"2024-06-04T16:09:25.601105+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":18434,"num_write":5,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.11","version":"254'2","reported_seq":42,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:47.528677+0000","last_change":"2024-06-04T16:22:47.528727+0000","last_active":"2024-06-04T16:22:47.528677+0000","last_peered":"2024-06-04T16:22:47.528677+0000","last_clean":"2024-06-04T16:22:47.528677+0000","last_became_active":"2024-06-04T16:09:23.607048+0000","last_became_peered":"2024-06-04T16:09:23.607048+0000","last_unstale":"2024-06-04T16:22:47.528677+0000","last_undegraded":"2024-06-04T16:22:47.528677+0000","last_fullsized":"2024-06-04T16:22:47.528677+0000","mapping_epoch":246,"log_start":"0'0","ondisk_log_start":"0'0","created":246,"last_epoch_clean":247,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'2","last_scrub_stamp":"2024-06-04T16:22:47.528594+0000","last_deep_scrub":"254'2","last_deep_scrub_stamp":"2024-06-04T16:22:47.528594+0000","last_clean_scrub_stamp":"2024-06-04T16:22:47.528594+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T18:03:35.616854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8192,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"64.10","version":"251'6","reported_seq":63,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:03.054250+0000","last_change":"2024-06-04T16:23:03.054311+0000","last_active":"2024-06-04T16:23:03.054250+0000","last_peered":"2024-06-04T16:23:03.054250+0000","last_clean":"2024-06-04T16:23:03.054250+0000","last_became_active":"2024-06-04T16:07:09.401445+0000","last_became_peered":"2024-06-04T16:07:09.401445+0000","last_unstale":"2024-06-04T16:23:03.054250+0000","last_undegraded":"2024-06-04T16:23:03.054250+0000","last_fullsized":"2024-06-04T16:23:03.054250+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":243,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"251'6","last_scrub_stamp":"2024-06-04T16:23:03.054099+0000","last_deep_scrub":"251'6","last_deep_scrub_stamp":"2024-06-04T16:23:03.054099+0000","last_clean_scrub_stamp":"2024-06-04T16:23:03.054099+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T02:24:52.447333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":24,"num_write":11,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.c","version":"254'1","reported_seq":17,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:46.973045+0000","last_change":"2024-06-04T16:16:08.664755+0000","last_active":"2024-06-04T16:22:46.973045+0000","last_peered":"2024-06-04T16:22:46.973045+0000","last_clean":"2024-06-04T16:22:46.973045+0000","last_became_active":"2024-06-04T16:16:08.664436+0000","last_became_peered":"2024-06-04T16:16:08.664436+0000","last_unstale":"2024-06-04T16:22:46.973045+0000","last_undegraded":"2024-06-04T16:22:46.973045+0000","last_fullsized":"2024-06-04T16:22:46.973045+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_clean_scrub_stamp":"2024-06-04T16:16:07.631263+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.d","version":"251'2","reported_seq":29,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:46.497128+0000","last_change":"2024-06-04T16:09:26.624040+0000","last_active":"2024-06-04T16:22:46.497128+0000","last_peered":"2024-06-04T16:22:46.497128+0000","last_clean":"2024-06-04T16:22:46.497128+0000","last_became_active":"2024-06-04T16:09:26.622747+0000","last_became_peered":"2024-06-04T16:09:26.622747+0000","last_unstale":"2024-06-04T16:22:46.497128+0000","last_undegraded":"2024-06-04T16:22:46.497128+0000","last_fullsized":"2024-06-04T16:22:46.497128+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_clean_scrub_stamp":"2024-06-04T16:09:25.601105+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.e","version":"254'11","reported_seq":58,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:50.975841+0000","last_change":"2024-06-04T16:22:50.975841+0000","last_active":"2024-06-04T16:22:50.975841+0000","last_peered":"2024-06-04T16:22:50.975841+0000","last_clean":"2024-06-04T16:22:50.975841+0000","last_became_active":"2024-06-04T16:09:23.608866+0000","last_became_peered":"2024-06-04T16:09:23.608866+0000","last_unstale":"2024-06-04T16:22:50.975841+0000","last_undegraded":"2024-06-04T16:22:50.975841+0000","last_fullsized":"2024-06-04T16:22:50.975841+0000","mapping_epoch":246,"log_start":"0'0","ondisk_log_start":"0'0","created":246,"last_epoch_clean":247,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'11","last_scrub_stamp":"2024-06-04T16:22:50.975673+0000","last_deep_scrub":"254'11","last_deep_scrub_stamp":"2024-06-04T16:22:50.975673+0000","last_clean_scrub_stamp":"2024-06-04T16:22:50.975673+0000","objects_scrubbed":1,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T01:18:54.016221+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":13,"num_read_kb":5122,"num_write":19,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"64.f","version":"251'6","reported_seq":61,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:47.127684+0000","last_change":"2024-06-04T16:22:47.127684+0000","last_active":"2024-06-04T16:22:47.127684+0000","last_peered":"2024-06-04T16:22:47.127684+0000","last_clean":"2024-06-04T16:22:47.127684+0000","last_became_active":"2024-06-04T16:07:09.400807+0000","last_became_peered":"2024-06-04T16:07:09.400807+0000","last_unstale":"2024-06-04T16:22:47.127684+0000","last_undegraded":"2024-06-04T16:22:47.127684+0000","last_fullsized":"2024-06-04T16:22:47.127684+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":243,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"251'6","last_scrub_stamp":"2024-06-04T16:22:47.127584+0000","last_deep_scrub":"251'6","last_deep_scrub_stamp":"2024-06-04T16:22:47.127584+0000","last_clean_scrub_stamp":"2024-06-04T16:22:47.127584+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T17:42:33.593477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":19,"num_write":12,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.d","version":"0'0","reported_seq":16,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:46.973053+0000","last_change":"2024-06-04T16:16:08.657069+0000","last_active":"2024-06-04T16:22:46.973053+0000","last_peered":"2024-06-04T16:22:46.973053+0000","last_clean":"2024-06-04T16:22:46.973053+0000","last_became_active":"2024-06-04T16:16:08.656726+0000","last_became_peered":"2024-06-04T16:16:08.656726+0000","last_unstale":"2024-06-04T16:22:46.973053+0000","last_undegraded":"2024-06-04T16:22:46.973053+0000","last_fullsized":"2024-06-04T16:22:46.973053+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_clean_scrub_stamp":"2024-06-04T16:16:07.631263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.c","version":"254'3","reported_seq":30,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:44.606655+0000","last_change":"2024-06-04T16:09:26.628320+0000","last_active":"2024-06-04T16:22:44.606655+0000","last_peered":"2024-06-04T16:22:44.606655+0000","last_clean":"2024-06-04T16:22:44.606655+0000","last_became_active":"2024-06-04T16:09:26.627994+0000","last_became_peered":"2024-06-04T16:09:26.627994+0000","last_unstale":"2024-06-04T16:22:44.606655+0000","last_undegraded":"2024-06-04T16:22:44.606655+0000","last_fullsized":"2024-06-04T16:22:44.606655+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_clean_scrub_stamp":"2024-06-04T16:09:25.601105+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8192,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.f","version":"254'2","reported_seq":43,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:51.055160+0000","last_change":"2024-06-04T16:22:51.055160+0000","last_active":"2024-06-04T16:22:51.055160+0000","last_peered":"2024-06-04T16:22:51.055160+0000","last_clean":"2024-06-04T16:22:51.055160+0000","last_became_active":"2024-06-04T16:09:23.609283+0000","last_became_peered":"2024-06-04T16:09:23.609283+0000","last_unstale":"2024-06-04T16:22:51.055160+0000","last_undegraded":"2024-06-04T16:22:51.055160+0000","last_fullsized":"2024-06-04T16:22:51.055160+0000","mapping_epoch":246,"log_start":"0'0","ondisk_log_start":"0'0","created":246,"last_epoch_clean":247,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'2","last_scrub_stamp":"2024-06-04T16:22:51.055012+0000","last_deep_scrub":"254'2","last_deep_scrub_stamp":"2024-06-04T16:22:51.055012+0000","last_clean_scrub_stamp":"2024-06-04T16:22:51.055012+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T00:43:28.540663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"64.e","version":"254'20","reported_seq":103,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:57.841373+0000","last_change":"2024-06-04T16:22:57.841402+0000","last_active":"2024-06-04T16:22:57.841373+0000","last_peered":"2024-06-04T16:22:57.841373+0000","last_clean":"2024-06-04T16:22:57.841373+0000","last_became_active":"2024-06-04T16:07:09.401515+0000","last_became_peered":"2024-06-04T16:07:09.401515+0000","last_unstale":"2024-06-04T16:22:57.841373+0000","last_undegraded":"2024-06-04T16:22:57.841373+0000","last_fullsized":"2024-06-04T16:22:57.841373+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":243,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'20","last_scrub_stamp":"2024-06-04T16:22:57.841275+0000","last_deep_scrub":"254'20","last_deep_scrub_stamp":"2024-06-04T16:22:57.841275+0000","last_clean_scrub_stamp":"2024-06-04T16:22:57.841275+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T22:23:22.342400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":108,"num_read_kb":75,"num_write":37,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.e","version":"0'0","reported_seq":16,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:46.024183+0000","last_change":"2024-06-04T16:16:08.657545+0000","last_active":"2024-06-04T16:22:46.024183+0000","last_peered":"2024-06-04T16:22:46.024183+0000","last_clean":"2024-06-04T16:22:46.024183+0000","last_became_active":"2024-06-04T16:16:08.657279+0000","last_became_peered":"2024-06-04T16:16:08.657279+0000","last_unstale":"2024-06-04T16:22:46.024183+0000","last_undegraded":"2024-06-04T16:22:46.024183+0000","last_fullsized":"2024-06-04T16:22:46.024183+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_clean_scrub_stamp":"2024-06-04T16:16:07.631263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.f","version":"254'10","reported_seq":54,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:48.017264+0000","last_change":"2024-06-04T16:22:48.017264+0000","last_active":"2024-06-04T16:22:48.017264+0000","last_peered":"2024-06-04T16:22:48.017264+0000","last_clean":"2024-06-04T16:22:48.017264+0000","last_became_active":"2024-06-04T16:09:26.623307+0000","last_became_peered":"2024-06-04T16:09:26.623307+0000","last_unstale":"2024-06-04T16:22:48.017264+0000","last_undegraded":"2024-06-04T16:22:48.017264+0000","last_fullsized":"2024-06-04T16:22:48.017264+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'10","last_scrub_stamp":"2024-06-04T16:22:48.017119+0000","last_deep_scrub":"254'10","last_deep_scrub_stamp":"2024-06-04T16:22:48.017119+0000","last_clean_scrub_stamp":"2024-06-04T16:22:48.017119+0000","objects_scrubbed":1,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T21:31:25.906647+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":8194,"num_write":13,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.c","version":"254'5","reported_seq":38,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:46.497066+0000","last_change":"2024-06-04T16:09:23.612714+0000","last_active":"2024-06-04T16:22:46.497066+0000","last_peered":"2024-06-04T16:22:46.497066+0000","last_clean":"2024-06-04T16:22:46.497066+0000","last_became_active":"2024-06-04T16:09:23.612445+0000","last_became_peered":"2024-06-04T16:09:23.612445+0000","last_unstale":"2024-06-04T16:22:46.497066+0000","last_undegraded":"2024-06-04T16:22:46.497066+0000","last_fullsized":"2024-06-04T16:22:46.497066+0000","mapping_epoch":246,"log_start":"0'0","ondisk_log_start":"0'0","created":246,"last_epoch_clean":247,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_clean_scrub_stamp":"2024-06-04T16:09:22.572686+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":1024,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"64.d","version":"251'24","reported_seq":115,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:52.929164+0000","last_change":"2024-06-04T16:22:52.929164+0000","last_active":"2024-06-04T16:22:52.929164+0000","last_peered":"2024-06-04T16:22:52.929164+0000","last_clean":"2024-06-04T16:22:52.929164+0000","last_became_active":"2024-06-04T16:07:09.511172+0000","last_became_peered":"2024-06-04T16:07:09.511172+0000","last_unstale":"2024-06-04T16:22:52.929164+0000","last_undegraded":"2024-06-04T16:22:52.929164+0000","last_fullsized":"2024-06-04T16:22:52.929164+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":243,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"251'24","last_scrub_stamp":"2024-06-04T16:22:52.929049+0000","last_deep_scrub":"251'24","last_deep_scrub_stamp":"2024-06-04T16:22:52.929049+0000","last_clean_scrub_stamp":"2024-06-04T16:22:52.929049+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T00:38:16.499504+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":134,"num_read_kb":91,"num_write":39,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.f","version":"0'0","reported_seq":16,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:46.973057+0000","last_change":"2024-06-04T16:16:08.662500+0000","last_active":"2024-06-04T16:22:46.973057+0000","last_peered":"2024-06-04T16:22:46.973057+0000","last_clean":"2024-06-04T16:22:46.973057+0000","last_became_active":"2024-06-04T16:16:08.662182+0000","last_became_peered":"2024-06-04T16:16:08.662182+0000","last_unstale":"2024-06-04T16:22:46.973057+0000","last_undegraded":"2024-06-04T16:22:46.973057+0000","last_fullsized":"2024-06-04T16:22:46.973057+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_clean_scrub_stamp":"2024-06-04T16:16:07.631263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.e","version":"0'0","reported_seq":33,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:04.074619+0000","last_change":"2024-06-04T16:23:04.074644+0000","last_active":"2024-06-04T16:23:04.074619+0000","last_peered":"2024-06-04T16:23:04.074619+0000","last_clean":"2024-06-04T16:23:04.074619+0000","last_became_active":"2024-06-04T16:09:26.629039+0000","last_became_peered":"2024-06-04T16:09:26.629039+0000","last_unstale":"2024-06-04T16:23:04.074619+0000","last_undegraded":"2024-06-04T16:23:04.074619+0000","last_fullsized":"2024-06-04T16:23:04.074619+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:23:04.074530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:23:04.074530+0000","last_clean_scrub_stamp":"2024-06-04T16:23:04.074530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T20:00:22.482411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.d","version":"254'7","reported_seq":44,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:44.133830+0000","last_change":"2024-06-04T16:09:23.607472+0000","last_active":"2024-06-04T16:22:44.133830+0000","last_peered":"2024-06-04T16:22:44.133830+0000","last_clean":"2024-06-04T16:22:44.133830+0000","last_became_active":"2024-06-04T16:09:23.606695+0000","last_became_peered":"2024-06-04T16:09:23.606695+0000","last_unstale":"2024-06-04T16:22:44.133830+0000","last_undegraded":"2024-06-04T16:22:44.133830+0000","last_fullsized":"2024-06-04T16:22:44.133830+0000","mapping_epoch":246,"log_start":"0'0","ondisk_log_start":"0'0","created":246,"last_epoch_clean":247,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_clean_scrub_stamp":"2024-06-04T16:09:22.572686+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":20480,"num_write":12,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"64.c","version":"251'31","reported_seq":133,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:50.515381+0000","last_change":"2024-06-04T16:22:50.515381+0000","last_active":"2024-06-04T16:22:50.515381+0000","last_peered":"2024-06-04T16:22:50.515381+0000","last_clean":"2024-06-04T16:22:50.515381+0000","last_became_active":"2024-06-04T16:07:09.510728+0000","last_became_peered":"2024-06-04T16:07:09.510728+0000","last_unstale":"2024-06-04T16:22:50.515381+0000","last_undegraded":"2024-06-04T16:22:50.515381+0000","last_fullsized":"2024-06-04T16:22:50.515381+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":243,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"251'31","last_scrub_stamp":"2024-06-04T16:22:50.515259+0000","last_deep_scrub":"251'31","last_deep_scrub_stamp":"2024-06-04T16:22:50.515259+0000","last_clean_scrub_stamp":"2024-06-04T16:22:50.515259+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T22:41:16.625162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":168,"num_read_kb":120,"num_write":55,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.8","version":"0'0","reported_seq":16,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:40.030148+0000","last_change":"2024-06-04T16:16:08.664471+0000","last_active":"2024-06-04T16:22:40.030148+0000","last_peered":"2024-06-04T16:22:40.030148+0000","last_clean":"2024-06-04T16:22:40.030148+0000","last_became_active":"2024-06-04T16:16:08.664198+0000","last_became_peered":"2024-06-04T16:16:08.664198+0000","last_unstale":"2024-06-04T16:22:40.030148+0000","last_undegraded":"2024-06-04T16:22:40.030148+0000","last_fullsized":"2024-06-04T16:22:40.030148+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_clean_scrub_stamp":"2024-06-04T16:16:07.631263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.9","version":"254'6","reported_seq":44,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:58.503564+0000","last_change":"2024-06-04T16:22:58.503590+0000","last_active":"2024-06-04T16:22:58.503564+0000","last_peered":"2024-06-04T16:22:58.503564+0000","last_clean":"2024-06-04T16:22:58.503564+0000","last_became_active":"2024-06-04T16:09:26.625999+0000","last_became_peered":"2024-06-04T16:09:26.625999+0000","last_unstale":"2024-06-04T16:22:58.503564+0000","last_undegraded":"2024-06-04T16:22:58.503564+0000","last_fullsized":"2024-06-04T16:22:58.503564+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'6","last_scrub_stamp":"2024-06-04T16:22:58.503400+0000","last_deep_scrub":"254'6","last_deep_scrub_stamp":"2024-06-04T16:22:58.503400+0000","last_clean_scrub_stamp":"2024-06-04T16:22:58.503400+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T21:34:38.409946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":9216,"num_write":6,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.a","version":"254'3","reported_seq":42,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:49.524226+0000","last_change":"2024-06-04T16:22:49.524282+0000","last_active":"2024-06-04T16:22:49.524226+0000","last_peered":"2024-06-04T16:22:49.524226+0000","last_clean":"2024-06-04T16:22:49.524226+0000","last_became_active":"2024-06-04T16:09:23.600752+0000","last_became_peered":"2024-06-04T16:09:23.600752+0000","last_unstale":"2024-06-04T16:22:49.524226+0000","last_undegraded":"2024-06-04T16:22:49.524226+0000","last_fullsized":"2024-06-04T16:22:49.524226+0000","mapping_epoch":246,"log_start":"0'0","ondisk_log_start":"0'0","created":246,"last_epoch_clean":247,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'3","last_scrub_stamp":"2024-06-04T16:22:49.524121+0000","last_deep_scrub":"254'3","last_deep_scrub_stamp":"2024-06-04T16:22:49.524121+0000","last_clean_scrub_stamp":"2024-06-04T16:22:49.524121+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T19:02:56.815608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"64.b","version":"251'21","reported_seq":106,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:58.017646+0000","last_change":"2024-06-04T16:22:58.017670+0000","last_active":"2024-06-04T16:22:58.017646+0000","last_peered":"2024-06-04T16:22:58.017646+0000","last_clean":"2024-06-04T16:22:58.017646+0000","last_became_active":"2024-06-04T16:07:09.513020+0000","last_became_peered":"2024-06-04T16:07:09.513020+0000","last_unstale":"2024-06-04T16:22:58.017646+0000","last_undegraded":"2024-06-04T16:22:58.017646+0000","last_fullsized":"2024-06-04T16:22:58.017646+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":243,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"251'21","last_scrub_stamp":"2024-06-04T16:22:58.017535+0000","last_deep_scrub":"251'21","last_deep_scrub_stamp":"2024-06-04T16:22:58.017535+0000","last_clean_scrub_stamp":"2024-06-04T16:22:58.017535+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T18:24:46.428109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":114,"num_read_kb":81,"num_write":38,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.9","version":"0'0","reported_seq":16,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:40.034809+0000","last_change":"2024-06-04T16:16:08.658344+0000","last_active":"2024-06-04T16:22:40.034809+0000","last_peered":"2024-06-04T16:22:40.034809+0000","last_clean":"2024-06-04T16:22:40.034809+0000","last_became_active":"2024-06-04T16:16:08.658076+0000","last_became_peered":"2024-06-04T16:16:08.658076+0000","last_unstale":"2024-06-04T16:22:40.034809+0000","last_undegraded":"2024-06-04T16:22:40.034809+0000","last_fullsized":"2024-06-04T16:22:40.034809+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_clean_scrub_stamp":"2024-06-04T16:16:07.631263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.8","version":"254'7","reported_seq":41,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:52.040855+0000","last_change":"2024-06-04T16:22:52.040890+0000","last_active":"2024-06-04T16:22:52.040855+0000","last_peered":"2024-06-04T16:22:52.040855+0000","last_clean":"2024-06-04T16:22:52.040855+0000","last_became_active":"2024-06-04T16:09:26.623966+0000","last_became_peered":"2024-06-04T16:09:26.623966+0000","last_unstale":"2024-06-04T16:22:52.040855+0000","last_undegraded":"2024-06-04T16:22:52.040855+0000","last_fullsized":"2024-06-04T16:22:52.040855+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'7","last_scrub_stamp":"2024-06-04T16:22:52.040732+0000","last_deep_scrub":"254'7","last_deep_scrub_stamp":"2024-06-04T16:22:52.040732+0000","last_clean_scrub_stamp":"2024-06-04T16:22:52.040732+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T00:48:17.796817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4096,"num_write":12,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.b","version":"254'4","reported_seq":37,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:46.497022+0000","last_change":"2024-06-04T16:09:23.613436+0000","last_active":"2024-06-04T16:22:46.497022+0000","last_peered":"2024-06-04T16:22:46.497022+0000","last_clean":"2024-06-04T16:22:46.497022+0000","last_became_active":"2024-06-04T16:09:23.613130+0000","last_became_peered":"2024-06-04T16:09:23.613130+0000","last_unstale":"2024-06-04T16:22:46.497022+0000","last_undegraded":"2024-06-04T16:22:46.497022+0000","last_fullsized":"2024-06-04T16:22:46.497022+0000","mapping_epoch":246,"log_start":"0'0","ondisk_log_start":"0'0","created":246,"last_epoch_clean":247,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_clean_scrub_stamp":"2024-06-04T16:09:22.572686+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3775,"num_write":4,"num_write_kb":3775,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"64.a","version":"251'22","reported_seq":109,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:51.982618+0000","last_change":"2024-06-04T16:22:51.982647+0000","last_active":"2024-06-04T16:22:51.982618+0000","last_peered":"2024-06-04T16:22:51.982618+0000","last_clean":"2024-06-04T16:22:51.982618+0000","last_became_active":"2024-06-04T16:07:09.403980+0000","last_became_peered":"2024-06-04T16:07:09.403980+0000","last_unstale":"2024-06-04T16:22:51.982618+0000","last_undegraded":"2024-06-04T16:22:51.982618+0000","last_fullsized":"2024-06-04T16:22:51.982618+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":243,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"251'22","last_scrub_stamp":"2024-06-04T16:22:51.982518+0000","last_deep_scrub":"251'22","last_deep_scrub_stamp":"2024-06-04T16:22:51.982518+0000","last_clean_scrub_stamp":"2024-06-04T16:22:51.982518+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T21:31:54.076119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":122,"num_read_kb":87,"num_write":38,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.a","version":"0'0","reported_seq":16,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:40.027547+0000","last_change":"2024-06-04T16:16:08.661712+0000","last_active":"2024-06-04T16:22:40.027547+0000","last_peered":"2024-06-04T16:22:40.027547+0000","last_clean":"2024-06-04T16:22:40.027547+0000","last_became_active":"2024-06-04T16:16:08.661413+0000","last_became_peered":"2024-06-04T16:16:08.661413+0000","last_unstale":"2024-06-04T16:22:40.027547+0000","last_undegraded":"2024-06-04T16:22:40.027547+0000","last_fullsized":"2024-06-04T16:22:40.027547+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_clean_scrub_stamp":"2024-06-04T16:16:07.631263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.b","version":"254'4","reported_seq":33,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:45.077655+0000","last_change":"2024-06-04T16:09:26.622990+0000","last_active":"2024-06-04T16:22:45.077655+0000","last_peered":"2024-06-04T16:22:45.077655+0000","last_clean":"2024-06-04T16:22:45.077655+0000","last_became_active":"2024-06-04T16:09:26.622600+0000","last_became_peered":"2024-06-04T16:09:26.622600+0000","last_unstale":"2024-06-04T16:22:45.077655+0000","last_undegraded":"2024-06-04T16:22:45.077655+0000","last_fullsized":"2024-06-04T16:22:45.077655+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_clean_scrub_stamp":"2024-06-04T16:09:25.601105+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":1032,"num_write":4,"num_write_kb":1028,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.8","version":"251'2","reported_seq":35,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:25.025887+0000","last_change":"2024-06-04T16:09:23.610808+0000","last_active":"2024-06-04T16:22:25.025887+0000","last_peered":"2024-06-04T16:22:25.025887+0000","last_clean":"2024-06-04T16:22:25.025887+0000","last_became_active":"2024-06-04T16:09:23.610525+0000","last_became_peered":"2024-06-04T16:09:23.610525+0000","last_unstale":"2024-06-04T16:22:25.025887+0000","last_undegraded":"2024-06-04T16:22:25.025887+0000","last_fullsized":"2024-06-04T16:22:25.025887+0000","mapping_epoch":246,"log_start":"0'0","ondisk_log_start":"0'0","created":246,"last_epoch_clean":247,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_clean_scrub_stamp":"2024-06-04T16:09:22.572686+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"64.9","version":"251'14","reported_seq":88,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:51.381066+0000","last_change":"2024-06-04T16:22:51.381093+0000","last_active":"2024-06-04T16:22:51.381066+0000","last_peered":"2024-06-04T16:22:51.381066+0000","last_clean":"2024-06-04T16:22:51.381066+0000","last_became_active":"2024-06-04T16:07:09.403227+0000","last_became_peered":"2024-06-04T16:07:09.403227+0000","last_unstale":"2024-06-04T16:22:51.381066+0000","last_undegraded":"2024-06-04T16:22:51.381066+0000","last_fullsized":"2024-06-04T16:22:51.381066+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":243,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"251'14","last_scrub_stamp":"2024-06-04T16:22:51.380961+0000","last_deep_scrub":"251'14","last_deep_scrub_stamp":"2024-06-04T16:22:51.380961+0000","last_clean_scrub_stamp":"2024-06-04T16:22:51.380961+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T23:08:22.543065+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":56,"num_write":27,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.b","version":"0'0","reported_seq":16,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:46.497194+0000","last_change":"2024-06-04T16:16:08.660998+0000","last_active":"2024-06-04T16:22:46.497194+0000","last_peered":"2024-06-04T16:22:46.497194+0000","last_clean":"2024-06-04T16:22:46.497194+0000","last_became_active":"2024-06-04T16:16:08.660717+0000","last_became_peered":"2024-06-04T16:16:08.660717+0000","last_unstale":"2024-06-04T16:22:46.497194+0000","last_undegraded":"2024-06-04T16:22:46.497194+0000","last_fullsized":"2024-06-04T16:22:46.497194+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_clean_scrub_stamp":"2024-06-04T16:16:07.631263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.a","version":"254'2","reported_seq":37,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:49.053054+0000","last_change":"2024-06-04T16:22:49.053106+0000","last_active":"2024-06-04T16:22:49.053054+0000","last_peered":"2024-06-04T16:22:49.053054+0000","last_clean":"2024-06-04T16:22:49.053054+0000","last_became_active":"2024-06-04T16:09:26.620119+0000","last_became_peered":"2024-06-04T16:09:26.620119+0000","last_unstale":"2024-06-04T16:22:49.053054+0000","last_undegraded":"2024-06-04T16:22:49.053054+0000","last_fullsized":"2024-06-04T16:22:49.053054+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'2","last_scrub_stamp":"2024-06-04T16:22:49.052943+0000","last_deep_scrub":"254'2","last_deep_scrub_stamp":"2024-06-04T16:22:49.052943+0000","last_clean_scrub_stamp":"2024-06-04T16:22:49.052943+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T04:22:22.929186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8192,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.9","version":"254'6","reported_seq":51,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:46.368834+0000","last_change":"2024-06-04T16:22:46.368878+0000","last_active":"2024-06-04T16:22:46.368834+0000","last_peered":"2024-06-04T16:22:46.368834+0000","last_clean":"2024-06-04T16:22:46.368834+0000","last_became_active":"2024-06-04T16:09:23.607666+0000","last_became_peered":"2024-06-04T16:09:23.607666+0000","last_unstale":"2024-06-04T16:22:46.368834+0000","last_undegraded":"2024-06-04T16:22:46.368834+0000","last_fullsized":"2024-06-04T16:22:46.368834+0000","mapping_epoch":246,"log_start":"0'0","ondisk_log_start":"0'0","created":246,"last_epoch_clean":247,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'6","last_scrub_stamp":"2024-06-04T16:22:46.368741+0000","last_deep_scrub":"254'6","last_deep_scrub_stamp":"2024-06-04T16:22:46.368741+0000","last_clean_scrub_stamp":"2024-06-04T16:22:46.368741+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T17:57:54.874735+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":16386,"num_write":9,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"64.8","version":"251'8","reported_seq":70,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:55.897731+0000","last_change":"2024-06-04T16:22:55.897764+0000","last_active":"2024-06-04T16:22:55.897731+0000","last_peered":"2024-06-04T16:22:55.897731+0000","last_clean":"2024-06-04T16:22:55.897731+0000","last_became_active":"2024-06-04T16:07:09.404928+0000","last_became_peered":"2024-06-04T16:07:09.404928+0000","last_unstale":"2024-06-04T16:22:55.897731+0000","last_undegraded":"2024-06-04T16:22:55.897731+0000","last_fullsized":"2024-06-04T16:22:55.897731+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":243,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"251'8","last_scrub_stamp":"2024-06-04T16:22:55.897619+0000","last_deep_scrub":"251'8","last_deep_scrub_stamp":"2024-06-04T16:22:55.897619+0000","last_clean_scrub_stamp":"2024-06-04T16:22:55.897619+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T16:49:54.112318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":32,"num_write":14,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.4","version":"0'0","reported_seq":16,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:25.041468+0000","last_change":"2024-06-04T16:16:08.663046+0000","last_active":"2024-06-04T16:22:25.041468+0000","last_peered":"2024-06-04T16:22:25.041468+0000","last_clean":"2024-06-04T16:22:25.041468+0000","last_became_active":"2024-06-04T16:16:08.662732+0000","last_became_peered":"2024-06-04T16:16:08.662732+0000","last_unstale":"2024-06-04T16:22:25.041468+0000","last_undegraded":"2024-06-04T16:22:25.041468+0000","last_fullsized":"2024-06-04T16:22:25.041468+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_clean_scrub_stamp":"2024-06-04T16:16:07.631263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.5","version":"254'2","reported_seq":28,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:39.426298+0000","last_change":"2024-06-04T16:09:26.624497+0000","last_active":"2024-06-04T16:22:39.426298+0000","last_peered":"2024-06-04T16:22:39.426298+0000","last_clean":"2024-06-04T16:22:39.426298+0000","last_became_active":"2024-06-04T16:09:26.624142+0000","last_became_peered":"2024-06-04T16:09:26.624142+0000","last_unstale":"2024-06-04T16:22:39.426298+0000","last_undegraded":"2024-06-04T16:22:39.426298+0000","last_fullsized":"2024-06-04T16:22:39.426298+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_clean_scrub_stamp":"2024-06-04T16:09:25.601105+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.6","version":"254'3","reported_seq":44,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:49.001427+0000","last_change":"2024-06-04T16:22:49.001449+0000","last_active":"2024-06-04T16:22:49.001427+0000","last_peered":"2024-06-04T16:22:49.001427+0000","last_clean":"2024-06-04T16:22:49.001427+0000","last_became_active":"2024-06-04T16:09:23.608300+0000","last_became_peered":"2024-06-04T16:09:23.608300+0000","last_unstale":"2024-06-04T16:22:49.001427+0000","last_undegraded":"2024-06-04T16:22:49.001427+0000","last_fullsized":"2024-06-04T16:22:49.001427+0000","mapping_epoch":246,"log_start":"0'0","ondisk_log_start":"0'0","created":246,"last_epoch_clean":247,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'3","last_scrub_stamp":"2024-06-04T16:22:49.001320+0000","last_deep_scrub":"254'3","last_deep_scrub_stamp":"2024-06-04T16:22:49.001320+0000","last_clean_scrub_stamp":"2024-06-04T16:22:49.001320+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T00:45:23.418302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8192,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"64.7","version":"251'16","reported_seq":88,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:48.318184+0000","last_change":"2024-06-04T16:22:48.318225+0000","last_active":"2024-06-04T16:22:48.318184+0000","last_peered":"2024-06-04T16:22:48.318184+0000","last_clean":"2024-06-04T16:22:48.318184+0000","last_became_active":"2024-06-04T16:07:09.511421+0000","last_became_peered":"2024-06-04T16:07:09.511421+0000","last_unstale":"2024-06-04T16:22:48.318184+0000","last_undegraded":"2024-06-04T16:22:48.318184+0000","last_fullsized":"2024-06-04T16:22:48.318184+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":243,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"251'16","last_scrub_stamp":"2024-06-04T16:22:48.318088+0000","last_deep_scrub":"251'16","last_deep_scrub_stamp":"2024-06-04T16:22:48.318088+0000","last_clean_scrub_stamp":"2024-06-04T16:22:48.318088+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T16:27:39.204380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":56,"num_write":28,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.5","version":"0'0","reported_seq":16,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:25.041488+0000","last_change":"2024-06-04T16:16:08.656242+0000","last_active":"2024-06-04T16:22:25.041488+0000","last_peered":"2024-06-04T16:22:25.041488+0000","last_clean":"2024-06-04T16:22:25.041488+0000","last_became_active":"2024-06-04T16:16:08.655913+0000","last_became_peered":"2024-06-04T16:16:08.655913+0000","last_unstale":"2024-06-04T16:22:25.041488+0000","last_undegraded":"2024-06-04T16:22:25.041488+0000","last_fullsized":"2024-06-04T16:22:25.041488+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_clean_scrub_stamp":"2024-06-04T16:16:07.631263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.4","version":"254'2","reported_seq":28,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:39.425172+0000","last_change":"2024-06-04T16:09:26.628240+0000","last_active":"2024-06-04T16:22:39.425172+0000","last_peered":"2024-06-04T16:22:39.425172+0000","last_clean":"2024-06-04T16:22:39.425172+0000","last_became_active":"2024-06-04T16:09:26.627915+0000","last_became_peered":"2024-06-04T16:09:26.627915+0000","last_unstale":"2024-06-04T16:22:39.425172+0000","last_undegraded":"2024-06-04T16:22:39.425172+0000","last_fullsized":"2024-06-04T16:22:39.425172+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_clean_scrub_stamp":"2024-06-04T16:09:25.601105+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.7","version":"251'3","reported_seq":36,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:24.922292+0000","last_change":"2024-06-04T16:09:23.607332+0000","last_active":"2024-06-04T16:22:24.922292+0000","last_peered":"2024-06-04T16:22:24.922292+0000","last_clean":"2024-06-04T16:22:24.922292+0000","last_became_active":"2024-06-04T16:09:23.605516+0000","last_became_peered":"2024-06-04T16:09:23.605516+0000","last_unstale":"2024-06-04T16:22:24.922292+0000","last_undegraded":"2024-06-04T16:22:24.922292+0000","last_fullsized":"2024-06-04T16:22:24.922292+0000","mapping_epoch":246,"log_start":"0'0","ondisk_log_start":"0'0","created":246,"last_epoch_clean":247,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_clean_scrub_stamp":"2024-06-04T16:09:22.572686+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"64.6","version":"251'12","reported_seq":76,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:43.846902+0000","last_change":"2024-06-04T16:22:43.846928+0000","last_active":"2024-06-04T16:22:43.846902+0000","last_peered":"2024-06-04T16:22:43.846902+0000","last_clean":"2024-06-04T16:22:43.846902+0000","last_became_active":"2024-06-04T16:07:09.397805+0000","last_became_peered":"2024-06-04T16:07:09.397805+0000","last_unstale":"2024-06-04T16:22:43.846902+0000","last_undegraded":"2024-06-04T16:22:43.846902+0000","last_fullsized":"2024-06-04T16:22:43.846902+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":243,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"251'12","last_scrub_stamp":"2024-06-04T16:22:43.846809+0000","last_deep_scrub":"251'12","last_deep_scrub_stamp":"2024-06-04T16:22:43.846809+0000","last_clean_scrub_stamp":"2024-06-04T16:22:43.846809+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T03:24:27.327994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":38,"num_write":27,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.6","version":"253'1","reported_seq":17,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:40.034937+0000","last_change":"2024-06-04T16:16:08.656516+0000","last_active":"2024-06-04T16:22:40.034937+0000","last_peered":"2024-06-04T16:22:40.034937+0000","last_clean":"2024-06-04T16:22:40.034937+0000","last_became_active":"2024-06-04T16:16:08.656182+0000","last_became_peered":"2024-06-04T16:16:08.656182+0000","last_unstale":"2024-06-04T16:22:40.034937+0000","last_undegraded":"2024-06-04T16:22:40.034937+0000","last_fullsized":"2024-06-04T16:22:40.034937+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_clean_scrub_stamp":"2024-06-04T16:16:07.631263+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.7","version":"0'0","reported_seq":25,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:30.033686+0000","last_change":"2024-06-04T16:09:26.626653+0000","last_active":"2024-06-04T16:22:30.033686+0000","last_peered":"2024-06-04T16:22:30.033686+0000","last_clean":"2024-06-04T16:22:30.033686+0000","last_became_active":"2024-06-04T16:09:26.625833+0000","last_became_peered":"2024-06-04T16:09:26.625833+0000","last_unstale":"2024-06-04T16:22:30.033686+0000","last_undegraded":"2024-06-04T16:22:30.033686+0000","last_fullsized":"2024-06-04T16:22:30.033686+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_clean_scrub_stamp":"2024-06-04T16:09:25.601105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.4","version":"0'0","reported_seq":39,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:55.080532+0000","last_change":"2024-06-04T16:22:55.080556+0000","last_active":"2024-06-04T16:22:55.080532+0000","last_peered":"2024-06-04T16:22:55.080532+0000","last_clean":"2024-06-04T16:22:55.080532+0000","last_became_active":"2024-06-04T16:09:23.606669+0000","last_became_peered":"2024-06-04T16:09:23.606669+0000","last_unstale":"2024-06-04T16:22:55.080532+0000","last_undegraded":"2024-06-04T16:22:55.080532+0000","last_fullsized":"2024-06-04T16:22:55.080532+0000","mapping_epoch":246,"log_start":"0'0","ondisk_log_start":"0'0","created":246,"last_epoch_clean":247,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:22:55.080426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:22:55.080426+0000","last_clean_scrub_stamp":"2024-06-04T16:22:55.080426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T04:12:00.220771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"64.5","version":"254'31","reported_seq":136,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:46.146644+0000","last_change":"2024-06-04T16:22:46.146668+0000","last_active":"2024-06-04T16:22:46.146644+0000","last_peered":"2024-06-04T16:22:46.146644+0000","last_clean":"2024-06-04T16:22:46.146644+0000","last_became_active":"2024-06-04T16:07:09.403868+0000","last_became_peered":"2024-06-04T16:07:09.403868+0000","last_unstale":"2024-06-04T16:22:46.146644+0000","last_undegraded":"2024-06-04T16:22:46.146644+0000","last_fullsized":"2024-06-04T16:22:46.146644+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":243,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'31","last_scrub_stamp":"2024-06-04T16:22:46.146551+0000","last_deep_scrub":"254'31","last_deep_scrub_stamp":"2024-06-04T16:22:46.146551+0000","last_clean_scrub_stamp":"2024-06-04T16:22:46.146551+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T03:51:35.087658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":170,"num_read_kb":120,"num_write":66,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.7","version":"0'0","reported_seq":16,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:40.027608+0000","last_change":"2024-06-04T16:16:08.661700+0000","last_active":"2024-06-04T16:22:40.027608+0000","last_peered":"2024-06-04T16:22:40.027608+0000","last_clean":"2024-06-04T16:22:40.027608+0000","last_became_active":"2024-06-04T16:16:08.661379+0000","last_became_peered":"2024-06-04T16:16:08.661379+0000","last_unstale":"2024-06-04T16:22:40.027608+0000","last_undegraded":"2024-06-04T16:22:40.027608+0000","last_fullsized":"2024-06-04T16:22:40.027608+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_clean_scrub_stamp":"2024-06-04T16:16:07.631263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.6","version":"0'0","reported_seq":33,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:55.526651+0000","last_change":"2024-06-04T16:22:55.526689+0000","last_active":"2024-06-04T16:22:55.526651+0000","last_peered":"2024-06-04T16:22:55.526651+0000","last_clean":"2024-06-04T16:22:55.526651+0000","last_became_active":"2024-06-04T16:09:26.624074+0000","last_became_peered":"2024-06-04T16:09:26.624074+0000","last_unstale":"2024-06-04T16:22:55.526651+0000","last_undegraded":"2024-06-04T16:22:55.526651+0000","last_fullsized":"2024-06-04T16:22:55.526651+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:22:55.526546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:22:55.526546+0000","last_clean_scrub_stamp":"2024-06-04T16:22:55.526546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T03:18:57.714249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.5","version":"254'4","reported_seq":45,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:48.563049+0000","last_change":"2024-06-04T16:22:48.563077+0000","last_active":"2024-06-04T16:22:48.563049+0000","last_peered":"2024-06-04T16:22:48.563049+0000","last_clean":"2024-06-04T16:22:48.563049+0000","last_became_active":"2024-06-04T16:09:23.604255+0000","last_became_peered":"2024-06-04T16:09:23.604255+0000","last_unstale":"2024-06-04T16:22:48.563049+0000","last_undegraded":"2024-06-04T16:22:48.563049+0000","last_fullsized":"2024-06-04T16:22:48.563049+0000","mapping_epoch":246,"log_start":"0'0","ondisk_log_start":"0'0","created":246,"last_epoch_clean":247,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'4","last_scrub_stamp":"2024-06-04T16:22:48.562953+0000","last_deep_scrub":"254'4","last_deep_scrub_stamp":"2024-06-04T16:22:48.562953+0000","last_clean_scrub_stamp":"2024-06-04T16:22:48.562953+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T18:29:37.864894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":4,"num_write_kb":1026,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"64.4","version":"254'14","reported_seq":85,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:44.859762+0000","last_change":"2024-06-04T16:22:44.859785+0000","last_active":"2024-06-04T16:22:44.859762+0000","last_peered":"2024-06-04T16:22:44.859762+0000","last_clean":"2024-06-04T16:22:44.859762+0000","last_became_active":"2024-06-04T16:07:09.396484+0000","last_became_peered":"2024-06-04T16:07:09.396484+0000","last_unstale":"2024-06-04T16:22:44.859762+0000","last_undegraded":"2024-06-04T16:22:44.859762+0000","last_fullsized":"2024-06-04T16:22:44.859762+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":243,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'14","last_scrub_stamp":"2024-06-04T16:22:44.859685+0000","last_deep_scrub":"254'14","last_deep_scrub_stamp":"2024-06-04T16:22:44.859685+0000","last_clean_scrub_stamp":"2024-06-04T16:22:44.859685+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T22:48:04.782391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":52,"num_write":27,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.0","version":"0'0","reported_seq":16,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:10.031288+0000","last_change":"2024-06-04T16:16:08.661272+0000","last_active":"2024-06-04T16:22:10.031288+0000","last_peered":"2024-06-04T16:22:10.031288+0000","last_clean":"2024-06-04T16:22:10.031288+0000","last_became_active":"2024-06-04T16:16:08.660893+0000","last_became_peered":"2024-06-04T16:16:08.660893+0000","last_unstale":"2024-06-04T16:22:10.031288+0000","last_undegraded":"2024-06-04T16:22:10.031288+0000","last_fullsized":"2024-06-04T16:22:10.031288+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_clean_scrub_stamp":"2024-06-04T16:16:07.631263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1","version":"251'2","reported_seq":29,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:00.030192+0000","last_change":"2024-06-04T16:09:26.623485+0000","last_active":"2024-06-04T16:22:00.030192+0000","last_peered":"2024-06-04T16:22:00.030192+0000","last_clean":"2024-06-04T16:22:00.030192+0000","last_became_active":"2024-06-04T16:09:26.623190+0000","last_became_peered":"2024-06-04T16:09:26.623190+0000","last_unstale":"2024-06-04T16:22:00.030192+0000","last_undegraded":"2024-06-04T16:22:00.030192+0000","last_fullsized":"2024-06-04T16:22:00.030192+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_clean_scrub_stamp":"2024-06-04T16:09:25.601105+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.2","version":"254'6","reported_seq":50,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:02.911920+0000","last_change":"2024-06-04T16:23:02.911961+0000","last_active":"2024-06-04T16:23:02.911920+0000","last_peered":"2024-06-04T16:23:02.911920+0000","last_clean":"2024-06-04T16:23:02.911920+0000","last_became_active":"2024-06-04T16:09:23.610479+0000","last_became_peered":"2024-06-04T16:09:23.610479+0000","last_unstale":"2024-06-04T16:23:02.911920+0000","last_undegraded":"2024-06-04T16:23:02.911920+0000","last_fullsized":"2024-06-04T16:23:02.911920+0000","mapping_epoch":246,"log_start":"0'0","ondisk_log_start":"0'0","created":246,"last_epoch_clean":247,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'6","last_scrub_stamp":"2024-06-04T16:23:02.911818+0000","last_deep_scrub":"254'6","last_deep_scrub_stamp":"2024-06-04T16:23:02.911818+0000","last_clean_scrub_stamp":"2024-06-04T16:23:02.911818+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T20:46:50.376469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5120,"num_write":6,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"64.3","version":"251'23","reported_seq":107,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:47.329783+0000","last_change":"2024-06-04T16:22:47.329808+0000","last_active":"2024-06-04T16:22:47.329783+0000","last_peered":"2024-06-04T16:22:47.329783+0000","last_clean":"2024-06-04T16:22:47.329783+0000","last_became_active":"2024-06-04T16:07:09.512996+0000","last_became_peered":"2024-06-04T16:07:09.512996+0000","last_unstale":"2024-06-04T16:22:47.329783+0000","last_undegraded":"2024-06-04T16:22:47.329783+0000","last_fullsized":"2024-06-04T16:22:47.329783+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":243,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"251'23","last_scrub_stamp":"2024-06-04T16:22:47.329687+0000","last_deep_scrub":"251'23","last_deep_scrub_stamp":"2024-06-04T16:22:47.329687+0000","last_clean_scrub_stamp":"2024-06-04T16:22:47.329687+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T16:28:06.079176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":113,"num_read_kb":81,"num_write":51,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1","version":"0'0","reported_seq":16,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:24.922203+0000","last_change":"2024-06-04T16:16:08.660525+0000","last_active":"2024-06-04T16:22:24.922203+0000","last_peered":"2024-06-04T16:22:24.922203+0000","last_clean":"2024-06-04T16:22:24.922203+0000","last_became_active":"2024-06-04T16:16:08.660177+0000","last_became_peered":"2024-06-04T16:16:08.660177+0000","last_unstale":"2024-06-04T16:22:24.922203+0000","last_undegraded":"2024-06-04T16:22:24.922203+0000","last_fullsized":"2024-06-04T16:22:24.922203+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_clean_scrub_stamp":"2024-06-04T16:16:07.631263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.0","version":"254'2","reported_seq":28,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:39.526943+0000","last_change":"2024-06-04T16:09:26.626867+0000","last_active":"2024-06-04T16:22:39.526943+0000","last_peered":"2024-06-04T16:22:39.526943+0000","last_clean":"2024-06-04T16:22:39.526943+0000","last_became_active":"2024-06-04T16:09:26.626576+0000","last_became_peered":"2024-06-04T16:09:26.626576+0000","last_unstale":"2024-06-04T16:22:39.526943+0000","last_undegraded":"2024-06-04T16:22:39.526943+0000","last_fullsized":"2024-06-04T16:22:39.526943+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_clean_scrub_stamp":"2024-06-04T16:09:25.601105+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.3","version":"254'2","reported_seq":42,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:46.486358+0000","last_change":"2024-06-04T16:22:46.486379+0000","last_active":"2024-06-04T16:22:46.486358+0000","last_peered":"2024-06-04T16:22:46.486358+0000","last_clean":"2024-06-04T16:22:46.486358+0000","last_became_active":"2024-06-04T16:09:23.604413+0000","last_became_peered":"2024-06-04T16:09:23.604413+0000","last_unstale":"2024-06-04T16:22:46.486358+0000","last_undegraded":"2024-06-04T16:22:46.486358+0000","last_fullsized":"2024-06-04T16:22:46.486358+0000","mapping_epoch":246,"log_start":"0'0","ondisk_log_start":"0'0","created":246,"last_epoch_clean":247,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'2","last_scrub_stamp":"2024-06-04T16:22:46.486286+0000","last_deep_scrub":"254'2","last_deep_scrub_stamp":"2024-06-04T16:22:46.486286+0000","last_clean_scrub_stamp":"2024-06-04T16:22:46.486286+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T03:08:45.620913+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"64.2","version":"254'2","reported_seq":52,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:47.896868+0000","last_change":"2024-06-04T16:22:47.896908+0000","last_active":"2024-06-04T16:22:47.896868+0000","last_peered":"2024-06-04T16:22:47.896868+0000","last_clean":"2024-06-04T16:22:47.896868+0000","last_became_active":"2024-06-04T16:07:09.401796+0000","last_became_peered":"2024-06-04T16:07:09.401796+0000","last_unstale":"2024-06-04T16:22:47.896868+0000","last_undegraded":"2024-06-04T16:22:47.896868+0000","last_fullsized":"2024-06-04T16:22:47.896868+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":243,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'2","last_scrub_stamp":"2024-06-04T16:22:47.896756+0000","last_deep_scrub":"254'2","last_deep_scrub_stamp":"2024-06-04T16:22:47.896756+0000","last_clean_scrub_stamp":"2024-06-04T16:22:47.896756+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T03:55:14.174846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":7,"num_write":11,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.2","version":"0'0","reported_seq":16,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:25.028323+0000","last_change":"2024-06-04T16:16:08.656504+0000","last_active":"2024-06-04T16:22:25.028323+0000","last_peered":"2024-06-04T16:22:25.028323+0000","last_clean":"2024-06-04T16:22:25.028323+0000","last_became_active":"2024-06-04T16:16:08.656245+0000","last_became_peered":"2024-06-04T16:16:08.656245+0000","last_unstale":"2024-06-04T16:22:25.028323+0000","last_undegraded":"2024-06-04T16:22:25.028323+0000","last_fullsized":"2024-06-04T16:22:25.028323+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_clean_scrub_stamp":"2024-06-04T16:16:07.631263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.3","version":"254'4","reported_seq":32,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:39.426329+0000","last_change":"2024-06-04T16:09:26.627525+0000","last_active":"2024-06-04T16:22:39.426329+0000","last_peered":"2024-06-04T16:22:39.426329+0000","last_clean":"2024-06-04T16:22:39.426329+0000","last_became_active":"2024-06-04T16:09:26.627193+0000","last_became_peered":"2024-06-04T16:09:26.627193+0000","last_unstale":"2024-06-04T16:22:39.426329+0000","last_undegraded":"2024-06-04T16:22:39.426329+0000","last_fullsized":"2024-06-04T16:22:39.426329+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_clean_scrub_stamp":"2024-06-04T16:09:25.601105+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":6144,"num_write":4,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.0","version":"254'2","reported_seq":42,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:45.465763+0000","last_change":"2024-06-04T16:22:45.465785+0000","last_active":"2024-06-04T16:22:45.465763+0000","last_peered":"2024-06-04T16:22:45.465763+0000","last_clean":"2024-06-04T16:22:45.465763+0000","last_became_active":"2024-06-04T16:09:23.605145+0000","last_became_peered":"2024-06-04T16:09:23.605145+0000","last_unstale":"2024-06-04T16:22:45.465763+0000","last_undegraded":"2024-06-04T16:22:45.465763+0000","last_fullsized":"2024-06-04T16:22:45.465763+0000","mapping_epoch":246,"log_start":"0'0","ondisk_log_start":"0'0","created":246,"last_epoch_clean":247,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'2","last_scrub_stamp":"2024-06-04T16:22:45.465690+0000","last_deep_scrub":"254'2","last_deep_scrub_stamp":"2024-06-04T16:22:45.465690+0000","last_clean_scrub_stamp":"2024-06-04T16:22:45.465690+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T23:45:13.033536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"64.1","version":"245'23","reported_seq":112,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:48.104188+0000","last_change":"2024-06-04T16:22:48.104216+0000","last_active":"2024-06-04T16:22:48.104188+0000","last_peered":"2024-06-04T16:22:48.104188+0000","last_clean":"2024-06-04T16:22:48.104188+0000","last_became_active":"2024-06-04T16:07:09.405086+0000","last_became_peered":"2024-06-04T16:07:09.405086+0000","last_unstale":"2024-06-04T16:22:48.104188+0000","last_undegraded":"2024-06-04T16:22:48.104188+0000","last_fullsized":"2024-06-04T16:22:48.104188+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":243,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"245'23","last_scrub_stamp":"2024-06-04T16:22:48.104090+0000","last_deep_scrub":"245'23","last_deep_scrub_stamp":"2024-06-04T16:22:48.104090+0000","last_clean_scrub_stamp":"2024-06-04T16:22:48.104090+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T22:36:27.428584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":130,"num_read_kb":96,"num_write":31,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.3","version":"0'0","reported_seq":16,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:25.028356+0000","last_change":"2024-06-04T16:16:08.661478+0000","last_active":"2024-06-04T16:22:25.028356+0000","last_peered":"2024-06-04T16:22:25.028356+0000","last_clean":"2024-06-04T16:22:25.028356+0000","last_became_active":"2024-06-04T16:16:08.661111+0000","last_became_peered":"2024-06-04T16:16:08.661111+0000","last_unstale":"2024-06-04T16:22:25.028356+0000","last_undegraded":"2024-06-04T16:22:25.028356+0000","last_fullsized":"2024-06-04T16:22:25.028356+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_clean_scrub_stamp":"2024-06-04T16:16:07.631263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.2","version":"254'2","reported_seq":29,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:39.410018+0000","last_change":"2024-06-04T16:09:26.625154+0000","last_active":"2024-06-04T16:22:39.410018+0000","last_peered":"2024-06-04T16:22:39.410018+0000","last_clean":"2024-06-04T16:22:39.410018+0000","last_became_active":"2024-06-04T16:09:26.624890+0000","last_became_peered":"2024-06-04T16:09:26.624890+0000","last_unstale":"2024-06-04T16:22:39.410018+0000","last_undegraded":"2024-06-04T16:22:39.410018+0000","last_fullsized":"2024-06-04T16:22:39.410018+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_clean_scrub_stamp":"2024-06-04T16:09:25.601105+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8192,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.1","version":"254'11","reported_seq":62,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:54.943147+0000","last_change":"2024-06-04T16:22:54.943177+0000","last_active":"2024-06-04T16:22:54.943147+0000","last_peered":"2024-06-04T16:22:54.943147+0000","last_clean":"2024-06-04T16:22:54.943147+0000","last_became_active":"2024-06-04T16:09:23.609072+0000","last_became_peered":"2024-06-04T16:09:23.609072+0000","last_unstale":"2024-06-04T16:22:54.943147+0000","last_undegraded":"2024-06-04T16:22:54.943147+0000","last_fullsized":"2024-06-04T16:22:54.943147+0000","mapping_epoch":246,"log_start":"0'0","ondisk_log_start":"0'0","created":246,"last_epoch_clean":247,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'11","last_scrub_stamp":"2024-06-04T16:22:54.943049+0000","last_deep_scrub":"254'11","last_deep_scrub_stamp":"2024-06-04T16:22:54.943049+0000","last_clean_scrub_stamp":"2024-06-04T16:22:54.943049+0000","objects_scrubbed":1,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T18:38:55.646525+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":15362,"num_write":9,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"64.0","version":"254'11","reported_seq":76,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:01.039448+0000","last_change":"2024-06-04T16:23:01.039472+0000","last_active":"2024-06-04T16:23:01.039448+0000","last_peered":"2024-06-04T16:23:01.039448+0000","last_clean":"2024-06-04T16:23:01.039448+0000","last_became_active":"2024-06-04T16:07:09.405109+0000","last_became_peered":"2024-06-04T16:07:09.405109+0000","last_unstale":"2024-06-04T16:23:01.039448+0000","last_undegraded":"2024-06-04T16:23:01.039448+0000","last_fullsized":"2024-06-04T16:23:01.039448+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":243,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'11","last_scrub_stamp":"2024-06-04T16:23:01.039356+0000","last_deep_scrub":"254'11","last_deep_scrub_stamp":"2024-06-04T16:23:01.039356+0000","last_clean_scrub_stamp":"2024-06-04T16:23:01.039356+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T20:47:01.766277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":37,"num_write":22,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"251'58","reported_seq":576,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:02.739712+0000","last_change":"2024-06-04T16:23:02.739753+0000","last_active":"2024-06-04T16:23:02.739712+0000","last_peered":"2024-06-04T16:23:02.739712+0000","last_clean":"2024-06-04T16:23:02.739712+0000","last_became_active":"2024-06-04T15:52:36.496345+0000","last_became_peered":"2024-06-04T15:52:36.496345+0000","last_unstale":"2024-06-04T16:23:02.739712+0000","last_undegraded":"2024-06-04T16:23:02.739712+0000","last_fullsized":"2024-06-04T16:23:02.739712+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"251'58","last_scrub_stamp":"2024-06-04T16:23:02.739604+0000","last_deep_scrub":"251'58","last_deep_scrub_stamp":"2024-06-04T16:23:02.739604+0000","last_clean_scrub_stamp":"2024-06-04T16:23:02.739604+0000","objects_scrubbed":2,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T22:51:46.895844+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":73,"num_read_kb":10950,"num_write":187,"num_write_kb":28882,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"254'156","reported_seq":896,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:01.232920+0000","last_change":"2024-06-04T16:23:01.232957+0000","last_active":"2024-06-04T16:23:01.232920+0000","last_peered":"2024-06-04T16:23:01.232920+0000","last_clean":"2024-06-04T16:23:01.232920+0000","last_became_active":"2024-06-04T15:52:38.485491+0000","last_became_peered":"2024-06-04T15:52:38.485491+0000","last_unstale":"2024-06-04T16:23:01.232920+0000","last_undegraded":"2024-06-04T16:23:01.232920+0000","last_fullsized":"2024-06-04T16:23:01.232920+0000","mapping_epoch":23,"log_start":"251'100","ondisk_log_start":"251'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'156","last_scrub_stamp":"2024-06-04T16:23:01.232829+0000","last_deep_scrub":"254'156","last_deep_scrub_stamp":"2024-06-04T16:23:01.232829+0000","last_clean_scrub_stamp":"2024-06-04T16:23:01.232829+0000","objects_scrubbed":1,"log_size":56,"log_dups_size":100,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T00:53:06.796590+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":710,"num_read_kb":632,"num_write":201,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"251'45","reported_seq":566,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:21:50.036815+0000","last_change":"2024-06-04T15:52:36.484644+0000","last_active":"2024-06-04T16:21:50.036815+0000","last_peered":"2024-06-04T16:21:50.036815+0000","last_clean":"2024-06-04T16:21:50.036815+0000","last_became_active":"2024-06-04T15:52:36.484223+0000","last_became_peered":"2024-06-04T15:52:36.484223+0000","last_unstale":"2024-06-04T16:21:50.036815+0000","last_undegraded":"2024-06-04T16:21:50.036815+0000","last_fullsized":"2024-06-04T16:21:50.036815+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1311028,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":90,"num_read_kb":9967,"num_write":210,"num_write_kb":17365,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,0],"acting":[5,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.39","version":"254'108","reported_seq":858,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:40.034837+0000","last_change":"2024-06-04T15:52:38.482297+0000","last_active":"2024-06-04T16:22:40.034837+0000","last_peered":"2024-06-04T16:22:40.034837+0000","last_clean":"2024-06-04T16:22:40.034837+0000","last_became_active":"2024-06-04T15:52:38.482000+0000","last_became_peered":"2024-06-04T15:52:38.482000+0000","last_unstale":"2024-06-04T16:22:40.034837+0000","last_undegraded":"2024-06-04T16:22:40.034837+0000","last_fullsized":"2024-06-04T16:22:40.034837+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":584,"num_read_kb":552,"num_write":123,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"254'42","reported_seq":539,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:21:50.036782+0000","last_change":"2024-06-04T15:52:36.480336+0000","last_active":"2024-06-04T16:21:50.036782+0000","last_peered":"2024-06-04T16:21:50.036782+0000","last_clean":"2024-06-04T16:21:50.036782+0000","last_became_active":"2024-06-04T15:52:36.479881+0000","last_became_peered":"2024-06-04T15:52:36.479881+0000","last_unstale":"2024-06-04T16:21:50.036782+0000","last_undegraded":"2024-06-04T16:21:50.036782+0000","last_fullsized":"2024-06-04T16:21:50.036782+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":40,"num_read_kb":31,"num_write":168,"num_write_kb":16512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3a","version":"254'106","reported_seq":817,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:40.034874+0000","last_change":"2024-06-04T15:52:38.483661+0000","last_active":"2024-06-04T16:22:40.034874+0000","last_peered":"2024-06-04T16:22:40.034874+0000","last_clean":"2024-06-04T16:22:40.034874+0000","last_became_active":"2024-06-04T15:52:38.483240+0000","last_became_peered":"2024-06-04T15:52:38.483240+0000","last_unstale":"2024-06-04T16:22:40.034874+0000","last_undegraded":"2024-06-04T16:22:40.034874+0000","last_fullsized":"2024-06-04T16:22:40.034874+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":515,"num_read_kb":482,"num_write":131,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"254'78","reported_seq":582,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:44.606300+0000","last_change":"2024-06-04T15:52:36.478336+0000","last_active":"2024-06-04T16:22:44.606300+0000","last_peered":"2024-06-04T16:22:44.606300+0000","last_clean":"2024-06-04T16:22:44.606300+0000","last_became_active":"2024-06-04T15:52:36.476981+0000","last_became_peered":"2024-06-04T15:52:36.476981+0000","last_unstale":"2024-06-04T16:22:44.606300+0000","last_undegraded":"2024-06-04T16:22:44.606300+0000","last_fullsized":"2024-06-04T16:22:44.606300+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":3145,"num_write":255,"num_write_kb":33835,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"254'148","reported_seq":1036,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:39.924652+0000","last_change":"2024-06-04T15:52:38.481259+0000","last_active":"2024-06-04T16:22:39.924652+0000","last_peered":"2024-06-04T16:22:39.924652+0000","last_clean":"2024-06-04T16:22:39.924652+0000","last_became_active":"2024-06-04T15:52:38.480986+0000","last_became_peered":"2024-06-04T15:52:38.480986+0000","last_unstale":"2024-06-04T16:22:39.924652+0000","last_undegraded":"2024-06-04T16:22:39.924652+0000","last_fullsized":"2024-06-04T16:22:39.924652+0000","mapping_epoch":23,"log_start":"251'100","ondisk_log_start":"251'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":100,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1072,"num_read_kb":1014,"num_write":195,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"251'46","reported_seq":557,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:40.027562+0000","last_change":"2024-06-04T15:52:36.495855+0000","last_active":"2024-06-04T16:22:40.027562+0000","last_peered":"2024-06-04T16:22:40.027562+0000","last_clean":"2024-06-04T16:22:40.027562+0000","last_became_active":"2024-06-04T15:52:36.495401+0000","last_became_peered":"2024-06-04T15:52:36.495401+0000","last_unstale":"2024-06-04T16:22:40.027562+0000","last_undegraded":"2024-06-04T16:22:40.027562+0000","last_fullsized":"2024-06-04T16:22:40.027562+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":89,"num_read_kb":6218,"num_write":199,"num_write_kb":11815,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"254'159","reported_seq":1096,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:58.807663+0000","last_change":"2024-06-04T16:22:58.807693+0000","last_active":"2024-06-04T16:22:58.807663+0000","last_peered":"2024-06-04T16:22:58.807663+0000","last_clean":"2024-06-04T16:22:58.807663+0000","last_became_active":"2024-06-04T15:52:38.484828+0000","last_became_peered":"2024-06-04T15:52:38.484828+0000","last_unstale":"2024-06-04T16:22:58.807663+0000","last_undegraded":"2024-06-04T16:22:58.807663+0000","last_fullsized":"2024-06-04T16:22:58.807663+0000","mapping_epoch":23,"log_start":"251'100","ondisk_log_start":"251'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'159","last_scrub_stamp":"2024-06-04T16:22:58.807558+0000","last_deep_scrub":"254'159","last_deep_scrub_stamp":"2024-06-04T16:22:58.807558+0000","last_clean_scrub_stamp":"2024-06-04T16:22:58.807558+0000","objects_scrubbed":2,"log_size":59,"log_dups_size":100,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T21:15:10.613499+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1071,"num_read_kb":1008,"num_write":198,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2864,"num_omap_keys":12,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"254'61","reported_seq":571,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:40.030194+0000","last_change":"2024-06-04T15:52:36.478124+0000","last_active":"2024-06-04T16:22:40.030194+0000","last_peered":"2024-06-04T16:22:40.030194+0000","last_clean":"2024-06-04T16:22:40.030194+0000","last_became_active":"2024-06-04T15:52:36.476167+0000","last_became_peered":"2024-06-04T15:52:36.476167+0000","last_unstale":"2024-06-04T16:22:40.030194+0000","last_undegraded":"2024-06-04T16:22:40.030194+0000","last_fullsized":"2024-06-04T16:22:40.030194+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":87,"num_read_kb":1095,"num_write":236,"num_write_kb":40818,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,7],"acting":[2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"254'99","reported_seq":820,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:00.757093+0000","last_change":"2024-06-04T16:23:00.757161+0000","last_active":"2024-06-04T16:23:00.757093+0000","last_peered":"2024-06-04T16:23:00.757093+0000","last_clean":"2024-06-04T16:23:00.757093+0000","last_became_active":"2024-06-04T15:52:38.482025+0000","last_became_peered":"2024-06-04T15:52:38.482025+0000","last_unstale":"2024-06-04T16:23:00.757093+0000","last_undegraded":"2024-06-04T16:23:00.757093+0000","last_fullsized":"2024-06-04T16:23:00.757093+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'99","last_scrub_stamp":"2024-06-04T16:23:00.756985+0000","last_deep_scrub":"254'99","last_deep_scrub_stamp":"2024-06-04T16:23:00.756985+0000","last_clean_scrub_stamp":"2024-06-04T16:23:00.756985+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T03:26:31.902180+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":511,"num_read_kb":478,"num_write":121,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.39","version":"251'54","reported_seq":550,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:40.027498+0000","last_change":"2024-06-04T15:52:36.493350+0000","last_active":"2024-06-04T16:22:40.027498+0000","last_peered":"2024-06-04T16:22:40.027498+0000","last_clean":"2024-06-04T16:22:40.027498+0000","last_became_active":"2024-06-04T15:52:36.493029+0000","last_became_peered":"2024-06-04T15:52:36.493029+0000","last_unstale":"2024-06-04T16:22:40.027498+0000","last_undegraded":"2024-06-04T16:22:40.027498+0000","last_fullsized":"2024-06-04T16:22:40.027498+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194343,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":48,"num_read_kb":7228,"num_write":201,"num_write_kb":32271,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,1],"acting":[0,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"254'138","reported_seq":1109,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:04.451889+0000","last_change":"2024-06-04T16:23:04.451925+0000","last_active":"2024-06-04T16:23:04.451889+0000","last_peered":"2024-06-04T16:23:04.451889+0000","last_clean":"2024-06-04T16:23:04.451889+0000","last_became_active":"2024-06-04T15:52:38.481269+0000","last_became_peered":"2024-06-04T15:52:38.481269+0000","last_unstale":"2024-06-04T16:23:04.451889+0000","last_undegraded":"2024-06-04T16:23:04.451889+0000","last_fullsized":"2024-06-04T16:23:04.451889+0000","mapping_epoch":23,"log_start":"251'100","ondisk_log_start":"251'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'138","last_scrub_stamp":"2024-06-04T16:23:04.451799+0000","last_deep_scrub":"254'138","last_deep_scrub_stamp":"2024-06-04T16:23:04.451799+0000","last_clean_scrub_stamp":"2024-06-04T16:23:04.451799+0000","objects_scrubbed":3,"log_size":38,"log_dups_size":100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T18:57:32.595376+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":974,"num_read_kb":946,"num_write":155,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1528,"num_omap_keys":6,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"254'71","reported_seq":659,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:40.043457+0000","last_change":"2024-06-04T15:52:36.494149+0000","last_active":"2024-06-04T16:22:40.043457+0000","last_peered":"2024-06-04T16:22:40.043457+0000","last_clean":"2024-06-04T16:22:40.043457+0000","last_became_active":"2024-06-04T15:52:36.493867+0000","last_became_peered":"2024-06-04T15:52:36.493867+0000","last_unstale":"2024-06-04T16:22:40.043457+0000","last_undegraded":"2024-06-04T16:22:40.043457+0000","last_fullsized":"2024-06-04T16:22:40.043457+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194320,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":320,"num_read_kb":135435,"num_write":258,"num_write_kb":39309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3],"acting":[5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3f","version":"254'142","reported_seq":981,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:21:50.036908+0000","last_change":"2024-06-04T15:52:38.487423+0000","last_active":"2024-06-04T16:21:50.036908+0000","last_peered":"2024-06-04T16:21:50.036908+0000","last_clean":"2024-06-04T16:21:50.036908+0000","last_became_active":"2024-06-04T15:52:38.486625+0000","last_became_peered":"2024-06-04T15:52:38.486625+0000","last_unstale":"2024-06-04T16:21:50.036908+0000","last_undegraded":"2024-06-04T16:21:50.036908+0000","last_fullsized":"2024-06-04T16:21:50.036908+0000","mapping_epoch":23,"log_start":"251'100","ondisk_log_start":"251'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":899,"num_read_kb":839,"num_write":184,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.30","version":"254'110","reported_seq":838,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:45.077058+0000","last_change":"2024-06-04T15:52:38.479433+0000","last_active":"2024-06-04T16:22:45.077058+0000","last_peered":"2024-06-04T16:22:45.077058+0000","last_clean":"2024-06-04T16:22:45.077058+0000","last_became_active":"2024-06-04T15:52:38.479148+0000","last_became_peered":"2024-06-04T15:52:38.479148+0000","last_unstale":"2024-06-04T16:22:45.077058+0000","last_undegraded":"2024-06-04T16:22:45.077058+0000","last_fullsized":"2024-06-04T16:22:45.077058+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":546,"num_read_kb":515,"num_write":127,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"251'65","reported_seq":590,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:21:40.132752+0000","last_change":"2024-06-04T15:52:36.493388+0000","last_active":"2024-06-04T16:21:40.132752+0000","last_peered":"2024-06-04T16:21:40.132752+0000","last_clean":"2024-06-04T16:21:40.132752+0000","last_became_active":"2024-06-04T15:52:36.493062+0000","last_became_peered":"2024-06-04T15:52:36.493062+0000","last_unstale":"2024-06-04T16:21:40.132752+0000","last_undegraded":"2024-06-04T16:21:40.132752+0000","last_fullsized":"2024-06-04T16:21:40.132752+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194345,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":95,"num_read_kb":64250,"num_write":262,"num_write_kb":45332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,5],"acting":[1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"254'69","reported_seq":746,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:56.821291+0000","last_change":"2024-06-04T16:22:56.821291+0000","last_active":"2024-06-04T16:22:56.821291+0000","last_peered":"2024-06-04T16:22:56.821291+0000","last_clean":"2024-06-04T16:22:56.821291+0000","last_became_active":"2024-06-04T15:52:38.486413+0000","last_became_peered":"2024-06-04T15:52:38.486413+0000","last_unstale":"2024-06-04T16:22:56.821291+0000","last_undegraded":"2024-06-04T16:22:56.821291+0000","last_fullsized":"2024-06-04T16:22:56.821291+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'69","last_scrub_stamp":"2024-06-04T16:22:56.821156+0000","last_deep_scrub":"254'69","last_deep_scrub_stamp":"2024-06-04T16:22:56.821156+0000","last_clean_scrub_stamp":"2024-06-04T16:22:56.821156+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T21:44:44.801551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":395,"num_read_kb":379,"num_write":76,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"251'60","reported_seq":571,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:21:40.021487+0000","last_change":"2024-06-04T15:52:36.494165+0000","last_active":"2024-06-04T16:21:40.021487+0000","last_peered":"2024-06-04T16:21:40.021487+0000","last_clean":"2024-06-04T16:21:40.021487+0000","last_became_active":"2024-06-04T15:52:36.493235+0000","last_became_peered":"2024-06-04T15:52:36.493235+0000","last_unstale":"2024-06-04T16:21:40.021487+0000","last_undegraded":"2024-06-04T16:21:40.021487+0000","last_fullsized":"2024-06-04T16:21:40.021487+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5327983,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":73,"num_read_kb":3706,"num_write":207,"num_write_kb":43313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"254'95","reported_seq":811,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:44.133332+0000","last_change":"2024-06-04T15:52:38.482371+0000","last_active":"2024-06-04T16:22:44.133332+0000","last_peered":"2024-06-04T16:22:44.133332+0000","last_clean":"2024-06-04T16:22:44.133332+0000","last_became_active":"2024-06-04T15:52:38.482120+0000","last_became_peered":"2024-06-04T15:52:38.482120+0000","last_unstale":"2024-06-04T16:22:44.133332+0000","last_undegraded":"2024-06-04T16:22:44.133332+0000","last_fullsized":"2024-06-04T16:22:44.133332+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":518,"num_read_kb":488,"num_write":107,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"251'41","reported_seq":565,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:45.894526+0000","last_change":"2024-06-04T16:22:45.894598+0000","last_active":"2024-06-04T16:22:45.894526+0000","last_peered":"2024-06-04T16:22:45.894526+0000","last_clean":"2024-06-04T16:22:45.894526+0000","last_became_active":"2024-06-04T15:53:14.839433+0000","last_became_peered":"2024-06-04T15:53:14.839433+0000","last_unstale":"2024-06-04T16:22:45.894526+0000","last_undegraded":"2024-06-04T16:22:45.894526+0000","last_fullsized":"2024-06-04T16:22:45.894526+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"251'41","last_scrub_stamp":"2024-06-04T16:22:45.894408+0000","last_deep_scrub":"251'41","last_deep_scrub_stamp":"2024-06-04T16:22:45.894408+0000","last_clean_scrub_stamp":"2024-06-04T16:22:45.894408+0000","objects_scrubbed":4,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T17:54:53.919284+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3420297,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":73,"num_read_kb":2132,"num_write":160,"num_write_kb":20015,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"254'143","reported_seq":932,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:21:40.034508+0000","last_change":"2024-06-04T15:52:38.482165+0000","last_active":"2024-06-04T16:21:40.034508+0000","last_peered":"2024-06-04T16:21:40.034508+0000","last_clean":"2024-06-04T16:21:40.034508+0000","last_became_active":"2024-06-04T15:52:38.480996+0000","last_became_peered":"2024-06-04T15:52:38.480996+0000","last_unstale":"2024-06-04T16:21:40.034508+0000","last_undegraded":"2024-06-04T16:21:40.034508+0000","last_fullsized":"2024-06-04T16:21:40.034508+0000","mapping_epoch":23,"log_start":"251'100","ondisk_log_start":"251'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":100,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":760,"num_read_kb":703,"num_write":184,"num_write_kb":47,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"251'68","reported_seq":579,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:21:40.021428+0000","last_change":"2024-06-04T15:52:36.488619+0000","last_active":"2024-06-04T16:21:40.021428+0000","last_peered":"2024-06-04T16:21:40.021428+0000","last_clean":"2024-06-04T16:21:40.021428+0000","last_became_active":"2024-06-04T15:52:36.486264+0000","last_became_peered":"2024-06-04T15:52:36.486264+0000","last_unstale":"2024-06-04T16:21:40.021428+0000","last_undegraded":"2024-06-04T16:21:40.021428+0000","last_fullsized":"2024-06-04T16:21:40.021428+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5328001,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":104,"num_read_kb":2209,"num_write":245,"num_write_kb":31585,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,7],"acting":[0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"254'109","reported_seq":991,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:21:40.035406+0000","last_change":"2024-06-04T15:52:38.488655+0000","last_active":"2024-06-04T16:21:40.035406+0000","last_peered":"2024-06-04T16:21:40.035406+0000","last_clean":"2024-06-04T16:21:40.035406+0000","last_became_active":"2024-06-04T15:52:38.488389+0000","last_became_peered":"2024-06-04T15:52:38.488389+0000","last_unstale":"2024-06-04T16:21:40.035406+0000","last_undegraded":"2024-06-04T16:21:40.035406+0000","last_fullsized":"2024-06-04T16:21:40.035406+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":949,"num_read_kb":919,"num_write":126,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.33","version":"254'50","reported_seq":552,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:39.442895+0000","last_change":"2024-06-04T15:52:36.498842+0000","last_active":"2024-06-04T16:22:39.442895+0000","last_peered":"2024-06-04T16:22:39.442895+0000","last_clean":"2024-06-04T16:22:39.442895+0000","last_became_active":"2024-06-04T15:52:36.498488+0000","last_became_peered":"2024-06-04T15:52:36.498488+0000","last_unstale":"2024-06-04T16:22:39.442895+0000","last_undegraded":"2024-06-04T16:22:39.442895+0000","last_fullsized":"2024-06-04T16:22:39.442895+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6461610,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":71,"num_read_kb":20343,"num_write":207,"num_write_kb":26780,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,4],"acting":[6,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.35","version":"254'139","reported_seq":935,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:59.197888+0000","last_change":"2024-06-04T16:22:59.197913+0000","last_active":"2024-06-04T16:22:59.197888+0000","last_peered":"2024-06-04T16:22:59.197888+0000","last_clean":"2024-06-04T16:22:59.197888+0000","last_became_active":"2024-06-04T15:52:38.486108+0000","last_became_peered":"2024-06-04T15:52:38.486108+0000","last_unstale":"2024-06-04T16:22:59.197888+0000","last_undegraded":"2024-06-04T16:22:59.197888+0000","last_fullsized":"2024-06-04T16:22:59.197888+0000","mapping_epoch":23,"log_start":"251'100","ondisk_log_start":"251'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'139","last_scrub_stamp":"2024-06-04T16:22:59.197784+0000","last_deep_scrub":"254'139","last_deep_scrub_stamp":"2024-06-04T16:22:59.197784+0000","last_clean_scrub_stamp":"2024-06-04T16:22:59.197784+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":100,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T19:34:23.692307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":692,"num_read_kb":648,"num_write":164,"num_write_kb":35,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"254'36","reported_seq":528,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:46.496488+0000","last_change":"2024-06-04T15:52:36.481363+0000","last_active":"2024-06-04T16:22:46.496488+0000","last_peered":"2024-06-04T16:22:46.496488+0000","last_clean":"2024-06-04T16:22:46.496488+0000","last_became_active":"2024-06-04T15:52:36.481047+0000","last_became_peered":"2024-06-04T15:52:36.481047+0000","last_unstale":"2024-06-04T16:22:46.496488+0000","last_undegraded":"2024-06-04T16:22:46.496488+0000","last_fullsized":"2024-06-04T16:22:46.496488+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":42,"num_read_kb":41,"num_write":149,"num_write_kb":21263,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4],"acting":[6,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.18","version":"254'36","reported_seq":527,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:48.897593+0000","last_change":"2024-06-04T16:22:48.897620+0000","last_active":"2024-06-04T16:22:48.897593+0000","last_peered":"2024-06-04T16:22:48.897593+0000","last_clean":"2024-06-04T16:22:48.897593+0000","last_became_active":"2024-06-04T15:52:46.536608+0000","last_became_peered":"2024-06-04T15:52:46.536608+0000","last_unstale":"2024-06-04T16:22:48.897593+0000","last_undegraded":"2024-06-04T16:22:48.897593+0000","last_fullsized":"2024-06-04T16:22:48.897593+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'36","last_scrub_stamp":"2024-06-04T16:22:48.897499+0000","last_deep_scrub":"254'36","last_deep_scrub_stamp":"2024-06-04T16:22:48.897499+0000","last_clean_scrub_stamp":"2024-06-04T16:22:48.897499+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T20:02:47.722917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":81,"num_read_kb":72,"num_write":87,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"254'110","reported_seq":833,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:46.496662+0000","last_change":"2024-06-04T15:52:38.477338+0000","last_active":"2024-06-04T16:22:46.496662+0000","last_peered":"2024-06-04T16:22:46.496662+0000","last_clean":"2024-06-04T16:22:46.496662+0000","last_became_active":"2024-06-04T15:52:38.477052+0000","last_became_peered":"2024-06-04T15:52:38.477052+0000","last_unstale":"2024-06-04T16:22:46.496662+0000","last_undegraded":"2024-06-04T16:22:46.496662+0000","last_fullsized":"2024-06-04T16:22:46.496662+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":560,"num_read_kb":523,"num_write":129,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.13","version":"254'52","reported_seq":555,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:45.076839+0000","last_change":"2024-06-04T15:52:36.499588+0000","last_active":"2024-06-04T16:22:45.076839+0000","last_peered":"2024-06-04T16:22:45.076839+0000","last_clean":"2024-06-04T16:22:45.076839+0000","last_became_active":"2024-06-04T15:52:36.499305+0000","last_became_peered":"2024-06-04T15:52:36.499305+0000","last_unstale":"2024-06-04T16:22:45.076839+0000","last_undegraded":"2024-06-04T16:22:45.076839+0000","last_fullsized":"2024-06-04T16:22:45.076839+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194320,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":75,"num_read_kb":3024,"num_write":196,"num_write_kb":28071,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":474,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:21:40.027937+0000","last_change":"2024-06-04T15:52:40.477030+0000","last_active":"2024-06-04T16:21:40.027937+0000","last_peered":"2024-06-04T16:21:40.027937+0000","last_clean":"2024-06-04T16:21:40.027937+0000","last_became_active":"2024-06-04T15:52:40.476730+0000","last_became_peered":"2024-06-04T15:52:40.476730+0000","last_unstale":"2024-06-04T16:21:40.027937+0000","last_undegraded":"2024-06-04T16:21:40.027937+0000","last_fullsized":"2024-06-04T16:21:40.027937+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_clean_scrub_stamp":"2024-06-04T15:52:39.463103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"254'147","reported_seq":727,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:58.046557+0000","last_change":"2024-06-04T16:22:58.046593+0000","last_active":"2024-06-04T16:22:58.046557+0000","last_peered":"2024-06-04T16:22:58.046557+0000","last_clean":"2024-06-04T16:22:58.046557+0000","last_became_active":"2024-06-04T15:52:42.503184+0000","last_became_peered":"2024-06-04T15:52:42.503184+0000","last_unstale":"2024-06-04T16:22:58.046557+0000","last_undegraded":"2024-06-04T16:22:58.046557+0000","last_fullsized":"2024-06-04T16:22:58.046557+0000","mapping_epoch":27,"log_start":"251'100","ondisk_log_start":"251'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'147","last_scrub_stamp":"2024-06-04T16:22:58.046476+0000","last_deep_scrub":"254'147","last_deep_scrub_stamp":"2024-06-04T16:22:58.046476+0000","last_clean_scrub_stamp":"2024-06-04T16:22:58.046476+0000","objects_scrubbed":4,"log_size":47,"log_dups_size":100,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T21:24:37.226246+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":210,"num_read_kb":210,"num_write":112,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":469,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:21:45.133278+0000","last_change":"2024-06-04T15:52:44.513719+0000","last_active":"2024-06-04T16:21:45.133278+0000","last_peered":"2024-06-04T16:21:45.133278+0000","last_clean":"2024-06-04T16:21:45.133278+0000","last_became_active":"2024-06-04T15:52:44.513442+0000","last_became_peered":"2024-06-04T15:52:44.513442+0000","last_unstale":"2024-06-04T16:21:45.133278+0000","last_undegraded":"2024-06-04T16:21:45.133278+0000","last_fullsized":"2024-06-04T16:21:45.133278+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_clean_scrub_stamp":"2024-06-04T15:52:43.492872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"254'147","reported_seq":716,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:53.150923+0000","last_change":"2024-06-04T16:22:53.150954+0000","last_active":"2024-06-04T16:22:53.150923+0000","last_peered":"2024-06-04T16:22:53.150923+0000","last_clean":"2024-06-04T16:22:53.150923+0000","last_became_active":"2024-06-04T15:52:46.539957+0000","last_became_peered":"2024-06-04T15:52:46.539957+0000","last_unstale":"2024-06-04T16:22:53.150923+0000","last_undegraded":"2024-06-04T16:22:53.150923+0000","last_fullsized":"2024-06-04T16:22:53.150923+0000","mapping_epoch":31,"log_start":"254'100","ondisk_log_start":"254'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'147","last_scrub_stamp":"2024-06-04T16:22:53.150822+0000","last_deep_scrub":"254'147","last_deep_scrub_stamp":"2024-06-04T16:22:53.150822+0000","last_clean_scrub_stamp":"2024-06-04T16:22:53.150822+0000","objects_scrubbed":2,"log_size":47,"log_dups_size":100,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T21:42:55.962546+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":399,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":346,"num_read_kb":345,"num_write":304,"num_write_kb":102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"254'154","reported_seq":838,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:21:40.027923+0000","last_change":"2024-06-04T15:52:38.483869+0000","last_active":"2024-06-04T16:21:40.027923+0000","last_peered":"2024-06-04T16:21:40.027923+0000","last_clean":"2024-06-04T16:21:40.027923+0000","last_became_active":"2024-06-04T15:52:38.483516+0000","last_became_peered":"2024-06-04T15:52:38.483516+0000","last_unstale":"2024-06-04T16:21:40.027923+0000","last_undegraded":"2024-06-04T16:21:40.027923+0000","last_fullsized":"2024-06-04T16:21:40.027923+0000","mapping_epoch":23,"log_start":"251'100","ondisk_log_start":"251'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":100,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":841,"num_read_kb":740,"num_write":235,"num_write_kb":95,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"254'66","reported_seq":580,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:46.496436+0000","last_change":"2024-06-04T15:52:36.481412+0000","last_active":"2024-06-04T16:22:46.496436+0000","last_peered":"2024-06-04T16:22:46.496436+0000","last_clean":"2024-06-04T16:22:46.496436+0000","last_became_active":"2024-06-04T15:52:36.481099+0000","last_became_peered":"2024-06-04T15:52:36.481099+0000","last_unstale":"2024-06-04T16:22:46.496436+0000","last_undegraded":"2024-06-04T16:22:46.496436+0000","last_fullsized":"2024-06-04T16:22:46.496436+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133687,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":119,"num_read_kb":2903,"num_write":273,"num_write_kb":32792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,7],"acting":[6,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":475,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:20:45.027080+0000","last_change":"2024-06-04T15:52:40.479746+0000","last_active":"2024-06-04T16:20:45.027080+0000","last_peered":"2024-06-04T16:20:45.027080+0000","last_clean":"2024-06-04T16:20:45.027080+0000","last_became_active":"2024-06-04T15:52:40.479483+0000","last_became_peered":"2024-06-04T15:52:40.479483+0000","last_unstale":"2024-06-04T16:20:45.027080+0000","last_undegraded":"2024-06-04T16:20:45.027080+0000","last_fullsized":"2024-06-04T16:20:45.027080+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_clean_scrub_stamp":"2024-06-04T15:52:39.463103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"254'51","reported_seq":548,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:21:45.133269+0000","last_change":"2024-06-04T15:52:42.503739+0000","last_active":"2024-06-04T16:21:45.133269+0000","last_peered":"2024-06-04T16:21:45.133269+0000","last_clean":"2024-06-04T16:21:45.133269+0000","last_became_active":"2024-06-04T15:52:42.503451+0000","last_became_peered":"2024-06-04T15:52:42.503451+0000","last_unstale":"2024-06-04T16:21:45.133269+0000","last_undegraded":"2024-06-04T16:21:45.133269+0000","last_fullsized":"2024-06-04T16:21:45.133269+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_clean_scrub_stamp":"2024-06-04T15:52:41.476734+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":72,"num_read_kb":67,"num_write":48,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":477,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:55.141200+0000","last_change":"2024-06-04T16:22:55.141223+0000","last_active":"2024-06-04T16:22:55.141200+0000","last_peered":"2024-06-04T16:22:55.141200+0000","last_clean":"2024-06-04T16:22:55.141200+0000","last_became_active":"2024-06-04T15:52:44.517614+0000","last_became_peered":"2024-06-04T15:52:44.517614+0000","last_unstale":"2024-06-04T16:22:55.141200+0000","last_undegraded":"2024-06-04T16:22:55.141200+0000","last_fullsized":"2024-06-04T16:22:55.141200+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:22:55.141113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:22:55.141113+0000","last_clean_scrub_stamp":"2024-06-04T16:22:55.141113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T21:06:04.632373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"254'26","reported_seq":510,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:53.168793+0000","last_change":"2024-06-04T16:22:53.168825+0000","last_active":"2024-06-04T16:22:53.168793+0000","last_peered":"2024-06-04T16:22:53.168793+0000","last_clean":"2024-06-04T16:22:53.168793+0000","last_became_active":"2024-06-04T15:52:46.535498+0000","last_became_peered":"2024-06-04T15:52:46.535498+0000","last_unstale":"2024-06-04T16:22:53.168793+0000","last_undegraded":"2024-06-04T16:22:53.168793+0000","last_fullsized":"2024-06-04T16:22:53.168793+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'26","last_scrub_stamp":"2024-06-04T16:22:53.168708+0000","last_deep_scrub":"254'26","last_deep_scrub_stamp":"2024-06-04T16:22:53.168708+0000","last_clean_scrub_stamp":"2024-06-04T16:22:53.168708+0000","objects_scrubbed":4,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T16:25:50.093337+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":432,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":50,"num_read_kb":48,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"254'95","reported_seq":836,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:21:40.035452+0000","last_change":"2024-06-04T15:52:38.486919+0000","last_active":"2024-06-04T16:21:40.035452+0000","last_peered":"2024-06-04T16:21:40.035452+0000","last_clean":"2024-06-04T16:21:40.035452+0000","last_became_active":"2024-06-04T15:52:38.486612+0000","last_became_peered":"2024-06-04T15:52:38.486612+0000","last_unstale":"2024-06-04T16:21:40.035452+0000","last_undegraded":"2024-06-04T16:21:40.035452+0000","last_fullsized":"2024-06-04T16:21:40.035452+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":567,"num_read_kb":536,"num_write":113,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"254'37","reported_seq":527,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:45.076838+0000","last_change":"2024-06-04T15:52:36.487317+0000","last_active":"2024-06-04T16:22:45.076838+0000","last_peered":"2024-06-04T16:22:45.076838+0000","last_clean":"2024-06-04T16:22:45.076838+0000","last_became_active":"2024-06-04T15:52:36.486999+0000","last_became_peered":"2024-06-04T15:52:36.486999+0000","last_unstale":"2024-06-04T16:22:45.076838+0000","last_undegraded":"2024-06-04T16:22:45.076838+0000","last_fullsized":"2024-06-04T16:22:45.076838+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":26,"num_read_kb":6159,"num_write":134,"num_write_kb":22820,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":475,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:21:40.035047+0000","last_change":"2024-06-04T15:52:40.485408+0000","last_active":"2024-06-04T16:21:40.035047+0000","last_peered":"2024-06-04T16:21:40.035047+0000","last_clean":"2024-06-04T16:21:40.035047+0000","last_became_active":"2024-06-04T15:52:40.484711+0000","last_became_peered":"2024-06-04T15:52:40.484711+0000","last_unstale":"2024-06-04T16:21:40.035047+0000","last_undegraded":"2024-06-04T16:21:40.035047+0000","last_fullsized":"2024-06-04T16:21:40.035047+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_clean_scrub_stamp":"2024-06-04T15:52:39.463103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"254'70","reported_seq":579,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:59.023776+0000","last_change":"2024-06-04T16:22:59.023817+0000","last_active":"2024-06-04T16:22:59.023776+0000","last_peered":"2024-06-04T16:22:59.023776+0000","last_clean":"2024-06-04T16:22:59.023776+0000","last_became_active":"2024-06-04T15:52:42.501248+0000","last_became_peered":"2024-06-04T15:52:42.501248+0000","last_unstale":"2024-06-04T16:22:59.023776+0000","last_undegraded":"2024-06-04T16:22:59.023776+0000","last_fullsized":"2024-06-04T16:22:59.023776+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'70","last_scrub_stamp":"2024-06-04T16:22:59.023678+0000","last_deep_scrub":"254'70","last_deep_scrub_stamp":"2024-06-04T16:22:59.023678+0000","last_clean_scrub_stamp":"2024-06-04T16:22:59.023678+0000","objects_scrubbed":5,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T00:41:59.670808+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":90,"num_read_kb":83,"num_write":60,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.15","version":"254'465","reported_seq":1508,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:00.895137+0000","last_change":"2024-06-04T16:23:00.895165+0000","last_active":"2024-06-04T16:23:00.895137+0000","last_peered":"2024-06-04T16:23:00.895137+0000","last_clean":"2024-06-04T16:23:00.895137+0000","last_became_active":"2024-06-04T15:52:44.523138+0000","last_became_peered":"2024-06-04T15:52:44.523138+0000","last_unstale":"2024-06-04T16:23:00.895137+0000","last_undegraded":"2024-06-04T16:23:00.895137+0000","last_fullsized":"2024-06-04T16:23:00.895137+0000","mapping_epoch":29,"log_start":"251'400","ondisk_log_start":"251'400","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'465","last_scrub_stamp":"2024-06-04T16:23:00.895051+0000","last_deep_scrub":"254'465","last_deep_scrub_stamp":"2024-06-04T16:23:00.895051+0000","last_clean_scrub_stamp":"2024-06-04T16:23:00.895051+0000","objects_scrubbed":1,"log_size":65,"log_dups_size":400,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T20:48:57.811545+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"254'38","reported_seq":515,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:54.535431+0000","last_change":"2024-06-04T16:22:54.535460+0000","last_active":"2024-06-04T16:22:54.535431+0000","last_peered":"2024-06-04T16:22:54.535431+0000","last_clean":"2024-06-04T16:22:54.535431+0000","last_became_active":"2024-06-04T15:52:46.532141+0000","last_became_peered":"2024-06-04T15:52:46.532141+0000","last_unstale":"2024-06-04T16:22:54.535431+0000","last_undegraded":"2024-06-04T16:22:54.535431+0000","last_fullsized":"2024-06-04T16:22:54.535431+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'38","last_scrub_stamp":"2024-06-04T16:22:54.535346+0000","last_deep_scrub":"254'38","last_deep_scrub_stamp":"2024-06-04T16:22:54.535346+0000","last_clean_scrub_stamp":"2024-06-04T16:22:54.535346+0000","objects_scrubbed":1,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T17:24:08.579752+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":56,"num_read_kb":50,"num_write":85,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":168,"num_omap_keys":1,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"254'146","reported_seq":979,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:21:40.035495+0000","last_change":"2024-06-04T15:52:38.490123+0000","last_active":"2024-06-04T16:21:40.035495+0000","last_peered":"2024-06-04T16:21:40.035495+0000","last_clean":"2024-06-04T16:21:40.035495+0000","last_became_active":"2024-06-04T15:52:38.489719+0000","last_became_peered":"2024-06-04T15:52:38.489719+0000","last_unstale":"2024-06-04T16:21:40.035495+0000","last_undegraded":"2024-06-04T16:21:40.035495+0000","last_fullsized":"2024-06-04T16:21:40.035495+0000","mapping_epoch":23,"log_start":"251'100","ondisk_log_start":"251'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":100,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":798,"num_read_kb":751,"num_write":172,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"254'47","reported_seq":557,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:44.133115+0000","last_change":"2024-06-04T15:52:36.483313+0000","last_active":"2024-06-04T16:22:44.133115+0000","last_peered":"2024-06-04T16:22:44.133115+0000","last_clean":"2024-06-04T16:22:44.133115+0000","last_became_active":"2024-06-04T15:52:36.482920+0000","last_became_peered":"2024-06-04T15:52:36.482920+0000","last_unstale":"2024-06-04T16:22:44.133115+0000","last_undegraded":"2024-06-04T16:22:44.133115+0000","last_fullsized":"2024-06-04T16:22:44.133115+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1069231,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":86,"num_read_kb":13402,"num_write":212,"num_write_kb":21907,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3],"acting":[1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":474,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:21:40.027956+0000","last_change":"2024-06-04T15:52:40.482578+0000","last_active":"2024-06-04T16:21:40.027956+0000","last_peered":"2024-06-04T16:21:40.027956+0000","last_clean":"2024-06-04T16:21:40.027956+0000","last_became_active":"2024-06-04T15:52:40.482288+0000","last_became_peered":"2024-06-04T15:52:40.482288+0000","last_unstale":"2024-06-04T16:21:40.027956+0000","last_undegraded":"2024-06-04T16:21:40.027956+0000","last_fullsized":"2024-06-04T16:21:40.027956+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_clean_scrub_stamp":"2024-06-04T15:52:39.463103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"254'91","reported_seq":637,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:03.430350+0000","last_change":"2024-06-04T16:23:03.430391+0000","last_active":"2024-06-04T16:23:03.430350+0000","last_peered":"2024-06-04T16:23:03.430350+0000","last_clean":"2024-06-04T16:23:03.430350+0000","last_became_active":"2024-06-04T15:52:42.503282+0000","last_became_peered":"2024-06-04T15:52:42.503282+0000","last_unstale":"2024-06-04T16:23:03.430350+0000","last_undegraded":"2024-06-04T16:23:03.430350+0000","last_fullsized":"2024-06-04T16:23:03.430350+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'91","last_scrub_stamp":"2024-06-04T16:23:03.430250+0000","last_deep_scrub":"254'91","last_deep_scrub_stamp":"2024-06-04T16:23:03.430250+0000","last_clean_scrub_stamp":"2024-06-04T16:23:03.430250+0000","objects_scrubbed":4,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T16:30:06.943222+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6020,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":136,"num_read_kb":193,"num_write":64,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"254'478","reported_seq":1575,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:39.579832+0000","last_change":"2024-06-04T15:52:44.520464+0000","last_active":"2024-06-04T16:22:39.579832+0000","last_peered":"2024-06-04T16:22:39.579832+0000","last_clean":"2024-06-04T16:22:39.579832+0000","last_became_active":"2024-06-04T15:52:44.518724+0000","last_became_peered":"2024-06-04T15:52:44.518724+0000","last_unstale":"2024-06-04T16:22:39.579832+0000","last_undegraded":"2024-06-04T16:22:39.579832+0000","last_fullsized":"2024-06-04T16:22:39.579832+0000","mapping_epoch":29,"log_start":"251'400","ondisk_log_start":"251'400","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_clean_scrub_stamp":"2024-06-04T15:52:43.492872+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":400,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"254'113","reported_seq":801,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:45.077042+0000","last_change":"2024-06-04T15:52:38.479210+0000","last_active":"2024-06-04T16:22:45.077042+0000","last_peered":"2024-06-04T16:22:45.077042+0000","last_clean":"2024-06-04T16:22:45.077042+0000","last_became_active":"2024-06-04T15:52:38.478886+0000","last_became_peered":"2024-06-04T15:52:38.478886+0000","last_unstale":"2024-06-04T16:22:45.077042+0000","last_undegraded":"2024-06-04T16:22:45.077042+0000","last_fullsized":"2024-06-04T16:22:45.077042+0000","mapping_epoch":23,"log_start":"251'100","ondisk_log_start":"251'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":100,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":534,"num_read_kb":483,"num_write":137,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"251'58","reported_seq":545,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:48.217293+0000","last_change":"2024-06-04T16:22:48.217346+0000","last_active":"2024-06-04T16:22:48.217293+0000","last_peered":"2024-06-04T16:22:48.217293+0000","last_clean":"2024-06-04T16:22:48.217293+0000","last_became_active":"2024-06-04T15:53:14.838259+0000","last_became_peered":"2024-06-04T15:53:14.838259+0000","last_unstale":"2024-06-04T16:22:48.217293+0000","last_undegraded":"2024-06-04T16:22:48.217293+0000","last_fullsized":"2024-06-04T16:22:48.217293+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"251'58","last_scrub_stamp":"2024-06-04T16:22:48.217194+0000","last_deep_scrub":"251'58","last_deep_scrub_stamp":"2024-06-04T16:22:48.217194+0000","last_clean_scrub_stamp":"2024-06-04T16:22:48.217194+0000","objects_scrubbed":2,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T01:01:00.864191+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":105,"num_read_kb":3164,"num_write":221,"num_write_kb":9993,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,4],"acting":[6,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":487,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:04.217949+0000","last_change":"2024-06-04T16:23:04.217972+0000","last_active":"2024-06-04T16:23:04.217949+0000","last_peered":"2024-06-04T16:23:04.217949+0000","last_clean":"2024-06-04T16:23:04.217949+0000","last_became_active":"2024-06-04T15:52:40.483832+0000","last_became_peered":"2024-06-04T15:52:40.483832+0000","last_unstale":"2024-06-04T16:23:04.217949+0000","last_undegraded":"2024-06-04T16:23:04.217949+0000","last_fullsized":"2024-06-04T16:23:04.217949+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:23:04.217854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:23:04.217854+0000","last_clean_scrub_stamp":"2024-06-04T16:23:04.217854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T17:33:21.489187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"254'148","reported_seq":729,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:55.848531+0000","last_change":"2024-06-04T16:22:55.848573+0000","last_active":"2024-06-04T16:22:55.848531+0000","last_peered":"2024-06-04T16:22:55.848531+0000","last_clean":"2024-06-04T16:22:55.848531+0000","last_became_active":"2024-06-04T15:52:42.504217+0000","last_became_peered":"2024-06-04T15:52:42.504217+0000","last_unstale":"2024-06-04T16:22:55.848531+0000","last_undegraded":"2024-06-04T16:22:55.848531+0000","last_fullsized":"2024-06-04T16:22:55.848531+0000","mapping_epoch":27,"log_start":"251'100","ondisk_log_start":"251'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'148","last_scrub_stamp":"2024-06-04T16:22:55.848437+0000","last_deep_scrub":"254'148","last_deep_scrub_stamp":"2024-06-04T16:22:55.848437+0000","last_clean_scrub_stamp":"2024-06-04T16:22:55.848437+0000","objects_scrubbed":9,"log_size":48,"log_dups_size":100,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T01:32:43.406440+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":216,"num_read_kb":258,"num_write":116,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":464,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:00.037226+0000","last_change":"2024-06-04T15:52:44.520621+0000","last_active":"2024-06-04T16:22:00.037226+0000","last_peered":"2024-06-04T16:22:00.037226+0000","last_clean":"2024-06-04T16:22:00.037226+0000","last_became_active":"2024-06-04T15:52:44.520358+0000","last_became_peered":"2024-06-04T15:52:44.520358+0000","last_unstale":"2024-06-04T16:22:00.037226+0000","last_undegraded":"2024-06-04T16:22:00.037226+0000","last_fullsized":"2024-06-04T16:22:00.037226+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_clean_scrub_stamp":"2024-06-04T15:52:43.492872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"254'457","reported_seq":1249,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:53.493908+0000","last_change":"2024-06-04T16:22:53.493945+0000","last_active":"2024-06-04T16:22:53.493908+0000","last_peered":"2024-06-04T16:22:53.493908+0000","last_clean":"2024-06-04T16:22:53.493908+0000","last_became_active":"2024-06-04T15:52:46.536442+0000","last_became_peered":"2024-06-04T15:52:46.536442+0000","last_unstale":"2024-06-04T16:22:53.493908+0000","last_undegraded":"2024-06-04T16:22:53.493908+0000","last_fullsized":"2024-06-04T16:22:53.493908+0000","mapping_epoch":31,"log_start":"251'400","ondisk_log_start":"251'400","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'457","last_scrub_stamp":"2024-06-04T16:22:53.493803+0000","last_deep_scrub":"254'457","last_deep_scrub_stamp":"2024-06-04T16:22:53.493803+0000","last_clean_scrub_stamp":"2024-06-04T16:22:53.493803+0000","objects_scrubbed":2,"log_size":57,"log_dups_size":400,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T17:18:55.700935+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":418,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1197,"num_read_kb":1195,"num_write":937,"num_write_kb":336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":182,"num_omap_keys":1,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"254'122","reported_seq":933,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:03.204186+0000","last_change":"2024-06-04T16:23:03.204213+0000","last_active":"2024-06-04T16:23:03.204186+0000","last_peered":"2024-06-04T16:23:03.204186+0000","last_clean":"2024-06-04T16:23:03.204186+0000","last_became_active":"2024-06-04T15:52:38.483194+0000","last_became_peered":"2024-06-04T15:52:38.483194+0000","last_unstale":"2024-06-04T16:23:03.204186+0000","last_undegraded":"2024-06-04T16:23:03.204186+0000","last_fullsized":"2024-06-04T16:23:03.204186+0000","mapping_epoch":23,"log_start":"251'100","ondisk_log_start":"251'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'122","last_scrub_stamp":"2024-06-04T16:23:03.204097+0000","last_deep_scrub":"254'122","last_deep_scrub_stamp":"2024-06-04T16:23:03.204097+0000","last_clean_scrub_stamp":"2024-06-04T16:23:03.204097+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":100,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T20:27:28.071534+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":683,"num_read_kb":649,"num_write":140,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"254'60","reported_seq":592,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:39.442636+0000","last_change":"2024-06-04T15:52:36.486364+0000","last_active":"2024-06-04T16:22:39.442636+0000","last_peered":"2024-06-04T16:22:39.442636+0000","last_clean":"2024-06-04T16:22:39.442636+0000","last_became_active":"2024-06-04T15:52:36.485995+0000","last_became_peered":"2024-06-04T15:52:36.485995+0000","last_unstale":"2024-06-04T16:22:39.442636+0000","last_undegraded":"2024-06-04T16:22:39.442636+0000","last_fullsized":"2024-06-04T16:22:39.442636+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":105,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":98,"num_read_kb":68665,"num_write":249,"num_write_kb":35943,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":481,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:01.049522+0000","last_change":"2024-06-04T16:23:01.049547+0000","last_active":"2024-06-04T16:23:01.049522+0000","last_peered":"2024-06-04T16:23:01.049522+0000","last_clean":"2024-06-04T16:23:01.049522+0000","last_became_active":"2024-06-04T15:52:40.480714+0000","last_became_peered":"2024-06-04T15:52:40.480714+0000","last_unstale":"2024-06-04T16:23:01.049522+0000","last_undegraded":"2024-06-04T16:23:01.049522+0000","last_fullsized":"2024-06-04T16:23:01.049522+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:23:01.049430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:23:01.049430+0000","last_clean_scrub_stamp":"2024-06-04T16:23:01.049430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T19:32:08.942239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.b","version":"254'96","reported_seq":645,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:55.026863+0000","last_change":"2024-06-04T16:22:55.026898+0000","last_active":"2024-06-04T16:22:55.026863+0000","last_peered":"2024-06-04T16:22:55.026863+0000","last_clean":"2024-06-04T16:22:55.026863+0000","last_became_active":"2024-06-04T15:52:42.505269+0000","last_became_peered":"2024-06-04T15:52:42.505269+0000","last_unstale":"2024-06-04T16:22:55.026863+0000","last_undegraded":"2024-06-04T16:22:55.026863+0000","last_fullsized":"2024-06-04T16:22:55.026863+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'96","last_scrub_stamp":"2024-06-04T16:22:55.026767+0000","last_deep_scrub":"254'96","last_deep_scrub_stamp":"2024-06-04T16:22:55.026767+0000","last_clean_scrub_stamp":"2024-06-04T16:22:55.026767+0000","objects_scrubbed":4,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T18:40:29.643937+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":127,"num_read_kb":117,"num_write":58,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":476,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:52.966782+0000","last_change":"2024-06-04T16:22:52.966827+0000","last_active":"2024-06-04T16:22:52.966782+0000","last_peered":"2024-06-04T16:22:52.966782+0000","last_clean":"2024-06-04T16:22:52.966782+0000","last_became_active":"2024-06-04T15:52:44.522149+0000","last_became_peered":"2024-06-04T15:52:44.522149+0000","last_unstale":"2024-06-04T16:22:52.966782+0000","last_undegraded":"2024-06-04T16:22:52.966782+0000","last_fullsized":"2024-06-04T16:22:52.966782+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:22:52.966674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:22:52.966674+0000","last_clean_scrub_stamp":"2024-06-04T16:22:52.966674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T02:07:15.814206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.5","version":"254'29","reported_seq":514,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:49.115675+0000","last_change":"2024-06-04T16:22:49.115732+0000","last_active":"2024-06-04T16:22:49.115675+0000","last_peered":"2024-06-04T16:22:49.115675+0000","last_clean":"2024-06-04T16:22:49.115675+0000","last_became_active":"2024-06-04T15:52:46.540510+0000","last_became_peered":"2024-06-04T15:52:46.540510+0000","last_unstale":"2024-06-04T16:22:49.115675+0000","last_undegraded":"2024-06-04T16:22:49.115675+0000","last_fullsized":"2024-06-04T16:22:49.115675+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'29","last_scrub_stamp":"2024-06-04T16:22:49.115565+0000","last_deep_scrub":"254'29","last_deep_scrub_stamp":"2024-06-04T16:22:49.115565+0000","last_clean_scrub_stamp":"2024-06-04T16:22:49.115565+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T21:09:44.617649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":51,"num_write":73,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"254'110","reported_seq":877,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:44.606290+0000","last_change":"2024-06-04T15:52:38.480623+0000","last_active":"2024-06-04T16:22:44.606290+0000","last_peered":"2024-06-04T16:22:44.606290+0000","last_clean":"2024-06-04T16:22:44.606290+0000","last_became_active":"2024-06-04T15:52:38.480112+0000","last_became_peered":"2024-06-04T15:52:38.480112+0000","last_unstale":"2024-06-04T16:22:44.606290+0000","last_undegraded":"2024-06-04T16:22:44.606290+0000","last_fullsized":"2024-06-04T16:22:44.606290+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":725,"num_read_kb":689,"num_write":131,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"251'79","reported_seq":556,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:49.252335+0000","last_change":"2024-06-04T16:22:49.252378+0000","last_active":"2024-06-04T16:22:49.252335+0000","last_peered":"2024-06-04T16:22:49.252335+0000","last_clean":"2024-06-04T16:22:49.252335+0000","last_became_active":"2024-06-04T15:53:14.838251+0000","last_became_peered":"2024-06-04T15:53:14.838251+0000","last_unstale":"2024-06-04T16:22:49.252335+0000","last_undegraded":"2024-06-04T16:22:49.252335+0000","last_fullsized":"2024-06-04T16:22:49.252335+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"251'79","last_scrub_stamp":"2024-06-04T16:22:49.252226+0000","last_deep_scrub":"251'79","last_deep_scrub_stamp":"2024-06-04T16:22:49.252226+0000","last_clean_scrub_stamp":"2024-06-04T16:22:49.252226+0000","objects_scrubbed":5,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T00:19:46.167408+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5263509,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":74,"num_read_kb":65,"num_write":320,"num_write_kb":43304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.b","version":"33'3","reported_seq":785,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:39.353111+0000","last_change":"2024-06-04T15:52:40.482441+0000","last_active":"2024-06-04T16:22:39.353111+0000","last_peered":"2024-06-04T16:22:39.353111+0000","last_clean":"2024-06-04T16:22:39.353111+0000","last_became_active":"2024-06-04T15:52:40.482173+0000","last_became_peered":"2024-06-04T15:52:40.482173+0000","last_unstale":"2024-06-04T16:22:39.353111+0000","last_undegraded":"2024-06-04T16:22:39.353111+0000","last_fullsized":"2024-06-04T16:22:39.353111+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_clean_scrub_stamp":"2024-06-04T15:52:39.463103+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":464,"num_read_kb":462,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"254'109","reported_seq":659,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:45.077256+0000","last_change":"2024-06-04T15:52:42.498254+0000","last_active":"2024-06-04T16:22:45.077256+0000","last_peered":"2024-06-04T16:22:45.077256+0000","last_clean":"2024-06-04T16:22:45.077256+0000","last_became_active":"2024-06-04T15:52:42.497393+0000","last_became_peered":"2024-06-04T15:52:42.497393+0000","last_unstale":"2024-06-04T16:22:45.077256+0000","last_undegraded":"2024-06-04T16:22:45.077256+0000","last_fullsized":"2024-06-04T16:22:45.077256+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_clean_scrub_stamp":"2024-06-04T15:52:41.476734+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13302,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":171,"num_read_kb":247,"num_write":88,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"254'478","reported_seq":1637,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:46.023784+0000","last_change":"2024-06-04T15:52:44.519059+0000","last_active":"2024-06-04T16:22:46.023784+0000","last_peered":"2024-06-04T16:22:46.023784+0000","last_clean":"2024-06-04T16:22:46.023784+0000","last_became_active":"2024-06-04T15:52:44.518765+0000","last_became_peered":"2024-06-04T15:52:44.518765+0000","last_unstale":"2024-06-04T16:22:46.023784+0000","last_undegraded":"2024-06-04T16:22:46.023784+0000","last_fullsized":"2024-06-04T16:22:46.023784+0000","mapping_epoch":29,"log_start":"251'400","ondisk_log_start":"251'400","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_clean_scrub_stamp":"2024-06-04T15:52:43.492872+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":400,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"254'22","reported_seq":498,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:52.174431+0000","last_change":"2024-06-04T16:22:52.174461+0000","last_active":"2024-06-04T16:22:52.174431+0000","last_peered":"2024-06-04T16:22:52.174431+0000","last_clean":"2024-06-04T16:22:52.174431+0000","last_became_active":"2024-06-04T15:52:46.537679+0000","last_became_peered":"2024-06-04T15:52:46.537679+0000","last_unstale":"2024-06-04T16:22:52.174431+0000","last_undegraded":"2024-06-04T16:22:52.174431+0000","last_fullsized":"2024-06-04T16:22:52.174431+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'22","last_scrub_stamp":"2024-06-04T16:22:52.174345+0000","last_deep_scrub":"254'22","last_deep_scrub_stamp":"2024-06-04T16:22:52.174345+0000","last_clean_scrub_stamp":"2024-06-04T16:22:52.174345+0000","objects_scrubbed":1,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T02:41:59.686833+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":390,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":49,"num_read_kb":41,"num_write":55,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"254'141","reported_seq":900,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:21:55.037496+0000","last_change":"2024-06-04T15:52:38.489274+0000","last_active":"2024-06-04T16:21:55.037496+0000","last_peered":"2024-06-04T16:21:55.037496+0000","last_clean":"2024-06-04T16:21:55.037496+0000","last_became_active":"2024-06-04T15:52:38.488997+0000","last_became_peered":"2024-06-04T15:52:38.488997+0000","last_unstale":"2024-06-04T16:21:55.037496+0000","last_undegraded":"2024-06-04T16:21:55.037496+0000","last_fullsized":"2024-06-04T16:21:55.037496+0000","mapping_epoch":23,"log_start":"251'100","ondisk_log_start":"251'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":100,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":688,"num_read_kb":631,"num_write":173,"num_write_kb":46,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"254'58","reported_seq":576,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:04.760655+0000","last_change":"2024-06-04T16:23:04.760722+0000","last_active":"2024-06-04T16:23:04.760655+0000","last_peered":"2024-06-04T16:23:04.760655+0000","last_clean":"2024-06-04T16:23:04.760655+0000","last_became_active":"2024-06-04T15:52:36.495601+0000","last_became_peered":"2024-06-04T15:52:36.495601+0000","last_unstale":"2024-06-04T16:23:04.760655+0000","last_undegraded":"2024-06-04T16:23:04.760655+0000","last_fullsized":"2024-06-04T16:23:04.760655+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'58","last_scrub_stamp":"2024-06-04T16:23:04.760535+0000","last_deep_scrub":"254'58","last_deep_scrub_stamp":"2024-06-04T16:23:04.760535+0000","last_clean_scrub_stamp":"2024-06-04T16:23:04.760535+0000","objects_scrubbed":3,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T16:26:15.812386+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":74,"num_read_kb":575,"num_write":257,"num_write_kb":23683,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":481,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:56.113187+0000","last_change":"2024-06-04T16:22:56.113187+0000","last_active":"2024-06-04T16:22:56.113187+0000","last_peered":"2024-06-04T16:22:56.113187+0000","last_clean":"2024-06-04T16:22:56.113187+0000","last_became_active":"2024-06-04T15:52:40.484785+0000","last_became_peered":"2024-06-04T15:52:40.484785+0000","last_unstale":"2024-06-04T16:22:56.113187+0000","last_undegraded":"2024-06-04T16:22:56.113187+0000","last_fullsized":"2024-06-04T16:22:56.113187+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:22:56.113062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:22:56.113062+0000","last_clean_scrub_stamp":"2024-06-04T16:22:56.113062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T03:33:52.074473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.9","version":"254'161","reported_seq":772,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:57.012649+0000","last_change":"2024-06-04T16:22:57.012649+0000","last_active":"2024-06-04T16:22:57.012649+0000","last_peered":"2024-06-04T16:22:57.012649+0000","last_clean":"2024-06-04T16:22:57.012649+0000","last_became_active":"2024-06-04T15:52:42.504622+0000","last_became_peered":"2024-06-04T15:52:42.504622+0000","last_unstale":"2024-06-04T16:22:57.012649+0000","last_undegraded":"2024-06-04T16:22:57.012649+0000","last_fullsized":"2024-06-04T16:22:57.012649+0000","mapping_epoch":27,"log_start":"251'100","ondisk_log_start":"251'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'161","last_scrub_stamp":"2024-06-04T16:22:57.012513+0000","last_deep_scrub":"254'161","last_deep_scrub_stamp":"2024-06-04T16:22:57.012513+0000","last_clean_scrub_stamp":"2024-06-04T16:22:57.012513+0000","objects_scrubbed":5,"log_size":61,"log_dups_size":100,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T04:11:37.544221+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25402,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":256,"num_read_kb":404,"num_write":118,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":471,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:46.023749+0000","last_change":"2024-06-04T15:52:44.518616+0000","last_active":"2024-06-04T16:22:46.023749+0000","last_peered":"2024-06-04T16:22:46.023749+0000","last_clean":"2024-06-04T16:22:46.023749+0000","last_became_active":"2024-06-04T15:52:44.518340+0000","last_became_peered":"2024-06-04T15:52:44.518340+0000","last_unstale":"2024-06-04T16:22:46.023749+0000","last_undegraded":"2024-06-04T16:22:46.023749+0000","last_fullsized":"2024-06-04T16:22:46.023749+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_clean_scrub_stamp":"2024-06-04T15:52:43.492872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"254'23","reported_seq":511,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:05.078577+0000","last_change":"2024-06-04T16:23:05.078621+0000","last_active":"2024-06-04T16:23:05.078577+0000","last_peered":"2024-06-04T16:23:05.078577+0000","last_clean":"2024-06-04T16:23:05.078577+0000","last_became_active":"2024-06-04T15:52:46.540542+0000","last_became_peered":"2024-06-04T15:52:46.540542+0000","last_unstale":"2024-06-04T16:23:05.078577+0000","last_undegraded":"2024-06-04T16:23:05.078577+0000","last_fullsized":"2024-06-04T16:23:05.078577+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'23","last_scrub_stamp":"2024-06-04T16:23:05.078478+0000","last_deep_scrub":"254'23","last_deep_scrub_stamp":"2024-06-04T16:23:05.078478+0000","last_clean_scrub_stamp":"2024-06-04T16:23:05.078478+0000","objects_scrubbed":1,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T02:22:33.559139+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":503,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":51,"num_read_kb":51,"num_write":59,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"254'119","reported_seq":924,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:54.855494+0000","last_change":"2024-06-04T16:22:54.855550+0000","last_active":"2024-06-04T16:22:54.855494+0000","last_peered":"2024-06-04T16:22:54.855494+0000","last_clean":"2024-06-04T16:22:54.855494+0000","last_became_active":"2024-06-04T15:52:38.488576+0000","last_became_peered":"2024-06-04T15:52:38.488576+0000","last_unstale":"2024-06-04T16:22:54.855494+0000","last_undegraded":"2024-06-04T16:22:54.855494+0000","last_fullsized":"2024-06-04T16:22:54.855494+0000","mapping_epoch":23,"log_start":"251'100","ondisk_log_start":"251'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'119","last_scrub_stamp":"2024-06-04T16:22:54.855389+0000","last_deep_scrub":"254'119","last_deep_scrub_stamp":"2024-06-04T16:22:54.855389+0000","last_clean_scrub_stamp":"2024-06-04T16:22:54.855389+0000","objects_scrubbed":3,"log_size":19,"log_dups_size":100,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T22:19:39.538012+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":804,"num_read_kb":763,"num_write":143,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":723,"num_omap_keys":3,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"254'83","reported_seq":604,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:39.450261+0000","last_change":"2024-06-04T15:52:36.499047+0000","last_active":"2024-06-04T16:22:39.450261+0000","last_peered":"2024-06-04T16:22:39.450261+0000","last_clean":"2024-06-04T16:22:39.450261+0000","last_became_active":"2024-06-04T15:52:36.498706+0000","last_became_peered":"2024-06-04T15:52:36.498706+0000","last_unstale":"2024-06-04T16:22:39.450261+0000","last_undegraded":"2024-06-04T16:22:39.450261+0000","last_fullsized":"2024-06-04T16:22:39.450261+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262197,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":125,"num_read_kb":7280,"num_write":369,"num_write_kb":33149,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":476,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:21:55.149935+0000","last_change":"2024-06-04T15:52:40.485318+0000","last_active":"2024-06-04T16:21:55.149935+0000","last_peered":"2024-06-04T16:21:55.149935+0000","last_clean":"2024-06-04T16:21:55.149935+0000","last_became_active":"2024-06-04T15:52:40.484285+0000","last_became_peered":"2024-06-04T15:52:40.484285+0000","last_unstale":"2024-06-04T16:21:55.149935+0000","last_undegraded":"2024-06-04T16:21:55.149935+0000","last_fullsized":"2024-06-04T16:21:55.149935+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_clean_scrub_stamp":"2024-06-04T15:52:39.463103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.e","version":"254'121","reported_seq":667,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:39.459446+0000","last_change":"2024-06-04T15:52:42.501168+0000","last_active":"2024-06-04T16:22:39.459446+0000","last_peered":"2024-06-04T16:22:39.459446+0000","last_clean":"2024-06-04T16:22:39.459446+0000","last_became_active":"2024-06-04T15:52:42.500865+0000","last_became_peered":"2024-06-04T15:52:42.500865+0000","last_unstale":"2024-06-04T16:22:39.459446+0000","last_undegraded":"2024-06-04T16:22:39.459446+0000","last_fullsized":"2024-06-04T16:22:39.459446+0000","mapping_epoch":27,"log_start":"251'100","ondisk_log_start":"251'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_clean_scrub_stamp":"2024-06-04T15:52:41.476734+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":100,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":174,"num_read_kb":176,"num_write":136,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":468,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:00.150703+0000","last_change":"2024-06-04T15:52:44.520519+0000","last_active":"2024-06-04T16:22:00.150703+0000","last_peered":"2024-06-04T16:22:00.150703+0000","last_clean":"2024-06-04T16:22:00.150703+0000","last_became_active":"2024-06-04T15:52:44.519542+0000","last_became_peered":"2024-06-04T15:52:44.519542+0000","last_unstale":"2024-06-04T16:22:00.150703+0000","last_undegraded":"2024-06-04T16:22:00.150703+0000","last_fullsized":"2024-06-04T16:22:00.150703+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_clean_scrub_stamp":"2024-06-04T15:52:43.492872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.0","version":"254'18","reported_seq":494,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:00.480512+0000","last_change":"2024-06-04T16:23:00.480554+0000","last_active":"2024-06-04T16:23:00.480512+0000","last_peered":"2024-06-04T16:23:00.480512+0000","last_clean":"2024-06-04T16:23:00.480512+0000","last_became_active":"2024-06-04T15:52:46.539906+0000","last_became_peered":"2024-06-04T15:52:46.539906+0000","last_unstale":"2024-06-04T16:23:00.480512+0000","last_undegraded":"2024-06-04T16:23:00.480512+0000","last_fullsized":"2024-06-04T16:23:00.480512+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'18","last_scrub_stamp":"2024-06-04T16:23:00.480421+0000","last_deep_scrub":"254'18","last_deep_scrub_stamp":"2024-06-04T16:23:00.480421+0000","last_clean_scrub_stamp":"2024-06-04T16:23:00.480421+0000","objects_scrubbed":2,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T20:46:48.332397+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":31,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"254'140","reported_seq":898,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:21:55.029677+0000","last_change":"2024-06-04T15:52:38.479098+0000","last_active":"2024-06-04T16:21:55.029677+0000","last_peered":"2024-06-04T16:21:55.029677+0000","last_clean":"2024-06-04T16:21:55.029677+0000","last_became_active":"2024-06-04T15:52:38.478691+0000","last_became_peered":"2024-06-04T15:52:38.478691+0000","last_unstale":"2024-06-04T16:21:55.029677+0000","last_undegraded":"2024-06-04T16:21:55.029677+0000","last_fullsized":"2024-06-04T16:21:55.029677+0000","mapping_epoch":23,"log_start":"251'100","ondisk_log_start":"251'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":100,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":683,"num_read_kb":634,"num_write":182,"num_write_kb":49,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"254'80","reported_seq":589,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:45.076820+0000","last_change":"2024-06-04T15:52:36.489783+0000","last_active":"2024-06-04T16:22:45.076820+0000","last_peered":"2024-06-04T16:22:45.076820+0000","last_clean":"2024-06-04T16:22:45.076820+0000","last_became_active":"2024-06-04T15:52:36.489437+0000","last_became_peered":"2024-06-04T15:52:36.489437+0000","last_unstale":"2024-06-04T16:22:45.076820+0000","last_undegraded":"2024-06-04T16:22:45.076820+0000","last_fullsized":"2024-06-04T16:22:45.076820+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133669,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":97,"num_read_kb":3905,"num_write":348,"num_write_kb":24180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":478,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:21:55.037541+0000","last_change":"2024-06-04T15:52:40.480878+0000","last_active":"2024-06-04T16:21:55.037541+0000","last_peered":"2024-06-04T16:21:55.037541+0000","last_clean":"2024-06-04T16:21:55.037541+0000","last_became_active":"2024-06-04T15:52:40.480568+0000","last_became_peered":"2024-06-04T15:52:40.480568+0000","last_unstale":"2024-06-04T16:21:55.037541+0000","last_undegraded":"2024-06-04T16:21:55.037541+0000","last_fullsized":"2024-06-04T16:21:55.037541+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_clean_scrub_stamp":"2024-06-04T15:52:39.463103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.f","version":"254'111","reported_seq":663,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:39.414356+0000","last_change":"2024-06-04T15:52:42.499311+0000","last_active":"2024-06-04T16:22:39.414356+0000","last_peered":"2024-06-04T16:22:39.414356+0000","last_clean":"2024-06-04T16:22:39.414356+0000","last_became_active":"2024-06-04T15:52:42.499014+0000","last_became_peered":"2024-06-04T15:52:42.499014+0000","last_unstale":"2024-06-04T16:22:39.414356+0000","last_undegraded":"2024-06-04T16:22:39.414356+0000","last_fullsized":"2024-06-04T16:22:39.414356+0000","mapping_epoch":27,"log_start":"251'100","ondisk_log_start":"251'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_clean_scrub_stamp":"2024-06-04T15:52:41.476734+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":100,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6848,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":169,"num_read_kb":239,"num_write":88,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.e","version":"254'463","reported_seq":1444,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:39.576748+0000","last_change":"2024-06-04T15:52:44.520284+0000","last_active":"2024-06-04T16:22:39.576748+0000","last_peered":"2024-06-04T16:22:39.576748+0000","last_clean":"2024-06-04T16:22:39.576748+0000","last_became_active":"2024-06-04T15:52:44.520016+0000","last_became_peered":"2024-06-04T15:52:44.520016+0000","last_unstale":"2024-06-04T16:22:39.576748+0000","last_undegraded":"2024-06-04T16:22:39.576748+0000","last_fullsized":"2024-06-04T16:22:39.576748+0000","mapping_epoch":29,"log_start":"251'400","ondisk_log_start":"251'400","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_clean_scrub_stamp":"2024-06-04T15:52:43.492872+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":400,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1","version":"254'28","reported_seq":500,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:00.037164+0000","last_change":"2024-06-04T15:52:46.532842+0000","last_active":"2024-06-04T16:22:00.037164+0000","last_peered":"2024-06-04T16:22:00.037164+0000","last_clean":"2024-06-04T16:22:00.037164+0000","last_became_active":"2024-06-04T15:52:46.532554+0000","last_became_peered":"2024-06-04T15:52:46.532554+0000","last_unstale":"2024-06-04T16:22:00.037164+0000","last_undegraded":"2024-06-04T16:22:00.037164+0000","last_fullsized":"2024-06-04T16:22:00.037164+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:45.513877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:45.513877+0000","last_clean_scrub_stamp":"2024-06-04T15:52:45.513877+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":764,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":64,"num_read_kb":55,"num_write":77,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.e","version":"254'75","reported_seq":758,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:21:55.025516+0000","last_change":"2024-06-04T15:52:38.481543+0000","last_active":"2024-06-04T16:21:55.025516+0000","last_peered":"2024-06-04T16:21:55.025516+0000","last_clean":"2024-06-04T16:21:55.025516+0000","last_became_active":"2024-06-04T15:52:38.480961+0000","last_became_peered":"2024-06-04T15:52:38.480961+0000","last_unstale":"2024-06-04T16:21:55.025516+0000","last_undegraded":"2024-06-04T16:21:55.025516+0000","last_fullsized":"2024-06-04T16:21:55.025516+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":420,"num_read_kb":402,"num_write":82,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"254'43","reported_seq":543,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:45.076808+0000","last_change":"2024-06-04T15:52:36.485951+0000","last_active":"2024-06-04T16:22:45.076808+0000","last_peered":"2024-06-04T16:22:45.076808+0000","last_clean":"2024-06-04T16:22:45.076808+0000","last_became_active":"2024-06-04T15:52:36.485571+0000","last_became_peered":"2024-06-04T15:52:36.485571+0000","last_unstale":"2024-06-04T16:22:45.076808+0000","last_undegraded":"2024-06-04T16:22:45.076808+0000","last_fullsized":"2024-06-04T16:22:45.076808+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":66,"num_read_kb":9943,"num_write":198,"num_write_kb":32171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"254'4","reported_seq":1096,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:58.155039+0000","last_change":"2024-06-04T16:22:58.155073+0000","last_active":"2024-06-04T16:22:58.155039+0000","last_peered":"2024-06-04T16:22:58.155039+0000","last_clean":"2024-06-04T16:22:58.155039+0000","last_became_active":"2024-06-04T15:52:40.477693+0000","last_became_peered":"2024-06-04T15:52:40.477693+0000","last_unstale":"2024-06-04T16:22:58.155039+0000","last_undegraded":"2024-06-04T16:22:58.155039+0000","last_fullsized":"2024-06-04T16:22:58.155039+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'4","last_scrub_stamp":"2024-06-04T16:22:58.154941+0000","last_deep_scrub":"254'4","last_deep_scrub_stamp":"2024-06-04T16:22:58.154941+0000","last_clean_scrub_stamp":"2024-06-04T16:22:58.154941+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T00:05:04.192698+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":606,"num_read_kb":606,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"254'40","reported_seq":531,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:02.080728+0000","last_change":"2024-06-04T16:23:02.080763+0000","last_active":"2024-06-04T16:23:02.080728+0000","last_peered":"2024-06-04T16:23:02.080728+0000","last_clean":"2024-06-04T16:23:02.080728+0000","last_became_active":"2024-06-04T15:52:42.503184+0000","last_became_peered":"2024-06-04T15:52:42.503184+0000","last_unstale":"2024-06-04T16:23:02.080728+0000","last_undegraded":"2024-06-04T16:23:02.080728+0000","last_fullsized":"2024-06-04T16:23:02.080728+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'40","last_scrub_stamp":"2024-06-04T16:23:02.080645+0000","last_deep_scrub":"254'40","last_deep_scrub_stamp":"2024-06-04T16:23:02.080645+0000","last_clean_scrub_stamp":"2024-06-04T16:23:02.080645+0000","objects_scrubbed":5,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T03:22:52.049410+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":45,"num_read_kb":40,"num_write":30,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.d","version":"254'470","reported_seq":1632,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:57.144139+0000","last_change":"2024-06-04T16:22:57.144210+0000","last_active":"2024-06-04T16:22:57.144139+0000","last_peered":"2024-06-04T16:22:57.144139+0000","last_clean":"2024-06-04T16:22:57.144139+0000","last_became_active":"2024-06-04T15:52:44.518522+0000","last_became_peered":"2024-06-04T15:52:44.518522+0000","last_unstale":"2024-06-04T16:22:57.144139+0000","last_undegraded":"2024-06-04T16:22:57.144139+0000","last_fullsized":"2024-06-04T16:22:57.144139+0000","mapping_epoch":29,"log_start":"251'400","ondisk_log_start":"251'400","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'470","last_scrub_stamp":"2024-06-04T16:22:57.144040+0000","last_deep_scrub":"254'470","last_deep_scrub_stamp":"2024-06-04T16:22:57.144040+0000","last_clean_scrub_stamp":"2024-06-04T16:22:57.144040+0000","objects_scrubbed":1,"log_size":70,"log_dups_size":400,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T02:23:07.168350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"254'25","reported_seq":494,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:00.025966+0000","last_change":"2024-06-04T15:52:46.529500+0000","last_active":"2024-06-04T16:22:00.025966+0000","last_peered":"2024-06-04T16:22:00.025966+0000","last_clean":"2024-06-04T16:22:00.025966+0000","last_became_active":"2024-06-04T15:52:46.529183+0000","last_became_peered":"2024-06-04T15:52:46.529183+0000","last_unstale":"2024-06-04T16:22:00.025966+0000","last_undegraded":"2024-06-04T16:22:00.025966+0000","last_fullsized":"2024-06-04T16:22:00.025966+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:45.513877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:45.513877+0000","last_clean_scrub_stamp":"2024-06-04T15:52:45.513877+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":33,"num_read_kb":31,"num_write":52,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"254'102","reported_seq":867,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:21:55.149989+0000","last_change":"2024-06-04T15:52:38.485496+0000","last_active":"2024-06-04T16:21:55.149989+0000","last_peered":"2024-06-04T16:21:55.149989+0000","last_clean":"2024-06-04T16:21:55.149989+0000","last_became_active":"2024-06-04T15:52:38.485146+0000","last_became_peered":"2024-06-04T15:52:38.485146+0000","last_unstale":"2024-06-04T16:21:55.149989+0000","last_undegraded":"2024-06-04T16:21:55.149989+0000","last_fullsized":"2024-06-04T16:21:55.149989+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":573,"num_read_kb":549,"num_write":116,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"251'24","reported_seq":518,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:45.550930+0000","last_change":"2024-06-04T15:52:36.475660+0000","last_active":"2024-06-04T16:22:45.550930+0000","last_peered":"2024-06-04T16:22:45.550930+0000","last_clean":"2024-06-04T16:22:45.550930+0000","last_became_active":"2024-06-04T15:52:36.475290+0000","last_became_peered":"2024-06-04T15:52:36.475290+0000","last_unstale":"2024-06-04T16:22:45.550930+0000","last_undegraded":"2024-06-04T16:22:45.550930+0000","last_fullsized":"2024-06-04T16:22:45.550930+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":22,"num_read_kb":15371,"num_write":75,"num_write_kb":21019,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,2],"acting":[4,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":475,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:21:55.029695+0000","last_change":"2024-06-04T15:52:40.482222+0000","last_active":"2024-06-04T16:21:55.029695+0000","last_peered":"2024-06-04T16:21:55.029695+0000","last_clean":"2024-06-04T16:21:55.029695+0000","last_became_active":"2024-06-04T15:52:40.481856+0000","last_became_peered":"2024-06-04T15:52:40.481856+0000","last_unstale":"2024-06-04T16:21:55.029695+0000","last_undegraded":"2024-06-04T16:21:55.029695+0000","last_fullsized":"2024-06-04T16:21:55.029695+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_clean_scrub_stamp":"2024-06-04T15:52:39.463103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"254'140","reported_seq":710,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:39.513928+0000","last_change":"2024-06-04T15:52:42.503483+0000","last_active":"2024-06-04T16:22:39.513928+0000","last_peered":"2024-06-04T16:22:39.513928+0000","last_clean":"2024-06-04T16:22:39.513928+0000","last_became_active":"2024-06-04T15:52:42.503214+0000","last_became_peered":"2024-06-04T15:52:42.503214+0000","last_unstale":"2024-06-04T16:22:39.513928+0000","last_undegraded":"2024-06-04T16:22:39.513928+0000","last_fullsized":"2024-06-04T16:22:39.513928+0000","mapping_epoch":27,"log_start":"251'100","ondisk_log_start":"251'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_clean_scrub_stamp":"2024-06-04T15:52:41.476734+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":100,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27149,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":238,"num_read_kb":318,"num_write":172,"num_write_kb":95,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":466,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:00.026012+0000","last_change":"2024-06-04T15:52:44.514586+0000","last_active":"2024-06-04T16:22:00.026012+0000","last_peered":"2024-06-04T16:22:00.026012+0000","last_clean":"2024-06-04T16:22:00.026012+0000","last_became_active":"2024-06-04T15:52:44.514269+0000","last_became_peered":"2024-06-04T15:52:44.514269+0000","last_unstale":"2024-06-04T16:22:00.026012+0000","last_undegraded":"2024-06-04T16:22:00.026012+0000","last_fullsized":"2024-06-04T16:22:00.026012+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_clean_scrub_stamp":"2024-06-04T15:52:43.492872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"254'31","reported_seq":504,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:00.150593+0000","last_change":"2024-06-04T15:52:46.532569+0000","last_active":"2024-06-04T16:22:00.150593+0000","last_peered":"2024-06-04T16:22:00.150593+0000","last_clean":"2024-06-04T16:22:00.150593+0000","last_became_active":"2024-06-04T15:52:46.531977+0000","last_became_peered":"2024-06-04T15:52:46.531977+0000","last_unstale":"2024-06-04T16:22:00.150593+0000","last_undegraded":"2024-06-04T16:22:00.150593+0000","last_fullsized":"2024-06-04T16:22:00.150593+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:45.513877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:45.513877+0000","last_clean_scrub_stamp":"2024-06-04T15:52:45.513877+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":49,"num_write":79,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"254'144","reported_seq":953,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:21:55.029663+0000","last_change":"2024-06-04T15:52:38.478958+0000","last_active":"2024-06-04T16:21:55.029663+0000","last_peered":"2024-06-04T16:21:55.029663+0000","last_clean":"2024-06-04T16:21:55.029663+0000","last_became_active":"2024-06-04T15:52:38.478362+0000","last_became_peered":"2024-06-04T15:52:38.478362+0000","last_unstale":"2024-06-04T16:21:55.029663+0000","last_undegraded":"2024-06-04T16:21:55.029663+0000","last_fullsized":"2024-06-04T16:21:55.029663+0000","mapping_epoch":23,"log_start":"251'100","ondisk_log_start":"251'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":807,"num_read_kb":748,"num_write":182,"num_write_kb":49,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":497,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:29.919383+0000","last_change":"2024-06-04T15:52:22.417765+0000","last_active":"2024-06-04T16:22:29.919383+0000","last_peered":"2024-06-04T16:22:29.919383+0000","last_clean":"2024-06-04T16:22:29.919383+0000","last_became_active":"2024-06-04T15:52:22.417462+0000","last_became_peered":"2024-06-04T15:52:22.417462+0000","last_unstale":"2024-06-04T16:22:29.919383+0000","last_undegraded":"2024-06-04T16:22:29.919383+0000","last_fullsized":"2024-06-04T16:22:29.919383+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:21.400880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:21.400880+0000","last_clean_scrub_stamp":"2024-06-04T15:52:21.400880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"251'43","reported_seq":535,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:21:50.036329+0000","last_change":"2024-06-04T15:52:36.498057+0000","last_active":"2024-06-04T16:21:50.036329+0000","last_peered":"2024-06-04T16:21:50.036329+0000","last_clean":"2024-06-04T16:21:50.036329+0000","last_became_active":"2024-06-04T15:52:36.497603+0000","last_became_peered":"2024-06-04T15:52:36.497603+0000","last_unstale":"2024-06-04T16:21:50.036329+0000","last_undegraded":"2024-06-04T16:21:50.036329+0000","last_fullsized":"2024-06-04T16:21:50.036329+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1069190,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":32,"num_read_kb":263,"num_write":148,"num_write_kb":16917,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,0],"acting":[4,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":487,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:51.867953+0000","last_change":"2024-06-04T16:22:51.867979+0000","last_active":"2024-06-04T16:22:51.867953+0000","last_peered":"2024-06-04T16:22:51.867953+0000","last_clean":"2024-06-04T16:22:51.867953+0000","last_became_active":"2024-06-04T15:52:40.482529+0000","last_became_peered":"2024-06-04T15:52:40.482529+0000","last_unstale":"2024-06-04T16:22:51.867953+0000","last_undegraded":"2024-06-04T16:22:51.867953+0000","last_fullsized":"2024-06-04T16:22:51.867953+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:22:51.867794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:22:51.867794+0000","last_clean_scrub_stamp":"2024-06-04T16:22:51.867794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T17:42:46.966148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"254'241","reported_seq":914,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:45.077250+0000","last_change":"2024-06-04T15:52:42.497154+0000","last_active":"2024-06-04T16:22:45.077250+0000","last_peered":"2024-06-04T16:22:45.077250+0000","last_clean":"2024-06-04T16:22:45.077250+0000","last_became_active":"2024-06-04T15:52:42.496878+0000","last_became_peered":"2024-06-04T15:52:42.496878+0000","last_unstale":"2024-06-04T16:22:45.077250+0000","last_undegraded":"2024-06-04T16:22:45.077250+0000","last_fullsized":"2024-06-04T16:22:45.077250+0000","mapping_epoch":27,"log_start":"251'200","ondisk_log_start":"251'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_clean_scrub_stamp":"2024-06-04T15:52:41.476734+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":200,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30577,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":489,"num_read_kb":691,"num_write":394,"num_write_kb":281,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":471,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:46.023725+0000","last_change":"2024-06-04T15:52:44.514011+0000","last_active":"2024-06-04T16:22:46.023725+0000","last_peered":"2024-06-04T16:22:46.023725+0000","last_clean":"2024-06-04T16:22:46.023725+0000","last_became_active":"2024-06-04T15:52:44.513726+0000","last_became_peered":"2024-06-04T15:52:44.513726+0000","last_unstale":"2024-06-04T16:22:46.023725+0000","last_undegraded":"2024-06-04T16:22:46.023725+0000","last_fullsized":"2024-06-04T16:22:46.023725+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_clean_scrub_stamp":"2024-06-04T15:52:43.492872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"254'34","reported_seq":517,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:21:00.017570+0000","last_change":"2024-06-04T15:52:46.536565+0000","last_active":"2024-06-04T16:21:00.017570+0000","last_peered":"2024-06-04T16:21:00.017570+0000","last_clean":"2024-06-04T16:21:00.017570+0000","last_became_active":"2024-06-04T15:52:46.536184+0000","last_became_peered":"2024-06-04T15:52:46.536184+0000","last_unstale":"2024-06-04T16:21:00.017570+0000","last_undegraded":"2024-06-04T16:21:00.017570+0000","last_fullsized":"2024-06-04T16:21:00.017570+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:45.513877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:45.513877+0000","last_clean_scrub_stamp":"2024-06-04T15:52:45.513877+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":408,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":64,"num_read_kb":61,"num_write":79,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"254'172","reported_seq":974,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:21:50.035951+0000","last_change":"2024-06-04T15:52:38.474997+0000","last_active":"2024-06-04T16:21:50.035951+0000","last_peered":"2024-06-04T16:21:50.035951+0000","last_clean":"2024-06-04T16:21:50.035951+0000","last_became_active":"2024-06-04T15:52:38.474646+0000","last_became_peered":"2024-06-04T15:52:38.474646+0000","last_unstale":"2024-06-04T16:21:50.035951+0000","last_undegraded":"2024-06-04T16:21:50.035951+0000","last_fullsized":"2024-06-04T16:21:50.035951+0000","mapping_epoch":23,"log_start":"251'100","ondisk_log_start":"251'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":100,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":944,"num_read_kb":866,"num_write":217,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":494,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:21:30.026717+0000","last_change":"2024-06-04T15:52:22.777198+0000","last_active":"2024-06-04T16:21:30.026717+0000","last_peered":"2024-06-04T16:21:30.026717+0000","last_clean":"2024-06-04T16:21:30.026717+0000","last_became_active":"2024-06-04T15:52:22.776779+0000","last_became_peered":"2024-06-04T15:52:22.776779+0000","last_unstale":"2024-06-04T16:21:30.026717+0000","last_undegraded":"2024-06-04T16:21:30.026717+0000","last_fullsized":"2024-06-04T16:21:30.026717+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:21.400880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:21.400880+0000","last_clean_scrub_stamp":"2024-06-04T15:52:21.400880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"251'43","reported_seq":540,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:21:50.022470+0000","last_change":"2024-06-04T15:52:36.495013+0000","last_active":"2024-06-04T16:21:50.022470+0000","last_peered":"2024-06-04T16:21:50.022470+0000","last_clean":"2024-06-04T16:21:50.022470+0000","last_became_active":"2024-06-04T15:52:36.494711+0000","last_became_peered":"2024-06-04T15:52:36.494711+0000","last_unstale":"2024-06-04T16:21:50.022470+0000","last_undegraded":"2024-06-04T16:21:50.022470+0000","last_fullsized":"2024-06-04T16:21:50.022470+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20644,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":32,"num_read_kb":101,"num_write":157,"num_write_kb":20554,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,4],"acting":[0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":477,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:21:50.149265+0000","last_change":"2024-06-04T15:52:40.485086+0000","last_active":"2024-06-04T16:21:50.149265+0000","last_peered":"2024-06-04T16:21:50.149265+0000","last_clean":"2024-06-04T16:21:50.149265+0000","last_became_active":"2024-06-04T15:52:40.484698+0000","last_became_peered":"2024-06-04T15:52:40.484698+0000","last_unstale":"2024-06-04T16:21:50.149265+0000","last_undegraded":"2024-06-04T16:21:50.149265+0000","last_fullsized":"2024-06-04T16:21:50.149265+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_clean_scrub_stamp":"2024-06-04T15:52:39.463103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"251'83","reported_seq":591,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:46.023693+0000","last_change":"2024-06-04T15:52:42.500941+0000","last_active":"2024-06-04T16:22:46.023693+0000","last_peered":"2024-06-04T16:22:46.023693+0000","last_clean":"2024-06-04T16:22:46.023693+0000","last_became_active":"2024-06-04T15:52:42.500646+0000","last_became_peered":"2024-06-04T15:52:42.500646+0000","last_unstale":"2024-06-04T16:22:46.023693+0000","last_undegraded":"2024-06-04T16:22:46.023693+0000","last_fullsized":"2024-06-04T16:22:46.023693+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_clean_scrub_stamp":"2024-06-04T15:52:41.476734+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":102,"num_read_kb":94,"num_write":72,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":476,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:03.864415+0000","last_change":"2024-06-04T16:23:03.864415+0000","last_active":"2024-06-04T16:23:03.864415+0000","last_peered":"2024-06-04T16:23:03.864415+0000","last_clean":"2024-06-04T16:23:03.864415+0000","last_became_active":"2024-06-04T15:52:44.520841+0000","last_became_peered":"2024-06-04T15:52:44.520841+0000","last_unstale":"2024-06-04T16:23:03.864415+0000","last_undegraded":"2024-06-04T16:23:03.864415+0000","last_fullsized":"2024-06-04T16:23:03.864415+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:23:03.864261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:23:03.864261+0000","last_clean_scrub_stamp":"2024-06-04T16:23:03.864261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T18:09:32.795774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"251'34","reported_seq":543,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:51.136291+0000","last_change":"2024-06-04T16:22:51.136365+0000","last_active":"2024-06-04T16:22:51.136291+0000","last_peered":"2024-06-04T16:22:51.136291+0000","last_clean":"2024-06-04T16:22:51.136291+0000","last_became_active":"2024-06-04T15:52:46.539931+0000","last_became_peered":"2024-06-04T15:52:46.539931+0000","last_unstale":"2024-06-04T16:22:51.136291+0000","last_undegraded":"2024-06-04T16:22:51.136291+0000","last_fullsized":"2024-06-04T16:22:51.136291+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"251'34","last_scrub_stamp":"2024-06-04T16:22:51.136181+0000","last_deep_scrub":"251'34","last_deep_scrub_stamp":"2024-06-04T16:22:51.136181+0000","last_clean_scrub_stamp":"2024-06-04T16:22:51.136181+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T19:05:15.366957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":127,"num_read_kb":111,"num_write":92,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"254'121","reported_seq":1040,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:03.065206+0000","last_change":"2024-06-04T16:23:03.065255+0000","last_active":"2024-06-04T16:23:03.065206+0000","last_peered":"2024-06-04T16:23:03.065206+0000","last_clean":"2024-06-04T16:23:03.065206+0000","last_became_active":"2024-06-04T15:52:38.485755+0000","last_became_peered":"2024-06-04T15:52:38.485755+0000","last_unstale":"2024-06-04T16:23:03.065206+0000","last_undegraded":"2024-06-04T16:23:03.065206+0000","last_fullsized":"2024-06-04T16:23:03.065206+0000","mapping_epoch":23,"log_start":"254'100","ondisk_log_start":"254'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'121","last_scrub_stamp":"2024-06-04T16:23:03.065085+0000","last_deep_scrub":"254'121","last_deep_scrub_stamp":"2024-06-04T16:23:03.065085+0000","last_clean_scrub_stamp":"2024-06-04T16:23:03.065085+0000","objects_scrubbed":2,"log_size":21,"log_dups_size":100,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T17:34:01.981275+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":989,"num_read_kb":963,"num_write":137,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2286,"num_omap_keys":9,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":496,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:21:35.020936+0000","last_change":"2024-06-04T15:52:22.423235+0000","last_active":"2024-06-04T16:21:35.020936+0000","last_peered":"2024-06-04T16:21:35.020936+0000","last_clean":"2024-06-04T16:21:35.020936+0000","last_became_active":"2024-06-04T15:52:22.422971+0000","last_became_peered":"2024-06-04T15:52:22.422971+0000","last_unstale":"2024-06-04T16:21:35.020936+0000","last_undegraded":"2024-06-04T16:21:35.020936+0000","last_fullsized":"2024-06-04T16:21:35.020936+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:21.400880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:21.400880+0000","last_clean_scrub_stamp":"2024-06-04T15:52:21.400880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"254'72","reported_seq":613,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:45.044128+0000","last_change":"2024-06-04T15:52:36.485796+0000","last_active":"2024-06-04T16:22:45.044128+0000","last_peered":"2024-06-04T16:22:45.044128+0000","last_clean":"2024-06-04T16:22:45.044128+0000","last_became_active":"2024-06-04T15:52:36.485475+0000","last_became_peered":"2024-06-04T15:52:36.485475+0000","last_unstale":"2024-06-04T16:22:45.044128+0000","last_undegraded":"2024-06-04T16:22:45.044128+0000","last_fullsized":"2024-06-04T16:22:45.044128+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":109,"num_read_kb":62832,"num_write":269,"num_write_kb":45136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,2],"acting":[5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"26'1","reported_seq":478,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:46.972333+0000","last_change":"2024-06-04T15:52:40.486597+0000","last_active":"2024-06-04T16:22:46.972333+0000","last_peered":"2024-06-04T16:22:46.972333+0000","last_clean":"2024-06-04T16:22:46.972333+0000","last_became_active":"2024-06-04T15:52:40.486003+0000","last_became_peered":"2024-06-04T15:52:40.486003+0000","last_unstale":"2024-06-04T16:22:46.972333+0000","last_undegraded":"2024-06-04T16:22:46.972333+0000","last_fullsized":"2024-06-04T16:22:46.972333+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_clean_scrub_stamp":"2024-06-04T15:52:39.463103+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"254'124","reported_seq":1007,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:57.787192+0000","last_change":"2024-06-04T16:22:57.787246+0000","last_active":"2024-06-04T16:22:57.787192+0000","last_peered":"2024-06-04T16:22:57.787192+0000","last_clean":"2024-06-04T16:22:57.787192+0000","last_became_active":"2024-06-04T15:52:42.505250+0000","last_became_peered":"2024-06-04T15:52:42.505250+0000","last_unstale":"2024-06-04T16:22:57.787192+0000","last_undegraded":"2024-06-04T16:22:57.787192+0000","last_fullsized":"2024-06-04T16:22:57.787192+0000","mapping_epoch":27,"log_start":"251'100","ondisk_log_start":"251'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'124","last_scrub_stamp":"2024-06-04T16:22:57.787100+0000","last_deep_scrub":"254'124","last_deep_scrub_stamp":"2024-06-04T16:22:57.787100+0000","last_clean_scrub_stamp":"2024-06-04T16:22:57.787100+0000","objects_scrubbed":8,"log_size":24,"log_dups_size":100,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T22:01:32.859318+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":113,"num_read_kb":103,"num_write":67,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":477,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:51.009073+0000","last_change":"2024-06-04T16:22:51.009109+0000","last_active":"2024-06-04T16:22:51.009073+0000","last_peered":"2024-06-04T16:22:51.009073+0000","last_clean":"2024-06-04T16:22:51.009073+0000","last_became_active":"2024-06-04T15:52:44.522168+0000","last_became_peered":"2024-06-04T15:52:44.522168+0000","last_unstale":"2024-06-04T16:22:51.009073+0000","last_undegraded":"2024-06-04T16:22:51.009073+0000","last_fullsized":"2024-06-04T16:22:51.009073+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:22:51.008969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:22:51.008969+0000","last_clean_scrub_stamp":"2024-06-04T16:22:51.008969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T17:53:46.600382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.b","version":"254'112","reported_seq":611,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:46.992773+0000","last_change":"2024-06-04T16:22:46.992832+0000","last_active":"2024-06-04T16:22:46.992773+0000","last_peered":"2024-06-04T16:22:46.992773+0000","last_clean":"2024-06-04T16:22:46.992773+0000","last_became_active":"2024-06-04T15:52:46.537377+0000","last_became_peered":"2024-06-04T15:52:46.537377+0000","last_unstale":"2024-06-04T16:22:46.992773+0000","last_undegraded":"2024-06-04T16:22:46.992773+0000","last_fullsized":"2024-06-04T16:22:46.992773+0000","mapping_epoch":31,"log_start":"251'100","ondisk_log_start":"251'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'112","last_scrub_stamp":"2024-06-04T16:22:46.992648+0000","last_deep_scrub":"254'112","last_deep_scrub_stamp":"2024-06-04T16:22:46.992648+0000","last_clean_scrub_stamp":"2024-06-04T16:22:46.992648+0000","objects_scrubbed":1,"log_size":12,"log_dups_size":100,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T19:14:15.808220+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":232,"num_read_kb":256,"num_write":227,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":851,"num_omap_keys":5,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.6","version":"254'74","reported_seq":767,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:46.023459+0000","last_change":"2024-06-04T15:52:38.487720+0000","last_active":"2024-06-04T16:22:46.023459+0000","last_peered":"2024-06-04T16:22:46.023459+0000","last_clean":"2024-06-04T16:22:46.023459+0000","last_became_active":"2024-06-04T15:52:38.487359+0000","last_became_peered":"2024-06-04T15:52:38.487359+0000","last_unstale":"2024-06-04T16:22:46.023459+0000","last_undegraded":"2024-06-04T16:22:46.023459+0000","last_fullsized":"2024-06-04T16:22:46.023459+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":431,"num_read_kb":414,"num_write":84,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":495,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:21:35.034308+0000","last_change":"2024-06-04T15:52:22.423963+0000","last_active":"2024-06-04T16:21:35.034308+0000","last_peered":"2024-06-04T16:21:35.034308+0000","last_clean":"2024-06-04T16:21:35.034308+0000","last_became_active":"2024-06-04T15:52:22.423712+0000","last_became_peered":"2024-06-04T15:52:22.423712+0000","last_unstale":"2024-06-04T16:21:35.034308+0000","last_undegraded":"2024-06-04T16:21:35.034308+0000","last_fullsized":"2024-06-04T16:21:35.034308+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:21.400880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:21.400880+0000","last_clean_scrub_stamp":"2024-06-04T15:52:21.400880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"17'72","reported_seq":585,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:30.033585+0000","last_change":"2024-06-04T15:52:22.429522+0000","last_active":"2024-06-04T16:22:30.033585+0000","last_peered":"2024-06-04T16:22:30.033585+0000","last_clean":"2024-06-04T16:22:30.033585+0000","last_became_active":"2024-06-04T15:52:22.428356+0000","last_became_peered":"2024-06-04T15:52:22.428356+0000","last_unstale":"2024-06-04T16:22:30.033585+0000","last_undegraded":"2024-06-04T16:22:30.033585+0000","last_fullsized":"2024-06-04T16:22:30.033585+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:21.400880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:21.400880+0000","last_clean_scrub_stamp":"2024-06-04T15:52:21.400880+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"254'72","reported_seq":581,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:21:50.035836+0000","last_change":"2024-06-04T15:52:36.488969+0000","last_active":"2024-06-04T16:21:50.035836+0000","last_peered":"2024-06-04T16:21:50.035836+0000","last_clean":"2024-06-04T16:21:50.035836+0000","last_became_active":"2024-06-04T15:52:36.488567+0000","last_became_peered":"2024-06-04T15:52:36.488567+0000","last_unstale":"2024-06-04T16:21:50.035836+0000","last_undegraded":"2024-06-04T16:21:50.035836+0000","last_fullsized":"2024-06-04T16:21:50.035836+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133705,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":100,"num_read_kb":15171,"num_write":323,"num_write_kb":30782,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,4],"acting":[6,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":476,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:45.077140+0000","last_change":"2024-06-04T15:52:40.479422+0000","last_active":"2024-06-04T16:22:45.077140+0000","last_peered":"2024-06-04T16:22:45.077140+0000","last_clean":"2024-06-04T16:22:45.077140+0000","last_became_active":"2024-06-04T15:52:40.479168+0000","last_became_peered":"2024-06-04T15:52:40.479168+0000","last_unstale":"2024-06-04T16:22:45.077140+0000","last_undegraded":"2024-06-04T16:22:45.077140+0000","last_fullsized":"2024-06-04T16:22:45.077140+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_clean_scrub_stamp":"2024-06-04T15:52:39.463103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"254'560","reported_seq":1738,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:39.572867+0000","last_change":"2024-06-04T15:52:42.503507+0000","last_active":"2024-06-04T16:22:39.572867+0000","last_peered":"2024-06-04T16:22:39.572867+0000","last_clean":"2024-06-04T16:22:39.572867+0000","last_became_active":"2024-06-04T15:52:42.503178+0000","last_became_peered":"2024-06-04T15:52:42.503178+0000","last_unstale":"2024-06-04T16:22:39.572867+0000","last_undegraded":"2024-06-04T16:22:39.572867+0000","last_fullsized":"2024-06-04T16:22:39.572867+0000","mapping_epoch":27,"log_start":"251'500","ondisk_log_start":"251'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_clean_scrub_stamp":"2024-06-04T15:52:41.476734+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":500,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29662,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":838,"num_read_kb":1049,"num_write":188,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":476,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:01.876753+0000","last_change":"2024-06-04T16:23:01.876775+0000","last_active":"2024-06-04T16:23:01.876753+0000","last_peered":"2024-06-04T16:23:01.876753+0000","last_clean":"2024-06-04T16:23:01.876753+0000","last_became_active":"2024-06-04T15:52:44.522475+0000","last_became_peered":"2024-06-04T15:52:44.522475+0000","last_unstale":"2024-06-04T16:23:01.876753+0000","last_undegraded":"2024-06-04T16:23:01.876753+0000","last_fullsized":"2024-06-04T16:23:01.876753+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:23:01.876659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:23:01.876659+0000","last_clean_scrub_stamp":"2024-06-04T16:23:01.876659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T18:04:59.431933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"254'73","reported_seq":567,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:59.496666+0000","last_change":"2024-06-04T16:22:59.496703+0000","last_active":"2024-06-04T16:22:59.496666+0000","last_peered":"2024-06-04T16:22:59.496666+0000","last_clean":"2024-06-04T16:22:59.496666+0000","last_became_active":"2024-06-04T15:52:46.541851+0000","last_became_peered":"2024-06-04T15:52:46.541851+0000","last_unstale":"2024-06-04T16:22:59.496666+0000","last_undegraded":"2024-06-04T16:22:59.496666+0000","last_fullsized":"2024-06-04T16:22:59.496666+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'73","last_scrub_stamp":"2024-06-04T16:22:59.496568+0000","last_deep_scrub":"254'73","last_deep_scrub_stamp":"2024-06-04T16:22:59.496568+0000","last_clean_scrub_stamp":"2024-06-04T16:22:59.496568+0000","objects_scrubbed":2,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T03:49:46.316753+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":147,"num_read_kb":147,"num_write":159,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1","version":"254'115","reported_seq":821,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:02.473712+0000","last_change":"2024-06-04T16:23:02.473738+0000","last_active":"2024-06-04T16:23:02.473712+0000","last_peered":"2024-06-04T16:23:02.473712+0000","last_clean":"2024-06-04T16:23:02.473712+0000","last_became_active":"2024-06-04T15:52:38.485314+0000","last_became_peered":"2024-06-04T15:52:38.485314+0000","last_unstale":"2024-06-04T16:23:02.473712+0000","last_undegraded":"2024-06-04T16:23:02.473712+0000","last_fullsized":"2024-06-04T16:23:02.473712+0000","mapping_epoch":23,"log_start":"251'100","ondisk_log_start":"251'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'115","last_scrub_stamp":"2024-06-04T16:23:02.473618+0000","last_deep_scrub":"254'115","last_deep_scrub_stamp":"2024-06-04T16:23:02.473618+0000","last_clean_scrub_stamp":"2024-06-04T16:23:02.473618+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":100,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T21:11:06.521739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":554,"num_read_kb":505,"num_write":149,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"251'78","reported_seq":589,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:45.550844+0000","last_change":"2024-06-04T15:52:36.479114+0000","last_active":"2024-06-04T16:22:45.550844+0000","last_peered":"2024-06-04T16:22:45.550844+0000","last_clean":"2024-06-04T16:22:45.550844+0000","last_became_active":"2024-06-04T15:52:36.478729+0000","last_became_peered":"2024-06-04T15:52:36.478729+0000","last_unstale":"2024-06-04T16:22:45.550844+0000","last_undegraded":"2024-06-04T16:22:45.550844+0000","last_fullsized":"2024-06-04T16:22:45.550844+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6659325,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":108,"num_read_kb":2222,"num_write":295,"num_write_kb":32111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,1],"acting":[4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":495,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:21:35.147082+0000","last_change":"2024-06-04T15:52:22.429208+0000","last_active":"2024-06-04T16:21:35.147082+0000","last_peered":"2024-06-04T16:21:35.147082+0000","last_clean":"2024-06-04T16:21:35.147082+0000","last_became_active":"2024-06-04T15:52:22.428894+0000","last_became_peered":"2024-06-04T15:52:22.428894+0000","last_unstale":"2024-06-04T16:21:35.147082+0000","last_undegraded":"2024-06-04T16:21:35.147082+0000","last_fullsized":"2024-06-04T16:21:35.147082+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:21.400880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:21.400880+0000","last_clean_scrub_stamp":"2024-06-04T15:52:21.400880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":486,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:04.014754+0000","last_change":"2024-06-04T16:23:04.014781+0000","last_active":"2024-06-04T16:23:04.014754+0000","last_peered":"2024-06-04T16:23:04.014754+0000","last_clean":"2024-06-04T16:23:04.014754+0000","last_became_active":"2024-06-04T15:52:40.478970+0000","last_became_peered":"2024-06-04T15:52:40.478970+0000","last_unstale":"2024-06-04T16:23:04.014754+0000","last_undegraded":"2024-06-04T16:23:04.014754+0000","last_fullsized":"2024-06-04T16:23:04.014754+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:23:04.014648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:23:04.014648+0000","last_clean_scrub_stamp":"2024-06-04T16:23:04.014648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T00:47:22.385623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"254'260","reported_seq":953,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:59.781740+0000","last_change":"2024-06-04T16:22:59.781790+0000","last_active":"2024-06-04T16:22:59.781740+0000","last_peered":"2024-06-04T16:22:59.781740+0000","last_clean":"2024-06-04T16:22:59.781740+0000","last_became_active":"2024-06-04T15:52:42.504735+0000","last_became_peered":"2024-06-04T15:52:42.504735+0000","last_unstale":"2024-06-04T16:22:59.781740+0000","last_undegraded":"2024-06-04T16:22:59.781740+0000","last_fullsized":"2024-06-04T16:22:59.781740+0000","mapping_epoch":27,"log_start":"251'200","ondisk_log_start":"251'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'260","last_scrub_stamp":"2024-06-04T16:22:59.781648+0000","last_deep_scrub":"254'260","last_deep_scrub_stamp":"2024-06-04T16:22:59.781648+0000","last_clean_scrub_stamp":"2024-06-04T16:22:59.781648+0000","objects_scrubbed":8,"log_size":60,"log_dups_size":200,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T20:43:24.750395+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20543,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":406,"num_read_kb":567,"num_write":188,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":477,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:50.024396+0000","last_change":"2024-06-04T16:22:50.024418+0000","last_active":"2024-06-04T16:22:50.024396+0000","last_peered":"2024-06-04T16:22:50.024396+0000","last_clean":"2024-06-04T16:22:50.024396+0000","last_became_active":"2024-06-04T15:52:44.522746+0000","last_became_peered":"2024-06-04T15:52:44.522746+0000","last_unstale":"2024-06-04T16:22:50.024396+0000","last_undegraded":"2024-06-04T16:22:50.024396+0000","last_fullsized":"2024-06-04T16:22:50.024396+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:22:50.024298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:22:50.024298+0000","last_clean_scrub_stamp":"2024-06-04T16:22:50.024298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T19:45:37.463155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.d","version":"254'30","reported_seq":511,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:56.543517+0000","last_change":"2024-06-04T16:22:56.543557+0000","last_active":"2024-06-04T16:22:56.543517+0000","last_peered":"2024-06-04T16:22:56.543517+0000","last_clean":"2024-06-04T16:22:56.543517+0000","last_became_active":"2024-06-04T15:52:46.530480+0000","last_became_peered":"2024-06-04T15:52:46.530480+0000","last_unstale":"2024-06-04T16:22:56.543517+0000","last_undegraded":"2024-06-04T16:22:56.543517+0000","last_fullsized":"2024-06-04T16:22:56.543517+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'30","last_scrub_stamp":"2024-06-04T16:22:56.543418+0000","last_deep_scrub":"254'30","last_deep_scrub_stamp":"2024-06-04T16:22:56.543418+0000","last_clean_scrub_stamp":"2024-06-04T16:22:56.543418+0000","objects_scrubbed":4,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T22:30:49.547884+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":260,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":42,"num_read_kb":31,"num_write":58,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"254'173","reported_seq":1004,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:45.550967+0000","last_change":"2024-06-04T15:52:38.485046+0000","last_active":"2024-06-04T16:22:45.550967+0000","last_peered":"2024-06-04T16:22:45.550967+0000","last_clean":"2024-06-04T16:22:45.550967+0000","last_became_active":"2024-06-04T15:52:38.484384+0000","last_became_peered":"2024-06-04T15:52:38.484384+0000","last_unstale":"2024-06-04T16:22:45.550967+0000","last_undegraded":"2024-06-04T16:22:45.550967+0000","last_fullsized":"2024-06-04T16:22:45.550967+0000","mapping_epoch":23,"log_start":"251'100","ondisk_log_start":"251'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":100,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":881,"num_read_kb":808,"num_write":233,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"251'46","reported_seq":545,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:45.550845+0000","last_change":"2024-06-04T15:52:36.478112+0000","last_active":"2024-06-04T16:22:45.550845+0000","last_peered":"2024-06-04T16:22:45.550845+0000","last_clean":"2024-06-04T16:22:45.550845+0000","last_became_active":"2024-06-04T15:52:36.477622+0000","last_became_peered":"2024-06-04T15:52:36.477622+0000","last_unstale":"2024-06-04T16:22:45.550845+0000","last_undegraded":"2024-06-04T16:22:45.550845+0000","last_fullsized":"2024-06-04T16:22:45.550845+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":45,"num_write":152,"num_write_kb":28742,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":493,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:21:40.023905+0000","last_change":"2024-06-04T15:52:22.777104+0000","last_active":"2024-06-04T16:21:40.023905+0000","last_peered":"2024-06-04T16:21:40.023905+0000","last_clean":"2024-06-04T16:21:40.023905+0000","last_became_active":"2024-06-04T15:52:22.776744+0000","last_became_peered":"2024-06-04T15:52:22.776744+0000","last_unstale":"2024-06-04T16:21:40.023905+0000","last_undegraded":"2024-06-04T16:21:40.023905+0000","last_fullsized":"2024-06-04T16:21:40.023905+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:21.400880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:21.400880+0000","last_clean_scrub_stamp":"2024-06-04T15:52:21.400880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":476,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:21:50.029009+0000","last_change":"2024-06-04T15:52:40.479829+0000","last_active":"2024-06-04T16:21:50.029009+0000","last_peered":"2024-06-04T16:21:50.029009+0000","last_clean":"2024-06-04T16:21:50.029009+0000","last_became_active":"2024-06-04T15:52:40.479319+0000","last_became_peered":"2024-06-04T15:52:40.479319+0000","last_unstale":"2024-06-04T16:21:50.029009+0000","last_undegraded":"2024-06-04T16:21:50.029009+0000","last_fullsized":"2024-06-04T16:21:50.029009+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_clean_scrub_stamp":"2024-06-04T15:52:39.463103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"251'66","reported_seq":568,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:21:55.029632+0000","last_change":"2024-06-04T15:52:42.500455+0000","last_active":"2024-06-04T16:21:55.029632+0000","last_peered":"2024-06-04T16:21:55.029632+0000","last_clean":"2024-06-04T16:21:55.029632+0000","last_became_active":"2024-06-04T15:52:42.500141+0000","last_became_peered":"2024-06-04T15:52:42.500141+0000","last_unstale":"2024-06-04T16:21:55.029632+0000","last_undegraded":"2024-06-04T16:21:55.029632+0000","last_fullsized":"2024-06-04T16:21:55.029632+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_clean_scrub_stamp":"2024-06-04T15:52:41.476734+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":90,"num_read_kb":83,"num_write":60,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"254'479","reported_seq":1475,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:39.578794+0000","last_change":"2024-06-04T15:52:44.517489+0000","last_active":"2024-06-04T16:22:39.578794+0000","last_peered":"2024-06-04T16:22:39.578794+0000","last_clean":"2024-06-04T16:22:39.578794+0000","last_became_active":"2024-06-04T15:52:44.517202+0000","last_became_peered":"2024-06-04T15:52:44.517202+0000","last_unstale":"2024-06-04T16:22:39.578794+0000","last_undegraded":"2024-06-04T16:22:39.578794+0000","last_fullsized":"2024-06-04T16:22:39.578794+0000","mapping_epoch":29,"log_start":"251'400","ondisk_log_start":"251'400","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_clean_scrub_stamp":"2024-06-04T15:52:43.492872+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":400,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.c","version":"254'27","reported_seq":504,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:01.472577+0000","last_change":"2024-06-04T16:23:01.472605+0000","last_active":"2024-06-04T16:23:01.472577+0000","last_peered":"2024-06-04T16:23:01.472577+0000","last_clean":"2024-06-04T16:23:01.472577+0000","last_became_active":"2024-06-04T15:52:46.538975+0000","last_became_peered":"2024-06-04T15:52:46.538975+0000","last_unstale":"2024-06-04T16:23:01.472577+0000","last_undegraded":"2024-06-04T16:23:01.472577+0000","last_fullsized":"2024-06-04T16:23:01.472577+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'27","last_scrub_stamp":"2024-06-04T16:23:01.472476+0000","last_deep_scrub":"254'27","last_deep_scrub_stamp":"2024-06-04T16:23:01.472476+0000","last_clean_scrub_stamp":"2024-06-04T16:23:01.472476+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T19:18:35.432866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":27,"num_write":64,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3","version":"254'180","reported_seq":1075,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:05.040707+0000","last_change":"2024-06-04T16:23:05.040749+0000","last_active":"2024-06-04T16:23:05.040707+0000","last_peered":"2024-06-04T16:23:05.040707+0000","last_clean":"2024-06-04T16:23:05.040707+0000","last_became_active":"2024-06-04T15:52:38.482240+0000","last_became_peered":"2024-06-04T15:52:38.482240+0000","last_unstale":"2024-06-04T16:23:05.040707+0000","last_undegraded":"2024-06-04T16:23:05.040707+0000","last_fullsized":"2024-06-04T16:23:05.040707+0000","mapping_epoch":23,"log_start":"251'100","ondisk_log_start":"251'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'180","last_scrub_stamp":"2024-06-04T16:23:05.040592+0000","last_deep_scrub":"254'180","last_deep_scrub_stamp":"2024-06-04T16:23:05.040592+0000","last_clean_scrub_stamp":"2024-06-04T16:23:05.040592+0000","objects_scrubbed":1,"log_size":80,"log_dups_size":100,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T23:58:37.248398+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1045,"num_read_kb":968,"num_write":230,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2044,"num_omap_keys":8,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"251'34","reported_seq":525,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:21:50.035935+0000","last_change":"2024-06-04T15:52:36.478791+0000","last_active":"2024-06-04T16:21:50.035935+0000","last_peered":"2024-06-04T16:21:50.035935+0000","last_clean":"2024-06-04T16:21:50.035935+0000","last_became_active":"2024-06-04T15:52:36.478441+0000","last_became_peered":"2024-06-04T15:52:36.478441+0000","last_unstale":"2024-06-04T16:21:50.035935+0000","last_undegraded":"2024-06-04T16:21:50.035935+0000","last_fullsized":"2024-06-04T16:21:50.035935+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":32,"num_read_kb":7500,"num_write":131,"num_write_kb":23723,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,4],"acting":[6,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":494,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:40.034928+0000","last_change":"2024-06-04T15:52:22.777126+0000","last_active":"2024-06-04T16:22:40.034928+0000","last_peered":"2024-06-04T16:22:40.034928+0000","last_clean":"2024-06-04T16:22:40.034928+0000","last_became_active":"2024-06-04T15:52:22.776729+0000","last_became_peered":"2024-06-04T15:52:22.776729+0000","last_unstale":"2024-06-04T16:22:40.034928+0000","last_undegraded":"2024-06-04T16:22:40.034928+0000","last_fullsized":"2024-06-04T16:22:40.034928+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:21.400880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:21.400880+0000","last_clean_scrub_stamp":"2024-06-04T15:52:21.400880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":487,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:49.871886+0000","last_change":"2024-06-04T16:22:49.871915+0000","last_active":"2024-06-04T16:22:49.871886+0000","last_peered":"2024-06-04T16:22:49.871886+0000","last_clean":"2024-06-04T16:22:49.871886+0000","last_became_active":"2024-06-04T15:52:40.481870+0000","last_became_peered":"2024-06-04T15:52:40.481870+0000","last_unstale":"2024-06-04T16:22:49.871886+0000","last_undegraded":"2024-06-04T16:22:49.871886+0000","last_fullsized":"2024-06-04T16:22:49.871886+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:22:49.871770+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:22:49.871770+0000","last_clean_scrub_stamp":"2024-06-04T16:22:49.871770+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T03:25:40.274941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"254'107","reported_seq":635,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:00.026044+0000","last_change":"2024-06-04T16:23:00.026083+0000","last_active":"2024-06-04T16:23:00.026044+0000","last_peered":"2024-06-04T16:23:00.026044+0000","last_clean":"2024-06-04T16:23:00.026044+0000","last_became_active":"2024-06-04T15:52:42.501708+0000","last_became_peered":"2024-06-04T15:52:42.501708+0000","last_unstale":"2024-06-04T16:23:00.026044+0000","last_undegraded":"2024-06-04T16:23:00.026044+0000","last_fullsized":"2024-06-04T16:23:00.026044+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'107","last_scrub_stamp":"2024-06-04T16:23:00.025948+0000","last_deep_scrub":"254'107","last_deep_scrub_stamp":"2024-06-04T16:23:00.025948+0000","last_clean_scrub_stamp":"2024-06-04T16:23:00.025948+0000","objects_scrubbed":8,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T18:12:41.006932+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":147,"num_read_kb":140,"num_write":98,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":330,"num_omap_keys":2,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.0","version":"254'470","reported_seq":1650,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:44.133540+0000","last_change":"2024-06-04T15:52:44.517953+0000","last_active":"2024-06-04T16:22:44.133540+0000","last_peered":"2024-06-04T16:22:44.133540+0000","last_clean":"2024-06-04T16:22:44.133540+0000","last_became_active":"2024-06-04T15:52:44.517066+0000","last_became_peered":"2024-06-04T15:52:44.517066+0000","last_unstale":"2024-06-04T16:22:44.133540+0000","last_undegraded":"2024-06-04T16:22:44.133540+0000","last_fullsized":"2024-06-04T16:22:44.133540+0000","mapping_epoch":29,"log_start":"251'400","ondisk_log_start":"251'400","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_clean_scrub_stamp":"2024-06-04T15:52:43.492872+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":400,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"254'27","reported_seq":494,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:32.401031+0000","last_change":"2024-06-04T15:52:46.532254+0000","last_active":"2024-06-04T16:22:32.401031+0000","last_peered":"2024-06-04T16:22:32.401031+0000","last_clean":"2024-06-04T16:22:32.401031+0000","last_became_active":"2024-06-04T15:52:46.531967+0000","last_became_peered":"2024-06-04T15:52:46.531967+0000","last_unstale":"2024-06-04T16:22:32.401031+0000","last_undegraded":"2024-06-04T16:22:32.401031+0000","last_fullsized":"2024-06-04T16:22:32.401031+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:45.513877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:45.513877+0000","last_clean_scrub_stamp":"2024-06-04T15:52:45.513877+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":905,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":28,"num_read_kb":26,"num_write":64,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2","version":"254'131","reported_seq":931,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:21:50.035852+0000","last_change":"2024-06-04T15:52:38.481406+0000","last_active":"2024-06-04T16:21:50.035852+0000","last_peered":"2024-06-04T16:21:50.035852+0000","last_clean":"2024-06-04T16:21:50.035852+0000","last_became_active":"2024-06-04T15:52:38.480942+0000","last_became_peered":"2024-06-04T15:52:38.480942+0000","last_unstale":"2024-06-04T16:21:50.035852+0000","last_undegraded":"2024-06-04T16:21:50.035852+0000","last_fullsized":"2024-06-04T16:21:50.035852+0000","mapping_epoch":23,"log_start":"251'100","ondisk_log_start":"251'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":705,"num_read_kb":672,"num_write":147,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"251'54","reported_seq":560,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:21:55.025493+0000","last_change":"2024-06-04T15:52:36.484356+0000","last_active":"2024-06-04T16:21:55.025493+0000","last_peered":"2024-06-04T16:21:55.025493+0000","last_clean":"2024-06-04T16:21:55.025493+0000","last_became_active":"2024-06-04T15:52:36.480469+0000","last_became_peered":"2024-06-04T15:52:36.480469+0000","last_unstale":"2024-06-04T16:21:55.025493+0000","last_undegraded":"2024-06-04T16:21:55.025493+0000","last_fullsized":"2024-06-04T16:21:55.025493+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":69,"num_read_kb":32811,"num_write":225,"num_write_kb":30438,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,4],"acting":[2,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":496,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:44.133053+0000","last_change":"2024-06-04T15:52:22.777053+0000","last_active":"2024-06-04T16:22:44.133053+0000","last_peered":"2024-06-04T16:22:44.133053+0000","last_clean":"2024-06-04T16:22:44.133053+0000","last_became_active":"2024-06-04T15:52:22.776723+0000","last_became_peered":"2024-06-04T15:52:22.776723+0000","last_unstale":"2024-06-04T16:22:44.133053+0000","last_undegraded":"2024-06-04T16:22:44.133053+0000","last_fullsized":"2024-06-04T16:22:44.133053+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:21.400880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:21.400880+0000","last_clean_scrub_stamp":"2024-06-04T15:52:21.400880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":477,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:21:50.036377+0000","last_change":"2024-06-04T15:52:40.484565+0000","last_active":"2024-06-04T16:21:50.036377+0000","last_peered":"2024-06-04T16:21:50.036377+0000","last_clean":"2024-06-04T16:21:50.036377+0000","last_became_active":"2024-06-04T15:52:40.483802+0000","last_became_peered":"2024-06-04T15:52:40.483802+0000","last_unstale":"2024-06-04T16:21:50.036377+0000","last_undegraded":"2024-06-04T16:21:50.036377+0000","last_fullsized":"2024-06-04T16:21:50.036377+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_clean_scrub_stamp":"2024-06-04T15:52:39.463103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"254'201","reported_seq":828,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:45.156996+0000","last_change":"2024-06-04T15:52:42.499319+0000","last_active":"2024-06-04T16:22:45.156996+0000","last_peered":"2024-06-04T16:22:45.156996+0000","last_clean":"2024-06-04T16:22:45.156996+0000","last_became_active":"2024-06-04T15:52:42.499002+0000","last_became_peered":"2024-06-04T15:52:42.499002+0000","last_unstale":"2024-06-04T16:22:45.156996+0000","last_undegraded":"2024-06-04T16:22:45.156996+0000","last_fullsized":"2024-06-04T16:22:45.156996+0000","mapping_epoch":27,"log_start":"251'100","ondisk_log_start":"251'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_clean_scrub_stamp":"2024-06-04T15:52:41.476734+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":100,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20869,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":311,"num_read_kb":405,"num_write":154,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":467,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:21:55.025411+0000","last_change":"2024-06-04T15:52:44.520800+0000","last_active":"2024-06-04T16:21:55.025411+0000","last_peered":"2024-06-04T16:21:55.025411+0000","last_clean":"2024-06-04T16:21:55.025411+0000","last_became_active":"2024-06-04T15:52:44.520499+0000","last_became_peered":"2024-06-04T15:52:44.520499+0000","last_unstale":"2024-06-04T16:21:55.025411+0000","last_undegraded":"2024-06-04T16:21:55.025411+0000","last_fullsized":"2024-06-04T16:21:55.025411+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_clean_scrub_stamp":"2024-06-04T15:52:43.492872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"254'25","reported_seq":507,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:56.551415+0000","last_change":"2024-06-04T16:22:56.551443+0000","last_active":"2024-06-04T16:22:56.551415+0000","last_peered":"2024-06-04T16:22:56.551415+0000","last_clean":"2024-06-04T16:22:56.551415+0000","last_became_active":"2024-06-04T15:52:46.541768+0000","last_became_peered":"2024-06-04T15:52:46.541768+0000","last_unstale":"2024-06-04T16:22:56.551415+0000","last_undegraded":"2024-06-04T16:22:56.551415+0000","last_fullsized":"2024-06-04T16:22:56.551415+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'25","last_scrub_stamp":"2024-06-04T16:22:56.551310+0000","last_deep_scrub":"254'25","last_deep_scrub_stamp":"2024-06-04T16:22:56.551310+0000","last_clean_scrub_stamp":"2024-06-04T16:22:56.551310+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T20:49:59.699028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":34,"num_write":60,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"254'25","reported_seq":499,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:46.017545+0000","last_change":"2024-06-04T16:22:46.017610+0000","last_active":"2024-06-04T16:22:46.017545+0000","last_peered":"2024-06-04T16:22:46.017545+0000","last_clean":"2024-06-04T16:22:46.017545+0000","last_became_active":"2024-06-04T15:52:46.540733+0000","last_became_peered":"2024-06-04T15:52:46.540733+0000","last_unstale":"2024-06-04T16:22:46.017545+0000","last_undegraded":"2024-06-04T16:22:46.017545+0000","last_fullsized":"2024-06-04T16:22:46.017545+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'25","last_scrub_stamp":"2024-06-04T16:22:46.017439+0000","last_deep_scrub":"254'25","last_deep_scrub_stamp":"2024-06-04T16:22:46.017439+0000","last_clean_scrub_stamp":"2024-06-04T16:22:46.017439+0000","objects_scrubbed":1,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T04:03:05.233942+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":53,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"254'151","reported_seq":918,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:44.606214+0000","last_change":"2024-06-04T15:52:38.480198+0000","last_active":"2024-06-04T16:22:44.606214+0000","last_peered":"2024-06-04T16:22:44.606214+0000","last_clean":"2024-06-04T16:22:44.606214+0000","last_became_active":"2024-06-04T15:52:38.479929+0000","last_became_peered":"2024-06-04T15:52:38.479929+0000","last_unstale":"2024-06-04T16:22:44.606214+0000","last_undegraded":"2024-06-04T16:22:44.606214+0000","last_fullsized":"2024-06-04T16:22:44.606214+0000","mapping_epoch":23,"log_start":"251'100","ondisk_log_start":"251'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":100,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":770,"num_read_kb":699,"num_write":204,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"251'34","reported_seq":547,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:45.076895+0000","last_change":"2024-06-04T15:52:36.497838+0000","last_active":"2024-06-04T16:22:45.076895+0000","last_peered":"2024-06-04T16:22:45.076895+0000","last_clean":"2024-06-04T16:22:45.076895+0000","last_became_active":"2024-06-04T15:52:36.497532+0000","last_became_peered":"2024-06-04T15:52:36.497532+0000","last_unstale":"2024-06-04T16:22:45.076895+0000","last_undegraded":"2024-06-04T16:22:45.076895+0000","last_fullsized":"2024-06-04T16:22:45.076895+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":54,"num_read_kb":42110,"num_write":160,"num_write_kb":16147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":480,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:57.091636+0000","last_change":"2024-06-04T16:22:57.091636+0000","last_active":"2024-06-04T16:22:57.091636+0000","last_peered":"2024-06-04T16:22:57.091636+0000","last_clean":"2024-06-04T16:22:57.091636+0000","last_became_active":"2024-06-04T15:52:40.483882+0000","last_became_peered":"2024-06-04T15:52:40.483882+0000","last_unstale":"2024-06-04T16:22:57.091636+0000","last_undegraded":"2024-06-04T16:22:57.091636+0000","last_fullsized":"2024-06-04T16:22:57.091636+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:22:57.091516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:22:57.091516+0000","last_clean_scrub_stamp":"2024-06-04T16:22:57.091516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T21:23:38.905655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.11","version":"254'96","reported_seq":636,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:46.496833+0000","last_change":"2024-06-04T15:52:42.504482+0000","last_active":"2024-06-04T16:22:46.496833+0000","last_peered":"2024-06-04T16:22:46.496833+0000","last_clean":"2024-06-04T16:22:46.496833+0000","last_became_active":"2024-06-04T15:52:42.504144+0000","last_became_peered":"2024-06-04T15:52:42.504144+0000","last_unstale":"2024-06-04T16:22:46.496833+0000","last_undegraded":"2024-06-04T16:22:46.496833+0000","last_fullsized":"2024-06-04T16:22:46.496833+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_clean_scrub_stamp":"2024-06-04T15:52:41.476734+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13519,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":145,"num_read_kb":205,"num_write":70,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":468,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:46.972490+0000","last_change":"2024-06-04T15:52:44.517996+0000","last_active":"2024-06-04T16:22:46.972490+0000","last_peered":"2024-06-04T16:22:46.972490+0000","last_clean":"2024-06-04T16:22:46.972490+0000","last_became_active":"2024-06-04T15:52:44.517718+0000","last_became_peered":"2024-06-04T15:52:44.517718+0000","last_unstale":"2024-06-04T16:22:46.972490+0000","last_undegraded":"2024-06-04T16:22:46.972490+0000","last_fullsized":"2024-06-04T16:22:46.972490+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_clean_scrub_stamp":"2024-06-04T15:52:43.492872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1e","version":"254'42","reported_seq":513,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:46.972568+0000","last_change":"2024-06-04T15:52:46.537867+0000","last_active":"2024-06-04T16:22:46.972568+0000","last_peered":"2024-06-04T16:22:46.972568+0000","last_clean":"2024-06-04T16:22:46.972568+0000","last_became_active":"2024-06-04T15:52:46.536917+0000","last_became_peered":"2024-06-04T15:52:46.536917+0000","last_unstale":"2024-06-04T16:22:46.972568+0000","last_undegraded":"2024-06-04T16:22:46.972568+0000","last_fullsized":"2024-06-04T16:22:46.972568+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:45.513877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:45.513877+0000","last_clean_scrub_stamp":"2024-06-04T15:52:45.513877+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":42,"num_write":101,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"254'152","reported_seq":994,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:02.977888+0000","last_change":"2024-06-04T16:23:02.977952+0000","last_active":"2024-06-04T16:23:02.977888+0000","last_peered":"2024-06-04T16:23:02.977888+0000","last_clean":"2024-06-04T16:23:02.977888+0000","last_became_active":"2024-06-04T15:52:38.488159+0000","last_became_peered":"2024-06-04T15:52:38.488159+0000","last_unstale":"2024-06-04T16:23:02.977888+0000","last_undegraded":"2024-06-04T16:23:02.977888+0000","last_fullsized":"2024-06-04T16:23:02.977888+0000","mapping_epoch":23,"log_start":"251'100","ondisk_log_start":"251'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'152","last_scrub_stamp":"2024-06-04T16:23:02.977774+0000","last_deep_scrub":"254'152","last_deep_scrub_stamp":"2024-06-04T16:23:02.977774+0000","last_clean_scrub_stamp":"2024-06-04T16:23:02.977774+0000","objects_scrubbed":1,"log_size":52,"log_dups_size":100,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T04:09:24.513394+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":952,"num_read_kb":891,"num_write":194,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.15","version":"251'69","reported_seq":604,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:21:40.021461+0000","last_change":"2024-06-04T15:52:36.492824+0000","last_active":"2024-06-04T16:21:40.021461+0000","last_peered":"2024-06-04T16:21:40.021461+0000","last_clean":"2024-06-04T16:21:40.021461+0000","last_became_active":"2024-06-04T15:52:36.492503+0000","last_became_peered":"2024-06-04T15:52:36.492503+0000","last_unstale":"2024-06-04T16:21:40.021461+0000","last_undegraded":"2024-06-04T16:21:40.021461+0000","last_fullsized":"2024-06-04T16:21:40.021461+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":528536,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":128,"num_read_kb":6583,"num_write":319,"num_write_kb":16503,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,3],"acting":[0,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":476,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:45.551223+0000","last_change":"2024-06-04T15:52:40.484769+0000","last_active":"2024-06-04T16:22:45.551223+0000","last_peered":"2024-06-04T16:22:45.551223+0000","last_clean":"2024-06-04T16:22:45.551223+0000","last_became_active":"2024-06-04T15:52:40.484480+0000","last_became_peered":"2024-06-04T15:52:40.484480+0000","last_unstale":"2024-06-04T16:22:45.551223+0000","last_undegraded":"2024-06-04T16:22:45.551223+0000","last_fullsized":"2024-06-04T16:22:45.551223+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_clean_scrub_stamp":"2024-06-04T15:52:39.463103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"254'21","reported_seq":507,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:01.000179+0000","last_change":"2024-06-04T16:23:01.000179+0000","last_active":"2024-06-04T16:23:01.000179+0000","last_peered":"2024-06-04T16:23:01.000179+0000","last_clean":"2024-06-04T16:23:01.000179+0000","last_became_active":"2024-06-04T15:52:42.499592+0000","last_became_peered":"2024-06-04T15:52:42.499592+0000","last_unstale":"2024-06-04T16:23:01.000179+0000","last_undegraded":"2024-06-04T16:23:01.000179+0000","last_fullsized":"2024-06-04T16:23:01.000179+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'21","last_scrub_stamp":"2024-06-04T16:23:01.000012+0000","last_deep_scrub":"254'21","last_deep_scrub_stamp":"2024-06-04T16:23:01.000012+0000","last_clean_scrub_stamp":"2024-06-04T16:23:01.000012+0000","objects_scrubbed":3,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T22:14:20.665186+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":19,"num_read_kb":17,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":294,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":466,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:44.606513+0000","last_change":"2024-06-04T15:52:44.519396+0000","last_active":"2024-06-04T16:22:44.606513+0000","last_peered":"2024-06-04T16:22:44.606513+0000","last_clean":"2024-06-04T16:22:44.606513+0000","last_became_active":"2024-06-04T15:52:44.519102+0000","last_became_peered":"2024-06-04T15:52:44.519102+0000","last_unstale":"2024-06-04T16:22:44.606513+0000","last_undegraded":"2024-06-04T16:22:44.606513+0000","last_fullsized":"2024-06-04T16:22:44.606513+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_clean_scrub_stamp":"2024-06-04T15:52:43.492872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"254'24","reported_seq":500,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:55.110607+0000","last_change":"2024-06-04T16:22:55.110633+0000","last_active":"2024-06-04T16:22:55.110607+0000","last_peered":"2024-06-04T16:22:55.110607+0000","last_clean":"2024-06-04T16:22:55.110607+0000","last_became_active":"2024-06-04T15:52:46.534277+0000","last_became_peered":"2024-06-04T15:52:46.534277+0000","last_unstale":"2024-06-04T16:22:55.110607+0000","last_undegraded":"2024-06-04T16:22:55.110607+0000","last_fullsized":"2024-06-04T16:22:55.110607+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'24","last_scrub_stamp":"2024-06-04T16:22:55.110517+0000","last_deep_scrub":"254'24","last_deep_scrub_stamp":"2024-06-04T16:22:55.110517+0000","last_clean_scrub_stamp":"2024-06-04T16:22:55.110517+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T18:12:16.411222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":38,"num_write":55,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"254'221","reported_seq":1037,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:45.551097+0000","last_change":"2024-06-04T15:52:38.482192+0000","last_active":"2024-06-04T16:22:45.551097+0000","last_peered":"2024-06-04T16:22:45.551097+0000","last_clean":"2024-06-04T16:22:45.551097+0000","last_became_active":"2024-06-04T15:52:38.481934+0000","last_became_peered":"2024-06-04T15:52:38.481934+0000","last_unstale":"2024-06-04T16:22:45.551097+0000","last_undegraded":"2024-06-04T16:22:45.551097+0000","last_fullsized":"2024-06-04T16:22:45.551097+0000","mapping_epoch":23,"log_start":"251'200","ondisk_log_start":"251'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":200,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1128,"num_read_kb":983,"num_write":320,"num_write_kb":131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.16","version":"251'39","reported_seq":529,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:21:40.023926+0000","last_change":"2024-06-04T15:52:36.481215+0000","last_active":"2024-06-04T16:21:40.023926+0000","last_peered":"2024-06-04T16:21:40.023926+0000","last_clean":"2024-06-04T16:21:40.023926+0000","last_became_active":"2024-06-04T15:52:36.480284+0000","last_became_peered":"2024-06-04T15:52:36.480284+0000","last_unstale":"2024-06-04T16:21:40.023926+0000","last_undegraded":"2024-06-04T16:21:40.023926+0000","last_fullsized":"2024-06-04T16:21:40.023926+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":37,"num_read_kb":1062,"num_write":155,"num_write_kb":20099,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4],"acting":[2,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":482,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:58.490367+0000","last_change":"2024-06-04T16:22:58.490367+0000","last_active":"2024-06-04T16:22:58.490367+0000","last_peered":"2024-06-04T16:22:58.490367+0000","last_clean":"2024-06-04T16:22:58.490367+0000","last_became_active":"2024-06-04T15:52:40.477609+0000","last_became_peered":"2024-06-04T15:52:40.477609+0000","last_unstale":"2024-06-04T16:22:58.490367+0000","last_undegraded":"2024-06-04T16:22:58.490367+0000","last_fullsized":"2024-06-04T16:22:58.490367+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:22:58.490254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:22:58.490254+0000","last_clean_scrub_stamp":"2024-06-04T16:22:58.490254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T03:58:39.460650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"254'133","reported_seq":692,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:46.972403+0000","last_change":"2024-06-04T15:52:42.496760+0000","last_active":"2024-06-04T16:22:46.972403+0000","last_peered":"2024-06-04T16:22:46.972403+0000","last_clean":"2024-06-04T16:22:46.972403+0000","last_became_active":"2024-06-04T15:52:42.496416+0000","last_became_peered":"2024-06-04T15:52:42.496416+0000","last_unstale":"2024-06-04T16:22:46.972403+0000","last_undegraded":"2024-06-04T16:22:46.972403+0000","last_fullsized":"2024-06-04T16:22:46.972403+0000","mapping_epoch":27,"log_start":"251'100","ondisk_log_start":"251'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_clean_scrub_stamp":"2024-06-04T15:52:41.476734+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":100,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14747,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":196,"num_read_kb":272,"num_write":106,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":478,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:54.181551+0000","last_change":"2024-06-04T16:22:54.181551+0000","last_active":"2024-06-04T16:22:54.181551+0000","last_peered":"2024-06-04T16:22:54.181551+0000","last_clean":"2024-06-04T16:22:54.181551+0000","last_became_active":"2024-06-04T15:52:44.519837+0000","last_became_peered":"2024-06-04T15:52:44.519837+0000","last_unstale":"2024-06-04T16:22:54.181551+0000","last_undegraded":"2024-06-04T16:22:54.181551+0000","last_fullsized":"2024-06-04T16:22:54.181551+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:22:54.181389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:22:54.181389+0000","last_clean_scrub_stamp":"2024-06-04T16:22:54.181389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T19:26:26.634657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"254'18","reported_seq":489,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:48.034172+0000","last_change":"2024-06-04T16:22:48.034172+0000","last_active":"2024-06-04T16:22:48.034172+0000","last_peered":"2024-06-04T16:22:48.034172+0000","last_clean":"2024-06-04T16:22:48.034172+0000","last_became_active":"2024-06-04T15:52:46.529366+0000","last_became_peered":"2024-06-04T15:52:46.529366+0000","last_unstale":"2024-06-04T16:22:48.034172+0000","last_undegraded":"2024-06-04T16:22:48.034172+0000","last_fullsized":"2024-06-04T16:22:48.034172+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'18","last_scrub_stamp":"2024-06-04T16:22:48.034075+0000","last_deep_scrub":"254'18","last_deep_scrub_stamp":"2024-06-04T16:22:48.034075+0000","last_clean_scrub_stamp":"2024-06-04T16:22:48.034075+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T01:45:02.416352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":52,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"254'127","reported_seq":831,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:46.972156+0000","last_change":"2024-06-04T15:52:38.488922+0000","last_active":"2024-06-04T16:22:46.972156+0000","last_peered":"2024-06-04T16:22:46.972156+0000","last_clean":"2024-06-04T16:22:46.972156+0000","last_became_active":"2024-06-04T15:52:38.488622+0000","last_became_peered":"2024-06-04T15:52:38.488622+0000","last_unstale":"2024-06-04T16:22:46.972156+0000","last_undegraded":"2024-06-04T16:22:46.972156+0000","last_fullsized":"2024-06-04T16:22:46.972156+0000","mapping_epoch":23,"log_start":"251'100","ondisk_log_start":"251'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":100,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":585,"num_read_kb":532,"num_write":156,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"254'50","reported_seq":562,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:39.554816+0000","last_change":"2024-06-04T15:52:36.483764+0000","last_active":"2024-06-04T16:22:39.554816+0000","last_peered":"2024-06-04T16:22:39.554816+0000","last_clean":"2024-06-04T16:22:39.554816+0000","last_became_active":"2024-06-04T15:52:36.482733+0000","last_became_peered":"2024-06-04T15:52:36.482733+0000","last_unstale":"2024-06-04T16:22:39.554816+0000","last_undegraded":"2024-06-04T16:22:39.554816+0000","last_fullsized":"2024-06-04T16:22:39.554816+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133705,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":82,"num_read_kb":13463,"num_write":227,"num_write_kb":36279,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1],"acting":[5,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.11","version":"33'4","reported_seq":781,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:45.077217+0000","last_change":"2024-06-04T15:52:40.479576+0000","last_active":"2024-06-04T16:22:45.077217+0000","last_peered":"2024-06-04T16:22:45.077217+0000","last_clean":"2024-06-04T16:22:45.077217+0000","last_became_active":"2024-06-04T15:52:40.479002+0000","last_became_peered":"2024-06-04T15:52:40.479002+0000","last_unstale":"2024-06-04T16:22:45.077217+0000","last_undegraded":"2024-06-04T16:22:45.077217+0000","last_fullsized":"2024-06-04T16:22:45.077217+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_clean_scrub_stamp":"2024-06-04T15:52:39.463103+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":463,"num_read_kb":757,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"254'89","reported_seq":640,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:01.759191+0000","last_change":"2024-06-04T16:23:01.759191+0000","last_active":"2024-06-04T16:23:01.759191+0000","last_peered":"2024-06-04T16:23:01.759191+0000","last_clean":"2024-06-04T16:23:01.759191+0000","last_became_active":"2024-06-04T15:52:42.505955+0000","last_became_peered":"2024-06-04T15:52:42.505955+0000","last_unstale":"2024-06-04T16:23:01.759191+0000","last_undegraded":"2024-06-04T16:23:01.759191+0000","last_fullsized":"2024-06-04T16:23:01.759191+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'89","last_scrub_stamp":"2024-06-04T16:23:01.759061+0000","last_deep_scrub":"254'89","last_deep_scrub_stamp":"2024-06-04T16:23:01.759061+0000","last_clean_scrub_stamp":"2024-06-04T16:23:01.759061+0000","objects_scrubbed":4,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T18:04:48.914592+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":128,"num_read_kb":150,"num_write":58,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":468,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:46.972496+0000","last_change":"2024-06-04T15:52:44.520920+0000","last_active":"2024-06-04T16:22:46.972496+0000","last_peered":"2024-06-04T16:22:46.972496+0000","last_clean":"2024-06-04T16:22:46.972496+0000","last_became_active":"2024-06-04T15:52:44.519975+0000","last_became_peered":"2024-06-04T15:52:44.519975+0000","last_unstale":"2024-06-04T16:22:46.972496+0000","last_undegraded":"2024-06-04T16:22:46.972496+0000","last_fullsized":"2024-06-04T16:22:46.972496+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_clean_scrub_stamp":"2024-06-04T15:52:43.492872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1f","version":"254'93","reported_seq":774,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:21:50.029117+0000","last_change":"2024-06-04T15:52:38.485442+0000","last_active":"2024-06-04T16:21:50.029117+0000","last_peered":"2024-06-04T16:21:50.029117+0000","last_clean":"2024-06-04T16:21:50.029117+0000","last_became_active":"2024-06-04T15:52:38.485163+0000","last_became_peered":"2024-06-04T15:52:38.485163+0000","last_unstale":"2024-06-04T16:21:50.029117+0000","last_undegraded":"2024-06-04T16:21:50.029117+0000","last_fullsized":"2024-06-04T16:21:50.029117+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":477,"num_read_kb":443,"num_write":114,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"254'35","reported_seq":538,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:39.456392+0000","last_change":"2024-06-04T15:52:36.490918+0000","last_active":"2024-06-04T16:22:39.456392+0000","last_peered":"2024-06-04T16:22:39.456392+0000","last_clean":"2024-06-04T16:22:39.456392+0000","last_became_active":"2024-06-04T15:52:36.490297+0000","last_became_peered":"2024-06-04T15:52:36.490297+0000","last_unstale":"2024-06-04T16:22:39.456392+0000","last_undegraded":"2024-06-04T16:22:39.456392+0000","last_fullsized":"2024-06-04T16:22:39.456392+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1069164,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":53,"num_read_kb":1061,"num_write":121,"num_write_kb":15390,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,3],"acting":[5,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":482,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:59.048325+0000","last_change":"2024-06-04T16:22:59.048348+0000","last_active":"2024-06-04T16:22:59.048325+0000","last_peered":"2024-06-04T16:22:59.048325+0000","last_clean":"2024-06-04T16:22:59.048325+0000","last_became_active":"2024-06-04T15:52:40.482962+0000","last_became_peered":"2024-06-04T15:52:40.482962+0000","last_unstale":"2024-06-04T16:22:59.048325+0000","last_undegraded":"2024-06-04T16:22:59.048325+0000","last_fullsized":"2024-06-04T16:22:59.048325+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:22:59.048237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:22:59.048237+0000","last_clean_scrub_stamp":"2024-06-04T16:22:59.048237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T21:58:02.126251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"254'150","reported_seq":746,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:45.043750+0000","last_change":"2024-06-04T15:52:42.504117+0000","last_active":"2024-06-04T16:22:45.043750+0000","last_peered":"2024-06-04T16:22:45.043750+0000","last_clean":"2024-06-04T16:22:45.043750+0000","last_became_active":"2024-06-04T15:52:42.503246+0000","last_became_peered":"2024-06-04T15:52:42.503246+0000","last_unstale":"2024-06-04T16:22:45.043750+0000","last_undegraded":"2024-06-04T16:22:45.043750+0000","last_fullsized":"2024-06-04T16:22:45.043750+0000","mapping_epoch":27,"log_start":"251'100","ondisk_log_start":"251'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_clean_scrub_stamp":"2024-06-04T15:52:41.476734+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":100,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8493,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":230,"num_read_kb":283,"num_write":98,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":465,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:44.606507+0000","last_change":"2024-06-04T15:52:44.518052+0000","last_active":"2024-06-04T16:22:44.606507+0000","last_peered":"2024-06-04T16:22:44.606507+0000","last_clean":"2024-06-04T16:22:44.606507+0000","last_became_active":"2024-06-04T15:52:44.517715+0000","last_became_peered":"2024-06-04T15:52:44.517715+0000","last_unstale":"2024-06-04T16:22:44.606507+0000","last_undegraded":"2024-06-04T16:22:44.606507+0000","last_fullsized":"2024-06-04T16:22:44.606507+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_clean_scrub_stamp":"2024-06-04T15:52:43.492872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"254'74","reported_seq":561,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:03.466480+0000","last_change":"2024-06-04T16:23:03.466516+0000","last_active":"2024-06-04T16:23:03.466480+0000","last_peered":"2024-06-04T16:23:03.466480+0000","last_clean":"2024-06-04T16:23:03.466480+0000","last_became_active":"2024-06-04T15:52:46.538338+0000","last_became_peered":"2024-06-04T15:52:46.538338+0000","last_unstale":"2024-06-04T16:23:03.466480+0000","last_undegraded":"2024-06-04T16:23:03.466480+0000","last_fullsized":"2024-06-04T16:23:03.466480+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'74","last_scrub_stamp":"2024-06-04T16:23:03.466387+0000","last_deep_scrub":"254'74","last_deep_scrub_stamp":"2024-06-04T16:23:03.466387+0000","last_clean_scrub_stamp":"2024-06-04T16:23:03.466387+0000","objects_scrubbed":3,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T17:43:39.194556+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1061,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":107,"num_read_kb":120,"num_write":148,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1e","version":"254'145","reported_seq":916,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:45.551028+0000","last_change":"2024-06-04T15:52:38.484537+0000","last_active":"2024-06-04T16:22:45.551028+0000","last_peered":"2024-06-04T16:22:45.551028+0000","last_clean":"2024-06-04T16:22:45.551028+0000","last_became_active":"2024-06-04T15:52:38.484087+0000","last_became_peered":"2024-06-04T15:52:38.484087+0000","last_unstale":"2024-06-04T16:22:45.551028+0000","last_undegraded":"2024-06-04T16:22:45.551028+0000","last_fullsized":"2024-06-04T16:22:45.551028+0000","mapping_epoch":23,"log_start":"251'100","ondisk_log_start":"251'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":100,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":710,"num_read_kb":650,"num_write":181,"num_write_kb":49,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"251'48","reported_seq":552,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:21:45.035626+0000","last_change":"2024-06-04T15:52:36.479337+0000","last_active":"2024-06-04T16:21:45.035626+0000","last_peered":"2024-06-04T16:21:45.035626+0000","last_clean":"2024-06-04T16:21:45.035626+0000","last_became_active":"2024-06-04T15:52:36.477626+0000","last_became_peered":"2024-06-04T15:52:36.477626+0000","last_unstale":"2024-06-04T16:21:45.035626+0000","last_undegraded":"2024-06-04T16:21:45.035626+0000","last_fullsized":"2024-06-04T16:21:45.035626+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20628,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":58,"num_read_kb":9358,"num_write":184,"num_write_kb":22886,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,1],"acting":[4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":483,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:01.495886+0000","last_change":"2024-06-04T16:23:01.495911+0000","last_active":"2024-06-04T16:23:01.495886+0000","last_peered":"2024-06-04T16:23:01.495886+0000","last_clean":"2024-06-04T16:23:01.495886+0000","last_became_active":"2024-06-04T15:52:40.484444+0000","last_became_peered":"2024-06-04T15:52:40.484444+0000","last_unstale":"2024-06-04T16:23:01.495886+0000","last_undegraded":"2024-06-04T16:23:01.495886+0000","last_fullsized":"2024-06-04T16:23:01.495886+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:23:01.495774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:23:01.495774+0000","last_clean_scrub_stamp":"2024-06-04T16:23:01.495774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T18:30:24.832332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"254'105","reported_seq":653,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:45.035537+0000","last_change":"2024-06-04T15:52:42.498603+0000","last_active":"2024-06-04T16:22:45.035537+0000","last_peered":"2024-06-04T16:22:45.035537+0000","last_clean":"2024-06-04T16:22:45.035537+0000","last_became_active":"2024-06-04T15:52:42.498329+0000","last_became_peered":"2024-06-04T15:52:42.498329+0000","last_unstale":"2024-06-04T16:22:45.035537+0000","last_undegraded":"2024-06-04T16:22:45.035537+0000","last_fullsized":"2024-06-04T16:22:45.035537+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_clean_scrub_stamp":"2024-06-04T15:52:41.476734+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":167,"num_read_kb":207,"num_write":102,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":477,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:04.428313+0000","last_change":"2024-06-04T16:23:04.428338+0000","last_active":"2024-06-04T16:23:04.428313+0000","last_peered":"2024-06-04T16:23:04.428313+0000","last_clean":"2024-06-04T16:23:04.428313+0000","last_became_active":"2024-06-04T15:52:44.523527+0000","last_became_peered":"2024-06-04T15:52:44.523527+0000","last_unstale":"2024-06-04T16:23:04.428313+0000","last_undegraded":"2024-06-04T16:23:04.428313+0000","last_fullsized":"2024-06-04T16:23:04.428313+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:23:04.428227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:23:04.428227+0000","last_clean_scrub_stamp":"2024-06-04T16:23:04.428227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T23:41:17.114473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.12","version":"254'33","reported_seq":518,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:45.120937+0000","last_change":"2024-06-04T16:22:45.120984+0000","last_active":"2024-06-04T16:22:45.120937+0000","last_peered":"2024-06-04T16:22:45.120937+0000","last_clean":"2024-06-04T16:22:45.120937+0000","last_became_active":"2024-06-04T15:52:46.537899+0000","last_became_peered":"2024-06-04T15:52:46.537899+0000","last_unstale":"2024-06-04T16:22:45.120937+0000","last_undegraded":"2024-06-04T16:22:45.120937+0000","last_fullsized":"2024-06-04T16:22:45.120937+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'33","last_scrub_stamp":"2024-06-04T16:22:45.120808+0000","last_deep_scrub":"254'33","last_deep_scrub_stamp":"2024-06-04T16:22:45.120808+0000","last_clean_scrub_stamp":"2024-06-04T16:22:45.120808+0000","objects_scrubbed":4,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T18:20:07.652176+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1228,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":67,"num_read_kb":65,"num_write":80,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"254'108","reported_seq":884,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:40.156395+0000","last_change":"2024-06-04T15:52:38.481130+0000","last_active":"2024-06-04T16:22:40.156395+0000","last_peered":"2024-06-04T16:22:40.156395+0000","last_clean":"2024-06-04T16:22:40.156395+0000","last_became_active":"2024-06-04T15:52:38.480458+0000","last_became_peered":"2024-06-04T15:52:38.480458+0000","last_unstale":"2024-06-04T16:22:40.156395+0000","last_undegraded":"2024-06-04T16:22:40.156395+0000","last_fullsized":"2024-06-04T16:22:40.156395+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":731,"num_read_kb":703,"num_write":125,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1a","version":"254'73","reported_seq":587,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:39.920665+0000","last_change":"2024-06-04T15:52:36.478450+0000","last_active":"2024-06-04T16:22:39.920665+0000","last_peered":"2024-06-04T16:22:39.920665+0000","last_clean":"2024-06-04T16:22:39.920665+0000","last_became_active":"2024-06-04T15:52:36.477885+0000","last_became_peered":"2024-06-04T15:52:36.477885+0000","last_unstale":"2024-06-04T16:22:39.920665+0000","last_undegraded":"2024-06-04T16:22:39.920665+0000","last_fullsized":"2024-06-04T16:22:39.920665+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1395842,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":88,"num_read_kb":3881,"num_write":289,"num_write_kb":29330,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":481,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:57.516834+0000","last_change":"2024-06-04T16:22:57.516894+0000","last_active":"2024-06-04T16:22:57.516834+0000","last_peered":"2024-06-04T16:22:57.516834+0000","last_clean":"2024-06-04T16:22:57.516834+0000","last_became_active":"2024-06-04T15:52:40.477924+0000","last_became_peered":"2024-06-04T15:52:40.477924+0000","last_unstale":"2024-06-04T16:22:57.516834+0000","last_undegraded":"2024-06-04T16:22:57.516834+0000","last_fullsized":"2024-06-04T16:22:57.516834+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:22:57.516723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:22:57.516723+0000","last_clean_scrub_stamp":"2024-06-04T16:22:57.516723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T18:12:49.229393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"254'97","reported_seq":647,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:04.066551+0000","last_change":"2024-06-04T16:23:04.066591+0000","last_active":"2024-06-04T16:23:04.066551+0000","last_peered":"2024-06-04T16:23:04.066551+0000","last_clean":"2024-06-04T16:23:04.066551+0000","last_became_active":"2024-06-04T15:52:42.503579+0000","last_became_peered":"2024-06-04T15:52:42.503579+0000","last_unstale":"2024-06-04T16:23:04.066551+0000","last_undegraded":"2024-06-04T16:23:04.066551+0000","last_fullsized":"2024-06-04T16:23:04.066551+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'97","last_scrub_stamp":"2024-06-04T16:23:04.066459+0000","last_deep_scrub":"254'97","last_deep_scrub_stamp":"2024-06-04T16:23:04.066459+0000","last_clean_scrub_stamp":"2024-06-04T16:23:04.066459+0000","objects_scrubbed":5,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T22:07:06.260680+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5924,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":139,"num_read_kb":180,"num_write":64,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":470,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:45.157097+0000","last_change":"2024-06-04T15:52:44.520226+0000","last_active":"2024-06-04T16:22:45.157097+0000","last_peered":"2024-06-04T16:22:45.157097+0000","last_clean":"2024-06-04T16:22:45.157097+0000","last_became_active":"2024-06-04T15:52:44.519570+0000","last_became_peered":"2024-06-04T15:52:44.519570+0000","last_unstale":"2024-06-04T16:22:45.157097+0000","last_undegraded":"2024-06-04T16:22:45.157097+0000","last_fullsized":"2024-06-04T16:22:45.157097+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_clean_scrub_stamp":"2024-06-04T15:52:43.492872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.11","version":"254'27","reported_seq":499,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:59.862544+0000","last_change":"2024-06-04T16:22:59.862605+0000","last_active":"2024-06-04T16:22:59.862544+0000","last_peered":"2024-06-04T16:22:59.862544+0000","last_clean":"2024-06-04T16:22:59.862544+0000","last_became_active":"2024-06-04T15:52:46.542820+0000","last_became_peered":"2024-06-04T15:52:46.542820+0000","last_unstale":"2024-06-04T16:22:59.862544+0000","last_undegraded":"2024-06-04T16:22:59.862544+0000","last_fullsized":"2024-06-04T16:22:59.862544+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'27","last_scrub_stamp":"2024-06-04T16:22:59.862441+0000","last_deep_scrub":"254'27","last_deep_scrub_stamp":"2024-06-04T16:22:59.862441+0000","last_clean_scrub_stamp":"2024-06-04T16:22:59.862441+0000","objects_scrubbed":3,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T21:08:54.099136+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":616,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":20,"num_read_kb":19,"num_write":60,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"254'121","reported_seq":816,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:39.924676+0000","last_change":"2024-06-04T15:52:38.478104+0000","last_active":"2024-06-04T16:22:39.924676+0000","last_peered":"2024-06-04T16:22:39.924676+0000","last_clean":"2024-06-04T16:22:39.924676+0000","last_became_active":"2024-06-04T15:52:38.477059+0000","last_became_peered":"2024-06-04T15:52:38.477059+0000","last_unstale":"2024-06-04T16:22:39.924676+0000","last_undegraded":"2024-06-04T16:22:39.924676+0000","last_fullsized":"2024-06-04T16:22:39.924676+0000","mapping_epoch":23,"log_start":"251'100","ondisk_log_start":"251'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":100,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":614,"num_read_kb":552,"num_write":164,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"254'63","reported_seq":572,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:39.924606+0000","last_change":"2024-06-04T15:52:36.498271+0000","last_active":"2024-06-04T16:22:39.924606+0000","last_peered":"2024-06-04T16:22:39.924606+0000","last_clean":"2024-06-04T16:22:39.924606+0000","last_became_active":"2024-06-04T15:52:36.497812+0000","last_became_peered":"2024-06-04T15:52:36.497812+0000","last_unstale":"2024-06-04T16:22:39.924606+0000","last_undegraded":"2024-06-04T16:22:39.924606+0000","last_fullsized":"2024-06-04T16:22:39.924606+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2267334,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":82,"num_read_kb":14576,"num_write":293,"num_write_kb":31387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3],"acting":[4,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":475,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:39.924700+0000","last_change":"2024-06-04T15:52:40.482009+0000","last_active":"2024-06-04T16:22:39.924700+0000","last_peered":"2024-06-04T16:22:39.924700+0000","last_clean":"2024-06-04T16:22:39.924700+0000","last_became_active":"2024-06-04T15:52:40.481621+0000","last_became_peered":"2024-06-04T15:52:40.481621+0000","last_unstale":"2024-06-04T16:22:39.924700+0000","last_undegraded":"2024-06-04T16:22:39.924700+0000","last_fullsized":"2024-06-04T16:22:39.924700+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_clean_scrub_stamp":"2024-06-04T15:52:39.463103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1e","version":"251'44","reported_seq":532,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:45.077329+0000","last_change":"2024-06-04T15:52:42.499792+0000","last_active":"2024-06-04T16:22:45.077329+0000","last_peered":"2024-06-04T16:22:45.077329+0000","last_clean":"2024-06-04T16:22:45.077329+0000","last_became_active":"2024-06-04T15:52:42.499488+0000","last_became_peered":"2024-06-04T15:52:42.499488+0000","last_unstale":"2024-06-04T16:22:45.077329+0000","last_undegraded":"2024-06-04T16:22:45.077329+0000","last_fullsized":"2024-06-04T16:22:45.077329+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_clean_scrub_stamp":"2024-06-04T15:52:41.476734+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":67,"num_read_kb":62,"num_write":74,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"254'461","reported_seq":1489,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:03.752146+0000","last_change":"2024-06-04T16:23:03.752174+0000","last_active":"2024-06-04T16:23:03.752146+0000","last_peered":"2024-06-04T16:23:03.752146+0000","last_clean":"2024-06-04T16:23:03.752146+0000","last_became_active":"2024-06-04T15:52:44.516460+0000","last_became_peered":"2024-06-04T15:52:44.516460+0000","last_unstale":"2024-06-04T16:23:03.752146+0000","last_undegraded":"2024-06-04T16:23:03.752146+0000","last_fullsized":"2024-06-04T16:23:03.752146+0000","mapping_epoch":29,"log_start":"251'400","ondisk_log_start":"251'400","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'461","last_scrub_stamp":"2024-06-04T16:23:03.752033+0000","last_deep_scrub":"254'461","last_deep_scrub_stamp":"2024-06-04T16:23:03.752033+0000","last_clean_scrub_stamp":"2024-06-04T16:23:03.752033+0000","objects_scrubbed":1,"log_size":61,"log_dups_size":400,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T22:17:40.547278+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.10","version":"254'21","reported_seq":500,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:47.043339+0000","last_change":"2024-06-04T16:22:47.043361+0000","last_active":"2024-06-04T16:22:47.043339+0000","last_peered":"2024-06-04T16:22:47.043339+0000","last_clean":"2024-06-04T16:22:47.043339+0000","last_became_active":"2024-06-04T15:52:46.538179+0000","last_became_peered":"2024-06-04T15:52:46.538179+0000","last_unstale":"2024-06-04T16:22:47.043339+0000","last_undegraded":"2024-06-04T16:22:47.043339+0000","last_fullsized":"2024-06-04T16:22:47.043339+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'21","last_scrub_stamp":"2024-06-04T16:22:47.043259+0000","last_deep_scrub":"254'21","last_deep_scrub_stamp":"2024-06-04T16:22:47.043259+0000","last_clean_scrub_stamp":"2024-06-04T16:22:47.043259+0000","objects_scrubbed":1,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T22:15:40.632828+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":34,"num_read_kb":33,"num_write":53,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"254'123","reported_seq":876,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:00.500298+0000","last_change":"2024-06-04T16:23:00.500326+0000","last_active":"2024-06-04T16:23:00.500298+0000","last_peered":"2024-06-04T16:23:00.500298+0000","last_clean":"2024-06-04T16:23:00.500298+0000","last_became_active":"2024-06-04T15:52:38.485379+0000","last_became_peered":"2024-06-04T15:52:38.485379+0000","last_unstale":"2024-06-04T16:23:00.500298+0000","last_undegraded":"2024-06-04T16:23:00.500298+0000","last_fullsized":"2024-06-04T16:23:00.500298+0000","mapping_epoch":23,"log_start":"254'100","ondisk_log_start":"254'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'123","last_scrub_stamp":"2024-06-04T16:23:00.500205+0000","last_deep_scrub":"254'123","last_deep_scrub_stamp":"2024-06-04T16:23:00.500205+0000","last_clean_scrub_stamp":"2024-06-04T16:23:00.500205+0000","objects_scrubbed":1,"log_size":23,"log_dups_size":100,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T20:17:09.939014+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":679,"num_read_kb":622,"num_write":158,"num_write_kb":49,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":473,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"251'30","reported_seq":522,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:39.920697+0000","last_change":"2024-06-04T15:52:36.486793+0000","last_active":"2024-06-04T16:22:39.920697+0000","last_peered":"2024-06-04T16:22:39.920697+0000","last_clean":"2024-06-04T16:22:39.920697+0000","last_became_active":"2024-06-04T15:52:36.486465+0000","last_became_peered":"2024-06-04T15:52:36.486465+0000","last_unstale":"2024-06-04T16:22:39.920697+0000","last_undegraded":"2024-06-04T16:22:39.920697+0000","last_fullsized":"2024-06-04T16:22:39.920697+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":30,"num_read_kb":1715,"num_write":122,"num_write_kb":16993,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,5],"acting":[1,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":485,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:00.183025+0000","last_change":"2024-06-04T16:23:00.183049+0000","last_active":"2024-06-04T16:23:00.183025+0000","last_peered":"2024-06-04T16:23:00.183025+0000","last_clean":"2024-06-04T16:23:00.183025+0000","last_became_active":"2024-06-04T15:52:40.480832+0000","last_became_peered":"2024-06-04T15:52:40.480832+0000","last_unstale":"2024-06-04T16:23:00.183025+0000","last_undegraded":"2024-06-04T16:23:00.183025+0000","last_fullsized":"2024-06-04T16:23:00.183025+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:23:00.182795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:23:00.182795+0000","last_clean_scrub_stamp":"2024-06-04T16:23:00.182795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T01:51:55.867582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"254'117","reported_seq":676,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:53.901967+0000","last_change":"2024-06-04T16:22:53.902005+0000","last_active":"2024-06-04T16:22:53.901967+0000","last_peered":"2024-06-04T16:22:53.901967+0000","last_clean":"2024-06-04T16:22:53.901967+0000","last_became_active":"2024-06-04T15:52:42.502601+0000","last_became_peered":"2024-06-04T15:52:42.502601+0000","last_unstale":"2024-06-04T16:22:53.901967+0000","last_undegraded":"2024-06-04T16:22:53.901967+0000","last_fullsized":"2024-06-04T16:22:53.901967+0000","mapping_epoch":27,"log_start":"251'100","ondisk_log_start":"251'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'117","last_scrub_stamp":"2024-06-04T16:22:53.901886+0000","last_deep_scrub":"254'117","last_deep_scrub_stamp":"2024-06-04T16:22:53.901886+0000","last_clean_scrub_stamp":"2024-06-04T16:22:53.901886+0000","objects_scrubbed":7,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T01:13:12.328330+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34754,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":168,"num_read_kb":281,"num_write":86,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":475,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:49.023291+0000","last_change":"2024-06-04T16:22:49.023320+0000","last_active":"2024-06-04T16:22:49.023291+0000","last_peered":"2024-06-04T16:22:49.023291+0000","last_clean":"2024-06-04T16:22:49.023291+0000","last_became_active":"2024-06-04T15:52:44.522992+0000","last_became_peered":"2024-06-04T15:52:44.522992+0000","last_unstale":"2024-06-04T16:22:49.023291+0000","last_undegraded":"2024-06-04T16:22:49.023291+0000","last_fullsized":"2024-06-04T16:22:49.023291+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:22:49.023192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:22:49.023192+0000","last_clean_scrub_stamp":"2024-06-04T16:22:49.023192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T21:20:02.532465+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"254'16","reported_seq":497,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:50.151424+0000","last_change":"2024-06-04T16:22:50.151477+0000","last_active":"2024-06-04T16:22:50.151424+0000","last_peered":"2024-06-04T16:22:50.151424+0000","last_clean":"2024-06-04T16:22:50.151424+0000","last_became_active":"2024-06-04T15:52:46.539985+0000","last_became_peered":"2024-06-04T15:52:46.539985+0000","last_unstale":"2024-06-04T16:22:50.151424+0000","last_undegraded":"2024-06-04T16:22:50.151424+0000","last_fullsized":"2024-06-04T16:22:50.151424+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'16","last_scrub_stamp":"2024-06-04T16:22:50.151326+0000","last_deep_scrub":"254'16","last_deep_scrub_stamp":"2024-06-04T16:22:50.151326+0000","last_clean_scrub_stamp":"2024-06-04T16:22:50.151326+0000","objects_scrubbed":1,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T17:32:57.901810+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":31,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"254'419","reported_seq":1237,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:40.030206+0000","last_change":"2024-06-04T15:52:38.475289+0000","last_active":"2024-06-04T16:22:40.030206+0000","last_peered":"2024-06-04T16:22:40.030206+0000","last_clean":"2024-06-04T16:22:40.030206+0000","last_became_active":"2024-06-04T15:52:38.474960+0000","last_became_peered":"2024-06-04T15:52:38.474960+0000","last_unstale":"2024-06-04T16:22:40.030206+0000","last_undegraded":"2024-06-04T16:22:40.030206+0000","last_fullsized":"2024-06-04T16:22:40.030206+0000","mapping_epoch":23,"log_start":"251'400","ondisk_log_start":"251'400","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":400,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2017,"num_read_kb":1794,"num_write":716,"num_write_kb":341,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"254'99","reported_seq":728,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:40.034910+0000","last_change":"2024-06-04T15:52:36.499152+0000","last_active":"2024-06-04T16:22:40.034910+0000","last_peered":"2024-06-04T16:22:40.034910+0000","last_clean":"2024-06-04T16:22:40.034910+0000","last_became_active":"2024-06-04T15:52:36.498806+0000","last_became_peered":"2024-06-04T15:52:36.498806+0000","last_unstale":"2024-06-04T16:22:40.034910+0000","last_undegraded":"2024-06-04T16:22:40.034910+0000","last_fullsized":"2024-06-04T16:22:40.034910+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":490,"num_read_kb":127523,"num_write":607,"num_write_kb":22490,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":481,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:59.503813+0000","last_change":"2024-06-04T16:22:59.503864+0000","last_active":"2024-06-04T16:22:59.503813+0000","last_peered":"2024-06-04T16:22:59.503813+0000","last_clean":"2024-06-04T16:22:59.503813+0000","last_became_active":"2024-06-04T15:52:40.478417+0000","last_became_peered":"2024-06-04T15:52:40.478417+0000","last_unstale":"2024-06-04T16:22:59.503813+0000","last_undegraded":"2024-06-04T16:22:59.503813+0000","last_fullsized":"2024-06-04T16:22:59.503813+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:22:59.503712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:22:59.503712+0000","last_clean_scrub_stamp":"2024-06-04T16:22:59.503712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T19:24:36.842678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"254'88","reported_seq":628,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:39.429000+0000","last_change":"2024-06-04T15:52:42.496557+0000","last_active":"2024-06-04T16:22:39.429000+0000","last_peered":"2024-06-04T16:22:39.429000+0000","last_clean":"2024-06-04T16:22:39.429000+0000","last_became_active":"2024-06-04T15:52:42.496263+0000","last_became_peered":"2024-06-04T15:52:42.496263+0000","last_unstale":"2024-06-04T16:22:39.429000+0000","last_undegraded":"2024-06-04T16:22:39.429000+0000","last_fullsized":"2024-06-04T16:22:39.429000+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_clean_scrub_stamp":"2024-06-04T15:52:41.476734+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7956,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":138,"num_read_kb":200,"num_write":66,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":474,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:04.870935+0000","last_change":"2024-06-04T16:23:04.870958+0000","last_active":"2024-06-04T16:23:04.870935+0000","last_peered":"2024-06-04T16:23:04.870935+0000","last_clean":"2024-06-04T16:23:04.870935+0000","last_became_active":"2024-06-04T15:52:44.520051+0000","last_became_peered":"2024-06-04T15:52:44.520051+0000","last_unstale":"2024-06-04T16:23:04.870935+0000","last_undegraded":"2024-06-04T16:23:04.870935+0000","last_fullsized":"2024-06-04T16:23:04.870935+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:23:04.870830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:23:04.870830+0000","last_clean_scrub_stamp":"2024-06-04T16:23:04.870830+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T20:14:18.357003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"254'40","reported_seq":557,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:57.535519+0000","last_change":"2024-06-04T16:22:57.535547+0000","last_active":"2024-06-04T16:22:57.535519+0000","last_peered":"2024-06-04T16:22:57.535519+0000","last_clean":"2024-06-04T16:22:57.535519+0000","last_became_active":"2024-06-04T15:52:46.541897+0000","last_became_peered":"2024-06-04T15:52:46.541897+0000","last_unstale":"2024-06-04T16:22:57.535519+0000","last_undegraded":"2024-06-04T16:22:57.535519+0000","last_fullsized":"2024-06-04T16:22:57.535519+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'40","last_scrub_stamp":"2024-06-04T16:22:57.535425+0000","last_deep_scrub":"254'40","last_deep_scrub_stamp":"2024-06-04T16:22:57.535425+0000","last_clean_scrub_stamp":"2024-06-04T16:22:57.535425+0000","objects_scrubbed":1,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T01:55:20.316635+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":549,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":152,"num_read_kb":137,"num_write":99,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"254'122","reported_seq":850,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:21:40.147742+0000","last_change":"2024-06-04T15:52:38.482687+0000","last_active":"2024-06-04T16:21:40.147742+0000","last_peered":"2024-06-04T16:21:40.147742+0000","last_clean":"2024-06-04T16:21:40.147742+0000","last_became_active":"2024-06-04T15:52:38.482388+0000","last_became_peered":"2024-06-04T15:52:38.482388+0000","last_unstale":"2024-06-04T16:21:40.147742+0000","last_undegraded":"2024-06-04T16:21:40.147742+0000","last_fullsized":"2024-06-04T16:21:40.147742+0000","mapping_epoch":23,"log_start":"251'100","ondisk_log_start":"251'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":100,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":625,"num_read_kb":571,"num_write":157,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1e","version":"251'81","reported_seq":613,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:45.044237+0000","last_change":"2024-06-04T15:52:36.485805+0000","last_active":"2024-06-04T16:22:45.044237+0000","last_peered":"2024-06-04T16:22:45.044237+0000","last_clean":"2024-06-04T16:22:45.044237+0000","last_became_active":"2024-06-04T15:52:36.485401+0000","last_became_peered":"2024-06-04T15:52:36.485401+0000","last_unstale":"2024-06-04T16:22:45.044237+0000","last_undegraded":"2024-06-04T16:22:45.044237+0000","last_fullsized":"2024-06-04T16:22:45.044237+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133679,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":131,"num_read_kb":40112,"num_write":294,"num_write_kb":27266,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,3],"acting":[5,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":485,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:02.189360+0000","last_change":"2024-06-04T16:23:02.189383+0000","last_active":"2024-06-04T16:23:02.189360+0000","last_peered":"2024-06-04T16:23:02.189360+0000","last_clean":"2024-06-04T16:23:02.189360+0000","last_became_active":"2024-06-04T15:52:40.483272+0000","last_became_peered":"2024-06-04T15:52:40.483272+0000","last_unstale":"2024-06-04T16:23:02.189360+0000","last_undegraded":"2024-06-04T16:23:02.189360+0000","last_fullsized":"2024-06-04T16:23:02.189360+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:23:02.189267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:23:02.189267+0000","last_clean_scrub_stamp":"2024-06-04T16:23:02.189267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T00:51:47.779975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"254'83","reported_seq":621,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:58.065530+0000","last_change":"2024-06-04T16:22:58.065561+0000","last_active":"2024-06-04T16:22:58.065530+0000","last_peered":"2024-06-04T16:22:58.065530+0000","last_clean":"2024-06-04T16:22:58.065530+0000","last_became_active":"2024-06-04T15:52:42.496934+0000","last_became_peered":"2024-06-04T15:52:42.496934+0000","last_unstale":"2024-06-04T16:22:58.065530+0000","last_undegraded":"2024-06-04T16:22:58.065530+0000","last_fullsized":"2024-06-04T16:22:58.065530+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'83","last_scrub_stamp":"2024-06-04T16:22:58.065438+0000","last_deep_scrub":"254'83","last_deep_scrub_stamp":"2024-06-04T16:22:58.065438+0000","last_clean_scrub_stamp":"2024-06-04T16:22:58.065438+0000","objects_scrubbed":2,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T03:24:48.725441+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8160,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":120,"num_read_kb":184,"num_write":54,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":466,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:45.035516+0000","last_change":"2024-06-04T15:52:44.519077+0000","last_active":"2024-06-04T16:22:45.035516+0000","last_peered":"2024-06-04T16:22:45.035516+0000","last_clean":"2024-06-04T16:22:45.035516+0000","last_became_active":"2024-06-04T15:52:44.518782+0000","last_became_peered":"2024-06-04T15:52:44.518782+0000","last_unstale":"2024-06-04T16:22:45.035516+0000","last_undegraded":"2024-06-04T16:22:45.035516+0000","last_fullsized":"2024-06-04T16:22:45.035516+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:43.492872+0000","last_clean_scrub_stamp":"2024-06-04T15:52:43.492872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"254'44","reported_seq":540,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:46.089113+0000","last_change":"2024-06-04T16:22:46.089139+0000","last_active":"2024-06-04T16:22:46.089113+0000","last_peered":"2024-06-04T16:22:46.089113+0000","last_clean":"2024-06-04T16:22:46.089113+0000","last_became_active":"2024-06-04T15:52:46.531795+0000","last_became_peered":"2024-06-04T15:52:46.531795+0000","last_unstale":"2024-06-04T16:22:46.089113+0000","last_undegraded":"2024-06-04T16:22:46.089113+0000","last_fullsized":"2024-06-04T16:22:46.089113+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'44","last_scrub_stamp":"2024-06-04T16:22:46.089042+0000","last_deep_scrub":"254'44","last_deep_scrub_stamp":"2024-06-04T16:22:46.089042+0000","last_clean_scrub_stamp":"2024-06-04T16:22:46.089042+0000","objects_scrubbed":3,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T18:19:03.232432+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":429,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":136,"num_read_kb":110,"num_write":109,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"254'356","reported_seq":1092,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:21:40.023766+0000","last_change":"2024-06-04T15:52:38.478558+0000","last_active":"2024-06-04T16:21:40.023766+0000","last_peered":"2024-06-04T16:21:40.023766+0000","last_clean":"2024-06-04T16:21:40.023766+0000","last_became_active":"2024-06-04T15:52:38.478204+0000","last_became_peered":"2024-06-04T15:52:38.478204+0000","last_unstale":"2024-06-04T16:21:40.023766+0000","last_undegraded":"2024-06-04T16:21:40.023766+0000","last_fullsized":"2024-06-04T16:21:40.023766+0000","mapping_epoch":23,"log_start":"251'300","ondisk_log_start":"251'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":300,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1642,"num_read_kb":1482,"num_write":614,"num_write_kb":292,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"251'22","reported_seq":514,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:21:50.036885+0000","last_change":"2024-06-04T15:52:36.478256+0000","last_active":"2024-06-04T16:21:50.036885+0000","last_peered":"2024-06-04T16:21:50.036885+0000","last_clean":"2024-06-04T16:21:50.036885+0000","last_became_active":"2024-06-04T15:52:36.477895+0000","last_became_peered":"2024-06-04T15:52:36.477895+0000","last_unstale":"2024-06-04T16:21:50.036885+0000","last_undegraded":"2024-06-04T16:21:50.036885+0000","last_fullsized":"2024-06-04T16:21:50.036885+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":78,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":120,"num_write_kb":13440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.19","version":"26'1","reported_seq":476,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:21:45.035643+0000","last_change":"2024-06-04T15:52:40.483405+0000","last_active":"2024-06-04T16:21:45.035643+0000","last_peered":"2024-06-04T16:21:45.035643+0000","last_clean":"2024-06-04T16:21:45.035643+0000","last_became_active":"2024-06-04T15:52:40.483131+0000","last_became_peered":"2024-06-04T15:52:40.483131+0000","last_unstale":"2024-06-04T16:21:45.035643+0000","last_undegraded":"2024-06-04T16:21:45.035643+0000","last_fullsized":"2024-06-04T16:21:45.035643+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_clean_scrub_stamp":"2024-06-04T15:52:39.463103+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1a","version":"254'120","reported_seq":674,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:45.035500+0000","last_change":"2024-06-04T15:52:42.503809+0000","last_active":"2024-06-04T16:22:45.035500+0000","last_peered":"2024-06-04T16:22:45.035500+0000","last_clean":"2024-06-04T16:22:45.035500+0000","last_became_active":"2024-06-04T15:52:42.503538+0000","last_became_peered":"2024-06-04T15:52:42.503538+0000","last_unstale":"2024-06-04T16:22:45.035500+0000","last_undegraded":"2024-06-04T16:22:45.035500+0000","last_fullsized":"2024-06-04T16:22:45.035500+0000","mapping_epoch":27,"log_start":"251'100","ondisk_log_start":"251'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_clean_scrub_stamp":"2024-06-04T15:52:41.476734+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":100,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6196,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":182,"num_read_kb":236,"num_write":96,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":475,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:53.984901+0000","last_change":"2024-06-04T16:22:53.984929+0000","last_active":"2024-06-04T16:22:53.984901+0000","last_peered":"2024-06-04T16:22:53.984901+0000","last_clean":"2024-06-04T16:22:53.984901+0000","last_became_active":"2024-06-04T15:52:44.519867+0000","last_became_peered":"2024-06-04T15:52:44.519867+0000","last_unstale":"2024-06-04T16:22:53.984901+0000","last_undegraded":"2024-06-04T16:22:53.984901+0000","last_fullsized":"2024-06-04T16:22:53.984901+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:22:53.984790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:22:53.984790+0000","last_clean_scrub_stamp":"2024-06-04T16:22:53.984790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T22:21:34.850045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.14","version":"254'32","reported_seq":540,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:46.906373+0000","last_change":"2024-06-04T16:22:46.906396+0000","last_active":"2024-06-04T16:22:46.906373+0000","last_peered":"2024-06-04T16:22:46.906373+0000","last_clean":"2024-06-04T16:22:46.906373+0000","last_became_active":"2024-06-04T15:52:46.537792+0000","last_became_peered":"2024-06-04T15:52:46.537792+0000","last_unstale":"2024-06-04T16:22:46.906373+0000","last_undegraded":"2024-06-04T16:22:46.906373+0000","last_fullsized":"2024-06-04T16:22:46.906373+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'32","last_scrub_stamp":"2024-06-04T16:22:46.906299+0000","last_deep_scrub":"254'32","last_deep_scrub_stamp":"2024-06-04T16:22:46.906299+0000","last_clean_scrub_stamp":"2024-06-04T16:22:46.906299+0000","objects_scrubbed":2,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T20:36:00.317258+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":433,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":163,"num_read_kb":128,"num_write":83,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"254'156","reported_seq":948,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:45.551028+0000","last_change":"2024-06-04T15:52:38.486670+0000","last_active":"2024-06-04T16:22:45.551028+0000","last_peered":"2024-06-04T16:22:45.551028+0000","last_clean":"2024-06-04T16:22:45.551028+0000","last_became_active":"2024-06-04T15:52:38.486335+0000","last_became_peered":"2024-06-04T15:52:38.486335+0000","last_unstale":"2024-06-04T16:22:45.551028+0000","last_undegraded":"2024-06-04T16:22:45.551028+0000","last_fullsized":"2024-06-04T16:22:45.551028+0000","mapping_epoch":23,"log_start":"251'100","ondisk_log_start":"251'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":100,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":839,"num_read_kb":763,"num_write":210,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.20","version":"254'54","reported_seq":577,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:52.513454+0000","last_change":"2024-06-04T16:22:52.513504+0000","last_active":"2024-06-04T16:22:52.513454+0000","last_peered":"2024-06-04T16:22:52.513454+0000","last_clean":"2024-06-04T16:22:52.513454+0000","last_became_active":"2024-06-04T15:53:14.002428+0000","last_became_peered":"2024-06-04T15:53:14.002428+0000","last_unstale":"2024-06-04T16:22:52.513454+0000","last_undegraded":"2024-06-04T16:22:52.513454+0000","last_fullsized":"2024-06-04T16:22:52.513454+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'54","last_scrub_stamp":"2024-06-04T16:22:52.513364+0000","last_deep_scrub":"254'54","last_deep_scrub_stamp":"2024-06-04T16:22:52.513364+0000","last_clean_scrub_stamp":"2024-06-04T16:22:52.513364+0000","objects_scrubbed":2,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T03:21:52.616336+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":15429,"num_write":206,"num_write_kb":34585,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5],"acting":[2,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"254'241","reported_seq":913,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:46.972199+0000","last_change":"2024-06-04T15:52:38.481773+0000","last_active":"2024-06-04T16:22:46.972199+0000","last_peered":"2024-06-04T16:22:46.972199+0000","last_clean":"2024-06-04T16:22:46.972199+0000","last_became_active":"2024-06-04T15:52:38.481490+0000","last_became_peered":"2024-06-04T15:52:38.481490+0000","last_unstale":"2024-06-04T16:22:46.972199+0000","last_undegraded":"2024-06-04T16:22:46.972199+0000","last_fullsized":"2024-06-04T16:22:46.972199+0000","mapping_epoch":23,"log_start":"251'200","ondisk_log_start":"251'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":200,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1011,"num_read_kb":836,"num_write":379,"num_write_kb":158,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.21","version":"254'54","reported_seq":556,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:39.488781+0000","last_change":"2024-06-04T15:52:36.495330+0000","last_active":"2024-06-04T16:22:39.488781+0000","last_peered":"2024-06-04T16:22:39.488781+0000","last_clean":"2024-06-04T16:22:39.488781+0000","last_became_active":"2024-06-04T15:52:36.495008+0000","last_became_peered":"2024-06-04T15:52:36.495008+0000","last_unstale":"2024-06-04T16:22:39.488781+0000","last_undegraded":"2024-06-04T16:22:39.488781+0000","last_fullsized":"2024-06-04T16:22:39.488781+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":63,"num_read_kb":12338,"num_write":219,"num_write_kb":31559,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.25","version":"254'138","reported_seq":975,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:45.077102+0000","last_change":"2024-06-04T15:52:38.482192+0000","last_active":"2024-06-04T16:22:45.077102+0000","last_peered":"2024-06-04T16:22:45.077102+0000","last_clean":"2024-06-04T16:22:45.077102+0000","last_became_active":"2024-06-04T15:52:38.481916+0000","last_became_peered":"2024-06-04T15:52:38.481916+0000","last_unstale":"2024-06-04T16:22:45.077102+0000","last_undegraded":"2024-06-04T16:22:45.077102+0000","last_fullsized":"2024-06-04T16:22:45.077102+0000","mapping_epoch":23,"log_start":"251'100","ondisk_log_start":"251'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":911,"num_read_kb":859,"num_write":180,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"254'58","reported_seq":586,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:39.539231+0000","last_change":"2024-06-04T15:52:36.482905+0000","last_active":"2024-06-04T16:22:39.539231+0000","last_peered":"2024-06-04T16:22:39.539231+0000","last_clean":"2024-06-04T16:22:39.539231+0000","last_became_active":"2024-06-04T15:52:36.482589+0000","last_became_peered":"2024-06-04T15:52:36.482589+0000","last_unstale":"2024-06-04T16:22:39.539231+0000","last_undegraded":"2024-06-04T16:22:39.539231+0000","last_fullsized":"2024-06-04T16:22:39.539231+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":134,"num_read_kb":8380,"num_write":298,"num_write_kb":18008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7],"acting":[3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"254'104","reported_seq":813,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:46.023557+0000","last_change":"2024-06-04T15:52:38.486331+0000","last_active":"2024-06-04T16:22:46.023557+0000","last_peered":"2024-06-04T16:22:46.023557+0000","last_clean":"2024-06-04T16:22:46.023557+0000","last_became_active":"2024-06-04T15:52:38.486018+0000","last_became_peered":"2024-06-04T15:52:38.486018+0000","last_unstale":"2024-06-04T16:22:46.023557+0000","last_undegraded":"2024-06-04T16:22:46.023557+0000","last_fullsized":"2024-06-04T16:22:46.023557+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":549,"num_read_kb":515,"num_write":118,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"251'48","reported_seq":560,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:21:55.037484+0000","last_change":"2024-06-04T15:52:36.496569+0000","last_active":"2024-06-04T16:21:55.037484+0000","last_peered":"2024-06-04T16:21:55.037484+0000","last_clean":"2024-06-04T16:21:55.037484+0000","last_became_active":"2024-06-04T15:52:36.496125+0000","last_became_peered":"2024-06-04T15:52:36.496125+0000","last_unstale":"2024-06-04T16:21:55.037484+0000","last_undegraded":"2024-06-04T16:21:55.037484+0000","last_fullsized":"2024-06-04T16:21:55.037484+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":98,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":59,"num_read_kb":26302,"num_write":204,"num_write_kb":24798,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,0],"acting":[5,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.23","version":"254'93","reported_seq":808,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:21:55.037505+0000","last_change":"2024-06-04T15:52:38.485339+0000","last_active":"2024-06-04T16:21:55.037505+0000","last_peered":"2024-06-04T16:21:55.037505+0000","last_clean":"2024-06-04T16:21:55.037505+0000","last_became_active":"2024-06-04T15:52:38.484927+0000","last_became_peered":"2024-06-04T15:52:38.484927+0000","last_unstale":"2024-06-04T16:21:55.037505+0000","last_undegraded":"2024-06-04T16:21:55.037505+0000","last_fullsized":"2024-06-04T16:21:55.037505+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":509,"num_read_kb":485,"num_write":106,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"254'52","reported_seq":564,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:51.205408+0000","last_change":"2024-06-04T16:22:51.205408+0000","last_active":"2024-06-04T16:22:51.205408+0000","last_peered":"2024-06-04T16:22:51.205408+0000","last_clean":"2024-06-04T16:22:51.205408+0000","last_became_active":"2024-06-04T15:53:14.183279+0000","last_became_peered":"2024-06-04T15:53:14.183279+0000","last_unstale":"2024-06-04T16:22:51.205408+0000","last_undegraded":"2024-06-04T16:22:51.205408+0000","last_fullsized":"2024-06-04T16:22:51.205408+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'52","last_scrub_stamp":"2024-06-04T16:22:51.205271+0000","last_deep_scrub":"254'52","last_deep_scrub_stamp":"2024-06-04T16:22:51.205271+0000","last_clean_scrub_stamp":"2024-06-04T16:22:51.205271+0000","objects_scrubbed":3,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T01:25:25.764034+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1395816,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":52,"num_read_kb":1141,"num_write":191,"num_write_kb":22936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.22","version":"254'209","reported_seq":1111,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:52.914929+0000","last_change":"2024-06-04T16:22:52.914964+0000","last_active":"2024-06-04T16:22:52.914929+0000","last_peered":"2024-06-04T16:22:52.914929+0000","last_clean":"2024-06-04T16:22:52.914929+0000","last_became_active":"2024-06-04T15:52:38.488762+0000","last_became_peered":"2024-06-04T15:52:38.488762+0000","last_unstale":"2024-06-04T16:22:52.914929+0000","last_undegraded":"2024-06-04T16:22:52.914929+0000","last_fullsized":"2024-06-04T16:22:52.914929+0000","mapping_epoch":23,"log_start":"251'100","ondisk_log_start":"251'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'209","last_scrub_stamp":"2024-06-04T16:22:52.914808+0000","last_deep_scrub":"254'209","last_deep_scrub_stamp":"2024-06-04T16:22:52.914808+0000","last_clean_scrub_stamp":"2024-06-04T16:22:52.914808+0000","objects_scrubbed":1,"log_size":109,"log_dups_size":100,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T19:07:05.255680+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1221,"num_read_kb":1130,"num_write":279,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.25","version":"254'51","reported_seq":552,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:46.496502+0000","last_change":"2024-06-04T15:52:36.489331+0000","last_active":"2024-06-04T16:22:46.496502+0000","last_peered":"2024-06-04T16:22:46.496502+0000","last_clean":"2024-06-04T16:22:46.496502+0000","last_became_active":"2024-06-04T15:52:36.488611+0000","last_became_peered":"2024-06-04T15:52:36.488611+0000","last_unstale":"2024-06-04T16:22:46.496502+0000","last_undegraded":"2024-06-04T16:22:46.496502+0000","last_fullsized":"2024-06-04T16:22:46.496502+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":75,"num_read_kb":4172,"num_write":239,"num_write_kb":26328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"254'157","reported_seq":914,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:21:50.035813+0000","last_change":"2024-06-04T15:52:38.482854+0000","last_active":"2024-06-04T16:21:50.035813+0000","last_peered":"2024-06-04T16:21:50.035813+0000","last_clean":"2024-06-04T16:21:50.035813+0000","last_became_active":"2024-06-04T15:52:38.482566+0000","last_became_peered":"2024-06-04T15:52:38.482566+0000","last_unstale":"2024-06-04T16:21:50.035813+0000","last_undegraded":"2024-06-04T16:21:50.035813+0000","last_fullsized":"2024-06-04T16:21:50.035813+0000","mapping_epoch":23,"log_start":"251'100","ondisk_log_start":"251'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":100,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":759,"num_read_kb":686,"num_write":203,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"254'59","reported_seq":561,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:44.606201+0000","last_change":"2024-06-04T15:52:36.487513+0000","last_active":"2024-06-04T16:22:44.606201+0000","last_peered":"2024-06-04T16:22:44.606201+0000","last_clean":"2024-06-04T16:22:44.606201+0000","last_became_active":"2024-06-04T15:52:36.487213+0000","last_became_peered":"2024-06-04T15:52:36.487213+0000","last_unstale":"2024-06-04T16:22:44.606201+0000","last_undegraded":"2024-06-04T16:22:44.606201+0000","last_fullsized":"2024-06-04T16:22:44.606201+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3860915,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":58,"num_read_kb":7398,"num_write":258,"num_write_kb":28567,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"254'120","reported_seq":862,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:21:50.133684+0000","last_change":"2024-06-04T15:52:38.477288+0000","last_active":"2024-06-04T16:21:50.133684+0000","last_peered":"2024-06-04T16:21:50.133684+0000","last_clean":"2024-06-04T16:21:50.133684+0000","last_became_active":"2024-06-04T15:52:38.477036+0000","last_became_peered":"2024-06-04T15:52:38.477036+0000","last_unstale":"2024-06-04T16:21:50.133684+0000","last_undegraded":"2024-06-04T16:21:50.133684+0000","last_fullsized":"2024-06-04T16:21:50.133684+0000","mapping_epoch":23,"log_start":"251'100","ondisk_log_start":"251'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":100,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":627,"num_read_kb":578,"num_write":156,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"254'48","reported_seq":564,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:46.023360+0000","last_change":"2024-06-04T15:52:36.482150+0000","last_active":"2024-06-04T16:22:46.023360+0000","last_peered":"2024-06-04T16:22:46.023360+0000","last_clean":"2024-06-04T16:22:46.023360+0000","last_became_active":"2024-06-04T15:52:36.479810+0000","last_became_peered":"2024-06-04T15:52:36.479810+0000","last_unstale":"2024-06-04T16:22:46.023360+0000","last_undegraded":"2024-06-04T16:22:46.023360+0000","last_fullsized":"2024-06-04T16:22:46.023360+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048839,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":103,"num_read_kb":5904,"num_write":252,"num_write_kb":17938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2f","version":"254'58","reported_seq":708,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:46.972234+0000","last_change":"2024-06-04T15:52:38.482098+0000","last_active":"2024-06-04T16:22:46.972234+0000","last_peered":"2024-06-04T16:22:46.972234+0000","last_clean":"2024-06-04T16:22:46.972234+0000","last_became_active":"2024-06-04T15:52:38.481789+0000","last_became_peered":"2024-06-04T15:52:38.481789+0000","last_unstale":"2024-06-04T16:22:46.972234+0000","last_undegraded":"2024-06-04T16:22:46.972234+0000","last_fullsized":"2024-06-04T16:22:46.972234+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":316,"num_read_kb":309,"num_write":62,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.28","version":"254'57","reported_seq":593,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:45.076976+0000","last_change":"2024-06-04T15:52:36.491357+0000","last_active":"2024-06-04T16:22:45.076976+0000","last_peered":"2024-06-04T16:22:45.076976+0000","last_clean":"2024-06-04T16:22:45.076976+0000","last_became_active":"2024-06-04T15:52:36.490119+0000","last_became_peered":"2024-06-04T15:52:36.490119+0000","last_unstale":"2024-06-04T16:22:45.076976+0000","last_undegraded":"2024-06-04T16:22:45.076976+0000","last_fullsized":"2024-06-04T16:22:45.076976+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262178,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":124,"num_read_kb":46547,"num_write":231,"num_write_kb":19872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7],"acting":[3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"254'93","reported_seq":787,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:50.895803+0000","last_change":"2024-06-04T16:22:50.895803+0000","last_active":"2024-06-04T16:22:50.895803+0000","last_peered":"2024-06-04T16:22:50.895803+0000","last_clean":"2024-06-04T16:22:50.895803+0000","last_became_active":"2024-06-04T15:52:38.488839+0000","last_became_peered":"2024-06-04T15:52:38.488839+0000","last_unstale":"2024-06-04T16:22:50.895803+0000","last_undegraded":"2024-06-04T16:22:50.895803+0000","last_fullsized":"2024-06-04T16:22:50.895803+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'93","last_scrub_stamp":"2024-06-04T16:22:50.895627+0000","last_deep_scrub":"254'93","last_deep_scrub_stamp":"2024-06-04T16:22:50.895627+0000","last_clean_scrub_stamp":"2024-06-04T16:22:50.895627+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T23:08:02.213621+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":464,"num_read_kb":434,"num_write":108,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.29","version":"254'42","reported_seq":547,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:21:55.037452+0000","last_change":"2024-06-04T15:52:36.496347+0000","last_active":"2024-06-04T16:21:55.037452+0000","last_peered":"2024-06-04T16:21:55.037452+0000","last_clean":"2024-06-04T16:21:55.037452+0000","last_became_active":"2024-06-04T15:52:36.495936+0000","last_became_peered":"2024-06-04T15:52:36.495936+0000","last_unstale":"2024-06-04T16:21:55.037452+0000","last_undegraded":"2024-06-04T16:21:55.037452+0000","last_fullsized":"2024-06-04T16:21:55.037452+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133666,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":74,"num_read_kb":10396,"num_write":213,"num_write_kb":18947,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,0],"acting":[5,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2d","version":"254'115","reported_seq":799,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:00.038194+0000","last_change":"2024-06-04T15:52:38.488600+0000","last_active":"2024-06-04T16:22:00.038194+0000","last_peered":"2024-06-04T16:22:00.038194+0000","last_clean":"2024-06-04T16:22:00.038194+0000","last_became_active":"2024-06-04T15:52:38.488289+0000","last_became_peered":"2024-06-04T15:52:38.488289+0000","last_unstale":"2024-06-04T16:22:00.038194+0000","last_undegraded":"2024-06-04T16:22:00.038194+0000","last_fullsized":"2024-06-04T16:22:00.038194+0000","mapping_epoch":23,"log_start":"251'100","ondisk_log_start":"251'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":100,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":534,"num_read_kb":481,"num_write":150,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"254'66","reported_seq":575,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:39.443162+0000","last_change":"2024-06-04T15:52:36.495691+0000","last_active":"2024-06-04T16:22:39.443162+0000","last_peered":"2024-06-04T16:22:39.443162+0000","last_clean":"2024-06-04T16:22:39.443162+0000","last_became_active":"2024-06-04T15:52:36.495386+0000","last_became_peered":"2024-06-04T15:52:36.495386+0000","last_unstale":"2024-06-04T16:22:39.443162+0000","last_undegraded":"2024-06-04T16:22:39.443162+0000","last_fullsized":"2024-06-04T16:22:39.443162+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4553920,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":69,"num_read_kb":17530,"num_write":238,"num_write_kb":31151,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"254'90","reported_seq":829,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:21:55.134221+0000","last_change":"2024-06-04T15:52:38.477573+0000","last_active":"2024-06-04T16:21:55.134221+0000","last_peered":"2024-06-04T16:21:55.134221+0000","last_clean":"2024-06-04T16:21:55.134221+0000","last_became_active":"2024-06-04T15:52:38.477333+0000","last_became_peered":"2024-06-04T15:52:38.477333+0000","last_unstale":"2024-06-04T16:21:55.134221+0000","last_undegraded":"2024-06-04T16:21:55.134221+0000","last_fullsized":"2024-06-04T16:21:55.134221+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":521,"num_read_kb":500,"num_write":102,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"251'47","reported_seq":559,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:21:55.037048+0000","last_change":"2024-06-04T15:52:36.483514+0000","last_active":"2024-06-04T16:21:55.037048+0000","last_peered":"2024-06-04T16:21:55.037048+0000","last_clean":"2024-06-04T16:21:55.037048+0000","last_became_active":"2024-06-04T15:52:36.482036+0000","last_became_peered":"2024-06-04T15:52:36.482036+0000","last_unstale":"2024-06-04T16:21:55.037048+0000","last_undegraded":"2024-06-04T16:21:55.037048+0000","last_fullsized":"2024-06-04T16:21:55.037048+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1069194,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":76,"num_read_kb":25646,"num_write":152,"num_write_kb":18921,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,6],"acting":[4,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"254'150","reported_seq":904,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:21:55.134212+0000","last_change":"2024-06-04T15:52:38.481261+0000","last_active":"2024-06-04T16:21:55.134212+0000","last_peered":"2024-06-04T16:21:55.134212+0000","last_clean":"2024-06-04T16:21:55.134212+0000","last_became_active":"2024-06-04T15:52:38.480432+0000","last_became_peered":"2024-06-04T15:52:38.480432+0000","last_unstale":"2024-06-04T16:21:55.134212+0000","last_undegraded":"2024-06-04T16:21:55.134212+0000","last_fullsized":"2024-06-04T16:21:55.134212+0000","mapping_epoch":23,"log_start":"251'100","ondisk_log_start":"251'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":100,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":703,"num_read_kb":638,"num_write":178,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"254'54","reported_seq":555,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:21:55.023014+0000","last_change":"2024-06-04T15:52:36.492604+0000","last_active":"2024-06-04T16:21:55.023014+0000","last_peered":"2024-06-04T16:21:55.023014+0000","last_clean":"2024-06-04T16:21:55.023014+0000","last_became_active":"2024-06-04T15:52:36.488813+0000","last_became_peered":"2024-06-04T15:52:36.488813+0000","last_unstale":"2024-06-04T16:21:55.023014+0000","last_undegraded":"2024-06-04T16:21:55.023014+0000","last_fullsized":"2024-06-04T16:21:55.023014+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":75,"num_read_kb":5170,"num_write":190,"num_write_kb":17954,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6],"acting":[0,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"254'97","reported_seq":792,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:21:55.149851+0000","last_change":"2024-06-04T15:52:38.479843+0000","last_active":"2024-06-04T16:21:55.149851+0000","last_peered":"2024-06-04T16:21:55.149851+0000","last_clean":"2024-06-04T16:21:55.149851+0000","last_became_active":"2024-06-04T15:52:38.479542+0000","last_became_peered":"2024-06-04T15:52:38.479542+0000","last_unstale":"2024-06-04T16:21:55.149851+0000","last_undegraded":"2024-06-04T16:21:55.149851+0000","last_fullsized":"2024-06-04T16:21:55.149851+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":493,"num_read_kb":461,"num_write":115,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"251'65","reported_seq":575,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:00.030267+0000","last_change":"2024-06-04T15:52:36.488268+0000","last_active":"2024-06-04T16:22:00.030267+0000","last_peered":"2024-06-04T16:22:00.030267+0000","last_clean":"2024-06-04T16:22:00.030267+0000","last_became_active":"2024-06-04T15:52:36.487971+0000","last_became_peered":"2024-06-04T15:52:36.487971+0000","last_unstale":"2024-06-04T16:22:00.030267+0000","last_undegraded":"2024-06-04T16:22:00.030267+0000","last_fullsized":"2024-06-04T16:22:00.030267+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262163,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":94,"num_read_kb":7564,"num_write":255,"num_write_kb":36740,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"254'136","reported_seq":912,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:21:55.036996+0000","last_change":"2024-06-04T15:52:38.484562+0000","last_active":"2024-06-04T16:21:55.036996+0000","last_peered":"2024-06-04T16:21:55.036996+0000","last_clean":"2024-06-04T16:21:55.036996+0000","last_became_active":"2024-06-04T15:52:38.484225+0000","last_became_peered":"2024-06-04T15:52:38.484225+0000","last_unstale":"2024-06-04T16:21:55.036996+0000","last_undegraded":"2024-06-04T16:21:55.036996+0000","last_fullsized":"2024-06-04T16:21:55.036996+0000","mapping_epoch":23,"log_start":"251'100","ondisk_log_start":"251'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":100,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":727,"num_read_kb":670,"num_write":170,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2e","version":"254'55","reported_seq":568,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:46.972045+0000","last_change":"2024-06-04T15:52:36.488496+0000","last_active":"2024-06-04T16:22:46.972045+0000","last_peered":"2024-06-04T16:22:46.972045+0000","last_clean":"2024-06-04T16:22:46.972045+0000","last_became_active":"2024-06-04T15:52:36.488139+0000","last_became_peered":"2024-06-04T15:52:36.488139+0000","last_unstale":"2024-06-04T16:22:46.972045+0000","last_undegraded":"2024-06-04T16:22:46.972045+0000","last_fullsized":"2024-06-04T16:22:46.972045+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":103,"num_read_kb":14422,"num_write":268,"num_write_kb":32685,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,3],"acting":[7,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.28","version":"254'289","reported_seq":1125,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:44.133262+0000","last_change":"2024-06-04T15:52:38.480910+0000","last_active":"2024-06-04T16:22:44.133262+0000","last_peered":"2024-06-04T16:22:44.133262+0000","last_clean":"2024-06-04T16:22:44.133262+0000","last_became_active":"2024-06-04T15:52:38.480613+0000","last_became_peered":"2024-06-04T15:52:38.480613+0000","last_unstale":"2024-06-04T16:22:44.133262+0000","last_undegraded":"2024-06-04T16:22:44.133262+0000","last_fullsized":"2024-06-04T16:22:44.133262+0000","mapping_epoch":23,"log_start":"251'200","ondisk_log_start":"251'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":200,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1456,"num_read_kb":1243,"num_write":452,"num_write_kb":208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"254'57","reported_seq":559,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:45.076992+0000","last_change":"2024-06-04T15:52:36.498902+0000","last_active":"2024-06-04T16:22:45.076992+0000","last_peered":"2024-06-04T16:22:45.076992+0000","last_clean":"2024-06-04T16:22:45.076992+0000","last_became_active":"2024-06-04T15:52:36.498564+0000","last_became_peered":"2024-06-04T15:52:36.498564+0000","last_unstale":"2024-06-04T16:22:45.076992+0000","last_undegraded":"2024-06-04T16:22:45.076992+0000","last_fullsized":"2024-06-04T16:22:45.076992+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1395816,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":73,"num_read_kb":11423,"num_write":228,"num_write_kb":34926,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"251'38","reported_seq":550,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:45.076981+0000","last_change":"2024-06-04T15:52:36.490119+0000","last_active":"2024-06-04T16:22:45.076981+0000","last_peered":"2024-06-04T16:22:45.076981+0000","last_clean":"2024-06-04T16:22:45.076981+0000","last_became_active":"2024-06-04T15:52:36.489681+0000","last_became_peered":"2024-06-04T15:52:36.489681+0000","last_unstale":"2024-06-04T16:22:45.076981+0000","last_undegraded":"2024-06-04T16:22:45.076981+0000","last_fullsized":"2024-06-04T16:22:45.076981+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1395831,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":78,"num_read_kb":4250,"num_write":172,"num_write_kb":18293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,6],"acting":[3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"254'121","reported_seq":1033,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:01.992253+0000","last_change":"2024-06-04T16:23:01.992301+0000","last_active":"2024-06-04T16:23:01.992253+0000","last_peered":"2024-06-04T16:23:01.992253+0000","last_clean":"2024-06-04T16:23:01.992253+0000","last_became_active":"2024-06-04T15:52:38.488941+0000","last_became_peered":"2024-06-04T15:52:38.488941+0000","last_unstale":"2024-06-04T16:23:01.992253+0000","last_undegraded":"2024-06-04T16:23:01.992253+0000","last_fullsized":"2024-06-04T16:23:01.992253+0000","mapping_epoch":23,"log_start":"251'100","ondisk_log_start":"251'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'121","last_scrub_stamp":"2024-06-04T16:23:01.992144+0000","last_deep_scrub":"254'121","last_deep_scrub_stamp":"2024-06-04T16:23:01.992144+0000","last_clean_scrub_stamp":"2024-06-04T16:23:01.992144+0000","objects_scrubbed":2,"log_size":21,"log_dups_size":100,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T21:08:34.393894+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1004,"num_read_kb":976,"num_write":157,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2539,"num_omap_keys":10,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"251'45","reported_seq":544,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:46.023404+0000","last_change":"2024-06-04T15:52:36.496468+0000","last_active":"2024-06-04T16:22:46.023404+0000","last_peered":"2024-06-04T16:22:46.023404+0000","last_clean":"2024-06-04T16:22:46.023404+0000","last_became_active":"2024-06-04T15:52:36.496046+0000","last_became_peered":"2024-06-04T15:52:36.496046+0000","last_unstale":"2024-06-04T16:22:46.023404+0000","last_undegraded":"2024-06-04T16:22:46.023404+0000","last_fullsized":"2024-06-04T16:22:46.023404+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1069179,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":46,"num_read_kb":3657,"num_write":159,"num_write_kb":22961,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3],"acting":[5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.36","version":"254'112","reported_seq":819,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:21:40.132739+0000","last_change":"2024-06-04T15:52:38.474859+0000","last_active":"2024-06-04T16:21:40.132739+0000","last_peered":"2024-06-04T16:21:40.132739+0000","last_clean":"2024-06-04T16:21:40.132739+0000","last_became_active":"2024-06-04T15:52:38.474574+0000","last_became_peered":"2024-06-04T15:52:38.474574+0000","last_unstale":"2024-06-04T16:21:40.132739+0000","last_undegraded":"2024-06-04T16:21:40.132739+0000","last_fullsized":"2024-06-04T16:21:40.132739+0000","mapping_epoch":23,"log_start":"254'100","ondisk_log_start":"254'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":100,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":563,"num_read_kb":518,"num_write":138,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":16777216,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":169,"num_read_kb":189232,"num_write":179,"num_write_kb":125730,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":33554432,"data_stored":33554432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":131,"ondisk_log_size":131,"up":64,"acting":64,"num_store_stats":8},{"poolid":64,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4378,"num_read_kb":3242,"num_write":1279,"num_write_kb":637,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4455,"num_omap_keys":9,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":683,"ondisk_log_size":683,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":8922,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":3579,"num_read_kb":3443,"num_write":3611,"num_write_kb":1042,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1201,"num_omap_keys":7,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":319488,"data_stored":17844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1038,"ondisk_log_size":1038,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":564,"ondisk_log_size":564,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":300865,"num_objects":188,"num_object_clones":0,"num_object_copies":376,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":188,"num_whiteouts":0,"num_read":6099,"num_read_kb":7761,"num_write":3199,"num_write_kb":973,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":624,"num_omap_keys":4,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1970,"ondisk_log_size":1970,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1533,"num_read_kb":1825,"num_write":20,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13,"ondisk_log_size":13,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":77,"num_object_clones":0,"num_object_copies":154,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":77,"num_whiteouts":0,"num_read":48565,"num_read_kb":44901,"num_write":11590,"num_write_kb":3535,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":77,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":12457,"num_omap_keys":50,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3775,"ondisk_log_size":3775,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":85563130,"num_objects":200,"num_object_clones":0,"num_object_copies":600,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":200,"num_whiteouts":0,"num_read":5481,"num_read_kb":1011284,"num_write":14360,"num_write_kb":1691909,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":130080768,"data_stored":130080768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3497,"ondisk_log_size":3497,"up":192,"acting":192,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":12,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4,"ondisk_log_size":4,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":16777216,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":170,"num_read_kb":185843,"num_write":179,"num_write_kb":125730,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":33554432,"data_stored":33554432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":129,"ondisk_log_size":129,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542518,"num_pgs":96,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":195128,"kb_used_data":23792,"kb_used_omap":1,"kb_used_meta":171326,"kb_avail":94176712,"statfs":{"total":96636764160,"available":96436953088,"internally_reserved":0,"allocated":24363008,"data_stored":22488525,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":175438282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542518,"num_pgs":108,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":73832,"kb_used_data":24608,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94298008,"statfs":{"total":96636764160,"available":96561160192,"internally_reserved":0,"allocated":25198592,"data_stored":23328559,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":50395591},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542517,"num_pgs":115,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":224796,"kb_used_data":22868,"kb_used_omap":1,"kb_used_meta":201918,"kb_avail":94147044,"statfs":{"total":96636764160,"available":96406573056,"internally_reserved":0,"allocated":23416832,"data_stored":21539413,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":206764485},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542515,"num_pgs":122,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":150856,"kb_used_data":33664,"kb_used_omap":1,"kb_used_meta":117182,"kb_avail":94220984,"statfs":{"total":96636764160,"available":96482287616,"internally_reserved":0,"allocated":34471936,"data_stored":32597872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":119994821},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542518,"num_pgs":119,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":205024,"kb_used_data":29464,"kb_used_omap":1,"kb_used_meta":175550,"kb_avail":94166816,"statfs":{"total":96636764160,"available":96426819584,"internally_reserved":0,"allocated":30171136,"data_stored":28278302,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":179763655},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542518,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":98200,"kb_used_data":22608,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94273640,"statfs":{"total":96636764160,"available":96536207360,"internally_reserved":0,"allocated":23150592,"data_stored":21269158,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":77396421},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542517,"num_pgs":98,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":266972,"kb_used_data":37268,"kb_used_omap":1,"kb_used_meta":229694,"kb_avail":94104868,"statfs":{"total":96636764160,"available":96363384832,"internally_reserved":0,"allocated":38162432,"data_stored":36275175,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":235207109},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542518,"num_pgs":93,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":80224,"kb_used_data":31000,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94291616,"statfs":{"total":96636764160,"available":96554614784,"internally_reserved":0,"allocated":31744000,"data_stored":29845910,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":25591808,"data_stored":25591808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":22585344,"data_stored":22585344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":14917632,"data_stored":14917632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":18190336,"data_stored":18190336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":18907136,"data_stored":18907136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":10403840,"data_stored":10403840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":10686464,"data_stored":10686464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8798208,"data_stored":8798208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":1139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":1364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2484,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1047,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":2789,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":2757,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2173,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2491,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1703,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":64,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":64,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":64,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":64,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":64,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":64,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":64,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":64,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":1048576,"data_stored":1048576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":1048576,"data_stored":1048576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":7340032,"data_stored":7340032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":5242880,"data_stored":5242880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4194304,"data_stored":4194304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":9437184,"data_stored":9437184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":5242880,"data_stored":5242880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":1048576,"data_stored":1048576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":10485760,"data_stored":10485760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4194304,"data_stored":4194304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":6291456,"data_stored":6291456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4194304,"data_stored":4194304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":1048576,"data_stored":1048576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":6291456,"data_stored":6291456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-06-04T16:23:07.783 INFO:tasks.ceph:pgid 67.1c last_scrub_stamp 2024-06-04T16:16:07.631263+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=16, tm_sec=7, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:07.783 INFO:tasks.ceph:pgid 66.1d last_scrub_stamp 2024-06-04T16:09:25.601105+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=9, tm_sec=25, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:07.784 INFO:tasks.ceph:pgid 65.1e last_scrub_stamp 2024-06-04T16:09:22.572686+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=9, tm_sec=22, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:07.784 INFO:tasks.ceph:pgid 67.1d last_scrub_stamp 2024-06-04T16:16:07.631263+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=16, tm_sec=7, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:07.784 INFO:tasks.ceph:pgid 65.1f last_scrub_stamp 2024-06-04T16:09:22.572686+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=9, tm_sec=22, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:07.784 INFO:tasks.ceph:pgid 67.1e last_scrub_stamp 2024-06-04T16:16:07.631263+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=16, tm_sec=7, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:07.784 INFO:tasks.ceph:pgid 66.1f last_scrub_stamp 2024-06-04T16:09:25.601105+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=9, tm_sec=25, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:07.785 INFO:tasks.ceph:pgid 67.1f last_scrub_stamp 2024-06-04T16:16:07.631263+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=16, tm_sec=7, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:07.785 INFO:tasks.ceph:pgid 67.18 last_scrub_stamp 2024-06-04T16:16:07.631263+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=16, tm_sec=7, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:07.785 INFO:tasks.ceph:pgid 66.19 last_scrub_stamp 2024-06-04T16:09:25.601105+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=9, tm_sec=25, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:07.785 INFO:tasks.ceph:pgid 67.19 last_scrub_stamp 2024-06-04T16:16:07.631263+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=16, tm_sec=7, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:07.785 INFO:tasks.ceph:pgid 65.1b last_scrub_stamp 2024-06-04T16:09:22.572686+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=9, tm_sec=22, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:07.786 INFO:tasks.ceph:pgid 67.1a last_scrub_stamp 2024-06-04T16:16:07.631263+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=16, tm_sec=7, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:07.786 INFO:tasks.ceph:pgid 66.1b last_scrub_stamp 2024-06-04T16:09:25.601105+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=9, tm_sec=25, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:07.786 INFO:tasks.ceph:pgid 67.1b last_scrub_stamp 2024-06-04T16:16:07.631263+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=16, tm_sec=7, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:07.786 INFO:tasks.ceph:pgid 66.1a last_scrub_stamp 2024-06-04T16:09:25.601105+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=9, tm_sec=25, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:07.787 INFO:tasks.ceph:pgid 67.14 last_scrub_stamp 2024-06-04T16:16:07.631263+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=16, tm_sec=7, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:07.787 INFO:tasks.ceph:pgid 66.15 last_scrub_stamp 2024-06-04T16:09:25.601105+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=9, tm_sec=25, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:07.787 INFO:tasks.ceph:pgid 65.16 last_scrub_stamp 2024-06-04T16:09:22.572686+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=9, tm_sec=22, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:07.787 INFO:tasks.ceph:pgid 67.15 last_scrub_stamp 2024-06-04T16:16:07.631263+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=16, tm_sec=7, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:07.787 INFO:tasks.ceph:pgid 66.14 last_scrub_stamp 2024-06-04T16:09:25.601105+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=9, tm_sec=25, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:07.788 INFO:tasks.ceph:pgid 65.17 last_scrub_stamp 2024-06-04T16:09:22.572686+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=9, tm_sec=22, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:07.788 INFO:tasks.ceph:pgid 67.16 last_scrub_stamp 2024-06-04T16:16:07.631263+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=16, tm_sec=7, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:07.788 INFO:tasks.ceph:pgid 67.17 last_scrub_stamp 2024-06-04T16:16:07.631263+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=16, tm_sec=7, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:07.788 INFO:tasks.ceph:pgid 67.10 last_scrub_stamp 2024-06-04T16:16:07.631263+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=16, tm_sec=7, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:07.788 INFO:tasks.ceph:pgid 67.11 last_scrub_stamp 2024-06-04T16:16:07.631263+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=16, tm_sec=7, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:07.789 INFO:tasks.ceph:pgid 66.10 last_scrub_stamp 2024-06-04T16:09:25.601105+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=9, tm_sec=25, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:07.789 INFO:tasks.ceph:pgid 67.12 last_scrub_stamp 2024-06-04T16:16:07.631263+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=16, tm_sec=7, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:07.789 INFO:tasks.ceph:pgid 66.13 last_scrub_stamp 2024-06-04T16:09:25.601105+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=9, tm_sec=25, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:07.789 INFO:tasks.ceph:pgid 67.13 last_scrub_stamp 2024-06-04T16:16:07.631263+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=16, tm_sec=7, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:07.789 INFO:tasks.ceph:pgid 66.12 last_scrub_stamp 2024-06-04T16:09:25.601105+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=9, tm_sec=25, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:07.790 INFO:tasks.ceph:pgid 67.c last_scrub_stamp 2024-06-04T16:16:07.631263+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=16, tm_sec=7, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:07.790 INFO:tasks.ceph:pgid 66.d last_scrub_stamp 2024-06-04T16:09:25.601105+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=9, tm_sec=25, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:07.790 INFO:tasks.ceph:pgid 67.d last_scrub_stamp 2024-06-04T16:16:07.631263+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=16, tm_sec=7, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:07.790 INFO:tasks.ceph:pgid 66.c last_scrub_stamp 2024-06-04T16:09:25.601105+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=9, tm_sec=25, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:07.790 INFO:tasks.ceph:pgid 67.e last_scrub_stamp 2024-06-04T16:16:07.631263+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=16, tm_sec=7, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:07.791 INFO:tasks.ceph:pgid 65.c last_scrub_stamp 2024-06-04T16:09:22.572686+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=9, tm_sec=22, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:07.791 INFO:tasks.ceph:pgid 67.f last_scrub_stamp 2024-06-04T16:16:07.631263+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=16, tm_sec=7, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:07.791 INFO:tasks.ceph:pgid 65.d last_scrub_stamp 2024-06-04T16:09:22.572686+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=9, tm_sec=22, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:07.791 INFO:tasks.ceph:pgid 67.8 last_scrub_stamp 2024-06-04T16:16:07.631263+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=16, tm_sec=7, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:07.791 INFO:tasks.ceph:pgid 67.9 last_scrub_stamp 2024-06-04T16:16:07.631263+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=16, tm_sec=7, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:07.792 INFO:tasks.ceph:pgid 65.b last_scrub_stamp 2024-06-04T16:09:22.572686+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=9, tm_sec=22, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:07.792 INFO:tasks.ceph:pgid 67.a last_scrub_stamp 2024-06-04T16:16:07.631263+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=16, tm_sec=7, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:07.792 INFO:tasks.ceph:pgid 66.b last_scrub_stamp 2024-06-04T16:09:25.601105+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=9, tm_sec=25, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:07.792 INFO:tasks.ceph:pgid 65.8 last_scrub_stamp 2024-06-04T16:09:22.572686+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=9, tm_sec=22, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:07.792 INFO:tasks.ceph:pgid 67.b last_scrub_stamp 2024-06-04T16:16:07.631263+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=16, tm_sec=7, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:07.793 INFO:tasks.ceph:pgid 67.4 last_scrub_stamp 2024-06-04T16:16:07.631263+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=16, tm_sec=7, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:07.793 INFO:tasks.ceph:pgid 66.5 last_scrub_stamp 2024-06-04T16:09:25.601105+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=9, tm_sec=25, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:07.793 INFO:tasks.ceph:pgid 67.5 last_scrub_stamp 2024-06-04T16:16:07.631263+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=16, tm_sec=7, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:07.793 INFO:tasks.ceph:pgid 66.4 last_scrub_stamp 2024-06-04T16:09:25.601105+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=9, tm_sec=25, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:07.793 INFO:tasks.ceph:pgid 65.7 last_scrub_stamp 2024-06-04T16:09:22.572686+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=9, tm_sec=22, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:07.794 INFO:tasks.ceph:pgid 67.6 last_scrub_stamp 2024-06-04T16:16:07.631263+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=16, tm_sec=7, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:07.794 INFO:tasks.ceph:pgid 66.7 last_scrub_stamp 2024-06-04T16:09:25.601105+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=9, tm_sec=25, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:07.794 INFO:tasks.ceph:pgid 67.7 last_scrub_stamp 2024-06-04T16:16:07.631263+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=16, tm_sec=7, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:07.794 INFO:tasks.ceph:pgid 67.0 last_scrub_stamp 2024-06-04T16:16:07.631263+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=16, tm_sec=7, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:07.794 INFO:tasks.ceph:pgid 66.1 last_scrub_stamp 2024-06-04T16:09:25.601105+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=9, tm_sec=25, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:07.795 INFO:tasks.ceph:pgid 67.1 last_scrub_stamp 2024-06-04T16:16:07.631263+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=16, tm_sec=7, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:07.795 INFO:tasks.ceph:pgid 66.0 last_scrub_stamp 2024-06-04T16:09:25.601105+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=9, tm_sec=25, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:07.795 INFO:tasks.ceph:pgid 67.2 last_scrub_stamp 2024-06-04T16:16:07.631263+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=16, tm_sec=7, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:07.795 INFO:tasks.ceph:pgid 66.3 last_scrub_stamp 2024-06-04T16:09:25.601105+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=9, tm_sec=25, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:07.795 INFO:tasks.ceph:pgid 67.3 last_scrub_stamp 2024-06-04T16:16:07.631263+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=16, tm_sec=7, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:07.795 INFO:tasks.ceph:pgid 66.2 last_scrub_stamp 2024-06-04T16:09:25.601105+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=9, tm_sec=25, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:07.796 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-06-04T15:52:35.455324+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=35, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:07.796 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-06-04T15:52:37.459483+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=37, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:07.796 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-06-04T15:52:35.455324+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=35, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:07.796 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-06-04T15:52:37.459483+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=37, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:07.796 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-06-04T15:52:35.455324+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=35, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:07.797 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-06-04T15:52:37.459483+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=37, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:07.797 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-06-04T15:52:35.455324+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=35, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:07.797 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-06-04T15:52:35.455324+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=35, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:07.797 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-06-04T15:52:35.455324+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=35, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:07.797 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-06-04T15:52:35.455324+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=35, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:07.797 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-06-04T15:52:37.459483+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=37, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:07.798 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-06-04T15:52:37.459483+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=37, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:07.798 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-06-04T15:52:35.455324+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=35, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:07.798 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-06-04T15:52:35.455324+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=35, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:07.798 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-06-04T15:52:37.459483+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=37, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:07.798 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-06-04T15:52:37.459483+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=37, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:07.799 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-06-04T15:52:35.455324+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=35, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:07.799 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-06-04T15:52:37.459483+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=37, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:07.799 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-06-04T15:52:35.455324+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=35, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:07.799 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-06-04T15:52:35.455324+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=35, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:07.799 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-06-04T15:52:37.459483+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=37, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:07.799 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-06-04T15:52:35.455324+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=35, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:07.800 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2024-06-04T15:52:39.463103+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=39, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:07.800 INFO:tasks.ceph:pgid 7.17 last_scrub_stamp 2024-06-04T15:52:43.492872+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=43, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:07.800 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-06-04T15:52:37.459483+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=37, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:07.800 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-06-04T15:52:35.455324+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=35, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:07.800 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-06-04T15:52:39.463103+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=39, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:07.800 INFO:tasks.ceph:pgid 6.17 last_scrub_stamp 2024-06-04T15:52:41.476734+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=41, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:07.801 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-06-04T15:52:37.459483+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=37, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:07.801 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-06-04T15:52:35.455324+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=35, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:07.801 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2024-06-04T15:52:39.463103+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=39, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:07.801 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-06-04T15:52:37.459483+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=37, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:07.801 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-06-04T15:52:35.455324+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=35, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:07.802 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2024-06-04T15:52:39.463103+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=39, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:07.802 INFO:tasks.ceph:pgid 7.14 last_scrub_stamp 2024-06-04T15:52:43.492872+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=43, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:07.802 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-06-04T15:52:37.459483+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=37, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:07.802 INFO:tasks.ceph:pgid 7.b last_scrub_stamp 2024-06-04T15:52:43.492872+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=43, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:07.802 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-06-04T15:52:35.455324+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=35, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:07.803 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-06-04T15:52:37.459483+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=37, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:07.803 INFO:tasks.ceph:pgid 5.b last_scrub_stamp 2024-06-04T15:52:39.463103+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=39, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:07.803 INFO:tasks.ceph:pgid 6.8 last_scrub_stamp 2024-06-04T15:52:41.476734+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=41, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:07.803 INFO:tasks.ceph:pgid 7.9 last_scrub_stamp 2024-06-04T15:52:43.492872+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=43, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:07.803 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-06-04T15:52:37.459483+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=37, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:07.804 INFO:tasks.ceph:pgid 7.8 last_scrub_stamp 2024-06-04T15:52:43.492872+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=43, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:07.804 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-06-04T15:52:35.455324+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=35, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:07.804 INFO:tasks.ceph:pgid 5.d last_scrub_stamp 2024-06-04T15:52:39.463103+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=39, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:07.804 INFO:tasks.ceph:pgid 6.e last_scrub_stamp 2024-06-04T15:52:41.476734+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=41, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:07.804 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2024-06-04T15:52:43.492872+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=43, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:07.805 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-06-04T15:52:37.459483+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=37, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:07.805 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-06-04T15:52:35.455324+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=35, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:07.805 INFO:tasks.ceph:pgid 5.c last_scrub_stamp 2024-06-04T15:52:39.463103+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=39, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:07.805 INFO:tasks.ceph:pgid 6.f last_scrub_stamp 2024-06-04T15:52:41.476734+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=41, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:07.805 INFO:tasks.ceph:pgid 7.e last_scrub_stamp 2024-06-04T15:52:43.492872+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=43, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:07.805 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-06-04T15:52:45.513877+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=45, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:07.806 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-06-04T15:52:37.459483+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=37, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:07.806 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-06-04T15:52:35.455324+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=35, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:07.806 INFO:tasks.ceph:pgid 8.2 last_scrub_stamp 2024-06-04T15:52:45.513877+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=45, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:07.806 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-06-04T15:52:37.459483+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=37, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:07.806 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-06-04T15:52:35.455324+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=35, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:07.807 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2024-06-04T15:52:39.463103+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=39, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:07.807 INFO:tasks.ceph:pgid 6.d last_scrub_stamp 2024-06-04T15:52:41.476734+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=41, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:07.807 INFO:tasks.ceph:pgid 7.c last_scrub_stamp 2024-06-04T15:52:43.492872+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=43, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:07.807 INFO:tasks.ceph:pgid 8.3 last_scrub_stamp 2024-06-04T15:52:45.513877+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=45, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:07.807 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-06-04T15:52:37.459483+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=37, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:07.808 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-06-04T15:52:21.400880+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=21, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:07.808 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-06-04T15:52:35.455324+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=35, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:07.808 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2024-06-04T15:52:41.476734+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=41, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:07.808 INFO:tasks.ceph:pgid 7.6 last_scrub_stamp 2024-06-04T15:52:43.492872+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=43, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:07.808 INFO:tasks.ceph:pgid 8.9 last_scrub_stamp 2024-06-04T15:52:45.513877+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=45, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:07.808 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-06-04T15:52:37.459483+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=37, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:07.809 INFO:tasks.ceph:pgid 1.1 last_scrub_stamp 2024-06-04T15:52:21.400880+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=21, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:07.809 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-06-04T15:52:35.455324+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=35, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:07.809 INFO:tasks.ceph:pgid 5.5 last_scrub_stamp 2024-06-04T15:52:39.463103+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=39, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:07.809 INFO:tasks.ceph:pgid 6.6 last_scrub_stamp 2024-06-04T15:52:41.476734+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=41, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:07.809 INFO:tasks.ceph:pgid 1.2 last_scrub_stamp 2024-06-04T15:52:21.400880+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=21, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:07.810 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-06-04T15:52:35.455324+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=35, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:07.810 INFO:tasks.ceph:pgid 5.6 last_scrub_stamp 2024-06-04T15:52:39.463103+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=39, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:07.810 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-06-04T15:52:37.459483+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=37, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:07.810 INFO:tasks.ceph:pgid 1.3 last_scrub_stamp 2024-06-04T15:52:21.400880+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=21, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:07.810 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-06-04T15:52:21.400880+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=21, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:07.811 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-06-04T15:52:35.455324+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=35, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:07.811 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2024-06-04T15:52:39.463103+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=39, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:07.811 INFO:tasks.ceph:pgid 6.4 last_scrub_stamp 2024-06-04T15:52:41.476734+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=41, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:07.811 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-06-04T15:52:35.455324+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=35, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:07.812 INFO:tasks.ceph:pgid 1.4 last_scrub_stamp 2024-06-04T15:52:21.400880+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=21, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:07.812 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-06-04T15:52:37.459483+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=37, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:07.812 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-06-04T15:52:35.455324+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=35, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:07.812 INFO:tasks.ceph:pgid 1.5 last_scrub_stamp 2024-06-04T15:52:21.400880+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=21, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:07.812 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2024-06-04T15:52:39.463103+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=39, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:07.813 INFO:tasks.ceph:pgid 6.2 last_scrub_stamp 2024-06-04T15:52:41.476734+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=41, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:07.813 INFO:tasks.ceph:pgid 7.3 last_scrub_stamp 2024-06-04T15:52:43.492872+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=43, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:07.813 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-06-04T15:52:35.455324+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=35, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:07.813 INFO:tasks.ceph:pgid 1.6 last_scrub_stamp 2024-06-04T15:52:21.400880+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=21, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:07.813 INFO:tasks.ceph:pgid 7.0 last_scrub_stamp 2024-06-04T15:52:43.492872+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=43, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:07.814 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-06-04T15:52:45.513877+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=45, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:07.814 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-06-04T15:52:37.459483+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=37, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:07.814 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-06-04T15:52:35.455324+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=35, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:07.814 INFO:tasks.ceph:pgid 1.7 last_scrub_stamp 2024-06-04T15:52:21.400880+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=21, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:07.814 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2024-06-04T15:52:39.463103+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=39, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:07.815 INFO:tasks.ceph:pgid 6.0 last_scrub_stamp 2024-06-04T15:52:41.476734+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=41, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:07.815 INFO:tasks.ceph:pgid 7.1 last_scrub_stamp 2024-06-04T15:52:43.492872+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=43, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:07.815 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-06-04T15:52:37.459483+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=37, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:07.815 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-06-04T15:52:35.455324+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=35, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:07.815 INFO:tasks.ceph:pgid 6.11 last_scrub_stamp 2024-06-04T15:52:41.476734+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=41, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:07.816 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2024-06-04T15:52:43.492872+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=43, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:07.816 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-06-04T15:52:45.513877+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=45, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:07.816 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-06-04T15:52:35.455324+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=35, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:07.816 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2024-06-04T15:52:39.463103+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=39, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:07.817 INFO:tasks.ceph:pgid 7.11 last_scrub_stamp 2024-06-04T15:52:43.492872+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=43, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:07.817 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-06-04T15:52:37.459483+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=37, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:07.817 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-06-04T15:52:35.455324+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=35, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:07.817 INFO:tasks.ceph:pgid 6.13 last_scrub_stamp 2024-06-04T15:52:41.476734+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=41, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:07.817 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-06-04T15:52:37.459483+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=37, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:07.817 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-06-04T15:52:35.455324+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=35, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:07.818 INFO:tasks.ceph:pgid 5.11 last_scrub_stamp 2024-06-04T15:52:39.463103+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=39, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:07.818 INFO:tasks.ceph:pgid 7.13 last_scrub_stamp 2024-06-04T15:52:43.492872+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=43, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:07.818 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-06-04T15:52:37.459483+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=37, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:07.818 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-06-04T15:52:35.455324+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=35, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:07.818 INFO:tasks.ceph:pgid 6.1d last_scrub_stamp 2024-06-04T15:52:41.476734+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=41, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:07.818 INFO:tasks.ceph:pgid 7.1c last_scrub_stamp 2024-06-04T15:52:43.492872+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=43, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:07.819 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-06-04T15:52:37.459483+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=37, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:07.819 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-06-04T15:52:35.455324+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=35, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:07.819 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2024-06-04T15:52:41.476734+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=41, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:07.819 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-06-04T15:52:37.459483+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=37, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:07.819 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-06-04T15:52:35.455324+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=35, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:07.819 INFO:tasks.ceph:pgid 7.1e last_scrub_stamp 2024-06-04T15:52:43.492872+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=43, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:07.820 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-06-04T15:52:37.459483+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=37, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:07.820 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-06-04T15:52:35.455324+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=35, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:07.820 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2024-06-04T15:52:39.463103+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=39, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:07.820 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2024-06-04T15:52:41.476734+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=41, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:07.820 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-06-04T15:52:35.455324+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=35, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:07.821 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-06-04T15:52:37.459483+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=37, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:07.821 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-06-04T15:52:35.455324+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=35, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:07.821 INFO:tasks.ceph:pgid 6.18 last_scrub_stamp 2024-06-04T15:52:41.476734+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=41, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:07.821 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-06-04T15:52:37.459483+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=37, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:07.821 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-06-04T15:52:35.455324+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=35, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:07.821 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-06-04T15:52:43.492872+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=43, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:07.822 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-06-04T15:52:37.459483+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=37, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:07.822 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-06-04T15:52:35.455324+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=35, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:07.822 INFO:tasks.ceph:pgid 5.19 last_scrub_stamp 2024-06-04T15:52:39.463103+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=39, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:07.822 INFO:tasks.ceph:pgid 6.1a last_scrub_stamp 2024-06-04T15:52:41.476734+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=41, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:07.822 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-06-04T15:52:37.459483+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=37, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:07.823 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-06-04T15:52:37.459483+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=37, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:07.823 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-06-04T15:52:35.455324+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=35, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:07.823 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-06-04T15:52:37.459483+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=37, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:07.823 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-06-04T15:52:35.455324+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=35, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:07.823 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-06-04T15:52:37.459483+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=37, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:07.823 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-06-04T15:52:35.455324+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=35, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:07.824 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-06-04T15:52:37.459483+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=37, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:07.824 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-06-04T15:52:35.455324+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=35, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:07.824 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-06-04T15:52:37.459483+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=37, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:07.824 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-06-04T15:52:35.455324+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=35, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:07.824 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-06-04T15:52:37.459483+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=37, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:07.824 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-06-04T15:52:35.455324+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=35, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:07.825 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-06-04T15:52:37.459483+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=37, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:07.825 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-06-04T15:52:35.455324+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=35, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:07.825 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-06-04T15:52:35.455324+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=35, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:07.825 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-06-04T15:52:37.459483+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=37, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:07.825 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-06-04T15:52:35.455324+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=35, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:07.825 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-06-04T15:52:37.459483+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=37, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:07.826 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-06-04T15:52:35.455324+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=35, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:07.826 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-06-04T15:52:37.459483+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=37, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:07.826 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-06-04T15:52:35.455324+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=35, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:07.826 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-06-04T15:52:37.459483+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=37, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:07.826 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-06-04T15:52:35.455324+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=35, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:07.826 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-06-04T15:52:37.459483+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=37, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:07.827 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-06-04T15:52:35.455324+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=35, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:07.827 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-06-04T15:52:37.459483+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=37, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:07.827 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-06-04T15:52:35.455324+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=35, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:07.827 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-06-04T15:52:35.455324+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=35, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:07.827 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-06-04T15:52:35.455324+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=35, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:07.827 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-06-04T15:52:37.459483+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=37, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:07.827 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-06-04T16:23:27.829 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-06-04T16:23:28.170 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:23:28.182 INFO:teuthology.orchestra.run.smithi144.stderr:dumped all 2024-06-04T16:23:28.185 INFO:teuthology.orchestra.run.smithi144.stdout:{"pg_ready":true,"pg_map":{"version":1181,"stamp":"2024-06-04T16:23:27.573951+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":120019510,"num_objects":545,"num_object_clones":0,"num_object_copies":1290,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":545,"num_whiteouts":0,"num_read":70048,"num_read_kb":1447594,"num_write":34530,"num_write_kb":1951205,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":99,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":189367,"num_omap_keys":523,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11819,"ondisk_log_size":11819,"up":850,"acting":850,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":850,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1295032,"kb_used_data":225272,"kb_used_omap":12,"kb_used_meta":1069683,"kb_avail":753679688,"statfs":{"total":773094113280,"available":771768000512,"internally_reserved":0,"allocated":230678528,"data_stored":215622914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":1095355953},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":13164,"num_omap_keys":55,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005471"},"pg_stats":[{"pgid":"67.1c","version":"0'0","reported_seq":15,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:21:10.019894+0000","last_change":"2024-06-04T16:16:08.658494+0000","last_active":"2024-06-04T16:21:10.019894+0000","last_peered":"2024-06-04T16:21:10.019894+0000","last_clean":"2024-06-04T16:21:10.019894+0000","last_became_active":"2024-06-04T16:16:08.658205+0000","last_became_peered":"2024-06-04T16:16:08.658205+0000","last_unstale":"2024-06-04T16:21:10.019894+0000","last_undegraded":"2024-06-04T16:21:10.019894+0000","last_fullsized":"2024-06-04T16:21:10.019894+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_clean_scrub_stamp":"2024-06-04T16:16:07.631263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1d","version":"251'2","reported_seq":36,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:06.405019+0000","last_change":"2024-06-04T16:23:06.405045+0000","last_active":"2024-06-04T16:23:06.405019+0000","last_peered":"2024-06-04T16:23:06.405019+0000","last_clean":"2024-06-04T16:23:06.405019+0000","last_became_active":"2024-06-04T16:09:26.627678+0000","last_became_peered":"2024-06-04T16:09:26.627678+0000","last_unstale":"2024-06-04T16:23:06.405019+0000","last_undegraded":"2024-06-04T16:23:06.405019+0000","last_fullsized":"2024-06-04T16:23:06.405019+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"251'2","last_scrub_stamp":"2024-06-04T16:23:06.404918+0000","last_deep_scrub":"251'2","last_deep_scrub_stamp":"2024-06-04T16:23:06.404918+0000","last_clean_scrub_stamp":"2024-06-04T16:23:06.404918+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T17:19:48.169731+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1e","version":"254'2","reported_seq":34,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:39.497204+0000","last_change":"2024-06-04T16:09:23.610282+0000","last_active":"2024-06-04T16:22:39.497204+0000","last_peered":"2024-06-04T16:22:39.497204+0000","last_clean":"2024-06-04T16:22:39.497204+0000","last_became_active":"2024-06-04T16:09:23.610020+0000","last_became_peered":"2024-06-04T16:09:23.610020+0000","last_unstale":"2024-06-04T16:22:39.497204+0000","last_undegraded":"2024-06-04T16:22:39.497204+0000","last_fullsized":"2024-06-04T16:22:39.497204+0000","mapping_epoch":246,"log_start":"0'0","ondisk_log_start":"0'0","created":246,"last_epoch_clean":247,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_clean_scrub_stamp":"2024-06-04T16:09:22.572686+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"64.1f","version":"251'21","reported_seq":103,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:53.425228+0000","last_change":"2024-06-04T16:22:53.425264+0000","last_active":"2024-06-04T16:22:53.425228+0000","last_peered":"2024-06-04T16:22:53.425228+0000","last_clean":"2024-06-04T16:22:53.425228+0000","last_became_active":"2024-06-04T16:07:09.402073+0000","last_became_peered":"2024-06-04T16:07:09.402073+0000","last_unstale":"2024-06-04T16:22:53.425228+0000","last_undegraded":"2024-06-04T16:22:53.425228+0000","last_fullsized":"2024-06-04T16:22:53.425228+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":243,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"251'21","last_scrub_stamp":"2024-06-04T16:22:53.425132+0000","last_deep_scrub":"251'21","last_deep_scrub_stamp":"2024-06-04T16:22:53.425132+0000","last_clean_scrub_stamp":"2024-06-04T16:22:53.425132+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T16:33:19.953015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":108,"num_read_kb":75,"num_write":41,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1d","version":"0'0","reported_seq":15,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:21:10.129832+0000","last_change":"2024-06-04T16:16:08.656686+0000","last_active":"2024-06-04T16:21:10.129832+0000","last_peered":"2024-06-04T16:21:10.129832+0000","last_clean":"2024-06-04T16:21:10.129832+0000","last_became_active":"2024-06-04T16:16:08.656388+0000","last_became_peered":"2024-06-04T16:16:08.656388+0000","last_unstale":"2024-06-04T16:21:10.129832+0000","last_undegraded":"2024-06-04T16:21:10.129832+0000","last_fullsized":"2024-06-04T16:21:10.129832+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_clean_scrub_stamp":"2024-06-04T16:16:07.631263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.1c","version":"254'2","reported_seq":35,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:56.032254+0000","last_change":"2024-06-04T16:22:56.032296+0000","last_active":"2024-06-04T16:22:56.032254+0000","last_peered":"2024-06-04T16:22:56.032254+0000","last_clean":"2024-06-04T16:22:56.032254+0000","last_became_active":"2024-06-04T16:09:26.626964+0000","last_became_peered":"2024-06-04T16:09:26.626964+0000","last_unstale":"2024-06-04T16:22:56.032254+0000","last_undegraded":"2024-06-04T16:22:56.032254+0000","last_fullsized":"2024-06-04T16:22:56.032254+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'2","last_scrub_stamp":"2024-06-04T16:22:56.032145+0000","last_deep_scrub":"254'2","last_deep_scrub_stamp":"2024-06-04T16:22:56.032145+0000","last_clean_scrub_stamp":"2024-06-04T16:22:56.032145+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T17:55:10.954470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1f","version":"254'4","reported_seq":38,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:39.473376+0000","last_change":"2024-06-04T16:09:23.608520+0000","last_active":"2024-06-04T16:22:39.473376+0000","last_peered":"2024-06-04T16:22:39.473376+0000","last_clean":"2024-06-04T16:22:39.473376+0000","last_became_active":"2024-06-04T16:09:23.608251+0000","last_became_peered":"2024-06-04T16:09:23.608251+0000","last_unstale":"2024-06-04T16:22:39.473376+0000","last_undegraded":"2024-06-04T16:22:39.473376+0000","last_fullsized":"2024-06-04T16:22:39.473376+0000","mapping_epoch":246,"log_start":"0'0","ondisk_log_start":"0'0","created":246,"last_epoch_clean":247,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_clean_scrub_stamp":"2024-06-04T16:09:22.572686+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":8192,"num_write":4,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"64.1e","version":"251'15","reported_seq":89,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:59.041515+0000","last_change":"2024-06-04T16:22:59.041515+0000","last_active":"2024-06-04T16:22:59.041515+0000","last_peered":"2024-06-04T16:22:59.041515+0000","last_clean":"2024-06-04T16:22:59.041515+0000","last_became_active":"2024-06-04T16:07:09.511253+0000","last_became_peered":"2024-06-04T16:07:09.511253+0000","last_unstale":"2024-06-04T16:22:59.041515+0000","last_undegraded":"2024-06-04T16:22:59.041515+0000","last_fullsized":"2024-06-04T16:22:59.041515+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":243,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"251'15","last_scrub_stamp":"2024-06-04T16:22:59.041341+0000","last_deep_scrub":"251'15","last_deep_scrub_stamp":"2024-06-04T16:22:59.041341+0000","last_clean_scrub_stamp":"2024-06-04T16:22:59.041341+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T18:09:07.672420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":58,"num_write":26,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1e","version":"0'0","reported_seq":16,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:10.039525+0000","last_change":"2024-06-04T16:16:08.660980+0000","last_active":"2024-06-04T16:22:10.039525+0000","last_peered":"2024-06-04T16:22:10.039525+0000","last_clean":"2024-06-04T16:22:10.039525+0000","last_became_active":"2024-06-04T16:16:08.660635+0000","last_became_peered":"2024-06-04T16:16:08.660635+0000","last_unstale":"2024-06-04T16:22:10.039525+0000","last_undegraded":"2024-06-04T16:22:10.039525+0000","last_fullsized":"2024-06-04T16:22:10.039525+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_clean_scrub_stamp":"2024-06-04T16:16:07.631263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1f","version":"0'0","reported_seq":25,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:00.134790+0000","last_change":"2024-06-04T16:09:26.624893+0000","last_active":"2024-06-04T16:22:00.134790+0000","last_peered":"2024-06-04T16:22:00.134790+0000","last_clean":"2024-06-04T16:22:00.134790+0000","last_became_active":"2024-06-04T16:09:26.624510+0000","last_became_peered":"2024-06-04T16:09:26.624510+0000","last_unstale":"2024-06-04T16:22:00.134790+0000","last_undegraded":"2024-06-04T16:22:00.134790+0000","last_fullsized":"2024-06-04T16:22:00.134790+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_clean_scrub_stamp":"2024-06-04T16:09:25.601105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1c","version":"0'0","reported_seq":38,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:54.138875+0000","last_change":"2024-06-04T16:22:54.138938+0000","last_active":"2024-06-04T16:22:54.138875+0000","last_peered":"2024-06-04T16:22:54.138875+0000","last_clean":"2024-06-04T16:22:54.138875+0000","last_became_active":"2024-06-04T16:09:23.612278+0000","last_became_peered":"2024-06-04T16:09:23.612278+0000","last_unstale":"2024-06-04T16:22:54.138875+0000","last_undegraded":"2024-06-04T16:22:54.138875+0000","last_fullsized":"2024-06-04T16:22:54.138875+0000","mapping_epoch":246,"log_start":"0'0","ondisk_log_start":"0'0","created":246,"last_epoch_clean":247,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:22:54.138763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:22:54.138763+0000","last_clean_scrub_stamp":"2024-06-04T16:22:54.138763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T18:25:29.872798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"64.1d","version":"251'28","reported_seq":123,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:56.120753+0000","last_change":"2024-06-04T16:22:56.120781+0000","last_active":"2024-06-04T16:22:56.120753+0000","last_peered":"2024-06-04T16:22:56.120753+0000","last_clean":"2024-06-04T16:22:56.120753+0000","last_became_active":"2024-06-04T16:07:09.511154+0000","last_became_peered":"2024-06-04T16:07:09.511154+0000","last_unstale":"2024-06-04T16:22:56.120753+0000","last_undegraded":"2024-06-04T16:22:56.120753+0000","last_fullsized":"2024-06-04T16:22:56.120753+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":243,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"251'28","last_scrub_stamp":"2024-06-04T16:22:56.120659+0000","last_deep_scrub":"251'28","last_deep_scrub_stamp":"2024-06-04T16:22:56.120659+0000","last_clean_scrub_stamp":"2024-06-04T16:22:56.120659+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T00:05:26.471359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":150,"num_read_kb":106,"num_write":50,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.1f","version":"0'0","reported_seq":16,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:25.041519+0000","last_change":"2024-06-04T16:16:08.661162+0000","last_active":"2024-06-04T16:22:25.041519+0000","last_peered":"2024-06-04T16:22:25.041519+0000","last_clean":"2024-06-04T16:22:25.041519+0000","last_became_active":"2024-06-04T16:16:08.660669+0000","last_became_peered":"2024-06-04T16:16:08.660669+0000","last_unstale":"2024-06-04T16:22:25.041519+0000","last_undegraded":"2024-06-04T16:22:25.041519+0000","last_fullsized":"2024-06-04T16:22:25.041519+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_clean_scrub_stamp":"2024-06-04T16:16:07.631263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1e","version":"254'2","reported_seq":36,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:47.038109+0000","last_change":"2024-06-04T16:22:47.038152+0000","last_active":"2024-06-04T16:22:47.038109+0000","last_peered":"2024-06-04T16:22:47.038109+0000","last_clean":"2024-06-04T16:22:47.038109+0000","last_became_active":"2024-06-04T16:09:26.621326+0000","last_became_peered":"2024-06-04T16:09:26.621326+0000","last_unstale":"2024-06-04T16:22:47.038109+0000","last_undegraded":"2024-06-04T16:22:47.038109+0000","last_fullsized":"2024-06-04T16:22:47.038109+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'2","last_scrub_stamp":"2024-06-04T16:22:47.037993+0000","last_deep_scrub":"254'2","last_deep_scrub_stamp":"2024-06-04T16:22:47.037993+0000","last_clean_scrub_stamp":"2024-06-04T16:22:47.037993+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T21:14:40.434297+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1d","version":"254'5","reported_seq":46,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:47.213650+0000","last_change":"2024-06-04T16:22:47.213678+0000","last_active":"2024-06-04T16:22:47.213650+0000","last_peered":"2024-06-04T16:22:47.213650+0000","last_clean":"2024-06-04T16:22:47.213650+0000","last_became_active":"2024-06-04T16:09:23.606918+0000","last_became_peered":"2024-06-04T16:09:23.606918+0000","last_unstale":"2024-06-04T16:22:47.213650+0000","last_undegraded":"2024-06-04T16:22:47.213650+0000","last_fullsized":"2024-06-04T16:22:47.213650+0000","mapping_epoch":246,"log_start":"0'0","ondisk_log_start":"0'0","created":246,"last_epoch_clean":247,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'5","last_scrub_stamp":"2024-06-04T16:22:47.213558+0000","last_deep_scrub":"254'5","last_deep_scrub_stamp":"2024-06-04T16:22:47.213558+0000","last_clean_scrub_stamp":"2024-06-04T16:22:47.213558+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T21:54:10.067561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":4144,"num_write":10,"num_write_kb":4144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"64.1c","version":"251'37","reported_seq":151,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:49.285431+0000","last_change":"2024-06-04T16:22:49.285460+0000","last_active":"2024-06-04T16:22:49.285431+0000","last_peered":"2024-06-04T16:22:49.285431+0000","last_clean":"2024-06-04T16:22:49.285431+0000","last_became_active":"2024-06-04T16:07:09.509671+0000","last_became_peered":"2024-06-04T16:07:09.509671+0000","last_unstale":"2024-06-04T16:22:49.285431+0000","last_undegraded":"2024-06-04T16:22:49.285431+0000","last_fullsized":"2024-06-04T16:22:49.285431+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":243,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"251'37","last_scrub_stamp":"2024-06-04T16:22:49.285327+0000","last_deep_scrub":"251'37","last_deep_scrub_stamp":"2024-06-04T16:22:49.285327+0000","last_clean_scrub_stamp":"2024-06-04T16:22:49.285327+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T20:32:45.523245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":197,"num_read_kb":141,"num_write":70,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.18","version":"0'0","reported_seq":16,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:45.077794+0000","last_change":"2024-06-04T16:16:08.664509+0000","last_active":"2024-06-04T16:22:45.077794+0000","last_peered":"2024-06-04T16:22:45.077794+0000","last_clean":"2024-06-04T16:22:45.077794+0000","last_became_active":"2024-06-04T16:16:08.664252+0000","last_became_peered":"2024-06-04T16:16:08.664252+0000","last_unstale":"2024-06-04T16:22:45.077794+0000","last_undegraded":"2024-06-04T16:22:45.077794+0000","last_fullsized":"2024-06-04T16:22:45.077794+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_clean_scrub_stamp":"2024-06-04T16:16:07.631263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.19","version":"254'7","reported_seq":44,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:18.779710+0000","last_change":"2024-06-04T16:23:18.779734+0000","last_active":"2024-06-04T16:23:18.779710+0000","last_peered":"2024-06-04T16:23:18.779710+0000","last_clean":"2024-06-04T16:23:18.779710+0000","last_became_active":"2024-06-04T16:09:26.624681+0000","last_became_peered":"2024-06-04T16:09:26.624681+0000","last_unstale":"2024-06-04T16:23:18.779710+0000","last_undegraded":"2024-06-04T16:23:18.779710+0000","last_fullsized":"2024-06-04T16:23:18.779710+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'7","last_scrub_stamp":"2024-06-04T16:23:18.779618+0000","last_deep_scrub":"254'7","last_deep_scrub_stamp":"2024-06-04T16:23:18.779618+0000","last_clean_scrub_stamp":"2024-06-04T16:23:18.779618+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T00:15:42.722331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":9216,"num_write":12,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1a","version":"251'3","reported_seq":43,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:51.476092+0000","last_change":"2024-06-04T16:22:51.476119+0000","last_active":"2024-06-04T16:22:51.476092+0000","last_peered":"2024-06-04T16:22:51.476092+0000","last_clean":"2024-06-04T16:22:51.476092+0000","last_became_active":"2024-06-04T16:09:23.609102+0000","last_became_peered":"2024-06-04T16:09:23.609102+0000","last_unstale":"2024-06-04T16:22:51.476092+0000","last_undegraded":"2024-06-04T16:22:51.476092+0000","last_fullsized":"2024-06-04T16:22:51.476092+0000","mapping_epoch":246,"log_start":"0'0","ondisk_log_start":"0'0","created":246,"last_epoch_clean":247,"parent":"0.0","parent_split_bits":0,"last_scrub":"251'3","last_scrub_stamp":"2024-06-04T16:22:51.475999+0000","last_deep_scrub":"251'3","last_deep_scrub_stamp":"2024-06-04T16:22:51.475999+0000","last_clean_scrub_stamp":"2024-06-04T16:22:51.475999+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T00:37:04.803162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"64.1b","version":"251'96","reported_seq":342,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:56.001961+0000","last_change":"2024-06-04T16:22:56.001988+0000","last_active":"2024-06-04T16:22:56.001961+0000","last_peered":"2024-06-04T16:22:56.001961+0000","last_clean":"2024-06-04T16:22:56.001961+0000","last_became_active":"2024-06-04T16:07:09.404202+0000","last_became_peered":"2024-06-04T16:07:09.404202+0000","last_unstale":"2024-06-04T16:22:56.001961+0000","last_undegraded":"2024-06-04T16:22:56.001961+0000","last_fullsized":"2024-06-04T16:22:56.001961+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":243,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"251'96","last_scrub_stamp":"2024-06-04T16:22:56.001853+0000","last_deep_scrub":"251'96","last_deep_scrub_stamp":"2024-06-04T16:22:56.001853+0000","last_clean_scrub_stamp":"2024-06-04T16:22:56.001853+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T03:12:58.679536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":591,"num_read_kb":533,"num_write":104,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.19","version":"0'0","reported_seq":24,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:18.878905+0000","last_change":"2024-06-04T16:23:18.878905+0000","last_active":"2024-06-04T16:23:18.878905+0000","last_peered":"2024-06-04T16:23:18.878905+0000","last_clean":"2024-06-04T16:23:18.878905+0000","last_became_active":"2024-06-04T16:16:08.658696+0000","last_became_peered":"2024-06-04T16:16:08.658696+0000","last_unstale":"2024-06-04T16:23:18.878905+0000","last_undegraded":"2024-06-04T16:23:18.878905+0000","last_fullsized":"2024-06-04T16:23:18.878905+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:23:18.878733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:23:18.878733+0000","last_clean_scrub_stamp":"2024-06-04T16:23:18.878733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T17:31:25.559043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.18","version":"254'7","reported_seq":43,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:50.332112+0000","last_change":"2024-06-04T16:22:50.332142+0000","last_active":"2024-06-04T16:22:50.332112+0000","last_peered":"2024-06-04T16:22:50.332112+0000","last_clean":"2024-06-04T16:22:50.332112+0000","last_became_active":"2024-06-04T16:09:26.624322+0000","last_became_peered":"2024-06-04T16:09:26.624322+0000","last_unstale":"2024-06-04T16:22:50.332112+0000","last_undegraded":"2024-06-04T16:22:50.332112+0000","last_fullsized":"2024-06-04T16:22:50.332112+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'7","last_scrub_stamp":"2024-06-04T16:22:50.332010+0000","last_deep_scrub":"254'7","last_deep_scrub_stamp":"2024-06-04T16:22:50.332010+0000","last_clean_scrub_stamp":"2024-06-04T16:22:50.332010+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T03:36:03.301991+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":8192,"num_write":12,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1b","version":"254'15","reported_seq":71,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:22.204972+0000","last_change":"2024-06-04T16:23:22.205010+0000","last_active":"2024-06-04T16:23:22.204972+0000","last_peered":"2024-06-04T16:23:22.204972+0000","last_clean":"2024-06-04T16:23:22.204972+0000","last_became_active":"2024-06-04T16:09:23.613109+0000","last_became_peered":"2024-06-04T16:09:23.613109+0000","last_unstale":"2024-06-04T16:23:22.204972+0000","last_undegraded":"2024-06-04T16:23:22.204972+0000","last_fullsized":"2024-06-04T16:23:22.204972+0000","mapping_epoch":246,"log_start":"0'0","ondisk_log_start":"0'0","created":246,"last_epoch_clean":247,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'15","last_scrub_stamp":"2024-06-04T16:23:22.204872+0000","last_deep_scrub":"254'15","last_deep_scrub_stamp":"2024-06-04T16:23:22.204872+0000","last_clean_scrub_stamp":"2024-06-04T16:23:22.204872+0000","objects_scrubbed":2,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T16:45:38.504686+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":26,"num_read_kb":29700,"num_write":16,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"64.1a","version":"251'15","reported_seq":84,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:52.099476+0000","last_change":"2024-06-04T16:22:52.099503+0000","last_active":"2024-06-04T16:22:52.099476+0000","last_peered":"2024-06-04T16:22:52.099476+0000","last_clean":"2024-06-04T16:22:52.099476+0000","last_became_active":"2024-06-04T16:07:09.406976+0000","last_became_peered":"2024-06-04T16:07:09.406976+0000","last_unstale":"2024-06-04T16:22:52.099476+0000","last_undegraded":"2024-06-04T16:22:52.099476+0000","last_fullsized":"2024-06-04T16:22:52.099476+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":243,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"251'15","last_scrub_stamp":"2024-06-04T16:22:52.099378+0000","last_deep_scrub":"251'15","last_deep_scrub_stamp":"2024-06-04T16:22:52.099378+0000","last_clean_scrub_stamp":"2024-06-04T16:22:52.099378+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T02:39:01.268878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":52,"num_write":29,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.1a","version":"0'0","reported_seq":15,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:21:10.142991+0000","last_change":"2024-06-04T16:16:08.664491+0000","last_active":"2024-06-04T16:21:10.142991+0000","last_peered":"2024-06-04T16:21:10.142991+0000","last_clean":"2024-06-04T16:21:10.142991+0000","last_became_active":"2024-06-04T16:16:08.664200+0000","last_became_peered":"2024-06-04T16:16:08.664200+0000","last_unstale":"2024-06-04T16:21:10.142991+0000","last_undegraded":"2024-06-04T16:21:10.142991+0000","last_fullsized":"2024-06-04T16:21:10.142991+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_clean_scrub_stamp":"2024-06-04T16:16:07.631263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.1b","version":"254'3","reported_seq":29,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:39.555540+0000","last_change":"2024-06-04T16:09:26.626809+0000","last_active":"2024-06-04T16:22:39.555540+0000","last_peered":"2024-06-04T16:22:39.555540+0000","last_clean":"2024-06-04T16:22:39.555540+0000","last_became_active":"2024-06-04T16:09:26.626528+0000","last_became_peered":"2024-06-04T16:09:26.626528+0000","last_unstale":"2024-06-04T16:22:39.555540+0000","last_undegraded":"2024-06-04T16:22:39.555540+0000","last_fullsized":"2024-06-04T16:22:39.555540+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_clean_scrub_stamp":"2024-06-04T16:09:25.601105+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8192,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.18","version":"254'4","reported_seq":45,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:50.225354+0000","last_change":"2024-06-04T16:22:50.225379+0000","last_active":"2024-06-04T16:22:50.225354+0000","last_peered":"2024-06-04T16:22:50.225354+0000","last_clean":"2024-06-04T16:22:50.225354+0000","last_became_active":"2024-06-04T16:09:23.609952+0000","last_became_peered":"2024-06-04T16:09:23.609952+0000","last_unstale":"2024-06-04T16:22:50.225354+0000","last_undegraded":"2024-06-04T16:22:50.225354+0000","last_fullsized":"2024-06-04T16:22:50.225354+0000","mapping_epoch":246,"log_start":"0'0","ondisk_log_start":"0'0","created":246,"last_epoch_clean":247,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'4","last_scrub_stamp":"2024-06-04T16:22:50.225242+0000","last_deep_scrub":"254'4","last_deep_scrub_stamp":"2024-06-04T16:22:50.225242+0000","last_clean_scrub_stamp":"2024-06-04T16:22:50.225242+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T19:11:13.044639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5120,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"64.19","version":"251'22","reported_seq":105,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:52.389508+0000","last_change":"2024-06-04T16:22:52.389536+0000","last_active":"2024-06-04T16:22:52.389508+0000","last_peered":"2024-06-04T16:22:52.389508+0000","last_clean":"2024-06-04T16:22:52.389508+0000","last_became_active":"2024-06-04T16:07:09.402316+0000","last_became_peered":"2024-06-04T16:07:09.402316+0000","last_unstale":"2024-06-04T16:22:52.389508+0000","last_undegraded":"2024-06-04T16:22:52.389508+0000","last_fullsized":"2024-06-04T16:22:52.389508+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":243,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"251'22","last_scrub_stamp":"2024-06-04T16:22:52.389413+0000","last_deep_scrub":"251'22","last_deep_scrub_stamp":"2024-06-04T16:22:52.389413+0000","last_clean_scrub_stamp":"2024-06-04T16:22:52.389413+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T17:48:23.344607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":114,"num_read_kb":79,"num_write":44,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1b","version":"0'0","reported_seq":23,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:24.681665+0000","last_change":"2024-06-04T16:23:24.681708+0000","last_active":"2024-06-04T16:23:24.681665+0000","last_peered":"2024-06-04T16:23:24.681665+0000","last_clean":"2024-06-04T16:23:24.681665+0000","last_became_active":"2024-06-04T16:16:08.653931+0000","last_became_peered":"2024-06-04T16:16:08.653931+0000","last_unstale":"2024-06-04T16:23:24.681665+0000","last_undegraded":"2024-06-04T16:23:24.681665+0000","last_fullsized":"2024-06-04T16:23:24.681665+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:23:24.681563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:23:24.681563+0000","last_clean_scrub_stamp":"2024-06-04T16:23:24.681563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T20:41:20.833917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1a","version":"254'9","reported_seq":50,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:16.876737+0000","last_change":"2024-06-04T16:23:16.876782+0000","last_active":"2024-06-04T16:23:16.876737+0000","last_peered":"2024-06-04T16:23:16.876737+0000","last_clean":"2024-06-04T16:23:16.876737+0000","last_became_active":"2024-06-04T16:09:26.623459+0000","last_became_peered":"2024-06-04T16:09:26.623459+0000","last_unstale":"2024-06-04T16:23:16.876737+0000","last_undegraded":"2024-06-04T16:23:16.876737+0000","last_fullsized":"2024-06-04T16:23:16.876737+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'9","last_scrub_stamp":"2024-06-04T16:23:16.876629+0000","last_deep_scrub":"254'9","last_deep_scrub_stamp":"2024-06-04T16:23:16.876629+0000","last_clean_scrub_stamp":"2024-06-04T16:23:16.876629+0000","objects_scrubbed":1,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T22:16:04.324630+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":9218,"num_write":7,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.19","version":"254'7","reported_seq":52,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:54.037549+0000","last_change":"2024-06-04T16:22:54.037579+0000","last_active":"2024-06-04T16:22:54.037549+0000","last_peered":"2024-06-04T16:22:54.037549+0000","last_clean":"2024-06-04T16:22:54.037549+0000","last_became_active":"2024-06-04T16:09:23.606966+0000","last_became_peered":"2024-06-04T16:09:23.606966+0000","last_unstale":"2024-06-04T16:22:54.037549+0000","last_undegraded":"2024-06-04T16:22:54.037549+0000","last_fullsized":"2024-06-04T16:22:54.037549+0000","mapping_epoch":246,"log_start":"0'0","ondisk_log_start":"0'0","created":246,"last_epoch_clean":247,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'7","last_scrub_stamp":"2024-06-04T16:22:54.037448+0000","last_deep_scrub":"254'7","last_deep_scrub_stamp":"2024-06-04T16:22:54.037448+0000","last_clean_scrub_stamp":"2024-06-04T16:22:54.037448+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T17:00:32.140550+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":11,"num_read_kb":8194,"num_write":5,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"64.18","version":"251'39","reported_seq":153,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:45.120633+0000","last_change":"2024-06-04T16:22:45.120654+0000","last_active":"2024-06-04T16:22:45.120633+0000","last_peered":"2024-06-04T16:22:45.120633+0000","last_clean":"2024-06-04T16:22:45.120633+0000","last_became_active":"2024-06-04T16:07:09.404055+0000","last_became_peered":"2024-06-04T16:07:09.404055+0000","last_unstale":"2024-06-04T16:22:45.120633+0000","last_undegraded":"2024-06-04T16:22:45.120633+0000","last_fullsized":"2024-06-04T16:22:45.120633+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":243,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"251'39","last_scrub_stamp":"2024-06-04T16:22:45.120553+0000","last_deep_scrub":"251'39","last_deep_scrub_stamp":"2024-06-04T16:22:45.120553+0000","last_clean_scrub_stamp":"2024-06-04T16:22:45.120553+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T19:34:39.593186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":206,"num_read_kb":146,"num_write":71,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.14","version":"253'1","reported_seq":17,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:46.024212+0000","last_change":"2024-06-04T16:16:08.662285+0000","last_active":"2024-06-04T16:22:46.024212+0000","last_peered":"2024-06-04T16:22:46.024212+0000","last_clean":"2024-06-04T16:22:46.024212+0000","last_became_active":"2024-06-04T16:16:08.661995+0000","last_became_peered":"2024-06-04T16:16:08.661995+0000","last_unstale":"2024-06-04T16:22:46.024212+0000","last_undegraded":"2024-06-04T16:22:46.024212+0000","last_fullsized":"2024-06-04T16:22:46.024212+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_clean_scrub_stamp":"2024-06-04T16:16:07.631263+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.15","version":"254'5","reported_seq":39,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:15.917343+0000","last_change":"2024-06-04T16:23:15.917369+0000","last_active":"2024-06-04T16:23:15.917343+0000","last_peered":"2024-06-04T16:23:15.917343+0000","last_clean":"2024-06-04T16:23:15.917343+0000","last_became_active":"2024-06-04T16:09:26.623442+0000","last_became_peered":"2024-06-04T16:09:26.623442+0000","last_unstale":"2024-06-04T16:23:15.917343+0000","last_undegraded":"2024-06-04T16:23:15.917343+0000","last_fullsized":"2024-06-04T16:23:15.917343+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'5","last_scrub_stamp":"2024-06-04T16:23:15.917252+0000","last_deep_scrub":"254'5","last_deep_scrub_stamp":"2024-06-04T16:23:15.917252+0000","last_clean_scrub_stamp":"2024-06-04T16:23:15.917252+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T18:10:33.362725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":1406,"num_write":10,"num_write_kb":4799,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.16","version":"251'2","reported_seq":34,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:21:30.033718+0000","last_change":"2024-06-04T16:09:23.609558+0000","last_active":"2024-06-04T16:21:30.033718+0000","last_peered":"2024-06-04T16:21:30.033718+0000","last_clean":"2024-06-04T16:21:30.033718+0000","last_became_active":"2024-06-04T16:09:23.609180+0000","last_became_peered":"2024-06-04T16:09:23.609180+0000","last_unstale":"2024-06-04T16:21:30.033718+0000","last_undegraded":"2024-06-04T16:21:30.033718+0000","last_fullsized":"2024-06-04T16:21:30.033718+0000","mapping_epoch":246,"log_start":"0'0","ondisk_log_start":"0'0","created":246,"last_epoch_clean":247,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_clean_scrub_stamp":"2024-06-04T16:09:22.572686+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":45,"num_write":2,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"64.17","version":"0'0","reported_seq":45,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:51.964414+0000","last_change":"2024-06-04T16:22:51.964441+0000","last_active":"2024-06-04T16:22:51.964414+0000","last_peered":"2024-06-04T16:22:51.964414+0000","last_clean":"2024-06-04T16:22:51.964414+0000","last_became_active":"2024-06-04T16:07:09.511806+0000","last_became_peered":"2024-06-04T16:07:09.511806+0000","last_unstale":"2024-06-04T16:22:51.964414+0000","last_undegraded":"2024-06-04T16:22:51.964414+0000","last_fullsized":"2024-06-04T16:22:51.964414+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":243,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:22:51.964320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:22:51.964320+0000","last_clean_scrub_stamp":"2024-06-04T16:22:51.964320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T17:12:29.022223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.15","version":"0'0","reported_seq":16,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:46.973131+0000","last_change":"2024-06-04T16:16:08.664995+0000","last_active":"2024-06-04T16:22:46.973131+0000","last_peered":"2024-06-04T16:22:46.973131+0000","last_clean":"2024-06-04T16:22:46.973131+0000","last_became_active":"2024-06-04T16:16:08.664680+0000","last_became_peered":"2024-06-04T16:16:08.664680+0000","last_unstale":"2024-06-04T16:22:46.973131+0000","last_undegraded":"2024-06-04T16:22:46.973131+0000","last_fullsized":"2024-06-04T16:22:46.973131+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_clean_scrub_stamp":"2024-06-04T16:16:07.631263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.14","version":"254'3","reported_seq":35,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:14.853006+0000","last_change":"2024-06-04T16:23:14.853043+0000","last_active":"2024-06-04T16:23:14.853006+0000","last_peered":"2024-06-04T16:23:14.853006+0000","last_clean":"2024-06-04T16:23:14.853006+0000","last_became_active":"2024-06-04T16:09:26.623991+0000","last_became_peered":"2024-06-04T16:09:26.623991+0000","last_unstale":"2024-06-04T16:23:14.853006+0000","last_undegraded":"2024-06-04T16:23:14.853006+0000","last_fullsized":"2024-06-04T16:23:14.853006+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'3","last_scrub_stamp":"2024-06-04T16:23:14.852908+0000","last_deep_scrub":"254'3","last_deep_scrub_stamp":"2024-06-04T16:23:14.852908+0000","last_clean_scrub_stamp":"2024-06-04T16:23:14.852908+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T01:38:33.737901+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.17","version":"254'2","reported_seq":33,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:39.539941+0000","last_change":"2024-06-04T16:09:23.595639+0000","last_active":"2024-06-04T16:22:39.539941+0000","last_peered":"2024-06-04T16:22:39.539941+0000","last_clean":"2024-06-04T16:22:39.539941+0000","last_became_active":"2024-06-04T16:09:23.595355+0000","last_became_peered":"2024-06-04T16:09:23.595355+0000","last_unstale":"2024-06-04T16:22:39.539941+0000","last_undegraded":"2024-06-04T16:22:39.539941+0000","last_fullsized":"2024-06-04T16:22:39.539941+0000","mapping_epoch":246,"log_start":"0'0","ondisk_log_start":"0'0","created":246,"last_epoch_clean":247,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_clean_scrub_stamp":"2024-06-04T16:09:22.572686+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"64.16","version":"251'16","reported_seq":89,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:02.010675+0000","last_change":"2024-06-04T16:23:02.010721+0000","last_active":"2024-06-04T16:23:02.010675+0000","last_peered":"2024-06-04T16:23:02.010675+0000","last_clean":"2024-06-04T16:23:02.010675+0000","last_became_active":"2024-06-04T16:07:09.405088+0000","last_became_peered":"2024-06-04T16:07:09.405088+0000","last_unstale":"2024-06-04T16:23:02.010675+0000","last_undegraded":"2024-06-04T16:23:02.010675+0000","last_fullsized":"2024-06-04T16:23:02.010675+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":243,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"251'16","last_scrub_stamp":"2024-06-04T16:23:02.010570+0000","last_deep_scrub":"251'16","last_deep_scrub_stamp":"2024-06-04T16:23:02.010570+0000","last_clean_scrub_stamp":"2024-06-04T16:23:02.010570+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T22:57:25.415865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":63,"num_write":30,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.16","version":"0'0","reported_seq":24,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:17.886115+0000","last_change":"2024-06-04T16:23:17.886115+0000","last_active":"2024-06-04T16:23:17.886115+0000","last_peered":"2024-06-04T16:23:17.886115+0000","last_clean":"2024-06-04T16:23:17.886115+0000","last_became_active":"2024-06-04T16:16:08.655571+0000","last_became_peered":"2024-06-04T16:16:08.655571+0000","last_unstale":"2024-06-04T16:23:17.886115+0000","last_undegraded":"2024-06-04T16:23:17.886115+0000","last_fullsized":"2024-06-04T16:23:17.886115+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:23:17.885998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:23:17.885998+0000","last_clean_scrub_stamp":"2024-06-04T16:23:17.885998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T18:50:59.477929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.17","version":"0'0","reported_seq":32,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:02.458256+0000","last_change":"2024-06-04T16:23:02.458281+0000","last_active":"2024-06-04T16:23:02.458256+0000","last_peered":"2024-06-04T16:23:02.458256+0000","last_clean":"2024-06-04T16:23:02.458256+0000","last_became_active":"2024-06-04T16:09:26.626605+0000","last_became_peered":"2024-06-04T16:09:26.626605+0000","last_unstale":"2024-06-04T16:23:02.458256+0000","last_undegraded":"2024-06-04T16:23:02.458256+0000","last_fullsized":"2024-06-04T16:23:02.458256+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:23:02.458129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:23:02.458129+0000","last_clean_scrub_stamp":"2024-06-04T16:23:02.458129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T19:52:01.192176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.14","version":"254'2","reported_seq":41,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:49.960905+0000","last_change":"2024-06-04T16:22:49.960934+0000","last_active":"2024-06-04T16:22:49.960905+0000","last_peered":"2024-06-04T16:22:49.960905+0000","last_clean":"2024-06-04T16:22:49.960905+0000","last_became_active":"2024-06-04T16:09:23.607906+0000","last_became_peered":"2024-06-04T16:09:23.607906+0000","last_unstale":"2024-06-04T16:22:49.960905+0000","last_undegraded":"2024-06-04T16:22:49.960905+0000","last_fullsized":"2024-06-04T16:22:49.960905+0000","mapping_epoch":246,"log_start":"0'0","ondisk_log_start":"0'0","created":246,"last_epoch_clean":247,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'2","last_scrub_stamp":"2024-06-04T16:22:49.960799+0000","last_deep_scrub":"254'2","last_deep_scrub_stamp":"2024-06-04T16:22:49.960799+0000","last_clean_scrub_stamp":"2024-06-04T16:22:49.960799+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T03:11:47.194479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"64.15","version":"0'0","reported_seq":45,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:55.504294+0000","last_change":"2024-06-04T16:22:55.504318+0000","last_active":"2024-06-04T16:22:55.504294+0000","last_peered":"2024-06-04T16:22:55.504294+0000","last_clean":"2024-06-04T16:22:55.504294+0000","last_became_active":"2024-06-04T16:07:09.401608+0000","last_became_peered":"2024-06-04T16:07:09.401608+0000","last_unstale":"2024-06-04T16:22:55.504294+0000","last_undegraded":"2024-06-04T16:22:55.504294+0000","last_fullsized":"2024-06-04T16:22:55.504294+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":243,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:22:55.504205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:22:55.504205+0000","last_clean_scrub_stamp":"2024-06-04T16:22:55.504205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T16:56:39.431832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.17","version":"0'0","reported_seq":16,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:46.973110+0000","last_change":"2024-06-04T16:16:08.657806+0000","last_active":"2024-06-04T16:22:46.973110+0000","last_peered":"2024-06-04T16:22:46.973110+0000","last_clean":"2024-06-04T16:22:46.973110+0000","last_became_active":"2024-06-04T16:16:08.657535+0000","last_became_peered":"2024-06-04T16:16:08.657535+0000","last_unstale":"2024-06-04T16:22:46.973110+0000","last_undegraded":"2024-06-04T16:22:46.973110+0000","last_fullsized":"2024-06-04T16:22:46.973110+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_clean_scrub_stamp":"2024-06-04T16:16:07.631263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.16","version":"254'13","reported_seq":57,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:00.022118+0000","last_change":"2024-06-04T16:23:00.022163+0000","last_active":"2024-06-04T16:23:00.022118+0000","last_peered":"2024-06-04T16:23:00.022118+0000","last_clean":"2024-06-04T16:23:00.022118+0000","last_became_active":"2024-06-04T16:09:26.628237+0000","last_became_peered":"2024-06-04T16:09:26.628237+0000","last_unstale":"2024-06-04T16:23:00.022118+0000","last_undegraded":"2024-06-04T16:23:00.022118+0000","last_fullsized":"2024-06-04T16:23:00.022118+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'13","last_scrub_stamp":"2024-06-04T16:23:00.022012+0000","last_deep_scrub":"254'13","last_deep_scrub_stamp":"2024-06-04T16:23:00.022012+0000","last_clean_scrub_stamp":"2024-06-04T16:23:00.022012+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T03:53:06.448598+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":19,"num_read_kb":9311,"num_write":11,"num_write_kb":6237,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.15","version":"0'0","reported_seq":38,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:53.025951+0000","last_change":"2024-06-04T16:22:53.025992+0000","last_active":"2024-06-04T16:22:53.025951+0000","last_peered":"2024-06-04T16:22:53.025951+0000","last_clean":"2024-06-04T16:22:53.025951+0000","last_became_active":"2024-06-04T16:09:23.608801+0000","last_became_peered":"2024-06-04T16:09:23.608801+0000","last_unstale":"2024-06-04T16:22:53.025951+0000","last_undegraded":"2024-06-04T16:22:53.025951+0000","last_fullsized":"2024-06-04T16:22:53.025951+0000","mapping_epoch":246,"log_start":"0'0","ondisk_log_start":"0'0","created":246,"last_epoch_clean":247,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:22:53.025834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:22:53.025834+0000","last_clean_scrub_stamp":"2024-06-04T16:22:53.025834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T18:36:02.347621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"64.14","version":"251'30","reported_seq":126,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:48.038079+0000","last_change":"2024-06-04T16:22:48.038108+0000","last_active":"2024-06-04T16:22:48.038079+0000","last_peered":"2024-06-04T16:22:48.038079+0000","last_clean":"2024-06-04T16:22:48.038079+0000","last_became_active":"2024-06-04T16:07:09.403925+0000","last_became_peered":"2024-06-04T16:07:09.403925+0000","last_unstale":"2024-06-04T16:22:48.038079+0000","last_undegraded":"2024-06-04T16:22:48.038079+0000","last_fullsized":"2024-06-04T16:22:48.038079+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":243,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"251'30","last_scrub_stamp":"2024-06-04T16:22:48.037984+0000","last_deep_scrub":"251'30","last_deep_scrub_stamp":"2024-06-04T16:22:48.037984+0000","last_clean_scrub_stamp":"2024-06-04T16:22:48.037984+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T16:58:19.728132+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":154,"num_read_kb":107,"num_write":60,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.10","version":"0'0","reported_seq":16,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:46.024215+0000","last_change":"2024-06-04T16:16:08.656330+0000","last_active":"2024-06-04T16:22:46.024215+0000","last_peered":"2024-06-04T16:22:46.024215+0000","last_clean":"2024-06-04T16:22:46.024215+0000","last_became_active":"2024-06-04T16:16:08.656048+0000","last_became_peered":"2024-06-04T16:16:08.656048+0000","last_unstale":"2024-06-04T16:22:46.024215+0000","last_undegraded":"2024-06-04T16:22:46.024215+0000","last_fullsized":"2024-06-04T16:22:46.024215+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_clean_scrub_stamp":"2024-06-04T16:16:07.631263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.11","version":"254'9","reported_seq":49,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:54.471634+0000","last_change":"2024-06-04T16:22:54.471674+0000","last_active":"2024-06-04T16:22:54.471634+0000","last_peered":"2024-06-04T16:22:54.471634+0000","last_clean":"2024-06-04T16:22:54.471634+0000","last_became_active":"2024-06-04T16:09:26.624122+0000","last_became_peered":"2024-06-04T16:09:26.624122+0000","last_unstale":"2024-06-04T16:22:54.471634+0000","last_undegraded":"2024-06-04T16:22:54.471634+0000","last_fullsized":"2024-06-04T16:22:54.471634+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'9","last_scrub_stamp":"2024-06-04T16:22:54.471546+0000","last_deep_scrub":"254'9","last_deep_scrub_stamp":"2024-06-04T16:22:54.471546+0000","last_clean_scrub_stamp":"2024-06-04T16:22:54.471546+0000","objects_scrubbed":1,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T19:44:26.280196+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":17410,"num_write":17,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.12","version":"254'4","reported_seq":44,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:50.065702+0000","last_change":"2024-06-04T16:22:50.065702+0000","last_active":"2024-06-04T16:22:50.065702+0000","last_peered":"2024-06-04T16:22:50.065702+0000","last_clean":"2024-06-04T16:22:50.065702+0000","last_became_active":"2024-06-04T16:09:23.612699+0000","last_became_peered":"2024-06-04T16:09:23.612699+0000","last_unstale":"2024-06-04T16:22:50.065702+0000","last_undegraded":"2024-06-04T16:22:50.065702+0000","last_fullsized":"2024-06-04T16:22:50.065702+0000","mapping_epoch":246,"log_start":"0'0","ondisk_log_start":"0'0","created":246,"last_epoch_clean":247,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'4","last_scrub_stamp":"2024-06-04T16:22:50.065529+0000","last_deep_scrub":"254'4","last_deep_scrub_stamp":"2024-06-04T16:22:50.065529+0000","last_clean_scrub_stamp":"2024-06-04T16:22:50.065529+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T19:24:18.911703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4,"num_write":4,"num_write_kb":1028,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"64.13","version":"254'35","reported_seq":147,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:00.004256+0000","last_change":"2024-06-04T16:23:00.004308+0000","last_active":"2024-06-04T16:23:00.004256+0000","last_peered":"2024-06-04T16:23:00.004256+0000","last_clean":"2024-06-04T16:23:00.004256+0000","last_became_active":"2024-06-04T16:07:09.511607+0000","last_became_peered":"2024-06-04T16:07:09.511607+0000","last_unstale":"2024-06-04T16:23:00.004256+0000","last_undegraded":"2024-06-04T16:23:00.004256+0000","last_fullsized":"2024-06-04T16:23:00.004256+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":243,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'35","last_scrub_stamp":"2024-06-04T16:23:00.004144+0000","last_deep_scrub":"254'35","last_deep_scrub_stamp":"2024-06-04T16:23:00.004144+0000","last_clean_scrub_stamp":"2024-06-04T16:23:00.004144+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T18:57:09.754963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":198,"num_read_kb":144,"num_write":54,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.11","version":"0'0","reported_seq":24,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:10.366340+0000","last_change":"2024-06-04T16:23:10.366366+0000","last_active":"2024-06-04T16:23:10.366340+0000","last_peered":"2024-06-04T16:23:10.366340+0000","last_clean":"2024-06-04T16:23:10.366340+0000","last_became_active":"2024-06-04T16:16:08.648899+0000","last_became_peered":"2024-06-04T16:16:08.648899+0000","last_unstale":"2024-06-04T16:23:10.366340+0000","last_undegraded":"2024-06-04T16:23:10.366340+0000","last_fullsized":"2024-06-04T16:23:10.366340+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:23:10.366238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:23:10.366238+0000","last_clean_scrub_stamp":"2024-06-04T16:23:10.366238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T03:12:18.946809+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.10","version":"254'2","reported_seq":27,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:39.426038+0000","last_change":"2024-06-04T16:09:26.628742+0000","last_active":"2024-06-04T16:22:39.426038+0000","last_peered":"2024-06-04T16:22:39.426038+0000","last_clean":"2024-06-04T16:22:39.426038+0000","last_became_active":"2024-06-04T16:09:26.628442+0000","last_became_peered":"2024-06-04T16:09:26.628442+0000","last_unstale":"2024-06-04T16:22:39.426038+0000","last_undegraded":"2024-06-04T16:22:39.426038+0000","last_fullsized":"2024-06-04T16:22:39.426038+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_clean_scrub_stamp":"2024-06-04T16:09:25.601105+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.13","version":"254'2","reported_seq":42,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:58.847088+0000","last_change":"2024-06-04T16:22:58.847088+0000","last_active":"2024-06-04T16:22:58.847088+0000","last_peered":"2024-06-04T16:22:58.847088+0000","last_clean":"2024-06-04T16:22:58.847088+0000","last_became_active":"2024-06-04T16:09:23.609536+0000","last_became_peered":"2024-06-04T16:09:23.609536+0000","last_unstale":"2024-06-04T16:22:58.847088+0000","last_undegraded":"2024-06-04T16:22:58.847088+0000","last_fullsized":"2024-06-04T16:22:58.847088+0000","mapping_epoch":246,"log_start":"0'0","ondisk_log_start":"0'0","created":246,"last_epoch_clean":247,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'2","last_scrub_stamp":"2024-06-04T16:22:58.846960+0000","last_deep_scrub":"254'2","last_deep_scrub_stamp":"2024-06-04T16:22:58.846960+0000","last_clean_scrub_stamp":"2024-06-04T16:22:58.846960+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T22:30:42.199456+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"64.12","version":"254'6","reported_seq":63,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:56.874223+0000","last_change":"2024-06-04T16:22:56.874251+0000","last_active":"2024-06-04T16:22:56.874223+0000","last_peered":"2024-06-04T16:22:56.874223+0000","last_clean":"2024-06-04T16:22:56.874223+0000","last_became_active":"2024-06-04T16:07:09.403352+0000","last_became_peered":"2024-06-04T16:07:09.403352+0000","last_unstale":"2024-06-04T16:22:56.874223+0000","last_undegraded":"2024-06-04T16:22:56.874223+0000","last_fullsized":"2024-06-04T16:22:56.874223+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":243,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'6","last_scrub_stamp":"2024-06-04T16:22:56.874133+0000","last_deep_scrub":"254'6","last_deep_scrub_stamp":"2024-06-04T16:22:56.874133+0000","last_clean_scrub_stamp":"2024-06-04T16:22:56.874133+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T01:49:34.273350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":24,"num_write":11,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.12","version":"0'0","reported_seq":16,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:45.077779+0000","last_change":"2024-06-04T16:16:08.654940+0000","last_active":"2024-06-04T16:22:45.077779+0000","last_peered":"2024-06-04T16:22:45.077779+0000","last_clean":"2024-06-04T16:22:45.077779+0000","last_became_active":"2024-06-04T16:16:08.654624+0000","last_became_peered":"2024-06-04T16:16:08.654624+0000","last_unstale":"2024-06-04T16:22:45.077779+0000","last_undegraded":"2024-06-04T16:22:45.077779+0000","last_fullsized":"2024-06-04T16:22:45.077779+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_clean_scrub_stamp":"2024-06-04T16:16:07.631263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.13","version":"254'14","reported_seq":60,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:24.314279+0000","last_change":"2024-06-04T16:23:24.314323+0000","last_active":"2024-06-04T16:23:24.314279+0000","last_peered":"2024-06-04T16:23:24.314279+0000","last_clean":"2024-06-04T16:23:24.314279+0000","last_became_active":"2024-06-04T16:09:26.621494+0000","last_became_peered":"2024-06-04T16:09:26.621494+0000","last_unstale":"2024-06-04T16:23:24.314279+0000","last_undegraded":"2024-06-04T16:23:24.314279+0000","last_fullsized":"2024-06-04T16:23:24.314279+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'14","last_scrub_stamp":"2024-06-04T16:23:24.314185+0000","last_deep_scrub":"254'14","last_deep_scrub_stamp":"2024-06-04T16:23:24.314185+0000","last_clean_scrub_stamp":"2024-06-04T16:23:24.314185+0000","objects_scrubbed":2,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T01:37:37.532445+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":21,"num_read_kb":22532,"num_write":20,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.10","version":"254'8","reported_seq":54,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:57.044720+0000","last_change":"2024-06-04T16:22:57.044720+0000","last_active":"2024-06-04T16:22:57.044720+0000","last_peered":"2024-06-04T16:22:57.044720+0000","last_clean":"2024-06-04T16:22:57.044720+0000","last_became_active":"2024-06-04T16:09:23.606050+0000","last_became_peered":"2024-06-04T16:09:23.606050+0000","last_unstale":"2024-06-04T16:22:57.044720+0000","last_undegraded":"2024-06-04T16:22:57.044720+0000","last_fullsized":"2024-06-04T16:22:57.044720+0000","mapping_epoch":246,"log_start":"0'0","ondisk_log_start":"0'0","created":246,"last_epoch_clean":247,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'8","last_scrub_stamp":"2024-06-04T16:22:57.044585+0000","last_deep_scrub":"254'8","last_deep_scrub_stamp":"2024-06-04T16:22:57.044585+0000","last_clean_scrub_stamp":"2024-06-04T16:22:57.044585+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T20:44:54.184609+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":11,"num_read_kb":20482,"num_write":11,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"64.11","version":"254'139","reported_seq":485,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:53.899095+0000","last_change":"2024-06-04T16:22:53.899126+0000","last_active":"2024-06-04T16:22:53.899095+0000","last_peered":"2024-06-04T16:22:53.899095+0000","last_clean":"2024-06-04T16:22:53.899095+0000","last_became_active":"2024-06-04T16:07:09.511098+0000","last_became_peered":"2024-06-04T16:07:09.511098+0000","last_unstale":"2024-06-04T16:22:53.899095+0000","last_undegraded":"2024-06-04T16:22:53.899095+0000","last_fullsized":"2024-06-04T16:22:53.899095+0000","mapping_epoch":243,"log_start":"251'100","ondisk_log_start":"251'100","created":243,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'139","last_scrub_stamp":"2024-06-04T16:22:53.899006+0000","last_deep_scrub":"254'139","last_deep_scrub_stamp":"2024-06-04T16:22:53.899006+0000","last_clean_scrub_stamp":"2024-06-04T16:22:53.899006+0000","objects_scrubbed":1,"log_size":39,"log_dups_size":100,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T22:35:53.282639+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":871,"num_read_kb":642,"num_write":155,"num_write_kb":133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4455,"num_omap_keys":9,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.13","version":"254'1","reported_seq":17,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:46.973106+0000","last_change":"2024-06-04T16:16:08.657706+0000","last_active":"2024-06-04T16:22:46.973106+0000","last_peered":"2024-06-04T16:22:46.973106+0000","last_clean":"2024-06-04T16:22:46.973106+0000","last_became_active":"2024-06-04T16:16:08.657428+0000","last_became_peered":"2024-06-04T16:16:08.657428+0000","last_unstale":"2024-06-04T16:22:46.973106+0000","last_undegraded":"2024-06-04T16:22:46.973106+0000","last_fullsized":"2024-06-04T16:22:46.973106+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_clean_scrub_stamp":"2024-06-04T16:16:07.631263+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.12","version":"254'6","reported_seq":38,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:39.409568+0000","last_change":"2024-06-04T16:09:26.623554+0000","last_active":"2024-06-04T16:22:39.409568+0000","last_peered":"2024-06-04T16:22:39.409568+0000","last_clean":"2024-06-04T16:22:39.409568+0000","last_became_active":"2024-06-04T16:09:26.623285+0000","last_became_peered":"2024-06-04T16:09:26.623285+0000","last_unstale":"2024-06-04T16:22:39.409568+0000","last_undegraded":"2024-06-04T16:22:39.409568+0000","last_fullsized":"2024-06-04T16:22:39.409568+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_clean_scrub_stamp":"2024-06-04T16:09:25.601105+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":18434,"num_write":5,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.11","version":"254'2","reported_seq":43,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:47.528727+0000","last_change":"2024-06-04T16:22:47.528727+0000","last_active":"2024-06-04T16:22:47.528727+0000","last_peered":"2024-06-04T16:22:47.528727+0000","last_clean":"2024-06-04T16:22:47.528727+0000","last_became_active":"2024-06-04T16:09:23.607048+0000","last_became_peered":"2024-06-04T16:09:23.607048+0000","last_unstale":"2024-06-04T16:22:47.528727+0000","last_undegraded":"2024-06-04T16:22:47.528727+0000","last_fullsized":"2024-06-04T16:22:47.528727+0000","mapping_epoch":246,"log_start":"0'0","ondisk_log_start":"0'0","created":246,"last_epoch_clean":247,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'2","last_scrub_stamp":"2024-06-04T16:22:47.528594+0000","last_deep_scrub":"254'2","last_deep_scrub_stamp":"2024-06-04T16:22:47.528594+0000","last_clean_scrub_stamp":"2024-06-04T16:22:47.528594+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T18:03:35.616854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8192,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"64.10","version":"251'6","reported_seq":63,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:03.054250+0000","last_change":"2024-06-04T16:23:03.054311+0000","last_active":"2024-06-04T16:23:03.054250+0000","last_peered":"2024-06-04T16:23:03.054250+0000","last_clean":"2024-06-04T16:23:03.054250+0000","last_became_active":"2024-06-04T16:07:09.401445+0000","last_became_peered":"2024-06-04T16:07:09.401445+0000","last_unstale":"2024-06-04T16:23:03.054250+0000","last_undegraded":"2024-06-04T16:23:03.054250+0000","last_fullsized":"2024-06-04T16:23:03.054250+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":243,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"251'6","last_scrub_stamp":"2024-06-04T16:23:03.054099+0000","last_deep_scrub":"251'6","last_deep_scrub_stamp":"2024-06-04T16:23:03.054099+0000","last_clean_scrub_stamp":"2024-06-04T16:23:03.054099+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T02:24:52.447333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":24,"num_write":11,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.c","version":"254'1","reported_seq":17,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:46.973045+0000","last_change":"2024-06-04T16:16:08.664755+0000","last_active":"2024-06-04T16:22:46.973045+0000","last_peered":"2024-06-04T16:22:46.973045+0000","last_clean":"2024-06-04T16:22:46.973045+0000","last_became_active":"2024-06-04T16:16:08.664436+0000","last_became_peered":"2024-06-04T16:16:08.664436+0000","last_unstale":"2024-06-04T16:22:46.973045+0000","last_undegraded":"2024-06-04T16:22:46.973045+0000","last_fullsized":"2024-06-04T16:22:46.973045+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_clean_scrub_stamp":"2024-06-04T16:16:07.631263+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.d","version":"251'2","reported_seq":37,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:24.264929+0000","last_change":"2024-06-04T16:23:24.264955+0000","last_active":"2024-06-04T16:23:24.264929+0000","last_peered":"2024-06-04T16:23:24.264929+0000","last_clean":"2024-06-04T16:23:24.264929+0000","last_became_active":"2024-06-04T16:09:26.622747+0000","last_became_peered":"2024-06-04T16:09:26.622747+0000","last_unstale":"2024-06-04T16:23:24.264929+0000","last_undegraded":"2024-06-04T16:23:24.264929+0000","last_fullsized":"2024-06-04T16:23:24.264929+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"251'2","last_scrub_stamp":"2024-06-04T16:23:24.264813+0000","last_deep_scrub":"251'2","last_deep_scrub_stamp":"2024-06-04T16:23:24.264813+0000","last_clean_scrub_stamp":"2024-06-04T16:23:24.264813+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T23:33:06.860827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.e","version":"254'11","reported_seq":58,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:50.975841+0000","last_change":"2024-06-04T16:22:50.975841+0000","last_active":"2024-06-04T16:22:50.975841+0000","last_peered":"2024-06-04T16:22:50.975841+0000","last_clean":"2024-06-04T16:22:50.975841+0000","last_became_active":"2024-06-04T16:09:23.608866+0000","last_became_peered":"2024-06-04T16:09:23.608866+0000","last_unstale":"2024-06-04T16:22:50.975841+0000","last_undegraded":"2024-06-04T16:22:50.975841+0000","last_fullsized":"2024-06-04T16:22:50.975841+0000","mapping_epoch":246,"log_start":"0'0","ondisk_log_start":"0'0","created":246,"last_epoch_clean":247,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'11","last_scrub_stamp":"2024-06-04T16:22:50.975673+0000","last_deep_scrub":"254'11","last_deep_scrub_stamp":"2024-06-04T16:22:50.975673+0000","last_clean_scrub_stamp":"2024-06-04T16:22:50.975673+0000","objects_scrubbed":1,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T01:18:54.016221+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":13,"num_read_kb":5122,"num_write":19,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"64.f","version":"251'6","reported_seq":61,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:47.127684+0000","last_change":"2024-06-04T16:22:47.127684+0000","last_active":"2024-06-04T16:22:47.127684+0000","last_peered":"2024-06-04T16:22:47.127684+0000","last_clean":"2024-06-04T16:22:47.127684+0000","last_became_active":"2024-06-04T16:07:09.400807+0000","last_became_peered":"2024-06-04T16:07:09.400807+0000","last_unstale":"2024-06-04T16:22:47.127684+0000","last_undegraded":"2024-06-04T16:22:47.127684+0000","last_fullsized":"2024-06-04T16:22:47.127684+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":243,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"251'6","last_scrub_stamp":"2024-06-04T16:22:47.127584+0000","last_deep_scrub":"251'6","last_deep_scrub_stamp":"2024-06-04T16:22:47.127584+0000","last_clean_scrub_stamp":"2024-06-04T16:22:47.127584+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T17:42:33.593477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":19,"num_write":12,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.d","version":"0'0","reported_seq":16,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:46.973053+0000","last_change":"2024-06-04T16:16:08.657069+0000","last_active":"2024-06-04T16:22:46.973053+0000","last_peered":"2024-06-04T16:22:46.973053+0000","last_clean":"2024-06-04T16:22:46.973053+0000","last_became_active":"2024-06-04T16:16:08.656726+0000","last_became_peered":"2024-06-04T16:16:08.656726+0000","last_unstale":"2024-06-04T16:22:46.973053+0000","last_undegraded":"2024-06-04T16:22:46.973053+0000","last_fullsized":"2024-06-04T16:22:46.973053+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_clean_scrub_stamp":"2024-06-04T16:16:07.631263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.c","version":"254'3","reported_seq":38,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:23.668556+0000","last_change":"2024-06-04T16:23:23.668597+0000","last_active":"2024-06-04T16:23:23.668556+0000","last_peered":"2024-06-04T16:23:23.668556+0000","last_clean":"2024-06-04T16:23:23.668556+0000","last_became_active":"2024-06-04T16:09:26.627994+0000","last_became_peered":"2024-06-04T16:09:26.627994+0000","last_unstale":"2024-06-04T16:23:23.668556+0000","last_undegraded":"2024-06-04T16:23:23.668556+0000","last_fullsized":"2024-06-04T16:23:23.668556+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'3","last_scrub_stamp":"2024-06-04T16:23:23.668463+0000","last_deep_scrub":"254'3","last_deep_scrub_stamp":"2024-06-04T16:23:23.668463+0000","last_clean_scrub_stamp":"2024-06-04T16:23:23.668463+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T16:35:31.294611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8192,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.f","version":"254'2","reported_seq":43,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:51.055160+0000","last_change":"2024-06-04T16:22:51.055160+0000","last_active":"2024-06-04T16:22:51.055160+0000","last_peered":"2024-06-04T16:22:51.055160+0000","last_clean":"2024-06-04T16:22:51.055160+0000","last_became_active":"2024-06-04T16:09:23.609283+0000","last_became_peered":"2024-06-04T16:09:23.609283+0000","last_unstale":"2024-06-04T16:22:51.055160+0000","last_undegraded":"2024-06-04T16:22:51.055160+0000","last_fullsized":"2024-06-04T16:22:51.055160+0000","mapping_epoch":246,"log_start":"0'0","ondisk_log_start":"0'0","created":246,"last_epoch_clean":247,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'2","last_scrub_stamp":"2024-06-04T16:22:51.055012+0000","last_deep_scrub":"254'2","last_deep_scrub_stamp":"2024-06-04T16:22:51.055012+0000","last_clean_scrub_stamp":"2024-06-04T16:22:51.055012+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T00:43:28.540663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"64.e","version":"254'20","reported_seq":103,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:57.841373+0000","last_change":"2024-06-04T16:22:57.841402+0000","last_active":"2024-06-04T16:22:57.841373+0000","last_peered":"2024-06-04T16:22:57.841373+0000","last_clean":"2024-06-04T16:22:57.841373+0000","last_became_active":"2024-06-04T16:07:09.401515+0000","last_became_peered":"2024-06-04T16:07:09.401515+0000","last_unstale":"2024-06-04T16:22:57.841373+0000","last_undegraded":"2024-06-04T16:22:57.841373+0000","last_fullsized":"2024-06-04T16:22:57.841373+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":243,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'20","last_scrub_stamp":"2024-06-04T16:22:57.841275+0000","last_deep_scrub":"254'20","last_deep_scrub_stamp":"2024-06-04T16:22:57.841275+0000","last_clean_scrub_stamp":"2024-06-04T16:22:57.841275+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T22:23:22.342400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":108,"num_read_kb":75,"num_write":37,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.e","version":"0'0","reported_seq":16,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:46.024183+0000","last_change":"2024-06-04T16:16:08.657545+0000","last_active":"2024-06-04T16:22:46.024183+0000","last_peered":"2024-06-04T16:22:46.024183+0000","last_clean":"2024-06-04T16:22:46.024183+0000","last_became_active":"2024-06-04T16:16:08.657279+0000","last_became_peered":"2024-06-04T16:16:08.657279+0000","last_unstale":"2024-06-04T16:22:46.024183+0000","last_undegraded":"2024-06-04T16:22:46.024183+0000","last_fullsized":"2024-06-04T16:22:46.024183+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_clean_scrub_stamp":"2024-06-04T16:16:07.631263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.f","version":"254'10","reported_seq":54,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:48.017264+0000","last_change":"2024-06-04T16:22:48.017264+0000","last_active":"2024-06-04T16:22:48.017264+0000","last_peered":"2024-06-04T16:22:48.017264+0000","last_clean":"2024-06-04T16:22:48.017264+0000","last_became_active":"2024-06-04T16:09:26.623307+0000","last_became_peered":"2024-06-04T16:09:26.623307+0000","last_unstale":"2024-06-04T16:22:48.017264+0000","last_undegraded":"2024-06-04T16:22:48.017264+0000","last_fullsized":"2024-06-04T16:22:48.017264+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'10","last_scrub_stamp":"2024-06-04T16:22:48.017119+0000","last_deep_scrub":"254'10","last_deep_scrub_stamp":"2024-06-04T16:22:48.017119+0000","last_clean_scrub_stamp":"2024-06-04T16:22:48.017119+0000","objects_scrubbed":1,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T21:31:25.906647+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":8194,"num_write":13,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.c","version":"254'5","reported_seq":46,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:21.207433+0000","last_change":"2024-06-04T16:23:21.207482+0000","last_active":"2024-06-04T16:23:21.207433+0000","last_peered":"2024-06-04T16:23:21.207433+0000","last_clean":"2024-06-04T16:23:21.207433+0000","last_became_active":"2024-06-04T16:09:23.612445+0000","last_became_peered":"2024-06-04T16:09:23.612445+0000","last_unstale":"2024-06-04T16:23:21.207433+0000","last_undegraded":"2024-06-04T16:23:21.207433+0000","last_fullsized":"2024-06-04T16:23:21.207433+0000","mapping_epoch":246,"log_start":"0'0","ondisk_log_start":"0'0","created":246,"last_epoch_clean":247,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'5","last_scrub_stamp":"2024-06-04T16:23:21.207328+0000","last_deep_scrub":"254'5","last_deep_scrub_stamp":"2024-06-04T16:23:21.207328+0000","last_clean_scrub_stamp":"2024-06-04T16:23:21.207328+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T20:25:45.797505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":1024,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"64.d","version":"251'24","reported_seq":115,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:52.929164+0000","last_change":"2024-06-04T16:22:52.929164+0000","last_active":"2024-06-04T16:22:52.929164+0000","last_peered":"2024-06-04T16:22:52.929164+0000","last_clean":"2024-06-04T16:22:52.929164+0000","last_became_active":"2024-06-04T16:07:09.511172+0000","last_became_peered":"2024-06-04T16:07:09.511172+0000","last_unstale":"2024-06-04T16:22:52.929164+0000","last_undegraded":"2024-06-04T16:22:52.929164+0000","last_fullsized":"2024-06-04T16:22:52.929164+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":243,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"251'24","last_scrub_stamp":"2024-06-04T16:22:52.929049+0000","last_deep_scrub":"251'24","last_deep_scrub_stamp":"2024-06-04T16:22:52.929049+0000","last_clean_scrub_stamp":"2024-06-04T16:22:52.929049+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T00:38:16.499504+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":134,"num_read_kb":91,"num_write":39,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.f","version":"0'0","reported_seq":16,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:46.973057+0000","last_change":"2024-06-04T16:16:08.662500+0000","last_active":"2024-06-04T16:22:46.973057+0000","last_peered":"2024-06-04T16:22:46.973057+0000","last_clean":"2024-06-04T16:22:46.973057+0000","last_became_active":"2024-06-04T16:16:08.662182+0000","last_became_peered":"2024-06-04T16:16:08.662182+0000","last_unstale":"2024-06-04T16:22:46.973057+0000","last_undegraded":"2024-06-04T16:22:46.973057+0000","last_fullsized":"2024-06-04T16:22:46.973057+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_clean_scrub_stamp":"2024-06-04T16:16:07.631263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.e","version":"0'0","reported_seq":33,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:04.074619+0000","last_change":"2024-06-04T16:23:04.074644+0000","last_active":"2024-06-04T16:23:04.074619+0000","last_peered":"2024-06-04T16:23:04.074619+0000","last_clean":"2024-06-04T16:23:04.074619+0000","last_became_active":"2024-06-04T16:09:26.629039+0000","last_became_peered":"2024-06-04T16:09:26.629039+0000","last_unstale":"2024-06-04T16:23:04.074619+0000","last_undegraded":"2024-06-04T16:23:04.074619+0000","last_fullsized":"2024-06-04T16:23:04.074619+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:23:04.074530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:23:04.074530+0000","last_clean_scrub_stamp":"2024-06-04T16:23:04.074530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T20:00:22.482411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.d","version":"254'7","reported_seq":52,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:23.350026+0000","last_change":"2024-06-04T16:23:23.350070+0000","last_active":"2024-06-04T16:23:23.350026+0000","last_peered":"2024-06-04T16:23:23.350026+0000","last_clean":"2024-06-04T16:23:23.350026+0000","last_became_active":"2024-06-04T16:09:23.606695+0000","last_became_peered":"2024-06-04T16:09:23.606695+0000","last_unstale":"2024-06-04T16:23:23.350026+0000","last_undegraded":"2024-06-04T16:23:23.350026+0000","last_fullsized":"2024-06-04T16:23:23.350026+0000","mapping_epoch":246,"log_start":"0'0","ondisk_log_start":"0'0","created":246,"last_epoch_clean":247,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'7","last_scrub_stamp":"2024-06-04T16:23:23.349909+0000","last_deep_scrub":"254'7","last_deep_scrub_stamp":"2024-06-04T16:23:23.349909+0000","last_clean_scrub_stamp":"2024-06-04T16:23:23.349909+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T20:58:47.153109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":20480,"num_write":12,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"64.c","version":"251'31","reported_seq":133,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:50.515381+0000","last_change":"2024-06-04T16:22:50.515381+0000","last_active":"2024-06-04T16:22:50.515381+0000","last_peered":"2024-06-04T16:22:50.515381+0000","last_clean":"2024-06-04T16:22:50.515381+0000","last_became_active":"2024-06-04T16:07:09.510728+0000","last_became_peered":"2024-06-04T16:07:09.510728+0000","last_unstale":"2024-06-04T16:22:50.515381+0000","last_undegraded":"2024-06-04T16:22:50.515381+0000","last_fullsized":"2024-06-04T16:22:50.515381+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":243,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"251'31","last_scrub_stamp":"2024-06-04T16:22:50.515259+0000","last_deep_scrub":"251'31","last_deep_scrub_stamp":"2024-06-04T16:22:50.515259+0000","last_clean_scrub_stamp":"2024-06-04T16:22:50.515259+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T22:41:16.625162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":168,"num_read_kb":120,"num_write":55,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.8","version":"0'0","reported_seq":16,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:40.030148+0000","last_change":"2024-06-04T16:16:08.664471+0000","last_active":"2024-06-04T16:22:40.030148+0000","last_peered":"2024-06-04T16:22:40.030148+0000","last_clean":"2024-06-04T16:22:40.030148+0000","last_became_active":"2024-06-04T16:16:08.664198+0000","last_became_peered":"2024-06-04T16:16:08.664198+0000","last_unstale":"2024-06-04T16:22:40.030148+0000","last_undegraded":"2024-06-04T16:22:40.030148+0000","last_fullsized":"2024-06-04T16:22:40.030148+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_clean_scrub_stamp":"2024-06-04T16:16:07.631263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.9","version":"254'6","reported_seq":44,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:58.503564+0000","last_change":"2024-06-04T16:22:58.503590+0000","last_active":"2024-06-04T16:22:58.503564+0000","last_peered":"2024-06-04T16:22:58.503564+0000","last_clean":"2024-06-04T16:22:58.503564+0000","last_became_active":"2024-06-04T16:09:26.625999+0000","last_became_peered":"2024-06-04T16:09:26.625999+0000","last_unstale":"2024-06-04T16:22:58.503564+0000","last_undegraded":"2024-06-04T16:22:58.503564+0000","last_fullsized":"2024-06-04T16:22:58.503564+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'6","last_scrub_stamp":"2024-06-04T16:22:58.503400+0000","last_deep_scrub":"254'6","last_deep_scrub_stamp":"2024-06-04T16:22:58.503400+0000","last_clean_scrub_stamp":"2024-06-04T16:22:58.503400+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T21:34:38.409946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":9216,"num_write":6,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.a","version":"254'3","reported_seq":42,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:49.524226+0000","last_change":"2024-06-04T16:22:49.524282+0000","last_active":"2024-06-04T16:22:49.524226+0000","last_peered":"2024-06-04T16:22:49.524226+0000","last_clean":"2024-06-04T16:22:49.524226+0000","last_became_active":"2024-06-04T16:09:23.600752+0000","last_became_peered":"2024-06-04T16:09:23.600752+0000","last_unstale":"2024-06-04T16:22:49.524226+0000","last_undegraded":"2024-06-04T16:22:49.524226+0000","last_fullsized":"2024-06-04T16:22:49.524226+0000","mapping_epoch":246,"log_start":"0'0","ondisk_log_start":"0'0","created":246,"last_epoch_clean":247,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'3","last_scrub_stamp":"2024-06-04T16:22:49.524121+0000","last_deep_scrub":"254'3","last_deep_scrub_stamp":"2024-06-04T16:22:49.524121+0000","last_clean_scrub_stamp":"2024-06-04T16:22:49.524121+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T19:02:56.815608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"64.b","version":"251'21","reported_seq":106,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:58.017646+0000","last_change":"2024-06-04T16:22:58.017670+0000","last_active":"2024-06-04T16:22:58.017646+0000","last_peered":"2024-06-04T16:22:58.017646+0000","last_clean":"2024-06-04T16:22:58.017646+0000","last_became_active":"2024-06-04T16:07:09.513020+0000","last_became_peered":"2024-06-04T16:07:09.513020+0000","last_unstale":"2024-06-04T16:22:58.017646+0000","last_undegraded":"2024-06-04T16:22:58.017646+0000","last_fullsized":"2024-06-04T16:22:58.017646+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":243,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"251'21","last_scrub_stamp":"2024-06-04T16:22:58.017535+0000","last_deep_scrub":"251'21","last_deep_scrub_stamp":"2024-06-04T16:22:58.017535+0000","last_clean_scrub_stamp":"2024-06-04T16:22:58.017535+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T18:24:46.428109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":114,"num_read_kb":81,"num_write":38,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.9","version":"0'0","reported_seq":16,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:40.034809+0000","last_change":"2024-06-04T16:16:08.658344+0000","last_active":"2024-06-04T16:22:40.034809+0000","last_peered":"2024-06-04T16:22:40.034809+0000","last_clean":"2024-06-04T16:22:40.034809+0000","last_became_active":"2024-06-04T16:16:08.658076+0000","last_became_peered":"2024-06-04T16:16:08.658076+0000","last_unstale":"2024-06-04T16:22:40.034809+0000","last_undegraded":"2024-06-04T16:22:40.034809+0000","last_fullsized":"2024-06-04T16:22:40.034809+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_clean_scrub_stamp":"2024-06-04T16:16:07.631263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.8","version":"254'7","reported_seq":41,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:52.040855+0000","last_change":"2024-06-04T16:22:52.040890+0000","last_active":"2024-06-04T16:22:52.040855+0000","last_peered":"2024-06-04T16:22:52.040855+0000","last_clean":"2024-06-04T16:22:52.040855+0000","last_became_active":"2024-06-04T16:09:26.623966+0000","last_became_peered":"2024-06-04T16:09:26.623966+0000","last_unstale":"2024-06-04T16:22:52.040855+0000","last_undegraded":"2024-06-04T16:22:52.040855+0000","last_fullsized":"2024-06-04T16:22:52.040855+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'7","last_scrub_stamp":"2024-06-04T16:22:52.040732+0000","last_deep_scrub":"254'7","last_deep_scrub_stamp":"2024-06-04T16:22:52.040732+0000","last_clean_scrub_stamp":"2024-06-04T16:22:52.040732+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T00:48:17.796817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4096,"num_write":12,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.b","version":"254'4","reported_seq":45,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:23.232762+0000","last_change":"2024-06-04T16:23:23.232790+0000","last_active":"2024-06-04T16:23:23.232762+0000","last_peered":"2024-06-04T16:23:23.232762+0000","last_clean":"2024-06-04T16:23:23.232762+0000","last_became_active":"2024-06-04T16:09:23.613130+0000","last_became_peered":"2024-06-04T16:09:23.613130+0000","last_unstale":"2024-06-04T16:23:23.232762+0000","last_undegraded":"2024-06-04T16:23:23.232762+0000","last_fullsized":"2024-06-04T16:23:23.232762+0000","mapping_epoch":246,"log_start":"0'0","ondisk_log_start":"0'0","created":246,"last_epoch_clean":247,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'4","last_scrub_stamp":"2024-06-04T16:23:23.232672+0000","last_deep_scrub":"254'4","last_deep_scrub_stamp":"2024-06-04T16:23:23.232672+0000","last_clean_scrub_stamp":"2024-06-04T16:23:23.232672+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T16:29:52.887408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3775,"num_write":4,"num_write_kb":3775,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"64.a","version":"251'22","reported_seq":109,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:51.982618+0000","last_change":"2024-06-04T16:22:51.982647+0000","last_active":"2024-06-04T16:22:51.982618+0000","last_peered":"2024-06-04T16:22:51.982618+0000","last_clean":"2024-06-04T16:22:51.982618+0000","last_became_active":"2024-06-04T16:07:09.403980+0000","last_became_peered":"2024-06-04T16:07:09.403980+0000","last_unstale":"2024-06-04T16:22:51.982618+0000","last_undegraded":"2024-06-04T16:22:51.982618+0000","last_fullsized":"2024-06-04T16:22:51.982618+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":243,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"251'22","last_scrub_stamp":"2024-06-04T16:22:51.982518+0000","last_deep_scrub":"251'22","last_deep_scrub_stamp":"2024-06-04T16:22:51.982518+0000","last_clean_scrub_stamp":"2024-06-04T16:22:51.982518+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T21:31:54.076119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":122,"num_read_kb":87,"num_write":38,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.a","version":"0'0","reported_seq":24,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:20.813915+0000","last_change":"2024-06-04T16:23:20.813953+0000","last_active":"2024-06-04T16:23:20.813915+0000","last_peered":"2024-06-04T16:23:20.813915+0000","last_clean":"2024-06-04T16:23:20.813915+0000","last_became_active":"2024-06-04T16:16:08.661413+0000","last_became_peered":"2024-06-04T16:16:08.661413+0000","last_unstale":"2024-06-04T16:23:20.813915+0000","last_undegraded":"2024-06-04T16:23:20.813915+0000","last_fullsized":"2024-06-04T16:23:20.813915+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:23:20.813795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:23:20.813795+0000","last_clean_scrub_stamp":"2024-06-04T16:23:20.813795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T23:43:11.287682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.b","version":"254'4","reported_seq":41,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:06.858334+0000","last_change":"2024-06-04T16:23:06.858360+0000","last_active":"2024-06-04T16:23:06.858334+0000","last_peered":"2024-06-04T16:23:06.858334+0000","last_clean":"2024-06-04T16:23:06.858334+0000","last_became_active":"2024-06-04T16:09:26.622600+0000","last_became_peered":"2024-06-04T16:09:26.622600+0000","last_unstale":"2024-06-04T16:23:06.858334+0000","last_undegraded":"2024-06-04T16:23:06.858334+0000","last_fullsized":"2024-06-04T16:23:06.858334+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'4","last_scrub_stamp":"2024-06-04T16:23:06.858249+0000","last_deep_scrub":"254'4","last_deep_scrub_stamp":"2024-06-04T16:23:06.858249+0000","last_clean_scrub_stamp":"2024-06-04T16:23:06.858249+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T00:09:08.441861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":1032,"num_write":4,"num_write_kb":1028,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.8","version":"251'2","reported_seq":43,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:14.877485+0000","last_change":"2024-06-04T16:23:14.877514+0000","last_active":"2024-06-04T16:23:14.877485+0000","last_peered":"2024-06-04T16:23:14.877485+0000","last_clean":"2024-06-04T16:23:14.877485+0000","last_became_active":"2024-06-04T16:09:23.610525+0000","last_became_peered":"2024-06-04T16:09:23.610525+0000","last_unstale":"2024-06-04T16:23:14.877485+0000","last_undegraded":"2024-06-04T16:23:14.877485+0000","last_fullsized":"2024-06-04T16:23:14.877485+0000","mapping_epoch":246,"log_start":"0'0","ondisk_log_start":"0'0","created":246,"last_epoch_clean":247,"parent":"0.0","parent_split_bits":0,"last_scrub":"251'2","last_scrub_stamp":"2024-06-04T16:23:14.877393+0000","last_deep_scrub":"251'2","last_deep_scrub_stamp":"2024-06-04T16:23:14.877393+0000","last_clean_scrub_stamp":"2024-06-04T16:23:14.877393+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T20:03:45.551762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"64.9","version":"251'14","reported_seq":88,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:51.381066+0000","last_change":"2024-06-04T16:22:51.381093+0000","last_active":"2024-06-04T16:22:51.381066+0000","last_peered":"2024-06-04T16:22:51.381066+0000","last_clean":"2024-06-04T16:22:51.381066+0000","last_became_active":"2024-06-04T16:07:09.403227+0000","last_became_peered":"2024-06-04T16:07:09.403227+0000","last_unstale":"2024-06-04T16:22:51.381066+0000","last_undegraded":"2024-06-04T16:22:51.381066+0000","last_fullsized":"2024-06-04T16:22:51.381066+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":243,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"251'14","last_scrub_stamp":"2024-06-04T16:22:51.380961+0000","last_deep_scrub":"251'14","last_deep_scrub_stamp":"2024-06-04T16:22:51.380961+0000","last_clean_scrub_stamp":"2024-06-04T16:22:51.380961+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T23:08:22.543065+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":56,"num_write":27,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.b","version":"0'0","reported_seq":16,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:46.497194+0000","last_change":"2024-06-04T16:16:08.660998+0000","last_active":"2024-06-04T16:22:46.497194+0000","last_peered":"2024-06-04T16:22:46.497194+0000","last_clean":"2024-06-04T16:22:46.497194+0000","last_became_active":"2024-06-04T16:16:08.660717+0000","last_became_peered":"2024-06-04T16:16:08.660717+0000","last_unstale":"2024-06-04T16:22:46.497194+0000","last_undegraded":"2024-06-04T16:22:46.497194+0000","last_fullsized":"2024-06-04T16:22:46.497194+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_clean_scrub_stamp":"2024-06-04T16:16:07.631263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.a","version":"254'2","reported_seq":37,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:49.053054+0000","last_change":"2024-06-04T16:22:49.053106+0000","last_active":"2024-06-04T16:22:49.053054+0000","last_peered":"2024-06-04T16:22:49.053054+0000","last_clean":"2024-06-04T16:22:49.053054+0000","last_became_active":"2024-06-04T16:09:26.620119+0000","last_became_peered":"2024-06-04T16:09:26.620119+0000","last_unstale":"2024-06-04T16:22:49.053054+0000","last_undegraded":"2024-06-04T16:22:49.053054+0000","last_fullsized":"2024-06-04T16:22:49.053054+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'2","last_scrub_stamp":"2024-06-04T16:22:49.052943+0000","last_deep_scrub":"254'2","last_deep_scrub_stamp":"2024-06-04T16:22:49.052943+0000","last_clean_scrub_stamp":"2024-06-04T16:22:49.052943+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T04:22:22.929186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8192,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.9","version":"254'6","reported_seq":51,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:46.368834+0000","last_change":"2024-06-04T16:22:46.368878+0000","last_active":"2024-06-04T16:22:46.368834+0000","last_peered":"2024-06-04T16:22:46.368834+0000","last_clean":"2024-06-04T16:22:46.368834+0000","last_became_active":"2024-06-04T16:09:23.607666+0000","last_became_peered":"2024-06-04T16:09:23.607666+0000","last_unstale":"2024-06-04T16:22:46.368834+0000","last_undegraded":"2024-06-04T16:22:46.368834+0000","last_fullsized":"2024-06-04T16:22:46.368834+0000","mapping_epoch":246,"log_start":"0'0","ondisk_log_start":"0'0","created":246,"last_epoch_clean":247,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'6","last_scrub_stamp":"2024-06-04T16:22:46.368741+0000","last_deep_scrub":"254'6","last_deep_scrub_stamp":"2024-06-04T16:22:46.368741+0000","last_clean_scrub_stamp":"2024-06-04T16:22:46.368741+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T17:57:54.874735+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":16386,"num_write":9,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"64.8","version":"251'8","reported_seq":70,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:55.897731+0000","last_change":"2024-06-04T16:22:55.897764+0000","last_active":"2024-06-04T16:22:55.897731+0000","last_peered":"2024-06-04T16:22:55.897731+0000","last_clean":"2024-06-04T16:22:55.897731+0000","last_became_active":"2024-06-04T16:07:09.404928+0000","last_became_peered":"2024-06-04T16:07:09.404928+0000","last_unstale":"2024-06-04T16:22:55.897731+0000","last_undegraded":"2024-06-04T16:22:55.897731+0000","last_fullsized":"2024-06-04T16:22:55.897731+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":243,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"251'8","last_scrub_stamp":"2024-06-04T16:22:55.897619+0000","last_deep_scrub":"251'8","last_deep_scrub_stamp":"2024-06-04T16:22:55.897619+0000","last_clean_scrub_stamp":"2024-06-04T16:22:55.897619+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T16:49:54.112318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":32,"num_write":14,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.4","version":"0'0","reported_seq":16,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:25.041468+0000","last_change":"2024-06-04T16:16:08.663046+0000","last_active":"2024-06-04T16:22:25.041468+0000","last_peered":"2024-06-04T16:22:25.041468+0000","last_clean":"2024-06-04T16:22:25.041468+0000","last_became_active":"2024-06-04T16:16:08.662732+0000","last_became_peered":"2024-06-04T16:16:08.662732+0000","last_unstale":"2024-06-04T16:22:25.041468+0000","last_undegraded":"2024-06-04T16:22:25.041468+0000","last_fullsized":"2024-06-04T16:22:25.041468+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_clean_scrub_stamp":"2024-06-04T16:16:07.631263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.5","version":"254'2","reported_seq":28,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:39.426298+0000","last_change":"2024-06-04T16:09:26.624497+0000","last_active":"2024-06-04T16:22:39.426298+0000","last_peered":"2024-06-04T16:22:39.426298+0000","last_clean":"2024-06-04T16:22:39.426298+0000","last_became_active":"2024-06-04T16:09:26.624142+0000","last_became_peered":"2024-06-04T16:09:26.624142+0000","last_unstale":"2024-06-04T16:22:39.426298+0000","last_undegraded":"2024-06-04T16:22:39.426298+0000","last_fullsized":"2024-06-04T16:22:39.426298+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_clean_scrub_stamp":"2024-06-04T16:09:25.601105+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.6","version":"254'3","reported_seq":44,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:49.001427+0000","last_change":"2024-06-04T16:22:49.001449+0000","last_active":"2024-06-04T16:22:49.001427+0000","last_peered":"2024-06-04T16:22:49.001427+0000","last_clean":"2024-06-04T16:22:49.001427+0000","last_became_active":"2024-06-04T16:09:23.608300+0000","last_became_peered":"2024-06-04T16:09:23.608300+0000","last_unstale":"2024-06-04T16:22:49.001427+0000","last_undegraded":"2024-06-04T16:22:49.001427+0000","last_fullsized":"2024-06-04T16:22:49.001427+0000","mapping_epoch":246,"log_start":"0'0","ondisk_log_start":"0'0","created":246,"last_epoch_clean":247,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'3","last_scrub_stamp":"2024-06-04T16:22:49.001320+0000","last_deep_scrub":"254'3","last_deep_scrub_stamp":"2024-06-04T16:22:49.001320+0000","last_clean_scrub_stamp":"2024-06-04T16:22:49.001320+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T00:45:23.418302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8192,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"64.7","version":"251'16","reported_seq":88,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:48.318184+0000","last_change":"2024-06-04T16:22:48.318225+0000","last_active":"2024-06-04T16:22:48.318184+0000","last_peered":"2024-06-04T16:22:48.318184+0000","last_clean":"2024-06-04T16:22:48.318184+0000","last_became_active":"2024-06-04T16:07:09.511421+0000","last_became_peered":"2024-06-04T16:07:09.511421+0000","last_unstale":"2024-06-04T16:22:48.318184+0000","last_undegraded":"2024-06-04T16:22:48.318184+0000","last_fullsized":"2024-06-04T16:22:48.318184+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":243,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"251'16","last_scrub_stamp":"2024-06-04T16:22:48.318088+0000","last_deep_scrub":"251'16","last_deep_scrub_stamp":"2024-06-04T16:22:48.318088+0000","last_clean_scrub_stamp":"2024-06-04T16:22:48.318088+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T16:27:39.204380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":56,"num_write":28,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.5","version":"0'0","reported_seq":16,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:25.041488+0000","last_change":"2024-06-04T16:16:08.656242+0000","last_active":"2024-06-04T16:22:25.041488+0000","last_peered":"2024-06-04T16:22:25.041488+0000","last_clean":"2024-06-04T16:22:25.041488+0000","last_became_active":"2024-06-04T16:16:08.655913+0000","last_became_peered":"2024-06-04T16:16:08.655913+0000","last_unstale":"2024-06-04T16:22:25.041488+0000","last_undegraded":"2024-06-04T16:22:25.041488+0000","last_fullsized":"2024-06-04T16:22:25.041488+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_clean_scrub_stamp":"2024-06-04T16:16:07.631263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.4","version":"254'2","reported_seq":28,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:39.425172+0000","last_change":"2024-06-04T16:09:26.628240+0000","last_active":"2024-06-04T16:22:39.425172+0000","last_peered":"2024-06-04T16:22:39.425172+0000","last_clean":"2024-06-04T16:22:39.425172+0000","last_became_active":"2024-06-04T16:09:26.627915+0000","last_became_peered":"2024-06-04T16:09:26.627915+0000","last_unstale":"2024-06-04T16:22:39.425172+0000","last_undegraded":"2024-06-04T16:22:39.425172+0000","last_fullsized":"2024-06-04T16:22:39.425172+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_clean_scrub_stamp":"2024-06-04T16:09:25.601105+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.7","version":"251'3","reported_seq":36,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:24.922292+0000","last_change":"2024-06-04T16:09:23.607332+0000","last_active":"2024-06-04T16:22:24.922292+0000","last_peered":"2024-06-04T16:22:24.922292+0000","last_clean":"2024-06-04T16:22:24.922292+0000","last_became_active":"2024-06-04T16:09:23.605516+0000","last_became_peered":"2024-06-04T16:09:23.605516+0000","last_unstale":"2024-06-04T16:22:24.922292+0000","last_undegraded":"2024-06-04T16:22:24.922292+0000","last_fullsized":"2024-06-04T16:22:24.922292+0000","mapping_epoch":246,"log_start":"0'0","ondisk_log_start":"0'0","created":246,"last_epoch_clean":247,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:22.572686+0000","last_clean_scrub_stamp":"2024-06-04T16:09:22.572686+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"64.6","version":"251'12","reported_seq":76,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:43.846902+0000","last_change":"2024-06-04T16:22:43.846928+0000","last_active":"2024-06-04T16:22:43.846902+0000","last_peered":"2024-06-04T16:22:43.846902+0000","last_clean":"2024-06-04T16:22:43.846902+0000","last_became_active":"2024-06-04T16:07:09.397805+0000","last_became_peered":"2024-06-04T16:07:09.397805+0000","last_unstale":"2024-06-04T16:22:43.846902+0000","last_undegraded":"2024-06-04T16:22:43.846902+0000","last_fullsized":"2024-06-04T16:22:43.846902+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":243,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"251'12","last_scrub_stamp":"2024-06-04T16:22:43.846809+0000","last_deep_scrub":"251'12","last_deep_scrub_stamp":"2024-06-04T16:22:43.846809+0000","last_clean_scrub_stamp":"2024-06-04T16:22:43.846809+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T03:24:27.327994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":38,"num_write":27,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.6","version":"253'1","reported_seq":17,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:40.034937+0000","last_change":"2024-06-04T16:16:08.656516+0000","last_active":"2024-06-04T16:22:40.034937+0000","last_peered":"2024-06-04T16:22:40.034937+0000","last_clean":"2024-06-04T16:22:40.034937+0000","last_became_active":"2024-06-04T16:16:08.656182+0000","last_became_peered":"2024-06-04T16:16:08.656182+0000","last_unstale":"2024-06-04T16:22:40.034937+0000","last_undegraded":"2024-06-04T16:22:40.034937+0000","last_fullsized":"2024-06-04T16:22:40.034937+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_clean_scrub_stamp":"2024-06-04T16:16:07.631263+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.7","version":"0'0","reported_seq":25,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:30.033686+0000","last_change":"2024-06-04T16:09:26.626653+0000","last_active":"2024-06-04T16:22:30.033686+0000","last_peered":"2024-06-04T16:22:30.033686+0000","last_clean":"2024-06-04T16:22:30.033686+0000","last_became_active":"2024-06-04T16:09:26.625833+0000","last_became_peered":"2024-06-04T16:09:26.625833+0000","last_unstale":"2024-06-04T16:22:30.033686+0000","last_undegraded":"2024-06-04T16:22:30.033686+0000","last_fullsized":"2024-06-04T16:22:30.033686+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_clean_scrub_stamp":"2024-06-04T16:09:25.601105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.4","version":"0'0","reported_seq":39,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:55.080532+0000","last_change":"2024-06-04T16:22:55.080556+0000","last_active":"2024-06-04T16:22:55.080532+0000","last_peered":"2024-06-04T16:22:55.080532+0000","last_clean":"2024-06-04T16:22:55.080532+0000","last_became_active":"2024-06-04T16:09:23.606669+0000","last_became_peered":"2024-06-04T16:09:23.606669+0000","last_unstale":"2024-06-04T16:22:55.080532+0000","last_undegraded":"2024-06-04T16:22:55.080532+0000","last_fullsized":"2024-06-04T16:22:55.080532+0000","mapping_epoch":246,"log_start":"0'0","ondisk_log_start":"0'0","created":246,"last_epoch_clean":247,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:22:55.080426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:22:55.080426+0000","last_clean_scrub_stamp":"2024-06-04T16:22:55.080426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T04:12:00.220771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"64.5","version":"254'31","reported_seq":136,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:46.146644+0000","last_change":"2024-06-04T16:22:46.146668+0000","last_active":"2024-06-04T16:22:46.146644+0000","last_peered":"2024-06-04T16:22:46.146644+0000","last_clean":"2024-06-04T16:22:46.146644+0000","last_became_active":"2024-06-04T16:07:09.403868+0000","last_became_peered":"2024-06-04T16:07:09.403868+0000","last_unstale":"2024-06-04T16:22:46.146644+0000","last_undegraded":"2024-06-04T16:22:46.146644+0000","last_fullsized":"2024-06-04T16:22:46.146644+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":243,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'31","last_scrub_stamp":"2024-06-04T16:22:46.146551+0000","last_deep_scrub":"254'31","last_deep_scrub_stamp":"2024-06-04T16:22:46.146551+0000","last_clean_scrub_stamp":"2024-06-04T16:22:46.146551+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T03:51:35.087658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":170,"num_read_kb":120,"num_write":66,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.7","version":"0'0","reported_seq":24,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:19.846994+0000","last_change":"2024-06-04T16:23:19.847020+0000","last_active":"2024-06-04T16:23:19.846994+0000","last_peered":"2024-06-04T16:23:19.846994+0000","last_clean":"2024-06-04T16:23:19.846994+0000","last_became_active":"2024-06-04T16:16:08.661379+0000","last_became_peered":"2024-06-04T16:16:08.661379+0000","last_unstale":"2024-06-04T16:23:19.846994+0000","last_undegraded":"2024-06-04T16:23:19.846994+0000","last_fullsized":"2024-06-04T16:23:19.846994+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:23:19.846894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:23:19.846894+0000","last_clean_scrub_stamp":"2024-06-04T16:23:19.846894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T20:31:05.565364+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.6","version":"0'0","reported_seq":33,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:55.526651+0000","last_change":"2024-06-04T16:22:55.526689+0000","last_active":"2024-06-04T16:22:55.526651+0000","last_peered":"2024-06-04T16:22:55.526651+0000","last_clean":"2024-06-04T16:22:55.526651+0000","last_became_active":"2024-06-04T16:09:26.624074+0000","last_became_peered":"2024-06-04T16:09:26.624074+0000","last_unstale":"2024-06-04T16:22:55.526651+0000","last_undegraded":"2024-06-04T16:22:55.526651+0000","last_fullsized":"2024-06-04T16:22:55.526651+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:22:55.526546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:22:55.526546+0000","last_clean_scrub_stamp":"2024-06-04T16:22:55.526546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T03:18:57.714249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.5","version":"254'4","reported_seq":45,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:48.563049+0000","last_change":"2024-06-04T16:22:48.563077+0000","last_active":"2024-06-04T16:22:48.563049+0000","last_peered":"2024-06-04T16:22:48.563049+0000","last_clean":"2024-06-04T16:22:48.563049+0000","last_became_active":"2024-06-04T16:09:23.604255+0000","last_became_peered":"2024-06-04T16:09:23.604255+0000","last_unstale":"2024-06-04T16:22:48.563049+0000","last_undegraded":"2024-06-04T16:22:48.563049+0000","last_fullsized":"2024-06-04T16:22:48.563049+0000","mapping_epoch":246,"log_start":"0'0","ondisk_log_start":"0'0","created":246,"last_epoch_clean":247,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'4","last_scrub_stamp":"2024-06-04T16:22:48.562953+0000","last_deep_scrub":"254'4","last_deep_scrub_stamp":"2024-06-04T16:22:48.562953+0000","last_clean_scrub_stamp":"2024-06-04T16:22:48.562953+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T18:29:37.864894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":4,"num_write_kb":1026,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"64.4","version":"254'14","reported_seq":85,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:44.859762+0000","last_change":"2024-06-04T16:22:44.859785+0000","last_active":"2024-06-04T16:22:44.859762+0000","last_peered":"2024-06-04T16:22:44.859762+0000","last_clean":"2024-06-04T16:22:44.859762+0000","last_became_active":"2024-06-04T16:07:09.396484+0000","last_became_peered":"2024-06-04T16:07:09.396484+0000","last_unstale":"2024-06-04T16:22:44.859762+0000","last_undegraded":"2024-06-04T16:22:44.859762+0000","last_fullsized":"2024-06-04T16:22:44.859762+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":243,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'14","last_scrub_stamp":"2024-06-04T16:22:44.859685+0000","last_deep_scrub":"254'14","last_deep_scrub_stamp":"2024-06-04T16:22:44.859685+0000","last_clean_scrub_stamp":"2024-06-04T16:22:44.859685+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T22:48:04.782391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":52,"num_write":27,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.0","version":"0'0","reported_seq":16,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:10.031288+0000","last_change":"2024-06-04T16:16:08.661272+0000","last_active":"2024-06-04T16:22:10.031288+0000","last_peered":"2024-06-04T16:22:10.031288+0000","last_clean":"2024-06-04T16:22:10.031288+0000","last_became_active":"2024-06-04T16:16:08.660893+0000","last_became_peered":"2024-06-04T16:16:08.660893+0000","last_unstale":"2024-06-04T16:22:10.031288+0000","last_undegraded":"2024-06-04T16:22:10.031288+0000","last_fullsized":"2024-06-04T16:22:10.031288+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_clean_scrub_stamp":"2024-06-04T16:16:07.631263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1","version":"251'2","reported_seq":37,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:10.885930+0000","last_change":"2024-06-04T16:23:10.885979+0000","last_active":"2024-06-04T16:23:10.885930+0000","last_peered":"2024-06-04T16:23:10.885930+0000","last_clean":"2024-06-04T16:23:10.885930+0000","last_became_active":"2024-06-04T16:09:26.623190+0000","last_became_peered":"2024-06-04T16:09:26.623190+0000","last_unstale":"2024-06-04T16:23:10.885930+0000","last_undegraded":"2024-06-04T16:23:10.885930+0000","last_fullsized":"2024-06-04T16:23:10.885930+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"251'2","last_scrub_stamp":"2024-06-04T16:23:10.885822+0000","last_deep_scrub":"251'2","last_deep_scrub_stamp":"2024-06-04T16:23:10.885822+0000","last_clean_scrub_stamp":"2024-06-04T16:23:10.885822+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T00:05:15.167784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.2","version":"254'6","reported_seq":50,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:02.911920+0000","last_change":"2024-06-04T16:23:02.911961+0000","last_active":"2024-06-04T16:23:02.911920+0000","last_peered":"2024-06-04T16:23:02.911920+0000","last_clean":"2024-06-04T16:23:02.911920+0000","last_became_active":"2024-06-04T16:09:23.610479+0000","last_became_peered":"2024-06-04T16:09:23.610479+0000","last_unstale":"2024-06-04T16:23:02.911920+0000","last_undegraded":"2024-06-04T16:23:02.911920+0000","last_fullsized":"2024-06-04T16:23:02.911920+0000","mapping_epoch":246,"log_start":"0'0","ondisk_log_start":"0'0","created":246,"last_epoch_clean":247,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'6","last_scrub_stamp":"2024-06-04T16:23:02.911818+0000","last_deep_scrub":"254'6","last_deep_scrub_stamp":"2024-06-04T16:23:02.911818+0000","last_clean_scrub_stamp":"2024-06-04T16:23:02.911818+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T20:46:50.376469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5120,"num_write":6,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"64.3","version":"251'23","reported_seq":107,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:47.329783+0000","last_change":"2024-06-04T16:22:47.329808+0000","last_active":"2024-06-04T16:22:47.329783+0000","last_peered":"2024-06-04T16:22:47.329783+0000","last_clean":"2024-06-04T16:22:47.329783+0000","last_became_active":"2024-06-04T16:07:09.512996+0000","last_became_peered":"2024-06-04T16:07:09.512996+0000","last_unstale":"2024-06-04T16:22:47.329783+0000","last_undegraded":"2024-06-04T16:22:47.329783+0000","last_fullsized":"2024-06-04T16:22:47.329783+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":243,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"251'23","last_scrub_stamp":"2024-06-04T16:22:47.329687+0000","last_deep_scrub":"251'23","last_deep_scrub_stamp":"2024-06-04T16:22:47.329687+0000","last_clean_scrub_stamp":"2024-06-04T16:22:47.329687+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T16:28:06.079176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":113,"num_read_kb":81,"num_write":51,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1","version":"0'0","reported_seq":16,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:24.922203+0000","last_change":"2024-06-04T16:16:08.660525+0000","last_active":"2024-06-04T16:22:24.922203+0000","last_peered":"2024-06-04T16:22:24.922203+0000","last_clean":"2024-06-04T16:22:24.922203+0000","last_became_active":"2024-06-04T16:16:08.660177+0000","last_became_peered":"2024-06-04T16:16:08.660177+0000","last_unstale":"2024-06-04T16:22:24.922203+0000","last_undegraded":"2024-06-04T16:22:24.922203+0000","last_fullsized":"2024-06-04T16:22:24.922203+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_clean_scrub_stamp":"2024-06-04T16:16:07.631263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.0","version":"254'2","reported_seq":36,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:22.667442+0000","last_change":"2024-06-04T16:23:22.667486+0000","last_active":"2024-06-04T16:23:22.667442+0000","last_peered":"2024-06-04T16:23:22.667442+0000","last_clean":"2024-06-04T16:23:22.667442+0000","last_became_active":"2024-06-04T16:09:26.626576+0000","last_became_peered":"2024-06-04T16:09:26.626576+0000","last_unstale":"2024-06-04T16:23:22.667442+0000","last_undegraded":"2024-06-04T16:23:22.667442+0000","last_fullsized":"2024-06-04T16:23:22.667442+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'2","last_scrub_stamp":"2024-06-04T16:23:22.667335+0000","last_deep_scrub":"254'2","last_deep_scrub_stamp":"2024-06-04T16:23:22.667335+0000","last_clean_scrub_stamp":"2024-06-04T16:23:22.667335+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T18:44:29.644287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.3","version":"254'2","reported_seq":42,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:46.486358+0000","last_change":"2024-06-04T16:22:46.486379+0000","last_active":"2024-06-04T16:22:46.486358+0000","last_peered":"2024-06-04T16:22:46.486358+0000","last_clean":"2024-06-04T16:22:46.486358+0000","last_became_active":"2024-06-04T16:09:23.604413+0000","last_became_peered":"2024-06-04T16:09:23.604413+0000","last_unstale":"2024-06-04T16:22:46.486358+0000","last_undegraded":"2024-06-04T16:22:46.486358+0000","last_fullsized":"2024-06-04T16:22:46.486358+0000","mapping_epoch":246,"log_start":"0'0","ondisk_log_start":"0'0","created":246,"last_epoch_clean":247,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'2","last_scrub_stamp":"2024-06-04T16:22:46.486286+0000","last_deep_scrub":"254'2","last_deep_scrub_stamp":"2024-06-04T16:22:46.486286+0000","last_clean_scrub_stamp":"2024-06-04T16:22:46.486286+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T03:08:45.620913+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"64.2","version":"254'2","reported_seq":52,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:47.896868+0000","last_change":"2024-06-04T16:22:47.896908+0000","last_active":"2024-06-04T16:22:47.896868+0000","last_peered":"2024-06-04T16:22:47.896868+0000","last_clean":"2024-06-04T16:22:47.896868+0000","last_became_active":"2024-06-04T16:07:09.401796+0000","last_became_peered":"2024-06-04T16:07:09.401796+0000","last_unstale":"2024-06-04T16:22:47.896868+0000","last_undegraded":"2024-06-04T16:22:47.896868+0000","last_fullsized":"2024-06-04T16:22:47.896868+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":243,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'2","last_scrub_stamp":"2024-06-04T16:22:47.896756+0000","last_deep_scrub":"254'2","last_deep_scrub_stamp":"2024-06-04T16:22:47.896756+0000","last_clean_scrub_stamp":"2024-06-04T16:22:47.896756+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T03:55:14.174846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":7,"num_write":11,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.2","version":"0'0","reported_seq":16,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:25.028323+0000","last_change":"2024-06-04T16:16:08.656504+0000","last_active":"2024-06-04T16:22:25.028323+0000","last_peered":"2024-06-04T16:22:25.028323+0000","last_clean":"2024-06-04T16:22:25.028323+0000","last_became_active":"2024-06-04T16:16:08.656245+0000","last_became_peered":"2024-06-04T16:16:08.656245+0000","last_unstale":"2024-06-04T16:22:25.028323+0000","last_undegraded":"2024-06-04T16:22:25.028323+0000","last_fullsized":"2024-06-04T16:22:25.028323+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_clean_scrub_stamp":"2024-06-04T16:16:07.631263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.3","version":"254'4","reported_seq":32,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:39.426329+0000","last_change":"2024-06-04T16:09:26.627525+0000","last_active":"2024-06-04T16:22:39.426329+0000","last_peered":"2024-06-04T16:22:39.426329+0000","last_clean":"2024-06-04T16:22:39.426329+0000","last_became_active":"2024-06-04T16:09:26.627193+0000","last_became_peered":"2024-06-04T16:09:26.627193+0000","last_unstale":"2024-06-04T16:22:39.426329+0000","last_undegraded":"2024-06-04T16:22:39.426329+0000","last_fullsized":"2024-06-04T16:22:39.426329+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_clean_scrub_stamp":"2024-06-04T16:09:25.601105+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":6144,"num_write":4,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.0","version":"254'2","reported_seq":43,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:45.465785+0000","last_change":"2024-06-04T16:22:45.465785+0000","last_active":"2024-06-04T16:22:45.465785+0000","last_peered":"2024-06-04T16:22:45.465785+0000","last_clean":"2024-06-04T16:22:45.465785+0000","last_became_active":"2024-06-04T16:09:23.605145+0000","last_became_peered":"2024-06-04T16:09:23.605145+0000","last_unstale":"2024-06-04T16:22:45.465785+0000","last_undegraded":"2024-06-04T16:22:45.465785+0000","last_fullsized":"2024-06-04T16:22:45.465785+0000","mapping_epoch":246,"log_start":"0'0","ondisk_log_start":"0'0","created":246,"last_epoch_clean":247,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'2","last_scrub_stamp":"2024-06-04T16:22:45.465690+0000","last_deep_scrub":"254'2","last_deep_scrub_stamp":"2024-06-04T16:22:45.465690+0000","last_clean_scrub_stamp":"2024-06-04T16:22:45.465690+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T23:45:13.033536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"64.1","version":"245'23","reported_seq":112,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:48.104188+0000","last_change":"2024-06-04T16:22:48.104216+0000","last_active":"2024-06-04T16:22:48.104188+0000","last_peered":"2024-06-04T16:22:48.104188+0000","last_clean":"2024-06-04T16:22:48.104188+0000","last_became_active":"2024-06-04T16:07:09.405086+0000","last_became_peered":"2024-06-04T16:07:09.405086+0000","last_unstale":"2024-06-04T16:22:48.104188+0000","last_undegraded":"2024-06-04T16:22:48.104188+0000","last_fullsized":"2024-06-04T16:22:48.104188+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":243,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"245'23","last_scrub_stamp":"2024-06-04T16:22:48.104090+0000","last_deep_scrub":"245'23","last_deep_scrub_stamp":"2024-06-04T16:22:48.104090+0000","last_clean_scrub_stamp":"2024-06-04T16:22:48.104090+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T22:36:27.428584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":130,"num_read_kb":96,"num_write":31,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.3","version":"0'0","reported_seq":16,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:25.028356+0000","last_change":"2024-06-04T16:16:08.661478+0000","last_active":"2024-06-04T16:22:25.028356+0000","last_peered":"2024-06-04T16:22:25.028356+0000","last_clean":"2024-06-04T16:22:25.028356+0000","last_became_active":"2024-06-04T16:16:08.661111+0000","last_became_peered":"2024-06-04T16:16:08.661111+0000","last_unstale":"2024-06-04T16:22:25.028356+0000","last_undegraded":"2024-06-04T16:22:25.028356+0000","last_fullsized":"2024-06-04T16:22:25.028356+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_clean_scrub_stamp":"2024-06-04T16:16:07.631263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.2","version":"254'2","reported_seq":29,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:39.410018+0000","last_change":"2024-06-04T16:09:26.625154+0000","last_active":"2024-06-04T16:22:39.410018+0000","last_peered":"2024-06-04T16:22:39.410018+0000","last_clean":"2024-06-04T16:22:39.410018+0000","last_became_active":"2024-06-04T16:09:26.624890+0000","last_became_peered":"2024-06-04T16:09:26.624890+0000","last_unstale":"2024-06-04T16:22:39.410018+0000","last_undegraded":"2024-06-04T16:22:39.410018+0000","last_fullsized":"2024-06-04T16:22:39.410018+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_clean_scrub_stamp":"2024-06-04T16:09:25.601105+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8192,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.1","version":"254'11","reported_seq":62,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:54.943147+0000","last_change":"2024-06-04T16:22:54.943177+0000","last_active":"2024-06-04T16:22:54.943147+0000","last_peered":"2024-06-04T16:22:54.943147+0000","last_clean":"2024-06-04T16:22:54.943147+0000","last_became_active":"2024-06-04T16:09:23.609072+0000","last_became_peered":"2024-06-04T16:09:23.609072+0000","last_unstale":"2024-06-04T16:22:54.943147+0000","last_undegraded":"2024-06-04T16:22:54.943147+0000","last_fullsized":"2024-06-04T16:22:54.943147+0000","mapping_epoch":246,"log_start":"0'0","ondisk_log_start":"0'0","created":246,"last_epoch_clean":247,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'11","last_scrub_stamp":"2024-06-04T16:22:54.943049+0000","last_deep_scrub":"254'11","last_deep_scrub_stamp":"2024-06-04T16:22:54.943049+0000","last_clean_scrub_stamp":"2024-06-04T16:22:54.943049+0000","objects_scrubbed":1,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T18:38:55.646525+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":15362,"num_write":9,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"64.0","version":"254'11","reported_seq":77,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:01.039472+0000","last_change":"2024-06-04T16:23:01.039472+0000","last_active":"2024-06-04T16:23:01.039472+0000","last_peered":"2024-06-04T16:23:01.039472+0000","last_clean":"2024-06-04T16:23:01.039472+0000","last_became_active":"2024-06-04T16:07:09.405109+0000","last_became_peered":"2024-06-04T16:07:09.405109+0000","last_unstale":"2024-06-04T16:23:01.039472+0000","last_undegraded":"2024-06-04T16:23:01.039472+0000","last_fullsized":"2024-06-04T16:23:01.039472+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":243,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'11","last_scrub_stamp":"2024-06-04T16:23:01.039356+0000","last_deep_scrub":"254'11","last_deep_scrub_stamp":"2024-06-04T16:23:01.039356+0000","last_clean_scrub_stamp":"2024-06-04T16:23:01.039356+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T20:47:01.766277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":37,"num_write":22,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"251'58","reported_seq":576,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:02.739712+0000","last_change":"2024-06-04T16:23:02.739753+0000","last_active":"2024-06-04T16:23:02.739712+0000","last_peered":"2024-06-04T16:23:02.739712+0000","last_clean":"2024-06-04T16:23:02.739712+0000","last_became_active":"2024-06-04T15:52:36.496345+0000","last_became_peered":"2024-06-04T15:52:36.496345+0000","last_unstale":"2024-06-04T16:23:02.739712+0000","last_undegraded":"2024-06-04T16:23:02.739712+0000","last_fullsized":"2024-06-04T16:23:02.739712+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"251'58","last_scrub_stamp":"2024-06-04T16:23:02.739604+0000","last_deep_scrub":"251'58","last_deep_scrub_stamp":"2024-06-04T16:23:02.739604+0000","last_clean_scrub_stamp":"2024-06-04T16:23:02.739604+0000","objects_scrubbed":2,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T22:51:46.895844+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":73,"num_read_kb":10950,"num_write":187,"num_write_kb":28882,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"254'156","reported_seq":896,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:01.232920+0000","last_change":"2024-06-04T16:23:01.232957+0000","last_active":"2024-06-04T16:23:01.232920+0000","last_peered":"2024-06-04T16:23:01.232920+0000","last_clean":"2024-06-04T16:23:01.232920+0000","last_became_active":"2024-06-04T15:52:38.485491+0000","last_became_peered":"2024-06-04T15:52:38.485491+0000","last_unstale":"2024-06-04T16:23:01.232920+0000","last_undegraded":"2024-06-04T16:23:01.232920+0000","last_fullsized":"2024-06-04T16:23:01.232920+0000","mapping_epoch":23,"log_start":"251'100","ondisk_log_start":"251'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'156","last_scrub_stamp":"2024-06-04T16:23:01.232829+0000","last_deep_scrub":"254'156","last_deep_scrub_stamp":"2024-06-04T16:23:01.232829+0000","last_clean_scrub_stamp":"2024-06-04T16:23:01.232829+0000","objects_scrubbed":1,"log_size":56,"log_dups_size":100,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T00:53:06.796590+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":710,"num_read_kb":632,"num_write":201,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"251'45","reported_seq":566,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:21:50.036815+0000","last_change":"2024-06-04T15:52:36.484644+0000","last_active":"2024-06-04T16:21:50.036815+0000","last_peered":"2024-06-04T16:21:50.036815+0000","last_clean":"2024-06-04T16:21:50.036815+0000","last_became_active":"2024-06-04T15:52:36.484223+0000","last_became_peered":"2024-06-04T15:52:36.484223+0000","last_unstale":"2024-06-04T16:21:50.036815+0000","last_undegraded":"2024-06-04T16:21:50.036815+0000","last_fullsized":"2024-06-04T16:21:50.036815+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1311028,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":90,"num_read_kb":9967,"num_write":210,"num_write_kb":17365,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,0],"acting":[5,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.39","version":"254'108","reported_seq":858,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:40.034837+0000","last_change":"2024-06-04T15:52:38.482297+0000","last_active":"2024-06-04T16:22:40.034837+0000","last_peered":"2024-06-04T16:22:40.034837+0000","last_clean":"2024-06-04T16:22:40.034837+0000","last_became_active":"2024-06-04T15:52:38.482000+0000","last_became_peered":"2024-06-04T15:52:38.482000+0000","last_unstale":"2024-06-04T16:22:40.034837+0000","last_undegraded":"2024-06-04T16:22:40.034837+0000","last_fullsized":"2024-06-04T16:22:40.034837+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":584,"num_read_kb":552,"num_write":123,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"254'42","reported_seq":539,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:21:50.036782+0000","last_change":"2024-06-04T15:52:36.480336+0000","last_active":"2024-06-04T16:21:50.036782+0000","last_peered":"2024-06-04T16:21:50.036782+0000","last_clean":"2024-06-04T16:21:50.036782+0000","last_became_active":"2024-06-04T15:52:36.479881+0000","last_became_peered":"2024-06-04T15:52:36.479881+0000","last_unstale":"2024-06-04T16:21:50.036782+0000","last_undegraded":"2024-06-04T16:21:50.036782+0000","last_fullsized":"2024-06-04T16:21:50.036782+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":40,"num_read_kb":31,"num_write":168,"num_write_kb":16512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3a","version":"254'106","reported_seq":817,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:40.034874+0000","last_change":"2024-06-04T15:52:38.483661+0000","last_active":"2024-06-04T16:22:40.034874+0000","last_peered":"2024-06-04T16:22:40.034874+0000","last_clean":"2024-06-04T16:22:40.034874+0000","last_became_active":"2024-06-04T15:52:38.483240+0000","last_became_peered":"2024-06-04T15:52:38.483240+0000","last_unstale":"2024-06-04T16:22:40.034874+0000","last_undegraded":"2024-06-04T16:22:40.034874+0000","last_fullsized":"2024-06-04T16:22:40.034874+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":515,"num_read_kb":482,"num_write":131,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"254'78","reported_seq":590,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:15.616829+0000","last_change":"2024-06-04T16:23:15.616915+0000","last_active":"2024-06-04T16:23:15.616829+0000","last_peered":"2024-06-04T16:23:15.616829+0000","last_clean":"2024-06-04T16:23:15.616829+0000","last_became_active":"2024-06-04T15:52:36.476981+0000","last_became_peered":"2024-06-04T15:52:36.476981+0000","last_unstale":"2024-06-04T16:23:15.616829+0000","last_undegraded":"2024-06-04T16:23:15.616829+0000","last_fullsized":"2024-06-04T16:23:15.616829+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'78","last_scrub_stamp":"2024-06-04T16:23:15.616718+0000","last_deep_scrub":"254'78","last_deep_scrub_stamp":"2024-06-04T16:23:15.616718+0000","last_clean_scrub_stamp":"2024-06-04T16:23:15.616718+0000","objects_scrubbed":2,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T20:13:50.024747+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":3145,"num_write":255,"num_write_kb":33835,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"254'149","reported_seq":1045,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:14.936095+0000","last_change":"2024-06-04T16:23:14.936140+0000","last_active":"2024-06-04T16:23:14.936095+0000","last_peered":"2024-06-04T16:23:14.936095+0000","last_clean":"2024-06-04T16:23:14.936095+0000","last_became_active":"2024-06-04T15:52:38.480986+0000","last_became_peered":"2024-06-04T15:52:38.480986+0000","last_unstale":"2024-06-04T16:23:14.936095+0000","last_undegraded":"2024-06-04T16:23:14.936095+0000","last_fullsized":"2024-06-04T16:23:14.936095+0000","mapping_epoch":23,"log_start":"251'100","ondisk_log_start":"251'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'149","last_scrub_stamp":"2024-06-04T16:23:14.935987+0000","last_deep_scrub":"254'149","last_deep_scrub_stamp":"2024-06-04T16:23:14.935987+0000","last_clean_scrub_stamp":"2024-06-04T16:23:14.935987+0000","objects_scrubbed":1,"log_size":49,"log_dups_size":100,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T23:09:16.826992+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1072,"num_read_kb":1014,"num_write":195,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2193,"num_omap_keys":9,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"251'46","reported_seq":565,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:12.848585+0000","last_change":"2024-06-04T16:23:12.848636+0000","last_active":"2024-06-04T16:23:12.848585+0000","last_peered":"2024-06-04T16:23:12.848585+0000","last_clean":"2024-06-04T16:23:12.848585+0000","last_became_active":"2024-06-04T15:52:36.495401+0000","last_became_peered":"2024-06-04T15:52:36.495401+0000","last_unstale":"2024-06-04T16:23:12.848585+0000","last_undegraded":"2024-06-04T16:23:12.848585+0000","last_fullsized":"2024-06-04T16:23:12.848585+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"251'46","last_scrub_stamp":"2024-06-04T16:23:12.848406+0000","last_deep_scrub":"251'46","last_deep_scrub_stamp":"2024-06-04T16:23:12.848406+0000","last_clean_scrub_stamp":"2024-06-04T16:23:12.848406+0000","objects_scrubbed":2,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T19:11:57.083518+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":89,"num_read_kb":6218,"num_write":199,"num_write_kb":11815,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"254'159","reported_seq":1096,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:58.807663+0000","last_change":"2024-06-04T16:22:58.807693+0000","last_active":"2024-06-04T16:22:58.807663+0000","last_peered":"2024-06-04T16:22:58.807663+0000","last_clean":"2024-06-04T16:22:58.807663+0000","last_became_active":"2024-06-04T15:52:38.484828+0000","last_became_peered":"2024-06-04T15:52:38.484828+0000","last_unstale":"2024-06-04T16:22:58.807663+0000","last_undegraded":"2024-06-04T16:22:58.807663+0000","last_fullsized":"2024-06-04T16:22:58.807663+0000","mapping_epoch":23,"log_start":"251'100","ondisk_log_start":"251'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'159","last_scrub_stamp":"2024-06-04T16:22:58.807558+0000","last_deep_scrub":"254'159","last_deep_scrub_stamp":"2024-06-04T16:22:58.807558+0000","last_clean_scrub_stamp":"2024-06-04T16:22:58.807558+0000","objects_scrubbed":2,"log_size":59,"log_dups_size":100,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T21:15:10.613499+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1071,"num_read_kb":1008,"num_write":198,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2864,"num_omap_keys":12,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"254'61","reported_seq":579,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:14.577814+0000","last_change":"2024-06-04T16:23:14.577857+0000","last_active":"2024-06-04T16:23:14.577814+0000","last_peered":"2024-06-04T16:23:14.577814+0000","last_clean":"2024-06-04T16:23:14.577814+0000","last_became_active":"2024-06-04T15:52:36.476167+0000","last_became_peered":"2024-06-04T15:52:36.476167+0000","last_unstale":"2024-06-04T16:23:14.577814+0000","last_undegraded":"2024-06-04T16:23:14.577814+0000","last_fullsized":"2024-06-04T16:23:14.577814+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'61","last_scrub_stamp":"2024-06-04T16:23:14.577722+0000","last_deep_scrub":"254'61","last_deep_scrub_stamp":"2024-06-04T16:23:14.577722+0000","last_clean_scrub_stamp":"2024-06-04T16:23:14.577722+0000","objects_scrubbed":1,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T00:44:08.552179+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":87,"num_read_kb":1095,"num_write":236,"num_write_kb":40818,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,7],"acting":[2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"254'99","reported_seq":820,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:00.757093+0000","last_change":"2024-06-04T16:23:00.757161+0000","last_active":"2024-06-04T16:23:00.757093+0000","last_peered":"2024-06-04T16:23:00.757093+0000","last_clean":"2024-06-04T16:23:00.757093+0000","last_became_active":"2024-06-04T15:52:38.482025+0000","last_became_peered":"2024-06-04T15:52:38.482025+0000","last_unstale":"2024-06-04T16:23:00.757093+0000","last_undegraded":"2024-06-04T16:23:00.757093+0000","last_fullsized":"2024-06-04T16:23:00.757093+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'99","last_scrub_stamp":"2024-06-04T16:23:00.756985+0000","last_deep_scrub":"254'99","last_deep_scrub_stamp":"2024-06-04T16:23:00.756985+0000","last_clean_scrub_stamp":"2024-06-04T16:23:00.756985+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T03:26:31.902180+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":511,"num_read_kb":478,"num_write":121,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.39","version":"251'54","reported_seq":558,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:09.793735+0000","last_change":"2024-06-04T16:23:09.793778+0000","last_active":"2024-06-04T16:23:09.793735+0000","last_peered":"2024-06-04T16:23:09.793735+0000","last_clean":"2024-06-04T16:23:09.793735+0000","last_became_active":"2024-06-04T15:52:36.493029+0000","last_became_peered":"2024-06-04T15:52:36.493029+0000","last_unstale":"2024-06-04T16:23:09.793735+0000","last_undegraded":"2024-06-04T16:23:09.793735+0000","last_fullsized":"2024-06-04T16:23:09.793735+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"251'54","last_scrub_stamp":"2024-06-04T16:23:09.793630+0000","last_deep_scrub":"251'54","last_deep_scrub_stamp":"2024-06-04T16:23:09.793630+0000","last_clean_scrub_stamp":"2024-06-04T16:23:09.793630+0000","objects_scrubbed":4,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T22:45:15.488703+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194343,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":48,"num_read_kb":7228,"num_write":201,"num_write_kb":32271,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,1],"acting":[0,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"254'138","reported_seq":1109,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:04.451889+0000","last_change":"2024-06-04T16:23:04.451925+0000","last_active":"2024-06-04T16:23:04.451889+0000","last_peered":"2024-06-04T16:23:04.451889+0000","last_clean":"2024-06-04T16:23:04.451889+0000","last_became_active":"2024-06-04T15:52:38.481269+0000","last_became_peered":"2024-06-04T15:52:38.481269+0000","last_unstale":"2024-06-04T16:23:04.451889+0000","last_undegraded":"2024-06-04T16:23:04.451889+0000","last_fullsized":"2024-06-04T16:23:04.451889+0000","mapping_epoch":23,"log_start":"251'100","ondisk_log_start":"251'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'138","last_scrub_stamp":"2024-06-04T16:23:04.451799+0000","last_deep_scrub":"254'138","last_deep_scrub_stamp":"2024-06-04T16:23:04.451799+0000","last_clean_scrub_stamp":"2024-06-04T16:23:04.451799+0000","objects_scrubbed":3,"log_size":38,"log_dups_size":100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T18:57:32.595376+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":974,"num_read_kb":946,"num_write":155,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1528,"num_omap_keys":6,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"254'71","reported_seq":659,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:40.043457+0000","last_change":"2024-06-04T15:52:36.494149+0000","last_active":"2024-06-04T16:22:40.043457+0000","last_peered":"2024-06-04T16:22:40.043457+0000","last_clean":"2024-06-04T16:22:40.043457+0000","last_became_active":"2024-06-04T15:52:36.493867+0000","last_became_peered":"2024-06-04T15:52:36.493867+0000","last_unstale":"2024-06-04T16:22:40.043457+0000","last_undegraded":"2024-06-04T16:22:40.043457+0000","last_fullsized":"2024-06-04T16:22:40.043457+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194320,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":320,"num_read_kb":135435,"num_write":258,"num_write_kb":39309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3],"acting":[5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3f","version":"254'143","reported_seq":990,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:13.353929+0000","last_change":"2024-06-04T16:23:13.353958+0000","last_active":"2024-06-04T16:23:13.353929+0000","last_peered":"2024-06-04T16:23:13.353929+0000","last_clean":"2024-06-04T16:23:13.353929+0000","last_became_active":"2024-06-04T15:52:38.486625+0000","last_became_peered":"2024-06-04T15:52:38.486625+0000","last_unstale":"2024-06-04T16:23:13.353929+0000","last_undegraded":"2024-06-04T16:23:13.353929+0000","last_fullsized":"2024-06-04T16:23:13.353929+0000","mapping_epoch":23,"log_start":"251'100","ondisk_log_start":"251'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'143","last_scrub_stamp":"2024-06-04T16:23:13.353829+0000","last_deep_scrub":"254'143","last_deep_scrub_stamp":"2024-06-04T16:23:13.353829+0000","last_clean_scrub_stamp":"2024-06-04T16:23:13.353829+0000","objects_scrubbed":1,"log_size":43,"log_dups_size":100,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T03:22:03.182465+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":899,"num_read_kb":839,"num_write":184,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2808,"num_omap_keys":11,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.30","version":"254'111","reported_seq":847,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:22.743898+0000","last_change":"2024-06-04T16:23:22.743953+0000","last_active":"2024-06-04T16:23:22.743898+0000","last_peered":"2024-06-04T16:23:22.743898+0000","last_clean":"2024-06-04T16:23:22.743898+0000","last_became_active":"2024-06-04T15:52:38.479148+0000","last_became_peered":"2024-06-04T15:52:38.479148+0000","last_unstale":"2024-06-04T16:23:22.743898+0000","last_undegraded":"2024-06-04T16:23:22.743898+0000","last_fullsized":"2024-06-04T16:23:22.743898+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'111","last_scrub_stamp":"2024-06-04T16:23:22.743793+0000","last_deep_scrub":"254'111","last_deep_scrub_stamp":"2024-06-04T16:23:22.743793+0000","last_clean_scrub_stamp":"2024-06-04T16:23:22.743793+0000","objects_scrubbed":1,"log_size":111,"log_dups_size":0,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T18:14:39.906512+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":546,"num_read_kb":515,"num_write":127,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"251'65","reported_seq":598,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:19.373198+0000","last_change":"2024-06-04T16:23:19.373244+0000","last_active":"2024-06-04T16:23:19.373198+0000","last_peered":"2024-06-04T16:23:19.373198+0000","last_clean":"2024-06-04T16:23:19.373198+0000","last_became_active":"2024-06-04T15:52:36.493062+0000","last_became_peered":"2024-06-04T15:52:36.493062+0000","last_unstale":"2024-06-04T16:23:19.373198+0000","last_undegraded":"2024-06-04T16:23:19.373198+0000","last_fullsized":"2024-06-04T16:23:19.373198+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"251'65","last_scrub_stamp":"2024-06-04T16:23:19.373074+0000","last_deep_scrub":"251'65","last_deep_scrub_stamp":"2024-06-04T16:23:19.373074+0000","last_clean_scrub_stamp":"2024-06-04T16:23:19.373074+0000","objects_scrubbed":4,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T22:16:45.027828+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194345,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":95,"num_read_kb":64250,"num_write":262,"num_write_kb":45332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,5],"acting":[1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"254'69","reported_seq":746,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:56.821291+0000","last_change":"2024-06-04T16:22:56.821291+0000","last_active":"2024-06-04T16:22:56.821291+0000","last_peered":"2024-06-04T16:22:56.821291+0000","last_clean":"2024-06-04T16:22:56.821291+0000","last_became_active":"2024-06-04T15:52:38.486413+0000","last_became_peered":"2024-06-04T15:52:38.486413+0000","last_unstale":"2024-06-04T16:22:56.821291+0000","last_undegraded":"2024-06-04T16:22:56.821291+0000","last_fullsized":"2024-06-04T16:22:56.821291+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'69","last_scrub_stamp":"2024-06-04T16:22:56.821156+0000","last_deep_scrub":"254'69","last_deep_scrub_stamp":"2024-06-04T16:22:56.821156+0000","last_clean_scrub_stamp":"2024-06-04T16:22:56.821156+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T21:44:44.801551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":395,"num_read_kb":379,"num_write":76,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"251'60","reported_seq":579,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:10.807907+0000","last_change":"2024-06-04T16:23:10.807946+0000","last_active":"2024-06-04T16:23:10.807907+0000","last_peered":"2024-06-04T16:23:10.807907+0000","last_clean":"2024-06-04T16:23:10.807907+0000","last_became_active":"2024-06-04T15:52:36.493235+0000","last_became_peered":"2024-06-04T15:52:36.493235+0000","last_unstale":"2024-06-04T16:23:10.807907+0000","last_undegraded":"2024-06-04T16:23:10.807907+0000","last_fullsized":"2024-06-04T16:23:10.807907+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"251'60","last_scrub_stamp":"2024-06-04T16:23:10.807783+0000","last_deep_scrub":"251'60","last_deep_scrub_stamp":"2024-06-04T16:23:10.807783+0000","last_clean_scrub_stamp":"2024-06-04T16:23:10.807783+0000","objects_scrubbed":3,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T17:09:52.431755+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5327983,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":73,"num_read_kb":3706,"num_write":207,"num_write_kb":43313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"254'95","reported_seq":819,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:05.258148+0000","last_change":"2024-06-04T16:23:05.258177+0000","last_active":"2024-06-04T16:23:05.258148+0000","last_peered":"2024-06-04T16:23:05.258148+0000","last_clean":"2024-06-04T16:23:05.258148+0000","last_became_active":"2024-06-04T15:52:38.482120+0000","last_became_peered":"2024-06-04T15:52:38.482120+0000","last_unstale":"2024-06-04T16:23:05.258148+0000","last_undegraded":"2024-06-04T16:23:05.258148+0000","last_fullsized":"2024-06-04T16:23:05.258148+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'95","last_scrub_stamp":"2024-06-04T16:23:05.258056+0000","last_deep_scrub":"254'95","last_deep_scrub_stamp":"2024-06-04T16:23:05.258056+0000","last_clean_scrub_stamp":"2024-06-04T16:23:05.258056+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T02:14:44.631445+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":518,"num_read_kb":488,"num_write":107,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"251'41","reported_seq":565,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:45.894526+0000","last_change":"2024-06-04T16:22:45.894598+0000","last_active":"2024-06-04T16:22:45.894526+0000","last_peered":"2024-06-04T16:22:45.894526+0000","last_clean":"2024-06-04T16:22:45.894526+0000","last_became_active":"2024-06-04T15:53:14.839433+0000","last_became_peered":"2024-06-04T15:53:14.839433+0000","last_unstale":"2024-06-04T16:22:45.894526+0000","last_undegraded":"2024-06-04T16:22:45.894526+0000","last_fullsized":"2024-06-04T16:22:45.894526+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"251'41","last_scrub_stamp":"2024-06-04T16:22:45.894408+0000","last_deep_scrub":"251'41","last_deep_scrub_stamp":"2024-06-04T16:22:45.894408+0000","last_clean_scrub_stamp":"2024-06-04T16:22:45.894408+0000","objects_scrubbed":4,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T17:54:53.919284+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3420297,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":73,"num_read_kb":2132,"num_write":160,"num_write_kb":20015,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"254'145","reported_seq":942,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:09.033890+0000","last_change":"2024-06-04T16:23:09.033925+0000","last_active":"2024-06-04T16:23:09.033890+0000","last_peered":"2024-06-04T16:23:09.033890+0000","last_clean":"2024-06-04T16:23:09.033890+0000","last_became_active":"2024-06-04T15:52:38.480996+0000","last_became_peered":"2024-06-04T15:52:38.480996+0000","last_unstale":"2024-06-04T16:23:09.033890+0000","last_undegraded":"2024-06-04T16:23:09.033890+0000","last_fullsized":"2024-06-04T16:23:09.033890+0000","mapping_epoch":23,"log_start":"251'100","ondisk_log_start":"251'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'145","last_scrub_stamp":"2024-06-04T16:23:09.033779+0000","last_deep_scrub":"254'145","last_deep_scrub_stamp":"2024-06-04T16:23:09.033779+0000","last_clean_scrub_stamp":"2024-06-04T16:23:09.033779+0000","objects_scrubbed":2,"log_size":45,"log_dups_size":100,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T17:43:39.336852+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":760,"num_read_kb":703,"num_write":184,"num_write_kb":47,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"251'68","reported_seq":587,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:06.831890+0000","last_change":"2024-06-04T16:23:06.831959+0000","last_active":"2024-06-04T16:23:06.831890+0000","last_peered":"2024-06-04T16:23:06.831890+0000","last_clean":"2024-06-04T16:23:06.831890+0000","last_became_active":"2024-06-04T15:52:36.486264+0000","last_became_peered":"2024-06-04T15:52:36.486264+0000","last_unstale":"2024-06-04T16:23:06.831890+0000","last_undegraded":"2024-06-04T16:23:06.831890+0000","last_fullsized":"2024-06-04T16:23:06.831890+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"251'68","last_scrub_stamp":"2024-06-04T16:23:06.831772+0000","last_deep_scrub":"251'68","last_deep_scrub_stamp":"2024-06-04T16:23:06.831772+0000","last_clean_scrub_stamp":"2024-06-04T16:23:06.831772+0000","objects_scrubbed":5,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T17:48:07.524627+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5328001,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":104,"num_read_kb":2209,"num_write":245,"num_write_kb":31585,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,7],"acting":[0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"254'110","reported_seq":1000,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:16.337809+0000","last_change":"2024-06-04T16:23:16.337867+0000","last_active":"2024-06-04T16:23:16.337809+0000","last_peered":"2024-06-04T16:23:16.337809+0000","last_clean":"2024-06-04T16:23:16.337809+0000","last_became_active":"2024-06-04T15:52:38.488389+0000","last_became_peered":"2024-06-04T15:52:38.488389+0000","last_unstale":"2024-06-04T16:23:16.337809+0000","last_undegraded":"2024-06-04T16:23:16.337809+0000","last_fullsized":"2024-06-04T16:23:16.337809+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'110","last_scrub_stamp":"2024-06-04T16:23:16.337710+0000","last_deep_scrub":"254'110","last_deep_scrub_stamp":"2024-06-04T16:23:16.337710+0000","last_clean_scrub_stamp":"2024-06-04T16:23:16.337710+0000","objects_scrubbed":1,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T17:14:53.579833+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":949,"num_read_kb":919,"num_write":126,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2299,"num_omap_keys":9,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.33","version":"254'50","reported_seq":560,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:17.163596+0000","last_change":"2024-06-04T16:23:17.163657+0000","last_active":"2024-06-04T16:23:17.163596+0000","last_peered":"2024-06-04T16:23:17.163596+0000","last_clean":"2024-06-04T16:23:17.163596+0000","last_became_active":"2024-06-04T15:52:36.498488+0000","last_became_peered":"2024-06-04T15:52:36.498488+0000","last_unstale":"2024-06-04T16:23:17.163596+0000","last_undegraded":"2024-06-04T16:23:17.163596+0000","last_fullsized":"2024-06-04T16:23:17.163596+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'50","last_scrub_stamp":"2024-06-04T16:23:17.163496+0000","last_deep_scrub":"254'50","last_deep_scrub_stamp":"2024-06-04T16:23:17.163496+0000","last_clean_scrub_stamp":"2024-06-04T16:23:17.163496+0000","objects_scrubbed":3,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T21:27:25.943842+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6461610,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":71,"num_read_kb":20343,"num_write":207,"num_write_kb":26780,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,4],"acting":[6,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.35","version":"254'139","reported_seq":935,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:59.197888+0000","last_change":"2024-06-04T16:22:59.197913+0000","last_active":"2024-06-04T16:22:59.197888+0000","last_peered":"2024-06-04T16:22:59.197888+0000","last_clean":"2024-06-04T16:22:59.197888+0000","last_became_active":"2024-06-04T15:52:38.486108+0000","last_became_peered":"2024-06-04T15:52:38.486108+0000","last_unstale":"2024-06-04T16:22:59.197888+0000","last_undegraded":"2024-06-04T16:22:59.197888+0000","last_fullsized":"2024-06-04T16:22:59.197888+0000","mapping_epoch":23,"log_start":"251'100","ondisk_log_start":"251'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'139","last_scrub_stamp":"2024-06-04T16:22:59.197784+0000","last_deep_scrub":"254'139","last_deep_scrub_stamp":"2024-06-04T16:22:59.197784+0000","last_clean_scrub_stamp":"2024-06-04T16:22:59.197784+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":100,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T19:34:23.692307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":692,"num_read_kb":648,"num_write":164,"num_write_kb":35,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"254'36","reported_seq":536,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:13.089771+0000","last_change":"2024-06-04T16:23:13.089808+0000","last_active":"2024-06-04T16:23:13.089771+0000","last_peered":"2024-06-04T16:23:13.089771+0000","last_clean":"2024-06-04T16:23:13.089771+0000","last_became_active":"2024-06-04T15:52:36.481047+0000","last_became_peered":"2024-06-04T15:52:36.481047+0000","last_unstale":"2024-06-04T16:23:13.089771+0000","last_undegraded":"2024-06-04T16:23:13.089771+0000","last_fullsized":"2024-06-04T16:23:13.089771+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'36","last_scrub_stamp":"2024-06-04T16:23:13.089678+0000","last_deep_scrub":"254'36","last_deep_scrub_stamp":"2024-06-04T16:23:13.089678+0000","last_clean_scrub_stamp":"2024-06-04T16:23:13.089678+0000","objects_scrubbed":1,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T02:50:31.631046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":42,"num_read_kb":41,"num_write":149,"num_write_kb":21263,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4],"acting":[6,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.18","version":"254'36","reported_seq":527,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:48.897593+0000","last_change":"2024-06-04T16:22:48.897620+0000","last_active":"2024-06-04T16:22:48.897593+0000","last_peered":"2024-06-04T16:22:48.897593+0000","last_clean":"2024-06-04T16:22:48.897593+0000","last_became_active":"2024-06-04T15:52:46.536608+0000","last_became_peered":"2024-06-04T15:52:46.536608+0000","last_unstale":"2024-06-04T16:22:48.897593+0000","last_undegraded":"2024-06-04T16:22:48.897593+0000","last_fullsized":"2024-06-04T16:22:48.897593+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'36","last_scrub_stamp":"2024-06-04T16:22:48.897499+0000","last_deep_scrub":"254'36","last_deep_scrub_stamp":"2024-06-04T16:22:48.897499+0000","last_clean_scrub_stamp":"2024-06-04T16:22:48.897499+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T20:02:47.722917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":81,"num_read_kb":72,"num_write":87,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"254'110","reported_seq":841,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:19.166996+0000","last_change":"2024-06-04T16:23:19.167020+0000","last_active":"2024-06-04T16:23:19.166996+0000","last_peered":"2024-06-04T16:23:19.166996+0000","last_clean":"2024-06-04T16:23:19.166996+0000","last_became_active":"2024-06-04T15:52:38.477052+0000","last_became_peered":"2024-06-04T15:52:38.477052+0000","last_unstale":"2024-06-04T16:23:19.166996+0000","last_undegraded":"2024-06-04T16:23:19.166996+0000","last_fullsized":"2024-06-04T16:23:19.166996+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'110","last_scrub_stamp":"2024-06-04T16:23:19.166917+0000","last_deep_scrub":"254'110","last_deep_scrub_stamp":"2024-06-04T16:23:19.166917+0000","last_clean_scrub_stamp":"2024-06-04T16:23:19.166917+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T01:33:44.001604+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":560,"num_read_kb":523,"num_write":129,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.13","version":"254'52","reported_seq":555,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:45.076839+0000","last_change":"2024-06-04T15:52:36.499588+0000","last_active":"2024-06-04T16:22:45.076839+0000","last_peered":"2024-06-04T16:22:45.076839+0000","last_clean":"2024-06-04T16:22:45.076839+0000","last_became_active":"2024-06-04T15:52:36.499305+0000","last_became_peered":"2024-06-04T15:52:36.499305+0000","last_unstale":"2024-06-04T16:22:45.076839+0000","last_undegraded":"2024-06-04T16:22:45.076839+0000","last_fullsized":"2024-06-04T16:22:45.076839+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194320,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":75,"num_read_kb":3024,"num_write":196,"num_write_kb":28071,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":474,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:21:40.027937+0000","last_change":"2024-06-04T15:52:40.477030+0000","last_active":"2024-06-04T16:21:40.027937+0000","last_peered":"2024-06-04T16:21:40.027937+0000","last_clean":"2024-06-04T16:21:40.027937+0000","last_became_active":"2024-06-04T15:52:40.476730+0000","last_became_peered":"2024-06-04T15:52:40.476730+0000","last_unstale":"2024-06-04T16:21:40.027937+0000","last_undegraded":"2024-06-04T16:21:40.027937+0000","last_fullsized":"2024-06-04T16:21:40.027937+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_clean_scrub_stamp":"2024-06-04T15:52:39.463103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"254'147","reported_seq":727,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:58.046557+0000","last_change":"2024-06-04T16:22:58.046593+0000","last_active":"2024-06-04T16:22:58.046557+0000","last_peered":"2024-06-04T16:22:58.046557+0000","last_clean":"2024-06-04T16:22:58.046557+0000","last_became_active":"2024-06-04T15:52:42.503184+0000","last_became_peered":"2024-06-04T15:52:42.503184+0000","last_unstale":"2024-06-04T16:22:58.046557+0000","last_undegraded":"2024-06-04T16:22:58.046557+0000","last_fullsized":"2024-06-04T16:22:58.046557+0000","mapping_epoch":27,"log_start":"251'100","ondisk_log_start":"251'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'147","last_scrub_stamp":"2024-06-04T16:22:58.046476+0000","last_deep_scrub":"254'147","last_deep_scrub_stamp":"2024-06-04T16:22:58.046476+0000","last_clean_scrub_stamp":"2024-06-04T16:22:58.046476+0000","objects_scrubbed":4,"log_size":47,"log_dups_size":100,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T21:24:37.226246+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":210,"num_read_kb":210,"num_write":112,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":477,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:12.320493+0000","last_change":"2024-06-04T16:23:12.320516+0000","last_active":"2024-06-04T16:23:12.320493+0000","last_peered":"2024-06-04T16:23:12.320493+0000","last_clean":"2024-06-04T16:23:12.320493+0000","last_became_active":"2024-06-04T15:52:44.513442+0000","last_became_peered":"2024-06-04T15:52:44.513442+0000","last_unstale":"2024-06-04T16:23:12.320493+0000","last_undegraded":"2024-06-04T16:23:12.320493+0000","last_fullsized":"2024-06-04T16:23:12.320493+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:23:12.320400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:23:12.320400+0000","last_clean_scrub_stamp":"2024-06-04T16:23:12.320400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T17:36:07.585385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"254'147","reported_seq":716,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:53.150923+0000","last_change":"2024-06-04T16:22:53.150954+0000","last_active":"2024-06-04T16:22:53.150923+0000","last_peered":"2024-06-04T16:22:53.150923+0000","last_clean":"2024-06-04T16:22:53.150923+0000","last_became_active":"2024-06-04T15:52:46.539957+0000","last_became_peered":"2024-06-04T15:52:46.539957+0000","last_unstale":"2024-06-04T16:22:53.150923+0000","last_undegraded":"2024-06-04T16:22:53.150923+0000","last_fullsized":"2024-06-04T16:22:53.150923+0000","mapping_epoch":31,"log_start":"254'100","ondisk_log_start":"254'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'147","last_scrub_stamp":"2024-06-04T16:22:53.150822+0000","last_deep_scrub":"254'147","last_deep_scrub_stamp":"2024-06-04T16:22:53.150822+0000","last_clean_scrub_stamp":"2024-06-04T16:22:53.150822+0000","objects_scrubbed":2,"log_size":47,"log_dups_size":100,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T21:42:55.962546+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":399,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":346,"num_read_kb":345,"num_write":304,"num_write_kb":102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"254'154","reported_seq":838,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:21:40.027923+0000","last_change":"2024-06-04T15:52:38.483869+0000","last_active":"2024-06-04T16:21:40.027923+0000","last_peered":"2024-06-04T16:21:40.027923+0000","last_clean":"2024-06-04T16:21:40.027923+0000","last_became_active":"2024-06-04T15:52:38.483516+0000","last_became_peered":"2024-06-04T15:52:38.483516+0000","last_unstale":"2024-06-04T16:21:40.027923+0000","last_undegraded":"2024-06-04T16:21:40.027923+0000","last_fullsized":"2024-06-04T16:21:40.027923+0000","mapping_epoch":23,"log_start":"251'100","ondisk_log_start":"251'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":100,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":841,"num_read_kb":740,"num_write":235,"num_write_kb":95,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"254'66","reported_seq":588,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:14.131826+0000","last_change":"2024-06-04T16:23:14.131879+0000","last_active":"2024-06-04T16:23:14.131826+0000","last_peered":"2024-06-04T16:23:14.131826+0000","last_clean":"2024-06-04T16:23:14.131826+0000","last_became_active":"2024-06-04T15:52:36.481099+0000","last_became_peered":"2024-06-04T15:52:36.481099+0000","last_unstale":"2024-06-04T16:23:14.131826+0000","last_undegraded":"2024-06-04T16:23:14.131826+0000","last_fullsized":"2024-06-04T16:23:14.131826+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'66","last_scrub_stamp":"2024-06-04T16:23:14.131731+0000","last_deep_scrub":"254'66","last_deep_scrub_stamp":"2024-06-04T16:23:14.131731+0000","last_clean_scrub_stamp":"2024-06-04T16:23:14.131731+0000","objects_scrubbed":3,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T21:24:25.096968+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133687,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":119,"num_read_kb":2903,"num_write":273,"num_write_kb":32792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,7],"acting":[6,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":484,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:06.002957+0000","last_change":"2024-06-04T16:23:06.002957+0000","last_active":"2024-06-04T16:23:06.002957+0000","last_peered":"2024-06-04T16:23:06.002957+0000","last_clean":"2024-06-04T16:23:06.002957+0000","last_became_active":"2024-06-04T15:52:40.479483+0000","last_became_peered":"2024-06-04T15:52:40.479483+0000","last_unstale":"2024-06-04T16:23:06.002957+0000","last_undegraded":"2024-06-04T16:23:06.002957+0000","last_fullsized":"2024-06-04T16:23:06.002957+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:23:06.002801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:23:06.002801+0000","last_clean_scrub_stamp":"2024-06-04T16:23:06.002801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T00:36:19.937830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"254'54","reported_seq":559,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:10.287138+0000","last_change":"2024-06-04T16:23:10.287196+0000","last_active":"2024-06-04T16:23:10.287138+0000","last_peered":"2024-06-04T16:23:10.287138+0000","last_clean":"2024-06-04T16:23:10.287138+0000","last_became_active":"2024-06-04T15:52:42.503451+0000","last_became_peered":"2024-06-04T15:52:42.503451+0000","last_unstale":"2024-06-04T16:23:10.287138+0000","last_undegraded":"2024-06-04T16:23:10.287138+0000","last_fullsized":"2024-06-04T16:23:10.287138+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'54","last_scrub_stamp":"2024-06-04T16:23:10.287044+0000","last_deep_scrub":"254'54","last_deep_scrub_stamp":"2024-06-04T16:23:10.287044+0000","last_clean_scrub_stamp":"2024-06-04T16:23:10.287044+0000","objects_scrubbed":3,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T20:35:52.209298+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":72,"num_read_kb":67,"num_write":48,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":477,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:55.141200+0000","last_change":"2024-06-04T16:22:55.141223+0000","last_active":"2024-06-04T16:22:55.141200+0000","last_peered":"2024-06-04T16:22:55.141200+0000","last_clean":"2024-06-04T16:22:55.141200+0000","last_became_active":"2024-06-04T15:52:44.517614+0000","last_became_peered":"2024-06-04T15:52:44.517614+0000","last_unstale":"2024-06-04T16:22:55.141200+0000","last_undegraded":"2024-06-04T16:22:55.141200+0000","last_fullsized":"2024-06-04T16:22:55.141200+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:22:55.141113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:22:55.141113+0000","last_clean_scrub_stamp":"2024-06-04T16:22:55.141113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T21:06:04.632373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"254'26","reported_seq":510,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:53.168793+0000","last_change":"2024-06-04T16:22:53.168825+0000","last_active":"2024-06-04T16:22:53.168793+0000","last_peered":"2024-06-04T16:22:53.168793+0000","last_clean":"2024-06-04T16:22:53.168793+0000","last_became_active":"2024-06-04T15:52:46.535498+0000","last_became_peered":"2024-06-04T15:52:46.535498+0000","last_unstale":"2024-06-04T16:22:53.168793+0000","last_undegraded":"2024-06-04T16:22:53.168793+0000","last_fullsized":"2024-06-04T16:22:53.168793+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'26","last_scrub_stamp":"2024-06-04T16:22:53.168708+0000","last_deep_scrub":"254'26","last_deep_scrub_stamp":"2024-06-04T16:22:53.168708+0000","last_clean_scrub_stamp":"2024-06-04T16:22:53.168708+0000","objects_scrubbed":4,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T16:25:50.093337+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":432,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":50,"num_read_kb":48,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"254'97","reported_seq":846,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:15.351317+0000","last_change":"2024-06-04T16:23:15.351347+0000","last_active":"2024-06-04T16:23:15.351317+0000","last_peered":"2024-06-04T16:23:15.351317+0000","last_clean":"2024-06-04T16:23:15.351317+0000","last_became_active":"2024-06-04T15:52:38.486612+0000","last_became_peered":"2024-06-04T15:52:38.486612+0000","last_unstale":"2024-06-04T16:23:15.351317+0000","last_undegraded":"2024-06-04T16:23:15.351317+0000","last_fullsized":"2024-06-04T16:23:15.351317+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'97","last_scrub_stamp":"2024-06-04T16:23:15.351224+0000","last_deep_scrub":"254'97","last_deep_scrub_stamp":"2024-06-04T16:23:15.351224+0000","last_clean_scrub_stamp":"2024-06-04T16:23:15.351224+0000","objects_scrubbed":2,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T04:14:08.447451+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":567,"num_read_kb":536,"num_write":113,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"254'37","reported_seq":527,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:45.076838+0000","last_change":"2024-06-04T15:52:36.487317+0000","last_active":"2024-06-04T16:22:45.076838+0000","last_peered":"2024-06-04T16:22:45.076838+0000","last_clean":"2024-06-04T16:22:45.076838+0000","last_became_active":"2024-06-04T15:52:36.486999+0000","last_became_peered":"2024-06-04T15:52:36.486999+0000","last_unstale":"2024-06-04T16:22:45.076838+0000","last_undegraded":"2024-06-04T16:22:45.076838+0000","last_fullsized":"2024-06-04T16:22:45.076838+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":26,"num_read_kb":6159,"num_write":134,"num_write_kb":22820,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":483,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:15.947311+0000","last_change":"2024-06-04T16:23:15.947335+0000","last_active":"2024-06-04T16:23:15.947311+0000","last_peered":"2024-06-04T16:23:15.947311+0000","last_clean":"2024-06-04T16:23:15.947311+0000","last_became_active":"2024-06-04T15:52:40.484711+0000","last_became_peered":"2024-06-04T15:52:40.484711+0000","last_unstale":"2024-06-04T16:23:15.947311+0000","last_undegraded":"2024-06-04T16:23:15.947311+0000","last_fullsized":"2024-06-04T16:23:15.947311+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:23:15.947213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:23:15.947213+0000","last_clean_scrub_stamp":"2024-06-04T16:23:15.947213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T02:55:05.998333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"254'70","reported_seq":580,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:59.023817+0000","last_change":"2024-06-04T16:22:59.023817+0000","last_active":"2024-06-04T16:22:59.023817+0000","last_peered":"2024-06-04T16:22:59.023817+0000","last_clean":"2024-06-04T16:22:59.023817+0000","last_became_active":"2024-06-04T15:52:42.501248+0000","last_became_peered":"2024-06-04T15:52:42.501248+0000","last_unstale":"2024-06-04T16:22:59.023817+0000","last_undegraded":"2024-06-04T16:22:59.023817+0000","last_fullsized":"2024-06-04T16:22:59.023817+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'70","last_scrub_stamp":"2024-06-04T16:22:59.023678+0000","last_deep_scrub":"254'70","last_deep_scrub_stamp":"2024-06-04T16:22:59.023678+0000","last_clean_scrub_stamp":"2024-06-04T16:22:59.023678+0000","objects_scrubbed":5,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T00:41:59.670808+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":90,"num_read_kb":83,"num_write":60,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.15","version":"254'465","reported_seq":1508,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:00.895137+0000","last_change":"2024-06-04T16:23:00.895165+0000","last_active":"2024-06-04T16:23:00.895137+0000","last_peered":"2024-06-04T16:23:00.895137+0000","last_clean":"2024-06-04T16:23:00.895137+0000","last_became_active":"2024-06-04T15:52:44.523138+0000","last_became_peered":"2024-06-04T15:52:44.523138+0000","last_unstale":"2024-06-04T16:23:00.895137+0000","last_undegraded":"2024-06-04T16:23:00.895137+0000","last_fullsized":"2024-06-04T16:23:00.895137+0000","mapping_epoch":29,"log_start":"251'400","ondisk_log_start":"251'400","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'465","last_scrub_stamp":"2024-06-04T16:23:00.895051+0000","last_deep_scrub":"254'465","last_deep_scrub_stamp":"2024-06-04T16:23:00.895051+0000","last_clean_scrub_stamp":"2024-06-04T16:23:00.895051+0000","objects_scrubbed":1,"log_size":65,"log_dups_size":400,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T20:48:57.811545+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"254'38","reported_seq":515,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:54.535431+0000","last_change":"2024-06-04T16:22:54.535460+0000","last_active":"2024-06-04T16:22:54.535431+0000","last_peered":"2024-06-04T16:22:54.535431+0000","last_clean":"2024-06-04T16:22:54.535431+0000","last_became_active":"2024-06-04T15:52:46.532141+0000","last_became_peered":"2024-06-04T15:52:46.532141+0000","last_unstale":"2024-06-04T16:22:54.535431+0000","last_undegraded":"2024-06-04T16:22:54.535431+0000","last_fullsized":"2024-06-04T16:22:54.535431+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'38","last_scrub_stamp":"2024-06-04T16:22:54.535346+0000","last_deep_scrub":"254'38","last_deep_scrub_stamp":"2024-06-04T16:22:54.535346+0000","last_clean_scrub_stamp":"2024-06-04T16:22:54.535346+0000","objects_scrubbed":1,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T17:24:08.579752+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":56,"num_read_kb":50,"num_write":85,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":168,"num_omap_keys":1,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"254'150","reported_seq":991,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:20.392868+0000","last_change":"2024-06-04T16:23:20.392913+0000","last_active":"2024-06-04T16:23:20.392868+0000","last_peered":"2024-06-04T16:23:20.392868+0000","last_clean":"2024-06-04T16:23:20.392868+0000","last_became_active":"2024-06-04T15:52:38.489719+0000","last_became_peered":"2024-06-04T15:52:38.489719+0000","last_unstale":"2024-06-04T16:23:20.392868+0000","last_undegraded":"2024-06-04T16:23:20.392868+0000","last_fullsized":"2024-06-04T16:23:20.392868+0000","mapping_epoch":23,"log_start":"251'100","ondisk_log_start":"251'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'150","last_scrub_stamp":"2024-06-04T16:23:20.392758+0000","last_deep_scrub":"254'150","last_deep_scrub_stamp":"2024-06-04T16:23:20.392758+0000","last_clean_scrub_stamp":"2024-06-04T16:23:20.392758+0000","objects_scrubbed":4,"log_size":50,"log_dups_size":100,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T18:56:39.101690+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":798,"num_read_kb":751,"num_write":172,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":148,"num_omap_keys":1,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"254'47","reported_seq":565,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:17.364677+0000","last_change":"2024-06-04T16:23:17.364729+0000","last_active":"2024-06-04T16:23:17.364677+0000","last_peered":"2024-06-04T16:23:17.364677+0000","last_clean":"2024-06-04T16:23:17.364677+0000","last_became_active":"2024-06-04T15:52:36.482920+0000","last_became_peered":"2024-06-04T15:52:36.482920+0000","last_unstale":"2024-06-04T16:23:17.364677+0000","last_undegraded":"2024-06-04T16:23:17.364677+0000","last_fullsized":"2024-06-04T16:23:17.364677+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'47","last_scrub_stamp":"2024-06-04T16:23:17.364583+0000","last_deep_scrub":"254'47","last_deep_scrub_stamp":"2024-06-04T16:23:17.364583+0000","last_clean_scrub_stamp":"2024-06-04T16:23:17.364583+0000","objects_scrubbed":5,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T22:19:51.192245+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1069231,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":86,"num_read_kb":13402,"num_write":212,"num_write_kb":21907,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3],"acting":[1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":482,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:15.830869+0000","last_change":"2024-06-04T16:23:15.830894+0000","last_active":"2024-06-04T16:23:15.830869+0000","last_peered":"2024-06-04T16:23:15.830869+0000","last_clean":"2024-06-04T16:23:15.830869+0000","last_became_active":"2024-06-04T15:52:40.482288+0000","last_became_peered":"2024-06-04T15:52:40.482288+0000","last_unstale":"2024-06-04T16:23:15.830869+0000","last_undegraded":"2024-06-04T16:23:15.830869+0000","last_fullsized":"2024-06-04T16:23:15.830869+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:23:15.830759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:23:15.830759+0000","last_clean_scrub_stamp":"2024-06-04T16:23:15.830759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T18:21:37.825735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"254'91","reported_seq":637,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:03.430350+0000","last_change":"2024-06-04T16:23:03.430391+0000","last_active":"2024-06-04T16:23:03.430350+0000","last_peered":"2024-06-04T16:23:03.430350+0000","last_clean":"2024-06-04T16:23:03.430350+0000","last_became_active":"2024-06-04T15:52:42.503282+0000","last_became_peered":"2024-06-04T15:52:42.503282+0000","last_unstale":"2024-06-04T16:23:03.430350+0000","last_undegraded":"2024-06-04T16:23:03.430350+0000","last_fullsized":"2024-06-04T16:23:03.430350+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'91","last_scrub_stamp":"2024-06-04T16:23:03.430250+0000","last_deep_scrub":"254'91","last_deep_scrub_stamp":"2024-06-04T16:23:03.430250+0000","last_clean_scrub_stamp":"2024-06-04T16:23:03.430250+0000","objects_scrubbed":4,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T16:30:06.943222+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6020,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":136,"num_read_kb":193,"num_write":64,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"254'478","reported_seq":1584,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:05.424688+0000","last_change":"2024-06-04T16:23:05.424688+0000","last_active":"2024-06-04T16:23:05.424688+0000","last_peered":"2024-06-04T16:23:05.424688+0000","last_clean":"2024-06-04T16:23:05.424688+0000","last_became_active":"2024-06-04T15:52:44.518724+0000","last_became_peered":"2024-06-04T15:52:44.518724+0000","last_unstale":"2024-06-04T16:23:05.424688+0000","last_undegraded":"2024-06-04T16:23:05.424688+0000","last_fullsized":"2024-06-04T16:23:05.424688+0000","mapping_epoch":29,"log_start":"251'400","ondisk_log_start":"251'400","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'478","last_scrub_stamp":"2024-06-04T16:23:05.424574+0000","last_deep_scrub":"254'478","last_deep_scrub_stamp":"2024-06-04T16:23:05.424574+0000","last_clean_scrub_stamp":"2024-06-04T16:23:05.424574+0000","objects_scrubbed":1,"log_size":78,"log_dups_size":400,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T17:23:14.724794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"254'113","reported_seq":809,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:20.707290+0000","last_change":"2024-06-04T16:23:20.707315+0000","last_active":"2024-06-04T16:23:20.707290+0000","last_peered":"2024-06-04T16:23:20.707290+0000","last_clean":"2024-06-04T16:23:20.707290+0000","last_became_active":"2024-06-04T15:52:38.478886+0000","last_became_peered":"2024-06-04T15:52:38.478886+0000","last_unstale":"2024-06-04T16:23:20.707290+0000","last_undegraded":"2024-06-04T16:23:20.707290+0000","last_fullsized":"2024-06-04T16:23:20.707290+0000","mapping_epoch":23,"log_start":"251'100","ondisk_log_start":"251'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'113","last_scrub_stamp":"2024-06-04T16:23:20.707200+0000","last_deep_scrub":"254'113","last_deep_scrub_stamp":"2024-06-04T16:23:20.707200+0000","last_clean_scrub_stamp":"2024-06-04T16:23:20.707200+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":100,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T01:55:10.845538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":534,"num_read_kb":483,"num_write":137,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"251'58","reported_seq":545,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:48.217293+0000","last_change":"2024-06-04T16:22:48.217346+0000","last_active":"2024-06-04T16:22:48.217293+0000","last_peered":"2024-06-04T16:22:48.217293+0000","last_clean":"2024-06-04T16:22:48.217293+0000","last_became_active":"2024-06-04T15:53:14.838259+0000","last_became_peered":"2024-06-04T15:53:14.838259+0000","last_unstale":"2024-06-04T16:22:48.217293+0000","last_undegraded":"2024-06-04T16:22:48.217293+0000","last_fullsized":"2024-06-04T16:22:48.217293+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"251'58","last_scrub_stamp":"2024-06-04T16:22:48.217194+0000","last_deep_scrub":"251'58","last_deep_scrub_stamp":"2024-06-04T16:22:48.217194+0000","last_clean_scrub_stamp":"2024-06-04T16:22:48.217194+0000","objects_scrubbed":2,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T01:01:00.864191+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":105,"num_read_kb":3164,"num_write":221,"num_write_kb":9993,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,4],"acting":[6,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":487,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:04.217949+0000","last_change":"2024-06-04T16:23:04.217972+0000","last_active":"2024-06-04T16:23:04.217949+0000","last_peered":"2024-06-04T16:23:04.217949+0000","last_clean":"2024-06-04T16:23:04.217949+0000","last_became_active":"2024-06-04T15:52:40.483832+0000","last_became_peered":"2024-06-04T15:52:40.483832+0000","last_unstale":"2024-06-04T16:23:04.217949+0000","last_undegraded":"2024-06-04T16:23:04.217949+0000","last_fullsized":"2024-06-04T16:23:04.217949+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:23:04.217854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:23:04.217854+0000","last_clean_scrub_stamp":"2024-06-04T16:23:04.217854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T17:33:21.489187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"254'148","reported_seq":730,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:55.848573+0000","last_change":"2024-06-04T16:22:55.848573+0000","last_active":"2024-06-04T16:22:55.848573+0000","last_peered":"2024-06-04T16:22:55.848573+0000","last_clean":"2024-06-04T16:22:55.848573+0000","last_became_active":"2024-06-04T15:52:42.504217+0000","last_became_peered":"2024-06-04T15:52:42.504217+0000","last_unstale":"2024-06-04T16:22:55.848573+0000","last_undegraded":"2024-06-04T16:22:55.848573+0000","last_fullsized":"2024-06-04T16:22:55.848573+0000","mapping_epoch":27,"log_start":"251'100","ondisk_log_start":"251'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'148","last_scrub_stamp":"2024-06-04T16:22:55.848437+0000","last_deep_scrub":"254'148","last_deep_scrub_stamp":"2024-06-04T16:22:55.848437+0000","last_clean_scrub_stamp":"2024-06-04T16:22:55.848437+0000","objects_scrubbed":9,"log_size":48,"log_dups_size":100,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T01:32:43.406440+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":216,"num_read_kb":258,"num_write":116,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":472,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:10.020836+0000","last_change":"2024-06-04T16:23:10.020872+0000","last_active":"2024-06-04T16:23:10.020836+0000","last_peered":"2024-06-04T16:23:10.020836+0000","last_clean":"2024-06-04T16:23:10.020836+0000","last_became_active":"2024-06-04T15:52:44.520358+0000","last_became_peered":"2024-06-04T15:52:44.520358+0000","last_unstale":"2024-06-04T16:23:10.020836+0000","last_undegraded":"2024-06-04T16:23:10.020836+0000","last_fullsized":"2024-06-04T16:23:10.020836+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:23:10.020709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:23:10.020709+0000","last_clean_scrub_stamp":"2024-06-04T16:23:10.020709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T20:15:17.221215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"254'457","reported_seq":1249,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:53.493908+0000","last_change":"2024-06-04T16:22:53.493945+0000","last_active":"2024-06-04T16:22:53.493908+0000","last_peered":"2024-06-04T16:22:53.493908+0000","last_clean":"2024-06-04T16:22:53.493908+0000","last_became_active":"2024-06-04T15:52:46.536442+0000","last_became_peered":"2024-06-04T15:52:46.536442+0000","last_unstale":"2024-06-04T16:22:53.493908+0000","last_undegraded":"2024-06-04T16:22:53.493908+0000","last_fullsized":"2024-06-04T16:22:53.493908+0000","mapping_epoch":31,"log_start":"251'400","ondisk_log_start":"251'400","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'457","last_scrub_stamp":"2024-06-04T16:22:53.493803+0000","last_deep_scrub":"254'457","last_deep_scrub_stamp":"2024-06-04T16:22:53.493803+0000","last_clean_scrub_stamp":"2024-06-04T16:22:53.493803+0000","objects_scrubbed":2,"log_size":57,"log_dups_size":400,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T17:18:55.700935+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":418,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1197,"num_read_kb":1195,"num_write":937,"num_write_kb":336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":182,"num_omap_keys":1,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"254'122","reported_seq":933,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:03.204186+0000","last_change":"2024-06-04T16:23:03.204213+0000","last_active":"2024-06-04T16:23:03.204186+0000","last_peered":"2024-06-04T16:23:03.204186+0000","last_clean":"2024-06-04T16:23:03.204186+0000","last_became_active":"2024-06-04T15:52:38.483194+0000","last_became_peered":"2024-06-04T15:52:38.483194+0000","last_unstale":"2024-06-04T16:23:03.204186+0000","last_undegraded":"2024-06-04T16:23:03.204186+0000","last_fullsized":"2024-06-04T16:23:03.204186+0000","mapping_epoch":23,"log_start":"251'100","ondisk_log_start":"251'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'122","last_scrub_stamp":"2024-06-04T16:23:03.204097+0000","last_deep_scrub":"254'122","last_deep_scrub_stamp":"2024-06-04T16:23:03.204097+0000","last_clean_scrub_stamp":"2024-06-04T16:23:03.204097+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":100,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T20:27:28.071534+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":683,"num_read_kb":649,"num_write":140,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"254'60","reported_seq":600,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:18.680129+0000","last_change":"2024-06-04T16:23:18.680207+0000","last_active":"2024-06-04T16:23:18.680129+0000","last_peered":"2024-06-04T16:23:18.680129+0000","last_clean":"2024-06-04T16:23:18.680129+0000","last_became_active":"2024-06-04T15:52:36.485995+0000","last_became_peered":"2024-06-04T15:52:36.485995+0000","last_unstale":"2024-06-04T16:23:18.680129+0000","last_undegraded":"2024-06-04T16:23:18.680129+0000","last_fullsized":"2024-06-04T16:23:18.680129+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'60","last_scrub_stamp":"2024-06-04T16:23:18.680030+0000","last_deep_scrub":"254'60","last_deep_scrub_stamp":"2024-06-04T16:23:18.680030+0000","last_clean_scrub_stamp":"2024-06-04T16:23:18.680030+0000","objects_scrubbed":6,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T16:54:32.626897+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":105,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":98,"num_read_kb":68665,"num_write":249,"num_write_kb":35943,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":481,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:01.049522+0000","last_change":"2024-06-04T16:23:01.049547+0000","last_active":"2024-06-04T16:23:01.049522+0000","last_peered":"2024-06-04T16:23:01.049522+0000","last_clean":"2024-06-04T16:23:01.049522+0000","last_became_active":"2024-06-04T15:52:40.480714+0000","last_became_peered":"2024-06-04T15:52:40.480714+0000","last_unstale":"2024-06-04T16:23:01.049522+0000","last_undegraded":"2024-06-04T16:23:01.049522+0000","last_fullsized":"2024-06-04T16:23:01.049522+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:23:01.049430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:23:01.049430+0000","last_clean_scrub_stamp":"2024-06-04T16:23:01.049430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T19:32:08.942239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.b","version":"254'96","reported_seq":645,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:55.026863+0000","last_change":"2024-06-04T16:22:55.026898+0000","last_active":"2024-06-04T16:22:55.026863+0000","last_peered":"2024-06-04T16:22:55.026863+0000","last_clean":"2024-06-04T16:22:55.026863+0000","last_became_active":"2024-06-04T15:52:42.505269+0000","last_became_peered":"2024-06-04T15:52:42.505269+0000","last_unstale":"2024-06-04T16:22:55.026863+0000","last_undegraded":"2024-06-04T16:22:55.026863+0000","last_fullsized":"2024-06-04T16:22:55.026863+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'96","last_scrub_stamp":"2024-06-04T16:22:55.026767+0000","last_deep_scrub":"254'96","last_deep_scrub_stamp":"2024-06-04T16:22:55.026767+0000","last_clean_scrub_stamp":"2024-06-04T16:22:55.026767+0000","objects_scrubbed":4,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T18:40:29.643937+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":127,"num_read_kb":117,"num_write":58,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":477,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:52.966827+0000","last_change":"2024-06-04T16:22:52.966827+0000","last_active":"2024-06-04T16:22:52.966827+0000","last_peered":"2024-06-04T16:22:52.966827+0000","last_clean":"2024-06-04T16:22:52.966827+0000","last_became_active":"2024-06-04T15:52:44.522149+0000","last_became_peered":"2024-06-04T15:52:44.522149+0000","last_unstale":"2024-06-04T16:22:52.966827+0000","last_undegraded":"2024-06-04T16:22:52.966827+0000","last_fullsized":"2024-06-04T16:22:52.966827+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:22:52.966674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:22:52.966674+0000","last_clean_scrub_stamp":"2024-06-04T16:22:52.966674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T02:07:15.814206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.5","version":"254'29","reported_seq":514,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:49.115675+0000","last_change":"2024-06-04T16:22:49.115732+0000","last_active":"2024-06-04T16:22:49.115675+0000","last_peered":"2024-06-04T16:22:49.115675+0000","last_clean":"2024-06-04T16:22:49.115675+0000","last_became_active":"2024-06-04T15:52:46.540510+0000","last_became_peered":"2024-06-04T15:52:46.540510+0000","last_unstale":"2024-06-04T16:22:49.115675+0000","last_undegraded":"2024-06-04T16:22:49.115675+0000","last_fullsized":"2024-06-04T16:22:49.115675+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'29","last_scrub_stamp":"2024-06-04T16:22:49.115565+0000","last_deep_scrub":"254'29","last_deep_scrub_stamp":"2024-06-04T16:22:49.115565+0000","last_clean_scrub_stamp":"2024-06-04T16:22:49.115565+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T21:09:44.617649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":51,"num_write":73,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"254'110","reported_seq":885,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:08.481097+0000","last_change":"2024-06-04T16:23:08.481122+0000","last_active":"2024-06-04T16:23:08.481097+0000","last_peered":"2024-06-04T16:23:08.481097+0000","last_clean":"2024-06-04T16:23:08.481097+0000","last_became_active":"2024-06-04T15:52:38.480112+0000","last_became_peered":"2024-06-04T15:52:38.480112+0000","last_unstale":"2024-06-04T16:23:08.481097+0000","last_undegraded":"2024-06-04T16:23:08.481097+0000","last_fullsized":"2024-06-04T16:23:08.481097+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'110","last_scrub_stamp":"2024-06-04T16:23:08.481025+0000","last_deep_scrub":"254'110","last_deep_scrub_stamp":"2024-06-04T16:23:08.481025+0000","last_clean_scrub_stamp":"2024-06-04T16:23:08.481025+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T19:01:23.753908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":725,"num_read_kb":689,"num_write":131,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"251'79","reported_seq":556,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:49.252335+0000","last_change":"2024-06-04T16:22:49.252378+0000","last_active":"2024-06-04T16:22:49.252335+0000","last_peered":"2024-06-04T16:22:49.252335+0000","last_clean":"2024-06-04T16:22:49.252335+0000","last_became_active":"2024-06-04T15:53:14.838251+0000","last_became_peered":"2024-06-04T15:53:14.838251+0000","last_unstale":"2024-06-04T16:22:49.252335+0000","last_undegraded":"2024-06-04T16:22:49.252335+0000","last_fullsized":"2024-06-04T16:22:49.252335+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"251'79","last_scrub_stamp":"2024-06-04T16:22:49.252226+0000","last_deep_scrub":"251'79","last_deep_scrub_stamp":"2024-06-04T16:22:49.252226+0000","last_clean_scrub_stamp":"2024-06-04T16:22:49.252226+0000","objects_scrubbed":5,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T00:19:46.167408+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5263509,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":74,"num_read_kb":65,"num_write":320,"num_write_kb":43304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.b","version":"254'4","reported_seq":794,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:24.369936+0000","last_change":"2024-06-04T16:23:24.369963+0000","last_active":"2024-06-04T16:23:24.369936+0000","last_peered":"2024-06-04T16:23:24.369936+0000","last_clean":"2024-06-04T16:23:24.369936+0000","last_became_active":"2024-06-04T15:52:40.482173+0000","last_became_peered":"2024-06-04T15:52:40.482173+0000","last_unstale":"2024-06-04T16:23:24.369936+0000","last_undegraded":"2024-06-04T16:23:24.369936+0000","last_fullsized":"2024-06-04T16:23:24.369936+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'4","last_scrub_stamp":"2024-06-04T16:23:24.369835+0000","last_deep_scrub":"254'4","last_deep_scrub_stamp":"2024-06-04T16:23:24.369835+0000","last_clean_scrub_stamp":"2024-06-04T16:23:24.369835+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T19:07:58.960858+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":464,"num_read_kb":462,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"254'116","reported_seq":674,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:12.884361+0000","last_change":"2024-06-04T16:23:12.884411+0000","last_active":"2024-06-04T16:23:12.884361+0000","last_peered":"2024-06-04T16:23:12.884361+0000","last_clean":"2024-06-04T16:23:12.884361+0000","last_became_active":"2024-06-04T15:52:42.497393+0000","last_became_peered":"2024-06-04T15:52:42.497393+0000","last_unstale":"2024-06-04T16:23:12.884361+0000","last_undegraded":"2024-06-04T16:23:12.884361+0000","last_fullsized":"2024-06-04T16:23:12.884361+0000","mapping_epoch":27,"log_start":"251'100","ondisk_log_start":"251'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'116","last_scrub_stamp":"2024-06-04T16:23:12.884257+0000","last_deep_scrub":"254'116","last_deep_scrub_stamp":"2024-06-04T16:23:12.884257+0000","last_clean_scrub_stamp":"2024-06-04T16:23:12.884257+0000","objects_scrubbed":7,"log_size":16,"log_dups_size":100,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T20:45:14.006254+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13302,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":171,"num_read_kb":247,"num_write":88,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"254'478","reported_seq":1645,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:07.355986+0000","last_change":"2024-06-04T16:23:07.356012+0000","last_active":"2024-06-04T16:23:07.355986+0000","last_peered":"2024-06-04T16:23:07.355986+0000","last_clean":"2024-06-04T16:23:07.355986+0000","last_became_active":"2024-06-04T15:52:44.518765+0000","last_became_peered":"2024-06-04T15:52:44.518765+0000","last_unstale":"2024-06-04T16:23:07.355986+0000","last_undegraded":"2024-06-04T16:23:07.355986+0000","last_fullsized":"2024-06-04T16:23:07.355986+0000","mapping_epoch":29,"log_start":"251'400","ondisk_log_start":"251'400","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'478","last_scrub_stamp":"2024-06-04T16:23:07.355902+0000","last_deep_scrub":"254'478","last_deep_scrub_stamp":"2024-06-04T16:23:07.355902+0000","last_clean_scrub_stamp":"2024-06-04T16:23:07.355902+0000","objects_scrubbed":1,"log_size":78,"log_dups_size":400,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T00:22:11.634747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"254'22","reported_seq":499,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:52.174461+0000","last_change":"2024-06-04T16:22:52.174461+0000","last_active":"2024-06-04T16:22:52.174461+0000","last_peered":"2024-06-04T16:22:52.174461+0000","last_clean":"2024-06-04T16:22:52.174461+0000","last_became_active":"2024-06-04T15:52:46.537679+0000","last_became_peered":"2024-06-04T15:52:46.537679+0000","last_unstale":"2024-06-04T16:22:52.174461+0000","last_undegraded":"2024-06-04T16:22:52.174461+0000","last_fullsized":"2024-06-04T16:22:52.174461+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'22","last_scrub_stamp":"2024-06-04T16:22:52.174345+0000","last_deep_scrub":"254'22","last_deep_scrub_stamp":"2024-06-04T16:22:52.174345+0000","last_clean_scrub_stamp":"2024-06-04T16:22:52.174345+0000","objects_scrubbed":1,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T02:41:59.686833+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":390,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":49,"num_read_kb":41,"num_write":55,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"254'142","reported_seq":909,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:18.327141+0000","last_change":"2024-06-04T16:23:18.327180+0000","last_active":"2024-06-04T16:23:18.327141+0000","last_peered":"2024-06-04T16:23:18.327141+0000","last_clean":"2024-06-04T16:23:18.327141+0000","last_became_active":"2024-06-04T15:52:38.488997+0000","last_became_peered":"2024-06-04T15:52:38.488997+0000","last_unstale":"2024-06-04T16:23:18.327141+0000","last_undegraded":"2024-06-04T16:23:18.327141+0000","last_fullsized":"2024-06-04T16:23:18.327141+0000","mapping_epoch":23,"log_start":"251'100","ondisk_log_start":"251'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'142","last_scrub_stamp":"2024-06-04T16:23:18.327044+0000","last_deep_scrub":"254'142","last_deep_scrub_stamp":"2024-06-04T16:23:18.327044+0000","last_clean_scrub_stamp":"2024-06-04T16:23:18.327044+0000","objects_scrubbed":1,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T20:11:38.046285+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":688,"num_read_kb":631,"num_write":173,"num_write_kb":46,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"254'58","reported_seq":576,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:04.760655+0000","last_change":"2024-06-04T16:23:04.760722+0000","last_active":"2024-06-04T16:23:04.760655+0000","last_peered":"2024-06-04T16:23:04.760655+0000","last_clean":"2024-06-04T16:23:04.760655+0000","last_became_active":"2024-06-04T15:52:36.495601+0000","last_became_peered":"2024-06-04T15:52:36.495601+0000","last_unstale":"2024-06-04T16:23:04.760655+0000","last_undegraded":"2024-06-04T16:23:04.760655+0000","last_fullsized":"2024-06-04T16:23:04.760655+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'58","last_scrub_stamp":"2024-06-04T16:23:04.760535+0000","last_deep_scrub":"254'58","last_deep_scrub_stamp":"2024-06-04T16:23:04.760535+0000","last_clean_scrub_stamp":"2024-06-04T16:23:04.760535+0000","objects_scrubbed":3,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T16:26:15.812386+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":74,"num_read_kb":575,"num_write":257,"num_write_kb":23683,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":481,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:56.113187+0000","last_change":"2024-06-04T16:22:56.113187+0000","last_active":"2024-06-04T16:22:56.113187+0000","last_peered":"2024-06-04T16:22:56.113187+0000","last_clean":"2024-06-04T16:22:56.113187+0000","last_became_active":"2024-06-04T15:52:40.484785+0000","last_became_peered":"2024-06-04T15:52:40.484785+0000","last_unstale":"2024-06-04T16:22:56.113187+0000","last_undegraded":"2024-06-04T16:22:56.113187+0000","last_fullsized":"2024-06-04T16:22:56.113187+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:22:56.113062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:22:56.113062+0000","last_clean_scrub_stamp":"2024-06-04T16:22:56.113062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T03:33:52.074473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.9","version":"254'161","reported_seq":772,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:57.012649+0000","last_change":"2024-06-04T16:22:57.012649+0000","last_active":"2024-06-04T16:22:57.012649+0000","last_peered":"2024-06-04T16:22:57.012649+0000","last_clean":"2024-06-04T16:22:57.012649+0000","last_became_active":"2024-06-04T15:52:42.504622+0000","last_became_peered":"2024-06-04T15:52:42.504622+0000","last_unstale":"2024-06-04T16:22:57.012649+0000","last_undegraded":"2024-06-04T16:22:57.012649+0000","last_fullsized":"2024-06-04T16:22:57.012649+0000","mapping_epoch":27,"log_start":"251'100","ondisk_log_start":"251'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'161","last_scrub_stamp":"2024-06-04T16:22:57.012513+0000","last_deep_scrub":"254'161","last_deep_scrub_stamp":"2024-06-04T16:22:57.012513+0000","last_clean_scrub_stamp":"2024-06-04T16:22:57.012513+0000","objects_scrubbed":5,"log_size":61,"log_dups_size":100,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T04:11:37.544221+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25402,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":256,"num_read_kb":404,"num_write":118,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":479,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:08.356628+0000","last_change":"2024-06-04T16:23:08.356652+0000","last_active":"2024-06-04T16:23:08.356628+0000","last_peered":"2024-06-04T16:23:08.356628+0000","last_clean":"2024-06-04T16:23:08.356628+0000","last_became_active":"2024-06-04T15:52:44.518340+0000","last_became_peered":"2024-06-04T15:52:44.518340+0000","last_unstale":"2024-06-04T16:23:08.356628+0000","last_undegraded":"2024-06-04T16:23:08.356628+0000","last_fullsized":"2024-06-04T16:23:08.356628+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:23:08.356529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:23:08.356529+0000","last_clean_scrub_stamp":"2024-06-04T16:23:08.356529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T01:28:35.019870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"254'23","reported_seq":512,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:05.078621+0000","last_change":"2024-06-04T16:23:05.078621+0000","last_active":"2024-06-04T16:23:05.078621+0000","last_peered":"2024-06-04T16:23:05.078621+0000","last_clean":"2024-06-04T16:23:05.078621+0000","last_became_active":"2024-06-04T15:52:46.540542+0000","last_became_peered":"2024-06-04T15:52:46.540542+0000","last_unstale":"2024-06-04T16:23:05.078621+0000","last_undegraded":"2024-06-04T16:23:05.078621+0000","last_fullsized":"2024-06-04T16:23:05.078621+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'23","last_scrub_stamp":"2024-06-04T16:23:05.078478+0000","last_deep_scrub":"254'23","last_deep_scrub_stamp":"2024-06-04T16:23:05.078478+0000","last_clean_scrub_stamp":"2024-06-04T16:23:05.078478+0000","objects_scrubbed":1,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T02:22:33.559139+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":503,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":51,"num_read_kb":51,"num_write":59,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"254'119","reported_seq":924,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:54.855494+0000","last_change":"2024-06-04T16:22:54.855550+0000","last_active":"2024-06-04T16:22:54.855494+0000","last_peered":"2024-06-04T16:22:54.855494+0000","last_clean":"2024-06-04T16:22:54.855494+0000","last_became_active":"2024-06-04T15:52:38.488576+0000","last_became_peered":"2024-06-04T15:52:38.488576+0000","last_unstale":"2024-06-04T16:22:54.855494+0000","last_undegraded":"2024-06-04T16:22:54.855494+0000","last_fullsized":"2024-06-04T16:22:54.855494+0000","mapping_epoch":23,"log_start":"251'100","ondisk_log_start":"251'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'119","last_scrub_stamp":"2024-06-04T16:22:54.855389+0000","last_deep_scrub":"254'119","last_deep_scrub_stamp":"2024-06-04T16:22:54.855389+0000","last_clean_scrub_stamp":"2024-06-04T16:22:54.855389+0000","objects_scrubbed":3,"log_size":19,"log_dups_size":100,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T22:19:39.538012+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":804,"num_read_kb":763,"num_write":143,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":723,"num_omap_keys":3,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"254'83","reported_seq":612,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:24.902386+0000","last_change":"2024-06-04T16:23:24.902461+0000","last_active":"2024-06-04T16:23:24.902386+0000","last_peered":"2024-06-04T16:23:24.902386+0000","last_clean":"2024-06-04T16:23:24.902386+0000","last_became_active":"2024-06-04T15:52:36.498706+0000","last_became_peered":"2024-06-04T15:52:36.498706+0000","last_unstale":"2024-06-04T16:23:24.902386+0000","last_undegraded":"2024-06-04T16:23:24.902386+0000","last_fullsized":"2024-06-04T16:23:24.902386+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'83","last_scrub_stamp":"2024-06-04T16:23:24.902269+0000","last_deep_scrub":"254'83","last_deep_scrub_stamp":"2024-06-04T16:23:24.902269+0000","last_clean_scrub_stamp":"2024-06-04T16:23:24.902269+0000","objects_scrubbed":3,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T00:39:33.757532+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262197,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":125,"num_read_kb":7280,"num_write":369,"num_write_kb":33149,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":484,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:12.929752+0000","last_change":"2024-06-04T16:23:12.929800+0000","last_active":"2024-06-04T16:23:12.929752+0000","last_peered":"2024-06-04T16:23:12.929752+0000","last_clean":"2024-06-04T16:23:12.929752+0000","last_became_active":"2024-06-04T15:52:40.484285+0000","last_became_peered":"2024-06-04T15:52:40.484285+0000","last_unstale":"2024-06-04T16:23:12.929752+0000","last_undegraded":"2024-06-04T16:23:12.929752+0000","last_fullsized":"2024-06-04T16:23:12.929752+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:23:12.929650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:23:12.929650+0000","last_clean_scrub_stamp":"2024-06-04T16:23:12.929650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T00:20:19.738361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.e","version":"254'126","reported_seq":680,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:06.264937+0000","last_change":"2024-06-04T16:23:06.265001+0000","last_active":"2024-06-04T16:23:06.264937+0000","last_peered":"2024-06-04T16:23:06.264937+0000","last_clean":"2024-06-04T16:23:06.264937+0000","last_became_active":"2024-06-04T15:52:42.500865+0000","last_became_peered":"2024-06-04T15:52:42.500865+0000","last_unstale":"2024-06-04T16:23:06.264937+0000","last_undegraded":"2024-06-04T16:23:06.264937+0000","last_fullsized":"2024-06-04T16:23:06.264937+0000","mapping_epoch":27,"log_start":"251'100","ondisk_log_start":"251'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'126","last_scrub_stamp":"2024-06-04T16:23:06.264820+0000","last_deep_scrub":"254'126","last_deep_scrub_stamp":"2024-06-04T16:23:06.264820+0000","last_clean_scrub_stamp":"2024-06-04T16:23:06.264820+0000","objects_scrubbed":6,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T20:12:34.216703+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":174,"num_read_kb":176,"num_write":136,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":13964,"num_omap_keys":34,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":476,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:13.901326+0000","last_change":"2024-06-04T16:23:13.901347+0000","last_active":"2024-06-04T16:23:13.901326+0000","last_peered":"2024-06-04T16:23:13.901326+0000","last_clean":"2024-06-04T16:23:13.901326+0000","last_became_active":"2024-06-04T15:52:44.519542+0000","last_became_peered":"2024-06-04T15:52:44.519542+0000","last_unstale":"2024-06-04T16:23:13.901326+0000","last_undegraded":"2024-06-04T16:23:13.901326+0000","last_fullsized":"2024-06-04T16:23:13.901326+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:23:13.901228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:23:13.901228+0000","last_clean_scrub_stamp":"2024-06-04T16:23:13.901228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T22:51:41.368783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.0","version":"254'18","reported_seq":494,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:00.480512+0000","last_change":"2024-06-04T16:23:00.480554+0000","last_active":"2024-06-04T16:23:00.480512+0000","last_peered":"2024-06-04T16:23:00.480512+0000","last_clean":"2024-06-04T16:23:00.480512+0000","last_became_active":"2024-06-04T15:52:46.539906+0000","last_became_peered":"2024-06-04T15:52:46.539906+0000","last_unstale":"2024-06-04T16:23:00.480512+0000","last_undegraded":"2024-06-04T16:23:00.480512+0000","last_fullsized":"2024-06-04T16:23:00.480512+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'18","last_scrub_stamp":"2024-06-04T16:23:00.480421+0000","last_deep_scrub":"254'18","last_deep_scrub_stamp":"2024-06-04T16:23:00.480421+0000","last_clean_scrub_stamp":"2024-06-04T16:23:00.480421+0000","objects_scrubbed":2,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T20:46:48.332397+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":31,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"254'141","reported_seq":907,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:21.730902+0000","last_change":"2024-06-04T16:23:21.730965+0000","last_active":"2024-06-04T16:23:21.730902+0000","last_peered":"2024-06-04T16:23:21.730902+0000","last_clean":"2024-06-04T16:23:21.730902+0000","last_became_active":"2024-06-04T15:52:38.478691+0000","last_became_peered":"2024-06-04T15:52:38.478691+0000","last_unstale":"2024-06-04T16:23:21.730902+0000","last_undegraded":"2024-06-04T16:23:21.730902+0000","last_fullsized":"2024-06-04T16:23:21.730902+0000","mapping_epoch":23,"log_start":"251'100","ondisk_log_start":"251'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'141","last_scrub_stamp":"2024-06-04T16:23:21.730784+0000","last_deep_scrub":"254'141","last_deep_scrub_stamp":"2024-06-04T16:23:21.730784+0000","last_clean_scrub_stamp":"2024-06-04T16:23:21.730784+0000","objects_scrubbed":1,"log_size":41,"log_dups_size":100,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T19:02:45.024119+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":683,"num_read_kb":634,"num_write":182,"num_write_kb":49,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":219,"num_omap_keys":1,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"254'80","reported_seq":589,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:45.076820+0000","last_change":"2024-06-04T15:52:36.489783+0000","last_active":"2024-06-04T16:22:45.076820+0000","last_peered":"2024-06-04T16:22:45.076820+0000","last_clean":"2024-06-04T16:22:45.076820+0000","last_became_active":"2024-06-04T15:52:36.489437+0000","last_became_peered":"2024-06-04T15:52:36.489437+0000","last_unstale":"2024-06-04T16:22:45.076820+0000","last_undegraded":"2024-06-04T16:22:45.076820+0000","last_fullsized":"2024-06-04T16:22:45.076820+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133669,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":97,"num_read_kb":3905,"num_write":348,"num_write_kb":24180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":486,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:22.346328+0000","last_change":"2024-06-04T16:23:22.346350+0000","last_active":"2024-06-04T16:23:22.346328+0000","last_peered":"2024-06-04T16:23:22.346328+0000","last_clean":"2024-06-04T16:23:22.346328+0000","last_became_active":"2024-06-04T15:52:40.480568+0000","last_became_peered":"2024-06-04T15:52:40.480568+0000","last_unstale":"2024-06-04T16:23:22.346328+0000","last_undegraded":"2024-06-04T16:23:22.346328+0000","last_fullsized":"2024-06-04T16:23:22.346328+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:23:22.346239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:23:22.346239+0000","last_clean_scrub_stamp":"2024-06-04T16:23:22.346239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T01:05:37.658043+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.f","version":"254'111","reported_seq":663,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:39.414356+0000","last_change":"2024-06-04T15:52:42.499311+0000","last_active":"2024-06-04T16:22:39.414356+0000","last_peered":"2024-06-04T16:22:39.414356+0000","last_clean":"2024-06-04T16:22:39.414356+0000","last_became_active":"2024-06-04T15:52:42.499014+0000","last_became_peered":"2024-06-04T15:52:42.499014+0000","last_unstale":"2024-06-04T16:22:39.414356+0000","last_undegraded":"2024-06-04T16:22:39.414356+0000","last_fullsized":"2024-06-04T16:22:39.414356+0000","mapping_epoch":27,"log_start":"251'100","ondisk_log_start":"251'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_clean_scrub_stamp":"2024-06-04T15:52:41.476734+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":100,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6848,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":169,"num_read_kb":239,"num_write":88,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.e","version":"254'464","reported_seq":1453,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:11.952502+0000","last_change":"2024-06-04T16:23:11.952532+0000","last_active":"2024-06-04T16:23:11.952502+0000","last_peered":"2024-06-04T16:23:11.952502+0000","last_clean":"2024-06-04T16:23:11.952502+0000","last_became_active":"2024-06-04T15:52:44.520016+0000","last_became_peered":"2024-06-04T15:52:44.520016+0000","last_unstale":"2024-06-04T16:23:11.952502+0000","last_undegraded":"2024-06-04T16:23:11.952502+0000","last_fullsized":"2024-06-04T16:23:11.952502+0000","mapping_epoch":29,"log_start":"251'400","ondisk_log_start":"251'400","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'464","last_scrub_stamp":"2024-06-04T16:23:11.952413+0000","last_deep_scrub":"254'464","last_deep_scrub_stamp":"2024-06-04T16:23:11.952413+0000","last_clean_scrub_stamp":"2024-06-04T16:23:11.952413+0000","objects_scrubbed":1,"log_size":64,"log_dups_size":400,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T02:24:58.126815+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1","version":"254'30","reported_seq":510,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:20.170753+0000","last_change":"2024-06-04T16:23:20.170804+0000","last_active":"2024-06-04T16:23:20.170753+0000","last_peered":"2024-06-04T16:23:20.170753+0000","last_clean":"2024-06-04T16:23:20.170753+0000","last_became_active":"2024-06-04T15:52:46.532554+0000","last_became_peered":"2024-06-04T15:52:46.532554+0000","last_unstale":"2024-06-04T16:23:20.170753+0000","last_undegraded":"2024-06-04T16:23:20.170753+0000","last_fullsized":"2024-06-04T16:23:20.170753+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'30","last_scrub_stamp":"2024-06-04T16:23:20.170628+0000","last_deep_scrub":"254'30","last_deep_scrub_stamp":"2024-06-04T16:23:20.170628+0000","last_clean_scrub_stamp":"2024-06-04T16:23:20.170628+0000","objects_scrubbed":2,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T23:35:04.324039+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":764,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":64,"num_read_kb":55,"num_write":77,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.e","version":"254'75","reported_seq":766,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:06.474256+0000","last_change":"2024-06-04T16:23:06.474304+0000","last_active":"2024-06-04T16:23:06.474256+0000","last_peered":"2024-06-04T16:23:06.474256+0000","last_clean":"2024-06-04T16:23:06.474256+0000","last_became_active":"2024-06-04T15:52:38.480961+0000","last_became_peered":"2024-06-04T15:52:38.480961+0000","last_unstale":"2024-06-04T16:23:06.474256+0000","last_undegraded":"2024-06-04T16:23:06.474256+0000","last_fullsized":"2024-06-04T16:23:06.474256+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'75","last_scrub_stamp":"2024-06-04T16:23:06.474148+0000","last_deep_scrub":"254'75","last_deep_scrub_stamp":"2024-06-04T16:23:06.474148+0000","last_clean_scrub_stamp":"2024-06-04T16:23:06.474148+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T19:29:32.107688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":420,"num_read_kb":402,"num_write":82,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"254'43","reported_seq":543,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:45.076808+0000","last_change":"2024-06-04T15:52:36.485951+0000","last_active":"2024-06-04T16:22:45.076808+0000","last_peered":"2024-06-04T16:22:45.076808+0000","last_clean":"2024-06-04T16:22:45.076808+0000","last_became_active":"2024-06-04T15:52:36.485571+0000","last_became_peered":"2024-06-04T15:52:36.485571+0000","last_unstale":"2024-06-04T16:22:45.076808+0000","last_undegraded":"2024-06-04T16:22:45.076808+0000","last_fullsized":"2024-06-04T16:22:45.076808+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":66,"num_read_kb":9943,"num_write":198,"num_write_kb":32171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"254'4","reported_seq":1096,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:58.155039+0000","last_change":"2024-06-04T16:22:58.155073+0000","last_active":"2024-06-04T16:22:58.155039+0000","last_peered":"2024-06-04T16:22:58.155039+0000","last_clean":"2024-06-04T16:22:58.155039+0000","last_became_active":"2024-06-04T15:52:40.477693+0000","last_became_peered":"2024-06-04T15:52:40.477693+0000","last_unstale":"2024-06-04T16:22:58.155039+0000","last_undegraded":"2024-06-04T16:22:58.155039+0000","last_fullsized":"2024-06-04T16:22:58.155039+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'4","last_scrub_stamp":"2024-06-04T16:22:58.154941+0000","last_deep_scrub":"254'4","last_deep_scrub_stamp":"2024-06-04T16:22:58.154941+0000","last_clean_scrub_stamp":"2024-06-04T16:22:58.154941+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T00:05:04.192698+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":606,"num_read_kb":606,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"254'40","reported_seq":531,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:02.080728+0000","last_change":"2024-06-04T16:23:02.080763+0000","last_active":"2024-06-04T16:23:02.080728+0000","last_peered":"2024-06-04T16:23:02.080728+0000","last_clean":"2024-06-04T16:23:02.080728+0000","last_became_active":"2024-06-04T15:52:42.503184+0000","last_became_peered":"2024-06-04T15:52:42.503184+0000","last_unstale":"2024-06-04T16:23:02.080728+0000","last_undegraded":"2024-06-04T16:23:02.080728+0000","last_fullsized":"2024-06-04T16:23:02.080728+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'40","last_scrub_stamp":"2024-06-04T16:23:02.080645+0000","last_deep_scrub":"254'40","last_deep_scrub_stamp":"2024-06-04T16:23:02.080645+0000","last_clean_scrub_stamp":"2024-06-04T16:23:02.080645+0000","objects_scrubbed":5,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T03:22:52.049410+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":45,"num_read_kb":40,"num_write":30,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.d","version":"254'470","reported_seq":1632,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:57.144139+0000","last_change":"2024-06-04T16:22:57.144210+0000","last_active":"2024-06-04T16:22:57.144139+0000","last_peered":"2024-06-04T16:22:57.144139+0000","last_clean":"2024-06-04T16:22:57.144139+0000","last_became_active":"2024-06-04T15:52:44.518522+0000","last_became_peered":"2024-06-04T15:52:44.518522+0000","last_unstale":"2024-06-04T16:22:57.144139+0000","last_undegraded":"2024-06-04T16:22:57.144139+0000","last_fullsized":"2024-06-04T16:22:57.144139+0000","mapping_epoch":29,"log_start":"251'400","ondisk_log_start":"251'400","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'470","last_scrub_stamp":"2024-06-04T16:22:57.144040+0000","last_deep_scrub":"254'470","last_deep_scrub_stamp":"2024-06-04T16:22:57.144040+0000","last_clean_scrub_stamp":"2024-06-04T16:22:57.144040+0000","objects_scrubbed":1,"log_size":70,"log_dups_size":400,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T02:23:07.168350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"254'26","reported_seq":503,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:21.631938+0000","last_change":"2024-06-04T16:23:21.631965+0000","last_active":"2024-06-04T16:23:21.631938+0000","last_peered":"2024-06-04T16:23:21.631938+0000","last_clean":"2024-06-04T16:23:21.631938+0000","last_became_active":"2024-06-04T15:52:46.529183+0000","last_became_peered":"2024-06-04T15:52:46.529183+0000","last_unstale":"2024-06-04T16:23:21.631938+0000","last_undegraded":"2024-06-04T16:23:21.631938+0000","last_fullsized":"2024-06-04T16:23:21.631938+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'26","last_scrub_stamp":"2024-06-04T16:23:21.631850+0000","last_deep_scrub":"254'26","last_deep_scrub_stamp":"2024-06-04T16:23:21.631850+0000","last_clean_scrub_stamp":"2024-06-04T16:23:21.631850+0000","objects_scrubbed":1,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T23:41:50.582422+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":33,"num_read_kb":31,"num_write":52,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"254'102","reported_seq":875,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:18.975096+0000","last_change":"2024-06-04T16:23:18.975148+0000","last_active":"2024-06-04T16:23:18.975096+0000","last_peered":"2024-06-04T16:23:18.975096+0000","last_clean":"2024-06-04T16:23:18.975096+0000","last_became_active":"2024-06-04T15:52:38.485146+0000","last_became_peered":"2024-06-04T15:52:38.485146+0000","last_unstale":"2024-06-04T16:23:18.975096+0000","last_undegraded":"2024-06-04T16:23:18.975096+0000","last_fullsized":"2024-06-04T16:23:18.975096+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'102","last_scrub_stamp":"2024-06-04T16:23:18.974996+0000","last_deep_scrub":"254'102","last_deep_scrub_stamp":"2024-06-04T16:23:18.974996+0000","last_clean_scrub_stamp":"2024-06-04T16:23:18.974996+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T23:16:12.932747+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":573,"num_read_kb":549,"num_write":116,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"251'24","reported_seq":526,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:18.858021+0000","last_change":"2024-06-04T16:23:18.858060+0000","last_active":"2024-06-04T16:23:18.858021+0000","last_peered":"2024-06-04T16:23:18.858021+0000","last_clean":"2024-06-04T16:23:18.858021+0000","last_became_active":"2024-06-04T15:52:36.475290+0000","last_became_peered":"2024-06-04T15:52:36.475290+0000","last_unstale":"2024-06-04T16:23:18.858021+0000","last_undegraded":"2024-06-04T16:23:18.858021+0000","last_fullsized":"2024-06-04T16:23:18.858021+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"251'24","last_scrub_stamp":"2024-06-04T16:23:18.857916+0000","last_deep_scrub":"251'24","last_deep_scrub_stamp":"2024-06-04T16:23:18.857916+0000","last_clean_scrub_stamp":"2024-06-04T16:23:18.857916+0000","objects_scrubbed":1,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T23:52:34.754727+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":22,"num_read_kb":15371,"num_write":75,"num_write_kb":21019,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,2],"acting":[4,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":483,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:16.796763+0000","last_change":"2024-06-04T16:23:16.796788+0000","last_active":"2024-06-04T16:23:16.796763+0000","last_peered":"2024-06-04T16:23:16.796763+0000","last_clean":"2024-06-04T16:23:16.796763+0000","last_became_active":"2024-06-04T15:52:40.481856+0000","last_became_peered":"2024-06-04T15:52:40.481856+0000","last_unstale":"2024-06-04T16:23:16.796763+0000","last_undegraded":"2024-06-04T16:23:16.796763+0000","last_fullsized":"2024-06-04T16:23:16.796763+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:23:16.796663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:23:16.796663+0000","last_clean_scrub_stamp":"2024-06-04T16:23:16.796663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T22:31:29.169661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"254'148","reported_seq":726,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:08.239387+0000","last_change":"2024-06-04T16:23:08.239441+0000","last_active":"2024-06-04T16:23:08.239387+0000","last_peered":"2024-06-04T16:23:08.239387+0000","last_clean":"2024-06-04T16:23:08.239387+0000","last_became_active":"2024-06-04T15:52:42.503214+0000","last_became_peered":"2024-06-04T15:52:42.503214+0000","last_unstale":"2024-06-04T16:23:08.239387+0000","last_undegraded":"2024-06-04T16:23:08.239387+0000","last_fullsized":"2024-06-04T16:23:08.239387+0000","mapping_epoch":27,"log_start":"251'100","ondisk_log_start":"251'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'148","last_scrub_stamp":"2024-06-04T16:23:08.239291+0000","last_deep_scrub":"254'148","last_deep_scrub_stamp":"2024-06-04T16:23:08.239291+0000","last_clean_scrub_stamp":"2024-06-04T16:23:08.239291+0000","objects_scrubbed":9,"log_size":48,"log_dups_size":100,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T23:13:35.428234+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27149,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":238,"num_read_kb":318,"num_write":172,"num_write_kb":95,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":23306,"num_omap_keys":60,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":474,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:05.466085+0000","last_change":"2024-06-04T16:23:05.466110+0000","last_active":"2024-06-04T16:23:05.466085+0000","last_peered":"2024-06-04T16:23:05.466085+0000","last_clean":"2024-06-04T16:23:05.466085+0000","last_became_active":"2024-06-04T15:52:44.514269+0000","last_became_peered":"2024-06-04T15:52:44.514269+0000","last_unstale":"2024-06-04T16:23:05.466085+0000","last_undegraded":"2024-06-04T16:23:05.466085+0000","last_fullsized":"2024-06-04T16:23:05.466085+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:23:05.465993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:23:05.465993+0000","last_clean_scrub_stamp":"2024-06-04T16:23:05.465993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T17:36:31.045619+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"254'31","reported_seq":512,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:19.955405+0000","last_change":"2024-06-04T16:23:19.955432+0000","last_active":"2024-06-04T16:23:19.955405+0000","last_peered":"2024-06-04T16:23:19.955405+0000","last_clean":"2024-06-04T16:23:19.955405+0000","last_became_active":"2024-06-04T15:52:46.531977+0000","last_became_peered":"2024-06-04T15:52:46.531977+0000","last_unstale":"2024-06-04T16:23:19.955405+0000","last_undegraded":"2024-06-04T16:23:19.955405+0000","last_fullsized":"2024-06-04T16:23:19.955405+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'31","last_scrub_stamp":"2024-06-04T16:23:19.955313+0000","last_deep_scrub":"254'31","last_deep_scrub_stamp":"2024-06-04T16:23:19.955313+0000","last_clean_scrub_stamp":"2024-06-04T16:23:19.955313+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T20:01:47.795809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":49,"num_write":79,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"254'145","reported_seq":962,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:23.734953+0000","last_change":"2024-06-04T16:23:23.734980+0000","last_active":"2024-06-04T16:23:23.734953+0000","last_peered":"2024-06-04T16:23:23.734953+0000","last_clean":"2024-06-04T16:23:23.734953+0000","last_became_active":"2024-06-04T15:52:38.478362+0000","last_became_peered":"2024-06-04T15:52:38.478362+0000","last_unstale":"2024-06-04T16:23:23.734953+0000","last_undegraded":"2024-06-04T16:23:23.734953+0000","last_fullsized":"2024-06-04T16:23:23.734953+0000","mapping_epoch":23,"log_start":"251'100","ondisk_log_start":"251'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'145","last_scrub_stamp":"2024-06-04T16:23:23.734860+0000","last_deep_scrub":"254'145","last_deep_scrub_stamp":"2024-06-04T16:23:23.734860+0000","last_clean_scrub_stamp":"2024-06-04T16:23:23.734860+0000","objects_scrubbed":1,"log_size":45,"log_dups_size":100,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T02:17:22.450341+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":807,"num_read_kb":748,"num_write":182,"num_write_kb":49,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":505,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:14.325906+0000","last_change":"2024-06-04T16:23:14.325930+0000","last_active":"2024-06-04T16:23:14.325906+0000","last_peered":"2024-06-04T16:23:14.325906+0000","last_clean":"2024-06-04T16:23:14.325906+0000","last_became_active":"2024-06-04T15:52:22.417462+0000","last_became_peered":"2024-06-04T15:52:22.417462+0000","last_unstale":"2024-06-04T16:23:14.325906+0000","last_undegraded":"2024-06-04T16:23:14.325906+0000","last_fullsized":"2024-06-04T16:23:14.325906+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:23:14.325798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:23:14.325798+0000","last_clean_scrub_stamp":"2024-06-04T16:23:14.325798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T23:53:10.001735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"251'43","reported_seq":543,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:23.808597+0000","last_change":"2024-06-04T16:23:23.808637+0000","last_active":"2024-06-04T16:23:23.808597+0000","last_peered":"2024-06-04T16:23:23.808597+0000","last_clean":"2024-06-04T16:23:23.808597+0000","last_became_active":"2024-06-04T15:52:36.497603+0000","last_became_peered":"2024-06-04T15:52:36.497603+0000","last_unstale":"2024-06-04T16:23:23.808597+0000","last_undegraded":"2024-06-04T16:23:23.808597+0000","last_fullsized":"2024-06-04T16:23:23.808597+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"251'43","last_scrub_stamp":"2024-06-04T16:23:23.808498+0000","last_deep_scrub":"251'43","last_deep_scrub_stamp":"2024-06-04T16:23:23.808498+0000","last_clean_scrub_stamp":"2024-06-04T16:23:23.808498+0000","objects_scrubbed":2,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T18:24:13.323796+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1069190,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":32,"num_read_kb":263,"num_write":148,"num_write_kb":16917,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,0],"acting":[4,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":487,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:51.867953+0000","last_change":"2024-06-04T16:22:51.867979+0000","last_active":"2024-06-04T16:22:51.867953+0000","last_peered":"2024-06-04T16:22:51.867953+0000","last_clean":"2024-06-04T16:22:51.867953+0000","last_became_active":"2024-06-04T15:52:40.482529+0000","last_became_peered":"2024-06-04T15:52:40.482529+0000","last_unstale":"2024-06-04T16:22:51.867953+0000","last_undegraded":"2024-06-04T16:22:51.867953+0000","last_fullsized":"2024-06-04T16:22:51.867953+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:22:51.867794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:22:51.867794+0000","last_clean_scrub_stamp":"2024-06-04T16:22:51.867794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T17:42:46.966148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"254'247","reported_seq":928,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:13.866235+0000","last_change":"2024-06-04T16:23:13.866295+0000","last_active":"2024-06-04T16:23:13.866235+0000","last_peered":"2024-06-04T16:23:13.866235+0000","last_clean":"2024-06-04T16:23:13.866235+0000","last_became_active":"2024-06-04T15:52:42.496878+0000","last_became_peered":"2024-06-04T15:52:42.496878+0000","last_unstale":"2024-06-04T16:23:13.866235+0000","last_undegraded":"2024-06-04T16:23:13.866235+0000","last_fullsized":"2024-06-04T16:23:13.866235+0000","mapping_epoch":27,"log_start":"251'200","ondisk_log_start":"251'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'247","last_scrub_stamp":"2024-06-04T16:23:13.866118+0000","last_deep_scrub":"254'247","last_deep_scrub_stamp":"2024-06-04T16:23:13.866118+0000","last_clean_scrub_stamp":"2024-06-04T16:23:13.866118+0000","objects_scrubbed":6,"log_size":47,"log_dups_size":200,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T23:18:27.252241+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30577,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":489,"num_read_kb":691,"num_write":394,"num_write_kb":281,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":89476,"num_omap_keys":214,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":479,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:11.411051+0000","last_change":"2024-06-04T16:23:11.411076+0000","last_active":"2024-06-04T16:23:11.411051+0000","last_peered":"2024-06-04T16:23:11.411051+0000","last_clean":"2024-06-04T16:23:11.411051+0000","last_became_active":"2024-06-04T15:52:44.513726+0000","last_became_peered":"2024-06-04T15:52:44.513726+0000","last_unstale":"2024-06-04T16:23:11.411051+0000","last_undegraded":"2024-06-04T16:23:11.411051+0000","last_fullsized":"2024-06-04T16:23:11.411051+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:23:11.410960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:23:11.410960+0000","last_clean_scrub_stamp":"2024-06-04T16:23:11.410960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T17:49:36.322932+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"254'35","reported_seq":527,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:13.860513+0000","last_change":"2024-06-04T16:23:13.860575+0000","last_active":"2024-06-04T16:23:13.860513+0000","last_peered":"2024-06-04T16:23:13.860513+0000","last_clean":"2024-06-04T16:23:13.860513+0000","last_became_active":"2024-06-04T15:52:46.536184+0000","last_became_peered":"2024-06-04T15:52:46.536184+0000","last_unstale":"2024-06-04T16:23:13.860513+0000","last_undegraded":"2024-06-04T16:23:13.860513+0000","last_fullsized":"2024-06-04T16:23:13.860513+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'35","last_scrub_stamp":"2024-06-04T16:23:13.860386+0000","last_deep_scrub":"254'35","last_deep_scrub_stamp":"2024-06-04T16:23:13.860386+0000","last_clean_scrub_stamp":"2024-06-04T16:23:13.860386+0000","objects_scrubbed":1,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T16:38:56.538838+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":408,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":64,"num_read_kb":61,"num_write":79,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"254'172","reported_seq":982,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:18.205094+0000","last_change":"2024-06-04T16:23:18.205120+0000","last_active":"2024-06-04T16:23:18.205094+0000","last_peered":"2024-06-04T16:23:18.205094+0000","last_clean":"2024-06-04T16:23:18.205094+0000","last_became_active":"2024-06-04T15:52:38.474646+0000","last_became_peered":"2024-06-04T15:52:38.474646+0000","last_unstale":"2024-06-04T16:23:18.205094+0000","last_undegraded":"2024-06-04T16:23:18.205094+0000","last_fullsized":"2024-06-04T16:23:18.205094+0000","mapping_epoch":23,"log_start":"251'100","ondisk_log_start":"251'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'172","last_scrub_stamp":"2024-06-04T16:23:18.205006+0000","last_deep_scrub":"254'172","last_deep_scrub_stamp":"2024-06-04T16:23:18.205006+0000","last_clean_scrub_stamp":"2024-06-04T16:23:18.205006+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":100,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T21:10:26.825707+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":944,"num_read_kb":866,"num_write":217,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":494,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:21:30.026717+0000","last_change":"2024-06-04T15:52:22.777198+0000","last_active":"2024-06-04T16:21:30.026717+0000","last_peered":"2024-06-04T16:21:30.026717+0000","last_clean":"2024-06-04T16:21:30.026717+0000","last_became_active":"2024-06-04T15:52:22.776779+0000","last_became_peered":"2024-06-04T15:52:22.776779+0000","last_unstale":"2024-06-04T16:21:30.026717+0000","last_undegraded":"2024-06-04T16:21:30.026717+0000","last_fullsized":"2024-06-04T16:21:30.026717+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:21.400880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:21.400880+0000","last_clean_scrub_stamp":"2024-06-04T15:52:21.400880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"251'43","reported_seq":548,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:11.801114+0000","last_change":"2024-06-04T16:23:11.801160+0000","last_active":"2024-06-04T16:23:11.801114+0000","last_peered":"2024-06-04T16:23:11.801114+0000","last_clean":"2024-06-04T16:23:11.801114+0000","last_became_active":"2024-06-04T15:52:36.494711+0000","last_became_peered":"2024-06-04T15:52:36.494711+0000","last_unstale":"2024-06-04T16:23:11.801114+0000","last_undegraded":"2024-06-04T16:23:11.801114+0000","last_fullsized":"2024-06-04T16:23:11.801114+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"251'43","last_scrub_stamp":"2024-06-04T16:23:11.801011+0000","last_deep_scrub":"251'43","last_deep_scrub_stamp":"2024-06-04T16:23:11.801011+0000","last_clean_scrub_stamp":"2024-06-04T16:23:11.801011+0000","objects_scrubbed":3,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T03:17:51.288880+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20644,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":32,"num_read_kb":101,"num_write":157,"num_write_kb":20554,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,4],"acting":[0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":485,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:14.949247+0000","last_change":"2024-06-04T16:23:14.949274+0000","last_active":"2024-06-04T16:23:14.949247+0000","last_peered":"2024-06-04T16:23:14.949247+0000","last_clean":"2024-06-04T16:23:14.949247+0000","last_became_active":"2024-06-04T15:52:40.484698+0000","last_became_peered":"2024-06-04T15:52:40.484698+0000","last_unstale":"2024-06-04T16:23:14.949247+0000","last_undegraded":"2024-06-04T16:23:14.949247+0000","last_fullsized":"2024-06-04T16:23:14.949247+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:23:14.949147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:23:14.949147+0000","last_clean_scrub_stamp":"2024-06-04T16:23:14.949147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T22:36:57.311927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"251'83","reported_seq":591,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:46.023693+0000","last_change":"2024-06-04T15:52:42.500941+0000","last_active":"2024-06-04T16:22:46.023693+0000","last_peered":"2024-06-04T16:22:46.023693+0000","last_clean":"2024-06-04T16:22:46.023693+0000","last_became_active":"2024-06-04T15:52:42.500646+0000","last_became_peered":"2024-06-04T15:52:42.500646+0000","last_unstale":"2024-06-04T16:22:46.023693+0000","last_undegraded":"2024-06-04T16:22:46.023693+0000","last_fullsized":"2024-06-04T16:22:46.023693+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_clean_scrub_stamp":"2024-06-04T15:52:41.476734+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":102,"num_read_kb":94,"num_write":72,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":476,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:03.864415+0000","last_change":"2024-06-04T16:23:03.864415+0000","last_active":"2024-06-04T16:23:03.864415+0000","last_peered":"2024-06-04T16:23:03.864415+0000","last_clean":"2024-06-04T16:23:03.864415+0000","last_became_active":"2024-06-04T15:52:44.520841+0000","last_became_peered":"2024-06-04T15:52:44.520841+0000","last_unstale":"2024-06-04T16:23:03.864415+0000","last_undegraded":"2024-06-04T16:23:03.864415+0000","last_fullsized":"2024-06-04T16:23:03.864415+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:23:03.864261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:23:03.864261+0000","last_clean_scrub_stamp":"2024-06-04T16:23:03.864261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T18:09:32.795774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"251'34","reported_seq":544,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:51.136365+0000","last_change":"2024-06-04T16:22:51.136365+0000","last_active":"2024-06-04T16:22:51.136365+0000","last_peered":"2024-06-04T16:22:51.136365+0000","last_clean":"2024-06-04T16:22:51.136365+0000","last_became_active":"2024-06-04T15:52:46.539931+0000","last_became_peered":"2024-06-04T15:52:46.539931+0000","last_unstale":"2024-06-04T16:22:51.136365+0000","last_undegraded":"2024-06-04T16:22:51.136365+0000","last_fullsized":"2024-06-04T16:22:51.136365+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"251'34","last_scrub_stamp":"2024-06-04T16:22:51.136181+0000","last_deep_scrub":"251'34","last_deep_scrub_stamp":"2024-06-04T16:22:51.136181+0000","last_clean_scrub_stamp":"2024-06-04T16:22:51.136181+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T19:05:15.366957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":127,"num_read_kb":111,"num_write":92,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"254'121","reported_seq":1040,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:03.065206+0000","last_change":"2024-06-04T16:23:03.065255+0000","last_active":"2024-06-04T16:23:03.065206+0000","last_peered":"2024-06-04T16:23:03.065206+0000","last_clean":"2024-06-04T16:23:03.065206+0000","last_became_active":"2024-06-04T15:52:38.485755+0000","last_became_peered":"2024-06-04T15:52:38.485755+0000","last_unstale":"2024-06-04T16:23:03.065206+0000","last_undegraded":"2024-06-04T16:23:03.065206+0000","last_fullsized":"2024-06-04T16:23:03.065206+0000","mapping_epoch":23,"log_start":"254'100","ondisk_log_start":"254'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'121","last_scrub_stamp":"2024-06-04T16:23:03.065085+0000","last_deep_scrub":"254'121","last_deep_scrub_stamp":"2024-06-04T16:23:03.065085+0000","last_clean_scrub_stamp":"2024-06-04T16:23:03.065085+0000","objects_scrubbed":2,"log_size":21,"log_dups_size":100,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T17:34:01.981275+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":989,"num_read_kb":963,"num_write":137,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2286,"num_omap_keys":9,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":504,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:05.784767+0000","last_change":"2024-06-04T16:23:05.784811+0000","last_active":"2024-06-04T16:23:05.784767+0000","last_peered":"2024-06-04T16:23:05.784767+0000","last_clean":"2024-06-04T16:23:05.784767+0000","last_became_active":"2024-06-04T15:52:22.422971+0000","last_became_peered":"2024-06-04T15:52:22.422971+0000","last_unstale":"2024-06-04T16:23:05.784767+0000","last_undegraded":"2024-06-04T16:23:05.784767+0000","last_fullsized":"2024-06-04T16:23:05.784767+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:23:05.784635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:23:05.784635+0000","last_clean_scrub_stamp":"2024-06-04T16:23:05.784635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T04:21:46.950261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"254'72","reported_seq":613,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:45.044128+0000","last_change":"2024-06-04T15:52:36.485796+0000","last_active":"2024-06-04T16:22:45.044128+0000","last_peered":"2024-06-04T16:22:45.044128+0000","last_clean":"2024-06-04T16:22:45.044128+0000","last_became_active":"2024-06-04T15:52:36.485475+0000","last_became_peered":"2024-06-04T15:52:36.485475+0000","last_unstale":"2024-06-04T16:22:45.044128+0000","last_undegraded":"2024-06-04T16:22:45.044128+0000","last_fullsized":"2024-06-04T16:22:45.044128+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":109,"num_read_kb":62832,"num_write":269,"num_write_kb":45136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,2],"acting":[5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"254'2","reported_seq":487,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:10.995937+0000","last_change":"2024-06-04T16:23:10.995968+0000","last_active":"2024-06-04T16:23:10.995937+0000","last_peered":"2024-06-04T16:23:10.995937+0000","last_clean":"2024-06-04T16:23:10.995937+0000","last_became_active":"2024-06-04T15:52:40.486003+0000","last_became_peered":"2024-06-04T15:52:40.486003+0000","last_unstale":"2024-06-04T16:23:10.995937+0000","last_undegraded":"2024-06-04T16:23:10.995937+0000","last_fullsized":"2024-06-04T16:23:10.995937+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'2","last_scrub_stamp":"2024-06-04T16:23:10.995821+0000","last_deep_scrub":"254'2","last_deep_scrub_stamp":"2024-06-04T16:23:10.995821+0000","last_clean_scrub_stamp":"2024-06-04T16:23:10.995821+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T18:23:07.156912+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"254'124","reported_seq":1007,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:57.787192+0000","last_change":"2024-06-04T16:22:57.787246+0000","last_active":"2024-06-04T16:22:57.787192+0000","last_peered":"2024-06-04T16:22:57.787192+0000","last_clean":"2024-06-04T16:22:57.787192+0000","last_became_active":"2024-06-04T15:52:42.505250+0000","last_became_peered":"2024-06-04T15:52:42.505250+0000","last_unstale":"2024-06-04T16:22:57.787192+0000","last_undegraded":"2024-06-04T16:22:57.787192+0000","last_fullsized":"2024-06-04T16:22:57.787192+0000","mapping_epoch":27,"log_start":"251'100","ondisk_log_start":"251'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'124","last_scrub_stamp":"2024-06-04T16:22:57.787100+0000","last_deep_scrub":"254'124","last_deep_scrub_stamp":"2024-06-04T16:22:57.787100+0000","last_clean_scrub_stamp":"2024-06-04T16:22:57.787100+0000","objects_scrubbed":8,"log_size":24,"log_dups_size":100,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T22:01:32.859318+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":113,"num_read_kb":103,"num_write":67,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":477,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:51.009073+0000","last_change":"2024-06-04T16:22:51.009109+0000","last_active":"2024-06-04T16:22:51.009073+0000","last_peered":"2024-06-04T16:22:51.009073+0000","last_clean":"2024-06-04T16:22:51.009073+0000","last_became_active":"2024-06-04T15:52:44.522168+0000","last_became_peered":"2024-06-04T15:52:44.522168+0000","last_unstale":"2024-06-04T16:22:51.009073+0000","last_undegraded":"2024-06-04T16:22:51.009073+0000","last_fullsized":"2024-06-04T16:22:51.009073+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:22:51.008969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:22:51.008969+0000","last_clean_scrub_stamp":"2024-06-04T16:22:51.008969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T17:53:46.600382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.b","version":"254'112","reported_seq":611,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:46.992773+0000","last_change":"2024-06-04T16:22:46.992832+0000","last_active":"2024-06-04T16:22:46.992773+0000","last_peered":"2024-06-04T16:22:46.992773+0000","last_clean":"2024-06-04T16:22:46.992773+0000","last_became_active":"2024-06-04T15:52:46.537377+0000","last_became_peered":"2024-06-04T15:52:46.537377+0000","last_unstale":"2024-06-04T16:22:46.992773+0000","last_undegraded":"2024-06-04T16:22:46.992773+0000","last_fullsized":"2024-06-04T16:22:46.992773+0000","mapping_epoch":31,"log_start":"251'100","ondisk_log_start":"251'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'112","last_scrub_stamp":"2024-06-04T16:22:46.992648+0000","last_deep_scrub":"254'112","last_deep_scrub_stamp":"2024-06-04T16:22:46.992648+0000","last_clean_scrub_stamp":"2024-06-04T16:22:46.992648+0000","objects_scrubbed":1,"log_size":12,"log_dups_size":100,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T19:14:15.808220+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":232,"num_read_kb":256,"num_write":227,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":851,"num_omap_keys":5,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.6","version":"254'76","reported_seq":777,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:12.378772+0000","last_change":"2024-06-04T16:23:12.378804+0000","last_active":"2024-06-04T16:23:12.378772+0000","last_peered":"2024-06-04T16:23:12.378772+0000","last_clean":"2024-06-04T16:23:12.378772+0000","last_became_active":"2024-06-04T15:52:38.487359+0000","last_became_peered":"2024-06-04T15:52:38.487359+0000","last_unstale":"2024-06-04T16:23:12.378772+0000","last_undegraded":"2024-06-04T16:23:12.378772+0000","last_fullsized":"2024-06-04T16:23:12.378772+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'76","last_scrub_stamp":"2024-06-04T16:23:12.378681+0000","last_deep_scrub":"254'76","last_deep_scrub_stamp":"2024-06-04T16:23:12.378681+0000","last_clean_scrub_stamp":"2024-06-04T16:23:12.378681+0000","objects_scrubbed":2,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T23:38:54.261802+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":431,"num_read_kb":414,"num_write":84,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":503,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:17.888798+0000","last_change":"2024-06-04T16:23:17.888839+0000","last_active":"2024-06-04T16:23:17.888798+0000","last_peered":"2024-06-04T16:23:17.888798+0000","last_clean":"2024-06-04T16:23:17.888798+0000","last_became_active":"2024-06-04T15:52:22.423712+0000","last_became_peered":"2024-06-04T15:52:22.423712+0000","last_unstale":"2024-06-04T16:23:17.888798+0000","last_undegraded":"2024-06-04T16:23:17.888798+0000","last_fullsized":"2024-06-04T16:23:17.888798+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:23:17.888685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:23:17.888685+0000","last_clean_scrub_stamp":"2024-06-04T16:23:17.888685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T00:03:32.023669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"17'72","reported_seq":585,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:30.033585+0000","last_change":"2024-06-04T15:52:22.429522+0000","last_active":"2024-06-04T16:22:30.033585+0000","last_peered":"2024-06-04T16:22:30.033585+0000","last_clean":"2024-06-04T16:22:30.033585+0000","last_became_active":"2024-06-04T15:52:22.428356+0000","last_became_peered":"2024-06-04T15:52:22.428356+0000","last_unstale":"2024-06-04T16:22:30.033585+0000","last_undegraded":"2024-06-04T16:22:30.033585+0000","last_fullsized":"2024-06-04T16:22:30.033585+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:21.400880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:21.400880+0000","last_clean_scrub_stamp":"2024-06-04T15:52:21.400880+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"254'72","reported_seq":589,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:15.095374+0000","last_change":"2024-06-04T16:23:15.095428+0000","last_active":"2024-06-04T16:23:15.095374+0000","last_peered":"2024-06-04T16:23:15.095374+0000","last_clean":"2024-06-04T16:23:15.095374+0000","last_became_active":"2024-06-04T15:52:36.488567+0000","last_became_peered":"2024-06-04T15:52:36.488567+0000","last_unstale":"2024-06-04T16:23:15.095374+0000","last_undegraded":"2024-06-04T16:23:15.095374+0000","last_fullsized":"2024-06-04T16:23:15.095374+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'72","last_scrub_stamp":"2024-06-04T16:23:15.095275+0000","last_deep_scrub":"254'72","last_deep_scrub_stamp":"2024-06-04T16:23:15.095275+0000","last_clean_scrub_stamp":"2024-06-04T16:23:15.095275+0000","objects_scrubbed":5,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T20:29:53.277016+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133705,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":100,"num_read_kb":15171,"num_write":323,"num_write_kb":30782,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,4],"acting":[6,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":476,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:45.077140+0000","last_change":"2024-06-04T15:52:40.479422+0000","last_active":"2024-06-04T16:22:45.077140+0000","last_peered":"2024-06-04T16:22:45.077140+0000","last_clean":"2024-06-04T16:22:45.077140+0000","last_became_active":"2024-06-04T15:52:40.479168+0000","last_became_peered":"2024-06-04T15:52:40.479168+0000","last_unstale":"2024-06-04T16:22:45.077140+0000","last_undegraded":"2024-06-04T16:22:45.077140+0000","last_fullsized":"2024-06-04T16:22:45.077140+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:39.463103+0000","last_clean_scrub_stamp":"2024-06-04T15:52:39.463103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"254'567","reported_seq":1753,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:06.058305+0000","last_change":"2024-06-04T16:23:06.058359+0000","last_active":"2024-06-04T16:23:06.058305+0000","last_peered":"2024-06-04T16:23:06.058305+0000","last_clean":"2024-06-04T16:23:06.058305+0000","last_became_active":"2024-06-04T15:52:42.503178+0000","last_became_peered":"2024-06-04T15:52:42.503178+0000","last_unstale":"2024-06-04T16:23:06.058305+0000","last_undegraded":"2024-06-04T16:23:06.058305+0000","last_fullsized":"2024-06-04T16:23:06.058305+0000","mapping_epoch":27,"log_start":"251'500","ondisk_log_start":"251'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'567","last_scrub_stamp":"2024-06-04T16:23:06.058220+0000","last_deep_scrub":"254'567","last_deep_scrub_stamp":"2024-06-04T16:23:06.058220+0000","last_clean_scrub_stamp":"2024-06-04T16:23:06.058220+0000","objects_scrubbed":11,"log_size":67,"log_dups_size":500,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T22:58:35.190155+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29662,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":838,"num_read_kb":1049,"num_write":188,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":300,"num_omap_keys":2,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":476,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:01.876753+0000","last_change":"2024-06-04T16:23:01.876775+0000","last_active":"2024-06-04T16:23:01.876753+0000","last_peered":"2024-06-04T16:23:01.876753+0000","last_clean":"2024-06-04T16:23:01.876753+0000","last_became_active":"2024-06-04T15:52:44.522475+0000","last_became_peered":"2024-06-04T15:52:44.522475+0000","last_unstale":"2024-06-04T16:23:01.876753+0000","last_undegraded":"2024-06-04T16:23:01.876753+0000","last_fullsized":"2024-06-04T16:23:01.876753+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:23:01.876659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:23:01.876659+0000","last_clean_scrub_stamp":"2024-06-04T16:23:01.876659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T18:04:59.431933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"254'73","reported_seq":568,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:59.496703+0000","last_change":"2024-06-04T16:22:59.496703+0000","last_active":"2024-06-04T16:22:59.496703+0000","last_peered":"2024-06-04T16:22:59.496703+0000","last_clean":"2024-06-04T16:22:59.496703+0000","last_became_active":"2024-06-04T15:52:46.541851+0000","last_became_peered":"2024-06-04T15:52:46.541851+0000","last_unstale":"2024-06-04T16:22:59.496703+0000","last_undegraded":"2024-06-04T16:22:59.496703+0000","last_fullsized":"2024-06-04T16:22:59.496703+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'73","last_scrub_stamp":"2024-06-04T16:22:59.496568+0000","last_deep_scrub":"254'73","last_deep_scrub_stamp":"2024-06-04T16:22:59.496568+0000","last_clean_scrub_stamp":"2024-06-04T16:22:59.496568+0000","objects_scrubbed":2,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T03:49:46.316753+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":147,"num_read_kb":147,"num_write":159,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1","version":"254'115","reported_seq":821,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:02.473712+0000","last_change":"2024-06-04T16:23:02.473738+0000","last_active":"2024-06-04T16:23:02.473712+0000","last_peered":"2024-06-04T16:23:02.473712+0000","last_clean":"2024-06-04T16:23:02.473712+0000","last_became_active":"2024-06-04T15:52:38.485314+0000","last_became_peered":"2024-06-04T15:52:38.485314+0000","last_unstale":"2024-06-04T16:23:02.473712+0000","last_undegraded":"2024-06-04T16:23:02.473712+0000","last_fullsized":"2024-06-04T16:23:02.473712+0000","mapping_epoch":23,"log_start":"251'100","ondisk_log_start":"251'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'115","last_scrub_stamp":"2024-06-04T16:23:02.473618+0000","last_deep_scrub":"254'115","last_deep_scrub_stamp":"2024-06-04T16:23:02.473618+0000","last_clean_scrub_stamp":"2024-06-04T16:23:02.473618+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":100,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T21:11:06.521739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":554,"num_read_kb":505,"num_write":149,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"251'78","reported_seq":597,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:20.783370+0000","last_change":"2024-06-04T16:23:20.783456+0000","last_active":"2024-06-04T16:23:20.783370+0000","last_peered":"2024-06-04T16:23:20.783370+0000","last_clean":"2024-06-04T16:23:20.783370+0000","last_became_active":"2024-06-04T15:52:36.478729+0000","last_became_peered":"2024-06-04T15:52:36.478729+0000","last_unstale":"2024-06-04T16:23:20.783370+0000","last_undegraded":"2024-06-04T16:23:20.783370+0000","last_fullsized":"2024-06-04T16:23:20.783370+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"251'78","last_scrub_stamp":"2024-06-04T16:23:20.783257+0000","last_deep_scrub":"251'78","last_deep_scrub_stamp":"2024-06-04T16:23:20.783257+0000","last_clean_scrub_stamp":"2024-06-04T16:23:20.783257+0000","objects_scrubbed":7,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T22:56:09.007093+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6659325,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":108,"num_read_kb":2222,"num_write":295,"num_write_kb":32111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,1],"acting":[4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":503,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:21.932598+0000","last_change":"2024-06-04T16:23:21.932637+0000","last_active":"2024-06-04T16:23:21.932598+0000","last_peered":"2024-06-04T16:23:21.932598+0000","last_clean":"2024-06-04T16:23:21.932598+0000","last_became_active":"2024-06-04T15:52:22.428894+0000","last_became_peered":"2024-06-04T15:52:22.428894+0000","last_unstale":"2024-06-04T16:23:21.932598+0000","last_undegraded":"2024-06-04T16:23:21.932598+0000","last_fullsized":"2024-06-04T16:23:21.932598+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:23:21.932495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:23:21.932495+0000","last_clean_scrub_stamp":"2024-06-04T16:23:21.932495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T02:09:01.019445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":486,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:04.014754+0000","last_change":"2024-06-04T16:23:04.014781+0000","last_active":"2024-06-04T16:23:04.014754+0000","last_peered":"2024-06-04T16:23:04.014754+0000","last_clean":"2024-06-04T16:23:04.014754+0000","last_became_active":"2024-06-04T15:52:40.478970+0000","last_became_peered":"2024-06-04T15:52:40.478970+0000","last_unstale":"2024-06-04T16:23:04.014754+0000","last_undegraded":"2024-06-04T16:23:04.014754+0000","last_fullsized":"2024-06-04T16:23:04.014754+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:23:04.014648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:23:04.014648+0000","last_clean_scrub_stamp":"2024-06-04T16:23:04.014648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T00:47:22.385623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"254'260","reported_seq":953,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:59.781740+0000","last_change":"2024-06-04T16:22:59.781790+0000","last_active":"2024-06-04T16:22:59.781740+0000","last_peered":"2024-06-04T16:22:59.781740+0000","last_clean":"2024-06-04T16:22:59.781740+0000","last_became_active":"2024-06-04T15:52:42.504735+0000","last_became_peered":"2024-06-04T15:52:42.504735+0000","last_unstale":"2024-06-04T16:22:59.781740+0000","last_undegraded":"2024-06-04T16:22:59.781740+0000","last_fullsized":"2024-06-04T16:22:59.781740+0000","mapping_epoch":27,"log_start":"251'200","ondisk_log_start":"251'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'260","last_scrub_stamp":"2024-06-04T16:22:59.781648+0000","last_deep_scrub":"254'260","last_deep_scrub_stamp":"2024-06-04T16:22:59.781648+0000","last_clean_scrub_stamp":"2024-06-04T16:22:59.781648+0000","objects_scrubbed":8,"log_size":60,"log_dups_size":200,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T20:43:24.750395+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20543,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":406,"num_read_kb":567,"num_write":188,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":477,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:50.024396+0000","last_change":"2024-06-04T16:22:50.024418+0000","last_active":"2024-06-04T16:22:50.024396+0000","last_peered":"2024-06-04T16:22:50.024396+0000","last_clean":"2024-06-04T16:22:50.024396+0000","last_became_active":"2024-06-04T15:52:44.522746+0000","last_became_peered":"2024-06-04T15:52:44.522746+0000","last_unstale":"2024-06-04T16:22:50.024396+0000","last_undegraded":"2024-06-04T16:22:50.024396+0000","last_fullsized":"2024-06-04T16:22:50.024396+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:22:50.024298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:22:50.024298+0000","last_clean_scrub_stamp":"2024-06-04T16:22:50.024298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T19:45:37.463155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.d","version":"254'30","reported_seq":511,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:56.543517+0000","last_change":"2024-06-04T16:22:56.543557+0000","last_active":"2024-06-04T16:22:56.543517+0000","last_peered":"2024-06-04T16:22:56.543517+0000","last_clean":"2024-06-04T16:22:56.543517+0000","last_became_active":"2024-06-04T15:52:46.530480+0000","last_became_peered":"2024-06-04T15:52:46.530480+0000","last_unstale":"2024-06-04T16:22:56.543517+0000","last_undegraded":"2024-06-04T16:22:56.543517+0000","last_fullsized":"2024-06-04T16:22:56.543517+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'30","last_scrub_stamp":"2024-06-04T16:22:56.543418+0000","last_deep_scrub":"254'30","last_deep_scrub_stamp":"2024-06-04T16:22:56.543418+0000","last_clean_scrub_stamp":"2024-06-04T16:22:56.543418+0000","objects_scrubbed":4,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T22:30:49.547884+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":260,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":42,"num_read_kb":31,"num_write":58,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"254'175","reported_seq":1014,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:07.031511+0000","last_change":"2024-06-04T16:23:07.031557+0000","last_active":"2024-06-04T16:23:07.031511+0000","last_peered":"2024-06-04T16:23:07.031511+0000","last_clean":"2024-06-04T16:23:07.031511+0000","last_became_active":"2024-06-04T15:52:38.484384+0000","last_became_peered":"2024-06-04T15:52:38.484384+0000","last_unstale":"2024-06-04T16:23:07.031511+0000","last_undegraded":"2024-06-04T16:23:07.031511+0000","last_fullsized":"2024-06-04T16:23:07.031511+0000","mapping_epoch":23,"log_start":"251'100","ondisk_log_start":"251'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'175","last_scrub_stamp":"2024-06-04T16:23:07.031386+0000","last_deep_scrub":"254'175","last_deep_scrub_stamp":"2024-06-04T16:23:07.031386+0000","last_clean_scrub_stamp":"2024-06-04T16:23:07.031386+0000","objects_scrubbed":2,"log_size":75,"log_dups_size":100,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T20:37:48.413121+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":881,"num_read_kb":808,"num_write":233,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"251'46","reported_seq":553,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:19.818127+0000","last_change":"2024-06-04T16:23:19.818176+0000","last_active":"2024-06-04T16:23:19.818127+0000","last_peered":"2024-06-04T16:23:19.818127+0000","last_clean":"2024-06-04T16:23:19.818127+0000","last_became_active":"2024-06-04T15:52:36.477622+0000","last_became_peered":"2024-06-04T15:52:36.477622+0000","last_unstale":"2024-06-04T16:23:19.818127+0000","last_undegraded":"2024-06-04T16:23:19.818127+0000","last_fullsized":"2024-06-04T16:23:19.818127+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"251'46","last_scrub_stamp":"2024-06-04T16:23:19.818027+0000","last_deep_scrub":"251'46","last_deep_scrub_stamp":"2024-06-04T16:23:19.818027+0000","last_clean_scrub_stamp":"2024-06-04T16:23:19.818027+0000","objects_scrubbed":2,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T01:44:44.151511+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":45,"num_write":152,"num_write_kb":28742,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":501,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:13.531823+0000","last_change":"2024-06-04T16:23:13.531852+0000","last_active":"2024-06-04T16:23:13.531823+0000","last_peered":"2024-06-04T16:23:13.531823+0000","last_clean":"2024-06-04T16:23:13.531823+0000","last_became_active":"2024-06-04T15:52:22.776744+0000","last_became_peered":"2024-06-04T15:52:22.776744+0000","last_unstale":"2024-06-04T16:23:13.531823+0000","last_undegraded":"2024-06-04T16:23:13.531823+0000","last_fullsized":"2024-06-04T16:23:13.531823+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:23:13.531727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:23:13.531727+0000","last_clean_scrub_stamp":"2024-06-04T16:23:13.531727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T02:54:14.681403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":484,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:17.764990+0000","last_change":"2024-06-04T16:23:17.765013+0000","last_active":"2024-06-04T16:23:17.764990+0000","last_peered":"2024-06-04T16:23:17.764990+0000","last_clean":"2024-06-04T16:23:17.764990+0000","last_became_active":"2024-06-04T15:52:40.479319+0000","last_became_peered":"2024-06-04T15:52:40.479319+0000","last_unstale":"2024-06-04T16:23:17.764990+0000","last_undegraded":"2024-06-04T16:23:17.764990+0000","last_fullsized":"2024-06-04T16:23:17.764990+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:23:17.764897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:23:17.764897+0000","last_clean_scrub_stamp":"2024-06-04T16:23:17.764897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T03:01:34.933351+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"254'71","reported_seq":581,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:08.851094+0000","last_change":"2024-06-04T16:23:08.851129+0000","last_active":"2024-06-04T16:23:08.851094+0000","last_peered":"2024-06-04T16:23:08.851094+0000","last_clean":"2024-06-04T16:23:08.851094+0000","last_became_active":"2024-06-04T15:52:42.500141+0000","last_became_peered":"2024-06-04T15:52:42.500141+0000","last_unstale":"2024-06-04T16:23:08.851094+0000","last_undegraded":"2024-06-04T16:23:08.851094+0000","last_fullsized":"2024-06-04T16:23:08.851094+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'71","last_scrub_stamp":"2024-06-04T16:23:08.851023+0000","last_deep_scrub":"254'71","last_deep_scrub_stamp":"2024-06-04T16:23:08.851023+0000","last_clean_scrub_stamp":"2024-06-04T16:23:08.851023+0000","objects_scrubbed":5,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T17:00:06.961504+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":90,"num_read_kb":83,"num_write":60,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"254'479","reported_seq":1483,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:09.402056+0000","last_change":"2024-06-04T16:23:09.402109+0000","last_active":"2024-06-04T16:23:09.402056+0000","last_peered":"2024-06-04T16:23:09.402056+0000","last_clean":"2024-06-04T16:23:09.402056+0000","last_became_active":"2024-06-04T15:52:44.517202+0000","last_became_peered":"2024-06-04T15:52:44.517202+0000","last_unstale":"2024-06-04T16:23:09.402056+0000","last_undegraded":"2024-06-04T16:23:09.402056+0000","last_fullsized":"2024-06-04T16:23:09.402056+0000","mapping_epoch":29,"log_start":"251'400","ondisk_log_start":"251'400","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'479","last_scrub_stamp":"2024-06-04T16:23:09.401953+0000","last_deep_scrub":"254'479","last_deep_scrub_stamp":"2024-06-04T16:23:09.401953+0000","last_clean_scrub_stamp":"2024-06-04T16:23:09.401953+0000","objects_scrubbed":1,"log_size":79,"log_dups_size":400,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T02:11:03.216134+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.c","version":"254'27","reported_seq":504,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:01.472577+0000","last_change":"2024-06-04T16:23:01.472605+0000","last_active":"2024-06-04T16:23:01.472577+0000","last_peered":"2024-06-04T16:23:01.472577+0000","last_clean":"2024-06-04T16:23:01.472577+0000","last_became_active":"2024-06-04T15:52:46.538975+0000","last_became_peered":"2024-06-04T15:52:46.538975+0000","last_unstale":"2024-06-04T16:23:01.472577+0000","last_undegraded":"2024-06-04T16:23:01.472577+0000","last_fullsized":"2024-06-04T16:23:01.472577+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'27","last_scrub_stamp":"2024-06-04T16:23:01.472476+0000","last_deep_scrub":"254'27","last_deep_scrub_stamp":"2024-06-04T16:23:01.472476+0000","last_clean_scrub_stamp":"2024-06-04T16:23:01.472476+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T19:18:35.432866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":27,"num_write":64,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3","version":"254'180","reported_seq":1075,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:05.040707+0000","last_change":"2024-06-04T16:23:05.040749+0000","last_active":"2024-06-04T16:23:05.040707+0000","last_peered":"2024-06-04T16:23:05.040707+0000","last_clean":"2024-06-04T16:23:05.040707+0000","last_became_active":"2024-06-04T15:52:38.482240+0000","last_became_peered":"2024-06-04T15:52:38.482240+0000","last_unstale":"2024-06-04T16:23:05.040707+0000","last_undegraded":"2024-06-04T16:23:05.040707+0000","last_fullsized":"2024-06-04T16:23:05.040707+0000","mapping_epoch":23,"log_start":"251'100","ondisk_log_start":"251'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'180","last_scrub_stamp":"2024-06-04T16:23:05.040592+0000","last_deep_scrub":"254'180","last_deep_scrub_stamp":"2024-06-04T16:23:05.040592+0000","last_clean_scrub_stamp":"2024-06-04T16:23:05.040592+0000","objects_scrubbed":1,"log_size":80,"log_dups_size":100,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T23:58:37.248398+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1045,"num_read_kb":968,"num_write":230,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2044,"num_omap_keys":8,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"251'34","reported_seq":533,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:12.049957+0000","last_change":"2024-06-04T16:23:12.049996+0000","last_active":"2024-06-04T16:23:12.049957+0000","last_peered":"2024-06-04T16:23:12.049957+0000","last_clean":"2024-06-04T16:23:12.049957+0000","last_became_active":"2024-06-04T15:52:36.478441+0000","last_became_peered":"2024-06-04T15:52:36.478441+0000","last_unstale":"2024-06-04T16:23:12.049957+0000","last_undegraded":"2024-06-04T16:23:12.049957+0000","last_fullsized":"2024-06-04T16:23:12.049957+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"251'34","last_scrub_stamp":"2024-06-04T16:23:12.049852+0000","last_deep_scrub":"251'34","last_deep_scrub_stamp":"2024-06-04T16:23:12.049852+0000","last_clean_scrub_stamp":"2024-06-04T16:23:12.049852+0000","objects_scrubbed":1,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T20:47:21.445706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":32,"num_read_kb":7500,"num_write":131,"num_write_kb":23723,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,4],"acting":[6,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":494,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:40.034928+0000","last_change":"2024-06-04T15:52:22.777126+0000","last_active":"2024-06-04T16:22:40.034928+0000","last_peered":"2024-06-04T16:22:40.034928+0000","last_clean":"2024-06-04T16:22:40.034928+0000","last_became_active":"2024-06-04T15:52:22.776729+0000","last_became_peered":"2024-06-04T15:52:22.776729+0000","last_unstale":"2024-06-04T16:22:40.034928+0000","last_undegraded":"2024-06-04T16:22:40.034928+0000","last_fullsized":"2024-06-04T16:22:40.034928+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:21.400880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:21.400880+0000","last_clean_scrub_stamp":"2024-06-04T15:52:21.400880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":487,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:49.871886+0000","last_change":"2024-06-04T16:22:49.871915+0000","last_active":"2024-06-04T16:22:49.871886+0000","last_peered":"2024-06-04T16:22:49.871886+0000","last_clean":"2024-06-04T16:22:49.871886+0000","last_became_active":"2024-06-04T15:52:40.481870+0000","last_became_peered":"2024-06-04T15:52:40.481870+0000","last_unstale":"2024-06-04T16:22:49.871886+0000","last_undegraded":"2024-06-04T16:22:49.871886+0000","last_fullsized":"2024-06-04T16:22:49.871886+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:22:49.871770+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:22:49.871770+0000","last_clean_scrub_stamp":"2024-06-04T16:22:49.871770+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T03:25:40.274941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"254'107","reported_seq":635,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:00.026044+0000","last_change":"2024-06-04T16:23:00.026083+0000","last_active":"2024-06-04T16:23:00.026044+0000","last_peered":"2024-06-04T16:23:00.026044+0000","last_clean":"2024-06-04T16:23:00.026044+0000","last_became_active":"2024-06-04T15:52:42.501708+0000","last_became_peered":"2024-06-04T15:52:42.501708+0000","last_unstale":"2024-06-04T16:23:00.026044+0000","last_undegraded":"2024-06-04T16:23:00.026044+0000","last_fullsized":"2024-06-04T16:23:00.026044+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'107","last_scrub_stamp":"2024-06-04T16:23:00.025948+0000","last_deep_scrub":"254'107","last_deep_scrub_stamp":"2024-06-04T16:23:00.025948+0000","last_clean_scrub_stamp":"2024-06-04T16:23:00.025948+0000","objects_scrubbed":8,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T18:12:41.006932+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":147,"num_read_kb":140,"num_write":98,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":330,"num_omap_keys":2,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.0","version":"254'471","reported_seq":1659,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:22.395221+0000","last_change":"2024-06-04T16:23:22.395256+0000","last_active":"2024-06-04T16:23:22.395221+0000","last_peered":"2024-06-04T16:23:22.395221+0000","last_clean":"2024-06-04T16:23:22.395221+0000","last_became_active":"2024-06-04T15:52:44.517066+0000","last_became_peered":"2024-06-04T15:52:44.517066+0000","last_unstale":"2024-06-04T16:23:22.395221+0000","last_undegraded":"2024-06-04T16:23:22.395221+0000","last_fullsized":"2024-06-04T16:23:22.395221+0000","mapping_epoch":29,"log_start":"251'400","ondisk_log_start":"251'400","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'471","last_scrub_stamp":"2024-06-04T16:23:22.395095+0000","last_deep_scrub":"254'471","last_deep_scrub_stamp":"2024-06-04T16:23:22.395095+0000","last_clean_scrub_stamp":"2024-06-04T16:23:22.395095+0000","objects_scrubbed":1,"log_size":71,"log_dups_size":400,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T02:14:58.949166+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"254'29","reported_seq":504,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:17.959292+0000","last_change":"2024-06-04T16:23:17.959328+0000","last_active":"2024-06-04T16:23:17.959292+0000","last_peered":"2024-06-04T16:23:17.959292+0000","last_clean":"2024-06-04T16:23:17.959292+0000","last_became_active":"2024-06-04T15:52:46.531967+0000","last_became_peered":"2024-06-04T15:52:46.531967+0000","last_unstale":"2024-06-04T16:23:17.959292+0000","last_undegraded":"2024-06-04T16:23:17.959292+0000","last_fullsized":"2024-06-04T16:23:17.959292+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'29","last_scrub_stamp":"2024-06-04T16:23:17.959201+0000","last_deep_scrub":"254'29","last_deep_scrub_stamp":"2024-06-04T16:23:17.959201+0000","last_clean_scrub_stamp":"2024-06-04T16:23:17.959201+0000","objects_scrubbed":2,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T21:13:41.813947+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":905,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":28,"num_read_kb":26,"num_write":64,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2","version":"254'131","reported_seq":939,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:11.028265+0000","last_change":"2024-06-04T16:23:11.028292+0000","last_active":"2024-06-04T16:23:11.028265+0000","last_peered":"2024-06-04T16:23:11.028265+0000","last_clean":"2024-06-04T16:23:11.028265+0000","last_became_active":"2024-06-04T15:52:38.480942+0000","last_became_peered":"2024-06-04T15:52:38.480942+0000","last_unstale":"2024-06-04T16:23:11.028265+0000","last_undegraded":"2024-06-04T16:23:11.028265+0000","last_fullsized":"2024-06-04T16:23:11.028265+0000","mapping_epoch":23,"log_start":"251'100","ondisk_log_start":"251'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'131","last_scrub_stamp":"2024-06-04T16:23:11.028175+0000","last_deep_scrub":"254'131","last_deep_scrub_stamp":"2024-06-04T16:23:11.028175+0000","last_clean_scrub_stamp":"2024-06-04T16:23:11.028175+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T16:52:05.710781+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":705,"num_read_kb":672,"num_write":147,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"251'54","reported_seq":568,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:17.647698+0000","last_change":"2024-06-04T16:23:17.647777+0000","last_active":"2024-06-04T16:23:17.647698+0000","last_peered":"2024-06-04T16:23:17.647698+0000","last_clean":"2024-06-04T16:23:17.647698+0000","last_became_active":"2024-06-04T15:52:36.480469+0000","last_became_peered":"2024-06-04T15:52:36.480469+0000","last_unstale":"2024-06-04T16:23:17.647698+0000","last_undegraded":"2024-06-04T16:23:17.647698+0000","last_fullsized":"2024-06-04T16:23:17.647698+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"251'54","last_scrub_stamp":"2024-06-04T16:23:17.647552+0000","last_deep_scrub":"251'54","last_deep_scrub_stamp":"2024-06-04T16:23:17.647552+0000","last_clean_scrub_stamp":"2024-06-04T16:23:17.647552+0000","objects_scrubbed":4,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T21:56:03.180708+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":69,"num_read_kb":32811,"num_write":225,"num_write_kb":30438,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,4],"acting":[2,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":504,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:15.344159+0000","last_change":"2024-06-04T16:23:15.344203+0000","last_active":"2024-06-04T16:23:15.344159+0000","last_peered":"2024-06-04T16:23:15.344159+0000","last_clean":"2024-06-04T16:23:15.344159+0000","last_became_active":"2024-06-04T15:52:22.776723+0000","last_became_peered":"2024-06-04T15:52:22.776723+0000","last_unstale":"2024-06-04T16:23:15.344159+0000","last_undegraded":"2024-06-04T16:23:15.344159+0000","last_fullsized":"2024-06-04T16:23:15.344159+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:23:15.344049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:23:15.344049+0000","last_clean_scrub_stamp":"2024-06-04T16:23:15.344049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T01:59:22.762947+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":485,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:12.004707+0000","last_change":"2024-06-04T16:23:12.004747+0000","last_active":"2024-06-04T16:23:12.004707+0000","last_peered":"2024-06-04T16:23:12.004707+0000","last_clean":"2024-06-04T16:23:12.004707+0000","last_became_active":"2024-06-04T15:52:40.483802+0000","last_became_peered":"2024-06-04T15:52:40.483802+0000","last_unstale":"2024-06-04T16:23:12.004707+0000","last_undegraded":"2024-06-04T16:23:12.004707+0000","last_fullsized":"2024-06-04T16:23:12.004707+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:23:12.004597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:23:12.004597+0000","last_clean_scrub_stamp":"2024-06-04T16:23:12.004597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T18:00:54.931037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"254'207","reported_seq":842,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:07.012392+0000","last_change":"2024-06-04T16:23:07.012433+0000","last_active":"2024-06-04T16:23:07.012392+0000","last_peered":"2024-06-04T16:23:07.012392+0000","last_clean":"2024-06-04T16:23:07.012392+0000","last_became_active":"2024-06-04T15:52:42.499002+0000","last_became_peered":"2024-06-04T15:52:42.499002+0000","last_unstale":"2024-06-04T16:23:07.012392+0000","last_undegraded":"2024-06-04T16:23:07.012392+0000","last_fullsized":"2024-06-04T16:23:07.012392+0000","mapping_epoch":27,"log_start":"251'100","ondisk_log_start":"251'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'207","last_scrub_stamp":"2024-06-04T16:23:07.012304+0000","last_deep_scrub":"254'207","last_deep_scrub_stamp":"2024-06-04T16:23:07.012304+0000","last_clean_scrub_stamp":"2024-06-04T16:23:07.012304+0000","objects_scrubbed":8,"log_size":107,"log_dups_size":100,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T19:16:17.106023+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20869,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":311,"num_read_kb":405,"num_write":154,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":475,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:11.557012+0000","last_change":"2024-06-04T16:23:11.557058+0000","last_active":"2024-06-04T16:23:11.557012+0000","last_peered":"2024-06-04T16:23:11.557012+0000","last_clean":"2024-06-04T16:23:11.557012+0000","last_became_active":"2024-06-04T15:52:44.520499+0000","last_became_peered":"2024-06-04T15:52:44.520499+0000","last_unstale":"2024-06-04T16:23:11.557012+0000","last_undegraded":"2024-06-04T16:23:11.557012+0000","last_fullsized":"2024-06-04T16:23:11.557012+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:23:11.556903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:23:11.556903+0000","last_clean_scrub_stamp":"2024-06-04T16:23:11.556903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T18:43:13.942573+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"254'25","reported_seq":507,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:56.551415+0000","last_change":"2024-06-04T16:22:56.551443+0000","last_active":"2024-06-04T16:22:56.551415+0000","last_peered":"2024-06-04T16:22:56.551415+0000","last_clean":"2024-06-04T16:22:56.551415+0000","last_became_active":"2024-06-04T15:52:46.541768+0000","last_became_peered":"2024-06-04T15:52:46.541768+0000","last_unstale":"2024-06-04T16:22:56.551415+0000","last_undegraded":"2024-06-04T16:22:56.551415+0000","last_fullsized":"2024-06-04T16:22:56.551415+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'25","last_scrub_stamp":"2024-06-04T16:22:56.551310+0000","last_deep_scrub":"254'25","last_deep_scrub_stamp":"2024-06-04T16:22:56.551310+0000","last_clean_scrub_stamp":"2024-06-04T16:22:56.551310+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T20:49:59.699028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":34,"num_write":60,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"254'25","reported_seq":499,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:46.017545+0000","last_change":"2024-06-04T16:22:46.017610+0000","last_active":"2024-06-04T16:22:46.017545+0000","last_peered":"2024-06-04T16:22:46.017545+0000","last_clean":"2024-06-04T16:22:46.017545+0000","last_became_active":"2024-06-04T15:52:46.540733+0000","last_became_peered":"2024-06-04T15:52:46.540733+0000","last_unstale":"2024-06-04T16:22:46.017545+0000","last_undegraded":"2024-06-04T16:22:46.017545+0000","last_fullsized":"2024-06-04T16:22:46.017545+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'25","last_scrub_stamp":"2024-06-04T16:22:46.017439+0000","last_deep_scrub":"254'25","last_deep_scrub_stamp":"2024-06-04T16:22:46.017439+0000","last_clean_scrub_stamp":"2024-06-04T16:22:46.017439+0000","objects_scrubbed":1,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T04:03:05.233942+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":53,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"254'152","reported_seq":927,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:10.521391+0000","last_change":"2024-06-04T16:23:10.521419+0000","last_active":"2024-06-04T16:23:10.521391+0000","last_peered":"2024-06-04T16:23:10.521391+0000","last_clean":"2024-06-04T16:23:10.521391+0000","last_became_active":"2024-06-04T15:52:38.479929+0000","last_became_peered":"2024-06-04T15:52:38.479929+0000","last_unstale":"2024-06-04T16:23:10.521391+0000","last_undegraded":"2024-06-04T16:23:10.521391+0000","last_fullsized":"2024-06-04T16:23:10.521391+0000","mapping_epoch":23,"log_start":"251'100","ondisk_log_start":"251'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'152","last_scrub_stamp":"2024-06-04T16:23:10.521305+0000","last_deep_scrub":"254'152","last_deep_scrub_stamp":"2024-06-04T16:23:10.521305+0000","last_clean_scrub_stamp":"2024-06-04T16:23:10.521305+0000","objects_scrubbed":1,"log_size":52,"log_dups_size":100,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T19:41:35.254224+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":770,"num_read_kb":699,"num_write":204,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"251'34","reported_seq":547,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:45.076895+0000","last_change":"2024-06-04T15:52:36.497838+0000","last_active":"2024-06-04T16:22:45.076895+0000","last_peered":"2024-06-04T16:22:45.076895+0000","last_clean":"2024-06-04T16:22:45.076895+0000","last_became_active":"2024-06-04T15:52:36.497532+0000","last_became_peered":"2024-06-04T15:52:36.497532+0000","last_unstale":"2024-06-04T16:22:45.076895+0000","last_undegraded":"2024-06-04T16:22:45.076895+0000","last_fullsized":"2024-06-04T16:22:45.076895+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":54,"num_read_kb":42110,"num_write":160,"num_write_kb":16147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":480,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:57.091636+0000","last_change":"2024-06-04T16:22:57.091636+0000","last_active":"2024-06-04T16:22:57.091636+0000","last_peered":"2024-06-04T16:22:57.091636+0000","last_clean":"2024-06-04T16:22:57.091636+0000","last_became_active":"2024-06-04T15:52:40.483882+0000","last_became_peered":"2024-06-04T15:52:40.483882+0000","last_unstale":"2024-06-04T16:22:57.091636+0000","last_undegraded":"2024-06-04T16:22:57.091636+0000","last_fullsized":"2024-06-04T16:22:57.091636+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:22:57.091516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:22:57.091516+0000","last_clean_scrub_stamp":"2024-06-04T16:22:57.091516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T21:23:38.905655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.11","version":"254'100","reported_seq":648,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:08.013627+0000","last_change":"2024-06-04T16:23:08.013676+0000","last_active":"2024-06-04T16:23:08.013627+0000","last_peered":"2024-06-04T16:23:08.013627+0000","last_clean":"2024-06-04T16:23:08.013627+0000","last_became_active":"2024-06-04T15:52:42.504144+0000","last_became_peered":"2024-06-04T15:52:42.504144+0000","last_unstale":"2024-06-04T16:23:08.013627+0000","last_undegraded":"2024-06-04T16:23:08.013627+0000","last_fullsized":"2024-06-04T16:23:08.013627+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'100","last_scrub_stamp":"2024-06-04T16:23:08.013535+0000","last_deep_scrub":"254'100","last_deep_scrub_stamp":"2024-06-04T16:23:08.013535+0000","last_clean_scrub_stamp":"2024-06-04T16:23:08.013535+0000","objects_scrubbed":5,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T23:33:08.492272+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13519,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":145,"num_read_kb":205,"num_write":70,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":476,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:08.030159+0000","last_change":"2024-06-04T16:23:08.030181+0000","last_active":"2024-06-04T16:23:08.030159+0000","last_peered":"2024-06-04T16:23:08.030159+0000","last_clean":"2024-06-04T16:23:08.030159+0000","last_became_active":"2024-06-04T15:52:44.517718+0000","last_became_peered":"2024-06-04T15:52:44.517718+0000","last_unstale":"2024-06-04T16:23:08.030159+0000","last_undegraded":"2024-06-04T16:23:08.030159+0000","last_fullsized":"2024-06-04T16:23:08.030159+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:23:08.030076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:23:08.030076+0000","last_clean_scrub_stamp":"2024-06-04T16:23:08.030076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T00:47:56.220482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1e","version":"254'42","reported_seq":513,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:46.972568+0000","last_change":"2024-06-04T15:52:46.537867+0000","last_active":"2024-06-04T16:22:46.972568+0000","last_peered":"2024-06-04T16:22:46.972568+0000","last_clean":"2024-06-04T16:22:46.972568+0000","last_became_active":"2024-06-04T15:52:46.536917+0000","last_became_peered":"2024-06-04T15:52:46.536917+0000","last_unstale":"2024-06-04T16:22:46.972568+0000","last_undegraded":"2024-06-04T16:22:46.972568+0000","last_fullsized":"2024-06-04T16:22:46.972568+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:45.513877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:45.513877+0000","last_clean_scrub_stamp":"2024-06-04T15:52:45.513877+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":42,"num_write":101,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"254'152","reported_seq":994,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:02.977888+0000","last_change":"2024-06-04T16:23:02.977952+0000","last_active":"2024-06-04T16:23:02.977888+0000","last_peered":"2024-06-04T16:23:02.977888+0000","last_clean":"2024-06-04T16:23:02.977888+0000","last_became_active":"2024-06-04T15:52:38.488159+0000","last_became_peered":"2024-06-04T15:52:38.488159+0000","last_unstale":"2024-06-04T16:23:02.977888+0000","last_undegraded":"2024-06-04T16:23:02.977888+0000","last_fullsized":"2024-06-04T16:23:02.977888+0000","mapping_epoch":23,"log_start":"251'100","ondisk_log_start":"251'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'152","last_scrub_stamp":"2024-06-04T16:23:02.977774+0000","last_deep_scrub":"254'152","last_deep_scrub_stamp":"2024-06-04T16:23:02.977774+0000","last_clean_scrub_stamp":"2024-06-04T16:23:02.977774+0000","objects_scrubbed":1,"log_size":52,"log_dups_size":100,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T04:09:24.513394+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":952,"num_read_kb":891,"num_write":194,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.15","version":"251'69","reported_seq":612,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:08.764588+0000","last_change":"2024-06-04T16:23:08.764663+0000","last_active":"2024-06-04T16:23:08.764588+0000","last_peered":"2024-06-04T16:23:08.764588+0000","last_clean":"2024-06-04T16:23:08.764588+0000","last_became_active":"2024-06-04T15:52:36.492503+0000","last_became_peered":"2024-06-04T15:52:36.492503+0000","last_unstale":"2024-06-04T16:23:08.764588+0000","last_undegraded":"2024-06-04T16:23:08.764588+0000","last_fullsized":"2024-06-04T16:23:08.764588+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"251'69","last_scrub_stamp":"2024-06-04T16:23:08.764479+0000","last_deep_scrub":"251'69","last_deep_scrub_stamp":"2024-06-04T16:23:08.764479+0000","last_clean_scrub_stamp":"2024-06-04T16:23:08.764479+0000","objects_scrubbed":6,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T20:05:58.412567+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":528536,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":128,"num_read_kb":6583,"num_write":319,"num_write_kb":16503,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,3],"acting":[0,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":484,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:13.965080+0000","last_change":"2024-06-04T16:23:13.965111+0000","last_active":"2024-06-04T16:23:13.965080+0000","last_peered":"2024-06-04T16:23:13.965080+0000","last_clean":"2024-06-04T16:23:13.965080+0000","last_became_active":"2024-06-04T15:52:40.484480+0000","last_became_peered":"2024-06-04T15:52:40.484480+0000","last_unstale":"2024-06-04T16:23:13.965080+0000","last_undegraded":"2024-06-04T16:23:13.965080+0000","last_fullsized":"2024-06-04T16:23:13.965080+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:23:13.964982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:23:13.964982+0000","last_clean_scrub_stamp":"2024-06-04T16:23:13.964982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T04:13:27.946132+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"254'21","reported_seq":507,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:01.000179+0000","last_change":"2024-06-04T16:23:01.000179+0000","last_active":"2024-06-04T16:23:01.000179+0000","last_peered":"2024-06-04T16:23:01.000179+0000","last_clean":"2024-06-04T16:23:01.000179+0000","last_became_active":"2024-06-04T15:52:42.499592+0000","last_became_peered":"2024-06-04T15:52:42.499592+0000","last_unstale":"2024-06-04T16:23:01.000179+0000","last_undegraded":"2024-06-04T16:23:01.000179+0000","last_fullsized":"2024-06-04T16:23:01.000179+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'21","last_scrub_stamp":"2024-06-04T16:23:01.000012+0000","last_deep_scrub":"254'21","last_deep_scrub_stamp":"2024-06-04T16:23:01.000012+0000","last_clean_scrub_stamp":"2024-06-04T16:23:01.000012+0000","objects_scrubbed":3,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T22:14:20.665186+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":19,"num_read_kb":17,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":294,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":474,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:09.485359+0000","last_change":"2024-06-04T16:23:09.485380+0000","last_active":"2024-06-04T16:23:09.485359+0000","last_peered":"2024-06-04T16:23:09.485359+0000","last_clean":"2024-06-04T16:23:09.485359+0000","last_became_active":"2024-06-04T15:52:44.519102+0000","last_became_peered":"2024-06-04T15:52:44.519102+0000","last_unstale":"2024-06-04T16:23:09.485359+0000","last_undegraded":"2024-06-04T16:23:09.485359+0000","last_fullsized":"2024-06-04T16:23:09.485359+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:23:09.485273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:23:09.485273+0000","last_clean_scrub_stamp":"2024-06-04T16:23:09.485273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T20:50:18.009284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"254'24","reported_seq":500,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:55.110607+0000","last_change":"2024-06-04T16:22:55.110633+0000","last_active":"2024-06-04T16:22:55.110607+0000","last_peered":"2024-06-04T16:22:55.110607+0000","last_clean":"2024-06-04T16:22:55.110607+0000","last_became_active":"2024-06-04T15:52:46.534277+0000","last_became_peered":"2024-06-04T15:52:46.534277+0000","last_unstale":"2024-06-04T16:22:55.110607+0000","last_undegraded":"2024-06-04T16:22:55.110607+0000","last_fullsized":"2024-06-04T16:22:55.110607+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'24","last_scrub_stamp":"2024-06-04T16:22:55.110517+0000","last_deep_scrub":"254'24","last_deep_scrub_stamp":"2024-06-04T16:22:55.110517+0000","last_clean_scrub_stamp":"2024-06-04T16:22:55.110517+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T18:12:16.411222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":38,"num_write":55,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"254'224","reported_seq":1048,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:12.970193+0000","last_change":"2024-06-04T16:23:12.970231+0000","last_active":"2024-06-04T16:23:12.970193+0000","last_peered":"2024-06-04T16:23:12.970193+0000","last_clean":"2024-06-04T16:23:12.970193+0000","last_became_active":"2024-06-04T15:52:38.481934+0000","last_became_peered":"2024-06-04T15:52:38.481934+0000","last_unstale":"2024-06-04T16:23:12.970193+0000","last_undegraded":"2024-06-04T16:23:12.970193+0000","last_fullsized":"2024-06-04T16:23:12.970193+0000","mapping_epoch":23,"log_start":"251'200","ondisk_log_start":"251'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'224","last_scrub_stamp":"2024-06-04T16:23:12.970097+0000","last_deep_scrub":"254'224","last_deep_scrub_stamp":"2024-06-04T16:23:12.970097+0000","last_clean_scrub_stamp":"2024-06-04T16:23:12.970097+0000","objects_scrubbed":3,"log_size":24,"log_dups_size":200,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T23:41:43.548804+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1128,"num_read_kb":983,"num_write":320,"num_write_kb":131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":811,"num_omap_keys":4,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.16","version":"251'39","reported_seq":537,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:16.624012+0000","last_change":"2024-06-04T16:23:16.624075+0000","last_active":"2024-06-04T16:23:16.624012+0000","last_peered":"2024-06-04T16:23:16.624012+0000","last_clean":"2024-06-04T16:23:16.624012+0000","last_became_active":"2024-06-04T15:52:36.480284+0000","last_became_peered":"2024-06-04T15:52:36.480284+0000","last_unstale":"2024-06-04T16:23:16.624012+0000","last_undegraded":"2024-06-04T16:23:16.624012+0000","last_fullsized":"2024-06-04T16:23:16.624012+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"251'39","last_scrub_stamp":"2024-06-04T16:23:16.623896+0000","last_deep_scrub":"251'39","last_deep_scrub_stamp":"2024-06-04T16:23:16.623896+0000","last_clean_scrub_stamp":"2024-06-04T16:23:16.623896+0000","objects_scrubbed":1,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T22:30:28.602372+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":37,"num_read_kb":1062,"num_write":155,"num_write_kb":20099,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4],"acting":[2,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":482,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:58.490367+0000","last_change":"2024-06-04T16:22:58.490367+0000","last_active":"2024-06-04T16:22:58.490367+0000","last_peered":"2024-06-04T16:22:58.490367+0000","last_clean":"2024-06-04T16:22:58.490367+0000","last_became_active":"2024-06-04T15:52:40.477609+0000","last_became_peered":"2024-06-04T15:52:40.477609+0000","last_unstale":"2024-06-04T16:22:58.490367+0000","last_undegraded":"2024-06-04T16:22:58.490367+0000","last_fullsized":"2024-06-04T16:22:58.490367+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:22:58.490254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:22:58.490254+0000","last_clean_scrub_stamp":"2024-06-04T16:22:58.490254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T03:58:39.460650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"254'137","reported_seq":704,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:09.075759+0000","last_change":"2024-06-04T16:23:09.075830+0000","last_active":"2024-06-04T16:23:09.075759+0000","last_peered":"2024-06-04T16:23:09.075759+0000","last_clean":"2024-06-04T16:23:09.075759+0000","last_became_active":"2024-06-04T15:52:42.496416+0000","last_became_peered":"2024-06-04T15:52:42.496416+0000","last_unstale":"2024-06-04T16:23:09.075759+0000","last_undegraded":"2024-06-04T16:23:09.075759+0000","last_fullsized":"2024-06-04T16:23:09.075759+0000","mapping_epoch":27,"log_start":"251'100","ondisk_log_start":"251'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'137","last_scrub_stamp":"2024-06-04T16:23:09.075655+0000","last_deep_scrub":"254'137","last_deep_scrub_stamp":"2024-06-04T16:23:09.075655+0000","last_clean_scrub_stamp":"2024-06-04T16:23:09.075655+0000","objects_scrubbed":5,"log_size":37,"log_dups_size":100,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T04:19:42.658569+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14747,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":196,"num_read_kb":272,"num_write":106,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":478,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:54.181551+0000","last_change":"2024-06-04T16:22:54.181551+0000","last_active":"2024-06-04T16:22:54.181551+0000","last_peered":"2024-06-04T16:22:54.181551+0000","last_clean":"2024-06-04T16:22:54.181551+0000","last_became_active":"2024-06-04T15:52:44.519837+0000","last_became_peered":"2024-06-04T15:52:44.519837+0000","last_unstale":"2024-06-04T16:22:54.181551+0000","last_undegraded":"2024-06-04T16:22:54.181551+0000","last_fullsized":"2024-06-04T16:22:54.181551+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:22:54.181389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:22:54.181389+0000","last_clean_scrub_stamp":"2024-06-04T16:22:54.181389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T19:26:26.634657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"254'18","reported_seq":489,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:48.034172+0000","last_change":"2024-06-04T16:22:48.034172+0000","last_active":"2024-06-04T16:22:48.034172+0000","last_peered":"2024-06-04T16:22:48.034172+0000","last_clean":"2024-06-04T16:22:48.034172+0000","last_became_active":"2024-06-04T15:52:46.529366+0000","last_became_peered":"2024-06-04T15:52:46.529366+0000","last_unstale":"2024-06-04T16:22:48.034172+0000","last_undegraded":"2024-06-04T16:22:48.034172+0000","last_fullsized":"2024-06-04T16:22:48.034172+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'18","last_scrub_stamp":"2024-06-04T16:22:48.034075+0000","last_deep_scrub":"254'18","last_deep_scrub_stamp":"2024-06-04T16:22:48.034075+0000","last_clean_scrub_stamp":"2024-06-04T16:22:48.034075+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T01:45:02.416352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":52,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"254'128","reported_seq":840,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:16.916618+0000","last_change":"2024-06-04T16:23:16.916659+0000","last_active":"2024-06-04T16:23:16.916618+0000","last_peered":"2024-06-04T16:23:16.916618+0000","last_clean":"2024-06-04T16:23:16.916618+0000","last_became_active":"2024-06-04T15:52:38.488622+0000","last_became_peered":"2024-06-04T15:52:38.488622+0000","last_unstale":"2024-06-04T16:23:16.916618+0000","last_undegraded":"2024-06-04T16:23:16.916618+0000","last_fullsized":"2024-06-04T16:23:16.916618+0000","mapping_epoch":23,"log_start":"251'100","ondisk_log_start":"251'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'128","last_scrub_stamp":"2024-06-04T16:23:16.916521+0000","last_deep_scrub":"254'128","last_deep_scrub_stamp":"2024-06-04T16:23:16.916521+0000","last_clean_scrub_stamp":"2024-06-04T16:23:16.916521+0000","objects_scrubbed":1,"log_size":28,"log_dups_size":100,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T03:05:56.416443+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":585,"num_read_kb":532,"num_write":156,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":248,"num_omap_keys":1,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"254'50","reported_seq":562,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:39.554816+0000","last_change":"2024-06-04T15:52:36.483764+0000","last_active":"2024-06-04T16:22:39.554816+0000","last_peered":"2024-06-04T16:22:39.554816+0000","last_clean":"2024-06-04T16:22:39.554816+0000","last_became_active":"2024-06-04T15:52:36.482733+0000","last_became_peered":"2024-06-04T15:52:36.482733+0000","last_unstale":"2024-06-04T16:22:39.554816+0000","last_undegraded":"2024-06-04T16:22:39.554816+0000","last_fullsized":"2024-06-04T16:22:39.554816+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133705,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":82,"num_read_kb":13463,"num_write":227,"num_write_kb":36279,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1],"acting":[5,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.11","version":"254'5","reported_seq":790,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:19.750795+0000","last_change":"2024-06-04T16:23:19.750825+0000","last_active":"2024-06-04T16:23:19.750795+0000","last_peered":"2024-06-04T16:23:19.750795+0000","last_clean":"2024-06-04T16:23:19.750795+0000","last_became_active":"2024-06-04T15:52:40.479002+0000","last_became_peered":"2024-06-04T15:52:40.479002+0000","last_unstale":"2024-06-04T16:23:19.750795+0000","last_undegraded":"2024-06-04T16:23:19.750795+0000","last_fullsized":"2024-06-04T16:23:19.750795+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'5","last_scrub_stamp":"2024-06-04T16:23:19.750708+0000","last_deep_scrub":"254'5","last_deep_scrub_stamp":"2024-06-04T16:23:19.750708+0000","last_clean_scrub_stamp":"2024-06-04T16:23:19.750708+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T18:35:30.453280+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":463,"num_read_kb":757,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"254'89","reported_seq":640,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:01.759191+0000","last_change":"2024-06-04T16:23:01.759191+0000","last_active":"2024-06-04T16:23:01.759191+0000","last_peered":"2024-06-04T16:23:01.759191+0000","last_clean":"2024-06-04T16:23:01.759191+0000","last_became_active":"2024-06-04T15:52:42.505955+0000","last_became_peered":"2024-06-04T15:52:42.505955+0000","last_unstale":"2024-06-04T16:23:01.759191+0000","last_undegraded":"2024-06-04T16:23:01.759191+0000","last_fullsized":"2024-06-04T16:23:01.759191+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'89","last_scrub_stamp":"2024-06-04T16:23:01.759061+0000","last_deep_scrub":"254'89","last_deep_scrub_stamp":"2024-06-04T16:23:01.759061+0000","last_clean_scrub_stamp":"2024-06-04T16:23:01.759061+0000","objects_scrubbed":4,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T18:04:48.914592+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":128,"num_read_kb":150,"num_write":58,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":476,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:15.906417+0000","last_change":"2024-06-04T16:23:15.906463+0000","last_active":"2024-06-04T16:23:15.906417+0000","last_peered":"2024-06-04T16:23:15.906417+0000","last_clean":"2024-06-04T16:23:15.906417+0000","last_became_active":"2024-06-04T15:52:44.519975+0000","last_became_peered":"2024-06-04T15:52:44.519975+0000","last_unstale":"2024-06-04T16:23:15.906417+0000","last_undegraded":"2024-06-04T16:23:15.906417+0000","last_fullsized":"2024-06-04T16:23:15.906417+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:23:15.906309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:23:15.906309+0000","last_clean_scrub_stamp":"2024-06-04T16:23:15.906309+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T02:21:45.561560+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1f","version":"254'93","reported_seq":774,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:21:50.029117+0000","last_change":"2024-06-04T15:52:38.485442+0000","last_active":"2024-06-04T16:21:50.029117+0000","last_peered":"2024-06-04T16:21:50.029117+0000","last_clean":"2024-06-04T16:21:50.029117+0000","last_became_active":"2024-06-04T15:52:38.485163+0000","last_became_peered":"2024-06-04T15:52:38.485163+0000","last_unstale":"2024-06-04T16:21:50.029117+0000","last_undegraded":"2024-06-04T16:21:50.029117+0000","last_fullsized":"2024-06-04T16:21:50.029117+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":477,"num_read_kb":443,"num_write":114,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"254'35","reported_seq":538,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:39.456392+0000","last_change":"2024-06-04T15:52:36.490918+0000","last_active":"2024-06-04T16:22:39.456392+0000","last_peered":"2024-06-04T16:22:39.456392+0000","last_clean":"2024-06-04T16:22:39.456392+0000","last_became_active":"2024-06-04T15:52:36.490297+0000","last_became_peered":"2024-06-04T15:52:36.490297+0000","last_unstale":"2024-06-04T16:22:39.456392+0000","last_undegraded":"2024-06-04T16:22:39.456392+0000","last_fullsized":"2024-06-04T16:22:39.456392+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1069164,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":53,"num_read_kb":1061,"num_write":121,"num_write_kb":15390,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,3],"acting":[5,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":482,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:59.048325+0000","last_change":"2024-06-04T16:22:59.048348+0000","last_active":"2024-06-04T16:22:59.048325+0000","last_peered":"2024-06-04T16:22:59.048325+0000","last_clean":"2024-06-04T16:22:59.048325+0000","last_became_active":"2024-06-04T15:52:40.482962+0000","last_became_peered":"2024-06-04T15:52:40.482962+0000","last_unstale":"2024-06-04T16:22:59.048325+0000","last_undegraded":"2024-06-04T16:22:59.048325+0000","last_fullsized":"2024-06-04T16:22:59.048325+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:22:59.048237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:22:59.048237+0000","last_clean_scrub_stamp":"2024-06-04T16:22:59.048237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T21:58:02.126251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"254'153","reported_seq":757,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:06.055514+0000","last_change":"2024-06-04T16:23:06.055560+0000","last_active":"2024-06-04T16:23:06.055514+0000","last_peered":"2024-06-04T16:23:06.055514+0000","last_clean":"2024-06-04T16:23:06.055514+0000","last_became_active":"2024-06-04T15:52:42.503246+0000","last_became_peered":"2024-06-04T15:52:42.503246+0000","last_unstale":"2024-06-04T16:23:06.055514+0000","last_undegraded":"2024-06-04T16:23:06.055514+0000","last_fullsized":"2024-06-04T16:23:06.055514+0000","mapping_epoch":27,"log_start":"251'100","ondisk_log_start":"251'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'153","last_scrub_stamp":"2024-06-04T16:23:06.055439+0000","last_deep_scrub":"254'153","last_deep_scrub_stamp":"2024-06-04T16:23:06.055439+0000","last_clean_scrub_stamp":"2024-06-04T16:23:06.055439+0000","objects_scrubbed":5,"log_size":53,"log_dups_size":100,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T00:59:17.824798+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8493,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":230,"num_read_kb":283,"num_write":98,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":473,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:07.432027+0000","last_change":"2024-06-04T16:23:07.432049+0000","last_active":"2024-06-04T16:23:07.432027+0000","last_peered":"2024-06-04T16:23:07.432027+0000","last_clean":"2024-06-04T16:23:07.432027+0000","last_became_active":"2024-06-04T15:52:44.517715+0000","last_became_peered":"2024-06-04T15:52:44.517715+0000","last_unstale":"2024-06-04T16:23:07.432027+0000","last_undegraded":"2024-06-04T16:23:07.432027+0000","last_fullsized":"2024-06-04T16:23:07.432027+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:23:07.431929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:23:07.431929+0000","last_clean_scrub_stamp":"2024-06-04T16:23:07.431929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T21:38:18.352137+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"254'74","reported_seq":562,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:03.466516+0000","last_change":"2024-06-04T16:23:03.466516+0000","last_active":"2024-06-04T16:23:03.466516+0000","last_peered":"2024-06-04T16:23:03.466516+0000","last_clean":"2024-06-04T16:23:03.466516+0000","last_became_active":"2024-06-04T15:52:46.538338+0000","last_became_peered":"2024-06-04T15:52:46.538338+0000","last_unstale":"2024-06-04T16:23:03.466516+0000","last_undegraded":"2024-06-04T16:23:03.466516+0000","last_fullsized":"2024-06-04T16:23:03.466516+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'74","last_scrub_stamp":"2024-06-04T16:23:03.466387+0000","last_deep_scrub":"254'74","last_deep_scrub_stamp":"2024-06-04T16:23:03.466387+0000","last_clean_scrub_stamp":"2024-06-04T16:23:03.466387+0000","objects_scrubbed":3,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T17:43:39.194556+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1061,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":107,"num_read_kb":120,"num_write":148,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1e","version":"254'145","reported_seq":924,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:11.005966+0000","last_change":"2024-06-04T16:23:11.006009+0000","last_active":"2024-06-04T16:23:11.005966+0000","last_peered":"2024-06-04T16:23:11.005966+0000","last_clean":"2024-06-04T16:23:11.005966+0000","last_became_active":"2024-06-04T15:52:38.484087+0000","last_became_peered":"2024-06-04T15:52:38.484087+0000","last_unstale":"2024-06-04T16:23:11.005966+0000","last_undegraded":"2024-06-04T16:23:11.005966+0000","last_fullsized":"2024-06-04T16:23:11.005966+0000","mapping_epoch":23,"log_start":"251'100","ondisk_log_start":"251'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'145","last_scrub_stamp":"2024-06-04T16:23:11.005877+0000","last_deep_scrub":"254'145","last_deep_scrub_stamp":"2024-06-04T16:23:11.005877+0000","last_clean_scrub_stamp":"2024-06-04T16:23:11.005877+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":100,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T22:18:10.083761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":710,"num_read_kb":650,"num_write":181,"num_write_kb":49,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"251'48","reported_seq":560,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:21.820350+0000","last_change":"2024-06-04T16:23:21.820386+0000","last_active":"2024-06-04T16:23:21.820350+0000","last_peered":"2024-06-04T16:23:21.820350+0000","last_clean":"2024-06-04T16:23:21.820350+0000","last_became_active":"2024-06-04T15:52:36.477626+0000","last_became_peered":"2024-06-04T15:52:36.477626+0000","last_unstale":"2024-06-04T16:23:21.820350+0000","last_undegraded":"2024-06-04T16:23:21.820350+0000","last_fullsized":"2024-06-04T16:23:21.820350+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"251'48","last_scrub_stamp":"2024-06-04T16:23:21.820253+0000","last_deep_scrub":"251'48","last_deep_scrub_stamp":"2024-06-04T16:23:21.820253+0000","last_clean_scrub_stamp":"2024-06-04T16:23:21.820253+0000","objects_scrubbed":2,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T21:31:34.108130+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20628,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":58,"num_read_kb":9358,"num_write":184,"num_write_kb":22886,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,1],"acting":[4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":483,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:01.495886+0000","last_change":"2024-06-04T16:23:01.495911+0000","last_active":"2024-06-04T16:23:01.495886+0000","last_peered":"2024-06-04T16:23:01.495886+0000","last_clean":"2024-06-04T16:23:01.495886+0000","last_became_active":"2024-06-04T15:52:40.484444+0000","last_became_peered":"2024-06-04T15:52:40.484444+0000","last_unstale":"2024-06-04T16:23:01.495886+0000","last_undegraded":"2024-06-04T16:23:01.495886+0000","last_fullsized":"2024-06-04T16:23:01.495886+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:23:01.495774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:23:01.495774+0000","last_clean_scrub_stamp":"2024-06-04T16:23:01.495774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T18:30:24.832332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"254'113","reported_seq":669,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:11.847562+0000","last_change":"2024-06-04T16:23:11.847607+0000","last_active":"2024-06-04T16:23:11.847562+0000","last_peered":"2024-06-04T16:23:11.847562+0000","last_clean":"2024-06-04T16:23:11.847562+0000","last_became_active":"2024-06-04T15:52:42.498329+0000","last_became_peered":"2024-06-04T15:52:42.498329+0000","last_unstale":"2024-06-04T16:23:11.847562+0000","last_undegraded":"2024-06-04T16:23:11.847562+0000","last_fullsized":"2024-06-04T16:23:11.847562+0000","mapping_epoch":27,"log_start":"251'100","ondisk_log_start":"251'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'113","last_scrub_stamp":"2024-06-04T16:23:11.847476+0000","last_deep_scrub":"254'113","last_deep_scrub_stamp":"2024-06-04T16:23:11.847476+0000","last_clean_scrub_stamp":"2024-06-04T16:23:11.847476+0000","objects_scrubbed":8,"log_size":13,"log_dups_size":100,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T16:54:36.931076+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":167,"num_read_kb":207,"num_write":102,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":11460,"num_omap_keys":24,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":477,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:04.428313+0000","last_change":"2024-06-04T16:23:04.428338+0000","last_active":"2024-06-04T16:23:04.428313+0000","last_peered":"2024-06-04T16:23:04.428313+0000","last_clean":"2024-06-04T16:23:04.428313+0000","last_became_active":"2024-06-04T15:52:44.523527+0000","last_became_peered":"2024-06-04T15:52:44.523527+0000","last_unstale":"2024-06-04T16:23:04.428313+0000","last_undegraded":"2024-06-04T16:23:04.428313+0000","last_fullsized":"2024-06-04T16:23:04.428313+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:23:04.428227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:23:04.428227+0000","last_clean_scrub_stamp":"2024-06-04T16:23:04.428227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T23:41:17.114473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.12","version":"254'33","reported_seq":519,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:45.120984+0000","last_change":"2024-06-04T16:22:45.120984+0000","last_active":"2024-06-04T16:22:45.120984+0000","last_peered":"2024-06-04T16:22:45.120984+0000","last_clean":"2024-06-04T16:22:45.120984+0000","last_became_active":"2024-06-04T15:52:46.537899+0000","last_became_peered":"2024-06-04T15:52:46.537899+0000","last_unstale":"2024-06-04T16:22:45.120984+0000","last_undegraded":"2024-06-04T16:22:45.120984+0000","last_fullsized":"2024-06-04T16:22:45.120984+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'33","last_scrub_stamp":"2024-06-04T16:22:45.120808+0000","last_deep_scrub":"254'33","last_deep_scrub_stamp":"2024-06-04T16:22:45.120808+0000","last_clean_scrub_stamp":"2024-06-04T16:22:45.120808+0000","objects_scrubbed":4,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T18:20:07.652176+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1228,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":67,"num_read_kb":65,"num_write":80,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"254'108","reported_seq":884,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:40.156395+0000","last_change":"2024-06-04T15:52:38.481130+0000","last_active":"2024-06-04T16:22:40.156395+0000","last_peered":"2024-06-04T16:22:40.156395+0000","last_clean":"2024-06-04T16:22:40.156395+0000","last_became_active":"2024-06-04T15:52:38.480458+0000","last_became_peered":"2024-06-04T15:52:38.480458+0000","last_unstale":"2024-06-04T16:22:40.156395+0000","last_undegraded":"2024-06-04T16:22:40.156395+0000","last_fullsized":"2024-06-04T16:22:40.156395+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":731,"num_read_kb":703,"num_write":125,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1a","version":"254'73","reported_seq":595,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:16.333696+0000","last_change":"2024-06-04T16:23:16.333779+0000","last_active":"2024-06-04T16:23:16.333696+0000","last_peered":"2024-06-04T16:23:16.333696+0000","last_clean":"2024-06-04T16:23:16.333696+0000","last_became_active":"2024-06-04T15:52:36.477885+0000","last_became_peered":"2024-06-04T15:52:36.477885+0000","last_unstale":"2024-06-04T16:23:16.333696+0000","last_undegraded":"2024-06-04T16:23:16.333696+0000","last_fullsized":"2024-06-04T16:23:16.333696+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'73","last_scrub_stamp":"2024-06-04T16:23:16.333565+0000","last_deep_scrub":"254'73","last_deep_scrub_stamp":"2024-06-04T16:23:16.333565+0000","last_clean_scrub_stamp":"2024-06-04T16:23:16.333565+0000","objects_scrubbed":5,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T02:47:04.293959+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1395842,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":88,"num_read_kb":3881,"num_write":289,"num_write_kb":29330,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":481,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:57.516834+0000","last_change":"2024-06-04T16:22:57.516894+0000","last_active":"2024-06-04T16:22:57.516834+0000","last_peered":"2024-06-04T16:22:57.516834+0000","last_clean":"2024-06-04T16:22:57.516834+0000","last_became_active":"2024-06-04T15:52:40.477924+0000","last_became_peered":"2024-06-04T15:52:40.477924+0000","last_unstale":"2024-06-04T16:22:57.516834+0000","last_undegraded":"2024-06-04T16:22:57.516834+0000","last_fullsized":"2024-06-04T16:22:57.516834+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:22:57.516723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:22:57.516723+0000","last_clean_scrub_stamp":"2024-06-04T16:22:57.516723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T18:12:49.229393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"254'97","reported_seq":647,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:04.066551+0000","last_change":"2024-06-04T16:23:04.066591+0000","last_active":"2024-06-04T16:23:04.066551+0000","last_peered":"2024-06-04T16:23:04.066551+0000","last_clean":"2024-06-04T16:23:04.066551+0000","last_became_active":"2024-06-04T15:52:42.503579+0000","last_became_peered":"2024-06-04T15:52:42.503579+0000","last_unstale":"2024-06-04T16:23:04.066551+0000","last_undegraded":"2024-06-04T16:23:04.066551+0000","last_fullsized":"2024-06-04T16:23:04.066551+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'97","last_scrub_stamp":"2024-06-04T16:23:04.066459+0000","last_deep_scrub":"254'97","last_deep_scrub_stamp":"2024-06-04T16:23:04.066459+0000","last_clean_scrub_stamp":"2024-06-04T16:23:04.066459+0000","objects_scrubbed":5,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T22:07:06.260680+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5924,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":139,"num_read_kb":180,"num_write":64,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":478,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:10.043211+0000","last_change":"2024-06-04T16:23:10.043234+0000","last_active":"2024-06-04T16:23:10.043211+0000","last_peered":"2024-06-04T16:23:10.043211+0000","last_clean":"2024-06-04T16:23:10.043211+0000","last_became_active":"2024-06-04T15:52:44.519570+0000","last_became_peered":"2024-06-04T15:52:44.519570+0000","last_unstale":"2024-06-04T16:23:10.043211+0000","last_undegraded":"2024-06-04T16:23:10.043211+0000","last_fullsized":"2024-06-04T16:23:10.043211+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:23:10.043105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:23:10.043105+0000","last_clean_scrub_stamp":"2024-06-04T16:23:10.043105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T03:18:54.475664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.11","version":"254'27","reported_seq":500,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:59.862605+0000","last_change":"2024-06-04T16:22:59.862605+0000","last_active":"2024-06-04T16:22:59.862605+0000","last_peered":"2024-06-04T16:22:59.862605+0000","last_clean":"2024-06-04T16:22:59.862605+0000","last_became_active":"2024-06-04T15:52:46.542820+0000","last_became_peered":"2024-06-04T15:52:46.542820+0000","last_unstale":"2024-06-04T16:22:59.862605+0000","last_undegraded":"2024-06-04T16:22:59.862605+0000","last_fullsized":"2024-06-04T16:22:59.862605+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'27","last_scrub_stamp":"2024-06-04T16:22:59.862441+0000","last_deep_scrub":"254'27","last_deep_scrub_stamp":"2024-06-04T16:22:59.862441+0000","last_clean_scrub_stamp":"2024-06-04T16:22:59.862441+0000","objects_scrubbed":3,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T21:08:54.099136+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":616,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":20,"num_read_kb":19,"num_write":60,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"254'122","reported_seq":825,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:16.913414+0000","last_change":"2024-06-04T16:23:16.913440+0000","last_active":"2024-06-04T16:23:16.913414+0000","last_peered":"2024-06-04T16:23:16.913414+0000","last_clean":"2024-06-04T16:23:16.913414+0000","last_became_active":"2024-06-04T15:52:38.477059+0000","last_became_peered":"2024-06-04T15:52:38.477059+0000","last_unstale":"2024-06-04T16:23:16.913414+0000","last_undegraded":"2024-06-04T16:23:16.913414+0000","last_fullsized":"2024-06-04T16:23:16.913414+0000","mapping_epoch":23,"log_start":"251'100","ondisk_log_start":"251'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'122","last_scrub_stamp":"2024-06-04T16:23:16.913326+0000","last_deep_scrub":"254'122","last_deep_scrub_stamp":"2024-06-04T16:23:16.913326+0000","last_clean_scrub_stamp":"2024-06-04T16:23:16.913326+0000","objects_scrubbed":1,"log_size":22,"log_dups_size":100,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T03:51:33.774060+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":614,"num_read_kb":552,"num_write":164,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":760,"num_omap_keys":4,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"254'63","reported_seq":580,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:24.765423+0000","last_change":"2024-06-04T16:23:24.765516+0000","last_active":"2024-06-04T16:23:24.765423+0000","last_peered":"2024-06-04T16:23:24.765423+0000","last_clean":"2024-06-04T16:23:24.765423+0000","last_became_active":"2024-06-04T15:52:36.497812+0000","last_became_peered":"2024-06-04T15:52:36.497812+0000","last_unstale":"2024-06-04T16:23:24.765423+0000","last_undegraded":"2024-06-04T16:23:24.765423+0000","last_fullsized":"2024-06-04T16:23:24.765423+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'63","last_scrub_stamp":"2024-06-04T16:23:24.765310+0000","last_deep_scrub":"254'63","last_deep_scrub_stamp":"2024-06-04T16:23:24.765310+0000","last_clean_scrub_stamp":"2024-06-04T16:23:24.765310+0000","objects_scrubbed":4,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T00:23:42.383064+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2267334,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":82,"num_read_kb":14576,"num_write":293,"num_write_kb":31387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3],"acting":[4,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":483,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:08.017758+0000","last_change":"2024-06-04T16:23:08.017785+0000","last_active":"2024-06-04T16:23:08.017758+0000","last_peered":"2024-06-04T16:23:08.017758+0000","last_clean":"2024-06-04T16:23:08.017758+0000","last_became_active":"2024-06-04T15:52:40.481621+0000","last_became_peered":"2024-06-04T15:52:40.481621+0000","last_unstale":"2024-06-04T16:23:08.017758+0000","last_undegraded":"2024-06-04T16:23:08.017758+0000","last_fullsized":"2024-06-04T16:23:08.017758+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:23:08.017669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:23:08.017669+0000","last_clean_scrub_stamp":"2024-06-04T16:23:08.017669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T00:50:40.268642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1e","version":"254'51","reported_seq":547,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:09.844823+0000","last_change":"2024-06-04T16:23:09.844878+0000","last_active":"2024-06-04T16:23:09.844823+0000","last_peered":"2024-06-04T16:23:09.844823+0000","last_clean":"2024-06-04T16:23:09.844823+0000","last_became_active":"2024-06-04T15:52:42.499488+0000","last_became_peered":"2024-06-04T15:52:42.499488+0000","last_unstale":"2024-06-04T16:23:09.844823+0000","last_undegraded":"2024-06-04T16:23:09.844823+0000","last_fullsized":"2024-06-04T16:23:09.844823+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'51","last_scrub_stamp":"2024-06-04T16:23:09.844736+0000","last_deep_scrub":"254'51","last_deep_scrub_stamp":"2024-06-04T16:23:09.844736+0000","last_clean_scrub_stamp":"2024-06-04T16:23:09.844736+0000","objects_scrubbed":7,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T16:46:37.753033+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":67,"num_read_kb":62,"num_write":74,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":11222,"num_omap_keys":30,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"254'461","reported_seq":1489,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:03.752146+0000","last_change":"2024-06-04T16:23:03.752174+0000","last_active":"2024-06-04T16:23:03.752146+0000","last_peered":"2024-06-04T16:23:03.752146+0000","last_clean":"2024-06-04T16:23:03.752146+0000","last_became_active":"2024-06-04T15:52:44.516460+0000","last_became_peered":"2024-06-04T15:52:44.516460+0000","last_unstale":"2024-06-04T16:23:03.752146+0000","last_undegraded":"2024-06-04T16:23:03.752146+0000","last_fullsized":"2024-06-04T16:23:03.752146+0000","mapping_epoch":29,"log_start":"251'400","ondisk_log_start":"251'400","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'461","last_scrub_stamp":"2024-06-04T16:23:03.752033+0000","last_deep_scrub":"254'461","last_deep_scrub_stamp":"2024-06-04T16:23:03.752033+0000","last_clean_scrub_stamp":"2024-06-04T16:23:03.752033+0000","objects_scrubbed":1,"log_size":61,"log_dups_size":400,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T22:17:40.547278+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.10","version":"254'21","reported_seq":501,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:47.043361+0000","last_change":"2024-06-04T16:22:47.043361+0000","last_active":"2024-06-04T16:22:47.043361+0000","last_peered":"2024-06-04T16:22:47.043361+0000","last_clean":"2024-06-04T16:22:47.043361+0000","last_became_active":"2024-06-04T15:52:46.538179+0000","last_became_peered":"2024-06-04T15:52:46.538179+0000","last_unstale":"2024-06-04T16:22:47.043361+0000","last_undegraded":"2024-06-04T16:22:47.043361+0000","last_fullsized":"2024-06-04T16:22:47.043361+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'21","last_scrub_stamp":"2024-06-04T16:22:47.043259+0000","last_deep_scrub":"254'21","last_deep_scrub_stamp":"2024-06-04T16:22:47.043259+0000","last_clean_scrub_stamp":"2024-06-04T16:22:47.043259+0000","objects_scrubbed":1,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T22:15:40.632828+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":34,"num_read_kb":33,"num_write":53,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"254'123","reported_seq":876,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:00.500298+0000","last_change":"2024-06-04T16:23:00.500326+0000","last_active":"2024-06-04T16:23:00.500298+0000","last_peered":"2024-06-04T16:23:00.500298+0000","last_clean":"2024-06-04T16:23:00.500298+0000","last_became_active":"2024-06-04T15:52:38.485379+0000","last_became_peered":"2024-06-04T15:52:38.485379+0000","last_unstale":"2024-06-04T16:23:00.500298+0000","last_undegraded":"2024-06-04T16:23:00.500298+0000","last_fullsized":"2024-06-04T16:23:00.500298+0000","mapping_epoch":23,"log_start":"254'100","ondisk_log_start":"254'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'123","last_scrub_stamp":"2024-06-04T16:23:00.500205+0000","last_deep_scrub":"254'123","last_deep_scrub_stamp":"2024-06-04T16:23:00.500205+0000","last_clean_scrub_stamp":"2024-06-04T16:23:00.500205+0000","objects_scrubbed":1,"log_size":23,"log_dups_size":100,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T20:17:09.939014+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":679,"num_read_kb":622,"num_write":158,"num_write_kb":49,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":473,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"251'30","reported_seq":530,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:18.399939+0000","last_change":"2024-06-04T16:23:18.399978+0000","last_active":"2024-06-04T16:23:18.399939+0000","last_peered":"2024-06-04T16:23:18.399939+0000","last_clean":"2024-06-04T16:23:18.399939+0000","last_became_active":"2024-06-04T15:52:36.486465+0000","last_became_peered":"2024-06-04T15:52:36.486465+0000","last_unstale":"2024-06-04T16:23:18.399939+0000","last_undegraded":"2024-06-04T16:23:18.399939+0000","last_fullsized":"2024-06-04T16:23:18.399939+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"251'30","last_scrub_stamp":"2024-06-04T16:23:18.399838+0000","last_deep_scrub":"251'30","last_deep_scrub_stamp":"2024-06-04T16:23:18.399838+0000","last_clean_scrub_stamp":"2024-06-04T16:23:18.399838+0000","objects_scrubbed":2,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T18:52:49.120366+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":30,"num_read_kb":1715,"num_write":122,"num_write_kb":16993,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,5],"acting":[1,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":485,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:00.183025+0000","last_change":"2024-06-04T16:23:00.183049+0000","last_active":"2024-06-04T16:23:00.183025+0000","last_peered":"2024-06-04T16:23:00.183025+0000","last_clean":"2024-06-04T16:23:00.183025+0000","last_became_active":"2024-06-04T15:52:40.480832+0000","last_became_peered":"2024-06-04T15:52:40.480832+0000","last_unstale":"2024-06-04T16:23:00.183025+0000","last_undegraded":"2024-06-04T16:23:00.183025+0000","last_fullsized":"2024-06-04T16:23:00.183025+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:23:00.182795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:23:00.182795+0000","last_clean_scrub_stamp":"2024-06-04T16:23:00.182795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T01:51:55.867582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"254'117","reported_seq":676,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:53.901967+0000","last_change":"2024-06-04T16:22:53.902005+0000","last_active":"2024-06-04T16:22:53.901967+0000","last_peered":"2024-06-04T16:22:53.901967+0000","last_clean":"2024-06-04T16:22:53.901967+0000","last_became_active":"2024-06-04T15:52:42.502601+0000","last_became_peered":"2024-06-04T15:52:42.502601+0000","last_unstale":"2024-06-04T16:22:53.901967+0000","last_undegraded":"2024-06-04T16:22:53.901967+0000","last_fullsized":"2024-06-04T16:22:53.901967+0000","mapping_epoch":27,"log_start":"251'100","ondisk_log_start":"251'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'117","last_scrub_stamp":"2024-06-04T16:22:53.901886+0000","last_deep_scrub":"254'117","last_deep_scrub_stamp":"2024-06-04T16:22:53.901886+0000","last_clean_scrub_stamp":"2024-06-04T16:22:53.901886+0000","objects_scrubbed":7,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T01:13:12.328330+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34754,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":168,"num_read_kb":281,"num_write":86,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":475,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:49.023291+0000","last_change":"2024-06-04T16:22:49.023320+0000","last_active":"2024-06-04T16:22:49.023291+0000","last_peered":"2024-06-04T16:22:49.023291+0000","last_clean":"2024-06-04T16:22:49.023291+0000","last_became_active":"2024-06-04T15:52:44.522992+0000","last_became_peered":"2024-06-04T15:52:44.522992+0000","last_unstale":"2024-06-04T16:22:49.023291+0000","last_undegraded":"2024-06-04T16:22:49.023291+0000","last_fullsized":"2024-06-04T16:22:49.023291+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:22:49.023192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:22:49.023192+0000","last_clean_scrub_stamp":"2024-06-04T16:22:49.023192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T21:20:02.532465+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"254'16","reported_seq":497,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:50.151424+0000","last_change":"2024-06-04T16:22:50.151477+0000","last_active":"2024-06-04T16:22:50.151424+0000","last_peered":"2024-06-04T16:22:50.151424+0000","last_clean":"2024-06-04T16:22:50.151424+0000","last_became_active":"2024-06-04T15:52:46.539985+0000","last_became_peered":"2024-06-04T15:52:46.539985+0000","last_unstale":"2024-06-04T16:22:50.151424+0000","last_undegraded":"2024-06-04T16:22:50.151424+0000","last_fullsized":"2024-06-04T16:22:50.151424+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'16","last_scrub_stamp":"2024-06-04T16:22:50.151326+0000","last_deep_scrub":"254'16","last_deep_scrub_stamp":"2024-06-04T16:22:50.151326+0000","last_clean_scrub_stamp":"2024-06-04T16:22:50.151326+0000","objects_scrubbed":1,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T17:32:57.901810+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":31,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"254'422","reported_seq":1248,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:20.638647+0000","last_change":"2024-06-04T16:23:20.638715+0000","last_active":"2024-06-04T16:23:20.638647+0000","last_peered":"2024-06-04T16:23:20.638647+0000","last_clean":"2024-06-04T16:23:20.638647+0000","last_became_active":"2024-06-04T15:52:38.474960+0000","last_became_peered":"2024-06-04T15:52:38.474960+0000","last_unstale":"2024-06-04T16:23:20.638647+0000","last_undegraded":"2024-06-04T16:23:20.638647+0000","last_fullsized":"2024-06-04T16:23:20.638647+0000","mapping_epoch":23,"log_start":"251'400","ondisk_log_start":"251'400","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'422","last_scrub_stamp":"2024-06-04T16:23:20.638541+0000","last_deep_scrub":"254'422","last_deep_scrub_stamp":"2024-06-04T16:23:20.638541+0000","last_clean_scrub_stamp":"2024-06-04T16:23:20.638541+0000","objects_scrubbed":3,"log_size":22,"log_dups_size":400,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T00:31:18.491940+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2017,"num_read_kb":1794,"num_write":716,"num_write_kb":341,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3525,"num_omap_keys":15,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"254'99","reported_seq":728,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:40.034910+0000","last_change":"2024-06-04T15:52:36.499152+0000","last_active":"2024-06-04T16:22:40.034910+0000","last_peered":"2024-06-04T16:22:40.034910+0000","last_clean":"2024-06-04T16:22:40.034910+0000","last_became_active":"2024-06-04T15:52:36.498806+0000","last_became_peered":"2024-06-04T15:52:36.498806+0000","last_unstale":"2024-06-04T16:22:40.034910+0000","last_undegraded":"2024-06-04T16:22:40.034910+0000","last_fullsized":"2024-06-04T16:22:40.034910+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":490,"num_read_kb":127523,"num_write":607,"num_write_kb":22490,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":481,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:59.503813+0000","last_change":"2024-06-04T16:22:59.503864+0000","last_active":"2024-06-04T16:22:59.503813+0000","last_peered":"2024-06-04T16:22:59.503813+0000","last_clean":"2024-06-04T16:22:59.503813+0000","last_became_active":"2024-06-04T15:52:40.478417+0000","last_became_peered":"2024-06-04T15:52:40.478417+0000","last_unstale":"2024-06-04T16:22:59.503813+0000","last_undegraded":"2024-06-04T16:22:59.503813+0000","last_fullsized":"2024-06-04T16:22:59.503813+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:22:59.503712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:22:59.503712+0000","last_clean_scrub_stamp":"2024-06-04T16:22:59.503712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T19:24:36.842678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"254'88","reported_seq":628,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:39.429000+0000","last_change":"2024-06-04T15:52:42.496557+0000","last_active":"2024-06-04T16:22:39.429000+0000","last_peered":"2024-06-04T16:22:39.429000+0000","last_clean":"2024-06-04T16:22:39.429000+0000","last_became_active":"2024-06-04T15:52:42.496263+0000","last_became_peered":"2024-06-04T15:52:42.496263+0000","last_unstale":"2024-06-04T16:22:39.429000+0000","last_undegraded":"2024-06-04T16:22:39.429000+0000","last_fullsized":"2024-06-04T16:22:39.429000+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:41.476734+0000","last_clean_scrub_stamp":"2024-06-04T15:52:41.476734+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7956,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":138,"num_read_kb":200,"num_write":66,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":474,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:04.870935+0000","last_change":"2024-06-04T16:23:04.870958+0000","last_active":"2024-06-04T16:23:04.870935+0000","last_peered":"2024-06-04T16:23:04.870935+0000","last_clean":"2024-06-04T16:23:04.870935+0000","last_became_active":"2024-06-04T15:52:44.520051+0000","last_became_peered":"2024-06-04T15:52:44.520051+0000","last_unstale":"2024-06-04T16:23:04.870935+0000","last_undegraded":"2024-06-04T16:23:04.870935+0000","last_fullsized":"2024-06-04T16:23:04.870935+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:23:04.870830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:23:04.870830+0000","last_clean_scrub_stamp":"2024-06-04T16:23:04.870830+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T20:14:18.357003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"254'40","reported_seq":557,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:57.535519+0000","last_change":"2024-06-04T16:22:57.535547+0000","last_active":"2024-06-04T16:22:57.535519+0000","last_peered":"2024-06-04T16:22:57.535519+0000","last_clean":"2024-06-04T16:22:57.535519+0000","last_became_active":"2024-06-04T15:52:46.541897+0000","last_became_peered":"2024-06-04T15:52:46.541897+0000","last_unstale":"2024-06-04T16:22:57.535519+0000","last_undegraded":"2024-06-04T16:22:57.535519+0000","last_fullsized":"2024-06-04T16:22:57.535519+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'40","last_scrub_stamp":"2024-06-04T16:22:57.535425+0000","last_deep_scrub":"254'40","last_deep_scrub_stamp":"2024-06-04T16:22:57.535425+0000","last_clean_scrub_stamp":"2024-06-04T16:22:57.535425+0000","objects_scrubbed":1,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T01:55:20.316635+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":549,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":152,"num_read_kb":137,"num_write":99,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"254'124","reported_seq":860,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:20.913028+0000","last_change":"2024-06-04T16:23:20.913058+0000","last_active":"2024-06-04T16:23:20.913028+0000","last_peered":"2024-06-04T16:23:20.913028+0000","last_clean":"2024-06-04T16:23:20.913028+0000","last_became_active":"2024-06-04T15:52:38.482388+0000","last_became_peered":"2024-06-04T15:52:38.482388+0000","last_unstale":"2024-06-04T16:23:20.913028+0000","last_undegraded":"2024-06-04T16:23:20.913028+0000","last_fullsized":"2024-06-04T16:23:20.913028+0000","mapping_epoch":23,"log_start":"251'100","ondisk_log_start":"251'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'124","last_scrub_stamp":"2024-06-04T16:23:20.912932+0000","last_deep_scrub":"254'124","last_deep_scrub_stamp":"2024-06-04T16:23:20.912932+0000","last_clean_scrub_stamp":"2024-06-04T16:23:20.912932+0000","objects_scrubbed":2,"log_size":24,"log_dups_size":100,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T21:56:21.589196+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":625,"num_read_kb":571,"num_write":157,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1e","version":"251'81","reported_seq":613,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:45.044237+0000","last_change":"2024-06-04T15:52:36.485805+0000","last_active":"2024-06-04T16:22:45.044237+0000","last_peered":"2024-06-04T16:22:45.044237+0000","last_clean":"2024-06-04T16:22:45.044237+0000","last_became_active":"2024-06-04T15:52:36.485401+0000","last_became_peered":"2024-06-04T15:52:36.485401+0000","last_unstale":"2024-06-04T16:22:45.044237+0000","last_undegraded":"2024-06-04T16:22:45.044237+0000","last_fullsized":"2024-06-04T16:22:45.044237+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133679,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":131,"num_read_kb":40112,"num_write":294,"num_write_kb":27266,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,3],"acting":[5,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":485,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:02.189360+0000","last_change":"2024-06-04T16:23:02.189383+0000","last_active":"2024-06-04T16:23:02.189360+0000","last_peered":"2024-06-04T16:23:02.189360+0000","last_clean":"2024-06-04T16:23:02.189360+0000","last_became_active":"2024-06-04T15:52:40.483272+0000","last_became_peered":"2024-06-04T15:52:40.483272+0000","last_unstale":"2024-06-04T16:23:02.189360+0000","last_undegraded":"2024-06-04T16:23:02.189360+0000","last_fullsized":"2024-06-04T16:23:02.189360+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:23:02.189267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:23:02.189267+0000","last_clean_scrub_stamp":"2024-06-04T16:23:02.189267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T00:51:47.779975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"254'83","reported_seq":621,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:58.065530+0000","last_change":"2024-06-04T16:22:58.065561+0000","last_active":"2024-06-04T16:22:58.065530+0000","last_peered":"2024-06-04T16:22:58.065530+0000","last_clean":"2024-06-04T16:22:58.065530+0000","last_became_active":"2024-06-04T15:52:42.496934+0000","last_became_peered":"2024-06-04T15:52:42.496934+0000","last_unstale":"2024-06-04T16:22:58.065530+0000","last_undegraded":"2024-06-04T16:22:58.065530+0000","last_fullsized":"2024-06-04T16:22:58.065530+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'83","last_scrub_stamp":"2024-06-04T16:22:58.065438+0000","last_deep_scrub":"254'83","last_deep_scrub_stamp":"2024-06-04T16:22:58.065438+0000","last_clean_scrub_stamp":"2024-06-04T16:22:58.065438+0000","objects_scrubbed":2,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T03:24:48.725441+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8160,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":120,"num_read_kb":184,"num_write":54,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":474,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:05.903821+0000","last_change":"2024-06-04T16:23:05.903856+0000","last_active":"2024-06-04T16:23:05.903821+0000","last_peered":"2024-06-04T16:23:05.903821+0000","last_clean":"2024-06-04T16:23:05.903821+0000","last_became_active":"2024-06-04T15:52:44.518782+0000","last_became_peered":"2024-06-04T15:52:44.518782+0000","last_unstale":"2024-06-04T16:23:05.903821+0000","last_undegraded":"2024-06-04T16:23:05.903821+0000","last_fullsized":"2024-06-04T16:23:05.903821+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:23:05.903728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:23:05.903728+0000","last_clean_scrub_stamp":"2024-06-04T16:23:05.903728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T19:53:16.916764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"254'44","reported_seq":540,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:46.089113+0000","last_change":"2024-06-04T16:22:46.089139+0000","last_active":"2024-06-04T16:22:46.089113+0000","last_peered":"2024-06-04T16:22:46.089113+0000","last_clean":"2024-06-04T16:22:46.089113+0000","last_became_active":"2024-06-04T15:52:46.531795+0000","last_became_peered":"2024-06-04T15:52:46.531795+0000","last_unstale":"2024-06-04T16:22:46.089113+0000","last_undegraded":"2024-06-04T16:22:46.089113+0000","last_fullsized":"2024-06-04T16:22:46.089113+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'44","last_scrub_stamp":"2024-06-04T16:22:46.089042+0000","last_deep_scrub":"254'44","last_deep_scrub_stamp":"2024-06-04T16:22:46.089042+0000","last_clean_scrub_stamp":"2024-06-04T16:22:46.089042+0000","objects_scrubbed":3,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T18:19:03.232432+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":429,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":136,"num_read_kb":110,"num_write":109,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"254'359","reported_seq":1103,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:12.517008+0000","last_change":"2024-06-04T16:23:12.517047+0000","last_active":"2024-06-04T16:23:12.517008+0000","last_peered":"2024-06-04T16:23:12.517008+0000","last_clean":"2024-06-04T16:23:12.517008+0000","last_became_active":"2024-06-04T15:52:38.478204+0000","last_became_peered":"2024-06-04T15:52:38.478204+0000","last_unstale":"2024-06-04T16:23:12.517008+0000","last_undegraded":"2024-06-04T16:23:12.517008+0000","last_fullsized":"2024-06-04T16:23:12.517008+0000","mapping_epoch":23,"log_start":"251'300","ondisk_log_start":"251'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'359","last_scrub_stamp":"2024-06-04T16:23:12.516911+0000","last_deep_scrub":"254'359","last_deep_scrub_stamp":"2024-06-04T16:23:12.516911+0000","last_clean_scrub_stamp":"2024-06-04T16:23:12.516911+0000","objects_scrubbed":3,"log_size":59,"log_dups_size":300,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T01:34:27.842574+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1642,"num_read_kb":1482,"num_write":614,"num_write_kb":292,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":768,"num_omap_keys":5,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"251'22","reported_seq":514,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:21:50.036885+0000","last_change":"2024-06-04T15:52:36.478256+0000","last_active":"2024-06-04T16:21:50.036885+0000","last_peered":"2024-06-04T16:21:50.036885+0000","last_clean":"2024-06-04T16:21:50.036885+0000","last_became_active":"2024-06-04T15:52:36.477895+0000","last_became_peered":"2024-06-04T15:52:36.477895+0000","last_unstale":"2024-06-04T16:21:50.036885+0000","last_undegraded":"2024-06-04T16:21:50.036885+0000","last_fullsized":"2024-06-04T16:21:50.036885+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":78,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":120,"num_write_kb":13440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.19","version":"254'2","reported_seq":485,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:10.003136+0000","last_change":"2024-06-04T16:23:10.003165+0000","last_active":"2024-06-04T16:23:10.003136+0000","last_peered":"2024-06-04T16:23:10.003136+0000","last_clean":"2024-06-04T16:23:10.003136+0000","last_became_active":"2024-06-04T15:52:40.483131+0000","last_became_peered":"2024-06-04T15:52:40.483131+0000","last_unstale":"2024-06-04T16:23:10.003136+0000","last_undegraded":"2024-06-04T16:23:10.003136+0000","last_fullsized":"2024-06-04T16:23:10.003136+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'2","last_scrub_stamp":"2024-06-04T16:23:10.003044+0000","last_deep_scrub":"254'2","last_deep_scrub_stamp":"2024-06-04T16:23:10.003044+0000","last_clean_scrub_stamp":"2024-06-04T16:23:10.003044+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T20:22:25.334380+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1a","version":"254'123","reported_seq":685,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:07.878541+0000","last_change":"2024-06-04T16:23:07.878570+0000","last_active":"2024-06-04T16:23:07.878541+0000","last_peered":"2024-06-04T16:23:07.878541+0000","last_clean":"2024-06-04T16:23:07.878541+0000","last_became_active":"2024-06-04T15:52:42.503538+0000","last_became_peered":"2024-06-04T15:52:42.503538+0000","last_unstale":"2024-06-04T16:23:07.878541+0000","last_undegraded":"2024-06-04T16:23:07.878541+0000","last_fullsized":"2024-06-04T16:23:07.878541+0000","mapping_epoch":27,"log_start":"251'100","ondisk_log_start":"251'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'123","last_scrub_stamp":"2024-06-04T16:23:07.878472+0000","last_deep_scrub":"254'123","last_deep_scrub_stamp":"2024-06-04T16:23:07.878472+0000","last_clean_scrub_stamp":"2024-06-04T16:23:07.878472+0000","objects_scrubbed":4,"log_size":23,"log_dups_size":100,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T17:02:13.406205+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6196,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":182,"num_read_kb":236,"num_write":96,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":475,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:53.984901+0000","last_change":"2024-06-04T16:22:53.984929+0000","last_active":"2024-06-04T16:22:53.984901+0000","last_peered":"2024-06-04T16:22:53.984901+0000","last_clean":"2024-06-04T16:22:53.984901+0000","last_became_active":"2024-06-04T15:52:44.519867+0000","last_became_peered":"2024-06-04T15:52:44.519867+0000","last_unstale":"2024-06-04T16:22:53.984901+0000","last_undegraded":"2024-06-04T16:22:53.984901+0000","last_fullsized":"2024-06-04T16:22:53.984901+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:22:53.984790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:22:53.984790+0000","last_clean_scrub_stamp":"2024-06-04T16:22:53.984790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T22:21:34.850045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.14","version":"254'32","reported_seq":541,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:46.906396+0000","last_change":"2024-06-04T16:22:46.906396+0000","last_active":"2024-06-04T16:22:46.906396+0000","last_peered":"2024-06-04T16:22:46.906396+0000","last_clean":"2024-06-04T16:22:46.906396+0000","last_became_active":"2024-06-04T15:52:46.537792+0000","last_became_peered":"2024-06-04T15:52:46.537792+0000","last_unstale":"2024-06-04T16:22:46.906396+0000","last_undegraded":"2024-06-04T16:22:46.906396+0000","last_fullsized":"2024-06-04T16:22:46.906396+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'32","last_scrub_stamp":"2024-06-04T16:22:46.906299+0000","last_deep_scrub":"254'32","last_deep_scrub_stamp":"2024-06-04T16:22:46.906299+0000","last_clean_scrub_stamp":"2024-06-04T16:22:46.906299+0000","objects_scrubbed":2,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T20:36:00.317258+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":433,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":163,"num_read_kb":128,"num_write":83,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"254'157","reported_seq":957,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:05.024132+0000","last_change":"2024-06-04T16:23:05.024162+0000","last_active":"2024-06-04T16:23:05.024132+0000","last_peered":"2024-06-04T16:23:05.024132+0000","last_clean":"2024-06-04T16:23:05.024132+0000","last_became_active":"2024-06-04T15:52:38.486335+0000","last_became_peered":"2024-06-04T15:52:38.486335+0000","last_unstale":"2024-06-04T16:23:05.024132+0000","last_undegraded":"2024-06-04T16:23:05.024132+0000","last_fullsized":"2024-06-04T16:23:05.024132+0000","mapping_epoch":23,"log_start":"251'100","ondisk_log_start":"251'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'157","last_scrub_stamp":"2024-06-04T16:23:05.024043+0000","last_deep_scrub":"254'157","last_deep_scrub_stamp":"2024-06-04T16:23:05.024043+0000","last_clean_scrub_stamp":"2024-06-04T16:23:05.024043+0000","objects_scrubbed":1,"log_size":57,"log_dups_size":100,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T17:07:05.833438+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":839,"num_read_kb":763,"num_write":210,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":310,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.20","version":"254'54","reported_seq":577,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:52.513454+0000","last_change":"2024-06-04T16:22:52.513504+0000","last_active":"2024-06-04T16:22:52.513454+0000","last_peered":"2024-06-04T16:22:52.513454+0000","last_clean":"2024-06-04T16:22:52.513454+0000","last_became_active":"2024-06-04T15:53:14.002428+0000","last_became_peered":"2024-06-04T15:53:14.002428+0000","last_unstale":"2024-06-04T16:22:52.513454+0000","last_undegraded":"2024-06-04T16:22:52.513454+0000","last_fullsized":"2024-06-04T16:22:52.513454+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'54","last_scrub_stamp":"2024-06-04T16:22:52.513364+0000","last_deep_scrub":"254'54","last_deep_scrub_stamp":"2024-06-04T16:22:52.513364+0000","last_clean_scrub_stamp":"2024-06-04T16:22:52.513364+0000","objects_scrubbed":2,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T03:21:52.616336+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":15429,"num_write":206,"num_write_kb":34585,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5],"acting":[2,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"254'241","reported_seq":913,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:46.972199+0000","last_change":"2024-06-04T15:52:38.481773+0000","last_active":"2024-06-04T16:22:46.972199+0000","last_peered":"2024-06-04T16:22:46.972199+0000","last_clean":"2024-06-04T16:22:46.972199+0000","last_became_active":"2024-06-04T15:52:38.481490+0000","last_became_peered":"2024-06-04T15:52:38.481490+0000","last_unstale":"2024-06-04T16:22:46.972199+0000","last_undegraded":"2024-06-04T16:22:46.972199+0000","last_fullsized":"2024-06-04T16:22:46.972199+0000","mapping_epoch":23,"log_start":"251'200","ondisk_log_start":"251'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":200,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1011,"num_read_kb":836,"num_write":379,"num_write_kb":158,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.21","version":"254'54","reported_seq":564,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:23.941102+0000","last_change":"2024-06-04T16:23:23.941130+0000","last_active":"2024-06-04T16:23:23.941102+0000","last_peered":"2024-06-04T16:23:23.941102+0000","last_clean":"2024-06-04T16:23:23.941102+0000","last_became_active":"2024-06-04T15:52:36.495008+0000","last_became_peered":"2024-06-04T15:52:36.495008+0000","last_unstale":"2024-06-04T16:23:23.941102+0000","last_undegraded":"2024-06-04T16:23:23.941102+0000","last_fullsized":"2024-06-04T16:23:23.941102+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'54","last_scrub_stamp":"2024-06-04T16:23:23.941009+0000","last_deep_scrub":"254'54","last_deep_scrub_stamp":"2024-06-04T16:23:23.941009+0000","last_clean_scrub_stamp":"2024-06-04T16:23:23.941009+0000","objects_scrubbed":1,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T19:31:11.830953+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":63,"num_read_kb":12338,"num_write":219,"num_write_kb":31559,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.25","version":"254'141","reported_seq":986,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:24.701155+0000","last_change":"2024-06-04T16:23:24.701221+0000","last_active":"2024-06-04T16:23:24.701155+0000","last_peered":"2024-06-04T16:23:24.701155+0000","last_clean":"2024-06-04T16:23:24.701155+0000","last_became_active":"2024-06-04T15:52:38.481916+0000","last_became_peered":"2024-06-04T15:52:38.481916+0000","last_unstale":"2024-06-04T16:23:24.701155+0000","last_undegraded":"2024-06-04T16:23:24.701155+0000","last_fullsized":"2024-06-04T16:23:24.701155+0000","mapping_epoch":23,"log_start":"251'100","ondisk_log_start":"251'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'141","last_scrub_stamp":"2024-06-04T16:23:24.701055+0000","last_deep_scrub":"254'141","last_deep_scrub_stamp":"2024-06-04T16:23:24.701055+0000","last_clean_scrub_stamp":"2024-06-04T16:23:24.701055+0000","objects_scrubbed":3,"log_size":41,"log_dups_size":100,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T18:19:37.940704+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":911,"num_read_kb":859,"num_write":180,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3772,"num_omap_keys":15,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"254'58","reported_seq":586,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:39.539231+0000","last_change":"2024-06-04T15:52:36.482905+0000","last_active":"2024-06-04T16:22:39.539231+0000","last_peered":"2024-06-04T16:22:39.539231+0000","last_clean":"2024-06-04T16:22:39.539231+0000","last_became_active":"2024-06-04T15:52:36.482589+0000","last_became_peered":"2024-06-04T15:52:36.482589+0000","last_unstale":"2024-06-04T16:22:39.539231+0000","last_undegraded":"2024-06-04T16:22:39.539231+0000","last_fullsized":"2024-06-04T16:22:39.539231+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":134,"num_read_kb":8380,"num_write":298,"num_write_kb":18008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7],"acting":[3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"254'104","reported_seq":821,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:17.351225+0000","last_change":"2024-06-04T16:23:17.351254+0000","last_active":"2024-06-04T16:23:17.351225+0000","last_peered":"2024-06-04T16:23:17.351225+0000","last_clean":"2024-06-04T16:23:17.351225+0000","last_became_active":"2024-06-04T15:52:38.486018+0000","last_became_peered":"2024-06-04T15:52:38.486018+0000","last_unstale":"2024-06-04T16:23:17.351225+0000","last_undegraded":"2024-06-04T16:23:17.351225+0000","last_fullsized":"2024-06-04T16:23:17.351225+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'104","last_scrub_stamp":"2024-06-04T16:23:17.351135+0000","last_deep_scrub":"254'104","last_deep_scrub_stamp":"2024-06-04T16:23:17.351135+0000","last_clean_scrub_stamp":"2024-06-04T16:23:17.351135+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T00:18:13.126137+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":549,"num_read_kb":515,"num_write":118,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"251'48","reported_seq":568,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:21.369617+0000","last_change":"2024-06-04T16:23:21.369661+0000","last_active":"2024-06-04T16:23:21.369617+0000","last_peered":"2024-06-04T16:23:21.369617+0000","last_clean":"2024-06-04T16:23:21.369617+0000","last_became_active":"2024-06-04T15:52:36.496125+0000","last_became_peered":"2024-06-04T15:52:36.496125+0000","last_unstale":"2024-06-04T16:23:21.369617+0000","last_undegraded":"2024-06-04T16:23:21.369617+0000","last_fullsized":"2024-06-04T16:23:21.369617+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"251'48","last_scrub_stamp":"2024-06-04T16:23:21.369501+0000","last_deep_scrub":"251'48","last_deep_scrub_stamp":"2024-06-04T16:23:21.369501+0000","last_clean_scrub_stamp":"2024-06-04T16:23:21.369501+0000","objects_scrubbed":4,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T04:23:20.241786+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":98,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":59,"num_read_kb":26302,"num_write":204,"num_write_kb":24798,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,0],"acting":[5,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.23","version":"254'93","reported_seq":816,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:19.356132+0000","last_change":"2024-06-04T16:23:19.356194+0000","last_active":"2024-06-04T16:23:19.356132+0000","last_peered":"2024-06-04T16:23:19.356132+0000","last_clean":"2024-06-04T16:23:19.356132+0000","last_became_active":"2024-06-04T15:52:38.484927+0000","last_became_peered":"2024-06-04T15:52:38.484927+0000","last_unstale":"2024-06-04T16:23:19.356132+0000","last_undegraded":"2024-06-04T16:23:19.356132+0000","last_fullsized":"2024-06-04T16:23:19.356132+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'93","last_scrub_stamp":"2024-06-04T16:23:19.356033+0000","last_deep_scrub":"254'93","last_deep_scrub_stamp":"2024-06-04T16:23:19.356033+0000","last_clean_scrub_stamp":"2024-06-04T16:23:19.356033+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T02:30:50.349506+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":509,"num_read_kb":485,"num_write":106,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"254'52","reported_seq":564,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:51.205408+0000","last_change":"2024-06-04T16:22:51.205408+0000","last_active":"2024-06-04T16:22:51.205408+0000","last_peered":"2024-06-04T16:22:51.205408+0000","last_clean":"2024-06-04T16:22:51.205408+0000","last_became_active":"2024-06-04T15:53:14.183279+0000","last_became_peered":"2024-06-04T15:53:14.183279+0000","last_unstale":"2024-06-04T16:22:51.205408+0000","last_undegraded":"2024-06-04T16:22:51.205408+0000","last_fullsized":"2024-06-04T16:22:51.205408+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'52","last_scrub_stamp":"2024-06-04T16:22:51.205271+0000","last_deep_scrub":"254'52","last_deep_scrub_stamp":"2024-06-04T16:22:51.205271+0000","last_clean_scrub_stamp":"2024-06-04T16:22:51.205271+0000","objects_scrubbed":3,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T01:25:25.764034+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1395816,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":52,"num_read_kb":1141,"num_write":191,"num_write_kb":22936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.22","version":"254'209","reported_seq":1111,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:52.914929+0000","last_change":"2024-06-04T16:22:52.914964+0000","last_active":"2024-06-04T16:22:52.914929+0000","last_peered":"2024-06-04T16:22:52.914929+0000","last_clean":"2024-06-04T16:22:52.914929+0000","last_became_active":"2024-06-04T15:52:38.488762+0000","last_became_peered":"2024-06-04T15:52:38.488762+0000","last_unstale":"2024-06-04T16:22:52.914929+0000","last_undegraded":"2024-06-04T16:22:52.914929+0000","last_fullsized":"2024-06-04T16:22:52.914929+0000","mapping_epoch":23,"log_start":"251'100","ondisk_log_start":"251'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'209","last_scrub_stamp":"2024-06-04T16:22:52.914808+0000","last_deep_scrub":"254'209","last_deep_scrub_stamp":"2024-06-04T16:22:52.914808+0000","last_clean_scrub_stamp":"2024-06-04T16:22:52.914808+0000","objects_scrubbed":1,"log_size":109,"log_dups_size":100,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T19:07:05.255680+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1221,"num_read_kb":1130,"num_write":279,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.25","version":"254'51","reported_seq":560,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:16.130444+0000","last_change":"2024-06-04T16:23:16.130481+0000","last_active":"2024-06-04T16:23:16.130444+0000","last_peered":"2024-06-04T16:23:16.130444+0000","last_clean":"2024-06-04T16:23:16.130444+0000","last_became_active":"2024-06-04T15:52:36.488611+0000","last_became_peered":"2024-06-04T15:52:36.488611+0000","last_unstale":"2024-06-04T16:23:16.130444+0000","last_undegraded":"2024-06-04T16:23:16.130444+0000","last_fullsized":"2024-06-04T16:23:16.130444+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'51","last_scrub_stamp":"2024-06-04T16:23:16.130347+0000","last_deep_scrub":"254'51","last_deep_scrub_stamp":"2024-06-04T16:23:16.130347+0000","last_clean_scrub_stamp":"2024-06-04T16:23:16.130347+0000","objects_scrubbed":3,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T21:31:44.332783+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":75,"num_read_kb":4172,"num_write":239,"num_write_kb":26328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"254'159","reported_seq":924,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:07.029020+0000","last_change":"2024-06-04T16:23:07.029052+0000","last_active":"2024-06-04T16:23:07.029020+0000","last_peered":"2024-06-04T16:23:07.029020+0000","last_clean":"2024-06-04T16:23:07.029020+0000","last_became_active":"2024-06-04T15:52:38.482566+0000","last_became_peered":"2024-06-04T15:52:38.482566+0000","last_unstale":"2024-06-04T16:23:07.029020+0000","last_undegraded":"2024-06-04T16:23:07.029020+0000","last_fullsized":"2024-06-04T16:23:07.029020+0000","mapping_epoch":23,"log_start":"251'100","ondisk_log_start":"251'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'159","last_scrub_stamp":"2024-06-04T16:23:07.028928+0000","last_deep_scrub":"254'159","last_deep_scrub_stamp":"2024-06-04T16:23:07.028928+0000","last_clean_scrub_stamp":"2024-06-04T16:23:07.028928+0000","objects_scrubbed":2,"log_size":59,"log_dups_size":100,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T03:04:52.237492+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":759,"num_read_kb":686,"num_write":203,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"254'59","reported_seq":569,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:19.645912+0000","last_change":"2024-06-04T16:23:19.646017+0000","last_active":"2024-06-04T16:23:19.645912+0000","last_peered":"2024-06-04T16:23:19.645912+0000","last_clean":"2024-06-04T16:23:19.645912+0000","last_became_active":"2024-06-04T15:52:36.487213+0000","last_became_peered":"2024-06-04T15:52:36.487213+0000","last_unstale":"2024-06-04T16:23:19.645912+0000","last_undegraded":"2024-06-04T16:23:19.645912+0000","last_fullsized":"2024-06-04T16:23:19.645912+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'59","last_scrub_stamp":"2024-06-04T16:23:19.645791+0000","last_deep_scrub":"254'59","last_deep_scrub_stamp":"2024-06-04T16:23:19.645791+0000","last_clean_scrub_stamp":"2024-06-04T16:23:19.645791+0000","objects_scrubbed":10,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T22:08:24.782217+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3860915,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":58,"num_read_kb":7398,"num_write":258,"num_write_kb":28567,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"254'121","reported_seq":871,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:13.303598+0000","last_change":"2024-06-04T16:23:13.303628+0000","last_active":"2024-06-04T16:23:13.303598+0000","last_peered":"2024-06-04T16:23:13.303598+0000","last_clean":"2024-06-04T16:23:13.303598+0000","last_became_active":"2024-06-04T15:52:38.477036+0000","last_became_peered":"2024-06-04T15:52:38.477036+0000","last_unstale":"2024-06-04T16:23:13.303598+0000","last_undegraded":"2024-06-04T16:23:13.303598+0000","last_fullsized":"2024-06-04T16:23:13.303598+0000","mapping_epoch":23,"log_start":"251'100","ondisk_log_start":"251'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'121","last_scrub_stamp":"2024-06-04T16:23:13.303496+0000","last_deep_scrub":"254'121","last_deep_scrub_stamp":"2024-06-04T16:23:13.303496+0000","last_clean_scrub_stamp":"2024-06-04T16:23:13.303496+0000","objects_scrubbed":1,"log_size":21,"log_dups_size":100,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T21:06:12.727561+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":627,"num_read_kb":578,"num_write":156,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"254'48","reported_seq":564,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:46.023360+0000","last_change":"2024-06-04T15:52:36.482150+0000","last_active":"2024-06-04T16:22:46.023360+0000","last_peered":"2024-06-04T16:22:46.023360+0000","last_clean":"2024-06-04T16:22:46.023360+0000","last_became_active":"2024-06-04T15:52:36.479810+0000","last_became_peered":"2024-06-04T15:52:36.479810+0000","last_unstale":"2024-06-04T16:22:46.023360+0000","last_undegraded":"2024-06-04T16:22:46.023360+0000","last_fullsized":"2024-06-04T16:22:46.023360+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048839,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":103,"num_read_kb":5904,"num_write":252,"num_write_kb":17938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2f","version":"254'58","reported_seq":708,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:46.972234+0000","last_change":"2024-06-04T15:52:38.482098+0000","last_active":"2024-06-04T16:22:46.972234+0000","last_peered":"2024-06-04T16:22:46.972234+0000","last_clean":"2024-06-04T16:22:46.972234+0000","last_became_active":"2024-06-04T15:52:38.481789+0000","last_became_peered":"2024-06-04T15:52:38.481789+0000","last_unstale":"2024-06-04T16:22:46.972234+0000","last_undegraded":"2024-06-04T16:22:46.972234+0000","last_fullsized":"2024-06-04T16:22:46.972234+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":316,"num_read_kb":309,"num_write":62,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.28","version":"254'57","reported_seq":593,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:45.076976+0000","last_change":"2024-06-04T15:52:36.491357+0000","last_active":"2024-06-04T16:22:45.076976+0000","last_peered":"2024-06-04T16:22:45.076976+0000","last_clean":"2024-06-04T16:22:45.076976+0000","last_became_active":"2024-06-04T15:52:36.490119+0000","last_became_peered":"2024-06-04T15:52:36.490119+0000","last_unstale":"2024-06-04T16:22:45.076976+0000","last_undegraded":"2024-06-04T16:22:45.076976+0000","last_fullsized":"2024-06-04T16:22:45.076976+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262178,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":124,"num_read_kb":46547,"num_write":231,"num_write_kb":19872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7],"acting":[3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"254'93","reported_seq":787,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:50.895803+0000","last_change":"2024-06-04T16:22:50.895803+0000","last_active":"2024-06-04T16:22:50.895803+0000","last_peered":"2024-06-04T16:22:50.895803+0000","last_clean":"2024-06-04T16:22:50.895803+0000","last_became_active":"2024-06-04T15:52:38.488839+0000","last_became_peered":"2024-06-04T15:52:38.488839+0000","last_unstale":"2024-06-04T16:22:50.895803+0000","last_undegraded":"2024-06-04T16:22:50.895803+0000","last_fullsized":"2024-06-04T16:22:50.895803+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'93","last_scrub_stamp":"2024-06-04T16:22:50.895627+0000","last_deep_scrub":"254'93","last_deep_scrub_stamp":"2024-06-04T16:22:50.895627+0000","last_clean_scrub_stamp":"2024-06-04T16:22:50.895627+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T23:08:02.213621+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":464,"num_read_kb":434,"num_write":108,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.29","version":"254'42","reported_seq":547,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:21:55.037452+0000","last_change":"2024-06-04T15:52:36.496347+0000","last_active":"2024-06-04T16:21:55.037452+0000","last_peered":"2024-06-04T16:21:55.037452+0000","last_clean":"2024-06-04T16:21:55.037452+0000","last_became_active":"2024-06-04T15:52:36.495936+0000","last_became_peered":"2024-06-04T15:52:36.495936+0000","last_unstale":"2024-06-04T16:21:55.037452+0000","last_undegraded":"2024-06-04T16:21:55.037452+0000","last_fullsized":"2024-06-04T16:21:55.037452+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133666,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":74,"num_read_kb":10396,"num_write":213,"num_write_kb":18947,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,0],"acting":[5,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2d","version":"254'116","reported_seq":808,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:14.334409+0000","last_change":"2024-06-04T16:23:14.334467+0000","last_active":"2024-06-04T16:23:14.334409+0000","last_peered":"2024-06-04T16:23:14.334409+0000","last_clean":"2024-06-04T16:23:14.334409+0000","last_became_active":"2024-06-04T15:52:38.488289+0000","last_became_peered":"2024-06-04T15:52:38.488289+0000","last_unstale":"2024-06-04T16:23:14.334409+0000","last_undegraded":"2024-06-04T16:23:14.334409+0000","last_fullsized":"2024-06-04T16:23:14.334409+0000","mapping_epoch":23,"log_start":"251'100","ondisk_log_start":"251'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'116","last_scrub_stamp":"2024-06-04T16:23:14.334288+0000","last_deep_scrub":"254'116","last_deep_scrub_stamp":"2024-06-04T16:23:14.334288+0000","last_clean_scrub_stamp":"2024-06-04T16:23:14.334288+0000","objects_scrubbed":1,"log_size":16,"log_dups_size":100,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T23:45:48.859590+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":534,"num_read_kb":481,"num_write":150,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":476,"num_omap_keys":2,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"254'66","reported_seq":583,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:20.375444+0000","last_change":"2024-06-04T16:23:20.375511+0000","last_active":"2024-06-04T16:23:20.375444+0000","last_peered":"2024-06-04T16:23:20.375444+0000","last_clean":"2024-06-04T16:23:20.375444+0000","last_became_active":"2024-06-04T15:52:36.495386+0000","last_became_peered":"2024-06-04T15:52:36.495386+0000","last_unstale":"2024-06-04T16:23:20.375444+0000","last_undegraded":"2024-06-04T16:23:20.375444+0000","last_fullsized":"2024-06-04T16:23:20.375444+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'66","last_scrub_stamp":"2024-06-04T16:23:20.375334+0000","last_deep_scrub":"254'66","last_deep_scrub_stamp":"2024-06-04T16:23:20.375334+0000","last_clean_scrub_stamp":"2024-06-04T16:23:20.375334+0000","objects_scrubbed":6,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T23:23:00.148285+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4553920,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":69,"num_read_kb":17530,"num_write":238,"num_write_kb":31151,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"254'93","reported_seq":840,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:11.291672+0000","last_change":"2024-06-04T16:23:11.291720+0000","last_active":"2024-06-04T16:23:11.291672+0000","last_peered":"2024-06-04T16:23:11.291672+0000","last_clean":"2024-06-04T16:23:11.291672+0000","last_became_active":"2024-06-04T15:52:38.477333+0000","last_became_peered":"2024-06-04T15:52:38.477333+0000","last_unstale":"2024-06-04T16:23:11.291672+0000","last_undegraded":"2024-06-04T16:23:11.291672+0000","last_fullsized":"2024-06-04T16:23:11.291672+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'93","last_scrub_stamp":"2024-06-04T16:23:11.291552+0000","last_deep_scrub":"254'93","last_deep_scrub_stamp":"2024-06-04T16:23:11.291552+0000","last_clean_scrub_stamp":"2024-06-04T16:23:11.291552+0000","objects_scrubbed":3,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T18:53:46.897687+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":521,"num_read_kb":500,"num_write":102,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"251'47","reported_seq":567,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:22.840571+0000","last_change":"2024-06-04T16:23:22.840607+0000","last_active":"2024-06-04T16:23:22.840571+0000","last_peered":"2024-06-04T16:23:22.840571+0000","last_clean":"2024-06-04T16:23:22.840571+0000","last_became_active":"2024-06-04T15:52:36.482036+0000","last_became_peered":"2024-06-04T15:52:36.482036+0000","last_unstale":"2024-06-04T16:23:22.840571+0000","last_undegraded":"2024-06-04T16:23:22.840571+0000","last_fullsized":"2024-06-04T16:23:22.840571+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"251'47","last_scrub_stamp":"2024-06-04T16:23:22.840471+0000","last_deep_scrub":"251'47","last_deep_scrub_stamp":"2024-06-04T16:23:22.840471+0000","last_clean_scrub_stamp":"2024-06-04T16:23:22.840471+0000","objects_scrubbed":3,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T03:52:07.635574+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1069194,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":76,"num_read_kb":25646,"num_write":152,"num_write_kb":18921,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,6],"acting":[4,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"254'150","reported_seq":912,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:07.252865+0000","last_change":"2024-06-04T16:23:07.252889+0000","last_active":"2024-06-04T16:23:07.252865+0000","last_peered":"2024-06-04T16:23:07.252865+0000","last_clean":"2024-06-04T16:23:07.252865+0000","last_became_active":"2024-06-04T15:52:38.480432+0000","last_became_peered":"2024-06-04T15:52:38.480432+0000","last_unstale":"2024-06-04T16:23:07.252865+0000","last_undegraded":"2024-06-04T16:23:07.252865+0000","last_fullsized":"2024-06-04T16:23:07.252865+0000","mapping_epoch":23,"log_start":"251'100","ondisk_log_start":"251'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'150","last_scrub_stamp":"2024-06-04T16:23:07.252763+0000","last_deep_scrub":"254'150","last_deep_scrub_stamp":"2024-06-04T16:23:07.252763+0000","last_clean_scrub_stamp":"2024-06-04T16:23:07.252763+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":100,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T02:08:42.991893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":703,"num_read_kb":638,"num_write":178,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"254'54","reported_seq":563,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:07.803392+0000","last_change":"2024-06-04T16:23:07.803428+0000","last_active":"2024-06-04T16:23:07.803392+0000","last_peered":"2024-06-04T16:23:07.803392+0000","last_clean":"2024-06-04T16:23:07.803392+0000","last_became_active":"2024-06-04T15:52:36.488813+0000","last_became_peered":"2024-06-04T15:52:36.488813+0000","last_unstale":"2024-06-04T16:23:07.803392+0000","last_undegraded":"2024-06-04T16:23:07.803392+0000","last_fullsized":"2024-06-04T16:23:07.803392+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'54","last_scrub_stamp":"2024-06-04T16:23:07.803315+0000","last_deep_scrub":"254'54","last_deep_scrub_stamp":"2024-06-04T16:23:07.803315+0000","last_clean_scrub_stamp":"2024-06-04T16:23:07.803315+0000","objects_scrubbed":4,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T22:56:04.807428+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":75,"num_read_kb":5170,"num_write":190,"num_write_kb":17954,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6],"acting":[0,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"254'97","reported_seq":792,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:21:55.149851+0000","last_change":"2024-06-04T15:52:38.479843+0000","last_active":"2024-06-04T16:21:55.149851+0000","last_peered":"2024-06-04T16:21:55.149851+0000","last_clean":"2024-06-04T16:21:55.149851+0000","last_became_active":"2024-06-04T15:52:38.479542+0000","last_became_peered":"2024-06-04T15:52:38.479542+0000","last_unstale":"2024-06-04T16:21:55.149851+0000","last_undegraded":"2024-06-04T16:21:55.149851+0000","last_fullsized":"2024-06-04T16:21:55.149851+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:37.459483+0000","last_clean_scrub_stamp":"2024-06-04T15:52:37.459483+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":493,"num_read_kb":461,"num_write":115,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"251'65","reported_seq":575,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:00.030267+0000","last_change":"2024-06-04T15:52:36.488268+0000","last_active":"2024-06-04T16:22:00.030267+0000","last_peered":"2024-06-04T16:22:00.030267+0000","last_clean":"2024-06-04T16:22:00.030267+0000","last_became_active":"2024-06-04T15:52:36.487971+0000","last_became_peered":"2024-06-04T15:52:36.487971+0000","last_unstale":"2024-06-04T16:22:00.030267+0000","last_undegraded":"2024-06-04T16:22:00.030267+0000","last_fullsized":"2024-06-04T16:22:00.030267+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262163,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":94,"num_read_kb":7564,"num_write":255,"num_write_kb":36740,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"254'139","reported_seq":923,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:09.050239+0000","last_change":"2024-06-04T16:23:09.050266+0000","last_active":"2024-06-04T16:23:09.050239+0000","last_peered":"2024-06-04T16:23:09.050239+0000","last_clean":"2024-06-04T16:23:09.050239+0000","last_became_active":"2024-06-04T15:52:38.484225+0000","last_became_peered":"2024-06-04T15:52:38.484225+0000","last_unstale":"2024-06-04T16:23:09.050239+0000","last_undegraded":"2024-06-04T16:23:09.050239+0000","last_fullsized":"2024-06-04T16:23:09.050239+0000","mapping_epoch":23,"log_start":"251'100","ondisk_log_start":"251'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'139","last_scrub_stamp":"2024-06-04T16:23:09.050145+0000","last_deep_scrub":"254'139","last_deep_scrub_stamp":"2024-06-04T16:23:09.050145+0000","last_clean_scrub_stamp":"2024-06-04T16:23:09.050145+0000","objects_scrubbed":3,"log_size":39,"log_dups_size":100,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T18:11:37.986197+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":727,"num_read_kb":670,"num_write":170,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2e","version":"254'55","reported_seq":576,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:22.905314+0000","last_change":"2024-06-04T16:23:22.905373+0000","last_active":"2024-06-04T16:23:22.905314+0000","last_peered":"2024-06-04T16:23:22.905314+0000","last_clean":"2024-06-04T16:23:22.905314+0000","last_became_active":"2024-06-04T15:52:36.488139+0000","last_became_peered":"2024-06-04T15:52:36.488139+0000","last_unstale":"2024-06-04T16:23:22.905314+0000","last_undegraded":"2024-06-04T16:23:22.905314+0000","last_fullsized":"2024-06-04T16:23:22.905314+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'55","last_scrub_stamp":"2024-06-04T16:23:22.905216+0000","last_deep_scrub":"254'55","last_deep_scrub_stamp":"2024-06-04T16:23:22.905216+0000","last_clean_scrub_stamp":"2024-06-04T16:23:22.905216+0000","objects_scrubbed":3,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T21:51:27.324326+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":103,"num_read_kb":14422,"num_write":268,"num_write_kb":32685,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,3],"acting":[7,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.28","version":"254'291","reported_seq":1135,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:09.264260+0000","last_change":"2024-06-04T16:23:09.264288+0000","last_active":"2024-06-04T16:23:09.264260+0000","last_peered":"2024-06-04T16:23:09.264260+0000","last_clean":"2024-06-04T16:23:09.264260+0000","last_became_active":"2024-06-04T15:52:38.480613+0000","last_became_peered":"2024-06-04T15:52:38.480613+0000","last_unstale":"2024-06-04T16:23:09.264260+0000","last_undegraded":"2024-06-04T16:23:09.264260+0000","last_fullsized":"2024-06-04T16:23:09.264260+0000","mapping_epoch":23,"log_start":"251'200","ondisk_log_start":"251'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'291","last_scrub_stamp":"2024-06-04T16:23:09.264173+0000","last_deep_scrub":"254'291","last_deep_scrub_stamp":"2024-06-04T16:23:09.264173+0000","last_clean_scrub_stamp":"2024-06-04T16:23:09.264173+0000","objects_scrubbed":2,"log_size":91,"log_dups_size":200,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T17:25:59.350082+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1456,"num_read_kb":1243,"num_write":452,"num_write_kb":208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2565,"num_omap_keys":10,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"254'57","reported_seq":559,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:45.076992+0000","last_change":"2024-06-04T15:52:36.498902+0000","last_active":"2024-06-04T16:22:45.076992+0000","last_peered":"2024-06-04T16:22:45.076992+0000","last_clean":"2024-06-04T16:22:45.076992+0000","last_became_active":"2024-06-04T15:52:36.498564+0000","last_became_peered":"2024-06-04T15:52:36.498564+0000","last_unstale":"2024-06-04T16:22:45.076992+0000","last_undegraded":"2024-06-04T16:22:45.076992+0000","last_fullsized":"2024-06-04T16:22:45.076992+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1395816,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":73,"num_read_kb":11423,"num_write":228,"num_write_kb":34926,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"251'38","reported_seq":550,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:45.076981+0000","last_change":"2024-06-04T15:52:36.490119+0000","last_active":"2024-06-04T16:22:45.076981+0000","last_peered":"2024-06-04T16:22:45.076981+0000","last_clean":"2024-06-04T16:22:45.076981+0000","last_became_active":"2024-06-04T15:52:36.489681+0000","last_became_peered":"2024-06-04T15:52:36.489681+0000","last_unstale":"2024-06-04T16:22:45.076981+0000","last_undegraded":"2024-06-04T16:22:45.076981+0000","last_fullsized":"2024-06-04T16:22:45.076981+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T15:52:35.455324+0000","last_clean_scrub_stamp":"2024-06-04T15:52:35.455324+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1395831,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":78,"num_read_kb":4250,"num_write":172,"num_write_kb":18293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,6],"acting":[3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"254'121","reported_seq":1033,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:01.992253+0000","last_change":"2024-06-04T16:23:01.992301+0000","last_active":"2024-06-04T16:23:01.992253+0000","last_peered":"2024-06-04T16:23:01.992253+0000","last_clean":"2024-06-04T16:23:01.992253+0000","last_became_active":"2024-06-04T15:52:38.488941+0000","last_became_peered":"2024-06-04T15:52:38.488941+0000","last_unstale":"2024-06-04T16:23:01.992253+0000","last_undegraded":"2024-06-04T16:23:01.992253+0000","last_fullsized":"2024-06-04T16:23:01.992253+0000","mapping_epoch":23,"log_start":"251'100","ondisk_log_start":"251'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'121","last_scrub_stamp":"2024-06-04T16:23:01.992144+0000","last_deep_scrub":"254'121","last_deep_scrub_stamp":"2024-06-04T16:23:01.992144+0000","last_clean_scrub_stamp":"2024-06-04T16:23:01.992144+0000","objects_scrubbed":2,"log_size":21,"log_dups_size":100,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T21:08:34.393894+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1004,"num_read_kb":976,"num_write":157,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2539,"num_omap_keys":10,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"251'45","reported_seq":552,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:23.381840+0000","last_change":"2024-06-04T16:23:23.381889+0000","last_active":"2024-06-04T16:23:23.381840+0000","last_peered":"2024-06-04T16:23:23.381840+0000","last_clean":"2024-06-04T16:23:23.381840+0000","last_became_active":"2024-06-04T15:52:36.496046+0000","last_became_peered":"2024-06-04T15:52:36.496046+0000","last_unstale":"2024-06-04T16:23:23.381840+0000","last_undegraded":"2024-06-04T16:23:23.381840+0000","last_fullsized":"2024-06-04T16:23:23.381840+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"251'45","last_scrub_stamp":"2024-06-04T16:23:23.381742+0000","last_deep_scrub":"251'45","last_deep_scrub_stamp":"2024-06-04T16:23:23.381742+0000","last_clean_scrub_stamp":"2024-06-04T16:23:23.381742+0000","objects_scrubbed":2,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T20:03:46.055994+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1069179,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":46,"num_read_kb":3657,"num_write":159,"num_write_kb":22961,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3],"acting":[5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.36","version":"254'113","reported_seq":828,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:21.411378+0000","last_change":"2024-06-04T16:23:21.411405+0000","last_active":"2024-06-04T16:23:21.411378+0000","last_peered":"2024-06-04T16:23:21.411378+0000","last_clean":"2024-06-04T16:23:21.411378+0000","last_became_active":"2024-06-04T15:52:38.474574+0000","last_became_peered":"2024-06-04T15:52:38.474574+0000","last_unstale":"2024-06-04T16:23:21.411378+0000","last_undegraded":"2024-06-04T16:23:21.411378+0000","last_fullsized":"2024-06-04T16:23:21.411378+0000","mapping_epoch":23,"log_start":"254'100","ondisk_log_start":"254'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'113","last_scrub_stamp":"2024-06-04T16:23:21.411261+0000","last_deep_scrub":"254'113","last_deep_scrub_stamp":"2024-06-04T16:23:21.411261+0000","last_clean_scrub_stamp":"2024-06-04T16:23:21.411261+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":100,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T02:22:44.411264+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":563,"num_read_kb":518,"num_write":138,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":16777216,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":169,"num_read_kb":189232,"num_write":179,"num_write_kb":125730,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":33554432,"data_stored":33554432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":133,"ondisk_log_size":133,"up":64,"acting":64,"num_store_stats":8},{"poolid":64,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4378,"num_read_kb":3242,"num_write":1279,"num_write_kb":637,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4455,"num_omap_keys":9,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":683,"ondisk_log_size":683,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":8922,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":3579,"num_read_kb":3443,"num_write":3611,"num_write_kb":1042,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1201,"num_omap_keys":7,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":319488,"data_stored":17844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1044,"ondisk_log_size":1044,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":566,"ondisk_log_size":566,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":300865,"num_objects":188,"num_object_clones":0,"num_object_copies":376,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":188,"num_whiteouts":0,"num_read":6099,"num_read_kb":7761,"num_write":3199,"num_write_kb":973,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":150352,"num_omap_keys":368,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1846,"ondisk_log_size":1846,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1533,"num_read_kb":1825,"num_write":20,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17,"ondisk_log_size":17,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":77,"num_object_clones":0,"num_object_copies":154,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":77,"num_whiteouts":0,"num_read":48565,"num_read_kb":44901,"num_write":11590,"num_write_kb":3535,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":77,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":33359,"num_omap_keys":139,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3825,"ondisk_log_size":3825,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":85563130,"num_objects":200,"num_object_clones":0,"num_object_copies":600,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":200,"num_whiteouts":0,"num_read":5481,"num_read_kb":1011284,"num_write":14360,"num_write_kb":1691909,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":130080768,"data_stored":130080768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3497,"ondisk_log_size":3497,"up":192,"acting":192,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":12,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4,"ondisk_log_size":4,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":16777216,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":170,"num_read_kb":185843,"num_write":179,"num_write_kb":125730,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":33554432,"data_stored":33554432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":132,"ondisk_log_size":132,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542522,"num_pgs":96,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":195128,"kb_used_data":23792,"kb_used_omap":1,"kb_used_meta":171326,"kb_avail":94176712,"statfs":{"total":96636764160,"available":96436953088,"internally_reserved":0,"allocated":24363008,"data_stored":22488525,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":175438282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542522,"num_pgs":108,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":73832,"kb_used_data":24608,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94298008,"statfs":{"total":96636764160,"available":96561160192,"internally_reserved":0,"allocated":25198592,"data_stored":23328559,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":50395591},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542521,"num_pgs":115,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":224796,"kb_used_data":22868,"kb_used_omap":1,"kb_used_meta":201918,"kb_avail":94147044,"statfs":{"total":96636764160,"available":96406573056,"internally_reserved":0,"allocated":23416832,"data_stored":21539413,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":206764485},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542519,"num_pgs":122,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":150856,"kb_used_data":33664,"kb_used_omap":1,"kb_used_meta":117182,"kb_avail":94220984,"statfs":{"total":96636764160,"available":96482287616,"internally_reserved":0,"allocated":34471936,"data_stored":32597872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":119994821},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542522,"num_pgs":119,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":205024,"kb_used_data":29464,"kb_used_omap":1,"kb_used_meta":175550,"kb_avail":94166816,"statfs":{"total":96636764160,"available":96426819584,"internally_reserved":0,"allocated":30171136,"data_stored":28278302,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":179763655},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542522,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":98200,"kb_used_data":22608,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94273640,"statfs":{"total":96636764160,"available":96536207360,"internally_reserved":0,"allocated":23150592,"data_stored":21269158,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":77396421},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542521,"num_pgs":98,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":266972,"kb_used_data":37268,"kb_used_omap":1,"kb_used_meta":229694,"kb_avail":94104868,"statfs":{"total":96636764160,"available":96363384832,"internally_reserved":0,"allocated":38162432,"data_stored":36275175,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":235207109},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542522,"num_pgs":93,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":80224,"kb_used_data":31000,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94291616,"statfs":{"total":96636764160,"available":96554614784,"internally_reserved":0,"allocated":31744000,"data_stored":29845910,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":25591808,"data_stored":25591808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":22585344,"data_stored":22585344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":14917632,"data_stored":14917632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":18190336,"data_stored":18190336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":18907136,"data_stored":18907136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":10403840,"data_stored":10403840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":10686464,"data_stored":10686464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8798208,"data_stored":8798208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":1139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":1364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2484,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1047,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":2789,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":2757,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2173,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2491,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1703,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":64,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":64,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":64,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":64,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":64,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":64,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":64,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":64,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":1048576,"data_stored":1048576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":1048576,"data_stored":1048576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":7340032,"data_stored":7340032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":5242880,"data_stored":5242880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4194304,"data_stored":4194304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":9437184,"data_stored":9437184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":5242880,"data_stored":5242880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":1048576,"data_stored":1048576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":10485760,"data_stored":10485760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4194304,"data_stored":4194304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":6291456,"data_stored":6291456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4194304,"data_stored":4194304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":1048576,"data_stored":1048576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":6291456,"data_stored":6291456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-06-04T16:23:28.200 INFO:tasks.ceph:pgid 67.1c last_scrub_stamp 2024-06-04T16:16:07.631263+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=16, tm_sec=7, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:28.201 INFO:tasks.ceph:pgid 65.1e last_scrub_stamp 2024-06-04T16:09:22.572686+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=9, tm_sec=22, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:28.201 INFO:tasks.ceph:pgid 67.1d last_scrub_stamp 2024-06-04T16:16:07.631263+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=16, tm_sec=7, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:28.201 INFO:tasks.ceph:pgid 65.1f last_scrub_stamp 2024-06-04T16:09:22.572686+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=9, tm_sec=22, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:28.201 INFO:tasks.ceph:pgid 67.1e last_scrub_stamp 2024-06-04T16:16:07.631263+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=16, tm_sec=7, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:28.201 INFO:tasks.ceph:pgid 66.1f last_scrub_stamp 2024-06-04T16:09:25.601105+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=9, tm_sec=25, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:28.202 INFO:tasks.ceph:pgid 67.1f last_scrub_stamp 2024-06-04T16:16:07.631263+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=16, tm_sec=7, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:28.202 INFO:tasks.ceph:pgid 67.18 last_scrub_stamp 2024-06-04T16:16:07.631263+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=16, tm_sec=7, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:28.202 INFO:tasks.ceph:pgid 67.1a last_scrub_stamp 2024-06-04T16:16:07.631263+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=16, tm_sec=7, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:28.202 INFO:tasks.ceph:pgid 66.1b last_scrub_stamp 2024-06-04T16:09:25.601105+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=9, tm_sec=25, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:28.203 INFO:tasks.ceph:pgid 67.14 last_scrub_stamp 2024-06-04T16:16:07.631263+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=16, tm_sec=7, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:28.203 INFO:tasks.ceph:pgid 65.16 last_scrub_stamp 2024-06-04T16:09:22.572686+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=9, tm_sec=22, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:28.203 INFO:tasks.ceph:pgid 67.15 last_scrub_stamp 2024-06-04T16:16:07.631263+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=16, tm_sec=7, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:28.203 INFO:tasks.ceph:pgid 65.17 last_scrub_stamp 2024-06-04T16:09:22.572686+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=9, tm_sec=22, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:28.203 INFO:tasks.ceph:pgid 67.17 last_scrub_stamp 2024-06-04T16:16:07.631263+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=16, tm_sec=7, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:28.204 INFO:tasks.ceph:pgid 67.10 last_scrub_stamp 2024-06-04T16:16:07.631263+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=16, tm_sec=7, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:28.204 INFO:tasks.ceph:pgid 66.10 last_scrub_stamp 2024-06-04T16:09:25.601105+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=9, tm_sec=25, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:28.204 INFO:tasks.ceph:pgid 67.12 last_scrub_stamp 2024-06-04T16:16:07.631263+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=16, tm_sec=7, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:28.204 INFO:tasks.ceph:pgid 67.13 last_scrub_stamp 2024-06-04T16:16:07.631263+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=16, tm_sec=7, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:28.204 INFO:tasks.ceph:pgid 66.12 last_scrub_stamp 2024-06-04T16:09:25.601105+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=9, tm_sec=25, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:28.205 INFO:tasks.ceph:pgid 67.c last_scrub_stamp 2024-06-04T16:16:07.631263+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=16, tm_sec=7, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:28.205 INFO:tasks.ceph:pgid 67.d last_scrub_stamp 2024-06-04T16:16:07.631263+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=16, tm_sec=7, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:28.205 INFO:tasks.ceph:pgid 67.e last_scrub_stamp 2024-06-04T16:16:07.631263+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=16, tm_sec=7, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:28.205 INFO:tasks.ceph:pgid 67.f last_scrub_stamp 2024-06-04T16:16:07.631263+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=16, tm_sec=7, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:28.205 INFO:tasks.ceph:pgid 67.8 last_scrub_stamp 2024-06-04T16:16:07.631263+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=16, tm_sec=7, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:28.206 INFO:tasks.ceph:pgid 67.9 last_scrub_stamp 2024-06-04T16:16:07.631263+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=16, tm_sec=7, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:28.206 INFO:tasks.ceph:pgid 67.b last_scrub_stamp 2024-06-04T16:16:07.631263+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=16, tm_sec=7, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:28.206 INFO:tasks.ceph:pgid 67.4 last_scrub_stamp 2024-06-04T16:16:07.631263+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=16, tm_sec=7, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:28.206 INFO:tasks.ceph:pgid 66.5 last_scrub_stamp 2024-06-04T16:09:25.601105+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=9, tm_sec=25, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:28.206 INFO:tasks.ceph:pgid 67.5 last_scrub_stamp 2024-06-04T16:16:07.631263+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=16, tm_sec=7, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:28.207 INFO:tasks.ceph:pgid 66.4 last_scrub_stamp 2024-06-04T16:09:25.601105+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=9, tm_sec=25, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:28.207 INFO:tasks.ceph:pgid 65.7 last_scrub_stamp 2024-06-04T16:09:22.572686+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=9, tm_sec=22, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:28.207 INFO:tasks.ceph:pgid 67.6 last_scrub_stamp 2024-06-04T16:16:07.631263+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=16, tm_sec=7, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:28.207 INFO:tasks.ceph:pgid 66.7 last_scrub_stamp 2024-06-04T16:09:25.601105+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=9, tm_sec=25, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:28.207 INFO:tasks.ceph:pgid 67.0 last_scrub_stamp 2024-06-04T16:16:07.631263+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=16, tm_sec=7, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:28.208 INFO:tasks.ceph:pgid 67.1 last_scrub_stamp 2024-06-04T16:16:07.631263+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=16, tm_sec=7, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:28.208 INFO:tasks.ceph:pgid 67.2 last_scrub_stamp 2024-06-04T16:16:07.631263+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=16, tm_sec=7, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:28.208 INFO:tasks.ceph:pgid 66.3 last_scrub_stamp 2024-06-04T16:09:25.601105+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=9, tm_sec=25, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:28.208 INFO:tasks.ceph:pgid 67.3 last_scrub_stamp 2024-06-04T16:16:07.631263+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=16, tm_sec=7, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:28.208 INFO:tasks.ceph:pgid 66.2 last_scrub_stamp 2024-06-04T16:09:25.601105+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=9, tm_sec=25, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:28.209 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-06-04T15:52:35.455324+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=35, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:28.209 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-06-04T15:52:37.459483+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=37, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:28.209 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-06-04T15:52:35.455324+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=35, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:28.209 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-06-04T15:52:37.459483+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=37, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:28.209 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-06-04T15:52:35.455324+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=35, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:28.210 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-06-04T15:52:35.455324+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=35, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:28.210 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2024-06-04T15:52:39.463103+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=39, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:28.210 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-06-04T15:52:37.459483+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=37, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:28.210 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-06-04T15:52:35.455324+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=35, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:28.211 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-06-04T15:52:35.455324+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=35, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:28.211 INFO:tasks.ceph:pgid 6.f last_scrub_stamp 2024-06-04T15:52:41.476734+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=41, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:28.211 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-06-04T15:52:35.455324+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=35, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:28.212 INFO:tasks.ceph:pgid 1.1 last_scrub_stamp 2024-06-04T15:52:21.400880+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=21, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:28.212 INFO:tasks.ceph:pgid 6.6 last_scrub_stamp 2024-06-04T15:52:41.476734+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=41, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:28.212 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-06-04T15:52:35.455324+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=35, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:28.212 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-06-04T15:52:21.400880+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=21, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:28.213 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2024-06-04T15:52:39.463103+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=39, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:28.213 INFO:tasks.ceph:pgid 1.6 last_scrub_stamp 2024-06-04T15:52:21.400880+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=21, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:28.213 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-06-04T15:52:35.455324+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=35, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:28.214 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-06-04T15:52:45.513877+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=45, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:28.214 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-06-04T15:52:35.455324+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=35, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:28.214 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-06-04T15:52:37.459483+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=37, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:28.214 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-06-04T15:52:35.455324+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=35, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:28.215 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-06-04T15:52:37.459483+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=37, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:28.215 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-06-04T15:52:35.455324+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=35, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:28.215 INFO:tasks.ceph:pgid 6.18 last_scrub_stamp 2024-06-04T15:52:41.476734+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=41, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:28.215 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-06-04T15:52:35.455324+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=35, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:28.216 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-06-04T15:52:35.455324+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=35, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:28.216 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-06-04T15:52:37.459483+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=37, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:28.216 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-06-04T15:52:35.455324+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=35, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:28.216 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-06-04T15:52:35.455324+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=35, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:28.216 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-06-04T15:52:37.459483+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=37, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:28.217 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-06-04T15:52:35.455324+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=35, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:28.217 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-06-04T15:52:35.455324+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=35, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:28.217 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-06-04T15:52:37.459483+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=37, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:28.217 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-06-04T15:52:35.455324+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=35, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:28.217 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-06-04T15:52:35.455324+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=35, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:28.218 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-06-04T15:52:35.455324+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=15, tm_min=52, tm_sec=35, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:28.218 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-06-04T16:23:48.218 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-06-04T16:23:48.560 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:23:48.571 INFO:teuthology.orchestra.run.smithi144.stderr:dumped all 2024-06-04T16:23:48.573 INFO:teuthology.orchestra.run.smithi144.stdout:{"pg_ready":true,"pg_map":{"version":1191,"stamp":"2024-06-04T16:23:47.582309+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":120019510,"num_objects":545,"num_object_clones":0,"num_object_copies":1290,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":545,"num_whiteouts":0,"num_read":70048,"num_read_kb":1447594,"num_write":34530,"num_write_kb":1951205,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":99,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":191792,"num_omap_keys":534,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11753,"ondisk_log_size":11753,"up":850,"acting":850,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":850,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1295032,"kb_used_data":225272,"kb_used_omap":12,"kb_used_meta":1069683,"kb_avail":753679688,"statfs":{"total":773094113280,"available":771768000512,"internally_reserved":0,"allocated":230678528,"data_stored":215622914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":1095355953},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2012,"num_omap_keys":8,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005384"},"pg_stats":[{"pgid":"67.1c","version":"0'0","reported_seq":24,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:26.763016+0000","last_change":"2024-06-04T16:23:26.763016+0000","last_active":"2024-06-04T16:23:26.763016+0000","last_peered":"2024-06-04T16:23:26.763016+0000","last_clean":"2024-06-04T16:23:26.763016+0000","last_became_active":"2024-06-04T16:16:08.658205+0000","last_became_peered":"2024-06-04T16:16:08.658205+0000","last_unstale":"2024-06-04T16:23:26.763016+0000","last_undegraded":"2024-06-04T16:23:26.763016+0000","last_fullsized":"2024-06-04T16:23:26.763016+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:23:26.762877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:23:26.762877+0000","last_clean_scrub_stamp":"2024-06-04T16:23:26.762877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T20:49:22.849059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1d","version":"251'2","reported_seq":36,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:06.405019+0000","last_change":"2024-06-04T16:23:06.405045+0000","last_active":"2024-06-04T16:23:06.405019+0000","last_peered":"2024-06-04T16:23:06.405019+0000","last_clean":"2024-06-04T16:23:06.405019+0000","last_became_active":"2024-06-04T16:09:26.627678+0000","last_became_peered":"2024-06-04T16:09:26.627678+0000","last_unstale":"2024-06-04T16:23:06.405019+0000","last_undegraded":"2024-06-04T16:23:06.405019+0000","last_fullsized":"2024-06-04T16:23:06.405019+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"251'2","last_scrub_stamp":"2024-06-04T16:23:06.404918+0000","last_deep_scrub":"251'2","last_deep_scrub_stamp":"2024-06-04T16:23:06.404918+0000","last_clean_scrub_stamp":"2024-06-04T16:23:06.404918+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T17:19:48.169731+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1e","version":"254'2","reported_seq":43,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:30.899471+0000","last_change":"2024-06-04T16:23:30.899499+0000","last_active":"2024-06-04T16:23:30.899471+0000","last_peered":"2024-06-04T16:23:30.899471+0000","last_clean":"2024-06-04T16:23:30.899471+0000","last_became_active":"2024-06-04T16:09:23.610020+0000","last_became_peered":"2024-06-04T16:09:23.610020+0000","last_unstale":"2024-06-04T16:23:30.899471+0000","last_undegraded":"2024-06-04T16:23:30.899471+0000","last_fullsized":"2024-06-04T16:23:30.899471+0000","mapping_epoch":246,"log_start":"0'0","ondisk_log_start":"0'0","created":246,"last_epoch_clean":247,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'2","last_scrub_stamp":"2024-06-04T16:23:30.899375+0000","last_deep_scrub":"254'2","last_deep_scrub_stamp":"2024-06-04T16:23:30.899375+0000","last_clean_scrub_stamp":"2024-06-04T16:23:30.899375+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T22:21:31.966657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"64.1f","version":"251'21","reported_seq":103,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:53.425228+0000","last_change":"2024-06-04T16:22:53.425264+0000","last_active":"2024-06-04T16:22:53.425228+0000","last_peered":"2024-06-04T16:22:53.425228+0000","last_clean":"2024-06-04T16:22:53.425228+0000","last_became_active":"2024-06-04T16:07:09.402073+0000","last_became_peered":"2024-06-04T16:07:09.402073+0000","last_unstale":"2024-06-04T16:22:53.425228+0000","last_undegraded":"2024-06-04T16:22:53.425228+0000","last_fullsized":"2024-06-04T16:22:53.425228+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":243,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"251'21","last_scrub_stamp":"2024-06-04T16:22:53.425132+0000","last_deep_scrub":"251'21","last_deep_scrub_stamp":"2024-06-04T16:22:53.425132+0000","last_clean_scrub_stamp":"2024-06-04T16:22:53.425132+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T16:33:19.953015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":108,"num_read_kb":75,"num_write":41,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1d","version":"0'0","reported_seq":24,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:29.290297+0000","last_change":"2024-06-04T16:23:29.290297+0000","last_active":"2024-06-04T16:23:29.290297+0000","last_peered":"2024-06-04T16:23:29.290297+0000","last_clean":"2024-06-04T16:23:29.290297+0000","last_became_active":"2024-06-04T16:16:08.656388+0000","last_became_peered":"2024-06-04T16:16:08.656388+0000","last_unstale":"2024-06-04T16:23:29.290297+0000","last_undegraded":"2024-06-04T16:23:29.290297+0000","last_fullsized":"2024-06-04T16:23:29.290297+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:23:29.290129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:23:29.290129+0000","last_clean_scrub_stamp":"2024-06-04T16:23:29.290129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T21:24:30.090203+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.1c","version":"254'2","reported_seq":35,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:56.032254+0000","last_change":"2024-06-04T16:22:56.032296+0000","last_active":"2024-06-04T16:22:56.032254+0000","last_peered":"2024-06-04T16:22:56.032254+0000","last_clean":"2024-06-04T16:22:56.032254+0000","last_became_active":"2024-06-04T16:09:26.626964+0000","last_became_peered":"2024-06-04T16:09:26.626964+0000","last_unstale":"2024-06-04T16:22:56.032254+0000","last_undegraded":"2024-06-04T16:22:56.032254+0000","last_fullsized":"2024-06-04T16:22:56.032254+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'2","last_scrub_stamp":"2024-06-04T16:22:56.032145+0000","last_deep_scrub":"254'2","last_deep_scrub_stamp":"2024-06-04T16:22:56.032145+0000","last_clean_scrub_stamp":"2024-06-04T16:22:56.032145+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T17:55:10.954470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1f","version":"254'4","reported_seq":46,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:28.871716+0000","last_change":"2024-06-04T16:23:28.871746+0000","last_active":"2024-06-04T16:23:28.871716+0000","last_peered":"2024-06-04T16:23:28.871716+0000","last_clean":"2024-06-04T16:23:28.871716+0000","last_became_active":"2024-06-04T16:09:23.608251+0000","last_became_peered":"2024-06-04T16:09:23.608251+0000","last_unstale":"2024-06-04T16:23:28.871716+0000","last_undegraded":"2024-06-04T16:23:28.871716+0000","last_fullsized":"2024-06-04T16:23:28.871716+0000","mapping_epoch":246,"log_start":"0'0","ondisk_log_start":"0'0","created":246,"last_epoch_clean":247,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'4","last_scrub_stamp":"2024-06-04T16:23:28.871643+0000","last_deep_scrub":"254'4","last_deep_scrub_stamp":"2024-06-04T16:23:28.871643+0000","last_clean_scrub_stamp":"2024-06-04T16:23:28.871643+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T23:07:23.476595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":8192,"num_write":4,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"64.1e","version":"251'15","reported_seq":89,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:59.041515+0000","last_change":"2024-06-04T16:22:59.041515+0000","last_active":"2024-06-04T16:22:59.041515+0000","last_peered":"2024-06-04T16:22:59.041515+0000","last_clean":"2024-06-04T16:22:59.041515+0000","last_became_active":"2024-06-04T16:07:09.511253+0000","last_became_peered":"2024-06-04T16:07:09.511253+0000","last_unstale":"2024-06-04T16:22:59.041515+0000","last_undegraded":"2024-06-04T16:22:59.041515+0000","last_fullsized":"2024-06-04T16:22:59.041515+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":243,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"251'15","last_scrub_stamp":"2024-06-04T16:22:59.041341+0000","last_deep_scrub":"251'15","last_deep_scrub_stamp":"2024-06-04T16:22:59.041341+0000","last_clean_scrub_stamp":"2024-06-04T16:22:59.041341+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T18:09:07.672420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":58,"num_write":26,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1e","version":"0'0","reported_seq":24,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:40.355007+0000","last_change":"2024-06-04T16:23:40.355043+0000","last_active":"2024-06-04T16:23:40.355007+0000","last_peered":"2024-06-04T16:23:40.355007+0000","last_clean":"2024-06-04T16:23:40.355007+0000","last_became_active":"2024-06-04T16:16:08.660635+0000","last_became_peered":"2024-06-04T16:16:08.660635+0000","last_unstale":"2024-06-04T16:23:40.355007+0000","last_undegraded":"2024-06-04T16:23:40.355007+0000","last_fullsized":"2024-06-04T16:23:40.355007+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:23:40.354873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:23:40.354873+0000","last_clean_scrub_stamp":"2024-06-04T16:23:40.354873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T03:07:14.790083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1f","version":"0'0","reported_seq":33,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:26.242339+0000","last_change":"2024-06-04T16:23:26.242384+0000","last_active":"2024-06-04T16:23:26.242339+0000","last_peered":"2024-06-04T16:23:26.242339+0000","last_clean":"2024-06-04T16:23:26.242339+0000","last_became_active":"2024-06-04T16:09:26.624510+0000","last_became_peered":"2024-06-04T16:09:26.624510+0000","last_unstale":"2024-06-04T16:23:26.242339+0000","last_undegraded":"2024-06-04T16:23:26.242339+0000","last_fullsized":"2024-06-04T16:23:26.242339+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:23:26.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:23:26.242226+0000","last_clean_scrub_stamp":"2024-06-04T16:23:26.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T23:46:14.456771+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1c","version":"0'0","reported_seq":38,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:54.138875+0000","last_change":"2024-06-04T16:22:54.138938+0000","last_active":"2024-06-04T16:22:54.138875+0000","last_peered":"2024-06-04T16:22:54.138875+0000","last_clean":"2024-06-04T16:22:54.138875+0000","last_became_active":"2024-06-04T16:09:23.612278+0000","last_became_peered":"2024-06-04T16:09:23.612278+0000","last_unstale":"2024-06-04T16:22:54.138875+0000","last_undegraded":"2024-06-04T16:22:54.138875+0000","last_fullsized":"2024-06-04T16:22:54.138875+0000","mapping_epoch":246,"log_start":"0'0","ondisk_log_start":"0'0","created":246,"last_epoch_clean":247,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:22:54.138763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:22:54.138763+0000","last_clean_scrub_stamp":"2024-06-04T16:22:54.138763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T18:25:29.872798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"64.1d","version":"251'28","reported_seq":123,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:56.120753+0000","last_change":"2024-06-04T16:22:56.120781+0000","last_active":"2024-06-04T16:22:56.120753+0000","last_peered":"2024-06-04T16:22:56.120753+0000","last_clean":"2024-06-04T16:22:56.120753+0000","last_became_active":"2024-06-04T16:07:09.511154+0000","last_became_peered":"2024-06-04T16:07:09.511154+0000","last_unstale":"2024-06-04T16:22:56.120753+0000","last_undegraded":"2024-06-04T16:22:56.120753+0000","last_fullsized":"2024-06-04T16:22:56.120753+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":243,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"251'28","last_scrub_stamp":"2024-06-04T16:22:56.120659+0000","last_deep_scrub":"251'28","last_deep_scrub_stamp":"2024-06-04T16:22:56.120659+0000","last_clean_scrub_stamp":"2024-06-04T16:22:56.120659+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T00:05:26.471359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":150,"num_read_kb":106,"num_write":50,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.1f","version":"0'0","reported_seq":24,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:41.401820+0000","last_change":"2024-06-04T16:23:41.401872+0000","last_active":"2024-06-04T16:23:41.401820+0000","last_peered":"2024-06-04T16:23:41.401820+0000","last_clean":"2024-06-04T16:23:41.401820+0000","last_became_active":"2024-06-04T16:16:08.660669+0000","last_became_peered":"2024-06-04T16:16:08.660669+0000","last_unstale":"2024-06-04T16:23:41.401820+0000","last_undegraded":"2024-06-04T16:23:41.401820+0000","last_fullsized":"2024-06-04T16:23:41.401820+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:23:41.401719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:23:41.401719+0000","last_clean_scrub_stamp":"2024-06-04T16:23:41.401719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T21:00:41.463198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1e","version":"254'2","reported_seq":37,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:47.038152+0000","last_change":"2024-06-04T16:22:47.038152+0000","last_active":"2024-06-04T16:22:47.038152+0000","last_peered":"2024-06-04T16:22:47.038152+0000","last_clean":"2024-06-04T16:22:47.038152+0000","last_became_active":"2024-06-04T16:09:26.621326+0000","last_became_peered":"2024-06-04T16:09:26.621326+0000","last_unstale":"2024-06-04T16:22:47.038152+0000","last_undegraded":"2024-06-04T16:22:47.038152+0000","last_fullsized":"2024-06-04T16:22:47.038152+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'2","last_scrub_stamp":"2024-06-04T16:22:47.037993+0000","last_deep_scrub":"254'2","last_deep_scrub_stamp":"2024-06-04T16:22:47.037993+0000","last_clean_scrub_stamp":"2024-06-04T16:22:47.037993+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T21:14:40.434297+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1d","version":"254'5","reported_seq":46,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:47.213650+0000","last_change":"2024-06-04T16:22:47.213678+0000","last_active":"2024-06-04T16:22:47.213650+0000","last_peered":"2024-06-04T16:22:47.213650+0000","last_clean":"2024-06-04T16:22:47.213650+0000","last_became_active":"2024-06-04T16:09:23.606918+0000","last_became_peered":"2024-06-04T16:09:23.606918+0000","last_unstale":"2024-06-04T16:22:47.213650+0000","last_undegraded":"2024-06-04T16:22:47.213650+0000","last_fullsized":"2024-06-04T16:22:47.213650+0000","mapping_epoch":246,"log_start":"0'0","ondisk_log_start":"0'0","created":246,"last_epoch_clean":247,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'5","last_scrub_stamp":"2024-06-04T16:22:47.213558+0000","last_deep_scrub":"254'5","last_deep_scrub_stamp":"2024-06-04T16:22:47.213558+0000","last_clean_scrub_stamp":"2024-06-04T16:22:47.213558+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T21:54:10.067561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":4144,"num_write":10,"num_write_kb":4144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"64.1c","version":"251'37","reported_seq":151,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:49.285431+0000","last_change":"2024-06-04T16:22:49.285460+0000","last_active":"2024-06-04T16:22:49.285431+0000","last_peered":"2024-06-04T16:22:49.285431+0000","last_clean":"2024-06-04T16:22:49.285431+0000","last_became_active":"2024-06-04T16:07:09.509671+0000","last_became_peered":"2024-06-04T16:07:09.509671+0000","last_unstale":"2024-06-04T16:22:49.285431+0000","last_undegraded":"2024-06-04T16:22:49.285431+0000","last_fullsized":"2024-06-04T16:22:49.285431+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":243,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"251'37","last_scrub_stamp":"2024-06-04T16:22:49.285327+0000","last_deep_scrub":"251'37","last_deep_scrub_stamp":"2024-06-04T16:22:49.285327+0000","last_clean_scrub_stamp":"2024-06-04T16:22:49.285327+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T20:32:45.523245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":197,"num_read_kb":141,"num_write":70,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.18","version":"0'0","reported_seq":16,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:45.077794+0000","last_change":"2024-06-04T16:16:08.664509+0000","last_active":"2024-06-04T16:22:45.077794+0000","last_peered":"2024-06-04T16:22:45.077794+0000","last_clean":"2024-06-04T16:22:45.077794+0000","last_became_active":"2024-06-04T16:16:08.664252+0000","last_became_peered":"2024-06-04T16:16:08.664252+0000","last_unstale":"2024-06-04T16:22:45.077794+0000","last_undegraded":"2024-06-04T16:22:45.077794+0000","last_fullsized":"2024-06-04T16:22:45.077794+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_clean_scrub_stamp":"2024-06-04T16:16:07.631263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.19","version":"254'7","reported_seq":44,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:18.779710+0000","last_change":"2024-06-04T16:23:18.779734+0000","last_active":"2024-06-04T16:23:18.779710+0000","last_peered":"2024-06-04T16:23:18.779710+0000","last_clean":"2024-06-04T16:23:18.779710+0000","last_became_active":"2024-06-04T16:09:26.624681+0000","last_became_peered":"2024-06-04T16:09:26.624681+0000","last_unstale":"2024-06-04T16:23:18.779710+0000","last_undegraded":"2024-06-04T16:23:18.779710+0000","last_fullsized":"2024-06-04T16:23:18.779710+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'7","last_scrub_stamp":"2024-06-04T16:23:18.779618+0000","last_deep_scrub":"254'7","last_deep_scrub_stamp":"2024-06-04T16:23:18.779618+0000","last_clean_scrub_stamp":"2024-06-04T16:23:18.779618+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T00:15:42.722331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":9216,"num_write":12,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1a","version":"251'3","reported_seq":43,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:51.476092+0000","last_change":"2024-06-04T16:22:51.476119+0000","last_active":"2024-06-04T16:22:51.476092+0000","last_peered":"2024-06-04T16:22:51.476092+0000","last_clean":"2024-06-04T16:22:51.476092+0000","last_became_active":"2024-06-04T16:09:23.609102+0000","last_became_peered":"2024-06-04T16:09:23.609102+0000","last_unstale":"2024-06-04T16:22:51.476092+0000","last_undegraded":"2024-06-04T16:22:51.476092+0000","last_fullsized":"2024-06-04T16:22:51.476092+0000","mapping_epoch":246,"log_start":"0'0","ondisk_log_start":"0'0","created":246,"last_epoch_clean":247,"parent":"0.0","parent_split_bits":0,"last_scrub":"251'3","last_scrub_stamp":"2024-06-04T16:22:51.475999+0000","last_deep_scrub":"251'3","last_deep_scrub_stamp":"2024-06-04T16:22:51.475999+0000","last_clean_scrub_stamp":"2024-06-04T16:22:51.475999+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T00:37:04.803162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"64.1b","version":"251'96","reported_seq":342,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:56.001961+0000","last_change":"2024-06-04T16:22:56.001988+0000","last_active":"2024-06-04T16:22:56.001961+0000","last_peered":"2024-06-04T16:22:56.001961+0000","last_clean":"2024-06-04T16:22:56.001961+0000","last_became_active":"2024-06-04T16:07:09.404202+0000","last_became_peered":"2024-06-04T16:07:09.404202+0000","last_unstale":"2024-06-04T16:22:56.001961+0000","last_undegraded":"2024-06-04T16:22:56.001961+0000","last_fullsized":"2024-06-04T16:22:56.001961+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":243,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"251'96","last_scrub_stamp":"2024-06-04T16:22:56.001853+0000","last_deep_scrub":"251'96","last_deep_scrub_stamp":"2024-06-04T16:22:56.001853+0000","last_clean_scrub_stamp":"2024-06-04T16:22:56.001853+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T03:12:58.679536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":591,"num_read_kb":533,"num_write":104,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.19","version":"0'0","reported_seq":24,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:18.878905+0000","last_change":"2024-06-04T16:23:18.878905+0000","last_active":"2024-06-04T16:23:18.878905+0000","last_peered":"2024-06-04T16:23:18.878905+0000","last_clean":"2024-06-04T16:23:18.878905+0000","last_became_active":"2024-06-04T16:16:08.658696+0000","last_became_peered":"2024-06-04T16:16:08.658696+0000","last_unstale":"2024-06-04T16:23:18.878905+0000","last_undegraded":"2024-06-04T16:23:18.878905+0000","last_fullsized":"2024-06-04T16:23:18.878905+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:23:18.878733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:23:18.878733+0000","last_clean_scrub_stamp":"2024-06-04T16:23:18.878733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T17:31:25.559043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.18","version":"254'7","reported_seq":43,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:50.332112+0000","last_change":"2024-06-04T16:22:50.332142+0000","last_active":"2024-06-04T16:22:50.332112+0000","last_peered":"2024-06-04T16:22:50.332112+0000","last_clean":"2024-06-04T16:22:50.332112+0000","last_became_active":"2024-06-04T16:09:26.624322+0000","last_became_peered":"2024-06-04T16:09:26.624322+0000","last_unstale":"2024-06-04T16:22:50.332112+0000","last_undegraded":"2024-06-04T16:22:50.332112+0000","last_fullsized":"2024-06-04T16:22:50.332112+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'7","last_scrub_stamp":"2024-06-04T16:22:50.332010+0000","last_deep_scrub":"254'7","last_deep_scrub_stamp":"2024-06-04T16:22:50.332010+0000","last_clean_scrub_stamp":"2024-06-04T16:22:50.332010+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T03:36:03.301991+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":8192,"num_write":12,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1b","version":"254'15","reported_seq":71,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:22.204972+0000","last_change":"2024-06-04T16:23:22.205010+0000","last_active":"2024-06-04T16:23:22.204972+0000","last_peered":"2024-06-04T16:23:22.204972+0000","last_clean":"2024-06-04T16:23:22.204972+0000","last_became_active":"2024-06-04T16:09:23.613109+0000","last_became_peered":"2024-06-04T16:09:23.613109+0000","last_unstale":"2024-06-04T16:23:22.204972+0000","last_undegraded":"2024-06-04T16:23:22.204972+0000","last_fullsized":"2024-06-04T16:23:22.204972+0000","mapping_epoch":246,"log_start":"0'0","ondisk_log_start":"0'0","created":246,"last_epoch_clean":247,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'15","last_scrub_stamp":"2024-06-04T16:23:22.204872+0000","last_deep_scrub":"254'15","last_deep_scrub_stamp":"2024-06-04T16:23:22.204872+0000","last_clean_scrub_stamp":"2024-06-04T16:23:22.204872+0000","objects_scrubbed":2,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T16:45:38.504686+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":26,"num_read_kb":29700,"num_write":16,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"64.1a","version":"251'15","reported_seq":84,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:52.099476+0000","last_change":"2024-06-04T16:22:52.099503+0000","last_active":"2024-06-04T16:22:52.099476+0000","last_peered":"2024-06-04T16:22:52.099476+0000","last_clean":"2024-06-04T16:22:52.099476+0000","last_became_active":"2024-06-04T16:07:09.406976+0000","last_became_peered":"2024-06-04T16:07:09.406976+0000","last_unstale":"2024-06-04T16:22:52.099476+0000","last_undegraded":"2024-06-04T16:22:52.099476+0000","last_fullsized":"2024-06-04T16:22:52.099476+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":243,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"251'15","last_scrub_stamp":"2024-06-04T16:22:52.099378+0000","last_deep_scrub":"251'15","last_deep_scrub_stamp":"2024-06-04T16:22:52.099378+0000","last_clean_scrub_stamp":"2024-06-04T16:22:52.099378+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T02:39:01.268878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":52,"num_write":29,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.1a","version":"0'0","reported_seq":24,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:35.038390+0000","last_change":"2024-06-04T16:23:35.038390+0000","last_active":"2024-06-04T16:23:35.038390+0000","last_peered":"2024-06-04T16:23:35.038390+0000","last_clean":"2024-06-04T16:23:35.038390+0000","last_became_active":"2024-06-04T16:16:08.664200+0000","last_became_peered":"2024-06-04T16:16:08.664200+0000","last_unstale":"2024-06-04T16:23:35.038390+0000","last_undegraded":"2024-06-04T16:23:35.038390+0000","last_fullsized":"2024-06-04T16:23:35.038390+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:23:35.038263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:23:35.038263+0000","last_clean_scrub_stamp":"2024-06-04T16:23:35.038263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T19:42:20.840250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.1b","version":"254'3","reported_seq":37,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:26.316337+0000","last_change":"2024-06-04T16:23:26.316382+0000","last_active":"2024-06-04T16:23:26.316337+0000","last_peered":"2024-06-04T16:23:26.316337+0000","last_clean":"2024-06-04T16:23:26.316337+0000","last_became_active":"2024-06-04T16:09:26.626528+0000","last_became_peered":"2024-06-04T16:09:26.626528+0000","last_unstale":"2024-06-04T16:23:26.316337+0000","last_undegraded":"2024-06-04T16:23:26.316337+0000","last_fullsized":"2024-06-04T16:23:26.316337+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'3","last_scrub_stamp":"2024-06-04T16:23:26.316238+0000","last_deep_scrub":"254'3","last_deep_scrub_stamp":"2024-06-04T16:23:26.316238+0000","last_clean_scrub_stamp":"2024-06-04T16:23:26.316238+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T20:01:19.475710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8192,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.18","version":"254'4","reported_seq":45,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:50.225354+0000","last_change":"2024-06-04T16:22:50.225379+0000","last_active":"2024-06-04T16:22:50.225354+0000","last_peered":"2024-06-04T16:22:50.225354+0000","last_clean":"2024-06-04T16:22:50.225354+0000","last_became_active":"2024-06-04T16:09:23.609952+0000","last_became_peered":"2024-06-04T16:09:23.609952+0000","last_unstale":"2024-06-04T16:22:50.225354+0000","last_undegraded":"2024-06-04T16:22:50.225354+0000","last_fullsized":"2024-06-04T16:22:50.225354+0000","mapping_epoch":246,"log_start":"0'0","ondisk_log_start":"0'0","created":246,"last_epoch_clean":247,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'4","last_scrub_stamp":"2024-06-04T16:22:50.225242+0000","last_deep_scrub":"254'4","last_deep_scrub_stamp":"2024-06-04T16:22:50.225242+0000","last_clean_scrub_stamp":"2024-06-04T16:22:50.225242+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T19:11:13.044639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5120,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"64.19","version":"251'22","reported_seq":105,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:52.389508+0000","last_change":"2024-06-04T16:22:52.389536+0000","last_active":"2024-06-04T16:22:52.389508+0000","last_peered":"2024-06-04T16:22:52.389508+0000","last_clean":"2024-06-04T16:22:52.389508+0000","last_became_active":"2024-06-04T16:07:09.402316+0000","last_became_peered":"2024-06-04T16:07:09.402316+0000","last_unstale":"2024-06-04T16:22:52.389508+0000","last_undegraded":"2024-06-04T16:22:52.389508+0000","last_fullsized":"2024-06-04T16:22:52.389508+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":243,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"251'22","last_scrub_stamp":"2024-06-04T16:22:52.389413+0000","last_deep_scrub":"251'22","last_deep_scrub_stamp":"2024-06-04T16:22:52.389413+0000","last_clean_scrub_stamp":"2024-06-04T16:22:52.389413+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T17:48:23.344607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":114,"num_read_kb":79,"num_write":44,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1b","version":"0'0","reported_seq":24,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:24.681708+0000","last_change":"2024-06-04T16:23:24.681708+0000","last_active":"2024-06-04T16:23:24.681708+0000","last_peered":"2024-06-04T16:23:24.681708+0000","last_clean":"2024-06-04T16:23:24.681708+0000","last_became_active":"2024-06-04T16:16:08.653931+0000","last_became_peered":"2024-06-04T16:16:08.653931+0000","last_unstale":"2024-06-04T16:23:24.681708+0000","last_undegraded":"2024-06-04T16:23:24.681708+0000","last_fullsized":"2024-06-04T16:23:24.681708+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:23:24.681563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:23:24.681563+0000","last_clean_scrub_stamp":"2024-06-04T16:23:24.681563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T20:41:20.833917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1a","version":"254'9","reported_seq":50,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:16.876737+0000","last_change":"2024-06-04T16:23:16.876782+0000","last_active":"2024-06-04T16:23:16.876737+0000","last_peered":"2024-06-04T16:23:16.876737+0000","last_clean":"2024-06-04T16:23:16.876737+0000","last_became_active":"2024-06-04T16:09:26.623459+0000","last_became_peered":"2024-06-04T16:09:26.623459+0000","last_unstale":"2024-06-04T16:23:16.876737+0000","last_undegraded":"2024-06-04T16:23:16.876737+0000","last_fullsized":"2024-06-04T16:23:16.876737+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'9","last_scrub_stamp":"2024-06-04T16:23:16.876629+0000","last_deep_scrub":"254'9","last_deep_scrub_stamp":"2024-06-04T16:23:16.876629+0000","last_clean_scrub_stamp":"2024-06-04T16:23:16.876629+0000","objects_scrubbed":1,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T22:16:04.324630+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":9218,"num_write":7,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.19","version":"254'7","reported_seq":52,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:54.037549+0000","last_change":"2024-06-04T16:22:54.037579+0000","last_active":"2024-06-04T16:22:54.037549+0000","last_peered":"2024-06-04T16:22:54.037549+0000","last_clean":"2024-06-04T16:22:54.037549+0000","last_became_active":"2024-06-04T16:09:23.606966+0000","last_became_peered":"2024-06-04T16:09:23.606966+0000","last_unstale":"2024-06-04T16:22:54.037549+0000","last_undegraded":"2024-06-04T16:22:54.037549+0000","last_fullsized":"2024-06-04T16:22:54.037549+0000","mapping_epoch":246,"log_start":"0'0","ondisk_log_start":"0'0","created":246,"last_epoch_clean":247,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'7","last_scrub_stamp":"2024-06-04T16:22:54.037448+0000","last_deep_scrub":"254'7","last_deep_scrub_stamp":"2024-06-04T16:22:54.037448+0000","last_clean_scrub_stamp":"2024-06-04T16:22:54.037448+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T17:00:32.140550+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":11,"num_read_kb":8194,"num_write":5,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"64.18","version":"251'39","reported_seq":153,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:45.120633+0000","last_change":"2024-06-04T16:22:45.120654+0000","last_active":"2024-06-04T16:22:45.120633+0000","last_peered":"2024-06-04T16:22:45.120633+0000","last_clean":"2024-06-04T16:22:45.120633+0000","last_became_active":"2024-06-04T16:07:09.404055+0000","last_became_peered":"2024-06-04T16:07:09.404055+0000","last_unstale":"2024-06-04T16:22:45.120633+0000","last_undegraded":"2024-06-04T16:22:45.120633+0000","last_fullsized":"2024-06-04T16:22:45.120633+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":243,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"251'39","last_scrub_stamp":"2024-06-04T16:22:45.120553+0000","last_deep_scrub":"251'39","last_deep_scrub_stamp":"2024-06-04T16:22:45.120553+0000","last_clean_scrub_stamp":"2024-06-04T16:22:45.120553+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T19:34:39.593186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":206,"num_read_kb":146,"num_write":71,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.14","version":"254'2","reported_seq":26,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:42.397718+0000","last_change":"2024-06-04T16:23:42.397746+0000","last_active":"2024-06-04T16:23:42.397718+0000","last_peered":"2024-06-04T16:23:42.397718+0000","last_clean":"2024-06-04T16:23:42.397718+0000","last_became_active":"2024-06-04T16:16:08.661995+0000","last_became_peered":"2024-06-04T16:16:08.661995+0000","last_unstale":"2024-06-04T16:23:42.397718+0000","last_undegraded":"2024-06-04T16:23:42.397718+0000","last_fullsized":"2024-06-04T16:23:42.397718+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'2","last_scrub_stamp":"2024-06-04T16:23:42.397627+0000","last_deep_scrub":"254'2","last_deep_scrub_stamp":"2024-06-04T16:23:42.397627+0000","last_clean_scrub_stamp":"2024-06-04T16:23:42.397627+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T02:53:05.087970+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.15","version":"254'5","reported_seq":39,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:15.917343+0000","last_change":"2024-06-04T16:23:15.917369+0000","last_active":"2024-06-04T16:23:15.917343+0000","last_peered":"2024-06-04T16:23:15.917343+0000","last_clean":"2024-06-04T16:23:15.917343+0000","last_became_active":"2024-06-04T16:09:26.623442+0000","last_became_peered":"2024-06-04T16:09:26.623442+0000","last_unstale":"2024-06-04T16:23:15.917343+0000","last_undegraded":"2024-06-04T16:23:15.917343+0000","last_fullsized":"2024-06-04T16:23:15.917343+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'5","last_scrub_stamp":"2024-06-04T16:23:15.917252+0000","last_deep_scrub":"254'5","last_deep_scrub_stamp":"2024-06-04T16:23:15.917252+0000","last_clean_scrub_stamp":"2024-06-04T16:23:15.917252+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T18:10:33.362725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":1406,"num_write":10,"num_write_kb":4799,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.16","version":"251'2","reported_seq":42,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:29.875049+0000","last_change":"2024-06-04T16:23:29.875080+0000","last_active":"2024-06-04T16:23:29.875049+0000","last_peered":"2024-06-04T16:23:29.875049+0000","last_clean":"2024-06-04T16:23:29.875049+0000","last_became_active":"2024-06-04T16:09:23.609180+0000","last_became_peered":"2024-06-04T16:09:23.609180+0000","last_unstale":"2024-06-04T16:23:29.875049+0000","last_undegraded":"2024-06-04T16:23:29.875049+0000","last_fullsized":"2024-06-04T16:23:29.875049+0000","mapping_epoch":246,"log_start":"0'0","ondisk_log_start":"0'0","created":246,"last_epoch_clean":247,"parent":"0.0","parent_split_bits":0,"last_scrub":"251'2","last_scrub_stamp":"2024-06-04T16:23:29.874951+0000","last_deep_scrub":"251'2","last_deep_scrub_stamp":"2024-06-04T16:23:29.874951+0000","last_clean_scrub_stamp":"2024-06-04T16:23:29.874951+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T19:50:30.186546+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":45,"num_write":2,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"64.17","version":"0'0","reported_seq":45,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:51.964414+0000","last_change":"2024-06-04T16:22:51.964441+0000","last_active":"2024-06-04T16:22:51.964414+0000","last_peered":"2024-06-04T16:22:51.964414+0000","last_clean":"2024-06-04T16:22:51.964414+0000","last_became_active":"2024-06-04T16:07:09.511806+0000","last_became_peered":"2024-06-04T16:07:09.511806+0000","last_unstale":"2024-06-04T16:22:51.964414+0000","last_undegraded":"2024-06-04T16:22:51.964414+0000","last_fullsized":"2024-06-04T16:22:51.964414+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":243,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:22:51.964320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:22:51.964320+0000","last_clean_scrub_stamp":"2024-06-04T16:22:51.964320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T17:12:29.022223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.15","version":"0'0","reported_seq":24,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:37.018186+0000","last_change":"2024-06-04T16:23:37.018211+0000","last_active":"2024-06-04T16:23:37.018186+0000","last_peered":"2024-06-04T16:23:37.018186+0000","last_clean":"2024-06-04T16:23:37.018186+0000","last_became_active":"2024-06-04T16:16:08.664680+0000","last_became_peered":"2024-06-04T16:16:08.664680+0000","last_unstale":"2024-06-04T16:23:37.018186+0000","last_undegraded":"2024-06-04T16:23:37.018186+0000","last_fullsized":"2024-06-04T16:23:37.018186+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:23:37.018087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:23:37.018087+0000","last_clean_scrub_stamp":"2024-06-04T16:23:37.018087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T00:44:50.931141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.14","version":"254'3","reported_seq":36,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:14.853043+0000","last_change":"2024-06-04T16:23:14.853043+0000","last_active":"2024-06-04T16:23:14.853043+0000","last_peered":"2024-06-04T16:23:14.853043+0000","last_clean":"2024-06-04T16:23:14.853043+0000","last_became_active":"2024-06-04T16:09:26.623991+0000","last_became_peered":"2024-06-04T16:09:26.623991+0000","last_unstale":"2024-06-04T16:23:14.853043+0000","last_undegraded":"2024-06-04T16:23:14.853043+0000","last_fullsized":"2024-06-04T16:23:14.853043+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'3","last_scrub_stamp":"2024-06-04T16:23:14.852908+0000","last_deep_scrub":"254'3","last_deep_scrub_stamp":"2024-06-04T16:23:14.852908+0000","last_clean_scrub_stamp":"2024-06-04T16:23:14.852908+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T01:38:33.737901+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.17","version":"254'2","reported_seq":41,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:26.846294+0000","last_change":"2024-06-04T16:23:26.846322+0000","last_active":"2024-06-04T16:23:26.846294+0000","last_peered":"2024-06-04T16:23:26.846294+0000","last_clean":"2024-06-04T16:23:26.846294+0000","last_became_active":"2024-06-04T16:09:23.595355+0000","last_became_peered":"2024-06-04T16:09:23.595355+0000","last_unstale":"2024-06-04T16:23:26.846294+0000","last_undegraded":"2024-06-04T16:23:26.846294+0000","last_fullsized":"2024-06-04T16:23:26.846294+0000","mapping_epoch":246,"log_start":"0'0","ondisk_log_start":"0'0","created":246,"last_epoch_clean":247,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'2","last_scrub_stamp":"2024-06-04T16:23:26.846192+0000","last_deep_scrub":"254'2","last_deep_scrub_stamp":"2024-06-04T16:23:26.846192+0000","last_clean_scrub_stamp":"2024-06-04T16:23:26.846192+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T03:23:28.254745+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"64.16","version":"251'16","reported_seq":89,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:02.010675+0000","last_change":"2024-06-04T16:23:02.010721+0000","last_active":"2024-06-04T16:23:02.010675+0000","last_peered":"2024-06-04T16:23:02.010675+0000","last_clean":"2024-06-04T16:23:02.010675+0000","last_became_active":"2024-06-04T16:07:09.405088+0000","last_became_peered":"2024-06-04T16:07:09.405088+0000","last_unstale":"2024-06-04T16:23:02.010675+0000","last_undegraded":"2024-06-04T16:23:02.010675+0000","last_fullsized":"2024-06-04T16:23:02.010675+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":243,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"251'16","last_scrub_stamp":"2024-06-04T16:23:02.010570+0000","last_deep_scrub":"251'16","last_deep_scrub_stamp":"2024-06-04T16:23:02.010570+0000","last_clean_scrub_stamp":"2024-06-04T16:23:02.010570+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T22:57:25.415865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":63,"num_write":30,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.16","version":"0'0","reported_seq":24,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:17.886115+0000","last_change":"2024-06-04T16:23:17.886115+0000","last_active":"2024-06-04T16:23:17.886115+0000","last_peered":"2024-06-04T16:23:17.886115+0000","last_clean":"2024-06-04T16:23:17.886115+0000","last_became_active":"2024-06-04T16:16:08.655571+0000","last_became_peered":"2024-06-04T16:16:08.655571+0000","last_unstale":"2024-06-04T16:23:17.886115+0000","last_undegraded":"2024-06-04T16:23:17.886115+0000","last_fullsized":"2024-06-04T16:23:17.886115+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:23:17.885998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:23:17.885998+0000","last_clean_scrub_stamp":"2024-06-04T16:23:17.885998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T18:50:59.477929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.17","version":"0'0","reported_seq":32,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:02.458256+0000","last_change":"2024-06-04T16:23:02.458281+0000","last_active":"2024-06-04T16:23:02.458256+0000","last_peered":"2024-06-04T16:23:02.458256+0000","last_clean":"2024-06-04T16:23:02.458256+0000","last_became_active":"2024-06-04T16:09:26.626605+0000","last_became_peered":"2024-06-04T16:09:26.626605+0000","last_unstale":"2024-06-04T16:23:02.458256+0000","last_undegraded":"2024-06-04T16:23:02.458256+0000","last_fullsized":"2024-06-04T16:23:02.458256+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:23:02.458129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:23:02.458129+0000","last_clean_scrub_stamp":"2024-06-04T16:23:02.458129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T19:52:01.192176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.14","version":"254'2","reported_seq":42,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:49.960934+0000","last_change":"2024-06-04T16:22:49.960934+0000","last_active":"2024-06-04T16:22:49.960934+0000","last_peered":"2024-06-04T16:22:49.960934+0000","last_clean":"2024-06-04T16:22:49.960934+0000","last_became_active":"2024-06-04T16:09:23.607906+0000","last_became_peered":"2024-06-04T16:09:23.607906+0000","last_unstale":"2024-06-04T16:22:49.960934+0000","last_undegraded":"2024-06-04T16:22:49.960934+0000","last_fullsized":"2024-06-04T16:22:49.960934+0000","mapping_epoch":246,"log_start":"0'0","ondisk_log_start":"0'0","created":246,"last_epoch_clean":247,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'2","last_scrub_stamp":"2024-06-04T16:22:49.960799+0000","last_deep_scrub":"254'2","last_deep_scrub_stamp":"2024-06-04T16:22:49.960799+0000","last_clean_scrub_stamp":"2024-06-04T16:22:49.960799+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T03:11:47.194479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"64.15","version":"0'0","reported_seq":45,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:55.504294+0000","last_change":"2024-06-04T16:22:55.504318+0000","last_active":"2024-06-04T16:22:55.504294+0000","last_peered":"2024-06-04T16:22:55.504294+0000","last_clean":"2024-06-04T16:22:55.504294+0000","last_became_active":"2024-06-04T16:07:09.401608+0000","last_became_peered":"2024-06-04T16:07:09.401608+0000","last_unstale":"2024-06-04T16:22:55.504294+0000","last_undegraded":"2024-06-04T16:22:55.504294+0000","last_fullsized":"2024-06-04T16:22:55.504294+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":243,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:22:55.504205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:22:55.504205+0000","last_clean_scrub_stamp":"2024-06-04T16:22:55.504205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T16:56:39.431832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.17","version":"0'0","reported_seq":24,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:32.987376+0000","last_change":"2024-06-04T16:23:32.987399+0000","last_active":"2024-06-04T16:23:32.987376+0000","last_peered":"2024-06-04T16:23:32.987376+0000","last_clean":"2024-06-04T16:23:32.987376+0000","last_became_active":"2024-06-04T16:16:08.657535+0000","last_became_peered":"2024-06-04T16:16:08.657535+0000","last_unstale":"2024-06-04T16:23:32.987376+0000","last_undegraded":"2024-06-04T16:23:32.987376+0000","last_fullsized":"2024-06-04T16:23:32.987376+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:23:32.987282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:23:32.987282+0000","last_clean_scrub_stamp":"2024-06-04T16:23:32.987282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T16:43:24.500634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.16","version":"254'13","reported_seq":57,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:00.022118+0000","last_change":"2024-06-04T16:23:00.022163+0000","last_active":"2024-06-04T16:23:00.022118+0000","last_peered":"2024-06-04T16:23:00.022118+0000","last_clean":"2024-06-04T16:23:00.022118+0000","last_became_active":"2024-06-04T16:09:26.628237+0000","last_became_peered":"2024-06-04T16:09:26.628237+0000","last_unstale":"2024-06-04T16:23:00.022118+0000","last_undegraded":"2024-06-04T16:23:00.022118+0000","last_fullsized":"2024-06-04T16:23:00.022118+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'13","last_scrub_stamp":"2024-06-04T16:23:00.022012+0000","last_deep_scrub":"254'13","last_deep_scrub_stamp":"2024-06-04T16:23:00.022012+0000","last_clean_scrub_stamp":"2024-06-04T16:23:00.022012+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T03:53:06.448598+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":19,"num_read_kb":9311,"num_write":11,"num_write_kb":6237,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.15","version":"0'0","reported_seq":38,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:53.025951+0000","last_change":"2024-06-04T16:22:53.025992+0000","last_active":"2024-06-04T16:22:53.025951+0000","last_peered":"2024-06-04T16:22:53.025951+0000","last_clean":"2024-06-04T16:22:53.025951+0000","last_became_active":"2024-06-04T16:09:23.608801+0000","last_became_peered":"2024-06-04T16:09:23.608801+0000","last_unstale":"2024-06-04T16:22:53.025951+0000","last_undegraded":"2024-06-04T16:22:53.025951+0000","last_fullsized":"2024-06-04T16:22:53.025951+0000","mapping_epoch":246,"log_start":"0'0","ondisk_log_start":"0'0","created":246,"last_epoch_clean":247,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:22:53.025834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:22:53.025834+0000","last_clean_scrub_stamp":"2024-06-04T16:22:53.025834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T18:36:02.347621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"64.14","version":"251'30","reported_seq":127,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:48.038108+0000","last_change":"2024-06-04T16:22:48.038108+0000","last_active":"2024-06-04T16:22:48.038108+0000","last_peered":"2024-06-04T16:22:48.038108+0000","last_clean":"2024-06-04T16:22:48.038108+0000","last_became_active":"2024-06-04T16:07:09.403925+0000","last_became_peered":"2024-06-04T16:07:09.403925+0000","last_unstale":"2024-06-04T16:22:48.038108+0000","last_undegraded":"2024-06-04T16:22:48.038108+0000","last_fullsized":"2024-06-04T16:22:48.038108+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":243,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"251'30","last_scrub_stamp":"2024-06-04T16:22:48.037984+0000","last_deep_scrub":"251'30","last_deep_scrub_stamp":"2024-06-04T16:22:48.037984+0000","last_clean_scrub_stamp":"2024-06-04T16:22:48.037984+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T16:58:19.728132+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":154,"num_read_kb":107,"num_write":60,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.10","version":"0'0","reported_seq":24,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:38.354711+0000","last_change":"2024-06-04T16:23:38.354737+0000","last_active":"2024-06-04T16:23:38.354711+0000","last_peered":"2024-06-04T16:23:38.354711+0000","last_clean":"2024-06-04T16:23:38.354711+0000","last_became_active":"2024-06-04T16:16:08.656048+0000","last_became_peered":"2024-06-04T16:16:08.656048+0000","last_unstale":"2024-06-04T16:23:38.354711+0000","last_undegraded":"2024-06-04T16:23:38.354711+0000","last_fullsized":"2024-06-04T16:23:38.354711+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:23:38.354611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:23:38.354611+0000","last_clean_scrub_stamp":"2024-06-04T16:23:38.354611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T02:33:12.881593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.11","version":"254'9","reported_seq":50,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:54.471674+0000","last_change":"2024-06-04T16:22:54.471674+0000","last_active":"2024-06-04T16:22:54.471674+0000","last_peered":"2024-06-04T16:22:54.471674+0000","last_clean":"2024-06-04T16:22:54.471674+0000","last_became_active":"2024-06-04T16:09:26.624122+0000","last_became_peered":"2024-06-04T16:09:26.624122+0000","last_unstale":"2024-06-04T16:22:54.471674+0000","last_undegraded":"2024-06-04T16:22:54.471674+0000","last_fullsized":"2024-06-04T16:22:54.471674+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'9","last_scrub_stamp":"2024-06-04T16:22:54.471546+0000","last_deep_scrub":"254'9","last_deep_scrub_stamp":"2024-06-04T16:22:54.471546+0000","last_clean_scrub_stamp":"2024-06-04T16:22:54.471546+0000","objects_scrubbed":1,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T19:44:26.280196+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":17410,"num_write":17,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.12","version":"254'4","reported_seq":44,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:50.065702+0000","last_change":"2024-06-04T16:22:50.065702+0000","last_active":"2024-06-04T16:22:50.065702+0000","last_peered":"2024-06-04T16:22:50.065702+0000","last_clean":"2024-06-04T16:22:50.065702+0000","last_became_active":"2024-06-04T16:09:23.612699+0000","last_became_peered":"2024-06-04T16:09:23.612699+0000","last_unstale":"2024-06-04T16:22:50.065702+0000","last_undegraded":"2024-06-04T16:22:50.065702+0000","last_fullsized":"2024-06-04T16:22:50.065702+0000","mapping_epoch":246,"log_start":"0'0","ondisk_log_start":"0'0","created":246,"last_epoch_clean":247,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'4","last_scrub_stamp":"2024-06-04T16:22:50.065529+0000","last_deep_scrub":"254'4","last_deep_scrub_stamp":"2024-06-04T16:22:50.065529+0000","last_clean_scrub_stamp":"2024-06-04T16:22:50.065529+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T19:24:18.911703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4,"num_write":4,"num_write_kb":1028,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"64.13","version":"254'35","reported_seq":148,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:00.004308+0000","last_change":"2024-06-04T16:23:00.004308+0000","last_active":"2024-06-04T16:23:00.004308+0000","last_peered":"2024-06-04T16:23:00.004308+0000","last_clean":"2024-06-04T16:23:00.004308+0000","last_became_active":"2024-06-04T16:07:09.511607+0000","last_became_peered":"2024-06-04T16:07:09.511607+0000","last_unstale":"2024-06-04T16:23:00.004308+0000","last_undegraded":"2024-06-04T16:23:00.004308+0000","last_fullsized":"2024-06-04T16:23:00.004308+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":243,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'35","last_scrub_stamp":"2024-06-04T16:23:00.004144+0000","last_deep_scrub":"254'35","last_deep_scrub_stamp":"2024-06-04T16:23:00.004144+0000","last_clean_scrub_stamp":"2024-06-04T16:23:00.004144+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T18:57:09.754963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":198,"num_read_kb":144,"num_write":54,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.11","version":"0'0","reported_seq":24,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:10.366340+0000","last_change":"2024-06-04T16:23:10.366366+0000","last_active":"2024-06-04T16:23:10.366340+0000","last_peered":"2024-06-04T16:23:10.366340+0000","last_clean":"2024-06-04T16:23:10.366340+0000","last_became_active":"2024-06-04T16:16:08.648899+0000","last_became_peered":"2024-06-04T16:16:08.648899+0000","last_unstale":"2024-06-04T16:23:10.366340+0000","last_undegraded":"2024-06-04T16:23:10.366340+0000","last_fullsized":"2024-06-04T16:23:10.366340+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:23:10.366238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:23:10.366238+0000","last_clean_scrub_stamp":"2024-06-04T16:23:10.366238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T03:12:18.946809+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.10","version":"254'2","reported_seq":36,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:28.243956+0000","last_change":"2024-06-04T16:23:28.243956+0000","last_active":"2024-06-04T16:23:28.243956+0000","last_peered":"2024-06-04T16:23:28.243956+0000","last_clean":"2024-06-04T16:23:28.243956+0000","last_became_active":"2024-06-04T16:09:26.628442+0000","last_became_peered":"2024-06-04T16:09:26.628442+0000","last_unstale":"2024-06-04T16:23:28.243956+0000","last_undegraded":"2024-06-04T16:23:28.243956+0000","last_fullsized":"2024-06-04T16:23:28.243956+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'2","last_scrub_stamp":"2024-06-04T16:23:28.243810+0000","last_deep_scrub":"254'2","last_deep_scrub_stamp":"2024-06-04T16:23:28.243810+0000","last_clean_scrub_stamp":"2024-06-04T16:23:28.243810+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T22:55:05.302653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.13","version":"254'2","reported_seq":42,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:58.847088+0000","last_change":"2024-06-04T16:22:58.847088+0000","last_active":"2024-06-04T16:22:58.847088+0000","last_peered":"2024-06-04T16:22:58.847088+0000","last_clean":"2024-06-04T16:22:58.847088+0000","last_became_active":"2024-06-04T16:09:23.609536+0000","last_became_peered":"2024-06-04T16:09:23.609536+0000","last_unstale":"2024-06-04T16:22:58.847088+0000","last_undegraded":"2024-06-04T16:22:58.847088+0000","last_fullsized":"2024-06-04T16:22:58.847088+0000","mapping_epoch":246,"log_start":"0'0","ondisk_log_start":"0'0","created":246,"last_epoch_clean":247,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'2","last_scrub_stamp":"2024-06-04T16:22:58.846960+0000","last_deep_scrub":"254'2","last_deep_scrub_stamp":"2024-06-04T16:22:58.846960+0000","last_clean_scrub_stamp":"2024-06-04T16:22:58.846960+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T22:30:42.199456+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"64.12","version":"254'6","reported_seq":64,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:56.874251+0000","last_change":"2024-06-04T16:22:56.874251+0000","last_active":"2024-06-04T16:22:56.874251+0000","last_peered":"2024-06-04T16:22:56.874251+0000","last_clean":"2024-06-04T16:22:56.874251+0000","last_became_active":"2024-06-04T16:07:09.403352+0000","last_became_peered":"2024-06-04T16:07:09.403352+0000","last_unstale":"2024-06-04T16:22:56.874251+0000","last_undegraded":"2024-06-04T16:22:56.874251+0000","last_fullsized":"2024-06-04T16:22:56.874251+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":243,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'6","last_scrub_stamp":"2024-06-04T16:22:56.874133+0000","last_deep_scrub":"254'6","last_deep_scrub_stamp":"2024-06-04T16:22:56.874133+0000","last_clean_scrub_stamp":"2024-06-04T16:22:56.874133+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T01:49:34.273350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":24,"num_write":11,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.12","version":"0'0","reported_seq":16,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:45.077779+0000","last_change":"2024-06-04T16:16:08.654940+0000","last_active":"2024-06-04T16:22:45.077779+0000","last_peered":"2024-06-04T16:22:45.077779+0000","last_clean":"2024-06-04T16:22:45.077779+0000","last_became_active":"2024-06-04T16:16:08.654624+0000","last_became_peered":"2024-06-04T16:16:08.654624+0000","last_unstale":"2024-06-04T16:22:45.077779+0000","last_undegraded":"2024-06-04T16:22:45.077779+0000","last_fullsized":"2024-06-04T16:22:45.077779+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_clean_scrub_stamp":"2024-06-04T16:16:07.631263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.13","version":"254'14","reported_seq":61,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:24.314323+0000","last_change":"2024-06-04T16:23:24.314323+0000","last_active":"2024-06-04T16:23:24.314323+0000","last_peered":"2024-06-04T16:23:24.314323+0000","last_clean":"2024-06-04T16:23:24.314323+0000","last_became_active":"2024-06-04T16:09:26.621494+0000","last_became_peered":"2024-06-04T16:09:26.621494+0000","last_unstale":"2024-06-04T16:23:24.314323+0000","last_undegraded":"2024-06-04T16:23:24.314323+0000","last_fullsized":"2024-06-04T16:23:24.314323+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'14","last_scrub_stamp":"2024-06-04T16:23:24.314185+0000","last_deep_scrub":"254'14","last_deep_scrub_stamp":"2024-06-04T16:23:24.314185+0000","last_clean_scrub_stamp":"2024-06-04T16:23:24.314185+0000","objects_scrubbed":2,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T01:37:37.532445+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":21,"num_read_kb":22532,"num_write":20,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.10","version":"254'8","reported_seq":54,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:57.044720+0000","last_change":"2024-06-04T16:22:57.044720+0000","last_active":"2024-06-04T16:22:57.044720+0000","last_peered":"2024-06-04T16:22:57.044720+0000","last_clean":"2024-06-04T16:22:57.044720+0000","last_became_active":"2024-06-04T16:09:23.606050+0000","last_became_peered":"2024-06-04T16:09:23.606050+0000","last_unstale":"2024-06-04T16:22:57.044720+0000","last_undegraded":"2024-06-04T16:22:57.044720+0000","last_fullsized":"2024-06-04T16:22:57.044720+0000","mapping_epoch":246,"log_start":"0'0","ondisk_log_start":"0'0","created":246,"last_epoch_clean":247,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'8","last_scrub_stamp":"2024-06-04T16:22:57.044585+0000","last_deep_scrub":"254'8","last_deep_scrub_stamp":"2024-06-04T16:22:57.044585+0000","last_clean_scrub_stamp":"2024-06-04T16:22:57.044585+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T20:44:54.184609+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":11,"num_read_kb":20482,"num_write":11,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"64.11","version":"254'139","reported_seq":486,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:53.899126+0000","last_change":"2024-06-04T16:22:53.899126+0000","last_active":"2024-06-04T16:22:53.899126+0000","last_peered":"2024-06-04T16:22:53.899126+0000","last_clean":"2024-06-04T16:22:53.899126+0000","last_became_active":"2024-06-04T16:07:09.511098+0000","last_became_peered":"2024-06-04T16:07:09.511098+0000","last_unstale":"2024-06-04T16:22:53.899126+0000","last_undegraded":"2024-06-04T16:22:53.899126+0000","last_fullsized":"2024-06-04T16:22:53.899126+0000","mapping_epoch":243,"log_start":"251'100","ondisk_log_start":"251'100","created":243,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'139","last_scrub_stamp":"2024-06-04T16:22:53.899006+0000","last_deep_scrub":"254'139","last_deep_scrub_stamp":"2024-06-04T16:22:53.899006+0000","last_clean_scrub_stamp":"2024-06-04T16:22:53.899006+0000","objects_scrubbed":1,"log_size":39,"log_dups_size":100,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T22:35:53.282639+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":871,"num_read_kb":642,"num_write":155,"num_write_kb":133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4455,"num_omap_keys":9,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.13","version":"254'2","reported_seq":26,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:32.024494+0000","last_change":"2024-06-04T16:23:32.024541+0000","last_active":"2024-06-04T16:23:32.024494+0000","last_peered":"2024-06-04T16:23:32.024494+0000","last_clean":"2024-06-04T16:23:32.024494+0000","last_became_active":"2024-06-04T16:16:08.657428+0000","last_became_peered":"2024-06-04T16:16:08.657428+0000","last_unstale":"2024-06-04T16:23:32.024494+0000","last_undegraded":"2024-06-04T16:23:32.024494+0000","last_fullsized":"2024-06-04T16:23:32.024494+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'2","last_scrub_stamp":"2024-06-04T16:23:32.024367+0000","last_deep_scrub":"254'2","last_deep_scrub_stamp":"2024-06-04T16:23:32.024367+0000","last_clean_scrub_stamp":"2024-06-04T16:23:32.024367+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T00:39:30.664115+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.12","version":"254'7","reported_seq":48,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:25.295314+0000","last_change":"2024-06-04T16:23:25.295314+0000","last_active":"2024-06-04T16:23:25.295314+0000","last_peered":"2024-06-04T16:23:25.295314+0000","last_clean":"2024-06-04T16:23:25.295314+0000","last_became_active":"2024-06-04T16:09:26.623285+0000","last_became_peered":"2024-06-04T16:09:26.623285+0000","last_unstale":"2024-06-04T16:23:25.295314+0000","last_undegraded":"2024-06-04T16:23:25.295314+0000","last_fullsized":"2024-06-04T16:23:25.295314+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'7","last_scrub_stamp":"2024-06-04T16:23:25.295187+0000","last_deep_scrub":"254'7","last_deep_scrub_stamp":"2024-06-04T16:23:25.295187+0000","last_clean_scrub_stamp":"2024-06-04T16:23:25.295187+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T04:20:24.714654+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":18434,"num_write":5,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.11","version":"254'2","reported_seq":43,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:47.528727+0000","last_change":"2024-06-04T16:22:47.528727+0000","last_active":"2024-06-04T16:22:47.528727+0000","last_peered":"2024-06-04T16:22:47.528727+0000","last_clean":"2024-06-04T16:22:47.528727+0000","last_became_active":"2024-06-04T16:09:23.607048+0000","last_became_peered":"2024-06-04T16:09:23.607048+0000","last_unstale":"2024-06-04T16:22:47.528727+0000","last_undegraded":"2024-06-04T16:22:47.528727+0000","last_fullsized":"2024-06-04T16:22:47.528727+0000","mapping_epoch":246,"log_start":"0'0","ondisk_log_start":"0'0","created":246,"last_epoch_clean":247,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'2","last_scrub_stamp":"2024-06-04T16:22:47.528594+0000","last_deep_scrub":"254'2","last_deep_scrub_stamp":"2024-06-04T16:22:47.528594+0000","last_clean_scrub_stamp":"2024-06-04T16:22:47.528594+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T18:03:35.616854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8192,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"64.10","version":"251'6","reported_seq":64,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:03.054311+0000","last_change":"2024-06-04T16:23:03.054311+0000","last_active":"2024-06-04T16:23:03.054311+0000","last_peered":"2024-06-04T16:23:03.054311+0000","last_clean":"2024-06-04T16:23:03.054311+0000","last_became_active":"2024-06-04T16:07:09.401445+0000","last_became_peered":"2024-06-04T16:07:09.401445+0000","last_unstale":"2024-06-04T16:23:03.054311+0000","last_undegraded":"2024-06-04T16:23:03.054311+0000","last_fullsized":"2024-06-04T16:23:03.054311+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":243,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"251'6","last_scrub_stamp":"2024-06-04T16:23:03.054099+0000","last_deep_scrub":"251'6","last_deep_scrub_stamp":"2024-06-04T16:23:03.054099+0000","last_clean_scrub_stamp":"2024-06-04T16:23:03.054099+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T02:24:52.447333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":24,"num_write":11,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.c","version":"254'2","reported_seq":26,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:35.995657+0000","last_change":"2024-06-04T16:23:35.995714+0000","last_active":"2024-06-04T16:23:35.995657+0000","last_peered":"2024-06-04T16:23:35.995657+0000","last_clean":"2024-06-04T16:23:35.995657+0000","last_became_active":"2024-06-04T16:16:08.664436+0000","last_became_peered":"2024-06-04T16:16:08.664436+0000","last_unstale":"2024-06-04T16:23:35.995657+0000","last_undegraded":"2024-06-04T16:23:35.995657+0000","last_fullsized":"2024-06-04T16:23:35.995657+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'2","last_scrub_stamp":"2024-06-04T16:23:35.995554+0000","last_deep_scrub":"254'2","last_deep_scrub_stamp":"2024-06-04T16:23:35.995554+0000","last_clean_scrub_stamp":"2024-06-04T16:23:35.995554+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T18:55:08.006492+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.d","version":"251'2","reported_seq":37,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:24.264929+0000","last_change":"2024-06-04T16:23:24.264955+0000","last_active":"2024-06-04T16:23:24.264929+0000","last_peered":"2024-06-04T16:23:24.264929+0000","last_clean":"2024-06-04T16:23:24.264929+0000","last_became_active":"2024-06-04T16:09:26.622747+0000","last_became_peered":"2024-06-04T16:09:26.622747+0000","last_unstale":"2024-06-04T16:23:24.264929+0000","last_undegraded":"2024-06-04T16:23:24.264929+0000","last_fullsized":"2024-06-04T16:23:24.264929+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"251'2","last_scrub_stamp":"2024-06-04T16:23:24.264813+0000","last_deep_scrub":"251'2","last_deep_scrub_stamp":"2024-06-04T16:23:24.264813+0000","last_clean_scrub_stamp":"2024-06-04T16:23:24.264813+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T23:33:06.860827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.e","version":"254'11","reported_seq":58,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:50.975841+0000","last_change":"2024-06-04T16:22:50.975841+0000","last_active":"2024-06-04T16:22:50.975841+0000","last_peered":"2024-06-04T16:22:50.975841+0000","last_clean":"2024-06-04T16:22:50.975841+0000","last_became_active":"2024-06-04T16:09:23.608866+0000","last_became_peered":"2024-06-04T16:09:23.608866+0000","last_unstale":"2024-06-04T16:22:50.975841+0000","last_undegraded":"2024-06-04T16:22:50.975841+0000","last_fullsized":"2024-06-04T16:22:50.975841+0000","mapping_epoch":246,"log_start":"0'0","ondisk_log_start":"0'0","created":246,"last_epoch_clean":247,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'11","last_scrub_stamp":"2024-06-04T16:22:50.975673+0000","last_deep_scrub":"254'11","last_deep_scrub_stamp":"2024-06-04T16:22:50.975673+0000","last_clean_scrub_stamp":"2024-06-04T16:22:50.975673+0000","objects_scrubbed":1,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T01:18:54.016221+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":13,"num_read_kb":5122,"num_write":19,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"64.f","version":"251'6","reported_seq":61,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:47.127684+0000","last_change":"2024-06-04T16:22:47.127684+0000","last_active":"2024-06-04T16:22:47.127684+0000","last_peered":"2024-06-04T16:22:47.127684+0000","last_clean":"2024-06-04T16:22:47.127684+0000","last_became_active":"2024-06-04T16:07:09.400807+0000","last_became_peered":"2024-06-04T16:07:09.400807+0000","last_unstale":"2024-06-04T16:22:47.127684+0000","last_undegraded":"2024-06-04T16:22:47.127684+0000","last_fullsized":"2024-06-04T16:22:47.127684+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":243,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"251'6","last_scrub_stamp":"2024-06-04T16:22:47.127584+0000","last_deep_scrub":"251'6","last_deep_scrub_stamp":"2024-06-04T16:22:47.127584+0000","last_clean_scrub_stamp":"2024-06-04T16:22:47.127584+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T17:42:33.593477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":19,"num_write":12,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.d","version":"0'0","reported_seq":24,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:30.995398+0000","last_change":"2024-06-04T16:23:30.995422+0000","last_active":"2024-06-04T16:23:30.995398+0000","last_peered":"2024-06-04T16:23:30.995398+0000","last_clean":"2024-06-04T16:23:30.995398+0000","last_became_active":"2024-06-04T16:16:08.656726+0000","last_became_peered":"2024-06-04T16:16:08.656726+0000","last_unstale":"2024-06-04T16:23:30.995398+0000","last_undegraded":"2024-06-04T16:23:30.995398+0000","last_fullsized":"2024-06-04T16:23:30.995398+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:23:30.995267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:23:30.995267+0000","last_clean_scrub_stamp":"2024-06-04T16:23:30.995267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T04:00:42.136125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.c","version":"254'3","reported_seq":38,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:23.668556+0000","last_change":"2024-06-04T16:23:23.668597+0000","last_active":"2024-06-04T16:23:23.668556+0000","last_peered":"2024-06-04T16:23:23.668556+0000","last_clean":"2024-06-04T16:23:23.668556+0000","last_became_active":"2024-06-04T16:09:26.627994+0000","last_became_peered":"2024-06-04T16:09:26.627994+0000","last_unstale":"2024-06-04T16:23:23.668556+0000","last_undegraded":"2024-06-04T16:23:23.668556+0000","last_fullsized":"2024-06-04T16:23:23.668556+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'3","last_scrub_stamp":"2024-06-04T16:23:23.668463+0000","last_deep_scrub":"254'3","last_deep_scrub_stamp":"2024-06-04T16:23:23.668463+0000","last_clean_scrub_stamp":"2024-06-04T16:23:23.668463+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T16:35:31.294611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8192,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.f","version":"254'2","reported_seq":43,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:51.055160+0000","last_change":"2024-06-04T16:22:51.055160+0000","last_active":"2024-06-04T16:22:51.055160+0000","last_peered":"2024-06-04T16:22:51.055160+0000","last_clean":"2024-06-04T16:22:51.055160+0000","last_became_active":"2024-06-04T16:09:23.609283+0000","last_became_peered":"2024-06-04T16:09:23.609283+0000","last_unstale":"2024-06-04T16:22:51.055160+0000","last_undegraded":"2024-06-04T16:22:51.055160+0000","last_fullsized":"2024-06-04T16:22:51.055160+0000","mapping_epoch":246,"log_start":"0'0","ondisk_log_start":"0'0","created":246,"last_epoch_clean":247,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'2","last_scrub_stamp":"2024-06-04T16:22:51.055012+0000","last_deep_scrub":"254'2","last_deep_scrub_stamp":"2024-06-04T16:22:51.055012+0000","last_clean_scrub_stamp":"2024-06-04T16:22:51.055012+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T00:43:28.540663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"64.e","version":"254'20","reported_seq":103,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:57.841373+0000","last_change":"2024-06-04T16:22:57.841402+0000","last_active":"2024-06-04T16:22:57.841373+0000","last_peered":"2024-06-04T16:22:57.841373+0000","last_clean":"2024-06-04T16:22:57.841373+0000","last_became_active":"2024-06-04T16:07:09.401515+0000","last_became_peered":"2024-06-04T16:07:09.401515+0000","last_unstale":"2024-06-04T16:22:57.841373+0000","last_undegraded":"2024-06-04T16:22:57.841373+0000","last_fullsized":"2024-06-04T16:22:57.841373+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":243,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'20","last_scrub_stamp":"2024-06-04T16:22:57.841275+0000","last_deep_scrub":"254'20","last_deep_scrub_stamp":"2024-06-04T16:22:57.841275+0000","last_clean_scrub_stamp":"2024-06-04T16:22:57.841275+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T22:23:22.342400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":108,"num_read_kb":75,"num_write":37,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.e","version":"0'0","reported_seq":24,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:39.351476+0000","last_change":"2024-06-04T16:23:39.351503+0000","last_active":"2024-06-04T16:23:39.351476+0000","last_peered":"2024-06-04T16:23:39.351476+0000","last_clean":"2024-06-04T16:23:39.351476+0000","last_became_active":"2024-06-04T16:16:08.657279+0000","last_became_peered":"2024-06-04T16:16:08.657279+0000","last_unstale":"2024-06-04T16:23:39.351476+0000","last_undegraded":"2024-06-04T16:23:39.351476+0000","last_fullsized":"2024-06-04T16:23:39.351476+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:23:39.351379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:23:39.351379+0000","last_clean_scrub_stamp":"2024-06-04T16:23:39.351379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T17:57:25.591816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.f","version":"254'10","reported_seq":54,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:48.017264+0000","last_change":"2024-06-04T16:22:48.017264+0000","last_active":"2024-06-04T16:22:48.017264+0000","last_peered":"2024-06-04T16:22:48.017264+0000","last_clean":"2024-06-04T16:22:48.017264+0000","last_became_active":"2024-06-04T16:09:26.623307+0000","last_became_peered":"2024-06-04T16:09:26.623307+0000","last_unstale":"2024-06-04T16:22:48.017264+0000","last_undegraded":"2024-06-04T16:22:48.017264+0000","last_fullsized":"2024-06-04T16:22:48.017264+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'10","last_scrub_stamp":"2024-06-04T16:22:48.017119+0000","last_deep_scrub":"254'10","last_deep_scrub_stamp":"2024-06-04T16:22:48.017119+0000","last_clean_scrub_stamp":"2024-06-04T16:22:48.017119+0000","objects_scrubbed":1,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T21:31:25.906647+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":8194,"num_write":13,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.c","version":"254'5","reported_seq":46,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:21.207433+0000","last_change":"2024-06-04T16:23:21.207482+0000","last_active":"2024-06-04T16:23:21.207433+0000","last_peered":"2024-06-04T16:23:21.207433+0000","last_clean":"2024-06-04T16:23:21.207433+0000","last_became_active":"2024-06-04T16:09:23.612445+0000","last_became_peered":"2024-06-04T16:09:23.612445+0000","last_unstale":"2024-06-04T16:23:21.207433+0000","last_undegraded":"2024-06-04T16:23:21.207433+0000","last_fullsized":"2024-06-04T16:23:21.207433+0000","mapping_epoch":246,"log_start":"0'0","ondisk_log_start":"0'0","created":246,"last_epoch_clean":247,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'5","last_scrub_stamp":"2024-06-04T16:23:21.207328+0000","last_deep_scrub":"254'5","last_deep_scrub_stamp":"2024-06-04T16:23:21.207328+0000","last_clean_scrub_stamp":"2024-06-04T16:23:21.207328+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T20:25:45.797505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":1024,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"64.d","version":"251'24","reported_seq":115,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:52.929164+0000","last_change":"2024-06-04T16:22:52.929164+0000","last_active":"2024-06-04T16:22:52.929164+0000","last_peered":"2024-06-04T16:22:52.929164+0000","last_clean":"2024-06-04T16:22:52.929164+0000","last_became_active":"2024-06-04T16:07:09.511172+0000","last_became_peered":"2024-06-04T16:07:09.511172+0000","last_unstale":"2024-06-04T16:22:52.929164+0000","last_undegraded":"2024-06-04T16:22:52.929164+0000","last_fullsized":"2024-06-04T16:22:52.929164+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":243,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"251'24","last_scrub_stamp":"2024-06-04T16:22:52.929049+0000","last_deep_scrub":"251'24","last_deep_scrub_stamp":"2024-06-04T16:22:52.929049+0000","last_clean_scrub_stamp":"2024-06-04T16:22:52.929049+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T00:38:16.499504+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":134,"num_read_kb":91,"num_write":39,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.f","version":"0'0","reported_seq":24,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:34.037390+0000","last_change":"2024-06-04T16:23:34.037417+0000","last_active":"2024-06-04T16:23:34.037390+0000","last_peered":"2024-06-04T16:23:34.037390+0000","last_clean":"2024-06-04T16:23:34.037390+0000","last_became_active":"2024-06-04T16:16:08.662182+0000","last_became_peered":"2024-06-04T16:16:08.662182+0000","last_unstale":"2024-06-04T16:23:34.037390+0000","last_undegraded":"2024-06-04T16:23:34.037390+0000","last_fullsized":"2024-06-04T16:23:34.037390+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:23:34.037278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:23:34.037278+0000","last_clean_scrub_stamp":"2024-06-04T16:23:34.037278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T20:01:36.616756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.e","version":"0'0","reported_seq":33,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:04.074619+0000","last_change":"2024-06-04T16:23:04.074644+0000","last_active":"2024-06-04T16:23:04.074619+0000","last_peered":"2024-06-04T16:23:04.074619+0000","last_clean":"2024-06-04T16:23:04.074619+0000","last_became_active":"2024-06-04T16:09:26.629039+0000","last_became_peered":"2024-06-04T16:09:26.629039+0000","last_unstale":"2024-06-04T16:23:04.074619+0000","last_undegraded":"2024-06-04T16:23:04.074619+0000","last_fullsized":"2024-06-04T16:23:04.074619+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:23:04.074530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:23:04.074530+0000","last_clean_scrub_stamp":"2024-06-04T16:23:04.074530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T20:00:22.482411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.d","version":"254'7","reported_seq":52,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:23.350026+0000","last_change":"2024-06-04T16:23:23.350070+0000","last_active":"2024-06-04T16:23:23.350026+0000","last_peered":"2024-06-04T16:23:23.350026+0000","last_clean":"2024-06-04T16:23:23.350026+0000","last_became_active":"2024-06-04T16:09:23.606695+0000","last_became_peered":"2024-06-04T16:09:23.606695+0000","last_unstale":"2024-06-04T16:23:23.350026+0000","last_undegraded":"2024-06-04T16:23:23.350026+0000","last_fullsized":"2024-06-04T16:23:23.350026+0000","mapping_epoch":246,"log_start":"0'0","ondisk_log_start":"0'0","created":246,"last_epoch_clean":247,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'7","last_scrub_stamp":"2024-06-04T16:23:23.349909+0000","last_deep_scrub":"254'7","last_deep_scrub_stamp":"2024-06-04T16:23:23.349909+0000","last_clean_scrub_stamp":"2024-06-04T16:23:23.349909+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T20:58:47.153109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":20480,"num_write":12,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"64.c","version":"251'31","reported_seq":133,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:50.515381+0000","last_change":"2024-06-04T16:22:50.515381+0000","last_active":"2024-06-04T16:22:50.515381+0000","last_peered":"2024-06-04T16:22:50.515381+0000","last_clean":"2024-06-04T16:22:50.515381+0000","last_became_active":"2024-06-04T16:07:09.510728+0000","last_became_peered":"2024-06-04T16:07:09.510728+0000","last_unstale":"2024-06-04T16:22:50.515381+0000","last_undegraded":"2024-06-04T16:22:50.515381+0000","last_fullsized":"2024-06-04T16:22:50.515381+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":243,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"251'31","last_scrub_stamp":"2024-06-04T16:22:50.515259+0000","last_deep_scrub":"251'31","last_deep_scrub_stamp":"2024-06-04T16:22:50.515259+0000","last_clean_scrub_stamp":"2024-06-04T16:22:50.515259+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T22:41:16.625162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":168,"num_read_kb":120,"num_write":55,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.8","version":"0'0","reported_seq":24,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:28.786476+0000","last_change":"2024-06-04T16:23:28.786525+0000","last_active":"2024-06-04T16:23:28.786476+0000","last_peered":"2024-06-04T16:23:28.786476+0000","last_clean":"2024-06-04T16:23:28.786476+0000","last_became_active":"2024-06-04T16:16:08.664198+0000","last_became_peered":"2024-06-04T16:16:08.664198+0000","last_unstale":"2024-06-04T16:23:28.786476+0000","last_undegraded":"2024-06-04T16:23:28.786476+0000","last_fullsized":"2024-06-04T16:23:28.786476+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:23:28.786390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:23:28.786390+0000","last_clean_scrub_stamp":"2024-06-04T16:23:28.786390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T03:14:34.607243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.9","version":"254'6","reported_seq":44,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:58.503564+0000","last_change":"2024-06-04T16:22:58.503590+0000","last_active":"2024-06-04T16:22:58.503564+0000","last_peered":"2024-06-04T16:22:58.503564+0000","last_clean":"2024-06-04T16:22:58.503564+0000","last_became_active":"2024-06-04T16:09:26.625999+0000","last_became_peered":"2024-06-04T16:09:26.625999+0000","last_unstale":"2024-06-04T16:22:58.503564+0000","last_undegraded":"2024-06-04T16:22:58.503564+0000","last_fullsized":"2024-06-04T16:22:58.503564+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'6","last_scrub_stamp":"2024-06-04T16:22:58.503400+0000","last_deep_scrub":"254'6","last_deep_scrub_stamp":"2024-06-04T16:22:58.503400+0000","last_clean_scrub_stamp":"2024-06-04T16:22:58.503400+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T21:34:38.409946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":9216,"num_write":6,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.a","version":"254'3","reported_seq":42,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:49.524226+0000","last_change":"2024-06-04T16:22:49.524282+0000","last_active":"2024-06-04T16:22:49.524226+0000","last_peered":"2024-06-04T16:22:49.524226+0000","last_clean":"2024-06-04T16:22:49.524226+0000","last_became_active":"2024-06-04T16:09:23.600752+0000","last_became_peered":"2024-06-04T16:09:23.600752+0000","last_unstale":"2024-06-04T16:22:49.524226+0000","last_undegraded":"2024-06-04T16:22:49.524226+0000","last_fullsized":"2024-06-04T16:22:49.524226+0000","mapping_epoch":246,"log_start":"0'0","ondisk_log_start":"0'0","created":246,"last_epoch_clean":247,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'3","last_scrub_stamp":"2024-06-04T16:22:49.524121+0000","last_deep_scrub":"254'3","last_deep_scrub_stamp":"2024-06-04T16:22:49.524121+0000","last_clean_scrub_stamp":"2024-06-04T16:22:49.524121+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T19:02:56.815608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"64.b","version":"251'21","reported_seq":106,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:58.017646+0000","last_change":"2024-06-04T16:22:58.017670+0000","last_active":"2024-06-04T16:22:58.017646+0000","last_peered":"2024-06-04T16:22:58.017646+0000","last_clean":"2024-06-04T16:22:58.017646+0000","last_became_active":"2024-06-04T16:07:09.513020+0000","last_became_peered":"2024-06-04T16:07:09.513020+0000","last_unstale":"2024-06-04T16:22:58.017646+0000","last_undegraded":"2024-06-04T16:22:58.017646+0000","last_fullsized":"2024-06-04T16:22:58.017646+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":243,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"251'21","last_scrub_stamp":"2024-06-04T16:22:58.017535+0000","last_deep_scrub":"251'21","last_deep_scrub_stamp":"2024-06-04T16:22:58.017535+0000","last_clean_scrub_stamp":"2024-06-04T16:22:58.017535+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T18:24:46.428109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":114,"num_read_kb":81,"num_write":38,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.9","version":"0'0","reported_seq":16,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:40.034809+0000","last_change":"2024-06-04T16:16:08.658344+0000","last_active":"2024-06-04T16:22:40.034809+0000","last_peered":"2024-06-04T16:22:40.034809+0000","last_clean":"2024-06-04T16:22:40.034809+0000","last_became_active":"2024-06-04T16:16:08.658076+0000","last_became_peered":"2024-06-04T16:16:08.658076+0000","last_unstale":"2024-06-04T16:22:40.034809+0000","last_undegraded":"2024-06-04T16:22:40.034809+0000","last_fullsized":"2024-06-04T16:22:40.034809+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_clean_scrub_stamp":"2024-06-04T16:16:07.631263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.8","version":"254'7","reported_seq":41,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:52.040855+0000","last_change":"2024-06-04T16:22:52.040890+0000","last_active":"2024-06-04T16:22:52.040855+0000","last_peered":"2024-06-04T16:22:52.040855+0000","last_clean":"2024-06-04T16:22:52.040855+0000","last_became_active":"2024-06-04T16:09:26.623966+0000","last_became_peered":"2024-06-04T16:09:26.623966+0000","last_unstale":"2024-06-04T16:22:52.040855+0000","last_undegraded":"2024-06-04T16:22:52.040855+0000","last_fullsized":"2024-06-04T16:22:52.040855+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'7","last_scrub_stamp":"2024-06-04T16:22:52.040732+0000","last_deep_scrub":"254'7","last_deep_scrub_stamp":"2024-06-04T16:22:52.040732+0000","last_clean_scrub_stamp":"2024-06-04T16:22:52.040732+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T00:48:17.796817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4096,"num_write":12,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.b","version":"254'4","reported_seq":45,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:23.232762+0000","last_change":"2024-06-04T16:23:23.232790+0000","last_active":"2024-06-04T16:23:23.232762+0000","last_peered":"2024-06-04T16:23:23.232762+0000","last_clean":"2024-06-04T16:23:23.232762+0000","last_became_active":"2024-06-04T16:09:23.613130+0000","last_became_peered":"2024-06-04T16:09:23.613130+0000","last_unstale":"2024-06-04T16:23:23.232762+0000","last_undegraded":"2024-06-04T16:23:23.232762+0000","last_fullsized":"2024-06-04T16:23:23.232762+0000","mapping_epoch":246,"log_start":"0'0","ondisk_log_start":"0'0","created":246,"last_epoch_clean":247,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'4","last_scrub_stamp":"2024-06-04T16:23:23.232672+0000","last_deep_scrub":"254'4","last_deep_scrub_stamp":"2024-06-04T16:23:23.232672+0000","last_clean_scrub_stamp":"2024-06-04T16:23:23.232672+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T16:29:52.887408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3775,"num_write":4,"num_write_kb":3775,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"64.a","version":"251'22","reported_seq":109,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:51.982618+0000","last_change":"2024-06-04T16:22:51.982647+0000","last_active":"2024-06-04T16:22:51.982618+0000","last_peered":"2024-06-04T16:22:51.982618+0000","last_clean":"2024-06-04T16:22:51.982618+0000","last_became_active":"2024-06-04T16:07:09.403980+0000","last_became_peered":"2024-06-04T16:07:09.403980+0000","last_unstale":"2024-06-04T16:22:51.982618+0000","last_undegraded":"2024-06-04T16:22:51.982618+0000","last_fullsized":"2024-06-04T16:22:51.982618+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":243,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"251'22","last_scrub_stamp":"2024-06-04T16:22:51.982518+0000","last_deep_scrub":"251'22","last_deep_scrub_stamp":"2024-06-04T16:22:51.982518+0000","last_clean_scrub_stamp":"2024-06-04T16:22:51.982518+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T21:31:54.076119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":122,"num_read_kb":87,"num_write":38,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.a","version":"0'0","reported_seq":24,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:20.813915+0000","last_change":"2024-06-04T16:23:20.813953+0000","last_active":"2024-06-04T16:23:20.813915+0000","last_peered":"2024-06-04T16:23:20.813915+0000","last_clean":"2024-06-04T16:23:20.813915+0000","last_became_active":"2024-06-04T16:16:08.661413+0000","last_became_peered":"2024-06-04T16:16:08.661413+0000","last_unstale":"2024-06-04T16:23:20.813915+0000","last_undegraded":"2024-06-04T16:23:20.813915+0000","last_fullsized":"2024-06-04T16:23:20.813915+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:23:20.813795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:23:20.813795+0000","last_clean_scrub_stamp":"2024-06-04T16:23:20.813795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T23:43:11.287682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.b","version":"254'4","reported_seq":41,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:06.858334+0000","last_change":"2024-06-04T16:23:06.858360+0000","last_active":"2024-06-04T16:23:06.858334+0000","last_peered":"2024-06-04T16:23:06.858334+0000","last_clean":"2024-06-04T16:23:06.858334+0000","last_became_active":"2024-06-04T16:09:26.622600+0000","last_became_peered":"2024-06-04T16:09:26.622600+0000","last_unstale":"2024-06-04T16:23:06.858334+0000","last_undegraded":"2024-06-04T16:23:06.858334+0000","last_fullsized":"2024-06-04T16:23:06.858334+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'4","last_scrub_stamp":"2024-06-04T16:23:06.858249+0000","last_deep_scrub":"254'4","last_deep_scrub_stamp":"2024-06-04T16:23:06.858249+0000","last_clean_scrub_stamp":"2024-06-04T16:23:06.858249+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T00:09:08.441861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":1032,"num_write":4,"num_write_kb":1028,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.8","version":"251'2","reported_seq":43,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:14.877485+0000","last_change":"2024-06-04T16:23:14.877514+0000","last_active":"2024-06-04T16:23:14.877485+0000","last_peered":"2024-06-04T16:23:14.877485+0000","last_clean":"2024-06-04T16:23:14.877485+0000","last_became_active":"2024-06-04T16:09:23.610525+0000","last_became_peered":"2024-06-04T16:09:23.610525+0000","last_unstale":"2024-06-04T16:23:14.877485+0000","last_undegraded":"2024-06-04T16:23:14.877485+0000","last_fullsized":"2024-06-04T16:23:14.877485+0000","mapping_epoch":246,"log_start":"0'0","ondisk_log_start":"0'0","created":246,"last_epoch_clean":247,"parent":"0.0","parent_split_bits":0,"last_scrub":"251'2","last_scrub_stamp":"2024-06-04T16:23:14.877393+0000","last_deep_scrub":"251'2","last_deep_scrub_stamp":"2024-06-04T16:23:14.877393+0000","last_clean_scrub_stamp":"2024-06-04T16:23:14.877393+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T20:03:45.551762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"64.9","version":"251'14","reported_seq":88,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:51.381066+0000","last_change":"2024-06-04T16:22:51.381093+0000","last_active":"2024-06-04T16:22:51.381066+0000","last_peered":"2024-06-04T16:22:51.381066+0000","last_clean":"2024-06-04T16:22:51.381066+0000","last_became_active":"2024-06-04T16:07:09.403227+0000","last_became_peered":"2024-06-04T16:07:09.403227+0000","last_unstale":"2024-06-04T16:22:51.381066+0000","last_undegraded":"2024-06-04T16:22:51.381066+0000","last_fullsized":"2024-06-04T16:22:51.381066+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":243,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"251'14","last_scrub_stamp":"2024-06-04T16:22:51.380961+0000","last_deep_scrub":"251'14","last_deep_scrub_stamp":"2024-06-04T16:22:51.380961+0000","last_clean_scrub_stamp":"2024-06-04T16:22:51.380961+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T23:08:22.543065+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":56,"num_write":27,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.b","version":"0'0","reported_seq":24,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:27.271514+0000","last_change":"2024-06-04T16:23:27.271540+0000","last_active":"2024-06-04T16:23:27.271514+0000","last_peered":"2024-06-04T16:23:27.271514+0000","last_clean":"2024-06-04T16:23:27.271514+0000","last_became_active":"2024-06-04T16:16:08.660717+0000","last_became_peered":"2024-06-04T16:16:08.660717+0000","last_unstale":"2024-06-04T16:23:27.271514+0000","last_undegraded":"2024-06-04T16:23:27.271514+0000","last_fullsized":"2024-06-04T16:23:27.271514+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:23:27.271425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:23:27.271425+0000","last_clean_scrub_stamp":"2024-06-04T16:23:27.271425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T21:13:50.140580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.a","version":"254'2","reported_seq":37,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:49.053054+0000","last_change":"2024-06-04T16:22:49.053106+0000","last_active":"2024-06-04T16:22:49.053054+0000","last_peered":"2024-06-04T16:22:49.053054+0000","last_clean":"2024-06-04T16:22:49.053054+0000","last_became_active":"2024-06-04T16:09:26.620119+0000","last_became_peered":"2024-06-04T16:09:26.620119+0000","last_unstale":"2024-06-04T16:22:49.053054+0000","last_undegraded":"2024-06-04T16:22:49.053054+0000","last_fullsized":"2024-06-04T16:22:49.053054+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'2","last_scrub_stamp":"2024-06-04T16:22:49.052943+0000","last_deep_scrub":"254'2","last_deep_scrub_stamp":"2024-06-04T16:22:49.052943+0000","last_clean_scrub_stamp":"2024-06-04T16:22:49.052943+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T04:22:22.929186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8192,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.9","version":"254'6","reported_seq":51,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:46.368834+0000","last_change":"2024-06-04T16:22:46.368878+0000","last_active":"2024-06-04T16:22:46.368834+0000","last_peered":"2024-06-04T16:22:46.368834+0000","last_clean":"2024-06-04T16:22:46.368834+0000","last_became_active":"2024-06-04T16:09:23.607666+0000","last_became_peered":"2024-06-04T16:09:23.607666+0000","last_unstale":"2024-06-04T16:22:46.368834+0000","last_undegraded":"2024-06-04T16:22:46.368834+0000","last_fullsized":"2024-06-04T16:22:46.368834+0000","mapping_epoch":246,"log_start":"0'0","ondisk_log_start":"0'0","created":246,"last_epoch_clean":247,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'6","last_scrub_stamp":"2024-06-04T16:22:46.368741+0000","last_deep_scrub":"254'6","last_deep_scrub_stamp":"2024-06-04T16:22:46.368741+0000","last_clean_scrub_stamp":"2024-06-04T16:22:46.368741+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T17:57:54.874735+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":16386,"num_write":9,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"64.8","version":"251'8","reported_seq":70,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:55.897731+0000","last_change":"2024-06-04T16:22:55.897764+0000","last_active":"2024-06-04T16:22:55.897731+0000","last_peered":"2024-06-04T16:22:55.897731+0000","last_clean":"2024-06-04T16:22:55.897731+0000","last_became_active":"2024-06-04T16:07:09.404928+0000","last_became_peered":"2024-06-04T16:07:09.404928+0000","last_unstale":"2024-06-04T16:22:55.897731+0000","last_undegraded":"2024-06-04T16:22:55.897731+0000","last_fullsized":"2024-06-04T16:22:55.897731+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":243,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"251'8","last_scrub_stamp":"2024-06-04T16:22:55.897619+0000","last_deep_scrub":"251'8","last_deep_scrub_stamp":"2024-06-04T16:22:55.897619+0000","last_clean_scrub_stamp":"2024-06-04T16:22:55.897619+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T16:49:54.112318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":32,"num_write":14,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.4","version":"0'0","reported_seq":24,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:43.393075+0000","last_change":"2024-06-04T16:23:43.393101+0000","last_active":"2024-06-04T16:23:43.393075+0000","last_peered":"2024-06-04T16:23:43.393075+0000","last_clean":"2024-06-04T16:23:43.393075+0000","last_became_active":"2024-06-04T16:16:08.662732+0000","last_became_peered":"2024-06-04T16:16:08.662732+0000","last_unstale":"2024-06-04T16:23:43.393075+0000","last_undegraded":"2024-06-04T16:23:43.393075+0000","last_fullsized":"2024-06-04T16:23:43.393075+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:23:43.392969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:23:43.392969+0000","last_clean_scrub_stamp":"2024-06-04T16:23:43.392969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T18:13:13.362164+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.5","version":"254'2","reported_seq":36,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:31.871833+0000","last_change":"2024-06-04T16:23:31.871900+0000","last_active":"2024-06-04T16:23:31.871833+0000","last_peered":"2024-06-04T16:23:31.871833+0000","last_clean":"2024-06-04T16:23:31.871833+0000","last_became_active":"2024-06-04T16:09:26.624142+0000","last_became_peered":"2024-06-04T16:09:26.624142+0000","last_unstale":"2024-06-04T16:23:31.871833+0000","last_undegraded":"2024-06-04T16:23:31.871833+0000","last_fullsized":"2024-06-04T16:23:31.871833+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'2","last_scrub_stamp":"2024-06-04T16:23:31.871668+0000","last_deep_scrub":"254'2","last_deep_scrub_stamp":"2024-06-04T16:23:31.871668+0000","last_clean_scrub_stamp":"2024-06-04T16:23:31.871668+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T22:19:56.554258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.6","version":"254'3","reported_seq":44,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:49.001427+0000","last_change":"2024-06-04T16:22:49.001449+0000","last_active":"2024-06-04T16:22:49.001427+0000","last_peered":"2024-06-04T16:22:49.001427+0000","last_clean":"2024-06-04T16:22:49.001427+0000","last_became_active":"2024-06-04T16:09:23.608300+0000","last_became_peered":"2024-06-04T16:09:23.608300+0000","last_unstale":"2024-06-04T16:22:49.001427+0000","last_undegraded":"2024-06-04T16:22:49.001427+0000","last_fullsized":"2024-06-04T16:22:49.001427+0000","mapping_epoch":246,"log_start":"0'0","ondisk_log_start":"0'0","created":246,"last_epoch_clean":247,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'3","last_scrub_stamp":"2024-06-04T16:22:49.001320+0000","last_deep_scrub":"254'3","last_deep_scrub_stamp":"2024-06-04T16:22:49.001320+0000","last_clean_scrub_stamp":"2024-06-04T16:22:49.001320+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T00:45:23.418302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8192,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"64.7","version":"251'16","reported_seq":88,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:48.318184+0000","last_change":"2024-06-04T16:22:48.318225+0000","last_active":"2024-06-04T16:22:48.318184+0000","last_peered":"2024-06-04T16:22:48.318184+0000","last_clean":"2024-06-04T16:22:48.318184+0000","last_became_active":"2024-06-04T16:07:09.511421+0000","last_became_peered":"2024-06-04T16:07:09.511421+0000","last_unstale":"2024-06-04T16:22:48.318184+0000","last_undegraded":"2024-06-04T16:22:48.318184+0000","last_fullsized":"2024-06-04T16:22:48.318184+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":243,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"251'16","last_scrub_stamp":"2024-06-04T16:22:48.318088+0000","last_deep_scrub":"251'16","last_deep_scrub_stamp":"2024-06-04T16:22:48.318088+0000","last_clean_scrub_stamp":"2024-06-04T16:22:48.318088+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T16:27:39.204380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":56,"num_write":28,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.5","version":"0'0","reported_seq":24,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:37.363979+0000","last_change":"2024-06-04T16:23:37.364011+0000","last_active":"2024-06-04T16:23:37.363979+0000","last_peered":"2024-06-04T16:23:37.363979+0000","last_clean":"2024-06-04T16:23:37.363979+0000","last_became_active":"2024-06-04T16:16:08.655913+0000","last_became_peered":"2024-06-04T16:16:08.655913+0000","last_unstale":"2024-06-04T16:23:37.363979+0000","last_undegraded":"2024-06-04T16:23:37.363979+0000","last_fullsized":"2024-06-04T16:23:37.363979+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:23:37.363878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:23:37.363878+0000","last_clean_scrub_stamp":"2024-06-04T16:23:37.363878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T22:06:52.340914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.4","version":"254'2","reported_seq":28,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:39.425172+0000","last_change":"2024-06-04T16:09:26.628240+0000","last_active":"2024-06-04T16:22:39.425172+0000","last_peered":"2024-06-04T16:22:39.425172+0000","last_clean":"2024-06-04T16:22:39.425172+0000","last_became_active":"2024-06-04T16:09:26.627915+0000","last_became_peered":"2024-06-04T16:09:26.627915+0000","last_unstale":"2024-06-04T16:22:39.425172+0000","last_undegraded":"2024-06-04T16:22:39.425172+0000","last_fullsized":"2024-06-04T16:22:39.425172+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_clean_scrub_stamp":"2024-06-04T16:09:25.601105+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.7","version":"251'3","reported_seq":44,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:27.866905+0000","last_change":"2024-06-04T16:23:27.866933+0000","last_active":"2024-06-04T16:23:27.866905+0000","last_peered":"2024-06-04T16:23:27.866905+0000","last_clean":"2024-06-04T16:23:27.866905+0000","last_became_active":"2024-06-04T16:09:23.605516+0000","last_became_peered":"2024-06-04T16:09:23.605516+0000","last_unstale":"2024-06-04T16:23:27.866905+0000","last_undegraded":"2024-06-04T16:23:27.866905+0000","last_fullsized":"2024-06-04T16:23:27.866905+0000","mapping_epoch":246,"log_start":"0'0","ondisk_log_start":"0'0","created":246,"last_epoch_clean":247,"parent":"0.0","parent_split_bits":0,"last_scrub":"251'3","last_scrub_stamp":"2024-06-04T16:23:27.866790+0000","last_deep_scrub":"251'3","last_deep_scrub_stamp":"2024-06-04T16:23:27.866790+0000","last_clean_scrub_stamp":"2024-06-04T16:23:27.866790+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T00:57:26.404262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"64.6","version":"251'12","reported_seq":76,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:43.846902+0000","last_change":"2024-06-04T16:22:43.846928+0000","last_active":"2024-06-04T16:22:43.846902+0000","last_peered":"2024-06-04T16:22:43.846902+0000","last_clean":"2024-06-04T16:22:43.846902+0000","last_became_active":"2024-06-04T16:07:09.397805+0000","last_became_peered":"2024-06-04T16:07:09.397805+0000","last_unstale":"2024-06-04T16:22:43.846902+0000","last_undegraded":"2024-06-04T16:22:43.846902+0000","last_fullsized":"2024-06-04T16:22:43.846902+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":243,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"251'12","last_scrub_stamp":"2024-06-04T16:22:43.846809+0000","last_deep_scrub":"251'12","last_deep_scrub_stamp":"2024-06-04T16:22:43.846809+0000","last_clean_scrub_stamp":"2024-06-04T16:22:43.846809+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T03:24:27.327994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":38,"num_write":27,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.6","version":"253'1","reported_seq":17,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:40.034937+0000","last_change":"2024-06-04T16:16:08.656516+0000","last_active":"2024-06-04T16:22:40.034937+0000","last_peered":"2024-06-04T16:22:40.034937+0000","last_clean":"2024-06-04T16:22:40.034937+0000","last_became_active":"2024-06-04T16:16:08.656182+0000","last_became_peered":"2024-06-04T16:16:08.656182+0000","last_unstale":"2024-06-04T16:22:40.034937+0000","last_undegraded":"2024-06-04T16:22:40.034937+0000","last_fullsized":"2024-06-04T16:22:40.034937+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_clean_scrub_stamp":"2024-06-04T16:16:07.631263+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.7","version":"0'0","reported_seq":25,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:30.033686+0000","last_change":"2024-06-04T16:09:26.626653+0000","last_active":"2024-06-04T16:22:30.033686+0000","last_peered":"2024-06-04T16:22:30.033686+0000","last_clean":"2024-06-04T16:22:30.033686+0000","last_became_active":"2024-06-04T16:09:26.625833+0000","last_became_peered":"2024-06-04T16:09:26.625833+0000","last_unstale":"2024-06-04T16:22:30.033686+0000","last_undegraded":"2024-06-04T16:22:30.033686+0000","last_fullsized":"2024-06-04T16:22:30.033686+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:09:25.601105+0000","last_clean_scrub_stamp":"2024-06-04T16:09:25.601105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.4","version":"0'0","reported_seq":39,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:55.080532+0000","last_change":"2024-06-04T16:22:55.080556+0000","last_active":"2024-06-04T16:22:55.080532+0000","last_peered":"2024-06-04T16:22:55.080532+0000","last_clean":"2024-06-04T16:22:55.080532+0000","last_became_active":"2024-06-04T16:09:23.606669+0000","last_became_peered":"2024-06-04T16:09:23.606669+0000","last_unstale":"2024-06-04T16:22:55.080532+0000","last_undegraded":"2024-06-04T16:22:55.080532+0000","last_fullsized":"2024-06-04T16:22:55.080532+0000","mapping_epoch":246,"log_start":"0'0","ondisk_log_start":"0'0","created":246,"last_epoch_clean":247,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:22:55.080426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:22:55.080426+0000","last_clean_scrub_stamp":"2024-06-04T16:22:55.080426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T04:12:00.220771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"64.5","version":"254'31","reported_seq":136,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:46.146644+0000","last_change":"2024-06-04T16:22:46.146668+0000","last_active":"2024-06-04T16:22:46.146644+0000","last_peered":"2024-06-04T16:22:46.146644+0000","last_clean":"2024-06-04T16:22:46.146644+0000","last_became_active":"2024-06-04T16:07:09.403868+0000","last_became_peered":"2024-06-04T16:07:09.403868+0000","last_unstale":"2024-06-04T16:22:46.146644+0000","last_undegraded":"2024-06-04T16:22:46.146644+0000","last_fullsized":"2024-06-04T16:22:46.146644+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":243,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'31","last_scrub_stamp":"2024-06-04T16:22:46.146551+0000","last_deep_scrub":"254'31","last_deep_scrub_stamp":"2024-06-04T16:22:46.146551+0000","last_clean_scrub_stamp":"2024-06-04T16:22:46.146551+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T03:51:35.087658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":170,"num_read_kb":120,"num_write":66,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.7","version":"0'0","reported_seq":24,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:19.846994+0000","last_change":"2024-06-04T16:23:19.847020+0000","last_active":"2024-06-04T16:23:19.846994+0000","last_peered":"2024-06-04T16:23:19.846994+0000","last_clean":"2024-06-04T16:23:19.846994+0000","last_became_active":"2024-06-04T16:16:08.661379+0000","last_became_peered":"2024-06-04T16:16:08.661379+0000","last_unstale":"2024-06-04T16:23:19.846994+0000","last_undegraded":"2024-06-04T16:23:19.846994+0000","last_fullsized":"2024-06-04T16:23:19.846994+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:23:19.846894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:23:19.846894+0000","last_clean_scrub_stamp":"2024-06-04T16:23:19.846894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T20:31:05.565364+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.6","version":"0'0","reported_seq":33,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:55.526651+0000","last_change":"2024-06-04T16:22:55.526689+0000","last_active":"2024-06-04T16:22:55.526651+0000","last_peered":"2024-06-04T16:22:55.526651+0000","last_clean":"2024-06-04T16:22:55.526651+0000","last_became_active":"2024-06-04T16:09:26.624074+0000","last_became_peered":"2024-06-04T16:09:26.624074+0000","last_unstale":"2024-06-04T16:22:55.526651+0000","last_undegraded":"2024-06-04T16:22:55.526651+0000","last_fullsized":"2024-06-04T16:22:55.526651+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:22:55.526546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:22:55.526546+0000","last_clean_scrub_stamp":"2024-06-04T16:22:55.526546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T03:18:57.714249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.5","version":"254'4","reported_seq":45,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:48.563049+0000","last_change":"2024-06-04T16:22:48.563077+0000","last_active":"2024-06-04T16:22:48.563049+0000","last_peered":"2024-06-04T16:22:48.563049+0000","last_clean":"2024-06-04T16:22:48.563049+0000","last_became_active":"2024-06-04T16:09:23.604255+0000","last_became_peered":"2024-06-04T16:09:23.604255+0000","last_unstale":"2024-06-04T16:22:48.563049+0000","last_undegraded":"2024-06-04T16:22:48.563049+0000","last_fullsized":"2024-06-04T16:22:48.563049+0000","mapping_epoch":246,"log_start":"0'0","ondisk_log_start":"0'0","created":246,"last_epoch_clean":247,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'4","last_scrub_stamp":"2024-06-04T16:22:48.562953+0000","last_deep_scrub":"254'4","last_deep_scrub_stamp":"2024-06-04T16:22:48.562953+0000","last_clean_scrub_stamp":"2024-06-04T16:22:48.562953+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T18:29:37.864894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":4,"num_write_kb":1026,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"64.4","version":"254'14","reported_seq":85,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:44.859762+0000","last_change":"2024-06-04T16:22:44.859785+0000","last_active":"2024-06-04T16:22:44.859762+0000","last_peered":"2024-06-04T16:22:44.859762+0000","last_clean":"2024-06-04T16:22:44.859762+0000","last_became_active":"2024-06-04T16:07:09.396484+0000","last_became_peered":"2024-06-04T16:07:09.396484+0000","last_unstale":"2024-06-04T16:22:44.859762+0000","last_undegraded":"2024-06-04T16:22:44.859762+0000","last_fullsized":"2024-06-04T16:22:44.859762+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":243,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'14","last_scrub_stamp":"2024-06-04T16:22:44.859685+0000","last_deep_scrub":"254'14","last_deep_scrub_stamp":"2024-06-04T16:22:44.859685+0000","last_clean_scrub_stamp":"2024-06-04T16:22:44.859685+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T22:48:04.782391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":52,"num_write":27,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.0","version":"0'0","reported_seq":16,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:10.031288+0000","last_change":"2024-06-04T16:16:08.661272+0000","last_active":"2024-06-04T16:22:10.031288+0000","last_peered":"2024-06-04T16:22:10.031288+0000","last_clean":"2024-06-04T16:22:10.031288+0000","last_became_active":"2024-06-04T16:16:08.660893+0000","last_became_peered":"2024-06-04T16:16:08.660893+0000","last_unstale":"2024-06-04T16:22:10.031288+0000","last_undegraded":"2024-06-04T16:22:10.031288+0000","last_fullsized":"2024-06-04T16:22:10.031288+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:16:07.631263+0000","last_clean_scrub_stamp":"2024-06-04T16:16:07.631263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1","version":"251'2","reported_seq":37,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:10.885930+0000","last_change":"2024-06-04T16:23:10.885979+0000","last_active":"2024-06-04T16:23:10.885930+0000","last_peered":"2024-06-04T16:23:10.885930+0000","last_clean":"2024-06-04T16:23:10.885930+0000","last_became_active":"2024-06-04T16:09:26.623190+0000","last_became_peered":"2024-06-04T16:09:26.623190+0000","last_unstale":"2024-06-04T16:23:10.885930+0000","last_undegraded":"2024-06-04T16:23:10.885930+0000","last_fullsized":"2024-06-04T16:23:10.885930+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"251'2","last_scrub_stamp":"2024-06-04T16:23:10.885822+0000","last_deep_scrub":"251'2","last_deep_scrub_stamp":"2024-06-04T16:23:10.885822+0000","last_clean_scrub_stamp":"2024-06-04T16:23:10.885822+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T00:05:15.167784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.2","version":"254'6","reported_seq":50,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:02.911920+0000","last_change":"2024-06-04T16:23:02.911961+0000","last_active":"2024-06-04T16:23:02.911920+0000","last_peered":"2024-06-04T16:23:02.911920+0000","last_clean":"2024-06-04T16:23:02.911920+0000","last_became_active":"2024-06-04T16:09:23.610479+0000","last_became_peered":"2024-06-04T16:09:23.610479+0000","last_unstale":"2024-06-04T16:23:02.911920+0000","last_undegraded":"2024-06-04T16:23:02.911920+0000","last_fullsized":"2024-06-04T16:23:02.911920+0000","mapping_epoch":246,"log_start":"0'0","ondisk_log_start":"0'0","created":246,"last_epoch_clean":247,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'6","last_scrub_stamp":"2024-06-04T16:23:02.911818+0000","last_deep_scrub":"254'6","last_deep_scrub_stamp":"2024-06-04T16:23:02.911818+0000","last_clean_scrub_stamp":"2024-06-04T16:23:02.911818+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T20:46:50.376469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5120,"num_write":6,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"64.3","version":"251'23","reported_seq":107,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:47.329783+0000","last_change":"2024-06-04T16:22:47.329808+0000","last_active":"2024-06-04T16:22:47.329783+0000","last_peered":"2024-06-04T16:22:47.329783+0000","last_clean":"2024-06-04T16:22:47.329783+0000","last_became_active":"2024-06-04T16:07:09.512996+0000","last_became_peered":"2024-06-04T16:07:09.512996+0000","last_unstale":"2024-06-04T16:22:47.329783+0000","last_undegraded":"2024-06-04T16:22:47.329783+0000","last_fullsized":"2024-06-04T16:22:47.329783+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":243,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"251'23","last_scrub_stamp":"2024-06-04T16:22:47.329687+0000","last_deep_scrub":"251'23","last_deep_scrub_stamp":"2024-06-04T16:22:47.329687+0000","last_clean_scrub_stamp":"2024-06-04T16:22:47.329687+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T16:28:06.079176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":113,"num_read_kb":81,"num_write":51,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1","version":"0'0","reported_seq":24,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:32.909959+0000","last_change":"2024-06-04T16:23:32.909999+0000","last_active":"2024-06-04T16:23:32.909959+0000","last_peered":"2024-06-04T16:23:32.909959+0000","last_clean":"2024-06-04T16:23:32.909959+0000","last_became_active":"2024-06-04T16:16:08.660177+0000","last_became_peered":"2024-06-04T16:16:08.660177+0000","last_unstale":"2024-06-04T16:23:32.909959+0000","last_undegraded":"2024-06-04T16:23:32.909959+0000","last_fullsized":"2024-06-04T16:23:32.909959+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:23:32.909831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:23:32.909831+0000","last_clean_scrub_stamp":"2024-06-04T16:23:32.909831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T21:58:38.586000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.0","version":"254'2","reported_seq":37,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:22.667486+0000","last_change":"2024-06-04T16:23:22.667486+0000","last_active":"2024-06-04T16:23:22.667486+0000","last_peered":"2024-06-04T16:23:22.667486+0000","last_clean":"2024-06-04T16:23:22.667486+0000","last_became_active":"2024-06-04T16:09:26.626576+0000","last_became_peered":"2024-06-04T16:09:26.626576+0000","last_unstale":"2024-06-04T16:23:22.667486+0000","last_undegraded":"2024-06-04T16:23:22.667486+0000","last_fullsized":"2024-06-04T16:23:22.667486+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'2","last_scrub_stamp":"2024-06-04T16:23:22.667335+0000","last_deep_scrub":"254'2","last_deep_scrub_stamp":"2024-06-04T16:23:22.667335+0000","last_clean_scrub_stamp":"2024-06-04T16:23:22.667335+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T18:44:29.644287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.3","version":"254'2","reported_seq":42,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:46.486358+0000","last_change":"2024-06-04T16:22:46.486379+0000","last_active":"2024-06-04T16:22:46.486358+0000","last_peered":"2024-06-04T16:22:46.486358+0000","last_clean":"2024-06-04T16:22:46.486358+0000","last_became_active":"2024-06-04T16:09:23.604413+0000","last_became_peered":"2024-06-04T16:09:23.604413+0000","last_unstale":"2024-06-04T16:22:46.486358+0000","last_undegraded":"2024-06-04T16:22:46.486358+0000","last_fullsized":"2024-06-04T16:22:46.486358+0000","mapping_epoch":246,"log_start":"0'0","ondisk_log_start":"0'0","created":246,"last_epoch_clean":247,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'2","last_scrub_stamp":"2024-06-04T16:22:46.486286+0000","last_deep_scrub":"254'2","last_deep_scrub_stamp":"2024-06-04T16:22:46.486286+0000","last_clean_scrub_stamp":"2024-06-04T16:22:46.486286+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T03:08:45.620913+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"64.2","version":"254'2","reported_seq":52,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:47.896868+0000","last_change":"2024-06-04T16:22:47.896908+0000","last_active":"2024-06-04T16:22:47.896868+0000","last_peered":"2024-06-04T16:22:47.896868+0000","last_clean":"2024-06-04T16:22:47.896868+0000","last_became_active":"2024-06-04T16:07:09.401796+0000","last_became_peered":"2024-06-04T16:07:09.401796+0000","last_unstale":"2024-06-04T16:22:47.896868+0000","last_undegraded":"2024-06-04T16:22:47.896868+0000","last_fullsized":"2024-06-04T16:22:47.896868+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":243,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'2","last_scrub_stamp":"2024-06-04T16:22:47.896756+0000","last_deep_scrub":"254'2","last_deep_scrub_stamp":"2024-06-04T16:22:47.896756+0000","last_clean_scrub_stamp":"2024-06-04T16:22:47.896756+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T03:55:14.174846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":7,"num_write":11,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.2","version":"0'0","reported_seq":24,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:25.719370+0000","last_change":"2024-06-04T16:23:25.719398+0000","last_active":"2024-06-04T16:23:25.719370+0000","last_peered":"2024-06-04T16:23:25.719370+0000","last_clean":"2024-06-04T16:23:25.719370+0000","last_became_active":"2024-06-04T16:16:08.656245+0000","last_became_peered":"2024-06-04T16:16:08.656245+0000","last_unstale":"2024-06-04T16:23:25.719370+0000","last_undegraded":"2024-06-04T16:23:25.719370+0000","last_fullsized":"2024-06-04T16:23:25.719370+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:23:25.719271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:23:25.719271+0000","last_clean_scrub_stamp":"2024-06-04T16:23:25.719271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T18:39:45.608723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.3","version":"254'4","reported_seq":40,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:27.270953+0000","last_change":"2024-06-04T16:23:27.270978+0000","last_active":"2024-06-04T16:23:27.270953+0000","last_peered":"2024-06-04T16:23:27.270953+0000","last_clean":"2024-06-04T16:23:27.270953+0000","last_became_active":"2024-06-04T16:09:26.627193+0000","last_became_peered":"2024-06-04T16:09:26.627193+0000","last_unstale":"2024-06-04T16:23:27.270953+0000","last_undegraded":"2024-06-04T16:23:27.270953+0000","last_fullsized":"2024-06-04T16:23:27.270953+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'4","last_scrub_stamp":"2024-06-04T16:23:27.270864+0000","last_deep_scrub":"254'4","last_deep_scrub_stamp":"2024-06-04T16:23:27.270864+0000","last_clean_scrub_stamp":"2024-06-04T16:23:27.270864+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T17:25:56.886677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":6144,"num_write":4,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.0","version":"254'2","reported_seq":43,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:45.465785+0000","last_change":"2024-06-04T16:22:45.465785+0000","last_active":"2024-06-04T16:22:45.465785+0000","last_peered":"2024-06-04T16:22:45.465785+0000","last_clean":"2024-06-04T16:22:45.465785+0000","last_became_active":"2024-06-04T16:09:23.605145+0000","last_became_peered":"2024-06-04T16:09:23.605145+0000","last_unstale":"2024-06-04T16:22:45.465785+0000","last_undegraded":"2024-06-04T16:22:45.465785+0000","last_fullsized":"2024-06-04T16:22:45.465785+0000","mapping_epoch":246,"log_start":"0'0","ondisk_log_start":"0'0","created":246,"last_epoch_clean":247,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'2","last_scrub_stamp":"2024-06-04T16:22:45.465690+0000","last_deep_scrub":"254'2","last_deep_scrub_stamp":"2024-06-04T16:22:45.465690+0000","last_clean_scrub_stamp":"2024-06-04T16:22:45.465690+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T23:45:13.033536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"64.1","version":"245'23","reported_seq":112,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:48.104188+0000","last_change":"2024-06-04T16:22:48.104216+0000","last_active":"2024-06-04T16:22:48.104188+0000","last_peered":"2024-06-04T16:22:48.104188+0000","last_clean":"2024-06-04T16:22:48.104188+0000","last_became_active":"2024-06-04T16:07:09.405086+0000","last_became_peered":"2024-06-04T16:07:09.405086+0000","last_unstale":"2024-06-04T16:22:48.104188+0000","last_undegraded":"2024-06-04T16:22:48.104188+0000","last_fullsized":"2024-06-04T16:22:48.104188+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":243,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"245'23","last_scrub_stamp":"2024-06-04T16:22:48.104090+0000","last_deep_scrub":"245'23","last_deep_scrub_stamp":"2024-06-04T16:22:48.104090+0000","last_clean_scrub_stamp":"2024-06-04T16:22:48.104090+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T22:36:27.428584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":130,"num_read_kb":96,"num_write":31,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.3","version":"0'0","reported_seq":24,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:27.756641+0000","last_change":"2024-06-04T16:23:27.756682+0000","last_active":"2024-06-04T16:23:27.756641+0000","last_peered":"2024-06-04T16:23:27.756641+0000","last_clean":"2024-06-04T16:23:27.756641+0000","last_became_active":"2024-06-04T16:16:08.661111+0000","last_became_peered":"2024-06-04T16:16:08.661111+0000","last_unstale":"2024-06-04T16:23:27.756641+0000","last_undegraded":"2024-06-04T16:23:27.756641+0000","last_fullsized":"2024-06-04T16:23:27.756641+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:23:27.756531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:23:27.756531+0000","last_clean_scrub_stamp":"2024-06-04T16:23:27.756531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T22:23:11.844959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.2","version":"254'2","reported_seq":37,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:25.312057+0000","last_change":"2024-06-04T16:23:25.312084+0000","last_active":"2024-06-04T16:23:25.312057+0000","last_peered":"2024-06-04T16:23:25.312057+0000","last_clean":"2024-06-04T16:23:25.312057+0000","last_became_active":"2024-06-04T16:09:26.624890+0000","last_became_peered":"2024-06-04T16:09:26.624890+0000","last_unstale":"2024-06-04T16:23:25.312057+0000","last_undegraded":"2024-06-04T16:23:25.312057+0000","last_fullsized":"2024-06-04T16:23:25.312057+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'2","last_scrub_stamp":"2024-06-04T16:23:25.311962+0000","last_deep_scrub":"254'2","last_deep_scrub_stamp":"2024-06-04T16:23:25.311962+0000","last_clean_scrub_stamp":"2024-06-04T16:23:25.311962+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T20:45:06.634469+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8192,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.1","version":"254'11","reported_seq":62,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:54.943147+0000","last_change":"2024-06-04T16:22:54.943177+0000","last_active":"2024-06-04T16:22:54.943147+0000","last_peered":"2024-06-04T16:22:54.943147+0000","last_clean":"2024-06-04T16:22:54.943147+0000","last_became_active":"2024-06-04T16:09:23.609072+0000","last_became_peered":"2024-06-04T16:09:23.609072+0000","last_unstale":"2024-06-04T16:22:54.943147+0000","last_undegraded":"2024-06-04T16:22:54.943147+0000","last_fullsized":"2024-06-04T16:22:54.943147+0000","mapping_epoch":246,"log_start":"0'0","ondisk_log_start":"0'0","created":246,"last_epoch_clean":247,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'11","last_scrub_stamp":"2024-06-04T16:22:54.943049+0000","last_deep_scrub":"254'11","last_deep_scrub_stamp":"2024-06-04T16:22:54.943049+0000","last_clean_scrub_stamp":"2024-06-04T16:22:54.943049+0000","objects_scrubbed":1,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T18:38:55.646525+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":15362,"num_write":9,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"64.0","version":"254'11","reported_seq":77,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:01.039472+0000","last_change":"2024-06-04T16:23:01.039472+0000","last_active":"2024-06-04T16:23:01.039472+0000","last_peered":"2024-06-04T16:23:01.039472+0000","last_clean":"2024-06-04T16:23:01.039472+0000","last_became_active":"2024-06-04T16:07:09.405109+0000","last_became_peered":"2024-06-04T16:07:09.405109+0000","last_unstale":"2024-06-04T16:23:01.039472+0000","last_undegraded":"2024-06-04T16:23:01.039472+0000","last_fullsized":"2024-06-04T16:23:01.039472+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":243,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'11","last_scrub_stamp":"2024-06-04T16:23:01.039356+0000","last_deep_scrub":"254'11","last_deep_scrub_stamp":"2024-06-04T16:23:01.039356+0000","last_clean_scrub_stamp":"2024-06-04T16:23:01.039356+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T20:47:01.766277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":37,"num_write":22,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"251'58","reported_seq":576,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:02.739712+0000","last_change":"2024-06-04T16:23:02.739753+0000","last_active":"2024-06-04T16:23:02.739712+0000","last_peered":"2024-06-04T16:23:02.739712+0000","last_clean":"2024-06-04T16:23:02.739712+0000","last_became_active":"2024-06-04T15:52:36.496345+0000","last_became_peered":"2024-06-04T15:52:36.496345+0000","last_unstale":"2024-06-04T16:23:02.739712+0000","last_undegraded":"2024-06-04T16:23:02.739712+0000","last_fullsized":"2024-06-04T16:23:02.739712+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"251'58","last_scrub_stamp":"2024-06-04T16:23:02.739604+0000","last_deep_scrub":"251'58","last_deep_scrub_stamp":"2024-06-04T16:23:02.739604+0000","last_clean_scrub_stamp":"2024-06-04T16:23:02.739604+0000","objects_scrubbed":2,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T22:51:46.895844+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":73,"num_read_kb":10950,"num_write":187,"num_write_kb":28882,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"254'156","reported_seq":896,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:01.232920+0000","last_change":"2024-06-04T16:23:01.232957+0000","last_active":"2024-06-04T16:23:01.232920+0000","last_peered":"2024-06-04T16:23:01.232920+0000","last_clean":"2024-06-04T16:23:01.232920+0000","last_became_active":"2024-06-04T15:52:38.485491+0000","last_became_peered":"2024-06-04T15:52:38.485491+0000","last_unstale":"2024-06-04T16:23:01.232920+0000","last_undegraded":"2024-06-04T16:23:01.232920+0000","last_fullsized":"2024-06-04T16:23:01.232920+0000","mapping_epoch":23,"log_start":"251'100","ondisk_log_start":"251'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'156","last_scrub_stamp":"2024-06-04T16:23:01.232829+0000","last_deep_scrub":"254'156","last_deep_scrub_stamp":"2024-06-04T16:23:01.232829+0000","last_clean_scrub_stamp":"2024-06-04T16:23:01.232829+0000","objects_scrubbed":1,"log_size":56,"log_dups_size":100,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T00:53:06.796590+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":710,"num_read_kb":632,"num_write":201,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"251'45","reported_seq":574,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:32.358946+0000","last_change":"2024-06-04T16:23:32.359020+0000","last_active":"2024-06-04T16:23:32.358946+0000","last_peered":"2024-06-04T16:23:32.358946+0000","last_clean":"2024-06-04T16:23:32.358946+0000","last_became_active":"2024-06-04T15:52:36.484223+0000","last_became_peered":"2024-06-04T15:52:36.484223+0000","last_unstale":"2024-06-04T16:23:32.358946+0000","last_undegraded":"2024-06-04T16:23:32.358946+0000","last_fullsized":"2024-06-04T16:23:32.358946+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"251'45","last_scrub_stamp":"2024-06-04T16:23:32.358841+0000","last_deep_scrub":"251'45","last_deep_scrub_stamp":"2024-06-04T16:23:32.358841+0000","last_clean_scrub_stamp":"2024-06-04T16:23:32.358841+0000","objects_scrubbed":5,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T22:06:51.049294+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1311028,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":90,"num_read_kb":9967,"num_write":210,"num_write_kb":17365,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,0],"acting":[5,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.39","version":"254'111","reported_seq":869,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:26.684727+0000","last_change":"2024-06-04T16:23:26.684760+0000","last_active":"2024-06-04T16:23:26.684727+0000","last_peered":"2024-06-04T16:23:26.684727+0000","last_clean":"2024-06-04T16:23:26.684727+0000","last_became_active":"2024-06-04T15:52:38.482000+0000","last_became_peered":"2024-06-04T15:52:38.482000+0000","last_unstale":"2024-06-04T16:23:26.684727+0000","last_undegraded":"2024-06-04T16:23:26.684727+0000","last_fullsized":"2024-06-04T16:23:26.684727+0000","mapping_epoch":23,"log_start":"254'100","ondisk_log_start":"254'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'111","last_scrub_stamp":"2024-06-04T16:23:26.684634+0000","last_deep_scrub":"254'111","last_deep_scrub_stamp":"2024-06-04T16:23:26.684634+0000","last_clean_scrub_stamp":"2024-06-04T16:23:26.684634+0000","objects_scrubbed":3,"log_size":11,"log_dups_size":100,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T17:32:45.765295+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":584,"num_read_kb":552,"num_write":123,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"254'42","reported_seq":547,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:29.407376+0000","last_change":"2024-06-04T16:23:29.407466+0000","last_active":"2024-06-04T16:23:29.407376+0000","last_peered":"2024-06-04T16:23:29.407376+0000","last_clean":"2024-06-04T16:23:29.407376+0000","last_became_active":"2024-06-04T15:52:36.479881+0000","last_became_peered":"2024-06-04T15:52:36.479881+0000","last_unstale":"2024-06-04T16:23:29.407376+0000","last_undegraded":"2024-06-04T16:23:29.407376+0000","last_fullsized":"2024-06-04T16:23:29.407376+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'42","last_scrub_stamp":"2024-06-04T16:23:29.407263+0000","last_deep_scrub":"254'42","last_deep_scrub_stamp":"2024-06-04T16:23:29.407263+0000","last_clean_scrub_stamp":"2024-06-04T16:23:29.407263+0000","objects_scrubbed":2,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T20:30:36.461307+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":40,"num_read_kb":31,"num_write":168,"num_write_kb":16512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3a","version":"254'108","reported_seq":827,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:28.688470+0000","last_change":"2024-06-04T16:23:28.688503+0000","last_active":"2024-06-04T16:23:28.688470+0000","last_peered":"2024-06-04T16:23:28.688470+0000","last_clean":"2024-06-04T16:23:28.688470+0000","last_became_active":"2024-06-04T15:52:38.483240+0000","last_became_peered":"2024-06-04T15:52:38.483240+0000","last_unstale":"2024-06-04T16:23:28.688470+0000","last_undegraded":"2024-06-04T16:23:28.688470+0000","last_fullsized":"2024-06-04T16:23:28.688470+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'108","last_scrub_stamp":"2024-06-04T16:23:28.688395+0000","last_deep_scrub":"254'108","last_deep_scrub_stamp":"2024-06-04T16:23:28.688395+0000","last_clean_scrub_stamp":"2024-06-04T16:23:28.688395+0000","objects_scrubbed":2,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T03:27:22.928255+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":515,"num_read_kb":482,"num_write":131,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"254'78","reported_seq":590,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:15.616829+0000","last_change":"2024-06-04T16:23:15.616915+0000","last_active":"2024-06-04T16:23:15.616829+0000","last_peered":"2024-06-04T16:23:15.616829+0000","last_clean":"2024-06-04T16:23:15.616829+0000","last_became_active":"2024-06-04T15:52:36.476981+0000","last_became_peered":"2024-06-04T15:52:36.476981+0000","last_unstale":"2024-06-04T16:23:15.616829+0000","last_undegraded":"2024-06-04T16:23:15.616829+0000","last_fullsized":"2024-06-04T16:23:15.616829+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'78","last_scrub_stamp":"2024-06-04T16:23:15.616718+0000","last_deep_scrub":"254'78","last_deep_scrub_stamp":"2024-06-04T16:23:15.616718+0000","last_clean_scrub_stamp":"2024-06-04T16:23:15.616718+0000","objects_scrubbed":2,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T20:13:50.024747+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":3145,"num_write":255,"num_write_kb":33835,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"254'149","reported_seq":1045,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:14.936095+0000","last_change":"2024-06-04T16:23:14.936140+0000","last_active":"2024-06-04T16:23:14.936095+0000","last_peered":"2024-06-04T16:23:14.936095+0000","last_clean":"2024-06-04T16:23:14.936095+0000","last_became_active":"2024-06-04T15:52:38.480986+0000","last_became_peered":"2024-06-04T15:52:38.480986+0000","last_unstale":"2024-06-04T16:23:14.936095+0000","last_undegraded":"2024-06-04T16:23:14.936095+0000","last_fullsized":"2024-06-04T16:23:14.936095+0000","mapping_epoch":23,"log_start":"251'100","ondisk_log_start":"251'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'149","last_scrub_stamp":"2024-06-04T16:23:14.935987+0000","last_deep_scrub":"254'149","last_deep_scrub_stamp":"2024-06-04T16:23:14.935987+0000","last_clean_scrub_stamp":"2024-06-04T16:23:14.935987+0000","objects_scrubbed":1,"log_size":49,"log_dups_size":100,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T23:09:16.826992+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1072,"num_read_kb":1014,"num_write":195,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2193,"num_omap_keys":9,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"251'46","reported_seq":565,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:12.848585+0000","last_change":"2024-06-04T16:23:12.848636+0000","last_active":"2024-06-04T16:23:12.848585+0000","last_peered":"2024-06-04T16:23:12.848585+0000","last_clean":"2024-06-04T16:23:12.848585+0000","last_became_active":"2024-06-04T15:52:36.495401+0000","last_became_peered":"2024-06-04T15:52:36.495401+0000","last_unstale":"2024-06-04T16:23:12.848585+0000","last_undegraded":"2024-06-04T16:23:12.848585+0000","last_fullsized":"2024-06-04T16:23:12.848585+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"251'46","last_scrub_stamp":"2024-06-04T16:23:12.848406+0000","last_deep_scrub":"251'46","last_deep_scrub_stamp":"2024-06-04T16:23:12.848406+0000","last_clean_scrub_stamp":"2024-06-04T16:23:12.848406+0000","objects_scrubbed":2,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T19:11:57.083518+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":89,"num_read_kb":6218,"num_write":199,"num_write_kb":11815,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"254'159","reported_seq":1096,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:58.807663+0000","last_change":"2024-06-04T16:22:58.807693+0000","last_active":"2024-06-04T16:22:58.807663+0000","last_peered":"2024-06-04T16:22:58.807663+0000","last_clean":"2024-06-04T16:22:58.807663+0000","last_became_active":"2024-06-04T15:52:38.484828+0000","last_became_peered":"2024-06-04T15:52:38.484828+0000","last_unstale":"2024-06-04T16:22:58.807663+0000","last_undegraded":"2024-06-04T16:22:58.807663+0000","last_fullsized":"2024-06-04T16:22:58.807663+0000","mapping_epoch":23,"log_start":"251'100","ondisk_log_start":"251'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'159","last_scrub_stamp":"2024-06-04T16:22:58.807558+0000","last_deep_scrub":"254'159","last_deep_scrub_stamp":"2024-06-04T16:22:58.807558+0000","last_clean_scrub_stamp":"2024-06-04T16:22:58.807558+0000","objects_scrubbed":2,"log_size":59,"log_dups_size":100,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T21:15:10.613499+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1071,"num_read_kb":1008,"num_write":198,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2864,"num_omap_keys":12,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"254'61","reported_seq":579,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:14.577814+0000","last_change":"2024-06-04T16:23:14.577857+0000","last_active":"2024-06-04T16:23:14.577814+0000","last_peered":"2024-06-04T16:23:14.577814+0000","last_clean":"2024-06-04T16:23:14.577814+0000","last_became_active":"2024-06-04T15:52:36.476167+0000","last_became_peered":"2024-06-04T15:52:36.476167+0000","last_unstale":"2024-06-04T16:23:14.577814+0000","last_undegraded":"2024-06-04T16:23:14.577814+0000","last_fullsized":"2024-06-04T16:23:14.577814+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'61","last_scrub_stamp":"2024-06-04T16:23:14.577722+0000","last_deep_scrub":"254'61","last_deep_scrub_stamp":"2024-06-04T16:23:14.577722+0000","last_clean_scrub_stamp":"2024-06-04T16:23:14.577722+0000","objects_scrubbed":1,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T00:44:08.552179+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":87,"num_read_kb":1095,"num_write":236,"num_write_kb":40818,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,7],"acting":[2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"254'99","reported_seq":820,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:00.757093+0000","last_change":"2024-06-04T16:23:00.757161+0000","last_active":"2024-06-04T16:23:00.757093+0000","last_peered":"2024-06-04T16:23:00.757093+0000","last_clean":"2024-06-04T16:23:00.757093+0000","last_became_active":"2024-06-04T15:52:38.482025+0000","last_became_peered":"2024-06-04T15:52:38.482025+0000","last_unstale":"2024-06-04T16:23:00.757093+0000","last_undegraded":"2024-06-04T16:23:00.757093+0000","last_fullsized":"2024-06-04T16:23:00.757093+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'99","last_scrub_stamp":"2024-06-04T16:23:00.756985+0000","last_deep_scrub":"254'99","last_deep_scrub_stamp":"2024-06-04T16:23:00.756985+0000","last_clean_scrub_stamp":"2024-06-04T16:23:00.756985+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T03:26:31.902180+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":511,"num_read_kb":478,"num_write":121,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.39","version":"251'54","reported_seq":558,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:09.793735+0000","last_change":"2024-06-04T16:23:09.793778+0000","last_active":"2024-06-04T16:23:09.793735+0000","last_peered":"2024-06-04T16:23:09.793735+0000","last_clean":"2024-06-04T16:23:09.793735+0000","last_became_active":"2024-06-04T15:52:36.493029+0000","last_became_peered":"2024-06-04T15:52:36.493029+0000","last_unstale":"2024-06-04T16:23:09.793735+0000","last_undegraded":"2024-06-04T16:23:09.793735+0000","last_fullsized":"2024-06-04T16:23:09.793735+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"251'54","last_scrub_stamp":"2024-06-04T16:23:09.793630+0000","last_deep_scrub":"251'54","last_deep_scrub_stamp":"2024-06-04T16:23:09.793630+0000","last_clean_scrub_stamp":"2024-06-04T16:23:09.793630+0000","objects_scrubbed":4,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T22:45:15.488703+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194343,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":48,"num_read_kb":7228,"num_write":201,"num_write_kb":32271,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,1],"acting":[0,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"254'138","reported_seq":1109,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:04.451889+0000","last_change":"2024-06-04T16:23:04.451925+0000","last_active":"2024-06-04T16:23:04.451889+0000","last_peered":"2024-06-04T16:23:04.451889+0000","last_clean":"2024-06-04T16:23:04.451889+0000","last_became_active":"2024-06-04T15:52:38.481269+0000","last_became_peered":"2024-06-04T15:52:38.481269+0000","last_unstale":"2024-06-04T16:23:04.451889+0000","last_undegraded":"2024-06-04T16:23:04.451889+0000","last_fullsized":"2024-06-04T16:23:04.451889+0000","mapping_epoch":23,"log_start":"251'100","ondisk_log_start":"251'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'138","last_scrub_stamp":"2024-06-04T16:23:04.451799+0000","last_deep_scrub":"254'138","last_deep_scrub_stamp":"2024-06-04T16:23:04.451799+0000","last_clean_scrub_stamp":"2024-06-04T16:23:04.451799+0000","objects_scrubbed":3,"log_size":38,"log_dups_size":100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T18:57:32.595376+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":974,"num_read_kb":946,"num_write":155,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1528,"num_omap_keys":6,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"254'71","reported_seq":667,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:27.425442+0000","last_change":"2024-06-04T16:23:27.425486+0000","last_active":"2024-06-04T16:23:27.425442+0000","last_peered":"2024-06-04T16:23:27.425442+0000","last_clean":"2024-06-04T16:23:27.425442+0000","last_became_active":"2024-06-04T15:52:36.493867+0000","last_became_peered":"2024-06-04T15:52:36.493867+0000","last_unstale":"2024-06-04T16:23:27.425442+0000","last_undegraded":"2024-06-04T16:23:27.425442+0000","last_fullsized":"2024-06-04T16:23:27.425442+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'71","last_scrub_stamp":"2024-06-04T16:23:27.425346+0000","last_deep_scrub":"254'71","last_deep_scrub_stamp":"2024-06-04T16:23:27.425346+0000","last_clean_scrub_stamp":"2024-06-04T16:23:27.425346+0000","objects_scrubbed":2,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T20:20:10.111624+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194320,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":320,"num_read_kb":135435,"num_write":258,"num_write_kb":39309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3],"acting":[5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3f","version":"254'143","reported_seq":990,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:13.353929+0000","last_change":"2024-06-04T16:23:13.353958+0000","last_active":"2024-06-04T16:23:13.353929+0000","last_peered":"2024-06-04T16:23:13.353929+0000","last_clean":"2024-06-04T16:23:13.353929+0000","last_became_active":"2024-06-04T15:52:38.486625+0000","last_became_peered":"2024-06-04T15:52:38.486625+0000","last_unstale":"2024-06-04T16:23:13.353929+0000","last_undegraded":"2024-06-04T16:23:13.353929+0000","last_fullsized":"2024-06-04T16:23:13.353929+0000","mapping_epoch":23,"log_start":"251'100","ondisk_log_start":"251'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'143","last_scrub_stamp":"2024-06-04T16:23:13.353829+0000","last_deep_scrub":"254'143","last_deep_scrub_stamp":"2024-06-04T16:23:13.353829+0000","last_clean_scrub_stamp":"2024-06-04T16:23:13.353829+0000","objects_scrubbed":1,"log_size":43,"log_dups_size":100,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T03:22:03.182465+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":899,"num_read_kb":839,"num_write":184,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2808,"num_omap_keys":11,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.30","version":"254'111","reported_seq":847,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:22.743898+0000","last_change":"2024-06-04T16:23:22.743953+0000","last_active":"2024-06-04T16:23:22.743898+0000","last_peered":"2024-06-04T16:23:22.743898+0000","last_clean":"2024-06-04T16:23:22.743898+0000","last_became_active":"2024-06-04T15:52:38.479148+0000","last_became_peered":"2024-06-04T15:52:38.479148+0000","last_unstale":"2024-06-04T16:23:22.743898+0000","last_undegraded":"2024-06-04T16:23:22.743898+0000","last_fullsized":"2024-06-04T16:23:22.743898+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'111","last_scrub_stamp":"2024-06-04T16:23:22.743793+0000","last_deep_scrub":"254'111","last_deep_scrub_stamp":"2024-06-04T16:23:22.743793+0000","last_clean_scrub_stamp":"2024-06-04T16:23:22.743793+0000","objects_scrubbed":1,"log_size":111,"log_dups_size":0,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T18:14:39.906512+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":546,"num_read_kb":515,"num_write":127,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"251'65","reported_seq":598,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:19.373198+0000","last_change":"2024-06-04T16:23:19.373244+0000","last_active":"2024-06-04T16:23:19.373198+0000","last_peered":"2024-06-04T16:23:19.373198+0000","last_clean":"2024-06-04T16:23:19.373198+0000","last_became_active":"2024-06-04T15:52:36.493062+0000","last_became_peered":"2024-06-04T15:52:36.493062+0000","last_unstale":"2024-06-04T16:23:19.373198+0000","last_undegraded":"2024-06-04T16:23:19.373198+0000","last_fullsized":"2024-06-04T16:23:19.373198+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"251'65","last_scrub_stamp":"2024-06-04T16:23:19.373074+0000","last_deep_scrub":"251'65","last_deep_scrub_stamp":"2024-06-04T16:23:19.373074+0000","last_clean_scrub_stamp":"2024-06-04T16:23:19.373074+0000","objects_scrubbed":4,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T22:16:45.027828+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194345,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":95,"num_read_kb":64250,"num_write":262,"num_write_kb":45332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,5],"acting":[1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"254'69","reported_seq":746,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:56.821291+0000","last_change":"2024-06-04T16:22:56.821291+0000","last_active":"2024-06-04T16:22:56.821291+0000","last_peered":"2024-06-04T16:22:56.821291+0000","last_clean":"2024-06-04T16:22:56.821291+0000","last_became_active":"2024-06-04T15:52:38.486413+0000","last_became_peered":"2024-06-04T15:52:38.486413+0000","last_unstale":"2024-06-04T16:22:56.821291+0000","last_undegraded":"2024-06-04T16:22:56.821291+0000","last_fullsized":"2024-06-04T16:22:56.821291+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'69","last_scrub_stamp":"2024-06-04T16:22:56.821156+0000","last_deep_scrub":"254'69","last_deep_scrub_stamp":"2024-06-04T16:22:56.821156+0000","last_clean_scrub_stamp":"2024-06-04T16:22:56.821156+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T21:44:44.801551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":395,"num_read_kb":379,"num_write":76,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"251'60","reported_seq":579,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:10.807907+0000","last_change":"2024-06-04T16:23:10.807946+0000","last_active":"2024-06-04T16:23:10.807907+0000","last_peered":"2024-06-04T16:23:10.807907+0000","last_clean":"2024-06-04T16:23:10.807907+0000","last_became_active":"2024-06-04T15:52:36.493235+0000","last_became_peered":"2024-06-04T15:52:36.493235+0000","last_unstale":"2024-06-04T16:23:10.807907+0000","last_undegraded":"2024-06-04T16:23:10.807907+0000","last_fullsized":"2024-06-04T16:23:10.807907+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"251'60","last_scrub_stamp":"2024-06-04T16:23:10.807783+0000","last_deep_scrub":"251'60","last_deep_scrub_stamp":"2024-06-04T16:23:10.807783+0000","last_clean_scrub_stamp":"2024-06-04T16:23:10.807783+0000","objects_scrubbed":3,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T17:09:52.431755+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5327983,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":73,"num_read_kb":3706,"num_write":207,"num_write_kb":43313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"254'95","reported_seq":819,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:05.258148+0000","last_change":"2024-06-04T16:23:05.258177+0000","last_active":"2024-06-04T16:23:05.258148+0000","last_peered":"2024-06-04T16:23:05.258148+0000","last_clean":"2024-06-04T16:23:05.258148+0000","last_became_active":"2024-06-04T15:52:38.482120+0000","last_became_peered":"2024-06-04T15:52:38.482120+0000","last_unstale":"2024-06-04T16:23:05.258148+0000","last_undegraded":"2024-06-04T16:23:05.258148+0000","last_fullsized":"2024-06-04T16:23:05.258148+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'95","last_scrub_stamp":"2024-06-04T16:23:05.258056+0000","last_deep_scrub":"254'95","last_deep_scrub_stamp":"2024-06-04T16:23:05.258056+0000","last_clean_scrub_stamp":"2024-06-04T16:23:05.258056+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T02:14:44.631445+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":518,"num_read_kb":488,"num_write":107,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"251'41","reported_seq":565,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:45.894526+0000","last_change":"2024-06-04T16:22:45.894598+0000","last_active":"2024-06-04T16:22:45.894526+0000","last_peered":"2024-06-04T16:22:45.894526+0000","last_clean":"2024-06-04T16:22:45.894526+0000","last_became_active":"2024-06-04T15:53:14.839433+0000","last_became_peered":"2024-06-04T15:53:14.839433+0000","last_unstale":"2024-06-04T16:22:45.894526+0000","last_undegraded":"2024-06-04T16:22:45.894526+0000","last_fullsized":"2024-06-04T16:22:45.894526+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"251'41","last_scrub_stamp":"2024-06-04T16:22:45.894408+0000","last_deep_scrub":"251'41","last_deep_scrub_stamp":"2024-06-04T16:22:45.894408+0000","last_clean_scrub_stamp":"2024-06-04T16:22:45.894408+0000","objects_scrubbed":4,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T17:54:53.919284+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3420297,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":73,"num_read_kb":2132,"num_write":160,"num_write_kb":20015,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"254'145","reported_seq":942,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:09.033890+0000","last_change":"2024-06-04T16:23:09.033925+0000","last_active":"2024-06-04T16:23:09.033890+0000","last_peered":"2024-06-04T16:23:09.033890+0000","last_clean":"2024-06-04T16:23:09.033890+0000","last_became_active":"2024-06-04T15:52:38.480996+0000","last_became_peered":"2024-06-04T15:52:38.480996+0000","last_unstale":"2024-06-04T16:23:09.033890+0000","last_undegraded":"2024-06-04T16:23:09.033890+0000","last_fullsized":"2024-06-04T16:23:09.033890+0000","mapping_epoch":23,"log_start":"251'100","ondisk_log_start":"251'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'145","last_scrub_stamp":"2024-06-04T16:23:09.033779+0000","last_deep_scrub":"254'145","last_deep_scrub_stamp":"2024-06-04T16:23:09.033779+0000","last_clean_scrub_stamp":"2024-06-04T16:23:09.033779+0000","objects_scrubbed":2,"log_size":45,"log_dups_size":100,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T17:43:39.336852+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":760,"num_read_kb":703,"num_write":184,"num_write_kb":47,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"251'68","reported_seq":587,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:06.831890+0000","last_change":"2024-06-04T16:23:06.831959+0000","last_active":"2024-06-04T16:23:06.831890+0000","last_peered":"2024-06-04T16:23:06.831890+0000","last_clean":"2024-06-04T16:23:06.831890+0000","last_became_active":"2024-06-04T15:52:36.486264+0000","last_became_peered":"2024-06-04T15:52:36.486264+0000","last_unstale":"2024-06-04T16:23:06.831890+0000","last_undegraded":"2024-06-04T16:23:06.831890+0000","last_fullsized":"2024-06-04T16:23:06.831890+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"251'68","last_scrub_stamp":"2024-06-04T16:23:06.831772+0000","last_deep_scrub":"251'68","last_deep_scrub_stamp":"2024-06-04T16:23:06.831772+0000","last_clean_scrub_stamp":"2024-06-04T16:23:06.831772+0000","objects_scrubbed":5,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T17:48:07.524627+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5328001,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":104,"num_read_kb":2209,"num_write":245,"num_write_kb":31585,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,7],"acting":[0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"254'110","reported_seq":1000,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:16.337809+0000","last_change":"2024-06-04T16:23:16.337867+0000","last_active":"2024-06-04T16:23:16.337809+0000","last_peered":"2024-06-04T16:23:16.337809+0000","last_clean":"2024-06-04T16:23:16.337809+0000","last_became_active":"2024-06-04T15:52:38.488389+0000","last_became_peered":"2024-06-04T15:52:38.488389+0000","last_unstale":"2024-06-04T16:23:16.337809+0000","last_undegraded":"2024-06-04T16:23:16.337809+0000","last_fullsized":"2024-06-04T16:23:16.337809+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'110","last_scrub_stamp":"2024-06-04T16:23:16.337710+0000","last_deep_scrub":"254'110","last_deep_scrub_stamp":"2024-06-04T16:23:16.337710+0000","last_clean_scrub_stamp":"2024-06-04T16:23:16.337710+0000","objects_scrubbed":1,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T17:14:53.579833+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":949,"num_read_kb":919,"num_write":126,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2299,"num_omap_keys":9,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.33","version":"254'50","reported_seq":560,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:17.163596+0000","last_change":"2024-06-04T16:23:17.163657+0000","last_active":"2024-06-04T16:23:17.163596+0000","last_peered":"2024-06-04T16:23:17.163596+0000","last_clean":"2024-06-04T16:23:17.163596+0000","last_became_active":"2024-06-04T15:52:36.498488+0000","last_became_peered":"2024-06-04T15:52:36.498488+0000","last_unstale":"2024-06-04T16:23:17.163596+0000","last_undegraded":"2024-06-04T16:23:17.163596+0000","last_fullsized":"2024-06-04T16:23:17.163596+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'50","last_scrub_stamp":"2024-06-04T16:23:17.163496+0000","last_deep_scrub":"254'50","last_deep_scrub_stamp":"2024-06-04T16:23:17.163496+0000","last_clean_scrub_stamp":"2024-06-04T16:23:17.163496+0000","objects_scrubbed":3,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T21:27:25.943842+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6461610,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":71,"num_read_kb":20343,"num_write":207,"num_write_kb":26780,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,4],"acting":[6,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.35","version":"254'139","reported_seq":935,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:59.197888+0000","last_change":"2024-06-04T16:22:59.197913+0000","last_active":"2024-06-04T16:22:59.197888+0000","last_peered":"2024-06-04T16:22:59.197888+0000","last_clean":"2024-06-04T16:22:59.197888+0000","last_became_active":"2024-06-04T15:52:38.486108+0000","last_became_peered":"2024-06-04T15:52:38.486108+0000","last_unstale":"2024-06-04T16:22:59.197888+0000","last_undegraded":"2024-06-04T16:22:59.197888+0000","last_fullsized":"2024-06-04T16:22:59.197888+0000","mapping_epoch":23,"log_start":"251'100","ondisk_log_start":"251'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'139","last_scrub_stamp":"2024-06-04T16:22:59.197784+0000","last_deep_scrub":"254'139","last_deep_scrub_stamp":"2024-06-04T16:22:59.197784+0000","last_clean_scrub_stamp":"2024-06-04T16:22:59.197784+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":100,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T19:34:23.692307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":692,"num_read_kb":648,"num_write":164,"num_write_kb":35,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"254'36","reported_seq":536,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:13.089771+0000","last_change":"2024-06-04T16:23:13.089808+0000","last_active":"2024-06-04T16:23:13.089771+0000","last_peered":"2024-06-04T16:23:13.089771+0000","last_clean":"2024-06-04T16:23:13.089771+0000","last_became_active":"2024-06-04T15:52:36.481047+0000","last_became_peered":"2024-06-04T15:52:36.481047+0000","last_unstale":"2024-06-04T16:23:13.089771+0000","last_undegraded":"2024-06-04T16:23:13.089771+0000","last_fullsized":"2024-06-04T16:23:13.089771+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'36","last_scrub_stamp":"2024-06-04T16:23:13.089678+0000","last_deep_scrub":"254'36","last_deep_scrub_stamp":"2024-06-04T16:23:13.089678+0000","last_clean_scrub_stamp":"2024-06-04T16:23:13.089678+0000","objects_scrubbed":1,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T02:50:31.631046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":42,"num_read_kb":41,"num_write":149,"num_write_kb":21263,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4],"acting":[6,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.18","version":"254'36","reported_seq":527,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:48.897593+0000","last_change":"2024-06-04T16:22:48.897620+0000","last_active":"2024-06-04T16:22:48.897593+0000","last_peered":"2024-06-04T16:22:48.897593+0000","last_clean":"2024-06-04T16:22:48.897593+0000","last_became_active":"2024-06-04T15:52:46.536608+0000","last_became_peered":"2024-06-04T15:52:46.536608+0000","last_unstale":"2024-06-04T16:22:48.897593+0000","last_undegraded":"2024-06-04T16:22:48.897593+0000","last_fullsized":"2024-06-04T16:22:48.897593+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'36","last_scrub_stamp":"2024-06-04T16:22:48.897499+0000","last_deep_scrub":"254'36","last_deep_scrub_stamp":"2024-06-04T16:22:48.897499+0000","last_clean_scrub_stamp":"2024-06-04T16:22:48.897499+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T20:02:47.722917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":81,"num_read_kb":72,"num_write":87,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"254'110","reported_seq":841,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:19.166996+0000","last_change":"2024-06-04T16:23:19.167020+0000","last_active":"2024-06-04T16:23:19.166996+0000","last_peered":"2024-06-04T16:23:19.166996+0000","last_clean":"2024-06-04T16:23:19.166996+0000","last_became_active":"2024-06-04T15:52:38.477052+0000","last_became_peered":"2024-06-04T15:52:38.477052+0000","last_unstale":"2024-06-04T16:23:19.166996+0000","last_undegraded":"2024-06-04T16:23:19.166996+0000","last_fullsized":"2024-06-04T16:23:19.166996+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'110","last_scrub_stamp":"2024-06-04T16:23:19.166917+0000","last_deep_scrub":"254'110","last_deep_scrub_stamp":"2024-06-04T16:23:19.166917+0000","last_clean_scrub_stamp":"2024-06-04T16:23:19.166917+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T01:33:44.001604+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":560,"num_read_kb":523,"num_write":129,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.13","version":"254'52","reported_seq":563,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:25.684932+0000","last_change":"2024-06-04T16:23:25.685009+0000","last_active":"2024-06-04T16:23:25.684932+0000","last_peered":"2024-06-04T16:23:25.684932+0000","last_clean":"2024-06-04T16:23:25.684932+0000","last_became_active":"2024-06-04T15:52:36.499305+0000","last_became_peered":"2024-06-04T15:52:36.499305+0000","last_unstale":"2024-06-04T16:23:25.684932+0000","last_undegraded":"2024-06-04T16:23:25.684932+0000","last_fullsized":"2024-06-04T16:23:25.684932+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'52","last_scrub_stamp":"2024-06-04T16:23:25.684795+0000","last_deep_scrub":"254'52","last_deep_scrub_stamp":"2024-06-04T16:23:25.684795+0000","last_clean_scrub_stamp":"2024-06-04T16:23:25.684795+0000","objects_scrubbed":2,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T22:25:43.278909+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194320,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":75,"num_read_kb":3024,"num_write":196,"num_write_kb":28071,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":482,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:34.589679+0000","last_change":"2024-06-04T16:23:34.589724+0000","last_active":"2024-06-04T16:23:34.589679+0000","last_peered":"2024-06-04T16:23:34.589679+0000","last_clean":"2024-06-04T16:23:34.589679+0000","last_became_active":"2024-06-04T15:52:40.476730+0000","last_became_peered":"2024-06-04T15:52:40.476730+0000","last_unstale":"2024-06-04T16:23:34.589679+0000","last_undegraded":"2024-06-04T16:23:34.589679+0000","last_fullsized":"2024-06-04T16:23:34.589679+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:23:34.589571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:23:34.589571+0000","last_clean_scrub_stamp":"2024-06-04T16:23:34.589571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T00:04:00.918615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"254'147","reported_seq":727,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:58.046557+0000","last_change":"2024-06-04T16:22:58.046593+0000","last_active":"2024-06-04T16:22:58.046557+0000","last_peered":"2024-06-04T16:22:58.046557+0000","last_clean":"2024-06-04T16:22:58.046557+0000","last_became_active":"2024-06-04T15:52:42.503184+0000","last_became_peered":"2024-06-04T15:52:42.503184+0000","last_unstale":"2024-06-04T16:22:58.046557+0000","last_undegraded":"2024-06-04T16:22:58.046557+0000","last_fullsized":"2024-06-04T16:22:58.046557+0000","mapping_epoch":27,"log_start":"251'100","ondisk_log_start":"251'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'147","last_scrub_stamp":"2024-06-04T16:22:58.046476+0000","last_deep_scrub":"254'147","last_deep_scrub_stamp":"2024-06-04T16:22:58.046476+0000","last_clean_scrub_stamp":"2024-06-04T16:22:58.046476+0000","objects_scrubbed":4,"log_size":47,"log_dups_size":100,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T21:24:37.226246+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":210,"num_read_kb":210,"num_write":112,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":477,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:12.320493+0000","last_change":"2024-06-04T16:23:12.320516+0000","last_active":"2024-06-04T16:23:12.320493+0000","last_peered":"2024-06-04T16:23:12.320493+0000","last_clean":"2024-06-04T16:23:12.320493+0000","last_became_active":"2024-06-04T15:52:44.513442+0000","last_became_peered":"2024-06-04T15:52:44.513442+0000","last_unstale":"2024-06-04T16:23:12.320493+0000","last_undegraded":"2024-06-04T16:23:12.320493+0000","last_fullsized":"2024-06-04T16:23:12.320493+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:23:12.320400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:23:12.320400+0000","last_clean_scrub_stamp":"2024-06-04T16:23:12.320400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T17:36:07.585385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"254'147","reported_seq":716,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:53.150923+0000","last_change":"2024-06-04T16:22:53.150954+0000","last_active":"2024-06-04T16:22:53.150923+0000","last_peered":"2024-06-04T16:22:53.150923+0000","last_clean":"2024-06-04T16:22:53.150923+0000","last_became_active":"2024-06-04T15:52:46.539957+0000","last_became_peered":"2024-06-04T15:52:46.539957+0000","last_unstale":"2024-06-04T16:22:53.150923+0000","last_undegraded":"2024-06-04T16:22:53.150923+0000","last_fullsized":"2024-06-04T16:22:53.150923+0000","mapping_epoch":31,"log_start":"254'100","ondisk_log_start":"254'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'147","last_scrub_stamp":"2024-06-04T16:22:53.150822+0000","last_deep_scrub":"254'147","last_deep_scrub_stamp":"2024-06-04T16:22:53.150822+0000","last_clean_scrub_stamp":"2024-06-04T16:22:53.150822+0000","objects_scrubbed":2,"log_size":47,"log_dups_size":100,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T21:42:55.962546+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":399,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":346,"num_read_kb":345,"num_write":304,"num_write_kb":102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"254'155","reported_seq":847,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:30.703706+0000","last_change":"2024-06-04T16:23:30.703731+0000","last_active":"2024-06-04T16:23:30.703706+0000","last_peered":"2024-06-04T16:23:30.703706+0000","last_clean":"2024-06-04T16:23:30.703706+0000","last_became_active":"2024-06-04T15:52:38.483516+0000","last_became_peered":"2024-06-04T15:52:38.483516+0000","last_unstale":"2024-06-04T16:23:30.703706+0000","last_undegraded":"2024-06-04T16:23:30.703706+0000","last_fullsized":"2024-06-04T16:23:30.703706+0000","mapping_epoch":23,"log_start":"251'100","ondisk_log_start":"251'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'155","last_scrub_stamp":"2024-06-04T16:23:30.703620+0000","last_deep_scrub":"254'155","last_deep_scrub_stamp":"2024-06-04T16:23:30.703620+0000","last_clean_scrub_stamp":"2024-06-04T16:23:30.703620+0000","objects_scrubbed":1,"log_size":55,"log_dups_size":100,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T21:00:13.749218+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":841,"num_read_kb":740,"num_write":235,"num_write_kb":95,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"254'66","reported_seq":588,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:14.131826+0000","last_change":"2024-06-04T16:23:14.131879+0000","last_active":"2024-06-04T16:23:14.131826+0000","last_peered":"2024-06-04T16:23:14.131826+0000","last_clean":"2024-06-04T16:23:14.131826+0000","last_became_active":"2024-06-04T15:52:36.481099+0000","last_became_peered":"2024-06-04T15:52:36.481099+0000","last_unstale":"2024-06-04T16:23:14.131826+0000","last_undegraded":"2024-06-04T16:23:14.131826+0000","last_fullsized":"2024-06-04T16:23:14.131826+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'66","last_scrub_stamp":"2024-06-04T16:23:14.131731+0000","last_deep_scrub":"254'66","last_deep_scrub_stamp":"2024-06-04T16:23:14.131731+0000","last_clean_scrub_stamp":"2024-06-04T16:23:14.131731+0000","objects_scrubbed":3,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T21:24:25.096968+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133687,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":119,"num_read_kb":2903,"num_write":273,"num_write_kb":32792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,7],"acting":[6,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":484,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:06.002957+0000","last_change":"2024-06-04T16:23:06.002957+0000","last_active":"2024-06-04T16:23:06.002957+0000","last_peered":"2024-06-04T16:23:06.002957+0000","last_clean":"2024-06-04T16:23:06.002957+0000","last_became_active":"2024-06-04T15:52:40.479483+0000","last_became_peered":"2024-06-04T15:52:40.479483+0000","last_unstale":"2024-06-04T16:23:06.002957+0000","last_undegraded":"2024-06-04T16:23:06.002957+0000","last_fullsized":"2024-06-04T16:23:06.002957+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:23:06.002801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:23:06.002801+0000","last_clean_scrub_stamp":"2024-06-04T16:23:06.002801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T00:36:19.937830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"254'54","reported_seq":559,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:10.287138+0000","last_change":"2024-06-04T16:23:10.287196+0000","last_active":"2024-06-04T16:23:10.287138+0000","last_peered":"2024-06-04T16:23:10.287138+0000","last_clean":"2024-06-04T16:23:10.287138+0000","last_became_active":"2024-06-04T15:52:42.503451+0000","last_became_peered":"2024-06-04T15:52:42.503451+0000","last_unstale":"2024-06-04T16:23:10.287138+0000","last_undegraded":"2024-06-04T16:23:10.287138+0000","last_fullsized":"2024-06-04T16:23:10.287138+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'54","last_scrub_stamp":"2024-06-04T16:23:10.287044+0000","last_deep_scrub":"254'54","last_deep_scrub_stamp":"2024-06-04T16:23:10.287044+0000","last_clean_scrub_stamp":"2024-06-04T16:23:10.287044+0000","objects_scrubbed":3,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T20:35:52.209298+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":72,"num_read_kb":67,"num_write":48,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":477,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:55.141200+0000","last_change":"2024-06-04T16:22:55.141223+0000","last_active":"2024-06-04T16:22:55.141200+0000","last_peered":"2024-06-04T16:22:55.141200+0000","last_clean":"2024-06-04T16:22:55.141200+0000","last_became_active":"2024-06-04T15:52:44.517614+0000","last_became_peered":"2024-06-04T15:52:44.517614+0000","last_unstale":"2024-06-04T16:22:55.141200+0000","last_undegraded":"2024-06-04T16:22:55.141200+0000","last_fullsized":"2024-06-04T16:22:55.141200+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:22:55.141113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:22:55.141113+0000","last_clean_scrub_stamp":"2024-06-04T16:22:55.141113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T21:06:04.632373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"254'26","reported_seq":510,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:53.168793+0000","last_change":"2024-06-04T16:22:53.168825+0000","last_active":"2024-06-04T16:22:53.168793+0000","last_peered":"2024-06-04T16:22:53.168793+0000","last_clean":"2024-06-04T16:22:53.168793+0000","last_became_active":"2024-06-04T15:52:46.535498+0000","last_became_peered":"2024-06-04T15:52:46.535498+0000","last_unstale":"2024-06-04T16:22:53.168793+0000","last_undegraded":"2024-06-04T16:22:53.168793+0000","last_fullsized":"2024-06-04T16:22:53.168793+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'26","last_scrub_stamp":"2024-06-04T16:22:53.168708+0000","last_deep_scrub":"254'26","last_deep_scrub_stamp":"2024-06-04T16:22:53.168708+0000","last_clean_scrub_stamp":"2024-06-04T16:22:53.168708+0000","objects_scrubbed":4,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T16:25:50.093337+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":432,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":50,"num_read_kb":48,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"254'97","reported_seq":846,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:15.351317+0000","last_change":"2024-06-04T16:23:15.351347+0000","last_active":"2024-06-04T16:23:15.351317+0000","last_peered":"2024-06-04T16:23:15.351317+0000","last_clean":"2024-06-04T16:23:15.351317+0000","last_became_active":"2024-06-04T15:52:38.486612+0000","last_became_peered":"2024-06-04T15:52:38.486612+0000","last_unstale":"2024-06-04T16:23:15.351317+0000","last_undegraded":"2024-06-04T16:23:15.351317+0000","last_fullsized":"2024-06-04T16:23:15.351317+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'97","last_scrub_stamp":"2024-06-04T16:23:15.351224+0000","last_deep_scrub":"254'97","last_deep_scrub_stamp":"2024-06-04T16:23:15.351224+0000","last_clean_scrub_stamp":"2024-06-04T16:23:15.351224+0000","objects_scrubbed":2,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T04:14:08.447451+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":567,"num_read_kb":536,"num_write":113,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"254'37","reported_seq":535,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:41.563562+0000","last_change":"2024-06-04T16:23:41.563601+0000","last_active":"2024-06-04T16:23:41.563562+0000","last_peered":"2024-06-04T16:23:41.563562+0000","last_clean":"2024-06-04T16:23:41.563562+0000","last_became_active":"2024-06-04T15:52:36.486999+0000","last_became_peered":"2024-06-04T15:52:36.486999+0000","last_unstale":"2024-06-04T16:23:41.563562+0000","last_undegraded":"2024-06-04T16:23:41.563562+0000","last_fullsized":"2024-06-04T16:23:41.563562+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'37","last_scrub_stamp":"2024-06-04T16:23:41.563463+0000","last_deep_scrub":"254'37","last_deep_scrub_stamp":"2024-06-04T16:23:41.563463+0000","last_clean_scrub_stamp":"2024-06-04T16:23:41.563463+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T19:33:48.164905+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":26,"num_read_kb":6159,"num_write":134,"num_write_kb":22820,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":483,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:15.947311+0000","last_change":"2024-06-04T16:23:15.947335+0000","last_active":"2024-06-04T16:23:15.947311+0000","last_peered":"2024-06-04T16:23:15.947311+0000","last_clean":"2024-06-04T16:23:15.947311+0000","last_became_active":"2024-06-04T15:52:40.484711+0000","last_became_peered":"2024-06-04T15:52:40.484711+0000","last_unstale":"2024-06-04T16:23:15.947311+0000","last_undegraded":"2024-06-04T16:23:15.947311+0000","last_fullsized":"2024-06-04T16:23:15.947311+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:23:15.947213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:23:15.947213+0000","last_clean_scrub_stamp":"2024-06-04T16:23:15.947213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T02:55:05.998333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"254'70","reported_seq":580,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:59.023817+0000","last_change":"2024-06-04T16:22:59.023817+0000","last_active":"2024-06-04T16:22:59.023817+0000","last_peered":"2024-06-04T16:22:59.023817+0000","last_clean":"2024-06-04T16:22:59.023817+0000","last_became_active":"2024-06-04T15:52:42.501248+0000","last_became_peered":"2024-06-04T15:52:42.501248+0000","last_unstale":"2024-06-04T16:22:59.023817+0000","last_undegraded":"2024-06-04T16:22:59.023817+0000","last_fullsized":"2024-06-04T16:22:59.023817+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'70","last_scrub_stamp":"2024-06-04T16:22:59.023678+0000","last_deep_scrub":"254'70","last_deep_scrub_stamp":"2024-06-04T16:22:59.023678+0000","last_clean_scrub_stamp":"2024-06-04T16:22:59.023678+0000","objects_scrubbed":5,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T00:41:59.670808+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":90,"num_read_kb":83,"num_write":60,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.15","version":"254'465","reported_seq":1508,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:00.895137+0000","last_change":"2024-06-04T16:23:00.895165+0000","last_active":"2024-06-04T16:23:00.895137+0000","last_peered":"2024-06-04T16:23:00.895137+0000","last_clean":"2024-06-04T16:23:00.895137+0000","last_became_active":"2024-06-04T15:52:44.523138+0000","last_became_peered":"2024-06-04T15:52:44.523138+0000","last_unstale":"2024-06-04T16:23:00.895137+0000","last_undegraded":"2024-06-04T16:23:00.895137+0000","last_fullsized":"2024-06-04T16:23:00.895137+0000","mapping_epoch":29,"log_start":"251'400","ondisk_log_start":"251'400","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'465","last_scrub_stamp":"2024-06-04T16:23:00.895051+0000","last_deep_scrub":"254'465","last_deep_scrub_stamp":"2024-06-04T16:23:00.895051+0000","last_clean_scrub_stamp":"2024-06-04T16:23:00.895051+0000","objects_scrubbed":1,"log_size":65,"log_dups_size":400,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T20:48:57.811545+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"254'38","reported_seq":515,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:54.535431+0000","last_change":"2024-06-04T16:22:54.535460+0000","last_active":"2024-06-04T16:22:54.535431+0000","last_peered":"2024-06-04T16:22:54.535431+0000","last_clean":"2024-06-04T16:22:54.535431+0000","last_became_active":"2024-06-04T15:52:46.532141+0000","last_became_peered":"2024-06-04T15:52:46.532141+0000","last_unstale":"2024-06-04T16:22:54.535431+0000","last_undegraded":"2024-06-04T16:22:54.535431+0000","last_fullsized":"2024-06-04T16:22:54.535431+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'38","last_scrub_stamp":"2024-06-04T16:22:54.535346+0000","last_deep_scrub":"254'38","last_deep_scrub_stamp":"2024-06-04T16:22:54.535346+0000","last_clean_scrub_stamp":"2024-06-04T16:22:54.535346+0000","objects_scrubbed":1,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T17:24:08.579752+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":56,"num_read_kb":50,"num_write":85,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":168,"num_omap_keys":1,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"254'150","reported_seq":991,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:20.392868+0000","last_change":"2024-06-04T16:23:20.392913+0000","last_active":"2024-06-04T16:23:20.392868+0000","last_peered":"2024-06-04T16:23:20.392868+0000","last_clean":"2024-06-04T16:23:20.392868+0000","last_became_active":"2024-06-04T15:52:38.489719+0000","last_became_peered":"2024-06-04T15:52:38.489719+0000","last_unstale":"2024-06-04T16:23:20.392868+0000","last_undegraded":"2024-06-04T16:23:20.392868+0000","last_fullsized":"2024-06-04T16:23:20.392868+0000","mapping_epoch":23,"log_start":"251'100","ondisk_log_start":"251'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'150","last_scrub_stamp":"2024-06-04T16:23:20.392758+0000","last_deep_scrub":"254'150","last_deep_scrub_stamp":"2024-06-04T16:23:20.392758+0000","last_clean_scrub_stamp":"2024-06-04T16:23:20.392758+0000","objects_scrubbed":4,"log_size":50,"log_dups_size":100,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T18:56:39.101690+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":798,"num_read_kb":751,"num_write":172,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":148,"num_omap_keys":1,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"254'47","reported_seq":565,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:17.364677+0000","last_change":"2024-06-04T16:23:17.364729+0000","last_active":"2024-06-04T16:23:17.364677+0000","last_peered":"2024-06-04T16:23:17.364677+0000","last_clean":"2024-06-04T16:23:17.364677+0000","last_became_active":"2024-06-04T15:52:36.482920+0000","last_became_peered":"2024-06-04T15:52:36.482920+0000","last_unstale":"2024-06-04T16:23:17.364677+0000","last_undegraded":"2024-06-04T16:23:17.364677+0000","last_fullsized":"2024-06-04T16:23:17.364677+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'47","last_scrub_stamp":"2024-06-04T16:23:17.364583+0000","last_deep_scrub":"254'47","last_deep_scrub_stamp":"2024-06-04T16:23:17.364583+0000","last_clean_scrub_stamp":"2024-06-04T16:23:17.364583+0000","objects_scrubbed":5,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T22:19:51.192245+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1069231,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":86,"num_read_kb":13402,"num_write":212,"num_write_kb":21907,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3],"acting":[1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":482,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:15.830869+0000","last_change":"2024-06-04T16:23:15.830894+0000","last_active":"2024-06-04T16:23:15.830869+0000","last_peered":"2024-06-04T16:23:15.830869+0000","last_clean":"2024-06-04T16:23:15.830869+0000","last_became_active":"2024-06-04T15:52:40.482288+0000","last_became_peered":"2024-06-04T15:52:40.482288+0000","last_unstale":"2024-06-04T16:23:15.830869+0000","last_undegraded":"2024-06-04T16:23:15.830869+0000","last_fullsized":"2024-06-04T16:23:15.830869+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:23:15.830759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:23:15.830759+0000","last_clean_scrub_stamp":"2024-06-04T16:23:15.830759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T18:21:37.825735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"254'91","reported_seq":637,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:03.430350+0000","last_change":"2024-06-04T16:23:03.430391+0000","last_active":"2024-06-04T16:23:03.430350+0000","last_peered":"2024-06-04T16:23:03.430350+0000","last_clean":"2024-06-04T16:23:03.430350+0000","last_became_active":"2024-06-04T15:52:42.503282+0000","last_became_peered":"2024-06-04T15:52:42.503282+0000","last_unstale":"2024-06-04T16:23:03.430350+0000","last_undegraded":"2024-06-04T16:23:03.430350+0000","last_fullsized":"2024-06-04T16:23:03.430350+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'91","last_scrub_stamp":"2024-06-04T16:23:03.430250+0000","last_deep_scrub":"254'91","last_deep_scrub_stamp":"2024-06-04T16:23:03.430250+0000","last_clean_scrub_stamp":"2024-06-04T16:23:03.430250+0000","objects_scrubbed":4,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T16:30:06.943222+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6020,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":136,"num_read_kb":193,"num_write":64,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"254'478","reported_seq":1584,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:05.424688+0000","last_change":"2024-06-04T16:23:05.424688+0000","last_active":"2024-06-04T16:23:05.424688+0000","last_peered":"2024-06-04T16:23:05.424688+0000","last_clean":"2024-06-04T16:23:05.424688+0000","last_became_active":"2024-06-04T15:52:44.518724+0000","last_became_peered":"2024-06-04T15:52:44.518724+0000","last_unstale":"2024-06-04T16:23:05.424688+0000","last_undegraded":"2024-06-04T16:23:05.424688+0000","last_fullsized":"2024-06-04T16:23:05.424688+0000","mapping_epoch":29,"log_start":"251'400","ondisk_log_start":"251'400","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'478","last_scrub_stamp":"2024-06-04T16:23:05.424574+0000","last_deep_scrub":"254'478","last_deep_scrub_stamp":"2024-06-04T16:23:05.424574+0000","last_clean_scrub_stamp":"2024-06-04T16:23:05.424574+0000","objects_scrubbed":1,"log_size":78,"log_dups_size":400,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T17:23:14.724794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"254'113","reported_seq":809,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:20.707290+0000","last_change":"2024-06-04T16:23:20.707315+0000","last_active":"2024-06-04T16:23:20.707290+0000","last_peered":"2024-06-04T16:23:20.707290+0000","last_clean":"2024-06-04T16:23:20.707290+0000","last_became_active":"2024-06-04T15:52:38.478886+0000","last_became_peered":"2024-06-04T15:52:38.478886+0000","last_unstale":"2024-06-04T16:23:20.707290+0000","last_undegraded":"2024-06-04T16:23:20.707290+0000","last_fullsized":"2024-06-04T16:23:20.707290+0000","mapping_epoch":23,"log_start":"251'100","ondisk_log_start":"251'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'113","last_scrub_stamp":"2024-06-04T16:23:20.707200+0000","last_deep_scrub":"254'113","last_deep_scrub_stamp":"2024-06-04T16:23:20.707200+0000","last_clean_scrub_stamp":"2024-06-04T16:23:20.707200+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":100,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T01:55:10.845538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":534,"num_read_kb":483,"num_write":137,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"251'58","reported_seq":545,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:48.217293+0000","last_change":"2024-06-04T16:22:48.217346+0000","last_active":"2024-06-04T16:22:48.217293+0000","last_peered":"2024-06-04T16:22:48.217293+0000","last_clean":"2024-06-04T16:22:48.217293+0000","last_became_active":"2024-06-04T15:53:14.838259+0000","last_became_peered":"2024-06-04T15:53:14.838259+0000","last_unstale":"2024-06-04T16:22:48.217293+0000","last_undegraded":"2024-06-04T16:22:48.217293+0000","last_fullsized":"2024-06-04T16:22:48.217293+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"251'58","last_scrub_stamp":"2024-06-04T16:22:48.217194+0000","last_deep_scrub":"251'58","last_deep_scrub_stamp":"2024-06-04T16:22:48.217194+0000","last_clean_scrub_stamp":"2024-06-04T16:22:48.217194+0000","objects_scrubbed":2,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T01:01:00.864191+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":105,"num_read_kb":3164,"num_write":221,"num_write_kb":9993,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,4],"acting":[6,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":487,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:04.217949+0000","last_change":"2024-06-04T16:23:04.217972+0000","last_active":"2024-06-04T16:23:04.217949+0000","last_peered":"2024-06-04T16:23:04.217949+0000","last_clean":"2024-06-04T16:23:04.217949+0000","last_became_active":"2024-06-04T15:52:40.483832+0000","last_became_peered":"2024-06-04T15:52:40.483832+0000","last_unstale":"2024-06-04T16:23:04.217949+0000","last_undegraded":"2024-06-04T16:23:04.217949+0000","last_fullsized":"2024-06-04T16:23:04.217949+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:23:04.217854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:23:04.217854+0000","last_clean_scrub_stamp":"2024-06-04T16:23:04.217854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T17:33:21.489187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"254'148","reported_seq":730,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:55.848573+0000","last_change":"2024-06-04T16:22:55.848573+0000","last_active":"2024-06-04T16:22:55.848573+0000","last_peered":"2024-06-04T16:22:55.848573+0000","last_clean":"2024-06-04T16:22:55.848573+0000","last_became_active":"2024-06-04T15:52:42.504217+0000","last_became_peered":"2024-06-04T15:52:42.504217+0000","last_unstale":"2024-06-04T16:22:55.848573+0000","last_undegraded":"2024-06-04T16:22:55.848573+0000","last_fullsized":"2024-06-04T16:22:55.848573+0000","mapping_epoch":27,"log_start":"251'100","ondisk_log_start":"251'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'148","last_scrub_stamp":"2024-06-04T16:22:55.848437+0000","last_deep_scrub":"254'148","last_deep_scrub_stamp":"2024-06-04T16:22:55.848437+0000","last_clean_scrub_stamp":"2024-06-04T16:22:55.848437+0000","objects_scrubbed":9,"log_size":48,"log_dups_size":100,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T01:32:43.406440+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":216,"num_read_kb":258,"num_write":116,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":472,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:10.020836+0000","last_change":"2024-06-04T16:23:10.020872+0000","last_active":"2024-06-04T16:23:10.020836+0000","last_peered":"2024-06-04T16:23:10.020836+0000","last_clean":"2024-06-04T16:23:10.020836+0000","last_became_active":"2024-06-04T15:52:44.520358+0000","last_became_peered":"2024-06-04T15:52:44.520358+0000","last_unstale":"2024-06-04T16:23:10.020836+0000","last_undegraded":"2024-06-04T16:23:10.020836+0000","last_fullsized":"2024-06-04T16:23:10.020836+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:23:10.020709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:23:10.020709+0000","last_clean_scrub_stamp":"2024-06-04T16:23:10.020709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T20:15:17.221215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"254'457","reported_seq":1249,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:53.493908+0000","last_change":"2024-06-04T16:22:53.493945+0000","last_active":"2024-06-04T16:22:53.493908+0000","last_peered":"2024-06-04T16:22:53.493908+0000","last_clean":"2024-06-04T16:22:53.493908+0000","last_became_active":"2024-06-04T15:52:46.536442+0000","last_became_peered":"2024-06-04T15:52:46.536442+0000","last_unstale":"2024-06-04T16:22:53.493908+0000","last_undegraded":"2024-06-04T16:22:53.493908+0000","last_fullsized":"2024-06-04T16:22:53.493908+0000","mapping_epoch":31,"log_start":"251'400","ondisk_log_start":"251'400","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'457","last_scrub_stamp":"2024-06-04T16:22:53.493803+0000","last_deep_scrub":"254'457","last_deep_scrub_stamp":"2024-06-04T16:22:53.493803+0000","last_clean_scrub_stamp":"2024-06-04T16:22:53.493803+0000","objects_scrubbed":2,"log_size":57,"log_dups_size":400,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T17:18:55.700935+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":418,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1197,"num_read_kb":1195,"num_write":937,"num_write_kb":336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":182,"num_omap_keys":1,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"254'122","reported_seq":933,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:03.204186+0000","last_change":"2024-06-04T16:23:03.204213+0000","last_active":"2024-06-04T16:23:03.204186+0000","last_peered":"2024-06-04T16:23:03.204186+0000","last_clean":"2024-06-04T16:23:03.204186+0000","last_became_active":"2024-06-04T15:52:38.483194+0000","last_became_peered":"2024-06-04T15:52:38.483194+0000","last_unstale":"2024-06-04T16:23:03.204186+0000","last_undegraded":"2024-06-04T16:23:03.204186+0000","last_fullsized":"2024-06-04T16:23:03.204186+0000","mapping_epoch":23,"log_start":"251'100","ondisk_log_start":"251'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'122","last_scrub_stamp":"2024-06-04T16:23:03.204097+0000","last_deep_scrub":"254'122","last_deep_scrub_stamp":"2024-06-04T16:23:03.204097+0000","last_clean_scrub_stamp":"2024-06-04T16:23:03.204097+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":100,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T20:27:28.071534+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":683,"num_read_kb":649,"num_write":140,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"254'60","reported_seq":600,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:18.680129+0000","last_change":"2024-06-04T16:23:18.680207+0000","last_active":"2024-06-04T16:23:18.680129+0000","last_peered":"2024-06-04T16:23:18.680129+0000","last_clean":"2024-06-04T16:23:18.680129+0000","last_became_active":"2024-06-04T15:52:36.485995+0000","last_became_peered":"2024-06-04T15:52:36.485995+0000","last_unstale":"2024-06-04T16:23:18.680129+0000","last_undegraded":"2024-06-04T16:23:18.680129+0000","last_fullsized":"2024-06-04T16:23:18.680129+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'60","last_scrub_stamp":"2024-06-04T16:23:18.680030+0000","last_deep_scrub":"254'60","last_deep_scrub_stamp":"2024-06-04T16:23:18.680030+0000","last_clean_scrub_stamp":"2024-06-04T16:23:18.680030+0000","objects_scrubbed":6,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T16:54:32.626897+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":105,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":98,"num_read_kb":68665,"num_write":249,"num_write_kb":35943,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":481,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:01.049522+0000","last_change":"2024-06-04T16:23:01.049547+0000","last_active":"2024-06-04T16:23:01.049522+0000","last_peered":"2024-06-04T16:23:01.049522+0000","last_clean":"2024-06-04T16:23:01.049522+0000","last_became_active":"2024-06-04T15:52:40.480714+0000","last_became_peered":"2024-06-04T15:52:40.480714+0000","last_unstale":"2024-06-04T16:23:01.049522+0000","last_undegraded":"2024-06-04T16:23:01.049522+0000","last_fullsized":"2024-06-04T16:23:01.049522+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:23:01.049430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:23:01.049430+0000","last_clean_scrub_stamp":"2024-06-04T16:23:01.049430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T19:32:08.942239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.b","version":"254'96","reported_seq":645,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:55.026863+0000","last_change":"2024-06-04T16:22:55.026898+0000","last_active":"2024-06-04T16:22:55.026863+0000","last_peered":"2024-06-04T16:22:55.026863+0000","last_clean":"2024-06-04T16:22:55.026863+0000","last_became_active":"2024-06-04T15:52:42.505269+0000","last_became_peered":"2024-06-04T15:52:42.505269+0000","last_unstale":"2024-06-04T16:22:55.026863+0000","last_undegraded":"2024-06-04T16:22:55.026863+0000","last_fullsized":"2024-06-04T16:22:55.026863+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'96","last_scrub_stamp":"2024-06-04T16:22:55.026767+0000","last_deep_scrub":"254'96","last_deep_scrub_stamp":"2024-06-04T16:22:55.026767+0000","last_clean_scrub_stamp":"2024-06-04T16:22:55.026767+0000","objects_scrubbed":4,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T18:40:29.643937+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":127,"num_read_kb":117,"num_write":58,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":477,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:52.966827+0000","last_change":"2024-06-04T16:22:52.966827+0000","last_active":"2024-06-04T16:22:52.966827+0000","last_peered":"2024-06-04T16:22:52.966827+0000","last_clean":"2024-06-04T16:22:52.966827+0000","last_became_active":"2024-06-04T15:52:44.522149+0000","last_became_peered":"2024-06-04T15:52:44.522149+0000","last_unstale":"2024-06-04T16:22:52.966827+0000","last_undegraded":"2024-06-04T16:22:52.966827+0000","last_fullsized":"2024-06-04T16:22:52.966827+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:22:52.966674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:22:52.966674+0000","last_clean_scrub_stamp":"2024-06-04T16:22:52.966674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T02:07:15.814206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.5","version":"254'29","reported_seq":514,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:49.115675+0000","last_change":"2024-06-04T16:22:49.115732+0000","last_active":"2024-06-04T16:22:49.115675+0000","last_peered":"2024-06-04T16:22:49.115675+0000","last_clean":"2024-06-04T16:22:49.115675+0000","last_became_active":"2024-06-04T15:52:46.540510+0000","last_became_peered":"2024-06-04T15:52:46.540510+0000","last_unstale":"2024-06-04T16:22:49.115675+0000","last_undegraded":"2024-06-04T16:22:49.115675+0000","last_fullsized":"2024-06-04T16:22:49.115675+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'29","last_scrub_stamp":"2024-06-04T16:22:49.115565+0000","last_deep_scrub":"254'29","last_deep_scrub_stamp":"2024-06-04T16:22:49.115565+0000","last_clean_scrub_stamp":"2024-06-04T16:22:49.115565+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T21:09:44.617649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":51,"num_write":73,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"254'110","reported_seq":885,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:08.481097+0000","last_change":"2024-06-04T16:23:08.481122+0000","last_active":"2024-06-04T16:23:08.481097+0000","last_peered":"2024-06-04T16:23:08.481097+0000","last_clean":"2024-06-04T16:23:08.481097+0000","last_became_active":"2024-06-04T15:52:38.480112+0000","last_became_peered":"2024-06-04T15:52:38.480112+0000","last_unstale":"2024-06-04T16:23:08.481097+0000","last_undegraded":"2024-06-04T16:23:08.481097+0000","last_fullsized":"2024-06-04T16:23:08.481097+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'110","last_scrub_stamp":"2024-06-04T16:23:08.481025+0000","last_deep_scrub":"254'110","last_deep_scrub_stamp":"2024-06-04T16:23:08.481025+0000","last_clean_scrub_stamp":"2024-06-04T16:23:08.481025+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T19:01:23.753908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":725,"num_read_kb":689,"num_write":131,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"251'79","reported_seq":556,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:49.252335+0000","last_change":"2024-06-04T16:22:49.252378+0000","last_active":"2024-06-04T16:22:49.252335+0000","last_peered":"2024-06-04T16:22:49.252335+0000","last_clean":"2024-06-04T16:22:49.252335+0000","last_became_active":"2024-06-04T15:53:14.838251+0000","last_became_peered":"2024-06-04T15:53:14.838251+0000","last_unstale":"2024-06-04T16:22:49.252335+0000","last_undegraded":"2024-06-04T16:22:49.252335+0000","last_fullsized":"2024-06-04T16:22:49.252335+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"251'79","last_scrub_stamp":"2024-06-04T16:22:49.252226+0000","last_deep_scrub":"251'79","last_deep_scrub_stamp":"2024-06-04T16:22:49.252226+0000","last_clean_scrub_stamp":"2024-06-04T16:22:49.252226+0000","objects_scrubbed":5,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T00:19:46.167408+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5263509,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":74,"num_read_kb":65,"num_write":320,"num_write_kb":43304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.b","version":"254'4","reported_seq":794,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:24.369936+0000","last_change":"2024-06-04T16:23:24.369963+0000","last_active":"2024-06-04T16:23:24.369936+0000","last_peered":"2024-06-04T16:23:24.369936+0000","last_clean":"2024-06-04T16:23:24.369936+0000","last_became_active":"2024-06-04T15:52:40.482173+0000","last_became_peered":"2024-06-04T15:52:40.482173+0000","last_unstale":"2024-06-04T16:23:24.369936+0000","last_undegraded":"2024-06-04T16:23:24.369936+0000","last_fullsized":"2024-06-04T16:23:24.369936+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'4","last_scrub_stamp":"2024-06-04T16:23:24.369835+0000","last_deep_scrub":"254'4","last_deep_scrub_stamp":"2024-06-04T16:23:24.369835+0000","last_clean_scrub_stamp":"2024-06-04T16:23:24.369835+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T19:07:58.960858+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":464,"num_read_kb":462,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"254'116","reported_seq":674,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:12.884361+0000","last_change":"2024-06-04T16:23:12.884411+0000","last_active":"2024-06-04T16:23:12.884361+0000","last_peered":"2024-06-04T16:23:12.884361+0000","last_clean":"2024-06-04T16:23:12.884361+0000","last_became_active":"2024-06-04T15:52:42.497393+0000","last_became_peered":"2024-06-04T15:52:42.497393+0000","last_unstale":"2024-06-04T16:23:12.884361+0000","last_undegraded":"2024-06-04T16:23:12.884361+0000","last_fullsized":"2024-06-04T16:23:12.884361+0000","mapping_epoch":27,"log_start":"251'100","ondisk_log_start":"251'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'116","last_scrub_stamp":"2024-06-04T16:23:12.884257+0000","last_deep_scrub":"254'116","last_deep_scrub_stamp":"2024-06-04T16:23:12.884257+0000","last_clean_scrub_stamp":"2024-06-04T16:23:12.884257+0000","objects_scrubbed":7,"log_size":16,"log_dups_size":100,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T20:45:14.006254+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13302,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":171,"num_read_kb":247,"num_write":88,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"254'478","reported_seq":1645,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:07.355986+0000","last_change":"2024-06-04T16:23:07.356012+0000","last_active":"2024-06-04T16:23:07.355986+0000","last_peered":"2024-06-04T16:23:07.355986+0000","last_clean":"2024-06-04T16:23:07.355986+0000","last_became_active":"2024-06-04T15:52:44.518765+0000","last_became_peered":"2024-06-04T15:52:44.518765+0000","last_unstale":"2024-06-04T16:23:07.355986+0000","last_undegraded":"2024-06-04T16:23:07.355986+0000","last_fullsized":"2024-06-04T16:23:07.355986+0000","mapping_epoch":29,"log_start":"251'400","ondisk_log_start":"251'400","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'478","last_scrub_stamp":"2024-06-04T16:23:07.355902+0000","last_deep_scrub":"254'478","last_deep_scrub_stamp":"2024-06-04T16:23:07.355902+0000","last_clean_scrub_stamp":"2024-06-04T16:23:07.355902+0000","objects_scrubbed":1,"log_size":78,"log_dups_size":400,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T00:22:11.634747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"254'22","reported_seq":499,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:52.174461+0000","last_change":"2024-06-04T16:22:52.174461+0000","last_active":"2024-06-04T16:22:52.174461+0000","last_peered":"2024-06-04T16:22:52.174461+0000","last_clean":"2024-06-04T16:22:52.174461+0000","last_became_active":"2024-06-04T15:52:46.537679+0000","last_became_peered":"2024-06-04T15:52:46.537679+0000","last_unstale":"2024-06-04T16:22:52.174461+0000","last_undegraded":"2024-06-04T16:22:52.174461+0000","last_fullsized":"2024-06-04T16:22:52.174461+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'22","last_scrub_stamp":"2024-06-04T16:22:52.174345+0000","last_deep_scrub":"254'22","last_deep_scrub_stamp":"2024-06-04T16:22:52.174345+0000","last_clean_scrub_stamp":"2024-06-04T16:22:52.174345+0000","objects_scrubbed":1,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T02:41:59.686833+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":390,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":49,"num_read_kb":41,"num_write":55,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"254'142","reported_seq":909,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:18.327141+0000","last_change":"2024-06-04T16:23:18.327180+0000","last_active":"2024-06-04T16:23:18.327141+0000","last_peered":"2024-06-04T16:23:18.327141+0000","last_clean":"2024-06-04T16:23:18.327141+0000","last_became_active":"2024-06-04T15:52:38.488997+0000","last_became_peered":"2024-06-04T15:52:38.488997+0000","last_unstale":"2024-06-04T16:23:18.327141+0000","last_undegraded":"2024-06-04T16:23:18.327141+0000","last_fullsized":"2024-06-04T16:23:18.327141+0000","mapping_epoch":23,"log_start":"251'100","ondisk_log_start":"251'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'142","last_scrub_stamp":"2024-06-04T16:23:18.327044+0000","last_deep_scrub":"254'142","last_deep_scrub_stamp":"2024-06-04T16:23:18.327044+0000","last_clean_scrub_stamp":"2024-06-04T16:23:18.327044+0000","objects_scrubbed":1,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T20:11:38.046285+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":688,"num_read_kb":631,"num_write":173,"num_write_kb":46,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"254'58","reported_seq":576,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:04.760655+0000","last_change":"2024-06-04T16:23:04.760722+0000","last_active":"2024-06-04T16:23:04.760655+0000","last_peered":"2024-06-04T16:23:04.760655+0000","last_clean":"2024-06-04T16:23:04.760655+0000","last_became_active":"2024-06-04T15:52:36.495601+0000","last_became_peered":"2024-06-04T15:52:36.495601+0000","last_unstale":"2024-06-04T16:23:04.760655+0000","last_undegraded":"2024-06-04T16:23:04.760655+0000","last_fullsized":"2024-06-04T16:23:04.760655+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'58","last_scrub_stamp":"2024-06-04T16:23:04.760535+0000","last_deep_scrub":"254'58","last_deep_scrub_stamp":"2024-06-04T16:23:04.760535+0000","last_clean_scrub_stamp":"2024-06-04T16:23:04.760535+0000","objects_scrubbed":3,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T16:26:15.812386+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":74,"num_read_kb":575,"num_write":257,"num_write_kb":23683,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":481,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:56.113187+0000","last_change":"2024-06-04T16:22:56.113187+0000","last_active":"2024-06-04T16:22:56.113187+0000","last_peered":"2024-06-04T16:22:56.113187+0000","last_clean":"2024-06-04T16:22:56.113187+0000","last_became_active":"2024-06-04T15:52:40.484785+0000","last_became_peered":"2024-06-04T15:52:40.484785+0000","last_unstale":"2024-06-04T16:22:56.113187+0000","last_undegraded":"2024-06-04T16:22:56.113187+0000","last_fullsized":"2024-06-04T16:22:56.113187+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:22:56.113062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:22:56.113062+0000","last_clean_scrub_stamp":"2024-06-04T16:22:56.113062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T03:33:52.074473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.9","version":"254'161","reported_seq":772,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:57.012649+0000","last_change":"2024-06-04T16:22:57.012649+0000","last_active":"2024-06-04T16:22:57.012649+0000","last_peered":"2024-06-04T16:22:57.012649+0000","last_clean":"2024-06-04T16:22:57.012649+0000","last_became_active":"2024-06-04T15:52:42.504622+0000","last_became_peered":"2024-06-04T15:52:42.504622+0000","last_unstale":"2024-06-04T16:22:57.012649+0000","last_undegraded":"2024-06-04T16:22:57.012649+0000","last_fullsized":"2024-06-04T16:22:57.012649+0000","mapping_epoch":27,"log_start":"251'100","ondisk_log_start":"251'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'161","last_scrub_stamp":"2024-06-04T16:22:57.012513+0000","last_deep_scrub":"254'161","last_deep_scrub_stamp":"2024-06-04T16:22:57.012513+0000","last_clean_scrub_stamp":"2024-06-04T16:22:57.012513+0000","objects_scrubbed":5,"log_size":61,"log_dups_size":100,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T04:11:37.544221+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25402,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":256,"num_read_kb":404,"num_write":118,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":479,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:08.356628+0000","last_change":"2024-06-04T16:23:08.356652+0000","last_active":"2024-06-04T16:23:08.356628+0000","last_peered":"2024-06-04T16:23:08.356628+0000","last_clean":"2024-06-04T16:23:08.356628+0000","last_became_active":"2024-06-04T15:52:44.518340+0000","last_became_peered":"2024-06-04T15:52:44.518340+0000","last_unstale":"2024-06-04T16:23:08.356628+0000","last_undegraded":"2024-06-04T16:23:08.356628+0000","last_fullsized":"2024-06-04T16:23:08.356628+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:23:08.356529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:23:08.356529+0000","last_clean_scrub_stamp":"2024-06-04T16:23:08.356529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T01:28:35.019870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"254'23","reported_seq":512,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:05.078621+0000","last_change":"2024-06-04T16:23:05.078621+0000","last_active":"2024-06-04T16:23:05.078621+0000","last_peered":"2024-06-04T16:23:05.078621+0000","last_clean":"2024-06-04T16:23:05.078621+0000","last_became_active":"2024-06-04T15:52:46.540542+0000","last_became_peered":"2024-06-04T15:52:46.540542+0000","last_unstale":"2024-06-04T16:23:05.078621+0000","last_undegraded":"2024-06-04T16:23:05.078621+0000","last_fullsized":"2024-06-04T16:23:05.078621+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'23","last_scrub_stamp":"2024-06-04T16:23:05.078478+0000","last_deep_scrub":"254'23","last_deep_scrub_stamp":"2024-06-04T16:23:05.078478+0000","last_clean_scrub_stamp":"2024-06-04T16:23:05.078478+0000","objects_scrubbed":1,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T02:22:33.559139+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":503,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":51,"num_read_kb":51,"num_write":59,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"254'119","reported_seq":924,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:54.855494+0000","last_change":"2024-06-04T16:22:54.855550+0000","last_active":"2024-06-04T16:22:54.855494+0000","last_peered":"2024-06-04T16:22:54.855494+0000","last_clean":"2024-06-04T16:22:54.855494+0000","last_became_active":"2024-06-04T15:52:38.488576+0000","last_became_peered":"2024-06-04T15:52:38.488576+0000","last_unstale":"2024-06-04T16:22:54.855494+0000","last_undegraded":"2024-06-04T16:22:54.855494+0000","last_fullsized":"2024-06-04T16:22:54.855494+0000","mapping_epoch":23,"log_start":"251'100","ondisk_log_start":"251'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'119","last_scrub_stamp":"2024-06-04T16:22:54.855389+0000","last_deep_scrub":"254'119","last_deep_scrub_stamp":"2024-06-04T16:22:54.855389+0000","last_clean_scrub_stamp":"2024-06-04T16:22:54.855389+0000","objects_scrubbed":3,"log_size":19,"log_dups_size":100,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T22:19:39.538012+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":804,"num_read_kb":763,"num_write":143,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":723,"num_omap_keys":3,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"254'83","reported_seq":612,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:24.902386+0000","last_change":"2024-06-04T16:23:24.902461+0000","last_active":"2024-06-04T16:23:24.902386+0000","last_peered":"2024-06-04T16:23:24.902386+0000","last_clean":"2024-06-04T16:23:24.902386+0000","last_became_active":"2024-06-04T15:52:36.498706+0000","last_became_peered":"2024-06-04T15:52:36.498706+0000","last_unstale":"2024-06-04T16:23:24.902386+0000","last_undegraded":"2024-06-04T16:23:24.902386+0000","last_fullsized":"2024-06-04T16:23:24.902386+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'83","last_scrub_stamp":"2024-06-04T16:23:24.902269+0000","last_deep_scrub":"254'83","last_deep_scrub_stamp":"2024-06-04T16:23:24.902269+0000","last_clean_scrub_stamp":"2024-06-04T16:23:24.902269+0000","objects_scrubbed":3,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T00:39:33.757532+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262197,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":125,"num_read_kb":7280,"num_write":369,"num_write_kb":33149,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":484,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:12.929752+0000","last_change":"2024-06-04T16:23:12.929800+0000","last_active":"2024-06-04T16:23:12.929752+0000","last_peered":"2024-06-04T16:23:12.929752+0000","last_clean":"2024-06-04T16:23:12.929752+0000","last_became_active":"2024-06-04T15:52:40.484285+0000","last_became_peered":"2024-06-04T15:52:40.484285+0000","last_unstale":"2024-06-04T16:23:12.929752+0000","last_undegraded":"2024-06-04T16:23:12.929752+0000","last_fullsized":"2024-06-04T16:23:12.929752+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:23:12.929650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:23:12.929650+0000","last_clean_scrub_stamp":"2024-06-04T16:23:12.929650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T00:20:19.738361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.e","version":"254'126","reported_seq":680,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:06.264937+0000","last_change":"2024-06-04T16:23:06.265001+0000","last_active":"2024-06-04T16:23:06.264937+0000","last_peered":"2024-06-04T16:23:06.264937+0000","last_clean":"2024-06-04T16:23:06.264937+0000","last_became_active":"2024-06-04T15:52:42.500865+0000","last_became_peered":"2024-06-04T15:52:42.500865+0000","last_unstale":"2024-06-04T16:23:06.264937+0000","last_undegraded":"2024-06-04T16:23:06.264937+0000","last_fullsized":"2024-06-04T16:23:06.264937+0000","mapping_epoch":27,"log_start":"251'100","ondisk_log_start":"251'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'126","last_scrub_stamp":"2024-06-04T16:23:06.264820+0000","last_deep_scrub":"254'126","last_deep_scrub_stamp":"2024-06-04T16:23:06.264820+0000","last_clean_scrub_stamp":"2024-06-04T16:23:06.264820+0000","objects_scrubbed":6,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T20:12:34.216703+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":174,"num_read_kb":176,"num_write":136,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":13964,"num_omap_keys":34,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":476,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:13.901326+0000","last_change":"2024-06-04T16:23:13.901347+0000","last_active":"2024-06-04T16:23:13.901326+0000","last_peered":"2024-06-04T16:23:13.901326+0000","last_clean":"2024-06-04T16:23:13.901326+0000","last_became_active":"2024-06-04T15:52:44.519542+0000","last_became_peered":"2024-06-04T15:52:44.519542+0000","last_unstale":"2024-06-04T16:23:13.901326+0000","last_undegraded":"2024-06-04T16:23:13.901326+0000","last_fullsized":"2024-06-04T16:23:13.901326+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:23:13.901228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:23:13.901228+0000","last_clean_scrub_stamp":"2024-06-04T16:23:13.901228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T22:51:41.368783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.0","version":"254'18","reported_seq":494,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:00.480512+0000","last_change":"2024-06-04T16:23:00.480554+0000","last_active":"2024-06-04T16:23:00.480512+0000","last_peered":"2024-06-04T16:23:00.480512+0000","last_clean":"2024-06-04T16:23:00.480512+0000","last_became_active":"2024-06-04T15:52:46.539906+0000","last_became_peered":"2024-06-04T15:52:46.539906+0000","last_unstale":"2024-06-04T16:23:00.480512+0000","last_undegraded":"2024-06-04T16:23:00.480512+0000","last_fullsized":"2024-06-04T16:23:00.480512+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'18","last_scrub_stamp":"2024-06-04T16:23:00.480421+0000","last_deep_scrub":"254'18","last_deep_scrub_stamp":"2024-06-04T16:23:00.480421+0000","last_clean_scrub_stamp":"2024-06-04T16:23:00.480421+0000","objects_scrubbed":2,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T20:46:48.332397+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":31,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"254'141","reported_seq":907,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:21.730902+0000","last_change":"2024-06-04T16:23:21.730965+0000","last_active":"2024-06-04T16:23:21.730902+0000","last_peered":"2024-06-04T16:23:21.730902+0000","last_clean":"2024-06-04T16:23:21.730902+0000","last_became_active":"2024-06-04T15:52:38.478691+0000","last_became_peered":"2024-06-04T15:52:38.478691+0000","last_unstale":"2024-06-04T16:23:21.730902+0000","last_undegraded":"2024-06-04T16:23:21.730902+0000","last_fullsized":"2024-06-04T16:23:21.730902+0000","mapping_epoch":23,"log_start":"251'100","ondisk_log_start":"251'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'141","last_scrub_stamp":"2024-06-04T16:23:21.730784+0000","last_deep_scrub":"254'141","last_deep_scrub_stamp":"2024-06-04T16:23:21.730784+0000","last_clean_scrub_stamp":"2024-06-04T16:23:21.730784+0000","objects_scrubbed":1,"log_size":41,"log_dups_size":100,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T19:02:45.024119+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":683,"num_read_kb":634,"num_write":182,"num_write_kb":49,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":219,"num_omap_keys":1,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"254'80","reported_seq":597,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:43.608394+0000","last_change":"2024-06-04T16:23:43.608431+0000","last_active":"2024-06-04T16:23:43.608394+0000","last_peered":"2024-06-04T16:23:43.608394+0000","last_clean":"2024-06-04T16:23:43.608394+0000","last_became_active":"2024-06-04T15:52:36.489437+0000","last_became_peered":"2024-06-04T15:52:36.489437+0000","last_unstale":"2024-06-04T16:23:43.608394+0000","last_undegraded":"2024-06-04T16:23:43.608394+0000","last_fullsized":"2024-06-04T16:23:43.608394+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'80","last_scrub_stamp":"2024-06-04T16:23:43.608257+0000","last_deep_scrub":"254'80","last_deep_scrub_stamp":"2024-06-04T16:23:43.608257+0000","last_clean_scrub_stamp":"2024-06-04T16:23:43.608257+0000","objects_scrubbed":2,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T22:15:30.727577+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133669,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":97,"num_read_kb":3905,"num_write":348,"num_write_kb":24180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":486,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:22.346328+0000","last_change":"2024-06-04T16:23:22.346350+0000","last_active":"2024-06-04T16:23:22.346328+0000","last_peered":"2024-06-04T16:23:22.346328+0000","last_clean":"2024-06-04T16:23:22.346328+0000","last_became_active":"2024-06-04T15:52:40.480568+0000","last_became_peered":"2024-06-04T15:52:40.480568+0000","last_unstale":"2024-06-04T16:23:22.346328+0000","last_undegraded":"2024-06-04T16:23:22.346328+0000","last_fullsized":"2024-06-04T16:23:22.346328+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:23:22.346239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:23:22.346239+0000","last_clean_scrub_stamp":"2024-06-04T16:23:22.346239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T01:05:37.658043+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.f","version":"254'118","reported_seq":678,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:26.452412+0000","last_change":"2024-06-04T16:23:26.452471+0000","last_active":"2024-06-04T16:23:26.452412+0000","last_peered":"2024-06-04T16:23:26.452412+0000","last_clean":"2024-06-04T16:23:26.452412+0000","last_became_active":"2024-06-04T15:52:42.499014+0000","last_became_peered":"2024-06-04T15:52:42.499014+0000","last_unstale":"2024-06-04T16:23:26.452412+0000","last_undegraded":"2024-06-04T16:23:26.452412+0000","last_fullsized":"2024-06-04T16:23:26.452412+0000","mapping_epoch":27,"log_start":"251'100","ondisk_log_start":"251'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'118","last_scrub_stamp":"2024-06-04T16:23:26.452307+0000","last_deep_scrub":"254'118","last_deep_scrub_stamp":"2024-06-04T16:23:26.452307+0000","last_clean_scrub_stamp":"2024-06-04T16:23:26.452307+0000","objects_scrubbed":7,"log_size":18,"log_dups_size":100,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T19:48:43.429761+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6848,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":169,"num_read_kb":239,"num_write":88,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.e","version":"254'464","reported_seq":1453,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:11.952502+0000","last_change":"2024-06-04T16:23:11.952532+0000","last_active":"2024-06-04T16:23:11.952502+0000","last_peered":"2024-06-04T16:23:11.952502+0000","last_clean":"2024-06-04T16:23:11.952502+0000","last_became_active":"2024-06-04T15:52:44.520016+0000","last_became_peered":"2024-06-04T15:52:44.520016+0000","last_unstale":"2024-06-04T16:23:11.952502+0000","last_undegraded":"2024-06-04T16:23:11.952502+0000","last_fullsized":"2024-06-04T16:23:11.952502+0000","mapping_epoch":29,"log_start":"251'400","ondisk_log_start":"251'400","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'464","last_scrub_stamp":"2024-06-04T16:23:11.952413+0000","last_deep_scrub":"254'464","last_deep_scrub_stamp":"2024-06-04T16:23:11.952413+0000","last_clean_scrub_stamp":"2024-06-04T16:23:11.952413+0000","objects_scrubbed":1,"log_size":64,"log_dups_size":400,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T02:24:58.126815+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1","version":"254'30","reported_seq":510,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:20.170753+0000","last_change":"2024-06-04T16:23:20.170804+0000","last_active":"2024-06-04T16:23:20.170753+0000","last_peered":"2024-06-04T16:23:20.170753+0000","last_clean":"2024-06-04T16:23:20.170753+0000","last_became_active":"2024-06-04T15:52:46.532554+0000","last_became_peered":"2024-06-04T15:52:46.532554+0000","last_unstale":"2024-06-04T16:23:20.170753+0000","last_undegraded":"2024-06-04T16:23:20.170753+0000","last_fullsized":"2024-06-04T16:23:20.170753+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'30","last_scrub_stamp":"2024-06-04T16:23:20.170628+0000","last_deep_scrub":"254'30","last_deep_scrub_stamp":"2024-06-04T16:23:20.170628+0000","last_clean_scrub_stamp":"2024-06-04T16:23:20.170628+0000","objects_scrubbed":2,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T23:35:04.324039+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":764,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":64,"num_read_kb":55,"num_write":77,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.e","version":"254'75","reported_seq":766,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:06.474256+0000","last_change":"2024-06-04T16:23:06.474304+0000","last_active":"2024-06-04T16:23:06.474256+0000","last_peered":"2024-06-04T16:23:06.474256+0000","last_clean":"2024-06-04T16:23:06.474256+0000","last_became_active":"2024-06-04T15:52:38.480961+0000","last_became_peered":"2024-06-04T15:52:38.480961+0000","last_unstale":"2024-06-04T16:23:06.474256+0000","last_undegraded":"2024-06-04T16:23:06.474256+0000","last_fullsized":"2024-06-04T16:23:06.474256+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'75","last_scrub_stamp":"2024-06-04T16:23:06.474148+0000","last_deep_scrub":"254'75","last_deep_scrub_stamp":"2024-06-04T16:23:06.474148+0000","last_clean_scrub_stamp":"2024-06-04T16:23:06.474148+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T19:29:32.107688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":420,"num_read_kb":402,"num_write":82,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"254'43","reported_seq":551,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:40.527986+0000","last_change":"2024-06-04T16:23:40.528042+0000","last_active":"2024-06-04T16:23:40.527986+0000","last_peered":"2024-06-04T16:23:40.527986+0000","last_clean":"2024-06-04T16:23:40.527986+0000","last_became_active":"2024-06-04T15:52:36.485571+0000","last_became_peered":"2024-06-04T15:52:36.485571+0000","last_unstale":"2024-06-04T16:23:40.527986+0000","last_undegraded":"2024-06-04T16:23:40.527986+0000","last_fullsized":"2024-06-04T16:23:40.527986+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'43","last_scrub_stamp":"2024-06-04T16:23:40.527859+0000","last_deep_scrub":"254'43","last_deep_scrub_stamp":"2024-06-04T16:23:40.527859+0000","last_clean_scrub_stamp":"2024-06-04T16:23:40.527859+0000","objects_scrubbed":1,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T00:32:31.087591+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":66,"num_read_kb":9943,"num_write":198,"num_write_kb":32171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"254'4","reported_seq":1096,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:58.155039+0000","last_change":"2024-06-04T16:22:58.155073+0000","last_active":"2024-06-04T16:22:58.155039+0000","last_peered":"2024-06-04T16:22:58.155039+0000","last_clean":"2024-06-04T16:22:58.155039+0000","last_became_active":"2024-06-04T15:52:40.477693+0000","last_became_peered":"2024-06-04T15:52:40.477693+0000","last_unstale":"2024-06-04T16:22:58.155039+0000","last_undegraded":"2024-06-04T16:22:58.155039+0000","last_fullsized":"2024-06-04T16:22:58.155039+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'4","last_scrub_stamp":"2024-06-04T16:22:58.154941+0000","last_deep_scrub":"254'4","last_deep_scrub_stamp":"2024-06-04T16:22:58.154941+0000","last_clean_scrub_stamp":"2024-06-04T16:22:58.154941+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T00:05:04.192698+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":606,"num_read_kb":606,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"254'40","reported_seq":531,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:02.080728+0000","last_change":"2024-06-04T16:23:02.080763+0000","last_active":"2024-06-04T16:23:02.080728+0000","last_peered":"2024-06-04T16:23:02.080728+0000","last_clean":"2024-06-04T16:23:02.080728+0000","last_became_active":"2024-06-04T15:52:42.503184+0000","last_became_peered":"2024-06-04T15:52:42.503184+0000","last_unstale":"2024-06-04T16:23:02.080728+0000","last_undegraded":"2024-06-04T16:23:02.080728+0000","last_fullsized":"2024-06-04T16:23:02.080728+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'40","last_scrub_stamp":"2024-06-04T16:23:02.080645+0000","last_deep_scrub":"254'40","last_deep_scrub_stamp":"2024-06-04T16:23:02.080645+0000","last_clean_scrub_stamp":"2024-06-04T16:23:02.080645+0000","objects_scrubbed":5,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T03:22:52.049410+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":45,"num_read_kb":40,"num_write":30,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.d","version":"254'470","reported_seq":1632,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:57.144139+0000","last_change":"2024-06-04T16:22:57.144210+0000","last_active":"2024-06-04T16:22:57.144139+0000","last_peered":"2024-06-04T16:22:57.144139+0000","last_clean":"2024-06-04T16:22:57.144139+0000","last_became_active":"2024-06-04T15:52:44.518522+0000","last_became_peered":"2024-06-04T15:52:44.518522+0000","last_unstale":"2024-06-04T16:22:57.144139+0000","last_undegraded":"2024-06-04T16:22:57.144139+0000","last_fullsized":"2024-06-04T16:22:57.144139+0000","mapping_epoch":29,"log_start":"251'400","ondisk_log_start":"251'400","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'470","last_scrub_stamp":"2024-06-04T16:22:57.144040+0000","last_deep_scrub":"254'470","last_deep_scrub_stamp":"2024-06-04T16:22:57.144040+0000","last_clean_scrub_stamp":"2024-06-04T16:22:57.144040+0000","objects_scrubbed":1,"log_size":70,"log_dups_size":400,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T02:23:07.168350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"254'26","reported_seq":503,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:21.631938+0000","last_change":"2024-06-04T16:23:21.631965+0000","last_active":"2024-06-04T16:23:21.631938+0000","last_peered":"2024-06-04T16:23:21.631938+0000","last_clean":"2024-06-04T16:23:21.631938+0000","last_became_active":"2024-06-04T15:52:46.529183+0000","last_became_peered":"2024-06-04T15:52:46.529183+0000","last_unstale":"2024-06-04T16:23:21.631938+0000","last_undegraded":"2024-06-04T16:23:21.631938+0000","last_fullsized":"2024-06-04T16:23:21.631938+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'26","last_scrub_stamp":"2024-06-04T16:23:21.631850+0000","last_deep_scrub":"254'26","last_deep_scrub_stamp":"2024-06-04T16:23:21.631850+0000","last_clean_scrub_stamp":"2024-06-04T16:23:21.631850+0000","objects_scrubbed":1,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T23:41:50.582422+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":33,"num_read_kb":31,"num_write":52,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"254'102","reported_seq":875,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:18.975096+0000","last_change":"2024-06-04T16:23:18.975148+0000","last_active":"2024-06-04T16:23:18.975096+0000","last_peered":"2024-06-04T16:23:18.975096+0000","last_clean":"2024-06-04T16:23:18.975096+0000","last_became_active":"2024-06-04T15:52:38.485146+0000","last_became_peered":"2024-06-04T15:52:38.485146+0000","last_unstale":"2024-06-04T16:23:18.975096+0000","last_undegraded":"2024-06-04T16:23:18.975096+0000","last_fullsized":"2024-06-04T16:23:18.975096+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'102","last_scrub_stamp":"2024-06-04T16:23:18.974996+0000","last_deep_scrub":"254'102","last_deep_scrub_stamp":"2024-06-04T16:23:18.974996+0000","last_clean_scrub_stamp":"2024-06-04T16:23:18.974996+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T23:16:12.932747+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":573,"num_read_kb":549,"num_write":116,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"251'24","reported_seq":526,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:18.858021+0000","last_change":"2024-06-04T16:23:18.858060+0000","last_active":"2024-06-04T16:23:18.858021+0000","last_peered":"2024-06-04T16:23:18.858021+0000","last_clean":"2024-06-04T16:23:18.858021+0000","last_became_active":"2024-06-04T15:52:36.475290+0000","last_became_peered":"2024-06-04T15:52:36.475290+0000","last_unstale":"2024-06-04T16:23:18.858021+0000","last_undegraded":"2024-06-04T16:23:18.858021+0000","last_fullsized":"2024-06-04T16:23:18.858021+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"251'24","last_scrub_stamp":"2024-06-04T16:23:18.857916+0000","last_deep_scrub":"251'24","last_deep_scrub_stamp":"2024-06-04T16:23:18.857916+0000","last_clean_scrub_stamp":"2024-06-04T16:23:18.857916+0000","objects_scrubbed":1,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T23:52:34.754727+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":22,"num_read_kb":15371,"num_write":75,"num_write_kb":21019,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,2],"acting":[4,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":483,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:16.796763+0000","last_change":"2024-06-04T16:23:16.796788+0000","last_active":"2024-06-04T16:23:16.796763+0000","last_peered":"2024-06-04T16:23:16.796763+0000","last_clean":"2024-06-04T16:23:16.796763+0000","last_became_active":"2024-06-04T15:52:40.481856+0000","last_became_peered":"2024-06-04T15:52:40.481856+0000","last_unstale":"2024-06-04T16:23:16.796763+0000","last_undegraded":"2024-06-04T16:23:16.796763+0000","last_fullsized":"2024-06-04T16:23:16.796763+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:23:16.796663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:23:16.796663+0000","last_clean_scrub_stamp":"2024-06-04T16:23:16.796663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T22:31:29.169661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"254'148","reported_seq":726,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:08.239387+0000","last_change":"2024-06-04T16:23:08.239441+0000","last_active":"2024-06-04T16:23:08.239387+0000","last_peered":"2024-06-04T16:23:08.239387+0000","last_clean":"2024-06-04T16:23:08.239387+0000","last_became_active":"2024-06-04T15:52:42.503214+0000","last_became_peered":"2024-06-04T15:52:42.503214+0000","last_unstale":"2024-06-04T16:23:08.239387+0000","last_undegraded":"2024-06-04T16:23:08.239387+0000","last_fullsized":"2024-06-04T16:23:08.239387+0000","mapping_epoch":27,"log_start":"251'100","ondisk_log_start":"251'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'148","last_scrub_stamp":"2024-06-04T16:23:08.239291+0000","last_deep_scrub":"254'148","last_deep_scrub_stamp":"2024-06-04T16:23:08.239291+0000","last_clean_scrub_stamp":"2024-06-04T16:23:08.239291+0000","objects_scrubbed":9,"log_size":48,"log_dups_size":100,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T23:13:35.428234+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27149,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":238,"num_read_kb":318,"num_write":172,"num_write_kb":95,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":23306,"num_omap_keys":60,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":474,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:05.466085+0000","last_change":"2024-06-04T16:23:05.466110+0000","last_active":"2024-06-04T16:23:05.466085+0000","last_peered":"2024-06-04T16:23:05.466085+0000","last_clean":"2024-06-04T16:23:05.466085+0000","last_became_active":"2024-06-04T15:52:44.514269+0000","last_became_peered":"2024-06-04T15:52:44.514269+0000","last_unstale":"2024-06-04T16:23:05.466085+0000","last_undegraded":"2024-06-04T16:23:05.466085+0000","last_fullsized":"2024-06-04T16:23:05.466085+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:23:05.465993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:23:05.465993+0000","last_clean_scrub_stamp":"2024-06-04T16:23:05.465993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T17:36:31.045619+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"254'31","reported_seq":512,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:19.955405+0000","last_change":"2024-06-04T16:23:19.955432+0000","last_active":"2024-06-04T16:23:19.955405+0000","last_peered":"2024-06-04T16:23:19.955405+0000","last_clean":"2024-06-04T16:23:19.955405+0000","last_became_active":"2024-06-04T15:52:46.531977+0000","last_became_peered":"2024-06-04T15:52:46.531977+0000","last_unstale":"2024-06-04T16:23:19.955405+0000","last_undegraded":"2024-06-04T16:23:19.955405+0000","last_fullsized":"2024-06-04T16:23:19.955405+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'31","last_scrub_stamp":"2024-06-04T16:23:19.955313+0000","last_deep_scrub":"254'31","last_deep_scrub_stamp":"2024-06-04T16:23:19.955313+0000","last_clean_scrub_stamp":"2024-06-04T16:23:19.955313+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T20:01:47.795809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":49,"num_write":79,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"254'145","reported_seq":962,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:23.734953+0000","last_change":"2024-06-04T16:23:23.734980+0000","last_active":"2024-06-04T16:23:23.734953+0000","last_peered":"2024-06-04T16:23:23.734953+0000","last_clean":"2024-06-04T16:23:23.734953+0000","last_became_active":"2024-06-04T15:52:38.478362+0000","last_became_peered":"2024-06-04T15:52:38.478362+0000","last_unstale":"2024-06-04T16:23:23.734953+0000","last_undegraded":"2024-06-04T16:23:23.734953+0000","last_fullsized":"2024-06-04T16:23:23.734953+0000","mapping_epoch":23,"log_start":"251'100","ondisk_log_start":"251'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'145","last_scrub_stamp":"2024-06-04T16:23:23.734860+0000","last_deep_scrub":"254'145","last_deep_scrub_stamp":"2024-06-04T16:23:23.734860+0000","last_clean_scrub_stamp":"2024-06-04T16:23:23.734860+0000","objects_scrubbed":1,"log_size":45,"log_dups_size":100,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T02:17:22.450341+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":807,"num_read_kb":748,"num_write":182,"num_write_kb":49,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":505,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:14.325906+0000","last_change":"2024-06-04T16:23:14.325930+0000","last_active":"2024-06-04T16:23:14.325906+0000","last_peered":"2024-06-04T16:23:14.325906+0000","last_clean":"2024-06-04T16:23:14.325906+0000","last_became_active":"2024-06-04T15:52:22.417462+0000","last_became_peered":"2024-06-04T15:52:22.417462+0000","last_unstale":"2024-06-04T16:23:14.325906+0000","last_undegraded":"2024-06-04T16:23:14.325906+0000","last_fullsized":"2024-06-04T16:23:14.325906+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:23:14.325798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:23:14.325798+0000","last_clean_scrub_stamp":"2024-06-04T16:23:14.325798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T23:53:10.001735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"251'43","reported_seq":543,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:23.808597+0000","last_change":"2024-06-04T16:23:23.808637+0000","last_active":"2024-06-04T16:23:23.808597+0000","last_peered":"2024-06-04T16:23:23.808597+0000","last_clean":"2024-06-04T16:23:23.808597+0000","last_became_active":"2024-06-04T15:52:36.497603+0000","last_became_peered":"2024-06-04T15:52:36.497603+0000","last_unstale":"2024-06-04T16:23:23.808597+0000","last_undegraded":"2024-06-04T16:23:23.808597+0000","last_fullsized":"2024-06-04T16:23:23.808597+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"251'43","last_scrub_stamp":"2024-06-04T16:23:23.808498+0000","last_deep_scrub":"251'43","last_deep_scrub_stamp":"2024-06-04T16:23:23.808498+0000","last_clean_scrub_stamp":"2024-06-04T16:23:23.808498+0000","objects_scrubbed":2,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T18:24:13.323796+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1069190,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":32,"num_read_kb":263,"num_write":148,"num_write_kb":16917,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,0],"acting":[4,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":487,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:51.867953+0000","last_change":"2024-06-04T16:22:51.867979+0000","last_active":"2024-06-04T16:22:51.867953+0000","last_peered":"2024-06-04T16:22:51.867953+0000","last_clean":"2024-06-04T16:22:51.867953+0000","last_became_active":"2024-06-04T15:52:40.482529+0000","last_became_peered":"2024-06-04T15:52:40.482529+0000","last_unstale":"2024-06-04T16:22:51.867953+0000","last_undegraded":"2024-06-04T16:22:51.867953+0000","last_fullsized":"2024-06-04T16:22:51.867953+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:22:51.867794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:22:51.867794+0000","last_clean_scrub_stamp":"2024-06-04T16:22:51.867794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T17:42:46.966148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"254'247","reported_seq":928,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:13.866235+0000","last_change":"2024-06-04T16:23:13.866295+0000","last_active":"2024-06-04T16:23:13.866235+0000","last_peered":"2024-06-04T16:23:13.866235+0000","last_clean":"2024-06-04T16:23:13.866235+0000","last_became_active":"2024-06-04T15:52:42.496878+0000","last_became_peered":"2024-06-04T15:52:42.496878+0000","last_unstale":"2024-06-04T16:23:13.866235+0000","last_undegraded":"2024-06-04T16:23:13.866235+0000","last_fullsized":"2024-06-04T16:23:13.866235+0000","mapping_epoch":27,"log_start":"251'200","ondisk_log_start":"251'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'247","last_scrub_stamp":"2024-06-04T16:23:13.866118+0000","last_deep_scrub":"254'247","last_deep_scrub_stamp":"2024-06-04T16:23:13.866118+0000","last_clean_scrub_stamp":"2024-06-04T16:23:13.866118+0000","objects_scrubbed":6,"log_size":47,"log_dups_size":200,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T23:18:27.252241+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30577,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":489,"num_read_kb":691,"num_write":394,"num_write_kb":281,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":89476,"num_omap_keys":214,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":479,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:11.411051+0000","last_change":"2024-06-04T16:23:11.411076+0000","last_active":"2024-06-04T16:23:11.411051+0000","last_peered":"2024-06-04T16:23:11.411051+0000","last_clean":"2024-06-04T16:23:11.411051+0000","last_became_active":"2024-06-04T15:52:44.513726+0000","last_became_peered":"2024-06-04T15:52:44.513726+0000","last_unstale":"2024-06-04T16:23:11.411051+0000","last_undegraded":"2024-06-04T16:23:11.411051+0000","last_fullsized":"2024-06-04T16:23:11.411051+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:23:11.410960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:23:11.410960+0000","last_clean_scrub_stamp":"2024-06-04T16:23:11.410960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T17:49:36.322932+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"254'35","reported_seq":527,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:13.860513+0000","last_change":"2024-06-04T16:23:13.860575+0000","last_active":"2024-06-04T16:23:13.860513+0000","last_peered":"2024-06-04T16:23:13.860513+0000","last_clean":"2024-06-04T16:23:13.860513+0000","last_became_active":"2024-06-04T15:52:46.536184+0000","last_became_peered":"2024-06-04T15:52:46.536184+0000","last_unstale":"2024-06-04T16:23:13.860513+0000","last_undegraded":"2024-06-04T16:23:13.860513+0000","last_fullsized":"2024-06-04T16:23:13.860513+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'35","last_scrub_stamp":"2024-06-04T16:23:13.860386+0000","last_deep_scrub":"254'35","last_deep_scrub_stamp":"2024-06-04T16:23:13.860386+0000","last_clean_scrub_stamp":"2024-06-04T16:23:13.860386+0000","objects_scrubbed":1,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T16:38:56.538838+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":408,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":64,"num_read_kb":61,"num_write":79,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"254'172","reported_seq":982,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:18.205094+0000","last_change":"2024-06-04T16:23:18.205120+0000","last_active":"2024-06-04T16:23:18.205094+0000","last_peered":"2024-06-04T16:23:18.205094+0000","last_clean":"2024-06-04T16:23:18.205094+0000","last_became_active":"2024-06-04T15:52:38.474646+0000","last_became_peered":"2024-06-04T15:52:38.474646+0000","last_unstale":"2024-06-04T16:23:18.205094+0000","last_undegraded":"2024-06-04T16:23:18.205094+0000","last_fullsized":"2024-06-04T16:23:18.205094+0000","mapping_epoch":23,"log_start":"251'100","ondisk_log_start":"251'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'172","last_scrub_stamp":"2024-06-04T16:23:18.205006+0000","last_deep_scrub":"254'172","last_deep_scrub_stamp":"2024-06-04T16:23:18.205006+0000","last_clean_scrub_stamp":"2024-06-04T16:23:18.205006+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":100,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T21:10:26.825707+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":944,"num_read_kb":866,"num_write":217,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":503,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:38.505826+0000","last_change":"2024-06-04T16:23:38.505862+0000","last_active":"2024-06-04T16:23:38.505826+0000","last_peered":"2024-06-04T16:23:38.505826+0000","last_clean":"2024-06-04T16:23:38.505826+0000","last_became_active":"2024-06-04T15:52:22.776779+0000","last_became_peered":"2024-06-04T15:52:22.776779+0000","last_unstale":"2024-06-04T16:23:38.505826+0000","last_undegraded":"2024-06-04T16:23:38.505826+0000","last_fullsized":"2024-06-04T16:23:38.505826+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:23:38.505689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:23:38.505689+0000","last_clean_scrub_stamp":"2024-06-04T16:23:38.505689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T23:36:53.146721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"251'43","reported_seq":548,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:11.801114+0000","last_change":"2024-06-04T16:23:11.801160+0000","last_active":"2024-06-04T16:23:11.801114+0000","last_peered":"2024-06-04T16:23:11.801114+0000","last_clean":"2024-06-04T16:23:11.801114+0000","last_became_active":"2024-06-04T15:52:36.494711+0000","last_became_peered":"2024-06-04T15:52:36.494711+0000","last_unstale":"2024-06-04T16:23:11.801114+0000","last_undegraded":"2024-06-04T16:23:11.801114+0000","last_fullsized":"2024-06-04T16:23:11.801114+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"251'43","last_scrub_stamp":"2024-06-04T16:23:11.801011+0000","last_deep_scrub":"251'43","last_deep_scrub_stamp":"2024-06-04T16:23:11.801011+0000","last_clean_scrub_stamp":"2024-06-04T16:23:11.801011+0000","objects_scrubbed":3,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T03:17:51.288880+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20644,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":32,"num_read_kb":101,"num_write":157,"num_write_kb":20554,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,4],"acting":[0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":485,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:14.949247+0000","last_change":"2024-06-04T16:23:14.949274+0000","last_active":"2024-06-04T16:23:14.949247+0000","last_peered":"2024-06-04T16:23:14.949247+0000","last_clean":"2024-06-04T16:23:14.949247+0000","last_became_active":"2024-06-04T15:52:40.484698+0000","last_became_peered":"2024-06-04T15:52:40.484698+0000","last_unstale":"2024-06-04T16:23:14.949247+0000","last_undegraded":"2024-06-04T16:23:14.949247+0000","last_fullsized":"2024-06-04T16:23:14.949247+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:23:14.949147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:23:14.949147+0000","last_clean_scrub_stamp":"2024-06-04T16:23:14.949147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T22:36:57.311927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"254'90","reported_seq":606,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:36.365331+0000","last_change":"2024-06-04T16:23:36.365363+0000","last_active":"2024-06-04T16:23:36.365331+0000","last_peered":"2024-06-04T16:23:36.365331+0000","last_clean":"2024-06-04T16:23:36.365331+0000","last_became_active":"2024-06-04T15:52:42.500646+0000","last_became_peered":"2024-06-04T15:52:42.500646+0000","last_unstale":"2024-06-04T16:23:36.365331+0000","last_undegraded":"2024-06-04T16:23:36.365331+0000","last_fullsized":"2024-06-04T16:23:36.365331+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'90","last_scrub_stamp":"2024-06-04T16:23:36.365234+0000","last_deep_scrub":"254'90","last_deep_scrub_stamp":"2024-06-04T16:23:36.365234+0000","last_clean_scrub_stamp":"2024-06-04T16:23:36.365234+0000","objects_scrubbed":7,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T17:09:17.198066+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":102,"num_read_kb":94,"num_write":72,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1636,"num_omap_keys":4,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":476,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:03.864415+0000","last_change":"2024-06-04T16:23:03.864415+0000","last_active":"2024-06-04T16:23:03.864415+0000","last_peered":"2024-06-04T16:23:03.864415+0000","last_clean":"2024-06-04T16:23:03.864415+0000","last_became_active":"2024-06-04T15:52:44.520841+0000","last_became_peered":"2024-06-04T15:52:44.520841+0000","last_unstale":"2024-06-04T16:23:03.864415+0000","last_undegraded":"2024-06-04T16:23:03.864415+0000","last_fullsized":"2024-06-04T16:23:03.864415+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:23:03.864261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:23:03.864261+0000","last_clean_scrub_stamp":"2024-06-04T16:23:03.864261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T18:09:32.795774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"251'34","reported_seq":544,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:51.136365+0000","last_change":"2024-06-04T16:22:51.136365+0000","last_active":"2024-06-04T16:22:51.136365+0000","last_peered":"2024-06-04T16:22:51.136365+0000","last_clean":"2024-06-04T16:22:51.136365+0000","last_became_active":"2024-06-04T15:52:46.539931+0000","last_became_peered":"2024-06-04T15:52:46.539931+0000","last_unstale":"2024-06-04T16:22:51.136365+0000","last_undegraded":"2024-06-04T16:22:51.136365+0000","last_fullsized":"2024-06-04T16:22:51.136365+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"251'34","last_scrub_stamp":"2024-06-04T16:22:51.136181+0000","last_deep_scrub":"251'34","last_deep_scrub_stamp":"2024-06-04T16:22:51.136181+0000","last_clean_scrub_stamp":"2024-06-04T16:22:51.136181+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T19:05:15.366957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":127,"num_read_kb":111,"num_write":92,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"254'121","reported_seq":1040,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:03.065206+0000","last_change":"2024-06-04T16:23:03.065255+0000","last_active":"2024-06-04T16:23:03.065206+0000","last_peered":"2024-06-04T16:23:03.065206+0000","last_clean":"2024-06-04T16:23:03.065206+0000","last_became_active":"2024-06-04T15:52:38.485755+0000","last_became_peered":"2024-06-04T15:52:38.485755+0000","last_unstale":"2024-06-04T16:23:03.065206+0000","last_undegraded":"2024-06-04T16:23:03.065206+0000","last_fullsized":"2024-06-04T16:23:03.065206+0000","mapping_epoch":23,"log_start":"254'100","ondisk_log_start":"254'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'121","last_scrub_stamp":"2024-06-04T16:23:03.065085+0000","last_deep_scrub":"254'121","last_deep_scrub_stamp":"2024-06-04T16:23:03.065085+0000","last_clean_scrub_stamp":"2024-06-04T16:23:03.065085+0000","objects_scrubbed":2,"log_size":21,"log_dups_size":100,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T17:34:01.981275+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":989,"num_read_kb":963,"num_write":137,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2286,"num_omap_keys":9,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":505,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:05.784811+0000","last_change":"2024-06-04T16:23:05.784811+0000","last_active":"2024-06-04T16:23:05.784811+0000","last_peered":"2024-06-04T16:23:05.784811+0000","last_clean":"2024-06-04T16:23:05.784811+0000","last_became_active":"2024-06-04T15:52:22.422971+0000","last_became_peered":"2024-06-04T15:52:22.422971+0000","last_unstale":"2024-06-04T16:23:05.784811+0000","last_undegraded":"2024-06-04T16:23:05.784811+0000","last_fullsized":"2024-06-04T16:23:05.784811+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:23:05.784635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:23:05.784635+0000","last_clean_scrub_stamp":"2024-06-04T16:23:05.784635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T04:21:46.950261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"254'72","reported_seq":621,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:33.398029+0000","last_change":"2024-06-04T16:23:33.398097+0000","last_active":"2024-06-04T16:23:33.398029+0000","last_peered":"2024-06-04T16:23:33.398029+0000","last_clean":"2024-06-04T16:23:33.398029+0000","last_became_active":"2024-06-04T15:52:36.485475+0000","last_became_peered":"2024-06-04T15:52:36.485475+0000","last_unstale":"2024-06-04T16:23:33.398029+0000","last_undegraded":"2024-06-04T16:23:33.398029+0000","last_fullsized":"2024-06-04T16:23:33.398029+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'72","last_scrub_stamp":"2024-06-04T16:23:33.397930+0000","last_deep_scrub":"254'72","last_deep_scrub_stamp":"2024-06-04T16:23:33.397930+0000","last_clean_scrub_stamp":"2024-06-04T16:23:33.397930+0000","objects_scrubbed":5,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T18:20:24.491750+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":109,"num_read_kb":62832,"num_write":269,"num_write_kb":45136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,2],"acting":[5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"254'2","reported_seq":487,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:10.995937+0000","last_change":"2024-06-04T16:23:10.995968+0000","last_active":"2024-06-04T16:23:10.995937+0000","last_peered":"2024-06-04T16:23:10.995937+0000","last_clean":"2024-06-04T16:23:10.995937+0000","last_became_active":"2024-06-04T15:52:40.486003+0000","last_became_peered":"2024-06-04T15:52:40.486003+0000","last_unstale":"2024-06-04T16:23:10.995937+0000","last_undegraded":"2024-06-04T16:23:10.995937+0000","last_fullsized":"2024-06-04T16:23:10.995937+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'2","last_scrub_stamp":"2024-06-04T16:23:10.995821+0000","last_deep_scrub":"254'2","last_deep_scrub_stamp":"2024-06-04T16:23:10.995821+0000","last_clean_scrub_stamp":"2024-06-04T16:23:10.995821+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T18:23:07.156912+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"254'124","reported_seq":1007,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:57.787192+0000","last_change":"2024-06-04T16:22:57.787246+0000","last_active":"2024-06-04T16:22:57.787192+0000","last_peered":"2024-06-04T16:22:57.787192+0000","last_clean":"2024-06-04T16:22:57.787192+0000","last_became_active":"2024-06-04T15:52:42.505250+0000","last_became_peered":"2024-06-04T15:52:42.505250+0000","last_unstale":"2024-06-04T16:22:57.787192+0000","last_undegraded":"2024-06-04T16:22:57.787192+0000","last_fullsized":"2024-06-04T16:22:57.787192+0000","mapping_epoch":27,"log_start":"251'100","ondisk_log_start":"251'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'124","last_scrub_stamp":"2024-06-04T16:22:57.787100+0000","last_deep_scrub":"254'124","last_deep_scrub_stamp":"2024-06-04T16:22:57.787100+0000","last_clean_scrub_stamp":"2024-06-04T16:22:57.787100+0000","objects_scrubbed":8,"log_size":24,"log_dups_size":100,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T22:01:32.859318+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":113,"num_read_kb":103,"num_write":67,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":477,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:51.009073+0000","last_change":"2024-06-04T16:22:51.009109+0000","last_active":"2024-06-04T16:22:51.009073+0000","last_peered":"2024-06-04T16:22:51.009073+0000","last_clean":"2024-06-04T16:22:51.009073+0000","last_became_active":"2024-06-04T15:52:44.522168+0000","last_became_peered":"2024-06-04T15:52:44.522168+0000","last_unstale":"2024-06-04T16:22:51.009073+0000","last_undegraded":"2024-06-04T16:22:51.009073+0000","last_fullsized":"2024-06-04T16:22:51.009073+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:22:51.008969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:22:51.008969+0000","last_clean_scrub_stamp":"2024-06-04T16:22:51.008969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T17:53:46.600382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.b","version":"254'112","reported_seq":611,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:46.992773+0000","last_change":"2024-06-04T16:22:46.992832+0000","last_active":"2024-06-04T16:22:46.992773+0000","last_peered":"2024-06-04T16:22:46.992773+0000","last_clean":"2024-06-04T16:22:46.992773+0000","last_became_active":"2024-06-04T15:52:46.537377+0000","last_became_peered":"2024-06-04T15:52:46.537377+0000","last_unstale":"2024-06-04T16:22:46.992773+0000","last_undegraded":"2024-06-04T16:22:46.992773+0000","last_fullsized":"2024-06-04T16:22:46.992773+0000","mapping_epoch":31,"log_start":"251'100","ondisk_log_start":"251'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'112","last_scrub_stamp":"2024-06-04T16:22:46.992648+0000","last_deep_scrub":"254'112","last_deep_scrub_stamp":"2024-06-04T16:22:46.992648+0000","last_clean_scrub_stamp":"2024-06-04T16:22:46.992648+0000","objects_scrubbed":1,"log_size":12,"log_dups_size":100,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T19:14:15.808220+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":232,"num_read_kb":256,"num_write":227,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":851,"num_omap_keys":5,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.6","version":"254'76","reported_seq":777,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:12.378772+0000","last_change":"2024-06-04T16:23:12.378804+0000","last_active":"2024-06-04T16:23:12.378772+0000","last_peered":"2024-06-04T16:23:12.378772+0000","last_clean":"2024-06-04T16:23:12.378772+0000","last_became_active":"2024-06-04T15:52:38.487359+0000","last_became_peered":"2024-06-04T15:52:38.487359+0000","last_unstale":"2024-06-04T16:23:12.378772+0000","last_undegraded":"2024-06-04T16:23:12.378772+0000","last_fullsized":"2024-06-04T16:23:12.378772+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'76","last_scrub_stamp":"2024-06-04T16:23:12.378681+0000","last_deep_scrub":"254'76","last_deep_scrub_stamp":"2024-06-04T16:23:12.378681+0000","last_clean_scrub_stamp":"2024-06-04T16:23:12.378681+0000","objects_scrubbed":2,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T23:38:54.261802+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":431,"num_read_kb":414,"num_write":84,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":504,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:17.888839+0000","last_change":"2024-06-04T16:23:17.888839+0000","last_active":"2024-06-04T16:23:17.888839+0000","last_peered":"2024-06-04T16:23:17.888839+0000","last_clean":"2024-06-04T16:23:17.888839+0000","last_became_active":"2024-06-04T15:52:22.423712+0000","last_became_peered":"2024-06-04T15:52:22.423712+0000","last_unstale":"2024-06-04T16:23:17.888839+0000","last_undegraded":"2024-06-04T16:23:17.888839+0000","last_fullsized":"2024-06-04T16:23:17.888839+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:23:17.888685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:23:17.888685+0000","last_clean_scrub_stamp":"2024-06-04T16:23:17.888685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T00:03:32.023669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"254'74","reported_seq":595,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:36.563755+0000","last_change":"2024-06-04T16:23:36.563792+0000","last_active":"2024-06-04T16:23:36.563755+0000","last_peered":"2024-06-04T16:23:36.563755+0000","last_clean":"2024-06-04T16:23:36.563755+0000","last_became_active":"2024-06-04T15:52:22.428356+0000","last_became_peered":"2024-06-04T15:52:22.428356+0000","last_unstale":"2024-06-04T16:23:36.563755+0000","last_undegraded":"2024-06-04T16:23:36.563755+0000","last_fullsized":"2024-06-04T16:23:36.563755+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'74","last_scrub_stamp":"2024-06-04T16:23:36.563665+0000","last_deep_scrub":"254'74","last_deep_scrub_stamp":"2024-06-04T16:23:36.563665+0000","last_clean_scrub_stamp":"2024-06-04T16:23:36.563665+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T17:34:14.987751+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"254'72","reported_seq":589,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:15.095374+0000","last_change":"2024-06-04T16:23:15.095428+0000","last_active":"2024-06-04T16:23:15.095374+0000","last_peered":"2024-06-04T16:23:15.095374+0000","last_clean":"2024-06-04T16:23:15.095374+0000","last_became_active":"2024-06-04T15:52:36.488567+0000","last_became_peered":"2024-06-04T15:52:36.488567+0000","last_unstale":"2024-06-04T16:23:15.095374+0000","last_undegraded":"2024-06-04T16:23:15.095374+0000","last_fullsized":"2024-06-04T16:23:15.095374+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'72","last_scrub_stamp":"2024-06-04T16:23:15.095275+0000","last_deep_scrub":"254'72","last_deep_scrub_stamp":"2024-06-04T16:23:15.095275+0000","last_clean_scrub_stamp":"2024-06-04T16:23:15.095275+0000","objects_scrubbed":5,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T20:29:53.277016+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133705,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":100,"num_read_kb":15171,"num_write":323,"num_write_kb":30782,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,4],"acting":[6,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":484,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:44.650735+0000","last_change":"2024-06-04T16:23:44.650760+0000","last_active":"2024-06-04T16:23:44.650735+0000","last_peered":"2024-06-04T16:23:44.650735+0000","last_clean":"2024-06-04T16:23:44.650735+0000","last_became_active":"2024-06-04T15:52:40.479168+0000","last_became_peered":"2024-06-04T15:52:40.479168+0000","last_unstale":"2024-06-04T16:23:44.650735+0000","last_undegraded":"2024-06-04T16:23:44.650735+0000","last_fullsized":"2024-06-04T16:23:44.650735+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:23:44.650641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:23:44.650641+0000","last_clean_scrub_stamp":"2024-06-04T16:23:44.650641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T20:28:38.926971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"254'567","reported_seq":1753,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:06.058305+0000","last_change":"2024-06-04T16:23:06.058359+0000","last_active":"2024-06-04T16:23:06.058305+0000","last_peered":"2024-06-04T16:23:06.058305+0000","last_clean":"2024-06-04T16:23:06.058305+0000","last_became_active":"2024-06-04T15:52:42.503178+0000","last_became_peered":"2024-06-04T15:52:42.503178+0000","last_unstale":"2024-06-04T16:23:06.058305+0000","last_undegraded":"2024-06-04T16:23:06.058305+0000","last_fullsized":"2024-06-04T16:23:06.058305+0000","mapping_epoch":27,"log_start":"251'500","ondisk_log_start":"251'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'567","last_scrub_stamp":"2024-06-04T16:23:06.058220+0000","last_deep_scrub":"254'567","last_deep_scrub_stamp":"2024-06-04T16:23:06.058220+0000","last_clean_scrub_stamp":"2024-06-04T16:23:06.058220+0000","objects_scrubbed":11,"log_size":67,"log_dups_size":500,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T22:58:35.190155+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29662,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":838,"num_read_kb":1049,"num_write":188,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":300,"num_omap_keys":2,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":476,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:01.876753+0000","last_change":"2024-06-04T16:23:01.876775+0000","last_active":"2024-06-04T16:23:01.876753+0000","last_peered":"2024-06-04T16:23:01.876753+0000","last_clean":"2024-06-04T16:23:01.876753+0000","last_became_active":"2024-06-04T15:52:44.522475+0000","last_became_peered":"2024-06-04T15:52:44.522475+0000","last_unstale":"2024-06-04T16:23:01.876753+0000","last_undegraded":"2024-06-04T16:23:01.876753+0000","last_fullsized":"2024-06-04T16:23:01.876753+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:23:01.876659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:23:01.876659+0000","last_clean_scrub_stamp":"2024-06-04T16:23:01.876659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T18:04:59.431933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"254'73","reported_seq":568,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:59.496703+0000","last_change":"2024-06-04T16:22:59.496703+0000","last_active":"2024-06-04T16:22:59.496703+0000","last_peered":"2024-06-04T16:22:59.496703+0000","last_clean":"2024-06-04T16:22:59.496703+0000","last_became_active":"2024-06-04T15:52:46.541851+0000","last_became_peered":"2024-06-04T15:52:46.541851+0000","last_unstale":"2024-06-04T16:22:59.496703+0000","last_undegraded":"2024-06-04T16:22:59.496703+0000","last_fullsized":"2024-06-04T16:22:59.496703+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'73","last_scrub_stamp":"2024-06-04T16:22:59.496568+0000","last_deep_scrub":"254'73","last_deep_scrub_stamp":"2024-06-04T16:22:59.496568+0000","last_clean_scrub_stamp":"2024-06-04T16:22:59.496568+0000","objects_scrubbed":2,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T03:49:46.316753+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":147,"num_read_kb":147,"num_write":159,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1","version":"254'115","reported_seq":821,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:02.473712+0000","last_change":"2024-06-04T16:23:02.473738+0000","last_active":"2024-06-04T16:23:02.473712+0000","last_peered":"2024-06-04T16:23:02.473712+0000","last_clean":"2024-06-04T16:23:02.473712+0000","last_became_active":"2024-06-04T15:52:38.485314+0000","last_became_peered":"2024-06-04T15:52:38.485314+0000","last_unstale":"2024-06-04T16:23:02.473712+0000","last_undegraded":"2024-06-04T16:23:02.473712+0000","last_fullsized":"2024-06-04T16:23:02.473712+0000","mapping_epoch":23,"log_start":"251'100","ondisk_log_start":"251'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'115","last_scrub_stamp":"2024-06-04T16:23:02.473618+0000","last_deep_scrub":"254'115","last_deep_scrub_stamp":"2024-06-04T16:23:02.473618+0000","last_clean_scrub_stamp":"2024-06-04T16:23:02.473618+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":100,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T21:11:06.521739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":554,"num_read_kb":505,"num_write":149,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"251'78","reported_seq":597,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:20.783370+0000","last_change":"2024-06-04T16:23:20.783456+0000","last_active":"2024-06-04T16:23:20.783370+0000","last_peered":"2024-06-04T16:23:20.783370+0000","last_clean":"2024-06-04T16:23:20.783370+0000","last_became_active":"2024-06-04T15:52:36.478729+0000","last_became_peered":"2024-06-04T15:52:36.478729+0000","last_unstale":"2024-06-04T16:23:20.783370+0000","last_undegraded":"2024-06-04T16:23:20.783370+0000","last_fullsized":"2024-06-04T16:23:20.783370+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"251'78","last_scrub_stamp":"2024-06-04T16:23:20.783257+0000","last_deep_scrub":"251'78","last_deep_scrub_stamp":"2024-06-04T16:23:20.783257+0000","last_clean_scrub_stamp":"2024-06-04T16:23:20.783257+0000","objects_scrubbed":7,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T22:56:09.007093+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6659325,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":108,"num_read_kb":2222,"num_write":295,"num_write_kb":32111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,1],"acting":[4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":504,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:21.932637+0000","last_change":"2024-06-04T16:23:21.932637+0000","last_active":"2024-06-04T16:23:21.932637+0000","last_peered":"2024-06-04T16:23:21.932637+0000","last_clean":"2024-06-04T16:23:21.932637+0000","last_became_active":"2024-06-04T15:52:22.428894+0000","last_became_peered":"2024-06-04T15:52:22.428894+0000","last_unstale":"2024-06-04T16:23:21.932637+0000","last_undegraded":"2024-06-04T16:23:21.932637+0000","last_fullsized":"2024-06-04T16:23:21.932637+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:23:21.932495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:23:21.932495+0000","last_clean_scrub_stamp":"2024-06-04T16:23:21.932495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T02:09:01.019445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":486,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:04.014754+0000","last_change":"2024-06-04T16:23:04.014781+0000","last_active":"2024-06-04T16:23:04.014754+0000","last_peered":"2024-06-04T16:23:04.014754+0000","last_clean":"2024-06-04T16:23:04.014754+0000","last_became_active":"2024-06-04T15:52:40.478970+0000","last_became_peered":"2024-06-04T15:52:40.478970+0000","last_unstale":"2024-06-04T16:23:04.014754+0000","last_undegraded":"2024-06-04T16:23:04.014754+0000","last_fullsized":"2024-06-04T16:23:04.014754+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:23:04.014648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:23:04.014648+0000","last_clean_scrub_stamp":"2024-06-04T16:23:04.014648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T00:47:22.385623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"254'260","reported_seq":953,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:59.781740+0000","last_change":"2024-06-04T16:22:59.781790+0000","last_active":"2024-06-04T16:22:59.781740+0000","last_peered":"2024-06-04T16:22:59.781740+0000","last_clean":"2024-06-04T16:22:59.781740+0000","last_became_active":"2024-06-04T15:52:42.504735+0000","last_became_peered":"2024-06-04T15:52:42.504735+0000","last_unstale":"2024-06-04T16:22:59.781740+0000","last_undegraded":"2024-06-04T16:22:59.781740+0000","last_fullsized":"2024-06-04T16:22:59.781740+0000","mapping_epoch":27,"log_start":"251'200","ondisk_log_start":"251'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'260","last_scrub_stamp":"2024-06-04T16:22:59.781648+0000","last_deep_scrub":"254'260","last_deep_scrub_stamp":"2024-06-04T16:22:59.781648+0000","last_clean_scrub_stamp":"2024-06-04T16:22:59.781648+0000","objects_scrubbed":8,"log_size":60,"log_dups_size":200,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T20:43:24.750395+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20543,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":406,"num_read_kb":567,"num_write":188,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":477,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:50.024396+0000","last_change":"2024-06-04T16:22:50.024418+0000","last_active":"2024-06-04T16:22:50.024396+0000","last_peered":"2024-06-04T16:22:50.024396+0000","last_clean":"2024-06-04T16:22:50.024396+0000","last_became_active":"2024-06-04T15:52:44.522746+0000","last_became_peered":"2024-06-04T15:52:44.522746+0000","last_unstale":"2024-06-04T16:22:50.024396+0000","last_undegraded":"2024-06-04T16:22:50.024396+0000","last_fullsized":"2024-06-04T16:22:50.024396+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:22:50.024298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:22:50.024298+0000","last_clean_scrub_stamp":"2024-06-04T16:22:50.024298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T19:45:37.463155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.d","version":"254'30","reported_seq":511,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:56.543517+0000","last_change":"2024-06-04T16:22:56.543557+0000","last_active":"2024-06-04T16:22:56.543517+0000","last_peered":"2024-06-04T16:22:56.543517+0000","last_clean":"2024-06-04T16:22:56.543517+0000","last_became_active":"2024-06-04T15:52:46.530480+0000","last_became_peered":"2024-06-04T15:52:46.530480+0000","last_unstale":"2024-06-04T16:22:56.543517+0000","last_undegraded":"2024-06-04T16:22:56.543517+0000","last_fullsized":"2024-06-04T16:22:56.543517+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'30","last_scrub_stamp":"2024-06-04T16:22:56.543418+0000","last_deep_scrub":"254'30","last_deep_scrub_stamp":"2024-06-04T16:22:56.543418+0000","last_clean_scrub_stamp":"2024-06-04T16:22:56.543418+0000","objects_scrubbed":4,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T22:30:49.547884+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":260,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":42,"num_read_kb":31,"num_write":58,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"254'175","reported_seq":1014,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:07.031511+0000","last_change":"2024-06-04T16:23:07.031557+0000","last_active":"2024-06-04T16:23:07.031511+0000","last_peered":"2024-06-04T16:23:07.031511+0000","last_clean":"2024-06-04T16:23:07.031511+0000","last_became_active":"2024-06-04T15:52:38.484384+0000","last_became_peered":"2024-06-04T15:52:38.484384+0000","last_unstale":"2024-06-04T16:23:07.031511+0000","last_undegraded":"2024-06-04T16:23:07.031511+0000","last_fullsized":"2024-06-04T16:23:07.031511+0000","mapping_epoch":23,"log_start":"251'100","ondisk_log_start":"251'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'175","last_scrub_stamp":"2024-06-04T16:23:07.031386+0000","last_deep_scrub":"254'175","last_deep_scrub_stamp":"2024-06-04T16:23:07.031386+0000","last_clean_scrub_stamp":"2024-06-04T16:23:07.031386+0000","objects_scrubbed":2,"log_size":75,"log_dups_size":100,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T20:37:48.413121+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":881,"num_read_kb":808,"num_write":233,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"251'46","reported_seq":553,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:19.818127+0000","last_change":"2024-06-04T16:23:19.818176+0000","last_active":"2024-06-04T16:23:19.818127+0000","last_peered":"2024-06-04T16:23:19.818127+0000","last_clean":"2024-06-04T16:23:19.818127+0000","last_became_active":"2024-06-04T15:52:36.477622+0000","last_became_peered":"2024-06-04T15:52:36.477622+0000","last_unstale":"2024-06-04T16:23:19.818127+0000","last_undegraded":"2024-06-04T16:23:19.818127+0000","last_fullsized":"2024-06-04T16:23:19.818127+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"251'46","last_scrub_stamp":"2024-06-04T16:23:19.818027+0000","last_deep_scrub":"251'46","last_deep_scrub_stamp":"2024-06-04T16:23:19.818027+0000","last_clean_scrub_stamp":"2024-06-04T16:23:19.818027+0000","objects_scrubbed":2,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T01:44:44.151511+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":45,"num_write":152,"num_write_kb":28742,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":502,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:13.531852+0000","last_change":"2024-06-04T16:23:13.531852+0000","last_active":"2024-06-04T16:23:13.531852+0000","last_peered":"2024-06-04T16:23:13.531852+0000","last_clean":"2024-06-04T16:23:13.531852+0000","last_became_active":"2024-06-04T15:52:22.776744+0000","last_became_peered":"2024-06-04T15:52:22.776744+0000","last_unstale":"2024-06-04T16:23:13.531852+0000","last_undegraded":"2024-06-04T16:23:13.531852+0000","last_fullsized":"2024-06-04T16:23:13.531852+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:23:13.531727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:23:13.531727+0000","last_clean_scrub_stamp":"2024-06-04T16:23:13.531727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T02:54:14.681403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":484,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:17.764990+0000","last_change":"2024-06-04T16:23:17.765013+0000","last_active":"2024-06-04T16:23:17.764990+0000","last_peered":"2024-06-04T16:23:17.764990+0000","last_clean":"2024-06-04T16:23:17.764990+0000","last_became_active":"2024-06-04T15:52:40.479319+0000","last_became_peered":"2024-06-04T15:52:40.479319+0000","last_unstale":"2024-06-04T16:23:17.764990+0000","last_undegraded":"2024-06-04T16:23:17.764990+0000","last_fullsized":"2024-06-04T16:23:17.764990+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:23:17.764897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:23:17.764897+0000","last_clean_scrub_stamp":"2024-06-04T16:23:17.764897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T03:01:34.933351+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"254'71","reported_seq":581,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:08.851094+0000","last_change":"2024-06-04T16:23:08.851129+0000","last_active":"2024-06-04T16:23:08.851094+0000","last_peered":"2024-06-04T16:23:08.851094+0000","last_clean":"2024-06-04T16:23:08.851094+0000","last_became_active":"2024-06-04T15:52:42.500141+0000","last_became_peered":"2024-06-04T15:52:42.500141+0000","last_unstale":"2024-06-04T16:23:08.851094+0000","last_undegraded":"2024-06-04T16:23:08.851094+0000","last_fullsized":"2024-06-04T16:23:08.851094+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'71","last_scrub_stamp":"2024-06-04T16:23:08.851023+0000","last_deep_scrub":"254'71","last_deep_scrub_stamp":"2024-06-04T16:23:08.851023+0000","last_clean_scrub_stamp":"2024-06-04T16:23:08.851023+0000","objects_scrubbed":5,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T17:00:06.961504+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":90,"num_read_kb":83,"num_write":60,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"254'479","reported_seq":1483,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:09.402056+0000","last_change":"2024-06-04T16:23:09.402109+0000","last_active":"2024-06-04T16:23:09.402056+0000","last_peered":"2024-06-04T16:23:09.402056+0000","last_clean":"2024-06-04T16:23:09.402056+0000","last_became_active":"2024-06-04T15:52:44.517202+0000","last_became_peered":"2024-06-04T15:52:44.517202+0000","last_unstale":"2024-06-04T16:23:09.402056+0000","last_undegraded":"2024-06-04T16:23:09.402056+0000","last_fullsized":"2024-06-04T16:23:09.402056+0000","mapping_epoch":29,"log_start":"251'400","ondisk_log_start":"251'400","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'479","last_scrub_stamp":"2024-06-04T16:23:09.401953+0000","last_deep_scrub":"254'479","last_deep_scrub_stamp":"2024-06-04T16:23:09.401953+0000","last_clean_scrub_stamp":"2024-06-04T16:23:09.401953+0000","objects_scrubbed":1,"log_size":79,"log_dups_size":400,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T02:11:03.216134+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.c","version":"254'27","reported_seq":504,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:01.472577+0000","last_change":"2024-06-04T16:23:01.472605+0000","last_active":"2024-06-04T16:23:01.472577+0000","last_peered":"2024-06-04T16:23:01.472577+0000","last_clean":"2024-06-04T16:23:01.472577+0000","last_became_active":"2024-06-04T15:52:46.538975+0000","last_became_peered":"2024-06-04T15:52:46.538975+0000","last_unstale":"2024-06-04T16:23:01.472577+0000","last_undegraded":"2024-06-04T16:23:01.472577+0000","last_fullsized":"2024-06-04T16:23:01.472577+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'27","last_scrub_stamp":"2024-06-04T16:23:01.472476+0000","last_deep_scrub":"254'27","last_deep_scrub_stamp":"2024-06-04T16:23:01.472476+0000","last_clean_scrub_stamp":"2024-06-04T16:23:01.472476+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T19:18:35.432866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":27,"num_write":64,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3","version":"254'180","reported_seq":1075,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:05.040707+0000","last_change":"2024-06-04T16:23:05.040749+0000","last_active":"2024-06-04T16:23:05.040707+0000","last_peered":"2024-06-04T16:23:05.040707+0000","last_clean":"2024-06-04T16:23:05.040707+0000","last_became_active":"2024-06-04T15:52:38.482240+0000","last_became_peered":"2024-06-04T15:52:38.482240+0000","last_unstale":"2024-06-04T16:23:05.040707+0000","last_undegraded":"2024-06-04T16:23:05.040707+0000","last_fullsized":"2024-06-04T16:23:05.040707+0000","mapping_epoch":23,"log_start":"251'100","ondisk_log_start":"251'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'180","last_scrub_stamp":"2024-06-04T16:23:05.040592+0000","last_deep_scrub":"254'180","last_deep_scrub_stamp":"2024-06-04T16:23:05.040592+0000","last_clean_scrub_stamp":"2024-06-04T16:23:05.040592+0000","objects_scrubbed":1,"log_size":80,"log_dups_size":100,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T23:58:37.248398+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1045,"num_read_kb":968,"num_write":230,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2044,"num_omap_keys":8,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"251'34","reported_seq":533,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:12.049957+0000","last_change":"2024-06-04T16:23:12.049996+0000","last_active":"2024-06-04T16:23:12.049957+0000","last_peered":"2024-06-04T16:23:12.049957+0000","last_clean":"2024-06-04T16:23:12.049957+0000","last_became_active":"2024-06-04T15:52:36.478441+0000","last_became_peered":"2024-06-04T15:52:36.478441+0000","last_unstale":"2024-06-04T16:23:12.049957+0000","last_undegraded":"2024-06-04T16:23:12.049957+0000","last_fullsized":"2024-06-04T16:23:12.049957+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"251'34","last_scrub_stamp":"2024-06-04T16:23:12.049852+0000","last_deep_scrub":"251'34","last_deep_scrub_stamp":"2024-06-04T16:23:12.049852+0000","last_clean_scrub_stamp":"2024-06-04T16:23:12.049852+0000","objects_scrubbed":1,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T20:47:21.445706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":32,"num_read_kb":7500,"num_write":131,"num_write_kb":23723,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,4],"acting":[6,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":502,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:37.549399+0000","last_change":"2024-06-04T16:23:37.549444+0000","last_active":"2024-06-04T16:23:37.549399+0000","last_peered":"2024-06-04T16:23:37.549399+0000","last_clean":"2024-06-04T16:23:37.549399+0000","last_became_active":"2024-06-04T15:52:22.776729+0000","last_became_peered":"2024-06-04T15:52:22.776729+0000","last_unstale":"2024-06-04T16:23:37.549399+0000","last_undegraded":"2024-06-04T16:23:37.549399+0000","last_fullsized":"2024-06-04T16:23:37.549399+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:23:37.549289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:23:37.549289+0000","last_clean_scrub_stamp":"2024-06-04T16:23:37.549289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T22:30:21.936404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":487,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:49.871886+0000","last_change":"2024-06-04T16:22:49.871915+0000","last_active":"2024-06-04T16:22:49.871886+0000","last_peered":"2024-06-04T16:22:49.871886+0000","last_clean":"2024-06-04T16:22:49.871886+0000","last_became_active":"2024-06-04T15:52:40.481870+0000","last_became_peered":"2024-06-04T15:52:40.481870+0000","last_unstale":"2024-06-04T16:22:49.871886+0000","last_undegraded":"2024-06-04T16:22:49.871886+0000","last_fullsized":"2024-06-04T16:22:49.871886+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:22:49.871770+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:22:49.871770+0000","last_clean_scrub_stamp":"2024-06-04T16:22:49.871770+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T03:25:40.274941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"254'107","reported_seq":635,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:00.026044+0000","last_change":"2024-06-04T16:23:00.026083+0000","last_active":"2024-06-04T16:23:00.026044+0000","last_peered":"2024-06-04T16:23:00.026044+0000","last_clean":"2024-06-04T16:23:00.026044+0000","last_became_active":"2024-06-04T15:52:42.501708+0000","last_became_peered":"2024-06-04T15:52:42.501708+0000","last_unstale":"2024-06-04T16:23:00.026044+0000","last_undegraded":"2024-06-04T16:23:00.026044+0000","last_fullsized":"2024-06-04T16:23:00.026044+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'107","last_scrub_stamp":"2024-06-04T16:23:00.025948+0000","last_deep_scrub":"254'107","last_deep_scrub_stamp":"2024-06-04T16:23:00.025948+0000","last_clean_scrub_stamp":"2024-06-04T16:23:00.025948+0000","objects_scrubbed":8,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T18:12:41.006932+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":147,"num_read_kb":140,"num_write":98,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":330,"num_omap_keys":2,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.0","version":"254'471","reported_seq":1659,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:22.395221+0000","last_change":"2024-06-04T16:23:22.395256+0000","last_active":"2024-06-04T16:23:22.395221+0000","last_peered":"2024-06-04T16:23:22.395221+0000","last_clean":"2024-06-04T16:23:22.395221+0000","last_became_active":"2024-06-04T15:52:44.517066+0000","last_became_peered":"2024-06-04T15:52:44.517066+0000","last_unstale":"2024-06-04T16:23:22.395221+0000","last_undegraded":"2024-06-04T16:23:22.395221+0000","last_fullsized":"2024-06-04T16:23:22.395221+0000","mapping_epoch":29,"log_start":"251'400","ondisk_log_start":"251'400","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'471","last_scrub_stamp":"2024-06-04T16:23:22.395095+0000","last_deep_scrub":"254'471","last_deep_scrub_stamp":"2024-06-04T16:23:22.395095+0000","last_clean_scrub_stamp":"2024-06-04T16:23:22.395095+0000","objects_scrubbed":1,"log_size":71,"log_dups_size":400,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T02:14:58.949166+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"254'29","reported_seq":504,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:17.959292+0000","last_change":"2024-06-04T16:23:17.959328+0000","last_active":"2024-06-04T16:23:17.959292+0000","last_peered":"2024-06-04T16:23:17.959292+0000","last_clean":"2024-06-04T16:23:17.959292+0000","last_became_active":"2024-06-04T15:52:46.531967+0000","last_became_peered":"2024-06-04T15:52:46.531967+0000","last_unstale":"2024-06-04T16:23:17.959292+0000","last_undegraded":"2024-06-04T16:23:17.959292+0000","last_fullsized":"2024-06-04T16:23:17.959292+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'29","last_scrub_stamp":"2024-06-04T16:23:17.959201+0000","last_deep_scrub":"254'29","last_deep_scrub_stamp":"2024-06-04T16:23:17.959201+0000","last_clean_scrub_stamp":"2024-06-04T16:23:17.959201+0000","objects_scrubbed":2,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T21:13:41.813947+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":905,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":28,"num_read_kb":26,"num_write":64,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2","version":"254'131","reported_seq":939,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:11.028265+0000","last_change":"2024-06-04T16:23:11.028292+0000","last_active":"2024-06-04T16:23:11.028265+0000","last_peered":"2024-06-04T16:23:11.028265+0000","last_clean":"2024-06-04T16:23:11.028265+0000","last_became_active":"2024-06-04T15:52:38.480942+0000","last_became_peered":"2024-06-04T15:52:38.480942+0000","last_unstale":"2024-06-04T16:23:11.028265+0000","last_undegraded":"2024-06-04T16:23:11.028265+0000","last_fullsized":"2024-06-04T16:23:11.028265+0000","mapping_epoch":23,"log_start":"251'100","ondisk_log_start":"251'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'131","last_scrub_stamp":"2024-06-04T16:23:11.028175+0000","last_deep_scrub":"254'131","last_deep_scrub_stamp":"2024-06-04T16:23:11.028175+0000","last_clean_scrub_stamp":"2024-06-04T16:23:11.028175+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T16:52:05.710781+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":705,"num_read_kb":672,"num_write":147,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"251'54","reported_seq":568,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:17.647698+0000","last_change":"2024-06-04T16:23:17.647777+0000","last_active":"2024-06-04T16:23:17.647698+0000","last_peered":"2024-06-04T16:23:17.647698+0000","last_clean":"2024-06-04T16:23:17.647698+0000","last_became_active":"2024-06-04T15:52:36.480469+0000","last_became_peered":"2024-06-04T15:52:36.480469+0000","last_unstale":"2024-06-04T16:23:17.647698+0000","last_undegraded":"2024-06-04T16:23:17.647698+0000","last_fullsized":"2024-06-04T16:23:17.647698+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"251'54","last_scrub_stamp":"2024-06-04T16:23:17.647552+0000","last_deep_scrub":"251'54","last_deep_scrub_stamp":"2024-06-04T16:23:17.647552+0000","last_clean_scrub_stamp":"2024-06-04T16:23:17.647552+0000","objects_scrubbed":4,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T21:56:03.180708+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":69,"num_read_kb":32811,"num_write":225,"num_write_kb":30438,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,4],"acting":[2,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":504,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:15.344159+0000","last_change":"2024-06-04T16:23:15.344203+0000","last_active":"2024-06-04T16:23:15.344159+0000","last_peered":"2024-06-04T16:23:15.344159+0000","last_clean":"2024-06-04T16:23:15.344159+0000","last_became_active":"2024-06-04T15:52:22.776723+0000","last_became_peered":"2024-06-04T15:52:22.776723+0000","last_unstale":"2024-06-04T16:23:15.344159+0000","last_undegraded":"2024-06-04T16:23:15.344159+0000","last_fullsized":"2024-06-04T16:23:15.344159+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:23:15.344049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:23:15.344049+0000","last_clean_scrub_stamp":"2024-06-04T16:23:15.344049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T01:59:22.762947+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":485,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:12.004707+0000","last_change":"2024-06-04T16:23:12.004747+0000","last_active":"2024-06-04T16:23:12.004707+0000","last_peered":"2024-06-04T16:23:12.004707+0000","last_clean":"2024-06-04T16:23:12.004707+0000","last_became_active":"2024-06-04T15:52:40.483802+0000","last_became_peered":"2024-06-04T15:52:40.483802+0000","last_unstale":"2024-06-04T16:23:12.004707+0000","last_undegraded":"2024-06-04T16:23:12.004707+0000","last_fullsized":"2024-06-04T16:23:12.004707+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:23:12.004597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:23:12.004597+0000","last_clean_scrub_stamp":"2024-06-04T16:23:12.004597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T18:00:54.931037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"254'207","reported_seq":842,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:07.012392+0000","last_change":"2024-06-04T16:23:07.012433+0000","last_active":"2024-06-04T16:23:07.012392+0000","last_peered":"2024-06-04T16:23:07.012392+0000","last_clean":"2024-06-04T16:23:07.012392+0000","last_became_active":"2024-06-04T15:52:42.499002+0000","last_became_peered":"2024-06-04T15:52:42.499002+0000","last_unstale":"2024-06-04T16:23:07.012392+0000","last_undegraded":"2024-06-04T16:23:07.012392+0000","last_fullsized":"2024-06-04T16:23:07.012392+0000","mapping_epoch":27,"log_start":"251'100","ondisk_log_start":"251'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'207","last_scrub_stamp":"2024-06-04T16:23:07.012304+0000","last_deep_scrub":"254'207","last_deep_scrub_stamp":"2024-06-04T16:23:07.012304+0000","last_clean_scrub_stamp":"2024-06-04T16:23:07.012304+0000","objects_scrubbed":8,"log_size":107,"log_dups_size":100,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T19:16:17.106023+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20869,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":311,"num_read_kb":405,"num_write":154,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":475,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:11.557012+0000","last_change":"2024-06-04T16:23:11.557058+0000","last_active":"2024-06-04T16:23:11.557012+0000","last_peered":"2024-06-04T16:23:11.557012+0000","last_clean":"2024-06-04T16:23:11.557012+0000","last_became_active":"2024-06-04T15:52:44.520499+0000","last_became_peered":"2024-06-04T15:52:44.520499+0000","last_unstale":"2024-06-04T16:23:11.557012+0000","last_undegraded":"2024-06-04T16:23:11.557012+0000","last_fullsized":"2024-06-04T16:23:11.557012+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:23:11.556903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:23:11.556903+0000","last_clean_scrub_stamp":"2024-06-04T16:23:11.556903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T18:43:13.942573+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"254'25","reported_seq":507,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:56.551415+0000","last_change":"2024-06-04T16:22:56.551443+0000","last_active":"2024-06-04T16:22:56.551415+0000","last_peered":"2024-06-04T16:22:56.551415+0000","last_clean":"2024-06-04T16:22:56.551415+0000","last_became_active":"2024-06-04T15:52:46.541768+0000","last_became_peered":"2024-06-04T15:52:46.541768+0000","last_unstale":"2024-06-04T16:22:56.551415+0000","last_undegraded":"2024-06-04T16:22:56.551415+0000","last_fullsized":"2024-06-04T16:22:56.551415+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'25","last_scrub_stamp":"2024-06-04T16:22:56.551310+0000","last_deep_scrub":"254'25","last_deep_scrub_stamp":"2024-06-04T16:22:56.551310+0000","last_clean_scrub_stamp":"2024-06-04T16:22:56.551310+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T20:49:59.699028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":34,"num_write":60,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"254'25","reported_seq":499,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:46.017545+0000","last_change":"2024-06-04T16:22:46.017610+0000","last_active":"2024-06-04T16:22:46.017545+0000","last_peered":"2024-06-04T16:22:46.017545+0000","last_clean":"2024-06-04T16:22:46.017545+0000","last_became_active":"2024-06-04T15:52:46.540733+0000","last_became_peered":"2024-06-04T15:52:46.540733+0000","last_unstale":"2024-06-04T16:22:46.017545+0000","last_undegraded":"2024-06-04T16:22:46.017545+0000","last_fullsized":"2024-06-04T16:22:46.017545+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'25","last_scrub_stamp":"2024-06-04T16:22:46.017439+0000","last_deep_scrub":"254'25","last_deep_scrub_stamp":"2024-06-04T16:22:46.017439+0000","last_clean_scrub_stamp":"2024-06-04T16:22:46.017439+0000","objects_scrubbed":1,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T04:03:05.233942+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":53,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"254'152","reported_seq":927,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:10.521391+0000","last_change":"2024-06-04T16:23:10.521419+0000","last_active":"2024-06-04T16:23:10.521391+0000","last_peered":"2024-06-04T16:23:10.521391+0000","last_clean":"2024-06-04T16:23:10.521391+0000","last_became_active":"2024-06-04T15:52:38.479929+0000","last_became_peered":"2024-06-04T15:52:38.479929+0000","last_unstale":"2024-06-04T16:23:10.521391+0000","last_undegraded":"2024-06-04T16:23:10.521391+0000","last_fullsized":"2024-06-04T16:23:10.521391+0000","mapping_epoch":23,"log_start":"251'100","ondisk_log_start":"251'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'152","last_scrub_stamp":"2024-06-04T16:23:10.521305+0000","last_deep_scrub":"254'152","last_deep_scrub_stamp":"2024-06-04T16:23:10.521305+0000","last_clean_scrub_stamp":"2024-06-04T16:23:10.521305+0000","objects_scrubbed":1,"log_size":52,"log_dups_size":100,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T19:41:35.254224+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":770,"num_read_kb":699,"num_write":204,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"251'34","reported_seq":555,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:31.702584+0000","last_change":"2024-06-04T16:23:31.702627+0000","last_active":"2024-06-04T16:23:31.702584+0000","last_peered":"2024-06-04T16:23:31.702584+0000","last_clean":"2024-06-04T16:23:31.702584+0000","last_became_active":"2024-06-04T15:52:36.497532+0000","last_became_peered":"2024-06-04T15:52:36.497532+0000","last_unstale":"2024-06-04T16:23:31.702584+0000","last_undegraded":"2024-06-04T16:23:31.702584+0000","last_fullsized":"2024-06-04T16:23:31.702584+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"251'34","last_scrub_stamp":"2024-06-04T16:23:31.702486+0000","last_deep_scrub":"251'34","last_deep_scrub_stamp":"2024-06-04T16:23:31.702486+0000","last_clean_scrub_stamp":"2024-06-04T16:23:31.702486+0000","objects_scrubbed":4,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T21:47:31.551548+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":54,"num_read_kb":42110,"num_write":160,"num_write_kb":16147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":480,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:57.091636+0000","last_change":"2024-06-04T16:22:57.091636+0000","last_active":"2024-06-04T16:22:57.091636+0000","last_peered":"2024-06-04T16:22:57.091636+0000","last_clean":"2024-06-04T16:22:57.091636+0000","last_became_active":"2024-06-04T15:52:40.483882+0000","last_became_peered":"2024-06-04T15:52:40.483882+0000","last_unstale":"2024-06-04T16:22:57.091636+0000","last_undegraded":"2024-06-04T16:22:57.091636+0000","last_fullsized":"2024-06-04T16:22:57.091636+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:22:57.091516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:22:57.091516+0000","last_clean_scrub_stamp":"2024-06-04T16:22:57.091516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T21:23:38.905655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.11","version":"254'100","reported_seq":648,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:08.013627+0000","last_change":"2024-06-04T16:23:08.013676+0000","last_active":"2024-06-04T16:23:08.013627+0000","last_peered":"2024-06-04T16:23:08.013627+0000","last_clean":"2024-06-04T16:23:08.013627+0000","last_became_active":"2024-06-04T15:52:42.504144+0000","last_became_peered":"2024-06-04T15:52:42.504144+0000","last_unstale":"2024-06-04T16:23:08.013627+0000","last_undegraded":"2024-06-04T16:23:08.013627+0000","last_fullsized":"2024-06-04T16:23:08.013627+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'100","last_scrub_stamp":"2024-06-04T16:23:08.013535+0000","last_deep_scrub":"254'100","last_deep_scrub_stamp":"2024-06-04T16:23:08.013535+0000","last_clean_scrub_stamp":"2024-06-04T16:23:08.013535+0000","objects_scrubbed":5,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T23:33:08.492272+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13519,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":145,"num_read_kb":205,"num_write":70,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":476,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:08.030159+0000","last_change":"2024-06-04T16:23:08.030181+0000","last_active":"2024-06-04T16:23:08.030159+0000","last_peered":"2024-06-04T16:23:08.030159+0000","last_clean":"2024-06-04T16:23:08.030159+0000","last_became_active":"2024-06-04T15:52:44.517718+0000","last_became_peered":"2024-06-04T15:52:44.517718+0000","last_unstale":"2024-06-04T16:23:08.030159+0000","last_undegraded":"2024-06-04T16:23:08.030159+0000","last_fullsized":"2024-06-04T16:23:08.030159+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:23:08.030076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:23:08.030076+0000","last_clean_scrub_stamp":"2024-06-04T16:23:08.030076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T00:47:56.220482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1e","version":"254'42","reported_seq":521,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:29.974225+0000","last_change":"2024-06-04T16:23:29.974251+0000","last_active":"2024-06-04T16:23:29.974225+0000","last_peered":"2024-06-04T16:23:29.974225+0000","last_clean":"2024-06-04T16:23:29.974225+0000","last_became_active":"2024-06-04T15:52:46.536917+0000","last_became_peered":"2024-06-04T15:52:46.536917+0000","last_unstale":"2024-06-04T16:23:29.974225+0000","last_undegraded":"2024-06-04T16:23:29.974225+0000","last_fullsized":"2024-06-04T16:23:29.974225+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'42","last_scrub_stamp":"2024-06-04T16:23:29.974130+0000","last_deep_scrub":"254'42","last_deep_scrub_stamp":"2024-06-04T16:23:29.974130+0000","last_clean_scrub_stamp":"2024-06-04T16:23:29.974130+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T17:46:26.069290+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":42,"num_write":101,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"254'152","reported_seq":994,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:02.977888+0000","last_change":"2024-06-04T16:23:02.977952+0000","last_active":"2024-06-04T16:23:02.977888+0000","last_peered":"2024-06-04T16:23:02.977888+0000","last_clean":"2024-06-04T16:23:02.977888+0000","last_became_active":"2024-06-04T15:52:38.488159+0000","last_became_peered":"2024-06-04T15:52:38.488159+0000","last_unstale":"2024-06-04T16:23:02.977888+0000","last_undegraded":"2024-06-04T16:23:02.977888+0000","last_fullsized":"2024-06-04T16:23:02.977888+0000","mapping_epoch":23,"log_start":"251'100","ondisk_log_start":"251'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'152","last_scrub_stamp":"2024-06-04T16:23:02.977774+0000","last_deep_scrub":"254'152","last_deep_scrub_stamp":"2024-06-04T16:23:02.977774+0000","last_clean_scrub_stamp":"2024-06-04T16:23:02.977774+0000","objects_scrubbed":1,"log_size":52,"log_dups_size":100,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T04:09:24.513394+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":952,"num_read_kb":891,"num_write":194,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.15","version":"251'69","reported_seq":612,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:08.764588+0000","last_change":"2024-06-04T16:23:08.764663+0000","last_active":"2024-06-04T16:23:08.764588+0000","last_peered":"2024-06-04T16:23:08.764588+0000","last_clean":"2024-06-04T16:23:08.764588+0000","last_became_active":"2024-06-04T15:52:36.492503+0000","last_became_peered":"2024-06-04T15:52:36.492503+0000","last_unstale":"2024-06-04T16:23:08.764588+0000","last_undegraded":"2024-06-04T16:23:08.764588+0000","last_fullsized":"2024-06-04T16:23:08.764588+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"251'69","last_scrub_stamp":"2024-06-04T16:23:08.764479+0000","last_deep_scrub":"251'69","last_deep_scrub_stamp":"2024-06-04T16:23:08.764479+0000","last_clean_scrub_stamp":"2024-06-04T16:23:08.764479+0000","objects_scrubbed":6,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T20:05:58.412567+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":528536,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":128,"num_read_kb":6583,"num_write":319,"num_write_kb":16503,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,3],"acting":[0,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":484,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:13.965080+0000","last_change":"2024-06-04T16:23:13.965111+0000","last_active":"2024-06-04T16:23:13.965080+0000","last_peered":"2024-06-04T16:23:13.965080+0000","last_clean":"2024-06-04T16:23:13.965080+0000","last_became_active":"2024-06-04T15:52:40.484480+0000","last_became_peered":"2024-06-04T15:52:40.484480+0000","last_unstale":"2024-06-04T16:23:13.965080+0000","last_undegraded":"2024-06-04T16:23:13.965080+0000","last_fullsized":"2024-06-04T16:23:13.965080+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:23:13.964982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:23:13.964982+0000","last_clean_scrub_stamp":"2024-06-04T16:23:13.964982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T04:13:27.946132+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"254'21","reported_seq":507,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:01.000179+0000","last_change":"2024-06-04T16:23:01.000179+0000","last_active":"2024-06-04T16:23:01.000179+0000","last_peered":"2024-06-04T16:23:01.000179+0000","last_clean":"2024-06-04T16:23:01.000179+0000","last_became_active":"2024-06-04T15:52:42.499592+0000","last_became_peered":"2024-06-04T15:52:42.499592+0000","last_unstale":"2024-06-04T16:23:01.000179+0000","last_undegraded":"2024-06-04T16:23:01.000179+0000","last_fullsized":"2024-06-04T16:23:01.000179+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'21","last_scrub_stamp":"2024-06-04T16:23:01.000012+0000","last_deep_scrub":"254'21","last_deep_scrub_stamp":"2024-06-04T16:23:01.000012+0000","last_clean_scrub_stamp":"2024-06-04T16:23:01.000012+0000","objects_scrubbed":3,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T22:14:20.665186+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":19,"num_read_kb":17,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":294,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":474,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:09.485359+0000","last_change":"2024-06-04T16:23:09.485380+0000","last_active":"2024-06-04T16:23:09.485359+0000","last_peered":"2024-06-04T16:23:09.485359+0000","last_clean":"2024-06-04T16:23:09.485359+0000","last_became_active":"2024-06-04T15:52:44.519102+0000","last_became_peered":"2024-06-04T15:52:44.519102+0000","last_unstale":"2024-06-04T16:23:09.485359+0000","last_undegraded":"2024-06-04T16:23:09.485359+0000","last_fullsized":"2024-06-04T16:23:09.485359+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:23:09.485273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:23:09.485273+0000","last_clean_scrub_stamp":"2024-06-04T16:23:09.485273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T20:50:18.009284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"254'24","reported_seq":500,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:55.110607+0000","last_change":"2024-06-04T16:22:55.110633+0000","last_active":"2024-06-04T16:22:55.110607+0000","last_peered":"2024-06-04T16:22:55.110607+0000","last_clean":"2024-06-04T16:22:55.110607+0000","last_became_active":"2024-06-04T15:52:46.534277+0000","last_became_peered":"2024-06-04T15:52:46.534277+0000","last_unstale":"2024-06-04T16:22:55.110607+0000","last_undegraded":"2024-06-04T16:22:55.110607+0000","last_fullsized":"2024-06-04T16:22:55.110607+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'24","last_scrub_stamp":"2024-06-04T16:22:55.110517+0000","last_deep_scrub":"254'24","last_deep_scrub_stamp":"2024-06-04T16:22:55.110517+0000","last_clean_scrub_stamp":"2024-06-04T16:22:55.110517+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T18:12:16.411222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":38,"num_write":55,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"254'224","reported_seq":1048,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:12.970193+0000","last_change":"2024-06-04T16:23:12.970231+0000","last_active":"2024-06-04T16:23:12.970193+0000","last_peered":"2024-06-04T16:23:12.970193+0000","last_clean":"2024-06-04T16:23:12.970193+0000","last_became_active":"2024-06-04T15:52:38.481934+0000","last_became_peered":"2024-06-04T15:52:38.481934+0000","last_unstale":"2024-06-04T16:23:12.970193+0000","last_undegraded":"2024-06-04T16:23:12.970193+0000","last_fullsized":"2024-06-04T16:23:12.970193+0000","mapping_epoch":23,"log_start":"251'200","ondisk_log_start":"251'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'224","last_scrub_stamp":"2024-06-04T16:23:12.970097+0000","last_deep_scrub":"254'224","last_deep_scrub_stamp":"2024-06-04T16:23:12.970097+0000","last_clean_scrub_stamp":"2024-06-04T16:23:12.970097+0000","objects_scrubbed":3,"log_size":24,"log_dups_size":200,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T23:41:43.548804+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1128,"num_read_kb":983,"num_write":320,"num_write_kb":131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":811,"num_omap_keys":4,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.16","version":"251'39","reported_seq":537,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:16.624012+0000","last_change":"2024-06-04T16:23:16.624075+0000","last_active":"2024-06-04T16:23:16.624012+0000","last_peered":"2024-06-04T16:23:16.624012+0000","last_clean":"2024-06-04T16:23:16.624012+0000","last_became_active":"2024-06-04T15:52:36.480284+0000","last_became_peered":"2024-06-04T15:52:36.480284+0000","last_unstale":"2024-06-04T16:23:16.624012+0000","last_undegraded":"2024-06-04T16:23:16.624012+0000","last_fullsized":"2024-06-04T16:23:16.624012+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"251'39","last_scrub_stamp":"2024-06-04T16:23:16.623896+0000","last_deep_scrub":"251'39","last_deep_scrub_stamp":"2024-06-04T16:23:16.623896+0000","last_clean_scrub_stamp":"2024-06-04T16:23:16.623896+0000","objects_scrubbed":1,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T22:30:28.602372+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":37,"num_read_kb":1062,"num_write":155,"num_write_kb":20099,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4],"acting":[2,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":482,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:58.490367+0000","last_change":"2024-06-04T16:22:58.490367+0000","last_active":"2024-06-04T16:22:58.490367+0000","last_peered":"2024-06-04T16:22:58.490367+0000","last_clean":"2024-06-04T16:22:58.490367+0000","last_became_active":"2024-06-04T15:52:40.477609+0000","last_became_peered":"2024-06-04T15:52:40.477609+0000","last_unstale":"2024-06-04T16:22:58.490367+0000","last_undegraded":"2024-06-04T16:22:58.490367+0000","last_fullsized":"2024-06-04T16:22:58.490367+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:22:58.490254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:22:58.490254+0000","last_clean_scrub_stamp":"2024-06-04T16:22:58.490254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T03:58:39.460650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"254'137","reported_seq":704,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:09.075759+0000","last_change":"2024-06-04T16:23:09.075830+0000","last_active":"2024-06-04T16:23:09.075759+0000","last_peered":"2024-06-04T16:23:09.075759+0000","last_clean":"2024-06-04T16:23:09.075759+0000","last_became_active":"2024-06-04T15:52:42.496416+0000","last_became_peered":"2024-06-04T15:52:42.496416+0000","last_unstale":"2024-06-04T16:23:09.075759+0000","last_undegraded":"2024-06-04T16:23:09.075759+0000","last_fullsized":"2024-06-04T16:23:09.075759+0000","mapping_epoch":27,"log_start":"251'100","ondisk_log_start":"251'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'137","last_scrub_stamp":"2024-06-04T16:23:09.075655+0000","last_deep_scrub":"254'137","last_deep_scrub_stamp":"2024-06-04T16:23:09.075655+0000","last_clean_scrub_stamp":"2024-06-04T16:23:09.075655+0000","objects_scrubbed":5,"log_size":37,"log_dups_size":100,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T04:19:42.658569+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14747,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":196,"num_read_kb":272,"num_write":106,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":478,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:54.181551+0000","last_change":"2024-06-04T16:22:54.181551+0000","last_active":"2024-06-04T16:22:54.181551+0000","last_peered":"2024-06-04T16:22:54.181551+0000","last_clean":"2024-06-04T16:22:54.181551+0000","last_became_active":"2024-06-04T15:52:44.519837+0000","last_became_peered":"2024-06-04T15:52:44.519837+0000","last_unstale":"2024-06-04T16:22:54.181551+0000","last_undegraded":"2024-06-04T16:22:54.181551+0000","last_fullsized":"2024-06-04T16:22:54.181551+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:22:54.181389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:22:54.181389+0000","last_clean_scrub_stamp":"2024-06-04T16:22:54.181389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T19:26:26.634657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"254'18","reported_seq":489,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:48.034172+0000","last_change":"2024-06-04T16:22:48.034172+0000","last_active":"2024-06-04T16:22:48.034172+0000","last_peered":"2024-06-04T16:22:48.034172+0000","last_clean":"2024-06-04T16:22:48.034172+0000","last_became_active":"2024-06-04T15:52:46.529366+0000","last_became_peered":"2024-06-04T15:52:46.529366+0000","last_unstale":"2024-06-04T16:22:48.034172+0000","last_undegraded":"2024-06-04T16:22:48.034172+0000","last_fullsized":"2024-06-04T16:22:48.034172+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'18","last_scrub_stamp":"2024-06-04T16:22:48.034075+0000","last_deep_scrub":"254'18","last_deep_scrub_stamp":"2024-06-04T16:22:48.034075+0000","last_clean_scrub_stamp":"2024-06-04T16:22:48.034075+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T01:45:02.416352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":52,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"254'128","reported_seq":840,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:16.916618+0000","last_change":"2024-06-04T16:23:16.916659+0000","last_active":"2024-06-04T16:23:16.916618+0000","last_peered":"2024-06-04T16:23:16.916618+0000","last_clean":"2024-06-04T16:23:16.916618+0000","last_became_active":"2024-06-04T15:52:38.488622+0000","last_became_peered":"2024-06-04T15:52:38.488622+0000","last_unstale":"2024-06-04T16:23:16.916618+0000","last_undegraded":"2024-06-04T16:23:16.916618+0000","last_fullsized":"2024-06-04T16:23:16.916618+0000","mapping_epoch":23,"log_start":"251'100","ondisk_log_start":"251'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'128","last_scrub_stamp":"2024-06-04T16:23:16.916521+0000","last_deep_scrub":"254'128","last_deep_scrub_stamp":"2024-06-04T16:23:16.916521+0000","last_clean_scrub_stamp":"2024-06-04T16:23:16.916521+0000","objects_scrubbed":1,"log_size":28,"log_dups_size":100,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T03:05:56.416443+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":585,"num_read_kb":532,"num_write":156,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":248,"num_omap_keys":1,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"254'50","reported_seq":570,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:31.388564+0000","last_change":"2024-06-04T16:23:31.388610+0000","last_active":"2024-06-04T16:23:31.388564+0000","last_peered":"2024-06-04T16:23:31.388564+0000","last_clean":"2024-06-04T16:23:31.388564+0000","last_became_active":"2024-06-04T15:52:36.482733+0000","last_became_peered":"2024-06-04T15:52:36.482733+0000","last_unstale":"2024-06-04T16:23:31.388564+0000","last_undegraded":"2024-06-04T16:23:31.388564+0000","last_fullsized":"2024-06-04T16:23:31.388564+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'50","last_scrub_stamp":"2024-06-04T16:23:31.388461+0000","last_deep_scrub":"254'50","last_deep_scrub_stamp":"2024-06-04T16:23:31.388461+0000","last_clean_scrub_stamp":"2024-06-04T16:23:31.388461+0000","objects_scrubbed":4,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T18:10:59.353248+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133705,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":82,"num_read_kb":13463,"num_write":227,"num_write_kb":36279,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1],"acting":[5,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.11","version":"254'5","reported_seq":790,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:19.750795+0000","last_change":"2024-06-04T16:23:19.750825+0000","last_active":"2024-06-04T16:23:19.750795+0000","last_peered":"2024-06-04T16:23:19.750795+0000","last_clean":"2024-06-04T16:23:19.750795+0000","last_became_active":"2024-06-04T15:52:40.479002+0000","last_became_peered":"2024-06-04T15:52:40.479002+0000","last_unstale":"2024-06-04T16:23:19.750795+0000","last_undegraded":"2024-06-04T16:23:19.750795+0000","last_fullsized":"2024-06-04T16:23:19.750795+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'5","last_scrub_stamp":"2024-06-04T16:23:19.750708+0000","last_deep_scrub":"254'5","last_deep_scrub_stamp":"2024-06-04T16:23:19.750708+0000","last_clean_scrub_stamp":"2024-06-04T16:23:19.750708+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T18:35:30.453280+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":463,"num_read_kb":757,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"254'89","reported_seq":640,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:01.759191+0000","last_change":"2024-06-04T16:23:01.759191+0000","last_active":"2024-06-04T16:23:01.759191+0000","last_peered":"2024-06-04T16:23:01.759191+0000","last_clean":"2024-06-04T16:23:01.759191+0000","last_became_active":"2024-06-04T15:52:42.505955+0000","last_became_peered":"2024-06-04T15:52:42.505955+0000","last_unstale":"2024-06-04T16:23:01.759191+0000","last_undegraded":"2024-06-04T16:23:01.759191+0000","last_fullsized":"2024-06-04T16:23:01.759191+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'89","last_scrub_stamp":"2024-06-04T16:23:01.759061+0000","last_deep_scrub":"254'89","last_deep_scrub_stamp":"2024-06-04T16:23:01.759061+0000","last_clean_scrub_stamp":"2024-06-04T16:23:01.759061+0000","objects_scrubbed":4,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T18:04:48.914592+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":128,"num_read_kb":150,"num_write":58,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":476,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:15.906417+0000","last_change":"2024-06-04T16:23:15.906463+0000","last_active":"2024-06-04T16:23:15.906417+0000","last_peered":"2024-06-04T16:23:15.906417+0000","last_clean":"2024-06-04T16:23:15.906417+0000","last_became_active":"2024-06-04T15:52:44.519975+0000","last_became_peered":"2024-06-04T15:52:44.519975+0000","last_unstale":"2024-06-04T16:23:15.906417+0000","last_undegraded":"2024-06-04T16:23:15.906417+0000","last_fullsized":"2024-06-04T16:23:15.906417+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:23:15.906309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:23:15.906309+0000","last_clean_scrub_stamp":"2024-06-04T16:23:15.906309+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T02:21:45.561560+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1f","version":"254'95","reported_seq":784,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:32.666021+0000","last_change":"2024-06-04T16:23:32.666057+0000","last_active":"2024-06-04T16:23:32.666021+0000","last_peered":"2024-06-04T16:23:32.666021+0000","last_clean":"2024-06-04T16:23:32.666021+0000","last_became_active":"2024-06-04T15:52:38.485163+0000","last_became_peered":"2024-06-04T15:52:38.485163+0000","last_unstale":"2024-06-04T16:23:32.666021+0000","last_undegraded":"2024-06-04T16:23:32.666021+0000","last_fullsized":"2024-06-04T16:23:32.666021+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'95","last_scrub_stamp":"2024-06-04T16:23:32.665921+0000","last_deep_scrub":"254'95","last_deep_scrub_stamp":"2024-06-04T16:23:32.665921+0000","last_clean_scrub_stamp":"2024-06-04T16:23:32.665921+0000","objects_scrubbed":2,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T03:03:50.908050+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":477,"num_read_kb":443,"num_write":114,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":225,"num_omap_keys":1,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"254'35","reported_seq":546,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:35.353856+0000","last_change":"2024-06-04T16:23:35.353893+0000","last_active":"2024-06-04T16:23:35.353856+0000","last_peered":"2024-06-04T16:23:35.353856+0000","last_clean":"2024-06-04T16:23:35.353856+0000","last_became_active":"2024-06-04T15:52:36.490297+0000","last_became_peered":"2024-06-04T15:52:36.490297+0000","last_unstale":"2024-06-04T16:23:35.353856+0000","last_undegraded":"2024-06-04T16:23:35.353856+0000","last_fullsized":"2024-06-04T16:23:35.353856+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'35","last_scrub_stamp":"2024-06-04T16:23:35.353762+0000","last_deep_scrub":"254'35","last_deep_scrub_stamp":"2024-06-04T16:23:35.353762+0000","last_clean_scrub_stamp":"2024-06-04T16:23:35.353762+0000","objects_scrubbed":1,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T23:19:49.438892+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1069164,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":53,"num_read_kb":1061,"num_write":121,"num_write_kb":15390,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,3],"acting":[5,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":482,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:59.048325+0000","last_change":"2024-06-04T16:22:59.048348+0000","last_active":"2024-06-04T16:22:59.048325+0000","last_peered":"2024-06-04T16:22:59.048325+0000","last_clean":"2024-06-04T16:22:59.048325+0000","last_became_active":"2024-06-04T15:52:40.482962+0000","last_became_peered":"2024-06-04T15:52:40.482962+0000","last_unstale":"2024-06-04T16:22:59.048325+0000","last_undegraded":"2024-06-04T16:22:59.048325+0000","last_fullsized":"2024-06-04T16:22:59.048325+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:22:59.048237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:22:59.048237+0000","last_clean_scrub_stamp":"2024-06-04T16:22:59.048237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T21:58:02.126251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"254'153","reported_seq":757,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:06.055514+0000","last_change":"2024-06-04T16:23:06.055560+0000","last_active":"2024-06-04T16:23:06.055514+0000","last_peered":"2024-06-04T16:23:06.055514+0000","last_clean":"2024-06-04T16:23:06.055514+0000","last_became_active":"2024-06-04T15:52:42.503246+0000","last_became_peered":"2024-06-04T15:52:42.503246+0000","last_unstale":"2024-06-04T16:23:06.055514+0000","last_undegraded":"2024-06-04T16:23:06.055514+0000","last_fullsized":"2024-06-04T16:23:06.055514+0000","mapping_epoch":27,"log_start":"251'100","ondisk_log_start":"251'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'153","last_scrub_stamp":"2024-06-04T16:23:06.055439+0000","last_deep_scrub":"254'153","last_deep_scrub_stamp":"2024-06-04T16:23:06.055439+0000","last_clean_scrub_stamp":"2024-06-04T16:23:06.055439+0000","objects_scrubbed":5,"log_size":53,"log_dups_size":100,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T00:59:17.824798+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8493,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":230,"num_read_kb":283,"num_write":98,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":473,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:07.432027+0000","last_change":"2024-06-04T16:23:07.432049+0000","last_active":"2024-06-04T16:23:07.432027+0000","last_peered":"2024-06-04T16:23:07.432027+0000","last_clean":"2024-06-04T16:23:07.432027+0000","last_became_active":"2024-06-04T15:52:44.517715+0000","last_became_peered":"2024-06-04T15:52:44.517715+0000","last_unstale":"2024-06-04T16:23:07.432027+0000","last_undegraded":"2024-06-04T16:23:07.432027+0000","last_fullsized":"2024-06-04T16:23:07.432027+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:23:07.431929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:23:07.431929+0000","last_clean_scrub_stamp":"2024-06-04T16:23:07.431929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T21:38:18.352137+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"254'74","reported_seq":562,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:03.466516+0000","last_change":"2024-06-04T16:23:03.466516+0000","last_active":"2024-06-04T16:23:03.466516+0000","last_peered":"2024-06-04T16:23:03.466516+0000","last_clean":"2024-06-04T16:23:03.466516+0000","last_became_active":"2024-06-04T15:52:46.538338+0000","last_became_peered":"2024-06-04T15:52:46.538338+0000","last_unstale":"2024-06-04T16:23:03.466516+0000","last_undegraded":"2024-06-04T16:23:03.466516+0000","last_fullsized":"2024-06-04T16:23:03.466516+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'74","last_scrub_stamp":"2024-06-04T16:23:03.466387+0000","last_deep_scrub":"254'74","last_deep_scrub_stamp":"2024-06-04T16:23:03.466387+0000","last_clean_scrub_stamp":"2024-06-04T16:23:03.466387+0000","objects_scrubbed":3,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T17:43:39.194556+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1061,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":107,"num_read_kb":120,"num_write":148,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1e","version":"254'145","reported_seq":924,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:11.005966+0000","last_change":"2024-06-04T16:23:11.006009+0000","last_active":"2024-06-04T16:23:11.005966+0000","last_peered":"2024-06-04T16:23:11.005966+0000","last_clean":"2024-06-04T16:23:11.005966+0000","last_became_active":"2024-06-04T15:52:38.484087+0000","last_became_peered":"2024-06-04T15:52:38.484087+0000","last_unstale":"2024-06-04T16:23:11.005966+0000","last_undegraded":"2024-06-04T16:23:11.005966+0000","last_fullsized":"2024-06-04T16:23:11.005966+0000","mapping_epoch":23,"log_start":"251'100","ondisk_log_start":"251'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'145","last_scrub_stamp":"2024-06-04T16:23:11.005877+0000","last_deep_scrub":"254'145","last_deep_scrub_stamp":"2024-06-04T16:23:11.005877+0000","last_clean_scrub_stamp":"2024-06-04T16:23:11.005877+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":100,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T22:18:10.083761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":710,"num_read_kb":650,"num_write":181,"num_write_kb":49,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"251'48","reported_seq":560,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:21.820350+0000","last_change":"2024-06-04T16:23:21.820386+0000","last_active":"2024-06-04T16:23:21.820350+0000","last_peered":"2024-06-04T16:23:21.820350+0000","last_clean":"2024-06-04T16:23:21.820350+0000","last_became_active":"2024-06-04T15:52:36.477626+0000","last_became_peered":"2024-06-04T15:52:36.477626+0000","last_unstale":"2024-06-04T16:23:21.820350+0000","last_undegraded":"2024-06-04T16:23:21.820350+0000","last_fullsized":"2024-06-04T16:23:21.820350+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"251'48","last_scrub_stamp":"2024-06-04T16:23:21.820253+0000","last_deep_scrub":"251'48","last_deep_scrub_stamp":"2024-06-04T16:23:21.820253+0000","last_clean_scrub_stamp":"2024-06-04T16:23:21.820253+0000","objects_scrubbed":2,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T21:31:34.108130+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20628,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":58,"num_read_kb":9358,"num_write":184,"num_write_kb":22886,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,1],"acting":[4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":483,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:01.495886+0000","last_change":"2024-06-04T16:23:01.495911+0000","last_active":"2024-06-04T16:23:01.495886+0000","last_peered":"2024-06-04T16:23:01.495886+0000","last_clean":"2024-06-04T16:23:01.495886+0000","last_became_active":"2024-06-04T15:52:40.484444+0000","last_became_peered":"2024-06-04T15:52:40.484444+0000","last_unstale":"2024-06-04T16:23:01.495886+0000","last_undegraded":"2024-06-04T16:23:01.495886+0000","last_fullsized":"2024-06-04T16:23:01.495886+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:23:01.495774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:23:01.495774+0000","last_clean_scrub_stamp":"2024-06-04T16:23:01.495774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T18:30:24.832332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"254'113","reported_seq":669,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:11.847562+0000","last_change":"2024-06-04T16:23:11.847607+0000","last_active":"2024-06-04T16:23:11.847562+0000","last_peered":"2024-06-04T16:23:11.847562+0000","last_clean":"2024-06-04T16:23:11.847562+0000","last_became_active":"2024-06-04T15:52:42.498329+0000","last_became_peered":"2024-06-04T15:52:42.498329+0000","last_unstale":"2024-06-04T16:23:11.847562+0000","last_undegraded":"2024-06-04T16:23:11.847562+0000","last_fullsized":"2024-06-04T16:23:11.847562+0000","mapping_epoch":27,"log_start":"251'100","ondisk_log_start":"251'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'113","last_scrub_stamp":"2024-06-04T16:23:11.847476+0000","last_deep_scrub":"254'113","last_deep_scrub_stamp":"2024-06-04T16:23:11.847476+0000","last_clean_scrub_stamp":"2024-06-04T16:23:11.847476+0000","objects_scrubbed":8,"log_size":13,"log_dups_size":100,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T16:54:36.931076+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":167,"num_read_kb":207,"num_write":102,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":11460,"num_omap_keys":24,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":477,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:04.428313+0000","last_change":"2024-06-04T16:23:04.428338+0000","last_active":"2024-06-04T16:23:04.428313+0000","last_peered":"2024-06-04T16:23:04.428313+0000","last_clean":"2024-06-04T16:23:04.428313+0000","last_became_active":"2024-06-04T15:52:44.523527+0000","last_became_peered":"2024-06-04T15:52:44.523527+0000","last_unstale":"2024-06-04T16:23:04.428313+0000","last_undegraded":"2024-06-04T16:23:04.428313+0000","last_fullsized":"2024-06-04T16:23:04.428313+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:23:04.428227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:23:04.428227+0000","last_clean_scrub_stamp":"2024-06-04T16:23:04.428227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T23:41:17.114473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.12","version":"254'33","reported_seq":519,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:45.120984+0000","last_change":"2024-06-04T16:22:45.120984+0000","last_active":"2024-06-04T16:22:45.120984+0000","last_peered":"2024-06-04T16:22:45.120984+0000","last_clean":"2024-06-04T16:22:45.120984+0000","last_became_active":"2024-06-04T15:52:46.537899+0000","last_became_peered":"2024-06-04T15:52:46.537899+0000","last_unstale":"2024-06-04T16:22:45.120984+0000","last_undegraded":"2024-06-04T16:22:45.120984+0000","last_fullsized":"2024-06-04T16:22:45.120984+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'33","last_scrub_stamp":"2024-06-04T16:22:45.120808+0000","last_deep_scrub":"254'33","last_deep_scrub_stamp":"2024-06-04T16:22:45.120808+0000","last_clean_scrub_stamp":"2024-06-04T16:22:45.120808+0000","objects_scrubbed":4,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T18:20:07.652176+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1228,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":67,"num_read_kb":65,"num_write":80,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"254'110","reported_seq":894,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:26.919908+0000","last_change":"2024-06-04T16:23:26.919950+0000","last_active":"2024-06-04T16:23:26.919908+0000","last_peered":"2024-06-04T16:23:26.919908+0000","last_clean":"2024-06-04T16:23:26.919908+0000","last_became_active":"2024-06-04T15:52:38.480458+0000","last_became_peered":"2024-06-04T15:52:38.480458+0000","last_unstale":"2024-06-04T16:23:26.919908+0000","last_undegraded":"2024-06-04T16:23:26.919908+0000","last_fullsized":"2024-06-04T16:23:26.919908+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'110","last_scrub_stamp":"2024-06-04T16:23:26.919814+0000","last_deep_scrub":"254'110","last_deep_scrub_stamp":"2024-06-04T16:23:26.919814+0000","last_clean_scrub_stamp":"2024-06-04T16:23:26.919814+0000","objects_scrubbed":2,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T21:46:39.229182+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":731,"num_read_kb":703,"num_write":125,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1a","version":"254'73","reported_seq":595,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:16.333696+0000","last_change":"2024-06-04T16:23:16.333779+0000","last_active":"2024-06-04T16:23:16.333696+0000","last_peered":"2024-06-04T16:23:16.333696+0000","last_clean":"2024-06-04T16:23:16.333696+0000","last_became_active":"2024-06-04T15:52:36.477885+0000","last_became_peered":"2024-06-04T15:52:36.477885+0000","last_unstale":"2024-06-04T16:23:16.333696+0000","last_undegraded":"2024-06-04T16:23:16.333696+0000","last_fullsized":"2024-06-04T16:23:16.333696+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'73","last_scrub_stamp":"2024-06-04T16:23:16.333565+0000","last_deep_scrub":"254'73","last_deep_scrub_stamp":"2024-06-04T16:23:16.333565+0000","last_clean_scrub_stamp":"2024-06-04T16:23:16.333565+0000","objects_scrubbed":5,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T02:47:04.293959+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1395842,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":88,"num_read_kb":3881,"num_write":289,"num_write_kb":29330,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":481,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:57.516834+0000","last_change":"2024-06-04T16:22:57.516894+0000","last_active":"2024-06-04T16:22:57.516834+0000","last_peered":"2024-06-04T16:22:57.516834+0000","last_clean":"2024-06-04T16:22:57.516834+0000","last_became_active":"2024-06-04T15:52:40.477924+0000","last_became_peered":"2024-06-04T15:52:40.477924+0000","last_unstale":"2024-06-04T16:22:57.516834+0000","last_undegraded":"2024-06-04T16:22:57.516834+0000","last_fullsized":"2024-06-04T16:22:57.516834+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:22:57.516723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:22:57.516723+0000","last_clean_scrub_stamp":"2024-06-04T16:22:57.516723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T18:12:49.229393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"254'97","reported_seq":647,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:04.066551+0000","last_change":"2024-06-04T16:23:04.066591+0000","last_active":"2024-06-04T16:23:04.066551+0000","last_peered":"2024-06-04T16:23:04.066551+0000","last_clean":"2024-06-04T16:23:04.066551+0000","last_became_active":"2024-06-04T15:52:42.503579+0000","last_became_peered":"2024-06-04T15:52:42.503579+0000","last_unstale":"2024-06-04T16:23:04.066551+0000","last_undegraded":"2024-06-04T16:23:04.066551+0000","last_fullsized":"2024-06-04T16:23:04.066551+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'97","last_scrub_stamp":"2024-06-04T16:23:04.066459+0000","last_deep_scrub":"254'97","last_deep_scrub_stamp":"2024-06-04T16:23:04.066459+0000","last_clean_scrub_stamp":"2024-06-04T16:23:04.066459+0000","objects_scrubbed":5,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T22:07:06.260680+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5924,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":139,"num_read_kb":180,"num_write":64,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":478,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:10.043211+0000","last_change":"2024-06-04T16:23:10.043234+0000","last_active":"2024-06-04T16:23:10.043211+0000","last_peered":"2024-06-04T16:23:10.043211+0000","last_clean":"2024-06-04T16:23:10.043211+0000","last_became_active":"2024-06-04T15:52:44.519570+0000","last_became_peered":"2024-06-04T15:52:44.519570+0000","last_unstale":"2024-06-04T16:23:10.043211+0000","last_undegraded":"2024-06-04T16:23:10.043211+0000","last_fullsized":"2024-06-04T16:23:10.043211+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:23:10.043105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:23:10.043105+0000","last_clean_scrub_stamp":"2024-06-04T16:23:10.043105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T03:18:54.475664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.11","version":"254'27","reported_seq":500,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:59.862605+0000","last_change":"2024-06-04T16:22:59.862605+0000","last_active":"2024-06-04T16:22:59.862605+0000","last_peered":"2024-06-04T16:22:59.862605+0000","last_clean":"2024-06-04T16:22:59.862605+0000","last_became_active":"2024-06-04T15:52:46.542820+0000","last_became_peered":"2024-06-04T15:52:46.542820+0000","last_unstale":"2024-06-04T16:22:59.862605+0000","last_undegraded":"2024-06-04T16:22:59.862605+0000","last_fullsized":"2024-06-04T16:22:59.862605+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'27","last_scrub_stamp":"2024-06-04T16:22:59.862441+0000","last_deep_scrub":"254'27","last_deep_scrub_stamp":"2024-06-04T16:22:59.862441+0000","last_clean_scrub_stamp":"2024-06-04T16:22:59.862441+0000","objects_scrubbed":3,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T21:08:54.099136+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":616,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":20,"num_read_kb":19,"num_write":60,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"254'122","reported_seq":825,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:16.913414+0000","last_change":"2024-06-04T16:23:16.913440+0000","last_active":"2024-06-04T16:23:16.913414+0000","last_peered":"2024-06-04T16:23:16.913414+0000","last_clean":"2024-06-04T16:23:16.913414+0000","last_became_active":"2024-06-04T15:52:38.477059+0000","last_became_peered":"2024-06-04T15:52:38.477059+0000","last_unstale":"2024-06-04T16:23:16.913414+0000","last_undegraded":"2024-06-04T16:23:16.913414+0000","last_fullsized":"2024-06-04T16:23:16.913414+0000","mapping_epoch":23,"log_start":"251'100","ondisk_log_start":"251'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'122","last_scrub_stamp":"2024-06-04T16:23:16.913326+0000","last_deep_scrub":"254'122","last_deep_scrub_stamp":"2024-06-04T16:23:16.913326+0000","last_clean_scrub_stamp":"2024-06-04T16:23:16.913326+0000","objects_scrubbed":1,"log_size":22,"log_dups_size":100,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T03:51:33.774060+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":614,"num_read_kb":552,"num_write":164,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":760,"num_omap_keys":4,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"254'63","reported_seq":580,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:24.765423+0000","last_change":"2024-06-04T16:23:24.765516+0000","last_active":"2024-06-04T16:23:24.765423+0000","last_peered":"2024-06-04T16:23:24.765423+0000","last_clean":"2024-06-04T16:23:24.765423+0000","last_became_active":"2024-06-04T15:52:36.497812+0000","last_became_peered":"2024-06-04T15:52:36.497812+0000","last_unstale":"2024-06-04T16:23:24.765423+0000","last_undegraded":"2024-06-04T16:23:24.765423+0000","last_fullsized":"2024-06-04T16:23:24.765423+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'63","last_scrub_stamp":"2024-06-04T16:23:24.765310+0000","last_deep_scrub":"254'63","last_deep_scrub_stamp":"2024-06-04T16:23:24.765310+0000","last_clean_scrub_stamp":"2024-06-04T16:23:24.765310+0000","objects_scrubbed":4,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T00:23:42.383064+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2267334,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":82,"num_read_kb":14576,"num_write":293,"num_write_kb":31387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3],"acting":[4,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":483,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:08.017758+0000","last_change":"2024-06-04T16:23:08.017785+0000","last_active":"2024-06-04T16:23:08.017758+0000","last_peered":"2024-06-04T16:23:08.017758+0000","last_clean":"2024-06-04T16:23:08.017758+0000","last_became_active":"2024-06-04T15:52:40.481621+0000","last_became_peered":"2024-06-04T15:52:40.481621+0000","last_unstale":"2024-06-04T16:23:08.017758+0000","last_undegraded":"2024-06-04T16:23:08.017758+0000","last_fullsized":"2024-06-04T16:23:08.017758+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:23:08.017669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:23:08.017669+0000","last_clean_scrub_stamp":"2024-06-04T16:23:08.017669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T00:50:40.268642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1e","version":"254'51","reported_seq":547,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:09.844823+0000","last_change":"2024-06-04T16:23:09.844878+0000","last_active":"2024-06-04T16:23:09.844823+0000","last_peered":"2024-06-04T16:23:09.844823+0000","last_clean":"2024-06-04T16:23:09.844823+0000","last_became_active":"2024-06-04T15:52:42.499488+0000","last_became_peered":"2024-06-04T15:52:42.499488+0000","last_unstale":"2024-06-04T16:23:09.844823+0000","last_undegraded":"2024-06-04T16:23:09.844823+0000","last_fullsized":"2024-06-04T16:23:09.844823+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'51","last_scrub_stamp":"2024-06-04T16:23:09.844736+0000","last_deep_scrub":"254'51","last_deep_scrub_stamp":"2024-06-04T16:23:09.844736+0000","last_clean_scrub_stamp":"2024-06-04T16:23:09.844736+0000","objects_scrubbed":7,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T16:46:37.753033+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":67,"num_read_kb":62,"num_write":74,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":11222,"num_omap_keys":30,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"254'461","reported_seq":1489,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:03.752146+0000","last_change":"2024-06-04T16:23:03.752174+0000","last_active":"2024-06-04T16:23:03.752146+0000","last_peered":"2024-06-04T16:23:03.752146+0000","last_clean":"2024-06-04T16:23:03.752146+0000","last_became_active":"2024-06-04T15:52:44.516460+0000","last_became_peered":"2024-06-04T15:52:44.516460+0000","last_unstale":"2024-06-04T16:23:03.752146+0000","last_undegraded":"2024-06-04T16:23:03.752146+0000","last_fullsized":"2024-06-04T16:23:03.752146+0000","mapping_epoch":29,"log_start":"251'400","ondisk_log_start":"251'400","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'461","last_scrub_stamp":"2024-06-04T16:23:03.752033+0000","last_deep_scrub":"254'461","last_deep_scrub_stamp":"2024-06-04T16:23:03.752033+0000","last_clean_scrub_stamp":"2024-06-04T16:23:03.752033+0000","objects_scrubbed":1,"log_size":61,"log_dups_size":400,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T22:17:40.547278+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.10","version":"254'21","reported_seq":501,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:47.043361+0000","last_change":"2024-06-04T16:22:47.043361+0000","last_active":"2024-06-04T16:22:47.043361+0000","last_peered":"2024-06-04T16:22:47.043361+0000","last_clean":"2024-06-04T16:22:47.043361+0000","last_became_active":"2024-06-04T15:52:46.538179+0000","last_became_peered":"2024-06-04T15:52:46.538179+0000","last_unstale":"2024-06-04T16:22:47.043361+0000","last_undegraded":"2024-06-04T16:22:47.043361+0000","last_fullsized":"2024-06-04T16:22:47.043361+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'21","last_scrub_stamp":"2024-06-04T16:22:47.043259+0000","last_deep_scrub":"254'21","last_deep_scrub_stamp":"2024-06-04T16:22:47.043259+0000","last_clean_scrub_stamp":"2024-06-04T16:22:47.043259+0000","objects_scrubbed":1,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T22:15:40.632828+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":34,"num_read_kb":33,"num_write":53,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"254'123","reported_seq":876,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:00.500298+0000","last_change":"2024-06-04T16:23:00.500326+0000","last_active":"2024-06-04T16:23:00.500298+0000","last_peered":"2024-06-04T16:23:00.500298+0000","last_clean":"2024-06-04T16:23:00.500298+0000","last_became_active":"2024-06-04T15:52:38.485379+0000","last_became_peered":"2024-06-04T15:52:38.485379+0000","last_unstale":"2024-06-04T16:23:00.500298+0000","last_undegraded":"2024-06-04T16:23:00.500298+0000","last_fullsized":"2024-06-04T16:23:00.500298+0000","mapping_epoch":23,"log_start":"254'100","ondisk_log_start":"254'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'123","last_scrub_stamp":"2024-06-04T16:23:00.500205+0000","last_deep_scrub":"254'123","last_deep_scrub_stamp":"2024-06-04T16:23:00.500205+0000","last_clean_scrub_stamp":"2024-06-04T16:23:00.500205+0000","objects_scrubbed":1,"log_size":23,"log_dups_size":100,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T20:17:09.939014+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":679,"num_read_kb":622,"num_write":158,"num_write_kb":49,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":473,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"251'30","reported_seq":530,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:18.399939+0000","last_change":"2024-06-04T16:23:18.399978+0000","last_active":"2024-06-04T16:23:18.399939+0000","last_peered":"2024-06-04T16:23:18.399939+0000","last_clean":"2024-06-04T16:23:18.399939+0000","last_became_active":"2024-06-04T15:52:36.486465+0000","last_became_peered":"2024-06-04T15:52:36.486465+0000","last_unstale":"2024-06-04T16:23:18.399939+0000","last_undegraded":"2024-06-04T16:23:18.399939+0000","last_fullsized":"2024-06-04T16:23:18.399939+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"251'30","last_scrub_stamp":"2024-06-04T16:23:18.399838+0000","last_deep_scrub":"251'30","last_deep_scrub_stamp":"2024-06-04T16:23:18.399838+0000","last_clean_scrub_stamp":"2024-06-04T16:23:18.399838+0000","objects_scrubbed":2,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T18:52:49.120366+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":30,"num_read_kb":1715,"num_write":122,"num_write_kb":16993,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,5],"acting":[1,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":485,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:00.183025+0000","last_change":"2024-06-04T16:23:00.183049+0000","last_active":"2024-06-04T16:23:00.183025+0000","last_peered":"2024-06-04T16:23:00.183025+0000","last_clean":"2024-06-04T16:23:00.183025+0000","last_became_active":"2024-06-04T15:52:40.480832+0000","last_became_peered":"2024-06-04T15:52:40.480832+0000","last_unstale":"2024-06-04T16:23:00.183025+0000","last_undegraded":"2024-06-04T16:23:00.183025+0000","last_fullsized":"2024-06-04T16:23:00.183025+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:23:00.182795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:23:00.182795+0000","last_clean_scrub_stamp":"2024-06-04T16:23:00.182795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T01:51:55.867582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"254'117","reported_seq":676,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:53.901967+0000","last_change":"2024-06-04T16:22:53.902005+0000","last_active":"2024-06-04T16:22:53.901967+0000","last_peered":"2024-06-04T16:22:53.901967+0000","last_clean":"2024-06-04T16:22:53.901967+0000","last_became_active":"2024-06-04T15:52:42.502601+0000","last_became_peered":"2024-06-04T15:52:42.502601+0000","last_unstale":"2024-06-04T16:22:53.901967+0000","last_undegraded":"2024-06-04T16:22:53.901967+0000","last_fullsized":"2024-06-04T16:22:53.901967+0000","mapping_epoch":27,"log_start":"251'100","ondisk_log_start":"251'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'117","last_scrub_stamp":"2024-06-04T16:22:53.901886+0000","last_deep_scrub":"254'117","last_deep_scrub_stamp":"2024-06-04T16:22:53.901886+0000","last_clean_scrub_stamp":"2024-06-04T16:22:53.901886+0000","objects_scrubbed":7,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T01:13:12.328330+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34754,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":168,"num_read_kb":281,"num_write":86,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":475,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:49.023291+0000","last_change":"2024-06-04T16:22:49.023320+0000","last_active":"2024-06-04T16:22:49.023291+0000","last_peered":"2024-06-04T16:22:49.023291+0000","last_clean":"2024-06-04T16:22:49.023291+0000","last_became_active":"2024-06-04T15:52:44.522992+0000","last_became_peered":"2024-06-04T15:52:44.522992+0000","last_unstale":"2024-06-04T16:22:49.023291+0000","last_undegraded":"2024-06-04T16:22:49.023291+0000","last_fullsized":"2024-06-04T16:22:49.023291+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:22:49.023192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:22:49.023192+0000","last_clean_scrub_stamp":"2024-06-04T16:22:49.023192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T21:20:02.532465+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"254'16","reported_seq":497,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:50.151424+0000","last_change":"2024-06-04T16:22:50.151477+0000","last_active":"2024-06-04T16:22:50.151424+0000","last_peered":"2024-06-04T16:22:50.151424+0000","last_clean":"2024-06-04T16:22:50.151424+0000","last_became_active":"2024-06-04T15:52:46.539985+0000","last_became_peered":"2024-06-04T15:52:46.539985+0000","last_unstale":"2024-06-04T16:22:50.151424+0000","last_undegraded":"2024-06-04T16:22:50.151424+0000","last_fullsized":"2024-06-04T16:22:50.151424+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'16","last_scrub_stamp":"2024-06-04T16:22:50.151326+0000","last_deep_scrub":"254'16","last_deep_scrub_stamp":"2024-06-04T16:22:50.151326+0000","last_clean_scrub_stamp":"2024-06-04T16:22:50.151326+0000","objects_scrubbed":1,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T17:32:57.901810+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":31,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"254'422","reported_seq":1248,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:20.638647+0000","last_change":"2024-06-04T16:23:20.638715+0000","last_active":"2024-06-04T16:23:20.638647+0000","last_peered":"2024-06-04T16:23:20.638647+0000","last_clean":"2024-06-04T16:23:20.638647+0000","last_became_active":"2024-06-04T15:52:38.474960+0000","last_became_peered":"2024-06-04T15:52:38.474960+0000","last_unstale":"2024-06-04T16:23:20.638647+0000","last_undegraded":"2024-06-04T16:23:20.638647+0000","last_fullsized":"2024-06-04T16:23:20.638647+0000","mapping_epoch":23,"log_start":"251'400","ondisk_log_start":"251'400","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'422","last_scrub_stamp":"2024-06-04T16:23:20.638541+0000","last_deep_scrub":"254'422","last_deep_scrub_stamp":"2024-06-04T16:23:20.638541+0000","last_clean_scrub_stamp":"2024-06-04T16:23:20.638541+0000","objects_scrubbed":3,"log_size":22,"log_dups_size":400,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T00:31:18.491940+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2017,"num_read_kb":1794,"num_write":716,"num_write_kb":341,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3525,"num_omap_keys":15,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"254'99","reported_seq":736,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:27.679253+0000","last_change":"2024-06-04T16:23:27.679298+0000","last_active":"2024-06-04T16:23:27.679253+0000","last_peered":"2024-06-04T16:23:27.679253+0000","last_clean":"2024-06-04T16:23:27.679253+0000","last_became_active":"2024-06-04T15:52:36.498806+0000","last_became_peered":"2024-06-04T15:52:36.498806+0000","last_unstale":"2024-06-04T16:23:27.679253+0000","last_undegraded":"2024-06-04T16:23:27.679253+0000","last_fullsized":"2024-06-04T16:23:27.679253+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'99","last_scrub_stamp":"2024-06-04T16:23:27.679156+0000","last_deep_scrub":"254'99","last_deep_scrub_stamp":"2024-06-04T16:23:27.679156+0000","last_clean_scrub_stamp":"2024-06-04T16:23:27.679156+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T03:58:25.345803+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":490,"num_read_kb":127523,"num_write":607,"num_write_kb":22490,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":481,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:59.503813+0000","last_change":"2024-06-04T16:22:59.503864+0000","last_active":"2024-06-04T16:22:59.503813+0000","last_peered":"2024-06-04T16:22:59.503813+0000","last_clean":"2024-06-04T16:22:59.503813+0000","last_became_active":"2024-06-04T15:52:40.478417+0000","last_became_peered":"2024-06-04T15:52:40.478417+0000","last_unstale":"2024-06-04T16:22:59.503813+0000","last_undegraded":"2024-06-04T16:22:59.503813+0000","last_fullsized":"2024-06-04T16:22:59.503813+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:22:59.503712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:22:59.503712+0000","last_clean_scrub_stamp":"2024-06-04T16:22:59.503712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T19:24:36.842678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"254'92","reported_seq":640,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:25.812420+0000","last_change":"2024-06-04T16:23:25.812462+0000","last_active":"2024-06-04T16:23:25.812420+0000","last_peered":"2024-06-04T16:23:25.812420+0000","last_clean":"2024-06-04T16:23:25.812420+0000","last_became_active":"2024-06-04T15:52:42.496263+0000","last_became_peered":"2024-06-04T15:52:42.496263+0000","last_unstale":"2024-06-04T16:23:25.812420+0000","last_undegraded":"2024-06-04T16:23:25.812420+0000","last_fullsized":"2024-06-04T16:23:25.812420+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'92","last_scrub_stamp":"2024-06-04T16:23:25.812328+0000","last_deep_scrub":"254'92","last_deep_scrub_stamp":"2024-06-04T16:23:25.812328+0000","last_clean_scrub_stamp":"2024-06-04T16:23:25.812328+0000","objects_scrubbed":4,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T19:24:39.575301+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7956,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":138,"num_read_kb":200,"num_write":66,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":474,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:04.870935+0000","last_change":"2024-06-04T16:23:04.870958+0000","last_active":"2024-06-04T16:23:04.870935+0000","last_peered":"2024-06-04T16:23:04.870935+0000","last_clean":"2024-06-04T16:23:04.870935+0000","last_became_active":"2024-06-04T15:52:44.520051+0000","last_became_peered":"2024-06-04T15:52:44.520051+0000","last_unstale":"2024-06-04T16:23:04.870935+0000","last_undegraded":"2024-06-04T16:23:04.870935+0000","last_fullsized":"2024-06-04T16:23:04.870935+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:23:04.870830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:23:04.870830+0000","last_clean_scrub_stamp":"2024-06-04T16:23:04.870830+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T20:14:18.357003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"254'40","reported_seq":557,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:57.535519+0000","last_change":"2024-06-04T16:22:57.535547+0000","last_active":"2024-06-04T16:22:57.535519+0000","last_peered":"2024-06-04T16:22:57.535519+0000","last_clean":"2024-06-04T16:22:57.535519+0000","last_became_active":"2024-06-04T15:52:46.541897+0000","last_became_peered":"2024-06-04T15:52:46.541897+0000","last_unstale":"2024-06-04T16:22:57.535519+0000","last_undegraded":"2024-06-04T16:22:57.535519+0000","last_fullsized":"2024-06-04T16:22:57.535519+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'40","last_scrub_stamp":"2024-06-04T16:22:57.535425+0000","last_deep_scrub":"254'40","last_deep_scrub_stamp":"2024-06-04T16:22:57.535425+0000","last_clean_scrub_stamp":"2024-06-04T16:22:57.535425+0000","objects_scrubbed":1,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T01:55:20.316635+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":549,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":152,"num_read_kb":137,"num_write":99,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"254'124","reported_seq":860,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:20.913028+0000","last_change":"2024-06-04T16:23:20.913058+0000","last_active":"2024-06-04T16:23:20.913028+0000","last_peered":"2024-06-04T16:23:20.913028+0000","last_clean":"2024-06-04T16:23:20.913028+0000","last_became_active":"2024-06-04T15:52:38.482388+0000","last_became_peered":"2024-06-04T15:52:38.482388+0000","last_unstale":"2024-06-04T16:23:20.913028+0000","last_undegraded":"2024-06-04T16:23:20.913028+0000","last_fullsized":"2024-06-04T16:23:20.913028+0000","mapping_epoch":23,"log_start":"251'100","ondisk_log_start":"251'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'124","last_scrub_stamp":"2024-06-04T16:23:20.912932+0000","last_deep_scrub":"254'124","last_deep_scrub_stamp":"2024-06-04T16:23:20.912932+0000","last_clean_scrub_stamp":"2024-06-04T16:23:20.912932+0000","objects_scrubbed":2,"log_size":24,"log_dups_size":100,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T21:56:21.589196+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":625,"num_read_kb":571,"num_write":157,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1e","version":"251'81","reported_seq":621,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:34.360778+0000","last_change":"2024-06-04T16:23:34.360865+0000","last_active":"2024-06-04T16:23:34.360778+0000","last_peered":"2024-06-04T16:23:34.360778+0000","last_clean":"2024-06-04T16:23:34.360778+0000","last_became_active":"2024-06-04T15:52:36.485401+0000","last_became_peered":"2024-06-04T15:52:36.485401+0000","last_unstale":"2024-06-04T16:23:34.360778+0000","last_undegraded":"2024-06-04T16:23:34.360778+0000","last_fullsized":"2024-06-04T16:23:34.360778+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"251'81","last_scrub_stamp":"2024-06-04T16:23:34.360665+0000","last_deep_scrub":"251'81","last_deep_scrub_stamp":"2024-06-04T16:23:34.360665+0000","last_clean_scrub_stamp":"2024-06-04T16:23:34.360665+0000","objects_scrubbed":4,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T04:14:33.483293+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133679,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":131,"num_read_kb":40112,"num_write":294,"num_write_kb":27266,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,3],"acting":[5,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":485,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:02.189360+0000","last_change":"2024-06-04T16:23:02.189383+0000","last_active":"2024-06-04T16:23:02.189360+0000","last_peered":"2024-06-04T16:23:02.189360+0000","last_clean":"2024-06-04T16:23:02.189360+0000","last_became_active":"2024-06-04T15:52:40.483272+0000","last_became_peered":"2024-06-04T15:52:40.483272+0000","last_unstale":"2024-06-04T16:23:02.189360+0000","last_undegraded":"2024-06-04T16:23:02.189360+0000","last_fullsized":"2024-06-04T16:23:02.189360+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:23:02.189267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:23:02.189267+0000","last_clean_scrub_stamp":"2024-06-04T16:23:02.189267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T00:51:47.779975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"254'83","reported_seq":621,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:58.065530+0000","last_change":"2024-06-04T16:22:58.065561+0000","last_active":"2024-06-04T16:22:58.065530+0000","last_peered":"2024-06-04T16:22:58.065530+0000","last_clean":"2024-06-04T16:22:58.065530+0000","last_became_active":"2024-06-04T15:52:42.496934+0000","last_became_peered":"2024-06-04T15:52:42.496934+0000","last_unstale":"2024-06-04T16:22:58.065530+0000","last_undegraded":"2024-06-04T16:22:58.065530+0000","last_fullsized":"2024-06-04T16:22:58.065530+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'83","last_scrub_stamp":"2024-06-04T16:22:58.065438+0000","last_deep_scrub":"254'83","last_deep_scrub_stamp":"2024-06-04T16:22:58.065438+0000","last_clean_scrub_stamp":"2024-06-04T16:22:58.065438+0000","objects_scrubbed":2,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T03:24:48.725441+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8160,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":120,"num_read_kb":184,"num_write":54,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":474,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:05.903821+0000","last_change":"2024-06-04T16:23:05.903856+0000","last_active":"2024-06-04T16:23:05.903821+0000","last_peered":"2024-06-04T16:23:05.903821+0000","last_clean":"2024-06-04T16:23:05.903821+0000","last_became_active":"2024-06-04T15:52:44.518782+0000","last_became_peered":"2024-06-04T15:52:44.518782+0000","last_unstale":"2024-06-04T16:23:05.903821+0000","last_undegraded":"2024-06-04T16:23:05.903821+0000","last_fullsized":"2024-06-04T16:23:05.903821+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:23:05.903728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:23:05.903728+0000","last_clean_scrub_stamp":"2024-06-04T16:23:05.903728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T19:53:16.916764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"254'44","reported_seq":540,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:46.089113+0000","last_change":"2024-06-04T16:22:46.089139+0000","last_active":"2024-06-04T16:22:46.089113+0000","last_peered":"2024-06-04T16:22:46.089113+0000","last_clean":"2024-06-04T16:22:46.089113+0000","last_became_active":"2024-06-04T15:52:46.531795+0000","last_became_peered":"2024-06-04T15:52:46.531795+0000","last_unstale":"2024-06-04T16:22:46.089113+0000","last_undegraded":"2024-06-04T16:22:46.089113+0000","last_fullsized":"2024-06-04T16:22:46.089113+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'44","last_scrub_stamp":"2024-06-04T16:22:46.089042+0000","last_deep_scrub":"254'44","last_deep_scrub_stamp":"2024-06-04T16:22:46.089042+0000","last_clean_scrub_stamp":"2024-06-04T16:22:46.089042+0000","objects_scrubbed":3,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T18:19:03.232432+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":429,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":136,"num_read_kb":110,"num_write":109,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"254'359","reported_seq":1103,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:12.517008+0000","last_change":"2024-06-04T16:23:12.517047+0000","last_active":"2024-06-04T16:23:12.517008+0000","last_peered":"2024-06-04T16:23:12.517008+0000","last_clean":"2024-06-04T16:23:12.517008+0000","last_became_active":"2024-06-04T15:52:38.478204+0000","last_became_peered":"2024-06-04T15:52:38.478204+0000","last_unstale":"2024-06-04T16:23:12.517008+0000","last_undegraded":"2024-06-04T16:23:12.517008+0000","last_fullsized":"2024-06-04T16:23:12.517008+0000","mapping_epoch":23,"log_start":"251'300","ondisk_log_start":"251'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'359","last_scrub_stamp":"2024-06-04T16:23:12.516911+0000","last_deep_scrub":"254'359","last_deep_scrub_stamp":"2024-06-04T16:23:12.516911+0000","last_clean_scrub_stamp":"2024-06-04T16:23:12.516911+0000","objects_scrubbed":3,"log_size":59,"log_dups_size":300,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T01:34:27.842574+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1642,"num_read_kb":1482,"num_write":614,"num_write_kb":292,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":768,"num_omap_keys":5,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"251'22","reported_seq":522,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:28.414286+0000","last_change":"2024-06-04T16:23:28.414343+0000","last_active":"2024-06-04T16:23:28.414286+0000","last_peered":"2024-06-04T16:23:28.414286+0000","last_clean":"2024-06-04T16:23:28.414286+0000","last_became_active":"2024-06-04T15:52:36.477895+0000","last_became_peered":"2024-06-04T15:52:36.477895+0000","last_unstale":"2024-06-04T16:23:28.414286+0000","last_undegraded":"2024-06-04T16:23:28.414286+0000","last_fullsized":"2024-06-04T16:23:28.414286+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"251'22","last_scrub_stamp":"2024-06-04T16:23:28.414169+0000","last_deep_scrub":"251'22","last_deep_scrub_stamp":"2024-06-04T16:23:28.414169+0000","last_clean_scrub_stamp":"2024-06-04T16:23:28.414169+0000","objects_scrubbed":3,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T02:46:15.884004+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":78,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":120,"num_write_kb":13440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.19","version":"254'2","reported_seq":485,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:10.003136+0000","last_change":"2024-06-04T16:23:10.003165+0000","last_active":"2024-06-04T16:23:10.003136+0000","last_peered":"2024-06-04T16:23:10.003136+0000","last_clean":"2024-06-04T16:23:10.003136+0000","last_became_active":"2024-06-04T15:52:40.483131+0000","last_became_peered":"2024-06-04T15:52:40.483131+0000","last_unstale":"2024-06-04T16:23:10.003136+0000","last_undegraded":"2024-06-04T16:23:10.003136+0000","last_fullsized":"2024-06-04T16:23:10.003136+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'2","last_scrub_stamp":"2024-06-04T16:23:10.003044+0000","last_deep_scrub":"254'2","last_deep_scrub_stamp":"2024-06-04T16:23:10.003044+0000","last_clean_scrub_stamp":"2024-06-04T16:23:10.003044+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T20:22:25.334380+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1a","version":"254'123","reported_seq":685,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:07.878541+0000","last_change":"2024-06-04T16:23:07.878570+0000","last_active":"2024-06-04T16:23:07.878541+0000","last_peered":"2024-06-04T16:23:07.878541+0000","last_clean":"2024-06-04T16:23:07.878541+0000","last_became_active":"2024-06-04T15:52:42.503538+0000","last_became_peered":"2024-06-04T15:52:42.503538+0000","last_unstale":"2024-06-04T16:23:07.878541+0000","last_undegraded":"2024-06-04T16:23:07.878541+0000","last_fullsized":"2024-06-04T16:23:07.878541+0000","mapping_epoch":27,"log_start":"251'100","ondisk_log_start":"251'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'123","last_scrub_stamp":"2024-06-04T16:23:07.878472+0000","last_deep_scrub":"254'123","last_deep_scrub_stamp":"2024-06-04T16:23:07.878472+0000","last_clean_scrub_stamp":"2024-06-04T16:23:07.878472+0000","objects_scrubbed":4,"log_size":23,"log_dups_size":100,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T17:02:13.406205+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6196,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":182,"num_read_kb":236,"num_write":96,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":475,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:53.984901+0000","last_change":"2024-06-04T16:22:53.984929+0000","last_active":"2024-06-04T16:22:53.984901+0000","last_peered":"2024-06-04T16:22:53.984901+0000","last_clean":"2024-06-04T16:22:53.984901+0000","last_became_active":"2024-06-04T15:52:44.519867+0000","last_became_peered":"2024-06-04T15:52:44.519867+0000","last_unstale":"2024-06-04T16:22:53.984901+0000","last_undegraded":"2024-06-04T16:22:53.984901+0000","last_fullsized":"2024-06-04T16:22:53.984901+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:22:53.984790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:22:53.984790+0000","last_clean_scrub_stamp":"2024-06-04T16:22:53.984790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T22:21:34.850045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.14","version":"254'32","reported_seq":541,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:46.906396+0000","last_change":"2024-06-04T16:22:46.906396+0000","last_active":"2024-06-04T16:22:46.906396+0000","last_peered":"2024-06-04T16:22:46.906396+0000","last_clean":"2024-06-04T16:22:46.906396+0000","last_became_active":"2024-06-04T15:52:46.537792+0000","last_became_peered":"2024-06-04T15:52:46.537792+0000","last_unstale":"2024-06-04T16:22:46.906396+0000","last_undegraded":"2024-06-04T16:22:46.906396+0000","last_fullsized":"2024-06-04T16:22:46.906396+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'32","last_scrub_stamp":"2024-06-04T16:22:46.906299+0000","last_deep_scrub":"254'32","last_deep_scrub_stamp":"2024-06-04T16:22:46.906299+0000","last_clean_scrub_stamp":"2024-06-04T16:22:46.906299+0000","objects_scrubbed":2,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T20:36:00.317258+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":433,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":163,"num_read_kb":128,"num_write":83,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"254'157","reported_seq":957,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:05.024132+0000","last_change":"2024-06-04T16:23:05.024162+0000","last_active":"2024-06-04T16:23:05.024132+0000","last_peered":"2024-06-04T16:23:05.024132+0000","last_clean":"2024-06-04T16:23:05.024132+0000","last_became_active":"2024-06-04T15:52:38.486335+0000","last_became_peered":"2024-06-04T15:52:38.486335+0000","last_unstale":"2024-06-04T16:23:05.024132+0000","last_undegraded":"2024-06-04T16:23:05.024132+0000","last_fullsized":"2024-06-04T16:23:05.024132+0000","mapping_epoch":23,"log_start":"251'100","ondisk_log_start":"251'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'157","last_scrub_stamp":"2024-06-04T16:23:05.024043+0000","last_deep_scrub":"254'157","last_deep_scrub_stamp":"2024-06-04T16:23:05.024043+0000","last_clean_scrub_stamp":"2024-06-04T16:23:05.024043+0000","objects_scrubbed":1,"log_size":57,"log_dups_size":100,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T17:07:05.833438+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":839,"num_read_kb":763,"num_write":210,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":310,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.20","version":"254'54","reported_seq":577,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:52.513454+0000","last_change":"2024-06-04T16:22:52.513504+0000","last_active":"2024-06-04T16:22:52.513454+0000","last_peered":"2024-06-04T16:22:52.513454+0000","last_clean":"2024-06-04T16:22:52.513454+0000","last_became_active":"2024-06-04T15:53:14.002428+0000","last_became_peered":"2024-06-04T15:53:14.002428+0000","last_unstale":"2024-06-04T16:22:52.513454+0000","last_undegraded":"2024-06-04T16:22:52.513454+0000","last_fullsized":"2024-06-04T16:22:52.513454+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'54","last_scrub_stamp":"2024-06-04T16:22:52.513364+0000","last_deep_scrub":"254'54","last_deep_scrub_stamp":"2024-06-04T16:22:52.513364+0000","last_clean_scrub_stamp":"2024-06-04T16:22:52.513364+0000","objects_scrubbed":2,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T03:21:52.616336+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":15429,"num_write":206,"num_write_kb":34585,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5],"acting":[2,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"254'241","reported_seq":921,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:27.953079+0000","last_change":"2024-06-04T16:23:27.953105+0000","last_active":"2024-06-04T16:23:27.953079+0000","last_peered":"2024-06-04T16:23:27.953079+0000","last_clean":"2024-06-04T16:23:27.953079+0000","last_became_active":"2024-06-04T15:52:38.481490+0000","last_became_peered":"2024-06-04T15:52:38.481490+0000","last_unstale":"2024-06-04T16:23:27.953079+0000","last_undegraded":"2024-06-04T16:23:27.953079+0000","last_fullsized":"2024-06-04T16:23:27.953079+0000","mapping_epoch":23,"log_start":"251'200","ondisk_log_start":"251'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'241","last_scrub_stamp":"2024-06-04T16:23:27.952981+0000","last_deep_scrub":"254'241","last_deep_scrub_stamp":"2024-06-04T16:23:27.952981+0000","last_clean_scrub_stamp":"2024-06-04T16:23:27.952981+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":200,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T23:20:40.006254+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1011,"num_read_kb":836,"num_write":379,"num_write_kb":158,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.21","version":"254'54","reported_seq":564,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:23.941102+0000","last_change":"2024-06-04T16:23:23.941130+0000","last_active":"2024-06-04T16:23:23.941102+0000","last_peered":"2024-06-04T16:23:23.941102+0000","last_clean":"2024-06-04T16:23:23.941102+0000","last_became_active":"2024-06-04T15:52:36.495008+0000","last_became_peered":"2024-06-04T15:52:36.495008+0000","last_unstale":"2024-06-04T16:23:23.941102+0000","last_undegraded":"2024-06-04T16:23:23.941102+0000","last_fullsized":"2024-06-04T16:23:23.941102+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'54","last_scrub_stamp":"2024-06-04T16:23:23.941009+0000","last_deep_scrub":"254'54","last_deep_scrub_stamp":"2024-06-04T16:23:23.941009+0000","last_clean_scrub_stamp":"2024-06-04T16:23:23.941009+0000","objects_scrubbed":1,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T19:31:11.830953+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":63,"num_read_kb":12338,"num_write":219,"num_write_kb":31559,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.25","version":"254'141","reported_seq":986,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:24.701155+0000","last_change":"2024-06-04T16:23:24.701221+0000","last_active":"2024-06-04T16:23:24.701155+0000","last_peered":"2024-06-04T16:23:24.701155+0000","last_clean":"2024-06-04T16:23:24.701155+0000","last_became_active":"2024-06-04T15:52:38.481916+0000","last_became_peered":"2024-06-04T15:52:38.481916+0000","last_unstale":"2024-06-04T16:23:24.701155+0000","last_undegraded":"2024-06-04T16:23:24.701155+0000","last_fullsized":"2024-06-04T16:23:24.701155+0000","mapping_epoch":23,"log_start":"251'100","ondisk_log_start":"251'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'141","last_scrub_stamp":"2024-06-04T16:23:24.701055+0000","last_deep_scrub":"254'141","last_deep_scrub_stamp":"2024-06-04T16:23:24.701055+0000","last_clean_scrub_stamp":"2024-06-04T16:23:24.701055+0000","objects_scrubbed":3,"log_size":41,"log_dups_size":100,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T18:19:37.940704+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":911,"num_read_kb":859,"num_write":180,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3772,"num_omap_keys":15,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"254'58","reported_seq":594,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:39.538986+0000","last_change":"2024-06-04T16:23:39.539013+0000","last_active":"2024-06-04T16:23:39.538986+0000","last_peered":"2024-06-04T16:23:39.538986+0000","last_clean":"2024-06-04T16:23:39.538986+0000","last_became_active":"2024-06-04T15:52:36.482589+0000","last_became_peered":"2024-06-04T15:52:36.482589+0000","last_unstale":"2024-06-04T16:23:39.538986+0000","last_undegraded":"2024-06-04T16:23:39.538986+0000","last_fullsized":"2024-06-04T16:23:39.538986+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'58","last_scrub_stamp":"2024-06-04T16:23:39.538890+0000","last_deep_scrub":"254'58","last_deep_scrub_stamp":"2024-06-04T16:23:39.538890+0000","last_clean_scrub_stamp":"2024-06-04T16:23:39.538890+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T03:29:04.326921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":134,"num_read_kb":8380,"num_write":298,"num_write_kb":18008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7],"acting":[3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"254'104","reported_seq":821,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:17.351225+0000","last_change":"2024-06-04T16:23:17.351254+0000","last_active":"2024-06-04T16:23:17.351225+0000","last_peered":"2024-06-04T16:23:17.351225+0000","last_clean":"2024-06-04T16:23:17.351225+0000","last_became_active":"2024-06-04T15:52:38.486018+0000","last_became_peered":"2024-06-04T15:52:38.486018+0000","last_unstale":"2024-06-04T16:23:17.351225+0000","last_undegraded":"2024-06-04T16:23:17.351225+0000","last_fullsized":"2024-06-04T16:23:17.351225+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'104","last_scrub_stamp":"2024-06-04T16:23:17.351135+0000","last_deep_scrub":"254'104","last_deep_scrub_stamp":"2024-06-04T16:23:17.351135+0000","last_clean_scrub_stamp":"2024-06-04T16:23:17.351135+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T00:18:13.126137+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":549,"num_read_kb":515,"num_write":118,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"251'48","reported_seq":568,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:21.369617+0000","last_change":"2024-06-04T16:23:21.369661+0000","last_active":"2024-06-04T16:23:21.369617+0000","last_peered":"2024-06-04T16:23:21.369617+0000","last_clean":"2024-06-04T16:23:21.369617+0000","last_became_active":"2024-06-04T15:52:36.496125+0000","last_became_peered":"2024-06-04T15:52:36.496125+0000","last_unstale":"2024-06-04T16:23:21.369617+0000","last_undegraded":"2024-06-04T16:23:21.369617+0000","last_fullsized":"2024-06-04T16:23:21.369617+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"251'48","last_scrub_stamp":"2024-06-04T16:23:21.369501+0000","last_deep_scrub":"251'48","last_deep_scrub_stamp":"2024-06-04T16:23:21.369501+0000","last_clean_scrub_stamp":"2024-06-04T16:23:21.369501+0000","objects_scrubbed":4,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T04:23:20.241786+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":98,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":59,"num_read_kb":26302,"num_write":204,"num_write_kb":24798,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,0],"acting":[5,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.23","version":"254'93","reported_seq":816,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:19.356132+0000","last_change":"2024-06-04T16:23:19.356194+0000","last_active":"2024-06-04T16:23:19.356132+0000","last_peered":"2024-06-04T16:23:19.356132+0000","last_clean":"2024-06-04T16:23:19.356132+0000","last_became_active":"2024-06-04T15:52:38.484927+0000","last_became_peered":"2024-06-04T15:52:38.484927+0000","last_unstale":"2024-06-04T16:23:19.356132+0000","last_undegraded":"2024-06-04T16:23:19.356132+0000","last_fullsized":"2024-06-04T16:23:19.356132+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'93","last_scrub_stamp":"2024-06-04T16:23:19.356033+0000","last_deep_scrub":"254'93","last_deep_scrub_stamp":"2024-06-04T16:23:19.356033+0000","last_clean_scrub_stamp":"2024-06-04T16:23:19.356033+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T02:30:50.349506+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":509,"num_read_kb":485,"num_write":106,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"254'52","reported_seq":564,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:51.205408+0000","last_change":"2024-06-04T16:22:51.205408+0000","last_active":"2024-06-04T16:22:51.205408+0000","last_peered":"2024-06-04T16:22:51.205408+0000","last_clean":"2024-06-04T16:22:51.205408+0000","last_became_active":"2024-06-04T15:53:14.183279+0000","last_became_peered":"2024-06-04T15:53:14.183279+0000","last_unstale":"2024-06-04T16:22:51.205408+0000","last_undegraded":"2024-06-04T16:22:51.205408+0000","last_fullsized":"2024-06-04T16:22:51.205408+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'52","last_scrub_stamp":"2024-06-04T16:22:51.205271+0000","last_deep_scrub":"254'52","last_deep_scrub_stamp":"2024-06-04T16:22:51.205271+0000","last_clean_scrub_stamp":"2024-06-04T16:22:51.205271+0000","objects_scrubbed":3,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T01:25:25.764034+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1395816,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":52,"num_read_kb":1141,"num_write":191,"num_write_kb":22936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.22","version":"254'209","reported_seq":1111,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:52.914929+0000","last_change":"2024-06-04T16:22:52.914964+0000","last_active":"2024-06-04T16:22:52.914929+0000","last_peered":"2024-06-04T16:22:52.914929+0000","last_clean":"2024-06-04T16:22:52.914929+0000","last_became_active":"2024-06-04T15:52:38.488762+0000","last_became_peered":"2024-06-04T15:52:38.488762+0000","last_unstale":"2024-06-04T16:22:52.914929+0000","last_undegraded":"2024-06-04T16:22:52.914929+0000","last_fullsized":"2024-06-04T16:22:52.914929+0000","mapping_epoch":23,"log_start":"251'100","ondisk_log_start":"251'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'209","last_scrub_stamp":"2024-06-04T16:22:52.914808+0000","last_deep_scrub":"254'209","last_deep_scrub_stamp":"2024-06-04T16:22:52.914808+0000","last_clean_scrub_stamp":"2024-06-04T16:22:52.914808+0000","objects_scrubbed":1,"log_size":109,"log_dups_size":100,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T19:07:05.255680+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1221,"num_read_kb":1130,"num_write":279,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.25","version":"254'51","reported_seq":560,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:16.130444+0000","last_change":"2024-06-04T16:23:16.130481+0000","last_active":"2024-06-04T16:23:16.130444+0000","last_peered":"2024-06-04T16:23:16.130444+0000","last_clean":"2024-06-04T16:23:16.130444+0000","last_became_active":"2024-06-04T15:52:36.488611+0000","last_became_peered":"2024-06-04T15:52:36.488611+0000","last_unstale":"2024-06-04T16:23:16.130444+0000","last_undegraded":"2024-06-04T16:23:16.130444+0000","last_fullsized":"2024-06-04T16:23:16.130444+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'51","last_scrub_stamp":"2024-06-04T16:23:16.130347+0000","last_deep_scrub":"254'51","last_deep_scrub_stamp":"2024-06-04T16:23:16.130347+0000","last_clean_scrub_stamp":"2024-06-04T16:23:16.130347+0000","objects_scrubbed":3,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T21:31:44.332783+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":75,"num_read_kb":4172,"num_write":239,"num_write_kb":26328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"254'159","reported_seq":924,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:07.029020+0000","last_change":"2024-06-04T16:23:07.029052+0000","last_active":"2024-06-04T16:23:07.029020+0000","last_peered":"2024-06-04T16:23:07.029020+0000","last_clean":"2024-06-04T16:23:07.029020+0000","last_became_active":"2024-06-04T15:52:38.482566+0000","last_became_peered":"2024-06-04T15:52:38.482566+0000","last_unstale":"2024-06-04T16:23:07.029020+0000","last_undegraded":"2024-06-04T16:23:07.029020+0000","last_fullsized":"2024-06-04T16:23:07.029020+0000","mapping_epoch":23,"log_start":"251'100","ondisk_log_start":"251'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'159","last_scrub_stamp":"2024-06-04T16:23:07.028928+0000","last_deep_scrub":"254'159","last_deep_scrub_stamp":"2024-06-04T16:23:07.028928+0000","last_clean_scrub_stamp":"2024-06-04T16:23:07.028928+0000","objects_scrubbed":2,"log_size":59,"log_dups_size":100,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T03:04:52.237492+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":759,"num_read_kb":686,"num_write":203,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"254'59","reported_seq":569,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:19.645912+0000","last_change":"2024-06-04T16:23:19.646017+0000","last_active":"2024-06-04T16:23:19.645912+0000","last_peered":"2024-06-04T16:23:19.645912+0000","last_clean":"2024-06-04T16:23:19.645912+0000","last_became_active":"2024-06-04T15:52:36.487213+0000","last_became_peered":"2024-06-04T15:52:36.487213+0000","last_unstale":"2024-06-04T16:23:19.645912+0000","last_undegraded":"2024-06-04T16:23:19.645912+0000","last_fullsized":"2024-06-04T16:23:19.645912+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'59","last_scrub_stamp":"2024-06-04T16:23:19.645791+0000","last_deep_scrub":"254'59","last_deep_scrub_stamp":"2024-06-04T16:23:19.645791+0000","last_clean_scrub_stamp":"2024-06-04T16:23:19.645791+0000","objects_scrubbed":10,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T22:08:24.782217+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3860915,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":58,"num_read_kb":7398,"num_write":258,"num_write_kb":28567,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"254'121","reported_seq":871,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:13.303598+0000","last_change":"2024-06-04T16:23:13.303628+0000","last_active":"2024-06-04T16:23:13.303598+0000","last_peered":"2024-06-04T16:23:13.303598+0000","last_clean":"2024-06-04T16:23:13.303598+0000","last_became_active":"2024-06-04T15:52:38.477036+0000","last_became_peered":"2024-06-04T15:52:38.477036+0000","last_unstale":"2024-06-04T16:23:13.303598+0000","last_undegraded":"2024-06-04T16:23:13.303598+0000","last_fullsized":"2024-06-04T16:23:13.303598+0000","mapping_epoch":23,"log_start":"251'100","ondisk_log_start":"251'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'121","last_scrub_stamp":"2024-06-04T16:23:13.303496+0000","last_deep_scrub":"254'121","last_deep_scrub_stamp":"2024-06-04T16:23:13.303496+0000","last_clean_scrub_stamp":"2024-06-04T16:23:13.303496+0000","objects_scrubbed":1,"log_size":21,"log_dups_size":100,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T21:06:12.727561+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":627,"num_read_kb":578,"num_write":156,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"254'48","reported_seq":572,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:30.366835+0000","last_change":"2024-06-04T16:23:30.366909+0000","last_active":"2024-06-04T16:23:30.366835+0000","last_peered":"2024-06-04T16:23:30.366835+0000","last_clean":"2024-06-04T16:23:30.366835+0000","last_became_active":"2024-06-04T15:52:36.479810+0000","last_became_peered":"2024-06-04T15:52:36.479810+0000","last_unstale":"2024-06-04T16:23:30.366835+0000","last_undegraded":"2024-06-04T16:23:30.366835+0000","last_fullsized":"2024-06-04T16:23:30.366835+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'48","last_scrub_stamp":"2024-06-04T16:23:30.366714+0000","last_deep_scrub":"254'48","last_deep_scrub_stamp":"2024-06-04T16:23:30.366714+0000","last_clean_scrub_stamp":"2024-06-04T16:23:30.366714+0000","objects_scrubbed":2,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T00:29:55.578633+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048839,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":103,"num_read_kb":5904,"num_write":252,"num_write_kb":17938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2f","version":"254'58","reported_seq":716,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:28.989494+0000","last_change":"2024-06-04T16:23:28.989521+0000","last_active":"2024-06-04T16:23:28.989494+0000","last_peered":"2024-06-04T16:23:28.989494+0000","last_clean":"2024-06-04T16:23:28.989494+0000","last_became_active":"2024-06-04T15:52:38.481789+0000","last_became_peered":"2024-06-04T15:52:38.481789+0000","last_unstale":"2024-06-04T16:23:28.989494+0000","last_undegraded":"2024-06-04T16:23:28.989494+0000","last_fullsized":"2024-06-04T16:23:28.989494+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'58","last_scrub_stamp":"2024-06-04T16:23:28.989400+0000","last_deep_scrub":"254'58","last_deep_scrub_stamp":"2024-06-04T16:23:28.989400+0000","last_clean_scrub_stamp":"2024-06-04T16:23:28.989400+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T23:45:20.172672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":316,"num_read_kb":309,"num_write":62,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.28","version":"254'57","reported_seq":601,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:33.639337+0000","last_change":"2024-06-04T16:23:33.639408+0000","last_active":"2024-06-04T16:23:33.639337+0000","last_peered":"2024-06-04T16:23:33.639337+0000","last_clean":"2024-06-04T16:23:33.639337+0000","last_became_active":"2024-06-04T15:52:36.490119+0000","last_became_peered":"2024-06-04T15:52:36.490119+0000","last_unstale":"2024-06-04T16:23:33.639337+0000","last_undegraded":"2024-06-04T16:23:33.639337+0000","last_fullsized":"2024-06-04T16:23:33.639337+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'57","last_scrub_stamp":"2024-06-04T16:23:33.639218+0000","last_deep_scrub":"254'57","last_deep_scrub_stamp":"2024-06-04T16:23:33.639218+0000","last_clean_scrub_stamp":"2024-06-04T16:23:33.639218+0000","objects_scrubbed":2,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T02:53:51.075995+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262178,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":124,"num_read_kb":46547,"num_write":231,"num_write_kb":19872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7],"acting":[3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"254'93","reported_seq":787,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:50.895803+0000","last_change":"2024-06-04T16:22:50.895803+0000","last_active":"2024-06-04T16:22:50.895803+0000","last_peered":"2024-06-04T16:22:50.895803+0000","last_clean":"2024-06-04T16:22:50.895803+0000","last_became_active":"2024-06-04T15:52:38.488839+0000","last_became_peered":"2024-06-04T15:52:38.488839+0000","last_unstale":"2024-06-04T16:22:50.895803+0000","last_undegraded":"2024-06-04T16:22:50.895803+0000","last_fullsized":"2024-06-04T16:22:50.895803+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'93","last_scrub_stamp":"2024-06-04T16:22:50.895627+0000","last_deep_scrub":"254'93","last_deep_scrub_stamp":"2024-06-04T16:22:50.895627+0000","last_clean_scrub_stamp":"2024-06-04T16:22:50.895627+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T23:08:02.213621+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":464,"num_read_kb":434,"num_write":108,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.29","version":"254'42","reported_seq":555,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:25.405112+0000","last_change":"2024-06-04T16:23:25.405152+0000","last_active":"2024-06-04T16:23:25.405112+0000","last_peered":"2024-06-04T16:23:25.405112+0000","last_clean":"2024-06-04T16:23:25.405112+0000","last_became_active":"2024-06-04T15:52:36.495936+0000","last_became_peered":"2024-06-04T15:52:36.495936+0000","last_unstale":"2024-06-04T16:23:25.405112+0000","last_undegraded":"2024-06-04T16:23:25.405112+0000","last_fullsized":"2024-06-04T16:23:25.405112+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'42","last_scrub_stamp":"2024-06-04T16:23:25.405021+0000","last_deep_scrub":"254'42","last_deep_scrub_stamp":"2024-06-04T16:23:25.405021+0000","last_clean_scrub_stamp":"2024-06-04T16:23:25.405021+0000","objects_scrubbed":3,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T02:15:18.635727+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133666,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":74,"num_read_kb":10396,"num_write":213,"num_write_kb":18947,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,0],"acting":[5,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2d","version":"254'116","reported_seq":808,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:14.334409+0000","last_change":"2024-06-04T16:23:14.334467+0000","last_active":"2024-06-04T16:23:14.334409+0000","last_peered":"2024-06-04T16:23:14.334409+0000","last_clean":"2024-06-04T16:23:14.334409+0000","last_became_active":"2024-06-04T15:52:38.488289+0000","last_became_peered":"2024-06-04T15:52:38.488289+0000","last_unstale":"2024-06-04T16:23:14.334409+0000","last_undegraded":"2024-06-04T16:23:14.334409+0000","last_fullsized":"2024-06-04T16:23:14.334409+0000","mapping_epoch":23,"log_start":"251'100","ondisk_log_start":"251'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'116","last_scrub_stamp":"2024-06-04T16:23:14.334288+0000","last_deep_scrub":"254'116","last_deep_scrub_stamp":"2024-06-04T16:23:14.334288+0000","last_clean_scrub_stamp":"2024-06-04T16:23:14.334288+0000","objects_scrubbed":1,"log_size":16,"log_dups_size":100,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T23:45:48.859590+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":534,"num_read_kb":481,"num_write":150,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":476,"num_omap_keys":2,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"254'66","reported_seq":583,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:20.375444+0000","last_change":"2024-06-04T16:23:20.375511+0000","last_active":"2024-06-04T16:23:20.375444+0000","last_peered":"2024-06-04T16:23:20.375444+0000","last_clean":"2024-06-04T16:23:20.375444+0000","last_became_active":"2024-06-04T15:52:36.495386+0000","last_became_peered":"2024-06-04T15:52:36.495386+0000","last_unstale":"2024-06-04T16:23:20.375444+0000","last_undegraded":"2024-06-04T16:23:20.375444+0000","last_fullsized":"2024-06-04T16:23:20.375444+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'66","last_scrub_stamp":"2024-06-04T16:23:20.375334+0000","last_deep_scrub":"254'66","last_deep_scrub_stamp":"2024-06-04T16:23:20.375334+0000","last_clean_scrub_stamp":"2024-06-04T16:23:20.375334+0000","objects_scrubbed":6,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T23:23:00.148285+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4553920,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":69,"num_read_kb":17530,"num_write":238,"num_write_kb":31151,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"254'93","reported_seq":840,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:11.291672+0000","last_change":"2024-06-04T16:23:11.291720+0000","last_active":"2024-06-04T16:23:11.291672+0000","last_peered":"2024-06-04T16:23:11.291672+0000","last_clean":"2024-06-04T16:23:11.291672+0000","last_became_active":"2024-06-04T15:52:38.477333+0000","last_became_peered":"2024-06-04T15:52:38.477333+0000","last_unstale":"2024-06-04T16:23:11.291672+0000","last_undegraded":"2024-06-04T16:23:11.291672+0000","last_fullsized":"2024-06-04T16:23:11.291672+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'93","last_scrub_stamp":"2024-06-04T16:23:11.291552+0000","last_deep_scrub":"254'93","last_deep_scrub_stamp":"2024-06-04T16:23:11.291552+0000","last_clean_scrub_stamp":"2024-06-04T16:23:11.291552+0000","objects_scrubbed":3,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T18:53:46.897687+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":521,"num_read_kb":500,"num_write":102,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"251'47","reported_seq":567,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:22.840571+0000","last_change":"2024-06-04T16:23:22.840607+0000","last_active":"2024-06-04T16:23:22.840571+0000","last_peered":"2024-06-04T16:23:22.840571+0000","last_clean":"2024-06-04T16:23:22.840571+0000","last_became_active":"2024-06-04T15:52:36.482036+0000","last_became_peered":"2024-06-04T15:52:36.482036+0000","last_unstale":"2024-06-04T16:23:22.840571+0000","last_undegraded":"2024-06-04T16:23:22.840571+0000","last_fullsized":"2024-06-04T16:23:22.840571+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"251'47","last_scrub_stamp":"2024-06-04T16:23:22.840471+0000","last_deep_scrub":"251'47","last_deep_scrub_stamp":"2024-06-04T16:23:22.840471+0000","last_clean_scrub_stamp":"2024-06-04T16:23:22.840471+0000","objects_scrubbed":3,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T03:52:07.635574+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1069194,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":76,"num_read_kb":25646,"num_write":152,"num_write_kb":18921,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,6],"acting":[4,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"254'150","reported_seq":912,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:07.252865+0000","last_change":"2024-06-04T16:23:07.252889+0000","last_active":"2024-06-04T16:23:07.252865+0000","last_peered":"2024-06-04T16:23:07.252865+0000","last_clean":"2024-06-04T16:23:07.252865+0000","last_became_active":"2024-06-04T15:52:38.480432+0000","last_became_peered":"2024-06-04T15:52:38.480432+0000","last_unstale":"2024-06-04T16:23:07.252865+0000","last_undegraded":"2024-06-04T16:23:07.252865+0000","last_fullsized":"2024-06-04T16:23:07.252865+0000","mapping_epoch":23,"log_start":"251'100","ondisk_log_start":"251'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'150","last_scrub_stamp":"2024-06-04T16:23:07.252763+0000","last_deep_scrub":"254'150","last_deep_scrub_stamp":"2024-06-04T16:23:07.252763+0000","last_clean_scrub_stamp":"2024-06-04T16:23:07.252763+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":100,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T02:08:42.991893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":703,"num_read_kb":638,"num_write":178,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"254'54","reported_seq":563,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:07.803392+0000","last_change":"2024-06-04T16:23:07.803428+0000","last_active":"2024-06-04T16:23:07.803392+0000","last_peered":"2024-06-04T16:23:07.803392+0000","last_clean":"2024-06-04T16:23:07.803392+0000","last_became_active":"2024-06-04T15:52:36.488813+0000","last_became_peered":"2024-06-04T15:52:36.488813+0000","last_unstale":"2024-06-04T16:23:07.803392+0000","last_undegraded":"2024-06-04T16:23:07.803392+0000","last_fullsized":"2024-06-04T16:23:07.803392+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'54","last_scrub_stamp":"2024-06-04T16:23:07.803315+0000","last_deep_scrub":"254'54","last_deep_scrub_stamp":"2024-06-04T16:23:07.803315+0000","last_clean_scrub_stamp":"2024-06-04T16:23:07.803315+0000","objects_scrubbed":4,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T22:56:04.807428+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":75,"num_read_kb":5170,"num_write":190,"num_write_kb":17954,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6],"acting":[0,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"254'97","reported_seq":800,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:25.933581+0000","last_change":"2024-06-04T16:23:25.933605+0000","last_active":"2024-06-04T16:23:25.933581+0000","last_peered":"2024-06-04T16:23:25.933581+0000","last_clean":"2024-06-04T16:23:25.933581+0000","last_became_active":"2024-06-04T15:52:38.479542+0000","last_became_peered":"2024-06-04T15:52:38.479542+0000","last_unstale":"2024-06-04T16:23:25.933581+0000","last_undegraded":"2024-06-04T16:23:25.933581+0000","last_fullsized":"2024-06-04T16:23:25.933581+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'97","last_scrub_stamp":"2024-06-04T16:23:25.933492+0000","last_deep_scrub":"254'97","last_deep_scrub_stamp":"2024-06-04T16:23:25.933492+0000","last_clean_scrub_stamp":"2024-06-04T16:23:25.933492+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T17:01:29.653836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":493,"num_read_kb":461,"num_write":115,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"251'65","reported_seq":583,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:42.590419+0000","last_change":"2024-06-04T16:23:42.590498+0000","last_active":"2024-06-04T16:23:42.590419+0000","last_peered":"2024-06-04T16:23:42.590419+0000","last_clean":"2024-06-04T16:23:42.590419+0000","last_became_active":"2024-06-04T15:52:36.487971+0000","last_became_peered":"2024-06-04T15:52:36.487971+0000","last_unstale":"2024-06-04T16:23:42.590419+0000","last_undegraded":"2024-06-04T16:23:42.590419+0000","last_fullsized":"2024-06-04T16:23:42.590419+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"251'65","last_scrub_stamp":"2024-06-04T16:23:42.590307+0000","last_deep_scrub":"251'65","last_deep_scrub_stamp":"2024-06-04T16:23:42.590307+0000","last_clean_scrub_stamp":"2024-06-04T16:23:42.590307+0000","objects_scrubbed":2,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T01:08:00.886417+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262163,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":94,"num_read_kb":7564,"num_write":255,"num_write_kb":36740,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"254'139","reported_seq":923,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:09.050239+0000","last_change":"2024-06-04T16:23:09.050266+0000","last_active":"2024-06-04T16:23:09.050239+0000","last_peered":"2024-06-04T16:23:09.050239+0000","last_clean":"2024-06-04T16:23:09.050239+0000","last_became_active":"2024-06-04T15:52:38.484225+0000","last_became_peered":"2024-06-04T15:52:38.484225+0000","last_unstale":"2024-06-04T16:23:09.050239+0000","last_undegraded":"2024-06-04T16:23:09.050239+0000","last_fullsized":"2024-06-04T16:23:09.050239+0000","mapping_epoch":23,"log_start":"251'100","ondisk_log_start":"251'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'139","last_scrub_stamp":"2024-06-04T16:23:09.050145+0000","last_deep_scrub":"254'139","last_deep_scrub_stamp":"2024-06-04T16:23:09.050145+0000","last_clean_scrub_stamp":"2024-06-04T16:23:09.050145+0000","objects_scrubbed":3,"log_size":39,"log_dups_size":100,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T18:11:37.986197+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":727,"num_read_kb":670,"num_write":170,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2e","version":"254'55","reported_seq":576,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:22.905314+0000","last_change":"2024-06-04T16:23:22.905373+0000","last_active":"2024-06-04T16:23:22.905314+0000","last_peered":"2024-06-04T16:23:22.905314+0000","last_clean":"2024-06-04T16:23:22.905314+0000","last_became_active":"2024-06-04T15:52:36.488139+0000","last_became_peered":"2024-06-04T15:52:36.488139+0000","last_unstale":"2024-06-04T16:23:22.905314+0000","last_undegraded":"2024-06-04T16:23:22.905314+0000","last_fullsized":"2024-06-04T16:23:22.905314+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'55","last_scrub_stamp":"2024-06-04T16:23:22.905216+0000","last_deep_scrub":"254'55","last_deep_scrub_stamp":"2024-06-04T16:23:22.905216+0000","last_clean_scrub_stamp":"2024-06-04T16:23:22.905216+0000","objects_scrubbed":3,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T21:51:27.324326+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":103,"num_read_kb":14422,"num_write":268,"num_write_kb":32685,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,3],"acting":[7,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.28","version":"254'291","reported_seq":1135,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:09.264260+0000","last_change":"2024-06-04T16:23:09.264288+0000","last_active":"2024-06-04T16:23:09.264260+0000","last_peered":"2024-06-04T16:23:09.264260+0000","last_clean":"2024-06-04T16:23:09.264260+0000","last_became_active":"2024-06-04T15:52:38.480613+0000","last_became_peered":"2024-06-04T15:52:38.480613+0000","last_unstale":"2024-06-04T16:23:09.264260+0000","last_undegraded":"2024-06-04T16:23:09.264260+0000","last_fullsized":"2024-06-04T16:23:09.264260+0000","mapping_epoch":23,"log_start":"251'200","ondisk_log_start":"251'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'291","last_scrub_stamp":"2024-06-04T16:23:09.264173+0000","last_deep_scrub":"254'291","last_deep_scrub_stamp":"2024-06-04T16:23:09.264173+0000","last_clean_scrub_stamp":"2024-06-04T16:23:09.264173+0000","objects_scrubbed":2,"log_size":91,"log_dups_size":200,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T17:25:59.350082+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1456,"num_read_kb":1243,"num_write":452,"num_write_kb":208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2565,"num_omap_keys":10,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"254'57","reported_seq":567,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:29.654790+0000","last_change":"2024-06-04T16:23:29.654838+0000","last_active":"2024-06-04T16:23:29.654790+0000","last_peered":"2024-06-04T16:23:29.654790+0000","last_clean":"2024-06-04T16:23:29.654790+0000","last_became_active":"2024-06-04T15:52:36.498564+0000","last_became_peered":"2024-06-04T15:52:36.498564+0000","last_unstale":"2024-06-04T16:23:29.654790+0000","last_undegraded":"2024-06-04T16:23:29.654790+0000","last_fullsized":"2024-06-04T16:23:29.654790+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'57","last_scrub_stamp":"2024-06-04T16:23:29.654695+0000","last_deep_scrub":"254'57","last_deep_scrub_stamp":"2024-06-04T16:23:29.654695+0000","last_clean_scrub_stamp":"2024-06-04T16:23:29.654695+0000","objects_scrubbed":3,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T22:40:49.101290+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1395816,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":73,"num_read_kb":11423,"num_write":228,"num_write_kb":34926,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"251'38","reported_seq":558,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:35.564079+0000","last_change":"2024-06-04T16:23:35.564132+0000","last_active":"2024-06-04T16:23:35.564079+0000","last_peered":"2024-06-04T16:23:35.564079+0000","last_clean":"2024-06-04T16:23:35.564079+0000","last_became_active":"2024-06-04T15:52:36.489681+0000","last_became_peered":"2024-06-04T15:52:36.489681+0000","last_unstale":"2024-06-04T16:23:35.564079+0000","last_undegraded":"2024-06-04T16:23:35.564079+0000","last_fullsized":"2024-06-04T16:23:35.564079+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"251'38","last_scrub_stamp":"2024-06-04T16:23:35.563977+0000","last_deep_scrub":"251'38","last_deep_scrub_stamp":"2024-06-04T16:23:35.563977+0000","last_clean_scrub_stamp":"2024-06-04T16:23:35.563977+0000","objects_scrubbed":3,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T02:15:55.013149+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1395831,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":78,"num_read_kb":4250,"num_write":172,"num_write_kb":18293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,6],"acting":[3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"254'121","reported_seq":1033,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:01.992253+0000","last_change":"2024-06-04T16:23:01.992301+0000","last_active":"2024-06-04T16:23:01.992253+0000","last_peered":"2024-06-04T16:23:01.992253+0000","last_clean":"2024-06-04T16:23:01.992253+0000","last_became_active":"2024-06-04T15:52:38.488941+0000","last_became_peered":"2024-06-04T15:52:38.488941+0000","last_unstale":"2024-06-04T16:23:01.992253+0000","last_undegraded":"2024-06-04T16:23:01.992253+0000","last_fullsized":"2024-06-04T16:23:01.992253+0000","mapping_epoch":23,"log_start":"251'100","ondisk_log_start":"251'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'121","last_scrub_stamp":"2024-06-04T16:23:01.992144+0000","last_deep_scrub":"254'121","last_deep_scrub_stamp":"2024-06-04T16:23:01.992144+0000","last_clean_scrub_stamp":"2024-06-04T16:23:01.992144+0000","objects_scrubbed":2,"log_size":21,"log_dups_size":100,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T21:08:34.393894+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1004,"num_read_kb":976,"num_write":157,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2539,"num_omap_keys":10,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"251'45","reported_seq":552,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:23.381840+0000","last_change":"2024-06-04T16:23:23.381889+0000","last_active":"2024-06-04T16:23:23.381840+0000","last_peered":"2024-06-04T16:23:23.381840+0000","last_clean":"2024-06-04T16:23:23.381840+0000","last_became_active":"2024-06-04T15:52:36.496046+0000","last_became_peered":"2024-06-04T15:52:36.496046+0000","last_unstale":"2024-06-04T16:23:23.381840+0000","last_undegraded":"2024-06-04T16:23:23.381840+0000","last_fullsized":"2024-06-04T16:23:23.381840+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"251'45","last_scrub_stamp":"2024-06-04T16:23:23.381742+0000","last_deep_scrub":"251'45","last_deep_scrub_stamp":"2024-06-04T16:23:23.381742+0000","last_clean_scrub_stamp":"2024-06-04T16:23:23.381742+0000","objects_scrubbed":2,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T20:03:46.055994+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1069179,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":46,"num_read_kb":3657,"num_write":159,"num_write_kb":22961,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3],"acting":[5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.36","version":"254'113","reported_seq":828,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:21.411378+0000","last_change":"2024-06-04T16:23:21.411405+0000","last_active":"2024-06-04T16:23:21.411378+0000","last_peered":"2024-06-04T16:23:21.411378+0000","last_clean":"2024-06-04T16:23:21.411378+0000","last_became_active":"2024-06-04T15:52:38.474574+0000","last_became_peered":"2024-06-04T15:52:38.474574+0000","last_unstale":"2024-06-04T16:23:21.411378+0000","last_undegraded":"2024-06-04T16:23:21.411378+0000","last_fullsized":"2024-06-04T16:23:21.411378+0000","mapping_epoch":23,"log_start":"254'100","ondisk_log_start":"254'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'113","last_scrub_stamp":"2024-06-04T16:23:21.411261+0000","last_deep_scrub":"254'113","last_deep_scrub_stamp":"2024-06-04T16:23:21.411261+0000","last_clean_scrub_stamp":"2024-06-04T16:23:21.411261+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":100,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T02:22:44.411264+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":563,"num_read_kb":518,"num_write":138,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":16777216,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":169,"num_read_kb":189232,"num_write":179,"num_write_kb":125730,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":33554432,"data_stored":33554432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":133,"ondisk_log_size":133,"up":64,"acting":64,"num_store_stats":8},{"poolid":64,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4378,"num_read_kb":3242,"num_write":1279,"num_write_kb":637,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4455,"num_omap_keys":9,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":683,"ondisk_log_size":683,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":8922,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":3579,"num_read_kb":3443,"num_write":3611,"num_write_kb":1042,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1201,"num_omap_keys":7,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":319488,"data_stored":17844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1044,"ondisk_log_size":1044,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":566,"ondisk_log_size":566,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":300865,"num_objects":188,"num_object_clones":0,"num_object_copies":376,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":188,"num_whiteouts":0,"num_read":6099,"num_read_kb":7761,"num_write":3199,"num_write_kb":973,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":151988,"num_omap_keys":372,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1864,"ondisk_log_size":1864,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1533,"num_read_kb":1825,"num_write":20,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17,"ondisk_log_size":17,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":77,"num_object_clones":0,"num_object_copies":154,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":77,"num_whiteouts":0,"num_read":48565,"num_read_kb":44901,"num_write":11590,"num_write_kb":3535,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":77,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":33584,"num_omap_keys":140,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3735,"ondisk_log_size":3735,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":85563130,"num_objects":200,"num_object_clones":0,"num_object_copies":600,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":200,"num_whiteouts":0,"num_read":5481,"num_read_kb":1011284,"num_write":14360,"num_write_kb":1691909,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":130080768,"data_stored":130080768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3497,"ondisk_log_size":3497,"up":192,"acting":192,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":12,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":564,"num_omap_keys":6,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7,"ondisk_log_size":7,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":16777216,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":170,"num_read_kb":185843,"num_write":179,"num_write_kb":125730,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":33554432,"data_stored":33554432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":133,"ondisk_log_size":133,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542526,"num_pgs":96,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":195128,"kb_used_data":23792,"kb_used_omap":1,"kb_used_meta":171326,"kb_avail":94176712,"statfs":{"total":96636764160,"available":96436953088,"internally_reserved":0,"allocated":24363008,"data_stored":22488525,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":175438282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542526,"num_pgs":108,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":73832,"kb_used_data":24608,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94298008,"statfs":{"total":96636764160,"available":96561160192,"internally_reserved":0,"allocated":25198592,"data_stored":23328559,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":50395591},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542525,"num_pgs":115,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":224796,"kb_used_data":22868,"kb_used_omap":1,"kb_used_meta":201918,"kb_avail":94147044,"statfs":{"total":96636764160,"available":96406573056,"internally_reserved":0,"allocated":23416832,"data_stored":21539413,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":206764485},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542523,"num_pgs":122,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":150856,"kb_used_data":33664,"kb_used_omap":1,"kb_used_meta":117182,"kb_avail":94220984,"statfs":{"total":96636764160,"available":96482287616,"internally_reserved":0,"allocated":34471936,"data_stored":32597872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":119994821},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542526,"num_pgs":119,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":205024,"kb_used_data":29464,"kb_used_omap":1,"kb_used_meta":175550,"kb_avail":94166816,"statfs":{"total":96636764160,"available":96426819584,"internally_reserved":0,"allocated":30171136,"data_stored":28278302,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":179763655},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542526,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":98200,"kb_used_data":22608,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94273640,"statfs":{"total":96636764160,"available":96536207360,"internally_reserved":0,"allocated":23150592,"data_stored":21269158,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":77396421},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542525,"num_pgs":98,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":266972,"kb_used_data":37268,"kb_used_omap":1,"kb_used_meta":229694,"kb_avail":94104868,"statfs":{"total":96636764160,"available":96363384832,"internally_reserved":0,"allocated":38162432,"data_stored":36275175,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":235207109},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542526,"num_pgs":93,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":80224,"kb_used_data":31000,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94291616,"statfs":{"total":96636764160,"available":96554614784,"internally_reserved":0,"allocated":31744000,"data_stored":29845910,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":25591808,"data_stored":25591808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":22585344,"data_stored":22585344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":14917632,"data_stored":14917632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":18190336,"data_stored":18190336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":18907136,"data_stored":18907136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":10403840,"data_stored":10403840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":10686464,"data_stored":10686464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8798208,"data_stored":8798208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":1139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":1364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2484,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1047,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":2789,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":2757,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2173,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2491,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1703,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":64,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":64,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":64,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":64,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":64,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":64,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":64,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":64,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":1048576,"data_stored":1048576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":1048576,"data_stored":1048576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":7340032,"data_stored":7340032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":5242880,"data_stored":5242880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4194304,"data_stored":4194304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":9437184,"data_stored":9437184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":5242880,"data_stored":5242880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":1048576,"data_stored":1048576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":10485760,"data_stored":10485760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4194304,"data_stored":4194304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":6291456,"data_stored":6291456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4194304,"data_stored":4194304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":1048576,"data_stored":1048576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":6291456,"data_stored":6291456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-06-04T16:23:48.587 INFO:tasks.ceph:pgid 67.18 last_scrub_stamp 2024-06-04T16:16:07.631263+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=16, tm_sec=7, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:48.588 INFO:tasks.ceph:pgid 67.12 last_scrub_stamp 2024-06-04T16:16:07.631263+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=16, tm_sec=7, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:48.588 INFO:tasks.ceph:pgid 67.9 last_scrub_stamp 2024-06-04T16:16:07.631263+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=16, tm_sec=7, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:48.588 INFO:tasks.ceph:pgid 66.4 last_scrub_stamp 2024-06-04T16:09:25.601105+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=9, tm_sec=25, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:48.589 INFO:tasks.ceph:pgid 67.6 last_scrub_stamp 2024-06-04T16:16:07.631263+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=16, tm_sec=7, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:48.589 INFO:tasks.ceph:pgid 66.7 last_scrub_stamp 2024-06-04T16:09:25.601105+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=9, tm_sec=25, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:48.589 INFO:tasks.ceph:pgid 67.0 last_scrub_stamp 2024-06-04T16:16:07.631263+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=16, tm_sec=7, tm_wday=1, tm_yday=156, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=4, tm_hour=16, tm_min=22, tm_sec=42, tm_wday=1, tm_yday=156, tm_isdst=0) 2024-06-04T16:23:48.592 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-06-04T16:24:08.593 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-06-04T16:24:08.937 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-06-04T16:24:08.949 INFO:teuthology.orchestra.run.smithi144.stderr:dumped all 2024-06-04T16:24:08.951 INFO:teuthology.orchestra.run.smithi144.stdout:{"pg_ready":true,"pg_map":{"version":1201,"stamp":"2024-06-04T16:24:07.590902+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":120019510,"num_objects":545,"num_object_clones":0,"num_object_copies":1290,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":545,"num_whiteouts":0,"num_read":70048,"num_read_kb":1447594,"num_write":34530,"num_write_kb":1951205,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":99,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":191980,"num_omap_keys":536,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11754,"ondisk_log_size":11754,"up":850,"acting":850,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":850,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1295032,"kb_used_data":225272,"kb_used_omap":12,"kb_used_meta":1069683,"kb_avail":753679688,"statfs":{"total":773094113280,"available":771768000512,"internally_reserved":0,"allocated":230678528,"data_stored":215622914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":1095355953},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005455"},"pg_stats":[{"pgid":"67.1c","version":"0'0","reported_seq":24,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:26.763016+0000","last_change":"2024-06-04T16:23:26.763016+0000","last_active":"2024-06-04T16:23:26.763016+0000","last_peered":"2024-06-04T16:23:26.763016+0000","last_clean":"2024-06-04T16:23:26.763016+0000","last_became_active":"2024-06-04T16:16:08.658205+0000","last_became_peered":"2024-06-04T16:16:08.658205+0000","last_unstale":"2024-06-04T16:23:26.763016+0000","last_undegraded":"2024-06-04T16:23:26.763016+0000","last_fullsized":"2024-06-04T16:23:26.763016+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:23:26.762877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:23:26.762877+0000","last_clean_scrub_stamp":"2024-06-04T16:23:26.762877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T20:49:22.849059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1d","version":"251'2","reported_seq":36,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:06.405019+0000","last_change":"2024-06-04T16:23:06.405045+0000","last_active":"2024-06-04T16:23:06.405019+0000","last_peered":"2024-06-04T16:23:06.405019+0000","last_clean":"2024-06-04T16:23:06.405019+0000","last_became_active":"2024-06-04T16:09:26.627678+0000","last_became_peered":"2024-06-04T16:09:26.627678+0000","last_unstale":"2024-06-04T16:23:06.405019+0000","last_undegraded":"2024-06-04T16:23:06.405019+0000","last_fullsized":"2024-06-04T16:23:06.405019+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"251'2","last_scrub_stamp":"2024-06-04T16:23:06.404918+0000","last_deep_scrub":"251'2","last_deep_scrub_stamp":"2024-06-04T16:23:06.404918+0000","last_clean_scrub_stamp":"2024-06-04T16:23:06.404918+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T17:19:48.169731+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1e","version":"254'2","reported_seq":43,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:30.899471+0000","last_change":"2024-06-04T16:23:30.899499+0000","last_active":"2024-06-04T16:23:30.899471+0000","last_peered":"2024-06-04T16:23:30.899471+0000","last_clean":"2024-06-04T16:23:30.899471+0000","last_became_active":"2024-06-04T16:09:23.610020+0000","last_became_peered":"2024-06-04T16:09:23.610020+0000","last_unstale":"2024-06-04T16:23:30.899471+0000","last_undegraded":"2024-06-04T16:23:30.899471+0000","last_fullsized":"2024-06-04T16:23:30.899471+0000","mapping_epoch":246,"log_start":"0'0","ondisk_log_start":"0'0","created":246,"last_epoch_clean":247,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'2","last_scrub_stamp":"2024-06-04T16:23:30.899375+0000","last_deep_scrub":"254'2","last_deep_scrub_stamp":"2024-06-04T16:23:30.899375+0000","last_clean_scrub_stamp":"2024-06-04T16:23:30.899375+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T22:21:31.966657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"64.1f","version":"251'21","reported_seq":104,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:53.425264+0000","last_change":"2024-06-04T16:22:53.425264+0000","last_active":"2024-06-04T16:22:53.425264+0000","last_peered":"2024-06-04T16:22:53.425264+0000","last_clean":"2024-06-04T16:22:53.425264+0000","last_became_active":"2024-06-04T16:07:09.402073+0000","last_became_peered":"2024-06-04T16:07:09.402073+0000","last_unstale":"2024-06-04T16:22:53.425264+0000","last_undegraded":"2024-06-04T16:22:53.425264+0000","last_fullsized":"2024-06-04T16:22:53.425264+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":243,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"251'21","last_scrub_stamp":"2024-06-04T16:22:53.425132+0000","last_deep_scrub":"251'21","last_deep_scrub_stamp":"2024-06-04T16:22:53.425132+0000","last_clean_scrub_stamp":"2024-06-04T16:22:53.425132+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T16:33:19.953015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":108,"num_read_kb":75,"num_write":41,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1d","version":"0'0","reported_seq":24,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:29.290297+0000","last_change":"2024-06-04T16:23:29.290297+0000","last_active":"2024-06-04T16:23:29.290297+0000","last_peered":"2024-06-04T16:23:29.290297+0000","last_clean":"2024-06-04T16:23:29.290297+0000","last_became_active":"2024-06-04T16:16:08.656388+0000","last_became_peered":"2024-06-04T16:16:08.656388+0000","last_unstale":"2024-06-04T16:23:29.290297+0000","last_undegraded":"2024-06-04T16:23:29.290297+0000","last_fullsized":"2024-06-04T16:23:29.290297+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:23:29.290129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:23:29.290129+0000","last_clean_scrub_stamp":"2024-06-04T16:23:29.290129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T21:24:30.090203+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.1c","version":"254'2","reported_seq":35,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:56.032254+0000","last_change":"2024-06-04T16:22:56.032296+0000","last_active":"2024-06-04T16:22:56.032254+0000","last_peered":"2024-06-04T16:22:56.032254+0000","last_clean":"2024-06-04T16:22:56.032254+0000","last_became_active":"2024-06-04T16:09:26.626964+0000","last_became_peered":"2024-06-04T16:09:26.626964+0000","last_unstale":"2024-06-04T16:22:56.032254+0000","last_undegraded":"2024-06-04T16:22:56.032254+0000","last_fullsized":"2024-06-04T16:22:56.032254+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'2","last_scrub_stamp":"2024-06-04T16:22:56.032145+0000","last_deep_scrub":"254'2","last_deep_scrub_stamp":"2024-06-04T16:22:56.032145+0000","last_clean_scrub_stamp":"2024-06-04T16:22:56.032145+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T17:55:10.954470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1f","version":"254'4","reported_seq":47,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:28.871746+0000","last_change":"2024-06-04T16:23:28.871746+0000","last_active":"2024-06-04T16:23:28.871746+0000","last_peered":"2024-06-04T16:23:28.871746+0000","last_clean":"2024-06-04T16:23:28.871746+0000","last_became_active":"2024-06-04T16:09:23.608251+0000","last_became_peered":"2024-06-04T16:09:23.608251+0000","last_unstale":"2024-06-04T16:23:28.871746+0000","last_undegraded":"2024-06-04T16:23:28.871746+0000","last_fullsized":"2024-06-04T16:23:28.871746+0000","mapping_epoch":246,"log_start":"0'0","ondisk_log_start":"0'0","created":246,"last_epoch_clean":247,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'4","last_scrub_stamp":"2024-06-04T16:23:28.871643+0000","last_deep_scrub":"254'4","last_deep_scrub_stamp":"2024-06-04T16:23:28.871643+0000","last_clean_scrub_stamp":"2024-06-04T16:23:28.871643+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T23:07:23.476595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":8192,"num_write":4,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"64.1e","version":"251'15","reported_seq":89,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:59.041515+0000","last_change":"2024-06-04T16:22:59.041515+0000","last_active":"2024-06-04T16:22:59.041515+0000","last_peered":"2024-06-04T16:22:59.041515+0000","last_clean":"2024-06-04T16:22:59.041515+0000","last_became_active":"2024-06-04T16:07:09.511253+0000","last_became_peered":"2024-06-04T16:07:09.511253+0000","last_unstale":"2024-06-04T16:22:59.041515+0000","last_undegraded":"2024-06-04T16:22:59.041515+0000","last_fullsized":"2024-06-04T16:22:59.041515+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":243,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"251'15","last_scrub_stamp":"2024-06-04T16:22:59.041341+0000","last_deep_scrub":"251'15","last_deep_scrub_stamp":"2024-06-04T16:22:59.041341+0000","last_clean_scrub_stamp":"2024-06-04T16:22:59.041341+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T18:09:07.672420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":58,"num_write":26,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1e","version":"0'0","reported_seq":24,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:40.355007+0000","last_change":"2024-06-04T16:23:40.355043+0000","last_active":"2024-06-04T16:23:40.355007+0000","last_peered":"2024-06-04T16:23:40.355007+0000","last_clean":"2024-06-04T16:23:40.355007+0000","last_became_active":"2024-06-04T16:16:08.660635+0000","last_became_peered":"2024-06-04T16:16:08.660635+0000","last_unstale":"2024-06-04T16:23:40.355007+0000","last_undegraded":"2024-06-04T16:23:40.355007+0000","last_fullsized":"2024-06-04T16:23:40.355007+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:23:40.354873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:23:40.354873+0000","last_clean_scrub_stamp":"2024-06-04T16:23:40.354873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T03:07:14.790083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1f","version":"0'0","reported_seq":34,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:26.242384+0000","last_change":"2024-06-04T16:23:26.242384+0000","last_active":"2024-06-04T16:23:26.242384+0000","last_peered":"2024-06-04T16:23:26.242384+0000","last_clean":"2024-06-04T16:23:26.242384+0000","last_became_active":"2024-06-04T16:09:26.624510+0000","last_became_peered":"2024-06-04T16:09:26.624510+0000","last_unstale":"2024-06-04T16:23:26.242384+0000","last_undegraded":"2024-06-04T16:23:26.242384+0000","last_fullsized":"2024-06-04T16:23:26.242384+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:23:26.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:23:26.242226+0000","last_clean_scrub_stamp":"2024-06-04T16:23:26.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T23:46:14.456771+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1c","version":"0'0","reported_seq":38,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:54.138875+0000","last_change":"2024-06-04T16:22:54.138938+0000","last_active":"2024-06-04T16:22:54.138875+0000","last_peered":"2024-06-04T16:22:54.138875+0000","last_clean":"2024-06-04T16:22:54.138875+0000","last_became_active":"2024-06-04T16:09:23.612278+0000","last_became_peered":"2024-06-04T16:09:23.612278+0000","last_unstale":"2024-06-04T16:22:54.138875+0000","last_undegraded":"2024-06-04T16:22:54.138875+0000","last_fullsized":"2024-06-04T16:22:54.138875+0000","mapping_epoch":246,"log_start":"0'0","ondisk_log_start":"0'0","created":246,"last_epoch_clean":247,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:22:54.138763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:22:54.138763+0000","last_clean_scrub_stamp":"2024-06-04T16:22:54.138763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T18:25:29.872798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"64.1d","version":"251'28","reported_seq":123,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:56.120753+0000","last_change":"2024-06-04T16:22:56.120781+0000","last_active":"2024-06-04T16:22:56.120753+0000","last_peered":"2024-06-04T16:22:56.120753+0000","last_clean":"2024-06-04T16:22:56.120753+0000","last_became_active":"2024-06-04T16:07:09.511154+0000","last_became_peered":"2024-06-04T16:07:09.511154+0000","last_unstale":"2024-06-04T16:22:56.120753+0000","last_undegraded":"2024-06-04T16:22:56.120753+0000","last_fullsized":"2024-06-04T16:22:56.120753+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":243,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"251'28","last_scrub_stamp":"2024-06-04T16:22:56.120659+0000","last_deep_scrub":"251'28","last_deep_scrub_stamp":"2024-06-04T16:22:56.120659+0000","last_clean_scrub_stamp":"2024-06-04T16:22:56.120659+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T00:05:26.471359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":150,"num_read_kb":106,"num_write":50,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.1f","version":"0'0","reported_seq":24,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:41.401820+0000","last_change":"2024-06-04T16:23:41.401872+0000","last_active":"2024-06-04T16:23:41.401820+0000","last_peered":"2024-06-04T16:23:41.401820+0000","last_clean":"2024-06-04T16:23:41.401820+0000","last_became_active":"2024-06-04T16:16:08.660669+0000","last_became_peered":"2024-06-04T16:16:08.660669+0000","last_unstale":"2024-06-04T16:23:41.401820+0000","last_undegraded":"2024-06-04T16:23:41.401820+0000","last_fullsized":"2024-06-04T16:23:41.401820+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:23:41.401719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:23:41.401719+0000","last_clean_scrub_stamp":"2024-06-04T16:23:41.401719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T21:00:41.463198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1e","version":"254'2","reported_seq":37,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:47.038152+0000","last_change":"2024-06-04T16:22:47.038152+0000","last_active":"2024-06-04T16:22:47.038152+0000","last_peered":"2024-06-04T16:22:47.038152+0000","last_clean":"2024-06-04T16:22:47.038152+0000","last_became_active":"2024-06-04T16:09:26.621326+0000","last_became_peered":"2024-06-04T16:09:26.621326+0000","last_unstale":"2024-06-04T16:22:47.038152+0000","last_undegraded":"2024-06-04T16:22:47.038152+0000","last_fullsized":"2024-06-04T16:22:47.038152+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'2","last_scrub_stamp":"2024-06-04T16:22:47.037993+0000","last_deep_scrub":"254'2","last_deep_scrub_stamp":"2024-06-04T16:22:47.037993+0000","last_clean_scrub_stamp":"2024-06-04T16:22:47.037993+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T21:14:40.434297+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1d","version":"254'5","reported_seq":46,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:47.213650+0000","last_change":"2024-06-04T16:22:47.213678+0000","last_active":"2024-06-04T16:22:47.213650+0000","last_peered":"2024-06-04T16:22:47.213650+0000","last_clean":"2024-06-04T16:22:47.213650+0000","last_became_active":"2024-06-04T16:09:23.606918+0000","last_became_peered":"2024-06-04T16:09:23.606918+0000","last_unstale":"2024-06-04T16:22:47.213650+0000","last_undegraded":"2024-06-04T16:22:47.213650+0000","last_fullsized":"2024-06-04T16:22:47.213650+0000","mapping_epoch":246,"log_start":"0'0","ondisk_log_start":"0'0","created":246,"last_epoch_clean":247,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'5","last_scrub_stamp":"2024-06-04T16:22:47.213558+0000","last_deep_scrub":"254'5","last_deep_scrub_stamp":"2024-06-04T16:22:47.213558+0000","last_clean_scrub_stamp":"2024-06-04T16:22:47.213558+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T21:54:10.067561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":4144,"num_write":10,"num_write_kb":4144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"64.1c","version":"251'37","reported_seq":151,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:49.285431+0000","last_change":"2024-06-04T16:22:49.285460+0000","last_active":"2024-06-04T16:22:49.285431+0000","last_peered":"2024-06-04T16:22:49.285431+0000","last_clean":"2024-06-04T16:22:49.285431+0000","last_became_active":"2024-06-04T16:07:09.509671+0000","last_became_peered":"2024-06-04T16:07:09.509671+0000","last_unstale":"2024-06-04T16:22:49.285431+0000","last_undegraded":"2024-06-04T16:22:49.285431+0000","last_fullsized":"2024-06-04T16:22:49.285431+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":243,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"251'37","last_scrub_stamp":"2024-06-04T16:22:49.285327+0000","last_deep_scrub":"251'37","last_deep_scrub_stamp":"2024-06-04T16:22:49.285327+0000","last_clean_scrub_stamp":"2024-06-04T16:22:49.285327+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T20:32:45.523245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":197,"num_read_kb":141,"num_write":70,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.18","version":"0'0","reported_seq":24,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:51.706612+0000","last_change":"2024-06-04T16:23:51.706640+0000","last_active":"2024-06-04T16:23:51.706612+0000","last_peered":"2024-06-04T16:23:51.706612+0000","last_clean":"2024-06-04T16:23:51.706612+0000","last_became_active":"2024-06-04T16:16:08.664252+0000","last_became_peered":"2024-06-04T16:16:08.664252+0000","last_unstale":"2024-06-04T16:23:51.706612+0000","last_undegraded":"2024-06-04T16:23:51.706612+0000","last_fullsized":"2024-06-04T16:23:51.706612+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:23:51.706514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:23:51.706514+0000","last_clean_scrub_stamp":"2024-06-04T16:23:51.706514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T02:07:08.476512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.19","version":"254'7","reported_seq":45,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:18.779734+0000","last_change":"2024-06-04T16:23:18.779734+0000","last_active":"2024-06-04T16:23:18.779734+0000","last_peered":"2024-06-04T16:23:18.779734+0000","last_clean":"2024-06-04T16:23:18.779734+0000","last_became_active":"2024-06-04T16:09:26.624681+0000","last_became_peered":"2024-06-04T16:09:26.624681+0000","last_unstale":"2024-06-04T16:23:18.779734+0000","last_undegraded":"2024-06-04T16:23:18.779734+0000","last_fullsized":"2024-06-04T16:23:18.779734+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'7","last_scrub_stamp":"2024-06-04T16:23:18.779618+0000","last_deep_scrub":"254'7","last_deep_scrub_stamp":"2024-06-04T16:23:18.779618+0000","last_clean_scrub_stamp":"2024-06-04T16:23:18.779618+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T00:15:42.722331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":9216,"num_write":12,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1a","version":"251'3","reported_seq":43,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:51.476092+0000","last_change":"2024-06-04T16:22:51.476119+0000","last_active":"2024-06-04T16:22:51.476092+0000","last_peered":"2024-06-04T16:22:51.476092+0000","last_clean":"2024-06-04T16:22:51.476092+0000","last_became_active":"2024-06-04T16:09:23.609102+0000","last_became_peered":"2024-06-04T16:09:23.609102+0000","last_unstale":"2024-06-04T16:22:51.476092+0000","last_undegraded":"2024-06-04T16:22:51.476092+0000","last_fullsized":"2024-06-04T16:22:51.476092+0000","mapping_epoch":246,"log_start":"0'0","ondisk_log_start":"0'0","created":246,"last_epoch_clean":247,"parent":"0.0","parent_split_bits":0,"last_scrub":"251'3","last_scrub_stamp":"2024-06-04T16:22:51.475999+0000","last_deep_scrub":"251'3","last_deep_scrub_stamp":"2024-06-04T16:22:51.475999+0000","last_clean_scrub_stamp":"2024-06-04T16:22:51.475999+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T00:37:04.803162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"64.1b","version":"251'96","reported_seq":342,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:56.001961+0000","last_change":"2024-06-04T16:22:56.001988+0000","last_active":"2024-06-04T16:22:56.001961+0000","last_peered":"2024-06-04T16:22:56.001961+0000","last_clean":"2024-06-04T16:22:56.001961+0000","last_became_active":"2024-06-04T16:07:09.404202+0000","last_became_peered":"2024-06-04T16:07:09.404202+0000","last_unstale":"2024-06-04T16:22:56.001961+0000","last_undegraded":"2024-06-04T16:22:56.001961+0000","last_fullsized":"2024-06-04T16:22:56.001961+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":243,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"251'96","last_scrub_stamp":"2024-06-04T16:22:56.001853+0000","last_deep_scrub":"251'96","last_deep_scrub_stamp":"2024-06-04T16:22:56.001853+0000","last_clean_scrub_stamp":"2024-06-04T16:22:56.001853+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T03:12:58.679536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":591,"num_read_kb":533,"num_write":104,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.19","version":"0'0","reported_seq":24,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:18.878905+0000","last_change":"2024-06-04T16:23:18.878905+0000","last_active":"2024-06-04T16:23:18.878905+0000","last_peered":"2024-06-04T16:23:18.878905+0000","last_clean":"2024-06-04T16:23:18.878905+0000","last_became_active":"2024-06-04T16:16:08.658696+0000","last_became_peered":"2024-06-04T16:16:08.658696+0000","last_unstale":"2024-06-04T16:23:18.878905+0000","last_undegraded":"2024-06-04T16:23:18.878905+0000","last_fullsized":"2024-06-04T16:23:18.878905+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:23:18.878733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:23:18.878733+0000","last_clean_scrub_stamp":"2024-06-04T16:23:18.878733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T17:31:25.559043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.18","version":"254'7","reported_seq":44,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:50.332142+0000","last_change":"2024-06-04T16:22:50.332142+0000","last_active":"2024-06-04T16:22:50.332142+0000","last_peered":"2024-06-04T16:22:50.332142+0000","last_clean":"2024-06-04T16:22:50.332142+0000","last_became_active":"2024-06-04T16:09:26.624322+0000","last_became_peered":"2024-06-04T16:09:26.624322+0000","last_unstale":"2024-06-04T16:22:50.332142+0000","last_undegraded":"2024-06-04T16:22:50.332142+0000","last_fullsized":"2024-06-04T16:22:50.332142+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'7","last_scrub_stamp":"2024-06-04T16:22:50.332010+0000","last_deep_scrub":"254'7","last_deep_scrub_stamp":"2024-06-04T16:22:50.332010+0000","last_clean_scrub_stamp":"2024-06-04T16:22:50.332010+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T03:36:03.301991+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":8192,"num_write":12,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1b","version":"254'15","reported_seq":71,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:22.204972+0000","last_change":"2024-06-04T16:23:22.205010+0000","last_active":"2024-06-04T16:23:22.204972+0000","last_peered":"2024-06-04T16:23:22.204972+0000","last_clean":"2024-06-04T16:23:22.204972+0000","last_became_active":"2024-06-04T16:09:23.613109+0000","last_became_peered":"2024-06-04T16:09:23.613109+0000","last_unstale":"2024-06-04T16:23:22.204972+0000","last_undegraded":"2024-06-04T16:23:22.204972+0000","last_fullsized":"2024-06-04T16:23:22.204972+0000","mapping_epoch":246,"log_start":"0'0","ondisk_log_start":"0'0","created":246,"last_epoch_clean":247,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'15","last_scrub_stamp":"2024-06-04T16:23:22.204872+0000","last_deep_scrub":"254'15","last_deep_scrub_stamp":"2024-06-04T16:23:22.204872+0000","last_clean_scrub_stamp":"2024-06-04T16:23:22.204872+0000","objects_scrubbed":2,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T16:45:38.504686+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":26,"num_read_kb":29700,"num_write":16,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"64.1a","version":"251'15","reported_seq":84,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:52.099476+0000","last_change":"2024-06-04T16:22:52.099503+0000","last_active":"2024-06-04T16:22:52.099476+0000","last_peered":"2024-06-04T16:22:52.099476+0000","last_clean":"2024-06-04T16:22:52.099476+0000","last_became_active":"2024-06-04T16:07:09.406976+0000","last_became_peered":"2024-06-04T16:07:09.406976+0000","last_unstale":"2024-06-04T16:22:52.099476+0000","last_undegraded":"2024-06-04T16:22:52.099476+0000","last_fullsized":"2024-06-04T16:22:52.099476+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":243,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"251'15","last_scrub_stamp":"2024-06-04T16:22:52.099378+0000","last_deep_scrub":"251'15","last_deep_scrub_stamp":"2024-06-04T16:22:52.099378+0000","last_clean_scrub_stamp":"2024-06-04T16:22:52.099378+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T02:39:01.268878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":52,"num_write":29,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.1a","version":"0'0","reported_seq":24,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:35.038390+0000","last_change":"2024-06-04T16:23:35.038390+0000","last_active":"2024-06-04T16:23:35.038390+0000","last_peered":"2024-06-04T16:23:35.038390+0000","last_clean":"2024-06-04T16:23:35.038390+0000","last_became_active":"2024-06-04T16:16:08.664200+0000","last_became_peered":"2024-06-04T16:16:08.664200+0000","last_unstale":"2024-06-04T16:23:35.038390+0000","last_undegraded":"2024-06-04T16:23:35.038390+0000","last_fullsized":"2024-06-04T16:23:35.038390+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:23:35.038263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:23:35.038263+0000","last_clean_scrub_stamp":"2024-06-04T16:23:35.038263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T19:42:20.840250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.1b","version":"254'3","reported_seq":37,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:26.316337+0000","last_change":"2024-06-04T16:23:26.316382+0000","last_active":"2024-06-04T16:23:26.316337+0000","last_peered":"2024-06-04T16:23:26.316337+0000","last_clean":"2024-06-04T16:23:26.316337+0000","last_became_active":"2024-06-04T16:09:26.626528+0000","last_became_peered":"2024-06-04T16:09:26.626528+0000","last_unstale":"2024-06-04T16:23:26.316337+0000","last_undegraded":"2024-06-04T16:23:26.316337+0000","last_fullsized":"2024-06-04T16:23:26.316337+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'3","last_scrub_stamp":"2024-06-04T16:23:26.316238+0000","last_deep_scrub":"254'3","last_deep_scrub_stamp":"2024-06-04T16:23:26.316238+0000","last_clean_scrub_stamp":"2024-06-04T16:23:26.316238+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T20:01:19.475710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8192,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.18","version":"254'4","reported_seq":46,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:50.225379+0000","last_change":"2024-06-04T16:22:50.225379+0000","last_active":"2024-06-04T16:22:50.225379+0000","last_peered":"2024-06-04T16:22:50.225379+0000","last_clean":"2024-06-04T16:22:50.225379+0000","last_became_active":"2024-06-04T16:09:23.609952+0000","last_became_peered":"2024-06-04T16:09:23.609952+0000","last_unstale":"2024-06-04T16:22:50.225379+0000","last_undegraded":"2024-06-04T16:22:50.225379+0000","last_fullsized":"2024-06-04T16:22:50.225379+0000","mapping_epoch":246,"log_start":"0'0","ondisk_log_start":"0'0","created":246,"last_epoch_clean":247,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'4","last_scrub_stamp":"2024-06-04T16:22:50.225242+0000","last_deep_scrub":"254'4","last_deep_scrub_stamp":"2024-06-04T16:22:50.225242+0000","last_clean_scrub_stamp":"2024-06-04T16:22:50.225242+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T19:11:13.044639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5120,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"64.19","version":"251'22","reported_seq":105,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:52.389508+0000","last_change":"2024-06-04T16:22:52.389536+0000","last_active":"2024-06-04T16:22:52.389508+0000","last_peered":"2024-06-04T16:22:52.389508+0000","last_clean":"2024-06-04T16:22:52.389508+0000","last_became_active":"2024-06-04T16:07:09.402316+0000","last_became_peered":"2024-06-04T16:07:09.402316+0000","last_unstale":"2024-06-04T16:22:52.389508+0000","last_undegraded":"2024-06-04T16:22:52.389508+0000","last_fullsized":"2024-06-04T16:22:52.389508+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":243,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"251'22","last_scrub_stamp":"2024-06-04T16:22:52.389413+0000","last_deep_scrub":"251'22","last_deep_scrub_stamp":"2024-06-04T16:22:52.389413+0000","last_clean_scrub_stamp":"2024-06-04T16:22:52.389413+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T17:48:23.344607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":114,"num_read_kb":79,"num_write":44,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1b","version":"0'0","reported_seq":24,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:24.681708+0000","last_change":"2024-06-04T16:23:24.681708+0000","last_active":"2024-06-04T16:23:24.681708+0000","last_peered":"2024-06-04T16:23:24.681708+0000","last_clean":"2024-06-04T16:23:24.681708+0000","last_became_active":"2024-06-04T16:16:08.653931+0000","last_became_peered":"2024-06-04T16:16:08.653931+0000","last_unstale":"2024-06-04T16:23:24.681708+0000","last_undegraded":"2024-06-04T16:23:24.681708+0000","last_fullsized":"2024-06-04T16:23:24.681708+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:23:24.681563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:23:24.681563+0000","last_clean_scrub_stamp":"2024-06-04T16:23:24.681563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T20:41:20.833917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1a","version":"254'9","reported_seq":50,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:16.876737+0000","last_change":"2024-06-04T16:23:16.876782+0000","last_active":"2024-06-04T16:23:16.876737+0000","last_peered":"2024-06-04T16:23:16.876737+0000","last_clean":"2024-06-04T16:23:16.876737+0000","last_became_active":"2024-06-04T16:09:26.623459+0000","last_became_peered":"2024-06-04T16:09:26.623459+0000","last_unstale":"2024-06-04T16:23:16.876737+0000","last_undegraded":"2024-06-04T16:23:16.876737+0000","last_fullsized":"2024-06-04T16:23:16.876737+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'9","last_scrub_stamp":"2024-06-04T16:23:16.876629+0000","last_deep_scrub":"254'9","last_deep_scrub_stamp":"2024-06-04T16:23:16.876629+0000","last_clean_scrub_stamp":"2024-06-04T16:23:16.876629+0000","objects_scrubbed":1,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T22:16:04.324630+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":9218,"num_write":7,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.19","version":"254'7","reported_seq":53,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:54.037579+0000","last_change":"2024-06-04T16:22:54.037579+0000","last_active":"2024-06-04T16:22:54.037579+0000","last_peered":"2024-06-04T16:22:54.037579+0000","last_clean":"2024-06-04T16:22:54.037579+0000","last_became_active":"2024-06-04T16:09:23.606966+0000","last_became_peered":"2024-06-04T16:09:23.606966+0000","last_unstale":"2024-06-04T16:22:54.037579+0000","last_undegraded":"2024-06-04T16:22:54.037579+0000","last_fullsized":"2024-06-04T16:22:54.037579+0000","mapping_epoch":246,"log_start":"0'0","ondisk_log_start":"0'0","created":246,"last_epoch_clean":247,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'7","last_scrub_stamp":"2024-06-04T16:22:54.037448+0000","last_deep_scrub":"254'7","last_deep_scrub_stamp":"2024-06-04T16:22:54.037448+0000","last_clean_scrub_stamp":"2024-06-04T16:22:54.037448+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T17:00:32.140550+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":11,"num_read_kb":8194,"num_write":5,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"64.18","version":"251'39","reported_seq":154,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:45.120654+0000","last_change":"2024-06-04T16:22:45.120654+0000","last_active":"2024-06-04T16:22:45.120654+0000","last_peered":"2024-06-04T16:22:45.120654+0000","last_clean":"2024-06-04T16:22:45.120654+0000","last_became_active":"2024-06-04T16:07:09.404055+0000","last_became_peered":"2024-06-04T16:07:09.404055+0000","last_unstale":"2024-06-04T16:22:45.120654+0000","last_undegraded":"2024-06-04T16:22:45.120654+0000","last_fullsized":"2024-06-04T16:22:45.120654+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":243,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"251'39","last_scrub_stamp":"2024-06-04T16:22:45.120553+0000","last_deep_scrub":"251'39","last_deep_scrub_stamp":"2024-06-04T16:22:45.120553+0000","last_clean_scrub_stamp":"2024-06-04T16:22:45.120553+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T19:34:39.593186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":206,"num_read_kb":146,"num_write":71,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.14","version":"254'2","reported_seq":26,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:42.397718+0000","last_change":"2024-06-04T16:23:42.397746+0000","last_active":"2024-06-04T16:23:42.397718+0000","last_peered":"2024-06-04T16:23:42.397718+0000","last_clean":"2024-06-04T16:23:42.397718+0000","last_became_active":"2024-06-04T16:16:08.661995+0000","last_became_peered":"2024-06-04T16:16:08.661995+0000","last_unstale":"2024-06-04T16:23:42.397718+0000","last_undegraded":"2024-06-04T16:23:42.397718+0000","last_fullsized":"2024-06-04T16:23:42.397718+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'2","last_scrub_stamp":"2024-06-04T16:23:42.397627+0000","last_deep_scrub":"254'2","last_deep_scrub_stamp":"2024-06-04T16:23:42.397627+0000","last_clean_scrub_stamp":"2024-06-04T16:23:42.397627+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T02:53:05.087970+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.15","version":"254'5","reported_seq":40,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:15.917369+0000","last_change":"2024-06-04T16:23:15.917369+0000","last_active":"2024-06-04T16:23:15.917369+0000","last_peered":"2024-06-04T16:23:15.917369+0000","last_clean":"2024-06-04T16:23:15.917369+0000","last_became_active":"2024-06-04T16:09:26.623442+0000","last_became_peered":"2024-06-04T16:09:26.623442+0000","last_unstale":"2024-06-04T16:23:15.917369+0000","last_undegraded":"2024-06-04T16:23:15.917369+0000","last_fullsized":"2024-06-04T16:23:15.917369+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'5","last_scrub_stamp":"2024-06-04T16:23:15.917252+0000","last_deep_scrub":"254'5","last_deep_scrub_stamp":"2024-06-04T16:23:15.917252+0000","last_clean_scrub_stamp":"2024-06-04T16:23:15.917252+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T18:10:33.362725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":1406,"num_write":10,"num_write_kb":4799,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.16","version":"251'2","reported_seq":43,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:29.875080+0000","last_change":"2024-06-04T16:23:29.875080+0000","last_active":"2024-06-04T16:23:29.875080+0000","last_peered":"2024-06-04T16:23:29.875080+0000","last_clean":"2024-06-04T16:23:29.875080+0000","last_became_active":"2024-06-04T16:09:23.609180+0000","last_became_peered":"2024-06-04T16:09:23.609180+0000","last_unstale":"2024-06-04T16:23:29.875080+0000","last_undegraded":"2024-06-04T16:23:29.875080+0000","last_fullsized":"2024-06-04T16:23:29.875080+0000","mapping_epoch":246,"log_start":"0'0","ondisk_log_start":"0'0","created":246,"last_epoch_clean":247,"parent":"0.0","parent_split_bits":0,"last_scrub":"251'2","last_scrub_stamp":"2024-06-04T16:23:29.874951+0000","last_deep_scrub":"251'2","last_deep_scrub_stamp":"2024-06-04T16:23:29.874951+0000","last_clean_scrub_stamp":"2024-06-04T16:23:29.874951+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T19:50:30.186546+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":45,"num_write":2,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"64.17","version":"0'0","reported_seq":46,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:51.964441+0000","last_change":"2024-06-04T16:22:51.964441+0000","last_active":"2024-06-04T16:22:51.964441+0000","last_peered":"2024-06-04T16:22:51.964441+0000","last_clean":"2024-06-04T16:22:51.964441+0000","last_became_active":"2024-06-04T16:07:09.511806+0000","last_became_peered":"2024-06-04T16:07:09.511806+0000","last_unstale":"2024-06-04T16:22:51.964441+0000","last_undegraded":"2024-06-04T16:22:51.964441+0000","last_fullsized":"2024-06-04T16:22:51.964441+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":243,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:22:51.964320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:22:51.964320+0000","last_clean_scrub_stamp":"2024-06-04T16:22:51.964320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T17:12:29.022223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.15","version":"0'0","reported_seq":24,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:37.018186+0000","last_change":"2024-06-04T16:23:37.018211+0000","last_active":"2024-06-04T16:23:37.018186+0000","last_peered":"2024-06-04T16:23:37.018186+0000","last_clean":"2024-06-04T16:23:37.018186+0000","last_became_active":"2024-06-04T16:16:08.664680+0000","last_became_peered":"2024-06-04T16:16:08.664680+0000","last_unstale":"2024-06-04T16:23:37.018186+0000","last_undegraded":"2024-06-04T16:23:37.018186+0000","last_fullsized":"2024-06-04T16:23:37.018186+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:23:37.018087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:23:37.018087+0000","last_clean_scrub_stamp":"2024-06-04T16:23:37.018087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T00:44:50.931141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.14","version":"254'3","reported_seq":36,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:14.853043+0000","last_change":"2024-06-04T16:23:14.853043+0000","last_active":"2024-06-04T16:23:14.853043+0000","last_peered":"2024-06-04T16:23:14.853043+0000","last_clean":"2024-06-04T16:23:14.853043+0000","last_became_active":"2024-06-04T16:09:26.623991+0000","last_became_peered":"2024-06-04T16:09:26.623991+0000","last_unstale":"2024-06-04T16:23:14.853043+0000","last_undegraded":"2024-06-04T16:23:14.853043+0000","last_fullsized":"2024-06-04T16:23:14.853043+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'3","last_scrub_stamp":"2024-06-04T16:23:14.852908+0000","last_deep_scrub":"254'3","last_deep_scrub_stamp":"2024-06-04T16:23:14.852908+0000","last_clean_scrub_stamp":"2024-06-04T16:23:14.852908+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T01:38:33.737901+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.17","version":"254'2","reported_seq":42,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:26.846322+0000","last_change":"2024-06-04T16:23:26.846322+0000","last_active":"2024-06-04T16:23:26.846322+0000","last_peered":"2024-06-04T16:23:26.846322+0000","last_clean":"2024-06-04T16:23:26.846322+0000","last_became_active":"2024-06-04T16:09:23.595355+0000","last_became_peered":"2024-06-04T16:09:23.595355+0000","last_unstale":"2024-06-04T16:23:26.846322+0000","last_undegraded":"2024-06-04T16:23:26.846322+0000","last_fullsized":"2024-06-04T16:23:26.846322+0000","mapping_epoch":246,"log_start":"0'0","ondisk_log_start":"0'0","created":246,"last_epoch_clean":247,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'2","last_scrub_stamp":"2024-06-04T16:23:26.846192+0000","last_deep_scrub":"254'2","last_deep_scrub_stamp":"2024-06-04T16:23:26.846192+0000","last_clean_scrub_stamp":"2024-06-04T16:23:26.846192+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T03:23:28.254745+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"64.16","version":"251'16","reported_seq":90,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:02.010721+0000","last_change":"2024-06-04T16:23:02.010721+0000","last_active":"2024-06-04T16:23:02.010721+0000","last_peered":"2024-06-04T16:23:02.010721+0000","last_clean":"2024-06-04T16:23:02.010721+0000","last_became_active":"2024-06-04T16:07:09.405088+0000","last_became_peered":"2024-06-04T16:07:09.405088+0000","last_unstale":"2024-06-04T16:23:02.010721+0000","last_undegraded":"2024-06-04T16:23:02.010721+0000","last_fullsized":"2024-06-04T16:23:02.010721+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":243,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"251'16","last_scrub_stamp":"2024-06-04T16:23:02.010570+0000","last_deep_scrub":"251'16","last_deep_scrub_stamp":"2024-06-04T16:23:02.010570+0000","last_clean_scrub_stamp":"2024-06-04T16:23:02.010570+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T22:57:25.415865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":63,"num_write":30,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.16","version":"0'0","reported_seq":24,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:17.886115+0000","last_change":"2024-06-04T16:23:17.886115+0000","last_active":"2024-06-04T16:23:17.886115+0000","last_peered":"2024-06-04T16:23:17.886115+0000","last_clean":"2024-06-04T16:23:17.886115+0000","last_became_active":"2024-06-04T16:16:08.655571+0000","last_became_peered":"2024-06-04T16:16:08.655571+0000","last_unstale":"2024-06-04T16:23:17.886115+0000","last_undegraded":"2024-06-04T16:23:17.886115+0000","last_fullsized":"2024-06-04T16:23:17.886115+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:23:17.885998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:23:17.885998+0000","last_clean_scrub_stamp":"2024-06-04T16:23:17.885998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T18:50:59.477929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.17","version":"0'0","reported_seq":33,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:02.458281+0000","last_change":"2024-06-04T16:23:02.458281+0000","last_active":"2024-06-04T16:23:02.458281+0000","last_peered":"2024-06-04T16:23:02.458281+0000","last_clean":"2024-06-04T16:23:02.458281+0000","last_became_active":"2024-06-04T16:09:26.626605+0000","last_became_peered":"2024-06-04T16:09:26.626605+0000","last_unstale":"2024-06-04T16:23:02.458281+0000","last_undegraded":"2024-06-04T16:23:02.458281+0000","last_fullsized":"2024-06-04T16:23:02.458281+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:23:02.458129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:23:02.458129+0000","last_clean_scrub_stamp":"2024-06-04T16:23:02.458129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T19:52:01.192176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.14","version":"254'2","reported_seq":42,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:49.960934+0000","last_change":"2024-06-04T16:22:49.960934+0000","last_active":"2024-06-04T16:22:49.960934+0000","last_peered":"2024-06-04T16:22:49.960934+0000","last_clean":"2024-06-04T16:22:49.960934+0000","last_became_active":"2024-06-04T16:09:23.607906+0000","last_became_peered":"2024-06-04T16:09:23.607906+0000","last_unstale":"2024-06-04T16:22:49.960934+0000","last_undegraded":"2024-06-04T16:22:49.960934+0000","last_fullsized":"2024-06-04T16:22:49.960934+0000","mapping_epoch":246,"log_start":"0'0","ondisk_log_start":"0'0","created":246,"last_epoch_clean":247,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'2","last_scrub_stamp":"2024-06-04T16:22:49.960799+0000","last_deep_scrub":"254'2","last_deep_scrub_stamp":"2024-06-04T16:22:49.960799+0000","last_clean_scrub_stamp":"2024-06-04T16:22:49.960799+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T03:11:47.194479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"64.15","version":"0'0","reported_seq":46,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:55.504318+0000","last_change":"2024-06-04T16:22:55.504318+0000","last_active":"2024-06-04T16:22:55.504318+0000","last_peered":"2024-06-04T16:22:55.504318+0000","last_clean":"2024-06-04T16:22:55.504318+0000","last_became_active":"2024-06-04T16:07:09.401608+0000","last_became_peered":"2024-06-04T16:07:09.401608+0000","last_unstale":"2024-06-04T16:22:55.504318+0000","last_undegraded":"2024-06-04T16:22:55.504318+0000","last_fullsized":"2024-06-04T16:22:55.504318+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":243,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:22:55.504205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:22:55.504205+0000","last_clean_scrub_stamp":"2024-06-04T16:22:55.504205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T16:56:39.431832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.17","version":"0'0","reported_seq":24,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:32.987376+0000","last_change":"2024-06-04T16:23:32.987399+0000","last_active":"2024-06-04T16:23:32.987376+0000","last_peered":"2024-06-04T16:23:32.987376+0000","last_clean":"2024-06-04T16:23:32.987376+0000","last_became_active":"2024-06-04T16:16:08.657535+0000","last_became_peered":"2024-06-04T16:16:08.657535+0000","last_unstale":"2024-06-04T16:23:32.987376+0000","last_undegraded":"2024-06-04T16:23:32.987376+0000","last_fullsized":"2024-06-04T16:23:32.987376+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:23:32.987282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:23:32.987282+0000","last_clean_scrub_stamp":"2024-06-04T16:23:32.987282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T16:43:24.500634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.16","version":"254'13","reported_seq":58,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:00.022163+0000","last_change":"2024-06-04T16:23:00.022163+0000","last_active":"2024-06-04T16:23:00.022163+0000","last_peered":"2024-06-04T16:23:00.022163+0000","last_clean":"2024-06-04T16:23:00.022163+0000","last_became_active":"2024-06-04T16:09:26.628237+0000","last_became_peered":"2024-06-04T16:09:26.628237+0000","last_unstale":"2024-06-04T16:23:00.022163+0000","last_undegraded":"2024-06-04T16:23:00.022163+0000","last_fullsized":"2024-06-04T16:23:00.022163+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'13","last_scrub_stamp":"2024-06-04T16:23:00.022012+0000","last_deep_scrub":"254'13","last_deep_scrub_stamp":"2024-06-04T16:23:00.022012+0000","last_clean_scrub_stamp":"2024-06-04T16:23:00.022012+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T03:53:06.448598+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":19,"num_read_kb":9311,"num_write":11,"num_write_kb":6237,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.15","version":"0'0","reported_seq":39,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:53.025992+0000","last_change":"2024-06-04T16:22:53.025992+0000","last_active":"2024-06-04T16:22:53.025992+0000","last_peered":"2024-06-04T16:22:53.025992+0000","last_clean":"2024-06-04T16:22:53.025992+0000","last_became_active":"2024-06-04T16:09:23.608801+0000","last_became_peered":"2024-06-04T16:09:23.608801+0000","last_unstale":"2024-06-04T16:22:53.025992+0000","last_undegraded":"2024-06-04T16:22:53.025992+0000","last_fullsized":"2024-06-04T16:22:53.025992+0000","mapping_epoch":246,"log_start":"0'0","ondisk_log_start":"0'0","created":246,"last_epoch_clean":247,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:22:53.025834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:22:53.025834+0000","last_clean_scrub_stamp":"2024-06-04T16:22:53.025834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T18:36:02.347621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"64.14","version":"251'30","reported_seq":127,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:48.038108+0000","last_change":"2024-06-04T16:22:48.038108+0000","last_active":"2024-06-04T16:22:48.038108+0000","last_peered":"2024-06-04T16:22:48.038108+0000","last_clean":"2024-06-04T16:22:48.038108+0000","last_became_active":"2024-06-04T16:07:09.403925+0000","last_became_peered":"2024-06-04T16:07:09.403925+0000","last_unstale":"2024-06-04T16:22:48.038108+0000","last_undegraded":"2024-06-04T16:22:48.038108+0000","last_fullsized":"2024-06-04T16:22:48.038108+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":243,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"251'30","last_scrub_stamp":"2024-06-04T16:22:48.037984+0000","last_deep_scrub":"251'30","last_deep_scrub_stamp":"2024-06-04T16:22:48.037984+0000","last_clean_scrub_stamp":"2024-06-04T16:22:48.037984+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T16:58:19.728132+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":154,"num_read_kb":107,"num_write":60,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.10","version":"0'0","reported_seq":24,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:38.354711+0000","last_change":"2024-06-04T16:23:38.354737+0000","last_active":"2024-06-04T16:23:38.354711+0000","last_peered":"2024-06-04T16:23:38.354711+0000","last_clean":"2024-06-04T16:23:38.354711+0000","last_became_active":"2024-06-04T16:16:08.656048+0000","last_became_peered":"2024-06-04T16:16:08.656048+0000","last_unstale":"2024-06-04T16:23:38.354711+0000","last_undegraded":"2024-06-04T16:23:38.354711+0000","last_fullsized":"2024-06-04T16:23:38.354711+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:23:38.354611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:23:38.354611+0000","last_clean_scrub_stamp":"2024-06-04T16:23:38.354611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T02:33:12.881593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.11","version":"254'9","reported_seq":50,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:54.471674+0000","last_change":"2024-06-04T16:22:54.471674+0000","last_active":"2024-06-04T16:22:54.471674+0000","last_peered":"2024-06-04T16:22:54.471674+0000","last_clean":"2024-06-04T16:22:54.471674+0000","last_became_active":"2024-06-04T16:09:26.624122+0000","last_became_peered":"2024-06-04T16:09:26.624122+0000","last_unstale":"2024-06-04T16:22:54.471674+0000","last_undegraded":"2024-06-04T16:22:54.471674+0000","last_fullsized":"2024-06-04T16:22:54.471674+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'9","last_scrub_stamp":"2024-06-04T16:22:54.471546+0000","last_deep_scrub":"254'9","last_deep_scrub_stamp":"2024-06-04T16:22:54.471546+0000","last_clean_scrub_stamp":"2024-06-04T16:22:54.471546+0000","objects_scrubbed":1,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T19:44:26.280196+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":17410,"num_write":17,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.12","version":"254'4","reported_seq":44,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:50.065702+0000","last_change":"2024-06-04T16:22:50.065702+0000","last_active":"2024-06-04T16:22:50.065702+0000","last_peered":"2024-06-04T16:22:50.065702+0000","last_clean":"2024-06-04T16:22:50.065702+0000","last_became_active":"2024-06-04T16:09:23.612699+0000","last_became_peered":"2024-06-04T16:09:23.612699+0000","last_unstale":"2024-06-04T16:22:50.065702+0000","last_undegraded":"2024-06-04T16:22:50.065702+0000","last_fullsized":"2024-06-04T16:22:50.065702+0000","mapping_epoch":246,"log_start":"0'0","ondisk_log_start":"0'0","created":246,"last_epoch_clean":247,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'4","last_scrub_stamp":"2024-06-04T16:22:50.065529+0000","last_deep_scrub":"254'4","last_deep_scrub_stamp":"2024-06-04T16:22:50.065529+0000","last_clean_scrub_stamp":"2024-06-04T16:22:50.065529+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T19:24:18.911703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4,"num_write":4,"num_write_kb":1028,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"64.13","version":"254'35","reported_seq":148,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:00.004308+0000","last_change":"2024-06-04T16:23:00.004308+0000","last_active":"2024-06-04T16:23:00.004308+0000","last_peered":"2024-06-04T16:23:00.004308+0000","last_clean":"2024-06-04T16:23:00.004308+0000","last_became_active":"2024-06-04T16:07:09.511607+0000","last_became_peered":"2024-06-04T16:07:09.511607+0000","last_unstale":"2024-06-04T16:23:00.004308+0000","last_undegraded":"2024-06-04T16:23:00.004308+0000","last_fullsized":"2024-06-04T16:23:00.004308+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":243,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'35","last_scrub_stamp":"2024-06-04T16:23:00.004144+0000","last_deep_scrub":"254'35","last_deep_scrub_stamp":"2024-06-04T16:23:00.004144+0000","last_clean_scrub_stamp":"2024-06-04T16:23:00.004144+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T18:57:09.754963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":198,"num_read_kb":144,"num_write":54,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.11","version":"0'0","reported_seq":24,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:10.366340+0000","last_change":"2024-06-04T16:23:10.366366+0000","last_active":"2024-06-04T16:23:10.366340+0000","last_peered":"2024-06-04T16:23:10.366340+0000","last_clean":"2024-06-04T16:23:10.366340+0000","last_became_active":"2024-06-04T16:16:08.648899+0000","last_became_peered":"2024-06-04T16:16:08.648899+0000","last_unstale":"2024-06-04T16:23:10.366340+0000","last_undegraded":"2024-06-04T16:23:10.366340+0000","last_fullsized":"2024-06-04T16:23:10.366340+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:23:10.366238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:23:10.366238+0000","last_clean_scrub_stamp":"2024-06-04T16:23:10.366238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T03:12:18.946809+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.10","version":"254'2","reported_seq":36,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:28.243956+0000","last_change":"2024-06-04T16:23:28.243956+0000","last_active":"2024-06-04T16:23:28.243956+0000","last_peered":"2024-06-04T16:23:28.243956+0000","last_clean":"2024-06-04T16:23:28.243956+0000","last_became_active":"2024-06-04T16:09:26.628442+0000","last_became_peered":"2024-06-04T16:09:26.628442+0000","last_unstale":"2024-06-04T16:23:28.243956+0000","last_undegraded":"2024-06-04T16:23:28.243956+0000","last_fullsized":"2024-06-04T16:23:28.243956+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'2","last_scrub_stamp":"2024-06-04T16:23:28.243810+0000","last_deep_scrub":"254'2","last_deep_scrub_stamp":"2024-06-04T16:23:28.243810+0000","last_clean_scrub_stamp":"2024-06-04T16:23:28.243810+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T22:55:05.302653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.13","version":"254'2","reported_seq":42,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:58.847088+0000","last_change":"2024-06-04T16:22:58.847088+0000","last_active":"2024-06-04T16:22:58.847088+0000","last_peered":"2024-06-04T16:22:58.847088+0000","last_clean":"2024-06-04T16:22:58.847088+0000","last_became_active":"2024-06-04T16:09:23.609536+0000","last_became_peered":"2024-06-04T16:09:23.609536+0000","last_unstale":"2024-06-04T16:22:58.847088+0000","last_undegraded":"2024-06-04T16:22:58.847088+0000","last_fullsized":"2024-06-04T16:22:58.847088+0000","mapping_epoch":246,"log_start":"0'0","ondisk_log_start":"0'0","created":246,"last_epoch_clean":247,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'2","last_scrub_stamp":"2024-06-04T16:22:58.846960+0000","last_deep_scrub":"254'2","last_deep_scrub_stamp":"2024-06-04T16:22:58.846960+0000","last_clean_scrub_stamp":"2024-06-04T16:22:58.846960+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T22:30:42.199456+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"64.12","version":"254'6","reported_seq":64,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:56.874251+0000","last_change":"2024-06-04T16:22:56.874251+0000","last_active":"2024-06-04T16:22:56.874251+0000","last_peered":"2024-06-04T16:22:56.874251+0000","last_clean":"2024-06-04T16:22:56.874251+0000","last_became_active":"2024-06-04T16:07:09.403352+0000","last_became_peered":"2024-06-04T16:07:09.403352+0000","last_unstale":"2024-06-04T16:22:56.874251+0000","last_undegraded":"2024-06-04T16:22:56.874251+0000","last_fullsized":"2024-06-04T16:22:56.874251+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":243,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'6","last_scrub_stamp":"2024-06-04T16:22:56.874133+0000","last_deep_scrub":"254'6","last_deep_scrub_stamp":"2024-06-04T16:22:56.874133+0000","last_clean_scrub_stamp":"2024-06-04T16:22:56.874133+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T01:49:34.273350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":24,"num_write":11,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.12","version":"0'0","reported_seq":24,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:47.714535+0000","last_change":"2024-06-04T16:23:47.714563+0000","last_active":"2024-06-04T16:23:47.714535+0000","last_peered":"2024-06-04T16:23:47.714535+0000","last_clean":"2024-06-04T16:23:47.714535+0000","last_became_active":"2024-06-04T16:16:08.654624+0000","last_became_peered":"2024-06-04T16:16:08.654624+0000","last_unstale":"2024-06-04T16:23:47.714535+0000","last_undegraded":"2024-06-04T16:23:47.714535+0000","last_fullsized":"2024-06-04T16:23:47.714535+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:23:47.714429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:23:47.714429+0000","last_clean_scrub_stamp":"2024-06-04T16:23:47.714429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T18:20:13.106959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.13","version":"254'14","reported_seq":61,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:24.314323+0000","last_change":"2024-06-04T16:23:24.314323+0000","last_active":"2024-06-04T16:23:24.314323+0000","last_peered":"2024-06-04T16:23:24.314323+0000","last_clean":"2024-06-04T16:23:24.314323+0000","last_became_active":"2024-06-04T16:09:26.621494+0000","last_became_peered":"2024-06-04T16:09:26.621494+0000","last_unstale":"2024-06-04T16:23:24.314323+0000","last_undegraded":"2024-06-04T16:23:24.314323+0000","last_fullsized":"2024-06-04T16:23:24.314323+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'14","last_scrub_stamp":"2024-06-04T16:23:24.314185+0000","last_deep_scrub":"254'14","last_deep_scrub_stamp":"2024-06-04T16:23:24.314185+0000","last_clean_scrub_stamp":"2024-06-04T16:23:24.314185+0000","objects_scrubbed":2,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T01:37:37.532445+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":21,"num_read_kb":22532,"num_write":20,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.10","version":"254'8","reported_seq":54,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:57.044720+0000","last_change":"2024-06-04T16:22:57.044720+0000","last_active":"2024-06-04T16:22:57.044720+0000","last_peered":"2024-06-04T16:22:57.044720+0000","last_clean":"2024-06-04T16:22:57.044720+0000","last_became_active":"2024-06-04T16:09:23.606050+0000","last_became_peered":"2024-06-04T16:09:23.606050+0000","last_unstale":"2024-06-04T16:22:57.044720+0000","last_undegraded":"2024-06-04T16:22:57.044720+0000","last_fullsized":"2024-06-04T16:22:57.044720+0000","mapping_epoch":246,"log_start":"0'0","ondisk_log_start":"0'0","created":246,"last_epoch_clean":247,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'8","last_scrub_stamp":"2024-06-04T16:22:57.044585+0000","last_deep_scrub":"254'8","last_deep_scrub_stamp":"2024-06-04T16:22:57.044585+0000","last_clean_scrub_stamp":"2024-06-04T16:22:57.044585+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T20:44:54.184609+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":11,"num_read_kb":20482,"num_write":11,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"64.11","version":"254'139","reported_seq":486,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:53.899126+0000","last_change":"2024-06-04T16:22:53.899126+0000","last_active":"2024-06-04T16:22:53.899126+0000","last_peered":"2024-06-04T16:22:53.899126+0000","last_clean":"2024-06-04T16:22:53.899126+0000","last_became_active":"2024-06-04T16:07:09.511098+0000","last_became_peered":"2024-06-04T16:07:09.511098+0000","last_unstale":"2024-06-04T16:22:53.899126+0000","last_undegraded":"2024-06-04T16:22:53.899126+0000","last_fullsized":"2024-06-04T16:22:53.899126+0000","mapping_epoch":243,"log_start":"251'100","ondisk_log_start":"251'100","created":243,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'139","last_scrub_stamp":"2024-06-04T16:22:53.899006+0000","last_deep_scrub":"254'139","last_deep_scrub_stamp":"2024-06-04T16:22:53.899006+0000","last_clean_scrub_stamp":"2024-06-04T16:22:53.899006+0000","objects_scrubbed":1,"log_size":39,"log_dups_size":100,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T22:35:53.282639+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":871,"num_read_kb":642,"num_write":155,"num_write_kb":133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4455,"num_omap_keys":9,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.13","version":"254'2","reported_seq":26,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:32.024494+0000","last_change":"2024-06-04T16:23:32.024541+0000","last_active":"2024-06-04T16:23:32.024494+0000","last_peered":"2024-06-04T16:23:32.024494+0000","last_clean":"2024-06-04T16:23:32.024494+0000","last_became_active":"2024-06-04T16:16:08.657428+0000","last_became_peered":"2024-06-04T16:16:08.657428+0000","last_unstale":"2024-06-04T16:23:32.024494+0000","last_undegraded":"2024-06-04T16:23:32.024494+0000","last_fullsized":"2024-06-04T16:23:32.024494+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'2","last_scrub_stamp":"2024-06-04T16:23:32.024367+0000","last_deep_scrub":"254'2","last_deep_scrub_stamp":"2024-06-04T16:23:32.024367+0000","last_clean_scrub_stamp":"2024-06-04T16:23:32.024367+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T00:39:30.664115+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.12","version":"254'7","reported_seq":48,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:25.295314+0000","last_change":"2024-06-04T16:23:25.295314+0000","last_active":"2024-06-04T16:23:25.295314+0000","last_peered":"2024-06-04T16:23:25.295314+0000","last_clean":"2024-06-04T16:23:25.295314+0000","last_became_active":"2024-06-04T16:09:26.623285+0000","last_became_peered":"2024-06-04T16:09:26.623285+0000","last_unstale":"2024-06-04T16:23:25.295314+0000","last_undegraded":"2024-06-04T16:23:25.295314+0000","last_fullsized":"2024-06-04T16:23:25.295314+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'7","last_scrub_stamp":"2024-06-04T16:23:25.295187+0000","last_deep_scrub":"254'7","last_deep_scrub_stamp":"2024-06-04T16:23:25.295187+0000","last_clean_scrub_stamp":"2024-06-04T16:23:25.295187+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T04:20:24.714654+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":18434,"num_write":5,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.11","version":"254'2","reported_seq":43,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:47.528727+0000","last_change":"2024-06-04T16:22:47.528727+0000","last_active":"2024-06-04T16:22:47.528727+0000","last_peered":"2024-06-04T16:22:47.528727+0000","last_clean":"2024-06-04T16:22:47.528727+0000","last_became_active":"2024-06-04T16:09:23.607048+0000","last_became_peered":"2024-06-04T16:09:23.607048+0000","last_unstale":"2024-06-04T16:22:47.528727+0000","last_undegraded":"2024-06-04T16:22:47.528727+0000","last_fullsized":"2024-06-04T16:22:47.528727+0000","mapping_epoch":246,"log_start":"0'0","ondisk_log_start":"0'0","created":246,"last_epoch_clean":247,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'2","last_scrub_stamp":"2024-06-04T16:22:47.528594+0000","last_deep_scrub":"254'2","last_deep_scrub_stamp":"2024-06-04T16:22:47.528594+0000","last_clean_scrub_stamp":"2024-06-04T16:22:47.528594+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T18:03:35.616854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8192,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"64.10","version":"251'6","reported_seq":64,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:03.054311+0000","last_change":"2024-06-04T16:23:03.054311+0000","last_active":"2024-06-04T16:23:03.054311+0000","last_peered":"2024-06-04T16:23:03.054311+0000","last_clean":"2024-06-04T16:23:03.054311+0000","last_became_active":"2024-06-04T16:07:09.401445+0000","last_became_peered":"2024-06-04T16:07:09.401445+0000","last_unstale":"2024-06-04T16:23:03.054311+0000","last_undegraded":"2024-06-04T16:23:03.054311+0000","last_fullsized":"2024-06-04T16:23:03.054311+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":243,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"251'6","last_scrub_stamp":"2024-06-04T16:23:03.054099+0000","last_deep_scrub":"251'6","last_deep_scrub_stamp":"2024-06-04T16:23:03.054099+0000","last_clean_scrub_stamp":"2024-06-04T16:23:03.054099+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T02:24:52.447333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":24,"num_write":11,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.c","version":"254'2","reported_seq":26,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:35.995657+0000","last_change":"2024-06-04T16:23:35.995714+0000","last_active":"2024-06-04T16:23:35.995657+0000","last_peered":"2024-06-04T16:23:35.995657+0000","last_clean":"2024-06-04T16:23:35.995657+0000","last_became_active":"2024-06-04T16:16:08.664436+0000","last_became_peered":"2024-06-04T16:16:08.664436+0000","last_unstale":"2024-06-04T16:23:35.995657+0000","last_undegraded":"2024-06-04T16:23:35.995657+0000","last_fullsized":"2024-06-04T16:23:35.995657+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'2","last_scrub_stamp":"2024-06-04T16:23:35.995554+0000","last_deep_scrub":"254'2","last_deep_scrub_stamp":"2024-06-04T16:23:35.995554+0000","last_clean_scrub_stamp":"2024-06-04T16:23:35.995554+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T18:55:08.006492+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.d","version":"251'2","reported_seq":37,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:24.264929+0000","last_change":"2024-06-04T16:23:24.264955+0000","last_active":"2024-06-04T16:23:24.264929+0000","last_peered":"2024-06-04T16:23:24.264929+0000","last_clean":"2024-06-04T16:23:24.264929+0000","last_became_active":"2024-06-04T16:09:26.622747+0000","last_became_peered":"2024-06-04T16:09:26.622747+0000","last_unstale":"2024-06-04T16:23:24.264929+0000","last_undegraded":"2024-06-04T16:23:24.264929+0000","last_fullsized":"2024-06-04T16:23:24.264929+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"251'2","last_scrub_stamp":"2024-06-04T16:23:24.264813+0000","last_deep_scrub":"251'2","last_deep_scrub_stamp":"2024-06-04T16:23:24.264813+0000","last_clean_scrub_stamp":"2024-06-04T16:23:24.264813+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T23:33:06.860827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.e","version":"254'11","reported_seq":58,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:50.975841+0000","last_change":"2024-06-04T16:22:50.975841+0000","last_active":"2024-06-04T16:22:50.975841+0000","last_peered":"2024-06-04T16:22:50.975841+0000","last_clean":"2024-06-04T16:22:50.975841+0000","last_became_active":"2024-06-04T16:09:23.608866+0000","last_became_peered":"2024-06-04T16:09:23.608866+0000","last_unstale":"2024-06-04T16:22:50.975841+0000","last_undegraded":"2024-06-04T16:22:50.975841+0000","last_fullsized":"2024-06-04T16:22:50.975841+0000","mapping_epoch":246,"log_start":"0'0","ondisk_log_start":"0'0","created":246,"last_epoch_clean":247,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'11","last_scrub_stamp":"2024-06-04T16:22:50.975673+0000","last_deep_scrub":"254'11","last_deep_scrub_stamp":"2024-06-04T16:22:50.975673+0000","last_clean_scrub_stamp":"2024-06-04T16:22:50.975673+0000","objects_scrubbed":1,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T01:18:54.016221+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":13,"num_read_kb":5122,"num_write":19,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"64.f","version":"251'6","reported_seq":61,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:47.127684+0000","last_change":"2024-06-04T16:22:47.127684+0000","last_active":"2024-06-04T16:22:47.127684+0000","last_peered":"2024-06-04T16:22:47.127684+0000","last_clean":"2024-06-04T16:22:47.127684+0000","last_became_active":"2024-06-04T16:07:09.400807+0000","last_became_peered":"2024-06-04T16:07:09.400807+0000","last_unstale":"2024-06-04T16:22:47.127684+0000","last_undegraded":"2024-06-04T16:22:47.127684+0000","last_fullsized":"2024-06-04T16:22:47.127684+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":243,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"251'6","last_scrub_stamp":"2024-06-04T16:22:47.127584+0000","last_deep_scrub":"251'6","last_deep_scrub_stamp":"2024-06-04T16:22:47.127584+0000","last_clean_scrub_stamp":"2024-06-04T16:22:47.127584+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T17:42:33.593477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":19,"num_write":12,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.d","version":"0'0","reported_seq":24,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:30.995398+0000","last_change":"2024-06-04T16:23:30.995422+0000","last_active":"2024-06-04T16:23:30.995398+0000","last_peered":"2024-06-04T16:23:30.995398+0000","last_clean":"2024-06-04T16:23:30.995398+0000","last_became_active":"2024-06-04T16:16:08.656726+0000","last_became_peered":"2024-06-04T16:16:08.656726+0000","last_unstale":"2024-06-04T16:23:30.995398+0000","last_undegraded":"2024-06-04T16:23:30.995398+0000","last_fullsized":"2024-06-04T16:23:30.995398+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:23:30.995267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:23:30.995267+0000","last_clean_scrub_stamp":"2024-06-04T16:23:30.995267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T04:00:42.136125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.c","version":"254'3","reported_seq":38,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:23.668556+0000","last_change":"2024-06-04T16:23:23.668597+0000","last_active":"2024-06-04T16:23:23.668556+0000","last_peered":"2024-06-04T16:23:23.668556+0000","last_clean":"2024-06-04T16:23:23.668556+0000","last_became_active":"2024-06-04T16:09:26.627994+0000","last_became_peered":"2024-06-04T16:09:26.627994+0000","last_unstale":"2024-06-04T16:23:23.668556+0000","last_undegraded":"2024-06-04T16:23:23.668556+0000","last_fullsized":"2024-06-04T16:23:23.668556+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'3","last_scrub_stamp":"2024-06-04T16:23:23.668463+0000","last_deep_scrub":"254'3","last_deep_scrub_stamp":"2024-06-04T16:23:23.668463+0000","last_clean_scrub_stamp":"2024-06-04T16:23:23.668463+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T16:35:31.294611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8192,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.f","version":"254'2","reported_seq":43,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:51.055160+0000","last_change":"2024-06-04T16:22:51.055160+0000","last_active":"2024-06-04T16:22:51.055160+0000","last_peered":"2024-06-04T16:22:51.055160+0000","last_clean":"2024-06-04T16:22:51.055160+0000","last_became_active":"2024-06-04T16:09:23.609283+0000","last_became_peered":"2024-06-04T16:09:23.609283+0000","last_unstale":"2024-06-04T16:22:51.055160+0000","last_undegraded":"2024-06-04T16:22:51.055160+0000","last_fullsized":"2024-06-04T16:22:51.055160+0000","mapping_epoch":246,"log_start":"0'0","ondisk_log_start":"0'0","created":246,"last_epoch_clean":247,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'2","last_scrub_stamp":"2024-06-04T16:22:51.055012+0000","last_deep_scrub":"254'2","last_deep_scrub_stamp":"2024-06-04T16:22:51.055012+0000","last_clean_scrub_stamp":"2024-06-04T16:22:51.055012+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T00:43:28.540663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"64.e","version":"254'20","reported_seq":103,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:57.841373+0000","last_change":"2024-06-04T16:22:57.841402+0000","last_active":"2024-06-04T16:22:57.841373+0000","last_peered":"2024-06-04T16:22:57.841373+0000","last_clean":"2024-06-04T16:22:57.841373+0000","last_became_active":"2024-06-04T16:07:09.401515+0000","last_became_peered":"2024-06-04T16:07:09.401515+0000","last_unstale":"2024-06-04T16:22:57.841373+0000","last_undegraded":"2024-06-04T16:22:57.841373+0000","last_fullsized":"2024-06-04T16:22:57.841373+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":243,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'20","last_scrub_stamp":"2024-06-04T16:22:57.841275+0000","last_deep_scrub":"254'20","last_deep_scrub_stamp":"2024-06-04T16:22:57.841275+0000","last_clean_scrub_stamp":"2024-06-04T16:22:57.841275+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T22:23:22.342400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":108,"num_read_kb":75,"num_write":37,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.e","version":"0'0","reported_seq":24,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:39.351476+0000","last_change":"2024-06-04T16:23:39.351503+0000","last_active":"2024-06-04T16:23:39.351476+0000","last_peered":"2024-06-04T16:23:39.351476+0000","last_clean":"2024-06-04T16:23:39.351476+0000","last_became_active":"2024-06-04T16:16:08.657279+0000","last_became_peered":"2024-06-04T16:16:08.657279+0000","last_unstale":"2024-06-04T16:23:39.351476+0000","last_undegraded":"2024-06-04T16:23:39.351476+0000","last_fullsized":"2024-06-04T16:23:39.351476+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:23:39.351379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:23:39.351379+0000","last_clean_scrub_stamp":"2024-06-04T16:23:39.351379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T17:57:25.591816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.f","version":"254'10","reported_seq":54,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:48.017264+0000","last_change":"2024-06-04T16:22:48.017264+0000","last_active":"2024-06-04T16:22:48.017264+0000","last_peered":"2024-06-04T16:22:48.017264+0000","last_clean":"2024-06-04T16:22:48.017264+0000","last_became_active":"2024-06-04T16:09:26.623307+0000","last_became_peered":"2024-06-04T16:09:26.623307+0000","last_unstale":"2024-06-04T16:22:48.017264+0000","last_undegraded":"2024-06-04T16:22:48.017264+0000","last_fullsized":"2024-06-04T16:22:48.017264+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'10","last_scrub_stamp":"2024-06-04T16:22:48.017119+0000","last_deep_scrub":"254'10","last_deep_scrub_stamp":"2024-06-04T16:22:48.017119+0000","last_clean_scrub_stamp":"2024-06-04T16:22:48.017119+0000","objects_scrubbed":1,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T21:31:25.906647+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":8194,"num_write":13,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.c","version":"254'5","reported_seq":46,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:21.207433+0000","last_change":"2024-06-04T16:23:21.207482+0000","last_active":"2024-06-04T16:23:21.207433+0000","last_peered":"2024-06-04T16:23:21.207433+0000","last_clean":"2024-06-04T16:23:21.207433+0000","last_became_active":"2024-06-04T16:09:23.612445+0000","last_became_peered":"2024-06-04T16:09:23.612445+0000","last_unstale":"2024-06-04T16:23:21.207433+0000","last_undegraded":"2024-06-04T16:23:21.207433+0000","last_fullsized":"2024-06-04T16:23:21.207433+0000","mapping_epoch":246,"log_start":"0'0","ondisk_log_start":"0'0","created":246,"last_epoch_clean":247,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'5","last_scrub_stamp":"2024-06-04T16:23:21.207328+0000","last_deep_scrub":"254'5","last_deep_scrub_stamp":"2024-06-04T16:23:21.207328+0000","last_clean_scrub_stamp":"2024-06-04T16:23:21.207328+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T20:25:45.797505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":1024,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"64.d","version":"251'24","reported_seq":115,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:52.929164+0000","last_change":"2024-06-04T16:22:52.929164+0000","last_active":"2024-06-04T16:22:52.929164+0000","last_peered":"2024-06-04T16:22:52.929164+0000","last_clean":"2024-06-04T16:22:52.929164+0000","last_became_active":"2024-06-04T16:07:09.511172+0000","last_became_peered":"2024-06-04T16:07:09.511172+0000","last_unstale":"2024-06-04T16:22:52.929164+0000","last_undegraded":"2024-06-04T16:22:52.929164+0000","last_fullsized":"2024-06-04T16:22:52.929164+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":243,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"251'24","last_scrub_stamp":"2024-06-04T16:22:52.929049+0000","last_deep_scrub":"251'24","last_deep_scrub_stamp":"2024-06-04T16:22:52.929049+0000","last_clean_scrub_stamp":"2024-06-04T16:22:52.929049+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T00:38:16.499504+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":134,"num_read_kb":91,"num_write":39,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.f","version":"0'0","reported_seq":24,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:34.037390+0000","last_change":"2024-06-04T16:23:34.037417+0000","last_active":"2024-06-04T16:23:34.037390+0000","last_peered":"2024-06-04T16:23:34.037390+0000","last_clean":"2024-06-04T16:23:34.037390+0000","last_became_active":"2024-06-04T16:16:08.662182+0000","last_became_peered":"2024-06-04T16:16:08.662182+0000","last_unstale":"2024-06-04T16:23:34.037390+0000","last_undegraded":"2024-06-04T16:23:34.037390+0000","last_fullsized":"2024-06-04T16:23:34.037390+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:23:34.037278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:23:34.037278+0000","last_clean_scrub_stamp":"2024-06-04T16:23:34.037278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T20:01:36.616756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.e","version":"0'0","reported_seq":33,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:04.074619+0000","last_change":"2024-06-04T16:23:04.074644+0000","last_active":"2024-06-04T16:23:04.074619+0000","last_peered":"2024-06-04T16:23:04.074619+0000","last_clean":"2024-06-04T16:23:04.074619+0000","last_became_active":"2024-06-04T16:09:26.629039+0000","last_became_peered":"2024-06-04T16:09:26.629039+0000","last_unstale":"2024-06-04T16:23:04.074619+0000","last_undegraded":"2024-06-04T16:23:04.074619+0000","last_fullsized":"2024-06-04T16:23:04.074619+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:23:04.074530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:23:04.074530+0000","last_clean_scrub_stamp":"2024-06-04T16:23:04.074530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T20:00:22.482411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.d","version":"254'7","reported_seq":52,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:23.350026+0000","last_change":"2024-06-04T16:23:23.350070+0000","last_active":"2024-06-04T16:23:23.350026+0000","last_peered":"2024-06-04T16:23:23.350026+0000","last_clean":"2024-06-04T16:23:23.350026+0000","last_became_active":"2024-06-04T16:09:23.606695+0000","last_became_peered":"2024-06-04T16:09:23.606695+0000","last_unstale":"2024-06-04T16:23:23.350026+0000","last_undegraded":"2024-06-04T16:23:23.350026+0000","last_fullsized":"2024-06-04T16:23:23.350026+0000","mapping_epoch":246,"log_start":"0'0","ondisk_log_start":"0'0","created":246,"last_epoch_clean":247,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'7","last_scrub_stamp":"2024-06-04T16:23:23.349909+0000","last_deep_scrub":"254'7","last_deep_scrub_stamp":"2024-06-04T16:23:23.349909+0000","last_clean_scrub_stamp":"2024-06-04T16:23:23.349909+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T20:58:47.153109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":20480,"num_write":12,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"64.c","version":"251'31","reported_seq":133,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:50.515381+0000","last_change":"2024-06-04T16:22:50.515381+0000","last_active":"2024-06-04T16:22:50.515381+0000","last_peered":"2024-06-04T16:22:50.515381+0000","last_clean":"2024-06-04T16:22:50.515381+0000","last_became_active":"2024-06-04T16:07:09.510728+0000","last_became_peered":"2024-06-04T16:07:09.510728+0000","last_unstale":"2024-06-04T16:22:50.515381+0000","last_undegraded":"2024-06-04T16:22:50.515381+0000","last_fullsized":"2024-06-04T16:22:50.515381+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":243,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"251'31","last_scrub_stamp":"2024-06-04T16:22:50.515259+0000","last_deep_scrub":"251'31","last_deep_scrub_stamp":"2024-06-04T16:22:50.515259+0000","last_clean_scrub_stamp":"2024-06-04T16:22:50.515259+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T22:41:16.625162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":168,"num_read_kb":120,"num_write":55,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.8","version":"0'0","reported_seq":24,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:28.786476+0000","last_change":"2024-06-04T16:23:28.786525+0000","last_active":"2024-06-04T16:23:28.786476+0000","last_peered":"2024-06-04T16:23:28.786476+0000","last_clean":"2024-06-04T16:23:28.786476+0000","last_became_active":"2024-06-04T16:16:08.664198+0000","last_became_peered":"2024-06-04T16:16:08.664198+0000","last_unstale":"2024-06-04T16:23:28.786476+0000","last_undegraded":"2024-06-04T16:23:28.786476+0000","last_fullsized":"2024-06-04T16:23:28.786476+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:23:28.786390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:23:28.786390+0000","last_clean_scrub_stamp":"2024-06-04T16:23:28.786390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T03:14:34.607243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.9","version":"254'6","reported_seq":44,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:58.503564+0000","last_change":"2024-06-04T16:22:58.503590+0000","last_active":"2024-06-04T16:22:58.503564+0000","last_peered":"2024-06-04T16:22:58.503564+0000","last_clean":"2024-06-04T16:22:58.503564+0000","last_became_active":"2024-06-04T16:09:26.625999+0000","last_became_peered":"2024-06-04T16:09:26.625999+0000","last_unstale":"2024-06-04T16:22:58.503564+0000","last_undegraded":"2024-06-04T16:22:58.503564+0000","last_fullsized":"2024-06-04T16:22:58.503564+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'6","last_scrub_stamp":"2024-06-04T16:22:58.503400+0000","last_deep_scrub":"254'6","last_deep_scrub_stamp":"2024-06-04T16:22:58.503400+0000","last_clean_scrub_stamp":"2024-06-04T16:22:58.503400+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T21:34:38.409946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":9216,"num_write":6,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.a","version":"254'3","reported_seq":42,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:49.524226+0000","last_change":"2024-06-04T16:22:49.524282+0000","last_active":"2024-06-04T16:22:49.524226+0000","last_peered":"2024-06-04T16:22:49.524226+0000","last_clean":"2024-06-04T16:22:49.524226+0000","last_became_active":"2024-06-04T16:09:23.600752+0000","last_became_peered":"2024-06-04T16:09:23.600752+0000","last_unstale":"2024-06-04T16:22:49.524226+0000","last_undegraded":"2024-06-04T16:22:49.524226+0000","last_fullsized":"2024-06-04T16:22:49.524226+0000","mapping_epoch":246,"log_start":"0'0","ondisk_log_start":"0'0","created":246,"last_epoch_clean":247,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'3","last_scrub_stamp":"2024-06-04T16:22:49.524121+0000","last_deep_scrub":"254'3","last_deep_scrub_stamp":"2024-06-04T16:22:49.524121+0000","last_clean_scrub_stamp":"2024-06-04T16:22:49.524121+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T19:02:56.815608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"64.b","version":"251'21","reported_seq":106,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:58.017646+0000","last_change":"2024-06-04T16:22:58.017670+0000","last_active":"2024-06-04T16:22:58.017646+0000","last_peered":"2024-06-04T16:22:58.017646+0000","last_clean":"2024-06-04T16:22:58.017646+0000","last_became_active":"2024-06-04T16:07:09.513020+0000","last_became_peered":"2024-06-04T16:07:09.513020+0000","last_unstale":"2024-06-04T16:22:58.017646+0000","last_undegraded":"2024-06-04T16:22:58.017646+0000","last_fullsized":"2024-06-04T16:22:58.017646+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":243,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"251'21","last_scrub_stamp":"2024-06-04T16:22:58.017535+0000","last_deep_scrub":"251'21","last_deep_scrub_stamp":"2024-06-04T16:22:58.017535+0000","last_clean_scrub_stamp":"2024-06-04T16:22:58.017535+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T18:24:46.428109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":114,"num_read_kb":81,"num_write":38,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.9","version":"0'0","reported_seq":24,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:49.767666+0000","last_change":"2024-06-04T16:23:49.767694+0000","last_active":"2024-06-04T16:23:49.767666+0000","last_peered":"2024-06-04T16:23:49.767666+0000","last_clean":"2024-06-04T16:23:49.767666+0000","last_became_active":"2024-06-04T16:16:08.658076+0000","last_became_peered":"2024-06-04T16:16:08.658076+0000","last_unstale":"2024-06-04T16:23:49.767666+0000","last_undegraded":"2024-06-04T16:23:49.767666+0000","last_fullsized":"2024-06-04T16:23:49.767666+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:23:49.767562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:23:49.767562+0000","last_clean_scrub_stamp":"2024-06-04T16:23:49.767562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T18:14:51.440464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.8","version":"254'7","reported_seq":41,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:52.040855+0000","last_change":"2024-06-04T16:22:52.040890+0000","last_active":"2024-06-04T16:22:52.040855+0000","last_peered":"2024-06-04T16:22:52.040855+0000","last_clean":"2024-06-04T16:22:52.040855+0000","last_became_active":"2024-06-04T16:09:26.623966+0000","last_became_peered":"2024-06-04T16:09:26.623966+0000","last_unstale":"2024-06-04T16:22:52.040855+0000","last_undegraded":"2024-06-04T16:22:52.040855+0000","last_fullsized":"2024-06-04T16:22:52.040855+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'7","last_scrub_stamp":"2024-06-04T16:22:52.040732+0000","last_deep_scrub":"254'7","last_deep_scrub_stamp":"2024-06-04T16:22:52.040732+0000","last_clean_scrub_stamp":"2024-06-04T16:22:52.040732+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T00:48:17.796817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4096,"num_write":12,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.b","version":"254'4","reported_seq":45,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:23.232762+0000","last_change":"2024-06-04T16:23:23.232790+0000","last_active":"2024-06-04T16:23:23.232762+0000","last_peered":"2024-06-04T16:23:23.232762+0000","last_clean":"2024-06-04T16:23:23.232762+0000","last_became_active":"2024-06-04T16:09:23.613130+0000","last_became_peered":"2024-06-04T16:09:23.613130+0000","last_unstale":"2024-06-04T16:23:23.232762+0000","last_undegraded":"2024-06-04T16:23:23.232762+0000","last_fullsized":"2024-06-04T16:23:23.232762+0000","mapping_epoch":246,"log_start":"0'0","ondisk_log_start":"0'0","created":246,"last_epoch_clean":247,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'4","last_scrub_stamp":"2024-06-04T16:23:23.232672+0000","last_deep_scrub":"254'4","last_deep_scrub_stamp":"2024-06-04T16:23:23.232672+0000","last_clean_scrub_stamp":"2024-06-04T16:23:23.232672+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T16:29:52.887408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3775,"num_write":4,"num_write_kb":3775,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"64.a","version":"251'22","reported_seq":109,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:51.982618+0000","last_change":"2024-06-04T16:22:51.982647+0000","last_active":"2024-06-04T16:22:51.982618+0000","last_peered":"2024-06-04T16:22:51.982618+0000","last_clean":"2024-06-04T16:22:51.982618+0000","last_became_active":"2024-06-04T16:07:09.403980+0000","last_became_peered":"2024-06-04T16:07:09.403980+0000","last_unstale":"2024-06-04T16:22:51.982618+0000","last_undegraded":"2024-06-04T16:22:51.982618+0000","last_fullsized":"2024-06-04T16:22:51.982618+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":243,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"251'22","last_scrub_stamp":"2024-06-04T16:22:51.982518+0000","last_deep_scrub":"251'22","last_deep_scrub_stamp":"2024-06-04T16:22:51.982518+0000","last_clean_scrub_stamp":"2024-06-04T16:22:51.982518+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T21:31:54.076119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":122,"num_read_kb":87,"num_write":38,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.a","version":"0'0","reported_seq":24,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:20.813915+0000","last_change":"2024-06-04T16:23:20.813953+0000","last_active":"2024-06-04T16:23:20.813915+0000","last_peered":"2024-06-04T16:23:20.813915+0000","last_clean":"2024-06-04T16:23:20.813915+0000","last_became_active":"2024-06-04T16:16:08.661413+0000","last_became_peered":"2024-06-04T16:16:08.661413+0000","last_unstale":"2024-06-04T16:23:20.813915+0000","last_undegraded":"2024-06-04T16:23:20.813915+0000","last_fullsized":"2024-06-04T16:23:20.813915+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:23:20.813795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:23:20.813795+0000","last_clean_scrub_stamp":"2024-06-04T16:23:20.813795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T23:43:11.287682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.b","version":"254'4","reported_seq":41,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:06.858334+0000","last_change":"2024-06-04T16:23:06.858360+0000","last_active":"2024-06-04T16:23:06.858334+0000","last_peered":"2024-06-04T16:23:06.858334+0000","last_clean":"2024-06-04T16:23:06.858334+0000","last_became_active":"2024-06-04T16:09:26.622600+0000","last_became_peered":"2024-06-04T16:09:26.622600+0000","last_unstale":"2024-06-04T16:23:06.858334+0000","last_undegraded":"2024-06-04T16:23:06.858334+0000","last_fullsized":"2024-06-04T16:23:06.858334+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'4","last_scrub_stamp":"2024-06-04T16:23:06.858249+0000","last_deep_scrub":"254'4","last_deep_scrub_stamp":"2024-06-04T16:23:06.858249+0000","last_clean_scrub_stamp":"2024-06-04T16:23:06.858249+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T00:09:08.441861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":1032,"num_write":4,"num_write_kb":1028,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.8","version":"251'2","reported_seq":43,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:14.877485+0000","last_change":"2024-06-04T16:23:14.877514+0000","last_active":"2024-06-04T16:23:14.877485+0000","last_peered":"2024-06-04T16:23:14.877485+0000","last_clean":"2024-06-04T16:23:14.877485+0000","last_became_active":"2024-06-04T16:09:23.610525+0000","last_became_peered":"2024-06-04T16:09:23.610525+0000","last_unstale":"2024-06-04T16:23:14.877485+0000","last_undegraded":"2024-06-04T16:23:14.877485+0000","last_fullsized":"2024-06-04T16:23:14.877485+0000","mapping_epoch":246,"log_start":"0'0","ondisk_log_start":"0'0","created":246,"last_epoch_clean":247,"parent":"0.0","parent_split_bits":0,"last_scrub":"251'2","last_scrub_stamp":"2024-06-04T16:23:14.877393+0000","last_deep_scrub":"251'2","last_deep_scrub_stamp":"2024-06-04T16:23:14.877393+0000","last_clean_scrub_stamp":"2024-06-04T16:23:14.877393+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T20:03:45.551762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"64.9","version":"251'14","reported_seq":88,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:51.381066+0000","last_change":"2024-06-04T16:22:51.381093+0000","last_active":"2024-06-04T16:22:51.381066+0000","last_peered":"2024-06-04T16:22:51.381066+0000","last_clean":"2024-06-04T16:22:51.381066+0000","last_became_active":"2024-06-04T16:07:09.403227+0000","last_became_peered":"2024-06-04T16:07:09.403227+0000","last_unstale":"2024-06-04T16:22:51.381066+0000","last_undegraded":"2024-06-04T16:22:51.381066+0000","last_fullsized":"2024-06-04T16:22:51.381066+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":243,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"251'14","last_scrub_stamp":"2024-06-04T16:22:51.380961+0000","last_deep_scrub":"251'14","last_deep_scrub_stamp":"2024-06-04T16:22:51.380961+0000","last_clean_scrub_stamp":"2024-06-04T16:22:51.380961+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T23:08:22.543065+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":56,"num_write":27,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.b","version":"0'0","reported_seq":24,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:27.271514+0000","last_change":"2024-06-04T16:23:27.271540+0000","last_active":"2024-06-04T16:23:27.271514+0000","last_peered":"2024-06-04T16:23:27.271514+0000","last_clean":"2024-06-04T16:23:27.271514+0000","last_became_active":"2024-06-04T16:16:08.660717+0000","last_became_peered":"2024-06-04T16:16:08.660717+0000","last_unstale":"2024-06-04T16:23:27.271514+0000","last_undegraded":"2024-06-04T16:23:27.271514+0000","last_fullsized":"2024-06-04T16:23:27.271514+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:23:27.271425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:23:27.271425+0000","last_clean_scrub_stamp":"2024-06-04T16:23:27.271425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T21:13:50.140580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.a","version":"254'2","reported_seq":37,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:49.053054+0000","last_change":"2024-06-04T16:22:49.053106+0000","last_active":"2024-06-04T16:22:49.053054+0000","last_peered":"2024-06-04T16:22:49.053054+0000","last_clean":"2024-06-04T16:22:49.053054+0000","last_became_active":"2024-06-04T16:09:26.620119+0000","last_became_peered":"2024-06-04T16:09:26.620119+0000","last_unstale":"2024-06-04T16:22:49.053054+0000","last_undegraded":"2024-06-04T16:22:49.053054+0000","last_fullsized":"2024-06-04T16:22:49.053054+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'2","last_scrub_stamp":"2024-06-04T16:22:49.052943+0000","last_deep_scrub":"254'2","last_deep_scrub_stamp":"2024-06-04T16:22:49.052943+0000","last_clean_scrub_stamp":"2024-06-04T16:22:49.052943+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T04:22:22.929186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8192,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.9","version":"254'6","reported_seq":51,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:46.368834+0000","last_change":"2024-06-04T16:22:46.368878+0000","last_active":"2024-06-04T16:22:46.368834+0000","last_peered":"2024-06-04T16:22:46.368834+0000","last_clean":"2024-06-04T16:22:46.368834+0000","last_became_active":"2024-06-04T16:09:23.607666+0000","last_became_peered":"2024-06-04T16:09:23.607666+0000","last_unstale":"2024-06-04T16:22:46.368834+0000","last_undegraded":"2024-06-04T16:22:46.368834+0000","last_fullsized":"2024-06-04T16:22:46.368834+0000","mapping_epoch":246,"log_start":"0'0","ondisk_log_start":"0'0","created":246,"last_epoch_clean":247,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'6","last_scrub_stamp":"2024-06-04T16:22:46.368741+0000","last_deep_scrub":"254'6","last_deep_scrub_stamp":"2024-06-04T16:22:46.368741+0000","last_clean_scrub_stamp":"2024-06-04T16:22:46.368741+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T17:57:54.874735+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":16386,"num_write":9,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"64.8","version":"251'8","reported_seq":70,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:55.897731+0000","last_change":"2024-06-04T16:22:55.897764+0000","last_active":"2024-06-04T16:22:55.897731+0000","last_peered":"2024-06-04T16:22:55.897731+0000","last_clean":"2024-06-04T16:22:55.897731+0000","last_became_active":"2024-06-04T16:07:09.404928+0000","last_became_peered":"2024-06-04T16:07:09.404928+0000","last_unstale":"2024-06-04T16:22:55.897731+0000","last_undegraded":"2024-06-04T16:22:55.897731+0000","last_fullsized":"2024-06-04T16:22:55.897731+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":243,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"251'8","last_scrub_stamp":"2024-06-04T16:22:55.897619+0000","last_deep_scrub":"251'8","last_deep_scrub_stamp":"2024-06-04T16:22:55.897619+0000","last_clean_scrub_stamp":"2024-06-04T16:22:55.897619+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T16:49:54.112318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":32,"num_write":14,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.4","version":"0'0","reported_seq":24,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:43.393075+0000","last_change":"2024-06-04T16:23:43.393101+0000","last_active":"2024-06-04T16:23:43.393075+0000","last_peered":"2024-06-04T16:23:43.393075+0000","last_clean":"2024-06-04T16:23:43.393075+0000","last_became_active":"2024-06-04T16:16:08.662732+0000","last_became_peered":"2024-06-04T16:16:08.662732+0000","last_unstale":"2024-06-04T16:23:43.393075+0000","last_undegraded":"2024-06-04T16:23:43.393075+0000","last_fullsized":"2024-06-04T16:23:43.393075+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:23:43.392969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:23:43.392969+0000","last_clean_scrub_stamp":"2024-06-04T16:23:43.392969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T18:13:13.362164+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.5","version":"254'2","reported_seq":36,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:31.871833+0000","last_change":"2024-06-04T16:23:31.871900+0000","last_active":"2024-06-04T16:23:31.871833+0000","last_peered":"2024-06-04T16:23:31.871833+0000","last_clean":"2024-06-04T16:23:31.871833+0000","last_became_active":"2024-06-04T16:09:26.624142+0000","last_became_peered":"2024-06-04T16:09:26.624142+0000","last_unstale":"2024-06-04T16:23:31.871833+0000","last_undegraded":"2024-06-04T16:23:31.871833+0000","last_fullsized":"2024-06-04T16:23:31.871833+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'2","last_scrub_stamp":"2024-06-04T16:23:31.871668+0000","last_deep_scrub":"254'2","last_deep_scrub_stamp":"2024-06-04T16:23:31.871668+0000","last_clean_scrub_stamp":"2024-06-04T16:23:31.871668+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T22:19:56.554258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.6","version":"254'3","reported_seq":44,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:49.001427+0000","last_change":"2024-06-04T16:22:49.001449+0000","last_active":"2024-06-04T16:22:49.001427+0000","last_peered":"2024-06-04T16:22:49.001427+0000","last_clean":"2024-06-04T16:22:49.001427+0000","last_became_active":"2024-06-04T16:09:23.608300+0000","last_became_peered":"2024-06-04T16:09:23.608300+0000","last_unstale":"2024-06-04T16:22:49.001427+0000","last_undegraded":"2024-06-04T16:22:49.001427+0000","last_fullsized":"2024-06-04T16:22:49.001427+0000","mapping_epoch":246,"log_start":"0'0","ondisk_log_start":"0'0","created":246,"last_epoch_clean":247,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'3","last_scrub_stamp":"2024-06-04T16:22:49.001320+0000","last_deep_scrub":"254'3","last_deep_scrub_stamp":"2024-06-04T16:22:49.001320+0000","last_clean_scrub_stamp":"2024-06-04T16:22:49.001320+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T00:45:23.418302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8192,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"64.7","version":"251'16","reported_seq":88,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:48.318184+0000","last_change":"2024-06-04T16:22:48.318225+0000","last_active":"2024-06-04T16:22:48.318184+0000","last_peered":"2024-06-04T16:22:48.318184+0000","last_clean":"2024-06-04T16:22:48.318184+0000","last_became_active":"2024-06-04T16:07:09.511421+0000","last_became_peered":"2024-06-04T16:07:09.511421+0000","last_unstale":"2024-06-04T16:22:48.318184+0000","last_undegraded":"2024-06-04T16:22:48.318184+0000","last_fullsized":"2024-06-04T16:22:48.318184+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":243,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"251'16","last_scrub_stamp":"2024-06-04T16:22:48.318088+0000","last_deep_scrub":"251'16","last_deep_scrub_stamp":"2024-06-04T16:22:48.318088+0000","last_clean_scrub_stamp":"2024-06-04T16:22:48.318088+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T16:27:39.204380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":56,"num_write":28,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.5","version":"0'0","reported_seq":24,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:37.363979+0000","last_change":"2024-06-04T16:23:37.364011+0000","last_active":"2024-06-04T16:23:37.363979+0000","last_peered":"2024-06-04T16:23:37.363979+0000","last_clean":"2024-06-04T16:23:37.363979+0000","last_became_active":"2024-06-04T16:16:08.655913+0000","last_became_peered":"2024-06-04T16:16:08.655913+0000","last_unstale":"2024-06-04T16:23:37.363979+0000","last_undegraded":"2024-06-04T16:23:37.363979+0000","last_fullsized":"2024-06-04T16:23:37.363979+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:23:37.363878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:23:37.363878+0000","last_clean_scrub_stamp":"2024-06-04T16:23:37.363878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T22:06:52.340914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.4","version":"254'2","reported_seq":37,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:46.708158+0000","last_change":"2024-06-04T16:23:46.708158+0000","last_active":"2024-06-04T16:23:46.708158+0000","last_peered":"2024-06-04T16:23:46.708158+0000","last_clean":"2024-06-04T16:23:46.708158+0000","last_became_active":"2024-06-04T16:09:26.627915+0000","last_became_peered":"2024-06-04T16:09:26.627915+0000","last_unstale":"2024-06-04T16:23:46.708158+0000","last_undegraded":"2024-06-04T16:23:46.708158+0000","last_fullsized":"2024-06-04T16:23:46.708158+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'2","last_scrub_stamp":"2024-06-04T16:23:46.708019+0000","last_deep_scrub":"254'2","last_deep_scrub_stamp":"2024-06-04T16:23:46.708019+0000","last_clean_scrub_stamp":"2024-06-04T16:23:46.708019+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T03:10:06.449434+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.7","version":"251'3","reported_seq":44,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:27.866905+0000","last_change":"2024-06-04T16:23:27.866933+0000","last_active":"2024-06-04T16:23:27.866905+0000","last_peered":"2024-06-04T16:23:27.866905+0000","last_clean":"2024-06-04T16:23:27.866905+0000","last_became_active":"2024-06-04T16:09:23.605516+0000","last_became_peered":"2024-06-04T16:09:23.605516+0000","last_unstale":"2024-06-04T16:23:27.866905+0000","last_undegraded":"2024-06-04T16:23:27.866905+0000","last_fullsized":"2024-06-04T16:23:27.866905+0000","mapping_epoch":246,"log_start":"0'0","ondisk_log_start":"0'0","created":246,"last_epoch_clean":247,"parent":"0.0","parent_split_bits":0,"last_scrub":"251'3","last_scrub_stamp":"2024-06-04T16:23:27.866790+0000","last_deep_scrub":"251'3","last_deep_scrub_stamp":"2024-06-04T16:23:27.866790+0000","last_clean_scrub_stamp":"2024-06-04T16:23:27.866790+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T00:57:26.404262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"64.6","version":"251'12","reported_seq":76,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:43.846902+0000","last_change":"2024-06-04T16:22:43.846928+0000","last_active":"2024-06-04T16:22:43.846902+0000","last_peered":"2024-06-04T16:22:43.846902+0000","last_clean":"2024-06-04T16:22:43.846902+0000","last_became_active":"2024-06-04T16:07:09.397805+0000","last_became_peered":"2024-06-04T16:07:09.397805+0000","last_unstale":"2024-06-04T16:22:43.846902+0000","last_undegraded":"2024-06-04T16:22:43.846902+0000","last_fullsized":"2024-06-04T16:22:43.846902+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":243,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"251'12","last_scrub_stamp":"2024-06-04T16:22:43.846809+0000","last_deep_scrub":"251'12","last_deep_scrub_stamp":"2024-06-04T16:22:43.846809+0000","last_clean_scrub_stamp":"2024-06-04T16:22:43.846809+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T03:24:27.327994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":38,"num_write":27,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.6","version":"254'2","reported_seq":26,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:48.721610+0000","last_change":"2024-06-04T16:23:48.721656+0000","last_active":"2024-06-04T16:23:48.721610+0000","last_peered":"2024-06-04T16:23:48.721610+0000","last_clean":"2024-06-04T16:23:48.721610+0000","last_became_active":"2024-06-04T16:16:08.656182+0000","last_became_peered":"2024-06-04T16:16:08.656182+0000","last_unstale":"2024-06-04T16:23:48.721610+0000","last_undegraded":"2024-06-04T16:23:48.721610+0000","last_fullsized":"2024-06-04T16:23:48.721610+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'2","last_scrub_stamp":"2024-06-04T16:23:48.721530+0000","last_deep_scrub":"254'2","last_deep_scrub_stamp":"2024-06-04T16:23:48.721530+0000","last_clean_scrub_stamp":"2024-06-04T16:23:48.721530+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T20:58:43.555927+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.7","version":"0'0","reported_seq":33,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:45.683712+0000","last_change":"2024-06-04T16:23:45.683737+0000","last_active":"2024-06-04T16:23:45.683712+0000","last_peered":"2024-06-04T16:23:45.683712+0000","last_clean":"2024-06-04T16:23:45.683712+0000","last_became_active":"2024-06-04T16:09:26.625833+0000","last_became_peered":"2024-06-04T16:09:26.625833+0000","last_unstale":"2024-06-04T16:23:45.683712+0000","last_undegraded":"2024-06-04T16:23:45.683712+0000","last_fullsized":"2024-06-04T16:23:45.683712+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:23:45.683607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:23:45.683607+0000","last_clean_scrub_stamp":"2024-06-04T16:23:45.683607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T20:21:18.863214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.4","version":"0'0","reported_seq":40,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:55.080556+0000","last_change":"2024-06-04T16:22:55.080556+0000","last_active":"2024-06-04T16:22:55.080556+0000","last_peered":"2024-06-04T16:22:55.080556+0000","last_clean":"2024-06-04T16:22:55.080556+0000","last_became_active":"2024-06-04T16:09:23.606669+0000","last_became_peered":"2024-06-04T16:09:23.606669+0000","last_unstale":"2024-06-04T16:22:55.080556+0000","last_undegraded":"2024-06-04T16:22:55.080556+0000","last_fullsized":"2024-06-04T16:22:55.080556+0000","mapping_epoch":246,"log_start":"0'0","ondisk_log_start":"0'0","created":246,"last_epoch_clean":247,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:22:55.080426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:22:55.080426+0000","last_clean_scrub_stamp":"2024-06-04T16:22:55.080426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T04:12:00.220771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"64.5","version":"254'31","reported_seq":137,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:46.146668+0000","last_change":"2024-06-04T16:22:46.146668+0000","last_active":"2024-06-04T16:22:46.146668+0000","last_peered":"2024-06-04T16:22:46.146668+0000","last_clean":"2024-06-04T16:22:46.146668+0000","last_became_active":"2024-06-04T16:07:09.403868+0000","last_became_peered":"2024-06-04T16:07:09.403868+0000","last_unstale":"2024-06-04T16:22:46.146668+0000","last_undegraded":"2024-06-04T16:22:46.146668+0000","last_fullsized":"2024-06-04T16:22:46.146668+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":243,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'31","last_scrub_stamp":"2024-06-04T16:22:46.146551+0000","last_deep_scrub":"254'31","last_deep_scrub_stamp":"2024-06-04T16:22:46.146551+0000","last_clean_scrub_stamp":"2024-06-04T16:22:46.146551+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T03:51:35.087658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":170,"num_read_kb":120,"num_write":66,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.7","version":"0'0","reported_seq":24,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:19.846994+0000","last_change":"2024-06-04T16:23:19.847020+0000","last_active":"2024-06-04T16:23:19.846994+0000","last_peered":"2024-06-04T16:23:19.846994+0000","last_clean":"2024-06-04T16:23:19.846994+0000","last_became_active":"2024-06-04T16:16:08.661379+0000","last_became_peered":"2024-06-04T16:16:08.661379+0000","last_unstale":"2024-06-04T16:23:19.846994+0000","last_undegraded":"2024-06-04T16:23:19.846994+0000","last_fullsized":"2024-06-04T16:23:19.846994+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:23:19.846894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:23:19.846894+0000","last_clean_scrub_stamp":"2024-06-04T16:23:19.846894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T20:31:05.565364+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.6","version":"0'0","reported_seq":33,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:55.526651+0000","last_change":"2024-06-04T16:22:55.526689+0000","last_active":"2024-06-04T16:22:55.526651+0000","last_peered":"2024-06-04T16:22:55.526651+0000","last_clean":"2024-06-04T16:22:55.526651+0000","last_became_active":"2024-06-04T16:09:26.624074+0000","last_became_peered":"2024-06-04T16:09:26.624074+0000","last_unstale":"2024-06-04T16:22:55.526651+0000","last_undegraded":"2024-06-04T16:22:55.526651+0000","last_fullsized":"2024-06-04T16:22:55.526651+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:22:55.526546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:22:55.526546+0000","last_clean_scrub_stamp":"2024-06-04T16:22:55.526546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T03:18:57.714249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.5","version":"254'4","reported_seq":46,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:48.563077+0000","last_change":"2024-06-04T16:22:48.563077+0000","last_active":"2024-06-04T16:22:48.563077+0000","last_peered":"2024-06-04T16:22:48.563077+0000","last_clean":"2024-06-04T16:22:48.563077+0000","last_became_active":"2024-06-04T16:09:23.604255+0000","last_became_peered":"2024-06-04T16:09:23.604255+0000","last_unstale":"2024-06-04T16:22:48.563077+0000","last_undegraded":"2024-06-04T16:22:48.563077+0000","last_fullsized":"2024-06-04T16:22:48.563077+0000","mapping_epoch":246,"log_start":"0'0","ondisk_log_start":"0'0","created":246,"last_epoch_clean":247,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'4","last_scrub_stamp":"2024-06-04T16:22:48.562953+0000","last_deep_scrub":"254'4","last_deep_scrub_stamp":"2024-06-04T16:22:48.562953+0000","last_clean_scrub_stamp":"2024-06-04T16:22:48.562953+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T18:29:37.864894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":4,"num_write_kb":1026,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"64.4","version":"254'14","reported_seq":86,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:44.859785+0000","last_change":"2024-06-04T16:22:44.859785+0000","last_active":"2024-06-04T16:22:44.859785+0000","last_peered":"2024-06-04T16:22:44.859785+0000","last_clean":"2024-06-04T16:22:44.859785+0000","last_became_active":"2024-06-04T16:07:09.396484+0000","last_became_peered":"2024-06-04T16:07:09.396484+0000","last_unstale":"2024-06-04T16:22:44.859785+0000","last_undegraded":"2024-06-04T16:22:44.859785+0000","last_fullsized":"2024-06-04T16:22:44.859785+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":243,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'14","last_scrub_stamp":"2024-06-04T16:22:44.859685+0000","last_deep_scrub":"254'14","last_deep_scrub_stamp":"2024-06-04T16:22:44.859685+0000","last_clean_scrub_stamp":"2024-06-04T16:22:44.859685+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T22:48:04.782391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":52,"num_write":27,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.0","version":"0'0","reported_seq":24,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:50.720244+0000","last_change":"2024-06-04T16:23:50.720268+0000","last_active":"2024-06-04T16:23:50.720244+0000","last_peered":"2024-06-04T16:23:50.720244+0000","last_clean":"2024-06-04T16:23:50.720244+0000","last_became_active":"2024-06-04T16:16:08.660893+0000","last_became_peered":"2024-06-04T16:16:08.660893+0000","last_unstale":"2024-06-04T16:23:50.720244+0000","last_undegraded":"2024-06-04T16:23:50.720244+0000","last_fullsized":"2024-06-04T16:23:50.720244+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:23:50.720145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:23:50.720145+0000","last_clean_scrub_stamp":"2024-06-04T16:23:50.720145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T22:13:23.672822+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1","version":"251'2","reported_seq":38,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:10.885979+0000","last_change":"2024-06-04T16:23:10.885979+0000","last_active":"2024-06-04T16:23:10.885979+0000","last_peered":"2024-06-04T16:23:10.885979+0000","last_clean":"2024-06-04T16:23:10.885979+0000","last_became_active":"2024-06-04T16:09:26.623190+0000","last_became_peered":"2024-06-04T16:09:26.623190+0000","last_unstale":"2024-06-04T16:23:10.885979+0000","last_undegraded":"2024-06-04T16:23:10.885979+0000","last_fullsized":"2024-06-04T16:23:10.885979+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"251'2","last_scrub_stamp":"2024-06-04T16:23:10.885822+0000","last_deep_scrub":"251'2","last_deep_scrub_stamp":"2024-06-04T16:23:10.885822+0000","last_clean_scrub_stamp":"2024-06-04T16:23:10.885822+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T00:05:15.167784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.2","version":"254'6","reported_seq":51,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:02.911961+0000","last_change":"2024-06-04T16:23:02.911961+0000","last_active":"2024-06-04T16:23:02.911961+0000","last_peered":"2024-06-04T16:23:02.911961+0000","last_clean":"2024-06-04T16:23:02.911961+0000","last_became_active":"2024-06-04T16:09:23.610479+0000","last_became_peered":"2024-06-04T16:09:23.610479+0000","last_unstale":"2024-06-04T16:23:02.911961+0000","last_undegraded":"2024-06-04T16:23:02.911961+0000","last_fullsized":"2024-06-04T16:23:02.911961+0000","mapping_epoch":246,"log_start":"0'0","ondisk_log_start":"0'0","created":246,"last_epoch_clean":247,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'6","last_scrub_stamp":"2024-06-04T16:23:02.911818+0000","last_deep_scrub":"254'6","last_deep_scrub_stamp":"2024-06-04T16:23:02.911818+0000","last_clean_scrub_stamp":"2024-06-04T16:23:02.911818+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T20:46:50.376469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5120,"num_write":6,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"64.3","version":"251'23","reported_seq":108,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:47.329808+0000","last_change":"2024-06-04T16:22:47.329808+0000","last_active":"2024-06-04T16:22:47.329808+0000","last_peered":"2024-06-04T16:22:47.329808+0000","last_clean":"2024-06-04T16:22:47.329808+0000","last_became_active":"2024-06-04T16:07:09.512996+0000","last_became_peered":"2024-06-04T16:07:09.512996+0000","last_unstale":"2024-06-04T16:22:47.329808+0000","last_undegraded":"2024-06-04T16:22:47.329808+0000","last_fullsized":"2024-06-04T16:22:47.329808+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":243,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"251'23","last_scrub_stamp":"2024-06-04T16:22:47.329687+0000","last_deep_scrub":"251'23","last_deep_scrub_stamp":"2024-06-04T16:22:47.329687+0000","last_clean_scrub_stamp":"2024-06-04T16:22:47.329687+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T16:28:06.079176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":113,"num_read_kb":81,"num_write":51,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1","version":"0'0","reported_seq":24,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:32.909959+0000","last_change":"2024-06-04T16:23:32.909999+0000","last_active":"2024-06-04T16:23:32.909959+0000","last_peered":"2024-06-04T16:23:32.909959+0000","last_clean":"2024-06-04T16:23:32.909959+0000","last_became_active":"2024-06-04T16:16:08.660177+0000","last_became_peered":"2024-06-04T16:16:08.660177+0000","last_unstale":"2024-06-04T16:23:32.909959+0000","last_undegraded":"2024-06-04T16:23:32.909959+0000","last_fullsized":"2024-06-04T16:23:32.909959+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:23:32.909831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:23:32.909831+0000","last_clean_scrub_stamp":"2024-06-04T16:23:32.909831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T21:58:38.586000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.0","version":"254'2","reported_seq":37,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:22.667486+0000","last_change":"2024-06-04T16:23:22.667486+0000","last_active":"2024-06-04T16:23:22.667486+0000","last_peered":"2024-06-04T16:23:22.667486+0000","last_clean":"2024-06-04T16:23:22.667486+0000","last_became_active":"2024-06-04T16:09:26.626576+0000","last_became_peered":"2024-06-04T16:09:26.626576+0000","last_unstale":"2024-06-04T16:23:22.667486+0000","last_undegraded":"2024-06-04T16:23:22.667486+0000","last_fullsized":"2024-06-04T16:23:22.667486+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'2","last_scrub_stamp":"2024-06-04T16:23:22.667335+0000","last_deep_scrub":"254'2","last_deep_scrub_stamp":"2024-06-04T16:23:22.667335+0000","last_clean_scrub_stamp":"2024-06-04T16:23:22.667335+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T18:44:29.644287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.3","version":"254'2","reported_seq":43,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:46.486379+0000","last_change":"2024-06-04T16:22:46.486379+0000","last_active":"2024-06-04T16:22:46.486379+0000","last_peered":"2024-06-04T16:22:46.486379+0000","last_clean":"2024-06-04T16:22:46.486379+0000","last_became_active":"2024-06-04T16:09:23.604413+0000","last_became_peered":"2024-06-04T16:09:23.604413+0000","last_unstale":"2024-06-04T16:22:46.486379+0000","last_undegraded":"2024-06-04T16:22:46.486379+0000","last_fullsized":"2024-06-04T16:22:46.486379+0000","mapping_epoch":246,"log_start":"0'0","ondisk_log_start":"0'0","created":246,"last_epoch_clean":247,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'2","last_scrub_stamp":"2024-06-04T16:22:46.486286+0000","last_deep_scrub":"254'2","last_deep_scrub_stamp":"2024-06-04T16:22:46.486286+0000","last_clean_scrub_stamp":"2024-06-04T16:22:46.486286+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T03:08:45.620913+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"64.2","version":"254'2","reported_seq":53,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:47.896908+0000","last_change":"2024-06-04T16:22:47.896908+0000","last_active":"2024-06-04T16:22:47.896908+0000","last_peered":"2024-06-04T16:22:47.896908+0000","last_clean":"2024-06-04T16:22:47.896908+0000","last_became_active":"2024-06-04T16:07:09.401796+0000","last_became_peered":"2024-06-04T16:07:09.401796+0000","last_unstale":"2024-06-04T16:22:47.896908+0000","last_undegraded":"2024-06-04T16:22:47.896908+0000","last_fullsized":"2024-06-04T16:22:47.896908+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":243,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'2","last_scrub_stamp":"2024-06-04T16:22:47.896756+0000","last_deep_scrub":"254'2","last_deep_scrub_stamp":"2024-06-04T16:22:47.896756+0000","last_clean_scrub_stamp":"2024-06-04T16:22:47.896756+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T03:55:14.174846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":7,"num_write":11,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.2","version":"0'0","reported_seq":24,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:25.719370+0000","last_change":"2024-06-04T16:23:25.719398+0000","last_active":"2024-06-04T16:23:25.719370+0000","last_peered":"2024-06-04T16:23:25.719370+0000","last_clean":"2024-06-04T16:23:25.719370+0000","last_became_active":"2024-06-04T16:16:08.656245+0000","last_became_peered":"2024-06-04T16:16:08.656245+0000","last_unstale":"2024-06-04T16:23:25.719370+0000","last_undegraded":"2024-06-04T16:23:25.719370+0000","last_fullsized":"2024-06-04T16:23:25.719370+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:23:25.719271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:23:25.719271+0000","last_clean_scrub_stamp":"2024-06-04T16:23:25.719271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T18:39:45.608723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.3","version":"254'4","reported_seq":41,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:27.270978+0000","last_change":"2024-06-04T16:23:27.270978+0000","last_active":"2024-06-04T16:23:27.270978+0000","last_peered":"2024-06-04T16:23:27.270978+0000","last_clean":"2024-06-04T16:23:27.270978+0000","last_became_active":"2024-06-04T16:09:26.627193+0000","last_became_peered":"2024-06-04T16:09:26.627193+0000","last_unstale":"2024-06-04T16:23:27.270978+0000","last_undegraded":"2024-06-04T16:23:27.270978+0000","last_fullsized":"2024-06-04T16:23:27.270978+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'4","last_scrub_stamp":"2024-06-04T16:23:27.270864+0000","last_deep_scrub":"254'4","last_deep_scrub_stamp":"2024-06-04T16:23:27.270864+0000","last_clean_scrub_stamp":"2024-06-04T16:23:27.270864+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T17:25:56.886677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":6144,"num_write":4,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.0","version":"254'2","reported_seq":43,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:45.465785+0000","last_change":"2024-06-04T16:22:45.465785+0000","last_active":"2024-06-04T16:22:45.465785+0000","last_peered":"2024-06-04T16:22:45.465785+0000","last_clean":"2024-06-04T16:22:45.465785+0000","last_became_active":"2024-06-04T16:09:23.605145+0000","last_became_peered":"2024-06-04T16:09:23.605145+0000","last_unstale":"2024-06-04T16:22:45.465785+0000","last_undegraded":"2024-06-04T16:22:45.465785+0000","last_fullsized":"2024-06-04T16:22:45.465785+0000","mapping_epoch":246,"log_start":"0'0","ondisk_log_start":"0'0","created":246,"last_epoch_clean":247,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'2","last_scrub_stamp":"2024-06-04T16:22:45.465690+0000","last_deep_scrub":"254'2","last_deep_scrub_stamp":"2024-06-04T16:22:45.465690+0000","last_clean_scrub_stamp":"2024-06-04T16:22:45.465690+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T23:45:13.033536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"64.1","version":"245'23","reported_seq":113,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:48.104216+0000","last_change":"2024-06-04T16:22:48.104216+0000","last_active":"2024-06-04T16:22:48.104216+0000","last_peered":"2024-06-04T16:22:48.104216+0000","last_clean":"2024-06-04T16:22:48.104216+0000","last_became_active":"2024-06-04T16:07:09.405086+0000","last_became_peered":"2024-06-04T16:07:09.405086+0000","last_unstale":"2024-06-04T16:22:48.104216+0000","last_undegraded":"2024-06-04T16:22:48.104216+0000","last_fullsized":"2024-06-04T16:22:48.104216+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":243,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"245'23","last_scrub_stamp":"2024-06-04T16:22:48.104090+0000","last_deep_scrub":"245'23","last_deep_scrub_stamp":"2024-06-04T16:22:48.104090+0000","last_clean_scrub_stamp":"2024-06-04T16:22:48.104090+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T22:36:27.428584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":130,"num_read_kb":96,"num_write":31,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.3","version":"0'0","reported_seq":24,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:27.756641+0000","last_change":"2024-06-04T16:23:27.756682+0000","last_active":"2024-06-04T16:23:27.756641+0000","last_peered":"2024-06-04T16:23:27.756641+0000","last_clean":"2024-06-04T16:23:27.756641+0000","last_became_active":"2024-06-04T16:16:08.661111+0000","last_became_peered":"2024-06-04T16:16:08.661111+0000","last_unstale":"2024-06-04T16:23:27.756641+0000","last_undegraded":"2024-06-04T16:23:27.756641+0000","last_fullsized":"2024-06-04T16:23:27.756641+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:23:27.756531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:23:27.756531+0000","last_clean_scrub_stamp":"2024-06-04T16:23:27.756531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T22:23:11.844959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.2","version":"254'2","reported_seq":38,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:25.312084+0000","last_change":"2024-06-04T16:23:25.312084+0000","last_active":"2024-06-04T16:23:25.312084+0000","last_peered":"2024-06-04T16:23:25.312084+0000","last_clean":"2024-06-04T16:23:25.312084+0000","last_became_active":"2024-06-04T16:09:26.624890+0000","last_became_peered":"2024-06-04T16:09:26.624890+0000","last_unstale":"2024-06-04T16:23:25.312084+0000","last_undegraded":"2024-06-04T16:23:25.312084+0000","last_fullsized":"2024-06-04T16:23:25.312084+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'2","last_scrub_stamp":"2024-06-04T16:23:25.311962+0000","last_deep_scrub":"254'2","last_deep_scrub_stamp":"2024-06-04T16:23:25.311962+0000","last_clean_scrub_stamp":"2024-06-04T16:23:25.311962+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T20:45:06.634469+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8192,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.1","version":"254'11","reported_seq":63,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:54.943177+0000","last_change":"2024-06-04T16:22:54.943177+0000","last_active":"2024-06-04T16:22:54.943177+0000","last_peered":"2024-06-04T16:22:54.943177+0000","last_clean":"2024-06-04T16:22:54.943177+0000","last_became_active":"2024-06-04T16:09:23.609072+0000","last_became_peered":"2024-06-04T16:09:23.609072+0000","last_unstale":"2024-06-04T16:22:54.943177+0000","last_undegraded":"2024-06-04T16:22:54.943177+0000","last_fullsized":"2024-06-04T16:22:54.943177+0000","mapping_epoch":246,"log_start":"0'0","ondisk_log_start":"0'0","created":246,"last_epoch_clean":247,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'11","last_scrub_stamp":"2024-06-04T16:22:54.943049+0000","last_deep_scrub":"254'11","last_deep_scrub_stamp":"2024-06-04T16:22:54.943049+0000","last_clean_scrub_stamp":"2024-06-04T16:22:54.943049+0000","objects_scrubbed":1,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T18:38:55.646525+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":15362,"num_write":9,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"64.0","version":"254'11","reported_seq":77,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:01.039472+0000","last_change":"2024-06-04T16:23:01.039472+0000","last_active":"2024-06-04T16:23:01.039472+0000","last_peered":"2024-06-04T16:23:01.039472+0000","last_clean":"2024-06-04T16:23:01.039472+0000","last_became_active":"2024-06-04T16:07:09.405109+0000","last_became_peered":"2024-06-04T16:07:09.405109+0000","last_unstale":"2024-06-04T16:23:01.039472+0000","last_undegraded":"2024-06-04T16:23:01.039472+0000","last_fullsized":"2024-06-04T16:23:01.039472+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":243,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'11","last_scrub_stamp":"2024-06-04T16:23:01.039356+0000","last_deep_scrub":"254'11","last_deep_scrub_stamp":"2024-06-04T16:23:01.039356+0000","last_clean_scrub_stamp":"2024-06-04T16:23:01.039356+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T20:47:01.766277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":37,"num_write":22,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"251'58","reported_seq":577,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:02.739753+0000","last_change":"2024-06-04T16:23:02.739753+0000","last_active":"2024-06-04T16:23:02.739753+0000","last_peered":"2024-06-04T16:23:02.739753+0000","last_clean":"2024-06-04T16:23:02.739753+0000","last_became_active":"2024-06-04T15:52:36.496345+0000","last_became_peered":"2024-06-04T15:52:36.496345+0000","last_unstale":"2024-06-04T16:23:02.739753+0000","last_undegraded":"2024-06-04T16:23:02.739753+0000","last_fullsized":"2024-06-04T16:23:02.739753+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"251'58","last_scrub_stamp":"2024-06-04T16:23:02.739604+0000","last_deep_scrub":"251'58","last_deep_scrub_stamp":"2024-06-04T16:23:02.739604+0000","last_clean_scrub_stamp":"2024-06-04T16:23:02.739604+0000","objects_scrubbed":2,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T22:51:46.895844+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":73,"num_read_kb":10950,"num_write":187,"num_write_kb":28882,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"254'156","reported_seq":896,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:01.232920+0000","last_change":"2024-06-04T16:23:01.232957+0000","last_active":"2024-06-04T16:23:01.232920+0000","last_peered":"2024-06-04T16:23:01.232920+0000","last_clean":"2024-06-04T16:23:01.232920+0000","last_became_active":"2024-06-04T15:52:38.485491+0000","last_became_peered":"2024-06-04T15:52:38.485491+0000","last_unstale":"2024-06-04T16:23:01.232920+0000","last_undegraded":"2024-06-04T16:23:01.232920+0000","last_fullsized":"2024-06-04T16:23:01.232920+0000","mapping_epoch":23,"log_start":"251'100","ondisk_log_start":"251'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'156","last_scrub_stamp":"2024-06-04T16:23:01.232829+0000","last_deep_scrub":"254'156","last_deep_scrub_stamp":"2024-06-04T16:23:01.232829+0000","last_clean_scrub_stamp":"2024-06-04T16:23:01.232829+0000","objects_scrubbed":1,"log_size":56,"log_dups_size":100,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T00:53:06.796590+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":710,"num_read_kb":632,"num_write":201,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"251'45","reported_seq":575,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:32.359020+0000","last_change":"2024-06-04T16:23:32.359020+0000","last_active":"2024-06-04T16:23:32.359020+0000","last_peered":"2024-06-04T16:23:32.359020+0000","last_clean":"2024-06-04T16:23:32.359020+0000","last_became_active":"2024-06-04T15:52:36.484223+0000","last_became_peered":"2024-06-04T15:52:36.484223+0000","last_unstale":"2024-06-04T16:23:32.359020+0000","last_undegraded":"2024-06-04T16:23:32.359020+0000","last_fullsized":"2024-06-04T16:23:32.359020+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"251'45","last_scrub_stamp":"2024-06-04T16:23:32.358841+0000","last_deep_scrub":"251'45","last_deep_scrub_stamp":"2024-06-04T16:23:32.358841+0000","last_clean_scrub_stamp":"2024-06-04T16:23:32.358841+0000","objects_scrubbed":5,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T22:06:51.049294+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1311028,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":90,"num_read_kb":9967,"num_write":210,"num_write_kb":17365,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,0],"acting":[5,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.39","version":"254'111","reported_seq":869,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:26.684727+0000","last_change":"2024-06-04T16:23:26.684760+0000","last_active":"2024-06-04T16:23:26.684727+0000","last_peered":"2024-06-04T16:23:26.684727+0000","last_clean":"2024-06-04T16:23:26.684727+0000","last_became_active":"2024-06-04T15:52:38.482000+0000","last_became_peered":"2024-06-04T15:52:38.482000+0000","last_unstale":"2024-06-04T16:23:26.684727+0000","last_undegraded":"2024-06-04T16:23:26.684727+0000","last_fullsized":"2024-06-04T16:23:26.684727+0000","mapping_epoch":23,"log_start":"254'100","ondisk_log_start":"254'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'111","last_scrub_stamp":"2024-06-04T16:23:26.684634+0000","last_deep_scrub":"254'111","last_deep_scrub_stamp":"2024-06-04T16:23:26.684634+0000","last_clean_scrub_stamp":"2024-06-04T16:23:26.684634+0000","objects_scrubbed":3,"log_size":11,"log_dups_size":100,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T17:32:45.765295+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":584,"num_read_kb":552,"num_write":123,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"254'42","reported_seq":548,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:29.407466+0000","last_change":"2024-06-04T16:23:29.407466+0000","last_active":"2024-06-04T16:23:29.407466+0000","last_peered":"2024-06-04T16:23:29.407466+0000","last_clean":"2024-06-04T16:23:29.407466+0000","last_became_active":"2024-06-04T15:52:36.479881+0000","last_became_peered":"2024-06-04T15:52:36.479881+0000","last_unstale":"2024-06-04T16:23:29.407466+0000","last_undegraded":"2024-06-04T16:23:29.407466+0000","last_fullsized":"2024-06-04T16:23:29.407466+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'42","last_scrub_stamp":"2024-06-04T16:23:29.407263+0000","last_deep_scrub":"254'42","last_deep_scrub_stamp":"2024-06-04T16:23:29.407263+0000","last_clean_scrub_stamp":"2024-06-04T16:23:29.407263+0000","objects_scrubbed":2,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T20:30:36.461307+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":40,"num_read_kb":31,"num_write":168,"num_write_kb":16512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3a","version":"254'108","reported_seq":827,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:28.688470+0000","last_change":"2024-06-04T16:23:28.688503+0000","last_active":"2024-06-04T16:23:28.688470+0000","last_peered":"2024-06-04T16:23:28.688470+0000","last_clean":"2024-06-04T16:23:28.688470+0000","last_became_active":"2024-06-04T15:52:38.483240+0000","last_became_peered":"2024-06-04T15:52:38.483240+0000","last_unstale":"2024-06-04T16:23:28.688470+0000","last_undegraded":"2024-06-04T16:23:28.688470+0000","last_fullsized":"2024-06-04T16:23:28.688470+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'108","last_scrub_stamp":"2024-06-04T16:23:28.688395+0000","last_deep_scrub":"254'108","last_deep_scrub_stamp":"2024-06-04T16:23:28.688395+0000","last_clean_scrub_stamp":"2024-06-04T16:23:28.688395+0000","objects_scrubbed":2,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T03:27:22.928255+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":515,"num_read_kb":482,"num_write":131,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"254'78","reported_seq":590,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:15.616829+0000","last_change":"2024-06-04T16:23:15.616915+0000","last_active":"2024-06-04T16:23:15.616829+0000","last_peered":"2024-06-04T16:23:15.616829+0000","last_clean":"2024-06-04T16:23:15.616829+0000","last_became_active":"2024-06-04T15:52:36.476981+0000","last_became_peered":"2024-06-04T15:52:36.476981+0000","last_unstale":"2024-06-04T16:23:15.616829+0000","last_undegraded":"2024-06-04T16:23:15.616829+0000","last_fullsized":"2024-06-04T16:23:15.616829+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'78","last_scrub_stamp":"2024-06-04T16:23:15.616718+0000","last_deep_scrub":"254'78","last_deep_scrub_stamp":"2024-06-04T16:23:15.616718+0000","last_clean_scrub_stamp":"2024-06-04T16:23:15.616718+0000","objects_scrubbed":2,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T20:13:50.024747+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":3145,"num_write":255,"num_write_kb":33835,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"254'149","reported_seq":1045,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:14.936095+0000","last_change":"2024-06-04T16:23:14.936140+0000","last_active":"2024-06-04T16:23:14.936095+0000","last_peered":"2024-06-04T16:23:14.936095+0000","last_clean":"2024-06-04T16:23:14.936095+0000","last_became_active":"2024-06-04T15:52:38.480986+0000","last_became_peered":"2024-06-04T15:52:38.480986+0000","last_unstale":"2024-06-04T16:23:14.936095+0000","last_undegraded":"2024-06-04T16:23:14.936095+0000","last_fullsized":"2024-06-04T16:23:14.936095+0000","mapping_epoch":23,"log_start":"251'100","ondisk_log_start":"251'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'149","last_scrub_stamp":"2024-06-04T16:23:14.935987+0000","last_deep_scrub":"254'149","last_deep_scrub_stamp":"2024-06-04T16:23:14.935987+0000","last_clean_scrub_stamp":"2024-06-04T16:23:14.935987+0000","objects_scrubbed":1,"log_size":49,"log_dups_size":100,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T23:09:16.826992+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1072,"num_read_kb":1014,"num_write":195,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2193,"num_omap_keys":9,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"251'46","reported_seq":565,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:12.848585+0000","last_change":"2024-06-04T16:23:12.848636+0000","last_active":"2024-06-04T16:23:12.848585+0000","last_peered":"2024-06-04T16:23:12.848585+0000","last_clean":"2024-06-04T16:23:12.848585+0000","last_became_active":"2024-06-04T15:52:36.495401+0000","last_became_peered":"2024-06-04T15:52:36.495401+0000","last_unstale":"2024-06-04T16:23:12.848585+0000","last_undegraded":"2024-06-04T16:23:12.848585+0000","last_fullsized":"2024-06-04T16:23:12.848585+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"251'46","last_scrub_stamp":"2024-06-04T16:23:12.848406+0000","last_deep_scrub":"251'46","last_deep_scrub_stamp":"2024-06-04T16:23:12.848406+0000","last_clean_scrub_stamp":"2024-06-04T16:23:12.848406+0000","objects_scrubbed":2,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T19:11:57.083518+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":89,"num_read_kb":6218,"num_write":199,"num_write_kb":11815,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"254'159","reported_seq":1096,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:58.807663+0000","last_change":"2024-06-04T16:22:58.807693+0000","last_active":"2024-06-04T16:22:58.807663+0000","last_peered":"2024-06-04T16:22:58.807663+0000","last_clean":"2024-06-04T16:22:58.807663+0000","last_became_active":"2024-06-04T15:52:38.484828+0000","last_became_peered":"2024-06-04T15:52:38.484828+0000","last_unstale":"2024-06-04T16:22:58.807663+0000","last_undegraded":"2024-06-04T16:22:58.807663+0000","last_fullsized":"2024-06-04T16:22:58.807663+0000","mapping_epoch":23,"log_start":"251'100","ondisk_log_start":"251'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'159","last_scrub_stamp":"2024-06-04T16:22:58.807558+0000","last_deep_scrub":"254'159","last_deep_scrub_stamp":"2024-06-04T16:22:58.807558+0000","last_clean_scrub_stamp":"2024-06-04T16:22:58.807558+0000","objects_scrubbed":2,"log_size":59,"log_dups_size":100,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T21:15:10.613499+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1071,"num_read_kb":1008,"num_write":198,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2864,"num_omap_keys":12,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"254'61","reported_seq":579,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:14.577814+0000","last_change":"2024-06-04T16:23:14.577857+0000","last_active":"2024-06-04T16:23:14.577814+0000","last_peered":"2024-06-04T16:23:14.577814+0000","last_clean":"2024-06-04T16:23:14.577814+0000","last_became_active":"2024-06-04T15:52:36.476167+0000","last_became_peered":"2024-06-04T15:52:36.476167+0000","last_unstale":"2024-06-04T16:23:14.577814+0000","last_undegraded":"2024-06-04T16:23:14.577814+0000","last_fullsized":"2024-06-04T16:23:14.577814+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'61","last_scrub_stamp":"2024-06-04T16:23:14.577722+0000","last_deep_scrub":"254'61","last_deep_scrub_stamp":"2024-06-04T16:23:14.577722+0000","last_clean_scrub_stamp":"2024-06-04T16:23:14.577722+0000","objects_scrubbed":1,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T00:44:08.552179+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":87,"num_read_kb":1095,"num_write":236,"num_write_kb":40818,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,7],"acting":[2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"254'99","reported_seq":821,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:00.757161+0000","last_change":"2024-06-04T16:23:00.757161+0000","last_active":"2024-06-04T16:23:00.757161+0000","last_peered":"2024-06-04T16:23:00.757161+0000","last_clean":"2024-06-04T16:23:00.757161+0000","last_became_active":"2024-06-04T15:52:38.482025+0000","last_became_peered":"2024-06-04T15:52:38.482025+0000","last_unstale":"2024-06-04T16:23:00.757161+0000","last_undegraded":"2024-06-04T16:23:00.757161+0000","last_fullsized":"2024-06-04T16:23:00.757161+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'99","last_scrub_stamp":"2024-06-04T16:23:00.756985+0000","last_deep_scrub":"254'99","last_deep_scrub_stamp":"2024-06-04T16:23:00.756985+0000","last_clean_scrub_stamp":"2024-06-04T16:23:00.756985+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T03:26:31.902180+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":511,"num_read_kb":478,"num_write":121,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.39","version":"251'54","reported_seq":558,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:09.793735+0000","last_change":"2024-06-04T16:23:09.793778+0000","last_active":"2024-06-04T16:23:09.793735+0000","last_peered":"2024-06-04T16:23:09.793735+0000","last_clean":"2024-06-04T16:23:09.793735+0000","last_became_active":"2024-06-04T15:52:36.493029+0000","last_became_peered":"2024-06-04T15:52:36.493029+0000","last_unstale":"2024-06-04T16:23:09.793735+0000","last_undegraded":"2024-06-04T16:23:09.793735+0000","last_fullsized":"2024-06-04T16:23:09.793735+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"251'54","last_scrub_stamp":"2024-06-04T16:23:09.793630+0000","last_deep_scrub":"251'54","last_deep_scrub_stamp":"2024-06-04T16:23:09.793630+0000","last_clean_scrub_stamp":"2024-06-04T16:23:09.793630+0000","objects_scrubbed":4,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T22:45:15.488703+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194343,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":48,"num_read_kb":7228,"num_write":201,"num_write_kb":32271,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,1],"acting":[0,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"254'138","reported_seq":1110,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:04.451925+0000","last_change":"2024-06-04T16:23:04.451925+0000","last_active":"2024-06-04T16:23:04.451925+0000","last_peered":"2024-06-04T16:23:04.451925+0000","last_clean":"2024-06-04T16:23:04.451925+0000","last_became_active":"2024-06-04T15:52:38.481269+0000","last_became_peered":"2024-06-04T15:52:38.481269+0000","last_unstale":"2024-06-04T16:23:04.451925+0000","last_undegraded":"2024-06-04T16:23:04.451925+0000","last_fullsized":"2024-06-04T16:23:04.451925+0000","mapping_epoch":23,"log_start":"251'100","ondisk_log_start":"251'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'138","last_scrub_stamp":"2024-06-04T16:23:04.451799+0000","last_deep_scrub":"254'138","last_deep_scrub_stamp":"2024-06-04T16:23:04.451799+0000","last_clean_scrub_stamp":"2024-06-04T16:23:04.451799+0000","objects_scrubbed":3,"log_size":38,"log_dups_size":100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T18:57:32.595376+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":974,"num_read_kb":946,"num_write":155,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1528,"num_omap_keys":6,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"254'71","reported_seq":667,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:27.425442+0000","last_change":"2024-06-04T16:23:27.425486+0000","last_active":"2024-06-04T16:23:27.425442+0000","last_peered":"2024-06-04T16:23:27.425442+0000","last_clean":"2024-06-04T16:23:27.425442+0000","last_became_active":"2024-06-04T15:52:36.493867+0000","last_became_peered":"2024-06-04T15:52:36.493867+0000","last_unstale":"2024-06-04T16:23:27.425442+0000","last_undegraded":"2024-06-04T16:23:27.425442+0000","last_fullsized":"2024-06-04T16:23:27.425442+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'71","last_scrub_stamp":"2024-06-04T16:23:27.425346+0000","last_deep_scrub":"254'71","last_deep_scrub_stamp":"2024-06-04T16:23:27.425346+0000","last_clean_scrub_stamp":"2024-06-04T16:23:27.425346+0000","objects_scrubbed":2,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T20:20:10.111624+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194320,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":320,"num_read_kb":135435,"num_write":258,"num_write_kb":39309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3],"acting":[5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3f","version":"254'143","reported_seq":991,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:13.353958+0000","last_change":"2024-06-04T16:23:13.353958+0000","last_active":"2024-06-04T16:23:13.353958+0000","last_peered":"2024-06-04T16:23:13.353958+0000","last_clean":"2024-06-04T16:23:13.353958+0000","last_became_active":"2024-06-04T15:52:38.486625+0000","last_became_peered":"2024-06-04T15:52:38.486625+0000","last_unstale":"2024-06-04T16:23:13.353958+0000","last_undegraded":"2024-06-04T16:23:13.353958+0000","last_fullsized":"2024-06-04T16:23:13.353958+0000","mapping_epoch":23,"log_start":"251'100","ondisk_log_start":"251'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'143","last_scrub_stamp":"2024-06-04T16:23:13.353829+0000","last_deep_scrub":"254'143","last_deep_scrub_stamp":"2024-06-04T16:23:13.353829+0000","last_clean_scrub_stamp":"2024-06-04T16:23:13.353829+0000","objects_scrubbed":1,"log_size":43,"log_dups_size":100,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T03:22:03.182465+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":899,"num_read_kb":839,"num_write":184,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2808,"num_omap_keys":11,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.30","version":"254'111","reported_seq":847,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:22.743898+0000","last_change":"2024-06-04T16:23:22.743953+0000","last_active":"2024-06-04T16:23:22.743898+0000","last_peered":"2024-06-04T16:23:22.743898+0000","last_clean":"2024-06-04T16:23:22.743898+0000","last_became_active":"2024-06-04T15:52:38.479148+0000","last_became_peered":"2024-06-04T15:52:38.479148+0000","last_unstale":"2024-06-04T16:23:22.743898+0000","last_undegraded":"2024-06-04T16:23:22.743898+0000","last_fullsized":"2024-06-04T16:23:22.743898+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'111","last_scrub_stamp":"2024-06-04T16:23:22.743793+0000","last_deep_scrub":"254'111","last_deep_scrub_stamp":"2024-06-04T16:23:22.743793+0000","last_clean_scrub_stamp":"2024-06-04T16:23:22.743793+0000","objects_scrubbed":1,"log_size":111,"log_dups_size":0,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T18:14:39.906512+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":546,"num_read_kb":515,"num_write":127,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"251'65","reported_seq":598,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:19.373198+0000","last_change":"2024-06-04T16:23:19.373244+0000","last_active":"2024-06-04T16:23:19.373198+0000","last_peered":"2024-06-04T16:23:19.373198+0000","last_clean":"2024-06-04T16:23:19.373198+0000","last_became_active":"2024-06-04T15:52:36.493062+0000","last_became_peered":"2024-06-04T15:52:36.493062+0000","last_unstale":"2024-06-04T16:23:19.373198+0000","last_undegraded":"2024-06-04T16:23:19.373198+0000","last_fullsized":"2024-06-04T16:23:19.373198+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"251'65","last_scrub_stamp":"2024-06-04T16:23:19.373074+0000","last_deep_scrub":"251'65","last_deep_scrub_stamp":"2024-06-04T16:23:19.373074+0000","last_clean_scrub_stamp":"2024-06-04T16:23:19.373074+0000","objects_scrubbed":4,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T22:16:45.027828+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194345,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":95,"num_read_kb":64250,"num_write":262,"num_write_kb":45332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,5],"acting":[1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"254'69","reported_seq":746,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:56.821291+0000","last_change":"2024-06-04T16:22:56.821291+0000","last_active":"2024-06-04T16:22:56.821291+0000","last_peered":"2024-06-04T16:22:56.821291+0000","last_clean":"2024-06-04T16:22:56.821291+0000","last_became_active":"2024-06-04T15:52:38.486413+0000","last_became_peered":"2024-06-04T15:52:38.486413+0000","last_unstale":"2024-06-04T16:22:56.821291+0000","last_undegraded":"2024-06-04T16:22:56.821291+0000","last_fullsized":"2024-06-04T16:22:56.821291+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'69","last_scrub_stamp":"2024-06-04T16:22:56.821156+0000","last_deep_scrub":"254'69","last_deep_scrub_stamp":"2024-06-04T16:22:56.821156+0000","last_clean_scrub_stamp":"2024-06-04T16:22:56.821156+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T21:44:44.801551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":395,"num_read_kb":379,"num_write":76,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"251'60","reported_seq":580,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:10.807946+0000","last_change":"2024-06-04T16:23:10.807946+0000","last_active":"2024-06-04T16:23:10.807946+0000","last_peered":"2024-06-04T16:23:10.807946+0000","last_clean":"2024-06-04T16:23:10.807946+0000","last_became_active":"2024-06-04T15:52:36.493235+0000","last_became_peered":"2024-06-04T15:52:36.493235+0000","last_unstale":"2024-06-04T16:23:10.807946+0000","last_undegraded":"2024-06-04T16:23:10.807946+0000","last_fullsized":"2024-06-04T16:23:10.807946+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"251'60","last_scrub_stamp":"2024-06-04T16:23:10.807783+0000","last_deep_scrub":"251'60","last_deep_scrub_stamp":"2024-06-04T16:23:10.807783+0000","last_clean_scrub_stamp":"2024-06-04T16:23:10.807783+0000","objects_scrubbed":3,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T17:09:52.431755+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5327983,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":73,"num_read_kb":3706,"num_write":207,"num_write_kb":43313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"254'95","reported_seq":819,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:05.258148+0000","last_change":"2024-06-04T16:23:05.258177+0000","last_active":"2024-06-04T16:23:05.258148+0000","last_peered":"2024-06-04T16:23:05.258148+0000","last_clean":"2024-06-04T16:23:05.258148+0000","last_became_active":"2024-06-04T15:52:38.482120+0000","last_became_peered":"2024-06-04T15:52:38.482120+0000","last_unstale":"2024-06-04T16:23:05.258148+0000","last_undegraded":"2024-06-04T16:23:05.258148+0000","last_fullsized":"2024-06-04T16:23:05.258148+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'95","last_scrub_stamp":"2024-06-04T16:23:05.258056+0000","last_deep_scrub":"254'95","last_deep_scrub_stamp":"2024-06-04T16:23:05.258056+0000","last_clean_scrub_stamp":"2024-06-04T16:23:05.258056+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T02:14:44.631445+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":518,"num_read_kb":488,"num_write":107,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"251'41","reported_seq":566,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:45.894598+0000","last_change":"2024-06-04T16:22:45.894598+0000","last_active":"2024-06-04T16:22:45.894598+0000","last_peered":"2024-06-04T16:22:45.894598+0000","last_clean":"2024-06-04T16:22:45.894598+0000","last_became_active":"2024-06-04T15:53:14.839433+0000","last_became_peered":"2024-06-04T15:53:14.839433+0000","last_unstale":"2024-06-04T16:22:45.894598+0000","last_undegraded":"2024-06-04T16:22:45.894598+0000","last_fullsized":"2024-06-04T16:22:45.894598+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"251'41","last_scrub_stamp":"2024-06-04T16:22:45.894408+0000","last_deep_scrub":"251'41","last_deep_scrub_stamp":"2024-06-04T16:22:45.894408+0000","last_clean_scrub_stamp":"2024-06-04T16:22:45.894408+0000","objects_scrubbed":4,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T17:54:53.919284+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3420297,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":73,"num_read_kb":2132,"num_write":160,"num_write_kb":20015,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"254'145","reported_seq":943,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:09.033925+0000","last_change":"2024-06-04T16:23:09.033925+0000","last_active":"2024-06-04T16:23:09.033925+0000","last_peered":"2024-06-04T16:23:09.033925+0000","last_clean":"2024-06-04T16:23:09.033925+0000","last_became_active":"2024-06-04T15:52:38.480996+0000","last_became_peered":"2024-06-04T15:52:38.480996+0000","last_unstale":"2024-06-04T16:23:09.033925+0000","last_undegraded":"2024-06-04T16:23:09.033925+0000","last_fullsized":"2024-06-04T16:23:09.033925+0000","mapping_epoch":23,"log_start":"251'100","ondisk_log_start":"251'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'145","last_scrub_stamp":"2024-06-04T16:23:09.033779+0000","last_deep_scrub":"254'145","last_deep_scrub_stamp":"2024-06-04T16:23:09.033779+0000","last_clean_scrub_stamp":"2024-06-04T16:23:09.033779+0000","objects_scrubbed":2,"log_size":45,"log_dups_size":100,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T17:43:39.336852+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":760,"num_read_kb":703,"num_write":184,"num_write_kb":47,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"251'68","reported_seq":588,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:06.831959+0000","last_change":"2024-06-04T16:23:06.831959+0000","last_active":"2024-06-04T16:23:06.831959+0000","last_peered":"2024-06-04T16:23:06.831959+0000","last_clean":"2024-06-04T16:23:06.831959+0000","last_became_active":"2024-06-04T15:52:36.486264+0000","last_became_peered":"2024-06-04T15:52:36.486264+0000","last_unstale":"2024-06-04T16:23:06.831959+0000","last_undegraded":"2024-06-04T16:23:06.831959+0000","last_fullsized":"2024-06-04T16:23:06.831959+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"251'68","last_scrub_stamp":"2024-06-04T16:23:06.831772+0000","last_deep_scrub":"251'68","last_deep_scrub_stamp":"2024-06-04T16:23:06.831772+0000","last_clean_scrub_stamp":"2024-06-04T16:23:06.831772+0000","objects_scrubbed":5,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T17:48:07.524627+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5328001,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":104,"num_read_kb":2209,"num_write":245,"num_write_kb":31585,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,7],"acting":[0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"254'110","reported_seq":1001,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:16.337867+0000","last_change":"2024-06-04T16:23:16.337867+0000","last_active":"2024-06-04T16:23:16.337867+0000","last_peered":"2024-06-04T16:23:16.337867+0000","last_clean":"2024-06-04T16:23:16.337867+0000","last_became_active":"2024-06-04T15:52:38.488389+0000","last_became_peered":"2024-06-04T15:52:38.488389+0000","last_unstale":"2024-06-04T16:23:16.337867+0000","last_undegraded":"2024-06-04T16:23:16.337867+0000","last_fullsized":"2024-06-04T16:23:16.337867+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'110","last_scrub_stamp":"2024-06-04T16:23:16.337710+0000","last_deep_scrub":"254'110","last_deep_scrub_stamp":"2024-06-04T16:23:16.337710+0000","last_clean_scrub_stamp":"2024-06-04T16:23:16.337710+0000","objects_scrubbed":1,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T17:14:53.579833+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":949,"num_read_kb":919,"num_write":126,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2299,"num_omap_keys":9,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.33","version":"254'50","reported_seq":561,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:17.163657+0000","last_change":"2024-06-04T16:23:17.163657+0000","last_active":"2024-06-04T16:23:17.163657+0000","last_peered":"2024-06-04T16:23:17.163657+0000","last_clean":"2024-06-04T16:23:17.163657+0000","last_became_active":"2024-06-04T15:52:36.498488+0000","last_became_peered":"2024-06-04T15:52:36.498488+0000","last_unstale":"2024-06-04T16:23:17.163657+0000","last_undegraded":"2024-06-04T16:23:17.163657+0000","last_fullsized":"2024-06-04T16:23:17.163657+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'50","last_scrub_stamp":"2024-06-04T16:23:17.163496+0000","last_deep_scrub":"254'50","last_deep_scrub_stamp":"2024-06-04T16:23:17.163496+0000","last_clean_scrub_stamp":"2024-06-04T16:23:17.163496+0000","objects_scrubbed":3,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T21:27:25.943842+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6461610,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":71,"num_read_kb":20343,"num_write":207,"num_write_kb":26780,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,4],"acting":[6,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.35","version":"254'139","reported_seq":936,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:59.197913+0000","last_change":"2024-06-04T16:22:59.197913+0000","last_active":"2024-06-04T16:22:59.197913+0000","last_peered":"2024-06-04T16:22:59.197913+0000","last_clean":"2024-06-04T16:22:59.197913+0000","last_became_active":"2024-06-04T15:52:38.486108+0000","last_became_peered":"2024-06-04T15:52:38.486108+0000","last_unstale":"2024-06-04T16:22:59.197913+0000","last_undegraded":"2024-06-04T16:22:59.197913+0000","last_fullsized":"2024-06-04T16:22:59.197913+0000","mapping_epoch":23,"log_start":"251'100","ondisk_log_start":"251'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'139","last_scrub_stamp":"2024-06-04T16:22:59.197784+0000","last_deep_scrub":"254'139","last_deep_scrub_stamp":"2024-06-04T16:22:59.197784+0000","last_clean_scrub_stamp":"2024-06-04T16:22:59.197784+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":100,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T19:34:23.692307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":692,"num_read_kb":648,"num_write":164,"num_write_kb":35,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"254'36","reported_seq":536,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:13.089771+0000","last_change":"2024-06-04T16:23:13.089808+0000","last_active":"2024-06-04T16:23:13.089771+0000","last_peered":"2024-06-04T16:23:13.089771+0000","last_clean":"2024-06-04T16:23:13.089771+0000","last_became_active":"2024-06-04T15:52:36.481047+0000","last_became_peered":"2024-06-04T15:52:36.481047+0000","last_unstale":"2024-06-04T16:23:13.089771+0000","last_undegraded":"2024-06-04T16:23:13.089771+0000","last_fullsized":"2024-06-04T16:23:13.089771+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'36","last_scrub_stamp":"2024-06-04T16:23:13.089678+0000","last_deep_scrub":"254'36","last_deep_scrub_stamp":"2024-06-04T16:23:13.089678+0000","last_clean_scrub_stamp":"2024-06-04T16:23:13.089678+0000","objects_scrubbed":1,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T02:50:31.631046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":42,"num_read_kb":41,"num_write":149,"num_write_kb":21263,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4],"acting":[6,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.18","version":"254'36","reported_seq":527,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:48.897593+0000","last_change":"2024-06-04T16:22:48.897620+0000","last_active":"2024-06-04T16:22:48.897593+0000","last_peered":"2024-06-04T16:22:48.897593+0000","last_clean":"2024-06-04T16:22:48.897593+0000","last_became_active":"2024-06-04T15:52:46.536608+0000","last_became_peered":"2024-06-04T15:52:46.536608+0000","last_unstale":"2024-06-04T16:22:48.897593+0000","last_undegraded":"2024-06-04T16:22:48.897593+0000","last_fullsized":"2024-06-04T16:22:48.897593+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'36","last_scrub_stamp":"2024-06-04T16:22:48.897499+0000","last_deep_scrub":"254'36","last_deep_scrub_stamp":"2024-06-04T16:22:48.897499+0000","last_clean_scrub_stamp":"2024-06-04T16:22:48.897499+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T20:02:47.722917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":81,"num_read_kb":72,"num_write":87,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"254'110","reported_seq":841,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:19.166996+0000","last_change":"2024-06-04T16:23:19.167020+0000","last_active":"2024-06-04T16:23:19.166996+0000","last_peered":"2024-06-04T16:23:19.166996+0000","last_clean":"2024-06-04T16:23:19.166996+0000","last_became_active":"2024-06-04T15:52:38.477052+0000","last_became_peered":"2024-06-04T15:52:38.477052+0000","last_unstale":"2024-06-04T16:23:19.166996+0000","last_undegraded":"2024-06-04T16:23:19.166996+0000","last_fullsized":"2024-06-04T16:23:19.166996+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'110","last_scrub_stamp":"2024-06-04T16:23:19.166917+0000","last_deep_scrub":"254'110","last_deep_scrub_stamp":"2024-06-04T16:23:19.166917+0000","last_clean_scrub_stamp":"2024-06-04T16:23:19.166917+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T01:33:44.001604+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":560,"num_read_kb":523,"num_write":129,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.13","version":"254'52","reported_seq":563,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:25.684932+0000","last_change":"2024-06-04T16:23:25.685009+0000","last_active":"2024-06-04T16:23:25.684932+0000","last_peered":"2024-06-04T16:23:25.684932+0000","last_clean":"2024-06-04T16:23:25.684932+0000","last_became_active":"2024-06-04T15:52:36.499305+0000","last_became_peered":"2024-06-04T15:52:36.499305+0000","last_unstale":"2024-06-04T16:23:25.684932+0000","last_undegraded":"2024-06-04T16:23:25.684932+0000","last_fullsized":"2024-06-04T16:23:25.684932+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'52","last_scrub_stamp":"2024-06-04T16:23:25.684795+0000","last_deep_scrub":"254'52","last_deep_scrub_stamp":"2024-06-04T16:23:25.684795+0000","last_clean_scrub_stamp":"2024-06-04T16:23:25.684795+0000","objects_scrubbed":2,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T22:25:43.278909+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194320,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":75,"num_read_kb":3024,"num_write":196,"num_write_kb":28071,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":483,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:34.589724+0000","last_change":"2024-06-04T16:23:34.589724+0000","last_active":"2024-06-04T16:23:34.589724+0000","last_peered":"2024-06-04T16:23:34.589724+0000","last_clean":"2024-06-04T16:23:34.589724+0000","last_became_active":"2024-06-04T15:52:40.476730+0000","last_became_peered":"2024-06-04T15:52:40.476730+0000","last_unstale":"2024-06-04T16:23:34.589724+0000","last_undegraded":"2024-06-04T16:23:34.589724+0000","last_fullsized":"2024-06-04T16:23:34.589724+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:23:34.589571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:23:34.589571+0000","last_clean_scrub_stamp":"2024-06-04T16:23:34.589571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T00:04:00.918615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"254'147","reported_seq":727,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:58.046557+0000","last_change":"2024-06-04T16:22:58.046593+0000","last_active":"2024-06-04T16:22:58.046557+0000","last_peered":"2024-06-04T16:22:58.046557+0000","last_clean":"2024-06-04T16:22:58.046557+0000","last_became_active":"2024-06-04T15:52:42.503184+0000","last_became_peered":"2024-06-04T15:52:42.503184+0000","last_unstale":"2024-06-04T16:22:58.046557+0000","last_undegraded":"2024-06-04T16:22:58.046557+0000","last_fullsized":"2024-06-04T16:22:58.046557+0000","mapping_epoch":27,"log_start":"251'100","ondisk_log_start":"251'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'147","last_scrub_stamp":"2024-06-04T16:22:58.046476+0000","last_deep_scrub":"254'147","last_deep_scrub_stamp":"2024-06-04T16:22:58.046476+0000","last_clean_scrub_stamp":"2024-06-04T16:22:58.046476+0000","objects_scrubbed":4,"log_size":47,"log_dups_size":100,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T21:24:37.226246+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":210,"num_read_kb":210,"num_write":112,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":477,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:12.320493+0000","last_change":"2024-06-04T16:23:12.320516+0000","last_active":"2024-06-04T16:23:12.320493+0000","last_peered":"2024-06-04T16:23:12.320493+0000","last_clean":"2024-06-04T16:23:12.320493+0000","last_became_active":"2024-06-04T15:52:44.513442+0000","last_became_peered":"2024-06-04T15:52:44.513442+0000","last_unstale":"2024-06-04T16:23:12.320493+0000","last_undegraded":"2024-06-04T16:23:12.320493+0000","last_fullsized":"2024-06-04T16:23:12.320493+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:23:12.320400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:23:12.320400+0000","last_clean_scrub_stamp":"2024-06-04T16:23:12.320400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T17:36:07.585385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"254'147","reported_seq":716,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:53.150923+0000","last_change":"2024-06-04T16:22:53.150954+0000","last_active":"2024-06-04T16:22:53.150923+0000","last_peered":"2024-06-04T16:22:53.150923+0000","last_clean":"2024-06-04T16:22:53.150923+0000","last_became_active":"2024-06-04T15:52:46.539957+0000","last_became_peered":"2024-06-04T15:52:46.539957+0000","last_unstale":"2024-06-04T16:22:53.150923+0000","last_undegraded":"2024-06-04T16:22:53.150923+0000","last_fullsized":"2024-06-04T16:22:53.150923+0000","mapping_epoch":31,"log_start":"254'100","ondisk_log_start":"254'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'147","last_scrub_stamp":"2024-06-04T16:22:53.150822+0000","last_deep_scrub":"254'147","last_deep_scrub_stamp":"2024-06-04T16:22:53.150822+0000","last_clean_scrub_stamp":"2024-06-04T16:22:53.150822+0000","objects_scrubbed":2,"log_size":47,"log_dups_size":100,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T21:42:55.962546+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":399,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":346,"num_read_kb":345,"num_write":304,"num_write_kb":102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"254'155","reported_seq":848,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:30.703731+0000","last_change":"2024-06-04T16:23:30.703731+0000","last_active":"2024-06-04T16:23:30.703731+0000","last_peered":"2024-06-04T16:23:30.703731+0000","last_clean":"2024-06-04T16:23:30.703731+0000","last_became_active":"2024-06-04T15:52:38.483516+0000","last_became_peered":"2024-06-04T15:52:38.483516+0000","last_unstale":"2024-06-04T16:23:30.703731+0000","last_undegraded":"2024-06-04T16:23:30.703731+0000","last_fullsized":"2024-06-04T16:23:30.703731+0000","mapping_epoch":23,"log_start":"251'100","ondisk_log_start":"251'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'155","last_scrub_stamp":"2024-06-04T16:23:30.703620+0000","last_deep_scrub":"254'155","last_deep_scrub_stamp":"2024-06-04T16:23:30.703620+0000","last_clean_scrub_stamp":"2024-06-04T16:23:30.703620+0000","objects_scrubbed":1,"log_size":55,"log_dups_size":100,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T21:00:13.749218+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":841,"num_read_kb":740,"num_write":235,"num_write_kb":95,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"254'66","reported_seq":588,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:14.131826+0000","last_change":"2024-06-04T16:23:14.131879+0000","last_active":"2024-06-04T16:23:14.131826+0000","last_peered":"2024-06-04T16:23:14.131826+0000","last_clean":"2024-06-04T16:23:14.131826+0000","last_became_active":"2024-06-04T15:52:36.481099+0000","last_became_peered":"2024-06-04T15:52:36.481099+0000","last_unstale":"2024-06-04T16:23:14.131826+0000","last_undegraded":"2024-06-04T16:23:14.131826+0000","last_fullsized":"2024-06-04T16:23:14.131826+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'66","last_scrub_stamp":"2024-06-04T16:23:14.131731+0000","last_deep_scrub":"254'66","last_deep_scrub_stamp":"2024-06-04T16:23:14.131731+0000","last_clean_scrub_stamp":"2024-06-04T16:23:14.131731+0000","objects_scrubbed":3,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T21:24:25.096968+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133687,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":119,"num_read_kb":2903,"num_write":273,"num_write_kb":32792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,7],"acting":[6,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":484,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:06.002957+0000","last_change":"2024-06-04T16:23:06.002957+0000","last_active":"2024-06-04T16:23:06.002957+0000","last_peered":"2024-06-04T16:23:06.002957+0000","last_clean":"2024-06-04T16:23:06.002957+0000","last_became_active":"2024-06-04T15:52:40.479483+0000","last_became_peered":"2024-06-04T15:52:40.479483+0000","last_unstale":"2024-06-04T16:23:06.002957+0000","last_undegraded":"2024-06-04T16:23:06.002957+0000","last_fullsized":"2024-06-04T16:23:06.002957+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:23:06.002801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:23:06.002801+0000","last_clean_scrub_stamp":"2024-06-04T16:23:06.002801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T00:36:19.937830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"254'54","reported_seq":559,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:10.287138+0000","last_change":"2024-06-04T16:23:10.287196+0000","last_active":"2024-06-04T16:23:10.287138+0000","last_peered":"2024-06-04T16:23:10.287138+0000","last_clean":"2024-06-04T16:23:10.287138+0000","last_became_active":"2024-06-04T15:52:42.503451+0000","last_became_peered":"2024-06-04T15:52:42.503451+0000","last_unstale":"2024-06-04T16:23:10.287138+0000","last_undegraded":"2024-06-04T16:23:10.287138+0000","last_fullsized":"2024-06-04T16:23:10.287138+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'54","last_scrub_stamp":"2024-06-04T16:23:10.287044+0000","last_deep_scrub":"254'54","last_deep_scrub_stamp":"2024-06-04T16:23:10.287044+0000","last_clean_scrub_stamp":"2024-06-04T16:23:10.287044+0000","objects_scrubbed":3,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T20:35:52.209298+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":72,"num_read_kb":67,"num_write":48,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":477,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:55.141200+0000","last_change":"2024-06-04T16:22:55.141223+0000","last_active":"2024-06-04T16:22:55.141200+0000","last_peered":"2024-06-04T16:22:55.141200+0000","last_clean":"2024-06-04T16:22:55.141200+0000","last_became_active":"2024-06-04T15:52:44.517614+0000","last_became_peered":"2024-06-04T15:52:44.517614+0000","last_unstale":"2024-06-04T16:22:55.141200+0000","last_undegraded":"2024-06-04T16:22:55.141200+0000","last_fullsized":"2024-06-04T16:22:55.141200+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:22:55.141113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:22:55.141113+0000","last_clean_scrub_stamp":"2024-06-04T16:22:55.141113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T21:06:04.632373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"254'26","reported_seq":510,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:53.168793+0000","last_change":"2024-06-04T16:22:53.168825+0000","last_active":"2024-06-04T16:22:53.168793+0000","last_peered":"2024-06-04T16:22:53.168793+0000","last_clean":"2024-06-04T16:22:53.168793+0000","last_became_active":"2024-06-04T15:52:46.535498+0000","last_became_peered":"2024-06-04T15:52:46.535498+0000","last_unstale":"2024-06-04T16:22:53.168793+0000","last_undegraded":"2024-06-04T16:22:53.168793+0000","last_fullsized":"2024-06-04T16:22:53.168793+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'26","last_scrub_stamp":"2024-06-04T16:22:53.168708+0000","last_deep_scrub":"254'26","last_deep_scrub_stamp":"2024-06-04T16:22:53.168708+0000","last_clean_scrub_stamp":"2024-06-04T16:22:53.168708+0000","objects_scrubbed":4,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T16:25:50.093337+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":432,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":50,"num_read_kb":48,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"254'97","reported_seq":847,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:15.351347+0000","last_change":"2024-06-04T16:23:15.351347+0000","last_active":"2024-06-04T16:23:15.351347+0000","last_peered":"2024-06-04T16:23:15.351347+0000","last_clean":"2024-06-04T16:23:15.351347+0000","last_became_active":"2024-06-04T15:52:38.486612+0000","last_became_peered":"2024-06-04T15:52:38.486612+0000","last_unstale":"2024-06-04T16:23:15.351347+0000","last_undegraded":"2024-06-04T16:23:15.351347+0000","last_fullsized":"2024-06-04T16:23:15.351347+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'97","last_scrub_stamp":"2024-06-04T16:23:15.351224+0000","last_deep_scrub":"254'97","last_deep_scrub_stamp":"2024-06-04T16:23:15.351224+0000","last_clean_scrub_stamp":"2024-06-04T16:23:15.351224+0000","objects_scrubbed":2,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T04:14:08.447451+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":567,"num_read_kb":536,"num_write":113,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"254'37","reported_seq":535,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:41.563562+0000","last_change":"2024-06-04T16:23:41.563601+0000","last_active":"2024-06-04T16:23:41.563562+0000","last_peered":"2024-06-04T16:23:41.563562+0000","last_clean":"2024-06-04T16:23:41.563562+0000","last_became_active":"2024-06-04T15:52:36.486999+0000","last_became_peered":"2024-06-04T15:52:36.486999+0000","last_unstale":"2024-06-04T16:23:41.563562+0000","last_undegraded":"2024-06-04T16:23:41.563562+0000","last_fullsized":"2024-06-04T16:23:41.563562+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'37","last_scrub_stamp":"2024-06-04T16:23:41.563463+0000","last_deep_scrub":"254'37","last_deep_scrub_stamp":"2024-06-04T16:23:41.563463+0000","last_clean_scrub_stamp":"2024-06-04T16:23:41.563463+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T19:33:48.164905+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":26,"num_read_kb":6159,"num_write":134,"num_write_kb":22820,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":484,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:15.947335+0000","last_change":"2024-06-04T16:23:15.947335+0000","last_active":"2024-06-04T16:23:15.947335+0000","last_peered":"2024-06-04T16:23:15.947335+0000","last_clean":"2024-06-04T16:23:15.947335+0000","last_became_active":"2024-06-04T15:52:40.484711+0000","last_became_peered":"2024-06-04T15:52:40.484711+0000","last_unstale":"2024-06-04T16:23:15.947335+0000","last_undegraded":"2024-06-04T16:23:15.947335+0000","last_fullsized":"2024-06-04T16:23:15.947335+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:23:15.947213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:23:15.947213+0000","last_clean_scrub_stamp":"2024-06-04T16:23:15.947213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T02:55:05.998333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"254'70","reported_seq":580,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:59.023817+0000","last_change":"2024-06-04T16:22:59.023817+0000","last_active":"2024-06-04T16:22:59.023817+0000","last_peered":"2024-06-04T16:22:59.023817+0000","last_clean":"2024-06-04T16:22:59.023817+0000","last_became_active":"2024-06-04T15:52:42.501248+0000","last_became_peered":"2024-06-04T15:52:42.501248+0000","last_unstale":"2024-06-04T16:22:59.023817+0000","last_undegraded":"2024-06-04T16:22:59.023817+0000","last_fullsized":"2024-06-04T16:22:59.023817+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'70","last_scrub_stamp":"2024-06-04T16:22:59.023678+0000","last_deep_scrub":"254'70","last_deep_scrub_stamp":"2024-06-04T16:22:59.023678+0000","last_clean_scrub_stamp":"2024-06-04T16:22:59.023678+0000","objects_scrubbed":5,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T00:41:59.670808+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":90,"num_read_kb":83,"num_write":60,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.15","version":"254'465","reported_seq":1508,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:00.895137+0000","last_change":"2024-06-04T16:23:00.895165+0000","last_active":"2024-06-04T16:23:00.895137+0000","last_peered":"2024-06-04T16:23:00.895137+0000","last_clean":"2024-06-04T16:23:00.895137+0000","last_became_active":"2024-06-04T15:52:44.523138+0000","last_became_peered":"2024-06-04T15:52:44.523138+0000","last_unstale":"2024-06-04T16:23:00.895137+0000","last_undegraded":"2024-06-04T16:23:00.895137+0000","last_fullsized":"2024-06-04T16:23:00.895137+0000","mapping_epoch":29,"log_start":"251'400","ondisk_log_start":"251'400","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'465","last_scrub_stamp":"2024-06-04T16:23:00.895051+0000","last_deep_scrub":"254'465","last_deep_scrub_stamp":"2024-06-04T16:23:00.895051+0000","last_clean_scrub_stamp":"2024-06-04T16:23:00.895051+0000","objects_scrubbed":1,"log_size":65,"log_dups_size":400,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T20:48:57.811545+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"254'38","reported_seq":515,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:54.535431+0000","last_change":"2024-06-04T16:22:54.535460+0000","last_active":"2024-06-04T16:22:54.535431+0000","last_peered":"2024-06-04T16:22:54.535431+0000","last_clean":"2024-06-04T16:22:54.535431+0000","last_became_active":"2024-06-04T15:52:46.532141+0000","last_became_peered":"2024-06-04T15:52:46.532141+0000","last_unstale":"2024-06-04T16:22:54.535431+0000","last_undegraded":"2024-06-04T16:22:54.535431+0000","last_fullsized":"2024-06-04T16:22:54.535431+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'38","last_scrub_stamp":"2024-06-04T16:22:54.535346+0000","last_deep_scrub":"254'38","last_deep_scrub_stamp":"2024-06-04T16:22:54.535346+0000","last_clean_scrub_stamp":"2024-06-04T16:22:54.535346+0000","objects_scrubbed":1,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T17:24:08.579752+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":56,"num_read_kb":50,"num_write":85,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":168,"num_omap_keys":1,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"254'150","reported_seq":992,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:20.392913+0000","last_change":"2024-06-04T16:23:20.392913+0000","last_active":"2024-06-04T16:23:20.392913+0000","last_peered":"2024-06-04T16:23:20.392913+0000","last_clean":"2024-06-04T16:23:20.392913+0000","last_became_active":"2024-06-04T15:52:38.489719+0000","last_became_peered":"2024-06-04T15:52:38.489719+0000","last_unstale":"2024-06-04T16:23:20.392913+0000","last_undegraded":"2024-06-04T16:23:20.392913+0000","last_fullsized":"2024-06-04T16:23:20.392913+0000","mapping_epoch":23,"log_start":"251'100","ondisk_log_start":"251'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'150","last_scrub_stamp":"2024-06-04T16:23:20.392758+0000","last_deep_scrub":"254'150","last_deep_scrub_stamp":"2024-06-04T16:23:20.392758+0000","last_clean_scrub_stamp":"2024-06-04T16:23:20.392758+0000","objects_scrubbed":4,"log_size":50,"log_dups_size":100,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T18:56:39.101690+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":798,"num_read_kb":751,"num_write":172,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":148,"num_omap_keys":1,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"254'47","reported_seq":565,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:17.364677+0000","last_change":"2024-06-04T16:23:17.364729+0000","last_active":"2024-06-04T16:23:17.364677+0000","last_peered":"2024-06-04T16:23:17.364677+0000","last_clean":"2024-06-04T16:23:17.364677+0000","last_became_active":"2024-06-04T15:52:36.482920+0000","last_became_peered":"2024-06-04T15:52:36.482920+0000","last_unstale":"2024-06-04T16:23:17.364677+0000","last_undegraded":"2024-06-04T16:23:17.364677+0000","last_fullsized":"2024-06-04T16:23:17.364677+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'47","last_scrub_stamp":"2024-06-04T16:23:17.364583+0000","last_deep_scrub":"254'47","last_deep_scrub_stamp":"2024-06-04T16:23:17.364583+0000","last_clean_scrub_stamp":"2024-06-04T16:23:17.364583+0000","objects_scrubbed":5,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T22:19:51.192245+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1069231,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":86,"num_read_kb":13402,"num_write":212,"num_write_kb":21907,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3],"acting":[1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":483,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:15.830894+0000","last_change":"2024-06-04T16:23:15.830894+0000","last_active":"2024-06-04T16:23:15.830894+0000","last_peered":"2024-06-04T16:23:15.830894+0000","last_clean":"2024-06-04T16:23:15.830894+0000","last_became_active":"2024-06-04T15:52:40.482288+0000","last_became_peered":"2024-06-04T15:52:40.482288+0000","last_unstale":"2024-06-04T16:23:15.830894+0000","last_undegraded":"2024-06-04T16:23:15.830894+0000","last_fullsized":"2024-06-04T16:23:15.830894+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:23:15.830759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:23:15.830759+0000","last_clean_scrub_stamp":"2024-06-04T16:23:15.830759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T18:21:37.825735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"254'91","reported_seq":637,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:03.430350+0000","last_change":"2024-06-04T16:23:03.430391+0000","last_active":"2024-06-04T16:23:03.430350+0000","last_peered":"2024-06-04T16:23:03.430350+0000","last_clean":"2024-06-04T16:23:03.430350+0000","last_became_active":"2024-06-04T15:52:42.503282+0000","last_became_peered":"2024-06-04T15:52:42.503282+0000","last_unstale":"2024-06-04T16:23:03.430350+0000","last_undegraded":"2024-06-04T16:23:03.430350+0000","last_fullsized":"2024-06-04T16:23:03.430350+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'91","last_scrub_stamp":"2024-06-04T16:23:03.430250+0000","last_deep_scrub":"254'91","last_deep_scrub_stamp":"2024-06-04T16:23:03.430250+0000","last_clean_scrub_stamp":"2024-06-04T16:23:03.430250+0000","objects_scrubbed":4,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T16:30:06.943222+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6020,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":136,"num_read_kb":193,"num_write":64,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"254'478","reported_seq":1584,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:05.424688+0000","last_change":"2024-06-04T16:23:05.424688+0000","last_active":"2024-06-04T16:23:05.424688+0000","last_peered":"2024-06-04T16:23:05.424688+0000","last_clean":"2024-06-04T16:23:05.424688+0000","last_became_active":"2024-06-04T15:52:44.518724+0000","last_became_peered":"2024-06-04T15:52:44.518724+0000","last_unstale":"2024-06-04T16:23:05.424688+0000","last_undegraded":"2024-06-04T16:23:05.424688+0000","last_fullsized":"2024-06-04T16:23:05.424688+0000","mapping_epoch":29,"log_start":"251'400","ondisk_log_start":"251'400","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'478","last_scrub_stamp":"2024-06-04T16:23:05.424574+0000","last_deep_scrub":"254'478","last_deep_scrub_stamp":"2024-06-04T16:23:05.424574+0000","last_clean_scrub_stamp":"2024-06-04T16:23:05.424574+0000","objects_scrubbed":1,"log_size":78,"log_dups_size":400,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T17:23:14.724794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"254'113","reported_seq":809,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:20.707290+0000","last_change":"2024-06-04T16:23:20.707315+0000","last_active":"2024-06-04T16:23:20.707290+0000","last_peered":"2024-06-04T16:23:20.707290+0000","last_clean":"2024-06-04T16:23:20.707290+0000","last_became_active":"2024-06-04T15:52:38.478886+0000","last_became_peered":"2024-06-04T15:52:38.478886+0000","last_unstale":"2024-06-04T16:23:20.707290+0000","last_undegraded":"2024-06-04T16:23:20.707290+0000","last_fullsized":"2024-06-04T16:23:20.707290+0000","mapping_epoch":23,"log_start":"251'100","ondisk_log_start":"251'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'113","last_scrub_stamp":"2024-06-04T16:23:20.707200+0000","last_deep_scrub":"254'113","last_deep_scrub_stamp":"2024-06-04T16:23:20.707200+0000","last_clean_scrub_stamp":"2024-06-04T16:23:20.707200+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":100,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T01:55:10.845538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":534,"num_read_kb":483,"num_write":137,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"251'58","reported_seq":545,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:48.217293+0000","last_change":"2024-06-04T16:22:48.217346+0000","last_active":"2024-06-04T16:22:48.217293+0000","last_peered":"2024-06-04T16:22:48.217293+0000","last_clean":"2024-06-04T16:22:48.217293+0000","last_became_active":"2024-06-04T15:53:14.838259+0000","last_became_peered":"2024-06-04T15:53:14.838259+0000","last_unstale":"2024-06-04T16:22:48.217293+0000","last_undegraded":"2024-06-04T16:22:48.217293+0000","last_fullsized":"2024-06-04T16:22:48.217293+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"251'58","last_scrub_stamp":"2024-06-04T16:22:48.217194+0000","last_deep_scrub":"251'58","last_deep_scrub_stamp":"2024-06-04T16:22:48.217194+0000","last_clean_scrub_stamp":"2024-06-04T16:22:48.217194+0000","objects_scrubbed":2,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T01:01:00.864191+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":105,"num_read_kb":3164,"num_write":221,"num_write_kb":9993,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,4],"acting":[6,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":487,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:04.217949+0000","last_change":"2024-06-04T16:23:04.217972+0000","last_active":"2024-06-04T16:23:04.217949+0000","last_peered":"2024-06-04T16:23:04.217949+0000","last_clean":"2024-06-04T16:23:04.217949+0000","last_became_active":"2024-06-04T15:52:40.483832+0000","last_became_peered":"2024-06-04T15:52:40.483832+0000","last_unstale":"2024-06-04T16:23:04.217949+0000","last_undegraded":"2024-06-04T16:23:04.217949+0000","last_fullsized":"2024-06-04T16:23:04.217949+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:23:04.217854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:23:04.217854+0000","last_clean_scrub_stamp":"2024-06-04T16:23:04.217854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T17:33:21.489187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"254'148","reported_seq":730,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:55.848573+0000","last_change":"2024-06-04T16:22:55.848573+0000","last_active":"2024-06-04T16:22:55.848573+0000","last_peered":"2024-06-04T16:22:55.848573+0000","last_clean":"2024-06-04T16:22:55.848573+0000","last_became_active":"2024-06-04T15:52:42.504217+0000","last_became_peered":"2024-06-04T15:52:42.504217+0000","last_unstale":"2024-06-04T16:22:55.848573+0000","last_undegraded":"2024-06-04T16:22:55.848573+0000","last_fullsized":"2024-06-04T16:22:55.848573+0000","mapping_epoch":27,"log_start":"251'100","ondisk_log_start":"251'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'148","last_scrub_stamp":"2024-06-04T16:22:55.848437+0000","last_deep_scrub":"254'148","last_deep_scrub_stamp":"2024-06-04T16:22:55.848437+0000","last_clean_scrub_stamp":"2024-06-04T16:22:55.848437+0000","objects_scrubbed":9,"log_size":48,"log_dups_size":100,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T01:32:43.406440+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":216,"num_read_kb":258,"num_write":116,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":472,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:10.020836+0000","last_change":"2024-06-04T16:23:10.020872+0000","last_active":"2024-06-04T16:23:10.020836+0000","last_peered":"2024-06-04T16:23:10.020836+0000","last_clean":"2024-06-04T16:23:10.020836+0000","last_became_active":"2024-06-04T15:52:44.520358+0000","last_became_peered":"2024-06-04T15:52:44.520358+0000","last_unstale":"2024-06-04T16:23:10.020836+0000","last_undegraded":"2024-06-04T16:23:10.020836+0000","last_fullsized":"2024-06-04T16:23:10.020836+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:23:10.020709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:23:10.020709+0000","last_clean_scrub_stamp":"2024-06-04T16:23:10.020709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T20:15:17.221215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"254'457","reported_seq":1250,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:53.493945+0000","last_change":"2024-06-04T16:22:53.493945+0000","last_active":"2024-06-04T16:22:53.493945+0000","last_peered":"2024-06-04T16:22:53.493945+0000","last_clean":"2024-06-04T16:22:53.493945+0000","last_became_active":"2024-06-04T15:52:46.536442+0000","last_became_peered":"2024-06-04T15:52:46.536442+0000","last_unstale":"2024-06-04T16:22:53.493945+0000","last_undegraded":"2024-06-04T16:22:53.493945+0000","last_fullsized":"2024-06-04T16:22:53.493945+0000","mapping_epoch":31,"log_start":"251'400","ondisk_log_start":"251'400","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'457","last_scrub_stamp":"2024-06-04T16:22:53.493803+0000","last_deep_scrub":"254'457","last_deep_scrub_stamp":"2024-06-04T16:22:53.493803+0000","last_clean_scrub_stamp":"2024-06-04T16:22:53.493803+0000","objects_scrubbed":2,"log_size":57,"log_dups_size":400,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T17:18:55.700935+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":418,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1197,"num_read_kb":1195,"num_write":937,"num_write_kb":336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":182,"num_omap_keys":1,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"254'122","reported_seq":933,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:03.204186+0000","last_change":"2024-06-04T16:23:03.204213+0000","last_active":"2024-06-04T16:23:03.204186+0000","last_peered":"2024-06-04T16:23:03.204186+0000","last_clean":"2024-06-04T16:23:03.204186+0000","last_became_active":"2024-06-04T15:52:38.483194+0000","last_became_peered":"2024-06-04T15:52:38.483194+0000","last_unstale":"2024-06-04T16:23:03.204186+0000","last_undegraded":"2024-06-04T16:23:03.204186+0000","last_fullsized":"2024-06-04T16:23:03.204186+0000","mapping_epoch":23,"log_start":"251'100","ondisk_log_start":"251'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'122","last_scrub_stamp":"2024-06-04T16:23:03.204097+0000","last_deep_scrub":"254'122","last_deep_scrub_stamp":"2024-06-04T16:23:03.204097+0000","last_clean_scrub_stamp":"2024-06-04T16:23:03.204097+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":100,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T20:27:28.071534+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":683,"num_read_kb":649,"num_write":140,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"254'60","reported_seq":600,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:18.680129+0000","last_change":"2024-06-04T16:23:18.680207+0000","last_active":"2024-06-04T16:23:18.680129+0000","last_peered":"2024-06-04T16:23:18.680129+0000","last_clean":"2024-06-04T16:23:18.680129+0000","last_became_active":"2024-06-04T15:52:36.485995+0000","last_became_peered":"2024-06-04T15:52:36.485995+0000","last_unstale":"2024-06-04T16:23:18.680129+0000","last_undegraded":"2024-06-04T16:23:18.680129+0000","last_fullsized":"2024-06-04T16:23:18.680129+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'60","last_scrub_stamp":"2024-06-04T16:23:18.680030+0000","last_deep_scrub":"254'60","last_deep_scrub_stamp":"2024-06-04T16:23:18.680030+0000","last_clean_scrub_stamp":"2024-06-04T16:23:18.680030+0000","objects_scrubbed":6,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T16:54:32.626897+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":105,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":98,"num_read_kb":68665,"num_write":249,"num_write_kb":35943,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":481,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:01.049522+0000","last_change":"2024-06-04T16:23:01.049547+0000","last_active":"2024-06-04T16:23:01.049522+0000","last_peered":"2024-06-04T16:23:01.049522+0000","last_clean":"2024-06-04T16:23:01.049522+0000","last_became_active":"2024-06-04T15:52:40.480714+0000","last_became_peered":"2024-06-04T15:52:40.480714+0000","last_unstale":"2024-06-04T16:23:01.049522+0000","last_undegraded":"2024-06-04T16:23:01.049522+0000","last_fullsized":"2024-06-04T16:23:01.049522+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:23:01.049430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:23:01.049430+0000","last_clean_scrub_stamp":"2024-06-04T16:23:01.049430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T19:32:08.942239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.b","version":"254'96","reported_seq":645,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:55.026863+0000","last_change":"2024-06-04T16:22:55.026898+0000","last_active":"2024-06-04T16:22:55.026863+0000","last_peered":"2024-06-04T16:22:55.026863+0000","last_clean":"2024-06-04T16:22:55.026863+0000","last_became_active":"2024-06-04T15:52:42.505269+0000","last_became_peered":"2024-06-04T15:52:42.505269+0000","last_unstale":"2024-06-04T16:22:55.026863+0000","last_undegraded":"2024-06-04T16:22:55.026863+0000","last_fullsized":"2024-06-04T16:22:55.026863+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'96","last_scrub_stamp":"2024-06-04T16:22:55.026767+0000","last_deep_scrub":"254'96","last_deep_scrub_stamp":"2024-06-04T16:22:55.026767+0000","last_clean_scrub_stamp":"2024-06-04T16:22:55.026767+0000","objects_scrubbed":4,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T18:40:29.643937+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":127,"num_read_kb":117,"num_write":58,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":477,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:52.966827+0000","last_change":"2024-06-04T16:22:52.966827+0000","last_active":"2024-06-04T16:22:52.966827+0000","last_peered":"2024-06-04T16:22:52.966827+0000","last_clean":"2024-06-04T16:22:52.966827+0000","last_became_active":"2024-06-04T15:52:44.522149+0000","last_became_peered":"2024-06-04T15:52:44.522149+0000","last_unstale":"2024-06-04T16:22:52.966827+0000","last_undegraded":"2024-06-04T16:22:52.966827+0000","last_fullsized":"2024-06-04T16:22:52.966827+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:22:52.966674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:22:52.966674+0000","last_clean_scrub_stamp":"2024-06-04T16:22:52.966674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T02:07:15.814206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.5","version":"254'29","reported_seq":514,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:49.115675+0000","last_change":"2024-06-04T16:22:49.115732+0000","last_active":"2024-06-04T16:22:49.115675+0000","last_peered":"2024-06-04T16:22:49.115675+0000","last_clean":"2024-06-04T16:22:49.115675+0000","last_became_active":"2024-06-04T15:52:46.540510+0000","last_became_peered":"2024-06-04T15:52:46.540510+0000","last_unstale":"2024-06-04T16:22:49.115675+0000","last_undegraded":"2024-06-04T16:22:49.115675+0000","last_fullsized":"2024-06-04T16:22:49.115675+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'29","last_scrub_stamp":"2024-06-04T16:22:49.115565+0000","last_deep_scrub":"254'29","last_deep_scrub_stamp":"2024-06-04T16:22:49.115565+0000","last_clean_scrub_stamp":"2024-06-04T16:22:49.115565+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T21:09:44.617649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":51,"num_write":73,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"254'110","reported_seq":885,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:08.481097+0000","last_change":"2024-06-04T16:23:08.481122+0000","last_active":"2024-06-04T16:23:08.481097+0000","last_peered":"2024-06-04T16:23:08.481097+0000","last_clean":"2024-06-04T16:23:08.481097+0000","last_became_active":"2024-06-04T15:52:38.480112+0000","last_became_peered":"2024-06-04T15:52:38.480112+0000","last_unstale":"2024-06-04T16:23:08.481097+0000","last_undegraded":"2024-06-04T16:23:08.481097+0000","last_fullsized":"2024-06-04T16:23:08.481097+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'110","last_scrub_stamp":"2024-06-04T16:23:08.481025+0000","last_deep_scrub":"254'110","last_deep_scrub_stamp":"2024-06-04T16:23:08.481025+0000","last_clean_scrub_stamp":"2024-06-04T16:23:08.481025+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T19:01:23.753908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":725,"num_read_kb":689,"num_write":131,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"251'79","reported_seq":556,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:49.252335+0000","last_change":"2024-06-04T16:22:49.252378+0000","last_active":"2024-06-04T16:22:49.252335+0000","last_peered":"2024-06-04T16:22:49.252335+0000","last_clean":"2024-06-04T16:22:49.252335+0000","last_became_active":"2024-06-04T15:53:14.838251+0000","last_became_peered":"2024-06-04T15:53:14.838251+0000","last_unstale":"2024-06-04T16:22:49.252335+0000","last_undegraded":"2024-06-04T16:22:49.252335+0000","last_fullsized":"2024-06-04T16:22:49.252335+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"251'79","last_scrub_stamp":"2024-06-04T16:22:49.252226+0000","last_deep_scrub":"251'79","last_deep_scrub_stamp":"2024-06-04T16:22:49.252226+0000","last_clean_scrub_stamp":"2024-06-04T16:22:49.252226+0000","objects_scrubbed":5,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T00:19:46.167408+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5263509,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":74,"num_read_kb":65,"num_write":320,"num_write_kb":43304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.b","version":"254'4","reported_seq":794,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:24.369936+0000","last_change":"2024-06-04T16:23:24.369963+0000","last_active":"2024-06-04T16:23:24.369936+0000","last_peered":"2024-06-04T16:23:24.369936+0000","last_clean":"2024-06-04T16:23:24.369936+0000","last_became_active":"2024-06-04T15:52:40.482173+0000","last_became_peered":"2024-06-04T15:52:40.482173+0000","last_unstale":"2024-06-04T16:23:24.369936+0000","last_undegraded":"2024-06-04T16:23:24.369936+0000","last_fullsized":"2024-06-04T16:23:24.369936+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'4","last_scrub_stamp":"2024-06-04T16:23:24.369835+0000","last_deep_scrub":"254'4","last_deep_scrub_stamp":"2024-06-04T16:23:24.369835+0000","last_clean_scrub_stamp":"2024-06-04T16:23:24.369835+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T19:07:58.960858+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":464,"num_read_kb":462,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"254'116","reported_seq":674,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:12.884361+0000","last_change":"2024-06-04T16:23:12.884411+0000","last_active":"2024-06-04T16:23:12.884361+0000","last_peered":"2024-06-04T16:23:12.884361+0000","last_clean":"2024-06-04T16:23:12.884361+0000","last_became_active":"2024-06-04T15:52:42.497393+0000","last_became_peered":"2024-06-04T15:52:42.497393+0000","last_unstale":"2024-06-04T16:23:12.884361+0000","last_undegraded":"2024-06-04T16:23:12.884361+0000","last_fullsized":"2024-06-04T16:23:12.884361+0000","mapping_epoch":27,"log_start":"251'100","ondisk_log_start":"251'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'116","last_scrub_stamp":"2024-06-04T16:23:12.884257+0000","last_deep_scrub":"254'116","last_deep_scrub_stamp":"2024-06-04T16:23:12.884257+0000","last_clean_scrub_stamp":"2024-06-04T16:23:12.884257+0000","objects_scrubbed":7,"log_size":16,"log_dups_size":100,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T20:45:14.006254+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13302,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":171,"num_read_kb":247,"num_write":88,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"254'478","reported_seq":1645,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:07.355986+0000","last_change":"2024-06-04T16:23:07.356012+0000","last_active":"2024-06-04T16:23:07.355986+0000","last_peered":"2024-06-04T16:23:07.355986+0000","last_clean":"2024-06-04T16:23:07.355986+0000","last_became_active":"2024-06-04T15:52:44.518765+0000","last_became_peered":"2024-06-04T15:52:44.518765+0000","last_unstale":"2024-06-04T16:23:07.355986+0000","last_undegraded":"2024-06-04T16:23:07.355986+0000","last_fullsized":"2024-06-04T16:23:07.355986+0000","mapping_epoch":29,"log_start":"251'400","ondisk_log_start":"251'400","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'478","last_scrub_stamp":"2024-06-04T16:23:07.355902+0000","last_deep_scrub":"254'478","last_deep_scrub_stamp":"2024-06-04T16:23:07.355902+0000","last_clean_scrub_stamp":"2024-06-04T16:23:07.355902+0000","objects_scrubbed":1,"log_size":78,"log_dups_size":400,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T00:22:11.634747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"254'22","reported_seq":499,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:52.174461+0000","last_change":"2024-06-04T16:22:52.174461+0000","last_active":"2024-06-04T16:22:52.174461+0000","last_peered":"2024-06-04T16:22:52.174461+0000","last_clean":"2024-06-04T16:22:52.174461+0000","last_became_active":"2024-06-04T15:52:46.537679+0000","last_became_peered":"2024-06-04T15:52:46.537679+0000","last_unstale":"2024-06-04T16:22:52.174461+0000","last_undegraded":"2024-06-04T16:22:52.174461+0000","last_fullsized":"2024-06-04T16:22:52.174461+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'22","last_scrub_stamp":"2024-06-04T16:22:52.174345+0000","last_deep_scrub":"254'22","last_deep_scrub_stamp":"2024-06-04T16:22:52.174345+0000","last_clean_scrub_stamp":"2024-06-04T16:22:52.174345+0000","objects_scrubbed":1,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T02:41:59.686833+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":390,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":49,"num_read_kb":41,"num_write":55,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"254'142","reported_seq":909,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:18.327141+0000","last_change":"2024-06-04T16:23:18.327180+0000","last_active":"2024-06-04T16:23:18.327141+0000","last_peered":"2024-06-04T16:23:18.327141+0000","last_clean":"2024-06-04T16:23:18.327141+0000","last_became_active":"2024-06-04T15:52:38.488997+0000","last_became_peered":"2024-06-04T15:52:38.488997+0000","last_unstale":"2024-06-04T16:23:18.327141+0000","last_undegraded":"2024-06-04T16:23:18.327141+0000","last_fullsized":"2024-06-04T16:23:18.327141+0000","mapping_epoch":23,"log_start":"251'100","ondisk_log_start":"251'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'142","last_scrub_stamp":"2024-06-04T16:23:18.327044+0000","last_deep_scrub":"254'142","last_deep_scrub_stamp":"2024-06-04T16:23:18.327044+0000","last_clean_scrub_stamp":"2024-06-04T16:23:18.327044+0000","objects_scrubbed":1,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T20:11:38.046285+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":688,"num_read_kb":631,"num_write":173,"num_write_kb":46,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"254'58","reported_seq":576,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:04.760655+0000","last_change":"2024-06-04T16:23:04.760722+0000","last_active":"2024-06-04T16:23:04.760655+0000","last_peered":"2024-06-04T16:23:04.760655+0000","last_clean":"2024-06-04T16:23:04.760655+0000","last_became_active":"2024-06-04T15:52:36.495601+0000","last_became_peered":"2024-06-04T15:52:36.495601+0000","last_unstale":"2024-06-04T16:23:04.760655+0000","last_undegraded":"2024-06-04T16:23:04.760655+0000","last_fullsized":"2024-06-04T16:23:04.760655+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'58","last_scrub_stamp":"2024-06-04T16:23:04.760535+0000","last_deep_scrub":"254'58","last_deep_scrub_stamp":"2024-06-04T16:23:04.760535+0000","last_clean_scrub_stamp":"2024-06-04T16:23:04.760535+0000","objects_scrubbed":3,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T16:26:15.812386+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":74,"num_read_kb":575,"num_write":257,"num_write_kb":23683,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":481,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:56.113187+0000","last_change":"2024-06-04T16:22:56.113187+0000","last_active":"2024-06-04T16:22:56.113187+0000","last_peered":"2024-06-04T16:22:56.113187+0000","last_clean":"2024-06-04T16:22:56.113187+0000","last_became_active":"2024-06-04T15:52:40.484785+0000","last_became_peered":"2024-06-04T15:52:40.484785+0000","last_unstale":"2024-06-04T16:22:56.113187+0000","last_undegraded":"2024-06-04T16:22:56.113187+0000","last_fullsized":"2024-06-04T16:22:56.113187+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:22:56.113062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:22:56.113062+0000","last_clean_scrub_stamp":"2024-06-04T16:22:56.113062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T03:33:52.074473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.9","version":"254'161","reported_seq":772,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:57.012649+0000","last_change":"2024-06-04T16:22:57.012649+0000","last_active":"2024-06-04T16:22:57.012649+0000","last_peered":"2024-06-04T16:22:57.012649+0000","last_clean":"2024-06-04T16:22:57.012649+0000","last_became_active":"2024-06-04T15:52:42.504622+0000","last_became_peered":"2024-06-04T15:52:42.504622+0000","last_unstale":"2024-06-04T16:22:57.012649+0000","last_undegraded":"2024-06-04T16:22:57.012649+0000","last_fullsized":"2024-06-04T16:22:57.012649+0000","mapping_epoch":27,"log_start":"251'100","ondisk_log_start":"251'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'161","last_scrub_stamp":"2024-06-04T16:22:57.012513+0000","last_deep_scrub":"254'161","last_deep_scrub_stamp":"2024-06-04T16:22:57.012513+0000","last_clean_scrub_stamp":"2024-06-04T16:22:57.012513+0000","objects_scrubbed":5,"log_size":61,"log_dups_size":100,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T04:11:37.544221+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25402,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":256,"num_read_kb":404,"num_write":118,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":479,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:08.356628+0000","last_change":"2024-06-04T16:23:08.356652+0000","last_active":"2024-06-04T16:23:08.356628+0000","last_peered":"2024-06-04T16:23:08.356628+0000","last_clean":"2024-06-04T16:23:08.356628+0000","last_became_active":"2024-06-04T15:52:44.518340+0000","last_became_peered":"2024-06-04T15:52:44.518340+0000","last_unstale":"2024-06-04T16:23:08.356628+0000","last_undegraded":"2024-06-04T16:23:08.356628+0000","last_fullsized":"2024-06-04T16:23:08.356628+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:23:08.356529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:23:08.356529+0000","last_clean_scrub_stamp":"2024-06-04T16:23:08.356529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T01:28:35.019870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"254'23","reported_seq":512,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:05.078621+0000","last_change":"2024-06-04T16:23:05.078621+0000","last_active":"2024-06-04T16:23:05.078621+0000","last_peered":"2024-06-04T16:23:05.078621+0000","last_clean":"2024-06-04T16:23:05.078621+0000","last_became_active":"2024-06-04T15:52:46.540542+0000","last_became_peered":"2024-06-04T15:52:46.540542+0000","last_unstale":"2024-06-04T16:23:05.078621+0000","last_undegraded":"2024-06-04T16:23:05.078621+0000","last_fullsized":"2024-06-04T16:23:05.078621+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'23","last_scrub_stamp":"2024-06-04T16:23:05.078478+0000","last_deep_scrub":"254'23","last_deep_scrub_stamp":"2024-06-04T16:23:05.078478+0000","last_clean_scrub_stamp":"2024-06-04T16:23:05.078478+0000","objects_scrubbed":1,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T02:22:33.559139+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":503,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":51,"num_read_kb":51,"num_write":59,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"254'119","reported_seq":924,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:54.855494+0000","last_change":"2024-06-04T16:22:54.855550+0000","last_active":"2024-06-04T16:22:54.855494+0000","last_peered":"2024-06-04T16:22:54.855494+0000","last_clean":"2024-06-04T16:22:54.855494+0000","last_became_active":"2024-06-04T15:52:38.488576+0000","last_became_peered":"2024-06-04T15:52:38.488576+0000","last_unstale":"2024-06-04T16:22:54.855494+0000","last_undegraded":"2024-06-04T16:22:54.855494+0000","last_fullsized":"2024-06-04T16:22:54.855494+0000","mapping_epoch":23,"log_start":"251'100","ondisk_log_start":"251'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'119","last_scrub_stamp":"2024-06-04T16:22:54.855389+0000","last_deep_scrub":"254'119","last_deep_scrub_stamp":"2024-06-04T16:22:54.855389+0000","last_clean_scrub_stamp":"2024-06-04T16:22:54.855389+0000","objects_scrubbed":3,"log_size":19,"log_dups_size":100,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T22:19:39.538012+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":804,"num_read_kb":763,"num_write":143,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":723,"num_omap_keys":3,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"254'83","reported_seq":612,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:24.902386+0000","last_change":"2024-06-04T16:23:24.902461+0000","last_active":"2024-06-04T16:23:24.902386+0000","last_peered":"2024-06-04T16:23:24.902386+0000","last_clean":"2024-06-04T16:23:24.902386+0000","last_became_active":"2024-06-04T15:52:36.498706+0000","last_became_peered":"2024-06-04T15:52:36.498706+0000","last_unstale":"2024-06-04T16:23:24.902386+0000","last_undegraded":"2024-06-04T16:23:24.902386+0000","last_fullsized":"2024-06-04T16:23:24.902386+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'83","last_scrub_stamp":"2024-06-04T16:23:24.902269+0000","last_deep_scrub":"254'83","last_deep_scrub_stamp":"2024-06-04T16:23:24.902269+0000","last_clean_scrub_stamp":"2024-06-04T16:23:24.902269+0000","objects_scrubbed":3,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T00:39:33.757532+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262197,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":125,"num_read_kb":7280,"num_write":369,"num_write_kb":33149,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":484,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:12.929752+0000","last_change":"2024-06-04T16:23:12.929800+0000","last_active":"2024-06-04T16:23:12.929752+0000","last_peered":"2024-06-04T16:23:12.929752+0000","last_clean":"2024-06-04T16:23:12.929752+0000","last_became_active":"2024-06-04T15:52:40.484285+0000","last_became_peered":"2024-06-04T15:52:40.484285+0000","last_unstale":"2024-06-04T16:23:12.929752+0000","last_undegraded":"2024-06-04T16:23:12.929752+0000","last_fullsized":"2024-06-04T16:23:12.929752+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:23:12.929650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:23:12.929650+0000","last_clean_scrub_stamp":"2024-06-04T16:23:12.929650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T00:20:19.738361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.e","version":"254'126","reported_seq":680,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:06.264937+0000","last_change":"2024-06-04T16:23:06.265001+0000","last_active":"2024-06-04T16:23:06.264937+0000","last_peered":"2024-06-04T16:23:06.264937+0000","last_clean":"2024-06-04T16:23:06.264937+0000","last_became_active":"2024-06-04T15:52:42.500865+0000","last_became_peered":"2024-06-04T15:52:42.500865+0000","last_unstale":"2024-06-04T16:23:06.264937+0000","last_undegraded":"2024-06-04T16:23:06.264937+0000","last_fullsized":"2024-06-04T16:23:06.264937+0000","mapping_epoch":27,"log_start":"251'100","ondisk_log_start":"251'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'126","last_scrub_stamp":"2024-06-04T16:23:06.264820+0000","last_deep_scrub":"254'126","last_deep_scrub_stamp":"2024-06-04T16:23:06.264820+0000","last_clean_scrub_stamp":"2024-06-04T16:23:06.264820+0000","objects_scrubbed":6,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T20:12:34.216703+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":174,"num_read_kb":176,"num_write":136,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":13964,"num_omap_keys":34,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":476,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:13.901326+0000","last_change":"2024-06-04T16:23:13.901347+0000","last_active":"2024-06-04T16:23:13.901326+0000","last_peered":"2024-06-04T16:23:13.901326+0000","last_clean":"2024-06-04T16:23:13.901326+0000","last_became_active":"2024-06-04T15:52:44.519542+0000","last_became_peered":"2024-06-04T15:52:44.519542+0000","last_unstale":"2024-06-04T16:23:13.901326+0000","last_undegraded":"2024-06-04T16:23:13.901326+0000","last_fullsized":"2024-06-04T16:23:13.901326+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:23:13.901228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:23:13.901228+0000","last_clean_scrub_stamp":"2024-06-04T16:23:13.901228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T22:51:41.368783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.0","version":"254'18","reported_seq":494,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:00.480512+0000","last_change":"2024-06-04T16:23:00.480554+0000","last_active":"2024-06-04T16:23:00.480512+0000","last_peered":"2024-06-04T16:23:00.480512+0000","last_clean":"2024-06-04T16:23:00.480512+0000","last_became_active":"2024-06-04T15:52:46.539906+0000","last_became_peered":"2024-06-04T15:52:46.539906+0000","last_unstale":"2024-06-04T16:23:00.480512+0000","last_undegraded":"2024-06-04T16:23:00.480512+0000","last_fullsized":"2024-06-04T16:23:00.480512+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'18","last_scrub_stamp":"2024-06-04T16:23:00.480421+0000","last_deep_scrub":"254'18","last_deep_scrub_stamp":"2024-06-04T16:23:00.480421+0000","last_clean_scrub_stamp":"2024-06-04T16:23:00.480421+0000","objects_scrubbed":2,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T20:46:48.332397+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":31,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"254'141","reported_seq":907,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:21.730902+0000","last_change":"2024-06-04T16:23:21.730965+0000","last_active":"2024-06-04T16:23:21.730902+0000","last_peered":"2024-06-04T16:23:21.730902+0000","last_clean":"2024-06-04T16:23:21.730902+0000","last_became_active":"2024-06-04T15:52:38.478691+0000","last_became_peered":"2024-06-04T15:52:38.478691+0000","last_unstale":"2024-06-04T16:23:21.730902+0000","last_undegraded":"2024-06-04T16:23:21.730902+0000","last_fullsized":"2024-06-04T16:23:21.730902+0000","mapping_epoch":23,"log_start":"251'100","ondisk_log_start":"251'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'141","last_scrub_stamp":"2024-06-04T16:23:21.730784+0000","last_deep_scrub":"254'141","last_deep_scrub_stamp":"2024-06-04T16:23:21.730784+0000","last_clean_scrub_stamp":"2024-06-04T16:23:21.730784+0000","objects_scrubbed":1,"log_size":41,"log_dups_size":100,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T19:02:45.024119+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":683,"num_read_kb":634,"num_write":182,"num_write_kb":49,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":219,"num_omap_keys":1,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"254'80","reported_seq":597,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:43.608394+0000","last_change":"2024-06-04T16:23:43.608431+0000","last_active":"2024-06-04T16:23:43.608394+0000","last_peered":"2024-06-04T16:23:43.608394+0000","last_clean":"2024-06-04T16:23:43.608394+0000","last_became_active":"2024-06-04T15:52:36.489437+0000","last_became_peered":"2024-06-04T15:52:36.489437+0000","last_unstale":"2024-06-04T16:23:43.608394+0000","last_undegraded":"2024-06-04T16:23:43.608394+0000","last_fullsized":"2024-06-04T16:23:43.608394+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'80","last_scrub_stamp":"2024-06-04T16:23:43.608257+0000","last_deep_scrub":"254'80","last_deep_scrub_stamp":"2024-06-04T16:23:43.608257+0000","last_clean_scrub_stamp":"2024-06-04T16:23:43.608257+0000","objects_scrubbed":2,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T22:15:30.727577+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133669,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":97,"num_read_kb":3905,"num_write":348,"num_write_kb":24180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":486,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:22.346328+0000","last_change":"2024-06-04T16:23:22.346350+0000","last_active":"2024-06-04T16:23:22.346328+0000","last_peered":"2024-06-04T16:23:22.346328+0000","last_clean":"2024-06-04T16:23:22.346328+0000","last_became_active":"2024-06-04T15:52:40.480568+0000","last_became_peered":"2024-06-04T15:52:40.480568+0000","last_unstale":"2024-06-04T16:23:22.346328+0000","last_undegraded":"2024-06-04T16:23:22.346328+0000","last_fullsized":"2024-06-04T16:23:22.346328+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:23:22.346239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:23:22.346239+0000","last_clean_scrub_stamp":"2024-06-04T16:23:22.346239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T01:05:37.658043+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.f","version":"254'118","reported_seq":678,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:26.452412+0000","last_change":"2024-06-04T16:23:26.452471+0000","last_active":"2024-06-04T16:23:26.452412+0000","last_peered":"2024-06-04T16:23:26.452412+0000","last_clean":"2024-06-04T16:23:26.452412+0000","last_became_active":"2024-06-04T15:52:42.499014+0000","last_became_peered":"2024-06-04T15:52:42.499014+0000","last_unstale":"2024-06-04T16:23:26.452412+0000","last_undegraded":"2024-06-04T16:23:26.452412+0000","last_fullsized":"2024-06-04T16:23:26.452412+0000","mapping_epoch":27,"log_start":"251'100","ondisk_log_start":"251'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'118","last_scrub_stamp":"2024-06-04T16:23:26.452307+0000","last_deep_scrub":"254'118","last_deep_scrub_stamp":"2024-06-04T16:23:26.452307+0000","last_clean_scrub_stamp":"2024-06-04T16:23:26.452307+0000","objects_scrubbed":7,"log_size":18,"log_dups_size":100,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T19:48:43.429761+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6848,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":169,"num_read_kb":239,"num_write":88,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.e","version":"254'464","reported_seq":1453,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:11.952502+0000","last_change":"2024-06-04T16:23:11.952532+0000","last_active":"2024-06-04T16:23:11.952502+0000","last_peered":"2024-06-04T16:23:11.952502+0000","last_clean":"2024-06-04T16:23:11.952502+0000","last_became_active":"2024-06-04T15:52:44.520016+0000","last_became_peered":"2024-06-04T15:52:44.520016+0000","last_unstale":"2024-06-04T16:23:11.952502+0000","last_undegraded":"2024-06-04T16:23:11.952502+0000","last_fullsized":"2024-06-04T16:23:11.952502+0000","mapping_epoch":29,"log_start":"251'400","ondisk_log_start":"251'400","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'464","last_scrub_stamp":"2024-06-04T16:23:11.952413+0000","last_deep_scrub":"254'464","last_deep_scrub_stamp":"2024-06-04T16:23:11.952413+0000","last_clean_scrub_stamp":"2024-06-04T16:23:11.952413+0000","objects_scrubbed":1,"log_size":64,"log_dups_size":400,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T02:24:58.126815+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1","version":"254'30","reported_seq":511,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:20.170804+0000","last_change":"2024-06-04T16:23:20.170804+0000","last_active":"2024-06-04T16:23:20.170804+0000","last_peered":"2024-06-04T16:23:20.170804+0000","last_clean":"2024-06-04T16:23:20.170804+0000","last_became_active":"2024-06-04T15:52:46.532554+0000","last_became_peered":"2024-06-04T15:52:46.532554+0000","last_unstale":"2024-06-04T16:23:20.170804+0000","last_undegraded":"2024-06-04T16:23:20.170804+0000","last_fullsized":"2024-06-04T16:23:20.170804+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'30","last_scrub_stamp":"2024-06-04T16:23:20.170628+0000","last_deep_scrub":"254'30","last_deep_scrub_stamp":"2024-06-04T16:23:20.170628+0000","last_clean_scrub_stamp":"2024-06-04T16:23:20.170628+0000","objects_scrubbed":2,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T23:35:04.324039+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":764,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":64,"num_read_kb":55,"num_write":77,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.e","version":"254'75","reported_seq":766,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:06.474256+0000","last_change":"2024-06-04T16:23:06.474304+0000","last_active":"2024-06-04T16:23:06.474256+0000","last_peered":"2024-06-04T16:23:06.474256+0000","last_clean":"2024-06-04T16:23:06.474256+0000","last_became_active":"2024-06-04T15:52:38.480961+0000","last_became_peered":"2024-06-04T15:52:38.480961+0000","last_unstale":"2024-06-04T16:23:06.474256+0000","last_undegraded":"2024-06-04T16:23:06.474256+0000","last_fullsized":"2024-06-04T16:23:06.474256+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'75","last_scrub_stamp":"2024-06-04T16:23:06.474148+0000","last_deep_scrub":"254'75","last_deep_scrub_stamp":"2024-06-04T16:23:06.474148+0000","last_clean_scrub_stamp":"2024-06-04T16:23:06.474148+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T19:29:32.107688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":420,"num_read_kb":402,"num_write":82,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"254'43","reported_seq":551,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:40.527986+0000","last_change":"2024-06-04T16:23:40.528042+0000","last_active":"2024-06-04T16:23:40.527986+0000","last_peered":"2024-06-04T16:23:40.527986+0000","last_clean":"2024-06-04T16:23:40.527986+0000","last_became_active":"2024-06-04T15:52:36.485571+0000","last_became_peered":"2024-06-04T15:52:36.485571+0000","last_unstale":"2024-06-04T16:23:40.527986+0000","last_undegraded":"2024-06-04T16:23:40.527986+0000","last_fullsized":"2024-06-04T16:23:40.527986+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'43","last_scrub_stamp":"2024-06-04T16:23:40.527859+0000","last_deep_scrub":"254'43","last_deep_scrub_stamp":"2024-06-04T16:23:40.527859+0000","last_clean_scrub_stamp":"2024-06-04T16:23:40.527859+0000","objects_scrubbed":1,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T00:32:31.087591+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":66,"num_read_kb":9943,"num_write":198,"num_write_kb":32171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"254'4","reported_seq":1096,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:58.155039+0000","last_change":"2024-06-04T16:22:58.155073+0000","last_active":"2024-06-04T16:22:58.155039+0000","last_peered":"2024-06-04T16:22:58.155039+0000","last_clean":"2024-06-04T16:22:58.155039+0000","last_became_active":"2024-06-04T15:52:40.477693+0000","last_became_peered":"2024-06-04T15:52:40.477693+0000","last_unstale":"2024-06-04T16:22:58.155039+0000","last_undegraded":"2024-06-04T16:22:58.155039+0000","last_fullsized":"2024-06-04T16:22:58.155039+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'4","last_scrub_stamp":"2024-06-04T16:22:58.154941+0000","last_deep_scrub":"254'4","last_deep_scrub_stamp":"2024-06-04T16:22:58.154941+0000","last_clean_scrub_stamp":"2024-06-04T16:22:58.154941+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T00:05:04.192698+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":606,"num_read_kb":606,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"254'40","reported_seq":531,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:02.080728+0000","last_change":"2024-06-04T16:23:02.080763+0000","last_active":"2024-06-04T16:23:02.080728+0000","last_peered":"2024-06-04T16:23:02.080728+0000","last_clean":"2024-06-04T16:23:02.080728+0000","last_became_active":"2024-06-04T15:52:42.503184+0000","last_became_peered":"2024-06-04T15:52:42.503184+0000","last_unstale":"2024-06-04T16:23:02.080728+0000","last_undegraded":"2024-06-04T16:23:02.080728+0000","last_fullsized":"2024-06-04T16:23:02.080728+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'40","last_scrub_stamp":"2024-06-04T16:23:02.080645+0000","last_deep_scrub":"254'40","last_deep_scrub_stamp":"2024-06-04T16:23:02.080645+0000","last_clean_scrub_stamp":"2024-06-04T16:23:02.080645+0000","objects_scrubbed":5,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T03:22:52.049410+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":45,"num_read_kb":40,"num_write":30,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.d","version":"254'470","reported_seq":1632,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:57.144139+0000","last_change":"2024-06-04T16:22:57.144210+0000","last_active":"2024-06-04T16:22:57.144139+0000","last_peered":"2024-06-04T16:22:57.144139+0000","last_clean":"2024-06-04T16:22:57.144139+0000","last_became_active":"2024-06-04T15:52:44.518522+0000","last_became_peered":"2024-06-04T15:52:44.518522+0000","last_unstale":"2024-06-04T16:22:57.144139+0000","last_undegraded":"2024-06-04T16:22:57.144139+0000","last_fullsized":"2024-06-04T16:22:57.144139+0000","mapping_epoch":29,"log_start":"251'400","ondisk_log_start":"251'400","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'470","last_scrub_stamp":"2024-06-04T16:22:57.144040+0000","last_deep_scrub":"254'470","last_deep_scrub_stamp":"2024-06-04T16:22:57.144040+0000","last_clean_scrub_stamp":"2024-06-04T16:22:57.144040+0000","objects_scrubbed":1,"log_size":70,"log_dups_size":400,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T02:23:07.168350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"254'26","reported_seq":504,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:21.631965+0000","last_change":"2024-06-04T16:23:21.631965+0000","last_active":"2024-06-04T16:23:21.631965+0000","last_peered":"2024-06-04T16:23:21.631965+0000","last_clean":"2024-06-04T16:23:21.631965+0000","last_became_active":"2024-06-04T15:52:46.529183+0000","last_became_peered":"2024-06-04T15:52:46.529183+0000","last_unstale":"2024-06-04T16:23:21.631965+0000","last_undegraded":"2024-06-04T16:23:21.631965+0000","last_fullsized":"2024-06-04T16:23:21.631965+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'26","last_scrub_stamp":"2024-06-04T16:23:21.631850+0000","last_deep_scrub":"254'26","last_deep_scrub_stamp":"2024-06-04T16:23:21.631850+0000","last_clean_scrub_stamp":"2024-06-04T16:23:21.631850+0000","objects_scrubbed":1,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T23:41:50.582422+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":33,"num_read_kb":31,"num_write":52,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"254'102","reported_seq":875,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:18.975096+0000","last_change":"2024-06-04T16:23:18.975148+0000","last_active":"2024-06-04T16:23:18.975096+0000","last_peered":"2024-06-04T16:23:18.975096+0000","last_clean":"2024-06-04T16:23:18.975096+0000","last_became_active":"2024-06-04T15:52:38.485146+0000","last_became_peered":"2024-06-04T15:52:38.485146+0000","last_unstale":"2024-06-04T16:23:18.975096+0000","last_undegraded":"2024-06-04T16:23:18.975096+0000","last_fullsized":"2024-06-04T16:23:18.975096+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'102","last_scrub_stamp":"2024-06-04T16:23:18.974996+0000","last_deep_scrub":"254'102","last_deep_scrub_stamp":"2024-06-04T16:23:18.974996+0000","last_clean_scrub_stamp":"2024-06-04T16:23:18.974996+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T23:16:12.932747+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":573,"num_read_kb":549,"num_write":116,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"251'24","reported_seq":526,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:18.858021+0000","last_change":"2024-06-04T16:23:18.858060+0000","last_active":"2024-06-04T16:23:18.858021+0000","last_peered":"2024-06-04T16:23:18.858021+0000","last_clean":"2024-06-04T16:23:18.858021+0000","last_became_active":"2024-06-04T15:52:36.475290+0000","last_became_peered":"2024-06-04T15:52:36.475290+0000","last_unstale":"2024-06-04T16:23:18.858021+0000","last_undegraded":"2024-06-04T16:23:18.858021+0000","last_fullsized":"2024-06-04T16:23:18.858021+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"251'24","last_scrub_stamp":"2024-06-04T16:23:18.857916+0000","last_deep_scrub":"251'24","last_deep_scrub_stamp":"2024-06-04T16:23:18.857916+0000","last_clean_scrub_stamp":"2024-06-04T16:23:18.857916+0000","objects_scrubbed":1,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T23:52:34.754727+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":22,"num_read_kb":15371,"num_write":75,"num_write_kb":21019,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,2],"acting":[4,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":483,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:16.796763+0000","last_change":"2024-06-04T16:23:16.796788+0000","last_active":"2024-06-04T16:23:16.796763+0000","last_peered":"2024-06-04T16:23:16.796763+0000","last_clean":"2024-06-04T16:23:16.796763+0000","last_became_active":"2024-06-04T15:52:40.481856+0000","last_became_peered":"2024-06-04T15:52:40.481856+0000","last_unstale":"2024-06-04T16:23:16.796763+0000","last_undegraded":"2024-06-04T16:23:16.796763+0000","last_fullsized":"2024-06-04T16:23:16.796763+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:23:16.796663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:23:16.796663+0000","last_clean_scrub_stamp":"2024-06-04T16:23:16.796663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T22:31:29.169661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"254'148","reported_seq":726,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:08.239387+0000","last_change":"2024-06-04T16:23:08.239441+0000","last_active":"2024-06-04T16:23:08.239387+0000","last_peered":"2024-06-04T16:23:08.239387+0000","last_clean":"2024-06-04T16:23:08.239387+0000","last_became_active":"2024-06-04T15:52:42.503214+0000","last_became_peered":"2024-06-04T15:52:42.503214+0000","last_unstale":"2024-06-04T16:23:08.239387+0000","last_undegraded":"2024-06-04T16:23:08.239387+0000","last_fullsized":"2024-06-04T16:23:08.239387+0000","mapping_epoch":27,"log_start":"251'100","ondisk_log_start":"251'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'148","last_scrub_stamp":"2024-06-04T16:23:08.239291+0000","last_deep_scrub":"254'148","last_deep_scrub_stamp":"2024-06-04T16:23:08.239291+0000","last_clean_scrub_stamp":"2024-06-04T16:23:08.239291+0000","objects_scrubbed":9,"log_size":48,"log_dups_size":100,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T23:13:35.428234+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27149,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":238,"num_read_kb":318,"num_write":172,"num_write_kb":95,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":23306,"num_omap_keys":60,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":474,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:05.466085+0000","last_change":"2024-06-04T16:23:05.466110+0000","last_active":"2024-06-04T16:23:05.466085+0000","last_peered":"2024-06-04T16:23:05.466085+0000","last_clean":"2024-06-04T16:23:05.466085+0000","last_became_active":"2024-06-04T15:52:44.514269+0000","last_became_peered":"2024-06-04T15:52:44.514269+0000","last_unstale":"2024-06-04T16:23:05.466085+0000","last_undegraded":"2024-06-04T16:23:05.466085+0000","last_fullsized":"2024-06-04T16:23:05.466085+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:23:05.465993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:23:05.465993+0000","last_clean_scrub_stamp":"2024-06-04T16:23:05.465993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T17:36:31.045619+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"254'31","reported_seq":513,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:19.955432+0000","last_change":"2024-06-04T16:23:19.955432+0000","last_active":"2024-06-04T16:23:19.955432+0000","last_peered":"2024-06-04T16:23:19.955432+0000","last_clean":"2024-06-04T16:23:19.955432+0000","last_became_active":"2024-06-04T15:52:46.531977+0000","last_became_peered":"2024-06-04T15:52:46.531977+0000","last_unstale":"2024-06-04T16:23:19.955432+0000","last_undegraded":"2024-06-04T16:23:19.955432+0000","last_fullsized":"2024-06-04T16:23:19.955432+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'31","last_scrub_stamp":"2024-06-04T16:23:19.955313+0000","last_deep_scrub":"254'31","last_deep_scrub_stamp":"2024-06-04T16:23:19.955313+0000","last_clean_scrub_stamp":"2024-06-04T16:23:19.955313+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T20:01:47.795809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":49,"num_write":79,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"254'145","reported_seq":963,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:23.734980+0000","last_change":"2024-06-04T16:23:23.734980+0000","last_active":"2024-06-04T16:23:23.734980+0000","last_peered":"2024-06-04T16:23:23.734980+0000","last_clean":"2024-06-04T16:23:23.734980+0000","last_became_active":"2024-06-04T15:52:38.478362+0000","last_became_peered":"2024-06-04T15:52:38.478362+0000","last_unstale":"2024-06-04T16:23:23.734980+0000","last_undegraded":"2024-06-04T16:23:23.734980+0000","last_fullsized":"2024-06-04T16:23:23.734980+0000","mapping_epoch":23,"log_start":"251'100","ondisk_log_start":"251'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'145","last_scrub_stamp":"2024-06-04T16:23:23.734860+0000","last_deep_scrub":"254'145","last_deep_scrub_stamp":"2024-06-04T16:23:23.734860+0000","last_clean_scrub_stamp":"2024-06-04T16:23:23.734860+0000","objects_scrubbed":1,"log_size":45,"log_dups_size":100,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T02:17:22.450341+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":807,"num_read_kb":748,"num_write":182,"num_write_kb":49,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":505,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:14.325906+0000","last_change":"2024-06-04T16:23:14.325930+0000","last_active":"2024-06-04T16:23:14.325906+0000","last_peered":"2024-06-04T16:23:14.325906+0000","last_clean":"2024-06-04T16:23:14.325906+0000","last_became_active":"2024-06-04T15:52:22.417462+0000","last_became_peered":"2024-06-04T15:52:22.417462+0000","last_unstale":"2024-06-04T16:23:14.325906+0000","last_undegraded":"2024-06-04T16:23:14.325906+0000","last_fullsized":"2024-06-04T16:23:14.325906+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:23:14.325798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:23:14.325798+0000","last_clean_scrub_stamp":"2024-06-04T16:23:14.325798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T23:53:10.001735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"251'43","reported_seq":544,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:23.808637+0000","last_change":"2024-06-04T16:23:23.808637+0000","last_active":"2024-06-04T16:23:23.808637+0000","last_peered":"2024-06-04T16:23:23.808637+0000","last_clean":"2024-06-04T16:23:23.808637+0000","last_became_active":"2024-06-04T15:52:36.497603+0000","last_became_peered":"2024-06-04T15:52:36.497603+0000","last_unstale":"2024-06-04T16:23:23.808637+0000","last_undegraded":"2024-06-04T16:23:23.808637+0000","last_fullsized":"2024-06-04T16:23:23.808637+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"251'43","last_scrub_stamp":"2024-06-04T16:23:23.808498+0000","last_deep_scrub":"251'43","last_deep_scrub_stamp":"2024-06-04T16:23:23.808498+0000","last_clean_scrub_stamp":"2024-06-04T16:23:23.808498+0000","objects_scrubbed":2,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T18:24:13.323796+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1069190,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":32,"num_read_kb":263,"num_write":148,"num_write_kb":16917,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,0],"acting":[4,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":488,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:51.867979+0000","last_change":"2024-06-04T16:22:51.867979+0000","last_active":"2024-06-04T16:22:51.867979+0000","last_peered":"2024-06-04T16:22:51.867979+0000","last_clean":"2024-06-04T16:22:51.867979+0000","last_became_active":"2024-06-04T15:52:40.482529+0000","last_became_peered":"2024-06-04T15:52:40.482529+0000","last_unstale":"2024-06-04T16:22:51.867979+0000","last_undegraded":"2024-06-04T16:22:51.867979+0000","last_fullsized":"2024-06-04T16:22:51.867979+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:22:51.867794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:22:51.867794+0000","last_clean_scrub_stamp":"2024-06-04T16:22:51.867794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T17:42:46.966148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"254'247","reported_seq":928,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:13.866235+0000","last_change":"2024-06-04T16:23:13.866295+0000","last_active":"2024-06-04T16:23:13.866235+0000","last_peered":"2024-06-04T16:23:13.866235+0000","last_clean":"2024-06-04T16:23:13.866235+0000","last_became_active":"2024-06-04T15:52:42.496878+0000","last_became_peered":"2024-06-04T15:52:42.496878+0000","last_unstale":"2024-06-04T16:23:13.866235+0000","last_undegraded":"2024-06-04T16:23:13.866235+0000","last_fullsized":"2024-06-04T16:23:13.866235+0000","mapping_epoch":27,"log_start":"251'200","ondisk_log_start":"251'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'247","last_scrub_stamp":"2024-06-04T16:23:13.866118+0000","last_deep_scrub":"254'247","last_deep_scrub_stamp":"2024-06-04T16:23:13.866118+0000","last_clean_scrub_stamp":"2024-06-04T16:23:13.866118+0000","objects_scrubbed":6,"log_size":47,"log_dups_size":200,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T23:18:27.252241+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30577,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":489,"num_read_kb":691,"num_write":394,"num_write_kb":281,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":89476,"num_omap_keys":214,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":479,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:11.411051+0000","last_change":"2024-06-04T16:23:11.411076+0000","last_active":"2024-06-04T16:23:11.411051+0000","last_peered":"2024-06-04T16:23:11.411051+0000","last_clean":"2024-06-04T16:23:11.411051+0000","last_became_active":"2024-06-04T15:52:44.513726+0000","last_became_peered":"2024-06-04T15:52:44.513726+0000","last_unstale":"2024-06-04T16:23:11.411051+0000","last_undegraded":"2024-06-04T16:23:11.411051+0000","last_fullsized":"2024-06-04T16:23:11.411051+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:23:11.410960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:23:11.410960+0000","last_clean_scrub_stamp":"2024-06-04T16:23:11.410960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T17:49:36.322932+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"254'35","reported_seq":527,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:13.860513+0000","last_change":"2024-06-04T16:23:13.860575+0000","last_active":"2024-06-04T16:23:13.860513+0000","last_peered":"2024-06-04T16:23:13.860513+0000","last_clean":"2024-06-04T16:23:13.860513+0000","last_became_active":"2024-06-04T15:52:46.536184+0000","last_became_peered":"2024-06-04T15:52:46.536184+0000","last_unstale":"2024-06-04T16:23:13.860513+0000","last_undegraded":"2024-06-04T16:23:13.860513+0000","last_fullsized":"2024-06-04T16:23:13.860513+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'35","last_scrub_stamp":"2024-06-04T16:23:13.860386+0000","last_deep_scrub":"254'35","last_deep_scrub_stamp":"2024-06-04T16:23:13.860386+0000","last_clean_scrub_stamp":"2024-06-04T16:23:13.860386+0000","objects_scrubbed":1,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T16:38:56.538838+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":408,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":64,"num_read_kb":61,"num_write":79,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"254'172","reported_seq":983,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:18.205120+0000","last_change":"2024-06-04T16:23:18.205120+0000","last_active":"2024-06-04T16:23:18.205120+0000","last_peered":"2024-06-04T16:23:18.205120+0000","last_clean":"2024-06-04T16:23:18.205120+0000","last_became_active":"2024-06-04T15:52:38.474646+0000","last_became_peered":"2024-06-04T15:52:38.474646+0000","last_unstale":"2024-06-04T16:23:18.205120+0000","last_undegraded":"2024-06-04T16:23:18.205120+0000","last_fullsized":"2024-06-04T16:23:18.205120+0000","mapping_epoch":23,"log_start":"251'100","ondisk_log_start":"251'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'172","last_scrub_stamp":"2024-06-04T16:23:18.205006+0000","last_deep_scrub":"254'172","last_deep_scrub_stamp":"2024-06-04T16:23:18.205006+0000","last_clean_scrub_stamp":"2024-06-04T16:23:18.205006+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":100,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T21:10:26.825707+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":944,"num_read_kb":866,"num_write":217,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":503,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:38.505826+0000","last_change":"2024-06-04T16:23:38.505862+0000","last_active":"2024-06-04T16:23:38.505826+0000","last_peered":"2024-06-04T16:23:38.505826+0000","last_clean":"2024-06-04T16:23:38.505826+0000","last_became_active":"2024-06-04T15:52:22.776779+0000","last_became_peered":"2024-06-04T15:52:22.776779+0000","last_unstale":"2024-06-04T16:23:38.505826+0000","last_undegraded":"2024-06-04T16:23:38.505826+0000","last_fullsized":"2024-06-04T16:23:38.505826+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:23:38.505689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:23:38.505689+0000","last_clean_scrub_stamp":"2024-06-04T16:23:38.505689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T23:36:53.146721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"251'43","reported_seq":549,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:11.801160+0000","last_change":"2024-06-04T16:23:11.801160+0000","last_active":"2024-06-04T16:23:11.801160+0000","last_peered":"2024-06-04T16:23:11.801160+0000","last_clean":"2024-06-04T16:23:11.801160+0000","last_became_active":"2024-06-04T15:52:36.494711+0000","last_became_peered":"2024-06-04T15:52:36.494711+0000","last_unstale":"2024-06-04T16:23:11.801160+0000","last_undegraded":"2024-06-04T16:23:11.801160+0000","last_fullsized":"2024-06-04T16:23:11.801160+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"251'43","last_scrub_stamp":"2024-06-04T16:23:11.801011+0000","last_deep_scrub":"251'43","last_deep_scrub_stamp":"2024-06-04T16:23:11.801011+0000","last_clean_scrub_stamp":"2024-06-04T16:23:11.801011+0000","objects_scrubbed":3,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T03:17:51.288880+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20644,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":32,"num_read_kb":101,"num_write":157,"num_write_kb":20554,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,4],"acting":[0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":486,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:14.949274+0000","last_change":"2024-06-04T16:23:14.949274+0000","last_active":"2024-06-04T16:23:14.949274+0000","last_peered":"2024-06-04T16:23:14.949274+0000","last_clean":"2024-06-04T16:23:14.949274+0000","last_became_active":"2024-06-04T15:52:40.484698+0000","last_became_peered":"2024-06-04T15:52:40.484698+0000","last_unstale":"2024-06-04T16:23:14.949274+0000","last_undegraded":"2024-06-04T16:23:14.949274+0000","last_fullsized":"2024-06-04T16:23:14.949274+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:23:14.949147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:23:14.949147+0000","last_clean_scrub_stamp":"2024-06-04T16:23:14.949147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T22:36:57.311927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"254'90","reported_seq":606,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:36.365331+0000","last_change":"2024-06-04T16:23:36.365363+0000","last_active":"2024-06-04T16:23:36.365331+0000","last_peered":"2024-06-04T16:23:36.365331+0000","last_clean":"2024-06-04T16:23:36.365331+0000","last_became_active":"2024-06-04T15:52:42.500646+0000","last_became_peered":"2024-06-04T15:52:42.500646+0000","last_unstale":"2024-06-04T16:23:36.365331+0000","last_undegraded":"2024-06-04T16:23:36.365331+0000","last_fullsized":"2024-06-04T16:23:36.365331+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'90","last_scrub_stamp":"2024-06-04T16:23:36.365234+0000","last_deep_scrub":"254'90","last_deep_scrub_stamp":"2024-06-04T16:23:36.365234+0000","last_clean_scrub_stamp":"2024-06-04T16:23:36.365234+0000","objects_scrubbed":7,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T17:09:17.198066+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":102,"num_read_kb":94,"num_write":72,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1636,"num_omap_keys":4,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":476,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:03.864415+0000","last_change":"2024-06-04T16:23:03.864415+0000","last_active":"2024-06-04T16:23:03.864415+0000","last_peered":"2024-06-04T16:23:03.864415+0000","last_clean":"2024-06-04T16:23:03.864415+0000","last_became_active":"2024-06-04T15:52:44.520841+0000","last_became_peered":"2024-06-04T15:52:44.520841+0000","last_unstale":"2024-06-04T16:23:03.864415+0000","last_undegraded":"2024-06-04T16:23:03.864415+0000","last_fullsized":"2024-06-04T16:23:03.864415+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:23:03.864261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:23:03.864261+0000","last_clean_scrub_stamp":"2024-06-04T16:23:03.864261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T18:09:32.795774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"251'34","reported_seq":544,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:51.136365+0000","last_change":"2024-06-04T16:22:51.136365+0000","last_active":"2024-06-04T16:22:51.136365+0000","last_peered":"2024-06-04T16:22:51.136365+0000","last_clean":"2024-06-04T16:22:51.136365+0000","last_became_active":"2024-06-04T15:52:46.539931+0000","last_became_peered":"2024-06-04T15:52:46.539931+0000","last_unstale":"2024-06-04T16:22:51.136365+0000","last_undegraded":"2024-06-04T16:22:51.136365+0000","last_fullsized":"2024-06-04T16:22:51.136365+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"251'34","last_scrub_stamp":"2024-06-04T16:22:51.136181+0000","last_deep_scrub":"251'34","last_deep_scrub_stamp":"2024-06-04T16:22:51.136181+0000","last_clean_scrub_stamp":"2024-06-04T16:22:51.136181+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T19:05:15.366957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":127,"num_read_kb":111,"num_write":92,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"254'121","reported_seq":1040,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:03.065206+0000","last_change":"2024-06-04T16:23:03.065255+0000","last_active":"2024-06-04T16:23:03.065206+0000","last_peered":"2024-06-04T16:23:03.065206+0000","last_clean":"2024-06-04T16:23:03.065206+0000","last_became_active":"2024-06-04T15:52:38.485755+0000","last_became_peered":"2024-06-04T15:52:38.485755+0000","last_unstale":"2024-06-04T16:23:03.065206+0000","last_undegraded":"2024-06-04T16:23:03.065206+0000","last_fullsized":"2024-06-04T16:23:03.065206+0000","mapping_epoch":23,"log_start":"254'100","ondisk_log_start":"254'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'121","last_scrub_stamp":"2024-06-04T16:23:03.065085+0000","last_deep_scrub":"254'121","last_deep_scrub_stamp":"2024-06-04T16:23:03.065085+0000","last_clean_scrub_stamp":"2024-06-04T16:23:03.065085+0000","objects_scrubbed":2,"log_size":21,"log_dups_size":100,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T17:34:01.981275+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":989,"num_read_kb":963,"num_write":137,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2286,"num_omap_keys":9,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":505,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:05.784811+0000","last_change":"2024-06-04T16:23:05.784811+0000","last_active":"2024-06-04T16:23:05.784811+0000","last_peered":"2024-06-04T16:23:05.784811+0000","last_clean":"2024-06-04T16:23:05.784811+0000","last_became_active":"2024-06-04T15:52:22.422971+0000","last_became_peered":"2024-06-04T15:52:22.422971+0000","last_unstale":"2024-06-04T16:23:05.784811+0000","last_undegraded":"2024-06-04T16:23:05.784811+0000","last_fullsized":"2024-06-04T16:23:05.784811+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:23:05.784635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:23:05.784635+0000","last_clean_scrub_stamp":"2024-06-04T16:23:05.784635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T04:21:46.950261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"254'72","reported_seq":621,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:33.398029+0000","last_change":"2024-06-04T16:23:33.398097+0000","last_active":"2024-06-04T16:23:33.398029+0000","last_peered":"2024-06-04T16:23:33.398029+0000","last_clean":"2024-06-04T16:23:33.398029+0000","last_became_active":"2024-06-04T15:52:36.485475+0000","last_became_peered":"2024-06-04T15:52:36.485475+0000","last_unstale":"2024-06-04T16:23:33.398029+0000","last_undegraded":"2024-06-04T16:23:33.398029+0000","last_fullsized":"2024-06-04T16:23:33.398029+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'72","last_scrub_stamp":"2024-06-04T16:23:33.397930+0000","last_deep_scrub":"254'72","last_deep_scrub_stamp":"2024-06-04T16:23:33.397930+0000","last_clean_scrub_stamp":"2024-06-04T16:23:33.397930+0000","objects_scrubbed":5,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T18:20:24.491750+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":109,"num_read_kb":62832,"num_write":269,"num_write_kb":45136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,2],"acting":[5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"254'2","reported_seq":487,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:10.995937+0000","last_change":"2024-06-04T16:23:10.995968+0000","last_active":"2024-06-04T16:23:10.995937+0000","last_peered":"2024-06-04T16:23:10.995937+0000","last_clean":"2024-06-04T16:23:10.995937+0000","last_became_active":"2024-06-04T15:52:40.486003+0000","last_became_peered":"2024-06-04T15:52:40.486003+0000","last_unstale":"2024-06-04T16:23:10.995937+0000","last_undegraded":"2024-06-04T16:23:10.995937+0000","last_fullsized":"2024-06-04T16:23:10.995937+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'2","last_scrub_stamp":"2024-06-04T16:23:10.995821+0000","last_deep_scrub":"254'2","last_deep_scrub_stamp":"2024-06-04T16:23:10.995821+0000","last_clean_scrub_stamp":"2024-06-04T16:23:10.995821+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T18:23:07.156912+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"254'124","reported_seq":1008,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:57.787246+0000","last_change":"2024-06-04T16:22:57.787246+0000","last_active":"2024-06-04T16:22:57.787246+0000","last_peered":"2024-06-04T16:22:57.787246+0000","last_clean":"2024-06-04T16:22:57.787246+0000","last_became_active":"2024-06-04T15:52:42.505250+0000","last_became_peered":"2024-06-04T15:52:42.505250+0000","last_unstale":"2024-06-04T16:22:57.787246+0000","last_undegraded":"2024-06-04T16:22:57.787246+0000","last_fullsized":"2024-06-04T16:22:57.787246+0000","mapping_epoch":27,"log_start":"251'100","ondisk_log_start":"251'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'124","last_scrub_stamp":"2024-06-04T16:22:57.787100+0000","last_deep_scrub":"254'124","last_deep_scrub_stamp":"2024-06-04T16:22:57.787100+0000","last_clean_scrub_stamp":"2024-06-04T16:22:57.787100+0000","objects_scrubbed":8,"log_size":24,"log_dups_size":100,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T22:01:32.859318+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":113,"num_read_kb":103,"num_write":67,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":478,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:51.009109+0000","last_change":"2024-06-04T16:22:51.009109+0000","last_active":"2024-06-04T16:22:51.009109+0000","last_peered":"2024-06-04T16:22:51.009109+0000","last_clean":"2024-06-04T16:22:51.009109+0000","last_became_active":"2024-06-04T15:52:44.522168+0000","last_became_peered":"2024-06-04T15:52:44.522168+0000","last_unstale":"2024-06-04T16:22:51.009109+0000","last_undegraded":"2024-06-04T16:22:51.009109+0000","last_fullsized":"2024-06-04T16:22:51.009109+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:22:51.008969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:22:51.008969+0000","last_clean_scrub_stamp":"2024-06-04T16:22:51.008969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T17:53:46.600382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.b","version":"254'112","reported_seq":611,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:46.992773+0000","last_change":"2024-06-04T16:22:46.992832+0000","last_active":"2024-06-04T16:22:46.992773+0000","last_peered":"2024-06-04T16:22:46.992773+0000","last_clean":"2024-06-04T16:22:46.992773+0000","last_became_active":"2024-06-04T15:52:46.537377+0000","last_became_peered":"2024-06-04T15:52:46.537377+0000","last_unstale":"2024-06-04T16:22:46.992773+0000","last_undegraded":"2024-06-04T16:22:46.992773+0000","last_fullsized":"2024-06-04T16:22:46.992773+0000","mapping_epoch":31,"log_start":"251'100","ondisk_log_start":"251'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'112","last_scrub_stamp":"2024-06-04T16:22:46.992648+0000","last_deep_scrub":"254'112","last_deep_scrub_stamp":"2024-06-04T16:22:46.992648+0000","last_clean_scrub_stamp":"2024-06-04T16:22:46.992648+0000","objects_scrubbed":1,"log_size":12,"log_dups_size":100,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T19:14:15.808220+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":232,"num_read_kb":256,"num_write":227,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":851,"num_omap_keys":5,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.6","version":"254'76","reported_seq":777,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:12.378772+0000","last_change":"2024-06-04T16:23:12.378804+0000","last_active":"2024-06-04T16:23:12.378772+0000","last_peered":"2024-06-04T16:23:12.378772+0000","last_clean":"2024-06-04T16:23:12.378772+0000","last_became_active":"2024-06-04T15:52:38.487359+0000","last_became_peered":"2024-06-04T15:52:38.487359+0000","last_unstale":"2024-06-04T16:23:12.378772+0000","last_undegraded":"2024-06-04T16:23:12.378772+0000","last_fullsized":"2024-06-04T16:23:12.378772+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'76","last_scrub_stamp":"2024-06-04T16:23:12.378681+0000","last_deep_scrub":"254'76","last_deep_scrub_stamp":"2024-06-04T16:23:12.378681+0000","last_clean_scrub_stamp":"2024-06-04T16:23:12.378681+0000","objects_scrubbed":2,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T23:38:54.261802+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":431,"num_read_kb":414,"num_write":84,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":504,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:17.888839+0000","last_change":"2024-06-04T16:23:17.888839+0000","last_active":"2024-06-04T16:23:17.888839+0000","last_peered":"2024-06-04T16:23:17.888839+0000","last_clean":"2024-06-04T16:23:17.888839+0000","last_became_active":"2024-06-04T15:52:22.423712+0000","last_became_peered":"2024-06-04T15:52:22.423712+0000","last_unstale":"2024-06-04T16:23:17.888839+0000","last_undegraded":"2024-06-04T16:23:17.888839+0000","last_fullsized":"2024-06-04T16:23:17.888839+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:23:17.888685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:23:17.888685+0000","last_clean_scrub_stamp":"2024-06-04T16:23:17.888685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T00:03:32.023669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"254'74","reported_seq":595,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:36.563755+0000","last_change":"2024-06-04T16:23:36.563792+0000","last_active":"2024-06-04T16:23:36.563755+0000","last_peered":"2024-06-04T16:23:36.563755+0000","last_clean":"2024-06-04T16:23:36.563755+0000","last_became_active":"2024-06-04T15:52:22.428356+0000","last_became_peered":"2024-06-04T15:52:22.428356+0000","last_unstale":"2024-06-04T16:23:36.563755+0000","last_undegraded":"2024-06-04T16:23:36.563755+0000","last_fullsized":"2024-06-04T16:23:36.563755+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'74","last_scrub_stamp":"2024-06-04T16:23:36.563665+0000","last_deep_scrub":"254'74","last_deep_scrub_stamp":"2024-06-04T16:23:36.563665+0000","last_clean_scrub_stamp":"2024-06-04T16:23:36.563665+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T17:34:14.987751+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"254'72","reported_seq":590,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:15.095428+0000","last_change":"2024-06-04T16:23:15.095428+0000","last_active":"2024-06-04T16:23:15.095428+0000","last_peered":"2024-06-04T16:23:15.095428+0000","last_clean":"2024-06-04T16:23:15.095428+0000","last_became_active":"2024-06-04T15:52:36.488567+0000","last_became_peered":"2024-06-04T15:52:36.488567+0000","last_unstale":"2024-06-04T16:23:15.095428+0000","last_undegraded":"2024-06-04T16:23:15.095428+0000","last_fullsized":"2024-06-04T16:23:15.095428+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'72","last_scrub_stamp":"2024-06-04T16:23:15.095275+0000","last_deep_scrub":"254'72","last_deep_scrub_stamp":"2024-06-04T16:23:15.095275+0000","last_clean_scrub_stamp":"2024-06-04T16:23:15.095275+0000","objects_scrubbed":5,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T20:29:53.277016+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133705,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":100,"num_read_kb":15171,"num_write":323,"num_write_kb":30782,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,4],"acting":[6,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":484,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:44.650735+0000","last_change":"2024-06-04T16:23:44.650760+0000","last_active":"2024-06-04T16:23:44.650735+0000","last_peered":"2024-06-04T16:23:44.650735+0000","last_clean":"2024-06-04T16:23:44.650735+0000","last_became_active":"2024-06-04T15:52:40.479168+0000","last_became_peered":"2024-06-04T15:52:40.479168+0000","last_unstale":"2024-06-04T16:23:44.650735+0000","last_undegraded":"2024-06-04T16:23:44.650735+0000","last_fullsized":"2024-06-04T16:23:44.650735+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:23:44.650641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:23:44.650641+0000","last_clean_scrub_stamp":"2024-06-04T16:23:44.650641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T20:28:38.926971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"254'567","reported_seq":1754,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:06.058359+0000","last_change":"2024-06-04T16:23:06.058359+0000","last_active":"2024-06-04T16:23:06.058359+0000","last_peered":"2024-06-04T16:23:06.058359+0000","last_clean":"2024-06-04T16:23:06.058359+0000","last_became_active":"2024-06-04T15:52:42.503178+0000","last_became_peered":"2024-06-04T15:52:42.503178+0000","last_unstale":"2024-06-04T16:23:06.058359+0000","last_undegraded":"2024-06-04T16:23:06.058359+0000","last_fullsized":"2024-06-04T16:23:06.058359+0000","mapping_epoch":27,"log_start":"251'500","ondisk_log_start":"251'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'567","last_scrub_stamp":"2024-06-04T16:23:06.058220+0000","last_deep_scrub":"254'567","last_deep_scrub_stamp":"2024-06-04T16:23:06.058220+0000","last_clean_scrub_stamp":"2024-06-04T16:23:06.058220+0000","objects_scrubbed":11,"log_size":67,"log_dups_size":500,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T22:58:35.190155+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29662,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":838,"num_read_kb":1049,"num_write":188,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":300,"num_omap_keys":2,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":477,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:01.876775+0000","last_change":"2024-06-04T16:23:01.876775+0000","last_active":"2024-06-04T16:23:01.876775+0000","last_peered":"2024-06-04T16:23:01.876775+0000","last_clean":"2024-06-04T16:23:01.876775+0000","last_became_active":"2024-06-04T15:52:44.522475+0000","last_became_peered":"2024-06-04T15:52:44.522475+0000","last_unstale":"2024-06-04T16:23:01.876775+0000","last_undegraded":"2024-06-04T16:23:01.876775+0000","last_fullsized":"2024-06-04T16:23:01.876775+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:23:01.876659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:23:01.876659+0000","last_clean_scrub_stamp":"2024-06-04T16:23:01.876659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T18:04:59.431933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"254'73","reported_seq":568,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:59.496703+0000","last_change":"2024-06-04T16:22:59.496703+0000","last_active":"2024-06-04T16:22:59.496703+0000","last_peered":"2024-06-04T16:22:59.496703+0000","last_clean":"2024-06-04T16:22:59.496703+0000","last_became_active":"2024-06-04T15:52:46.541851+0000","last_became_peered":"2024-06-04T15:52:46.541851+0000","last_unstale":"2024-06-04T16:22:59.496703+0000","last_undegraded":"2024-06-04T16:22:59.496703+0000","last_fullsized":"2024-06-04T16:22:59.496703+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'73","last_scrub_stamp":"2024-06-04T16:22:59.496568+0000","last_deep_scrub":"254'73","last_deep_scrub_stamp":"2024-06-04T16:22:59.496568+0000","last_clean_scrub_stamp":"2024-06-04T16:22:59.496568+0000","objects_scrubbed":2,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T03:49:46.316753+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":147,"num_read_kb":147,"num_write":159,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1","version":"254'115","reported_seq":822,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:02.473738+0000","last_change":"2024-06-04T16:23:02.473738+0000","last_active":"2024-06-04T16:23:02.473738+0000","last_peered":"2024-06-04T16:23:02.473738+0000","last_clean":"2024-06-04T16:23:02.473738+0000","last_became_active":"2024-06-04T15:52:38.485314+0000","last_became_peered":"2024-06-04T15:52:38.485314+0000","last_unstale":"2024-06-04T16:23:02.473738+0000","last_undegraded":"2024-06-04T16:23:02.473738+0000","last_fullsized":"2024-06-04T16:23:02.473738+0000","mapping_epoch":23,"log_start":"251'100","ondisk_log_start":"251'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'115","last_scrub_stamp":"2024-06-04T16:23:02.473618+0000","last_deep_scrub":"254'115","last_deep_scrub_stamp":"2024-06-04T16:23:02.473618+0000","last_clean_scrub_stamp":"2024-06-04T16:23:02.473618+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":100,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T21:11:06.521739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":554,"num_read_kb":505,"num_write":149,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"251'78","reported_seq":597,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:20.783370+0000","last_change":"2024-06-04T16:23:20.783456+0000","last_active":"2024-06-04T16:23:20.783370+0000","last_peered":"2024-06-04T16:23:20.783370+0000","last_clean":"2024-06-04T16:23:20.783370+0000","last_became_active":"2024-06-04T15:52:36.478729+0000","last_became_peered":"2024-06-04T15:52:36.478729+0000","last_unstale":"2024-06-04T16:23:20.783370+0000","last_undegraded":"2024-06-04T16:23:20.783370+0000","last_fullsized":"2024-06-04T16:23:20.783370+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"251'78","last_scrub_stamp":"2024-06-04T16:23:20.783257+0000","last_deep_scrub":"251'78","last_deep_scrub_stamp":"2024-06-04T16:23:20.783257+0000","last_clean_scrub_stamp":"2024-06-04T16:23:20.783257+0000","objects_scrubbed":7,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T22:56:09.007093+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6659325,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":108,"num_read_kb":2222,"num_write":295,"num_write_kb":32111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,1],"acting":[4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":504,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:21.932637+0000","last_change":"2024-06-04T16:23:21.932637+0000","last_active":"2024-06-04T16:23:21.932637+0000","last_peered":"2024-06-04T16:23:21.932637+0000","last_clean":"2024-06-04T16:23:21.932637+0000","last_became_active":"2024-06-04T15:52:22.428894+0000","last_became_peered":"2024-06-04T15:52:22.428894+0000","last_unstale":"2024-06-04T16:23:21.932637+0000","last_undegraded":"2024-06-04T16:23:21.932637+0000","last_fullsized":"2024-06-04T16:23:21.932637+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:23:21.932495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:23:21.932495+0000","last_clean_scrub_stamp":"2024-06-04T16:23:21.932495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T02:09:01.019445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":486,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:04.014754+0000","last_change":"2024-06-04T16:23:04.014781+0000","last_active":"2024-06-04T16:23:04.014754+0000","last_peered":"2024-06-04T16:23:04.014754+0000","last_clean":"2024-06-04T16:23:04.014754+0000","last_became_active":"2024-06-04T15:52:40.478970+0000","last_became_peered":"2024-06-04T15:52:40.478970+0000","last_unstale":"2024-06-04T16:23:04.014754+0000","last_undegraded":"2024-06-04T16:23:04.014754+0000","last_fullsized":"2024-06-04T16:23:04.014754+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:23:04.014648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:23:04.014648+0000","last_clean_scrub_stamp":"2024-06-04T16:23:04.014648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T00:47:22.385623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"254'260","reported_seq":954,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:59.781790+0000","last_change":"2024-06-04T16:22:59.781790+0000","last_active":"2024-06-04T16:22:59.781790+0000","last_peered":"2024-06-04T16:22:59.781790+0000","last_clean":"2024-06-04T16:22:59.781790+0000","last_became_active":"2024-06-04T15:52:42.504735+0000","last_became_peered":"2024-06-04T15:52:42.504735+0000","last_unstale":"2024-06-04T16:22:59.781790+0000","last_undegraded":"2024-06-04T16:22:59.781790+0000","last_fullsized":"2024-06-04T16:22:59.781790+0000","mapping_epoch":27,"log_start":"251'200","ondisk_log_start":"251'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'260","last_scrub_stamp":"2024-06-04T16:22:59.781648+0000","last_deep_scrub":"254'260","last_deep_scrub_stamp":"2024-06-04T16:22:59.781648+0000","last_clean_scrub_stamp":"2024-06-04T16:22:59.781648+0000","objects_scrubbed":8,"log_size":60,"log_dups_size":200,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T20:43:24.750395+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20543,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":406,"num_read_kb":567,"num_write":188,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":478,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:50.024418+0000","last_change":"2024-06-04T16:22:50.024418+0000","last_active":"2024-06-04T16:22:50.024418+0000","last_peered":"2024-06-04T16:22:50.024418+0000","last_clean":"2024-06-04T16:22:50.024418+0000","last_became_active":"2024-06-04T15:52:44.522746+0000","last_became_peered":"2024-06-04T15:52:44.522746+0000","last_unstale":"2024-06-04T16:22:50.024418+0000","last_undegraded":"2024-06-04T16:22:50.024418+0000","last_fullsized":"2024-06-04T16:22:50.024418+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:22:50.024298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:22:50.024298+0000","last_clean_scrub_stamp":"2024-06-04T16:22:50.024298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T19:45:37.463155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.d","version":"254'30","reported_seq":511,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:56.543517+0000","last_change":"2024-06-04T16:22:56.543557+0000","last_active":"2024-06-04T16:22:56.543517+0000","last_peered":"2024-06-04T16:22:56.543517+0000","last_clean":"2024-06-04T16:22:56.543517+0000","last_became_active":"2024-06-04T15:52:46.530480+0000","last_became_peered":"2024-06-04T15:52:46.530480+0000","last_unstale":"2024-06-04T16:22:56.543517+0000","last_undegraded":"2024-06-04T16:22:56.543517+0000","last_fullsized":"2024-06-04T16:22:56.543517+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'30","last_scrub_stamp":"2024-06-04T16:22:56.543418+0000","last_deep_scrub":"254'30","last_deep_scrub_stamp":"2024-06-04T16:22:56.543418+0000","last_clean_scrub_stamp":"2024-06-04T16:22:56.543418+0000","objects_scrubbed":4,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T22:30:49.547884+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":260,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":42,"num_read_kb":31,"num_write":58,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"254'175","reported_seq":1014,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:07.031511+0000","last_change":"2024-06-04T16:23:07.031557+0000","last_active":"2024-06-04T16:23:07.031511+0000","last_peered":"2024-06-04T16:23:07.031511+0000","last_clean":"2024-06-04T16:23:07.031511+0000","last_became_active":"2024-06-04T15:52:38.484384+0000","last_became_peered":"2024-06-04T15:52:38.484384+0000","last_unstale":"2024-06-04T16:23:07.031511+0000","last_undegraded":"2024-06-04T16:23:07.031511+0000","last_fullsized":"2024-06-04T16:23:07.031511+0000","mapping_epoch":23,"log_start":"251'100","ondisk_log_start":"251'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'175","last_scrub_stamp":"2024-06-04T16:23:07.031386+0000","last_deep_scrub":"254'175","last_deep_scrub_stamp":"2024-06-04T16:23:07.031386+0000","last_clean_scrub_stamp":"2024-06-04T16:23:07.031386+0000","objects_scrubbed":2,"log_size":75,"log_dups_size":100,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T20:37:48.413121+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":881,"num_read_kb":808,"num_write":233,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"251'46","reported_seq":553,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:19.818127+0000","last_change":"2024-06-04T16:23:19.818176+0000","last_active":"2024-06-04T16:23:19.818127+0000","last_peered":"2024-06-04T16:23:19.818127+0000","last_clean":"2024-06-04T16:23:19.818127+0000","last_became_active":"2024-06-04T15:52:36.477622+0000","last_became_peered":"2024-06-04T15:52:36.477622+0000","last_unstale":"2024-06-04T16:23:19.818127+0000","last_undegraded":"2024-06-04T16:23:19.818127+0000","last_fullsized":"2024-06-04T16:23:19.818127+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"251'46","last_scrub_stamp":"2024-06-04T16:23:19.818027+0000","last_deep_scrub":"251'46","last_deep_scrub_stamp":"2024-06-04T16:23:19.818027+0000","last_clean_scrub_stamp":"2024-06-04T16:23:19.818027+0000","objects_scrubbed":2,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T01:44:44.151511+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":45,"num_write":152,"num_write_kb":28742,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":502,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:13.531852+0000","last_change":"2024-06-04T16:23:13.531852+0000","last_active":"2024-06-04T16:23:13.531852+0000","last_peered":"2024-06-04T16:23:13.531852+0000","last_clean":"2024-06-04T16:23:13.531852+0000","last_became_active":"2024-06-04T15:52:22.776744+0000","last_became_peered":"2024-06-04T15:52:22.776744+0000","last_unstale":"2024-06-04T16:23:13.531852+0000","last_undegraded":"2024-06-04T16:23:13.531852+0000","last_fullsized":"2024-06-04T16:23:13.531852+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:23:13.531727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:23:13.531727+0000","last_clean_scrub_stamp":"2024-06-04T16:23:13.531727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T02:54:14.681403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":485,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:17.765013+0000","last_change":"2024-06-04T16:23:17.765013+0000","last_active":"2024-06-04T16:23:17.765013+0000","last_peered":"2024-06-04T16:23:17.765013+0000","last_clean":"2024-06-04T16:23:17.765013+0000","last_became_active":"2024-06-04T15:52:40.479319+0000","last_became_peered":"2024-06-04T15:52:40.479319+0000","last_unstale":"2024-06-04T16:23:17.765013+0000","last_undegraded":"2024-06-04T16:23:17.765013+0000","last_fullsized":"2024-06-04T16:23:17.765013+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:23:17.764897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:23:17.764897+0000","last_clean_scrub_stamp":"2024-06-04T16:23:17.764897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T03:01:34.933351+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"254'71","reported_seq":582,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:08.851129+0000","last_change":"2024-06-04T16:23:08.851129+0000","last_active":"2024-06-04T16:23:08.851129+0000","last_peered":"2024-06-04T16:23:08.851129+0000","last_clean":"2024-06-04T16:23:08.851129+0000","last_became_active":"2024-06-04T15:52:42.500141+0000","last_became_peered":"2024-06-04T15:52:42.500141+0000","last_unstale":"2024-06-04T16:23:08.851129+0000","last_undegraded":"2024-06-04T16:23:08.851129+0000","last_fullsized":"2024-06-04T16:23:08.851129+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'71","last_scrub_stamp":"2024-06-04T16:23:08.851023+0000","last_deep_scrub":"254'71","last_deep_scrub_stamp":"2024-06-04T16:23:08.851023+0000","last_clean_scrub_stamp":"2024-06-04T16:23:08.851023+0000","objects_scrubbed":5,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T17:00:06.961504+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":90,"num_read_kb":83,"num_write":60,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"254'479","reported_seq":1484,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:09.402109+0000","last_change":"2024-06-04T16:23:09.402109+0000","last_active":"2024-06-04T16:23:09.402109+0000","last_peered":"2024-06-04T16:23:09.402109+0000","last_clean":"2024-06-04T16:23:09.402109+0000","last_became_active":"2024-06-04T15:52:44.517202+0000","last_became_peered":"2024-06-04T15:52:44.517202+0000","last_unstale":"2024-06-04T16:23:09.402109+0000","last_undegraded":"2024-06-04T16:23:09.402109+0000","last_fullsized":"2024-06-04T16:23:09.402109+0000","mapping_epoch":29,"log_start":"251'400","ondisk_log_start":"251'400","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'479","last_scrub_stamp":"2024-06-04T16:23:09.401953+0000","last_deep_scrub":"254'479","last_deep_scrub_stamp":"2024-06-04T16:23:09.401953+0000","last_clean_scrub_stamp":"2024-06-04T16:23:09.401953+0000","objects_scrubbed":1,"log_size":79,"log_dups_size":400,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T02:11:03.216134+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.c","version":"254'27","reported_seq":504,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:01.472577+0000","last_change":"2024-06-04T16:23:01.472605+0000","last_active":"2024-06-04T16:23:01.472577+0000","last_peered":"2024-06-04T16:23:01.472577+0000","last_clean":"2024-06-04T16:23:01.472577+0000","last_became_active":"2024-06-04T15:52:46.538975+0000","last_became_peered":"2024-06-04T15:52:46.538975+0000","last_unstale":"2024-06-04T16:23:01.472577+0000","last_undegraded":"2024-06-04T16:23:01.472577+0000","last_fullsized":"2024-06-04T16:23:01.472577+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'27","last_scrub_stamp":"2024-06-04T16:23:01.472476+0000","last_deep_scrub":"254'27","last_deep_scrub_stamp":"2024-06-04T16:23:01.472476+0000","last_clean_scrub_stamp":"2024-06-04T16:23:01.472476+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T19:18:35.432866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":27,"num_write":64,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3","version":"254'180","reported_seq":1076,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:05.040749+0000","last_change":"2024-06-04T16:23:05.040749+0000","last_active":"2024-06-04T16:23:05.040749+0000","last_peered":"2024-06-04T16:23:05.040749+0000","last_clean":"2024-06-04T16:23:05.040749+0000","last_became_active":"2024-06-04T15:52:38.482240+0000","last_became_peered":"2024-06-04T15:52:38.482240+0000","last_unstale":"2024-06-04T16:23:05.040749+0000","last_undegraded":"2024-06-04T16:23:05.040749+0000","last_fullsized":"2024-06-04T16:23:05.040749+0000","mapping_epoch":23,"log_start":"251'100","ondisk_log_start":"251'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'180","last_scrub_stamp":"2024-06-04T16:23:05.040592+0000","last_deep_scrub":"254'180","last_deep_scrub_stamp":"2024-06-04T16:23:05.040592+0000","last_clean_scrub_stamp":"2024-06-04T16:23:05.040592+0000","objects_scrubbed":1,"log_size":80,"log_dups_size":100,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T23:58:37.248398+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1045,"num_read_kb":968,"num_write":230,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2044,"num_omap_keys":8,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"251'34","reported_seq":534,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:12.049996+0000","last_change":"2024-06-04T16:23:12.049996+0000","last_active":"2024-06-04T16:23:12.049996+0000","last_peered":"2024-06-04T16:23:12.049996+0000","last_clean":"2024-06-04T16:23:12.049996+0000","last_became_active":"2024-06-04T15:52:36.478441+0000","last_became_peered":"2024-06-04T15:52:36.478441+0000","last_unstale":"2024-06-04T16:23:12.049996+0000","last_undegraded":"2024-06-04T16:23:12.049996+0000","last_fullsized":"2024-06-04T16:23:12.049996+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"251'34","last_scrub_stamp":"2024-06-04T16:23:12.049852+0000","last_deep_scrub":"251'34","last_deep_scrub_stamp":"2024-06-04T16:23:12.049852+0000","last_clean_scrub_stamp":"2024-06-04T16:23:12.049852+0000","objects_scrubbed":1,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T20:47:21.445706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":32,"num_read_kb":7500,"num_write":131,"num_write_kb":23723,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,4],"acting":[6,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":502,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:37.549399+0000","last_change":"2024-06-04T16:23:37.549444+0000","last_active":"2024-06-04T16:23:37.549399+0000","last_peered":"2024-06-04T16:23:37.549399+0000","last_clean":"2024-06-04T16:23:37.549399+0000","last_became_active":"2024-06-04T15:52:22.776729+0000","last_became_peered":"2024-06-04T15:52:22.776729+0000","last_unstale":"2024-06-04T16:23:37.549399+0000","last_undegraded":"2024-06-04T16:23:37.549399+0000","last_fullsized":"2024-06-04T16:23:37.549399+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:23:37.549289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:23:37.549289+0000","last_clean_scrub_stamp":"2024-06-04T16:23:37.549289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T22:30:21.936404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":488,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:49.871915+0000","last_change":"2024-06-04T16:22:49.871915+0000","last_active":"2024-06-04T16:22:49.871915+0000","last_peered":"2024-06-04T16:22:49.871915+0000","last_clean":"2024-06-04T16:22:49.871915+0000","last_became_active":"2024-06-04T15:52:40.481870+0000","last_became_peered":"2024-06-04T15:52:40.481870+0000","last_unstale":"2024-06-04T16:22:49.871915+0000","last_undegraded":"2024-06-04T16:22:49.871915+0000","last_fullsized":"2024-06-04T16:22:49.871915+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:22:49.871770+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:22:49.871770+0000","last_clean_scrub_stamp":"2024-06-04T16:22:49.871770+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T03:25:40.274941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"254'107","reported_seq":636,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:00.026083+0000","last_change":"2024-06-04T16:23:00.026083+0000","last_active":"2024-06-04T16:23:00.026083+0000","last_peered":"2024-06-04T16:23:00.026083+0000","last_clean":"2024-06-04T16:23:00.026083+0000","last_became_active":"2024-06-04T15:52:42.501708+0000","last_became_peered":"2024-06-04T15:52:42.501708+0000","last_unstale":"2024-06-04T16:23:00.026083+0000","last_undegraded":"2024-06-04T16:23:00.026083+0000","last_fullsized":"2024-06-04T16:23:00.026083+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'107","last_scrub_stamp":"2024-06-04T16:23:00.025948+0000","last_deep_scrub":"254'107","last_deep_scrub_stamp":"2024-06-04T16:23:00.025948+0000","last_clean_scrub_stamp":"2024-06-04T16:23:00.025948+0000","objects_scrubbed":8,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T18:12:41.006932+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":147,"num_read_kb":140,"num_write":98,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":330,"num_omap_keys":2,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.0","version":"254'471","reported_seq":1659,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:22.395221+0000","last_change":"2024-06-04T16:23:22.395256+0000","last_active":"2024-06-04T16:23:22.395221+0000","last_peered":"2024-06-04T16:23:22.395221+0000","last_clean":"2024-06-04T16:23:22.395221+0000","last_became_active":"2024-06-04T15:52:44.517066+0000","last_became_peered":"2024-06-04T15:52:44.517066+0000","last_unstale":"2024-06-04T16:23:22.395221+0000","last_undegraded":"2024-06-04T16:23:22.395221+0000","last_fullsized":"2024-06-04T16:23:22.395221+0000","mapping_epoch":29,"log_start":"251'400","ondisk_log_start":"251'400","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'471","last_scrub_stamp":"2024-06-04T16:23:22.395095+0000","last_deep_scrub":"254'471","last_deep_scrub_stamp":"2024-06-04T16:23:22.395095+0000","last_clean_scrub_stamp":"2024-06-04T16:23:22.395095+0000","objects_scrubbed":1,"log_size":71,"log_dups_size":400,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T02:14:58.949166+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"254'29","reported_seq":504,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:17.959292+0000","last_change":"2024-06-04T16:23:17.959328+0000","last_active":"2024-06-04T16:23:17.959292+0000","last_peered":"2024-06-04T16:23:17.959292+0000","last_clean":"2024-06-04T16:23:17.959292+0000","last_became_active":"2024-06-04T15:52:46.531967+0000","last_became_peered":"2024-06-04T15:52:46.531967+0000","last_unstale":"2024-06-04T16:23:17.959292+0000","last_undegraded":"2024-06-04T16:23:17.959292+0000","last_fullsized":"2024-06-04T16:23:17.959292+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'29","last_scrub_stamp":"2024-06-04T16:23:17.959201+0000","last_deep_scrub":"254'29","last_deep_scrub_stamp":"2024-06-04T16:23:17.959201+0000","last_clean_scrub_stamp":"2024-06-04T16:23:17.959201+0000","objects_scrubbed":2,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T21:13:41.813947+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":905,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":28,"num_read_kb":26,"num_write":64,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2","version":"254'131","reported_seq":940,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:11.028292+0000","last_change":"2024-06-04T16:23:11.028292+0000","last_active":"2024-06-04T16:23:11.028292+0000","last_peered":"2024-06-04T16:23:11.028292+0000","last_clean":"2024-06-04T16:23:11.028292+0000","last_became_active":"2024-06-04T15:52:38.480942+0000","last_became_peered":"2024-06-04T15:52:38.480942+0000","last_unstale":"2024-06-04T16:23:11.028292+0000","last_undegraded":"2024-06-04T16:23:11.028292+0000","last_fullsized":"2024-06-04T16:23:11.028292+0000","mapping_epoch":23,"log_start":"251'100","ondisk_log_start":"251'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'131","last_scrub_stamp":"2024-06-04T16:23:11.028175+0000","last_deep_scrub":"254'131","last_deep_scrub_stamp":"2024-06-04T16:23:11.028175+0000","last_clean_scrub_stamp":"2024-06-04T16:23:11.028175+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T16:52:05.710781+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":705,"num_read_kb":672,"num_write":147,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"251'54","reported_seq":569,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:17.647777+0000","last_change":"2024-06-04T16:23:17.647777+0000","last_active":"2024-06-04T16:23:17.647777+0000","last_peered":"2024-06-04T16:23:17.647777+0000","last_clean":"2024-06-04T16:23:17.647777+0000","last_became_active":"2024-06-04T15:52:36.480469+0000","last_became_peered":"2024-06-04T15:52:36.480469+0000","last_unstale":"2024-06-04T16:23:17.647777+0000","last_undegraded":"2024-06-04T16:23:17.647777+0000","last_fullsized":"2024-06-04T16:23:17.647777+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"251'54","last_scrub_stamp":"2024-06-04T16:23:17.647552+0000","last_deep_scrub":"251'54","last_deep_scrub_stamp":"2024-06-04T16:23:17.647552+0000","last_clean_scrub_stamp":"2024-06-04T16:23:17.647552+0000","objects_scrubbed":4,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T21:56:03.180708+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":69,"num_read_kb":32811,"num_write":225,"num_write_kb":30438,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,4],"acting":[2,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":504,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:15.344159+0000","last_change":"2024-06-04T16:23:15.344203+0000","last_active":"2024-06-04T16:23:15.344159+0000","last_peered":"2024-06-04T16:23:15.344159+0000","last_clean":"2024-06-04T16:23:15.344159+0000","last_became_active":"2024-06-04T15:52:22.776723+0000","last_became_peered":"2024-06-04T15:52:22.776723+0000","last_unstale":"2024-06-04T16:23:15.344159+0000","last_undegraded":"2024-06-04T16:23:15.344159+0000","last_fullsized":"2024-06-04T16:23:15.344159+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:23:15.344049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:23:15.344049+0000","last_clean_scrub_stamp":"2024-06-04T16:23:15.344049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T01:59:22.762947+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":486,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:12.004747+0000","last_change":"2024-06-04T16:23:12.004747+0000","last_active":"2024-06-04T16:23:12.004747+0000","last_peered":"2024-06-04T16:23:12.004747+0000","last_clean":"2024-06-04T16:23:12.004747+0000","last_became_active":"2024-06-04T15:52:40.483802+0000","last_became_peered":"2024-06-04T15:52:40.483802+0000","last_unstale":"2024-06-04T16:23:12.004747+0000","last_undegraded":"2024-06-04T16:23:12.004747+0000","last_fullsized":"2024-06-04T16:23:12.004747+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:23:12.004597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:23:12.004597+0000","last_clean_scrub_stamp":"2024-06-04T16:23:12.004597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T18:00:54.931037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"254'207","reported_seq":842,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:07.012392+0000","last_change":"2024-06-04T16:23:07.012433+0000","last_active":"2024-06-04T16:23:07.012392+0000","last_peered":"2024-06-04T16:23:07.012392+0000","last_clean":"2024-06-04T16:23:07.012392+0000","last_became_active":"2024-06-04T15:52:42.499002+0000","last_became_peered":"2024-06-04T15:52:42.499002+0000","last_unstale":"2024-06-04T16:23:07.012392+0000","last_undegraded":"2024-06-04T16:23:07.012392+0000","last_fullsized":"2024-06-04T16:23:07.012392+0000","mapping_epoch":27,"log_start":"251'100","ondisk_log_start":"251'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'207","last_scrub_stamp":"2024-06-04T16:23:07.012304+0000","last_deep_scrub":"254'207","last_deep_scrub_stamp":"2024-06-04T16:23:07.012304+0000","last_clean_scrub_stamp":"2024-06-04T16:23:07.012304+0000","objects_scrubbed":8,"log_size":107,"log_dups_size":100,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T19:16:17.106023+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20869,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":311,"num_read_kb":405,"num_write":154,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":476,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:11.557058+0000","last_change":"2024-06-04T16:23:11.557058+0000","last_active":"2024-06-04T16:23:11.557058+0000","last_peered":"2024-06-04T16:23:11.557058+0000","last_clean":"2024-06-04T16:23:11.557058+0000","last_became_active":"2024-06-04T15:52:44.520499+0000","last_became_peered":"2024-06-04T15:52:44.520499+0000","last_unstale":"2024-06-04T16:23:11.557058+0000","last_undegraded":"2024-06-04T16:23:11.557058+0000","last_fullsized":"2024-06-04T16:23:11.557058+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:23:11.556903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:23:11.556903+0000","last_clean_scrub_stamp":"2024-06-04T16:23:11.556903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T18:43:13.942573+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"254'25","reported_seq":507,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:56.551415+0000","last_change":"2024-06-04T16:22:56.551443+0000","last_active":"2024-06-04T16:22:56.551415+0000","last_peered":"2024-06-04T16:22:56.551415+0000","last_clean":"2024-06-04T16:22:56.551415+0000","last_became_active":"2024-06-04T15:52:46.541768+0000","last_became_peered":"2024-06-04T15:52:46.541768+0000","last_unstale":"2024-06-04T16:22:56.551415+0000","last_undegraded":"2024-06-04T16:22:56.551415+0000","last_fullsized":"2024-06-04T16:22:56.551415+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'25","last_scrub_stamp":"2024-06-04T16:22:56.551310+0000","last_deep_scrub":"254'25","last_deep_scrub_stamp":"2024-06-04T16:22:56.551310+0000","last_clean_scrub_stamp":"2024-06-04T16:22:56.551310+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T20:49:59.699028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":34,"num_write":60,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"254'25","reported_seq":500,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:46.017610+0000","last_change":"2024-06-04T16:22:46.017610+0000","last_active":"2024-06-04T16:22:46.017610+0000","last_peered":"2024-06-04T16:22:46.017610+0000","last_clean":"2024-06-04T16:22:46.017610+0000","last_became_active":"2024-06-04T15:52:46.540733+0000","last_became_peered":"2024-06-04T15:52:46.540733+0000","last_unstale":"2024-06-04T16:22:46.017610+0000","last_undegraded":"2024-06-04T16:22:46.017610+0000","last_fullsized":"2024-06-04T16:22:46.017610+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'25","last_scrub_stamp":"2024-06-04T16:22:46.017439+0000","last_deep_scrub":"254'25","last_deep_scrub_stamp":"2024-06-04T16:22:46.017439+0000","last_clean_scrub_stamp":"2024-06-04T16:22:46.017439+0000","objects_scrubbed":1,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T04:03:05.233942+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":53,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"254'152","reported_seq":927,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:10.521391+0000","last_change":"2024-06-04T16:23:10.521419+0000","last_active":"2024-06-04T16:23:10.521391+0000","last_peered":"2024-06-04T16:23:10.521391+0000","last_clean":"2024-06-04T16:23:10.521391+0000","last_became_active":"2024-06-04T15:52:38.479929+0000","last_became_peered":"2024-06-04T15:52:38.479929+0000","last_unstale":"2024-06-04T16:23:10.521391+0000","last_undegraded":"2024-06-04T16:23:10.521391+0000","last_fullsized":"2024-06-04T16:23:10.521391+0000","mapping_epoch":23,"log_start":"251'100","ondisk_log_start":"251'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'152","last_scrub_stamp":"2024-06-04T16:23:10.521305+0000","last_deep_scrub":"254'152","last_deep_scrub_stamp":"2024-06-04T16:23:10.521305+0000","last_clean_scrub_stamp":"2024-06-04T16:23:10.521305+0000","objects_scrubbed":1,"log_size":52,"log_dups_size":100,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T19:41:35.254224+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":770,"num_read_kb":699,"num_write":204,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"251'34","reported_seq":555,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:31.702584+0000","last_change":"2024-06-04T16:23:31.702627+0000","last_active":"2024-06-04T16:23:31.702584+0000","last_peered":"2024-06-04T16:23:31.702584+0000","last_clean":"2024-06-04T16:23:31.702584+0000","last_became_active":"2024-06-04T15:52:36.497532+0000","last_became_peered":"2024-06-04T15:52:36.497532+0000","last_unstale":"2024-06-04T16:23:31.702584+0000","last_undegraded":"2024-06-04T16:23:31.702584+0000","last_fullsized":"2024-06-04T16:23:31.702584+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"251'34","last_scrub_stamp":"2024-06-04T16:23:31.702486+0000","last_deep_scrub":"251'34","last_deep_scrub_stamp":"2024-06-04T16:23:31.702486+0000","last_clean_scrub_stamp":"2024-06-04T16:23:31.702486+0000","objects_scrubbed":4,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T21:47:31.551548+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":54,"num_read_kb":42110,"num_write":160,"num_write_kb":16147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":480,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:57.091636+0000","last_change":"2024-06-04T16:22:57.091636+0000","last_active":"2024-06-04T16:22:57.091636+0000","last_peered":"2024-06-04T16:22:57.091636+0000","last_clean":"2024-06-04T16:22:57.091636+0000","last_became_active":"2024-06-04T15:52:40.483882+0000","last_became_peered":"2024-06-04T15:52:40.483882+0000","last_unstale":"2024-06-04T16:22:57.091636+0000","last_undegraded":"2024-06-04T16:22:57.091636+0000","last_fullsized":"2024-06-04T16:22:57.091636+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:22:57.091516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:22:57.091516+0000","last_clean_scrub_stamp":"2024-06-04T16:22:57.091516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T21:23:38.905655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.11","version":"254'100","reported_seq":648,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:08.013627+0000","last_change":"2024-06-04T16:23:08.013676+0000","last_active":"2024-06-04T16:23:08.013627+0000","last_peered":"2024-06-04T16:23:08.013627+0000","last_clean":"2024-06-04T16:23:08.013627+0000","last_became_active":"2024-06-04T15:52:42.504144+0000","last_became_peered":"2024-06-04T15:52:42.504144+0000","last_unstale":"2024-06-04T16:23:08.013627+0000","last_undegraded":"2024-06-04T16:23:08.013627+0000","last_fullsized":"2024-06-04T16:23:08.013627+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'100","last_scrub_stamp":"2024-06-04T16:23:08.013535+0000","last_deep_scrub":"254'100","last_deep_scrub_stamp":"2024-06-04T16:23:08.013535+0000","last_clean_scrub_stamp":"2024-06-04T16:23:08.013535+0000","objects_scrubbed":5,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T23:33:08.492272+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13519,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":145,"num_read_kb":205,"num_write":70,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":476,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:08.030159+0000","last_change":"2024-06-04T16:23:08.030181+0000","last_active":"2024-06-04T16:23:08.030159+0000","last_peered":"2024-06-04T16:23:08.030159+0000","last_clean":"2024-06-04T16:23:08.030159+0000","last_became_active":"2024-06-04T15:52:44.517718+0000","last_became_peered":"2024-06-04T15:52:44.517718+0000","last_unstale":"2024-06-04T16:23:08.030159+0000","last_undegraded":"2024-06-04T16:23:08.030159+0000","last_fullsized":"2024-06-04T16:23:08.030159+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:23:08.030076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:23:08.030076+0000","last_clean_scrub_stamp":"2024-06-04T16:23:08.030076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T00:47:56.220482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1e","version":"254'42","reported_seq":521,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:29.974225+0000","last_change":"2024-06-04T16:23:29.974251+0000","last_active":"2024-06-04T16:23:29.974225+0000","last_peered":"2024-06-04T16:23:29.974225+0000","last_clean":"2024-06-04T16:23:29.974225+0000","last_became_active":"2024-06-04T15:52:46.536917+0000","last_became_peered":"2024-06-04T15:52:46.536917+0000","last_unstale":"2024-06-04T16:23:29.974225+0000","last_undegraded":"2024-06-04T16:23:29.974225+0000","last_fullsized":"2024-06-04T16:23:29.974225+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'42","last_scrub_stamp":"2024-06-04T16:23:29.974130+0000","last_deep_scrub":"254'42","last_deep_scrub_stamp":"2024-06-04T16:23:29.974130+0000","last_clean_scrub_stamp":"2024-06-04T16:23:29.974130+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T17:46:26.069290+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":42,"num_write":101,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"254'152","reported_seq":994,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:02.977888+0000","last_change":"2024-06-04T16:23:02.977952+0000","last_active":"2024-06-04T16:23:02.977888+0000","last_peered":"2024-06-04T16:23:02.977888+0000","last_clean":"2024-06-04T16:23:02.977888+0000","last_became_active":"2024-06-04T15:52:38.488159+0000","last_became_peered":"2024-06-04T15:52:38.488159+0000","last_unstale":"2024-06-04T16:23:02.977888+0000","last_undegraded":"2024-06-04T16:23:02.977888+0000","last_fullsized":"2024-06-04T16:23:02.977888+0000","mapping_epoch":23,"log_start":"251'100","ondisk_log_start":"251'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'152","last_scrub_stamp":"2024-06-04T16:23:02.977774+0000","last_deep_scrub":"254'152","last_deep_scrub_stamp":"2024-06-04T16:23:02.977774+0000","last_clean_scrub_stamp":"2024-06-04T16:23:02.977774+0000","objects_scrubbed":1,"log_size":52,"log_dups_size":100,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T04:09:24.513394+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":952,"num_read_kb":891,"num_write":194,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.15","version":"251'69","reported_seq":613,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:08.764663+0000","last_change":"2024-06-04T16:23:08.764663+0000","last_active":"2024-06-04T16:23:08.764663+0000","last_peered":"2024-06-04T16:23:08.764663+0000","last_clean":"2024-06-04T16:23:08.764663+0000","last_became_active":"2024-06-04T15:52:36.492503+0000","last_became_peered":"2024-06-04T15:52:36.492503+0000","last_unstale":"2024-06-04T16:23:08.764663+0000","last_undegraded":"2024-06-04T16:23:08.764663+0000","last_fullsized":"2024-06-04T16:23:08.764663+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"251'69","last_scrub_stamp":"2024-06-04T16:23:08.764479+0000","last_deep_scrub":"251'69","last_deep_scrub_stamp":"2024-06-04T16:23:08.764479+0000","last_clean_scrub_stamp":"2024-06-04T16:23:08.764479+0000","objects_scrubbed":6,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T20:05:58.412567+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":528536,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":128,"num_read_kb":6583,"num_write":319,"num_write_kb":16503,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,3],"acting":[0,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":484,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:13.965080+0000","last_change":"2024-06-04T16:23:13.965111+0000","last_active":"2024-06-04T16:23:13.965080+0000","last_peered":"2024-06-04T16:23:13.965080+0000","last_clean":"2024-06-04T16:23:13.965080+0000","last_became_active":"2024-06-04T15:52:40.484480+0000","last_became_peered":"2024-06-04T15:52:40.484480+0000","last_unstale":"2024-06-04T16:23:13.965080+0000","last_undegraded":"2024-06-04T16:23:13.965080+0000","last_fullsized":"2024-06-04T16:23:13.965080+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:23:13.964982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:23:13.964982+0000","last_clean_scrub_stamp":"2024-06-04T16:23:13.964982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T04:13:27.946132+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"254'21","reported_seq":507,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:01.000179+0000","last_change":"2024-06-04T16:23:01.000179+0000","last_active":"2024-06-04T16:23:01.000179+0000","last_peered":"2024-06-04T16:23:01.000179+0000","last_clean":"2024-06-04T16:23:01.000179+0000","last_became_active":"2024-06-04T15:52:42.499592+0000","last_became_peered":"2024-06-04T15:52:42.499592+0000","last_unstale":"2024-06-04T16:23:01.000179+0000","last_undegraded":"2024-06-04T16:23:01.000179+0000","last_fullsized":"2024-06-04T16:23:01.000179+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'21","last_scrub_stamp":"2024-06-04T16:23:01.000012+0000","last_deep_scrub":"254'21","last_deep_scrub_stamp":"2024-06-04T16:23:01.000012+0000","last_clean_scrub_stamp":"2024-06-04T16:23:01.000012+0000","objects_scrubbed":3,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T22:14:20.665186+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":19,"num_read_kb":17,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":294,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":474,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:09.485359+0000","last_change":"2024-06-04T16:23:09.485380+0000","last_active":"2024-06-04T16:23:09.485359+0000","last_peered":"2024-06-04T16:23:09.485359+0000","last_clean":"2024-06-04T16:23:09.485359+0000","last_became_active":"2024-06-04T15:52:44.519102+0000","last_became_peered":"2024-06-04T15:52:44.519102+0000","last_unstale":"2024-06-04T16:23:09.485359+0000","last_undegraded":"2024-06-04T16:23:09.485359+0000","last_fullsized":"2024-06-04T16:23:09.485359+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:23:09.485273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:23:09.485273+0000","last_clean_scrub_stamp":"2024-06-04T16:23:09.485273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T20:50:18.009284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"254'24","reported_seq":500,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:55.110607+0000","last_change":"2024-06-04T16:22:55.110633+0000","last_active":"2024-06-04T16:22:55.110607+0000","last_peered":"2024-06-04T16:22:55.110607+0000","last_clean":"2024-06-04T16:22:55.110607+0000","last_became_active":"2024-06-04T15:52:46.534277+0000","last_became_peered":"2024-06-04T15:52:46.534277+0000","last_unstale":"2024-06-04T16:22:55.110607+0000","last_undegraded":"2024-06-04T16:22:55.110607+0000","last_fullsized":"2024-06-04T16:22:55.110607+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'24","last_scrub_stamp":"2024-06-04T16:22:55.110517+0000","last_deep_scrub":"254'24","last_deep_scrub_stamp":"2024-06-04T16:22:55.110517+0000","last_clean_scrub_stamp":"2024-06-04T16:22:55.110517+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T18:12:16.411222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":38,"num_write":55,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"254'224","reported_seq":1048,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:12.970193+0000","last_change":"2024-06-04T16:23:12.970231+0000","last_active":"2024-06-04T16:23:12.970193+0000","last_peered":"2024-06-04T16:23:12.970193+0000","last_clean":"2024-06-04T16:23:12.970193+0000","last_became_active":"2024-06-04T15:52:38.481934+0000","last_became_peered":"2024-06-04T15:52:38.481934+0000","last_unstale":"2024-06-04T16:23:12.970193+0000","last_undegraded":"2024-06-04T16:23:12.970193+0000","last_fullsized":"2024-06-04T16:23:12.970193+0000","mapping_epoch":23,"log_start":"251'200","ondisk_log_start":"251'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'224","last_scrub_stamp":"2024-06-04T16:23:12.970097+0000","last_deep_scrub":"254'224","last_deep_scrub_stamp":"2024-06-04T16:23:12.970097+0000","last_clean_scrub_stamp":"2024-06-04T16:23:12.970097+0000","objects_scrubbed":3,"log_size":24,"log_dups_size":200,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T23:41:43.548804+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1128,"num_read_kb":983,"num_write":320,"num_write_kb":131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":811,"num_omap_keys":4,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.16","version":"251'39","reported_seq":538,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:16.624075+0000","last_change":"2024-06-04T16:23:16.624075+0000","last_active":"2024-06-04T16:23:16.624075+0000","last_peered":"2024-06-04T16:23:16.624075+0000","last_clean":"2024-06-04T16:23:16.624075+0000","last_became_active":"2024-06-04T15:52:36.480284+0000","last_became_peered":"2024-06-04T15:52:36.480284+0000","last_unstale":"2024-06-04T16:23:16.624075+0000","last_undegraded":"2024-06-04T16:23:16.624075+0000","last_fullsized":"2024-06-04T16:23:16.624075+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"251'39","last_scrub_stamp":"2024-06-04T16:23:16.623896+0000","last_deep_scrub":"251'39","last_deep_scrub_stamp":"2024-06-04T16:23:16.623896+0000","last_clean_scrub_stamp":"2024-06-04T16:23:16.623896+0000","objects_scrubbed":1,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T22:30:28.602372+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":37,"num_read_kb":1062,"num_write":155,"num_write_kb":20099,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4],"acting":[2,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":482,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:58.490367+0000","last_change":"2024-06-04T16:22:58.490367+0000","last_active":"2024-06-04T16:22:58.490367+0000","last_peered":"2024-06-04T16:22:58.490367+0000","last_clean":"2024-06-04T16:22:58.490367+0000","last_became_active":"2024-06-04T15:52:40.477609+0000","last_became_peered":"2024-06-04T15:52:40.477609+0000","last_unstale":"2024-06-04T16:22:58.490367+0000","last_undegraded":"2024-06-04T16:22:58.490367+0000","last_fullsized":"2024-06-04T16:22:58.490367+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:22:58.490254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:22:58.490254+0000","last_clean_scrub_stamp":"2024-06-04T16:22:58.490254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T03:58:39.460650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"254'137","reported_seq":704,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:09.075759+0000","last_change":"2024-06-04T16:23:09.075830+0000","last_active":"2024-06-04T16:23:09.075759+0000","last_peered":"2024-06-04T16:23:09.075759+0000","last_clean":"2024-06-04T16:23:09.075759+0000","last_became_active":"2024-06-04T15:52:42.496416+0000","last_became_peered":"2024-06-04T15:52:42.496416+0000","last_unstale":"2024-06-04T16:23:09.075759+0000","last_undegraded":"2024-06-04T16:23:09.075759+0000","last_fullsized":"2024-06-04T16:23:09.075759+0000","mapping_epoch":27,"log_start":"251'100","ondisk_log_start":"251'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'137","last_scrub_stamp":"2024-06-04T16:23:09.075655+0000","last_deep_scrub":"254'137","last_deep_scrub_stamp":"2024-06-04T16:23:09.075655+0000","last_clean_scrub_stamp":"2024-06-04T16:23:09.075655+0000","objects_scrubbed":5,"log_size":37,"log_dups_size":100,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T04:19:42.658569+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14747,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":196,"num_read_kb":272,"num_write":106,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":478,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:54.181551+0000","last_change":"2024-06-04T16:22:54.181551+0000","last_active":"2024-06-04T16:22:54.181551+0000","last_peered":"2024-06-04T16:22:54.181551+0000","last_clean":"2024-06-04T16:22:54.181551+0000","last_became_active":"2024-06-04T15:52:44.519837+0000","last_became_peered":"2024-06-04T15:52:44.519837+0000","last_unstale":"2024-06-04T16:22:54.181551+0000","last_undegraded":"2024-06-04T16:22:54.181551+0000","last_fullsized":"2024-06-04T16:22:54.181551+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:22:54.181389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:22:54.181389+0000","last_clean_scrub_stamp":"2024-06-04T16:22:54.181389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T19:26:26.634657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"254'18","reported_seq":489,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:48.034172+0000","last_change":"2024-06-04T16:22:48.034172+0000","last_active":"2024-06-04T16:22:48.034172+0000","last_peered":"2024-06-04T16:22:48.034172+0000","last_clean":"2024-06-04T16:22:48.034172+0000","last_became_active":"2024-06-04T15:52:46.529366+0000","last_became_peered":"2024-06-04T15:52:46.529366+0000","last_unstale":"2024-06-04T16:22:48.034172+0000","last_undegraded":"2024-06-04T16:22:48.034172+0000","last_fullsized":"2024-06-04T16:22:48.034172+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'18","last_scrub_stamp":"2024-06-04T16:22:48.034075+0000","last_deep_scrub":"254'18","last_deep_scrub_stamp":"2024-06-04T16:22:48.034075+0000","last_clean_scrub_stamp":"2024-06-04T16:22:48.034075+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T01:45:02.416352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":52,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"254'128","reported_seq":840,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:16.916618+0000","last_change":"2024-06-04T16:23:16.916659+0000","last_active":"2024-06-04T16:23:16.916618+0000","last_peered":"2024-06-04T16:23:16.916618+0000","last_clean":"2024-06-04T16:23:16.916618+0000","last_became_active":"2024-06-04T15:52:38.488622+0000","last_became_peered":"2024-06-04T15:52:38.488622+0000","last_unstale":"2024-06-04T16:23:16.916618+0000","last_undegraded":"2024-06-04T16:23:16.916618+0000","last_fullsized":"2024-06-04T16:23:16.916618+0000","mapping_epoch":23,"log_start":"251'100","ondisk_log_start":"251'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'128","last_scrub_stamp":"2024-06-04T16:23:16.916521+0000","last_deep_scrub":"254'128","last_deep_scrub_stamp":"2024-06-04T16:23:16.916521+0000","last_clean_scrub_stamp":"2024-06-04T16:23:16.916521+0000","objects_scrubbed":1,"log_size":28,"log_dups_size":100,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T03:05:56.416443+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":585,"num_read_kb":532,"num_write":156,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":248,"num_omap_keys":1,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"254'50","reported_seq":571,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:31.388610+0000","last_change":"2024-06-04T16:23:31.388610+0000","last_active":"2024-06-04T16:23:31.388610+0000","last_peered":"2024-06-04T16:23:31.388610+0000","last_clean":"2024-06-04T16:23:31.388610+0000","last_became_active":"2024-06-04T15:52:36.482733+0000","last_became_peered":"2024-06-04T15:52:36.482733+0000","last_unstale":"2024-06-04T16:23:31.388610+0000","last_undegraded":"2024-06-04T16:23:31.388610+0000","last_fullsized":"2024-06-04T16:23:31.388610+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'50","last_scrub_stamp":"2024-06-04T16:23:31.388461+0000","last_deep_scrub":"254'50","last_deep_scrub_stamp":"2024-06-04T16:23:31.388461+0000","last_clean_scrub_stamp":"2024-06-04T16:23:31.388461+0000","objects_scrubbed":4,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T18:10:59.353248+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133705,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":82,"num_read_kb":13463,"num_write":227,"num_write_kb":36279,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1],"acting":[5,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.11","version":"254'5","reported_seq":790,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:19.750795+0000","last_change":"2024-06-04T16:23:19.750825+0000","last_active":"2024-06-04T16:23:19.750795+0000","last_peered":"2024-06-04T16:23:19.750795+0000","last_clean":"2024-06-04T16:23:19.750795+0000","last_became_active":"2024-06-04T15:52:40.479002+0000","last_became_peered":"2024-06-04T15:52:40.479002+0000","last_unstale":"2024-06-04T16:23:19.750795+0000","last_undegraded":"2024-06-04T16:23:19.750795+0000","last_fullsized":"2024-06-04T16:23:19.750795+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'5","last_scrub_stamp":"2024-06-04T16:23:19.750708+0000","last_deep_scrub":"254'5","last_deep_scrub_stamp":"2024-06-04T16:23:19.750708+0000","last_clean_scrub_stamp":"2024-06-04T16:23:19.750708+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T18:35:30.453280+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":463,"num_read_kb":757,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"254'89","reported_seq":640,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:01.759191+0000","last_change":"2024-06-04T16:23:01.759191+0000","last_active":"2024-06-04T16:23:01.759191+0000","last_peered":"2024-06-04T16:23:01.759191+0000","last_clean":"2024-06-04T16:23:01.759191+0000","last_became_active":"2024-06-04T15:52:42.505955+0000","last_became_peered":"2024-06-04T15:52:42.505955+0000","last_unstale":"2024-06-04T16:23:01.759191+0000","last_undegraded":"2024-06-04T16:23:01.759191+0000","last_fullsized":"2024-06-04T16:23:01.759191+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'89","last_scrub_stamp":"2024-06-04T16:23:01.759061+0000","last_deep_scrub":"254'89","last_deep_scrub_stamp":"2024-06-04T16:23:01.759061+0000","last_clean_scrub_stamp":"2024-06-04T16:23:01.759061+0000","objects_scrubbed":4,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T18:04:48.914592+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":128,"num_read_kb":150,"num_write":58,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":476,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:15.906417+0000","last_change":"2024-06-04T16:23:15.906463+0000","last_active":"2024-06-04T16:23:15.906417+0000","last_peered":"2024-06-04T16:23:15.906417+0000","last_clean":"2024-06-04T16:23:15.906417+0000","last_became_active":"2024-06-04T15:52:44.519975+0000","last_became_peered":"2024-06-04T15:52:44.519975+0000","last_unstale":"2024-06-04T16:23:15.906417+0000","last_undegraded":"2024-06-04T16:23:15.906417+0000","last_fullsized":"2024-06-04T16:23:15.906417+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:23:15.906309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:23:15.906309+0000","last_clean_scrub_stamp":"2024-06-04T16:23:15.906309+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T02:21:45.561560+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1f","version":"254'95","reported_seq":785,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:32.666057+0000","last_change":"2024-06-04T16:23:32.666057+0000","last_active":"2024-06-04T16:23:32.666057+0000","last_peered":"2024-06-04T16:23:32.666057+0000","last_clean":"2024-06-04T16:23:32.666057+0000","last_became_active":"2024-06-04T15:52:38.485163+0000","last_became_peered":"2024-06-04T15:52:38.485163+0000","last_unstale":"2024-06-04T16:23:32.666057+0000","last_undegraded":"2024-06-04T16:23:32.666057+0000","last_fullsized":"2024-06-04T16:23:32.666057+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'95","last_scrub_stamp":"2024-06-04T16:23:32.665921+0000","last_deep_scrub":"254'95","last_deep_scrub_stamp":"2024-06-04T16:23:32.665921+0000","last_clean_scrub_stamp":"2024-06-04T16:23:32.665921+0000","objects_scrubbed":2,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T03:03:50.908050+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":477,"num_read_kb":443,"num_write":114,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":225,"num_omap_keys":1,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"254'35","reported_seq":547,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:35.353893+0000","last_change":"2024-06-04T16:23:35.353893+0000","last_active":"2024-06-04T16:23:35.353893+0000","last_peered":"2024-06-04T16:23:35.353893+0000","last_clean":"2024-06-04T16:23:35.353893+0000","last_became_active":"2024-06-04T15:52:36.490297+0000","last_became_peered":"2024-06-04T15:52:36.490297+0000","last_unstale":"2024-06-04T16:23:35.353893+0000","last_undegraded":"2024-06-04T16:23:35.353893+0000","last_fullsized":"2024-06-04T16:23:35.353893+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'35","last_scrub_stamp":"2024-06-04T16:23:35.353762+0000","last_deep_scrub":"254'35","last_deep_scrub_stamp":"2024-06-04T16:23:35.353762+0000","last_clean_scrub_stamp":"2024-06-04T16:23:35.353762+0000","objects_scrubbed":1,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T23:19:49.438892+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1069164,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":53,"num_read_kb":1061,"num_write":121,"num_write_kb":15390,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,3],"acting":[5,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":482,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:59.048325+0000","last_change":"2024-06-04T16:22:59.048348+0000","last_active":"2024-06-04T16:22:59.048325+0000","last_peered":"2024-06-04T16:22:59.048325+0000","last_clean":"2024-06-04T16:22:59.048325+0000","last_became_active":"2024-06-04T15:52:40.482962+0000","last_became_peered":"2024-06-04T15:52:40.482962+0000","last_unstale":"2024-06-04T16:22:59.048325+0000","last_undegraded":"2024-06-04T16:22:59.048325+0000","last_fullsized":"2024-06-04T16:22:59.048325+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:22:59.048237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:22:59.048237+0000","last_clean_scrub_stamp":"2024-06-04T16:22:59.048237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T21:58:02.126251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"254'153","reported_seq":757,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:06.055514+0000","last_change":"2024-06-04T16:23:06.055560+0000","last_active":"2024-06-04T16:23:06.055514+0000","last_peered":"2024-06-04T16:23:06.055514+0000","last_clean":"2024-06-04T16:23:06.055514+0000","last_became_active":"2024-06-04T15:52:42.503246+0000","last_became_peered":"2024-06-04T15:52:42.503246+0000","last_unstale":"2024-06-04T16:23:06.055514+0000","last_undegraded":"2024-06-04T16:23:06.055514+0000","last_fullsized":"2024-06-04T16:23:06.055514+0000","mapping_epoch":27,"log_start":"251'100","ondisk_log_start":"251'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'153","last_scrub_stamp":"2024-06-04T16:23:06.055439+0000","last_deep_scrub":"254'153","last_deep_scrub_stamp":"2024-06-04T16:23:06.055439+0000","last_clean_scrub_stamp":"2024-06-04T16:23:06.055439+0000","objects_scrubbed":5,"log_size":53,"log_dups_size":100,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T00:59:17.824798+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8493,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":230,"num_read_kb":283,"num_write":98,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":473,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:07.432027+0000","last_change":"2024-06-04T16:23:07.432049+0000","last_active":"2024-06-04T16:23:07.432027+0000","last_peered":"2024-06-04T16:23:07.432027+0000","last_clean":"2024-06-04T16:23:07.432027+0000","last_became_active":"2024-06-04T15:52:44.517715+0000","last_became_peered":"2024-06-04T15:52:44.517715+0000","last_unstale":"2024-06-04T16:23:07.432027+0000","last_undegraded":"2024-06-04T16:23:07.432027+0000","last_fullsized":"2024-06-04T16:23:07.432027+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:23:07.431929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:23:07.431929+0000","last_clean_scrub_stamp":"2024-06-04T16:23:07.431929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T21:38:18.352137+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"254'74","reported_seq":562,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:03.466516+0000","last_change":"2024-06-04T16:23:03.466516+0000","last_active":"2024-06-04T16:23:03.466516+0000","last_peered":"2024-06-04T16:23:03.466516+0000","last_clean":"2024-06-04T16:23:03.466516+0000","last_became_active":"2024-06-04T15:52:46.538338+0000","last_became_peered":"2024-06-04T15:52:46.538338+0000","last_unstale":"2024-06-04T16:23:03.466516+0000","last_undegraded":"2024-06-04T16:23:03.466516+0000","last_fullsized":"2024-06-04T16:23:03.466516+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'74","last_scrub_stamp":"2024-06-04T16:23:03.466387+0000","last_deep_scrub":"254'74","last_deep_scrub_stamp":"2024-06-04T16:23:03.466387+0000","last_clean_scrub_stamp":"2024-06-04T16:23:03.466387+0000","objects_scrubbed":3,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T17:43:39.194556+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1061,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":107,"num_read_kb":120,"num_write":148,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1e","version":"254'145","reported_seq":924,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:11.005966+0000","last_change":"2024-06-04T16:23:11.006009+0000","last_active":"2024-06-04T16:23:11.005966+0000","last_peered":"2024-06-04T16:23:11.005966+0000","last_clean":"2024-06-04T16:23:11.005966+0000","last_became_active":"2024-06-04T15:52:38.484087+0000","last_became_peered":"2024-06-04T15:52:38.484087+0000","last_unstale":"2024-06-04T16:23:11.005966+0000","last_undegraded":"2024-06-04T16:23:11.005966+0000","last_fullsized":"2024-06-04T16:23:11.005966+0000","mapping_epoch":23,"log_start":"251'100","ondisk_log_start":"251'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'145","last_scrub_stamp":"2024-06-04T16:23:11.005877+0000","last_deep_scrub":"254'145","last_deep_scrub_stamp":"2024-06-04T16:23:11.005877+0000","last_clean_scrub_stamp":"2024-06-04T16:23:11.005877+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":100,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T22:18:10.083761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":710,"num_read_kb":650,"num_write":181,"num_write_kb":49,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"251'48","reported_seq":560,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:21.820350+0000","last_change":"2024-06-04T16:23:21.820386+0000","last_active":"2024-06-04T16:23:21.820350+0000","last_peered":"2024-06-04T16:23:21.820350+0000","last_clean":"2024-06-04T16:23:21.820350+0000","last_became_active":"2024-06-04T15:52:36.477626+0000","last_became_peered":"2024-06-04T15:52:36.477626+0000","last_unstale":"2024-06-04T16:23:21.820350+0000","last_undegraded":"2024-06-04T16:23:21.820350+0000","last_fullsized":"2024-06-04T16:23:21.820350+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"251'48","last_scrub_stamp":"2024-06-04T16:23:21.820253+0000","last_deep_scrub":"251'48","last_deep_scrub_stamp":"2024-06-04T16:23:21.820253+0000","last_clean_scrub_stamp":"2024-06-04T16:23:21.820253+0000","objects_scrubbed":2,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T21:31:34.108130+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20628,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":58,"num_read_kb":9358,"num_write":184,"num_write_kb":22886,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,1],"acting":[4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":484,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:01.495911+0000","last_change":"2024-06-04T16:23:01.495911+0000","last_active":"2024-06-04T16:23:01.495911+0000","last_peered":"2024-06-04T16:23:01.495911+0000","last_clean":"2024-06-04T16:23:01.495911+0000","last_became_active":"2024-06-04T15:52:40.484444+0000","last_became_peered":"2024-06-04T15:52:40.484444+0000","last_unstale":"2024-06-04T16:23:01.495911+0000","last_undegraded":"2024-06-04T16:23:01.495911+0000","last_fullsized":"2024-06-04T16:23:01.495911+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:23:01.495774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:23:01.495774+0000","last_clean_scrub_stamp":"2024-06-04T16:23:01.495774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T18:30:24.832332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"254'113","reported_seq":669,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:11.847562+0000","last_change":"2024-06-04T16:23:11.847607+0000","last_active":"2024-06-04T16:23:11.847562+0000","last_peered":"2024-06-04T16:23:11.847562+0000","last_clean":"2024-06-04T16:23:11.847562+0000","last_became_active":"2024-06-04T15:52:42.498329+0000","last_became_peered":"2024-06-04T15:52:42.498329+0000","last_unstale":"2024-06-04T16:23:11.847562+0000","last_undegraded":"2024-06-04T16:23:11.847562+0000","last_fullsized":"2024-06-04T16:23:11.847562+0000","mapping_epoch":27,"log_start":"251'100","ondisk_log_start":"251'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'113","last_scrub_stamp":"2024-06-04T16:23:11.847476+0000","last_deep_scrub":"254'113","last_deep_scrub_stamp":"2024-06-04T16:23:11.847476+0000","last_clean_scrub_stamp":"2024-06-04T16:23:11.847476+0000","objects_scrubbed":8,"log_size":13,"log_dups_size":100,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T16:54:36.931076+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":167,"num_read_kb":207,"num_write":102,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":11460,"num_omap_keys":24,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":477,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:04.428313+0000","last_change":"2024-06-04T16:23:04.428338+0000","last_active":"2024-06-04T16:23:04.428313+0000","last_peered":"2024-06-04T16:23:04.428313+0000","last_clean":"2024-06-04T16:23:04.428313+0000","last_became_active":"2024-06-04T15:52:44.523527+0000","last_became_peered":"2024-06-04T15:52:44.523527+0000","last_unstale":"2024-06-04T16:23:04.428313+0000","last_undegraded":"2024-06-04T16:23:04.428313+0000","last_fullsized":"2024-06-04T16:23:04.428313+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:23:04.428227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:23:04.428227+0000","last_clean_scrub_stamp":"2024-06-04T16:23:04.428227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T23:41:17.114473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.12","version":"254'33","reported_seq":519,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:45.120984+0000","last_change":"2024-06-04T16:22:45.120984+0000","last_active":"2024-06-04T16:22:45.120984+0000","last_peered":"2024-06-04T16:22:45.120984+0000","last_clean":"2024-06-04T16:22:45.120984+0000","last_became_active":"2024-06-04T15:52:46.537899+0000","last_became_peered":"2024-06-04T15:52:46.537899+0000","last_unstale":"2024-06-04T16:22:45.120984+0000","last_undegraded":"2024-06-04T16:22:45.120984+0000","last_fullsized":"2024-06-04T16:22:45.120984+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'33","last_scrub_stamp":"2024-06-04T16:22:45.120808+0000","last_deep_scrub":"254'33","last_deep_scrub_stamp":"2024-06-04T16:22:45.120808+0000","last_clean_scrub_stamp":"2024-06-04T16:22:45.120808+0000","objects_scrubbed":4,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T18:20:07.652176+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1228,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":67,"num_read_kb":65,"num_write":80,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"254'110","reported_seq":894,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:26.919908+0000","last_change":"2024-06-04T16:23:26.919950+0000","last_active":"2024-06-04T16:23:26.919908+0000","last_peered":"2024-06-04T16:23:26.919908+0000","last_clean":"2024-06-04T16:23:26.919908+0000","last_became_active":"2024-06-04T15:52:38.480458+0000","last_became_peered":"2024-06-04T15:52:38.480458+0000","last_unstale":"2024-06-04T16:23:26.919908+0000","last_undegraded":"2024-06-04T16:23:26.919908+0000","last_fullsized":"2024-06-04T16:23:26.919908+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'110","last_scrub_stamp":"2024-06-04T16:23:26.919814+0000","last_deep_scrub":"254'110","last_deep_scrub_stamp":"2024-06-04T16:23:26.919814+0000","last_clean_scrub_stamp":"2024-06-04T16:23:26.919814+0000","objects_scrubbed":2,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T21:46:39.229182+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":731,"num_read_kb":703,"num_write":125,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1a","version":"254'73","reported_seq":595,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:16.333696+0000","last_change":"2024-06-04T16:23:16.333779+0000","last_active":"2024-06-04T16:23:16.333696+0000","last_peered":"2024-06-04T16:23:16.333696+0000","last_clean":"2024-06-04T16:23:16.333696+0000","last_became_active":"2024-06-04T15:52:36.477885+0000","last_became_peered":"2024-06-04T15:52:36.477885+0000","last_unstale":"2024-06-04T16:23:16.333696+0000","last_undegraded":"2024-06-04T16:23:16.333696+0000","last_fullsized":"2024-06-04T16:23:16.333696+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'73","last_scrub_stamp":"2024-06-04T16:23:16.333565+0000","last_deep_scrub":"254'73","last_deep_scrub_stamp":"2024-06-04T16:23:16.333565+0000","last_clean_scrub_stamp":"2024-06-04T16:23:16.333565+0000","objects_scrubbed":5,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T02:47:04.293959+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1395842,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":88,"num_read_kb":3881,"num_write":289,"num_write_kb":29330,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":481,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:57.516834+0000","last_change":"2024-06-04T16:22:57.516894+0000","last_active":"2024-06-04T16:22:57.516834+0000","last_peered":"2024-06-04T16:22:57.516834+0000","last_clean":"2024-06-04T16:22:57.516834+0000","last_became_active":"2024-06-04T15:52:40.477924+0000","last_became_peered":"2024-06-04T15:52:40.477924+0000","last_unstale":"2024-06-04T16:22:57.516834+0000","last_undegraded":"2024-06-04T16:22:57.516834+0000","last_fullsized":"2024-06-04T16:22:57.516834+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:22:57.516723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:22:57.516723+0000","last_clean_scrub_stamp":"2024-06-04T16:22:57.516723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T18:12:49.229393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"254'97","reported_seq":648,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:04.066591+0000","last_change":"2024-06-04T16:23:04.066591+0000","last_active":"2024-06-04T16:23:04.066591+0000","last_peered":"2024-06-04T16:23:04.066591+0000","last_clean":"2024-06-04T16:23:04.066591+0000","last_became_active":"2024-06-04T15:52:42.503579+0000","last_became_peered":"2024-06-04T15:52:42.503579+0000","last_unstale":"2024-06-04T16:23:04.066591+0000","last_undegraded":"2024-06-04T16:23:04.066591+0000","last_fullsized":"2024-06-04T16:23:04.066591+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'97","last_scrub_stamp":"2024-06-04T16:23:04.066459+0000","last_deep_scrub":"254'97","last_deep_scrub_stamp":"2024-06-04T16:23:04.066459+0000","last_clean_scrub_stamp":"2024-06-04T16:23:04.066459+0000","objects_scrubbed":5,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T22:07:06.260680+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5924,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":139,"num_read_kb":180,"num_write":64,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":478,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:10.043211+0000","last_change":"2024-06-04T16:23:10.043234+0000","last_active":"2024-06-04T16:23:10.043211+0000","last_peered":"2024-06-04T16:23:10.043211+0000","last_clean":"2024-06-04T16:23:10.043211+0000","last_became_active":"2024-06-04T15:52:44.519570+0000","last_became_peered":"2024-06-04T15:52:44.519570+0000","last_unstale":"2024-06-04T16:23:10.043211+0000","last_undegraded":"2024-06-04T16:23:10.043211+0000","last_fullsized":"2024-06-04T16:23:10.043211+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:23:10.043105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:23:10.043105+0000","last_clean_scrub_stamp":"2024-06-04T16:23:10.043105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T03:18:54.475664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.11","version":"254'27","reported_seq":500,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:59.862605+0000","last_change":"2024-06-04T16:22:59.862605+0000","last_active":"2024-06-04T16:22:59.862605+0000","last_peered":"2024-06-04T16:22:59.862605+0000","last_clean":"2024-06-04T16:22:59.862605+0000","last_became_active":"2024-06-04T15:52:46.542820+0000","last_became_peered":"2024-06-04T15:52:46.542820+0000","last_unstale":"2024-06-04T16:22:59.862605+0000","last_undegraded":"2024-06-04T16:22:59.862605+0000","last_fullsized":"2024-06-04T16:22:59.862605+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'27","last_scrub_stamp":"2024-06-04T16:22:59.862441+0000","last_deep_scrub":"254'27","last_deep_scrub_stamp":"2024-06-04T16:22:59.862441+0000","last_clean_scrub_stamp":"2024-06-04T16:22:59.862441+0000","objects_scrubbed":3,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T21:08:54.099136+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":616,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":20,"num_read_kb":19,"num_write":60,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"254'122","reported_seq":825,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:16.913414+0000","last_change":"2024-06-04T16:23:16.913440+0000","last_active":"2024-06-04T16:23:16.913414+0000","last_peered":"2024-06-04T16:23:16.913414+0000","last_clean":"2024-06-04T16:23:16.913414+0000","last_became_active":"2024-06-04T15:52:38.477059+0000","last_became_peered":"2024-06-04T15:52:38.477059+0000","last_unstale":"2024-06-04T16:23:16.913414+0000","last_undegraded":"2024-06-04T16:23:16.913414+0000","last_fullsized":"2024-06-04T16:23:16.913414+0000","mapping_epoch":23,"log_start":"251'100","ondisk_log_start":"251'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'122","last_scrub_stamp":"2024-06-04T16:23:16.913326+0000","last_deep_scrub":"254'122","last_deep_scrub_stamp":"2024-06-04T16:23:16.913326+0000","last_clean_scrub_stamp":"2024-06-04T16:23:16.913326+0000","objects_scrubbed":1,"log_size":22,"log_dups_size":100,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T03:51:33.774060+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":614,"num_read_kb":552,"num_write":164,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":760,"num_omap_keys":4,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"254'63","reported_seq":580,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:24.765423+0000","last_change":"2024-06-04T16:23:24.765516+0000","last_active":"2024-06-04T16:23:24.765423+0000","last_peered":"2024-06-04T16:23:24.765423+0000","last_clean":"2024-06-04T16:23:24.765423+0000","last_became_active":"2024-06-04T15:52:36.497812+0000","last_became_peered":"2024-06-04T15:52:36.497812+0000","last_unstale":"2024-06-04T16:23:24.765423+0000","last_undegraded":"2024-06-04T16:23:24.765423+0000","last_fullsized":"2024-06-04T16:23:24.765423+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'63","last_scrub_stamp":"2024-06-04T16:23:24.765310+0000","last_deep_scrub":"254'63","last_deep_scrub_stamp":"2024-06-04T16:23:24.765310+0000","last_clean_scrub_stamp":"2024-06-04T16:23:24.765310+0000","objects_scrubbed":4,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T00:23:42.383064+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2267334,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":82,"num_read_kb":14576,"num_write":293,"num_write_kb":31387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3],"acting":[4,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":483,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:08.017758+0000","last_change":"2024-06-04T16:23:08.017785+0000","last_active":"2024-06-04T16:23:08.017758+0000","last_peered":"2024-06-04T16:23:08.017758+0000","last_clean":"2024-06-04T16:23:08.017758+0000","last_became_active":"2024-06-04T15:52:40.481621+0000","last_became_peered":"2024-06-04T15:52:40.481621+0000","last_unstale":"2024-06-04T16:23:08.017758+0000","last_undegraded":"2024-06-04T16:23:08.017758+0000","last_fullsized":"2024-06-04T16:23:08.017758+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:23:08.017669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:23:08.017669+0000","last_clean_scrub_stamp":"2024-06-04T16:23:08.017669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T00:50:40.268642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1e","version":"254'51","reported_seq":547,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:09.844823+0000","last_change":"2024-06-04T16:23:09.844878+0000","last_active":"2024-06-04T16:23:09.844823+0000","last_peered":"2024-06-04T16:23:09.844823+0000","last_clean":"2024-06-04T16:23:09.844823+0000","last_became_active":"2024-06-04T15:52:42.499488+0000","last_became_peered":"2024-06-04T15:52:42.499488+0000","last_unstale":"2024-06-04T16:23:09.844823+0000","last_undegraded":"2024-06-04T16:23:09.844823+0000","last_fullsized":"2024-06-04T16:23:09.844823+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'51","last_scrub_stamp":"2024-06-04T16:23:09.844736+0000","last_deep_scrub":"254'51","last_deep_scrub_stamp":"2024-06-04T16:23:09.844736+0000","last_clean_scrub_stamp":"2024-06-04T16:23:09.844736+0000","objects_scrubbed":7,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T16:46:37.753033+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":67,"num_read_kb":62,"num_write":74,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":11222,"num_omap_keys":30,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"254'461","reported_seq":1490,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:03.752174+0000","last_change":"2024-06-04T16:23:03.752174+0000","last_active":"2024-06-04T16:23:03.752174+0000","last_peered":"2024-06-04T16:23:03.752174+0000","last_clean":"2024-06-04T16:23:03.752174+0000","last_became_active":"2024-06-04T15:52:44.516460+0000","last_became_peered":"2024-06-04T15:52:44.516460+0000","last_unstale":"2024-06-04T16:23:03.752174+0000","last_undegraded":"2024-06-04T16:23:03.752174+0000","last_fullsized":"2024-06-04T16:23:03.752174+0000","mapping_epoch":29,"log_start":"251'400","ondisk_log_start":"251'400","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'461","last_scrub_stamp":"2024-06-04T16:23:03.752033+0000","last_deep_scrub":"254'461","last_deep_scrub_stamp":"2024-06-04T16:23:03.752033+0000","last_clean_scrub_stamp":"2024-06-04T16:23:03.752033+0000","objects_scrubbed":1,"log_size":61,"log_dups_size":400,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T22:17:40.547278+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.10","version":"254'21","reported_seq":501,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:47.043361+0000","last_change":"2024-06-04T16:22:47.043361+0000","last_active":"2024-06-04T16:22:47.043361+0000","last_peered":"2024-06-04T16:22:47.043361+0000","last_clean":"2024-06-04T16:22:47.043361+0000","last_became_active":"2024-06-04T15:52:46.538179+0000","last_became_peered":"2024-06-04T15:52:46.538179+0000","last_unstale":"2024-06-04T16:22:47.043361+0000","last_undegraded":"2024-06-04T16:22:47.043361+0000","last_fullsized":"2024-06-04T16:22:47.043361+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'21","last_scrub_stamp":"2024-06-04T16:22:47.043259+0000","last_deep_scrub":"254'21","last_deep_scrub_stamp":"2024-06-04T16:22:47.043259+0000","last_clean_scrub_stamp":"2024-06-04T16:22:47.043259+0000","objects_scrubbed":1,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T22:15:40.632828+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":34,"num_read_kb":33,"num_write":53,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"254'123","reported_seq":876,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:00.500298+0000","last_change":"2024-06-04T16:23:00.500326+0000","last_active":"2024-06-04T16:23:00.500298+0000","last_peered":"2024-06-04T16:23:00.500298+0000","last_clean":"2024-06-04T16:23:00.500298+0000","last_became_active":"2024-06-04T15:52:38.485379+0000","last_became_peered":"2024-06-04T15:52:38.485379+0000","last_unstale":"2024-06-04T16:23:00.500298+0000","last_undegraded":"2024-06-04T16:23:00.500298+0000","last_fullsized":"2024-06-04T16:23:00.500298+0000","mapping_epoch":23,"log_start":"254'100","ondisk_log_start":"254'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'123","last_scrub_stamp":"2024-06-04T16:23:00.500205+0000","last_deep_scrub":"254'123","last_deep_scrub_stamp":"2024-06-04T16:23:00.500205+0000","last_clean_scrub_stamp":"2024-06-04T16:23:00.500205+0000","objects_scrubbed":1,"log_size":23,"log_dups_size":100,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T20:17:09.939014+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":679,"num_read_kb":622,"num_write":158,"num_write_kb":49,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":473,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"251'30","reported_seq":530,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:18.399939+0000","last_change":"2024-06-04T16:23:18.399978+0000","last_active":"2024-06-04T16:23:18.399939+0000","last_peered":"2024-06-04T16:23:18.399939+0000","last_clean":"2024-06-04T16:23:18.399939+0000","last_became_active":"2024-06-04T15:52:36.486465+0000","last_became_peered":"2024-06-04T15:52:36.486465+0000","last_unstale":"2024-06-04T16:23:18.399939+0000","last_undegraded":"2024-06-04T16:23:18.399939+0000","last_fullsized":"2024-06-04T16:23:18.399939+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"251'30","last_scrub_stamp":"2024-06-04T16:23:18.399838+0000","last_deep_scrub":"251'30","last_deep_scrub_stamp":"2024-06-04T16:23:18.399838+0000","last_clean_scrub_stamp":"2024-06-04T16:23:18.399838+0000","objects_scrubbed":2,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T18:52:49.120366+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":30,"num_read_kb":1715,"num_write":122,"num_write_kb":16993,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,5],"acting":[1,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":485,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:00.183025+0000","last_change":"2024-06-04T16:23:00.183049+0000","last_active":"2024-06-04T16:23:00.183025+0000","last_peered":"2024-06-04T16:23:00.183025+0000","last_clean":"2024-06-04T16:23:00.183025+0000","last_became_active":"2024-06-04T15:52:40.480832+0000","last_became_peered":"2024-06-04T15:52:40.480832+0000","last_unstale":"2024-06-04T16:23:00.183025+0000","last_undegraded":"2024-06-04T16:23:00.183025+0000","last_fullsized":"2024-06-04T16:23:00.183025+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:23:00.182795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:23:00.182795+0000","last_clean_scrub_stamp":"2024-06-04T16:23:00.182795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T01:51:55.867582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"254'117","reported_seq":676,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:53.901967+0000","last_change":"2024-06-04T16:22:53.902005+0000","last_active":"2024-06-04T16:22:53.901967+0000","last_peered":"2024-06-04T16:22:53.901967+0000","last_clean":"2024-06-04T16:22:53.901967+0000","last_became_active":"2024-06-04T15:52:42.502601+0000","last_became_peered":"2024-06-04T15:52:42.502601+0000","last_unstale":"2024-06-04T16:22:53.901967+0000","last_undegraded":"2024-06-04T16:22:53.901967+0000","last_fullsized":"2024-06-04T16:22:53.901967+0000","mapping_epoch":27,"log_start":"251'100","ondisk_log_start":"251'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'117","last_scrub_stamp":"2024-06-04T16:22:53.901886+0000","last_deep_scrub":"254'117","last_deep_scrub_stamp":"2024-06-04T16:22:53.901886+0000","last_clean_scrub_stamp":"2024-06-04T16:22:53.901886+0000","objects_scrubbed":7,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T01:13:12.328330+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34754,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":168,"num_read_kb":281,"num_write":86,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":475,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:49.023291+0000","last_change":"2024-06-04T16:22:49.023320+0000","last_active":"2024-06-04T16:22:49.023291+0000","last_peered":"2024-06-04T16:22:49.023291+0000","last_clean":"2024-06-04T16:22:49.023291+0000","last_became_active":"2024-06-04T15:52:44.522992+0000","last_became_peered":"2024-06-04T15:52:44.522992+0000","last_unstale":"2024-06-04T16:22:49.023291+0000","last_undegraded":"2024-06-04T16:22:49.023291+0000","last_fullsized":"2024-06-04T16:22:49.023291+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:22:49.023192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:22:49.023192+0000","last_clean_scrub_stamp":"2024-06-04T16:22:49.023192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T21:20:02.532465+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"254'16","reported_seq":497,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:50.151424+0000","last_change":"2024-06-04T16:22:50.151477+0000","last_active":"2024-06-04T16:22:50.151424+0000","last_peered":"2024-06-04T16:22:50.151424+0000","last_clean":"2024-06-04T16:22:50.151424+0000","last_became_active":"2024-06-04T15:52:46.539985+0000","last_became_peered":"2024-06-04T15:52:46.539985+0000","last_unstale":"2024-06-04T16:22:50.151424+0000","last_undegraded":"2024-06-04T16:22:50.151424+0000","last_fullsized":"2024-06-04T16:22:50.151424+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'16","last_scrub_stamp":"2024-06-04T16:22:50.151326+0000","last_deep_scrub":"254'16","last_deep_scrub_stamp":"2024-06-04T16:22:50.151326+0000","last_clean_scrub_stamp":"2024-06-04T16:22:50.151326+0000","objects_scrubbed":1,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T17:32:57.901810+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":31,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"254'422","reported_seq":1248,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:20.638647+0000","last_change":"2024-06-04T16:23:20.638715+0000","last_active":"2024-06-04T16:23:20.638647+0000","last_peered":"2024-06-04T16:23:20.638647+0000","last_clean":"2024-06-04T16:23:20.638647+0000","last_became_active":"2024-06-04T15:52:38.474960+0000","last_became_peered":"2024-06-04T15:52:38.474960+0000","last_unstale":"2024-06-04T16:23:20.638647+0000","last_undegraded":"2024-06-04T16:23:20.638647+0000","last_fullsized":"2024-06-04T16:23:20.638647+0000","mapping_epoch":23,"log_start":"251'400","ondisk_log_start":"251'400","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'422","last_scrub_stamp":"2024-06-04T16:23:20.638541+0000","last_deep_scrub":"254'422","last_deep_scrub_stamp":"2024-06-04T16:23:20.638541+0000","last_clean_scrub_stamp":"2024-06-04T16:23:20.638541+0000","objects_scrubbed":3,"log_size":22,"log_dups_size":400,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T00:31:18.491940+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2017,"num_read_kb":1794,"num_write":716,"num_write_kb":341,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3525,"num_omap_keys":15,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"254'99","reported_seq":736,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:27.679253+0000","last_change":"2024-06-04T16:23:27.679298+0000","last_active":"2024-06-04T16:23:27.679253+0000","last_peered":"2024-06-04T16:23:27.679253+0000","last_clean":"2024-06-04T16:23:27.679253+0000","last_became_active":"2024-06-04T15:52:36.498806+0000","last_became_peered":"2024-06-04T15:52:36.498806+0000","last_unstale":"2024-06-04T16:23:27.679253+0000","last_undegraded":"2024-06-04T16:23:27.679253+0000","last_fullsized":"2024-06-04T16:23:27.679253+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'99","last_scrub_stamp":"2024-06-04T16:23:27.679156+0000","last_deep_scrub":"254'99","last_deep_scrub_stamp":"2024-06-04T16:23:27.679156+0000","last_clean_scrub_stamp":"2024-06-04T16:23:27.679156+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T03:58:25.345803+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":490,"num_read_kb":127523,"num_write":607,"num_write_kb":22490,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":481,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:59.503813+0000","last_change":"2024-06-04T16:22:59.503864+0000","last_active":"2024-06-04T16:22:59.503813+0000","last_peered":"2024-06-04T16:22:59.503813+0000","last_clean":"2024-06-04T16:22:59.503813+0000","last_became_active":"2024-06-04T15:52:40.478417+0000","last_became_peered":"2024-06-04T15:52:40.478417+0000","last_unstale":"2024-06-04T16:22:59.503813+0000","last_undegraded":"2024-06-04T16:22:59.503813+0000","last_fullsized":"2024-06-04T16:22:59.503813+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:22:59.503712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:22:59.503712+0000","last_clean_scrub_stamp":"2024-06-04T16:22:59.503712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T19:24:36.842678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"254'92","reported_seq":640,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:25.812420+0000","last_change":"2024-06-04T16:23:25.812462+0000","last_active":"2024-06-04T16:23:25.812420+0000","last_peered":"2024-06-04T16:23:25.812420+0000","last_clean":"2024-06-04T16:23:25.812420+0000","last_became_active":"2024-06-04T15:52:42.496263+0000","last_became_peered":"2024-06-04T15:52:42.496263+0000","last_unstale":"2024-06-04T16:23:25.812420+0000","last_undegraded":"2024-06-04T16:23:25.812420+0000","last_fullsized":"2024-06-04T16:23:25.812420+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'92","last_scrub_stamp":"2024-06-04T16:23:25.812328+0000","last_deep_scrub":"254'92","last_deep_scrub_stamp":"2024-06-04T16:23:25.812328+0000","last_clean_scrub_stamp":"2024-06-04T16:23:25.812328+0000","objects_scrubbed":4,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T19:24:39.575301+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7956,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":138,"num_read_kb":200,"num_write":66,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":474,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:04.870935+0000","last_change":"2024-06-04T16:23:04.870958+0000","last_active":"2024-06-04T16:23:04.870935+0000","last_peered":"2024-06-04T16:23:04.870935+0000","last_clean":"2024-06-04T16:23:04.870935+0000","last_became_active":"2024-06-04T15:52:44.520051+0000","last_became_peered":"2024-06-04T15:52:44.520051+0000","last_unstale":"2024-06-04T16:23:04.870935+0000","last_undegraded":"2024-06-04T16:23:04.870935+0000","last_fullsized":"2024-06-04T16:23:04.870935+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:23:04.870830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:23:04.870830+0000","last_clean_scrub_stamp":"2024-06-04T16:23:04.870830+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T20:14:18.357003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"254'40","reported_seq":557,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:57.535519+0000","last_change":"2024-06-04T16:22:57.535547+0000","last_active":"2024-06-04T16:22:57.535519+0000","last_peered":"2024-06-04T16:22:57.535519+0000","last_clean":"2024-06-04T16:22:57.535519+0000","last_became_active":"2024-06-04T15:52:46.541897+0000","last_became_peered":"2024-06-04T15:52:46.541897+0000","last_unstale":"2024-06-04T16:22:57.535519+0000","last_undegraded":"2024-06-04T16:22:57.535519+0000","last_fullsized":"2024-06-04T16:22:57.535519+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'40","last_scrub_stamp":"2024-06-04T16:22:57.535425+0000","last_deep_scrub":"254'40","last_deep_scrub_stamp":"2024-06-04T16:22:57.535425+0000","last_clean_scrub_stamp":"2024-06-04T16:22:57.535425+0000","objects_scrubbed":1,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T01:55:20.316635+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":549,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":152,"num_read_kb":137,"num_write":99,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"254'124","reported_seq":861,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:20.913058+0000","last_change":"2024-06-04T16:23:20.913058+0000","last_active":"2024-06-04T16:23:20.913058+0000","last_peered":"2024-06-04T16:23:20.913058+0000","last_clean":"2024-06-04T16:23:20.913058+0000","last_became_active":"2024-06-04T15:52:38.482388+0000","last_became_peered":"2024-06-04T15:52:38.482388+0000","last_unstale":"2024-06-04T16:23:20.913058+0000","last_undegraded":"2024-06-04T16:23:20.913058+0000","last_fullsized":"2024-06-04T16:23:20.913058+0000","mapping_epoch":23,"log_start":"251'100","ondisk_log_start":"251'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'124","last_scrub_stamp":"2024-06-04T16:23:20.912932+0000","last_deep_scrub":"254'124","last_deep_scrub_stamp":"2024-06-04T16:23:20.912932+0000","last_clean_scrub_stamp":"2024-06-04T16:23:20.912932+0000","objects_scrubbed":2,"log_size":24,"log_dups_size":100,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T21:56:21.589196+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":625,"num_read_kb":571,"num_write":157,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1e","version":"251'81","reported_seq":621,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:34.360778+0000","last_change":"2024-06-04T16:23:34.360865+0000","last_active":"2024-06-04T16:23:34.360778+0000","last_peered":"2024-06-04T16:23:34.360778+0000","last_clean":"2024-06-04T16:23:34.360778+0000","last_became_active":"2024-06-04T15:52:36.485401+0000","last_became_peered":"2024-06-04T15:52:36.485401+0000","last_unstale":"2024-06-04T16:23:34.360778+0000","last_undegraded":"2024-06-04T16:23:34.360778+0000","last_fullsized":"2024-06-04T16:23:34.360778+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"251'81","last_scrub_stamp":"2024-06-04T16:23:34.360665+0000","last_deep_scrub":"251'81","last_deep_scrub_stamp":"2024-06-04T16:23:34.360665+0000","last_clean_scrub_stamp":"2024-06-04T16:23:34.360665+0000","objects_scrubbed":4,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T04:14:33.483293+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133679,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":131,"num_read_kb":40112,"num_write":294,"num_write_kb":27266,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,3],"acting":[5,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":486,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:02.189383+0000","last_change":"2024-06-04T16:23:02.189383+0000","last_active":"2024-06-04T16:23:02.189383+0000","last_peered":"2024-06-04T16:23:02.189383+0000","last_clean":"2024-06-04T16:23:02.189383+0000","last_became_active":"2024-06-04T15:52:40.483272+0000","last_became_peered":"2024-06-04T15:52:40.483272+0000","last_unstale":"2024-06-04T16:23:02.189383+0000","last_undegraded":"2024-06-04T16:23:02.189383+0000","last_fullsized":"2024-06-04T16:23:02.189383+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:23:02.189267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:23:02.189267+0000","last_clean_scrub_stamp":"2024-06-04T16:23:02.189267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T00:51:47.779975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"254'83","reported_seq":621,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:58.065530+0000","last_change":"2024-06-04T16:22:58.065561+0000","last_active":"2024-06-04T16:22:58.065530+0000","last_peered":"2024-06-04T16:22:58.065530+0000","last_clean":"2024-06-04T16:22:58.065530+0000","last_became_active":"2024-06-04T15:52:42.496934+0000","last_became_peered":"2024-06-04T15:52:42.496934+0000","last_unstale":"2024-06-04T16:22:58.065530+0000","last_undegraded":"2024-06-04T16:22:58.065530+0000","last_fullsized":"2024-06-04T16:22:58.065530+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'83","last_scrub_stamp":"2024-06-04T16:22:58.065438+0000","last_deep_scrub":"254'83","last_deep_scrub_stamp":"2024-06-04T16:22:58.065438+0000","last_clean_scrub_stamp":"2024-06-04T16:22:58.065438+0000","objects_scrubbed":2,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T03:24:48.725441+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8160,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":120,"num_read_kb":184,"num_write":54,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":474,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:05.903821+0000","last_change":"2024-06-04T16:23:05.903856+0000","last_active":"2024-06-04T16:23:05.903821+0000","last_peered":"2024-06-04T16:23:05.903821+0000","last_clean":"2024-06-04T16:23:05.903821+0000","last_became_active":"2024-06-04T15:52:44.518782+0000","last_became_peered":"2024-06-04T15:52:44.518782+0000","last_unstale":"2024-06-04T16:23:05.903821+0000","last_undegraded":"2024-06-04T16:23:05.903821+0000","last_fullsized":"2024-06-04T16:23:05.903821+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:23:05.903728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:23:05.903728+0000","last_clean_scrub_stamp":"2024-06-04T16:23:05.903728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T19:53:16.916764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"254'44","reported_seq":540,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:46.089113+0000","last_change":"2024-06-04T16:22:46.089139+0000","last_active":"2024-06-04T16:22:46.089113+0000","last_peered":"2024-06-04T16:22:46.089113+0000","last_clean":"2024-06-04T16:22:46.089113+0000","last_became_active":"2024-06-04T15:52:46.531795+0000","last_became_peered":"2024-06-04T15:52:46.531795+0000","last_unstale":"2024-06-04T16:22:46.089113+0000","last_undegraded":"2024-06-04T16:22:46.089113+0000","last_fullsized":"2024-06-04T16:22:46.089113+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'44","last_scrub_stamp":"2024-06-04T16:22:46.089042+0000","last_deep_scrub":"254'44","last_deep_scrub_stamp":"2024-06-04T16:22:46.089042+0000","last_clean_scrub_stamp":"2024-06-04T16:22:46.089042+0000","objects_scrubbed":3,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T18:19:03.232432+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":429,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":136,"num_read_kb":110,"num_write":109,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"254'359","reported_seq":1104,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:12.517047+0000","last_change":"2024-06-04T16:23:12.517047+0000","last_active":"2024-06-04T16:23:12.517047+0000","last_peered":"2024-06-04T16:23:12.517047+0000","last_clean":"2024-06-04T16:23:12.517047+0000","last_became_active":"2024-06-04T15:52:38.478204+0000","last_became_peered":"2024-06-04T15:52:38.478204+0000","last_unstale":"2024-06-04T16:23:12.517047+0000","last_undegraded":"2024-06-04T16:23:12.517047+0000","last_fullsized":"2024-06-04T16:23:12.517047+0000","mapping_epoch":23,"log_start":"251'300","ondisk_log_start":"251'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'359","last_scrub_stamp":"2024-06-04T16:23:12.516911+0000","last_deep_scrub":"254'359","last_deep_scrub_stamp":"2024-06-04T16:23:12.516911+0000","last_clean_scrub_stamp":"2024-06-04T16:23:12.516911+0000","objects_scrubbed":3,"log_size":59,"log_dups_size":300,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T01:34:27.842574+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1642,"num_read_kb":1482,"num_write":614,"num_write_kb":292,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":768,"num_omap_keys":5,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"251'22","reported_seq":523,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:28.414343+0000","last_change":"2024-06-04T16:23:28.414343+0000","last_active":"2024-06-04T16:23:28.414343+0000","last_peered":"2024-06-04T16:23:28.414343+0000","last_clean":"2024-06-04T16:23:28.414343+0000","last_became_active":"2024-06-04T15:52:36.477895+0000","last_became_peered":"2024-06-04T15:52:36.477895+0000","last_unstale":"2024-06-04T16:23:28.414343+0000","last_undegraded":"2024-06-04T16:23:28.414343+0000","last_fullsized":"2024-06-04T16:23:28.414343+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"251'22","last_scrub_stamp":"2024-06-04T16:23:28.414169+0000","last_deep_scrub":"251'22","last_deep_scrub_stamp":"2024-06-04T16:23:28.414169+0000","last_clean_scrub_stamp":"2024-06-04T16:23:28.414169+0000","objects_scrubbed":3,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T02:46:15.884004+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":78,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":120,"num_write_kb":13440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.19","version":"254'2","reported_seq":485,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:10.003136+0000","last_change":"2024-06-04T16:23:10.003165+0000","last_active":"2024-06-04T16:23:10.003136+0000","last_peered":"2024-06-04T16:23:10.003136+0000","last_clean":"2024-06-04T16:23:10.003136+0000","last_became_active":"2024-06-04T15:52:40.483131+0000","last_became_peered":"2024-06-04T15:52:40.483131+0000","last_unstale":"2024-06-04T16:23:10.003136+0000","last_undegraded":"2024-06-04T16:23:10.003136+0000","last_fullsized":"2024-06-04T16:23:10.003136+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'2","last_scrub_stamp":"2024-06-04T16:23:10.003044+0000","last_deep_scrub":"254'2","last_deep_scrub_stamp":"2024-06-04T16:23:10.003044+0000","last_clean_scrub_stamp":"2024-06-04T16:23:10.003044+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T20:22:25.334380+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1a","version":"254'123","reported_seq":685,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:07.878541+0000","last_change":"2024-06-04T16:23:07.878570+0000","last_active":"2024-06-04T16:23:07.878541+0000","last_peered":"2024-06-04T16:23:07.878541+0000","last_clean":"2024-06-04T16:23:07.878541+0000","last_became_active":"2024-06-04T15:52:42.503538+0000","last_became_peered":"2024-06-04T15:52:42.503538+0000","last_unstale":"2024-06-04T16:23:07.878541+0000","last_undegraded":"2024-06-04T16:23:07.878541+0000","last_fullsized":"2024-06-04T16:23:07.878541+0000","mapping_epoch":27,"log_start":"251'100","ondisk_log_start":"251'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'123","last_scrub_stamp":"2024-06-04T16:23:07.878472+0000","last_deep_scrub":"254'123","last_deep_scrub_stamp":"2024-06-04T16:23:07.878472+0000","last_clean_scrub_stamp":"2024-06-04T16:23:07.878472+0000","objects_scrubbed":4,"log_size":23,"log_dups_size":100,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T17:02:13.406205+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6196,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":182,"num_read_kb":236,"num_write":96,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":475,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:53.984901+0000","last_change":"2024-06-04T16:22:53.984929+0000","last_active":"2024-06-04T16:22:53.984901+0000","last_peered":"2024-06-04T16:22:53.984901+0000","last_clean":"2024-06-04T16:22:53.984901+0000","last_became_active":"2024-06-04T15:52:44.519867+0000","last_became_peered":"2024-06-04T15:52:44.519867+0000","last_unstale":"2024-06-04T16:22:53.984901+0000","last_undegraded":"2024-06-04T16:22:53.984901+0000","last_fullsized":"2024-06-04T16:22:53.984901+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-04T16:22:53.984790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-04T16:22:53.984790+0000","last_clean_scrub_stamp":"2024-06-04T16:22:53.984790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T22:21:34.850045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.14","version":"254'32","reported_seq":541,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:46.906396+0000","last_change":"2024-06-04T16:22:46.906396+0000","last_active":"2024-06-04T16:22:46.906396+0000","last_peered":"2024-06-04T16:22:46.906396+0000","last_clean":"2024-06-04T16:22:46.906396+0000","last_became_active":"2024-06-04T15:52:46.537792+0000","last_became_peered":"2024-06-04T15:52:46.537792+0000","last_unstale":"2024-06-04T16:22:46.906396+0000","last_undegraded":"2024-06-04T16:22:46.906396+0000","last_fullsized":"2024-06-04T16:22:46.906396+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'32","last_scrub_stamp":"2024-06-04T16:22:46.906299+0000","last_deep_scrub":"254'32","last_deep_scrub_stamp":"2024-06-04T16:22:46.906299+0000","last_clean_scrub_stamp":"2024-06-04T16:22:46.906299+0000","objects_scrubbed":2,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T20:36:00.317258+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":433,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":163,"num_read_kb":128,"num_write":83,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"254'157","reported_seq":957,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:05.024132+0000","last_change":"2024-06-04T16:23:05.024162+0000","last_active":"2024-06-04T16:23:05.024132+0000","last_peered":"2024-06-04T16:23:05.024132+0000","last_clean":"2024-06-04T16:23:05.024132+0000","last_became_active":"2024-06-04T15:52:38.486335+0000","last_became_peered":"2024-06-04T15:52:38.486335+0000","last_unstale":"2024-06-04T16:23:05.024132+0000","last_undegraded":"2024-06-04T16:23:05.024132+0000","last_fullsized":"2024-06-04T16:23:05.024132+0000","mapping_epoch":23,"log_start":"251'100","ondisk_log_start":"251'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'157","last_scrub_stamp":"2024-06-04T16:23:05.024043+0000","last_deep_scrub":"254'157","last_deep_scrub_stamp":"2024-06-04T16:23:05.024043+0000","last_clean_scrub_stamp":"2024-06-04T16:23:05.024043+0000","objects_scrubbed":1,"log_size":57,"log_dups_size":100,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T17:07:05.833438+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":839,"num_read_kb":763,"num_write":210,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":310,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.20","version":"254'54","reported_seq":578,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:52.513504+0000","last_change":"2024-06-04T16:22:52.513504+0000","last_active":"2024-06-04T16:22:52.513504+0000","last_peered":"2024-06-04T16:22:52.513504+0000","last_clean":"2024-06-04T16:22:52.513504+0000","last_became_active":"2024-06-04T15:53:14.002428+0000","last_became_peered":"2024-06-04T15:53:14.002428+0000","last_unstale":"2024-06-04T16:22:52.513504+0000","last_undegraded":"2024-06-04T16:22:52.513504+0000","last_fullsized":"2024-06-04T16:22:52.513504+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'54","last_scrub_stamp":"2024-06-04T16:22:52.513364+0000","last_deep_scrub":"254'54","last_deep_scrub_stamp":"2024-06-04T16:22:52.513364+0000","last_clean_scrub_stamp":"2024-06-04T16:22:52.513364+0000","objects_scrubbed":2,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T03:21:52.616336+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":15429,"num_write":206,"num_write_kb":34585,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5],"acting":[2,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"254'241","reported_seq":921,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:27.953079+0000","last_change":"2024-06-04T16:23:27.953105+0000","last_active":"2024-06-04T16:23:27.953079+0000","last_peered":"2024-06-04T16:23:27.953079+0000","last_clean":"2024-06-04T16:23:27.953079+0000","last_became_active":"2024-06-04T15:52:38.481490+0000","last_became_peered":"2024-06-04T15:52:38.481490+0000","last_unstale":"2024-06-04T16:23:27.953079+0000","last_undegraded":"2024-06-04T16:23:27.953079+0000","last_fullsized":"2024-06-04T16:23:27.953079+0000","mapping_epoch":23,"log_start":"251'200","ondisk_log_start":"251'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'241","last_scrub_stamp":"2024-06-04T16:23:27.952981+0000","last_deep_scrub":"254'241","last_deep_scrub_stamp":"2024-06-04T16:23:27.952981+0000","last_clean_scrub_stamp":"2024-06-04T16:23:27.952981+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":200,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T23:20:40.006254+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1011,"num_read_kb":836,"num_write":379,"num_write_kb":158,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.21","version":"254'54","reported_seq":565,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:23.941130+0000","last_change":"2024-06-04T16:23:23.941130+0000","last_active":"2024-06-04T16:23:23.941130+0000","last_peered":"2024-06-04T16:23:23.941130+0000","last_clean":"2024-06-04T16:23:23.941130+0000","last_became_active":"2024-06-04T15:52:36.495008+0000","last_became_peered":"2024-06-04T15:52:36.495008+0000","last_unstale":"2024-06-04T16:23:23.941130+0000","last_undegraded":"2024-06-04T16:23:23.941130+0000","last_fullsized":"2024-06-04T16:23:23.941130+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'54","last_scrub_stamp":"2024-06-04T16:23:23.941009+0000","last_deep_scrub":"254'54","last_deep_scrub_stamp":"2024-06-04T16:23:23.941009+0000","last_clean_scrub_stamp":"2024-06-04T16:23:23.941009+0000","objects_scrubbed":1,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T19:31:11.830953+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":63,"num_read_kb":12338,"num_write":219,"num_write_kb":31559,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.25","version":"254'141","reported_seq":986,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:24.701155+0000","last_change":"2024-06-04T16:23:24.701221+0000","last_active":"2024-06-04T16:23:24.701155+0000","last_peered":"2024-06-04T16:23:24.701155+0000","last_clean":"2024-06-04T16:23:24.701155+0000","last_became_active":"2024-06-04T15:52:38.481916+0000","last_became_peered":"2024-06-04T15:52:38.481916+0000","last_unstale":"2024-06-04T16:23:24.701155+0000","last_undegraded":"2024-06-04T16:23:24.701155+0000","last_fullsized":"2024-06-04T16:23:24.701155+0000","mapping_epoch":23,"log_start":"251'100","ondisk_log_start":"251'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'141","last_scrub_stamp":"2024-06-04T16:23:24.701055+0000","last_deep_scrub":"254'141","last_deep_scrub_stamp":"2024-06-04T16:23:24.701055+0000","last_clean_scrub_stamp":"2024-06-04T16:23:24.701055+0000","objects_scrubbed":3,"log_size":41,"log_dups_size":100,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T18:19:37.940704+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":911,"num_read_kb":859,"num_write":180,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3772,"num_omap_keys":15,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"254'58","reported_seq":595,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:39.539013+0000","last_change":"2024-06-04T16:23:39.539013+0000","last_active":"2024-06-04T16:23:39.539013+0000","last_peered":"2024-06-04T16:23:39.539013+0000","last_clean":"2024-06-04T16:23:39.539013+0000","last_became_active":"2024-06-04T15:52:36.482589+0000","last_became_peered":"2024-06-04T15:52:36.482589+0000","last_unstale":"2024-06-04T16:23:39.539013+0000","last_undegraded":"2024-06-04T16:23:39.539013+0000","last_fullsized":"2024-06-04T16:23:39.539013+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'58","last_scrub_stamp":"2024-06-04T16:23:39.538890+0000","last_deep_scrub":"254'58","last_deep_scrub_stamp":"2024-06-04T16:23:39.538890+0000","last_clean_scrub_stamp":"2024-06-04T16:23:39.538890+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T03:29:04.326921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":134,"num_read_kb":8380,"num_write":298,"num_write_kb":18008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7],"acting":[3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"254'104","reported_seq":821,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:17.351225+0000","last_change":"2024-06-04T16:23:17.351254+0000","last_active":"2024-06-04T16:23:17.351225+0000","last_peered":"2024-06-04T16:23:17.351225+0000","last_clean":"2024-06-04T16:23:17.351225+0000","last_became_active":"2024-06-04T15:52:38.486018+0000","last_became_peered":"2024-06-04T15:52:38.486018+0000","last_unstale":"2024-06-04T16:23:17.351225+0000","last_undegraded":"2024-06-04T16:23:17.351225+0000","last_fullsized":"2024-06-04T16:23:17.351225+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'104","last_scrub_stamp":"2024-06-04T16:23:17.351135+0000","last_deep_scrub":"254'104","last_deep_scrub_stamp":"2024-06-04T16:23:17.351135+0000","last_clean_scrub_stamp":"2024-06-04T16:23:17.351135+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T00:18:13.126137+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":549,"num_read_kb":515,"num_write":118,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"251'48","reported_seq":569,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:21.369661+0000","last_change":"2024-06-04T16:23:21.369661+0000","last_active":"2024-06-04T16:23:21.369661+0000","last_peered":"2024-06-04T16:23:21.369661+0000","last_clean":"2024-06-04T16:23:21.369661+0000","last_became_active":"2024-06-04T15:52:36.496125+0000","last_became_peered":"2024-06-04T15:52:36.496125+0000","last_unstale":"2024-06-04T16:23:21.369661+0000","last_undegraded":"2024-06-04T16:23:21.369661+0000","last_fullsized":"2024-06-04T16:23:21.369661+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"251'48","last_scrub_stamp":"2024-06-04T16:23:21.369501+0000","last_deep_scrub":"251'48","last_deep_scrub_stamp":"2024-06-04T16:23:21.369501+0000","last_clean_scrub_stamp":"2024-06-04T16:23:21.369501+0000","objects_scrubbed":4,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T04:23:20.241786+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":98,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":59,"num_read_kb":26302,"num_write":204,"num_write_kb":24798,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,0],"acting":[5,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.23","version":"254'93","reported_seq":817,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:19.356194+0000","last_change":"2024-06-04T16:23:19.356194+0000","last_active":"2024-06-04T16:23:19.356194+0000","last_peered":"2024-06-04T16:23:19.356194+0000","last_clean":"2024-06-04T16:23:19.356194+0000","last_became_active":"2024-06-04T15:52:38.484927+0000","last_became_peered":"2024-06-04T15:52:38.484927+0000","last_unstale":"2024-06-04T16:23:19.356194+0000","last_undegraded":"2024-06-04T16:23:19.356194+0000","last_fullsized":"2024-06-04T16:23:19.356194+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'93","last_scrub_stamp":"2024-06-04T16:23:19.356033+0000","last_deep_scrub":"254'93","last_deep_scrub_stamp":"2024-06-04T16:23:19.356033+0000","last_clean_scrub_stamp":"2024-06-04T16:23:19.356033+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T02:30:50.349506+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":509,"num_read_kb":485,"num_write":106,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"254'52","reported_seq":564,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:51.205408+0000","last_change":"2024-06-04T16:22:51.205408+0000","last_active":"2024-06-04T16:22:51.205408+0000","last_peered":"2024-06-04T16:22:51.205408+0000","last_clean":"2024-06-04T16:22:51.205408+0000","last_became_active":"2024-06-04T15:53:14.183279+0000","last_became_peered":"2024-06-04T15:53:14.183279+0000","last_unstale":"2024-06-04T16:22:51.205408+0000","last_undegraded":"2024-06-04T16:22:51.205408+0000","last_fullsized":"2024-06-04T16:22:51.205408+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'52","last_scrub_stamp":"2024-06-04T16:22:51.205271+0000","last_deep_scrub":"254'52","last_deep_scrub_stamp":"2024-06-04T16:22:51.205271+0000","last_clean_scrub_stamp":"2024-06-04T16:22:51.205271+0000","objects_scrubbed":3,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T01:25:25.764034+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1395816,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":52,"num_read_kb":1141,"num_write":191,"num_write_kb":22936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.22","version":"254'209","reported_seq":1112,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:52.914964+0000","last_change":"2024-06-04T16:22:52.914964+0000","last_active":"2024-06-04T16:22:52.914964+0000","last_peered":"2024-06-04T16:22:52.914964+0000","last_clean":"2024-06-04T16:22:52.914964+0000","last_became_active":"2024-06-04T15:52:38.488762+0000","last_became_peered":"2024-06-04T15:52:38.488762+0000","last_unstale":"2024-06-04T16:22:52.914964+0000","last_undegraded":"2024-06-04T16:22:52.914964+0000","last_fullsized":"2024-06-04T16:22:52.914964+0000","mapping_epoch":23,"log_start":"251'100","ondisk_log_start":"251'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'209","last_scrub_stamp":"2024-06-04T16:22:52.914808+0000","last_deep_scrub":"254'209","last_deep_scrub_stamp":"2024-06-04T16:22:52.914808+0000","last_clean_scrub_stamp":"2024-06-04T16:22:52.914808+0000","objects_scrubbed":1,"log_size":109,"log_dups_size":100,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T19:07:05.255680+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1221,"num_read_kb":1130,"num_write":279,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.25","version":"254'51","reported_seq":560,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:16.130444+0000","last_change":"2024-06-04T16:23:16.130481+0000","last_active":"2024-06-04T16:23:16.130444+0000","last_peered":"2024-06-04T16:23:16.130444+0000","last_clean":"2024-06-04T16:23:16.130444+0000","last_became_active":"2024-06-04T15:52:36.488611+0000","last_became_peered":"2024-06-04T15:52:36.488611+0000","last_unstale":"2024-06-04T16:23:16.130444+0000","last_undegraded":"2024-06-04T16:23:16.130444+0000","last_fullsized":"2024-06-04T16:23:16.130444+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'51","last_scrub_stamp":"2024-06-04T16:23:16.130347+0000","last_deep_scrub":"254'51","last_deep_scrub_stamp":"2024-06-04T16:23:16.130347+0000","last_clean_scrub_stamp":"2024-06-04T16:23:16.130347+0000","objects_scrubbed":3,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T21:31:44.332783+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":75,"num_read_kb":4172,"num_write":239,"num_write_kb":26328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"254'159","reported_seq":925,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:07.029052+0000","last_change":"2024-06-04T16:23:07.029052+0000","last_active":"2024-06-04T16:23:07.029052+0000","last_peered":"2024-06-04T16:23:07.029052+0000","last_clean":"2024-06-04T16:23:07.029052+0000","last_became_active":"2024-06-04T15:52:38.482566+0000","last_became_peered":"2024-06-04T15:52:38.482566+0000","last_unstale":"2024-06-04T16:23:07.029052+0000","last_undegraded":"2024-06-04T16:23:07.029052+0000","last_fullsized":"2024-06-04T16:23:07.029052+0000","mapping_epoch":23,"log_start":"251'100","ondisk_log_start":"251'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'159","last_scrub_stamp":"2024-06-04T16:23:07.028928+0000","last_deep_scrub":"254'159","last_deep_scrub_stamp":"2024-06-04T16:23:07.028928+0000","last_clean_scrub_stamp":"2024-06-04T16:23:07.028928+0000","objects_scrubbed":2,"log_size":59,"log_dups_size":100,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T03:04:52.237492+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":759,"num_read_kb":686,"num_write":203,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"254'59","reported_seq":569,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:19.645912+0000","last_change":"2024-06-04T16:23:19.646017+0000","last_active":"2024-06-04T16:23:19.645912+0000","last_peered":"2024-06-04T16:23:19.645912+0000","last_clean":"2024-06-04T16:23:19.645912+0000","last_became_active":"2024-06-04T15:52:36.487213+0000","last_became_peered":"2024-06-04T15:52:36.487213+0000","last_unstale":"2024-06-04T16:23:19.645912+0000","last_undegraded":"2024-06-04T16:23:19.645912+0000","last_fullsized":"2024-06-04T16:23:19.645912+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'59","last_scrub_stamp":"2024-06-04T16:23:19.645791+0000","last_deep_scrub":"254'59","last_deep_scrub_stamp":"2024-06-04T16:23:19.645791+0000","last_clean_scrub_stamp":"2024-06-04T16:23:19.645791+0000","objects_scrubbed":10,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T22:08:24.782217+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3860915,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":58,"num_read_kb":7398,"num_write":258,"num_write_kb":28567,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"254'121","reported_seq":872,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:13.303628+0000","last_change":"2024-06-04T16:23:13.303628+0000","last_active":"2024-06-04T16:23:13.303628+0000","last_peered":"2024-06-04T16:23:13.303628+0000","last_clean":"2024-06-04T16:23:13.303628+0000","last_became_active":"2024-06-04T15:52:38.477036+0000","last_became_peered":"2024-06-04T15:52:38.477036+0000","last_unstale":"2024-06-04T16:23:13.303628+0000","last_undegraded":"2024-06-04T16:23:13.303628+0000","last_fullsized":"2024-06-04T16:23:13.303628+0000","mapping_epoch":23,"log_start":"251'100","ondisk_log_start":"251'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'121","last_scrub_stamp":"2024-06-04T16:23:13.303496+0000","last_deep_scrub":"254'121","last_deep_scrub_stamp":"2024-06-04T16:23:13.303496+0000","last_clean_scrub_stamp":"2024-06-04T16:23:13.303496+0000","objects_scrubbed":1,"log_size":21,"log_dups_size":100,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T21:06:12.727561+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":627,"num_read_kb":578,"num_write":156,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"254'48","reported_seq":572,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:30.366835+0000","last_change":"2024-06-04T16:23:30.366909+0000","last_active":"2024-06-04T16:23:30.366835+0000","last_peered":"2024-06-04T16:23:30.366835+0000","last_clean":"2024-06-04T16:23:30.366835+0000","last_became_active":"2024-06-04T15:52:36.479810+0000","last_became_peered":"2024-06-04T15:52:36.479810+0000","last_unstale":"2024-06-04T16:23:30.366835+0000","last_undegraded":"2024-06-04T16:23:30.366835+0000","last_fullsized":"2024-06-04T16:23:30.366835+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'48","last_scrub_stamp":"2024-06-04T16:23:30.366714+0000","last_deep_scrub":"254'48","last_deep_scrub_stamp":"2024-06-04T16:23:30.366714+0000","last_clean_scrub_stamp":"2024-06-04T16:23:30.366714+0000","objects_scrubbed":2,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T00:29:55.578633+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048839,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":103,"num_read_kb":5904,"num_write":252,"num_write_kb":17938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2f","version":"254'58","reported_seq":716,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:28.989494+0000","last_change":"2024-06-04T16:23:28.989521+0000","last_active":"2024-06-04T16:23:28.989494+0000","last_peered":"2024-06-04T16:23:28.989494+0000","last_clean":"2024-06-04T16:23:28.989494+0000","last_became_active":"2024-06-04T15:52:38.481789+0000","last_became_peered":"2024-06-04T15:52:38.481789+0000","last_unstale":"2024-06-04T16:23:28.989494+0000","last_undegraded":"2024-06-04T16:23:28.989494+0000","last_fullsized":"2024-06-04T16:23:28.989494+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'58","last_scrub_stamp":"2024-06-04T16:23:28.989400+0000","last_deep_scrub":"254'58","last_deep_scrub_stamp":"2024-06-04T16:23:28.989400+0000","last_clean_scrub_stamp":"2024-06-04T16:23:28.989400+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T23:45:20.172672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":316,"num_read_kb":309,"num_write":62,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.28","version":"254'57","reported_seq":601,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:33.639337+0000","last_change":"2024-06-04T16:23:33.639408+0000","last_active":"2024-06-04T16:23:33.639337+0000","last_peered":"2024-06-04T16:23:33.639337+0000","last_clean":"2024-06-04T16:23:33.639337+0000","last_became_active":"2024-06-04T15:52:36.490119+0000","last_became_peered":"2024-06-04T15:52:36.490119+0000","last_unstale":"2024-06-04T16:23:33.639337+0000","last_undegraded":"2024-06-04T16:23:33.639337+0000","last_fullsized":"2024-06-04T16:23:33.639337+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'57","last_scrub_stamp":"2024-06-04T16:23:33.639218+0000","last_deep_scrub":"254'57","last_deep_scrub_stamp":"2024-06-04T16:23:33.639218+0000","last_clean_scrub_stamp":"2024-06-04T16:23:33.639218+0000","objects_scrubbed":2,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T02:53:51.075995+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262178,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":124,"num_read_kb":46547,"num_write":231,"num_write_kb":19872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7],"acting":[3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"254'93","reported_seq":787,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:22:50.895803+0000","last_change":"2024-06-04T16:22:50.895803+0000","last_active":"2024-06-04T16:22:50.895803+0000","last_peered":"2024-06-04T16:22:50.895803+0000","last_clean":"2024-06-04T16:22:50.895803+0000","last_became_active":"2024-06-04T15:52:38.488839+0000","last_became_peered":"2024-06-04T15:52:38.488839+0000","last_unstale":"2024-06-04T16:22:50.895803+0000","last_undegraded":"2024-06-04T16:22:50.895803+0000","last_fullsized":"2024-06-04T16:22:50.895803+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'93","last_scrub_stamp":"2024-06-04T16:22:50.895627+0000","last_deep_scrub":"254'93","last_deep_scrub_stamp":"2024-06-04T16:22:50.895627+0000","last_clean_scrub_stamp":"2024-06-04T16:22:50.895627+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T23:08:02.213621+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":464,"num_read_kb":434,"num_write":108,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.29","version":"254'42","reported_seq":555,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:25.405112+0000","last_change":"2024-06-04T16:23:25.405152+0000","last_active":"2024-06-04T16:23:25.405112+0000","last_peered":"2024-06-04T16:23:25.405112+0000","last_clean":"2024-06-04T16:23:25.405112+0000","last_became_active":"2024-06-04T15:52:36.495936+0000","last_became_peered":"2024-06-04T15:52:36.495936+0000","last_unstale":"2024-06-04T16:23:25.405112+0000","last_undegraded":"2024-06-04T16:23:25.405112+0000","last_fullsized":"2024-06-04T16:23:25.405112+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'42","last_scrub_stamp":"2024-06-04T16:23:25.405021+0000","last_deep_scrub":"254'42","last_deep_scrub_stamp":"2024-06-04T16:23:25.405021+0000","last_clean_scrub_stamp":"2024-06-04T16:23:25.405021+0000","objects_scrubbed":3,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T02:15:18.635727+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133666,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":74,"num_read_kb":10396,"num_write":213,"num_write_kb":18947,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,0],"acting":[5,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2d","version":"254'116","reported_seq":808,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:14.334409+0000","last_change":"2024-06-04T16:23:14.334467+0000","last_active":"2024-06-04T16:23:14.334409+0000","last_peered":"2024-06-04T16:23:14.334409+0000","last_clean":"2024-06-04T16:23:14.334409+0000","last_became_active":"2024-06-04T15:52:38.488289+0000","last_became_peered":"2024-06-04T15:52:38.488289+0000","last_unstale":"2024-06-04T16:23:14.334409+0000","last_undegraded":"2024-06-04T16:23:14.334409+0000","last_fullsized":"2024-06-04T16:23:14.334409+0000","mapping_epoch":23,"log_start":"251'100","ondisk_log_start":"251'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'116","last_scrub_stamp":"2024-06-04T16:23:14.334288+0000","last_deep_scrub":"254'116","last_deep_scrub_stamp":"2024-06-04T16:23:14.334288+0000","last_clean_scrub_stamp":"2024-06-04T16:23:14.334288+0000","objects_scrubbed":1,"log_size":16,"log_dups_size":100,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T23:45:48.859590+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":534,"num_read_kb":481,"num_write":150,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":476,"num_omap_keys":2,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"254'66","reported_seq":583,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:20.375444+0000","last_change":"2024-06-04T16:23:20.375511+0000","last_active":"2024-06-04T16:23:20.375444+0000","last_peered":"2024-06-04T16:23:20.375444+0000","last_clean":"2024-06-04T16:23:20.375444+0000","last_became_active":"2024-06-04T15:52:36.495386+0000","last_became_peered":"2024-06-04T15:52:36.495386+0000","last_unstale":"2024-06-04T16:23:20.375444+0000","last_undegraded":"2024-06-04T16:23:20.375444+0000","last_fullsized":"2024-06-04T16:23:20.375444+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'66","last_scrub_stamp":"2024-06-04T16:23:20.375334+0000","last_deep_scrub":"254'66","last_deep_scrub_stamp":"2024-06-04T16:23:20.375334+0000","last_clean_scrub_stamp":"2024-06-04T16:23:20.375334+0000","objects_scrubbed":6,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T23:23:00.148285+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4553920,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":69,"num_read_kb":17530,"num_write":238,"num_write_kb":31151,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"254'93","reported_seq":840,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:11.291672+0000","last_change":"2024-06-04T16:23:11.291720+0000","last_active":"2024-06-04T16:23:11.291672+0000","last_peered":"2024-06-04T16:23:11.291672+0000","last_clean":"2024-06-04T16:23:11.291672+0000","last_became_active":"2024-06-04T15:52:38.477333+0000","last_became_peered":"2024-06-04T15:52:38.477333+0000","last_unstale":"2024-06-04T16:23:11.291672+0000","last_undegraded":"2024-06-04T16:23:11.291672+0000","last_fullsized":"2024-06-04T16:23:11.291672+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'93","last_scrub_stamp":"2024-06-04T16:23:11.291552+0000","last_deep_scrub":"254'93","last_deep_scrub_stamp":"2024-06-04T16:23:11.291552+0000","last_clean_scrub_stamp":"2024-06-04T16:23:11.291552+0000","objects_scrubbed":3,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T18:53:46.897687+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":521,"num_read_kb":500,"num_write":102,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"251'47","reported_seq":567,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:22.840571+0000","last_change":"2024-06-04T16:23:22.840607+0000","last_active":"2024-06-04T16:23:22.840571+0000","last_peered":"2024-06-04T16:23:22.840571+0000","last_clean":"2024-06-04T16:23:22.840571+0000","last_became_active":"2024-06-04T15:52:36.482036+0000","last_became_peered":"2024-06-04T15:52:36.482036+0000","last_unstale":"2024-06-04T16:23:22.840571+0000","last_undegraded":"2024-06-04T16:23:22.840571+0000","last_fullsized":"2024-06-04T16:23:22.840571+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"251'47","last_scrub_stamp":"2024-06-04T16:23:22.840471+0000","last_deep_scrub":"251'47","last_deep_scrub_stamp":"2024-06-04T16:23:22.840471+0000","last_clean_scrub_stamp":"2024-06-04T16:23:22.840471+0000","objects_scrubbed":3,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T03:52:07.635574+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1069194,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":76,"num_read_kb":25646,"num_write":152,"num_write_kb":18921,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,6],"acting":[4,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"254'150","reported_seq":912,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:07.252865+0000","last_change":"2024-06-04T16:23:07.252889+0000","last_active":"2024-06-04T16:23:07.252865+0000","last_peered":"2024-06-04T16:23:07.252865+0000","last_clean":"2024-06-04T16:23:07.252865+0000","last_became_active":"2024-06-04T15:52:38.480432+0000","last_became_peered":"2024-06-04T15:52:38.480432+0000","last_unstale":"2024-06-04T16:23:07.252865+0000","last_undegraded":"2024-06-04T16:23:07.252865+0000","last_fullsized":"2024-06-04T16:23:07.252865+0000","mapping_epoch":23,"log_start":"251'100","ondisk_log_start":"251'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'150","last_scrub_stamp":"2024-06-04T16:23:07.252763+0000","last_deep_scrub":"254'150","last_deep_scrub_stamp":"2024-06-04T16:23:07.252763+0000","last_clean_scrub_stamp":"2024-06-04T16:23:07.252763+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":100,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T02:08:42.991893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":703,"num_read_kb":638,"num_write":178,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"254'54","reported_seq":563,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:07.803392+0000","last_change":"2024-06-04T16:23:07.803428+0000","last_active":"2024-06-04T16:23:07.803392+0000","last_peered":"2024-06-04T16:23:07.803392+0000","last_clean":"2024-06-04T16:23:07.803392+0000","last_became_active":"2024-06-04T15:52:36.488813+0000","last_became_peered":"2024-06-04T15:52:36.488813+0000","last_unstale":"2024-06-04T16:23:07.803392+0000","last_undegraded":"2024-06-04T16:23:07.803392+0000","last_fullsized":"2024-06-04T16:23:07.803392+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'54","last_scrub_stamp":"2024-06-04T16:23:07.803315+0000","last_deep_scrub":"254'54","last_deep_scrub_stamp":"2024-06-04T16:23:07.803315+0000","last_clean_scrub_stamp":"2024-06-04T16:23:07.803315+0000","objects_scrubbed":4,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T22:56:04.807428+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":75,"num_read_kb":5170,"num_write":190,"num_write_kb":17954,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6],"acting":[0,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"254'97","reported_seq":800,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:25.933581+0000","last_change":"2024-06-04T16:23:25.933605+0000","last_active":"2024-06-04T16:23:25.933581+0000","last_peered":"2024-06-04T16:23:25.933581+0000","last_clean":"2024-06-04T16:23:25.933581+0000","last_became_active":"2024-06-04T15:52:38.479542+0000","last_became_peered":"2024-06-04T15:52:38.479542+0000","last_unstale":"2024-06-04T16:23:25.933581+0000","last_undegraded":"2024-06-04T16:23:25.933581+0000","last_fullsized":"2024-06-04T16:23:25.933581+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'97","last_scrub_stamp":"2024-06-04T16:23:25.933492+0000","last_deep_scrub":"254'97","last_deep_scrub_stamp":"2024-06-04T16:23:25.933492+0000","last_clean_scrub_stamp":"2024-06-04T16:23:25.933492+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T17:01:29.653836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":493,"num_read_kb":461,"num_write":115,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"251'65","reported_seq":583,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:42.590419+0000","last_change":"2024-06-04T16:23:42.590498+0000","last_active":"2024-06-04T16:23:42.590419+0000","last_peered":"2024-06-04T16:23:42.590419+0000","last_clean":"2024-06-04T16:23:42.590419+0000","last_became_active":"2024-06-04T15:52:36.487971+0000","last_became_peered":"2024-06-04T15:52:36.487971+0000","last_unstale":"2024-06-04T16:23:42.590419+0000","last_undegraded":"2024-06-04T16:23:42.590419+0000","last_fullsized":"2024-06-04T16:23:42.590419+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"251'65","last_scrub_stamp":"2024-06-04T16:23:42.590307+0000","last_deep_scrub":"251'65","last_deep_scrub_stamp":"2024-06-04T16:23:42.590307+0000","last_clean_scrub_stamp":"2024-06-04T16:23:42.590307+0000","objects_scrubbed":2,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T01:08:00.886417+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262163,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":94,"num_read_kb":7564,"num_write":255,"num_write_kb":36740,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"254'139","reported_seq":923,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:09.050239+0000","last_change":"2024-06-04T16:23:09.050266+0000","last_active":"2024-06-04T16:23:09.050239+0000","last_peered":"2024-06-04T16:23:09.050239+0000","last_clean":"2024-06-04T16:23:09.050239+0000","last_became_active":"2024-06-04T15:52:38.484225+0000","last_became_peered":"2024-06-04T15:52:38.484225+0000","last_unstale":"2024-06-04T16:23:09.050239+0000","last_undegraded":"2024-06-04T16:23:09.050239+0000","last_fullsized":"2024-06-04T16:23:09.050239+0000","mapping_epoch":23,"log_start":"251'100","ondisk_log_start":"251'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'139","last_scrub_stamp":"2024-06-04T16:23:09.050145+0000","last_deep_scrub":"254'139","last_deep_scrub_stamp":"2024-06-04T16:23:09.050145+0000","last_clean_scrub_stamp":"2024-06-04T16:23:09.050145+0000","objects_scrubbed":3,"log_size":39,"log_dups_size":100,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T18:11:37.986197+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":727,"num_read_kb":670,"num_write":170,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2e","version":"254'55","reported_seq":576,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:22.905314+0000","last_change":"2024-06-04T16:23:22.905373+0000","last_active":"2024-06-04T16:23:22.905314+0000","last_peered":"2024-06-04T16:23:22.905314+0000","last_clean":"2024-06-04T16:23:22.905314+0000","last_became_active":"2024-06-04T15:52:36.488139+0000","last_became_peered":"2024-06-04T15:52:36.488139+0000","last_unstale":"2024-06-04T16:23:22.905314+0000","last_undegraded":"2024-06-04T16:23:22.905314+0000","last_fullsized":"2024-06-04T16:23:22.905314+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'55","last_scrub_stamp":"2024-06-04T16:23:22.905216+0000","last_deep_scrub":"254'55","last_deep_scrub_stamp":"2024-06-04T16:23:22.905216+0000","last_clean_scrub_stamp":"2024-06-04T16:23:22.905216+0000","objects_scrubbed":3,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T21:51:27.324326+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":103,"num_read_kb":14422,"num_write":268,"num_write_kb":32685,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,3],"acting":[7,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.28","version":"254'291","reported_seq":1135,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:09.264260+0000","last_change":"2024-06-04T16:23:09.264288+0000","last_active":"2024-06-04T16:23:09.264260+0000","last_peered":"2024-06-04T16:23:09.264260+0000","last_clean":"2024-06-04T16:23:09.264260+0000","last_became_active":"2024-06-04T15:52:38.480613+0000","last_became_peered":"2024-06-04T15:52:38.480613+0000","last_unstale":"2024-06-04T16:23:09.264260+0000","last_undegraded":"2024-06-04T16:23:09.264260+0000","last_fullsized":"2024-06-04T16:23:09.264260+0000","mapping_epoch":23,"log_start":"251'200","ondisk_log_start":"251'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'291","last_scrub_stamp":"2024-06-04T16:23:09.264173+0000","last_deep_scrub":"254'291","last_deep_scrub_stamp":"2024-06-04T16:23:09.264173+0000","last_clean_scrub_stamp":"2024-06-04T16:23:09.264173+0000","objects_scrubbed":2,"log_size":91,"log_dups_size":200,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T17:25:59.350082+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1456,"num_read_kb":1243,"num_write":452,"num_write_kb":208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2565,"num_omap_keys":10,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"254'57","reported_seq":567,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:29.654790+0000","last_change":"2024-06-04T16:23:29.654838+0000","last_active":"2024-06-04T16:23:29.654790+0000","last_peered":"2024-06-04T16:23:29.654790+0000","last_clean":"2024-06-04T16:23:29.654790+0000","last_became_active":"2024-06-04T15:52:36.498564+0000","last_became_peered":"2024-06-04T15:52:36.498564+0000","last_unstale":"2024-06-04T16:23:29.654790+0000","last_undegraded":"2024-06-04T16:23:29.654790+0000","last_fullsized":"2024-06-04T16:23:29.654790+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'57","last_scrub_stamp":"2024-06-04T16:23:29.654695+0000","last_deep_scrub":"254'57","last_deep_scrub_stamp":"2024-06-04T16:23:29.654695+0000","last_clean_scrub_stamp":"2024-06-04T16:23:29.654695+0000","objects_scrubbed":3,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T22:40:49.101290+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1395816,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":73,"num_read_kb":11423,"num_write":228,"num_write_kb":34926,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"251'38","reported_seq":558,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:35.564079+0000","last_change":"2024-06-04T16:23:35.564132+0000","last_active":"2024-06-04T16:23:35.564079+0000","last_peered":"2024-06-04T16:23:35.564079+0000","last_clean":"2024-06-04T16:23:35.564079+0000","last_became_active":"2024-06-04T15:52:36.489681+0000","last_became_peered":"2024-06-04T15:52:36.489681+0000","last_unstale":"2024-06-04T16:23:35.564079+0000","last_undegraded":"2024-06-04T16:23:35.564079+0000","last_fullsized":"2024-06-04T16:23:35.564079+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"251'38","last_scrub_stamp":"2024-06-04T16:23:35.563977+0000","last_deep_scrub":"251'38","last_deep_scrub_stamp":"2024-06-04T16:23:35.563977+0000","last_clean_scrub_stamp":"2024-06-04T16:23:35.563977+0000","objects_scrubbed":3,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T02:15:55.013149+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1395831,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":78,"num_read_kb":4250,"num_write":172,"num_write_kb":18293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,6],"acting":[3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"254'121","reported_seq":1033,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:01.992253+0000","last_change":"2024-06-04T16:23:01.992301+0000","last_active":"2024-06-04T16:23:01.992253+0000","last_peered":"2024-06-04T16:23:01.992253+0000","last_clean":"2024-06-04T16:23:01.992253+0000","last_became_active":"2024-06-04T15:52:38.488941+0000","last_became_peered":"2024-06-04T15:52:38.488941+0000","last_unstale":"2024-06-04T16:23:01.992253+0000","last_undegraded":"2024-06-04T16:23:01.992253+0000","last_fullsized":"2024-06-04T16:23:01.992253+0000","mapping_epoch":23,"log_start":"251'100","ondisk_log_start":"251'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'121","last_scrub_stamp":"2024-06-04T16:23:01.992144+0000","last_deep_scrub":"254'121","last_deep_scrub_stamp":"2024-06-04T16:23:01.992144+0000","last_clean_scrub_stamp":"2024-06-04T16:23:01.992144+0000","objects_scrubbed":2,"log_size":21,"log_dups_size":100,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T21:08:34.393894+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1004,"num_read_kb":976,"num_write":157,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2539,"num_omap_keys":10,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"251'45","reported_seq":552,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:23.381840+0000","last_change":"2024-06-04T16:23:23.381889+0000","last_active":"2024-06-04T16:23:23.381840+0000","last_peered":"2024-06-04T16:23:23.381840+0000","last_clean":"2024-06-04T16:23:23.381840+0000","last_became_active":"2024-06-04T15:52:36.496046+0000","last_became_peered":"2024-06-04T15:52:36.496046+0000","last_unstale":"2024-06-04T16:23:23.381840+0000","last_undegraded":"2024-06-04T16:23:23.381840+0000","last_fullsized":"2024-06-04T16:23:23.381840+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"251'45","last_scrub_stamp":"2024-06-04T16:23:23.381742+0000","last_deep_scrub":"251'45","last_deep_scrub_stamp":"2024-06-04T16:23:23.381742+0000","last_clean_scrub_stamp":"2024-06-04T16:23:23.381742+0000","objects_scrubbed":2,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-05T20:03:46.055994+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1069179,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":46,"num_read_kb":3657,"num_write":159,"num_write_kb":22961,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3],"acting":[5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.36","version":"254'113","reported_seq":829,"reported_epoch":254,"state":"active+clean","last_fresh":"2024-06-04T16:23:21.411405+0000","last_change":"2024-06-04T16:23:21.411405+0000","last_active":"2024-06-04T16:23:21.411405+0000","last_peered":"2024-06-04T16:23:21.411405+0000","last_clean":"2024-06-04T16:23:21.411405+0000","last_became_active":"2024-06-04T15:52:38.474574+0000","last_became_peered":"2024-06-04T15:52:38.474574+0000","last_unstale":"2024-06-04T16:23:21.411405+0000","last_undegraded":"2024-06-04T16:23:21.411405+0000","last_fullsized":"2024-06-04T16:23:21.411405+0000","mapping_epoch":23,"log_start":"254'100","ondisk_log_start":"254'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'113","last_scrub_stamp":"2024-06-04T16:23:21.411261+0000","last_deep_scrub":"254'113","last_deep_scrub_stamp":"2024-06-04T16:23:21.411261+0000","last_clean_scrub_stamp":"2024-06-04T16:23:21.411261+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":100,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-06T02:22:44.411264+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":563,"num_read_kb":518,"num_write":138,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":16777216,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":169,"num_read_kb":189232,"num_write":179,"num_write_kb":125730,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":33554432,"data_stored":33554432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":133,"ondisk_log_size":133,"up":64,"acting":64,"num_store_stats":8},{"poolid":64,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4378,"num_read_kb":3242,"num_write":1279,"num_write_kb":637,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4455,"num_omap_keys":9,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":683,"ondisk_log_size":683,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":8922,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":3579,"num_read_kb":3443,"num_write":3611,"num_write_kb":1042,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1201,"num_omap_keys":7,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":319488,"data_stored":17844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1044,"ondisk_log_size":1044,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":566,"ondisk_log_size":566,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":300865,"num_objects":188,"num_object_clones":0,"num_object_copies":376,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":188,"num_whiteouts":0,"num_read":6099,"num_read_kb":7761,"num_write":3199,"num_write_kb":973,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":151988,"num_omap_keys":372,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1864,"ondisk_log_size":1864,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1533,"num_read_kb":1825,"num_write":20,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17,"ondisk_log_size":17,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":77,"num_object_clones":0,"num_object_copies":154,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":77,"num_whiteouts":0,"num_read":48565,"num_read_kb":44901,"num_write":11590,"num_write_kb":3535,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":77,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":33584,"num_omap_keys":140,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3735,"ondisk_log_size":3735,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":85563130,"num_objects":200,"num_object_clones":0,"num_object_copies":600,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":200,"num_whiteouts":0,"num_read":5481,"num_read_kb":1011284,"num_write":14360,"num_write_kb":1691909,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":130080768,"data_stored":130080768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3497,"ondisk_log_size":3497,"up":192,"acting":192,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":12,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":752,"num_omap_keys":8,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8,"ondisk_log_size":8,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":16777216,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":170,"num_read_kb":185843,"num_write":179,"num_write_kb":125730,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":33554432,"data_stored":33554432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":133,"ondisk_log_size":133,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542530,"num_pgs":96,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":195128,"kb_used_data":23792,"kb_used_omap":1,"kb_used_meta":171326,"kb_avail":94176712,"statfs":{"total":96636764160,"available":96436953088,"internally_reserved":0,"allocated":24363008,"data_stored":22488525,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":175438282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542530,"num_pgs":108,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":73832,"kb_used_data":24608,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94298008,"statfs":{"total":96636764160,"available":96561160192,"internally_reserved":0,"allocated":25198592,"data_stored":23328559,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":50395591},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542529,"num_pgs":115,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":224796,"kb_used_data":22868,"kb_used_omap":1,"kb_used_meta":201918,"kb_avail":94147044,"statfs":{"total":96636764160,"available":96406573056,"internally_reserved":0,"allocated":23416832,"data_stored":21539413,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":206764485},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542527,"num_pgs":122,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":150856,"kb_used_data":33664,"kb_used_omap":1,"kb_used_meta":117182,"kb_avail":94220984,"statfs":{"total":96636764160,"available":96482287616,"internally_reserved":0,"allocated":34471936,"data_stored":32597872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":119994821},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542530,"num_pgs":119,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":205024,"kb_used_data":29464,"kb_used_omap":1,"kb_used_meta":175550,"kb_avail":94166816,"statfs":{"total":96636764160,"available":96426819584,"internally_reserved":0,"allocated":30171136,"data_stored":28278302,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":179763655},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542530,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":98200,"kb_used_data":22608,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94273640,"statfs":{"total":96636764160,"available":96536207360,"internally_reserved":0,"allocated":23150592,"data_stored":21269158,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":77396421},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542529,"num_pgs":98,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":266972,"kb_used_data":37268,"kb_used_omap":1,"kb_used_meta":229694,"kb_avail":94104868,"statfs":{"total":96636764160,"available":96363384832,"internally_reserved":0,"allocated":38162432,"data_stored":36275175,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":235207109},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542530,"num_pgs":93,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":80224,"kb_used_data":31000,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94291616,"statfs":{"total":96636764160,"available":96554614784,"internally_reserved":0,"allocated":31744000,"data_stored":29845910,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":25591808,"data_stored":25591808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":22585344,"data_stored":22585344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":14917632,"data_stored":14917632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":18190336,"data_stored":18190336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":18907136,"data_stored":18907136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":10403840,"data_stored":10403840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":10686464,"data_stored":10686464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8798208,"data_stored":8798208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":1139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":1364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2484,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1047,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":2789,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":2757,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2173,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2491,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1703,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":64,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":64,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":64,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":64,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":64,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":64,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":64,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":64,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":1048576,"data_stored":1048576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":1048576,"data_stored":1048576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":7340032,"data_stored":7340032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":5242880,"data_stored":5242880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4194304,"data_stored":4194304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":9437184,"data_stored":9437184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":5242880,"data_stored":5242880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":1048576,"data_stored":1048576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":10485760,"data_stored":10485760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4194304,"data_stored":4194304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":6291456,"data_stored":6291456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4194304,"data_stored":4194304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":1048576,"data_stored":1048576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":6291456,"data_stored":6291456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-06-04T16:24:08.972 DEBUG:teuthology.orchestra.run.smithi144:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-06-04T16:24:09.309 INFO:teuthology.misc:Shutting down mds daemons... 2024-06-04T16:24:09.309 INFO:teuthology.misc:Shutting down osd daemons... 2024-06-04T16:24:09.309 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-06-04T16:24:09.310 INFO:teuthology.orchestra.run:waiting for 300 2024-06-04T16:24:09.344 INFO:tasks.ceph.osd.0:Stopped 2024-06-04T16:24:09.344 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-06-04T16:24:09.344 INFO:teuthology.orchestra.run:waiting for 300 2024-06-04T16:24:09.424 INFO:tasks.ceph.osd.1:Stopped 2024-06-04T16:24:09.424 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-06-04T16:24:09.425 INFO:teuthology.orchestra.run:waiting for 300 2024-06-04T16:24:09.496 INFO:tasks.ceph.osd.2:Stopped 2024-06-04T16:24:09.496 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-06-04T16:24:09.496 INFO:teuthology.orchestra.run:waiting for 300 2024-06-04T16:24:09.575 INFO:tasks.ceph.osd.3:Stopped 2024-06-04T16:24:09.575 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-06-04T16:24:09.576 INFO:teuthology.orchestra.run:waiting for 300 2024-06-04T16:24:09.621 INFO:tasks.ceph.osd.4:Stopped 2024-06-04T16:24:09.621 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-06-04T16:24:09.621 INFO:teuthology.orchestra.run:waiting for 300 2024-06-04T16:24:09.666 INFO:tasks.ceph.osd.5:Stopped 2024-06-04T16:24:09.667 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-06-04T16:24:09.667 INFO:teuthology.orchestra.run:waiting for 300 2024-06-04T16:24:09.707 INFO:tasks.ceph.osd.6:Stopped 2024-06-04T16:24:09.707 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-06-04T16:24:09.707 INFO:teuthology.orchestra.run:waiting for 300 2024-06-04T16:24:09.780 INFO:tasks.ceph.osd.7:Stopped 2024-06-04T16:24:09.780 INFO:teuthology.misc:Shutting down mgr daemons... 2024-06-04T16:24:09.781 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-06-04T16:24:09.781 INFO:teuthology.orchestra.run:waiting for 300 2024-06-04T16:24:09.805 INFO:tasks.ceph.mgr.y:Stopped 2024-06-04T16:24:09.806 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-06-04T16:24:09.806 INFO:teuthology.orchestra.run:waiting for 300 2024-06-04T16:24:09.850 INFO:tasks.ceph.mgr.x:Stopped 2024-06-04T16:24:09.851 INFO:teuthology.misc:Shutting down mon daemons... 2024-06-04T16:24:09.851 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-06-04T16:24:09.851 INFO:teuthology.orchestra.run:waiting for 300 2024-06-04T16:24:09.864 INFO:tasks.ceph.mon.a:Stopped 2024-06-04T16:24:09.865 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-06-04T16:24:09.865 INFO:teuthology.orchestra.run:waiting for 300 2024-06-04T16:24:09.917 INFO:tasks.ceph.mon.c:Stopped 2024-06-04T16:24:09.917 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-06-04T16:24:09.917 INFO:teuthology.orchestra.run:waiting for 300 2024-06-04T16:24:09.929 INFO:tasks.ceph.mon.b:Stopped 2024-06-04T16:24:09.930 INFO:tasks.ceph:Checking cluster log for badness... 2024-06-04T16:24:09.930 DEBUG:teuthology.orchestra.run.smithi144:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(PG_AVAILABILITY\)' | egrep -v '\(PG_DEGRADED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'not have an application enabled' | egrep -v '\(OSD_SLOW_PING_TIME' | head -n 1 2024-06-04T16:24:10.005 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi144.front.sepia.ceph.com 2024-06-04T16:24:10.006 DEBUG:teuthology.orchestra.run.smithi144:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-06-04T16:24:10.182 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi144.front.sepia.ceph.com 2024-06-04T16:24:10.182 DEBUG:teuthology.orchestra.run.smithi144:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-06-04T16:24:10.322 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi144.front.sepia.ceph.com 2024-06-04T16:24:10.323 DEBUG:teuthology.orchestra.run.smithi144:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-06-04T16:24:10.391 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi144.front.sepia.ceph.com 2024-06-04T16:24:10.391 DEBUG:teuthology.orchestra.run.smithi144:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-06-04T16:24:10.468 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi177.front.sepia.ceph.com 2024-06-04T16:24:10.469 DEBUG:teuthology.orchestra.run.smithi177:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-06-04T16:24:10.577 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi177.front.sepia.ceph.com 2024-06-04T16:24:10.577 DEBUG:teuthology.orchestra.run.smithi177:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-06-04T16:24:10.708 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi177.front.sepia.ceph.com 2024-06-04T16:24:10.708 DEBUG:teuthology.orchestra.run.smithi177:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-06-04T16:24:10.774 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi177.front.sepia.ceph.com 2024-06-04T16:24:10.774 DEBUG:teuthology.orchestra.run.smithi177:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-06-04T16:24:10.845 INFO:tasks.ceph:Archiving mon data... 2024-06-04T16:24:10.847 DEBUG:teuthology.misc:Transferring archived files from smithi144:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/cbodley-2024-06-04_15:11:52-rgw-main-distro-default-smithi/7740770/data/mon.a.tgz 2024-06-04T16:24:10.847 DEBUG:teuthology.orchestra.run.smithi144:> mktemp 2024-06-04T16:24:10.876 INFO:teuthology.orchestra.run.smithi144.stdout:/tmp/tmp.0Zj00FwhXj 2024-06-04T16:24:10.876 DEBUG:teuthology.orchestra.run.smithi144:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.0Zj00FwhXj 2024-06-04T16:24:11.077 DEBUG:teuthology.orchestra.run.smithi144:> sudo chmod 0666 /tmp/tmp.0Zj00FwhXj 2024-06-04T16:24:11.187 DEBUG:teuthology.orchestra.remote:smithi144:/tmp/tmp.0Zj00FwhXj is 437KB 2024-06-04T16:24:11.285 DEBUG:teuthology.orchestra.run.smithi144:> rm -fr /tmp/tmp.0Zj00FwhXj 2024-06-04T16:24:11.313 DEBUG:teuthology.misc:Transferring archived files from smithi144:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/cbodley-2024-06-04_15:11:52-rgw-main-distro-default-smithi/7740770/data/mon.c.tgz 2024-06-04T16:24:11.313 DEBUG:teuthology.orchestra.run.smithi144:> mktemp 2024-06-04T16:24:11.381 INFO:teuthology.orchestra.run.smithi144.stdout:/tmp/tmp.NlcMs01Lkj 2024-06-04T16:24:11.381 DEBUG:teuthology.orchestra.run.smithi144:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.NlcMs01Lkj 2024-06-04T16:24:11.558 DEBUG:teuthology.orchestra.run.smithi144:> sudo chmod 0666 /tmp/tmp.NlcMs01Lkj 2024-06-04T16:24:11.668 DEBUG:teuthology.orchestra.remote:smithi144:/tmp/tmp.NlcMs01Lkj is 443KB 2024-06-04T16:24:11.749 DEBUG:teuthology.orchestra.run.smithi144:> rm -fr /tmp/tmp.NlcMs01Lkj 2024-06-04T16:24:11.777 DEBUG:teuthology.misc:Transferring archived files from smithi177:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/cbodley-2024-06-04_15:11:52-rgw-main-distro-default-smithi/7740770/data/mon.b.tgz 2024-06-04T16:24:11.777 DEBUG:teuthology.orchestra.run.smithi177:> mktemp 2024-06-04T16:24:11.810 INFO:teuthology.orchestra.run.smithi177.stdout:/tmp/tmp.r0v8ckLQyM 2024-06-04T16:24:11.810 DEBUG:teuthology.orchestra.run.smithi177:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.r0v8ckLQyM 2024-06-04T16:24:12.003 DEBUG:teuthology.orchestra.run.smithi177:> sudo chmod 0666 /tmp/tmp.r0v8ckLQyM 2024-06-04T16:24:12.112 DEBUG:teuthology.orchestra.remote:smithi177:/tmp/tmp.r0v8ckLQyM is 443KB 2024-06-04T16:24:12.207 DEBUG:teuthology.orchestra.run.smithi177:> rm -fr /tmp/tmp.r0v8ckLQyM 2024-06-04T16:24:12.236 INFO:tasks.ceph:Cleaning ceph cluster... 2024-06-04T16:24:12.236 DEBUG:teuthology.orchestra.run.smithi144:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-06-04T16:24:12.239 DEBUG:teuthology.orchestra.run.smithi177:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-06-04T16:24:12.345 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-06-04T16:24:12.383 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-06-04T16:24:12.383 INFO:tasks.ceph:Archiving crash dumps... 2024-06-04T16:24:12.385 DEBUG:teuthology.misc:Transferring archived files from smithi144:/var/lib/ceph/crash to /home/teuthworker/archive/cbodley-2024-06-04_15:11:52-rgw-main-distro-default-smithi/7740770/remote/smithi144/crash 2024-06-04T16:24:12.386 DEBUG:teuthology.orchestra.run.smithi144:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-06-04T16:24:12.425 DEBUG:teuthology.misc:Transferring archived files from smithi177:/var/lib/ceph/crash to /home/teuthworker/archive/cbodley-2024-06-04_15:11:52-rgw-main-distro-default-smithi/7740770/remote/smithi177/crash 2024-06-04T16:24:12.426 DEBUG:teuthology.orchestra.run.smithi177:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-06-04T16:24:12.463 INFO:tasks.ceph:Compressing logs... 2024-06-04T16:24:12.464 DEBUG:teuthology.orchestra.run.smithi144:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-06-04T16:24:12.470 DEBUG:teuthology.orchestra.run.smithi177:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-06-04T16:24:12.550 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39532.log 2024-06-04T16:24:12.550 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72608.log 2024-06-04T16:24:12.550 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.39532.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140397.log 2024-06-04T16:24:12.550 INFO:teuthology.orchestra.run.smithi144.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39532.log.gz 2024-06-04T16:24:12.550 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.72608.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82707.log 2024-06-04T16:24:12.551 INFO:teuthology.orchestra.run.smithi144.stderr: 83.9% -- replaced with /var/log/ceph/ceph-client.admin.72608.log.gz 2024-06-04T16:24:12.551 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.140397.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52616.log 2024-06-04T16:24:12.551 INFO:teuthology.orchestra.run.smithi144.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.140397.log.gz 2024-06-04T16:24:12.551 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.82707.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40544.log 2024-06-04T16:24:12.551 INFO:teuthology.orchestra.run.smithi144.stderr: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.82707.log.gz 2024-06-04T16:24:12.551 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.52616.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61856.log 2024-06-04T16:24:12.551 INFO:teuthology.orchestra.run.smithi144.stderr: 84.0% -- replaced with /var/log/ceph/ceph-client.admin.52616.log.gz 2024-06-04T16:24:12.551 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.40544.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.75750.log 2024-06-04T16:24:12.552 INFO:teuthology.orchestra.run.smithi144.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40544.log.gz 2024-06-04T16:24:12.552 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.61856.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139845.log 2024-06-04T16:24:12.552 INFO:teuthology.orchestra.run.smithi144.stderr: 63.8% -- replaced with /var/log/ceph/ceph-client.admin.61856.log.gz 2024-06-04T16:24:12.552 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.0.75750.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79173.log 2024-06-04T16:24:12.552 INFO:teuthology.orchestra.run.smithi144.stderr: 83.8%/var/log/ceph/ceph-client.admin.139845.log: -- replaced with /var/log/ceph/ceph-client.0.75750.log.gz 2024-06-04T16:24:12.552 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41155.log 2024-06-04T16:24:12.552 INFO:teuthology.orchestra.run.smithi144.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.139845.log.gz 2024-06-04T16:24:12.553 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.79173.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86241.log 2024-06-04T16:24:12.553 INFO:teuthology.orchestra.run.smithi144.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.79173.log.gz 2024-06-04T16:24:12.553 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.41155.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41245.log 2024-06-04T16:24:12.553 INFO:teuthology.orchestra.run.smithi144.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41155.log.gz 2024-06-04T16:24:12.553 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.86241.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95076.log 2024-06-04T16:24:12.553 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.41245.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79762.log 2024-06-04T16:24:12.554 INFO:teuthology.orchestra.run.smithi144.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.86241.log.gz 2024-06-04T16:24:12.554 INFO:teuthology.orchestra.run.smithi144.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41245.log.gz 2024-06-04T16:24:12.554 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.95076.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139661.log 2024-06-04T16:24:12.554 INFO:teuthology.orchestra.run.smithi144.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.95076.log.gz 2024-06-04T16:24:12.554 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.79762.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96843.log 2024-06-04T16:24:12.554 INFO:teuthology.orchestra.run.smithi144.stderr: 80.7%/var/log/ceph/ceph-client.admin.139661.log: -- replaced with /var/log/ceph/ceph-client.admin.79762.log.gz 2024-06-04T16:24:12.554 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34558.log 2024-06-04T16:24:12.554 INFO:teuthology.orchestra.run.smithi144.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.139661.log.gz 2024-06-04T16:24:12.555 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.96843.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.136767.log 2024-06-04T16:24:12.555 INFO:teuthology.orchestra.run.smithi144.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.96843.log.gz 2024-06-04T16:24:12.555 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.134331.log 2024-06-04T16:24:12.555 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.34558.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34558.log.gz 2024-06-04T16:24:12.555 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.0.136767.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50212.log 2024-06-04T16:24:12.555 INFO:teuthology.orchestra.run.smithi144.stderr: 80.4% -- replaced with /var/log/ceph/ceph-client.0.136767.log.gz 2024-06-04T16:24:12.555 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.0.134331.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34117.log 2024-06-04T16:24:12.555 INFO:teuthology.orchestra.run.smithi144.stderr: 84.1% -- replaced with /var/log/ceph/ceph-client.0.134331.log.gz 2024-06-04T16:24:12.555 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.50212.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118683.log 2024-06-04T16:24:12.556 INFO:teuthology.orchestra.run.smithi144.stderr: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.50212.log.gz 2024-06-04T16:24:12.556 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.34117.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87419.log 2024-06-04T16:24:12.556 INFO:teuthology.orchestra.run.smithi144.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34117.log.gz 2024-06-04T16:24:12.556 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.118683.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78584.log 2024-06-04T16:24:12.556 INFO:teuthology.orchestra.run.smithi144.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.118683.log.gz 2024-06-04T16:24:12.556 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.87419.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140443.log 2024-06-04T16:24:12.556 INFO:teuthology.orchestra.run.smithi144.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.87419.log.gz 2024-06-04T16:24:12.556 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.78584.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120522.log 2024-06-04T16:24:12.556 INFO:teuthology.orchestra.run.smithi144.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.78584.log.gz 2024-06-04T16:24:12.557 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.140443.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123801.log 2024-06-04T16:24:12.557 INFO:teuthology.orchestra.run.smithi144.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.140443.log.gz 2024-06-04T16:24:12.557 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.120522.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80940.log 2024-06-04T16:24:12.557 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.123801.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70258.log 2024-06-04T16:24:12.557 INFO:teuthology.orchestra.run.smithi144.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.120522.log.gz 2024-06-04T16:24:12.557 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.80940.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.43746.log 2024-06-04T16:24:12.557 INFO:teuthology.orchestra.run.smithi144.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.80940.log.gz 2024-06-04T16:24:12.558 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.70258.log: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.123801.log.gz 2024-06-04T16:24:12.558 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103911.log 2024-06-04T16:24:12.558 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.0.43746.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.133113.log 2024-06-04T16:24:12.558 INFO:teuthology.orchestra.run.smithi144.stderr: 43.5% -- replaced with /var/log/ceph/ceph-client.0.43746.log.gz 2024-06-04T16:24:12.558 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.103911.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-06-04T16:24:12.558 INFO:teuthology.orchestra.run.smithi144.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.103911.log.gz 2024-06-04T16:24:12.558 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.0.133113.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.75141.log 2024-06-04T16:24:12.558 INFO:teuthology.orchestra.run.smithi144.stderr: 84.0% -- replaced with /var/log/ceph/ceph-client.0.133113.log.gz 2024-06-04T16:24:12.559 INFO:teuthology.orchestra.run.smithi144.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.70258.log.gz 2024-06-04T16:24:12.559 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119296.log 2024-06-04T16:24:12.559 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.0.75141.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82118.log 2024-06-04T16:24:12.559 INFO:teuthology.orchestra.run.smithi144.stderr: 84.1% -- replaced with /var/log/ceph/ceph-client.0.75141.log.gz 2024-06-04T16:24:12.559 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99199.log 2024-06-04T16:24:12.559 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.119296.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.119296.log.gz 2024-06-04T16:24:12.559 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.82118.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139615.log 2024-06-04T16:24:12.559 INFO:teuthology.orchestra.run.smithi144.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.82118.log.gz 2024-06-04T16:24:12.560 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.99199.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.133722.log 2024-06-04T16:24:12.560 INFO:teuthology.orchestra.run.smithi144.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.99199.log.gz 2024-06-04T16:24:12.560 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.139615.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85063.log 2024-06-04T16:24:12.560 INFO:teuthology.orchestra.run.smithi144.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.139615.log.gz 2024-06-04T16:24:12.560 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.0.133722.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-06-04T16:24:12.561 INFO:teuthology.orchestra.run.smithi144.stderr: 80.3% -- replaced with /var/log/ceph/ceph-client.0.133722.log.gz 2024-06-04T16:24:12.561 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.85063.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131254.log 2024-06-04T16:24:12.561 INFO:teuthology.orchestra.run.smithi144.stderr: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.85063.log.gz 2024-06-04T16:24:12.561 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39808.log 2024-06-04T16:24:12.561 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.131254.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90953.log 2024-06-04T16:24:12.561 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.39808.log: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.131254.log.gz 2024-06-04T16:24:12.561 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110979.log 2024-06-04T16:24:12.561 INFO:teuthology.orchestra.run.smithi144.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39808.log.gz 2024-06-04T16:24:12.562 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.90953.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73790.log 2024-06-04T16:24:12.562 INFO:teuthology.orchestra.run.smithi144.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.90953.log.gz 2024-06-04T16:24:12.562 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.110979.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39802.log 2024-06-04T16:24:12.562 INFO:teuthology.orchestra.run.smithi144.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.110979.log.gz 2024-06-04T16:24:12.562 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39296.log 2024-06-04T16:24:12.562 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.73790.log: /var/log/ceph/ceph-client.admin.39802.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39806.log 2024-06-04T16:24:12.562 INFO:teuthology.orchestra.run.smithi144.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.73790.log.gz 2024-06-04T16:24:12.563 INFO:teuthology.orchestra.run.smithi144.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39802.log.gz 2024-06-04T16:24:12.563 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.39296.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140029.log 2024-06-04T16:24:12.563 INFO:teuthology.orchestra.run.smithi144.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39296.log.gz 2024-06-04T16:24:12.563 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.39806.log: gzip 0.0% -5 -- replaced with /var/log/ceph/ceph-client.admin.39806.log.gz 2024-06-04T16:24:12.563 INFO:teuthology.orchestra.run.smithi144.stderr: --verbose -- /var/log/ceph/ceph-client.admin.40744.log 2024-06-04T16:24:12.563 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.140029.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.138853.log 2024-06-04T16:24:12.563 INFO:teuthology.orchestra.run.smithi144.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.140029.log.gz 2024-06-04T16:24:12.563 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.40744.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62557.log 2024-06-04T16:24:12.563 INFO:teuthology.orchestra.run.smithi144.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40744.log.gz 2024-06-04T16:24:12.564 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.0.138853.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121700.log 2024-06-04T16:24:12.564 INFO:teuthology.orchestra.run.smithi144.stderr: 93.4% -- replaced with /var/log/ceph/ceph.log.gz 2024-06-04T16:24:12.564 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.62557.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59780.log 2024-06-04T16:24:12.564 INFO:teuthology.orchestra.run.smithi144.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62557.log.gz 2024-06-04T16:24:12.564 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.121700.log: 90.2% -- replaced with /var/log/ceph/ceph-client.0.138853.log.gz 2024-06-04T16:24:12.564 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-06-04T16:24:12.564 INFO:teuthology.orchestra.run.smithi144.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.121700.log.gz 2024-06-04T16:24:12.564 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.59780.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126577.log 2024-06-04T16:24:12.564 INFO:teuthology.orchestra.run.smithi144.stderr: 83.2% -- replaced with /var/log/ceph/ceph-client.admin.59780.log.gz 2024-06-04T16:24:12.565 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65304.log 2024-06-04T16:24:12.565 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.126577.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40171.log 2024-06-04T16:24:12.565 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.65304.log: 92.1% -- replaced with /var/log/ceph/ceph-client.admin.126577.log.gz 2024-06-04T16:24:12.565 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108623.log 2024-06-04T16:24:12.565 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.40171.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40171.log.gz 2024-06-04T16:24:12.565 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139799.log 2024-06-04T16:24:12.565 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39805.log 2024-06-04T16:24:12.565 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.108623.log: /var/log/ceph/ceph-client.admin.139799.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.139799.log.gz 2024-06-04T16:24:12.566 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89775.log 2024-06-04T16:24:12.566 INFO:teuthology.orchestra.run.smithi144.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.108623.log.gz 2024-06-04T16:24:12.566 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40173.log 2024-06-04T16:24:12.566 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.39805.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39805.log.gz 2024-06-04T16:24:12.566 INFO:teuthology.orchestra.run.smithi144.stderr: 94.6% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-06-04T16:24:12.566 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.89775.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62248.log 2024-06-04T16:24:12.566 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-06-04T16:24:12.566 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.40173.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40173.log.gz 2024-06-04T16:24:12.567 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.62248.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85652.log 2024-06-04T16:24:12.567 INFO:teuthology.orchestra.run.smithi144.stderr: 56.8% -- replaced with /var/log/ceph/ceph-client.admin.62248.log.gz 2024-06-04T16:24:12.567 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39594.log 2024-06-04T16:24:12.567 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.85652.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110390.log 2024-06-04T16:24:12.567 INFO:teuthology.orchestra.run.smithi144.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.89775.log.gz 2024-06-04T16:24:12.567 INFO:teuthology.orchestra.run.smithi144.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.85652.log.gz 2024-06-04T16:24:12.567 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.39594.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.132502.log 2024-06-04T16:24:12.567 INFO:teuthology.orchestra.run.smithi144.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39594.log.gz 2024-06-04T16:24:12.567 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.110390.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40377.log 2024-06-04T16:24:12.567 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.0.132502.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80351.log 2024-06-04T16:24:12.568 INFO:teuthology.orchestra.run.smithi144.stderr: 80.3% -- replaced with /var/log/ceph/ceph-client.0.132502.log.gz 2024-06-04T16:24:12.568 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.40377.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116892.log 2024-06-04T16:24:12.568 INFO:teuthology.orchestra.run.smithi144.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40377.log.gz 2024-06-04T16:24:12.568 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.80351.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51414.log 2024-06-04T16:24:12.568 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.116892.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.80351.log.gz 2024-06-04T16:24:12.568 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99788.log 2024-06-04T16:24:12.568 INFO:teuthology.orchestra.run.smithi144.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.110390.log.gz 2024-06-04T16:24:12.568 INFO:teuthology.orchestra.run.smithi144.stderr: 79.7% -- replaced with /var/log/ceph/ceph-client.admin.116892.log.gz 2024-06-04T16:24:12.569 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.51414.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52027.log 2024-06-04T16:24:12.569 INFO:teuthology.orchestra.run.smithi144.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51414.log.gz 2024-06-04T16:24:12.569 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125361.log 2024-06-04T16:24:12.569 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.99788.log: /var/log/ceph/ceph-client.admin.52027.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49010.log 2024-06-04T16:24:12.569 INFO:teuthology.orchestra.run.smithi144.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.99788.log.gz 2024-06-04T16:24:12.569 INFO:teuthology.orchestra.run.smithi144.stderr: 93.3% -- replaced with /var/log/ceph/ceph-client.admin.65304.log.gz 2024-06-04T16:24:12.569 INFO:teuthology.orchestra.run.smithi144.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.52027.log.gz 2024-06-04T16:24:12.569 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.125361.log: -- /var/log/ceph/ceph-client.admin.103322.log 2024-06-04T16:24:12.569 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.49010.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129156.log 2024-06-04T16:24:12.570 INFO:teuthology.orchestra.run.smithi144.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49010.log.gz 2024-06-04T16:24:12.570 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.103322.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98021.log 2024-06-04T16:24:12.570 INFO:teuthology.orchestra.run.smithi144.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.103322.log.gz 2024-06-04T16:24:12.570 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.129156.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64685.log 2024-06-04T16:24:12.570 INFO:teuthology.orchestra.run.smithi144.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.129156.log.gz 2024-06-04T16:24:12.570 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139707.log 2024-06-04T16:24:12.570 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.98021.log: 94.0% -- replaced with /var/log/ceph/ceph-client.admin.125361.log.gz 2024-06-04T16:24:12.570 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.64685.log: gzip -5 --verbose -- /var/log/ceph/ops-log-ceph-client.0.log 2024-06-04T16:24:12.571 INFO:teuthology.orchestra.run.smithi144.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.98021.log.gz 2024-06-04T16:24:12.571 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.139707.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48397.log 2024-06-04T16:24:12.571 INFO:teuthology.orchestra.run.smithi144.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.139707.log.gz 2024-06-04T16:24:12.571 INFO:teuthology.orchestra.run.smithi144.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.64685.log.gz 2024-06-04T16:24:12.571 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ops-log-ceph-client.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97432.log 2024-06-04T16:24:12.571 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130646.log 2024-06-04T16:24:12.571 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.48397.log: /var/log/ceph/ceph-client.admin.97432.log: 84.3% -- replaced with /var/log/ceph/ceph-client.admin.48397.log.gz 2024-06-04T16:24:12.571 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.134940.log 2024-06-04T16:24:12.571 INFO:teuthology.orchestra.run.smithi144.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.97432.log.gz 2024-06-04T16:24:12.572 INFO:teuthology.orchestra.run.smithi144.stderr:gzip/var/log/ceph/ceph-client.admin.130646.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.89186.log 2024-06-04T16:24:12.572 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.0.134940.log: gzip -5 --verbose -- /var/log/ceph/rgw.ceph.client.0.log 2024-06-04T16:24:12.572 INFO:teuthology.orchestra.run.smithi144.stderr: 80.4% -- replaced with /var/log/ceph/ceph-client.0.134940.log.gz 2024-06-04T16:24:12.572 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.89186.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83885.log 2024-06-04T16:24:12.572 INFO:teuthology.orchestra.run.smithi144.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.89186.log.gz 2024-06-04T16:24:12.572 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/rgw.ceph.client.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74381.log 2024-06-04T16:24:12.572 INFO:teuthology.orchestra.run.smithi144.stderr: 93.8% -- replaced with /var/log/ceph/ceph-client.admin.130646.log.gz 2024-06-04T16:24:12.572 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.83885.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48986.log 2024-06-04T16:24:12.572 INFO:teuthology.orchestra.run.smithi144.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.83885.log.gz 2024-06-04T16:24:12.572 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.74381.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40836.log 2024-06-04T16:24:12.573 INFO:teuthology.orchestra.run.smithi144.stderr: 83.2%/var/log/ceph/ceph-client.admin.48986.log: -- replaced with /var/log/ceph/ceph-client.admin.74381.log.gz 2024-06-04T16:24:12.573 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-06-04T16:24:12.573 INFO:teuthology.orchestra.run.smithi144.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48986.log.gz 2024-06-04T16:24:12.573 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.40836.log: gzip -5 --verbose -- 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40836.log.gz 2024-06-04T16:24:12.573 INFO:teuthology.orchestra.run.smithi144.stderr: /var/log/ceph/ceph-mgr.y.log 2024-06-04T16:24:12.573 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.77128.log 2024-06-04T16:24:12.573 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95665.log 2024-06-04T16:24:12.573 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.0.77128.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115103.log 2024-06-04T16:24:12.574 INFO:teuthology.orchestra.run.smithi144.stderr: 79.8% -- replaced with /var/log/ceph/ceph-client.0.77128.log.gz 2024-06-04T16:24:12.574 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.95665.log: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.95665.log.gz 2024-06-04T16:24:12.574 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51438.log 2024-06-04T16:24:12.574 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-06-04T16:24:12.574 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.115103.log: /var/log/ceph/ceph-client.admin.51438.log: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.115103.log.gz 2024-06-04T16:24:12.574 INFO:teuthology.orchestra.run.smithi144.stderr: 84.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88008.log 2024-06-04T16:24:12.574 INFO:teuthology.orchestra.run.smithi144.stderr: -- replaced with /var/log/ceph/ceph-client.admin.51438.log.gz 2024-06-04T16:24:12.575 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92131.log 2024-06-04T16:24:12.575 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.88008.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.88008.log.gz 2024-06-04T16:24:12.593 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34083.log 2024-06-04T16:24:12.593 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33995.log 2024-06-04T16:24:12.593 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34215.log 2024-06-04T16:24:12.593 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.34083.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34083.log.gz 2024-06-04T16:24:12.593 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.33995.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-06-04T16:24:12.593 INFO:teuthology.orchestra.run.smithi177.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33995.log.gz 2024-06-04T16:24:12.594 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.34215.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33951.log 2024-06-04T16:24:12.594 INFO:teuthology.orchestra.run.smithi177.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34215.log.gz 2024-06-04T16:24:12.594 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-06-04T16:24:12.594 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.33951.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-06-04T16:24:12.594 INFO:teuthology.orchestra.run.smithi177.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33951.log.gz 2024-06-04T16:24:12.594 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-06-04T16:24:12.595 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-06-04T16:24:12.595 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34171.log 2024-06-04T16:24:12.595 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-06-04T16:24:12.595 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.34171.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34127.log 2024-06-04T16:24:12.595 INFO:teuthology.orchestra.run.smithi177.stderr: 90.7% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-06-04T16:24:12.595 INFO:teuthology.orchestra.run.smithi177.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34171.log.gz 2024-06-04T16:24:12.595 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-06-04T16:24:12.595 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-mgr.x.log: /var/log/ceph/ceph-client.admin.34127.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34127.log.gz 2024-06-04T16:24:12.596 INFO:teuthology.orchestra.run.smithi177.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.34259.log 2024-06-04T16:24:12.596 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34039.log 2024-06-04T16:24:12.596 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.34259.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-06-04T16:24:12.596 INFO:teuthology.orchestra.run.smithi177.stderr: -- replaced with /var/log/ceph/ceph-client.admin.34259.log.gz 2024-06-04T16:24:12.596 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.34039.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34039.log.gz 2024-06-04T16:24:12.596 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-mon.b.log: 88.0% -- replaced with /var/log/ceph/ceph.log.gz 2024-06-04T16:24:12.684 INFO:teuthology.orchestra.run.smithi144.stderr: 94.5% -- replaced with /var/log/ceph/ops-log-ceph-client.0.log.gz 2024-06-04T16:24:12.685 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140213.log 2024-06-04T16:24:12.685 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.92131.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.135549.log 2024-06-04T16:24:12.685 INFO:teuthology.orchestra.run.smithi144.stderr: 81.9%/var/log/ceph/ceph-client.admin.140213.log: -- replaced with /var/log/ceph/ceph-client.admin.92131.log.gz 2024-06-04T16:24:12.685 INFO:teuthology.orchestra.run.smithi144.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.140213.log.gz 2024-06-04T16:24:12.685 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63362.log 2024-06-04T16:24:12.685 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.0.135549.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140121.log 2024-06-04T16:24:12.685 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.63362.log: 84.0% -- replaced with /var/log/ceph/ceph-client.0.135549.log.gz 2024-06-04T16:24:12.686 INFO:teuthology.orchestra.run.smithi144.stderr: 20.8% -- replaced with /var/log/ceph/ceph-client.admin.63362.log.gz 2024-06-04T16:24:12.686 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.42534.log 2024-06-04T16:24:12.686 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.140121.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57328.log 2024-06-04T16:24:12.686 INFO:teuthology.orchestra.run.smithi144.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.140121.log.gz 2024-06-04T16:24:12.686 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.0.42534.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39455.log 2024-06-04T16:24:12.686 INFO:teuthology.orchestra.run.smithi144.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.0.42534.log.gz 2024-06-04T16:24:12.686 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.57328.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57328.log.gz 2024-06-04T16:24:12.686 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73200.log 2024-06-04T16:24:12.687 INFO:teuthology.orchestra.run.smithi144.stderr: 94.8% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-06-04T16:24:12.687 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.39455.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39455.log.gz 2024-06-04T16:24:12.687 INFO:teuthology.orchestra.run.smithi144.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.60958.log 2024-06-04T16:24:12.687 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.73200.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119885.log 2024-06-04T16:24:12.687 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.60958.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115714.log 2024-06-04T16:24:12.687 INFO:teuthology.orchestra.run.smithi144.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.admin.73200.log.gz 2024-06-04T16:24:12.687 INFO:teuthology.orchestra.run.smithi144.stderr: 82.0%/var/log/ceph/ceph-client.admin.119885.log: -- replaced with /var/log/ceph/ceph-client.admin.60958.log.gz 2024-06-04T16:24:12.687 INFO:teuthology.orchestra.run.smithi144.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.119885.log.gz 2024-06-04T16:24:12.688 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50801.log 2024-06-04T16:24:12.688 INFO:teuthology.orchestra.run.smithi144.stderr:gzip/var/log/ceph/ceph-client.admin.115714.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.62754.log 2024-06-04T16:24:12.688 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.50801.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.115714.log.gz 2024-06-04T16:24:12.688 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-06-04T16:24:12.688 INFO:teuthology.orchestra.run.smithi144.stderr: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.50801.log.gz 2024-06-04T16:24:12.688 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40540.log 2024-06-04T16:24:12.688 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.62754.log: /var/log/ceph/ceph-mon.c.log: 91.7% -- replaced with /var/log/ceph/ceph-client.admin.62754.log.gz 2024-06-04T16:24:12.688 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57965.log 2024-06-04T16:24:12.689 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34455.log 2024-06-04T16:24:12.689 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.57965.log: /var/log/ceph/ceph-client.admin.40540.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40540.log.gz 2024-06-04T16:24:12.689 INFO:teuthology.orchestra.run.smithi144.stderr: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.57965.log.gz 2024-06-04T16:24:12.689 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108034.log 2024-06-04T16:24:12.689 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39801.log 2024-06-04T16:24:12.689 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.108034.log: /var/log/ceph/ceph-client.admin.34455.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34455.log.gz 2024-06-04T16:24:12.689 INFO:teuthology.orchestra.run.smithi144.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.108034.log.gz 2024-06-04T16:24:12.689 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105678.log 2024-06-04T16:24:12.689 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.39801.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94487.log 2024-06-04T16:24:12.690 INFO:teuthology.orchestra.run.smithi144.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39801.log.gz 2024-06-04T16:24:12.690 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.105678.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56150.log 2024-06-04T16:24:12.690 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.94487.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.105678.log.gz 2024-06-04T16:24:12.690 INFO:teuthology.orchestra.run.smithi144.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.94487.log.gz 2024-06-04T16:24:12.690 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98610.log 2024-06-04T16:24:12.690 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.56150.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41291.log 2024-06-04T16:24:12.690 INFO:teuthology.orchestra.run.smithi144.stderr: 85.0% -- replaced with /var/log/ceph/ceph-client.admin.56150.log.gz 2024-06-04T16:24:12.690 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.98610.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-06-04T16:24:12.691 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.41291.log: 0.0% 81.6% -- replaced with /var/log/ceph/ceph-client.admin.98610.log.gz 2024-06-04T16:24:12.691 INFO:teuthology.orchestra.run.smithi144.stderr: -- replaced with /var/log/ceph/ceph-client.admin.41291.log.gz 2024-06-04T16:24:12.691 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102733.log 2024-06-04T16:24:12.691 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62690.log 2024-06-04T16:24:12.691 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.102733.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.102733.log.gz 2024-06-04T16:24:12.691 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139983.log 2024-06-04T16:24:12.691 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.62690.log: 58.1% -- replaced with /var/log/ceph/ceph-client.admin.62690.log.gz 2024-06-04T16:24:12.691 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70922.log 2024-06-04T16:24:12.692 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.139983.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.139983.log.gz 2024-06-04T16:24:12.692 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109212.log 2024-06-04T16:24:12.692 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.70922.log: 84.0% -- replaced with /var/log/ceph/ceph-client.admin.70922.log.gz 2024-06-04T16:24:12.692 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ops-log-ceph-client.admin.log 2024-06-04T16:24:12.692 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.109212.log: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.109212.log.gz 2024-06-04T16:24:12.692 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93309.log 2024-06-04T16:24:12.692 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ops-log-ceph-client.admin.log: 94.3% -- replaced with /var/log/ceph/ops-log-ceph-client.admin.log.gz 2024-06-04T16:24:12.692 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140720.log 2024-06-04T16:24:12.693 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.93309.log: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.93309.log.gz 2024-06-04T16:24:12.693 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139937.log 2024-06-04T16:24:12.693 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.140720.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.140720.log.gz 2024-06-04T16:24:12.693 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121111.log 2024-06-04T16:24:12.693 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.139937.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.139937.log.gz 2024-06-04T16:24:12.693 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88597.log 2024-06-04T16:24:12.693 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.121111.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.121111.log.gz 2024-06-04T16:24:12.693 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90364.log 2024-06-04T16:24:12.693 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.88597.log: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.88597.log.gz 2024-06-04T16:24:12.694 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.28029.log 2024-06-04T16:24:12.694 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.90364.log: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.90364.log.gz 2024-06-04T16:24:12.694 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140674.log 2024-06-04T16:24:12.694 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph.tmp-client.admin.28029.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.28029.log.gz 2024-06-04T16:24:12.694 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118659.log 2024-06-04T16:24:12.694 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.140674.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.140674.log.gz 2024-06-04T16:24:12.694 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63476.log 2024-06-04T16:24:12.694 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.118659.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.118659.log.gz 2024-06-04T16:24:12.695 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118070.log 2024-06-04T16:24:12.695 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.63476.log: 83.9% -- replaced with /var/log/ceph/ceph-client.admin.63476.log.gz 2024-06-04T16:24:12.695 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124409.log 2024-06-04T16:24:12.695 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.118070.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.118070.log.gz 2024-06-04T16:24:12.695 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39796.log 2024-06-04T16:24:12.695 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.124409.log: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.124409.log.gz 2024-06-04T16:24:12.695 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.137376.log 2024-06-04T16:24:12.695 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.39796.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39796.log.gz 2024-06-04T16:24:12.696 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40542.log 2024-06-04T16:24:12.696 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.0.137376.log: 80.2% -- replaced with /var/log/ceph/ceph-client.0.137376.log.gz 2024-06-04T16:24:12.696 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59732.log 2024-06-04T16:24:12.696 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.40542.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40542.log.gz 2024-06-04T16:24:12.696 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140167.log 2024-06-04T16:24:12.696 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.59732.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59732.log.gz 2024-06-04T16:24:12.696 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112747.log 2024-06-04T16:24:12.696 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.140167.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.140167.log.gz 2024-06-04T16:24:12.696 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140581.log 2024-06-04T16:24:12.697 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.112747.log: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.112747.log.gz 2024-06-04T16:24:12.697 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102144.log 2024-06-04T16:24:12.697 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.140581.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.140581.log.gz 2024-06-04T16:24:12.697 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53794.log 2024-06-04T16:24:12.697 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.102144.log: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.102144.log.gz 2024-06-04T16:24:12.697 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127940.log 2024-06-04T16:24:12.697 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.53794.log: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.53794.log.gz 2024-06-04T16:24:12.697 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.41931.log 2024-06-04T16:24:12.698 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.127940.log: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.127940.log.gz 2024-06-04T16:24:12.698 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69638.log 2024-06-04T16:24:12.698 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.0.41931.log: 43.9% -- replaced with /var/log/ceph/ceph-client.0.41931.log.gz 2024-06-04T16:24:12.698 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74972.log 2024-06-04T16:24:12.698 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.69638.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.69638.log.gz 2024-06-04T16:24:12.698 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40176.log 2024-06-04T16:24:12.698 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.74972.log: 25.1% -- replaced with /var/log/ceph/ceph-client.admin.74972.log.gz 2024-06-04T16:24:12.698 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41201.log 2024-06-04T16:24:12.698 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.40176.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40176.log.gz 2024-06-04T16:24:12.699 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.44349.log 2024-06-04T16:24:12.699 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.41201.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41201.log.gz 2024-06-04T16:24:12.699 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49623.log 2024-06-04T16:24:12.699 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.0.44349.log: 43.9% -- replaced with /var/log/ceph/ceph-client.0.44349.log.gz 2024-06-04T16:24:12.699 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116303.log 2024-06-04T16:24:12.699 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.49623.log: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.49623.log.gz 2024-06-04T16:24:12.699 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140535.log 2024-06-04T16:24:12.699 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.116303.log: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.116303.log.gz 2024-06-04T16:24:12.699 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120474.log 2024-06-04T16:24:12.700 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.140535.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.140535.log.gz 2024-06-04T16:24:12.700 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40790.log 2024-06-04T16:24:12.700 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.120474.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.120474.log.gz 2024-06-04T16:24:12.700 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39360.log 2024-06-04T16:24:12.700 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.40790.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40790.log.gz 2024-06-04T16:24:12.700 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115693.log 2024-06-04T16:24:12.700 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.39360.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39360.log.gz 2024-06-04T16:24:12.700 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140075.log 2024-06-04T16:24:12.700 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.115693.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.115693.log.gz 2024-06-04T16:24:12.701 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106856.log 2024-06-04T16:24:12.701 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.140075.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.140075.log.gz 2024-06-04T16:24:12.701 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.123151.log 2024-06-04T16:24:12.701 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.106856.log: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.106856.log.gz 2024-06-04T16:24:12.701 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86830.log 2024-06-04T16:24:12.701 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.0.123151.log: 84.1% -- replaced with /var/log/ceph/ceph-client.0.123151.log.gz 2024-06-04T16:24:12.701 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140764.log 2024-06-04T16:24:12.701 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.86830.log: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.86830.log.gz 2024-06-04T16:24:12.701 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39800.log 2024-06-04T16:24:12.702 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.140764.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.140764.log.gz 2024-06-04T16:24:12.702 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40175.log 2024-06-04T16:24:12.702 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.39800.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39800.log.gz 2024-06-04T16:24:12.702 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.136158.log 2024-06-04T16:24:12.702 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.40175.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40175.log.gz 2024-06-04T16:24:12.702 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100966.log 2024-06-04T16:24:12.702 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.0.136158.log: 80.1% -- replaced with /var/log/ceph/ceph-client.0.136158.log.gz 2024-06-04T16:24:12.702 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.138160.log 2024-06-04T16:24:12.703 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.100966.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.100966.log.gz 2024-06-04T16:24:12.703 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113925.log 2024-06-04T16:24:12.703 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.0.138160.log: 80.4% -- replaced with /var/log/ceph/ceph-client.0.138160.log.gz 2024-06-04T16:24:12.703 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39807.log 2024-06-04T16:24:12.703 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.113925.log: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.113925.log.gz 2024-06-04T16:24:12.703 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40170.log 2024-06-04T16:24:12.703 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.39807.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39807.log.gz 2024-06-04T16:24:12.703 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66542.log 2024-06-04T16:24:12.703 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.40170.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40170.log.gz 2024-06-04T16:24:12.704 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40174.log 2024-06-04T16:24:12.704 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.66542.log: 93.0% -- replaced with /var/log/ceph/ceph-client.admin.66542.log.gz 2024-06-04T16:24:12.704 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84474.log 2024-06-04T16:24:12.704 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.40174.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40174.log.gz 2024-06-04T16:24:12.704 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.44952.log 2024-06-04T16:24:12.704 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.84474.log: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.84474.log.gz 2024-06-04T16:24:12.704 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140351.log 2024-06-04T16:24:12.704 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.0.44952.log: 43.5% -- replaced with /var/log/ceph/ceph-client.0.44952.log.gz 2024-06-04T16:24:12.704 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120498.log 2024-06-04T16:24:12.704 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.140351.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.140351.log.gz 2024-06-04T16:24:12.705 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139891.log 2024-06-04T16:24:12.705 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.120498.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.120498.log.gz 2024-06-04T16:24:12.705 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59143.log 2024-06-04T16:24:12.705 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.139891.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.139891.log.gz 2024-06-04T16:24:12.705 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65923.log 2024-06-04T16:24:12.705 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.59143.log: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.59143.log.gz 2024-06-04T16:24:12.705 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100377.log 2024-06-04T16:24:12.705 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.65923.log: 93.1% -- replaced with /var/log/ceph/ceph-client.admin.65923.log.gz 2024-06-04T16:24:12.706 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140628.log 2024-06-04T16:24:12.706 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.100377.log: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.100377.log.gz 2024-06-04T16:24:12.706 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140305.log 2024-06-04T16:24:12.706 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.140628.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.140628.log.gz 2024-06-04T16:24:12.706 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83296.log 2024-06-04T16:24:12.706 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.140305.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.140305.log.gz 2024-06-04T16:24:12.706 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54972.log 2024-06-04T16:24:12.706 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.83296.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.83296.log.gz 2024-06-04T16:24:12.706 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69019.log 2024-06-04T16:24:12.707 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.54972.log: 84.1% -- replaced with /var/log/ceph/ceph-client.admin.54972.log.gz 2024-06-04T16:24:12.707 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49034.log 2024-06-04T16:24:12.707 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.69019.log: 92.6% -- replaced with /var/log/ceph/ceph-client.admin.69019.log.gz 2024-06-04T16:24:12.707 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93898.log 2024-06-04T16:24:12.707 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.49034.log: 85.0% -- replaced with /var/log/ceph/ceph-client.admin.49034.log.gz 2024-06-04T16:24:12.707 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40541.log 2024-06-04T16:24:12.707 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.93898.log: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.93898.log.gz 2024-06-04T16:24:12.707 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39408.log 2024-06-04T16:24:12.707 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.40541.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40541.log.gz 2024-06-04T16:24:12.708 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111569.log 2024-06-04T16:24:12.708 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.39408.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39408.log.gz 2024-06-04T16:24:12.708 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40136.log 2024-06-04T16:24:12.708 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.111569.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.111569.log.gz 2024-06-04T16:24:12.708 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105089.log 2024-06-04T16:24:12.708 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.40136.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40136.log.gz 2024-06-04T16:24:12.708 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72019.log 2024-06-04T16:24:12.708 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.105089.log: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.105089.log.gz 2024-06-04T16:24:12.708 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140259.log 2024-06-04T16:24:12.709 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.72019.log: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.72019.log.gz 2024-06-04T16:24:12.709 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106267.log 2024-06-04T16:24:12.709 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.140259.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.140259.log.gz 2024-06-04T16:24:12.709 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139753.log 2024-06-04T16:24:12.709 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.106267.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.106267.log.gz 2024-06-04T16:24:12.709 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140489.log 2024-06-04T16:24:12.709 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.139753.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.139753.log.gz 2024-06-04T16:24:12.709 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76463.log 2024-06-04T16:24:12.709 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.140489.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.140489.log.gz 2024-06-04T16:24:12.710 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.76519.log 2024-06-04T16:24:12.710 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.76463.log: 51.2% -- replaced with /var/log/ceph/ceph-client.admin.76463.log.gz 2024-06-04T16:24:12.710 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40538.log 2024-06-04T16:24:12.710 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.0.76519.log: 92.1% -- replaced with /var/log/ceph/ceph-client.0.76519.log.gz 2024-06-04T16:24:12.710 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96254.log 2024-06-04T16:24:12.710 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.40538.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40538.log.gz 2024-06-04T16:24:12.710 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67781.log 2024-06-04T16:24:12.710 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.96254.log: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.96254.log.gz 2024-06-04T16:24:12.710 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92720.log 2024-06-04T16:24:12.720 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.67781.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.67781.log.gz 2024-06-04T16:24:12.720 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41111.log 2024-06-04T16:24:12.720 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.92720.log: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.92720.log.gz 2024-06-04T16:24:12.720 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.43143.log 2024-06-04T16:24:12.720 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.41111.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41111.log.gz 2024-06-04T16:24:12.721 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64065.log 2024-06-04T16:24:12.721 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.0.43143.log: 43.9% -- replaced with /var/log/ceph/ceph-client.0.43143.log.gz 2024-06-04T16:24:12.721 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113336.log 2024-06-04T16:24:12.721 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.64065.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40539.log 2024-06-04T16:24:12.721 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.113336.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.113336.log.gz 2024-06-04T16:24:12.721 INFO:teuthology.orchestra.run.smithi144.stderr: 94.0% -- replaced with /var/log/ceph/ceph-client.admin.64065.log.gz 2024-06-04T16:24:12.721 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60369.log 2024-06-04T16:24:12.721 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.40539.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40539.log.gz 2024-06-04T16:24:12.722 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56739.log 2024-06-04T16:24:12.722 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.60369.log: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.60369.log.gz 2024-06-04T16:24:12.722 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109801.log 2024-06-04T16:24:12.722 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.56739.log: 84.3% -- replaced with /var/log/ceph/ceph-client.admin.56739.log.gz 2024-06-04T16:24:12.722 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128548.log 2024-06-04T16:24:12.722 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.109801.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.109801.log.gz 2024-06-04T16:24:12.722 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68400.log 2024-06-04T16:24:12.722 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.128548.log: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.128548.log.gz 2024-06-04T16:24:12.723 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77995.log 2024-06-04T16:24:12.727 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.68400.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114514.log 2024-06-04T16:24:12.728 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.77995.log: 82.4% -- replaced with /var/log/ceph/ceph-client.admin.77995.log.gz 2024-06-04T16:24:12.740 INFO:teuthology.orchestra.run.smithi144.stderr: 95.1%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112158.log 2024-06-04T16:24:12.742 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.114514.log: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.114514.log.gz 2024-06-04T16:24:12.742 INFO:teuthology.orchestra.run.smithi144.stderr: -- replaced with /var/log/ceph/ceph-client.admin.68400.log.gz 2024-06-04T16:24:12.742 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58554.log 2024-06-04T16:24:12.744 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.112158.log: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.112158.log.gz 2024-06-04T16:24:12.744 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46630.log 2024-06-04T16:24:12.744 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.58554.log: 85.0% -- replaced with /var/log/ceph/ceph-client.admin.58554.log.gz 2024-06-04T16:24:12.745 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129764.log 2024-06-04T16:24:12.746 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.46630.log: 82.7% -- replaced with /var/log/ceph/ceph-client.admin.46630.log.gz 2024-06-04T16:24:12.746 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117481.log 2024-06-04T16:24:12.746 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.129764.log: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.129764.log.gz 2024-06-04T16:24:12.748 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91542.log 2024-06-04T16:24:12.748 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.117481.log: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.117481.log.gz 2024-06-04T16:24:12.748 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.41314.log 2024-06-04T16:24:12.749 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.91542.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.91542.log.gz 2024-06-04T16:24:12.750 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40172.log 2024-06-04T16:24:12.751 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.0.41314.log: 95.9% -- replaced with /var/log/ceph/ceph-client.0.41314.log.gz 2024-06-04T16:24:12.751 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127185.log 2024-06-04T16:24:12.752 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.40172.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40172.log.gz 2024-06-04T16:24:12.752 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125969.log 2024-06-04T16:24:12.753 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.127185.log: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.127185.log.gz 2024-06-04T16:24:12.754 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81529.log 2024-06-04T16:24:12.755 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.125969.log: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.125969.log.gz 2024-06-04T16:24:12.755 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47219.log 2024-06-04T16:24:12.756 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.81529.log: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.81529.log.gz 2024-06-04T16:24:12.756 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57376.log 2024-06-04T16:24:12.757 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.47219.log: 83.3% -- replaced with /var/log/ceph/ceph-client.admin.47219.log.gz 2024-06-04T16:24:12.757 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62130.log 2024-06-04T16:24:12.759 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.57376.log: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.57376.log.gz 2024-06-04T16:24:12.759 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53205.log 2024-06-04T16:24:12.759 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.62130.log: 57.4% -- replaced with /var/log/ceph/ceph-client.admin.62130.log.gz 2024-06-04T16:24:12.761 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.131893.log 2024-06-04T16:24:12.761 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.53205.log: 85.0% -- replaced with /var/log/ceph/ceph-client.admin.53205.log.gz 2024-06-04T16:24:12.761 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54383.log 2024-06-04T16:24:12.763 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.0.131893.log: 84.3% -- replaced with /var/log/ceph/ceph-client.0.131893.log.gz 2024-06-04T16:24:12.763 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62476.log 2024-06-04T16:24:12.763 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.54383.log: 84.3% -- replaced with /var/log/ceph/ceph-client.admin.54383.log.gz 2024-06-04T16:24:12.764 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101555.log 2024-06-04T16:24:12.764 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.62476.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.62476.log.gz 2024-06-04T16:24:12.765 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40543.log 2024-06-04T16:24:12.766 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.101555.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.101555.log.gz 2024-06-04T16:24:12.766 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55561.log 2024-06-04T16:24:12.766 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.40543.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40543.log.gz 2024-06-04T16:24:12.767 INFO:teuthology.orchestra.run.smithi177.stderr: 91.6% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-06-04T16:24:12.769 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59756.log 2024-06-04T16:24:12.769 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.55561.log: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.55561.log.gz 2024-06-04T16:24:12.770 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67162.log 2024-06-04T16:24:12.770 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.59756.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59756.log.gz 2024-06-04T16:24:12.770 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107445.log 2024-06-04T16:24:12.772 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.67162.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.67162.log.gz 2024-06-04T16:24:12.772 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57352.log 2024-06-04T16:24:12.773 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.107445.log: 84.9% -- replaced with /var/log/ceph/ceph-client.admin.107445.log.gz 2024-06-04T16:24:12.773 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62623.log 2024-06-04T16:24:12.774 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.57352.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57352.log.gz 2024-06-04T16:24:12.774 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47808.log 2024-06-04T16:24:12.785 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.62623.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51390.log 2024-06-04T16:24:12.786 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.47808.log: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.47808.log.gz 2024-06-04T16:24:12.791 INFO:teuthology.orchestra.run.smithi144.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.62623.log.gz 2024-06-04T16:24:12.793 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104500.log 2024-06-04T16:24:12.793 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.51390.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51390.log.gz 2024-06-04T16:24:12.793 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118707.log 2024-06-04T16:24:12.794 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.104500.log: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.104500.log.gz 2024-06-04T16:24:12.795 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.118707.log: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.118707.log.gz 2024-06-04T16:24:13.021 INFO:teuthology.orchestra.run.smithi177.stderr: 92.4% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-06-04T16:24:13.109 INFO:teuthology.orchestra.run.smithi144.stderr: 93.0% -- replaced with /var/log/ceph/rgw.ceph.client.0.log.gz 2024-06-04T16:24:13.266 INFO:teuthology.orchestra.run.smithi144.stderr: 92.3% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-06-04T16:24:13.766 INFO:teuthology.orchestra.run.smithi144.stderr: 91.5% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-06-04T16:24:16.378 INFO:teuthology.orchestra.run.smithi177.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-06-04T16:24:16.476 INFO:teuthology.orchestra.run.smithi144.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-06-04T16:24:17.170 INFO:teuthology.orchestra.run.smithi177.stderr: 94.2% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-06-04T16:24:17.295 INFO:teuthology.orchestra.run.smithi144.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-06-04T16:24:18.805 INFO:teuthology.orchestra.run.smithi144.stderr: 94.1% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-06-04T16:24:20.454 INFO:teuthology.orchestra.run.smithi177.stderr: 94.5% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-06-04T16:24:20.781 INFO:teuthology.orchestra.run.smithi144.stderr: 94.3% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-06-04T16:24:20.783 INFO:teuthology.orchestra.run.smithi144.stderr: 2024-06-04T16:24:20.783 INFO:teuthology.orchestra.run.smithi144.stderr:real 0m8.287s 2024-06-04T16:24:20.783 INFO:teuthology.orchestra.run.smithi144.stderr:user 0m25.007s 2024-06-04T16:24:20.783 INFO:teuthology.orchestra.run.smithi144.stderr:sys 0m1.062s 2024-06-04T16:24:23.767 INFO:teuthology.orchestra.run.smithi177.stderr: 95.0% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-06-04T16:24:23.769 INFO:teuthology.orchestra.run.smithi177.stderr: 2024-06-04T16:24:23.769 INFO:teuthology.orchestra.run.smithi177.stderr:real 0m11.229s 2024-06-04T16:24:23.769 INFO:teuthology.orchestra.run.smithi177.stderr:user 0m27.194s 2024-06-04T16:24:23.770 INFO:teuthology.orchestra.run.smithi177.stderr:sys 0m1.031s 2024-06-04T16:24:23.770 INFO:tasks.ceph:Archiving logs... 2024-06-04T16:24:23.770 DEBUG:teuthology.misc:Transferring archived files from smithi144:/var/log/ceph to /home/teuthworker/archive/cbodley-2024-06-04_15:11:52-rgw-main-distro-default-smithi/7740770/remote/smithi144/log 2024-06-04T16:24:23.771 DEBUG:teuthology.orchestra.run.smithi144:> sudo tar c -f - -C /var/log/ceph -- . 2024-06-04T16:24:27.288 DEBUG:teuthology.misc:Transferring archived files from smithi177:/var/log/ceph to /home/teuthworker/archive/cbodley-2024-06-04_15:11:52-rgw-main-distro-default-smithi/7740770/remote/smithi177/log 2024-06-04T16:24:27.288 DEBUG:teuthology.orchestra.run.smithi177:> sudo tar c -f - -C /var/log/ceph -- . 2024-06-04T16:24:30.924 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-06-04T16:24:30.935 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-06-04T16:24:30.936 DEBUG:teuthology.orchestra.run.smithi144:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-06-04T16:24:30.939 DEBUG:teuthology.orchestra.run.smithi177:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-06-04T16:24:31.037 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-06-04T16:24:31.047 INFO:teuthology.task.clock:Checking final clock skew... 2024-06-04T16:24:31.047 DEBUG:teuthology.orchestra.run.smithi144:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-06-04T16:24:31.050 DEBUG:teuthology.orchestra.run.smithi177:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-06-04T16:24:31.080 INFO:teuthology.orchestra.run.smithi144.stderr:bash: line 1: ntpq: command not found 2024-06-04T16:24:31.081 INFO:teuthology.orchestra.run.smithi177.stderr:bash: line 1: ntpq: command not found 2024-06-04T16:24:31.085 INFO:teuthology.orchestra.run.smithi144.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-06-04T16:24:31.086 INFO:teuthology.orchestra.run.smithi144.stdout:=============================================================================== 2024-06-04T16:24:31.086 INFO:teuthology.orchestra.run.smithi144.stdout:^* hv01.front.sepia.ceph.com 3 6 377 39 -1406us[-1424us] +/- 52ms 2024-06-04T16:24:31.086 INFO:teuthology.orchestra.run.smithi144.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 43 -782us[ -800us] +/- 61ms 2024-06-04T16:24:31.086 INFO:teuthology.orchestra.run.smithi144.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 37 +3570us[+3570us] +/- 86ms 2024-06-04T16:24:31.086 INFO:teuthology.orchestra.run.smithi144.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-06-04T16:24:31.086 INFO:teuthology.orchestra.run.smithi177.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-06-04T16:24:31.086 INFO:teuthology.orchestra.run.smithi177.stdout:=============================================================================== 2024-06-04T16:24:31.086 INFO:teuthology.orchestra.run.smithi177.stdout:^* hv01.front.sepia.ceph.com 3 6 377 41 -1402us[-1405us] +/- 52ms 2024-06-04T16:24:31.087 INFO:teuthology.orchestra.run.smithi177.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 41 -734us[ -737us] +/- 62ms 2024-06-04T16:24:31.087 INFO:teuthology.orchestra.run.smithi177.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 41 +3564us[+3560us] +/- 86ms 2024-06-04T16:24:31.087 INFO:teuthology.orchestra.run.smithi177.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-06-04T16:24:31.088 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-06-04T16:24:31.098 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-06-04T16:24:31.098 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-06-04T16:24:31.118 DEBUG:teuthology.orchestra.run.smithi144:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-06-04T16:24:31.209 DEBUG:teuthology.orchestra.run.smithi177:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-06-04T16:24:31.289 DEBUG:teuthology.orchestra.run.smithi144:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-06-04T16:24:31.332 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-06-04T16:24:31.332 DEBUG:teuthology.orchestra.run.smithi177:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-06-04T16:24:31.375 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-06-04T16:24:31.375 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-06-04T16:24:31.386 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-06-04T16:24:31.401 INFO:teuthology.task.internal:Duration was 2378.916176 seconds 2024-06-04T16:24:31.402 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-06-04T16:24:31.436 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-06-04T16:24:31.436 DEBUG:teuthology.orchestra.run.smithi144:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-06-04T16:24:31.438 DEBUG:teuthology.orchestra.run.smithi177:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-06-04T16:24:31.490 INFO:teuthology.orchestra.run.smithi144.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-06-04T16:24:31.492 INFO:teuthology.orchestra.run.smithi177.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-06-04T16:24:31.791 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-06-04T16:24:31.792 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi144.front.sepia.ceph.com 2024-06-04T16:24:31.792 DEBUG:teuthology.orchestra.run.smithi144:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-06-04T16:24:31.826 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi177.front.sepia.ceph.com 2024-06-04T16:24:31.826 DEBUG:teuthology.orchestra.run.smithi177:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-06-04T16:24:31.863 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-06-04T16:24:31.863 DEBUG:teuthology.orchestra.run.smithi144:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-06-04T16:24:31.869 DEBUG:teuthology.orchestra.run.smithi177:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-06-04T16:24:31.943 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-06-04T16:24:31.944 DEBUG:teuthology.orchestra.run.smithi144:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-06-04T16:24:31.949 DEBUG:teuthology.orchestra.run.smithi177:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-06-04T16:24:32.094 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-06-04T16:24:32.105 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-06-04T16:24:32.105 DEBUG:teuthology.orchestra.run.smithi144:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-06-04T16:24:32.143 DEBUG:teuthology.orchestra.run.smithi177:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-06-04T16:24:32.182 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-06-04T16:24:32.193 DEBUG:teuthology.orchestra.run.smithi144:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-06-04T16:24:32.195 DEBUG:teuthology.orchestra.run.smithi177:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-06-04T16:24:32.229 INFO:teuthology.orchestra.run.smithi144.stdout:kernel.core_pattern = core 2024-06-04T16:24:32.258 INFO:teuthology.orchestra.run.smithi177.stdout:kernel.core_pattern = core 2024-06-04T16:24:32.286 DEBUG:teuthology.orchestra.run.smithi144:> test -e /home/ubuntu/cephtest/archive/coredump 2024-06-04T16:24:32.313 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-06-04T16:24:32.314 DEBUG:teuthology.orchestra.run.smithi177:> test -e /home/ubuntu/cephtest/archive/coredump 2024-06-04T16:24:32.351 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-06-04T16:24:32.351 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-06-04T16:24:32.362 INFO:teuthology.task.internal:Transferring archived files... 2024-06-04T16:24:32.363 DEBUG:teuthology.misc:Transferring archived files from smithi144:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/cbodley-2024-06-04_15:11:52-rgw-main-distro-default-smithi/7740770/remote/smithi144 2024-06-04T16:24:32.363 DEBUG:teuthology.orchestra.run.smithi144:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-06-04T16:24:32.413 DEBUG:teuthology.misc:Transferring archived files from smithi177:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/cbodley-2024-06-04_15:11:52-rgw-main-distro-default-smithi/7740770/remote/smithi177 2024-06-04T16:24:32.413 DEBUG:teuthology.orchestra.run.smithi177:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-06-04T16:24:32.458 INFO:teuthology.task.internal:Removing archive directory... 2024-06-04T16:24:32.458 DEBUG:teuthology.orchestra.run.smithi144:> rm -rf -- /home/ubuntu/cephtest/archive 2024-06-04T16:24:32.460 DEBUG:teuthology.orchestra.run.smithi177:> rm -rf -- /home/ubuntu/cephtest/archive 2024-06-04T16:24:32.521 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-06-04T16:24:32.534 INFO:teuthology.task.internal:Not uploading archives. 2024-06-04T16:24:32.534 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-06-04T16:24:32.552 INFO:teuthology.task.internal:Tidying up after the test... 2024-06-04T16:24:32.552 DEBUG:teuthology.orchestra.run.smithi144:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-06-04T16:24:32.555 DEBUG:teuthology.orchestra.run.smithi177:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-06-04T16:24:32.580 INFO:teuthology.orchestra.run.smithi144.stdout: 265304 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Jun 4 16:24 /home/ubuntu/cephtest 2024-06-04T16:24:32.591 INFO:teuthology.orchestra.run.smithi177.stdout: 266045 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Jun 4 16:24 /home/ubuntu/cephtest 2024-06-04T16:24:32.592 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-06-04T16:24:32.603 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-06-04T16:24:32.693 INFO:teuthology.run:Summary data: description: rgw/verify/{0-install clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability inline-data$/{on} msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/ec s3tests-branch sharding$/{default} striping$/{stripe-equals-chunk} supported-random-distro$/{centos_latest} tasks/{bucket-check cls mp_reupload ragweed reshard s3tests-java s3tests versioning} validater/lockdep} duration: 2378.9161763191223 failure_reason: 'Command failed (s3 tests against rgw) on smithi144 with status 1: "source /home/ubuntu/cephtest/tox-venv/bin/activate && cd /home/ubuntu/cephtest/s3-tests-client.0 && S3TEST_CONF=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf BOTO_CONFIG=/home/ubuntu/cephtest/boto-client.0.cfg REQUESTS_CA_BUNDLE=/etc/pki/tls/certs/ca-bundle.crt tox -- -v -m ''not fails_on_rgw and not lifecycle_expiration and not lifecycle_transition and not cloud_transition and not test_of_sts and not webidentity_test and not fails_with_subdomain and not sse_s3''"' flavor: default owner: scheduled_cbodley@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=17520e1378824833b1622d18488e794d status: fail success: false 2024-06-04T16:24:32.694 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-06-04T16:24:32.775 INFO:teuthology.run:FAIL